2023-11-30T16:51:43.625 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-11-30T16:51:43.626 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472115 --verbose --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} -- /home/teuthworker/archive/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472115/orig.config.yaml 2023-11-30T16:51:43.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T16:51:43.758 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472115 branch: wip-yuri8-testing-2023-11-29-0706-pacific description: fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} email: yweinste@redhat.com first_in_suite: false job_id: '7472115' kernel: client: sha1: distro kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri8-testing-2023-11-29-0706-pacific ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri8-testing-2023-11-29-0706-pacific sha1: 0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 416 sha1: 0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri8-testing-2023-11-29-0706-pacific suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9 targets: smithi049.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGWtCmC456vXsvM+Bn7/qfysPkkMTNCua9SIzCCxA1MXbgbTPPxwvKFdbdC7RzEivFCAkkaTQnUfUN/5fjWYzcs= smithi115.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL2YEHmGElf6OzvqTeRZfpqQ6SDdXrnJF0LarYALtARSHEsaJ+XW3FHDs8f855sCsmA+Xlv2nPq3H1Fzj/Dqg8s= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_snap_schedules teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: f2de108beb0a6dde7f3e6c96039071828a1f6269 timestamp: 2023-11-30_15:46:13 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-30T16:51:43.758 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9/qa; will attempt to use it 2023-11-30T16:51:43.759 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9/qa/tasks 2023-11-30T16:51:43.759 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-30T16:51:43.761 INFO:teuthology.task.internal:Checking packages... 2023-11-30T16:51:43.790 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9' 2023-11-30T16:51:43.790 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-30T16:51:43.790 INFO:teuthology.packaging:ref: None 2023-11-30T16:51:43.790 INFO:teuthology.packaging:tag: None 2023-11-30T16:51:43.790 INFO:teuthology.packaging:branch: wip-yuri8-testing-2023-11-29-0706-pacific 2023-11-30T16:51:43.790 INFO:teuthology.packaging:sha1: 0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9 2023-11-30T16:51:43.791 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri8-testing-2023-11-29-0706-pacific 2023-11-30T16:51:44.011 INFO:teuthology.task.internal:Found packages for ceph version 16.2.14-328.g0dc074ce 2023-11-30T16:51:44.012 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-30T16:51:44.018 INFO:teuthology.task.internal:no buildpackages task found 2023-11-30T16:51:44.018 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-30T16:51:44.044 INFO:teuthology.task.internal:Saving configuration 2023-11-30T16:51:44.060 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-30T16:51:44.077 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-30T16:51:44.102 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472115', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-30 16:44:45.201688', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGWtCmC456vXsvM+Bn7/qfysPkkMTNCua9SIzCCxA1MXbgbTPPxwvKFdbdC7RzEivFCAkkaTQnUfUN/5fjWYzcs='} 2023-11-30T16:51:44.125 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472115', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-30 16:44:45.203314', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL2YEHmGElf6OzvqTeRZfpqQ6SDdXrnJF0LarYALtARSHEsaJ+XW3FHDs8f855sCsmA+Xlv2nPq3H1Fzj/Dqg8s='} 2023-11-30T16:51:44.125 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-30T16:51:44.131 INFO:teuthology.task.internal:roles: ubuntu@smithi049.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-30T16:51:44.131 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-30T16:51:44.131 INFO:teuthology.run_tasks:Running task console_log... 2023-11-30T16:51:44.233 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1689bcfa60>, signals=[15]) 2023-11-30T16:51:44.233 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-30T16:51:44.239 INFO:teuthology.task.internal:Opening connections... 2023-11-30T16:51:44.239 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi049.front.sepia.ceph.com 2023-11-30T16:51:44.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T16:51:44.312 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi115.front.sepia.ceph.com 2023-11-30T16:51:44.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T16:51:44.381 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-30T16:51:44.388 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2023-11-30T16:51:44.406 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2023-11-30T16:51:44.406 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2023-11-30T16:51:44.462 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="Red Hat Enterprise Linux" 2023-11-30T16:51:44.463 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8.4 (Ootpa)" 2023-11-30T16:51:44.463 INFO:teuthology.orchestra.run.smithi049.stdout:ID="rhel" 2023-11-30T16:51:44.463 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="fedora" 2023-11-30T16:51:44.463 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8.4" 2023-11-30T16:51:44.463 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8" 2023-11-30T16:51:44.463 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-11-30T16:51:44.463 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2023-11-30T16:51:44.463 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-11-30T16:51:44.463 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://www.redhat.com/" 2023-11-30T16:51:44.463 INFO:teuthology.orchestra.run.smithi049.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-30T16:51:44.463 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-30T16:51:44.463 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T16:51:44.463 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-30T16:51:44.463 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-11-30T16:51:44.464 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-30T16:51:44.464 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-11-30T16:51:44.464 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2023-11-30T16:51:44.488 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2023-11-30T16:51:44.505 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2023-11-30T16:51:44.505 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2023-11-30T16:51:44.561 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="Red Hat Enterprise Linux" 2023-11-30T16:51:44.561 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8.4 (Ootpa)" 2023-11-30T16:51:44.561 INFO:teuthology.orchestra.run.smithi115.stdout:ID="rhel" 2023-11-30T16:51:44.561 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="fedora" 2023-11-30T16:51:44.561 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8.4" 2023-11-30T16:51:44.561 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8" 2023-11-30T16:51:44.561 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-11-30T16:51:44.561 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2023-11-30T16:51:44.562 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-11-30T16:51:44.562 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://www.redhat.com/" 2023-11-30T16:51:44.562 INFO:teuthology.orchestra.run.smithi115.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-30T16:51:44.562 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-30T16:51:44.562 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T16:51:44.562 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-30T16:51:44.562 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-11-30T16:51:44.562 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-30T16:51:44.562 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-11-30T16:51:44.563 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2023-11-30T16:51:44.587 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-30T16:51:44.597 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-30T16:51:44.636 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-30T16:51:44.636 DEBUG:teuthology.orchestra.run.smithi049:> test '!' -e /home/ubuntu/cephtest 2023-11-30T16:51:44.639 DEBUG:teuthology.orchestra.run.smithi115:> test '!' -e /home/ubuntu/cephtest 2023-11-30T16:51:44.655 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-30T16:51:44.670 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-30T16:51:44.671 DEBUG:teuthology.orchestra.run.smithi049:> test -z $(ls -A /var/lib/ceph) 2023-11-30T16:51:44.696 DEBUG:teuthology.orchestra.run.smithi115:> test -z $(ls -A /var/lib/ceph) 2023-11-30T16:51:44.710 INFO:teuthology.orchestra.run.smithi049.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-11-30T16:51:44.713 INFO:teuthology.orchestra.run.smithi115.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-11-30T16:51:44.714 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-30T16:51:44.772 INFO:teuthology.run_tasks:Running task kernel... 2023-11-30T16:51:44.788 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-11-30T16:51:44.788 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-11-30T16:51:44.788 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-11-30T16:51:44.788 DEBUG:teuthology.orchestra.run.smithi049:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-30T16:51:44.789 DEBUG:teuthology.orchestra.run.smithi115:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-30T16:51:44.804 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-30T16:51:44.805 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2023-11-30T16:51:44.806 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-30T16:51:44.806 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2023-11-30T16:51:44.861 INFO:teuthology.orchestra.run.smithi115.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-11-30T16:51:44.861 INFO:teuthology.task.kernel:Running kernel on smithi115: 4.18.0-305.25.1.el8_4.x86_64 2023-11-30T16:51:44.861 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum install -y kernel 2023-11-30T16:51:44.863 INFO:teuthology.orchestra.run.smithi049.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-11-30T16:51:44.863 INFO:teuthology.task.kernel:Running kernel on smithi049: 4.18.0-305.25.1.el8_4.x86_64 2023-11-30T16:51:44.863 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum install -y kernel 2023-11-30T16:51:46.303 INFO:teuthology.orchestra.run.smithi049.stdout:Updating Subscription Management repositories. 2023-11-30T16:51:46.303 INFO:teuthology.orchestra.run.smithi049.stdout:Unable to read consumer identity 2023-11-30T16:51:46.363 INFO:teuthology.orchestra.run.smithi115.stdout:Updating Subscription Management repositories. 2023-11-30T16:51:46.364 INFO:teuthology.orchestra.run.smithi115.stdout:Unable to read consumer identity 2023-11-30T16:51:47.681 INFO:teuthology.orchestra.run.smithi049.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2023-11-30T16:51:47.718 INFO:teuthology.orchestra.run.smithi115.stdout:Copr repo for python3-asyncssh owned by ceph 31 kB/s | 3.5 kB 00:00 2023-11-30T16:51:48.351 INFO:teuthology.orchestra.run.smithi049.stdout:Extra Packages for Enterprise Linux 26 MB/s | 16 MB 00:00 2023-11-30T16:51:48.735 INFO:teuthology.orchestra.run.smithi115.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:00 2023-11-30T16:51:51.842 INFO:teuthology.orchestra.run.smithi049.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2023-11-30T16:51:51.967 INFO:teuthology.orchestra.run.smithi115.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2023-11-30T16:51:52.601 INFO:teuthology.orchestra.run.smithi049.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-11-30T16:51:52.601 INFO:teuthology.orchestra.run.smithi049.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-11-30T16:51:52.601 INFO:teuthology.orchestra.run.smithi049.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-11-30T16:51:52.662 INFO:teuthology.orchestra.run.smithi115.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-11-30T16:51:52.662 INFO:teuthology.orchestra.run.smithi115.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-11-30T16:51:52.662 INFO:teuthology.orchestra.run.smithi115.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-11-30T16:51:52.749 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-11-30T16:51:52.750 INFO:teuthology.orchestra.run.smithi049.stdout:Nothing to do. 2023-11-30T16:51:52.751 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-11-30T16:51:52.808 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2023-11-30T16:51:52.809 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2023-11-30T16:51:52.809 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2023-11-30T16:51:52.858 DEBUG:teuthology.orchestra.run.smithi049:> echo no | sudo yum reinstall kernel || true 2023-11-30T16:51:52.928 DEBUG:teuthology.orchestra.run.smithi115:> echo no | sudo yum reinstall kernel || true 2023-11-30T16:51:53.225 INFO:teuthology.orchestra.run.smithi049.stdout:Updating Subscription Management repositories. 2023-11-30T16:51:53.225 INFO:teuthology.orchestra.run.smithi049.stdout:Unable to read consumer identity 2023-11-30T16:51:53.270 INFO:teuthology.orchestra.run.smithi115.stdout:Updating Subscription Management repositories. 2023-11-30T16:51:53.270 INFO:teuthology.orchestra.run.smithi115.stdout:Unable to read consumer identity 2023-11-30T16:51:53.535 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:00:02 ago on Thu 30 Nov 2023 04:51:51 PM UTC. 2023-11-30T16:51:53.562 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:00:02 ago on Thu 30 Nov 2023 04:51:51 PM UTC. 2023-11-30T16:51:53.670 INFO:teuthology.orchestra.run.smithi049.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-11-30T16:51:53.671 INFO:teuthology.orchestra.run.smithi049.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-11-30T16:51:53.671 INFO:teuthology.orchestra.run.smithi049.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-11-30T16:51:53.691 INFO:teuthology.orchestra.run.smithi115.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-11-30T16:51:53.692 INFO:teuthology.orchestra.run.smithi115.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-11-30T16:51:53.692 INFO:teuthology.orchestra.run.smithi115.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-11-30T16:51:53.706 INFO:teuthology.orchestra.run.smithi049.stderr:Error: No packages marked for reinstall. 2023-11-30T16:51:53.709 INFO:teuthology.orchestra.run.smithi115.stderr:Error: No packages marked for reinstall. 2023-11-30T16:51:53.758 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum reinstall -y kernel || true 2023-11-30T16:51:53.759 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum reinstall -y kernel || true 2023-11-30T16:51:54.102 INFO:teuthology.orchestra.run.smithi115.stdout:Updating Subscription Management repositories. 2023-11-30T16:51:54.102 INFO:teuthology.orchestra.run.smithi115.stdout:Unable to read consumer identity 2023-11-30T16:51:54.122 INFO:teuthology.orchestra.run.smithi049.stdout:Updating Subscription Management repositories. 2023-11-30T16:51:54.122 INFO:teuthology.orchestra.run.smithi049.stdout:Unable to read consumer identity 2023-11-30T16:51:54.385 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:00:03 ago on Thu 30 Nov 2023 04:51:51 PM UTC. 2023-11-30T16:51:54.423 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:00:03 ago on Thu 30 Nov 2023 04:51:51 PM UTC. 2023-11-30T16:51:54.515 INFO:teuthology.orchestra.run.smithi115.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-11-30T16:51:54.516 INFO:teuthology.orchestra.run.smithi115.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-11-30T16:51:54.516 INFO:teuthology.orchestra.run.smithi115.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-11-30T16:51:54.526 INFO:teuthology.orchestra.run.smithi115.stderr:Error: No packages marked for reinstall. 2023-11-30T16:51:54.561 INFO:teuthology.orchestra.run.smithi049.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-11-30T16:51:54.562 INFO:teuthology.orchestra.run.smithi049.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-11-30T16:51:54.562 INFO:teuthology.orchestra.run.smithi049.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-11-30T16:51:54.575 DEBUG:teuthology.orchestra.run.smithi115:> rpm -q kernel | sort -rV | head -n 1 2023-11-30T16:51:54.576 INFO:teuthology.orchestra.run.smithi049.stderr:Error: No packages marked for reinstall. 2023-11-30T16:51:54.626 DEBUG:teuthology.orchestra.run.smithi049:> rpm -q kernel | sort -rV | head -n 1 2023-11-30T16:51:54.699 INFO:teuthology.orchestra.run.smithi115.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-11-30T16:51:54.700 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-11-30T16:51:54.700 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-11-30T16:51:54.700 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-30T16:51:54.700 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-30T16:51:54.700 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-11-30T16:51:54.700 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi115.front.sepia.ceph.com, path=None, version=distro) 2023-11-30T16:51:54.700 DEBUG:teuthology.orchestra.run.smithi115:> rpm -q kernel | sort -rV | head -n 1 2023-11-30T16:51:54.759 INFO:teuthology.orchestra.run.smithi049.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-11-30T16:51:54.759 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-11-30T16:51:54.759 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-11-30T16:51:54.759 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-30T16:51:54.759 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-30T16:51:54.759 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-11-30T16:51:54.760 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi049.front.sepia.ceph.com, path=None, version=distro) 2023-11-30T16:51:54.760 DEBUG:teuthology.orchestra.run.smithi049:> rpm -q kernel | sort -rV | head -n 1 2023-11-30T16:51:54.825 INFO:teuthology.orchestra.run.smithi115.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-11-30T16:51:54.825 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-11-30T16:51:54.825 DEBUG:teuthology.orchestra.run.smithi115:> sudo rpm -qi grub2-tools 2023-11-30T16:51:54.852 INFO:teuthology.orchestra.run.smithi115.stdout:Name : grub2-tools 2023-11-30T16:51:54.852 INFO:teuthology.orchestra.run.smithi115.stdout:Epoch : 1 2023-11-30T16:51:54.852 INFO:teuthology.orchestra.run.smithi115.stdout:Version : 2.02 2023-11-30T16:51:54.853 INFO:teuthology.orchestra.run.smithi115.stdout:Release : 99.el8_4.1 2023-11-30T16:51:54.853 INFO:teuthology.orchestra.run.smithi115.stdout:Architecture: x86_64 2023-11-30T16:51:54.853 INFO:teuthology.orchestra.run.smithi115.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-11-30T16:51:54.853 INFO:teuthology.orchestra.run.smithi115.stdout:Group : System Environment/Base 2023-11-30T16:51:54.853 INFO:teuthology.orchestra.run.smithi115.stdout:Size : 9264631 2023-11-30T16:51:54.853 INFO:teuthology.orchestra.run.smithi115.stdout:License : GPLv3+ 2023-11-30T16:51:54.854 INFO:teuthology.orchestra.run.smithi115.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-11-30T16:51:54.854 INFO:teuthology.orchestra.run.smithi115.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-11-30T16:51:54.854 INFO:teuthology.orchestra.run.smithi115.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-11-30T16:51:54.854 INFO:teuthology.orchestra.run.smithi115.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-11-30T16:51:54.854 INFO:teuthology.orchestra.run.smithi115.stdout:Relocations : (not relocatable) 2023-11-30T16:51:54.854 INFO:teuthology.orchestra.run.smithi115.stdout:Packager : Red Hat, Inc. 2023-11-30T16:51:54.854 INFO:teuthology.orchestra.run.smithi115.stdout:Vendor : Red Hat, Inc. 2023-11-30T16:51:54.854 INFO:teuthology.orchestra.run.smithi115.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-30T16:51:54.855 INFO:teuthology.orchestra.run.smithi115.stdout:Summary : Support tools for GRUB. 2023-11-30T16:51:54.855 INFO:teuthology.orchestra.run.smithi115.stdout:Description : 2023-11-30T16:51:54.855 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T16:51:54.855 INFO:teuthology.orchestra.run.smithi115.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-30T16:51:54.855 INFO:teuthology.orchestra.run.smithi115.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-30T16:51:54.855 INFO:teuthology.orchestra.run.smithi115.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-30T16:51:54.855 INFO:teuthology.orchestra.run.smithi115.stdout:hardware devices. 2023-11-30T16:51:54.855 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T16:51:54.856 INFO:teuthology.orchestra.run.smithi115.stdout:This subpackage provides tools for support of all platforms. 2023-11-30T16:51:54.857 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-30T16:51:54.857 INFO:teuthology.task.kernel:Updating grub on smithi115 to boot 4.18.0-425.3.1.el8.x86_64 2023-11-30T16:51:54.857 DEBUG:teuthology.orchestra.run.smithi115:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-30T16:51:54.890 INFO:teuthology.orchestra.run.smithi049.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-11-30T16:51:54.891 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-11-30T16:51:54.891 DEBUG:teuthology.orchestra.run.smithi049:> sudo rpm -qi grub2-tools 2023-11-30T16:51:54.918 INFO:teuthology.orchestra.run.smithi049.stdout:Name : grub2-tools 2023-11-30T16:51:54.918 INFO:teuthology.orchestra.run.smithi049.stdout:Epoch : 1 2023-11-30T16:51:54.918 INFO:teuthology.orchestra.run.smithi049.stdout:Version : 2.02 2023-11-30T16:51:54.919 INFO:teuthology.orchestra.run.smithi049.stdout:Release : 99.el8_4.1 2023-11-30T16:51:54.919 INFO:teuthology.orchestra.run.smithi049.stdout:Architecture: x86_64 2023-11-30T16:51:54.919 INFO:teuthology.orchestra.run.smithi049.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-11-30T16:51:54.919 INFO:teuthology.orchestra.run.smithi049.stdout:Group : System Environment/Base 2023-11-30T16:51:54.919 INFO:teuthology.orchestra.run.smithi049.stdout:Size : 9264631 2023-11-30T16:51:54.919 INFO:teuthology.orchestra.run.smithi049.stdout:License : GPLv3+ 2023-11-30T16:51:54.919 INFO:teuthology.orchestra.run.smithi049.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-11-30T16:51:54.919 INFO:teuthology.orchestra.run.smithi049.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-11-30T16:51:54.919 INFO:teuthology.orchestra.run.smithi049.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-11-30T16:51:54.919 INFO:teuthology.orchestra.run.smithi049.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-11-30T16:51:54.919 INFO:teuthology.orchestra.run.smithi049.stdout:Relocations : (not relocatable) 2023-11-30T16:51:54.919 INFO:teuthology.orchestra.run.smithi049.stdout:Packager : Red Hat, Inc. 2023-11-30T16:51:54.919 INFO:teuthology.orchestra.run.smithi049.stdout:Vendor : Red Hat, Inc. 2023-11-30T16:51:54.919 INFO:teuthology.orchestra.run.smithi049.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-30T16:51:54.919 INFO:teuthology.orchestra.run.smithi049.stdout:Summary : Support tools for GRUB. 2023-11-30T16:51:54.920 INFO:teuthology.orchestra.run.smithi049.stdout:Description : 2023-11-30T16:51:54.920 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T16:51:54.920 INFO:teuthology.orchestra.run.smithi049.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-30T16:51:54.920 INFO:teuthology.orchestra.run.smithi049.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-30T16:51:54.920 INFO:teuthology.orchestra.run.smithi049.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-30T16:51:54.920 INFO:teuthology.orchestra.run.smithi049.stdout:hardware devices. 2023-11-30T16:51:54.920 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T16:51:54.920 INFO:teuthology.orchestra.run.smithi049.stdout:This subpackage provides tools for support of all platforms. 2023-11-30T16:51:54.921 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-30T16:51:54.921 INFO:teuthology.task.kernel:Updating grub on smithi049 to boot 4.18.0-425.3.1.el8.x86_64 2023-11-30T16:51:54.921 DEBUG:teuthology.orchestra.run.smithi049:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-30T16:51:56.154 INFO:teuthology.orchestra.run.smithi115.stderr:Generating grub configuration file ... 2023-11-30T16:51:56.246 INFO:teuthology.orchestra.run.smithi049.stderr:Generating grub configuration file ... 2023-11-30T16:51:58.326 INFO:teuthology.orchestra.run.smithi049.stderr:done 2023-11-30T16:51:58.329 DEBUG:teuthology.orchestra.run.smithi049:> mktemp 2023-11-30T16:51:58.329 INFO:teuthology.orchestra.run.smithi115.stderr:done 2023-11-30T16:51:58.330 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2023-11-30T16:51:58.344 INFO:teuthology.orchestra.run.smithi049.stdout:/tmp/tmp.DJDLeXtS09 2023-11-30T16:51:58.345 DEBUG:teuthology.orchestra.run.smithi049:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.DJDLeXtS09 2023-11-30T16:51:58.346 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.1L4zk45ZTm 2023-11-30T16:51:58.346 DEBUG:teuthology.orchestra.run.smithi115:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.1L4zk45ZTm 2023-11-30T16:51:58.416 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.1L4zk45ZTm 2023-11-30T16:51:58.441 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0666 /tmp/tmp.DJDLeXtS09 2023-11-30T16:51:58.554 DEBUG:teuthology.orchestra.remote:smithi049:/tmp/tmp.DJDLeXtS09 is 6KB 2023-11-30T16:51:58.585 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.1L4zk45ZTm is 6KB 2023-11-30T16:51:58.602 DEBUG:teuthology.orchestra.run.smithi049:> rm -fr /tmp/tmp.DJDLeXtS09 2023-11-30T16:51:58.616 DEBUG:teuthology.orchestra.run.smithi049:> sudo /bin/ls /boot/loader/entries || true 2023-11-30T16:51:58.633 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.1L4zk45ZTm 2023-11-30T16:51:58.647 DEBUG:teuthology.orchestra.run.smithi115:> sudo /bin/ls /boot/loader/entries || true 2023-11-30T16:51:58.697 INFO:teuthology.orchestra.run.smithi049.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-11-30T16:51:58.697 INFO:teuthology.orchestra.run.smithi049.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-11-30T16:51:58.697 INFO:teuthology.orchestra.run.smithi049.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-11-30T16:51:58.697 INFO:teuthology.orchestra.run.smithi049.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-11-30T16:51:58.698 DEBUG:teuthology.orchestra.run.smithi049:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-11-30T16:51:58.708 INFO:teuthology.orchestra.run.smithi115.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-11-30T16:51:58.708 INFO:teuthology.orchestra.run.smithi115.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-11-30T16:51:58.708 INFO:teuthology.orchestra.run.smithi115.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-11-30T16:51:58.708 INFO:teuthology.orchestra.run.smithi115.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-11-30T16:51:58.709 DEBUG:teuthology.orchestra.run.smithi115:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-11-30T16:51:58.847 DEBUG:teuthology.orchestra.run.smithi049:> sudo shutdown -r now 2023-11-30T16:51:58.916 DEBUG:teuthology.orchestra.run.smithi115:> sudo shutdown -r now 2023-11-30T16:52:28.878 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-11-30T16:52:28.879 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-11-30T16:52:28.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T16:52:28.918 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-11-30T16:52:28.919 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-11-30T16:52:28.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T16:52:47.330 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-11-30T16:52:47.334 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-11-30T16:52:56.338 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-11-30T16:52:56.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T16:52:56.340 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-11-30T16:52:56.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T16:52:59.394 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-11-30T16:52:59.394 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-11-30T16:53:11.406 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-11-30T16:53:11.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T16:53:11.409 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-11-30T16:53:11.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T16:53:14.466 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-11-30T16:53:29.481 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-11-30T16:53:29.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T16:53:29.826 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-11-30T16:53:32.550 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-11-30T16:53:44.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-11-30T16:53:44.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T16:53:45.259 DEBUG:teuthology.orchestra.run.smithi115:> true 2023-11-30T16:53:45.559 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-11-30T16:53:45.559 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-425.3.1.el8.x86_64"... 2023-11-30T16:53:45.559 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2023-11-30T16:53:45.573 INFO:teuthology.orchestra.run.smithi115.stdout:4.18.0-425.3.1.el8.x86_64 2023-11-30T16:53:45.573 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-11-30T16:53:45.573 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-30T16:53:45.573 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-11-30T16:53:46.574 DEBUG:teuthology.parallel:result is None 2023-11-30T16:53:50.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-11-30T16:53:50.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T16:53:53.606 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-11-30T16:54:14.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-11-30T16:54:14.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T16:54:46.364 DEBUG:teuthology.orchestra.run.smithi049:> true 2023-11-30T16:54:46.607 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-11-30T16:54:46.607 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-425.3.1.el8.x86_64"... 2023-11-30T16:54:46.607 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2023-11-30T16:54:46.622 INFO:teuthology.orchestra.run.smithi049.stdout:4.18.0-425.3.1.el8.x86_64 2023-11-30T16:54:46.622 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-11-30T16:54:46.622 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-30T16:54:46.623 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-11-30T16:54:47.624 DEBUG:teuthology.parallel:result is None 2023-11-30T16:54:47.624 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-30T16:54:47.633 INFO:teuthology.task.internal:Creating test directory... 2023-11-30T16:54:47.633 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-30T16:54:47.636 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-30T16:54:47.656 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-30T16:54:47.678 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-30T16:54:47.732 INFO:teuthology.task.internal:Creating archive directory... 2023-11-30T16:54:47.732 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-30T16:54:47.735 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-30T16:54:47.768 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-30T16:54:47.778 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-30T16:54:47.779 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-30T16:54:47.801 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-30T16:54:47.887 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-30T16:54:47.908 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-30T16:54:47.932 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-30T16:54:47.953 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-30T16:54:47.954 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-30T16:54:47.965 INFO:teuthology.task.internal:Configuring sudo... 2023-11-30T16:54:47.965 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-30T16:54:47.969 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-30T16:54:47.996 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-30T16:54:48.010 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-30T16:54:48.010 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-30T16:54:48.040 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-30T16:54:48.056 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-30T16:54:48.140 DEBUG:teuthology.orchestra.run.smithi049:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-30T16:54:48.203 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-30T16:54:48.248 DEBUG:teuthology.orchestra.run.smithi049:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-30T16:54:48.290 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-30T16:54:48.290 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-30T16:54:48.357 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-30T16:54:48.401 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-30T16:54:48.473 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-30T16:54:48.516 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-30T16:54:48.558 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-11-30T16:54:48.558 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-30T16:54:48.623 DEBUG:teuthology.orchestra.run.smithi049:> sudo service rsyslog restart 2023-11-30T16:54:48.625 DEBUG:teuthology.orchestra.run.smithi115:> sudo service rsyslog restart 2023-11-30T16:54:48.673 INFO:teuthology.orchestra.run.smithi049.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-30T16:54:48.714 INFO:teuthology.orchestra.run.smithi115.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-30T16:54:49.094 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-30T16:54:49.104 INFO:teuthology.task.internal:Starting timer... 2023-11-30T16:54:49.105 INFO:teuthology.run_tasks:Running task pcp... 2023-11-30T16:54:49.148 INFO:teuthology.run_tasks:Running task selinux... 2023-11-30T16:54:49.199 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-11-30T16:54:49.199 DEBUG:teuthology.orchestra.run.smithi049:> sudo service auditd rotate 2023-11-30T16:54:49.272 INFO:teuthology.orchestra.run.smithi049.stdout:Rotating logs: [ OK ] 2023-11-30T16:54:49.274 DEBUG:teuthology.orchestra.run.smithi115:> sudo service auditd rotate 2023-11-30T16:54:49.339 INFO:teuthology.orchestra.run.smithi115.stdout:Rotating logs: [ OK ] 2023-11-30T16:54:49.341 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-30T16:54:49.341 DEBUG:teuthology.orchestra.run.smithi049:> /usr/sbin/getenforce 2023-11-30T16:54:49.369 INFO:teuthology.orchestra.run.smithi049.stdout:Permissive 2023-11-30T16:54:49.370 DEBUG:teuthology.orchestra.run.smithi115:> /usr/sbin/getenforce 2023-11-30T16:54:49.398 INFO:teuthology.orchestra.run.smithi115.stdout:Permissive 2023-11-30T16:54:49.398 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi049.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi115.front.sepia.ceph.com': 'permissive'} 2023-11-30T16:54:49.399 DEBUG:teuthology.orchestra.run.smithi049:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-30T16:54:49.435 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-30T16:54:49.436 DEBUG:teuthology.orchestra.run.smithi115:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-30T16:54:49.463 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-30T16:54:49.463 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-30T16:54:49.464 DEBUG:teuthology.orchestra.run.smithi049:> sudo /usr/sbin/setenforce permissive 2023-11-30T16:54:49.507 DEBUG:teuthology.orchestra.run.smithi115:> sudo /usr/sbin/setenforce permissive 2023-11-30T16:54:49.532 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-30T16:54:49.542 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-30T16:54:49.542 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-30T16:54:49.562 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-30T16:54:49.563 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi049.front.sepia.ceph.com,smithi115.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-30T17:03:51.265 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi049.front.sepia.ceph.com'), Remote(name='ubuntu@smithi115.front.sepia.ceph.com')] 2023-11-30T17:03:51.266 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-11-30T17:03:51.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T17:03:51.339 DEBUG:teuthology.orchestra.run.smithi049:> true 2023-11-30T17:03:51.407 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-11-30T17:03:51.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-11-30T17:03:51.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T17:03:51.479 DEBUG:teuthology.orchestra.run.smithi115:> true 2023-11-30T17:03:51.546 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-11-30T17:03:51.546 INFO:teuthology.run_tasks:Running task clock... 2023-11-30T17:03:51.558 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-30T17:03:51.558 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-30T17:03:51.559 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-30T17:03:51.561 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-30T17:03:51.561 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-30T17:03:51.593 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-30T17:03:51.609 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-30T17:03:51.617 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-30T17:03:51.632 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-30T17:03:51.644 INFO:teuthology.orchestra.run.smithi049.stderr:sudo: ntpd: command not found 2023-11-30T17:03:51.655 INFO:teuthology.orchestra.run.smithi049.stdout:506 Cannot talk to daemon 2023-11-30T17:03:51.667 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: ntpd: command not found 2023-11-30T17:03:51.670 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-30T17:03:51.677 INFO:teuthology.orchestra.run.smithi115.stdout:506 Cannot talk to daemon 2023-11-30T17:03:51.684 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-30T17:03:51.691 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-30T17:03:51.704 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-30T17:03:51.755 INFO:teuthology.orchestra.run.smithi049.stderr:bash: ntpq: command not found 2023-11-30T17:03:51.757 INFO:teuthology.orchestra.run.smithi049.stdout:210 Number of sources = 4 2023-11-30T17:03:51.758 INFO:teuthology.orchestra.run.smithi049.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-30T17:03:51.758 INFO:teuthology.orchestra.run.smithi049.stdout:=============================================================================== 2023-11-30T17:03:51.758 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-30T17:03:51.758 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-30T17:03:51.758 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-30T17:03:51.758 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-30T17:03:51.769 INFO:teuthology.orchestra.run.smithi115.stderr:bash: ntpq: command not found 2023-11-30T17:03:51.771 INFO:teuthology.orchestra.run.smithi115.stdout:210 Number of sources = 4 2023-11-30T17:03:51.772 INFO:teuthology.orchestra.run.smithi115.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-30T17:03:51.772 INFO:teuthology.orchestra.run.smithi115.stdout:=============================================================================== 2023-11-30T17:03:51.772 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-30T17:03:51.772 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-30T17:03:51.772 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-30T17:03:51.772 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-30T17:03:51.772 INFO:teuthology.run_tasks:Running task install... 2023-11-30T17:03:51.781 DEBUG:teuthology.task.install:project ceph 2023-11-30T17:03:51.781 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9'}} 2023-11-30T17:03:51.781 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9'} 2023-11-30T17:03:51.781 INFO:teuthology.task.install:Using flavor: default 2023-11-30T17:03:51.787 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-30T17:03:51.787 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-30T17:03:51.787 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9', 'tag': None, 'wait_for_package': False} 2023-11-30T17:03:51.788 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9 2023-11-30T17:03:51.790 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9', 'tag': None, 'wait_for_package': False} 2023-11-30T17:03:51.790 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9 2023-11-30T17:03:51.933 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-11-29-0706-pacific/0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9/centos/8/flavors/default/ 2023-11-30T17:03:51.933 INFO:teuthology.task.install.rpm:Package version is 16.2.14-328.g0dc074ce 2023-11-30T17:03:52.013 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-11-29-0706-pacific/0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9/centos/8/flavors/default/ 2023-11-30T17:03:52.013 INFO:teuthology.task.install.rpm:Package version is 16.2.14-328.g0dc074ce 2023-11-30T17:03:52.051 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-11-29-0706-pacific/0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-11-29-0706-pacific/0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-11-29-0706-pacific/0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-30T17:03:52.052 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-11-30T17:03:52.052 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-30T17:03:52.085 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-11-30T17:03:52.086 DEBUG:teuthology.orchestra.run.smithi115:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-30T17:03:52.150 DEBUG:teuthology.orchestra.run.smithi115:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-30T17:03:52.187 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-11-29-0706-pacific/0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-11-29-0706-pacific/0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-11-29-0706-pacific/0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-30T17:03:52.187 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-30T17:03:52.188 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-30T17:03:52.215 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-11-30T17:03:52.215 DEBUG:teuthology.orchestra.run.smithi049:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-30T17:03:52.224 DEBUG:teuthology.orchestra.run.smithi115:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-30T17:03:52.282 DEBUG:teuthology.orchestra.run.smithi049:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-30T17:03:52.287 INFO:teuthology.orchestra.run.smithi115.stdout:check_obsoletes = 1 2023-11-30T17:03:52.289 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum clean all 2023-11-30T17:03:52.359 DEBUG:teuthology.orchestra.run.smithi049:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-30T17:03:52.424 INFO:teuthology.orchestra.run.smithi049.stdout:check_obsoletes = 1 2023-11-30T17:03:52.425 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum clean all 2023-11-30T17:03:52.680 INFO:teuthology.orchestra.run.smithi115.stdout:Updating Subscription Management repositories. 2023-11-30T17:03:52.836 INFO:teuthology.orchestra.run.smithi049.stdout:Updating Subscription Management repositories. 2023-11-30T17:03:53.024 INFO:teuthology.orchestra.run.smithi115.stdout:44 files removed 2023-11-30T17:03:53.077 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-11-30T17:03:53.173 INFO:teuthology.orchestra.run.smithi049.stdout:44 files removed 2023-11-30T17:03:53.229 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-11-30T17:03:53.423 INFO:teuthology.orchestra.run.smithi115.stdout:Updating Subscription Management repositories. 2023-11-30T17:03:53.600 INFO:teuthology.orchestra.run.smithi049.stdout:Updating Subscription Management repositories. 2023-11-30T17:03:54.161 INFO:teuthology.orchestra.run.smithi115.stdout:ceph packages for x86_64 243 kB/s | 76 kB 00:00 2023-11-30T17:03:54.387 INFO:teuthology.orchestra.run.smithi049.stdout:ceph packages for x86_64 225 kB/s | 76 kB 00:00 2023-11-30T17:03:54.388 INFO:teuthology.orchestra.run.smithi115.stdout:ceph noarch packages 82 kB/s | 15 kB 00:00 2023-11-30T17:03:54.617 INFO:teuthology.orchestra.run.smithi049.stdout:ceph noarch packages 82 kB/s | 15 kB 00:00 2023-11-30T17:03:54.664 INFO:teuthology.orchestra.run.smithi115.stdout:ceph source packages 5.9 kB/s | 1.4 kB 00:00 2023-11-30T17:03:54.778 INFO:teuthology.orchestra.run.smithi115.stdout:Copr repo for python3-asyncssh owned by ceph 41 kB/s | 3.5 kB 00:00 2023-11-30T17:03:54.898 INFO:teuthology.orchestra.run.smithi049.stdout:ceph source packages 5.8 kB/s | 1.4 kB 00:00 2023-11-30T17:03:55.041 INFO:teuthology.orchestra.run.smithi049.stdout:Copr repo for python3-asyncssh owned by ceph 31 kB/s | 3.5 kB 00:00 2023-11-30T17:03:55.539 INFO:teuthology.orchestra.run.smithi049.stdout:Extra Packages for Enterprise Linux 34 MB/s | 16 MB 00:00 2023-11-30T17:03:55.571 INFO:teuthology.orchestra.run.smithi115.stdout:Extra Packages for Enterprise Linux 21 MB/s | 16 MB 00:00 2023-11-30T17:03:58.830 INFO:teuthology.orchestra.run.smithi115.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2023-11-30T17:03:59.011 INFO:teuthology.orchestra.run.smithi049.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2023-11-30T17:03:59.265 INFO:teuthology.orchestra.run.smithi115.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 108 MB/s | 38 MB 00:00 2023-11-30T17:03:59.493 INFO:teuthology.orchestra.run.smithi049.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 97 MB/s | 38 MB 00:00 2023-11-30T17:04:04.771 INFO:teuthology.orchestra.run.smithi115.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 109 MB/s | 33 MB 00:00 2023-11-30T17:04:05.337 INFO:teuthology.orchestra.run.smithi049.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 105 MB/s | 33 MB 00:00 2023-11-30T17:04:12.644 INFO:teuthology.orchestra.run.smithi115.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-30T17:04:12.645 INFO:teuthology.orchestra.run.smithi115.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-30T17:04:12.656 INFO:teuthology.orchestra.run.smithi115.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-11-30T17:04:12.656 INFO:teuthology.orchestra.run.smithi115.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-11-30T17:04:12.657 INFO:teuthology.orchestra.run.smithi115.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-11-30T17:04:12.658 INFO:teuthology.orchestra.run.smithi115.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-11-30T17:04:12.660 INFO:teuthology.orchestra.run.smithi115.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-11-30T17:04:12.662 INFO:teuthology.orchestra.run.smithi115.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-11-30T17:04:12.663 INFO:teuthology.orchestra.run.smithi115.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-11-30T17:04:13.157 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2023-11-30T17:04:13.168 INFO:teuthology.orchestra.run.smithi115.stdout:====================================================================================================================== 2023-11-30T17:04:13.168 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2023-11-30T17:04:13.168 INFO:teuthology.orchestra.run.smithi115.stdout:====================================================================================================================== 2023-11-30T17:04:13.168 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2023-11-30T17:04:13.168 INFO:teuthology.orchestra.run.smithi115.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-11-30T17:04:13.168 INFO:teuthology.orchestra.run.smithi115.stdout: ceph x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 6.4 k 2023-11-30T17:04:13.169 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 6.1 M 2023-11-30T17:04:13.169 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-fuse x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 911 k 2023-11-30T17:04:13.169 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-immutable-object-cache x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 161 k 2023-11-30T17:04:13.169 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 1.6 M 2023-11-30T17:04:13.169 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-cephadm noarch 2:16.2.14-328.g0dc074ce.el8 ceph-noarch 116 k 2023-11-30T17:04:13.169 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard noarch 2:16.2.14-328.g0dc074ce.el8 ceph-noarch 3.1 M 2023-11-30T17:04:13.169 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-328.g0dc074ce.el8 ceph-noarch 8.6 M 2023-11-30T17:04:13.169 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-rook noarch 2:16.2.14-328.g0dc074ce.el8 ceph-noarch 27 k 2023-11-30T17:04:13.169 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-radosgw x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 12 M 2023-11-30T17:04:13.169 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-test x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 52 M 2023-11-30T17:04:13.169 INFO:teuthology.orchestra.run.smithi115.stdout: cephadm noarch 2:16.2.14-328.g0dc074ce.el8 ceph-noarch 85 k 2023-11-30T17:04:13.169 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-mirror x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 257 k 2023-11-30T17:04:13.169 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-top noarch 2:16.2.14-328.g0dc074ce.el8 ceph-noarch 19 k 2023-11-30T17:04:13.169 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-11-30T17:04:13.170 INFO:teuthology.orchestra.run.smithi115.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-11-30T17:04:13.170 INFO:teuthology.orchestra.run.smithi115.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-11-30T17:04:13.170 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-devel x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 25 k 2023-11-30T17:04:13.170 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2 x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 825 k 2023-11-30T17:04:13.170 INFO:teuthology.orchestra.run.smithi115.stdout: librados-devel x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 131 k 2023-11-30T17:04:13.170 INFO:teuthology.orchestra.run.smithi115.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-11-30T17:04:13.170 INFO:teuthology.orchestra.run.smithi115.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-11-30T17:04:13.170 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-11-30T17:04:13.170 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cephfs x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 215 k 2023-11-30T17:04:13.170 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rados x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 390 k 2023-11-30T17:04:13.170 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rbd x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 369 k 2023-11-30T17:04:13.170 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rgw x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 114 k 2023-11-30T17:04:13.170 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-fuse x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 88 k 2023-11-30T17:04:13.170 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-mirror x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 3.7 M 2023-11-30T17:04:13.171 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-nbd x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 175 k 2023-11-30T17:04:13.171 INFO:teuthology.orchestra.run.smithi115.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-11-30T17:04:13.171 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrading: 2023-11-30T17:04:13.171 INFO:teuthology.orchestra.run.smithi115.stdout: librados2 x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 3.7 M 2023-11-30T17:04:13.171 INFO:teuthology.orchestra.run.smithi115.stdout: librbd1 x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 4.2 M 2023-11-30T17:04:13.171 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2023-11-30T17:04:13.171 INFO:teuthology.orchestra.run.smithi115.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-11-30T17:04:13.171 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-common x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 24 M 2023-11-30T17:04:13.171 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-grafana-dashboards noarch 2:16.2.14-328.g0dc074ce.el8 ceph-noarch 24 k 2023-11-30T17:04:13.171 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mds x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 2.4 M 2023-11-30T17:04:13.171 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core noarch 2:16.2.14-328.g0dc074ce.el8 ceph-noarch 245 k 2023-11-30T17:04:13.171 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mon x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 5.0 M 2023-11-30T17:04:13.172 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-osd x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 18 M 2023-11-30T17:04:13.172 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-prometheus-alerts noarch 2:16.2.14-328.g0dc074ce.el8 ceph-noarch 15 k 2023-11-30T17:04:13.172 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-selinux x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 26 k 2023-11-30T17:04:13.172 INFO:teuthology.orchestra.run.smithi115.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-11-30T17:04:13.172 INFO:teuthology.orchestra.run.smithi115.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-11-30T17:04:13.172 INFO:teuthology.orchestra.run.smithi115.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-11-30T17:04:13.172 INFO:teuthology.orchestra.run.smithi115.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-11-30T17:04:13.172 INFO:teuthology.orchestra.run.smithi115.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-11-30T17:04:13.172 INFO:teuthology.orchestra.run.smithi115.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-11-30T17:04:13.172 INFO:teuthology.orchestra.run.smithi115.stdout: libcephsqlite x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 174 k 2023-11-30T17:04:13.172 INFO:teuthology.orchestra.run.smithi115.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-11-30T17:04:13.172 INFO:teuthology.orchestra.run.smithi115.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-11-30T17:04:13.172 INFO:teuthology.orchestra.run.smithi115.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-11-30T17:04:13.172 INFO:teuthology.orchestra.run.smithi115.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-11-30T17:04:13.173 INFO:teuthology.orchestra.run.smithi115.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-11-30T17:04:13.173 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1 x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 493 k 2023-11-30T17:04:13.173 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-11-30T17:04:13.173 INFO:teuthology.orchestra.run.smithi115.stdout: librgw2 x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 3.8 M 2023-11-30T17:04:13.173 INFO:teuthology.orchestra.run.smithi115.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-11-30T17:04:13.173 INFO:teuthology.orchestra.run.smithi115.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-11-30T17:04:13.173 INFO:teuthology.orchestra.run.smithi115.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-11-30T17:04:13.173 INFO:teuthology.orchestra.run.smithi115.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-11-30T17:04:13.173 INFO:teuthology.orchestra.run.smithi115.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-11-30T17:04:13.173 INFO:teuthology.orchestra.run.smithi115.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-11-30T17:04:13.173 INFO:teuthology.orchestra.run.smithi115.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-11-30T17:04:13.173 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-11-30T17:04:13.173 INFO:teuthology.orchestra.run.smithi115.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-11-30T17:04:13.173 INFO:teuthology.orchestra.run.smithi115.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-11-30T17:04:13.174 INFO:teuthology.orchestra.run.smithi115.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-11-30T17:04:13.174 INFO:teuthology.orchestra.run.smithi115.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2023-11-30T17:04:13.174 INFO:teuthology.orchestra.run.smithi115.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-11-30T17:04:13.174 INFO:teuthology.orchestra.run.smithi115.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-11-30T17:04:13.174 INFO:teuthology.orchestra.run.smithi115.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-11-30T17:04:13.174 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-11-30T17:04:13.174 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 45 k 2023-11-30T17:04:13.174 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 99 k 2023-11-30T17:04:13.174 INFO:teuthology.orchestra.run.smithi115.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-11-30T17:04:13.174 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-11-30T17:04:13.174 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-11-30T17:04:13.174 INFO:teuthology.orchestra.run.smithi115.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2023-11-30T17:04:13.174 INFO:teuthology.orchestra.run.smithi115.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-11-30T17:04:13.174 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-11-30T17:04:13.174 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-11-30T17:04:13.175 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-11-30T17:04:13.175 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-11-30T17:04:13.175 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-11-30T17:04:13.175 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-30T17:04:13.175 INFO:teuthology.orchestra.run.smithi115.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-11-30T17:04:13.175 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-11-30T17:04:13.175 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-11-30T17:04:13.175 INFO:teuthology.orchestra.run.smithi115.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-11-30T17:04:13.175 INFO:teuthology.orchestra.run.smithi115.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-11-30T17:04:13.175 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-11-30T17:04:13.175 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-11-30T17:04:13.175 INFO:teuthology.orchestra.run.smithi115.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-11-30T17:04:13.175 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-11-30T17:04:13.175 INFO:teuthology.orchestra.run.smithi115.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-11-30T17:04:13.176 INFO:teuthology.orchestra.run.smithi115.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-11-30T17:04:13.176 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-11-30T17:04:13.176 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-11-30T17:04:13.176 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-11-30T17:04:13.176 INFO:teuthology.orchestra.run.smithi115.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2023-11-30T17:04:13.176 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-11-30T17:04:13.176 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-30T17:04:13.176 INFO:teuthology.orchestra.run.smithi115.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-11-30T17:04:13.176 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-11-30T17:04:13.176 INFO:teuthology.orchestra.run.smithi115.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-11-30T17:04:13.176 INFO:teuthology.orchestra.run.smithi115.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-11-30T17:04:13.176 INFO:teuthology.orchestra.run.smithi115.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-11-30T17:04:13.176 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-11-30T17:04:13.176 INFO:teuthology.orchestra.run.smithi115.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-11-30T17:04:13.176 INFO:teuthology.orchestra.run.smithi115.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-11-30T17:04:13.177 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-11-30T17:04:13.177 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-11-30T17:04:13.177 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-11-30T17:04:13.177 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-11-30T17:04:13.177 INFO:teuthology.orchestra.run.smithi115.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-11-30T17:04:13.177 INFO:teuthology.orchestra.run.smithi115.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-11-30T17:04:13.177 INFO:teuthology.orchestra.run.smithi115.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-11-30T17:04:13.177 INFO:teuthology.orchestra.run.smithi115.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-11-30T17:04:13.177 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:04:13.177 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2023-11-30T17:04:13.177 INFO:teuthology.orchestra.run.smithi115.stdout:====================================================================================================================== 2023-11-30T17:04:13.177 INFO:teuthology.orchestra.run.smithi115.stdout:Install 118 Packages 2023-11-30T17:04:13.177 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrade 2 Packages 2023-11-30T17:04:13.177 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:04:13.178 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 201 M 2023-11-30T17:04:13.178 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2023-11-30T17:04:13.394 INFO:teuthology.orchestra.run.smithi115.stdout:(1/120): ceph-16.2.14-328.g0dc074ce.el8.x86_64. 43 kB/s | 6.4 kB 00:00 2023-11-30T17:04:13.721 INFO:teuthology.orchestra.run.smithi115.stdout:(2/120): ceph-fuse-16.2.14-328.g0dc074ce.el8.x8 2.7 MB/s | 911 kB 00:00 2023-11-30T17:04:13.760 INFO:teuthology.orchestra.run.smithi115.stdout:(3/120): ceph-immutable-object-cache-16.2.14-32 4.1 MB/s | 161 kB 00:00 2023-11-30T17:04:13.786 INFO:teuthology.orchestra.run.smithi049.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-30T17:04:13.787 INFO:teuthology.orchestra.run.smithi049.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-30T17:04:13.798 INFO:teuthology.orchestra.run.smithi049.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-11-30T17:04:13.799 INFO:teuthology.orchestra.run.smithi049.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-11-30T17:04:13.802 INFO:teuthology.orchestra.run.smithi049.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-11-30T17:04:13.803 INFO:teuthology.orchestra.run.smithi049.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-11-30T17:04:13.803 INFO:teuthology.orchestra.run.smithi049.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-11-30T17:04:13.805 INFO:teuthology.orchestra.run.smithi049.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-11-30T17:04:13.806 INFO:teuthology.orchestra.run.smithi049.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-11-30T17:04:13.869 INFO:teuthology.orchestra.run.smithi115.stdout:(4/120): ceph-base-16.2.14-328.g0dc074ce.el8.x8 9.7 MB/s | 6.1 MB 00:00 2023-11-30T17:04:13.975 INFO:teuthology.orchestra.run.smithi115.stdout:(5/120): ceph-mgr-16.2.14-328.g0dc074ce.el8.x86 15 MB/s | 1.6 MB 00:00 2023-11-30T17:04:14.261 INFO:teuthology.orchestra.run.smithi115.stdout:(6/120): ceph-mon-16.2.14-328.g0dc074ce.el8.x86 18 MB/s | 5.0 MB 00:00 2023-11-30T17:04:14.272 INFO:teuthology.orchestra.run.smithi115.stdout:(7/120): ceph-mds-16.2.14-328.g0dc074ce.el8.x86 4.8 MB/s | 2.4 MB 00:00 2023-11-30T17:04:14.325 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-11-30T17:04:14.338 INFO:teuthology.orchestra.run.smithi049.stdout:====================================================================================================================== 2023-11-30T17:04:14.338 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2023-11-30T17:04:14.338 INFO:teuthology.orchestra.run.smithi049.stdout:====================================================================================================================== 2023-11-30T17:04:14.339 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2023-11-30T17:04:14.339 INFO:teuthology.orchestra.run.smithi049.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-11-30T17:04:14.339 INFO:teuthology.orchestra.run.smithi049.stdout: ceph x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 6.4 k 2023-11-30T17:04:14.339 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 6.1 M 2023-11-30T17:04:14.339 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-fuse x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 911 k 2023-11-30T17:04:14.340 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-immutable-object-cache x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 161 k 2023-11-30T17:04:14.340 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 1.6 M 2023-11-30T17:04:14.340 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-cephadm noarch 2:16.2.14-328.g0dc074ce.el8 ceph-noarch 116 k 2023-11-30T17:04:14.340 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-dashboard noarch 2:16.2.14-328.g0dc074ce.el8 ceph-noarch 3.1 M 2023-11-30T17:04:14.340 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-328.g0dc074ce.el8 ceph-noarch 8.6 M 2023-11-30T17:04:14.340 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-rook noarch 2:16.2.14-328.g0dc074ce.el8 ceph-noarch 27 k 2023-11-30T17:04:14.340 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-radosgw x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 12 M 2023-11-30T17:04:14.341 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-test x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 52 M 2023-11-30T17:04:14.341 INFO:teuthology.orchestra.run.smithi049.stdout: cephadm noarch 2:16.2.14-328.g0dc074ce.el8 ceph-noarch 85 k 2023-11-30T17:04:14.341 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-mirror x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 257 k 2023-11-30T17:04:14.341 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-top noarch 2:16.2.14-328.g0dc074ce.el8 ceph-noarch 19 k 2023-11-30T17:04:14.341 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-11-30T17:04:14.341 INFO:teuthology.orchestra.run.smithi049.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-11-30T17:04:14.342 INFO:teuthology.orchestra.run.smithi049.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-11-30T17:04:14.342 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs-devel x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 25 k 2023-11-30T17:04:14.342 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs2 x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 825 k 2023-11-30T17:04:14.342 INFO:teuthology.orchestra.run.smithi049.stdout: librados-devel x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 131 k 2023-11-30T17:04:14.343 INFO:teuthology.orchestra.run.smithi049.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-11-30T17:04:14.343 INFO:teuthology.orchestra.run.smithi049.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-11-30T17:04:14.343 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-11-30T17:04:14.343 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cephfs x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 215 k 2023-11-30T17:04:14.343 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rados x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 390 k 2023-11-30T17:04:14.343 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rbd x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 369 k 2023-11-30T17:04:14.344 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rgw x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 114 k 2023-11-30T17:04:14.344 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-fuse x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 88 k 2023-11-30T17:04:14.344 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-mirror x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 3.7 M 2023-11-30T17:04:14.344 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-nbd x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 175 k 2023-11-30T17:04:14.344 INFO:teuthology.orchestra.run.smithi049.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-11-30T17:04:14.344 INFO:teuthology.orchestra.run.smithi049.stdout:Upgrading: 2023-11-30T17:04:14.345 INFO:teuthology.orchestra.run.smithi049.stdout: librados2 x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 3.7 M 2023-11-30T17:04:14.345 INFO:teuthology.orchestra.run.smithi049.stdout: librbd1 x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 4.2 M 2023-11-30T17:04:14.345 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2023-11-30T17:04:14.345 INFO:teuthology.orchestra.run.smithi049.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-11-30T17:04:14.345 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-common x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 24 M 2023-11-30T17:04:14.345 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-grafana-dashboards noarch 2:16.2.14-328.g0dc074ce.el8 ceph-noarch 24 k 2023-11-30T17:04:14.346 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mds x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 2.4 M 2023-11-30T17:04:14.346 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-modules-core noarch 2:16.2.14-328.g0dc074ce.el8 ceph-noarch 245 k 2023-11-30T17:04:14.346 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mon x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 5.0 M 2023-11-30T17:04:14.346 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-osd x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 18 M 2023-11-30T17:04:14.346 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-prometheus-alerts noarch 2:16.2.14-328.g0dc074ce.el8 ceph-noarch 15 k 2023-11-30T17:04:14.346 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-selinux x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 26 k 2023-11-30T17:04:14.346 INFO:teuthology.orchestra.run.smithi049.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-11-30T17:04:14.347 INFO:teuthology.orchestra.run.smithi049.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-11-30T17:04:14.347 INFO:teuthology.orchestra.run.smithi049.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-11-30T17:04:14.347 INFO:teuthology.orchestra.run.smithi049.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-11-30T17:04:14.347 INFO:teuthology.orchestra.run.smithi049.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-11-30T17:04:14.347 INFO:teuthology.orchestra.run.smithi049.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-11-30T17:04:14.347 INFO:teuthology.orchestra.run.smithi049.stdout: libcephsqlite x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 174 k 2023-11-30T17:04:14.347 INFO:teuthology.orchestra.run.smithi049.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-11-30T17:04:14.347 INFO:teuthology.orchestra.run.smithi049.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-11-30T17:04:14.347 INFO:teuthology.orchestra.run.smithi049.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-11-30T17:04:14.348 INFO:teuthology.orchestra.run.smithi049.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-11-30T17:04:14.348 INFO:teuthology.orchestra.run.smithi049.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-11-30T17:04:14.348 INFO:teuthology.orchestra.run.smithi049.stdout: libradosstriper1 x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 493 k 2023-11-30T17:04:14.348 INFO:teuthology.orchestra.run.smithi049.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-11-30T17:04:14.348 INFO:teuthology.orchestra.run.smithi049.stdout: librgw2 x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 3.8 M 2023-11-30T17:04:14.348 INFO:teuthology.orchestra.run.smithi049.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-11-30T17:04:14.348 INFO:teuthology.orchestra.run.smithi049.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-11-30T17:04:14.348 INFO:teuthology.orchestra.run.smithi049.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-11-30T17:04:14.348 INFO:teuthology.orchestra.run.smithi049.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-11-30T17:04:14.348 INFO:teuthology.orchestra.run.smithi049.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-11-30T17:04:14.348 INFO:teuthology.orchestra.run.smithi049.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-11-30T17:04:14.348 INFO:teuthology.orchestra.run.smithi049.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-11-30T17:04:14.348 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-11-30T17:04:14.348 INFO:teuthology.orchestra.run.smithi049.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-11-30T17:04:14.349 INFO:teuthology.orchestra.run.smithi049.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-11-30T17:04:14.349 INFO:teuthology.orchestra.run.smithi049.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-11-30T17:04:14.349 INFO:teuthology.orchestra.run.smithi049.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2023-11-30T17:04:14.349 INFO:teuthology.orchestra.run.smithi049.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-11-30T17:04:14.349 INFO:teuthology.orchestra.run.smithi049.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-11-30T17:04:14.349 INFO:teuthology.orchestra.run.smithi049.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-11-30T17:04:14.349 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-11-30T17:04:14.349 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-argparse x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 45 k 2023-11-30T17:04:14.350 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-common x86_64 2:16.2.14-328.g0dc074ce.el8 ceph 99 k 2023-11-30T17:04:14.350 INFO:teuthology.orchestra.run.smithi049.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-11-30T17:04:14.350 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-11-30T17:04:14.350 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-11-30T17:04:14.350 INFO:teuthology.orchestra.run.smithi049.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2023-11-30T17:04:14.350 INFO:teuthology.orchestra.run.smithi049.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-11-30T17:04:14.350 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-11-30T17:04:14.350 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-11-30T17:04:14.350 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-11-30T17:04:14.350 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-11-30T17:04:14.350 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-11-30T17:04:14.350 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-30T17:04:14.351 INFO:teuthology.orchestra.run.smithi049.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-11-30T17:04:14.351 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-11-30T17:04:14.351 INFO:teuthology.orchestra.run.smithi049.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-11-30T17:04:14.351 INFO:teuthology.orchestra.run.smithi049.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-11-30T17:04:14.351 INFO:teuthology.orchestra.run.smithi049.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-11-30T17:04:14.351 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-11-30T17:04:14.351 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-11-30T17:04:14.351 INFO:teuthology.orchestra.run.smithi049.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-11-30T17:04:14.351 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-11-30T17:04:14.351 INFO:teuthology.orchestra.run.smithi049.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-11-30T17:04:14.351 INFO:teuthology.orchestra.run.smithi049.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-11-30T17:04:14.351 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-11-30T17:04:14.351 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-11-30T17:04:14.351 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-11-30T17:04:14.351 INFO:teuthology.orchestra.run.smithi049.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2023-11-30T17:04:14.352 INFO:teuthology.orchestra.run.smithi049.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-11-30T17:04:14.352 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-30T17:04:14.352 INFO:teuthology.orchestra.run.smithi049.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-11-30T17:04:14.352 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-11-30T17:04:14.352 INFO:teuthology.orchestra.run.smithi049.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-11-30T17:04:14.352 INFO:teuthology.orchestra.run.smithi049.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-11-30T17:04:14.352 INFO:teuthology.orchestra.run.smithi049.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-11-30T17:04:14.352 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-11-30T17:04:14.352 INFO:teuthology.orchestra.run.smithi049.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-11-30T17:04:14.352 INFO:teuthology.orchestra.run.smithi049.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-11-30T17:04:14.352 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-11-30T17:04:14.352 INFO:teuthology.orchestra.run.smithi049.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-11-30T17:04:14.353 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-11-30T17:04:14.353 INFO:teuthology.orchestra.run.smithi049.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-11-30T17:04:14.353 INFO:teuthology.orchestra.run.smithi049.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-11-30T17:04:14.353 INFO:teuthology.orchestra.run.smithi049.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-11-30T17:04:14.353 INFO:teuthology.orchestra.run.smithi049.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-11-30T17:04:14.353 INFO:teuthology.orchestra.run.smithi049.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-11-30T17:04:14.353 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:04:14.353 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2023-11-30T17:04:14.353 INFO:teuthology.orchestra.run.smithi049.stdout:====================================================================================================================== 2023-11-30T17:04:14.353 INFO:teuthology.orchestra.run.smithi049.stdout:Install 118 Packages 2023-11-30T17:04:14.353 INFO:teuthology.orchestra.run.smithi049.stdout:Upgrade 2 Packages 2023-11-30T17:04:14.353 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:04:14.354 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 201 M 2023-11-30T17:04:14.354 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2023-11-30T17:04:14.737 INFO:teuthology.orchestra.run.smithi049.stdout:(1/120): ceph-16.2.14-328.g0dc074ce.el8.x86_64. 18 kB/s | 6.4 kB 00:00 2023-11-30T17:04:15.419 INFO:teuthology.orchestra.run.smithi115.stdout:(8/120): ceph-osd-16.2.14-328.g0dc074ce.el8.x86 16 MB/s | 18 MB 00:01 2023-11-30T17:04:15.452 INFO:teuthology.orchestra.run.smithi115.stdout:(9/120): ceph-selinux-16.2.14-328.g0dc074ce.el8 786 kB/s | 26 kB 00:00 2023-11-30T17:04:16.077 INFO:teuthology.orchestra.run.smithi049.stdout:(2/120): ceph-fuse-16.2.14-328.g0dc074ce.el8.x8 680 kB/s | 911 kB 00:01 2023-11-30T17:04:16.248 INFO:teuthology.orchestra.run.smithi049.stdout:(3/120): ceph-immutable-object-cache-16.2.14-32 946 kB/s | 161 kB 00:00 2023-11-30T17:04:16.898 INFO:teuthology.orchestra.run.smithi115.stdout:(10/120): ceph-radosgw-16.2.14-328.g0dc074ce.el 4.4 MB/s | 12 MB 00:02 2023-11-30T17:04:16.991 INFO:teuthology.orchestra.run.smithi115.stdout:(11/120): cephfs-mirror-16.2.14-328.g0dc074ce.e 2.7 MB/s | 257 kB 00:00 2023-11-30T17:04:17.076 INFO:teuthology.orchestra.run.smithi115.stdout:(12/120): libcephfs-devel-16.2.14-328.g0dc074ce 298 kB/s | 25 kB 00:00 2023-11-30T17:04:17.328 INFO:teuthology.orchestra.run.smithi115.stdout:(13/120): libcephfs2-16.2.14-328.g0dc074ce.el8. 3.2 MB/s | 825 kB 00:00 2023-11-30T17:04:17.474 INFO:teuthology.orchestra.run.smithi115.stdout:(14/120): libcephsqlite-16.2.14-328.g0dc074ce.e 1.2 MB/s | 174 kB 00:00 2023-11-30T17:04:17.619 INFO:teuthology.orchestra.run.smithi115.stdout:(15/120): librados-devel-16.2.14-328.g0dc074ce. 904 kB/s | 131 kB 00:00 2023-11-30T17:04:17.748 INFO:teuthology.orchestra.run.smithi049.stdout:(4/120): ceph-mds-16.2.14-328.g0dc074ce.el8.x86 1.6 MB/s | 2.4 MB 00:01 2023-11-30T17:04:18.026 INFO:teuthology.orchestra.run.smithi115.stdout:(16/120): ceph-common-16.2.14-328.g0dc074ce.el8 5.1 MB/s | 24 MB 00:04 2023-11-30T17:04:18.028 INFO:teuthology.orchestra.run.smithi115.stdout:(17/120): libradosstriper1-16.2.14-328.g0dc074c 1.2 MB/s | 493 kB 00:00 2023-11-30T17:04:18.125 INFO:teuthology.orchestra.run.smithi115.stdout:(18/120): python3-ceph-argparse-16.2.14-328.g0d 466 kB/s | 45 kB 00:00 2023-11-30T17:04:18.208 INFO:teuthology.orchestra.run.smithi115.stdout:(19/120): python3-ceph-common-16.2.14-328.g0dc0 1.2 MB/s | 99 kB 00:00 2023-11-30T17:04:18.244 INFO:teuthology.orchestra.run.smithi049.stdout:(5/120): ceph-mgr-16.2.14-328.g0dc074ce.el8.x86 3.3 MB/s | 1.6 MB 00:00 2023-11-30T17:04:18.376 INFO:teuthology.orchestra.run.smithi115.stdout:(20/120): python3-cephfs-16.2.14-328.g0dc074ce. 1.3 MB/s | 215 kB 00:00 2023-11-30T17:04:18.650 INFO:teuthology.orchestra.run.smithi115.stdout:(21/120): python3-rados-16.2.14-328.g0dc074ce.e 1.4 MB/s | 390 kB 00:00 2023-11-30T17:04:18.916 INFO:teuthology.orchestra.run.smithi115.stdout:(22/120): librgw2-16.2.14-328.g0dc074ce.el8.x86 4.3 MB/s | 3.8 MB 00:00 2023-11-30T17:04:18.917 INFO:teuthology.orchestra.run.smithi115.stdout:(23/120): python3-rbd-16.2.14-328.g0dc074ce.el8 1.3 MB/s | 369 kB 00:00 2023-11-30T17:04:19.061 INFO:teuthology.orchestra.run.smithi049.stdout:(6/120): ceph-base-16.2.14-328.g0dc074ce.el8.x8 1.3 MB/s | 6.1 MB 00:04 2023-11-30T17:04:19.326 INFO:teuthology.orchestra.run.smithi049.stdout:(7/120): ceph-mon-16.2.14-328.g0dc074ce.el8.x86 4.6 MB/s | 5.0 MB 00:01 2023-11-30T17:04:19.376 INFO:teuthology.orchestra.run.smithi115.stdout:(24/120): ceph-test-16.2.14-328.g0dc074ce.el8.x 13 MB/s | 52 MB 00:03 2023-11-30T17:04:19.377 INFO:teuthology.orchestra.run.smithi115.stdout:(25/120): rbd-fuse-16.2.14-328.g0dc074ce.el8.x8 192 kB/s | 88 kB 00:00 2023-11-30T17:04:19.378 INFO:teuthology.orchestra.run.smithi115.stdout:(26/120): python3-rgw-16.2.14-328.g0dc074ce.el8 247 kB/s | 114 kB 00:00 2023-11-30T17:04:19.439 INFO:teuthology.orchestra.run.smithi115.stdout:(27/120): ceph-grafana-dashboards-16.2.14-328.g 407 kB/s | 24 kB 00:00 2023-11-30T17:04:19.512 INFO:teuthology.orchestra.run.smithi115.stdout:(28/120): rbd-nbd-16.2.14-328.g0dc074ce.el8.x86 1.3 MB/s | 175 kB 00:00 2023-11-30T17:04:19.591 INFO:teuthology.orchestra.run.smithi115.stdout:(29/120): ceph-mgr-cephadm-16.2.14-328.g0dc074c 764 kB/s | 116 kB 00:00 2023-11-30T17:04:19.735 INFO:teuthology.orchestra.run.smithi115.stdout:(30/120): rbd-mirror-16.2.14-328.g0dc074ce.el8. 10 MB/s | 3.7 MB 00:00 2023-11-30T17:04:19.775 INFO:teuthology.orchestra.run.smithi115.stdout:(31/120): ceph-mgr-modules-core-16.2.14-328.g0d 6.1 MB/s | 245 kB 00:00 2023-11-30T17:04:19.811 INFO:teuthology.orchestra.run.smithi115.stdout:(32/120): ceph-mgr-rook-16.2.14-328.g0dc074ce.e 770 kB/s | 27 kB 00:00 2023-11-30T17:04:19.840 INFO:teuthology.orchestra.run.smithi115.stdout:(33/120): ceph-prometheus-alerts-16.2.14-328.g0 506 kB/s | 15 kB 00:00 2023-11-30T17:04:19.869 INFO:teuthology.orchestra.run.smithi115.stdout:(34/120): cephadm-16.2.14-328.g0dc074ce.el8.noa 3.0 MB/s | 85 kB 00:00 2023-11-30T17:04:19.901 INFO:teuthology.orchestra.run.smithi115.stdout:(35/120): cephfs-top-16.2.14-328.g0dc074ce.el8. 580 kB/s | 19 kB 00:00 2023-11-30T17:04:20.299 INFO:teuthology.orchestra.run.smithi049.stdout:(8/120): ceph-common-16.2.14-328.g0dc074ce.el8. 4.1 MB/s | 24 MB 00:05 2023-11-30T17:04:20.371 INFO:teuthology.orchestra.run.smithi049.stdout:(9/120): ceph-selinux-16.2.14-328.g0dc074ce.el8 359 kB/s | 26 kB 00:00 2023-11-30T17:04:20.644 INFO:teuthology.orchestra.run.smithi115.stdout:(36/120): gperftools-libs-2.7-9.el8.x86_64.rpm 412 kB/s | 306 kB 00:00 2023-11-30T17:04:20.685 INFO:teuthology.orchestra.run.smithi115.stdout:(37/120): ceph-mgr-dashboard-16.2.14-328.g0dc07 2.7 MB/s | 3.1 MB 00:01 2023-11-30T17:04:20.797 INFO:teuthology.orchestra.run.smithi115.stdout:(38/120): leveldb-1.22-1.el8.x86_64.rpm 1.2 MB/s | 181 kB 00:00 2023-11-30T17:04:20.920 INFO:teuthology.orchestra.run.smithi115.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 611 kB/s | 75 kB 00:00 2023-11-30T17:04:21.029 INFO:teuthology.orchestra.run.smithi115.stdout:(40/120): python3-apipkg-1.5-6.el8.noarch.rpm 195 kB/s | 21 kB 00:00 2023-11-30T17:04:21.147 INFO:teuthology.orchestra.run.smithi115.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 372 kB/s | 44 kB 00:00 2023-11-30T17:04:21.228 INFO:teuthology.orchestra.run.smithi115.stdout:(42/120): liboath-2.6.2-3.el8.x86_64.rpm 108 kB/s | 59 kB 00:00 2023-11-30T17:04:21.298 INFO:teuthology.orchestra.run.smithi115.stdout:(43/120): python3-beautifulsoup4-4.6.3-2.el8.1. 1.2 MB/s | 185 kB 00:00 2023-11-30T17:04:21.363 INFO:teuthology.orchestra.run.smithi115.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 245 kB/s | 33 kB 00:00 2023-11-30T17:04:21.403 INFO:teuthology.orchestra.run.smithi115.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 155 kB/s | 16 kB 00:00 2023-11-30T17:04:21.608 INFO:teuthology.orchestra.run.smithi115.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 1.8 MB/s | 384 kB 00:00 2023-11-30T17:04:21.644 INFO:teuthology.orchestra.run.smithi115.stdout:(47/120): python3-cheroot-8.5.2-1.el8.noarch.rp 615 kB/s | 173 kB 00:00 2023-11-30T17:04:21.885 INFO:teuthology.orchestra.run.smithi115.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 338 kB/s | 81 kB 00:00 2023-11-30T17:04:21.892 INFO:teuthology.orchestra.run.smithi115.stdout:(49/120): python3-execnet-1.7.1-1.el8.noarch.rp 1.2 MB/s | 355 kB 00:00 2023-11-30T17:04:22.000 INFO:teuthology.orchestra.run.smithi115.stdout:(50/120): python3-jaraco-6.2-6.el8.noarch.rpm 96 kB/s | 11 kB 00:00 2023-11-30T17:04:22.006 INFO:teuthology.orchestra.run.smithi115.stdout:(51/120): python3-jaraco-functools-2.0-4.el8.no 155 kB/s | 18 kB 00:00 2023-11-30T17:04:22.220 INFO:teuthology.orchestra.run.smithi115.stdout:(52/120): python3-logutils-0.3.5-11.el8.noarch. 228 kB/s | 49 kB 00:00 2023-11-30T17:04:22.444 INFO:teuthology.orchestra.run.smithi115.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 262 kB/s | 59 kB 00:00 2023-11-30T17:04:22.484 INFO:teuthology.orchestra.run.smithi115.stdout:(54/120): python3-kubernetes-11.0.0-6.el8.noarc 2.4 MB/s | 1.2 MB 00:00 2023-11-30T17:04:22.595 INFO:teuthology.orchestra.run.smithi115.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 140 kB/s | 16 kB 00:00 2023-11-30T17:04:22.609 INFO:teuthology.orchestra.run.smithi115.stdout:(56/120): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2023-11-30T17:04:22.717 INFO:teuthology.orchestra.run.smithi115.stdout:(57/120): python3-remoto-1.2.1-1.el8.noarch.rpm 402 kB/s | 49 kB 00:00 2023-11-30T17:04:22.830 INFO:teuthology.orchestra.run.smithi115.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 1.7 MB/s | 196 kB 00:00 2023-11-30T17:04:22.833 INFO:teuthology.orchestra.run.smithi115.stdout:(59/120): python3-repoze-lru-0.7-6.el8.noarch.r 150 kB/s | 34 kB 00:00 2023-11-30T17:04:22.950 INFO:teuthology.orchestra.run.smithi115.stdout:(60/120): python3-rsa-4.9-2.el8.noarch.rpm 538 kB/s | 64 kB 00:00 2023-11-30T17:04:22.956 INFO:teuthology.orchestra.run.smithi115.stdout:(61/120): python3-simplegeneric-0.8.1-17.el8.no 151 kB/s | 19 kB 00:00 2023-11-30T17:04:23.173 INFO:teuthology.orchestra.run.smithi115.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 135 kB/s | 29 kB 00:00 2023-11-30T17:04:23.368 INFO:teuthology.orchestra.run.smithi115.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 141 kB/s | 27 kB 00:00 2023-11-30T17:04:23.642 INFO:teuthology.orchestra.run.smithi115.stdout:(64/120): python3-singledispatch-3.4.0.3-18.el8 35 kB/s | 24 kB 00:00 2023-11-30T17:04:23.799 INFO:teuthology.orchestra.run.smithi115.stdout:(65/120): python3-webob-1.8.5-1.el8.1.noarch.rp 1.6 MB/s | 251 kB 00:00 2023-11-30T17:04:23.926 INFO:teuthology.orchestra.run.smithi115.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 484 kB/s | 61 kB 00:00 2023-11-30T17:04:24.156 INFO:teuthology.orchestra.run.smithi115.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 372 kB/s | 85 kB 00:00 2023-11-30T17:04:24.403 INFO:teuthology.orchestra.run.smithi115.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 93 kB/s | 23 kB 00:00 2023-11-30T17:04:24.426 INFO:teuthology.orchestra.run.smithi115.stdout:(69/120): python3-waitress-1.4.3-1.el8.noarch.r 241 kB/s | 255 kB 00:01 2023-11-30T17:04:24.428 INFO:teuthology.orchestra.run.smithi115.stdout:(70/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-11-30T17:04:24.472 INFO:teuthology.orchestra.run.smithi115.stdout:(71/120): python3-jwt-1.6.1-2.el8.noarch.rpm 993 kB/s | 43 kB 00:00 2023-11-30T17:04:24.483 INFO:teuthology.orchestra.run.smithi115.stdout:(72/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 328 kB/s | 19 kB 00:00 2023-11-30T17:04:24.496 INFO:teuthology.orchestra.run.smithi115.stdout:(73/120): python3-oauthlib-2.1.0-1.el8.noarch.r 6.2 MB/s | 155 kB 00:00 2023-11-30T17:04:24.508 INFO:teuthology.orchestra.run.smithi115.stdout:(74/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 8.9 MB/s | 220 kB 00:00 2023-11-30T17:04:24.518 INFO:teuthology.orchestra.run.smithi115.stdout:(75/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 2.2 MB/s | 48 kB 00:00 2023-11-30T17:04:24.543 INFO:teuthology.orchestra.run.smithi115.stdout:(76/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 6.6 MB/s | 229 kB 00:00 2023-11-30T17:04:24.553 INFO:teuthology.orchestra.run.smithi115.stdout:(77/120): python3-requests-oauthlib-1.0.0-1.el8 1.2 MB/s | 43 kB 00:00 2023-11-30T17:04:24.573 INFO:teuthology.orchestra.run.smithi115.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 884 kB/s | 18 kB 00:00 2023-11-30T17:04:24.597 INFO:teuthology.orchestra.run.smithi115.stdout:(79/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 42 MB/s | 2.3 MB 00:00 2023-11-30T17:04:24.604 INFO:teuthology.orchestra.run.smithi115.stdout:(80/120): pcre2-devel-10.32-2.el8.x86_64.rpm 19 MB/s | 605 kB 00:00 2023-11-30T17:04:24.631 INFO:teuthology.orchestra.run.smithi115.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 2.4 MB/s | 83 kB 00:00 2023-11-30T17:04:24.632 INFO:teuthology.orchestra.run.smithi115.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 2.1 MB/s | 59 kB 00:00 2023-11-30T17:04:24.654 INFO:teuthology.orchestra.run.smithi115.stdout:(83/120): libcom_err-devel-1.45.6-1.el8.x86_64. 1.7 MB/s | 38 kB 00:00 2023-11-30T17:04:24.658 INFO:teuthology.orchestra.run.smithi115.stdout:(84/120): libquadmath-8.4.1-1.el8.x86_64.rpm 6.3 MB/s | 169 kB 00:00 2023-11-30T17:04:24.691 INFO:teuthology.orchestra.run.smithi115.stdout:(85/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 1.7 MB/s | 58 kB 00:00 2023-11-30T17:04:24.692 INFO:teuthology.orchestra.run.smithi115.stdout:(86/120): libsepol-devel-2.9-2.el8.x86_64.rpm 2.2 MB/s | 86 kB 00:00 2023-11-30T17:04:24.719 INFO:teuthology.orchestra.run.smithi115.stdout:(87/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.7 MB/s | 47 kB 00:00 2023-11-30T17:04:24.733 INFO:teuthology.orchestra.run.smithi115.stdout:(88/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 13 MB/s | 559 kB 00:00 2023-11-30T17:04:24.752 INFO:teuthology.orchestra.run.smithi115.stdout:(89/120): libgfortran-8.4.1-1.el8.x86_64.rpm 19 MB/s | 639 kB 00:00 2023-11-30T17:04:24.769 INFO:teuthology.orchestra.run.smithi115.stdout:(90/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 1.9 MB/s | 70 kB 00:00 2023-11-30T17:04:24.773 INFO:teuthology.orchestra.run.smithi115.stdout:(91/120): libselinux-devel-2.9-5.el8.x86_64.rpm 9.3 MB/s | 200 kB 00:00 2023-11-30T17:04:24.796 INFO:teuthology.orchestra.run.smithi115.stdout:(92/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 3.5 MB/s | 97 kB 00:00 2023-11-30T17:04:24.819 INFO:teuthology.orchestra.run.smithi115.stdout:(93/120): python3-prettytable-0.7.2-14.el8.noar 1.9 MB/s | 44 kB 00:00 2023-11-30T17:04:24.837 INFO:teuthology.orchestra.run.smithi115.stdout:(94/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.5 MB/s | 27 kB 00:00 2023-11-30T17:04:24.856 INFO:teuthology.orchestra.run.smithi115.stdout:(95/120): jq-1.5-12.el8.x86_64.rpm 8.2 MB/s | 161 kB 00:00 2023-11-30T17:04:24.883 INFO:teuthology.orchestra.run.smithi115.stdout:(96/120): flex-2.6.1-9.el8.x86_64.rpm 12 MB/s | 320 kB 00:00 2023-11-30T17:04:24.907 INFO:teuthology.orchestra.run.smithi115.stdout:(97/120): python3-werkzeug-0.12.2-4.el8.noarch. 18 MB/s | 457 kB 00:00 2023-11-30T17:04:25.020 INFO:teuthology.orchestra.run.smithi115.stdout:(98/120): python3-scipy-1.0.0-20.module+el8.1.0 59 MB/s | 15 MB 00:00 2023-11-30T17:04:25.040 INFO:teuthology.orchestra.run.smithi115.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 1.9 MB/s | 39 kB 00:00 2023-11-30T17:04:25.073 INFO:teuthology.orchestra.run.smithi115.stdout:(100/120): python3-babel-2.5.1-5.el8.noarch.rpm 29 MB/s | 4.8 MB 00:00 2023-11-30T17:04:25.077 INFO:teuthology.orchestra.run.smithi115.stdout:(101/120): bison-3.0.4-10.el8.x86_64.rpm 18 MB/s | 688 kB 00:00 2023-11-30T17:04:25.098 INFO:teuthology.orchestra.run.smithi115.stdout:(102/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 10 MB/s | 259 kB 00:00 2023-11-30T17:04:25.101 INFO:teuthology.orchestra.run.smithi115.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 9.2 MB/s | 225 kB 00:00 2023-11-30T17:04:25.124 INFO:teuthology.orchestra.run.smithi115.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 4.9 MB/s | 126 kB 00:00 2023-11-30T17:04:25.146 INFO:teuthology.orchestra.run.smithi115.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 8.3 MB/s | 187 kB 00:00 2023-11-30T17:04:25.163 INFO:teuthology.orchestra.run.smithi115.stdout:(106/120): python3-numpy-1.14.3-9.el8.x86_64.rp 61 MB/s | 3.7 MB 00:00 2023-11-30T17:04:25.169 INFO:teuthology.orchestra.run.smithi115.stdout:(107/120): python3-jinja2-2.10.1-2.el8_0.noarch 23 MB/s | 538 kB 00:00 2023-11-30T17:04:25.198 INFO:teuthology.orchestra.run.smithi115.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 8.6 MB/s | 302 kB 00:00 2023-11-30T17:04:25.206 INFO:teuthology.orchestra.run.smithi115.stdout:(109/120): python3-mako-1.0.6-13.el8.noarch.rpm 4.2 MB/s | 157 kB 00:00 2023-11-30T17:04:25.222 INFO:teuthology.orchestra.run.smithi115.stdout:(110/120): python3-pyasn1-modules-0.3.7-6.el8.n 4.5 MB/s | 110 kB 00:00 2023-11-30T17:04:25.241 INFO:teuthology.orchestra.run.smithi115.stdout:(111/120): python3-jsonpointer-1.10-11.el8.noar 1.1 MB/s | 20 kB 00:00 2023-11-30T17:04:25.250 INFO:teuthology.orchestra.run.smithi115.stdout:(112/120): librdkafka-0.11.4-1.el8.x86_64.rpm 7.8 MB/s | 353 kB 00:00 2023-11-30T17:04:25.268 INFO:teuthology.orchestra.run.smithi115.stdout:(113/120): libtool-2.4.6-25.el8.x86_64.rpm 26 MB/s | 709 kB 00:00 2023-11-30T17:04:25.269 INFO:teuthology.orchestra.run.smithi115.stdout:(114/120): python3-pytz-2017.2-9.el8.noarch.rpm 2.8 MB/s | 54 kB 00:00 2023-11-30T17:04:25.348 INFO:teuthology.orchestra.run.smithi115.stdout:(115/120): openblas-threads-0.3.12-1.el8.x86_64 59 MB/s | 4.7 MB 00:00 2023-11-30T17:04:25.375 INFO:teuthology.orchestra.run.smithi115.stdout:(116/120): openblas-0.3.12-1.el8.x86_64.rpm 44 MB/s | 4.6 MB 00:00 2023-11-30T17:04:25.387 INFO:teuthology.orchestra.run.smithi115.stdout:(117/120): automake-1.16.1-7.el8.noarch.rpm 18 MB/s | 713 kB 00:00 2023-11-30T17:04:26.507 INFO:teuthology.orchestra.run.smithi115.stdout:(118/120): librbd1-16.2.14-328.g0dc074ce.el8.x8 3.7 MB/s | 4.2 MB 00:01 2023-11-30T17:04:27.338 INFO:teuthology.orchestra.run.smithi049.stdout:(10/120): ceph-osd-16.2.14-328.g0dc074ce.el8.x8 2.2 MB/s | 18 MB 00:08 2023-11-30T17:04:27.479 INFO:teuthology.orchestra.run.smithi115.stdout:(119/120): librados2-16.2.14-328.g0dc074ce.el8. 1.8 MB/s | 3.7 MB 00:02 2023-11-30T17:04:27.483 INFO:teuthology.orchestra.run.smithi049.stdout:(11/120): cephfs-mirror-16.2.14-328.g0dc074ce.e 1.7 MB/s | 257 kB 00:00 2023-11-30T17:04:27.548 INFO:teuthology.orchestra.run.smithi049.stdout:(12/120): libcephfs-devel-16.2.14-328.g0dc074ce 397 kB/s | 25 kB 00:00 2023-11-30T17:04:27.947 INFO:teuthology.orchestra.run.smithi049.stdout:(13/120): ceph-radosgw-16.2.14-328.g0dc074ce.el 1.3 MB/s | 12 MB 00:08 2023-11-30T17:04:27.961 INFO:teuthology.orchestra.run.smithi049.stdout:(14/120): libcephfs2-16.2.14-328.g0dc074ce.el8. 2.0 MB/s | 825 kB 00:00 2023-11-30T17:04:28.032 INFO:teuthology.orchestra.run.smithi049.stdout:(15/120): librados-devel-16.2.14-328.g0dc074ce. 1.8 MB/s | 131 kB 00:00 2023-11-30T17:04:28.291 INFO:teuthology.orchestra.run.smithi049.stdout:(16/120): libcephsqlite-16.2.14-328.g0dc074ce.e 506 kB/s | 174 kB 00:00 2023-11-30T17:04:28.312 INFO:teuthology.orchestra.run.smithi049.stdout:(17/120): libradosstriper1-16.2.14-328.g0dc074c 1.7 MB/s | 493 kB 00:00 2023-11-30T17:04:28.376 INFO:teuthology.orchestra.run.smithi049.stdout:(18/120): python3-ceph-argparse-16.2.14-328.g0d 708 kB/s | 45 kB 00:00 2023-11-30T17:04:28.440 INFO:teuthology.orchestra.run.smithi049.stdout:(19/120): python3-ceph-common-16.2.14-328.g0dc0 1.5 MB/s | 99 kB 00:00 2023-11-30T17:04:28.573 INFO:teuthology.orchestra.run.smithi049.stdout:(20/120): python3-cephfs-16.2.14-328.g0dc074ce. 1.6 MB/s | 215 kB 00:00 2023-11-30T17:04:28.788 INFO:teuthology.orchestra.run.smithi049.stdout:(21/120): python3-rados-16.2.14-328.g0dc074ce.e 1.8 MB/s | 390 kB 00:00 2023-11-30T17:04:28.990 INFO:teuthology.orchestra.run.smithi049.stdout:(22/120): python3-rbd-16.2.14-328.g0dc074ce.el8 1.8 MB/s | 369 kB 00:00 2023-11-30T17:04:29.063 INFO:teuthology.orchestra.run.smithi049.stdout:(23/120): python3-rgw-16.2.14-328.g0dc074ce.el8 1.5 MB/s | 114 kB 00:00 2023-11-30T17:04:29.137 INFO:teuthology.orchestra.run.smithi049.stdout:(24/120): rbd-fuse-16.2.14-328.g0dc074ce.el8.x8 1.2 MB/s | 88 kB 00:00 2023-11-30T17:04:30.874 INFO:teuthology.orchestra.run.smithi049.stdout:(25/120): rbd-mirror-16.2.14-328.g0dc074ce.el8. 2.1 MB/s | 3.7 MB 00:01 2023-11-30T17:04:31.028 INFO:teuthology.orchestra.run.smithi049.stdout:(26/120): rbd-nbd-16.2.14-328.g0dc074ce.el8.x86 1.1 MB/s | 175 kB 00:00 2023-11-30T17:04:31.104 INFO:teuthology.orchestra.run.smithi049.stdout:(27/120): ceph-grafana-dashboards-16.2.14-328.g 322 kB/s | 24 kB 00:00 2023-11-30T17:04:31.184 INFO:teuthology.orchestra.run.smithi049.stdout:(28/120): ceph-mgr-cephadm-16.2.14-328.g0dc074c 1.4 MB/s | 116 kB 00:00 2023-11-30T17:04:31.716 INFO:teuthology.orchestra.run.smithi115.stdout:(120/120): ceph-mgr-diskprediction-local-16.2.1 725 kB/s | 8.6 MB 00:12 2023-11-30T17:04:31.722 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2023-11-30T17:04:31.723 INFO:teuthology.orchestra.run.smithi115.stdout:Total 11 MB/s | 201 MB 00:18 2023-11-30T17:04:31.775 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2023-11-30T17:04:31.889 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2023-11-30T17:04:31.889 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2023-11-30T17:04:32.292 INFO:teuthology.orchestra.run.smithi049.stdout:(29/120): ceph-mgr-dashboard-16.2.14-328.g0dc07 2.8 MB/s | 3.1 MB 00:01 2023-11-30T17:04:32.652 INFO:teuthology.orchestra.run.smithi049.stdout:(30/120): librgw2-16.2.14-328.g0dc074ce.el8.x86 891 kB/s | 3.8 MB 00:04 2023-11-30T17:04:32.820 INFO:teuthology.orchestra.run.smithi049.stdout:(31/120): ceph-mgr-modules-core-16.2.14-328.g0d 1.4 MB/s | 245 kB 00:00 2023-11-30T17:04:32.892 INFO:teuthology.orchestra.run.smithi049.stdout:(32/120): ceph-mgr-rook-16.2.14-328.g0dc074ce.e 384 kB/s | 27 kB 00:00 2023-11-30T17:04:32.970 INFO:teuthology.orchestra.run.smithi049.stdout:(33/120): ceph-prometheus-alerts-16.2.14-328.g0 191 kB/s | 15 kB 00:00 2023-11-30T17:04:33.053 INFO:teuthology.orchestra.run.smithi049.stdout:(34/120): cephadm-16.2.14-328.g0dc074ce.el8.noa 1.0 MB/s | 85 kB 00:00 2023-11-30T17:04:33.134 INFO:teuthology.orchestra.run.smithi049.stdout:(35/120): cephfs-top-16.2.14-328.g0dc074ce.el8. 231 kB/s | 19 kB 00:00 2023-11-30T17:04:33.684 INFO:teuthology.orchestra.run.smithi049.stdout:(36/120): gperftools-libs-2.7-9.el8.x86_64.rpm 557 kB/s | 306 kB 00:00 2023-11-30T17:04:33.750 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2023-11-30T17:04:33.754 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2023-11-30T17:04:34.021 INFO:teuthology.orchestra.run.smithi049.stdout:(37/120): leveldb-1.22-1.el8.x86_64.rpm 538 kB/s | 181 kB 00:00 2023-11-30T17:04:34.117 INFO:teuthology.orchestra.run.smithi049.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 610 kB/s | 59 kB 00:00 2023-11-30T17:04:34.177 INFO:teuthology.orchestra.run.smithi049.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 1.2 MB/s | 75 kB 00:00 2023-11-30T17:04:34.270 INFO:teuthology.orchestra.run.smithi049.stdout:(40/120): python3-apipkg-1.5-6.el8.noarch.rpm 230 kB/s | 21 kB 00:00 2023-11-30T17:04:34.353 INFO:teuthology.orchestra.run.smithi049.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 521 kB/s | 44 kB 00:00 2023-11-30T17:04:34.537 INFO:teuthology.orchestra.run.smithi049.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 1.0 MB/s | 185 kB 00:00 2023-11-30T17:04:34.590 INFO:teuthology.orchestra.run.smithi049.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 616 kB/s | 33 kB 00:00 2023-11-30T17:04:34.675 INFO:teuthology.orchestra.run.smithi049.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 195 kB/s | 16 kB 00:00 2023-11-30T17:04:34.877 INFO:teuthology.orchestra.run.smithi049.stdout:(45/120): ceph-mgr-diskprediction-local-16.2.14 3.3 MB/s | 8.6 MB 00:02 2023-11-30T17:04:34.878 INFO:teuthology.orchestra.run.smithi049.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 847 kB/s | 173 kB 00:00 2023-11-30T17:04:35.180 INFO:teuthology.orchestra.run.smithi049.stdout:(47/120): python3-execnet-1.7.1-1.el8.noarch.rp 1.1 MB/s | 355 kB 00:00 2023-11-30T17:04:35.665 INFO:teuthology.orchestra.run.smithi049.stdout:(48/120): python3-cherrypy-18.4.0-1.el8.noarch. 488 kB/s | 384 kB 00:00 2023-11-30T17:04:35.693 INFO:teuthology.orchestra.run.smithi049.stdout:(49/120): python3-google-auth-1.1.1-10.el8.noar 158 kB/s | 81 kB 00:00 2023-11-30T17:04:35.724 INFO:teuthology.orchestra.run.smithi049.stdout:(50/120): python3-jaraco-6.2-6.el8.noarch.rpm 191 kB/s | 11 kB 00:00 2023-11-30T17:04:35.748 INFO:teuthology.orchestra.run.smithi049.stdout:(51/120): python3-jaraco-functools-2.0-4.el8.no 322 kB/s | 18 kB 00:00 2023-11-30T17:04:35.806 INFO:teuthology.orchestra.run.smithi049.stdout:(52/120): python3-logutils-0.3.5-11.el8.noarch. 851 kB/s | 49 kB 00:00 2023-11-30T17:04:35.904 INFO:teuthology.orchestra.run.smithi049.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 598 kB/s | 59 kB 00:00 2023-11-30T17:04:36.014 INFO:teuthology.orchestra.run.smithi049.stdout:(54/120): python3-kubernetes-11.0.0-6.el8.noarc 4.0 MB/s | 1.2 MB 00:00 2023-11-30T17:04:36.068 INFO:teuthology.orchestra.run.smithi049.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 289 kB/s | 16 kB 00:00 2023-11-30T17:04:36.121 INFO:teuthology.orchestra.run.smithi049.stdout:(56/120): python3-remoto-1.2.1-1.el8.noarch.rpm 920 kB/s | 49 kB 00:00 2023-11-30T17:04:36.177 INFO:teuthology.orchestra.run.smithi049.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 603 kB/s | 34 kB 00:00 2023-11-30T17:04:36.185 INFO:teuthology.orchestra.run.smithi049.stdout:(58/120): python3-pecan-1.3.2-9.el8.noarch.rpm 1.0 MB/s | 283 kB 00:00 2023-11-30T17:04:36.249 INFO:teuthology.orchestra.run.smithi049.stdout:(59/120): python3-routes-2.4.1-12.el8.noarch.rp 2.7 MB/s | 196 kB 00:00 2023-11-30T17:04:36.283 INFO:teuthology.orchestra.run.smithi049.stdout:(60/120): python3-rsa-4.9-2.el8.noarch.rpm 654 kB/s | 64 kB 00:00 2023-11-30T17:04:36.308 INFO:teuthology.orchestra.run.smithi049.stdout:(61/120): python3-simplegeneric-0.8.1-17.el8.no 318 kB/s | 19 kB 00:00 2023-11-30T17:04:36.339 INFO:teuthology.orchestra.run.smithi049.stdout:(62/120): python3-singledispatch-3.4.0.3-18.el8 433 kB/s | 24 kB 00:00 2023-11-30T17:04:36.364 INFO:teuthology.orchestra.run.smithi049.stdout:(63/120): python3-tempora-1.14.1-5.el8.noarch.r 525 kB/s | 29 kB 00:00 2023-11-30T17:04:36.394 INFO:teuthology.orchestra.run.smithi049.stdout:(64/120): python3-trustme-0.6.0-4.el8.noarch.rp 500 kB/s | 27 kB 00:00 2023-11-30T17:04:36.466 INFO:teuthology.orchestra.run.smithi049.stdout:(65/120): python3-waitress-1.4.3-1.el8.noarch.r 2.4 MB/s | 255 kB 00:00 2023-11-30T17:04:36.514 INFO:teuthology.orchestra.run.smithi049.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 1.3 MB/s | 61 kB 00:00 2023-11-30T17:04:36.573 INFO:teuthology.orchestra.run.smithi049.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 1.4 MB/s | 85 kB 00:00 2023-11-30T17:04:36.628 INFO:teuthology.orchestra.run.smithi049.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 412 kB/s | 23 kB 00:00 2023-11-30T17:04:36.633 INFO:teuthology.orchestra.run.smithi049.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 16 MB/s | 70 kB 00:00 2023-11-30T17:04:36.634 INFO:teuthology.orchestra.run.smithi049.stdout:(70/120): python3-webob-1.8.5-1.el8.1.noarch.rp 1.0 MB/s | 251 kB 00:00 2023-11-30T17:04:36.729 INFO:teuthology.orchestra.run.smithi049.stdout:(71/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 194 kB/s | 19 kB 00:00 2023-11-30T17:04:36.739 INFO:teuthology.orchestra.run.smithi049.stdout:(72/120): python3-jwt-1.6.1-2.el8.noarch.rpm 409 kB/s | 43 kB 00:00 2023-11-30T17:04:36.828 INFO:teuthology.orchestra.run.smithi049.stdout:(73/120): python3-oauthlib-2.1.0-1.el8.noarch.r 1.5 MB/s | 155 kB 00:00 2023-11-30T17:04:36.851 INFO:teuthology.orchestra.run.smithi049.stdout:(74/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.9 MB/s | 220 kB 00:00 2023-11-30T17:04:36.875 INFO:teuthology.orchestra.run.smithi049.stdout:(75/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 1.0 MB/s | 48 kB 00:00 2023-11-30T17:04:36.975 INFO:teuthology.orchestra.run.smithi049.stdout:(76/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.8 MB/s | 229 kB 00:00 2023-11-30T17:04:36.976 INFO:teuthology.orchestra.run.smithi049.stdout:(77/120): python3-requests-oauthlib-1.0.0-1.el8 417 kB/s | 43 kB 00:00 2023-11-30T17:04:37.002 INFO:teuthology.orchestra.run.smithi049.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 699 kB/s | 18 kB 00:00 2023-11-30T17:04:37.048 INFO:teuthology.orchestra.run.smithi049.stdout:(79/120): pcre2-devel-10.32-2.el8.x86_64.rpm 13 MB/s | 605 kB 00:00 2023-11-30T17:04:37.056 INFO:teuthology.orchestra.run.smithi049.stdout:(80/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 29 MB/s | 2.3 MB 00:00 2023-11-30T17:04:37.076 INFO:teuthology.orchestra.run.smithi049.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 2.9 MB/s | 83 kB 00:00 2023-11-30T17:04:37.107 INFO:teuthology.orchestra.run.smithi049.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 1.1 MB/s | 59 kB 00:00 2023-11-30T17:04:37.117 INFO:teuthology.orchestra.run.smithi049.stdout:(83/120): libquadmath-8.4.1-1.el8.x86_64.rpm 4.1 MB/s | 169 kB 00:00 2023-11-30T17:04:37.156 INFO:teuthology.orchestra.run.smithi049.stdout:(84/120): libsepol-devel-2.9-2.el8.x86_64.rpm 2.2 MB/s | 86 kB 00:00 2023-11-30T17:04:37.204 INFO:teuthology.orchestra.run.smithi049.stdout:(85/120): libcom_err-devel-1.45.6-1.el8.x86_64. 393 kB/s | 38 kB 00:00 2023-11-30T17:04:37.215 INFO:teuthology.orchestra.run.smithi049.stdout:(86/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 971 kB/s | 58 kB 00:00 2023-11-30T17:04:37.261 INFO:teuthology.orchestra.run.smithi049.stdout:(87/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 838 kB/s | 47 kB 00:00 2023-11-30T17:04:37.272 INFO:teuthology.orchestra.run.smithi049.stdout:(88/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 9.7 MB/s | 559 kB 00:00 2023-11-30T17:04:37.361 INFO:teuthology.orchestra.run.smithi049.stdout:(89/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 784 kB/s | 70 kB 00:00 2023-11-30T17:04:37.373 INFO:teuthology.orchestra.run.smithi049.stdout:(90/120): libgfortran-8.4.1-1.el8.x86_64.rpm 5.6 MB/s | 639 kB 00:00 2023-11-30T17:04:37.421 INFO:teuthology.orchestra.run.smithi049.stdout:(91/120): libselinux-devel-2.9-5.el8.x86_64.rpm 3.3 MB/s | 200 kB 00:00 2023-11-30T17:04:37.443 INFO:teuthology.orchestra.run.smithi049.stdout:(92/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 1.4 MB/s | 97 kB 00:00 2023-11-30T17:04:37.748 INFO:teuthology.orchestra.run.smithi049.stdout:(93/120): python3-scipy-1.0.0-20.module+el8.1.0 44 MB/s | 15 MB 00:00 2023-11-30T17:04:37.750 INFO:teuthology.orchestra.run.smithi049.stdout:(94/120): python3-prettytable-0.7.2-14.el8.noar 143 kB/s | 44 kB 00:00 2023-11-30T17:04:37.807 INFO:teuthology.orchestra.run.smithi049.stdout:(95/120): jq-1.5-12.el8.x86_64.rpm 2.8 MB/s | 161 kB 00:00 2023-11-30T17:04:37.828 INFO:teuthology.orchestra.run.smithi049.stdout:(96/120): python3-jsonpatch-1.21-2.el8.noarch.r 334 kB/s | 27 kB 00:00 2023-11-30T17:04:37.961 INFO:teuthology.orchestra.run.smithi049.stdout:(97/120): flex-2.6.1-9.el8.x86_64.rpm 2.0 MB/s | 320 kB 00:00 2023-11-30T17:04:38.039 INFO:teuthology.orchestra.run.smithi049.stdout:(98/120): python3-werkzeug-0.12.2-4.el8.noarch. 2.1 MB/s | 457 kB 00:00 2023-11-30T17:04:38.108 INFO:teuthology.orchestra.run.smithi049.stdout:(99/120): python3-babel-2.5.1-5.el8.noarch.rpm 33 MB/s | 4.8 MB 00:00 2023-11-30T17:04:38.190 INFO:teuthology.orchestra.run.smithi049.stdout:(100/120): python3-markupsafe-0.23-19.el8.x86_6 256 kB/s | 39 kB 00:00 2023-11-30T17:04:38.232 INFO:teuthology.orchestra.run.smithi049.stdout:(101/120): bison-3.0.4-10.el8.x86_64.rpm 5.4 MB/s | 688 kB 00:00 2023-11-30T17:04:38.303 INFO:teuthology.orchestra.run.smithi049.stdout:(102/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.3 MB/s | 259 kB 00:00 2023-11-30T17:04:38.359 INFO:teuthology.orchestra.run.smithi049.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 1.7 MB/s | 225 kB 00:00 2023-11-30T17:04:38.452 INFO:teuthology.orchestra.run.smithi049.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 849 kB/s | 126 kB 00:00 2023-11-30T17:04:38.589 INFO:teuthology.orchestra.run.smithi049.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 1.3 MB/s | 187 kB 00:00 2023-11-30T17:04:38.636 INFO:teuthology.orchestra.run.smithi049.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 11 MB/s | 538 kB 00:00 2023-11-30T17:04:38.675 INFO:teuthology.orchestra.run.smithi049.stdout:(107/120): python3-numpy-1.14.3-9.el8.x86_64.rp 12 MB/s | 3.7 MB 00:00 2023-11-30T17:04:38.679 INFO:teuthology.orchestra.run.smithi049.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 7.0 MB/s | 302 kB 00:00 2023-11-30T17:04:38.695 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2023-11-30T17:04:38.731 INFO:teuthology.orchestra.run.smithi049.stdout:(109/120): python3-mako-1.0.6-13.el8.noarch.rpm 2.8 MB/s | 157 kB 00:00 2023-11-30T17:04:38.744 INFO:teuthology.orchestra.run.smithi049.stdout:(110/120): python3-pyasn1-modules-0.3.7-6.el8.n 1.7 MB/s | 110 kB 00:00 2023-11-30T17:04:38.790 INFO:teuthology.orchestra.run.smithi049.stdout:(111/120): python3-jsonpointer-1.10-11.el8.noar 438 kB/s | 20 kB 00:00 2023-11-30T17:04:38.801 INFO:teuthology.orchestra.run.smithi049.stdout:(112/120): librdkafka-0.11.4-1.el8.x86_64.rpm 4.9 MB/s | 353 kB 00:00 2023-11-30T17:04:38.833 INFO:teuthology.orchestra.run.smithi049.stdout:(113/120): python3-pytz-2017.2-9.el8.noarch.rpm 1.7 MB/s | 54 kB 00:00 2023-11-30T17:04:38.860 INFO:teuthology.orchestra.run.smithi049.stdout:(114/120): libtool-2.4.6-25.el8.x86_64.rpm 9.9 MB/s | 709 kB 00:00 2023-11-30T17:04:38.928 INFO:teuthology.orchestra.run.smithi049.stdout:(115/120): openblas-threads-0.3.12-1.el8.x86_64 50 MB/s | 4.7 MB 00:00 2023-11-30T17:04:38.982 INFO:teuthology.orchestra.run.smithi049.stdout:(116/120): openblas-0.3.12-1.el8.x86_64.rpm 38 MB/s | 4.6 MB 00:00 2023-11-30T17:04:38.989 INFO:teuthology.orchestra.run.smithi049.stdout:(117/120): automake-1.16.1-7.el8.noarch.rpm 17 MB/s | 713 kB 00:00 2023-11-30T17:04:39.129 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-11-30T17:04:39.375 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/122 2023-11-30T17:04:39.492 INFO:teuthology.orchestra.run.smithi049.stdout:(118/120): librbd1-16.2.14-328.g0dc074ce.el8.x8 8.3 MB/s | 4.2 MB 00:00 2023-11-30T17:04:39.605 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-11-30T17:04:39.720 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-11-30T17:04:39.931 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-11-30T17:04:40.317 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-11-30T17:04:40.435 INFO:teuthology.orchestra.run.smithi049.stdout:(119/120): librados2-16.2.14-328.g0dc074ce.el8. 2.6 MB/s | 3.7 MB 00:01 2023-11-30T17:04:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : librados2-2:16.2.14-328.g0dc074ce.el8.x86_64 5/122 2023-11-30T17:04:40.993 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados2-2:16.2.14-328.g0dc074ce.el8.x86_64 5/122 2023-11-30T17:04:41.247 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : librbd1-2:16.2.14-328.g0dc074ce.el8.x86_64 6/122 2023-11-30T17:04:41.372 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librbd1-2:16.2.14-328.g0dc074ce.el8.x86_64 6/122 2023-11-30T17:04:41.605 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephfs2-2:16.2.14-328.g0dc074ce.el8.x86_64 7/122 2023-11-30T17:04:41.735 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephfs2-2:16.2.14-328.g0dc074ce.el8.x86_64 7/122 2023-11-30T17:04:41.968 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rados-2:16.2.14-328.g0dc074ce.el8.x86_64 8/122 2023-11-30T17:04:42.439 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/122 2023-11-30T17:04:42.630 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librgw2-2:16.2.14-328.g0dc074ce.el8.x86_64 10/122 2023-11-30T17:04:42.725 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librgw2-2:16.2.14-328.g0dc074ce.el8.x86_64 10/122 2023-11-30T17:04:42.950 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-11-30T17:04:43.157 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-11-30T17:04:43.379 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephsqlite-2:16.2.14-328.g0dc074ce.el8.x86_64 13/122 2023-11-30T17:04:43.472 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephsqlite-2:16.2.14-328.g0dc074ce.el8.x86_64 13/122 2023-11-30T17:04:43.655 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libradosstriper1-2:16.2.14-328.g0dc074ce.el8.x86 14/122 2023-11-30T17:04:43.712 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libradosstriper1-2:16.2.14-328.g0dc074ce.el8.x86 14/122 2023-11-30T17:04:43.926 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-11-30T17:04:44.194 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-11-30T17:04:44.495 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-11-30T17:04:44.677 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-11-30T17:04:44.846 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-11-30T17:04:44.963 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-11-30T17:04:45.146 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-11-30T17:04:45.696 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-11-30T17:04:45.879 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-11-30T17:04:46.412 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-11-30T17:04:46.670 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-11-30T17:04:47.378 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-11-30T17:04:47.682 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-11-30T17:04:47.913 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-11-30T17:04:48.134 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-11-30T17:04:48.334 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ceph-common-2:16.2.14-328.g0dc074ce.el8. 26/122 2023-11-30T17:04:48.501 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ceph-argparse-2:16.2.14-328.g0dc074ce.el 27/122 2023-11-30T17:04:48.795 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cephfs-2:16.2.14-328.g0dc074ce.el8.x86_6 28/122 2023-11-30T17:04:49.068 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-11-30T17:04:49.378 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-11-30T17:04:49.636 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-11-30T17:04:51.715 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-11-30T17:04:51.824 INFO:teuthology.orchestra.run.smithi049.stdout:(120/120): ceph-test-16.2.14-328.g0dc074ce.el8. 1.6 MB/s | 52 MB 00:31 2023-11-30T17:04:51.828 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2023-11-30T17:04:51.828 INFO:teuthology.orchestra.run.smithi049.stdout:Total 5.4 MB/s | 201 MB 00:37 2023-11-30T17:04:51.888 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2023-11-30T17:04:52.015 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2023-11-30T17:04:52.016 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2023-11-30T17:04:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-11-30T17:04:53.103 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-11-30T17:04:53.432 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-11-30T17:04:53.713 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2023-11-30T17:04:53.717 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2023-11-30T17:04:53.722 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-11-30T17:04:53.982 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-11-30T17:04:54.206 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-11-30T17:04:54.444 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rgw-2:16.2.14-328.g0dc074ce.el8.x86_64 38/122 2023-11-30T17:04:54.626 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rbd-2:16.2.14-328.g0dc074ce.el8.x86_64 39/122 2023-11-30T17:04:54.943 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librados-devel-2:16.2.14-328.g0dc074ce.el8.x86_6 40/122 2023-11-30T17:04:55.183 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-11-30T17:04:55.367 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-11-30T17:04:55.589 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-11-30T17:04:55.830 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-11-30T17:04:56.043 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-11-30T17:04:56.103 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-11-30T17:04:56.302 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-11-30T17:04:56.458 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-11-30T17:04:56.650 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-11-30T17:04:56.832 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-11-30T17:04:56.987 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-11-30T17:04:57.179 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-11-30T17:04:57.355 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-11-30T17:04:57.584 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-11-30T17:04:57.729 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-11-30T17:04:58.079 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-11-30T17:04:58.249 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2023-11-30T17:04:58.339 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-11-30T17:04:58.460 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-11-30T17:04:58.592 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-11-30T17:04:58.668 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/122 2023-11-30T17:04:58.833 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-11-30T17:04:58.890 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-11-30T17:04:58.980 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-11-30T17:04:59.059 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-11-30T17:04:59.158 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-11-30T17:04:59.273 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-11-30T17:04:59.562 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-11-30T17:04:59.589 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-11-30T17:04:59.766 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : librados2-2:16.2.14-328.g0dc074ce.el8.x86_64 5/122 2023-11-30T17:04:59.851 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-11-30T17:05:00.076 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-11-30T17:05:00.197 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librados2-2:16.2.14-328.g0dc074ce.el8.x86_64 5/122 2023-11-30T17:05:00.264 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-11-30T17:05:00.408 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : librbd1-2:16.2.14-328.g0dc074ce.el8.x86_64 6/122 2023-11-30T17:05:00.461 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-11-30T17:05:00.546 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librbd1-2:16.2.14-328.g0dc074ce.el8.x86_64 6/122 2023-11-30T17:05:00.660 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-11-30T17:05:00.724 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephfs2-2:16.2.14-328.g0dc074ce.el8.x86_64 7/122 2023-11-30T17:05:00.824 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libcephfs2-2:16.2.14-328.g0dc074ce.el8.x86_64 7/122 2023-11-30T17:05:00.878 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-11-30T17:05:01.038 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rados-2:16.2.14-328.g0dc074ce.el8.x86_64 8/122 2023-11-30T17:05:01.087 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 68/122 2023-11-30T17:05:01.265 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 69/122 2023-11-30T17:05:01.478 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 70/122 2023-11-30T17:05:01.522 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/122 2023-11-30T17:05:01.674 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librgw2-2:16.2.14-328.g0dc074ce.el8.x86_64 10/122 2023-11-30T17:05:01.687 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 71/122 2023-11-30T17:05:01.790 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librgw2-2:16.2.14-328.g0dc074ce.el8.x86_64 10/122 2023-11-30T17:05:01.922 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 72/122 2023-11-30T17:05:02.037 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-11-30T17:05:02.221 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-11-30T17:05:02.253 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-portend-2.6-1.el8.noarch 73/122 2023-11-30T17:05:02.432 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephsqlite-2:16.2.14-328.g0dc074ce.el8.x86_64 13/122 2023-11-30T17:05:02.491 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 74/122 2023-11-30T17:05:02.528 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libcephsqlite-2:16.2.14-328.g0dc074ce.el8.x86_64 13/122 2023-11-30T17:05:02.666 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libradosstriper1-2:16.2.14-328.g0dc074ce.el8.x86 14/122 2023-11-30T17:05:02.699 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 75/122 2023-11-30T17:05:02.725 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libradosstriper1-2:16.2.14-328.g0dc074ce.el8.x86 14/122 2023-11-30T17:05:02.887 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-11-30T17:05:02.947 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 76/122 2023-11-30T17:05:03.170 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-11-30T17:05:03.391 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-11-30T17:05:03.547 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-11-30T17:05:03.674 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-11-30T17:05:03.816 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-11-30T17:05:03.990 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-11-30T17:05:04.118 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 77/122 2023-11-30T17:05:04.447 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 78/122 2023-11-30T17:05:04.582 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-11-30T17:05:04.693 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 79/122 2023-11-30T17:05:04.748 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-11-30T17:05:05.072 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 80/122 2023-11-30T17:05:05.323 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-11-30T17:05:05.363 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 81/122 2023-11-30T17:05:05.540 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-11-30T17:05:05.598 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/122 2023-11-30T17:05:05.872 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 83/122 2023-11-30T17:05:06.205 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 84/122 2023-11-30T17:05:06.344 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-11-30T17:05:06.453 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 85/122 2023-11-30T17:05:06.594 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-11-30T17:05:06.667 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 86/122 2023-11-30T17:05:06.837 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-11-30T17:05:06.917 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 87/122 2023-11-30T17:05:07.073 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-11-30T17:05:07.221 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ceph-common-2:16.2.14-328.g0dc074ce.el8. 26/122 2023-11-30T17:05:07.355 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ceph-argparse-2:16.2.14-328.g0dc074ce.el 27/122 2023-11-30T17:05:07.635 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cephfs-2:16.2.14-328.g0dc074ce.el8.x86_6 28/122 2023-11-30T17:05:07.855 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-11-30T17:05:08.152 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-11-30T17:05:08.381 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-11-30T17:05:10.588 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-11-30T17:05:10.898 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-11-30T17:05:11.736 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-common-2:16.2.14-328.g0dc074ce.el8.x86_64 88/122 2023-11-30T17:05:11.925 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-11-30T17:05:11.957 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-common-2:16.2.14-328.g0dc074ce.el8.x86_64 88/122 2023-11-30T17:05:12.250 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-11-30T17:05:12.528 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-11-30T17:05:12.695 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-common-2:16.2.14-328.g0dc074ce.el8.x86_64 88/122 2023-11-30T17:05:12.765 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-11-30T17:05:12.965 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-base-2:16.2.14-328.g0dc074ce.el8.x86_64 89/122 2023-11-30T17:05:12.974 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-11-30T17:05:13.086 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-base-2:16.2.14-328.g0dc074ce.el8.x86_64 89/122 2023-11-30T17:05:13.151 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rgw-2:16.2.14-328.g0dc074ce.el8.x86_64 38/122 2023-11-30T17:05:13.206 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-selinux-2:16.2.14-328.g0dc074ce.el8.x86_64 90/122 2023-11-30T17:05:13.320 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rbd-2:16.2.14-328.g0dc074ce.el8.x86_64 39/122 2023-11-30T17:05:13.621 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librados-devel-2:16.2.14-328.g0dc074ce.el8.x86_6 40/122 2023-11-30T17:05:13.813 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-11-30T17:05:14.013 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-11-30T17:05:14.196 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-11-30T17:05:14.702 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-11-30T17:05:14.855 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-11-30T17:05:14.923 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-11-30T17:05:15.107 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-11-30T17:05:15.272 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-11-30T17:05:15.445 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-11-30T17:05:15.611 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-11-30T17:05:15.792 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-11-30T17:05:15.975 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-11-30T17:05:16.120 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-11-30T17:05:16.299 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-11-30T17:05:16.494 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-11-30T17:05:16.802 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-11-30T17:05:17.093 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-11-30T17:05:17.340 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-11-30T17:05:17.629 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-11-30T17:05:17.773 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-11-30T17:05:17.929 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-11-30T17:05:18.244 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-11-30T17:05:18.522 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-11-30T17:05:18.703 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-11-30T17:05:18.861 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-11-30T17:05:19.051 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-11-30T17:05:19.251 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-11-30T17:05:19.451 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-11-30T17:05:19.658 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 68/122 2023-11-30T17:05:19.803 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 69/122 2023-11-30T17:05:20.009 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 70/122 2023-11-30T17:05:20.202 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 71/122 2023-11-30T17:05:20.403 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 72/122 2023-11-30T17:05:20.743 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-portend-2.6-1.el8.noarch 73/122 2023-11-30T17:05:21.022 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 74/122 2023-11-30T17:05:21.217 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 75/122 2023-11-30T17:05:21.462 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 76/122 2023-11-30T17:05:22.698 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 77/122 2023-11-30T17:05:23.020 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 78/122 2023-11-30T17:05:23.282 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 79/122 2023-11-30T17:05:23.629 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 80/122 2023-11-30T17:05:23.882 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 81/122 2023-11-30T17:05:24.103 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/122 2023-11-30T17:05:24.322 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 83/122 2023-11-30T17:05:24.629 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 84/122 2023-11-30T17:05:24.829 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 85/122 2023-11-30T17:05:25.118 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 86/122 2023-11-30T17:05:25.312 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 87/122 2023-11-30T17:05:30.605 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-common-2:16.2.14-328.g0dc074ce.el8.x86_64 88/122 2023-11-30T17:05:30.803 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-common-2:16.2.14-328.g0dc074ce.el8.x86_64 88/122 2023-11-30T17:05:31.022 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-selinux-2:16.2.14-328.g0dc074ce.el8.x86_64 90/122 2023-11-30T17:05:31.022 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /sys 2023-11-30T17:05:31.023 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /proc 2023-11-30T17:05:31.023 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /dev 2023-11-30T17:05:31.023 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /run 2023-11-30T17:05:31.023 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /mnt 2023-11-30T17:05:31.023 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /var/tmp 2023-11-30T17:05:31.023 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /home 2023-11-30T17:05:31.023 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /tmp 2023-11-30T17:05:31.023 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /dev 2023-11-30T17:05:31.023 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:05:31.419 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mds-2:16.2.14-328.g0dc074ce.el8.x86_64 91/122 2023-11-30T17:05:31.582 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-common-2:16.2.14-328.g0dc074ce.el8.x86_64 88/122 2023-11-30T17:05:31.852 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-base-2:16.2.14-328.g0dc074ce.el8.x86_64 89/122 2023-11-30T17:05:31.857 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mds-2:16.2.14-328.g0dc074ce.el8.x86_64 91/122 2023-11-30T17:05:31.974 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-base-2:16.2.14-328.g0dc074ce.el8.x86_64 89/122 2023-11-30T17:05:32.036 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mon-2:16.2.14-328.g0dc074ce.el8.x86_64 92/122 2023-11-30T17:05:32.086 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-selinux-2:16.2.14-328.g0dc074ce.el8.x86_64 90/122 2023-11-30T17:05:33.545 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mon-2:16.2.14-328.g0dc074ce.el8.x86_64 92/122 2023-11-30T17:05:33.752 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-osd-2:16.2.14-328.g0dc074ce.el8.x86_64 93/122 2023-11-30T17:05:33.772 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-osd-2:16.2.14-328.g0dc074ce.el8.x86_64 93/122 2023-11-30T17:05:36.635 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: cephadm-2:16.2.14-328.g0dc074ce.el8.noarch 94/122 2023-11-30T17:05:36.762 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephadm-2:16.2.14-328.g0dc074ce.el8.noarch 94/122 2023-11-30T17:05:36.999 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-328.g0dc074ce.e 95/122 2023-11-30T17:05:37.186 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-328.g0dc074ce. 96/122 2023-11-30T17:05:37.384 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-cephadm-2:16.2.14-328.g0dc074ce.el8.noa 97/122 2023-11-30T17:05:38.337 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.14-328.g0dc074ce.el8.noa 97/122 2023-11-30T17:05:38.617 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-328.g0dc074ce.el8.n 98/122 2023-11-30T17:05:39.664 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-328.g0dc074ce.el8.n 98/122 2023-11-30T17:05:39.867 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-328.g0dc 99/122 2023-11-30T17:05:39.962 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-328.g0dc 99/122 2023-11-30T17:05:40.303 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-328.g0dc074ce.el 100/122 2023-11-30T17:05:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-2:16.2.14-328.g0dc074ce.el8.x86_64 101/122 2023-11-30T17:05:40.535 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-2:16.2.14-328.g0dc074ce.el8.x86_64 101/122 2023-11-30T17:05:40.650 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-rook-2:16.2.14-328.g0dc074ce.el8.noarch 102/122 2023-11-30T17:05:40.660 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-328.g0dc074ce.el8.noarch 102/122 2023-11-30T17:05:41.752 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-2:16.2.14-328.g0dc074ce.el8.x86_64 103/122 2023-11-30T17:05:41.983 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-radosgw-2:16.2.14-328.g0dc074ce.el8.x86_64 104/122 2023-11-30T17:05:42.060 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-328.g0dc074ce.el8.x86_64 104/122 2023-11-30T17:05:42.208 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-immutable-object-cache-2:16.2.14-328.g0dc07 105/122 2023-11-30T17:05:42.250 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.14-328.g0dc07 105/122 2023-11-30T17:05:42.425 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephfs-mirror-2:16.2.14-328.g0dc074ce.el8.x86_64 106/122 2023-11-30T17:05:42.772 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: cephfs-mirror-2:16.2.14-328.g0dc074ce.el8.x86_64 106/122 2023-11-30T17:05:42.966 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-mirror-2:16.2.14-328.g0dc074ce.el8.x86_64 107/122 2023-11-30T17:05:47.553 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: rbd-mirror-2:16.2.14-328.g0dc074ce.el8.x86_64 107/122 2023-11-30T17:05:48.566 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-test-2:16.2.14-328.g0dc074ce.el8.x86_64 108/122 2023-11-30T17:05:48.957 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-11-30T17:05:49.171 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-fuse-2:16.2.14-328.g0dc074ce.el8.x86_64 110/122 2023-11-30T17:05:49.490 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-11-30T17:05:49.690 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-11-30T17:05:49.701 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-11-30T17:05:49.861 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephfs-devel-2:16.2.14-328.g0dc074ce.el8.x86_ 113/122 2023-11-30T17:05:50.045 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-11-30T17:05:50.228 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-selinux-2:16.2.14-328.g0dc074ce.el8.x86_64 90/122 2023-11-30T17:05:50.228 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /sys 2023-11-30T17:05:50.228 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /proc 2023-11-30T17:05:50.228 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /dev 2023-11-30T17:05:50.228 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /run 2023-11-30T17:05:50.228 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /mnt 2023-11-30T17:05:50.228 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /var/tmp 2023-11-30T17:05:50.228 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /home 2023-11-30T17:05:50.228 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /tmp 2023-11-30T17:05:50.228 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /dev 2023-11-30T17:05:50.228 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:05:50.231 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephfs-top-2:16.2.14-328.g0dc074ce.el8.noarch 115/122 2023-11-30T17:05:50.414 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-fuse-2:16.2.14-328.g0dc074ce.el8.x86_64 116/122 2023-11-30T17:05:50.574 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mds-2:16.2.14-328.g0dc074ce.el8.x86_64 91/122 2023-11-30T17:05:50.689 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-nbd-2:16.2.14-328.g0dc074ce.el8.x86_64 117/122 2023-11-30T17:05:50.914 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-11-30T17:05:50.979 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-11-30T17:05:51.043 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mds-2:16.2.14-328.g0dc074ce.el8.x86_64 91/122 2023-11-30T17:05:51.156 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-11-30T17:05:51.165 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-11-30T17:05:51.216 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mon-2:16.2.14-328.g0dc074ce.el8.x86_64 92/122 2023-11-30T17:05:51.325 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-11-30T17:05:51.325 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-11-30T17:05:51.542 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-11-30T17:05:51.543 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-11-30T17:05:52.387 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-11-30T17:05:52.388 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-2:16.2.14-328.g0dc074ce.el8.x86_64 1/122 2023-11-30T17:05:52.388 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-base-2:16.2.14-328.g0dc074ce.el8.x86_64 2/122 2023-11-30T17:05:52.388 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-common-2:16.2.14-328.g0dc074ce.el8.x86_64 3/122 2023-11-30T17:05:52.388 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-fuse-2:16.2.14-328.g0dc074ce.el8.x86_64 4/122 2023-11-30T17:05:52.388 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-immutable-object-cache-2:16.2.14-328.g0dc07 5/122 2023-11-30T17:05:52.388 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mds-2:16.2.14-328.g0dc074ce.el8.x86_64 6/122 2023-11-30T17:05:52.388 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-2:16.2.14-328.g0dc074ce.el8.x86_64 7/122 2023-11-30T17:05:52.388 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mon-2:16.2.14-328.g0dc074ce.el8.x86_64 8/122 2023-11-30T17:05:52.388 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-osd-2:16.2.14-328.g0dc074ce.el8.x86_64 9/122 2023-11-30T17:05:52.388 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-radosgw-2:16.2.14-328.g0dc074ce.el8.x86_64 10/122 2023-11-30T17:05:52.388 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-selinux-2:16.2.14-328.g0dc074ce.el8.x86_64 11/122 2023-11-30T17:05:52.388 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-test-2:16.2.14-328.g0dc074ce.el8.x86_64 12/122 2023-11-30T17:05:52.388 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephfs-mirror-2:16.2.14-328.g0dc074ce.el8.x86_64 13/122 2023-11-30T17:05:52.388 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephfs-devel-2:16.2.14-328.g0dc074ce.el8.x86_ 14/122 2023-11-30T17:05:52.389 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephfs2-2:16.2.14-328.g0dc074ce.el8.x86_64 15/122 2023-11-30T17:05:52.389 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephsqlite-2:16.2.14-328.g0dc074ce.el8.x86_64 16/122 2023-11-30T17:05:52.389 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados-devel-2:16.2.14-328.g0dc074ce.el8.x86_6 17/122 2023-11-30T17:05:52.389 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libradosstriper1-2:16.2.14-328.g0dc074ce.el8.x86 18/122 2023-11-30T17:05:52.389 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librgw2-2:16.2.14-328.g0dc074ce.el8.x86_64 19/122 2023-11-30T17:05:52.389 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ceph-argparse-2:16.2.14-328.g0dc074ce.el 20/122 2023-11-30T17:05:52.389 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ceph-common-2:16.2.14-328.g0dc074ce.el8. 21/122 2023-11-30T17:05:52.389 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cephfs-2:16.2.14-328.g0dc074ce.el8.x86_6 22/122 2023-11-30T17:05:52.389 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rados-2:16.2.14-328.g0dc074ce.el8.x86_64 23/122 2023-11-30T17:05:52.389 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rbd-2:16.2.14-328.g0dc074ce.el8.x86_64 24/122 2023-11-30T17:05:52.389 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rgw-2:16.2.14-328.g0dc074ce.el8.x86_64 25/122 2023-11-30T17:05:52.389 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-fuse-2:16.2.14-328.g0dc074ce.el8.x86_64 26/122 2023-11-30T17:05:52.389 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-mirror-2:16.2.14-328.g0dc074ce.el8.x86_64 27/122 2023-11-30T17:05:52.389 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-nbd-2:16.2.14-328.g0dc074ce.el8.x86_64 28/122 2023-11-30T17:05:52.389 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-328.g0dc074ce. 29/122 2023-11-30T17:05:52.390 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-cephadm-2:16.2.14-328.g0dc074ce.el8.noa 30/122 2023-11-30T17:05:52.390 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-328.g0dc074ce.el8.n 31/122 2023-11-30T17:05:52.390 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-328.g0dc 32/122 2023-11-30T17:05:52.399 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-328.g0dc074ce.el 33/122 2023-11-30T17:05:52.399 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-rook-2:16.2.14-328.g0dc074ce.el8.noarch 34/122 2023-11-30T17:05:52.400 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-328.g0dc074ce.e 35/122 2023-11-30T17:05:52.400 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephadm-2:16.2.14-328.g0dc074ce.el8.noarch 36/122 2023-11-30T17:05:52.400 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephfs-top-2:16.2.14-328.g0dc074ce.el8.noarch 37/122 2023-11-30T17:05:52.400 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 38/122 2023-11-30T17:05:52.400 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : leveldb-1.22-1.el8.x86_64 39/122 2023-11-30T17:05:52.400 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-11-30T17:05:52.400 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-11-30T17:05:52.400 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 42/122 2023-11-30T17:05:52.400 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-11-30T17:05:52.400 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-11-30T17:05:52.400 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-11-30T17:05:52.400 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-11-30T17:05:52.400 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-11-30T17:05:52.400 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-11-30T17:05:52.401 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 49/122 2023-11-30T17:05:52.401 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 50/122 2023-11-30T17:05:52.401 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 51/122 2023-11-30T17:05:52.401 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 52/122 2023-11-30T17:05:52.401 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 53/122 2023-11-30T17:05:52.401 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 54/122 2023-11-30T17:05:52.401 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 55/122 2023-11-30T17:05:52.401 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-11-30T17:05:52.401 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-11-30T17:05:52.401 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 58/122 2023-11-30T17:05:52.401 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 59/122 2023-11-30T17:05:52.401 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 60/122 2023-11-30T17:05:52.401 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 61/122 2023-11-30T17:05:52.401 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 62/122 2023-11-30T17:05:52.402 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 63/122 2023-11-30T17:05:52.402 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 64/122 2023-11-30T17:05:52.402 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 65/122 2023-11-30T17:05:52.402 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 66/122 2023-11-30T17:05:52.402 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/122 2023-11-30T17:05:52.402 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/122 2023-11-30T17:05:52.402 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/122 2023-11-30T17:05:52.402 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 70/122 2023-11-30T17:05:52.402 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-11-30T17:05:52.402 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-11-30T17:05:52.402 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-11-30T17:05:52.402 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-11-30T17:05:52.402 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-11-30T17:05:52.402 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-11-30T17:05:52.403 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-11-30T17:05:52.403 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-11-30T17:05:52.403 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-11-30T17:05:52.403 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-11-30T17:05:52.403 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-11-30T17:05:52.403 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-11-30T17:05:52.403 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-11-30T17:05:52.403 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-11-30T17:05:52.403 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-11-30T17:05:52.403 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-11-30T17:05:52.403 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-11-30T17:05:52.403 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-11-30T17:05:52.403 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-11-30T17:05:52.403 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-11-30T17:05:52.403 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-11-30T17:05:52.404 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-11-30T17:05:52.404 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-11-30T17:05:52.404 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-11-30T17:05:52.404 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-11-30T17:05:52.404 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-11-30T17:05:52.404 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-11-30T17:05:52.404 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-11-30T17:05:52.404 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-11-30T17:05:52.404 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-11-30T17:05:52.404 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-11-30T17:05:52.404 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-11-30T17:05:52.404 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-11-30T17:05:52.404 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-11-30T17:05:52.404 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-11-30T17:05:52.405 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-11-30T17:05:52.405 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-11-30T17:05:52.405 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-11-30T17:05:52.405 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-11-30T17:05:52.405 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-11-30T17:05:52.405 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-11-30T17:05:52.405 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-11-30T17:05:52.405 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-11-30T17:05:52.405 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-11-30T17:05:52.405 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-11-30T17:05:52.405 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-11-30T17:05:52.405 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-11-30T17:05:52.405 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-11-30T17:05:52.405 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados2-2:16.2.14-328.g0dc074ce.el8.x86_64 119/122 2023-11-30T17:05:52.406 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-11-30T17:05:52.406 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librbd1-2:16.2.14-328.g0dc074ce.el8.x86_64 121/122 2023-11-30T17:05:52.831 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mon-2:16.2.14-328.g0dc074ce.el8.x86_64 92/122 2023-11-30T17:05:52.999 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-osd-2:16.2.14-328.g0dc074ce.el8.x86_64 93/122 2023-11-30T17:05:53.021 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-osd-2:16.2.14-328.g0dc074ce.el8.x86_64 93/122 2023-11-30T17:05:54.630 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-11-30T17:05:54.630 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:50 ago on Thu 30 Nov 2023 05:04:04 PM UTC. 2023-11-30T17:05:56.055 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: cephadm-2:16.2.14-328.g0dc074ce.el8.noarch 94/122 2023-11-30T17:05:56.218 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephadm-2:16.2.14-328.g0dc074ce.el8.noarch 94/122 2023-11-30T17:05:56.405 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-328.g0dc074ce.e 95/122 2023-11-30T17:05:56.561 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-328.g0dc074ce. 96/122 2023-11-30T17:05:56.580 INFO:teuthology.orchestra.run.smithi115.stdout:Installed products updated. 2023-11-30T17:05:56.738 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:05:56.738 INFO:teuthology.orchestra.run.smithi115.stdout:Upgraded: 2023-11-30T17:05:56.738 INFO:teuthology.orchestra.run.smithi115.stdout: librados2-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:05:56.738 INFO:teuthology.orchestra.run.smithi115.stdout: librbd1-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:05:56.738 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2023-11-30T17:05:56.738 INFO:teuthology.orchestra.run.smithi115.stdout: automake-1.16.1-7.el8.noarch 2023-11-30T17:05:56.738 INFO:teuthology.orchestra.run.smithi115.stdout: bison-3.0.4-10.el8.x86_64 2023-11-30T17:05:56.738 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:05:56.738 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:05:56.738 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-common-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:05:56.738 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-fuse-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:05:56.738 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-grafana-dashboards-2:16.2.14-328.g0dc074ce.el8.noarch 2023-11-30T17:05:56.739 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-immutable-object-cache-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:05:56.739 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mds-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:05:56.739 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:05:56.739 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-cephadm-2:16.2.14-328.g0dc074ce.el8.noarch 2023-11-30T17:05:56.739 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard-2:16.2.14-328.g0dc074ce.el8.noarch 2023-11-30T17:05:56.739 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-local-2:16.2.14-328.g0dc074ce.el8.noarch 2023-11-30T17:05:56.739 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core-2:16.2.14-328.g0dc074ce.el8.noarch 2023-11-30T17:05:56.739 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-rook-2:16.2.14-328.g0dc074ce.el8.noarch 2023-11-30T17:05:56.739 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mon-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:05:56.739 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-osd-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:05:56.739 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-prometheus-alerts-2:16.2.14-328.g0dc074ce.el8.noarch 2023-11-30T17:05:56.739 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-radosgw-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:05:56.739 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-selinux-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:05:56.739 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-test-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:05:56.740 INFO:teuthology.orchestra.run.smithi115.stdout: cephadm-2:16.2.14-328.g0dc074ce.el8.noarch 2023-11-30T17:05:56.740 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-mirror-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:05:56.740 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-top-2:16.2.14-328.g0dc074ce.el8.noarch 2023-11-30T17:05:56.740 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-11-30T17:05:56.740 INFO:teuthology.orchestra.run.smithi115.stdout: flex-2.6.1-9.el8.x86_64 2023-11-30T17:05:56.740 INFO:teuthology.orchestra.run.smithi115.stdout: fuse-2.9.7-12.el8.x86_64 2023-11-30T17:05:56.740 INFO:teuthology.orchestra.run.smithi115.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-11-30T17:05:56.740 INFO:teuthology.orchestra.run.smithi115.stdout: jq-1.5-12.el8.x86_64 2023-11-30T17:05:56.740 INFO:teuthology.orchestra.run.smithi115.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-11-30T17:05:56.740 INFO:teuthology.orchestra.run.smithi115.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-11-30T17:05:56.740 INFO:teuthology.orchestra.run.smithi115.stdout: leveldb-1.22-1.el8.x86_64 2023-11-30T17:05:56.740 INFO:teuthology.orchestra.run.smithi115.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-11-30T17:05:56.740 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-devel-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:05:56.740 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:05:56.741 INFO:teuthology.orchestra.run.smithi115.stdout: libcephsqlite-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:05:56.741 INFO:teuthology.orchestra.run.smithi115.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-11-30T17:05:56.741 INFO:teuthology.orchestra.run.smithi115.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-11-30T17:05:56.741 INFO:teuthology.orchestra.run.smithi115.stdout: liboath-2.6.2-3.el8.x86_64 2023-11-30T17:05:56.741 INFO:teuthology.orchestra.run.smithi115.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-11-30T17:05:56.741 INFO:teuthology.orchestra.run.smithi115.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-11-30T17:05:56.741 INFO:teuthology.orchestra.run.smithi115.stdout: librados-devel-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:05:56.741 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:05:56.741 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-11-30T17:05:56.741 INFO:teuthology.orchestra.run.smithi115.stdout: librgw2-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:05:56.741 INFO:teuthology.orchestra.run.smithi115.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-11-30T17:05:56.741 INFO:teuthology.orchestra.run.smithi115.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-11-30T17:05:56.741 INFO:teuthology.orchestra.run.smithi115.stdout: libtool-2.4.6-25.el8.x86_64 2023-11-30T17:05:56.741 INFO:teuthology.orchestra.run.smithi115.stdout: libunwind-1.3.1-3.el8.x86_64 2023-11-30T17:05:56.742 INFO:teuthology.orchestra.run.smithi115.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-11-30T17:05:56.742 INFO:teuthology.orchestra.run.smithi115.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-11-30T17:05:56.742 INFO:teuthology.orchestra.run.smithi115.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-11-30T17:05:56.742 INFO:teuthology.orchestra.run.smithi115.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-11-30T17:05:56.742 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-0.3.12-1.el8.x86_64 2023-11-30T17:05:56.742 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-11-30T17:05:56.742 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-11-30T17:05:56.742 INFO:teuthology.orchestra.run.smithi115.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-11-30T17:05:56.742 INFO:teuthology.orchestra.run.smithi115.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-11-30T17:05:56.742 INFO:teuthology.orchestra.run.smithi115.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-11-30T17:05:56.742 INFO:teuthology.orchestra.run.smithi115.stdout: python3-apipkg-1.5-6.el8.noarch 2023-11-30T17:05:56.742 INFO:teuthology.orchestra.run.smithi115.stdout: python3-babel-2.5.1-5.el8.noarch 2023-11-30T17:05:56.742 INFO:teuthology.orchestra.run.smithi115.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-11-30T17:05:56.742 INFO:teuthology.orchestra.run.smithi115.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-11-30T17:05:56.743 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-11-30T17:05:56.743 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:05:56.743 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:05:56.743 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cephfs-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:05:56.743 INFO:teuthology.orchestra.run.smithi115.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-11-30T17:05:56.743 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-11-30T17:05:56.743 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-11-30T17:05:56.744 INFO:teuthology.orchestra.run.smithi115.stdout: python3-execnet-1.7.1-1.el8.noarch 2023-11-30T17:05:56.744 INFO:teuthology.orchestra.run.smithi115.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-11-30T17:05:56.744 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-6.2-6.el8.noarch 2023-11-30T17:05:56.744 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-11-30T17:05:56.744 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-11-30T17:05:56.744 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-11-30T17:05:56.744 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-11-30T17:05:56.744 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-11-30T17:05:56.744 INFO:teuthology.orchestra.run.smithi115.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-11-30T17:05:56.744 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-11-30T17:05:56.744 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako-1.0.6-13.el8.noarch 2023-11-30T17:05:56.744 INFO:teuthology.orchestra.run.smithi115.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-11-30T17:05:56.744 INFO:teuthology.orchestra.run.smithi115.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-11-30T17:05:56.744 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-11-30T17:05:56.745 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-11-30T17:05:56.745 INFO:teuthology.orchestra.run.smithi115.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-11-30T17:05:56.745 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-11-30T17:05:56.745 INFO:teuthology.orchestra.run.smithi115.stdout: python3-portend-2.6-1.el8.noarch 2023-11-30T17:05:56.745 INFO:teuthology.orchestra.run.smithi115.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-11-30T17:05:56.745 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-11-30T17:05:56.745 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-11-30T17:05:56.745 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pytz-2017.2-9.el8.noarch 2023-11-30T17:05:56.745 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rados-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:05:56.745 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rbd-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:05:56.745 INFO:teuthology.orchestra.run.smithi115.stdout: python3-remoto-1.2.1-1.el8.noarch 2023-11-30T17:05:56.745 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-11-30T17:05:56.745 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-11-30T17:05:56.745 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rgw-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:05:56.745 INFO:teuthology.orchestra.run.smithi115.stdout: python3-routes-2.4.1-12.el8.noarch 2023-11-30T17:05:56.746 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rsa-4.9-2.el8.noarch 2023-11-30T17:05:56.746 INFO:teuthology.orchestra.run.smithi115.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-11-30T17:05:56.746 INFO:teuthology.orchestra.run.smithi115.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-11-30T17:05:56.746 INFO:teuthology.orchestra.run.smithi115.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-11-30T17:05:56.746 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-11-30T17:05:56.746 INFO:teuthology.orchestra.run.smithi115.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-11-30T17:05:56.746 INFO:teuthology.orchestra.run.smithi115.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-11-30T17:05:56.746 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-11-30T17:05:56.746 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-11-30T17:05:56.746 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-11-30T17:05:56.746 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-11-30T17:05:56.746 INFO:teuthology.orchestra.run.smithi115.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-11-30T17:05:56.746 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-fuse-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:05:56.746 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-mirror-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:05:56.746 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-nbd-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:05:56.747 INFO:teuthology.orchestra.run.smithi115.stdout: socat-1.7.3.3-2.el8.x86_64 2023-11-30T17:05:56.747 INFO:teuthology.orchestra.run.smithi115.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-11-30T17:05:56.747 INFO:teuthology.orchestra.run.smithi115.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-11-30T17:05:56.747 INFO:teuthology.orchestra.run.smithi115.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-11-30T17:05:56.747 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:05:56.747 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2023-11-30T17:05:56.765 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-cephadm-2:16.2.14-328.g0dc074ce.el8.noa 97/122 2023-11-30T17:05:57.054 DEBUG:teuthology.parallel:result is None 2023-11-30T17:05:57.782 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.14-328.g0dc074ce.el8.noa 97/122 2023-11-30T17:05:58.022 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-328.g0dc074ce.el8.n 98/122 2023-11-30T17:05:59.156 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-328.g0dc074ce.el8.n 98/122 2023-11-30T17:05:59.323 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-328.g0dc 99/122 2023-11-30T17:05:59.424 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-328.g0dc 99/122 2023-11-30T17:05:59.945 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-328.g0dc074ce.el 100/122 2023-11-30T17:06:00.114 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-2:16.2.14-328.g0dc074ce.el8.x86_64 101/122 2023-11-30T17:06:00.142 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-2:16.2.14-328.g0dc074ce.el8.x86_64 101/122 2023-11-30T17:06:00.322 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-rook-2:16.2.14-328.g0dc074ce.el8.noarch 102/122 2023-11-30T17:06:00.334 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-328.g0dc074ce.el8.noarch 102/122 2023-11-30T17:06:01.476 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-2:16.2.14-328.g0dc074ce.el8.x86_64 103/122 2023-11-30T17:06:01.855 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-radosgw-2:16.2.14-328.g0dc074ce.el8.x86_64 104/122 2023-11-30T17:06:01.935 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-328.g0dc074ce.el8.x86_64 104/122 2023-11-30T17:06:02.073 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-immutable-object-cache-2:16.2.14-328.g0dc07 105/122 2023-11-30T17:06:02.116 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.14-328.g0dc07 105/122 2023-11-30T17:06:02.247 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephfs-mirror-2:16.2.14-328.g0dc074ce.el8.x86_64 106/122 2023-11-30T17:06:02.619 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: cephfs-mirror-2:16.2.14-328.g0dc074ce.el8.x86_64 106/122 2023-11-30T17:06:02.822 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-mirror-2:16.2.14-328.g0dc074ce.el8.x86_64 107/122 2023-11-30T17:06:07.735 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: rbd-mirror-2:16.2.14-328.g0dc074ce.el8.x86_64 107/122 2023-11-30T17:06:08.796 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-test-2:16.2.14-328.g0dc074ce.el8.x86_64 108/122 2023-11-30T17:06:09.150 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-11-30T17:06:09.358 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-fuse-2:16.2.14-328.g0dc074ce.el8.x86_64 110/122 2023-11-30T17:06:09.606 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-11-30T17:06:09.804 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-11-30T17:06:09.816 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-11-30T17:06:09.968 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephfs-devel-2:16.2.14-328.g0dc074ce.el8.x86_ 113/122 2023-11-30T17:06:10.110 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-11-30T17:06:10.271 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephfs-top-2:16.2.14-328.g0dc074ce.el8.noarch 115/122 2023-11-30T17:06:10.422 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-fuse-2:16.2.14-328.g0dc074ce.el8.x86_64 116/122 2023-11-30T17:06:10.646 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-nbd-2:16.2.14-328.g0dc074ce.el8.x86_64 117/122 2023-11-30T17:06:10.837 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-11-30T17:06:10.904 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-11-30T17:06:11.054 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-11-30T17:06:11.063 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-11-30T17:06:11.182 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-11-30T17:06:11.182 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-11-30T17:06:11.399 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-11-30T17:06:11.399 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-11-30T17:06:12.221 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-11-30T17:06:12.221 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-2:16.2.14-328.g0dc074ce.el8.x86_64 1/122 2023-11-30T17:06:12.221 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-base-2:16.2.14-328.g0dc074ce.el8.x86_64 2/122 2023-11-30T17:06:12.221 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-common-2:16.2.14-328.g0dc074ce.el8.x86_64 3/122 2023-11-30T17:06:12.221 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-fuse-2:16.2.14-328.g0dc074ce.el8.x86_64 4/122 2023-11-30T17:06:12.221 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-immutable-object-cache-2:16.2.14-328.g0dc07 5/122 2023-11-30T17:06:12.221 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mds-2:16.2.14-328.g0dc074ce.el8.x86_64 6/122 2023-11-30T17:06:12.221 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-2:16.2.14-328.g0dc074ce.el8.x86_64 7/122 2023-11-30T17:06:12.221 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mon-2:16.2.14-328.g0dc074ce.el8.x86_64 8/122 2023-11-30T17:06:12.222 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-osd-2:16.2.14-328.g0dc074ce.el8.x86_64 9/122 2023-11-30T17:06:12.222 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-radosgw-2:16.2.14-328.g0dc074ce.el8.x86_64 10/122 2023-11-30T17:06:12.222 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-selinux-2:16.2.14-328.g0dc074ce.el8.x86_64 11/122 2023-11-30T17:06:12.222 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-test-2:16.2.14-328.g0dc074ce.el8.x86_64 12/122 2023-11-30T17:06:12.222 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephfs-mirror-2:16.2.14-328.g0dc074ce.el8.x86_64 13/122 2023-11-30T17:06:12.222 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephfs-devel-2:16.2.14-328.g0dc074ce.el8.x86_ 14/122 2023-11-30T17:06:12.222 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephfs2-2:16.2.14-328.g0dc074ce.el8.x86_64 15/122 2023-11-30T17:06:12.222 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephsqlite-2:16.2.14-328.g0dc074ce.el8.x86_64 16/122 2023-11-30T17:06:12.222 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados-devel-2:16.2.14-328.g0dc074ce.el8.x86_6 17/122 2023-11-30T17:06:12.222 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libradosstriper1-2:16.2.14-328.g0dc074ce.el8.x86 18/122 2023-11-30T17:06:12.222 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librgw2-2:16.2.14-328.g0dc074ce.el8.x86_64 19/122 2023-11-30T17:06:12.222 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ceph-argparse-2:16.2.14-328.g0dc074ce.el 20/122 2023-11-30T17:06:12.222 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ceph-common-2:16.2.14-328.g0dc074ce.el8. 21/122 2023-11-30T17:06:12.222 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cephfs-2:16.2.14-328.g0dc074ce.el8.x86_6 22/122 2023-11-30T17:06:12.223 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rados-2:16.2.14-328.g0dc074ce.el8.x86_64 23/122 2023-11-30T17:06:12.223 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rbd-2:16.2.14-328.g0dc074ce.el8.x86_64 24/122 2023-11-30T17:06:12.223 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rgw-2:16.2.14-328.g0dc074ce.el8.x86_64 25/122 2023-11-30T17:06:12.223 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-fuse-2:16.2.14-328.g0dc074ce.el8.x86_64 26/122 2023-11-30T17:06:12.223 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-mirror-2:16.2.14-328.g0dc074ce.el8.x86_64 27/122 2023-11-30T17:06:12.223 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-nbd-2:16.2.14-328.g0dc074ce.el8.x86_64 28/122 2023-11-30T17:06:12.223 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-328.g0dc074ce. 29/122 2023-11-30T17:06:12.240 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-cephadm-2:16.2.14-328.g0dc074ce.el8.noa 30/122 2023-11-30T17:06:12.240 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-328.g0dc074ce.el8.n 31/122 2023-11-30T17:06:12.240 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-328.g0dc 32/122 2023-11-30T17:06:12.240 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-328.g0dc074ce.el 33/122 2023-11-30T17:06:12.241 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-rook-2:16.2.14-328.g0dc074ce.el8.noarch 34/122 2023-11-30T17:06:12.241 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-328.g0dc074ce.e 35/122 2023-11-30T17:06:12.241 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephadm-2:16.2.14-328.g0dc074ce.el8.noarch 36/122 2023-11-30T17:06:12.241 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephfs-top-2:16.2.14-328.g0dc074ce.el8.noarch 37/122 2023-11-30T17:06:12.241 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 38/122 2023-11-30T17:06:12.241 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : leveldb-1.22-1.el8.x86_64 39/122 2023-11-30T17:06:12.241 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-11-30T17:06:12.242 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-11-30T17:06:12.242 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 42/122 2023-11-30T17:06:12.242 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-11-30T17:06:12.242 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-11-30T17:06:12.242 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-11-30T17:06:12.242 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-11-30T17:06:12.242 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-11-30T17:06:12.242 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-11-30T17:06:12.243 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 49/122 2023-11-30T17:06:12.243 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 50/122 2023-11-30T17:06:12.243 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 51/122 2023-11-30T17:06:12.243 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 52/122 2023-11-30T17:06:12.243 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 53/122 2023-11-30T17:06:12.243 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 54/122 2023-11-30T17:06:12.243 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 55/122 2023-11-30T17:06:12.243 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-11-30T17:06:12.243 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-11-30T17:06:12.244 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 58/122 2023-11-30T17:06:12.244 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 59/122 2023-11-30T17:06:12.244 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 60/122 2023-11-30T17:06:12.244 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 61/122 2023-11-30T17:06:12.244 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 62/122 2023-11-30T17:06:12.244 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 63/122 2023-11-30T17:06:12.244 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 64/122 2023-11-30T17:06:12.244 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 65/122 2023-11-30T17:06:12.245 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 66/122 2023-11-30T17:06:12.245 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/122 2023-11-30T17:06:12.245 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/122 2023-11-30T17:06:12.245 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/122 2023-11-30T17:06:12.245 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 70/122 2023-11-30T17:06:12.245 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-11-30T17:06:12.245 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-11-30T17:06:12.245 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-11-30T17:06:12.246 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-11-30T17:06:12.246 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-11-30T17:06:12.246 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-11-30T17:06:12.246 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-11-30T17:06:12.246 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-11-30T17:06:12.247 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-11-30T17:06:12.247 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-11-30T17:06:12.247 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-11-30T17:06:12.247 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-11-30T17:06:12.247 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-11-30T17:06:12.247 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-11-30T17:06:12.247 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-11-30T17:06:12.248 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-11-30T17:06:12.248 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-11-30T17:06:12.248 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-11-30T17:06:12.248 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-11-30T17:06:12.248 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-11-30T17:06:12.248 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-11-30T17:06:12.249 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-11-30T17:06:12.249 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-11-30T17:06:12.249 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-11-30T17:06:12.249 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-11-30T17:06:12.249 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-11-30T17:06:12.249 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-11-30T17:06:12.249 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-11-30T17:06:12.250 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-11-30T17:06:12.250 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-11-30T17:06:12.250 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-11-30T17:06:12.250 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-11-30T17:06:12.250 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-11-30T17:06:12.250 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-11-30T17:06:12.250 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-11-30T17:06:12.250 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-11-30T17:06:12.250 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-11-30T17:06:12.250 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-11-30T17:06:12.250 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-11-30T17:06:12.251 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-11-30T17:06:12.251 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-11-30T17:06:12.251 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-11-30T17:06:12.251 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-11-30T17:06:12.251 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-11-30T17:06:12.251 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-11-30T17:06:12.251 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-11-30T17:06:12.251 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-11-30T17:06:12.251 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-11-30T17:06:12.251 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados2-2:16.2.14-328.g0dc074ce.el8.x86_64 119/122 2023-11-30T17:06:12.251 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-11-30T17:06:12.251 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librbd1-2:16.2.14-328.g0dc074ce.el8.x86_64 121/122 2023-11-30T17:06:14.529 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-11-30T17:06:14.529 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:02:09 ago on Thu 30 Nov 2023 05:04:05 PM UTC. 2023-11-30T17:06:16.807 INFO:teuthology.orchestra.run.smithi049.stdout:Installed products updated. 2023-11-30T17:06:16.965 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:06:16.965 INFO:teuthology.orchestra.run.smithi049.stdout:Upgraded: 2023-11-30T17:06:16.965 INFO:teuthology.orchestra.run.smithi049.stdout: librados2-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:06:16.965 INFO:teuthology.orchestra.run.smithi049.stdout: librbd1-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:06:16.965 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2023-11-30T17:06:16.965 INFO:teuthology.orchestra.run.smithi049.stdout: automake-1.16.1-7.el8.noarch 2023-11-30T17:06:16.965 INFO:teuthology.orchestra.run.smithi049.stdout: bison-3.0.4-10.el8.x86_64 2023-11-30T17:06:16.966 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:06:16.966 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:06:16.966 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-common-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:06:16.966 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-fuse-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:06:16.966 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-grafana-dashboards-2:16.2.14-328.g0dc074ce.el8.noarch 2023-11-30T17:06:16.966 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-immutable-object-cache-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:06:16.966 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mds-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:06:16.966 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:06:16.966 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-cephadm-2:16.2.14-328.g0dc074ce.el8.noarch 2023-11-30T17:06:16.966 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-dashboard-2:16.2.14-328.g0dc074ce.el8.noarch 2023-11-30T17:06:16.966 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-diskprediction-local-2:16.2.14-328.g0dc074ce.el8.noarch 2023-11-30T17:06:16.966 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-modules-core-2:16.2.14-328.g0dc074ce.el8.noarch 2023-11-30T17:06:16.967 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-rook-2:16.2.14-328.g0dc074ce.el8.noarch 2023-11-30T17:06:16.967 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mon-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:06:16.967 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-osd-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:06:16.967 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-prometheus-alerts-2:16.2.14-328.g0dc074ce.el8.noarch 2023-11-30T17:06:16.967 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-radosgw-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:06:16.967 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-selinux-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:06:16.967 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-test-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:06:16.967 INFO:teuthology.orchestra.run.smithi049.stdout: cephadm-2:16.2.14-328.g0dc074ce.el8.noarch 2023-11-30T17:06:16.967 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-mirror-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:06:16.967 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-top-2:16.2.14-328.g0dc074ce.el8.noarch 2023-11-30T17:06:16.967 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-11-30T17:06:16.967 INFO:teuthology.orchestra.run.smithi049.stdout: flex-2.6.1-9.el8.x86_64 2023-11-30T17:06:16.967 INFO:teuthology.orchestra.run.smithi049.stdout: fuse-2.9.7-12.el8.x86_64 2023-11-30T17:06:16.968 INFO:teuthology.orchestra.run.smithi049.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-11-30T17:06:16.968 INFO:teuthology.orchestra.run.smithi049.stdout: jq-1.5-12.el8.x86_64 2023-11-30T17:06:16.968 INFO:teuthology.orchestra.run.smithi049.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-11-30T17:06:16.968 INFO:teuthology.orchestra.run.smithi049.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-11-30T17:06:16.968 INFO:teuthology.orchestra.run.smithi049.stdout: leveldb-1.22-1.el8.x86_64 2023-11-30T17:06:16.968 INFO:teuthology.orchestra.run.smithi049.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-11-30T17:06:16.968 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs-devel-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:06:16.968 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs2-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:06:16.968 INFO:teuthology.orchestra.run.smithi049.stdout: libcephsqlite-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:06:16.968 INFO:teuthology.orchestra.run.smithi049.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-11-30T17:06:16.968 INFO:teuthology.orchestra.run.smithi049.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-11-30T17:06:16.968 INFO:teuthology.orchestra.run.smithi049.stdout: liboath-2.6.2-3.el8.x86_64 2023-11-30T17:06:16.968 INFO:teuthology.orchestra.run.smithi049.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-11-30T17:06:16.968 INFO:teuthology.orchestra.run.smithi049.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-11-30T17:06:16.969 INFO:teuthology.orchestra.run.smithi049.stdout: librados-devel-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:06:16.969 INFO:teuthology.orchestra.run.smithi049.stdout: libradosstriper1-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:06:16.969 INFO:teuthology.orchestra.run.smithi049.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-11-30T17:06:16.969 INFO:teuthology.orchestra.run.smithi049.stdout: librgw2-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:06:16.969 INFO:teuthology.orchestra.run.smithi049.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-11-30T17:06:16.969 INFO:teuthology.orchestra.run.smithi049.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-11-30T17:06:16.969 INFO:teuthology.orchestra.run.smithi049.stdout: libtool-2.4.6-25.el8.x86_64 2023-11-30T17:06:16.969 INFO:teuthology.orchestra.run.smithi049.stdout: libunwind-1.3.1-3.el8.x86_64 2023-11-30T17:06:16.969 INFO:teuthology.orchestra.run.smithi049.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-11-30T17:06:16.969 INFO:teuthology.orchestra.run.smithi049.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-11-30T17:06:16.969 INFO:teuthology.orchestra.run.smithi049.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-11-30T17:06:16.969 INFO:teuthology.orchestra.run.smithi049.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-11-30T17:06:16.970 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-0.3.12-1.el8.x86_64 2023-11-30T17:06:16.970 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-11-30T17:06:16.970 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-11-30T17:06:16.970 INFO:teuthology.orchestra.run.smithi049.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-11-30T17:06:16.970 INFO:teuthology.orchestra.run.smithi049.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-11-30T17:06:16.970 INFO:teuthology.orchestra.run.smithi049.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-11-30T17:06:16.970 INFO:teuthology.orchestra.run.smithi049.stdout: python3-apipkg-1.5-6.el8.noarch 2023-11-30T17:06:16.970 INFO:teuthology.orchestra.run.smithi049.stdout: python3-babel-2.5.1-5.el8.noarch 2023-11-30T17:06:16.970 INFO:teuthology.orchestra.run.smithi049.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-11-30T17:06:16.970 INFO:teuthology.orchestra.run.smithi049.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-11-30T17:06:16.970 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-11-30T17:06:16.971 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-argparse-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:06:16.971 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-common-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:06:16.971 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cephfs-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:06:16.971 INFO:teuthology.orchestra.run.smithi049.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-11-30T17:06:16.971 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-11-30T17:06:16.971 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-11-30T17:06:16.971 INFO:teuthology.orchestra.run.smithi049.stdout: python3-execnet-1.7.1-1.el8.noarch 2023-11-30T17:06:16.971 INFO:teuthology.orchestra.run.smithi049.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-11-30T17:06:16.971 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-6.2-6.el8.noarch 2023-11-30T17:06:16.971 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-11-30T17:06:16.971 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-11-30T17:06:16.971 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-11-30T17:06:16.971 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-11-30T17:06:16.971 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-11-30T17:06:16.971 INFO:teuthology.orchestra.run.smithi049.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-11-30T17:06:16.971 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-11-30T17:06:16.972 INFO:teuthology.orchestra.run.smithi049.stdout: python3-mako-1.0.6-13.el8.noarch 2023-11-30T17:06:16.972 INFO:teuthology.orchestra.run.smithi049.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-11-30T17:06:16.972 INFO:teuthology.orchestra.run.smithi049.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-11-30T17:06:16.972 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-11-30T17:06:16.972 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-11-30T17:06:16.972 INFO:teuthology.orchestra.run.smithi049.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-11-30T17:06:16.972 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-11-30T17:06:16.972 INFO:teuthology.orchestra.run.smithi049.stdout: python3-portend-2.6-1.el8.noarch 2023-11-30T17:06:16.972 INFO:teuthology.orchestra.run.smithi049.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-11-30T17:06:16.972 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-11-30T17:06:16.972 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-11-30T17:06:16.972 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytz-2017.2-9.el8.noarch 2023-11-30T17:06:16.972 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rados-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:06:16.972 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rbd-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:06:16.972 INFO:teuthology.orchestra.run.smithi049.stdout: python3-remoto-1.2.1-1.el8.noarch 2023-11-30T17:06:16.973 INFO:teuthology.orchestra.run.smithi049.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-11-30T17:06:16.973 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-11-30T17:06:16.973 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rgw-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:06:16.973 INFO:teuthology.orchestra.run.smithi049.stdout: python3-routes-2.4.1-12.el8.noarch 2023-11-30T17:06:16.973 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rsa-4.9-2.el8.noarch 2023-11-30T17:06:16.973 INFO:teuthology.orchestra.run.smithi049.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-11-30T17:06:16.973 INFO:teuthology.orchestra.run.smithi049.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-11-30T17:06:16.973 INFO:teuthology.orchestra.run.smithi049.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-11-30T17:06:16.973 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-11-30T17:06:16.973 INFO:teuthology.orchestra.run.smithi049.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-11-30T17:06:16.974 INFO:teuthology.orchestra.run.smithi049.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-11-30T17:06:16.974 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-11-30T17:06:16.974 INFO:teuthology.orchestra.run.smithi049.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-11-30T17:06:16.974 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-11-30T17:06:16.974 INFO:teuthology.orchestra.run.smithi049.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-11-30T17:06:16.974 INFO:teuthology.orchestra.run.smithi049.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-11-30T17:06:16.974 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-fuse-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:06:16.974 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-mirror-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:06:16.974 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-nbd-2:16.2.14-328.g0dc074ce.el8.x86_64 2023-11-30T17:06:16.974 INFO:teuthology.orchestra.run.smithi049.stdout: socat-1.7.3.3-2.el8.x86_64 2023-11-30T17:06:16.974 INFO:teuthology.orchestra.run.smithi049.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-11-30T17:06:16.974 INFO:teuthology.orchestra.run.smithi049.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-11-30T17:06:16.975 INFO:teuthology.orchestra.run.smithi049.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-11-30T17:06:16.975 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:06:16.975 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-11-30T17:06:17.244 DEBUG:teuthology.parallel:result is None 2023-11-30T17:06:17.245 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9 2023-11-30T17:06:17.490 DEBUG:teuthology.orchestra.run.smithi049:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-30T17:06:17.512 INFO:teuthology.orchestra.run.smithi049.stdout:16.2.14-328.g0dc074ce.el8 2023-11-30T17:06:17.512 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-328.g0dc074ce.el8 2023-11-30T17:06:17.512 INFO:teuthology.task.install:The correct ceph version 16.2.14-328.g0dc074ce is installed. 2023-11-30T17:06:17.513 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9 2023-11-30T17:06:17.652 DEBUG:teuthology.orchestra.run.smithi115:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-30T17:06:17.675 INFO:teuthology.orchestra.run.smithi115.stdout:16.2.14-328.g0dc074ce.el8 2023-11-30T17:06:17.675 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-328.g0dc074ce.el8 2023-11-30T17:06:17.675 INFO:teuthology.task.install:The correct ceph version 16.2.14-328.g0dc074ce is installed. 2023-11-30T17:06:17.676 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-30T17:06:17.676 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-30T17:06:17.676 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-30T17:06:17.716 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-11-30T17:06:17.716 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-30T17:06:17.755 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-30T17:06:17.755 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-30T17:06:17.755 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/daemon-helper 2023-11-30T17:06:17.781 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-30T17:06:17.846 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-11-30T17:06:17.846 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/daemon-helper 2023-11-30T17:06:17.871 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-30T17:06:17.936 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-30T17:06:17.936 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-30T17:06:17.936 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-30T17:06:17.962 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-30T17:06:18.027 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-11-30T17:06:18.027 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-30T17:06:18.052 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-30T17:06:18.117 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-30T17:06:18.118 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-30T17:06:18.118 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/stdin-killer 2023-11-30T17:06:18.142 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-30T17:06:18.207 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-11-30T17:06:18.207 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/stdin-killer 2023-11-30T17:06:18.231 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-30T17:06:18.296 INFO:teuthology.run_tasks:Running task ceph... 2023-11-30T17:06:18.360 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-30T17:06:18.360 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 777 /var/log/ceph 2023-11-30T17:06:18.362 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 777 /var/log/ceph 2023-11-30T17:06:18.386 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-30T17:06:18.386 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-30T17:06:18.427 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-30T17:06:18.478 INFO:tasks.ceph:Creating extra log directories... 2023-11-30T17:06:18.478 DEBUG:teuthology.orchestra.run.smithi049:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-30T17:06:18.493 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-30T17:06:18.523 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-30T17:06:18.523 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-30T17:06:18.523 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-30T17:06:18.523 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-30T17:06:18.524 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-30T17:06:18.570 DEBUG:teuthology.orchestra.run.smithi049:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-30T17:06:18.683 DEBUG:teuthology.orchestra.run.smithi049:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-30T17:06:18.709 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-11-30T17:06:18.709 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-30T17:06:18.724 DEBUG:teuthology.orchestra.run.smithi115:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-30T17:06:18.836 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-30T17:06:18.897 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-30T17:06:18.897 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-30T17:06:18.897 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472115', 'branch': 'wip-yuri8-testing-2023-11-29-0706-pacific', 'description': 'fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7472115', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri8-testing-2023-11-29-0706-pacific'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri8-testing-2023-11-29-0706-pacific', 'sha1': '0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 416, 'sha1': '0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri8-testing-2023-11-29-0706-pacific', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9', 'targets': {'smithi049.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGWtCmC456vXsvM+Bn7/qfysPkkMTNCua9SIzCCxA1MXbgbTPPxwvKFdbdC7RzEivFCAkkaTQnUfUN/5fjWYzcs=', 'smithi115.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL2YEHmGElf6OzvqTeRZfpqQ6SDdXrnJF0LarYALtARSHEsaJ+XW3FHDs8f855sCsmA+Xlv2nPq3H1Fzj/Dqg8s='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '0dc074ce0b0b3b4f393f56dd32ef36884ebf45a9'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_snap_schedules']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'f2de108beb0a6dde7f3e6c96039071828a1f6269', 'timestamp': '2023-11-30_15:46:13', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-30T17:06:18.898 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-30T17:06:18.900 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-30T17:06:18.914 DEBUG:teuthology.orchestra.run.smithi049:> sudo install -d -m0777 -- /var/run/ceph 2023-11-30T17:06:18.955 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m0777 -- /var/run/ceph 2023-11-30T17:06:18.979 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-30T17:06:18.979 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/scratch_devs of=/dev/stdout 2023-11-30T17:06:19.034 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-30T17:06:19.034 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_1 2023-11-30T17:06:19.089 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-30T17:06:19.090 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-30T17:06:19.090 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 6h/6d Inode: 219558 Links: 1 2023-11-30T17:06:19.090 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-30T17:06:19.090 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2023-11-30T17:06:19.090 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2023-11-30 17:06:11.787743083 +0000 2023-11-30T17:06:19.090 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2023-11-30 17:03:21.068224784 +0000 2023-11-30T17:06:19.090 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2023-11-30 17:03:21.068224784 +0000 2023-11-30T17:06:19.090 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2023-11-30T17:06:19.090 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-30T17:06:19.154 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2023-11-30T17:06:19.154 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2023-11-30T17:06:19.154 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000114757 s, 4.5 MB/s 2023-11-30T17:06:19.155 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-30T17:06:19.211 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_2 2023-11-30T17:06:19.266 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-30T17:06:19.266 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-30T17:06:19.266 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 6h/6d Inode: 220913 Links: 1 2023-11-30T17:06:19.266 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-30T17:06:19.266 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2023-11-30T17:06:19.266 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2023-11-30 17:06:11.787743083 +0000 2023-11-30T17:06:19.267 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2023-11-30 17:03:21.601209353 +0000 2023-11-30T17:06:19.267 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2023-11-30 17:03:21.601209353 +0000 2023-11-30T17:06:19.267 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2023-11-30T17:06:19.269 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-30T17:06:19.329 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2023-11-30T17:06:19.329 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2023-11-30T17:06:19.329 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000111547 s, 4.6 MB/s 2023-11-30T17:06:19.331 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-30T17:06:19.387 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_3 2023-11-30T17:06:19.442 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-30T17:06:19.442 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-30T17:06:19.442 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 6h/6d Inode: 223309 Links: 1 2023-11-30T17:06:19.443 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-30T17:06:19.443 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2023-11-30T17:06:19.443 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2023-11-30 17:06:11.787743083 +0000 2023-11-30T17:06:19.443 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2023-11-30 17:03:22.110194617 +0000 2023-11-30T17:06:19.443 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2023-11-30 17:03:22.110194617 +0000 2023-11-30T17:06:19.443 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2023-11-30T17:06:19.443 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-30T17:06:19.505 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2023-11-30T17:06:19.506 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2023-11-30T17:06:19.506 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000111729 s, 4.6 MB/s 2023-11-30T17:06:19.506 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-30T17:06:19.563 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_4 2023-11-30T17:06:19.618 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-30T17:06:19.619 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-30T17:06:19.619 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 6h/6d Inode: 221109 Links: 1 2023-11-30T17:06:19.619 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-30T17:06:19.619 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2023-11-30T17:06:19.619 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2023-11-30 17:06:11.787743083 +0000 2023-11-30T17:06:19.619 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2023-11-30 17:03:22.637179360 +0000 2023-11-30T17:06:19.619 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2023-11-30 17:03:22.637179360 +0000 2023-11-30T17:06:19.619 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2023-11-30T17:06:19.619 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-30T17:06:19.682 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2023-11-30T17:06:19.683 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2023-11-30T17:06:19.683 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000111006 s, 4.6 MB/s 2023-11-30T17:06:19.684 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-30T17:06:19.740 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-30T17:06:19.740 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-11-30T17:06:19.740 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/scratch_devs of=/dev/stdout 2023-11-30T17:06:19.758 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-30T17:06:19.758 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_1 2023-11-30T17:06:19.816 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-30T17:06:19.816 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-30T17:06:19.816 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 6h/6d Inode: 217074 Links: 1 2023-11-30T17:06:19.816 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-30T17:06:19.816 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2023-11-30T17:06:19.816 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2023-11-30 17:05:51.974458905 +0000 2023-11-30T17:06:19.816 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2023-11-30 17:02:43.980434915 +0000 2023-11-30T17:06:19.816 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2023-11-30 17:02:43.980434915 +0000 2023-11-30T17:06:19.816 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2023-11-30T17:06:19.817 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-30T17:06:19.883 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-11-30T17:06:19.883 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-11-30T17:06:19.883 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000268163 s, 1.9 MB/s 2023-11-30T17:06:19.885 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-30T17:06:19.942 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_2 2023-11-30T17:06:19.998 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-30T17:06:19.999 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-30T17:06:19.999 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 6h/6d Inode: 221307 Links: 1 2023-11-30T17:06:19.999 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-30T17:06:19.999 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2023-11-30T17:06:19.999 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2023-11-30 17:05:51.974458905 +0000 2023-11-30T17:06:19.999 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2023-11-30 17:02:44.505425332 +0000 2023-11-30T17:06:19.999 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2023-11-30 17:02:44.505425332 +0000 2023-11-30T17:06:19.999 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2023-11-30T17:06:19.999 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-30T17:06:20.067 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-11-30T17:06:20.067 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-11-30T17:06:20.067 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000212098 s, 2.4 MB/s 2023-11-30T17:06:20.068 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-30T17:06:20.124 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_3 2023-11-30T17:06:20.180 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-30T17:06:20.180 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-30T17:06:20.180 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 6h/6d Inode: 221420 Links: 1 2023-11-30T17:06:20.180 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-30T17:06:20.180 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2023-11-30T17:06:20.180 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2023-11-30 17:05:51.975458887 +0000 2023-11-30T17:06:20.180 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2023-11-30 17:02:45.014416041 +0000 2023-11-30T17:06:20.180 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2023-11-30 17:02:45.014416041 +0000 2023-11-30T17:06:20.180 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2023-11-30T17:06:20.181 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-30T17:06:20.244 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-11-30T17:06:20.244 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-11-30T17:06:20.244 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000238872 s, 2.1 MB/s 2023-11-30T17:06:20.245 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-30T17:06:20.301 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_4 2023-11-30T17:06:20.356 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-30T17:06:20.356 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-30T17:06:20.356 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 6h/6d Inode: 224258 Links: 1 2023-11-30T17:06:20.357 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-30T17:06:20.357 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2023-11-30T17:06:20.357 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2023-11-30 17:05:51.975458887 +0000 2023-11-30T17:06:20.357 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2023-11-30 17:02:45.505407079 +0000 2023-11-30T17:06:20.357 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2023-11-30 17:02:45.505407079 +0000 2023-11-30T17:06:20.357 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2023-11-30T17:06:20.357 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-30T17:06:20.419 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-11-30T17:06:20.419 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-11-30T17:06:20.419 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000178363 s, 2.9 MB/s 2023-11-30T17:06:20.420 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-30T17:06:20.476 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-30T17:06:20.477 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi049.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi115.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-30T17:06:20.477 INFO:tasks.ceph:Generating config... 2023-11-30T17:06:20.478 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-30T17:06:20.478 INFO:tasks.ceph:[client] debug client = 20 2023-11-30T17:06:20.478 INFO:tasks.ceph:[client] debug ms = 1 2023-11-30T17:06:20.478 INFO:tasks.ceph:[client] pid file = 2023-11-30T17:06:20.478 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-30T17:06:20.478 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-30T17:06:20.478 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-11-30T17:06:20.479 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-30T17:06:20.479 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-30T17:06:20.479 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-30T17:06:20.479 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-30T17:06:20.479 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-30T17:06:20.479 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-30T17:06:20.479 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-30T17:06:20.479 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-30T17:06:20.479 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-30T17:06:20.479 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-30T17:06:20.479 INFO:tasks.ceph:[mgr] debug client = 20 2023-11-30T17:06:20.479 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-11-30T17:06:20.479 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-30T17:06:20.479 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-30T17:06:20.479 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-30T17:06:20.479 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-30T17:06:20.480 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-30T17:06:20.480 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-30T17:06:20.480 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-30T17:06:20.480 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-30T17:06:20.480 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-30T17:06:20.480 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-30T17:06:20.480 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-30T17:06:20.480 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-30T17:06:20.480 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-30T17:06:20.480 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-30T17:06:20.480 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-30T17:06:20.480 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-30T17:06:20.480 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-30T17:06:20.480 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-30T17:06:20.480 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-30T17:06:20.481 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-30T17:06:20.481 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-30T17:06:20.481 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-30T17:06:20.481 INFO:tasks.ceph:Setting up mon.a... 2023-11-30T17:06:20.481 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-30T17:06:20.546 INFO:teuthology.orchestra.run.smithi049.stdout:creating /etc/ceph/ceph.keyring 2023-11-30T17:06:20.548 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-30T17:06:20.590 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-30T17:06:20.657 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.49'), ('mon.b', '172.21.15.115'), ('mon.c', '[v2:172.21.15.115:3301,v1:172.21.15.115:6790]')] 2023-11-30T17:06:20.657 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.49,172.21.15.115,[v2:172.21.15.115:3301,v1:172.21.15.115:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-30T17:06:20.658 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-30T17:06:20.658 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-30T17:06:20.713 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.49 --add b 172.21.15.115 --addv c '[v2:172.21.15.115:3301,v1:172.21.15.115:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-30T17:06:20.795 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-30T17:06:20.796 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool: generated fsid ef213ed4-8f62-4ad5-b55f-7510fd0ee359 2023-11-30T17:06:20.796 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 0 2023-11-30T17:06:20.796 INFO:teuthology.orchestra.run.smithi049.stdout:fsid ef213ed4-8f62-4ad5-b55f-7510fd0ee359 2023-11-30T17:06:20.796 INFO:teuthology.orchestra.run.smithi049.stdout:last_changed 2023-11-30T17:06:20.794914+0000 2023-11-30T17:06:20.796 INFO:teuthology.orchestra.run.smithi049.stdout:created 2023-11-30T17:06:20.794914+0000 2023-11-30T17:06:20.796 INFO:teuthology.orchestra.run.smithi049.stdout:min_mon_release 0 (unknown) 2023-11-30T17:06:20.796 INFO:teuthology.orchestra.run.smithi049.stdout:election_strategy: 1 2023-11-30T17:06:20.796 INFO:teuthology.orchestra.run.smithi049.stdout:0: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.a 2023-11-30T17:06:20.796 INFO:teuthology.orchestra.run.smithi049.stdout:1: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.b 2023-11-30T17:06:20.796 INFO:teuthology.orchestra.run.smithi049.stdout:2: [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] mon.c 2023-11-30T17:06:20.797 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-30T17:06:20.799 DEBUG:teuthology.orchestra.run.smithi049:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-30T17:06:20.853 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ef213ed4-8f62-4ad5-b55f-7510fd0ee359... 2023-11-30T17:06:20.854 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-30T17:06:20.895 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-30T17:06:20.937 INFO:teuthology.orchestra.run.smithi049.stdout:[global] 2023-11-30T17:06:20.937 INFO:teuthology.orchestra.run.smithi049.stdout: chdir = "" 2023-11-30T17:06:20.937 INFO:teuthology.orchestra.run.smithi049.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-30T17:06:20.938 INFO:teuthology.orchestra.run.smithi049.stdout: auth supported = cephx 2023-11-30T17:06:20.938 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:06:20.938 INFO:teuthology.orchestra.run.smithi049.stdout: filestore xattr use omap = true 2023-11-30T17:06:20.938 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:06:20.938 INFO:teuthology.orchestra.run.smithi049.stdout: mon clock drift allowed = 1.000 2023-11-30T17:06:20.938 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:06:20.938 INFO:teuthology.orchestra.run.smithi049.stdout: osd crush chooseleaf type = 0 2023-11-30T17:06:20.938 INFO:teuthology.orchestra.run.smithi049.stdout: auth debug = true 2023-11-30T17:06:20.938 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:06:20.938 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on old message = true 2023-11-30T17:06:20.938 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on bug = true 2023-11-30T17:06:20.938 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:06:20.938 INFO:teuthology.orchestra.run.smithi049.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-30T17:06:20.938 INFO:teuthology.orchestra.run.smithi049.stdout: mon pg warn max object skew = 0 2023-11-30T17:06:20.939 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:06:20.939 INFO:teuthology.orchestra.run.smithi049.stdout: # disable pg_autoscaler by default for new pools 2023-11-30T17:06:20.939 INFO:teuthology.orchestra.run.smithi049.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-30T17:06:20.939 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:06:20.939 INFO:teuthology.orchestra.run.smithi049.stdout: osd pool default size = 2 2023-11-30T17:06:20.939 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:06:20.939 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd allow primary affinity = true 2023-11-30T17:06:20.939 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd allow pg remap = true 2023-11-30T17:06:20.939 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on legacy crush tunables = false 2023-11-30T17:06:20.939 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on crush straw calc version zero = false 2023-11-30T17:06:20.939 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on no sortbitwise = false 2023-11-30T17:06:20.939 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on osd down out interval zero = false 2023-11-30T17:06:20.939 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on too few osds = false 2023-11-30T17:06:20.939 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-30T17:06:20.939 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-30T17:06:20.940 INFO:teuthology.orchestra.run.smithi049.stdout: mon_allow_pool_size_one = true 2023-11-30T17:06:20.940 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:06:20.940 INFO:teuthology.orchestra.run.smithi049.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-11-30T17:06:20.940 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:06:20.940 INFO:teuthology.orchestra.run.smithi049.stdout: osd default data pool replay window = 5 2023-11-30T17:06:20.940 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:06:20.940 INFO:teuthology.orchestra.run.smithi049.stdout: mon allow pool delete = true 2023-11-30T17:06:20.940 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:06:20.940 INFO:teuthology.orchestra.run.smithi049.stdout: mon cluster log file level = debug 2023-11-30T17:06:20.940 INFO:teuthology.orchestra.run.smithi049.stdout: debug asserts on shutdown = true 2023-11-30T17:06:20.940 INFO:teuthology.orchestra.run.smithi049.stdout: mon health detail to clog = false 2023-11-30T17:06:20.940 INFO:teuthology.orchestra.run.smithi049.stdout: mon host = "172.21.15.49,172.21.15.115,[v2:172.21.15.115:3301,v1:172.21.15.115:6790]" 2023-11-30T17:06:20.940 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on skipped message = False 2023-11-30T17:06:20.940 INFO:teuthology.orchestra.run.smithi049.stdout: fsid = ef213ed4-8f62-4ad5-b55f-7510fd0ee359 2023-11-30T17:06:20.941 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:06:20.941 INFO:teuthology.orchestra.run.smithi049.stdout:[osd] 2023-11-30T17:06:20.941 INFO:teuthology.orchestra.run.smithi049.stdout: osd journal size = 100 2023-11-30T17:06:20.941 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:06:20.941 INFO:teuthology.orchestra.run.smithi049.stdout: osd scrub load threshold = 5.0 2023-11-30T17:06:20.941 INFO:teuthology.orchestra.run.smithi049.stdout: osd scrub max interval = 600 2023-11-30T17:06:20.941 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:06:20.941 INFO:teuthology.orchestra.run.smithi049.stdout: osd recover clone overlap = true 2023-11-30T17:06:20.941 INFO:teuthology.orchestra.run.smithi049.stdout: osd recovery max chunk = 1048576 2023-11-30T17:06:20.941 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:06:20.941 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug shutdown = true 2023-11-30T17:06:20.941 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug op order = true 2023-11-30T17:06:20.942 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug verify stray on activate = true 2023-11-30T17:06:20.942 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:06:20.942 INFO:teuthology.orchestra.run.smithi049.stdout: osd open classes on start = true 2023-11-30T17:06:20.942 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug pg log writeout = true 2023-11-30T17:06:20.942 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:06:20.942 INFO:teuthology.orchestra.run.smithi049.stdout: osd deep scrub update digest min age = 30 2023-11-30T17:06:20.942 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:06:20.942 INFO:teuthology.orchestra.run.smithi049.stdout: osd map max advance = 10 2023-11-30T17:06:20.942 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:06:20.942 INFO:teuthology.orchestra.run.smithi049.stdout: journal zero on create = true 2023-11-30T17:06:20.942 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:06:20.942 INFO:teuthology.orchestra.run.smithi049.stdout: filestore ondisk finisher threads = 3 2023-11-30T17:06:20.942 INFO:teuthology.orchestra.run.smithi049.stdout: filestore apply finisher threads = 3 2023-11-30T17:06:20.942 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:06:20.942 INFO:teuthology.orchestra.run.smithi049.stdout: bdev debug aio = true 2023-11-30T17:06:20.943 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug misdirected ops = true 2023-11-30T17:06:20.943 INFO:teuthology.orchestra.run.smithi049.stdout: bdev async discard = True 2023-11-30T17:06:20.943 INFO:teuthology.orchestra.run.smithi049.stdout: bdev enable discard = True 2023-11-30T17:06:20.943 INFO:teuthology.orchestra.run.smithi049.stdout: bluestore allocator = bitmap 2023-11-30T17:06:20.943 INFO:teuthology.orchestra.run.smithi049.stdout: bluestore block size = 96636764160 2023-11-30T17:06:20.943 INFO:teuthology.orchestra.run.smithi049.stdout: bluestore fsck on mount = True 2023-11-30T17:06:20.943 INFO:teuthology.orchestra.run.smithi049.stdout: debug bluefs = 1/20 2023-11-30T17:06:20.943 INFO:teuthology.orchestra.run.smithi049.stdout: debug bluestore = 1/20 2023-11-30T17:06:20.944 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2023-11-30T17:06:20.944 INFO:teuthology.orchestra.run.smithi049.stdout: debug osd = 20 2023-11-30T17:06:20.944 INFO:teuthology.orchestra.run.smithi049.stdout: debug rocksdb = 4/10 2023-11-30T17:06:20.944 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd backfillfull_ratio = 0.85 2023-11-30T17:06:20.944 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd full ratio = 0.9 2023-11-30T17:06:20.944 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd nearfull ratio = 0.8 2023-11-30T17:06:20.944 INFO:teuthology.orchestra.run.smithi049.stdout: osd failsafe full ratio = 0.95 2023-11-30T17:06:20.944 INFO:teuthology.orchestra.run.smithi049.stdout: osd objectstore = bluestore 2023-11-30T17:06:20.944 INFO:teuthology.orchestra.run.smithi049.stdout: osd op complaint time = 180 2023-11-30T17:06:20.945 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:06:20.945 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr] 2023-11-30T17:06:20.945 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2023-11-30T17:06:20.945 INFO:teuthology.orchestra.run.smithi049.stdout: debug mgr = 20 2023-11-30T17:06:20.945 INFO:teuthology.orchestra.run.smithi049.stdout: debug mon = 20 2023-11-30T17:06:20.945 INFO:teuthology.orchestra.run.smithi049.stdout: debug auth = 20 2023-11-30T17:06:20.945 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min pgs per osd = 4 2023-11-30T17:06:20.945 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min bytes per osd = 10 2023-11-30T17:06:20.945 INFO:teuthology.orchestra.run.smithi049.stdout: mgr/telemetry/nag = false 2023-11-30T17:06:20.945 INFO:teuthology.orchestra.run.smithi049.stdout: debug client = 20 2023-11-30T17:06:20.945 INFO:teuthology.orchestra.run.smithi049.stdout: debug finisher = 20 2023-11-30T17:06:20.945 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:06:20.945 INFO:teuthology.orchestra.run.smithi049.stdout:[mon] 2023-11-30T17:06:20.946 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2023-11-30T17:06:20.946 INFO:teuthology.orchestra.run.smithi049.stdout: debug mon = 20 2023-11-30T17:06:20.946 INFO:teuthology.orchestra.run.smithi049.stdout: debug paxos = 20 2023-11-30T17:06:20.946 INFO:teuthology.orchestra.run.smithi049.stdout: debug auth = 20 2023-11-30T17:06:20.946 INFO:teuthology.orchestra.run.smithi049.stdout: mon data avail warn = 5 2023-11-30T17:06:20.946 INFO:teuthology.orchestra.run.smithi049.stdout: mon mgr mkfs grace = 240 2023-11-30T17:06:20.946 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min pgs per osd = 4 2023-11-30T17:06:20.946 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd reporter subtree level = osd 2023-11-30T17:06:20.946 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd prime pg temp = true 2023-11-30T17:06:20.946 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min bytes per osd = 10 2023-11-30T17:06:20.946 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:06:20.947 INFO:teuthology.orchestra.run.smithi049.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-30T17:06:20.947 INFO:teuthology.orchestra.run.smithi049.stdout: auth mon ticket ttl = 660 # 11m 2023-11-30T17:06:20.947 INFO:teuthology.orchestra.run.smithi049.stdout: auth service ticket ttl = 240 # 4m 2023-11-30T17:06:20.947 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:06:20.947 INFO:teuthology.orchestra.run.smithi049.stdout: # don't complain about insecure global_id in the test suite 2023-11-30T17:06:20.947 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-30T17:06:20.947 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-30T17:06:20.947 INFO:teuthology.orchestra.run.smithi049.stdout: mon op complaint time = 120 2023-11-30T17:06:20.947 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:06:20.947 INFO:teuthology.orchestra.run.smithi049.stdout:[client] 2023-11-30T17:06:20.949 INFO:teuthology.orchestra.run.smithi049.stdout: rgw cache enabled = true 2023-11-30T17:06:20.949 INFO:teuthology.orchestra.run.smithi049.stdout: rgw enable ops log = true 2023-11-30T17:06:20.949 INFO:teuthology.orchestra.run.smithi049.stdout: rgw enable usage log = true 2023-11-30T17:06:20.949 INFO:teuthology.orchestra.run.smithi049.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-30T17:06:20.949 INFO:teuthology.orchestra.run.smithi049.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-30T17:06:20.949 INFO:teuthology.orchestra.run.smithi049.stdout: client mount timeout = 600 2023-11-30T17:06:20.949 INFO:teuthology.orchestra.run.smithi049.stdout: debug client = 20 2023-11-30T17:06:20.949 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2023-11-30T17:06:20.949 INFO:teuthology.orchestra.run.smithi049.stdout: pid file = "" 2023-11-30T17:06:20.949 INFO:teuthology.orchestra.run.smithi049.stdout: rados mon op timeout = 900 2023-11-30T17:06:20.949 INFO:teuthology.orchestra.run.smithi049.stdout: rados osd op timeout = 900 2023-11-30T17:06:20.949 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.a] 2023-11-30T17:06:20.949 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.b] 2023-11-30T17:06:20.949 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.c] 2023-11-30T17:06:20.950 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.a] 2023-11-30T17:06:20.950 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.c] 2023-11-30T17:06:20.950 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.b] 2023-11-30T17:06:20.950 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.d] 2023-11-30T17:06:20.950 INFO:teuthology.orchestra.run.smithi049.stdout:[mds] 2023-11-30T17:06:20.950 INFO:teuthology.orchestra.run.smithi049.stdout: debug mds = 20 2023-11-30T17:06:20.950 INFO:teuthology.orchestra.run.smithi049.stdout: debug mds balancer = 20 2023-11-30T17:06:20.950 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2023-11-30T17:06:20.950 INFO:teuthology.orchestra.run.smithi049.stdout: mds debug frag = True 2023-11-30T17:06:20.950 INFO:teuthology.orchestra.run.smithi049.stdout: mds debug scatterstat = True 2023-11-30T17:06:20.950 INFO:teuthology.orchestra.run.smithi049.stdout: mds op complaint time = 180 2023-11-30T17:06:20.950 INFO:teuthology.orchestra.run.smithi049.stdout: mds verify scatter = True 2023-11-30T17:06:20.950 INFO:teuthology.orchestra.run.smithi049.stdout: osd op complaint time = 180 2023-11-30T17:06:20.950 INFO:teuthology.orchestra.run.smithi049.stdout: rados mon op timeout = 900 2023-11-30T17:06:20.951 INFO:teuthology.orchestra.run.smithi049.stdout: rados osd op timeout = 900 2023-11-30T17:06:20.951 INFO:teuthology.orchestra.run.smithi115.stdout:[global] 2023-11-30T17:06:20.951 INFO:teuthology.orchestra.run.smithi115.stdout: chdir = "" 2023-11-30T17:06:20.951 INFO:teuthology.orchestra.run.smithi115.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-30T17:06:20.951 INFO:teuthology.orchestra.run.smithi115.stdout: auth supported = cephx 2023-11-30T17:06:20.951 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:06:20.951 INFO:teuthology.orchestra.run.smithi115.stdout: filestore xattr use omap = true 2023-11-30T17:06:20.952 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:06:20.952 INFO:teuthology.orchestra.run.smithi115.stdout: mon clock drift allowed = 1.000 2023-11-30T17:06:20.952 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:06:20.952 INFO:teuthology.orchestra.run.smithi115.stdout: osd crush chooseleaf type = 0 2023-11-30T17:06:20.952 INFO:teuthology.orchestra.run.smithi115.stdout: auth debug = true 2023-11-30T17:06:20.952 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:06:20.952 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on old message = true 2023-11-30T17:06:20.952 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on bug = true 2023-11-30T17:06:20.952 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:06:20.952 INFO:teuthology.orchestra.run.smithi115.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-30T17:06:20.952 INFO:teuthology.orchestra.run.smithi115.stdout: mon pg warn max object skew = 0 2023-11-30T17:06:20.952 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:06:20.952 INFO:teuthology.orchestra.run.smithi115.stdout: # disable pg_autoscaler by default for new pools 2023-11-30T17:06:20.952 INFO:teuthology.orchestra.run.smithi115.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-30T17:06:20.952 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:06:20.953 INFO:teuthology.orchestra.run.smithi115.stdout: osd pool default size = 2 2023-11-30T17:06:20.953 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:06:20.953 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd allow primary affinity = true 2023-11-30T17:06:20.953 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd allow pg remap = true 2023-11-30T17:06:20.953 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on legacy crush tunables = false 2023-11-30T17:06:20.953 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on crush straw calc version zero = false 2023-11-30T17:06:20.953 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on no sortbitwise = false 2023-11-30T17:06:20.953 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on osd down out interval zero = false 2023-11-30T17:06:20.953 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on too few osds = false 2023-11-30T17:06:20.953 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-30T17:06:20.953 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-30T17:06:20.953 INFO:teuthology.orchestra.run.smithi115.stdout: mon_allow_pool_size_one = true 2023-11-30T17:06:20.953 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:06:20.953 INFO:teuthology.orchestra.run.smithi115.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-11-30T17:06:20.954 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:06:20.954 INFO:teuthology.orchestra.run.smithi115.stdout: osd default data pool replay window = 5 2023-11-30T17:06:20.954 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:06:20.954 INFO:teuthology.orchestra.run.smithi115.stdout: mon allow pool delete = true 2023-11-30T17:06:20.954 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:06:20.954 INFO:teuthology.orchestra.run.smithi115.stdout: mon cluster log file level = debug 2023-11-30T17:06:20.954 INFO:teuthology.orchestra.run.smithi115.stdout: debug asserts on shutdown = true 2023-11-30T17:06:20.954 INFO:teuthology.orchestra.run.smithi115.stdout: mon health detail to clog = false 2023-11-30T17:06:20.955 INFO:teuthology.orchestra.run.smithi115.stdout: mon host = "172.21.15.49,172.21.15.115,[v2:172.21.15.115:3301,v1:172.21.15.115:6790]" 2023-11-30T17:06:20.955 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on skipped message = False 2023-11-30T17:06:20.955 INFO:teuthology.orchestra.run.smithi115.stdout: fsid = ef213ed4-8f62-4ad5-b55f-7510fd0ee359 2023-11-30T17:06:20.955 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:06:20.955 INFO:teuthology.orchestra.run.smithi115.stdout:[osd] 2023-11-30T17:06:20.955 INFO:teuthology.orchestra.run.smithi115.stdout: osd journal size = 100 2023-11-30T17:06:20.955 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:06:20.955 INFO:teuthology.orchestra.run.smithi115.stdout: osd scrub load threshold = 5.0 2023-11-30T17:06:20.955 INFO:teuthology.orchestra.run.smithi115.stdout: osd scrub max interval = 600 2023-11-30T17:06:20.955 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:06:20.955 INFO:teuthology.orchestra.run.smithi115.stdout: osd recover clone overlap = true 2023-11-30T17:06:20.955 INFO:teuthology.orchestra.run.smithi115.stdout: osd recovery max chunk = 1048576 2023-11-30T17:06:20.955 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:06:20.955 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug shutdown = true 2023-11-30T17:06:20.955 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug op order = true 2023-11-30T17:06:20.955 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug verify stray on activate = true 2023-11-30T17:06:20.956 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:06:20.956 INFO:teuthology.orchestra.run.smithi115.stdout: osd open classes on start = true 2023-11-30T17:06:20.956 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug pg log writeout = true 2023-11-30T17:06:20.956 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:06:20.956 INFO:teuthology.orchestra.run.smithi115.stdout: osd deep scrub update digest min age = 30 2023-11-30T17:06:20.956 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:06:20.956 INFO:teuthology.orchestra.run.smithi115.stdout: osd map max advance = 10 2023-11-30T17:06:20.956 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:06:20.956 INFO:teuthology.orchestra.run.smithi115.stdout: journal zero on create = true 2023-11-30T17:06:20.956 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:06:20.956 INFO:teuthology.orchestra.run.smithi115.stdout: filestore ondisk finisher threads = 3 2023-11-30T17:06:20.956 INFO:teuthology.orchestra.run.smithi115.stdout: filestore apply finisher threads = 3 2023-11-30T17:06:20.956 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:06:20.956 INFO:teuthology.orchestra.run.smithi115.stdout: bdev debug aio = true 2023-11-30T17:06:20.956 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug misdirected ops = true 2023-11-30T17:06:20.957 INFO:teuthology.orchestra.run.smithi115.stdout: bdev async discard = True 2023-11-30T17:06:20.957 INFO:teuthology.orchestra.run.smithi115.stdout: bdev enable discard = True 2023-11-30T17:06:20.957 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore allocator = bitmap 2023-11-30T17:06:20.957 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore block size = 96636764160 2023-11-30T17:06:20.957 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore fsck on mount = True 2023-11-30T17:06:20.957 INFO:teuthology.orchestra.run.smithi115.stdout: debug bluefs = 1/20 2023-11-30T17:06:20.957 INFO:teuthology.orchestra.run.smithi115.stdout: debug bluestore = 1/20 2023-11-30T17:06:20.957 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2023-11-30T17:06:20.957 INFO:teuthology.orchestra.run.smithi115.stdout: debug osd = 20 2023-11-30T17:06:20.957 INFO:teuthology.orchestra.run.smithi115.stdout: debug rocksdb = 4/10 2023-11-30T17:06:20.957 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd backfillfull_ratio = 0.85 2023-11-30T17:06:20.957 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd full ratio = 0.9 2023-11-30T17:06:20.957 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd nearfull ratio = 0.8 2023-11-30T17:06:20.957 INFO:teuthology.orchestra.run.smithi115.stdout: osd failsafe full ratio = 0.95 2023-11-30T17:06:20.957 INFO:teuthology.orchestra.run.smithi115.stdout: osd objectstore = bluestore 2023-11-30T17:06:20.957 INFO:teuthology.orchestra.run.smithi115.stdout: osd op complaint time = 180 2023-11-30T17:06:20.958 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:06:20.958 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr] 2023-11-30T17:06:20.958 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2023-11-30T17:06:20.958 INFO:teuthology.orchestra.run.smithi115.stdout: debug mgr = 20 2023-11-30T17:06:20.958 INFO:teuthology.orchestra.run.smithi115.stdout: debug mon = 20 2023-11-30T17:06:20.958 INFO:teuthology.orchestra.run.smithi115.stdout: debug auth = 20 2023-11-30T17:06:20.958 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min pgs per osd = 4 2023-11-30T17:06:20.958 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min bytes per osd = 10 2023-11-30T17:06:20.958 INFO:teuthology.orchestra.run.smithi115.stdout: mgr/telemetry/nag = false 2023-11-30T17:06:20.958 INFO:teuthology.orchestra.run.smithi115.stdout: debug client = 20 2023-11-30T17:06:20.958 INFO:teuthology.orchestra.run.smithi115.stdout: debug finisher = 20 2023-11-30T17:06:20.958 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:06:20.958 INFO:teuthology.orchestra.run.smithi115.stdout:[mon] 2023-11-30T17:06:20.958 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2023-11-30T17:06:20.958 INFO:teuthology.orchestra.run.smithi115.stdout: debug mon = 20 2023-11-30T17:06:20.959 INFO:teuthology.orchestra.run.smithi115.stdout: debug paxos = 20 2023-11-30T17:06:20.959 INFO:teuthology.orchestra.run.smithi115.stdout: debug auth = 20 2023-11-30T17:06:20.959 INFO:teuthology.orchestra.run.smithi115.stdout: mon data avail warn = 5 2023-11-30T17:06:20.959 INFO:teuthology.orchestra.run.smithi115.stdout: mon mgr mkfs grace = 240 2023-11-30T17:06:20.959 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min pgs per osd = 4 2023-11-30T17:06:20.959 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd reporter subtree level = osd 2023-11-30T17:06:20.959 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd prime pg temp = true 2023-11-30T17:06:20.959 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min bytes per osd = 10 2023-11-30T17:06:20.959 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:06:20.959 INFO:teuthology.orchestra.run.smithi115.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-30T17:06:20.959 INFO:teuthology.orchestra.run.smithi115.stdout: auth mon ticket ttl = 660 # 11m 2023-11-30T17:06:20.959 INFO:teuthology.orchestra.run.smithi115.stdout: auth service ticket ttl = 240 # 4m 2023-11-30T17:06:20.959 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:06:20.959 INFO:teuthology.orchestra.run.smithi115.stdout: # don't complain about insecure global_id in the test suite 2023-11-30T17:06:20.959 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-30T17:06:20.959 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-30T17:06:20.960 INFO:teuthology.orchestra.run.smithi115.stdout: mon op complaint time = 120 2023-11-30T17:06:20.960 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T17:06:20.960 INFO:teuthology.orchestra.run.smithi115.stdout:[client] 2023-11-30T17:06:20.960 INFO:teuthology.orchestra.run.smithi115.stdout: rgw cache enabled = true 2023-11-30T17:06:20.960 INFO:teuthology.orchestra.run.smithi115.stdout: rgw enable ops log = true 2023-11-30T17:06:20.960 INFO:teuthology.orchestra.run.smithi115.stdout: rgw enable usage log = true 2023-11-30T17:06:20.960 INFO:teuthology.orchestra.run.smithi115.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-30T17:06:20.960 INFO:teuthology.orchestra.run.smithi115.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-30T17:06:20.960 INFO:teuthology.orchestra.run.smithi115.stdout: client mount timeout = 600 2023-11-30T17:06:20.960 INFO:teuthology.orchestra.run.smithi115.stdout: debug client = 20 2023-11-30T17:06:20.960 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2023-11-30T17:06:20.960 INFO:teuthology.orchestra.run.smithi115.stdout: pid file = "" 2023-11-30T17:06:20.960 INFO:teuthology.orchestra.run.smithi115.stdout: rados mon op timeout = 900 2023-11-30T17:06:20.960 INFO:teuthology.orchestra.run.smithi115.stdout: rados osd op timeout = 900 2023-11-30T17:06:20.960 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.a] 2023-11-30T17:06:20.960 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.b] 2023-11-30T17:06:20.961 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.c] 2023-11-30T17:06:20.961 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.a] 2023-11-30T17:06:20.961 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.c] 2023-11-30T17:06:20.961 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.b] 2023-11-30T17:06:20.961 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.d] 2023-11-30T17:06:20.961 INFO:teuthology.orchestra.run.smithi115.stdout:[mds] 2023-11-30T17:06:20.961 INFO:teuthology.orchestra.run.smithi115.stdout: debug mds = 20 2023-11-30T17:06:20.961 INFO:teuthology.orchestra.run.smithi115.stdout: debug mds balancer = 20 2023-11-30T17:06:20.961 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2023-11-30T17:06:20.961 INFO:teuthology.orchestra.run.smithi115.stdout: mds debug frag = True 2023-11-30T17:06:20.961 INFO:teuthology.orchestra.run.smithi115.stdout: mds debug scatterstat = True 2023-11-30T17:06:20.961 INFO:teuthology.orchestra.run.smithi115.stdout: mds op complaint time = 180 2023-11-30T17:06:20.961 INFO:teuthology.orchestra.run.smithi115.stdout: mds verify scatter = True 2023-11-30T17:06:20.961 INFO:teuthology.orchestra.run.smithi115.stdout: osd op complaint time = 180 2023-11-30T17:06:20.961 INFO:teuthology.orchestra.run.smithi115.stdout: rados mon op timeout = 900 2023-11-30T17:06:20.961 INFO:teuthology.orchestra.run.smithi115.stdout: rados osd op timeout = 900 2023-11-30T17:06:20.963 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-30T17:06:20.963 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-30T17:06:21.054 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-30T17:06:21.054 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-30T17:06:21.054 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-30T17:06:21.069 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-30T17:06:21.069 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-30T17:06:21.124 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi049.front.sepia.ceph.com 2023-11-30T17:06:21.125 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-30T17:06:21.125 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-30T17:06:21.125 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-30T17:06:21.199 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-30T17:06:21.200 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-30T17:06:21.255 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi115.front.sepia.ceph.com 2023-11-30T17:06:21.255 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-11-30T17:06:21.255 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-30T17:06:21.255 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-30T17:06:21.293 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-11-30T17:06:21.293 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-30T17:06:21.348 INFO:tasks.ceph:Setting up mon nodes... 2023-11-30T17:06:21.349 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-30T17:06:21.349 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-30T17:06:21.397 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-30T17:06:21.399 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-30T17:06:21.474 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-30T17:06:21.476 INFO:tasks.ceph:Setting up mds nodes... 2023-11-30T17:06:21.476 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-30T17:06:21.525 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-30T17:06:21.527 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-30T17:06:21.552 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-30T17:06:21.641 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-30T17:06:21.644 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-30T17:06:21.668 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-30T17:06:21.717 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-30T17:06:21.719 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-30T17:06:21.744 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-30T17:06:21.831 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-30T17:06:21.833 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-30T17:06:21.857 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-30T17:06:21.857 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-30T17:06:21.896 INFO:teuthology.orchestra.run.smithi049.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-30T17:06:21.908 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-30T17:06:21.986 INFO:teuthology.orchestra.run.smithi049.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-30T17:06:21.999 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-30T17:06:22.036 INFO:teuthology.orchestra.run.smithi115.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-30T17:06:22.048 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-30T17:06:22.125 INFO:teuthology.orchestra.run.smithi115.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-30T17:06:22.138 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-30T17:06:22.138 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi049.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi115.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-30T17:06:22.138 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-30T17:06:22.163 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-30T17:06:22.163 INFO:tasks.ceph:role: osd.0 2023-11-30T17:06:22.164 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi049.front.sepia.ceph.com 2023-11-30T17:06:22.164 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-30T17:06:22.229 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-30T17:06:22.229 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-30T17:06:22.229 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-30T17:06:22.229 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 2023-11-30T17:06:22.229 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-30T17:06:22.229 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2023-11-30T17:06:22.229 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-30T17:06:22.229 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-30T17:06:22.230 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-30T17:06:22.230 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-30T17:06:22.251 INFO:teuthology.orchestra.run.smithi049.stdout:Discarding blocks...Done. 2023-11-30T17:06:22.253 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2023-11-30T17:06:22.253 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-30T17:06:22.333 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-30T17:06:22.403 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-30T17:06:22.469 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-30T17:06:22.469 INFO:tasks.ceph:role: osd.1 2023-11-30T17:06:22.469 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi049.front.sepia.ceph.com 2023-11-30T17:06:22.469 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-30T17:06:22.533 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-30T17:06:22.534 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-30T17:06:22.534 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-30T17:06:22.534 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 2023-11-30T17:06:22.534 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-30T17:06:22.534 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2023-11-30T17:06:22.534 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-30T17:06:22.534 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-30T17:06:22.534 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-30T17:06:22.534 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-30T17:06:22.556 INFO:teuthology.orchestra.run.smithi049.stdout:Discarding blocks...Done. 2023-11-30T17:06:22.558 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2023-11-30T17:06:22.558 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-30T17:06:22.636 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-30T17:06:22.705 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-30T17:06:22.771 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-30T17:06:22.772 INFO:tasks.ceph:role: osd.2 2023-11-30T17:06:22.772 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi049.front.sepia.ceph.com 2023-11-30T17:06:22.772 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-30T17:06:22.836 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-30T17:06:22.837 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-30T17:06:22.837 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-30T17:06:22.837 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 2023-11-30T17:06:22.837 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-30T17:06:22.837 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2023-11-30T17:06:22.837 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-30T17:06:22.837 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-30T17:06:22.837 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-30T17:06:22.837 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-30T17:06:22.859 INFO:teuthology.orchestra.run.smithi049.stdout:Discarding blocks...Done. 2023-11-30T17:06:22.860 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2023-11-30T17:06:22.860 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-30T17:06:22.938 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-30T17:06:23.007 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-30T17:06:23.072 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-30T17:06:23.072 INFO:tasks.ceph:role: osd.3 2023-11-30T17:06:23.073 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi049.front.sepia.ceph.com 2023-11-30T17:06:23.073 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-30T17:06:23.137 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-30T17:06:23.137 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-30T17:06:23.137 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-30T17:06:23.137 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 2023-11-30T17:06:23.137 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-30T17:06:23.137 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2023-11-30T17:06:23.137 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-30T17:06:23.137 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-30T17:06:23.137 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-30T17:06:23.137 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-30T17:06:23.159 INFO:teuthology.orchestra.run.smithi049.stdout:Discarding blocks...Done. 2023-11-30T17:06:23.162 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2023-11-30T17:06:23.162 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-30T17:06:23.240 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-30T17:06:23.309 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-30T17:06:23.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:23.400+0000 7f0581da3380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-30T17:06:23.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:23.400+0000 7f0581da3380 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-30T17:06:23.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:23.400+0000 7f0581da3380 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-30T17:06:23.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:23.400+0000 7f0581da3380 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-30T17:06:23.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:23.400+0000 7f0581da3380 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-30T17:06:23.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:23.400+0000 7f0581da3380 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-30T17:06:26.273 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-30T17:06:26.302 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-30T17:06:26.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:26.385+0000 7fea4bdc3380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-30T17:06:26.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:26.385+0000 7fea4bdc3380 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-30T17:06:26.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:26.385+0000 7fea4bdc3380 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-30T17:06:26.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:26.385+0000 7fea4bdc3380 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-30T17:06:26.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:26.385+0000 7fea4bdc3380 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-30T17:06:26.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:26.386+0000 7fea4bdc3380 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-30T17:06:29.228 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-30T17:06:29.256 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-30T17:06:29.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:29.338+0000 7fd4c0b4b380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-30T17:06:29.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:29.338+0000 7fd4c0b4b380 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-30T17:06:29.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:29.338+0000 7fd4c0b4b380 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-30T17:06:29.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:29.338+0000 7fd4c0b4b380 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-30T17:06:29.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:29.338+0000 7fd4c0b4b380 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-30T17:06:29.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:29.338+0000 7fd4c0b4b380 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-30T17:06:32.199 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-30T17:06:32.269 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-30T17:06:32.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:32.356+0000 7f07002c4380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-30T17:06:32.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:32.356+0000 7f07002c4380 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-30T17:06:32.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:32.356+0000 7f07002c4380 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-30T17:06:32.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:32.356+0000 7f07002c4380 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-30T17:06:32.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:32.356+0000 7f07002c4380 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-30T17:06:32.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:32.356+0000 7f07002c4380 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-30T17:06:35.205 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-30T17:06:35.235 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-30T17:06:35.264 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-30T17:06:35.264 INFO:tasks.ceph:role: osd.4 2023-11-30T17:06:35.264 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi115.front.sepia.ceph.com 2023-11-30T17:06:35.264 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-30T17:06:35.337 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-30T17:06:35.337 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-30T17:06:35.337 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-30T17:06:35.338 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 2023-11-30T17:06:35.338 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-30T17:06:35.338 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2023-11-30T17:06:35.338 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-30T17:06:35.338 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-30T17:06:35.338 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-30T17:06:35.338 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-30T17:06:35.777 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2023-11-30T17:06:35.779 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2023-11-30T17:06:35.779 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-30T17:06:35.939 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-30T17:06:35.970 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-30T17:06:36.036 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-30T17:06:36.036 INFO:tasks.ceph:role: osd.5 2023-11-30T17:06:36.036 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi115.front.sepia.ceph.com 2023-11-30T17:06:36.036 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-30T17:06:36.108 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-30T17:06:36.108 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-30T17:06:36.108 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-30T17:06:36.109 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 2023-11-30T17:06:36.109 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-30T17:06:36.109 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2023-11-30T17:06:36.109 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-30T17:06:36.109 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-30T17:06:36.109 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-30T17:06:36.109 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-30T17:06:36.537 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2023-11-30T17:06:36.538 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2023-11-30T17:06:36.539 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-30T17:06:36.657 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-30T17:06:36.686 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-30T17:06:36.751 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-30T17:06:36.751 INFO:tasks.ceph:role: osd.6 2023-11-30T17:06:36.751 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi115.front.sepia.ceph.com 2023-11-30T17:06:36.751 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-30T17:06:36.823 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-30T17:06:36.823 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-30T17:06:36.823 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-30T17:06:36.823 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 2023-11-30T17:06:36.823 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-30T17:06:36.823 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2023-11-30T17:06:36.823 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-30T17:06:36.823 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-30T17:06:36.823 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-30T17:06:36.824 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-30T17:06:37.267 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2023-11-30T17:06:37.268 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2023-11-30T17:06:37.269 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-30T17:06:37.422 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-30T17:06:37.452 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-30T17:06:37.516 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-30T17:06:37.517 INFO:tasks.ceph:role: osd.7 2023-11-30T17:06:37.517 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi115.front.sepia.ceph.com 2023-11-30T17:06:37.517 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-30T17:06:37.589 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-30T17:06:37.589 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-30T17:06:37.589 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-30T17:06:37.589 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 2023-11-30T17:06:37.589 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-30T17:06:37.589 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2023-11-30T17:06:37.589 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-30T17:06:37.589 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-30T17:06:37.589 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-30T17:06:37.589 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-30T17:06:38.029 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2023-11-30T17:06:38.031 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2023-11-30T17:06:38.031 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-30T17:06:38.209 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-30T17:06:38.239 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-30T17:06:38.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:38.336+0000 7f9e70357380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-30T17:06:38.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:38.336+0000 7f9e70357380 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-30T17:06:38.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:38.336+0000 7f9e70357380 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-30T17:06:38.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:38.336+0000 7f9e70357380 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-30T17:06:38.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:38.336+0000 7f9e70357380 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-30T17:06:38.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:38.337+0000 7f9e70357380 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-30T17:06:41.182 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-30T17:06:41.209 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-30T17:06:41.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:41.290+0000 7f9ca3901380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-30T17:06:41.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:41.290+0000 7f9ca3901380 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-30T17:06:41.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:41.290+0000 7f9ca3901380 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-30T17:06:41.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:41.290+0000 7f9ca3901380 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-30T17:06:41.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:41.290+0000 7f9ca3901380 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-30T17:06:41.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:41.291+0000 7f9ca3901380 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-30T17:06:44.138 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-30T17:06:44.204 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-30T17:06:44.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:44.282+0000 7fb6eae80380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-30T17:06:44.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:44.282+0000 7fb6eae80380 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-30T17:06:44.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:44.282+0000 7fb6eae80380 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-30T17:06:44.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:44.282+0000 7fb6eae80380 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-30T17:06:44.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:44.282+0000 7fb6eae80380 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-30T17:06:44.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:44.283+0000 7fb6eae80380 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-30T17:06:47.131 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-30T17:06:47.198 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-30T17:06:47.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:47.277+0000 7fbeaeb72380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-30T17:06:47.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:47.278+0000 7fbeaeb72380 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-30T17:06:47.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:47.278+0000 7fbeaeb72380 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-30T17:06:47.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:47.278+0000 7fbeaeb72380 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-30T17:06:47.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:47.278+0000 7fbeaeb72380 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-30T17:06:47.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:47.278+0000 7fbeaeb72380 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-30T17:06:48.899 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:06:48.902 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:06:50.119 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-30T17:06:50.145 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-30T17:06:50.145 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-30T17:06:50.145 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-30T17:06:50.174 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-30T17:06:50.174 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-30T17:06:50.243 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-30T17:06:50.244 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-30T17:06:50.312 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-30T17:06:50.312 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-30T17:06:50.380 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-30T17:06:50.380 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-30T17:06:50.447 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-30T17:06:50.447 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-30T17:06:50.513 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-30T17:06:50.514 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-30T17:06:50.579 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-11-30T17:06:50.579 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-30T17:06:50.606 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-11-30T17:06:50.606 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-30T17:06:50.672 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-11-30T17:06:50.672 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-30T17:06:50.737 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-11-30T17:06:50.737 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-30T17:06:50.802 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-11-30T17:06:50.802 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-30T17:06:50.866 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-11-30T17:06:50.866 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-30T17:06:50.930 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-11-30T17:06:50.930 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-30T17:06:50.995 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-30T17:06:50.995 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-30T17:06:51.010 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-30T17:06:51.010 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-30T17:06:51.065 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-11-30T17:06:51.065 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-30T17:06:51.080 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-11-30T17:06:51.080 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-30T17:06:51.135 INFO:tasks.ceph:Adding keys to all mons... 2023-11-30T17:06:51.135 DEBUG:teuthology.orchestra.run.smithi049:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-30T17:06:51.137 DEBUG:teuthology.orchestra.run.smithi115:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-30T17:06:51.179 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr.y] 2023-11-30T17:06:51.179 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQANwWhlpy+fFxAA3qmboR+PlQtK6T35ryj+Lw== 2023-11-30T17:06:51.179 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.a] 2023-11-30T17:06:51.179 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQANwWhlwm1FHxAAk+s9c60UZ5jB37wbpGzlcg== 2023-11-30T17:06:51.179 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.c] 2023-11-30T17:06:51.179 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQANwWhlYnY1JhAA+Lurauug0NhWnK8aZErR3g== 2023-11-30T17:06:51.179 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.0] 2023-11-30T17:06:51.179 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAPwWhlGdbhFxAAOspNRLMhR59LSWatFbsYDA== 2023-11-30T17:06:51.180 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.1] 2023-11-30T17:06:51.180 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQASwWhlfwUEFxAAuj0L8ooIGi1vsb7XWLVlDA== 2023-11-30T17:06:51.180 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.2] 2023-11-30T17:06:51.180 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAVwWhl7XYwFBAAuSHZqdfRR8V1Y+hmPT5uuw== 2023-11-30T17:06:51.180 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.3] 2023-11-30T17:06:51.180 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAYwWhlkhRCFRAAe3cRLcrhJ3ZoluXuRUhmew== 2023-11-30T17:06:51.180 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr.x] 2023-11-30T17:06:51.180 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQANwWhlH1s2HBAA3ea9Utfv7fZoo2hO+ElDVQ== 2023-11-30T17:06:51.180 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.b] 2023-11-30T17:06:51.180 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQANwWhlADm0KhAArffesGGTXzQwY4NPnJ1Bjw== 2023-11-30T17:06:51.180 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.d] 2023-11-30T17:06:51.180 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQANwWhlQdKCMRAA3h4O2NqkQ2zE3DxOqBoaQQ== 2023-11-30T17:06:51.181 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.4] 2023-11-30T17:06:51.181 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAewWhlrq4qFBAAOSdqozO8iH25BQFrPI1SRQ== 2023-11-30T17:06:51.181 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.5] 2023-11-30T17:06:51.181 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAhwWhlZL9WERAA90znWBLNuY5eem3yF6O0wg== 2023-11-30T17:06:51.181 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.6] 2023-11-30T17:06:51.181 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAkwWhlCJDiEBAAETLCBNCdaWXFgkPPaulTAA== 2023-11-30T17:06:51.181 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.7] 2023-11-30T17:06:51.181 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAnwWhl+IiYEBAAcI3AU5xrv0cYy9lckyu0dQ== 2023-11-30T17:06:51.181 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2023-11-30T17:06:51.181 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQANwWhleYZcNRAA5PoPChH+s6XfbrQ0hmu2NA== 2023-11-30T17:06:51.181 INFO:teuthology.orchestra.run.smithi049.stdout:[client.2] 2023-11-30T17:06:51.182 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQANwWhlLZrDOhAAHG/dYWYmPouk3+Iqafr7qw== 2023-11-30T17:06:51.182 INFO:teuthology.orchestra.run.smithi049.stdout:[client.1] 2023-11-30T17:06:51.182 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAOwWhlFhcfAhAAzaBDtyRxuqeQ9BatfgUuXw== 2023-11-30T17:06:51.182 INFO:teuthology.orchestra.run.smithi049.stdout:[client.3] 2023-11-30T17:06:51.182 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAOwWhl6lxuBxAA/YXQDo+U2ppULGzK054Gzg== 2023-11-30T17:06:51.198 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr.y] 2023-11-30T17:06:51.198 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQANwWhlpy+fFxAA3qmboR+PlQtK6T35ryj+Lw== 2023-11-30T17:06:51.198 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.a] 2023-11-30T17:06:51.198 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQANwWhlwm1FHxAAk+s9c60UZ5jB37wbpGzlcg== 2023-11-30T17:06:51.198 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.c] 2023-11-30T17:06:51.198 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQANwWhlYnY1JhAA+Lurauug0NhWnK8aZErR3g== 2023-11-30T17:06:51.198 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.0] 2023-11-30T17:06:51.198 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAPwWhlGdbhFxAAOspNRLMhR59LSWatFbsYDA== 2023-11-30T17:06:51.198 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.1] 2023-11-30T17:06:51.199 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQASwWhlfwUEFxAAuj0L8ooIGi1vsb7XWLVlDA== 2023-11-30T17:06:51.199 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.2] 2023-11-30T17:06:51.199 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAVwWhl7XYwFBAAuSHZqdfRR8V1Y+hmPT5uuw== 2023-11-30T17:06:51.199 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.3] 2023-11-30T17:06:51.199 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAYwWhlkhRCFRAAe3cRLcrhJ3ZoluXuRUhmew== 2023-11-30T17:06:51.199 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr.x] 2023-11-30T17:06:51.199 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQANwWhlH1s2HBAA3ea9Utfv7fZoo2hO+ElDVQ== 2023-11-30T17:06:51.199 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.b] 2023-11-30T17:06:51.199 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQANwWhlADm0KhAArffesGGTXzQwY4NPnJ1Bjw== 2023-11-30T17:06:51.199 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.d] 2023-11-30T17:06:51.199 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQANwWhlQdKCMRAA3h4O2NqkQ2zE3DxOqBoaQQ== 2023-11-30T17:06:51.199 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.4] 2023-11-30T17:06:51.199 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAewWhlrq4qFBAAOSdqozO8iH25BQFrPI1SRQ== 2023-11-30T17:06:51.199 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.5] 2023-11-30T17:06:51.199 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAhwWhlZL9WERAA90znWBLNuY5eem3yF6O0wg== 2023-11-30T17:06:51.200 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.6] 2023-11-30T17:06:51.200 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAkwWhlCJDiEBAAETLCBNCdaWXFgkPPaulTAA== 2023-11-30T17:06:51.200 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.7] 2023-11-30T17:06:51.200 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAnwWhl+IiYEBAAcI3AU5xrv0cYy9lckyu0dQ== 2023-11-30T17:06:51.200 INFO:teuthology.orchestra.run.smithi115.stdout:[client.0] 2023-11-30T17:06:51.200 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQANwWhleYZcNRAA5PoPChH+s6XfbrQ0hmu2NA== 2023-11-30T17:06:51.200 INFO:teuthology.orchestra.run.smithi115.stdout:[client.2] 2023-11-30T17:06:51.200 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQANwWhlLZrDOhAAHG/dYWYmPouk3+Iqafr7qw== 2023-11-30T17:06:51.200 INFO:teuthology.orchestra.run.smithi115.stdout:[client.1] 2023-11-30T17:06:51.200 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAOwWhlFhcfAhAAzaBDtyRxuqeQ9BatfgUuXw== 2023-11-30T17:06:51.200 INFO:teuthology.orchestra.run.smithi115.stdout:[client.3] 2023-11-30T17:06:51.200 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAOwWhl6lxuBxAA/YXQDo+U2ppULGzK054Gzg== 2023-11-30T17:06:51.201 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-30T17:06:51.225 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-30T17:06:51.288 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-30T17:06:51.291 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-30T17:06:51.339 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-30T17:06:51.341 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-30T17:06:51.390 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T17:06:51.392 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T17:06:51.438 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T17:06:51.440 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T17:06:51.487 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T17:06:51.489 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T17:06:51.535 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T17:06:51.537 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T17:06:51.583 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-30T17:06:51.585 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-30T17:06:51.632 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-30T17:06:51.634 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-30T17:06:51.684 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-30T17:06:51.686 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-30T17:06:51.735 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T17:06:51.737 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T17:06:51.783 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T17:06:51.785 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T17:06:51.831 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T17:06:51.833 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T17:06:51.880 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T17:06:51.882 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T17:06:51.928 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-30T17:06:51.930 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-30T17:06:51.979 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-30T17:06:51.981 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-30T17:06:52.030 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-30T17:06:52.032 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-30T17:06:52.081 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-30T17:06:52.083 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-30T17:06:52.132 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-30T17:06:52.132 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-30T17:06:52.157 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-30T17:06:52.248 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-30T17:06:52.273 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-30T17:06:52.297 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-30T17:06:52.387 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-30T17:06:52.411 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-30T17:06:52.475 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-30T17:06:52.565 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-30T17:06:52.589 DEBUG:teuthology.orchestra.run.smithi049:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-30T17:06:52.592 DEBUG:teuthology.orchestra.run.smithi115:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-30T17:06:52.643 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-30T17:06:52.644 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-30T17:06:52.644 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-30T17:06:52.646 INFO:tasks.ceph.mon.a:Started 2023-11-30T17:06:52.646 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-30T17:06:52.646 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-30T17:06:52.685 INFO:tasks.ceph.mon.b:Started 2023-11-30T17:06:52.685 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-30T17:06:52.686 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-30T17:06:52.687 INFO:tasks.ceph.mon.c:Started 2023-11-30T17:06:52.687 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-30T17:06:52.688 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-30T17:06:52.688 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-30T17:06:52.690 INFO:tasks.ceph.mgr.y:Started 2023-11-30T17:06:52.690 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-30T17:06:52.690 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-30T17:06:52.694 INFO:tasks.ceph.mgr.x:Started 2023-11-30T17:06:52.695 INFO:tasks.ceph:Setting crush tunables to default 2023-11-30T17:06:52.695 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph osd crush tunables default 2023-11-30T17:06:52.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:52.810+0000 7ff42175e700 1 Processor -- start 2023-11-30T17:06:52.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:52.810+0000 7ff42175e700 1 -- start start 2023-11-30T17:06:52.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:52.811+0000 7ff42175e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff41c062e10 0x7ff41c0a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:06:52.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:52.811+0000 7ff42175e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff41c0c7e30 con 0x7ff41c1547f0 2023-11-30T17:06:52.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:52.811+0000 7ff42175e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff41c0bcf40 con 0x7ff41c0c86f0 2023-11-30T17:06:52.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:52.811+0000 7ff42175e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c0c6b20 con 0x7ff41c062e10 2023-11-30T17:06:52.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:52.811+0000 7ff41affd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff41c1547f0 0x7ff41c0c6fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:54498/0 (socket says 172.21.15.49:54498) 2023-11-30T17:06:52.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:52.811+0000 7ff41affd700 1 -- 172.21.15.49:0/3918264284 learned_addr learned my addr 172.21.15.49:0/3918264284 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:06:52.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:52.811+0000 7ff41b7fe700 1 --2- 172.21.15.49:0/3918264284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff41c062e10 0x7ff41c0a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:52.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:52.811+0000 7ff41b7fe700 1 -- 172.21.15.49:0/3918264284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff41c062e10 msgr2=0x7ff41c0a72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-30T17:06:52.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:52.811+0000 7ff41b7fe700 1 -- 172.21.15.49:0/3918264284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff41c062e10 msgr2=0x7ff41c0a72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-30T17:06:52.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:52.811+0000 7ff41b7fe700 1 --2- 172.21.15.49:0/3918264284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff41c062e10 0x7ff41c0a72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-11-30T17:06:52.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:52.811+0000 7ff41b7fe700 1 --2- 172.21.15.49:0/3918264284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff41c062e10 0x7ff41c0a72e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:06:53.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:53.012+0000 7ff41b7fe700 1 --2- 172.21.15.49:0/3918264284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff41c062e10 0x7ff41c0a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:53.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:53.012+0000 7ff41b7fe700 1 -- 172.21.15.49:0/3918264284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff41c062e10 msgr2=0x7ff41c0a72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-30T17:06:53.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:53.012+0000 7ff41b7fe700 1 -- 172.21.15.49:0/3918264284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff41c062e10 msgr2=0x7ff41c0a72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-30T17:06:53.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:53.012+0000 7ff41b7fe700 1 --2- 172.21.15.49:0/3918264284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff41c062e10 0x7ff41c0a72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-11-30T17:06:53.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:53.012+0000 7ff41b7fe700 1 --2- 172.21.15.49:0/3918264284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff41c062e10 0x7ff41c0a72e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:06:53.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:53.413+0000 7ff41b7fe700 1 --2- 172.21.15.49:0/3918264284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff41c062e10 0x7ff41c0a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:53.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:53.413+0000 7ff41b7fe700 1 -- 172.21.15.49:0/3918264284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff41c062e10 msgr2=0x7ff41c0a72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-30T17:06:53.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:53.413+0000 7ff41b7fe700 1 -- 172.21.15.49:0/3918264284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff41c062e10 msgr2=0x7ff41c0a72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-30T17:06:53.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:53.413+0000 7ff41b7fe700 1 --2- 172.21.15.49:0/3918264284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff41c062e10 0x7ff41c0a72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-11-30T17:06:53.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:53.413+0000 7ff41b7fe700 1 --2- 172.21.15.49:0/3918264284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff41c062e10 0x7ff41c0a72e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2023-11-30T17:06:54.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:54.215+0000 7ff41b7fe700 1 --2- 172.21.15.49:0/3918264284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff41c062e10 0x7ff41c0a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:54.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:54.215+0000 7ff41b7fe700 1 -- 172.21.15.49:0/3918264284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff41c062e10 msgr2=0x7ff41c0a72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-30T17:06:54.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:54.215+0000 7ff41b7fe700 1 -- 172.21.15.49:0/3918264284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff41c062e10 msgr2=0x7ff41c0a72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-30T17:06:54.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:54.215+0000 7ff41b7fe700 1 --2- 172.21.15.49:0/3918264284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff41c062e10 0x7ff41c0a72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-11-30T17:06:54.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:54.215+0000 7ff41b7fe700 1 --2- 172.21.15.49:0/3918264284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff41c062e10 0x7ff41c0a72e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2023-11-30T17:06:55.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:55.812+0000 7ff418ff9700 1 -- 172.21.15.49:0/3918264284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff41c062e10 msgr2=0x7ff41c0a72e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-30T17:06:55.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:55.812+0000 7ff418ff9700 1 --2- 172.21.15.49:0/3918264284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff41c062e10 0x7ff41c0a72e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:55.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:55.812+0000 7ff418ff9700 1 -- 172.21.15.49:0/3918264284 >> v1:172.21.15.115:6789/0 conn(0x7ff41c0c86f0 legacy=0x7ff41c062700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:06:55.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:55.812+0000 7ff418ff9700 1 -- 172.21.15.49:0/3918264284 >> v1:172.21.15.49:6789/0 conn(0x7ff41c1547f0 legacy=0x7ff41c0c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:06:55.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:55.812+0000 7ff418ff9700 1 --2- 172.21.15.49:0/3918264284 >> v2:172.21.15.115:3300/0 conn(0x7ff4080035e0 0x7ff408005a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:06:55.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:55.812+0000 7ff418ff9700 1 --2- 172.21.15.49:0/3918264284 >> v2:172.21.15.49:3300/0 conn(0x7ff4080060e0 0x7ff408008580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:06:55.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:55.812+0000 7ff418ff9700 1 -- 172.21.15.49:0/3918264284 --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff41c0c6b20 con 0x7ff4080060e0 2023-11-30T17:06:55.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:55.812+0000 7ff418ff9700 1 -- 172.21.15.49:0/3918264284 --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff408008bf0 con 0x7ff4080035e0 2023-11-30T17:06:55.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:55.812+0000 7ff41a7fc700 1 --2- 172.21.15.49:0/3918264284 >> v2:172.21.15.49:3300/0 conn(0x7ff4080060e0 0x7ff408008580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:55.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:55.812+0000 7ff41affd700 1 --2- 172.21.15.49:0/3918264284 >> v2:172.21.15.115:3300/0 conn(0x7ff4080035e0 0x7ff408005a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:55.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:55.812+0000 7ff41a7fc700 1 -- 172.21.15.49:0/3918264284 >> v2:172.21.15.49:3300/0 conn(0x7ff4080060e0 msgr2=0x7ff408008580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-30T17:06:55.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:55.812+0000 7ff41a7fc700 1 -- 172.21.15.49:0/3918264284 >> v2:172.21.15.49:3300/0 conn(0x7ff4080060e0 msgr2=0x7ff408008580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-30T17:06:55.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:55.812+0000 7ff41a7fc700 1 --2- 172.21.15.49:0/3918264284 >> v2:172.21.15.49:3300/0 conn(0x7ff4080060e0 0x7ff408008580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-11-30T17:06:55.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:55.812+0000 7ff41a7fc700 1 --2- 172.21.15.49:0/3918264284 >> v2:172.21.15.49:3300/0 conn(0x7ff4080060e0 0x7ff408008580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:06:55.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:55.812+0000 7ff41affd700 1 -- 172.21.15.49:0/3918264284 >> v2:172.21.15.115:3300/0 conn(0x7ff4080035e0 msgr2=0x7ff408005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-30T17:06:55.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:55.812+0000 7ff41affd700 1 -- 172.21.15.49:0/3918264284 >> v2:172.21.15.115:3300/0 conn(0x7ff4080035e0 msgr2=0x7ff408005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-30T17:06:55.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:55.812+0000 7ff41affd700 1 --2- 172.21.15.49:0/3918264284 >> v2:172.21.15.115:3300/0 conn(0x7ff4080035e0 0x7ff408005a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-11-30T17:06:55.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:55.812+0000 7ff41affd700 1 --2- 172.21.15.49:0/3918264284 >> v2:172.21.15.115:3300/0 conn(0x7ff4080035e0 0x7ff408005a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:06:56.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:56.013+0000 7ff41a7fc700 1 --2- 172.21.15.49:0/3918264284 >> v2:172.21.15.49:3300/0 conn(0x7ff4080060e0 0x7ff408008580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:56.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:56.013+0000 7ff41affd700 1 --2- 172.21.15.49:0/3918264284 >> v2:172.21.15.115:3300/0 conn(0x7ff4080035e0 0x7ff408005a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:56.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:56.013+0000 7ff41a7fc700 1 -- 172.21.15.49:0/3918264284 >> v2:172.21.15.49:3300/0 conn(0x7ff4080060e0 msgr2=0x7ff408008580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-30T17:06:56.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:56.013+0000 7ff41a7fc700 1 -- 172.21.15.49:0/3918264284 >> v2:172.21.15.49:3300/0 conn(0x7ff4080060e0 msgr2=0x7ff408008580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-30T17:06:56.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:56.013+0000 7ff41a7fc700 1 --2- 172.21.15.49:0/3918264284 >> v2:172.21.15.49:3300/0 conn(0x7ff4080060e0 0x7ff408008580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-11-30T17:06:56.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:56.013+0000 7ff41a7fc700 1 --2- 172.21.15.49:0/3918264284 >> v2:172.21.15.49:3300/0 conn(0x7ff4080060e0 0x7ff408008580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:06:56.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:56.013+0000 7ff41affd700 1 -- 172.21.15.49:0/3918264284 >> v2:172.21.15.115:3300/0 conn(0x7ff4080035e0 msgr2=0x7ff408005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-30T17:06:56.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:56.013+0000 7ff41affd700 1 -- 172.21.15.49:0/3918264284 >> v2:172.21.15.115:3300/0 conn(0x7ff4080035e0 msgr2=0x7ff408005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-30T17:06:56.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:56.013+0000 7ff41affd700 1 --2- 172.21.15.49:0/3918264284 >> v2:172.21.15.115:3300/0 conn(0x7ff4080035e0 0x7ff408005a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-11-30T17:06:56.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:56.013+0000 7ff41affd700 1 --2- 172.21.15.49:0/3918264284 >> v2:172.21.15.115:3300/0 conn(0x7ff4080035e0 0x7ff408005a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:06:56.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:56.414+0000 7ff41a7fc700 1 --2- 172.21.15.49:0/3918264284 >> v2:172.21.15.49:3300/0 conn(0x7ff4080060e0 0x7ff408008580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:56.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:56.414+0000 7ff41affd700 1 --2- 172.21.15.49:0/3918264284 >> v2:172.21.15.115:3300/0 conn(0x7ff4080035e0 0x7ff408005a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:56.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:56.414+0000 7ff41a7fc700 1 -- 172.21.15.49:0/3918264284 >> v2:172.21.15.49:3300/0 conn(0x7ff4080060e0 msgr2=0x7ff408008580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-30T17:06:56.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:56.414+0000 7ff41a7fc700 1 -- 172.21.15.49:0/3918264284 >> v2:172.21.15.49:3300/0 conn(0x7ff4080060e0 msgr2=0x7ff408008580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-30T17:06:56.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:56.414+0000 7ff41a7fc700 1 --2- 172.21.15.49:0/3918264284 >> v2:172.21.15.49:3300/0 conn(0x7ff4080060e0 0x7ff408008580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-11-30T17:06:56.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:56.414+0000 7ff41affd700 1 -- 172.21.15.49:0/3918264284 >> v2:172.21.15.115:3300/0 conn(0x7ff4080035e0 msgr2=0x7ff408005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-30T17:06:56.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:56.414+0000 7ff41affd700 1 -- 172.21.15.49:0/3918264284 >> v2:172.21.15.115:3300/0 conn(0x7ff4080035e0 msgr2=0x7ff408005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-30T17:06:56.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:56.414+0000 7ff41affd700 1 --2- 172.21.15.49:0/3918264284 >> v2:172.21.15.115:3300/0 conn(0x7ff4080035e0 0x7ff408005a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-11-30T17:06:56.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:56.414+0000 7ff41a7fc700 1 --2- 172.21.15.49:0/3918264284 >> v2:172.21.15.49:3300/0 conn(0x7ff4080060e0 0x7ff408008580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2023-11-30T17:06:56.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:56.414+0000 7ff41affd700 1 --2- 172.21.15.49:0/3918264284 >> v2:172.21.15.115:3300/0 conn(0x7ff4080035e0 0x7ff408005a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2023-11-30T17:06:57.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:57.215+0000 7ff41a7fc700 1 --2- 172.21.15.49:0/3918264284 >> v2:172.21.15.49:3300/0 conn(0x7ff4080060e0 0x7ff408008580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:57.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:57.215+0000 7ff41affd700 1 --2- 172.21.15.49:0/3918264284 >> v2:172.21.15.115:3300/0 conn(0x7ff4080035e0 0x7ff408005a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:57.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:57.215+0000 7ff41a7fc700 1 -- 172.21.15.49:0/3918264284 >> v2:172.21.15.49:3300/0 conn(0x7ff4080060e0 msgr2=0x7ff408008580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-30T17:06:57.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:57.215+0000 7ff41a7fc700 1 -- 172.21.15.49:0/3918264284 >> v2:172.21.15.49:3300/0 conn(0x7ff4080060e0 msgr2=0x7ff408008580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-30T17:06:57.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:57.215+0000 7ff41a7fc700 1 --2- 172.21.15.49:0/3918264284 >> v2:172.21.15.49:3300/0 conn(0x7ff4080060e0 0x7ff408008580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-11-30T17:06:57.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:57.215+0000 7ff41a7fc700 1 --2- 172.21.15.49:0/3918264284 >> v2:172.21.15.49:3300/0 conn(0x7ff4080060e0 0x7ff408008580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2023-11-30T17:06:57.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:57.215+0000 7ff41affd700 1 -- 172.21.15.49:0/3918264284 >> v2:172.21.15.115:3300/0 conn(0x7ff4080035e0 msgr2=0x7ff408005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-30T17:06:57.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:57.215+0000 7ff41affd700 1 -- 172.21.15.49:0/3918264284 >> v2:172.21.15.115:3300/0 conn(0x7ff4080035e0 msgr2=0x7ff408005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-30T17:06:57.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:57.215+0000 7ff41affd700 1 --2- 172.21.15.49:0/3918264284 >> v2:172.21.15.115:3300/0 conn(0x7ff4080035e0 0x7ff408005a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-11-30T17:06:57.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:57.215+0000 7ff41affd700 1 --2- 172.21.15.49:0/3918264284 >> v2:172.21.15.115:3300/0 conn(0x7ff4080035e0 0x7ff408005a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2023-11-30T17:06:58.169 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:06:58.168+0000 7fa7c1c7a680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T17:06:58.173 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:06:58.171+0000 7f9aad6cf680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T17:06:58.241 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:06:58.240+0000 7f9aad6cf680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T17:06:58.242 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:06:58.240+0000 7fa7c1c7a680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T17:06:58.712 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:06:58.711+0000 7f9aad6cf680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T17:06:58.726 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:06:58.725+0000 7fa7c1c7a680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T17:06:58.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.812+0000 7ff418ff9700 1 -- 172.21.15.49:0/3918264284 >> v2:172.21.15.115:3300/0 conn(0x7ff4080035e0 msgr2=0x7ff408005a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-30T17:06:58.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.812+0000 7ff418ff9700 1 --2- 172.21.15.49:0/3918264284 >> v2:172.21.15.115:3300/0 conn(0x7ff4080035e0 0x7ff408005a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:58.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.812+0000 7ff418ff9700 1 -- 172.21.15.49:0/3918264284 >> v2:172.21.15.49:3300/0 conn(0x7ff4080060e0 msgr2=0x7ff408008580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-30T17:06:58.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.812+0000 7ff418ff9700 1 --2- 172.21.15.49:0/3918264284 >> v2:172.21.15.49:3300/0 conn(0x7ff4080060e0 0x7ff408008580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:58.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.812+0000 7ff41b7fe700 1 -- 172.21.15.49:0/3918264284 reap_dead start 2023-11-30T17:06:58.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.812+0000 7ff418ff9700 1 --2- 172.21.15.49:0/3918264284 >> v2:172.21.15.49:3300/0 conn(0x7ff408003a10 0x7ff4080064c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:06:58.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.812+0000 7ff418ff9700 1 --2- 172.21.15.49:0/3918264284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4080069b0 0x7ff408006e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:06:58.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.812+0000 7ff418ff9700 1 -- 172.21.15.49:0/3918264284 --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff41c0a77d0 con 0x7ff41c1547f0 2023-11-30T17:06:58.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.812+0000 7ff418ff9700 1 -- 172.21.15.49:0/3918264284 --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff41c0c6b20 con 0x7ff408003a10 2023-11-30T17:06:58.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.812+0000 7ff418ff9700 1 -- 172.21.15.49:0/3918264284 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff408008bf0 con 0x7ff4080069b0 2023-11-30T17:06:58.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.812+0000 7ff41a7fc700 1 --2- 172.21.15.49:0/3918264284 >> v2:172.21.15.49:3300/0 conn(0x7ff408003a10 0x7ff4080064c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:58.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.813+0000 7ff41b7fe700 1 --2- 172.21.15.49:0/3918264284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4080069b0 0x7ff408006e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:58.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.813+0000 7ff41a7fc700 1 -- 172.21.15.49:0/3918264284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4080069b0 msgr2=0x7ff408006e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:06:58.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.813+0000 7ff41a7fc700 1 --2- 172.21.15.49:0/3918264284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4080069b0 0x7ff408006e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:58.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.813+0000 7ff41a7fc700 1 -- 172.21.15.49:0/3918264284 >> v1:172.21.15.49:6789/0 conn(0x7ff41c1547f0 legacy=0x7ff40800afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:06:58.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.813+0000 7ff41a7fc700 1 -- 172.21.15.49:0/3918264284 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4080085c0 con 0x7ff408003a10 2023-11-30T17:06:58.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.813+0000 7ff419ffb700 1 -- 172.21.15.49:0/3918264284 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3420450533 0 0) 0x7ff41c0a77d0 con 0x7ff41c1547f0 2023-11-30T17:06:58.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.813+0000 7ff41b7fe700 1 --2- 172.21.15.49:0/3918264284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4080069b0 0x7ff408006e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:06:58.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.813+0000 7ff41a7fc700 1 --2- 172.21.15.49:0/3918264284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff408003a10 0x7ff4080064c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7ff410007fd0 tx=0x7ff410009040).ready entity=mon.0 client_cookie=2349cbb77694710a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:06:58.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.813+0000 7ff419ffb700 1 -- 172.21.15.49:0/3918264284 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff410016490 con 0x7ff408003a10 2023-11-30T17:06:58.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.813+0000 7ff419ffb700 1 -- 172.21.15.49:0/3918264284 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4100165f0 con 0x7ff408003a10 2023-11-30T17:06:58.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.813+0000 7ff419ffb700 1 -- 172.21.15.49:0/3918264284 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff410016970 con 0x7ff408003a10 2023-11-30T17:06:58.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.814+0000 7ff42175e700 1 -- 172.21.15.49:0/3918264284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff408003a10 msgr2=0x7ff4080064c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:06:58.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.814+0000 7ff42175e700 1 --2- 172.21.15.49:0/3918264284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff408003a10 0x7ff4080064c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7ff410007fd0 tx=0x7ff410009040).stop 2023-11-30T17:06:58.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.814+0000 7ff42175e700 1 -- 172.21.15.49:0/3918264284 shutdown_connections 2023-11-30T17:06:58.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.814+0000 7ff42175e700 1 --2- 172.21.15.49:0/3918264284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4080069b0 0x7ff408006e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:58.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.814+0000 7ff42175e700 1 --2- 172.21.15.49:0/3918264284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff408003a10 0x7ff4080064c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:58.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.814+0000 7ff42175e700 1 -- 172.21.15.49:0/3918264284 >> 172.21.15.49:0/3918264284 conn(0x7ff41c0642d0 msgr2=0x7ff41c0c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:06:58.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.814+0000 7ff42175e700 1 -- 172.21.15.49:0/3918264284 shutdown_connections 2023-11-30T17:06:58.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.814+0000 7ff42175e700 1 -- 172.21.15.49:0/3918264284 wait complete. 2023-11-30T17:06:58.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.815+0000 7ff42175e700 1 Processor -- start 2023-11-30T17:06:58.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.815+0000 7ff42175e700 1 -- start start 2023-11-30T17:06:58.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.816+0000 7ff42175e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff408003a10 0x7ff41c1593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:06:58.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.816+0000 7ff42175e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4080069b0 0x7ff41c168700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:06:58.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.816+0000 7ff42175e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff41c1547f0 0x7ff41c143b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:06:58.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.816+0000 7ff42175e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c15a680 con 0x7ff4080069b0 2023-11-30T17:06:58.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.816+0000 7ff42175e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c151460 con 0x7ff408003a10 2023-11-30T17:06:58.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.816+0000 7ff42175e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c168bf0 con 0x7ff41c1547f0 2023-11-30T17:06:58.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.816+0000 7ff41a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4080069b0 0x7ff41c168700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:58.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.816+0000 7ff41a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4080069b0 0x7ff41c168700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56496/0 (socket says 172.21.15.49:56496) 2023-11-30T17:06:58.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.816+0000 7ff41a7fc700 1 -- 172.21.15.49:0/2675551028 learned_addr learned my addr 172.21.15.49:0/2675551028 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:06:58.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.816+0000 7ff41b7fe700 1 --2- 172.21.15.49:0/2675551028 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff41c1547f0 0x7ff41c143b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:58.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.816+0000 7ff41affd700 1 --2- 172.21.15.49:0/2675551028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff408003a10 0x7ff41c1593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:58.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.816+0000 7ff41a7fc700 1 -- 172.21.15.49:0/2675551028 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff41c1547f0 msgr2=0x7ff41c143b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:06:58.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.816+0000 7ff41a7fc700 1 --2- 172.21.15.49:0/2675551028 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff41c1547f0 0x7ff41c143b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:58.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.816+0000 7ff41a7fc700 1 -- 172.21.15.49:0/2675551028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff408003a10 msgr2=0x7ff41c1593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:06:58.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.816+0000 7ff41a7fc700 1 --2- 172.21.15.49:0/2675551028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff408003a10 0x7ff41c1593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:58.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.816+0000 7ff41a7fc700 1 -- 172.21.15.49:0/2675551028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41000f040 con 0x7ff4080069b0 2023-11-30T17:06:58.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.817+0000 7ff41a7fc700 1 --2- 172.21.15.49:0/2675551028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4080069b0 0x7ff41c168700 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7ff410007ae0 tx=0x7ff410009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:06:58.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.817+0000 7ff402ffd700 1 -- 172.21.15.49:0/2675551028 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff410016490 con 0x7ff4080069b0 2023-11-30T17:06:58.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.817+0000 7ff402ffd700 1 -- 172.21.15.49:0/2675551028 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff410016ce0 con 0x7ff4080069b0 2023-11-30T17:06:58.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.817+0000 7ff42175e700 1 -- 172.21.15.49:0/2675551028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff41c159a00 con 0x7ff4080069b0 2023-11-30T17:06:58.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.817+0000 7ff402ffd700 1 -- 172.21.15.49:0/2675551028 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff410016e50 con 0x7ff4080069b0 2023-11-30T17:06:58.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.817+0000 7ff42175e700 1 -- 172.21.15.49:0/2675551028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff41c159fc0 con 0x7ff4080069b0 2023-11-30T17:06:58.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.817+0000 7ff402ffd700 1 -- 172.21.15.49:0/2675551028 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7ff41001f070 con 0x7ff4080069b0 2023-11-30T17:06:58.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.817+0000 7ff402ffd700 1 -- 172.21.15.49:0/2675551028 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7ff410017ba0 con 0x7ff4080069b0 2023-11-30T17:06:58.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.818+0000 7ff42175e700 1 -- 172.21.15.49:0/2675551028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff41c06c860 con 0x7ff4080069b0 2023-11-30T17:06:58.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.821+0000 7ff402ffd700 1 -- 172.21.15.49:0/2675551028 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7ff410033060 con 0x7ff4080069b0 2023-11-30T17:06:58.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.893+0000 7ff42175e700 1 -- 172.21.15.49:0/2675551028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff41c065290 con 0x7ff4080069b0 2023-11-30T17:06:58.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.896+0000 7ff402ffd700 1 -- 172.21.15.49:0/2675551028 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff410028020 con 0x7ff4080069b0 2023-11-30T17:06:58.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.896+0000 7ff42175e700 1 -- 172.21.15.49:0/2675551028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4080069b0 msgr2=0x7ff41c168700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:06:58.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.896+0000 7ff42175e700 1 --2- 172.21.15.49:0/2675551028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4080069b0 0x7ff41c168700 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7ff410007ae0 tx=0x7ff410009040).stop 2023-11-30T17:06:58.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.896+0000 7ff42175e700 1 -- 172.21.15.49:0/2675551028 shutdown_connections 2023-11-30T17:06:58.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.896+0000 7ff42175e700 1 --2- 172.21.15.49:0/2675551028 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff41c1547f0 0x7ff41c143b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:58.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.896+0000 7ff42175e700 1 --2- 172.21.15.49:0/2675551028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff408003a10 0x7ff41c1593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:58.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.896+0000 7ff42175e700 1 --2- 172.21.15.49:0/2675551028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4080069b0 0x7ff41c168700 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:58.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.896+0000 7ff42175e700 1 -- 172.21.15.49:0/2675551028 >> 172.21.15.49:0/2675551028 conn(0x7ff41c0642d0 msgr2=0x7ff41c153a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:06:58.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.897+0000 7ff42175e700 1 -- 172.21.15.49:0/2675551028 shutdown_connections 2023-11-30T17:06:58.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:06:58.897+0000 7ff42175e700 1 -- 172.21.15.49:0/2675551028 wait complete. 2023-11-30T17:06:58.899 INFO:teuthology.orchestra.run.smithi049.stderr:adjusted tunables profile to default 2023-11-30T17:06:58.910 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-30T17:06:58.910 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-30T17:06:58.910 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-30T17:06:58.935 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-30T17:06:58.935 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-30T17:06:59.001 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-30T17:06:59.001 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-30T17:06:59.066 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-30T17:06:59.066 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-30T17:06:59.132 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-11-30T17:06:59.132 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-30T17:06:59.156 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-11-30T17:06:59.157 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-30T17:06:59.220 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-11-30T17:06:59.221 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-30T17:06:59.285 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-11-30T17:06:59.285 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-30T17:06:59.349 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new de56022c-e31e-4aa5-8f71-06fa5a59378d 0 2023-11-30T17:06:59.473 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:06:59.471+0000 7f9aad6cf680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T17:06:59.523 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:06:59.522+0000 7fa7c1c7a680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T17:06:59.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.534+0000 7f071a9aa700 1 Processor -- start 2023-11-30T17:06:59.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.534+0000 7f071a9aa700 1 -- start start 2023-11-30T17:06:59.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.535+0000 7f071a9aa700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07140c6620 0x7f0714150d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:06:59.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.535+0000 7f071a9aa700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f07140bcfa0 0x7f07140bd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:06:59.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.535+0000 7f071a9aa700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0714062910 con 0x7f0714150930 2023-11-30T17:06:59.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.535+0000 7f071a9aa700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07140c2460 con 0x7f07140bcfa0 2023-11-30T17:06:59.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.535+0000 7f071a9aa700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07140bd900 con 0x7f07140c6620 2023-11-30T17:06:59.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.535+0000 7f07137fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07140c6620 0x7f0714150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:59.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.535+0000 7f0718f47700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f07140bcfa0 0x7f07140bd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:59.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.536+0000 7f07137fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07140c6620 0x7f0714150d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:42376/0 (socket says 172.21.15.115:42376) 2023-11-30T17:06:59.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.536+0000 7f0713fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f0714150930 0x7f07140a6ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51666/0 (socket says 172.21.15.115:51666) 2023-11-30T17:06:59.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.536+0000 7f07137fe700 1 -- 172.21.15.115:0/1006342177 learned_addr learned my addr 172.21.15.115:0/1006342177 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-11-30T17:06:59.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.536+0000 7f0718f47700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f07140bcfa0 0x7f07140bd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60620/0 (socket says 172.21.15.115:60620) 2023-11-30T17:06:59.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.536+0000 7f0718f47700 1 -- 172.21.15.115:0/1006342177 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07140c6620 msgr2=0x7f0714150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:06:59.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.536+0000 7f0718f47700 1 --2- 172.21.15.115:0/1006342177 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07140c6620 0x7f0714150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:59.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.536+0000 7f0718f47700 1 -- 172.21.15.115:0/1006342177 >> v1:172.21.15.115:6789/0 conn(0x7f0714150930 legacy=0x7f07140a6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:06:59.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.536+0000 7f0718f47700 1 -- 172.21.15.115:0/1006342177 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07140c6c00 con 0x7f07140bcfa0 2023-11-30T17:06:59.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.536+0000 7f0712ffd700 1 -- 172.21.15.115:0/1006342177 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1880381324 0 0) 0x7f0714062910 con 0x7f0714150930 2023-11-30T17:06:59.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.536+0000 7f07137fe700 1 --2- 172.21.15.115:0/1006342177 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07140c6620 0x7f0714150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:06:59.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.536+0000 7f0718f47700 1 --2- 172.21.15.115:0/1006342177 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07140bcfa0 0x7f07140bd410 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f070c00d0d0 tx=0x7f070c00b990).ready entity=mon.1 client_cookie=b7c7c0dcd771a096 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:06:59.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.536+0000 7f0712ffd700 1 -- 172.21.15.115:0/1006342177 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c010070 con 0x7f07140bcfa0 2023-11-30T17:06:59.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.536+0000 7f0712ffd700 1 -- 172.21.15.115:0/1006342177 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070c00dd40 con 0x7f07140bcfa0 2023-11-30T17:06:59.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.536+0000 7f0712ffd700 1 -- 172.21.15.115:0/1006342177 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c015680 con 0x7f07140bcfa0 2023-11-30T17:06:59.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.537+0000 7f071a9aa700 1 -- 172.21.15.115:0/1006342177 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07140bcfa0 msgr2=0x7f07140bd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:06:59.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.537+0000 7f071a9aa700 1 --2- 172.21.15.115:0/1006342177 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07140bcfa0 0x7f07140bd410 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f070c00d0d0 tx=0x7f070c00b990).stop 2023-11-30T17:06:59.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.537+0000 7f071a9aa700 1 -- 172.21.15.115:0/1006342177 shutdown_connections 2023-11-30T17:06:59.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.537+0000 7f071a9aa700 1 --2- 172.21.15.115:0/1006342177 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07140bcfa0 0x7f07140bd410 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:59.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.537+0000 7f071a9aa700 1 --2- 172.21.15.115:0/1006342177 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07140c6620 0x7f0714150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:59.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.537+0000 7f071a9aa700 1 -- 172.21.15.115:0/1006342177 >> 172.21.15.115:0/1006342177 conn(0x7f07140c8230 msgr2=0x7f07140c4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:06:59.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.537+0000 7f071a9aa700 1 -- 172.21.15.115:0/1006342177 shutdown_connections 2023-11-30T17:06:59.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.537+0000 7f071a9aa700 1 -- 172.21.15.115:0/1006342177 wait complete. 2023-11-30T17:06:59.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.538+0000 7f071a9aa700 1 Processor -- start 2023-11-30T17:06:59.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.538+0000 7f071a9aa700 1 -- start start 2023-11-30T17:06:59.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.539+0000 7f071a9aa700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07140bcfa0 0x7f0714148770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:06:59.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.539+0000 7f071a9aa700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07140c6620 0x7f07140c1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:06:59.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.539+0000 7f071a9aa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0714150930 0x7f07140bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:06:59.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.539+0000 7f071a9aa700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0714148c60 con 0x7f0714150930 2023-11-30T17:06:59.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.539+0000 7f071a9aa700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07140c0b70 con 0x7f07140bcfa0 2023-11-30T17:06:59.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.539+0000 7f071a9aa700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07140bff60 con 0x7f07140c6620 2023-11-30T17:06:59.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.539+0000 7f0713fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07140bcfa0 0x7f0714148770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:59.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.539+0000 7f07137fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07140c6620 0x7f07140c1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:59.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.539+0000 7f07137fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07140c6620 0x7f07140c1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:42386/0 (socket says 172.21.15.115:42386) 2023-11-30T17:06:59.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.539+0000 7f07137fe700 1 -- 172.21.15.115:0/2145059106 learned_addr learned my addr 172.21.15.115:0/2145059106 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-11-30T17:06:59.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.539+0000 7f0713fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07140bcfa0 0x7f0714148770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60636/0 (socket says 172.21.15.115:60636) 2023-11-30T17:06:59.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.539+0000 7f0718f47700 1 --2- 172.21.15.115:0/2145059106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0714150930 0x7f07140bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:59.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.539+0000 7f07137fe700 1 -- 172.21.15.115:0/2145059106 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07140bcfa0 msgr2=0x7f0714148770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:06:59.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.539+0000 7f07137fe700 1 --2- 172.21.15.115:0/2145059106 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07140bcfa0 0x7f0714148770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:59.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.539+0000 7f07137fe700 1 -- 172.21.15.115:0/2145059106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0714150930 msgr2=0x7f07140bf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:06:59.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.539+0000 7f07137fe700 1 --2- 172.21.15.115:0/2145059106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0714150930 0x7f07140bf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:59.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.539+0000 7f07137fe700 1 -- 172.21.15.115:0/2145059106 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0704009300 con 0x7f07140c6620 2023-11-30T17:06:59.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.539+0000 7f0713fff700 1 --2- 172.21.15.115:0/2145059106 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07140bcfa0 0x7f0714148770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:06:59.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.539+0000 7f07137fe700 1 --2- 172.21.15.115:0/2145059106 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07140c6620 0x7f07140c1000 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f070400e9e0 tx=0x7f0704009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:06:59.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.540+0000 7f06fbfff700 1 -- 172.21.15.115:0/2145059106 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0704005880 con 0x7f07140c6620 2023-11-30T17:06:59.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.540+0000 7f06fbfff700 1 -- 172.21.15.115:0/2145059106 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07040059e0 con 0x7f07140c6620 2023-11-30T17:06:59.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.540+0000 7f071a9aa700 1 -- 172.21.15.115:0/2145059106 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f070c00bc30 con 0x7f07140c6620 2023-11-30T17:06:59.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.540+0000 7f06fbfff700 1 -- 172.21.15.115:0/2145059106 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0704005d60 con 0x7f07140c6620 2023-11-30T17:06:59.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.540+0000 7f071a9aa700 1 -- 172.21.15.115:0/2145059106 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07140c0520 con 0x7f07140c6620 2023-11-30T17:06:59.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.540+0000 7f06fbfff700 1 -- 172.21.15.115:0/2145059106 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f0704006490 con 0x7f07140c6620 2023-11-30T17:06:59.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.540+0000 7f06fbfff700 1 -- 172.21.15.115:0/2145059106 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f0704012db0 con 0x7f07140c6620 2023-11-30T17:06:59.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.541+0000 7f071a9aa700 1 -- 172.21.15.115:0/2145059106 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f071406c860 con 0x7f07140c6620 2023-11-30T17:06:59.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.543+0000 7f06fbfff700 1 -- 172.21.15.115:0/2145059106 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f0704016030 con 0x7f07140c6620 2023-11-30T17:06:59.552 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:06:59.548+0000 7f9aad6cf680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T17:06:59.593 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:06:59.592+0000 7fa7c1c7a680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T17:06:59.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.622+0000 7f071a9aa700 1 -- 172.21.15.115:0/2145059106 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "de56022c-e31e-4aa5-8f71-06fa5a59378d", "id": 0} v 0) v1 -- 0x7f071414c120 con 0x7f07140c6620 2023-11-30T17:06:59.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.628+0000 7f06fbfff700 1 -- 172.21.15.115:0/2145059106 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "de56022c-e31e-4aa5-8f71-06fa5a59378d", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f070401b460 con 0x7f07140c6620 2023-11-30T17:06:59.629 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-11-30T17:06:59.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.629+0000 7f071a9aa700 1 -- 172.21.15.115:0/2145059106 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07140c6620 msgr2=0x7f07140c1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:06:59.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.629+0000 7f071a9aa700 1 --2- 172.21.15.115:0/2145059106 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07140c6620 0x7f07140c1000 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f070400e9e0 tx=0x7f0704009060).stop 2023-11-30T17:06:59.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.629+0000 7f071a9aa700 1 -- 172.21.15.115:0/2145059106 shutdown_connections 2023-11-30T17:06:59.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.629+0000 7f071a9aa700 1 --2- 172.21.15.115:0/2145059106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0714150930 0x7f07140bf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:59.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.629+0000 7f071a9aa700 1 --2- 172.21.15.115:0/2145059106 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07140bcfa0 0x7f0714148770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:59.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.629+0000 7f071a9aa700 1 --2- 172.21.15.115:0/2145059106 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07140c6620 0x7f07140c1000 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:59.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.629+0000 7f071a9aa700 1 -- 172.21.15.115:0/2145059106 >> 172.21.15.115:0/2145059106 conn(0x7f07140c8230 msgr2=0x7f07140c42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:06:59.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.629+0000 7f071a9aa700 1 -- 172.21.15.115:0/2145059106 shutdown_connections 2023-11-30T17:06:59.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.629+0000 7f071a9aa700 1 -- 172.21.15.115:0/2145059106 wait complete. 2023-11-30T17:06:59.642 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 0db27d78-4d49-426b-8028-c160cd6004d2 1 2023-11-30T17:06:59.745 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:06:59.743+0000 7f9aad6cf680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T17:06:59.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.754+0000 7f9832c81700 1 Processor -- start 2023-11-30T17:06:59.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.754+0000 7f9832c81700 1 -- start start 2023-11-30T17:06:59.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.755+0000 7f9832c81700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f982c0c6190 0x7f982c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:06:59.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.755+0000 7f9832c81700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f982c158320 0x7f982c1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:06:59.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.755+0000 7f9832c81700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f982c158cc0 con 0x7f982c098d10 2023-11-30T17:06:59.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.755+0000 7f9832c81700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f982c0c72d0 con 0x7f982c0c6190 2023-11-30T17:06:59.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.755+0000 7f9832c81700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982c064570 con 0x7f982c158320 2023-11-30T17:06:59.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.755+0000 7f983121e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f982c158320 0x7f982c1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:59.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.755+0000 7f982bfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f982c0c6190 0x7f982c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:59.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.755+0000 7f983121e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f982c158320 0x7f982c1587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:42394/0 (socket says 172.21.15.115:42394) 2023-11-30T17:06:59.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.755+0000 7f982bfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f982c0c6190 0x7f982c0c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60642/0 (socket says 172.21.15.115:60642) 2023-11-30T17:06:59.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.755+0000 7f983121e700 1 -- 172.21.15.115:0/3297260682 learned_addr learned my addr 172.21.15.115:0/3297260682 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-11-30T17:06:59.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.756+0000 7f982bfff700 1 -- 172.21.15.115:0/3297260682 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f982c158320 msgr2=0x7f982c1587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:06:59.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.756+0000 7f982bfff700 1 --2- 172.21.15.115:0/3297260682 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f982c158320 0x7f982c1587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:59.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.756+0000 7f982bfff700 1 -- 172.21.15.115:0/3297260682 >> v1:172.21.15.49:6789/0 conn(0x7f982c098d10 legacy=0x7f982c063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:06:59.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.756+0000 7f982bfff700 1 -- 172.21.15.115:0/3297260682 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982c154bc0 con 0x7f982c0c6190 2023-11-30T17:06:59.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.756+0000 7f983121e700 1 --2- 172.21.15.115:0/3297260682 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f982c158320 0x7f982c1587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:06:59.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.756+0000 7f982bfff700 1 --2- 172.21.15.115:0/3297260682 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f982c0c6190 0x7f982c0c7760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f9818009760 tx=0x7f9818009060).ready entity=mon.1 client_cookie=c53d42c75ce47d54 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:06:59.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.756+0000 7f982b7fe700 1 -- 172.21.15.115:0/3297260682 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981800f510 con 0x7f982c0c6190 2023-11-30T17:06:59.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.756+0000 7f982b7fe700 1 -- 172.21.15.115:0/3297260682 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981800f670 con 0x7f982c0c6190 2023-11-30T17:06:59.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.756+0000 7f982b7fe700 1 -- 172.21.15.115:0/3297260682 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981800f9f0 con 0x7f982c0c6190 2023-11-30T17:06:59.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.756+0000 7f9832c81700 1 -- 172.21.15.115:0/3297260682 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f982c0c6190 msgr2=0x7f982c0c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:06:59.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.756+0000 7f9832c81700 1 --2- 172.21.15.115:0/3297260682 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f982c0c6190 0x7f982c0c7760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f9818009760 tx=0x7f9818009060).stop 2023-11-30T17:06:59.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.757+0000 7f9832c81700 1 -- 172.21.15.115:0/3297260682 shutdown_connections 2023-11-30T17:06:59.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.757+0000 7f9832c81700 1 --2- 172.21.15.115:0/3297260682 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f982c158320 0x7f982c1587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:59.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.757+0000 7f9832c81700 1 --2- 172.21.15.115:0/3297260682 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f982c0c6190 0x7f982c0c7760 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:59.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.757+0000 7f9832c81700 1 -- 172.21.15.115:0/3297260682 >> 172.21.15.115:0/3297260682 conn(0x7f982c0cb310 msgr2=0x7f982c0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:06:59.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.757+0000 7f9832c81700 1 -- 172.21.15.115:0/3297260682 shutdown_connections 2023-11-30T17:06:59.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.757+0000 7f9832c81700 1 -- 172.21.15.115:0/3297260682 wait complete. 2023-11-30T17:06:59.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.758+0000 7f9832c81700 1 Processor -- start 2023-11-30T17:06:59.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.758+0000 7f9832c81700 1 -- start start 2023-11-30T17:06:59.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.759+0000 7f9832c81700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f982c098d10 0x7f982c150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:06:59.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.759+0000 7f9832c81700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f982c0c6190 0x7f982c0af450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:06:59.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.759+0000 7f9832c81700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f982c158320 0x7f982c15a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:06:59.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.759+0000 7f9832c81700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c151090 con 0x7f982c0c6190 2023-11-30T17:06:59.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.759+0000 7f9832c81700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c156ff0 con 0x7f982c158320 2023-11-30T17:06:59.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.759+0000 7f9832c81700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982c1572d0 con 0x7f982c098d10 2023-11-30T17:06:59.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.759+0000 7f9830a1d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f982c098d10 0x7f982c150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:59.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.759+0000 7f983121e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f982c158320 0x7f982c15a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:59.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.759+0000 7f9830a1d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f982c098d10 0x7f982c150ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:42402/0 (socket says 172.21.15.115:42402) 2023-11-30T17:06:59.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.759+0000 7f9830a1d700 1 -- 172.21.15.115:0/3161985748 learned_addr learned my addr 172.21.15.115:0/3161985748 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-11-30T17:06:59.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.759+0000 7f983121e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f982c158320 0x7f982c15a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60658/0 (socket says 172.21.15.115:60658) 2023-11-30T17:06:59.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.759+0000 7f982bfff700 1 --2- 172.21.15.115:0/3161985748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f982c0c6190 0x7f982c0af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:59.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.759+0000 7f9830a1d700 1 -- 172.21.15.115:0/3161985748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f982c158320 msgr2=0x7f982c15a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:06:59.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.759+0000 7f9830a1d700 1 --2- 172.21.15.115:0/3161985748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f982c158320 0x7f982c15a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:59.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.759+0000 7f9830a1d700 1 -- 172.21.15.115:0/3161985748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f982c0c6190 msgr2=0x7f982c0af450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:06:59.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.759+0000 7f9830a1d700 1 --2- 172.21.15.115:0/3161985748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f982c0c6190 0x7f982c0af450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:59.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.759+0000 7f9830a1d700 1 -- 172.21.15.115:0/3161985748 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9824009ae0 con 0x7f982c098d10 2023-11-30T17:06:59.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.759+0000 7f9830a1d700 1 --2- 172.21.15.115:0/3161985748 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f982c098d10 0x7f982c150ba0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f982000c4c0 tx=0x7f9820007e00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:06:59.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.759+0000 7f9828ff9700 1 -- 172.21.15.115:0/3161985748 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982000ce70 con 0x7f982c098d10 2023-11-30T17:06:59.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.759+0000 7f9828ff9700 1 -- 172.21.15.115:0/3161985748 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9820001e90 con 0x7f982c098d10 2023-11-30T17:06:59.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.759+0000 7f9832c81700 1 -- 172.21.15.115:0/3161985748 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98180092a0 con 0x7f982c098d10 2023-11-30T17:06:59.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.759+0000 7f9828ff9700 1 -- 172.21.15.115:0/3161985748 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9820007250 con 0x7f982c098d10 2023-11-30T17:06:59.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.759+0000 7f9832c81700 1 -- 172.21.15.115:0/3161985748 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f982c157890 con 0x7f982c098d10 2023-11-30T17:06:59.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.760+0000 7f9828ff9700 1 -- 172.21.15.115:0/3161985748 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f9820006900 con 0x7f982c098d10 2023-11-30T17:06:59.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.760+0000 7f9828ff9700 1 -- 172.21.15.115:0/3161985748 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7f982000fab0 con 0x7f982c098d10 2023-11-30T17:06:59.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.761+0000 7f9832c81700 1 -- 172.21.15.115:0/3161985748 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f982c152320 con 0x7f982c098d10 2023-11-30T17:06:59.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.763+0000 7f9828ff9700 1 -- 172.21.15.115:0/3161985748 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f982c158cc0 con 0x7f982c098d10 2023-11-30T17:06:59.789 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:06:59.788+0000 7fa7c1c7a680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T17:06:59.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.843+0000 7f9832c81700 1 -- 172.21.15.115:0/3161985748 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0db27d78-4d49-426b-8028-c160cd6004d2", "id": 1} v 0) v1 -- 0x7f982c06c860 con 0x7f982c098d10 2023-11-30T17:06:59.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.848+0000 7f9828ff9700 1 -- 172.21.15.115:0/3161985748 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0db27d78-4d49-426b-8028-c160cd6004d2", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9820006de0 con 0x7f982c098d10 2023-11-30T17:06:59.850 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-11-30T17:06:59.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.849+0000 7f9832c81700 1 -- 172.21.15.115:0/3161985748 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f982c098d10 msgr2=0x7f982c150ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:06:59.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.849+0000 7f9832c81700 1 --2- 172.21.15.115:0/3161985748 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f982c098d10 0x7f982c150ba0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f982000c4c0 tx=0x7f9820007e00).stop 2023-11-30T17:06:59.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.849+0000 7f9832c81700 1 -- 172.21.15.115:0/3161985748 shutdown_connections 2023-11-30T17:06:59.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.849+0000 7f9832c81700 1 --2- 172.21.15.115:0/3161985748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f982c158320 0x7f982c15a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:59.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.849+0000 7f9832c81700 1 --2- 172.21.15.115:0/3161985748 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f982c098d10 0x7f982c150ba0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:59.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.849+0000 7f9832c81700 1 --2- 172.21.15.115:0/3161985748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f982c0c6190 0x7f982c0af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:59.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.849+0000 7f9832c81700 1 -- 172.21.15.115:0/3161985748 >> 172.21.15.115:0/3161985748 conn(0x7f982c0cb310 msgr2=0x7f982c153bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:06:59.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.849+0000 7f9832c81700 1 -- 172.21.15.115:0/3161985748 shutdown_connections 2023-11-30T17:06:59.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.849+0000 7f9832c81700 1 -- 172.21.15.115:0/3161985748 wait complete. 2023-11-30T17:06:59.862 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new ea04ab6b-30cd-4b3f-8b91-64c839245dbd 2 2023-11-30T17:06:59.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.976+0000 7f559bd24700 1 Processor -- start 2023-11-30T17:06:59.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.977+0000 7f559bd24700 1 -- start start 2023-11-30T17:06:59.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.977+0000 7f559bd24700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5594098d10 0x7f55940c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:06:59.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.977+0000 7f559bd24700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f55940c6190 0x7f5594063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:06:59.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.977+0000 7f559bd24700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55940c72d0 con 0x7f5594064350 2023-11-30T17:06:59.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.977+0000 7f559bd24700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5594154bc0 con 0x7f55940c6190 2023-11-30T17:06:59.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.977+0000 7f559bd24700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55940c66c0 con 0x7f5594098d10 2023-11-30T17:06:59.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.977+0000 7f55992bf700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f55940c6190 0x7f5594063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:59.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.977+0000 7f5599ac0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5594098d10 0x7f55940c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:59.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.977+0000 7f559a2c1700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f5594064350 0x7f5594158320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51674/0 (socket says 172.21.15.115:51674) 2023-11-30T17:06:59.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.977+0000 7f559a2c1700 1 -- 172.21.15.115:0/734028039 learned_addr learned my addr 172.21.15.115:0/734028039 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-11-30T17:06:59.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.978+0000 7f5599ac0700 1 -- 172.21.15.115:0/734028039 >> v2:172.21.15.115:3300/0 conn(0x7f55940c6190 msgr2=0x7f5594063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:06:59.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.978+0000 7f5599ac0700 1 --2- 172.21.15.115:0/734028039 >> v2:172.21.15.115:3300/0 conn(0x7f55940c6190 0x7f5594063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:59.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.978+0000 7f5599ac0700 1 -- 172.21.15.115:0/734028039 >> v1:172.21.15.115:6789/0 conn(0x7f5594064350 legacy=0x7f5594158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:06:59.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.978+0000 7f5598abe700 1 -- 172.21.15.115:0/734028039 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 465728966 0 0) 0x7f55940c72d0 con 0x7f5594064350 2023-11-30T17:06:59.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.978+0000 7f5599ac0700 1 -- 172.21.15.115:0/734028039 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55940c69a0 con 0x7f5594098d10 2023-11-30T17:06:59.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.978+0000 7f55992bf700 1 --2- 172.21.15.115:0/734028039 >> v2:172.21.15.115:3300/0 conn(0x7f55940c6190 0x7f5594063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:06:59.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.978+0000 7f5599ac0700 1 --2- 172.21.15.115:0/734028039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5594098d10 0x7f55940c7760 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f5584009760 tx=0x7f5584009060).ready entity=mon.2 client_cookie=1d159d1277a03e55 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:06:59.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.978+0000 7f5598abe700 1 -- 172.21.15.115:0/734028039 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558400f510 con 0x7f5594098d10 2023-11-30T17:06:59.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.978+0000 7f5598abe700 1 -- 172.21.15.115:0/734028039 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558400f670 con 0x7f5594098d10 2023-11-30T17:06:59.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.978+0000 7f5598abe700 1 -- 172.21.15.115:0/734028039 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558400f9f0 con 0x7f5594098d10 2023-11-30T17:06:59.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.979+0000 7f559bd24700 1 -- 172.21.15.115:0/734028039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5594098d10 msgr2=0x7f55940c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:06:59.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.979+0000 7f559bd24700 1 --2- 172.21.15.115:0/734028039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5594098d10 0x7f55940c7760 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f5584009760 tx=0x7f5584009060).stop 2023-11-30T17:06:59.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.979+0000 7f559bd24700 1 -- 172.21.15.115:0/734028039 shutdown_connections 2023-11-30T17:06:59.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.979+0000 7f559bd24700 1 --2- 172.21.15.115:0/734028039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5594098d10 0x7f55940c7760 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:59.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.979+0000 7f559bd24700 1 --2- 172.21.15.115:0/734028039 >> v2:172.21.15.115:3300/0 conn(0x7f55940c6190 0x7f5594063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:59.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.979+0000 7f559bd24700 1 -- 172.21.15.115:0/734028039 >> 172.21.15.115:0/734028039 conn(0x7f55940cb310 msgr2=0x7f55940cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:06:59.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.979+0000 7f559bd24700 1 -- 172.21.15.115:0/734028039 shutdown_connections 2023-11-30T17:06:59.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.979+0000 7f559bd24700 1 -- 172.21.15.115:0/734028039 wait complete. 2023-11-30T17:06:59.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.980+0000 7f559bd24700 1 Processor -- start 2023-11-30T17:06:59.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.980+0000 7f559bd24700 1 -- start start 2023-11-30T17:06:59.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.981+0000 7f559bd24700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5594064350 0x7f55941574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:06:59.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.981+0000 7f559bd24700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5594098d10 0x7f55940a86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:06:59.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.981+0000 7f559bd24700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55940c6190 0x7f559414fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:06:59.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.981+0000 7f559bd24700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55941555b0 con 0x7f55940c6190 2023-11-30T17:06:59.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.981+0000 7f559bd24700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5594155e50 con 0x7f5594064350 2023-11-30T17:06:59.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.981+0000 7f559bd24700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5594150c50 con 0x7f5594098d10 2023-11-30T17:06:59.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.981+0000 7f55992bf700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5594098d10 0x7f55940a86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:59.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.981+0000 7f5599ac0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5594064350 0x7f55941574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:59.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.981+0000 7f55992bf700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5594098d10 0x7f55940a86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:42412/0 (socket says 172.21.15.115:42412) 2023-11-30T17:06:59.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.981+0000 7f5599ac0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5594064350 0x7f55941574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60682/0 (socket says 172.21.15.115:60682) 2023-11-30T17:06:59.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.981+0000 7f55992bf700 1 -- 172.21.15.115:0/280798105 learned_addr learned my addr 172.21.15.115:0/280798105 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-11-30T17:06:59.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.981+0000 7f559a2c1700 1 --2- 172.21.15.115:0/280798105 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55940c6190 0x7f559414fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:06:59.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.981+0000 7f5599ac0700 1 -- 172.21.15.115:0/280798105 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5594098d10 msgr2=0x7f55940a86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:06:59.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.981+0000 7f5599ac0700 1 --2- 172.21.15.115:0/280798105 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5594098d10 0x7f55940a86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:59.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.981+0000 7f5599ac0700 1 -- 172.21.15.115:0/280798105 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55940c6190 msgr2=0x7f559414fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:06:59.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.981+0000 7f5599ac0700 1 --2- 172.21.15.115:0/280798105 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55940c6190 0x7f559414fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:06:59.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.981+0000 7f5599ac0700 1 -- 172.21.15.115:0/280798105 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55900092a0 con 0x7f5594064350 2023-11-30T17:06:59.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.981+0000 7f55992bf700 1 --2- 172.21.15.115:0/280798105 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5594098d10 0x7f55940a86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:06:59.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.981+0000 7f5599ac0700 1 --2- 172.21.15.115:0/280798105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5594064350 0x7f55941574a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f5584014000 tx=0x7f5584017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:06:59.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.981+0000 7f5589ffb700 1 -- 172.21.15.115:0/280798105 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558400f7e0 con 0x7f5594064350 2023-11-30T17:06:59.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.982+0000 7f5589ffb700 1 -- 172.21.15.115:0/280798105 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558400f940 con 0x7f5594064350 2023-11-30T17:06:59.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.982+0000 7f559bd24700 1 -- 172.21.15.115:0/280798105 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55840092a0 con 0x7f5594064350 2023-11-30T17:06:59.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.982+0000 7f5589ffb700 1 -- 172.21.15.115:0/280798105 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558401b660 con 0x7f5594064350 2023-11-30T17:06:59.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.982+0000 7f559bd24700 1 -- 172.21.15.115:0/280798105 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5594155800 con 0x7f5594064350 2023-11-30T17:06:59.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.982+0000 7f5589ffb700 1 -- 172.21.15.115:0/280798105 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f558401bcb0 con 0x7f5594064350 2023-11-30T17:06:59.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.982+0000 7f5589ffb700 1 -- 172.21.15.115:0/280798105 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f55840238f0 con 0x7f5594064350 2023-11-30T17:06:59.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.983+0000 7f559bd24700 1 -- 172.21.15.115:0/280798105 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f559406c860 con 0x7f5594064350 2023-11-30T17:06:59.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:06:59.988+0000 7f5589ffb700 1 -- 172.21.15.115:0/280798105 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f5584023cd0 con 0x7f5594064350 2023-11-30T17:07:00.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.068+0000 7f559bd24700 1 -- 172.21.15.115:0/280798105 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ea04ab6b-30cd-4b3f-8b91-64c839245dbd", "id": 2} v 0) v1 -- 0x7f55940c6c80 con 0x7f5594064350 2023-11-30T17:07:00.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.075+0000 7f5589ffb700 1 -- 172.21.15.115:0/280798105 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ea04ab6b-30cd-4b3f-8b91-64c839245dbd", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f55840234a0 con 0x7f5594064350 2023-11-30T17:07:00.077 INFO:teuthology.orchestra.run.smithi115.stdout:2 2023-11-30T17:07:00.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.076+0000 7f559bd24700 1 -- 172.21.15.115:0/280798105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5594064350 msgr2=0x7f55941574a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:00.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.076+0000 7f559bd24700 1 --2- 172.21.15.115:0/280798105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5594064350 0x7f55941574a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f5584014000 tx=0x7f5584017000).stop 2023-11-30T17:07:00.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.076+0000 7f559bd24700 1 -- 172.21.15.115:0/280798105 shutdown_connections 2023-11-30T17:07:00.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.076+0000 7f559bd24700 1 --2- 172.21.15.115:0/280798105 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55940c6190 0x7f559414fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.076+0000 7f559bd24700 1 --2- 172.21.15.115:0/280798105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5594064350 0x7f55941574a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.076+0000 7f559bd24700 1 --2- 172.21.15.115:0/280798105 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5594098d10 0x7f55940a86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.076+0000 7f559bd24700 1 -- 172.21.15.115:0/280798105 >> 172.21.15.115:0/280798105 conn(0x7f55940cb310 msgr2=0x7f5594153a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:00.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.076+0000 7f559bd24700 1 -- 172.21.15.115:0/280798105 shutdown_connections 2023-11-30T17:07:00.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.076+0000 7f559bd24700 1 -- 172.21.15.115:0/280798105 wait complete. 2023-11-30T17:07:00.089 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 13617b13-0ec6-4515-91a8-fee1f18754df 3 2023-11-30T17:07:00.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.202+0000 7f6809ed4700 1 Processor -- start 2023-11-30T17:07:00.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.202+0000 7f6809ed4700 1 -- start start 2023-11-30T17:07:00.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.202+0000 7f6809ed4700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f680414eb00 0x7f680414eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:00.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.202+0000 7f6809ed4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6804062e80 0x7f68040bcb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:00.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.203+0000 7f6809ed4700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68040bd060 con 0x7f68040bc6c0 2023-11-30T17:07:00.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.203+0000 7f6809ed4700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6804137d90 con 0x7f680414eb00 2023-11-30T17:07:00.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.203+0000 7f6809ed4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68040634a0 con 0x7f6804062e80 2023-11-30T17:07:00.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.203+0000 7f68037fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f680414eb00 0x7f680414eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:00.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.203+0000 7f6803fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6804062e80 0x7f68040bcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:00.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.203+0000 7f68037fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f680414eb00 0x7f680414eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60690/0 (socket says 172.21.15.115:60690) 2023-11-30T17:07:00.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.203+0000 7f6803fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6804062e80 0x7f68040bcb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:42428/0 (socket says 172.21.15.115:42428) 2023-11-30T17:07:00.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.203+0000 7f68037fe700 1 -- 172.21.15.115:0/3137628749 learned_addr learned my addr 172.21.15.115:0/3137628749 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-11-30T17:07:00.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.203+0000 7f68037fe700 1 -- 172.21.15.115:0/3137628749 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6804062e80 msgr2=0x7f68040bcb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:00.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.203+0000 7f68037fe700 1 --2- 172.21.15.115:0/3137628749 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6804062e80 0x7f68040bcb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.203+0000 7f68037fe700 1 -- 172.21.15.115:0/3137628749 >> v1:172.21.15.49:6789/0 conn(0x7f68040bc6c0 legacy=0x7f6804062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:00.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.203+0000 7f68037fe700 1 -- 172.21.15.115:0/3137628749 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6804063780 con 0x7f680414eb00 2023-11-30T17:07:00.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.203+0000 7f6803fff700 1 --2- 172.21.15.115:0/3137628749 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6804062e80 0x7f68040bcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:07:00.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.203+0000 7f68037fe700 1 --2- 172.21.15.115:0/3137628749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f680414eb00 0x7f680414eee0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f67f8009810 tx=0x7f67f8009060).ready entity=mon.1 client_cookie=f40ca35903418f32 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:00.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.203+0000 7f68027fc700 1 -- 172.21.15.115:0/3137628749 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f8005880 con 0x7f680414eb00 2023-11-30T17:07:00.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.203+0000 7f68027fc700 1 -- 172.21.15.115:0/3137628749 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f80059e0 con 0x7f680414eb00 2023-11-30T17:07:00.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.203+0000 7f68027fc700 1 -- 172.21.15.115:0/3137628749 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f8005d60 con 0x7f680414eb00 2023-11-30T17:07:00.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.204+0000 7f6809ed4700 1 -- 172.21.15.115:0/3137628749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f680414eb00 msgr2=0x7f680414eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:00.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.204+0000 7f6809ed4700 1 --2- 172.21.15.115:0/3137628749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f680414eb00 0x7f680414eee0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f67f8009810 tx=0x7f67f8009060).stop 2023-11-30T17:07:00.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.204+0000 7f6809ed4700 1 -- 172.21.15.115:0/3137628749 shutdown_connections 2023-11-30T17:07:00.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.204+0000 7f6809ed4700 1 --2- 172.21.15.115:0/3137628749 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6804062e80 0x7f68040bcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.204+0000 7f6809ed4700 1 --2- 172.21.15.115:0/3137628749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f680414eb00 0x7f680414eee0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.204+0000 7f6809ed4700 1 -- 172.21.15.115:0/3137628749 >> 172.21.15.115:0/3137628749 conn(0x7f68040c8230 msgr2=0x7f68040c4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:00.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.204+0000 7f6809ed4700 1 -- 172.21.15.115:0/3137628749 shutdown_connections 2023-11-30T17:07:00.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.204+0000 7f6809ed4700 1 -- 172.21.15.115:0/3137628749 wait complete. 2023-11-30T17:07:00.208 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:07:00.204+0000 7f9aad6cf680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T17:07:00.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.205+0000 7f6809ed4700 1 Processor -- start 2023-11-30T17:07:00.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.205+0000 7f6809ed4700 1 -- start start 2023-11-30T17:07:00.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.206+0000 7f6809ed4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6804062e80 0x7f680414dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:00.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.206+0000 7f6809ed4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f68040bc6c0 0x7f6804152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:00.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.206+0000 7f6809ed4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f680414eb00 0x7f6804153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:00.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.206+0000 7f6809ed4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6804153530 con 0x7f6804062e80 2023-11-30T17:07:00.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.206+0000 7f6809ed4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68040ad430 con 0x7f680414eb00 2023-11-30T17:07:00.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.206+0000 7f6809ed4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6804150c30 con 0x7f68040bc6c0 2023-11-30T17:07:00.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.206+0000 7f6803fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f680414eb00 0x7f6804153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:00.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.206+0000 7f6803fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f680414eb00 0x7f6804153040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60696/0 (socket says 172.21.15.115:60696) 2023-11-30T17:07:00.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.206+0000 7f6803fff700 1 -- 172.21.15.115:0/3708401224 learned_addr learned my addr 172.21.15.115:0/3708401224 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-11-30T17:07:00.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.206+0000 7f68037fe700 1 --2- 172.21.15.115:0/3708401224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6804062e80 0x7f680414dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:00.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.206+0000 7f6802ffd700 1 --2- 172.21.15.115:0/3708401224 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f68040bc6c0 0x7f6804152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:00.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.206+0000 7f6803fff700 1 -- 172.21.15.115:0/3708401224 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f68040bc6c0 msgr2=0x7f6804152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:00.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.206+0000 7f6803fff700 1 --2- 172.21.15.115:0/3708401224 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f68040bc6c0 0x7f6804152b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.206+0000 7f6803fff700 1 -- 172.21.15.115:0/3708401224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6804062e80 msgr2=0x7f680414dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:00.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.206+0000 7f6803fff700 1 --2- 172.21.15.115:0/3708401224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6804062e80 0x7f680414dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.206+0000 7f6803fff700 1 -- 172.21.15.115:0/3708401224 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67fc009a20 con 0x7f680414eb00 2023-11-30T17:07:00.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.206+0000 7f6803fff700 1 --2- 172.21.15.115:0/3708401224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f680414eb00 0x7f6804153040 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f67fc009fc0 tx=0x7f67fc00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:00.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.207+0000 7f67eb7fe700 1 -- 172.21.15.115:0/3708401224 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc00cbd0 con 0x7f680414eb00 2023-11-30T17:07:00.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.207+0000 7f67eb7fe700 1 -- 172.21.15.115:0/3708401224 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67fc00f040 con 0x7f680414eb00 2023-11-30T17:07:00.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.207+0000 7f6809ed4700 1 -- 172.21.15.115:0/3708401224 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f8009300 con 0x7f680414eb00 2023-11-30T17:07:00.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.207+0000 7f67eb7fe700 1 -- 172.21.15.115:0/3708401224 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc013400 con 0x7f680414eb00 2023-11-30T17:07:00.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.207+0000 7f6809ed4700 1 -- 172.21.15.115:0/3708401224 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6804150020 con 0x7f680414eb00 2023-11-30T17:07:00.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.207+0000 7f67eb7fe700 1 -- 172.21.15.115:0/3708401224 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f67fc013a50 con 0x7f680414eb00 2023-11-30T17:07:00.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.207+0000 7f67eb7fe700 1 -- 172.21.15.115:0/3708401224 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7f67fc01dbf0 con 0x7f680414eb00 2023-11-30T17:07:00.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.208+0000 7f6809ed4700 1 -- 172.21.15.115:0/3708401224 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f680406c860 con 0x7f680414eb00 2023-11-30T17:07:00.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.210+0000 7f67eb7fe700 1 -- 172.21.15.115:0/3708401224 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f67fc01d730 con 0x7f680414eb00 2023-11-30T17:07:00.248 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:07:00.246+0000 7fa7c1c7a680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T17:07:00.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.289+0000 7f6809ed4700 1 -- 172.21.15.115:0/3708401224 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd new", "uuid": "13617b13-0ec6-4515-91a8-fee1f18754df", "id": 3} v 0) v1 -- 0x7f6804065d20 con 0x7f680414eb00 2023-11-30T17:07:00.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.293+0000 7f67eb7fe700 1 -- 172.21.15.115:0/3708401224 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "13617b13-0ec6-4515-91a8-fee1f18754df", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f67fc01d990 con 0x7f680414eb00 2023-11-30T17:07:00.294 INFO:teuthology.orchestra.run.smithi115.stdout:3 2023-11-30T17:07:00.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.294+0000 7f6809ed4700 1 -- 172.21.15.115:0/3708401224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f680414eb00 msgr2=0x7f6804153040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:00.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.294+0000 7f6809ed4700 1 --2- 172.21.15.115:0/3708401224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f680414eb00 0x7f6804153040 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f67fc009fc0 tx=0x7f67fc00b040).stop 2023-11-30T17:07:00.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.294+0000 7f6809ed4700 1 -- 172.21.15.115:0/3708401224 shutdown_connections 2023-11-30T17:07:00.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.294+0000 7f6809ed4700 1 --2- 172.21.15.115:0/3708401224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f680414eb00 0x7f6804153040 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.294+0000 7f6809ed4700 1 --2- 172.21.15.115:0/3708401224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6804062e80 0x7f680414dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.294+0000 7f6809ed4700 1 --2- 172.21.15.115:0/3708401224 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f68040bc6c0 0x7f6804152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.294+0000 7f6809ed4700 1 -- 172.21.15.115:0/3708401224 >> 172.21.15.115:0/3708401224 conn(0x7f68040c8230 msgr2=0x7f68040c67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:00.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.294+0000 7f6809ed4700 1 -- 172.21.15.115:0/3708401224 shutdown_connections 2023-11-30T17:07:00.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.294+0000 7f6809ed4700 1 -- 172.21.15.115:0/3708401224 wait complete. 2023-11-30T17:07:00.307 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 36fb835b-48c2-4954-9fff-5d6d2cf7576a 4 2023-11-30T17:07:00.314 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:07:00.312+0000 7f9aad6cf680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:07:00.355 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:07:00.354+0000 7fa7c1c7a680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:07:00.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.422+0000 7fc606586700 1 Processor -- start 2023-11-30T17:07:00.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.422+0000 7fc606586700 1 -- start start 2023-11-30T17:07:00.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.423+0000 7fc606586700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc600098d10 0x7fc6000c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:00.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.423+0000 7fc606586700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc600158320 0x7fc6001587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:00.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.423+0000 7fc606586700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc600158cc0 con 0x7fc6000c6190 2023-11-30T17:07:00.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.423+0000 7fc606586700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6000c72d0 con 0x7fc600098d10 2023-11-30T17:07:00.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.423+0000 7fc606586700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc600064570 con 0x7fc600158320 2023-11-30T17:07:00.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.423+0000 7fc604b23700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc600158320 0x7fc6001587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:00.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.423+0000 7fc604b23700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc600158320 0x7fc6001587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60702/0 (socket says 172.21.15.115:60702) 2023-11-30T17:07:00.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.423+0000 7fc604b23700 1 -- 172.21.15.115:0/1201366297 learned_addr learned my addr 172.21.15.115:0/1201366297 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-11-30T17:07:00.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.423+0000 7fc5fffff700 1 --2- 172.21.15.115:0/1201366297 >> v2:172.21.15.49:3300/0 conn(0x7fc600098d10 0x7fc6000c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:00.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.423+0000 7fc604b23700 1 -- 172.21.15.115:0/1201366297 >> v2:172.21.15.49:3300/0 conn(0x7fc600098d10 msgr2=0x7fc6000c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:00.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.423+0000 7fc604b23700 1 --2- 172.21.15.115:0/1201366297 >> v2:172.21.15.49:3300/0 conn(0x7fc600098d10 0x7fc6000c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.423+0000 7fc604b23700 1 -- 172.21.15.115:0/1201366297 >> v1:172.21.15.49:6789/0 conn(0x7fc6000c6190 legacy=0x7fc600063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:00.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.423+0000 7fc604b23700 1 -- 172.21.15.115:0/1201366297 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc600154bc0 con 0x7fc600158320 2023-11-30T17:07:00.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.423+0000 7fc5fffff700 1 --2- 172.21.15.115:0/1201366297 >> v2:172.21.15.49:3300/0 conn(0x7fc600098d10 0x7fc6000c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:00.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.423+0000 7fc604b23700 1 --2- 172.21.15.115:0/1201366297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc600158320 0x7fc6001587d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fc6000657a0 tx=0x7fc5f8009840).ready entity=mon.1 client_cookie=9f3f63f3f87b2f6c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:00.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.424+0000 7fc5feffd700 1 -- 172.21.15.115:0/1201366297 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f800e070 con 0x7fc600158320 2023-11-30T17:07:00.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.424+0000 7fc5feffd700 1 -- 172.21.15.115:0/1201366297 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f800ba50 con 0x7fc600158320 2023-11-30T17:07:00.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.424+0000 7fc5feffd700 1 -- 172.21.15.115:0/1201366297 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f800bdd0 con 0x7fc600158320 2023-11-30T17:07:00.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.424+0000 7fc606586700 1 -- 172.21.15.115:0/1201366297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc600158320 msgr2=0x7fc6001587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:00.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.424+0000 7fc606586700 1 --2- 172.21.15.115:0/1201366297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc600158320 0x7fc6001587d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fc6000657a0 tx=0x7fc5f8009840).stop 2023-11-30T17:07:00.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.424+0000 7fc606586700 1 -- 172.21.15.115:0/1201366297 shutdown_connections 2023-11-30T17:07:00.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.424+0000 7fc606586700 1 --2- 172.21.15.115:0/1201366297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc600158320 0x7fc6001587d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.424+0000 7fc606586700 1 --2- 172.21.15.115:0/1201366297 >> v2:172.21.15.49:3300/0 conn(0x7fc600098d10 0x7fc6000c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.424+0000 7fc606586700 1 -- 172.21.15.115:0/1201366297 >> 172.21.15.115:0/1201366297 conn(0x7fc6000cb310 msgr2=0x7fc6000cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:00.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.424+0000 7fc606586700 1 -- 172.21.15.115:0/1201366297 shutdown_connections 2023-11-30T17:07:00.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.424+0000 7fc606586700 1 -- 172.21.15.115:0/1201366297 wait complete. 2023-11-30T17:07:00.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.425+0000 7fc606586700 1 Processor -- start 2023-11-30T17:07:00.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.426+0000 7fc606586700 1 -- start start 2023-11-30T17:07:00.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.426+0000 7fc606586700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc600098d10 0x7fc6001657a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:00.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.426+0000 7fc606586700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6000c6190 0x7fc6001645a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:00.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.426+0000 7fc606586700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc600158320 0x7fc600153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:00.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.426+0000 7fc606586700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60014e9c0 con 0x7fc600158320 2023-11-30T17:07:00.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.426+0000 7fc606586700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6001655e0 con 0x7fc6000c6190 2023-11-30T17:07:00.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.427+0000 7fc606586700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6000a8fa0 con 0x7fc600098d10 2023-11-30T17:07:00.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.427+0000 7fc5fffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc600098d10 0x7fc6001657a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:00.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.427+0000 7fc5ff7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6000c6190 0x7fc6001645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:00.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.427+0000 7fc5ff7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6000c6190 0x7fc6001645a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60706/0 (socket says 172.21.15.115:60706) 2023-11-30T17:07:00.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.427+0000 7fc5fffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc600098d10 0x7fc6001657a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:42450/0 (socket says 172.21.15.115:42450) 2023-11-30T17:07:00.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.427+0000 7fc5ff7fe700 1 -- 172.21.15.115:0/302607013 learned_addr learned my addr 172.21.15.115:0/302607013 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-11-30T17:07:00.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.427+0000 7fc604b23700 1 --2- 172.21.15.115:0/302607013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc600158320 0x7fc600153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:00.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.427+0000 7fc5ff7fe700 1 -- 172.21.15.115:0/302607013 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc600098d10 msgr2=0x7fc6001657a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:00.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.427+0000 7fc5ff7fe700 1 --2- 172.21.15.115:0/302607013 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc600098d10 0x7fc6001657a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.427+0000 7fc5ff7fe700 1 -- 172.21.15.115:0/302607013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc600158320 msgr2=0x7fc600153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:00.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.427+0000 7fc5ff7fe700 1 --2- 172.21.15.115:0/302607013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc600158320 0x7fc600153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.427+0000 7fc5ff7fe700 1 -- 172.21.15.115:0/302607013 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f8009ae0 con 0x7fc6000c6190 2023-11-30T17:07:00.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.427+0000 7fc5ff7fe700 1 --2- 172.21.15.115:0/302607013 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6000c6190 0x7fc6001645a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fc5f000c4f0 tx=0x7fc5f0007dd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:00.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.427+0000 7fc5e7fff700 1 -- 172.21.15.115:0/302607013 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f000ce00 con 0x7fc6000c6190 2023-11-30T17:07:00.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.427+0000 7fc5e7fff700 1 -- 172.21.15.115:0/302607013 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f0007020 con 0x7fc6000c6190 2023-11-30T17:07:00.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.427+0000 7fc606586700 1 -- 172.21.15.115:0/302607013 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc600164a90 con 0x7fc6000c6190 2023-11-30T17:07:00.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.427+0000 7fc5e7fff700 1 -- 172.21.15.115:0/302607013 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f00073c0 con 0x7fc6000c6190 2023-11-30T17:07:00.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.427+0000 7fc606586700 1 -- 172.21.15.115:0/302607013 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc600164d40 con 0x7fc6000c6190 2023-11-30T17:07:00.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.427+0000 7fc5e7fff700 1 -- 172.21.15.115:0/302607013 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fc5f0006b10 con 0x7fc6000c6190 2023-11-30T17:07:00.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.428+0000 7fc5e7fff700 1 -- 172.21.15.115:0/302607013 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7fc5f0007520 con 0x7fc6000c6190 2023-11-30T17:07:00.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.428+0000 7fc606586700 1 -- 172.21.15.115:0/302607013 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6000a8dc0 con 0x7fc6000c6190 2023-11-30T17:07:00.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.433+0000 7fc5e7fff700 1 -- 172.21.15.115:0/302607013 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fc5f0020060 con 0x7fc6000c6190 2023-11-30T17:07:00.474 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:07:00.472+0000 7f9aad6cf680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T17:07:00.513 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:07:00.512+0000 7fa7c1c7a680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T17:07:00.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.514+0000 7fc606586700 1 -- 172.21.15.115:0/302607013 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd new", "uuid": "36fb835b-48c2-4954-9fff-5d6d2cf7576a", "id": 4} v 0) v1 -- 0x7fc6000a9110 con 0x7fc6000c6190 2023-11-30T17:07:00.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.518+0000 7fc5e7fff700 1 -- 172.21.15.115:0/302607013 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "36fb835b-48c2-4954-9fff-5d6d2cf7576a", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc600158cc0 con 0x7fc6000c6190 2023-11-30T17:07:00.520 INFO:teuthology.orchestra.run.smithi115.stdout:4 2023-11-30T17:07:00.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.519+0000 7fc606586700 1 -- 172.21.15.115:0/302607013 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6000c6190 msgr2=0x7fc6001645a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:00.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.519+0000 7fc606586700 1 --2- 172.21.15.115:0/302607013 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6000c6190 0x7fc6001645a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fc5f000c4f0 tx=0x7fc5f0007dd0).stop 2023-11-30T17:07:00.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.519+0000 7fc606586700 1 -- 172.21.15.115:0/302607013 shutdown_connections 2023-11-30T17:07:00.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.519+0000 7fc606586700 1 --2- 172.21.15.115:0/302607013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc600158320 0x7fc600153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.519+0000 7fc606586700 1 --2- 172.21.15.115:0/302607013 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc600098d10 0x7fc6001657a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.519+0000 7fc606586700 1 --2- 172.21.15.115:0/302607013 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6000c6190 0x7fc6001645a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.519+0000 7fc606586700 1 -- 172.21.15.115:0/302607013 >> 172.21.15.115:0/302607013 conn(0x7fc6000cb310 msgr2=0x7fc600150f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:00.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.519+0000 7fc606586700 1 -- 172.21.15.115:0/302607013 shutdown_connections 2023-11-30T17:07:00.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.519+0000 7fc606586700 1 -- 172.21.15.115:0/302607013 wait complete. 2023-11-30T17:07:00.532 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 6a1cc107-899d-44da-b7b4-29e656ee7880 5 2023-11-30T17:07:00.555 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:07:00.553+0000 7f9aad6cf680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T17:07:00.594 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:07:00.593+0000 7fa7c1c7a680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T17:07:00.628 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:07:00.627+0000 7f9aad6cf680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T17:07:00.666 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:07:00.665+0000 7fa7c1c7a680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T17:07:00.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.667+0000 7f6a860d2700 1 Processor -- start 2023-11-30T17:07:00.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.667+0000 7f6a860d2700 1 -- start start 2023-11-30T17:07:00.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.667+0000 7f6a860d2700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6a80098d10 0x7f6a800c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:00.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.667+0000 7f6a860d2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6a800c6190 0x7f6a80063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:00.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.667+0000 7f6a860d2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a80064350 0x7f6a80158320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:00.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.667+0000 7f6a860d2700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a800c72d0 con 0x7f6a800c6190 2023-11-30T17:07:00.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.667+0000 7f6a860d2700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a80154bc0 con 0x7f6a80098d10 2023-11-30T17:07:00.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.667+0000 7f6a860d2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a800c66c0 con 0x7f6a80064350 2023-11-30T17:07:00.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.668+0000 7f6a7ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a80064350 0x7f6a80158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:00.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.668+0000 7f6a7f7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6a80098d10 0x7f6a800c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:00.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.668+0000 7f6a7ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a80064350 0x7f6a80158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:42464/0 (socket says 172.21.15.115:42464) 2023-11-30T17:07:00.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.668+0000 7f6a7ffff700 1 -- 172.21.15.115:0/4149001081 learned_addr learned my addr 172.21.15.115:0/4149001081 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-11-30T17:07:00.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.668+0000 7f6a7f7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6a80098d10 0x7f6a800c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60718/0 (socket says 172.21.15.115:60718) 2023-11-30T17:07:00.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.668+0000 7f6a7effd700 1 --2- 172.21.15.115:0/4149001081 >> v2:172.21.15.49:3300/0 conn(0x7f6a800c6190 0x7f6a80063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:00.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.668+0000 7f6a7ffff700 1 -- 172.21.15.115:0/4149001081 >> v2:172.21.15.115:3300/0 conn(0x7f6a80098d10 msgr2=0x7f6a800c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:00.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.668+0000 7f6a7ffff700 1 --2- 172.21.15.115:0/4149001081 >> v2:172.21.15.115:3300/0 conn(0x7f6a80098d10 0x7f6a800c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.668+0000 7f6a7ffff700 1 -- 172.21.15.115:0/4149001081 >> v2:172.21.15.49:3300/0 conn(0x7f6a800c6190 msgr2=0x7f6a80063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:00.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.668+0000 7f6a7ffff700 1 --2- 172.21.15.115:0/4149001081 >> v2:172.21.15.49:3300/0 conn(0x7f6a800c6190 0x7f6a80063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.668+0000 7f6a7ffff700 1 -- 172.21.15.115:0/4149001081 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a800c69a0 con 0x7f6a80064350 2023-11-30T17:07:00.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.668+0000 7f6a7f7fe700 1 --2- 172.21.15.115:0/4149001081 >> v2:172.21.15.115:3300/0 conn(0x7f6a80098d10 0x7f6a800c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:07:00.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.668+0000 7f6a7ffff700 1 --2- 172.21.15.115:0/4149001081 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a80064350 0x7f6a80158320 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f6a80083f80 tx=0x7f6a78009840).ready entity=mon.2 client_cookie=371510afb3a535d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:00.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.668+0000 7f6a7e7fc700 1 -- 172.21.15.115:0/4149001081 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7800e070 con 0x7f6a80064350 2023-11-30T17:07:00.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.668+0000 7f6a7e7fc700 1 -- 172.21.15.115:0/4149001081 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7800b970 con 0x7f6a80064350 2023-11-30T17:07:00.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.668+0000 7f6a7e7fc700 1 -- 172.21.15.115:0/4149001081 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7800bcf0 con 0x7f6a80064350 2023-11-30T17:07:00.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.669+0000 7f6a860d2700 1 -- 172.21.15.115:0/4149001081 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a80064350 msgr2=0x7f6a80158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:00.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.669+0000 7f6a860d2700 1 --2- 172.21.15.115:0/4149001081 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a80064350 0x7f6a80158320 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f6a80083f80 tx=0x7f6a78009840).stop 2023-11-30T17:07:00.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.669+0000 7f6a860d2700 1 -- 172.21.15.115:0/4149001081 shutdown_connections 2023-11-30T17:07:00.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.669+0000 7f6a860d2700 1 --2- 172.21.15.115:0/4149001081 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a80064350 0x7f6a80158320 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.669+0000 7f6a860d2700 1 --2- 172.21.15.115:0/4149001081 >> v2:172.21.15.115:3300/0 conn(0x7f6a80098d10 0x7f6a800c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.669+0000 7f6a860d2700 1 --2- 172.21.15.115:0/4149001081 >> v2:172.21.15.49:3300/0 conn(0x7f6a800c6190 0x7f6a80063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.669+0000 7f6a860d2700 1 -- 172.21.15.115:0/4149001081 >> 172.21.15.115:0/4149001081 conn(0x7f6a800cb310 msgr2=0x7f6a800cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:00.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.669+0000 7f6a860d2700 1 -- 172.21.15.115:0/4149001081 shutdown_connections 2023-11-30T17:07:00.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.669+0000 7f6a860d2700 1 -- 172.21.15.115:0/4149001081 wait complete. 2023-11-30T17:07:00.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.670+0000 7f6a860d2700 1 Processor -- start 2023-11-30T17:07:00.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.670+0000 7f6a860d2700 1 -- start start 2023-11-30T17:07:00.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.671+0000 7f6a860d2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a80064350 0x7f6a80157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:00.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.671+0000 7f6a860d2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a80098d10 0x7f6a800a9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:00.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.671+0000 7f6a860d2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a800c6190 0x7f6a80164490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:00.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.671+0000 7f6a860d2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a800b0240 con 0x7f6a80098d10 2023-11-30T17:07:00.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.671+0000 7f6a860d2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a800b0520 con 0x7f6a800c6190 2023-11-30T17:07:00.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.671+0000 7f6a860d2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a800a83b0 con 0x7f6a80064350 2023-11-30T17:07:00.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.671+0000 7f6a7f7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a80064350 0x7f6a80157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:00.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.671+0000 7f6a7ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a800c6190 0x7f6a80164490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:00.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.671+0000 7f6a7f7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a80064350 0x7f6a80157400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:42474/0 (socket says 172.21.15.115:42474) 2023-11-30T17:07:00.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.671+0000 7f6a7ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a800c6190 0x7f6a80164490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60726/0 (socket says 172.21.15.115:60726) 2023-11-30T17:07:00.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.671+0000 7f6a7f7fe700 1 -- 172.21.15.115:0/611791493 learned_addr learned my addr 172.21.15.115:0/611791493 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-11-30T17:07:00.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.671+0000 7f6a7effd700 1 --2- 172.21.15.115:0/611791493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a80098d10 0x7f6a800a9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:00.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.671+0000 7f6a7f7fe700 1 -- 172.21.15.115:0/611791493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a800c6190 msgr2=0x7f6a80164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:00.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.671+0000 7f6a7f7fe700 1 --2- 172.21.15.115:0/611791493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a800c6190 0x7f6a80164490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.671+0000 7f6a7f7fe700 1 -- 172.21.15.115:0/611791493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a80098d10 msgr2=0x7f6a800a9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:00.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.671+0000 7f6a7f7fe700 1 --2- 172.21.15.115:0/611791493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a80098d10 0x7f6a800a9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.671+0000 7f6a7f7fe700 1 -- 172.21.15.115:0/611791493 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a700092a0 con 0x7f6a80064350 2023-11-30T17:07:00.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.671+0000 7f6a7f7fe700 1 --2- 172.21.15.115:0/611791493 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a80064350 0x7f6a80157400 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f6a7000ea20 tx=0x7f6a70009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:00.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.671+0000 7f6a677fe700 1 -- 172.21.15.115:0/611791493 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7000ee60 con 0x7f6a80064350 2023-11-30T17:07:00.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.672+0000 7f6a677fe700 1 -- 172.21.15.115:0/611791493 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7000c850 con 0x7f6a80064350 2023-11-30T17:07:00.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.672+0000 7f6a860d2700 1 -- 172.21.15.115:0/611791493 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a78009ae0 con 0x7f6a80064350 2023-11-30T17:07:00.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.672+0000 7f6a677fe700 1 -- 172.21.15.115:0/611791493 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7000cbd0 con 0x7f6a80064350 2023-11-30T17:07:00.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.672+0000 7f6a860d2700 1 -- 172.21.15.115:0/611791493 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a80165670 con 0x7f6a80064350 2023-11-30T17:07:00.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.672+0000 7f6a677fe700 1 -- 172.21.15.115:0/611791493 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f6a7001b660 con 0x7f6a80064350 2023-11-30T17:07:00.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.672+0000 7f6a677fe700 1 -- 172.21.15.115:0/611791493 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7f6a700129a0 con 0x7f6a80064350 2023-11-30T17:07:00.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.673+0000 7f6a860d2700 1 -- 172.21.15.115:0/611791493 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a800a8a00 con 0x7f6a80064350 2023-11-30T17:07:00.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.675+0000 7f6a677fe700 1 -- 172.21.15.115:0/611791493 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f6a7003ae50 con 0x7f6a80064350 2023-11-30T17:07:00.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.754+0000 7f6a860d2700 1 -- 172.21.15.115:0/611791493 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6a1cc107-899d-44da-b7b4-29e656ee7880", "id": 5} v 0) v1 -- 0x7f6a800b0740 con 0x7f6a80064350 2023-11-30T17:07:00.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.765+0000 7f6a677fe700 1 -- 172.21.15.115:0/611791493 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6a1cc107-899d-44da-b7b4-29e656ee7880", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6a70029030 con 0x7f6a80064350 2023-11-30T17:07:00.767 INFO:teuthology.orchestra.run.smithi115.stdout:5 2023-11-30T17:07:00.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.766+0000 7f6a860d2700 1 -- 172.21.15.115:0/611791493 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a80064350 msgr2=0x7f6a80157400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:00.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.766+0000 7f6a860d2700 1 --2- 172.21.15.115:0/611791493 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a80064350 0x7f6a80157400 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f6a7000ea20 tx=0x7f6a70009060).stop 2023-11-30T17:07:00.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.766+0000 7f6a860d2700 1 -- 172.21.15.115:0/611791493 shutdown_connections 2023-11-30T17:07:00.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.766+0000 7f6a860d2700 1 --2- 172.21.15.115:0/611791493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a800c6190 0x7f6a80164490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.766+0000 7f6a860d2700 1 --2- 172.21.15.115:0/611791493 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a80064350 0x7f6a80157400 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.766+0000 7f6a860d2700 1 --2- 172.21.15.115:0/611791493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a80098d10 0x7f6a800a9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.766+0000 7f6a860d2700 1 -- 172.21.15.115:0/611791493 >> 172.21.15.115:0/611791493 conn(0x7f6a800cb310 msgr2=0x7f6a80152190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:00.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.766+0000 7f6a860d2700 1 -- 172.21.15.115:0/611791493 shutdown_connections 2023-11-30T17:07:00.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.766+0000 7f6a860d2700 1 -- 172.21.15.115:0/611791493 wait complete. 2023-11-30T17:07:00.779 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new e974c62c-9567-46b8-b70c-2ae47a55482e 6 2023-11-30T17:07:00.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.891+0000 7f9f4b9e0700 1 Processor -- start 2023-11-30T17:07:00.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.892+0000 7f9f4b9e0700 1 -- start start 2023-11-30T17:07:00.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.892+0000 7f9f4b9e0700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9f441547f0 0x7f9f440a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:00.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.892+0000 7f9f4b9e0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f44062700 0x7f9f44062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:00.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.892+0000 7f9f4b9e0700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f440630a0 con 0x7f9f440c86f0 2023-11-30T17:07:00.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.892+0000 7f9f4b9e0700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f440c7e30 con 0x7f9f441547f0 2023-11-30T17:07:00.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.892+0000 7f9f4b9e0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f440bcf40 con 0x7f9f44062700 2023-11-30T17:07:00.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.893+0000 7f9f49f7d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f44062700 0x7f9f44062bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:00.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.893+0000 7f9f48f7b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f9f440c86f0 0x7f9f440c6fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51684/0 (socket says 172.21.15.115:51684) 2023-11-30T17:07:00.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.893+0000 7f9f48f7b700 1 -- 172.21.15.115:0/1928440678 learned_addr learned my addr 172.21.15.115:0/1928440678 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-11-30T17:07:00.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.893+0000 7f9f4977c700 1 --2- 172.21.15.115:0/1928440678 >> v2:172.21.15.49:3300/0 conn(0x7f9f441547f0 0x7f9f440a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:00.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.893+0000 7f9f3bfff700 1 -- 172.21.15.115:0/1928440678 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3998315991 0 0) 0x7f9f40001110 con 0x7f9f440c86f0 2023-11-30T17:07:00.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.893+0000 7f9f49f7d700 1 -- 172.21.15.115:0/1928440678 >> v2:172.21.15.49:3300/0 conn(0x7f9f441547f0 msgr2=0x7f9f440a72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:00.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.893+0000 7f9f49f7d700 1 --2- 172.21.15.115:0/1928440678 >> v2:172.21.15.49:3300/0 conn(0x7f9f441547f0 0x7f9f440a72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.893+0000 7f9f49f7d700 1 -- 172.21.15.115:0/1928440678 >> v1:172.21.15.115:6789/0 conn(0x7f9f440c86f0 legacy=0x7f9f440c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:00.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.893+0000 7f9f49f7d700 1 -- 172.21.15.115:0/1928440678 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f440c6b20 con 0x7f9f44062700 2023-11-30T17:07:00.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.893+0000 7f9f49f7d700 1 --2- 172.21.15.115:0/1928440678 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f44062700 0x7f9f44062bb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f9f3c009e60 tx=0x7f9f3c009780).ready entity=mon.2 client_cookie=577b221dcc0e9701 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:00.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.893+0000 7f9f3bfff700 1 -- 172.21.15.115:0/1928440678 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c00e070 con 0x7f9f44062700 2023-11-30T17:07:00.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.893+0000 7f9f3bfff700 1 -- 172.21.15.115:0/1928440678 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3c00bb60 con 0x7f9f44062700 2023-11-30T17:07:00.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.893+0000 7f9f3bfff700 1 -- 172.21.15.115:0/1928440678 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c012410 con 0x7f9f44062700 2023-11-30T17:07:00.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.894+0000 7f9f4b9e0700 1 -- 172.21.15.115:0/1928440678 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f44062700 msgr2=0x7f9f44062bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:00.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.894+0000 7f9f4b9e0700 1 --2- 172.21.15.115:0/1928440678 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f44062700 0x7f9f44062bb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f9f3c009e60 tx=0x7f9f3c009780).stop 2023-11-30T17:07:00.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.894+0000 7f9f4b9e0700 1 -- 172.21.15.115:0/1928440678 shutdown_connections 2023-11-30T17:07:00.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.894+0000 7f9f4b9e0700 1 --2- 172.21.15.115:0/1928440678 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f44062700 0x7f9f44062bb0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.894+0000 7f9f4b9e0700 1 --2- 172.21.15.115:0/1928440678 >> v2:172.21.15.49:3300/0 conn(0x7f9f441547f0 0x7f9f440a72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.894+0000 7f9f4b9e0700 1 -- 172.21.15.115:0/1928440678 >> 172.21.15.115:0/1928440678 conn(0x7f9f440642d0 msgr2=0x7f9f440c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:00.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.894+0000 7f9f4b9e0700 1 -- 172.21.15.115:0/1928440678 shutdown_connections 2023-11-30T17:07:00.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.894+0000 7f9f4b9e0700 1 -- 172.21.15.115:0/1928440678 wait complete. 2023-11-30T17:07:00.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.895+0000 7f9f4b9e0700 1 Processor -- start 2023-11-30T17:07:00.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.895+0000 7f9f4b9e0700 1 -- start start 2023-11-30T17:07:00.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.896+0000 7f9f4b9e0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f44062700 0x7f9f4414b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:00.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.896+0000 7f9f4b9e0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f440c86f0 0x7f9f44153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:00.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.896+0000 7f9f4b9e0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f441547f0 0x7f9f440a8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:00.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.896+0000 7f9f4b9e0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f44153fc0 con 0x7f9f441547f0 2023-11-30T17:07:00.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.896+0000 7f9f4b9e0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4414c830 con 0x7f9f44062700 2023-11-30T17:07:00.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.896+0000 7f9f4b9e0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4414bf00 con 0x7f9f440c86f0 2023-11-30T17:07:00.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.896+0000 7f9f48f7b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f440c86f0 0x7f9f44153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:00.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.896+0000 7f9f4977c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f44062700 0x7f9f4414b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:00.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.896+0000 7f9f4977c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f44062700 0x7f9f4414b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60736/0 (socket says 172.21.15.115:60736) 2023-11-30T17:07:00.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.896+0000 7f9f48f7b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f440c86f0 0x7f9f44153680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:42482/0 (socket says 172.21.15.115:42482) 2023-11-30T17:07:00.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.896+0000 7f9f48f7b700 1 -- 172.21.15.115:0/2303324946 learned_addr learned my addr 172.21.15.115:0/2303324946 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-11-30T17:07:00.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.896+0000 7f9f49f7d700 1 --2- 172.21.15.115:0/2303324946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f441547f0 0x7f9f440a8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:00.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.896+0000 7f9f48f7b700 1 -- 172.21.15.115:0/2303324946 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f44062700 msgr2=0x7f9f4414b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:00.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.896+0000 7f9f48f7b700 1 --2- 172.21.15.115:0/2303324946 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f44062700 0x7f9f4414b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.896+0000 7f9f48f7b700 1 -- 172.21.15.115:0/2303324946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f441547f0 msgr2=0x7f9f440a8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:00.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.896+0000 7f9f48f7b700 1 --2- 172.21.15.115:0/2303324946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f441547f0 0x7f9f440a8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.896+0000 7f9f48f7b700 1 -- 172.21.15.115:0/2303324946 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3c009a20 con 0x7f9f440c86f0 2023-11-30T17:07:00.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.896+0000 7f9f4977c700 1 --2- 172.21.15.115:0/2303324946 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f44062700 0x7f9f4414b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:07:00.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.896+0000 7f9f48f7b700 1 --2- 172.21.15.115:0/2303324946 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f440c86f0 0x7f9f44153680 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f9f4000c490 tx=0x7f9f40007e60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:00.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.896+0000 7f9f397fa700 1 -- 172.21.15.115:0/2303324946 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f400070d0 con 0x7f9f440c86f0 2023-11-30T17:07:00.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.896+0000 7f9f397fa700 1 -- 172.21.15.115:0/2303324946 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f40007230 con 0x7f9f440c86f0 2023-11-30T17:07:00.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.896+0000 7f9f397fa700 1 -- 172.21.15.115:0/2303324946 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f400075d0 con 0x7f9f440c86f0 2023-11-30T17:07:00.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.896+0000 7f9f4b9e0700 1 -- 172.21.15.115:0/2303324946 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f4414c1e0 con 0x7f9f440c86f0 2023-11-30T17:07:00.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.897+0000 7f9f4b9e0700 1 -- 172.21.15.115:0/2303324946 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4414b9c0 con 0x7f9f440c86f0 2023-11-30T17:07:00.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.897+0000 7f9f397fa700 1 -- 172.21.15.115:0/2303324946 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f9f40013450 con 0x7f9f440c86f0 2023-11-30T17:07:00.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.897+0000 7f9f397fa700 1 -- 172.21.15.115:0/2303324946 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7f9f40005e20 con 0x7f9f440c86f0 2023-11-30T17:07:00.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.897+0000 7f9f4b9e0700 1 -- 172.21.15.115:0/2303324946 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f4406c860 con 0x7f9f440c86f0 2023-11-30T17:07:00.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.900+0000 7f9f397fa700 1 -- 172.21.15.115:0/2303324946 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f9f440630a0 con 0x7f9f440c86f0 2023-11-30T17:07:00.906 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:07:00.905+0000 7f9aad6cf680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T17:07:00.947 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:07:00.945+0000 7fa7c1c7a680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T17:07:00.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.981+0000 7f9f4b9e0700 1 -- 172.21.15.115:0/2303324946 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e974c62c-9567-46b8-b70c-2ae47a55482e", "id": 6} v 0) v1 -- 0x7f9f44065a60 con 0x7f9f440c86f0 2023-11-30T17:07:00.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.989+0000 7f9f397fa700 1 -- 172.21.15.115:0/2303324946 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e974c62c-9567-46b8-b70c-2ae47a55482e", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9f400138e0 con 0x7f9f440c86f0 2023-11-30T17:07:00.991 INFO:teuthology.orchestra.run.smithi115.stdout:6 2023-11-30T17:07:00.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.990+0000 7f9f4b9e0700 1 -- 172.21.15.115:0/2303324946 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f440c86f0 msgr2=0x7f9f44153680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:00.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.990+0000 7f9f4b9e0700 1 --2- 172.21.15.115:0/2303324946 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f440c86f0 0x7f9f44153680 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f9f4000c490 tx=0x7f9f40007e60).stop 2023-11-30T17:07:00.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.990+0000 7f9f4b9e0700 1 -- 172.21.15.115:0/2303324946 shutdown_connections 2023-11-30T17:07:00.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.990+0000 7f9f4b9e0700 1 --2- 172.21.15.115:0/2303324946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f441547f0 0x7f9f440a8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.990+0000 7f9f4b9e0700 1 --2- 172.21.15.115:0/2303324946 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f44062700 0x7f9f4414b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.990+0000 7f9f4b9e0700 1 --2- 172.21.15.115:0/2303324946 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f440c86f0 0x7f9f44153680 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:00.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.990+0000 7f9f4b9e0700 1 -- 172.21.15.115:0/2303324946 >> 172.21.15.115:0/2303324946 conn(0x7f9f440642d0 msgr2=0x7f9f44066d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:00.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.990+0000 7f9f4b9e0700 1 -- 172.21.15.115:0/2303324946 shutdown_connections 2023-11-30T17:07:00.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:00.990+0000 7f9f4b9e0700 1 -- 172.21.15.115:0/2303324946 wait complete. 2023-11-30T17:07:01.004 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 39b0a658-7017-4637-99b1-b60ce3583779 7 2023-11-30T17:07:01.111 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:07:01.110+0000 7f9aad6cf680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T17:07:01.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.119+0000 7f178f8bd700 1 Processor -- start 2023-11-30T17:07:01.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.120+0000 7f178f8bd700 1 -- start start 2023-11-30T17:07:01.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.121+0000 7f178f8bd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f17880bcdd0 0x7f178814eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:01.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.121+0000 7f178f8bd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1788062770 0x7f1788062be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:01.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.121+0000 7f178f8bd700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17880634a0 con 0x7f178814eb00 2023-11-30T17:07:01.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.121+0000 7f178f8bd700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1788137d90 con 0x7f17880bcdd0 2023-11-30T17:07:01.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.121+0000 7f178f8bd700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1788063780 con 0x7f1788062770 2023-11-30T17:07:01.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.121+0000 7f178de5a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1788062770 0x7f1788062be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:01.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.121+0000 7f178ce58700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f17880bcdd0 0x7f178814eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:01.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.121+0000 7f178de5a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1788062770 0x7f1788062be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:42496/0 (socket says 172.21.15.115:42496) 2023-11-30T17:07:01.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.121+0000 7f178ce58700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f17880bcdd0 0x7f178814eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60742/0 (socket says 172.21.15.115:60742) 2023-11-30T17:07:01.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.121+0000 7f178de5a700 1 -- 172.21.15.115:0/147873536 learned_addr learned my addr 172.21.15.115:0/147873536 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-11-30T17:07:01.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.121+0000 7f178ce58700 1 -- 172.21.15.115:0/147873536 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1788062770 msgr2=0x7f1788062be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:01.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.121+0000 7f178ce58700 1 --2- 172.21.15.115:0/147873536 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1788062770 0x7f1788062be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:01.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.121+0000 7f178ce58700 1 -- 172.21.15.115:0/147873536 >> v1:172.21.15.49:6789/0 conn(0x7f178814eb00 legacy=0x7f17880bc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:01.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.121+0000 7f178ce58700 1 -- 172.21.15.115:0/147873536 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1788063a60 con 0x7f17880bcdd0 2023-11-30T17:07:01.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.121+0000 7f178de5a700 1 --2- 172.21.15.115:0/147873536 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1788062770 0x7f1788062be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:07:01.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.121+0000 7f178ce58700 1 --2- 172.21.15.115:0/147873536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17880bcdd0 0x7f178814eee0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f1784006fd0 tx=0x7f1784006f40).ready entity=mon.1 client_cookie=89f4a1438f3e8110 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:01.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.121+0000 7f177ffff700 1 -- 172.21.15.115:0/147873536 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1784005880 con 0x7f17880bcdd0 2023-11-30T17:07:01.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.121+0000 7f177ffff700 1 -- 172.21.15.115:0/147873536 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17840059e0 con 0x7f17880bcdd0 2023-11-30T17:07:01.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.121+0000 7f177ffff700 1 -- 172.21.15.115:0/147873536 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1784005d60 con 0x7f17880bcdd0 2023-11-30T17:07:01.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.122+0000 7f178f8bd700 1 -- 172.21.15.115:0/147873536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17880bcdd0 msgr2=0x7f178814eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:01.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.122+0000 7f178f8bd700 1 --2- 172.21.15.115:0/147873536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17880bcdd0 0x7f178814eee0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f1784006fd0 tx=0x7f1784006f40).stop 2023-11-30T17:07:01.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.122+0000 7f178f8bd700 1 -- 172.21.15.115:0/147873536 shutdown_connections 2023-11-30T17:07:01.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.122+0000 7f178f8bd700 1 --2- 172.21.15.115:0/147873536 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1788062770 0x7f1788062be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:01.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.122+0000 7f178f8bd700 1 --2- 172.21.15.115:0/147873536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17880bcdd0 0x7f178814eee0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:01.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.122+0000 7f178f8bd700 1 -- 172.21.15.115:0/147873536 >> 172.21.15.115:0/147873536 conn(0x7f17880c8230 msgr2=0x7f17880c4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:01.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.122+0000 7f178f8bd700 1 -- 172.21.15.115:0/147873536 shutdown_connections 2023-11-30T17:07:01.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.122+0000 7f178f8bd700 1 -- 172.21.15.115:0/147873536 wait complete. 2023-11-30T17:07:01.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.123+0000 7f178f8bd700 1 Processor -- start 2023-11-30T17:07:01.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.123+0000 7f178f8bd700 1 -- start start 2023-11-30T17:07:01.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.124+0000 7f178f8bd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1788062770 0x7f178814d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:01.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.124+0000 7f178f8bd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17880bcdd0 0x7f17880a7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:01.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.124+0000 7f178f8bd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f178814eb00 0x7f17880a7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:01.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.124+0000 7f178f8bd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17880bef10 con 0x7f17880bcdd0 2023-11-30T17:07:01.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.124+0000 7f178f8bd700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17880bf140 con 0x7f1788062770 2023-11-30T17:07:01.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.124+0000 7f178f8bd700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17880bf6c0 con 0x7f178814eb00 2023-11-30T17:07:01.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.124+0000 7f178d659700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1788062770 0x7f178814d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:01.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.124+0000 7f178de5a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f178814eb00 0x7f17880a7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:01.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.124+0000 7f178de5a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f178814eb00 0x7f17880a7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:42506/0 (socket says 172.21.15.115:42506) 2023-11-30T17:07:01.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.124+0000 7f178d659700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1788062770 0x7f178814d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60754/0 (socket says 172.21.15.115:60754) 2023-11-30T17:07:01.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.124+0000 7f178de5a700 1 -- 172.21.15.115:0/2748278522 learned_addr learned my addr 172.21.15.115:0/2748278522 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-11-30T17:07:01.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.124+0000 7f178ce58700 1 --2- 172.21.15.115:0/2748278522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17880bcdd0 0x7f17880a7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:01.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.124+0000 7f178d659700 1 -- 172.21.15.115:0/2748278522 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f178814eb00 msgr2=0x7f17880a7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:01.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.124+0000 7f178d659700 1 --2- 172.21.15.115:0/2748278522 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f178814eb00 0x7f17880a7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:01.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.124+0000 7f178d659700 1 -- 172.21.15.115:0/2748278522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17880bcdd0 msgr2=0x7f17880a7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:01.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.124+0000 7f178d659700 1 --2- 172.21.15.115:0/2748278522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17880bcdd0 0x7f17880a7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:01.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.124+0000 7f178d659700 1 -- 172.21.15.115:0/2748278522 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1780009ae0 con 0x7f1788062770 2023-11-30T17:07:01.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.124+0000 7f178de5a700 1 --2- 172.21.15.115:0/2748278522 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f178814eb00 0x7f17880a7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:07:01.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.125+0000 7f178d659700 1 --2- 172.21.15.115:0/2748278522 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1788062770 0x7f178814d910 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f177800c440 tx=0x7f1778007d90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:01.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.125+0000 7f177d7fa700 1 -- 172.21.15.115:0/2748278522 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1778007020 con 0x7f1788062770 2023-11-30T17:07:01.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.125+0000 7f177d7fa700 1 -- 172.21.15.115:0/2748278522 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1778007180 con 0x7f1788062770 2023-11-30T17:07:01.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.125+0000 7f178f8bd700 1 -- 172.21.15.115:0/2748278522 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1784009250 con 0x7f1788062770 2023-11-30T17:07:01.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.125+0000 7f177d7fa700 1 -- 172.21.15.115:0/2748278522 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1778007520 con 0x7f1788062770 2023-11-30T17:07:01.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.125+0000 7f178f8bd700 1 -- 172.21.15.115:0/2748278522 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17880a9e50 con 0x7f1788062770 2023-11-30T17:07:01.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.125+0000 7f177d7fa700 1 -- 172.21.15.115:0/2748278522 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f1778006b60 con 0x7f1788062770 2023-11-30T17:07:01.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.125+0000 7f177d7fa700 1 -- 172.21.15.115:0/2748278522 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7f1778012e00 con 0x7f1788062770 2023-11-30T17:07:01.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.126+0000 7f178f8bd700 1 -- 172.21.15.115:0/2748278522 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f178806c860 con 0x7f1788062770 2023-11-30T17:07:01.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.128+0000 7f177d7fa700 1 -- 172.21.15.115:0/2748278522 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f1778020060 con 0x7f1788062770 2023-11-30T17:07:01.150 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:07:01.149+0000 7fa7c1c7a680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T17:07:01.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.208+0000 7f178f8bd700 1 -- 172.21.15.115:0/2748278522 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd new", "uuid": "39b0a658-7017-4637-99b1-b60ce3583779", "id": 7} v 0) v1 -- 0x7f17880c4ac0 con 0x7f1788062770 2023-11-30T17:07:01.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.211+0000 7f177d7fa700 1 -- 172.21.15.115:0/2748278522 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "39b0a658-7017-4637-99b1-b60ce3583779", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f17780290b0 con 0x7f1788062770 2023-11-30T17:07:01.213 INFO:teuthology.orchestra.run.smithi115.stdout:7 2023-11-30T17:07:01.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.212+0000 7f178f8bd700 1 -- 172.21.15.115:0/2748278522 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1788062770 msgr2=0x7f178814d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:01.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.212+0000 7f178f8bd700 1 --2- 172.21.15.115:0/2748278522 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1788062770 0x7f178814d910 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f177800c440 tx=0x7f1778007d90).stop 2023-11-30T17:07:01.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.212+0000 7f178f8bd700 1 -- 172.21.15.115:0/2748278522 shutdown_connections 2023-11-30T17:07:01.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.212+0000 7f178f8bd700 1 --2- 172.21.15.115:0/2748278522 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f178814eb00 0x7f17880a7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:01.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.212+0000 7f178f8bd700 1 --2- 172.21.15.115:0/2748278522 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1788062770 0x7f178814d910 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:01.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.212+0000 7f178f8bd700 1 --2- 172.21.15.115:0/2748278522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17880bcdd0 0x7f17880a7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:01.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.212+0000 7f178f8bd700 1 -- 172.21.15.115:0/2748278522 >> 172.21.15.115:0/2748278522 conn(0x7f17880c8230 msgr2=0x7f17880c2910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:01.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.212+0000 7f178f8bd700 1 -- 172.21.15.115:0/2748278522 shutdown_connections 2023-11-30T17:07:01.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:01.212+0000 7f178f8bd700 1 -- 172.21.15.115:0/2748278522 wait complete. 2023-11-30T17:07:01.229 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-30T17:07:01.230 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-30T17:07:01.232 INFO:tasks.ceph.osd.0:Started 2023-11-30T17:07:01.232 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-30T17:07:01.232 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-30T17:07:01.235 INFO:tasks.ceph.osd.1:Started 2023-11-30T17:07:01.235 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-30T17:07:01.235 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-30T17:07:01.238 INFO:tasks.ceph.osd.2:Started 2023-11-30T17:07:01.238 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-30T17:07:01.238 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-30T17:07:01.240 INFO:tasks.ceph.osd.3:Started 2023-11-30T17:07:01.240 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-30T17:07:01.240 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-30T17:07:01.243 INFO:tasks.ceph.osd.4:Started 2023-11-30T17:07:01.243 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-30T17:07:01.243 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-30T17:07:01.245 INFO:tasks.ceph.osd.5:Started 2023-11-30T17:07:01.245 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-30T17:07:01.245 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-30T17:07:01.247 INFO:tasks.ceph.osd.6:Started 2023-11-30T17:07:01.247 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-30T17:07:01.247 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-30T17:07:01.250 INFO:tasks.ceph.osd.7:Started 2023-11-30T17:07:01.250 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:07:01.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.386+0000 7f1622a86700 1 Processor -- start 2023-11-30T17:07:01.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.386+0000 7f1622a86700 1 -- start start 2023-11-30T17:07:01.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.387+0000 7f1622a86700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f161c1542d0 0x7f161c0697f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:01.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.387+0000 7f1622a86700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f161c065760 con 0x7f161c062e10 2023-11-30T17:07:01.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.387+0000 7f1622a86700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f161c0c3250 con 0x7f161c069ce0 2023-11-30T17:07:01.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.387+0000 7f1622a86700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f161c06a340 con 0x7f161c1542d0 2023-11-30T17:07:01.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.387+0000 7f1621023700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f161c062e10 0x7f161c0661b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44868/0 (socket says 172.21.15.49:44868) 2023-11-30T17:07:01.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.387+0000 7f1621023700 1 -- 172.21.15.49:0/367130833 learned_addr learned my addr 172.21.15.49:0/367130833 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:01.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.387+0000 7f1620822700 1 --2- 172.21.15.49:0/367130833 >> v2:172.21.15.115:3300/0 conn(0x7f161c1542d0 0x7f161c0697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:01.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.388+0000 7f161b7fe700 1 -- 172.21.15.49:0/367130833 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2024238103 0 0) 0x7f161c065760 con 0x7f161c062e10 2023-11-30T17:07:01.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.388+0000 7f161b7fe700 1 -- 172.21.15.49:0/367130833 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16080033f0 con 0x7f161c062e10 2023-11-30T17:07:01.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.388+0000 7f1620822700 1 -- 172.21.15.49:0/367130833 >> v1:172.21.15.115:6789/0 conn(0x7f161c069ce0 legacy=0x7f161c062700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:01.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.388+0000 7f1620822700 1 -- 172.21.15.49:0/367130833 >> v1:172.21.15.49:6789/0 conn(0x7f161c062e10 legacy=0x7f161c0661b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:01.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.388+0000 7f1620822700 1 -- 172.21.15.49:0/367130833 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161c06a620 con 0x7f161c1542d0 2023-11-30T17:07:01.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.388+0000 7f1620822700 1 --2- 172.21.15.49:0/367130833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f161c1542d0 0x7f161c0697f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f1614009e60 tx=0x7f1614009780).ready entity=mon.1 client_cookie=c6766a5df6ac353c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:01.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.388+0000 7f161b7fe700 1 -- 172.21.15.49:0/367130833 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161400e070 con 0x7f161c1542d0 2023-11-30T17:07:01.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.388+0000 7f161b7fe700 1 -- 172.21.15.49:0/367130833 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161400bb60 con 0x7f161c1542d0 2023-11-30T17:07:01.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.388+0000 7f161b7fe700 1 -- 172.21.15.49:0/367130833 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1614012410 con 0x7f161c1542d0 2023-11-30T17:07:01.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.389+0000 7f1622a86700 1 -- 172.21.15.49:0/367130833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f161c1542d0 msgr2=0x7f161c0697f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:01.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.389+0000 7f1622a86700 1 --2- 172.21.15.49:0/367130833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f161c1542d0 0x7f161c0697f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f1614009e60 tx=0x7f1614009780).stop 2023-11-30T17:07:01.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.389+0000 7f1622a86700 1 -- 172.21.15.49:0/367130833 shutdown_connections 2023-11-30T17:07:01.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.389+0000 7f1622a86700 1 --2- 172.21.15.49:0/367130833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f161c1542d0 0x7f161c0697f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:01.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.389+0000 7f1622a86700 1 -- 172.21.15.49:0/367130833 >> 172.21.15.49:0/367130833 conn(0x7f161c0c7fd0 msgr2=0x7f161c0c83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:01.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.389+0000 7f1622a86700 1 -- 172.21.15.49:0/367130833 shutdown_connections 2023-11-30T17:07:01.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.389+0000 7f1622a86700 1 -- 172.21.15.49:0/367130833 wait complete. 2023-11-30T17:07:01.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.390+0000 7f1622a86700 1 Processor -- start 2023-11-30T17:07:01.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.390+0000 7f1622a86700 1 -- start start 2023-11-30T17:07:01.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.391+0000 7f1622a86700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f161c062e10 0x7f161c0ac3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:01.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.391+0000 7f1622a86700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f161c069ce0 0x7f161c0a9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:01.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.391+0000 7f1622a86700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f161c1542d0 0x7f161c0aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:01.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.391+0000 7f1622a86700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161c0aa5e0 con 0x7f161c069ce0 2023-11-30T17:07:01.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.391+0000 7f1622a86700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161c14f420 con 0x7f161c062e10 2023-11-30T17:07:01.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.391+0000 7f1622a86700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161c0bf110 con 0x7f161c1542d0 2023-11-30T17:07:01.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.391+0000 7f161bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f161c069ce0 0x7f161c0a9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:01.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.391+0000 7f1620822700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f161c062e10 0x7f161c0ac3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:01.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.391+0000 7f161bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f161c069ce0 0x7f161c0a9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47952/0 (socket says 172.21.15.49:47952) 2023-11-30T17:07:01.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.391+0000 7f1620822700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f161c062e10 0x7f161c0ac3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:60804/0 (socket says 172.21.15.49:60804) 2023-11-30T17:07:01.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.391+0000 7f161bfff700 1 -- 172.21.15.49:0/727065114 learned_addr learned my addr 172.21.15.49:0/727065114 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:01.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.391+0000 7f1621023700 1 --2- 172.21.15.49:0/727065114 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f161c1542d0 0x7f161c0aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:01.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.391+0000 7f161bfff700 1 -- 172.21.15.49:0/727065114 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f161c1542d0 msgr2=0x7f161c0aa0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:01.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.391+0000 7f161bfff700 1 --2- 172.21.15.49:0/727065114 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f161c1542d0 0x7f161c0aa0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:01.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.391+0000 7f161bfff700 1 -- 172.21.15.49:0/727065114 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f161c062e10 msgr2=0x7f161c0ac3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:01.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.391+0000 7f161bfff700 1 --2- 172.21.15.49:0/727065114 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f161c062e10 0x7f161c0ac3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:01.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.391+0000 7f161bfff700 1 -- 172.21.15.49:0/727065114 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1614009a20 con 0x7f161c069ce0 2023-11-30T17:07:01.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.391+0000 7f161bfff700 1 --2- 172.21.15.49:0/727065114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f161c069ce0 0x7f161c0a9c00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f160400c4c0 tx=0x7f1604007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:01.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.391+0000 7f1618ff9700 1 -- 172.21.15.49:0/727065114 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160400ce70 con 0x7f161c069ce0 2023-11-30T17:07:01.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.391+0000 7f1618ff9700 1 -- 172.21.15.49:0/727065114 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1604001e90 con 0x7f161c069ce0 2023-11-30T17:07:01.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.391+0000 7f1622a86700 1 -- 172.21.15.49:0/727065114 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f161c0bf3b0 con 0x7f161c069ce0 2023-11-30T17:07:01.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.391+0000 7f1618ff9700 1 -- 172.21.15.49:0/727065114 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1604007250 con 0x7f161c069ce0 2023-11-30T17:07:01.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.391+0000 7f1622a86700 1 -- 172.21.15.49:0/727065114 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f161c0bf740 con 0x7f161c069ce0 2023-11-30T17:07:01.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.392+0000 7f1618ff9700 1 -- 172.21.15.49:0/727065114 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f1604006900 con 0x7f161c069ce0 2023-11-30T17:07:01.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.392+0000 7f1618ff9700 1 -- 172.21.15.49:0/727065114 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f160400fd00 con 0x7f161c069ce0 2023-11-30T17:07:01.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.393+0000 7f1622a86700 1 -- 172.21.15.49:0/727065114 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f161c0bfbb0 con 0x7f161c069ce0 2023-11-30T17:07:01.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.395+0000 7f1618ff9700 1 -- 172.21.15.49:0/727065114 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f161c0bfbb0 con 0x7f161c069ce0 2023-11-30T17:07:01.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.481+0000 7f1622a86700 1 -- 172.21.15.49:0/727065114 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f161c165470 con 0x7f161c069ce0 2023-11-30T17:07:01.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.482+0000 7f1618ff9700 1 -- 172.21.15.49:0/727065114 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7045 (secure 0 0 0) 0x7f160400f600 con 0x7f161c069ce0 2023-11-30T17:07:01.484 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:01.484 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":10,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:07:01.209781+0000","last_up_change":"0.000000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:07:01.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.483+0000 7f1622a86700 1 -- 172.21.15.49:0/727065114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f161c069ce0 msgr2=0x7f161c0a9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:01.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.483+0000 7f1622a86700 1 --2- 172.21.15.49:0/727065114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f161c069ce0 0x7f161c0a9c00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f160400c4c0 tx=0x7f1604007e00).stop 2023-11-30T17:07:01.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.483+0000 7f1622a86700 1 -- 172.21.15.49:0/727065114 shutdown_connections 2023-11-30T17:07:01.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.483+0000 7f1622a86700 1 --2- 172.21.15.49:0/727065114 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f161c1542d0 0x7f161c0aa0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:01.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.483+0000 7f1622a86700 1 --2- 172.21.15.49:0/727065114 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f161c062e10 0x7f161c0ac3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:01.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.483+0000 7f1622a86700 1 --2- 172.21.15.49:0/727065114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f161c069ce0 0x7f161c0a9c00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:01.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.483+0000 7f1622a86700 1 -- 172.21.15.49:0/727065114 >> 172.21.15.49:0/727065114 conn(0x7f161c0c7fd0 msgr2=0x7f161c0a7070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:01.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.483+0000 7f1622a86700 1 -- 172.21.15.49:0/727065114 shutdown_connections 2023-11-30T17:07:01.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:01.483+0000 7f1622a86700 1 -- 172.21.15.49:0/727065114 wait complete. 2023-11-30T17:07:01.496 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-30T17:07:01.497 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-30T17:07:01.826 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:07:01.824+0000 7f9aad6cf680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T17:07:01.835 INFO:tasks.ceph.osd.2.smithi049.stderr:2023-11-30T17:07:01.833+0000 7f1d42394380 -1 Falling back to public interface 2023-11-30T17:07:01.854 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-11-30T17:07:01.852+0000 7fe3e09ef380 -1 Falling back to public interface 2023-11-30T17:07:01.854 INFO:tasks.ceph.osd.1.smithi049.stderr:2023-11-30T17:07:01.853+0000 7f9f21847380 -1 Falling back to public interface 2023-11-30T17:07:01.861 INFO:tasks.ceph.osd.3.smithi049.stderr:2023-11-30T17:07:01.859+0000 7f764dc98380 -1 Falling back to public interface 2023-11-30T17:07:01.862 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-11-30T17:07:01.857+0000 7feadac2d380 -1 Falling back to public interface 2023-11-30T17:07:01.862 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-11-30T17:07:01.857+0000 7fce7986f380 -1 Falling back to public interface 2023-11-30T17:07:01.862 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-11-30T17:07:01.859+0000 7fead4df2700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6815/0: (98) Address already in use 2023-11-30T17:07:01.864 INFO:tasks.ceph.osd.0.smithi049.stderr:2023-11-30T17:07:01.863+0000 7ff88bda7380 -1 Falling back to public interface 2023-11-30T17:07:01.872 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-11-30T17:07:01.871+0000 7fe8f5122380 -1 Falling back to public interface 2023-11-30T17:07:01.900 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:07:01.899+0000 7f9aad6cf680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T17:07:01.915 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:07:01.913+0000 7fa7c1c7a680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T17:07:01.979 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:07:01.978+0000 7f9aad6cf680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T17:07:01.987 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:07:01.986+0000 7fa7c1c7a680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T17:07:02.070 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:07:02.068+0000 7fa7c1c7a680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T17:07:02.129 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:07:02.127+0000 7f9aad6cf680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T17:07:02.201 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:07:02.200+0000 7f9aad6cf680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T17:07:02.225 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:07:02.223+0000 7fa7c1c7a680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T17:07:02.298 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:07:02.297+0000 7fa7c1c7a680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T17:07:02.302 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-30T17:07:02.317 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:07:02.315+0000 7f9aad6cf680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T17:07:02.411 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.409+0000 7efd741f5700 1 Processor -- start 2023-11-30T17:07:02.411 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.410+0000 7efd741f5700 1 -- start start 2023-11-30T17:07:02.413 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.411+0000 7efd741f5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efd6c0c1220 0x7efd6c15f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:02.413 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.411+0000 7efd741f5700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd6c0a8570 con 0x7efd6c155790 2023-11-30T17:07:02.413 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.411+0000 7efd741f5700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd6c158b70 con 0x7efd6c1543a0 2023-11-30T17:07:02.414 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.411+0000 7efd741f5700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd6c158e50 con 0x7efd6c0c1220 2023-11-30T17:07:02.414 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.411+0000 7efd72792700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efd6c0c1220 0x7efd6c15f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:02.414 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.411+0000 7efd71790700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7efd6c155790 0x7efd6c0c0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44870/0 (socket says 172.21.15.49:44870) 2023-11-30T17:07:02.414 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.411+0000 7efd71790700 1 -- 172.21.15.49:0/3257770194 learned_addr learned my addr 172.21.15.49:0/3257770194 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:02.414 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.411+0000 7efd72792700 1 -- 172.21.15.49:0/3257770194 >> v1:172.21.15.115:6789/0 conn(0x7efd6c1543a0 legacy=0x7efd6c1580f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:02.414 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.411+0000 7efd72792700 1 -- 172.21.15.49:0/3257770194 >> v1:172.21.15.49:6789/0 conn(0x7efd6c155790 legacy=0x7efd6c0c0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:02.414 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.411+0000 7efd72792700 1 -- 172.21.15.49:0/3257770194 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6c0a8200 con 0x7efd6c0c1220 2023-11-30T17:07:02.414 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.411+0000 7efd70f8f700 1 -- 172.21.15.49:0/3257770194 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2486320606 0 0) 0x7efd6c0a8570 con 0x7efd6c155790 2023-11-30T17:07:02.414 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.411+0000 7efd72792700 1 --2- 172.21.15.49:0/3257770194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd6c0c1220 0x7efd6c15f490 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7efd64009e60 tx=0x7efd64009780).ready entity=mon.0 client_cookie=7b7eedcd2662acd3 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:02.414 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.411+0000 7efd70f8f700 1 -- 172.21.15.49:0/3257770194 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6400e070 con 0x7efd6c0c1220 2023-11-30T17:07:02.414 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.411+0000 7efd70f8f700 1 -- 172.21.15.49:0/3257770194 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6400bc30 con 0x7efd6c0c1220 2023-11-30T17:07:02.414 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.411+0000 7efd70f8f700 1 -- 172.21.15.49:0/3257770194 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd64012410 con 0x7efd6c0c1220 2023-11-30T17:07:02.415 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.412+0000 7efd741f5700 1 -- 172.21.15.49:0/3257770194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd6c0c1220 msgr2=0x7efd6c15f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:02.415 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.412+0000 7efd741f5700 1 --2- 172.21.15.49:0/3257770194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd6c0c1220 0x7efd6c15f490 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7efd64009e60 tx=0x7efd64009780).stop 2023-11-30T17:07:02.415 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.412+0000 7efd741f5700 1 -- 172.21.15.49:0/3257770194 shutdown_connections 2023-11-30T17:07:02.415 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.412+0000 7efd741f5700 1 --2- 172.21.15.49:0/3257770194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd6c0c1220 0x7efd6c15f490 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:02.415 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.412+0000 7efd741f5700 1 -- 172.21.15.49:0/3257770194 >> 172.21.15.49:0/3257770194 conn(0x7efd6c084ff0 msgr2=0x7efd6c094910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:02.415 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.412+0000 7efd741f5700 1 -- 172.21.15.49:0/3257770194 shutdown_connections 2023-11-30T17:07:02.415 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.412+0000 7efd741f5700 1 -- 172.21.15.49:0/3257770194 wait complete. 2023-11-30T17:07:02.418 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.413+0000 7efd741f5700 1 Processor -- start 2023-11-30T17:07:02.418 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.413+0000 7efd741f5700 1 -- start start 2023-11-30T17:07:02.418 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.414+0000 7efd741f5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd6c0c1220 0x7efd6c0ac810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:02.418 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.414+0000 7efd741f5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd6c1543a0 0x7efd6c167ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:02.418 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.414+0000 7efd741f5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd6c155790 0x7efd6c0c6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:02.418 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.414+0000 7efd741f5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c1682e0 con 0x7efd6c155790 2023-11-30T17:07:02.418 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.414+0000 7efd741f5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c1685c0 con 0x7efd6c1543a0 2023-11-30T17:07:02.418 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.414+0000 7efd741f5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c1688a0 con 0x7efd6c0c1220 2023-11-30T17:07:02.419 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.414+0000 7efd72792700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd6c155790 0x7efd6c0c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:02.419 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.414+0000 7efd72792700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd6c155790 0x7efd6c0c6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47970/0 (socket says 172.21.15.49:47970) 2023-11-30T17:07:02.419 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.414+0000 7efd72792700 1 -- 172.21.15.49:0/677642987 learned_addr learned my addr 172.21.15.49:0/677642987 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:02.419 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.414+0000 7efd71790700 1 --2- 172.21.15.49:0/677642987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd6c1543a0 0x7efd6c167ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:02.419 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.414+0000 7efd71f91700 1 --2- 172.21.15.49:0/677642987 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd6c0c1220 0x7efd6c0ac810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:02.419 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.414+0000 7efd72792700 1 -- 172.21.15.49:0/677642987 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd6c0c1220 msgr2=0x7efd6c0ac810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:02.419 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.414+0000 7efd72792700 1 --2- 172.21.15.49:0/677642987 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd6c0c1220 0x7efd6c0ac810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:02.419 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.414+0000 7efd72792700 1 -- 172.21.15.49:0/677642987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd6c1543a0 msgr2=0x7efd6c167ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:02.419 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.414+0000 7efd72792700 1 --2- 172.21.15.49:0/677642987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd6c1543a0 0x7efd6c167ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:02.419 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.414+0000 7efd72792700 1 -- 172.21.15.49:0/677642987 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd64009a20 con 0x7efd6c155790 2023-11-30T17:07:02.419 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.414+0000 7efd71f91700 1 --2- 172.21.15.49:0/677642987 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd6c0c1220 0x7efd6c0ac810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:02.419 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.415+0000 7efd72792700 1 --2- 172.21.15.49:0/677642987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd6c155790 0x7efd6c0c6960 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7efd6c06af20 tx=0x7efd64009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:02.419 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.415+0000 7efd61ffb700 1 -- 172.21.15.49:0/677642987 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6400b6f0 con 0x7efd6c155790 2023-11-30T17:07:02.420 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.415+0000 7efd61ffb700 1 -- 172.21.15.49:0/677642987 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd64013e00 con 0x7efd6c155790 2023-11-30T17:07:02.420 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.415+0000 7efd741f5700 1 -- 172.21.15.49:0/677642987 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd6c0ca390 con 0x7efd6c155790 2023-11-30T17:07:02.420 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.415+0000 7efd61ffb700 1 -- 172.21.15.49:0/677642987 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd64006a40 con 0x7efd6c155790 2023-11-30T17:07:02.420 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.415+0000 7efd741f5700 1 -- 172.21.15.49:0/677642987 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd6c0c9fb0 con 0x7efd6c155790 2023-11-30T17:07:02.420 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.415+0000 7efd61ffb700 1 -- 172.21.15.49:0/677642987 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7efd6401d890 con 0x7efd6c155790 2023-11-30T17:07:02.420 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.415+0000 7efd61ffb700 1 -- 172.21.15.49:0/677642987 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7efd64027b60 con 0x7efd6c155790 2023-11-30T17:07:02.420 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.416+0000 7efd741f5700 1 -- 172.21.15.49:0/677642987 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd6c0ca5d0 con 0x7efd6c155790 2023-11-30T17:07:02.421 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.420+0000 7efd61ffb700 1 -- 172.21.15.49:0/677642987 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7efd6c0ca5d0 con 0x7efd6c155790 2023-11-30T17:07:02.425 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:07:02.424+0000 7f9aad6cf680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:07:02.426 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:07:02.425+0000 7fa7c1c7a680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T17:07:02.491 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.489+0000 7efd741f5700 1 -- 172.21.15.49:0/677642987 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd6c06bd30 con 0x7efd6c155790 2023-11-30T17:07:02.491 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.490+0000 7efd61ffb700 1 -- 172.21.15.49:0/677642987 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7045 (secure 0 0 0) 0x7efd64017070 con 0x7efd6c155790 2023-11-30T17:07:02.492 INFO:teuthology.misc.health.smithi049.stdout: 2023-11-30T17:07:02.492 INFO:teuthology.misc.health.smithi049.stdout:{"epoch":10,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:07:01.209781+0000","last_up_change":"0.000000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:07:02.493 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.491+0000 7efd741f5700 1 -- 172.21.15.49:0/677642987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd6c155790 msgr2=0x7efd6c0c6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:02.494 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.491+0000 7efd741f5700 1 --2- 172.21.15.49:0/677642987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd6c155790 0x7efd6c0c6960 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7efd6c06af20 tx=0x7efd64009780).stop 2023-11-30T17:07:02.494 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.491+0000 7efd741f5700 1 -- 172.21.15.49:0/677642987 shutdown_connections 2023-11-30T17:07:02.494 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.491+0000 7efd741f5700 1 --2- 172.21.15.49:0/677642987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd6c155790 0x7efd6c0c6960 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:02.494 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.491+0000 7efd741f5700 1 --2- 172.21.15.49:0/677642987 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd6c0c1220 0x7efd6c0ac810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:02.494 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.491+0000 7efd741f5700 1 --2- 172.21.15.49:0/677642987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd6c1543a0 0x7efd6c167ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:02.494 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.491+0000 7efd741f5700 1 -- 172.21.15.49:0/677642987 >> 172.21.15.49:0/677642987 conn(0x7efd6c084ff0 msgr2=0x7efd6c157ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:02.495 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.491+0000 7efd741f5700 1 -- 172.21.15.49:0/677642987 shutdown_connections 2023-11-30T17:07:02.495 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:02.491+0000 7efd741f5700 1 -- 172.21.15.49:0/677642987 wait complete. 2023-11-30T17:07:02.504 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-30T17:07:02.542 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:07:02.540+0000 7fa7c1c7a680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:07:02.745 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:07:02.743+0000 7f9aad6cf680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T17:07:02.817 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:07:02.815+0000 7f9aad6cf680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T17:07:02.874 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:07:02.873+0000 7fa7c1c7a680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T17:07:02.949 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:07:02.947+0000 7fa7c1c7a680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T17:07:03.843 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:07:03.841+0000 7f9a638f2700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-30T17:07:03.844 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:07:03.842+0000 7f9a638f2700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-30T17:07:05.289 INFO:tasks.ceph.osd.2.smithi049.stderr:2023-11-30T17:07:05.287+0000 7f1d42394380 -1 osd.2 0 log_to_monitors {default=true} 2023-11-30T17:07:05.327 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-11-30T17:07:05.326+0000 7feadac2d380 -1 osd.5 0 log_to_monitors {default=true} 2023-11-30T17:07:05.336 INFO:tasks.ceph.osd.0.smithi049.stderr:2023-11-30T17:07:05.335+0000 7ff88bda7380 -1 osd.0 0 log_to_monitors {default=true} 2023-11-30T17:07:05.346 INFO:tasks.ceph.osd.1.smithi049.stderr:2023-11-30T17:07:05.345+0000 7f9f21847380 -1 osd.1 0 log_to_monitors {default=true} 2023-11-30T17:07:05.369 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-11-30T17:07:05.367+0000 7fce7986f380 -1 osd.6 0 log_to_monitors {default=true} 2023-11-30T17:07:05.373 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-11-30T17:07:05.371+0000 7fe3e09ef380 -1 osd.4 0 log_to_monitors {default=true} 2023-11-30T17:07:05.377 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-11-30T17:07:05.375+0000 7fe8f5122380 -1 osd.7 0 log_to_monitors {default=true} 2023-11-30T17:07:05.385 INFO:tasks.ceph.osd.3.smithi049.stderr:2023-11-30T17:07:05.383+0000 7f764dc98380 -1 osd.3 0 log_to_monitors {default=true} 2023-11-30T17:07:06.849 INFO:tasks.ceph.osd.2.smithi049.stderr:2023-11-30T17:07:06.848+0000 7f1d38d52700 -1 osd.2 0 waiting for initial osdmap 2023-11-30T17:07:06.850 INFO:tasks.ceph.osd.1.smithi049.stderr:2023-11-30T17:07:06.849+0000 7f9f18205700 -1 osd.1 0 waiting for initial osdmap 2023-11-30T17:07:06.850 INFO:tasks.ceph.osd.0.smithi049.stderr:2023-11-30T17:07:06.849+0000 7ff882765700 -1 osd.0 0 waiting for initial osdmap 2023-11-30T17:07:06.851 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-11-30T17:07:06.850+0000 7fce7022d700 -1 osd.6 0 waiting for initial osdmap 2023-11-30T17:07:06.851 INFO:tasks.ceph.osd.3.smithi049.stderr:2023-11-30T17:07:06.850+0000 7f7644656700 -1 osd.3 0 waiting for initial osdmap 2023-11-30T17:07:06.852 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-11-30T17:07:06.850+0000 7fe8ebae0700 -1 osd.7 0 waiting for initial osdmap 2023-11-30T17:07:06.852 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-11-30T17:07:06.850+0000 7fe3d73ad700 -1 osd.4 0 waiting for initial osdmap 2023-11-30T17:07:06.852 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-11-30T17:07:06.850+0000 7fead15eb700 -1 osd.5 0 waiting for initial osdmap 2023-11-30T17:07:06.856 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-11-30T17:07:06.855+0000 7fce6c9a9700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-30T17:07:06.857 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-11-30T17:07:06.855+0000 7fe8e825c700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-30T17:07:06.857 INFO:tasks.ceph.osd.2.smithi049.stderr:2023-11-30T17:07:06.856+0000 7f1d354ce700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-30T17:07:06.857 INFO:tasks.ceph.osd.1.smithi049.stderr:2023-11-30T17:07:06.856+0000 7f9f14981700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-30T17:07:06.857 INFO:tasks.ceph.osd.0.smithi049.stderr:2023-11-30T17:07:06.856+0000 7ff87eee1700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-30T17:07:06.858 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-11-30T17:07:06.856+0000 7fe3d3b29700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-30T17:07:06.858 INFO:tasks.ceph.osd.3.smithi049.stderr:2023-11-30T17:07:06.857+0000 7f7640dd2700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-30T17:07:06.858 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-11-30T17:07:06.856+0000 7feacdd67700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-30T17:07:09.311 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-30T17:07:09.434 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.433+0000 7fa325cb8700 1 Processor -- start 2023-11-30T17:07:09.434 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.433+0000 7fa325cb8700 1 -- start start 2023-11-30T17:07:09.438 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.433+0000 7fa325cb8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3201543a0 0x7fa3201580f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:09.438 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.433+0000 7fa325cb8700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa3201585e0 0x7fa3200c0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:09.438 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.433+0000 7fa325cb8700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3200c14b0 con 0x7fa3200c1000 2023-11-30T17:07:09.438 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.433+0000 7fa325cb8700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3200a8570 con 0x7fa3201585e0 2023-11-30T17:07:09.438 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.433+0000 7fa325cb8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa320158b70 con 0x7fa3201543a0 2023-11-30T17:07:09.438 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.434+0000 7fa31ffff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa3200c1000 0x7fa320154780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44876/0 (socket says 172.21.15.49:44876) 2023-11-30T17:07:09.438 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.434+0000 7fa31ffff700 1 -- 172.21.15.49:0/1498806790 learned_addr learned my addr 172.21.15.49:0/1498806790 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:09.438 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.434+0000 7fa31effd700 1 --2- 172.21.15.49:0/1498806790 >> v2:172.21.15.115:3300/0 conn(0x7fa3201585e0 0x7fa3200c0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:09.439 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.434+0000 7fa31f7fe700 1 --2- 172.21.15.49:0/1498806790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3201543a0 0x7fa3201580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:09.439 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.434+0000 7fa31e7fc700 1 -- 172.21.15.49:0/1498806790 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2473734809 0 0) 0x7fa318001490 con 0x7fa3200c1000 2023-11-30T17:07:09.439 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.434+0000 7fa31e7fc700 1 -- 172.21.15.49:0/1498806790 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3080033f0 con 0x7fa3200c1000 2023-11-30T17:07:09.439 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.434+0000 7fa31e7fc700 1 -- 172.21.15.49:0/1498806790 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 567563687 0 0) 0x7fa3080033f0 con 0x7fa3200c1000 2023-11-30T17:07:09.439 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.434+0000 7fa31e7fc700 1 -- 172.21.15.49:0/1498806790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3201543a0 msgr2=0x7fa3201580f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:09.439 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.434+0000 7fa31e7fc700 1 --2- 172.21.15.49:0/1498806790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3201543a0 0x7fa3201580f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:09.439 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.434+0000 7fa31e7fc700 1 -- 172.21.15.49:0/1498806790 >> v2:172.21.15.115:3300/0 conn(0x7fa3201585e0 msgr2=0x7fa3200c0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:09.439 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.434+0000 7fa31e7fc700 1 --2- 172.21.15.49:0/1498806790 >> v2:172.21.15.115:3300/0 conn(0x7fa3201585e0 0x7fa3200c0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:09.439 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.434+0000 7fa31e7fc700 1 -- 172.21.15.49:0/1498806790 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa320158e50 con 0x7fa3200c1000 2023-11-30T17:07:09.439 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.434+0000 7fa31e7fc700 1 -- 172.21.15.49:0/1498806790 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fa318001980 con 0x7fa3200c1000 2023-11-30T17:07:09.439 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.434+0000 7fa31effd700 1 --2- 172.21.15.49:0/1498806790 >> v2:172.21.15.115:3300/0 conn(0x7fa3201585e0 0x7fa3200c0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:07:09.439 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.434+0000 7fa31e7fc700 1 -- 172.21.15.49:0/1498806790 >> v1:172.21.15.49:6789/0 conn(0x7fa3200c1000 legacy=0x7fa320154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:09.439 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.434+0000 7fa31e7fc700 1 --2- 172.21.15.49:0/1498806790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3080038e0 0x7fa308003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:09.439 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.434+0000 7fa31e7fc700 1 --2- 172.21.15.49:0/1498806790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3201543a0 0x7fa308004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:09.440 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.434+0000 7fa31e7fc700 1 --2- 172.21.15.49:0/1498806790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa308004b80 0x7fa308005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:09.440 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.434+0000 7fa31e7fc700 1 -- 172.21.15.49:0/1498806790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3200a8570 con 0x7fa308004b80 2023-11-30T17:07:09.440 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.434+0000 7fa31e7fc700 1 -- 172.21.15.49:0/1498806790 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa320158b70 con 0x7fa3080038e0 2023-11-30T17:07:09.440 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.434+0000 7fa31e7fc700 1 -- 172.21.15.49:0/1498806790 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30800b8e0 con 0x7fa3201543a0 2023-11-30T17:07:09.440 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.434+0000 7fa31ffff700 1 --2- 172.21.15.49:0/1498806790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa308004b80 0x7fa308005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:09.440 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.435+0000 7fa31effd700 1 --2- 172.21.15.49:0/1498806790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3201543a0 0x7fa308004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:09.440 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.435+0000 7fa31f7fe700 1 --2- 172.21.15.49:0/1498806790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3080038e0 0x7fa308003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:09.440 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.435+0000 7fa31ffff700 1 -- 172.21.15.49:0/1498806790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3201543a0 msgr2=0x7fa308004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:09.441 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.435+0000 7fa31ffff700 1 --2- 172.21.15.49:0/1498806790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3201543a0 0x7fa308004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:09.441 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.435+0000 7fa31ffff700 1 -- 172.21.15.49:0/1498806790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3080038e0 msgr2=0x7fa308003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:09.441 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.435+0000 7fa31ffff700 1 --2- 172.21.15.49:0/1498806790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3080038e0 0x7fa308003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:09.441 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.435+0000 7fa31ffff700 1 -- 172.21.15.49:0/1498806790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3080033f0 con 0x7fa308004b80 2023-11-30T17:07:09.441 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.435+0000 7fa31ffff700 1 --2- 172.21.15.49:0/1498806790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa308004b80 0x7fa308005000 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fa31800c6d0 tx=0x7fa318007c80).ready entity=mon.0 client_cookie=38d3ee17601996e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:09.441 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.435+0000 7fa31e7fc700 1 -- 172.21.15.49:0/1498806790 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa318005b20 con 0x7fa308004b80 2023-11-30T17:07:09.441 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.435+0000 7fa31e7fc700 1 -- 172.21.15.49:0/1498806790 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa318005c80 con 0x7fa308004b80 2023-11-30T17:07:09.441 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.435+0000 7fa31e7fc700 1 -- 172.21.15.49:0/1498806790 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa318007110 con 0x7fa308004b80 2023-11-30T17:07:09.441 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.436+0000 7fa325cb8700 1 -- 172.21.15.49:0/1498806790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa308004b80 msgr2=0x7fa308005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:09.441 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.436+0000 7fa325cb8700 1 --2- 172.21.15.49:0/1498806790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa308004b80 0x7fa308005000 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fa31800c6d0 tx=0x7fa318007c80).stop 2023-11-30T17:07:09.441 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.436+0000 7fa31ffff700 1 -- 172.21.15.49:0/1498806790 reap_dead start 2023-11-30T17:07:09.441 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.436+0000 7fa325cb8700 1 -- 172.21.15.49:0/1498806790 shutdown_connections 2023-11-30T17:07:09.441 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.436+0000 7fa325cb8700 1 -- 172.21.15.49:0/1498806790 >> 172.21.15.49:0/1498806790 conn(0x7fa320084ff0 msgr2=0x7fa320094910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:09.442 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.436+0000 7fa325cb8700 1 -- 172.21.15.49:0/1498806790 shutdown_connections 2023-11-30T17:07:09.442 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.436+0000 7fa325cb8700 1 -- 172.21.15.49:0/1498806790 wait complete. 2023-11-30T17:07:09.444 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.437+0000 7fa325cb8700 1 Processor -- start 2023-11-30T17:07:09.444 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.437+0000 7fa325cb8700 1 -- start start 2023-11-30T17:07:09.445 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.438+0000 7fa325cb8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa308004b80 0x7fa32014fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:09.445 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.438+0000 7fa325cb8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3200c90a0 0x7fa3200cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:09.445 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.438+0000 7fa325cb8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa320167dd0 0x7fa320168250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:09.445 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.438+0000 7fa325cb8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3200c9580 con 0x7fa3200c90a0 2023-11-30T17:07:09.445 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.438+0000 7fa325cb8700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3200c9860 con 0x7fa320167dd0 2023-11-30T17:07:09.445 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.438+0000 7fa325cb8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3200c9b40 con 0x7fa308004b80 2023-11-30T17:07:09.445 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.438+0000 7fa31effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3200c90a0 0x7fa3200cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:09.445 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.438+0000 7fa31effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3200c90a0 0x7fa3200cafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48020/0 (socket says 172.21.15.49:48020) 2023-11-30T17:07:09.445 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.438+0000 7fa31effd700 1 -- 172.21.15.49:0/2140884810 learned_addr learned my addr 172.21.15.49:0/2140884810 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:09.445 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.438+0000 7fa31ffff700 1 --2- 172.21.15.49:0/2140884810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa320167dd0 0x7fa320168250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:09.445 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.438+0000 7fa31f7fe700 1 --2- 172.21.15.49:0/2140884810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa308004b80 0x7fa32014fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:09.446 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.438+0000 7fa31effd700 1 -- 172.21.15.49:0/2140884810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa308004b80 msgr2=0x7fa32014fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:09.446 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.438+0000 7fa31effd700 1 --2- 172.21.15.49:0/2140884810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa308004b80 0x7fa32014fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:09.446 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.438+0000 7fa31effd700 1 -- 172.21.15.49:0/2140884810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa320167dd0 msgr2=0x7fa320168250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:09.446 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.438+0000 7fa31effd700 1 --2- 172.21.15.49:0/2140884810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa320167dd0 0x7fa320168250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:09.446 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.438+0000 7fa31effd700 1 -- 172.21.15.49:0/2140884810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3200c9e20 con 0x7fa3200c90a0 2023-11-30T17:07:09.446 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.438+0000 7fa31effd700 1 --2- 172.21.15.49:0/2140884810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3200c90a0 0x7fa3200cafb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fa314011b40 tx=0x7fa314006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:09.446 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.438+0000 7fa3077fe700 1 -- 172.21.15.49:0/2140884810 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31400f940 con 0x7fa3200c90a0 2023-11-30T17:07:09.446 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.438+0000 7fa3077fe700 1 -- 172.21.15.49:0/2140884810 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31400faa0 con 0x7fa3200c90a0 2023-11-30T17:07:09.446 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.438+0000 7fa325cb8700 1 -- 172.21.15.49:0/2140884810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa320164930 con 0x7fa3200c90a0 2023-11-30T17:07:09.446 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.438+0000 7fa3077fe700 1 -- 172.21.15.49:0/2140884810 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31400fe20 con 0x7fa3200c90a0 2023-11-30T17:07:09.446 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.439+0000 7fa325cb8700 1 -- 172.21.15.49:0/2140884810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3200cb4a0 con 0x7fa3200c90a0 2023-11-30T17:07:09.446 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.440+0000 7fa325cb8700 1 -- 172.21.15.49:0/2140884810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa320164b50 con 0x7fa3200c90a0 2023-11-30T17:07:09.446 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.440+0000 7fa3077fe700 1 -- 172.21.15.49:0/2140884810 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa314014650 con 0x7fa3200c90a0 2023-11-30T17:07:09.447 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.440+0000 7fa3077fe700 1 --2- 172.21.15.49:0/2140884810 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa30c05f150 0x7fa30c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:09.447 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.440+0000 7fa3077fe700 1 -- 172.21.15.49:0/2140884810 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4892+0+0 (secure 0 0 0) 0x7fa31407a760 con 0x7fa3200c90a0 2023-11-30T17:07:09.447 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.441+0000 7fa31f7fe700 1 --2- 172.21.15.49:0/2140884810 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa30c05f150 0x7fa30c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:09.447 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.441+0000 7fa31f7fe700 1 --2- 172.21.15.49:0/2140884810 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa30c05f150 0x7fa30c061610 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fa310006cf0 tx=0x7fa310006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:09.447 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.445+0000 7fa3077fe700 1 -- 172.21.15.49:0/2140884810 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa31404bf00 con 0x7fa3200c90a0 2023-11-30T17:07:09.622 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.621+0000 7fa325cb8700 1 -- 172.21.15.49:0/2140884810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3200c8bd0 con 0x7fa3200c90a0 2023-11-30T17:07:09.623 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.622+0000 7fa3077fe700 1 -- 172.21.15.49:0/2140884810 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+12180 (secure 0 0 0) 0x7fa31404f520 con 0x7fa3200c90a0 2023-11-30T17:07:09.623 INFO:teuthology.misc.health.smithi049.stdout: 2023-11-30T17:07:09.623 INFO:teuthology.misc.health.smithi049.stdout:{"epoch":14,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:07:08.852991+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:07:09.625 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.623+0000 7fa325cb8700 1 -- 172.21.15.49:0/2140884810 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa30c05f150 msgr2=0x7fa30c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:09.625 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.623+0000 7fa325cb8700 1 --2- 172.21.15.49:0/2140884810 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa30c05f150 0x7fa30c061610 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fa310006cf0 tx=0x7fa310006f40).stop 2023-11-30T17:07:09.625 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.623+0000 7fa325cb8700 1 -- 172.21.15.49:0/2140884810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3200c90a0 msgr2=0x7fa3200cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:09.625 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.623+0000 7fa325cb8700 1 --2- 172.21.15.49:0/2140884810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3200c90a0 0x7fa3200cafb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fa314011b40 tx=0x7fa314006f40).stop 2023-11-30T17:07:09.625 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.623+0000 7fa325cb8700 1 -- 172.21.15.49:0/2140884810 shutdown_connections 2023-11-30T17:07:09.625 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.623+0000 7fa325cb8700 1 --2- 172.21.15.49:0/2140884810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa320167dd0 0x7fa320168250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:09.625 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.623+0000 7fa325cb8700 1 --2- 172.21.15.49:0/2140884810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa308004b80 0x7fa32014fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:09.626 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.623+0000 7fa325cb8700 1 --2- 172.21.15.49:0/2140884810 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa30c05f150 0x7fa30c061610 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:09.626 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.623+0000 7fa325cb8700 1 --2- 172.21.15.49:0/2140884810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3200c90a0 0x7fa3200cafb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:09.626 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.623+0000 7fa325cb8700 1 -- 172.21.15.49:0/2140884810 >> 172.21.15.49:0/2140884810 conn(0x7fa320084ff0 msgr2=0x7fa3200c7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:09.626 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.623+0000 7fa325cb8700 1 -- 172.21.15.49:0/2140884810 shutdown_connections 2023-11-30T17:07:09.626 INFO:teuthology.misc.health.smithi049.stderr:2023-11-30T17:07:09.623+0000 7fa325cb8700 1 -- 172.21.15.49:0/2140884810 wait complete. 2023-11-30T17:07:09.636 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-30T17:07:09.636 INFO:tasks.ceph:Creating RBD pool 2023-11-30T17:07:09.636 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph osd pool create rbd 8 2023-11-30T17:07:09.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.752+0000 7fd0a9359700 1 Processor -- start 2023-11-30T17:07:09.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.752+0000 7fd0a9359700 1 -- start start 2023-11-30T17:07:09.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.753+0000 7fd0a9359700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a414e530 0x7fd0a40c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:09.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.753+0000 7fd0a9359700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd0a4158570 0x7fd0a4158a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:09.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.753+0000 7fd0a9359700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a40c7bc0 con 0x7fd0a4154950 2023-11-30T17:07:09.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.753+0000 7fd0a9359700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a4155920 con 0x7fd0a4158570 2023-11-30T17:07:09.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.753+0000 7fd0a9359700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a4154dd0 con 0x7fd0a414e530 2023-11-30T17:07:09.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.753+0000 7fd0a37fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd0a4154950 0x7fd0a414e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44882/0 (socket says 172.21.15.49:44882) 2023-11-30T17:07:09.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.753+0000 7fd0a37fe700 1 -- 172.21.15.49:0/2818069838 learned_addr learned my addr 172.21.15.49:0/2818069838 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:09.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.753+0000 7fd0a3fff700 1 --2- 172.21.15.49:0/2818069838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a414e530 0x7fd0a40c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:09.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.753+0000 7fd0a2ffd700 1 -- 172.21.15.49:0/2818069838 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 461133602 0 0) 0x7fd0a40c7bc0 con 0x7fd0a4154950 2023-11-30T17:07:09.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.753+0000 7fd0a2ffd700 1 -- 172.21.15.49:0/2818069838 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd08c0033f0 con 0x7fd0a4154950 2023-11-30T17:07:09.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.753+0000 7fd0a8b58700 1 --2- 172.21.15.49:0/2818069838 >> v2:172.21.15.115:3300/0 conn(0x7fd0a4158570 0x7fd0a4158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:09.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.753+0000 7fd0a2ffd700 1 -- 172.21.15.49:0/2818069838 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2440236685 0 0) 0x7fd08c0033f0 con 0x7fd0a4154950 2023-11-30T17:07:09.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.753+0000 7fd0a2ffd700 1 -- 172.21.15.49:0/2818069838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a414e530 msgr2=0x7fd0a40c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:09.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.753+0000 7fd0a2ffd700 1 --2- 172.21.15.49:0/2818069838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a414e530 0x7fd0a40c66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:09.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.753+0000 7fd0a2ffd700 1 -- 172.21.15.49:0/2818069838 >> v2:172.21.15.115:3300/0 conn(0x7fd0a4158570 msgr2=0x7fd0a4158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:09.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.753+0000 7fd0a2ffd700 1 --2- 172.21.15.49:0/2818069838 >> v2:172.21.15.115:3300/0 conn(0x7fd0a4158570 0x7fd0a4158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:09.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.753+0000 7fd0a2ffd700 1 -- 172.21.15.49:0/2818069838 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a4155080 con 0x7fd0a4154950 2023-11-30T17:07:09.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.753+0000 7fd0a2ffd700 1 -- 172.21.15.49:0/2818069838 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fd098001470 con 0x7fd0a4154950 2023-11-30T17:07:09.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.753+0000 7fd0a2ffd700 1 -- 172.21.15.49:0/2818069838 >> v1:172.21.15.49:6789/0 conn(0x7fd0a4154950 legacy=0x7fd0a414e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:09.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.753+0000 7fd0a2ffd700 1 --2- 172.21.15.49:0/2818069838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd08c0038e0 0x7fd08c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:09.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.753+0000 7fd0a2ffd700 1 --2- 172.21.15.49:0/2818069838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd08c004690 0x7fd08c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:09.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.753+0000 7fd0a2ffd700 1 --2- 172.21.15.49:0/2818069838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a414e530 0x7fd08c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:09.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.753+0000 7fd0a2ffd700 1 -- 172.21.15.49:0/2818069838 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a4155920 con 0x7fd08c0038e0 2023-11-30T17:07:09.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.753+0000 7fd0a2ffd700 1 -- 172.21.15.49:0/2818069838 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a4154dd0 con 0x7fd08c004690 2023-11-30T17:07:09.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.753+0000 7fd0a2ffd700 1 -- 172.21.15.49:0/2818069838 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c00b8e0 con 0x7fd0a414e530 2023-11-30T17:07:09.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.754+0000 7fd0a3fff700 1 --2- 172.21.15.49:0/2818069838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd08c0038e0 0x7fd08c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:09.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.754+0000 7fd0a37fe700 1 --2- 172.21.15.49:0/2818069838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd08c004690 0x7fd08c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:09.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.754+0000 7fd0a8b58700 1 --2- 172.21.15.49:0/2818069838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a414e530 0x7fd08c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:09.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.754+0000 7fd0a3fff700 1 -- 172.21.15.49:0/2818069838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a414e530 msgr2=0x7fd08c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:09.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.754+0000 7fd0a3fff700 1 --2- 172.21.15.49:0/2818069838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a414e530 0x7fd08c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:09.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.754+0000 7fd0a3fff700 1 -- 172.21.15.49:0/2818069838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd08c004690 msgr2=0x7fd08c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:09.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.754+0000 7fd0a3fff700 1 --2- 172.21.15.49:0/2818069838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd08c004690 0x7fd08c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:09.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.754+0000 7fd0a3fff700 1 -- 172.21.15.49:0/2818069838 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08c0033f0 con 0x7fd08c0038e0 2023-11-30T17:07:09.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.754+0000 7fd0a3fff700 1 --2- 172.21.15.49:0/2818069838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd08c0038e0 0x7fd08c003d00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fd094009a60 tx=0x7fd094009060).ready entity=mon.0 client_cookie=41d23ce41bef9005 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:09.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.754+0000 7fd0a2ffd700 1 -- 172.21.15.49:0/2818069838 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd094009ea0 con 0x7fd08c0038e0 2023-11-30T17:07:09.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.754+0000 7fd0a2ffd700 1 -- 172.21.15.49:0/2818069838 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd094009430 con 0x7fd08c0038e0 2023-11-30T17:07:09.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.754+0000 7fd0a2ffd700 1 -- 172.21.15.49:0/2818069838 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09400e870 con 0x7fd08c0038e0 2023-11-30T17:07:09.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.755+0000 7fd0a9359700 1 -- 172.21.15.49:0/2818069838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd08c0038e0 msgr2=0x7fd08c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:09.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.755+0000 7fd0a9359700 1 --2- 172.21.15.49:0/2818069838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd08c0038e0 0x7fd08c003d00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fd094009a60 tx=0x7fd094009060).stop 2023-11-30T17:07:09.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.755+0000 7fd0a8b58700 1 -- 172.21.15.49:0/2818069838 reap_dead start 2023-11-30T17:07:09.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.755+0000 7fd0a9359700 1 -- 172.21.15.49:0/2818069838 shutdown_connections 2023-11-30T17:07:09.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.755+0000 7fd0a9359700 1 -- 172.21.15.49:0/2818069838 >> 172.21.15.49:0/2818069838 conn(0x7fd0a4064990 msgr2=0x7fd0a4064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:09.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.755+0000 7fd0a9359700 1 -- 172.21.15.49:0/2818069838 shutdown_connections 2023-11-30T17:07:09.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.755+0000 7fd0a9359700 1 -- 172.21.15.49:0/2818069838 wait complete. 2023-11-30T17:07:09.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.756+0000 7fd0a9359700 1 Processor -- start 2023-11-30T17:07:09.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.756+0000 7fd0a9359700 1 -- start start 2023-11-30T17:07:09.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.757+0000 7fd0a9359700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd08c0038e0 0x7fd0a4167340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:09.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.757+0000 7fd0a9359700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a40af000 0x7fd0a40af480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:09.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.757+0000 7fd0a9359700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0a40c2c00 0x7fd0a40c3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:09.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.757+0000 7fd0a9359700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a4167830 con 0x7fd0a40c2c00 2023-11-30T17:07:09.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.757+0000 7fd0a9359700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a40b0690 con 0x7fd08c0038e0 2023-11-30T17:07:09.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.757+0000 7fd0a9359700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a40c3570 con 0x7fd0a40af000 2023-11-30T17:07:09.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.757+0000 7fd0a8b58700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0a40c2c00 0x7fd0a40c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:09.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.757+0000 7fd0a8b58700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0a40c2c00 0x7fd0a40c3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48040/0 (socket says 172.21.15.49:48040) 2023-11-30T17:07:09.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.757+0000 7fd0a8b58700 1 -- 172.21.15.49:0/856597833 learned_addr learned my addr 172.21.15.49:0/856597833 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:09.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.757+0000 7fd0a37fe700 1 --2- 172.21.15.49:0/856597833 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a40af000 0x7fd0a40af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:09.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.757+0000 7fd0a3fff700 1 --2- 172.21.15.49:0/856597833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd08c0038e0 0x7fd0a4167340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:09.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.757+0000 7fd0a8b58700 1 -- 172.21.15.49:0/856597833 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a40af000 msgr2=0x7fd0a40af480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:09.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.757+0000 7fd0a8b58700 1 --2- 172.21.15.49:0/856597833 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a40af000 0x7fd0a40af480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:09.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.757+0000 7fd0a8b58700 1 -- 172.21.15.49:0/856597833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd08c0038e0 msgr2=0x7fd0a4167340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:09.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.757+0000 7fd0a8b58700 1 --2- 172.21.15.49:0/856597833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd08c0038e0 0x7fd0a4167340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:09.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.757+0000 7fd0a8b58700 1 -- 172.21.15.49:0/856597833 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a40afa80 con 0x7fd0a40c2c00 2023-11-30T17:07:09.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.757+0000 7fd0a8b58700 1 --2- 172.21.15.49:0/856597833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0a40c2c00 0x7fd0a40c3080 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fd09c009d70 tx=0x7fd09c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:09.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.757+0000 7fd08bfff700 1 -- 172.21.15.49:0/856597833 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c00e040 con 0x7fd0a40c2c00 2023-11-30T17:07:09.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.757+0000 7fd08bfff700 1 -- 172.21.15.49:0/856597833 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09c00f040 con 0x7fd0a40c2c00 2023-11-30T17:07:09.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.757+0000 7fd0a9359700 1 -- 172.21.15.49:0/856597833 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a40afd60 con 0x7fd0a40c2c00 2023-11-30T17:07:09.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.757+0000 7fd08bfff700 1 -- 172.21.15.49:0/856597833 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c00fd40 con 0x7fd0a40c2c00 2023-11-30T17:07:09.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.757+0000 7fd0a9359700 1 -- 172.21.15.49:0/856597833 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a40b0320 con 0x7fd0a40c2c00 2023-11-30T17:07:09.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.758+0000 7fd0a9359700 1 -- 172.21.15.49:0/856597833 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a4062ee0 con 0x7fd0a40c2c00 2023-11-30T17:07:09.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.759+0000 7fd08bfff700 1 -- 172.21.15.49:0/856597833 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd09c015660 con 0x7fd0a40c2c00 2023-11-30T17:07:09.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.759+0000 7fd08bfff700 1 --2- 172.21.15.49:0/856597833 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd09005f150 0x7fd090061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:09.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.759+0000 7fd08bfff700 1 -- 172.21.15.49:0/856597833 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4892+0+0 (secure 0 0 0) 0x7fd09c07a5a0 con 0x7fd0a40c2c00 2023-11-30T17:07:09.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.759+0000 7fd0a3fff700 1 --2- 172.21.15.49:0/856597833 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd09005f150 0x7fd090061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:09.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.760+0000 7fd0a3fff700 1 --2- 172.21.15.49:0/856597833 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd09005f150 0x7fd090061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fd094006d50 tx=0x7fd09401a000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:09.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.763+0000 7fd08bfff700 1 -- 172.21.15.49:0/856597833 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd09c04bd40 con 0x7fd0a40c2c00 2023-11-30T17:07:09.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:09.938+0000 7fd0a9359700 1 -- 172.21.15.49:0/856597833 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fd0a406c7c0 con 0x7fd0a40c2c00 2023-11-30T17:07:10.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:10.867+0000 7fd08bfff700 1 -- 172.21.15.49:0/856597833 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7fd09c00fea0 con 0x7fd0a40c2c00 2023-11-30T17:07:10.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:10.871+0000 7fd0a9359700 1 -- 172.21.15.49:0/856597833 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd09005f150 msgr2=0x7fd090061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:10.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:10.871+0000 7fd0a9359700 1 --2- 172.21.15.49:0/856597833 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd09005f150 0x7fd090061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fd094006d50 tx=0x7fd09401a000).stop 2023-11-30T17:07:10.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:10.871+0000 7fd0a9359700 1 -- 172.21.15.49:0/856597833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0a40c2c00 msgr2=0x7fd0a40c3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:10.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:10.871+0000 7fd0a9359700 1 --2- 172.21.15.49:0/856597833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0a40c2c00 0x7fd0a40c3080 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fd09c009d70 tx=0x7fd09c00b040).stop 2023-11-30T17:07:10.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:10.871+0000 7fd0a9359700 1 -- 172.21.15.49:0/856597833 shutdown_connections 2023-11-30T17:07:10.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:10.871+0000 7fd0a9359700 1 --2- 172.21.15.49:0/856597833 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd09005f150 0x7fd090061610 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:10.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:10.871+0000 7fd0a9359700 1 --2- 172.21.15.49:0/856597833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0a40c2c00 0x7fd0a40c3080 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:10.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:10.871+0000 7fd0a9359700 1 --2- 172.21.15.49:0/856597833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd08c0038e0 0x7fd0a4167340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:10.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:10.871+0000 7fd0a9359700 1 --2- 172.21.15.49:0/856597833 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a40af000 0x7fd0a40af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:10.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:10.871+0000 7fd0a9359700 1 -- 172.21.15.49:0/856597833 >> 172.21.15.49:0/856597833 conn(0x7fd0a4064990 msgr2=0x7fd0a40cb700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:10.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:10.871+0000 7fd0a9359700 1 -- 172.21.15.49:0/856597833 shutdown_connections 2023-11-30T17:07:10.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:10.871+0000 7fd0a9359700 1 -- 172.21.15.49:0/856597833 wait complete. 2023-11-30T17:07:10.874 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'rbd' created 2023-11-30T17:07:10.888 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-11-30T17:07:11.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.012+0000 7fe76cb71700 1 Processor -- start 2023-11-30T17:07:11.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.012+0000 7fe76cb71700 1 -- start start 2023-11-30T17:07:11.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.013+0000 7fe76cb71700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe7680aa680 0x7fe7680c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:11.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.013+0000 7fe76cb71700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe7681546b0 0x7fe7680c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:11.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.013+0000 7fe76cb71700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe768158d50 con 0x7fe7681542d0 2023-11-30T17:07:11.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.013+0000 7fe76cb71700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe768158140 con 0x7fe7681546b0 2023-11-30T17:07:11.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.013+0000 7fe76cb71700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe768158420 con 0x7fe7680aa680 2023-11-30T17:07:11.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.013+0000 7fe767fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe7681546b0 0x7fe7680c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:11.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.013+0000 7fe767fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe7681546b0 0x7fe7680c64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45934/0 (socket says 172.21.15.49:45934) 2023-11-30T17:07:11.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.013+0000 7fe767fff700 1 -- 172.21.15.49:0/3881440612 learned_addr learned my addr 172.21.15.49:0/3881440612 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:11.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.013+0000 7fe766ffd700 1 --2- 172.21.15.49:0/3881440612 >> v2:172.21.15.115:3300/0 conn(0x7fe7680aa680 0x7fe7680c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:11.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.014+0000 7fe767fff700 1 -- 172.21.15.49:0/3881440612 >> v2:172.21.15.115:3300/0 conn(0x7fe7680aa680 msgr2=0x7fe7680c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:11.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.014+0000 7fe767fff700 1 --2- 172.21.15.49:0/3881440612 >> v2:172.21.15.115:3300/0 conn(0x7fe7680aa680 0x7fe7680c5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:11.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.014+0000 7fe767fff700 1 -- 172.21.15.49:0/3881440612 >> v1:172.21.15.115:6789/0 conn(0x7fe7681542d0 legacy=0x7fe7680a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:11.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.014+0000 7fe767fff700 1 -- 172.21.15.49:0/3881440612 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe768158700 con 0x7fe7681546b0 2023-11-30T17:07:11.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.014+0000 7fe766ffd700 1 --2- 172.21.15.49:0/3881440612 >> v2:172.21.15.115:3300/0 conn(0x7fe7680aa680 0x7fe7680c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:11.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.014+0000 7fe767fff700 1 --2- 172.21.15.49:0/3881440612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7681546b0 0x7fe7680c64b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fe7680add40 tx=0x7fe760009840).ready entity=mon.0 client_cookie=6ed239fe1c737757 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:11.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.014+0000 7fe7667fc700 1 -- 172.21.15.49:0/3881440612 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76000e070 con 0x7fe7681546b0 2023-11-30T17:07:11.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.014+0000 7fe7667fc700 1 -- 172.21.15.49:0/3881440612 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76000ba50 con 0x7fe7681546b0 2023-11-30T17:07:11.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.014+0000 7fe7667fc700 1 -- 172.21.15.49:0/3881440612 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76000bdd0 con 0x7fe7681546b0 2023-11-30T17:07:11.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.014+0000 7fe76cb71700 1 -- 172.21.15.49:0/3881440612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7681546b0 msgr2=0x7fe7680c64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:11.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.014+0000 7fe76cb71700 1 --2- 172.21.15.49:0/3881440612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7681546b0 0x7fe7680c64b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fe7680add40 tx=0x7fe760009840).stop 2023-11-30T17:07:11.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.014+0000 7fe76cb71700 1 -- 172.21.15.49:0/3881440612 shutdown_connections 2023-11-30T17:07:11.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.014+0000 7fe76cb71700 1 --2- 172.21.15.49:0/3881440612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7681546b0 0x7fe7680c64b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:11.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.014+0000 7fe76cb71700 1 --2- 172.21.15.49:0/3881440612 >> v2:172.21.15.115:3300/0 conn(0x7fe7680aa680 0x7fe7680c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:11.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.014+0000 7fe76cb71700 1 -- 172.21.15.49:0/3881440612 >> 172.21.15.49:0/3881440612 conn(0x7fe7680cb010 msgr2=0x7fe7680cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:11.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.014+0000 7fe76cb71700 1 -- 172.21.15.49:0/3881440612 shutdown_connections 2023-11-30T17:07:11.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.014+0000 7fe76cb71700 1 -- 172.21.15.49:0/3881440612 wait complete. 2023-11-30T17:07:11.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.016+0000 7fe76cb71700 1 Processor -- start 2023-11-30T17:07:11.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.016+0000 7fe76cb71700 1 -- start start 2023-11-30T17:07:11.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.016+0000 7fe76cb71700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7680aa680 0x7fe76814bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:11.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.017+0000 7fe76cb71700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7681542d0 0x7fe768147130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:11.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.017+0000 7fe76cb71700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7681546b0 0x7fe7680c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:11.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.017+0000 7fe76cb71700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76814cf00 con 0x7fe7680aa680 2023-11-30T17:07:11.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.017+0000 7fe76cb71700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7680ae630 con 0x7fe7681542d0 2023-11-30T17:07:11.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.017+0000 7fe76cb71700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76814c2f0 con 0x7fe7681546b0 2023-11-30T17:07:11.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.017+0000 7fe7677fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7680aa680 0x7fe76814bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:11.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.017+0000 7fe7677fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7680aa680 0x7fe76814bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45950/0 (socket says 172.21.15.49:45950) 2023-11-30T17:07:11.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.017+0000 7fe7677fe700 1 -- 172.21.15.49:0/2552768939 learned_addr learned my addr 172.21.15.49:0/2552768939 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:11.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.017+0000 7fe766ffd700 1 --2- 172.21.15.49:0/2552768939 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7681542d0 0x7fe768147130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:11.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.017+0000 7fe767fff700 1 --2- 172.21.15.49:0/2552768939 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7681546b0 0x7fe7680c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:11.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.017+0000 7fe7677fe700 1 -- 172.21.15.49:0/2552768939 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7681546b0 msgr2=0x7fe7680c3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:11.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.017+0000 7fe7677fe700 1 --2- 172.21.15.49:0/2552768939 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7681546b0 0x7fe7680c3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:11.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.017+0000 7fe7677fe700 1 -- 172.21.15.49:0/2552768939 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7681542d0 msgr2=0x7fe768147130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:11.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.017+0000 7fe7677fe700 1 --2- 172.21.15.49:0/2552768939 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7681542d0 0x7fe768147130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:11.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.017+0000 7fe7677fe700 1 -- 172.21.15.49:0/2552768939 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe760009ae0 con 0x7fe7680aa680 2023-11-30T17:07:11.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.017+0000 7fe7677fe700 1 --2- 172.21.15.49:0/2552768939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7680aa680 0x7fe76814bd40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe75800c440 tx=0x7fe758007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:11.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.017+0000 7fe74f7fe700 1 -- 172.21.15.49:0/2552768939 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe758012400 con 0x7fe7680aa680 2023-11-30T17:07:11.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.017+0000 7fe74f7fe700 1 -- 172.21.15.49:0/2552768939 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe758012560 con 0x7fe7680aa680 2023-11-30T17:07:11.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.017+0000 7fe76cb71700 1 -- 172.21.15.49:0/2552768939 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe76814c5d0 con 0x7fe7680aa680 2023-11-30T17:07:11.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.017+0000 7fe74f7fe700 1 -- 172.21.15.49:0/2552768939 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe758012900 con 0x7fe7680aa680 2023-11-30T17:07:11.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.017+0000 7fe76cb71700 1 -- 172.21.15.49:0/2552768939 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76814cb90 con 0x7fe7680aa680 2023-11-30T17:07:11.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.019+0000 7fe76cb71700 1 -- 172.21.15.49:0/2552768939 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe768157e30 con 0x7fe7680aa680 2023-11-30T17:07:11.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.019+0000 7fe74f7fe700 1 -- 172.21.15.49:0/2552768939 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe75801c440 con 0x7fe7680aa680 2023-11-30T17:07:11.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.019+0000 7fe74f7fe700 1 --2- 172.21.15.49:0/2552768939 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe75405f150 0x7fe754061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:11.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.019+0000 7fe74f7fe700 1 -- 172.21.15.49:0/2552768939 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5258+0+0 (secure 0 0 0) 0x7fe7580795f0 con 0x7fe7680aa680 2023-11-30T17:07:11.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.019+0000 7fe766ffd700 1 --2- 172.21.15.49:0/2552768939 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe75405f150 0x7fe754061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:11.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.020+0000 7fe766ffd700 1 --2- 172.21.15.49:0/2552768939 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe75405f150 0x7fe754061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe7680ae070 tx=0x7fe75c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:11.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.023+0000 7fe74f7fe700 1 -- 172.21.15.49:0/2552768939 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe75804abc0 con 0x7fe7680aa680 2023-11-30T17:07:11.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.199+0000 7fe76cb71700 1 -- 172.21.15.49:0/2552768939 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe76806c7c0 con 0x7fe7680aa680 2023-11-30T17:07:11.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.869+0000 7fe74f7fe700 1 -- 172.21.15.49:0/2552768939 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7fe758017020 con 0x7fe7680aa680 2023-11-30T17:07:11.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.872+0000 7fe76cb71700 1 -- 172.21.15.49:0/2552768939 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe75405f150 msgr2=0x7fe754061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:11.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.872+0000 7fe76cb71700 1 --2- 172.21.15.49:0/2552768939 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe75405f150 0x7fe754061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe7680ae070 tx=0x7fe75c008040).stop 2023-11-30T17:07:11.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.872+0000 7fe76cb71700 1 -- 172.21.15.49:0/2552768939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7680aa680 msgr2=0x7fe76814bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:11.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.872+0000 7fe76cb71700 1 --2- 172.21.15.49:0/2552768939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7680aa680 0x7fe76814bd40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe75800c440 tx=0x7fe758007dc0).stop 2023-11-30T17:07:11.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.872+0000 7fe76cb71700 1 -- 172.21.15.49:0/2552768939 shutdown_connections 2023-11-30T17:07:11.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.872+0000 7fe76cb71700 1 --2- 172.21.15.49:0/2552768939 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7681546b0 0x7fe7680c3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:11.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.872+0000 7fe76cb71700 1 --2- 172.21.15.49:0/2552768939 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe75405f150 0x7fe754061610 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:11.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.872+0000 7fe76cb71700 1 --2- 172.21.15.49:0/2552768939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7680aa680 0x7fe76814bd40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:11.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.872+0000 7fe76cb71700 1 --2- 172.21.15.49:0/2552768939 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7681542d0 0x7fe768147130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:11.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.872+0000 7fe76cb71700 1 -- 172.21.15.49:0/2552768939 >> 172.21.15.49:0/2552768939 conn(0x7fe7680cb010 msgr2=0x7fe76814e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:11.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.873+0000 7fe76cb71700 1 -- 172.21.15.49:0/2552768939 shutdown_connections 2023-11-30T17:07:11.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:11.873+0000 7fe76cb71700 1 -- 172.21.15.49:0/2552768939 wait complete. 2023-11-30T17:07:11.876 INFO:teuthology.orchestra.run.smithi049.stderr:enabled application 'rbd' on pool 'rbd' 2023-11-30T17:07:11.889 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-30T17:07:11.890 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-30T17:07:11.890 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-30T17:07:11.892 INFO:tasks.ceph.mds.a:Started 2023-11-30T17:07:11.892 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-30T17:07:11.892 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-30T17:07:11.894 INFO:tasks.ceph.mds.c:Started 2023-11-30T17:07:11.894 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-30T17:07:11.894 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-30T17:07:11.897 INFO:tasks.ceph.mds.b:Started 2023-11-30T17:07:11.897 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-30T17:07:11.897 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-30T17:07:11.899 INFO:tasks.ceph.mds.d:Started 2023-11-30T17:07:11.899 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-30T17:07:11.900 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:07:11.971 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-11-30T17:07:11.972 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-11-30T17:07:11.980 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-11-30T17:07:11.980 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-11-30T17:07:12.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.025+0000 7fbd1eafe700 1 Processor -- start 2023-11-30T17:07:12.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.025+0000 7fbd1eafe700 1 -- start start 2023-11-30T17:07:12.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.026+0000 7fbd1eafe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbd18157660 0x7fbd18157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:12.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.026+0000 7fbd1eafe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbd180c0180 0x7fbd181589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:12.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.026+0000 7fbd1eafe700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd180c12c0 con 0x7fbd180c1750 2023-11-30T17:07:12.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.026+0000 7fbd1eafe700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd180c06b0 con 0x7fbd180c0180 2023-11-30T17:07:12.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.026+0000 7fbd1eafe700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd180c0990 con 0x7fbd18157660 2023-11-30T17:07:12.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.026+0000 7fbd1d2fb700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbd180c0180 0x7fbd181589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:12.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.026+0000 7fbd1e2fd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbd180c1750 0x7fbd180648d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46826/0 (socket says 172.21.15.49:46826) 2023-11-30T17:07:12.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.026+0000 7fbd1d2fb700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbd180c0180 0x7fbd181589c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45980/0 (socket says 172.21.15.49:45980) 2023-11-30T17:07:12.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.026+0000 7fbd1e2fd700 1 -- 172.21.15.49:0/2353585838 learned_addr learned my addr 172.21.15.49:0/2353585838 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:12.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.026+0000 7fbd1dafc700 1 --2- 172.21.15.49:0/2353585838 >> v2:172.21.15.115:3300/0 conn(0x7fbd18157660 0x7fbd18157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:12.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.027+0000 7fbd1d2fb700 1 -- 172.21.15.49:0/2353585838 >> v2:172.21.15.115:3300/0 conn(0x7fbd18157660 msgr2=0x7fbd18157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:12.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.027+0000 7fbd1d2fb700 1 --2- 172.21.15.49:0/2353585838 >> v2:172.21.15.115:3300/0 conn(0x7fbd18157660 0x7fbd18157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:12.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.027+0000 7fbd1d2fb700 1 -- 172.21.15.49:0/2353585838 >> v1:172.21.15.49:6789/0 conn(0x7fbd180c1750 legacy=0x7fbd180648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:12.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.027+0000 7fbd1cafa700 1 -- 172.21.15.49:0/2353585838 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3650523250 0 0) 0x7fbd180c12c0 con 0x7fbd180c1750 2023-11-30T17:07:12.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.027+0000 7fbd1d2fb700 1 -- 172.21.15.49:0/2353585838 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd180c0c70 con 0x7fbd180c0180 2023-11-30T17:07:12.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.027+0000 7fbd1d2fb700 1 --2- 172.21.15.49:0/2353585838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd180c0180 0x7fbd181589c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fbd180839a0 tx=0x7fbd0c009060).ready entity=mon.0 client_cookie=d198daaf4e1a6cb7 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:12.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.027+0000 7fbd1cafa700 1 -- 172.21.15.49:0/2353585838 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c00f510 con 0x7fbd180c0180 2023-11-30T17:07:12.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.027+0000 7fbd1cafa700 1 -- 172.21.15.49:0/2353585838 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0c00f670 con 0x7fbd180c0180 2023-11-30T17:07:12.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.027+0000 7fbd1cafa700 1 -- 172.21.15.49:0/2353585838 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c00f9f0 con 0x7fbd180c0180 2023-11-30T17:07:12.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.027+0000 7fbd1eafe700 1 -- 172.21.15.49:0/2353585838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd180c0180 msgr2=0x7fbd181589c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:12.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.027+0000 7fbd1eafe700 1 --2- 172.21.15.49:0/2353585838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd180c0180 0x7fbd181589c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fbd180839a0 tx=0x7fbd0c009060).stop 2023-11-30T17:07:12.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.027+0000 7fbd1eafe700 1 -- 172.21.15.49:0/2353585838 shutdown_connections 2023-11-30T17:07:12.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.027+0000 7fbd1eafe700 1 --2- 172.21.15.49:0/2353585838 >> v2:172.21.15.115:3300/0 conn(0x7fbd18157660 0x7fbd18157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:12.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.027+0000 7fbd1eafe700 1 --2- 172.21.15.49:0/2353585838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd180c0180 0x7fbd181589c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:12.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.027+0000 7fbd1eafe700 1 -- 172.21.15.49:0/2353585838 >> 172.21.15.49:0/2353585838 conn(0x7fbd180cb000 msgr2=0x7fbd180cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:12.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.027+0000 7fbd1eafe700 1 -- 172.21.15.49:0/2353585838 shutdown_connections 2023-11-30T17:07:12.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.027+0000 7fbd1eafe700 1 -- 172.21.15.49:0/2353585838 wait complete. 2023-11-30T17:07:12.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.028+0000 7fbd1eafe700 1 Processor -- start 2023-11-30T17:07:12.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.029+0000 7fbd1eafe700 1 -- start start 2023-11-30T17:07:12.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.029+0000 7fbd1eafe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd180c0180 0x7fbd180c2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:12.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.029+0000 7fbd1eafe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd180c1750 0x7fbd18143d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:12.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.029+0000 7fbd1eafe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd18157660 0x7fbd180af230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:12.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.029+0000 7fbd1eafe700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd18164500 con 0x7fbd180c0180 2023-11-30T17:07:12.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.029+0000 7fbd1eafe700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd18144220 con 0x7fbd180c1750 2023-11-30T17:07:12.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.029+0000 7fbd1eafe700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd180c2bf0 con 0x7fbd18157660 2023-11-30T17:07:12.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.029+0000 7fbd1dafc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd180c0180 0x7fbd180c2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:12.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.029+0000 7fbd1dafc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd180c0180 0x7fbd180c2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45982/0 (socket says 172.21.15.49:45982) 2023-11-30T17:07:12.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.029+0000 7fbd1dafc700 1 -- 172.21.15.49:0/887417529 learned_addr learned my addr 172.21.15.49:0/887417529 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:12.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.030+0000 7fbd1d2fb700 1 --2- 172.21.15.49:0/887417529 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd180c1750 0x7fbd18143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:12.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.030+0000 7fbd1dafc700 1 -- 172.21.15.49:0/887417529 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd18157660 msgr2=0x7fbd180af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:12.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.030+0000 7fbd1e2fd700 1 --2- 172.21.15.49:0/887417529 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd18157660 0x7fbd180af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:12.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.030+0000 7fbd1dafc700 1 --2- 172.21.15.49:0/887417529 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd18157660 0x7fbd180af230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:12.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.030+0000 7fbd1dafc700 1 -- 172.21.15.49:0/887417529 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd180c1750 msgr2=0x7fbd18143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:12.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.030+0000 7fbd1dafc700 1 --2- 172.21.15.49:0/887417529 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd180c1750 0x7fbd18143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:12.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.030+0000 7fbd1dafc700 1 -- 172.21.15.49:0/887417529 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0c0092a0 con 0x7fbd180c0180 2023-11-30T17:07:12.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.030+0000 7fbd1d2fb700 1 --2- 172.21.15.49:0/887417529 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd180c1750 0x7fbd18143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:12.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.030+0000 7fbd1e2fd700 1 --2- 172.21.15.49:0/887417529 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd18157660 0x7fbd180af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:12.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.030+0000 7fbd1dafc700 1 --2- 172.21.15.49:0/887417529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd180c0180 0x7fbd180c2540 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fbd10009e70 tx=0x7fbd1000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:12.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.030+0000 7fbd15ffb700 1 -- 172.21.15.49:0/887417529 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1000cbd0 con 0x7fbd180c0180 2023-11-30T17:07:12.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.030+0000 7fbd15ffb700 1 -- 172.21.15.49:0/887417529 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1000f040 con 0x7fbd180c0180 2023-11-30T17:07:12.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.030+0000 7fbd1eafe700 1 -- 172.21.15.49:0/887417529 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd180c2ed0 con 0x7fbd180c0180 2023-11-30T17:07:12.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.030+0000 7fbd15ffb700 1 -- 172.21.15.49:0/887417529 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd10013400 con 0x7fbd180c0180 2023-11-30T17:07:12.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.030+0000 7fbd1eafe700 1 -- 172.21.15.49:0/887417529 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd180c3490 con 0x7fbd180c0180 2023-11-30T17:07:12.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.031+0000 7fbd1eafe700 1 -- 172.21.15.49:0/887417529 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd1806c7c0 con 0x7fbd180c0180 2023-11-30T17:07:12.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.031+0000 7fbd15ffb700 1 -- 172.21.15.49:0/887417529 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fbd100137b0 con 0x7fbd180c0180 2023-11-30T17:07:12.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.032+0000 7fbd15ffb700 1 --2- 172.21.15.49:0/887417529 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbd0405f150 0x7fbd04061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:12.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.032+0000 7fbd15ffb700 1 -- 172.21.15.49:0/887417529 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fbd1007a740 con 0x7fbd180c0180 2023-11-30T17:07:12.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.032+0000 7fbd1d2fb700 1 --2- 172.21.15.49:0/887417529 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbd0405f150 0x7fbd04061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:12.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.033+0000 7fbd1d2fb700 1 --2- 172.21.15.49:0/887417529 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbd0405f150 0x7fbd04061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fbd180477a0 tx=0x7fbd0c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:12.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.036+0000 7fbd15ffb700 1 -- 172.21.15.49:0/887417529 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbd1004bd60 con 0x7fbd180c0180 2023-11-30T17:07:12.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.209+0000 7fbd1eafe700 1 -- 172.21.15.49:0/887417529 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd180c0f50 con 0x7fbd180c0180 2023-11-30T17:07:12.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.209+0000 7fbd15ffb700 1 -- 172.21.15.49:0/887417529 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13722 (secure 0 0 0) 0x7fbd1004f380 con 0x7fbd180c0180 2023-11-30T17:07:12.212 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:12.212 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":17,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:07:11.866542+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:07:12.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.211+0000 7fbd1eafe700 1 -- 172.21.15.49:0/887417529 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbd0405f150 msgr2=0x7fbd04061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:12.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.211+0000 7fbd1eafe700 1 --2- 172.21.15.49:0/887417529 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbd0405f150 0x7fbd04061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fbd180477a0 tx=0x7fbd0c017000).stop 2023-11-30T17:07:12.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.212+0000 7fbd1eafe700 1 -- 172.21.15.49:0/887417529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd180c0180 msgr2=0x7fbd180c2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:12.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.212+0000 7fbd1eafe700 1 --2- 172.21.15.49:0/887417529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd180c0180 0x7fbd180c2540 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fbd10009e70 tx=0x7fbd1000b040).stop 2023-11-30T17:07:12.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.212+0000 7fbd1eafe700 1 -- 172.21.15.49:0/887417529 shutdown_connections 2023-11-30T17:07:12.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.212+0000 7fbd1eafe700 1 --2- 172.21.15.49:0/887417529 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd18157660 0x7fbd180af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:12.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.212+0000 7fbd1eafe700 1 --2- 172.21.15.49:0/887417529 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbd0405f150 0x7fbd04061610 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:12.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.212+0000 7fbd1eafe700 1 --2- 172.21.15.49:0/887417529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd180c0180 0x7fbd180c2540 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:12.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.212+0000 7fbd1eafe700 1 --2- 172.21.15.49:0/887417529 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd180c1750 0x7fbd18143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:12.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.212+0000 7fbd1eafe700 1 -- 172.21.15.49:0/887417529 >> 172.21.15.49:0/887417529 conn(0x7fbd180cb000 msgr2=0x7fbd180ab670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:12.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.212+0000 7fbd1eafe700 1 -- 172.21.15.49:0/887417529 shutdown_connections 2023-11-30T17:07:12.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.212+0000 7fbd1eafe700 1 -- 172.21.15.49:0/887417529 wait complete. 2023-11-30T17:07:12.226 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-11-30T17:07:12.227 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T17:07:12.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.347+0000 7fef43c29700 1 Processor -- start 2023-11-30T17:07:12.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.347+0000 7fef43c29700 1 -- start start 2023-11-30T17:07:12.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.348+0000 7fef43c29700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fef3c062e10 0x7fef3c0a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:12.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.348+0000 7fef43c29700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef3c0c7e30 con 0x7fef3c1547f0 2023-11-30T17:07:12.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.348+0000 7fef43c29700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef3c0bcf40 con 0x7fef3c0c86f0 2023-11-30T17:07:12.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.348+0000 7fef43c29700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef3c0c6b20 con 0x7fef3c062e10 2023-11-30T17:07:12.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.348+0000 7fef419c5700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fef3c1547f0 0x7fef3c0c6fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46828/0 (socket says 172.21.15.49:46828) 2023-11-30T17:07:12.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.348+0000 7fef419c5700 1 -- 172.21.15.49:0/1493948866 learned_addr learned my addr 172.21.15.49:0/1493948866 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:12.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.348+0000 7fef421c6700 1 --2- 172.21.15.49:0/1493948866 >> v2:172.21.15.49:3300/0 conn(0x7fef3c062e10 0x7fef3c0a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:12.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.348+0000 7fef409c3700 1 -- 172.21.15.49:0/1493948866 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3834389661 0 0) 0x7fef3c0c7e30 con 0x7fef3c1547f0 2023-11-30T17:07:12.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.348+0000 7fef409c3700 1 -- 172.21.15.49:0/1493948866 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef280033f0 con 0x7fef3c1547f0 2023-11-30T17:07:12.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.348+0000 7fef421c6700 1 -- 172.21.15.49:0/1493948866 >> v1:172.21.15.115:6789/0 conn(0x7fef3c0c86f0 legacy=0x7fef3c062700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:12.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.348+0000 7fef409c3700 1 -- 172.21.15.49:0/1493948866 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3392940989 0 0) 0x7fef3c0bcf40 con 0x7fef3c0c86f0 2023-11-30T17:07:12.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.348+0000 7fef421c6700 1 -- 172.21.15.49:0/1493948866 >> v1:172.21.15.49:6789/0 conn(0x7fef3c1547f0 legacy=0x7fef3c0c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:12.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.348+0000 7fef421c6700 1 -- 172.21.15.49:0/1493948866 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3c0a77d0 con 0x7fef3c062e10 2023-11-30T17:07:12.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.349+0000 7fef421c6700 1 --2- 172.21.15.49:0/1493948866 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef3c062e10 0x7fef3c0a72e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fef34009e60 tx=0x7fef34009780).ready entity=mon.0 client_cookie=f4e6ce18e6642e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:12.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.349+0000 7fef409c3700 1 -- 172.21.15.49:0/1493948866 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3400e070 con 0x7fef3c062e10 2023-11-30T17:07:12.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.349+0000 7fef409c3700 1 -- 172.21.15.49:0/1493948866 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3400bb60 con 0x7fef3c062e10 2023-11-30T17:07:12.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.349+0000 7fef409c3700 1 -- 172.21.15.49:0/1493948866 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3400bee0 con 0x7fef3c062e10 2023-11-30T17:07:12.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.349+0000 7fef43c29700 1 -- 172.21.15.49:0/1493948866 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef3c062e10 msgr2=0x7fef3c0a72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:12.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.349+0000 7fef43c29700 1 --2- 172.21.15.49:0/1493948866 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef3c062e10 0x7fef3c0a72e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fef34009e60 tx=0x7fef34009780).stop 2023-11-30T17:07:12.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.349+0000 7fef43c29700 1 -- 172.21.15.49:0/1493948866 shutdown_connections 2023-11-30T17:07:12.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.349+0000 7fef43c29700 1 --2- 172.21.15.49:0/1493948866 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef3c062e10 0x7fef3c0a72e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:12.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.349+0000 7fef43c29700 1 -- 172.21.15.49:0/1493948866 >> 172.21.15.49:0/1493948866 conn(0x7fef3c0642d0 msgr2=0x7fef3c0c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:12.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.349+0000 7fef43c29700 1 -- 172.21.15.49:0/1493948866 shutdown_connections 2023-11-30T17:07:12.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.349+0000 7fef43c29700 1 -- 172.21.15.49:0/1493948866 wait complete. 2023-11-30T17:07:12.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.351+0000 7fef43c29700 1 Processor -- start 2023-11-30T17:07:12.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.351+0000 7fef43c29700 1 -- start start 2023-11-30T17:07:12.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.351+0000 7fef43c29700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef3c062e10 0x7fef3c142c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:12.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.351+0000 7fef43c29700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef3c0c86f0 0x7fef3c0aaf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:12.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.351+0000 7fef43c29700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef3c1547f0 0x7fef3c0ab480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:12.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.351+0000 7fef43c29700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c164310 con 0x7fef3c062e10 2023-11-30T17:07:12.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.351+0000 7fef43c29700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c0abff0 con 0x7fef3c1547f0 2023-11-30T17:07:12.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.351+0000 7fef43c29700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c0a7f60 con 0x7fef3c0c86f0 2023-11-30T17:07:12.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.351+0000 7fef419c5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef3c062e10 0x7fef3c142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:12.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.351+0000 7fef419c5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef3c062e10 0x7fef3c142c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46002/0 (socket says 172.21.15.49:46002) 2023-11-30T17:07:12.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.351+0000 7fef419c5700 1 -- 172.21.15.49:0/3609450368 learned_addr learned my addr 172.21.15.49:0/3609450368 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:12.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.352+0000 7fef421c6700 1 --2- 172.21.15.49:0/3609450368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef3c1547f0 0x7fef3c0ab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:12.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.352+0000 7fef411c4700 1 --2- 172.21.15.49:0/3609450368 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef3c0c86f0 0x7fef3c0aaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:12.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.352+0000 7fef419c5700 1 -- 172.21.15.49:0/3609450368 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef3c0c86f0 msgr2=0x7fef3c0aaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:12.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.352+0000 7fef419c5700 1 --2- 172.21.15.49:0/3609450368 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef3c0c86f0 0x7fef3c0aaf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:12.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.352+0000 7fef419c5700 1 -- 172.21.15.49:0/3609450368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef3c1547f0 msgr2=0x7fef3c0ab480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:12.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.352+0000 7fef419c5700 1 --2- 172.21.15.49:0/3609450368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef3c1547f0 0x7fef3c0ab480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:12.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.352+0000 7fef419c5700 1 -- 172.21.15.49:0/3609450368 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef34009a20 con 0x7fef3c062e10 2023-11-30T17:07:12.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.352+0000 7fef419c5700 1 --2- 172.21.15.49:0/3609450368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef3c062e10 0x7fef3c142c80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fef38001c90 tx=0x7fef38007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:12.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.352+0000 7fef31ffb700 1 -- 172.21.15.49:0/3609450368 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef38007110 con 0x7fef3c062e10 2023-11-30T17:07:12.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.352+0000 7fef31ffb700 1 -- 172.21.15.49:0/3609450368 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef38007270 con 0x7fef3c062e10 2023-11-30T17:07:12.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.352+0000 7fef43c29700 1 -- 172.21.15.49:0/3609450368 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef3c0aba30 con 0x7fef3c062e10 2023-11-30T17:07:12.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.352+0000 7fef31ffb700 1 -- 172.21.15.49:0/3609450368 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef38007630 con 0x7fef3c062e10 2023-11-30T17:07:12.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.352+0000 7fef43c29700 1 -- 172.21.15.49:0/3609450368 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef3c0a7bf0 con 0x7fef3c062e10 2023-11-30T17:07:12.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.353+0000 7fef43c29700 1 -- 172.21.15.49:0/3609450368 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef3c06c860 con 0x7fef3c062e10 2023-11-30T17:07:12.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.354+0000 7fef31ffb700 1 -- 172.21.15.49:0/3609450368 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fef3800aa80 con 0x7fef3c062e10 2023-11-30T17:07:12.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.354+0000 7fef31ffb700 1 --2- 172.21.15.49:0/3609450368 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fef2005f150 0x7fef20061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:12.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.354+0000 7fef31ffb700 1 -- 172.21.15.49:0/3609450368 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fef380819c0 con 0x7fef3c062e10 2023-11-30T17:07:12.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.354+0000 7fef411c4700 1 --2- 172.21.15.49:0/3609450368 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fef2005f150 0x7fef20061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:12.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.355+0000 7fef411c4700 1 --2- 172.21.15.49:0/3609450368 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fef2005f150 0x7fef20061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fef2c007fd0 tx=0x7fef2c007bb0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:12.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.358+0000 7fef31ffb700 1 -- 172.21.15.49:0/3609450368 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fef38052fe0 con 0x7fef3c062e10 2023-11-30T17:07:12.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.531+0000 7fef43c29700 1 -- 172.21.15.49:0/3609450368 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fef3c065290 con 0x7fef3c062e10 2023-11-30T17:07:12.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.531+0000 7fef31ffb700 1 -- 172.21.15.49:0/3609450368 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7fef38022030 con 0x7fef3c062e10 2023-11-30T17:07:12.533 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T17:07:12.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.533+0000 7fef43c29700 1 -- 172.21.15.49:0/3609450368 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fef2005f150 msgr2=0x7fef20061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:12.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.533+0000 7fef43c29700 1 --2- 172.21.15.49:0/3609450368 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fef2005f150 0x7fef20061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fef2c007fd0 tx=0x7fef2c007bb0).stop 2023-11-30T17:07:12.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.533+0000 7fef43c29700 1 -- 172.21.15.49:0/3609450368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef3c062e10 msgr2=0x7fef3c142c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:12.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.533+0000 7fef43c29700 1 --2- 172.21.15.49:0/3609450368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef3c062e10 0x7fef3c142c80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fef38001c90 tx=0x7fef38007c70).stop 2023-11-30T17:07:12.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.533+0000 7fef43c29700 1 -- 172.21.15.49:0/3609450368 shutdown_connections 2023-11-30T17:07:12.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.533+0000 7fef43c29700 1 --2- 172.21.15.49:0/3609450368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef3c1547f0 0x7fef3c0ab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:12.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.533+0000 7fef43c29700 1 --2- 172.21.15.49:0/3609450368 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fef2005f150 0x7fef20061610 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:12.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.533+0000 7fef43c29700 1 --2- 172.21.15.49:0/3609450368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef3c062e10 0x7fef3c142c80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:12.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.533+0000 7fef43c29700 1 --2- 172.21.15.49:0/3609450368 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef3c0c86f0 0x7fef3c0aaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:12.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.533+0000 7fef43c29700 1 -- 172.21.15.49:0/3609450368 >> 172.21.15.49:0/3609450368 conn(0x7fef3c0642d0 msgr2=0x7fef3c0c5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:12.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.533+0000 7fef43c29700 1 -- 172.21.15.49:0/3609450368 shutdown_connections 2023-11-30T17:07:12.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.533+0000 7fef43c29700 1 -- 172.21.15.49:0/3609450368 wait complete. 2023-11-30T17:07:12.547 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T17:07:12.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.666+0000 7f5e1e04a700 1 Processor -- start 2023-11-30T17:07:12.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.666+0000 7f5e1e04a700 1 -- start start 2023-11-30T17:07:12.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.667+0000 7f5e1e04a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5e180c66f0 0x7f5e18154950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.667+0000 7f5e1e04a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5e18158570 0x7f5e18158a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.667+0000 7f5e1e04a700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e18154e40 con 0x7f5e1814e530 2023-11-30T17:07:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.667+0000 7f5e1e04a700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e180c6ba0 con 0x7f5e18158570 2023-11-30T17:07:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.667+0000 7f5e1e04a700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e180c7bc0 con 0x7f5e180c66f0 2023-11-30T17:07:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.667+0000 7f5e1d849700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5e18158570 0x7f5e18158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.667+0000 7f5e1d849700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5e18158570 0x7f5e18158a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46006/0 (socket says 172.21.15.49:46006) 2023-11-30T17:07:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.667+0000 7f5e1d849700 1 -- 172.21.15.49:0/33418708 learned_addr learned my addr 172.21.15.49:0/33418708 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.667+0000 7f5e1c847700 1 --2- 172.21.15.49:0/33418708 >> v2:172.21.15.115:3300/0 conn(0x7f5e180c66f0 0x7f5e18154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.667+0000 7f5e1d849700 1 -- 172.21.15.49:0/33418708 >> v2:172.21.15.115:3300/0 conn(0x7f5e180c66f0 msgr2=0x7f5e18154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.667+0000 7f5e1d849700 1 --2- 172.21.15.49:0/33418708 >> v2:172.21.15.115:3300/0 conn(0x7f5e180c66f0 0x7f5e18154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.667+0000 7f5e1d849700 1 -- 172.21.15.49:0/33418708 >> v1:172.21.15.115:6789/0 conn(0x7f5e1814e530 legacy=0x7f5e1814e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.667+0000 7f5e1d849700 1 -- 172.21.15.49:0/33418708 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e18155920 con 0x7f5e18158570 2023-11-30T17:07:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.667+0000 7f5e1c847700 1 --2- 172.21.15.49:0/33418708 >> v2:172.21.15.115:3300/0 conn(0x7f5e180c66f0 0x7f5e18154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:07:12.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.667+0000 7f5e1d849700 1 --2- 172.21.15.49:0/33418708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e18158570 0x7f5e18158a00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f5e180ab0a0 tx=0x7f5e100090f0).ready entity=mon.0 client_cookie=eaf9d158425a4e99 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:12.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.667+0000 7f5e17fff700 1 -- 172.21.15.49:0/33418708 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1000b520 con 0x7f5e18158570 2023-11-30T17:07:12.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.667+0000 7f5e17fff700 1 -- 172.21.15.49:0/33418708 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1000b680 con 0x7f5e18158570 2023-11-30T17:07:12.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.667+0000 7f5e17fff700 1 -- 172.21.15.49:0/33418708 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1000ba00 con 0x7f5e18158570 2023-11-30T17:07:12.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.668+0000 7f5e1e04a700 1 -- 172.21.15.49:0/33418708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e18158570 msgr2=0x7f5e18158a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:12.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.668+0000 7f5e1e04a700 1 --2- 172.21.15.49:0/33418708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e18158570 0x7f5e18158a00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f5e180ab0a0 tx=0x7f5e100090f0).stop 2023-11-30T17:07:12.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.668+0000 7f5e1e04a700 1 -- 172.21.15.49:0/33418708 shutdown_connections 2023-11-30T17:07:12.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.668+0000 7f5e1e04a700 1 --2- 172.21.15.49:0/33418708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e18158570 0x7f5e18158a00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:12.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.668+0000 7f5e1e04a700 1 --2- 172.21.15.49:0/33418708 >> v2:172.21.15.115:3300/0 conn(0x7f5e180c66f0 0x7f5e18154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:12.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.668+0000 7f5e1e04a700 1 -- 172.21.15.49:0/33418708 >> 172.21.15.49:0/33418708 conn(0x7f5e18064990 msgr2=0x7f5e18064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:12.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.668+0000 7f5e1e04a700 1 -- 172.21.15.49:0/33418708 shutdown_connections 2023-11-30T17:07:12.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.668+0000 7f5e1e04a700 1 -- 172.21.15.49:0/33418708 wait complete. 2023-11-30T17:07:12.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.669+0000 7f5e1e04a700 1 Processor -- start 2023-11-30T17:07:12.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.669+0000 7f5e1e04a700 1 -- start start 2023-11-30T17:07:12.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.670+0000 7f5e1e04a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e180c66f0 0x7f5e180c2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.670+0000 7f5e1e04a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e1814e530 0x7f5e1814dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.670+0000 7f5e1e04a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e18158570 0x7f5e1814d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.670+0000 7f5e1e04a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1814e240 con 0x7f5e1814e530 2023-11-30T17:07:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.670+0000 7f5e1e04a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e180c3000 con 0x7f5e18158570 2023-11-30T17:07:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.670+0000 7f5e1e04a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e180c32e0 con 0x7f5e180c66f0 2023-11-30T17:07:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.670+0000 7f5e1c847700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e1814e530 0x7f5e1814dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.670+0000 7f5e1c847700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e1814e530 0x7f5e1814dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46012/0 (socket says 172.21.15.49:46012) 2023-11-30T17:07:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.670+0000 7f5e1c847700 1 -- 172.21.15.49:0/2345159102 learned_addr learned my addr 172.21.15.49:0/2345159102 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.670+0000 7f5e1d849700 1 --2- 172.21.15.49:0/2345159102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e18158570 0x7f5e1814d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.670+0000 7f5e1d048700 1 --2- 172.21.15.49:0/2345159102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e180c66f0 0x7f5e180c2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.670+0000 7f5e1c847700 1 -- 172.21.15.49:0/2345159102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e180c66f0 msgr2=0x7f5e180c2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.670+0000 7f5e1c847700 1 --2- 172.21.15.49:0/2345159102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e180c66f0 0x7f5e180c2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.670+0000 7f5e1c847700 1 -- 172.21.15.49:0/2345159102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e18158570 msgr2=0x7f5e1814d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.670+0000 7f5e1c847700 1 --2- 172.21.15.49:0/2345159102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e18158570 0x7f5e1814d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.670+0000 7f5e1c847700 1 -- 172.21.15.49:0/2345159102 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0c0092a0 con 0x7f5e1814e530 2023-11-30T17:07:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.671+0000 7f5e1c847700 1 --2- 172.21.15.49:0/2345159102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e1814e530 0x7f5e1814dd50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f5e0c00e980 tx=0x7f5e0c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.671+0000 7f5e157fa700 1 -- 172.21.15.49:0/2345159102 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c00c850 con 0x7f5e1814e530 2023-11-30T17:07:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.671+0000 7f5e157fa700 1 -- 172.21.15.49:0/2345159102 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0c00c9b0 con 0x7f5e1814e530 2023-11-30T17:07:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.671+0000 7f5e1e04a700 1 -- 172.21.15.49:0/2345159102 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e10009370 con 0x7f5e1814e530 2023-11-30T17:07:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.671+0000 7f5e157fa700 1 -- 172.21.15.49:0/2345159102 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c00cd30 con 0x7f5e1814e530 2023-11-30T17:07:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.671+0000 7f5e1e04a700 1 -- 172.21.15.49:0/2345159102 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e180c38a0 con 0x7f5e1814e530 2023-11-30T17:07:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.672+0000 7f5e1e04a700 1 -- 172.21.15.49:0/2345159102 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e18062ee0 con 0x7f5e1814e530 2023-11-30T17:07:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.672+0000 7f5e157fa700 1 -- 172.21.15.49:0/2345159102 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5e0c012600 con 0x7f5e1814e530 2023-11-30T17:07:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.672+0000 7f5e157fa700 1 --2- 172.21.15.49:0/2345159102 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5e0405f150 0x7f5e04061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.673+0000 7f5e157fa700 1 -- 172.21.15.49:0/2345159102 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f5e0c07a4b0 con 0x7f5e1814e530 2023-11-30T17:07:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.673+0000 7f5e1d048700 1 --2- 172.21.15.49:0/2345159102 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5e0405f150 0x7f5e04061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.673+0000 7f5e1d048700 1 --2- 172.21.15.49:0/2345159102 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5e0405f150 0x7f5e04061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f5e18156950 tx=0x7f5e08009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:12.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.677+0000 7f5e157fa700 1 -- 172.21.15.49:0/2345159102 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5e0c04bad0 con 0x7f5e1814e530 2023-11-30T17:07:12.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.849+0000 7f5e1e04a700 1 -- 172.21.15.49:0/2345159102 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5e1806c7c0 con 0x7f5e1814e530 2023-11-30T17:07:12.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.850+0000 7f5e157fa700 1 -- 172.21.15.49:0/2345159102 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5e0c04f0f0 con 0x7f5e1814e530 2023-11-30T17:07:12.852 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T17:07:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.852+0000 7f5e1e04a700 1 -- 172.21.15.49:0/2345159102 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5e0405f150 msgr2=0x7f5e04061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.852+0000 7f5e1e04a700 1 --2- 172.21.15.49:0/2345159102 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5e0405f150 0x7f5e04061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f5e18156950 tx=0x7f5e08009040).stop 2023-11-30T17:07:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.852+0000 7f5e1e04a700 1 -- 172.21.15.49:0/2345159102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e1814e530 msgr2=0x7f5e1814dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.852+0000 7f5e1e04a700 1 --2- 172.21.15.49:0/2345159102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e1814e530 0x7f5e1814dd50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f5e0c00e980 tx=0x7f5e0c009060).stop 2023-11-30T17:07:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.852+0000 7f5e1e04a700 1 -- 172.21.15.49:0/2345159102 shutdown_connections 2023-11-30T17:07:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.852+0000 7f5e1e04a700 1 --2- 172.21.15.49:0/2345159102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e18158570 0x7f5e1814d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.852+0000 7f5e1e04a700 1 --2- 172.21.15.49:0/2345159102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e180c66f0 0x7f5e180c2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.852+0000 7f5e1e04a700 1 --2- 172.21.15.49:0/2345159102 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5e0405f150 0x7f5e04061610 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.852+0000 7f5e1e04a700 1 --2- 172.21.15.49:0/2345159102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e1814e530 0x7f5e1814dd50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.852+0000 7f5e1e04a700 1 -- 172.21.15.49:0/2345159102 >> 172.21.15.49:0/2345159102 conn(0x7f5e18064990 msgr2=0x7f5e18157230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.852+0000 7f5e1e04a700 1 -- 172.21.15.49:0/2345159102 shutdown_connections 2023-11-30T17:07:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.852+0000 7f5e1e04a700 1 -- 172.21.15.49:0/2345159102 wait complete. 2023-11-30T17:07:12.866 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:07:12.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.983+0000 7f23948c0700 1 Processor -- start 2023-11-30T17:07:12.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.983+0000 7f23948c0700 1 -- start start 2023-11-30T17:07:12.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.984+0000 7f23948c0700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2390067cb0 0x7f23900c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:12.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.984+0000 7f23948c0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2390068090 0x7f23900c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:12.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.984+0000 7f23948c0700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2390154d20 con 0x7f23900c2640 2023-11-30T17:07:12.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.984+0000 7f23948c0700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2390151670 con 0x7f2390067cb0 2023-11-30T17:07:12.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.984+0000 7f23948c0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23900c48a0 con 0x7f2390068090 2023-11-30T17:07:12.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.984+0000 7f2385d9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2390068090 0x7f23900c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:12.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.984+0000 7f238e59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2390067cb0 0x7f23900c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:12.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.984+0000 7f2385d9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2390068090 0x7f23900c43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:55456/0 (socket says 172.21.15.49:55456) 2023-11-30T17:07:12.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.984+0000 7f238ed9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f23900c2640 0x7f23900c2ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:59658/0 (socket says 172.21.15.49:59658) 2023-11-30T17:07:12.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.984+0000 7f238e59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2390067cb0 0x7f23900c3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:36902/0 (socket says 172.21.15.49:36902) 2023-11-30T17:07:12.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.984+0000 7f2385d9b700 1 -- 172.21.15.49:0/395130841 learned_addr learned my addr 172.21.15.49:0/395130841 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:12.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.984+0000 7f2385d9b700 1 -- 172.21.15.49:0/395130841 >> v2:172.21.15.115:3300/0 conn(0x7f2390067cb0 msgr2=0x7f23900c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:12.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.984+0000 7f2385d9b700 1 --2- 172.21.15.49:0/395130841 >> v2:172.21.15.115:3300/0 conn(0x7f2390067cb0 0x7f23900c3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:12.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.984+0000 7f2385d9b700 1 -- 172.21.15.49:0/395130841 >> v1:172.21.15.115:6789/0 conn(0x7f23900c2640 legacy=0x7f23900c2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:12.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.984+0000 7f2385d9b700 1 -- 172.21.15.49:0/395130841 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23900a7490 con 0x7f2390068090 2023-11-30T17:07:12.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.984+0000 7f238dd9b700 1 -- 172.21.15.49:0/395130841 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437683090 0 0) 0x7f2390154d20 con 0x7f23900c2640 2023-11-30T17:07:12.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.984+0000 7f238e59c700 1 --2- 172.21.15.49:0/395130841 >> v2:172.21.15.115:3300/0 conn(0x7f2390067cb0 0x7f23900c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:07:12.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.985+0000 7f2385d9b700 1 --2- 172.21.15.49:0/395130841 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2390068090 0x7f23900c43b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f2378006fd0 tx=0x7f23780090f0).ready entity=mon.2 client_cookie=cc2ed0bafa5b68fc server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:12.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.985+0000 7f238dd9b700 1 -- 172.21.15.49:0/395130841 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237800b580 con 0x7f2390068090 2023-11-30T17:07:12.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.985+0000 7f238dd9b700 1 -- 172.21.15.49:0/395130841 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237800b6e0 con 0x7f2390068090 2023-11-30T17:07:12.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.985+0000 7f238dd9b700 1 -- 172.21.15.49:0/395130841 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237800ba60 con 0x7f2390068090 2023-11-30T17:07:12.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.985+0000 7f23948c0700 1 -- 172.21.15.49:0/395130841 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2390068090 msgr2=0x7f23900c43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:12.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.985+0000 7f23948c0700 1 --2- 172.21.15.49:0/395130841 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2390068090 0x7f23900c43b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f2378006fd0 tx=0x7f23780090f0).stop 2023-11-30T17:07:12.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.985+0000 7f23948c0700 1 -- 172.21.15.49:0/395130841 shutdown_connections 2023-11-30T17:07:12.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.985+0000 7f23948c0700 1 --2- 172.21.15.49:0/395130841 >> v2:172.21.15.115:3300/0 conn(0x7f2390067cb0 0x7f23900c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:12.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.985+0000 7f23948c0700 1 --2- 172.21.15.49:0/395130841 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2390068090 0x7f23900c43b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:12.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.985+0000 7f23948c0700 1 -- 172.21.15.49:0/395130841 >> 172.21.15.49:0/395130841 conn(0x7f23900c7fd0 msgr2=0x7f23900c83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:12.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.985+0000 7f23948c0700 1 -- 172.21.15.49:0/395130841 shutdown_connections 2023-11-30T17:07:12.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.985+0000 7f23948c0700 1 -- 172.21.15.49:0/395130841 wait complete. 2023-11-30T17:07:12.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.987+0000 7f23948c0700 1 Processor -- start 2023-11-30T17:07:12.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.987+0000 7f23948c0700 1 -- start start 2023-11-30T17:07:12.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.987+0000 7f23948c0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2390067cb0 0x7f23900acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:12.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.987+0000 7f23948c0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2390068090 0x7f2390150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:12.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.987+0000 7f23948c0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23900c2640 0x7f23900c01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:12.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.987+0000 7f23948c0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23900ad720 con 0x7f2390068090 2023-11-30T17:07:12.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.987+0000 7f23948c0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2390151960 con 0x7f23900c2640 2023-11-30T17:07:12.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.987+0000 7f23948c0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2390151c40 con 0x7f2390067cb0 2023-11-30T17:07:12.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.987+0000 7f2385d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2390068090 0x7f2390150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:12.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.987+0000 7f2385d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2390068090 0x7f2390150870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46018/0 (socket says 172.21.15.49:46018) 2023-11-30T17:07:12.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.987+0000 7f2385d9b700 1 -- 172.21.15.49:0/3436253562 learned_addr learned my addr 172.21.15.49:0/3436253562 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:12.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.988+0000 7f238e59c700 1 --2- 172.21.15.49:0/3436253562 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2390067cb0 0x7f23900acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:12.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.988+0000 7f238ed9d700 1 --2- 172.21.15.49:0/3436253562 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23900c2640 0x7f23900c01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:12.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.988+0000 7f2385d9b700 1 -- 172.21.15.49:0/3436253562 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2390067cb0 msgr2=0x7f23900acdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:12.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.988+0000 7f2385d9b700 1 --2- 172.21.15.49:0/3436253562 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2390067cb0 0x7f23900acdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:12.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.988+0000 7f2385d9b700 1 -- 172.21.15.49:0/3436253562 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23900c2640 msgr2=0x7f23900c01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:12.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.988+0000 7f2385d9b700 1 --2- 172.21.15.49:0/3436253562 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23900c2640 0x7f23900c01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:12.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.988+0000 7f2385d9b700 1 -- 172.21.15.49:0/3436253562 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23800092a0 con 0x7f2390068090 2023-11-30T17:07:12.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.988+0000 7f2385d9b700 1 --2- 172.21.15.49:0/3436253562 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2390068090 0x7f2390150870 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f2390154c80 tx=0x7f2378017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:12.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.988+0000 7f2386ffd700 1 -- 172.21.15.49:0/3436253562 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2378000bc0 con 0x7f2390068090 2023-11-30T17:07:12.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.988+0000 7f2386ffd700 1 -- 172.21.15.49:0/3436253562 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237800b850 con 0x7f2390068090 2023-11-30T17:07:12.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.988+0000 7f23948c0700 1 -- 172.21.15.49:0/3436253562 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2378009370 con 0x7f2390068090 2023-11-30T17:07:12.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.988+0000 7f2386ffd700 1 -- 172.21.15.49:0/3436253562 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2378000d20 con 0x7f2390068090 2023-11-30T17:07:12.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.988+0000 7f23948c0700 1 -- 172.21.15.49:0/3436253562 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2390152200 con 0x7f2390068090 2023-11-30T17:07:12.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.989+0000 7f23948c0700 1 -- 172.21.15.49:0/3436253562 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f239006c860 con 0x7f2390068090 2023-11-30T17:07:12.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.989+0000 7f2386ffd700 1 -- 172.21.15.49:0/3436253562 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f237801cad0 con 0x7f2390068090 2023-11-30T17:07:12.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.990+0000 7f2386ffd700 1 --2- 172.21.15.49:0/3436253562 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f237005f150 0x7f2370061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:12.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.990+0000 7f2386ffd700 1 -- 172.21.15.49:0/3436253562 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f237807b9f0 con 0x7f2390068090 2023-11-30T17:07:12.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.990+0000 7f238e59c700 1 --2- 172.21.15.49:0/3436253562 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f237005f150 0x7f2370061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:12.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.990+0000 7f238e59c700 1 --2- 172.21.15.49:0/3436253562 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f237005f150 0x7f2370061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f2380009dc0 tx=0x7f2380009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:12.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:12.994+0000 7f2386ffd700 1 -- 172.21.15.49:0/3436253562 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f237804d010 con 0x7f2390068090 2023-11-30T17:07:13.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.210+0000 7f23948c0700 1 -- 172.21.15.49:0/3436253562 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23900a7490 con 0x7f2390068090 2023-11-30T17:07:13.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.211+0000 7f2386ffd700 1 -- 172.21.15.49:0/3436253562 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7f23900a7490 con 0x7f2390068090 2023-11-30T17:07:13.213 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:13.214 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/4055676379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":4055676379},{"type":"v1","addr":"172.21.15.115:6835","nonce":4055676379}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1595689264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1595689264},{"type":"v1","addr":"172.21.15.115:6837","nonce":1595689264}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/124650277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":124650277},{"type":"v1","addr":"172.21.15.49:6834","nonce":124650277}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2333639572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2333639572},{"type":"v1","addr":"172.21.15.49:6835","nonce":2333639572}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-11-30T17:07:13.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.213+0000 7f23948c0700 1 -- 172.21.15.49:0/3436253562 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f237005f150 msgr2=0x7f2370061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:13.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.213+0000 7f23948c0700 1 --2- 172.21.15.49:0/3436253562 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f237005f150 0x7f2370061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f2380009dc0 tx=0x7f2380009060).stop 2023-11-30T17:07:13.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.213+0000 7f23948c0700 1 -- 172.21.15.49:0/3436253562 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2390068090 msgr2=0x7f2390150870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:13.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.213+0000 7f23948c0700 1 --2- 172.21.15.49:0/3436253562 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2390068090 0x7f2390150870 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f2390154c80 tx=0x7f2378017000).stop 2023-11-30T17:07:13.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.213+0000 7f23948c0700 1 -- 172.21.15.49:0/3436253562 shutdown_connections 2023-11-30T17:07:13.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.213+0000 7f23948c0700 1 --2- 172.21.15.49:0/3436253562 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23900c2640 0x7f23900c01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:13.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.213+0000 7f23948c0700 1 --2- 172.21.15.49:0/3436253562 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2390067cb0 0x7f23900acdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:13.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.213+0000 7f23948c0700 1 --2- 172.21.15.49:0/3436253562 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f237005f150 0x7f2370061610 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:13.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.213+0000 7f23948c0700 1 --2- 172.21.15.49:0/3436253562 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2390068090 0x7f2390150870 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:13.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.213+0000 7f23948c0700 1 -- 172.21.15.49:0/3436253562 >> 172.21.15.49:0/3436253562 conn(0x7f23900c7fd0 msgr2=0x7f23900c5da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:13.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.213+0000 7f23948c0700 1 -- 172.21.15.49:0/3436253562 shutdown_connections 2023-11-30T17:07:13.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.213+0000 7f23948c0700 1 -- 172.21.15.49:0/3436253562 wait complete. 2023-11-30T17:07:13.217 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 3 2023-11-30T17:07:13.228 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:07:13.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.343+0000 7f9aae65a700 1 Processor -- start 2023-11-30T17:07:13.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.343+0000 7f9aae65a700 1 -- start start 2023-11-30T17:07:13.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.343+0000 7f9aae65a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9aa80cae90 0x7f9aa80c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:13.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.344+0000 7f9aae65a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9aa80ca180 0x7f9aa80c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:13.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.344+0000 7f9aae65a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa80a9a90 con 0x7f9aa80caab0 2023-11-30T17:07:13.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.344+0000 7f9aae65a700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa80c1490 con 0x7f9aa80cae90 2023-11-30T17:07:13.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.344+0000 7f9aae65a700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa8154ce0 con 0x7f9aa80ca180 2023-11-30T17:07:13.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.344+0000 7f9aa77fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9aa80cae90 0x7f9aa80c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:13.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.344+0000 7f9aa7fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9aa80caab0 0x7f9aa80aa470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46832/0 (socket says 172.21.15.49:46832) 2023-11-30T17:07:13.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.344+0000 7f9aa7fff700 1 -- 172.21.15.49:0/1885756762 learned_addr learned my addr 172.21.15.49:0/1885756762 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:13.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.344+0000 7f9aacbf7700 1 --2- 172.21.15.49:0/1885756762 >> v2:172.21.15.115:3300/0 conn(0x7f9aa80ca180 0x7f9aa80c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:13.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.344+0000 7f9aa77fe700 1 -- 172.21.15.49:0/1885756762 >> v2:172.21.15.115:3300/0 conn(0x7f9aa80ca180 msgr2=0x7f9aa80c0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:13.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.344+0000 7f9aa77fe700 1 --2- 172.21.15.49:0/1885756762 >> v2:172.21.15.115:3300/0 conn(0x7f9aa80ca180 0x7f9aa80c0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:13.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.344+0000 7f9aa77fe700 1 -- 172.21.15.49:0/1885756762 >> v1:172.21.15.49:6789/0 conn(0x7f9aa80caab0 legacy=0x7f9aa80aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:13.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.344+0000 7f9aa6ffd700 1 -- 172.21.15.49:0/1885756762 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3523076900 0 0) 0x7f9aa80a9a90 con 0x7f9aa80caab0 2023-11-30T17:07:13.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.344+0000 7f9aa77fe700 1 -- 172.21.15.49:0/1885756762 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa80aab80 con 0x7f9aa80cae90 2023-11-30T17:07:13.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.344+0000 7f9aa77fe700 1 --2- 172.21.15.49:0/1885756762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9aa80cae90 0x7f9aa80c0ab0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f9aa80a9a00 tx=0x7f9a9c009060).ready entity=mon.0 client_cookie=fd770f6a3151ca6a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:13.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.344+0000 7f9aa6ffd700 1 -- 172.21.15.49:0/1885756762 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c00b580 con 0x7f9aa80cae90 2023-11-30T17:07:13.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.344+0000 7f9aa6ffd700 1 -- 172.21.15.49:0/1885756762 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9c00b6e0 con 0x7f9aa80cae90 2023-11-30T17:07:13.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.344+0000 7f9aa6ffd700 1 -- 172.21.15.49:0/1885756762 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c00ba60 con 0x7f9aa80cae90 2023-11-30T17:07:13.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.345+0000 7f9aae65a700 1 -- 172.21.15.49:0/1885756762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9aa80cae90 msgr2=0x7f9aa80c0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:13.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.345+0000 7f9aae65a700 1 --2- 172.21.15.49:0/1885756762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9aa80cae90 0x7f9aa80c0ab0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f9aa80a9a00 tx=0x7f9a9c009060).stop 2023-11-30T17:07:13.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.345+0000 7f9aae65a700 1 -- 172.21.15.49:0/1885756762 shutdown_connections 2023-11-30T17:07:13.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.345+0000 7f9aae65a700 1 --2- 172.21.15.49:0/1885756762 >> v2:172.21.15.115:3300/0 conn(0x7f9aa80ca180 0x7f9aa80c0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:13.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.345+0000 7f9aae65a700 1 --2- 172.21.15.49:0/1885756762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9aa80cae90 0x7f9aa80c0ab0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:13.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.345+0000 7f9aae65a700 1 -- 172.21.15.49:0/1885756762 >> 172.21.15.49:0/1885756762 conn(0x7f9aa8094920 msgr2=0x7f9aa806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:13.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.345+0000 7f9aae65a700 1 -- 172.21.15.49:0/1885756762 shutdown_connections 2023-11-30T17:07:13.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.345+0000 7f9aae65a700 1 -- 172.21.15.49:0/1885756762 wait complete. 2023-11-30T17:07:13.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.346+0000 7f9aae65a700 1 Processor -- start 2023-11-30T17:07:13.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.346+0000 7f9aae65a700 1 -- start start 2023-11-30T17:07:13.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.347+0000 7f9aae65a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9aa80ca180 0x7f9aa814e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:13.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.347+0000 7f9aae65a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9aa80caab0 0x7f9aa8153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:13.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.347+0000 7f9aae65a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9aa80cae90 0x7f9aa8153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:13.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.347+0000 7f9aae65a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa80c7fe0 con 0x7f9aa80ca180 2023-11-30T17:07:13.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.347+0000 7f9aae65a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa8154120 con 0x7f9aa80cae90 2023-11-30T17:07:13.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.347+0000 7f9aae65a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa80afdd0 con 0x7f9aa80caab0 2023-11-30T17:07:13.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.347+0000 7f9aa7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9aa80ca180 0x7f9aa814e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:13.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.347+0000 7f9aa7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9aa80ca180 0x7f9aa814e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46036/0 (socket says 172.21.15.49:46036) 2023-11-30T17:07:13.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.347+0000 7f9aa7fff700 1 -- 172.21.15.49:0/417438856 learned_addr learned my addr 172.21.15.49:0/417438856 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:13.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.347+0000 7f9aa77fe700 1 --2- 172.21.15.49:0/417438856 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9aa80caab0 0x7f9aa8153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:13.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.347+0000 7f9aacbf7700 1 --2- 172.21.15.49:0/417438856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9aa80cae90 0x7f9aa8153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:13.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.347+0000 7f9aa7fff700 1 -- 172.21.15.49:0/417438856 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9aa80caab0 msgr2=0x7f9aa8153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:13.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.347+0000 7f9aa7fff700 1 --2- 172.21.15.49:0/417438856 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9aa80caab0 0x7f9aa8153740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:13.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.347+0000 7f9aa7fff700 1 -- 172.21.15.49:0/417438856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9aa80cae90 msgr2=0x7f9aa8153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:13.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.347+0000 7f9aa7fff700 1 --2- 172.21.15.49:0/417438856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9aa80cae90 0x7f9aa8153c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:13.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.347+0000 7f9aa7fff700 1 -- 172.21.15.49:0/417438856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a9c0092a0 con 0x7f9aa80ca180 2023-11-30T17:07:13.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.347+0000 7f9aa77fe700 1 --2- 172.21.15.49:0/417438856 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9aa80caab0 0x7f9aa8153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:13.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.347+0000 7f9aacbf7700 1 --2- 172.21.15.49:0/417438856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9aa80cae90 0x7f9aa8153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:13.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.348+0000 7f9aa7fff700 1 --2- 172.21.15.49:0/417438856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9aa80ca180 0x7f9aa814e460 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f9a98001360 tx=0x7f9a98007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:13.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.348+0000 7f9a8ffff700 1 -- 172.21.15.49:0/417438856 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a980072e0 con 0x7f9aa80ca180 2023-11-30T17:07:13.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.348+0000 7f9a8ffff700 1 -- 172.21.15.49:0/417438856 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a98007460 con 0x7f9aa80ca180 2023-11-30T17:07:13.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.348+0000 7f9aae65a700 1 -- 172.21.15.49:0/417438856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa8155350 con 0x7f9aa80ca180 2023-11-30T17:07:13.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.348+0000 7f9a8ffff700 1 -- 172.21.15.49:0/417438856 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a980058c0 con 0x7f9aa80ca180 2023-11-30T17:07:13.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.348+0000 7f9aae65a700 1 -- 172.21.15.49:0/417438856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa80afaf0 con 0x7f9aa80ca180 2023-11-30T17:07:13.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.349+0000 7f9aae65a700 1 -- 172.21.15.49:0/417438856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa80ca560 con 0x7f9aa80ca180 2023-11-30T17:07:13.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.349+0000 7f9a8ffff700 1 -- 172.21.15.49:0/417438856 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9a98005c70 con 0x7f9aa80ca180 2023-11-30T17:07:13.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.349+0000 7f9a8ffff700 1 --2- 172.21.15.49:0/417438856 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a9405f150 0x7f9a94061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:13.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.349+0000 7f9a8ffff700 1 -- 172.21.15.49:0/417438856 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f9a98079660 con 0x7f9aa80ca180 2023-11-30T17:07:13.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.349+0000 7f9aa77fe700 1 --2- 172.21.15.49:0/417438856 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a9405f150 0x7f9a94061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:13.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.350+0000 7f9aa77fe700 1 --2- 172.21.15.49:0/417438856 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a9405f150 0x7f9a94061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f9a9c009fd0 tx=0x7f9a9c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:13.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.353+0000 7f9a8ffff700 1 -- 172.21.15.49:0/417438856 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9a9804ac80 con 0x7f9aa80ca180 2023-11-30T17:07:13.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.524+0000 7f9aae65a700 1 -- 172.21.15.49:0/417438856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9aa806c860 con 0x7f9aa80ca180 2023-11-30T17:07:13.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.525+0000 7f9a8ffff700 1 -- 172.21.15.49:0/417438856 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13709 (secure 0 0 0) 0x7f9a9804e2a0 con 0x7f9aa80ca180 2023-11-30T17:07:13.528 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:13.528 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":18,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:07:12.871216+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:07:13.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.527+0000 7f9aae65a700 1 -- 172.21.15.49:0/417438856 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a9405f150 msgr2=0x7f9a94061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:13.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.527+0000 7f9aae65a700 1 --2- 172.21.15.49:0/417438856 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a9405f150 0x7f9a94061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f9a9c009fd0 tx=0x7f9a9c017000).stop 2023-11-30T17:07:13.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.527+0000 7f9aae65a700 1 -- 172.21.15.49:0/417438856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9aa80ca180 msgr2=0x7f9aa814e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:13.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.527+0000 7f9aae65a700 1 --2- 172.21.15.49:0/417438856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9aa80ca180 0x7f9aa814e460 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f9a98001360 tx=0x7f9a98007b00).stop 2023-11-30T17:07:13.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.527+0000 7f9aae65a700 1 -- 172.21.15.49:0/417438856 shutdown_connections 2023-11-30T17:07:13.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.527+0000 7f9aae65a700 1 --2- 172.21.15.49:0/417438856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9aa80cae90 0x7f9aa8153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:13.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.527+0000 7f9aae65a700 1 --2- 172.21.15.49:0/417438856 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a9405f150 0x7f9a94061610 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:13.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.527+0000 7f9aae65a700 1 --2- 172.21.15.49:0/417438856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9aa80ca180 0x7f9aa814e460 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:13.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.527+0000 7f9aae65a700 1 --2- 172.21.15.49:0/417438856 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9aa80caab0 0x7f9aa8153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:13.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.527+0000 7f9aae65a700 1 -- 172.21.15.49:0/417438856 >> 172.21.15.49:0/417438856 conn(0x7f9aa8094920 msgr2=0x7f9aa80a9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:13.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.527+0000 7f9aae65a700 1 -- 172.21.15.49:0/417438856 shutdown_connections 2023-11-30T17:07:13.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.527+0000 7f9aae65a700 1 -- 172.21.15.49:0/417438856 wait complete. 2023-11-30T17:07:13.542 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-11-30T17:07:13.543 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T17:07:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.660+0000 7f78c53d5700 1 Processor -- start 2023-11-30T17:07:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.660+0000 7f78c53d5700 1 -- start start 2023-11-30T17:07:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.661+0000 7f78c53d5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78c014e530 0x7f78c00c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.661+0000 7f78c53d5700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f78c0158570 0x7f78c0158a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.661+0000 7f78c53d5700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c00c7bc0 con 0x7f78c0154950 2023-11-30T17:07:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.661+0000 7f78c53d5700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c0155920 con 0x7f78c0158570 2023-11-30T17:07:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.661+0000 7f78c53d5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c0154dd0 con 0x7f78c014e530 2023-11-30T17:07:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.661+0000 7f78bffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78c014e530 0x7f78c00c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.661+0000 7f78c4bd4700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f78c0158570 0x7f78c0158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.661+0000 7f78c4bd4700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f78c0158570 0x7f78c0158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:36940/0 (socket says 172.21.15.49:36940) 2023-11-30T17:07:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.661+0000 7f78bf7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f78c0154950 0x7f78c014e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:59674/0 (socket says 172.21.15.49:59674) 2023-11-30T17:07:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.661+0000 7f78bffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78c014e530 0x7f78c00c66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:55482/0 (socket says 172.21.15.49:55482) 2023-11-30T17:07:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.661+0000 7f78c4bd4700 1 -- 172.21.15.49:0/1839892663 learned_addr learned my addr 172.21.15.49:0/1839892663 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.662+0000 7f78bffff700 1 -- 172.21.15.49:0/1839892663 >> v2:172.21.15.115:3300/0 conn(0x7f78c0158570 msgr2=0x7f78c0158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.662+0000 7f78bffff700 1 --2- 172.21.15.49:0/1839892663 >> v2:172.21.15.115:3300/0 conn(0x7f78c0158570 0x7f78c0158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.662+0000 7f78bffff700 1 -- 172.21.15.49:0/1839892663 >> v1:172.21.15.115:6789/0 conn(0x7f78c0154950 legacy=0x7f78c014e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.662+0000 7f78beffd700 1 -- 172.21.15.49:0/1839892663 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724062410 0 0) 0x7f78c00c7bc0 con 0x7f78c0154950 2023-11-30T17:07:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.662+0000 7f78bffff700 1 -- 172.21.15.49:0/1839892663 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c0155080 con 0x7f78c014e530 2023-11-30T17:07:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.662+0000 7f78bffff700 1 --2- 172.21.15.49:0/1839892663 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78c014e530 0x7f78c00c66f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f78a8009760 tx=0x7f78a8009060).ready entity=mon.2 client_cookie=911ad22b2b4f21d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.662+0000 7f78beffd700 1 -- 172.21.15.49:0/1839892663 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a80090d0 con 0x7f78c014e530 2023-11-30T17:07:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.662+0000 7f78beffd700 1 -- 172.21.15.49:0/1839892663 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a800f510 con 0x7f78c014e530 2023-11-30T17:07:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.662+0000 7f78beffd700 1 -- 172.21.15.49:0/1839892663 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a800f890 con 0x7f78c014e530 2023-11-30T17:07:13.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.662+0000 7f78c53d5700 1 -- 172.21.15.49:0/1839892663 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78c014e530 msgr2=0x7f78c00c66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:13.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.662+0000 7f78c53d5700 1 --2- 172.21.15.49:0/1839892663 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78c014e530 0x7f78c00c66f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f78a8009760 tx=0x7f78a8009060).stop 2023-11-30T17:07:13.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.663+0000 7f78c53d5700 1 -- 172.21.15.49:0/1839892663 shutdown_connections 2023-11-30T17:07:13.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.663+0000 7f78c53d5700 1 --2- 172.21.15.49:0/1839892663 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78c014e530 0x7f78c00c66f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:13.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.663+0000 7f78c53d5700 1 --2- 172.21.15.49:0/1839892663 >> v2:172.21.15.115:3300/0 conn(0x7f78c0158570 0x7f78c0158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:13.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.663+0000 7f78c53d5700 1 -- 172.21.15.49:0/1839892663 >> 172.21.15.49:0/1839892663 conn(0x7f78c0064990 msgr2=0x7f78c0064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:13.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.663+0000 7f78c53d5700 1 -- 172.21.15.49:0/1839892663 shutdown_connections 2023-11-30T17:07:13.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.663+0000 7f78c53d5700 1 -- 172.21.15.49:0/1839892663 wait complete. 2023-11-30T17:07:13.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.664+0000 7f78c53d5700 1 Processor -- start 2023-11-30T17:07:13.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.664+0000 7f78c53d5700 1 -- start start 2023-11-30T17:07:13.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.665+0000 7f78c53d5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78c014e530 0x7f78c01675a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:13.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.665+0000 7f78c53d5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78c0154950 0x7f78c0164830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:13.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.665+0000 7f78c53d5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78c0158570 0x7f78c00c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:13.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.665+0000 7f78c53d5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c00b0a10 con 0x7f78c014e530 2023-11-30T17:07:13.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.665+0000 7f78c53d5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c00c3720 con 0x7f78c0154950 2023-11-30T17:07:13.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.665+0000 7f78c53d5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c00c3a00 con 0x7f78c0158570 2023-11-30T17:07:13.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.665+0000 7f78bffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78c014e530 0x7f78c01675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:13.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.665+0000 7f78bffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78c014e530 0x7f78c01675a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46044/0 (socket says 172.21.15.49:46044) 2023-11-30T17:07:13.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.665+0000 7f78bffff700 1 -- 172.21.15.49:0/4121412066 learned_addr learned my addr 172.21.15.49:0/4121412066 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:13.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.665+0000 7f78bf7fe700 1 --2- 172.21.15.49:0/4121412066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78c0154950 0x7f78c0164830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:13.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.665+0000 7f78c4bd4700 1 --2- 172.21.15.49:0/4121412066 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78c0158570 0x7f78c00c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:13.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.665+0000 7f78bffff700 1 -- 172.21.15.49:0/4121412066 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78c0158570 msgr2=0x7f78c00c53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:13.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.665+0000 7f78bffff700 1 --2- 172.21.15.49:0/4121412066 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78c0158570 0x7f78c00c53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:13.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.665+0000 7f78bffff700 1 -- 172.21.15.49:0/4121412066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78c0154950 msgr2=0x7f78c0164830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:13.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.665+0000 7f78bffff700 1 --2- 172.21.15.49:0/4121412066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78c0154950 0x7f78c0164830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:13.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.665+0000 7f78bffff700 1 -- 172.21.15.49:0/4121412066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a80092a0 con 0x7f78c014e530 2023-11-30T17:07:13.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.665+0000 7f78bffff700 1 --2- 172.21.15.49:0/4121412066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78c014e530 0x7f78c01675a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f78c00644d0 tx=0x7f78a8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:13.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.665+0000 7f78b7fff700 1 -- 172.21.15.49:0/4121412066 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a800f890 con 0x7f78c014e530 2023-11-30T17:07:13.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.665+0000 7f78b7fff700 1 -- 172.21.15.49:0/4121412066 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a800fc50 con 0x7f78c014e530 2023-11-30T17:07:13.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.665+0000 7f78c53d5700 1 -- 172.21.15.49:0/4121412066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c00c3ce0 con 0x7f78c014e530 2023-11-30T17:07:13.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.665+0000 7f78b7fff700 1 -- 172.21.15.49:0/4121412066 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a801b440 con 0x7f78c014e530 2023-11-30T17:07:13.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.666+0000 7f78c53d5700 1 -- 172.21.15.49:0/4121412066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c00c42a0 con 0x7f78c014e530 2023-11-30T17:07:13.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.666+0000 7f78c53d5700 1 -- 172.21.15.49:0/4121412066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c0062ee0 con 0x7f78c014e530 2023-11-30T17:07:13.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.667+0000 7f78b7fff700 1 -- 172.21.15.49:0/4121412066 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f78a801b830 con 0x7f78c014e530 2023-11-30T17:07:13.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.667+0000 7f78b7fff700 1 --2- 172.21.15.49:0/4121412066 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f78a005f150 0x7f78a0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:13.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.667+0000 7f78b7fff700 1 -- 172.21.15.49:0/4121412066 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f78a807b420 con 0x7f78c014e530 2023-11-30T17:07:13.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.667+0000 7f78bf7fe700 1 --2- 172.21.15.49:0/4121412066 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f78a005f150 0x7f78a0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:13.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.668+0000 7f78bf7fe700 1 --2- 172.21.15.49:0/4121412066 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f78a005f150 0x7f78a0061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f78c00aa5c0 tx=0x7f78b0007bd0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:13.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.671+0000 7f78b7fff700 1 -- 172.21.15.49:0/4121412066 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f78a804ca40 con 0x7f78c014e530 2023-11-30T17:07:13.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.844+0000 7f78c53d5700 1 -- 172.21.15.49:0/4121412066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f78c006c7c0 con 0x7f78c014e530 2023-11-30T17:07:13.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.844+0000 7f78b7fff700 1 -- 172.21.15.49:0/4121412066 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7f78a80280b0 con 0x7f78c014e530 2023-11-30T17:07:13.847 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T17:07:13.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.846+0000 7f78c53d5700 1 -- 172.21.15.49:0/4121412066 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f78a005f150 msgr2=0x7f78a0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:13.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.846+0000 7f78c53d5700 1 --2- 172.21.15.49:0/4121412066 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f78a005f150 0x7f78a0061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f78c00aa5c0 tx=0x7f78b0007bd0).stop 2023-11-30T17:07:13.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.846+0000 7f78c53d5700 1 -- 172.21.15.49:0/4121412066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78c014e530 msgr2=0x7f78c01675a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:13.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.846+0000 7f78c53d5700 1 --2- 172.21.15.49:0/4121412066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78c014e530 0x7f78c01675a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f78c00644d0 tx=0x7f78a8017000).stop 2023-11-30T17:07:13.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.846+0000 7f78c53d5700 1 -- 172.21.15.49:0/4121412066 shutdown_connections 2023-11-30T17:07:13.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.846+0000 7f78c53d5700 1 --2- 172.21.15.49:0/4121412066 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78c0158570 0x7f78c00c53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:13.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.846+0000 7f78c53d5700 1 --2- 172.21.15.49:0/4121412066 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f78a005f150 0x7f78a0061610 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:13.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.846+0000 7f78c53d5700 1 --2- 172.21.15.49:0/4121412066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78c014e530 0x7f78c01675a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:13.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.846+0000 7f78c53d5700 1 --2- 172.21.15.49:0/4121412066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78c0154950 0x7f78c0164830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:13.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.846+0000 7f78c53d5700 1 -- 172.21.15.49:0/4121412066 >> 172.21.15.49:0/4121412066 conn(0x7f78c0064990 msgr2=0x7f78c0157040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:13.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.846+0000 7f78c53d5700 1 -- 172.21.15.49:0/4121412066 shutdown_connections 2023-11-30T17:07:13.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.846+0000 7f78c53d5700 1 -- 172.21.15.49:0/4121412066 wait complete. 2023-11-30T17:07:13.861 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T17:07:13.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.979+0000 7f33fe535700 1 Processor -- start 2023-11-30T17:07:13.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.980+0000 7f33fe535700 1 -- start start 2023-11-30T17:07:13.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.980+0000 7f33fe535700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f33f8062b80 0x7f33f80c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:13.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.980+0000 7f33fe535700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f80c6b10 con 0x7f33f8138cf0 2023-11-30T17:07:13.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.980+0000 7f33fe535700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f81390d0 con 0x7f33f8062700 2023-11-30T17:07:13.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.980+0000 7f33fe535700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f80bdb80 con 0x7f33f8062b80 2023-11-30T17:07:13.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.980+0000 7f33f7fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f33f8138cf0 0x7f33f80bd0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46840/0 (socket says 172.21.15.49:46840) 2023-11-30T17:07:13.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.981+0000 7f33f7fff700 1 -- 172.21.15.49:0/2477101295 learned_addr learned my addr 172.21.15.49:0/2477101295 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:13.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.981+0000 7f33fcad2700 1 --2- 172.21.15.49:0/2477101295 >> v2:172.21.15.115:3300/0 conn(0x7f33f8062b80 0x7f33f80c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:13.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.981+0000 7f33f6ffd700 1 -- 172.21.15.49:0/2477101295 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2439802630 0 0) 0x7f33f80c6b10 con 0x7f33f8138cf0 2023-11-30T17:07:13.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.981+0000 7f33f6ffd700 1 -- 172.21.15.49:0/2477101295 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33e40033f0 con 0x7f33f8138cf0 2023-11-30T17:07:13.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.981+0000 7f33f6ffd700 1 -- 172.21.15.49:0/2477101295 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2259172216 0 0) 0x7f33e40033f0 con 0x7f33f8138cf0 2023-11-30T17:07:13.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.981+0000 7f33f6ffd700 1 -- 172.21.15.49:0/2477101295 >> v2:172.21.15.115:3300/0 conn(0x7f33f8062b80 msgr2=0x7f33f80c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:13.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.981+0000 7f33f6ffd700 1 --2- 172.21.15.49:0/2477101295 >> v2:172.21.15.115:3300/0 conn(0x7f33f8062b80 0x7f33f80c76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:13.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.981+0000 7f33f6ffd700 1 -- 172.21.15.49:0/2477101295 >> v1:172.21.15.115:6789/0 conn(0x7f33f8062700 legacy=0x7f33f80c6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:13.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.981+0000 7f33f6ffd700 1 -- 172.21.15.49:0/2477101295 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f80c61e0 con 0x7f33f8138cf0 2023-11-30T17:07:13.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.981+0000 7f33f6ffd700 1 -- 172.21.15.49:0/2477101295 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f33e80015f0 con 0x7f33f8138cf0 2023-11-30T17:07:13.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.981+0000 7f33f6ffd700 1 -- 172.21.15.49:0/2477101295 >> v1:172.21.15.49:6789/0 conn(0x7f33f8138cf0 legacy=0x7f33f80bd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:13.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.981+0000 7f33f6ffd700 1 --2- 172.21.15.49:0/2477101295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33e40038e0 0x7f33e4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:13.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.981+0000 7f33f6ffd700 1 --2- 172.21.15.49:0/2477101295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33e4004690 0x7f33e4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:13.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.981+0000 7f33f6ffd700 1 --2- 172.21.15.49:0/2477101295 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33e4005050 0x7f33e400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:13.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.981+0000 7f33f6ffd700 1 -- 172.21.15.49:0/2477101295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f80bdb80 con 0x7f33e40038e0 2023-11-30T17:07:13.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.981+0000 7f33f6ffd700 1 -- 172.21.15.49:0/2477101295 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e400bfe0 con 0x7f33e4004690 2023-11-30T17:07:13.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.981+0000 7f33f6ffd700 1 -- 172.21.15.49:0/2477101295 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e400c1a0 con 0x7f33e4005050 2023-11-30T17:07:13.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.981+0000 7f33f7fff700 1 --2- 172.21.15.49:0/2477101295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33e40038e0 0x7f33e4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:13.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.981+0000 7f33fcad2700 1 --2- 172.21.15.49:0/2477101295 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33e4005050 0x7f33e400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:13.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.981+0000 7f33f77fe700 1 --2- 172.21.15.49:0/2477101295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33e4004690 0x7f33e4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:13.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.981+0000 7f33f7fff700 1 -- 172.21.15.49:0/2477101295 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33e4005050 msgr2=0x7f33e400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:13.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.981+0000 7f33f7fff700 1 --2- 172.21.15.49:0/2477101295 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33e4005050 0x7f33e400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:13.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.981+0000 7f33f7fff700 1 -- 172.21.15.49:0/2477101295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33e4004690 msgr2=0x7f33e4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:13.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.981+0000 7f33f7fff700 1 --2- 172.21.15.49:0/2477101295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33e4004690 0x7f33e4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:13.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.982+0000 7f33f7fff700 1 -- 172.21.15.49:0/2477101295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e40033f0 con 0x7f33e40038e0 2023-11-30T17:07:13.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.982+0000 7f33fcad2700 1 --2- 172.21.15.49:0/2477101295 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33e4005050 0x7f33e400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:13.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.982+0000 7f33f77fe700 1 --2- 172.21.15.49:0/2477101295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33e4004690 0x7f33e4004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:13.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.982+0000 7f33fcad2700 1 -- 172.21.15.49:0/2477101295 reap_dead start 2023-11-30T17:07:13.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.982+0000 7f33f7fff700 1 --2- 172.21.15.49:0/2477101295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33e40038e0 0x7f33e4003d00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f33e8007fd0 tx=0x7f33e80077a0).ready entity=mon.0 client_cookie=92fd91723ebc04eb server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:13.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.982+0000 7f33f6ffd700 1 -- 172.21.15.49:0/2477101295 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e80079d0 con 0x7f33e40038e0 2023-11-30T17:07:13.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.982+0000 7f33f6ffd700 1 -- 172.21.15.49:0/2477101295 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e800ca60 con 0x7f33e40038e0 2023-11-30T17:07:13.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.982+0000 7f33f6ffd700 1 -- 172.21.15.49:0/2477101295 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e800cde0 con 0x7f33e40038e0 2023-11-30T17:07:13.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.982+0000 7f33fe535700 1 -- 172.21.15.49:0/2477101295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33e40038e0 msgr2=0x7f33e4003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:13.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.982+0000 7f33fe535700 1 --2- 172.21.15.49:0/2477101295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33e40038e0 0x7f33e4003d00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f33e8007fd0 tx=0x7f33e80077a0).stop 2023-11-30T17:07:13.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.982+0000 7f33fe535700 1 -- 172.21.15.49:0/2477101295 shutdown_connections 2023-11-30T17:07:13.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.982+0000 7f33fe535700 1 --2- 172.21.15.49:0/2477101295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33e40038e0 0x7f33e4003d00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:13.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.982+0000 7f33fe535700 1 -- 172.21.15.49:0/2477101295 >> 172.21.15.49:0/2477101295 conn(0x7f33f80c4c00 msgr2=0x7f33f80c5010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:13.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.982+0000 7f33fe535700 1 -- 172.21.15.49:0/2477101295 shutdown_connections 2023-11-30T17:07:13.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.982+0000 7f33fe535700 1 -- 172.21.15.49:0/2477101295 wait complete. 2023-11-30T17:07:13.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.983+0000 7f33fe535700 1 Processor -- start 2023-11-30T17:07:13.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.984+0000 7f33fe535700 1 -- start start 2023-11-30T17:07:13.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.984+0000 7f33fe535700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33e40038e0 0x7f33f80bf200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:13.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.984+0000 7f33fe535700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33f80c1490 0x7f33f81619d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:13.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.984+0000 7f33fe535700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33f8161ec0 0x7f33f8065d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:13.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.984+0000 7f33fe535700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f80c1910 con 0x7f33e40038e0 2023-11-30T17:07:13.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.984+0000 7f33fe535700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f8063cf0 con 0x7f33f80c1490 2023-11-30T17:07:13.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.984+0000 7f33fe535700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f80a89a0 con 0x7f33f8161ec0 2023-11-30T17:07:13.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.984+0000 7f33f7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33e40038e0 0x7f33f80bf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:13.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.984+0000 7f33f7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33e40038e0 0x7f33f80bf200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46058/0 (socket says 172.21.15.49:46058) 2023-11-30T17:07:13.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.984+0000 7f33f7fff700 1 -- 172.21.15.49:0/3306554751 learned_addr learned my addr 172.21.15.49:0/3306554751 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:13.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.985+0000 7f33fcad2700 1 --2- 172.21.15.49:0/3306554751 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33f8161ec0 0x7f33f8065d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:13.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.985+0000 7f33f77fe700 1 --2- 172.21.15.49:0/3306554751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33f80c1490 0x7f33f81619d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:13.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.985+0000 7f33f7fff700 1 -- 172.21.15.49:0/3306554751 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33f8161ec0 msgr2=0x7f33f8065d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:13.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.985+0000 7f33f7fff700 1 --2- 172.21.15.49:0/3306554751 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33f8161ec0 0x7f33f8065d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:13.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.985+0000 7f33f7fff700 1 -- 172.21.15.49:0/3306554751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33f80c1490 msgr2=0x7f33f81619d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:13.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.985+0000 7f33f7fff700 1 --2- 172.21.15.49:0/3306554751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33f80c1490 0x7f33f81619d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:13.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.985+0000 7f33f7fff700 1 -- 172.21.15.49:0/3306554751 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f80c0080 con 0x7f33e40038e0 2023-11-30T17:07:13.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.985+0000 7f33f7fff700 1 --2- 172.21.15.49:0/3306554751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33e40038e0 0x7f33f80bf200 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f33e800c720 tx=0x7f33e8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:13.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.985+0000 7f33effff700 1 -- 172.21.15.49:0/3306554751 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e800cde0 con 0x7f33e40038e0 2023-11-30T17:07:13.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.985+0000 7f33effff700 1 -- 172.21.15.49:0/3306554751 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e8005670 con 0x7f33e40038e0 2023-11-30T17:07:13.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.985+0000 7f33fe535700 1 -- 172.21.15.49:0/3306554751 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f80bf7e0 con 0x7f33e40038e0 2023-11-30T17:07:13.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.985+0000 7f33effff700 1 -- 172.21.15.49:0/3306554751 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e80059f0 con 0x7f33e40038e0 2023-11-30T17:07:13.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.985+0000 7f33fe535700 1 -- 172.21.15.49:0/3306554751 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f80bfda0 con 0x7f33e40038e0 2023-11-30T17:07:13.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.986+0000 7f33fe535700 1 -- 172.21.15.49:0/3306554751 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f80a8770 con 0x7f33e40038e0 2023-11-30T17:07:13.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.986+0000 7f33effff700 1 -- 172.21.15.49:0/3306554751 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f33e8013450 con 0x7f33e40038e0 2023-11-30T17:07:13.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.987+0000 7f33effff700 1 --2- 172.21.15.49:0/3306554751 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f33d805f150 0x7f33d8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:13.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.987+0000 7f33effff700 1 -- 172.21.15.49:0/3306554751 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f33e807abe0 con 0x7f33e40038e0 2023-11-30T17:07:13.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.987+0000 7f33f77fe700 1 --2- 172.21.15.49:0/3306554751 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f33d805f150 0x7f33d8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:13.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.987+0000 7f33f77fe700 1 --2- 172.21.15.49:0/3306554751 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f33d805f150 0x7f33d8061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f33e0007fd0 tx=0x7f33e0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:13.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:13.991+0000 7f33effff700 1 -- 172.21.15.49:0/3306554751 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f33f80a8770 con 0x7f33e40038e0 2023-11-30T17:07:14.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.163+0000 7f33fe535700 1 -- 172.21.15.49:0/3306554751 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f33f80a8770 con 0x7f33e40038e0 2023-11-30T17:07:14.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.163+0000 7f33effff700 1 -- 172.21.15.49:0/3306554751 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f33f80a8770 con 0x7f33e40038e0 2023-11-30T17:07:14.166 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T17:07:14.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.165+0000 7f33fe535700 1 -- 172.21.15.49:0/3306554751 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f33d805f150 msgr2=0x7f33d8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:14.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.165+0000 7f33fe535700 1 --2- 172.21.15.49:0/3306554751 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f33d805f150 0x7f33d8061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f33e0007fd0 tx=0x7f33e0009040).stop 2023-11-30T17:07:14.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.165+0000 7f33fe535700 1 -- 172.21.15.49:0/3306554751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33e40038e0 msgr2=0x7f33f80bf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:14.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.165+0000 7f33fe535700 1 --2- 172.21.15.49:0/3306554751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33e40038e0 0x7f33f80bf200 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f33e800c720 tx=0x7f33e8015000).stop 2023-11-30T17:07:14.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.165+0000 7f33fe535700 1 -- 172.21.15.49:0/3306554751 shutdown_connections 2023-11-30T17:07:14.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.165+0000 7f33fe535700 1 --2- 172.21.15.49:0/3306554751 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33f8161ec0 0x7f33f8065d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:14.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.165+0000 7f33fe535700 1 --2- 172.21.15.49:0/3306554751 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f33d805f150 0x7f33d8061610 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:14.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.165+0000 7f33fe535700 1 --2- 172.21.15.49:0/3306554751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33e40038e0 0x7f33f80bf200 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:14.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.165+0000 7f33fe535700 1 --2- 172.21.15.49:0/3306554751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33f80c1490 0x7f33f81619d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:14.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.165+0000 7f33fe535700 1 -- 172.21.15.49:0/3306554751 >> 172.21.15.49:0/3306554751 conn(0x7f33f80c4c00 msgr2=0x7f33f8066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:14.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.165+0000 7f33fe535700 1 -- 172.21.15.49:0/3306554751 shutdown_connections 2023-11-30T17:07:14.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.165+0000 7f33fe535700 1 -- 172.21.15.49:0/3306554751 wait complete. 2023-11-30T17:07:14.180 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-30T17:07:14.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.294+0000 7fdf1318d700 1 Processor -- start 2023-11-30T17:07:14.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.294+0000 7fdf1318d700 1 -- start start 2023-11-30T17:07:14.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.295+0000 7fdf1318d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdf0c0c0d10 0x7fdf0c0c10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:14.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.295+0000 7fdf1318d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf0c06b510 0x7fdf0c158b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:14.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.295+0000 7fdf1318d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdf0c153fe0 0x7fdf0c154470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:14.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.295+0000 7fdf1318d700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf0c0c19e0 con 0x7fdf0c0c0d10 2023-11-30T17:07:14.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.295+0000 7fdf1318d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf0c063380 con 0x7fdf0c153fe0 2023-11-30T17:07:14.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.295+0000 7fdf1318d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c159060 con 0x7fdf0c06b510 2023-11-30T17:07:14.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.295+0000 7fdf10f29700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdf0c0c0d10 0x7fdf0c0c10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:14.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.295+0000 7fdf10f29700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdf0c0c0d10 0x7fdf0c0c10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46074/0 (socket says 172.21.15.49:46074) 2023-11-30T17:07:14.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.295+0000 7fdf10f29700 1 -- 172.21.15.49:0/1923721900 learned_addr learned my addr 172.21.15.49:0/1923721900 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:14.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.296+0000 7fdf0bfff700 1 --2- 172.21.15.49:0/1923721900 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf0c06b510 0x7fdf0c158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:14.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.296+0000 7fdf1172a700 1 --2- 172.21.15.49:0/1923721900 >> v2:172.21.15.115:3300/0 conn(0x7fdf0c153fe0 0x7fdf0c154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:14.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.296+0000 7fdf10f29700 1 -- 172.21.15.49:0/1923721900 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf0c06b510 msgr2=0x7fdf0c158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:14.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.296+0000 7fdf10f29700 1 --2- 172.21.15.49:0/1923721900 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf0c06b510 0x7fdf0c158b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:14.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.296+0000 7fdf10f29700 1 -- 172.21.15.49:0/1923721900 >> v2:172.21.15.115:3300/0 conn(0x7fdf0c153fe0 msgr2=0x7fdf0c154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:14.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.296+0000 7fdf10f29700 1 --2- 172.21.15.49:0/1923721900 >> v2:172.21.15.115:3300/0 conn(0x7fdf0c153fe0 0x7fdf0c154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:14.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.296+0000 7fdf10f29700 1 -- 172.21.15.49:0/1923721900 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0c062770 con 0x7fdf0c0c0d10 2023-11-30T17:07:14.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.296+0000 7fdf1172a700 1 --2- 172.21.15.49:0/1923721900 >> v2:172.21.15.115:3300/0 conn(0x7fdf0c153fe0 0x7fdf0c154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:14.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.296+0000 7fdf10f29700 1 --2- 172.21.15.49:0/1923721900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf0c0c0d10 0x7fdf0c0c10f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fdf0c06b9c0 tx=0x7fdf04009840).ready entity=mon.0 client_cookie=e6edbd4a6899960c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:14.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.296+0000 7fdf0b7fe700 1 -- 172.21.15.49:0/1923721900 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0400e070 con 0x7fdf0c0c0d10 2023-11-30T17:07:14.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.296+0000 7fdf0b7fe700 1 -- 172.21.15.49:0/1923721900 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0400ba50 con 0x7fdf0c0c0d10 2023-11-30T17:07:14.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.296+0000 7fdf0b7fe700 1 -- 172.21.15.49:0/1923721900 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0400bdd0 con 0x7fdf0c0c0d10 2023-11-30T17:07:14.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.296+0000 7fdf1318d700 1 -- 172.21.15.49:0/1923721900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf0c0c0d10 msgr2=0x7fdf0c0c10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:14.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.296+0000 7fdf1318d700 1 --2- 172.21.15.49:0/1923721900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf0c0c0d10 0x7fdf0c0c10f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fdf0c06b9c0 tx=0x7fdf04009840).stop 2023-11-30T17:07:14.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.297+0000 7fdf1318d700 1 -- 172.21.15.49:0/1923721900 shutdown_connections 2023-11-30T17:07:14.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.297+0000 7fdf1318d700 1 --2- 172.21.15.49:0/1923721900 >> v2:172.21.15.115:3300/0 conn(0x7fdf0c153fe0 0x7fdf0c154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:14.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.297+0000 7fdf1318d700 1 --2- 172.21.15.49:0/1923721900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf0c0c0d10 0x7fdf0c0c10f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:14.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.297+0000 7fdf1318d700 1 --2- 172.21.15.49:0/1923721900 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf0c06b510 0x7fdf0c158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:14.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.297+0000 7fdf1318d700 1 -- 172.21.15.49:0/1923721900 >> 172.21.15.49:0/1923721900 conn(0x7fdf0c0c7760 msgr2=0x7fdf0c0c7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:14.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.297+0000 7fdf1318d700 1 -- 172.21.15.49:0/1923721900 shutdown_connections 2023-11-30T17:07:14.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.297+0000 7fdf1318d700 1 -- 172.21.15.49:0/1923721900 wait complete. 2023-11-30T17:07:14.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.298+0000 7fdf1318d700 1 Processor -- start 2023-11-30T17:07:14.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.298+0000 7fdf1318d700 1 -- start start 2023-11-30T17:07:14.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.299+0000 7fdf1318d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf0c06b510 0x7fdf0c0a04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:14.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.299+0000 7fdf1318d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf0c0c0d10 0x7fdf0c069070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:14.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.299+0000 7fdf1318d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf0c153fe0 0x7fdf0c0651b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:14.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.299+0000 7fdf1318d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c156180 con 0x7fdf0c153fe0 2023-11-30T17:07:14.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.299+0000 7fdf1318d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c069560 con 0x7fdf0c06b510 2023-11-30T17:07:14.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.299+0000 7fdf1318d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c155570 con 0x7fdf0c0c0d10 2023-11-30T17:07:14.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.299+0000 7fdf1172a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf0c153fe0 0x7fdf0c0651b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:14.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.299+0000 7fdf0bfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf0c0c0d10 0x7fdf0c069070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:14.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.299+0000 7fdf1172a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf0c153fe0 0x7fdf0c0651b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46084/0 (socket says 172.21.15.49:46084) 2023-11-30T17:07:14.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.299+0000 7fdf1172a700 1 -- 172.21.15.49:0/1185262476 learned_addr learned my addr 172.21.15.49:0/1185262476 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:14.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.299+0000 7fdf10f29700 1 --2- 172.21.15.49:0/1185262476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf0c06b510 0x7fdf0c0a04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:14.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.299+0000 7fdf1172a700 1 -- 172.21.15.49:0/1185262476 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf0c0c0d10 msgr2=0x7fdf0c069070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:14.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.299+0000 7fdf1172a700 1 --2- 172.21.15.49:0/1185262476 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf0c0c0d10 0x7fdf0c069070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:14.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.299+0000 7fdf1172a700 1 -- 172.21.15.49:0/1185262476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf0c06b510 msgr2=0x7fdf0c0a04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:14.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.299+0000 7fdf1172a700 1 --2- 172.21.15.49:0/1185262476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf0c06b510 0x7fdf0c0a04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:14.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.299+0000 7fdf1172a700 1 -- 172.21.15.49:0/1185262476 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf04009ae0 con 0x7fdf0c153fe0 2023-11-30T17:07:14.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.299+0000 7fdf1172a700 1 --2- 172.21.15.49:0/1185262476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf0c153fe0 0x7fdf0c0651b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fdef400c650 tx=0x7fdef4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:14.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.299+0000 7fdf08ff9700 1 -- 172.21.15.49:0/1185262476 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef4010580 con 0x7fdf0c153fe0 2023-11-30T17:07:14.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.299+0000 7fdf08ff9700 1 -- 172.21.15.49:0/1185262476 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef40106e0 con 0x7fdf0c153fe0 2023-11-30T17:07:14.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.299+0000 7fdf1318d700 1 -- 172.21.15.49:0/1185262476 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0c155850 con 0x7fdf0c153fe0 2023-11-30T17:07:14.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.299+0000 7fdf08ff9700 1 -- 172.21.15.49:0/1185262476 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef4010a60 con 0x7fdf0c153fe0 2023-11-30T17:07:14.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.299+0000 7fdf1318d700 1 -- 172.21.15.49:0/1185262476 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0c155e10 con 0x7fdf0c153fe0 2023-11-30T17:07:14.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.301+0000 7fdf1318d700 1 -- 172.21.15.49:0/1185262476 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf0c156330 con 0x7fdf0c153fe0 2023-11-30T17:07:14.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.301+0000 7fdf08ff9700 1 -- 172.21.15.49:0/1185262476 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdef401b460 con 0x7fdf0c153fe0 2023-11-30T17:07:14.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.301+0000 7fdf08ff9700 1 --2- 172.21.15.49:0/1185262476 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdeec05f150 0x7fdeec061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:14.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.301+0000 7fdf08ff9700 1 -- 172.21.15.49:0/1185262476 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fdef4079c20 con 0x7fdf0c153fe0 2023-11-30T17:07:14.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.301+0000 7fdf10f29700 1 --2- 172.21.15.49:0/1185262476 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdeec05f150 0x7fdeec061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:14.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.302+0000 7fdf10f29700 1 --2- 172.21.15.49:0/1185262476 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdeec05f150 0x7fdeec061610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fdf0400ba20 tx=0x7fdf04009840).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:14.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.305+0000 7fdf08ff9700 1 -- 172.21.15.49:0/1185262476 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdf0c156330 con 0x7fdf0c153fe0 2023-11-30T17:07:14.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.480+0000 7fdf1318d700 1 -- 172.21.15.49:0/1185262476 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdf0c06c860 con 0x7fdf0c153fe0 2023-11-30T17:07:14.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.481+0000 7fdf08ff9700 1 -- 172.21.15.49:0/1185262476 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+143 (secure 0 0 0) 0x7fdef404b1e0 con 0x7fdf0c153fe0 2023-11-30T17:07:14.483 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:14.483 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-11-30T17:07:14.483 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:07:14.483 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2023-11-30T17:07:14.484 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "device_health_metrics" 2023-11-30T17:07:14.484 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:07:14.484 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:07:14.484 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 2, 2023-11-30T17:07:14.484 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "rbd" 2023-11-30T17:07:14.484 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:07:14.484 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-11-30T17:07:14.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.482+0000 7fdf1318d700 1 -- 172.21.15.49:0/1185262476 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdeec05f150 msgr2=0x7fdeec061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:14.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.482+0000 7fdf1318d700 1 --2- 172.21.15.49:0/1185262476 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdeec05f150 0x7fdeec061610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fdf0400ba20 tx=0x7fdf04009840).stop 2023-11-30T17:07:14.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.482+0000 7fdf1318d700 1 -- 172.21.15.49:0/1185262476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf0c153fe0 msgr2=0x7fdf0c0651b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:14.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.482+0000 7fdf1318d700 1 --2- 172.21.15.49:0/1185262476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf0c153fe0 0x7fdf0c0651b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fdef400c650 tx=0x7fdef4008040).stop 2023-11-30T17:07:14.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.482+0000 7fdf1318d700 1 -- 172.21.15.49:0/1185262476 shutdown_connections 2023-11-30T17:07:14.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.482+0000 7fdf1318d700 1 --2- 172.21.15.49:0/1185262476 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdeec05f150 0x7fdeec061610 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:14.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.482+0000 7fdf1318d700 1 --2- 172.21.15.49:0/1185262476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf0c153fe0 0x7fdf0c0651b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:14.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.482+0000 7fdf1318d700 1 --2- 172.21.15.49:0/1185262476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf0c06b510 0x7fdf0c0a04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:14.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.482+0000 7fdf1318d700 1 --2- 172.21.15.49:0/1185262476 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf0c0c0d10 0x7fdf0c069070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:14.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.483+0000 7fdf1318d700 1 -- 172.21.15.49:0/1185262476 >> 172.21.15.49:0/1185262476 conn(0x7fdf0c0c7760 msgr2=0x7fdf0c0c60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:14.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.483+0000 7fdf1318d700 1 -- 172.21.15.49:0/1185262476 shutdown_connections 2023-11-30T17:07:14.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.483+0000 7fdf1318d700 1 -- 172.21.15.49:0/1185262476 wait complete. 2023-11-30T17:07:14.497 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-30T17:07:14.497 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-11-30T17:07:14.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.618+0000 7f5ec82ec700 1 Processor -- start 2023-11-30T17:07:14.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.618+0000 7f5ec82ec700 1 -- start start 2023-11-30T17:07:14.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.619+0000 7f5ec82ec700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ec0154530 0x7f5ec0154910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:14.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.619+0000 7f5ec82ec700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5ec00a7ff0 0x7f5ec00c8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:14.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.619+0000 7f5ec82ec700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ec00c6630 con 0x7f5ec00aa220 2023-11-30T17:07:14.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.619+0000 7f5ec82ec700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ec00c6390 con 0x7f5ec00a7ff0 2023-11-30T17:07:14.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.619+0000 7f5ec82ec700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec00a8470 con 0x7f5ec0154530 2023-11-30T17:07:14.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.619+0000 7f5ec6889700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5ec00aa220 0x7f5ec00c6ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46842/0 (socket says 172.21.15.49:46842) 2023-11-30T17:07:14.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.619+0000 7f5ec6889700 1 -- 172.21.15.49:0/164724096 learned_addr learned my addr 172.21.15.49:0/164724096 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:14.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.619+0000 7f5ec6088700 1 --2- 172.21.15.49:0/164724096 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ec0154530 0x7f5ec0154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:14.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.619+0000 7f5ec5887700 1 --2- 172.21.15.49:0/164724096 >> v2:172.21.15.115:3300/0 conn(0x7f5ec00a7ff0 0x7f5ec00c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:14.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.619+0000 7f5ec5086700 1 -- 172.21.15.49:0/164724096 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244568700 0 0) 0x7f5ec00c6630 con 0x7f5ec00aa220 2023-11-30T17:07:14.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.619+0000 7f5ec5086700 1 -- 172.21.15.49:0/164724096 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5eac0033f0 con 0x7f5ec00aa220 2023-11-30T17:07:14.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.620+0000 7f5ec6088700 1 -- 172.21.15.49:0/164724096 >> v2:172.21.15.115:3300/0 conn(0x7f5ec00a7ff0 msgr2=0x7f5ec00c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:14.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.620+0000 7f5ec6088700 1 --2- 172.21.15.49:0/164724096 >> v2:172.21.15.115:3300/0 conn(0x7f5ec00a7ff0 0x7f5ec00c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:14.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.620+0000 7f5ec6088700 1 -- 172.21.15.49:0/164724096 >> v1:172.21.15.49:6789/0 conn(0x7f5ec00aa220 legacy=0x7f5ec00c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:14.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.620+0000 7f5ec6088700 1 -- 172.21.15.49:0/164724096 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec0064230 con 0x7f5ec0154530 2023-11-30T17:07:14.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.620+0000 7f5ec6088700 1 --2- 172.21.15.49:0/164724096 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ec0154530 0x7f5ec0154910 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f5ebc006fd0 tx=0x7f5ebc006f40).ready entity=mon.2 client_cookie=7019741bedc79f53 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:14.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.620+0000 7f5ec5086700 1 -- 172.21.15.49:0/164724096 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc005880 con 0x7f5ec0154530 2023-11-30T17:07:14.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.620+0000 7f5ec5086700 1 -- 172.21.15.49:0/164724096 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ebc0059e0 con 0x7f5ec0154530 2023-11-30T17:07:14.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.620+0000 7f5ec5086700 1 -- 172.21.15.49:0/164724096 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc005d60 con 0x7f5ec0154530 2023-11-30T17:07:14.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.620+0000 7f5ec82ec700 1 -- 172.21.15.49:0/164724096 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ec0154530 msgr2=0x7f5ec0154910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:14.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.620+0000 7f5ec82ec700 1 --2- 172.21.15.49:0/164724096 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ec0154530 0x7f5ec0154910 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f5ebc006fd0 tx=0x7f5ebc006f40).stop 2023-11-30T17:07:14.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.620+0000 7f5ec82ec700 1 -- 172.21.15.49:0/164724096 shutdown_connections 2023-11-30T17:07:14.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.620+0000 7f5ec82ec700 1 --2- 172.21.15.49:0/164724096 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ec0154530 0x7f5ec0154910 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:14.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.620+0000 7f5ec82ec700 1 --2- 172.21.15.49:0/164724096 >> v2:172.21.15.115:3300/0 conn(0x7f5ec00a7ff0 0x7f5ec00c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:14.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.620+0000 7f5ec82ec700 1 -- 172.21.15.49:0/164724096 >> 172.21.15.49:0/164724096 conn(0x7f5ec0094930 msgr2=0x7f5ec006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:14.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.621+0000 7f5ec82ec700 1 -- 172.21.15.49:0/164724096 shutdown_connections 2023-11-30T17:07:14.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.621+0000 7f5ec82ec700 1 -- 172.21.15.49:0/164724096 wait complete. 2023-11-30T17:07:14.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.622+0000 7f5ec82ec700 1 Processor -- start 2023-11-30T17:07:14.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.622+0000 7f5ec82ec700 1 -- start start 2023-11-30T17:07:14.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.622+0000 7f5ec82ec700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ec00a7ff0 0x7f5ec0168930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:14.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.622+0000 7f5ec82ec700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ec00aa220 0x7f5ec0167ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:14.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.622+0000 7f5ec82ec700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ec0154530 0x7f5ec0144bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:14.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.623+0000 7f5ec82ec700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec00c3d10 con 0x7f5ec00a7ff0 2023-11-30T17:07:14.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.623+0000 7f5ec82ec700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec00c3f60 con 0x7f5ec0154530 2023-11-30T17:07:14.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.623+0000 7f5ec82ec700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec00c4240 con 0x7f5ec00aa220 2023-11-30T17:07:14.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.623+0000 7f5ec6088700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ec00a7ff0 0x7f5ec0168930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:14.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.623+0000 7f5ec6088700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ec00a7ff0 0x7f5ec0168930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46092/0 (socket says 172.21.15.49:46092) 2023-11-30T17:07:14.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.623+0000 7f5ec6088700 1 -- 172.21.15.49:0/1880680850 learned_addr learned my addr 172.21.15.49:0/1880680850 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:14.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.623+0000 7f5ec5887700 1 --2- 172.21.15.49:0/1880680850 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ec00aa220 0x7f5ec0167ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:14.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.623+0000 7f5ec6889700 1 --2- 172.21.15.49:0/1880680850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ec0154530 0x7f5ec0144bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:14.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.623+0000 7f5ec6088700 1 -- 172.21.15.49:0/1880680850 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ec00aa220 msgr2=0x7f5ec0167ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:14.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.623+0000 7f5ec6088700 1 --2- 172.21.15.49:0/1880680850 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ec00aa220 0x7f5ec0167ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:14.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.623+0000 7f5ec6088700 1 -- 172.21.15.49:0/1880680850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ec0154530 msgr2=0x7f5ec0144bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:14.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.623+0000 7f5ec6088700 1 --2- 172.21.15.49:0/1880680850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ec0154530 0x7f5ec0144bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:14.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.623+0000 7f5ec6088700 1 -- 172.21.15.49:0/1880680850 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ebc009250 con 0x7f5ec00a7ff0 2023-11-30T17:07:14.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.623+0000 7f5ec6088700 1 --2- 172.21.15.49:0/1880680850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ec00a7ff0 0x7f5ec0168930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f5ec00c64d0 tx=0x7f5ebc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:14.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.623+0000 7f5eb67fc700 1 -- 172.21.15.49:0/1880680850 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc0067f0 con 0x7f5ec00a7ff0 2023-11-30T17:07:14.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.623+0000 7f5eb67fc700 1 -- 172.21.15.49:0/1880680850 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ebc00d6b0 con 0x7f5ec00a7ff0 2023-11-30T17:07:14.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.623+0000 7f5eb67fc700 1 -- 172.21.15.49:0/1880680850 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc00da70 con 0x7f5ec00a7ff0 2023-11-30T17:07:14.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.623+0000 7f5ec82ec700 1 -- 172.21.15.49:0/1880680850 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec00c4520 con 0x7f5ec00a7ff0 2023-11-30T17:07:14.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.623+0000 7f5ec82ec700 1 -- 172.21.15.49:0/1880680850 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec01683c0 con 0x7f5ec00a7ff0 2023-11-30T17:07:14.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.624+0000 7f5ec82ec700 1 -- 172.21.15.49:0/1880680850 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ec006c860 con 0x7f5ec00a7ff0 2023-11-30T17:07:14.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.624+0000 7f5eb67fc700 1 -- 172.21.15.49:0/1880680850 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5ebc0113f0 con 0x7f5ec00a7ff0 2023-11-30T17:07:14.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.625+0000 7f5eb67fc700 1 --2- 172.21.15.49:0/1880680850 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5ea405f150 0x7f5ea4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:14.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.625+0000 7f5eb67fc700 1 -- 172.21.15.49:0/1880680850 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f5ebc07b3c0 con 0x7f5ec00a7ff0 2023-11-30T17:07:14.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.625+0000 7f5ec5887700 1 --2- 172.21.15.49:0/1880680850 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5ea405f150 0x7f5ea4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:14.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.625+0000 7f5ec5887700 1 --2- 172.21.15.49:0/1880680850 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5ea405f150 0x7f5ea4061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f5ec00caad0 tx=0x7f5eb0009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:14.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.629+0000 7f5eb67fc700 1 -- 172.21.15.49:0/1880680850 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5ebc04ca60 con 0x7f5ec00a7ff0 2023-11-30T17:07:14.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.802+0000 7f5ec82ec700 1 -- 172.21.15.49:0/1880680850 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f5ec0064510 con 0x7f5ec00a7ff0 2023-11-30T17:07:14.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.883+0000 7f5eb67fc700 1 -- 172.21.15.49:0/1880680850 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 152+0+0 (secure 0 0 0) 0x7f5ebc023070 con 0x7f5ec00a7ff0 2023-11-30T17:07:14.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.886+0000 7f5ec82ec700 1 -- 172.21.15.49:0/1880680850 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5ea405f150 msgr2=0x7f5ea4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:14.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.886+0000 7f5ec82ec700 1 --2- 172.21.15.49:0/1880680850 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5ea405f150 0x7f5ea4061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f5ec00caad0 tx=0x7f5eb0009060).stop 2023-11-30T17:07:14.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.886+0000 7f5ec82ec700 1 -- 172.21.15.49:0/1880680850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ec00a7ff0 msgr2=0x7f5ec0168930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:14.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.886+0000 7f5ec82ec700 1 --2- 172.21.15.49:0/1880680850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ec00a7ff0 0x7f5ec0168930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f5ec00c64d0 tx=0x7f5ebc015000).stop 2023-11-30T17:07:14.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.886+0000 7f5ec82ec700 1 -- 172.21.15.49:0/1880680850 shutdown_connections 2023-11-30T17:07:14.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.886+0000 7f5ec82ec700 1 --2- 172.21.15.49:0/1880680850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ec0154530 0x7f5ec0144bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:14.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.886+0000 7f5ec82ec700 1 --2- 172.21.15.49:0/1880680850 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5ea405f150 0x7f5ea4061610 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:14.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.886+0000 7f5ec82ec700 1 --2- 172.21.15.49:0/1880680850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ec00a7ff0 0x7f5ec0168930 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0x7f5ec00c64d0 tx=0x7f5ebc015000).stop 2023-11-30T17:07:14.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.886+0000 7f5ec82ec700 1 --2- 172.21.15.49:0/1880680850 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ec00aa220 0x7f5ec0167ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:14.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.886+0000 7f5ec82ec700 1 -- 172.21.15.49:0/1880680850 >> 172.21.15.49:0/1880680850 conn(0x7f5ec0094930 msgr2=0x7f5ec014fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:14.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.889+0000 7f5ec82ec700 1 -- 172.21.15.49:0/1880680850 shutdown_connections 2023-11-30T17:07:14.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:14.889+0000 7f5ec82ec700 1 -- 172.21.15.49:0/1880680850 wait complete. 2023-11-30T17:07:14.895 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2023-11-30T17:07:14.906 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-30T17:07:15.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.028+0000 7efff2233700 1 Processor -- start 2023-11-30T17:07:15.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.028+0000 7efff2233700 1 -- start start 2023-11-30T17:07:15.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.028+0000 7efff2233700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7effec151a20 0x7effec06a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:15.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.028+0000 7efff2233700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effec0c3470 con 0x7effec0bd1f0 2023-11-30T17:07:15.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.028+0000 7efff2233700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effec151ea0 con 0x7effec069d10 2023-11-30T17:07:15.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.028+0000 7efff2233700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effec152180 con 0x7effec151a20 2023-11-30T17:07:15.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.029+0000 7effebfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7effec0bd1f0 0x7effec0c38e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46844/0 (socket says 172.21.15.49:46844) 2023-11-30T17:07:15.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.029+0000 7effebfff700 1 -- 172.21.15.49:0/138857924 learned_addr learned my addr 172.21.15.49:0/138857924 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:15.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.029+0000 7effeaffd700 1 --2- 172.21.15.49:0/138857924 >> v2:172.21.15.115:3300/0 conn(0x7effec151a20 0x7effec06a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:15.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.029+0000 7effea7fc700 1 -- 172.21.15.49:0/138857924 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377211902 0 0) 0x7effec0c3470 con 0x7effec0bd1f0 2023-11-30T17:07:15.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.029+0000 7effea7fc700 1 -- 172.21.15.49:0/138857924 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effd80033f0 con 0x7effec0bd1f0 2023-11-30T17:07:15.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.029+0000 7effea7fc700 1 -- 172.21.15.49:0/138857924 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 336524782 0 0) 0x7effd80033f0 con 0x7effec0bd1f0 2023-11-30T17:07:15.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.029+0000 7effea7fc700 1 -- 172.21.15.49:0/138857924 >> v2:172.21.15.115:3300/0 conn(0x7effec151a20 msgr2=0x7effec06a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:15.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.029+0000 7effea7fc700 1 --2- 172.21.15.49:0/138857924 >> v2:172.21.15.115:3300/0 conn(0x7effec151a20 0x7effec06a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:15.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.029+0000 7effea7fc700 1 -- 172.21.15.49:0/138857924 >> v1:172.21.15.115:6789/0 conn(0x7effec069d10 legacy=0x7effec0be1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:15.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.029+0000 7effea7fc700 1 -- 172.21.15.49:0/138857924 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effec152460 con 0x7effec0bd1f0 2023-11-30T17:07:15.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.029+0000 7effea7fc700 1 -- 172.21.15.49:0/138857924 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7effe40017f0 con 0x7effec0bd1f0 2023-11-30T17:07:15.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.029+0000 7effea7fc700 1 -- 172.21.15.49:0/138857924 >> v1:172.21.15.49:6789/0 conn(0x7effec0bd1f0 legacy=0x7effec0c38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:15.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.029+0000 7effea7fc700 1 --2- 172.21.15.49:0/138857924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effd80038e0 0x7effd8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:15.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.029+0000 7effea7fc700 1 --2- 172.21.15.49:0/138857924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd8004690 0x7effd8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:15.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.029+0000 7effea7fc700 1 --2- 172.21.15.49:0/138857924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effd8005000 0x7effd800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:15.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.029+0000 7effea7fc700 1 -- 172.21.15.49:0/138857924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec152180 con 0x7effd8004690 2023-11-30T17:07:15.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.029+0000 7effea7fc700 1 -- 172.21.15.49:0/138857924 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd800bf60 con 0x7effd8005000 2023-11-30T17:07:15.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.029+0000 7effea7fc700 1 -- 172.21.15.49:0/138857924 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd800e300 con 0x7effd80038e0 2023-11-30T17:07:15.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.029+0000 7effeaffd700 1 --2- 172.21.15.49:0/138857924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd8004690 0x7effd8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:15.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.029+0000 7effeb7fe700 1 --2- 172.21.15.49:0/138857924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effd80038e0 0x7effd8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:15.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.029+0000 7effebfff700 1 --2- 172.21.15.49:0/138857924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effd8005000 0x7effd800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:15.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.030+0000 7effeaffd700 1 -- 172.21.15.49:0/138857924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effd80038e0 msgr2=0x7effd8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:15.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.030+0000 7effeaffd700 1 --2- 172.21.15.49:0/138857924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effd80038e0 0x7effd8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:15.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.030+0000 7effeaffd700 1 -- 172.21.15.49:0/138857924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effd8005000 msgr2=0x7effd800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:15.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.030+0000 7effeaffd700 1 --2- 172.21.15.49:0/138857924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effd8005000 0x7effd800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:15.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.030+0000 7effeaffd700 1 -- 172.21.15.49:0/138857924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd80033f0 con 0x7effd8004690 2023-11-30T17:07:15.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.030+0000 7effebfff700 1 -- 172.21.15.49:0/138857924 reap_dead start 2023-11-30T17:07:15.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.030+0000 7effeaffd700 1 --2- 172.21.15.49:0/138857924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd8004690 0x7effd8004b10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7effec0c3260 tx=0x7effd4009060).ready entity=mon.0 client_cookie=98e9ec54678ff652 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:15.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.030+0000 7effea7fc700 1 -- 172.21.15.49:0/138857924 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd4009e90 con 0x7effd8004690 2023-11-30T17:07:15.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.030+0000 7effea7fc700 1 -- 172.21.15.49:0/138857924 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd4009430 con 0x7effd8004690 2023-11-30T17:07:15.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.030+0000 7effea7fc700 1 -- 172.21.15.49:0/138857924 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd400e820 con 0x7effd8004690 2023-11-30T17:07:15.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.030+0000 7efff2233700 1 -- 172.21.15.49:0/138857924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd8004690 msgr2=0x7effd8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:15.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.030+0000 7efff2233700 1 --2- 172.21.15.49:0/138857924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd8004690 0x7effd8004b10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7effec0c3260 tx=0x7effd4009060).stop 2023-11-30T17:07:15.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.030+0000 7efff2233700 1 -- 172.21.15.49:0/138857924 shutdown_connections 2023-11-30T17:07:15.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.030+0000 7efff2233700 1 --2- 172.21.15.49:0/138857924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd8004690 0x7effd8004b10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:15.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.030+0000 7efff2233700 1 -- 172.21.15.49:0/138857924 >> 172.21.15.49:0/138857924 conn(0x7effec0642d0 msgr2=0x7effec0c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:15.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.030+0000 7efff2233700 1 -- 172.21.15.49:0/138857924 shutdown_connections 2023-11-30T17:07:15.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.030+0000 7efff2233700 1 -- 172.21.15.49:0/138857924 wait complete. 2023-11-30T17:07:15.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.032+0000 7efff2233700 1 Processor -- start 2023-11-30T17:07:15.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.032+0000 7efff2233700 1 -- start start 2023-11-30T17:07:15.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.033+0000 7efff2233700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effd8004690 0x7effec14d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:15.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.033+0000 7efff2233700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effec0bf120 0x7effec149c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:15.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.033+0000 7efff2233700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effec0c4950 0x7effec0c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:15.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.033+0000 7efff2233700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec14dbb0 con 0x7effec0c4950 2023-11-30T17:07:15.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.033+0000 7efff2233700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec14de90 con 0x7effec0bf120 2023-11-30T17:07:15.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.033+0000 7efff2233700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effec14e170 con 0x7effd8004690 2023-11-30T17:07:15.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.033+0000 7effebfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effec0c4950 0x7effec0c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:15.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.033+0000 7effebfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effec0c4950 0x7effec0c5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46114/0 (socket says 172.21.15.49:46114) 2023-11-30T17:07:15.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.033+0000 7effebfff700 1 -- 172.21.15.49:0/4015196370 learned_addr learned my addr 172.21.15.49:0/4015196370 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:15.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.033+0000 7effeaffd700 1 --2- 172.21.15.49:0/4015196370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effec0bf120 0x7effec149c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:15.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.033+0000 7effeb7fe700 1 --2- 172.21.15.49:0/4015196370 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effd8004690 0x7effec14d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:15.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.033+0000 7effebfff700 1 -- 172.21.15.49:0/4015196370 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effd8004690 msgr2=0x7effec14d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:15.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.033+0000 7effebfff700 1 --2- 172.21.15.49:0/4015196370 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effd8004690 0x7effec14d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:15.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.033+0000 7effebfff700 1 -- 172.21.15.49:0/4015196370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effec0bf120 msgr2=0x7effec149c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:15.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.033+0000 7effebfff700 1 --2- 172.21.15.49:0/4015196370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effec0bf120 0x7effec149c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:15.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.033+0000 7effebfff700 1 -- 172.21.15.49:0/4015196370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effec14e450 con 0x7effec0c4950 2023-11-30T17:07:15.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.033+0000 7effebfff700 1 --2- 172.21.15.49:0/4015196370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effec0c4950 0x7effec0c5ee0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7effec0bde80 tx=0x7effe4007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:15.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.033+0000 7effe37fe700 1 -- 172.21.15.49:0/4015196370 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe4001080 con 0x7effec0c4950 2023-11-30T17:07:15.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.033+0000 7effe37fe700 1 -- 172.21.15.49:0/4015196370 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe4001250 con 0x7effec0c4950 2023-11-30T17:07:15.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.033+0000 7efff2233700 1 -- 172.21.15.49:0/4015196370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effec0a4db0 con 0x7effec0c4950 2023-11-30T17:07:15.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.033+0000 7effe37fe700 1 -- 172.21.15.49:0/4015196370 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe400fab0 con 0x7effec0c4950 2023-11-30T17:07:15.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.033+0000 7efff2233700 1 -- 172.21.15.49:0/4015196370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effec14a160 con 0x7effec0c4950 2023-11-30T17:07:15.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.034+0000 7efff2233700 1 -- 172.21.15.49:0/4015196370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effec0a4fa0 con 0x7effec0c4950 2023-11-30T17:07:15.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.035+0000 7effe37fe700 1 -- 172.21.15.49:0/4015196370 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7effe401d3b0 con 0x7effec0c4950 2023-11-30T17:07:15.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.035+0000 7effe37fe700 1 --2- 172.21.15.49:0/4015196370 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7effcc05f150 0x7effcc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:15.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.035+0000 7effe37fe700 1 -- 172.21.15.49:0/4015196370 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5639+0+0 (secure 0 0 0) 0x7effe4079aa0 con 0x7effec0c4950 2023-11-30T17:07:15.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.035+0000 7effeb7fe700 1 --2- 172.21.15.49:0/4015196370 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7effcc05f150 0x7effcc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:15.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.036+0000 7effeb7fe700 1 --2- 172.21.15.49:0/4015196370 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7effcc05f150 0x7effcc061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7effdc007fd0 tx=0x7effdc007bb0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:15.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.040+0000 7effe37fe700 1 -- 172.21.15.49:0/4015196370 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7effe404afa0 con 0x7effec0c4950 2023-11-30T17:07:15.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.212+0000 7efff2233700 1 -- 172.21.15.49:0/4015196370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7effec06c860 con 0x7effec0c4950 2023-11-30T17:07:15.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.891+0000 7effe37fe700 1 -- 172.21.15.49:0/4015196370 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7effe4019030 con 0x7effec0c4950 2023-11-30T17:07:15.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.908+0000 7efff2233700 1 -- 172.21.15.49:0/4015196370 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7effcc05f150 msgr2=0x7effcc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:15.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.908+0000 7efff2233700 1 --2- 172.21.15.49:0/4015196370 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7effcc05f150 0x7effcc061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7effdc007fd0 tx=0x7effdc007bb0).stop 2023-11-30T17:07:15.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.908+0000 7efff2233700 1 -- 172.21.15.49:0/4015196370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effec0c4950 msgr2=0x7effec0c5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:15.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.908+0000 7efff2233700 1 --2- 172.21.15.49:0/4015196370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effec0c4950 0x7effec0c5ee0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7effec0bde80 tx=0x7effe4007d90).stop 2023-11-30T17:07:15.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.909+0000 7efff2233700 1 -- 172.21.15.49:0/4015196370 shutdown_connections 2023-11-30T17:07:15.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.909+0000 7efff2233700 1 --2- 172.21.15.49:0/4015196370 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7effcc05f150 0x7effcc061610 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:15.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.909+0000 7efff2233700 1 --2- 172.21.15.49:0/4015196370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effec0c4950 0x7effec0c5ee0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:15.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.909+0000 7efff2233700 1 --2- 172.21.15.49:0/4015196370 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effd8004690 0x7effec14d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:15.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.909+0000 7efff2233700 1 --2- 172.21.15.49:0/4015196370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effec0bf120 0x7effec149c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:15.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.909+0000 7efff2233700 1 -- 172.21.15.49:0/4015196370 >> 172.21.15.49:0/4015196370 conn(0x7effec0642d0 msgr2=0x7effec14bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:15.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.911+0000 7efff2233700 1 -- 172.21.15.49:0/4015196370 shutdown_connections 2023-11-30T17:07:15.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:15.911+0000 7efff2233700 1 -- 172.21.15.49:0/4015196370 wait complete. 2023-11-30T17:07:15.917 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2023-11-30T17:07:15.931 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-30T17:07:16.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.053+0000 7f90bc6ea700 1 Processor -- start 2023-11-30T17:07:16.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.053+0000 7f90bc6ea700 1 -- start start 2023-11-30T17:07:16.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.054+0000 7f90bc6ea700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f90b414eb00 0x7f90b414eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:16.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.054+0000 7f90bc6ea700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90b40bc6c0 0x7f90b40bcb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:16.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.054+0000 7f90bc6ea700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b40bd030 con 0x7f90b4062770 2023-11-30T17:07:16.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.054+0000 7f90bc6ea700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b4137d90 con 0x7f90b414eb00 2023-11-30T17:07:16.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.054+0000 7f90bc6ea700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b40634a0 con 0x7f90b40bc6c0 2023-11-30T17:07:16.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.054+0000 7f90ba486700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f90b414eb00 0x7f90b414eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:16.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.054+0000 7f90ba486700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f90b414eb00 0x7f90b414eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46124/0 (socket says 172.21.15.49:46124) 2023-11-30T17:07:16.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.054+0000 7f90ba486700 1 -- 172.21.15.49:0/298376570 learned_addr learned my addr 172.21.15.49:0/298376570 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:16.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.054+0000 7f90bac87700 1 --1- 172.21.15.49:0/298376570 >> v1:172.21.15.49:6789/0 conn(0x7f90b4062770 0x7f90b4062c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46858/0 (socket says 172.21.15.49:46858) 2023-11-30T17:07:16.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.055+0000 7f90b9c85700 1 --2- 172.21.15.49:0/298376570 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90b40bc6c0 0x7f90b40bcb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:16.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.055+0000 7f90ba486700 1 -- 172.21.15.49:0/298376570 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90b40bc6c0 msgr2=0x7f90b40bcb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:16.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.055+0000 7f90ba486700 1 --2- 172.21.15.49:0/298376570 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90b40bc6c0 0x7f90b40bcb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:16.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.055+0000 7f90ba486700 1 -- 172.21.15.49:0/298376570 >> v1:172.21.15.49:6789/0 conn(0x7f90b4062770 legacy=0x7f90b4062c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:16.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.055+0000 7f90b9484700 1 -- 172.21.15.49:0/298376570 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3007373406 0 0) 0x7f90b40bd030 con 0x7f90b4062770 2023-11-30T17:07:16.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.055+0000 7f90ba486700 1 -- 172.21.15.49:0/298376570 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b4063780 con 0x7f90b414eb00 2023-11-30T17:07:16.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.055+0000 7f90b9c85700 1 --2- 172.21.15.49:0/298376570 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90b40bc6c0 0x7f90b40bcb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:16.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.055+0000 7f90ba486700 1 --2- 172.21.15.49:0/298376570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90b414eb00 0x7f90b414eee0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f90ac009810 tx=0x7f90ac009060).ready entity=mon.0 client_cookie=9a007ddf44902a9e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:16.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.055+0000 7f90b9484700 1 -- 172.21.15.49:0/298376570 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac005880 con 0x7f90b414eb00 2023-11-30T17:07:16.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.055+0000 7f90b9484700 1 -- 172.21.15.49:0/298376570 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ac0059e0 con 0x7f90b414eb00 2023-11-30T17:07:16.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.055+0000 7f90b9484700 1 -- 172.21.15.49:0/298376570 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac005d60 con 0x7f90b414eb00 2023-11-30T17:07:16.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.055+0000 7f90bc6ea700 1 -- 172.21.15.49:0/298376570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90b414eb00 msgr2=0x7f90b414eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:16.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.055+0000 7f90bc6ea700 1 --2- 172.21.15.49:0/298376570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90b414eb00 0x7f90b414eee0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f90ac009810 tx=0x7f90ac009060).stop 2023-11-30T17:07:16.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.055+0000 7f90bc6ea700 1 -- 172.21.15.49:0/298376570 shutdown_connections 2023-11-30T17:07:16.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.055+0000 7f90bc6ea700 1 --2- 172.21.15.49:0/298376570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90b414eb00 0x7f90b414eee0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:16.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.055+0000 7f90bc6ea700 1 --2- 172.21.15.49:0/298376570 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90b40bc6c0 0x7f90b40bcb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:16.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.055+0000 7f90bc6ea700 1 -- 172.21.15.49:0/298376570 >> 172.21.15.49:0/298376570 conn(0x7f90b40c8230 msgr2=0x7f90b40c4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:16.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.056+0000 7f90bc6ea700 1 -- 172.21.15.49:0/298376570 shutdown_connections 2023-11-30T17:07:16.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.056+0000 7f90bc6ea700 1 -- 172.21.15.49:0/298376570 wait complete. 2023-11-30T17:07:16.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.057+0000 7f90bc6ea700 1 Processor -- start 2023-11-30T17:07:16.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.057+0000 7f90bc6ea700 1 -- start start 2023-11-30T17:07:16.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.057+0000 7f90bc6ea700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90b4062770 0x7f90b41504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:16.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.057+0000 7f90bc6ea700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90b40bc6c0 0x7f90b4154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:16.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.057+0000 7f90bc6ea700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90b414eb00 0x7f90b41373f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:16.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.057+0000 7f90bc6ea700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b41509d0 con 0x7f90b4062770 2023-11-30T17:07:16.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.057+0000 7f90bc6ea700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b41553f0 con 0x7f90b414eb00 2023-11-30T17:07:16.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.057+0000 7f90bc6ea700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b41517f0 con 0x7f90b40bc6c0 2023-11-30T17:07:16.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.058+0000 7f90ba486700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90b4062770 0x7f90b41504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:16.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.058+0000 7f90ba486700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90b4062770 0x7f90b41504e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46134/0 (socket says 172.21.15.49:46134) 2023-11-30T17:07:16.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.058+0000 7f90ba486700 1 -- 172.21.15.49:0/45229512 learned_addr learned my addr 172.21.15.49:0/45229512 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:16.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.058+0000 7f90b9c85700 1 --2- 172.21.15.49:0/45229512 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90b40bc6c0 0x7f90b4154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:16.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.058+0000 7f90bac87700 1 --2- 172.21.15.49:0/45229512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90b414eb00 0x7f90b41373f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:16.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.058+0000 7f90ba486700 1 -- 172.21.15.49:0/45229512 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90b40bc6c0 msgr2=0x7f90b4154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:16.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.058+0000 7f90ba486700 1 --2- 172.21.15.49:0/45229512 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90b40bc6c0 0x7f90b4154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:16.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.058+0000 7f90ba486700 1 -- 172.21.15.49:0/45229512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90b414eb00 msgr2=0x7f90b41373f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:16.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.058+0000 7f90ba486700 1 --2- 172.21.15.49:0/45229512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90b414eb00 0x7f90b41373f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:16.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.058+0000 7f90ba486700 1 -- 172.21.15.49:0/45229512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ac009300 con 0x7f90b4062770 2023-11-30T17:07:16.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.058+0000 7f90bac87700 1 --2- 172.21.15.49:0/45229512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90b414eb00 0x7f90b41373f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:16.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.058+0000 7f90ba486700 1 --2- 172.21.15.49:0/45229512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90b4062770 0x7f90b41504e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f90ac009fd0 tx=0x7f90ac016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:16.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.058+0000 7f90b27fc700 1 -- 172.21.15.49:0/45229512 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac00b850 con 0x7f90b4062770 2023-11-30T17:07:16.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.058+0000 7f90b27fc700 1 -- 172.21.15.49:0/45229512 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ac00b9b0 con 0x7f90b4062770 2023-11-30T17:07:16.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.058+0000 7f90bc6ea700 1 -- 172.21.15.49:0/45229512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b4150be0 con 0x7f90b4062770 2023-11-30T17:07:16.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.058+0000 7f90b27fc700 1 -- 172.21.15.49:0/45229512 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac00bd70 con 0x7f90b4062770 2023-11-30T17:07:16.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.058+0000 7f90bc6ea700 1 -- 172.21.15.49:0/45229512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b41511a0 con 0x7f90b4062770 2023-11-30T17:07:16.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.059+0000 7f90bc6ea700 1 -- 172.21.15.49:0/45229512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90b406c860 con 0x7f90b4062770 2023-11-30T17:07:16.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.060+0000 7f90b27fc700 1 -- 172.21.15.49:0/45229512 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f90ac018070 con 0x7f90b4062770 2023-11-30T17:07:16.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.060+0000 7f90b27fc700 1 --2- 172.21.15.49:0/45229512 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f90a005f150 0x7f90a0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:16.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.060+0000 7f90b27fc700 1 -- 172.21.15.49:0/45229512 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f90ac07a840 con 0x7f90b4062770 2023-11-30T17:07:16.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.060+0000 7f90b9c85700 1 --2- 172.21.15.49:0/45229512 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f90a005f150 0x7f90a0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:16.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.061+0000 7f90b9c85700 1 --2- 172.21.15.49:0/45229512 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f90a005f150 0x7f90a0061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f90b414fb70 tx=0x7f90a8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:16.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.064+0000 7f90b27fc700 1 -- 172.21.15.49:0/45229512 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f90ac04bc20 con 0x7f90b4062770 2023-11-30T17:07:16.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.280+0000 7f90bc6ea700 1 -- 172.21.15.49:0/45229512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f90b40c4ac0 con 0x7f90b4062770 2023-11-30T17:07:16.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.286+0000 7f90b27fc700 1 -- 172.21.15.49:0/45229512 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f90ac020070 con 0x7f90b4062770 2023-11-30T17:07:16.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.289+0000 7f90bc6ea700 1 -- 172.21.15.49:0/45229512 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f90a005f150 msgr2=0x7f90a0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:16.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.289+0000 7f90bc6ea700 1 --2- 172.21.15.49:0/45229512 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f90a005f150 0x7f90a0061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f90b414fb70 tx=0x7f90a8008040).stop 2023-11-30T17:07:16.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.289+0000 7f90bc6ea700 1 -- 172.21.15.49:0/45229512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90b4062770 msgr2=0x7f90b41504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:16.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.289+0000 7f90bc6ea700 1 --2- 172.21.15.49:0/45229512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90b4062770 0x7f90b41504e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f90ac009fd0 tx=0x7f90ac016000).stop 2023-11-30T17:07:16.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.290+0000 7f90bc6ea700 1 -- 172.21.15.49:0/45229512 shutdown_connections 2023-11-30T17:07:16.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.290+0000 7f90bc6ea700 1 --2- 172.21.15.49:0/45229512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90b414eb00 0x7f90b41373f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:16.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.290+0000 7f90bc6ea700 1 --2- 172.21.15.49:0/45229512 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f90a005f150 0x7f90a0061610 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:16.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.290+0000 7f90bc6ea700 1 --2- 172.21.15.49:0/45229512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90b4062770 0x7f90b41504e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:16.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.290+0000 7f90bc6ea700 1 --2- 172.21.15.49:0/45229512 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90b40bc6c0 0x7f90b4154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:16.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.290+0000 7f90bc6ea700 1 -- 172.21.15.49:0/45229512 >> 172.21.15.49:0/45229512 conn(0x7f90b40c8230 msgr2=0x7f90b40ace40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:16.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.290+0000 7f90bc6ea700 1 -- 172.21.15.49:0/45229512 shutdown_connections 2023-11-30T17:07:16.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.291+0000 7f90bc6ea700 1 -- 172.21.15.49:0/45229512 wait complete. 2023-11-30T17:07:16.302 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 3 and data pool 4 2023-11-30T17:07:16.323 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:07:16.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.438+0000 7fa26608b700 1 Processor -- start 2023-11-30T17:07:16.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.438+0000 7fa26608b700 1 -- start start 2023-11-30T17:07:16.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.439+0000 7fa26608b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa260062700 0x7fa260062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:16.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.439+0000 7fa26608b700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2600630a0 con 0x7fa2600661b0 2023-11-30T17:07:16.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.439+0000 7fa26608b700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa260065760 con 0x7fa2601542d0 2023-11-30T17:07:16.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.439+0000 7fa26608b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2600c3250 con 0x7fa260062700 2023-11-30T17:07:16.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.439+0000 7fa25ffff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa2600661b0 0x7fa260066640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46868/0 (socket says 172.21.15.49:46868) 2023-11-30T17:07:16.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.439+0000 7fa25ffff700 1 -- 172.21.15.49:0/301145123 learned_addr learned my addr 172.21.15.49:0/301145123 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:16.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.439+0000 7fa25effd700 1 --2- 172.21.15.49:0/301145123 >> v2:172.21.15.115:3300/0 conn(0x7fa260062700 0x7fa260062bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:16.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.439+0000 7fa25e7fc700 1 -- 172.21.15.49:0/301145123 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1153600739 0 0) 0x7fa258001490 con 0x7fa2600661b0 2023-11-30T17:07:16.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.440+0000 7fa25e7fc700 1 -- 172.21.15.49:0/301145123 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2480033f0 con 0x7fa2600661b0 2023-11-30T17:07:16.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.440+0000 7fa25e7fc700 1 -- 172.21.15.49:0/301145123 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1640388564 0 0) 0x7fa260065760 con 0x7fa2601542d0 2023-11-30T17:07:16.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.440+0000 7fa25e7fc700 1 -- 172.21.15.49:0/301145123 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa258001490 con 0x7fa2601542d0 2023-11-30T17:07:16.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.440+0000 7fa25effd700 1 -- 172.21.15.49:0/301145123 >> v1:172.21.15.115:6789/0 conn(0x7fa2601542d0 legacy=0x7fa2600697f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:16.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.440+0000 7fa25effd700 1 -- 172.21.15.49:0/301145123 >> v1:172.21.15.49:6789/0 conn(0x7fa2600661b0 legacy=0x7fa260066640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:16.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.440+0000 7fa25e7fc700 1 -- 172.21.15.49:0/301145123 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2911889895 0 0) 0x7fa2480033f0 con 0x7fa2600661b0 2023-11-30T17:07:16.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.440+0000 7fa25effd700 1 -- 172.21.15.49:0/301145123 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26006a340 con 0x7fa260062700 2023-11-30T17:07:16.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.440+0000 7fa25effd700 1 --2- 172.21.15.49:0/301145123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa260062700 0x7fa260062bb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fa254009760 tx=0x7fa254009060).ready entity=mon.1 client_cookie=fcc2379df29dc313 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:16.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.440+0000 7fa25e7fc700 1 -- 172.21.15.49:0/301145123 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258001980 con 0x7fa260062700 2023-11-30T17:07:16.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.440+0000 7fa25e7fc700 1 -- 172.21.15.49:0/301145123 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa254011400 con 0x7fa260062700 2023-11-30T17:07:16.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.440+0000 7fa25e7fc700 1 -- 172.21.15.49:0/301145123 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa254011780 con 0x7fa260062700 2023-11-30T17:07:16.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.440+0000 7fa26608b700 1 -- 172.21.15.49:0/301145123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa260062700 msgr2=0x7fa260062bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:16.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.440+0000 7fa26608b700 1 --2- 172.21.15.49:0/301145123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa260062700 0x7fa260062bb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fa254009760 tx=0x7fa254009060).stop 2023-11-30T17:07:16.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.440+0000 7fa26608b700 1 -- 172.21.15.49:0/301145123 shutdown_connections 2023-11-30T17:07:16.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.440+0000 7fa26608b700 1 --2- 172.21.15.49:0/301145123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa260062700 0x7fa260062bb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:16.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.440+0000 7fa26608b700 1 -- 172.21.15.49:0/301145123 >> 172.21.15.49:0/301145123 conn(0x7fa2600c7fd0 msgr2=0x7fa2600c83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:16.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.441+0000 7fa26608b700 1 -- 172.21.15.49:0/301145123 shutdown_connections 2023-11-30T17:07:16.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.441+0000 7fa26608b700 1 -- 172.21.15.49:0/301145123 wait complete. 2023-11-30T17:07:16.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.442+0000 7fa26608b700 1 Processor -- start 2023-11-30T17:07:16.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.442+0000 7fa26608b700 1 -- start start 2023-11-30T17:07:16.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.443+0000 7fa26608b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa260062700 0x7fa2600a9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:16.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.443+0000 7fa26608b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2600661b0 0x7fa2600aaf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:16.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.443+0000 7fa26608b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2601542d0 0x7fa2600ab470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:16.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.443+0000 7fa26608b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2600ab960 con 0x7fa2601542d0 2023-11-30T17:07:16.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.443+0000 7fa26608b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa260168560 con 0x7fa2600661b0 2023-11-30T17:07:16.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.443+0000 7fa26608b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2600ac1a0 con 0x7fa260062700 2023-11-30T17:07:16.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.443+0000 7fa25ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2601542d0 0x7fa2600ab470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:16.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.443+0000 7fa25ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2601542d0 0x7fa2600ab470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46146/0 (socket says 172.21.15.49:46146) 2023-11-30T17:07:16.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.443+0000 7fa25ffff700 1 -- 172.21.15.49:0/243531957 learned_addr learned my addr 172.21.15.49:0/243531957 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:16.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.443+0000 7fa25effd700 1 --2- 172.21.15.49:0/243531957 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2600661b0 0x7fa2600aaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:16.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.443+0000 7fa25f7fe700 1 --2- 172.21.15.49:0/243531957 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa260062700 0x7fa2600a9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:16.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.443+0000 7fa25ffff700 1 -- 172.21.15.49:0/243531957 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa260062700 msgr2=0x7fa2600a9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:16.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.443+0000 7fa25ffff700 1 --2- 172.21.15.49:0/243531957 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa260062700 0x7fa2600a9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:16.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.443+0000 7fa25ffff700 1 -- 172.21.15.49:0/243531957 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2600661b0 msgr2=0x7fa2600aaf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:16.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.443+0000 7fa25ffff700 1 --2- 172.21.15.49:0/243531957 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2600661b0 0x7fa2600aaf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:16.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.443+0000 7fa25ffff700 1 -- 172.21.15.49:0/243531957 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2540092a0 con 0x7fa2601542d0 2023-11-30T17:07:16.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.443+0000 7fa25ffff700 1 --2- 172.21.15.49:0/243531957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2601542d0 0x7fa2600ab470 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fa25800cb50 tx=0x7fa2580017d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:16.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.443+0000 7fa2477fe700 1 -- 172.21.15.49:0/243531957 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258004c40 con 0x7fa2601542d0 2023-11-30T17:07:16.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.443+0000 7fa2477fe700 1 -- 172.21.15.49:0/243531957 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa258004dc0 con 0x7fa2601542d0 2023-11-30T17:07:16.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.443+0000 7fa26608b700 1 -- 172.21.15.49:0/243531957 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2600ac480 con 0x7fa2601542d0 2023-11-30T17:07:16.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.443+0000 7fa2477fe700 1 -- 172.21.15.49:0/243531957 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2580073c0 con 0x7fa2601542d0 2023-11-30T17:07:16.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.443+0000 7fa26608b700 1 -- 172.21.15.49:0/243531957 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2600aca40 con 0x7fa2601542d0 2023-11-30T17:07:16.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.444+0000 7fa26608b700 1 -- 172.21.15.49:0/243531957 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2600acc60 con 0x7fa2601542d0 2023-11-30T17:07:16.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.445+0000 7fa2477fe700 1 -- 172.21.15.49:0/243531957 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa258007770 con 0x7fa2601542d0 2023-11-30T17:07:16.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.445+0000 7fa2477fe700 1 --2- 172.21.15.49:0/243531957 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa24c05f120 0x7fa24c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:16.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.445+0000 7fa2477fe700 1 -- 172.21.15.49:0/243531957 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa258079f20 con 0x7fa2601542d0 2023-11-30T17:07:16.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.445+0000 7fa25f7fe700 1 --2- 172.21.15.49:0/243531957 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa24c05f120 0x7fa24c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:16.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.446+0000 7fa25f7fe700 1 --2- 172.21.15.49:0/243531957 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa24c05f120 0x7fa24c0615e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fa250003660 tx=0x7fa250009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:16.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.449+0000 7fa2477fe700 1 -- 172.21.15.49:0/243531957 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa25804b1f0 con 0x7fa2601542d0 2023-11-30T17:07:16.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.620+0000 7fa26608b700 1 -- 172.21.15.49:0/243531957 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2600630a0 con 0x7fa2601542d0 2023-11-30T17:07:16.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.621+0000 7fa2477fe700 1 -- 172.21.15.49:0/243531957 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16941 (secure 0 0 0) 0x7fa2600630a0 con 0x7fa2601542d0 2023-11-30T17:07:16.624 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:16.625 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":21,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:07:16.282177+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:07:14.837882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-30T17:07:15.248549+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:07:16.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.623+0000 7fa26608b700 1 -- 172.21.15.49:0/243531957 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa24c05f120 msgr2=0x7fa24c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:16.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.623+0000 7fa26608b700 1 --2- 172.21.15.49:0/243531957 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa24c05f120 0x7fa24c0615e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fa250003660 tx=0x7fa250009040).stop 2023-11-30T17:07:16.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.623+0000 7fa26608b700 1 -- 172.21.15.49:0/243531957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2601542d0 msgr2=0x7fa2600ab470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:16.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.623+0000 7fa26608b700 1 --2- 172.21.15.49:0/243531957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2601542d0 0x7fa2600ab470 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fa25800cb50 tx=0x7fa2580017d0).stop 2023-11-30T17:07:16.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.623+0000 7fa26608b700 1 -- 172.21.15.49:0/243531957 shutdown_connections 2023-11-30T17:07:16.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.623+0000 7fa26608b700 1 --2- 172.21.15.49:0/243531957 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa24c05f120 0x7fa24c0615e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:16.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.623+0000 7fa26608b700 1 --2- 172.21.15.49:0/243531957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2601542d0 0x7fa2600ab470 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:16.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.623+0000 7fa26608b700 1 --2- 172.21.15.49:0/243531957 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa260062700 0x7fa2600a9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:16.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.623+0000 7fa26608b700 1 --2- 172.21.15.49:0/243531957 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2600661b0 0x7fa2600aaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:16.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.623+0000 7fa26608b700 1 -- 172.21.15.49:0/243531957 >> 172.21.15.49:0/243531957 conn(0x7fa2600c7fd0 msgr2=0x7fa2600c6230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:16.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.623+0000 7fa26608b700 1 -- 172.21.15.49:0/243531957 shutdown_connections 2023-11-30T17:07:16.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.623+0000 7fa26608b700 1 -- 172.21.15.49:0/243531957 wait complete. 2023-11-30T17:07:16.638 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:07:16.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.752+0000 7f387efb9700 1 Processor -- start 2023-11-30T17:07:16.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.752+0000 7f387efb9700 1 -- start start 2023-11-30T17:07:16.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.753+0000 7f387efb9700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f38780c45d0 0x7f38780c2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:16.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.753+0000 7f387efb9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3878068090 0x7f38780c2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:16.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.753+0000 7f387efb9700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3878154d20 con 0x7f3878067cb0 2023-11-30T17:07:16.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.753+0000 7f387efb9700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3878151670 con 0x7f38780c45d0 2023-11-30T17:07:16.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.753+0000 7f387efb9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38780a7490 con 0x7f3878068090 2023-11-30T17:07:16.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.753+0000 7f387cd55700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3878067cb0 0x7f38780c3ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46872/0 (socket says 172.21.15.49:46872) 2023-11-30T17:07:16.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.753+0000 7f387cd55700 1 -- 172.21.15.49:0/365534517 learned_addr learned my addr 172.21.15.49:0/365534517 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:16.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.754+0000 7f3877fff700 1 --2- 172.21.15.49:0/365534517 >> v2:172.21.15.115:3300/0 conn(0x7f38780c45d0 0x7f38780c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:16.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.754+0000 7f387d556700 1 --2- 172.21.15.49:0/365534517 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3878068090 0x7f38780c2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:16.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.754+0000 7f38777fe700 1 -- 172.21.15.49:0/365534517 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3067679778 0 0) 0x7f3878154d20 con 0x7f3878067cb0 2023-11-30T17:07:16.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.754+0000 7f38777fe700 1 -- 172.21.15.49:0/365534517 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38640033f0 con 0x7f3878067cb0 2023-11-30T17:07:16.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.754+0000 7f3877fff700 1 -- 172.21.15.49:0/365534517 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3878068090 msgr2=0x7f38780c2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:16.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.754+0000 7f3877fff700 1 --2- 172.21.15.49:0/365534517 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3878068090 0x7f38780c2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:16.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.754+0000 7f3877fff700 1 -- 172.21.15.49:0/365534517 >> v1:172.21.15.49:6789/0 conn(0x7f3878067cb0 legacy=0x7f38780c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:16.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.754+0000 7f3877fff700 1 -- 172.21.15.49:0/365534517 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38781555c0 con 0x7f38780c45d0 2023-11-30T17:07:16.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.754+0000 7f387d556700 1 --2- 172.21.15.49:0/365534517 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3878068090 0x7f38780c2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:07:16.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.754+0000 7f3877fff700 1 --2- 172.21.15.49:0/365534517 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38780c45d0 0x7f38780c2640 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f3868009e60 tx=0x7f3868009780).ready entity=mon.1 client_cookie=e633df0f165e09 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:16.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.754+0000 7f38777fe700 1 -- 172.21.15.49:0/365534517 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386800e070 con 0x7f38780c45d0 2023-11-30T17:07:16.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.754+0000 7f38777fe700 1 -- 172.21.15.49:0/365534517 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386800bab0 con 0x7f38780c45d0 2023-11-30T17:07:16.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.754+0000 7f38777fe700 1 -- 172.21.15.49:0/365534517 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386800be30 con 0x7f38780c45d0 2023-11-30T17:07:16.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.755+0000 7f387efb9700 1 -- 172.21.15.49:0/365534517 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38780c45d0 msgr2=0x7f38780c2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:16.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.755+0000 7f387efb9700 1 --2- 172.21.15.49:0/365534517 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38780c45d0 0x7f38780c2640 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f3868009e60 tx=0x7f3868009780).stop 2023-11-30T17:07:16.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.755+0000 7f387efb9700 1 -- 172.21.15.49:0/365534517 shutdown_connections 2023-11-30T17:07:16.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.755+0000 7f387efb9700 1 --2- 172.21.15.49:0/365534517 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3878068090 0x7f38780c2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:16.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.755+0000 7f387efb9700 1 --2- 172.21.15.49:0/365534517 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38780c45d0 0x7f38780c2640 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:16.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.755+0000 7f387efb9700 1 -- 172.21.15.49:0/365534517 >> 172.21.15.49:0/365534517 conn(0x7f38780c7fd0 msgr2=0x7f38780c83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:16.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.755+0000 7f387efb9700 1 -- 172.21.15.49:0/365534517 shutdown_connections 2023-11-30T17:07:16.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.755+0000 7f387efb9700 1 -- 172.21.15.49:0/365534517 wait complete. 2023-11-30T17:07:16.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.756+0000 7f387efb9700 1 Processor -- start 2023-11-30T17:07:16.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.756+0000 7f387efb9700 1 -- start start 2023-11-30T17:07:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.757+0000 7f387efb9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3878067cb0 0x7f38780a7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.757+0000 7f387efb9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3878068090 0x7f38780c4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.757+0000 7f387efb9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38780c45d0 0x7f38780ac0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.757+0000 7f387efb9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3878154ab0 con 0x7f3878068090 2023-11-30T17:07:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.757+0000 7f387efb9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3878151ac0 con 0x7f38780c45d0 2023-11-30T17:07:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.757+0000 7f387efb9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3878154620 con 0x7f3878067cb0 2023-11-30T17:07:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.757+0000 7f3877fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3878068090 0x7f38780c4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.757+0000 7f3877fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3878068090 0x7f38780c4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46150/0 (socket says 172.21.15.49:46150) 2023-11-30T17:07:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.757+0000 7f3877fff700 1 -- 172.21.15.49:0/3582693499 learned_addr learned my addr 172.21.15.49:0/3582693499 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.757+0000 7f387cd55700 1 --2- 172.21.15.49:0/3582693499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3878067cb0 0x7f38780a7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.757+0000 7f387d556700 1 --2- 172.21.15.49:0/3582693499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38780c45d0 0x7f38780ac0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.757+0000 7f3877fff700 1 -- 172.21.15.49:0/3582693499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3878067cb0 msgr2=0x7f38780a7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.757+0000 7f3877fff700 1 --2- 172.21.15.49:0/3582693499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3878067cb0 0x7f38780a7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:16.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.757+0000 7f3877fff700 1 -- 172.21.15.49:0/3582693499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38780c45d0 msgr2=0x7f38780ac0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:16.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.757+0000 7f3877fff700 1 --2- 172.21.15.49:0/3582693499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38780c45d0 0x7f38780ac0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:16.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.757+0000 7f3877fff700 1 -- 172.21.15.49:0/3582693499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38600092a0 con 0x7f3878068090 2023-11-30T17:07:16.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.757+0000 7f387cd55700 1 --2- 172.21.15.49:0/3582693499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3878067cb0 0x7f38780a7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:07:16.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.758+0000 7f3877fff700 1 --2- 172.21.15.49:0/3582693499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3878068090 0x7f38780c4bc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f38680097c0 tx=0x7f38780c3670).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:16.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.758+0000 7f3874ff9700 1 -- 172.21.15.49:0/3582693499 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386801d420 con 0x7f3878068090 2023-11-30T17:07:16.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.758+0000 7f3874ff9700 1 -- 172.21.15.49:0/3582693499 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386801d5a0 con 0x7f3878068090 2023-11-30T17:07:16.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.758+0000 7f3874ff9700 1 -- 172.21.15.49:0/3582693499 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386801d960 con 0x7f3878068090 2023-11-30T17:07:16.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.758+0000 7f387efb9700 1 -- 172.21.15.49:0/3582693499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3868009a20 con 0x7f3878068090 2023-11-30T17:07:16.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.758+0000 7f387efb9700 1 -- 172.21.15.49:0/3582693499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3878153cf0 con 0x7f3878068090 2023-11-30T17:07:16.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.759+0000 7f387efb9700 1 -- 172.21.15.49:0/3582693499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f387806c860 con 0x7f3878068090 2023-11-30T17:07:16.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.759+0000 7f3874ff9700 1 -- 172.21.15.49:0/3582693499 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3868003040 con 0x7f3878068090 2023-11-30T17:07:16.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.759+0000 7f3874ff9700 1 --2- 172.21.15.49:0/3582693499 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f385805f150 0x7f3858061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:16.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.759+0000 7f3874ff9700 1 -- 172.21.15.49:0/3582693499 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f386807be80 con 0x7f3878068090 2023-11-30T17:07:16.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.760+0000 7f387cd55700 1 --2- 172.21.15.49:0/3582693499 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f385805f150 0x7f3858061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:16.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.760+0000 7f387cd55700 1 --2- 172.21.15.49:0/3582693499 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f385805f150 0x7f3858061610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f3870005750 tx=0x7f3870009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:16.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.763+0000 7f3874ff9700 1 -- 172.21.15.49:0/3582693499 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f386804d150 con 0x7f3878068090 2023-11-30T17:07:16.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.938+0000 7f387efb9700 1 -- 172.21.15.49:0/3582693499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38780a4f40 con 0x7f3878068090 2023-11-30T17:07:16.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.939+0000 7f3874ff9700 1 -- 172.21.15.49:0/3582693499 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16941 (secure 0 0 0) 0x7f3868050770 con 0x7f3878068090 2023-11-30T17:07:16.941 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:16.941 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":21,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:07:16.282177+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:07:14.837882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-30T17:07:15.248549+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:07:16.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.941+0000 7f387efb9700 1 -- 172.21.15.49:0/3582693499 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f385805f150 msgr2=0x7f3858061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:16.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.941+0000 7f387efb9700 1 --2- 172.21.15.49:0/3582693499 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f385805f150 0x7f3858061610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f3870005750 tx=0x7f3870009040).stop 2023-11-30T17:07:16.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.941+0000 7f387efb9700 1 -- 172.21.15.49:0/3582693499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3878068090 msgr2=0x7f38780c4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:16.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.941+0000 7f387efb9700 1 --2- 172.21.15.49:0/3582693499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3878068090 0x7f38780c4bc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f38680097c0 tx=0x7f38780c3670).stop 2023-11-30T17:07:16.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.941+0000 7f387efb9700 1 -- 172.21.15.49:0/3582693499 shutdown_connections 2023-11-30T17:07:16.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.941+0000 7f387efb9700 1 --2- 172.21.15.49:0/3582693499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38780c45d0 0x7f38780ac0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:16.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.941+0000 7f387efb9700 1 --2- 172.21.15.49:0/3582693499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3878067cb0 0x7f38780a7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:16.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.941+0000 7f387efb9700 1 --2- 172.21.15.49:0/3582693499 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f385805f150 0x7f3858061610 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:16.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.941+0000 7f387efb9700 1 --2- 172.21.15.49:0/3582693499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3878068090 0x7f38780c4bc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:16.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.941+0000 7f387efb9700 1 -- 172.21.15.49:0/3582693499 >> 172.21.15.49:0/3582693499 conn(0x7f38780c7fd0 msgr2=0x7f38780c7680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:16.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.941+0000 7f387efb9700 1 -- 172.21.15.49:0/3582693499 shutdown_connections 2023-11-30T17:07:16.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:16.941+0000 7f387efb9700 1 -- 172.21.15.49:0/3582693499 wait complete. 2023-11-30T17:07:16.956 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-30T17:07:17.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.074+0000 7fb3ee608700 1 Processor -- start 2023-11-30T17:07:17.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.075+0000 7fb3ee608700 1 -- start start 2023-11-30T17:07:17.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.075+0000 7fb3ee608700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb3e813be20 0x7fb3e80c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:17.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.075+0000 7fb3ee608700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e80c7500 con 0x7fb3e80c8780 2023-11-30T17:07:17.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.075+0000 7fb3ee608700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e80bd650 con 0x7fb3e8062700 2023-11-30T17:07:17.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.075+0000 7fb3ee608700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e813c200 con 0x7fb3e813be20 2023-11-30T17:07:17.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.076+0000 7fb3e77fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb3e80c8780 0x7fb3e80bcf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46888/0 (socket says 172.21.15.49:46888) 2023-11-30T17:07:17.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.076+0000 7fb3e77fe700 1 -- 172.21.15.49:0/4087398899 learned_addr learned my addr 172.21.15.49:0/4087398899 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:17.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.076+0000 7fb3e7fff700 1 --2- 172.21.15.49:0/4087398899 >> v2:172.21.15.115:3300/0 conn(0x7fb3e813be20 0x7fb3e80c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:17.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.076+0000 7fb3e6ffd700 1 -- 172.21.15.49:0/4087398899 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2733597275 0 0) 0x7fb3e80c7500 con 0x7fb3e80c8780 2023-11-30T17:07:17.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.076+0000 7fb3e6ffd700 1 -- 172.21.15.49:0/4087398899 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3d00033f0 con 0x7fb3e80c8780 2023-11-30T17:07:17.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.076+0000 7fb3e6ffd700 1 -- 172.21.15.49:0/4087398899 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3398611286 0 0) 0x7fb3e80bd650 con 0x7fb3e8062700 2023-11-30T17:07:17.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.076+0000 7fb3e6ffd700 1 -- 172.21.15.49:0/4087398899 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3e80c7500 con 0x7fb3e8062700 2023-11-30T17:07:17.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.076+0000 7fb3e6ffd700 1 -- 172.21.15.49:0/4087398899 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2433790467 0 0) 0x7fb3d00033f0 con 0x7fb3e80c8780 2023-11-30T17:07:17.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.076+0000 7fb3e7fff700 1 -- 172.21.15.49:0/4087398899 >> v1:172.21.15.115:6789/0 conn(0x7fb3e8062700 legacy=0x7fb3e80a4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:17.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.076+0000 7fb3e7fff700 1 -- 172.21.15.49:0/4087398899 >> v1:172.21.15.49:6789/0 conn(0x7fb3e80c8780 legacy=0x7fb3e80bcf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:17.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.076+0000 7fb3e7fff700 1 -- 172.21.15.49:0/4087398899 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e80c68f0 con 0x7fb3e813be20 2023-11-30T17:07:17.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.076+0000 7fb3e7fff700 1 --2- 172.21.15.49:0/4087398899 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3e813be20 0x7fb3e80c7990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fb3d8009760 tx=0x7fb3d8009060).ready entity=mon.1 client_cookie=24f2608c357835aa server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:17.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.076+0000 7fb3e6ffd700 1 -- 172.21.15.49:0/4087398899 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc001470 con 0x7fb3e813be20 2023-11-30T17:07:17.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.076+0000 7fb3e6ffd700 1 -- 172.21.15.49:0/4087398899 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d8011400 con 0x7fb3e813be20 2023-11-30T17:07:17.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.076+0000 7fb3e6ffd700 1 -- 172.21.15.49:0/4087398899 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8011780 con 0x7fb3e813be20 2023-11-30T17:07:17.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.077+0000 7fb3ee608700 1 -- 172.21.15.49:0/4087398899 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3e813be20 msgr2=0x7fb3e80c7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:17.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.077+0000 7fb3ee608700 1 --2- 172.21.15.49:0/4087398899 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3e813be20 0x7fb3e80c7990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fb3d8009760 tx=0x7fb3d8009060).stop 2023-11-30T17:07:17.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.077+0000 7fb3ee608700 1 -- 172.21.15.49:0/4087398899 shutdown_connections 2023-11-30T17:07:17.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.077+0000 7fb3ee608700 1 --2- 172.21.15.49:0/4087398899 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3e813be20 0x7fb3e80c7990 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:17.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.077+0000 7fb3ee608700 1 -- 172.21.15.49:0/4087398899 >> 172.21.15.49:0/4087398899 conn(0x7fb3e80642d0 msgr2=0x7fb3e80c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:17.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.077+0000 7fb3ee608700 1 -- 172.21.15.49:0/4087398899 shutdown_connections 2023-11-30T17:07:17.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.077+0000 7fb3ee608700 1 -- 172.21.15.49:0/4087398899 wait complete. 2023-11-30T17:07:17.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.078+0000 7fb3ee608700 1 Processor -- start 2023-11-30T17:07:17.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.078+0000 7fb3ee608700 1 -- start start 2023-11-30T17:07:17.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.079+0000 7fb3ee608700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3e8062700 0x7fb3e8152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:17.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.079+0000 7fb3ee608700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3e80c8780 0x7fb3e80c1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:17.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.079+0000 7fb3ee608700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3e813be20 0x7fb3e80c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:17.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.079+0000 7fb3ee608700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e8152760 con 0x7fb3e8062700 2023-11-30T17:07:17.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.079+0000 7fb3ee608700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e80c1070 con 0x7fb3e813be20 2023-11-30T17:07:17.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.079+0000 7fb3ee608700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e80c19f0 con 0x7fb3e80c8780 2023-11-30T17:07:17.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.079+0000 7fb3e7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3e8062700 0x7fb3e8152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:17.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.079+0000 7fb3e7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3e8062700 0x7fb3e8152270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46158/0 (socket says 172.21.15.49:46158) 2023-11-30T17:07:17.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.079+0000 7fb3e7fff700 1 -- 172.21.15.49:0/3761753784 learned_addr learned my addr 172.21.15.49:0/3761753784 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:17.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.079+0000 7fb3ecba5700 1 --2- 172.21.15.49:0/3761753784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3e813be20 0x7fb3e80c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:17.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.079+0000 7fb3e77fe700 1 --2- 172.21.15.49:0/3761753784 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3e80c8780 0x7fb3e80c1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:17.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.079+0000 7fb3e7fff700 1 -- 172.21.15.49:0/3761753784 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3e80c8780 msgr2=0x7fb3e80c1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:17.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.079+0000 7fb3e7fff700 1 --2- 172.21.15.49:0/3761753784 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3e80c8780 0x7fb3e80c1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:17.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.079+0000 7fb3e7fff700 1 -- 172.21.15.49:0/3761753784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3e813be20 msgr2=0x7fb3e80c3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:17.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.079+0000 7fb3e7fff700 1 --2- 172.21.15.49:0/3761753784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3e813be20 0x7fb3e80c3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:17.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.079+0000 7fb3e7fff700 1 -- 172.21.15.49:0/3761753784 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d80092a0 con 0x7fb3e8062700 2023-11-30T17:07:17.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.080+0000 7fb3e7fff700 1 --2- 172.21.15.49:0/3761753784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3e8062700 0x7fb3e8152270 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fb3d8011880 tx=0x7fb3d8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:17.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.080+0000 7fb3cffff700 1 -- 172.21.15.49:0/3761753784 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d80107c0 con 0x7fb3e8062700 2023-11-30T17:07:17.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.080+0000 7fb3cffff700 1 -- 172.21.15.49:0/3761753784 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d8010920 con 0x7fb3e8062700 2023-11-30T17:07:17.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.080+0000 7fb3ee608700 1 -- 172.21.15.49:0/3761753784 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e80c0460 con 0x7fb3e8062700 2023-11-30T17:07:17.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.080+0000 7fb3cffff700 1 -- 172.21.15.49:0/3761753784 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8010ce0 con 0x7fb3e8062700 2023-11-30T17:07:17.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.080+0000 7fb3ee608700 1 -- 172.21.15.49:0/3761753784 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e80c0a20 con 0x7fb3e8062700 2023-11-30T17:07:17.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.081+0000 7fb3ee608700 1 -- 172.21.15.49:0/3761753784 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e80beee0 con 0x7fb3e8062700 2023-11-30T17:07:17.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.081+0000 7fb3cffff700 1 -- 172.21.15.49:0/3761753784 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb3d801d640 con 0x7fb3e8062700 2023-11-30T17:07:17.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.081+0000 7fb3cffff700 1 --2- 172.21.15.49:0/3761753784 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb3d405f150 0x7fb3d4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:17.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.081+0000 7fb3cffff700 1 -- 172.21.15.49:0/3761753784 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb3d807b670 con 0x7fb3e8062700 2023-11-30T17:07:17.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.082+0000 7fb3e77fe700 1 --2- 172.21.15.49:0/3761753784 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb3d405f150 0x7fb3d4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:17.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.082+0000 7fb3e77fe700 1 --2- 172.21.15.49:0/3761753784 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb3d405f150 0x7fb3d4061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fb3dc000fb0 tx=0x7fb3dc001620).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:17.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.085+0000 7fb3cffff700 1 -- 172.21.15.49:0/3761753784 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb3d804c940 con 0x7fb3e8062700 2023-11-30T17:07:17.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:17.306+0000 7fb3ee608700 1 -- 172.21.15.49:0/3761753784 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb3e806c860 con 0x7fb3e8062700 2023-11-30T17:07:18.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.293+0000 7fb3cffff700 1 -- 172.21.15.49:0/3761753784 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb3d804ff60 con 0x7fb3e8062700 2023-11-30T17:07:18.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.296+0000 7fb3ee608700 1 -- 172.21.15.49:0/3761753784 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb3d405f150 msgr2=0x7fb3d4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:18.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.296+0000 7fb3ee608700 1 --2- 172.21.15.49:0/3761753784 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb3d405f150 0x7fb3d4061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fb3dc000fb0 tx=0x7fb3dc001620).stop 2023-11-30T17:07:18.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.296+0000 7fb3ee608700 1 -- 172.21.15.49:0/3761753784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3e8062700 msgr2=0x7fb3e8152270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:18.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.296+0000 7fb3ee608700 1 --2- 172.21.15.49:0/3761753784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3e8062700 0x7fb3e8152270 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fb3d8011880 tx=0x7fb3d8016000).stop 2023-11-30T17:07:18.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.296+0000 7fb3ee608700 1 -- 172.21.15.49:0/3761753784 shutdown_connections 2023-11-30T17:07:18.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.296+0000 7fb3ee608700 1 --2- 172.21.15.49:0/3761753784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3e813be20 0x7fb3e80c3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:18.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.296+0000 7fb3ee608700 1 --2- 172.21.15.49:0/3761753784 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb3d405f150 0x7fb3d4061610 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:18.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.296+0000 7fb3ee608700 1 --2- 172.21.15.49:0/3761753784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3e8062700 0x7fb3e8152270 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:18.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.296+0000 7fb3ee608700 1 --2- 172.21.15.49:0/3761753784 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3e80c8780 0x7fb3e80c1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:18.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.296+0000 7fb3ee608700 1 -- 172.21.15.49:0/3761753784 >> 172.21.15.49:0/3761753784 conn(0x7fb3e80642d0 msgr2=0x7fb3e80a4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:18.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.296+0000 7fb3ee608700 1 -- 172.21.15.49:0/3761753784 shutdown_connections 2023-11-30T17:07:18.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.296+0000 7fb3ee608700 1 -- 172.21.15.49:0/3761753784 wait complete. 2023-11-30T17:07:18.313 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-30T17:07:18.313 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-30T17:07:18.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.436+0000 7f2d12327700 1 Processor -- start 2023-11-30T17:07:18.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.436+0000 7f2d12327700 1 -- start start 2023-11-30T17:07:18.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.437+0000 7f2d12327700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2d0c14e530 0x7f2d0c0c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:18.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.437+0000 7f2d12327700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d0c154950 0x7f2d0c14e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:18.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.437+0000 7f2d12327700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d0c0c7bc0 con 0x7f2d0c158570 2023-11-30T17:07:18.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.437+0000 7f2d12327700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0c155920 con 0x7f2d0c14e530 2023-11-30T17:07:18.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.437+0000 7f2d12327700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c154dd0 con 0x7f2d0c154950 2023-11-30T17:07:18.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.437+0000 7f2d11b26700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2d0c158570 0x7f2d0c0aa030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46896/0 (socket says 172.21.15.49:46896) 2023-11-30T17:07:18.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.437+0000 7f2d11b26700 1 -- 172.21.15.49:0/1451779585 learned_addr learned my addr 172.21.15.49:0/1451779585 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:18.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.437+0000 7f2d10b24700 1 --2- 172.21.15.49:0/1451779585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d0c154950 0x7f2d0c14e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:18.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.437+0000 7f2d11325700 1 --2- 172.21.15.49:0/1451779585 >> v2:172.21.15.115:3300/0 conn(0x7f2d0c14e530 0x7f2d0c0c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:18.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.437+0000 7f2d0bfff700 1 -- 172.21.15.49:0/1451779585 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2061799290 0 0) 0x7f2d0c0c7bc0 con 0x7f2d0c158570 2023-11-30T17:07:18.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.437+0000 7f2d0bfff700 1 -- 172.21.15.49:0/1451779585 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cf40033f0 con 0x7f2d0c158570 2023-11-30T17:07:18.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.437+0000 7f2d0bfff700 1 -- 172.21.15.49:0/1451779585 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2031833506 0 0) 0x7f2cf40033f0 con 0x7f2d0c158570 2023-11-30T17:07:18.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.438+0000 7f2d0bfff700 1 -- 172.21.15.49:0/1451779585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d0c154950 msgr2=0x7f2d0c14e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:18.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.438+0000 7f2d0bfff700 1 --2- 172.21.15.49:0/1451779585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d0c154950 0x7f2d0c14e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:18.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.438+0000 7f2d0bfff700 1 -- 172.21.15.49:0/1451779585 >> v2:172.21.15.115:3300/0 conn(0x7f2d0c14e530 msgr2=0x7f2d0c0c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:18.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.438+0000 7f2d0bfff700 1 --2- 172.21.15.49:0/1451779585 >> v2:172.21.15.115:3300/0 conn(0x7f2d0c14e530 0x7f2d0c0c66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:18.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.438+0000 7f2d0bfff700 1 -- 172.21.15.49:0/1451779585 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0c155080 con 0x7f2d0c158570 2023-11-30T17:07:18.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.438+0000 7f2d0bfff700 1 -- 172.21.15.49:0/1451779585 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f2d040017f0 con 0x7f2d0c158570 2023-11-30T17:07:18.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.438+0000 7f2d0bfff700 1 -- 172.21.15.49:0/1451779585 >> v1:172.21.15.49:6789/0 conn(0x7f2d0c158570 legacy=0x7f2d0c0aa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:18.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.438+0000 7f2d0bfff700 1 --2- 172.21.15.49:0/1451779585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cf40038e0 0x7f2cf4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:18.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.438+0000 7f2d0bfff700 1 --2- 172.21.15.49:0/1451779585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2cf4004690 0x7f2cf4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:18.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.438+0000 7f2d0bfff700 1 --2- 172.21.15.49:0/1451779585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d0c154950 0x7f2cf4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:18.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.438+0000 7f2d0bfff700 1 -- 172.21.15.49:0/1451779585 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c155920 con 0x7f2cf4004690 2023-11-30T17:07:18.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.438+0000 7f2d0bfff700 1 -- 172.21.15.49:0/1451779585 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c154dd0 con 0x7f2cf40038e0 2023-11-30T17:07:18.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.438+0000 7f2d0bfff700 1 -- 172.21.15.49:0/1451779585 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf400b8e0 con 0x7f2d0c154950 2023-11-30T17:07:18.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.438+0000 7f2d10b24700 1 --2- 172.21.15.49:0/1451779585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2cf4004690 0x7f2cf4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:18.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.438+0000 7f2d11325700 1 --2- 172.21.15.49:0/1451779585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cf40038e0 0x7f2cf4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:18.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.438+0000 7f2d11b26700 1 --2- 172.21.15.49:0/1451779585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d0c154950 0x7f2cf4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:18.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.438+0000 7f2d10b24700 1 -- 172.21.15.49:0/1451779585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d0c154950 msgr2=0x7f2cf4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:18.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.438+0000 7f2d10b24700 1 --2- 172.21.15.49:0/1451779585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d0c154950 0x7f2cf4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:18.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.438+0000 7f2d10b24700 1 -- 172.21.15.49:0/1451779585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cf40038e0 msgr2=0x7f2cf4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:18.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.438+0000 7f2d10b24700 1 --2- 172.21.15.49:0/1451779585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cf40038e0 0x7f2cf4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:18.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.438+0000 7f2d10b24700 1 -- 172.21.15.49:0/1451779585 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf40033f0 con 0x7f2cf4004690 2023-11-30T17:07:18.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.438+0000 7f2d10b24700 1 --2- 172.21.15.49:0/1451779585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2cf4004690 0x7f2cf4004b10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f2d00009a90 tx=0x7f2d00009060).ready entity=mon.0 client_cookie=4e36effdb8b16e9a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:18.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.438+0000 7f2d0bfff700 1 -- 172.21.15.49:0/1451779585 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d00009430 con 0x7f2cf4004690 2023-11-30T17:07:18.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.438+0000 7f2d0bfff700 1 -- 172.21.15.49:0/1451779585 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0000e640 con 0x7f2cf4004690 2023-11-30T17:07:18.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.438+0000 7f2d0bfff700 1 -- 172.21.15.49:0/1451779585 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0000e9c0 con 0x7f2cf4004690 2023-11-30T17:07:18.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.439+0000 7f2d12327700 1 -- 172.21.15.49:0/1451779585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2cf4004690 msgr2=0x7f2cf4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:18.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.439+0000 7f2d12327700 1 --2- 172.21.15.49:0/1451779585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2cf4004690 0x7f2cf4004b10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f2d00009a90 tx=0x7f2d00009060).stop 2023-11-30T17:07:18.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.439+0000 7f2d11b26700 1 -- 172.21.15.49:0/1451779585 reap_dead start 2023-11-30T17:07:18.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.439+0000 7f2d12327700 1 -- 172.21.15.49:0/1451779585 shutdown_connections 2023-11-30T17:07:18.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.439+0000 7f2d12327700 1 -- 172.21.15.49:0/1451779585 >> 172.21.15.49:0/1451779585 conn(0x7f2d0c064990 msgr2=0x7f2d0c064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:18.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.439+0000 7f2d12327700 1 -- 172.21.15.49:0/1451779585 shutdown_connections 2023-11-30T17:07:18.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.439+0000 7f2d12327700 1 -- 172.21.15.49:0/1451779585 wait complete. 2023-11-30T17:07:18.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.440+0000 7f2d12327700 1 Processor -- start 2023-11-30T17:07:18.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.440+0000 7f2d12327700 1 -- start start 2023-11-30T17:07:18.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.441+0000 7f2d12327700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2cf4004690 0x7f2d0c142ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:18.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.441+0000 7f2d12327700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d0c167a50 0x7f2d0c167eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:18.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.441+0000 7f2d12327700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d0c0afd10 0x7f2d0c0b0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:18.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.441+0000 7f2d12327700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c0c4cc0 con 0x7f2d0c0afd10 2023-11-30T17:07:18.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.441+0000 7f2d12327700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c0af880 con 0x7f2d0c167a50 2023-11-30T17:07:18.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.441+0000 7f2d12327700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c1683a0 con 0x7f2cf4004690 2023-11-30T17:07:18.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.441+0000 7f2d11b26700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d0c0afd10 0x7f2d0c0b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:18.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.441+0000 7f2d11b26700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d0c0afd10 0x7f2d0c0b0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46172/0 (socket says 172.21.15.49:46172) 2023-11-30T17:07:18.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.441+0000 7f2d11b26700 1 -- 172.21.15.49:0/3369157004 learned_addr learned my addr 172.21.15.49:0/3369157004 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:18.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.441+0000 7f2d11325700 1 --2- 172.21.15.49:0/3369157004 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2cf4004690 0x7f2d0c142ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:18.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.441+0000 7f2d10b24700 1 --2- 172.21.15.49:0/3369157004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d0c167a50 0x7f2d0c167eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:18.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.441+0000 7f2d11b26700 1 -- 172.21.15.49:0/3369157004 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2cf4004690 msgr2=0x7f2d0c142ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:18.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.441+0000 7f2d11b26700 1 --2- 172.21.15.49:0/3369157004 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2cf4004690 0x7f2d0c142ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:18.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.441+0000 7f2d11b26700 1 -- 172.21.15.49:0/3369157004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d0c167a50 msgr2=0x7f2d0c167eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:18.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.441+0000 7f2d11b26700 1 --2- 172.21.15.49:0/3369157004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d0c167a50 0x7f2d0c167eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:18.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.441+0000 7f2d11b26700 1 -- 172.21.15.49:0/3369157004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0c0af270 con 0x7f2d0c0afd10 2023-11-30T17:07:18.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.442+0000 7f2d11b26700 1 --2- 172.21.15.49:0/3369157004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d0c0afd10 0x7f2d0c0b0170 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f2d04000f80 tx=0x7f2d04001d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:18.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.442+0000 7f2d097fa700 1 -- 172.21.15.49:0/3369157004 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d040017b0 con 0x7f2d0c0afd10 2023-11-30T17:07:18.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.442+0000 7f2d097fa700 1 -- 172.21.15.49:0/3369157004 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d040020a0 con 0x7f2d0c0afd10 2023-11-30T17:07:18.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.442+0000 7f2d12327700 1 -- 172.21.15.49:0/3369157004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d0c0c49e0 con 0x7f2d0c0afd10 2023-11-30T17:07:18.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.442+0000 7f2d097fa700 1 -- 172.21.15.49:0/3369157004 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0400fdb0 con 0x7f2d0c0afd10 2023-11-30T17:07:18.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.442+0000 7f2d12327700 1 -- 172.21.15.49:0/3369157004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0c1405c0 con 0x7f2d0c0afd10 2023-11-30T17:07:18.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.443+0000 7f2d12327700 1 -- 172.21.15.49:0/3369157004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d0c0af0d0 con 0x7f2d0c0afd10 2023-11-30T17:07:18.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.443+0000 7f2d097fa700 1 -- 172.21.15.49:0/3369157004 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2d04012560 con 0x7f2d0c0afd10 2023-11-30T17:07:18.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.443+0000 7f2d097fa700 1 --2- 172.21.15.49:0/3369157004 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2cf805f150 0x7f2cf8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:18.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.443+0000 7f2d097fa700 1 -- 172.21.15.49:0/3369157004 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2d040799e0 con 0x7f2d0c0afd10 2023-11-30T17:07:18.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.444+0000 7f2d11325700 1 --2- 172.21.15.49:0/3369157004 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2cf805f150 0x7f2cf8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:18.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.444+0000 7f2d11325700 1 --2- 172.21.15.49:0/3369157004 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2cf805f150 0x7f2cf8061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f2cfc006d80 tx=0x7f2cfc009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:18.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.448+0000 7f2d097fa700 1 -- 172.21.15.49:0/3369157004 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2d0c0af0d0 con 0x7f2d0c0afd10 2023-11-30T17:07:18.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:18.664+0000 7f2d12327700 1 -- 172.21.15.49:0/3369157004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2d0c0af0d0 con 0x7f2d0c0afd10 2023-11-30T17:07:18.974 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:07:18.977 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:07:19.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.298+0000 7f2d097fa700 1 -- 172.21.15.49:0/3369157004 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2d0c0af0d0 con 0x7f2d0c0afd10 2023-11-30T17:07:19.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.300+0000 7f2d12327700 1 -- 172.21.15.49:0/3369157004 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2cf805f150 msgr2=0x7f2cf8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:19.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.300+0000 7f2d12327700 1 --2- 172.21.15.49:0/3369157004 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2cf805f150 0x7f2cf8061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f2cfc006d80 tx=0x7f2cfc009060).stop 2023-11-30T17:07:19.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.300+0000 7f2d12327700 1 -- 172.21.15.49:0/3369157004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d0c0afd10 msgr2=0x7f2d0c0b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:19.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.300+0000 7f2d12327700 1 --2- 172.21.15.49:0/3369157004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d0c0afd10 0x7f2d0c0b0170 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f2d04000f80 tx=0x7f2d04001d90).stop 2023-11-30T17:07:19.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.300+0000 7f2d12327700 1 -- 172.21.15.49:0/3369157004 shutdown_connections 2023-11-30T17:07:19.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.300+0000 7f2d12327700 1 --2- 172.21.15.49:0/3369157004 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2cf805f150 0x7f2cf8061610 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:19.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.300+0000 7f2d12327700 1 --2- 172.21.15.49:0/3369157004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d0c0afd10 0x7f2d0c0b0170 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:19.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.300+0000 7f2d12327700 1 --2- 172.21.15.49:0/3369157004 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2cf4004690 0x7f2d0c142ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:19.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.300+0000 7f2d12327700 1 --2- 172.21.15.49:0/3369157004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d0c167a50 0x7f2d0c167eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:19.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.300+0000 7f2d12327700 1 -- 172.21.15.49:0/3369157004 >> 172.21.15.49:0/3369157004 conn(0x7f2d0c064990 msgr2=0x7f2d0c0c9300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:19.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.300+0000 7f2d12327700 1 -- 172.21.15.49:0/3369157004 shutdown_connections 2023-11-30T17:07:19.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.300+0000 7f2d12327700 1 -- 172.21.15.49:0/3369157004 wait complete. 2023-11-30T17:07:19.315 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-30T17:07:19.316 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:07:19.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.433+0000 7f0344662700 1 Processor -- start 2023-11-30T17:07:19.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.433+0000 7f0344662700 1 -- start start 2023-11-30T17:07:19.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.434+0000 7f0344662700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f033c0ca180 0x7f033c15f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:19.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.434+0000 7f0344662700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f033c0a9a90 con 0x7f033c0cae90 2023-11-30T17:07:19.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.434+0000 7f0344662700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f033c154ce0 con 0x7f033c0caab0 2023-11-30T17:07:19.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.434+0000 7f0344662700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f033c0aab80 con 0x7f033c0ca180 2023-11-30T17:07:19.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.434+0000 7f0341bfd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f033c0cae90 0x7f033c0c0ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46908/0 (socket says 172.21.15.49:46908) 2023-11-30T17:07:19.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.434+0000 7f0341bfd700 1 -- 172.21.15.49:0/70727569 learned_addr learned my addr 172.21.15.49:0/70727569 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:19.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.434+0000 7f0342bff700 1 --2- 172.21.15.49:0/70727569 >> v2:172.21.15.115:3300/0 conn(0x7f033c0ca180 0x7f033c15f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:19.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.434+0000 7f03413fc700 1 -- 172.21.15.49:0/70727569 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1035690978 0 0) 0x7f033c0a9a90 con 0x7f033c0cae90 2023-11-30T17:07:19.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.434+0000 7f03413fc700 1 -- 172.21.15.49:0/70727569 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03280033f0 con 0x7f033c0cae90 2023-11-30T17:07:19.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.434+0000 7f0342bff700 1 -- 172.21.15.49:0/70727569 >> v1:172.21.15.115:6789/0 conn(0x7f033c0caab0 legacy=0x7f033c0aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:19.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.434+0000 7f0342bff700 1 -- 172.21.15.49:0/70727569 >> v1:172.21.15.49:6789/0 conn(0x7f033c0cae90 legacy=0x7f033c0c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:19.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.434+0000 7f0342bff700 1 -- 172.21.15.49:0/70727569 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033c0a8e80 con 0x7f033c0ca180 2023-11-30T17:07:19.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.434+0000 7f0342bff700 1 --2- 172.21.15.49:0/70727569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f033c0ca180 0x7f033c15f3d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f0334009e60 tx=0x7f0334009780).ready entity=mon.1 client_cookie=3f58094d5c361d2d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:19.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.435+0000 7f03413fc700 1 -- 172.21.15.49:0/70727569 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033400e070 con 0x7f033c0ca180 2023-11-30T17:07:19.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.435+0000 7f03413fc700 1 -- 172.21.15.49:0/70727569 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033400bb60 con 0x7f033c0ca180 2023-11-30T17:07:19.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.435+0000 7f03413fc700 1 -- 172.21.15.49:0/70727569 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0334012410 con 0x7f033c0ca180 2023-11-30T17:07:19.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.435+0000 7f0344662700 1 -- 172.21.15.49:0/70727569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f033c0ca180 msgr2=0x7f033c15f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:19.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.435+0000 7f0344662700 1 --2- 172.21.15.49:0/70727569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f033c0ca180 0x7f033c15f3d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f0334009e60 tx=0x7f0334009780).stop 2023-11-30T17:07:19.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.435+0000 7f0344662700 1 -- 172.21.15.49:0/70727569 shutdown_connections 2023-11-30T17:07:19.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.435+0000 7f0344662700 1 --2- 172.21.15.49:0/70727569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f033c0ca180 0x7f033c15f3d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:19.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.435+0000 7f0344662700 1 -- 172.21.15.49:0/70727569 >> 172.21.15.49:0/70727569 conn(0x7f033c094920 msgr2=0x7f033c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:19.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.435+0000 7f0344662700 1 -- 172.21.15.49:0/70727569 shutdown_connections 2023-11-30T17:07:19.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.435+0000 7f0344662700 1 -- 172.21.15.49:0/70727569 wait complete. 2023-11-30T17:07:19.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.436+0000 7f0344662700 1 Processor -- start 2023-11-30T17:07:19.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.436+0000 7f0344662700 1 -- start start 2023-11-30T17:07:19.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.437+0000 7f0344662700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f033c0ca180 0x7f033c0c2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:19.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.437+0000 7f0344662700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f033c0caab0 0x7f033c150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:19.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.437+0000 7f0344662700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f033c0cae90 0x7f033c0c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:19.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.437+0000 7f0344662700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033c0abcf0 con 0x7f033c0ca180 2023-11-30T17:07:19.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.437+0000 7f0344662700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033c0c3550 con 0x7f033c0cae90 2023-11-30T17:07:19.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.437+0000 7f0344662700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033c0c3830 con 0x7f033c0caab0 2023-11-30T17:07:19.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.437+0000 7f03423fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f033c0ca180 0x7f033c0c2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:19.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.437+0000 7f03423fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f033c0ca180 0x7f033c0c2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46174/0 (socket says 172.21.15.49:46174) 2023-11-30T17:07:19.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.437+0000 7f03423fe700 1 -- 172.21.15.49:0/2270149828 learned_addr learned my addr 172.21.15.49:0/2270149828 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:19.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.437+0000 7f0342bff700 1 --2- 172.21.15.49:0/2270149828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f033c0cae90 0x7f033c0c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:19.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.437+0000 7f0341bfd700 1 --2- 172.21.15.49:0/2270149828 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f033c0caab0 0x7f033c150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:19.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.438+0000 7f03423fe700 1 -- 172.21.15.49:0/2270149828 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f033c0caab0 msgr2=0x7f033c150020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:19.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.438+0000 7f03423fe700 1 --2- 172.21.15.49:0/2270149828 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f033c0caab0 0x7f033c150020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:19.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.438+0000 7f03423fe700 1 -- 172.21.15.49:0/2270149828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f033c0cae90 msgr2=0x7f033c0c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:19.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.438+0000 7f03423fe700 1 --2- 172.21.15.49:0/2270149828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f033c0cae90 0x7f033c0c7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:19.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.438+0000 7f03423fe700 1 -- 172.21.15.49:0/2270149828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0334009a20 con 0x7f033c0ca180 2023-11-30T17:07:19.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.438+0000 7f0342bff700 1 --2- 172.21.15.49:0/2270149828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f033c0cae90 0x7f033c0c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:19.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.438+0000 7f03423fe700 1 --2- 172.21.15.49:0/2270149828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f033c0ca180 0x7f033c0c2ce0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f033800c4c0 tx=0x7f0338007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:19.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.438+0000 7f03327fc700 1 -- 172.21.15.49:0/2270149828 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0338007020 con 0x7f033c0ca180 2023-11-30T17:07:19.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.438+0000 7f03327fc700 1 -- 172.21.15.49:0/2270149828 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0338007180 con 0x7f033c0ca180 2023-11-30T17:07:19.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.438+0000 7f0344662700 1 -- 172.21.15.49:0/2270149828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f033c0c3b10 con 0x7f033c0ca180 2023-11-30T17:07:19.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.438+0000 7f03327fc700 1 -- 172.21.15.49:0/2270149828 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0338007520 con 0x7f033c0ca180 2023-11-30T17:07:19.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.438+0000 7f0344662700 1 -- 172.21.15.49:0/2270149828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f033c0c31d0 con 0x7f033c0ca180 2023-11-30T17:07:19.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.439+0000 7f0344662700 1 -- 172.21.15.49:0/2270149828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f033c06c860 con 0x7f033c0ca180 2023-11-30T17:07:19.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.439+0000 7f03327fc700 1 -- 172.21.15.49:0/2270149828 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0338006900 con 0x7f033c0ca180 2023-11-30T17:07:19.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.440+0000 7f03327fc700 1 --2- 172.21.15.49:0/2270149828 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f032005f120 0x7f03200615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:19.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.440+0000 7f03327fc700 1 -- 172.21.15.49:0/2270149828 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0338079d50 con 0x7f033c0ca180 2023-11-30T17:07:19.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.440+0000 7f0341bfd700 1 --2- 172.21.15.49:0/2270149828 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f032005f120 0x7f03200615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:19.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.440+0000 7f0341bfd700 1 --2- 172.21.15.49:0/2270149828 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f032005f120 0x7f03200615e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f032c005750 tx=0x7f032c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:19.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.444+0000 7f03327fc700 1 -- 172.21.15.49:0/2270149828 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f033807d030 con 0x7f033c0ca180 2023-11-30T17:07:19.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.657+0000 7f0344662700 1 -- 172.21.15.49:0/2270149828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f033c0a9160 con 0x7f033c0ca180 2023-11-30T17:07:19.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.658+0000 7f03327fc700 1 -- 172.21.15.49:0/2270149828 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4486 (secure 0 0 0) 0x7f033804b020 con 0x7f033c0ca180 2023-11-30T17:07:19.660 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:19.660 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/4055676379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":4055676379},{"type":"v1","addr":"172.21.15.115:6835","nonce":4055676379}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1595689264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1595689264},{"type":"v1","addr":"172.21.15.115:6837","nonce":1595689264}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/124650277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":124650277},{"type":"v1","addr":"172.21.15.49:6834","nonce":124650277}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:07:16.282510+0000","modified":"2023-11-30T17:07:19.293997+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2333639572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2333639572},{"type":"v1","addr":"172.21.15.49:6835","nonce":2333639572}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-11-30T17:07:19.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.659+0000 7f0344662700 1 -- 172.21.15.49:0/2270149828 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f032005f120 msgr2=0x7f03200615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:19.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.659+0000 7f0344662700 1 --2- 172.21.15.49:0/2270149828 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f032005f120 0x7f03200615e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f032c005750 tx=0x7f032c009040).stop 2023-11-30T17:07:19.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.659+0000 7f0344662700 1 -- 172.21.15.49:0/2270149828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f033c0ca180 msgr2=0x7f033c0c2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:19.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.659+0000 7f0344662700 1 --2- 172.21.15.49:0/2270149828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f033c0ca180 0x7f033c0c2ce0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f033800c4c0 tx=0x7f0338007df0).stop 2023-11-30T17:07:19.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.660+0000 7f0344662700 1 -- 172.21.15.49:0/2270149828 shutdown_connections 2023-11-30T17:07:19.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.660+0000 7f0344662700 1 --2- 172.21.15.49:0/2270149828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f033c0cae90 0x7f033c0c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:19.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.660+0000 7f0344662700 1 --2- 172.21.15.49:0/2270149828 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f032005f120 0x7f03200615e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:19.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.660+0000 7f0344662700 1 --2- 172.21.15.49:0/2270149828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f033c0ca180 0x7f033c0c2ce0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:19.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.660+0000 7f0344662700 1 --2- 172.21.15.49:0/2270149828 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f033c0caab0 0x7f033c150020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:19.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.660+0000 7f0344662700 1 -- 172.21.15.49:0/2270149828 >> 172.21.15.49:0/2270149828 conn(0x7f033c094920 msgr2=0x7f033c152f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:19.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.660+0000 7f0344662700 1 -- 172.21.15.49:0/2270149828 shutdown_connections 2023-11-30T17:07:19.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.660+0000 7f0344662700 1 -- 172.21.15.49:0/2270149828 wait complete. 2023-11-30T17:07:19.664 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 8 2023-11-30T17:07:19.675 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:07:19.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.790+0000 7f15b6a33700 1 Processor -- start 2023-11-30T17:07:19.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.790+0000 7f15b6a33700 1 -- start start 2023-11-30T17:07:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.791+0000 7f15b6a33700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f15b00caab0 0x7f15b00aa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.791+0000 7f15b6a33700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15b00cae90 0x7f15b00c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.791+0000 7f15b6a33700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b00a9a90 con 0x7f15b00aa960 2023-11-30T17:07:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.791+0000 7f15b6a33700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15b0154ce0 con 0x7f15b00caab0 2023-11-30T17:07:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.791+0000 7f15b6a33700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b00a8e80 con 0x7f15b00cae90 2023-11-30T17:07:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.791+0000 7f15affff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f15b00caab0 0x7f15b00aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.791+0000 7f15affff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f15b00caab0 0x7f15b00aa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46176/0 (socket says 172.21.15.49:46176) 2023-11-30T17:07:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.791+0000 7f15b4fd0700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f15b00aa960 0x7f15b00c9170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46924/0 (socket says 172.21.15.49:46924) 2023-11-30T17:07:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.791+0000 7f15affff700 1 -- 172.21.15.49:0/2444428606 learned_addr learned my addr 172.21.15.49:0/2444428606 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.791+0000 7f15af7fe700 1 --2- 172.21.15.49:0/2444428606 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15b00cae90 0x7f15b00c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.791+0000 7f15affff700 1 -- 172.21.15.49:0/2444428606 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15b00cae90 msgr2=0x7f15b00c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.791+0000 7f15affff700 1 --2- 172.21.15.49:0/2444428606 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15b00cae90 0x7f15b00c0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.791+0000 7f15affff700 1 -- 172.21.15.49:0/2444428606 >> v1:172.21.15.49:6789/0 conn(0x7f15b00aa960 legacy=0x7f15b00c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.791+0000 7f15aeffd700 1 -- 172.21.15.49:0/2444428606 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 604783550 0 0) 0x7f15b00a9a90 con 0x7f15b00aa960 2023-11-30T17:07:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.792+0000 7f15affff700 1 -- 172.21.15.49:0/2444428606 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b00a9160 con 0x7f15b00caab0 2023-11-30T17:07:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.792+0000 7f15affff700 1 --2- 172.21.15.49:0/2444428606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15b00caab0 0x7f15b00aa470 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f15a4009810 tx=0x7f15a4009060).ready entity=mon.0 client_cookie=2e11cc6d6cc1d2b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.792+0000 7f15aeffd700 1 -- 172.21.15.49:0/2444428606 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a4005880 con 0x7f15b00caab0 2023-11-30T17:07:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.792+0000 7f15aeffd700 1 -- 172.21.15.49:0/2444428606 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a40059e0 con 0x7f15b00caab0 2023-11-30T17:07:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.792+0000 7f15aeffd700 1 -- 172.21.15.49:0/2444428606 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a4005d60 con 0x7f15b00caab0 2023-11-30T17:07:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.792+0000 7f15b6a33700 1 -- 172.21.15.49:0/2444428606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15b00caab0 msgr2=0x7f15b00aa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.792+0000 7f15b6a33700 1 --2- 172.21.15.49:0/2444428606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15b00caab0 0x7f15b00aa470 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f15a4009810 tx=0x7f15a4009060).stop 2023-11-30T17:07:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.792+0000 7f15b6a33700 1 -- 172.21.15.49:0/2444428606 shutdown_connections 2023-11-30T17:07:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.792+0000 7f15b6a33700 1 --2- 172.21.15.49:0/2444428606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15b00caab0 0x7f15b00aa470 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.792+0000 7f15b6a33700 1 --2- 172.21.15.49:0/2444428606 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15b00cae90 0x7f15b00c0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.792+0000 7f15b6a33700 1 -- 172.21.15.49:0/2444428606 >> 172.21.15.49:0/2444428606 conn(0x7f15b0094920 msgr2=0x7f15b006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:19.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.792+0000 7f15b6a33700 1 -- 172.21.15.49:0/2444428606 shutdown_connections 2023-11-30T17:07:19.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.792+0000 7f15b6a33700 1 -- 172.21.15.49:0/2444428606 wait complete. 2023-11-30T17:07:19.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.793+0000 7f15b6a33700 1 Processor -- start 2023-11-30T17:07:19.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.794+0000 7f15b6a33700 1 -- start start 2023-11-30T17:07:19.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.794+0000 7f15b6a33700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15b00caab0 0x7f15b014e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.794+0000 7f15b6a33700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15b00cae90 0x7f15b0155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.794+0000 7f15b6a33700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15b0155f20 0x7f15b00c3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.794+0000 7f15b6a33700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b00c3130 con 0x7f15b00caab0 2023-11-30T17:07:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.794+0000 7f15b6a33700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b00c24b0 con 0x7f15b0155f20 2023-11-30T17:07:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.794+0000 7f15b6a33700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b00c2790 con 0x7f15b00cae90 2023-11-30T17:07:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.794+0000 7f15affff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15b00caab0 0x7f15b014e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.794+0000 7f15affff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15b00caab0 0x7f15b014e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46184/0 (socket says 172.21.15.49:46184) 2023-11-30T17:07:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.794+0000 7f15affff700 1 -- 172.21.15.49:0/2378826453 learned_addr learned my addr 172.21.15.49:0/2378826453 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.795+0000 7f15b4fd0700 1 --2- 172.21.15.49:0/2378826453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15b0155f20 0x7f15b00c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.795+0000 7f15af7fe700 1 --2- 172.21.15.49:0/2378826453 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15b00cae90 0x7f15b0155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.795+0000 7f15affff700 1 -- 172.21.15.49:0/2378826453 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15b00cae90 msgr2=0x7f15b0155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:19.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.795+0000 7f15affff700 1 --2- 172.21.15.49:0/2378826453 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15b00cae90 0x7f15b0155a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:19.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.795+0000 7f15affff700 1 -- 172.21.15.49:0/2378826453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15b0155f20 msgr2=0x7f15b00c3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:19.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.795+0000 7f15affff700 1 --2- 172.21.15.49:0/2378826453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15b0155f20 0x7f15b00c3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:19.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.795+0000 7f15affff700 1 -- 172.21.15.49:0/2378826453 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a4009300 con 0x7f15b00caab0 2023-11-30T17:07:19.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.795+0000 7f15affff700 1 --2- 172.21.15.49:0/2378826453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15b00caab0 0x7f15b014e040 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f15a4009fd0 tx=0x7f15a4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:19.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.795+0000 7f1597fff700 1 -- 172.21.15.49:0/2378826453 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a4006770 con 0x7f15b00caab0 2023-11-30T17:07:19.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.795+0000 7f1597fff700 1 -- 172.21.15.49:0/2378826453 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a400b850 con 0x7f15b00caab0 2023-11-30T17:07:19.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.795+0000 7f15b6a33700 1 -- 172.21.15.49:0/2378826453 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b00c2a70 con 0x7f15b00caab0 2023-11-30T17:07:19.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.795+0000 7f1597fff700 1 -- 172.21.15.49:0/2378826453 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a400bc10 con 0x7f15b00caab0 2023-11-30T17:07:19.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.795+0000 7f15b6a33700 1 -- 172.21.15.49:0/2378826453 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b014e530 con 0x7f15b00caab0 2023-11-30T17:07:19.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.796+0000 7f1597fff700 1 -- 172.21.15.49:0/2378826453 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f15a4018070 con 0x7f15b00caab0 2023-11-30T17:07:19.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.796+0000 7f15b6a33700 1 -- 172.21.15.49:0/2378826453 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15b006c860 con 0x7f15b00caab0 2023-11-30T17:07:19.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.797+0000 7f1597fff700 1 --2- 172.21.15.49:0/2378826453 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f159c05f150 0x7f159c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.797+0000 7f1597fff700 1 -- 172.21.15.49:0/2378826453 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f15a407b160 con 0x7f15b00caab0 2023-11-30T17:07:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.797+0000 7f15af7fe700 1 --2- 172.21.15.49:0/2378826453 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f159c05f150 0x7f159c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.797+0000 7f15af7fe700 1 --2- 172.21.15.49:0/2378826453 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f159c05f150 0x7f159c061610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f15b00c5540 tx=0x7f15a0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.801+0000 7f1597fff700 1 -- 172.21.15.49:0/2378826453 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f15a404c430 con 0x7f15b00caab0 2023-11-30T17:07:19.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.974+0000 7f15b6a33700 1 -- 172.21.15.49:0/2378826453 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15b00a9440 con 0x7f15b00caab0 2023-11-30T17:07:19.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.975+0000 7f1597fff700 1 -- 172.21.15.49:0/2378826453 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f15a404fa50 con 0x7f15b00caab0 2023-11-30T17:07:19.978 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:19.978 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":22,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:07:17.283998+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:07:14.837882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-30T17:07:15.248549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:07:19.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.977+0000 7f15b6a33700 1 -- 172.21.15.49:0/2378826453 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f159c05f150 msgr2=0x7f159c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:19.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.977+0000 7f15b6a33700 1 --2- 172.21.15.49:0/2378826453 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f159c05f150 0x7f159c061610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f15b00c5540 tx=0x7f15a0008040).stop 2023-11-30T17:07:19.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.977+0000 7f15b6a33700 1 -- 172.21.15.49:0/2378826453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15b00caab0 msgr2=0x7f15b014e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:19.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.977+0000 7f15b6a33700 1 --2- 172.21.15.49:0/2378826453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15b00caab0 0x7f15b014e040 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f15a4009fd0 tx=0x7f15a4016000).stop 2023-11-30T17:07:19.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.977+0000 7f15b6a33700 1 -- 172.21.15.49:0/2378826453 shutdown_connections 2023-11-30T17:07:19.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.977+0000 7f15b6a33700 1 --2- 172.21.15.49:0/2378826453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15b0155f20 0x7f15b00c3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:19.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.977+0000 7f15b6a33700 1 --2- 172.21.15.49:0/2378826453 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f159c05f150 0x7f159c061610 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:19.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.977+0000 7f15b6a33700 1 --2- 172.21.15.49:0/2378826453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15b00caab0 0x7f15b014e040 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:19.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.977+0000 7f15b6a33700 1 --2- 172.21.15.49:0/2378826453 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15b00cae90 0x7f15b0155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:19.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.977+0000 7f15b6a33700 1 -- 172.21.15.49:0/2378826453 >> 172.21.15.49:0/2378826453 conn(0x7f15b0094920 msgr2=0x7f15b00af680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:19.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.977+0000 7f15b6a33700 1 -- 172.21.15.49:0/2378826453 shutdown_connections 2023-11-30T17:07:19.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:19.977+0000 7f15b6a33700 1 -- 172.21.15.49:0/2378826453 wait complete. 2023-11-30T17:07:19.992 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-30T17:07:19.993 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:07:20.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.107+0000 7f434ab7f700 1 Processor -- start 2023-11-30T17:07:20.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.107+0000 7f434ab7f700 1 -- start start 2023-11-30T17:07:20.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.108+0000 7f434ab7f700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4344157660 0x7f4344157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:20.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.108+0000 7f434ab7f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f43440c1750 0x7f43440c1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:20.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.108+0000 7f434ab7f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43440c12c0 con 0x7f43440c0180 2023-11-30T17:07:20.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.108+0000 7f434ab7f700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43440c06b0 con 0x7f43440c1750 2023-11-30T17:07:20.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.108+0000 7f434ab7f700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43440c0990 con 0x7f4344157660 2023-11-30T17:07:20.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.108+0000 7f434a37e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f43440c1750 0x7f43440c1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:20.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.108+0000 7f434a37e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f43440c1750 0x7f43440c1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46198/0 (socket says 172.21.15.49:46198) 2023-11-30T17:07:20.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.108+0000 7f434a37e700 1 -- 172.21.15.49:0/2822362777 learned_addr learned my addr 172.21.15.49:0/2822362777 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:20.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.108+0000 7f434937c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f43440c0180 0x7f43441589c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46932/0 (socket says 172.21.15.49:46932) 2023-11-30T17:07:20.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.109+0000 7f4349b7d700 1 --2- 172.21.15.49:0/2822362777 >> v2:172.21.15.115:3300/0 conn(0x7f4344157660 0x7f4344157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:20.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.109+0000 7f434a37e700 1 -- 172.21.15.49:0/2822362777 >> v2:172.21.15.115:3300/0 conn(0x7f4344157660 msgr2=0x7f4344157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:20.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.109+0000 7f434a37e700 1 --2- 172.21.15.49:0/2822362777 >> v2:172.21.15.115:3300/0 conn(0x7f4344157660 0x7f4344157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:20.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.109+0000 7f434a37e700 1 -- 172.21.15.49:0/2822362777 >> v1:172.21.15.49:6789/0 conn(0x7f43440c0180 legacy=0x7f43441589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:20.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.109+0000 7f4348b7b700 1 -- 172.21.15.49:0/2822362777 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583111142 0 0) 0x7f43440c12c0 con 0x7f43440c0180 2023-11-30T17:07:20.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.109+0000 7f434a37e700 1 -- 172.21.15.49:0/2822362777 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43440c0c70 con 0x7f43440c1750 2023-11-30T17:07:20.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.109+0000 7f434a37e700 1 --2- 172.21.15.49:0/2822362777 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43440c1750 0x7f43440c1b70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f43440839a0 tx=0x7f433c009840).ready entity=mon.0 client_cookie=feacf5599f8fd163 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:20.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.109+0000 7f4348b7b700 1 -- 172.21.15.49:0/2822362777 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c00e070 con 0x7f43440c1750 2023-11-30T17:07:20.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.109+0000 7f4348b7b700 1 -- 172.21.15.49:0/2822362777 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433c00ba50 con 0x7f43440c1750 2023-11-30T17:07:20.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.109+0000 7f4348b7b700 1 -- 172.21.15.49:0/2822362777 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c00bdd0 con 0x7f43440c1750 2023-11-30T17:07:20.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.109+0000 7f434ab7f700 1 -- 172.21.15.49:0/2822362777 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43440c1750 msgr2=0x7f43440c1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:20.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.109+0000 7f434ab7f700 1 --2- 172.21.15.49:0/2822362777 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43440c1750 0x7f43440c1b70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f43440839a0 tx=0x7f433c009840).stop 2023-11-30T17:07:20.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.110+0000 7f434ab7f700 1 -- 172.21.15.49:0/2822362777 shutdown_connections 2023-11-30T17:07:20.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.110+0000 7f434ab7f700 1 --2- 172.21.15.49:0/2822362777 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43440c1750 0x7f43440c1b70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:20.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.110+0000 7f434ab7f700 1 --2- 172.21.15.49:0/2822362777 >> v2:172.21.15.115:3300/0 conn(0x7f4344157660 0x7f4344157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:20.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.110+0000 7f434ab7f700 1 -- 172.21.15.49:0/2822362777 >> 172.21.15.49:0/2822362777 conn(0x7f43440cb000 msgr2=0x7f43440cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:20.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.110+0000 7f434ab7f700 1 -- 172.21.15.49:0/2822362777 shutdown_connections 2023-11-30T17:07:20.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.110+0000 7f434ab7f700 1 -- 172.21.15.49:0/2822362777 wait complete. 2023-11-30T17:07:20.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.111+0000 7f434ab7f700 1 Processor -- start 2023-11-30T17:07:20.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.111+0000 7f434ab7f700 1 -- start start 2023-11-30T17:07:20.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.111+0000 7f434ab7f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43440c0180 0x7f43440ad240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:20.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.111+0000 7f434ab7f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43440c1750 0x7f4344147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:20.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.112+0000 7f434ab7f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4344157660 0x7f4344153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:20.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.112+0000 7f434ab7f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4344156490 con 0x7f4344157660 2023-11-30T17:07:20.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.112+0000 7f434ab7f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4344156920 con 0x7f43440c1750 2023-11-30T17:07:20.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.112+0000 7f434ab7f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4344147610 con 0x7f43440c0180 2023-11-30T17:07:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.112+0000 7f434a37e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4344157660 0x7f4344153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.112+0000 7f434a37e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4344157660 0x7f4344153a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46200/0 (socket says 172.21.15.49:46200) 2023-11-30T17:07:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.112+0000 7f434a37e700 1 -- 172.21.15.49:0/3179617528 learned_addr learned my addr 172.21.15.49:0/3179617528 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.112+0000 7f4349b7d700 1 --2- 172.21.15.49:0/3179617528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43440c0180 0x7f43440ad240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.112+0000 7f434937c700 1 --2- 172.21.15.49:0/3179617528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43440c1750 0x7f4344147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.112+0000 7f434a37e700 1 -- 172.21.15.49:0/3179617528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43440c0180 msgr2=0x7f43440ad240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.112+0000 7f434a37e700 1 --2- 172.21.15.49:0/3179617528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43440c0180 0x7f43440ad240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.112+0000 7f434a37e700 1 -- 172.21.15.49:0/3179617528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43440c1750 msgr2=0x7f4344147120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.112+0000 7f434a37e700 1 --2- 172.21.15.49:0/3179617528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43440c1750 0x7f4344147120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.112+0000 7f434a37e700 1 -- 172.21.15.49:0/3179617528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433c009ae0 con 0x7f4344157660 2023-11-30T17:07:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.112+0000 7f4349b7d700 1 --2- 172.21.15.49:0/3179617528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43440c0180 0x7f43440ad240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.112+0000 7f434937c700 1 --2- 172.21.15.49:0/3179617528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43440c1750 0x7f4344147120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.112+0000 7f434a37e700 1 --2- 172.21.15.49:0/3179617528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4344157660 0x7f4344153a50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f433c009fd0 tx=0x7f43440c1230).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.112+0000 7f4339ffb700 1 -- 172.21.15.49:0/3179617528 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c0092e0 con 0x7f4344157660 2023-11-30T17:07:20.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.112+0000 7f4339ffb700 1 -- 172.21.15.49:0/3179617528 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433c01d410 con 0x7f4344157660 2023-11-30T17:07:20.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.112+0000 7f434ab7f700 1 -- 172.21.15.49:0/3179617528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43440ad800 con 0x7f4344157660 2023-11-30T17:07:20.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.112+0000 7f4339ffb700 1 -- 172.21.15.49:0/3179617528 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c01d790 con 0x7f4344157660 2023-11-30T17:07:20.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.112+0000 7f434ab7f700 1 -- 172.21.15.49:0/3179617528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4344156120 con 0x7f4344157660 2023-11-30T17:07:20.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.113+0000 7f434ab7f700 1 -- 172.21.15.49:0/3179617528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4344156640 con 0x7f4344157660 2023-11-30T17:07:20.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.114+0000 7f4339ffb700 1 -- 172.21.15.49:0/3179617528 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f433c01db80 con 0x7f4344157660 2023-11-30T17:07:20.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.114+0000 7f4339ffb700 1 --2- 172.21.15.49:0/3179617528 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f432805f120 0x7f43280615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:20.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.114+0000 7f4339ffb700 1 -- 172.21.15.49:0/3179617528 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f433c07bd10 con 0x7f4344157660 2023-11-30T17:07:20.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.114+0000 7f4349b7d700 1 --2- 172.21.15.49:0/3179617528 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f432805f120 0x7f43280615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:20.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.115+0000 7f4349b7d700 1 --2- 172.21.15.49:0/3179617528 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f432805f120 0x7f43280615e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f4340009810 tx=0x7f4340008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:20.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.118+0000 7f4339ffb700 1 -- 172.21.15.49:0/3179617528 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4344156640 con 0x7f4344157660 2023-11-30T17:07:20.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.284+0000 7f434ab7f700 1 -- 172.21.15.49:0/3179617528 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4344156640 con 0x7f432805f120 2023-11-30T17:07:20.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.294+0000 7f4339ffb700 1 -- 172.21.15.49:0/3179617528 <== mgr.4105 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+325096 (secure 0 0 0) 0x7f4344156640 con 0x7f432805f120 2023-11-30T17:07:20.300 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.297+0000 7f434ab7f700 1 -- 172.21.15.49:0/3179617528 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f432805f120 msgr2=0x7f43280615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.297+0000 7f434ab7f700 1 --2- 172.21.15.49:0/3179617528 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f432805f120 0x7f43280615e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f4340009810 tx=0x7f4340008040).stop 2023-11-30T17:07:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.297+0000 7f434ab7f700 1 -- 172.21.15.49:0/3179617528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4344157660 msgr2=0x7f4344153a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.297+0000 7f434ab7f700 1 --2- 172.21.15.49:0/3179617528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4344157660 0x7f4344153a50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f433c009fd0 tx=0x7f43440c1230).stop 2023-11-30T17:07:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.297+0000 7f434ab7f700 1 -- 172.21.15.49:0/3179617528 shutdown_connections 2023-11-30T17:07:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.297+0000 7f434ab7f700 1 --2- 172.21.15.49:0/3179617528 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f432805f120 0x7f43280615e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.297+0000 7f434ab7f700 1 --2- 172.21.15.49:0/3179617528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4344157660 0x7f4344153a50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.297+0000 7f434ab7f700 1 --2- 172.21.15.49:0/3179617528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43440c0180 0x7f43440ad240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.297+0000 7f434ab7f700 1 --2- 172.21.15.49:0/3179617528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43440c1750 0x7f4344147120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.297+0000 7f434ab7f700 1 -- 172.21.15.49:0/3179617528 >> 172.21.15.49:0/3179617528 conn(0x7f43440cb000 msgr2=0x7f43440aa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.297+0000 7f434ab7f700 1 -- 172.21.15.49:0/3179617528 shutdown_connections 2023-11-30T17:07:20.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.297+0000 7f434ab7f700 1 -- 172.21.15.49:0/3179617528 wait complete. 2023-11-30T17:07:20.305 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:07:20.312 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-11-30T17:07:18.838043+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2378128,"kb_used_data":1360,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596592,"statfs":{"total":773094113280,"available":770658910208,"internally_reserved":0,"allocated":1392640,"data_stored":445268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-11-30T17:07:12.300983+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:07:12.300983+0000","last_peered":"2023-11-30T17:07:12.300983+0000","last_clean":"2023-11-30T17:07:12.300983+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:07:12.300983+0000","last_undegraded":"2023-11-30T17:07:12.300983+0000","last_fullsized":"2023-11-30T17:07:12.300983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-11-30T17:07:11.875121+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:07:11.875121+0000","last_peered":"2023-11-30T17:07:11.875121+0000","last_clean":"2023-11-30T17:07:11.875121+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:07:11.875121+0000","last_undegraded":"2023-11-30T17:07:11.875121+0000","last_fullsized":"2023-11-30T17:07:11.875121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-11-30T17:07:11.873903+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:07:11.873903+0000","last_peered":"2023-11-30T17:07:11.873903+0000","last_clean":"2023-11-30T17:07:11.873903+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:07:11.873903+0000","last_undegraded":"2023-11-30T17:07:11.873903+0000","last_fullsized":"2023-11-30T17:07:11.873903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-11-30T17:07:11.876907+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:07:11.876907+0000","last_peered":"2023-11-30T17:07:11.876907+0000","last_clean":"2023-11-30T17:07:11.876907+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:07:11.876907+0000","last_undegraded":"2023-11-30T17:07:11.876907+0000","last_fullsized":"2023-11-30T17:07:11.876907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-11-30T17:07:11.871123+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:07:11.871123+0000","last_peered":"2023-11-30T17:07:11.871123+0000","last_clean":"2023-11-30T17:07:11.871123+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:07:11.871123+0000","last_undegraded":"2023-11-30T17:07:11.871123+0000","last_fullsized":"2023-11-30T17:07:11.871123+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-11-30T17:07:11.879123+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:07:11.879123+0000","last_peered":"2023-11-30T17:07:11.879123+0000","last_clean":"2023-11-30T17:07:11.879123+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:07:11.879123+0000","last_undegraded":"2023-11-30T17:07:11.879123+0000","last_fullsized":"2023-11-30T17:07:11.879123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-11-30T17:07:12.304084+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:07:12.304084+0000","last_peered":"2023-11-30T17:07:12.304084+0000","last_clean":"2023-11-30T17:07:12.304084+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:07:12.304084+0000","last_undegraded":"2023-11-30T17:07:12.304084+0000","last_fullsized":"2023-11-30T17:07:12.304084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-11-30T17:07:11.877803+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:07:11.877803+0000","last_peered":"2023-11-30T17:07:11.877803+0000","last_clean":"2023-11-30T17:07:11.877803+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:07:11.877803+0000","last_undegraded":"2023-11-30T17:07:11.877803+0000","last_fullsized":"2023-11-30T17:07:11.877803+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-11-30T17:07:11.881832+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:07:11.881832+0000","last_peered":"2023-11-30T17:07:11.881832+0000","last_clean":"2023-11-30T17:07:11.881832+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:07:11.881832+0000","last_undegraded":"2023-11-30T17:07:11.881832+0000","last_fullsized":"2023-11-30T17:07:11.881832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297272,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074568,"statfs":{"total":96636764160,"available":96332357632,"internally_reserved":0,"allocated":180224,"data_stored":58558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574850,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297272,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074568,"statfs":{"total":96636764160,"available":96332357632,"internally_reserved":0,"allocated":180224,"data_stored":58558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574850,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297272,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074568,"statfs":{"total":96636764160,"available":96332357632,"internally_reserved":0,"allocated":180224,"data_stored":58558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574850,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":52759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574850,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":52759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574850,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":52759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297272,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074568,"statfs":{"total":96636764160,"available":96332357632,"internally_reserved":0,"allocated":180224,"data_stored":58558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574850,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":52759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:07:20.318 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:07:20.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.468+0000 7f347186b700 1 Processor -- start 2023-11-30T17:07:20.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.468+0000 7f347186b700 1 -- start start 2023-11-30T17:07:20.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.468+0000 7f347186b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f346c154230 0x7f346c0a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:20.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.468+0000 7f347186b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f346c0c2cb0 0x7f346c0a6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:20.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.468+0000 7f347186b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f346c062700 0x7f346c062b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:20.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.468+0000 7f347186b700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f346c063080 con 0x7f346c154230 2023-11-30T17:07:20.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.468+0000 7f347186b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f346c0c2540 con 0x7f346c062700 2023-11-30T17:07:20.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.468+0000 7f347186b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346c0a4f70 con 0x7f346c0c2cb0 2023-11-30T17:07:20.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.469+0000 7f3470869700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f346c154230 0x7f346c0a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:20.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.469+0000 7f3470869700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f346c154230 0x7f346c0a48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46212/0 (socket says 172.21.15.49:46212) 2023-11-30T17:07:20.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.469+0000 7f3470869700 1 -- 172.21.15.49:0/3814032686 learned_addr learned my addr 172.21.15.49:0/3814032686 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:20.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.469+0000 7f346bfff700 1 --2- 172.21.15.49:0/3814032686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f346c0c2cb0 0x7f346c0a6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:20.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.469+0000 7f347106a700 1 --2- 172.21.15.49:0/3814032686 >> v2:172.21.15.115:3300/0 conn(0x7f346c062700 0x7f346c062b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:20.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.469+0000 7f3470869700 1 -- 172.21.15.49:0/3814032686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f346c0c2cb0 msgr2=0x7f346c0a6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:20.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.469+0000 7f3470869700 1 --2- 172.21.15.49:0/3814032686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f346c0c2cb0 0x7f346c0a6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:20.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.469+0000 7f3470869700 1 -- 172.21.15.49:0/3814032686 >> v2:172.21.15.115:3300/0 conn(0x7f346c062700 msgr2=0x7f346c062b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:20.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.469+0000 7f3470869700 1 --2- 172.21.15.49:0/3814032686 >> v2:172.21.15.115:3300/0 conn(0x7f346c062700 0x7f346c062b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:20.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.469+0000 7f3470869700 1 -- 172.21.15.49:0/3814032686 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346c0a5250 con 0x7f346c154230 2023-11-30T17:07:20.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.469+0000 7f347106a700 1 --2- 172.21.15.49:0/3814032686 >> v2:172.21.15.115:3300/0 conn(0x7f346c062700 0x7f346c062b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:20.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.469+0000 7f3470869700 1 --2- 172.21.15.49:0/3814032686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f346c154230 0x7f346c0a48e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f346c0ade50 tx=0x7f34640090f0).ready entity=mon.0 client_cookie=482cbf5dc2dd7a28 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:20.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.469+0000 7f346b7fe700 1 -- 172.21.15.49:0/3814032686 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346400b520 con 0x7f346c154230 2023-11-30T17:07:20.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.469+0000 7f346b7fe700 1 -- 172.21.15.49:0/3814032686 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346400b680 con 0x7f346c154230 2023-11-30T17:07:20.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.469+0000 7f346b7fe700 1 -- 172.21.15.49:0/3814032686 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346400ba00 con 0x7f346c154230 2023-11-30T17:07:20.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.470+0000 7f347186b700 1 -- 172.21.15.49:0/3814032686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f346c154230 msgr2=0x7f346c0a48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:20.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.470+0000 7f347186b700 1 --2- 172.21.15.49:0/3814032686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f346c154230 0x7f346c0a48e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f346c0ade50 tx=0x7f34640090f0).stop 2023-11-30T17:07:20.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.470+0000 7f347186b700 1 -- 172.21.15.49:0/3814032686 shutdown_connections 2023-11-30T17:07:20.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.470+0000 7f347186b700 1 --2- 172.21.15.49:0/3814032686 >> v2:172.21.15.115:3300/0 conn(0x7f346c062700 0x7f346c062b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:20.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.470+0000 7f347186b700 1 --2- 172.21.15.49:0/3814032686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f346c154230 0x7f346c0a48e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:20.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.470+0000 7f347186b700 1 --2- 172.21.15.49:0/3814032686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f346c0c2cb0 0x7f346c0a6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:20.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.470+0000 7f347186b700 1 -- 172.21.15.49:0/3814032686 >> 172.21.15.49:0/3814032686 conn(0x7f346c0c7ca0 msgr2=0x7f346c0c80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:20.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.470+0000 7f347186b700 1 -- 172.21.15.49:0/3814032686 shutdown_connections 2023-11-30T17:07:20.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.470+0000 7f347186b700 1 -- 172.21.15.49:0/3814032686 wait complete. 2023-11-30T17:07:20.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.471+0000 7f347186b700 1 Processor -- start 2023-11-30T17:07:20.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.471+0000 7f347186b700 1 -- start start 2023-11-30T17:07:20.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.472+0000 7f347186b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f346c062700 0x7f346c146a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:20.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.472+0000 7f347186b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f346c0c2cb0 0x7f346c0bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:20.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.472+0000 7f347186b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f346c154230 0x7f346c0668e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:20.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.472+0000 7f347186b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c0ad690 con 0x7f346c154230 2023-11-30T17:07:20.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.472+0000 7f347186b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c0a7b80 con 0x7f346c062700 2023-11-30T17:07:20.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.472+0000 7f347186b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346c146f10 con 0x7f346c0c2cb0 2023-11-30T17:07:20.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.472+0000 7f347106a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f346c154230 0x7f346c0668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:20.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.472+0000 7f347106a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f346c154230 0x7f346c0668e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46214/0 (socket says 172.21.15.49:46214) 2023-11-30T17:07:20.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.472+0000 7f347106a700 1 -- 172.21.15.49:0/645537947 learned_addr learned my addr 172.21.15.49:0/645537947 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:20.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.472+0000 7f3470869700 1 --2- 172.21.15.49:0/645537947 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f346c062700 0x7f346c146a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:20.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.472+0000 7f346bfff700 1 --2- 172.21.15.49:0/645537947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f346c0c2cb0 0x7f346c0bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:20.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.472+0000 7f347106a700 1 -- 172.21.15.49:0/645537947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f346c0c2cb0 msgr2=0x7f346c0bfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:20.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.472+0000 7f347106a700 1 --2- 172.21.15.49:0/645537947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f346c0c2cb0 0x7f346c0bfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:20.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.472+0000 7f347106a700 1 -- 172.21.15.49:0/645537947 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f346c062700 msgr2=0x7f346c146a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:20.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.472+0000 7f347106a700 1 --2- 172.21.15.49:0/645537947 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f346c062700 0x7f346c146a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:20.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.472+0000 7f347106a700 1 -- 172.21.15.49:0/645537947 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3464009370 con 0x7f346c154230 2023-11-30T17:07:20.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.472+0000 7f347106a700 1 --2- 172.21.15.49:0/645537947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f346c154230 0x7f346c0668e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f345400d890 tx=0x7f3454008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:20.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.472+0000 7f3468ff9700 1 -- 172.21.15.49:0/645537947 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3454011590 con 0x7f346c154230 2023-11-30T17:07:20.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.472+0000 7f3468ff9700 1 -- 172.21.15.49:0/645537947 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34540116f0 con 0x7f346c154230 2023-11-30T17:07:20.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.472+0000 7f347186b700 1 -- 172.21.15.49:0/645537947 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346c0ac830 con 0x7f346c154230 2023-11-30T17:07:20.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.472+0000 7f3468ff9700 1 -- 172.21.15.49:0/645537947 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3454011a90 con 0x7f346c154230 2023-11-30T17:07:20.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.473+0000 7f347186b700 1 -- 172.21.15.49:0/645537947 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346c0a7530 con 0x7f346c154230 2023-11-30T17:07:20.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.474+0000 7f347186b700 1 -- 172.21.15.49:0/645537947 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f346c0aa5f0 con 0x7f346c154230 2023-11-30T17:07:20.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.474+0000 7f3468ff9700 1 -- 172.21.15.49:0/645537947 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3454012420 con 0x7f346c154230 2023-11-30T17:07:20.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.474+0000 7f3468ff9700 1 --2- 172.21.15.49:0/645537947 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f344c05f150 0x7f344c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:20.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.474+0000 7f3468ff9700 1 -- 172.21.15.49:0/645537947 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3454079b10 con 0x7f346c154230 2023-11-30T17:07:20.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.474+0000 7f3470869700 1 --2- 172.21.15.49:0/645537947 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f344c05f150 0x7f344c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:20.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.475+0000 7f3470869700 1 --2- 172.21.15.49:0/645537947 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f344c05f150 0x7f344c061610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f3464009130 tx=0x7f3464017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:20.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.478+0000 7f3468ff9700 1 -- 172.21.15.49:0/645537947 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f345404ad80 con 0x7f346c154230 2023-11-30T17:07:20.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.646+0000 7f347186b700 1 -- 172.21.15.49:0/645537947 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f346c06c7c0 con 0x7f344c05f150 2023-11-30T17:07:20.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.655+0000 7f3468ff9700 1 -- 172.21.15.49:0/645537947 <== mgr.4105 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+325096 (secure 0 0 0) 0x7f346c06c7c0 con 0x7f344c05f150 2023-11-30T17:07:20.663 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:20.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.658+0000 7f347186b700 1 -- 172.21.15.49:0/645537947 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f344c05f150 msgr2=0x7f344c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:20.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.658+0000 7f347186b700 1 --2- 172.21.15.49:0/645537947 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f344c05f150 0x7f344c061610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f3464009130 tx=0x7f3464017000).stop 2023-11-30T17:07:20.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.658+0000 7f347186b700 1 -- 172.21.15.49:0/645537947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f346c154230 msgr2=0x7f346c0668e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:20.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.658+0000 7f347186b700 1 --2- 172.21.15.49:0/645537947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f346c154230 0x7f346c0668e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f345400d890 tx=0x7f3454008040).stop 2023-11-30T17:07:20.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.659+0000 7f347186b700 1 -- 172.21.15.49:0/645537947 shutdown_connections 2023-11-30T17:07:20.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.659+0000 7f347186b700 1 --2- 172.21.15.49:0/645537947 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f344c05f150 0x7f344c061610 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:20.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.659+0000 7f347186b700 1 --2- 172.21.15.49:0/645537947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f346c154230 0x7f346c0668e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:20.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.659+0000 7f347186b700 1 --2- 172.21.15.49:0/645537947 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f346c062700 0x7f346c146a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:20.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.659+0000 7f347186b700 1 --2- 172.21.15.49:0/645537947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f346c0c2cb0 0x7f346c0bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:20.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.659+0000 7f347186b700 1 -- 172.21.15.49:0/645537947 >> 172.21.15.49:0/645537947 conn(0x7f346c0c7ca0 msgr2=0x7f346c0c5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:20.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.659+0000 7f347186b700 1 -- 172.21.15.49:0/645537947 shutdown_connections 2023-11-30T17:07:20.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.659+0000 7f347186b700 1 -- 172.21.15.49:0/645537947 wait complete. 2023-11-30T17:07:20.667 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:07:20.673 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-11-30T17:07:18.838043+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2378128,"kb_used_data":1360,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596592,"statfs":{"total":773094113280,"available":770658910208,"internally_reserved":0,"allocated":1392640,"data_stored":445268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-11-30T17:07:12.300983+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:07:12.300983+0000","last_peered":"2023-11-30T17:07:12.300983+0000","last_clean":"2023-11-30T17:07:12.300983+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:07:12.300983+0000","last_undegraded":"2023-11-30T17:07:12.300983+0000","last_fullsized":"2023-11-30T17:07:12.300983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-11-30T17:07:11.875121+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:07:11.875121+0000","last_peered":"2023-11-30T17:07:11.875121+0000","last_clean":"2023-11-30T17:07:11.875121+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:07:11.875121+0000","last_undegraded":"2023-11-30T17:07:11.875121+0000","last_fullsized":"2023-11-30T17:07:11.875121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-11-30T17:07:11.873903+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:07:11.873903+0000","last_peered":"2023-11-30T17:07:11.873903+0000","last_clean":"2023-11-30T17:07:11.873903+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:07:11.873903+0000","last_undegraded":"2023-11-30T17:07:11.873903+0000","last_fullsized":"2023-11-30T17:07:11.873903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-11-30T17:07:11.876907+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:07:11.876907+0000","last_peered":"2023-11-30T17:07:11.876907+0000","last_clean":"2023-11-30T17:07:11.876907+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:07:11.876907+0000","last_undegraded":"2023-11-30T17:07:11.876907+0000","last_fullsized":"2023-11-30T17:07:11.876907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-11-30T17:07:11.871123+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:07:11.871123+0000","last_peered":"2023-11-30T17:07:11.871123+0000","last_clean":"2023-11-30T17:07:11.871123+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:07:11.871123+0000","last_undegraded":"2023-11-30T17:07:11.871123+0000","last_fullsized":"2023-11-30T17:07:11.871123+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-11-30T17:07:11.879123+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:07:11.879123+0000","last_peered":"2023-11-30T17:07:11.879123+0000","last_clean":"2023-11-30T17:07:11.879123+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:07:11.879123+0000","last_undegraded":"2023-11-30T17:07:11.879123+0000","last_fullsized":"2023-11-30T17:07:11.879123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-11-30T17:07:12.304084+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:07:12.304084+0000","last_peered":"2023-11-30T17:07:12.304084+0000","last_clean":"2023-11-30T17:07:12.304084+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:07:12.304084+0000","last_undegraded":"2023-11-30T17:07:12.304084+0000","last_fullsized":"2023-11-30T17:07:12.304084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-11-30T17:07:11.877803+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:07:11.877803+0000","last_peered":"2023-11-30T17:07:11.877803+0000","last_clean":"2023-11-30T17:07:11.877803+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:07:11.877803+0000","last_undegraded":"2023-11-30T17:07:11.877803+0000","last_fullsized":"2023-11-30T17:07:11.877803+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-11-30T17:07:11.881832+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:07:11.881832+0000","last_peered":"2023-11-30T17:07:11.881832+0000","last_clean":"2023-11-30T17:07:11.881832+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:07:11.881832+0000","last_undegraded":"2023-11-30T17:07:11.881832+0000","last_fullsized":"2023-11-30T17:07:11.881832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:15.884305+0000","last_change":"2023-11-30T17:07:15.884305+0000","last_active":"2023-11-30T17:07:15.884305+0000","last_peered":"2023-11-30T17:07:15.884305+0000","last_clean":"2023-11-30T17:07:15.884305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:15.884305+0000","last_undegraded":"2023-11-30T17:07:15.884305+0000","last_fullsized":"2023-11-30T17:07:15.884305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:07:14.878326+0000","last_change":"2023-11-30T17:07:14.878326+0000","last_active":"2023-11-30T17:07:14.878326+0000","last_peered":"2023-11-30T17:07:14.878326+0000","last_clean":"2023-11-30T17:07:14.878326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:07:14.878326+0000","last_undegraded":"2023-11-30T17:07:14.878326+0000","last_fullsized":"2023-11-30T17:07:14.878326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297272,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074568,"statfs":{"total":96636764160,"available":96332357632,"internally_reserved":0,"allocated":180224,"data_stored":58558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574850,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297272,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074568,"statfs":{"total":96636764160,"available":96332357632,"internally_reserved":0,"allocated":180224,"data_stored":58558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574850,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297272,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074568,"statfs":{"total":96636764160,"available":96332357632,"internally_reserved":0,"allocated":180224,"data_stored":58558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574850,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":52759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574850,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":52759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574850,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":52759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297272,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074568,"statfs":{"total":96636764160,"available":96332357632,"internally_reserved":0,"allocated":180224,"data_stored":58558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574850,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":52759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:07:20.680 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:07:20.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.829+0000 7f253da41700 1 Processor -- start 2023-11-30T17:07:20.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.829+0000 7f253da41700 1 -- start start 2023-11-30T17:07:20.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.830+0000 7f253da41700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25381520c0 0x7f2538066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:20.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.830+0000 7f253da41700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2538068150 0x7f2538066a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:20.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.830+0000 7f253da41700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25380be110 con 0x7f25381524a0 2023-11-30T17:07:20.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.830+0000 7f253da41700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2538066fc0 con 0x7f2538068150 2023-11-30T17:07:20.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.830+0000 7f253da41700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25380672a0 con 0x7f25381520c0 2023-11-30T17:07:20.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.830+0000 7f25377fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2538068150 0x7f2538066a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:20.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.830+0000 7f25367fc700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f25381524a0 0x7f2538067a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34838/0 (socket says 172.21.15.49:34838) 2023-11-30T17:07:20.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.830+0000 7f25377fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2538068150 0x7f2538066a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59124/0 (socket says 172.21.15.49:59124) 2023-11-30T17:07:20.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.830+0000 7f25367fc700 1 -- 172.21.15.49:0/1252821331 learned_addr learned my addr 172.21.15.49:0/1252821331 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:20.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.831+0000 7f2536ffd700 1 --2- 172.21.15.49:0/1252821331 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25381520c0 0x7f2538066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:20.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.831+0000 7f25377fe700 1 -- 172.21.15.49:0/1252821331 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25381520c0 msgr2=0x7f2538066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:20.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.831+0000 7f25377fe700 1 --2- 172.21.15.49:0/1252821331 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25381520c0 0x7f2538066520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:20.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.831+0000 7f25377fe700 1 -- 172.21.15.49:0/1252821331 >> v1:172.21.15.49:6789/0 conn(0x7f25381524a0 legacy=0x7f2538067a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:20.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.831+0000 7f25377fe700 1 -- 172.21.15.49:0/1252821331 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25380be380 con 0x7f2538068150 2023-11-30T17:07:20.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.831+0000 7f2535ffb700 1 -- 172.21.15.49:0/1252821331 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3602143300 0 0) 0x7f25380be110 con 0x7f25381524a0 2023-11-30T17:07:20.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.831+0000 7f25377fe700 1 --2- 172.21.15.49:0/1252821331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2538068150 0x7f2538066a10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f2528009e60 tx=0x7f2528009780).ready entity=mon.0 client_cookie=8145cffb979e2158 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:20.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.831+0000 7f2535ffb700 1 -- 172.21.15.49:0/1252821331 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252800e070 con 0x7f2538068150 2023-11-30T17:07:20.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.831+0000 7f2535ffb700 1 -- 172.21.15.49:0/1252821331 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252800bb60 con 0x7f2538068150 2023-11-30T17:07:20.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.831+0000 7f2535ffb700 1 -- 172.21.15.49:0/1252821331 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2528012410 con 0x7f2538068150 2023-11-30T17:07:20.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.831+0000 7f253da41700 1 -- 172.21.15.49:0/1252821331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2538068150 msgr2=0x7f2538066a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:20.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.832+0000 7f253da41700 1 --2- 172.21.15.49:0/1252821331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2538068150 0x7f2538066a10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f2528009e60 tx=0x7f2528009780).stop 2023-11-30T17:07:20.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.832+0000 7f253da41700 1 -- 172.21.15.49:0/1252821331 shutdown_connections 2023-11-30T17:07:20.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.832+0000 7f253da41700 1 --2- 172.21.15.49:0/1252821331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2538068150 0x7f2538066a10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:20.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.832+0000 7f253da41700 1 --2- 172.21.15.49:0/1252821331 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25381520c0 0x7f2538066520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:20.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.832+0000 7f253da41700 1 -- 172.21.15.49:0/1252821331 >> 172.21.15.49:0/1252821331 conn(0x7f25380631d0 msgr2=0x7f25380c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:20.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.832+0000 7f253da41700 1 -- 172.21.15.49:0/1252821331 shutdown_connections 2023-11-30T17:07:20.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.832+0000 7f253da41700 1 -- 172.21.15.49:0/1252821331 wait complete. 2023-11-30T17:07:20.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.833+0000 7f253da41700 1 Processor -- start 2023-11-30T17:07:20.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.833+0000 7f253da41700 1 -- start start 2023-11-30T17:07:20.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.834+0000 7f253da41700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2538068150 0x7f2538165210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:20.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.834+0000 7f253da41700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25381520c0 0x7f25380ac3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:20.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.834+0000 7f253da41700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25381524a0 0x7f25380ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:20.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.834+0000 7f253da41700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25381621f0 con 0x7f2538068150 2023-11-30T17:07:20.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.834+0000 7f253da41700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2538162fe0 con 0x7f25381520c0 2023-11-30T17:07:20.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.834+0000 7f253da41700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25381623d0 con 0x7f25381524a0 2023-11-30T17:07:20.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.834+0000 7f2536ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2538068150 0x7f2538165210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:20.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.834+0000 7f2536ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2538068150 0x7f2538165210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59140/0 (socket says 172.21.15.49:59140) 2023-11-30T17:07:20.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.834+0000 7f2536ffd700 1 -- 172.21.15.49:0/421442385 learned_addr learned my addr 172.21.15.49:0/421442385 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:20.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.834+0000 7f25367fc700 1 --2- 172.21.15.49:0/421442385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25381520c0 0x7f25380ac3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:20.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.834+0000 7f25377fe700 1 --2- 172.21.15.49:0/421442385 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25381524a0 0x7f25380ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:20.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.834+0000 7f2536ffd700 1 -- 172.21.15.49:0/421442385 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25381524a0 msgr2=0x7f25380ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:20.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.834+0000 7f2536ffd700 1 --2- 172.21.15.49:0/421442385 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25381524a0 0x7f25380ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:20.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.834+0000 7f2536ffd700 1 -- 172.21.15.49:0/421442385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25381520c0 msgr2=0x7f25380ac3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:20.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.834+0000 7f2536ffd700 1 --2- 172.21.15.49:0/421442385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25381520c0 0x7f25380ac3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:20.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.834+0000 7f2536ffd700 1 -- 172.21.15.49:0/421442385 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2528009a20 con 0x7f2538068150 2023-11-30T17:07:20.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.834+0000 7f2536ffd700 1 --2- 172.21.15.49:0/421442385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2538068150 0x7f2538165210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f253000e8d0 tx=0x7f2530006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:20.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.834+0000 7f252effd700 1 -- 172.21.15.49:0/421442385 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2530009450 con 0x7f2538068150 2023-11-30T17:07:20.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.834+0000 7f252effd700 1 -- 172.21.15.49:0/421442385 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2530012600 con 0x7f2538068150 2023-11-30T17:07:20.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.834+0000 7f253da41700 1 -- 172.21.15.49:0/421442385 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25381626b0 con 0x7f2538068150 2023-11-30T17:07:20.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.834+0000 7f252effd700 1 -- 172.21.15.49:0/421442385 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2530012980 con 0x7f2538068150 2023-11-30T17:07:20.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.835+0000 7f253da41700 1 -- 172.21.15.49:0/421442385 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2538162c70 con 0x7f2538068150 2023-11-30T17:07:20.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.835+0000 7f253da41700 1 -- 172.21.15.49:0/421442385 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f253806c860 con 0x7f2538068150 2023-11-30T17:07:20.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.836+0000 7f252effd700 1 -- 172.21.15.49:0/421442385 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2530012cf0 con 0x7f2538068150 2023-11-30T17:07:20.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.836+0000 7f252effd700 1 --2- 172.21.15.49:0/421442385 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f251805f120 0x7f25180615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:20.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.836+0000 7f252effd700 1 -- 172.21.15.49:0/421442385 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f253007a4c0 con 0x7f2538068150 2023-11-30T17:07:20.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.836+0000 7f25367fc700 1 --2- 172.21.15.49:0/421442385 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f251805f120 0x7f25180615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:20.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.837+0000 7f25367fc700 1 --2- 172.21.15.49:0/421442385 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f251805f120 0x7f25180615e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f25380c8600 tx=0x7f2520007dd0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:20.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:20.840+0000 7f252effd700 1 -- 172.21.15.49:0/421442385 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f253004b790 con 0x7f2538068150 2023-11-30T17:07:21.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.009+0000 7f253da41700 1 -- 172.21.15.49:0/421442385 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f25380c5880 con 0x7f251805f120 2023-11-30T17:07:21.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.018+0000 7f252effd700 1 -- 172.21.15.49:0/421442385 <== mgr.4105 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336479 (secure 0 0 0) 0x7f25380c5880 con 0x7f251805f120 2023-11-30T17:07:21.024 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:21.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.021+0000 7f253da41700 1 -- 172.21.15.49:0/421442385 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f251805f120 msgr2=0x7f25180615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:21.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.021+0000 7f253da41700 1 --2- 172.21.15.49:0/421442385 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f251805f120 0x7f25180615e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f25380c8600 tx=0x7f2520007dd0).stop 2023-11-30T17:07:21.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.021+0000 7f253da41700 1 -- 172.21.15.49:0/421442385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2538068150 msgr2=0x7f2538165210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:21.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.021+0000 7f253da41700 1 --2- 172.21.15.49:0/421442385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2538068150 0x7f2538165210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f253000e8d0 tx=0x7f2530006f40).stop 2023-11-30T17:07:21.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.021+0000 7f253da41700 1 -- 172.21.15.49:0/421442385 shutdown_connections 2023-11-30T17:07:21.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.021+0000 7f253da41700 1 --2- 172.21.15.49:0/421442385 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25381524a0 0x7f25380ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:21.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.021+0000 7f253da41700 1 --2- 172.21.15.49:0/421442385 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f251805f120 0x7f25180615e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:21.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.021+0000 7f253da41700 1 --2- 172.21.15.49:0/421442385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2538068150 0x7f2538165210 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:21.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.021+0000 7f253da41700 1 --2- 172.21.15.49:0/421442385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25381520c0 0x7f25380ac3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:21.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.021+0000 7f253da41700 1 -- 172.21.15.49:0/421442385 >> 172.21.15.49:0/421442385 conn(0x7f25380631d0 msgr2=0x7f25380a6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:21.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.021+0000 7f253da41700 1 -- 172.21.15.49:0/421442385 shutdown_connections 2023-11-30T17:07:21.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.021+0000 7f253da41700 1 -- 172.21.15.49:0/421442385 wait complete. 2023-11-30T17:07:21.028 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:07:21.036 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-11-30T17:07:20.838510+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378576,"kb_used_data":1808,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596144,"statfs":{"total":773094113280,"available":770658451456,"internally_reserved":0,"allocated":1851392,"data_stored":660524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307566+0000","last_change":"2023-11-30T17:07:16.305288+0000","last_active":"2023-11-30T17:07:16.307566+0000","last_peered":"2023-11-30T17:07:16.307566+0000","last_clean":"2023-11-30T17:07:16.307566+0000","last_became_active":"2023-11-30T17:07:16.305010+0000","last_became_peered":"2023-11-30T17:07:16.305010+0000","last_unstale":"2023-11-30T17:07:16.307566+0000","last_undegraded":"2023-11-30T17:07:16.307566+0000","last_fullsized":"2023-11-30T17:07:16.307566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295268+0000","last_change":"2023-11-30T17:07:15.910158+0000","last_active":"2023-11-30T17:07:16.295268+0000","last_peered":"2023-11-30T17:07:16.295268+0000","last_clean":"2023-11-30T17:07:16.295268+0000","last_became_active":"2023-11-30T17:07:15.909808+0000","last_became_peered":"2023-11-30T17:07:15.909808+0000","last_unstale":"2023-11-30T17:07:16.295268+0000","last_undegraded":"2023-11-30T17:07:16.295268+0000","last_fullsized":"2023-11-30T17:07:16.295268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.309132+0000","last_change":"2023-11-30T17:07:16.303941+0000","last_active":"2023-11-30T17:07:16.309132+0000","last_peered":"2023-11-30T17:07:16.309132+0000","last_clean":"2023-11-30T17:07:16.309132+0000","last_became_active":"2023-11-30T17:07:16.303673+0000","last_became_peered":"2023-11-30T17:07:16.303673+0000","last_unstale":"2023-11-30T17:07:16.309132+0000","last_undegraded":"2023-11-30T17:07:16.309132+0000","last_fullsized":"2023-11-30T17:07:16.309132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.285551+0000","last_change":"2023-11-30T17:07:15.914251+0000","last_active":"2023-11-30T17:07:16.285551+0000","last_peered":"2023-11-30T17:07:16.285551+0000","last_clean":"2023-11-30T17:07:16.285551+0000","last_became_active":"2023-11-30T17:07:15.913954+0000","last_became_peered":"2023-11-30T17:07:15.913954+0000","last_unstale":"2023-11-30T17:07:16.285551+0000","last_undegraded":"2023-11-30T17:07:16.285551+0000","last_fullsized":"2023-11-30T17:07:16.285551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318395+0000","last_change":"2023-11-30T17:07:16.314266+0000","last_active":"2023-11-30T17:07:16.318395+0000","last_peered":"2023-11-30T17:07:16.318395+0000","last_clean":"2023-11-30T17:07:16.318395+0000","last_became_active":"2023-11-30T17:07:16.313990+0000","last_became_peered":"2023-11-30T17:07:16.313990+0000","last_unstale":"2023-11-30T17:07:16.318395+0000","last_undegraded":"2023-11-30T17:07:16.318395+0000","last_fullsized":"2023-11-30T17:07:16.318395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.294345+0000","last_change":"2023-11-30T17:07:15.911004+0000","last_active":"2023-11-30T17:07:16.294345+0000","last_peered":"2023-11-30T17:07:16.294345+0000","last_clean":"2023-11-30T17:07:16.294345+0000","last_became_active":"2023-11-30T17:07:15.910698+0000","last_became_peered":"2023-11-30T17:07:15.910698+0000","last_unstale":"2023-11-30T17:07:16.294345+0000","last_undegraded":"2023-11-30T17:07:16.294345+0000","last_fullsized":"2023-11-30T17:07:16.294345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.306911+0000","last_change":"2023-11-30T17:07:16.304718+0000","last_active":"2023-11-30T17:07:16.306911+0000","last_peered":"2023-11-30T17:07:16.306911+0000","last_clean":"2023-11-30T17:07:16.306911+0000","last_became_active":"2023-11-30T17:07:16.304311+0000","last_became_peered":"2023-11-30T17:07:16.304311+0000","last_unstale":"2023-11-30T17:07:16.306911+0000","last_undegraded":"2023-11-30T17:07:16.306911+0000","last_fullsized":"2023-11-30T17:07:16.306911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.289689+0000","last_change":"2023-11-30T17:07:15.905295+0000","last_active":"2023-11-30T17:07:16.289689+0000","last_peered":"2023-11-30T17:07:16.289689+0000","last_clean":"2023-11-30T17:07:16.289689+0000","last_became_active":"2023-11-30T17:07:15.904998+0000","last_became_peered":"2023-11-30T17:07:15.904998+0000","last_unstale":"2023-11-30T17:07:16.289689+0000","last_undegraded":"2023-11-30T17:07:16.289689+0000","last_fullsized":"2023-11-30T17:07:16.289689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308850+0000","last_change":"2023-11-30T17:07:16.307461+0000","last_active":"2023-11-30T17:07:16.308850+0000","last_peered":"2023-11-30T17:07:16.308850+0000","last_clean":"2023-11-30T17:07:16.308850+0000","last_became_active":"2023-11-30T17:07:16.307178+0000","last_became_peered":"2023-11-30T17:07:16.307178+0000","last_unstale":"2023-11-30T17:07:16.308850+0000","last_undegraded":"2023-11-30T17:07:16.308850+0000","last_fullsized":"2023-11-30T17:07:16.308850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.305220+0000","last_change":"2023-11-30T17:07:15.915224+0000","last_active":"2023-11-30T17:07:16.305220+0000","last_peered":"2023-11-30T17:07:16.305220+0000","last_clean":"2023-11-30T17:07:16.305220+0000","last_became_active":"2023-11-30T17:07:15.915001+0000","last_became_peered":"2023-11-30T17:07:15.915001+0000","last_unstale":"2023-11-30T17:07:16.305220+0000","last_undegraded":"2023-11-30T17:07:16.305220+0000","last_fullsized":"2023-11-30T17:07:16.305220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.310566+0000","last_change":"2023-11-30T17:07:16.302009+0000","last_active":"2023-11-30T17:07:16.310566+0000","last_peered":"2023-11-30T17:07:16.310566+0000","last_clean":"2023-11-30T17:07:16.310566+0000","last_became_active":"2023-11-30T17:07:16.301664+0000","last_became_peered":"2023-11-30T17:07:16.301664+0000","last_unstale":"2023-11-30T17:07:16.310566+0000","last_undegraded":"2023-11-30T17:07:16.310566+0000","last_fullsized":"2023-11-30T17:07:16.310566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308378+0000","last_change":"2023-11-30T17:07:15.919005+0000","last_active":"2023-11-30T17:07:16.308378+0000","last_peered":"2023-11-30T17:07:16.308378+0000","last_clean":"2023-11-30T17:07:16.308378+0000","last_became_active":"2023-11-30T17:07:15.918757+0000","last_became_peered":"2023-11-30T17:07:15.918757+0000","last_unstale":"2023-11-30T17:07:16.308378+0000","last_undegraded":"2023-11-30T17:07:16.308378+0000","last_fullsized":"2023-11-30T17:07:16.308378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.305107+0000","last_change":"2023-11-30T17:07:16.303563+0000","last_active":"2023-11-30T17:07:16.305107+0000","last_peered":"2023-11-30T17:07:16.305107+0000","last_clean":"2023-11-30T17:07:16.305107+0000","last_became_active":"2023-11-30T17:07:16.303281+0000","last_became_peered":"2023-11-30T17:07:16.303281+0000","last_unstale":"2023-11-30T17:07:16.305107+0000","last_undegraded":"2023-11-30T17:07:16.305107+0000","last_fullsized":"2023-11-30T17:07:16.305107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.311442+0000","last_change":"2023-11-30T17:07:15.912815+0000","last_active":"2023-11-30T17:07:16.311442+0000","last_peered":"2023-11-30T17:07:16.311442+0000","last_clean":"2023-11-30T17:07:16.311442+0000","last_became_active":"2023-11-30T17:07:15.912519+0000","last_became_peered":"2023-11-30T17:07:15.912519+0000","last_unstale":"2023-11-30T17:07:16.311442+0000","last_undegraded":"2023-11-30T17:07:16.311442+0000","last_fullsized":"2023-11-30T17:07:16.311442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.306264+0000","last_change":"2023-11-30T17:07:16.305070+0000","last_active":"2023-11-30T17:07:16.306264+0000","last_peered":"2023-11-30T17:07:16.306264+0000","last_clean":"2023-11-30T17:07:16.306264+0000","last_became_active":"2023-11-30T17:07:16.304769+0000","last_became_peered":"2023-11-30T17:07:16.304769+0000","last_unstale":"2023-11-30T17:07:16.306264+0000","last_undegraded":"2023-11-30T17:07:16.306264+0000","last_fullsized":"2023-11-30T17:07:16.306264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.305362+0000","last_change":"2023-11-30T17:07:15.911789+0000","last_active":"2023-11-30T17:07:16.305362+0000","last_peered":"2023-11-30T17:07:16.305362+0000","last_clean":"2023-11-30T17:07:16.305362+0000","last_became_active":"2023-11-30T17:07:15.911461+0000","last_became_peered":"2023-11-30T17:07:15.911461+0000","last_unstale":"2023-11-30T17:07:16.305362+0000","last_undegraded":"2023-11-30T17:07:16.305362+0000","last_fullsized":"2023-11-30T17:07:16.305362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.320053+0000","last_change":"2023-11-30T17:07:16.316309+0000","last_active":"2023-11-30T17:07:16.320053+0000","last_peered":"2023-11-30T17:07:16.320053+0000","last_clean":"2023-11-30T17:07:16.320053+0000","last_became_active":"2023-11-30T17:07:16.316010+0000","last_became_peered":"2023-11-30T17:07:16.316010+0000","last_unstale":"2023-11-30T17:07:16.320053+0000","last_undegraded":"2023-11-30T17:07:16.320053+0000","last_fullsized":"2023-11-30T17:07:16.320053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.288892+0000","last_change":"2023-11-30T17:07:15.914178+0000","last_active":"2023-11-30T17:07:16.288892+0000","last_peered":"2023-11-30T17:07:16.288892+0000","last_clean":"2023-11-30T17:07:16.288892+0000","last_became_active":"2023-11-30T17:07:15.913297+0000","last_became_peered":"2023-11-30T17:07:15.913297+0000","last_unstale":"2023-11-30T17:07:16.288892+0000","last_undegraded":"2023-11-30T17:07:16.288892+0000","last_fullsized":"2023-11-30T17:07:16.288892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.304041+0000","last_change":"2023-11-30T17:07:16.300572+0000","last_active":"2023-11-30T17:07:16.304041+0000","last_peered":"2023-11-30T17:07:16.304041+0000","last_clean":"2023-11-30T17:07:16.304041+0000","last_became_active":"2023-11-30T17:07:16.300298+0000","last_became_peered":"2023-11-30T17:07:16.300298+0000","last_unstale":"2023-11-30T17:07:16.304041+0000","last_undegraded":"2023-11-30T17:07:16.304041+0000","last_fullsized":"2023-11-30T17:07:16.304041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295495+0000","last_change":"2023-11-30T17:07:15.915272+0000","last_active":"2023-11-30T17:07:16.295495+0000","last_peered":"2023-11-30T17:07:16.295495+0000","last_clean":"2023-11-30T17:07:16.295495+0000","last_became_active":"2023-11-30T17:07:15.914832+0000","last_became_peered":"2023-11-30T17:07:15.914832+0000","last_unstale":"2023-11-30T17:07:16.295495+0000","last_undegraded":"2023-11-30T17:07:16.295495+0000","last_fullsized":"2023-11-30T17:07:16.295495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.313799+0000","last_change":"2023-11-30T17:07:16.311093+0000","last_active":"2023-11-30T17:07:16.313799+0000","last_peered":"2023-11-30T17:07:16.313799+0000","last_clean":"2023-11-30T17:07:16.313799+0000","last_became_active":"2023-11-30T17:07:16.310618+0000","last_became_peered":"2023-11-30T17:07:16.310618+0000","last_unstale":"2023-11-30T17:07:16.313799+0000","last_undegraded":"2023-11-30T17:07:16.313799+0000","last_fullsized":"2023-11-30T17:07:16.313799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.310314+0000","last_change":"2023-11-30T17:07:15.910300+0000","last_active":"2023-11-30T17:07:16.310314+0000","last_peered":"2023-11-30T17:07:16.310314+0000","last_clean":"2023-11-30T17:07:16.310314+0000","last_became_active":"2023-11-30T17:07:15.909476+0000","last_became_peered":"2023-11-30T17:07:15.909476+0000","last_unstale":"2023-11-30T17:07:16.310314+0000","last_undegraded":"2023-11-30T17:07:16.310314+0000","last_fullsized":"2023-11-30T17:07:16.310314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318565+0000","last_change":"2023-11-30T17:07:16.313453+0000","last_active":"2023-11-30T17:07:16.318565+0000","last_peered":"2023-11-30T17:07:16.318565+0000","last_clean":"2023-11-30T17:07:16.318565+0000","last_became_active":"2023-11-30T17:07:16.312874+0000","last_became_peered":"2023-11-30T17:07:16.312874+0000","last_unstale":"2023-11-30T17:07:16.318565+0000","last_undegraded":"2023-11-30T17:07:16.318565+0000","last_fullsized":"2023-11-30T17:07:16.318565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307366+0000","last_change":"2023-11-30T17:07:15.911874+0000","last_active":"2023-11-30T17:07:16.307366+0000","last_peered":"2023-11-30T17:07:16.307366+0000","last_clean":"2023-11-30T17:07:16.307366+0000","last_became_active":"2023-11-30T17:07:15.911404+0000","last_became_peered":"2023-11-30T17:07:15.911404+0000","last_unstale":"2023-11-30T17:07:16.307366+0000","last_undegraded":"2023-11-30T17:07:16.307366+0000","last_fullsized":"2023-11-30T17:07:16.307366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315251+0000","last_change":"2023-11-30T17:07:16.312859+0000","last_active":"2023-11-30T17:07:16.315251+0000","last_peered":"2023-11-30T17:07:16.315251+0000","last_clean":"2023-11-30T17:07:16.315251+0000","last_became_active":"2023-11-30T17:07:16.312514+0000","last_became_peered":"2023-11-30T17:07:16.312514+0000","last_unstale":"2023-11-30T17:07:16.315251+0000","last_undegraded":"2023-11-30T17:07:16.315251+0000","last_fullsized":"2023-11-30T17:07:16.315251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308003+0000","last_change":"2023-11-30T17:07:15.912336+0000","last_active":"2023-11-30T17:07:16.308003+0000","last_peered":"2023-11-30T17:07:16.308003+0000","last_clean":"2023-11-30T17:07:16.308003+0000","last_became_active":"2023-11-30T17:07:15.912069+0000","last_became_peered":"2023-11-30T17:07:15.912069+0000","last_unstale":"2023-11-30T17:07:16.308003+0000","last_undegraded":"2023-11-30T17:07:16.308003+0000","last_fullsized":"2023-11-30T17:07:16.308003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.305757+0000","last_change":"2023-11-30T17:07:16.300210+0000","last_active":"2023-11-30T17:07:16.305757+0000","last_peered":"2023-11-30T17:07:16.305757+0000","last_clean":"2023-11-30T17:07:16.305757+0000","last_became_active":"2023-11-30T17:07:16.298899+0000","last_became_peered":"2023-11-30T17:07:16.298899+0000","last_unstale":"2023-11-30T17:07:16.305757+0000","last_undegraded":"2023-11-30T17:07:16.305757+0000","last_fullsized":"2023-11-30T17:07:16.305757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295980+0000","last_change":"2023-11-30T17:07:15.917879+0000","last_active":"2023-11-30T17:07:16.295980+0000","last_peered":"2023-11-30T17:07:16.295980+0000","last_clean":"2023-11-30T17:07:16.295980+0000","last_became_active":"2023-11-30T17:07:15.917554+0000","last_became_peered":"2023-11-30T17:07:15.917554+0000","last_unstale":"2023-11-30T17:07:16.295980+0000","last_undegraded":"2023-11-30T17:07:16.295980+0000","last_fullsized":"2023-11-30T17:07:16.295980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307516+0000","last_change":"2023-11-30T17:07:16.303927+0000","last_active":"2023-11-30T17:07:16.307516+0000","last_peered":"2023-11-30T17:07:16.307516+0000","last_clean":"2023-11-30T17:07:16.307516+0000","last_became_active":"2023-11-30T17:07:16.303463+0000","last_became_peered":"2023-11-30T17:07:16.303463+0000","last_unstale":"2023-11-30T17:07:16.307516+0000","last_undegraded":"2023-11-30T17:07:16.307516+0000","last_fullsized":"2023-11-30T17:07:16.307516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.303300+0000","last_change":"2023-11-30T17:07:15.913512+0000","last_active":"2023-11-30T17:07:16.303300+0000","last_peered":"2023-11-30T17:07:16.303300+0000","last_clean":"2023-11-30T17:07:16.303300+0000","last_became_active":"2023-11-30T17:07:15.913268+0000","last_became_peered":"2023-11-30T17:07:15.913268+0000","last_unstale":"2023-11-30T17:07:16.303300+0000","last_undegraded":"2023-11-30T17:07:16.303300+0000","last_fullsized":"2023-11-30T17:07:16.303300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312201+0000","last_change":"2023-11-30T17:07:16.308161+0000","last_active":"2023-11-30T17:07:16.312201+0000","last_peered":"2023-11-30T17:07:16.312201+0000","last_clean":"2023-11-30T17:07:16.312201+0000","last_became_active":"2023-11-30T17:07:16.307884+0000","last_became_peered":"2023-11-30T17:07:16.307884+0000","last_unstale":"2023-11-30T17:07:16.312201+0000","last_undegraded":"2023-11-30T17:07:16.312201+0000","last_fullsized":"2023-11-30T17:07:16.312201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.306036+0000","last_change":"2023-11-30T17:07:15.910523+0000","last_active":"2023-11-30T17:07:16.306036+0000","last_peered":"2023-11-30T17:07:16.306036+0000","last_clean":"2023-11-30T17:07:16.306036+0000","last_became_active":"2023-11-30T17:07:15.910216+0000","last_became_peered":"2023-11-30T17:07:15.910216+0000","last_unstale":"2023-11-30T17:07:16.306036+0000","last_undegraded":"2023-11-30T17:07:16.306036+0000","last_fullsized":"2023-11-30T17:07:16.306036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315009+0000","last_change":"2023-11-30T17:07:16.311819+0000","last_active":"2023-11-30T17:07:16.315009+0000","last_peered":"2023-11-30T17:07:16.315009+0000","last_clean":"2023-11-30T17:07:16.315009+0000","last_became_active":"2023-11-30T17:07:16.311446+0000","last_became_peered":"2023-11-30T17:07:16.311446+0000","last_unstale":"2023-11-30T17:07:16.315009+0000","last_undegraded":"2023-11-30T17:07:16.315009+0000","last_fullsized":"2023-11-30T17:07:16.315009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.290739+0000","last_change":"2023-11-30T17:07:15.903463+0000","last_active":"2023-11-30T17:07:16.290739+0000","last_peered":"2023-11-30T17:07:16.290739+0000","last_clean":"2023-11-30T17:07:16.290739+0000","last_became_active":"2023-11-30T17:07:15.903169+0000","last_became_peered":"2023-11-30T17:07:15.903169+0000","last_unstale":"2023-11-30T17:07:16.290739+0000","last_undegraded":"2023-11-30T17:07:16.290739+0000","last_fullsized":"2023-11-30T17:07:16.290739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.304451+0000","last_change":"2023-11-30T17:07:16.301048+0000","last_active":"2023-11-30T17:07:16.304451+0000","last_peered":"2023-11-30T17:07:16.304451+0000","last_clean":"2023-11-30T17:07:16.304451+0000","last_became_active":"2023-11-30T17:07:16.300733+0000","last_became_peered":"2023-11-30T17:07:16.300733+0000","last_unstale":"2023-11-30T17:07:16.304451+0000","last_undegraded":"2023-11-30T17:07:16.304451+0000","last_fullsized":"2023-11-30T17:07:16.304451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.297265+0000","last_change":"2023-11-30T17:07:15.912479+0000","last_active":"2023-11-30T17:07:16.297265+0000","last_peered":"2023-11-30T17:07:16.297265+0000","last_clean":"2023-11-30T17:07:16.297265+0000","last_became_active":"2023-11-30T17:07:15.911715+0000","last_became_peered":"2023-11-30T17:07:15.911715+0000","last_unstale":"2023-11-30T17:07:16.297265+0000","last_undegraded":"2023-11-30T17:07:16.297265+0000","last_fullsized":"2023-11-30T17:07:16.297265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312756+0000","last_change":"2023-11-30T17:07:16.308823+0000","last_active":"2023-11-30T17:07:16.312756+0000","last_peered":"2023-11-30T17:07:16.312756+0000","last_clean":"2023-11-30T17:07:16.312756+0000","last_became_active":"2023-11-30T17:07:16.308607+0000","last_became_peered":"2023-11-30T17:07:16.308607+0000","last_unstale":"2023-11-30T17:07:16.312756+0000","last_undegraded":"2023-11-30T17:07:16.312756+0000","last_fullsized":"2023-11-30T17:07:16.312756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.294468+0000","last_change":"2023-11-30T17:07:15.907967+0000","last_active":"2023-11-30T17:07:16.294468+0000","last_peered":"2023-11-30T17:07:16.294468+0000","last_clean":"2023-11-30T17:07:16.294468+0000","last_became_active":"2023-11-30T17:07:15.907702+0000","last_became_peered":"2023-11-30T17:07:15.907702+0000","last_unstale":"2023-11-30T17:07:16.294468+0000","last_undegraded":"2023-11-30T17:07:16.294468+0000","last_fullsized":"2023-11-30T17:07:16.294468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.285836+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:07:16.285836+0000","last_peered":"2023-11-30T17:07:16.285836+0000","last_clean":"2023-11-30T17:07:16.285836+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:07:16.285836+0000","last_undegraded":"2023-11-30T17:07:16.285836+0000","last_fullsized":"2023-11-30T17:07:16.285836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307514+0000","last_change":"2023-11-30T17:07:15.918902+0000","last_active":"2023-11-30T17:07:16.307514+0000","last_peered":"2023-11-30T17:07:16.307514+0000","last_clean":"2023-11-30T17:07:16.307514+0000","last_became_active":"2023-11-30T17:07:15.918581+0000","last_became_peered":"2023-11-30T17:07:15.918581+0000","last_unstale":"2023-11-30T17:07:16.307514+0000","last_undegraded":"2023-11-30T17:07:16.307514+0000","last_fullsized":"2023-11-30T17:07:16.307514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315758+0000","last_change":"2023-11-30T17:07:16.314704+0000","last_active":"2023-11-30T17:07:16.315758+0000","last_peered":"2023-11-30T17:07:16.315758+0000","last_clean":"2023-11-30T17:07:16.315758+0000","last_became_active":"2023-11-30T17:07:16.314432+0000","last_became_peered":"2023-11-30T17:07:16.314432+0000","last_unstale":"2023-11-30T17:07:16.315758+0000","last_undegraded":"2023-11-30T17:07:16.315758+0000","last_fullsized":"2023-11-30T17:07:16.315758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308686+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:07:16.308686+0000","last_peered":"2023-11-30T17:07:16.308686+0000","last_clean":"2023-11-30T17:07:16.308686+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:07:16.308686+0000","last_undegraded":"2023-11-30T17:07:16.308686+0000","last_fullsized":"2023-11-30T17:07:16.308686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.294139+0000","last_change":"2023-11-30T17:07:15.911883+0000","last_active":"2023-11-30T17:07:16.294139+0000","last_peered":"2023-11-30T17:07:16.294139+0000","last_clean":"2023-11-30T17:07:16.294139+0000","last_became_active":"2023-11-30T17:07:15.911610+0000","last_became_peered":"2023-11-30T17:07:15.911610+0000","last_unstale":"2023-11-30T17:07:16.294139+0000","last_undegraded":"2023-11-30T17:07:16.294139+0000","last_fullsized":"2023-11-30T17:07:16.294139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312407+0000","last_change":"2023-11-30T17:07:16.303472+0000","last_active":"2023-11-30T17:07:16.312407+0000","last_peered":"2023-11-30T17:07:16.312407+0000","last_clean":"2023-11-30T17:07:16.312407+0000","last_became_active":"2023-11-30T17:07:16.302394+0000","last_became_peered":"2023-11-30T17:07:16.302394+0000","last_unstale":"2023-11-30T17:07:16.312407+0000","last_undegraded":"2023-11-30T17:07:16.312407+0000","last_fullsized":"2023-11-30T17:07:16.312407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315795+0000","last_change":"2023-11-30T17:07:16.314725+0000","last_active":"2023-11-30T17:07:16.315795+0000","last_peered":"2023-11-30T17:07:16.315795+0000","last_clean":"2023-11-30T17:07:16.315795+0000","last_became_active":"2023-11-30T17:07:16.314512+0000","last_became_peered":"2023-11-30T17:07:16.314512+0000","last_unstale":"2023-11-30T17:07:16.315795+0000","last_undegraded":"2023-11-30T17:07:16.315795+0000","last_fullsized":"2023-11-30T17:07:16.315795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.292666+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:07:16.292666+0000","last_peered":"2023-11-30T17:07:16.292666+0000","last_clean":"2023-11-30T17:07:16.292666+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:07:16.292666+0000","last_undegraded":"2023-11-30T17:07:16.292666+0000","last_fullsized":"2023-11-30T17:07:16.292666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.285572+0000","last_change":"2023-11-30T17:07:15.913075+0000","last_active":"2023-11-30T17:07:16.285572+0000","last_peered":"2023-11-30T17:07:16.285572+0000","last_clean":"2023-11-30T17:07:16.285572+0000","last_became_active":"2023-11-30T17:07:15.912781+0000","last_became_peered":"2023-11-30T17:07:15.912781+0000","last_unstale":"2023-11-30T17:07:16.285572+0000","last_undegraded":"2023-11-30T17:07:16.285572+0000","last_fullsized":"2023-11-30T17:07:16.285572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307120+0000","last_change":"2023-11-30T17:07:16.300272+0000","last_active":"2023-11-30T17:07:16.307120+0000","last_peered":"2023-11-30T17:07:16.307120+0000","last_clean":"2023-11-30T17:07:16.307120+0000","last_became_active":"2023-11-30T17:07:16.299930+0000","last_became_peered":"2023-11-30T17:07:16.299930+0000","last_unstale":"2023-11-30T17:07:16.307120+0000","last_undegraded":"2023-11-30T17:07:16.307120+0000","last_fullsized":"2023-11-30T17:07:16.307120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.301634+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:07:16.301634+0000","last_peered":"2023-11-30T17:07:16.301634+0000","last_clean":"2023-11-30T17:07:16.301634+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:07:16.301634+0000","last_undegraded":"2023-11-30T17:07:16.301634+0000","last_fullsized":"2023-11-30T17:07:16.301634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.293696+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:07:16.293696+0000","last_peered":"2023-11-30T17:07:16.293696+0000","last_clean":"2023-11-30T17:07:16.293696+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:07:16.293696+0000","last_undegraded":"2023-11-30T17:07:16.293696+0000","last_fullsized":"2023-11-30T17:07:16.293696+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295020+0000","last_change":"2023-11-30T17:07:15.906109+0000","last_active":"2023-11-30T17:07:16.295020+0000","last_peered":"2023-11-30T17:07:16.295020+0000","last_clean":"2023-11-30T17:07:16.295020+0000","last_became_active":"2023-11-30T17:07:15.905789+0000","last_became_peered":"2023-11-30T17:07:15.905789+0000","last_unstale":"2023-11-30T17:07:16.295020+0000","last_undegraded":"2023-11-30T17:07:16.295020+0000","last_fullsized":"2023-11-30T17:07:16.295020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.304020+0000","last_change":"2023-11-30T17:07:16.296058+0000","last_active":"2023-11-30T17:07:16.304020+0000","last_peered":"2023-11-30T17:07:16.304020+0000","last_clean":"2023-11-30T17:07:16.304020+0000","last_became_active":"2023-11-30T17:07:16.295800+0000","last_became_peered":"2023-11-30T17:07:16.295800+0000","last_unstale":"2023-11-30T17:07:16.304020+0000","last_undegraded":"2023-11-30T17:07:16.304020+0000","last_fullsized":"2023-11-30T17:07:16.304020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.294447+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:07:16.294447+0000","last_peered":"2023-11-30T17:07:16.294447+0000","last_clean":"2023-11-30T17:07:16.294447+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:07:16.294447+0000","last_undegraded":"2023-11-30T17:07:16.294447+0000","last_fullsized":"2023-11-30T17:07:16.294447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.289819+0000","last_change":"2023-11-30T17:07:15.908114+0000","last_active":"2023-11-30T17:07:16.289819+0000","last_peered":"2023-11-30T17:07:16.289819+0000","last_clean":"2023-11-30T17:07:16.289819+0000","last_became_active":"2023-11-30T17:07:15.907787+0000","last_became_peered":"2023-11-30T17:07:15.907787+0000","last_unstale":"2023-11-30T17:07:16.289819+0000","last_undegraded":"2023-11-30T17:07:16.289819+0000","last_fullsized":"2023-11-30T17:07:16.289819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295873+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:07:16.295873+0000","last_peered":"2023-11-30T17:07:16.295873+0000","last_clean":"2023-11-30T17:07:16.295873+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:07:16.295873+0000","last_undegraded":"2023-11-30T17:07:16.295873+0000","last_fullsized":"2023-11-30T17:07:16.295873+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.285991+0000","last_change":"2023-11-30T17:07:15.912233+0000","last_active":"2023-11-30T17:07:16.285991+0000","last_peered":"2023-11-30T17:07:16.285991+0000","last_clean":"2023-11-30T17:07:16.285991+0000","last_became_active":"2023-11-30T17:07:15.911944+0000","last_became_peered":"2023-11-30T17:07:15.911944+0000","last_unstale":"2023-11-30T17:07:16.285991+0000","last_undegraded":"2023-11-30T17:07:16.285991+0000","last_fullsized":"2023-11-30T17:07:16.285991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315990+0000","last_change":"2023-11-30T17:07:16.314967+0000","last_active":"2023-11-30T17:07:16.315990+0000","last_peered":"2023-11-30T17:07:16.315990+0000","last_clean":"2023-11-30T17:07:16.315990+0000","last_became_active":"2023-11-30T17:07:16.313860+0000","last_became_peered":"2023-11-30T17:07:16.313860+0000","last_unstale":"2023-11-30T17:07:16.315990+0000","last_undegraded":"2023-11-30T17:07:16.315990+0000","last_fullsized":"2023-11-30T17:07:16.315990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.311367+0000","last_change":"2023-11-30T17:07:15.918489+0000","last_active":"2023-11-30T17:07:16.311367+0000","last_peered":"2023-11-30T17:07:16.311367+0000","last_clean":"2023-11-30T17:07:16.311367+0000","last_became_active":"2023-11-30T17:07:15.918200+0000","last_became_peered":"2023-11-30T17:07:15.918200+0000","last_unstale":"2023-11-30T17:07:16.311367+0000","last_undegraded":"2023-11-30T17:07:16.311367+0000","last_fullsized":"2023-11-30T17:07:16.311367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.286349+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:07:16.286349+0000","last_peered":"2023-11-30T17:07:16.286349+0000","last_clean":"2023-11-30T17:07:16.286349+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:07:16.286349+0000","last_undegraded":"2023-11-30T17:07:16.286349+0000","last_fullsized":"2023-11-30T17:07:16.286349+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308858+0000","last_change":"2023-11-30T17:07:16.307511+0000","last_active":"2023-11-30T17:07:16.308858+0000","last_peered":"2023-11-30T17:07:16.308858+0000","last_clean":"2023-11-30T17:07:16.308858+0000","last_became_active":"2023-11-30T17:07:16.307230+0000","last_became_peered":"2023-11-30T17:07:16.307230+0000","last_unstale":"2023-11-30T17:07:16.308858+0000","last_undegraded":"2023-11-30T17:07:16.308858+0000","last_fullsized":"2023-11-30T17:07:16.308858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.291598+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:07:16.291598+0000","last_peered":"2023-11-30T17:07:16.291598+0000","last_clean":"2023-11-30T17:07:16.291598+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:07:16.291598+0000","last_undegraded":"2023-11-30T17:07:16.291598+0000","last_fullsized":"2023-11-30T17:07:16.291598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.289782+0000","last_change":"2023-11-30T17:07:15.908349+0000","last_active":"2023-11-30T17:07:16.289782+0000","last_peered":"2023-11-30T17:07:16.289782+0000","last_clean":"2023-11-30T17:07:16.289782+0000","last_became_active":"2023-11-30T17:07:15.908063+0000","last_became_peered":"2023-11-30T17:07:15.908063+0000","last_unstale":"2023-11-30T17:07:16.289782+0000","last_undegraded":"2023-11-30T17:07:16.289782+0000","last_fullsized":"2023-11-30T17:07:16.289782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315272+0000","last_change":"2023-11-30T17:07:16.314378+0000","last_active":"2023-11-30T17:07:16.315272+0000","last_peered":"2023-11-30T17:07:16.315272+0000","last_clean":"2023-11-30T17:07:16.315272+0000","last_became_active":"2023-11-30T17:07:16.314073+0000","last_became_peered":"2023-11-30T17:07:16.314073+0000","last_unstale":"2023-11-30T17:07:16.315272+0000","last_undegraded":"2023-11-30T17:07:16.315272+0000","last_fullsized":"2023-11-30T17:07:16.315272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.309505+0000","last_change":"2023-11-30T17:07:16.304420+0000","last_active":"2023-11-30T17:07:16.309505+0000","last_peered":"2023-11-30T17:07:16.309505+0000","last_clean":"2023-11-30T17:07:16.309505+0000","last_became_active":"2023-11-30T17:07:16.304065+0000","last_became_peered":"2023-11-30T17:07:16.304065+0000","last_unstale":"2023-11-30T17:07:16.309505+0000","last_undegraded":"2023-11-30T17:07:16.309505+0000","last_fullsized":"2023-11-30T17:07:16.309505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.291238+0000","last_change":"2023-11-30T17:07:15.905313+0000","last_active":"2023-11-30T17:07:16.291238+0000","last_peered":"2023-11-30T17:07:16.291238+0000","last_clean":"2023-11-30T17:07:16.291238+0000","last_became_active":"2023-11-30T17:07:15.905016+0000","last_became_peered":"2023-11-30T17:07:15.905016+0000","last_unstale":"2023-11-30T17:07:16.291238+0000","last_undegraded":"2023-11-30T17:07:16.291238+0000","last_fullsized":"2023-11-30T17:07:16.291238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312205+0000","last_change":"2023-11-30T17:07:16.308479+0000","last_active":"2023-11-30T17:07:16.312205+0000","last_peered":"2023-11-30T17:07:16.312205+0000","last_clean":"2023-11-30T17:07:16.312205+0000","last_became_active":"2023-11-30T17:07:16.307732+0000","last_became_peered":"2023-11-30T17:07:16.307732+0000","last_unstale":"2023-11-30T17:07:16.312205+0000","last_undegraded":"2023-11-30T17:07:16.312205+0000","last_fullsized":"2023-11-30T17:07:16.312205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.303391+0000","last_change":"2023-11-30T17:07:15.907619+0000","last_active":"2023-11-30T17:07:16.303391+0000","last_peered":"2023-11-30T17:07:16.303391+0000","last_clean":"2023-11-30T17:07:16.303391+0000","last_became_active":"2023-11-30T17:07:15.907322+0000","last_became_peered":"2023-11-30T17:07:15.907322+0000","last_unstale":"2023-11-30T17:07:16.303391+0000","last_undegraded":"2023-11-30T17:07:16.303391+0000","last_fullsized":"2023-11-30T17:07:16.303391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312237+0000","last_change":"2023-11-30T17:07:16.307668+0000","last_active":"2023-11-30T17:07:16.312237+0000","last_peered":"2023-11-30T17:07:16.312237+0000","last_clean":"2023-11-30T17:07:16.312237+0000","last_became_active":"2023-11-30T17:07:16.306226+0000","last_became_peered":"2023-11-30T17:07:16.306226+0000","last_unstale":"2023-11-30T17:07:16.312237+0000","last_undegraded":"2023-11-30T17:07:16.312237+0000","last_fullsized":"2023-11-30T17:07:16.312237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315804+0000","last_change":"2023-11-30T17:07:15.910485+0000","last_active":"2023-11-30T17:07:16.315804+0000","last_peered":"2023-11-30T17:07:16.315804+0000","last_clean":"2023-11-30T17:07:16.315804+0000","last_became_active":"2023-11-30T17:07:15.909426+0000","last_became_peered":"2023-11-30T17:07:15.909426+0000","last_unstale":"2023-11-30T17:07:16.315804+0000","last_undegraded":"2023-11-30T17:07:16.315804+0000","last_fullsized":"2023-11-30T17:07:16.315804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.314207+0000","last_change":"2023-11-30T17:07:16.308666+0000","last_active":"2023-11-30T17:07:16.314207+0000","last_peered":"2023-11-30T17:07:16.314207+0000","last_clean":"2023-11-30T17:07:16.314207+0000","last_became_active":"2023-11-30T17:07:16.308353+0000","last_became_peered":"2023-11-30T17:07:16.308353+0000","last_unstale":"2023-11-30T17:07:16.314207+0000","last_undegraded":"2023-11-30T17:07:16.314207+0000","last_fullsized":"2023-11-30T17:07:16.314207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.305835+0000","last_change":"2023-11-30T17:07:15.899895+0000","last_active":"2023-11-30T17:07:16.305835+0000","last_peered":"2023-11-30T17:07:16.305835+0000","last_clean":"2023-11-30T17:07:16.305835+0000","last_became_active":"2023-11-30T17:07:15.899595+0000","last_became_peered":"2023-11-30T17:07:15.899595+0000","last_unstale":"2023-11-30T17:07:16.305835+0000","last_undegraded":"2023-11-30T17:07:16.305835+0000","last_fullsized":"2023-11-30T17:07:16.305835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.304474+0000","last_change":"2023-11-30T17:07:16.301694+0000","last_active":"2023-11-30T17:07:16.304474+0000","last_peered":"2023-11-30T17:07:16.304474+0000","last_clean":"2023-11-30T17:07:16.304474+0000","last_became_active":"2023-11-30T17:07:16.301392+0000","last_became_peered":"2023-11-30T17:07:16.301392+0000","last_unstale":"2023-11-30T17:07:16.304474+0000","last_undegraded":"2023-11-30T17:07:16.304474+0000","last_fullsized":"2023-11-30T17:07:16.304474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.309919+0000","last_change":"2023-11-30T17:07:15.905807+0000","last_active":"2023-11-30T17:07:16.309919+0000","last_peered":"2023-11-30T17:07:16.309919+0000","last_clean":"2023-11-30T17:07:16.309919+0000","last_became_active":"2023-11-30T17:07:15.905509+0000","last_became_peered":"2023-11-30T17:07:15.905509+0000","last_unstale":"2023-11-30T17:07:16.309919+0000","last_undegraded":"2023-11-30T17:07:16.309919+0000","last_fullsized":"2023-11-30T17:07:16.309919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.310536+0000","last_change":"2023-11-30T17:07:16.301265+0000","last_active":"2023-11-30T17:07:16.310536+0000","last_peered":"2023-11-30T17:07:16.310536+0000","last_clean":"2023-11-30T17:07:16.310536+0000","last_became_active":"2023-11-30T17:07:16.300966+0000","last_became_peered":"2023-11-30T17:07:16.300966+0000","last_unstale":"2023-11-30T17:07:16.310536+0000","last_undegraded":"2023-11-30T17:07:16.310536+0000","last_fullsized":"2023-11-30T17:07:16.310536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.291444+0000","last_change":"2023-11-30T17:07:15.907348+0000","last_active":"2023-11-30T17:07:16.291444+0000","last_peered":"2023-11-30T17:07:16.291444+0000","last_clean":"2023-11-30T17:07:16.291444+0000","last_became_active":"2023-11-30T17:07:15.907034+0000","last_became_peered":"2023-11-30T17:07:15.907034+0000","last_unstale":"2023-11-30T17:07:16.291444+0000","last_undegraded":"2023-11-30T17:07:16.291444+0000","last_fullsized":"2023-11-30T17:07:16.291444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.310519+0000","last_change":"2023-11-30T17:07:16.302759+0000","last_active":"2023-11-30T17:07:16.310519+0000","last_peered":"2023-11-30T17:07:16.310519+0000","last_clean":"2023-11-30T17:07:16.310519+0000","last_became_active":"2023-11-30T17:07:16.302501+0000","last_became_peered":"2023-11-30T17:07:16.302501+0000","last_unstale":"2023-11-30T17:07:16.310519+0000","last_undegraded":"2023-11-30T17:07:16.310519+0000","last_fullsized":"2023-11-30T17:07:16.310519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.292697+0000","last_change":"2023-11-30T17:07:15.915794+0000","last_active":"2023-11-30T17:07:16.292697+0000","last_peered":"2023-11-30T17:07:16.292697+0000","last_clean":"2023-11-30T17:07:16.292697+0000","last_became_active":"2023-11-30T17:07:15.915469+0000","last_became_peered":"2023-11-30T17:07:15.915469+0000","last_unstale":"2023-11-30T17:07:16.292697+0000","last_undegraded":"2023-11-30T17:07:16.292697+0000","last_fullsized":"2023-11-30T17:07:16.292697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.320036+0000","last_change":"2023-11-30T17:07:16.316288+0000","last_active":"2023-11-30T17:07:16.320036+0000","last_peered":"2023-11-30T17:07:16.320036+0000","last_clean":"2023-11-30T17:07:16.320036+0000","last_became_active":"2023-11-30T17:07:16.315974+0000","last_became_peered":"2023-11-30T17:07:16.315974+0000","last_unstale":"2023-11-30T17:07:16.320036+0000","last_undegraded":"2023-11-30T17:07:16.320036+0000","last_fullsized":"2023-11-30T17:07:16.320036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308587+0000","last_change":"2023-11-30T17:07:15.918830+0000","last_active":"2023-11-30T17:07:16.308587+0000","last_peered":"2023-11-30T17:07:16.308587+0000","last_clean":"2023-11-30T17:07:16.308587+0000","last_became_active":"2023-11-30T17:07:15.918553+0000","last_became_peered":"2023-11-30T17:07:15.918553+0000","last_unstale":"2023-11-30T17:07:16.308587+0000","last_undegraded":"2023-11-30T17:07:16.308587+0000","last_fullsized":"2023-11-30T17:07:16.308587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312385+0000","last_change":"2023-11-30T17:07:16.300603+0000","last_active":"2023-11-30T17:07:16.312385+0000","last_peered":"2023-11-30T17:07:16.312385+0000","last_clean":"2023-11-30T17:07:16.312385+0000","last_became_active":"2023-11-30T17:07:16.297982+0000","last_became_peered":"2023-11-30T17:07:16.297982+0000","last_unstale":"2023-11-30T17:07:16.312385+0000","last_undegraded":"2023-11-30T17:07:16.312385+0000","last_fullsized":"2023-11-30T17:07:16.312385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.291351+0000","last_change":"2023-11-30T17:07:15.905698+0000","last_active":"2023-11-30T17:07:16.291351+0000","last_peered":"2023-11-30T17:07:16.291351+0000","last_clean":"2023-11-30T17:07:16.291351+0000","last_became_active":"2023-11-30T17:07:15.905364+0000","last_became_peered":"2023-11-30T17:07:15.905364+0000","last_unstale":"2023-11-30T17:07:16.291351+0000","last_undegraded":"2023-11-30T17:07:16.291351+0000","last_fullsized":"2023-11-30T17:07:16.291351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.314168+0000","last_change":"2023-11-30T17:07:16.310762+0000","last_active":"2023-11-30T17:07:16.314168+0000","last_peered":"2023-11-30T17:07:16.314168+0000","last_clean":"2023-11-30T17:07:16.314168+0000","last_became_active":"2023-11-30T17:07:16.310459+0000","last_became_peered":"2023-11-30T17:07:16.310459+0000","last_unstale":"2023-11-30T17:07:16.314168+0000","last_undegraded":"2023-11-30T17:07:16.314168+0000","last_fullsized":"2023-11-30T17:07:16.314168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.296049+0000","last_change":"2023-11-30T17:07:15.905922+0000","last_active":"2023-11-30T17:07:16.296049+0000","last_peered":"2023-11-30T17:07:16.296049+0000","last_clean":"2023-11-30T17:07:16.296049+0000","last_became_active":"2023-11-30T17:07:15.905607+0000","last_became_peered":"2023-11-30T17:07:15.905607+0000","last_unstale":"2023-11-30T17:07:16.296049+0000","last_undegraded":"2023-11-30T17:07:16.296049+0000","last_fullsized":"2023-11-30T17:07:16.296049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.314769+0000","last_change":"2023-11-30T17:07:16.310200+0000","last_active":"2023-11-30T17:07:16.314769+0000","last_peered":"2023-11-30T17:07:16.314769+0000","last_clean":"2023-11-30T17:07:16.314769+0000","last_became_active":"2023-11-30T17:07:16.309645+0000","last_became_peered":"2023-11-30T17:07:16.309645+0000","last_unstale":"2023-11-30T17:07:16.314769+0000","last_undegraded":"2023-11-30T17:07:16.314769+0000","last_fullsized":"2023-11-30T17:07:16.314769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.285637+0000","last_change":"2023-11-30T17:07:15.913510+0000","last_active":"2023-11-30T17:07:16.285637+0000","last_peered":"2023-11-30T17:07:16.285637+0000","last_clean":"2023-11-30T17:07:16.285637+0000","last_became_active":"2023-11-30T17:07:15.913195+0000","last_became_peered":"2023-11-30T17:07:15.913195+0000","last_unstale":"2023-11-30T17:07:16.285637+0000","last_undegraded":"2023-11-30T17:07:16.285637+0000","last_fullsized":"2023-11-30T17:07:16.285637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307638+0000","last_change":"2023-11-30T17:07:16.305749+0000","last_active":"2023-11-30T17:07:16.307638+0000","last_peered":"2023-11-30T17:07:16.307638+0000","last_clean":"2023-11-30T17:07:16.307638+0000","last_became_active":"2023-11-30T17:07:16.305460+0000","last_became_peered":"2023-11-30T17:07:16.305460+0000","last_unstale":"2023-11-30T17:07:16.307638+0000","last_undegraded":"2023-11-30T17:07:16.307638+0000","last_fullsized":"2023-11-30T17:07:16.307638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.291660+0000","last_change":"2023-11-30T17:07:15.915366+0000","last_active":"2023-11-30T17:07:16.291660+0000","last_peered":"2023-11-30T17:07:16.291660+0000","last_clean":"2023-11-30T17:07:16.291660+0000","last_became_active":"2023-11-30T17:07:15.915099+0000","last_became_peered":"2023-11-30T17:07:15.915099+0000","last_unstale":"2023-11-30T17:07:16.291660+0000","last_undegraded":"2023-11-30T17:07:16.291660+0000","last_fullsized":"2023-11-30T17:07:16.291660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.303911+0000","last_change":"2023-11-30T17:07:16.300223+0000","last_active":"2023-11-30T17:07:16.303911+0000","last_peered":"2023-11-30T17:07:16.303911+0000","last_clean":"2023-11-30T17:07:16.303911+0000","last_became_active":"2023-11-30T17:07:16.299885+0000","last_became_peered":"2023-11-30T17:07:16.299885+0000","last_unstale":"2023-11-30T17:07:16.303911+0000","last_undegraded":"2023-11-30T17:07:16.303911+0000","last_fullsized":"2023-11-30T17:07:16.303911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.298199+0000","last_change":"2023-11-30T17:07:15.912712+0000","last_active":"2023-11-30T17:07:16.298199+0000","last_peered":"2023-11-30T17:07:16.298199+0000","last_clean":"2023-11-30T17:07:16.298199+0000","last_became_active":"2023-11-30T17:07:15.912259+0000","last_became_peered":"2023-11-30T17:07:15.912259+0000","last_unstale":"2023-11-30T17:07:16.298199+0000","last_undegraded":"2023-11-30T17:07:16.298199+0000","last_fullsized":"2023-11-30T17:07:16.298199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.313787+0000","last_change":"2023-11-30T17:07:16.309299+0000","last_active":"2023-11-30T17:07:16.313787+0000","last_peered":"2023-11-30T17:07:16.313787+0000","last_clean":"2023-11-30T17:07:16.313787+0000","last_became_active":"2023-11-30T17:07:16.308844+0000","last_became_peered":"2023-11-30T17:07:16.308844+0000","last_unstale":"2023-11-30T17:07:16.313787+0000","last_undegraded":"2023-11-30T17:07:16.313787+0000","last_fullsized":"2023-11-30T17:07:16.313787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.298030+0000","last_change":"2023-11-30T17:07:15.920996+0000","last_active":"2023-11-30T17:07:16.298030+0000","last_peered":"2023-11-30T17:07:16.298030+0000","last_clean":"2023-11-30T17:07:16.298030+0000","last_became_active":"2023-11-30T17:07:15.920782+0000","last_became_peered":"2023-11-30T17:07:15.920782+0000","last_unstale":"2023-11-30T17:07:16.298030+0000","last_undegraded":"2023-11-30T17:07:16.298030+0000","last_fullsized":"2023-11-30T17:07:16.298030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307613+0000","last_change":"2023-11-30T17:07:16.304597+0000","last_active":"2023-11-30T17:07:16.307613+0000","last_peered":"2023-11-30T17:07:16.307613+0000","last_clean":"2023-11-30T17:07:16.307613+0000","last_became_active":"2023-11-30T17:07:16.304251+0000","last_became_peered":"2023-11-30T17:07:16.304251+0000","last_unstale":"2023-11-30T17:07:16.307613+0000","last_undegraded":"2023-11-30T17:07:16.307613+0000","last_fullsized":"2023-11-30T17:07:16.307613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.297402+0000","last_change":"2023-11-30T17:07:15.913299+0000","last_active":"2023-11-30T17:07:16.297402+0000","last_peered":"2023-11-30T17:07:16.297402+0000","last_clean":"2023-11-30T17:07:16.297402+0000","last_became_active":"2023-11-30T17:07:15.912978+0000","last_became_peered":"2023-11-30T17:07:15.912978+0000","last_unstale":"2023-11-30T17:07:16.297402+0000","last_undegraded":"2023-11-30T17:07:16.297402+0000","last_fullsized":"2023-11-30T17:07:16.297402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315291+0000","last_change":"2023-11-30T17:07:16.311213+0000","last_active":"2023-11-30T17:07:16.315291+0000","last_peered":"2023-11-30T17:07:16.315291+0000","last_clean":"2023-11-30T17:07:16.315291+0000","last_became_active":"2023-11-30T17:07:16.309590+0000","last_became_peered":"2023-11-30T17:07:16.309590+0000","last_unstale":"2023-11-30T17:07:16.315291+0000","last_undegraded":"2023-11-30T17:07:16.315291+0000","last_fullsized":"2023-11-30T17:07:16.315291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308744+0000","last_change":"2023-11-30T17:07:15.917988+0000","last_active":"2023-11-30T17:07:16.308744+0000","last_peered":"2023-11-30T17:07:16.308744+0000","last_clean":"2023-11-30T17:07:16.308744+0000","last_became_active":"2023-11-30T17:07:15.917715+0000","last_became_peered":"2023-11-30T17:07:15.917715+0000","last_unstale":"2023-11-30T17:07:16.308744+0000","last_undegraded":"2023-11-30T17:07:16.308744+0000","last_fullsized":"2023-11-30T17:07:16.308744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.309259+0000","last_change":"2023-11-30T17:07:16.305167+0000","last_active":"2023-11-30T17:07:16.309259+0000","last_peered":"2023-11-30T17:07:16.309259+0000","last_clean":"2023-11-30T17:07:16.309259+0000","last_became_active":"2023-11-30T17:07:16.304366+0000","last_became_peered":"2023-11-30T17:07:16.304366+0000","last_unstale":"2023-11-30T17:07:16.309259+0000","last_undegraded":"2023-11-30T17:07:16.309259+0000","last_fullsized":"2023-11-30T17:07:16.309259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.309634+0000","last_change":"2023-11-30T17:07:15.913349+0000","last_active":"2023-11-30T17:07:16.309634+0000","last_peered":"2023-11-30T17:07:16.309634+0000","last_clean":"2023-11-30T17:07:16.309634+0000","last_became_active":"2023-11-30T17:07:15.912819+0000","last_became_peered":"2023-11-30T17:07:15.912819+0000","last_unstale":"2023-11-30T17:07:16.309634+0000","last_undegraded":"2023-11-30T17:07:16.309634+0000","last_fullsized":"2023-11-30T17:07:16.309634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312387+0000","last_change":"2023-11-30T17:07:16.307878+0000","last_active":"2023-11-30T17:07:16.312387+0000","last_peered":"2023-11-30T17:07:16.312387+0000","last_clean":"2023-11-30T17:07:16.312387+0000","last_became_active":"2023-11-30T17:07:16.307596+0000","last_became_peered":"2023-11-30T17:07:16.307596+0000","last_unstale":"2023-11-30T17:07:16.312387+0000","last_undegraded":"2023-11-30T17:07:16.312387+0000","last_fullsized":"2023-11-30T17:07:16.312387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.289290+0000","last_change":"2023-11-30T17:07:15.905418+0000","last_active":"2023-11-30T17:07:16.289290+0000","last_peered":"2023-11-30T17:07:16.289290+0000","last_clean":"2023-11-30T17:07:16.289290+0000","last_became_active":"2023-11-30T17:07:15.905118+0000","last_became_peered":"2023-11-30T17:07:15.905118+0000","last_unstale":"2023-11-30T17:07:16.289290+0000","last_undegraded":"2023-11-30T17:07:16.289290+0000","last_fullsized":"2023-11-30T17:07:16.289290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295717+0000","last_change":"2023-11-30T17:07:16.294026+0000","last_active":"2023-11-30T17:07:16.295717+0000","last_peered":"2023-11-30T17:07:16.295717+0000","last_clean":"2023-11-30T17:07:16.295717+0000","last_became_active":"2023-11-30T17:07:16.293758+0000","last_became_peered":"2023-11-30T17:07:16.293758+0000","last_unstale":"2023-11-30T17:07:16.295717+0000","last_undegraded":"2023-11-30T17:07:16.295717+0000","last_fullsized":"2023-11-30T17:07:16.295717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.310234+0000","last_change":"2023-11-30T17:07:15.914406+0000","last_active":"2023-11-30T17:07:16.310234+0000","last_peered":"2023-11-30T17:07:16.310234+0000","last_clean":"2023-11-30T17:07:16.310234+0000","last_became_active":"2023-11-30T17:07:15.914121+0000","last_became_peered":"2023-11-30T17:07:15.914121+0000","last_unstale":"2023-11-30T17:07:16.310234+0000","last_undegraded":"2023-11-30T17:07:16.310234+0000","last_fullsized":"2023-11-30T17:07:16.310234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307697+0000","last_change":"2023-11-30T17:07:16.306238+0000","last_active":"2023-11-30T17:07:16.307697+0000","last_peered":"2023-11-30T17:07:16.307697+0000","last_clean":"2023-11-30T17:07:16.307697+0000","last_became_active":"2023-11-30T17:07:16.305963+0000","last_became_peered":"2023-11-30T17:07:16.305963+0000","last_unstale":"2023-11-30T17:07:16.307697+0000","last_undegraded":"2023-11-30T17:07:16.307697+0000","last_fullsized":"2023-11-30T17:07:16.307697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.293985+0000","last_change":"2023-11-30T17:07:15.909372+0000","last_active":"2023-11-30T17:07:16.293985+0000","last_peered":"2023-11-30T17:07:16.293985+0000","last_clean":"2023-11-30T17:07:16.293985+0000","last_became_active":"2023-11-30T17:07:15.909092+0000","last_became_peered":"2023-11-30T17:07:15.909092+0000","last_unstale":"2023-11-30T17:07:16.293985+0000","last_undegraded":"2023-11-30T17:07:16.293985+0000","last_fullsized":"2023-11-30T17:07:16.293985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315497+0000","last_change":"2023-11-30T17:07:16.309056+0000","last_active":"2023-11-30T17:07:16.315497+0000","last_peered":"2023-11-30T17:07:16.315497+0000","last_clean":"2023-11-30T17:07:16.315497+0000","last_became_active":"2023-11-30T17:07:16.308728+0000","last_became_peered":"2023-11-30T17:07:16.308728+0000","last_unstale":"2023-11-30T17:07:16.315497+0000","last_undegraded":"2023-11-30T17:07:16.315497+0000","last_fullsized":"2023-11-30T17:07:16.315497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.306826+0000","last_change":"2023-11-30T17:07:15.914123+0000","last_active":"2023-11-30T17:07:16.306826+0000","last_peered":"2023-11-30T17:07:16.306826+0000","last_clean":"2023-11-30T17:07:16.306826+0000","last_became_active":"2023-11-30T17:07:15.913855+0000","last_became_peered":"2023-11-30T17:07:15.913855+0000","last_unstale":"2023-11-30T17:07:16.306826+0000","last_undegraded":"2023-11-30T17:07:16.306826+0000","last_fullsized":"2023-11-30T17:07:16.306826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.313763+0000","last_change":"2023-11-30T17:07:16.309110+0000","last_active":"2023-11-30T17:07:16.313763+0000","last_peered":"2023-11-30T17:07:16.313763+0000","last_clean":"2023-11-30T17:07:16.313763+0000","last_became_active":"2023-11-30T17:07:16.308500+0000","last_became_peered":"2023-11-30T17:07:16.308500+0000","last_unstale":"2023-11-30T17:07:16.313763+0000","last_undegraded":"2023-11-30T17:07:16.313763+0000","last_fullsized":"2023-11-30T17:07:16.313763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.313277+0000","last_change":"2023-11-30T17:07:15.909703+0000","last_active":"2023-11-30T17:07:16.313277+0000","last_peered":"2023-11-30T17:07:16.313277+0000","last_clean":"2023-11-30T17:07:16.313277+0000","last_became_active":"2023-11-30T17:07:15.909387+0000","last_became_peered":"2023-11-30T17:07:15.909387+0000","last_unstale":"2023-11-30T17:07:16.313277+0000","last_undegraded":"2023-11-30T17:07:16.313277+0000","last_fullsized":"2023-11-30T17:07:16.313277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318600+0000","last_change":"2023-11-30T17:07:16.314404+0000","last_active":"2023-11-30T17:07:16.318600+0000","last_peered":"2023-11-30T17:07:16.318600+0000","last_clean":"2023-11-30T17:07:16.318600+0000","last_became_active":"2023-11-30T17:07:16.314144+0000","last_became_peered":"2023-11-30T17:07:16.314144+0000","last_unstale":"2023-11-30T17:07:16.318600+0000","last_undegraded":"2023-11-30T17:07:16.318600+0000","last_fullsized":"2023-11-30T17:07:16.318600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.285577+0000","last_change":"2023-11-30T17:07:15.907074+0000","last_active":"2023-11-30T17:07:16.285577+0000","last_peered":"2023-11-30T17:07:16.285577+0000","last_clean":"2023-11-30T17:07:16.285577+0000","last_became_active":"2023-11-30T17:07:15.906537+0000","last_became_peered":"2023-11-30T17:07:15.906537+0000","last_unstale":"2023-11-30T17:07:16.285577+0000","last_undegraded":"2023-11-30T17:07:16.285577+0000","last_fullsized":"2023-11-30T17:07:16.285577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308169+0000","last_change":"2023-11-30T17:07:16.304623+0000","last_active":"2023-11-30T17:07:16.308169+0000","last_peered":"2023-11-30T17:07:16.308169+0000","last_clean":"2023-11-30T17:07:16.308169+0000","last_became_active":"2023-11-30T17:07:16.303986+0000","last_became_peered":"2023-11-30T17:07:16.303986+0000","last_unstale":"2023-11-30T17:07:16.308169+0000","last_undegraded":"2023-11-30T17:07:16.308169+0000","last_fullsized":"2023-11-30T17:07:16.308169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.288987+0000","last_change":"2023-11-30T17:07:15.905081+0000","last_active":"2023-11-30T17:07:16.288987+0000","last_peered":"2023-11-30T17:07:16.288987+0000","last_clean":"2023-11-30T17:07:16.288987+0000","last_became_active":"2023-11-30T17:07:15.903780+0000","last_became_peered":"2023-11-30T17:07:15.903780+0000","last_unstale":"2023-11-30T17:07:16.288987+0000","last_undegraded":"2023-11-30T17:07:16.288987+0000","last_fullsized":"2023-11-30T17:07:16.288987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.301942+0000","last_change":"2023-11-30T17:07:16.300473+0000","last_active":"2023-11-30T17:07:16.301942+0000","last_peered":"2023-11-30T17:07:16.301942+0000","last_clean":"2023-11-30T17:07:16.301942+0000","last_became_active":"2023-11-30T17:07:16.300201+0000","last_became_peered":"2023-11-30T17:07:16.300201+0000","last_unstale":"2023-11-30T17:07:16.301942+0000","last_undegraded":"2023-11-30T17:07:16.301942+0000","last_fullsized":"2023-11-30T17:07:16.301942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.306129+0000","last_change":"2023-11-30T17:07:15.903443+0000","last_active":"2023-11-30T17:07:16.306129+0000","last_peered":"2023-11-30T17:07:16.306129+0000","last_clean":"2023-11-30T17:07:16.306129+0000","last_became_active":"2023-11-30T17:07:15.902100+0000","last_became_peered":"2023-11-30T17:07:15.902100+0000","last_unstale":"2023-11-30T17:07:16.306129+0000","last_undegraded":"2023-11-30T17:07:16.306129+0000","last_fullsized":"2023-11-30T17:07:16.306129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.311052+0000","last_change":"2023-11-30T17:07:16.308777+0000","last_active":"2023-11-30T17:07:16.311052+0000","last_peered":"2023-11-30T17:07:16.311052+0000","last_clean":"2023-11-30T17:07:16.311052+0000","last_became_active":"2023-11-30T17:07:16.308488+0000","last_became_peered":"2023-11-30T17:07:16.308488+0000","last_unstale":"2023-11-30T17:07:16.311052+0000","last_undegraded":"2023-11-30T17:07:16.311052+0000","last_fullsized":"2023-11-30T17:07:16.311052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318584+0000","last_change":"2023-11-30T17:07:15.909022+0000","last_active":"2023-11-30T17:07:16.318584+0000","last_peered":"2023-11-30T17:07:16.318584+0000","last_clean":"2023-11-30T17:07:16.318584+0000","last_became_active":"2023-11-30T17:07:15.908674+0000","last_became_peered":"2023-11-30T17:07:15.908674+0000","last_unstale":"2023-11-30T17:07:16.318584+0000","last_undegraded":"2023-11-30T17:07:16.318584+0000","last_fullsized":"2023-11-30T17:07:16.318584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318514+0000","last_change":"2023-11-30T17:07:16.313527+0000","last_active":"2023-11-30T17:07:16.318514+0000","last_peered":"2023-11-30T17:07:16.318514+0000","last_clean":"2023-11-30T17:07:16.318514+0000","last_became_active":"2023-11-30T17:07:16.313199+0000","last_became_peered":"2023-11-30T17:07:16.313199+0000","last_unstale":"2023-11-30T17:07:16.318514+0000","last_undegraded":"2023-11-30T17:07:16.318514+0000","last_fullsized":"2023-11-30T17:07:16.318514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.288932+0000","last_change":"2023-11-30T17:07:15.914420+0000","last_active":"2023-11-30T17:07:16.288932+0000","last_peered":"2023-11-30T17:07:16.288932+0000","last_clean":"2023-11-30T17:07:16.288932+0000","last_became_active":"2023-11-30T17:07:15.914142+0000","last_became_peered":"2023-11-30T17:07:15.914142+0000","last_unstale":"2023-11-30T17:07:16.288932+0000","last_undegraded":"2023-11-30T17:07:16.288932+0000","last_fullsized":"2023-11-30T17:07:16.288932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308304+0000","last_change":"2023-11-30T17:07:16.305961+0000","last_active":"2023-11-30T17:07:16.308304+0000","last_peered":"2023-11-30T17:07:16.308304+0000","last_clean":"2023-11-30T17:07:16.308304+0000","last_became_active":"2023-11-30T17:07:16.305363+0000","last_became_peered":"2023-11-30T17:07:16.305363+0000","last_unstale":"2023-11-30T17:07:16.308304+0000","last_undegraded":"2023-11-30T17:07:16.308304+0000","last_fullsized":"2023-11-30T17:07:16.308304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.291553+0000","last_change":"2023-11-30T17:07:15.911255+0000","last_active":"2023-11-30T17:07:16.291553+0000","last_peered":"2023-11-30T17:07:16.291553+0000","last_clean":"2023-11-30T17:07:16.291553+0000","last_became_active":"2023-11-30T17:07:15.910945+0000","last_became_peered":"2023-11-30T17:07:15.910945+0000","last_unstale":"2023-11-30T17:07:16.291553+0000","last_undegraded":"2023-11-30T17:07:16.291553+0000","last_fullsized":"2023-11-30T17:07:16.291553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.314860+0000","last_change":"2023-11-30T17:07:16.310924+0000","last_active":"2023-11-30T17:07:16.314860+0000","last_peered":"2023-11-30T17:07:16.314860+0000","last_clean":"2023-11-30T17:07:16.314860+0000","last_became_active":"2023-11-30T17:07:16.310631+0000","last_became_peered":"2023-11-30T17:07:16.310631+0000","last_unstale":"2023-11-30T17:07:16.314860+0000","last_undegraded":"2023-11-30T17:07:16.314860+0000","last_fullsized":"2023-11-30T17:07:16.314860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.297213+0000","last_change":"2023-11-30T17:07:15.917972+0000","last_active":"2023-11-30T17:07:16.297213+0000","last_peered":"2023-11-30T17:07:16.297213+0000","last_clean":"2023-11-30T17:07:16.297213+0000","last_became_active":"2023-11-30T17:07:15.917546+0000","last_became_peered":"2023-11-30T17:07:15.917546+0000","last_unstale":"2023-11-30T17:07:16.297213+0000","last_undegraded":"2023-11-30T17:07:16.297213+0000","last_fullsized":"2023-11-30T17:07:16.297213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.311505+0000","last_change":"2023-11-30T17:07:16.309537+0000","last_active":"2023-11-30T17:07:16.311505+0000","last_peered":"2023-11-30T17:07:16.311505+0000","last_clean":"2023-11-30T17:07:16.311505+0000","last_became_active":"2023-11-30T17:07:16.309220+0000","last_became_peered":"2023-11-30T17:07:16.309220+0000","last_unstale":"2023-11-30T17:07:16.311505+0000","last_undegraded":"2023-11-30T17:07:16.311505+0000","last_fullsized":"2023-11-30T17:07:16.311505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.294800+0000","last_change":"2023-11-30T17:07:15.913708+0000","last_active":"2023-11-30T17:07:16.294800+0000","last_peered":"2023-11-30T17:07:16.294800+0000","last_clean":"2023-11-30T17:07:16.294800+0000","last_became_active":"2023-11-30T17:07:15.913418+0000","last_became_peered":"2023-11-30T17:07:15.913418+0000","last_unstale":"2023-11-30T17:07:16.294800+0000","last_undegraded":"2023-11-30T17:07:16.294800+0000","last_fullsized":"2023-11-30T17:07:16.294800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318618+0000","last_change":"2023-11-30T17:07:16.314589+0000","last_active":"2023-11-30T17:07:16.318618+0000","last_peered":"2023-11-30T17:07:16.318618+0000","last_clean":"2023-11-30T17:07:16.318618+0000","last_became_active":"2023-11-30T17:07:16.313770+0000","last_became_peered":"2023-11-30T17:07:16.313770+0000","last_unstale":"2023-11-30T17:07:16.318618+0000","last_undegraded":"2023-11-30T17:07:16.318618+0000","last_fullsized":"2023-11-30T17:07:16.318618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295850+0000","last_change":"2023-11-30T17:07:15.914471+0000","last_active":"2023-11-30T17:07:16.295850+0000","last_peered":"2023-11-30T17:07:16.295850+0000","last_clean":"2023-11-30T17:07:16.295850+0000","last_became_active":"2023-11-30T17:07:15.914170+0000","last_became_peered":"2023-11-30T17:07:15.914170+0000","last_unstale":"2023-11-30T17:07:16.295850+0000","last_undegraded":"2023-11-30T17:07:16.295850+0000","last_fullsized":"2023-11-30T17:07:16.295850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.314949+0000","last_change":"2023-11-30T17:07:16.309802+0000","last_active":"2023-11-30T17:07:16.314949+0000","last_peered":"2023-11-30T17:07:16.314949+0000","last_clean":"2023-11-30T17:07:16.314949+0000","last_became_active":"2023-11-30T17:07:16.309499+0000","last_became_peered":"2023-11-30T17:07:16.309499+0000","last_unstale":"2023-11-30T17:07:16.314949+0000","last_undegraded":"2023-11-30T17:07:16.314949+0000","last_fullsized":"2023-11-30T17:07:16.314949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.313989+0000","last_change":"2023-11-30T17:07:15.909306+0000","last_active":"2023-11-30T17:07:16.313989+0000","last_peered":"2023-11-30T17:07:16.313989+0000","last_clean":"2023-11-30T17:07:16.313989+0000","last_became_active":"2023-11-30T17:07:15.909030+0000","last_became_peered":"2023-11-30T17:07:15.909030+0000","last_unstale":"2023-11-30T17:07:16.313989+0000","last_undegraded":"2023-11-30T17:07:16.313989+0000","last_fullsized":"2023-11-30T17:07:16.313989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307156+0000","last_change":"2023-11-30T17:07:16.303384+0000","last_active":"2023-11-30T17:07:16.307156+0000","last_peered":"2023-11-30T17:07:16.307156+0000","last_clean":"2023-11-30T17:07:16.307156+0000","last_became_active":"2023-11-30T17:07:16.298413+0000","last_became_peered":"2023-11-30T17:07:16.298413+0000","last_unstale":"2023-11-30T17:07:16.307156+0000","last_undegraded":"2023-11-30T17:07:16.307156+0000","last_fullsized":"2023-11-30T17:07:16.307156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.305248+0000","last_change":"2023-11-30T17:07:15.914690+0000","last_active":"2023-11-30T17:07:16.305248+0000","last_peered":"2023-11-30T17:07:16.305248+0000","last_clean":"2023-11-30T17:07:16.305248+0000","last_became_active":"2023-11-30T17:07:15.914405+0000","last_became_peered":"2023-11-30T17:07:15.914405+0000","last_unstale":"2023-11-30T17:07:16.305248+0000","last_undegraded":"2023-11-30T17:07:16.305248+0000","last_fullsized":"2023-11-30T17:07:16.305248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.310006+0000","last_change":"2023-11-30T17:07:16.306951+0000","last_active":"2023-11-30T17:07:16.310006+0000","last_peered":"2023-11-30T17:07:16.310006+0000","last_clean":"2023-11-30T17:07:16.310006+0000","last_became_active":"2023-11-30T17:07:16.306691+0000","last_became_peered":"2023-11-30T17:07:16.306691+0000","last_unstale":"2023-11-30T17:07:16.310006+0000","last_undegraded":"2023-11-30T17:07:16.310006+0000","last_fullsized":"2023-11-30T17:07:16.310006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312888+0000","last_change":"2023-11-30T17:07:15.913637+0000","last_active":"2023-11-30T17:07:16.312888+0000","last_peered":"2023-11-30T17:07:16.312888+0000","last_clean":"2023-11-30T17:07:16.312888+0000","last_became_active":"2023-11-30T17:07:15.913336+0000","last_became_peered":"2023-11-30T17:07:15.913336+0000","last_unstale":"2023-11-30T17:07:16.312888+0000","last_undegraded":"2023-11-30T17:07:16.312888+0000","last_fullsized":"2023-11-30T17:07:16.312888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.314791+0000","last_change":"2023-11-30T17:07:16.310337+0000","last_active":"2023-11-30T17:07:16.314791+0000","last_peered":"2023-11-30T17:07:16.314791+0000","last_clean":"2023-11-30T17:07:16.314791+0000","last_became_active":"2023-11-30T17:07:16.310010+0000","last_became_peered":"2023-11-30T17:07:16.310010+0000","last_unstale":"2023-11-30T17:07:16.314791+0000","last_undegraded":"2023-11-30T17:07:16.314791+0000","last_fullsized":"2023-11-30T17:07:16.314791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.290031+0000","last_change":"2023-11-30T17:07:15.912918+0000","last_active":"2023-11-30T17:07:16.290031+0000","last_peered":"2023-11-30T17:07:16.290031+0000","last_clean":"2023-11-30T17:07:16.290031+0000","last_became_active":"2023-11-30T17:07:15.912624+0000","last_became_peered":"2023-11-30T17:07:15.912624+0000","last_unstale":"2023-11-30T17:07:16.290031+0000","last_undegraded":"2023-11-30T17:07:16.290031+0000","last_fullsized":"2023-11-30T17:07:16.290031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308325+0000","last_change":"2023-11-30T17:07:16.306137+0000","last_active":"2023-11-30T17:07:16.308325+0000","last_peered":"2023-11-30T17:07:16.308325+0000","last_clean":"2023-11-30T17:07:16.308325+0000","last_became_active":"2023-11-30T17:07:16.305673+0000","last_became_peered":"2023-11-30T17:07:16.305673+0000","last_unstale":"2023-11-30T17:07:16.308325+0000","last_undegraded":"2023-11-30T17:07:16.308325+0000","last_fullsized":"2023-11-30T17:07:16.308325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.286516+0000","last_change":"2023-11-30T17:07:15.912021+0000","last_active":"2023-11-30T17:07:16.286516+0000","last_peered":"2023-11-30T17:07:16.286516+0000","last_clean":"2023-11-30T17:07:16.286516+0000","last_became_active":"2023-11-30T17:07:15.911720+0000","last_became_peered":"2023-11-30T17:07:15.911720+0000","last_unstale":"2023-11-30T17:07:16.286516+0000","last_undegraded":"2023-11-30T17:07:16.286516+0000","last_fullsized":"2023-11-30T17:07:16.286516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318594+0000","last_change":"2023-11-30T17:07:16.313578+0000","last_active":"2023-11-30T17:07:16.318594+0000","last_peered":"2023-11-30T17:07:16.318594+0000","last_clean":"2023-11-30T17:07:16.318594+0000","last_became_active":"2023-11-30T17:07:16.313325+0000","last_became_peered":"2023-11-30T17:07:16.313325+0000","last_unstale":"2023-11-30T17:07:16.318594+0000","last_undegraded":"2023-11-30T17:07:16.318594+0000","last_fullsized":"2023-11-30T17:07:16.318594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.311197+0000","last_change":"2023-11-30T17:07:15.908770+0000","last_active":"2023-11-30T17:07:16.311197+0000","last_peered":"2023-11-30T17:07:16.311197+0000","last_clean":"2023-11-30T17:07:16.311197+0000","last_became_active":"2023-11-30T17:07:15.908480+0000","last_became_peered":"2023-11-30T17:07:15.908480+0000","last_unstale":"2023-11-30T17:07:16.311197+0000","last_undegraded":"2023-11-30T17:07:16.311197+0000","last_fullsized":"2023-11-30T17:07:16.311197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297348,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074492,"statfs":{"total":96636764160,"available":96332279808,"internally_reserved":0,"allocated":258048,"data_stored":86755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":86787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":78637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.222}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":78637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.246}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":80229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":78637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:07:21.041 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-30T17:07:21.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.189+0000 7fa540246700 1 Processor -- start 2023-11-30T17:07:21.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.190+0000 7fa540246700 1 -- start start 2023-11-30T17:07:21.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.190+0000 7fa540246700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa538062700 0x7fa538062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:21.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.190+0000 7fa540246700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5380630a0 con 0x7fa5380661b0 2023-11-30T17:07:21.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.190+0000 7fa540246700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa538065760 con 0x7fa5381542d0 2023-11-30T17:07:21.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.190+0000 7fa540246700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5380c3250 con 0x7fa538062700 2023-11-30T17:07:21.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.190+0000 7fa53d7e1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa538062700 0x7fa538062bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:21.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.191+0000 7fa53d7e1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa538062700 0x7fa538062bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59154/0 (socket says 172.21.15.49:59154) 2023-11-30T17:07:21.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.191+0000 7fa53d7e1700 1 -- 172.21.15.49:0/3790228974 learned_addr learned my addr 172.21.15.49:0/3790228974 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:21.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.191+0000 7fa53e7e3700 1 --1- 172.21.15.49:0/3790228974 >> v1:172.21.15.49:6789/0 conn(0x7fa5380661b0 0x7fa538066640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34842/0 (socket says 172.21.15.49:34842) 2023-11-30T17:07:21.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.191+0000 7fa53d7e1700 1 -- 172.21.15.49:0/3790228974 >> v1:172.21.15.115:6789/0 conn(0x7fa5381542d0 legacy=0x7fa5380697f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:21.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.191+0000 7fa53d7e1700 1 -- 172.21.15.49:0/3790228974 >> v1:172.21.15.49:6789/0 conn(0x7fa5380661b0 legacy=0x7fa538066640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:21.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.191+0000 7fa53cfe0700 1 -- 172.21.15.49:0/3790228974 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3887685232 0 0) 0x7fa530001110 con 0x7fa5380661b0 2023-11-30T17:07:21.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.191+0000 7fa53d7e1700 1 -- 172.21.15.49:0/3790228974 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53806a340 con 0x7fa538062700 2023-11-30T17:07:21.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.191+0000 7fa53d7e1700 1 --2- 172.21.15.49:0/3790228974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa538062700 0x7fa538062bb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fa52c006fd0 tx=0x7fa52c0090f0).ready entity=mon.0 client_cookie=3c64e6c317418043 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:21.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.191+0000 7fa53cfe0700 1 -- 172.21.15.49:0/3790228974 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c00b600 con 0x7fa538062700 2023-11-30T17:07:21.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.191+0000 7fa53cfe0700 1 -- 172.21.15.49:0/3790228974 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa52c00b760 con 0x7fa538062700 2023-11-30T17:07:21.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.191+0000 7fa53cfe0700 1 -- 172.21.15.49:0/3790228974 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c00bae0 con 0x7fa538062700 2023-11-30T17:07:21.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.192+0000 7fa540246700 1 -- 172.21.15.49:0/3790228974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa538062700 msgr2=0x7fa538062bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:21.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.192+0000 7fa540246700 1 --2- 172.21.15.49:0/3790228974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa538062700 0x7fa538062bb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fa52c006fd0 tx=0x7fa52c0090f0).stop 2023-11-30T17:07:21.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.192+0000 7fa540246700 1 -- 172.21.15.49:0/3790228974 shutdown_connections 2023-11-30T17:07:21.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.192+0000 7fa540246700 1 --2- 172.21.15.49:0/3790228974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa538062700 0x7fa538062bb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:21.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.192+0000 7fa540246700 1 -- 172.21.15.49:0/3790228974 >> 172.21.15.49:0/3790228974 conn(0x7fa5380c7fd0 msgr2=0x7fa5380c83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:21.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.192+0000 7fa540246700 1 -- 172.21.15.49:0/3790228974 shutdown_connections 2023-11-30T17:07:21.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.192+0000 7fa540246700 1 -- 172.21.15.49:0/3790228974 wait complete. 2023-11-30T17:07:21.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.193+0000 7fa540246700 1 Processor -- start 2023-11-30T17:07:21.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.193+0000 7fa540246700 1 -- start start 2023-11-30T17:07:21.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.194+0000 7fa540246700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa538062700 0x7fa5380a7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:21.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.194+0000 7fa540246700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5380661b0 0x7fa5380ab120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:21.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.194+0000 7fa540246700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5381542d0 0x7fa5380ab610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:21.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.194+0000 7fa540246700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5380a8f80 con 0x7fa5381542d0 2023-11-30T17:07:21.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.194+0000 7fa540246700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5380a8370 con 0x7fa538062700 2023-11-30T17:07:21.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.194+0000 7fa540246700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5380a8650 con 0x7fa5380661b0 2023-11-30T17:07:21.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.194+0000 7fa53e7e3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5381542d0 0x7fa5380ab610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:21.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.194+0000 7fa53e7e3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5381542d0 0x7fa5380ab610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59166/0 (socket says 172.21.15.49:59166) 2023-11-30T17:07:21.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.194+0000 7fa53e7e3700 1 -- 172.21.15.49:0/2152927653 learned_addr learned my addr 172.21.15.49:0/2152927653 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:21.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.194+0000 7fa53dfe2700 1 --2- 172.21.15.49:0/2152927653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa538062700 0x7fa5380a7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:21.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.194+0000 7fa53d7e1700 1 --2- 172.21.15.49:0/2152927653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5380661b0 0x7fa5380ab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:21.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.194+0000 7fa53e7e3700 1 -- 172.21.15.49:0/2152927653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5380661b0 msgr2=0x7fa5380ab120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:21.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.194+0000 7fa53e7e3700 1 --2- 172.21.15.49:0/2152927653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5380661b0 0x7fa5380ab120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:21.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.194+0000 7fa53e7e3700 1 -- 172.21.15.49:0/2152927653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa538062700 msgr2=0x7fa5380a7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:21.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.194+0000 7fa53e7e3700 1 --2- 172.21.15.49:0/2152927653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa538062700 0x7fa5380a7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:21.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.194+0000 7fa53e7e3700 1 -- 172.21.15.49:0/2152927653 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52c009370 con 0x7fa5381542d0 2023-11-30T17:07:21.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.194+0000 7fa53e7e3700 1 --2- 172.21.15.49:0/2152927653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5381542d0 0x7fa5380ab610 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fa530001370 tx=0x7fa530007a10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:21.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.194+0000 7fa535ffb700 1 -- 172.21.15.49:0/2152927653 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5300070d0 con 0x7fa5381542d0 2023-11-30T17:07:21.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.194+0000 7fa535ffb700 1 -- 172.21.15.49:0/2152927653 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa530007250 con 0x7fa5381542d0 2023-11-30T17:07:21.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.194+0000 7fa540246700 1 -- 172.21.15.49:0/2152927653 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5380a8930 con 0x7fa5381542d0 2023-11-30T17:07:21.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.194+0000 7fa535ffb700 1 -- 172.21.15.49:0/2152927653 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5300056e0 con 0x7fa5381542d0 2023-11-30T17:07:21.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.195+0000 7fa540246700 1 -- 172.21.15.49:0/2152927653 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5380a7f60 con 0x7fa5381542d0 2023-11-30T17:07:21.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.196+0000 7fa540246700 1 -- 172.21.15.49:0/2152927653 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5380a90f0 con 0x7fa5381542d0 2023-11-30T17:07:21.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.196+0000 7fa535ffb700 1 -- 172.21.15.49:0/2152927653 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa530005a90 con 0x7fa5381542d0 2023-11-30T17:07:21.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.196+0000 7fa535ffb700 1 --2- 172.21.15.49:0/2152927653 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa52405f150 0x7fa524061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:21.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.196+0000 7fa535ffb700 1 -- 172.21.15.49:0/2152927653 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa530079740 con 0x7fa5381542d0 2023-11-30T17:07:21.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.197+0000 7fa53dfe2700 1 --2- 172.21.15.49:0/2152927653 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa52405f150 0x7fa524061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:21.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.197+0000 7fa53dfe2700 1 --2- 172.21.15.49:0/2152927653 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa52405f150 0x7fa524061610 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fa528004290 tx=0x7fa5280014c0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:21.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.201+0000 7fa535ffb700 1 -- 172.21.15.49:0/2152927653 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa53004aa10 con 0x7fa5381542d0 2023-11-30T17:07:21.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.442+0000 7fa540246700 1 -- 172.21.15.49:0/2152927653 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa53806c860 con 0x7fa5381542d0 2023-11-30T17:07:21.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.442+0000 7fa535ffb700 1 -- 172.21.15.49:0/2152927653 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+950 (secure 0 0 0) 0x7fa53004e030 con 0x7fa5381542d0 2023-11-30T17:07:21.445 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:21.446 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":23,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":22,"num_osds":8,"num_up_osds":8,"osd_up_since":1701364027,"num_in_osds":8,"osd_in_since":1701364021,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":21,"data_bytes":2306,"bytes_used":2435661824,"bytes_avail":770658451456,"bytes_total":773094113280},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4276}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-11-30T17:06:57.995701+0000","services":{}},"progress_events":{}} 2023-11-30T17:07:21.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.444+0000 7fa540246700 1 -- 172.21.15.49:0/2152927653 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa52405f150 msgr2=0x7fa524061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:21.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.444+0000 7fa540246700 1 --2- 172.21.15.49:0/2152927653 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa52405f150 0x7fa524061610 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fa528004290 tx=0x7fa5280014c0).stop 2023-11-30T17:07:21.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.444+0000 7fa540246700 1 -- 172.21.15.49:0/2152927653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5381542d0 msgr2=0x7fa5380ab610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:21.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.444+0000 7fa540246700 1 --2- 172.21.15.49:0/2152927653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5381542d0 0x7fa5380ab610 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fa530001370 tx=0x7fa530007a10).stop 2023-11-30T17:07:21.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.444+0000 7fa540246700 1 -- 172.21.15.49:0/2152927653 shutdown_connections 2023-11-30T17:07:21.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.444+0000 7fa540246700 1 --2- 172.21.15.49:0/2152927653 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa52405f150 0x7fa524061610 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:21.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.444+0000 7fa540246700 1 --2- 172.21.15.49:0/2152927653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5381542d0 0x7fa5380ab610 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:21.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.444+0000 7fa540246700 1 --2- 172.21.15.49:0/2152927653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa538062700 0x7fa5380a7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:21.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.444+0000 7fa540246700 1 --2- 172.21.15.49:0/2152927653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5380661b0 0x7fa5380ab120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:21.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.444+0000 7fa540246700 1 -- 172.21.15.49:0/2152927653 >> 172.21.15.49:0/2152927653 conn(0x7fa5380c7fd0 msgr2=0x7fa5380be660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:21.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.444+0000 7fa540246700 1 -- 172.21.15.49:0/2152927653 shutdown_connections 2023-11-30T17:07:21.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.444+0000 7fa540246700 1 -- 172.21.15.49:0/2152927653 wait complete. 2023-11-30T17:07:21.459 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-30T17:07:21.459 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:07:21.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.573+0000 7f5bbd30f700 1 Processor -- start 2023-11-30T17:07:21.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.573+0000 7f5bbd30f700 1 -- start start 2023-11-30T17:07:21.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.574+0000 7f5bbd30f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bb806b510 0x7f5bb81546f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:21.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.574+0000 7f5bbd30f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb8063380 con 0x7f5bb80c10f0 2023-11-30T17:07:21.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.574+0000 7f5bbd30f700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb8062770 con 0x7f5bb80c0d10 2023-11-30T17:07:21.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.574+0000 7f5bbd30f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb80c19e0 con 0x7f5bb806b510 2023-11-30T17:07:21.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.574+0000 7f5bb77fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5bb80c10f0 0x7f5bb80c2ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34852/0 (socket says 172.21.15.49:34852) 2023-11-30T17:07:21.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.574+0000 7f5bb77fe700 1 -- 172.21.15.49:0/3581901887 learned_addr learned my addr 172.21.15.49:0/3581901887 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:21.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.575+0000 7f5bb67fc700 1 --2- 172.21.15.49:0/3581901887 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bb806b510 0x7f5bb81546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:21.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.575+0000 7f5bb5ffb700 1 -- 172.21.15.49:0/3581901887 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1662684269 0 0) 0x7f5bb8063380 con 0x7f5bb80c10f0 2023-11-30T17:07:21.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.575+0000 7f5bb5ffb700 1 -- 172.21.15.49:0/3581901887 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ba40033f0 con 0x7f5bb80c10f0 2023-11-30T17:07:21.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.575+0000 7f5bb5ffb700 1 -- 172.21.15.49:0/3581901887 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3925238035 0 0) 0x7f5ba40033f0 con 0x7f5bb80c10f0 2023-11-30T17:07:21.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.575+0000 7f5bb5ffb700 1 -- 172.21.15.49:0/3581901887 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bb806b510 msgr2=0x7f5bb81546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:21.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.575+0000 7f5bb5ffb700 1 --2- 172.21.15.49:0/3581901887 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bb806b510 0x7f5bb81546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:21.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.575+0000 7f5bb5ffb700 1 -- 172.21.15.49:0/3581901887 >> v1:172.21.15.115:6789/0 conn(0x7f5bb80c0d10 legacy=0x7f5bb8153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:21.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.575+0000 7f5bb5ffb700 1 -- 172.21.15.49:0/3581901887 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb8062a50 con 0x7f5bb80c10f0 2023-11-30T17:07:21.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.575+0000 7f5bb5ffb700 1 -- 172.21.15.49:0/3581901887 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f5ba8001470 con 0x7f5bb80c10f0 2023-11-30T17:07:21.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.575+0000 7f5bb5ffb700 1 -- 172.21.15.49:0/3581901887 >> v1:172.21.15.49:6789/0 conn(0x7f5bb80c10f0 legacy=0x7f5bb80c2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:21.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.575+0000 7f5bb5ffb700 1 --2- 172.21.15.49:0/3581901887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ba4003910 0x7f5ba4003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:21.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.575+0000 7f5bb5ffb700 1 --2- 172.21.15.49:0/3581901887 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bb806b510 0x7f5ba4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:21.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.575+0000 7f5bb5ffb700 1 --2- 172.21.15.49:0/3581901887 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ba4004b80 0x7f5ba4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:21.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.575+0000 7f5bb5ffb700 1 -- 172.21.15.49:0/3581901887 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb80c19e0 con 0x7f5ba4004b80 2023-11-30T17:07:21.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.575+0000 7f5bb5ffb700 1 -- 172.21.15.49:0/3581901887 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba400b910 con 0x7f5ba4003910 2023-11-30T17:07:21.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.575+0000 7f5bb5ffb700 1 -- 172.21.15.49:0/3581901887 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba400bad0 con 0x7f5bb806b510 2023-11-30T17:07:21.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.575+0000 7f5bb77fe700 1 --2- 172.21.15.49:0/3581901887 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ba4004b80 0x7f5ba4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:21.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.575+0000 7f5bb6ffd700 1 --2- 172.21.15.49:0/3581901887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ba4003910 0x7f5ba4003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:21.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.575+0000 7f5bb67fc700 1 --2- 172.21.15.49:0/3581901887 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bb806b510 0x7f5ba4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:21.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.575+0000 7f5bb77fe700 1 -- 172.21.15.49:0/3581901887 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bb806b510 msgr2=0x7f5ba4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:21.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.575+0000 7f5bb77fe700 1 --2- 172.21.15.49:0/3581901887 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bb806b510 0x7f5ba4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:21.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.575+0000 7f5bb77fe700 1 -- 172.21.15.49:0/3581901887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ba4003910 msgr2=0x7f5ba4003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:21.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.575+0000 7f5bb77fe700 1 --2- 172.21.15.49:0/3581901887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ba4003910 0x7f5ba4003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:21.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.575+0000 7f5bb77fe700 1 -- 172.21.15.49:0/3581901887 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba40033f0 con 0x7f5ba4004b80 2023-11-30T17:07:21.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.576+0000 7f5bb77fe700 1 --2- 172.21.15.49:0/3581901887 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ba4004b80 0x7f5ba4005000 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f5ba800c190 tx=0x7f5ba8001e50).ready entity=mon.0 client_cookie=aae391da596db524 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:21.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.576+0000 7f5bb5ffb700 1 -- 172.21.15.49:0/3581901887 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba8007a20 con 0x7f5ba4004b80 2023-11-30T17:07:21.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.576+0000 7f5bb5ffb700 1 -- 172.21.15.49:0/3581901887 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba800cac0 con 0x7f5ba4004b80 2023-11-30T17:07:21.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.576+0000 7f5bb5ffb700 1 -- 172.21.15.49:0/3581901887 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba800ce40 con 0x7f5ba4004b80 2023-11-30T17:07:21.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.576+0000 7f5bbd30f700 1 -- 172.21.15.49:0/3581901887 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ba4004b80 msgr2=0x7f5ba4005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:21.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.576+0000 7f5bbd30f700 1 --2- 172.21.15.49:0/3581901887 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ba4004b80 0x7f5ba4005000 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f5ba800c190 tx=0x7f5ba8001e50).stop 2023-11-30T17:07:21.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.576+0000 7f5bb77fe700 1 -- 172.21.15.49:0/3581901887 reap_dead start 2023-11-30T17:07:21.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.576+0000 7f5bbd30f700 1 -- 172.21.15.49:0/3581901887 shutdown_connections 2023-11-30T17:07:21.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.576+0000 7f5bbd30f700 1 -- 172.21.15.49:0/3581901887 >> 172.21.15.49:0/3581901887 conn(0x7f5bb80c7760 msgr2=0x7f5bb80c7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:21.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.576+0000 7f5bbd30f700 1 -- 172.21.15.49:0/3581901887 shutdown_connections 2023-11-30T17:07:21.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.576+0000 7f5bbd30f700 1 -- 172.21.15.49:0/3581901887 wait complete. 2023-11-30T17:07:21.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.578+0000 7f5bbd30f700 1 Processor -- start 2023-11-30T17:07:21.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.578+0000 7f5bbd30f700 1 -- start start 2023-11-30T17:07:21.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.578+0000 7f5bbd30f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ba4004b80 0x7f5bb80acc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:21.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.578+0000 7f5bbd30f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bb814a2d0 0x7f5bb8149a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:21.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.578+0000 7f5bbd30f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5bb814c5b0 0x7f5bb814ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:21.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.578+0000 7f5bbd30f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb80ad880 con 0x7f5ba4004b80 2023-11-30T17:07:21.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.578+0000 7f5bbd30f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb814cf20 con 0x7f5bb814c5b0 2023-11-30T17:07:21.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.578+0000 7f5bbd30f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb80ad2f0 con 0x7f5bb814a2d0 2023-11-30T17:07:21.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.578+0000 7f5bb6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ba4004b80 0x7f5bb80acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:21.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.578+0000 7f5bb6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ba4004b80 0x7f5bb80acc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59190/0 (socket says 172.21.15.49:59190) 2023-11-30T17:07:21.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.578+0000 7f5bb6ffd700 1 -- 172.21.15.49:0/1759128397 learned_addr learned my addr 172.21.15.49:0/1759128397 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:21.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.579+0000 7f5bb67fc700 1 --2- 172.21.15.49:0/1759128397 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bb814a2d0 0x7f5bb8149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:21.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.579+0000 7f5bb77fe700 1 --2- 172.21.15.49:0/1759128397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5bb814c5b0 0x7f5bb814ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:21.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.579+0000 7f5bb6ffd700 1 -- 172.21.15.49:0/1759128397 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bb814a2d0 msgr2=0x7f5bb8149a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:21.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.579+0000 7f5bb6ffd700 1 --2- 172.21.15.49:0/1759128397 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bb814a2d0 0x7f5bb8149a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:21.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.579+0000 7f5bb6ffd700 1 -- 172.21.15.49:0/1759128397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5bb814c5b0 msgr2=0x7f5bb814ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:21.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.579+0000 7f5bb6ffd700 1 --2- 172.21.15.49:0/1759128397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5bb814c5b0 0x7f5bb814ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:21.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.579+0000 7f5bb6ffd700 1 -- 172.21.15.49:0/1759128397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb80ab330 con 0x7f5ba4004b80 2023-11-30T17:07:21.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.579+0000 7f5bb77fe700 1 --2- 172.21.15.49:0/1759128397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5bb814c5b0 0x7f5bb814ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:21.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.579+0000 7f5bb6ffd700 1 --2- 172.21.15.49:0/1759128397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ba4004b80 0x7f5bb80acc80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f5bb000e960 tx=0x7f5bb0007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:21.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.579+0000 7f5baeffd700 1 -- 172.21.15.49:0/1759128397 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0017070 con 0x7f5ba4004b80 2023-11-30T17:07:21.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.579+0000 7f5baeffd700 1 -- 172.21.15.49:0/1759128397 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb0001800 con 0x7f5ba4004b80 2023-11-30T17:07:21.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.579+0000 7f5bbd30f700 1 -- 172.21.15.49:0/1759128397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb80ab5d0 con 0x7f5ba4004b80 2023-11-30T17:07:21.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.579+0000 7f5baeffd700 1 -- 172.21.15.49:0/1759128397 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0001b80 con 0x7f5ba4004b80 2023-11-30T17:07:21.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.579+0000 7f5bbd30f700 1 -- 172.21.15.49:0/1759128397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb80abb90 con 0x7f5ba4004b80 2023-11-30T17:07:21.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.580+0000 7f5bbd30f700 1 -- 172.21.15.49:0/1759128397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bb806c860 con 0x7f5ba4004b80 2023-11-30T17:07:21.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.580+0000 7f5baeffd700 1 -- 172.21.15.49:0/1759128397 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5bb000c7e0 con 0x7f5ba4004b80 2023-11-30T17:07:21.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.581+0000 7f5baeffd700 1 --2- 172.21.15.49:0/1759128397 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5b9805f150 0x7f5b98061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:21.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.581+0000 7f5baeffd700 1 -- 172.21.15.49:0/1759128397 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5bb0079fb0 con 0x7f5ba4004b80 2023-11-30T17:07:21.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.581+0000 7f5bb67fc700 1 --2- 172.21.15.49:0/1759128397 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5b9805f150 0x7f5b98061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:21.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.581+0000 7f5bb67fc700 1 --2- 172.21.15.49:0/1759128397 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5b9805f150 0x7f5b98061610 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f5bb8157f20 tx=0x7f5ba0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:21.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.585+0000 7f5baeffd700 1 -- 172.21.15.49:0/1759128397 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5bb00a8b00 con 0x7f5ba4004b80 2023-11-30T17:07:21.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.755+0000 7f5bbd30f700 1 -- 172.21.15.49:0/1759128397 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5bb8062d30 con 0x7f5b9805f150 2023-11-30T17:07:21.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.765+0000 7f5baeffd700 1 -- 172.21.15.49:0/1759128397 <== mgr.4105 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336479 (secure 0 0 0) 0x7f5bb8062d30 con 0x7f5b9805f150 2023-11-30T17:07:21.771 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:21.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.768+0000 7f5bbd30f700 1 -- 172.21.15.49:0/1759128397 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5b9805f150 msgr2=0x7f5b98061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:21.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.768+0000 7f5bbd30f700 1 --2- 172.21.15.49:0/1759128397 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5b9805f150 0x7f5b98061610 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f5bb8157f20 tx=0x7f5ba0008040).stop 2023-11-30T17:07:21.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.768+0000 7f5bbd30f700 1 -- 172.21.15.49:0/1759128397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ba4004b80 msgr2=0x7f5bb80acc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:21.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.768+0000 7f5bbd30f700 1 --2- 172.21.15.49:0/1759128397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ba4004b80 0x7f5bb80acc80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f5bb000e960 tx=0x7f5bb0007f30).stop 2023-11-30T17:07:21.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.768+0000 7f5bbd30f700 1 -- 172.21.15.49:0/1759128397 shutdown_connections 2023-11-30T17:07:21.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.768+0000 7f5bbd30f700 1 --2- 172.21.15.49:0/1759128397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5bb814c5b0 0x7f5bb814ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:21.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.768+0000 7f5bbd30f700 1 --2- 172.21.15.49:0/1759128397 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5b9805f150 0x7f5b98061610 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:21.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.768+0000 7f5bbd30f700 1 --2- 172.21.15.49:0/1759128397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ba4004b80 0x7f5bb80acc80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:21.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.768+0000 7f5bbd30f700 1 --2- 172.21.15.49:0/1759128397 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bb814a2d0 0x7f5bb8149a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:21.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.768+0000 7f5bbd30f700 1 -- 172.21.15.49:0/1759128397 >> 172.21.15.49:0/1759128397 conn(0x7f5bb80c7760 msgr2=0x7f5bb80c6140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:21.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.768+0000 7f5bbd30f700 1 -- 172.21.15.49:0/1759128397 shutdown_connections 2023-11-30T17:07:21.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:21.768+0000 7f5bbd30f700 1 -- 172.21.15.49:0/1759128397 wait complete. 2023-11-30T17:07:21.774 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:07:21.782 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-11-30T17:07:20.838510+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378576,"kb_used_data":1808,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596144,"statfs":{"total":773094113280,"available":770658451456,"internally_reserved":0,"allocated":1851392,"data_stored":660524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307566+0000","last_change":"2023-11-30T17:07:16.305288+0000","last_active":"2023-11-30T17:07:16.307566+0000","last_peered":"2023-11-30T17:07:16.307566+0000","last_clean":"2023-11-30T17:07:16.307566+0000","last_became_active":"2023-11-30T17:07:16.305010+0000","last_became_peered":"2023-11-30T17:07:16.305010+0000","last_unstale":"2023-11-30T17:07:16.307566+0000","last_undegraded":"2023-11-30T17:07:16.307566+0000","last_fullsized":"2023-11-30T17:07:16.307566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295268+0000","last_change":"2023-11-30T17:07:15.910158+0000","last_active":"2023-11-30T17:07:16.295268+0000","last_peered":"2023-11-30T17:07:16.295268+0000","last_clean":"2023-11-30T17:07:16.295268+0000","last_became_active":"2023-11-30T17:07:15.909808+0000","last_became_peered":"2023-11-30T17:07:15.909808+0000","last_unstale":"2023-11-30T17:07:16.295268+0000","last_undegraded":"2023-11-30T17:07:16.295268+0000","last_fullsized":"2023-11-30T17:07:16.295268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.309132+0000","last_change":"2023-11-30T17:07:16.303941+0000","last_active":"2023-11-30T17:07:16.309132+0000","last_peered":"2023-11-30T17:07:16.309132+0000","last_clean":"2023-11-30T17:07:16.309132+0000","last_became_active":"2023-11-30T17:07:16.303673+0000","last_became_peered":"2023-11-30T17:07:16.303673+0000","last_unstale":"2023-11-30T17:07:16.309132+0000","last_undegraded":"2023-11-30T17:07:16.309132+0000","last_fullsized":"2023-11-30T17:07:16.309132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.285551+0000","last_change":"2023-11-30T17:07:15.914251+0000","last_active":"2023-11-30T17:07:16.285551+0000","last_peered":"2023-11-30T17:07:16.285551+0000","last_clean":"2023-11-30T17:07:16.285551+0000","last_became_active":"2023-11-30T17:07:15.913954+0000","last_became_peered":"2023-11-30T17:07:15.913954+0000","last_unstale":"2023-11-30T17:07:16.285551+0000","last_undegraded":"2023-11-30T17:07:16.285551+0000","last_fullsized":"2023-11-30T17:07:16.285551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318395+0000","last_change":"2023-11-30T17:07:16.314266+0000","last_active":"2023-11-30T17:07:16.318395+0000","last_peered":"2023-11-30T17:07:16.318395+0000","last_clean":"2023-11-30T17:07:16.318395+0000","last_became_active":"2023-11-30T17:07:16.313990+0000","last_became_peered":"2023-11-30T17:07:16.313990+0000","last_unstale":"2023-11-30T17:07:16.318395+0000","last_undegraded":"2023-11-30T17:07:16.318395+0000","last_fullsized":"2023-11-30T17:07:16.318395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.294345+0000","last_change":"2023-11-30T17:07:15.911004+0000","last_active":"2023-11-30T17:07:16.294345+0000","last_peered":"2023-11-30T17:07:16.294345+0000","last_clean":"2023-11-30T17:07:16.294345+0000","last_became_active":"2023-11-30T17:07:15.910698+0000","last_became_peered":"2023-11-30T17:07:15.910698+0000","last_unstale":"2023-11-30T17:07:16.294345+0000","last_undegraded":"2023-11-30T17:07:16.294345+0000","last_fullsized":"2023-11-30T17:07:16.294345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.306911+0000","last_change":"2023-11-30T17:07:16.304718+0000","last_active":"2023-11-30T17:07:16.306911+0000","last_peered":"2023-11-30T17:07:16.306911+0000","last_clean":"2023-11-30T17:07:16.306911+0000","last_became_active":"2023-11-30T17:07:16.304311+0000","last_became_peered":"2023-11-30T17:07:16.304311+0000","last_unstale":"2023-11-30T17:07:16.306911+0000","last_undegraded":"2023-11-30T17:07:16.306911+0000","last_fullsized":"2023-11-30T17:07:16.306911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.289689+0000","last_change":"2023-11-30T17:07:15.905295+0000","last_active":"2023-11-30T17:07:16.289689+0000","last_peered":"2023-11-30T17:07:16.289689+0000","last_clean":"2023-11-30T17:07:16.289689+0000","last_became_active":"2023-11-30T17:07:15.904998+0000","last_became_peered":"2023-11-30T17:07:15.904998+0000","last_unstale":"2023-11-30T17:07:16.289689+0000","last_undegraded":"2023-11-30T17:07:16.289689+0000","last_fullsized":"2023-11-30T17:07:16.289689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308850+0000","last_change":"2023-11-30T17:07:16.307461+0000","last_active":"2023-11-30T17:07:16.308850+0000","last_peered":"2023-11-30T17:07:16.308850+0000","last_clean":"2023-11-30T17:07:16.308850+0000","last_became_active":"2023-11-30T17:07:16.307178+0000","last_became_peered":"2023-11-30T17:07:16.307178+0000","last_unstale":"2023-11-30T17:07:16.308850+0000","last_undegraded":"2023-11-30T17:07:16.308850+0000","last_fullsized":"2023-11-30T17:07:16.308850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.305220+0000","last_change":"2023-11-30T17:07:15.915224+0000","last_active":"2023-11-30T17:07:16.305220+0000","last_peered":"2023-11-30T17:07:16.305220+0000","last_clean":"2023-11-30T17:07:16.305220+0000","last_became_active":"2023-11-30T17:07:15.915001+0000","last_became_peered":"2023-11-30T17:07:15.915001+0000","last_unstale":"2023-11-30T17:07:16.305220+0000","last_undegraded":"2023-11-30T17:07:16.305220+0000","last_fullsized":"2023-11-30T17:07:16.305220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.310566+0000","last_change":"2023-11-30T17:07:16.302009+0000","last_active":"2023-11-30T17:07:16.310566+0000","last_peered":"2023-11-30T17:07:16.310566+0000","last_clean":"2023-11-30T17:07:16.310566+0000","last_became_active":"2023-11-30T17:07:16.301664+0000","last_became_peered":"2023-11-30T17:07:16.301664+0000","last_unstale":"2023-11-30T17:07:16.310566+0000","last_undegraded":"2023-11-30T17:07:16.310566+0000","last_fullsized":"2023-11-30T17:07:16.310566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308378+0000","last_change":"2023-11-30T17:07:15.919005+0000","last_active":"2023-11-30T17:07:16.308378+0000","last_peered":"2023-11-30T17:07:16.308378+0000","last_clean":"2023-11-30T17:07:16.308378+0000","last_became_active":"2023-11-30T17:07:15.918757+0000","last_became_peered":"2023-11-30T17:07:15.918757+0000","last_unstale":"2023-11-30T17:07:16.308378+0000","last_undegraded":"2023-11-30T17:07:16.308378+0000","last_fullsized":"2023-11-30T17:07:16.308378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.305107+0000","last_change":"2023-11-30T17:07:16.303563+0000","last_active":"2023-11-30T17:07:16.305107+0000","last_peered":"2023-11-30T17:07:16.305107+0000","last_clean":"2023-11-30T17:07:16.305107+0000","last_became_active":"2023-11-30T17:07:16.303281+0000","last_became_peered":"2023-11-30T17:07:16.303281+0000","last_unstale":"2023-11-30T17:07:16.305107+0000","last_undegraded":"2023-11-30T17:07:16.305107+0000","last_fullsized":"2023-11-30T17:07:16.305107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.311442+0000","last_change":"2023-11-30T17:07:15.912815+0000","last_active":"2023-11-30T17:07:16.311442+0000","last_peered":"2023-11-30T17:07:16.311442+0000","last_clean":"2023-11-30T17:07:16.311442+0000","last_became_active":"2023-11-30T17:07:15.912519+0000","last_became_peered":"2023-11-30T17:07:15.912519+0000","last_unstale":"2023-11-30T17:07:16.311442+0000","last_undegraded":"2023-11-30T17:07:16.311442+0000","last_fullsized":"2023-11-30T17:07:16.311442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.306264+0000","last_change":"2023-11-30T17:07:16.305070+0000","last_active":"2023-11-30T17:07:16.306264+0000","last_peered":"2023-11-30T17:07:16.306264+0000","last_clean":"2023-11-30T17:07:16.306264+0000","last_became_active":"2023-11-30T17:07:16.304769+0000","last_became_peered":"2023-11-30T17:07:16.304769+0000","last_unstale":"2023-11-30T17:07:16.306264+0000","last_undegraded":"2023-11-30T17:07:16.306264+0000","last_fullsized":"2023-11-30T17:07:16.306264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.305362+0000","last_change":"2023-11-30T17:07:15.911789+0000","last_active":"2023-11-30T17:07:16.305362+0000","last_peered":"2023-11-30T17:07:16.305362+0000","last_clean":"2023-11-30T17:07:16.305362+0000","last_became_active":"2023-11-30T17:07:15.911461+0000","last_became_peered":"2023-11-30T17:07:15.911461+0000","last_unstale":"2023-11-30T17:07:16.305362+0000","last_undegraded":"2023-11-30T17:07:16.305362+0000","last_fullsized":"2023-11-30T17:07:16.305362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.320053+0000","last_change":"2023-11-30T17:07:16.316309+0000","last_active":"2023-11-30T17:07:16.320053+0000","last_peered":"2023-11-30T17:07:16.320053+0000","last_clean":"2023-11-30T17:07:16.320053+0000","last_became_active":"2023-11-30T17:07:16.316010+0000","last_became_peered":"2023-11-30T17:07:16.316010+0000","last_unstale":"2023-11-30T17:07:16.320053+0000","last_undegraded":"2023-11-30T17:07:16.320053+0000","last_fullsized":"2023-11-30T17:07:16.320053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.288892+0000","last_change":"2023-11-30T17:07:15.914178+0000","last_active":"2023-11-30T17:07:16.288892+0000","last_peered":"2023-11-30T17:07:16.288892+0000","last_clean":"2023-11-30T17:07:16.288892+0000","last_became_active":"2023-11-30T17:07:15.913297+0000","last_became_peered":"2023-11-30T17:07:15.913297+0000","last_unstale":"2023-11-30T17:07:16.288892+0000","last_undegraded":"2023-11-30T17:07:16.288892+0000","last_fullsized":"2023-11-30T17:07:16.288892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.304041+0000","last_change":"2023-11-30T17:07:16.300572+0000","last_active":"2023-11-30T17:07:16.304041+0000","last_peered":"2023-11-30T17:07:16.304041+0000","last_clean":"2023-11-30T17:07:16.304041+0000","last_became_active":"2023-11-30T17:07:16.300298+0000","last_became_peered":"2023-11-30T17:07:16.300298+0000","last_unstale":"2023-11-30T17:07:16.304041+0000","last_undegraded":"2023-11-30T17:07:16.304041+0000","last_fullsized":"2023-11-30T17:07:16.304041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295495+0000","last_change":"2023-11-30T17:07:15.915272+0000","last_active":"2023-11-30T17:07:16.295495+0000","last_peered":"2023-11-30T17:07:16.295495+0000","last_clean":"2023-11-30T17:07:16.295495+0000","last_became_active":"2023-11-30T17:07:15.914832+0000","last_became_peered":"2023-11-30T17:07:15.914832+0000","last_unstale":"2023-11-30T17:07:16.295495+0000","last_undegraded":"2023-11-30T17:07:16.295495+0000","last_fullsized":"2023-11-30T17:07:16.295495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.313799+0000","last_change":"2023-11-30T17:07:16.311093+0000","last_active":"2023-11-30T17:07:16.313799+0000","last_peered":"2023-11-30T17:07:16.313799+0000","last_clean":"2023-11-30T17:07:16.313799+0000","last_became_active":"2023-11-30T17:07:16.310618+0000","last_became_peered":"2023-11-30T17:07:16.310618+0000","last_unstale":"2023-11-30T17:07:16.313799+0000","last_undegraded":"2023-11-30T17:07:16.313799+0000","last_fullsized":"2023-11-30T17:07:16.313799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.310314+0000","last_change":"2023-11-30T17:07:15.910300+0000","last_active":"2023-11-30T17:07:16.310314+0000","last_peered":"2023-11-30T17:07:16.310314+0000","last_clean":"2023-11-30T17:07:16.310314+0000","last_became_active":"2023-11-30T17:07:15.909476+0000","last_became_peered":"2023-11-30T17:07:15.909476+0000","last_unstale":"2023-11-30T17:07:16.310314+0000","last_undegraded":"2023-11-30T17:07:16.310314+0000","last_fullsized":"2023-11-30T17:07:16.310314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318565+0000","last_change":"2023-11-30T17:07:16.313453+0000","last_active":"2023-11-30T17:07:16.318565+0000","last_peered":"2023-11-30T17:07:16.318565+0000","last_clean":"2023-11-30T17:07:16.318565+0000","last_became_active":"2023-11-30T17:07:16.312874+0000","last_became_peered":"2023-11-30T17:07:16.312874+0000","last_unstale":"2023-11-30T17:07:16.318565+0000","last_undegraded":"2023-11-30T17:07:16.318565+0000","last_fullsized":"2023-11-30T17:07:16.318565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307366+0000","last_change":"2023-11-30T17:07:15.911874+0000","last_active":"2023-11-30T17:07:16.307366+0000","last_peered":"2023-11-30T17:07:16.307366+0000","last_clean":"2023-11-30T17:07:16.307366+0000","last_became_active":"2023-11-30T17:07:15.911404+0000","last_became_peered":"2023-11-30T17:07:15.911404+0000","last_unstale":"2023-11-30T17:07:16.307366+0000","last_undegraded":"2023-11-30T17:07:16.307366+0000","last_fullsized":"2023-11-30T17:07:16.307366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315251+0000","last_change":"2023-11-30T17:07:16.312859+0000","last_active":"2023-11-30T17:07:16.315251+0000","last_peered":"2023-11-30T17:07:16.315251+0000","last_clean":"2023-11-30T17:07:16.315251+0000","last_became_active":"2023-11-30T17:07:16.312514+0000","last_became_peered":"2023-11-30T17:07:16.312514+0000","last_unstale":"2023-11-30T17:07:16.315251+0000","last_undegraded":"2023-11-30T17:07:16.315251+0000","last_fullsized":"2023-11-30T17:07:16.315251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308003+0000","last_change":"2023-11-30T17:07:15.912336+0000","last_active":"2023-11-30T17:07:16.308003+0000","last_peered":"2023-11-30T17:07:16.308003+0000","last_clean":"2023-11-30T17:07:16.308003+0000","last_became_active":"2023-11-30T17:07:15.912069+0000","last_became_peered":"2023-11-30T17:07:15.912069+0000","last_unstale":"2023-11-30T17:07:16.308003+0000","last_undegraded":"2023-11-30T17:07:16.308003+0000","last_fullsized":"2023-11-30T17:07:16.308003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.305757+0000","last_change":"2023-11-30T17:07:16.300210+0000","last_active":"2023-11-30T17:07:16.305757+0000","last_peered":"2023-11-30T17:07:16.305757+0000","last_clean":"2023-11-30T17:07:16.305757+0000","last_became_active":"2023-11-30T17:07:16.298899+0000","last_became_peered":"2023-11-30T17:07:16.298899+0000","last_unstale":"2023-11-30T17:07:16.305757+0000","last_undegraded":"2023-11-30T17:07:16.305757+0000","last_fullsized":"2023-11-30T17:07:16.305757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295980+0000","last_change":"2023-11-30T17:07:15.917879+0000","last_active":"2023-11-30T17:07:16.295980+0000","last_peered":"2023-11-30T17:07:16.295980+0000","last_clean":"2023-11-30T17:07:16.295980+0000","last_became_active":"2023-11-30T17:07:15.917554+0000","last_became_peered":"2023-11-30T17:07:15.917554+0000","last_unstale":"2023-11-30T17:07:16.295980+0000","last_undegraded":"2023-11-30T17:07:16.295980+0000","last_fullsized":"2023-11-30T17:07:16.295980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307516+0000","last_change":"2023-11-30T17:07:16.303927+0000","last_active":"2023-11-30T17:07:16.307516+0000","last_peered":"2023-11-30T17:07:16.307516+0000","last_clean":"2023-11-30T17:07:16.307516+0000","last_became_active":"2023-11-30T17:07:16.303463+0000","last_became_peered":"2023-11-30T17:07:16.303463+0000","last_unstale":"2023-11-30T17:07:16.307516+0000","last_undegraded":"2023-11-30T17:07:16.307516+0000","last_fullsized":"2023-11-30T17:07:16.307516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.303300+0000","last_change":"2023-11-30T17:07:15.913512+0000","last_active":"2023-11-30T17:07:16.303300+0000","last_peered":"2023-11-30T17:07:16.303300+0000","last_clean":"2023-11-30T17:07:16.303300+0000","last_became_active":"2023-11-30T17:07:15.913268+0000","last_became_peered":"2023-11-30T17:07:15.913268+0000","last_unstale":"2023-11-30T17:07:16.303300+0000","last_undegraded":"2023-11-30T17:07:16.303300+0000","last_fullsized":"2023-11-30T17:07:16.303300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312201+0000","last_change":"2023-11-30T17:07:16.308161+0000","last_active":"2023-11-30T17:07:16.312201+0000","last_peered":"2023-11-30T17:07:16.312201+0000","last_clean":"2023-11-30T17:07:16.312201+0000","last_became_active":"2023-11-30T17:07:16.307884+0000","last_became_peered":"2023-11-30T17:07:16.307884+0000","last_unstale":"2023-11-30T17:07:16.312201+0000","last_undegraded":"2023-11-30T17:07:16.312201+0000","last_fullsized":"2023-11-30T17:07:16.312201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.306036+0000","last_change":"2023-11-30T17:07:15.910523+0000","last_active":"2023-11-30T17:07:16.306036+0000","last_peered":"2023-11-30T17:07:16.306036+0000","last_clean":"2023-11-30T17:07:16.306036+0000","last_became_active":"2023-11-30T17:07:15.910216+0000","last_became_peered":"2023-11-30T17:07:15.910216+0000","last_unstale":"2023-11-30T17:07:16.306036+0000","last_undegraded":"2023-11-30T17:07:16.306036+0000","last_fullsized":"2023-11-30T17:07:16.306036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315009+0000","last_change":"2023-11-30T17:07:16.311819+0000","last_active":"2023-11-30T17:07:16.315009+0000","last_peered":"2023-11-30T17:07:16.315009+0000","last_clean":"2023-11-30T17:07:16.315009+0000","last_became_active":"2023-11-30T17:07:16.311446+0000","last_became_peered":"2023-11-30T17:07:16.311446+0000","last_unstale":"2023-11-30T17:07:16.315009+0000","last_undegraded":"2023-11-30T17:07:16.315009+0000","last_fullsized":"2023-11-30T17:07:16.315009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.290739+0000","last_change":"2023-11-30T17:07:15.903463+0000","last_active":"2023-11-30T17:07:16.290739+0000","last_peered":"2023-11-30T17:07:16.290739+0000","last_clean":"2023-11-30T17:07:16.290739+0000","last_became_active":"2023-11-30T17:07:15.903169+0000","last_became_peered":"2023-11-30T17:07:15.903169+0000","last_unstale":"2023-11-30T17:07:16.290739+0000","last_undegraded":"2023-11-30T17:07:16.290739+0000","last_fullsized":"2023-11-30T17:07:16.290739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.304451+0000","last_change":"2023-11-30T17:07:16.301048+0000","last_active":"2023-11-30T17:07:16.304451+0000","last_peered":"2023-11-30T17:07:16.304451+0000","last_clean":"2023-11-30T17:07:16.304451+0000","last_became_active":"2023-11-30T17:07:16.300733+0000","last_became_peered":"2023-11-30T17:07:16.300733+0000","last_unstale":"2023-11-30T17:07:16.304451+0000","last_undegraded":"2023-11-30T17:07:16.304451+0000","last_fullsized":"2023-11-30T17:07:16.304451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.297265+0000","last_change":"2023-11-30T17:07:15.912479+0000","last_active":"2023-11-30T17:07:16.297265+0000","last_peered":"2023-11-30T17:07:16.297265+0000","last_clean":"2023-11-30T17:07:16.297265+0000","last_became_active":"2023-11-30T17:07:15.911715+0000","last_became_peered":"2023-11-30T17:07:15.911715+0000","last_unstale":"2023-11-30T17:07:16.297265+0000","last_undegraded":"2023-11-30T17:07:16.297265+0000","last_fullsized":"2023-11-30T17:07:16.297265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312756+0000","last_change":"2023-11-30T17:07:16.308823+0000","last_active":"2023-11-30T17:07:16.312756+0000","last_peered":"2023-11-30T17:07:16.312756+0000","last_clean":"2023-11-30T17:07:16.312756+0000","last_became_active":"2023-11-30T17:07:16.308607+0000","last_became_peered":"2023-11-30T17:07:16.308607+0000","last_unstale":"2023-11-30T17:07:16.312756+0000","last_undegraded":"2023-11-30T17:07:16.312756+0000","last_fullsized":"2023-11-30T17:07:16.312756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.294468+0000","last_change":"2023-11-30T17:07:15.907967+0000","last_active":"2023-11-30T17:07:16.294468+0000","last_peered":"2023-11-30T17:07:16.294468+0000","last_clean":"2023-11-30T17:07:16.294468+0000","last_became_active":"2023-11-30T17:07:15.907702+0000","last_became_peered":"2023-11-30T17:07:15.907702+0000","last_unstale":"2023-11-30T17:07:16.294468+0000","last_undegraded":"2023-11-30T17:07:16.294468+0000","last_fullsized":"2023-11-30T17:07:16.294468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.285836+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:07:16.285836+0000","last_peered":"2023-11-30T17:07:16.285836+0000","last_clean":"2023-11-30T17:07:16.285836+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:07:16.285836+0000","last_undegraded":"2023-11-30T17:07:16.285836+0000","last_fullsized":"2023-11-30T17:07:16.285836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307514+0000","last_change":"2023-11-30T17:07:15.918902+0000","last_active":"2023-11-30T17:07:16.307514+0000","last_peered":"2023-11-30T17:07:16.307514+0000","last_clean":"2023-11-30T17:07:16.307514+0000","last_became_active":"2023-11-30T17:07:15.918581+0000","last_became_peered":"2023-11-30T17:07:15.918581+0000","last_unstale":"2023-11-30T17:07:16.307514+0000","last_undegraded":"2023-11-30T17:07:16.307514+0000","last_fullsized":"2023-11-30T17:07:16.307514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315758+0000","last_change":"2023-11-30T17:07:16.314704+0000","last_active":"2023-11-30T17:07:16.315758+0000","last_peered":"2023-11-30T17:07:16.315758+0000","last_clean":"2023-11-30T17:07:16.315758+0000","last_became_active":"2023-11-30T17:07:16.314432+0000","last_became_peered":"2023-11-30T17:07:16.314432+0000","last_unstale":"2023-11-30T17:07:16.315758+0000","last_undegraded":"2023-11-30T17:07:16.315758+0000","last_fullsized":"2023-11-30T17:07:16.315758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308686+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:07:16.308686+0000","last_peered":"2023-11-30T17:07:16.308686+0000","last_clean":"2023-11-30T17:07:16.308686+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:07:16.308686+0000","last_undegraded":"2023-11-30T17:07:16.308686+0000","last_fullsized":"2023-11-30T17:07:16.308686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.294139+0000","last_change":"2023-11-30T17:07:15.911883+0000","last_active":"2023-11-30T17:07:16.294139+0000","last_peered":"2023-11-30T17:07:16.294139+0000","last_clean":"2023-11-30T17:07:16.294139+0000","last_became_active":"2023-11-30T17:07:15.911610+0000","last_became_peered":"2023-11-30T17:07:15.911610+0000","last_unstale":"2023-11-30T17:07:16.294139+0000","last_undegraded":"2023-11-30T17:07:16.294139+0000","last_fullsized":"2023-11-30T17:07:16.294139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312407+0000","last_change":"2023-11-30T17:07:16.303472+0000","last_active":"2023-11-30T17:07:16.312407+0000","last_peered":"2023-11-30T17:07:16.312407+0000","last_clean":"2023-11-30T17:07:16.312407+0000","last_became_active":"2023-11-30T17:07:16.302394+0000","last_became_peered":"2023-11-30T17:07:16.302394+0000","last_unstale":"2023-11-30T17:07:16.312407+0000","last_undegraded":"2023-11-30T17:07:16.312407+0000","last_fullsized":"2023-11-30T17:07:16.312407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315795+0000","last_change":"2023-11-30T17:07:16.314725+0000","last_active":"2023-11-30T17:07:16.315795+0000","last_peered":"2023-11-30T17:07:16.315795+0000","last_clean":"2023-11-30T17:07:16.315795+0000","last_became_active":"2023-11-30T17:07:16.314512+0000","last_became_peered":"2023-11-30T17:07:16.314512+0000","last_unstale":"2023-11-30T17:07:16.315795+0000","last_undegraded":"2023-11-30T17:07:16.315795+0000","last_fullsized":"2023-11-30T17:07:16.315795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.292666+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:07:16.292666+0000","last_peered":"2023-11-30T17:07:16.292666+0000","last_clean":"2023-11-30T17:07:16.292666+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:07:16.292666+0000","last_undegraded":"2023-11-30T17:07:16.292666+0000","last_fullsized":"2023-11-30T17:07:16.292666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.285572+0000","last_change":"2023-11-30T17:07:15.913075+0000","last_active":"2023-11-30T17:07:16.285572+0000","last_peered":"2023-11-30T17:07:16.285572+0000","last_clean":"2023-11-30T17:07:16.285572+0000","last_became_active":"2023-11-30T17:07:15.912781+0000","last_became_peered":"2023-11-30T17:07:15.912781+0000","last_unstale":"2023-11-30T17:07:16.285572+0000","last_undegraded":"2023-11-30T17:07:16.285572+0000","last_fullsized":"2023-11-30T17:07:16.285572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307120+0000","last_change":"2023-11-30T17:07:16.300272+0000","last_active":"2023-11-30T17:07:16.307120+0000","last_peered":"2023-11-30T17:07:16.307120+0000","last_clean":"2023-11-30T17:07:16.307120+0000","last_became_active":"2023-11-30T17:07:16.299930+0000","last_became_peered":"2023-11-30T17:07:16.299930+0000","last_unstale":"2023-11-30T17:07:16.307120+0000","last_undegraded":"2023-11-30T17:07:16.307120+0000","last_fullsized":"2023-11-30T17:07:16.307120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.301634+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:07:16.301634+0000","last_peered":"2023-11-30T17:07:16.301634+0000","last_clean":"2023-11-30T17:07:16.301634+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:07:16.301634+0000","last_undegraded":"2023-11-30T17:07:16.301634+0000","last_fullsized":"2023-11-30T17:07:16.301634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.293696+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:07:16.293696+0000","last_peered":"2023-11-30T17:07:16.293696+0000","last_clean":"2023-11-30T17:07:16.293696+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:07:16.293696+0000","last_undegraded":"2023-11-30T17:07:16.293696+0000","last_fullsized":"2023-11-30T17:07:16.293696+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295020+0000","last_change":"2023-11-30T17:07:15.906109+0000","last_active":"2023-11-30T17:07:16.295020+0000","last_peered":"2023-11-30T17:07:16.295020+0000","last_clean":"2023-11-30T17:07:16.295020+0000","last_became_active":"2023-11-30T17:07:15.905789+0000","last_became_peered":"2023-11-30T17:07:15.905789+0000","last_unstale":"2023-11-30T17:07:16.295020+0000","last_undegraded":"2023-11-30T17:07:16.295020+0000","last_fullsized":"2023-11-30T17:07:16.295020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.304020+0000","last_change":"2023-11-30T17:07:16.296058+0000","last_active":"2023-11-30T17:07:16.304020+0000","last_peered":"2023-11-30T17:07:16.304020+0000","last_clean":"2023-11-30T17:07:16.304020+0000","last_became_active":"2023-11-30T17:07:16.295800+0000","last_became_peered":"2023-11-30T17:07:16.295800+0000","last_unstale":"2023-11-30T17:07:16.304020+0000","last_undegraded":"2023-11-30T17:07:16.304020+0000","last_fullsized":"2023-11-30T17:07:16.304020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.294447+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:07:16.294447+0000","last_peered":"2023-11-30T17:07:16.294447+0000","last_clean":"2023-11-30T17:07:16.294447+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:07:16.294447+0000","last_undegraded":"2023-11-30T17:07:16.294447+0000","last_fullsized":"2023-11-30T17:07:16.294447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.289819+0000","last_change":"2023-11-30T17:07:15.908114+0000","last_active":"2023-11-30T17:07:16.289819+0000","last_peered":"2023-11-30T17:07:16.289819+0000","last_clean":"2023-11-30T17:07:16.289819+0000","last_became_active":"2023-11-30T17:07:15.907787+0000","last_became_peered":"2023-11-30T17:07:15.907787+0000","last_unstale":"2023-11-30T17:07:16.289819+0000","last_undegraded":"2023-11-30T17:07:16.289819+0000","last_fullsized":"2023-11-30T17:07:16.289819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295873+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:07:16.295873+0000","last_peered":"2023-11-30T17:07:16.295873+0000","last_clean":"2023-11-30T17:07:16.295873+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:07:16.295873+0000","last_undegraded":"2023-11-30T17:07:16.295873+0000","last_fullsized":"2023-11-30T17:07:16.295873+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.285991+0000","last_change":"2023-11-30T17:07:15.912233+0000","last_active":"2023-11-30T17:07:16.285991+0000","last_peered":"2023-11-30T17:07:16.285991+0000","last_clean":"2023-11-30T17:07:16.285991+0000","last_became_active":"2023-11-30T17:07:15.911944+0000","last_became_peered":"2023-11-30T17:07:15.911944+0000","last_unstale":"2023-11-30T17:07:16.285991+0000","last_undegraded":"2023-11-30T17:07:16.285991+0000","last_fullsized":"2023-11-30T17:07:16.285991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315990+0000","last_change":"2023-11-30T17:07:16.314967+0000","last_active":"2023-11-30T17:07:16.315990+0000","last_peered":"2023-11-30T17:07:16.315990+0000","last_clean":"2023-11-30T17:07:16.315990+0000","last_became_active":"2023-11-30T17:07:16.313860+0000","last_became_peered":"2023-11-30T17:07:16.313860+0000","last_unstale":"2023-11-30T17:07:16.315990+0000","last_undegraded":"2023-11-30T17:07:16.315990+0000","last_fullsized":"2023-11-30T17:07:16.315990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.311367+0000","last_change":"2023-11-30T17:07:15.918489+0000","last_active":"2023-11-30T17:07:16.311367+0000","last_peered":"2023-11-30T17:07:16.311367+0000","last_clean":"2023-11-30T17:07:16.311367+0000","last_became_active":"2023-11-30T17:07:15.918200+0000","last_became_peered":"2023-11-30T17:07:15.918200+0000","last_unstale":"2023-11-30T17:07:16.311367+0000","last_undegraded":"2023-11-30T17:07:16.311367+0000","last_fullsized":"2023-11-30T17:07:16.311367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.286349+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:07:16.286349+0000","last_peered":"2023-11-30T17:07:16.286349+0000","last_clean":"2023-11-30T17:07:16.286349+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:07:16.286349+0000","last_undegraded":"2023-11-30T17:07:16.286349+0000","last_fullsized":"2023-11-30T17:07:16.286349+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308858+0000","last_change":"2023-11-30T17:07:16.307511+0000","last_active":"2023-11-30T17:07:16.308858+0000","last_peered":"2023-11-30T17:07:16.308858+0000","last_clean":"2023-11-30T17:07:16.308858+0000","last_became_active":"2023-11-30T17:07:16.307230+0000","last_became_peered":"2023-11-30T17:07:16.307230+0000","last_unstale":"2023-11-30T17:07:16.308858+0000","last_undegraded":"2023-11-30T17:07:16.308858+0000","last_fullsized":"2023-11-30T17:07:16.308858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.291598+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:07:16.291598+0000","last_peered":"2023-11-30T17:07:16.291598+0000","last_clean":"2023-11-30T17:07:16.291598+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:07:16.291598+0000","last_undegraded":"2023-11-30T17:07:16.291598+0000","last_fullsized":"2023-11-30T17:07:16.291598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.289782+0000","last_change":"2023-11-30T17:07:15.908349+0000","last_active":"2023-11-30T17:07:16.289782+0000","last_peered":"2023-11-30T17:07:16.289782+0000","last_clean":"2023-11-30T17:07:16.289782+0000","last_became_active":"2023-11-30T17:07:15.908063+0000","last_became_peered":"2023-11-30T17:07:15.908063+0000","last_unstale":"2023-11-30T17:07:16.289782+0000","last_undegraded":"2023-11-30T17:07:16.289782+0000","last_fullsized":"2023-11-30T17:07:16.289782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315272+0000","last_change":"2023-11-30T17:07:16.314378+0000","last_active":"2023-11-30T17:07:16.315272+0000","last_peered":"2023-11-30T17:07:16.315272+0000","last_clean":"2023-11-30T17:07:16.315272+0000","last_became_active":"2023-11-30T17:07:16.314073+0000","last_became_peered":"2023-11-30T17:07:16.314073+0000","last_unstale":"2023-11-30T17:07:16.315272+0000","last_undegraded":"2023-11-30T17:07:16.315272+0000","last_fullsized":"2023-11-30T17:07:16.315272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.309505+0000","last_change":"2023-11-30T17:07:16.304420+0000","last_active":"2023-11-30T17:07:16.309505+0000","last_peered":"2023-11-30T17:07:16.309505+0000","last_clean":"2023-11-30T17:07:16.309505+0000","last_became_active":"2023-11-30T17:07:16.304065+0000","last_became_peered":"2023-11-30T17:07:16.304065+0000","last_unstale":"2023-11-30T17:07:16.309505+0000","last_undegraded":"2023-11-30T17:07:16.309505+0000","last_fullsized":"2023-11-30T17:07:16.309505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.291238+0000","last_change":"2023-11-30T17:07:15.905313+0000","last_active":"2023-11-30T17:07:16.291238+0000","last_peered":"2023-11-30T17:07:16.291238+0000","last_clean":"2023-11-30T17:07:16.291238+0000","last_became_active":"2023-11-30T17:07:15.905016+0000","last_became_peered":"2023-11-30T17:07:15.905016+0000","last_unstale":"2023-11-30T17:07:16.291238+0000","last_undegraded":"2023-11-30T17:07:16.291238+0000","last_fullsized":"2023-11-30T17:07:16.291238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312205+0000","last_change":"2023-11-30T17:07:16.308479+0000","last_active":"2023-11-30T17:07:16.312205+0000","last_peered":"2023-11-30T17:07:16.312205+0000","last_clean":"2023-11-30T17:07:16.312205+0000","last_became_active":"2023-11-30T17:07:16.307732+0000","last_became_peered":"2023-11-30T17:07:16.307732+0000","last_unstale":"2023-11-30T17:07:16.312205+0000","last_undegraded":"2023-11-30T17:07:16.312205+0000","last_fullsized":"2023-11-30T17:07:16.312205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.303391+0000","last_change":"2023-11-30T17:07:15.907619+0000","last_active":"2023-11-30T17:07:16.303391+0000","last_peered":"2023-11-30T17:07:16.303391+0000","last_clean":"2023-11-30T17:07:16.303391+0000","last_became_active":"2023-11-30T17:07:15.907322+0000","last_became_peered":"2023-11-30T17:07:15.907322+0000","last_unstale":"2023-11-30T17:07:16.303391+0000","last_undegraded":"2023-11-30T17:07:16.303391+0000","last_fullsized":"2023-11-30T17:07:16.303391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312237+0000","last_change":"2023-11-30T17:07:16.307668+0000","last_active":"2023-11-30T17:07:16.312237+0000","last_peered":"2023-11-30T17:07:16.312237+0000","last_clean":"2023-11-30T17:07:16.312237+0000","last_became_active":"2023-11-30T17:07:16.306226+0000","last_became_peered":"2023-11-30T17:07:16.306226+0000","last_unstale":"2023-11-30T17:07:16.312237+0000","last_undegraded":"2023-11-30T17:07:16.312237+0000","last_fullsized":"2023-11-30T17:07:16.312237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315804+0000","last_change":"2023-11-30T17:07:15.910485+0000","last_active":"2023-11-30T17:07:16.315804+0000","last_peered":"2023-11-30T17:07:16.315804+0000","last_clean":"2023-11-30T17:07:16.315804+0000","last_became_active":"2023-11-30T17:07:15.909426+0000","last_became_peered":"2023-11-30T17:07:15.909426+0000","last_unstale":"2023-11-30T17:07:16.315804+0000","last_undegraded":"2023-11-30T17:07:16.315804+0000","last_fullsized":"2023-11-30T17:07:16.315804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.314207+0000","last_change":"2023-11-30T17:07:16.308666+0000","last_active":"2023-11-30T17:07:16.314207+0000","last_peered":"2023-11-30T17:07:16.314207+0000","last_clean":"2023-11-30T17:07:16.314207+0000","last_became_active":"2023-11-30T17:07:16.308353+0000","last_became_peered":"2023-11-30T17:07:16.308353+0000","last_unstale":"2023-11-30T17:07:16.314207+0000","last_undegraded":"2023-11-30T17:07:16.314207+0000","last_fullsized":"2023-11-30T17:07:16.314207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.305835+0000","last_change":"2023-11-30T17:07:15.899895+0000","last_active":"2023-11-30T17:07:16.305835+0000","last_peered":"2023-11-30T17:07:16.305835+0000","last_clean":"2023-11-30T17:07:16.305835+0000","last_became_active":"2023-11-30T17:07:15.899595+0000","last_became_peered":"2023-11-30T17:07:15.899595+0000","last_unstale":"2023-11-30T17:07:16.305835+0000","last_undegraded":"2023-11-30T17:07:16.305835+0000","last_fullsized":"2023-11-30T17:07:16.305835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.304474+0000","last_change":"2023-11-30T17:07:16.301694+0000","last_active":"2023-11-30T17:07:16.304474+0000","last_peered":"2023-11-30T17:07:16.304474+0000","last_clean":"2023-11-30T17:07:16.304474+0000","last_became_active":"2023-11-30T17:07:16.301392+0000","last_became_peered":"2023-11-30T17:07:16.301392+0000","last_unstale":"2023-11-30T17:07:16.304474+0000","last_undegraded":"2023-11-30T17:07:16.304474+0000","last_fullsized":"2023-11-30T17:07:16.304474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.309919+0000","last_change":"2023-11-30T17:07:15.905807+0000","last_active":"2023-11-30T17:07:16.309919+0000","last_peered":"2023-11-30T17:07:16.309919+0000","last_clean":"2023-11-30T17:07:16.309919+0000","last_became_active":"2023-11-30T17:07:15.905509+0000","last_became_peered":"2023-11-30T17:07:15.905509+0000","last_unstale":"2023-11-30T17:07:16.309919+0000","last_undegraded":"2023-11-30T17:07:16.309919+0000","last_fullsized":"2023-11-30T17:07:16.309919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.310536+0000","last_change":"2023-11-30T17:07:16.301265+0000","last_active":"2023-11-30T17:07:16.310536+0000","last_peered":"2023-11-30T17:07:16.310536+0000","last_clean":"2023-11-30T17:07:16.310536+0000","last_became_active":"2023-11-30T17:07:16.300966+0000","last_became_peered":"2023-11-30T17:07:16.300966+0000","last_unstale":"2023-11-30T17:07:16.310536+0000","last_undegraded":"2023-11-30T17:07:16.310536+0000","last_fullsized":"2023-11-30T17:07:16.310536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.291444+0000","last_change":"2023-11-30T17:07:15.907348+0000","last_active":"2023-11-30T17:07:16.291444+0000","last_peered":"2023-11-30T17:07:16.291444+0000","last_clean":"2023-11-30T17:07:16.291444+0000","last_became_active":"2023-11-30T17:07:15.907034+0000","last_became_peered":"2023-11-30T17:07:15.907034+0000","last_unstale":"2023-11-30T17:07:16.291444+0000","last_undegraded":"2023-11-30T17:07:16.291444+0000","last_fullsized":"2023-11-30T17:07:16.291444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.310519+0000","last_change":"2023-11-30T17:07:16.302759+0000","last_active":"2023-11-30T17:07:16.310519+0000","last_peered":"2023-11-30T17:07:16.310519+0000","last_clean":"2023-11-30T17:07:16.310519+0000","last_became_active":"2023-11-30T17:07:16.302501+0000","last_became_peered":"2023-11-30T17:07:16.302501+0000","last_unstale":"2023-11-30T17:07:16.310519+0000","last_undegraded":"2023-11-30T17:07:16.310519+0000","last_fullsized":"2023-11-30T17:07:16.310519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.292697+0000","last_change":"2023-11-30T17:07:15.915794+0000","last_active":"2023-11-30T17:07:16.292697+0000","last_peered":"2023-11-30T17:07:16.292697+0000","last_clean":"2023-11-30T17:07:16.292697+0000","last_became_active":"2023-11-30T17:07:15.915469+0000","last_became_peered":"2023-11-30T17:07:15.915469+0000","last_unstale":"2023-11-30T17:07:16.292697+0000","last_undegraded":"2023-11-30T17:07:16.292697+0000","last_fullsized":"2023-11-30T17:07:16.292697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.320036+0000","last_change":"2023-11-30T17:07:16.316288+0000","last_active":"2023-11-30T17:07:16.320036+0000","last_peered":"2023-11-30T17:07:16.320036+0000","last_clean":"2023-11-30T17:07:16.320036+0000","last_became_active":"2023-11-30T17:07:16.315974+0000","last_became_peered":"2023-11-30T17:07:16.315974+0000","last_unstale":"2023-11-30T17:07:16.320036+0000","last_undegraded":"2023-11-30T17:07:16.320036+0000","last_fullsized":"2023-11-30T17:07:16.320036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308587+0000","last_change":"2023-11-30T17:07:15.918830+0000","last_active":"2023-11-30T17:07:16.308587+0000","last_peered":"2023-11-30T17:07:16.308587+0000","last_clean":"2023-11-30T17:07:16.308587+0000","last_became_active":"2023-11-30T17:07:15.918553+0000","last_became_peered":"2023-11-30T17:07:15.918553+0000","last_unstale":"2023-11-30T17:07:16.308587+0000","last_undegraded":"2023-11-30T17:07:16.308587+0000","last_fullsized":"2023-11-30T17:07:16.308587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312385+0000","last_change":"2023-11-30T17:07:16.300603+0000","last_active":"2023-11-30T17:07:16.312385+0000","last_peered":"2023-11-30T17:07:16.312385+0000","last_clean":"2023-11-30T17:07:16.312385+0000","last_became_active":"2023-11-30T17:07:16.297982+0000","last_became_peered":"2023-11-30T17:07:16.297982+0000","last_unstale":"2023-11-30T17:07:16.312385+0000","last_undegraded":"2023-11-30T17:07:16.312385+0000","last_fullsized":"2023-11-30T17:07:16.312385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.291351+0000","last_change":"2023-11-30T17:07:15.905698+0000","last_active":"2023-11-30T17:07:16.291351+0000","last_peered":"2023-11-30T17:07:16.291351+0000","last_clean":"2023-11-30T17:07:16.291351+0000","last_became_active":"2023-11-30T17:07:15.905364+0000","last_became_peered":"2023-11-30T17:07:15.905364+0000","last_unstale":"2023-11-30T17:07:16.291351+0000","last_undegraded":"2023-11-30T17:07:16.291351+0000","last_fullsized":"2023-11-30T17:07:16.291351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.314168+0000","last_change":"2023-11-30T17:07:16.310762+0000","last_active":"2023-11-30T17:07:16.314168+0000","last_peered":"2023-11-30T17:07:16.314168+0000","last_clean":"2023-11-30T17:07:16.314168+0000","last_became_active":"2023-11-30T17:07:16.310459+0000","last_became_peered":"2023-11-30T17:07:16.310459+0000","last_unstale":"2023-11-30T17:07:16.314168+0000","last_undegraded":"2023-11-30T17:07:16.314168+0000","last_fullsized":"2023-11-30T17:07:16.314168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.296049+0000","last_change":"2023-11-30T17:07:15.905922+0000","last_active":"2023-11-30T17:07:16.296049+0000","last_peered":"2023-11-30T17:07:16.296049+0000","last_clean":"2023-11-30T17:07:16.296049+0000","last_became_active":"2023-11-30T17:07:15.905607+0000","last_became_peered":"2023-11-30T17:07:15.905607+0000","last_unstale":"2023-11-30T17:07:16.296049+0000","last_undegraded":"2023-11-30T17:07:16.296049+0000","last_fullsized":"2023-11-30T17:07:16.296049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.314769+0000","last_change":"2023-11-30T17:07:16.310200+0000","last_active":"2023-11-30T17:07:16.314769+0000","last_peered":"2023-11-30T17:07:16.314769+0000","last_clean":"2023-11-30T17:07:16.314769+0000","last_became_active":"2023-11-30T17:07:16.309645+0000","last_became_peered":"2023-11-30T17:07:16.309645+0000","last_unstale":"2023-11-30T17:07:16.314769+0000","last_undegraded":"2023-11-30T17:07:16.314769+0000","last_fullsized":"2023-11-30T17:07:16.314769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.285637+0000","last_change":"2023-11-30T17:07:15.913510+0000","last_active":"2023-11-30T17:07:16.285637+0000","last_peered":"2023-11-30T17:07:16.285637+0000","last_clean":"2023-11-30T17:07:16.285637+0000","last_became_active":"2023-11-30T17:07:15.913195+0000","last_became_peered":"2023-11-30T17:07:15.913195+0000","last_unstale":"2023-11-30T17:07:16.285637+0000","last_undegraded":"2023-11-30T17:07:16.285637+0000","last_fullsized":"2023-11-30T17:07:16.285637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307638+0000","last_change":"2023-11-30T17:07:16.305749+0000","last_active":"2023-11-30T17:07:16.307638+0000","last_peered":"2023-11-30T17:07:16.307638+0000","last_clean":"2023-11-30T17:07:16.307638+0000","last_became_active":"2023-11-30T17:07:16.305460+0000","last_became_peered":"2023-11-30T17:07:16.305460+0000","last_unstale":"2023-11-30T17:07:16.307638+0000","last_undegraded":"2023-11-30T17:07:16.307638+0000","last_fullsized":"2023-11-30T17:07:16.307638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.291660+0000","last_change":"2023-11-30T17:07:15.915366+0000","last_active":"2023-11-30T17:07:16.291660+0000","last_peered":"2023-11-30T17:07:16.291660+0000","last_clean":"2023-11-30T17:07:16.291660+0000","last_became_active":"2023-11-30T17:07:15.915099+0000","last_became_peered":"2023-11-30T17:07:15.915099+0000","last_unstale":"2023-11-30T17:07:16.291660+0000","last_undegraded":"2023-11-30T17:07:16.291660+0000","last_fullsized":"2023-11-30T17:07:16.291660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.303911+0000","last_change":"2023-11-30T17:07:16.300223+0000","last_active":"2023-11-30T17:07:16.303911+0000","last_peered":"2023-11-30T17:07:16.303911+0000","last_clean":"2023-11-30T17:07:16.303911+0000","last_became_active":"2023-11-30T17:07:16.299885+0000","last_became_peered":"2023-11-30T17:07:16.299885+0000","last_unstale":"2023-11-30T17:07:16.303911+0000","last_undegraded":"2023-11-30T17:07:16.303911+0000","last_fullsized":"2023-11-30T17:07:16.303911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.298199+0000","last_change":"2023-11-30T17:07:15.912712+0000","last_active":"2023-11-30T17:07:16.298199+0000","last_peered":"2023-11-30T17:07:16.298199+0000","last_clean":"2023-11-30T17:07:16.298199+0000","last_became_active":"2023-11-30T17:07:15.912259+0000","last_became_peered":"2023-11-30T17:07:15.912259+0000","last_unstale":"2023-11-30T17:07:16.298199+0000","last_undegraded":"2023-11-30T17:07:16.298199+0000","last_fullsized":"2023-11-30T17:07:16.298199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.313787+0000","last_change":"2023-11-30T17:07:16.309299+0000","last_active":"2023-11-30T17:07:16.313787+0000","last_peered":"2023-11-30T17:07:16.313787+0000","last_clean":"2023-11-30T17:07:16.313787+0000","last_became_active":"2023-11-30T17:07:16.308844+0000","last_became_peered":"2023-11-30T17:07:16.308844+0000","last_unstale":"2023-11-30T17:07:16.313787+0000","last_undegraded":"2023-11-30T17:07:16.313787+0000","last_fullsized":"2023-11-30T17:07:16.313787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.298030+0000","last_change":"2023-11-30T17:07:15.920996+0000","last_active":"2023-11-30T17:07:16.298030+0000","last_peered":"2023-11-30T17:07:16.298030+0000","last_clean":"2023-11-30T17:07:16.298030+0000","last_became_active":"2023-11-30T17:07:15.920782+0000","last_became_peered":"2023-11-30T17:07:15.920782+0000","last_unstale":"2023-11-30T17:07:16.298030+0000","last_undegraded":"2023-11-30T17:07:16.298030+0000","last_fullsized":"2023-11-30T17:07:16.298030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307613+0000","last_change":"2023-11-30T17:07:16.304597+0000","last_active":"2023-11-30T17:07:16.307613+0000","last_peered":"2023-11-30T17:07:16.307613+0000","last_clean":"2023-11-30T17:07:16.307613+0000","last_became_active":"2023-11-30T17:07:16.304251+0000","last_became_peered":"2023-11-30T17:07:16.304251+0000","last_unstale":"2023-11-30T17:07:16.307613+0000","last_undegraded":"2023-11-30T17:07:16.307613+0000","last_fullsized":"2023-11-30T17:07:16.307613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.297402+0000","last_change":"2023-11-30T17:07:15.913299+0000","last_active":"2023-11-30T17:07:16.297402+0000","last_peered":"2023-11-30T17:07:16.297402+0000","last_clean":"2023-11-30T17:07:16.297402+0000","last_became_active":"2023-11-30T17:07:15.912978+0000","last_became_peered":"2023-11-30T17:07:15.912978+0000","last_unstale":"2023-11-30T17:07:16.297402+0000","last_undegraded":"2023-11-30T17:07:16.297402+0000","last_fullsized":"2023-11-30T17:07:16.297402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315291+0000","last_change":"2023-11-30T17:07:16.311213+0000","last_active":"2023-11-30T17:07:16.315291+0000","last_peered":"2023-11-30T17:07:16.315291+0000","last_clean":"2023-11-30T17:07:16.315291+0000","last_became_active":"2023-11-30T17:07:16.309590+0000","last_became_peered":"2023-11-30T17:07:16.309590+0000","last_unstale":"2023-11-30T17:07:16.315291+0000","last_undegraded":"2023-11-30T17:07:16.315291+0000","last_fullsized":"2023-11-30T17:07:16.315291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308744+0000","last_change":"2023-11-30T17:07:15.917988+0000","last_active":"2023-11-30T17:07:16.308744+0000","last_peered":"2023-11-30T17:07:16.308744+0000","last_clean":"2023-11-30T17:07:16.308744+0000","last_became_active":"2023-11-30T17:07:15.917715+0000","last_became_peered":"2023-11-30T17:07:15.917715+0000","last_unstale":"2023-11-30T17:07:16.308744+0000","last_undegraded":"2023-11-30T17:07:16.308744+0000","last_fullsized":"2023-11-30T17:07:16.308744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.309259+0000","last_change":"2023-11-30T17:07:16.305167+0000","last_active":"2023-11-30T17:07:16.309259+0000","last_peered":"2023-11-30T17:07:16.309259+0000","last_clean":"2023-11-30T17:07:16.309259+0000","last_became_active":"2023-11-30T17:07:16.304366+0000","last_became_peered":"2023-11-30T17:07:16.304366+0000","last_unstale":"2023-11-30T17:07:16.309259+0000","last_undegraded":"2023-11-30T17:07:16.309259+0000","last_fullsized":"2023-11-30T17:07:16.309259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.309634+0000","last_change":"2023-11-30T17:07:15.913349+0000","last_active":"2023-11-30T17:07:16.309634+0000","last_peered":"2023-11-30T17:07:16.309634+0000","last_clean":"2023-11-30T17:07:16.309634+0000","last_became_active":"2023-11-30T17:07:15.912819+0000","last_became_peered":"2023-11-30T17:07:15.912819+0000","last_unstale":"2023-11-30T17:07:16.309634+0000","last_undegraded":"2023-11-30T17:07:16.309634+0000","last_fullsized":"2023-11-30T17:07:16.309634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312387+0000","last_change":"2023-11-30T17:07:16.307878+0000","last_active":"2023-11-30T17:07:16.312387+0000","last_peered":"2023-11-30T17:07:16.312387+0000","last_clean":"2023-11-30T17:07:16.312387+0000","last_became_active":"2023-11-30T17:07:16.307596+0000","last_became_peered":"2023-11-30T17:07:16.307596+0000","last_unstale":"2023-11-30T17:07:16.312387+0000","last_undegraded":"2023-11-30T17:07:16.312387+0000","last_fullsized":"2023-11-30T17:07:16.312387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.289290+0000","last_change":"2023-11-30T17:07:15.905418+0000","last_active":"2023-11-30T17:07:16.289290+0000","last_peered":"2023-11-30T17:07:16.289290+0000","last_clean":"2023-11-30T17:07:16.289290+0000","last_became_active":"2023-11-30T17:07:15.905118+0000","last_became_peered":"2023-11-30T17:07:15.905118+0000","last_unstale":"2023-11-30T17:07:16.289290+0000","last_undegraded":"2023-11-30T17:07:16.289290+0000","last_fullsized":"2023-11-30T17:07:16.289290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295717+0000","last_change":"2023-11-30T17:07:16.294026+0000","last_active":"2023-11-30T17:07:16.295717+0000","last_peered":"2023-11-30T17:07:16.295717+0000","last_clean":"2023-11-30T17:07:16.295717+0000","last_became_active":"2023-11-30T17:07:16.293758+0000","last_became_peered":"2023-11-30T17:07:16.293758+0000","last_unstale":"2023-11-30T17:07:16.295717+0000","last_undegraded":"2023-11-30T17:07:16.295717+0000","last_fullsized":"2023-11-30T17:07:16.295717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.310234+0000","last_change":"2023-11-30T17:07:15.914406+0000","last_active":"2023-11-30T17:07:16.310234+0000","last_peered":"2023-11-30T17:07:16.310234+0000","last_clean":"2023-11-30T17:07:16.310234+0000","last_became_active":"2023-11-30T17:07:15.914121+0000","last_became_peered":"2023-11-30T17:07:15.914121+0000","last_unstale":"2023-11-30T17:07:16.310234+0000","last_undegraded":"2023-11-30T17:07:16.310234+0000","last_fullsized":"2023-11-30T17:07:16.310234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307697+0000","last_change":"2023-11-30T17:07:16.306238+0000","last_active":"2023-11-30T17:07:16.307697+0000","last_peered":"2023-11-30T17:07:16.307697+0000","last_clean":"2023-11-30T17:07:16.307697+0000","last_became_active":"2023-11-30T17:07:16.305963+0000","last_became_peered":"2023-11-30T17:07:16.305963+0000","last_unstale":"2023-11-30T17:07:16.307697+0000","last_undegraded":"2023-11-30T17:07:16.307697+0000","last_fullsized":"2023-11-30T17:07:16.307697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.293985+0000","last_change":"2023-11-30T17:07:15.909372+0000","last_active":"2023-11-30T17:07:16.293985+0000","last_peered":"2023-11-30T17:07:16.293985+0000","last_clean":"2023-11-30T17:07:16.293985+0000","last_became_active":"2023-11-30T17:07:15.909092+0000","last_became_peered":"2023-11-30T17:07:15.909092+0000","last_unstale":"2023-11-30T17:07:16.293985+0000","last_undegraded":"2023-11-30T17:07:16.293985+0000","last_fullsized":"2023-11-30T17:07:16.293985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315497+0000","last_change":"2023-11-30T17:07:16.309056+0000","last_active":"2023-11-30T17:07:16.315497+0000","last_peered":"2023-11-30T17:07:16.315497+0000","last_clean":"2023-11-30T17:07:16.315497+0000","last_became_active":"2023-11-30T17:07:16.308728+0000","last_became_peered":"2023-11-30T17:07:16.308728+0000","last_unstale":"2023-11-30T17:07:16.315497+0000","last_undegraded":"2023-11-30T17:07:16.315497+0000","last_fullsized":"2023-11-30T17:07:16.315497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.306826+0000","last_change":"2023-11-30T17:07:15.914123+0000","last_active":"2023-11-30T17:07:16.306826+0000","last_peered":"2023-11-30T17:07:16.306826+0000","last_clean":"2023-11-30T17:07:16.306826+0000","last_became_active":"2023-11-30T17:07:15.913855+0000","last_became_peered":"2023-11-30T17:07:15.913855+0000","last_unstale":"2023-11-30T17:07:16.306826+0000","last_undegraded":"2023-11-30T17:07:16.306826+0000","last_fullsized":"2023-11-30T17:07:16.306826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.313763+0000","last_change":"2023-11-30T17:07:16.309110+0000","last_active":"2023-11-30T17:07:16.313763+0000","last_peered":"2023-11-30T17:07:16.313763+0000","last_clean":"2023-11-30T17:07:16.313763+0000","last_became_active":"2023-11-30T17:07:16.308500+0000","last_became_peered":"2023-11-30T17:07:16.308500+0000","last_unstale":"2023-11-30T17:07:16.313763+0000","last_undegraded":"2023-11-30T17:07:16.313763+0000","last_fullsized":"2023-11-30T17:07:16.313763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.313277+0000","last_change":"2023-11-30T17:07:15.909703+0000","last_active":"2023-11-30T17:07:16.313277+0000","last_peered":"2023-11-30T17:07:16.313277+0000","last_clean":"2023-11-30T17:07:16.313277+0000","last_became_active":"2023-11-30T17:07:15.909387+0000","last_became_peered":"2023-11-30T17:07:15.909387+0000","last_unstale":"2023-11-30T17:07:16.313277+0000","last_undegraded":"2023-11-30T17:07:16.313277+0000","last_fullsized":"2023-11-30T17:07:16.313277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318600+0000","last_change":"2023-11-30T17:07:16.314404+0000","last_active":"2023-11-30T17:07:16.318600+0000","last_peered":"2023-11-30T17:07:16.318600+0000","last_clean":"2023-11-30T17:07:16.318600+0000","last_became_active":"2023-11-30T17:07:16.314144+0000","last_became_peered":"2023-11-30T17:07:16.314144+0000","last_unstale":"2023-11-30T17:07:16.318600+0000","last_undegraded":"2023-11-30T17:07:16.318600+0000","last_fullsized":"2023-11-30T17:07:16.318600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.285577+0000","last_change":"2023-11-30T17:07:15.907074+0000","last_active":"2023-11-30T17:07:16.285577+0000","last_peered":"2023-11-30T17:07:16.285577+0000","last_clean":"2023-11-30T17:07:16.285577+0000","last_became_active":"2023-11-30T17:07:15.906537+0000","last_became_peered":"2023-11-30T17:07:15.906537+0000","last_unstale":"2023-11-30T17:07:16.285577+0000","last_undegraded":"2023-11-30T17:07:16.285577+0000","last_fullsized":"2023-11-30T17:07:16.285577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308169+0000","last_change":"2023-11-30T17:07:16.304623+0000","last_active":"2023-11-30T17:07:16.308169+0000","last_peered":"2023-11-30T17:07:16.308169+0000","last_clean":"2023-11-30T17:07:16.308169+0000","last_became_active":"2023-11-30T17:07:16.303986+0000","last_became_peered":"2023-11-30T17:07:16.303986+0000","last_unstale":"2023-11-30T17:07:16.308169+0000","last_undegraded":"2023-11-30T17:07:16.308169+0000","last_fullsized":"2023-11-30T17:07:16.308169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.288987+0000","last_change":"2023-11-30T17:07:15.905081+0000","last_active":"2023-11-30T17:07:16.288987+0000","last_peered":"2023-11-30T17:07:16.288987+0000","last_clean":"2023-11-30T17:07:16.288987+0000","last_became_active":"2023-11-30T17:07:15.903780+0000","last_became_peered":"2023-11-30T17:07:15.903780+0000","last_unstale":"2023-11-30T17:07:16.288987+0000","last_undegraded":"2023-11-30T17:07:16.288987+0000","last_fullsized":"2023-11-30T17:07:16.288987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.301942+0000","last_change":"2023-11-30T17:07:16.300473+0000","last_active":"2023-11-30T17:07:16.301942+0000","last_peered":"2023-11-30T17:07:16.301942+0000","last_clean":"2023-11-30T17:07:16.301942+0000","last_became_active":"2023-11-30T17:07:16.300201+0000","last_became_peered":"2023-11-30T17:07:16.300201+0000","last_unstale":"2023-11-30T17:07:16.301942+0000","last_undegraded":"2023-11-30T17:07:16.301942+0000","last_fullsized":"2023-11-30T17:07:16.301942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.306129+0000","last_change":"2023-11-30T17:07:15.903443+0000","last_active":"2023-11-30T17:07:16.306129+0000","last_peered":"2023-11-30T17:07:16.306129+0000","last_clean":"2023-11-30T17:07:16.306129+0000","last_became_active":"2023-11-30T17:07:15.902100+0000","last_became_peered":"2023-11-30T17:07:15.902100+0000","last_unstale":"2023-11-30T17:07:16.306129+0000","last_undegraded":"2023-11-30T17:07:16.306129+0000","last_fullsized":"2023-11-30T17:07:16.306129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.311052+0000","last_change":"2023-11-30T17:07:16.308777+0000","last_active":"2023-11-30T17:07:16.311052+0000","last_peered":"2023-11-30T17:07:16.311052+0000","last_clean":"2023-11-30T17:07:16.311052+0000","last_became_active":"2023-11-30T17:07:16.308488+0000","last_became_peered":"2023-11-30T17:07:16.308488+0000","last_unstale":"2023-11-30T17:07:16.311052+0000","last_undegraded":"2023-11-30T17:07:16.311052+0000","last_fullsized":"2023-11-30T17:07:16.311052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318584+0000","last_change":"2023-11-30T17:07:15.909022+0000","last_active":"2023-11-30T17:07:16.318584+0000","last_peered":"2023-11-30T17:07:16.318584+0000","last_clean":"2023-11-30T17:07:16.318584+0000","last_became_active":"2023-11-30T17:07:15.908674+0000","last_became_peered":"2023-11-30T17:07:15.908674+0000","last_unstale":"2023-11-30T17:07:16.318584+0000","last_undegraded":"2023-11-30T17:07:16.318584+0000","last_fullsized":"2023-11-30T17:07:16.318584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318514+0000","last_change":"2023-11-30T17:07:16.313527+0000","last_active":"2023-11-30T17:07:16.318514+0000","last_peered":"2023-11-30T17:07:16.318514+0000","last_clean":"2023-11-30T17:07:16.318514+0000","last_became_active":"2023-11-30T17:07:16.313199+0000","last_became_peered":"2023-11-30T17:07:16.313199+0000","last_unstale":"2023-11-30T17:07:16.318514+0000","last_undegraded":"2023-11-30T17:07:16.318514+0000","last_fullsized":"2023-11-30T17:07:16.318514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.288932+0000","last_change":"2023-11-30T17:07:15.914420+0000","last_active":"2023-11-30T17:07:16.288932+0000","last_peered":"2023-11-30T17:07:16.288932+0000","last_clean":"2023-11-30T17:07:16.288932+0000","last_became_active":"2023-11-30T17:07:15.914142+0000","last_became_peered":"2023-11-30T17:07:15.914142+0000","last_unstale":"2023-11-30T17:07:16.288932+0000","last_undegraded":"2023-11-30T17:07:16.288932+0000","last_fullsized":"2023-11-30T17:07:16.288932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308304+0000","last_change":"2023-11-30T17:07:16.305961+0000","last_active":"2023-11-30T17:07:16.308304+0000","last_peered":"2023-11-30T17:07:16.308304+0000","last_clean":"2023-11-30T17:07:16.308304+0000","last_became_active":"2023-11-30T17:07:16.305363+0000","last_became_peered":"2023-11-30T17:07:16.305363+0000","last_unstale":"2023-11-30T17:07:16.308304+0000","last_undegraded":"2023-11-30T17:07:16.308304+0000","last_fullsized":"2023-11-30T17:07:16.308304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.291553+0000","last_change":"2023-11-30T17:07:15.911255+0000","last_active":"2023-11-30T17:07:16.291553+0000","last_peered":"2023-11-30T17:07:16.291553+0000","last_clean":"2023-11-30T17:07:16.291553+0000","last_became_active":"2023-11-30T17:07:15.910945+0000","last_became_peered":"2023-11-30T17:07:15.910945+0000","last_unstale":"2023-11-30T17:07:16.291553+0000","last_undegraded":"2023-11-30T17:07:16.291553+0000","last_fullsized":"2023-11-30T17:07:16.291553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.314860+0000","last_change":"2023-11-30T17:07:16.310924+0000","last_active":"2023-11-30T17:07:16.314860+0000","last_peered":"2023-11-30T17:07:16.314860+0000","last_clean":"2023-11-30T17:07:16.314860+0000","last_became_active":"2023-11-30T17:07:16.310631+0000","last_became_peered":"2023-11-30T17:07:16.310631+0000","last_unstale":"2023-11-30T17:07:16.314860+0000","last_undegraded":"2023-11-30T17:07:16.314860+0000","last_fullsized":"2023-11-30T17:07:16.314860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.297213+0000","last_change":"2023-11-30T17:07:15.917972+0000","last_active":"2023-11-30T17:07:16.297213+0000","last_peered":"2023-11-30T17:07:16.297213+0000","last_clean":"2023-11-30T17:07:16.297213+0000","last_became_active":"2023-11-30T17:07:15.917546+0000","last_became_peered":"2023-11-30T17:07:15.917546+0000","last_unstale":"2023-11-30T17:07:16.297213+0000","last_undegraded":"2023-11-30T17:07:16.297213+0000","last_fullsized":"2023-11-30T17:07:16.297213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.311505+0000","last_change":"2023-11-30T17:07:16.309537+0000","last_active":"2023-11-30T17:07:16.311505+0000","last_peered":"2023-11-30T17:07:16.311505+0000","last_clean":"2023-11-30T17:07:16.311505+0000","last_became_active":"2023-11-30T17:07:16.309220+0000","last_became_peered":"2023-11-30T17:07:16.309220+0000","last_unstale":"2023-11-30T17:07:16.311505+0000","last_undegraded":"2023-11-30T17:07:16.311505+0000","last_fullsized":"2023-11-30T17:07:16.311505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.294800+0000","last_change":"2023-11-30T17:07:15.913708+0000","last_active":"2023-11-30T17:07:16.294800+0000","last_peered":"2023-11-30T17:07:16.294800+0000","last_clean":"2023-11-30T17:07:16.294800+0000","last_became_active":"2023-11-30T17:07:15.913418+0000","last_became_peered":"2023-11-30T17:07:15.913418+0000","last_unstale":"2023-11-30T17:07:16.294800+0000","last_undegraded":"2023-11-30T17:07:16.294800+0000","last_fullsized":"2023-11-30T17:07:16.294800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318618+0000","last_change":"2023-11-30T17:07:16.314589+0000","last_active":"2023-11-30T17:07:16.318618+0000","last_peered":"2023-11-30T17:07:16.318618+0000","last_clean":"2023-11-30T17:07:16.318618+0000","last_became_active":"2023-11-30T17:07:16.313770+0000","last_became_peered":"2023-11-30T17:07:16.313770+0000","last_unstale":"2023-11-30T17:07:16.318618+0000","last_undegraded":"2023-11-30T17:07:16.318618+0000","last_fullsized":"2023-11-30T17:07:16.318618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295850+0000","last_change":"2023-11-30T17:07:15.914471+0000","last_active":"2023-11-30T17:07:16.295850+0000","last_peered":"2023-11-30T17:07:16.295850+0000","last_clean":"2023-11-30T17:07:16.295850+0000","last_became_active":"2023-11-30T17:07:15.914170+0000","last_became_peered":"2023-11-30T17:07:15.914170+0000","last_unstale":"2023-11-30T17:07:16.295850+0000","last_undegraded":"2023-11-30T17:07:16.295850+0000","last_fullsized":"2023-11-30T17:07:16.295850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.314949+0000","last_change":"2023-11-30T17:07:16.309802+0000","last_active":"2023-11-30T17:07:16.314949+0000","last_peered":"2023-11-30T17:07:16.314949+0000","last_clean":"2023-11-30T17:07:16.314949+0000","last_became_active":"2023-11-30T17:07:16.309499+0000","last_became_peered":"2023-11-30T17:07:16.309499+0000","last_unstale":"2023-11-30T17:07:16.314949+0000","last_undegraded":"2023-11-30T17:07:16.314949+0000","last_fullsized":"2023-11-30T17:07:16.314949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.313989+0000","last_change":"2023-11-30T17:07:15.909306+0000","last_active":"2023-11-30T17:07:16.313989+0000","last_peered":"2023-11-30T17:07:16.313989+0000","last_clean":"2023-11-30T17:07:16.313989+0000","last_became_active":"2023-11-30T17:07:15.909030+0000","last_became_peered":"2023-11-30T17:07:15.909030+0000","last_unstale":"2023-11-30T17:07:16.313989+0000","last_undegraded":"2023-11-30T17:07:16.313989+0000","last_fullsized":"2023-11-30T17:07:16.313989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307156+0000","last_change":"2023-11-30T17:07:16.303384+0000","last_active":"2023-11-30T17:07:16.307156+0000","last_peered":"2023-11-30T17:07:16.307156+0000","last_clean":"2023-11-30T17:07:16.307156+0000","last_became_active":"2023-11-30T17:07:16.298413+0000","last_became_peered":"2023-11-30T17:07:16.298413+0000","last_unstale":"2023-11-30T17:07:16.307156+0000","last_undegraded":"2023-11-30T17:07:16.307156+0000","last_fullsized":"2023-11-30T17:07:16.307156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.305248+0000","last_change":"2023-11-30T17:07:15.914690+0000","last_active":"2023-11-30T17:07:16.305248+0000","last_peered":"2023-11-30T17:07:16.305248+0000","last_clean":"2023-11-30T17:07:16.305248+0000","last_became_active":"2023-11-30T17:07:15.914405+0000","last_became_peered":"2023-11-30T17:07:15.914405+0000","last_unstale":"2023-11-30T17:07:16.305248+0000","last_undegraded":"2023-11-30T17:07:16.305248+0000","last_fullsized":"2023-11-30T17:07:16.305248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.310006+0000","last_change":"2023-11-30T17:07:16.306951+0000","last_active":"2023-11-30T17:07:16.310006+0000","last_peered":"2023-11-30T17:07:16.310006+0000","last_clean":"2023-11-30T17:07:16.310006+0000","last_became_active":"2023-11-30T17:07:16.306691+0000","last_became_peered":"2023-11-30T17:07:16.306691+0000","last_unstale":"2023-11-30T17:07:16.310006+0000","last_undegraded":"2023-11-30T17:07:16.310006+0000","last_fullsized":"2023-11-30T17:07:16.310006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312888+0000","last_change":"2023-11-30T17:07:15.913637+0000","last_active":"2023-11-30T17:07:16.312888+0000","last_peered":"2023-11-30T17:07:16.312888+0000","last_clean":"2023-11-30T17:07:16.312888+0000","last_became_active":"2023-11-30T17:07:15.913336+0000","last_became_peered":"2023-11-30T17:07:15.913336+0000","last_unstale":"2023-11-30T17:07:16.312888+0000","last_undegraded":"2023-11-30T17:07:16.312888+0000","last_fullsized":"2023-11-30T17:07:16.312888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.314791+0000","last_change":"2023-11-30T17:07:16.310337+0000","last_active":"2023-11-30T17:07:16.314791+0000","last_peered":"2023-11-30T17:07:16.314791+0000","last_clean":"2023-11-30T17:07:16.314791+0000","last_became_active":"2023-11-30T17:07:16.310010+0000","last_became_peered":"2023-11-30T17:07:16.310010+0000","last_unstale":"2023-11-30T17:07:16.314791+0000","last_undegraded":"2023-11-30T17:07:16.314791+0000","last_fullsized":"2023-11-30T17:07:16.314791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.290031+0000","last_change":"2023-11-30T17:07:15.912918+0000","last_active":"2023-11-30T17:07:16.290031+0000","last_peered":"2023-11-30T17:07:16.290031+0000","last_clean":"2023-11-30T17:07:16.290031+0000","last_became_active":"2023-11-30T17:07:15.912624+0000","last_became_peered":"2023-11-30T17:07:15.912624+0000","last_unstale":"2023-11-30T17:07:16.290031+0000","last_undegraded":"2023-11-30T17:07:16.290031+0000","last_fullsized":"2023-11-30T17:07:16.290031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308325+0000","last_change":"2023-11-30T17:07:16.306137+0000","last_active":"2023-11-30T17:07:16.308325+0000","last_peered":"2023-11-30T17:07:16.308325+0000","last_clean":"2023-11-30T17:07:16.308325+0000","last_became_active":"2023-11-30T17:07:16.305673+0000","last_became_peered":"2023-11-30T17:07:16.305673+0000","last_unstale":"2023-11-30T17:07:16.308325+0000","last_undegraded":"2023-11-30T17:07:16.308325+0000","last_fullsized":"2023-11-30T17:07:16.308325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.286516+0000","last_change":"2023-11-30T17:07:15.912021+0000","last_active":"2023-11-30T17:07:16.286516+0000","last_peered":"2023-11-30T17:07:16.286516+0000","last_clean":"2023-11-30T17:07:16.286516+0000","last_became_active":"2023-11-30T17:07:15.911720+0000","last_became_peered":"2023-11-30T17:07:15.911720+0000","last_unstale":"2023-11-30T17:07:16.286516+0000","last_undegraded":"2023-11-30T17:07:16.286516+0000","last_fullsized":"2023-11-30T17:07:16.286516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318594+0000","last_change":"2023-11-30T17:07:16.313578+0000","last_active":"2023-11-30T17:07:16.318594+0000","last_peered":"2023-11-30T17:07:16.318594+0000","last_clean":"2023-11-30T17:07:16.318594+0000","last_became_active":"2023-11-30T17:07:16.313325+0000","last_became_peered":"2023-11-30T17:07:16.313325+0000","last_unstale":"2023-11-30T17:07:16.318594+0000","last_undegraded":"2023-11-30T17:07:16.318594+0000","last_fullsized":"2023-11-30T17:07:16.318594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.311197+0000","last_change":"2023-11-30T17:07:15.908770+0000","last_active":"2023-11-30T17:07:16.311197+0000","last_peered":"2023-11-30T17:07:16.311197+0000","last_clean":"2023-11-30T17:07:16.311197+0000","last_became_active":"2023-11-30T17:07:15.908480+0000","last_became_peered":"2023-11-30T17:07:15.908480+0000","last_unstale":"2023-11-30T17:07:16.311197+0000","last_undegraded":"2023-11-30T17:07:16.311197+0000","last_fullsized":"2023-11-30T17:07:16.311197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297348,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074492,"statfs":{"total":96636764160,"available":96332279808,"internally_reserved":0,"allocated":258048,"data_stored":86755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":86787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":78637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.222}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":78637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.246}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":80229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":78637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:07:21.982 INFO:tasks.ceph.mds.a.smithi049.stderr:2023-11-30T17:07:21.980+0000 7f340fc0d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-30T17:07:24.788 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:07:24.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.916+0000 7fc2a5f96700 1 Processor -- start 2023-11-30T17:07:24.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.916+0000 7fc2a5f96700 1 -- start start 2023-11-30T17:07:24.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.916+0000 7fc2a5f96700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2a00caab0 0x7fc2a00aa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:24.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.917+0000 7fc2a5f96700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc2a00ca180 0x7fc2a015e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:24.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.917+0000 7fc2a5f96700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a00a9a90 con 0x7fc2a00cae90 2023-11-30T17:07:24.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.917+0000 7fc2a5f96700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a0154ce0 con 0x7fc2a00ca180 2023-11-30T17:07:24.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.917+0000 7fc2a5f96700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a00a8e80 con 0x7fc2a00caab0 2023-11-30T17:07:24.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.917+0000 7fc29effd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc2a00cae90 0x7fc2a00c0ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34854/0 (socket says 172.21.15.49:34854) 2023-11-30T17:07:24.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.917+0000 7fc29effd700 1 -- 172.21.15.49:0/62420759 learned_addr learned my addr 172.21.15.49:0/62420759 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:24.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.917+0000 7fc29f7fe700 1 --2- 172.21.15.49:0/62420759 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2a00caab0 0x7fc2a00aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:24.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.917+0000 7fc29ffff700 1 --2- 172.21.15.49:0/62420759 >> v2:172.21.15.115:3300/0 conn(0x7fc2a00ca180 0x7fc2a015e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:24.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.917+0000 7fc29e7fc700 1 -- 172.21.15.49:0/62420759 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 270146787 0 0) 0x7fc2a00a9a90 con 0x7fc2a00cae90 2023-11-30T17:07:24.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.917+0000 7fc29e7fc700 1 -- 172.21.15.49:0/62420759 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc28c0033f0 con 0x7fc2a00cae90 2023-11-30T17:07:24.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.917+0000 7fc29ffff700 1 -- 172.21.15.49:0/62420759 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2a00caab0 msgr2=0x7fc2a00aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:24.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.917+0000 7fc29e7fc700 1 -- 172.21.15.49:0/62420759 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4136471790 0 0) 0x7fc28c0033f0 con 0x7fc2a00cae90 2023-11-30T17:07:24.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.917+0000 7fc29ffff700 1 --2- 172.21.15.49:0/62420759 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2a00caab0 0x7fc2a00aa470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:24.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.917+0000 7fc29ffff700 1 -- 172.21.15.49:0/62420759 >> v1:172.21.15.49:6789/0 conn(0x7fc2a00cae90 legacy=0x7fc2a00c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:24.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.917+0000 7fc29ffff700 1 -- 172.21.15.49:0/62420759 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a00a9160 con 0x7fc2a00ca180 2023-11-30T17:07:24.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.917+0000 7fc29f7fe700 1 --2- 172.21.15.49:0/62420759 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2a00caab0 0x7fc2a00aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:07:24.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.917+0000 7fc29ffff700 1 --2- 172.21.15.49:0/62420759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2a00ca180 0x7fc2a015e3c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fc298009e60 tx=0x7fc298009780).ready entity=mon.1 client_cookie=a7a5b418c11151bc server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:24.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.918+0000 7fc29e7fc700 1 -- 172.21.15.49:0/62420759 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29800e070 con 0x7fc2a00ca180 2023-11-30T17:07:24.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.918+0000 7fc29e7fc700 1 -- 172.21.15.49:0/62420759 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29800b7a0 con 0x7fc2a00ca180 2023-11-30T17:07:24.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.918+0000 7fc29e7fc700 1 -- 172.21.15.49:0/62420759 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc288001470 con 0x7fc2a00ca180 2023-11-30T17:07:24.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.918+0000 7fc2a5f96700 1 -- 172.21.15.49:0/62420759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2a00ca180 msgr2=0x7fc2a015e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:24.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.918+0000 7fc2a5f96700 1 --2- 172.21.15.49:0/62420759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2a00ca180 0x7fc2a015e3c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fc298009e60 tx=0x7fc298009780).stop 2023-11-30T17:07:24.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.918+0000 7fc2a5f96700 1 -- 172.21.15.49:0/62420759 shutdown_connections 2023-11-30T17:07:24.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.918+0000 7fc2a5f96700 1 --2- 172.21.15.49:0/62420759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2a00ca180 0x7fc2a015e3c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:24.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.918+0000 7fc2a5f96700 1 --2- 172.21.15.49:0/62420759 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2a00caab0 0x7fc2a00aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:24.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.918+0000 7fc2a5f96700 1 -- 172.21.15.49:0/62420759 >> 172.21.15.49:0/62420759 conn(0x7fc2a0094920 msgr2=0x7fc2a006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:24.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.918+0000 7fc2a5f96700 1 -- 172.21.15.49:0/62420759 shutdown_connections 2023-11-30T17:07:24.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.918+0000 7fc2a5f96700 1 -- 172.21.15.49:0/62420759 wait complete. 2023-11-30T17:07:24.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.919+0000 7fc2a5f96700 1 Processor -- start 2023-11-30T17:07:24.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.919+0000 7fc2a5f96700 1 -- start start 2023-11-30T17:07:24.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.920+0000 7fc2a5f96700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2a00ca180 0x7fc2a0150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:24.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.920+0000 7fc2a5f96700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2a00caab0 0x7fc2a00afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:24.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.920+0000 7fc2a5f96700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2a00cae90 0x7fc2a00b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:24.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.920+0000 7fc2a5f96700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a00c45b0 con 0x7fc2a00cae90 2023-11-30T17:07:24.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.920+0000 7fc2a5f96700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a00c31c0 con 0x7fc2a00ca180 2023-11-30T17:07:24.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.920+0000 7fc2a5f96700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a00c2310 con 0x7fc2a00caab0 2023-11-30T17:07:24.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.920+0000 7fc29ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2a00cae90 0x7fc2a00b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:24.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.920+0000 7fc29ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2a00cae90 0x7fc2a00b03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59194/0 (socket says 172.21.15.49:59194) 2023-11-30T17:07:24.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.920+0000 7fc29ffff700 1 -- 172.21.15.49:0/1917669263 learned_addr learned my addr 172.21.15.49:0/1917669263 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:24.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.921+0000 7fc29f7fe700 1 --2- 172.21.15.49:0/1917669263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2a00ca180 0x7fc2a0150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:24.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.921+0000 7fc29effd700 1 --2- 172.21.15.49:0/1917669263 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2a00caab0 0x7fc2a00afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:24.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.921+0000 7fc29ffff700 1 -- 172.21.15.49:0/1917669263 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2a00caab0 msgr2=0x7fc2a00afeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:24.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.921+0000 7fc29ffff700 1 --2- 172.21.15.49:0/1917669263 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2a00caab0 0x7fc2a00afeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:24.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.921+0000 7fc29ffff700 1 -- 172.21.15.49:0/1917669263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2a00ca180 msgr2=0x7fc2a0150150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:24.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.921+0000 7fc29ffff700 1 --2- 172.21.15.49:0/1917669263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2a00ca180 0x7fc2a0150150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:24.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.921+0000 7fc29ffff700 1 -- 172.21.15.49:0/1917669263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc290009250 con 0x7fc2a00cae90 2023-11-30T17:07:24.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.921+0000 7fc29f7fe700 1 --2- 172.21.15.49:0/1917669263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2a00ca180 0x7fc2a0150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:24.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.921+0000 7fc29effd700 1 --2- 172.21.15.49:0/1917669263 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2a00caab0 0x7fc2a00afeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:24.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.921+0000 7fc29ffff700 1 --2- 172.21.15.49:0/1917669263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2a00cae90 0x7fc2a00b03a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fc2a0083c30 tx=0x7fc298009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:24.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.921+0000 7fc2977fe700 1 -- 172.21.15.49:0/1917669263 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29800be50 con 0x7fc2a00cae90 2023-11-30T17:07:24.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.921+0000 7fc2977fe700 1 -- 172.21.15.49:0/1917669263 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29801d630 con 0x7fc2a00cae90 2023-11-30T17:07:24.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.921+0000 7fc2a5f96700 1 -- 172.21.15.49:0/1917669263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc298009a20 con 0x7fc2a00cae90 2023-11-30T17:07:24.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.921+0000 7fc2977fe700 1 -- 172.21.15.49:0/1917669263 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29801d9f0 con 0x7fc2a00cae90 2023-11-30T17:07:24.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.921+0000 7fc2a5f96700 1 -- 172.21.15.49:0/1917669263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a00c25b0 con 0x7fc2a00cae90 2023-11-30T17:07:24.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.922+0000 7fc2a5f96700 1 -- 172.21.15.49:0/1917669263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a006c860 con 0x7fc2a00cae90 2023-11-30T17:07:24.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.922+0000 7fc2977fe700 1 -- 172.21.15.49:0/1917669263 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc298003040 con 0x7fc2a00cae90 2023-11-30T17:07:24.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.923+0000 7fc2977fe700 1 --2- 172.21.15.49:0/1917669263 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc28005f150 0x7fc280061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:24.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.923+0000 7fc2977fe700 1 -- 172.21.15.49:0/1917669263 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc29807bf00 con 0x7fc2a00cae90 2023-11-30T17:07:24.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.923+0000 7fc29f7fe700 1 --2- 172.21.15.49:0/1917669263 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc28005f150 0x7fc280061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:24.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.923+0000 7fc29f7fe700 1 --2- 172.21.15.49:0/1917669263 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc28005f150 0x7fc280061610 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fc290006d20 tx=0x7fc290008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:24.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:24.927+0000 7fc2977fe700 1 -- 172.21.15.49:0/1917669263 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc29804d1d0 con 0x7fc2a00cae90 2023-11-30T17:07:25.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.097+0000 7fc2a5f96700 1 -- 172.21.15.49:0/1917669263 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc2a00a9440 con 0x7fc28005f150 2023-11-30T17:07:25.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.107+0000 7fc2977fe700 1 -- 172.21.15.49:0/1917669263 <== mgr.4105 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336312 (secure 0 0 0) 0x7fc2a00a9440 con 0x7fc28005f150 2023-11-30T17:07:25.113 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:25.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.109+0000 7fc2a5f96700 1 -- 172.21.15.49:0/1917669263 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc28005f150 msgr2=0x7fc280061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:25.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.110+0000 7fc2a5f96700 1 --2- 172.21.15.49:0/1917669263 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc28005f150 0x7fc280061610 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fc290006d20 tx=0x7fc290008040).stop 2023-11-30T17:07:25.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.110+0000 7fc2a5f96700 1 -- 172.21.15.49:0/1917669263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2a00cae90 msgr2=0x7fc2a00b03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:25.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.110+0000 7fc2a5f96700 1 --2- 172.21.15.49:0/1917669263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2a00cae90 0x7fc2a00b03a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fc2a0083c30 tx=0x7fc298009780).stop 2023-11-30T17:07:25.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.110+0000 7fc2a5f96700 1 -- 172.21.15.49:0/1917669263 shutdown_connections 2023-11-30T17:07:25.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.110+0000 7fc2a5f96700 1 --2- 172.21.15.49:0/1917669263 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc28005f150 0x7fc280061610 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:25.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.110+0000 7fc2a5f96700 1 --2- 172.21.15.49:0/1917669263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2a00cae90 0x7fc2a00b03a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:25.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.110+0000 7fc2a5f96700 1 --2- 172.21.15.49:0/1917669263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2a00ca180 0x7fc2a0150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:25.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.110+0000 7fc2a5f96700 1 --2- 172.21.15.49:0/1917669263 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2a00caab0 0x7fc2a00afeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:25.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.110+0000 7fc2a5f96700 1 -- 172.21.15.49:0/1917669263 >> 172.21.15.49:0/1917669263 conn(0x7fc2a0094920 msgr2=0x7fc2a00a7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:25.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.110+0000 7fc2a5f96700 1 -- 172.21.15.49:0/1917669263 shutdown_connections 2023-11-30T17:07:25.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.110+0000 7fc2a5f96700 1 -- 172.21.15.49:0/1917669263 wait complete. 2023-11-30T17:07:25.116 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:07:25.124 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-11-30T17:07:24.839434+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378624,"kb_used_data":1856,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596096,"statfs":{"total":773094113280,"available":770658402304,"internally_reserved":0,"allocated":1900544,"data_stored":687340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000924"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307566+0000","last_change":"2023-11-30T17:07:16.305288+0000","last_active":"2023-11-30T17:07:16.307566+0000","last_peered":"2023-11-30T17:07:16.307566+0000","last_clean":"2023-11-30T17:07:16.307566+0000","last_became_active":"2023-11-30T17:07:16.305010+0000","last_became_peered":"2023-11-30T17:07:16.305010+0000","last_unstale":"2023-11-30T17:07:16.307566+0000","last_undegraded":"2023-11-30T17:07:16.307566+0000","last_fullsized":"2023-11-30T17:07:16.307566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295268+0000","last_change":"2023-11-30T17:07:15.910158+0000","last_active":"2023-11-30T17:07:16.295268+0000","last_peered":"2023-11-30T17:07:16.295268+0000","last_clean":"2023-11-30T17:07:16.295268+0000","last_became_active":"2023-11-30T17:07:15.909808+0000","last_became_peered":"2023-11-30T17:07:15.909808+0000","last_unstale":"2023-11-30T17:07:16.295268+0000","last_undegraded":"2023-11-30T17:07:16.295268+0000","last_fullsized":"2023-11-30T17:07:16.295268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.309132+0000","last_change":"2023-11-30T17:07:16.303941+0000","last_active":"2023-11-30T17:07:16.309132+0000","last_peered":"2023-11-30T17:07:16.309132+0000","last_clean":"2023-11-30T17:07:16.309132+0000","last_became_active":"2023-11-30T17:07:16.303673+0000","last_became_peered":"2023-11-30T17:07:16.303673+0000","last_unstale":"2023-11-30T17:07:16.309132+0000","last_undegraded":"2023-11-30T17:07:16.309132+0000","last_fullsized":"2023-11-30T17:07:16.309132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.285551+0000","last_change":"2023-11-30T17:07:15.914251+0000","last_active":"2023-11-30T17:07:16.285551+0000","last_peered":"2023-11-30T17:07:16.285551+0000","last_clean":"2023-11-30T17:07:16.285551+0000","last_became_active":"2023-11-30T17:07:15.913954+0000","last_became_peered":"2023-11-30T17:07:15.913954+0000","last_unstale":"2023-11-30T17:07:16.285551+0000","last_undegraded":"2023-11-30T17:07:16.285551+0000","last_fullsized":"2023-11-30T17:07:16.285551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318395+0000","last_change":"2023-11-30T17:07:16.314266+0000","last_active":"2023-11-30T17:07:16.318395+0000","last_peered":"2023-11-30T17:07:16.318395+0000","last_clean":"2023-11-30T17:07:16.318395+0000","last_became_active":"2023-11-30T17:07:16.313990+0000","last_became_peered":"2023-11-30T17:07:16.313990+0000","last_unstale":"2023-11-30T17:07:16.318395+0000","last_undegraded":"2023-11-30T17:07:16.318395+0000","last_fullsized":"2023-11-30T17:07:16.318395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.294345+0000","last_change":"2023-11-30T17:07:15.911004+0000","last_active":"2023-11-30T17:07:16.294345+0000","last_peered":"2023-11-30T17:07:16.294345+0000","last_clean":"2023-11-30T17:07:16.294345+0000","last_became_active":"2023-11-30T17:07:15.910698+0000","last_became_peered":"2023-11-30T17:07:15.910698+0000","last_unstale":"2023-11-30T17:07:16.294345+0000","last_undegraded":"2023-11-30T17:07:16.294345+0000","last_fullsized":"2023-11-30T17:07:16.294345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.306911+0000","last_change":"2023-11-30T17:07:16.304718+0000","last_active":"2023-11-30T17:07:16.306911+0000","last_peered":"2023-11-30T17:07:16.306911+0000","last_clean":"2023-11-30T17:07:16.306911+0000","last_became_active":"2023-11-30T17:07:16.304311+0000","last_became_peered":"2023-11-30T17:07:16.304311+0000","last_unstale":"2023-11-30T17:07:16.306911+0000","last_undegraded":"2023-11-30T17:07:16.306911+0000","last_fullsized":"2023-11-30T17:07:16.306911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.289689+0000","last_change":"2023-11-30T17:07:15.905295+0000","last_active":"2023-11-30T17:07:16.289689+0000","last_peered":"2023-11-30T17:07:16.289689+0000","last_clean":"2023-11-30T17:07:16.289689+0000","last_became_active":"2023-11-30T17:07:15.904998+0000","last_became_peered":"2023-11-30T17:07:15.904998+0000","last_unstale":"2023-11-30T17:07:16.289689+0000","last_undegraded":"2023-11-30T17:07:16.289689+0000","last_fullsized":"2023-11-30T17:07:16.289689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308850+0000","last_change":"2023-11-30T17:07:16.307461+0000","last_active":"2023-11-30T17:07:16.308850+0000","last_peered":"2023-11-30T17:07:16.308850+0000","last_clean":"2023-11-30T17:07:16.308850+0000","last_became_active":"2023-11-30T17:07:16.307178+0000","last_became_peered":"2023-11-30T17:07:16.307178+0000","last_unstale":"2023-11-30T17:07:16.308850+0000","last_undegraded":"2023-11-30T17:07:16.308850+0000","last_fullsized":"2023-11-30T17:07:16.308850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.305220+0000","last_change":"2023-11-30T17:07:15.915224+0000","last_active":"2023-11-30T17:07:16.305220+0000","last_peered":"2023-11-30T17:07:16.305220+0000","last_clean":"2023-11-30T17:07:16.305220+0000","last_became_active":"2023-11-30T17:07:15.915001+0000","last_became_peered":"2023-11-30T17:07:15.915001+0000","last_unstale":"2023-11-30T17:07:16.305220+0000","last_undegraded":"2023-11-30T17:07:16.305220+0000","last_fullsized":"2023-11-30T17:07:16.305220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.310566+0000","last_change":"2023-11-30T17:07:16.302009+0000","last_active":"2023-11-30T17:07:16.310566+0000","last_peered":"2023-11-30T17:07:16.310566+0000","last_clean":"2023-11-30T17:07:16.310566+0000","last_became_active":"2023-11-30T17:07:16.301664+0000","last_became_peered":"2023-11-30T17:07:16.301664+0000","last_unstale":"2023-11-30T17:07:16.310566+0000","last_undegraded":"2023-11-30T17:07:16.310566+0000","last_fullsized":"2023-11-30T17:07:16.310566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308378+0000","last_change":"2023-11-30T17:07:15.919005+0000","last_active":"2023-11-30T17:07:16.308378+0000","last_peered":"2023-11-30T17:07:16.308378+0000","last_clean":"2023-11-30T17:07:16.308378+0000","last_became_active":"2023-11-30T17:07:15.918757+0000","last_became_peered":"2023-11-30T17:07:15.918757+0000","last_unstale":"2023-11-30T17:07:16.308378+0000","last_undegraded":"2023-11-30T17:07:16.308378+0000","last_fullsized":"2023-11-30T17:07:16.308378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.305107+0000","last_change":"2023-11-30T17:07:16.303563+0000","last_active":"2023-11-30T17:07:16.305107+0000","last_peered":"2023-11-30T17:07:16.305107+0000","last_clean":"2023-11-30T17:07:16.305107+0000","last_became_active":"2023-11-30T17:07:16.303281+0000","last_became_peered":"2023-11-30T17:07:16.303281+0000","last_unstale":"2023-11-30T17:07:16.305107+0000","last_undegraded":"2023-11-30T17:07:16.305107+0000","last_fullsized":"2023-11-30T17:07:16.305107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.311442+0000","last_change":"2023-11-30T17:07:15.912815+0000","last_active":"2023-11-30T17:07:16.311442+0000","last_peered":"2023-11-30T17:07:16.311442+0000","last_clean":"2023-11-30T17:07:16.311442+0000","last_became_active":"2023-11-30T17:07:15.912519+0000","last_became_peered":"2023-11-30T17:07:15.912519+0000","last_unstale":"2023-11-30T17:07:16.311442+0000","last_undegraded":"2023-11-30T17:07:16.311442+0000","last_fullsized":"2023-11-30T17:07:16.311442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.306264+0000","last_change":"2023-11-30T17:07:16.305070+0000","last_active":"2023-11-30T17:07:16.306264+0000","last_peered":"2023-11-30T17:07:16.306264+0000","last_clean":"2023-11-30T17:07:16.306264+0000","last_became_active":"2023-11-30T17:07:16.304769+0000","last_became_peered":"2023-11-30T17:07:16.304769+0000","last_unstale":"2023-11-30T17:07:16.306264+0000","last_undegraded":"2023-11-30T17:07:16.306264+0000","last_fullsized":"2023-11-30T17:07:16.306264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.305362+0000","last_change":"2023-11-30T17:07:15.911789+0000","last_active":"2023-11-30T17:07:16.305362+0000","last_peered":"2023-11-30T17:07:16.305362+0000","last_clean":"2023-11-30T17:07:16.305362+0000","last_became_active":"2023-11-30T17:07:15.911461+0000","last_became_peered":"2023-11-30T17:07:15.911461+0000","last_unstale":"2023-11-30T17:07:16.305362+0000","last_undegraded":"2023-11-30T17:07:16.305362+0000","last_fullsized":"2023-11-30T17:07:16.305362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.320053+0000","last_change":"2023-11-30T17:07:16.316309+0000","last_active":"2023-11-30T17:07:16.320053+0000","last_peered":"2023-11-30T17:07:16.320053+0000","last_clean":"2023-11-30T17:07:16.320053+0000","last_became_active":"2023-11-30T17:07:16.316010+0000","last_became_peered":"2023-11-30T17:07:16.316010+0000","last_unstale":"2023-11-30T17:07:16.320053+0000","last_undegraded":"2023-11-30T17:07:16.320053+0000","last_fullsized":"2023-11-30T17:07:16.320053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.288892+0000","last_change":"2023-11-30T17:07:15.914178+0000","last_active":"2023-11-30T17:07:16.288892+0000","last_peered":"2023-11-30T17:07:16.288892+0000","last_clean":"2023-11-30T17:07:16.288892+0000","last_became_active":"2023-11-30T17:07:15.913297+0000","last_became_peered":"2023-11-30T17:07:15.913297+0000","last_unstale":"2023-11-30T17:07:16.288892+0000","last_undegraded":"2023-11-30T17:07:16.288892+0000","last_fullsized":"2023-11-30T17:07:16.288892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.304041+0000","last_change":"2023-11-30T17:07:16.300572+0000","last_active":"2023-11-30T17:07:16.304041+0000","last_peered":"2023-11-30T17:07:16.304041+0000","last_clean":"2023-11-30T17:07:16.304041+0000","last_became_active":"2023-11-30T17:07:16.300298+0000","last_became_peered":"2023-11-30T17:07:16.300298+0000","last_unstale":"2023-11-30T17:07:16.304041+0000","last_undegraded":"2023-11-30T17:07:16.304041+0000","last_fullsized":"2023-11-30T17:07:16.304041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295495+0000","last_change":"2023-11-30T17:07:15.915272+0000","last_active":"2023-11-30T17:07:16.295495+0000","last_peered":"2023-11-30T17:07:16.295495+0000","last_clean":"2023-11-30T17:07:16.295495+0000","last_became_active":"2023-11-30T17:07:15.914832+0000","last_became_peered":"2023-11-30T17:07:15.914832+0000","last_unstale":"2023-11-30T17:07:16.295495+0000","last_undegraded":"2023-11-30T17:07:16.295495+0000","last_fullsized":"2023-11-30T17:07:16.295495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.313799+0000","last_change":"2023-11-30T17:07:16.311093+0000","last_active":"2023-11-30T17:07:16.313799+0000","last_peered":"2023-11-30T17:07:16.313799+0000","last_clean":"2023-11-30T17:07:16.313799+0000","last_became_active":"2023-11-30T17:07:16.310618+0000","last_became_peered":"2023-11-30T17:07:16.310618+0000","last_unstale":"2023-11-30T17:07:16.313799+0000","last_undegraded":"2023-11-30T17:07:16.313799+0000","last_fullsized":"2023-11-30T17:07:16.313799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.310314+0000","last_change":"2023-11-30T17:07:15.910300+0000","last_active":"2023-11-30T17:07:16.310314+0000","last_peered":"2023-11-30T17:07:16.310314+0000","last_clean":"2023-11-30T17:07:16.310314+0000","last_became_active":"2023-11-30T17:07:15.909476+0000","last_became_peered":"2023-11-30T17:07:15.909476+0000","last_unstale":"2023-11-30T17:07:16.310314+0000","last_undegraded":"2023-11-30T17:07:16.310314+0000","last_fullsized":"2023-11-30T17:07:16.310314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318565+0000","last_change":"2023-11-30T17:07:16.313453+0000","last_active":"2023-11-30T17:07:16.318565+0000","last_peered":"2023-11-30T17:07:16.318565+0000","last_clean":"2023-11-30T17:07:16.318565+0000","last_became_active":"2023-11-30T17:07:16.312874+0000","last_became_peered":"2023-11-30T17:07:16.312874+0000","last_unstale":"2023-11-30T17:07:16.318565+0000","last_undegraded":"2023-11-30T17:07:16.318565+0000","last_fullsized":"2023-11-30T17:07:16.318565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307366+0000","last_change":"2023-11-30T17:07:15.911874+0000","last_active":"2023-11-30T17:07:16.307366+0000","last_peered":"2023-11-30T17:07:16.307366+0000","last_clean":"2023-11-30T17:07:16.307366+0000","last_became_active":"2023-11-30T17:07:15.911404+0000","last_became_peered":"2023-11-30T17:07:15.911404+0000","last_unstale":"2023-11-30T17:07:16.307366+0000","last_undegraded":"2023-11-30T17:07:16.307366+0000","last_fullsized":"2023-11-30T17:07:16.307366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315251+0000","last_change":"2023-11-30T17:07:16.312859+0000","last_active":"2023-11-30T17:07:16.315251+0000","last_peered":"2023-11-30T17:07:16.315251+0000","last_clean":"2023-11-30T17:07:16.315251+0000","last_became_active":"2023-11-30T17:07:16.312514+0000","last_became_peered":"2023-11-30T17:07:16.312514+0000","last_unstale":"2023-11-30T17:07:16.315251+0000","last_undegraded":"2023-11-30T17:07:16.315251+0000","last_fullsized":"2023-11-30T17:07:16.315251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308003+0000","last_change":"2023-11-30T17:07:15.912336+0000","last_active":"2023-11-30T17:07:16.308003+0000","last_peered":"2023-11-30T17:07:16.308003+0000","last_clean":"2023-11-30T17:07:16.308003+0000","last_became_active":"2023-11-30T17:07:15.912069+0000","last_became_peered":"2023-11-30T17:07:15.912069+0000","last_unstale":"2023-11-30T17:07:16.308003+0000","last_undegraded":"2023-11-30T17:07:16.308003+0000","last_fullsized":"2023-11-30T17:07:16.308003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.305757+0000","last_change":"2023-11-30T17:07:16.300210+0000","last_active":"2023-11-30T17:07:16.305757+0000","last_peered":"2023-11-30T17:07:16.305757+0000","last_clean":"2023-11-30T17:07:16.305757+0000","last_became_active":"2023-11-30T17:07:16.298899+0000","last_became_peered":"2023-11-30T17:07:16.298899+0000","last_unstale":"2023-11-30T17:07:16.305757+0000","last_undegraded":"2023-11-30T17:07:16.305757+0000","last_fullsized":"2023-11-30T17:07:16.305757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295980+0000","last_change":"2023-11-30T17:07:15.917879+0000","last_active":"2023-11-30T17:07:16.295980+0000","last_peered":"2023-11-30T17:07:16.295980+0000","last_clean":"2023-11-30T17:07:16.295980+0000","last_became_active":"2023-11-30T17:07:15.917554+0000","last_became_peered":"2023-11-30T17:07:15.917554+0000","last_unstale":"2023-11-30T17:07:16.295980+0000","last_undegraded":"2023-11-30T17:07:16.295980+0000","last_fullsized":"2023-11-30T17:07:16.295980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307516+0000","last_change":"2023-11-30T17:07:16.303927+0000","last_active":"2023-11-30T17:07:16.307516+0000","last_peered":"2023-11-30T17:07:16.307516+0000","last_clean":"2023-11-30T17:07:16.307516+0000","last_became_active":"2023-11-30T17:07:16.303463+0000","last_became_peered":"2023-11-30T17:07:16.303463+0000","last_unstale":"2023-11-30T17:07:16.307516+0000","last_undegraded":"2023-11-30T17:07:16.307516+0000","last_fullsized":"2023-11-30T17:07:16.307516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.303300+0000","last_change":"2023-11-30T17:07:15.913512+0000","last_active":"2023-11-30T17:07:16.303300+0000","last_peered":"2023-11-30T17:07:16.303300+0000","last_clean":"2023-11-30T17:07:16.303300+0000","last_became_active":"2023-11-30T17:07:15.913268+0000","last_became_peered":"2023-11-30T17:07:15.913268+0000","last_unstale":"2023-11-30T17:07:16.303300+0000","last_undegraded":"2023-11-30T17:07:16.303300+0000","last_fullsized":"2023-11-30T17:07:16.303300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312201+0000","last_change":"2023-11-30T17:07:16.308161+0000","last_active":"2023-11-30T17:07:16.312201+0000","last_peered":"2023-11-30T17:07:16.312201+0000","last_clean":"2023-11-30T17:07:16.312201+0000","last_became_active":"2023-11-30T17:07:16.307884+0000","last_became_peered":"2023-11-30T17:07:16.307884+0000","last_unstale":"2023-11-30T17:07:16.312201+0000","last_undegraded":"2023-11-30T17:07:16.312201+0000","last_fullsized":"2023-11-30T17:07:16.312201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.306036+0000","last_change":"2023-11-30T17:07:15.910523+0000","last_active":"2023-11-30T17:07:16.306036+0000","last_peered":"2023-11-30T17:07:16.306036+0000","last_clean":"2023-11-30T17:07:16.306036+0000","last_became_active":"2023-11-30T17:07:15.910216+0000","last_became_peered":"2023-11-30T17:07:15.910216+0000","last_unstale":"2023-11-30T17:07:16.306036+0000","last_undegraded":"2023-11-30T17:07:16.306036+0000","last_fullsized":"2023-11-30T17:07:16.306036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315009+0000","last_change":"2023-11-30T17:07:16.311819+0000","last_active":"2023-11-30T17:07:16.315009+0000","last_peered":"2023-11-30T17:07:16.315009+0000","last_clean":"2023-11-30T17:07:16.315009+0000","last_became_active":"2023-11-30T17:07:16.311446+0000","last_became_peered":"2023-11-30T17:07:16.311446+0000","last_unstale":"2023-11-30T17:07:16.315009+0000","last_undegraded":"2023-11-30T17:07:16.315009+0000","last_fullsized":"2023-11-30T17:07:16.315009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.290739+0000","last_change":"2023-11-30T17:07:15.903463+0000","last_active":"2023-11-30T17:07:16.290739+0000","last_peered":"2023-11-30T17:07:16.290739+0000","last_clean":"2023-11-30T17:07:16.290739+0000","last_became_active":"2023-11-30T17:07:15.903169+0000","last_became_peered":"2023-11-30T17:07:15.903169+0000","last_unstale":"2023-11-30T17:07:16.290739+0000","last_undegraded":"2023-11-30T17:07:16.290739+0000","last_fullsized":"2023-11-30T17:07:16.290739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.304451+0000","last_change":"2023-11-30T17:07:16.301048+0000","last_active":"2023-11-30T17:07:16.304451+0000","last_peered":"2023-11-30T17:07:16.304451+0000","last_clean":"2023-11-30T17:07:16.304451+0000","last_became_active":"2023-11-30T17:07:16.300733+0000","last_became_peered":"2023-11-30T17:07:16.300733+0000","last_unstale":"2023-11-30T17:07:16.304451+0000","last_undegraded":"2023-11-30T17:07:16.304451+0000","last_fullsized":"2023-11-30T17:07:16.304451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.297265+0000","last_change":"2023-11-30T17:07:15.912479+0000","last_active":"2023-11-30T17:07:16.297265+0000","last_peered":"2023-11-30T17:07:16.297265+0000","last_clean":"2023-11-30T17:07:16.297265+0000","last_became_active":"2023-11-30T17:07:15.911715+0000","last_became_peered":"2023-11-30T17:07:15.911715+0000","last_unstale":"2023-11-30T17:07:16.297265+0000","last_undegraded":"2023-11-30T17:07:16.297265+0000","last_fullsized":"2023-11-30T17:07:16.297265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312756+0000","last_change":"2023-11-30T17:07:16.308823+0000","last_active":"2023-11-30T17:07:16.312756+0000","last_peered":"2023-11-30T17:07:16.312756+0000","last_clean":"2023-11-30T17:07:16.312756+0000","last_became_active":"2023-11-30T17:07:16.308607+0000","last_became_peered":"2023-11-30T17:07:16.308607+0000","last_unstale":"2023-11-30T17:07:16.312756+0000","last_undegraded":"2023-11-30T17:07:16.312756+0000","last_fullsized":"2023-11-30T17:07:16.312756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.294468+0000","last_change":"2023-11-30T17:07:15.907967+0000","last_active":"2023-11-30T17:07:16.294468+0000","last_peered":"2023-11-30T17:07:16.294468+0000","last_clean":"2023-11-30T17:07:16.294468+0000","last_became_active":"2023-11-30T17:07:15.907702+0000","last_became_peered":"2023-11-30T17:07:15.907702+0000","last_unstale":"2023-11-30T17:07:16.294468+0000","last_undegraded":"2023-11-30T17:07:16.294468+0000","last_fullsized":"2023-11-30T17:07:16.294468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.285836+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:07:16.285836+0000","last_peered":"2023-11-30T17:07:16.285836+0000","last_clean":"2023-11-30T17:07:16.285836+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:07:16.285836+0000","last_undegraded":"2023-11-30T17:07:16.285836+0000","last_fullsized":"2023-11-30T17:07:16.285836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307514+0000","last_change":"2023-11-30T17:07:15.918902+0000","last_active":"2023-11-30T17:07:16.307514+0000","last_peered":"2023-11-30T17:07:16.307514+0000","last_clean":"2023-11-30T17:07:16.307514+0000","last_became_active":"2023-11-30T17:07:15.918581+0000","last_became_peered":"2023-11-30T17:07:15.918581+0000","last_unstale":"2023-11-30T17:07:16.307514+0000","last_undegraded":"2023-11-30T17:07:16.307514+0000","last_fullsized":"2023-11-30T17:07:16.307514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315758+0000","last_change":"2023-11-30T17:07:16.314704+0000","last_active":"2023-11-30T17:07:16.315758+0000","last_peered":"2023-11-30T17:07:16.315758+0000","last_clean":"2023-11-30T17:07:16.315758+0000","last_became_active":"2023-11-30T17:07:16.314432+0000","last_became_peered":"2023-11-30T17:07:16.314432+0000","last_unstale":"2023-11-30T17:07:16.315758+0000","last_undegraded":"2023-11-30T17:07:16.315758+0000","last_fullsized":"2023-11-30T17:07:16.315758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308686+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:07:16.308686+0000","last_peered":"2023-11-30T17:07:16.308686+0000","last_clean":"2023-11-30T17:07:16.308686+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:07:16.308686+0000","last_undegraded":"2023-11-30T17:07:16.308686+0000","last_fullsized":"2023-11-30T17:07:16.308686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.294139+0000","last_change":"2023-11-30T17:07:15.911883+0000","last_active":"2023-11-30T17:07:16.294139+0000","last_peered":"2023-11-30T17:07:16.294139+0000","last_clean":"2023-11-30T17:07:16.294139+0000","last_became_active":"2023-11-30T17:07:15.911610+0000","last_became_peered":"2023-11-30T17:07:15.911610+0000","last_unstale":"2023-11-30T17:07:16.294139+0000","last_undegraded":"2023-11-30T17:07:16.294139+0000","last_fullsized":"2023-11-30T17:07:16.294139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312407+0000","last_change":"2023-11-30T17:07:16.303472+0000","last_active":"2023-11-30T17:07:16.312407+0000","last_peered":"2023-11-30T17:07:16.312407+0000","last_clean":"2023-11-30T17:07:16.312407+0000","last_became_active":"2023-11-30T17:07:16.302394+0000","last_became_peered":"2023-11-30T17:07:16.302394+0000","last_unstale":"2023-11-30T17:07:16.312407+0000","last_undegraded":"2023-11-30T17:07:16.312407+0000","last_fullsized":"2023-11-30T17:07:16.312407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315795+0000","last_change":"2023-11-30T17:07:16.314725+0000","last_active":"2023-11-30T17:07:16.315795+0000","last_peered":"2023-11-30T17:07:16.315795+0000","last_clean":"2023-11-30T17:07:16.315795+0000","last_became_active":"2023-11-30T17:07:16.314512+0000","last_became_peered":"2023-11-30T17:07:16.314512+0000","last_unstale":"2023-11-30T17:07:16.315795+0000","last_undegraded":"2023-11-30T17:07:16.315795+0000","last_fullsized":"2023-11-30T17:07:16.315795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.292666+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:07:16.292666+0000","last_peered":"2023-11-30T17:07:16.292666+0000","last_clean":"2023-11-30T17:07:16.292666+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:07:16.292666+0000","last_undegraded":"2023-11-30T17:07:16.292666+0000","last_fullsized":"2023-11-30T17:07:16.292666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.285572+0000","last_change":"2023-11-30T17:07:15.913075+0000","last_active":"2023-11-30T17:07:16.285572+0000","last_peered":"2023-11-30T17:07:16.285572+0000","last_clean":"2023-11-30T17:07:16.285572+0000","last_became_active":"2023-11-30T17:07:15.912781+0000","last_became_peered":"2023-11-30T17:07:15.912781+0000","last_unstale":"2023-11-30T17:07:16.285572+0000","last_undegraded":"2023-11-30T17:07:16.285572+0000","last_fullsized":"2023-11-30T17:07:16.285572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307120+0000","last_change":"2023-11-30T17:07:16.300272+0000","last_active":"2023-11-30T17:07:16.307120+0000","last_peered":"2023-11-30T17:07:16.307120+0000","last_clean":"2023-11-30T17:07:16.307120+0000","last_became_active":"2023-11-30T17:07:16.299930+0000","last_became_peered":"2023-11-30T17:07:16.299930+0000","last_unstale":"2023-11-30T17:07:16.307120+0000","last_undegraded":"2023-11-30T17:07:16.307120+0000","last_fullsized":"2023-11-30T17:07:16.307120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.301634+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:07:16.301634+0000","last_peered":"2023-11-30T17:07:16.301634+0000","last_clean":"2023-11-30T17:07:16.301634+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:07:16.301634+0000","last_undegraded":"2023-11-30T17:07:16.301634+0000","last_fullsized":"2023-11-30T17:07:16.301634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.293696+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:07:16.293696+0000","last_peered":"2023-11-30T17:07:16.293696+0000","last_clean":"2023-11-30T17:07:16.293696+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:07:16.293696+0000","last_undegraded":"2023-11-30T17:07:16.293696+0000","last_fullsized":"2023-11-30T17:07:16.293696+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295020+0000","last_change":"2023-11-30T17:07:15.906109+0000","last_active":"2023-11-30T17:07:16.295020+0000","last_peered":"2023-11-30T17:07:16.295020+0000","last_clean":"2023-11-30T17:07:16.295020+0000","last_became_active":"2023-11-30T17:07:15.905789+0000","last_became_peered":"2023-11-30T17:07:15.905789+0000","last_unstale":"2023-11-30T17:07:16.295020+0000","last_undegraded":"2023-11-30T17:07:16.295020+0000","last_fullsized":"2023-11-30T17:07:16.295020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.304020+0000","last_change":"2023-11-30T17:07:16.296058+0000","last_active":"2023-11-30T17:07:16.304020+0000","last_peered":"2023-11-30T17:07:16.304020+0000","last_clean":"2023-11-30T17:07:16.304020+0000","last_became_active":"2023-11-30T17:07:16.295800+0000","last_became_peered":"2023-11-30T17:07:16.295800+0000","last_unstale":"2023-11-30T17:07:16.304020+0000","last_undegraded":"2023-11-30T17:07:16.304020+0000","last_fullsized":"2023-11-30T17:07:16.304020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.294447+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:07:16.294447+0000","last_peered":"2023-11-30T17:07:16.294447+0000","last_clean":"2023-11-30T17:07:16.294447+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:07:16.294447+0000","last_undegraded":"2023-11-30T17:07:16.294447+0000","last_fullsized":"2023-11-30T17:07:16.294447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.289819+0000","last_change":"2023-11-30T17:07:15.908114+0000","last_active":"2023-11-30T17:07:16.289819+0000","last_peered":"2023-11-30T17:07:16.289819+0000","last_clean":"2023-11-30T17:07:16.289819+0000","last_became_active":"2023-11-30T17:07:15.907787+0000","last_became_peered":"2023-11-30T17:07:15.907787+0000","last_unstale":"2023-11-30T17:07:16.289819+0000","last_undegraded":"2023-11-30T17:07:16.289819+0000","last_fullsized":"2023-11-30T17:07:16.289819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295873+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:07:16.295873+0000","last_peered":"2023-11-30T17:07:16.295873+0000","last_clean":"2023-11-30T17:07:16.295873+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:07:16.295873+0000","last_undegraded":"2023-11-30T17:07:16.295873+0000","last_fullsized":"2023-11-30T17:07:16.295873+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.285991+0000","last_change":"2023-11-30T17:07:15.912233+0000","last_active":"2023-11-30T17:07:16.285991+0000","last_peered":"2023-11-30T17:07:16.285991+0000","last_clean":"2023-11-30T17:07:16.285991+0000","last_became_active":"2023-11-30T17:07:15.911944+0000","last_became_peered":"2023-11-30T17:07:15.911944+0000","last_unstale":"2023-11-30T17:07:16.285991+0000","last_undegraded":"2023-11-30T17:07:16.285991+0000","last_fullsized":"2023-11-30T17:07:16.285991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315990+0000","last_change":"2023-11-30T17:07:16.314967+0000","last_active":"2023-11-30T17:07:16.315990+0000","last_peered":"2023-11-30T17:07:16.315990+0000","last_clean":"2023-11-30T17:07:16.315990+0000","last_became_active":"2023-11-30T17:07:16.313860+0000","last_became_peered":"2023-11-30T17:07:16.313860+0000","last_unstale":"2023-11-30T17:07:16.315990+0000","last_undegraded":"2023-11-30T17:07:16.315990+0000","last_fullsized":"2023-11-30T17:07:16.315990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.311367+0000","last_change":"2023-11-30T17:07:15.918489+0000","last_active":"2023-11-30T17:07:16.311367+0000","last_peered":"2023-11-30T17:07:16.311367+0000","last_clean":"2023-11-30T17:07:16.311367+0000","last_became_active":"2023-11-30T17:07:15.918200+0000","last_became_peered":"2023-11-30T17:07:15.918200+0000","last_unstale":"2023-11-30T17:07:16.311367+0000","last_undegraded":"2023-11-30T17:07:16.311367+0000","last_fullsized":"2023-11-30T17:07:16.311367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.286349+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:07:16.286349+0000","last_peered":"2023-11-30T17:07:16.286349+0000","last_clean":"2023-11-30T17:07:16.286349+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:07:16.286349+0000","last_undegraded":"2023-11-30T17:07:16.286349+0000","last_fullsized":"2023-11-30T17:07:16.286349+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308858+0000","last_change":"2023-11-30T17:07:16.307511+0000","last_active":"2023-11-30T17:07:16.308858+0000","last_peered":"2023-11-30T17:07:16.308858+0000","last_clean":"2023-11-30T17:07:16.308858+0000","last_became_active":"2023-11-30T17:07:16.307230+0000","last_became_peered":"2023-11-30T17:07:16.307230+0000","last_unstale":"2023-11-30T17:07:16.308858+0000","last_undegraded":"2023-11-30T17:07:16.308858+0000","last_fullsized":"2023-11-30T17:07:16.308858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.291598+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:07:16.291598+0000","last_peered":"2023-11-30T17:07:16.291598+0000","last_clean":"2023-11-30T17:07:16.291598+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:07:16.291598+0000","last_undegraded":"2023-11-30T17:07:16.291598+0000","last_fullsized":"2023-11-30T17:07:16.291598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.289782+0000","last_change":"2023-11-30T17:07:15.908349+0000","last_active":"2023-11-30T17:07:16.289782+0000","last_peered":"2023-11-30T17:07:16.289782+0000","last_clean":"2023-11-30T17:07:16.289782+0000","last_became_active":"2023-11-30T17:07:15.908063+0000","last_became_peered":"2023-11-30T17:07:15.908063+0000","last_unstale":"2023-11-30T17:07:16.289782+0000","last_undegraded":"2023-11-30T17:07:16.289782+0000","last_fullsized":"2023-11-30T17:07:16.289782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315272+0000","last_change":"2023-11-30T17:07:16.314378+0000","last_active":"2023-11-30T17:07:16.315272+0000","last_peered":"2023-11-30T17:07:16.315272+0000","last_clean":"2023-11-30T17:07:16.315272+0000","last_became_active":"2023-11-30T17:07:16.314073+0000","last_became_peered":"2023-11-30T17:07:16.314073+0000","last_unstale":"2023-11-30T17:07:16.315272+0000","last_undegraded":"2023-11-30T17:07:16.315272+0000","last_fullsized":"2023-11-30T17:07:16.315272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.309505+0000","last_change":"2023-11-30T17:07:16.304420+0000","last_active":"2023-11-30T17:07:16.309505+0000","last_peered":"2023-11-30T17:07:16.309505+0000","last_clean":"2023-11-30T17:07:16.309505+0000","last_became_active":"2023-11-30T17:07:16.304065+0000","last_became_peered":"2023-11-30T17:07:16.304065+0000","last_unstale":"2023-11-30T17:07:16.309505+0000","last_undegraded":"2023-11-30T17:07:16.309505+0000","last_fullsized":"2023-11-30T17:07:16.309505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.291238+0000","last_change":"2023-11-30T17:07:15.905313+0000","last_active":"2023-11-30T17:07:16.291238+0000","last_peered":"2023-11-30T17:07:16.291238+0000","last_clean":"2023-11-30T17:07:16.291238+0000","last_became_active":"2023-11-30T17:07:15.905016+0000","last_became_peered":"2023-11-30T17:07:15.905016+0000","last_unstale":"2023-11-30T17:07:16.291238+0000","last_undegraded":"2023-11-30T17:07:16.291238+0000","last_fullsized":"2023-11-30T17:07:16.291238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312205+0000","last_change":"2023-11-30T17:07:16.308479+0000","last_active":"2023-11-30T17:07:16.312205+0000","last_peered":"2023-11-30T17:07:16.312205+0000","last_clean":"2023-11-30T17:07:16.312205+0000","last_became_active":"2023-11-30T17:07:16.307732+0000","last_became_peered":"2023-11-30T17:07:16.307732+0000","last_unstale":"2023-11-30T17:07:16.312205+0000","last_undegraded":"2023-11-30T17:07:16.312205+0000","last_fullsized":"2023-11-30T17:07:16.312205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.303391+0000","last_change":"2023-11-30T17:07:15.907619+0000","last_active":"2023-11-30T17:07:16.303391+0000","last_peered":"2023-11-30T17:07:16.303391+0000","last_clean":"2023-11-30T17:07:16.303391+0000","last_became_active":"2023-11-30T17:07:15.907322+0000","last_became_peered":"2023-11-30T17:07:15.907322+0000","last_unstale":"2023-11-30T17:07:16.303391+0000","last_undegraded":"2023-11-30T17:07:16.303391+0000","last_fullsized":"2023-11-30T17:07:16.303391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312237+0000","last_change":"2023-11-30T17:07:16.307668+0000","last_active":"2023-11-30T17:07:16.312237+0000","last_peered":"2023-11-30T17:07:16.312237+0000","last_clean":"2023-11-30T17:07:16.312237+0000","last_became_active":"2023-11-30T17:07:16.306226+0000","last_became_peered":"2023-11-30T17:07:16.306226+0000","last_unstale":"2023-11-30T17:07:16.312237+0000","last_undegraded":"2023-11-30T17:07:16.312237+0000","last_fullsized":"2023-11-30T17:07:16.312237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315804+0000","last_change":"2023-11-30T17:07:15.910485+0000","last_active":"2023-11-30T17:07:16.315804+0000","last_peered":"2023-11-30T17:07:16.315804+0000","last_clean":"2023-11-30T17:07:16.315804+0000","last_became_active":"2023-11-30T17:07:15.909426+0000","last_became_peered":"2023-11-30T17:07:15.909426+0000","last_unstale":"2023-11-30T17:07:16.315804+0000","last_undegraded":"2023-11-30T17:07:16.315804+0000","last_fullsized":"2023-11-30T17:07:16.315804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.314207+0000","last_change":"2023-11-30T17:07:16.308666+0000","last_active":"2023-11-30T17:07:16.314207+0000","last_peered":"2023-11-30T17:07:16.314207+0000","last_clean":"2023-11-30T17:07:16.314207+0000","last_became_active":"2023-11-30T17:07:16.308353+0000","last_became_peered":"2023-11-30T17:07:16.308353+0000","last_unstale":"2023-11-30T17:07:16.314207+0000","last_undegraded":"2023-11-30T17:07:16.314207+0000","last_fullsized":"2023-11-30T17:07:16.314207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.305835+0000","last_change":"2023-11-30T17:07:15.899895+0000","last_active":"2023-11-30T17:07:16.305835+0000","last_peered":"2023-11-30T17:07:16.305835+0000","last_clean":"2023-11-30T17:07:16.305835+0000","last_became_active":"2023-11-30T17:07:15.899595+0000","last_became_peered":"2023-11-30T17:07:15.899595+0000","last_unstale":"2023-11-30T17:07:16.305835+0000","last_undegraded":"2023-11-30T17:07:16.305835+0000","last_fullsized":"2023-11-30T17:07:16.305835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.304474+0000","last_change":"2023-11-30T17:07:16.301694+0000","last_active":"2023-11-30T17:07:16.304474+0000","last_peered":"2023-11-30T17:07:16.304474+0000","last_clean":"2023-11-30T17:07:16.304474+0000","last_became_active":"2023-11-30T17:07:16.301392+0000","last_became_peered":"2023-11-30T17:07:16.301392+0000","last_unstale":"2023-11-30T17:07:16.304474+0000","last_undegraded":"2023-11-30T17:07:16.304474+0000","last_fullsized":"2023-11-30T17:07:16.304474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.309919+0000","last_change":"2023-11-30T17:07:15.905807+0000","last_active":"2023-11-30T17:07:16.309919+0000","last_peered":"2023-11-30T17:07:16.309919+0000","last_clean":"2023-11-30T17:07:16.309919+0000","last_became_active":"2023-11-30T17:07:15.905509+0000","last_became_peered":"2023-11-30T17:07:15.905509+0000","last_unstale":"2023-11-30T17:07:16.309919+0000","last_undegraded":"2023-11-30T17:07:16.309919+0000","last_fullsized":"2023-11-30T17:07:16.309919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.310536+0000","last_change":"2023-11-30T17:07:16.301265+0000","last_active":"2023-11-30T17:07:16.310536+0000","last_peered":"2023-11-30T17:07:16.310536+0000","last_clean":"2023-11-30T17:07:16.310536+0000","last_became_active":"2023-11-30T17:07:16.300966+0000","last_became_peered":"2023-11-30T17:07:16.300966+0000","last_unstale":"2023-11-30T17:07:16.310536+0000","last_undegraded":"2023-11-30T17:07:16.310536+0000","last_fullsized":"2023-11-30T17:07:16.310536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.291444+0000","last_change":"2023-11-30T17:07:15.907348+0000","last_active":"2023-11-30T17:07:16.291444+0000","last_peered":"2023-11-30T17:07:16.291444+0000","last_clean":"2023-11-30T17:07:16.291444+0000","last_became_active":"2023-11-30T17:07:15.907034+0000","last_became_peered":"2023-11-30T17:07:15.907034+0000","last_unstale":"2023-11-30T17:07:16.291444+0000","last_undegraded":"2023-11-30T17:07:16.291444+0000","last_fullsized":"2023-11-30T17:07:16.291444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.310519+0000","last_change":"2023-11-30T17:07:16.302759+0000","last_active":"2023-11-30T17:07:16.310519+0000","last_peered":"2023-11-30T17:07:16.310519+0000","last_clean":"2023-11-30T17:07:16.310519+0000","last_became_active":"2023-11-30T17:07:16.302501+0000","last_became_peered":"2023-11-30T17:07:16.302501+0000","last_unstale":"2023-11-30T17:07:16.310519+0000","last_undegraded":"2023-11-30T17:07:16.310519+0000","last_fullsized":"2023-11-30T17:07:16.310519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.292697+0000","last_change":"2023-11-30T17:07:15.915794+0000","last_active":"2023-11-30T17:07:16.292697+0000","last_peered":"2023-11-30T17:07:16.292697+0000","last_clean":"2023-11-30T17:07:16.292697+0000","last_became_active":"2023-11-30T17:07:15.915469+0000","last_became_peered":"2023-11-30T17:07:15.915469+0000","last_unstale":"2023-11-30T17:07:16.292697+0000","last_undegraded":"2023-11-30T17:07:16.292697+0000","last_fullsized":"2023-11-30T17:07:16.292697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.320036+0000","last_change":"2023-11-30T17:07:16.316288+0000","last_active":"2023-11-30T17:07:16.320036+0000","last_peered":"2023-11-30T17:07:16.320036+0000","last_clean":"2023-11-30T17:07:16.320036+0000","last_became_active":"2023-11-30T17:07:16.315974+0000","last_became_peered":"2023-11-30T17:07:16.315974+0000","last_unstale":"2023-11-30T17:07:16.320036+0000","last_undegraded":"2023-11-30T17:07:16.320036+0000","last_fullsized":"2023-11-30T17:07:16.320036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308587+0000","last_change":"2023-11-30T17:07:15.918830+0000","last_active":"2023-11-30T17:07:16.308587+0000","last_peered":"2023-11-30T17:07:16.308587+0000","last_clean":"2023-11-30T17:07:16.308587+0000","last_became_active":"2023-11-30T17:07:15.918553+0000","last_became_peered":"2023-11-30T17:07:15.918553+0000","last_unstale":"2023-11-30T17:07:16.308587+0000","last_undegraded":"2023-11-30T17:07:16.308587+0000","last_fullsized":"2023-11-30T17:07:16.308587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312385+0000","last_change":"2023-11-30T17:07:16.300603+0000","last_active":"2023-11-30T17:07:16.312385+0000","last_peered":"2023-11-30T17:07:16.312385+0000","last_clean":"2023-11-30T17:07:16.312385+0000","last_became_active":"2023-11-30T17:07:16.297982+0000","last_became_peered":"2023-11-30T17:07:16.297982+0000","last_unstale":"2023-11-30T17:07:16.312385+0000","last_undegraded":"2023-11-30T17:07:16.312385+0000","last_fullsized":"2023-11-30T17:07:16.312385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.291351+0000","last_change":"2023-11-30T17:07:15.905698+0000","last_active":"2023-11-30T17:07:16.291351+0000","last_peered":"2023-11-30T17:07:16.291351+0000","last_clean":"2023-11-30T17:07:16.291351+0000","last_became_active":"2023-11-30T17:07:15.905364+0000","last_became_peered":"2023-11-30T17:07:15.905364+0000","last_unstale":"2023-11-30T17:07:16.291351+0000","last_undegraded":"2023-11-30T17:07:16.291351+0000","last_fullsized":"2023-11-30T17:07:16.291351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.314168+0000","last_change":"2023-11-30T17:07:16.310762+0000","last_active":"2023-11-30T17:07:16.314168+0000","last_peered":"2023-11-30T17:07:16.314168+0000","last_clean":"2023-11-30T17:07:16.314168+0000","last_became_active":"2023-11-30T17:07:16.310459+0000","last_became_peered":"2023-11-30T17:07:16.310459+0000","last_unstale":"2023-11-30T17:07:16.314168+0000","last_undegraded":"2023-11-30T17:07:16.314168+0000","last_fullsized":"2023-11-30T17:07:16.314168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.296049+0000","last_change":"2023-11-30T17:07:15.905922+0000","last_active":"2023-11-30T17:07:16.296049+0000","last_peered":"2023-11-30T17:07:16.296049+0000","last_clean":"2023-11-30T17:07:16.296049+0000","last_became_active":"2023-11-30T17:07:15.905607+0000","last_became_peered":"2023-11-30T17:07:15.905607+0000","last_unstale":"2023-11-30T17:07:16.296049+0000","last_undegraded":"2023-11-30T17:07:16.296049+0000","last_fullsized":"2023-11-30T17:07:16.296049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.314769+0000","last_change":"2023-11-30T17:07:16.310200+0000","last_active":"2023-11-30T17:07:16.314769+0000","last_peered":"2023-11-30T17:07:16.314769+0000","last_clean":"2023-11-30T17:07:16.314769+0000","last_became_active":"2023-11-30T17:07:16.309645+0000","last_became_peered":"2023-11-30T17:07:16.309645+0000","last_unstale":"2023-11-30T17:07:16.314769+0000","last_undegraded":"2023-11-30T17:07:16.314769+0000","last_fullsized":"2023-11-30T17:07:16.314769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.285637+0000","last_change":"2023-11-30T17:07:15.913510+0000","last_active":"2023-11-30T17:07:16.285637+0000","last_peered":"2023-11-30T17:07:16.285637+0000","last_clean":"2023-11-30T17:07:16.285637+0000","last_became_active":"2023-11-30T17:07:15.913195+0000","last_became_peered":"2023-11-30T17:07:15.913195+0000","last_unstale":"2023-11-30T17:07:16.285637+0000","last_undegraded":"2023-11-30T17:07:16.285637+0000","last_fullsized":"2023-11-30T17:07:16.285637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307638+0000","last_change":"2023-11-30T17:07:16.305749+0000","last_active":"2023-11-30T17:07:16.307638+0000","last_peered":"2023-11-30T17:07:16.307638+0000","last_clean":"2023-11-30T17:07:16.307638+0000","last_became_active":"2023-11-30T17:07:16.305460+0000","last_became_peered":"2023-11-30T17:07:16.305460+0000","last_unstale":"2023-11-30T17:07:16.307638+0000","last_undegraded":"2023-11-30T17:07:16.307638+0000","last_fullsized":"2023-11-30T17:07:16.307638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-30T17:07:17.291653+0000","last_change":"2023-11-30T17:07:15.915366+0000","last_active":"2023-11-30T17:07:17.291653+0000","last_peered":"2023-11-30T17:07:17.291653+0000","last_clean":"2023-11-30T17:07:17.291653+0000","last_became_active":"2023-11-30T17:07:15.915099+0000","last_became_peered":"2023-11-30T17:07:15.915099+0000","last_unstale":"2023-11-30T17:07:17.291653+0000","last_undegraded":"2023-11-30T17:07:17.291653+0000","last_fullsized":"2023-11-30T17:07:17.291653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.303911+0000","last_change":"2023-11-30T17:07:16.300223+0000","last_active":"2023-11-30T17:07:16.303911+0000","last_peered":"2023-11-30T17:07:16.303911+0000","last_clean":"2023-11-30T17:07:16.303911+0000","last_became_active":"2023-11-30T17:07:16.299885+0000","last_became_peered":"2023-11-30T17:07:16.299885+0000","last_unstale":"2023-11-30T17:07:16.303911+0000","last_undegraded":"2023-11-30T17:07:16.303911+0000","last_fullsized":"2023-11-30T17:07:16.303911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.298199+0000","last_change":"2023-11-30T17:07:15.912712+0000","last_active":"2023-11-30T17:07:16.298199+0000","last_peered":"2023-11-30T17:07:16.298199+0000","last_clean":"2023-11-30T17:07:16.298199+0000","last_became_active":"2023-11-30T17:07:15.912259+0000","last_became_peered":"2023-11-30T17:07:15.912259+0000","last_unstale":"2023-11-30T17:07:16.298199+0000","last_undegraded":"2023-11-30T17:07:16.298199+0000","last_fullsized":"2023-11-30T17:07:16.298199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.313787+0000","last_change":"2023-11-30T17:07:16.309299+0000","last_active":"2023-11-30T17:07:16.313787+0000","last_peered":"2023-11-30T17:07:16.313787+0000","last_clean":"2023-11-30T17:07:16.313787+0000","last_became_active":"2023-11-30T17:07:16.308844+0000","last_became_peered":"2023-11-30T17:07:16.308844+0000","last_unstale":"2023-11-30T17:07:16.313787+0000","last_undegraded":"2023-11-30T17:07:16.313787+0000","last_fullsized":"2023-11-30T17:07:16.313787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.298030+0000","last_change":"2023-11-30T17:07:15.920996+0000","last_active":"2023-11-30T17:07:16.298030+0000","last_peered":"2023-11-30T17:07:16.298030+0000","last_clean":"2023-11-30T17:07:16.298030+0000","last_became_active":"2023-11-30T17:07:15.920782+0000","last_became_peered":"2023-11-30T17:07:15.920782+0000","last_unstale":"2023-11-30T17:07:16.298030+0000","last_undegraded":"2023-11-30T17:07:16.298030+0000","last_fullsized":"2023-11-30T17:07:16.298030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307613+0000","last_change":"2023-11-30T17:07:16.304597+0000","last_active":"2023-11-30T17:07:16.307613+0000","last_peered":"2023-11-30T17:07:16.307613+0000","last_clean":"2023-11-30T17:07:16.307613+0000","last_became_active":"2023-11-30T17:07:16.304251+0000","last_became_peered":"2023-11-30T17:07:16.304251+0000","last_unstale":"2023-11-30T17:07:16.307613+0000","last_undegraded":"2023-11-30T17:07:16.307613+0000","last_fullsized":"2023-11-30T17:07:16.307613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.297402+0000","last_change":"2023-11-30T17:07:15.913299+0000","last_active":"2023-11-30T17:07:16.297402+0000","last_peered":"2023-11-30T17:07:16.297402+0000","last_clean":"2023-11-30T17:07:16.297402+0000","last_became_active":"2023-11-30T17:07:15.912978+0000","last_became_peered":"2023-11-30T17:07:15.912978+0000","last_unstale":"2023-11-30T17:07:16.297402+0000","last_undegraded":"2023-11-30T17:07:16.297402+0000","last_fullsized":"2023-11-30T17:07:16.297402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315291+0000","last_change":"2023-11-30T17:07:16.311213+0000","last_active":"2023-11-30T17:07:16.315291+0000","last_peered":"2023-11-30T17:07:16.315291+0000","last_clean":"2023-11-30T17:07:16.315291+0000","last_became_active":"2023-11-30T17:07:16.309590+0000","last_became_peered":"2023-11-30T17:07:16.309590+0000","last_unstale":"2023-11-30T17:07:16.315291+0000","last_undegraded":"2023-11-30T17:07:16.315291+0000","last_fullsized":"2023-11-30T17:07:16.315291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308744+0000","last_change":"2023-11-30T17:07:15.917988+0000","last_active":"2023-11-30T17:07:16.308744+0000","last_peered":"2023-11-30T17:07:16.308744+0000","last_clean":"2023-11-30T17:07:16.308744+0000","last_became_active":"2023-11-30T17:07:15.917715+0000","last_became_peered":"2023-11-30T17:07:15.917715+0000","last_unstale":"2023-11-30T17:07:16.308744+0000","last_undegraded":"2023-11-30T17:07:16.308744+0000","last_fullsized":"2023-11-30T17:07:16.308744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.309259+0000","last_change":"2023-11-30T17:07:16.305167+0000","last_active":"2023-11-30T17:07:16.309259+0000","last_peered":"2023-11-30T17:07:16.309259+0000","last_clean":"2023-11-30T17:07:16.309259+0000","last_became_active":"2023-11-30T17:07:16.304366+0000","last_became_peered":"2023-11-30T17:07:16.304366+0000","last_unstale":"2023-11-30T17:07:16.309259+0000","last_undegraded":"2023-11-30T17:07:16.309259+0000","last_fullsized":"2023-11-30T17:07:16.309259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.309634+0000","last_change":"2023-11-30T17:07:15.913349+0000","last_active":"2023-11-30T17:07:16.309634+0000","last_peered":"2023-11-30T17:07:16.309634+0000","last_clean":"2023-11-30T17:07:16.309634+0000","last_became_active":"2023-11-30T17:07:15.912819+0000","last_became_peered":"2023-11-30T17:07:15.912819+0000","last_unstale":"2023-11-30T17:07:16.309634+0000","last_undegraded":"2023-11-30T17:07:16.309634+0000","last_fullsized":"2023-11-30T17:07:16.309634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312387+0000","last_change":"2023-11-30T17:07:16.307878+0000","last_active":"2023-11-30T17:07:16.312387+0000","last_peered":"2023-11-30T17:07:16.312387+0000","last_clean":"2023-11-30T17:07:16.312387+0000","last_became_active":"2023-11-30T17:07:16.307596+0000","last_became_peered":"2023-11-30T17:07:16.307596+0000","last_unstale":"2023-11-30T17:07:16.312387+0000","last_undegraded":"2023-11-30T17:07:16.312387+0000","last_fullsized":"2023-11-30T17:07:16.312387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.289290+0000","last_change":"2023-11-30T17:07:15.905418+0000","last_active":"2023-11-30T17:07:16.289290+0000","last_peered":"2023-11-30T17:07:16.289290+0000","last_clean":"2023-11-30T17:07:16.289290+0000","last_became_active":"2023-11-30T17:07:15.905118+0000","last_became_peered":"2023-11-30T17:07:15.905118+0000","last_unstale":"2023-11-30T17:07:16.289290+0000","last_undegraded":"2023-11-30T17:07:16.289290+0000","last_fullsized":"2023-11-30T17:07:16.289290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295717+0000","last_change":"2023-11-30T17:07:16.294026+0000","last_active":"2023-11-30T17:07:16.295717+0000","last_peered":"2023-11-30T17:07:16.295717+0000","last_clean":"2023-11-30T17:07:16.295717+0000","last_became_active":"2023-11-30T17:07:16.293758+0000","last_became_peered":"2023-11-30T17:07:16.293758+0000","last_unstale":"2023-11-30T17:07:16.295717+0000","last_undegraded":"2023-11-30T17:07:16.295717+0000","last_fullsized":"2023-11-30T17:07:16.295717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.310234+0000","last_change":"2023-11-30T17:07:15.914406+0000","last_active":"2023-11-30T17:07:16.310234+0000","last_peered":"2023-11-30T17:07:16.310234+0000","last_clean":"2023-11-30T17:07:16.310234+0000","last_became_active":"2023-11-30T17:07:15.914121+0000","last_became_peered":"2023-11-30T17:07:15.914121+0000","last_unstale":"2023-11-30T17:07:16.310234+0000","last_undegraded":"2023-11-30T17:07:16.310234+0000","last_fullsized":"2023-11-30T17:07:16.310234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307697+0000","last_change":"2023-11-30T17:07:16.306238+0000","last_active":"2023-11-30T17:07:16.307697+0000","last_peered":"2023-11-30T17:07:16.307697+0000","last_clean":"2023-11-30T17:07:16.307697+0000","last_became_active":"2023-11-30T17:07:16.305963+0000","last_became_peered":"2023-11-30T17:07:16.305963+0000","last_unstale":"2023-11-30T17:07:16.307697+0000","last_undegraded":"2023-11-30T17:07:16.307697+0000","last_fullsized":"2023-11-30T17:07:16.307697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.293985+0000","last_change":"2023-11-30T17:07:15.909372+0000","last_active":"2023-11-30T17:07:16.293985+0000","last_peered":"2023-11-30T17:07:16.293985+0000","last_clean":"2023-11-30T17:07:16.293985+0000","last_became_active":"2023-11-30T17:07:15.909092+0000","last_became_peered":"2023-11-30T17:07:15.909092+0000","last_unstale":"2023-11-30T17:07:16.293985+0000","last_undegraded":"2023-11-30T17:07:16.293985+0000","last_fullsized":"2023-11-30T17:07:16.293985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315497+0000","last_change":"2023-11-30T17:07:16.309056+0000","last_active":"2023-11-30T17:07:16.315497+0000","last_peered":"2023-11-30T17:07:16.315497+0000","last_clean":"2023-11-30T17:07:16.315497+0000","last_became_active":"2023-11-30T17:07:16.308728+0000","last_became_peered":"2023-11-30T17:07:16.308728+0000","last_unstale":"2023-11-30T17:07:16.315497+0000","last_undegraded":"2023-11-30T17:07:16.315497+0000","last_fullsized":"2023-11-30T17:07:16.315497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.306826+0000","last_change":"2023-11-30T17:07:15.914123+0000","last_active":"2023-11-30T17:07:16.306826+0000","last_peered":"2023-11-30T17:07:16.306826+0000","last_clean":"2023-11-30T17:07:16.306826+0000","last_became_active":"2023-11-30T17:07:15.913855+0000","last_became_peered":"2023-11-30T17:07:15.913855+0000","last_unstale":"2023-11-30T17:07:16.306826+0000","last_undegraded":"2023-11-30T17:07:16.306826+0000","last_fullsized":"2023-11-30T17:07:16.306826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.313763+0000","last_change":"2023-11-30T17:07:16.309110+0000","last_active":"2023-11-30T17:07:16.313763+0000","last_peered":"2023-11-30T17:07:16.313763+0000","last_clean":"2023-11-30T17:07:16.313763+0000","last_became_active":"2023-11-30T17:07:16.308500+0000","last_became_peered":"2023-11-30T17:07:16.308500+0000","last_unstale":"2023-11-30T17:07:16.313763+0000","last_undegraded":"2023-11-30T17:07:16.313763+0000","last_fullsized":"2023-11-30T17:07:16.313763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.313277+0000","last_change":"2023-11-30T17:07:15.909703+0000","last_active":"2023-11-30T17:07:16.313277+0000","last_peered":"2023-11-30T17:07:16.313277+0000","last_clean":"2023-11-30T17:07:16.313277+0000","last_became_active":"2023-11-30T17:07:15.909387+0000","last_became_peered":"2023-11-30T17:07:15.909387+0000","last_unstale":"2023-11-30T17:07:16.313277+0000","last_undegraded":"2023-11-30T17:07:16.313277+0000","last_fullsized":"2023-11-30T17:07:16.313277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318600+0000","last_change":"2023-11-30T17:07:16.314404+0000","last_active":"2023-11-30T17:07:16.318600+0000","last_peered":"2023-11-30T17:07:16.318600+0000","last_clean":"2023-11-30T17:07:16.318600+0000","last_became_active":"2023-11-30T17:07:16.314144+0000","last_became_peered":"2023-11-30T17:07:16.314144+0000","last_unstale":"2023-11-30T17:07:16.318600+0000","last_undegraded":"2023-11-30T17:07:16.318600+0000","last_fullsized":"2023-11-30T17:07:16.318600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.285577+0000","last_change":"2023-11-30T17:07:15.907074+0000","last_active":"2023-11-30T17:07:16.285577+0000","last_peered":"2023-11-30T17:07:16.285577+0000","last_clean":"2023-11-30T17:07:16.285577+0000","last_became_active":"2023-11-30T17:07:15.906537+0000","last_became_peered":"2023-11-30T17:07:15.906537+0000","last_unstale":"2023-11-30T17:07:16.285577+0000","last_undegraded":"2023-11-30T17:07:16.285577+0000","last_fullsized":"2023-11-30T17:07:16.285577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308169+0000","last_change":"2023-11-30T17:07:16.304623+0000","last_active":"2023-11-30T17:07:16.308169+0000","last_peered":"2023-11-30T17:07:16.308169+0000","last_clean":"2023-11-30T17:07:16.308169+0000","last_became_active":"2023-11-30T17:07:16.303986+0000","last_became_peered":"2023-11-30T17:07:16.303986+0000","last_unstale":"2023-11-30T17:07:16.308169+0000","last_undegraded":"2023-11-30T17:07:16.308169+0000","last_fullsized":"2023-11-30T17:07:16.308169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.288987+0000","last_change":"2023-11-30T17:07:15.905081+0000","last_active":"2023-11-30T17:07:16.288987+0000","last_peered":"2023-11-30T17:07:16.288987+0000","last_clean":"2023-11-30T17:07:16.288987+0000","last_became_active":"2023-11-30T17:07:15.903780+0000","last_became_peered":"2023-11-30T17:07:15.903780+0000","last_unstale":"2023-11-30T17:07:16.288987+0000","last_undegraded":"2023-11-30T17:07:16.288987+0000","last_fullsized":"2023-11-30T17:07:16.288987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.301942+0000","last_change":"2023-11-30T17:07:16.300473+0000","last_active":"2023-11-30T17:07:16.301942+0000","last_peered":"2023-11-30T17:07:16.301942+0000","last_clean":"2023-11-30T17:07:16.301942+0000","last_became_active":"2023-11-30T17:07:16.300201+0000","last_became_peered":"2023-11-30T17:07:16.300201+0000","last_unstale":"2023-11-30T17:07:16.301942+0000","last_undegraded":"2023-11-30T17:07:16.301942+0000","last_fullsized":"2023-11-30T17:07:16.301942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.306129+0000","last_change":"2023-11-30T17:07:15.903443+0000","last_active":"2023-11-30T17:07:16.306129+0000","last_peered":"2023-11-30T17:07:16.306129+0000","last_clean":"2023-11-30T17:07:16.306129+0000","last_became_active":"2023-11-30T17:07:15.902100+0000","last_became_peered":"2023-11-30T17:07:15.902100+0000","last_unstale":"2023-11-30T17:07:16.306129+0000","last_undegraded":"2023-11-30T17:07:16.306129+0000","last_fullsized":"2023-11-30T17:07:16.306129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.311052+0000","last_change":"2023-11-30T17:07:16.308777+0000","last_active":"2023-11-30T17:07:16.311052+0000","last_peered":"2023-11-30T17:07:16.311052+0000","last_clean":"2023-11-30T17:07:16.311052+0000","last_became_active":"2023-11-30T17:07:16.308488+0000","last_became_peered":"2023-11-30T17:07:16.308488+0000","last_unstale":"2023-11-30T17:07:16.311052+0000","last_undegraded":"2023-11-30T17:07:16.311052+0000","last_fullsized":"2023-11-30T17:07:16.311052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318584+0000","last_change":"2023-11-30T17:07:15.909022+0000","last_active":"2023-11-30T17:07:16.318584+0000","last_peered":"2023-11-30T17:07:16.318584+0000","last_clean":"2023-11-30T17:07:16.318584+0000","last_became_active":"2023-11-30T17:07:15.908674+0000","last_became_peered":"2023-11-30T17:07:15.908674+0000","last_unstale":"2023-11-30T17:07:16.318584+0000","last_undegraded":"2023-11-30T17:07:16.318584+0000","last_fullsized":"2023-11-30T17:07:16.318584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318514+0000","last_change":"2023-11-30T17:07:16.313527+0000","last_active":"2023-11-30T17:07:16.318514+0000","last_peered":"2023-11-30T17:07:16.318514+0000","last_clean":"2023-11-30T17:07:16.318514+0000","last_became_active":"2023-11-30T17:07:16.313199+0000","last_became_peered":"2023-11-30T17:07:16.313199+0000","last_unstale":"2023-11-30T17:07:16.318514+0000","last_undegraded":"2023-11-30T17:07:16.318514+0000","last_fullsized":"2023-11-30T17:07:16.318514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.288932+0000","last_change":"2023-11-30T17:07:15.914420+0000","last_active":"2023-11-30T17:07:16.288932+0000","last_peered":"2023-11-30T17:07:16.288932+0000","last_clean":"2023-11-30T17:07:16.288932+0000","last_became_active":"2023-11-30T17:07:15.914142+0000","last_became_peered":"2023-11-30T17:07:15.914142+0000","last_unstale":"2023-11-30T17:07:16.288932+0000","last_undegraded":"2023-11-30T17:07:16.288932+0000","last_fullsized":"2023-11-30T17:07:16.288932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308304+0000","last_change":"2023-11-30T17:07:16.305961+0000","last_active":"2023-11-30T17:07:16.308304+0000","last_peered":"2023-11-30T17:07:16.308304+0000","last_clean":"2023-11-30T17:07:16.308304+0000","last_became_active":"2023-11-30T17:07:16.305363+0000","last_became_peered":"2023-11-30T17:07:16.305363+0000","last_unstale":"2023-11-30T17:07:16.308304+0000","last_undegraded":"2023-11-30T17:07:16.308304+0000","last_fullsized":"2023-11-30T17:07:16.308304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.291553+0000","last_change":"2023-11-30T17:07:15.911255+0000","last_active":"2023-11-30T17:07:16.291553+0000","last_peered":"2023-11-30T17:07:16.291553+0000","last_clean":"2023-11-30T17:07:16.291553+0000","last_became_active":"2023-11-30T17:07:15.910945+0000","last_became_peered":"2023-11-30T17:07:15.910945+0000","last_unstale":"2023-11-30T17:07:16.291553+0000","last_undegraded":"2023-11-30T17:07:16.291553+0000","last_fullsized":"2023-11-30T17:07:16.291553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.314860+0000","last_change":"2023-11-30T17:07:16.310924+0000","last_active":"2023-11-30T17:07:16.314860+0000","last_peered":"2023-11-30T17:07:16.314860+0000","last_clean":"2023-11-30T17:07:16.314860+0000","last_became_active":"2023-11-30T17:07:16.310631+0000","last_became_peered":"2023-11-30T17:07:16.310631+0000","last_unstale":"2023-11-30T17:07:16.314860+0000","last_undegraded":"2023-11-30T17:07:16.314860+0000","last_fullsized":"2023-11-30T17:07:16.314860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.297213+0000","last_change":"2023-11-30T17:07:15.917972+0000","last_active":"2023-11-30T17:07:16.297213+0000","last_peered":"2023-11-30T17:07:16.297213+0000","last_clean":"2023-11-30T17:07:16.297213+0000","last_became_active":"2023-11-30T17:07:15.917546+0000","last_became_peered":"2023-11-30T17:07:15.917546+0000","last_unstale":"2023-11-30T17:07:16.297213+0000","last_undegraded":"2023-11-30T17:07:16.297213+0000","last_fullsized":"2023-11-30T17:07:16.297213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.311505+0000","last_change":"2023-11-30T17:07:16.309537+0000","last_active":"2023-11-30T17:07:16.311505+0000","last_peered":"2023-11-30T17:07:16.311505+0000","last_clean":"2023-11-30T17:07:16.311505+0000","last_became_active":"2023-11-30T17:07:16.309220+0000","last_became_peered":"2023-11-30T17:07:16.309220+0000","last_unstale":"2023-11-30T17:07:16.311505+0000","last_undegraded":"2023-11-30T17:07:16.311505+0000","last_fullsized":"2023-11-30T17:07:16.311505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.294800+0000","last_change":"2023-11-30T17:07:15.913708+0000","last_active":"2023-11-30T17:07:16.294800+0000","last_peered":"2023-11-30T17:07:16.294800+0000","last_clean":"2023-11-30T17:07:16.294800+0000","last_became_active":"2023-11-30T17:07:15.913418+0000","last_became_peered":"2023-11-30T17:07:15.913418+0000","last_unstale":"2023-11-30T17:07:16.294800+0000","last_undegraded":"2023-11-30T17:07:16.294800+0000","last_fullsized":"2023-11-30T17:07:16.294800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318618+0000","last_change":"2023-11-30T17:07:16.314589+0000","last_active":"2023-11-30T17:07:16.318618+0000","last_peered":"2023-11-30T17:07:16.318618+0000","last_clean":"2023-11-30T17:07:16.318618+0000","last_became_active":"2023-11-30T17:07:16.313770+0000","last_became_peered":"2023-11-30T17:07:16.313770+0000","last_unstale":"2023-11-30T17:07:16.318618+0000","last_undegraded":"2023-11-30T17:07:16.318618+0000","last_fullsized":"2023-11-30T17:07:16.318618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295850+0000","last_change":"2023-11-30T17:07:15.914471+0000","last_active":"2023-11-30T17:07:16.295850+0000","last_peered":"2023-11-30T17:07:16.295850+0000","last_clean":"2023-11-30T17:07:16.295850+0000","last_became_active":"2023-11-30T17:07:15.914170+0000","last_became_peered":"2023-11-30T17:07:15.914170+0000","last_unstale":"2023-11-30T17:07:16.295850+0000","last_undegraded":"2023-11-30T17:07:16.295850+0000","last_fullsized":"2023-11-30T17:07:16.295850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.314949+0000","last_change":"2023-11-30T17:07:16.309802+0000","last_active":"2023-11-30T17:07:16.314949+0000","last_peered":"2023-11-30T17:07:16.314949+0000","last_clean":"2023-11-30T17:07:16.314949+0000","last_became_active":"2023-11-30T17:07:16.309499+0000","last_became_peered":"2023-11-30T17:07:16.309499+0000","last_unstale":"2023-11-30T17:07:16.314949+0000","last_undegraded":"2023-11-30T17:07:16.314949+0000","last_fullsized":"2023-11-30T17:07:16.314949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.313989+0000","last_change":"2023-11-30T17:07:15.909306+0000","last_active":"2023-11-30T17:07:16.313989+0000","last_peered":"2023-11-30T17:07:16.313989+0000","last_clean":"2023-11-30T17:07:16.313989+0000","last_became_active":"2023-11-30T17:07:15.909030+0000","last_became_peered":"2023-11-30T17:07:15.909030+0000","last_unstale":"2023-11-30T17:07:16.313989+0000","last_undegraded":"2023-11-30T17:07:16.313989+0000","last_fullsized":"2023-11-30T17:07:16.313989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307156+0000","last_change":"2023-11-30T17:07:16.303384+0000","last_active":"2023-11-30T17:07:16.307156+0000","last_peered":"2023-11-30T17:07:16.307156+0000","last_clean":"2023-11-30T17:07:16.307156+0000","last_became_active":"2023-11-30T17:07:16.298413+0000","last_became_peered":"2023-11-30T17:07:16.298413+0000","last_unstale":"2023-11-30T17:07:16.307156+0000","last_undegraded":"2023-11-30T17:07:16.307156+0000","last_fullsized":"2023-11-30T17:07:16.307156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.305248+0000","last_change":"2023-11-30T17:07:15.914690+0000","last_active":"2023-11-30T17:07:16.305248+0000","last_peered":"2023-11-30T17:07:16.305248+0000","last_clean":"2023-11-30T17:07:16.305248+0000","last_became_active":"2023-11-30T17:07:15.914405+0000","last_became_peered":"2023-11-30T17:07:15.914405+0000","last_unstale":"2023-11-30T17:07:16.305248+0000","last_undegraded":"2023-11-30T17:07:16.305248+0000","last_fullsized":"2023-11-30T17:07:16.305248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.310006+0000","last_change":"2023-11-30T17:07:16.306951+0000","last_active":"2023-11-30T17:07:16.310006+0000","last_peered":"2023-11-30T17:07:16.310006+0000","last_clean":"2023-11-30T17:07:16.310006+0000","last_became_active":"2023-11-30T17:07:16.306691+0000","last_became_peered":"2023-11-30T17:07:16.306691+0000","last_unstale":"2023-11-30T17:07:16.310006+0000","last_undegraded":"2023-11-30T17:07:16.310006+0000","last_fullsized":"2023-11-30T17:07:16.310006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312888+0000","last_change":"2023-11-30T17:07:15.913637+0000","last_active":"2023-11-30T17:07:16.312888+0000","last_peered":"2023-11-30T17:07:16.312888+0000","last_clean":"2023-11-30T17:07:16.312888+0000","last_became_active":"2023-11-30T17:07:15.913336+0000","last_became_peered":"2023-11-30T17:07:15.913336+0000","last_unstale":"2023-11-30T17:07:16.312888+0000","last_undegraded":"2023-11-30T17:07:16.312888+0000","last_fullsized":"2023-11-30T17:07:16.312888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.314791+0000","last_change":"2023-11-30T17:07:16.310337+0000","last_active":"2023-11-30T17:07:16.314791+0000","last_peered":"2023-11-30T17:07:16.314791+0000","last_clean":"2023-11-30T17:07:16.314791+0000","last_became_active":"2023-11-30T17:07:16.310010+0000","last_became_peered":"2023-11-30T17:07:16.310010+0000","last_unstale":"2023-11-30T17:07:16.314791+0000","last_undegraded":"2023-11-30T17:07:16.314791+0000","last_fullsized":"2023-11-30T17:07:16.314791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.290031+0000","last_change":"2023-11-30T17:07:15.912918+0000","last_active":"2023-11-30T17:07:16.290031+0000","last_peered":"2023-11-30T17:07:16.290031+0000","last_clean":"2023-11-30T17:07:16.290031+0000","last_became_active":"2023-11-30T17:07:15.912624+0000","last_became_peered":"2023-11-30T17:07:15.912624+0000","last_unstale":"2023-11-30T17:07:16.290031+0000","last_undegraded":"2023-11-30T17:07:16.290031+0000","last_fullsized":"2023-11-30T17:07:16.290031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308325+0000","last_change":"2023-11-30T17:07:16.306137+0000","last_active":"2023-11-30T17:07:16.308325+0000","last_peered":"2023-11-30T17:07:16.308325+0000","last_clean":"2023-11-30T17:07:16.308325+0000","last_became_active":"2023-11-30T17:07:16.305673+0000","last_became_peered":"2023-11-30T17:07:16.305673+0000","last_unstale":"2023-11-30T17:07:16.308325+0000","last_undegraded":"2023-11-30T17:07:16.308325+0000","last_fullsized":"2023-11-30T17:07:16.308325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.286516+0000","last_change":"2023-11-30T17:07:15.912021+0000","last_active":"2023-11-30T17:07:16.286516+0000","last_peered":"2023-11-30T17:07:16.286516+0000","last_clean":"2023-11-30T17:07:16.286516+0000","last_became_active":"2023-11-30T17:07:15.911720+0000","last_became_peered":"2023-11-30T17:07:15.911720+0000","last_unstale":"2023-11-30T17:07:16.286516+0000","last_undegraded":"2023-11-30T17:07:16.286516+0000","last_fullsized":"2023-11-30T17:07:16.286516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318594+0000","last_change":"2023-11-30T17:07:16.313578+0000","last_active":"2023-11-30T17:07:16.318594+0000","last_peered":"2023-11-30T17:07:16.318594+0000","last_clean":"2023-11-30T17:07:16.318594+0000","last_became_active":"2023-11-30T17:07:16.313325+0000","last_became_peered":"2023-11-30T17:07:16.313325+0000","last_unstale":"2023-11-30T17:07:16.318594+0000","last_undegraded":"2023-11-30T17:07:16.318594+0000","last_fullsized":"2023-11-30T17:07:16.318594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.311197+0000","last_change":"2023-11-30T17:07:15.908770+0000","last_active":"2023-11-30T17:07:16.311197+0000","last_peered":"2023-11-30T17:07:16.311197+0000","last_clean":"2023-11-30T17:07:16.311197+0000","last_became_active":"2023-11-30T17:07:15.908480+0000","last_became_peered":"2023-11-30T17:07:15.908480+0000","last_unstale":"2023-11-30T17:07:16.311197+0000","last_undegraded":"2023-11-30T17:07:16.311197+0000","last_fullsized":"2023-11-30T17:07:16.311197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297348,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074492,"statfs":{"total":96636764160,"available":96332279808,"internally_reserved":0,"allocated":258048,"data_stored":86755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":86787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297340,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074500,"statfs":{"total":96636764160,"available":96332288000,"internally_reserved":0,"allocated":249856,"data_stored":86933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:07:25.130 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-30T17:07:25.130 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-30T17:07:25.130 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-30T17:07:25.130 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-30T17:07:25.131 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-30T17:07:25.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.280+0000 7fe778a64700 1 Processor -- start 2023-11-30T17:07:25.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.280+0000 7fe778a64700 1 -- start start 2023-11-30T17:07:25.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.281+0000 7fe778a64700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe7740c0180 0x7fe774157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:25.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.281+0000 7fe778a64700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7740c12c0 con 0x7fe7740c1750 2023-11-30T17:07:25.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.281+0000 7fe778a64700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7740c06b0 con 0x7fe774157660 2023-11-30T17:07:25.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.281+0000 7fe778a64700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7740c0990 con 0x7fe7740c0180 2023-11-30T17:07:25.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.281+0000 7fe772ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe7740c0180 0x7fe774157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:25.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.281+0000 7fe773fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe7740c1750 0x7fe7740648d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34868/0 (socket says 172.21.15.49:34868) 2023-11-30T17:07:25.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.281+0000 7fe773fff700 1 -- 172.21.15.49:0/1301925463 learned_addr learned my addr 172.21.15.49:0/1301925463 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:25.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.281+0000 7fe772ffd700 1 -- 172.21.15.49:0/1301925463 >> v1:172.21.15.115:6789/0 conn(0x7fe774157660 legacy=0x7fe7741589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:25.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.281+0000 7fe772ffd700 1 -- 172.21.15.49:0/1301925463 >> v1:172.21.15.49:6789/0 conn(0x7fe7740c1750 legacy=0x7fe7740648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:25.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.281+0000 7fe772ffd700 1 -- 172.21.15.49:0/1301925463 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7740c0c70 con 0x7fe7740c0180 2023-11-30T17:07:25.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.281+0000 7fe7727fc700 1 -- 172.21.15.49:0/1301925463 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1292720295 0 0) 0x7fe7740c12c0 con 0x7fe7740c1750 2023-11-30T17:07:25.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.282+0000 7fe772ffd700 1 --2- 172.21.15.49:0/1301925463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7740c0180 0x7fe774157a40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fe768009760 tx=0x7fe768009060).ready entity=mon.0 client_cookie=271cb063fc8ed453 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:25.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.282+0000 7fe7727fc700 1 -- 172.21.15.49:0/1301925463 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76800b580 con 0x7fe7740c0180 2023-11-30T17:07:25.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.282+0000 7fe7727fc700 1 -- 172.21.15.49:0/1301925463 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76800b6e0 con 0x7fe7740c0180 2023-11-30T17:07:25.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.282+0000 7fe7727fc700 1 -- 172.21.15.49:0/1301925463 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76800ba60 con 0x7fe7740c0180 2023-11-30T17:07:25.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.282+0000 7fe778a64700 1 -- 172.21.15.49:0/1301925463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7740c0180 msgr2=0x7fe774157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:25.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.282+0000 7fe778a64700 1 --2- 172.21.15.49:0/1301925463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7740c0180 0x7fe774157a40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fe768009760 tx=0x7fe768009060).stop 2023-11-30T17:07:25.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.282+0000 7fe778a64700 1 -- 172.21.15.49:0/1301925463 shutdown_connections 2023-11-30T17:07:25.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.282+0000 7fe778a64700 1 --2- 172.21.15.49:0/1301925463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7740c0180 0x7fe774157a40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:25.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.282+0000 7fe778a64700 1 -- 172.21.15.49:0/1301925463 >> 172.21.15.49:0/1301925463 conn(0x7fe7740cb000 msgr2=0x7fe7740cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:25.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.282+0000 7fe778a64700 1 -- 172.21.15.49:0/1301925463 shutdown_connections 2023-11-30T17:07:25.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.282+0000 7fe778a64700 1 -- 172.21.15.49:0/1301925463 wait complete. 2023-11-30T17:07:25.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.283+0000 7fe778a64700 1 Processor -- start 2023-11-30T17:07:25.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.284+0000 7fe778a64700 1 -- start start 2023-11-30T17:07:25.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.284+0000 7fe778a64700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7740c0180 0x7fe774148d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:25.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.284+0000 7fe778a64700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7740c1750 0x7fe774167e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:25.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.284+0000 7fe778a64700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe774157660 0x7fe774168310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:25.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.284+0000 7fe778a64700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe774168800 con 0x7fe7740c1750 2023-11-30T17:07:25.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.284+0000 7fe778a64700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7740b08d0 con 0x7fe774157660 2023-11-30T17:07:25.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.284+0000 7fe778a64700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7740ae660 con 0x7fe7740c0180 2023-11-30T17:07:25.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.284+0000 7fe772ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7740c1750 0x7fe774167e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:25.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.284+0000 7fe772ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7740c1750 0x7fe774167e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59212/0 (socket says 172.21.15.49:59212) 2023-11-30T17:07:25.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.284+0000 7fe772ffd700 1 -- 172.21.15.49:0/833179836 learned_addr learned my addr 172.21.15.49:0/833179836 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:25.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.285+0000 7fe773fff700 1 --2- 172.21.15.49:0/833179836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe774157660 0x7fe774168310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:25.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.285+0000 7fe7737fe700 1 --2- 172.21.15.49:0/833179836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7740c0180 0x7fe774148d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:25.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.285+0000 7fe772ffd700 1 -- 172.21.15.49:0/833179836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7740c0180 msgr2=0x7fe774148d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:25.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.285+0000 7fe772ffd700 1 --2- 172.21.15.49:0/833179836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7740c0180 0x7fe774148d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:25.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.285+0000 7fe772ffd700 1 -- 172.21.15.49:0/833179836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe774157660 msgr2=0x7fe774168310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:25.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.285+0000 7fe772ffd700 1 --2- 172.21.15.49:0/833179836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe774157660 0x7fe774168310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:25.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.285+0000 7fe772ffd700 1 -- 172.21.15.49:0/833179836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7680092a0 con 0x7fe7740c1750 2023-11-30T17:07:25.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.285+0000 7fe7737fe700 1 --2- 172.21.15.49:0/833179836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7740c0180 0x7fe774148d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:25.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.285+0000 7fe773fff700 1 --2- 172.21.15.49:0/833179836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe774157660 0x7fe774168310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:25.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.285+0000 7fe772ffd700 1 --2- 172.21.15.49:0/833179836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7740c1750 0x7fe774167e20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fe768009eb0 tx=0x7fe768017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:25.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.285+0000 7fe75b7fe700 1 -- 172.21.15.49:0/833179836 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76800ba60 con 0x7fe7740c1750 2023-11-30T17:07:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.285+0000 7fe75b7fe700 1 -- 172.21.15.49:0/833179836 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe768000cc0 con 0x7fe7740c1750 2023-11-30T17:07:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.285+0000 7fe778a64700 1 -- 172.21.15.49:0/833179836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7740ae050 con 0x7fe7740c1750 2023-11-30T17:07:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.285+0000 7fe75b7fe700 1 -- 172.21.15.49:0/833179836 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76801b640 con 0x7fe7740c1750 2023-11-30T17:07:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.285+0000 7fe778a64700 1 -- 172.21.15.49:0/833179836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7740ae2f0 con 0x7fe7740c1750 2023-11-30T17:07:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.286+0000 7fe778a64700 1 -- 172.21.15.49:0/833179836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe774168da0 con 0x7fe7740c1750 2023-11-30T17:07:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.286+0000 7fe75b7fe700 1 -- 172.21.15.49:0/833179836 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe76801ba30 con 0x7fe7740c1750 2023-11-30T17:07:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.287+0000 7fe75b7fe700 1 --2- 172.21.15.49:0/833179836 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe76005f150 0x7fe760061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.287+0000 7fe75b7fe700 1 -- 172.21.15.49:0/833179836 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe76807be90 con 0x7fe7740c1750 2023-11-30T17:07:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.287+0000 7fe7737fe700 1 --2- 172.21.15.49:0/833179836 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe76005f150 0x7fe760061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.287+0000 7fe7737fe700 1 --2- 172.21.15.49:0/833179836 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe76005f150 0x7fe760061610 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fe7640016a0 tx=0x7fe764009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:25.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.291+0000 7fe75b7fe700 1 -- 172.21.15.49:0/833179836 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe774168da0 con 0x7fe7740c1750 2023-11-30T17:07:25.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.508+0000 7fe778a64700 1 -- 172.21.15.49:0/833179836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fe774168da0 con 0x7fe7740c1750 2023-11-30T17:07:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.511+0000 7fe75b7fe700 1 -- 172.21.15.49:0/833179836 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+148955 (secure 0 0 0) 0x7fe774168da0 con 0x7fe7740c1750 2023-11-30T17:07:25.515 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:25.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.513+0000 7fe778a64700 1 -- 172.21.15.49:0/833179836 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe76005f150 msgr2=0x7fe760061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:25.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.513+0000 7fe778a64700 1 --2- 172.21.15.49:0/833179836 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe76005f150 0x7fe760061610 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fe7640016a0 tx=0x7fe764009040).stop 2023-11-30T17:07:25.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.513+0000 7fe778a64700 1 -- 172.21.15.49:0/833179836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7740c1750 msgr2=0x7fe774167e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:25.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.513+0000 7fe778a64700 1 --2- 172.21.15.49:0/833179836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7740c1750 0x7fe774167e20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fe768009eb0 tx=0x7fe768017000).stop 2023-11-30T17:07:25.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.513+0000 7fe778a64700 1 -- 172.21.15.49:0/833179836 shutdown_connections 2023-11-30T17:07:25.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.513+0000 7fe778a64700 1 --2- 172.21.15.49:0/833179836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe774157660 0x7fe774168310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:25.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.513+0000 7fe778a64700 1 --2- 172.21.15.49:0/833179836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7740c0180 0x7fe774148d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:25.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.513+0000 7fe778a64700 1 --2- 172.21.15.49:0/833179836 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe76005f150 0x7fe760061610 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:25.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.513+0000 7fe778a64700 1 --2- 172.21.15.49:0/833179836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7740c1750 0x7fe774167e20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:25.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.513+0000 7fe778a64700 1 -- 172.21.15.49:0/833179836 >> 172.21.15.49:0/833179836 conn(0x7fe7740cb000 msgr2=0x7fe7740ab050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:25.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.513+0000 7fe778a64700 1 -- 172.21.15.49:0/833179836 shutdown_connections 2023-11-30T17:07:25.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.513+0000 7fe778a64700 1 -- 172.21.15.49:0/833179836 wait complete. 2023-11-30T17:07:25.528 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":4,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":89956},{"type":"v1","addr":"172.21.15.115:6833","nonce":89956}]},"active_addr":"172.21.15.115:6833/89956","active_change":"2023-11-30T17:07:02.830021+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":4101,"name":"y","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":2453164493}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":3230559129}]}]} 2023-11-30T17:07:25.531 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-30T17:07:25.531 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-30T17:07:25.531 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:07:25.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.646+0000 7efc26319700 1 Processor -- start 2023-11-30T17:07:25.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.646+0000 7efc26319700 1 -- start start 2023-11-30T17:07:25.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.647+0000 7efc26319700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc2006b510 0x7efc201546f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:25.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.647+0000 7efc26319700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efc200c10f0 0x7efc20158b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:25.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.647+0000 7efc26319700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc20063380 con 0x7efc200c0d10 2023-11-30T17:07:25.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.647+0000 7efc26319700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc200c19e0 con 0x7efc2006b510 2023-11-30T17:07:25.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.647+0000 7efc26319700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc20159060 con 0x7efc200c10f0 2023-11-30T17:07:25.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.647+0000 7efc1f7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc2006b510 0x7efc201546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:25.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.647+0000 7efc1f7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc2006b510 0x7efc201546f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59224/0 (socket says 172.21.15.49:59224) 2023-11-30T17:07:25.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.647+0000 7efc1f7fe700 1 -- 172.21.15.49:0/1098760842 learned_addr learned my addr 172.21.15.49:0/1098760842 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:25.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.647+0000 7efc248b6700 1 --2- 172.21.15.49:0/1098760842 >> v2:172.21.15.115:3300/0 conn(0x7efc200c10f0 0x7efc20158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:25.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.647+0000 7efc1f7fe700 1 -- 172.21.15.49:0/1098760842 >> v2:172.21.15.115:3300/0 conn(0x7efc200c10f0 msgr2=0x7efc20158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:25.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.647+0000 7efc1f7fe700 1 --2- 172.21.15.49:0/1098760842 >> v2:172.21.15.115:3300/0 conn(0x7efc200c10f0 0x7efc20158b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:25.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.647+0000 7efc1f7fe700 1 -- 172.21.15.49:0/1098760842 >> v1:172.21.15.115:6789/0 conn(0x7efc200c0d10 legacy=0x7efc20153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:25.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.647+0000 7efc1f7fe700 1 -- 172.21.15.49:0/1098760842 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc20062770 con 0x7efc2006b510 2023-11-30T17:07:25.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.647+0000 7efc1f7fe700 1 --2- 172.21.15.49:0/1098760842 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc2006b510 0x7efc201546f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7efc08006fd0 tx=0x7efc080090f0).ready entity=mon.0 client_cookie=195740f4f9768177 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:25.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.648+0000 7efc1effd700 1 -- 172.21.15.49:0/1098760842 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0800b520 con 0x7efc2006b510 2023-11-30T17:07:25.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.648+0000 7efc1effd700 1 -- 172.21.15.49:0/1098760842 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0800b680 con 0x7efc2006b510 2023-11-30T17:07:25.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.648+0000 7efc1effd700 1 -- 172.21.15.49:0/1098760842 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0800ba00 con 0x7efc2006b510 2023-11-30T17:07:25.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.648+0000 7efc26319700 1 -- 172.21.15.49:0/1098760842 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc2006b510 msgr2=0x7efc201546f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:25.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.648+0000 7efc26319700 1 --2- 172.21.15.49:0/1098760842 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc2006b510 0x7efc201546f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7efc08006fd0 tx=0x7efc080090f0).stop 2023-11-30T17:07:25.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.648+0000 7efc26319700 1 -- 172.21.15.49:0/1098760842 shutdown_connections 2023-11-30T17:07:25.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.648+0000 7efc26319700 1 --2- 172.21.15.49:0/1098760842 >> v2:172.21.15.115:3300/0 conn(0x7efc200c10f0 0x7efc20158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:25.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.648+0000 7efc26319700 1 --2- 172.21.15.49:0/1098760842 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc2006b510 0x7efc201546f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:25.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.648+0000 7efc26319700 1 -- 172.21.15.49:0/1098760842 >> 172.21.15.49:0/1098760842 conn(0x7efc200c7760 msgr2=0x7efc200c7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:25.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.648+0000 7efc26319700 1 -- 172.21.15.49:0/1098760842 shutdown_connections 2023-11-30T17:07:25.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.648+0000 7efc26319700 1 -- 172.21.15.49:0/1098760842 wait complete. 2023-11-30T17:07:25.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.649+0000 7efc26319700 1 Processor -- start 2023-11-30T17:07:25.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.650+0000 7efc26319700 1 -- start start 2023-11-30T17:07:25.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.650+0000 7efc26319700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc2006b510 0x7efc2014c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:25.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.650+0000 7efc26319700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc200c0d10 0x7efc2014df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:25.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.650+0000 7efc26319700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc200c10f0 0x7efc201530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:25.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.650+0000 7efc26319700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2014f330 con 0x7efc200c10f0 2023-11-30T17:07:25.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.650+0000 7efc26319700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc201566a0 con 0x7efc2006b510 2023-11-30T17:07:25.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.650+0000 7efc26319700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc20155db0 con 0x7efc200c0d10 2023-11-30T17:07:25.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.650+0000 7efc248b6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc200c10f0 0x7efc201530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:25.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.650+0000 7efc248b6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc200c10f0 0x7efc201530b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59232/0 (socket says 172.21.15.49:59232) 2023-11-30T17:07:25.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.650+0000 7efc248b6700 1 -- 172.21.15.49:0/599342673 learned_addr learned my addr 172.21.15.49:0/599342673 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:25.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.651+0000 7efc1f7fe700 1 --2- 172.21.15.49:0/599342673 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc200c0d10 0x7efc2014df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:25.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.651+0000 7efc1ffff700 1 --2- 172.21.15.49:0/599342673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc2006b510 0x7efc2014c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:25.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.651+0000 7efc248b6700 1 -- 172.21.15.49:0/599342673 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc200c0d10 msgr2=0x7efc2014df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:25.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.651+0000 7efc248b6700 1 --2- 172.21.15.49:0/599342673 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc200c0d10 0x7efc2014df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:25.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.651+0000 7efc248b6700 1 -- 172.21.15.49:0/599342673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc2006b510 msgr2=0x7efc2014c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:25.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.651+0000 7efc248b6700 1 --2- 172.21.15.49:0/599342673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc2006b510 0x7efc2014c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:25.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.651+0000 7efc248b6700 1 -- 172.21.15.49:0/599342673 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc08009370 con 0x7efc200c10f0 2023-11-30T17:07:25.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.651+0000 7efc1ffff700 1 --2- 172.21.15.49:0/599342673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc2006b510 0x7efc2014c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:25.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.651+0000 7efc248b6700 1 --2- 172.21.15.49:0/599342673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc200c10f0 0x7efc201530b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7efc18009df0 tx=0x7efc1800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:25.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.651+0000 7efc17fff700 1 -- 172.21.15.49:0/599342673 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1800cb50 con 0x7efc200c10f0 2023-11-30T17:07:25.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.651+0000 7efc17fff700 1 -- 172.21.15.49:0/599342673 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1800f040 con 0x7efc200c10f0 2023-11-30T17:07:25.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.651+0000 7efc17fff700 1 -- 172.21.15.49:0/599342673 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1800cec0 con 0x7efc200c10f0 2023-11-30T17:07:25.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.651+0000 7efc26319700 1 -- 172.21.15.49:0/599342673 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc20168ad0 con 0x7efc200c10f0 2023-11-30T17:07:25.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.651+0000 7efc26319700 1 -- 172.21.15.49:0/599342673 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc20156330 con 0x7efc200c10f0 2023-11-30T17:07:25.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.652+0000 7efc26319700 1 -- 172.21.15.49:0/599342673 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc20156830 con 0x7efc200c10f0 2023-11-30T17:07:25.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.652+0000 7efc17fff700 1 -- 172.21.15.49:0/599342673 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7efc18013610 con 0x7efc200c10f0 2023-11-30T17:07:25.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.653+0000 7efc17fff700 1 --2- 172.21.15.49:0/599342673 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc0005f120 0x7efc000615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:25.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.653+0000 7efc17fff700 1 -- 172.21.15.49:0/599342673 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7efc1807a9a0 con 0x7efc200c10f0 2023-11-30T17:07:25.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.653+0000 7efc1ffff700 1 --2- 172.21.15.49:0/599342673 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc0005f120 0x7efc000615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:25.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.653+0000 7efc1ffff700 1 --2- 172.21.15.49:0/599342673 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc0005f120 0x7efc000615e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7efc100016d0 tx=0x7efc10009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:25.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.657+0000 7efc17fff700 1 -- 172.21.15.49:0/599342673 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efc1804bc70 con 0x7efc200c10f0 2023-11-30T17:07:25.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.829+0000 7efc26319700 1 -- 172.21.15.49:0/599342673 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc2006c860 con 0x7efc200c10f0 2023-11-30T17:07:25.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.830+0000 7efc17fff700 1 -- 172.21.15.49:0/599342673 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16928 (secure 0 0 0) 0x7efc1804f290 con 0x7efc200c10f0 2023-11-30T17:07:25.833 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:25.833 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":22,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:07:17.283998+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:07:14.837882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-30T17:07:15.248549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:07:25.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.832+0000 7efc26319700 1 -- 172.21.15.49:0/599342673 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc0005f120 msgr2=0x7efc000615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:25.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.832+0000 7efc26319700 1 --2- 172.21.15.49:0/599342673 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc0005f120 0x7efc000615e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7efc100016d0 tx=0x7efc10009040).stop 2023-11-30T17:07:25.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.832+0000 7efc26319700 1 -- 172.21.15.49:0/599342673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc200c10f0 msgr2=0x7efc201530b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:25.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.832+0000 7efc26319700 1 --2- 172.21.15.49:0/599342673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc200c10f0 0x7efc201530b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7efc18009df0 tx=0x7efc1800b040).stop 2023-11-30T17:07:25.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.832+0000 7efc26319700 1 -- 172.21.15.49:0/599342673 shutdown_connections 2023-11-30T17:07:25.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.832+0000 7efc26319700 1 --2- 172.21.15.49:0/599342673 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc0005f120 0x7efc000615e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:25.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.832+0000 7efc26319700 1 --2- 172.21.15.49:0/599342673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc200c10f0 0x7efc201530b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:25.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.832+0000 7efc26319700 1 --2- 172.21.15.49:0/599342673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc2006b510 0x7efc2014c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:25.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.832+0000 7efc26319700 1 --2- 172.21.15.49:0/599342673 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc200c0d10 0x7efc2014df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:25.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.832+0000 7efc26319700 1 -- 172.21.15.49:0/599342673 >> 172.21.15.49:0/599342673 conn(0x7efc200c7760 msgr2=0x7efc200c3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:25.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.832+0000 7efc26319700 1 -- 172.21.15.49:0/599342673 shutdown_connections 2023-11-30T17:07:25.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.832+0000 7efc26319700 1 -- 172.21.15.49:0/599342673 wait complete. 2023-11-30T17:07:25.847 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-30T17:07:25.847 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:07:25.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.964+0000 7fc954814700 1 Processor -- start 2023-11-30T17:07:25.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.964+0000 7fc954814700 1 -- start start 2023-11-30T17:07:25.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.965+0000 7fc954814700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc9501548c0 0x7fc95006a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:25.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.965+0000 7fc954814700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9500c6e30 0x7fc9500c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:25.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.965+0000 7fc954814700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9500c69a0 con 0x7fc9501544e0 2023-11-30T17:07:25.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.965+0000 7fc954814700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9500c13a0 con 0x7fc9501548c0 2023-11-30T17:07:25.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.965+0000 7fc954814700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9500c1680 con 0x7fc9500c6e30 2023-11-30T17:07:25.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.965+0000 7fc94ed9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9500c6e30 0x7fc9500c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:25.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.965+0000 7fc94dd9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc9501548c0 0x7fc95006a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:25.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.965+0000 7fc94dd9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc9501548c0 0x7fc95006a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:55018/0 (socket says 172.21.15.49:55018) 2023-11-30T17:07:25.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.965+0000 7fc94dd9b700 1 -- 172.21.15.49:0/441553751 learned_addr learned my addr 172.21.15.49:0/441553751 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:25.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.965+0000 7fc94ed9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9500c6e30 0x7fc9500c72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:34856/0 (socket says 172.21.15.49:34856) 2023-11-30T17:07:25.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.965+0000 7fc94ed9d700 1 -- 172.21.15.49:0/441553751 >> v2:172.21.15.115:3300/0 conn(0x7fc9501548c0 msgr2=0x7fc95006a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:25.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.965+0000 7fc94ed9d700 1 --2- 172.21.15.49:0/441553751 >> v2:172.21.15.115:3300/0 conn(0x7fc9501548c0 0x7fc95006a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:25.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.965+0000 7fc94ed9d700 1 -- 172.21.15.49:0/441553751 >> v1:172.21.15.115:6789/0 conn(0x7fc9501544e0 legacy=0x7fc9500c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:25.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.965+0000 7fc94d59a700 1 -- 172.21.15.49:0/441553751 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2448146749 0 0) 0x7fc9500c69a0 con 0x7fc9501544e0 2023-11-30T17:07:25.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.965+0000 7fc94ed9d700 1 -- 172.21.15.49:0/441553751 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9500c6630 con 0x7fc9500c6e30 2023-11-30T17:07:25.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.965+0000 7fc94dd9b700 1 --2- 172.21.15.49:0/441553751 >> v2:172.21.15.115:3300/0 conn(0x7fc9501548c0 0x7fc95006a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:07:25.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.966+0000 7fc94ed9d700 1 --2- 172.21.15.49:0/441553751 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9500c6e30 0x7fc9500c72e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fc948009e60 tx=0x7fc948009780).ready entity=mon.2 client_cookie=5d36f1250f494b8e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:25.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.966+0000 7fc94d59a700 1 -- 172.21.15.49:0/441553751 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94800e070 con 0x7fc9500c6e30 2023-11-30T17:07:25.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.966+0000 7fc94d59a700 1 -- 172.21.15.49:0/441553751 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94800bb60 con 0x7fc9500c6e30 2023-11-30T17:07:25.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.966+0000 7fc94d59a700 1 -- 172.21.15.49:0/441553751 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc948012410 con 0x7fc9500c6e30 2023-11-30T17:07:25.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.966+0000 7fc954814700 1 -- 172.21.15.49:0/441553751 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9500c6e30 msgr2=0x7fc9500c72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:25.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.966+0000 7fc954814700 1 --2- 172.21.15.49:0/441553751 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9500c6e30 0x7fc9500c72e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fc948009e60 tx=0x7fc948009780).stop 2023-11-30T17:07:25.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.966+0000 7fc954814700 1 -- 172.21.15.49:0/441553751 shutdown_connections 2023-11-30T17:07:25.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.966+0000 7fc954814700 1 --2- 172.21.15.49:0/441553751 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9500c6e30 0x7fc9500c72e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:25.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.966+0000 7fc954814700 1 --2- 172.21.15.49:0/441553751 >> v2:172.21.15.115:3300/0 conn(0x7fc9501548c0 0x7fc95006a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:25.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.966+0000 7fc954814700 1 -- 172.21.15.49:0/441553751 >> 172.21.15.49:0/441553751 conn(0x7fc950085020 msgr2=0x7fc950094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:25.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.966+0000 7fc954814700 1 -- 172.21.15.49:0/441553751 shutdown_connections 2023-11-30T17:07:25.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.966+0000 7fc954814700 1 -- 172.21.15.49:0/441553751 wait complete. 2023-11-30T17:07:25.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.967+0000 7fc954814700 1 Processor -- start 2023-11-30T17:07:25.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.967+0000 7fc954814700 1 -- start start 2023-11-30T17:07:25.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.968+0000 7fc954814700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9500c6e30 0x7fc950168960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:25.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.968+0000 7fc954814700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9501544e0 0x7fc9500c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:25.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.968+0000 7fc954814700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9501548c0 0x7fc95014f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:25.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.968+0000 7fc954814700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9501684d0 con 0x7fc9501548c0 2023-11-30T17:07:25.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.968+0000 7fc954814700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9500ad040 con 0x7fc9500c6e30 2023-11-30T17:07:25.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.968+0000 7fc954814700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc950167ec0 con 0x7fc9501544e0 2023-11-30T17:07:25.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.968+0000 7fc94ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9501548c0 0x7fc95014f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:25.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.968+0000 7fc94ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9501548c0 0x7fc95014f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59248/0 (socket says 172.21.15.49:59248) 2023-11-30T17:07:25.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.968+0000 7fc94ed9d700 1 -- 172.21.15.49:0/1101130545 learned_addr learned my addr 172.21.15.49:0/1101130545 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:25.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.968+0000 7fc94e59c700 1 --2- 172.21.15.49:0/1101130545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9500c6e30 0x7fc950168960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:25.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.968+0000 7fc94dd9b700 1 --2- 172.21.15.49:0/1101130545 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9501544e0 0x7fc9500c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:25.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.969+0000 7fc94ed9d700 1 -- 172.21.15.49:0/1101130545 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9501544e0 msgr2=0x7fc9500c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:25.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.969+0000 7fc94ed9d700 1 --2- 172.21.15.49:0/1101130545 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9501544e0 0x7fc9500c4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:25.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.969+0000 7fc94ed9d700 1 -- 172.21.15.49:0/1101130545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9500c6e30 msgr2=0x7fc950168960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:25.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.969+0000 7fc94ed9d700 1 --2- 172.21.15.49:0/1101130545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9500c6e30 0x7fc950168960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:25.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.969+0000 7fc94ed9d700 1 -- 172.21.15.49:0/1101130545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc944009370 con 0x7fc9501548c0 2023-11-30T17:07:25.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.969+0000 7fc94ed9d700 1 --2- 172.21.15.49:0/1101130545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9501548c0 0x7fc95014f260 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fc94800b6c0 tx=0x7fc948009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:25.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.969+0000 7fc93e7fc700 1 -- 172.21.15.49:0/1101130545 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc948012410 con 0x7fc9501548c0 2023-11-30T17:07:25.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.969+0000 7fc93e7fc700 1 -- 172.21.15.49:0/1101130545 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94801d630 con 0x7fc9501548c0 2023-11-30T17:07:25.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.969+0000 7fc93e7fc700 1 -- 172.21.15.49:0/1101130545 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94801d9f0 con 0x7fc9501548c0 2023-11-30T17:07:25.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.969+0000 7fc954814700 1 -- 172.21.15.49:0/1101130545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc948009a20 con 0x7fc9501548c0 2023-11-30T17:07:25.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.969+0000 7fc954814700 1 -- 172.21.15.49:0/1101130545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9500acd60 con 0x7fc9501548c0 2023-11-30T17:07:25.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.970+0000 7fc954814700 1 -- 172.21.15.49:0/1101130545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc95006c860 con 0x7fc9501548c0 2023-11-30T17:07:25.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.970+0000 7fc93e7fc700 1 -- 172.21.15.49:0/1101130545 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc948003040 con 0x7fc9501548c0 2023-11-30T17:07:25.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.971+0000 7fc93e7fc700 1 --2- 172.21.15.49:0/1101130545 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc93005f150 0x7fc930061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:25.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.971+0000 7fc93e7fc700 1 -- 172.21.15.49:0/1101130545 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc94807bf10 con 0x7fc9501548c0 2023-11-30T17:07:25.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.971+0000 7fc94e59c700 1 --2- 172.21.15.49:0/1101130545 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc93005f150 0x7fc930061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:25.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.971+0000 7fc94e59c700 1 --2- 172.21.15.49:0/1101130545 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc93005f150 0x7fc930061610 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fc940007fd0 tx=0x7fc940007d90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:25.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:25.975+0000 7fc93e7fc700 1 -- 172.21.15.49:0/1101130545 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc94804d1e0 con 0x7fc9501548c0 2023-11-30T17:07:26.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.148+0000 7fc954814700 1 -- 172.21.15.49:0/1101130545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9500c5890 con 0x7fc9501548c0 2023-11-30T17:07:26.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.149+0000 7fc93e7fc700 1 -- 172.21.15.49:0/1101130545 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16928 (secure 0 0 0) 0x7fc948050800 con 0x7fc9501548c0 2023-11-30T17:07:26.152 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:26.152 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":22,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:07:17.283998+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:07:14.837882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-30T17:07:15.248549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:07:26.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.151+0000 7fc954814700 1 -- 172.21.15.49:0/1101130545 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc93005f150 msgr2=0x7fc930061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.151+0000 7fc954814700 1 --2- 172.21.15.49:0/1101130545 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc93005f150 0x7fc930061610 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fc940007fd0 tx=0x7fc940007d90).stop 2023-11-30T17:07:26.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.151+0000 7fc954814700 1 -- 172.21.15.49:0/1101130545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9501548c0 msgr2=0x7fc95014f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.151+0000 7fc954814700 1 --2- 172.21.15.49:0/1101130545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9501548c0 0x7fc95014f260 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fc94800b6c0 tx=0x7fc948009780).stop 2023-11-30T17:07:26.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.151+0000 7fc954814700 1 -- 172.21.15.49:0/1101130545 shutdown_connections 2023-11-30T17:07:26.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.151+0000 7fc954814700 1 --2- 172.21.15.49:0/1101130545 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc93005f150 0x7fc930061610 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.151+0000 7fc954814700 1 --2- 172.21.15.49:0/1101130545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9501548c0 0x7fc95014f260 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.151+0000 7fc954814700 1 --2- 172.21.15.49:0/1101130545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9500c6e30 0x7fc950168960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.151+0000 7fc954814700 1 --2- 172.21.15.49:0/1101130545 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9501544e0 0x7fc9500c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.151+0000 7fc954814700 1 -- 172.21.15.49:0/1101130545 >> 172.21.15.49:0/1101130545 conn(0x7fc950085020 msgr2=0x7fc9500caaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:26.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.151+0000 7fc954814700 1 -- 172.21.15.49:0/1101130545 shutdown_connections 2023-11-30T17:07:26.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.151+0000 7fc954814700 1 -- 172.21.15.49:0/1101130545 wait complete. 2023-11-30T17:07:26.166 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-30T17:07:26.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.281+0000 7fc73b2c9700 1 Processor -- start 2023-11-30T17:07:26.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.282+0000 7fc73b2c9700 1 -- start start 2023-11-30T17:07:26.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.282+0000 7fc73b2c9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7340c86f0 0x7fc7340a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.283+0000 7fc73b2c9700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc734062700 0x7fc734062b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.283+0000 7fc73b2c9700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7340c7e30 con 0x7fc7341547f0 2023-11-30T17:07:26.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.283+0000 7fc73b2c9700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7340bcf40 con 0x7fc734062700 2023-11-30T17:07:26.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.283+0000 7fc73b2c9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7340c6b20 con 0x7fc7340c86f0 2023-11-30T17:07:26.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.283+0000 7fc739866700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc734062700 0x7fc734062b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.283+0000 7fc739866700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc734062700 0x7fc734062b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59256/0 (socket says 172.21.15.49:59256) 2023-11-30T17:07:26.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.283+0000 7fc739866700 1 -- 172.21.15.49:0/4250247197 learned_addr learned my addr 172.21.15.49:0/4250247197 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:26.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.283+0000 7fc738864700 1 --2- 172.21.15.49:0/4250247197 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7340c86f0 0x7fc7340a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.283+0000 7fc739866700 1 -- 172.21.15.49:0/4250247197 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7340c86f0 msgr2=0x7fc7340a72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:26.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.283+0000 7fc739866700 1 --2- 172.21.15.49:0/4250247197 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7340c86f0 0x7fc7340a72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.283+0000 7fc739866700 1 -- 172.21.15.49:0/4250247197 >> v1:172.21.15.115:6789/0 conn(0x7fc7341547f0 legacy=0x7fc7340c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:26.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.283+0000 7fc739866700 1 -- 172.21.15.49:0/4250247197 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7340a77d0 con 0x7fc734062700 2023-11-30T17:07:26.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.283+0000 7fc739866700 1 --2- 172.21.15.49:0/4250247197 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc734062700 0x7fc734062b90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fc724006fd0 tx=0x7fc7240090f0).ready entity=mon.0 client_cookie=3fc7f525c24013b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:26.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.283+0000 7fc733fff700 1 -- 172.21.15.49:0/4250247197 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72400b600 con 0x7fc734062700 2023-11-30T17:07:26.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.283+0000 7fc733fff700 1 -- 172.21.15.49:0/4250247197 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72400b760 con 0x7fc734062700 2023-11-30T17:07:26.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.283+0000 7fc733fff700 1 -- 172.21.15.49:0/4250247197 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72400bb00 con 0x7fc734062700 2023-11-30T17:07:26.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.284+0000 7fc73b2c9700 1 -- 172.21.15.49:0/4250247197 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc734062700 msgr2=0x7fc734062b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.284+0000 7fc73b2c9700 1 --2- 172.21.15.49:0/4250247197 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc734062700 0x7fc734062b90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fc724006fd0 tx=0x7fc7240090f0).stop 2023-11-30T17:07:26.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.284+0000 7fc73b2c9700 1 -- 172.21.15.49:0/4250247197 shutdown_connections 2023-11-30T17:07:26.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.284+0000 7fc73b2c9700 1 --2- 172.21.15.49:0/4250247197 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc734062700 0x7fc734062b90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.284+0000 7fc73b2c9700 1 --2- 172.21.15.49:0/4250247197 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7340c86f0 0x7fc7340a72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.284+0000 7fc73b2c9700 1 -- 172.21.15.49:0/4250247197 >> 172.21.15.49:0/4250247197 conn(0x7fc7340642d0 msgr2=0x7fc7340c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:26.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.284+0000 7fc73b2c9700 1 -- 172.21.15.49:0/4250247197 shutdown_connections 2023-11-30T17:07:26.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.284+0000 7fc73b2c9700 1 -- 172.21.15.49:0/4250247197 wait complete. 2023-11-30T17:07:26.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.285+0000 7fc73b2c9700 1 Processor -- start 2023-11-30T17:07:26.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.285+0000 7fc73b2c9700 1 -- start start 2023-11-30T17:07:26.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.286+0000 7fc73b2c9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc734062700 0x7fc7340abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.286+0000 7fc73b2c9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7340c86f0 0x7fc73414f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.286+0000 7fc73b2c9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7341547f0 0x7fc7340ad350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.286+0000 7fc73b2c9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc734151fb0 con 0x7fc7341547f0 2023-11-30T17:07:26.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.286+0000 7fc73b2c9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc734152290 con 0x7fc7340c86f0 2023-11-30T17:07:26.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.286+0000 7fc73b2c9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7340aa3a0 con 0x7fc734062700 2023-11-30T17:07:26.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.286+0000 7fc739866700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7341547f0 0x7fc7340ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.286+0000 7fc739866700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7341547f0 0x7fc7340ad350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59262/0 (socket says 172.21.15.49:59262) 2023-11-30T17:07:26.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.286+0000 7fc739866700 1 -- 172.21.15.49:0/3501381888 learned_addr learned my addr 172.21.15.49:0/3501381888 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:26.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.286+0000 7fc738864700 1 --2- 172.21.15.49:0/3501381888 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7340c86f0 0x7fc73414f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.286+0000 7fc739065700 1 --2- 172.21.15.49:0/3501381888 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc734062700 0x7fc7340abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.286+0000 7fc739866700 1 -- 172.21.15.49:0/3501381888 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc734062700 msgr2=0x7fc7340abbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.286+0000 7fc739866700 1 --2- 172.21.15.49:0/3501381888 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc734062700 0x7fc7340abbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.286+0000 7fc739866700 1 -- 172.21.15.49:0/3501381888 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7340c86f0 msgr2=0x7fc73414f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.286+0000 7fc739866700 1 --2- 172.21.15.49:0/3501381888 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7340c86f0 0x7fc73414f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.286+0000 7fc739866700 1 -- 172.21.15.49:0/3501381888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc724009370 con 0x7fc7341547f0 2023-11-30T17:07:26.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.287+0000 7fc739866700 1 --2- 172.21.15.49:0/3501381888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7341547f0 0x7fc7340ad350 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fc724002f70 tx=0x7fc724017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:26.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.287+0000 7fc7317fa700 1 -- 172.21.15.49:0/3501381888 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72400b600 con 0x7fc7341547f0 2023-11-30T17:07:26.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.287+0000 7fc7317fa700 1 -- 172.21.15.49:0/3501381888 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72400bec0 con 0x7fc7341547f0 2023-11-30T17:07:26.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.287+0000 7fc7317fa700 1 -- 172.21.15.49:0/3501381888 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc724024680 con 0x7fc7341547f0 2023-11-30T17:07:26.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.287+0000 7fc73b2c9700 1 -- 172.21.15.49:0/3501381888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7340aa680 con 0x7fc7341547f0 2023-11-30T17:07:26.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.287+0000 7fc73b2c9700 1 -- 172.21.15.49:0/3501381888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc73414f510 con 0x7fc7341547f0 2023-11-30T17:07:26.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.287+0000 7fc73b2c9700 1 -- 172.21.15.49:0/3501381888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc73406c860 con 0x7fc7341547f0 2023-11-30T17:07:26.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.288+0000 7fc7317fa700 1 -- 172.21.15.49:0/3501381888 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc724021070 con 0x7fc7341547f0 2023-11-30T17:07:26.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.288+0000 7fc7317fa700 1 --2- 172.21.15.49:0/3501381888 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc72005f150 0x7fc720061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.288+0000 7fc7317fa700 1 -- 172.21.15.49:0/3501381888 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc72407bfe0 con 0x7fc7341547f0 2023-11-30T17:07:26.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.289+0000 7fc7317fa700 1 --2- 172.21.15.49:0/3501381888 >> [v2:172.21.15.49:6824/90306,v1:172.21.15.49:6825/90306] conn(0x7fc7200684f0 0x7fc72006a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.289+0000 7fc739065700 1 --2- 172.21.15.49:0/3501381888 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc72005f150 0x7fc720061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.289+0000 7fc7317fa700 1 -- 172.21.15.49:0/3501381888 --> [v2:172.21.15.49:6824/90306,v1:172.21.15.49:6825/90306] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc72006afd0 con 0x7fc7200684f0 2023-11-30T17:07:26.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.289+0000 7fc7317fa700 1 -- 172.21.15.49:0/3501381888 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc72407c390 con 0x7fc7341547f0 2023-11-30T17:07:26.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.289+0000 7fc738864700 1 --2- 172.21.15.49:0/3501381888 >> [v2:172.21.15.49:6824/90306,v1:172.21.15.49:6825/90306] conn(0x7fc7200684f0 0x7fc72006a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.289+0000 7fc739065700 1 --2- 172.21.15.49:0/3501381888 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc72005f150 0x7fc720061610 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fc72c003fb0 tx=0x7fc72c002530).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:26.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.289+0000 7fc738864700 1 --2- 172.21.15.49:0/3501381888 >> [v2:172.21.15.49:6824/90306,v1:172.21.15.49:6825/90306] conn(0x7fc7200684f0 0x7fc72006a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:26.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.290+0000 7fc7317fa700 1 -- 172.21.15.49:0/3501381888 <== osd.0 v2:172.21.15.49:6824/90306 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fc72006afd0 con 0x7fc7200684f0 2023-11-30T17:07:26.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.304+0000 7fc73b2c9700 1 -- 172.21.15.49:0/3501381888 --> [v2:172.21.15.49:6824/90306,v1:172.21.15.49:6825/90306] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc734152420 con 0x7fc7200684f0 2023-11-30T17:07:26.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.304+0000 7fc7317fa700 1 -- 172.21.15.49:0/3501381888 <== osd.0 v2:172.21.15.49:6824/90306 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc734152420 con 0x7fc7200684f0 2023-11-30T17:07:26.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.304+0000 7fc73b2c9700 1 -- 172.21.15.49:0/3501381888 >> [v2:172.21.15.49:6824/90306,v1:172.21.15.49:6825/90306] conn(0x7fc7200684f0 msgr2=0x7fc72006a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.304+0000 7fc73b2c9700 1 --2- 172.21.15.49:0/3501381888 >> [v2:172.21.15.49:6824/90306,v1:172.21.15.49:6825/90306] conn(0x7fc7200684f0 0x7fc72006a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.305+0000 7fc73b2c9700 1 -- 172.21.15.49:0/3501381888 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc72005f150 msgr2=0x7fc720061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.305+0000 7fc73b2c9700 1 --2- 172.21.15.49:0/3501381888 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc72005f150 0x7fc720061610 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fc72c003fb0 tx=0x7fc72c002530).stop 2023-11-30T17:07:26.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.305+0000 7fc73b2c9700 1 -- 172.21.15.49:0/3501381888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7341547f0 msgr2=0x7fc7340ad350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.305+0000 7fc73b2c9700 1 --2- 172.21.15.49:0/3501381888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7341547f0 0x7fc7340ad350 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fc724002f70 tx=0x7fc724017000).stop 2023-11-30T17:07:26.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.305+0000 7fc739866700 1 -- 172.21.15.49:0/3501381888 reap_dead start 2023-11-30T17:07:26.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.305+0000 7fc73b2c9700 1 -- 172.21.15.49:0/3501381888 shutdown_connections 2023-11-30T17:07:26.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.305+0000 7fc73b2c9700 1 -- 172.21.15.49:0/3501381888 >> 172.21.15.49:0/3501381888 conn(0x7fc7340642d0 msgr2=0x7fc7340c7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:26.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.305+0000 7fc73b2c9700 1 -- 172.21.15.49:0/3501381888 shutdown_connections 2023-11-30T17:07:26.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.305+0000 7fc73b2c9700 1 -- 172.21.15.49:0/3501381888 wait complete. 2023-11-30T17:07:26.319 INFO:teuthology.orchestra.run.smithi049.stdout:55834574853 2023-11-30T17:07:26.319 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-30T17:07:26.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.434+0000 7f2bdd450700 1 Processor -- start 2023-11-30T17:07:26.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.434+0000 7f2bdd450700 1 -- start start 2023-11-30T17:07:26.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.435+0000 7f2bdd450700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bd80a8280 0x7f2bd80a8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.435+0000 7f2bdd450700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2bd814e600 0x7f2bd814eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.435+0000 7f2bdd450700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd8067770 con 0x7f2bd8158160 2023-11-30T17:07:26.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.435+0000 7f2bdd450700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd8159180 con 0x7f2bd814e600 2023-11-30T17:07:26.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.435+0000 7f2bdd450700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd80be8d0 con 0x7f2bd80a8280 2023-11-30T17:07:26.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.435+0000 7f2bd77fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2bd814e600 0x7f2bd814eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.436+0000 7f2bd77fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2bd814e600 0x7f2bd814eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59276/0 (socket says 172.21.15.49:59276) 2023-11-30T17:07:26.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.436+0000 7f2bd77fe700 1 -- 172.21.15.49:0/2550519971 learned_addr learned my addr 172.21.15.49:0/2550519971 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:26.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.436+0000 7f2bd6ffd700 1 --2- 172.21.15.49:0/2550519971 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bd80a8280 0x7f2bd80a8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.436+0000 7f2bd77fe700 1 -- 172.21.15.49:0/2550519971 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bd80a8280 msgr2=0x7f2bd80a8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:26.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.436+0000 7f2bd77fe700 1 --2- 172.21.15.49:0/2550519971 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bd80a8280 0x7f2bd80a8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.436+0000 7f2bd77fe700 1 -- 172.21.15.49:0/2550519971 >> v1:172.21.15.115:6789/0 conn(0x7f2bd8158160 legacy=0x7f2bd8155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.436+0000 7f2bd77fe700 1 -- 172.21.15.49:0/2550519971 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd8158600 con 0x7f2bd814e600 2023-11-30T17:07:26.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.436+0000 7f2bd77fe700 1 --2- 172.21.15.49:0/2550519971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bd814e600 0x7f2bd814eab0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f2bc8009f20 tx=0x7f2bc8009840).ready entity=mon.0 client_cookie=adb9c35846ab3ed3 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:26.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.436+0000 7f2bd5ffb700 1 -- 172.21.15.49:0/2550519971 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc800e070 con 0x7f2bd814e600 2023-11-30T17:07:26.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.436+0000 7f2bd5ffb700 1 -- 172.21.15.49:0/2550519971 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc800b9d0 con 0x7f2bd814e600 2023-11-30T17:07:26.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.436+0000 7f2bd5ffb700 1 -- 172.21.15.49:0/2550519971 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc800bd50 con 0x7f2bd814e600 2023-11-30T17:07:26.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.437+0000 7f2bdd450700 1 -- 172.21.15.49:0/2550519971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bd814e600 msgr2=0x7f2bd814eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.437+0000 7f2bdd450700 1 --2- 172.21.15.49:0/2550519971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bd814e600 0x7f2bd814eab0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f2bc8009f20 tx=0x7f2bc8009840).stop 2023-11-30T17:07:26.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.437+0000 7f2bdd450700 1 -- 172.21.15.49:0/2550519971 shutdown_connections 2023-11-30T17:07:26.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.437+0000 7f2bdd450700 1 --2- 172.21.15.49:0/2550519971 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bd80a8280 0x7f2bd80a8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.437+0000 7f2bdd450700 1 --2- 172.21.15.49:0/2550519971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bd814e600 0x7f2bd814eab0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.437+0000 7f2bdd450700 1 -- 172.21.15.49:0/2550519971 >> 172.21.15.49:0/2550519971 conn(0x7f2bd8062700 msgr2=0x7f2bd8062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:26.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.437+0000 7f2bdd450700 1 -- 172.21.15.49:0/2550519971 shutdown_connections 2023-11-30T17:07:26.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.437+0000 7f2bdd450700 1 -- 172.21.15.49:0/2550519971 wait complete. 2023-11-30T17:07:26.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.438+0000 7f2bdd450700 1 Processor -- start 2023-11-30T17:07:26.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.438+0000 7f2bdd450700 1 -- start start 2023-11-30T17:07:26.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.439+0000 7f2bdd450700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bd80a8280 0x7f2bd80ac0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.439+0000 7f2bdd450700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bd814e600 0x7f2bd815aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.439+0000 7f2bdd450700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bd8158160 0x7f2bd8063810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.439+0000 7f2bdd450700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd80aa7a0 con 0x7f2bd8158160 2023-11-30T17:07:26.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.439+0000 7f2bdd450700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd8063ff0 con 0x7f2bd80a8280 2023-11-30T17:07:26.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.439+0000 7f2bdd450700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd80642d0 con 0x7f2bd814e600 2023-11-30T17:07:26.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.439+0000 7f2bd77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bd8158160 0x7f2bd8063810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.439+0000 7f2bd77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bd8158160 0x7f2bd8063810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59292/0 (socket says 172.21.15.49:59292) 2023-11-30T17:07:26.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.439+0000 7f2bd77fe700 1 -- 172.21.15.49:0/1981541992 learned_addr learned my addr 172.21.15.49:0/1981541992 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:26.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.439+0000 7f2bd6ffd700 1 --2- 172.21.15.49:0/1981541992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bd80a8280 0x7f2bd80ac0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.439+0000 7f2bd67fc700 1 --2- 172.21.15.49:0/1981541992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bd814e600 0x7f2bd815aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.439+0000 7f2bd77fe700 1 -- 172.21.15.49:0/1981541992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bd814e600 msgr2=0x7f2bd815aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.439+0000 7f2bd77fe700 1 --2- 172.21.15.49:0/1981541992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bd814e600 0x7f2bd815aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.439+0000 7f2bd77fe700 1 -- 172.21.15.49:0/1981541992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bd80a8280 msgr2=0x7f2bd80ac0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.439+0000 7f2bd77fe700 1 --2- 172.21.15.49:0/1981541992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bd80a8280 0x7f2bd80ac0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.439+0000 7f2bd77fe700 1 -- 172.21.15.49:0/1981541992 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc8009ae0 con 0x7f2bd8158160 2023-11-30T17:07:26.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.439+0000 7f2bd77fe700 1 --2- 172.21.15.49:0/1981541992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bd8158160 0x7f2bd8063810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f2bc800b610 tx=0x7f2bc8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:26.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.439+0000 7f2bceffd700 1 -- 172.21.15.49:0/1981541992 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc80092e0 con 0x7f2bd8158160 2023-11-30T17:07:26.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.440+0000 7f2bceffd700 1 -- 172.21.15.49:0/1981541992 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc801e470 con 0x7f2bd8158160 2023-11-30T17:07:26.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.440+0000 7f2bdd450700 1 -- 172.21.15.49:0/1981541992 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd80645b0 con 0x7f2bd8158160 2023-11-30T17:07:26.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.440+0000 7f2bceffd700 1 -- 172.21.15.49:0/1981541992 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc801e830 con 0x7f2bd8158160 2023-11-30T17:07:26.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.440+0000 7f2bdd450700 1 -- 172.21.15.49:0/1981541992 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd80aa3c0 con 0x7f2bd8158160 2023-11-30T17:07:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.440+0000 7f2bdd450700 1 -- 172.21.15.49:0/1981541992 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2bd806c860 con 0x7f2bd8158160 2023-11-30T17:07:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.441+0000 7f2bceffd700 1 -- 172.21.15.49:0/1981541992 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2bc8003040 con 0x7f2bd8158160 2023-11-30T17:07:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.441+0000 7f2bceffd700 1 --2- 172.21.15.49:0/1981541992 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2bb805f150 0x7f2bb8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.441+0000 7f2bceffd700 1 -- 172.21.15.49:0/1981541992 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2bc807b580 con 0x7f2bd8158160 2023-11-30T17:07:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.441+0000 7f2bceffd700 1 --2- 172.21.15.49:0/1981541992 >> [v2:172.21.15.49:6808/90315,v1:172.21.15.49:6809/90315] conn(0x7f2bb80684f0 0x7f2bb806a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.441+0000 7f2bceffd700 1 -- 172.21.15.49:0/1981541992 --> [v2:172.21.15.49:6808/90315,v1:172.21.15.49:6809/90315] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2bb806afd0 con 0x7f2bb80684f0 2023-11-30T17:07:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.441+0000 7f2bceffd700 1 -- 172.21.15.49:0/1981541992 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2bc807dba0 con 0x7f2bd8158160 2023-11-30T17:07:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.441+0000 7f2bd6ffd700 1 --2- 172.21.15.49:0/1981541992 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2bb805f150 0x7f2bb8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.442+0000 7f2bd67fc700 1 --2- 172.21.15.49:0/1981541992 >> [v2:172.21.15.49:6808/90315,v1:172.21.15.49:6809/90315] conn(0x7f2bb80684f0 0x7f2bb806a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.442+0000 7f2bd6ffd700 1 --2- 172.21.15.49:0/1981541992 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2bb805f150 0x7f2bb8061610 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f2bd0009b90 tx=0x7f2bd0009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.442+0000 7f2bd67fc700 1 --2- 172.21.15.49:0/1981541992 >> [v2:172.21.15.49:6808/90315,v1:172.21.15.49:6809/90315] conn(0x7f2bb80684f0 0x7f2bb806a950 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.442+0000 7f2bceffd700 1 -- 172.21.15.49:0/1981541992 <== osd.1 v2:172.21.15.49:6808/90315 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f2bb806afd0 con 0x7f2bb80684f0 2023-11-30T17:07:26.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.457+0000 7f2bdd450700 1 -- 172.21.15.49:0/1981541992 --> [v2:172.21.15.49:6808/90315,v1:172.21.15.49:6809/90315] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2bd80aa8e0 con 0x7f2bb80684f0 2023-11-30T17:07:26.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.457+0000 7f2bceffd700 1 -- 172.21.15.49:0/1981541992 <== osd.1 v2:172.21.15.49:6808/90315 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2bd80aa8e0 con 0x7f2bb80684f0 2023-11-30T17:07:26.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.457+0000 7f2bdd450700 1 -- 172.21.15.49:0/1981541992 >> [v2:172.21.15.49:6808/90315,v1:172.21.15.49:6809/90315] conn(0x7f2bb80684f0 msgr2=0x7f2bb806a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.457+0000 7f2bdd450700 1 --2- 172.21.15.49:0/1981541992 >> [v2:172.21.15.49:6808/90315,v1:172.21.15.49:6809/90315] conn(0x7f2bb80684f0 0x7f2bb806a950 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.457+0000 7f2bdd450700 1 -- 172.21.15.49:0/1981541992 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2bb805f150 msgr2=0x7f2bb8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.457+0000 7f2bdd450700 1 --2- 172.21.15.49:0/1981541992 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2bb805f150 0x7f2bb8061610 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f2bd0009b90 tx=0x7f2bd0009060).stop 2023-11-30T17:07:26.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.457+0000 7f2bdd450700 1 -- 172.21.15.49:0/1981541992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bd8158160 msgr2=0x7f2bd8063810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.457+0000 7f2bdd450700 1 --2- 172.21.15.49:0/1981541992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bd8158160 0x7f2bd8063810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f2bc800b610 tx=0x7f2bc8009840).stop 2023-11-30T17:07:26.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.457+0000 7f2bd77fe700 1 -- 172.21.15.49:0/1981541992 reap_dead start 2023-11-30T17:07:26.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.457+0000 7f2bdd450700 1 -- 172.21.15.49:0/1981541992 shutdown_connections 2023-11-30T17:07:26.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.457+0000 7f2bdd450700 1 -- 172.21.15.49:0/1981541992 >> 172.21.15.49:0/1981541992 conn(0x7f2bd8062700 msgr2=0x7f2bd8062ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:26.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.457+0000 7f2bdd450700 1 -- 172.21.15.49:0/1981541992 shutdown_connections 2023-11-30T17:07:26.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.458+0000 7f2bdd450700 1 -- 172.21.15.49:0/1981541992 wait complete. 2023-11-30T17:07:26.471 INFO:teuthology.orchestra.run.smithi049.stdout:55834574853 2023-11-30T17:07:26.472 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-30T17:07:26.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.588+0000 7fb79a291700 1 Processor -- start 2023-11-30T17:07:26.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.588+0000 7fb79a291700 1 -- start start 2023-11-30T17:07:26.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.589+0000 7fb79a291700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb7940c6190 0x7fb7940c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.589+0000 7fb79a291700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7940c72d0 con 0x7fb794158320 2023-11-30T17:07:26.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.589+0000 7fb79a291700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb794064570 con 0x7fb794098d10 2023-11-30T17:07:26.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.589+0000 7fb79a291700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb794154bc0 con 0x7fb7940c6190 2023-11-30T17:07:26.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.589+0000 7fb7937fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb7940c6190 0x7fb7940c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.589+0000 7fb7937fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb7940c6190 0x7fb7940c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59300/0 (socket says 172.21.15.49:59300) 2023-11-30T17:07:26.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.589+0000 7fb7937fe700 1 -- 172.21.15.49:0/1478623216 learned_addr learned my addr 172.21.15.49:0/1478623216 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:26.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.589+0000 7fb79882e700 1 --1- 172.21.15.49:0/1478623216 >> v1:172.21.15.49:6789/0 conn(0x7fb794158320 0x7fb7940a80f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34884/0 (socket says 172.21.15.49:34884) 2023-11-30T17:07:26.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.589+0000 7fb7937fe700 1 -- 172.21.15.49:0/1478623216 >> v1:172.21.15.115:6789/0 conn(0x7fb794098d10 legacy=0x7fb794063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.589+0000 7fb7937fe700 1 -- 172.21.15.49:0/1478623216 >> v1:172.21.15.49:6789/0 conn(0x7fb794158320 legacy=0x7fb7940a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.589+0000 7fb792ffd700 1 -- 172.21.15.49:0/1478623216 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1581497144 0 0) 0x7fb7940c72d0 con 0x7fb794158320 2023-11-30T17:07:26.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.589+0000 7fb7937fe700 1 -- 172.21.15.49:0/1478623216 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7940c66c0 con 0x7fb7940c6190 2023-11-30T17:07:26.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.589+0000 7fb7937fe700 1 --2- 172.21.15.49:0/1478623216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7940c6190 0x7fb7940c7760 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fb788006fd0 tx=0x7fb7880090f0).ready entity=mon.0 client_cookie=7e5153c4a161cfc3 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:26.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.589+0000 7fb792ffd700 1 -- 172.21.15.49:0/1478623216 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78800b600 con 0x7fb7940c6190 2023-11-30T17:07:26.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.589+0000 7fb792ffd700 1 -- 172.21.15.49:0/1478623216 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78800b760 con 0x7fb7940c6190 2023-11-30T17:07:26.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.589+0000 7fb792ffd700 1 -- 172.21.15.49:0/1478623216 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78800bae0 con 0x7fb7940c6190 2023-11-30T17:07:26.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.590+0000 7fb79a291700 1 -- 172.21.15.49:0/1478623216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7940c6190 msgr2=0x7fb7940c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.590+0000 7fb79a291700 1 --2- 172.21.15.49:0/1478623216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7940c6190 0x7fb7940c7760 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fb788006fd0 tx=0x7fb7880090f0).stop 2023-11-30T17:07:26.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.590+0000 7fb79a291700 1 -- 172.21.15.49:0/1478623216 shutdown_connections 2023-11-30T17:07:26.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.590+0000 7fb79a291700 1 --2- 172.21.15.49:0/1478623216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7940c6190 0x7fb7940c7760 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.590+0000 7fb79a291700 1 -- 172.21.15.49:0/1478623216 >> 172.21.15.49:0/1478623216 conn(0x7fb7940cb310 msgr2=0x7fb7940cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:26.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.590+0000 7fb79a291700 1 -- 172.21.15.49:0/1478623216 shutdown_connections 2023-11-30T17:07:26.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.590+0000 7fb79a291700 1 -- 172.21.15.49:0/1478623216 wait complete. 2023-11-30T17:07:26.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.591+0000 7fb79a291700 1 Processor -- start 2023-11-30T17:07:26.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.591+0000 7fb79a291700 1 -- start start 2023-11-30T17:07:26.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.592+0000 7fb79a291700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb794098d10 0x7fb794155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.592+0000 7fb79a291700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7940c6190 0x7fb7940c2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.592+0000 7fb79a291700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb794158320 0x7fb7940c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.592+0000 7fb79a291700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7940c3270 con 0x7fb794098d10 2023-11-30T17:07:26.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.592+0000 7fb79a291700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb794155eb0 con 0x7fb7940c6190 2023-11-30T17:07:26.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.592+0000 7fb79a291700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7940c2450 con 0x7fb794158320 2023-11-30T17:07:26.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.592+0000 7fb793fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb794098d10 0x7fb794155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.592+0000 7fb793fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb794098d10 0x7fb794155820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59302/0 (socket says 172.21.15.49:59302) 2023-11-30T17:07:26.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.592+0000 7fb793fff700 1 -- 172.21.15.49:0/4288748779 learned_addr learned my addr 172.21.15.49:0/4288748779 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:26.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.592+0000 7fb7937fe700 1 --2- 172.21.15.49:0/4288748779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7940c6190 0x7fb7940c2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.592+0000 7fb79882e700 1 --2- 172.21.15.49:0/4288748779 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb794158320 0x7fb7940c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.593+0000 7fb793fff700 1 -- 172.21.15.49:0/4288748779 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb794158320 msgr2=0x7fb7940c4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.593+0000 7fb793fff700 1 --2- 172.21.15.49:0/4288748779 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb794158320 0x7fb7940c4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.593+0000 7fb793fff700 1 -- 172.21.15.49:0/4288748779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7940c6190 msgr2=0x7fb7940c2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.593+0000 7fb793fff700 1 --2- 172.21.15.49:0/4288748779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7940c6190 0x7fb7940c2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.593+0000 7fb793fff700 1 -- 172.21.15.49:0/4288748779 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb788009370 con 0x7fb794098d10 2023-11-30T17:07:26.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.593+0000 7fb7937fe700 1 --2- 172.21.15.49:0/4288748779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7940c6190 0x7fb7940c2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:26.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.593+0000 7fb793fff700 1 --2- 172.21.15.49:0/4288748779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb794098d10 0x7fb794155820 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fb78400c4c0 tx=0x7fb784007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:26.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.593+0000 7fb77bfff700 1 -- 172.21.15.49:0/4288748779 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb784007020 con 0x7fb794098d10 2023-11-30T17:07:26.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.593+0000 7fb77bfff700 1 -- 172.21.15.49:0/4288748779 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb784001e90 con 0x7fb794098d10 2023-11-30T17:07:26.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.593+0000 7fb79a291700 1 -- 172.21.15.49:0/4288748779 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7940c2730 con 0x7fb794098d10 2023-11-30T17:07:26.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.593+0000 7fb77bfff700 1 -- 172.21.15.49:0/4288748779 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7840073b0 con 0x7fb794098d10 2023-11-30T17:07:26.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.593+0000 7fb79a291700 1 -- 172.21.15.49:0/4288748779 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7940c5150 con 0x7fb794098d10 2023-11-30T17:07:26.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.594+0000 7fb79a291700 1 -- 172.21.15.49:0/4288748779 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb794167fa0 con 0x7fb794098d10 2023-11-30T17:07:26.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.594+0000 7fb77bfff700 1 -- 172.21.15.49:0/4288748779 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb7840068b0 con 0x7fb794098d10 2023-11-30T17:07:26.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.594+0000 7fb77bfff700 1 --2- 172.21.15.49:0/4288748779 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb78005f150 0x7fb780061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.595+0000 7fb77bfff700 1 -- 172.21.15.49:0/4288748779 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb784079c90 con 0x7fb794098d10 2023-11-30T17:07:26.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.595+0000 7fb77bfff700 1 --2- 172.21.15.49:0/4288748779 >> [v2:172.21.15.49:6800/90305,v1:172.21.15.49:6801/90305] conn(0x7fb7800684f0 0x7fb78006a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.595+0000 7fb7937fe700 1 --2- 172.21.15.49:0/4288748779 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb78005f150 0x7fb780061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.595+0000 7fb77bfff700 1 -- 172.21.15.49:0/4288748779 --> [v2:172.21.15.49:6800/90305,v1:172.21.15.49:6801/90305] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb78006afd0 con 0x7fb7800684f0 2023-11-30T17:07:26.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.595+0000 7fb77bfff700 1 -- 172.21.15.49:0/4288748779 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb78407c1f0 con 0x7fb794098d10 2023-11-30T17:07:26.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.595+0000 7fb79882e700 1 --2- 172.21.15.49:0/4288748779 >> [v2:172.21.15.49:6800/90305,v1:172.21.15.49:6801/90305] conn(0x7fb7800684f0 0x7fb78006a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.595+0000 7fb7937fe700 1 --2- 172.21.15.49:0/4288748779 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb78005f150 0x7fb780061610 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fb788006fd0 tx=0x7fb788017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:26.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.595+0000 7fb79882e700 1 --2- 172.21.15.49:0/4288748779 >> [v2:172.21.15.49:6800/90305,v1:172.21.15.49:6801/90305] conn(0x7fb7800684f0 0x7fb78006a950 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:26.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.596+0000 7fb77bfff700 1 -- 172.21.15.49:0/4288748779 <== osd.2 v2:172.21.15.49:6800/90305 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fb78006afd0 con 0x7fb7800684f0 2023-11-30T17:07:26.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.610+0000 7fb79a291700 1 -- 172.21.15.49:0/4288748779 --> [v2:172.21.15.49:6800/90305,v1:172.21.15.49:6801/90305] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb79406c860 con 0x7fb7800684f0 2023-11-30T17:07:26.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.610+0000 7fb77bfff700 1 -- 172.21.15.49:0/4288748779 <== osd.2 v2:172.21.15.49:6800/90305 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb79406c860 con 0x7fb7800684f0 2023-11-30T17:07:26.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.611+0000 7fb79a291700 1 -- 172.21.15.49:0/4288748779 >> [v2:172.21.15.49:6800/90305,v1:172.21.15.49:6801/90305] conn(0x7fb7800684f0 msgr2=0x7fb78006a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.611+0000 7fb79a291700 1 --2- 172.21.15.49:0/4288748779 >> [v2:172.21.15.49:6800/90305,v1:172.21.15.49:6801/90305] conn(0x7fb7800684f0 0x7fb78006a950 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.611+0000 7fb79a291700 1 -- 172.21.15.49:0/4288748779 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb78005f150 msgr2=0x7fb780061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.611+0000 7fb79a291700 1 --2- 172.21.15.49:0/4288748779 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb78005f150 0x7fb780061610 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fb788006fd0 tx=0x7fb788017000).stop 2023-11-30T17:07:26.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.611+0000 7fb79a291700 1 -- 172.21.15.49:0/4288748779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb794098d10 msgr2=0x7fb794155820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.611+0000 7fb79a291700 1 --2- 172.21.15.49:0/4288748779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb794098d10 0x7fb794155820 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fb78400c4c0 tx=0x7fb784007e00).stop 2023-11-30T17:07:26.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.611+0000 7fb79882e700 1 -- 172.21.15.49:0/4288748779 reap_dead start 2023-11-30T17:07:26.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.611+0000 7fb79a291700 1 -- 172.21.15.49:0/4288748779 shutdown_connections 2023-11-30T17:07:26.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.611+0000 7fb79a291700 1 -- 172.21.15.49:0/4288748779 >> 172.21.15.49:0/4288748779 conn(0x7fb7940cb310 msgr2=0x7fb79414bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:26.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.611+0000 7fb79a291700 1 -- 172.21.15.49:0/4288748779 shutdown_connections 2023-11-30T17:07:26.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.611+0000 7fb79a291700 1 -- 172.21.15.49:0/4288748779 wait complete. 2023-11-30T17:07:26.625 INFO:teuthology.orchestra.run.smithi049.stdout:55834574853 2023-11-30T17:07:26.625 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-30T17:07:26.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.741+0000 7fdc48e93700 1 Processor -- start 2023-11-30T17:07:26.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.741+0000 7fdc48e93700 1 -- start start 2023-11-30T17:07:26.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.742+0000 7fdc48e93700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdc440c6190 0x7fdc440c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.742+0000 7fdc48e93700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdc44158320 0x7fdc441587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.742+0000 7fdc48e93700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc44158cc0 con 0x7fdc44098d10 2023-11-30T17:07:26.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.742+0000 7fdc48e93700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc440c72d0 con 0x7fdc440c6190 2023-11-30T17:07:26.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.742+0000 7fdc48e93700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc44064570 con 0x7fdc44158320 2023-11-30T17:07:26.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.742+0000 7fdc41d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdc440c6190 0x7fdc440c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.742+0000 7fdc41d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdc440c6190 0x7fdc440c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59308/0 (socket says 172.21.15.49:59308) 2023-11-30T17:07:26.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.742+0000 7fdc4259c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdc44098d10 0x7fdc44063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34892/0 (socket says 172.21.15.49:34892) 2023-11-30T17:07:26.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.742+0000 7fdc41d9b700 1 -- 172.21.15.49:0/4247444176 learned_addr learned my addr 172.21.15.49:0/4247444176 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:26.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.743+0000 7fdc42d9d700 1 --2- 172.21.15.49:0/4247444176 >> v2:172.21.15.115:3300/0 conn(0x7fdc44158320 0x7fdc441587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.743+0000 7fdc41d9b700 1 -- 172.21.15.49:0/4247444176 >> v2:172.21.15.115:3300/0 conn(0x7fdc44158320 msgr2=0x7fdc441587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:26.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.743+0000 7fdc41d9b700 1 --2- 172.21.15.49:0/4247444176 >> v2:172.21.15.115:3300/0 conn(0x7fdc44158320 0x7fdc441587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.743+0000 7fdc41d9b700 1 -- 172.21.15.49:0/4247444176 >> v1:172.21.15.49:6789/0 conn(0x7fdc44098d10 legacy=0x7fdc44063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.743+0000 7fdc4159a700 1 -- 172.21.15.49:0/4247444176 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1537504879 0 0) 0x7fdc3c001490 con 0x7fdc44098d10 2023-11-30T17:07:26.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.743+0000 7fdc41d9b700 1 -- 172.21.15.49:0/4247444176 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc44154bc0 con 0x7fdc440c6190 2023-11-30T17:07:26.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.743+0000 7fdc42d9d700 1 --2- 172.21.15.49:0/4247444176 >> v2:172.21.15.115:3300/0 conn(0x7fdc44158320 0x7fdc441587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:26.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.743+0000 7fdc41d9b700 1 --2- 172.21.15.49:0/4247444176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc440c6190 0x7fdc440c7760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fdc440657a0 tx=0x7fdc2c0090f0).ready entity=mon.0 client_cookie=88272eb5e83cf9d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:26.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.743+0000 7fdc4159a700 1 -- 172.21.15.49:0/4247444176 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c00b600 con 0x7fdc440c6190 2023-11-30T17:07:26.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.743+0000 7fdc4159a700 1 -- 172.21.15.49:0/4247444176 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2c00b760 con 0x7fdc440c6190 2023-11-30T17:07:26.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.743+0000 7fdc4159a700 1 -- 172.21.15.49:0/4247444176 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c00bae0 con 0x7fdc440c6190 2023-11-30T17:07:26.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.743+0000 7fdc48e93700 1 -- 172.21.15.49:0/4247444176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc440c6190 msgr2=0x7fdc440c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.743+0000 7fdc48e93700 1 --2- 172.21.15.49:0/4247444176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc440c6190 0x7fdc440c7760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fdc440657a0 tx=0x7fdc2c0090f0).stop 2023-11-30T17:07:26.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.743+0000 7fdc48e93700 1 -- 172.21.15.49:0/4247444176 shutdown_connections 2023-11-30T17:07:26.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.743+0000 7fdc48e93700 1 --2- 172.21.15.49:0/4247444176 >> v2:172.21.15.115:3300/0 conn(0x7fdc44158320 0x7fdc441587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.743+0000 7fdc48e93700 1 --2- 172.21.15.49:0/4247444176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc440c6190 0x7fdc440c7760 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.743+0000 7fdc48e93700 1 -- 172.21.15.49:0/4247444176 >> 172.21.15.49:0/4247444176 conn(0x7fdc440cb310 msgr2=0x7fdc440cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:26.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.743+0000 7fdc48e93700 1 -- 172.21.15.49:0/4247444176 shutdown_connections 2023-11-30T17:07:26.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.744+0000 7fdc48e93700 1 -- 172.21.15.49:0/4247444176 wait complete. 2023-11-30T17:07:26.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.745+0000 7fdc48e93700 1 Processor -- start 2023-11-30T17:07:26.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.745+0000 7fdc48e93700 1 -- start start 2023-11-30T17:07:26.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.745+0000 7fdc48e93700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc44098d10 0x7fdc440b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.745+0000 7fdc48e93700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc440c6190 0x7fdc44152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.745+0000 7fdc48e93700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc44158320 0x7fdc44151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.745+0000 7fdc48e93700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc441520a0 con 0x7fdc44158320 2023-11-30T17:07:26.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.745+0000 7fdc48e93700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc441655a0 con 0x7fdc44098d10 2023-11-30T17:07:26.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.745+0000 7fdc48e93700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc44152a90 con 0x7fdc440c6190 2023-11-30T17:07:26.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.745+0000 7fdc42d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc44158320 0x7fdc44151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.745+0000 7fdc42d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc44158320 0x7fdc44151bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59316/0 (socket says 172.21.15.49:59316) 2023-11-30T17:07:26.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.745+0000 7fdc42d9d700 1 -- 172.21.15.49:0/2827636011 learned_addr learned my addr 172.21.15.49:0/2827636011 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:26.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.746+0000 7fdc41d9b700 1 --2- 172.21.15.49:0/2827636011 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc440c6190 0x7fdc44152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.746+0000 7fdc4259c700 1 --2- 172.21.15.49:0/2827636011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc44098d10 0x7fdc440b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.746+0000 7fdc42d9d700 1 -- 172.21.15.49:0/2827636011 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc440c6190 msgr2=0x7fdc44152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.746+0000 7fdc42d9d700 1 --2- 172.21.15.49:0/2827636011 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc440c6190 0x7fdc44152260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.746+0000 7fdc42d9d700 1 -- 172.21.15.49:0/2827636011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc44098d10 msgr2=0x7fdc440b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.746+0000 7fdc42d9d700 1 --2- 172.21.15.49:0/2827636011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc44098d10 0x7fdc440b02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.746+0000 7fdc42d9d700 1 -- 172.21.15.49:0/2827636011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2c009370 con 0x7fdc44158320 2023-11-30T17:07:26.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.746+0000 7fdc42d9d700 1 --2- 172.21.15.49:0/2827636011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc44158320 0x7fdc44151bb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fdc3400c680 tx=0x7fdc34008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:26.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.746+0000 7fdc3a7fc700 1 -- 172.21.15.49:0/2827636011 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc34010580 con 0x7fdc44158320 2023-11-30T17:07:26.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.746+0000 7fdc3a7fc700 1 -- 172.21.15.49:0/2827636011 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc340106e0 con 0x7fdc44158320 2023-11-30T17:07:26.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.746+0000 7fdc48e93700 1 -- 172.21.15.49:0/2827636011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc44164700 con 0x7fdc44158320 2023-11-30T17:07:26.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.746+0000 7fdc3a7fc700 1 -- 172.21.15.49:0/2827636011 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc34010a60 con 0x7fdc44158320 2023-11-30T17:07:26.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.746+0000 7fdc48e93700 1 -- 172.21.15.49:0/2827636011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc44164c70 con 0x7fdc44158320 2023-11-30T17:07:26.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.747+0000 7fdc48e93700 1 -- 172.21.15.49:0/2827636011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdc4406c860 con 0x7fdc44158320 2023-11-30T17:07:26.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.747+0000 7fdc3a7fc700 1 -- 172.21.15.49:0/2827636011 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdc3401b460 con 0x7fdc44158320 2023-11-30T17:07:26.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.748+0000 7fdc3a7fc700 1 --2- 172.21.15.49:0/2827636011 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdc2405f120 0x7fdc240615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.748+0000 7fdc3a7fc700 1 -- 172.21.15.49:0/2827636011 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdc3407a170 con 0x7fdc44158320 2023-11-30T17:07:26.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.748+0000 7fdc4259c700 1 --2- 172.21.15.49:0/2827636011 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdc2405f120 0x7fdc240615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.748+0000 7fdc3a7fc700 1 --2- 172.21.15.49:0/2827636011 >> [v2:172.21.15.49:6816/90322,v1:172.21.15.49:6817/90322] conn(0x7fdc240684c0 0x7fdc2406a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.748+0000 7fdc3a7fc700 1 -- 172.21.15.49:0/2827636011 --> [v2:172.21.15.49:6816/90322,v1:172.21.15.49:6817/90322] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdc2406afa0 con 0x7fdc240684c0 2023-11-30T17:07:26.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.748+0000 7fdc3a7fc700 1 -- 172.21.15.49:0/2827636011 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc3407c790 con 0x7fdc44158320 2023-11-30T17:07:26.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.748+0000 7fdc41d9b700 1 --2- 172.21.15.49:0/2827636011 >> [v2:172.21.15.49:6816/90322,v1:172.21.15.49:6817/90322] conn(0x7fdc240684c0 0x7fdc2406a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.748+0000 7fdc4259c700 1 --2- 172.21.15.49:0/2827636011 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdc2405f120 0x7fdc240615e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fdc3c0016f0 tx=0x7fdc3c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:26.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.748+0000 7fdc41d9b700 1 --2- 172.21.15.49:0/2827636011 >> [v2:172.21.15.49:6816/90322,v1:172.21.15.49:6817/90322] conn(0x7fdc240684c0 0x7fdc2406a920 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:26.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.749+0000 7fdc3a7fc700 1 -- 172.21.15.49:0/2827636011 <== osd.3 v2:172.21.15.49:6816/90322 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fdc2406afa0 con 0x7fdc240684c0 2023-11-30T17:07:26.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.763+0000 7fdc48e93700 1 -- 172.21.15.49:0/2827636011 --> [v2:172.21.15.49:6816/90322,v1:172.21.15.49:6817/90322] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdc440c66c0 con 0x7fdc240684c0 2023-11-30T17:07:26.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.763+0000 7fdc3a7fc700 1 -- 172.21.15.49:0/2827636011 <== osd.3 v2:172.21.15.49:6816/90322 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdc440c66c0 con 0x7fdc240684c0 2023-11-30T17:07:26.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.764+0000 7fdc48e93700 1 -- 172.21.15.49:0/2827636011 >> [v2:172.21.15.49:6816/90322,v1:172.21.15.49:6817/90322] conn(0x7fdc240684c0 msgr2=0x7fdc2406a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.764+0000 7fdc48e93700 1 --2- 172.21.15.49:0/2827636011 >> [v2:172.21.15.49:6816/90322,v1:172.21.15.49:6817/90322] conn(0x7fdc240684c0 0x7fdc2406a920 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.764+0000 7fdc48e93700 1 -- 172.21.15.49:0/2827636011 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdc2405f120 msgr2=0x7fdc240615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.764+0000 7fdc48e93700 1 --2- 172.21.15.49:0/2827636011 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdc2405f120 0x7fdc240615e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fdc3c0016f0 tx=0x7fdc3c009040).stop 2023-11-30T17:07:26.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.764+0000 7fdc48e93700 1 -- 172.21.15.49:0/2827636011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc44158320 msgr2=0x7fdc44151bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.764+0000 7fdc48e93700 1 --2- 172.21.15.49:0/2827636011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc44158320 0x7fdc44151bb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fdc3400c680 tx=0x7fdc34008040).stop 2023-11-30T17:07:26.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.764+0000 7fdc42d9d700 1 -- 172.21.15.49:0/2827636011 reap_dead start 2023-11-30T17:07:26.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.764+0000 7fdc48e93700 1 -- 172.21.15.49:0/2827636011 shutdown_connections 2023-11-30T17:07:26.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.764+0000 7fdc48e93700 1 -- 172.21.15.49:0/2827636011 >> 172.21.15.49:0/2827636011 conn(0x7fdc440cb310 msgr2=0x7fdc44153060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:26.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.764+0000 7fdc48e93700 1 -- 172.21.15.49:0/2827636011 shutdown_connections 2023-11-30T17:07:26.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.764+0000 7fdc48e93700 1 -- 172.21.15.49:0/2827636011 wait complete. 2023-11-30T17:07:26.778 INFO:teuthology.orchestra.run.smithi049.stdout:55834574853 2023-11-30T17:07:26.778 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-30T17:07:26.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.896+0000 7fd87ee42700 1 Processor -- start 2023-11-30T17:07:26.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.896+0000 7fd87ee42700 1 -- start start 2023-11-30T17:07:26.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.897+0000 7fd87ee42700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd8780c6b30 0x7fd878155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.897+0000 7fd87ee42700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8780bde50 0x7fd8780c2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.897+0000 7fd87ee42700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd878155fd0 con 0x7fd8781524b0 2023-11-30T17:07:26.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.897+0000 7fd87ee42700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd87814bff0 con 0x7fd8780c6b30 2023-11-30T17:07:26.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.897+0000 7fd87ee42700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd878155650 con 0x7fd8780bde50 2023-11-30T17:07:26.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.897+0000 7fd877fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd8781524b0 0x7fd8780bd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34896/0 (socket says 172.21.15.49:34896) 2023-11-30T17:07:26.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.897+0000 7fd877fff700 1 -- 172.21.15.49:0/67540427 learned_addr learned my addr 172.21.15.49:0/67540427 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:26.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.897+0000 7fd87cbde700 1 --2- 172.21.15.49:0/67540427 >> v2:172.21.15.115:3300/0 conn(0x7fd8780c6b30 0x7fd878155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.897+0000 7fd87d3df700 1 --2- 172.21.15.49:0/67540427 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8780bde50 0x7fd8780c2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.897+0000 7fd87cbde700 1 -- 172.21.15.49:0/67540427 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8780bde50 msgr2=0x7fd8780c2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:26.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.897+0000 7fd87cbde700 1 --2- 172.21.15.49:0/67540427 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8780bde50 0x7fd8780c2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.897+0000 7fd87cbde700 1 -- 172.21.15.49:0/67540427 >> v1:172.21.15.49:6789/0 conn(0x7fd8781524b0 legacy=0x7fd8780bd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.897+0000 7fd87cbde700 1 -- 172.21.15.49:0/67540427 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd878063b60 con 0x7fd8780c6b30 2023-11-30T17:07:26.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.897+0000 7fd87d3df700 1 --2- 172.21.15.49:0/67540427 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8780bde50 0x7fd8780c2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:07:26.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.897+0000 7fd87cbde700 1 --2- 172.21.15.49:0/67540427 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8780c6b30 0x7fd878155ae0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fd86c006fd0 tx=0x7fd86c006f40).ready entity=mon.1 client_cookie=a20336d2f9fe855e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:26.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.899+0000 7fd8777fe700 1 -- 172.21.15.49:0/67540427 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86c005880 con 0x7fd8780c6b30 2023-11-30T17:07:26.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.899+0000 7fd8777fe700 1 -- 172.21.15.49:0/67540427 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86c0059e0 con 0x7fd8780c6b30 2023-11-30T17:07:26.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.899+0000 7fd8777fe700 1 -- 172.21.15.49:0/67540427 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86c005d60 con 0x7fd8780c6b30 2023-11-30T17:07:26.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.899+0000 7fd87ee42700 1 -- 172.21.15.49:0/67540427 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8780c6b30 msgr2=0x7fd878155ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.899+0000 7fd87ee42700 1 --2- 172.21.15.49:0/67540427 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8780c6b30 0x7fd878155ae0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fd86c006fd0 tx=0x7fd86c006f40).stop 2023-11-30T17:07:26.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.899+0000 7fd87ee42700 1 -- 172.21.15.49:0/67540427 shutdown_connections 2023-11-30T17:07:26.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.899+0000 7fd87ee42700 1 --2- 172.21.15.49:0/67540427 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8780bde50 0x7fd8780c2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.899+0000 7fd87ee42700 1 --2- 172.21.15.49:0/67540427 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8780c6b30 0x7fd878155ae0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.899+0000 7fd87ee42700 1 -- 172.21.15.49:0/67540427 >> 172.21.15.49:0/67540427 conn(0x7fd8780c8230 msgr2=0x7fd8780c4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:26.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.899+0000 7fd87ee42700 1 -- 172.21.15.49:0/67540427 shutdown_connections 2023-11-30T17:07:26.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.900+0000 7fd87ee42700 1 -- 172.21.15.49:0/67540427 wait complete. 2023-11-30T17:07:26.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.901+0000 7fd87ee42700 1 Processor -- start 2023-11-30T17:07:26.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.901+0000 7fd87ee42700 1 -- start start 2023-11-30T17:07:26.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.902+0000 7fd87ee42700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8780bde50 0x7fd8780a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.902+0000 7fd87ee42700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8780c6b30 0x7fd878166850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.902+0000 7fd87ee42700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8781524b0 0x7fd878166d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.902+0000 7fd87ee42700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8780c1b80 con 0x7fd8781524b0 2023-11-30T17:07:26.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.902+0000 7fd87ee42700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8780aaf00 con 0x7fd8780c6b30 2023-11-30T17:07:26.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.902+0000 7fd87ee42700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8780c18a0 con 0x7fd8780bde50 2023-11-30T17:07:26.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.902+0000 7fd87d3df700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8781524b0 0x7fd878166d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.902+0000 7fd87d3df700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8781524b0 0x7fd878166d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59324/0 (socket says 172.21.15.49:59324) 2023-11-30T17:07:26.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.902+0000 7fd87d3df700 1 -- 172.21.15.49:0/1225983791 learned_addr learned my addr 172.21.15.49:0/1225983791 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:26.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.902+0000 7fd87cbde700 1 --2- 172.21.15.49:0/1225983791 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8780bde50 0x7fd8780a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.902+0000 7fd877fff700 1 --2- 172.21.15.49:0/1225983791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8780c6b30 0x7fd878166850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.902+0000 7fd87d3df700 1 -- 172.21.15.49:0/1225983791 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8780bde50 msgr2=0x7fd8780a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.902+0000 7fd87d3df700 1 --2- 172.21.15.49:0/1225983791 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8780bde50 0x7fd8780a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.902+0000 7fd87d3df700 1 -- 172.21.15.49:0/1225983791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8780c6b30 msgr2=0x7fd878166850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.902+0000 7fd87d3df700 1 --2- 172.21.15.49:0/1225983791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8780c6b30 0x7fd878166850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.902+0000 7fd87d3df700 1 -- 172.21.15.49:0/1225983791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd870009a20 con 0x7fd8781524b0 2023-11-30T17:07:26.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.902+0000 7fd87cbde700 1 --2- 172.21.15.49:0/1225983791 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8780bde50 0x7fd8780a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:26.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.902+0000 7fd877fff700 1 --2- 172.21.15.49:0/1225983791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8780c6b30 0x7fd878166850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:26.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.902+0000 7fd87d3df700 1 --2- 172.21.15.49:0/1225983791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8781524b0 0x7fd878166d40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fd87000ef90 tx=0x7fd87000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:26.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.902+0000 7fd874ff9700 1 -- 172.21.15.49:0/1225983791 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87000cd30 con 0x7fd8781524b0 2023-11-30T17:07:26.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.902+0000 7fd874ff9700 1 -- 172.21.15.49:0/1225983791 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87000f040 con 0x7fd8781524b0 2023-11-30T17:07:26.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.902+0000 7fd87ee42700 1 -- 172.21.15.49:0/1225983791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd86c009250 con 0x7fd8781524b0 2023-11-30T17:07:26.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.902+0000 7fd874ff9700 1 -- 172.21.15.49:0/1225983791 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd870013610 con 0x7fd8781524b0 2023-11-30T17:07:26.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.902+0000 7fd87ee42700 1 -- 172.21.15.49:0/1225983791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8780aab90 con 0x7fd8781524b0 2023-11-30T17:07:26.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.903+0000 7fd87ee42700 1 -- 172.21.15.49:0/1225983791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd87806c860 con 0x7fd8781524b0 2023-11-30T17:07:26.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.904+0000 7fd874ff9700 1 -- 172.21.15.49:0/1225983791 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd870013a40 con 0x7fd8781524b0 2023-11-30T17:07:26.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.904+0000 7fd874ff9700 1 --2- 172.21.15.49:0/1225983791 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd85c05f120 0x7fd85c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.904+0000 7fd874ff9700 1 -- 172.21.15.49:0/1225983791 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd87007ac10 con 0x7fd8781524b0 2023-11-30T17:07:26.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.904+0000 7fd874ff9700 1 --2- 172.21.15.49:0/1225983791 >> [v2:172.21.15.115:6800/90553,v1:172.21.15.115:6801/90553] conn(0x7fd85c0684c0 0x7fd85c06a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:26.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.904+0000 7fd874ff9700 1 -- 172.21.15.49:0/1225983791 --> [v2:172.21.15.115:6800/90553,v1:172.21.15.115:6801/90553] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd85c06afa0 con 0x7fd85c0684c0 2023-11-30T17:07:26.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.904+0000 7fd874ff9700 1 -- 172.21.15.49:0/1225983791 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd870080220 con 0x7fd8781524b0 2023-11-30T17:07:26.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.904+0000 7fd87cbde700 1 --2- 172.21.15.49:0/1225983791 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd85c05f120 0x7fd85c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.904+0000 7fd877fff700 1 --2- 172.21.15.49:0/1225983791 >> [v2:172.21.15.115:6800/90553,v1:172.21.15.115:6801/90553] conn(0x7fd85c0684c0 0x7fd85c06a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:26.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.905+0000 7fd877fff700 1 --2- 172.21.15.49:0/1225983791 >> [v2:172.21.15.115:6800/90553,v1:172.21.15.115:6801/90553] conn(0x7fd85c0684c0 0x7fd85c06a920 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:26.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.905+0000 7fd87cbde700 1 --2- 172.21.15.49:0/1225983791 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd85c05f120 0x7fd85c0615e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fd86c006f80 tx=0x7fd86c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:26.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.906+0000 7fd874ff9700 1 -- 172.21.15.49:0/1225983791 <== osd.4 v2:172.21.15.115:6800/90553 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fd85c06afa0 con 0x7fd85c0684c0 2023-11-30T17:07:26.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.920+0000 7fd87ee42700 1 -- 172.21.15.49:0/1225983791 --> [v2:172.21.15.115:6800/90553,v1:172.21.15.115:6801/90553] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd878063e40 con 0x7fd85c0684c0 2023-11-30T17:07:26.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.921+0000 7fd874ff9700 1 -- 172.21.15.49:0/1225983791 <== osd.4 v2:172.21.15.115:6800/90553 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd878063e40 con 0x7fd85c0684c0 2023-11-30T17:07:26.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.921+0000 7fd87ee42700 1 -- 172.21.15.49:0/1225983791 >> [v2:172.21.15.115:6800/90553,v1:172.21.15.115:6801/90553] conn(0x7fd85c0684c0 msgr2=0x7fd85c06a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.921+0000 7fd87ee42700 1 --2- 172.21.15.49:0/1225983791 >> [v2:172.21.15.115:6800/90553,v1:172.21.15.115:6801/90553] conn(0x7fd85c0684c0 0x7fd85c06a920 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:26.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.921+0000 7fd87ee42700 1 -- 172.21.15.49:0/1225983791 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd85c05f120 msgr2=0x7fd85c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.921+0000 7fd87ee42700 1 --2- 172.21.15.49:0/1225983791 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd85c05f120 0x7fd85c0615e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fd86c006f80 tx=0x7fd86c015000).stop 2023-11-30T17:07:26.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.921+0000 7fd87ee42700 1 -- 172.21.15.49:0/1225983791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8781524b0 msgr2=0x7fd878166d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:26.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.921+0000 7fd87ee42700 1 --2- 172.21.15.49:0/1225983791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8781524b0 0x7fd878166d40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fd87000ef90 tx=0x7fd87000b040).stop 2023-11-30T17:07:26.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.921+0000 7fd87d3df700 1 -- 172.21.15.49:0/1225983791 reap_dead start 2023-11-30T17:07:26.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.921+0000 7fd87ee42700 1 -- 172.21.15.49:0/1225983791 shutdown_connections 2023-11-30T17:07:26.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.921+0000 7fd87ee42700 1 -- 172.21.15.49:0/1225983791 >> 172.21.15.49:0/1225983791 conn(0x7fd8780c8230 msgr2=0x7fd8780c3950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:26.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.921+0000 7fd87ee42700 1 -- 172.21.15.49:0/1225983791 shutdown_connections 2023-11-30T17:07:26.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:26.921+0000 7fd87ee42700 1 -- 172.21.15.49:0/1225983791 wait complete. 2023-11-30T17:07:26.935 INFO:teuthology.orchestra.run.smithi049.stdout:55834574853 2023-11-30T17:07:26.936 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-30T17:07:27.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.052+0000 7f3b99ad4700 1 Processor -- start 2023-11-30T17:07:27.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.052+0000 7f3b99ad4700 1 -- start start 2023-11-30T17:07:27.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.053+0000 7f3b99ad4700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3b94098d10 0x7f3b940c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.053+0000 7f3b99ad4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b940c6190 0x7f3b94063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.053+0000 7f3b99ad4700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3b94064350 0x7f3b94158320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.053+0000 7f3b99ad4700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b940c72d0 con 0x7f3b94098d10 2023-11-30T17:07:27.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.053+0000 7f3b99ad4700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b94154bc0 con 0x7f3b94064350 2023-11-30T17:07:27.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.053+0000 7f3b99ad4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b940c66c0 con 0x7f3b940c6190 2023-11-30T17:07:27.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.053+0000 7f3b937fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3b94098d10 0x7f3b940c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.053+0000 7f3b937fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3b94098d10 0x7f3b940c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59334/0 (socket says 172.21.15.49:59334) 2023-11-30T17:07:27.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.053+0000 7f3b937fe700 1 -- 172.21.15.49:0/2768528902 learned_addr learned my addr 172.21.15.49:0/2768528902 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:27.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.053+0000 7f3b92ffd700 1 --2- 172.21.15.49:0/2768528902 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b940c6190 0x7f3b94063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.053+0000 7f3b93fff700 1 --2- 172.21.15.49:0/2768528902 >> v2:172.21.15.115:3300/0 conn(0x7f3b94064350 0x7f3b94158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.053+0000 7f3b937fe700 1 -- 172.21.15.49:0/2768528902 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b940c6190 msgr2=0x7f3b94063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:27.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.053+0000 7f3b937fe700 1 --2- 172.21.15.49:0/2768528902 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b940c6190 0x7f3b94063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:27.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.053+0000 7f3b937fe700 1 -- 172.21.15.49:0/2768528902 >> v2:172.21.15.115:3300/0 conn(0x7f3b94064350 msgr2=0x7f3b94158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:27.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.053+0000 7f3b937fe700 1 --2- 172.21.15.49:0/2768528902 >> v2:172.21.15.115:3300/0 conn(0x7f3b94064350 0x7f3b94158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:27.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.053+0000 7f3b937fe700 1 -- 172.21.15.49:0/2768528902 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b940c69a0 con 0x7f3b94098d10 2023-11-30T17:07:27.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.053+0000 7f3b937fe700 1 --2- 172.21.15.49:0/2768528902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b94098d10 0x7f3b940c7760 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f3b94084b10 tx=0x7f3b840090f0).ready entity=mon.0 client_cookie=e7e7960e0abe4a0f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:27.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.054+0000 7f3b927fc700 1 -- 172.21.15.49:0/2768528902 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8400b600 con 0x7f3b94098d10 2023-11-30T17:07:27.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.054+0000 7f3b927fc700 1 -- 172.21.15.49:0/2768528902 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8400b760 con 0x7f3b94098d10 2023-11-30T17:07:27.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.054+0000 7f3b927fc700 1 -- 172.21.15.49:0/2768528902 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8400bae0 con 0x7f3b94098d10 2023-11-30T17:07:27.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.054+0000 7f3b99ad4700 1 -- 172.21.15.49:0/2768528902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b94098d10 msgr2=0x7f3b940c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:27.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.054+0000 7f3b99ad4700 1 --2- 172.21.15.49:0/2768528902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b94098d10 0x7f3b940c7760 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f3b94084b10 tx=0x7f3b840090f0).stop 2023-11-30T17:07:27.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.054+0000 7f3b99ad4700 1 -- 172.21.15.49:0/2768528902 shutdown_connections 2023-11-30T17:07:27.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.054+0000 7f3b99ad4700 1 --2- 172.21.15.49:0/2768528902 >> v2:172.21.15.115:3300/0 conn(0x7f3b94064350 0x7f3b94158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:27.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.054+0000 7f3b99ad4700 1 --2- 172.21.15.49:0/2768528902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b94098d10 0x7f3b940c7760 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:27.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.054+0000 7f3b99ad4700 1 --2- 172.21.15.49:0/2768528902 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b940c6190 0x7f3b94063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:27.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.054+0000 7f3b99ad4700 1 -- 172.21.15.49:0/2768528902 >> 172.21.15.49:0/2768528902 conn(0x7f3b940cb310 msgr2=0x7f3b940cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:27.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.054+0000 7f3b99ad4700 1 -- 172.21.15.49:0/2768528902 shutdown_connections 2023-11-30T17:07:27.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.054+0000 7f3b99ad4700 1 -- 172.21.15.49:0/2768528902 wait complete. 2023-11-30T17:07:27.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.055+0000 7f3b99ad4700 1 Processor -- start 2023-11-30T17:07:27.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.055+0000 7f3b99ad4700 1 -- start start 2023-11-30T17:07:27.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.056+0000 7f3b99ad4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b94064350 0x7f3b94154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.056+0000 7f3b99ad4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b94098d10 0x7f3b940aaf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.056+0000 7f3b99ad4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b940c6190 0x7f3b940c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.056+0000 7f3b99ad4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b940aa190 con 0x7f3b940c6190 2023-11-30T17:07:27.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.056+0000 7f3b99ad4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b940c3560 con 0x7f3b94098d10 2023-11-30T17:07:27.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.056+0000 7f3b99ad4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b940c3800 con 0x7f3b94064350 2023-11-30T17:07:27.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.056+0000 7f3b93fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b940c6190 0x7f3b940c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.056+0000 7f3b93fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b940c6190 0x7f3b940c42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59344/0 (socket says 172.21.15.49:59344) 2023-11-30T17:07:27.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.056+0000 7f3b93fff700 1 -- 172.21.15.49:0/1530585288 learned_addr learned my addr 172.21.15.49:0/1530585288 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:27.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.056+0000 7f3b92ffd700 1 --2- 172.21.15.49:0/1530585288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b94098d10 0x7f3b940aaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.056+0000 7f3b937fe700 1 --2- 172.21.15.49:0/1530585288 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b94064350 0x7f3b94154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.057+0000 7f3b93fff700 1 -- 172.21.15.49:0/1530585288 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b94064350 msgr2=0x7f3b94154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:27.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.057+0000 7f3b93fff700 1 --2- 172.21.15.49:0/1530585288 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b94064350 0x7f3b94154dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:27.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.057+0000 7f3b93fff700 1 -- 172.21.15.49:0/1530585288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b94098d10 msgr2=0x7f3b940aaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:27.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.057+0000 7f3b93fff700 1 --2- 172.21.15.49:0/1530585288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b94098d10 0x7f3b940aaf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:27.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.057+0000 7f3b93fff700 1 -- 172.21.15.49:0/1530585288 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b84009370 con 0x7f3b940c6190 2023-11-30T17:07:27.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.057+0000 7f3b92ffd700 1 --2- 172.21.15.49:0/1530585288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b94098d10 0x7f3b940aaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:27.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.057+0000 7f3b937fe700 1 --2- 172.21.15.49:0/1530585288 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b94064350 0x7f3b94154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:27.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.057+0000 7f3b93fff700 1 --2- 172.21.15.49:0/1530585288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b940c6190 0x7f3b940c42e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f3b8c009fa0 tx=0x7f3b8c009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:27.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.057+0000 7f3b7b7fe700 1 -- 172.21.15.49:0/1530585288 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c00ed20 con 0x7f3b940c6190 2023-11-30T17:07:27.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.057+0000 7f3b7b7fe700 1 -- 172.21.15.49:0/1530585288 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8c00ee80 con 0x7f3b940c6190 2023-11-30T17:07:27.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.057+0000 7f3b99ad4700 1 -- 172.21.15.49:0/1530585288 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b940c3ae0 con 0x7f3b940c6190 2023-11-30T17:07:27.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.057+0000 7f3b7b7fe700 1 -- 172.21.15.49:0/1530585288 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c014610 con 0x7f3b940c6190 2023-11-30T17:07:27.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.057+0000 7f3b99ad4700 1 -- 172.21.15.49:0/1530585288 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b941552b0 con 0x7f3b940c6190 2023-11-30T17:07:27.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.058+0000 7f3b99ad4700 1 -- 172.21.15.49:0/1530585288 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3b94155530 con 0x7f3b940c6190 2023-11-30T17:07:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.058+0000 7f3b7b7fe700 1 -- 172.21.15.49:0/1530585288 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3b8c01d3b0 con 0x7f3b940c6190 2023-11-30T17:07:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.058+0000 7f3b7b7fe700 1 --2- 172.21.15.49:0/1530585288 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3b8005f120 0x7f3b800615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.059+0000 7f3b7b7fe700 1 -- 172.21.15.49:0/1530585288 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3b8c07a740 con 0x7f3b940c6190 2023-11-30T17:07:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.059+0000 7f3b7b7fe700 1 --2- 172.21.15.49:0/1530585288 >> [v2:172.21.15.115:6808/90554,v1:172.21.15.115:6811/90554] conn(0x7f3b800684c0 0x7f3b8006a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.059+0000 7f3b7b7fe700 1 -- 172.21.15.49:0/1530585288 --> [v2:172.21.15.115:6808/90554,v1:172.21.15.115:6811/90554] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3b8006afa0 con 0x7f3b800684c0 2023-11-30T17:07:27.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.059+0000 7f3b7b7fe700 1 -- 172.21.15.49:0/1530585288 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b8c07cd60 con 0x7f3b940c6190 2023-11-30T17:07:27.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.059+0000 7f3b937fe700 1 --2- 172.21.15.49:0/1530585288 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3b8005f120 0x7f3b800615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.059+0000 7f3b92ffd700 1 --2- 172.21.15.49:0/1530585288 >> [v2:172.21.15.115:6808/90554,v1:172.21.15.115:6811/90554] conn(0x7f3b800684c0 0x7f3b8006a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.059+0000 7f3b937fe700 1 --2- 172.21.15.49:0/1530585288 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3b8005f120 0x7f3b800615e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f3b8400b3c0 tx=0x7f3b84017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:27.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.059+0000 7f3b92ffd700 1 --2- 172.21.15.49:0/1530585288 >> [v2:172.21.15.115:6808/90554,v1:172.21.15.115:6811/90554] conn(0x7f3b800684c0 0x7f3b8006a920 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:27.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.060+0000 7f3b7b7fe700 1 -- 172.21.15.49:0/1530585288 <== osd.5 v2:172.21.15.115:6808/90554 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f3b8006afa0 con 0x7f3b800684c0 2023-11-30T17:07:27.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.074+0000 7f3b99ad4700 1 -- 172.21.15.49:0/1530585288 --> [v2:172.21.15.115:6808/90554,v1:172.21.15.115:6811/90554] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3b940ab6e0 con 0x7f3b800684c0 2023-11-30T17:07:27.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.075+0000 7f3b7b7fe700 1 -- 172.21.15.49:0/1530585288 <== osd.5 v2:172.21.15.115:6808/90554 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3b940ab6e0 con 0x7f3b800684c0 2023-11-30T17:07:27.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.075+0000 7f3b99ad4700 1 -- 172.21.15.49:0/1530585288 >> [v2:172.21.15.115:6808/90554,v1:172.21.15.115:6811/90554] conn(0x7f3b800684c0 msgr2=0x7f3b8006a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:27.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.075+0000 7f3b99ad4700 1 --2- 172.21.15.49:0/1530585288 >> [v2:172.21.15.115:6808/90554,v1:172.21.15.115:6811/90554] conn(0x7f3b800684c0 0x7f3b8006a920 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:27.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.075+0000 7f3b99ad4700 1 -- 172.21.15.49:0/1530585288 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3b8005f120 msgr2=0x7f3b800615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:27.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.075+0000 7f3b99ad4700 1 --2- 172.21.15.49:0/1530585288 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3b8005f120 0x7f3b800615e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f3b8400b3c0 tx=0x7f3b84017000).stop 2023-11-30T17:07:27.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.075+0000 7f3b99ad4700 1 -- 172.21.15.49:0/1530585288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b940c6190 msgr2=0x7f3b940c42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:27.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.075+0000 7f3b99ad4700 1 --2- 172.21.15.49:0/1530585288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b940c6190 0x7f3b940c42e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f3b8c009fa0 tx=0x7f3b8c009900).stop 2023-11-30T17:07:27.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.075+0000 7f3b93fff700 1 -- 172.21.15.49:0/1530585288 reap_dead start 2023-11-30T17:07:27.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.075+0000 7f3b99ad4700 1 -- 172.21.15.49:0/1530585288 shutdown_connections 2023-11-30T17:07:27.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.075+0000 7f3b99ad4700 1 -- 172.21.15.49:0/1530585288 >> 172.21.15.49:0/1530585288 conn(0x7f3b940cb310 msgr2=0x7f3b94148c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:27.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.075+0000 7f3b99ad4700 1 -- 172.21.15.49:0/1530585288 shutdown_connections 2023-11-30T17:07:27.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.075+0000 7f3b99ad4700 1 -- 172.21.15.49:0/1530585288 wait complete. 2023-11-30T17:07:27.089 INFO:teuthology.orchestra.run.smithi049.stdout:55834574853 2023-11-30T17:07:27.089 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-30T17:07:27.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.204+0000 7f09179d2700 1 Processor -- start 2023-11-30T17:07:27.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.205+0000 7f09179d2700 1 -- start start 2023-11-30T17:07:27.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.205+0000 7f09179d2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f091014ed10 0x7f09100a8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.205+0000 7f09179d2700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0910067770 con 0x7f0910158160 2023-11-30T17:07:27.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.205+0000 7f09179d2700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09100be8d0 con 0x7f09100a8280 2023-11-30T17:07:27.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.205+0000 7f09179d2700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0910159180 con 0x7f091014ed10 2023-11-30T17:07:27.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.206+0000 7f0915f6f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f091014ed10 0x7f09100a8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.206+0000 7f0915f6f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f091014ed10 0x7f09100a8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59356/0 (socket says 172.21.15.49:59356) 2023-11-30T17:07:27.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.206+0000 7f0915f6f700 1 -- 172.21.15.49:0/670260265 learned_addr learned my addr 172.21.15.49:0/670260265 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:27.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.206+0000 7f0914f6d700 1 --1- 172.21.15.49:0/670260265 >> v1:172.21.15.49:6789/0 conn(0x7f0910158160 0x7f091014e600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34902/0 (socket says 172.21.15.49:34902) 2023-11-30T17:07:27.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.206+0000 7f0915f6f700 1 -- 172.21.15.49:0/670260265 >> v1:172.21.15.115:6789/0 conn(0x7f09100a8280 legacy=0x7f0910155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:27.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.206+0000 7f0915f6f700 1 -- 172.21.15.49:0/670260265 >> v1:172.21.15.49:6789/0 conn(0x7f0910158160 legacy=0x7f091014e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:27.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.206+0000 7f090ffff700 1 -- 172.21.15.49:0/670260265 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2010546993 0 0) 0x7f0910067770 con 0x7f0910158160 2023-11-30T17:07:27.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.206+0000 7f0915f6f700 1 -- 172.21.15.49:0/670260265 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0910158600 con 0x7f091014ed10 2023-11-30T17:07:27.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.206+0000 7f0915f6f700 1 --2- 172.21.15.49:0/670260265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f091014ed10 0x7f09100a8660 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f0900009f20 tx=0x7f0900009840).ready entity=mon.0 client_cookie=93544bccb92a32ed server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:27.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.206+0000 7f090ffff700 1 -- 172.21.15.49:0/670260265 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090000e070 con 0x7f091014ed10 2023-11-30T17:07:27.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.206+0000 7f090ffff700 1 -- 172.21.15.49:0/670260265 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090000ba40 con 0x7f091014ed10 2023-11-30T17:07:27.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.206+0000 7f090ffff700 1 -- 172.21.15.49:0/670260265 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090000bdc0 con 0x7f091014ed10 2023-11-30T17:07:27.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.207+0000 7f09179d2700 1 -- 172.21.15.49:0/670260265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f091014ed10 msgr2=0x7f09100a8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:27.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.207+0000 7f09179d2700 1 --2- 172.21.15.49:0/670260265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f091014ed10 0x7f09100a8660 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f0900009f20 tx=0x7f0900009840).stop 2023-11-30T17:07:27.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.207+0000 7f09179d2700 1 -- 172.21.15.49:0/670260265 shutdown_connections 2023-11-30T17:07:27.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.207+0000 7f09179d2700 1 --2- 172.21.15.49:0/670260265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f091014ed10 0x7f09100a8660 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:27.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.207+0000 7f09179d2700 1 -- 172.21.15.49:0/670260265 >> 172.21.15.49:0/670260265 conn(0x7f0910062700 msgr2=0x7f0910062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:27.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.207+0000 7f09179d2700 1 -- 172.21.15.49:0/670260265 shutdown_connections 2023-11-30T17:07:27.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.207+0000 7f09179d2700 1 -- 172.21.15.49:0/670260265 wait complete. 2023-11-30T17:07:27.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.208+0000 7f09179d2700 1 Processor -- start 2023-11-30T17:07:27.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.208+0000 7f09179d2700 1 -- start start 2023-11-30T17:07:27.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.209+0000 7f09179d2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09100a8280 0x7f0910161890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.209+0000 7f09179d2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f091014ed10 0x7f0910157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.209+0000 7f09179d2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0910158160 0x7f09100a6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.209+0000 7f09179d2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0910167990 con 0x7f0910158160 2023-11-30T17:07:27.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.209+0000 7f09179d2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0910161d80 con 0x7f091014ed10 2023-11-30T17:07:27.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.209+0000 7f09179d2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09101654d0 con 0x7f09100a8280 2023-11-30T17:07:27.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.209+0000 7f0915f6f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0910158160 0x7f09100a6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.209+0000 7f0915f6f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0910158160 0x7f09100a6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59372/0 (socket says 172.21.15.49:59372) 2023-11-30T17:07:27.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.209+0000 7f0915f6f700 1 -- 172.21.15.49:0/585097241 learned_addr learned my addr 172.21.15.49:0/585097241 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:27.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.209+0000 7f0914f6d700 1 --2- 172.21.15.49:0/585097241 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f091014ed10 0x7f0910157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.209+0000 7f091576e700 1 --2- 172.21.15.49:0/585097241 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09100a8280 0x7f0910161890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.209+0000 7f0915f6f700 1 -- 172.21.15.49:0/585097241 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09100a8280 msgr2=0x7f0910161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:27.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.209+0000 7f0915f6f700 1 --2- 172.21.15.49:0/585097241 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09100a8280 0x7f0910161890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:27.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.209+0000 7f0915f6f700 1 -- 172.21.15.49:0/585097241 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f091014ed10 msgr2=0x7f0910157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:27.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.209+0000 7f0915f6f700 1 --2- 172.21.15.49:0/585097241 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f091014ed10 0x7f0910157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:27.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.209+0000 7f0915f6f700 1 -- 172.21.15.49:0/585097241 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0900009ae0 con 0x7f0910158160 2023-11-30T17:07:27.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.209+0000 7f0915f6f700 1 --2- 172.21.15.49:0/585097241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0910158160 0x7f09100a6ae0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f0910067900 tx=0x7f09100bea60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:27.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.210+0000 7f090d7fa700 1 -- 172.21.15.49:0/585097241 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09000092e0 con 0x7f0910158160 2023-11-30T17:07:27.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.210+0000 7f090d7fa700 1 -- 172.21.15.49:0/585097241 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090001d410 con 0x7f0910158160 2023-11-30T17:07:27.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.210+0000 7f09179d2700 1 -- 172.21.15.49:0/585097241 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0910167be0 con 0x7f0910158160 2023-11-30T17:07:27.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.210+0000 7f090d7fa700 1 -- 172.21.15.49:0/585097241 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090001d7b0 con 0x7f0910158160 2023-11-30T17:07:27.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.210+0000 7f09179d2700 1 -- 172.21.15.49:0/585097241 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09101681a0 con 0x7f0910158160 2023-11-30T17:07:27.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.210+0000 7f09179d2700 1 -- 172.21.15.49:0/585097241 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f091006c860 con 0x7f0910158160 2023-11-30T17:07:27.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.211+0000 7f090d7fa700 1 -- 172.21.15.49:0/585097241 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f090001db60 con 0x7f0910158160 2023-11-30T17:07:27.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.211+0000 7f090d7fa700 1 --2- 172.21.15.49:0/585097241 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f08fc05f150 0x7f08fc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.211+0000 7f090d7fa700 1 -- 172.21.15.49:0/585097241 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f090007c8c0 con 0x7f0910158160 2023-11-30T17:07:27.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.212+0000 7f090d7fa700 1 --2- 172.21.15.49:0/585097241 >> [v2:172.21.15.115:6809/90555,v1:172.21.15.115:6810/90555] conn(0x7f08fc0684f0 0x7f08fc06a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.212+0000 7f090d7fa700 1 -- 172.21.15.49:0/585097241 --> [v2:172.21.15.115:6809/90555,v1:172.21.15.115:6810/90555] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f08fc06afd0 con 0x7f08fc0684f0 2023-11-30T17:07:27.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.212+0000 7f091576e700 1 --2- 172.21.15.49:0/585097241 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f08fc05f150 0x7f08fc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.212+0000 7f090d7fa700 1 -- 172.21.15.49:0/585097241 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f090007cbb0 con 0x7f0910158160 2023-11-30T17:07:27.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.212+0000 7f0914f6d700 1 --2- 172.21.15.49:0/585097241 >> [v2:172.21.15.115:6809/90555,v1:172.21.15.115:6810/90555] conn(0x7f08fc0684f0 0x7f08fc06a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.212+0000 7f091576e700 1 --2- 172.21.15.49:0/585097241 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f08fc05f150 0x7f08fc061610 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f091014e390 tx=0x7f0908007d20).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:27.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.212+0000 7f0914f6d700 1 --2- 172.21.15.49:0/585097241 >> [v2:172.21.15.115:6809/90555,v1:172.21.15.115:6810/90555] conn(0x7f08fc0684f0 0x7f08fc06a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:27.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.213+0000 7f090d7fa700 1 -- 172.21.15.49:0/585097241 <== osd.6 v2:172.21.15.115:6809/90555 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f08fc06afd0 con 0x7f08fc0684f0 2023-11-30T17:07:27.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.227+0000 7f09179d2700 1 -- 172.21.15.49:0/585097241 --> [v2:172.21.15.115:6809/90555,v1:172.21.15.115:6810/90555] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f09100c3c90 con 0x7f08fc0684f0 2023-11-30T17:07:27.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.228+0000 7f090d7fa700 1 -- 172.21.15.49:0/585097241 <== osd.6 v2:172.21.15.115:6809/90555 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f09100c3c90 con 0x7f08fc0684f0 2023-11-30T17:07:27.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.228+0000 7f09179d2700 1 -- 172.21.15.49:0/585097241 >> [v2:172.21.15.115:6809/90555,v1:172.21.15.115:6810/90555] conn(0x7f08fc0684f0 msgr2=0x7f08fc06a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:27.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.228+0000 7f09179d2700 1 --2- 172.21.15.49:0/585097241 >> [v2:172.21.15.115:6809/90555,v1:172.21.15.115:6810/90555] conn(0x7f08fc0684f0 0x7f08fc06a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:27.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.228+0000 7f09179d2700 1 -- 172.21.15.49:0/585097241 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f08fc05f150 msgr2=0x7f08fc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:27.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.228+0000 7f09179d2700 1 --2- 172.21.15.49:0/585097241 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f08fc05f150 0x7f08fc061610 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f091014e390 tx=0x7f0908007d20).stop 2023-11-30T17:07:27.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.228+0000 7f09179d2700 1 -- 172.21.15.49:0/585097241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0910158160 msgr2=0x7f09100a6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:27.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.228+0000 7f09179d2700 1 --2- 172.21.15.49:0/585097241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0910158160 0x7f09100a6ae0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f0910067900 tx=0x7f09100bea60).stop 2023-11-30T17:07:27.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.228+0000 7f0915f6f700 1 -- 172.21.15.49:0/585097241 reap_dead start 2023-11-30T17:07:27.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.228+0000 7f09179d2700 1 -- 172.21.15.49:0/585097241 shutdown_connections 2023-11-30T17:07:27.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.228+0000 7f09179d2700 1 -- 172.21.15.49:0/585097241 >> 172.21.15.49:0/585097241 conn(0x7f0910062700 msgr2=0x7f0910062ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:27.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.228+0000 7f09179d2700 1 -- 172.21.15.49:0/585097241 shutdown_connections 2023-11-30T17:07:27.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.228+0000 7f09179d2700 1 -- 172.21.15.49:0/585097241 wait complete. 2023-11-30T17:07:27.242 INFO:teuthology.orchestra.run.smithi049.stdout:55834574853 2023-11-30T17:07:27.242 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-30T17:07:27.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.358+0000 7f06f46dd700 1 Processor -- start 2023-11-30T17:07:27.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.358+0000 7f06f46dd700 1 -- start start 2023-11-30T17:07:27.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.359+0000 7f06f46dd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f06ec158a30 0x7f06ec0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.359+0000 7f06f46dd700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ec0c72d0 con 0x7f06ec0c6190 2023-11-30T17:07:27.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.359+0000 7f06f46dd700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ec064570 con 0x7f06ec098d10 2023-11-30T17:07:27.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.359+0000 7f06f46dd700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ec154bc0 con 0x7f06ec158a30 2023-11-30T17:07:27.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.359+0000 7f06f2c7a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f06ec158a30 0x7f06ec0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.359+0000 7f06f1c78700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f06ec0c6190 0x7f06ec158320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34908/0 (socket says 172.21.15.49:34908) 2023-11-30T17:07:27.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.359+0000 7f06f1c78700 1 -- 172.21.15.49:0/799608425 learned_addr learned my addr 172.21.15.49:0/799608425 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:27.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.359+0000 7f06f2c7a700 1 -- 172.21.15.49:0/799608425 >> v1:172.21.15.115:6789/0 conn(0x7f06ec098d10 legacy=0x7f06ec063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:27.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.359+0000 7f06f2c7a700 1 -- 172.21.15.49:0/799608425 >> v1:172.21.15.49:6789/0 conn(0x7f06ec0c6190 legacy=0x7f06ec158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:27.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.359+0000 7f06f1477700 1 -- 172.21.15.49:0/799608425 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3681395550 0 0) 0x7f06ec0c72d0 con 0x7f06ec0c6190 2023-11-30T17:07:27.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.359+0000 7f06f2c7a700 1 -- 172.21.15.49:0/799608425 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec0c66c0 con 0x7f06ec158a30 2023-11-30T17:07:27.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.359+0000 7f06f2c7a700 1 --2- 172.21.15.49:0/799608425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06ec158a30 0x7f06ec0c7760 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f06e4009e60 tx=0x7f06e4009780).ready entity=mon.0 client_cookie=650822a85e1a7ea server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:27.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.359+0000 7f06f1477700 1 -- 172.21.15.49:0/799608425 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e400e070 con 0x7f06ec158a30 2023-11-30T17:07:27.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.359+0000 7f06f1477700 1 -- 172.21.15.49:0/799608425 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e400bc30 con 0x7f06ec158a30 2023-11-30T17:07:27.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.359+0000 7f06f1477700 1 -- 172.21.15.49:0/799608425 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e4012410 con 0x7f06ec158a30 2023-11-30T17:07:27.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.360+0000 7f06f46dd700 1 -- 172.21.15.49:0/799608425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06ec158a30 msgr2=0x7f06ec0c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:27.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.360+0000 7f06f46dd700 1 --2- 172.21.15.49:0/799608425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06ec158a30 0x7f06ec0c7760 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f06e4009e60 tx=0x7f06e4009780).stop 2023-11-30T17:07:27.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.360+0000 7f06f46dd700 1 -- 172.21.15.49:0/799608425 shutdown_connections 2023-11-30T17:07:27.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.360+0000 7f06f46dd700 1 --2- 172.21.15.49:0/799608425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06ec158a30 0x7f06ec0c7760 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:27.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.360+0000 7f06f46dd700 1 -- 172.21.15.49:0/799608425 >> 172.21.15.49:0/799608425 conn(0x7f06ec0cb310 msgr2=0x7f06ec0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:27.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.360+0000 7f06f46dd700 1 -- 172.21.15.49:0/799608425 shutdown_connections 2023-11-30T17:07:27.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.360+0000 7f06f46dd700 1 -- 172.21.15.49:0/799608425 wait complete. 2023-11-30T17:07:27.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.361+0000 7f06f46dd700 1 Processor -- start 2023-11-30T17:07:27.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.361+0000 7f06f46dd700 1 -- start start 2023-11-30T17:07:27.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.362+0000 7f06f46dd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06ec098d10 0x7f06ec1688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.362+0000 7f06f46dd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06ec0c6190 0x7f06ec1568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.362+0000 7f06f46dd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06ec158a30 0x7f06ec0ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.362+0000 7f06f46dd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec168d90 con 0x7f06ec098d10 2023-11-30T17:07:27.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.362+0000 7f06f46dd700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec0b0b40 con 0x7f06ec158a30 2023-11-30T17:07:27.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.362+0000 7f06f46dd700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec0afaa0 con 0x7f06ec0c6190 2023-11-30T17:07:27.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.362+0000 7f06f2479700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06ec098d10 0x7f06ec1688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.362+0000 7f06f2479700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06ec098d10 0x7f06ec1688a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59390/0 (socket says 172.21.15.49:59390) 2023-11-30T17:07:27.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.362+0000 7f06f2479700 1 -- 172.21.15.49:0/719776600 learned_addr learned my addr 172.21.15.49:0/719776600 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:27.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.362+0000 7f06f1c78700 1 --2- 172.21.15.49:0/719776600 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06ec0c6190 0x7f06ec1568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.362+0000 7f06f2c7a700 1 --2- 172.21.15.49:0/719776600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06ec158a30 0x7f06ec0ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.362+0000 7f06f2479700 1 -- 172.21.15.49:0/719776600 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06ec0c6190 msgr2=0x7f06ec1568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:27.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.362+0000 7f06f2479700 1 --2- 172.21.15.49:0/719776600 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06ec0c6190 0x7f06ec1568b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:27.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.362+0000 7f06f2479700 1 -- 172.21.15.49:0/719776600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06ec158a30 msgr2=0x7f06ec0ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:27.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.362+0000 7f06f2479700 1 --2- 172.21.15.49:0/719776600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06ec158a30 0x7f06ec0ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:27.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.362+0000 7f06f2479700 1 -- 172.21.15.49:0/719776600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e4009a20 con 0x7f06ec098d10 2023-11-30T17:07:27.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.362+0000 7f06f1c78700 1 --2- 172.21.15.49:0/719776600 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06ec0c6190 0x7f06ec1568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:27.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.362+0000 7f06f2479700 1 --2- 172.21.15.49:0/719776600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06ec098d10 0x7f06ec1688a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f06e800c4c0 tx=0x7f06e8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:27.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.363+0000 7f06e27fc700 1 -- 172.21.15.49:0/719776600 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e8007020 con 0x7f06ec098d10 2023-11-30T17:07:27.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.363+0000 7f06e27fc700 1 -- 172.21.15.49:0/719776600 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e8001e90 con 0x7f06ec098d10 2023-11-30T17:07:27.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.363+0000 7f06f46dd700 1 -- 172.21.15.49:0/719776600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ec0afd80 con 0x7f06ec098d10 2023-11-30T17:07:27.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.363+0000 7f06e27fc700 1 -- 172.21.15.49:0/719776600 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e80073d0 con 0x7f06ec098d10 2023-11-30T17:07:27.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.363+0000 7f06f46dd700 1 -- 172.21.15.49:0/719776600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ec0b0340 con 0x7f06ec098d10 2023-11-30T17:07:27.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.363+0000 7f06f46dd700 1 -- 172.21.15.49:0/719776600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f06ec06c860 con 0x7f06ec098d10 2023-11-30T17:07:27.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.364+0000 7f06e27fc700 1 -- 172.21.15.49:0/719776600 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f06e80068b0 con 0x7f06ec098d10 2023-11-30T17:07:27.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.364+0000 7f06e27fc700 1 --2- 172.21.15.49:0/719776600 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f06d005f150 0x7f06d0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.364+0000 7f06e27fc700 1 -- 172.21.15.49:0/719776600 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f06e8079af0 con 0x7f06ec098d10 2023-11-30T17:07:27.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.364+0000 7f06e27fc700 1 --2- 172.21.15.49:0/719776600 >> [v2:172.21.15.115:6824/90598,v1:172.21.15.115:6825/90598] conn(0x7f06d00684f0 0x7f06d006a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.364+0000 7f06f1c78700 1 --2- 172.21.15.49:0/719776600 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f06d005f150 0x7f06d0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.364+0000 7f06e27fc700 1 -- 172.21.15.49:0/719776600 --> [v2:172.21.15.115:6824/90598,v1:172.21.15.115:6825/90598] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f06d006afd0 con 0x7f06d00684f0 2023-11-30T17:07:27.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.364+0000 7f06e27fc700 1 -- 172.21.15.49:0/719776600 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06e807e220 con 0x7f06ec098d10 2023-11-30T17:07:27.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.365+0000 7f06f2c7a700 1 --2- 172.21.15.49:0/719776600 >> [v2:172.21.15.115:6824/90598,v1:172.21.15.115:6825/90598] conn(0x7f06d00684f0 0x7f06d006a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.365+0000 7f06f1c78700 1 --2- 172.21.15.49:0/719776600 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f06d005f150 0x7f06d0061610 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f06ec151660 tx=0x7f06dc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:27.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.365+0000 7f06f2c7a700 1 --2- 172.21.15.49:0/719776600 >> [v2:172.21.15.115:6824/90598,v1:172.21.15.115:6825/90598] conn(0x7f06d00684f0 0x7f06d006a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:27.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.366+0000 7f06e27fc700 1 -- 172.21.15.49:0/719776600 <== osd.7 v2:172.21.15.115:6824/90598 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f06d006afd0 con 0x7f06d00684f0 2023-11-30T17:07:27.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.380+0000 7f06f46dd700 1 -- 172.21.15.49:0/719776600 --> [v2:172.21.15.115:6824/90598,v1:172.21.15.115:6825/90598] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f06ec0b0990 con 0x7f06d00684f0 2023-11-30T17:07:27.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.381+0000 7f06e27fc700 1 -- 172.21.15.49:0/719776600 <== osd.7 v2:172.21.15.115:6824/90598 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f06ec0b0990 con 0x7f06d00684f0 2023-11-30T17:07:27.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.381+0000 7f06f46dd700 1 -- 172.21.15.49:0/719776600 >> [v2:172.21.15.115:6824/90598,v1:172.21.15.115:6825/90598] conn(0x7f06d00684f0 msgr2=0x7f06d006a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:27.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.381+0000 7f06f46dd700 1 --2- 172.21.15.49:0/719776600 >> [v2:172.21.15.115:6824/90598,v1:172.21.15.115:6825/90598] conn(0x7f06d00684f0 0x7f06d006a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:27.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.381+0000 7f06f46dd700 1 -- 172.21.15.49:0/719776600 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f06d005f150 msgr2=0x7f06d0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:27.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.381+0000 7f06f46dd700 1 --2- 172.21.15.49:0/719776600 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f06d005f150 0x7f06d0061610 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f06ec151660 tx=0x7f06dc009040).stop 2023-11-30T17:07:27.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.381+0000 7f06f46dd700 1 -- 172.21.15.49:0/719776600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06ec098d10 msgr2=0x7f06ec1688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:27.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.381+0000 7f06f46dd700 1 --2- 172.21.15.49:0/719776600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06ec098d10 0x7f06ec1688a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f06e800c4c0 tx=0x7f06e8007e00).stop 2023-11-30T17:07:27.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.381+0000 7f06f2c7a700 1 -- 172.21.15.49:0/719776600 reap_dead start 2023-11-30T17:07:27.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.381+0000 7f06f46dd700 1 -- 172.21.15.49:0/719776600 shutdown_connections 2023-11-30T17:07:27.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.381+0000 7f06f46dd700 1 -- 172.21.15.49:0/719776600 >> 172.21.15.49:0/719776600 conn(0x7f06ec0cb310 msgr2=0x7f06ec0c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:27.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.381+0000 7f06f46dd700 1 -- 172.21.15.49:0/719776600 shutdown_connections 2023-11-30T17:07:27.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.381+0000 7f06f46dd700 1 -- 172.21.15.49:0/719776600 wait complete. 2023-11-30T17:07:27.395 INFO:teuthology.orchestra.run.smithi049.stdout:55834574854 2023-11-30T17:07:27.395 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-30T17:07:27.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.511+0000 7f042c159700 1 Processor -- start 2023-11-30T17:07:27.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.511+0000 7f042c159700 1 -- start start 2023-11-30T17:07:27.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.512+0000 7f042c159700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0424098d10 0x7f04240c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.512+0000 7f042c159700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f04240c6190 0x7f0424063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.512+0000 7f042c159700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04240c72d0 con 0x7f0424064350 2023-11-30T17:07:27.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.512+0000 7f042c159700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0424154bc0 con 0x7f04240c6190 2023-11-30T17:07:27.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.512+0000 7f042c159700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04240c66c0 con 0x7f0424098d10 2023-11-30T17:07:27.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.512+0000 7f04296f4700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f04240c6190 0x7f0424063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.512+0000 7f04296f4700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f04240c6190 0x7f0424063e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59404/0 (socket says 172.21.15.49:59404) 2023-11-30T17:07:27.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.512+0000 7f04296f4700 1 -- 172.21.15.49:0/3376851839 learned_addr learned my addr 172.21.15.49:0/3376851839 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:27.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.512+0000 7f0429ef5700 1 --2- 172.21.15.49:0/3376851839 >> v2:172.21.15.115:3300/0 conn(0x7f0424098d10 0x7f04240c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.513+0000 7f04296f4700 1 -- 172.21.15.49:0/3376851839 >> v2:172.21.15.115:3300/0 conn(0x7f0424098d10 msgr2=0x7f04240c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:27.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.513+0000 7f04296f4700 1 --2- 172.21.15.49:0/3376851839 >> v2:172.21.15.115:3300/0 conn(0x7f0424098d10 0x7f04240c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:27.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.513+0000 7f04296f4700 1 -- 172.21.15.49:0/3376851839 >> v1:172.21.15.115:6789/0 conn(0x7f0424064350 legacy=0x7f0424158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:27.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.513+0000 7f0428ef3700 1 -- 172.21.15.49:0/3376851839 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1054000575 0 0) 0x7f04240c72d0 con 0x7f0424064350 2023-11-30T17:07:27.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.513+0000 7f04296f4700 1 -- 172.21.15.49:0/3376851839 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04240c69a0 con 0x7f04240c6190 2023-11-30T17:07:27.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.513+0000 7f04296f4700 1 --2- 172.21.15.49:0/3376851839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04240c6190 0x7f0424063e60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f0424083f80 tx=0x7f04200090f0).ready entity=mon.0 client_cookie=52de7cee4e3f840b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:27.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.513+0000 7f0428ef3700 1 -- 172.21.15.49:0/3376851839 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042000b520 con 0x7f04240c6190 2023-11-30T17:07:27.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.513+0000 7f0428ef3700 1 -- 172.21.15.49:0/3376851839 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042000b680 con 0x7f04240c6190 2023-11-30T17:07:27.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.513+0000 7f0428ef3700 1 -- 172.21.15.49:0/3376851839 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042000ba00 con 0x7f04240c6190 2023-11-30T17:07:27.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.513+0000 7f042c159700 1 -- 172.21.15.49:0/3376851839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04240c6190 msgr2=0x7f0424063e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:27.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.513+0000 7f042c159700 1 --2- 172.21.15.49:0/3376851839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04240c6190 0x7f0424063e60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f0424083f80 tx=0x7f04200090f0).stop 2023-11-30T17:07:27.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.514+0000 7f042c159700 1 -- 172.21.15.49:0/3376851839 shutdown_connections 2023-11-30T17:07:27.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.514+0000 7f042c159700 1 --2- 172.21.15.49:0/3376851839 >> v2:172.21.15.115:3300/0 conn(0x7f0424098d10 0x7f04240c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:27.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.514+0000 7f042c159700 1 --2- 172.21.15.49:0/3376851839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04240c6190 0x7f0424063e60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:27.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.514+0000 7f042c159700 1 -- 172.21.15.49:0/3376851839 >> 172.21.15.49:0/3376851839 conn(0x7f04240cb310 msgr2=0x7f04240cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:27.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.514+0000 7f042c159700 1 -- 172.21.15.49:0/3376851839 shutdown_connections 2023-11-30T17:07:27.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.514+0000 7f042c159700 1 -- 172.21.15.49:0/3376851839 wait complete. 2023-11-30T17:07:27.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.515+0000 7f042c159700 1 Processor -- start 2023-11-30T17:07:27.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.515+0000 7f042c159700 1 -- start start 2023-11-30T17:07:27.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.515+0000 7f042c159700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0424064350 0x7f04240aee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.516+0000 7f042c159700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0424098d10 0x7f04240c23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.516+0000 7f042c159700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04240c6190 0x7f042413fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.516+0000 7f042c159700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04240c28a0 con 0x7f0424064350 2023-11-30T17:07:27.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.516+0000 7f042c159700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04240aec30 con 0x7f04240c6190 2023-11-30T17:07:27.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.516+0000 7f042c159700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04241564b0 con 0x7f0424098d10 2023-11-30T17:07:27.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.516+0000 7f0429ef5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0424064350 0x7f04240aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.516+0000 7f0429ef5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0424064350 0x7f04240aee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59412/0 (socket says 172.21.15.49:59412) 2023-11-30T17:07:27.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.516+0000 7f0429ef5700 1 -- 172.21.15.49:0/1369671183 learned_addr learned my addr 172.21.15.49:0/1369671183 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:27.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.516+0000 7f04296f4700 1 --2- 172.21.15.49:0/1369671183 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0424098d10 0x7f04240c23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.516+0000 7f042a6f6700 1 --2- 172.21.15.49:0/1369671183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04240c6190 0x7f042413fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.516+0000 7f0429ef5700 1 -- 172.21.15.49:0/1369671183 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0424098d10 msgr2=0x7f04240c23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:27.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.516+0000 7f0429ef5700 1 --2- 172.21.15.49:0/1369671183 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0424098d10 0x7f04240c23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:27.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.516+0000 7f0429ef5700 1 -- 172.21.15.49:0/1369671183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04240c6190 msgr2=0x7f042413fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:27.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.516+0000 7f0429ef5700 1 --2- 172.21.15.49:0/1369671183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04240c6190 0x7f042413fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:27.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.516+0000 7f0429ef5700 1 -- 172.21.15.49:0/1369671183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0420009370 con 0x7f0424064350 2023-11-30T17:07:27.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.516+0000 7f0429ef5700 1 --2- 172.21.15.49:0/1369671183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0424064350 0x7f04240aee30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f041400e930 tx=0x7f0414009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:27.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.516+0000 7f0419ffb700 1 -- 172.21.15.49:0/1369671183 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0414012600 con 0x7f0424064350 2023-11-30T17:07:27.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.516+0000 7f0419ffb700 1 -- 172.21.15.49:0/1369671183 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0414012760 con 0x7f0424064350 2023-11-30T17:07:27.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.516+0000 7f042c159700 1 -- 172.21.15.49:0/1369671183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04240ae950 con 0x7f0424064350 2023-11-30T17:07:27.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.516+0000 7f0419ffb700 1 -- 172.21.15.49:0/1369671183 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0414012ae0 con 0x7f0424064350 2023-11-30T17:07:27.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.517+0000 7f042c159700 1 -- 172.21.15.49:0/1369671183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0424156140 con 0x7f0424064350 2023-11-30T17:07:27.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.518+0000 7f042c159700 1 -- 172.21.15.49:0/1369671183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f042406c860 con 0x7f0424064350 2023-11-30T17:07:27.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.518+0000 7f0419ffb700 1 -- 172.21.15.49:0/1369671183 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f041401b400 con 0x7f0424064350 2023-11-30T17:07:27.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.518+0000 7f0419ffb700 1 --2- 172.21.15.49:0/1369671183 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f040805f180 0x7f0408061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.518+0000 7f0419ffb700 1 -- 172.21.15.49:0/1369671183 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f041407a5d0 con 0x7f0424064350 2023-11-30T17:07:27.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.518+0000 7f04296f4700 1 --2- 172.21.15.49:0/1369671183 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f040805f180 0x7f0408061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.519+0000 7f04296f4700 1 --2- 172.21.15.49:0/1369671183 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f040805f180 0x7f0408061640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f0424083f80 tx=0x7f0420017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:27.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.522+0000 7f0419ffb700 1 -- 172.21.15.49:0/1369671183 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f041404b840 con 0x7f0424064350 2023-11-30T17:07:27.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.695+0000 7f042c159700 1 -- 172.21.15.49:0/1369671183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f04240c6c80 con 0x7f0424064350 2023-11-30T17:07:27.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.696+0000 7f0419ffb700 1 -- 172.21.15.49:0/1369671183 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f041404ee60 con 0x7f0424064350 2023-11-30T17:07:27.698 INFO:teuthology.orchestra.run.smithi049.stdout:55834574853 2023-11-30T17:07:27.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.697+0000 7f042c159700 1 -- 172.21.15.49:0/1369671183 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f040805f180 msgr2=0x7f0408061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:27.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.697+0000 7f042c159700 1 --2- 172.21.15.49:0/1369671183 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f040805f180 0x7f0408061640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f0424083f80 tx=0x7f0420017000).stop 2023-11-30T17:07:27.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.697+0000 7f042c159700 1 -- 172.21.15.49:0/1369671183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0424064350 msgr2=0x7f04240aee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:27.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.697+0000 7f042c159700 1 --2- 172.21.15.49:0/1369671183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0424064350 0x7f04240aee30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f041400e930 tx=0x7f0414009060).stop 2023-11-30T17:07:27.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.697+0000 7f042c159700 1 -- 172.21.15.49:0/1369671183 shutdown_connections 2023-11-30T17:07:27.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.697+0000 7f042c159700 1 --2- 172.21.15.49:0/1369671183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04240c6190 0x7f042413fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:27.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.697+0000 7f042c159700 1 --2- 172.21.15.49:0/1369671183 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f040805f180 0x7f0408061640 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:27.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.697+0000 7f042c159700 1 --2- 172.21.15.49:0/1369671183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0424064350 0x7f04240aee30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:27.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.697+0000 7f042c159700 1 --2- 172.21.15.49:0/1369671183 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0424098d10 0x7f04240c23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:27.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.697+0000 7f042c159700 1 -- 172.21.15.49:0/1369671183 >> 172.21.15.49:0/1369671183 conn(0x7f04240cb310 msgr2=0x7f04240ca800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:27.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.698+0000 7f042c159700 1 -- 172.21.15.49:0/1369671183 shutdown_connections 2023-11-30T17:07:27.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.698+0000 7f042c159700 1 -- 172.21.15.49:0/1369671183 wait complete. 2023-11-30T17:07:27.712 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2023-11-30T17:07:27.712 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-30T17:07:27.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.828+0000 7f0e7967d700 1 Processor -- start 2023-11-30T17:07:27.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.828+0000 7f0e7967d700 1 -- start start 2023-11-30T17:07:27.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.829+0000 7f0e7967d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0e74152480 0x7f0e74069df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.829+0000 7f0e7967d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e74152860 0x7f0e740c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.829+0000 7f0e7967d700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e740c4df0 con 0x7f0e74063560 2023-11-30T17:07:27.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.829+0000 7f0e7967d700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e7406a2e0 con 0x7f0e74152480 2023-11-30T17:07:27.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.829+0000 7f0e7967d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e740c4bd0 con 0x7f0e74152860 2023-11-30T17:07:27.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.829+0000 7f0e72ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0e74152480 0x7f0e74069df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.829+0000 7f0e72ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0e74152480 0x7f0e74069df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59426/0 (socket says 172.21.15.49:59426) 2023-11-30T17:07:27.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.829+0000 7f0e72ffd700 1 -- 172.21.15.49:0/1763074654 learned_addr learned my addr 172.21.15.49:0/1763074654 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:27.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.829+0000 7f0e727fc700 1 --2- 172.21.15.49:0/1763074654 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e74152860 0x7f0e740c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.829+0000 7f0e72ffd700 1 -- 172.21.15.49:0/1763074654 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e74152860 msgr2=0x7f0e740c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:27.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.829+0000 7f0e72ffd700 1 --2- 172.21.15.49:0/1763074654 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e74152860 0x7f0e740c46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:27.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.829+0000 7f0e72ffd700 1 -- 172.21.15.49:0/1763074654 >> v1:172.21.15.115:6789/0 conn(0x7f0e74063560 legacy=0x7f0e740bc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:27.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.829+0000 7f0e72ffd700 1 -- 172.21.15.49:0/1763074654 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e740639c0 con 0x7f0e74152480 2023-11-30T17:07:27.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.830+0000 7f0e72ffd700 1 --2- 172.21.15.49:0/1763074654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e74152480 0x7f0e74069df0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f0e6c009830 tx=0x7f0e6c0090f0).ready entity=mon.0 client_cookie=42dc5bf596c280a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:27.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.830+0000 7f0e71ffb700 1 -- 172.21.15.49:0/1763074654 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c00b600 con 0x7f0e74152480 2023-11-30T17:07:27.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.830+0000 7f0e71ffb700 1 -- 172.21.15.49:0/1763074654 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6c00b760 con 0x7f0e74152480 2023-11-30T17:07:27.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.830+0000 7f0e71ffb700 1 -- 172.21.15.49:0/1763074654 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c00bb00 con 0x7f0e74152480 2023-11-30T17:07:27.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.830+0000 7f0e7967d700 1 -- 172.21.15.49:0/1763074654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e74152480 msgr2=0x7f0e74069df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:27.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.830+0000 7f0e7967d700 1 --2- 172.21.15.49:0/1763074654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e74152480 0x7f0e74069df0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f0e6c009830 tx=0x7f0e6c0090f0).stop 2023-11-30T17:07:27.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.830+0000 7f0e7967d700 1 -- 172.21.15.49:0/1763074654 shutdown_connections 2023-11-30T17:07:27.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.830+0000 7f0e7967d700 1 --2- 172.21.15.49:0/1763074654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e74152480 0x7f0e74069df0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:27.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.830+0000 7f0e7967d700 1 --2- 172.21.15.49:0/1763074654 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e74152860 0x7f0e740c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:27.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.830+0000 7f0e7967d700 1 -- 172.21.15.49:0/1763074654 >> 172.21.15.49:0/1763074654 conn(0x7f0e740c7fb0 msgr2=0x7f0e740c3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:27.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.830+0000 7f0e7967d700 1 -- 172.21.15.49:0/1763074654 shutdown_connections 2023-11-30T17:07:27.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.830+0000 7f0e7967d700 1 -- 172.21.15.49:0/1763074654 wait complete. 2023-11-30T17:07:27.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.832+0000 7f0e7967d700 1 Processor -- start 2023-11-30T17:07:27.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.832+0000 7f0e7967d700 1 -- start start 2023-11-30T17:07:27.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.832+0000 7f0e7967d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e74063560 0x7f0e740ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.832+0000 7f0e7967d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e74152480 0x7f0e74142270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.832+0000 7f0e7967d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e74152860 0x7f0e740c1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.832+0000 7f0e7967d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e740ac560 con 0x7f0e74152480 2023-11-30T17:07:27.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.832+0000 7f0e7967d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e74142760 con 0x7f0e74063560 2023-11-30T17:07:27.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.832+0000 7f0e7967d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e74153f80 con 0x7f0e74152860 2023-11-30T17:07:27.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.832+0000 7f0e727fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e74152480 0x7f0e74142270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.832+0000 7f0e727fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e74152480 0x7f0e74142270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59440/0 (socket says 172.21.15.49:59440) 2023-11-30T17:07:27.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.832+0000 7f0e727fc700 1 -- 172.21.15.49:0/882813815 learned_addr learned my addr 172.21.15.49:0/882813815 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:27.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.832+0000 7f0e72ffd700 1 --2- 172.21.15.49:0/882813815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e74063560 0x7f0e740ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.832+0000 7f0e737fe700 1 --2- 172.21.15.49:0/882813815 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e74152860 0x7f0e740c1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.833+0000 7f0e727fc700 1 -- 172.21.15.49:0/882813815 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e74152860 msgr2=0x7f0e740c1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:27.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.833+0000 7f0e727fc700 1 --2- 172.21.15.49:0/882813815 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e74152860 0x7f0e740c1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:27.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.833+0000 7f0e727fc700 1 -- 172.21.15.49:0/882813815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e74063560 msgr2=0x7f0e740ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:27.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.833+0000 7f0e727fc700 1 --2- 172.21.15.49:0/882813815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e74063560 0x7f0e740ac070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:27.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.833+0000 7f0e727fc700 1 -- 172.21.15.49:0/882813815 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6c009370 con 0x7f0e74152480 2023-11-30T17:07:27.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.833+0000 7f0e727fc700 1 --2- 172.21.15.49:0/882813815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e74152480 0x7f0e74142270 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f0e5c00c650 tx=0x7f0e5c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:27.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.833+0000 7f0e6affd700 1 -- 172.21.15.49:0/882813815 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c010580 con 0x7f0e74152480 2023-11-30T17:07:27.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.833+0000 7f0e6affd700 1 -- 172.21.15.49:0/882813815 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5c0106e0 con 0x7f0e74152480 2023-11-30T17:07:27.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.833+0000 7f0e7967d700 1 -- 172.21.15.49:0/882813815 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e740ac770 con 0x7f0e74152480 2023-11-30T17:07:27.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.833+0000 7f0e6affd700 1 -- 172.21.15.49:0/882813815 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c010a60 con 0x7f0e74152480 2023-11-30T17:07:27.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.833+0000 7f0e7967d700 1 -- 172.21.15.49:0/882813815 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e740acd30 con 0x7f0e74152480 2023-11-30T17:07:27.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.834+0000 7f0e7967d700 1 -- 172.21.15.49:0/882813815 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e74154130 con 0x7f0e74152480 2023-11-30T17:07:27.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.834+0000 7f0e6affd700 1 -- 172.21.15.49:0/882813815 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0e5c01b460 con 0x7f0e74152480 2023-11-30T17:07:27.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.835+0000 7f0e6affd700 1 --2- 172.21.15.49:0/882813815 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0e5405f150 0x7f0e54061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:27.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.835+0000 7f0e6affd700 1 -- 172.21.15.49:0/882813815 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0e5c079f60 con 0x7f0e74152480 2023-11-30T17:07:27.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.835+0000 7f0e72ffd700 1 --2- 172.21.15.49:0/882813815 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0e5405f150 0x7f0e54061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:27.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.835+0000 7f0e72ffd700 1 --2- 172.21.15.49:0/882813815 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0e5405f150 0x7f0e54061610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f0e74153680 tx=0x7f0e6c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:27.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:27.839+0000 7f0e6affd700 1 -- 172.21.15.49:0/882813815 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0e74154130 con 0x7f0e74152480 2023-11-30T17:07:28.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.014+0000 7f0e7967d700 1 -- 172.21.15.49:0/882813815 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0e741540f0 con 0x7f0e74152480 2023-11-30T17:07:28.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.014+0000 7f0e6affd700 1 -- 172.21.15.49:0/882813815 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0e5c04b1d0 con 0x7f0e74152480 2023-11-30T17:07:28.017 INFO:teuthology.orchestra.run.smithi049.stdout:55834574853 2023-11-30T17:07:28.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.016+0000 7f0e7967d700 1 -- 172.21.15.49:0/882813815 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0e5405f150 msgr2=0x7f0e54061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:28.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.016+0000 7f0e7967d700 1 --2- 172.21.15.49:0/882813815 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0e5405f150 0x7f0e54061610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f0e74153680 tx=0x7f0e6c017000).stop 2023-11-30T17:07:28.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.016+0000 7f0e7967d700 1 -- 172.21.15.49:0/882813815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e74152480 msgr2=0x7f0e74142270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:28.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.016+0000 7f0e7967d700 1 --2- 172.21.15.49:0/882813815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e74152480 0x7f0e74142270 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f0e5c00c650 tx=0x7f0e5c008040).stop 2023-11-30T17:07:28.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.016+0000 7f0e7967d700 1 -- 172.21.15.49:0/882813815 shutdown_connections 2023-11-30T17:07:28.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.016+0000 7f0e7967d700 1 --2- 172.21.15.49:0/882813815 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e74152860 0x7f0e740c1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.016+0000 7f0e7967d700 1 --2- 172.21.15.49:0/882813815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e74063560 0x7f0e740ac070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.016+0000 7f0e7967d700 1 --2- 172.21.15.49:0/882813815 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0e5405f150 0x7f0e54061610 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.016+0000 7f0e7967d700 1 --2- 172.21.15.49:0/882813815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e74152480 0x7f0e74142270 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.016+0000 7f0e7967d700 1 -- 172.21.15.49:0/882813815 >> 172.21.15.49:0/882813815 conn(0x7f0e740c7fb0 msgr2=0x7f0e740c67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:28.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.016+0000 7f0e7967d700 1 -- 172.21.15.49:0/882813815 shutdown_connections 2023-11-30T17:07:28.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.016+0000 7f0e7967d700 1 -- 172.21.15.49:0/882813815 wait complete. 2023-11-30T17:07:28.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2023-11-30T17:07:28.031 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-30T17:07:28.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.147+0000 7fcb84788700 1 Processor -- start 2023-11-30T17:07:28.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.147+0000 7fcb84788700 1 -- start start 2023-11-30T17:07:28.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.148+0000 7fcb84788700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcb7c098d10 0x7fcb7c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:28.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.148+0000 7fcb84788700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb7c0c6190 0x7fcb7c063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:28.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.148+0000 7fcb84788700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb7c0c72d0 con 0x7fcb7c064350 2023-11-30T17:07:28.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.148+0000 7fcb84788700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb7c154bc0 con 0x7fcb7c098d10 2023-11-30T17:07:28.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.148+0000 7fcb84788700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c0c66c0 con 0x7fcb7c0c6190 2023-11-30T17:07:28.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.148+0000 7fcb82524700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcb7c098d10 0x7fcb7c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:28.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.148+0000 7fcb82524700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcb7c098d10 0x7fcb7c0c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59454/0 (socket says 172.21.15.49:59454) 2023-11-30T17:07:28.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.148+0000 7fcb82524700 1 -- 172.21.15.49:0/3837286957 learned_addr learned my addr 172.21.15.49:0/3837286957 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:28.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.148+0000 7fcb81d23700 1 --2- 172.21.15.49:0/3837286957 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb7c0c6190 0x7fcb7c063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:28.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.148+0000 7fcb82524700 1 -- 172.21.15.49:0/3837286957 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb7c0c6190 msgr2=0x7fcb7c063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:28.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.148+0000 7fcb82524700 1 --2- 172.21.15.49:0/3837286957 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb7c0c6190 0x7fcb7c063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.148+0000 7fcb82524700 1 -- 172.21.15.49:0/3837286957 >> v1:172.21.15.115:6789/0 conn(0x7fcb7c064350 legacy=0x7fcb7c158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:28.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.148+0000 7fcb82524700 1 -- 172.21.15.49:0/3837286957 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7c0c69a0 con 0x7fcb7c098d10 2023-11-30T17:07:28.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.148+0000 7fcb82524700 1 --2- 172.21.15.49:0/3837286957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb7c098d10 0x7fcb7c0c7760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fcb74006fd0 tx=0x7fcb740090f0).ready entity=mon.0 client_cookie=cf8eb17f0416b11a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:28.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.148+0000 7fcb81522700 1 -- 172.21.15.49:0/3837286957 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7400b600 con 0x7fcb7c098d10 2023-11-30T17:07:28.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.148+0000 7fcb81522700 1 -- 172.21.15.49:0/3837286957 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7400b760 con 0x7fcb7c098d10 2023-11-30T17:07:28.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.148+0000 7fcb81522700 1 -- 172.21.15.49:0/3837286957 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7400bae0 con 0x7fcb7c098d10 2023-11-30T17:07:28.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.149+0000 7fcb84788700 1 -- 172.21.15.49:0/3837286957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb7c098d10 msgr2=0x7fcb7c0c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:28.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.149+0000 7fcb84788700 1 --2- 172.21.15.49:0/3837286957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb7c098d10 0x7fcb7c0c7760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fcb74006fd0 tx=0x7fcb740090f0).stop 2023-11-30T17:07:28.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.149+0000 7fcb84788700 1 -- 172.21.15.49:0/3837286957 shutdown_connections 2023-11-30T17:07:28.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.149+0000 7fcb84788700 1 --2- 172.21.15.49:0/3837286957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb7c098d10 0x7fcb7c0c7760 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.149+0000 7fcb84788700 1 --2- 172.21.15.49:0/3837286957 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb7c0c6190 0x7fcb7c063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.149+0000 7fcb84788700 1 -- 172.21.15.49:0/3837286957 >> 172.21.15.49:0/3837286957 conn(0x7fcb7c0cb310 msgr2=0x7fcb7c0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:28.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.149+0000 7fcb84788700 1 -- 172.21.15.49:0/3837286957 shutdown_connections 2023-11-30T17:07:28.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.149+0000 7fcb84788700 1 -- 172.21.15.49:0/3837286957 wait complete. 2023-11-30T17:07:28.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.150+0000 7fcb84788700 1 Processor -- start 2023-11-30T17:07:28.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.150+0000 7fcb84788700 1 -- start start 2023-11-30T17:07:28.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.151+0000 7fcb84788700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb7c064350 0x7fcb7c0af670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:28.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.151+0000 7fcb84788700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb7c098d10 0x7fcb7c156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:28.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.151+0000 7fcb84788700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb7c0c6190 0x7fcb7c13ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:28.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.151+0000 7fcb84788700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c0b09d0 con 0x7fcb7c0c6190 2023-11-30T17:07:28.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.151+0000 7fcb84788700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c0afb60 con 0x7fcb7c098d10 2023-11-30T17:07:28.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.151+0000 7fcb84788700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c156e80 con 0x7fcb7c064350 2023-11-30T17:07:28.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.151+0000 7fcb82d25700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb7c0c6190 0x7fcb7c13ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:28.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.151+0000 7fcb82d25700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb7c0c6190 0x7fcb7c13ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59464/0 (socket says 172.21.15.49:59464) 2023-11-30T17:07:28.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.151+0000 7fcb82d25700 1 -- 172.21.15.49:0/530709405 learned_addr learned my addr 172.21.15.49:0/530709405 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:28.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.151+0000 7fcb82524700 1 --2- 172.21.15.49:0/530709405 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb7c064350 0x7fcb7c0af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:28.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.151+0000 7fcb81d23700 1 --2- 172.21.15.49:0/530709405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb7c098d10 0x7fcb7c156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:28.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.151+0000 7fcb82d25700 1 -- 172.21.15.49:0/530709405 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb7c064350 msgr2=0x7fcb7c0af670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:28.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.151+0000 7fcb82d25700 1 --2- 172.21.15.49:0/530709405 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb7c064350 0x7fcb7c0af670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.151+0000 7fcb82d25700 1 -- 172.21.15.49:0/530709405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb7c098d10 msgr2=0x7fcb7c156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:28.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.151+0000 7fcb82d25700 1 --2- 172.21.15.49:0/530709405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb7c098d10 0x7fcb7c156990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.151+0000 7fcb82d25700 1 -- 172.21.15.49:0/530709405 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb74009370 con 0x7fcb7c0c6190 2023-11-30T17:07:28.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.151+0000 7fcb82d25700 1 --2- 172.21.15.49:0/530709405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb7c0c6190 0x7fcb7c13ef40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fcb6c002230 tx=0x7fcb6c0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:28.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.152+0000 7fcb7a7fc700 1 -- 172.21.15.49:0/530709405 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c00e4a0 con 0x7fcb7c0c6190 2023-11-30T17:07:28.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.152+0000 7fcb7a7fc700 1 -- 172.21.15.49:0/530709405 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6c00e600 con 0x7fcb7c0c6190 2023-11-30T17:07:28.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.152+0000 7fcb84788700 1 -- 172.21.15.49:0/530709405 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb7c0afdc0 con 0x7fcb7c0c6190 2023-11-30T17:07:28.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.152+0000 7fcb7a7fc700 1 -- 172.21.15.49:0/530709405 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c00e980 con 0x7fcb7c0c6190 2023-11-30T17:07:28.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.152+0000 7fcb84788700 1 -- 172.21.15.49:0/530709405 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb7c0b0380 con 0x7fcb7c0c6190 2023-11-30T17:07:28.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.153+0000 7fcb84788700 1 -- 172.21.15.49:0/530709405 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb7c0b0b40 con 0x7fcb7c0c6190 2023-11-30T17:07:28.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.153+0000 7fcb7a7fc700 1 -- 172.21.15.49:0/530709405 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fcb6c01b3b0 con 0x7fcb7c0c6190 2023-11-30T17:07:28.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.154+0000 7fcb7a7fc700 1 --2- 172.21.15.49:0/530709405 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcb6805f150 0x7fcb68061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:28.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.154+0000 7fcb7a7fc700 1 -- 172.21.15.49:0/530709405 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcb6c0797f0 con 0x7fcb7c0c6190 2023-11-30T17:07:28.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.154+0000 7fcb82524700 1 --2- 172.21.15.49:0/530709405 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcb6805f150 0x7fcb68061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:28.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.154+0000 7fcb82524700 1 --2- 172.21.15.49:0/530709405 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcb6805f150 0x7fcb68061610 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fcb74009130 tx=0x7fcb74017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:28.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.158+0000 7fcb7a7fc700 1 -- 172.21.15.49:0/530709405 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcb6c048b00 con 0x7fcb7c0c6190 2023-11-30T17:07:28.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.329+0000 7fcb84788700 1 -- 172.21.15.49:0/530709405 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcb7c06c860 con 0x7fcb7c0c6190 2023-11-30T17:07:28.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.329+0000 7fcb7a7fc700 1 -- 172.21.15.49:0/530709405 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcb6c04ab10 con 0x7fcb7c0c6190 2023-11-30T17:07:28.331 INFO:teuthology.orchestra.run.smithi049.stdout:55834574853 2023-11-30T17:07:28.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.331+0000 7fcb84788700 1 -- 172.21.15.49:0/530709405 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcb6805f150 msgr2=0x7fcb68061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:28.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.331+0000 7fcb84788700 1 --2- 172.21.15.49:0/530709405 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcb6805f150 0x7fcb68061610 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fcb74009130 tx=0x7fcb74017000).stop 2023-11-30T17:07:28.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.331+0000 7fcb84788700 1 -- 172.21.15.49:0/530709405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb7c0c6190 msgr2=0x7fcb7c13ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:28.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.331+0000 7fcb84788700 1 --2- 172.21.15.49:0/530709405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb7c0c6190 0x7fcb7c13ef40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fcb6c002230 tx=0x7fcb6c0015e0).stop 2023-11-30T17:07:28.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.331+0000 7fcb84788700 1 -- 172.21.15.49:0/530709405 shutdown_connections 2023-11-30T17:07:28.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.331+0000 7fcb84788700 1 --2- 172.21.15.49:0/530709405 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcb6805f150 0x7fcb68061610 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.331+0000 7fcb84788700 1 --2- 172.21.15.49:0/530709405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb7c0c6190 0x7fcb7c13ef40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.331+0000 7fcb84788700 1 --2- 172.21.15.49:0/530709405 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb7c064350 0x7fcb7c0af670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.331+0000 7fcb84788700 1 --2- 172.21.15.49:0/530709405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb7c098d10 0x7fcb7c156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.331+0000 7fcb84788700 1 -- 172.21.15.49:0/530709405 >> 172.21.15.49:0/530709405 conn(0x7fcb7c0cb310 msgr2=0x7fcb7c0aa590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:28.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.331+0000 7fcb84788700 1 -- 172.21.15.49:0/530709405 shutdown_connections 2023-11-30T17:07:28.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.331+0000 7fcb84788700 1 -- 172.21.15.49:0/530709405 wait complete. 2023-11-30T17:07:28.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2023-11-30T17:07:28.345 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-30T17:07:28.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.461+0000 7fad8880e700 1 Processor -- start 2023-11-30T17:07:28.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.461+0000 7fad8880e700 1 -- start start 2023-11-30T17:07:28.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.462+0000 7fad8880e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad84154950 0x7fad840ca540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:28.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.462+0000 7fad8880e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad840c7bc0 con 0x7fad840c66f0 2023-11-30T17:07:28.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.462+0000 7fad8880e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad84155920 con 0x7fad8414e530 2023-11-30T17:07:28.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.462+0000 7fad8880e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad840c6ba0 con 0x7fad84154950 2023-11-30T17:07:28.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.462+0000 7fad82ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fad840c66f0 0x7fad84158570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34914/0 (socket says 172.21.15.49:34914) 2023-11-30T17:07:28.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.462+0000 7fad82ffd700 1 -- 172.21.15.49:0/1045800724 learned_addr learned my addr 172.21.15.49:0/1045800724 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:28.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.462+0000 7fad83fff700 1 --2- 172.21.15.49:0/1045800724 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad84154950 0x7fad840ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:28.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.462+0000 7fad827fc700 1 -- 172.21.15.49:0/1045800724 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2675836077 0 0) 0x7fad840c7bc0 con 0x7fad840c66f0 2023-11-30T17:07:28.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.462+0000 7fad827fc700 1 -- 172.21.15.49:0/1045800724 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad6c0033f0 con 0x7fad840c66f0 2023-11-30T17:07:28.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.462+0000 7fad827fc700 1 -- 172.21.15.49:0/1045800724 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1019739280 0 0) 0x7fad6c0033f0 con 0x7fad840c66f0 2023-11-30T17:07:28.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.462+0000 7fad827fc700 1 -- 172.21.15.49:0/1045800724 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad84154950 msgr2=0x7fad840ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:28.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.462+0000 7fad827fc700 1 --2- 172.21.15.49:0/1045800724 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad84154950 0x7fad840ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.462+0000 7fad827fc700 1 -- 172.21.15.49:0/1045800724 >> v1:172.21.15.115:6789/0 conn(0x7fad8414e530 legacy=0x7fad8414e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:28.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.463+0000 7fad827fc700 1 -- 172.21.15.49:0/1045800724 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad84154de0 con 0x7fad840c66f0 2023-11-30T17:07:28.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.463+0000 7fad827fc700 1 -- 172.21.15.49:0/1045800724 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fad78001470 con 0x7fad840c66f0 2023-11-30T17:07:28.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.463+0000 7fad827fc700 1 -- 172.21.15.49:0/1045800724 >> v1:172.21.15.49:6789/0 conn(0x7fad840c66f0 legacy=0x7fad84158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:28.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.463+0000 7fad827fc700 1 --2- 172.21.15.49:0/1045800724 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad84154950 0x7fad6c003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:28.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.463+0000 7fad827fc700 1 --2- 172.21.15.49:0/1045800724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad6c003e00 0x7fad6c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:28.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.463+0000 7fad827fc700 1 --2- 172.21.15.49:0/1045800724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad6c004b80 0x7fad6c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:28.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.463+0000 7fad827fc700 1 -- 172.21.15.49:0/1045800724 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad840c6ba0 con 0x7fad6c004b80 2023-11-30T17:07:28.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.463+0000 7fad827fc700 1 -- 172.21.15.49:0/1045800724 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c00b8e0 con 0x7fad6c003e00 2023-11-30T17:07:28.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.463+0000 7fad827fc700 1 -- 172.21.15.49:0/1045800724 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c00baa0 con 0x7fad84154950 2023-11-30T17:07:28.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.463+0000 7fad83fff700 1 --2- 172.21.15.49:0/1045800724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad6c004b80 0x7fad6c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:28.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.463+0000 7fad82ffd700 1 --2- 172.21.15.49:0/1045800724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad6c003e00 0x7fad6c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:28.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.463+0000 7fad837fe700 1 --2- 172.21.15.49:0/1045800724 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad84154950 0x7fad6c003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:28.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.463+0000 7fad83fff700 1 -- 172.21.15.49:0/1045800724 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad84154950 msgr2=0x7fad6c003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:28.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.463+0000 7fad83fff700 1 --2- 172.21.15.49:0/1045800724 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad84154950 0x7fad6c003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.463+0000 7fad83fff700 1 -- 172.21.15.49:0/1045800724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad6c003e00 msgr2=0x7fad6c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:28.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.463+0000 7fad83fff700 1 --2- 172.21.15.49:0/1045800724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad6c003e00 0x7fad6c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.463+0000 7fad83fff700 1 -- 172.21.15.49:0/1045800724 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6c0033f0 con 0x7fad6c004b80 2023-11-30T17:07:28.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.463+0000 7fad83fff700 1 --2- 172.21.15.49:0/1045800724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad6c004b80 0x7fad6c005000 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fad7c00e210 tx=0x7fad7c00b040).ready entity=mon.0 client_cookie=b953eada03723c4e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:28.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.463+0000 7fad827fc700 1 -- 172.21.15.49:0/1045800724 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c009ac0 con 0x7fad6c004b80 2023-11-30T17:07:28.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.463+0000 7fad827fc700 1 -- 172.21.15.49:0/1045800724 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7c00f040 con 0x7fad6c004b80 2023-11-30T17:07:28.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.463+0000 7fad827fc700 1 -- 172.21.15.49:0/1045800724 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c00ecd0 con 0x7fad6c004b80 2023-11-30T17:07:28.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.464+0000 7fad8880e700 1 -- 172.21.15.49:0/1045800724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad6c004b80 msgr2=0x7fad6c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:28.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.464+0000 7fad8880e700 1 --2- 172.21.15.49:0/1045800724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad6c004b80 0x7fad6c005000 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fad7c00e210 tx=0x7fad7c00b040).stop 2023-11-30T17:07:28.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.464+0000 7fad83fff700 1 -- 172.21.15.49:0/1045800724 reap_dead start 2023-11-30T17:07:28.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.464+0000 7fad8880e700 1 -- 172.21.15.49:0/1045800724 shutdown_connections 2023-11-30T17:07:28.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.464+0000 7fad8880e700 1 -- 172.21.15.49:0/1045800724 >> 172.21.15.49:0/1045800724 conn(0x7fad84064990 msgr2=0x7fad84064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:28.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.464+0000 7fad8880e700 1 -- 172.21.15.49:0/1045800724 shutdown_connections 2023-11-30T17:07:28.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.464+0000 7fad8880e700 1 -- 172.21.15.49:0/1045800724 wait complete. 2023-11-30T17:07:28.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.465+0000 7fad8880e700 1 Processor -- start 2023-11-30T17:07:28.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.465+0000 7fad8880e700 1 -- start start 2023-11-30T17:07:28.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.466+0000 7fad8880e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad840aecd0 0x7fad8414db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:28.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.466+0000 7fad8880e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad840af0b0 0x7fad840b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:28.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.466+0000 7fad8880e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad840af530 0x7fad8413d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:28.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.466+0000 7fad8880e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad840b05d0 con 0x7fad840aecd0 2023-11-30T17:07:28.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.466+0000 7fad8880e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad840af9c0 con 0x7fad840af0b0 2023-11-30T17:07:28.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.466+0000 7fad8880e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad840afca0 con 0x7fad840af530 2023-11-30T17:07:28.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.466+0000 7fad837fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad840aecd0 0x7fad8414db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:28.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.466+0000 7fad837fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad840aecd0 0x7fad8414db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59480/0 (socket says 172.21.15.49:59480) 2023-11-30T17:07:28.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.466+0000 7fad837fe700 1 -- 172.21.15.49:0/1499288211 learned_addr learned my addr 172.21.15.49:0/1499288211 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:28.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.466+0000 7fad82ffd700 1 --2- 172.21.15.49:0/1499288211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad840af0b0 0x7fad840b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:28.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.466+0000 7fad83fff700 1 --2- 172.21.15.49:0/1499288211 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad840af530 0x7fad8413d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:28.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.466+0000 7fad837fe700 1 -- 172.21.15.49:0/1499288211 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad840af530 msgr2=0x7fad8413d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:28.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.466+0000 7fad837fe700 1 --2- 172.21.15.49:0/1499288211 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad840af530 0x7fad8413d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.466+0000 7fad837fe700 1 -- 172.21.15.49:0/1499288211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad840af0b0 msgr2=0x7fad840b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:28.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.466+0000 7fad837fe700 1 --2- 172.21.15.49:0/1499288211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad840af0b0 0x7fad840b0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.466+0000 7fad837fe700 1 -- 172.21.15.49:0/1499288211 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad840aff80 con 0x7fad840aecd0 2023-11-30T17:07:28.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.466+0000 7fad83fff700 1 --2- 172.21.15.49:0/1499288211 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad840af530 0x7fad8413d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:28.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.466+0000 7fad837fe700 1 --2- 172.21.15.49:0/1499288211 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad840aecd0 0x7fad8414db90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fad740078e0 tx=0x7fad74007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:28.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.467+0000 7fad6b7fe700 1 -- 172.21.15.49:0/1499288211 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad74011590 con 0x7fad840aecd0 2023-11-30T17:07:28.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.467+0000 7fad6b7fe700 1 -- 172.21.15.49:0/1499288211 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad740116f0 con 0x7fad840aecd0 2023-11-30T17:07:28.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.467+0000 7fad8880e700 1 -- 172.21.15.49:0/1499288211 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad840b0260 con 0x7fad840aecd0 2023-11-30T17:07:28.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.467+0000 7fad6b7fe700 1 -- 172.21.15.49:0/1499288211 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad74011a70 con 0x7fad840aecd0 2023-11-30T17:07:28.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.467+0000 7fad8880e700 1 -- 172.21.15.49:0/1499288211 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad840b0f50 con 0x7fad840aecd0 2023-11-30T17:07:28.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.468+0000 7fad8880e700 1 -- 172.21.15.49:0/1499288211 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad84062ee0 con 0x7fad840aecd0 2023-11-30T17:07:28.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.468+0000 7fad6b7fe700 1 -- 172.21.15.49:0/1499288211 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fad74014450 con 0x7fad840aecd0 2023-11-30T17:07:28.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.468+0000 7fad6b7fe700 1 --2- 172.21.15.49:0/1499288211 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fad7005f150 0x7fad70061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:28.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.468+0000 7fad6b7fe700 1 -- 172.21.15.49:0/1499288211 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fad74079e50 con 0x7fad840aecd0 2023-11-30T17:07:28.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.469+0000 7fad82ffd700 1 --2- 172.21.15.49:0/1499288211 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fad7005f150 0x7fad70061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:28.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.469+0000 7fad82ffd700 1 --2- 172.21.15.49:0/1499288211 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fad7005f150 0x7fad70061610 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fad78001d00 tx=0x7fad78001e70).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:28.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.473+0000 7fad6b7fe700 1 -- 172.21.15.49:0/1499288211 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fad7404b170 con 0x7fad840aecd0 2023-11-30T17:07:28.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.647+0000 7fad8880e700 1 -- 172.21.15.49:0/1499288211 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fad8406c7c0 con 0x7fad840aecd0 2023-11-30T17:07:28.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.647+0000 7fad6b7fe700 1 -- 172.21.15.49:0/1499288211 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fad7404e790 con 0x7fad840aecd0 2023-11-30T17:07:28.649 INFO:teuthology.orchestra.run.smithi049.stdout:55834574853 2023-11-30T17:07:28.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.648+0000 7fad8880e700 1 -- 172.21.15.49:0/1499288211 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fad7005f150 msgr2=0x7fad70061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:28.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.648+0000 7fad8880e700 1 --2- 172.21.15.49:0/1499288211 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fad7005f150 0x7fad70061610 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fad78001d00 tx=0x7fad78001e70).stop 2023-11-30T17:07:28.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.648+0000 7fad8880e700 1 -- 172.21.15.49:0/1499288211 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad840aecd0 msgr2=0x7fad8414db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:28.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.649+0000 7fad8880e700 1 --2- 172.21.15.49:0/1499288211 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad840aecd0 0x7fad8414db90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fad740078e0 tx=0x7fad74007b90).stop 2023-11-30T17:07:28.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.649+0000 7fad8880e700 1 -- 172.21.15.49:0/1499288211 shutdown_connections 2023-11-30T17:07:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.649+0000 7fad8880e700 1 --2- 172.21.15.49:0/1499288211 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad840af530 0x7fad8413d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.649+0000 7fad8880e700 1 --2- 172.21.15.49:0/1499288211 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fad7005f150 0x7fad70061610 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.649+0000 7fad8880e700 1 --2- 172.21.15.49:0/1499288211 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad840aecd0 0x7fad8414db90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.649+0000 7fad8880e700 1 --2- 172.21.15.49:0/1499288211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad840af0b0 0x7fad840b0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.649+0000 7fad8880e700 1 -- 172.21.15.49:0/1499288211 >> 172.21.15.49:0/1499288211 conn(0x7fad84064990 msgr2=0x7fad84156760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.649+0000 7fad8880e700 1 -- 172.21.15.49:0/1499288211 shutdown_connections 2023-11-30T17:07:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.649+0000 7fad8880e700 1 -- 172.21.15.49:0/1499288211 wait complete. 2023-11-30T17:07:28.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2023-11-30T17:07:28.663 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-30T17:07:28.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.779+0000 7fe510aae700 1 Processor -- start 2023-11-30T17:07:28.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.779+0000 7fe510aae700 1 -- start start 2023-11-30T17:07:28.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.780+0000 7fe510aae700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50c0c6190 0x7fe50c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:28.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.780+0000 7fe510aae700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe50c158320 0x7fe50c1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:28.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.780+0000 7fe510aae700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe50c158cc0 con 0x7fe50c098d10 2023-11-30T17:07:28.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.780+0000 7fe510aae700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe50c0c72d0 con 0x7fe50c158320 2023-11-30T17:07:28.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.780+0000 7fe510aae700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c064570 con 0x7fe50c0c6190 2023-11-30T17:07:28.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.780+0000 7fe50ad9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe50c158320 0x7fe50c1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:28.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.781+0000 7fe50ad9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe50c158320 0x7fe50c1587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59488/0 (socket says 172.21.15.49:59488) 2023-11-30T17:07:28.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.781+0000 7fe50ad9d700 1 -- 172.21.15.49:0/3970760288 learned_addr learned my addr 172.21.15.49:0/3970760288 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:28.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.781+0000 7fe50a59c700 1 --1- 172.21.15.49:0/3970760288 >> v1:172.21.15.49:6789/0 conn(0x7fe50c098d10 0x7fe50c063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34918/0 (socket says 172.21.15.49:34918) 2023-11-30T17:07:28.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.781+0000 7fe509d9b700 1 --2- 172.21.15.49:0/3970760288 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50c0c6190 0x7fe50c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:28.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.781+0000 7fe50ad9d700 1 -- 172.21.15.49:0/3970760288 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50c0c6190 msgr2=0x7fe50c0c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:28.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.781+0000 7fe50ad9d700 1 --2- 172.21.15.49:0/3970760288 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50c0c6190 0x7fe50c0c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.781+0000 7fe50ad9d700 1 -- 172.21.15.49:0/3970760288 >> v1:172.21.15.49:6789/0 conn(0x7fe50c098d10 legacy=0x7fe50c063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:28.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.781+0000 7fe50959a700 1 -- 172.21.15.49:0/3970760288 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3155699302 0 0) 0x7fe504001490 con 0x7fe50c098d10 2023-11-30T17:07:28.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.781+0000 7fe50ad9d700 1 -- 172.21.15.49:0/3970760288 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50c154bc0 con 0x7fe50c158320 2023-11-30T17:07:28.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.781+0000 7fe509d9b700 1 --2- 172.21.15.49:0/3970760288 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50c0c6190 0x7fe50c0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:28.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.781+0000 7fe50ad9d700 1 --2- 172.21.15.49:0/3970760288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe50c158320 0x7fe50c1587d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fe4fc006fd0 tx=0x7fe4fc0090f0).ready entity=mon.0 client_cookie=9a7392ce498a852a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:28.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.781+0000 7fe50959a700 1 -- 172.21.15.49:0/3970760288 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc00b600 con 0x7fe50c158320 2023-11-30T17:07:28.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.781+0000 7fe50959a700 1 -- 172.21.15.49:0/3970760288 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4fc00b760 con 0x7fe50c158320 2023-11-30T17:07:28.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.781+0000 7fe50959a700 1 -- 172.21.15.49:0/3970760288 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc00bae0 con 0x7fe50c158320 2023-11-30T17:07:28.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.782+0000 7fe510aae700 1 -- 172.21.15.49:0/3970760288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe50c158320 msgr2=0x7fe50c1587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:28.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.782+0000 7fe510aae700 1 --2- 172.21.15.49:0/3970760288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe50c158320 0x7fe50c1587d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fe4fc006fd0 tx=0x7fe4fc0090f0).stop 2023-11-30T17:07:28.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.782+0000 7fe510aae700 1 -- 172.21.15.49:0/3970760288 shutdown_connections 2023-11-30T17:07:28.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.782+0000 7fe510aae700 1 --2- 172.21.15.49:0/3970760288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe50c158320 0x7fe50c1587d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.782+0000 7fe510aae700 1 --2- 172.21.15.49:0/3970760288 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50c0c6190 0x7fe50c0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.782+0000 7fe510aae700 1 -- 172.21.15.49:0/3970760288 >> 172.21.15.49:0/3970760288 conn(0x7fe50c0cb310 msgr2=0x7fe50c0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:28.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.782+0000 7fe510aae700 1 -- 172.21.15.49:0/3970760288 shutdown_connections 2023-11-30T17:07:28.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.782+0000 7fe510aae700 1 -- 172.21.15.49:0/3970760288 wait complete. 2023-11-30T17:07:28.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.783+0000 7fe510aae700 1 Processor -- start 2023-11-30T17:07:28.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.783+0000 7fe510aae700 1 -- start start 2023-11-30T17:07:28.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.784+0000 7fe510aae700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50c098d10 0x7fe50c140e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:28.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.784+0000 7fe510aae700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe50c0c6190 0x7fe50c153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:28.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.784+0000 7fe510aae700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe50c158320 0x7fe50c153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:28.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.784+0000 7fe510aae700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c152e70 con 0x7fe50c0c6190 2023-11-30T17:07:28.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.784+0000 7fe510aae700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c152b60 con 0x7fe50c158320 2023-11-30T17:07:28.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.784+0000 7fe510aae700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c0c4d80 con 0x7fe50c098d10 2023-11-30T17:07:28.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.784+0000 7fe509d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe50c0c6190 0x7fe50c153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:28.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.784+0000 7fe509d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe50c0c6190 0x7fe50c153290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59504/0 (socket says 172.21.15.49:59504) 2023-11-30T17:07:28.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.784+0000 7fe509d9b700 1 -- 172.21.15.49:0/1039909676 learned_addr learned my addr 172.21.15.49:0/1039909676 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:28.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.784+0000 7fe50a59c700 1 --2- 172.21.15.49:0/1039909676 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50c098d10 0x7fe50c140e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:28.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.784+0000 7fe50ad9d700 1 --2- 172.21.15.49:0/1039909676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe50c158320 0x7fe50c153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:28.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.784+0000 7fe509d9b700 1 -- 172.21.15.49:0/1039909676 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50c098d10 msgr2=0x7fe50c140e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:28.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.784+0000 7fe509d9b700 1 --2- 172.21.15.49:0/1039909676 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50c098d10 0x7fe50c140e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.784+0000 7fe509d9b700 1 -- 172.21.15.49:0/1039909676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe50c158320 msgr2=0x7fe50c153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:28.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.784+0000 7fe509d9b700 1 --2- 172.21.15.49:0/1039909676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe50c158320 0x7fe50c153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.784+0000 7fe509d9b700 1 -- 172.21.15.49:0/1039909676 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4fc009370 con 0x7fe50c0c6190 2023-11-30T17:07:28.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.784+0000 7fe50a59c700 1 --2- 172.21.15.49:0/1039909676 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50c098d10 0x7fe50c140e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:28.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.784+0000 7fe509d9b700 1 --2- 172.21.15.49:0/1039909676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe50c0c6190 0x7fe50c153290 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fe4f400c880 tx=0x7fe4f4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:28.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.784+0000 7fe5027fc700 1 -- 172.21.15.49:0/1039909676 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f4010580 con 0x7fe50c0c6190 2023-11-30T17:07:28.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.784+0000 7fe5027fc700 1 -- 172.21.15.49:0/1039909676 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f40106e0 con 0x7fe50c0c6190 2023-11-30T17:07:28.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.784+0000 7fe5027fc700 1 -- 172.21.15.49:0/1039909676 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f4010a60 con 0x7fe50c0c6190 2023-11-30T17:07:28.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.784+0000 7fe510aae700 1 -- 172.21.15.49:0/1039909676 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe50c0c5020 con 0x7fe50c0c6190 2023-11-30T17:07:28.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.784+0000 7fe510aae700 1 -- 172.21.15.49:0/1039909676 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe50c168d70 con 0x7fe50c0c6190 2023-11-30T17:07:28.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.786+0000 7fe510aae700 1 -- 172.21.15.49:0/1039909676 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe50c152fb0 con 0x7fe50c0c6190 2023-11-30T17:07:28.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.786+0000 7fe5027fc700 1 -- 172.21.15.49:0/1039909676 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe4f401b460 con 0x7fe50c0c6190 2023-11-30T17:07:28.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.786+0000 7fe5027fc700 1 --2- 172.21.15.49:0/1039909676 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe4ec05f150 0x7fe4ec061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:28.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.786+0000 7fe5027fc700 1 -- 172.21.15.49:0/1039909676 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe4f407a0d0 con 0x7fe50c0c6190 2023-11-30T17:07:28.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.787+0000 7fe50a59c700 1 --2- 172.21.15.49:0/1039909676 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe4ec05f150 0x7fe4ec061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:28.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.787+0000 7fe50a59c700 1 --2- 172.21.15.49:0/1039909676 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe4ec05f150 0x7fe4ec061610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fe504005fd0 tx=0x7fe504007cd0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:28.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.791+0000 7fe5027fc700 1 -- 172.21.15.49:0/1039909676 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe50c152fb0 con 0x7fe50c0c6190 2023-11-30T17:07:28.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.965+0000 7fe510aae700 1 -- 172.21.15.49:0/1039909676 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe50c152fb0 con 0x7fe50c0c6190 2023-11-30T17:07:28.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.965+0000 7fe5027fc700 1 -- 172.21.15.49:0/1039909676 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe50c152fb0 con 0x7fe50c0c6190 2023-11-30T17:07:28.968 INFO:teuthology.orchestra.run.smithi049.stdout:55834574853 2023-11-30T17:07:28.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.967+0000 7fe510aae700 1 -- 172.21.15.49:0/1039909676 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe4ec05f150 msgr2=0x7fe4ec061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:28.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.967+0000 7fe510aae700 1 --2- 172.21.15.49:0/1039909676 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe4ec05f150 0x7fe4ec061610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fe504005fd0 tx=0x7fe504007cd0).stop 2023-11-30T17:07:28.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.967+0000 7fe510aae700 1 -- 172.21.15.49:0/1039909676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe50c0c6190 msgr2=0x7fe50c153290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:28.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.967+0000 7fe510aae700 1 --2- 172.21.15.49:0/1039909676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe50c0c6190 0x7fe50c153290 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fe4f400c880 tx=0x7fe4f4008040).stop 2023-11-30T17:07:28.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.967+0000 7fe510aae700 1 -- 172.21.15.49:0/1039909676 shutdown_connections 2023-11-30T17:07:28.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.967+0000 7fe510aae700 1 --2- 172.21.15.49:0/1039909676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe50c158320 0x7fe50c153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.967+0000 7fe510aae700 1 --2- 172.21.15.49:0/1039909676 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50c098d10 0x7fe50c140e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.967+0000 7fe510aae700 1 --2- 172.21.15.49:0/1039909676 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe4ec05f150 0x7fe4ec061610 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.967+0000 7fe510aae700 1 --2- 172.21.15.49:0/1039909676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe50c0c6190 0x7fe50c153290 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:28.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.967+0000 7fe510aae700 1 -- 172.21.15.49:0/1039909676 >> 172.21.15.49:0/1039909676 conn(0x7fe50c0cb310 msgr2=0x7fe50c0ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:28.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.967+0000 7fe510aae700 1 -- 172.21.15.49:0/1039909676 shutdown_connections 2023-11-30T17:07:28.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:28.967+0000 7fe510aae700 1 -- 172.21.15.49:0/1039909676 wait complete. 2023-11-30T17:07:28.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2023-11-30T17:07:28.981 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-30T17:07:29.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.097+0000 7fcf9541f700 1 Processor -- start 2023-11-30T17:07:29.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.097+0000 7fcf9541f700 1 -- start start 2023-11-30T17:07:29.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.098+0000 7fcf9541f700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcf90098d10 0x7fcf900c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:29.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.098+0000 7fcf9541f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcf900c6190 0x7fcf90063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:29.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.098+0000 7fcf9541f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf90064350 0x7fcf90158320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:29.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.098+0000 7fcf9541f700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf900c72d0 con 0x7fcf900c6190 2023-11-30T17:07:29.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.098+0000 7fcf9541f700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf90154bc0 con 0x7fcf90098d10 2023-11-30T17:07:29.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.098+0000 7fcf9541f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900c66c0 con 0x7fcf90064350 2023-11-30T17:07:29.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.098+0000 7fcf8e7fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcf900c6190 0x7fcf90063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:29.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.098+0000 7fcf8e7fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcf900c6190 0x7fcf90063e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59518/0 (socket says 172.21.15.49:59518) 2023-11-30T17:07:29.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.098+0000 7fcf8e7fc700 1 -- 172.21.15.49:0/3714060446 learned_addr learned my addr 172.21.15.49:0/3714060446 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:29.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.098+0000 7fcf8f7fe700 1 --2- 172.21.15.49:0/3714060446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf90064350 0x7fcf90158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:29.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.098+0000 7fcf8effd700 1 --2- 172.21.15.49:0/3714060446 >> v2:172.21.15.115:3300/0 conn(0x7fcf90098d10 0x7fcf900c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:29.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.099+0000 7fcf8e7fc700 1 -- 172.21.15.49:0/3714060446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf90064350 msgr2=0x7fcf90158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:29.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.099+0000 7fcf8e7fc700 1 --2- 172.21.15.49:0/3714060446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf90064350 0x7fcf90158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:29.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.099+0000 7fcf8e7fc700 1 -- 172.21.15.49:0/3714060446 >> v2:172.21.15.115:3300/0 conn(0x7fcf90098d10 msgr2=0x7fcf900c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:29.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.099+0000 7fcf8e7fc700 1 --2- 172.21.15.49:0/3714060446 >> v2:172.21.15.115:3300/0 conn(0x7fcf90098d10 0x7fcf900c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:29.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.099+0000 7fcf8e7fc700 1 -- 172.21.15.49:0/3714060446 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf900c69a0 con 0x7fcf900c6190 2023-11-30T17:07:29.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.099+0000 7fcf8e7fc700 1 --2- 172.21.15.49:0/3714060446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf900c6190 0x7fcf90063e60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fcf90083f80 tx=0x7fcf780090f0).ready entity=mon.0 client_cookie=50749110e7eefb0a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:29.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.099+0000 7fcf8dffb700 1 -- 172.21.15.49:0/3714060446 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7800f510 con 0x7fcf900c6190 2023-11-30T17:07:29.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.099+0000 7fcf8dffb700 1 -- 172.21.15.49:0/3714060446 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7800f670 con 0x7fcf900c6190 2023-11-30T17:07:29.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.099+0000 7fcf8dffb700 1 -- 172.21.15.49:0/3714060446 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7800f9f0 con 0x7fcf900c6190 2023-11-30T17:07:29.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.099+0000 7fcf9541f700 1 -- 172.21.15.49:0/3714060446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf900c6190 msgr2=0x7fcf90063e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:29.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.099+0000 7fcf9541f700 1 --2- 172.21.15.49:0/3714060446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf900c6190 0x7fcf90063e60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fcf90083f80 tx=0x7fcf780090f0).stop 2023-11-30T17:07:29.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.099+0000 7fcf9541f700 1 -- 172.21.15.49:0/3714060446 shutdown_connections 2023-11-30T17:07:29.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.099+0000 7fcf9541f700 1 --2- 172.21.15.49:0/3714060446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf90064350 0x7fcf90158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:29.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.099+0000 7fcf9541f700 1 --2- 172.21.15.49:0/3714060446 >> v2:172.21.15.115:3300/0 conn(0x7fcf90098d10 0x7fcf900c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:29.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.099+0000 7fcf9541f700 1 --2- 172.21.15.49:0/3714060446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf900c6190 0x7fcf90063e60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:29.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.099+0000 7fcf9541f700 1 -- 172.21.15.49:0/3714060446 >> 172.21.15.49:0/3714060446 conn(0x7fcf900cb310 msgr2=0x7fcf900cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:29.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.099+0000 7fcf9541f700 1 -- 172.21.15.49:0/3714060446 shutdown_connections 2023-11-30T17:07:29.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.099+0000 7fcf9541f700 1 -- 172.21.15.49:0/3714060446 wait complete. 2023-11-30T17:07:29.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.101+0000 7fcf9541f700 1 Processor -- start 2023-11-30T17:07:29.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.101+0000 7fcf9541f700 1 -- start start 2023-11-30T17:07:29.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.102+0000 7fcf9541f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf90064350 0x7fcf900c4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:29.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.102+0000 7fcf9541f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf90098d10 0x7fcf901523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:29.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.102+0000 7fcf9541f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf900c6190 0x7fcf901528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:29.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.102+0000 7fcf9541f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900c4720 con 0x7fcf90064350 2023-11-30T17:07:29.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.102+0000 7fcf9541f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900c3b10 con 0x7fcf90098d10 2023-11-30T17:07:29.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.102+0000 7fcf9541f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900c3df0 con 0x7fcf900c6190 2023-11-30T17:07:29.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.102+0000 7fcf8effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf90064350 0x7fcf900c4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:29.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.102+0000 7fcf8effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf90064350 0x7fcf900c4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59528/0 (socket says 172.21.15.49:59528) 2023-11-30T17:07:29.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.102+0000 7fcf8effd700 1 -- 172.21.15.49:0/2997040175 learned_addr learned my addr 172.21.15.49:0/2997040175 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:29.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.102+0000 7fcf8e7fc700 1 --2- 172.21.15.49:0/2997040175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf90098d10 0x7fcf901523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:29.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.102+0000 7fcf8f7fe700 1 --2- 172.21.15.49:0/2997040175 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf900c6190 0x7fcf901528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:29.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.102+0000 7fcf8effd700 1 -- 172.21.15.49:0/2997040175 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf900c6190 msgr2=0x7fcf901528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:29.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.102+0000 7fcf8effd700 1 --2- 172.21.15.49:0/2997040175 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf900c6190 0x7fcf901528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:29.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.102+0000 7fcf8effd700 1 -- 172.21.15.49:0/2997040175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf90098d10 msgr2=0x7fcf901523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:29.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.102+0000 7fcf8effd700 1 --2- 172.21.15.49:0/2997040175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf90098d10 0x7fcf901523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:29.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.102+0000 7fcf8effd700 1 -- 172.21.15.49:0/2997040175 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf78009370 con 0x7fcf90064350 2023-11-30T17:07:29.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.102+0000 7fcf8f7fe700 1 --2- 172.21.15.49:0/2997040175 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf900c6190 0x7fcf901528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:29.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.102+0000 7fcf8effd700 1 --2- 172.21.15.49:0/2997040175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf90064350 0x7fcf900c4ee0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fcf8800e930 tx=0x7fcf88009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:29.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.102+0000 7fcf86ffd700 1 -- 172.21.15.49:0/2997040175 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf88017d90 con 0x7fcf90064350 2023-11-30T17:07:29.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.102+0000 7fcf86ffd700 1 -- 172.21.15.49:0/2997040175 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf88020470 con 0x7fcf90064350 2023-11-30T17:07:29.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.102+0000 7fcf9541f700 1 -- 172.21.15.49:0/2997040175 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf900c40d0 con 0x7fcf90064350 2023-11-30T17:07:29.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.102+0000 7fcf86ffd700 1 -- 172.21.15.49:0/2997040175 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf880207f0 con 0x7fcf90064350 2023-11-30T17:07:29.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.102+0000 7fcf9541f700 1 -- 172.21.15.49:0/2997040175 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf90152dd0 con 0x7fcf90064350 2023-11-30T17:07:29.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.103+0000 7fcf9541f700 1 -- 172.21.15.49:0/2997040175 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf9006c860 con 0x7fcf90064350 2023-11-30T17:07:29.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.104+0000 7fcf86ffd700 1 -- 172.21.15.49:0/2997040175 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fcf8801d070 con 0x7fcf90064350 2023-11-30T17:07:29.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.104+0000 7fcf86ffd700 1 --2- 172.21.15.49:0/2997040175 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcf7005f150 0x7fcf70061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:29.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.104+0000 7fcf86ffd700 1 -- 172.21.15.49:0/2997040175 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcf88082690 con 0x7fcf90064350 2023-11-30T17:07:29.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.104+0000 7fcf8e7fc700 1 --2- 172.21.15.49:0/2997040175 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcf7005f150 0x7fcf70061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:29.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.105+0000 7fcf8e7fc700 1 --2- 172.21.15.49:0/2997040175 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcf7005f150 0x7fcf70061610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fcf90083f80 tx=0x7fcf78017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:29.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.108+0000 7fcf86ffd700 1 -- 172.21.15.49:0/2997040175 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcf88053960 con 0x7fcf90064350 2023-11-30T17:07:29.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.281+0000 7fcf9541f700 1 -- 172.21.15.49:0/2997040175 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fcf900c4a00 con 0x7fcf90064350 2023-11-30T17:07:29.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.281+0000 7fcf86ffd700 1 -- 172.21.15.49:0/2997040175 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcf88056f80 con 0x7fcf90064350 2023-11-30T17:07:29.283 INFO:teuthology.orchestra.run.smithi049.stdout:55834574853 2023-11-30T17:07:29.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.283+0000 7fcf9541f700 1 -- 172.21.15.49:0/2997040175 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcf7005f150 msgr2=0x7fcf70061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:29.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.283+0000 7fcf9541f700 1 --2- 172.21.15.49:0/2997040175 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcf7005f150 0x7fcf70061610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fcf90083f80 tx=0x7fcf78017000).stop 2023-11-30T17:07:29.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.283+0000 7fcf9541f700 1 -- 172.21.15.49:0/2997040175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf90064350 msgr2=0x7fcf900c4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:29.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.283+0000 7fcf9541f700 1 --2- 172.21.15.49:0/2997040175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf90064350 0x7fcf900c4ee0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fcf8800e930 tx=0x7fcf88009060).stop 2023-11-30T17:07:29.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.283+0000 7fcf9541f700 1 -- 172.21.15.49:0/2997040175 shutdown_connections 2023-11-30T17:07:29.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.283+0000 7fcf9541f700 1 --2- 172.21.15.49:0/2997040175 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf900c6190 0x7fcf901528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:29.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.283+0000 7fcf9541f700 1 --2- 172.21.15.49:0/2997040175 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcf7005f150 0x7fcf70061610 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:29.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.283+0000 7fcf9541f700 1 --2- 172.21.15.49:0/2997040175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf90064350 0x7fcf900c4ee0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:29.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.283+0000 7fcf9541f700 1 --2- 172.21.15.49:0/2997040175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf90098d10 0x7fcf901523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:29.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.283+0000 7fcf9541f700 1 -- 172.21.15.49:0/2997040175 >> 172.21.15.49:0/2997040175 conn(0x7fcf900cb310 msgr2=0x7fcf900ca870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:29.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.283+0000 7fcf9541f700 1 -- 172.21.15.49:0/2997040175 shutdown_connections 2023-11-30T17:07:29.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.283+0000 7fcf9541f700 1 -- 172.21.15.49:0/2997040175 wait complete. 2023-11-30T17:07:29.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2023-11-30T17:07:29.297 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-30T17:07:29.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.413+0000 7f02120b1700 1 Processor -- start 2023-11-30T17:07:29.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.413+0000 7f02120b1700 1 -- start start 2023-11-30T17:07:29.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.414+0000 7f02120b1700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f020c13be20 0x7f020c0c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:29.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.414+0000 7f02120b1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f020c062700 0x7f020c062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:29.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.414+0000 7f02120b1700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020c0630a0 con 0x7f020c0c8780 2023-11-30T17:07:29.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.414+0000 7f02120b1700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f020c0c7500 con 0x7f020c13be20 2023-11-30T17:07:29.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.414+0000 7f02120b1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020c0bd650 con 0x7f020c062700 2023-11-30T17:07:29.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.414+0000 7f020b7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f020c13be20 0x7f020c0c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:29.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.414+0000 7f020bfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f020c062700 0x7f020c062bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:29.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.414+0000 7f020affd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f020c0c8780 0x7f020c0bcf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:33662/0 (socket says 172.21.15.49:33662) 2023-11-30T17:07:29.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.414+0000 7f020b7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f020c13be20 0x7f020c0c7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:55232/0 (socket says 172.21.15.49:55232) 2023-11-30T17:07:29.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.414+0000 7f020affd700 1 -- 172.21.15.49:0/3146148276 learned_addr learned my addr 172.21.15.49:0/3146148276 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:29.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.415+0000 7f020bfff700 1 -- 172.21.15.49:0/3146148276 >> v2:172.21.15.115:3300/0 conn(0x7f020c13be20 msgr2=0x7f020c0c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:29.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.415+0000 7f020bfff700 1 --2- 172.21.15.49:0/3146148276 >> v2:172.21.15.115:3300/0 conn(0x7f020c13be20 0x7f020c0c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:29.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.415+0000 7f020bfff700 1 -- 172.21.15.49:0/3146148276 >> v1:172.21.15.115:6789/0 conn(0x7f020c0c8780 legacy=0x7f020c0bcf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:29.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.415+0000 7f020bfff700 1 -- 172.21.15.49:0/3146148276 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c13c200 con 0x7f020c062700 2023-11-30T17:07:29.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.415+0000 7f020b7fe700 1 --2- 172.21.15.49:0/3146148276 >> v2:172.21.15.115:3300/0 conn(0x7f020c13be20 0x7f020c0c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:07:29.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.415+0000 7f020bfff700 1 --2- 172.21.15.49:0/3146148276 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f020c062700 0x7f020c062bb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f0204009e60 tx=0x7f0204009780).ready entity=mon.2 client_cookie=1ad1c359179cb56 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:29.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.415+0000 7f020a7fc700 1 -- 172.21.15.49:0/3146148276 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020400e070 con 0x7f020c062700 2023-11-30T17:07:29.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.415+0000 7f020a7fc700 1 -- 172.21.15.49:0/3146148276 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020400bb60 con 0x7f020c062700 2023-11-30T17:07:29.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.415+0000 7f020a7fc700 1 -- 172.21.15.49:0/3146148276 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0204012410 con 0x7f020c062700 2023-11-30T17:07:29.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.416+0000 7f02120b1700 1 -- 172.21.15.49:0/3146148276 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f020c062700 msgr2=0x7f020c062bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:29.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.416+0000 7f02120b1700 1 --2- 172.21.15.49:0/3146148276 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f020c062700 0x7f020c062bb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f0204009e60 tx=0x7f0204009780).stop 2023-11-30T17:07:29.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.416+0000 7f02120b1700 1 -- 172.21.15.49:0/3146148276 shutdown_connections 2023-11-30T17:07:29.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.416+0000 7f02120b1700 1 --2- 172.21.15.49:0/3146148276 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f020c062700 0x7f020c062bb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:29.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.416+0000 7f02120b1700 1 --2- 172.21.15.49:0/3146148276 >> v2:172.21.15.115:3300/0 conn(0x7f020c13be20 0x7f020c0c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:29.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.416+0000 7f02120b1700 1 -- 172.21.15.49:0/3146148276 >> 172.21.15.49:0/3146148276 conn(0x7f020c0642d0 msgr2=0x7f020c0c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:29.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.416+0000 7f02120b1700 1 -- 172.21.15.49:0/3146148276 shutdown_connections 2023-11-30T17:07:29.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.416+0000 7f02120b1700 1 -- 172.21.15.49:0/3146148276 wait complete. 2023-11-30T17:07:29.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.417+0000 7f02120b1700 1 Processor -- start 2023-11-30T17:07:29.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.417+0000 7f02120b1700 1 -- start start 2023-11-30T17:07:29.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.418+0000 7f02120b1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f020c062700 0x7f020c0ab230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:29.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.418+0000 7f02120b1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f020c0c8780 0x7f020c1374e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:29.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.418+0000 7f02120b1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f020c13be20 0x7f020c0c00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:29.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.418+0000 7f02120b1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c0a88c0 con 0x7f020c0c8780 2023-11-30T17:07:29.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.418+0000 7f02120b1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c0a8000 con 0x7f020c13be20 2023-11-30T17:07:29.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.418+0000 7f02120b1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020c0a8270 con 0x7f020c062700 2023-11-30T17:07:29.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.418+0000 7f020affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f020c0c8780 0x7f020c1374e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:29.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.418+0000 7f020affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f020c0c8780 0x7f020c1374e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59532/0 (socket says 172.21.15.49:59532) 2023-11-30T17:07:29.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.418+0000 7f020affd700 1 -- 172.21.15.49:0/3110994664 learned_addr learned my addr 172.21.15.49:0/3110994664 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:29.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.418+0000 7f020b7fe700 1 --2- 172.21.15.49:0/3110994664 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f020c062700 0x7f020c0ab230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:29.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.418+0000 7f020bfff700 1 --2- 172.21.15.49:0/3110994664 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f020c13be20 0x7f020c0c00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:29.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.418+0000 7f020affd700 1 -- 172.21.15.49:0/3110994664 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f020c062700 msgr2=0x7f020c0ab230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:29.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.418+0000 7f020affd700 1 --2- 172.21.15.49:0/3110994664 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f020c062700 0x7f020c0ab230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:29.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.418+0000 7f020affd700 1 -- 172.21.15.49:0/3110994664 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f020c13be20 msgr2=0x7f020c0c00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:29.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.418+0000 7f020affd700 1 --2- 172.21.15.49:0/3110994664 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f020c13be20 0x7f020c0c00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:29.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.418+0000 7f020affd700 1 -- 172.21.15.49:0/3110994664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01fc0092a0 con 0x7f020c0c8780 2023-11-30T17:07:29.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.418+0000 7f020bfff700 1 --2- 172.21.15.49:0/3110994664 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f020c13be20 0x7f020c0c00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:29.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.418+0000 7f020affd700 1 --2- 172.21.15.49:0/3110994664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f020c0c8780 0x7f020c1374e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f020000c4c0 tx=0x7f0200007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:29.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.419+0000 7f01f37fe700 1 -- 172.21.15.49:0/3110994664 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02000072e0 con 0x7f020c0c8780 2023-11-30T17:07:29.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.419+0000 7f01f37fe700 1 -- 172.21.15.49:0/3110994664 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0200007440 con 0x7f020c0c8780 2023-11-30T17:07:29.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.419+0000 7f02120b1700 1 -- 172.21.15.49:0/3110994664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0204009a20 con 0x7f020c0c8780 2023-11-30T17:07:29.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.419+0000 7f01f37fe700 1 -- 172.21.15.49:0/3110994664 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02000057a0 con 0x7f020c0c8780 2023-11-30T17:07:29.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.419+0000 7f02120b1700 1 -- 172.21.15.49:0/3110994664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020c0adf00 con 0x7f020c0c8780 2023-11-30T17:07:29.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.420+0000 7f02120b1700 1 -- 172.21.15.49:0/3110994664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f020c0a8a30 con 0x7f020c0c8780 2023-11-30T17:07:29.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.420+0000 7f01f37fe700 1 -- 172.21.15.49:0/3110994664 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0200005bd0 con 0x7f020c0c8780 2023-11-30T17:07:29.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.420+0000 7f01f37fe700 1 --2- 172.21.15.49:0/3110994664 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f01f805f150 0x7f01f8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:29.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.420+0000 7f01f37fe700 1 -- 172.21.15.49:0/3110994664 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0200079600 con 0x7f020c0c8780 2023-11-30T17:07:29.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.420+0000 7f020b7fe700 1 --2- 172.21.15.49:0/3110994664 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f01f805f150 0x7f01f8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:29.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.421+0000 7f020b7fe700 1 --2- 172.21.15.49:0/3110994664 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f01f805f150 0x7f01f8061610 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f01fc009dc0 tx=0x7f01fc009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:29.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.424+0000 7f01f37fe700 1 -- 172.21.15.49:0/3110994664 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f020004a870 con 0x7f020c0c8780 2023-11-30T17:07:29.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.595+0000 7f02120b1700 1 -- 172.21.15.49:0/3110994664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f020c0630a0 con 0x7f020c0c8780 2023-11-30T17:07:29.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.595+0000 7f01f37fe700 1 -- 172.21.15.49:0/3110994664 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0200018020 con 0x7f020c0c8780 2023-11-30T17:07:29.598 INFO:teuthology.orchestra.run.smithi049.stdout:55834574853 2023-11-30T17:07:29.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.597+0000 7f02120b1700 1 -- 172.21.15.49:0/3110994664 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f01f805f150 msgr2=0x7f01f8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:29.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.597+0000 7f02120b1700 1 --2- 172.21.15.49:0/3110994664 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f01f805f150 0x7f01f8061610 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f01fc009dc0 tx=0x7f01fc009060).stop 2023-11-30T17:07:29.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.597+0000 7f02120b1700 1 -- 172.21.15.49:0/3110994664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f020c0c8780 msgr2=0x7f020c1374e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:29.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.597+0000 7f02120b1700 1 --2- 172.21.15.49:0/3110994664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f020c0c8780 0x7f020c1374e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f020000c4c0 tx=0x7f0200007dc0).stop 2023-11-30T17:07:29.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.597+0000 7f02120b1700 1 -- 172.21.15.49:0/3110994664 shutdown_connections 2023-11-30T17:07:29.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.597+0000 7f02120b1700 1 --2- 172.21.15.49:0/3110994664 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f020c13be20 0x7f020c0c00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:29.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.597+0000 7f02120b1700 1 --2- 172.21.15.49:0/3110994664 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f020c062700 0x7f020c0ab230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:29.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.597+0000 7f02120b1700 1 --2- 172.21.15.49:0/3110994664 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f01f805f150 0x7f01f8061610 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:29.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.597+0000 7f02120b1700 1 --2- 172.21.15.49:0/3110994664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f020c0c8780 0x7f020c1374e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:29.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.597+0000 7f02120b1700 1 -- 172.21.15.49:0/3110994664 >> 172.21.15.49:0/3110994664 conn(0x7f020c0642d0 msgr2=0x7f020c0a6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:29.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.597+0000 7f02120b1700 1 -- 172.21.15.49:0/3110994664 shutdown_connections 2023-11-30T17:07:29.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.597+0000 7f02120b1700 1 -- 172.21.15.49:0/3110994664 wait complete. 2023-11-30T17:07:29.612 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2023-11-30T17:07:29.612 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-30T17:07:29.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.727+0000 7efc5eef1700 1 Processor -- start 2023-11-30T17:07:29.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.727+0000 7efc5eef1700 1 -- start start 2023-11-30T17:07:29.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.728+0000 7efc5eef1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc58158a30 0x7efc580c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:29.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.728+0000 7efc5eef1700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc580c72d0 con 0x7efc58098d10 2023-11-30T17:07:29.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.728+0000 7efc5eef1700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc58064570 con 0x7efc580c6190 2023-11-30T17:07:29.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.728+0000 7efc5eef1700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc58154bc0 con 0x7efc58158a30 2023-11-30T17:07:29.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.728+0000 7efc5d48e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc58158a30 0x7efc580c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:29.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.728+0000 7efc5cc8d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7efc58098d10 0x7efc58063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34932/0 (socket says 172.21.15.49:34932) 2023-11-30T17:07:29.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.728+0000 7efc5d48e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc58158a30 0x7efc580c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59538/0 (socket says 172.21.15.49:59538) 2023-11-30T17:07:29.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.728+0000 7efc5cc8d700 1 -- 172.21.15.49:0/2389614097 learned_addr learned my addr 172.21.15.49:0/2389614097 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:29.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.729+0000 7efc5d48e700 1 -- 172.21.15.49:0/2389614097 >> v1:172.21.15.115:6789/0 conn(0x7efc580c6190 legacy=0x7efc58158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:29.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.729+0000 7efc577fe700 1 -- 172.21.15.49:0/2389614097 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3758058043 0 0) 0x7efc580c72d0 con 0x7efc58098d10 2023-11-30T17:07:29.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.729+0000 7efc5d48e700 1 -- 172.21.15.49:0/2389614097 >> v1:172.21.15.49:6789/0 conn(0x7efc58098d10 legacy=0x7efc58063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:29.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.729+0000 7efc5d48e700 1 -- 172.21.15.49:0/2389614097 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc580c66c0 con 0x7efc58158a30 2023-11-30T17:07:29.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.729+0000 7efc5d48e700 1 --2- 172.21.15.49:0/2389614097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc58158a30 0x7efc580c7760 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7efc40009760 tx=0x7efc40009060).ready entity=mon.0 client_cookie=1884bc068296082e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:29.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.729+0000 7efc577fe700 1 -- 172.21.15.49:0/2389614097 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4000b520 con 0x7efc58158a30 2023-11-30T17:07:29.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.729+0000 7efc577fe700 1 -- 172.21.15.49:0/2389614097 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4000b680 con 0x7efc58158a30 2023-11-30T17:07:29.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.729+0000 7efc577fe700 1 -- 172.21.15.49:0/2389614097 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4000ba00 con 0x7efc58158a30 2023-11-30T17:07:29.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.729+0000 7efc5eef1700 1 -- 172.21.15.49:0/2389614097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc58158a30 msgr2=0x7efc580c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:29.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.729+0000 7efc5eef1700 1 --2- 172.21.15.49:0/2389614097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc58158a30 0x7efc580c7760 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7efc40009760 tx=0x7efc40009060).stop 2023-11-30T17:07:29.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.730+0000 7efc5eef1700 1 -- 172.21.15.49:0/2389614097 shutdown_connections 2023-11-30T17:07:29.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.730+0000 7efc5eef1700 1 --2- 172.21.15.49:0/2389614097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc58158a30 0x7efc580c7760 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:29.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.730+0000 7efc5eef1700 1 -- 172.21.15.49:0/2389614097 >> 172.21.15.49:0/2389614097 conn(0x7efc580cb310 msgr2=0x7efc580cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:29.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.730+0000 7efc5eef1700 1 -- 172.21.15.49:0/2389614097 shutdown_connections 2023-11-30T17:07:29.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.730+0000 7efc5eef1700 1 -- 172.21.15.49:0/2389614097 wait complete. 2023-11-30T17:07:29.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.731+0000 7efc5eef1700 1 Processor -- start 2023-11-30T17:07:29.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.731+0000 7efc5eef1700 1 -- start start 2023-11-30T17:07:29.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.732+0000 7efc5eef1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc58098d10 0x7efc580ab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:29.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.732+0000 7efc5eef1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc580c6190 0x7efc58144f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:29.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.732+0000 7efc5eef1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc58158a30 0x7efc580c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:29.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.732+0000 7efc5eef1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc580abd60 con 0x7efc58098d10 2023-11-30T17:07:29.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.732+0000 7efc5eef1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc580af1b0 con 0x7efc580c6190 2023-11-30T17:07:29.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.732+0000 7efc5eef1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc580ae2c0 con 0x7efc58158a30 2023-11-30T17:07:29.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.732+0000 7efc5cc8d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc58098d10 0x7efc580ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:29.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.732+0000 7efc5cc8d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc58098d10 0x7efc580ab870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59552/0 (socket says 172.21.15.49:59552) 2023-11-30T17:07:29.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.732+0000 7efc5cc8d700 1 -- 172.21.15.49:0/899070698 learned_addr learned my addr 172.21.15.49:0/899070698 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:29.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.732+0000 7efc57fff700 1 --2- 172.21.15.49:0/899070698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc580c6190 0x7efc58144f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:29.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.732+0000 7efc5d48e700 1 --2- 172.21.15.49:0/899070698 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc58158a30 0x7efc580c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:29.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.732+0000 7efc5cc8d700 1 -- 172.21.15.49:0/899070698 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc58158a30 msgr2=0x7efc580c45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:29.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.732+0000 7efc5cc8d700 1 --2- 172.21.15.49:0/899070698 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc58158a30 0x7efc580c45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:29.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.732+0000 7efc5cc8d700 1 -- 172.21.15.49:0/899070698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc580c6190 msgr2=0x7efc58144f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:29.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.732+0000 7efc5cc8d700 1 --2- 172.21.15.49:0/899070698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc580c6190 0x7efc58144f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:29.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.732+0000 7efc5cc8d700 1 -- 172.21.15.49:0/899070698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc400092a0 con 0x7efc58098d10 2023-11-30T17:07:29.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.732+0000 7efc57fff700 1 --2- 172.21.15.49:0/899070698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc580c6190 0x7efc58144f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:29.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.732+0000 7efc5cc8d700 1 --2- 172.21.15.49:0/899070698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc58098d10 0x7efc580ab870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7efc5000c4e0 tx=0x7efc50007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:29.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.732+0000 7efc54ff9700 1 -- 172.21.15.49:0/899070698 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc500072e0 con 0x7efc58098d10 2023-11-30T17:07:29.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.732+0000 7efc54ff9700 1 -- 172.21.15.49:0/899070698 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc50007440 con 0x7efc58098d10 2023-11-30T17:07:29.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.732+0000 7efc5eef1700 1 -- 172.21.15.49:0/899070698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc580ae5a0 con 0x7efc58098d10 2023-11-30T17:07:29.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.732+0000 7efc54ff9700 1 -- 172.21.15.49:0/899070698 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc500057a0 con 0x7efc58098d10 2023-11-30T17:07:29.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.732+0000 7efc5eef1700 1 -- 172.21.15.49:0/899070698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc580aeb60 con 0x7efc58098d10 2023-11-30T17:07:29.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.734+0000 7efc5eef1700 1 -- 172.21.15.49:0/899070698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc5806c860 con 0x7efc58098d10 2023-11-30T17:07:29.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.734+0000 7efc54ff9700 1 -- 172.21.15.49:0/899070698 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7efc50005b90 con 0x7efc58098d10 2023-11-30T17:07:29.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.734+0000 7efc54ff9700 1 --2- 172.21.15.49:0/899070698 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc3805f120 0x7efc380615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:29.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.734+0000 7efc54ff9700 1 -- 172.21.15.49:0/899070698 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7efc50079c00 con 0x7efc58098d10 2023-11-30T17:07:29.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.734+0000 7efc57fff700 1 --2- 172.21.15.49:0/899070698 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc3805f120 0x7efc380615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:29.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.735+0000 7efc57fff700 1 --2- 172.21.15.49:0/899070698 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc3805f120 0x7efc380615e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7efc48007fd0 tx=0x7efc48009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:29.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.738+0000 7efc54ff9700 1 -- 172.21.15.49:0/899070698 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efc50080080 con 0x7efc58098d10 2023-11-30T17:07:29.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.912+0000 7efc5eef1700 1 -- 172.21.15.49:0/899070698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7efc580c69a0 con 0x7efc58098d10 2023-11-30T17:07:29.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.912+0000 7efc54ff9700 1 -- 172.21.15.49:0/899070698 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efc50018030 con 0x7efc58098d10 2023-11-30T17:07:29.915 INFO:teuthology.orchestra.run.smithi049.stdout:55834574854 2023-11-30T17:07:29.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.914+0000 7efc5eef1700 1 -- 172.21.15.49:0/899070698 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc3805f120 msgr2=0x7efc380615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:29.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.914+0000 7efc5eef1700 1 --2- 172.21.15.49:0/899070698 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc3805f120 0x7efc380615e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7efc48007fd0 tx=0x7efc48009040).stop 2023-11-30T17:07:29.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.914+0000 7efc5eef1700 1 -- 172.21.15.49:0/899070698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc58098d10 msgr2=0x7efc580ab870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:29.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.914+0000 7efc5eef1700 1 --2- 172.21.15.49:0/899070698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc58098d10 0x7efc580ab870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7efc5000c4e0 tx=0x7efc50007c70).stop 2023-11-30T17:07:29.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.914+0000 7efc5eef1700 1 -- 172.21.15.49:0/899070698 shutdown_connections 2023-11-30T17:07:29.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.914+0000 7efc5eef1700 1 --2- 172.21.15.49:0/899070698 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc58158a30 0x7efc580c45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:29.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.914+0000 7efc5eef1700 1 --2- 172.21.15.49:0/899070698 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc3805f120 0x7efc380615e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:29.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.914+0000 7efc5eef1700 1 --2- 172.21.15.49:0/899070698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc58098d10 0x7efc580ab870 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:29.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.914+0000 7efc5eef1700 1 --2- 172.21.15.49:0/899070698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc580c6190 0x7efc58144f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:29.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.914+0000 7efc5eef1700 1 -- 172.21.15.49:0/899070698 >> 172.21.15.49:0/899070698 conn(0x7efc580cb310 msgr2=0x7efc58153d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:29.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.914+0000 7efc5eef1700 1 -- 172.21.15.49:0/899070698 shutdown_connections 2023-11-30T17:07:29.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:29.914+0000 7efc5eef1700 1 -- 172.21.15.49:0/899070698 wait complete. 2023-11-30T17:07:29.928 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-11-30T17:07:29.929 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-30T17:07:29.929 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:07:30.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.044+0000 7f12d59a9700 1 Processor -- start 2023-11-30T17:07:30.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.044+0000 7f12d59a9700 1 -- start start 2023-11-30T17:07:30.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.045+0000 7f12d59a9700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f12d00c0180 0x7f12d0157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:30.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.045+0000 7f12d59a9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12d00c1750 0x7f12d00c1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:30.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.045+0000 7f12d59a9700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d00c12c0 con 0x7f12d0157660 2023-11-30T17:07:30.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.045+0000 7f12d59a9700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12d00c06b0 con 0x7f12d00c0180 2023-11-30T17:07:30.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.045+0000 7f12d59a9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d00c0990 con 0x7f12d00c1750 2023-11-30T17:07:30.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.045+0000 7f12d49a7700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f12d0157660 0x7f12d01589c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34948/0 (socket says 172.21.15.49:34948) 2023-11-30T17:07:30.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.045+0000 7f12d49a7700 1 -- 172.21.15.49:0/1919133987 learned_addr learned my addr 172.21.15.49:0/1919133987 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:30.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.045+0000 7f12cffff700 1 --2- 172.21.15.49:0/1919133987 >> v2:172.21.15.115:3300/0 conn(0x7f12d00c0180 0x7f12d0157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:30.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.045+0000 7f12d51a8700 1 --2- 172.21.15.49:0/1919133987 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12d00c1750 0x7f12d00c1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:30.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.045+0000 7f12cf7fe700 1 -- 172.21.15.49:0/1919133987 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 165529475 0 0) 0x7f12d00c12c0 con 0x7f12d0157660 2023-11-30T17:07:30.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.045+0000 7f12cf7fe700 1 -- 172.21.15.49:0/1919133987 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12c00033f0 con 0x7f12d0157660 2023-11-30T17:07:30.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.045+0000 7f12cffff700 1 -- 172.21.15.49:0/1919133987 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12d00c1750 msgr2=0x7f12d00c1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:30.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.045+0000 7f12cffff700 1 --2- 172.21.15.49:0/1919133987 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12d00c1750 0x7f12d00c1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:30.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.045+0000 7f12cffff700 1 -- 172.21.15.49:0/1919133987 >> v1:172.21.15.49:6789/0 conn(0x7f12d0157660 legacy=0x7f12d01589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:30.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.045+0000 7f12cffff700 1 -- 172.21.15.49:0/1919133987 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d00c0c70 con 0x7f12d00c0180 2023-11-30T17:07:30.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.046+0000 7f12cffff700 1 --2- 172.21.15.49:0/1919133987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12d00c0180 0x7f12d0157a40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f12bc009760 tx=0x7f12bc009060).ready entity=mon.1 client_cookie=d24e70096e04a775 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:30.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.046+0000 7f12cf7fe700 1 -- 172.21.15.49:0/1919133987 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc00d4a0 con 0x7f12d00c0180 2023-11-30T17:07:30.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.046+0000 7f12cf7fe700 1 -- 172.21.15.49:0/1919133987 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12bc00d600 con 0x7f12d00c0180 2023-11-30T17:07:30.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.046+0000 7f12cf7fe700 1 -- 172.21.15.49:0/1919133987 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc00d980 con 0x7f12d00c0180 2023-11-30T17:07:30.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.046+0000 7f12d59a9700 1 -- 172.21.15.49:0/1919133987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12d00c0180 msgr2=0x7f12d0157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:30.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.046+0000 7f12d59a9700 1 --2- 172.21.15.49:0/1919133987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12d00c0180 0x7f12d0157a40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f12bc009760 tx=0x7f12bc009060).stop 2023-11-30T17:07:30.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.046+0000 7f12d59a9700 1 -- 172.21.15.49:0/1919133987 shutdown_connections 2023-11-30T17:07:30.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.046+0000 7f12d59a9700 1 --2- 172.21.15.49:0/1919133987 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12d00c1750 0x7f12d00c1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:30.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.046+0000 7f12d59a9700 1 --2- 172.21.15.49:0/1919133987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12d00c0180 0x7f12d0157a40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:30.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.046+0000 7f12d59a9700 1 -- 172.21.15.49:0/1919133987 >> 172.21.15.49:0/1919133987 conn(0x7f12d00cb000 msgr2=0x7f12d00cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:30.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.046+0000 7f12d59a9700 1 -- 172.21.15.49:0/1919133987 shutdown_connections 2023-11-30T17:07:30.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.046+0000 7f12d59a9700 1 -- 172.21.15.49:0/1919133987 wait complete. 2023-11-30T17:07:30.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.047+0000 7f12d59a9700 1 Processor -- start 2023-11-30T17:07:30.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.048+0000 7f12d59a9700 1 -- start start 2023-11-30T17:07:30.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.048+0000 7f12d59a9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12d00c0180 0x7f12d01519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:30.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.048+0000 7f12d59a9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12d00c1750 0x7f12d01641d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:30.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.048+0000 7f12d59a9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12d0157660 0x7f12d01646c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:30.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.048+0000 7f12d59a9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d00c1bc0 con 0x7f12d0157660 2023-11-30T17:07:30.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.048+0000 7f12d59a9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d0156a80 con 0x7f12d00c0180 2023-11-30T17:07:30.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.048+0000 7f12d59a9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d0164d00 con 0x7f12d00c1750 2023-11-30T17:07:30.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.048+0000 7f12d51a8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12d0157660 0x7f12d01646c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:30.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.049+0000 7f12d51a8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12d0157660 0x7f12d01646c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59556/0 (socket says 172.21.15.49:59556) 2023-11-30T17:07:30.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.049+0000 7f12d51a8700 1 -- 172.21.15.49:0/3923384749 learned_addr learned my addr 172.21.15.49:0/3923384749 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:30.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.049+0000 7f12d49a7700 1 --2- 172.21.15.49:0/3923384749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12d00c0180 0x7f12d01519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:30.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.049+0000 7f12cffff700 1 --2- 172.21.15.49:0/3923384749 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12d00c1750 0x7f12d01641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:30.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.049+0000 7f12d51a8700 1 -- 172.21.15.49:0/3923384749 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12d00c1750 msgr2=0x7f12d01641d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:30.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.049+0000 7f12d51a8700 1 --2- 172.21.15.49:0/3923384749 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12d00c1750 0x7f12d01641d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:30.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.049+0000 7f12d51a8700 1 -- 172.21.15.49:0/3923384749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12d00c0180 msgr2=0x7f12d01519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:30.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.049+0000 7f12d51a8700 1 --2- 172.21.15.49:0/3923384749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12d00c0180 0x7f12d01519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:30.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.049+0000 7f12d51a8700 1 -- 172.21.15.49:0/3923384749 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12bc0092a0 con 0x7f12d0157660 2023-11-30T17:07:30.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.049+0000 7f12d51a8700 1 --2- 172.21.15.49:0/3923384749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12d0157660 0x7f12d01646c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f12c8009e90 tx=0x7f12c800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:30.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.049+0000 7f12ccff9700 1 -- 172.21.15.49:0/3923384749 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c800cc20 con 0x7f12d0157660 2023-11-30T17:07:30.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.049+0000 7f12ccff9700 1 -- 172.21.15.49:0/3923384749 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c800f040 con 0x7f12d0157660 2023-11-30T17:07:30.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.049+0000 7f12ccff9700 1 -- 172.21.15.49:0/3923384749 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c8013400 con 0x7f12d0157660 2023-11-30T17:07:30.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.049+0000 7f12d59a9700 1 -- 172.21.15.49:0/3923384749 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d0164fe0 con 0x7f12d0157660 2023-11-30T17:07:30.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.049+0000 7f12d59a9700 1 -- 172.21.15.49:0/3923384749 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d00c20f0 con 0x7f12d0157660 2023-11-30T17:07:30.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.050+0000 7f12d59a9700 1 -- 172.21.15.49:0/3923384749 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d006c7c0 con 0x7f12d0157660 2023-11-30T17:07:30.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.050+0000 7f12ccff9700 1 -- 172.21.15.49:0/3923384749 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f12c80137b0 con 0x7f12d0157660 2023-11-30T17:07:30.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.051+0000 7f12ccff9700 1 --2- 172.21.15.49:0/3923384749 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f12b405f150 0x7f12b4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:30.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.051+0000 7f12ccff9700 1 -- 172.21.15.49:0/3923384749 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f12c807aa70 con 0x7f12d0157660 2023-11-30T17:07:30.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.051+0000 7f12d49a7700 1 --2- 172.21.15.49:0/3923384749 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f12b405f150 0x7f12b4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:30.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.051+0000 7f12d49a7700 1 --2- 172.21.15.49:0/3923384749 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f12b405f150 0x7f12b4061610 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f12c4005750 tx=0x7f12c4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:30.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.055+0000 7f12ccff9700 1 -- 172.21.15.49:0/3923384749 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f12c804bd40 con 0x7f12d0157660 2023-11-30T17:07:30.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.222+0000 7f12d59a9700 1 -- 172.21.15.49:0/3923384749 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f12d00c22e0 con 0x7f12b405f150 2023-11-30T17:07:30.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.232+0000 7f12ccff9700 1 -- 172.21.15.49:0/3923384749 <== mgr.4105 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336354 (secure 0 0 0) 0x7f12d00c22e0 con 0x7f12b405f150 2023-11-30T17:07:30.238 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:30.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.235+0000 7f12d59a9700 1 -- 172.21.15.49:0/3923384749 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f12b405f150 msgr2=0x7f12b4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:30.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.235+0000 7f12d59a9700 1 --2- 172.21.15.49:0/3923384749 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f12b405f150 0x7f12b4061610 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f12c4005750 tx=0x7f12c4009040).stop 2023-11-30T17:07:30.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.235+0000 7f12d59a9700 1 -- 172.21.15.49:0/3923384749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12d0157660 msgr2=0x7f12d01646c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:30.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.235+0000 7f12d59a9700 1 --2- 172.21.15.49:0/3923384749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12d0157660 0x7f12d01646c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f12c8009e90 tx=0x7f12c800b040).stop 2023-11-30T17:07:30.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.235+0000 7f12d59a9700 1 -- 172.21.15.49:0/3923384749 shutdown_connections 2023-11-30T17:07:30.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.235+0000 7f12d59a9700 1 --2- 172.21.15.49:0/3923384749 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f12b405f150 0x7f12b4061610 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:30.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.235+0000 7f12d59a9700 1 --2- 172.21.15.49:0/3923384749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12d0157660 0x7f12d01646c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:30.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.235+0000 7f12d59a9700 1 --2- 172.21.15.49:0/3923384749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12d00c0180 0x7f12d01519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:30.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.235+0000 7f12d59a9700 1 --2- 172.21.15.49:0/3923384749 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12d00c1750 0x7f12d01641d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:30.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.235+0000 7f12d59a9700 1 -- 172.21.15.49:0/3923384749 >> 172.21.15.49:0/3923384749 conn(0x7f12d00cb000 msgr2=0x7f12d00aae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:30.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.235+0000 7f12d59a9700 1 -- 172.21.15.49:0/3923384749 shutdown_connections 2023-11-30T17:07:30.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.235+0000 7f12d59a9700 1 -- 172.21.15.49:0/3923384749 wait complete. 2023-11-30T17:07:30.242 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:07:30.250 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-30T17:07:28.840963+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378624,"kb_used_data":1856,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596096,"statfs":{"total":773094113280,"available":770658402304,"internally_reserved":0,"allocated":1900544,"data_stored":687340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002453"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307566+0000","last_change":"2023-11-30T17:07:16.305288+0000","last_active":"2023-11-30T17:07:16.307566+0000","last_peered":"2023-11-30T17:07:16.307566+0000","last_clean":"2023-11-30T17:07:16.307566+0000","last_became_active":"2023-11-30T17:07:16.305010+0000","last_became_peered":"2023-11-30T17:07:16.305010+0000","last_unstale":"2023-11-30T17:07:16.307566+0000","last_undegraded":"2023-11-30T17:07:16.307566+0000","last_fullsized":"2023-11-30T17:07:16.307566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295268+0000","last_change":"2023-11-30T17:07:15.910158+0000","last_active":"2023-11-30T17:07:16.295268+0000","last_peered":"2023-11-30T17:07:16.295268+0000","last_clean":"2023-11-30T17:07:16.295268+0000","last_became_active":"2023-11-30T17:07:15.909808+0000","last_became_peered":"2023-11-30T17:07:15.909808+0000","last_unstale":"2023-11-30T17:07:16.295268+0000","last_undegraded":"2023-11-30T17:07:16.295268+0000","last_fullsized":"2023-11-30T17:07:16.295268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.309132+0000","last_change":"2023-11-30T17:07:16.303941+0000","last_active":"2023-11-30T17:07:16.309132+0000","last_peered":"2023-11-30T17:07:16.309132+0000","last_clean":"2023-11-30T17:07:16.309132+0000","last_became_active":"2023-11-30T17:07:16.303673+0000","last_became_peered":"2023-11-30T17:07:16.303673+0000","last_unstale":"2023-11-30T17:07:16.309132+0000","last_undegraded":"2023-11-30T17:07:16.309132+0000","last_fullsized":"2023-11-30T17:07:16.309132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.285551+0000","last_change":"2023-11-30T17:07:15.914251+0000","last_active":"2023-11-30T17:07:16.285551+0000","last_peered":"2023-11-30T17:07:16.285551+0000","last_clean":"2023-11-30T17:07:16.285551+0000","last_became_active":"2023-11-30T17:07:15.913954+0000","last_became_peered":"2023-11-30T17:07:15.913954+0000","last_unstale":"2023-11-30T17:07:16.285551+0000","last_undegraded":"2023-11-30T17:07:16.285551+0000","last_fullsized":"2023-11-30T17:07:16.285551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318395+0000","last_change":"2023-11-30T17:07:16.314266+0000","last_active":"2023-11-30T17:07:16.318395+0000","last_peered":"2023-11-30T17:07:16.318395+0000","last_clean":"2023-11-30T17:07:16.318395+0000","last_became_active":"2023-11-30T17:07:16.313990+0000","last_became_peered":"2023-11-30T17:07:16.313990+0000","last_unstale":"2023-11-30T17:07:16.318395+0000","last_undegraded":"2023-11-30T17:07:16.318395+0000","last_fullsized":"2023-11-30T17:07:16.318395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.294345+0000","last_change":"2023-11-30T17:07:15.911004+0000","last_active":"2023-11-30T17:07:16.294345+0000","last_peered":"2023-11-30T17:07:16.294345+0000","last_clean":"2023-11-30T17:07:16.294345+0000","last_became_active":"2023-11-30T17:07:15.910698+0000","last_became_peered":"2023-11-30T17:07:15.910698+0000","last_unstale":"2023-11-30T17:07:16.294345+0000","last_undegraded":"2023-11-30T17:07:16.294345+0000","last_fullsized":"2023-11-30T17:07:16.294345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.306911+0000","last_change":"2023-11-30T17:07:16.304718+0000","last_active":"2023-11-30T17:07:16.306911+0000","last_peered":"2023-11-30T17:07:16.306911+0000","last_clean":"2023-11-30T17:07:16.306911+0000","last_became_active":"2023-11-30T17:07:16.304311+0000","last_became_peered":"2023-11-30T17:07:16.304311+0000","last_unstale":"2023-11-30T17:07:16.306911+0000","last_undegraded":"2023-11-30T17:07:16.306911+0000","last_fullsized":"2023-11-30T17:07:16.306911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.289689+0000","last_change":"2023-11-30T17:07:15.905295+0000","last_active":"2023-11-30T17:07:16.289689+0000","last_peered":"2023-11-30T17:07:16.289689+0000","last_clean":"2023-11-30T17:07:16.289689+0000","last_became_active":"2023-11-30T17:07:15.904998+0000","last_became_peered":"2023-11-30T17:07:15.904998+0000","last_unstale":"2023-11-30T17:07:16.289689+0000","last_undegraded":"2023-11-30T17:07:16.289689+0000","last_fullsized":"2023-11-30T17:07:16.289689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308850+0000","last_change":"2023-11-30T17:07:16.307461+0000","last_active":"2023-11-30T17:07:16.308850+0000","last_peered":"2023-11-30T17:07:16.308850+0000","last_clean":"2023-11-30T17:07:16.308850+0000","last_became_active":"2023-11-30T17:07:16.307178+0000","last_became_peered":"2023-11-30T17:07:16.307178+0000","last_unstale":"2023-11-30T17:07:16.308850+0000","last_undegraded":"2023-11-30T17:07:16.308850+0000","last_fullsized":"2023-11-30T17:07:16.308850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.305220+0000","last_change":"2023-11-30T17:07:15.915224+0000","last_active":"2023-11-30T17:07:16.305220+0000","last_peered":"2023-11-30T17:07:16.305220+0000","last_clean":"2023-11-30T17:07:16.305220+0000","last_became_active":"2023-11-30T17:07:15.915001+0000","last_became_peered":"2023-11-30T17:07:15.915001+0000","last_unstale":"2023-11-30T17:07:16.305220+0000","last_undegraded":"2023-11-30T17:07:16.305220+0000","last_fullsized":"2023-11-30T17:07:16.305220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.310566+0000","last_change":"2023-11-30T17:07:16.302009+0000","last_active":"2023-11-30T17:07:16.310566+0000","last_peered":"2023-11-30T17:07:16.310566+0000","last_clean":"2023-11-30T17:07:16.310566+0000","last_became_active":"2023-11-30T17:07:16.301664+0000","last_became_peered":"2023-11-30T17:07:16.301664+0000","last_unstale":"2023-11-30T17:07:16.310566+0000","last_undegraded":"2023-11-30T17:07:16.310566+0000","last_fullsized":"2023-11-30T17:07:16.310566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308378+0000","last_change":"2023-11-30T17:07:15.919005+0000","last_active":"2023-11-30T17:07:16.308378+0000","last_peered":"2023-11-30T17:07:16.308378+0000","last_clean":"2023-11-30T17:07:16.308378+0000","last_became_active":"2023-11-30T17:07:15.918757+0000","last_became_peered":"2023-11-30T17:07:15.918757+0000","last_unstale":"2023-11-30T17:07:16.308378+0000","last_undegraded":"2023-11-30T17:07:16.308378+0000","last_fullsized":"2023-11-30T17:07:16.308378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.305107+0000","last_change":"2023-11-30T17:07:16.303563+0000","last_active":"2023-11-30T17:07:16.305107+0000","last_peered":"2023-11-30T17:07:16.305107+0000","last_clean":"2023-11-30T17:07:16.305107+0000","last_became_active":"2023-11-30T17:07:16.303281+0000","last_became_peered":"2023-11-30T17:07:16.303281+0000","last_unstale":"2023-11-30T17:07:16.305107+0000","last_undegraded":"2023-11-30T17:07:16.305107+0000","last_fullsized":"2023-11-30T17:07:16.305107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.311442+0000","last_change":"2023-11-30T17:07:15.912815+0000","last_active":"2023-11-30T17:07:16.311442+0000","last_peered":"2023-11-30T17:07:16.311442+0000","last_clean":"2023-11-30T17:07:16.311442+0000","last_became_active":"2023-11-30T17:07:15.912519+0000","last_became_peered":"2023-11-30T17:07:15.912519+0000","last_unstale":"2023-11-30T17:07:16.311442+0000","last_undegraded":"2023-11-30T17:07:16.311442+0000","last_fullsized":"2023-11-30T17:07:16.311442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.306264+0000","last_change":"2023-11-30T17:07:16.305070+0000","last_active":"2023-11-30T17:07:16.306264+0000","last_peered":"2023-11-30T17:07:16.306264+0000","last_clean":"2023-11-30T17:07:16.306264+0000","last_became_active":"2023-11-30T17:07:16.304769+0000","last_became_peered":"2023-11-30T17:07:16.304769+0000","last_unstale":"2023-11-30T17:07:16.306264+0000","last_undegraded":"2023-11-30T17:07:16.306264+0000","last_fullsized":"2023-11-30T17:07:16.306264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.305362+0000","last_change":"2023-11-30T17:07:15.911789+0000","last_active":"2023-11-30T17:07:16.305362+0000","last_peered":"2023-11-30T17:07:16.305362+0000","last_clean":"2023-11-30T17:07:16.305362+0000","last_became_active":"2023-11-30T17:07:15.911461+0000","last_became_peered":"2023-11-30T17:07:15.911461+0000","last_unstale":"2023-11-30T17:07:16.305362+0000","last_undegraded":"2023-11-30T17:07:16.305362+0000","last_fullsized":"2023-11-30T17:07:16.305362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.320053+0000","last_change":"2023-11-30T17:07:16.316309+0000","last_active":"2023-11-30T17:07:16.320053+0000","last_peered":"2023-11-30T17:07:16.320053+0000","last_clean":"2023-11-30T17:07:16.320053+0000","last_became_active":"2023-11-30T17:07:16.316010+0000","last_became_peered":"2023-11-30T17:07:16.316010+0000","last_unstale":"2023-11-30T17:07:16.320053+0000","last_undegraded":"2023-11-30T17:07:16.320053+0000","last_fullsized":"2023-11-30T17:07:16.320053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.288892+0000","last_change":"2023-11-30T17:07:15.914178+0000","last_active":"2023-11-30T17:07:16.288892+0000","last_peered":"2023-11-30T17:07:16.288892+0000","last_clean":"2023-11-30T17:07:16.288892+0000","last_became_active":"2023-11-30T17:07:15.913297+0000","last_became_peered":"2023-11-30T17:07:15.913297+0000","last_unstale":"2023-11-30T17:07:16.288892+0000","last_undegraded":"2023-11-30T17:07:16.288892+0000","last_fullsized":"2023-11-30T17:07:16.288892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.304041+0000","last_change":"2023-11-30T17:07:16.300572+0000","last_active":"2023-11-30T17:07:16.304041+0000","last_peered":"2023-11-30T17:07:16.304041+0000","last_clean":"2023-11-30T17:07:16.304041+0000","last_became_active":"2023-11-30T17:07:16.300298+0000","last_became_peered":"2023-11-30T17:07:16.300298+0000","last_unstale":"2023-11-30T17:07:16.304041+0000","last_undegraded":"2023-11-30T17:07:16.304041+0000","last_fullsized":"2023-11-30T17:07:16.304041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295495+0000","last_change":"2023-11-30T17:07:15.915272+0000","last_active":"2023-11-30T17:07:16.295495+0000","last_peered":"2023-11-30T17:07:16.295495+0000","last_clean":"2023-11-30T17:07:16.295495+0000","last_became_active":"2023-11-30T17:07:15.914832+0000","last_became_peered":"2023-11-30T17:07:15.914832+0000","last_unstale":"2023-11-30T17:07:16.295495+0000","last_undegraded":"2023-11-30T17:07:16.295495+0000","last_fullsized":"2023-11-30T17:07:16.295495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.313799+0000","last_change":"2023-11-30T17:07:16.311093+0000","last_active":"2023-11-30T17:07:16.313799+0000","last_peered":"2023-11-30T17:07:16.313799+0000","last_clean":"2023-11-30T17:07:16.313799+0000","last_became_active":"2023-11-30T17:07:16.310618+0000","last_became_peered":"2023-11-30T17:07:16.310618+0000","last_unstale":"2023-11-30T17:07:16.313799+0000","last_undegraded":"2023-11-30T17:07:16.313799+0000","last_fullsized":"2023-11-30T17:07:16.313799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.310314+0000","last_change":"2023-11-30T17:07:15.910300+0000","last_active":"2023-11-30T17:07:16.310314+0000","last_peered":"2023-11-30T17:07:16.310314+0000","last_clean":"2023-11-30T17:07:16.310314+0000","last_became_active":"2023-11-30T17:07:15.909476+0000","last_became_peered":"2023-11-30T17:07:15.909476+0000","last_unstale":"2023-11-30T17:07:16.310314+0000","last_undegraded":"2023-11-30T17:07:16.310314+0000","last_fullsized":"2023-11-30T17:07:16.310314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318565+0000","last_change":"2023-11-30T17:07:16.313453+0000","last_active":"2023-11-30T17:07:16.318565+0000","last_peered":"2023-11-30T17:07:16.318565+0000","last_clean":"2023-11-30T17:07:16.318565+0000","last_became_active":"2023-11-30T17:07:16.312874+0000","last_became_peered":"2023-11-30T17:07:16.312874+0000","last_unstale":"2023-11-30T17:07:16.318565+0000","last_undegraded":"2023-11-30T17:07:16.318565+0000","last_fullsized":"2023-11-30T17:07:16.318565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307366+0000","last_change":"2023-11-30T17:07:15.911874+0000","last_active":"2023-11-30T17:07:16.307366+0000","last_peered":"2023-11-30T17:07:16.307366+0000","last_clean":"2023-11-30T17:07:16.307366+0000","last_became_active":"2023-11-30T17:07:15.911404+0000","last_became_peered":"2023-11-30T17:07:15.911404+0000","last_unstale":"2023-11-30T17:07:16.307366+0000","last_undegraded":"2023-11-30T17:07:16.307366+0000","last_fullsized":"2023-11-30T17:07:16.307366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315251+0000","last_change":"2023-11-30T17:07:16.312859+0000","last_active":"2023-11-30T17:07:16.315251+0000","last_peered":"2023-11-30T17:07:16.315251+0000","last_clean":"2023-11-30T17:07:16.315251+0000","last_became_active":"2023-11-30T17:07:16.312514+0000","last_became_peered":"2023-11-30T17:07:16.312514+0000","last_unstale":"2023-11-30T17:07:16.315251+0000","last_undegraded":"2023-11-30T17:07:16.315251+0000","last_fullsized":"2023-11-30T17:07:16.315251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308003+0000","last_change":"2023-11-30T17:07:15.912336+0000","last_active":"2023-11-30T17:07:16.308003+0000","last_peered":"2023-11-30T17:07:16.308003+0000","last_clean":"2023-11-30T17:07:16.308003+0000","last_became_active":"2023-11-30T17:07:15.912069+0000","last_became_peered":"2023-11-30T17:07:15.912069+0000","last_unstale":"2023-11-30T17:07:16.308003+0000","last_undegraded":"2023-11-30T17:07:16.308003+0000","last_fullsized":"2023-11-30T17:07:16.308003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.305757+0000","last_change":"2023-11-30T17:07:16.300210+0000","last_active":"2023-11-30T17:07:16.305757+0000","last_peered":"2023-11-30T17:07:16.305757+0000","last_clean":"2023-11-30T17:07:16.305757+0000","last_became_active":"2023-11-30T17:07:16.298899+0000","last_became_peered":"2023-11-30T17:07:16.298899+0000","last_unstale":"2023-11-30T17:07:16.305757+0000","last_undegraded":"2023-11-30T17:07:16.305757+0000","last_fullsized":"2023-11-30T17:07:16.305757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295980+0000","last_change":"2023-11-30T17:07:15.917879+0000","last_active":"2023-11-30T17:07:16.295980+0000","last_peered":"2023-11-30T17:07:16.295980+0000","last_clean":"2023-11-30T17:07:16.295980+0000","last_became_active":"2023-11-30T17:07:15.917554+0000","last_became_peered":"2023-11-30T17:07:15.917554+0000","last_unstale":"2023-11-30T17:07:16.295980+0000","last_undegraded":"2023-11-30T17:07:16.295980+0000","last_fullsized":"2023-11-30T17:07:16.295980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307516+0000","last_change":"2023-11-30T17:07:16.303927+0000","last_active":"2023-11-30T17:07:16.307516+0000","last_peered":"2023-11-30T17:07:16.307516+0000","last_clean":"2023-11-30T17:07:16.307516+0000","last_became_active":"2023-11-30T17:07:16.303463+0000","last_became_peered":"2023-11-30T17:07:16.303463+0000","last_unstale":"2023-11-30T17:07:16.307516+0000","last_undegraded":"2023-11-30T17:07:16.307516+0000","last_fullsized":"2023-11-30T17:07:16.307516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.303300+0000","last_change":"2023-11-30T17:07:15.913512+0000","last_active":"2023-11-30T17:07:16.303300+0000","last_peered":"2023-11-30T17:07:16.303300+0000","last_clean":"2023-11-30T17:07:16.303300+0000","last_became_active":"2023-11-30T17:07:15.913268+0000","last_became_peered":"2023-11-30T17:07:15.913268+0000","last_unstale":"2023-11-30T17:07:16.303300+0000","last_undegraded":"2023-11-30T17:07:16.303300+0000","last_fullsized":"2023-11-30T17:07:16.303300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312201+0000","last_change":"2023-11-30T17:07:16.308161+0000","last_active":"2023-11-30T17:07:16.312201+0000","last_peered":"2023-11-30T17:07:16.312201+0000","last_clean":"2023-11-30T17:07:16.312201+0000","last_became_active":"2023-11-30T17:07:16.307884+0000","last_became_peered":"2023-11-30T17:07:16.307884+0000","last_unstale":"2023-11-30T17:07:16.312201+0000","last_undegraded":"2023-11-30T17:07:16.312201+0000","last_fullsized":"2023-11-30T17:07:16.312201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.306036+0000","last_change":"2023-11-30T17:07:15.910523+0000","last_active":"2023-11-30T17:07:16.306036+0000","last_peered":"2023-11-30T17:07:16.306036+0000","last_clean":"2023-11-30T17:07:16.306036+0000","last_became_active":"2023-11-30T17:07:15.910216+0000","last_became_peered":"2023-11-30T17:07:15.910216+0000","last_unstale":"2023-11-30T17:07:16.306036+0000","last_undegraded":"2023-11-30T17:07:16.306036+0000","last_fullsized":"2023-11-30T17:07:16.306036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315009+0000","last_change":"2023-11-30T17:07:16.311819+0000","last_active":"2023-11-30T17:07:16.315009+0000","last_peered":"2023-11-30T17:07:16.315009+0000","last_clean":"2023-11-30T17:07:16.315009+0000","last_became_active":"2023-11-30T17:07:16.311446+0000","last_became_peered":"2023-11-30T17:07:16.311446+0000","last_unstale":"2023-11-30T17:07:16.315009+0000","last_undegraded":"2023-11-30T17:07:16.315009+0000","last_fullsized":"2023-11-30T17:07:16.315009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.290739+0000","last_change":"2023-11-30T17:07:15.903463+0000","last_active":"2023-11-30T17:07:16.290739+0000","last_peered":"2023-11-30T17:07:16.290739+0000","last_clean":"2023-11-30T17:07:16.290739+0000","last_became_active":"2023-11-30T17:07:15.903169+0000","last_became_peered":"2023-11-30T17:07:15.903169+0000","last_unstale":"2023-11-30T17:07:16.290739+0000","last_undegraded":"2023-11-30T17:07:16.290739+0000","last_fullsized":"2023-11-30T17:07:16.290739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.304451+0000","last_change":"2023-11-30T17:07:16.301048+0000","last_active":"2023-11-30T17:07:16.304451+0000","last_peered":"2023-11-30T17:07:16.304451+0000","last_clean":"2023-11-30T17:07:16.304451+0000","last_became_active":"2023-11-30T17:07:16.300733+0000","last_became_peered":"2023-11-30T17:07:16.300733+0000","last_unstale":"2023-11-30T17:07:16.304451+0000","last_undegraded":"2023-11-30T17:07:16.304451+0000","last_fullsized":"2023-11-30T17:07:16.304451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.297265+0000","last_change":"2023-11-30T17:07:15.912479+0000","last_active":"2023-11-30T17:07:16.297265+0000","last_peered":"2023-11-30T17:07:16.297265+0000","last_clean":"2023-11-30T17:07:16.297265+0000","last_became_active":"2023-11-30T17:07:15.911715+0000","last_became_peered":"2023-11-30T17:07:15.911715+0000","last_unstale":"2023-11-30T17:07:16.297265+0000","last_undegraded":"2023-11-30T17:07:16.297265+0000","last_fullsized":"2023-11-30T17:07:16.297265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312756+0000","last_change":"2023-11-30T17:07:16.308823+0000","last_active":"2023-11-30T17:07:16.312756+0000","last_peered":"2023-11-30T17:07:16.312756+0000","last_clean":"2023-11-30T17:07:16.312756+0000","last_became_active":"2023-11-30T17:07:16.308607+0000","last_became_peered":"2023-11-30T17:07:16.308607+0000","last_unstale":"2023-11-30T17:07:16.312756+0000","last_undegraded":"2023-11-30T17:07:16.312756+0000","last_fullsized":"2023-11-30T17:07:16.312756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.294468+0000","last_change":"2023-11-30T17:07:15.907967+0000","last_active":"2023-11-30T17:07:16.294468+0000","last_peered":"2023-11-30T17:07:16.294468+0000","last_clean":"2023-11-30T17:07:16.294468+0000","last_became_active":"2023-11-30T17:07:15.907702+0000","last_became_peered":"2023-11-30T17:07:15.907702+0000","last_unstale":"2023-11-30T17:07:16.294468+0000","last_undegraded":"2023-11-30T17:07:16.294468+0000","last_fullsized":"2023-11-30T17:07:16.294468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.285836+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:07:16.285836+0000","last_peered":"2023-11-30T17:07:16.285836+0000","last_clean":"2023-11-30T17:07:16.285836+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:07:16.285836+0000","last_undegraded":"2023-11-30T17:07:16.285836+0000","last_fullsized":"2023-11-30T17:07:16.285836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307514+0000","last_change":"2023-11-30T17:07:15.918902+0000","last_active":"2023-11-30T17:07:16.307514+0000","last_peered":"2023-11-30T17:07:16.307514+0000","last_clean":"2023-11-30T17:07:16.307514+0000","last_became_active":"2023-11-30T17:07:15.918581+0000","last_became_peered":"2023-11-30T17:07:15.918581+0000","last_unstale":"2023-11-30T17:07:16.307514+0000","last_undegraded":"2023-11-30T17:07:16.307514+0000","last_fullsized":"2023-11-30T17:07:16.307514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315758+0000","last_change":"2023-11-30T17:07:16.314704+0000","last_active":"2023-11-30T17:07:16.315758+0000","last_peered":"2023-11-30T17:07:16.315758+0000","last_clean":"2023-11-30T17:07:16.315758+0000","last_became_active":"2023-11-30T17:07:16.314432+0000","last_became_peered":"2023-11-30T17:07:16.314432+0000","last_unstale":"2023-11-30T17:07:16.315758+0000","last_undegraded":"2023-11-30T17:07:16.315758+0000","last_fullsized":"2023-11-30T17:07:16.315758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308686+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:07:16.308686+0000","last_peered":"2023-11-30T17:07:16.308686+0000","last_clean":"2023-11-30T17:07:16.308686+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:07:16.308686+0000","last_undegraded":"2023-11-30T17:07:16.308686+0000","last_fullsized":"2023-11-30T17:07:16.308686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.294139+0000","last_change":"2023-11-30T17:07:15.911883+0000","last_active":"2023-11-30T17:07:16.294139+0000","last_peered":"2023-11-30T17:07:16.294139+0000","last_clean":"2023-11-30T17:07:16.294139+0000","last_became_active":"2023-11-30T17:07:15.911610+0000","last_became_peered":"2023-11-30T17:07:15.911610+0000","last_unstale":"2023-11-30T17:07:16.294139+0000","last_undegraded":"2023-11-30T17:07:16.294139+0000","last_fullsized":"2023-11-30T17:07:16.294139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312407+0000","last_change":"2023-11-30T17:07:16.303472+0000","last_active":"2023-11-30T17:07:16.312407+0000","last_peered":"2023-11-30T17:07:16.312407+0000","last_clean":"2023-11-30T17:07:16.312407+0000","last_became_active":"2023-11-30T17:07:16.302394+0000","last_became_peered":"2023-11-30T17:07:16.302394+0000","last_unstale":"2023-11-30T17:07:16.312407+0000","last_undegraded":"2023-11-30T17:07:16.312407+0000","last_fullsized":"2023-11-30T17:07:16.312407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315795+0000","last_change":"2023-11-30T17:07:16.314725+0000","last_active":"2023-11-30T17:07:16.315795+0000","last_peered":"2023-11-30T17:07:16.315795+0000","last_clean":"2023-11-30T17:07:16.315795+0000","last_became_active":"2023-11-30T17:07:16.314512+0000","last_became_peered":"2023-11-30T17:07:16.314512+0000","last_unstale":"2023-11-30T17:07:16.315795+0000","last_undegraded":"2023-11-30T17:07:16.315795+0000","last_fullsized":"2023-11-30T17:07:16.315795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.292666+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:07:16.292666+0000","last_peered":"2023-11-30T17:07:16.292666+0000","last_clean":"2023-11-30T17:07:16.292666+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:07:16.292666+0000","last_undegraded":"2023-11-30T17:07:16.292666+0000","last_fullsized":"2023-11-30T17:07:16.292666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.285572+0000","last_change":"2023-11-30T17:07:15.913075+0000","last_active":"2023-11-30T17:07:16.285572+0000","last_peered":"2023-11-30T17:07:16.285572+0000","last_clean":"2023-11-30T17:07:16.285572+0000","last_became_active":"2023-11-30T17:07:15.912781+0000","last_became_peered":"2023-11-30T17:07:15.912781+0000","last_unstale":"2023-11-30T17:07:16.285572+0000","last_undegraded":"2023-11-30T17:07:16.285572+0000","last_fullsized":"2023-11-30T17:07:16.285572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307120+0000","last_change":"2023-11-30T17:07:16.300272+0000","last_active":"2023-11-30T17:07:16.307120+0000","last_peered":"2023-11-30T17:07:16.307120+0000","last_clean":"2023-11-30T17:07:16.307120+0000","last_became_active":"2023-11-30T17:07:16.299930+0000","last_became_peered":"2023-11-30T17:07:16.299930+0000","last_unstale":"2023-11-30T17:07:16.307120+0000","last_undegraded":"2023-11-30T17:07:16.307120+0000","last_fullsized":"2023-11-30T17:07:16.307120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.301634+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:07:16.301634+0000","last_peered":"2023-11-30T17:07:16.301634+0000","last_clean":"2023-11-30T17:07:16.301634+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:07:16.301634+0000","last_undegraded":"2023-11-30T17:07:16.301634+0000","last_fullsized":"2023-11-30T17:07:16.301634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.293696+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:07:16.293696+0000","last_peered":"2023-11-30T17:07:16.293696+0000","last_clean":"2023-11-30T17:07:16.293696+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:07:16.293696+0000","last_undegraded":"2023-11-30T17:07:16.293696+0000","last_fullsized":"2023-11-30T17:07:16.293696+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295020+0000","last_change":"2023-11-30T17:07:15.906109+0000","last_active":"2023-11-30T17:07:16.295020+0000","last_peered":"2023-11-30T17:07:16.295020+0000","last_clean":"2023-11-30T17:07:16.295020+0000","last_became_active":"2023-11-30T17:07:15.905789+0000","last_became_peered":"2023-11-30T17:07:15.905789+0000","last_unstale":"2023-11-30T17:07:16.295020+0000","last_undegraded":"2023-11-30T17:07:16.295020+0000","last_fullsized":"2023-11-30T17:07:16.295020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.304020+0000","last_change":"2023-11-30T17:07:16.296058+0000","last_active":"2023-11-30T17:07:16.304020+0000","last_peered":"2023-11-30T17:07:16.304020+0000","last_clean":"2023-11-30T17:07:16.304020+0000","last_became_active":"2023-11-30T17:07:16.295800+0000","last_became_peered":"2023-11-30T17:07:16.295800+0000","last_unstale":"2023-11-30T17:07:16.304020+0000","last_undegraded":"2023-11-30T17:07:16.304020+0000","last_fullsized":"2023-11-30T17:07:16.304020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.294447+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:07:16.294447+0000","last_peered":"2023-11-30T17:07:16.294447+0000","last_clean":"2023-11-30T17:07:16.294447+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:07:16.294447+0000","last_undegraded":"2023-11-30T17:07:16.294447+0000","last_fullsized":"2023-11-30T17:07:16.294447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.289819+0000","last_change":"2023-11-30T17:07:15.908114+0000","last_active":"2023-11-30T17:07:16.289819+0000","last_peered":"2023-11-30T17:07:16.289819+0000","last_clean":"2023-11-30T17:07:16.289819+0000","last_became_active":"2023-11-30T17:07:15.907787+0000","last_became_peered":"2023-11-30T17:07:15.907787+0000","last_unstale":"2023-11-30T17:07:16.289819+0000","last_undegraded":"2023-11-30T17:07:16.289819+0000","last_fullsized":"2023-11-30T17:07:16.289819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295873+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:07:16.295873+0000","last_peered":"2023-11-30T17:07:16.295873+0000","last_clean":"2023-11-30T17:07:16.295873+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:07:16.295873+0000","last_undegraded":"2023-11-30T17:07:16.295873+0000","last_fullsized":"2023-11-30T17:07:16.295873+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.285991+0000","last_change":"2023-11-30T17:07:15.912233+0000","last_active":"2023-11-30T17:07:16.285991+0000","last_peered":"2023-11-30T17:07:16.285991+0000","last_clean":"2023-11-30T17:07:16.285991+0000","last_became_active":"2023-11-30T17:07:15.911944+0000","last_became_peered":"2023-11-30T17:07:15.911944+0000","last_unstale":"2023-11-30T17:07:16.285991+0000","last_undegraded":"2023-11-30T17:07:16.285991+0000","last_fullsized":"2023-11-30T17:07:16.285991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315990+0000","last_change":"2023-11-30T17:07:16.314967+0000","last_active":"2023-11-30T17:07:16.315990+0000","last_peered":"2023-11-30T17:07:16.315990+0000","last_clean":"2023-11-30T17:07:16.315990+0000","last_became_active":"2023-11-30T17:07:16.313860+0000","last_became_peered":"2023-11-30T17:07:16.313860+0000","last_unstale":"2023-11-30T17:07:16.315990+0000","last_undegraded":"2023-11-30T17:07:16.315990+0000","last_fullsized":"2023-11-30T17:07:16.315990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.311367+0000","last_change":"2023-11-30T17:07:15.918489+0000","last_active":"2023-11-30T17:07:16.311367+0000","last_peered":"2023-11-30T17:07:16.311367+0000","last_clean":"2023-11-30T17:07:16.311367+0000","last_became_active":"2023-11-30T17:07:15.918200+0000","last_became_peered":"2023-11-30T17:07:15.918200+0000","last_unstale":"2023-11-30T17:07:16.311367+0000","last_undegraded":"2023-11-30T17:07:16.311367+0000","last_fullsized":"2023-11-30T17:07:16.311367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.286349+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:07:16.286349+0000","last_peered":"2023-11-30T17:07:16.286349+0000","last_clean":"2023-11-30T17:07:16.286349+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:07:16.286349+0000","last_undegraded":"2023-11-30T17:07:16.286349+0000","last_fullsized":"2023-11-30T17:07:16.286349+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308858+0000","last_change":"2023-11-30T17:07:16.307511+0000","last_active":"2023-11-30T17:07:16.308858+0000","last_peered":"2023-11-30T17:07:16.308858+0000","last_clean":"2023-11-30T17:07:16.308858+0000","last_became_active":"2023-11-30T17:07:16.307230+0000","last_became_peered":"2023-11-30T17:07:16.307230+0000","last_unstale":"2023-11-30T17:07:16.308858+0000","last_undegraded":"2023-11-30T17:07:16.308858+0000","last_fullsized":"2023-11-30T17:07:16.308858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.291598+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:07:16.291598+0000","last_peered":"2023-11-30T17:07:16.291598+0000","last_clean":"2023-11-30T17:07:16.291598+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:07:16.291598+0000","last_undegraded":"2023-11-30T17:07:16.291598+0000","last_fullsized":"2023-11-30T17:07:16.291598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.289782+0000","last_change":"2023-11-30T17:07:15.908349+0000","last_active":"2023-11-30T17:07:16.289782+0000","last_peered":"2023-11-30T17:07:16.289782+0000","last_clean":"2023-11-30T17:07:16.289782+0000","last_became_active":"2023-11-30T17:07:15.908063+0000","last_became_peered":"2023-11-30T17:07:15.908063+0000","last_unstale":"2023-11-30T17:07:16.289782+0000","last_undegraded":"2023-11-30T17:07:16.289782+0000","last_fullsized":"2023-11-30T17:07:16.289782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315272+0000","last_change":"2023-11-30T17:07:16.314378+0000","last_active":"2023-11-30T17:07:16.315272+0000","last_peered":"2023-11-30T17:07:16.315272+0000","last_clean":"2023-11-30T17:07:16.315272+0000","last_became_active":"2023-11-30T17:07:16.314073+0000","last_became_peered":"2023-11-30T17:07:16.314073+0000","last_unstale":"2023-11-30T17:07:16.315272+0000","last_undegraded":"2023-11-30T17:07:16.315272+0000","last_fullsized":"2023-11-30T17:07:16.315272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.309505+0000","last_change":"2023-11-30T17:07:16.304420+0000","last_active":"2023-11-30T17:07:16.309505+0000","last_peered":"2023-11-30T17:07:16.309505+0000","last_clean":"2023-11-30T17:07:16.309505+0000","last_became_active":"2023-11-30T17:07:16.304065+0000","last_became_peered":"2023-11-30T17:07:16.304065+0000","last_unstale":"2023-11-30T17:07:16.309505+0000","last_undegraded":"2023-11-30T17:07:16.309505+0000","last_fullsized":"2023-11-30T17:07:16.309505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.291238+0000","last_change":"2023-11-30T17:07:15.905313+0000","last_active":"2023-11-30T17:07:16.291238+0000","last_peered":"2023-11-30T17:07:16.291238+0000","last_clean":"2023-11-30T17:07:16.291238+0000","last_became_active":"2023-11-30T17:07:15.905016+0000","last_became_peered":"2023-11-30T17:07:15.905016+0000","last_unstale":"2023-11-30T17:07:16.291238+0000","last_undegraded":"2023-11-30T17:07:16.291238+0000","last_fullsized":"2023-11-30T17:07:16.291238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312205+0000","last_change":"2023-11-30T17:07:16.308479+0000","last_active":"2023-11-30T17:07:16.312205+0000","last_peered":"2023-11-30T17:07:16.312205+0000","last_clean":"2023-11-30T17:07:16.312205+0000","last_became_active":"2023-11-30T17:07:16.307732+0000","last_became_peered":"2023-11-30T17:07:16.307732+0000","last_unstale":"2023-11-30T17:07:16.312205+0000","last_undegraded":"2023-11-30T17:07:16.312205+0000","last_fullsized":"2023-11-30T17:07:16.312205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.303391+0000","last_change":"2023-11-30T17:07:15.907619+0000","last_active":"2023-11-30T17:07:16.303391+0000","last_peered":"2023-11-30T17:07:16.303391+0000","last_clean":"2023-11-30T17:07:16.303391+0000","last_became_active":"2023-11-30T17:07:15.907322+0000","last_became_peered":"2023-11-30T17:07:15.907322+0000","last_unstale":"2023-11-30T17:07:16.303391+0000","last_undegraded":"2023-11-30T17:07:16.303391+0000","last_fullsized":"2023-11-30T17:07:16.303391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312237+0000","last_change":"2023-11-30T17:07:16.307668+0000","last_active":"2023-11-30T17:07:16.312237+0000","last_peered":"2023-11-30T17:07:16.312237+0000","last_clean":"2023-11-30T17:07:16.312237+0000","last_became_active":"2023-11-30T17:07:16.306226+0000","last_became_peered":"2023-11-30T17:07:16.306226+0000","last_unstale":"2023-11-30T17:07:16.312237+0000","last_undegraded":"2023-11-30T17:07:16.312237+0000","last_fullsized":"2023-11-30T17:07:16.312237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315804+0000","last_change":"2023-11-30T17:07:15.910485+0000","last_active":"2023-11-30T17:07:16.315804+0000","last_peered":"2023-11-30T17:07:16.315804+0000","last_clean":"2023-11-30T17:07:16.315804+0000","last_became_active":"2023-11-30T17:07:15.909426+0000","last_became_peered":"2023-11-30T17:07:15.909426+0000","last_unstale":"2023-11-30T17:07:16.315804+0000","last_undegraded":"2023-11-30T17:07:16.315804+0000","last_fullsized":"2023-11-30T17:07:16.315804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.314207+0000","last_change":"2023-11-30T17:07:16.308666+0000","last_active":"2023-11-30T17:07:16.314207+0000","last_peered":"2023-11-30T17:07:16.314207+0000","last_clean":"2023-11-30T17:07:16.314207+0000","last_became_active":"2023-11-30T17:07:16.308353+0000","last_became_peered":"2023-11-30T17:07:16.308353+0000","last_unstale":"2023-11-30T17:07:16.314207+0000","last_undegraded":"2023-11-30T17:07:16.314207+0000","last_fullsized":"2023-11-30T17:07:16.314207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.305835+0000","last_change":"2023-11-30T17:07:15.899895+0000","last_active":"2023-11-30T17:07:16.305835+0000","last_peered":"2023-11-30T17:07:16.305835+0000","last_clean":"2023-11-30T17:07:16.305835+0000","last_became_active":"2023-11-30T17:07:15.899595+0000","last_became_peered":"2023-11-30T17:07:15.899595+0000","last_unstale":"2023-11-30T17:07:16.305835+0000","last_undegraded":"2023-11-30T17:07:16.305835+0000","last_fullsized":"2023-11-30T17:07:16.305835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.304474+0000","last_change":"2023-11-30T17:07:16.301694+0000","last_active":"2023-11-30T17:07:16.304474+0000","last_peered":"2023-11-30T17:07:16.304474+0000","last_clean":"2023-11-30T17:07:16.304474+0000","last_became_active":"2023-11-30T17:07:16.301392+0000","last_became_peered":"2023-11-30T17:07:16.301392+0000","last_unstale":"2023-11-30T17:07:16.304474+0000","last_undegraded":"2023-11-30T17:07:16.304474+0000","last_fullsized":"2023-11-30T17:07:16.304474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.309919+0000","last_change":"2023-11-30T17:07:15.905807+0000","last_active":"2023-11-30T17:07:16.309919+0000","last_peered":"2023-11-30T17:07:16.309919+0000","last_clean":"2023-11-30T17:07:16.309919+0000","last_became_active":"2023-11-30T17:07:15.905509+0000","last_became_peered":"2023-11-30T17:07:15.905509+0000","last_unstale":"2023-11-30T17:07:16.309919+0000","last_undegraded":"2023-11-30T17:07:16.309919+0000","last_fullsized":"2023-11-30T17:07:16.309919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.310536+0000","last_change":"2023-11-30T17:07:16.301265+0000","last_active":"2023-11-30T17:07:16.310536+0000","last_peered":"2023-11-30T17:07:16.310536+0000","last_clean":"2023-11-30T17:07:16.310536+0000","last_became_active":"2023-11-30T17:07:16.300966+0000","last_became_peered":"2023-11-30T17:07:16.300966+0000","last_unstale":"2023-11-30T17:07:16.310536+0000","last_undegraded":"2023-11-30T17:07:16.310536+0000","last_fullsized":"2023-11-30T17:07:16.310536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.291444+0000","last_change":"2023-11-30T17:07:15.907348+0000","last_active":"2023-11-30T17:07:16.291444+0000","last_peered":"2023-11-30T17:07:16.291444+0000","last_clean":"2023-11-30T17:07:16.291444+0000","last_became_active":"2023-11-30T17:07:15.907034+0000","last_became_peered":"2023-11-30T17:07:15.907034+0000","last_unstale":"2023-11-30T17:07:16.291444+0000","last_undegraded":"2023-11-30T17:07:16.291444+0000","last_fullsized":"2023-11-30T17:07:16.291444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.310519+0000","last_change":"2023-11-30T17:07:16.302759+0000","last_active":"2023-11-30T17:07:16.310519+0000","last_peered":"2023-11-30T17:07:16.310519+0000","last_clean":"2023-11-30T17:07:16.310519+0000","last_became_active":"2023-11-30T17:07:16.302501+0000","last_became_peered":"2023-11-30T17:07:16.302501+0000","last_unstale":"2023-11-30T17:07:16.310519+0000","last_undegraded":"2023-11-30T17:07:16.310519+0000","last_fullsized":"2023-11-30T17:07:16.310519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.292697+0000","last_change":"2023-11-30T17:07:15.915794+0000","last_active":"2023-11-30T17:07:16.292697+0000","last_peered":"2023-11-30T17:07:16.292697+0000","last_clean":"2023-11-30T17:07:16.292697+0000","last_became_active":"2023-11-30T17:07:15.915469+0000","last_became_peered":"2023-11-30T17:07:15.915469+0000","last_unstale":"2023-11-30T17:07:16.292697+0000","last_undegraded":"2023-11-30T17:07:16.292697+0000","last_fullsized":"2023-11-30T17:07:16.292697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.320036+0000","last_change":"2023-11-30T17:07:16.316288+0000","last_active":"2023-11-30T17:07:16.320036+0000","last_peered":"2023-11-30T17:07:16.320036+0000","last_clean":"2023-11-30T17:07:16.320036+0000","last_became_active":"2023-11-30T17:07:16.315974+0000","last_became_peered":"2023-11-30T17:07:16.315974+0000","last_unstale":"2023-11-30T17:07:16.320036+0000","last_undegraded":"2023-11-30T17:07:16.320036+0000","last_fullsized":"2023-11-30T17:07:16.320036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308587+0000","last_change":"2023-11-30T17:07:15.918830+0000","last_active":"2023-11-30T17:07:16.308587+0000","last_peered":"2023-11-30T17:07:16.308587+0000","last_clean":"2023-11-30T17:07:16.308587+0000","last_became_active":"2023-11-30T17:07:15.918553+0000","last_became_peered":"2023-11-30T17:07:15.918553+0000","last_unstale":"2023-11-30T17:07:16.308587+0000","last_undegraded":"2023-11-30T17:07:16.308587+0000","last_fullsized":"2023-11-30T17:07:16.308587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312385+0000","last_change":"2023-11-30T17:07:16.300603+0000","last_active":"2023-11-30T17:07:16.312385+0000","last_peered":"2023-11-30T17:07:16.312385+0000","last_clean":"2023-11-30T17:07:16.312385+0000","last_became_active":"2023-11-30T17:07:16.297982+0000","last_became_peered":"2023-11-30T17:07:16.297982+0000","last_unstale":"2023-11-30T17:07:16.312385+0000","last_undegraded":"2023-11-30T17:07:16.312385+0000","last_fullsized":"2023-11-30T17:07:16.312385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.291351+0000","last_change":"2023-11-30T17:07:15.905698+0000","last_active":"2023-11-30T17:07:16.291351+0000","last_peered":"2023-11-30T17:07:16.291351+0000","last_clean":"2023-11-30T17:07:16.291351+0000","last_became_active":"2023-11-30T17:07:15.905364+0000","last_became_peered":"2023-11-30T17:07:15.905364+0000","last_unstale":"2023-11-30T17:07:16.291351+0000","last_undegraded":"2023-11-30T17:07:16.291351+0000","last_fullsized":"2023-11-30T17:07:16.291351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.314168+0000","last_change":"2023-11-30T17:07:16.310762+0000","last_active":"2023-11-30T17:07:16.314168+0000","last_peered":"2023-11-30T17:07:16.314168+0000","last_clean":"2023-11-30T17:07:16.314168+0000","last_became_active":"2023-11-30T17:07:16.310459+0000","last_became_peered":"2023-11-30T17:07:16.310459+0000","last_unstale":"2023-11-30T17:07:16.314168+0000","last_undegraded":"2023-11-30T17:07:16.314168+0000","last_fullsized":"2023-11-30T17:07:16.314168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.296049+0000","last_change":"2023-11-30T17:07:15.905922+0000","last_active":"2023-11-30T17:07:16.296049+0000","last_peered":"2023-11-30T17:07:16.296049+0000","last_clean":"2023-11-30T17:07:16.296049+0000","last_became_active":"2023-11-30T17:07:15.905607+0000","last_became_peered":"2023-11-30T17:07:15.905607+0000","last_unstale":"2023-11-30T17:07:16.296049+0000","last_undegraded":"2023-11-30T17:07:16.296049+0000","last_fullsized":"2023-11-30T17:07:16.296049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.314769+0000","last_change":"2023-11-30T17:07:16.310200+0000","last_active":"2023-11-30T17:07:16.314769+0000","last_peered":"2023-11-30T17:07:16.314769+0000","last_clean":"2023-11-30T17:07:16.314769+0000","last_became_active":"2023-11-30T17:07:16.309645+0000","last_became_peered":"2023-11-30T17:07:16.309645+0000","last_unstale":"2023-11-30T17:07:16.314769+0000","last_undegraded":"2023-11-30T17:07:16.314769+0000","last_fullsized":"2023-11-30T17:07:16.314769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.285637+0000","last_change":"2023-11-30T17:07:15.913510+0000","last_active":"2023-11-30T17:07:16.285637+0000","last_peered":"2023-11-30T17:07:16.285637+0000","last_clean":"2023-11-30T17:07:16.285637+0000","last_became_active":"2023-11-30T17:07:15.913195+0000","last_became_peered":"2023-11-30T17:07:15.913195+0000","last_unstale":"2023-11-30T17:07:16.285637+0000","last_undegraded":"2023-11-30T17:07:16.285637+0000","last_fullsized":"2023-11-30T17:07:16.285637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307638+0000","last_change":"2023-11-30T17:07:16.305749+0000","last_active":"2023-11-30T17:07:16.307638+0000","last_peered":"2023-11-30T17:07:16.307638+0000","last_clean":"2023-11-30T17:07:16.307638+0000","last_became_active":"2023-11-30T17:07:16.305460+0000","last_became_peered":"2023-11-30T17:07:16.305460+0000","last_unstale":"2023-11-30T17:07:16.307638+0000","last_undegraded":"2023-11-30T17:07:16.307638+0000","last_fullsized":"2023-11-30T17:07:16.307638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-30T17:07:17.291653+0000","last_change":"2023-11-30T17:07:15.915366+0000","last_active":"2023-11-30T17:07:17.291653+0000","last_peered":"2023-11-30T17:07:17.291653+0000","last_clean":"2023-11-30T17:07:17.291653+0000","last_became_active":"2023-11-30T17:07:15.915099+0000","last_became_peered":"2023-11-30T17:07:15.915099+0000","last_unstale":"2023-11-30T17:07:17.291653+0000","last_undegraded":"2023-11-30T17:07:17.291653+0000","last_fullsized":"2023-11-30T17:07:17.291653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.303911+0000","last_change":"2023-11-30T17:07:16.300223+0000","last_active":"2023-11-30T17:07:16.303911+0000","last_peered":"2023-11-30T17:07:16.303911+0000","last_clean":"2023-11-30T17:07:16.303911+0000","last_became_active":"2023-11-30T17:07:16.299885+0000","last_became_peered":"2023-11-30T17:07:16.299885+0000","last_unstale":"2023-11-30T17:07:16.303911+0000","last_undegraded":"2023-11-30T17:07:16.303911+0000","last_fullsized":"2023-11-30T17:07:16.303911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.298199+0000","last_change":"2023-11-30T17:07:15.912712+0000","last_active":"2023-11-30T17:07:16.298199+0000","last_peered":"2023-11-30T17:07:16.298199+0000","last_clean":"2023-11-30T17:07:16.298199+0000","last_became_active":"2023-11-30T17:07:15.912259+0000","last_became_peered":"2023-11-30T17:07:15.912259+0000","last_unstale":"2023-11-30T17:07:16.298199+0000","last_undegraded":"2023-11-30T17:07:16.298199+0000","last_fullsized":"2023-11-30T17:07:16.298199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.313787+0000","last_change":"2023-11-30T17:07:16.309299+0000","last_active":"2023-11-30T17:07:16.313787+0000","last_peered":"2023-11-30T17:07:16.313787+0000","last_clean":"2023-11-30T17:07:16.313787+0000","last_became_active":"2023-11-30T17:07:16.308844+0000","last_became_peered":"2023-11-30T17:07:16.308844+0000","last_unstale":"2023-11-30T17:07:16.313787+0000","last_undegraded":"2023-11-30T17:07:16.313787+0000","last_fullsized":"2023-11-30T17:07:16.313787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.298030+0000","last_change":"2023-11-30T17:07:15.920996+0000","last_active":"2023-11-30T17:07:16.298030+0000","last_peered":"2023-11-30T17:07:16.298030+0000","last_clean":"2023-11-30T17:07:16.298030+0000","last_became_active":"2023-11-30T17:07:15.920782+0000","last_became_peered":"2023-11-30T17:07:15.920782+0000","last_unstale":"2023-11-30T17:07:16.298030+0000","last_undegraded":"2023-11-30T17:07:16.298030+0000","last_fullsized":"2023-11-30T17:07:16.298030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307613+0000","last_change":"2023-11-30T17:07:16.304597+0000","last_active":"2023-11-30T17:07:16.307613+0000","last_peered":"2023-11-30T17:07:16.307613+0000","last_clean":"2023-11-30T17:07:16.307613+0000","last_became_active":"2023-11-30T17:07:16.304251+0000","last_became_peered":"2023-11-30T17:07:16.304251+0000","last_unstale":"2023-11-30T17:07:16.307613+0000","last_undegraded":"2023-11-30T17:07:16.307613+0000","last_fullsized":"2023-11-30T17:07:16.307613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.297402+0000","last_change":"2023-11-30T17:07:15.913299+0000","last_active":"2023-11-30T17:07:16.297402+0000","last_peered":"2023-11-30T17:07:16.297402+0000","last_clean":"2023-11-30T17:07:16.297402+0000","last_became_active":"2023-11-30T17:07:15.912978+0000","last_became_peered":"2023-11-30T17:07:15.912978+0000","last_unstale":"2023-11-30T17:07:16.297402+0000","last_undegraded":"2023-11-30T17:07:16.297402+0000","last_fullsized":"2023-11-30T17:07:16.297402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315291+0000","last_change":"2023-11-30T17:07:16.311213+0000","last_active":"2023-11-30T17:07:16.315291+0000","last_peered":"2023-11-30T17:07:16.315291+0000","last_clean":"2023-11-30T17:07:16.315291+0000","last_became_active":"2023-11-30T17:07:16.309590+0000","last_became_peered":"2023-11-30T17:07:16.309590+0000","last_unstale":"2023-11-30T17:07:16.315291+0000","last_undegraded":"2023-11-30T17:07:16.315291+0000","last_fullsized":"2023-11-30T17:07:16.315291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308744+0000","last_change":"2023-11-30T17:07:15.917988+0000","last_active":"2023-11-30T17:07:16.308744+0000","last_peered":"2023-11-30T17:07:16.308744+0000","last_clean":"2023-11-30T17:07:16.308744+0000","last_became_active":"2023-11-30T17:07:15.917715+0000","last_became_peered":"2023-11-30T17:07:15.917715+0000","last_unstale":"2023-11-30T17:07:16.308744+0000","last_undegraded":"2023-11-30T17:07:16.308744+0000","last_fullsized":"2023-11-30T17:07:16.308744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.309259+0000","last_change":"2023-11-30T17:07:16.305167+0000","last_active":"2023-11-30T17:07:16.309259+0000","last_peered":"2023-11-30T17:07:16.309259+0000","last_clean":"2023-11-30T17:07:16.309259+0000","last_became_active":"2023-11-30T17:07:16.304366+0000","last_became_peered":"2023-11-30T17:07:16.304366+0000","last_unstale":"2023-11-30T17:07:16.309259+0000","last_undegraded":"2023-11-30T17:07:16.309259+0000","last_fullsized":"2023-11-30T17:07:16.309259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.309634+0000","last_change":"2023-11-30T17:07:15.913349+0000","last_active":"2023-11-30T17:07:16.309634+0000","last_peered":"2023-11-30T17:07:16.309634+0000","last_clean":"2023-11-30T17:07:16.309634+0000","last_became_active":"2023-11-30T17:07:15.912819+0000","last_became_peered":"2023-11-30T17:07:15.912819+0000","last_unstale":"2023-11-30T17:07:16.309634+0000","last_undegraded":"2023-11-30T17:07:16.309634+0000","last_fullsized":"2023-11-30T17:07:16.309634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312387+0000","last_change":"2023-11-30T17:07:16.307878+0000","last_active":"2023-11-30T17:07:16.312387+0000","last_peered":"2023-11-30T17:07:16.312387+0000","last_clean":"2023-11-30T17:07:16.312387+0000","last_became_active":"2023-11-30T17:07:16.307596+0000","last_became_peered":"2023-11-30T17:07:16.307596+0000","last_unstale":"2023-11-30T17:07:16.312387+0000","last_undegraded":"2023-11-30T17:07:16.312387+0000","last_fullsized":"2023-11-30T17:07:16.312387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.289290+0000","last_change":"2023-11-30T17:07:15.905418+0000","last_active":"2023-11-30T17:07:16.289290+0000","last_peered":"2023-11-30T17:07:16.289290+0000","last_clean":"2023-11-30T17:07:16.289290+0000","last_became_active":"2023-11-30T17:07:15.905118+0000","last_became_peered":"2023-11-30T17:07:15.905118+0000","last_unstale":"2023-11-30T17:07:16.289290+0000","last_undegraded":"2023-11-30T17:07:16.289290+0000","last_fullsized":"2023-11-30T17:07:16.289290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295717+0000","last_change":"2023-11-30T17:07:16.294026+0000","last_active":"2023-11-30T17:07:16.295717+0000","last_peered":"2023-11-30T17:07:16.295717+0000","last_clean":"2023-11-30T17:07:16.295717+0000","last_became_active":"2023-11-30T17:07:16.293758+0000","last_became_peered":"2023-11-30T17:07:16.293758+0000","last_unstale":"2023-11-30T17:07:16.295717+0000","last_undegraded":"2023-11-30T17:07:16.295717+0000","last_fullsized":"2023-11-30T17:07:16.295717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.310234+0000","last_change":"2023-11-30T17:07:15.914406+0000","last_active":"2023-11-30T17:07:16.310234+0000","last_peered":"2023-11-30T17:07:16.310234+0000","last_clean":"2023-11-30T17:07:16.310234+0000","last_became_active":"2023-11-30T17:07:15.914121+0000","last_became_peered":"2023-11-30T17:07:15.914121+0000","last_unstale":"2023-11-30T17:07:16.310234+0000","last_undegraded":"2023-11-30T17:07:16.310234+0000","last_fullsized":"2023-11-30T17:07:16.310234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307697+0000","last_change":"2023-11-30T17:07:16.306238+0000","last_active":"2023-11-30T17:07:16.307697+0000","last_peered":"2023-11-30T17:07:16.307697+0000","last_clean":"2023-11-30T17:07:16.307697+0000","last_became_active":"2023-11-30T17:07:16.305963+0000","last_became_peered":"2023-11-30T17:07:16.305963+0000","last_unstale":"2023-11-30T17:07:16.307697+0000","last_undegraded":"2023-11-30T17:07:16.307697+0000","last_fullsized":"2023-11-30T17:07:16.307697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.293985+0000","last_change":"2023-11-30T17:07:15.909372+0000","last_active":"2023-11-30T17:07:16.293985+0000","last_peered":"2023-11-30T17:07:16.293985+0000","last_clean":"2023-11-30T17:07:16.293985+0000","last_became_active":"2023-11-30T17:07:15.909092+0000","last_became_peered":"2023-11-30T17:07:15.909092+0000","last_unstale":"2023-11-30T17:07:16.293985+0000","last_undegraded":"2023-11-30T17:07:16.293985+0000","last_fullsized":"2023-11-30T17:07:16.293985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315497+0000","last_change":"2023-11-30T17:07:16.309056+0000","last_active":"2023-11-30T17:07:16.315497+0000","last_peered":"2023-11-30T17:07:16.315497+0000","last_clean":"2023-11-30T17:07:16.315497+0000","last_became_active":"2023-11-30T17:07:16.308728+0000","last_became_peered":"2023-11-30T17:07:16.308728+0000","last_unstale":"2023-11-30T17:07:16.315497+0000","last_undegraded":"2023-11-30T17:07:16.315497+0000","last_fullsized":"2023-11-30T17:07:16.315497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.306826+0000","last_change":"2023-11-30T17:07:15.914123+0000","last_active":"2023-11-30T17:07:16.306826+0000","last_peered":"2023-11-30T17:07:16.306826+0000","last_clean":"2023-11-30T17:07:16.306826+0000","last_became_active":"2023-11-30T17:07:15.913855+0000","last_became_peered":"2023-11-30T17:07:15.913855+0000","last_unstale":"2023-11-30T17:07:16.306826+0000","last_undegraded":"2023-11-30T17:07:16.306826+0000","last_fullsized":"2023-11-30T17:07:16.306826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.313763+0000","last_change":"2023-11-30T17:07:16.309110+0000","last_active":"2023-11-30T17:07:16.313763+0000","last_peered":"2023-11-30T17:07:16.313763+0000","last_clean":"2023-11-30T17:07:16.313763+0000","last_became_active":"2023-11-30T17:07:16.308500+0000","last_became_peered":"2023-11-30T17:07:16.308500+0000","last_unstale":"2023-11-30T17:07:16.313763+0000","last_undegraded":"2023-11-30T17:07:16.313763+0000","last_fullsized":"2023-11-30T17:07:16.313763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.313277+0000","last_change":"2023-11-30T17:07:15.909703+0000","last_active":"2023-11-30T17:07:16.313277+0000","last_peered":"2023-11-30T17:07:16.313277+0000","last_clean":"2023-11-30T17:07:16.313277+0000","last_became_active":"2023-11-30T17:07:15.909387+0000","last_became_peered":"2023-11-30T17:07:15.909387+0000","last_unstale":"2023-11-30T17:07:16.313277+0000","last_undegraded":"2023-11-30T17:07:16.313277+0000","last_fullsized":"2023-11-30T17:07:16.313277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318600+0000","last_change":"2023-11-30T17:07:16.314404+0000","last_active":"2023-11-30T17:07:16.318600+0000","last_peered":"2023-11-30T17:07:16.318600+0000","last_clean":"2023-11-30T17:07:16.318600+0000","last_became_active":"2023-11-30T17:07:16.314144+0000","last_became_peered":"2023-11-30T17:07:16.314144+0000","last_unstale":"2023-11-30T17:07:16.318600+0000","last_undegraded":"2023-11-30T17:07:16.318600+0000","last_fullsized":"2023-11-30T17:07:16.318600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.285577+0000","last_change":"2023-11-30T17:07:15.907074+0000","last_active":"2023-11-30T17:07:16.285577+0000","last_peered":"2023-11-30T17:07:16.285577+0000","last_clean":"2023-11-30T17:07:16.285577+0000","last_became_active":"2023-11-30T17:07:15.906537+0000","last_became_peered":"2023-11-30T17:07:15.906537+0000","last_unstale":"2023-11-30T17:07:16.285577+0000","last_undegraded":"2023-11-30T17:07:16.285577+0000","last_fullsized":"2023-11-30T17:07:16.285577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308169+0000","last_change":"2023-11-30T17:07:16.304623+0000","last_active":"2023-11-30T17:07:16.308169+0000","last_peered":"2023-11-30T17:07:16.308169+0000","last_clean":"2023-11-30T17:07:16.308169+0000","last_became_active":"2023-11-30T17:07:16.303986+0000","last_became_peered":"2023-11-30T17:07:16.303986+0000","last_unstale":"2023-11-30T17:07:16.308169+0000","last_undegraded":"2023-11-30T17:07:16.308169+0000","last_fullsized":"2023-11-30T17:07:16.308169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.288987+0000","last_change":"2023-11-30T17:07:15.905081+0000","last_active":"2023-11-30T17:07:16.288987+0000","last_peered":"2023-11-30T17:07:16.288987+0000","last_clean":"2023-11-30T17:07:16.288987+0000","last_became_active":"2023-11-30T17:07:15.903780+0000","last_became_peered":"2023-11-30T17:07:15.903780+0000","last_unstale":"2023-11-30T17:07:16.288987+0000","last_undegraded":"2023-11-30T17:07:16.288987+0000","last_fullsized":"2023-11-30T17:07:16.288987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.301942+0000","last_change":"2023-11-30T17:07:16.300473+0000","last_active":"2023-11-30T17:07:16.301942+0000","last_peered":"2023-11-30T17:07:16.301942+0000","last_clean":"2023-11-30T17:07:16.301942+0000","last_became_active":"2023-11-30T17:07:16.300201+0000","last_became_peered":"2023-11-30T17:07:16.300201+0000","last_unstale":"2023-11-30T17:07:16.301942+0000","last_undegraded":"2023-11-30T17:07:16.301942+0000","last_fullsized":"2023-11-30T17:07:16.301942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.306129+0000","last_change":"2023-11-30T17:07:15.903443+0000","last_active":"2023-11-30T17:07:16.306129+0000","last_peered":"2023-11-30T17:07:16.306129+0000","last_clean":"2023-11-30T17:07:16.306129+0000","last_became_active":"2023-11-30T17:07:15.902100+0000","last_became_peered":"2023-11-30T17:07:15.902100+0000","last_unstale":"2023-11-30T17:07:16.306129+0000","last_undegraded":"2023-11-30T17:07:16.306129+0000","last_fullsized":"2023-11-30T17:07:16.306129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.311052+0000","last_change":"2023-11-30T17:07:16.308777+0000","last_active":"2023-11-30T17:07:16.311052+0000","last_peered":"2023-11-30T17:07:16.311052+0000","last_clean":"2023-11-30T17:07:16.311052+0000","last_became_active":"2023-11-30T17:07:16.308488+0000","last_became_peered":"2023-11-30T17:07:16.308488+0000","last_unstale":"2023-11-30T17:07:16.311052+0000","last_undegraded":"2023-11-30T17:07:16.311052+0000","last_fullsized":"2023-11-30T17:07:16.311052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318584+0000","last_change":"2023-11-30T17:07:15.909022+0000","last_active":"2023-11-30T17:07:16.318584+0000","last_peered":"2023-11-30T17:07:16.318584+0000","last_clean":"2023-11-30T17:07:16.318584+0000","last_became_active":"2023-11-30T17:07:15.908674+0000","last_became_peered":"2023-11-30T17:07:15.908674+0000","last_unstale":"2023-11-30T17:07:16.318584+0000","last_undegraded":"2023-11-30T17:07:16.318584+0000","last_fullsized":"2023-11-30T17:07:16.318584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318514+0000","last_change":"2023-11-30T17:07:16.313527+0000","last_active":"2023-11-30T17:07:16.318514+0000","last_peered":"2023-11-30T17:07:16.318514+0000","last_clean":"2023-11-30T17:07:16.318514+0000","last_became_active":"2023-11-30T17:07:16.313199+0000","last_became_peered":"2023-11-30T17:07:16.313199+0000","last_unstale":"2023-11-30T17:07:16.318514+0000","last_undegraded":"2023-11-30T17:07:16.318514+0000","last_fullsized":"2023-11-30T17:07:16.318514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.288932+0000","last_change":"2023-11-30T17:07:15.914420+0000","last_active":"2023-11-30T17:07:16.288932+0000","last_peered":"2023-11-30T17:07:16.288932+0000","last_clean":"2023-11-30T17:07:16.288932+0000","last_became_active":"2023-11-30T17:07:15.914142+0000","last_became_peered":"2023-11-30T17:07:15.914142+0000","last_unstale":"2023-11-30T17:07:16.288932+0000","last_undegraded":"2023-11-30T17:07:16.288932+0000","last_fullsized":"2023-11-30T17:07:16.288932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308304+0000","last_change":"2023-11-30T17:07:16.305961+0000","last_active":"2023-11-30T17:07:16.308304+0000","last_peered":"2023-11-30T17:07:16.308304+0000","last_clean":"2023-11-30T17:07:16.308304+0000","last_became_active":"2023-11-30T17:07:16.305363+0000","last_became_peered":"2023-11-30T17:07:16.305363+0000","last_unstale":"2023-11-30T17:07:16.308304+0000","last_undegraded":"2023-11-30T17:07:16.308304+0000","last_fullsized":"2023-11-30T17:07:16.308304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.291553+0000","last_change":"2023-11-30T17:07:15.911255+0000","last_active":"2023-11-30T17:07:16.291553+0000","last_peered":"2023-11-30T17:07:16.291553+0000","last_clean":"2023-11-30T17:07:16.291553+0000","last_became_active":"2023-11-30T17:07:15.910945+0000","last_became_peered":"2023-11-30T17:07:15.910945+0000","last_unstale":"2023-11-30T17:07:16.291553+0000","last_undegraded":"2023-11-30T17:07:16.291553+0000","last_fullsized":"2023-11-30T17:07:16.291553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.314860+0000","last_change":"2023-11-30T17:07:16.310924+0000","last_active":"2023-11-30T17:07:16.314860+0000","last_peered":"2023-11-30T17:07:16.314860+0000","last_clean":"2023-11-30T17:07:16.314860+0000","last_became_active":"2023-11-30T17:07:16.310631+0000","last_became_peered":"2023-11-30T17:07:16.310631+0000","last_unstale":"2023-11-30T17:07:16.314860+0000","last_undegraded":"2023-11-30T17:07:16.314860+0000","last_fullsized":"2023-11-30T17:07:16.314860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.297213+0000","last_change":"2023-11-30T17:07:15.917972+0000","last_active":"2023-11-30T17:07:16.297213+0000","last_peered":"2023-11-30T17:07:16.297213+0000","last_clean":"2023-11-30T17:07:16.297213+0000","last_became_active":"2023-11-30T17:07:15.917546+0000","last_became_peered":"2023-11-30T17:07:15.917546+0000","last_unstale":"2023-11-30T17:07:16.297213+0000","last_undegraded":"2023-11-30T17:07:16.297213+0000","last_fullsized":"2023-11-30T17:07:16.297213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.311505+0000","last_change":"2023-11-30T17:07:16.309537+0000","last_active":"2023-11-30T17:07:16.311505+0000","last_peered":"2023-11-30T17:07:16.311505+0000","last_clean":"2023-11-30T17:07:16.311505+0000","last_became_active":"2023-11-30T17:07:16.309220+0000","last_became_peered":"2023-11-30T17:07:16.309220+0000","last_unstale":"2023-11-30T17:07:16.311505+0000","last_undegraded":"2023-11-30T17:07:16.311505+0000","last_fullsized":"2023-11-30T17:07:16.311505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.294800+0000","last_change":"2023-11-30T17:07:15.913708+0000","last_active":"2023-11-30T17:07:16.294800+0000","last_peered":"2023-11-30T17:07:16.294800+0000","last_clean":"2023-11-30T17:07:16.294800+0000","last_became_active":"2023-11-30T17:07:15.913418+0000","last_became_peered":"2023-11-30T17:07:15.913418+0000","last_unstale":"2023-11-30T17:07:16.294800+0000","last_undegraded":"2023-11-30T17:07:16.294800+0000","last_fullsized":"2023-11-30T17:07:16.294800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318618+0000","last_change":"2023-11-30T17:07:16.314589+0000","last_active":"2023-11-30T17:07:16.318618+0000","last_peered":"2023-11-30T17:07:16.318618+0000","last_clean":"2023-11-30T17:07:16.318618+0000","last_became_active":"2023-11-30T17:07:16.313770+0000","last_became_peered":"2023-11-30T17:07:16.313770+0000","last_unstale":"2023-11-30T17:07:16.318618+0000","last_undegraded":"2023-11-30T17:07:16.318618+0000","last_fullsized":"2023-11-30T17:07:16.318618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295850+0000","last_change":"2023-11-30T17:07:15.914471+0000","last_active":"2023-11-30T17:07:16.295850+0000","last_peered":"2023-11-30T17:07:16.295850+0000","last_clean":"2023-11-30T17:07:16.295850+0000","last_became_active":"2023-11-30T17:07:15.914170+0000","last_became_peered":"2023-11-30T17:07:15.914170+0000","last_unstale":"2023-11-30T17:07:16.295850+0000","last_undegraded":"2023-11-30T17:07:16.295850+0000","last_fullsized":"2023-11-30T17:07:16.295850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.314949+0000","last_change":"2023-11-30T17:07:16.309802+0000","last_active":"2023-11-30T17:07:16.314949+0000","last_peered":"2023-11-30T17:07:16.314949+0000","last_clean":"2023-11-30T17:07:16.314949+0000","last_became_active":"2023-11-30T17:07:16.309499+0000","last_became_peered":"2023-11-30T17:07:16.309499+0000","last_unstale":"2023-11-30T17:07:16.314949+0000","last_undegraded":"2023-11-30T17:07:16.314949+0000","last_fullsized":"2023-11-30T17:07:16.314949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.313989+0000","last_change":"2023-11-30T17:07:15.909306+0000","last_active":"2023-11-30T17:07:16.313989+0000","last_peered":"2023-11-30T17:07:16.313989+0000","last_clean":"2023-11-30T17:07:16.313989+0000","last_became_active":"2023-11-30T17:07:15.909030+0000","last_became_peered":"2023-11-30T17:07:15.909030+0000","last_unstale":"2023-11-30T17:07:16.313989+0000","last_undegraded":"2023-11-30T17:07:16.313989+0000","last_fullsized":"2023-11-30T17:07:16.313989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307156+0000","last_change":"2023-11-30T17:07:16.303384+0000","last_active":"2023-11-30T17:07:16.307156+0000","last_peered":"2023-11-30T17:07:16.307156+0000","last_clean":"2023-11-30T17:07:16.307156+0000","last_became_active":"2023-11-30T17:07:16.298413+0000","last_became_peered":"2023-11-30T17:07:16.298413+0000","last_unstale":"2023-11-30T17:07:16.307156+0000","last_undegraded":"2023-11-30T17:07:16.307156+0000","last_fullsized":"2023-11-30T17:07:16.307156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.305248+0000","last_change":"2023-11-30T17:07:15.914690+0000","last_active":"2023-11-30T17:07:16.305248+0000","last_peered":"2023-11-30T17:07:16.305248+0000","last_clean":"2023-11-30T17:07:16.305248+0000","last_became_active":"2023-11-30T17:07:15.914405+0000","last_became_peered":"2023-11-30T17:07:15.914405+0000","last_unstale":"2023-11-30T17:07:16.305248+0000","last_undegraded":"2023-11-30T17:07:16.305248+0000","last_fullsized":"2023-11-30T17:07:16.305248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.310006+0000","last_change":"2023-11-30T17:07:16.306951+0000","last_active":"2023-11-30T17:07:16.310006+0000","last_peered":"2023-11-30T17:07:16.310006+0000","last_clean":"2023-11-30T17:07:16.310006+0000","last_became_active":"2023-11-30T17:07:16.306691+0000","last_became_peered":"2023-11-30T17:07:16.306691+0000","last_unstale":"2023-11-30T17:07:16.310006+0000","last_undegraded":"2023-11-30T17:07:16.310006+0000","last_fullsized":"2023-11-30T17:07:16.310006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312888+0000","last_change":"2023-11-30T17:07:15.913637+0000","last_active":"2023-11-30T17:07:16.312888+0000","last_peered":"2023-11-30T17:07:16.312888+0000","last_clean":"2023-11-30T17:07:16.312888+0000","last_became_active":"2023-11-30T17:07:15.913336+0000","last_became_peered":"2023-11-30T17:07:15.913336+0000","last_unstale":"2023-11-30T17:07:16.312888+0000","last_undegraded":"2023-11-30T17:07:16.312888+0000","last_fullsized":"2023-11-30T17:07:16.312888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.314791+0000","last_change":"2023-11-30T17:07:16.310337+0000","last_active":"2023-11-30T17:07:16.314791+0000","last_peered":"2023-11-30T17:07:16.314791+0000","last_clean":"2023-11-30T17:07:16.314791+0000","last_became_active":"2023-11-30T17:07:16.310010+0000","last_became_peered":"2023-11-30T17:07:16.310010+0000","last_unstale":"2023-11-30T17:07:16.314791+0000","last_undegraded":"2023-11-30T17:07:16.314791+0000","last_fullsized":"2023-11-30T17:07:16.314791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.290031+0000","last_change":"2023-11-30T17:07:15.912918+0000","last_active":"2023-11-30T17:07:16.290031+0000","last_peered":"2023-11-30T17:07:16.290031+0000","last_clean":"2023-11-30T17:07:16.290031+0000","last_became_active":"2023-11-30T17:07:15.912624+0000","last_became_peered":"2023-11-30T17:07:15.912624+0000","last_unstale":"2023-11-30T17:07:16.290031+0000","last_undegraded":"2023-11-30T17:07:16.290031+0000","last_fullsized":"2023-11-30T17:07:16.290031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308325+0000","last_change":"2023-11-30T17:07:16.306137+0000","last_active":"2023-11-30T17:07:16.308325+0000","last_peered":"2023-11-30T17:07:16.308325+0000","last_clean":"2023-11-30T17:07:16.308325+0000","last_became_active":"2023-11-30T17:07:16.305673+0000","last_became_peered":"2023-11-30T17:07:16.305673+0000","last_unstale":"2023-11-30T17:07:16.308325+0000","last_undegraded":"2023-11-30T17:07:16.308325+0000","last_fullsized":"2023-11-30T17:07:16.308325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.286516+0000","last_change":"2023-11-30T17:07:15.912021+0000","last_active":"2023-11-30T17:07:16.286516+0000","last_peered":"2023-11-30T17:07:16.286516+0000","last_clean":"2023-11-30T17:07:16.286516+0000","last_became_active":"2023-11-30T17:07:15.911720+0000","last_became_peered":"2023-11-30T17:07:15.911720+0000","last_unstale":"2023-11-30T17:07:16.286516+0000","last_undegraded":"2023-11-30T17:07:16.286516+0000","last_fullsized":"2023-11-30T17:07:16.286516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318594+0000","last_change":"2023-11-30T17:07:16.313578+0000","last_active":"2023-11-30T17:07:16.318594+0000","last_peered":"2023-11-30T17:07:16.318594+0000","last_clean":"2023-11-30T17:07:16.318594+0000","last_became_active":"2023-11-30T17:07:16.313325+0000","last_became_peered":"2023-11-30T17:07:16.313325+0000","last_unstale":"2023-11-30T17:07:16.318594+0000","last_undegraded":"2023-11-30T17:07:16.318594+0000","last_fullsized":"2023-11-30T17:07:16.318594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.311197+0000","last_change":"2023-11-30T17:07:15.908770+0000","last_active":"2023-11-30T17:07:16.311197+0000","last_peered":"2023-11-30T17:07:16.311197+0000","last_clean":"2023-11-30T17:07:16.311197+0000","last_became_active":"2023-11-30T17:07:15.908480+0000","last_became_peered":"2023-11-30T17:07:15.908480+0000","last_unstale":"2023-11-30T17:07:16.311197+0000","last_undegraded":"2023-11-30T17:07:16.311197+0000","last_fullsized":"2023-11-30T17:07:16.311197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297348,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074492,"statfs":{"total":96636764160,"available":96332279808,"internally_reserved":0,"allocated":258048,"data_stored":86755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":86787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297340,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074500,"statfs":{"total":96636764160,"available":96332288000,"internally_reserved":0,"allocated":249856,"data_stored":86933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:07:30.255 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:07:30.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.405+0000 7fbe3ecc8700 1 Processor -- start 2023-11-30T17:07:30.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.406+0000 7fbe3ecc8700 1 -- start start 2023-11-30T17:07:30.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.406+0000 7fbe3ecc8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe3806b510 0x7fbe381546f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:30.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.406+0000 7fbe3ecc8700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbe380c10f0 0x7fbe38158b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:30.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.406+0000 7fbe3ecc8700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe38063380 con 0x7fbe380c0d10 2023-11-30T17:07:30.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.406+0000 7fbe3ecc8700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe380c19e0 con 0x7fbe380c10f0 2023-11-30T17:07:30.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.406+0000 7fbe3ecc8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe38159060 con 0x7fbe3806b510 2023-11-30T17:07:30.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.407+0000 7fbe3d265700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbe380c10f0 0x7fbe38158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:30.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.407+0000 7fbe37fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe3806b510 0x7fbe381546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:30.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.407+0000 7fbe3ca64700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fbe380c0d10 0x7fbe38153fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:33674/0 (socket says 172.21.15.49:33674) 2023-11-30T17:07:30.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.407+0000 7fbe3ca64700 1 -- 172.21.15.49:0/2250048146 learned_addr learned my addr 172.21.15.49:0/2250048146 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:30.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.407+0000 7fbe3d265700 1 -- 172.21.15.49:0/2250048146 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe3806b510 msgr2=0x7fbe381546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:30.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.407+0000 7fbe3d265700 1 --2- 172.21.15.49:0/2250048146 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe3806b510 0x7fbe381546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:30.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.407+0000 7fbe3d265700 1 -- 172.21.15.49:0/2250048146 >> v1:172.21.15.115:6789/0 conn(0x7fbe380c0d10 legacy=0x7fbe38153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:30.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.407+0000 7fbe377fe700 1 -- 172.21.15.49:0/2250048146 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1267677446 0 0) 0x7fbe38063380 con 0x7fbe380c0d10 2023-11-30T17:07:30.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.407+0000 7fbe3d265700 1 -- 172.21.15.49:0/2250048146 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe38062770 con 0x7fbe380c10f0 2023-11-30T17:07:30.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.407+0000 7fbe37fff700 1 --2- 172.21.15.49:0/2250048146 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe3806b510 0x7fbe381546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:07:30.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.407+0000 7fbe3d265700 1 --2- 172.21.15.49:0/2250048146 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe380c10f0 0x7fbe38158b70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fbe20009760 tx=0x7fbe20009060).ready entity=mon.1 client_cookie=b835683913c8159e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:30.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.407+0000 7fbe377fe700 1 -- 172.21.15.49:0/2250048146 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2000f510 con 0x7fbe380c10f0 2023-11-30T17:07:30.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.408+0000 7fbe377fe700 1 -- 172.21.15.49:0/2250048146 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2000f670 con 0x7fbe380c10f0 2023-11-30T17:07:30.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.408+0000 7fbe377fe700 1 -- 172.21.15.49:0/2250048146 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2000f9f0 con 0x7fbe380c10f0 2023-11-30T17:07:30.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.408+0000 7fbe3ecc8700 1 -- 172.21.15.49:0/2250048146 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe380c10f0 msgr2=0x7fbe38158b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:30.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.408+0000 7fbe3ecc8700 1 --2- 172.21.15.49:0/2250048146 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe380c10f0 0x7fbe38158b70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fbe20009760 tx=0x7fbe20009060).stop 2023-11-30T17:07:30.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.408+0000 7fbe3ecc8700 1 -- 172.21.15.49:0/2250048146 shutdown_connections 2023-11-30T17:07:30.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.408+0000 7fbe3ecc8700 1 --2- 172.21.15.49:0/2250048146 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe380c10f0 0x7fbe38158b70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:30.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.408+0000 7fbe3ecc8700 1 --2- 172.21.15.49:0/2250048146 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe3806b510 0x7fbe381546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:30.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.408+0000 7fbe3ecc8700 1 -- 172.21.15.49:0/2250048146 >> 172.21.15.49:0/2250048146 conn(0x7fbe380c7760 msgr2=0x7fbe380c7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:30.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.408+0000 7fbe3ecc8700 1 -- 172.21.15.49:0/2250048146 shutdown_connections 2023-11-30T17:07:30.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.408+0000 7fbe3ecc8700 1 -- 172.21.15.49:0/2250048146 wait complete. 2023-11-30T17:07:30.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.409+0000 7fbe3ecc8700 1 Processor -- start 2023-11-30T17:07:30.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.409+0000 7fbe3ecc8700 1 -- start start 2023-11-30T17:07:30.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.410+0000 7fbe3ecc8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe3806b510 0x7fbe38147360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:30.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.410+0000 7fbe3ecc8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe380c0d10 0x7fbe380ab1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:30.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.410+0000 7fbe3ecc8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe380c10f0 0x7fbe38153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:30.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.410+0000 7fbe3ecc8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe380abb00 con 0x7fbe380c10f0 2023-11-30T17:07:30.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.410+0000 7fbe3ecc8700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe380abde0 con 0x7fbe380c0d10 2023-11-30T17:07:30.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.410+0000 7fbe3ecc8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe380ac0c0 con 0x7fbe3806b510 2023-11-30T17:07:30.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.410+0000 7fbe3d265700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe380c10f0 0x7fbe38153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:30.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.410+0000 7fbe3d265700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe380c10f0 0x7fbe38153db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59562/0 (socket says 172.21.15.49:59562) 2023-11-30T17:07:30.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.410+0000 7fbe3d265700 1 -- 172.21.15.49:0/1672965423 learned_addr learned my addr 172.21.15.49:0/1672965423 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:30.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.410+0000 7fbe37fff700 1 --2- 172.21.15.49:0/1672965423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe380c0d10 0x7fbe380ab1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:30.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.410+0000 7fbe3ca64700 1 --2- 172.21.15.49:0/1672965423 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe3806b510 0x7fbe38147360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:30.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.411+0000 7fbe3d265700 1 -- 172.21.15.49:0/1672965423 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe3806b510 msgr2=0x7fbe38147360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:30.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.411+0000 7fbe3d265700 1 --2- 172.21.15.49:0/1672965423 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe3806b510 0x7fbe38147360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:30.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.411+0000 7fbe3d265700 1 -- 172.21.15.49:0/1672965423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe380c0d10 msgr2=0x7fbe380ab1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:30.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.411+0000 7fbe3d265700 1 --2- 172.21.15.49:0/1672965423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe380c0d10 0x7fbe380ab1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:30.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.411+0000 7fbe3d265700 1 -- 172.21.15.49:0/1672965423 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe280092a0 con 0x7fbe380c10f0 2023-11-30T17:07:30.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.411+0000 7fbe37fff700 1 --2- 172.21.15.49:0/1672965423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe380c0d10 0x7fbe380ab1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:30.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.411+0000 7fbe3d265700 1 --2- 172.21.15.49:0/1672965423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe380c10f0 0x7fbe38153db0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fbe20009e00 tx=0x7fbe20017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:30.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.411+0000 7fbe34ff9700 1 -- 172.21.15.49:0/1672965423 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2000f9f0 con 0x7fbe380c10f0 2023-11-30T17:07:30.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.411+0000 7fbe34ff9700 1 -- 172.21.15.49:0/1672965423 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2001b410 con 0x7fbe380c10f0 2023-11-30T17:07:30.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.411+0000 7fbe3ecc8700 1 -- 172.21.15.49:0/1672965423 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe200092a0 con 0x7fbe380c10f0 2023-11-30T17:07:30.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.411+0000 7fbe34ff9700 1 -- 172.21.15.49:0/1672965423 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2001b7d0 con 0x7fbe380c10f0 2023-11-30T17:07:30.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.411+0000 7fbe3ecc8700 1 -- 172.21.15.49:0/1672965423 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe3814bbf0 con 0x7fbe380c10f0 2023-11-30T17:07:30.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.412+0000 7fbe3ecc8700 1 -- 172.21.15.49:0/1672965423 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe380ac560 con 0x7fbe380c10f0 2023-11-30T17:07:30.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.412+0000 7fbe34ff9700 1 -- 172.21.15.49:0/1672965423 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fbe2001bbc0 con 0x7fbe380c10f0 2023-11-30T17:07:30.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.412+0000 7fbe34ff9700 1 --2- 172.21.15.49:0/1672965423 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbe1805f150 0x7fbe18061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:30.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.413+0000 7fbe34ff9700 1 -- 172.21.15.49:0/1672965423 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbe2007be30 con 0x7fbe380c10f0 2023-11-30T17:07:30.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.413+0000 7fbe3ca64700 1 --2- 172.21.15.49:0/1672965423 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbe1805f150 0x7fbe18061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:30.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.413+0000 7fbe3ca64700 1 --2- 172.21.15.49:0/1672965423 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbe1805f150 0x7fbe18061610 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fbe30001560 tx=0x7fbe30009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:30.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.417+0000 7fbe34ff9700 1 -- 172.21.15.49:0/1672965423 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbe2004d1b0 con 0x7fbe380c10f0 2023-11-30T17:07:30.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.584+0000 7fbe3ecc8700 1 -- 172.21.15.49:0/1672965423 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbe380abf50 con 0x7fbe1805f150 2023-11-30T17:07:30.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.598+0000 7fbe34ff9700 1 -- 172.21.15.49:0/1672965423 <== mgr.4105 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336354 (secure 0 0 0) 0x7fbe380abf50 con 0x7fbe1805f150 2023-11-30T17:07:30.604 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:30.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.601+0000 7fbe3ecc8700 1 -- 172.21.15.49:0/1672965423 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbe1805f150 msgr2=0x7fbe18061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:30.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.601+0000 7fbe3ecc8700 1 --2- 172.21.15.49:0/1672965423 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbe1805f150 0x7fbe18061610 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fbe30001560 tx=0x7fbe30009040).stop 2023-11-30T17:07:30.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.601+0000 7fbe3ecc8700 1 -- 172.21.15.49:0/1672965423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe380c10f0 msgr2=0x7fbe38153db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:30.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.601+0000 7fbe3ecc8700 1 --2- 172.21.15.49:0/1672965423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe380c10f0 0x7fbe38153db0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fbe20009e00 tx=0x7fbe20017000).stop 2023-11-30T17:07:30.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.601+0000 7fbe3ecc8700 1 -- 172.21.15.49:0/1672965423 shutdown_connections 2023-11-30T17:07:30.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.601+0000 7fbe3ecc8700 1 --2- 172.21.15.49:0/1672965423 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbe1805f150 0x7fbe18061610 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:30.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.601+0000 7fbe3ecc8700 1 --2- 172.21.15.49:0/1672965423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe380c10f0 0x7fbe38153db0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:30.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.601+0000 7fbe3ecc8700 1 --2- 172.21.15.49:0/1672965423 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe3806b510 0x7fbe38147360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:30.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.601+0000 7fbe3ecc8700 1 --2- 172.21.15.49:0/1672965423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe380c0d10 0x7fbe380ab1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:30.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.601+0000 7fbe3ecc8700 1 -- 172.21.15.49:0/1672965423 >> 172.21.15.49:0/1672965423 conn(0x7fbe380c7760 msgr2=0x7fbe380c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:30.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.601+0000 7fbe3ecc8700 1 -- 172.21.15.49:0/1672965423 shutdown_connections 2023-11-30T17:07:30.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.601+0000 7fbe3ecc8700 1 -- 172.21.15.49:0/1672965423 wait complete. 2023-11-30T17:07:30.608 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:07:30.615 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-30T17:07:28.840963+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378624,"kb_used_data":1856,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596096,"statfs":{"total":773094113280,"available":770658402304,"internally_reserved":0,"allocated":1900544,"data_stored":687340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002453"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307566+0000","last_change":"2023-11-30T17:07:16.305288+0000","last_active":"2023-11-30T17:07:16.307566+0000","last_peered":"2023-11-30T17:07:16.307566+0000","last_clean":"2023-11-30T17:07:16.307566+0000","last_became_active":"2023-11-30T17:07:16.305010+0000","last_became_peered":"2023-11-30T17:07:16.305010+0000","last_unstale":"2023-11-30T17:07:16.307566+0000","last_undegraded":"2023-11-30T17:07:16.307566+0000","last_fullsized":"2023-11-30T17:07:16.307566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295268+0000","last_change":"2023-11-30T17:07:15.910158+0000","last_active":"2023-11-30T17:07:16.295268+0000","last_peered":"2023-11-30T17:07:16.295268+0000","last_clean":"2023-11-30T17:07:16.295268+0000","last_became_active":"2023-11-30T17:07:15.909808+0000","last_became_peered":"2023-11-30T17:07:15.909808+0000","last_unstale":"2023-11-30T17:07:16.295268+0000","last_undegraded":"2023-11-30T17:07:16.295268+0000","last_fullsized":"2023-11-30T17:07:16.295268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.309132+0000","last_change":"2023-11-30T17:07:16.303941+0000","last_active":"2023-11-30T17:07:16.309132+0000","last_peered":"2023-11-30T17:07:16.309132+0000","last_clean":"2023-11-30T17:07:16.309132+0000","last_became_active":"2023-11-30T17:07:16.303673+0000","last_became_peered":"2023-11-30T17:07:16.303673+0000","last_unstale":"2023-11-30T17:07:16.309132+0000","last_undegraded":"2023-11-30T17:07:16.309132+0000","last_fullsized":"2023-11-30T17:07:16.309132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.285551+0000","last_change":"2023-11-30T17:07:15.914251+0000","last_active":"2023-11-30T17:07:16.285551+0000","last_peered":"2023-11-30T17:07:16.285551+0000","last_clean":"2023-11-30T17:07:16.285551+0000","last_became_active":"2023-11-30T17:07:15.913954+0000","last_became_peered":"2023-11-30T17:07:15.913954+0000","last_unstale":"2023-11-30T17:07:16.285551+0000","last_undegraded":"2023-11-30T17:07:16.285551+0000","last_fullsized":"2023-11-30T17:07:16.285551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318395+0000","last_change":"2023-11-30T17:07:16.314266+0000","last_active":"2023-11-30T17:07:16.318395+0000","last_peered":"2023-11-30T17:07:16.318395+0000","last_clean":"2023-11-30T17:07:16.318395+0000","last_became_active":"2023-11-30T17:07:16.313990+0000","last_became_peered":"2023-11-30T17:07:16.313990+0000","last_unstale":"2023-11-30T17:07:16.318395+0000","last_undegraded":"2023-11-30T17:07:16.318395+0000","last_fullsized":"2023-11-30T17:07:16.318395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.294345+0000","last_change":"2023-11-30T17:07:15.911004+0000","last_active":"2023-11-30T17:07:16.294345+0000","last_peered":"2023-11-30T17:07:16.294345+0000","last_clean":"2023-11-30T17:07:16.294345+0000","last_became_active":"2023-11-30T17:07:15.910698+0000","last_became_peered":"2023-11-30T17:07:15.910698+0000","last_unstale":"2023-11-30T17:07:16.294345+0000","last_undegraded":"2023-11-30T17:07:16.294345+0000","last_fullsized":"2023-11-30T17:07:16.294345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.306911+0000","last_change":"2023-11-30T17:07:16.304718+0000","last_active":"2023-11-30T17:07:16.306911+0000","last_peered":"2023-11-30T17:07:16.306911+0000","last_clean":"2023-11-30T17:07:16.306911+0000","last_became_active":"2023-11-30T17:07:16.304311+0000","last_became_peered":"2023-11-30T17:07:16.304311+0000","last_unstale":"2023-11-30T17:07:16.306911+0000","last_undegraded":"2023-11-30T17:07:16.306911+0000","last_fullsized":"2023-11-30T17:07:16.306911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.289689+0000","last_change":"2023-11-30T17:07:15.905295+0000","last_active":"2023-11-30T17:07:16.289689+0000","last_peered":"2023-11-30T17:07:16.289689+0000","last_clean":"2023-11-30T17:07:16.289689+0000","last_became_active":"2023-11-30T17:07:15.904998+0000","last_became_peered":"2023-11-30T17:07:15.904998+0000","last_unstale":"2023-11-30T17:07:16.289689+0000","last_undegraded":"2023-11-30T17:07:16.289689+0000","last_fullsized":"2023-11-30T17:07:16.289689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308850+0000","last_change":"2023-11-30T17:07:16.307461+0000","last_active":"2023-11-30T17:07:16.308850+0000","last_peered":"2023-11-30T17:07:16.308850+0000","last_clean":"2023-11-30T17:07:16.308850+0000","last_became_active":"2023-11-30T17:07:16.307178+0000","last_became_peered":"2023-11-30T17:07:16.307178+0000","last_unstale":"2023-11-30T17:07:16.308850+0000","last_undegraded":"2023-11-30T17:07:16.308850+0000","last_fullsized":"2023-11-30T17:07:16.308850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.305220+0000","last_change":"2023-11-30T17:07:15.915224+0000","last_active":"2023-11-30T17:07:16.305220+0000","last_peered":"2023-11-30T17:07:16.305220+0000","last_clean":"2023-11-30T17:07:16.305220+0000","last_became_active":"2023-11-30T17:07:15.915001+0000","last_became_peered":"2023-11-30T17:07:15.915001+0000","last_unstale":"2023-11-30T17:07:16.305220+0000","last_undegraded":"2023-11-30T17:07:16.305220+0000","last_fullsized":"2023-11-30T17:07:16.305220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.310566+0000","last_change":"2023-11-30T17:07:16.302009+0000","last_active":"2023-11-30T17:07:16.310566+0000","last_peered":"2023-11-30T17:07:16.310566+0000","last_clean":"2023-11-30T17:07:16.310566+0000","last_became_active":"2023-11-30T17:07:16.301664+0000","last_became_peered":"2023-11-30T17:07:16.301664+0000","last_unstale":"2023-11-30T17:07:16.310566+0000","last_undegraded":"2023-11-30T17:07:16.310566+0000","last_fullsized":"2023-11-30T17:07:16.310566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308378+0000","last_change":"2023-11-30T17:07:15.919005+0000","last_active":"2023-11-30T17:07:16.308378+0000","last_peered":"2023-11-30T17:07:16.308378+0000","last_clean":"2023-11-30T17:07:16.308378+0000","last_became_active":"2023-11-30T17:07:15.918757+0000","last_became_peered":"2023-11-30T17:07:15.918757+0000","last_unstale":"2023-11-30T17:07:16.308378+0000","last_undegraded":"2023-11-30T17:07:16.308378+0000","last_fullsized":"2023-11-30T17:07:16.308378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.305107+0000","last_change":"2023-11-30T17:07:16.303563+0000","last_active":"2023-11-30T17:07:16.305107+0000","last_peered":"2023-11-30T17:07:16.305107+0000","last_clean":"2023-11-30T17:07:16.305107+0000","last_became_active":"2023-11-30T17:07:16.303281+0000","last_became_peered":"2023-11-30T17:07:16.303281+0000","last_unstale":"2023-11-30T17:07:16.305107+0000","last_undegraded":"2023-11-30T17:07:16.305107+0000","last_fullsized":"2023-11-30T17:07:16.305107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.311442+0000","last_change":"2023-11-30T17:07:15.912815+0000","last_active":"2023-11-30T17:07:16.311442+0000","last_peered":"2023-11-30T17:07:16.311442+0000","last_clean":"2023-11-30T17:07:16.311442+0000","last_became_active":"2023-11-30T17:07:15.912519+0000","last_became_peered":"2023-11-30T17:07:15.912519+0000","last_unstale":"2023-11-30T17:07:16.311442+0000","last_undegraded":"2023-11-30T17:07:16.311442+0000","last_fullsized":"2023-11-30T17:07:16.311442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.306264+0000","last_change":"2023-11-30T17:07:16.305070+0000","last_active":"2023-11-30T17:07:16.306264+0000","last_peered":"2023-11-30T17:07:16.306264+0000","last_clean":"2023-11-30T17:07:16.306264+0000","last_became_active":"2023-11-30T17:07:16.304769+0000","last_became_peered":"2023-11-30T17:07:16.304769+0000","last_unstale":"2023-11-30T17:07:16.306264+0000","last_undegraded":"2023-11-30T17:07:16.306264+0000","last_fullsized":"2023-11-30T17:07:16.306264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.305362+0000","last_change":"2023-11-30T17:07:15.911789+0000","last_active":"2023-11-30T17:07:16.305362+0000","last_peered":"2023-11-30T17:07:16.305362+0000","last_clean":"2023-11-30T17:07:16.305362+0000","last_became_active":"2023-11-30T17:07:15.911461+0000","last_became_peered":"2023-11-30T17:07:15.911461+0000","last_unstale":"2023-11-30T17:07:16.305362+0000","last_undegraded":"2023-11-30T17:07:16.305362+0000","last_fullsized":"2023-11-30T17:07:16.305362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.320053+0000","last_change":"2023-11-30T17:07:16.316309+0000","last_active":"2023-11-30T17:07:16.320053+0000","last_peered":"2023-11-30T17:07:16.320053+0000","last_clean":"2023-11-30T17:07:16.320053+0000","last_became_active":"2023-11-30T17:07:16.316010+0000","last_became_peered":"2023-11-30T17:07:16.316010+0000","last_unstale":"2023-11-30T17:07:16.320053+0000","last_undegraded":"2023-11-30T17:07:16.320053+0000","last_fullsized":"2023-11-30T17:07:16.320053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.288892+0000","last_change":"2023-11-30T17:07:15.914178+0000","last_active":"2023-11-30T17:07:16.288892+0000","last_peered":"2023-11-30T17:07:16.288892+0000","last_clean":"2023-11-30T17:07:16.288892+0000","last_became_active":"2023-11-30T17:07:15.913297+0000","last_became_peered":"2023-11-30T17:07:15.913297+0000","last_unstale":"2023-11-30T17:07:16.288892+0000","last_undegraded":"2023-11-30T17:07:16.288892+0000","last_fullsized":"2023-11-30T17:07:16.288892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.304041+0000","last_change":"2023-11-30T17:07:16.300572+0000","last_active":"2023-11-30T17:07:16.304041+0000","last_peered":"2023-11-30T17:07:16.304041+0000","last_clean":"2023-11-30T17:07:16.304041+0000","last_became_active":"2023-11-30T17:07:16.300298+0000","last_became_peered":"2023-11-30T17:07:16.300298+0000","last_unstale":"2023-11-30T17:07:16.304041+0000","last_undegraded":"2023-11-30T17:07:16.304041+0000","last_fullsized":"2023-11-30T17:07:16.304041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295495+0000","last_change":"2023-11-30T17:07:15.915272+0000","last_active":"2023-11-30T17:07:16.295495+0000","last_peered":"2023-11-30T17:07:16.295495+0000","last_clean":"2023-11-30T17:07:16.295495+0000","last_became_active":"2023-11-30T17:07:15.914832+0000","last_became_peered":"2023-11-30T17:07:15.914832+0000","last_unstale":"2023-11-30T17:07:16.295495+0000","last_undegraded":"2023-11-30T17:07:16.295495+0000","last_fullsized":"2023-11-30T17:07:16.295495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.313799+0000","last_change":"2023-11-30T17:07:16.311093+0000","last_active":"2023-11-30T17:07:16.313799+0000","last_peered":"2023-11-30T17:07:16.313799+0000","last_clean":"2023-11-30T17:07:16.313799+0000","last_became_active":"2023-11-30T17:07:16.310618+0000","last_became_peered":"2023-11-30T17:07:16.310618+0000","last_unstale":"2023-11-30T17:07:16.313799+0000","last_undegraded":"2023-11-30T17:07:16.313799+0000","last_fullsized":"2023-11-30T17:07:16.313799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.310314+0000","last_change":"2023-11-30T17:07:15.910300+0000","last_active":"2023-11-30T17:07:16.310314+0000","last_peered":"2023-11-30T17:07:16.310314+0000","last_clean":"2023-11-30T17:07:16.310314+0000","last_became_active":"2023-11-30T17:07:15.909476+0000","last_became_peered":"2023-11-30T17:07:15.909476+0000","last_unstale":"2023-11-30T17:07:16.310314+0000","last_undegraded":"2023-11-30T17:07:16.310314+0000","last_fullsized":"2023-11-30T17:07:16.310314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318565+0000","last_change":"2023-11-30T17:07:16.313453+0000","last_active":"2023-11-30T17:07:16.318565+0000","last_peered":"2023-11-30T17:07:16.318565+0000","last_clean":"2023-11-30T17:07:16.318565+0000","last_became_active":"2023-11-30T17:07:16.312874+0000","last_became_peered":"2023-11-30T17:07:16.312874+0000","last_unstale":"2023-11-30T17:07:16.318565+0000","last_undegraded":"2023-11-30T17:07:16.318565+0000","last_fullsized":"2023-11-30T17:07:16.318565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307366+0000","last_change":"2023-11-30T17:07:15.911874+0000","last_active":"2023-11-30T17:07:16.307366+0000","last_peered":"2023-11-30T17:07:16.307366+0000","last_clean":"2023-11-30T17:07:16.307366+0000","last_became_active":"2023-11-30T17:07:15.911404+0000","last_became_peered":"2023-11-30T17:07:15.911404+0000","last_unstale":"2023-11-30T17:07:16.307366+0000","last_undegraded":"2023-11-30T17:07:16.307366+0000","last_fullsized":"2023-11-30T17:07:16.307366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315251+0000","last_change":"2023-11-30T17:07:16.312859+0000","last_active":"2023-11-30T17:07:16.315251+0000","last_peered":"2023-11-30T17:07:16.315251+0000","last_clean":"2023-11-30T17:07:16.315251+0000","last_became_active":"2023-11-30T17:07:16.312514+0000","last_became_peered":"2023-11-30T17:07:16.312514+0000","last_unstale":"2023-11-30T17:07:16.315251+0000","last_undegraded":"2023-11-30T17:07:16.315251+0000","last_fullsized":"2023-11-30T17:07:16.315251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308003+0000","last_change":"2023-11-30T17:07:15.912336+0000","last_active":"2023-11-30T17:07:16.308003+0000","last_peered":"2023-11-30T17:07:16.308003+0000","last_clean":"2023-11-30T17:07:16.308003+0000","last_became_active":"2023-11-30T17:07:15.912069+0000","last_became_peered":"2023-11-30T17:07:15.912069+0000","last_unstale":"2023-11-30T17:07:16.308003+0000","last_undegraded":"2023-11-30T17:07:16.308003+0000","last_fullsized":"2023-11-30T17:07:16.308003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.305757+0000","last_change":"2023-11-30T17:07:16.300210+0000","last_active":"2023-11-30T17:07:16.305757+0000","last_peered":"2023-11-30T17:07:16.305757+0000","last_clean":"2023-11-30T17:07:16.305757+0000","last_became_active":"2023-11-30T17:07:16.298899+0000","last_became_peered":"2023-11-30T17:07:16.298899+0000","last_unstale":"2023-11-30T17:07:16.305757+0000","last_undegraded":"2023-11-30T17:07:16.305757+0000","last_fullsized":"2023-11-30T17:07:16.305757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295980+0000","last_change":"2023-11-30T17:07:15.917879+0000","last_active":"2023-11-30T17:07:16.295980+0000","last_peered":"2023-11-30T17:07:16.295980+0000","last_clean":"2023-11-30T17:07:16.295980+0000","last_became_active":"2023-11-30T17:07:15.917554+0000","last_became_peered":"2023-11-30T17:07:15.917554+0000","last_unstale":"2023-11-30T17:07:16.295980+0000","last_undegraded":"2023-11-30T17:07:16.295980+0000","last_fullsized":"2023-11-30T17:07:16.295980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307516+0000","last_change":"2023-11-30T17:07:16.303927+0000","last_active":"2023-11-30T17:07:16.307516+0000","last_peered":"2023-11-30T17:07:16.307516+0000","last_clean":"2023-11-30T17:07:16.307516+0000","last_became_active":"2023-11-30T17:07:16.303463+0000","last_became_peered":"2023-11-30T17:07:16.303463+0000","last_unstale":"2023-11-30T17:07:16.307516+0000","last_undegraded":"2023-11-30T17:07:16.307516+0000","last_fullsized":"2023-11-30T17:07:16.307516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.303300+0000","last_change":"2023-11-30T17:07:15.913512+0000","last_active":"2023-11-30T17:07:16.303300+0000","last_peered":"2023-11-30T17:07:16.303300+0000","last_clean":"2023-11-30T17:07:16.303300+0000","last_became_active":"2023-11-30T17:07:15.913268+0000","last_became_peered":"2023-11-30T17:07:15.913268+0000","last_unstale":"2023-11-30T17:07:16.303300+0000","last_undegraded":"2023-11-30T17:07:16.303300+0000","last_fullsized":"2023-11-30T17:07:16.303300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312201+0000","last_change":"2023-11-30T17:07:16.308161+0000","last_active":"2023-11-30T17:07:16.312201+0000","last_peered":"2023-11-30T17:07:16.312201+0000","last_clean":"2023-11-30T17:07:16.312201+0000","last_became_active":"2023-11-30T17:07:16.307884+0000","last_became_peered":"2023-11-30T17:07:16.307884+0000","last_unstale":"2023-11-30T17:07:16.312201+0000","last_undegraded":"2023-11-30T17:07:16.312201+0000","last_fullsized":"2023-11-30T17:07:16.312201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.306036+0000","last_change":"2023-11-30T17:07:15.910523+0000","last_active":"2023-11-30T17:07:16.306036+0000","last_peered":"2023-11-30T17:07:16.306036+0000","last_clean":"2023-11-30T17:07:16.306036+0000","last_became_active":"2023-11-30T17:07:15.910216+0000","last_became_peered":"2023-11-30T17:07:15.910216+0000","last_unstale":"2023-11-30T17:07:16.306036+0000","last_undegraded":"2023-11-30T17:07:16.306036+0000","last_fullsized":"2023-11-30T17:07:16.306036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315009+0000","last_change":"2023-11-30T17:07:16.311819+0000","last_active":"2023-11-30T17:07:16.315009+0000","last_peered":"2023-11-30T17:07:16.315009+0000","last_clean":"2023-11-30T17:07:16.315009+0000","last_became_active":"2023-11-30T17:07:16.311446+0000","last_became_peered":"2023-11-30T17:07:16.311446+0000","last_unstale":"2023-11-30T17:07:16.315009+0000","last_undegraded":"2023-11-30T17:07:16.315009+0000","last_fullsized":"2023-11-30T17:07:16.315009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.290739+0000","last_change":"2023-11-30T17:07:15.903463+0000","last_active":"2023-11-30T17:07:16.290739+0000","last_peered":"2023-11-30T17:07:16.290739+0000","last_clean":"2023-11-30T17:07:16.290739+0000","last_became_active":"2023-11-30T17:07:15.903169+0000","last_became_peered":"2023-11-30T17:07:15.903169+0000","last_unstale":"2023-11-30T17:07:16.290739+0000","last_undegraded":"2023-11-30T17:07:16.290739+0000","last_fullsized":"2023-11-30T17:07:16.290739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.304451+0000","last_change":"2023-11-30T17:07:16.301048+0000","last_active":"2023-11-30T17:07:16.304451+0000","last_peered":"2023-11-30T17:07:16.304451+0000","last_clean":"2023-11-30T17:07:16.304451+0000","last_became_active":"2023-11-30T17:07:16.300733+0000","last_became_peered":"2023-11-30T17:07:16.300733+0000","last_unstale":"2023-11-30T17:07:16.304451+0000","last_undegraded":"2023-11-30T17:07:16.304451+0000","last_fullsized":"2023-11-30T17:07:16.304451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.297265+0000","last_change":"2023-11-30T17:07:15.912479+0000","last_active":"2023-11-30T17:07:16.297265+0000","last_peered":"2023-11-30T17:07:16.297265+0000","last_clean":"2023-11-30T17:07:16.297265+0000","last_became_active":"2023-11-30T17:07:15.911715+0000","last_became_peered":"2023-11-30T17:07:15.911715+0000","last_unstale":"2023-11-30T17:07:16.297265+0000","last_undegraded":"2023-11-30T17:07:16.297265+0000","last_fullsized":"2023-11-30T17:07:16.297265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312756+0000","last_change":"2023-11-30T17:07:16.308823+0000","last_active":"2023-11-30T17:07:16.312756+0000","last_peered":"2023-11-30T17:07:16.312756+0000","last_clean":"2023-11-30T17:07:16.312756+0000","last_became_active":"2023-11-30T17:07:16.308607+0000","last_became_peered":"2023-11-30T17:07:16.308607+0000","last_unstale":"2023-11-30T17:07:16.312756+0000","last_undegraded":"2023-11-30T17:07:16.312756+0000","last_fullsized":"2023-11-30T17:07:16.312756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.294468+0000","last_change":"2023-11-30T17:07:15.907967+0000","last_active":"2023-11-30T17:07:16.294468+0000","last_peered":"2023-11-30T17:07:16.294468+0000","last_clean":"2023-11-30T17:07:16.294468+0000","last_became_active":"2023-11-30T17:07:15.907702+0000","last_became_peered":"2023-11-30T17:07:15.907702+0000","last_unstale":"2023-11-30T17:07:16.294468+0000","last_undegraded":"2023-11-30T17:07:16.294468+0000","last_fullsized":"2023-11-30T17:07:16.294468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.285836+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:07:16.285836+0000","last_peered":"2023-11-30T17:07:16.285836+0000","last_clean":"2023-11-30T17:07:16.285836+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:07:16.285836+0000","last_undegraded":"2023-11-30T17:07:16.285836+0000","last_fullsized":"2023-11-30T17:07:16.285836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307514+0000","last_change":"2023-11-30T17:07:15.918902+0000","last_active":"2023-11-30T17:07:16.307514+0000","last_peered":"2023-11-30T17:07:16.307514+0000","last_clean":"2023-11-30T17:07:16.307514+0000","last_became_active":"2023-11-30T17:07:15.918581+0000","last_became_peered":"2023-11-30T17:07:15.918581+0000","last_unstale":"2023-11-30T17:07:16.307514+0000","last_undegraded":"2023-11-30T17:07:16.307514+0000","last_fullsized":"2023-11-30T17:07:16.307514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315758+0000","last_change":"2023-11-30T17:07:16.314704+0000","last_active":"2023-11-30T17:07:16.315758+0000","last_peered":"2023-11-30T17:07:16.315758+0000","last_clean":"2023-11-30T17:07:16.315758+0000","last_became_active":"2023-11-30T17:07:16.314432+0000","last_became_peered":"2023-11-30T17:07:16.314432+0000","last_unstale":"2023-11-30T17:07:16.315758+0000","last_undegraded":"2023-11-30T17:07:16.315758+0000","last_fullsized":"2023-11-30T17:07:16.315758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308686+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:07:16.308686+0000","last_peered":"2023-11-30T17:07:16.308686+0000","last_clean":"2023-11-30T17:07:16.308686+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:07:16.308686+0000","last_undegraded":"2023-11-30T17:07:16.308686+0000","last_fullsized":"2023-11-30T17:07:16.308686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.294139+0000","last_change":"2023-11-30T17:07:15.911883+0000","last_active":"2023-11-30T17:07:16.294139+0000","last_peered":"2023-11-30T17:07:16.294139+0000","last_clean":"2023-11-30T17:07:16.294139+0000","last_became_active":"2023-11-30T17:07:15.911610+0000","last_became_peered":"2023-11-30T17:07:15.911610+0000","last_unstale":"2023-11-30T17:07:16.294139+0000","last_undegraded":"2023-11-30T17:07:16.294139+0000","last_fullsized":"2023-11-30T17:07:16.294139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312407+0000","last_change":"2023-11-30T17:07:16.303472+0000","last_active":"2023-11-30T17:07:16.312407+0000","last_peered":"2023-11-30T17:07:16.312407+0000","last_clean":"2023-11-30T17:07:16.312407+0000","last_became_active":"2023-11-30T17:07:16.302394+0000","last_became_peered":"2023-11-30T17:07:16.302394+0000","last_unstale":"2023-11-30T17:07:16.312407+0000","last_undegraded":"2023-11-30T17:07:16.312407+0000","last_fullsized":"2023-11-30T17:07:16.312407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315795+0000","last_change":"2023-11-30T17:07:16.314725+0000","last_active":"2023-11-30T17:07:16.315795+0000","last_peered":"2023-11-30T17:07:16.315795+0000","last_clean":"2023-11-30T17:07:16.315795+0000","last_became_active":"2023-11-30T17:07:16.314512+0000","last_became_peered":"2023-11-30T17:07:16.314512+0000","last_unstale":"2023-11-30T17:07:16.315795+0000","last_undegraded":"2023-11-30T17:07:16.315795+0000","last_fullsized":"2023-11-30T17:07:16.315795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.292666+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:07:16.292666+0000","last_peered":"2023-11-30T17:07:16.292666+0000","last_clean":"2023-11-30T17:07:16.292666+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:07:16.292666+0000","last_undegraded":"2023-11-30T17:07:16.292666+0000","last_fullsized":"2023-11-30T17:07:16.292666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.285572+0000","last_change":"2023-11-30T17:07:15.913075+0000","last_active":"2023-11-30T17:07:16.285572+0000","last_peered":"2023-11-30T17:07:16.285572+0000","last_clean":"2023-11-30T17:07:16.285572+0000","last_became_active":"2023-11-30T17:07:15.912781+0000","last_became_peered":"2023-11-30T17:07:15.912781+0000","last_unstale":"2023-11-30T17:07:16.285572+0000","last_undegraded":"2023-11-30T17:07:16.285572+0000","last_fullsized":"2023-11-30T17:07:16.285572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307120+0000","last_change":"2023-11-30T17:07:16.300272+0000","last_active":"2023-11-30T17:07:16.307120+0000","last_peered":"2023-11-30T17:07:16.307120+0000","last_clean":"2023-11-30T17:07:16.307120+0000","last_became_active":"2023-11-30T17:07:16.299930+0000","last_became_peered":"2023-11-30T17:07:16.299930+0000","last_unstale":"2023-11-30T17:07:16.307120+0000","last_undegraded":"2023-11-30T17:07:16.307120+0000","last_fullsized":"2023-11-30T17:07:16.307120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.301634+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:07:16.301634+0000","last_peered":"2023-11-30T17:07:16.301634+0000","last_clean":"2023-11-30T17:07:16.301634+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:07:16.301634+0000","last_undegraded":"2023-11-30T17:07:16.301634+0000","last_fullsized":"2023-11-30T17:07:16.301634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.293696+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:07:16.293696+0000","last_peered":"2023-11-30T17:07:16.293696+0000","last_clean":"2023-11-30T17:07:16.293696+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:07:16.293696+0000","last_undegraded":"2023-11-30T17:07:16.293696+0000","last_fullsized":"2023-11-30T17:07:16.293696+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295020+0000","last_change":"2023-11-30T17:07:15.906109+0000","last_active":"2023-11-30T17:07:16.295020+0000","last_peered":"2023-11-30T17:07:16.295020+0000","last_clean":"2023-11-30T17:07:16.295020+0000","last_became_active":"2023-11-30T17:07:15.905789+0000","last_became_peered":"2023-11-30T17:07:15.905789+0000","last_unstale":"2023-11-30T17:07:16.295020+0000","last_undegraded":"2023-11-30T17:07:16.295020+0000","last_fullsized":"2023-11-30T17:07:16.295020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.304020+0000","last_change":"2023-11-30T17:07:16.296058+0000","last_active":"2023-11-30T17:07:16.304020+0000","last_peered":"2023-11-30T17:07:16.304020+0000","last_clean":"2023-11-30T17:07:16.304020+0000","last_became_active":"2023-11-30T17:07:16.295800+0000","last_became_peered":"2023-11-30T17:07:16.295800+0000","last_unstale":"2023-11-30T17:07:16.304020+0000","last_undegraded":"2023-11-30T17:07:16.304020+0000","last_fullsized":"2023-11-30T17:07:16.304020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.294447+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:07:16.294447+0000","last_peered":"2023-11-30T17:07:16.294447+0000","last_clean":"2023-11-30T17:07:16.294447+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:07:16.294447+0000","last_undegraded":"2023-11-30T17:07:16.294447+0000","last_fullsized":"2023-11-30T17:07:16.294447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.289819+0000","last_change":"2023-11-30T17:07:15.908114+0000","last_active":"2023-11-30T17:07:16.289819+0000","last_peered":"2023-11-30T17:07:16.289819+0000","last_clean":"2023-11-30T17:07:16.289819+0000","last_became_active":"2023-11-30T17:07:15.907787+0000","last_became_peered":"2023-11-30T17:07:15.907787+0000","last_unstale":"2023-11-30T17:07:16.289819+0000","last_undegraded":"2023-11-30T17:07:16.289819+0000","last_fullsized":"2023-11-30T17:07:16.289819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295873+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:07:16.295873+0000","last_peered":"2023-11-30T17:07:16.295873+0000","last_clean":"2023-11-30T17:07:16.295873+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:07:16.295873+0000","last_undegraded":"2023-11-30T17:07:16.295873+0000","last_fullsized":"2023-11-30T17:07:16.295873+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.285991+0000","last_change":"2023-11-30T17:07:15.912233+0000","last_active":"2023-11-30T17:07:16.285991+0000","last_peered":"2023-11-30T17:07:16.285991+0000","last_clean":"2023-11-30T17:07:16.285991+0000","last_became_active":"2023-11-30T17:07:15.911944+0000","last_became_peered":"2023-11-30T17:07:15.911944+0000","last_unstale":"2023-11-30T17:07:16.285991+0000","last_undegraded":"2023-11-30T17:07:16.285991+0000","last_fullsized":"2023-11-30T17:07:16.285991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315990+0000","last_change":"2023-11-30T17:07:16.314967+0000","last_active":"2023-11-30T17:07:16.315990+0000","last_peered":"2023-11-30T17:07:16.315990+0000","last_clean":"2023-11-30T17:07:16.315990+0000","last_became_active":"2023-11-30T17:07:16.313860+0000","last_became_peered":"2023-11-30T17:07:16.313860+0000","last_unstale":"2023-11-30T17:07:16.315990+0000","last_undegraded":"2023-11-30T17:07:16.315990+0000","last_fullsized":"2023-11-30T17:07:16.315990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.311367+0000","last_change":"2023-11-30T17:07:15.918489+0000","last_active":"2023-11-30T17:07:16.311367+0000","last_peered":"2023-11-30T17:07:16.311367+0000","last_clean":"2023-11-30T17:07:16.311367+0000","last_became_active":"2023-11-30T17:07:15.918200+0000","last_became_peered":"2023-11-30T17:07:15.918200+0000","last_unstale":"2023-11-30T17:07:16.311367+0000","last_undegraded":"2023-11-30T17:07:16.311367+0000","last_fullsized":"2023-11-30T17:07:16.311367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.286349+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:07:16.286349+0000","last_peered":"2023-11-30T17:07:16.286349+0000","last_clean":"2023-11-30T17:07:16.286349+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:07:16.286349+0000","last_undegraded":"2023-11-30T17:07:16.286349+0000","last_fullsized":"2023-11-30T17:07:16.286349+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308858+0000","last_change":"2023-11-30T17:07:16.307511+0000","last_active":"2023-11-30T17:07:16.308858+0000","last_peered":"2023-11-30T17:07:16.308858+0000","last_clean":"2023-11-30T17:07:16.308858+0000","last_became_active":"2023-11-30T17:07:16.307230+0000","last_became_peered":"2023-11-30T17:07:16.307230+0000","last_unstale":"2023-11-30T17:07:16.308858+0000","last_undegraded":"2023-11-30T17:07:16.308858+0000","last_fullsized":"2023-11-30T17:07:16.308858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.291598+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:07:16.291598+0000","last_peered":"2023-11-30T17:07:16.291598+0000","last_clean":"2023-11-30T17:07:16.291598+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:07:16.291598+0000","last_undegraded":"2023-11-30T17:07:16.291598+0000","last_fullsized":"2023-11-30T17:07:16.291598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.289782+0000","last_change":"2023-11-30T17:07:15.908349+0000","last_active":"2023-11-30T17:07:16.289782+0000","last_peered":"2023-11-30T17:07:16.289782+0000","last_clean":"2023-11-30T17:07:16.289782+0000","last_became_active":"2023-11-30T17:07:15.908063+0000","last_became_peered":"2023-11-30T17:07:15.908063+0000","last_unstale":"2023-11-30T17:07:16.289782+0000","last_undegraded":"2023-11-30T17:07:16.289782+0000","last_fullsized":"2023-11-30T17:07:16.289782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315272+0000","last_change":"2023-11-30T17:07:16.314378+0000","last_active":"2023-11-30T17:07:16.315272+0000","last_peered":"2023-11-30T17:07:16.315272+0000","last_clean":"2023-11-30T17:07:16.315272+0000","last_became_active":"2023-11-30T17:07:16.314073+0000","last_became_peered":"2023-11-30T17:07:16.314073+0000","last_unstale":"2023-11-30T17:07:16.315272+0000","last_undegraded":"2023-11-30T17:07:16.315272+0000","last_fullsized":"2023-11-30T17:07:16.315272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.309505+0000","last_change":"2023-11-30T17:07:16.304420+0000","last_active":"2023-11-30T17:07:16.309505+0000","last_peered":"2023-11-30T17:07:16.309505+0000","last_clean":"2023-11-30T17:07:16.309505+0000","last_became_active":"2023-11-30T17:07:16.304065+0000","last_became_peered":"2023-11-30T17:07:16.304065+0000","last_unstale":"2023-11-30T17:07:16.309505+0000","last_undegraded":"2023-11-30T17:07:16.309505+0000","last_fullsized":"2023-11-30T17:07:16.309505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.291238+0000","last_change":"2023-11-30T17:07:15.905313+0000","last_active":"2023-11-30T17:07:16.291238+0000","last_peered":"2023-11-30T17:07:16.291238+0000","last_clean":"2023-11-30T17:07:16.291238+0000","last_became_active":"2023-11-30T17:07:15.905016+0000","last_became_peered":"2023-11-30T17:07:15.905016+0000","last_unstale":"2023-11-30T17:07:16.291238+0000","last_undegraded":"2023-11-30T17:07:16.291238+0000","last_fullsized":"2023-11-30T17:07:16.291238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312205+0000","last_change":"2023-11-30T17:07:16.308479+0000","last_active":"2023-11-30T17:07:16.312205+0000","last_peered":"2023-11-30T17:07:16.312205+0000","last_clean":"2023-11-30T17:07:16.312205+0000","last_became_active":"2023-11-30T17:07:16.307732+0000","last_became_peered":"2023-11-30T17:07:16.307732+0000","last_unstale":"2023-11-30T17:07:16.312205+0000","last_undegraded":"2023-11-30T17:07:16.312205+0000","last_fullsized":"2023-11-30T17:07:16.312205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.303391+0000","last_change":"2023-11-30T17:07:15.907619+0000","last_active":"2023-11-30T17:07:16.303391+0000","last_peered":"2023-11-30T17:07:16.303391+0000","last_clean":"2023-11-30T17:07:16.303391+0000","last_became_active":"2023-11-30T17:07:15.907322+0000","last_became_peered":"2023-11-30T17:07:15.907322+0000","last_unstale":"2023-11-30T17:07:16.303391+0000","last_undegraded":"2023-11-30T17:07:16.303391+0000","last_fullsized":"2023-11-30T17:07:16.303391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312237+0000","last_change":"2023-11-30T17:07:16.307668+0000","last_active":"2023-11-30T17:07:16.312237+0000","last_peered":"2023-11-30T17:07:16.312237+0000","last_clean":"2023-11-30T17:07:16.312237+0000","last_became_active":"2023-11-30T17:07:16.306226+0000","last_became_peered":"2023-11-30T17:07:16.306226+0000","last_unstale":"2023-11-30T17:07:16.312237+0000","last_undegraded":"2023-11-30T17:07:16.312237+0000","last_fullsized":"2023-11-30T17:07:16.312237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315804+0000","last_change":"2023-11-30T17:07:15.910485+0000","last_active":"2023-11-30T17:07:16.315804+0000","last_peered":"2023-11-30T17:07:16.315804+0000","last_clean":"2023-11-30T17:07:16.315804+0000","last_became_active":"2023-11-30T17:07:15.909426+0000","last_became_peered":"2023-11-30T17:07:15.909426+0000","last_unstale":"2023-11-30T17:07:16.315804+0000","last_undegraded":"2023-11-30T17:07:16.315804+0000","last_fullsized":"2023-11-30T17:07:16.315804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.314207+0000","last_change":"2023-11-30T17:07:16.308666+0000","last_active":"2023-11-30T17:07:16.314207+0000","last_peered":"2023-11-30T17:07:16.314207+0000","last_clean":"2023-11-30T17:07:16.314207+0000","last_became_active":"2023-11-30T17:07:16.308353+0000","last_became_peered":"2023-11-30T17:07:16.308353+0000","last_unstale":"2023-11-30T17:07:16.314207+0000","last_undegraded":"2023-11-30T17:07:16.314207+0000","last_fullsized":"2023-11-30T17:07:16.314207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.305835+0000","last_change":"2023-11-30T17:07:15.899895+0000","last_active":"2023-11-30T17:07:16.305835+0000","last_peered":"2023-11-30T17:07:16.305835+0000","last_clean":"2023-11-30T17:07:16.305835+0000","last_became_active":"2023-11-30T17:07:15.899595+0000","last_became_peered":"2023-11-30T17:07:15.899595+0000","last_unstale":"2023-11-30T17:07:16.305835+0000","last_undegraded":"2023-11-30T17:07:16.305835+0000","last_fullsized":"2023-11-30T17:07:16.305835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.304474+0000","last_change":"2023-11-30T17:07:16.301694+0000","last_active":"2023-11-30T17:07:16.304474+0000","last_peered":"2023-11-30T17:07:16.304474+0000","last_clean":"2023-11-30T17:07:16.304474+0000","last_became_active":"2023-11-30T17:07:16.301392+0000","last_became_peered":"2023-11-30T17:07:16.301392+0000","last_unstale":"2023-11-30T17:07:16.304474+0000","last_undegraded":"2023-11-30T17:07:16.304474+0000","last_fullsized":"2023-11-30T17:07:16.304474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.309919+0000","last_change":"2023-11-30T17:07:15.905807+0000","last_active":"2023-11-30T17:07:16.309919+0000","last_peered":"2023-11-30T17:07:16.309919+0000","last_clean":"2023-11-30T17:07:16.309919+0000","last_became_active":"2023-11-30T17:07:15.905509+0000","last_became_peered":"2023-11-30T17:07:15.905509+0000","last_unstale":"2023-11-30T17:07:16.309919+0000","last_undegraded":"2023-11-30T17:07:16.309919+0000","last_fullsized":"2023-11-30T17:07:16.309919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.310536+0000","last_change":"2023-11-30T17:07:16.301265+0000","last_active":"2023-11-30T17:07:16.310536+0000","last_peered":"2023-11-30T17:07:16.310536+0000","last_clean":"2023-11-30T17:07:16.310536+0000","last_became_active":"2023-11-30T17:07:16.300966+0000","last_became_peered":"2023-11-30T17:07:16.300966+0000","last_unstale":"2023-11-30T17:07:16.310536+0000","last_undegraded":"2023-11-30T17:07:16.310536+0000","last_fullsized":"2023-11-30T17:07:16.310536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.291444+0000","last_change":"2023-11-30T17:07:15.907348+0000","last_active":"2023-11-30T17:07:16.291444+0000","last_peered":"2023-11-30T17:07:16.291444+0000","last_clean":"2023-11-30T17:07:16.291444+0000","last_became_active":"2023-11-30T17:07:15.907034+0000","last_became_peered":"2023-11-30T17:07:15.907034+0000","last_unstale":"2023-11-30T17:07:16.291444+0000","last_undegraded":"2023-11-30T17:07:16.291444+0000","last_fullsized":"2023-11-30T17:07:16.291444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.310519+0000","last_change":"2023-11-30T17:07:16.302759+0000","last_active":"2023-11-30T17:07:16.310519+0000","last_peered":"2023-11-30T17:07:16.310519+0000","last_clean":"2023-11-30T17:07:16.310519+0000","last_became_active":"2023-11-30T17:07:16.302501+0000","last_became_peered":"2023-11-30T17:07:16.302501+0000","last_unstale":"2023-11-30T17:07:16.310519+0000","last_undegraded":"2023-11-30T17:07:16.310519+0000","last_fullsized":"2023-11-30T17:07:16.310519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.292697+0000","last_change":"2023-11-30T17:07:15.915794+0000","last_active":"2023-11-30T17:07:16.292697+0000","last_peered":"2023-11-30T17:07:16.292697+0000","last_clean":"2023-11-30T17:07:16.292697+0000","last_became_active":"2023-11-30T17:07:15.915469+0000","last_became_peered":"2023-11-30T17:07:15.915469+0000","last_unstale":"2023-11-30T17:07:16.292697+0000","last_undegraded":"2023-11-30T17:07:16.292697+0000","last_fullsized":"2023-11-30T17:07:16.292697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.320036+0000","last_change":"2023-11-30T17:07:16.316288+0000","last_active":"2023-11-30T17:07:16.320036+0000","last_peered":"2023-11-30T17:07:16.320036+0000","last_clean":"2023-11-30T17:07:16.320036+0000","last_became_active":"2023-11-30T17:07:16.315974+0000","last_became_peered":"2023-11-30T17:07:16.315974+0000","last_unstale":"2023-11-30T17:07:16.320036+0000","last_undegraded":"2023-11-30T17:07:16.320036+0000","last_fullsized":"2023-11-30T17:07:16.320036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308587+0000","last_change":"2023-11-30T17:07:15.918830+0000","last_active":"2023-11-30T17:07:16.308587+0000","last_peered":"2023-11-30T17:07:16.308587+0000","last_clean":"2023-11-30T17:07:16.308587+0000","last_became_active":"2023-11-30T17:07:15.918553+0000","last_became_peered":"2023-11-30T17:07:15.918553+0000","last_unstale":"2023-11-30T17:07:16.308587+0000","last_undegraded":"2023-11-30T17:07:16.308587+0000","last_fullsized":"2023-11-30T17:07:16.308587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312385+0000","last_change":"2023-11-30T17:07:16.300603+0000","last_active":"2023-11-30T17:07:16.312385+0000","last_peered":"2023-11-30T17:07:16.312385+0000","last_clean":"2023-11-30T17:07:16.312385+0000","last_became_active":"2023-11-30T17:07:16.297982+0000","last_became_peered":"2023-11-30T17:07:16.297982+0000","last_unstale":"2023-11-30T17:07:16.312385+0000","last_undegraded":"2023-11-30T17:07:16.312385+0000","last_fullsized":"2023-11-30T17:07:16.312385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.291351+0000","last_change":"2023-11-30T17:07:15.905698+0000","last_active":"2023-11-30T17:07:16.291351+0000","last_peered":"2023-11-30T17:07:16.291351+0000","last_clean":"2023-11-30T17:07:16.291351+0000","last_became_active":"2023-11-30T17:07:15.905364+0000","last_became_peered":"2023-11-30T17:07:15.905364+0000","last_unstale":"2023-11-30T17:07:16.291351+0000","last_undegraded":"2023-11-30T17:07:16.291351+0000","last_fullsized":"2023-11-30T17:07:16.291351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.314168+0000","last_change":"2023-11-30T17:07:16.310762+0000","last_active":"2023-11-30T17:07:16.314168+0000","last_peered":"2023-11-30T17:07:16.314168+0000","last_clean":"2023-11-30T17:07:16.314168+0000","last_became_active":"2023-11-30T17:07:16.310459+0000","last_became_peered":"2023-11-30T17:07:16.310459+0000","last_unstale":"2023-11-30T17:07:16.314168+0000","last_undegraded":"2023-11-30T17:07:16.314168+0000","last_fullsized":"2023-11-30T17:07:16.314168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.296049+0000","last_change":"2023-11-30T17:07:15.905922+0000","last_active":"2023-11-30T17:07:16.296049+0000","last_peered":"2023-11-30T17:07:16.296049+0000","last_clean":"2023-11-30T17:07:16.296049+0000","last_became_active":"2023-11-30T17:07:15.905607+0000","last_became_peered":"2023-11-30T17:07:15.905607+0000","last_unstale":"2023-11-30T17:07:16.296049+0000","last_undegraded":"2023-11-30T17:07:16.296049+0000","last_fullsized":"2023-11-30T17:07:16.296049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.314769+0000","last_change":"2023-11-30T17:07:16.310200+0000","last_active":"2023-11-30T17:07:16.314769+0000","last_peered":"2023-11-30T17:07:16.314769+0000","last_clean":"2023-11-30T17:07:16.314769+0000","last_became_active":"2023-11-30T17:07:16.309645+0000","last_became_peered":"2023-11-30T17:07:16.309645+0000","last_unstale":"2023-11-30T17:07:16.314769+0000","last_undegraded":"2023-11-30T17:07:16.314769+0000","last_fullsized":"2023-11-30T17:07:16.314769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.285637+0000","last_change":"2023-11-30T17:07:15.913510+0000","last_active":"2023-11-30T17:07:16.285637+0000","last_peered":"2023-11-30T17:07:16.285637+0000","last_clean":"2023-11-30T17:07:16.285637+0000","last_became_active":"2023-11-30T17:07:15.913195+0000","last_became_peered":"2023-11-30T17:07:15.913195+0000","last_unstale":"2023-11-30T17:07:16.285637+0000","last_undegraded":"2023-11-30T17:07:16.285637+0000","last_fullsized":"2023-11-30T17:07:16.285637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307638+0000","last_change":"2023-11-30T17:07:16.305749+0000","last_active":"2023-11-30T17:07:16.307638+0000","last_peered":"2023-11-30T17:07:16.307638+0000","last_clean":"2023-11-30T17:07:16.307638+0000","last_became_active":"2023-11-30T17:07:16.305460+0000","last_became_peered":"2023-11-30T17:07:16.305460+0000","last_unstale":"2023-11-30T17:07:16.307638+0000","last_undegraded":"2023-11-30T17:07:16.307638+0000","last_fullsized":"2023-11-30T17:07:16.307638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-30T17:07:17.291653+0000","last_change":"2023-11-30T17:07:15.915366+0000","last_active":"2023-11-30T17:07:17.291653+0000","last_peered":"2023-11-30T17:07:17.291653+0000","last_clean":"2023-11-30T17:07:17.291653+0000","last_became_active":"2023-11-30T17:07:15.915099+0000","last_became_peered":"2023-11-30T17:07:15.915099+0000","last_unstale":"2023-11-30T17:07:17.291653+0000","last_undegraded":"2023-11-30T17:07:17.291653+0000","last_fullsized":"2023-11-30T17:07:17.291653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.303911+0000","last_change":"2023-11-30T17:07:16.300223+0000","last_active":"2023-11-30T17:07:16.303911+0000","last_peered":"2023-11-30T17:07:16.303911+0000","last_clean":"2023-11-30T17:07:16.303911+0000","last_became_active":"2023-11-30T17:07:16.299885+0000","last_became_peered":"2023-11-30T17:07:16.299885+0000","last_unstale":"2023-11-30T17:07:16.303911+0000","last_undegraded":"2023-11-30T17:07:16.303911+0000","last_fullsized":"2023-11-30T17:07:16.303911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.298199+0000","last_change":"2023-11-30T17:07:15.912712+0000","last_active":"2023-11-30T17:07:16.298199+0000","last_peered":"2023-11-30T17:07:16.298199+0000","last_clean":"2023-11-30T17:07:16.298199+0000","last_became_active":"2023-11-30T17:07:15.912259+0000","last_became_peered":"2023-11-30T17:07:15.912259+0000","last_unstale":"2023-11-30T17:07:16.298199+0000","last_undegraded":"2023-11-30T17:07:16.298199+0000","last_fullsized":"2023-11-30T17:07:16.298199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.313787+0000","last_change":"2023-11-30T17:07:16.309299+0000","last_active":"2023-11-30T17:07:16.313787+0000","last_peered":"2023-11-30T17:07:16.313787+0000","last_clean":"2023-11-30T17:07:16.313787+0000","last_became_active":"2023-11-30T17:07:16.308844+0000","last_became_peered":"2023-11-30T17:07:16.308844+0000","last_unstale":"2023-11-30T17:07:16.313787+0000","last_undegraded":"2023-11-30T17:07:16.313787+0000","last_fullsized":"2023-11-30T17:07:16.313787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.298030+0000","last_change":"2023-11-30T17:07:15.920996+0000","last_active":"2023-11-30T17:07:16.298030+0000","last_peered":"2023-11-30T17:07:16.298030+0000","last_clean":"2023-11-30T17:07:16.298030+0000","last_became_active":"2023-11-30T17:07:15.920782+0000","last_became_peered":"2023-11-30T17:07:15.920782+0000","last_unstale":"2023-11-30T17:07:16.298030+0000","last_undegraded":"2023-11-30T17:07:16.298030+0000","last_fullsized":"2023-11-30T17:07:16.298030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307613+0000","last_change":"2023-11-30T17:07:16.304597+0000","last_active":"2023-11-30T17:07:16.307613+0000","last_peered":"2023-11-30T17:07:16.307613+0000","last_clean":"2023-11-30T17:07:16.307613+0000","last_became_active":"2023-11-30T17:07:16.304251+0000","last_became_peered":"2023-11-30T17:07:16.304251+0000","last_unstale":"2023-11-30T17:07:16.307613+0000","last_undegraded":"2023-11-30T17:07:16.307613+0000","last_fullsized":"2023-11-30T17:07:16.307613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.297402+0000","last_change":"2023-11-30T17:07:15.913299+0000","last_active":"2023-11-30T17:07:16.297402+0000","last_peered":"2023-11-30T17:07:16.297402+0000","last_clean":"2023-11-30T17:07:16.297402+0000","last_became_active":"2023-11-30T17:07:15.912978+0000","last_became_peered":"2023-11-30T17:07:15.912978+0000","last_unstale":"2023-11-30T17:07:16.297402+0000","last_undegraded":"2023-11-30T17:07:16.297402+0000","last_fullsized":"2023-11-30T17:07:16.297402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315291+0000","last_change":"2023-11-30T17:07:16.311213+0000","last_active":"2023-11-30T17:07:16.315291+0000","last_peered":"2023-11-30T17:07:16.315291+0000","last_clean":"2023-11-30T17:07:16.315291+0000","last_became_active":"2023-11-30T17:07:16.309590+0000","last_became_peered":"2023-11-30T17:07:16.309590+0000","last_unstale":"2023-11-30T17:07:16.315291+0000","last_undegraded":"2023-11-30T17:07:16.315291+0000","last_fullsized":"2023-11-30T17:07:16.315291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308744+0000","last_change":"2023-11-30T17:07:15.917988+0000","last_active":"2023-11-30T17:07:16.308744+0000","last_peered":"2023-11-30T17:07:16.308744+0000","last_clean":"2023-11-30T17:07:16.308744+0000","last_became_active":"2023-11-30T17:07:15.917715+0000","last_became_peered":"2023-11-30T17:07:15.917715+0000","last_unstale":"2023-11-30T17:07:16.308744+0000","last_undegraded":"2023-11-30T17:07:16.308744+0000","last_fullsized":"2023-11-30T17:07:16.308744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.309259+0000","last_change":"2023-11-30T17:07:16.305167+0000","last_active":"2023-11-30T17:07:16.309259+0000","last_peered":"2023-11-30T17:07:16.309259+0000","last_clean":"2023-11-30T17:07:16.309259+0000","last_became_active":"2023-11-30T17:07:16.304366+0000","last_became_peered":"2023-11-30T17:07:16.304366+0000","last_unstale":"2023-11-30T17:07:16.309259+0000","last_undegraded":"2023-11-30T17:07:16.309259+0000","last_fullsized":"2023-11-30T17:07:16.309259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.309634+0000","last_change":"2023-11-30T17:07:15.913349+0000","last_active":"2023-11-30T17:07:16.309634+0000","last_peered":"2023-11-30T17:07:16.309634+0000","last_clean":"2023-11-30T17:07:16.309634+0000","last_became_active":"2023-11-30T17:07:15.912819+0000","last_became_peered":"2023-11-30T17:07:15.912819+0000","last_unstale":"2023-11-30T17:07:16.309634+0000","last_undegraded":"2023-11-30T17:07:16.309634+0000","last_fullsized":"2023-11-30T17:07:16.309634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312387+0000","last_change":"2023-11-30T17:07:16.307878+0000","last_active":"2023-11-30T17:07:16.312387+0000","last_peered":"2023-11-30T17:07:16.312387+0000","last_clean":"2023-11-30T17:07:16.312387+0000","last_became_active":"2023-11-30T17:07:16.307596+0000","last_became_peered":"2023-11-30T17:07:16.307596+0000","last_unstale":"2023-11-30T17:07:16.312387+0000","last_undegraded":"2023-11-30T17:07:16.312387+0000","last_fullsized":"2023-11-30T17:07:16.312387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.289290+0000","last_change":"2023-11-30T17:07:15.905418+0000","last_active":"2023-11-30T17:07:16.289290+0000","last_peered":"2023-11-30T17:07:16.289290+0000","last_clean":"2023-11-30T17:07:16.289290+0000","last_became_active":"2023-11-30T17:07:15.905118+0000","last_became_peered":"2023-11-30T17:07:15.905118+0000","last_unstale":"2023-11-30T17:07:16.289290+0000","last_undegraded":"2023-11-30T17:07:16.289290+0000","last_fullsized":"2023-11-30T17:07:16.289290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295717+0000","last_change":"2023-11-30T17:07:16.294026+0000","last_active":"2023-11-30T17:07:16.295717+0000","last_peered":"2023-11-30T17:07:16.295717+0000","last_clean":"2023-11-30T17:07:16.295717+0000","last_became_active":"2023-11-30T17:07:16.293758+0000","last_became_peered":"2023-11-30T17:07:16.293758+0000","last_unstale":"2023-11-30T17:07:16.295717+0000","last_undegraded":"2023-11-30T17:07:16.295717+0000","last_fullsized":"2023-11-30T17:07:16.295717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.310234+0000","last_change":"2023-11-30T17:07:15.914406+0000","last_active":"2023-11-30T17:07:16.310234+0000","last_peered":"2023-11-30T17:07:16.310234+0000","last_clean":"2023-11-30T17:07:16.310234+0000","last_became_active":"2023-11-30T17:07:15.914121+0000","last_became_peered":"2023-11-30T17:07:15.914121+0000","last_unstale":"2023-11-30T17:07:16.310234+0000","last_undegraded":"2023-11-30T17:07:16.310234+0000","last_fullsized":"2023-11-30T17:07:16.310234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307697+0000","last_change":"2023-11-30T17:07:16.306238+0000","last_active":"2023-11-30T17:07:16.307697+0000","last_peered":"2023-11-30T17:07:16.307697+0000","last_clean":"2023-11-30T17:07:16.307697+0000","last_became_active":"2023-11-30T17:07:16.305963+0000","last_became_peered":"2023-11-30T17:07:16.305963+0000","last_unstale":"2023-11-30T17:07:16.307697+0000","last_undegraded":"2023-11-30T17:07:16.307697+0000","last_fullsized":"2023-11-30T17:07:16.307697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.293985+0000","last_change":"2023-11-30T17:07:15.909372+0000","last_active":"2023-11-30T17:07:16.293985+0000","last_peered":"2023-11-30T17:07:16.293985+0000","last_clean":"2023-11-30T17:07:16.293985+0000","last_became_active":"2023-11-30T17:07:15.909092+0000","last_became_peered":"2023-11-30T17:07:15.909092+0000","last_unstale":"2023-11-30T17:07:16.293985+0000","last_undegraded":"2023-11-30T17:07:16.293985+0000","last_fullsized":"2023-11-30T17:07:16.293985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.315497+0000","last_change":"2023-11-30T17:07:16.309056+0000","last_active":"2023-11-30T17:07:16.315497+0000","last_peered":"2023-11-30T17:07:16.315497+0000","last_clean":"2023-11-30T17:07:16.315497+0000","last_became_active":"2023-11-30T17:07:16.308728+0000","last_became_peered":"2023-11-30T17:07:16.308728+0000","last_unstale":"2023-11-30T17:07:16.315497+0000","last_undegraded":"2023-11-30T17:07:16.315497+0000","last_fullsized":"2023-11-30T17:07:16.315497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.306826+0000","last_change":"2023-11-30T17:07:15.914123+0000","last_active":"2023-11-30T17:07:16.306826+0000","last_peered":"2023-11-30T17:07:16.306826+0000","last_clean":"2023-11-30T17:07:16.306826+0000","last_became_active":"2023-11-30T17:07:15.913855+0000","last_became_peered":"2023-11-30T17:07:15.913855+0000","last_unstale":"2023-11-30T17:07:16.306826+0000","last_undegraded":"2023-11-30T17:07:16.306826+0000","last_fullsized":"2023-11-30T17:07:16.306826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.313763+0000","last_change":"2023-11-30T17:07:16.309110+0000","last_active":"2023-11-30T17:07:16.313763+0000","last_peered":"2023-11-30T17:07:16.313763+0000","last_clean":"2023-11-30T17:07:16.313763+0000","last_became_active":"2023-11-30T17:07:16.308500+0000","last_became_peered":"2023-11-30T17:07:16.308500+0000","last_unstale":"2023-11-30T17:07:16.313763+0000","last_undegraded":"2023-11-30T17:07:16.313763+0000","last_fullsized":"2023-11-30T17:07:16.313763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.313277+0000","last_change":"2023-11-30T17:07:15.909703+0000","last_active":"2023-11-30T17:07:16.313277+0000","last_peered":"2023-11-30T17:07:16.313277+0000","last_clean":"2023-11-30T17:07:16.313277+0000","last_became_active":"2023-11-30T17:07:15.909387+0000","last_became_peered":"2023-11-30T17:07:15.909387+0000","last_unstale":"2023-11-30T17:07:16.313277+0000","last_undegraded":"2023-11-30T17:07:16.313277+0000","last_fullsized":"2023-11-30T17:07:16.313277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318600+0000","last_change":"2023-11-30T17:07:16.314404+0000","last_active":"2023-11-30T17:07:16.318600+0000","last_peered":"2023-11-30T17:07:16.318600+0000","last_clean":"2023-11-30T17:07:16.318600+0000","last_became_active":"2023-11-30T17:07:16.314144+0000","last_became_peered":"2023-11-30T17:07:16.314144+0000","last_unstale":"2023-11-30T17:07:16.318600+0000","last_undegraded":"2023-11-30T17:07:16.318600+0000","last_fullsized":"2023-11-30T17:07:16.318600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.285577+0000","last_change":"2023-11-30T17:07:15.907074+0000","last_active":"2023-11-30T17:07:16.285577+0000","last_peered":"2023-11-30T17:07:16.285577+0000","last_clean":"2023-11-30T17:07:16.285577+0000","last_became_active":"2023-11-30T17:07:15.906537+0000","last_became_peered":"2023-11-30T17:07:15.906537+0000","last_unstale":"2023-11-30T17:07:16.285577+0000","last_undegraded":"2023-11-30T17:07:16.285577+0000","last_fullsized":"2023-11-30T17:07:16.285577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308169+0000","last_change":"2023-11-30T17:07:16.304623+0000","last_active":"2023-11-30T17:07:16.308169+0000","last_peered":"2023-11-30T17:07:16.308169+0000","last_clean":"2023-11-30T17:07:16.308169+0000","last_became_active":"2023-11-30T17:07:16.303986+0000","last_became_peered":"2023-11-30T17:07:16.303986+0000","last_unstale":"2023-11-30T17:07:16.308169+0000","last_undegraded":"2023-11-30T17:07:16.308169+0000","last_fullsized":"2023-11-30T17:07:16.308169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.288987+0000","last_change":"2023-11-30T17:07:15.905081+0000","last_active":"2023-11-30T17:07:16.288987+0000","last_peered":"2023-11-30T17:07:16.288987+0000","last_clean":"2023-11-30T17:07:16.288987+0000","last_became_active":"2023-11-30T17:07:15.903780+0000","last_became_peered":"2023-11-30T17:07:15.903780+0000","last_unstale":"2023-11-30T17:07:16.288987+0000","last_undegraded":"2023-11-30T17:07:16.288987+0000","last_fullsized":"2023-11-30T17:07:16.288987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.301942+0000","last_change":"2023-11-30T17:07:16.300473+0000","last_active":"2023-11-30T17:07:16.301942+0000","last_peered":"2023-11-30T17:07:16.301942+0000","last_clean":"2023-11-30T17:07:16.301942+0000","last_became_active":"2023-11-30T17:07:16.300201+0000","last_became_peered":"2023-11-30T17:07:16.300201+0000","last_unstale":"2023-11-30T17:07:16.301942+0000","last_undegraded":"2023-11-30T17:07:16.301942+0000","last_fullsized":"2023-11-30T17:07:16.301942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.306129+0000","last_change":"2023-11-30T17:07:15.903443+0000","last_active":"2023-11-30T17:07:16.306129+0000","last_peered":"2023-11-30T17:07:16.306129+0000","last_clean":"2023-11-30T17:07:16.306129+0000","last_became_active":"2023-11-30T17:07:15.902100+0000","last_became_peered":"2023-11-30T17:07:15.902100+0000","last_unstale":"2023-11-30T17:07:16.306129+0000","last_undegraded":"2023-11-30T17:07:16.306129+0000","last_fullsized":"2023-11-30T17:07:16.306129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.311052+0000","last_change":"2023-11-30T17:07:16.308777+0000","last_active":"2023-11-30T17:07:16.311052+0000","last_peered":"2023-11-30T17:07:16.311052+0000","last_clean":"2023-11-30T17:07:16.311052+0000","last_became_active":"2023-11-30T17:07:16.308488+0000","last_became_peered":"2023-11-30T17:07:16.308488+0000","last_unstale":"2023-11-30T17:07:16.311052+0000","last_undegraded":"2023-11-30T17:07:16.311052+0000","last_fullsized":"2023-11-30T17:07:16.311052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318584+0000","last_change":"2023-11-30T17:07:15.909022+0000","last_active":"2023-11-30T17:07:16.318584+0000","last_peered":"2023-11-30T17:07:16.318584+0000","last_clean":"2023-11-30T17:07:16.318584+0000","last_became_active":"2023-11-30T17:07:15.908674+0000","last_became_peered":"2023-11-30T17:07:15.908674+0000","last_unstale":"2023-11-30T17:07:16.318584+0000","last_undegraded":"2023-11-30T17:07:16.318584+0000","last_fullsized":"2023-11-30T17:07:16.318584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318514+0000","last_change":"2023-11-30T17:07:16.313527+0000","last_active":"2023-11-30T17:07:16.318514+0000","last_peered":"2023-11-30T17:07:16.318514+0000","last_clean":"2023-11-30T17:07:16.318514+0000","last_became_active":"2023-11-30T17:07:16.313199+0000","last_became_peered":"2023-11-30T17:07:16.313199+0000","last_unstale":"2023-11-30T17:07:16.318514+0000","last_undegraded":"2023-11-30T17:07:16.318514+0000","last_fullsized":"2023-11-30T17:07:16.318514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.288932+0000","last_change":"2023-11-30T17:07:15.914420+0000","last_active":"2023-11-30T17:07:16.288932+0000","last_peered":"2023-11-30T17:07:16.288932+0000","last_clean":"2023-11-30T17:07:16.288932+0000","last_became_active":"2023-11-30T17:07:15.914142+0000","last_became_peered":"2023-11-30T17:07:15.914142+0000","last_unstale":"2023-11-30T17:07:16.288932+0000","last_undegraded":"2023-11-30T17:07:16.288932+0000","last_fullsized":"2023-11-30T17:07:16.288932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308304+0000","last_change":"2023-11-30T17:07:16.305961+0000","last_active":"2023-11-30T17:07:16.308304+0000","last_peered":"2023-11-30T17:07:16.308304+0000","last_clean":"2023-11-30T17:07:16.308304+0000","last_became_active":"2023-11-30T17:07:16.305363+0000","last_became_peered":"2023-11-30T17:07:16.305363+0000","last_unstale":"2023-11-30T17:07:16.308304+0000","last_undegraded":"2023-11-30T17:07:16.308304+0000","last_fullsized":"2023-11-30T17:07:16.308304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.291553+0000","last_change":"2023-11-30T17:07:15.911255+0000","last_active":"2023-11-30T17:07:16.291553+0000","last_peered":"2023-11-30T17:07:16.291553+0000","last_clean":"2023-11-30T17:07:16.291553+0000","last_became_active":"2023-11-30T17:07:15.910945+0000","last_became_peered":"2023-11-30T17:07:15.910945+0000","last_unstale":"2023-11-30T17:07:16.291553+0000","last_undegraded":"2023-11-30T17:07:16.291553+0000","last_fullsized":"2023-11-30T17:07:16.291553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.314860+0000","last_change":"2023-11-30T17:07:16.310924+0000","last_active":"2023-11-30T17:07:16.314860+0000","last_peered":"2023-11-30T17:07:16.314860+0000","last_clean":"2023-11-30T17:07:16.314860+0000","last_became_active":"2023-11-30T17:07:16.310631+0000","last_became_peered":"2023-11-30T17:07:16.310631+0000","last_unstale":"2023-11-30T17:07:16.314860+0000","last_undegraded":"2023-11-30T17:07:16.314860+0000","last_fullsized":"2023-11-30T17:07:16.314860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.297213+0000","last_change":"2023-11-30T17:07:15.917972+0000","last_active":"2023-11-30T17:07:16.297213+0000","last_peered":"2023-11-30T17:07:16.297213+0000","last_clean":"2023-11-30T17:07:16.297213+0000","last_became_active":"2023-11-30T17:07:15.917546+0000","last_became_peered":"2023-11-30T17:07:15.917546+0000","last_unstale":"2023-11-30T17:07:16.297213+0000","last_undegraded":"2023-11-30T17:07:16.297213+0000","last_fullsized":"2023-11-30T17:07:16.297213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.311505+0000","last_change":"2023-11-30T17:07:16.309537+0000","last_active":"2023-11-30T17:07:16.311505+0000","last_peered":"2023-11-30T17:07:16.311505+0000","last_clean":"2023-11-30T17:07:16.311505+0000","last_became_active":"2023-11-30T17:07:16.309220+0000","last_became_peered":"2023-11-30T17:07:16.309220+0000","last_unstale":"2023-11-30T17:07:16.311505+0000","last_undegraded":"2023-11-30T17:07:16.311505+0000","last_fullsized":"2023-11-30T17:07:16.311505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.294800+0000","last_change":"2023-11-30T17:07:15.913708+0000","last_active":"2023-11-30T17:07:16.294800+0000","last_peered":"2023-11-30T17:07:16.294800+0000","last_clean":"2023-11-30T17:07:16.294800+0000","last_became_active":"2023-11-30T17:07:15.913418+0000","last_became_peered":"2023-11-30T17:07:15.913418+0000","last_unstale":"2023-11-30T17:07:16.294800+0000","last_undegraded":"2023-11-30T17:07:16.294800+0000","last_fullsized":"2023-11-30T17:07:16.294800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318618+0000","last_change":"2023-11-30T17:07:16.314589+0000","last_active":"2023-11-30T17:07:16.318618+0000","last_peered":"2023-11-30T17:07:16.318618+0000","last_clean":"2023-11-30T17:07:16.318618+0000","last_became_active":"2023-11-30T17:07:16.313770+0000","last_became_peered":"2023-11-30T17:07:16.313770+0000","last_unstale":"2023-11-30T17:07:16.318618+0000","last_undegraded":"2023-11-30T17:07:16.318618+0000","last_fullsized":"2023-11-30T17:07:16.318618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.295850+0000","last_change":"2023-11-30T17:07:15.914471+0000","last_active":"2023-11-30T17:07:16.295850+0000","last_peered":"2023-11-30T17:07:16.295850+0000","last_clean":"2023-11-30T17:07:16.295850+0000","last_became_active":"2023-11-30T17:07:15.914170+0000","last_became_peered":"2023-11-30T17:07:15.914170+0000","last_unstale":"2023-11-30T17:07:16.295850+0000","last_undegraded":"2023-11-30T17:07:16.295850+0000","last_fullsized":"2023-11-30T17:07:16.295850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.314949+0000","last_change":"2023-11-30T17:07:16.309802+0000","last_active":"2023-11-30T17:07:16.314949+0000","last_peered":"2023-11-30T17:07:16.314949+0000","last_clean":"2023-11-30T17:07:16.314949+0000","last_became_active":"2023-11-30T17:07:16.309499+0000","last_became_peered":"2023-11-30T17:07:16.309499+0000","last_unstale":"2023-11-30T17:07:16.314949+0000","last_undegraded":"2023-11-30T17:07:16.314949+0000","last_fullsized":"2023-11-30T17:07:16.314949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.313989+0000","last_change":"2023-11-30T17:07:15.909306+0000","last_active":"2023-11-30T17:07:16.313989+0000","last_peered":"2023-11-30T17:07:16.313989+0000","last_clean":"2023-11-30T17:07:16.313989+0000","last_became_active":"2023-11-30T17:07:15.909030+0000","last_became_peered":"2023-11-30T17:07:15.909030+0000","last_unstale":"2023-11-30T17:07:16.313989+0000","last_undegraded":"2023-11-30T17:07:16.313989+0000","last_fullsized":"2023-11-30T17:07:16.313989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.307156+0000","last_change":"2023-11-30T17:07:16.303384+0000","last_active":"2023-11-30T17:07:16.307156+0000","last_peered":"2023-11-30T17:07:16.307156+0000","last_clean":"2023-11-30T17:07:16.307156+0000","last_became_active":"2023-11-30T17:07:16.298413+0000","last_became_peered":"2023-11-30T17:07:16.298413+0000","last_unstale":"2023-11-30T17:07:16.307156+0000","last_undegraded":"2023-11-30T17:07:16.307156+0000","last_fullsized":"2023-11-30T17:07:16.307156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.305248+0000","last_change":"2023-11-30T17:07:15.914690+0000","last_active":"2023-11-30T17:07:16.305248+0000","last_peered":"2023-11-30T17:07:16.305248+0000","last_clean":"2023-11-30T17:07:16.305248+0000","last_became_active":"2023-11-30T17:07:15.914405+0000","last_became_peered":"2023-11-30T17:07:15.914405+0000","last_unstale":"2023-11-30T17:07:16.305248+0000","last_undegraded":"2023-11-30T17:07:16.305248+0000","last_fullsized":"2023-11-30T17:07:16.305248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.310006+0000","last_change":"2023-11-30T17:07:16.306951+0000","last_active":"2023-11-30T17:07:16.310006+0000","last_peered":"2023-11-30T17:07:16.310006+0000","last_clean":"2023-11-30T17:07:16.310006+0000","last_became_active":"2023-11-30T17:07:16.306691+0000","last_became_peered":"2023-11-30T17:07:16.306691+0000","last_unstale":"2023-11-30T17:07:16.310006+0000","last_undegraded":"2023-11-30T17:07:16.310006+0000","last_fullsized":"2023-11-30T17:07:16.310006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.312888+0000","last_change":"2023-11-30T17:07:15.913637+0000","last_active":"2023-11-30T17:07:16.312888+0000","last_peered":"2023-11-30T17:07:16.312888+0000","last_clean":"2023-11-30T17:07:16.312888+0000","last_became_active":"2023-11-30T17:07:15.913336+0000","last_became_peered":"2023-11-30T17:07:15.913336+0000","last_unstale":"2023-11-30T17:07:16.312888+0000","last_undegraded":"2023-11-30T17:07:16.312888+0000","last_fullsized":"2023-11-30T17:07:16.312888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.314791+0000","last_change":"2023-11-30T17:07:16.310337+0000","last_active":"2023-11-30T17:07:16.314791+0000","last_peered":"2023-11-30T17:07:16.314791+0000","last_clean":"2023-11-30T17:07:16.314791+0000","last_became_active":"2023-11-30T17:07:16.310010+0000","last_became_peered":"2023-11-30T17:07:16.310010+0000","last_unstale":"2023-11-30T17:07:16.314791+0000","last_undegraded":"2023-11-30T17:07:16.314791+0000","last_fullsized":"2023-11-30T17:07:16.314791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.290031+0000","last_change":"2023-11-30T17:07:15.912918+0000","last_active":"2023-11-30T17:07:16.290031+0000","last_peered":"2023-11-30T17:07:16.290031+0000","last_clean":"2023-11-30T17:07:16.290031+0000","last_became_active":"2023-11-30T17:07:15.912624+0000","last_became_peered":"2023-11-30T17:07:15.912624+0000","last_unstale":"2023-11-30T17:07:16.290031+0000","last_undegraded":"2023-11-30T17:07:16.290031+0000","last_fullsized":"2023-11-30T17:07:16.290031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.308325+0000","last_change":"2023-11-30T17:07:16.306137+0000","last_active":"2023-11-30T17:07:16.308325+0000","last_peered":"2023-11-30T17:07:16.308325+0000","last_clean":"2023-11-30T17:07:16.308325+0000","last_became_active":"2023-11-30T17:07:16.305673+0000","last_became_peered":"2023-11-30T17:07:16.305673+0000","last_unstale":"2023-11-30T17:07:16.308325+0000","last_undegraded":"2023-11-30T17:07:16.308325+0000","last_fullsized":"2023-11-30T17:07:16.308325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.286516+0000","last_change":"2023-11-30T17:07:15.912021+0000","last_active":"2023-11-30T17:07:16.286516+0000","last_peered":"2023-11-30T17:07:16.286516+0000","last_clean":"2023-11-30T17:07:16.286516+0000","last_became_active":"2023-11-30T17:07:15.911720+0000","last_became_peered":"2023-11-30T17:07:15.911720+0000","last_unstale":"2023-11-30T17:07:16.286516+0000","last_undegraded":"2023-11-30T17:07:16.286516+0000","last_fullsized":"2023-11-30T17:07:16.286516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.318594+0000","last_change":"2023-11-30T17:07:16.313578+0000","last_active":"2023-11-30T17:07:16.318594+0000","last_peered":"2023-11-30T17:07:16.318594+0000","last_clean":"2023-11-30T17:07:16.318594+0000","last_became_active":"2023-11-30T17:07:16.313325+0000","last_became_peered":"2023-11-30T17:07:16.313325+0000","last_unstale":"2023-11-30T17:07:16.318594+0000","last_undegraded":"2023-11-30T17:07:16.318594+0000","last_fullsized":"2023-11-30T17:07:16.318594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:15.884305+0000","last_clean_scrub_stamp":"2023-11-30T17:07:15.884305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-30T17:07:16.311197+0000","last_change":"2023-11-30T17:07:15.908770+0000","last_active":"2023-11-30T17:07:16.311197+0000","last_peered":"2023-11-30T17:07:16.311197+0000","last_clean":"2023-11-30T17:07:16.311197+0000","last_became_active":"2023-11-30T17:07:15.908480+0000","last_became_peered":"2023-11-30T17:07:15.908480+0000","last_unstale":"2023-11-30T17:07:16.311197+0000","last_undegraded":"2023-11-30T17:07:16.311197+0000","last_fullsized":"2023-11-30T17:07:16.311197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:14.878326+0000","last_clean_scrub_stamp":"2023-11-30T17:07:14.878326+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297348,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074492,"statfs":{"total":96636764160,"available":96332279808,"internally_reserved":0,"allocated":258048,"data_stored":86755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":86787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297340,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074500,"statfs":{"total":96636764160,"available":96332288000,"internally_reserved":0,"allocated":249856,"data_stored":86933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:07:30.620 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-30T17:07:30.621 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-30T17:07:30.621 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-30T17:07:30.621 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-30T17:07:30.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.769+0000 7f4a162ab700 1 Processor -- start 2023-11-30T17:07:30.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.769+0000 7f4a162ab700 1 -- start start 2023-11-30T17:07:30.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.770+0000 7f4a162ab700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4a10157a40 0x7f4a100648d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:30.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.770+0000 7f4a162ab700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a100c12c0 con 0x7f4a10157660 2023-11-30T17:07:30.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.770+0000 7f4a162ab700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a100c06b0 con 0x7f4a100c0180 2023-11-30T17:07:30.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.770+0000 7f4a162ab700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a100c0990 con 0x7f4a10157a40 2023-11-30T17:07:30.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.770+0000 7f4a152a9700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4a10157660 0x7f4a101589c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40650/0 (socket says 172.21.15.49:40650) 2023-11-30T17:07:30.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.770+0000 7f4a152a9700 1 -- 172.21.15.49:0/111606810 learned_addr learned my addr 172.21.15.49:0/111606810 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:30.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.770+0000 7f4a15aaa700 1 --2- 172.21.15.49:0/111606810 >> v2:172.21.15.115:3300/0 conn(0x7f4a10157a40 0x7f4a100648d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:30.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.770+0000 7f4a0ffff700 1 -- 172.21.15.49:0/111606810 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1156337511 0 0) 0x7f4a100c12c0 con 0x7f4a10157660 2023-11-30T17:07:30.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.770+0000 7f4a0ffff700 1 -- 172.21.15.49:0/111606810 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49f80033f0 con 0x7f4a10157660 2023-11-30T17:07:30.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.770+0000 7f4a15aaa700 1 -- 172.21.15.49:0/111606810 >> v1:172.21.15.115:6789/0 conn(0x7f4a100c0180 legacy=0x7f4a100c1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:30.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.770+0000 7f4a0ffff700 1 -- 172.21.15.49:0/111606810 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 780346848 0 0) 0x7f49f80033f0 con 0x7f4a10157660 2023-11-30T17:07:30.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.770+0000 7f4a15aaa700 1 -- 172.21.15.49:0/111606810 >> v1:172.21.15.49:6789/0 conn(0x7f4a10157660 legacy=0x7f4a101589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:30.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.770+0000 7f4a15aaa700 1 -- 172.21.15.49:0/111606810 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a100c0c70 con 0x7f4a10157a40 2023-11-30T17:07:30.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.771+0000 7f4a15aaa700 1 --2- 172.21.15.49:0/111606810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a10157a40 0x7f4a100648d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f4a00009760 tx=0x7f4a00009060).ready entity=mon.1 client_cookie=3c85c2cff15b8181 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:30.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.771+0000 7f4a0ffff700 1 -- 172.21.15.49:0/111606810 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a08001470 con 0x7f4a10157a40 2023-11-30T17:07:30.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.771+0000 7f4a0ffff700 1 -- 172.21.15.49:0/111606810 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a00011400 con 0x7f4a10157a40 2023-11-30T17:07:30.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.771+0000 7f4a0ffff700 1 -- 172.21.15.49:0/111606810 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a00011780 con 0x7f4a10157a40 2023-11-30T17:07:30.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.771+0000 7f4a162ab700 1 -- 172.21.15.49:0/111606810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a10157a40 msgr2=0x7f4a100648d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:30.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.771+0000 7f4a162ab700 1 --2- 172.21.15.49:0/111606810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a10157a40 0x7f4a100648d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f4a00009760 tx=0x7f4a00009060).stop 2023-11-30T17:07:30.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.771+0000 7f4a162ab700 1 -- 172.21.15.49:0/111606810 shutdown_connections 2023-11-30T17:07:30.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.771+0000 7f4a162ab700 1 --2- 172.21.15.49:0/111606810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a10157a40 0x7f4a100648d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:30.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.771+0000 7f4a162ab700 1 -- 172.21.15.49:0/111606810 >> 172.21.15.49:0/111606810 conn(0x7f4a100cb000 msgr2=0x7f4a100cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:30.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.771+0000 7f4a162ab700 1 -- 172.21.15.49:0/111606810 shutdown_connections 2023-11-30T17:07:30.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.771+0000 7f4a162ab700 1 -- 172.21.15.49:0/111606810 wait complete. 2023-11-30T17:07:30.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.773+0000 7f4a162ab700 1 Processor -- start 2023-11-30T17:07:30.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.773+0000 7f4a162ab700 1 -- start start 2023-11-30T17:07:30.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.773+0000 7f4a162ab700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a100c0180 0x7f4a10151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:30.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.773+0000 7f4a162ab700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a10157660 0x7f4a10166f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:30.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.773+0000 7f4a162ab700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a10157a40 0x7f4a100ac9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:30.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.773+0000 7f4a162ab700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a101661d0 con 0x7f4a10157a40 2023-11-30T17:07:30.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.773+0000 7f4a162ab700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a101664b0 con 0x7f4a100c0180 2023-11-30T17:07:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.773+0000 7f4a162ab700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a10166790 con 0x7f4a10157660 2023-11-30T17:07:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.774+0000 7f4a15aaa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a10157a40 0x7f4a100ac9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.774+0000 7f4a15aaa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a10157a40 0x7f4a100ac9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37964/0 (socket says 172.21.15.49:37964) 2023-11-30T17:07:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.774+0000 7f4a15aaa700 1 -- 172.21.15.49:0/4047466468 learned_addr learned my addr 172.21.15.49:0/4047466468 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.774+0000 7f4a152a9700 1 --2- 172.21.15.49:0/4047466468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a100c0180 0x7f4a10151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.774+0000 7f4a14aa8700 1 --2- 172.21.15.49:0/4047466468 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a10157660 0x7f4a10166f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.774+0000 7f4a15aaa700 1 -- 172.21.15.49:0/4047466468 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a10157660 msgr2=0x7f4a10166f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.774+0000 7f4a15aaa700 1 --2- 172.21.15.49:0/4047466468 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a10157660 0x7f4a10166f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.774+0000 7f4a15aaa700 1 -- 172.21.15.49:0/4047466468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a100c0180 msgr2=0x7f4a10151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.774+0000 7f4a15aaa700 1 --2- 172.21.15.49:0/4047466468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a100c0180 0x7f4a10151690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.774+0000 7f4a15aaa700 1 -- 172.21.15.49:0/4047466468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a000092a0 con 0x7f4a10157a40 2023-11-30T17:07:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.774+0000 7f4a152a9700 1 --2- 172.21.15.49:0/4047466468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a100c0180 0x7f4a10151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.774+0000 7f4a15aaa700 1 --2- 172.21.15.49:0/4047466468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a10157a40 0x7f4a100ac9a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f4a00009e00 tx=0x7f4a00014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.774+0000 7f4a0d7fa700 1 -- 172.21.15.49:0/4047466468 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a00010c30 con 0x7f4a10157a40 2023-11-30T17:07:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.774+0000 7f4a0d7fa700 1 -- 172.21.15.49:0/4047466468 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a00010d90 con 0x7f4a10157a40 2023-11-30T17:07:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.774+0000 7f4a162ab700 1 -- 172.21.15.49:0/4047466468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a10166a70 con 0x7f4a10157a40 2023-11-30T17:07:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.774+0000 7f4a0d7fa700 1 -- 172.21.15.49:0/4047466468 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0001d680 con 0x7f4a10157a40 2023-11-30T17:07:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.774+0000 7f4a162ab700 1 -- 172.21.15.49:0/4047466468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1013d910 con 0x7f4a10157a40 2023-11-30T17:07:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.775+0000 7f4a162ab700 1 -- 172.21.15.49:0/4047466468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a10166c30 con 0x7f4a10157a40 2023-11-30T17:07:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.775+0000 7f4a0d7fa700 1 -- 172.21.15.49:0/4047466468 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4a0001dab0 con 0x7f4a10157a40 2023-11-30T17:07:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.776+0000 7f4a0d7fa700 1 --2- 172.21.15.49:0/4047466468 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f49fc05f150 0x7f49fc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.776+0000 7f4a0d7fa700 1 -- 172.21.15.49:0/4047466468 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4a0007b8e0 con 0x7f4a10157a40 2023-11-30T17:07:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.776+0000 7f4a152a9700 1 --2- 172.21.15.49:0/4047466468 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f49fc05f150 0x7f49fc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.776+0000 7f4a152a9700 1 --2- 172.21.15.49:0/4047466468 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f49fc05f150 0x7f49fc061610 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f4a08001ed0 tx=0x7f4a08000bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:30.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.780+0000 7f4a0d7fa700 1 -- 172.21.15.49:0/4047466468 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4a0004cbb0 con 0x7f4a10157a40 2023-11-30T17:07:30.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.991+0000 7f4a162ab700 1 -- 172.21.15.49:0/4047466468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4a1006c7c0 con 0x7f4a10157a40 2023-11-30T17:07:30.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.992+0000 7f4a0d7fa700 1 -- 172.21.15.49:0/4047466468 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f4a00016020 con 0x7f4a10157a40 2023-11-30T17:07:30.994 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:30.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.993+0000 7f4a162ab700 1 -- 172.21.15.49:0/4047466468 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f49fc05f150 msgr2=0x7f49fc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:30.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.993+0000 7f4a162ab700 1 --2- 172.21.15.49:0/4047466468 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f49fc05f150 0x7f49fc061610 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f4a08001ed0 tx=0x7f4a08000bc0).stop 2023-11-30T17:07:30.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.993+0000 7f4a162ab700 1 -- 172.21.15.49:0/4047466468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a10157a40 msgr2=0x7f4a100ac9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:30.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.993+0000 7f4a162ab700 1 --2- 172.21.15.49:0/4047466468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a10157a40 0x7f4a100ac9a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f4a00009e00 tx=0x7f4a00014000).stop 2023-11-30T17:07:30.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.993+0000 7f4a162ab700 1 -- 172.21.15.49:0/4047466468 shutdown_connections 2023-11-30T17:07:30.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.993+0000 7f4a162ab700 1 --2- 172.21.15.49:0/4047466468 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f49fc05f150 0x7f49fc061610 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:30.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.993+0000 7f4a162ab700 1 --2- 172.21.15.49:0/4047466468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a10157a40 0x7f4a100ac9a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:30.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.993+0000 7f4a162ab700 1 --2- 172.21.15.49:0/4047466468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a100c0180 0x7f4a10151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:30.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.993+0000 7f4a162ab700 1 --2- 172.21.15.49:0/4047466468 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a10157660 0x7f4a10166f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:30.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.993+0000 7f4a162ab700 1 -- 172.21.15.49:0/4047466468 >> 172.21.15.49:0/4047466468 conn(0x7f4a100cb000 msgr2=0x7f4a100c78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:30.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.994+0000 7f4a162ab700 1 -- 172.21.15.49:0/4047466468 shutdown_connections 2023-11-30T17:07:30.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:30.994+0000 7f4a162ab700 1 -- 172.21.15.49:0/4047466468 wait complete. 2023-11-30T17:07:31.008 INFO:teuthology.orchestra.run.smithi049.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-30T17:07:31.008 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-30T17:07:31.008 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:07:31.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.123+0000 7f7a8450a700 1 Processor -- start 2023-11-30T17:07:31.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.123+0000 7f7a8450a700 1 -- start start 2023-11-30T17:07:31.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.124+0000 7f7a8450a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7a7c0caab0 0x7f7a7c0aa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:31.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.124+0000 7f7a8450a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a7c0ca180 0x7f7a7c15e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:31.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.124+0000 7f7a8450a700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7c0a9a90 con 0x7f7a7c0cae90 2023-11-30T17:07:31.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.124+0000 7f7a8450a700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a7c154ce0 con 0x7f7a7c0caab0 2023-11-30T17:07:31.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.124+0000 7f7a8450a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c0a8e80 con 0x7f7a7c0ca180 2023-11-30T17:07:31.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.125+0000 7f7a82aa7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a7c0ca180 0x7f7a7c15e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:31.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.125+0000 7f7a822a6700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7a7c0caab0 0x7f7a7c0aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:31.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.125+0000 7f7a81aa5700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f7a7c0cae90 0x7f7a7c0c0ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:39866/0 (socket says 172.21.15.49:39866) 2023-11-30T17:07:31.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.125+0000 7f7a81aa5700 1 -- 172.21.15.49:0/403415073 learned_addr learned my addr 172.21.15.49:0/403415073 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:31.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.125+0000 7f7a822a6700 1 -- 172.21.15.49:0/403415073 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a7c0ca180 msgr2=0x7f7a7c15e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:31.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.125+0000 7f7a822a6700 1 --2- 172.21.15.49:0/403415073 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a7c0ca180 0x7f7a7c15e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:31.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.125+0000 7f7a822a6700 1 -- 172.21.15.49:0/403415073 >> v1:172.21.15.115:6789/0 conn(0x7f7a7c0cae90 legacy=0x7f7a7c0c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:31.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.125+0000 7f7a822a6700 1 -- 172.21.15.49:0/403415073 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7c0a9160 con 0x7f7a7c0caab0 2023-11-30T17:07:31.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.125+0000 7f7a812a4700 1 -- 172.21.15.49:0/403415073 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1937691204 0 0) 0x7f7a7c0a9a90 con 0x7f7a7c0cae90 2023-11-30T17:07:31.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.125+0000 7f7a82aa7700 1 --2- 172.21.15.49:0/403415073 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a7c0ca180 0x7f7a7c15e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:07:31.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.125+0000 7f7a822a6700 1 --2- 172.21.15.49:0/403415073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a7c0caab0 0x7f7a7c0aa470 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f7a74006fd0 tx=0x7f7a74006f40).ready entity=mon.1 client_cookie=72e0c9b2bc32a4d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:31.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.125+0000 7f7a812a4700 1 -- 172.21.15.49:0/403415073 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a74005880 con 0x7f7a7c0caab0 2023-11-30T17:07:31.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.125+0000 7f7a812a4700 1 -- 172.21.15.49:0/403415073 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a740059e0 con 0x7f7a7c0caab0 2023-11-30T17:07:31.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.125+0000 7f7a812a4700 1 -- 172.21.15.49:0/403415073 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a74005d60 con 0x7f7a7c0caab0 2023-11-30T17:07:31.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.126+0000 7f7a8450a700 1 -- 172.21.15.49:0/403415073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a7c0caab0 msgr2=0x7f7a7c0aa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:31.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.126+0000 7f7a8450a700 1 --2- 172.21.15.49:0/403415073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a7c0caab0 0x7f7a7c0aa470 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f7a74006fd0 tx=0x7f7a74006f40).stop 2023-11-30T17:07:31.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.126+0000 7f7a8450a700 1 -- 172.21.15.49:0/403415073 shutdown_connections 2023-11-30T17:07:31.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.126+0000 7f7a8450a700 1 --2- 172.21.15.49:0/403415073 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a7c0ca180 0x7f7a7c15e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:31.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.126+0000 7f7a8450a700 1 --2- 172.21.15.49:0/403415073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a7c0caab0 0x7f7a7c0aa470 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:31.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.126+0000 7f7a8450a700 1 -- 172.21.15.49:0/403415073 >> 172.21.15.49:0/403415073 conn(0x7f7a7c094920 msgr2=0x7f7a7c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:31.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.126+0000 7f7a8450a700 1 -- 172.21.15.49:0/403415073 shutdown_connections 2023-11-30T17:07:31.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.126+0000 7f7a8450a700 1 -- 172.21.15.49:0/403415073 wait complete. 2023-11-30T17:07:31.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.127+0000 7f7a8450a700 1 Processor -- start 2023-11-30T17:07:31.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.127+0000 7f7a8450a700 1 -- start start 2023-11-30T17:07:31.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.128+0000 7f7a8450a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a7c0ca180 0x7f7a7c157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:31.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.128+0000 7f7a8450a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a7c0caab0 0x7f7a7c167de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:31.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.128+0000 7f7a8450a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a7c0cae90 0x7f7a7c153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:31.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.128+0000 7f7a8450a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c0ac8b0 con 0x7f7a7c0cae90 2023-11-30T17:07:31.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.128+0000 7f7a8450a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c0aa760 con 0x7f7a7c0ca180 2023-11-30T17:07:31.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.128+0000 7f7a8450a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c0aa1a0 con 0x7f7a7c0caab0 2023-11-30T17:07:31.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.128+0000 7f7a82aa7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a7c0cae90 0x7f7a7c153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:31.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.128+0000 7f7a82aa7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a7c0cae90 0x7f7a7c153c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37976/0 (socket says 172.21.15.49:37976) 2023-11-30T17:07:31.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.128+0000 7f7a82aa7700 1 -- 172.21.15.49:0/1361554758 learned_addr learned my addr 172.21.15.49:0/1361554758 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:31.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.128+0000 7f7a81aa5700 1 --2- 172.21.15.49:0/1361554758 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a7c0caab0 0x7f7a7c167de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:31.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.128+0000 7f7a822a6700 1 --2- 172.21.15.49:0/1361554758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a7c0ca180 0x7f7a7c157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:31.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.128+0000 7f7a82aa7700 1 -- 172.21.15.49:0/1361554758 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a7c0caab0 msgr2=0x7f7a7c167de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:31.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.128+0000 7f7a82aa7700 1 --2- 172.21.15.49:0/1361554758 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a7c0caab0 0x7f7a7c167de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:31.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.128+0000 7f7a82aa7700 1 -- 172.21.15.49:0/1361554758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a7c0ca180 msgr2=0x7f7a7c157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:31.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.128+0000 7f7a82aa7700 1 --2- 172.21.15.49:0/1361554758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a7c0ca180 0x7f7a7c157b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:31.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.128+0000 7f7a82aa7700 1 -- 172.21.15.49:0/1361554758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a6c009a20 con 0x7f7a7c0cae90 2023-11-30T17:07:31.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.128+0000 7f7a82aa7700 1 --2- 172.21.15.49:0/1361554758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a7c0cae90 0x7f7a7c153c70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f7a6c00ef90 tx=0x7f7a6c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:31.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.129+0000 7f7a7a7fc700 1 -- 172.21.15.49:0/1361554758 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c00cbd0 con 0x7f7a7c0cae90 2023-11-30T17:07:31.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.129+0000 7f7a7a7fc700 1 -- 172.21.15.49:0/1361554758 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6c00f040 con 0x7f7a7c0cae90 2023-11-30T17:07:31.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.129+0000 7f7a8450a700 1 -- 172.21.15.49:0/1361554758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a74009250 con 0x7f7a7c0cae90 2023-11-30T17:07:31.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.129+0000 7f7a7a7fc700 1 -- 172.21.15.49:0/1361554758 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c013400 con 0x7f7a7c0cae90 2023-11-30T17:07:31.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.129+0000 7f7a8450a700 1 -- 172.21.15.49:0/1361554758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a7c0acb50 con 0x7f7a7c0cae90 2023-11-30T17:07:31.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.130+0000 7f7a8450a700 1 -- 172.21.15.49:0/1361554758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a7c0a81f0 con 0x7f7a7c0cae90 2023-11-30T17:07:31.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.130+0000 7f7a7a7fc700 1 -- 172.21.15.49:0/1361554758 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7a6c013830 con 0x7f7a7c0cae90 2023-11-30T17:07:31.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.130+0000 7f7a7a7fc700 1 --2- 172.21.15.49:0/1361554758 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7a6805f150 0x7f7a68061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:31.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.130+0000 7f7a7a7fc700 1 -- 172.21.15.49:0/1361554758 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7a6c07aac0 con 0x7f7a7c0cae90 2023-11-30T17:07:31.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.130+0000 7f7a822a6700 1 --2- 172.21.15.49:0/1361554758 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7a6805f150 0x7f7a68061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:31.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.131+0000 7f7a822a6700 1 --2- 172.21.15.49:0/1361554758 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7a6805f150 0x7f7a68061610 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f7a74006fa0 tx=0x7f7a74016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:31.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.134+0000 7f7a7a7fc700 1 -- 172.21.15.49:0/1361554758 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7a6c04bd90 con 0x7f7a7c0cae90 2023-11-30T17:07:31.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.306+0000 7f7a8450a700 1 -- 172.21.15.49:0/1361554758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a7c0ac6f0 con 0x7f7a7c0cae90 2023-11-30T17:07:31.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.307+0000 7f7a7a7fc700 1 -- 172.21.15.49:0/1361554758 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f7a6c07ae60 con 0x7f7a7c0cae90 2023-11-30T17:07:31.310 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:31.310 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":22,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:07:17.283998+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:07:14.837882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-30T17:07:15.248549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:07:31.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.309+0000 7f7a8450a700 1 -- 172.21.15.49:0/1361554758 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7a6805f150 msgr2=0x7f7a68061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:31.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.309+0000 7f7a8450a700 1 --2- 172.21.15.49:0/1361554758 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7a6805f150 0x7f7a68061610 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f7a74006fa0 tx=0x7f7a74016000).stop 2023-11-30T17:07:31.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.309+0000 7f7a8450a700 1 -- 172.21.15.49:0/1361554758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a7c0cae90 msgr2=0x7f7a7c153c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:31.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.309+0000 7f7a8450a700 1 --2- 172.21.15.49:0/1361554758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a7c0cae90 0x7f7a7c153c70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f7a6c00ef90 tx=0x7f7a6c00b040).stop 2023-11-30T17:07:31.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.309+0000 7f7a8450a700 1 -- 172.21.15.49:0/1361554758 shutdown_connections 2023-11-30T17:07:31.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.309+0000 7f7a8450a700 1 --2- 172.21.15.49:0/1361554758 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7a6805f150 0x7f7a68061610 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:31.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.309+0000 7f7a8450a700 1 --2- 172.21.15.49:0/1361554758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a7c0cae90 0x7f7a7c153c70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:31.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.309+0000 7f7a8450a700 1 --2- 172.21.15.49:0/1361554758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a7c0ca180 0x7f7a7c157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:31.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.309+0000 7f7a8450a700 1 --2- 172.21.15.49:0/1361554758 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a7c0caab0 0x7f7a7c167de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:31.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.309+0000 7f7a8450a700 1 -- 172.21.15.49:0/1361554758 >> 172.21.15.49:0/1361554758 conn(0x7f7a7c094920 msgr2=0x7f7a7c064ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:31.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.309+0000 7f7a8450a700 1 -- 172.21.15.49:0/1361554758 shutdown_connections 2023-11-30T17:07:31.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.309+0000 7f7a8450a700 1 -- 172.21.15.49:0/1361554758 wait complete. 2023-11-30T17:07:31.324 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-30T17:07:14.837882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-30T17:07:15.248549+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-30T17:07:31.324 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T17:07:31.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.443+0000 7f9120290700 1 Processor -- start 2023-11-30T17:07:31.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.443+0000 7f9120290700 1 -- start start 2023-11-30T17:07:31.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.444+0000 7f9120290700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f91180c7170 0x7f9118063b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:31.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.444+0000 7f9120290700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91180c18b0 con 0x7f9118064000 2023-11-30T17:07:31.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.444+0000 7f9120290700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9118064490 con 0x7f91180c1d40 2023-11-30T17:07:31.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.444+0000 7f9120290700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91180c6a20 con 0x7f91180c7170 2023-11-30T17:07:31.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.444+0000 7f911e82d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9118064000 0x7f91180c6310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40664/0 (socket says 172.21.15.49:40664) 2023-11-30T17:07:31.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.444+0000 7f911e82d700 1 -- 172.21.15.49:0/1180274572 learned_addr learned my addr 172.21.15.49:0/1180274572 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:31.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.444+0000 7f911e02c700 1 --2- 172.21.15.49:0/1180274572 >> v2:172.21.15.115:3300/0 conn(0x7f91180c7170 0x7f9118063b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:31.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.444+0000 7f911d02a700 1 -- 172.21.15.49:0/1180274572 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3463117875 0 0) 0x7f91180c18b0 con 0x7f9118064000 2023-11-30T17:07:31.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.444+0000 7f911d02a700 1 -- 172.21.15.49:0/1180274572 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91000033f0 con 0x7f9118064000 2023-11-30T17:07:31.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.444+0000 7f911d02a700 1 -- 172.21.15.49:0/1180274572 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 479676452 0 0) 0x7f9118064490 con 0x7f91180c1d40 2023-11-30T17:07:31.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.444+0000 7f911d02a700 1 -- 172.21.15.49:0/1180274572 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91180c18b0 con 0x7f91180c1d40 2023-11-30T17:07:31.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.444+0000 7f911e02c700 1 -- 172.21.15.49:0/1180274572 >> v1:172.21.15.115:6789/0 conn(0x7f91180c1d40 legacy=0x7f91180c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:31.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.444+0000 7f911e02c700 1 -- 172.21.15.49:0/1180274572 >> v1:172.21.15.49:6789/0 conn(0x7f9118064000 legacy=0x7f91180c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:31.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.444+0000 7f911e02c700 1 -- 172.21.15.49:0/1180274572 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91180c0ca0 con 0x7f91180c7170 2023-11-30T17:07:31.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.445+0000 7f911e02c700 1 --2- 172.21.15.49:0/1180274572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91180c7170 0x7f9118063b10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f9110009760 tx=0x7f9110009060).ready entity=mon.1 client_cookie=436586ebef64ce4d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:31.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.445+0000 7f911d02a700 1 -- 172.21.15.49:0/1180274572 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9110009120 con 0x7f91180c7170 2023-11-30T17:07:31.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.445+0000 7f911d02a700 1 -- 172.21.15.49:0/1180274572 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911000d4a0 con 0x7f91180c7170 2023-11-30T17:07:31.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.445+0000 7f911d02a700 1 -- 172.21.15.49:0/1180274572 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911000d820 con 0x7f91180c7170 2023-11-30T17:07:31.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.445+0000 7f9120290700 1 -- 172.21.15.49:0/1180274572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91180c7170 msgr2=0x7f9118063b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:31.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.445+0000 7f9120290700 1 --2- 172.21.15.49:0/1180274572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91180c7170 0x7f9118063b10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f9110009760 tx=0x7f9110009060).stop 2023-11-30T17:07:31.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.445+0000 7f9120290700 1 -- 172.21.15.49:0/1180274572 shutdown_connections 2023-11-30T17:07:31.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.445+0000 7f9120290700 1 --2- 172.21.15.49:0/1180274572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91180c7170 0x7f9118063b10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:31.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.445+0000 7f9120290700 1 -- 172.21.15.49:0/1180274572 >> 172.21.15.49:0/1180274572 conn(0x7f91180cb260 msgr2=0x7f91180cb670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:31.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.445+0000 7f9120290700 1 -- 172.21.15.49:0/1180274572 shutdown_connections 2023-11-30T17:07:31.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.445+0000 7f9120290700 1 -- 172.21.15.49:0/1180274572 wait complete. 2023-11-30T17:07:31.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.446+0000 7f9120290700 1 Processor -- start 2023-11-30T17:07:31.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.446+0000 7f9120290700 1 -- start start 2023-11-30T17:07:31.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.447+0000 7f9120290700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9118064000 0x7f91180ac9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:31.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.447+0000 7f9120290700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91180c1d40 0x7f9118164cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:31.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.447+0000 7f9120290700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f91180c7170 0x7f91181651c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:31.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.447+0000 7f9120290700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91180ab3f0 con 0x7f91180c1d40 2023-11-30T17:07:31.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.447+0000 7f9120290700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91180aade0 con 0x7f9118064000 2023-11-30T17:07:31.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.447+0000 7f9120290700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9118168e60 con 0x7f91180c7170 2023-11-30T17:07:31.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.447+0000 7f911d82b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91180c1d40 0x7f9118164cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:31.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.447+0000 7f911d82b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91180c1d40 0x7f9118164cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37988/0 (socket says 172.21.15.49:37988) 2023-11-30T17:07:31.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.447+0000 7f911d82b700 1 -- 172.21.15.49:0/3744039603 learned_addr learned my addr 172.21.15.49:0/3744039603 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:31.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.448+0000 7f911e82d700 1 --2- 172.21.15.49:0/3744039603 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f91180c7170 0x7f91181651c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:31.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.448+0000 7f911e02c700 1 --2- 172.21.15.49:0/3744039603 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9118064000 0x7f91180ac9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:31.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.448+0000 7f911d82b700 1 -- 172.21.15.49:0/3744039603 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f91180c7170 msgr2=0x7f91181651c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:31.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.448+0000 7f911d82b700 1 --2- 172.21.15.49:0/3744039603 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f91180c7170 0x7f91181651c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:31.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.448+0000 7f911d82b700 1 -- 172.21.15.49:0/3744039603 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9118064000 msgr2=0x7f91180ac9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:31.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.448+0000 7f911d82b700 1 --2- 172.21.15.49:0/3744039603 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9118064000 0x7f91180ac9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:31.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.448+0000 7f911d82b700 1 -- 172.21.15.49:0/3744039603 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91100092a0 con 0x7f91180c1d40 2023-11-30T17:07:31.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.448+0000 7f911e02c700 1 --2- 172.21.15.49:0/3744039603 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9118064000 0x7f91180ac9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:31.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.448+0000 7f911d82b700 1 --2- 172.21.15.49:0/3744039603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91180c1d40 0x7f9118164cd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f910c00c490 tx=0x7f910c007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:31.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.448+0000 7f91167fc700 1 -- 172.21.15.49:0/3744039603 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910c00f470 con 0x7f91180c1d40 2023-11-30T17:07:31.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.448+0000 7f91167fc700 1 -- 172.21.15.49:0/3744039603 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910c00f5d0 con 0x7f91180c1d40 2023-11-30T17:07:31.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.448+0000 7f9120290700 1 -- 172.21.15.49:0/3744039603 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91180ab080 con 0x7f91180c1d40 2023-11-30T17:07:31.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.448+0000 7f91167fc700 1 -- 172.21.15.49:0/3744039603 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910c00f990 con 0x7f91180c1d40 2023-11-30T17:07:31.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.448+0000 7f9120290700 1 -- 172.21.15.49:0/3744039603 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91180acee0 con 0x7f91180c1d40 2023-11-30T17:07:31.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.449+0000 7f9120290700 1 -- 172.21.15.49:0/3744039603 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91180c08a0 con 0x7f91180c1d40 2023-11-30T17:07:31.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.449+0000 7f91167fc700 1 -- 172.21.15.49:0/3744039603 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f910c00fd40 con 0x7f91180c1d40 2023-11-30T17:07:31.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.450+0000 7f91167fc700 1 --2- 172.21.15.49:0/3744039603 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f910405f150 0x7f9104061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:31.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.450+0000 7f91167fc700 1 -- 172.21.15.49:0/3744039603 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f910c079820 con 0x7f91180c1d40 2023-11-30T17:07:31.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.450+0000 7f911e02c700 1 --2- 172.21.15.49:0/3744039603 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f910405f150 0x7f9104061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:31.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.450+0000 7f911e02c700 1 --2- 172.21.15.49:0/3744039603 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f910405f150 0x7f9104061610 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f9110009270 tx=0x7f9110016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:31.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.455+0000 7f91167fc700 1 -- 172.21.15.49:0/3744039603 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f910c04aaf0 con 0x7f91180c1d40 2023-11-30T17:07:31.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.626+0000 7f9120290700 1 -- 172.21.15.49:0/3744039603 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f91180ab530 con 0x7f91180c1d40 2023-11-30T17:07:31.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.626+0000 7f91167fc700 1 -- 172.21.15.49:0/3744039603 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f910c04e110 con 0x7f91180c1d40 2023-11-30T17:07:31.629 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T17:07:31.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.628+0000 7f9120290700 1 -- 172.21.15.49:0/3744039603 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f910405f150 msgr2=0x7f9104061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:31.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.628+0000 7f9120290700 1 --2- 172.21.15.49:0/3744039603 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f910405f150 0x7f9104061610 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f9110009270 tx=0x7f9110016000).stop 2023-11-30T17:07:31.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.628+0000 7f9120290700 1 -- 172.21.15.49:0/3744039603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91180c1d40 msgr2=0x7f9118164cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:31.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.628+0000 7f9120290700 1 --2- 172.21.15.49:0/3744039603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91180c1d40 0x7f9118164cd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f910c00c490 tx=0x7f910c007c60).stop 2023-11-30T17:07:31.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.628+0000 7f9120290700 1 -- 172.21.15.49:0/3744039603 shutdown_connections 2023-11-30T17:07:31.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.628+0000 7f9120290700 1 --2- 172.21.15.49:0/3744039603 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f91180c7170 0x7f91181651c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:31.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.628+0000 7f9120290700 1 --2- 172.21.15.49:0/3744039603 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9118064000 0x7f91180ac9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:31.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.628+0000 7f9120290700 1 --2- 172.21.15.49:0/3744039603 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f910405f150 0x7f9104061610 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:31.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.628+0000 7f9120290700 1 --2- 172.21.15.49:0/3744039603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91180c1d40 0x7f9118164cd0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:31.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.628+0000 7f9120290700 1 -- 172.21.15.49:0/3744039603 >> 172.21.15.49:0/3744039603 conn(0x7f91180cb260 msgr2=0x7f91180aa390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:31.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.628+0000 7f9120290700 1 -- 172.21.15.49:0/3744039603 shutdown_connections 2023-11-30T17:07:31.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.628+0000 7f9120290700 1 -- 172.21.15.49:0/3744039603 wait complete. 2023-11-30T17:07:31.643 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T17:07:31.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.761+0000 7f46a0934700 1 Processor -- start 2023-11-30T17:07:31.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.761+0000 7f46a0934700 1 -- start start 2023-11-30T17:07:31.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.762+0000 7f46a0934700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f469c154950 0x7f469c0ca540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:31.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.762+0000 7f46a0934700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f469c0c7bc0 con 0x7f469c0c66f0 2023-11-30T17:07:31.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.762+0000 7f46a0934700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f469c155920 con 0x7f469c14e530 2023-11-30T17:07:31.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.762+0000 7f46a0934700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469c0c6ba0 con 0x7f469c154950 2023-11-30T17:07:31.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.762+0000 7f469affd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f469c0c66f0 0x7f469c158570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40680/0 (socket says 172.21.15.49:40680) 2023-11-30T17:07:31.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.762+0000 7f469affd700 1 -- 172.21.15.49:0/3284971383 learned_addr learned my addr 172.21.15.49:0/3284971383 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:31.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.762+0000 7f469bfff700 1 --2- 172.21.15.49:0/3284971383 >> v2:172.21.15.115:3300/0 conn(0x7f469c154950 0x7f469c0ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:31.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.762+0000 7f469a7fc700 1 -- 172.21.15.49:0/3284971383 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 786920248 0 0) 0x7f469c0c7bc0 con 0x7f469c0c66f0 2023-11-30T17:07:31.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.762+0000 7f469a7fc700 1 -- 172.21.15.49:0/3284971383 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46880033f0 con 0x7f469c0c66f0 2023-11-30T17:07:31.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.762+0000 7f469a7fc700 1 -- 172.21.15.49:0/3284971383 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3709336806 0 0) 0x7f469c155920 con 0x7f469c14e530 2023-11-30T17:07:31.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.762+0000 7f469a7fc700 1 -- 172.21.15.49:0/3284971383 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f469c0c7bc0 con 0x7f469c14e530 2023-11-30T17:07:31.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.762+0000 7f469bfff700 1 -- 172.21.15.49:0/3284971383 >> v1:172.21.15.115:6789/0 conn(0x7f469c14e530 legacy=0x7f469c14e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:31.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.762+0000 7f469bfff700 1 -- 172.21.15.49:0/3284971383 >> v1:172.21.15.49:6789/0 conn(0x7f469c0c66f0 legacy=0x7f469c158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:31.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.762+0000 7f469a7fc700 1 -- 172.21.15.49:0/3284971383 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 728535778 0 0) 0x7f46880033f0 con 0x7f469c0c66f0 2023-11-30T17:07:31.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.762+0000 7f469bfff700 1 -- 172.21.15.49:0/3284971383 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469c154de0 con 0x7f469c154950 2023-11-30T17:07:31.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.762+0000 7f469bfff700 1 --2- 172.21.15.49:0/3284971383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f469c154950 0x7f469c0ca540 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f4694009760 tx=0x7f4694009060).ready entity=mon.1 client_cookie=858ba70c10dbc1ff server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:31.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.762+0000 7f469a7fc700 1 -- 172.21.15.49:0/3284971383 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4684001470 con 0x7f469c154950 2023-11-30T17:07:31.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.762+0000 7f469a7fc700 1 -- 172.21.15.49:0/3284971383 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4694011400 con 0x7f469c154950 2023-11-30T17:07:31.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.762+0000 7f469a7fc700 1 -- 172.21.15.49:0/3284971383 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4694011780 con 0x7f469c154950 2023-11-30T17:07:31.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.762+0000 7f46a0934700 1 -- 172.21.15.49:0/3284971383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f469c154950 msgr2=0x7f469c0ca540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:31.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.762+0000 7f46a0934700 1 --2- 172.21.15.49:0/3284971383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f469c154950 0x7f469c0ca540 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f4694009760 tx=0x7f4694009060).stop 2023-11-30T17:07:31.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.762+0000 7f46a0934700 1 -- 172.21.15.49:0/3284971383 shutdown_connections 2023-11-30T17:07:31.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.762+0000 7f46a0934700 1 --2- 172.21.15.49:0/3284971383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f469c154950 0x7f469c0ca540 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:31.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.762+0000 7f46a0934700 1 -- 172.21.15.49:0/3284971383 >> 172.21.15.49:0/3284971383 conn(0x7f469c064990 msgr2=0x7f469c064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:31.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.762+0000 7f46a0934700 1 -- 172.21.15.49:0/3284971383 shutdown_connections 2023-11-30T17:07:31.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.762+0000 7f46a0934700 1 -- 172.21.15.49:0/3284971383 wait complete. 2023-11-30T17:07:31.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.763+0000 7f46a0934700 1 Processor -- start 2023-11-30T17:07:31.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.763+0000 7f46a0934700 1 -- start start 2023-11-30T17:07:31.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.764+0000 7f46a0934700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f469c0c66f0 0x7f469c0c22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:31.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.764+0000 7f46a0934700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f469c14e530 0x7f469c164ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:31.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.764+0000 7f46a0934700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f469c154950 0x7f469c14dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:31.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.764+0000 7f46a0934700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0c27a0 con 0x7f469c154950 2023-11-30T17:07:31.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.764+0000 7f46a0934700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c1651d0 con 0x7f469c0c66f0 2023-11-30T17:07:31.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.764+0000 7f46a0934700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0c35c0 con 0x7f469c14e530 2023-11-30T17:07:31.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.764+0000 7f469bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f469c154950 0x7f469c14dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:31.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.764+0000 7f469bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f469c154950 0x7f469c14dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37992/0 (socket says 172.21.15.49:37992) 2023-11-30T17:07:31.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.764+0000 7f469bfff700 1 -- 172.21.15.49:0/4265681924 learned_addr learned my addr 172.21.15.49:0/4265681924 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:31.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.764+0000 7f469b7fe700 1 --2- 172.21.15.49:0/4265681924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f469c0c66f0 0x7f469c0c22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:31.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.764+0000 7f469affd700 1 --2- 172.21.15.49:0/4265681924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f469c14e530 0x7f469c164ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:31.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.765+0000 7f469bfff700 1 -- 172.21.15.49:0/4265681924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f469c14e530 msgr2=0x7f469c164ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:31.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.765+0000 7f469bfff700 1 --2- 172.21.15.49:0/4265681924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f469c14e530 0x7f469c164ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:31.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.765+0000 7f469bfff700 1 -- 172.21.15.49:0/4265681924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f469c0c66f0 msgr2=0x7f469c0c22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:31.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.765+0000 7f469bfff700 1 --2- 172.21.15.49:0/4265681924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f469c0c66f0 0x7f469c0c22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:31.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.765+0000 7f469bfff700 1 -- 172.21.15.49:0/4265681924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46940092a0 con 0x7f469c154950 2023-11-30T17:07:31.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.765+0000 7f469bfff700 1 --2- 172.21.15.49:0/4265681924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f469c154950 0x7f469c14dab0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f4694009d50 tx=0x7f4694016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:31.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.765+0000 7f46937fe700 1 -- 172.21.15.49:0/4265681924 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4694010bf0 con 0x7f469c154950 2023-11-30T17:07:31.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.765+0000 7f46937fe700 1 -- 172.21.15.49:0/4265681924 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4694010d50 con 0x7f469c154950 2023-11-30T17:07:31.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.765+0000 7f46a0934700 1 -- 172.21.15.49:0/4265681924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f469c0c3a50 con 0x7f469c154950 2023-11-30T17:07:31.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.765+0000 7f46937fe700 1 -- 172.21.15.49:0/4265681924 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469401d680 con 0x7f469c154950 2023-11-30T17:07:31.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.765+0000 7f46a0934700 1 -- 172.21.15.49:0/4265681924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f469c0c2c90 con 0x7f469c154950 2023-11-30T17:07:31.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.766+0000 7f46a0934700 1 -- 172.21.15.49:0/4265681924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f469c062ee0 con 0x7f469c154950 2023-11-30T17:07:31.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.766+0000 7f46937fe700 1 -- 172.21.15.49:0/4265681924 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f469401dab0 con 0x7f469c154950 2023-11-30T17:07:31.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.767+0000 7f46937fe700 1 --2- 172.21.15.49:0/4265681924 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f467c05f150 0x7f467c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:31.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.767+0000 7f46937fe700 1 -- 172.21.15.49:0/4265681924 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f469407b8e0 con 0x7f469c154950 2023-11-30T17:07:31.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.767+0000 7f469b7fe700 1 --2- 172.21.15.49:0/4265681924 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f467c05f150 0x7f467c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:31.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.767+0000 7f469b7fe700 1 --2- 172.21.15.49:0/4265681924 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f467c05f150 0x7f467c061610 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f468c003df0 tx=0x7f468c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:31.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.772+0000 7f46937fe700 1 -- 172.21.15.49:0/4265681924 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f469404cbb0 con 0x7f469c154950 2023-11-30T17:07:31.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.944+0000 7f46a0934700 1 -- 172.21.15.49:0/4265681924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f469c0c3730 con 0x7f469c154950 2023-11-30T17:07:31.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.945+0000 7f46937fe700 1 -- 172.21.15.49:0/4265681924 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f46940501d0 con 0x7f469c154950 2023-11-30T17:07:31.947 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T17:07:31.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.947+0000 7f46a0934700 1 -- 172.21.15.49:0/4265681924 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f467c05f150 msgr2=0x7f467c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:31.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.947+0000 7f46a0934700 1 --2- 172.21.15.49:0/4265681924 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f467c05f150 0x7f467c061610 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f468c003df0 tx=0x7f468c009040).stop 2023-11-30T17:07:31.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.947+0000 7f46a0934700 1 -- 172.21.15.49:0/4265681924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f469c154950 msgr2=0x7f469c14dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:31.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.947+0000 7f46a0934700 1 --2- 172.21.15.49:0/4265681924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f469c154950 0x7f469c14dab0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f4694009d50 tx=0x7f4694016000).stop 2023-11-30T17:07:31.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.947+0000 7f46a0934700 1 -- 172.21.15.49:0/4265681924 shutdown_connections 2023-11-30T17:07:31.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.947+0000 7f46a0934700 1 --2- 172.21.15.49:0/4265681924 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f467c05f150 0x7f467c061610 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:31.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.947+0000 7f46a0934700 1 --2- 172.21.15.49:0/4265681924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f469c154950 0x7f469c14dab0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:31.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.947+0000 7f46a0934700 1 --2- 172.21.15.49:0/4265681924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f469c0c66f0 0x7f469c0c22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:31.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.947+0000 7f46a0934700 1 --2- 172.21.15.49:0/4265681924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f469c14e530 0x7f469c164ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:31.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.947+0000 7f46a0934700 1 -- 172.21.15.49:0/4265681924 >> 172.21.15.49:0/4265681924 conn(0x7f469c064990 msgr2=0x7f469c0c0610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:31.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.947+0000 7f46a0934700 1 -- 172.21.15.49:0/4265681924 shutdown_connections 2023-11-30T17:07:31.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:31.947+0000 7f46a0934700 1 -- 172.21.15.49:0/4265681924 wait complete. 2023-11-30T17:07:31.962 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-30T17:07:32.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.081+0000 7fedbdcb3700 1 Processor -- start 2023-11-30T17:07:32.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.081+0000 7fedbdcb3700 1 -- start start 2023-11-30T17:07:32.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.082+0000 7fedbdcb3700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fedb8098d10 0x7fedb80c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:32.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.082+0000 7fedbdcb3700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb80c72d0 con 0x7fedb8158320 2023-11-30T17:07:32.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.082+0000 7fedbdcb3700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb8064570 con 0x7fedb80c6190 2023-11-30T17:07:32.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.082+0000 7fedbdcb3700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb8154bc0 con 0x7fedb8098d10 2023-11-30T17:07:32.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.082+0000 7fedb7fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fedb8158320 0x7fedb80a80f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40694/0 (socket says 172.21.15.49:40694) 2023-11-30T17:07:32.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.082+0000 7fedb7fff700 1 -- 172.21.15.49:0/3081426122 learned_addr learned my addr 172.21.15.49:0/3081426122 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:32.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.082+0000 7fedb77fe700 1 --2- 172.21.15.49:0/3081426122 >> v2:172.21.15.115:3300/0 conn(0x7fedb8098d10 0x7fedb80c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:32.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.082+0000 7fedb67fc700 1 -- 172.21.15.49:0/3081426122 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1464216986 0 0) 0x7fedb80c72d0 con 0x7fedb8158320 2023-11-30T17:07:32.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.082+0000 7fedb67fc700 1 -- 172.21.15.49:0/3081426122 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feda00033f0 con 0x7fedb8158320 2023-11-30T17:07:32.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.082+0000 7fedb77fe700 1 -- 172.21.15.49:0/3081426122 >> v1:172.21.15.115:6789/0 conn(0x7fedb80c6190 legacy=0x7fedb8063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:32.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.082+0000 7fedb67fc700 1 -- 172.21.15.49:0/3081426122 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885100546 0 0) 0x7fedb8064570 con 0x7fedb80c6190 2023-11-30T17:07:32.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.082+0000 7fedb77fe700 1 -- 172.21.15.49:0/3081426122 >> v1:172.21.15.49:6789/0 conn(0x7fedb8158320 legacy=0x7fedb80a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:32.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.082+0000 7fedb77fe700 1 -- 172.21.15.49:0/3081426122 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb80c66c0 con 0x7fedb8098d10 2023-11-30T17:07:32.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.082+0000 7fedb77fe700 1 --2- 172.21.15.49:0/3081426122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb8098d10 0x7fedb80c7760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7feda8009760 tx=0x7feda8009060).ready entity=mon.1 client_cookie=e4f1b0ebdb69638c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:32.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.082+0000 7fedb67fc700 1 -- 172.21.15.49:0/3081426122 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda800f510 con 0x7fedb8098d10 2023-11-30T17:07:32.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.082+0000 7fedb67fc700 1 -- 172.21.15.49:0/3081426122 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda800f670 con 0x7fedb8098d10 2023-11-30T17:07:32.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.082+0000 7fedb67fc700 1 -- 172.21.15.49:0/3081426122 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda800f9f0 con 0x7fedb8098d10 2023-11-30T17:07:32.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.082+0000 7fedbdcb3700 1 -- 172.21.15.49:0/3081426122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb8098d10 msgr2=0x7fedb80c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:32.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.082+0000 7fedbdcb3700 1 --2- 172.21.15.49:0/3081426122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb8098d10 0x7fedb80c7760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7feda8009760 tx=0x7feda8009060).stop 2023-11-30T17:07:32.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.082+0000 7fedbdcb3700 1 -- 172.21.15.49:0/3081426122 shutdown_connections 2023-11-30T17:07:32.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.082+0000 7fedbdcb3700 1 --2- 172.21.15.49:0/3081426122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb8098d10 0x7fedb80c7760 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:32.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.082+0000 7fedbdcb3700 1 -- 172.21.15.49:0/3081426122 >> 172.21.15.49:0/3081426122 conn(0x7fedb80cb310 msgr2=0x7fedb80cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:32.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.082+0000 7fedbdcb3700 1 -- 172.21.15.49:0/3081426122 shutdown_connections 2023-11-30T17:07:32.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.082+0000 7fedbdcb3700 1 -- 172.21.15.49:0/3081426122 wait complete. 2023-11-30T17:07:32.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.084+0000 7fedbdcb3700 1 Processor -- start 2023-11-30T17:07:32.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.084+0000 7fedbdcb3700 1 -- start start 2023-11-30T17:07:32.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.084+0000 7fedbdcb3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb8098d10 0x7fedb81488f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:32.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.084+0000 7fedbdcb3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fedb80c6190 0x7fedb8156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:32.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.084+0000 7fedbdcb3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedb8158320 0x7fedb8157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:32.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.084+0000 7fedbdcb3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb80b1380 con 0x7fedb8158320 2023-11-30T17:07:32.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.084+0000 7fedbdcb3700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb80c3fb0 con 0x7fedb8098d10 2023-11-30T17:07:32.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.084+0000 7fedbdcb3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb8155a10 con 0x7fedb80c6190 2023-11-30T17:07:32.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.085+0000 7fedb7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedb8158320 0x7fedb8157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:32.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.085+0000 7fedb7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedb8158320 0x7fedb8157470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38002/0 (socket says 172.21.15.49:38002) 2023-11-30T17:07:32.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.085+0000 7fedb7fff700 1 -- 172.21.15.49:0/3150757516 learned_addr learned my addr 172.21.15.49:0/3150757516 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:32.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.085+0000 7fedb77fe700 1 --2- 172.21.15.49:0/3150757516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb8098d10 0x7fedb81488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:32.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.085+0000 7fedb6ffd700 1 --2- 172.21.15.49:0/3150757516 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fedb80c6190 0x7fedb8156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:32.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.085+0000 7fedb7fff700 1 -- 172.21.15.49:0/3150757516 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fedb80c6190 msgr2=0x7fedb8156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:32.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.085+0000 7fedb7fff700 1 --2- 172.21.15.49:0/3150757516 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fedb80c6190 0x7fedb8156f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:32.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.085+0000 7fedb7fff700 1 -- 172.21.15.49:0/3150757516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb8098d10 msgr2=0x7fedb81488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:32.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.085+0000 7fedb7fff700 1 --2- 172.21.15.49:0/3150757516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb8098d10 0x7fedb81488f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:32.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.085+0000 7fedb7fff700 1 -- 172.21.15.49:0/3150757516 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda80092a0 con 0x7fedb8158320 2023-11-30T17:07:32.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.085+0000 7fedb6ffd700 1 --2- 172.21.15.49:0/3150757516 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fedb80c6190 0x7fedb8156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:32.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.085+0000 7fedb77fe700 1 --2- 172.21.15.49:0/3150757516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb8098d10 0x7fedb81488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:32.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.085+0000 7fedb7fff700 1 --2- 172.21.15.49:0/3150757516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedb8158320 0x7fedb8157470 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fedb0005ad0 tx=0x7fedb00015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:32.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.085+0000 7fed9f7fe700 1 -- 172.21.15.49:0/3150757516 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb0005d30 con 0x7fedb8158320 2023-11-30T17:07:32.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.085+0000 7fed9f7fe700 1 -- 172.21.15.49:0/3150757516 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb0005e90 con 0x7fedb8158320 2023-11-30T17:07:32.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.085+0000 7fedbdcb3700 1 -- 172.21.15.49:0/3150757516 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb8155cf0 con 0x7fedb8158320 2023-11-30T17:07:32.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.085+0000 7fed9f7fe700 1 -- 172.21.15.49:0/3150757516 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb0007320 con 0x7fedb8158320 2023-11-30T17:07:32.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.085+0000 7fedbdcb3700 1 -- 172.21.15.49:0/3150757516 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb8156780 con 0x7fedb8158320 2023-11-30T17:07:32.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.086+0000 7fedbdcb3700 1 -- 172.21.15.49:0/3150757516 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb806c860 con 0x7fedb8158320 2023-11-30T17:07:32.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.086+0000 7fed9f7fe700 1 -- 172.21.15.49:0/3150757516 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fedb0007710 con 0x7fedb8158320 2023-11-30T17:07:32.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.087+0000 7fed9f7fe700 1 --2- 172.21.15.49:0/3150757516 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7feda405f120 0x7feda40615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:32.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.087+0000 7fed9f7fe700 1 -- 172.21.15.49:0/3150757516 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fedb007a1b0 con 0x7fedb8158320 2023-11-30T17:07:32.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.087+0000 7fedb77fe700 1 --2- 172.21.15.49:0/3150757516 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7feda405f120 0x7feda40615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:32.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.087+0000 7fedb77fe700 1 --2- 172.21.15.49:0/3150757516 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7feda405f120 0x7feda40615e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7feda8009760 tx=0x7feda8017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:32.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.091+0000 7fed9f7fe700 1 -- 172.21.15.49:0/3150757516 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fedb004b520 con 0x7fedb8158320 2023-11-30T17:07:32.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.263+0000 7fedbdcb3700 1 -- 172.21.15.49:0/3150757516 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fedb80c69a0 con 0x7fedb8158320 2023-11-30T17:07:32.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.264+0000 7fed9f7fe700 1 -- 172.21.15.49:0/3150757516 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fedb004eb40 con 0x7fedb8158320 2023-11-30T17:07:32.266 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T17:07:32.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.266+0000 7fedbdcb3700 1 -- 172.21.15.49:0/3150757516 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7feda405f120 msgr2=0x7feda40615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:32.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.266+0000 7fedbdcb3700 1 --2- 172.21.15.49:0/3150757516 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7feda405f120 0x7feda40615e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7feda8009760 tx=0x7feda8017000).stop 2023-11-30T17:07:32.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.266+0000 7fedbdcb3700 1 -- 172.21.15.49:0/3150757516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedb8158320 msgr2=0x7fedb8157470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:32.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.266+0000 7fedbdcb3700 1 --2- 172.21.15.49:0/3150757516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedb8158320 0x7fedb8157470 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fedb0005ad0 tx=0x7fedb00015b0).stop 2023-11-30T17:07:32.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.266+0000 7fedbdcb3700 1 -- 172.21.15.49:0/3150757516 shutdown_connections 2023-11-30T17:07:32.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.266+0000 7fedbdcb3700 1 --2- 172.21.15.49:0/3150757516 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7feda405f120 0x7feda40615e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:32.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.266+0000 7fedbdcb3700 1 --2- 172.21.15.49:0/3150757516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedb8158320 0x7fedb8157470 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:32.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.266+0000 7fedbdcb3700 1 --2- 172.21.15.49:0/3150757516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb8098d10 0x7fedb81488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:32.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.266+0000 7fedbdcb3700 1 --2- 172.21.15.49:0/3150757516 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fedb80c6190 0x7fedb8156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:32.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.266+0000 7fedbdcb3700 1 -- 172.21.15.49:0/3150757516 >> 172.21.15.49:0/3150757516 conn(0x7fedb80cb310 msgr2=0x7fedb80ca400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:32.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.266+0000 7fedbdcb3700 1 -- 172.21.15.49:0/3150757516 shutdown_connections 2023-11-30T17:07:32.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.266+0000 7fedbdcb3700 1 -- 172.21.15.49:0/3150757516 wait complete. 2023-11-30T17:07:32.279 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-30T17:07:32.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.401+0000 7f141ea35700 1 Processor -- start 2023-11-30T17:07:32.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.401+0000 7f141ea35700 1 -- start start 2023-11-30T17:07:32.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.402+0000 7f141ea35700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14181510d0 0x7f14180a6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:32.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.402+0000 7f141ea35700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f14181514b0 0x7f14180c37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:32.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.402+0000 7f141ea35700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1418063b40 con 0x7f14180bcea0 2023-11-30T17:07:32.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.402+0000 7f141ea35700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14180c2ce0 con 0x7f14181514b0 2023-11-30T17:07:32.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.402+0000 7f141ea35700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14180c2fc0 con 0x7f14181510d0 2023-11-30T17:07:32.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.402+0000 7f141d232700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f14181514b0 0x7f14180c37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:32.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.402+0000 7f141e234700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f14180bcea0 0x7f14180bd3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40696/0 (socket says 172.21.15.49:40696) 2023-11-30T17:07:32.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.402+0000 7f141e234700 1 -- 172.21.15.49:0/392409950 learned_addr learned my addr 172.21.15.49:0/392409950 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:32.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.403+0000 7f141da33700 1 --2- 172.21.15.49:0/392409950 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14181510d0 0x7f14180a6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:32.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.403+0000 7f141d232700 1 -- 172.21.15.49:0/392409950 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14181510d0 msgr2=0x7f14180a6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:32.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.403+0000 7f141d232700 1 --2- 172.21.15.49:0/392409950 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14181510d0 0x7f14180a6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:32.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.403+0000 7f141d232700 1 -- 172.21.15.49:0/392409950 >> v1:172.21.15.49:6789/0 conn(0x7f14180bcea0 legacy=0x7f14180bd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:32.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.403+0000 7f141ca31700 1 -- 172.21.15.49:0/392409950 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2666337056 0 0) 0x7f1418063b40 con 0x7f14180bcea0 2023-11-30T17:07:32.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.403+0000 7f141d232700 1 -- 172.21.15.49:0/392409950 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14180c32a0 con 0x7f14181514b0 2023-11-30T17:07:32.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.403+0000 7f141d232700 1 --2- 172.21.15.49:0/392409950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14181514b0 0x7f14180c37c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f140c009790 tx=0x7f140c009060).ready entity=mon.0 client_cookie=4a41cbaaa23e718d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:32.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.403+0000 7f141ca31700 1 -- 172.21.15.49:0/392409950 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c00b580 con 0x7f14181514b0 2023-11-30T17:07:32.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.403+0000 7f141ca31700 1 -- 172.21.15.49:0/392409950 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140c00b6e0 con 0x7f14181514b0 2023-11-30T17:07:32.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.403+0000 7f141ca31700 1 -- 172.21.15.49:0/392409950 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c00ba60 con 0x7f14181514b0 2023-11-30T17:07:32.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.404+0000 7f141ea35700 1 -- 172.21.15.49:0/392409950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14181514b0 msgr2=0x7f14180c37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:32.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.404+0000 7f141ea35700 1 --2- 172.21.15.49:0/392409950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14181514b0 0x7f14180c37c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f140c009790 tx=0x7f140c009060).stop 2023-11-30T17:07:32.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.404+0000 7f141ea35700 1 -- 172.21.15.49:0/392409950 shutdown_connections 2023-11-30T17:07:32.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.404+0000 7f141ea35700 1 --2- 172.21.15.49:0/392409950 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14181510d0 0x7f14180a6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:32.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.404+0000 7f141ea35700 1 --2- 172.21.15.49:0/392409950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14181514b0 0x7f14180c37c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:32.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.404+0000 7f141ea35700 1 -- 172.21.15.49:0/392409950 >> 172.21.15.49:0/392409950 conn(0x7f14180c4010 msgr2=0x7f14180c4420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:32.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.404+0000 7f141ea35700 1 -- 172.21.15.49:0/392409950 shutdown_connections 2023-11-30T17:07:32.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.404+0000 7f141ea35700 1 -- 172.21.15.49:0/392409950 wait complete. 2023-11-30T17:07:32.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.405+0000 7f141ea35700 1 Processor -- start 2023-11-30T17:07:32.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.405+0000 7f141ea35700 1 -- start start 2023-11-30T17:07:32.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.406+0000 7f141ea35700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14180bcea0 0x7f1418147250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:32.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.406+0000 7f141ea35700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14181510d0 0x7f14181536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:32.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.406+0000 7f141ea35700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14181514b0 0x7f1418166400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:32.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.406+0000 7f141ea35700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1418147740 con 0x7f14181514b0 2023-11-30T17:07:32.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.406+0000 7f141ea35700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14181479a0 con 0x7f14180bcea0 2023-11-30T17:07:32.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.406+0000 7f141ea35700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141814fa80 con 0x7f14181510d0 2023-11-30T17:07:32.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.406+0000 7f141e234700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14181514b0 0x7f1418166400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:32.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.406+0000 7f141e234700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14181514b0 0x7f1418166400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38026/0 (socket says 172.21.15.49:38026) 2023-11-30T17:07:32.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.406+0000 7f141e234700 1 -- 172.21.15.49:0/3298118551 learned_addr learned my addr 172.21.15.49:0/3298118551 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:32.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.406+0000 7f141da33700 1 --2- 172.21.15.49:0/3298118551 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14180bcea0 0x7f1418147250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:32.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.406+0000 7f141d232700 1 --2- 172.21.15.49:0/3298118551 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14181510d0 0x7f14181536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:32.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.406+0000 7f141e234700 1 -- 172.21.15.49:0/3298118551 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14181510d0 msgr2=0x7f14181536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:32.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.406+0000 7f141e234700 1 --2- 172.21.15.49:0/3298118551 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14181510d0 0x7f14181536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:32.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.406+0000 7f141e234700 1 -- 172.21.15.49:0/3298118551 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14180bcea0 msgr2=0x7f1418147250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:32.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.406+0000 7f141e234700 1 --2- 172.21.15.49:0/3298118551 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14180bcea0 0x7f1418147250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:32.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.406+0000 7f141e234700 1 -- 172.21.15.49:0/3298118551 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140c0092a0 con 0x7f14181514b0 2023-11-30T17:07:32.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.406+0000 7f141e234700 1 --2- 172.21.15.49:0/3298118551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14181514b0 0x7f1418166400 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f140800c490 tx=0x7f1408007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:32.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.406+0000 7f1415ffb700 1 -- 172.21.15.49:0/3298118551 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14080070d0 con 0x7f14181514b0 2023-11-30T17:07:32.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.406+0000 7f1415ffb700 1 -- 172.21.15.49:0/3298118551 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1408007230 con 0x7f14181514b0 2023-11-30T17:07:32.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.406+0000 7f141ea35700 1 -- 172.21.15.49:0/3298118551 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f141814fd60 con 0x7f14181514b0 2023-11-30T17:07:32.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.406+0000 7f1415ffb700 1 -- 172.21.15.49:0/3298118551 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14080075d0 con 0x7f14181514b0 2023-11-30T17:07:32.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.407+0000 7f141ea35700 1 -- 172.21.15.49:0/3298118551 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1418153bb0 con 0x7f14181514b0 2023-11-30T17:07:32.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.408+0000 7f141ea35700 1 -- 172.21.15.49:0/3298118551 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f141806c7c0 con 0x7f14181514b0 2023-11-30T17:07:32.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.408+0000 7f1415ffb700 1 -- 172.21.15.49:0/3298118551 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1408005bc0 con 0x7f14181514b0 2023-11-30T17:07:32.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.408+0000 7f1415ffb700 1 --2- 172.21.15.49:0/3298118551 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f140405f120 0x7f14040615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:32.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.408+0000 7f1415ffb700 1 -- 172.21.15.49:0/3298118551 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f14080799d0 con 0x7f14181514b0 2023-11-30T17:07:32.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.408+0000 7f141da33700 1 --2- 172.21.15.49:0/3298118551 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f140405f120 0x7f14040615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:32.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.409+0000 7f141da33700 1 --2- 172.21.15.49:0/3298118551 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f140405f120 0x7f14040615e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f14100075a0 tx=0x7f14100097b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:32.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.412+0000 7f1415ffb700 1 -- 172.21.15.49:0/3298118551 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f140804aca0 con 0x7f14181514b0 2023-11-30T17:07:32.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.582+0000 7f141ea35700 1 -- 172.21.15.49:0/3298118551 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f14180c2990 con 0x7f14181514b0 2023-11-30T17:07:32.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.582+0000 7f1415ffb700 1 -- 172.21.15.49:0/3298118551 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1408079020 con 0x7f14181514b0 2023-11-30T17:07:32.584 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T17:07:32.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.584+0000 7f141ea35700 1 -- 172.21.15.49:0/3298118551 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f140405f120 msgr2=0x7f14040615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:32.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.584+0000 7f141ea35700 1 --2- 172.21.15.49:0/3298118551 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f140405f120 0x7f14040615e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f14100075a0 tx=0x7f14100097b0).stop 2023-11-30T17:07:32.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.584+0000 7f141ea35700 1 -- 172.21.15.49:0/3298118551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14181514b0 msgr2=0x7f1418166400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:32.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.584+0000 7f141ea35700 1 --2- 172.21.15.49:0/3298118551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14181514b0 0x7f1418166400 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f140800c490 tx=0x7f1408007de0).stop 2023-11-30T17:07:32.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.584+0000 7f141ea35700 1 -- 172.21.15.49:0/3298118551 shutdown_connections 2023-11-30T17:07:32.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.584+0000 7f141ea35700 1 --2- 172.21.15.49:0/3298118551 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f140405f120 0x7f14040615e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:32.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.584+0000 7f141ea35700 1 --2- 172.21.15.49:0/3298118551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14181514b0 0x7f1418166400 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:32.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.584+0000 7f141ea35700 1 --2- 172.21.15.49:0/3298118551 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14180bcea0 0x7f1418147250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:32.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.584+0000 7f141ea35700 1 --2- 172.21.15.49:0/3298118551 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14181510d0 0x7f14181536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:32.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.584+0000 7f141ea35700 1 -- 172.21.15.49:0/3298118551 >> 172.21.15.49:0/3298118551 conn(0x7f14180c4010 msgr2=0x7f14180bd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:32.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.584+0000 7f141ea35700 1 -- 172.21.15.49:0/3298118551 shutdown_connections 2023-11-30T17:07:32.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.584+0000 7f141ea35700 1 -- 172.21.15.49:0/3298118551 wait complete. 2023-11-30T17:07:32.597 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:07:32.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.713+0000 7fed07431700 1 Processor -- start 2023-11-30T17:07:32.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.713+0000 7fed07431700 1 -- start start 2023-11-30T17:07:32.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.714+0000 7fed07431700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fed00064e20 0x7fed00155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:32.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.714+0000 7fed07431700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fed00095e80 0x7fed000962f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:32.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.714+0000 7fed07431700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed000967e0 con 0x7fed001544d0 2023-11-30T17:07:32.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.714+0000 7fed07431700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed00067650 con 0x7fed00095e80 2023-11-30T17:07:32.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.714+0000 7fed07431700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed000683d0 con 0x7fed00064e20 2023-11-30T17:07:32.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.714+0000 7fed059ce700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fed00095e80 0x7fed000962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:32.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.714+0000 7fed059ce700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fed00095e80 0x7fed000962f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38040/0 (socket says 172.21.15.49:38040) 2023-11-30T17:07:32.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.714+0000 7fed059ce700 1 -- 172.21.15.49:0/316718995 learned_addr learned my addr 172.21.15.49:0/316718995 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:32.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.715+0000 7fed049cc700 1 --2- 172.21.15.49:0/316718995 >> v2:172.21.15.115:3300/0 conn(0x7fed00064e20 0x7fed00155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:32.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.715+0000 7fed059ce700 1 -- 172.21.15.49:0/316718995 >> v2:172.21.15.115:3300/0 conn(0x7fed00064e20 msgr2=0x7fed00155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:32.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.715+0000 7fed059ce700 1 --2- 172.21.15.49:0/316718995 >> v2:172.21.15.115:3300/0 conn(0x7fed00064e20 0x7fed00155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:32.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.715+0000 7fed059ce700 1 -- 172.21.15.49:0/316718995 >> v1:172.21.15.115:6789/0 conn(0x7fed001544d0 legacy=0x7fed00066f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:32.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.715+0000 7fed059ce700 1 -- 172.21.15.49:0/316718995 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed00067850 con 0x7fed00095e80 2023-11-30T17:07:32.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.715+0000 7fed059ce700 1 --2- 172.21.15.49:0/316718995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed00095e80 0x7fed000962f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fed0006a7d0 tx=0x7fecf00090f0).ready entity=mon.0 client_cookie=b44ea0c55b024fbb server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:32.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.715+0000 7fecfffff700 1 -- 172.21.15.49:0/316718995 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf000b600 con 0x7fed00095e80 2023-11-30T17:07:32.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.715+0000 7fecfffff700 1 -- 172.21.15.49:0/316718995 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf000b760 con 0x7fed00095e80 2023-11-30T17:07:32.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.715+0000 7fecfffff700 1 -- 172.21.15.49:0/316718995 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf000bae0 con 0x7fed00095e80 2023-11-30T17:07:32.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.715+0000 7fed07431700 1 -- 172.21.15.49:0/316718995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed00095e80 msgr2=0x7fed000962f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:32.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.715+0000 7fed07431700 1 --2- 172.21.15.49:0/316718995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed00095e80 0x7fed000962f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fed0006a7d0 tx=0x7fecf00090f0).stop 2023-11-30T17:07:32.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.716+0000 7fed07431700 1 -- 172.21.15.49:0/316718995 shutdown_connections 2023-11-30T17:07:32.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.716+0000 7fed07431700 1 --2- 172.21.15.49:0/316718995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed00095e80 0x7fed000962f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:32.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.716+0000 7fed07431700 1 --2- 172.21.15.49:0/316718995 >> v2:172.21.15.115:3300/0 conn(0x7fed00064e20 0x7fed00155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:32.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.716+0000 7fed07431700 1 -- 172.21.15.49:0/316718995 >> 172.21.15.49:0/316718995 conn(0x7fed000631d0 msgr2=0x7fed000c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:32.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.716+0000 7fed07431700 1 -- 172.21.15.49:0/316718995 shutdown_connections 2023-11-30T17:07:32.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.716+0000 7fed07431700 1 -- 172.21.15.49:0/316718995 wait complete. 2023-11-30T17:07:32.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.717+0000 7fed07431700 1 Processor -- start 2023-11-30T17:07:32.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.717+0000 7fed07431700 1 -- start start 2023-11-30T17:07:32.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.718+0000 7fed07431700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed00064e20 0x7fed0014db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:32.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.718+0000 7fed07431700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed00095e80 0x7fed000a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:32.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.718+0000 7fed07431700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed001544d0 0x7fed000a7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:32.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.718+0000 7fed07431700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed000a7810 con 0x7fed001544d0 2023-11-30T17:07:32.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.718+0000 7fed07431700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed000ad920 con 0x7fed00064e20 2023-11-30T17:07:32.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.718+0000 7fed07431700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed000acd10 con 0x7fed00095e80 2023-11-30T17:07:32.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.718+0000 7fed059ce700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed001544d0 0x7fed000a7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:32.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.718+0000 7fed059ce700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed001544d0 0x7fed000a7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38048/0 (socket says 172.21.15.49:38048) 2023-11-30T17:07:32.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.718+0000 7fed059ce700 1 -- 172.21.15.49:0/1039887842 learned_addr learned my addr 172.21.15.49:0/1039887842 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:32.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.718+0000 7fed051cd700 1 --2- 172.21.15.49:0/1039887842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed00064e20 0x7fed0014db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:32.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.718+0000 7fed049cc700 1 --2- 172.21.15.49:0/1039887842 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed00095e80 0x7fed000a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:32.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.718+0000 7fed059ce700 1 -- 172.21.15.49:0/1039887842 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed00095e80 msgr2=0x7fed000a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:32.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.718+0000 7fed059ce700 1 --2- 172.21.15.49:0/1039887842 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed00095e80 0x7fed000a6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:32.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.718+0000 7fed059ce700 1 -- 172.21.15.49:0/1039887842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed00064e20 msgr2=0x7fed0014db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:32.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.718+0000 7fed059ce700 1 --2- 172.21.15.49:0/1039887842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed00064e20 0x7fed0014db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:32.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.718+0000 7fed059ce700 1 -- 172.21.15.49:0/1039887842 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf0009370 con 0x7fed001544d0 2023-11-30T17:07:32.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.718+0000 7fed059ce700 1 --2- 172.21.15.49:0/1039887842 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed001544d0 0x7fed000a7320 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fecf0009130 tx=0x7fecf0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:32.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.718+0000 7fecfd7fa700 1 -- 172.21.15.49:0/1039887842 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf000bae0 con 0x7fed001544d0 2023-11-30T17:07:32.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.719+0000 7fecfd7fa700 1 -- 172.21.15.49:0/1039887842 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf000bea0 con 0x7fed001544d0 2023-11-30T17:07:32.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.719+0000 7fed07431700 1 -- 172.21.15.49:0/1039887842 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed000acff0 con 0x7fed001544d0 2023-11-30T17:07:32.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.719+0000 7fecfd7fa700 1 -- 172.21.15.49:0/1039887842 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf001c670 con 0x7fed001544d0 2023-11-30T17:07:32.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.719+0000 7fed07431700 1 -- 172.21.15.49:0/1039887842 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed000ad5b0 con 0x7fed001544d0 2023-11-30T17:07:32.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.720+0000 7fed07431700 1 -- 172.21.15.49:0/1039887842 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed0006c860 con 0x7fed001544d0 2023-11-30T17:07:32.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.720+0000 7fecfd7fa700 1 -- 172.21.15.49:0/1039887842 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fecf001c9e0 con 0x7fed001544d0 2023-11-30T17:07:32.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.720+0000 7fecfd7fa700 1 --2- 172.21.15.49:0/1039887842 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fecec05f150 0x7fecec061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:32.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.720+0000 7fecfd7fa700 1 -- 172.21.15.49:0/1039887842 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fecf007bfd0 con 0x7fed001544d0 2023-11-30T17:07:32.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.720+0000 7fed051cd700 1 --2- 172.21.15.49:0/1039887842 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fecec05f150 0x7fecec061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:32.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.721+0000 7fed051cd700 1 --2- 172.21.15.49:0/1039887842 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fecec05f150 0x7fecec061610 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fed000c6350 tx=0x7fecf8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:32.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.724+0000 7fecfd7fa700 1 -- 172.21.15.49:0/1039887842 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fecf004d2a0 con 0x7fed001544d0 2023-11-30T17:07:32.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.942+0000 7fed07431700 1 -- 172.21.15.49:0/1039887842 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed00067b30 con 0x7fed001544d0 2023-11-30T17:07:32.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.942+0000 7fecfd7fa700 1 -- 172.21.15.49:0/1039887842 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4486 (secure 0 0 0) 0x7fecf002a070 con 0x7fed001544d0 2023-11-30T17:07:32.944 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:32.944 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/4055676379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":4055676379},{"type":"v1","addr":"172.21.15.115:6835","nonce":4055676379}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1595689264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1595689264},{"type":"v1","addr":"172.21.15.115:6837","nonce":1595689264}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/124650277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":124650277},{"type":"v1","addr":"172.21.15.49:6834","nonce":124650277}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:07:16.282510+0000","modified":"2023-11-30T17:07:19.293997+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2333639572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2333639572},{"type":"v1","addr":"172.21.15.49:6835","nonce":2333639572}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-11-30T17:07:32.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.944+0000 7fed07431700 1 -- 172.21.15.49:0/1039887842 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fecec05f150 msgr2=0x7fecec061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:32.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.944+0000 7fed07431700 1 --2- 172.21.15.49:0/1039887842 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fecec05f150 0x7fecec061610 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fed000c6350 tx=0x7fecf8009040).stop 2023-11-30T17:07:32.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.944+0000 7fed07431700 1 -- 172.21.15.49:0/1039887842 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed001544d0 msgr2=0x7fed000a7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:32.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.944+0000 7fed07431700 1 --2- 172.21.15.49:0/1039887842 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed001544d0 0x7fed000a7320 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fecf0009130 tx=0x7fecf0017000).stop 2023-11-30T17:07:32.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.944+0000 7fed07431700 1 -- 172.21.15.49:0/1039887842 shutdown_connections 2023-11-30T17:07:32.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.944+0000 7fed07431700 1 --2- 172.21.15.49:0/1039887842 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fecec05f150 0x7fecec061610 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:32.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.944+0000 7fed07431700 1 --2- 172.21.15.49:0/1039887842 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed001544d0 0x7fed000a7320 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:32.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.944+0000 7fed07431700 1 --2- 172.21.15.49:0/1039887842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed00064e20 0x7fed0014db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:32.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.944+0000 7fed07431700 1 --2- 172.21.15.49:0/1039887842 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed00095e80 0x7fed000a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:32.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.944+0000 7fed07431700 1 -- 172.21.15.49:0/1039887842 >> 172.21.15.49:0/1039887842 conn(0x7fed000631d0 msgr2=0x7fed000c4950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:32.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.944+0000 7fed07431700 1 -- 172.21.15.49:0/1039887842 shutdown_connections 2023-11-30T17:07:32.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:32.944+0000 7fed07431700 1 -- 172.21.15.49:0/1039887842 wait complete. 2023-11-30T17:07:32.947 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 8 2023-11-30T17:07:32.958 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:07:33.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.073+0000 7f6f89a5a700 1 Processor -- start 2023-11-30T17:07:33.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.074+0000 7f6f89a5a700 1 -- start start 2023-11-30T17:07:33.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.074+0000 7f6f89a5a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6f84152230 0x7f6f84156a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:33.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.074+0000 7f6f89a5a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f840a3da0 0x7f6f84066250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:33.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.074+0000 7f6f89a5a700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f840a4220 con 0x7f6f840686e0 2023-11-30T17:07:33.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.074+0000 7f6f89a5a700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f840bbed0 con 0x7f6f84152230 2023-11-30T17:07:33.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.074+0000 7f6f89a5a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f840bc1b0 con 0x7f6f840a3da0 2023-11-30T17:07:33.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.074+0000 7f6f82ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6f84152230 0x7f6f84156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:33.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.074+0000 7f6f82ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6f84152230 0x7f6f84156a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38056/0 (socket says 172.21.15.49:38056) 2023-11-30T17:07:33.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.075+0000 7f6f82ffd700 1 -- 172.21.15.49:0/743142153 learned_addr learned my addr 172.21.15.49:0/743142153 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:33.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.075+0000 7f6f827fc700 1 --2- 172.21.15.49:0/743142153 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f840a3da0 0x7f6f84066250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:33.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.075+0000 7f6f82ffd700 1 -- 172.21.15.49:0/743142153 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f840a3da0 msgr2=0x7f6f84066250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:33.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.075+0000 7f6f82ffd700 1 --2- 172.21.15.49:0/743142153 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f840a3da0 0x7f6f84066250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:33.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.075+0000 7f6f82ffd700 1 -- 172.21.15.49:0/743142153 >> v1:172.21.15.115:6789/0 conn(0x7f6f840686e0 legacy=0x7f6f840bcc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:33.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.075+0000 7f6f82ffd700 1 -- 172.21.15.49:0/743142153 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f840bc490 con 0x7f6f84152230 2023-11-30T17:07:33.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.075+0000 7f6f82ffd700 1 --2- 172.21.15.49:0/743142153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f84152230 0x7f6f84156a80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f6f7c009f20 tx=0x7f6f7c009840).ready entity=mon.0 client_cookie=6ca7700916bf043 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:33.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.075+0000 7f6f81ffb700 1 -- 172.21.15.49:0/743142153 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c00e070 con 0x7f6f84152230 2023-11-30T17:07:33.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.075+0000 7f6f81ffb700 1 -- 172.21.15.49:0/743142153 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7c00ba40 con 0x7f6f84152230 2023-11-30T17:07:33.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.075+0000 7f6f81ffb700 1 -- 172.21.15.49:0/743142153 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c00bdc0 con 0x7f6f84152230 2023-11-30T17:07:33.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.075+0000 7f6f89a5a700 1 -- 172.21.15.49:0/743142153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f84152230 msgr2=0x7f6f84156a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:33.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.075+0000 7f6f89a5a700 1 --2- 172.21.15.49:0/743142153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f84152230 0x7f6f84156a80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f6f7c009f20 tx=0x7f6f7c009840).stop 2023-11-30T17:07:33.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.076+0000 7f6f89a5a700 1 -- 172.21.15.49:0/743142153 shutdown_connections 2023-11-30T17:07:33.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.076+0000 7f6f89a5a700 1 --2- 172.21.15.49:0/743142153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f84152230 0x7f6f84156a80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:33.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.076+0000 7f6f89a5a700 1 --2- 172.21.15.49:0/743142153 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f840a3da0 0x7f6f84066250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:33.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.076+0000 7f6f89a5a700 1 -- 172.21.15.49:0/743142153 >> 172.21.15.49:0/743142153 conn(0x7f6f840631d0 msgr2=0x7f6f840c6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:33.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.076+0000 7f6f89a5a700 1 -- 172.21.15.49:0/743142153 shutdown_connections 2023-11-30T17:07:33.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.076+0000 7f6f89a5a700 1 -- 172.21.15.49:0/743142153 wait complete. 2023-11-30T17:07:33.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.077+0000 7f6f89a5a700 1 Processor -- start 2023-11-30T17:07:33.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.077+0000 7f6f89a5a700 1 -- start start 2023-11-30T17:07:33.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.078+0000 7f6f89a5a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f840686e0 0x7f6f840bf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:33.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.078+0000 7f6f89a5a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f840a3da0 0x7f6f840bfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:33.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.078+0000 7f6f89a5a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f84152230 0x7f6f840a6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:33.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.078+0000 7f6f89a5a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f84092560 con 0x7f6f840a3da0 2023-11-30T17:07:33.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.078+0000 7f6f89a5a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f84092b20 con 0x7f6f840686e0 2023-11-30T17:07:33.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.078+0000 7f6f89a5a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f840c0410 con 0x7f6f84152230 2023-11-30T17:07:33.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.078+0000 7f6f827fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f840a3da0 0x7f6f840bfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:33.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.078+0000 7f6f827fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f840a3da0 0x7f6f840bfe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38068/0 (socket says 172.21.15.49:38068) 2023-11-30T17:07:33.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.078+0000 7f6f827fc700 1 -- 172.21.15.49:0/951474928 learned_addr learned my addr 172.21.15.49:0/951474928 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:33.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.078+0000 7f6f82ffd700 1 --2- 172.21.15.49:0/951474928 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f840686e0 0x7f6f840bf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:33.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.078+0000 7f6f837fe700 1 --2- 172.21.15.49:0/951474928 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f84152230 0x7f6f840a6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:33.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.078+0000 7f6f827fc700 1 -- 172.21.15.49:0/951474928 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f84152230 msgr2=0x7f6f840a6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:33.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.078+0000 7f6f827fc700 1 --2- 172.21.15.49:0/951474928 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f84152230 0x7f6f840a6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:33.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.078+0000 7f6f827fc700 1 -- 172.21.15.49:0/951474928 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f840686e0 msgr2=0x7f6f840bf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:33.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.078+0000 7f6f827fc700 1 --2- 172.21.15.49:0/951474928 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f840686e0 0x7f6f840bf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:33.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.078+0000 7f6f827fc700 1 -- 172.21.15.49:0/951474928 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7c009ae0 con 0x7f6f840a3da0 2023-11-30T17:07:33.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.078+0000 7f6f827fc700 1 --2- 172.21.15.49:0/951474928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f840a3da0 0x7f6f840bfe40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f6f6c00c850 tx=0x7f6f6c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:33.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.078+0000 7f6f7affd700 1 -- 172.21.15.49:0/951474928 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c010580 con 0x7f6f840a3da0 2023-11-30T17:07:33.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.078+0000 7f6f7affd700 1 -- 172.21.15.49:0/951474928 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6c0106e0 con 0x7f6f840a3da0 2023-11-30T17:07:33.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.078+0000 7f6f89a5a700 1 -- 172.21.15.49:0/951474928 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f840c06f0 con 0x7f6f840a3da0 2023-11-30T17:07:33.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.078+0000 7f6f7affd700 1 -- 172.21.15.49:0/951474928 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c010a60 con 0x7f6f840a3da0 2023-11-30T17:07:33.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.079+0000 7f6f89a5a700 1 -- 172.21.15.49:0/951474928 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f840a90e0 con 0x7f6f840a3da0 2023-11-30T17:07:33.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.080+0000 7f6f89a5a700 1 -- 172.21.15.49:0/951474928 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f8406c860 con 0x7f6f840a3da0 2023-11-30T17:07:33.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.080+0000 7f6f7affd700 1 -- 172.21.15.49:0/951474928 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6f6c01b460 con 0x7f6f840a3da0 2023-11-30T17:07:33.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.080+0000 7f6f7affd700 1 --2- 172.21.15.49:0/951474928 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6f6405f150 0x7f6f64061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:33.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.080+0000 7f6f7affd700 1 -- 172.21.15.49:0/951474928 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6f6c07a000 con 0x7f6f840a3da0 2023-11-30T17:07:33.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.080+0000 7f6f82ffd700 1 --2- 172.21.15.49:0/951474928 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6f6405f150 0x7f6f64061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:33.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.081+0000 7f6f82ffd700 1 --2- 172.21.15.49:0/951474928 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6f6405f150 0x7f6f64061610 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f6f7c00c010 tx=0x7f6f7c009840).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:33.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.084+0000 7f6f7affd700 1 -- 172.21.15.49:0/951474928 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6f6c04b270 con 0x7f6f840a3da0 2023-11-30T17:07:33.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.259+0000 7f6f89a5a700 1 -- 172.21.15.49:0/951474928 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f8414dfa0 con 0x7f6f840a3da0 2023-11-30T17:07:33.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.260+0000 7f6f7affd700 1 -- 172.21.15.49:0/951474928 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f6f6c04e890 con 0x7f6f840a3da0 2023-11-30T17:07:33.261 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:33.262 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":22,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:07:17.283998+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:07:14.837882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-30T17:07:15.248549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:07:33.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.261+0000 7f6f89a5a700 1 -- 172.21.15.49:0/951474928 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6f6405f150 msgr2=0x7f6f64061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:33.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.261+0000 7f6f89a5a700 1 --2- 172.21.15.49:0/951474928 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6f6405f150 0x7f6f64061610 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f6f7c00c010 tx=0x7f6f7c009840).stop 2023-11-30T17:07:33.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.261+0000 7f6f89a5a700 1 -- 172.21.15.49:0/951474928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f840a3da0 msgr2=0x7f6f840bfe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:33.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.261+0000 7f6f89a5a700 1 --2- 172.21.15.49:0/951474928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f840a3da0 0x7f6f840bfe40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f6f6c00c850 tx=0x7f6f6c008040).stop 2023-11-30T17:07:33.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.261+0000 7f6f89a5a700 1 -- 172.21.15.49:0/951474928 shutdown_connections 2023-11-30T17:07:33.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.261+0000 7f6f89a5a700 1 --2- 172.21.15.49:0/951474928 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f84152230 0x7f6f840a6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:33.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.261+0000 7f6f89a5a700 1 --2- 172.21.15.49:0/951474928 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f840686e0 0x7f6f840bf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:33.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.261+0000 7f6f89a5a700 1 --2- 172.21.15.49:0/951474928 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6f6405f150 0x7f6f64061610 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:33.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.261+0000 7f6f89a5a700 1 --2- 172.21.15.49:0/951474928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f840a3da0 0x7f6f840bfe40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:33.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.261+0000 7f6f89a5a700 1 -- 172.21.15.49:0/951474928 >> 172.21.15.49:0/951474928 conn(0x7f6f840631d0 msgr2=0x7f6f840c5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:33.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.261+0000 7f6f89a5a700 1 -- 172.21.15.49:0/951474928 shutdown_connections 2023-11-30T17:07:33.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.261+0000 7f6f89a5a700 1 -- 172.21.15.49:0/951474928 wait complete. 2023-11-30T17:07:33.275 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-30T17:07:14.837882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-30T17:07:15.248549+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-30T17:07:33.276 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T17:07:33.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.394+0000 7f4c0477c700 1 Processor -- start 2023-11-30T17:07:33.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.394+0000 7f4c0477c700 1 -- start start 2023-11-30T17:07:33.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.395+0000 7f4c0477c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4bfc0bcdd0 0x7f4bfc14eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:33.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.395+0000 7f4c0477c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4bfc062770 0x7f4bfc062b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:33.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.395+0000 7f4c0477c700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bfc0634a0 con 0x7f4bfc14eb00 2023-11-30T17:07:33.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.395+0000 7f4c0477c700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bfc137d90 con 0x7f4bfc0bcdd0 2023-11-30T17:07:33.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.395+0000 7f4c0477c700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bfc063780 con 0x7f4bfc062770 2023-11-30T17:07:33.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.396+0000 7f4c02518700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4bfc14eb00 0x7f4bfc0bc6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40698/0 (socket says 172.21.15.49:40698) 2023-11-30T17:07:33.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.396+0000 7f4c01d17700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4bfc0bcdd0 0x7f4bfc14eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:33.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.396+0000 7f4c02518700 1 -- 172.21.15.49:0/2608249643 learned_addr learned my addr 172.21.15.49:0/2608249643 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:33.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.396+0000 7f4c02d19700 1 --2- 172.21.15.49:0/2608249643 >> v2:172.21.15.115:3300/0 conn(0x7f4bfc062770 0x7f4bfc062b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:33.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.396+0000 7f4c01516700 1 -- 172.21.15.49:0/2608249643 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1070385911 0 0) 0x7f4bfc0634a0 con 0x7f4bfc14eb00 2023-11-30T17:07:33.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.396+0000 7f4c01516700 1 -- 172.21.15.49:0/2608249643 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be40033f0 con 0x7f4bfc14eb00 2023-11-30T17:07:33.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.396+0000 7f4c01d17700 1 -- 172.21.15.49:0/2608249643 >> v2:172.21.15.115:3300/0 conn(0x7f4bfc062770 msgr2=0x7f4bfc062b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:33.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.396+0000 7f4c01d17700 1 --2- 172.21.15.49:0/2608249643 >> v2:172.21.15.115:3300/0 conn(0x7f4bfc062770 0x7f4bfc062b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:33.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.396+0000 7f4c01d17700 1 -- 172.21.15.49:0/2608249643 >> v1:172.21.15.49:6789/0 conn(0x7f4bfc14eb00 legacy=0x7f4bfc0bc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:33.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.396+0000 7f4c01d17700 1 -- 172.21.15.49:0/2608249643 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bfc063a60 con 0x7f4bfc0bcdd0 2023-11-30T17:07:33.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.396+0000 7f4c02d19700 1 --2- 172.21.15.49:0/2608249643 >> v2:172.21.15.115:3300/0 conn(0x7f4bfc062770 0x7f4bfc062b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:33.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.396+0000 7f4c01d17700 1 --2- 172.21.15.49:0/2608249643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bfc0bcdd0 0x7f4bfc14eee0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f4bfc0601b0 tx=0x7f4bf0006f40).ready entity=mon.0 client_cookie=5fe84126127af19b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:33.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.396+0000 7f4c01516700 1 -- 172.21.15.49:0/2608249643 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0005880 con 0x7f4bfc0bcdd0 2023-11-30T17:07:33.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.396+0000 7f4c01516700 1 -- 172.21.15.49:0/2608249643 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf00059e0 con 0x7f4bfc0bcdd0 2023-11-30T17:07:33.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.396+0000 7f4c01516700 1 -- 172.21.15.49:0/2608249643 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0005d60 con 0x7f4bfc0bcdd0 2023-11-30T17:07:33.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.397+0000 7f4c0477c700 1 -- 172.21.15.49:0/2608249643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bfc0bcdd0 msgr2=0x7f4bfc14eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:33.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.397+0000 7f4c0477c700 1 --2- 172.21.15.49:0/2608249643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bfc0bcdd0 0x7f4bfc14eee0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f4bfc0601b0 tx=0x7f4bf0006f40).stop 2023-11-30T17:07:33.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.397+0000 7f4c0477c700 1 -- 172.21.15.49:0/2608249643 shutdown_connections 2023-11-30T17:07:33.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.397+0000 7f4c0477c700 1 --2- 172.21.15.49:0/2608249643 >> v2:172.21.15.115:3300/0 conn(0x7f4bfc062770 0x7f4bfc062b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:33.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.397+0000 7f4c0477c700 1 --2- 172.21.15.49:0/2608249643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bfc0bcdd0 0x7f4bfc14eee0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:33.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.397+0000 7f4c0477c700 1 -- 172.21.15.49:0/2608249643 >> 172.21.15.49:0/2608249643 conn(0x7f4bfc0c8230 msgr2=0x7f4bfc0c4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:33.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.397+0000 7f4c0477c700 1 -- 172.21.15.49:0/2608249643 shutdown_connections 2023-11-30T17:07:33.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.397+0000 7f4c0477c700 1 -- 172.21.15.49:0/2608249643 wait complete. 2023-11-30T17:07:33.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.398+0000 7f4c0477c700 1 Processor -- start 2023-11-30T17:07:33.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.398+0000 7f4c0477c700 1 -- start start 2023-11-30T17:07:33.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.399+0000 7f4c0477c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4bfc062770 0x7f4bfc138bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:33.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.399+0000 7f4c0477c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bfc0bcdd0 0x7f4bfc136820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:33.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.399+0000 7f4c0477c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4bfc14eb00 0x7f4bfc0acaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:33.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.399+0000 7f4c0477c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc136d10 con 0x7f4bfc0bcdd0 2023-11-30T17:07:33.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.399+0000 7f4c0477c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc0aa7b0 con 0x7f4bfc062770 2023-11-30T17:07:33.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.399+0000 7f4c0477c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc0ad340 con 0x7f4bfc14eb00 2023-11-30T17:07:33.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.399+0000 7f4c01d17700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bfc0bcdd0 0x7f4bfc136820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:33.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.399+0000 7f4c01d17700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bfc0bcdd0 0x7f4bfc136820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38092/0 (socket says 172.21.15.49:38092) 2023-11-30T17:07:33.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.399+0000 7f4c01d17700 1 -- 172.21.15.49:0/661515536 learned_addr learned my addr 172.21.15.49:0/661515536 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:33.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.399+0000 7f4c02518700 1 --2- 172.21.15.49:0/661515536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4bfc062770 0x7f4bfc138bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:33.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.399+0000 7f4c02d19700 1 --2- 172.21.15.49:0/661515536 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4bfc14eb00 0x7f4bfc0acaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:33.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.399+0000 7f4c01d17700 1 -- 172.21.15.49:0/661515536 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4bfc14eb00 msgr2=0x7f4bfc0acaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:33.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.399+0000 7f4c01d17700 1 --2- 172.21.15.49:0/661515536 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4bfc14eb00 0x7f4bfc0acaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:33.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.399+0000 7f4c01d17700 1 -- 172.21.15.49:0/661515536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4bfc062770 msgr2=0x7f4bfc138bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:33.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.399+0000 7f4c01d17700 1 --2- 172.21.15.49:0/661515536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4bfc062770 0x7f4bfc138bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:33.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.399+0000 7f4c01d17700 1 -- 172.21.15.49:0/661515536 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf0009250 con 0x7f4bfc0bcdd0 2023-11-30T17:07:33.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.399+0000 7f4c02d19700 1 --2- 172.21.15.49:0/661515536 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4bfc14eb00 0x7f4bfc0acaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:33.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.399+0000 7f4c01d17700 1 --2- 172.21.15.49:0/661515536 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bfc0bcdd0 0x7f4bfc136820 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f4bf0006fa0 tx=0x7f4bf0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:33.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.399+0000 7f4bfa7fc700 1 -- 172.21.15.49:0/661515536 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0002f50 con 0x7f4bfc0bcdd0 2023-11-30T17:07:33.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.399+0000 7f4bfa7fc700 1 -- 172.21.15.49:0/661515536 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf000f720 con 0x7f4bfc0bcdd0 2023-11-30T17:07:33.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.399+0000 7f4bfa7fc700 1 -- 172.21.15.49:0/661515536 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf000fac0 con 0x7f4bfc0bcdd0 2023-11-30T17:07:33.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.399+0000 7f4c0477c700 1 -- 172.21.15.49:0/661515536 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bfc0aaa50 con 0x7f4bfc0bcdd0 2023-11-30T17:07:33.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.400+0000 7f4c0477c700 1 -- 172.21.15.49:0/661515536 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bfc0ad620 con 0x7f4bfc0bcdd0 2023-11-30T17:07:33.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.401+0000 7f4c0477c700 1 -- 172.21.15.49:0/661515536 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bfc06c860 con 0x7f4bfc0bcdd0 2023-11-30T17:07:33.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.401+0000 7f4bfa7fc700 1 -- 172.21.15.49:0/661515536 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4bf0026460 con 0x7f4bfc0bcdd0 2023-11-30T17:07:33.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.401+0000 7f4bfa7fc700 1 --2- 172.21.15.49:0/661515536 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4be805f150 0x7f4be8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:33.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.401+0000 7f4bfa7fc700 1 -- 172.21.15.49:0/661515536 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4bf007b460 con 0x7f4bfc0bcdd0 2023-11-30T17:07:33.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.401+0000 7f4c02518700 1 --2- 172.21.15.49:0/661515536 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4be805f150 0x7f4be8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:33.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.402+0000 7f4c02518700 1 --2- 172.21.15.49:0/661515536 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4be805f150 0x7f4be8061610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f4bf4007fd0 tx=0x7f4bf4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:33.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.405+0000 7f4bfa7fc700 1 -- 172.21.15.49:0/661515536 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4bf004c6d0 con 0x7f4bfc0bcdd0 2023-11-30T17:07:33.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.575+0000 7f4c0477c700 1 -- 172.21.15.49:0/661515536 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4bfc0c4ac0 con 0x7f4bfc0bcdd0 2023-11-30T17:07:33.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.576+0000 7f4bfa7fc700 1 -- 172.21.15.49:0/661515536 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4bf004fcf0 con 0x7f4bfc0bcdd0 2023-11-30T17:07:33.578 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T17:07:33.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.578+0000 7f4c0477c700 1 -- 172.21.15.49:0/661515536 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4be805f150 msgr2=0x7f4be8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:33.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.578+0000 7f4c0477c700 1 --2- 172.21.15.49:0/661515536 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4be805f150 0x7f4be8061610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f4bf4007fd0 tx=0x7f4bf4009040).stop 2023-11-30T17:07:33.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.578+0000 7f4c0477c700 1 -- 172.21.15.49:0/661515536 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bfc0bcdd0 msgr2=0x7f4bfc136820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:33.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.578+0000 7f4c0477c700 1 --2- 172.21.15.49:0/661515536 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bfc0bcdd0 0x7f4bfc136820 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f4bf0006fa0 tx=0x7f4bf0016000).stop 2023-11-30T17:07:33.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.578+0000 7f4c0477c700 1 -- 172.21.15.49:0/661515536 shutdown_connections 2023-11-30T17:07:33.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.578+0000 7f4c0477c700 1 --2- 172.21.15.49:0/661515536 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4bfc14eb00 0x7f4bfc0acaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:33.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.578+0000 7f4c0477c700 1 --2- 172.21.15.49:0/661515536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4bfc062770 0x7f4bfc138bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:33.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.578+0000 7f4c0477c700 1 --2- 172.21.15.49:0/661515536 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4be805f150 0x7f4be8061610 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:33.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.578+0000 7f4c0477c700 1 --2- 172.21.15.49:0/661515536 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bfc0bcdd0 0x7f4bfc136820 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:33.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.578+0000 7f4c0477c700 1 -- 172.21.15.49:0/661515536 >> 172.21.15.49:0/661515536 conn(0x7f4bfc0c8230 msgr2=0x7f4bfc0c27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:33.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.578+0000 7f4c0477c700 1 -- 172.21.15.49:0/661515536 shutdown_connections 2023-11-30T17:07:33.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.578+0000 7f4c0477c700 1 -- 172.21.15.49:0/661515536 wait complete. 2023-11-30T17:07:33.592 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T17:07:33.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.712+0000 7f3e7e091700 1 Processor -- start 2023-11-30T17:07:33.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.712+0000 7f3e7e091700 1 -- start start 2023-11-30T17:07:33.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.713+0000 7f3e7e091700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e78098d10 0x7f3e780c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:33.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.713+0000 7f3e7e091700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e780c72d0 con 0x7f3e78158320 2023-11-30T17:07:33.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.713+0000 7f3e7e091700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e78064570 con 0x7f3e780c6190 2023-11-30T17:07:33.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.713+0000 7f3e7e091700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e78154bc0 con 0x7f3e78098d10 2023-11-30T17:07:33.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.713+0000 7f3e77fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3e78158320 0x7f3e780a80f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40704/0 (socket says 172.21.15.49:40704) 2023-11-30T17:07:33.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.713+0000 7f3e77fff700 1 -- 172.21.15.49:0/1747858508 learned_addr learned my addr 172.21.15.49:0/1747858508 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:33.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.713+0000 7f3e777fe700 1 --2- 172.21.15.49:0/1747858508 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e78098d10 0x7f3e780c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:33.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.713+0000 7f3e767fc700 1 -- 172.21.15.49:0/1747858508 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1898877828 0 0) 0x7f3e780c72d0 con 0x7f3e78158320 2023-11-30T17:07:33.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.713+0000 7f3e767fc700 1 -- 172.21.15.49:0/1747858508 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e600033f0 con 0x7f3e78158320 2023-11-30T17:07:33.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.714+0000 7f3e767fc700 1 -- 172.21.15.49:0/1747858508 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 887691035 0 0) 0x7f3e600033f0 con 0x7f3e78158320 2023-11-30T17:07:33.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.714+0000 7f3e767fc700 1 -- 172.21.15.49:0/1747858508 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e78098d10 msgr2=0x7f3e780c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:33.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.714+0000 7f3e767fc700 1 --2- 172.21.15.49:0/1747858508 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e78098d10 0x7f3e780c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:33.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.714+0000 7f3e767fc700 1 -- 172.21.15.49:0/1747858508 >> v1:172.21.15.115:6789/0 conn(0x7f3e780c6190 legacy=0x7f3e78063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:33.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.714+0000 7f3e767fc700 1 -- 172.21.15.49:0/1747858508 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e780c66c0 con 0x7f3e78158320 2023-11-30T17:07:33.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.714+0000 7f3e767fc700 1 -- 172.21.15.49:0/1747858508 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f3e700017f0 con 0x7f3e78158320 2023-11-30T17:07:33.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.714+0000 7f3e767fc700 1 -- 172.21.15.49:0/1747858508 >> v1:172.21.15.49:6789/0 conn(0x7f3e78158320 legacy=0x7f3e780a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:33.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.714+0000 7f3e767fc700 1 --2- 172.21.15.49:0/1747858508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e60003910 0x7f3e60003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:33.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.714+0000 7f3e767fc700 1 --2- 172.21.15.49:0/1747858508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e60004690 0x7f3e60004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:33.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.714+0000 7f3e767fc700 1 --2- 172.21.15.49:0/1747858508 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e78098d10 0x7f3e60005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:33.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.714+0000 7f3e767fc700 1 -- 172.21.15.49:0/1747858508 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e78154bc0 con 0x7f3e60004690 2023-11-30T17:07:33.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.714+0000 7f3e767fc700 1 -- 172.21.15.49:0/1747858508 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6000b8e0 con 0x7f3e60003910 2023-11-30T17:07:33.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.714+0000 7f3e767fc700 1 -- 172.21.15.49:0/1747858508 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6000ba50 con 0x7f3e78098d10 2023-11-30T17:07:33.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.714+0000 7f3e76ffd700 1 --2- 172.21.15.49:0/1747858508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e60004690 0x7f3e60004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:33.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.714+0000 7f3e777fe700 1 --2- 172.21.15.49:0/1747858508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e60003910 0x7f3e60003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:33.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.714+0000 7f3e77fff700 1 --2- 172.21.15.49:0/1747858508 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e78098d10 0x7f3e60005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:33.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.714+0000 7f3e76ffd700 1 -- 172.21.15.49:0/1747858508 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e78098d10 msgr2=0x7f3e60005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.714+0000 7f3e76ffd700 1 --2- 172.21.15.49:0/1747858508 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e78098d10 0x7f3e60005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.714+0000 7f3e76ffd700 1 -- 172.21.15.49:0/1747858508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e60003910 msgr2=0x7f3e60003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.714+0000 7f3e76ffd700 1 --2- 172.21.15.49:0/1747858508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e60003910 0x7f3e60003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.714+0000 7f3e76ffd700 1 -- 172.21.15.49:0/1747858508 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e600033f0 con 0x7f3e60004690 2023-11-30T17:07:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.714+0000 7f3e76ffd700 1 --2- 172.21.15.49:0/1747858508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e60004690 0x7f3e60004b10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f3e78084960 tx=0x7f3e6c007bb0).ready entity=mon.0 client_cookie=a51dbcc07231c7b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.714+0000 7f3e767fc700 1 -- 172.21.15.49:0/1747858508 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c012400 con 0x7f3e60004690 2023-11-30T17:07:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.715+0000 7f3e767fc700 1 -- 172.21.15.49:0/1747858508 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6c012560 con 0x7f3e60004690 2023-11-30T17:07:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.715+0000 7f3e767fc700 1 -- 172.21.15.49:0/1747858508 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c012920 con 0x7f3e60004690 2023-11-30T17:07:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.715+0000 7f3e7e091700 1 -- 172.21.15.49:0/1747858508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e60004690 msgr2=0x7f3e60004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.715+0000 7f3e7e091700 1 --2- 172.21.15.49:0/1747858508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e60004690 0x7f3e60004b10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f3e78084960 tx=0x7f3e6c007bb0).stop 2023-11-30T17:07:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.715+0000 7f3e77fff700 1 -- 172.21.15.49:0/1747858508 reap_dead start 2023-11-30T17:07:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.715+0000 7f3e7e091700 1 -- 172.21.15.49:0/1747858508 shutdown_connections 2023-11-30T17:07:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.715+0000 7f3e7e091700 1 -- 172.21.15.49:0/1747858508 >> 172.21.15.49:0/1747858508 conn(0x7f3e780cb310 msgr2=0x7f3e780cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.715+0000 7f3e7e091700 1 -- 172.21.15.49:0/1747858508 shutdown_connections 2023-11-30T17:07:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.715+0000 7f3e7e091700 1 -- 172.21.15.49:0/1747858508 wait complete. 2023-11-30T17:07:33.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.716+0000 7f3e7e091700 1 Processor -- start 2023-11-30T17:07:33.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.716+0000 7f3e7e091700 1 -- start start 2023-11-30T17:07:33.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.717+0000 7f3e7e091700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e60004690 0x7f3e780ca080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:33.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.717+0000 7f3e7e091700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e7814ea70 0x7f3e780af450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:33.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.717+0000 7f3e7e091700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e780af940 0x7f3e78154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:33.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.717+0000 7f3e7e091700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e780c9bf0 con 0x7f3e780af940 2023-11-30T17:07:33.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.717+0000 7f3e7e091700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7814eef0 con 0x7f3e60004690 2023-11-30T17:07:33.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.717+0000 7f3e7e091700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e780c8fe0 con 0x7f3e7814ea70 2023-11-30T17:07:33.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.717+0000 7f3e77fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e780af940 0x7f3e78154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:33.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.717+0000 7f3e77fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e780af940 0x7f3e78154dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38112/0 (socket says 172.21.15.49:38112) 2023-11-30T17:07:33.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.717+0000 7f3e77fff700 1 -- 172.21.15.49:0/1143785964 learned_addr learned my addr 172.21.15.49:0/1143785964 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:33.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.717+0000 7f3e777fe700 1 --2- 172.21.15.49:0/1143785964 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e60004690 0x7f3e780ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:33.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.717+0000 7f3e76ffd700 1 --2- 172.21.15.49:0/1143785964 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e7814ea70 0x7f3e780af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:33.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.718+0000 7f3e77fff700 1 -- 172.21.15.49:0/1143785964 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e7814ea70 msgr2=0x7f3e780af450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:33.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.718+0000 7f3e77fff700 1 --2- 172.21.15.49:0/1143785964 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e7814ea70 0x7f3e780af450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:33.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.718+0000 7f3e77fff700 1 -- 172.21.15.49:0/1143785964 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e60004690 msgr2=0x7f3e780ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:33.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.718+0000 7f3e77fff700 1 --2- 172.21.15.49:0/1143785964 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e60004690 0x7f3e780ca080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:33.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.718+0000 7f3e77fff700 1 -- 172.21.15.49:0/1143785964 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e780c92c0 con 0x7f3e780af940 2023-11-30T17:07:33.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.718+0000 7f3e77fff700 1 --2- 172.21.15.49:0/1143785964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e780af940 0x7f3e78154dc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f3e78083fb0 tx=0x7f3e70001d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:33.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.718+0000 7f3e5f7fe700 1 -- 172.21.15.49:0/1143785964 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e70007a40 con 0x7f3e780af940 2023-11-30T17:07:33.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.718+0000 7f3e5f7fe700 1 -- 172.21.15.49:0/1143785964 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7000f8a0 con 0x7f3e780af940 2023-11-30T17:07:33.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.718+0000 7f3e7e091700 1 -- 172.21.15.49:0/1143785964 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e780c95a0 con 0x7f3e780af940 2023-11-30T17:07:33.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.718+0000 7f3e5f7fe700 1 -- 172.21.15.49:0/1143785964 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7000fc20 con 0x7f3e780af940 2023-11-30T17:07:33.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.718+0000 7f3e7e091700 1 -- 172.21.15.49:0/1143785964 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e780c8c70 con 0x7f3e780af940 2023-11-30T17:07:33.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.719+0000 7f3e7e091700 1 -- 172.21.15.49:0/1143785964 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e7806c860 con 0x7f3e780af940 2023-11-30T17:07:33.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.719+0000 7f3e5f7fe700 1 -- 172.21.15.49:0/1143785964 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3e7001c360 con 0x7f3e780af940 2023-11-30T17:07:33.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.719+0000 7f3e5f7fe700 1 --2- 172.21.15.49:0/1143785964 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3e6405f150 0x7f3e64061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:33.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.720+0000 7f3e5f7fe700 1 -- 172.21.15.49:0/1143785964 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3e70079a40 con 0x7f3e780af940 2023-11-30T17:07:33.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.720+0000 7f3e777fe700 1 --2- 172.21.15.49:0/1143785964 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3e6405f150 0x7f3e64061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:33.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.720+0000 7f3e777fe700 1 --2- 172.21.15.49:0/1143785964 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3e6405f150 0x7f3e64061610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f3e68006d80 tx=0x7f3e68009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:33.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.724+0000 7f3e5f7fe700 1 -- 172.21.15.49:0/1143785964 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3e7007be60 con 0x7f3e780af940 2023-11-30T17:07:33.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.896+0000 7f3e7e091700 1 -- 172.21.15.49:0/1143785964 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3e780c69a0 con 0x7f3e780af940 2023-11-30T17:07:33.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.896+0000 7f3e5f7fe700 1 -- 172.21.15.49:0/1143785964 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3e70019020 con 0x7f3e780af940 2023-11-30T17:07:33.898 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T17:07:33.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.898+0000 7f3e7e091700 1 -- 172.21.15.49:0/1143785964 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3e6405f150 msgr2=0x7f3e64061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:33.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.898+0000 7f3e7e091700 1 --2- 172.21.15.49:0/1143785964 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3e6405f150 0x7f3e64061610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f3e68006d80 tx=0x7f3e68009060).stop 2023-11-30T17:07:33.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.898+0000 7f3e7e091700 1 -- 172.21.15.49:0/1143785964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e780af940 msgr2=0x7f3e78154dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:33.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.898+0000 7f3e7e091700 1 --2- 172.21.15.49:0/1143785964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e780af940 0x7f3e78154dc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f3e78083fb0 tx=0x7f3e70001d10).stop 2023-11-30T17:07:33.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.898+0000 7f3e7e091700 1 -- 172.21.15.49:0/1143785964 shutdown_connections 2023-11-30T17:07:33.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.898+0000 7f3e7e091700 1 --2- 172.21.15.49:0/1143785964 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3e6405f150 0x7f3e64061610 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:33.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.898+0000 7f3e7e091700 1 --2- 172.21.15.49:0/1143785964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e780af940 0x7f3e78154dc0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:33.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.898+0000 7f3e7e091700 1 --2- 172.21.15.49:0/1143785964 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e60004690 0x7f3e780ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:33.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.898+0000 7f3e7e091700 1 --2- 172.21.15.49:0/1143785964 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e7814ea70 0x7f3e780af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:33.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.898+0000 7f3e7e091700 1 -- 172.21.15.49:0/1143785964 >> 172.21.15.49:0/1143785964 conn(0x7f3e780cb310 msgr2=0x7f3e781529b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:33.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.898+0000 7f3e7e091700 1 -- 172.21.15.49:0/1143785964 shutdown_connections 2023-11-30T17:07:33.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:33.898+0000 7f3e7e091700 1 -- 172.21.15.49:0/1143785964 wait complete. 2023-11-30T17:07:33.912 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-30T17:07:34.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.031+0000 7f6ed08f8700 1 Processor -- start 2023-11-30T17:07:34.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.031+0000 7f6ed08f8700 1 -- start start 2023-11-30T17:07:34.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.032+0000 7f6ed08f8700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6ecc14e530 0x7f6ecc0c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:34.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.032+0000 7f6ed08f8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ecc154950 0x7f6ecc14e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:34.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.032+0000 7f6ed08f8700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6ecc158570 0x7f6ecc158a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:34.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.032+0000 7f6ed08f8700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ecc0c7bc0 con 0x7f6ecc14e530 2023-11-30T17:07:34.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.032+0000 7f6ed08f8700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ecc155920 con 0x7f6ecc158570 2023-11-30T17:07:34.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.032+0000 7f6ed08f8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc154dd0 con 0x7f6ecc154950 2023-11-30T17:07:34.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.032+0000 7f6ecad9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6ecc14e530 0x7f6ecc0c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:34.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.032+0000 7f6ecad9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6ecc14e530 0x7f6ecc0c66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38116/0 (socket says 172.21.15.49:38116) 2023-11-30T17:07:34.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.032+0000 7f6ecad9d700 1 -- 172.21.15.49:0/3312878048 learned_addr learned my addr 172.21.15.49:0/3312878048 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:34.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.032+0000 7f6ecb59e700 1 --2- 172.21.15.49:0/3312878048 >> v2:172.21.15.115:3300/0 conn(0x7f6ecc158570 0x7f6ecc158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:34.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.032+0000 7f6eca59c700 1 --2- 172.21.15.49:0/3312878048 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ecc154950 0x7f6ecc14e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:34.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.032+0000 7f6ecad9d700 1 -- 172.21.15.49:0/3312878048 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ecc154950 msgr2=0x7f6ecc14e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:34.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.032+0000 7f6ecad9d700 1 --2- 172.21.15.49:0/3312878048 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ecc154950 0x7f6ecc14e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:34.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.032+0000 7f6ecad9d700 1 -- 172.21.15.49:0/3312878048 >> v2:172.21.15.115:3300/0 conn(0x7f6ecc158570 msgr2=0x7f6ecc158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:34.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.032+0000 7f6ecad9d700 1 --2- 172.21.15.49:0/3312878048 >> v2:172.21.15.115:3300/0 conn(0x7f6ecc158570 0x7f6ecc158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:34.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.032+0000 7f6ecad9d700 1 -- 172.21.15.49:0/3312878048 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ecc155080 con 0x7f6ecc14e530 2023-11-30T17:07:34.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.032+0000 7f6ecad9d700 1 --2- 172.21.15.49:0/3312878048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ecc14e530 0x7f6ecc0c66f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f6ecc0644d0 tx=0x7f6ec4009840).ready entity=mon.0 client_cookie=9812c21f0ec4617e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:34.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.032+0000 7f6ec9d9b700 1 -- 172.21.15.49:0/3312878048 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec400e070 con 0x7f6ecc14e530 2023-11-30T17:07:34.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.032+0000 7f6ec9d9b700 1 -- 172.21.15.49:0/3312878048 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec400b970 con 0x7f6ecc14e530 2023-11-30T17:07:34.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.032+0000 7f6ec9d9b700 1 -- 172.21.15.49:0/3312878048 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec400bcf0 con 0x7f6ecc14e530 2023-11-30T17:07:34.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.033+0000 7f6ed08f8700 1 -- 172.21.15.49:0/3312878048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ecc14e530 msgr2=0x7f6ecc0c66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:34.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.033+0000 7f6ed08f8700 1 --2- 172.21.15.49:0/3312878048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ecc14e530 0x7f6ecc0c66f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f6ecc0644d0 tx=0x7f6ec4009840).stop 2023-11-30T17:07:34.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.033+0000 7f6ed08f8700 1 -- 172.21.15.49:0/3312878048 shutdown_connections 2023-11-30T17:07:34.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.033+0000 7f6ed08f8700 1 --2- 172.21.15.49:0/3312878048 >> v2:172.21.15.115:3300/0 conn(0x7f6ecc158570 0x7f6ecc158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:34.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.033+0000 7f6ed08f8700 1 --2- 172.21.15.49:0/3312878048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ecc14e530 0x7f6ecc0c66f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:34.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.033+0000 7f6ed08f8700 1 --2- 172.21.15.49:0/3312878048 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ecc154950 0x7f6ecc14e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:34.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.033+0000 7f6ed08f8700 1 -- 172.21.15.49:0/3312878048 >> 172.21.15.49:0/3312878048 conn(0x7f6ecc064990 msgr2=0x7f6ecc064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:34.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.033+0000 7f6ed08f8700 1 -- 172.21.15.49:0/3312878048 shutdown_connections 2023-11-30T17:07:34.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.033+0000 7f6ed08f8700 1 -- 172.21.15.49:0/3312878048 wait complete. 2023-11-30T17:07:34.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.034+0000 7f6ed08f8700 1 Processor -- start 2023-11-30T17:07:34.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.034+0000 7f6ed08f8700 1 -- start start 2023-11-30T17:07:34.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.035+0000 7f6ed08f8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ecc14e530 0x7f6ecc14d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:34.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.035+0000 7f6ed08f8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ecc154950 0x7f6ecc0cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:34.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.035+0000 7f6ed08f8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ecc158570 0x7f6ecc13e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:34.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.035+0000 7f6ed08f8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc0c2120 con 0x7f6ecc158570 2023-11-30T17:07:34.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.035+0000 7f6ed08f8700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc0afb40 con 0x7f6ecc154950 2023-11-30T17:07:34.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.035+0000 7f6ed08f8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc0afe20 con 0x7f6ecc14e530 2023-11-30T17:07:34.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.035+0000 7f6ecb59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ecc158570 0x7f6ecc13e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:34.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.035+0000 7f6ecb59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ecc158570 0x7f6ecc13e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38130/0 (socket says 172.21.15.49:38130) 2023-11-30T17:07:34.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.035+0000 7f6ecb59e700 1 -- 172.21.15.49:0/1208293494 learned_addr learned my addr 172.21.15.49:0/1208293494 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:34.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.035+0000 7f6eca59c700 1 --2- 172.21.15.49:0/1208293494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ecc154950 0x7f6ecc0cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:34.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.035+0000 7f6ecad9d700 1 --2- 172.21.15.49:0/1208293494 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ecc14e530 0x7f6ecc14d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:34.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.035+0000 7f6ecb59e700 1 -- 172.21.15.49:0/1208293494 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ecc14e530 msgr2=0x7f6ecc14d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:34.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.035+0000 7f6ecb59e700 1 --2- 172.21.15.49:0/1208293494 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ecc14e530 0x7f6ecc14d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:34.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.035+0000 7f6ecb59e700 1 -- 172.21.15.49:0/1208293494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ecc154950 msgr2=0x7f6ecc0cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:34.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.035+0000 7f6ecb59e700 1 --2- 172.21.15.49:0/1208293494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ecc154950 0x7f6ecc0cb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:34.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.035+0000 7f6ecb59e700 1 -- 172.21.15.49:0/1208293494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec4009ae0 con 0x7f6ecc158570 2023-11-30T17:07:34.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.036+0000 7f6ecb59e700 1 --2- 172.21.15.49:0/1208293494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ecc158570 0x7f6ecc13e6c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f6ebc00e8d0 tx=0x7f6ebc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:34.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.036+0000 7f6ec2ffd700 1 -- 172.21.15.49:0/1208293494 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc00ee70 con 0x7f6ecc158570 2023-11-30T17:07:34.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.036+0000 7f6ec2ffd700 1 -- 172.21.15.49:0/1208293494 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ebc00c850 con 0x7f6ecc158570 2023-11-30T17:07:34.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.036+0000 7f6ed08f8700 1 -- 172.21.15.49:0/1208293494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ecc0b0100 con 0x7f6ecc158570 2023-11-30T17:07:34.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.036+0000 7f6ec2ffd700 1 -- 172.21.15.49:0/1208293494 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc00cbd0 con 0x7f6ecc158570 2023-11-30T17:07:34.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.036+0000 7f6ed08f8700 1 -- 172.21.15.49:0/1208293494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ecc14d680 con 0x7f6ecc158570 2023-11-30T17:07:34.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.037+0000 7f6ed08f8700 1 -- 172.21.15.49:0/1208293494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ecc062ee0 con 0x7f6ecc158570 2023-11-30T17:07:34.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.037+0000 7f6ec2ffd700 1 -- 172.21.15.49:0/1208293494 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6ebc01b400 con 0x7f6ecc158570 2023-11-30T17:07:34.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.037+0000 7f6ec2ffd700 1 --2- 172.21.15.49:0/1208293494 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6eac05f150 0x7f6eac061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:34.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.038+0000 7f6ec2ffd700 1 -- 172.21.15.49:0/1208293494 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6ebc07a720 con 0x7f6ecc158570 2023-11-30T17:07:34.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.038+0000 7f6ecad9d700 1 --2- 172.21.15.49:0/1208293494 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6eac05f150 0x7f6eac061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:34.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.038+0000 7f6ecad9d700 1 --2- 172.21.15.49:0/1208293494 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6eac05f150 0x7f6eac061610 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f6ec4009930 tx=0x7f6ec4009840).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:34.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.042+0000 7f6ec2ffd700 1 -- 172.21.15.49:0/1208293494 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6ebc04b990 con 0x7f6ecc158570 2023-11-30T17:07:34.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.211+0000 7f6ed08f8700 1 -- 172.21.15.49:0/1208293494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6ecc06c7c0 con 0x7f6ecc158570 2023-11-30T17:07:34.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.212+0000 7f6ec2ffd700 1 -- 172.21.15.49:0/1208293494 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6ebc0160a0 con 0x7f6ecc158570 2023-11-30T17:07:34.214 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T17:07:34.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.213+0000 7f6ed08f8700 1 -- 172.21.15.49:0/1208293494 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6eac05f150 msgr2=0x7f6eac061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:34.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.213+0000 7f6ed08f8700 1 --2- 172.21.15.49:0/1208293494 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6eac05f150 0x7f6eac061610 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f6ec4009930 tx=0x7f6ec4009840).stop 2023-11-30T17:07:34.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.213+0000 7f6ed08f8700 1 -- 172.21.15.49:0/1208293494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ecc158570 msgr2=0x7f6ecc13e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:34.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.213+0000 7f6ed08f8700 1 --2- 172.21.15.49:0/1208293494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ecc158570 0x7f6ecc13e6c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f6ebc00e8d0 tx=0x7f6ebc009060).stop 2023-11-30T17:07:34.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.213+0000 7f6ed08f8700 1 -- 172.21.15.49:0/1208293494 shutdown_connections 2023-11-30T17:07:34.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.213+0000 7f6ed08f8700 1 --2- 172.21.15.49:0/1208293494 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6eac05f150 0x7f6eac061610 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:34.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.213+0000 7f6ed08f8700 1 --2- 172.21.15.49:0/1208293494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ecc158570 0x7f6ecc13e6c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:34.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.213+0000 7f6ed08f8700 1 --2- 172.21.15.49:0/1208293494 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ecc14e530 0x7f6ecc14d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:34.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.213+0000 7f6ed08f8700 1 --2- 172.21.15.49:0/1208293494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ecc154950 0x7f6ecc0cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:34.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.213+0000 7f6ed08f8700 1 -- 172.21.15.49:0/1208293494 >> 172.21.15.49:0/1208293494 conn(0x7f6ecc064990 msgr2=0x7f6ecc14db80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:34.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.213+0000 7f6ed08f8700 1 -- 172.21.15.49:0/1208293494 shutdown_connections 2023-11-30T17:07:34.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.213+0000 7f6ed08f8700 1 -- 172.21.15.49:0/1208293494 wait complete. 2023-11-30T17:07:34.227 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-30T17:07:34.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.347+0000 7fdad278b700 1 Processor -- start 2023-11-30T17:07:34.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.348+0000 7fdad278b700 1 -- start start 2023-11-30T17:07:34.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.348+0000 7fdad278b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdacc0c6190 0x7fdacc0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:34.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.348+0000 7fdad278b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdacc158320 0x7fdacc1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:34.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.348+0000 7fdad278b700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdacc158cc0 con 0x7fdacc098d10 2023-11-30T17:07:34.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.348+0000 7fdad278b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdacc0c72d0 con 0x7fdacc158320 2023-11-30T17:07:34.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.348+0000 7fdad278b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc064570 con 0x7fdacc0c6190 2023-11-30T17:07:34.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.348+0000 7fdacbfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdacc098d10 0x7fdacc063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40720/0 (socket says 172.21.15.49:40720) 2023-11-30T17:07:34.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.349+0000 7fdacbfff700 1 -- 172.21.15.49:0/1129101506 learned_addr learned my addr 172.21.15.49:0/1129101506 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:34.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.349+0000 7fdac3fff700 1 --2- 172.21.15.49:0/1129101506 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdacc0c6190 0x7fdacc0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:34.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.349+0000 7fdacb7fe700 1 -- 172.21.15.49:0/1129101506 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008360212 0 0) 0x7fdabc001110 con 0x7fdacc098d10 2023-11-30T17:07:34.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.349+0000 7fdad0d28700 1 --2- 172.21.15.49:0/1129101506 >> v2:172.21.15.115:3300/0 conn(0x7fdacc158320 0x7fdacc1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:34.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.349+0000 7fdacb7fe700 1 -- 172.21.15.49:0/1129101506 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdab80033f0 con 0x7fdacc098d10 2023-11-30T17:07:34.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.349+0000 7fdacb7fe700 1 -- 172.21.15.49:0/1129101506 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3135671340 0 0) 0x7fdab80033f0 con 0x7fdacc098d10 2023-11-30T17:07:34.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.349+0000 7fdacb7fe700 1 -- 172.21.15.49:0/1129101506 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdacc0c6190 msgr2=0x7fdacc0c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:34.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.349+0000 7fdacb7fe700 1 --2- 172.21.15.49:0/1129101506 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdacc0c6190 0x7fdacc0c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:34.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.349+0000 7fdacb7fe700 1 -- 172.21.15.49:0/1129101506 >> v2:172.21.15.115:3300/0 conn(0x7fdacc158320 msgr2=0x7fdacc1587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:34.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.349+0000 7fdacb7fe700 1 --2- 172.21.15.49:0/1129101506 >> v2:172.21.15.115:3300/0 conn(0x7fdacc158320 0x7fdacc1587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:34.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.349+0000 7fdacb7fe700 1 -- 172.21.15.49:0/1129101506 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdacc154bc0 con 0x7fdacc098d10 2023-11-30T17:07:34.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.349+0000 7fdacb7fe700 1 -- 172.21.15.49:0/1129101506 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fdabc001600 con 0x7fdacc098d10 2023-11-30T17:07:34.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.349+0000 7fdacb7fe700 1 -- 172.21.15.49:0/1129101506 >> v1:172.21.15.49:6789/0 conn(0x7fdacc098d10 legacy=0x7fdacc063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:34.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.349+0000 7fdacb7fe700 1 --2- 172.21.15.49:0/1129101506 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdab8003960 0x7fdab8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:34.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.349+0000 7fdacb7fe700 1 --2- 172.21.15.49:0/1129101506 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdacc0c6190 0x7fdab8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:34.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.349+0000 7fdacb7fe700 1 --2- 172.21.15.49:0/1129101506 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdab8004b80 0x7fdab8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:34.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.349+0000 7fdacb7fe700 1 -- 172.21.15.49:0/1129101506 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc0c72d0 con 0x7fdab8004b80 2023-11-30T17:07:34.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.349+0000 7fdacb7fe700 1 -- 172.21.15.49:0/1129101506 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc064570 con 0x7fdab8003960 2023-11-30T17:07:34.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.349+0000 7fdacb7fe700 1 -- 172.21.15.49:0/1129101506 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab800b8e0 con 0x7fdacc0c6190 2023-11-30T17:07:34.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.349+0000 7fdad0d28700 1 --2- 172.21.15.49:0/1129101506 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdab8004b80 0x7fdab8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:34.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.349+0000 7fdac3fff700 1 --2- 172.21.15.49:0/1129101506 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdacc0c6190 0x7fdab8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:34.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.349+0000 7fdacbfff700 1 --2- 172.21.15.49:0/1129101506 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdab8003960 0x7fdab8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:34.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.350+0000 7fdad0d28700 1 -- 172.21.15.49:0/1129101506 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdacc0c6190 msgr2=0x7fdab8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:34.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.350+0000 7fdad0d28700 1 --2- 172.21.15.49:0/1129101506 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdacc0c6190 0x7fdab8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:34.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.350+0000 7fdad0d28700 1 -- 172.21.15.49:0/1129101506 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdab8003960 msgr2=0x7fdab8003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:34.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.350+0000 7fdad0d28700 1 --2- 172.21.15.49:0/1129101506 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdab8003960 0x7fdab8003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:34.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.350+0000 7fdad0d28700 1 -- 172.21.15.49:0/1129101506 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab80033f0 con 0x7fdab8004b80 2023-11-30T17:07:34.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.350+0000 7fdad0d28700 1 --2- 172.21.15.49:0/1129101506 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdab8004b80 0x7fdab8005000 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fdac400e210 tx=0x7fdac400b040).ready entity=mon.0 client_cookie=d3d515ed45d448ee server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:34.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.350+0000 7fdacb7fe700 1 -- 172.21.15.49:0/1129101506 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4009ac0 con 0x7fdab8004b80 2023-11-30T17:07:34.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.350+0000 7fdacb7fe700 1 -- 172.21.15.49:0/1129101506 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac400f040 con 0x7fdab8004b80 2023-11-30T17:07:34.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.350+0000 7fdacb7fe700 1 -- 172.21.15.49:0/1129101506 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac400ecd0 con 0x7fdab8004b80 2023-11-30T17:07:34.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.350+0000 7fdad278b700 1 -- 172.21.15.49:0/1129101506 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdab8004b80 msgr2=0x7fdab8005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:34.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.350+0000 7fdad278b700 1 --2- 172.21.15.49:0/1129101506 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdab8004b80 0x7fdab8005000 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fdac400e210 tx=0x7fdac400b040).stop 2023-11-30T17:07:34.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.350+0000 7fdad0d28700 1 -- 172.21.15.49:0/1129101506 reap_dead start 2023-11-30T17:07:34.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.350+0000 7fdad278b700 1 -- 172.21.15.49:0/1129101506 shutdown_connections 2023-11-30T17:07:34.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.350+0000 7fdad278b700 1 -- 172.21.15.49:0/1129101506 >> 172.21.15.49:0/1129101506 conn(0x7fdacc0cb310 msgr2=0x7fdacc0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:34.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.350+0000 7fdad278b700 1 -- 172.21.15.49:0/1129101506 shutdown_connections 2023-11-30T17:07:34.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.350+0000 7fdad278b700 1 -- 172.21.15.49:0/1129101506 wait complete. 2023-11-30T17:07:34.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.351+0000 7fdad278b700 1 Processor -- start 2023-11-30T17:07:34.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.352+0000 7fdad278b700 1 -- start start 2023-11-30T17:07:34.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.352+0000 7fdad278b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdacc0c9080 0x7fdacc165380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:34.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.352+0000 7fdad278b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdacc151110 0x7fdacc151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:34.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.352+0000 7fdad278b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdacc0ae2c0 0x7fdacc0ae740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:34.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.352+0000 7fdad278b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc0b0b70 con 0x7fdacc0c9080 2023-11-30T17:07:34.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.352+0000 7fdad278b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc151a80 con 0x7fdacc0ae2c0 2023-11-30T17:07:34.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.352+0000 7fdad278b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc0b1000 con 0x7fdacc151110 2023-11-30T17:07:34.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.352+0000 7fdacbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdacc0c9080 0x7fdacc165380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:34.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.352+0000 7fdacbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdacc0c9080 0x7fdacc165380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38146/0 (socket says 172.21.15.49:38146) 2023-11-30T17:07:34.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.352+0000 7fdacbfff700 1 -- 172.21.15.49:0/974958933 learned_addr learned my addr 172.21.15.49:0/974958933 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:34.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.352+0000 7fdac3fff700 1 --2- 172.21.15.49:0/974958933 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdacc151110 0x7fdacc151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:34.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.352+0000 7fdad0d28700 1 --2- 172.21.15.49:0/974958933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdacc0ae2c0 0x7fdacc0ae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:34.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.353+0000 7fdacbfff700 1 -- 172.21.15.49:0/974958933 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdacc151110 msgr2=0x7fdacc151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:34.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.353+0000 7fdacbfff700 1 --2- 172.21.15.49:0/974958933 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdacc151110 0x7fdacc151590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:34.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.353+0000 7fdacbfff700 1 -- 172.21.15.49:0/974958933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdacc0ae2c0 msgr2=0x7fdacc0ae740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:34.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.353+0000 7fdacbfff700 1 --2- 172.21.15.49:0/974958933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdacc0ae2c0 0x7fdacc0ae740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:34.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.353+0000 7fdacbfff700 1 -- 172.21.15.49:0/974958933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdacc165870 con 0x7fdacc0c9080 2023-11-30T17:07:34.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.353+0000 7fdad0d28700 1 --2- 172.21.15.49:0/974958933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdacc0ae2c0 0x7fdacc0ae740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:34.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.353+0000 7fdacbfff700 1 --2- 172.21.15.49:0/974958933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdacc0c9080 0x7fdacc165380 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fdabc007790 tx=0x7fdacc0a8040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:34.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.353+0000 7fdac8ff9700 1 -- 172.21.15.49:0/974958933 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc011590 con 0x7fdacc0c9080 2023-11-30T17:07:34.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.353+0000 7fdac8ff9700 1 -- 172.21.15.49:0/974958933 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdabc0116f0 con 0x7fdacc0c9080 2023-11-30T17:07:34.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.353+0000 7fdad278b700 1 -- 172.21.15.49:0/974958933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdacc0c9460 con 0x7fdacc0c9080 2023-11-30T17:07:34.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.353+0000 7fdac8ff9700 1 -- 172.21.15.49:0/974958933 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc011a70 con 0x7fdacc0c9080 2023-11-30T17:07:34.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.353+0000 7fdad278b700 1 -- 172.21.15.49:0/974958933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdacc0b0240 con 0x7fdacc0c9080 2023-11-30T17:07:34.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.354+0000 7fdad278b700 1 -- 172.21.15.49:0/974958933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdacc0b0e50 con 0x7fdacc0c9080 2023-11-30T17:07:34.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.354+0000 7fdac8ff9700 1 -- 172.21.15.49:0/974958933 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdabc01c360 con 0x7fdacc0c9080 2023-11-30T17:07:34.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.355+0000 7fdac8ff9700 1 --2- 172.21.15.49:0/974958933 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdaac05f120 0x7fdaac0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:34.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.355+0000 7fdac8ff9700 1 -- 172.21.15.49:0/974958933 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdabc079710 con 0x7fdacc0c9080 2023-11-30T17:07:34.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.355+0000 7fdac3fff700 1 --2- 172.21.15.49:0/974958933 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdaac05f120 0x7fdaac0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:34.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.355+0000 7fdac3fff700 1 --2- 172.21.15.49:0/974958933 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdaac05f120 0x7fdaac0615e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fdacc0986b0 tx=0x7fdab4009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:34.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.359+0000 7fdac8ff9700 1 -- 172.21.15.49:0/974958933 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdabc049b00 con 0x7fdacc0c9080 2023-11-30T17:07:34.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.531+0000 7fdad278b700 1 -- 172.21.15.49:0/974958933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdacc158cc0 con 0x7fdacc0c9080 2023-11-30T17:07:34.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.531+0000 7fdac8ff9700 1 -- 172.21.15.49:0/974958933 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdacc158cc0 con 0x7fdacc0c9080 2023-11-30T17:07:34.535 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T17:07:34.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.533+0000 7fdad278b700 1 -- 172.21.15.49:0/974958933 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdaac05f120 msgr2=0x7fdaac0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:34.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.533+0000 7fdad278b700 1 --2- 172.21.15.49:0/974958933 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdaac05f120 0x7fdaac0615e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fdacc0986b0 tx=0x7fdab4009060).stop 2023-11-30T17:07:34.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.533+0000 7fdad278b700 1 -- 172.21.15.49:0/974958933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdacc0c9080 msgr2=0x7fdacc165380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:34.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.533+0000 7fdad278b700 1 --2- 172.21.15.49:0/974958933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdacc0c9080 0x7fdacc165380 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fdabc007790 tx=0x7fdacc0a8040).stop 2023-11-30T17:07:34.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.533+0000 7fdad278b700 1 -- 172.21.15.49:0/974958933 shutdown_connections 2023-11-30T17:07:34.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.533+0000 7fdad278b700 1 --2- 172.21.15.49:0/974958933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdacc0ae2c0 0x7fdacc0ae740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:34.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.533+0000 7fdad278b700 1 --2- 172.21.15.49:0/974958933 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdaac05f120 0x7fdaac0615e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:34.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.533+0000 7fdad278b700 1 --2- 172.21.15.49:0/974958933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdacc0c9080 0x7fdacc165380 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:34.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.533+0000 7fdad278b700 1 --2- 172.21.15.49:0/974958933 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdacc151110 0x7fdacc151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:34.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.533+0000 7fdad278b700 1 -- 172.21.15.49:0/974958933 >> 172.21.15.49:0/974958933 conn(0x7fdacc0cb310 msgr2=0x7fdacc156e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:34.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.533+0000 7fdad278b700 1 -- 172.21.15.49:0/974958933 shutdown_connections 2023-11-30T17:07:34.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.533+0000 7fdad278b700 1 -- 172.21.15.49:0/974958933 wait complete. 2023-11-30T17:07:34.547 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:07:34.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.663+0000 7fa2b5db7700 1 Processor -- start 2023-11-30T17:07:34.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.663+0000 7fa2b5db7700 1 -- start start 2023-11-30T17:07:34.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.663+0000 7fa2b5db7700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa2b01520c0 0x7fa2b0066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:34.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.663+0000 7fa2b5db7700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa2b0068150 0x7fa2b0066a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:34.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.663+0000 7fa2b5db7700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2b00be110 con 0x7fa2b01524a0 2023-11-30T17:07:34.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.663+0000 7fa2b5db7700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2b0066fc0 con 0x7fa2b01520c0 2023-11-30T17:07:34.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.663+0000 7fa2b5db7700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2b00672a0 con 0x7fa2b0068150 2023-11-30T17:07:34.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.664+0000 7fa2af7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa2b01520c0 0x7fa2b0066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:34.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.664+0000 7fa2af7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa2b01520c0 0x7fa2b0066520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38154/0 (socket says 172.21.15.49:38154) 2023-11-30T17:07:34.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.664+0000 7fa2af7fe700 1 -- 172.21.15.49:0/2928729061 learned_addr learned my addr 172.21.15.49:0/2928729061 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:34.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.664+0000 7fa2affff700 1 --2- 172.21.15.49:0/2928729061 >> v2:172.21.15.115:3300/0 conn(0x7fa2b0068150 0x7fa2b0066a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:34.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.664+0000 7fa2af7fe700 1 -- 172.21.15.49:0/2928729061 >> v2:172.21.15.115:3300/0 conn(0x7fa2b0068150 msgr2=0x7fa2b0066a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:34.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.664+0000 7fa2af7fe700 1 --2- 172.21.15.49:0/2928729061 >> v2:172.21.15.115:3300/0 conn(0x7fa2b0068150 0x7fa2b0066a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:34.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.664+0000 7fa2af7fe700 1 -- 172.21.15.49:0/2928729061 >> v1:172.21.15.115:6789/0 conn(0x7fa2b01524a0 legacy=0x7fa2b0067a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:34.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.664+0000 7fa2af7fe700 1 -- 172.21.15.49:0/2928729061 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b00be380 con 0x7fa2b01520c0 2023-11-30T17:07:34.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.664+0000 7fa2af7fe700 1 --2- 172.21.15.49:0/2928729061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2b01520c0 0x7fa2b0066520 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fa2b00c3690 tx=0x7fa2a0009060).ready entity=mon.0 client_cookie=f8a829576dc78afd server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:34.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.664+0000 7fa2ae7fc700 1 -- 172.21.15.49:0/2928729061 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0005880 con 0x7fa2b01520c0 2023-11-30T17:07:34.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.664+0000 7fa2ae7fc700 1 -- 172.21.15.49:0/2928729061 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a00059e0 con 0x7fa2b01520c0 2023-11-30T17:07:34.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.664+0000 7fa2ae7fc700 1 -- 172.21.15.49:0/2928729061 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0005d60 con 0x7fa2b01520c0 2023-11-30T17:07:34.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.665+0000 7fa2b5db7700 1 -- 172.21.15.49:0/2928729061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2b01520c0 msgr2=0x7fa2b0066520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:34.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.665+0000 7fa2b5db7700 1 --2- 172.21.15.49:0/2928729061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2b01520c0 0x7fa2b0066520 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fa2b00c3690 tx=0x7fa2a0009060).stop 2023-11-30T17:07:34.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.665+0000 7fa2b5db7700 1 -- 172.21.15.49:0/2928729061 shutdown_connections 2023-11-30T17:07:34.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.665+0000 7fa2b5db7700 1 --2- 172.21.15.49:0/2928729061 >> v2:172.21.15.115:3300/0 conn(0x7fa2b0068150 0x7fa2b0066a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:34.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.665+0000 7fa2b5db7700 1 --2- 172.21.15.49:0/2928729061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2b01520c0 0x7fa2b0066520 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:34.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.665+0000 7fa2b5db7700 1 -- 172.21.15.49:0/2928729061 >> 172.21.15.49:0/2928729061 conn(0x7fa2b00631d0 msgr2=0x7fa2b00c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:34.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.665+0000 7fa2b5db7700 1 -- 172.21.15.49:0/2928729061 shutdown_connections 2023-11-30T17:07:34.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.665+0000 7fa2b5db7700 1 -- 172.21.15.49:0/2928729061 wait complete. 2023-11-30T17:07:34.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.666+0000 7fa2b5db7700 1 Processor -- start 2023-11-30T17:07:34.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.666+0000 7fa2b5db7700 1 -- start start 2023-11-30T17:07:34.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.667+0000 7fa2b5db7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2b0068150 0x7fa2b0163af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:34.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.667+0000 7fa2b5db7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2b01520c0 0x7fa2b00aa2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:34.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.667+0000 7fa2b5db7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2b01524a0 0x7fa2b00aa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:34.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.667+0000 7fa2b5db7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b00aac90 con 0x7fa2b0068150 2023-11-30T17:07:34.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.667+0000 7fa2b5db7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b00ae340 con 0x7fa2b01524a0 2023-11-30T17:07:34.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.667+0000 7fa2b5db7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b00add30 con 0x7fa2b01520c0 2023-11-30T17:07:34.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.667+0000 7fa2af7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2b0068150 0x7fa2b0163af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:34.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.667+0000 7fa2af7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2b0068150 0x7fa2b0163af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38170/0 (socket says 172.21.15.49:38170) 2023-11-30T17:07:34.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.667+0000 7fa2af7fe700 1 -- 172.21.15.49:0/1008511728 learned_addr learned my addr 172.21.15.49:0/1008511728 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:34.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.667+0000 7fa2aeffd700 1 --2- 172.21.15.49:0/1008511728 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2b01520c0 0x7fa2b00aa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:34.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.667+0000 7fa2affff700 1 --2- 172.21.15.49:0/1008511728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2b01524a0 0x7fa2b00aa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:34.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.667+0000 7fa2af7fe700 1 -- 172.21.15.49:0/1008511728 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2b01520c0 msgr2=0x7fa2b00aa2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:34.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.667+0000 7fa2af7fe700 1 --2- 172.21.15.49:0/1008511728 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2b01520c0 0x7fa2b00aa2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:34.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.667+0000 7fa2af7fe700 1 -- 172.21.15.49:0/1008511728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2b01524a0 msgr2=0x7fa2b00aa7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:34.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.667+0000 7fa2af7fe700 1 --2- 172.21.15.49:0/1008511728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2b01524a0 0x7fa2b00aa7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:34.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.667+0000 7fa2af7fe700 1 -- 172.21.15.49:0/1008511728 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a0009300 con 0x7fa2b0068150 2023-11-30T17:07:34.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.667+0000 7fa2affff700 1 --2- 172.21.15.49:0/1008511728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2b01524a0 0x7fa2b00aa7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:34.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.667+0000 7fa2af7fe700 1 --2- 172.21.15.49:0/1008511728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2b0068150 0x7fa2b0163af0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fa2b0047d20 tx=0x7fa2a0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:34.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.668+0000 7fa2977fe700 1 -- 172.21.15.49:0/1008511728 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a00067e0 con 0x7fa2b0068150 2023-11-30T17:07:34.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.668+0000 7fa2977fe700 1 -- 172.21.15.49:0/1008511728 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a000b810 con 0x7fa2b0068150 2023-11-30T17:07:34.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.668+0000 7fa2b5db7700 1 -- 172.21.15.49:0/1008511728 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b01633e0 con 0x7fa2b0068150 2023-11-30T17:07:34.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.668+0000 7fa2977fe700 1 -- 172.21.15.49:0/1008511728 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a000bb90 con 0x7fa2b0068150 2023-11-30T17:07:34.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.668+0000 7fa2b5db7700 1 -- 172.21.15.49:0/1008511728 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b00adfd0 con 0x7fa2b0068150 2023-11-30T17:07:34.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.669+0000 7fa2b5db7700 1 -- 172.21.15.49:0/1008511728 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2b01638e0 con 0x7fa2b0068150 2023-11-30T17:07:34.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.669+0000 7fa2977fe700 1 -- 172.21.15.49:0/1008511728 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa2a0018070 con 0x7fa2b0068150 2023-11-30T17:07:34.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.669+0000 7fa2977fe700 1 --2- 172.21.15.49:0/1008511728 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa29c05f150 0x7fa29c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:34.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.670+0000 7fa2977fe700 1 -- 172.21.15.49:0/1008511728 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa2a007b160 con 0x7fa2b0068150 2023-11-30T17:07:34.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.670+0000 7fa2aeffd700 1 --2- 172.21.15.49:0/1008511728 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa29c05f150 0x7fa29c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:34.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.670+0000 7fa2aeffd700 1 --2- 172.21.15.49:0/1008511728 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa29c05f150 0x7fa29c061610 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fa2b00a66b0 tx=0x7fa2a4007d40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:34.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.674+0000 7fa2977fe700 1 -- 172.21.15.49:0/1008511728 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa2a004c430 con 0x7fa2b0068150 2023-11-30T17:07:34.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.890+0000 7fa2b5db7700 1 -- 172.21.15.49:0/1008511728 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2b006c860 con 0x7fa2b0068150 2023-11-30T17:07:34.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.890+0000 7fa2977fe700 1 -- 172.21.15.49:0/1008511728 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4486 (secure 0 0 0) 0x7fa2a0006ad0 con 0x7fa2b0068150 2023-11-30T17:07:34.892 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:34.892 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/4055676379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":4055676379},{"type":"v1","addr":"172.21.15.115:6835","nonce":4055676379}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1595689264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1595689264},{"type":"v1","addr":"172.21.15.115:6837","nonce":1595689264}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/124650277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":124650277},{"type":"v1","addr":"172.21.15.49:6834","nonce":124650277}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:07:16.282510+0000","modified":"2023-11-30T17:07:19.293997+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2333639572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2333639572},{"type":"v1","addr":"172.21.15.49:6835","nonce":2333639572}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-11-30T17:07:34.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.892+0000 7fa2b5db7700 1 -- 172.21.15.49:0/1008511728 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa29c05f150 msgr2=0x7fa29c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:34.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.892+0000 7fa2b5db7700 1 --2- 172.21.15.49:0/1008511728 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa29c05f150 0x7fa29c061610 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fa2b00a66b0 tx=0x7fa2a4007d40).stop 2023-11-30T17:07:34.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.892+0000 7fa2b5db7700 1 -- 172.21.15.49:0/1008511728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2b0068150 msgr2=0x7fa2b0163af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:34.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.892+0000 7fa2b5db7700 1 --2- 172.21.15.49:0/1008511728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2b0068150 0x7fa2b0163af0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fa2b0047d20 tx=0x7fa2a0016000).stop 2023-11-30T17:07:34.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.892+0000 7fa2b5db7700 1 -- 172.21.15.49:0/1008511728 shutdown_connections 2023-11-30T17:07:34.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.892+0000 7fa2b5db7700 1 --2- 172.21.15.49:0/1008511728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2b01524a0 0x7fa2b00aa7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:34.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.892+0000 7fa2b5db7700 1 --2- 172.21.15.49:0/1008511728 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa29c05f150 0x7fa29c061610 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:34.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.892+0000 7fa2b5db7700 1 --2- 172.21.15.49:0/1008511728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2b0068150 0x7fa2b0163af0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:34.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.892+0000 7fa2b5db7700 1 --2- 172.21.15.49:0/1008511728 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2b01520c0 0x7fa2b00aa2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:34.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.892+0000 7fa2b5db7700 1 -- 172.21.15.49:0/1008511728 >> 172.21.15.49:0/1008511728 conn(0x7fa2b00631d0 msgr2=0x7fa2b00beac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:34.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.892+0000 7fa2b5db7700 1 -- 172.21.15.49:0/1008511728 shutdown_connections 2023-11-30T17:07:34.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:34.892+0000 7fa2b5db7700 1 -- 172.21.15.49:0/1008511728 wait complete. 2023-11-30T17:07:34.895 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 8 2023-11-30T17:07:34.906 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:07:35.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.023+0000 7fb07175d700 1 Processor -- start 2023-11-30T17:07:35.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.023+0000 7fb07175d700 1 -- start start 2023-11-30T17:07:35.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.024+0000 7fb07175d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb06c0cae90 0x7fb06c0c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:35.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.024+0000 7fb07175d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb06c0ca180 0x7fb06c0c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:35.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.024+0000 7fb07175d700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb06c0a9a90 con 0x7fb06c0caab0 2023-11-30T17:07:35.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.024+0000 7fb07175d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb06c0c1490 con 0x7fb06c0ca180 2023-11-30T17:07:35.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.024+0000 7fb07175d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c154ce0 con 0x7fb06c0cae90 2023-11-30T17:07:35.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.024+0000 7fb06a7fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb06c0cae90 0x7fb06c0c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:35.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.024+0000 7fb06a7fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb06c0cae90 0x7fb06c0c0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:34744/0 (socket says 172.21.15.49:34744) 2023-11-30T17:07:35.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.024+0000 7fb06affd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fb06c0caab0 0x7fb06c0aa470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:39950/0 (socket says 172.21.15.49:39950) 2023-11-30T17:07:35.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.024+0000 7fb06a7fc700 1 -- 172.21.15.49:0/1023574010 learned_addr learned my addr 172.21.15.49:0/1023574010 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:35.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.024+0000 7fb06b7fe700 1 --2- 172.21.15.49:0/1023574010 >> v2:172.21.15.115:3300/0 conn(0x7fb06c0ca180 0x7fb06c0c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:35.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.024+0000 7fb069ffb700 1 -- 172.21.15.49:0/1023574010 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1991138438 0 0) 0x7fb06c0a9a90 con 0x7fb06c0caab0 2023-11-30T17:07:35.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.024+0000 7fb069ffb700 1 -- 172.21.15.49:0/1023574010 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0540033f0 con 0x7fb06c0caab0 2023-11-30T17:07:35.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.024+0000 7fb06a7fc700 1 -- 172.21.15.49:0/1023574010 >> v2:172.21.15.115:3300/0 conn(0x7fb06c0ca180 msgr2=0x7fb06c0c0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:35.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.024+0000 7fb06a7fc700 1 --2- 172.21.15.49:0/1023574010 >> v2:172.21.15.115:3300/0 conn(0x7fb06c0ca180 0x7fb06c0c0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:35.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.025+0000 7fb06a7fc700 1 -- 172.21.15.49:0/1023574010 >> v1:172.21.15.115:6789/0 conn(0x7fb06c0caab0 legacy=0x7fb06c0aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:35.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.025+0000 7fb06a7fc700 1 -- 172.21.15.49:0/1023574010 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06c0aab80 con 0x7fb06c0cae90 2023-11-30T17:07:35.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.025+0000 7fb06b7fe700 1 --2- 172.21.15.49:0/1023574010 >> v2:172.21.15.115:3300/0 conn(0x7fb06c0ca180 0x7fb06c0c0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:07:35.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.025+0000 7fb06a7fc700 1 --2- 172.21.15.49:0/1023574010 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb06c0cae90 0x7fb06c0c0ab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fb060006fd0 tx=0x7fb0600090f0).ready entity=mon.2 client_cookie=361ff72600b69dcd server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:35.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.025+0000 7fb069ffb700 1 -- 172.21.15.49:0/1023574010 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06000f510 con 0x7fb06c0cae90 2023-11-30T17:07:35.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.025+0000 7fb069ffb700 1 -- 172.21.15.49:0/1023574010 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06000f670 con 0x7fb06c0cae90 2023-11-30T17:07:35.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.025+0000 7fb069ffb700 1 -- 172.21.15.49:0/1023574010 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06000f9f0 con 0x7fb06c0cae90 2023-11-30T17:07:35.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.025+0000 7fb07175d700 1 -- 172.21.15.49:0/1023574010 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb06c0cae90 msgr2=0x7fb06c0c0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:35.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.025+0000 7fb07175d700 1 --2- 172.21.15.49:0/1023574010 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb06c0cae90 0x7fb06c0c0ab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fb060006fd0 tx=0x7fb0600090f0).stop 2023-11-30T17:07:35.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.025+0000 7fb07175d700 1 -- 172.21.15.49:0/1023574010 shutdown_connections 2023-11-30T17:07:35.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.025+0000 7fb07175d700 1 --2- 172.21.15.49:0/1023574010 >> v2:172.21.15.115:3300/0 conn(0x7fb06c0ca180 0x7fb06c0c0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:35.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.025+0000 7fb07175d700 1 --2- 172.21.15.49:0/1023574010 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb06c0cae90 0x7fb06c0c0ab0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:35.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.025+0000 7fb07175d700 1 -- 172.21.15.49:0/1023574010 >> 172.21.15.49:0/1023574010 conn(0x7fb06c094920 msgr2=0x7fb06c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:35.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.025+0000 7fb07175d700 1 -- 172.21.15.49:0/1023574010 shutdown_connections 2023-11-30T17:07:35.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.025+0000 7fb07175d700 1 -- 172.21.15.49:0/1023574010 wait complete. 2023-11-30T17:07:35.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.027+0000 7fb07175d700 1 Processor -- start 2023-11-30T17:07:35.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.027+0000 7fb07175d700 1 -- start start 2023-11-30T17:07:35.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.027+0000 7fb07175d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb06c0ca180 0x7fb06c0c6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:35.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.027+0000 7fb07175d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb06c0caab0 0x7fb06c0ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:35.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.027+0000 7fb07175d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb06c0cae90 0x7fb06c0c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:35.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.027+0000 7fb07175d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c0abbd0 con 0x7fb06c0caab0 2023-11-30T17:07:35.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.027+0000 7fb07175d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c0abe90 con 0x7fb06c0cae90 2023-11-30T17:07:35.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.027+0000 7fb07175d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c0ac170 con 0x7fb06c0ca180 2023-11-30T17:07:35.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.028+0000 7fb06a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb06c0caab0 0x7fb06c0ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:35.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.028+0000 7fb06a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb06c0caab0 0x7fb06c0ab6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38176/0 (socket says 172.21.15.49:38176) 2023-11-30T17:07:35.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.028+0000 7fb06a7fc700 1 -- 172.21.15.49:0/2850301161 learned_addr learned my addr 172.21.15.49:0/2850301161 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:35.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.028+0000 7fb06affd700 1 --2- 172.21.15.49:0/2850301161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb06c0ca180 0x7fb06c0c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:35.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.028+0000 7fb06b7fe700 1 --2- 172.21.15.49:0/2850301161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb06c0cae90 0x7fb06c0c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:35.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.028+0000 7fb06a7fc700 1 -- 172.21.15.49:0/2850301161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb06c0ca180 msgr2=0x7fb06c0c6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:35.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.028+0000 7fb06a7fc700 1 --2- 172.21.15.49:0/2850301161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb06c0ca180 0x7fb06c0c6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:35.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.028+0000 7fb06a7fc700 1 -- 172.21.15.49:0/2850301161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb06c0cae90 msgr2=0x7fb06c0c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:35.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.028+0000 7fb06a7fc700 1 --2- 172.21.15.49:0/2850301161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb06c0cae90 0x7fb06c0c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:35.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.028+0000 7fb06a7fc700 1 -- 172.21.15.49:0/2850301161 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb064009a20 con 0x7fb06c0caab0 2023-11-30T17:07:35.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.028+0000 7fb06a7fc700 1 --2- 172.21.15.49:0/2850301161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb06c0caab0 0x7fb06c0ab6e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fb06c154e20 tx=0x7fb060017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:35.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.028+0000 7fb052ffd700 1 -- 172.21.15.49:0/2850301161 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06000f7e0 con 0x7fb06c0caab0 2023-11-30T17:07:35.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.028+0000 7fb052ffd700 1 -- 172.21.15.49:0/2850301161 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06000f940 con 0x7fb06c0caab0 2023-11-30T17:07:35.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.028+0000 7fb07175d700 1 -- 172.21.15.49:0/2850301161 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb060009370 con 0x7fb06c0caab0 2023-11-30T17:07:35.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.028+0000 7fb052ffd700 1 -- 172.21.15.49:0/2850301161 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06001c670 con 0x7fb06c0caab0 2023-11-30T17:07:35.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.028+0000 7fb07175d700 1 -- 172.21.15.49:0/2850301161 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb06c0c2900 con 0x7fb06c0caab0 2023-11-30T17:07:35.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.029+0000 7fb07175d700 1 -- 172.21.15.49:0/2850301161 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb06c0c2c70 con 0x7fb06c0caab0 2023-11-30T17:07:35.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.029+0000 7fb052ffd700 1 -- 172.21.15.49:0/2850301161 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb06001ca20 con 0x7fb06c0caab0 2023-11-30T17:07:35.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.030+0000 7fb052ffd700 1 --2- 172.21.15.49:0/2850301161 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb05805f150 0x7fb058061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:35.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.030+0000 7fb052ffd700 1 -- 172.21.15.49:0/2850301161 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb06007bc00 con 0x7fb06c0caab0 2023-11-30T17:07:35.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.030+0000 7fb06affd700 1 --2- 172.21.15.49:0/2850301161 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb05805f150 0x7fb058061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:35.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.030+0000 7fb06affd700 1 --2- 172.21.15.49:0/2850301161 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb05805f150 0x7fb058061610 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fb05c007640 tx=0x7fb05c007bb0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:35.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.034+0000 7fb052ffd700 1 -- 172.21.15.49:0/2850301161 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb060082080 con 0x7fb06c0caab0 2023-11-30T17:07:35.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.206+0000 7fb07175d700 1 -- 172.21.15.49:0/2850301161 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb06c0ac690 con 0x7fb06c0caab0 2023-11-30T17:07:35.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.207+0000 7fb052ffd700 1 -- 172.21.15.49:0/2850301161 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16928 (secure 0 0 0) 0x7fb06c0ac690 con 0x7fb06c0caab0 2023-11-30T17:07:35.209 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:35.209 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":22,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:07:17.283998+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:07:14.837882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-30T17:07:15.248549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:07:35.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.209+0000 7fb07175d700 1 -- 172.21.15.49:0/2850301161 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb05805f150 msgr2=0x7fb058061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:35.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.209+0000 7fb07175d700 1 --2- 172.21.15.49:0/2850301161 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb05805f150 0x7fb058061610 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fb05c007640 tx=0x7fb05c007bb0).stop 2023-11-30T17:07:35.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.209+0000 7fb07175d700 1 -- 172.21.15.49:0/2850301161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb06c0caab0 msgr2=0x7fb06c0ab6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:35.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.209+0000 7fb07175d700 1 --2- 172.21.15.49:0/2850301161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb06c0caab0 0x7fb06c0ab6e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fb06c154e20 tx=0x7fb060017000).stop 2023-11-30T17:07:35.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.209+0000 7fb07175d700 1 -- 172.21.15.49:0/2850301161 shutdown_connections 2023-11-30T17:07:35.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.209+0000 7fb07175d700 1 --2- 172.21.15.49:0/2850301161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb06c0cae90 0x7fb06c0c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:35.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.209+0000 7fb07175d700 1 --2- 172.21.15.49:0/2850301161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb06c0ca180 0x7fb06c0c6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:35.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.209+0000 7fb07175d700 1 --2- 172.21.15.49:0/2850301161 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb05805f150 0x7fb058061610 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:35.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.209+0000 7fb07175d700 1 --2- 172.21.15.49:0/2850301161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb06c0caab0 0x7fb06c0ab6e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:35.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.209+0000 7fb07175d700 1 -- 172.21.15.49:0/2850301161 >> 172.21.15.49:0/2850301161 conn(0x7fb06c094920 msgr2=0x7fb06c0a7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:35.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.209+0000 7fb07175d700 1 -- 172.21.15.49:0/2850301161 shutdown_connections 2023-11-30T17:07:35.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.209+0000 7fb07175d700 1 -- 172.21.15.49:0/2850301161 wait complete. 2023-11-30T17:07:35.223 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:07:35.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.339+0000 7f35b5fb7700 1 Processor -- start 2023-11-30T17:07:35.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.339+0000 7f35b5fb7700 1 -- start start 2023-11-30T17:07:35.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.340+0000 7f35b5fb7700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f35b01544d0 0x7f35b0155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:35.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.340+0000 7f35b5fb7700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b00683d0 con 0x7f35b0066f40 2023-11-30T17:07:35.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.340+0000 7f35b5fb7700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b0067850 con 0x7f35b00673c0 2023-11-30T17:07:35.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.340+0000 7f35b5fb7700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35b0067b30 con 0x7f35b01544d0 2023-11-30T17:07:35.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.340+0000 7f35af7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f35b01544d0 0x7f35b0155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:35.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.340+0000 7f35af7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f35b01544d0 0x7f35b0155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38184/0 (socket says 172.21.15.49:38184) 2023-11-30T17:07:35.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.341+0000 7f35af7fe700 1 -- 172.21.15.49:0/1276991461 learned_addr learned my addr 172.21.15.49:0/1276991461 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:35.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.340+0000 7f35aeffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f35b0066f40 0x7f35b0095e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40734/0 (socket says 172.21.15.49:40734) 2023-11-30T17:07:35.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.341+0000 7f35af7fe700 1 -- 172.21.15.49:0/1276991461 >> v1:172.21.15.115:6789/0 conn(0x7f35b00673c0 legacy=0x7f35b015e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:35.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.341+0000 7f35af7fe700 1 -- 172.21.15.49:0/1276991461 >> v1:172.21.15.49:6789/0 conn(0x7f35b0066f40 legacy=0x7f35b0095e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:35.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.341+0000 7f35ae7fc700 1 -- 172.21.15.49:0/1276991461 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 166354628 0 0) 0x7f35b00683d0 con 0x7f35b0066f40 2023-11-30T17:07:35.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.341+0000 7f35af7fe700 1 -- 172.21.15.49:0/1276991461 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b0067e10 con 0x7f35b01544d0 2023-11-30T17:07:35.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.341+0000 7f35af7fe700 1 --2- 172.21.15.49:0/1276991461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35b01544d0 0x7f35b0155750 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f3598009810 tx=0x7f3598009060).ready entity=mon.0 client_cookie=ea056f7d6da334f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:35.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.341+0000 7f35ae7fc700 1 -- 172.21.15.49:0/1276991461 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3598005880 con 0x7f35b01544d0 2023-11-30T17:07:35.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.341+0000 7f35ae7fc700 1 -- 172.21.15.49:0/1276991461 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35980059e0 con 0x7f35b01544d0 2023-11-30T17:07:35.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.341+0000 7f35ae7fc700 1 -- 172.21.15.49:0/1276991461 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3598005d60 con 0x7f35b01544d0 2023-11-30T17:07:35.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.341+0000 7f35b5fb7700 1 -- 172.21.15.49:0/1276991461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35b01544d0 msgr2=0x7f35b0155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:35.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.342+0000 7f35b5fb7700 1 --2- 172.21.15.49:0/1276991461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35b01544d0 0x7f35b0155750 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f3598009810 tx=0x7f3598009060).stop 2023-11-30T17:07:35.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.342+0000 7f35b5fb7700 1 -- 172.21.15.49:0/1276991461 shutdown_connections 2023-11-30T17:07:35.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.342+0000 7f35b5fb7700 1 --2- 172.21.15.49:0/1276991461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35b01544d0 0x7f35b0155750 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:35.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.342+0000 7f35b5fb7700 1 -- 172.21.15.49:0/1276991461 >> 172.21.15.49:0/1276991461 conn(0x7f35b00631d0 msgr2=0x7f35b00c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:35.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.342+0000 7f35b5fb7700 1 -- 172.21.15.49:0/1276991461 shutdown_connections 2023-11-30T17:07:35.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.342+0000 7f35b5fb7700 1 -- 172.21.15.49:0/1276991461 wait complete. 2023-11-30T17:07:35.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.343+0000 7f35b5fb7700 1 Processor -- start 2023-11-30T17:07:35.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.343+0000 7f35b5fb7700 1 -- start start 2023-11-30T17:07:35.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.344+0000 7f35b5fb7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35b0066f40 0x7f35b0150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:35.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.344+0000 7f35b5fb7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35b01544d0 0x7f35b01554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:35.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.344+0000 7f35b5fb7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35b014cd40 0x7f35b00646a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:35.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.344+0000 7f35b5fb7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b0156740 con 0x7f35b0066f40 2023-11-30T17:07:35.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.344+0000 7f35b5fb7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b0155b30 con 0x7f35b01544d0 2023-11-30T17:07:35.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.344+0000 7f35b5fb7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b0155e10 con 0x7f35b014cd40 2023-11-30T17:07:35.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.344+0000 7f35af7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35b0066f40 0x7f35b0150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:35.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.344+0000 7f35af7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35b0066f40 0x7f35b0150990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38192/0 (socket says 172.21.15.49:38192) 2023-11-30T17:07:35.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.344+0000 7f35af7fe700 1 -- 172.21.15.49:0/3759678443 learned_addr learned my addr 172.21.15.49:0/3759678443 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:35.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.344+0000 7f35aeffd700 1 --2- 172.21.15.49:0/3759678443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35b01544d0 0x7f35b01554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:35.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.344+0000 7f35affff700 1 --2- 172.21.15.49:0/3759678443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35b014cd40 0x7f35b00646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:35.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.344+0000 7f35af7fe700 1 -- 172.21.15.49:0/3759678443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35b014cd40 msgr2=0x7f35b00646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:35.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.344+0000 7f35af7fe700 1 --2- 172.21.15.49:0/3759678443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35b014cd40 0x7f35b00646a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:35.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.344+0000 7f35af7fe700 1 -- 172.21.15.49:0/3759678443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35b01544d0 msgr2=0x7f35b01554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:35.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.344+0000 7f35af7fe700 1 --2- 172.21.15.49:0/3759678443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35b01544d0 0x7f35b01554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:35.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.344+0000 7f35af7fe700 1 -- 172.21.15.49:0/3759678443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3598009300 con 0x7f35b0066f40 2023-11-30T17:07:35.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.344+0000 7f35af7fe700 1 --2- 172.21.15.49:0/3759678443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35b0066f40 0x7f35b0150990 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f3598009fd0 tx=0x7f3598016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:35.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.344+0000 7f35a77fe700 1 -- 172.21.15.49:0/3759678443 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3598006770 con 0x7f35b0066f40 2023-11-30T17:07:35.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.344+0000 7f35a77fe700 1 -- 172.21.15.49:0/3759678443 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359800b850 con 0x7f35b0066f40 2023-11-30T17:07:35.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.344+0000 7f35b5fb7700 1 -- 172.21.15.49:0/3759678443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35b01560f0 con 0x7f35b0066f40 2023-11-30T17:07:35.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.344+0000 7f35a77fe700 1 -- 172.21.15.49:0/3759678443 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359800bbd0 con 0x7f35b0066f40 2023-11-30T17:07:35.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.345+0000 7f35b5fb7700 1 -- 172.21.15.49:0/3759678443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35b014d1a0 con 0x7f35b0066f40 2023-11-30T17:07:35.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.346+0000 7f35b5fb7700 1 -- 172.21.15.49:0/3759678443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35b006c860 con 0x7f35b0066f40 2023-11-30T17:07:35.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.346+0000 7f35a77fe700 1 -- 172.21.15.49:0/3759678443 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3598018030 con 0x7f35b0066f40 2023-11-30T17:07:35.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.346+0000 7f35a77fe700 1 --2- 172.21.15.49:0/3759678443 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f359005f120 0x7f35900615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:35.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.346+0000 7f35a77fe700 1 -- 172.21.15.49:0/3759678443 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f359807b140 con 0x7f35b0066f40 2023-11-30T17:07:35.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.347+0000 7f35aeffd700 1 --2- 172.21.15.49:0/3759678443 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f359005f120 0x7f35900615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:35.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.347+0000 7f35aeffd700 1 --2- 172.21.15.49:0/3759678443 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f359005f120 0x7f35900615e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f35b00c9a30 tx=0x7f35a0007bb0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:35.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.351+0000 7f35a77fe700 1 -- 172.21.15.49:0/3759678443 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f359804c410 con 0x7f35b0066f40 2023-11-30T17:07:35.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.564+0000 7f35b5fb7700 1 -- 172.21.15.49:0/3759678443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35b00680f0 con 0x7f35b0066f40 2023-11-30T17:07:35.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.565+0000 7f35a77fe700 1 -- 172.21.15.49:0/3759678443 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4486 (secure 0 0 0) 0x7f3598028020 con 0x7f35b0066f40 2023-11-30T17:07:35.567 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:35.567 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/4055676379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":4055676379},{"type":"v1","addr":"172.21.15.115:6835","nonce":4055676379}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1595689264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1595689264},{"type":"v1","addr":"172.21.15.115:6837","nonce":1595689264}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/124650277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":124650277},{"type":"v1","addr":"172.21.15.49:6834","nonce":124650277}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:07:16.282510+0000","modified":"2023-11-30T17:07:19.293997+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2333639572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2333639572},{"type":"v1","addr":"172.21.15.49:6835","nonce":2333639572}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-11-30T17:07:35.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.567+0000 7f35b5fb7700 1 -- 172.21.15.49:0/3759678443 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f359005f120 msgr2=0x7f35900615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:35.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.567+0000 7f35b5fb7700 1 --2- 172.21.15.49:0/3759678443 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f359005f120 0x7f35900615e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f35b00c9a30 tx=0x7f35a0007bb0).stop 2023-11-30T17:07:35.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.567+0000 7f35b5fb7700 1 -- 172.21.15.49:0/3759678443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35b0066f40 msgr2=0x7f35b0150990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:35.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.567+0000 7f35b5fb7700 1 --2- 172.21.15.49:0/3759678443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35b0066f40 0x7f35b0150990 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f3598009fd0 tx=0x7f3598016000).stop 2023-11-30T17:07:35.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.567+0000 7f35b5fb7700 1 -- 172.21.15.49:0/3759678443 shutdown_connections 2023-11-30T17:07:35.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.567+0000 7f35b5fb7700 1 --2- 172.21.15.49:0/3759678443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35b014cd40 0x7f35b00646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:35.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.567+0000 7f35b5fb7700 1 --2- 172.21.15.49:0/3759678443 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f359005f120 0x7f35900615e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:35.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.567+0000 7f35b5fb7700 1 --2- 172.21.15.49:0/3759678443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35b0066f40 0x7f35b0150990 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:35.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.567+0000 7f35b5fb7700 1 --2- 172.21.15.49:0/3759678443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35b01544d0 0x7f35b01554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:35.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.567+0000 7f35b5fb7700 1 -- 172.21.15.49:0/3759678443 >> 172.21.15.49:0/3759678443 conn(0x7f35b00631d0 msgr2=0x7f35b00beb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:35.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.567+0000 7f35b5fb7700 1 -- 172.21.15.49:0/3759678443 shutdown_connections 2023-11-30T17:07:35.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:35.567+0000 7f35b5fb7700 1 -- 172.21.15.49:0/3759678443 wait complete. 2023-11-30T17:07:35.569 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 8 2023-11-30T17:07:35.983 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-30T17:07:16.282510+0000', 'modified': '2023-11-30T17:07:19.293997+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4276}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4276': {'gid': 4276, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6835/2333639572', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6833', 'nonce': 2333639572}, {'type': 'v1', 'addr': '172.21.15.49:6835', 'nonce': 2333639572}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-11-30T17:07:35.983 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-30T17:07:35.983 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-30T17:07:36.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.102+0000 7fa3e7d75700 1 Processor -- start 2023-11-30T17:07:36.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.102+0000 7fa3e7d75700 1 -- start start 2023-11-30T17:07:36.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.103+0000 7fa3e7d75700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3e0152640 0x7fa3e0062c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:36.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.103+0000 7fa3e7d75700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa3e00be5d0 0x7fa3e00c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:36.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.103+0000 7fa3e7d75700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e00c5380 con 0x7fa3e00c4f20 2023-11-30T17:07:36.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.103+0000 7fa3e7d75700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e0155e20 con 0x7fa3e00be5d0 2023-11-30T17:07:36.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.103+0000 7fa3e7d75700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e00bed70 con 0x7fa3e0152640 2023-11-30T17:07:36.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.103+0000 7fa3e6312700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa3e00c4f20 0x7fa3e00658e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40740/0 (socket says 172.21.15.49:40740) 2023-11-30T17:07:36.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.103+0000 7fa3e6312700 1 -- 172.21.15.49:0/4077672668 learned_addr learned my addr 172.21.15.49:0/4077672668 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:36.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.104+0000 7fa3e5310700 1 --2- 172.21.15.49:0/4077672668 >> v2:172.21.15.115:3300/0 conn(0x7fa3e00be5d0 0x7fa3e00c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:36.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.104+0000 7fa3e5b11700 1 --2- 172.21.15.49:0/4077672668 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3e0152640 0x7fa3e0062c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:36.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.104+0000 7fa3e4b0f700 1 -- 172.21.15.49:0/4077672668 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2230730085 0 0) 0x7fa3e00c5380 con 0x7fa3e00c4f20 2023-11-30T17:07:36.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.104+0000 7fa3e4b0f700 1 -- 172.21.15.49:0/4077672668 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3c80033f0 con 0x7fa3e00c4f20 2023-11-30T17:07:36.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.104+0000 7fa3e5310700 1 -- 172.21.15.49:0/4077672668 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3e0152640 msgr2=0x7fa3e0062c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:36.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.104+0000 7fa3e5310700 1 --2- 172.21.15.49:0/4077672668 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3e0152640 0x7fa3e0062c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.104+0000 7fa3e5310700 1 -- 172.21.15.49:0/4077672668 >> v1:172.21.15.49:6789/0 conn(0x7fa3e00c4f20 legacy=0x7fa3e00658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:36.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.104+0000 7fa3e5310700 1 -- 172.21.15.49:0/4077672668 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e0158420 con 0x7fa3e00be5d0 2023-11-30T17:07:36.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.104+0000 7fa3e5310700 1 --2- 172.21.15.49:0/4077672668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3e00be5d0 0x7fa3e00c4a30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fa3d4009760 tx=0x7fa3d4009060).ready entity=mon.1 client_cookie=dbd5592c3850fe59 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:36.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.104+0000 7fa3e4b0f700 1 -- 172.21.15.49:0/4077672668 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d400d4a0 con 0x7fa3e00be5d0 2023-11-30T17:07:36.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.104+0000 7fa3e4b0f700 1 -- 172.21.15.49:0/4077672668 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d400d600 con 0x7fa3e00be5d0 2023-11-30T17:07:36.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.104+0000 7fa3e4b0f700 1 -- 172.21.15.49:0/4077672668 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d400d980 con 0x7fa3e00be5d0 2023-11-30T17:07:36.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.105+0000 7fa3e7d75700 1 -- 172.21.15.49:0/4077672668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3e00be5d0 msgr2=0x7fa3e00c4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:36.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.105+0000 7fa3e7d75700 1 --2- 172.21.15.49:0/4077672668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3e00be5d0 0x7fa3e00c4a30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fa3d4009760 tx=0x7fa3d4009060).stop 2023-11-30T17:07:36.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.105+0000 7fa3e7d75700 1 -- 172.21.15.49:0/4077672668 shutdown_connections 2023-11-30T17:07:36.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.105+0000 7fa3e7d75700 1 --2- 172.21.15.49:0/4077672668 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3e0152640 0x7fa3e0062c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.105+0000 7fa3e7d75700 1 --2- 172.21.15.49:0/4077672668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3e00be5d0 0x7fa3e00c4a30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.105+0000 7fa3e7d75700 1 -- 172.21.15.49:0/4077672668 >> 172.21.15.49:0/4077672668 conn(0x7fa3e0063810 msgr2=0x7fa3e0063c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:36.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.105+0000 7fa3e7d75700 1 -- 172.21.15.49:0/4077672668 shutdown_connections 2023-11-30T17:07:36.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.105+0000 7fa3e7d75700 1 -- 172.21.15.49:0/4077672668 wait complete. 2023-11-30T17:07:36.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.106+0000 7fa3e7d75700 1 Processor -- start 2023-11-30T17:07:36.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.106+0000 7fa3e7d75700 1 -- start start 2023-11-30T17:07:36.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.107+0000 7fa3e7d75700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3e00be5d0 0x7fa3e0157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:36.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.107+0000 7fa3e7d75700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3e00c4f20 0x7fa3e014c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:36.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.107+0000 7fa3e7d75700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3e0152640 0x7fa3e0147450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:36.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.107+0000 7fa3e7d75700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e00a9740 con 0x7fa3e0152640 2023-11-30T17:07:36.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.107+0000 7fa3e7d75700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e0164d90 con 0x7fa3e00c4f20 2023-11-30T17:07:36.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.107+0000 7fa3e7d75700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e0165070 con 0x7fa3e00be5d0 2023-11-30T17:07:36.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.107+0000 7fa3e6312700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3e0152640 0x7fa3e0147450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:36.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.107+0000 7fa3e6312700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3e0152640 0x7fa3e0147450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38200/0 (socket says 172.21.15.49:38200) 2023-11-30T17:07:36.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.107+0000 7fa3e6312700 1 -- 172.21.15.49:0/17743881 learned_addr learned my addr 172.21.15.49:0/17743881 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:36.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.107+0000 7fa3e5310700 1 --2- 172.21.15.49:0/17743881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3e00c4f20 0x7fa3e014c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:36.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.107+0000 7fa3e5b11700 1 --2- 172.21.15.49:0/17743881 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3e00be5d0 0x7fa3e0157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:36.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.107+0000 7fa3e6312700 1 -- 172.21.15.49:0/17743881 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3e00be5d0 msgr2=0x7fa3e0157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:36.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.107+0000 7fa3e6312700 1 --2- 172.21.15.49:0/17743881 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3e00be5d0 0x7fa3e0157ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.107+0000 7fa3e6312700 1 -- 172.21.15.49:0/17743881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3e00c4f20 msgr2=0x7fa3e014c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:36.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.107+0000 7fa3e6312700 1 --2- 172.21.15.49:0/17743881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3e00c4f20 0x7fa3e014c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.107+0000 7fa3e6312700 1 -- 172.21.15.49:0/17743881 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d40092a0 con 0x7fa3e0152640 2023-11-30T17:07:36.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.107+0000 7fa3e6312700 1 --2- 172.21.15.49:0/17743881 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3e0152640 0x7fa3e0147450 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fa3d0002250 tx=0x7fa3d0007f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:36.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.108+0000 7fa3ddffb700 1 -- 172.21.15.49:0/17743881 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0005d30 con 0x7fa3e0152640 2023-11-30T17:07:36.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.108+0000 7fa3ddffb700 1 -- 172.21.15.49:0/17743881 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d0005e90 con 0x7fa3e0152640 2023-11-30T17:07:36.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.108+0000 7fa3ddffb700 1 -- 172.21.15.49:0/17743881 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0007320 con 0x7fa3e0152640 2023-11-30T17:07:36.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.108+0000 7fa3e7d75700 1 -- 172.21.15.49:0/17743881 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e0165350 con 0x7fa3e0152640 2023-11-30T17:07:36.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.108+0000 7fa3e7d75700 1 -- 172.21.15.49:0/17743881 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e0165910 con 0x7fa3e0152640 2023-11-30T17:07:36.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.109+0000 7fa3ddffb700 1 -- 172.21.15.49:0/17743881 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa3d00076d0 con 0x7fa3e0152640 2023-11-30T17:07:36.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.109+0000 7fa3ddffb700 1 --2- 172.21.15.49:0/17743881 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa3cc05f150 0x7fa3cc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:36.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.109+0000 7fa3ddffb700 1 -- 172.21.15.49:0/17743881 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa3d0079b40 con 0x7fa3e0152640 2023-11-30T17:07:36.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.110+0000 7fa3e5b11700 1 --2- 172.21.15.49:0/17743881 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa3cc05f150 0x7fa3cc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:36.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.110+0000 7fa3e5b11700 1 --2- 172.21.15.49:0/17743881 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa3cc05f150 0x7fa3cc061610 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fa3d8009b90 tx=0x7fa3d8009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:36.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.111+0000 7fa3f970db80 1 Processor -- start 2023-11-30T17:07:36.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.112+0000 7fa3f970db80 1 -- start start 2023-11-30T17:07:36.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.112+0000 7fa3f970db80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d6df47e40 0x563d6e1b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:36.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.112+0000 7fa3f970db80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d6e1d4ea0 0x563d6e18b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:36.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.112+0000 7fa3f970db80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563d6e18bcb0 0x563d6e186600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:36.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.112+0000 7fa3f970db80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d6e151060 con 0x563d6e1d4ea0 2023-11-30T17:07:36.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.112+0000 7fa3f970db80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d6e0c81f0 con 0x563d6df47e40 2023-11-30T17:07:36.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.112+0000 7fa3f970db80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x563d6e0dd440 con 0x563d6e18bcb0 2023-11-30T17:07:36.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.112+0000 7fa3e5310700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d6e1d4ea0 0x563d6e18b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:36.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.112+0000 7fa3e5310700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d6e1d4ea0 0x563d6e18b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38206/0 (socket says 172.21.15.49:38206) 2023-11-30T17:07:36.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.112+0000 7fa3e5310700 1 -- 172.21.15.49:0/1838146676 learned_addr learned my addr 172.21.15.49:0/1838146676 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:36.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.112+0000 7fa3e5b11700 1 --2- 172.21.15.49:0/1838146676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d6df47e40 0x563d6e1b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:36.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.113+0000 7fa3e6312700 1 --2- 172.21.15.49:0/1838146676 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563d6e18bcb0 0x563d6e186600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:36.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.113+0000 7fa3e5310700 1 -- 172.21.15.49:0/1838146676 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563d6e18bcb0 msgr2=0x563d6e186600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:36.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.113+0000 7fa3e5310700 1 --2- 172.21.15.49:0/1838146676 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563d6e18bcb0 0x563d6e186600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.113+0000 7fa3e5310700 1 -- 172.21.15.49:0/1838146676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d6df47e40 msgr2=0x563d6e1b3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:36.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.113+0000 7fa3e5310700 1 --2- 172.21.15.49:0/1838146676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d6df47e40 0x563d6e1b3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.113+0000 7fa3e5310700 1 -- 172.21.15.49:0/1838146676 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d6e0d6620 con 0x563d6e1d4ea0 2023-11-30T17:07:36.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.113+0000 7fa3e5310700 1 --2- 172.21.15.49:0/1838146676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d6e1d4ea0 0x563d6e18b7c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fa3e0069610 tx=0x7fa3d4016000).ready entity=mon.0 client_cookie=9487ee90fe618cd0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:36.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.113+0000 7fa3c6ffd700 1 -- 172.21.15.49:0/1838146676 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4000be0 con 0x563d6e1d4ea0 2023-11-30T17:07:36.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.113+0000 7fa3c6ffd700 1 -- 172.21.15.49:0/1838146676 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d400dd40 con 0x563d6e1d4ea0 2023-11-30T17:07:36.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.113+0000 7fa3c6ffd700 1 -- 172.21.15.49:0/1838146676 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d400d980 con 0x563d6e1d4ea0 2023-11-30T17:07:36.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.113+0000 7fa3f970db80 1 -- 172.21.15.49:0/1838146676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d6e1d4ea0 msgr2=0x563d6e18b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:36.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.113+0000 7fa3f970db80 1 --2- 172.21.15.49:0/1838146676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d6e1d4ea0 0x563d6e18b7c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fa3e0069610 tx=0x7fa3d4016000).stop 2023-11-30T17:07:36.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.113+0000 7fa3f970db80 1 -- 172.21.15.49:0/1838146676 shutdown_connections 2023-11-30T17:07:36.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.113+0000 7fa3f970db80 1 --2- 172.21.15.49:0/1838146676 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563d6e18bcb0 0x563d6e186600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.113+0000 7fa3f970db80 1 --2- 172.21.15.49:0/1838146676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d6df47e40 0x563d6e1b3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.113+0000 7fa3f970db80 1 --2- 172.21.15.49:0/1838146676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d6e1d4ea0 0x563d6e18b7c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.113+0000 7fa3f970db80 1 -- 172.21.15.49:0/1838146676 >> 172.21.15.49:0/1838146676 conn(0x563d6dff54a0 msgr2=0x563d6e1d4790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:36.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.114+0000 7fa3f970db80 1 -- 172.21.15.49:0/1838146676 shutdown_connections 2023-11-30T17:07:36.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.114+0000 7fa3f970db80 1 -- 172.21.15.49:0/1838146676 wait complete. 2023-11-30T17:07:36.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.114+0000 7fa3f970db80 1 -- start start 2023-11-30T17:07:36.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.114+0000 7fa3f970db80 1 Processor -- start 2023-11-30T17:07:36.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.115+0000 7fa3f970db80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d6df47e40 0x563d6e1b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:36.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.115+0000 7fa3f970db80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563d6e18bcb0 0x563d6e1cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:36.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.115+0000 7fa3f970db80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d6e1d4ea0 0x563d6e1cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:36.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.115+0000 7fa3f970db80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d6e0dd580 con 0x563d6e1d4ea0 2023-11-30T17:07:36.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.115+0000 7fa3f970db80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d6e0dd800 con 0x563d6df47e40 2023-11-30T17:07:36.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.115+0000 7fa3f970db80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x563d6e0a8e10 con 0x563d6e18bcb0 2023-11-30T17:07:36.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.115+0000 7fa3f970db80 10 client.0 ll_register_callbacks cb 0x563d6e14b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-30T17:07:36.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.115+0000 7fa3e6312700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d6e1d4ea0 0x563d6e1cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:36.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.115+0000 7fa3e6312700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d6e1d4ea0 0x563d6e1cbda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38208/0 (socket says 172.21.15.49:38208) 2023-11-30T17:07:36.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.115+0000 7fa3e6312700 1 -- 172.21.15.49:0/2252819454 learned_addr learned my addr 172.21.15.49:0/2252819454 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:36.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.115+0000 7fa3e5310700 1 --2- 172.21.15.49:0/2252819454 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563d6e18bcb0 0x563d6e1cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:36.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.115+0000 7fa3e5b11700 1 --2- 172.21.15.49:0/2252819454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d6df47e40 0x563d6e1b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:36.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.116+0000 7fa3e6312700 1 -- 172.21.15.49:0/2252819454 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563d6e18bcb0 msgr2=0x563d6e1cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:36.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.116+0000 7fa3e6312700 1 --2- 172.21.15.49:0/2252819454 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563d6e18bcb0 0x563d6e1cb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.116+0000 7fa3e6312700 1 -- 172.21.15.49:0/2252819454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d6df47e40 msgr2=0x563d6e1b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:36.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.116+0000 7fa3e6312700 1 --2- 172.21.15.49:0/2252819454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d6df47e40 0x563d6e1b11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.116+0000 7fa3e6312700 1 -- 172.21.15.49:0/2252819454 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e0158420 con 0x563d6e1d4ea0 2023-11-30T17:07:36.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.116+0000 7fa3e6312700 1 --2- 172.21.15.49:0/2252819454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d6e1d4ea0 0x563d6e1cbda0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fa3d0077ff0 tx=0x7fa3d0051040).ready entity=mon.0 client_cookie=1386eb762f7dc7ca server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:36.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.116+0000 7fa3bbfff700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-30T17:07:36.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.116+0000 7fa3bbfff700 1 -- 172.21.15.49:0/2252819454 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0054040 con 0x563d6e1d4ea0 2023-11-30T17:07:36.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.116+0000 7fa3bbfff700 1 -- 172.21.15.49:0/2252819454 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa3d004e9b0 con 0x563d6e1d4ea0 2023-11-30T17:07:36.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.116+0000 7fa3f970db80 1 -- 172.21.15.49:0/2252819454 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563d6e17f720 con 0x563d6e1d4ea0 2023-11-30T17:07:36.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.116+0000 7fa3bbfff700 1 -- 172.21.15.49:0/2252819454 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3d0010510 con 0x563d6e1d4ea0 2023-11-30T17:07:36.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.116+0000 7fa3f970db80 10 client.4662 fetch_fsmap learned FSMap version 8 2023-11-30T17:07:36.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.116+0000 7fa3f970db80 1 -- 172.21.15.49:0/2252819454 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x563d6e0d19c0 con 0x563d6e1d4ea0 2023-11-30T17:07:36.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.116+0000 7fa3bbfff700 1 -- 172.21.15.49:0/2252819454 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563d6e17f720 con 0x563d6e1d4ea0 2023-11-30T17:07:36.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.116+0000 7fa3bbfff700 1 -- 172.21.15.49:0/2252819454 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa3d004a800 con 0x563d6e1d4ea0 2023-11-30T17:07:36.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.116+0000 7fa3f970db80 10 client.4662 fetch_fsmap finished waiting for FSMap version 8 2023-11-30T17:07:36.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.116+0000 7fa3f970db80 10 client.4662 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-30T17:07:36.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.116+0000 7fa3f970db80 20 client.4662 populate_metadata read hostname 'smithi049' 2023-11-30T17:07:36.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.116+0000 7fa3f970db80 1 --2- 172.21.15.49:0/2252819454 >> [v2:172.21.15.49:6833/2333639572,v1:172.21.15.49:6835/2333639572] conn(0x563d6e1b9200 0x563d6e1b95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:36.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.116+0000 7fa3f970db80 4 client.4662 mds_command: new command op to 4276 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-30T17:07:36.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.116+0000 7fa3f970db80 1 -- 172.21.15.49:0/2252819454 --> [v2:172.21.15.49:6833/2333639572,v1:172.21.15.49:6835/2333639572] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563d6df43ca0 con 0x563d6e1b9200 2023-11-30T17:07:36.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.116+0000 7fa3e5b11700 1 --2- 172.21.15.49:0/2252819454 >> [v2:172.21.15.49:6833/2333639572,v1:172.21.15.49:6835/2333639572] conn(0x563d6e1b9200 0x563d6e1b95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:36.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.117+0000 7fa3bbfff700 10 client.4662 ms_handle_connect on v2:172.21.15.49:6833/2333639572 2023-11-30T17:07:36.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.117+0000 7fa3e5b11700 1 --2- 172.21.15.49:0/2252819454 >> [v2:172.21.15.49:6833/2333639572,v1:172.21.15.49:6835/2333639572] conn(0x563d6e1b9200 0x563d6e1b95e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=2446876313ab7420 server_cookie=14817c79b020bff4 in_seq=0 out_seq=0 2023-11-30T17:07:36.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.117+0000 7fa3bbfff700 1 -- 172.21.15.49:0/2252819454 <== mds.0 v2:172.21.15.49:6833/2333639572 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x563d6df43ca0 con 0x563d6e1b9200 2023-11-30T17:07:36.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.117+0000 7fa3bbfff700 10 client.4662 handle_command_reply: tid=0 2023-11-30T17:07:36.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.117+0000 7fa3f970db80 1 client.4662 shutdown 2023-11-30T17:07:36.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.117+0000 7fa3f970db80 1 -- 172.21.15.49:0/2252819454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d6e1d4ea0 msgr2=0x563d6e1cbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:36.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.117+0000 7fa3f970db80 1 --2- 172.21.15.49:0/2252819454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d6e1d4ea0 0x563d6e1cbda0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fa3d0077ff0 tx=0x7fa3d0051040).stop 2023-11-30T17:07:36.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.117+0000 7fa3f970db80 1 -- 172.21.15.49:0/2252819454 shutdown_connections 2023-11-30T17:07:36.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.117+0000 7fa3f970db80 1 --2- 172.21.15.49:0/2252819454 >> [v2:172.21.15.49:6833/2333639572,v1:172.21.15.49:6835/2333639572] conn(0x563d6e1b9200 0x563d6e1b95e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.117+0000 7fa3f970db80 1 --2- 172.21.15.49:0/2252819454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d6e1d4ea0 0x563d6e1cbda0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.117+0000 7fa3bbfff700 0 client.4662 ms_handle_reset on v2:172.21.15.49:6833/2333639572 2023-11-30T17:07:36.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.117+0000 7fa3f970db80 1 --2- 172.21.15.49:0/2252819454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d6df47e40 0x563d6e1b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.117+0000 7fa3f970db80 1 --2- 172.21.15.49:0/2252819454 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563d6e18bcb0 0x563d6e1cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.117+0000 7fa3f970db80 1 -- 172.21.15.49:0/2252819454 >> 172.21.15.49:0/2252819454 conn(0x563d6dff54a0 msgr2=0x563d6e18c110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:36.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.118+0000 7fa3f970db80 1 -- 172.21.15.49:0/2252819454 shutdown_connections 2023-11-30T17:07:36.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.118+0000 7fa3f970db80 1 -- 172.21.15.49:0/2252819454 wait complete. 2023-11-30T17:07:36.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.118+0000 7fa3f970db80 20 client.4662 trim_cache size 0 max 16384 2023-11-30T17:07:36.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.134+0000 7fa3f970db80 1 Processor -- start 2023-11-30T17:07:36.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.134+0000 7fa3f970db80 1 -- start start 2023-11-30T17:07:36.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.135+0000 7fa3f970db80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d6df47e40 0x563d6e18cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:36.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.135+0000 7fa3f970db80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563d6e18bcb0 0x563d6e1ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:36.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.135+0000 7fa3f970db80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d6e1d4ea0 0x563d6e1b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:36.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.135+0000 7fa3f970db80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d6e187720 con 0x563d6e1d4ea0 2023-11-30T17:07:36.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.135+0000 7fa3f970db80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d6e188150 con 0x563d6df47e40 2023-11-30T17:07:36.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.135+0000 7fa3f970db80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x563d6e18cfb0 con 0x563d6e18bcb0 2023-11-30T17:07:36.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.135+0000 7fa3e6312700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d6e1d4ea0 0x563d6e1b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:36.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.135+0000 7fa3e6312700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d6e1d4ea0 0x563d6e1b5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38222/0 (socket says 172.21.15.49:38222) 2023-11-30T17:07:36.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.135+0000 7fa3e6312700 1 -- 172.21.15.49:0/2786724527 learned_addr learned my addr 172.21.15.49:0/2786724527 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:36.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.135+0000 7fa3e5310700 1 --2- 172.21.15.49:0/2786724527 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563d6e18bcb0 0x563d6e1ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:36.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.135+0000 7fa3e5b11700 1 --2- 172.21.15.49:0/2786724527 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d6df47e40 0x563d6e18cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:36.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.135+0000 7fa3e6312700 1 -- 172.21.15.49:0/2786724527 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563d6e18bcb0 msgr2=0x563d6e1ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:36.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.135+0000 7fa3e6312700 1 --2- 172.21.15.49:0/2786724527 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563d6e18bcb0 0x563d6e1ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.135+0000 7fa3e6312700 1 -- 172.21.15.49:0/2786724527 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d6df47e40 msgr2=0x563d6e18cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:36.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.135+0000 7fa3e6312700 1 --2- 172.21.15.49:0/2786724527 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d6df47e40 0x563d6e18cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.135+0000 7fa3e6312700 1 -- 172.21.15.49:0/2786724527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d6e1b80c0 con 0x563d6e1d4ea0 2023-11-30T17:07:36.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.135+0000 7fa3e5310700 1 --2- 172.21.15.49:0/2786724527 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563d6e18bcb0 0x563d6e1ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:36.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.135+0000 7fa3e6312700 1 --2- 172.21.15.49:0/2786724527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d6e1d4ea0 0x563d6e1b5cb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fa3d004e710 tx=0x7fa3d0060000).ready entity=mon.0 client_cookie=e4f86cc24f7a7314 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:36.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.136+0000 7fa3c77fe700 1 -- 172.21.15.49:0/2786724527 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d006b070 con 0x563d6e1d4ea0 2023-11-30T17:07:36.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.136+0000 7fa3c77fe700 1 -- 172.21.15.49:0/2786724527 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d0007980 con 0x563d6e1d4ea0 2023-11-30T17:07:36.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.136+0000 7fa3c77fe700 1 -- 172.21.15.49:0/2786724527 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0054040 con 0x563d6e1d4ea0 2023-11-30T17:07:36.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.136+0000 7fa3f970db80 1 -- 172.21.15.49:0/2786724527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d6e1d4ea0 msgr2=0x563d6e1b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:36.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.136+0000 7fa3f970db80 1 --2- 172.21.15.49:0/2786724527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d6e1d4ea0 0x563d6e1b5cb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fa3d004e710 tx=0x7fa3d0060000).stop 2023-11-30T17:07:36.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.136+0000 7fa3f970db80 1 -- 172.21.15.49:0/2786724527 shutdown_connections 2023-11-30T17:07:36.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.136+0000 7fa3f970db80 1 --2- 172.21.15.49:0/2786724527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d6e1d4ea0 0x563d6e1b5cb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.136+0000 7fa3f970db80 1 --2- 172.21.15.49:0/2786724527 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d6df47e40 0x563d6e18cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.136+0000 7fa3f970db80 1 --2- 172.21.15.49:0/2786724527 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563d6e18bcb0 0x563d6e1ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.136+0000 7fa3f970db80 1 -- 172.21.15.49:0/2786724527 >> 172.21.15.49:0/2786724527 conn(0x563d6dff54a0 msgr2=0x563d6e1b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:36.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.136+0000 7fa3f970db80 1 -- 172.21.15.49:0/2786724527 shutdown_connections 2023-11-30T17:07:36.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.136+0000 7fa3f970db80 1 -- 172.21.15.49:0/2786724527 wait complete. 2023-11-30T17:07:36.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.137+0000 7fa3f970db80 1 -- start start 2023-11-30T17:07:36.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.137+0000 7fa3f970db80 1 Processor -- start 2023-11-30T17:07:36.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.138+0000 7fa3f970db80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d6df47e40 0x563d6e1b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:36.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.138+0000 7fa3f970db80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d6e18bcb0 0x563d6e1b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:36.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.138+0000 7fa3f970db80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563d6e1d4ea0 0x563d6e1ec500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:36.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.138+0000 7fa3f970db80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d6e1b6690 con 0x563d6df47e40 2023-11-30T17:07:36.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.138+0000 7fa3f970db80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d6e1ed390 con 0x563d6e18bcb0 2023-11-30T17:07:36.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.138+0000 7fa3f970db80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x563d6e238f50 con 0x563d6e1d4ea0 2023-11-30T17:07:36.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.138+0000 7fa3f970db80 10 client.0 ll_register_callbacks cb 0x563d6e14b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-30T17:07:36.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.138+0000 7fa3e5b11700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d6df47e40 0x563d6e1b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:36.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.138+0000 7fa3e5b11700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d6df47e40 0x563d6e1b5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38226/0 (socket says 172.21.15.49:38226) 2023-11-30T17:07:36.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.138+0000 7fa3e5b11700 1 -- 172.21.15.49:0/3622838017 learned_addr learned my addr 172.21.15.49:0/3622838017 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:36.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.138+0000 7fa3e5310700 1 --2- 172.21.15.49:0/3622838017 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d6e18bcb0 0x563d6e1b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:36.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.138+0000 7fa3e6312700 1 --2- 172.21.15.49:0/3622838017 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563d6e1d4ea0 0x563d6e1ec500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:36.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.138+0000 7fa3e5b11700 1 -- 172.21.15.49:0/3622838017 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563d6e1d4ea0 msgr2=0x563d6e1ec500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:36.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.138+0000 7fa3e5b11700 1 --2- 172.21.15.49:0/3622838017 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563d6e1d4ea0 0x563d6e1ec500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.138+0000 7fa3e5b11700 1 -- 172.21.15.49:0/3622838017 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d6e18bcb0 msgr2=0x563d6e1b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:36.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.138+0000 7fa3e5b11700 1 --2- 172.21.15.49:0/3622838017 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d6e18bcb0 0x563d6e1b61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.138+0000 7fa3e5b11700 1 -- 172.21.15.49:0/3622838017 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563d6e0d19c0 con 0x563d6df47e40 2023-11-30T17:07:36.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.138+0000 7fa3e5310700 1 --2- 172.21.15.49:0/3622838017 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d6e18bcb0 0x563d6e1b61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:36.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.138+0000 7fa3e6312700 1 --2- 172.21.15.49:0/3622838017 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563d6e1d4ea0 0x563d6e1ec500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:36.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.138+0000 7fa3e5b11700 1 --2- 172.21.15.49:0/3622838017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d6df47e40 0x563d6e1b5cb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fa3d8011ed0 tx=0x7fa3d8017000).ready entity=mon.0 client_cookie=8aae4d08c7cff7c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:36.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.138+0000 7fa3bbfff700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-30T17:07:36.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.138+0000 7fa3bbfff700 1 -- 172.21.15.49:0/3622838017 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8014650 con 0x563d6df47e40 2023-11-30T17:07:36.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.138+0000 7fa3bbfff700 1 -- 172.21.15.49:0/3622838017 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa3d80147b0 con 0x563d6df47e40 2023-11-30T17:07:36.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.138+0000 7fa3f970db80 1 -- 172.21.15.49:0/3622838017 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa3d400dd40 con 0x563d6df47e40 2023-11-30T17:07:36.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.138+0000 7fa3bbfff700 1 -- 172.21.15.49:0/3622838017 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3d8014b80 con 0x563d6df47e40 2023-11-30T17:07:36.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.138+0000 7fa3f970db80 10 client.4668 fetch_fsmap learned FSMap version 8 2023-11-30T17:07:36.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.138+0000 7fa3f970db80 1 -- 172.21.15.49:0/3622838017 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x563d6e17f340 con 0x563d6df47e40 2023-11-30T17:07:36.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.139+0000 7fa3bbfff700 1 -- 172.21.15.49:0/3622838017 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d400dd40 con 0x563d6df47e40 2023-11-30T17:07:36.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.139+0000 7fa3bbfff700 1 -- 172.21.15.49:0/3622838017 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa3d8014ce0 con 0x563d6df47e40 2023-11-30T17:07:36.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.139+0000 7fa3f970db80 10 client.4668 fetch_fsmap finished waiting for FSMap version 8 2023-11-30T17:07:36.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.139+0000 7fa3f970db80 10 client.4668 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-30T17:07:36.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.139+0000 7fa3f970db80 20 client.4668 populate_metadata read hostname 'smithi049' 2023-11-30T17:07:36.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.139+0000 7fa3f970db80 1 --2- 172.21.15.49:0/3622838017 >> [v2:172.21.15.49:6833/2333639572,v1:172.21.15.49:6835/2333639572] conn(0x563d6e1ec9f0 0x563d6e1ecdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:36.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.139+0000 7fa3f970db80 4 client.4668 mds_command: new command op to 4276 tid=0[{"prefix": "status"}] 2023-11-30T17:07:36.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.139+0000 7fa3f970db80 1 -- 172.21.15.49:0/3622838017 --> [v2:172.21.15.49:6833/2333639572,v1:172.21.15.49:6835/2333639572] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563d6df7aca0 con 0x563d6e1ec9f0 2023-11-30T17:07:36.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.139+0000 7fa3e5310700 1 --2- 172.21.15.49:0/3622838017 >> [v2:172.21.15.49:6833/2333639572,v1:172.21.15.49:6835/2333639572] conn(0x563d6e1ec9f0 0x563d6e1ecdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:36.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.139+0000 7fa3bbfff700 10 client.4668 ms_handle_connect on v2:172.21.15.49:6833/2333639572 2023-11-30T17:07:36.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.139+0000 7fa3e5310700 1 --2- 172.21.15.49:0/3622838017 >> [v2:172.21.15.49:6833/2333639572,v1:172.21.15.49:6835/2333639572] conn(0x563d6e1ec9f0 0x563d6e1ecdd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=15d8973425fd74b server_cookie=9c74dbfe865d3f18 in_seq=0 out_seq=0 2023-11-30T17:07:36.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.139+0000 7fa3bbfff700 1 -- 172.21.15.49:0/3622838017 <== mds.0 v2:172.21.15.49:6833/2333639572 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x563d6df7aca0 con 0x563d6e1ec9f0 2023-11-30T17:07:36.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.139+0000 7fa3bbfff700 10 client.4668 handle_command_reply: tid=0 2023-11-30T17:07:36.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.139+0000 7fa3f970db80 1 client.4668 shutdown 2023-11-30T17:07:36.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.139+0000 7fa3f970db80 1 -- 172.21.15.49:0/3622838017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d6df47e40 msgr2=0x563d6e1b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:36.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.139+0000 7fa3f970db80 1 --2- 172.21.15.49:0/3622838017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d6df47e40 0x563d6e1b5cb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fa3d8011ed0 tx=0x7fa3d8017000).stop 2023-11-30T17:07:36.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.139+0000 7fa3f970db80 1 -- 172.21.15.49:0/3622838017 shutdown_connections 2023-11-30T17:07:36.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.139+0000 7fa3f970db80 1 --2- 172.21.15.49:0/3622838017 >> [v2:172.21.15.49:6833/2333639572,v1:172.21.15.49:6835/2333639572] conn(0x563d6e1ec9f0 0x563d6e1ecdd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.140+0000 7fa3f970db80 1 --2- 172.21.15.49:0/3622838017 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563d6e1d4ea0 0x563d6e1ec500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.140+0000 7fa3f970db80 1 --2- 172.21.15.49:0/3622838017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d6df47e40 0x563d6e1b5cb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.140+0000 7fa3f970db80 1 --2- 172.21.15.49:0/3622838017 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d6e18bcb0 0x563d6e1b61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.140+0000 7fa3bbfff700 0 client.4668 ms_handle_reset on v2:172.21.15.49:6833/2333639572 2023-11-30T17:07:36.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.140+0000 7fa3f970db80 1 -- 172.21.15.49:0/3622838017 >> 172.21.15.49:0/3622838017 conn(0x563d6dff54a0 msgr2=0x563d6e1e9a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:36.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.140+0000 7fa3f970db80 1 -- 172.21.15.49:0/3622838017 shutdown_connections 2023-11-30T17:07:36.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.140+0000 7fa3f970db80 1 -- 172.21.15.49:0/3622838017 wait complete. 2023-11-30T17:07:36.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.140+0000 7fa3f970db80 20 client.4668 trim_cache size 0 max 16384 2023-11-30T17:07:36.154 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T17:07:36.155 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "ef213ed4-8f62-4ad5-b55f-7510fd0ee359", 2023-11-30T17:07:36.155 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2023-11-30T17:07:36.155 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4276, 2023-11-30T17:07:36.155 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-11-30T17:07:36.155 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-11-30T17:07:36.155 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-11-30T17:07:36.155 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 19.852848968, 2023-11-30T17:07:36.155 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 8, 2023-11-30T17:07:36.155 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 22, 2023-11-30T17:07:36.155 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 22, 2023-11-30T17:07:36.155 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 24.167057080999999 2023-11-30T17:07:36.155 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T17:07:36.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.140+0000 7fa3e7d75700 1 -- 172.21.15.49:0/17743881 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa3cc05f150 msgr2=0x7fa3cc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:36.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.140+0000 7fa3e7d75700 1 --2- 172.21.15.49:0/17743881 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa3cc05f150 0x7fa3cc061610 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fa3d8009b90 tx=0x7fa3d8009060).stop 2023-11-30T17:07:36.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.140+0000 7fa3e7d75700 1 -- 172.21.15.49:0/17743881 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3e0152640 msgr2=0x7fa3e0147450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:36.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.140+0000 7fa3e7d75700 1 --2- 172.21.15.49:0/17743881 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3e0152640 0x7fa3e0147450 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fa3d0002250 tx=0x7fa3d0007f50).stop 2023-11-30T17:07:36.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.140+0000 7fa3e7d75700 1 -- 172.21.15.49:0/17743881 shutdown_connections 2023-11-30T17:07:36.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.140+0000 7fa3e7d75700 1 --2- 172.21.15.49:0/17743881 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa3cc05f150 0x7fa3cc061610 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.140+0000 7fa3e7d75700 1 --2- 172.21.15.49:0/17743881 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3e0152640 0x7fa3e0147450 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.140+0000 7fa3e7d75700 1 --2- 172.21.15.49:0/17743881 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3e00be5d0 0x7fa3e0157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.140+0000 7fa3e7d75700 1 --2- 172.21.15.49:0/17743881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3e00c4f20 0x7fa3e014c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.140+0000 7fa3e7d75700 1 -- 172.21.15.49:0/17743881 >> 172.21.15.49:0/17743881 conn(0x7fa3e0063810 msgr2=0x7fa3e01516c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:36.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.140+0000 7fa3e7d75700 1 -- 172.21.15.49:0/17743881 shutdown_connections 2023-11-30T17:07:36.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.140+0000 7fa3e7d75700 1 -- 172.21.15.49:0/17743881 wait complete. 2023-11-30T17:07:36.160 INFO:teuthology.run_tasks:Running task kclient... 2023-11-30T17:07:36.184 INFO:tasks.kclient:Mounting kernel clients... 2023-11-30T17:07:36.184 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-30T17:07:36.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:36.185 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-11-30T17:07:36.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:36.200 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2023-11-30T17:07:36.268 INFO:teuthology.orchestra.run.smithi049.stderr:Cannot find device "ceph-brx" 2023-11-30T17:07:36.269 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-30T17:07:36.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:36.270 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-11-30T17:07:36.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:36.326 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2023-11-30T17:07:36.392 INFO:teuthology.orchestra.run.smithi049.stderr:Cannot find device "ceph-brx" 2023-11-30T17:07:36.392 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-30T17:07:36.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:36.393 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-11-30T17:07:36.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:36.411 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link delete ceph-brx 2023-11-30T17:07:36.482 INFO:teuthology.orchestra.run.smithi115.stderr:Cannot find device "ceph-brx" 2023-11-30T17:07:36.483 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-30T17:07:36.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:36.484 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-11-30T17:07:36.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:36.542 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link delete ceph-brx 2023-11-30T17:07:36.610 INFO:teuthology.orchestra.run.smithi115.stderr:Cannot find device "ceph-brx" 2023-11-30T17:07:36.611 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-30T17:07:36.611 INFO:tasks.kclient:client.0 config is {} 2023-11-30T17:07:36.612 DEBUG:teuthology.orchestra.run.smithi049:> ceph fs ls 2023-11-30T17:07:36.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.717+0000 7f12a30b9700 1 Processor -- start 2023-11-30T17:07:36.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.717+0000 7f12a30b9700 1 -- start start 2023-11-30T17:07:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.718+0000 7f12a30b9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f129c154490 0x7f129c0c2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.718+0000 7f12a30b9700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f129c0be270 0x7f129c0654f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.718+0000 7f12a30b9700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f129c0bdde0 con 0x7f129c062780 2023-11-30T17:07:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.718+0000 7f12a30b9700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f129c0bd1d0 con 0x7f129c0be270 2023-11-30T17:07:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.718+0000 7f12a30b9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129c0bd4b0 con 0x7f129c154490 2023-11-30T17:07:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.718+0000 7f12a20b7700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f129c062780 0x7f129c062b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40748/0 (socket says 172.21.15.49:40748) 2023-11-30T17:07:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.718+0000 7f12a20b7700 1 -- 172.21.15.49:0/110788016 learned_addr learned my addr 172.21.15.49:0/110788016 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.718+0000 7f12a10b5700 1 -- 172.21.15.49:0/110788016 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2863918476 0 0) 0x7f129c0bdde0 con 0x7f129c062780 2023-11-30T17:07:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.718+0000 7f12a10b5700 1 -- 172.21.15.49:0/110788016 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12840033f0 con 0x7f129c062780 2023-11-30T17:07:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.718+0000 7f12a18b6700 1 --2- 172.21.15.49:0/110788016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f129c154490 0x7f129c0c2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.718+0000 7f12a28b8700 1 --2- 172.21.15.49:0/110788016 >> v2:172.21.15.115:3300/0 conn(0x7f129c0be270 0x7f129c0654f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.719+0000 7f12a10b5700 1 -- 172.21.15.49:0/110788016 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 186828655 0 0) 0x7f12840033f0 con 0x7f129c062780 2023-11-30T17:07:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.719+0000 7f12a10b5700 1 -- 172.21.15.49:0/110788016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f129c154490 msgr2=0x7f129c0c2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.719+0000 7f12a10b5700 1 --2- 172.21.15.49:0/110788016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f129c154490 0x7f129c0c2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.719+0000 7f12a10b5700 1 -- 172.21.15.49:0/110788016 >> v2:172.21.15.115:3300/0 conn(0x7f129c0be270 msgr2=0x7f129c0654f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.719+0000 7f12a10b5700 1 --2- 172.21.15.49:0/110788016 >> v2:172.21.15.115:3300/0 conn(0x7f129c0be270 0x7f129c0654f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.719+0000 7f12a10b5700 1 -- 172.21.15.49:0/110788016 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129c0bd790 con 0x7f129c062780 2023-11-30T17:07:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.719+0000 7f12a10b5700 1 -- 172.21.15.49:0/110788016 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f1294001470 con 0x7f129c062780 2023-11-30T17:07:36.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.719+0000 7f12a10b5700 1 -- 172.21.15.49:0/110788016 >> v1:172.21.15.49:6789/0 conn(0x7f129c062780 legacy=0x7f129c062b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:36.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.719+0000 7f12a10b5700 1 --2- 172.21.15.49:0/110788016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12840038e0 0x7f1284003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:36.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.719+0000 7f12a10b5700 1 --2- 172.21.15.49:0/110788016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f129c154490 0x7f1284004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:36.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.719+0000 7f12a10b5700 1 --2- 172.21.15.49:0/110788016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1284004b80 0x7f1284005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:36.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.719+0000 7f12a10b5700 1 -- 172.21.15.49:0/110788016 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c0bd1d0 con 0x7f1284004b80 2023-11-30T17:07:36.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.719+0000 7f12a10b5700 1 -- 172.21.15.49:0/110788016 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c0bd4b0 con 0x7f12840038e0 2023-11-30T17:07:36.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.719+0000 7f12a10b5700 1 -- 172.21.15.49:0/110788016 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128400b8e0 con 0x7f129c154490 2023-11-30T17:07:36.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.719+0000 7f12a20b7700 1 --2- 172.21.15.49:0/110788016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12840038e0 0x7f1284003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:36.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.719+0000 7f12a28b8700 1 --2- 172.21.15.49:0/110788016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1284004b80 0x7f1284005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:36.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.719+0000 7f12a18b6700 1 --2- 172.21.15.49:0/110788016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f129c154490 0x7f1284004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:36.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.719+0000 7f12a28b8700 1 -- 172.21.15.49:0/110788016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f129c154490 msgr2=0x7f1284004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:36.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.719+0000 7f12a28b8700 1 --2- 172.21.15.49:0/110788016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f129c154490 0x7f1284004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.719+0000 7f12a28b8700 1 -- 172.21.15.49:0/110788016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12840038e0 msgr2=0x7f1284003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:36.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.719+0000 7f12a28b8700 1 --2- 172.21.15.49:0/110788016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12840038e0 0x7f1284003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.719+0000 7f12a28b8700 1 -- 172.21.15.49:0/110788016 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12840033f0 con 0x7f1284004b80 2023-11-30T17:07:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.719+0000 7f12a28b8700 1 --2- 172.21.15.49:0/110788016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1284004b80 0x7f1284005000 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f129c0bed70 tx=0x7f128c00b040).ready entity=mon.0 client_cookie=d4eff9d1da38179d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.719+0000 7f12a10b5700 1 -- 172.21.15.49:0/110788016 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c009ac0 con 0x7f1284004b80 2023-11-30T17:07:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.719+0000 7f12a10b5700 1 -- 172.21.15.49:0/110788016 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128c00f040 con 0x7f1284004b80 2023-11-30T17:07:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.719+0000 7f12a10b5700 1 -- 172.21.15.49:0/110788016 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c00eca0 con 0x7f1284004b80 2023-11-30T17:07:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.720+0000 7f12a30b9700 1 -- 172.21.15.49:0/110788016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1284004b80 msgr2=0x7f1284005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.720+0000 7f12a30b9700 1 --2- 172.21.15.49:0/110788016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1284004b80 0x7f1284005000 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f129c0bed70 tx=0x7f128c00b040).stop 2023-11-30T17:07:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.720+0000 7f12a28b8700 1 -- 172.21.15.49:0/110788016 reap_dead start 2023-11-30T17:07:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.720+0000 7f12a30b9700 1 -- 172.21.15.49:0/110788016 shutdown_connections 2023-11-30T17:07:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.720+0000 7f12a30b9700 1 -- 172.21.15.49:0/110788016 >> 172.21.15.49:0/110788016 conn(0x7f129c0c7d00 msgr2=0x7f129c0c8110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.720+0000 7f12a30b9700 1 -- 172.21.15.49:0/110788016 shutdown_connections 2023-11-30T17:07:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.720+0000 7f12a30b9700 1 -- 172.21.15.49:0/110788016 wait complete. 2023-11-30T17:07:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.721+0000 7f12a30b9700 1 Processor -- start 2023-11-30T17:07:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.721+0000 7f12a30b9700 1 -- start start 2023-11-30T17:07:36.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.722+0000 7f12a30b9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1284004b80 0x7f129c0a6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:36.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.722+0000 7f12a30b9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f129c0bee80 0x7f129c0bf780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:36.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.722+0000 7f12a30b9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f129c0ad670 0x7f129c0c1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:36.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.722+0000 7f12a30b9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c0a6730 con 0x7f129c0bee80 2023-11-30T17:07:36.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.722+0000 7f12a30b9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c0a57b0 con 0x7f1284004b80 2023-11-30T17:07:36.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.722+0000 7f12a30b9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129c0abb80 con 0x7f129c0ad670 2023-11-30T17:07:36.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.722+0000 7f12a18b6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f129c0bee80 0x7f129c0bf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:36.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.722+0000 7f12a18b6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f129c0bee80 0x7f129c0bf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38234/0 (socket says 172.21.15.49:38234) 2023-11-30T17:07:36.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.722+0000 7f12a18b6700 1 -- 172.21.15.49:0/2032709219 learned_addr learned my addr 172.21.15.49:0/2032709219 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:36.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.722+0000 7f12a20b7700 1 --2- 172.21.15.49:0/2032709219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1284004b80 0x7f129c0a6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:36.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.722+0000 7f12a28b8700 1 --2- 172.21.15.49:0/2032709219 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f129c0ad670 0x7f129c0c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:36.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.722+0000 7f12a18b6700 1 -- 172.21.15.49:0/2032709219 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f129c0ad670 msgr2=0x7f129c0c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:36.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.722+0000 7f12a18b6700 1 --2- 172.21.15.49:0/2032709219 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f129c0ad670 0x7f129c0c1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.722+0000 7f12a18b6700 1 -- 172.21.15.49:0/2032709219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1284004b80 msgr2=0x7f129c0a6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:36.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.722+0000 7f12a18b6700 1 --2- 172.21.15.49:0/2032709219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1284004b80 0x7f129c0a6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.722+0000 7f12a18b6700 1 -- 172.21.15.49:0/2032709219 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129c0abe60 con 0x7f129c0bee80 2023-11-30T17:07:36.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.722+0000 7f12a18b6700 1 --2- 172.21.15.49:0/2032709219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f129c0bee80 0x7f129c0bf780 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f12900119f0 tx=0x7f1290009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:36.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.723+0000 7f129a7fc700 1 -- 172.21.15.49:0/2032709219 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129000f6e0 con 0x7f129c0bee80 2023-11-30T17:07:36.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.723+0000 7f129a7fc700 1 -- 172.21.15.49:0/2032709219 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129000f840 con 0x7f129c0bee80 2023-11-30T17:07:36.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.723+0000 7f12a30b9700 1 -- 172.21.15.49:0/2032709219 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f129c0a5a40 con 0x7f129c0bee80 2023-11-30T17:07:36.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.723+0000 7f129a7fc700 1 -- 172.21.15.49:0/2032709219 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129000fbc0 con 0x7f129c0bee80 2023-11-30T17:07:36.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.723+0000 7f12a30b9700 1 -- 172.21.15.49:0/2032709219 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f129c0bfc70 con 0x7f129c0bee80 2023-11-30T17:07:36.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.724+0000 7f12a30b9700 1 -- 172.21.15.49:0/2032709219 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f129c0a5f60 con 0x7f129c0bee80 2023-11-30T17:07:36.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.724+0000 7f129a7fc700 1 -- 172.21.15.49:0/2032709219 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1290014440 con 0x7f129c0bee80 2023-11-30T17:07:36.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.724+0000 7f129a7fc700 1 --2- 172.21.15.49:0/2032709219 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f128805f150 0x7f1288061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:36.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.724+0000 7f129a7fc700 1 -- 172.21.15.49:0/2032709219 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f129007a9f0 con 0x7f129c0bee80 2023-11-30T17:07:36.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.725+0000 7f12a20b7700 1 --2- 172.21.15.49:0/2032709219 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f128805f150 0x7f1288061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:36.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.725+0000 7f12a20b7700 1 --2- 172.21.15.49:0/2032709219 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f128805f150 0x7f1288061610 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f1294007860 tx=0x7f129c0a4d70).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:36.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.728+0000 7f129a7fc700 1 -- 172.21.15.49:0/2032709219 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f129c0a5f60 con 0x7f129c0bee80 2023-11-30T17:07:36.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.949+0000 7f12a30b9700 1 -- 172.21.15.49:0/2032709219 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f129c068850 con 0x7f129c0bee80 2023-11-30T17:07:36.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.949+0000 7f129a7fc700 1 -- 172.21.15.49:0/2032709219 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1290022030 con 0x7f129c0bee80 2023-11-30T17:07:36.951 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-30T17:07:36.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.951+0000 7f12a30b9700 1 -- 172.21.15.49:0/2032709219 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f128805f150 msgr2=0x7f1288061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:36.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.951+0000 7f12a30b9700 1 --2- 172.21.15.49:0/2032709219 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f128805f150 0x7f1288061610 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f1294007860 tx=0x7f129c0a4d70).stop 2023-11-30T17:07:36.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.951+0000 7f12a30b9700 1 -- 172.21.15.49:0/2032709219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f129c0bee80 msgr2=0x7f129c0bf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:36.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.951+0000 7f12a30b9700 1 --2- 172.21.15.49:0/2032709219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f129c0bee80 0x7f129c0bf780 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f12900119f0 tx=0x7f1290009060).stop 2023-11-30T17:07:36.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.951+0000 7f12a30b9700 1 -- 172.21.15.49:0/2032709219 shutdown_connections 2023-11-30T17:07:36.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.951+0000 7f12a30b9700 1 --2- 172.21.15.49:0/2032709219 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f129c0ad670 0x7f129c0c1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.951+0000 7f12a30b9700 1 --2- 172.21.15.49:0/2032709219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1284004b80 0x7f129c0a6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.951+0000 7f12a30b9700 1 --2- 172.21.15.49:0/2032709219 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f128805f150 0x7f1288061610 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.951+0000 7f12a30b9700 1 --2- 172.21.15.49:0/2032709219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f129c0bee80 0x7f129c0bf780 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:36.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.951+0000 7f12a30b9700 1 -- 172.21.15.49:0/2032709219 >> 172.21.15.49:0/2032709219 conn(0x7f129c0c7d00 msgr2=0x7f129c0a6970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:36.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.951+0000 7f12a30b9700 1 -- 172.21.15.49:0/2032709219 shutdown_connections 2023-11-30T17:07:36.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:36.951+0000 7f12a30b9700 1 -- 172.21.15.49:0/2032709219 wait complete. 2023-11-30T17:07:36.963 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-30T17:07:36.963 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-30T17:07:36.963 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-11-30T17:07:36.963 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-30T17:07:36.963 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-30T17:07:36.964 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-30T17:07:36.964 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-30T17:07:36.964 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-30T17:07:36.964 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-30T17:07:36.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:36.964 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-11-30T17:07:36.980 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-30T17:07:36.980 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-30T17:07:36.980 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-11-30T17:07:36.980 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:36.980 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-11-30T17:07:36.980 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:36.980 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:07:36.980 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:07:36.980 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-11-30T17:07:36.981 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:07:36.981 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:07:36.981 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-11-30T17:07:36.981 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-30T17:07:36.981 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:07:36.981 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-11-30T17:07:36.981 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-30T17:07:36.981 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42418sec preferred_lft 42418sec 2023-11-30T17:07:36.981 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2023-11-30T17:07:36.981 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:36.981 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:07:36.981 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:07:36.981 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-11-30T17:07:36.982 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-30T17:07:36.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:36.982 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-11-30T17:07:36.982 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-11-30T17:07:36.982 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add name ceph-brx type bridge 2023-11-30T17:07:36.982 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr flush dev ceph-brx 2023-11-30T17:07:36.982 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set ceph-brx up 2023-11-30T17:07:36.982 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-30T17:07:36.982 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-11-30T17:07:37.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:37.135 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-30T17:07:37.181 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-11-30T17:07:37.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:37.183 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-11-30T17:07:37.219 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-11-30T17:07:37.219 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-30T17:07:37.219 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-30T17:07:37.219 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-30T17:07:37.219 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-30T17:07:37.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:37.220 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-11-30T17:07:37.220 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-11-30T17:07:37.220 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-30T17:07:37.220 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-30T17:07:37.220 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-30T17:07:37.220 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-11-30T17:07:37.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:37.520 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-11-30T17:07:37.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:37.536 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list-id 2023-11-30T17:07:37.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:37.591 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-11-30T17:07:37.591 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-11-30T17:07:37.591 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-30T17:07:37.591 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-30T17:07:37.591 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-11-30T17:07:37.681 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-30T17:07:37.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:37.682 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-11-30T17:07:37.682 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-11-30T17:07:37.682 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-30T17:07:37.682 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-30T17:07:37.682 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-30T17:07:37.682 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-30T17:07:37.682 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-30T17:07:37.682 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-11-30T17:07:37.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:37.889 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-11-30T17:07:37.889 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-11-30T17:07:37.889 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-11-30T17:07:37.889 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set dev brx.0 master ceph-brx 2023-11-30T17:07:37.889 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-11-30T17:07:37.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:37.984 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-11-30T17:07:37.999 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-30T17:07:37.999 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:07:38.090 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:07:38.091 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-30T17:07:38.191 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:07:38.191 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-30T17:07:38.194 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-30T17:07:38.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:38.194 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-30T17:07:38.219 INFO:tasks.kclient:client.2 config is {} 2023-11-30T17:07:38.220 DEBUG:teuthology.orchestra.run.smithi049:> ceph fs ls 2023-11-30T17:07:38.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.364+0000 7f8f3d9c5700 1 Processor -- start 2023-11-30T17:07:38.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.364+0000 7f8f3d9c5700 1 -- start start 2023-11-30T17:07:38.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.365+0000 7f8f3d9c5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f380aa1a0 0x7f8f380aa620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:38.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.365+0000 7f8f3d9c5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8f380c7c50 0x7f8f380c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:38.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.365+0000 7f8f3d9c5700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f380c6d80 con 0x7f8f38154700 2023-11-30T17:07:38.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.365+0000 7f8f3d9c5700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f380c85d0 con 0x7f8f380c7c50 2023-11-30T17:07:38.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.365+0000 7f8f3d9c5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f38154ae0 con 0x7f8f380aa1a0 2023-11-30T17:07:38.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.365+0000 7f8f36ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8f38154700 0x7f8f380c7210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40756/0 (socket says 172.21.15.49:40756) 2023-11-30T17:07:38.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.365+0000 7f8f377fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8f380c7c50 0x7f8f380c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:38.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.365+0000 7f8f36ffd700 1 -- 172.21.15.49:0/4008897652 learned_addr learned my addr 172.21.15.49:0/4008897652 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:38.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.365+0000 7f8f367fc700 1 --2- 172.21.15.49:0/4008897652 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f380aa1a0 0x7f8f380aa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:38.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.365+0000 7f8f377fe700 1 -- 172.21.15.49:0/4008897652 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f380aa1a0 msgr2=0x7f8f380aa620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:38.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.365+0000 7f8f377fe700 1 --2- 172.21.15.49:0/4008897652 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f380aa1a0 0x7f8f380aa620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:38.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.365+0000 7f8f377fe700 1 -- 172.21.15.49:0/4008897652 >> v1:172.21.15.49:6789/0 conn(0x7f8f38154700 legacy=0x7f8f380c7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:38.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.365+0000 7f8f377fe700 1 -- 172.21.15.49:0/4008897652 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f38064c30 con 0x7f8f380c7c50 2023-11-30T17:07:38.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.365+0000 7f8f35ffb700 1 -- 172.21.15.49:0/4008897652 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3825958741 0 0) 0x7f8f380c6d80 con 0x7f8f38154700 2023-11-30T17:07:38.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.365+0000 7f8f367fc700 1 --2- 172.21.15.49:0/4008897652 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f380aa1a0 0x7f8f380aa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:38.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.365+0000 7f8f377fe700 1 --2- 172.21.15.49:0/4008897652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f380c7c50 0x7f8f380c80e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f8f28009e60 tx=0x7f8f28009780).ready entity=mon.0 client_cookie=1d5c3ea6b0ba32c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:38.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.365+0000 7f8f35ffb700 1 -- 172.21.15.49:0/4008897652 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2800e070 con 0x7f8f380c7c50 2023-11-30T17:07:38.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.366+0000 7f8f35ffb700 1 -- 172.21.15.49:0/4008897652 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2800bc30 con 0x7f8f380c7c50 2023-11-30T17:07:38.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.366+0000 7f8f35ffb700 1 -- 172.21.15.49:0/4008897652 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f28012410 con 0x7f8f380c7c50 2023-11-30T17:07:38.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.366+0000 7f8f3d9c5700 1 -- 172.21.15.49:0/4008897652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f380c7c50 msgr2=0x7f8f380c80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:38.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.366+0000 7f8f3d9c5700 1 --2- 172.21.15.49:0/4008897652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f380c7c50 0x7f8f380c80e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f8f28009e60 tx=0x7f8f28009780).stop 2023-11-30T17:07:38.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.366+0000 7f8f3d9c5700 1 -- 172.21.15.49:0/4008897652 shutdown_connections 2023-11-30T17:07:38.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.366+0000 7f8f3d9c5700 1 --2- 172.21.15.49:0/4008897652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f380c7c50 0x7f8f380c80e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:38.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.366+0000 7f8f3d9c5700 1 --2- 172.21.15.49:0/4008897652 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f380aa1a0 0x7f8f380aa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:38.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.366+0000 7f8f3d9c5700 1 -- 172.21.15.49:0/4008897652 >> 172.21.15.49:0/4008897652 conn(0x7f8f380948b0 msgr2=0x7f8f3806a690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:38.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.366+0000 7f8f3d9c5700 1 -- 172.21.15.49:0/4008897652 shutdown_connections 2023-11-30T17:07:38.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.366+0000 7f8f3d9c5700 1 -- 172.21.15.49:0/4008897652 wait complete. 2023-11-30T17:07:38.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.367+0000 7f8f3d9c5700 1 Processor -- start 2023-11-30T17:07:38.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.367+0000 7f8f3d9c5700 1 -- start start 2023-11-30T17:07:38.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.368+0000 7f8f3d9c5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f380aa1a0 0x7f8f38163a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:38.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.368+0000 7f8f3d9c5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f380c7c50 0x7f8f38156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:38.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.368+0000 7f8f3d9c5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f38154700 0x7f8f38156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:38.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.368+0000 7f8f3d9c5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f381570f0 con 0x7f8f380aa1a0 2023-11-30T17:07:38.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.368+0000 7f8f3d9c5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f380aef10 con 0x7f8f38154700 2023-11-30T17:07:38.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.368+0000 7f8f3d9c5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f380ae300 con 0x7f8f380c7c50 2023-11-30T17:07:38.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.368+0000 7f8f36ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f380aa1a0 0x7f8f38163a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:38.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.368+0000 7f8f36ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f380aa1a0 0x7f8f38163a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38250/0 (socket says 172.21.15.49:38250) 2023-11-30T17:07:38.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.368+0000 7f8f36ffd700 1 -- 172.21.15.49:0/4073104407 learned_addr learned my addr 172.21.15.49:0/4073104407 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:38.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.368+0000 7f8f377fe700 1 --2- 172.21.15.49:0/4073104407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f38154700 0x7f8f38156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:38.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.368+0000 7f8f367fc700 1 --2- 172.21.15.49:0/4073104407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f380c7c50 0x7f8f38156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:38.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.369+0000 7f8f36ffd700 1 -- 172.21.15.49:0/4073104407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f380c7c50 msgr2=0x7f8f38156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:38.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.369+0000 7f8f36ffd700 1 --2- 172.21.15.49:0/4073104407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f380c7c50 0x7f8f38156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:38.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.369+0000 7f8f36ffd700 1 -- 172.21.15.49:0/4073104407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f38154700 msgr2=0x7f8f38156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:38.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.369+0000 7f8f36ffd700 1 --2- 172.21.15.49:0/4073104407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f38154700 0x7f8f38156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:38.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.369+0000 7f8f36ffd700 1 -- 172.21.15.49:0/4073104407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f28009a20 con 0x7f8f380aa1a0 2023-11-30T17:07:38.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.369+0000 7f8f36ffd700 1 --2- 172.21.15.49:0/4073104407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f380aa1a0 0x7f8f38163a40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f8f3000c510 tx=0x7f8f30007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:38.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.369+0000 7f8f2effd700 1 -- 172.21.15.49:0/4073104407 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f300072e0 con 0x7f8f380aa1a0 2023-11-30T17:07:38.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.369+0000 7f8f2effd700 1 -- 172.21.15.49:0/4073104407 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f30007440 con 0x7f8f380aa1a0 2023-11-30T17:07:38.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.369+0000 7f8f3d9c5700 1 -- 172.21.15.49:0/4073104407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f380ae5e0 con 0x7f8f380aa1a0 2023-11-30T17:07:38.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.369+0000 7f8f2effd700 1 -- 172.21.15.49:0/4073104407 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f300057a0 con 0x7f8f380aa1a0 2023-11-30T17:07:38.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.369+0000 7f8f3d9c5700 1 -- 172.21.15.49:0/4073104407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f380aeba0 con 0x7f8f380aa1a0 2023-11-30T17:07:38.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.370+0000 7f8f3d9c5700 1 -- 172.21.15.49:0/4073104407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f380475e0 con 0x7f8f380aa1a0 2023-11-30T17:07:38.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.370+0000 7f8f2effd700 1 -- 172.21.15.49:0/4073104407 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8f30005bd0 con 0x7f8f380aa1a0 2023-11-30T17:07:38.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.371+0000 7f8f2effd700 1 --2- 172.21.15.49:0/4073104407 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8f1805f150 0x7f8f18061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:38.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.371+0000 7f8f2effd700 1 -- 172.21.15.49:0/4073104407 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8f30079af0 con 0x7f8f380aa1a0 2023-11-30T17:07:38.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.371+0000 7f8f367fc700 1 --2- 172.21.15.49:0/4073104407 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8f1805f150 0x7f8f18061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:38.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.371+0000 7f8f367fc700 1 --2- 172.21.15.49:0/4073104407 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8f1805f150 0x7f8f18061610 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f8f38150ae0 tx=0x7f8f20008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:38.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.375+0000 7f8f2effd700 1 -- 172.21.15.49:0/4073104407 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8f3004aca0 con 0x7f8f380aa1a0 2023-11-30T17:07:38.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.591+0000 7f8f3d9c5700 1 -- 172.21.15.49:0/4073104407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8f380c6450 con 0x7f8f380aa1a0 2023-11-30T17:07:38.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.591+0000 7f8f2effd700 1 -- 172.21.15.49:0/4073104407 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8f30007db0 con 0x7f8f380aa1a0 2023-11-30T17:07:38.593 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-30T17:07:38.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.593+0000 7f8f3d9c5700 1 -- 172.21.15.49:0/4073104407 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8f1805f150 msgr2=0x7f8f18061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:38.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.593+0000 7f8f3d9c5700 1 --2- 172.21.15.49:0/4073104407 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8f1805f150 0x7f8f18061610 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f8f38150ae0 tx=0x7f8f20008040).stop 2023-11-30T17:07:38.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.593+0000 7f8f3d9c5700 1 -- 172.21.15.49:0/4073104407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f380aa1a0 msgr2=0x7f8f38163a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:38.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.593+0000 7f8f3d9c5700 1 --2- 172.21.15.49:0/4073104407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f380aa1a0 0x7f8f38163a40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f8f3000c510 tx=0x7f8f30007c70).stop 2023-11-30T17:07:38.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.593+0000 7f8f3d9c5700 1 -- 172.21.15.49:0/4073104407 shutdown_connections 2023-11-30T17:07:38.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.593+0000 7f8f3d9c5700 1 --2- 172.21.15.49:0/4073104407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f38154700 0x7f8f38156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:38.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.593+0000 7f8f3d9c5700 1 --2- 172.21.15.49:0/4073104407 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8f1805f150 0x7f8f18061610 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:38.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.593+0000 7f8f3d9c5700 1 --2- 172.21.15.49:0/4073104407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f380aa1a0 0x7f8f38163a40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:38.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.593+0000 7f8f3d9c5700 1 --2- 172.21.15.49:0/4073104407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f380c7c50 0x7f8f38156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:38.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.593+0000 7f8f3d9c5700 1 -- 172.21.15.49:0/4073104407 >> 172.21.15.49:0/4073104407 conn(0x7f8f380948b0 msgr2=0x7f8f380c7210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:38.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.593+0000 7f8f3d9c5700 1 -- 172.21.15.49:0/4073104407 shutdown_connections 2023-11-30T17:07:38.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:38.593+0000 7f8f3d9c5700 1 -- 172.21.15.49:0/4073104407 wait complete. 2023-11-30T17:07:38.605 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-30T17:07:38.605 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-30T17:07:38.605 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-11-30T17:07:38.605 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-30T17:07:38.605 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-30T17:07:38.606 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-30T17:07:38.606 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-30T17:07:38.606 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-30T17:07:38.606 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-30T17:07:38.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:38.606 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-11-30T17:07:38.622 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-30T17:07:38.622 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-30T17:07:38.622 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-11-30T17:07:38.622 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:38.622 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-11-30T17:07:38.622 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:38.622 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:07:38.622 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:07:38.622 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-11-30T17:07:38.623 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:07:38.623 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:07:38.623 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-11-30T17:07:38.623 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-30T17:07:38.623 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:07:38.623 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-11-30T17:07:38.623 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-30T17:07:38.623 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42416sec preferred_lft 42416sec 2023-11-30T17:07:38.623 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2023-11-30T17:07:38.623 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:38.623 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:07:38.624 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:07:38.624 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-11-30T17:07:38.624 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-30T17:07:38.624 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 3e:e9:3c:a8:7a:95 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:07:38.624 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-30T17:07:38.624 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:38.624 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::8b6:11ff:fe93:7174/64 scope link 2023-11-30T17:07:38.624 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:38.624 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-30T17:07:38.624 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 3e:e9:3c:a8:7a:95 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-30T17:07:38.624 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::3ce9:3cff:fea8:7a95/64 scope link tentative 2023-11-30T17:07:38.624 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:38.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:38.625 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-30T17:07:38.686 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-11-30T17:07:38.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:38.688 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-11-30T17:07:38.743 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-11-30T17:07:38.743 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-30T17:07:38.743 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-30T17:07:38.744 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-30T17:07:38.744 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-30T17:07:38.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:38.744 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-11-30T17:07:38.744 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-11-30T17:07:38.744 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-30T17:07:38.744 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-30T17:07:38.744 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-30T17:07:38.744 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-11-30T17:07:38.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:38.845 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-11-30T17:07:38.861 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-30T17:07:38.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:38.861 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list-id 2023-11-30T17:07:38.916 INFO:teuthology.orchestra.run.smithi049.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-30T17:07:38.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:38.916 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-11-30T17:07:38.917 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-11-30T17:07:38.917 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-30T17:07:38.917 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-30T17:07:38.917 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-11-30T17:07:39.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:39.007 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-30T17:07:39.045 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-30T17:07:39.046 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-30T17:07:39.046 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-11-30T17:07:39.046 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:39.046 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-11-30T17:07:39.046 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:39.046 INFO:teuthology.orchestra.run.smithi049.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-30T17:07:39.046 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 5a:a0:cc:67:8c:70 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-30T17:07:39.046 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-30T17:07:39.046 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:39.046 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::58a0:ccff:fe67:8c70/64 scope link tentative 2023-11-30T17:07:39.046 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:39.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:39.063 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-30T17:07:39.137 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-30T17:07:39.137 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-30T17:07:39.137 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-11-30T17:07:39.137 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:39.137 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-11-30T17:07:39.137 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:39.138 INFO:teuthology.orchestra.run.smithi049.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-30T17:07:39.138 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 5a:a0:cc:67:8c:70 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-30T17:07:39.138 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-30T17:07:39.138 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:39.138 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::58a0:ccff:fe67:8c70/64 scope link tentative 2023-11-30T17:07:39.138 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:39.147 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-30T17:07:39.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:39.148 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-11-30T17:07:39.148 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-11-30T17:07:39.148 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-30T17:07:39.148 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-30T17:07:39.148 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-30T17:07:39.148 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-30T17:07:39.148 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-30T17:07:39.148 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-11-30T17:07:39.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:39.371 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-11-30T17:07:39.371 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-11-30T17:07:39.371 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.1 up 2023-11-30T17:07:39.371 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set dev brx.1 master ceph-brx 2023-11-30T17:07:39.371 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-11-30T17:07:39.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:39.454 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p /home/ubuntu/cephtest/mnt.2 2023-11-30T17:07:39.469 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-30T17:07:39.469 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:07:39.550 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:07:39.550 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=2,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-30T17:07:39.574 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:07:39.574 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=2,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-30T17:07:39.576 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-30T17:07:39.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:39.576 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-30T17:07:39.641 INFO:tasks.kclient:client.1 config is {} 2023-11-30T17:07:39.642 DEBUG:teuthology.orchestra.run.smithi115:> ceph fs ls 2023-11-30T17:07:39.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.749+0000 7f4d9c966700 1 Processor -- start 2023-11-30T17:07:39.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.749+0000 7f4d9c966700 1 -- start start 2023-11-30T17:07:39.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.750+0000 7f4d9c966700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4d980ca740 0x7f4d980cab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:39.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.750+0000 7f4d9c966700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4d980aa0d0 0x7f4d980aa540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:39.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.750+0000 7f4d9c966700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d980a9700 con 0x7f4d980c0930 2023-11-30T17:07:39.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.750+0000 7f4d9c966700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d98154ae0 con 0x7f4d980aa0d0 2023-11-30T17:07:39.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.750+0000 7f4d9c966700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d980a9b90 con 0x7f4d980ca740 2023-11-30T17:07:39.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.750+0000 7f4d96d9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4d980ca740 0x7f4d980cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:39.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.750+0000 7f4d9759e700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f4d980c0930 0x7f4d98158120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54450/0 (socket says 172.21.15.115:54450) 2023-11-30T17:07:39.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.750+0000 7f4d9759e700 1 -- 172.21.15.115:0/1378511733 learned_addr learned my addr 172.21.15.115:0/1378511733 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-11-30T17:07:39.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.750+0000 7f4d96d9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4d980ca740 0x7f4d980cab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44390/0 (socket says 172.21.15.115:44390) 2023-11-30T17:07:39.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.750+0000 7f4d9659c700 1 --2- 172.21.15.115:0/1378511733 >> v2:172.21.15.49:3300/0 conn(0x7f4d980aa0d0 0x7f4d980aa540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:39.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.750+0000 7f4d96d9d700 1 -- 172.21.15.115:0/1378511733 >> v2:172.21.15.49:3300/0 conn(0x7f4d980aa0d0 msgr2=0x7f4d980aa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:39.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.750+0000 7f4d96d9d700 1 --2- 172.21.15.115:0/1378511733 >> v2:172.21.15.49:3300/0 conn(0x7f4d980aa0d0 0x7f4d980aa540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:39.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.750+0000 7f4d96d9d700 1 -- 172.21.15.115:0/1378511733 >> v1:172.21.15.115:6789/0 conn(0x7f4d980c0930 legacy=0x7f4d98158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:39.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.750+0000 7f4d95d9b700 1 -- 172.21.15.115:0/1378511733 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2468441443 0 0) 0x7f4d980a9700 con 0x7f4d980c0930 2023-11-30T17:07:39.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.750+0000 7f4d96d9d700 1 -- 172.21.15.115:0/1378511733 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d980a8af0 con 0x7f4d980ca740 2023-11-30T17:07:39.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.750+0000 7f4d96d9d700 1 --2- 172.21.15.115:0/1378511733 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d980ca740 0x7f4d980cab20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f4d98084520 tx=0x7f4d88009060).ready entity=mon.1 client_cookie=8dea6285f62d69d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:39.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.751+0000 7f4d95d9b700 1 -- 172.21.15.115:0/1378511733 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8800f510 con 0x7f4d980ca740 2023-11-30T17:07:39.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.751+0000 7f4d95d9b700 1 -- 172.21.15.115:0/1378511733 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8800f670 con 0x7f4d980ca740 2023-11-30T17:07:39.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.751+0000 7f4d95d9b700 1 -- 172.21.15.115:0/1378511733 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8800f9f0 con 0x7f4d980ca740 2023-11-30T17:07:39.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.751+0000 7f4d9c966700 1 -- 172.21.15.115:0/1378511733 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d980ca740 msgr2=0x7f4d980cab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:39.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.751+0000 7f4d9c966700 1 --2- 172.21.15.115:0/1378511733 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d980ca740 0x7f4d980cab20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f4d98084520 tx=0x7f4d88009060).stop 2023-11-30T17:07:39.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.751+0000 7f4d9c966700 1 -- 172.21.15.115:0/1378511733 shutdown_connections 2023-11-30T17:07:39.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.751+0000 7f4d9c966700 1 --2- 172.21.15.115:0/1378511733 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d980ca740 0x7f4d980cab20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:39.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.751+0000 7f4d9c966700 1 --2- 172.21.15.115:0/1378511733 >> v2:172.21.15.49:3300/0 conn(0x7f4d980aa0d0 0x7f4d980aa540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:39.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.751+0000 7f4d9c966700 1 -- 172.21.15.115:0/1378511733 >> 172.21.15.115:0/1378511733 conn(0x7f4d980946d0 msgr2=0x7f4d9806a690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:39.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.751+0000 7f4d9c966700 1 -- 172.21.15.115:0/1378511733 shutdown_connections 2023-11-30T17:07:39.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.751+0000 7f4d9c966700 1 -- 172.21.15.115:0/1378511733 wait complete. 2023-11-30T17:07:39.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.752+0000 7f4d9c966700 1 Processor -- start 2023-11-30T17:07:39.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.752+0000 7f4d9c966700 1 -- start start 2023-11-30T17:07:39.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.753+0000 7f4d9c966700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d980aa0d0 0x7f4d980ac790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:39.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.753+0000 7f4d9c966700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d980c0930 0x7f4d98151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:39.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.753+0000 7f4d9c966700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d980ca740 0x7f4d980ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:39.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.753+0000 7f4d9c966700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d980c2190 con 0x7f4d980aa0d0 2023-11-30T17:07:39.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.753+0000 7f4d9c966700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d980c2470 con 0x7f4d980ca740 2023-11-30T17:07:39.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.753+0000 7f4d9c966700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d980c2750 con 0x7f4d980c0930 2023-11-30T17:07:39.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.753+0000 7f4d9759e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d980ca740 0x7f4d980ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:39.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.753+0000 7f4d9659c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d980c0930 0x7f4d98151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:39.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.753+0000 7f4d9759e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d980ca740 0x7f4d980ae850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44396/0 (socket says 172.21.15.115:44396) 2023-11-30T17:07:39.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.753+0000 7f4d9759e700 1 -- 172.21.15.115:0/1587341034 learned_addr learned my addr 172.21.15.115:0/1587341034 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-11-30T17:07:39.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.753+0000 7f4d96d9d700 1 --2- 172.21.15.115:0/1587341034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d980aa0d0 0x7f4d980ac790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:39.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.754+0000 7f4d9759e700 1 -- 172.21.15.115:0/1587341034 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d980c0930 msgr2=0x7f4d98151ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:39.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.754+0000 7f4d9759e700 1 --2- 172.21.15.115:0/1587341034 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d980c0930 0x7f4d98151ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:39.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.754+0000 7f4d9759e700 1 -- 172.21.15.115:0/1587341034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d980aa0d0 msgr2=0x7f4d980ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:39.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.754+0000 7f4d9759e700 1 --2- 172.21.15.115:0/1587341034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d980aa0d0 0x7f4d980ac790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:39.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.754+0000 7f4d9759e700 1 -- 172.21.15.115:0/1587341034 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d880092a0 con 0x7f4d980ca740 2023-11-30T17:07:39.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.754+0000 7f4d9659c700 1 --2- 172.21.15.115:0/1587341034 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d980c0930 0x7f4d98151ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:07:39.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.754+0000 7f4d9759e700 1 --2- 172.21.15.115:0/1587341034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d980ca740 0x7f4d980ae850 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f4d9000c7e0 tx=0x7f4d90007f90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:39.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.754+0000 7f4d7effd700 1 -- 172.21.15.115:0/1587341034 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d90005d30 con 0x7f4d980ca740 2023-11-30T17:07:39.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.754+0000 7f4d7effd700 1 -- 172.21.15.115:0/1587341034 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d90005e90 con 0x7f4d980ca740 2023-11-30T17:07:39.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.754+0000 7f4d7effd700 1 -- 172.21.15.115:0/1587341034 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d90007320 con 0x7f4d980ca740 2023-11-30T17:07:39.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.754+0000 7f4d9c966700 1 -- 172.21.15.115:0/1587341034 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d980c2a30 con 0x7f4d980ca740 2023-11-30T17:07:39.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.754+0000 7f4d9c966700 1 -- 172.21.15.115:0/1587341034 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d980acc80 con 0x7f4d980ca740 2023-11-30T17:07:39.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.755+0000 7f4d9c966700 1 -- 172.21.15.115:0/1587341034 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d980c2f50 con 0x7f4d980ca740 2023-11-30T17:07:39.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.755+0000 7f4d7effd700 1 -- 172.21.15.115:0/1587341034 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4d90007710 con 0x7f4d980ca740 2023-11-30T17:07:39.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.755+0000 7f4d7effd700 1 --2- 172.21.15.115:0/1587341034 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4d8405f150 0x7f4d84061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:39.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.756+0000 7f4d7effd700 1 -- 172.21.15.115:0/1587341034 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4d9007a180 con 0x7f4d980ca740 2023-11-30T17:07:39.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.756+0000 7f4d96d9d700 1 --2- 172.21.15.115:0/1587341034 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4d8405f150 0x7f4d84061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:39.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.756+0000 7f4d96d9d700 1 --2- 172.21.15.115:0/1587341034 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4d8405f150 0x7f4d84061610 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f4d98084520 tx=0x7f4d88017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:39.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.760+0000 7f4d7effd700 1 -- 172.21.15.115:0/1587341034 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4d980c2f50 con 0x7f4d980ca740 2023-11-30T17:07:39.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.972+0000 7f4d9c966700 1 -- 172.21.15.115:0/1587341034 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4d980c2f50 con 0x7f4d980ca740 2023-11-30T17:07:39.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.972+0000 7f4d7effd700 1 -- 172.21.15.115:0/1587341034 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4d980c2f50 con 0x7f4d980ca740 2023-11-30T17:07:39.974 INFO:teuthology.orchestra.run.smithi115.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-30T17:07:39.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.974+0000 7f4d9c966700 1 -- 172.21.15.115:0/1587341034 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4d8405f150 msgr2=0x7f4d84061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:39.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.974+0000 7f4d9c966700 1 --2- 172.21.15.115:0/1587341034 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4d8405f150 0x7f4d84061610 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f4d98084520 tx=0x7f4d88017000).stop 2023-11-30T17:07:39.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.974+0000 7f4d9c966700 1 -- 172.21.15.115:0/1587341034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d980ca740 msgr2=0x7f4d980ae850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:39.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.974+0000 7f4d9c966700 1 --2- 172.21.15.115:0/1587341034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d980ca740 0x7f4d980ae850 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f4d9000c7e0 tx=0x7f4d90007f90).stop 2023-11-30T17:07:39.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.974+0000 7f4d9c966700 1 -- 172.21.15.115:0/1587341034 shutdown_connections 2023-11-30T17:07:39.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.974+0000 7f4d9c966700 1 --2- 172.21.15.115:0/1587341034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d980ca740 0x7f4d980ae850 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:39.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.974+0000 7f4d9c966700 1 --2- 172.21.15.115:0/1587341034 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4d8405f150 0x7f4d84061610 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:39.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.974+0000 7f4d9c966700 1 --2- 172.21.15.115:0/1587341034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d980aa0d0 0x7f4d980ac790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:39.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.974+0000 7f4d9c966700 1 --2- 172.21.15.115:0/1587341034 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d980c0930 0x7f4d98151ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:39.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.974+0000 7f4d9c966700 1 -- 172.21.15.115:0/1587341034 >> 172.21.15.115:0/1587341034 conn(0x7f4d980946d0 msgr2=0x7f4d980c9650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:39.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.974+0000 7f4d9c966700 1 -- 172.21.15.115:0/1587341034 shutdown_connections 2023-11-30T17:07:39.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:39.974+0000 7f4d9c966700 1 -- 172.21.15.115:0/1587341034 wait complete. 2023-11-30T17:07:39.986 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-30T17:07:39.986 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-30T17:07:39.986 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-11-30T17:07:39.987 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-30T17:07:39.987 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-30T17:07:39.987 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-30T17:07:39.987 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-30T17:07:39.987 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-30T17:07:39.987 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-30T17:07:39.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:39.987 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-11-30T17:07:40.002 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-30T17:07:40.002 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-30T17:07:40.002 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-11-30T17:07:40.002 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:40.002 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-11-30T17:07:40.002 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:40.002 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:07:40.002 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:07:40.003 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-11-30T17:07:40.003 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:07:40.003 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:07:40.003 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-11-30T17:07:40.003 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:07:40.003 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-11-30T17:07:40.003 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-30T17:07:40.003 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-11-30T17:07:40.003 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-30T17:07:40.003 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 42357sec preferred_lft 42357sec 2023-11-30T17:07:40.003 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-11-30T17:07:40.003 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:40.004 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-30T17:07:40.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:40.004 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-11-30T17:07:40.004 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-11-30T17:07:40.004 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link add name ceph-brx type bridge 2023-11-30T17:07:40.004 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip addr flush dev ceph-brx 2023-11-30T17:07:40.004 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set ceph-brx up 2023-11-30T17:07:40.004 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-30T17:07:40.004 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-11-30T17:07:40.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:40.166 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-30T17:07:40.206 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-11-30T17:07:40.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:40.208 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-11-30T17:07:40.299 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-11-30T17:07:40.299 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-30T17:07:40.299 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-30T17:07:40.299 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-30T17:07:40.299 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-30T17:07:40.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:40.300 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-11-30T17:07:40.300 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-11-30T17:07:40.300 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-30T17:07:40.300 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-30T17:07:40.300 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-30T17:07:40.300 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-11-30T17:07:40.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:40.508 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-11-30T17:07:40.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:40.523 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list-id 2023-11-30T17:07:40.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:40.578 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-11-30T17:07:40.578 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-11-30T17:07:40.578 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-30T17:07:40.578 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-30T17:07:40.578 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-11-30T17:07:40.667 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-30T17:07:40.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:40.667 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-11-30T17:07:40.667 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-11-30T17:07:40.667 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-30T17:07:40.667 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-30T17:07:40.667 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-30T17:07:40.667 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-30T17:07:40.668 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-30T17:07:40.668 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-11-30T17:07:40.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:40.871 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-11-30T17:07:40.871 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-11-30T17:07:40.871 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2023-11-30T17:07:40.871 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set dev brx.0 master ceph-brx 2023-11-30T17:07:40.871 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-11-30T17:07:40.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:40.964 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p /home/ubuntu/cephtest/mnt.1 2023-11-30T17:07:40.978 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-30T17:07:40.978 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:07:41.071 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:07:41.071 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-30T17:07:41.165 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:07:41.165 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-30T17:07:41.167 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-30T17:07:41.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:41.167 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-30T17:07:41.191 INFO:tasks.kclient:client.3 config is {} 2023-11-30T17:07:41.191 DEBUG:teuthology.orchestra.run.smithi115:> ceph fs ls 2023-11-30T17:07:41.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.331+0000 7fa9c9935700 1 Processor -- start 2023-11-30T17:07:41.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.331+0000 7fa9c9935700 1 -- start start 2023-11-30T17:07:41.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.332+0000 7fa9c9935700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa9c4062d20 0x7fa9c40aa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:41.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.332+0000 7fa9c9935700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9c40a7b20 0x7fa9c40a7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:41.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.332+0000 7fa9c9935700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9c406a040 con 0x7fa9c4062940 2023-11-30T17:07:41.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.332+0000 7fa9c9935700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9c40aa690 con 0x7fa9c4062d20 2023-11-30T17:07:41.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.332+0000 7fa9c9935700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c40bd8a0 con 0x7fa9c40a7b20 2023-11-30T17:07:41.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.332+0000 7fa9c37fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9c40a7b20 0x7fa9c40a7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:41.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.332+0000 7fa9c37fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9c40a7b20 0x7fa9c40a7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:46030/0 (socket says 172.21.15.115:46030) 2023-11-30T17:07:41.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.332+0000 7fa9c37fe700 1 -- 172.21.15.115:0/2820298010 learned_addr learned my addr 172.21.15.115:0/2820298010 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-11-30T17:07:41.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.333+0000 7fa9c27fc700 1 --2- 172.21.15.115:0/2820298010 >> v2:172.21.15.49:3300/0 conn(0x7fa9c4062d20 0x7fa9c40aa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:41.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.333+0000 7fa9c37fe700 1 -- 172.21.15.115:0/2820298010 >> v2:172.21.15.49:3300/0 conn(0x7fa9c4062d20 msgr2=0x7fa9c40aa1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:41.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.333+0000 7fa9c37fe700 1 --2- 172.21.15.115:0/2820298010 >> v2:172.21.15.49:3300/0 conn(0x7fa9c4062d20 0x7fa9c40aa1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:41.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.333+0000 7fa9c37fe700 1 -- 172.21.15.115:0/2820298010 >> v1:172.21.15.49:6789/0 conn(0x7fa9c4062940 legacy=0x7fa9c406a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:41.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.333+0000 7fa9c37fe700 1 -- 172.21.15.115:0/2820298010 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c40a8450 con 0x7fa9c40a7b20 2023-11-30T17:07:41.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.333+0000 7fa9c37fe700 1 --2- 172.21.15.115:0/2820298010 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9c40a7b20 0x7fa9c40a7f60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fa9bc006fd0 tx=0x7fa9bc0090f0).ready entity=mon.2 client_cookie=c64e32c6d6999cc7 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:41.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.333+0000 7fa9c1ffb700 1 -- 172.21.15.115:0/2820298010 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc00b600 con 0x7fa9c40a7b20 2023-11-30T17:07:41.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.333+0000 7fa9c1ffb700 1 -- 172.21.15.115:0/2820298010 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9bc00b760 con 0x7fa9c40a7b20 2023-11-30T17:07:41.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.333+0000 7fa9c1ffb700 1 -- 172.21.15.115:0/2820298010 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc00bae0 con 0x7fa9c40a7b20 2023-11-30T17:07:41.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.333+0000 7fa9c9935700 1 -- 172.21.15.115:0/2820298010 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9c40a7b20 msgr2=0x7fa9c40a7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:41.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.333+0000 7fa9c9935700 1 --2- 172.21.15.115:0/2820298010 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9c40a7b20 0x7fa9c40a7f60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fa9bc006fd0 tx=0x7fa9bc0090f0).stop 2023-11-30T17:07:41.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.333+0000 7fa9c9935700 1 -- 172.21.15.115:0/2820298010 shutdown_connections 2023-11-30T17:07:41.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.333+0000 7fa9c9935700 1 --2- 172.21.15.115:0/2820298010 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9c40a7b20 0x7fa9c40a7f60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:41.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.333+0000 7fa9c9935700 1 --2- 172.21.15.115:0/2820298010 >> v2:172.21.15.49:3300/0 conn(0x7fa9c4062d20 0x7fa9c40aa1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:41.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.333+0000 7fa9c9935700 1 -- 172.21.15.115:0/2820298010 >> 172.21.15.115:0/2820298010 conn(0x7fa9c4064360 msgr2=0x7fa9c4065900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:41.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.334+0000 7fa9c9935700 1 -- 172.21.15.115:0/2820298010 shutdown_connections 2023-11-30T17:07:41.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.334+0000 7fa9c9935700 1 -- 172.21.15.115:0/2820298010 wait complete. 2023-11-30T17:07:41.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.335+0000 7fa9c9935700 1 Processor -- start 2023-11-30T17:07:41.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.335+0000 7fa9c9935700 1 -- start start 2023-11-30T17:07:41.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.336+0000 7fa9c9935700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9c4062940 0x7fa9c4150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:41.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.336+0000 7fa9c9935700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9c4062d20 0x7fa9c4156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:41.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.336+0000 7fa9c9935700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9c40a7b20 0x7fa9c4157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:41.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.336+0000 7fa9c9935700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c41566d0 con 0x7fa9c40a7b20 2023-11-30T17:07:41.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.336+0000 7fa9c9935700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c4158d60 con 0x7fa9c4062d20 2023-11-30T17:07:41.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.336+0000 7fa9c9935700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c4156080 con 0x7fa9c4062940 2023-11-30T17:07:41.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.336+0000 7fa9c2ffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9c4062940 0x7fa9c4150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:41.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.336+0000 7fa9c27fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9c4062d20 0x7fa9c4156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:41.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.336+0000 7fa9c2ffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9c4062940 0x7fa9c4150aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:46034/0 (socket says 172.21.15.115:46034) 2023-11-30T17:07:41.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.336+0000 7fa9c2ffd700 1 -- 172.21.15.115:0/580110458 learned_addr learned my addr 172.21.15.115:0/580110458 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-11-30T17:07:41.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.336+0000 7fa9c37fe700 1 --2- 172.21.15.115:0/580110458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9c40a7b20 0x7fa9c4157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:41.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.336+0000 7fa9c2ffd700 1 -- 172.21.15.115:0/580110458 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9c4062d20 msgr2=0x7fa9c4156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:41.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.336+0000 7fa9c2ffd700 1 --2- 172.21.15.115:0/580110458 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9c4062d20 0x7fa9c4156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:41.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.336+0000 7fa9c2ffd700 1 -- 172.21.15.115:0/580110458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9c40a7b20 msgr2=0x7fa9c4157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:41.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.336+0000 7fa9c2ffd700 1 --2- 172.21.15.115:0/580110458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9c40a7b20 0x7fa9c4157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:41.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.336+0000 7fa9c2ffd700 1 -- 172.21.15.115:0/580110458 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9bc009370 con 0x7fa9c4062940 2023-11-30T17:07:41.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.336+0000 7fa9c27fc700 1 --2- 172.21.15.115:0/580110458 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9c4062d20 0x7fa9c4156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:07:41.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.336+0000 7fa9c2ffd700 1 --2- 172.21.15.115:0/580110458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9c4062940 0x7fa9c4150aa0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fa9b400c810 tx=0x7fa9b40025e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:41.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.336+0000 7fa9aaffd700 1 -- 172.21.15.115:0/580110458 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b4010510 con 0x7fa9c4062940 2023-11-30T17:07:41.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.336+0000 7fa9aaffd700 1 -- 172.21.15.115:0/580110458 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b4010690 con 0x7fa9c4062940 2023-11-30T17:07:41.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.336+0000 7fa9c9935700 1 -- 172.21.15.115:0/580110458 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9c4156360 con 0x7fa9c4062940 2023-11-30T17:07:41.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.336+0000 7fa9aaffd700 1 -- 172.21.15.115:0/580110458 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b4010a50 con 0x7fa9c4062940 2023-11-30T17:07:41.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.336+0000 7fa9c9935700 1 -- 172.21.15.115:0/580110458 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9c41511d0 con 0x7fa9c4062940 2023-11-30T17:07:41.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.337+0000 7fa9c9935700 1 -- 172.21.15.115:0/580110458 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9c41569b0 con 0x7fa9c4062940 2023-11-30T17:07:41.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.337+0000 7fa9aaffd700 1 -- 172.21.15.115:0/580110458 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa9b401b400 con 0x7fa9c4062940 2023-11-30T17:07:41.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.338+0000 7fa9aaffd700 1 --2- 172.21.15.115:0/580110458 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa9b005f150 0x7fa9b0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:41.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.338+0000 7fa9aaffd700 1 -- 172.21.15.115:0/580110458 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa9b4079f40 con 0x7fa9c4062940 2023-11-30T17:07:41.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.338+0000 7fa9c27fc700 1 --2- 172.21.15.115:0/580110458 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa9b005f150 0x7fa9b0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:41.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.338+0000 7fa9c27fc700 1 --2- 172.21.15.115:0/580110458 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa9b005f150 0x7fa9b0061610 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fa9c40c7a60 tx=0x7fa9b8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:41.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.342+0000 7fa9aaffd700 1 -- 172.21.15.115:0/580110458 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa9b404b1b0 con 0x7fa9c4062940 2023-11-30T17:07:41.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.549+0000 7fa9c9935700 1 -- 172.21.15.115:0/580110458 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa9c41511d0 con 0x7fa9c4062940 2023-11-30T17:07:41.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.549+0000 7fa9aaffd700 1 -- 172.21.15.115:0/580110458 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa9c41511d0 con 0x7fa9c4062940 2023-11-30T17:07:41.551 INFO:teuthology.orchestra.run.smithi115.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-30T17:07:41.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.551+0000 7fa9c9935700 1 -- 172.21.15.115:0/580110458 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa9b005f150 msgr2=0x7fa9b0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:41.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.551+0000 7fa9c9935700 1 --2- 172.21.15.115:0/580110458 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa9b005f150 0x7fa9b0061610 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fa9c40c7a60 tx=0x7fa9b8008040).stop 2023-11-30T17:07:41.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.551+0000 7fa9c9935700 1 -- 172.21.15.115:0/580110458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9c4062940 msgr2=0x7fa9c4150aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:41.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.551+0000 7fa9c9935700 1 --2- 172.21.15.115:0/580110458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9c4062940 0x7fa9c4150aa0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fa9b400c810 tx=0x7fa9b40025e0).stop 2023-11-30T17:07:41.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.551+0000 7fa9c9935700 1 -- 172.21.15.115:0/580110458 shutdown_connections 2023-11-30T17:07:41.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.551+0000 7fa9c9935700 1 --2- 172.21.15.115:0/580110458 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa9b005f150 0x7fa9b0061610 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:41.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.551+0000 7fa9c9935700 1 --2- 172.21.15.115:0/580110458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9c40a7b20 0x7fa9c4157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:41.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.551+0000 7fa9c9935700 1 --2- 172.21.15.115:0/580110458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9c4062940 0x7fa9c4150aa0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:41.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.551+0000 7fa9c9935700 1 --2- 172.21.15.115:0/580110458 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9c4062d20 0x7fa9c4156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:41.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.551+0000 7fa9c9935700 1 -- 172.21.15.115:0/580110458 >> 172.21.15.115:0/580110458 conn(0x7fa9c4064360 msgr2=0x7fa9c40c5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:41.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.551+0000 7fa9c9935700 1 -- 172.21.15.115:0/580110458 shutdown_connections 2023-11-30T17:07:41.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-11-30T17:07:41.551+0000 7fa9c9935700 1 -- 172.21.15.115:0/580110458 wait complete. 2023-11-30T17:07:41.563 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-30T17:07:41.563 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-30T17:07:41.563 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-11-30T17:07:41.563 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-30T17:07:41.564 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-30T17:07:41.564 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-30T17:07:41.564 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-30T17:07:41.564 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-30T17:07:41.564 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-30T17:07:41.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:41.564 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-11-30T17:07:41.579 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-30T17:07:41.579 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-30T17:07:41.579 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-11-30T17:07:41.579 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:41.579 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-11-30T17:07:41.579 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:41.579 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:07:41.580 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:07:41.580 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-11-30T17:07:41.580 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:07:41.580 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:07:41.580 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-11-30T17:07:41.580 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:07:41.580 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-11-30T17:07:41.580 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-30T17:07:41.580 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-11-30T17:07:41.580 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-30T17:07:41.580 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 42356sec preferred_lft 42356sec 2023-11-30T17:07:41.580 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-11-30T17:07:41.580 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:41.580 INFO:teuthology.orchestra.run.smithi115.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-30T17:07:41.580 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 62:8d:1a:67:42:36 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:07:41.581 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-30T17:07:41.581 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:41.581 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::b444:b2ff:fe20:85c/64 scope link 2023-11-30T17:07:41.581 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:41.581 INFO:teuthology.orchestra.run.smithi115.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-30T17:07:41.581 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 62:8d:1a:67:42:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-30T17:07:41.581 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::608d:1aff:fe67:4236/64 scope link tentative 2023-11-30T17:07:41.581 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:41.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:41.581 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-30T17:07:41.643 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-11-30T17:07:41.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:41.644 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-11-30T17:07:41.701 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-11-30T17:07:41.701 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-30T17:07:41.701 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-30T17:07:41.701 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-30T17:07:41.701 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-30T17:07:41.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:41.702 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-11-30T17:07:41.702 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-11-30T17:07:41.702 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-30T17:07:41.702 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-30T17:07:41.702 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-30T17:07:41.702 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-11-30T17:07:41.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:41.801 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-11-30T17:07:41.815 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-30T17:07:41.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:41.816 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list-id 2023-11-30T17:07:41.870 INFO:teuthology.orchestra.run.smithi115.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-30T17:07:41.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:41.870 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-11-30T17:07:41.870 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-11-30T17:07:41.871 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-30T17:07:41.871 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-30T17:07:41.871 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-11-30T17:07:41.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:41.959 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-30T17:07:41.992 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-30T17:07:41.992 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-30T17:07:41.992 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-11-30T17:07:41.992 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:41.992 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-11-30T17:07:41.993 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:41.993 INFO:teuthology.orchestra.run.smithi115.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-30T17:07:41.993 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 12:43:f0:0e:48:a1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-30T17:07:41.993 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-30T17:07:41.993 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:41.993 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::1043:f0ff:fe0e:48a1/64 scope link tentative 2023-11-30T17:07:41.993 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:42.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:42.000 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-30T17:07:42.077 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-30T17:07:42.077 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-30T17:07:42.077 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-11-30T17:07:42.077 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:42.077 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-11-30T17:07:42.077 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:42.078 INFO:teuthology.orchestra.run.smithi115.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-30T17:07:42.078 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 12:43:f0:0e:48:a1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-30T17:07:42.078 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-30T17:07:42.078 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:42.078 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::1043:f0ff:fe0e:48a1/64 scope link tentative 2023-11-30T17:07:42.078 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:07:42.091 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-30T17:07:42.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:42.092 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-11-30T17:07:42.092 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-11-30T17:07:42.092 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-30T17:07:42.092 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-30T17:07:42.092 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-30T17:07:42.092 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-30T17:07:42.092 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-30T17:07:42.092 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-11-30T17:07:42.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:42.313 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-11-30T17:07:42.313 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-11-30T17:07:42.313 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.1 up 2023-11-30T17:07:42.314 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set dev brx.1 master ceph-brx 2023-11-30T17:07:42.314 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-11-30T17:07:42.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:42.394 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p /home/ubuntu/cephtest/mnt.3 2023-11-30T17:07:42.408 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-30T17:07:42.408 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:07:42.487 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:07:42.487 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=3,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-30T17:07:42.513 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:07:42.513 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=3,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-30T17:07:42.515 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-30T17:07:42.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:42.515 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-30T17:07:42.579 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-30T17:07:42.599 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:07:42.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.728+0000 7f8f10f9e700 1 Processor -- start 2023-11-30T17:07:42.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.729+0000 7f8f10f9e700 1 -- start start 2023-11-30T17:07:42.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.729+0000 7f8f10f9e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8f0c0a6e00 0x7f8f0c0a71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:42.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.729+0000 7f8f10f9e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8f0c1546e0 0x7f8f0c0c2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:42.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.729+0000 7f8f10f9e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f0c1556c0 con 0x7f8f0c0c5da0 2023-11-30T17:07:42.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.729+0000 7f8f10f9e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f0c154b90 con 0x7f8f0c0a6e00 2023-11-30T17:07:42.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.729+0000 7f8f10f9e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f0c0c3450 con 0x7f8f0c1546e0 2023-11-30T17:07:42.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.730+0000 7f8f0b7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8f0c0a6e00 0x7f8f0c0a71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:42.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.730+0000 7f8f0b7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8f0c0a6e00 0x7f8f0c0a71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59540/0 (socket says 172.21.15.49:59540) 2023-11-30T17:07:42.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.730+0000 7f8f0b7fe700 1 -- 172.21.15.49:0/1287684834 learned_addr learned my addr 172.21.15.49:0/1287684834 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:42.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.730+0000 7f8f0affd700 1 --2- 172.21.15.49:0/1287684834 >> v2:172.21.15.115:3300/0 conn(0x7f8f0c1546e0 0x7f8f0c0c2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:42.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.730+0000 7f8f0b7fe700 1 -- 172.21.15.49:0/1287684834 >> v2:172.21.15.115:3300/0 conn(0x7f8f0c1546e0 msgr2=0x7f8f0c0c2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:42.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.730+0000 7f8f0b7fe700 1 --2- 172.21.15.49:0/1287684834 >> v2:172.21.15.115:3300/0 conn(0x7f8f0c1546e0 0x7f8f0c0c2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:42.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.730+0000 7f8f0b7fe700 1 -- 172.21.15.49:0/1287684834 >> v1:172.21.15.115:6789/0 conn(0x7f8f0c0c5da0 legacy=0x7f8f0c158340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:42.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.730+0000 7f8f0b7fe700 1 -- 172.21.15.49:0/1287684834 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f0c154e20 con 0x7f8f0c0a6e00 2023-11-30T17:07:42.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.730+0000 7f8f0a7fc700 1 -- 172.21.15.49:0/1287684834 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 395999918 0 0) 0x7f8f0c1556c0 con 0x7f8f0c0c5da0 2023-11-30T17:07:42.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.730+0000 7f8f0b7fe700 1 --2- 172.21.15.49:0/1287684834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f0c0a6e00 0x7f8f0c0a71e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f8f0c0c47f0 tx=0x7f8efc0090f0).ready entity=mon.0 client_cookie=adbb0e77f07c5615 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:42.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.730+0000 7f8f0a7fc700 1 -- 172.21.15.49:0/1287684834 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc00b520 con 0x7f8f0c0a6e00 2023-11-30T17:07:42.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.730+0000 7f8f0a7fc700 1 -- 172.21.15.49:0/1287684834 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8efc00b680 con 0x7f8f0c0a6e00 2023-11-30T17:07:42.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.730+0000 7f8f0a7fc700 1 -- 172.21.15.49:0/1287684834 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc00ba00 con 0x7f8f0c0a6e00 2023-11-30T17:07:42.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.731+0000 7f8f10f9e700 1 -- 172.21.15.49:0/1287684834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f0c0a6e00 msgr2=0x7f8f0c0a71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:42.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.731+0000 7f8f10f9e700 1 --2- 172.21.15.49:0/1287684834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f0c0a6e00 0x7f8f0c0a71e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f8f0c0c47f0 tx=0x7f8efc0090f0).stop 2023-11-30T17:07:42.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.731+0000 7f8f10f9e700 1 -- 172.21.15.49:0/1287684834 shutdown_connections 2023-11-30T17:07:42.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.731+0000 7f8f10f9e700 1 --2- 172.21.15.49:0/1287684834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f0c0a6e00 0x7f8f0c0a71e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:42.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.731+0000 7f8f10f9e700 1 --2- 172.21.15.49:0/1287684834 >> v2:172.21.15.115:3300/0 conn(0x7f8f0c1546e0 0x7f8f0c0c2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:42.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.731+0000 7f8f10f9e700 1 -- 172.21.15.49:0/1287684834 >> 172.21.15.49:0/1287684834 conn(0x7f8f0c0c7d80 msgr2=0x7f8f0c0c8190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:42.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.731+0000 7f8f10f9e700 1 -- 172.21.15.49:0/1287684834 shutdown_connections 2023-11-30T17:07:42.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.731+0000 7f8f10f9e700 1 -- 172.21.15.49:0/1287684834 wait complete. 2023-11-30T17:07:42.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.732+0000 7f8f10f9e700 1 Processor -- start 2023-11-30T17:07:42.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.732+0000 7f8f10f9e700 1 -- start start 2023-11-30T17:07:42.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.733+0000 7f8f10f9e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f0c0a6e00 0x7f8f0c163e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:42.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.733+0000 7f8f10f9e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f0c0c5da0 0x7f8f0c151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:42.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.733+0000 7f8f10f9e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f0c1546e0 0x7f8f0c15a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:42.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.733+0000 7f8f10f9e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c159310 con 0x7f8f0c0a6e00 2023-11-30T17:07:42.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.733+0000 7f8f10f9e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c1597a0 con 0x7f8f0c1546e0 2023-11-30T17:07:42.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.733+0000 7f8f10f9e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c158700 con 0x7f8f0c0c5da0 2023-11-30T17:07:42.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.733+0000 7f8f0b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f0c0a6e00 0x7f8f0c163e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:42.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.733+0000 7f8f0b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f0c0a6e00 0x7f8f0c163e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59544/0 (socket says 172.21.15.49:59544) 2023-11-30T17:07:42.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.733+0000 7f8f0b7fe700 1 -- 172.21.15.49:0/3416626345 learned_addr learned my addr 172.21.15.49:0/3416626345 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:42.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.733+0000 7f8f0bfff700 1 --2- 172.21.15.49:0/3416626345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f0c1546e0 0x7f8f0c15a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:42.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.733+0000 7f8f0affd700 1 --2- 172.21.15.49:0/3416626345 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f0c0c5da0 0x7f8f0c151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:42.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.733+0000 7f8f0b7fe700 1 -- 172.21.15.49:0/3416626345 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f0c0c5da0 msgr2=0x7f8f0c151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:42.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.733+0000 7f8f0b7fe700 1 --2- 172.21.15.49:0/3416626345 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f0c0c5da0 0x7f8f0c151bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:42.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.733+0000 7f8f0b7fe700 1 -- 172.21.15.49:0/3416626345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f0c1546e0 msgr2=0x7f8f0c15a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:42.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.733+0000 7f8f0b7fe700 1 --2- 172.21.15.49:0/3416626345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f0c1546e0 0x7f8f0c15a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:42.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.733+0000 7f8f0b7fe700 1 -- 172.21.15.49:0/3416626345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc009370 con 0x7f8f0c0a6e00 2023-11-30T17:07:42.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.733+0000 7f8f0b7fe700 1 --2- 172.21.15.49:0/3416626345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f0c0a6e00 0x7f8f0c163e70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f8efc009130 tx=0x7f8efc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:42.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.734+0000 7f8ef37fe700 1 -- 172.21.15.49:0/3416626345 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc000bc0 con 0x7f8f0c0a6e00 2023-11-30T17:07:42.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.734+0000 7f8ef37fe700 1 -- 172.21.15.49:0/3416626345 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8efc00b7f0 con 0x7f8f0c0a6e00 2023-11-30T17:07:42.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.734+0000 7f8f10f9e700 1 -- 172.21.15.49:0/3416626345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f0c1589e0 con 0x7f8f0c0a6e00 2023-11-30T17:07:42.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.734+0000 7f8ef37fe700 1 -- 172.21.15.49:0/3416626345 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc000d20 con 0x7f8f0c0a6e00 2023-11-30T17:07:42.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.734+0000 7f8f10f9e700 1 -- 172.21.15.49:0/3416626345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f0c158fa0 con 0x7f8f0c0a6e00 2023-11-30T17:07:42.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.735+0000 7f8f10f9e700 1 -- 172.21.15.49:0/3416626345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f0c1595f0 con 0x7f8f0c0a6e00 2023-11-30T17:07:42.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.736+0000 7f8ef37fe700 1 -- 172.21.15.49:0/3416626345 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8efc01b8b0 con 0x7f8f0c0a6e00 2023-11-30T17:07:42.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.736+0000 7f8ef37fe700 1 --2- 172.21.15.49:0/3416626345 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8ef805f150 0x7f8ef8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:42.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.736+0000 7f8ef37fe700 1 -- 172.21.15.49:0/3416626345 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8efc07bae0 con 0x7f8f0c0a6e00 2023-11-30T17:07:42.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.736+0000 7f8f0affd700 1 --2- 172.21.15.49:0/3416626345 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8ef805f150 0x7f8ef8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:42.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.737+0000 7f8f0affd700 1 --2- 172.21.15.49:0/3416626345 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8ef805f150 0x7f8ef8061610 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f8f0c0a4dd0 tx=0x7f8f00009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:42.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.741+0000 7f8ef37fe700 1 -- 172.21.15.49:0/3416626345 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8efc04cdb0 con 0x7f8f0c0a6e00 2023-11-30T17:07:42.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.913+0000 7f8f10f9e700 1 -- 172.21.15.49:0/3416626345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f0c06c7c0 con 0x7f8f0c0a6e00 2023-11-30T17:07:42.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.914+0000 7f8ef37fe700 1 -- 172.21.15.49:0/3416626345 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f8efc01f070 con 0x7f8f0c0a6e00 2023-11-30T17:07:42.916 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:42.916 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":22,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:07:17.283998+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:07:14.837882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-30T17:07:15.248549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:07:42.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.916+0000 7f8f10f9e700 1 -- 172.21.15.49:0/3416626345 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8ef805f150 msgr2=0x7f8ef8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:42.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.916+0000 7f8f10f9e700 1 --2- 172.21.15.49:0/3416626345 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8ef805f150 0x7f8ef8061610 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f8f0c0a4dd0 tx=0x7f8f00009060).stop 2023-11-30T17:07:42.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.916+0000 7f8f10f9e700 1 -- 172.21.15.49:0/3416626345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f0c0a6e00 msgr2=0x7f8f0c163e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:42.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.916+0000 7f8f10f9e700 1 --2- 172.21.15.49:0/3416626345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f0c0a6e00 0x7f8f0c163e70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f8efc009130 tx=0x7f8efc017000).stop 2023-11-30T17:07:42.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.916+0000 7f8f10f9e700 1 -- 172.21.15.49:0/3416626345 shutdown_connections 2023-11-30T17:07:42.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.916+0000 7f8f10f9e700 1 --2- 172.21.15.49:0/3416626345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f0c1546e0 0x7f8f0c15a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:42.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.916+0000 7f8f10f9e700 1 --2- 172.21.15.49:0/3416626345 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8ef805f150 0x7f8ef8061610 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:42.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.916+0000 7f8f10f9e700 1 --2- 172.21.15.49:0/3416626345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f0c0a6e00 0x7f8f0c163e70 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:42.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.916+0000 7f8f10f9e700 1 --2- 172.21.15.49:0/3416626345 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f0c0c5da0 0x7f8f0c151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:42.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.916+0000 7f8f10f9e700 1 -- 172.21.15.49:0/3416626345 >> 172.21.15.49:0/3416626345 conn(0x7f8f0c0c7d80 msgr2=0x7f8f0c0c6210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:42.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.916+0000 7f8f10f9e700 1 -- 172.21.15.49:0/3416626345 shutdown_connections 2023-11-30T17:07:42.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:42.916+0000 7f8f10f9e700 1 -- 172.21.15.49:0/3416626345 wait complete. 2023-11-30T17:07:42.930 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-30T17:07:14.837882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-30T17:07:15.248549+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-30T17:07:42.930 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T17:07:43.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.050+0000 7f688c997700 1 Processor -- start 2023-11-30T17:07:43.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.050+0000 7f688c997700 1 -- start start 2023-11-30T17:07:43.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.051+0000 7f688c997700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6888158a30 0x7f68880c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:43.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.051+0000 7f688c997700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68880c72d0 con 0x7f68880c6190 2023-11-30T17:07:43.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.051+0000 7f688c997700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6888064570 con 0x7f6888098d10 2023-11-30T17:07:43.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.051+0000 7f688c997700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6888154bc0 con 0x7f6888158a30 2023-11-30T17:07:43.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.051+0000 7f6885d9b700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f68880c6190 0x7f6888158320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51724/0 (socket says 172.21.15.49:51724) 2023-11-30T17:07:43.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.051+0000 7f6885d9b700 1 -- 172.21.15.49:0/1099716237 learned_addr learned my addr 172.21.15.49:0/1099716237 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:43.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.051+0000 7f6886d9d700 1 --2- 172.21.15.49:0/1099716237 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6888158a30 0x7f68880c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:43.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.051+0000 7f688559a700 1 -- 172.21.15.49:0/1099716237 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1389053873 0 0) 0x7f68880c72d0 con 0x7f68880c6190 2023-11-30T17:07:43.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.051+0000 7f688559a700 1 -- 172.21.15.49:0/1099716237 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68740033f0 con 0x7f68880c6190 2023-11-30T17:07:43.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.051+0000 7f688559a700 1 -- 172.21.15.49:0/1099716237 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022593457 0 0) 0x7f6888064570 con 0x7f6888098d10 2023-11-30T17:07:43.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.051+0000 7f688559a700 1 -- 172.21.15.49:0/1099716237 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68880c72d0 con 0x7f6888098d10 2023-11-30T17:07:43.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.051+0000 7f6886d9d700 1 -- 172.21.15.49:0/1099716237 >> v1:172.21.15.115:6789/0 conn(0x7f6888098d10 legacy=0x7f6888063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:43.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.051+0000 7f6886d9d700 1 -- 172.21.15.49:0/1099716237 >> v1:172.21.15.49:6789/0 conn(0x7f68880c6190 legacy=0x7f6888158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:43.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.051+0000 7f6886d9d700 1 -- 172.21.15.49:0/1099716237 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68880c66c0 con 0x7f6888158a30 2023-11-30T17:07:43.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.052+0000 7f6886d9d700 1 --2- 172.21.15.49:0/1099716237 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6888158a30 0x7f68880c7760 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f6878009790 tx=0x7f6878009060).ready entity=mon.2 client_cookie=a27f8ab93cdd7859 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:43.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.052+0000 7f688559a700 1 -- 172.21.15.49:0/1099716237 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687800f510 con 0x7f6888158a30 2023-11-30T17:07:43.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.052+0000 7f688559a700 1 -- 172.21.15.49:0/1099716237 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687800f670 con 0x7f6888158a30 2023-11-30T17:07:43.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.052+0000 7f688559a700 1 -- 172.21.15.49:0/1099716237 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687800f9f0 con 0x7f6888158a30 2023-11-30T17:07:43.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.052+0000 7f688c997700 1 -- 172.21.15.49:0/1099716237 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6888158a30 msgr2=0x7f68880c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:43.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.052+0000 7f688c997700 1 --2- 172.21.15.49:0/1099716237 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6888158a30 0x7f68880c7760 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f6878009790 tx=0x7f6878009060).stop 2023-11-30T17:07:43.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.052+0000 7f688c997700 1 -- 172.21.15.49:0/1099716237 shutdown_connections 2023-11-30T17:07:43.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.052+0000 7f688c997700 1 --2- 172.21.15.49:0/1099716237 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6888158a30 0x7f68880c7760 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:43.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.052+0000 7f688c997700 1 -- 172.21.15.49:0/1099716237 >> 172.21.15.49:0/1099716237 conn(0x7f68880cb310 msgr2=0x7f68880cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:43.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.052+0000 7f688c997700 1 -- 172.21.15.49:0/1099716237 shutdown_connections 2023-11-30T17:07:43.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.052+0000 7f688c997700 1 -- 172.21.15.49:0/1099716237 wait complete. 2023-11-30T17:07:43.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.053+0000 7f688c997700 1 Processor -- start 2023-11-30T17:07:43.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.054+0000 7f688c997700 1 -- start start 2023-11-30T17:07:43.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.054+0000 7f688c997700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6888098d10 0x7f6888158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:43.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.054+0000 7f688c997700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68880c6190 0x7f688814c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:43.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.054+0000 7f688c997700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6888158a30 0x7f68880c2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:43.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.054+0000 7f688c997700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6888156580 con 0x7f68880c6190 2023-11-30T17:07:43.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.054+0000 7f688c997700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6888155970 con 0x7f6888098d10 2023-11-30T17:07:43.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.054+0000 7f688c997700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6888155c50 con 0x7f6888158a30 2023-11-30T17:07:43.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.054+0000 7f6885d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68880c6190 0x7f688814c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:43.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.054+0000 7f6885d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68880c6190 0x7f688814c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59554/0 (socket says 172.21.15.49:59554) 2023-11-30T17:07:43.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.054+0000 7f6885d9b700 1 -- 172.21.15.49:0/2850125122 learned_addr learned my addr 172.21.15.49:0/2850125122 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:43.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.055+0000 7f688659c700 1 --2- 172.21.15.49:0/2850125122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6888098d10 0x7f6888158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:43.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.055+0000 7f6886d9d700 1 --2- 172.21.15.49:0/2850125122 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6888158a30 0x7f68880c2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:43.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.055+0000 7f6885d9b700 1 -- 172.21.15.49:0/2850125122 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6888158a30 msgr2=0x7f68880c2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:43.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.055+0000 7f6885d9b700 1 --2- 172.21.15.49:0/2850125122 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6888158a30 0x7f68880c2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:43.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.055+0000 7f6885d9b700 1 -- 172.21.15.49:0/2850125122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6888098d10 msgr2=0x7f6888158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:43.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.055+0000 7f6885d9b700 1 --2- 172.21.15.49:0/2850125122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6888098d10 0x7f6888158e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:43.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.055+0000 7f6885d9b700 1 -- 172.21.15.49:0/2850125122 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68780092a0 con 0x7f68880c6190 2023-11-30T17:07:43.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.055+0000 7f6886d9d700 1 --2- 172.21.15.49:0/2850125122 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6888158a30 0x7f68880c2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:43.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.055+0000 7f6885d9b700 1 --2- 172.21.15.49:0/2850125122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68880c6190 0x7f688814c080 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f687000c560 tx=0x7f6870007cc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:43.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.055+0000 7f687e7fc700 1 -- 172.21.15.49:0/2850125122 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68700072e0 con 0x7f68880c6190 2023-11-30T17:07:43.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.055+0000 7f688c997700 1 -- 172.21.15.49:0/2850125122 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6888155f30 con 0x7f68880c6190 2023-11-30T17:07:43.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.055+0000 7f687e7fc700 1 -- 172.21.15.49:0/2850125122 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6870007440 con 0x7f68880c6190 2023-11-30T17:07:43.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.055+0000 7f687e7fc700 1 -- 172.21.15.49:0/2850125122 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68700057a0 con 0x7f68880c6190 2023-11-30T17:07:43.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.055+0000 7f688c997700 1 -- 172.21.15.49:0/2850125122 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f688814c570 con 0x7f68880c6190 2023-11-30T17:07:43.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.056+0000 7f688c997700 1 -- 172.21.15.49:0/2850125122 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f688806c860 con 0x7f68880c6190 2023-11-30T17:07:43.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.056+0000 7f687e7fc700 1 -- 172.21.15.49:0/2850125122 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6870005bd0 con 0x7f68880c6190 2023-11-30T17:07:43.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.057+0000 7f687e7fc700 1 --2- 172.21.15.49:0/2850125122 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f686805f150 0x7f6868061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:43.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.057+0000 7f687e7fc700 1 -- 172.21.15.49:0/2850125122 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6870079920 con 0x7f68880c6190 2023-11-30T17:07:43.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.057+0000 7f688659c700 1 --2- 172.21.15.49:0/2850125122 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f686805f150 0x7f6868061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:43.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.057+0000 7f688659c700 1 --2- 172.21.15.49:0/2850125122 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f686805f150 0x7f6868061610 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f6880003df0 tx=0x7f6880009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:43.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.061+0000 7f687e7fc700 1 -- 172.21.15.49:0/2850125122 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f687004abf0 con 0x7f68880c6190 2023-11-30T17:07:43.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.232+0000 7f688c997700 1 -- 172.21.15.49:0/2850125122 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f68880c69a0 con 0x7f68880c6190 2023-11-30T17:07:43.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.232+0000 7f687e7fc700 1 -- 172.21.15.49:0/2850125122 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6870018020 con 0x7f68880c6190 2023-11-30T17:07:43.234 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T17:07:43.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.234+0000 7f688c997700 1 -- 172.21.15.49:0/2850125122 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f686805f150 msgr2=0x7f6868061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:43.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.234+0000 7f688c997700 1 --2- 172.21.15.49:0/2850125122 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f686805f150 0x7f6868061610 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f6880003df0 tx=0x7f6880009040).stop 2023-11-30T17:07:43.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.234+0000 7f688c997700 1 -- 172.21.15.49:0/2850125122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68880c6190 msgr2=0x7f688814c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:43.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.234+0000 7f688c997700 1 --2- 172.21.15.49:0/2850125122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68880c6190 0x7f688814c080 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f687000c560 tx=0x7f6870007cc0).stop 2023-11-30T17:07:43.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.234+0000 7f688c997700 1 -- 172.21.15.49:0/2850125122 shutdown_connections 2023-11-30T17:07:43.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.234+0000 7f688c997700 1 --2- 172.21.15.49:0/2850125122 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6888158a30 0x7f68880c2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:43.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.234+0000 7f688c997700 1 --2- 172.21.15.49:0/2850125122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6888098d10 0x7f6888158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:43.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.234+0000 7f688c997700 1 --2- 172.21.15.49:0/2850125122 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f686805f150 0x7f6868061610 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:43.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.234+0000 7f688c997700 1 --2- 172.21.15.49:0/2850125122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68880c6190 0x7f688814c080 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:43.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.234+0000 7f688c997700 1 -- 172.21.15.49:0/2850125122 >> 172.21.15.49:0/2850125122 conn(0x7f68880cb310 msgr2=0x7f6888063990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:43.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.234+0000 7f688c997700 1 -- 172.21.15.49:0/2850125122 shutdown_connections 2023-11-30T17:07:43.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.234+0000 7f688c997700 1 -- 172.21.15.49:0/2850125122 wait complete. 2023-11-30T17:07:43.248 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T17:07:43.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.367+0000 7f4c2c745700 1 Processor -- start 2023-11-30T17:07:43.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.367+0000 7f4c2c745700 1 -- start start 2023-11-30T17:07:43.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.368+0000 7f4c2c745700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4c240a8280 0x7f4c240a8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:43.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.368+0000 7f4c2c745700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c24067770 con 0x7f4c2414e600 2023-11-30T17:07:43.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.368+0000 7f4c2c745700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c240be8d0 con 0x7f4c24158160 2023-11-30T17:07:43.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.368+0000 7f4c2c745700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c24159180 con 0x7f4c240a8280 2023-11-30T17:07:43.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.368+0000 7f4c2ace2700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4c2414e600 0x7f4c2414ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51738/0 (socket says 172.21.15.49:51738) 2023-11-30T17:07:43.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.368+0000 7f4c2ace2700 1 -- 172.21.15.49:0/540639811 learned_addr learned my addr 172.21.15.49:0/540639811 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:43.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.368+0000 7f4c2a4e1700 1 --2- 172.21.15.49:0/540639811 >> v2:172.21.15.115:3300/0 conn(0x7f4c240a8280 0x7f4c240a8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:43.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.368+0000 7f4c294df700 1 -- 172.21.15.49:0/540639811 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1483639000 0 0) 0x7f4c24067770 con 0x7f4c2414e600 2023-11-30T17:07:43.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.368+0000 7f4c294df700 1 -- 172.21.15.49:0/540639811 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c0c0033f0 con 0x7f4c2414e600 2023-11-30T17:07:43.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.368+0000 7f4c2a4e1700 1 -- 172.21.15.49:0/540639811 >> v1:172.21.15.115:6789/0 conn(0x7f4c24158160 legacy=0x7f4c24155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:43.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.368+0000 7f4c294df700 1 -- 172.21.15.49:0/540639811 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056779014 0 0) 0x7f4c240be8d0 con 0x7f4c24158160 2023-11-30T17:07:43.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.368+0000 7f4c2a4e1700 1 -- 172.21.15.49:0/540639811 >> v1:172.21.15.49:6789/0 conn(0x7f4c2414e600 legacy=0x7f4c2414ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:43.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.368+0000 7f4c2a4e1700 1 -- 172.21.15.49:0/540639811 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c24158600 con 0x7f4c240a8280 2023-11-30T17:07:43.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.368+0000 7f4c2a4e1700 1 --2- 172.21.15.49:0/540639811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c240a8280 0x7f4c240a8660 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f4c14009760 tx=0x7f4c14009060).ready entity=mon.1 client_cookie=dd1efc934637f071 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:43.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.369+0000 7f4c294df700 1 -- 172.21.15.49:0/540639811 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1400f510 con 0x7f4c240a8280 2023-11-30T17:07:43.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.369+0000 7f4c294df700 1 -- 172.21.15.49:0/540639811 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1400f670 con 0x7f4c240a8280 2023-11-30T17:07:43.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.369+0000 7f4c294df700 1 -- 172.21.15.49:0/540639811 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1400f9f0 con 0x7f4c240a8280 2023-11-30T17:07:43.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.369+0000 7f4c2c745700 1 -- 172.21.15.49:0/540639811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c240a8280 msgr2=0x7f4c240a8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:43.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.369+0000 7f4c2c745700 1 --2- 172.21.15.49:0/540639811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c240a8280 0x7f4c240a8660 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f4c14009760 tx=0x7f4c14009060).stop 2023-11-30T17:07:43.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.369+0000 7f4c2c745700 1 -- 172.21.15.49:0/540639811 shutdown_connections 2023-11-30T17:07:43.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.369+0000 7f4c2c745700 1 --2- 172.21.15.49:0/540639811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c240a8280 0x7f4c240a8660 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:43.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.369+0000 7f4c2c745700 1 -- 172.21.15.49:0/540639811 >> 172.21.15.49:0/540639811 conn(0x7f4c24062700 msgr2=0x7f4c24062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:43.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.369+0000 7f4c2c745700 1 -- 172.21.15.49:0/540639811 shutdown_connections 2023-11-30T17:07:43.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.369+0000 7f4c2c745700 1 -- 172.21.15.49:0/540639811 wait complete. 2023-11-30T17:07:43.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.370+0000 7f4c2c745700 1 Processor -- start 2023-11-30T17:07:43.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.370+0000 7f4c2c745700 1 -- start start 2023-11-30T17:07:43.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.371+0000 7f4c2c745700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c240a8280 0x7f4c240c1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:43.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.371+0000 7f4c2c745700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c2414e600 0x7f4c2414de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:43.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.371+0000 7f4c2c745700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c24158160 0x7f4c24157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:43.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.371+0000 7f4c2c745700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c240c3eb0 con 0x7f4c2414e600 2023-11-30T17:07:43.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.371+0000 7f4c2c745700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c240c4d10 con 0x7f4c240a8280 2023-11-30T17:07:43.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.371+0000 7f4c2c745700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c240c1e40 con 0x7f4c24158160 2023-11-30T17:07:43.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.371+0000 7f4c29ce0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c2414e600 0x7f4c2414de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:43.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.371+0000 7f4c29ce0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c2414e600 0x7f4c2414de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59564/0 (socket says 172.21.15.49:59564) 2023-11-30T17:07:43.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.371+0000 7f4c29ce0700 1 -- 172.21.15.49:0/7821914 learned_addr learned my addr 172.21.15.49:0/7821914 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:43.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.371+0000 7f4c2a4e1700 1 --2- 172.21.15.49:0/7821914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c240a8280 0x7f4c240c1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:43.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.371+0000 7f4c2ace2700 1 --2- 172.21.15.49:0/7821914 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c24158160 0x7f4c24157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:43.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.371+0000 7f4c29ce0700 1 -- 172.21.15.49:0/7821914 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c24158160 msgr2=0x7f4c24157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:43.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.371+0000 7f4c29ce0700 1 --2- 172.21.15.49:0/7821914 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c24158160 0x7f4c24157720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:43.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.371+0000 7f4c29ce0700 1 -- 172.21.15.49:0/7821914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c240a8280 msgr2=0x7f4c240c1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:43.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.371+0000 7f4c29ce0700 1 --2- 172.21.15.49:0/7821914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c240a8280 0x7f4c240c1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:43.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.371+0000 7f4c29ce0700 1 -- 172.21.15.49:0/7821914 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c140092a0 con 0x7f4c2414e600 2023-11-30T17:07:43.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.372+0000 7f4c29ce0700 1 --2- 172.21.15.49:0/7821914 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c2414e600 0x7f4c2414de10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f4c1800c4e0 tx=0x7f4c18007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:43.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.372+0000 7f4c227fc700 1 -- 172.21.15.49:0/7821914 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1800f470 con 0x7f4c2414e600 2023-11-30T17:07:43.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.372+0000 7f4c227fc700 1 -- 172.21.15.49:0/7821914 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1800f5f0 con 0x7f4c2414e600 2023-11-30T17:07:43.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.372+0000 7f4c2c745700 1 -- 172.21.15.49:0/7821914 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c2414e300 con 0x7f4c2414e600 2023-11-30T17:07:43.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.372+0000 7f4c227fc700 1 -- 172.21.15.49:0/7821914 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1800f9b0 con 0x7f4c2414e600 2023-11-30T17:07:43.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.372+0000 7f4c2c745700 1 -- 172.21.15.49:0/7821914 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c240c43e0 con 0x7f4c2414e600 2023-11-30T17:07:43.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.373+0000 7f4c2c745700 1 -- 172.21.15.49:0/7821914 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c241641e0 con 0x7f4c2414e600 2023-11-30T17:07:43.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.373+0000 7f4c227fc700 1 -- 172.21.15.49:0/7821914 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4c1800fd20 con 0x7f4c2414e600 2023-11-30T17:07:43.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.373+0000 7f4c227fc700 1 --2- 172.21.15.49:0/7821914 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4c1005f150 0x7f4c10061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:43.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.373+0000 7f4c227fc700 1 -- 172.21.15.49:0/7821914 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4c180798b0 con 0x7f4c2414e600 2023-11-30T17:07:43.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.374+0000 7f4c2a4e1700 1 --2- 172.21.15.49:0/7821914 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4c1005f150 0x7f4c10061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:43.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.374+0000 7f4c2a4e1700 1 --2- 172.21.15.49:0/7821914 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4c1005f150 0x7f4c10061610 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f4c240c31e0 tx=0x7f4c14017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:43.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.378+0000 7f4c227fc700 1 -- 172.21.15.49:0/7821914 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4c241641e0 con 0x7f4c2414e600 2023-11-30T17:07:43.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.549+0000 7f4c2c745700 1 -- 172.21.15.49:0/7821914 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4c241641e0 con 0x7f4c2414e600 2023-11-30T17:07:43.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.549+0000 7f4c227fc700 1 -- 172.21.15.49:0/7821914 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4c241641e0 con 0x7f4c2414e600 2023-11-30T17:07:43.551 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T17:07:43.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.551+0000 7f4c2c745700 1 -- 172.21.15.49:0/7821914 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4c1005f150 msgr2=0x7f4c10061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:43.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.551+0000 7f4c2c745700 1 --2- 172.21.15.49:0/7821914 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4c1005f150 0x7f4c10061610 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f4c240c31e0 tx=0x7f4c14017000).stop 2023-11-30T17:07:43.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.551+0000 7f4c2c745700 1 -- 172.21.15.49:0/7821914 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c2414e600 msgr2=0x7f4c2414de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:43.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.551+0000 7f4c2c745700 1 --2- 172.21.15.49:0/7821914 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c2414e600 0x7f4c2414de10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f4c1800c4e0 tx=0x7f4c18007c70).stop 2023-11-30T17:07:43.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.551+0000 7f4c2c745700 1 -- 172.21.15.49:0/7821914 shutdown_connections 2023-11-30T17:07:43.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.551+0000 7f4c2c745700 1 --2- 172.21.15.49:0/7821914 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c24158160 0x7f4c24157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:43.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.551+0000 7f4c2c745700 1 --2- 172.21.15.49:0/7821914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c240a8280 0x7f4c240c1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:43.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.551+0000 7f4c2c745700 1 --2- 172.21.15.49:0/7821914 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4c1005f150 0x7f4c10061610 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:43.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.551+0000 7f4c2c745700 1 --2- 172.21.15.49:0/7821914 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c2414e600 0x7f4c2414de10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:43.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.551+0000 7f4c2c745700 1 -- 172.21.15.49:0/7821914 >> 172.21.15.49:0/7821914 conn(0x7f4c24062700 msgr2=0x7f4c240bf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:43.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.551+0000 7f4c2c745700 1 -- 172.21.15.49:0/7821914 shutdown_connections 2023-11-30T17:07:43.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.551+0000 7f4c2c745700 1 -- 172.21.15.49:0/7821914 wait complete. 2023-11-30T17:07:43.564 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-30T17:07:43.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.683+0000 7f22a9732700 1 Processor -- start 2023-11-30T17:07:43.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.684+0000 7f22a9732700 1 -- start start 2023-11-30T17:07:43.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.684+0000 7f22a9732700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f22a4158a30 0x7f22a40c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:43.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.684+0000 7f22a9732700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a40c72d0 con 0x7f22a40c6190 2023-11-30T17:07:43.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.684+0000 7f22a9732700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a4064570 con 0x7f22a4098d10 2023-11-30T17:07:43.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.684+0000 7f22a9732700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22a4154bc0 con 0x7f22a4158a30 2023-11-30T17:07:43.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.685+0000 7f22a27fc700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f22a40c6190 0x7f22a4158320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51740/0 (socket says 172.21.15.49:51740) 2023-11-30T17:07:43.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.685+0000 7f22a27fc700 1 -- 172.21.15.49:0/3286087373 learned_addr learned my addr 172.21.15.49:0/3286087373 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:43.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.685+0000 7f22a37fe700 1 --2- 172.21.15.49:0/3286087373 >> v2:172.21.15.115:3300/0 conn(0x7f22a4158a30 0x7f22a40c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:43.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.685+0000 7f22a1ffb700 1 -- 172.21.15.49:0/3286087373 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2152438191 0 0) 0x7f22a4064570 con 0x7f22a4098d10 2023-11-30T17:07:43.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.685+0000 7f22a1ffb700 1 -- 172.21.15.49:0/3286087373 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22900033f0 con 0x7f22a4098d10 2023-11-30T17:07:43.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.685+0000 7f22a1ffb700 1 -- 172.21.15.49:0/3286087373 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322645157 0 0) 0x7f22a40c72d0 con 0x7f22a40c6190 2023-11-30T17:07:43.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.685+0000 7f22a37fe700 1 -- 172.21.15.49:0/3286087373 >> v1:172.21.15.115:6789/0 conn(0x7f22a4098d10 legacy=0x7f22a4063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:43.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.685+0000 7f22a37fe700 1 -- 172.21.15.49:0/3286087373 >> v1:172.21.15.49:6789/0 conn(0x7f22a40c6190 legacy=0x7f22a4158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:43.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.685+0000 7f22a37fe700 1 -- 172.21.15.49:0/3286087373 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a40c66c0 con 0x7f22a4158a30 2023-11-30T17:07:43.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.685+0000 7f22a37fe700 1 --2- 172.21.15.49:0/3286087373 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22a4158a30 0x7f22a40c7760 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f2294009e60 tx=0x7f2294009780).ready entity=mon.1 client_cookie=57f9bddb3a5994ca server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:43.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.685+0000 7f22a1ffb700 1 -- 172.21.15.49:0/3286087373 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229400e070 con 0x7f22a4158a30 2023-11-30T17:07:43.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.685+0000 7f22a1ffb700 1 -- 172.21.15.49:0/3286087373 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229400bb60 con 0x7f22a4158a30 2023-11-30T17:07:43.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.685+0000 7f22a1ffb700 1 -- 172.21.15.49:0/3286087373 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229400bee0 con 0x7f22a4158a30 2023-11-30T17:07:43.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.686+0000 7f22a9732700 1 -- 172.21.15.49:0/3286087373 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22a4158a30 msgr2=0x7f22a40c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:43.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.686+0000 7f22a9732700 1 --2- 172.21.15.49:0/3286087373 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22a4158a30 0x7f22a40c7760 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f2294009e60 tx=0x7f2294009780).stop 2023-11-30T17:07:43.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.686+0000 7f22a9732700 1 -- 172.21.15.49:0/3286087373 shutdown_connections 2023-11-30T17:07:43.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.686+0000 7f22a9732700 1 --2- 172.21.15.49:0/3286087373 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22a4158a30 0x7f22a40c7760 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:43.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.686+0000 7f22a9732700 1 -- 172.21.15.49:0/3286087373 >> 172.21.15.49:0/3286087373 conn(0x7f22a40cb310 msgr2=0x7f22a40cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:43.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.686+0000 7f22a9732700 1 -- 172.21.15.49:0/3286087373 shutdown_connections 2023-11-30T17:07:43.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.686+0000 7f22a9732700 1 -- 172.21.15.49:0/3286087373 wait complete. 2023-11-30T17:07:43.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.687+0000 7f22a9732700 1 Processor -- start 2023-11-30T17:07:43.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.687+0000 7f22a9732700 1 -- start start 2023-11-30T17:07:43.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.688+0000 7f22a9732700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22a4098d10 0x7f22a40c4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:43.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.688+0000 7f22a9732700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22a40c6190 0x7f22a40aaf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:43.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.688+0000 7f22a9732700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22a4158a30 0x7f22a40a96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:43.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.688+0000 7f22a9732700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a4155f60 con 0x7f22a4158a30 2023-11-30T17:07:43.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.688+0000 7f22a9732700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a40ab940 con 0x7f22a40c6190 2023-11-30T17:07:43.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.688+0000 7f22a9732700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a40abc20 con 0x7f22a4098d10 2023-11-30T17:07:43.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.688+0000 7f22a37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22a4158a30 0x7f22a40a96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:43.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.688+0000 7f22a37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22a4158a30 0x7f22a40a96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59568/0 (socket says 172.21.15.49:59568) 2023-11-30T17:07:43.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.688+0000 7f22a27fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22a40c6190 0x7f22a40aaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:43.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.688+0000 7f22a2ffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22a4098d10 0x7f22a40c4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:43.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.688+0000 7f22a37fe700 1 -- 172.21.15.49:0/460150003 learned_addr learned my addr 172.21.15.49:0/460150003 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:43.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.688+0000 7f22a37fe700 1 -- 172.21.15.49:0/460150003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22a4098d10 msgr2=0x7f22a40c4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:43.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.688+0000 7f22a37fe700 1 --2- 172.21.15.49:0/460150003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22a4098d10 0x7f22a40c4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:43.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.688+0000 7f22a37fe700 1 -- 172.21.15.49:0/460150003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22a40c6190 msgr2=0x7f22a40aaf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:43.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.688+0000 7f22a37fe700 1 --2- 172.21.15.49:0/460150003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22a40c6190 0x7f22a40aaf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:43.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.688+0000 7f22a37fe700 1 -- 172.21.15.49:0/460150003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2294009a20 con 0x7f22a4158a30 2023-11-30T17:07:43.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.688+0000 7f22a27fc700 1 --2- 172.21.15.49:0/460150003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22a40c6190 0x7f22a40aaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:07:43.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.688+0000 7f22a37fe700 1 --2- 172.21.15.49:0/460150003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22a4158a30 0x7f22a40a96f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f22a40c2360 tx=0x7f22a40a8040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:43.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.689+0000 7f229affd700 1 -- 172.21.15.49:0/460150003 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294012e20 con 0x7f22a4158a30 2023-11-30T17:07:43.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.689+0000 7f229affd700 1 -- 172.21.15.49:0/460150003 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229401d630 con 0x7f22a4158a30 2023-11-30T17:07:43.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.689+0000 7f22a9732700 1 -- 172.21.15.49:0/460150003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a40abf00 con 0x7f22a4158a30 2023-11-30T17:07:43.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.689+0000 7f229affd700 1 -- 172.21.15.49:0/460150003 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229401d9b0 con 0x7f22a4158a30 2023-11-30T17:07:43.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.689+0000 7f22a9732700 1 -- 172.21.15.49:0/460150003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a40c23b0 con 0x7f22a4158a30 2023-11-30T17:07:43.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.690+0000 7f22a9732700 1 -- 172.21.15.49:0/460150003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a41560f0 con 0x7f22a4158a30 2023-11-30T17:07:43.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.690+0000 7f229affd700 1 -- 172.21.15.49:0/460150003 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f229401dd20 con 0x7f22a4158a30 2023-11-30T17:07:43.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.690+0000 7f229affd700 1 --2- 172.21.15.49:0/460150003 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f228405f150 0x7f2284061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:43.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.691+0000 7f229affd700 1 -- 172.21.15.49:0/460150003 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f229407c050 con 0x7f22a4158a30 2023-11-30T17:07:43.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.691+0000 7f22a2ffd700 1 --2- 172.21.15.49:0/460150003 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f228405f150 0x7f2284061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:43.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.691+0000 7f22a2ffd700 1 --2- 172.21.15.49:0/460150003 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f228405f150 0x7f2284061610 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f229c003930 tx=0x7f229c007bd0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:43.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.695+0000 7f229affd700 1 -- 172.21.15.49:0/460150003 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f22940aab00 con 0x7f22a4158a30 2023-11-30T17:07:43.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.866+0000 7f22a9732700 1 -- 172.21.15.49:0/460150003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f22a406c860 con 0x7f22a4158a30 2023-11-30T17:07:43.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.866+0000 7f229affd700 1 -- 172.21.15.49:0/460150003 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f22a41560f0 con 0x7f22a4158a30 2023-11-30T17:07:43.868 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T17:07:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.868+0000 7f22a9732700 1 -- 172.21.15.49:0/460150003 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f228405f150 msgr2=0x7f2284061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.868+0000 7f22a9732700 1 --2- 172.21.15.49:0/460150003 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f228405f150 0x7f2284061610 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f229c003930 tx=0x7f229c007bd0).stop 2023-11-30T17:07:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.868+0000 7f22a9732700 1 -- 172.21.15.49:0/460150003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22a4158a30 msgr2=0x7f22a40a96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.868+0000 7f22a9732700 1 --2- 172.21.15.49:0/460150003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22a4158a30 0x7f22a40a96f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f22a40c2360 tx=0x7f22a40a8040).stop 2023-11-30T17:07:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.868+0000 7f22a9732700 1 -- 172.21.15.49:0/460150003 shutdown_connections 2023-11-30T17:07:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.868+0000 7f22a9732700 1 --2- 172.21.15.49:0/460150003 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f228405f150 0x7f2284061610 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.868+0000 7f22a9732700 1 --2- 172.21.15.49:0/460150003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22a4158a30 0x7f22a40a96f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.868+0000 7f22a9732700 1 --2- 172.21.15.49:0/460150003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22a4098d10 0x7f22a40c4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.868+0000 7f22a9732700 1 --2- 172.21.15.49:0/460150003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22a40c6190 0x7f22a40aaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.868+0000 7f22a9732700 1 -- 172.21.15.49:0/460150003 >> 172.21.15.49:0/460150003 conn(0x7f22a40cb310 msgr2=0x7f22a4148e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.868+0000 7f22a9732700 1 -- 172.21.15.49:0/460150003 shutdown_connections 2023-11-30T17:07:43.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:43.868+0000 7f22a9732700 1 -- 172.21.15.49:0/460150003 wait complete. 2023-11-30T17:07:43.882 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-30T17:07:44.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.000+0000 7f88db7f9700 1 Processor -- start 2023-11-30T17:07:44.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.001+0000 7f88db7f9700 1 -- start start 2023-11-30T17:07:44.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.001+0000 7f88db7f9700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f88d4158160 0x7f88d40a8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:44.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.001+0000 7f88db7f9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88d414e600 0x7f88d414ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:44.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.001+0000 7f88db7f9700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88d4067770 con 0x7f88d40a8280 2023-11-30T17:07:44.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.001+0000 7f88db7f9700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d4159180 con 0x7f88d4158160 2023-11-30T17:07:44.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.001+0000 7f88db7f9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d40be8d0 con 0x7f88d414e600 2023-11-30T17:07:44.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.002+0000 7f88d8d94700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f88d4158160 0x7f88d40a8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:44.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.002+0000 7f88d8d94700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f88d4158160 0x7f88d40a8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59574/0 (socket says 172.21.15.49:59574) 2023-11-30T17:07:44.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.002+0000 7f88d8d94700 1 -- 172.21.15.49:0/3059935143 learned_addr learned my addr 172.21.15.49:0/3059935143 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:44.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.002+0000 7f88d9d96700 1 --2- 172.21.15.49:0/3059935143 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88d414e600 0x7f88d414ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:44.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.002+0000 7f88d8d94700 1 -- 172.21.15.49:0/3059935143 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88d414e600 msgr2=0x7f88d414ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:44.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.002+0000 7f88d8d94700 1 --2- 172.21.15.49:0/3059935143 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88d414e600 0x7f88d414ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.002+0000 7f88d8d94700 1 -- 172.21.15.49:0/3059935143 >> v1:172.21.15.115:6789/0 conn(0x7f88d40a8280 legacy=0x7f88d4155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:44.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.002+0000 7f88d8d94700 1 -- 172.21.15.49:0/3059935143 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d4158600 con 0x7f88d4158160 2023-11-30T17:07:44.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.002+0000 7f88d9d96700 1 --2- 172.21.15.49:0/3059935143 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88d414e600 0x7f88d414ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:44.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.002+0000 7f88d8d94700 1 --2- 172.21.15.49:0/3059935143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88d4158160 0x7f88d40a8660 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f88c8006fd0 tx=0x7f88c80090f0).ready entity=mon.0 client_cookie=ffe4e6f79a5f844f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:44.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.002+0000 7f88d3fff700 1 -- 172.21.15.49:0/3059935143 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c800b600 con 0x7f88d4158160 2023-11-30T17:07:44.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.002+0000 7f88d3fff700 1 -- 172.21.15.49:0/3059935143 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c800b760 con 0x7f88d4158160 2023-11-30T17:07:44.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.002+0000 7f88d3fff700 1 -- 172.21.15.49:0/3059935143 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c800bae0 con 0x7f88d4158160 2023-11-30T17:07:44.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.003+0000 7f88db7f9700 1 -- 172.21.15.49:0/3059935143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88d4158160 msgr2=0x7f88d40a8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:44.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.003+0000 7f88db7f9700 1 --2- 172.21.15.49:0/3059935143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88d4158160 0x7f88d40a8660 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f88c8006fd0 tx=0x7f88c80090f0).stop 2023-11-30T17:07:44.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.003+0000 7f88db7f9700 1 -- 172.21.15.49:0/3059935143 shutdown_connections 2023-11-30T17:07:44.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.003+0000 7f88db7f9700 1 --2- 172.21.15.49:0/3059935143 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88d414e600 0x7f88d414ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.003+0000 7f88db7f9700 1 --2- 172.21.15.49:0/3059935143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88d4158160 0x7f88d40a8660 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.003+0000 7f88db7f9700 1 -- 172.21.15.49:0/3059935143 >> 172.21.15.49:0/3059935143 conn(0x7f88d4062700 msgr2=0x7f88d4062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:44.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.003+0000 7f88db7f9700 1 -- 172.21.15.49:0/3059935143 shutdown_connections 2023-11-30T17:07:44.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.003+0000 7f88db7f9700 1 -- 172.21.15.49:0/3059935143 wait complete. 2023-11-30T17:07:44.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.004+0000 7f88db7f9700 1 Processor -- start 2023-11-30T17:07:44.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.004+0000 7f88db7f9700 1 -- start start 2023-11-30T17:07:44.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.005+0000 7f88db7f9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88d40a8280 0x7f88d4063810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:44.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.005+0000 7f88db7f9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88d414e600 0x7f88d414ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:44.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.005+0000 7f88db7f9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88d4158160 0x7f88d40c2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:44.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.005+0000 7f88db7f9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d414b360 con 0x7f88d40a8280 2023-11-30T17:07:44.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.005+0000 7f88db7f9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d40c0630 con 0x7f88d414e600 2023-11-30T17:07:44.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.005+0000 7f88db7f9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d4155dc0 con 0x7f88d4158160 2023-11-30T17:07:44.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.005+0000 7f88d9595700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88d40a8280 0x7f88d4063810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:44.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.005+0000 7f88d9595700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88d40a8280 0x7f88d4063810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59590/0 (socket says 172.21.15.49:59590) 2023-11-30T17:07:44.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.005+0000 7f88d9595700 1 -- 172.21.15.49:0/1144039535 learned_addr learned my addr 172.21.15.49:0/1144039535 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:44.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.005+0000 7f88d9d96700 1 --2- 172.21.15.49:0/1144039535 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88d4158160 0x7f88d40c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:44.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.005+0000 7f88d8d94700 1 --2- 172.21.15.49:0/1144039535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88d414e600 0x7f88d414ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:44.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.005+0000 7f88d9595700 1 -- 172.21.15.49:0/1144039535 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88d4158160 msgr2=0x7f88d40c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:44.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.005+0000 7f88d9595700 1 --2- 172.21.15.49:0/1144039535 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88d4158160 0x7f88d40c2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.005+0000 7f88d9595700 1 -- 172.21.15.49:0/1144039535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88d414e600 msgr2=0x7f88d414ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:44.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.005+0000 7f88d9595700 1 --2- 172.21.15.49:0/1144039535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88d414e600 0x7f88d414ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.005+0000 7f88d9595700 1 -- 172.21.15.49:0/1144039535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c8009370 con 0x7f88d40a8280 2023-11-30T17:07:44.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.005+0000 7f88d9595700 1 --2- 172.21.15.49:0/1144039535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88d40a8280 0x7f88d4063810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f88cc00c440 tx=0x7f88cc007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:44.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.006+0000 7f88d17fa700 1 -- 172.21.15.49:0/1144039535 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc007020 con 0x7f88d40a8280 2023-11-30T17:07:44.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.006+0000 7f88d17fa700 1 -- 172.21.15.49:0/1144039535 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88cc007180 con 0x7f88d40a8280 2023-11-30T17:07:44.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.006+0000 7f88d17fa700 1 -- 172.21.15.49:0/1144039535 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc007520 con 0x7f88d40a8280 2023-11-30T17:07:44.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.006+0000 7f88db7f9700 1 -- 172.21.15.49:0/1144039535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d41560a0 con 0x7f88d40a8280 2023-11-30T17:07:44.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.006+0000 7f88db7f9700 1 -- 172.21.15.49:0/1144039535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d40c0910 con 0x7f88d40a8280 2023-11-30T17:07:44.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.007+0000 7f88db7f9700 1 -- 172.21.15.49:0/1144039535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d4155c10 con 0x7f88d40a8280 2023-11-30T17:07:44.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.007+0000 7f88d17fa700 1 -- 172.21.15.49:0/1144039535 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f88cc0068b0 con 0x7f88d40a8280 2023-11-30T17:07:44.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.007+0000 7f88d17fa700 1 --2- 172.21.15.49:0/1144039535 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f88c005f150 0x7f88c0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:44.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.007+0000 7f88d17fa700 1 -- 172.21.15.49:0/1144039535 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f88cc079410 con 0x7f88d40a8280 2023-11-30T17:07:44.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.008+0000 7f88d8d94700 1 --2- 172.21.15.49:0/1144039535 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f88c005f150 0x7f88c0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:44.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.008+0000 7f88d8d94700 1 --2- 172.21.15.49:0/1144039535 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f88c005f150 0x7f88c0061610 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f88c800b3c0 tx=0x7f88c8017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:44.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.011+0000 7f88d17fa700 1 -- 172.21.15.49:0/1144039535 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f88cc047b00 con 0x7f88d40a8280 2023-11-30T17:07:44.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.182+0000 7f88db7f9700 1 -- 172.21.15.49:0/1144039535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f88d406c860 con 0x7f88d40a8280 2023-11-30T17:07:44.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.182+0000 7f88d17fa700 1 -- 172.21.15.49:0/1144039535 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f88cc04a6e0 con 0x7f88d40a8280 2023-11-30T17:07:44.184 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T17:07:44.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.184+0000 7f88db7f9700 1 -- 172.21.15.49:0/1144039535 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f88c005f150 msgr2=0x7f88c0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:44.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.184+0000 7f88db7f9700 1 --2- 172.21.15.49:0/1144039535 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f88c005f150 0x7f88c0061610 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f88c800b3c0 tx=0x7f88c8017000).stop 2023-11-30T17:07:44.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.184+0000 7f88db7f9700 1 -- 172.21.15.49:0/1144039535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88d40a8280 msgr2=0x7f88d4063810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:44.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.184+0000 7f88db7f9700 1 --2- 172.21.15.49:0/1144039535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88d40a8280 0x7f88d4063810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f88cc00c440 tx=0x7f88cc007e00).stop 2023-11-30T17:07:44.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.184+0000 7f88db7f9700 1 -- 172.21.15.49:0/1144039535 shutdown_connections 2023-11-30T17:07:44.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.184+0000 7f88db7f9700 1 --2- 172.21.15.49:0/1144039535 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88d4158160 0x7f88d40c2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.184+0000 7f88db7f9700 1 --2- 172.21.15.49:0/1144039535 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f88c005f150 0x7f88c0061610 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.184+0000 7f88db7f9700 1 --2- 172.21.15.49:0/1144039535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88d40a8280 0x7f88d4063810 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.184+0000 7f88db7f9700 1 --2- 172.21.15.49:0/1144039535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88d414e600 0x7f88d414ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.184+0000 7f88db7f9700 1 -- 172.21.15.49:0/1144039535 >> 172.21.15.49:0/1144039535 conn(0x7f88d4062700 msgr2=0x7f88d4062ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:44.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.184+0000 7f88db7f9700 1 -- 172.21.15.49:0/1144039535 shutdown_connections 2023-11-30T17:07:44.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.184+0000 7f88db7f9700 1 -- 172.21.15.49:0/1144039535 wait complete. 2023-11-30T17:07:44.197 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:07:44.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.314+0000 7ff3a380a700 1 Processor -- start 2023-11-30T17:07:44.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.314+0000 7ff3a380a700 1 -- start start 2023-11-30T17:07:44.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.315+0000 7ff3a380a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff39c06b510 0x7ff39c1546f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:44.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.315+0000 7ff3a380a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff39c0c10f0 0x7ff39c158b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:44.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.315+0000 7ff3a380a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff39c063380 con 0x7ff39c0c0d10 2023-11-30T17:07:44.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.315+0000 7ff3a380a700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff39c0c19e0 con 0x7ff39c0c10f0 2023-11-30T17:07:44.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.315+0000 7ff3a380a700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff39c159060 con 0x7ff39c06b510 2023-11-30T17:07:44.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.315+0000 7ff3a15a6700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff39c0c0d10 0x7ff39c153fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51756/0 (socket says 172.21.15.49:51756) 2023-11-30T17:07:44.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.315+0000 7ff3a15a6700 1 -- 172.21.15.49:0/4057735770 learned_addr learned my addr 172.21.15.49:0/4057735770 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:44.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.315+0000 7ff3a1da7700 1 --2- 172.21.15.49:0/4057735770 >> v2:172.21.15.49:3300/0 conn(0x7ff39c0c10f0 0x7ff39c158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:44.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.315+0000 7ff3a0da5700 1 --2- 172.21.15.49:0/4057735770 >> v2:172.21.15.115:3300/0 conn(0x7ff39c06b510 0x7ff39c1546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:44.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.316+0000 7ff3a1da7700 1 -- 172.21.15.49:0/4057735770 >> v2:172.21.15.115:3300/0 conn(0x7ff39c06b510 msgr2=0x7ff39c1546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:44.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.316+0000 7ff3a1da7700 1 --2- 172.21.15.49:0/4057735770 >> v2:172.21.15.115:3300/0 conn(0x7ff39c06b510 0x7ff39c1546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.316+0000 7ff3a1da7700 1 -- 172.21.15.49:0/4057735770 >> v1:172.21.15.49:6789/0 conn(0x7ff39c0c0d10 legacy=0x7ff39c153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:44.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.316+0000 7ff39bfff700 1 -- 172.21.15.49:0/4057735770 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 902330854 0 0) 0x7ff39c063380 con 0x7ff39c0c0d10 2023-11-30T17:07:44.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.316+0000 7ff3a1da7700 1 -- 172.21.15.49:0/4057735770 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39c062770 con 0x7ff39c0c10f0 2023-11-30T17:07:44.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.316+0000 7ff3a1da7700 1 --2- 172.21.15.49:0/4057735770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff39c0c10f0 0x7ff39c158b70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7ff394009760 tx=0x7ff394009060).ready entity=mon.0 client_cookie=13d5125643f9e680 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:44.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.316+0000 7ff39bfff700 1 -- 172.21.15.49:0/4057735770 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39400f510 con 0x7ff39c0c10f0 2023-11-30T17:07:44.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.316+0000 7ff39bfff700 1 -- 172.21.15.49:0/4057735770 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39400f670 con 0x7ff39c0c10f0 2023-11-30T17:07:44.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.316+0000 7ff39bfff700 1 -- 172.21.15.49:0/4057735770 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39400f9f0 con 0x7ff39c0c10f0 2023-11-30T17:07:44.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.316+0000 7ff3a380a700 1 -- 172.21.15.49:0/4057735770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff39c0c10f0 msgr2=0x7ff39c158b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:44.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.316+0000 7ff3a380a700 1 --2- 172.21.15.49:0/4057735770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff39c0c10f0 0x7ff39c158b70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7ff394009760 tx=0x7ff394009060).stop 2023-11-30T17:07:44.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.317+0000 7ff3a380a700 1 -- 172.21.15.49:0/4057735770 shutdown_connections 2023-11-30T17:07:44.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.317+0000 7ff3a380a700 1 --2- 172.21.15.49:0/4057735770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff39c0c10f0 0x7ff39c158b70 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.317+0000 7ff3a380a700 1 --2- 172.21.15.49:0/4057735770 >> v2:172.21.15.115:3300/0 conn(0x7ff39c06b510 0x7ff39c1546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.317+0000 7ff3a380a700 1 -- 172.21.15.49:0/4057735770 >> 172.21.15.49:0/4057735770 conn(0x7ff39c0c7760 msgr2=0x7ff39c0c7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:44.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.317+0000 7ff3a380a700 1 -- 172.21.15.49:0/4057735770 shutdown_connections 2023-11-30T17:07:44.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.317+0000 7ff3a380a700 1 -- 172.21.15.49:0/4057735770 wait complete. 2023-11-30T17:07:44.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.318+0000 7ff3a380a700 1 Processor -- start 2023-11-30T17:07:44.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.318+0000 7ff3a380a700 1 -- start start 2023-11-30T17:07:44.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.319+0000 7ff3a380a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff39c06b510 0x7ff39c13f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:44.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.319+0000 7ff3a380a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff39c0c0d10 0x7ff39c0ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:44.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.319+0000 7ff3a380a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff39c0c10f0 0x7ff39c13fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:44.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.319+0000 7ff3a380a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c0aa7f0 con 0x7ff39c06b510 2023-11-30T17:07:44.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.319+0000 7ff3a380a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c0aaad0 con 0x7ff39c0c0d10 2023-11-30T17:07:44.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.319+0000 7ff3a380a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c0aadb0 con 0x7ff39c0c10f0 2023-11-30T17:07:44.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.319+0000 7ff3a15a6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff39c06b510 0x7ff39c13f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:44.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.319+0000 7ff3a15a6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff39c06b510 0x7ff39c13f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59620/0 (socket says 172.21.15.49:59620) 2023-11-30T17:07:44.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.319+0000 7ff3a15a6700 1 -- 172.21.15.49:0/680984293 learned_addr learned my addr 172.21.15.49:0/680984293 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:44.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.319+0000 7ff3a0da5700 1 --2- 172.21.15.49:0/680984293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff39c0c0d10 0x7ff39c0ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:44.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.319+0000 7ff3a1da7700 1 --2- 172.21.15.49:0/680984293 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff39c0c10f0 0x7ff39c13fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:44.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.319+0000 7ff3a15a6700 1 -- 172.21.15.49:0/680984293 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff39c0c10f0 msgr2=0x7ff39c13fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:44.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.319+0000 7ff3a15a6700 1 --2- 172.21.15.49:0/680984293 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff39c0c10f0 0x7ff39c13fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.319+0000 7ff3a15a6700 1 -- 172.21.15.49:0/680984293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff39c0c0d10 msgr2=0x7ff39c0ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:44.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.319+0000 7ff3a15a6700 1 --2- 172.21.15.49:0/680984293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff39c0c0d10 0x7ff39c0ad0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.319+0000 7ff3a15a6700 1 -- 172.21.15.49:0/680984293 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3940092a0 con 0x7ff39c06b510 2023-11-30T17:07:44.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.319+0000 7ff3a15a6700 1 --2- 172.21.15.49:0/680984293 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff39c06b510 0x7ff39c13f170 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7ff38c00c960 tx=0x7ff38c001630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:44.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.319+0000 7ff3997fa700 1 -- 172.21.15.49:0/680984293 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c005d30 con 0x7ff39c06b510 2023-11-30T17:07:44.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.319+0000 7ff3997fa700 1 -- 172.21.15.49:0/680984293 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38c005e90 con 0x7ff39c06b510 2023-11-30T17:07:44.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.319+0000 7ff3997fa700 1 -- 172.21.15.49:0/680984293 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c007320 con 0x7ff39c06b510 2023-11-30T17:07:44.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.319+0000 7ff3a380a700 1 -- 172.21.15.49:0/680984293 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff39c0ab090 con 0x7ff39c06b510 2023-11-30T17:07:44.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.319+0000 7ff3a380a700 1 -- 172.21.15.49:0/680984293 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff39c13f660 con 0x7ff39c06b510 2023-11-30T17:07:44.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.321+0000 7ff3a380a700 1 -- 172.21.15.49:0/680984293 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff39c0ab5b0 con 0x7ff39c06b510 2023-11-30T17:07:44.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.321+0000 7ff3997fa700 1 -- 172.21.15.49:0/680984293 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff38c007750 con 0x7ff39c06b510 2023-11-30T17:07:44.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.321+0000 7ff3997fa700 1 --2- 172.21.15.49:0/680984293 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff38805f150 0x7ff388061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:44.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.321+0000 7ff3997fa700 1 -- 172.21.15.49:0/680984293 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff38c07a260 con 0x7ff39c06b510 2023-11-30T17:07:44.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.321+0000 7ff3a0da5700 1 --2- 172.21.15.49:0/680984293 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff38805f150 0x7ff388061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:44.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.322+0000 7ff3a0da5700 1 --2- 172.21.15.49:0/680984293 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff38805f150 0x7ff388061610 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7ff39c150360 tx=0x7ff390009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:44.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.325+0000 7ff3997fa700 1 -- 172.21.15.49:0/680984293 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff38c04b530 con 0x7ff39c06b510 2023-11-30T17:07:44.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.499+0000 7ff3a380a700 1 -- 172.21.15.49:0/680984293 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff39c06c860 con 0x7ff39c06b510 2023-11-30T17:07:44.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.500+0000 7ff3997fa700 1 -- 172.21.15.49:0/680984293 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16928 (secure 0 0 0) 0x7ff38c001770 con 0x7ff39c06b510 2023-11-30T17:07:44.501 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:44.502 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":22,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:07:17.283998+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:07:14.837882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-30T17:07:15.248549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:07:44.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.502+0000 7ff3a380a700 1 -- 172.21.15.49:0/680984293 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff38805f150 msgr2=0x7ff388061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:44.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.502+0000 7ff3a380a700 1 --2- 172.21.15.49:0/680984293 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff38805f150 0x7ff388061610 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7ff39c150360 tx=0x7ff390009060).stop 2023-11-30T17:07:44.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.502+0000 7ff3a380a700 1 -- 172.21.15.49:0/680984293 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff39c06b510 msgr2=0x7ff39c13f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:44.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.502+0000 7ff3a380a700 1 --2- 172.21.15.49:0/680984293 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff39c06b510 0x7ff39c13f170 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7ff38c00c960 tx=0x7ff38c001630).stop 2023-11-30T17:07:44.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.502+0000 7ff3a380a700 1 -- 172.21.15.49:0/680984293 shutdown_connections 2023-11-30T17:07:44.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.502+0000 7ff3a380a700 1 --2- 172.21.15.49:0/680984293 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff39c0c10f0 0x7ff39c13fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.502+0000 7ff3a380a700 1 --2- 172.21.15.49:0/680984293 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff38805f150 0x7ff388061610 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.502+0000 7ff3a380a700 1 --2- 172.21.15.49:0/680984293 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff39c06b510 0x7ff39c13f170 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.502+0000 7ff3a380a700 1 --2- 172.21.15.49:0/680984293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff39c0c0d10 0x7ff39c0ad0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.502+0000 7ff3a380a700 1 -- 172.21.15.49:0/680984293 >> 172.21.15.49:0/680984293 conn(0x7ff39c0c7760 msgr2=0x7ff39c153db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:44.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.502+0000 7ff3a380a700 1 -- 172.21.15.49:0/680984293 shutdown_connections 2023-11-30T17:07:44.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.502+0000 7ff3a380a700 1 -- 172.21.15.49:0/680984293 wait complete. 2023-11-30T17:07:44.516 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-30T17:07:14.837882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-30T17:07:15.248549+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-30T17:07:44.516 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T17:07:44.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.635+0000 7fd760aac700 1 Processor -- start 2023-11-30T17:07:44.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.635+0000 7fd760aac700 1 -- start start 2023-11-30T17:07:44.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.636+0000 7fd760aac700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd75c098d10 0x7fd75c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.636+0000 7fd760aac700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd75c0c72d0 con 0x7fd75c158320 2023-11-30T17:07:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.636+0000 7fd760aac700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd75c064570 con 0x7fd75c0c6190 2023-11-30T17:07:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.636+0000 7fd760aac700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd75c154bc0 con 0x7fd75c098d10 2023-11-30T17:07:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.636+0000 7fd75ad9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd75c158320 0x7fd75c0a80f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51770/0 (socket says 172.21.15.49:51770) 2023-11-30T17:07:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.636+0000 7fd75ad9d700 1 -- 172.21.15.49:0/3632872070 learned_addr learned my addr 172.21.15.49:0/3632872070 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.637+0000 7fd75a59c700 1 --2- 172.21.15.49:0/3632872070 >> v2:172.21.15.115:3300/0 conn(0x7fd75c098d10 0x7fd75c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.637+0000 7fd75959a700 1 -- 172.21.15.49:0/3632872070 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008047013 0 0) 0x7fd75c0c72d0 con 0x7fd75c158320 2023-11-30T17:07:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.637+0000 7fd75959a700 1 -- 172.21.15.49:0/3632872070 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7480033f0 con 0x7fd75c158320 2023-11-30T17:07:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.637+0000 7fd75a59c700 1 -- 172.21.15.49:0/3632872070 >> v1:172.21.15.115:6789/0 conn(0x7fd75c0c6190 legacy=0x7fd75c063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.637+0000 7fd75a59c700 1 -- 172.21.15.49:0/3632872070 >> v1:172.21.15.49:6789/0 conn(0x7fd75c158320 legacy=0x7fd75c0a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.637+0000 7fd75a59c700 1 -- 172.21.15.49:0/3632872070 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c0c66c0 con 0x7fd75c098d10 2023-11-30T17:07:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.637+0000 7fd75a59c700 1 --2- 172.21.15.49:0/3632872070 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd75c098d10 0x7fd75c0c7760 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fd754009760 tx=0x7fd754009060).ready entity=mon.1 client_cookie=59569ca82534e472 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.637+0000 7fd75959a700 1 -- 172.21.15.49:0/3632872070 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75400f510 con 0x7fd75c098d10 2023-11-30T17:07:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.637+0000 7fd75959a700 1 -- 172.21.15.49:0/3632872070 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75400f670 con 0x7fd75c098d10 2023-11-30T17:07:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.637+0000 7fd75959a700 1 -- 172.21.15.49:0/3632872070 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75400f9f0 con 0x7fd75c098d10 2023-11-30T17:07:44.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.638+0000 7fd760aac700 1 -- 172.21.15.49:0/3632872070 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd75c098d10 msgr2=0x7fd75c0c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:44.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.638+0000 7fd760aac700 1 --2- 172.21.15.49:0/3632872070 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd75c098d10 0x7fd75c0c7760 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fd754009760 tx=0x7fd754009060).stop 2023-11-30T17:07:44.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.638+0000 7fd760aac700 1 -- 172.21.15.49:0/3632872070 shutdown_connections 2023-11-30T17:07:44.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.638+0000 7fd760aac700 1 --2- 172.21.15.49:0/3632872070 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd75c098d10 0x7fd75c0c7760 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.638+0000 7fd760aac700 1 -- 172.21.15.49:0/3632872070 >> 172.21.15.49:0/3632872070 conn(0x7fd75c0cb310 msgr2=0x7fd75c0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:44.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.638+0000 7fd760aac700 1 -- 172.21.15.49:0/3632872070 shutdown_connections 2023-11-30T17:07:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.638+0000 7fd760aac700 1 -- 172.21.15.49:0/3632872070 wait complete. 2023-11-30T17:07:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.639+0000 7fd760aac700 1 Processor -- start 2023-11-30T17:07:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.639+0000 7fd760aac700 1 -- start start 2023-11-30T17:07:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.640+0000 7fd760aac700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd75c098d10 0x7fd75c14e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.640+0000 7fd760aac700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd75c0c6190 0x7fd75c14cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.640+0000 7fd760aac700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd75c158320 0x7fd75c0c0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.640+0000 7fd760aac700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c14ed80 con 0x7fd75c158320 2023-11-30T17:07:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.640+0000 7fd760aac700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c1560a0 con 0x7fd75c0c6190 2023-11-30T17:07:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.640+0000 7fd760aac700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c14dac0 con 0x7fd75c098d10 2023-11-30T17:07:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.640+0000 7fd75ad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd75c158320 0x7fd75c0c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.640+0000 7fd75ad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd75c158320 0x7fd75c0c0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59634/0 (socket says 172.21.15.49:59634) 2023-11-30T17:07:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.640+0000 7fd75ad9d700 1 -- 172.21.15.49:0/1361566395 learned_addr learned my addr 172.21.15.49:0/1361566395 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.640+0000 7fd759d9b700 1 --2- 172.21.15.49:0/1361566395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd75c0c6190 0x7fd75c14cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:44.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.640+0000 7fd75a59c700 1 --2- 172.21.15.49:0/1361566395 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd75c098d10 0x7fd75c14e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:44.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.640+0000 7fd75ad9d700 1 -- 172.21.15.49:0/1361566395 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd75c098d10 msgr2=0x7fd75c14e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:44.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.640+0000 7fd75ad9d700 1 --2- 172.21.15.49:0/1361566395 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd75c098d10 0x7fd75c14e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.640+0000 7fd75ad9d700 1 -- 172.21.15.49:0/1361566395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd75c0c6190 msgr2=0x7fd75c14cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:44.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.640+0000 7fd75ad9d700 1 --2- 172.21.15.49:0/1361566395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd75c0c6190 0x7fd75c14cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.640+0000 7fd75ad9d700 1 -- 172.21.15.49:0/1361566395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7540092a0 con 0x7fd75c158320 2023-11-30T17:07:44.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.640+0000 7fd75ad9d700 1 --2- 172.21.15.49:0/1361566395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd75c158320 0x7fd75c0c0420 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fd74c005ad0 tx=0x7fd74c0015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:44.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.640+0000 7fd7527fc700 1 -- 172.21.15.49:0/1361566395 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74c005d30 con 0x7fd75c158320 2023-11-30T17:07:44.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.640+0000 7fd7527fc700 1 -- 172.21.15.49:0/1361566395 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd74c005e90 con 0x7fd75c158320 2023-11-30T17:07:44.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.640+0000 7fd760aac700 1 -- 172.21.15.49:0/1361566395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd75c156360 con 0x7fd75c158320 2023-11-30T17:07:44.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.640+0000 7fd7527fc700 1 -- 172.21.15.49:0/1361566395 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74c0072e0 con 0x7fd75c158320 2023-11-30T17:07:44.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.641+0000 7fd760aac700 1 -- 172.21.15.49:0/1361566395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75c14d500 con 0x7fd75c158320 2023-11-30T17:07:44.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.641+0000 7fd760aac700 1 -- 172.21.15.49:0/1361566395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd75c1564f0 con 0x7fd75c158320 2023-11-30T17:07:44.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.642+0000 7fd7527fc700 1 -- 172.21.15.49:0/1361566395 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd74c0076d0 con 0x7fd75c158320 2023-11-30T17:07:44.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.642+0000 7fd7527fc700 1 --2- 172.21.15.49:0/1361566395 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd73c05f120 0x7fd73c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:44.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.642+0000 7fd7527fc700 1 -- 172.21.15.49:0/1361566395 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd74c079a50 con 0x7fd75c158320 2023-11-30T17:07:44.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.642+0000 7fd75a59c700 1 --2- 172.21.15.49:0/1361566395 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd73c05f120 0x7fd73c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:44.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.643+0000 7fd75a59c700 1 --2- 172.21.15.49:0/1361566395 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd73c05f120 0x7fd73c0615e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fd754009760 tx=0x7fd754017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:44.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.646+0000 7fd7527fc700 1 -- 172.21.15.49:0/1361566395 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd74c04acc0 con 0x7fd75c158320 2023-11-30T17:07:44.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.819+0000 7fd760aac700 1 -- 172.21.15.49:0/1361566395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd75c06c860 con 0x7fd75c158320 2023-11-30T17:07:44.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.820+0000 7fd7527fc700 1 -- 172.21.15.49:0/1361566395 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd74c04e2e0 con 0x7fd75c158320 2023-11-30T17:07:44.821 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T17:07:44.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.821+0000 7fd760aac700 1 -- 172.21.15.49:0/1361566395 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd73c05f120 msgr2=0x7fd73c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:44.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.821+0000 7fd760aac700 1 --2- 172.21.15.49:0/1361566395 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd73c05f120 0x7fd73c0615e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fd754009760 tx=0x7fd754017000).stop 2023-11-30T17:07:44.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.821+0000 7fd760aac700 1 -- 172.21.15.49:0/1361566395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd75c158320 msgr2=0x7fd75c0c0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:44.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.821+0000 7fd760aac700 1 --2- 172.21.15.49:0/1361566395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd75c158320 0x7fd75c0c0420 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fd74c005ad0 tx=0x7fd74c0015b0).stop 2023-11-30T17:07:44.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.821+0000 7fd760aac700 1 -- 172.21.15.49:0/1361566395 shutdown_connections 2023-11-30T17:07:44.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.821+0000 7fd760aac700 1 --2- 172.21.15.49:0/1361566395 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd73c05f120 0x7fd73c0615e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.821+0000 7fd760aac700 1 --2- 172.21.15.49:0/1361566395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd75c158320 0x7fd75c0c0420 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.821+0000 7fd760aac700 1 --2- 172.21.15.49:0/1361566395 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd75c098d10 0x7fd75c14e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.821+0000 7fd760aac700 1 --2- 172.21.15.49:0/1361566395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd75c0c6190 0x7fd75c14cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.821+0000 7fd760aac700 1 -- 172.21.15.49:0/1361566395 >> 172.21.15.49:0/1361566395 conn(0x7fd75c0cb310 msgr2=0x7fd75c1532f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:44.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.822+0000 7fd760aac700 1 -- 172.21.15.49:0/1361566395 shutdown_connections 2023-11-30T17:07:44.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.822+0000 7fd760aac700 1 -- 172.21.15.49:0/1361566395 wait complete. 2023-11-30T17:07:44.835 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T17:07:44.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.953+0000 7f4915304700 1 Processor -- start 2023-11-30T17:07:44.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.953+0000 7f4915304700 1 -- start start 2023-11-30T17:07:44.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.954+0000 7f4915304700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f49100c6190 0x7f49100c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:44.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.954+0000 7f4915304700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4910158320 0x7f49101587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:44.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.954+0000 7f4915304700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4910158cc0 con 0x7f4910098d10 2023-11-30T17:07:44.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.954+0000 7f4915304700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49100c72d0 con 0x7f49100c6190 2023-11-30T17:07:44.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.954+0000 7f4915304700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4910064570 con 0x7f4910158320 2023-11-30T17:07:44.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.954+0000 7f490effd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4910098d10 0x7f4910063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51778/0 (socket says 172.21.15.49:51778) 2023-11-30T17:07:44.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.954+0000 7f490effd700 1 -- 172.21.15.49:0/34818609 learned_addr learned my addr 172.21.15.49:0/34818609 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:44.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.954+0000 7f490dffb700 1 -- 172.21.15.49:0/34818609 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 44777385 0 0) 0x7f4908001110 con 0x7f4910098d10 2023-11-30T17:07:44.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.954+0000 7f490dffb700 1 -- 172.21.15.49:0/34818609 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48fc0033f0 con 0x7f4910098d10 2023-11-30T17:07:44.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.954+0000 7f490e7fc700 1 --2- 172.21.15.49:0/34818609 >> v2:172.21.15.115:3300/0 conn(0x7f49100c6190 0x7f49100c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:44.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.954+0000 7f490f7fe700 1 --2- 172.21.15.49:0/34818609 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4910158320 0x7f49101587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:44.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.955+0000 7f490dffb700 1 -- 172.21.15.49:0/34818609 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2471402513 0 0) 0x7f48fc0033f0 con 0x7f4910098d10 2023-11-30T17:07:44.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.955+0000 7f490dffb700 1 -- 172.21.15.49:0/34818609 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4910158320 msgr2=0x7f49101587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:44.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.955+0000 7f490dffb700 1 --2- 172.21.15.49:0/34818609 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4910158320 0x7f49101587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.955+0000 7f490dffb700 1 -- 172.21.15.49:0/34818609 >> v2:172.21.15.115:3300/0 conn(0x7f49100c6190 msgr2=0x7f49100c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:44.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.955+0000 7f490dffb700 1 --2- 172.21.15.49:0/34818609 >> v2:172.21.15.115:3300/0 conn(0x7f49100c6190 0x7f49100c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.955+0000 7f490dffb700 1 -- 172.21.15.49:0/34818609 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4910154bc0 con 0x7f4910098d10 2023-11-30T17:07:44.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.955+0000 7f490dffb700 1 -- 172.21.15.49:0/34818609 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f4908001600 con 0x7f4910098d10 2023-11-30T17:07:44.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.955+0000 7f490f7fe700 1 --2- 172.21.15.49:0/34818609 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4910158320 0x7f49101587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:44.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.955+0000 7f490dffb700 1 -- 172.21.15.49:0/34818609 >> v1:172.21.15.49:6789/0 conn(0x7f4910098d10 legacy=0x7f4910063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:44.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.955+0000 7f490dffb700 1 --2- 172.21.15.49:0/34818609 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4910158320 0x7f48fc0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:44.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.955+0000 7f490dffb700 1 --2- 172.21.15.49:0/34818609 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48fc003dd0 0x7f48fc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:44.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.955+0000 7f490dffb700 1 --2- 172.21.15.49:0/34818609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48fc004b80 0x7f48fc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:44.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.955+0000 7f490dffb700 1 -- 172.21.15.49:0/34818609 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49100c72d0 con 0x7f48fc004b80 2023-11-30T17:07:44.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.955+0000 7f490dffb700 1 -- 172.21.15.49:0/34818609 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4910064570 con 0x7f48fc003dd0 2023-11-30T17:07:44.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.955+0000 7f490dffb700 1 -- 172.21.15.49:0/34818609 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc00b8e0 con 0x7f4910158320 2023-11-30T17:07:44.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.955+0000 7f490f7fe700 1 --2- 172.21.15.49:0/34818609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48fc004b80 0x7f48fc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:44.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.955+0000 7f490effd700 1 --2- 172.21.15.49:0/34818609 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4910158320 0x7f48fc0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:44.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.955+0000 7f490e7fc700 1 --2- 172.21.15.49:0/34818609 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48fc003dd0 0x7f48fc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:44.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.955+0000 7f490f7fe700 1 -- 172.21.15.49:0/34818609 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4910158320 msgr2=0x7f48fc0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:44.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.955+0000 7f490f7fe700 1 --2- 172.21.15.49:0/34818609 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4910158320 0x7f48fc0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.955+0000 7f490f7fe700 1 -- 172.21.15.49:0/34818609 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48fc003dd0 msgr2=0x7f48fc004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:44.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.955+0000 7f490f7fe700 1 --2- 172.21.15.49:0/34818609 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48fc003dd0 0x7f48fc004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.955+0000 7f490f7fe700 1 -- 172.21.15.49:0/34818609 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc0033f0 con 0x7f48fc004b80 2023-11-30T17:07:44.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.955+0000 7f490f7fe700 1 --2- 172.21.15.49:0/34818609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48fc004b80 0x7f48fc005000 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f49000075b0 tx=0x7f49000097d0).ready entity=mon.0 client_cookie=88db8eb5698078e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:44.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.955+0000 7f490dffb700 1 -- 172.21.15.49:0/34818609 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900009ae0 con 0x7f48fc004b80 2023-11-30T17:07:44.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.955+0000 7f490dffb700 1 -- 172.21.15.49:0/34818609 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4900007e00 con 0x7f48fc004b80 2023-11-30T17:07:44.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.955+0000 7f490dffb700 1 -- 172.21.15.49:0/34818609 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900015660 con 0x7f48fc004b80 2023-11-30T17:07:44.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.956+0000 7f4915304700 1 -- 172.21.15.49:0/34818609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48fc004b80 msgr2=0x7f48fc005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:44.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.956+0000 7f4915304700 1 --2- 172.21.15.49:0/34818609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48fc004b80 0x7f48fc005000 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f49000075b0 tx=0x7f49000097d0).stop 2023-11-30T17:07:44.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.956+0000 7f490f7fe700 1 -- 172.21.15.49:0/34818609 reap_dead start 2023-11-30T17:07:44.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.956+0000 7f4915304700 1 -- 172.21.15.49:0/34818609 shutdown_connections 2023-11-30T17:07:44.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.956+0000 7f4915304700 1 -- 172.21.15.49:0/34818609 >> 172.21.15.49:0/34818609 conn(0x7f49100cb310 msgr2=0x7f49100cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:44.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.956+0000 7f4915304700 1 -- 172.21.15.49:0/34818609 shutdown_connections 2023-11-30T17:07:44.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.956+0000 7f4915304700 1 -- 172.21.15.49:0/34818609 wait complete. 2023-11-30T17:07:44.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.957+0000 7f4915304700 1 Processor -- start 2023-11-30T17:07:44.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.957+0000 7f4915304700 1 -- start start 2023-11-30T17:07:44.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.958+0000 7f4915304700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48fc004b80 0x7f4910149f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:44.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.958+0000 7f4915304700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f491014ad10 0x7f491014b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:44.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.958+0000 7f4915304700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4910168250 0x7f49101686d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:44.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.958+0000 7f4915304700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49100c88e0 con 0x7f491014ad10 2023-11-30T17:07:44.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.958+0000 7f4915304700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491014b680 con 0x7f48fc004b80 2023-11-30T17:07:44.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.958+0000 7f4915304700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49100c7d10 con 0x7f4910168250 2023-11-30T17:07:44.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.958+0000 7f490e7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f491014ad10 0x7f491014b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:44.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.958+0000 7f490e7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f491014ad10 0x7f491014b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59640/0 (socket says 172.21.15.49:59640) 2023-11-30T17:07:44.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.958+0000 7f490e7fc700 1 -- 172.21.15.49:0/1537114396 learned_addr learned my addr 172.21.15.49:0/1537114396 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:44.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.959+0000 7f490effd700 1 --2- 172.21.15.49:0/1537114396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48fc004b80 0x7f4910149f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:44.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.959+0000 7f490f7fe700 1 --2- 172.21.15.49:0/1537114396 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4910168250 0x7f49101686d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:44.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.959+0000 7f490e7fc700 1 -- 172.21.15.49:0/1537114396 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4910168250 msgr2=0x7f49101686d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:44.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.959+0000 7f490e7fc700 1 --2- 172.21.15.49:0/1537114396 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4910168250 0x7f49101686d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.959+0000 7f490e7fc700 1 -- 172.21.15.49:0/1537114396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48fc004b80 msgr2=0x7f4910149f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:44.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.959+0000 7f490e7fc700 1 --2- 172.21.15.49:0/1537114396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48fc004b80 0x7f4910149f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:44.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.959+0000 7f490e7fc700 1 -- 172.21.15.49:0/1537114396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49100c7fb0 con 0x7f491014ad10 2023-11-30T17:07:44.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.959+0000 7f490effd700 1 --2- 172.21.15.49:0/1537114396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48fc004b80 0x7f4910149f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:44.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.959+0000 7f490e7fc700 1 --2- 172.21.15.49:0/1537114396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f491014ad10 0x7f491014b190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f48f8011970 tx=0x7f48f8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:44.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.959+0000 7f4906ffd700 1 -- 172.21.15.49:0/1537114396 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f800f940 con 0x7f491014ad10 2023-11-30T17:07:44.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.959+0000 7f4906ffd700 1 -- 172.21.15.49:0/1537114396 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f800faa0 con 0x7f491014ad10 2023-11-30T17:07:44.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.959+0000 7f4915304700 1 -- 172.21.15.49:0/1537114396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49100c8290 con 0x7f491014ad10 2023-11-30T17:07:44.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.959+0000 7f4906ffd700 1 -- 172.21.15.49:0/1537114396 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f800fe20 con 0x7f491014ad10 2023-11-30T17:07:44.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.959+0000 7f4915304700 1 -- 172.21.15.49:0/1537114396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f491014a480 con 0x7f491014ad10 2023-11-30T17:07:44.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.960+0000 7f4915304700 1 -- 172.21.15.49:0/1537114396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49100c8a90 con 0x7f491014ad10 2023-11-30T17:07:44.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.960+0000 7f4906ffd700 1 -- 172.21.15.49:0/1537114396 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f48f8014650 con 0x7f491014ad10 2023-11-30T17:07:44.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.961+0000 7f4906ffd700 1 --2- 172.21.15.49:0/1537114396 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f48f005f150 0x7f48f0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:44.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.961+0000 7f4906ffd700 1 -- 172.21.15.49:0/1537114396 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f48f807ab00 con 0x7f491014ad10 2023-11-30T17:07:44.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.961+0000 7f490effd700 1 --2- 172.21.15.49:0/1537114396 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f48f005f150 0x7f48f0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:44.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.961+0000 7f490effd700 1 --2- 172.21.15.49:0/1537114396 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f48f005f150 0x7f48f0061610 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f49080079e0 tx=0x7f4908009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:44.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:44.965+0000 7f4906ffd700 1 -- 172.21.15.49:0/1537114396 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f49100c8a90 con 0x7f491014ad10 2023-11-30T17:07:45.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.135+0000 7f4915304700 1 -- 172.21.15.49:0/1537114396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f49100c8730 con 0x7f491014ad10 2023-11-30T17:07:45.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.135+0000 7f4906ffd700 1 -- 172.21.15.49:0/1537114396 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f48f8022030 con 0x7f491014ad10 2023-11-30T17:07:45.137 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T17:07:45.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.137+0000 7f4915304700 1 -- 172.21.15.49:0/1537114396 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f48f005f150 msgr2=0x7f48f0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:45.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.137+0000 7f4915304700 1 --2- 172.21.15.49:0/1537114396 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f48f005f150 0x7f48f0061610 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f49080079e0 tx=0x7f4908009040).stop 2023-11-30T17:07:45.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.137+0000 7f4915304700 1 -- 172.21.15.49:0/1537114396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f491014ad10 msgr2=0x7f491014b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:45.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.137+0000 7f4915304700 1 --2- 172.21.15.49:0/1537114396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f491014ad10 0x7f491014b190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f48f8011970 tx=0x7f48f8009060).stop 2023-11-30T17:07:45.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.137+0000 7f4915304700 1 -- 172.21.15.49:0/1537114396 shutdown_connections 2023-11-30T17:07:45.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.137+0000 7f4915304700 1 --2- 172.21.15.49:0/1537114396 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4910168250 0x7f49101686d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:45.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.137+0000 7f4915304700 1 --2- 172.21.15.49:0/1537114396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48fc004b80 0x7f4910149f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:45.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.137+0000 7f4915304700 1 --2- 172.21.15.49:0/1537114396 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f48f005f150 0x7f48f0061610 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:45.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.137+0000 7f4915304700 1 --2- 172.21.15.49:0/1537114396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f491014ad10 0x7f491014b190 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:45.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.137+0000 7f4915304700 1 -- 172.21.15.49:0/1537114396 >> 172.21.15.49:0/1537114396 conn(0x7f49100cb310 msgr2=0x7f4910154fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:45.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.137+0000 7f4915304700 1 -- 172.21.15.49:0/1537114396 shutdown_connections 2023-11-30T17:07:45.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.137+0000 7f4915304700 1 -- 172.21.15.49:0/1537114396 wait complete. 2023-11-30T17:07:45.151 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-30T17:07:45.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.270+0000 7f7558581700 1 Processor -- start 2023-11-30T17:07:45.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.270+0000 7f7558581700 1 -- start start 2023-11-30T17:07:45.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.271+0000 7f7558581700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7550098d10 0x7f75500c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:45.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.271+0000 7f7558581700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f75500c6190 0x7f7550063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:45.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.271+0000 7f7558581700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75500c72d0 con 0x7f7550064350 2023-11-30T17:07:45.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.271+0000 7f7558581700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7550154bc0 con 0x7f75500c6190 2023-11-30T17:07:45.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.271+0000 7f7558581700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75500c66c0 con 0x7f7550098d10 2023-11-30T17:07:45.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.272+0000 7f7555b1c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f75500c6190 0x7f7550063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:45.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.272+0000 7f7555b1c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f75500c6190 0x7f7550063e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59646/0 (socket says 172.21.15.49:59646) 2023-11-30T17:07:45.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.272+0000 7f7555b1c700 1 -- 172.21.15.49:0/2659760061 learned_addr learned my addr 172.21.15.49:0/2659760061 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:45.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.272+0000 7f755631d700 1 --2- 172.21.15.49:0/2659760061 >> v2:172.21.15.115:3300/0 conn(0x7f7550098d10 0x7f75500c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:45.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.272+0000 7f7555b1c700 1 -- 172.21.15.49:0/2659760061 >> v2:172.21.15.115:3300/0 conn(0x7f7550098d10 msgr2=0x7f75500c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:45.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.272+0000 7f7555b1c700 1 --2- 172.21.15.49:0/2659760061 >> v2:172.21.15.115:3300/0 conn(0x7f7550098d10 0x7f75500c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:45.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.272+0000 7f7555b1c700 1 -- 172.21.15.49:0/2659760061 >> v1:172.21.15.115:6789/0 conn(0x7f7550064350 legacy=0x7f7550158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:45.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.272+0000 7f7555b1c700 1 -- 172.21.15.49:0/2659760061 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75500c69a0 con 0x7f75500c6190 2023-11-30T17:07:45.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.272+0000 7f7555b1c700 1 --2- 172.21.15.49:0/2659760061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75500c6190 0x7f7550063e60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f7550083f80 tx=0x7f75440090f0).ready entity=mon.0 client_cookie=f73267d1bfb64867 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:45.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.272+0000 7f755531b700 1 -- 172.21.15.49:0/2659760061 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754400b600 con 0x7f75500c6190 2023-11-30T17:07:45.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.272+0000 7f755531b700 1 -- 172.21.15.49:0/2659760061 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754400b760 con 0x7f75500c6190 2023-11-30T17:07:45.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.272+0000 7f755531b700 1 -- 172.21.15.49:0/2659760061 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754400bae0 con 0x7f75500c6190 2023-11-30T17:07:45.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.273+0000 7f7558581700 1 -- 172.21.15.49:0/2659760061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75500c6190 msgr2=0x7f7550063e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:45.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.273+0000 7f7558581700 1 --2- 172.21.15.49:0/2659760061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75500c6190 0x7f7550063e60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f7550083f80 tx=0x7f75440090f0).stop 2023-11-30T17:07:45.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.273+0000 7f7558581700 1 -- 172.21.15.49:0/2659760061 shutdown_connections 2023-11-30T17:07:45.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.273+0000 7f7558581700 1 --2- 172.21.15.49:0/2659760061 >> v2:172.21.15.115:3300/0 conn(0x7f7550098d10 0x7f75500c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:45.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.273+0000 7f7558581700 1 --2- 172.21.15.49:0/2659760061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75500c6190 0x7f7550063e60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:45.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.273+0000 7f7558581700 1 -- 172.21.15.49:0/2659760061 >> 172.21.15.49:0/2659760061 conn(0x7f75500cb310 msgr2=0x7f75500cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:45.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.273+0000 7f7558581700 1 -- 172.21.15.49:0/2659760061 shutdown_connections 2023-11-30T17:07:45.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.273+0000 7f7558581700 1 -- 172.21.15.49:0/2659760061 wait complete. 2023-11-30T17:07:45.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.274+0000 7f7558581700 1 Processor -- start 2023-11-30T17:07:45.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.274+0000 7f7558581700 1 -- start start 2023-11-30T17:07:45.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.275+0000 7f7558581700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7550064350 0x7f75500c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:45.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.275+0000 7f7558581700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7550098d10 0x7f75500c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:45.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.275+0000 7f7558581700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75500c6190 0x7f75501687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:45.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.275+0000 7f7558581700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75500c29c0 con 0x7f7550064350 2023-11-30T17:07:45.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.275+0000 7f7558581700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75500c54c0 con 0x7f75500c6190 2023-11-30T17:07:45.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.275+0000 7f7558581700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75500c37e0 con 0x7f7550098d10 2023-11-30T17:07:45.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.275+0000 7f755631d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7550064350 0x7f75500c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:45.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.275+0000 7f755631d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7550064350 0x7f75500c24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59656/0 (socket says 172.21.15.49:59656) 2023-11-30T17:07:45.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.275+0000 7f755631d700 1 -- 172.21.15.49:0/2905132826 learned_addr learned my addr 172.21.15.49:0/2905132826 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:45.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.275+0000 7f7556b1e700 1 --2- 172.21.15.49:0/2905132826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75500c6190 0x7f75501687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:45.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.275+0000 7f7555b1c700 1 --2- 172.21.15.49:0/2905132826 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7550098d10 0x7f75500c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:45.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.275+0000 7f755631d700 1 -- 172.21.15.49:0/2905132826 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7550098d10 msgr2=0x7f75500c4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:45.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.275+0000 7f755631d700 1 --2- 172.21.15.49:0/2905132826 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7550098d10 0x7f75500c4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:45.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.275+0000 7f755631d700 1 -- 172.21.15.49:0/2905132826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75500c6190 msgr2=0x7f75501687b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:45.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.275+0000 7f755631d700 1 --2- 172.21.15.49:0/2905132826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75500c6190 0x7f75501687b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:45.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.275+0000 7f755631d700 1 -- 172.21.15.49:0/2905132826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7544009370 con 0x7f7550064350 2023-11-30T17:07:45.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.275+0000 7f7556b1e700 1 --2- 172.21.15.49:0/2905132826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75500c6190 0x7f75501687b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:45.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.275+0000 7f755631d700 1 --2- 172.21.15.49:0/2905132826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7550064350 0x7f75500c24d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f754800d8c0 tx=0x7f7548008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:45.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.275+0000 7f754e7fc700 1 -- 172.21.15.49:0/2905132826 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75480095b0 con 0x7f7550064350 2023-11-30T17:07:45.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.275+0000 7f754e7fc700 1 -- 172.21.15.49:0/2905132826 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7548009710 con 0x7f7550064350 2023-11-30T17:07:45.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.275+0000 7f7558581700 1 -- 172.21.15.49:0/2905132826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75500c2bd0 con 0x7f7550064350 2023-11-30T17:07:45.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.275+0000 7f754e7fc700 1 -- 172.21.15.49:0/2905132826 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7548009a90 con 0x7f7550064350 2023-11-30T17:07:45.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.276+0000 7f7558581700 1 -- 172.21.15.49:0/2905132826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75500c3190 con 0x7f7550064350 2023-11-30T17:07:45.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.276+0000 7f7558581700 1 -- 172.21.15.49:0/2905132826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f755006c860 con 0x7f7550064350 2023-11-30T17:07:45.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.277+0000 7f754e7fc700 1 -- 172.21.15.49:0/2905132826 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7548013480 con 0x7f7550064350 2023-11-30T17:07:45.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.277+0000 7f754e7fc700 1 --2- 172.21.15.49:0/2905132826 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f753c05f150 0x7f753c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:45.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.277+0000 7f754e7fc700 1 -- 172.21.15.49:0/2905132826 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f754807a020 con 0x7f7550064350 2023-11-30T17:07:45.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.278+0000 7f7555b1c700 1 --2- 172.21.15.49:0/2905132826 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f753c05f150 0x7f753c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:45.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.278+0000 7f7555b1c700 1 --2- 172.21.15.49:0/2905132826 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f753c05f150 0x7f753c061610 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f7550083f80 tx=0x7f7544017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:45.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.282+0000 7f754e7fc700 1 -- 172.21.15.49:0/2905132826 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f754804b290 con 0x7f7550064350 2023-11-30T17:07:45.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.454+0000 7f7558581700 1 -- 172.21.15.49:0/2905132826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f75500c6c80 con 0x7f7550064350 2023-11-30T17:07:45.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.454+0000 7f754e7fc700 1 -- 172.21.15.49:0/2905132826 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f754804e8b0 con 0x7f7550064350 2023-11-30T17:07:45.456 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T17:07:45.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.456+0000 7f7558581700 1 -- 172.21.15.49:0/2905132826 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f753c05f150 msgr2=0x7f753c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:45.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.456+0000 7f7558581700 1 --2- 172.21.15.49:0/2905132826 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f753c05f150 0x7f753c061610 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f7550083f80 tx=0x7f7544017000).stop 2023-11-30T17:07:45.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.456+0000 7f7558581700 1 -- 172.21.15.49:0/2905132826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7550064350 msgr2=0x7f75500c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:45.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.456+0000 7f7558581700 1 --2- 172.21.15.49:0/2905132826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7550064350 0x7f75500c24d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f754800d8c0 tx=0x7f7548008040).stop 2023-11-30T17:07:45.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.456+0000 7f7558581700 1 -- 172.21.15.49:0/2905132826 shutdown_connections 2023-11-30T17:07:45.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.456+0000 7f7558581700 1 --2- 172.21.15.49:0/2905132826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75500c6190 0x7f75501687b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:45.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.456+0000 7f7558581700 1 --2- 172.21.15.49:0/2905132826 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f753c05f150 0x7f753c061610 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:45.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.456+0000 7f7558581700 1 --2- 172.21.15.49:0/2905132826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7550064350 0x7f75500c24d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:45.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.456+0000 7f7558581700 1 --2- 172.21.15.49:0/2905132826 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7550098d10 0x7f75500c4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:45.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.456+0000 7f7558581700 1 -- 172.21.15.49:0/2905132826 >> 172.21.15.49:0/2905132826 conn(0x7f75500cb310 msgr2=0x7f75500ca6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:45.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.456+0000 7f7558581700 1 -- 172.21.15.49:0/2905132826 shutdown_connections 2023-11-30T17:07:45.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.456+0000 7f7558581700 1 -- 172.21.15.49:0/2905132826 wait complete. 2023-11-30T17:07:45.469 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-30T17:07:45.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.590+0000 7fd33935d700 1 Processor -- start 2023-11-30T17:07:45.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.590+0000 7fd33935d700 1 -- start start 2023-11-30T17:07:45.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.591+0000 7fd33935d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd334154650 0x7fd3340c6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:45.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.591+0000 7fd33935d700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3340c9730 con 0x7fd334154270 2023-11-30T17:07:45.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.591+0000 7fd33935d700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3340c99f0 con 0x7fd3340aa770 2023-11-30T17:07:45.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.591+0000 7fd33935d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3340c6b40 con 0x7fd334154650 2023-11-30T17:07:45.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.591+0000 7fd332ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd334154270 0x7fd3340aa060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51786/0 (socket says 172.21.15.49:51786) 2023-11-30T17:07:45.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.591+0000 7fd332ffd700 1 -- 172.21.15.49:0/134132034 learned_addr learned my addr 172.21.15.49:0/134132034 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:45.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.591+0000 7fd3327fc700 1 --2- 172.21.15.49:0/134132034 >> v2:172.21.15.115:3300/0 conn(0x7fd334154650 0x7fd3340c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:45.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.591+0000 7fd331ffb700 1 -- 172.21.15.49:0/134132034 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2248593411 0 0) 0x7fd3340c9730 con 0x7fd334154270 2023-11-30T17:07:45.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.591+0000 7fd331ffb700 1 -- 172.21.15.49:0/134132034 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3200033f0 con 0x7fd334154270 2023-11-30T17:07:45.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.592+0000 7fd331ffb700 1 -- 172.21.15.49:0/134132034 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3535932294 0 0) 0x7fd3200033f0 con 0x7fd334154270 2023-11-30T17:07:45.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.592+0000 7fd3327fc700 1 -- 172.21.15.49:0/134132034 >> v1:172.21.15.115:6789/0 conn(0x7fd3340aa770 legacy=0x7fd3340c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:45.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.592+0000 7fd3327fc700 1 -- 172.21.15.49:0/134132034 >> v1:172.21.15.49:6789/0 conn(0x7fd334154270 legacy=0x7fd3340aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:45.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.592+0000 7fd3327fc700 1 -- 172.21.15.49:0/134132034 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3341586d0 con 0x7fd334154650 2023-11-30T17:07:45.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.592+0000 7fd3327fc700 1 --2- 172.21.15.49:0/134132034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd334154650 0x7fd3340c6650 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fd31c009760 tx=0x7fd31c009060).ready entity=mon.1 client_cookie=542723185a470b80 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:45.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.592+0000 7fd331ffb700 1 -- 172.21.15.49:0/134132034 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c001470 con 0x7fd334154650 2023-11-30T17:07:45.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.592+0000 7fd331ffb700 1 -- 172.21.15.49:0/134132034 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31c009130 con 0x7fd334154650 2023-11-30T17:07:45.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.592+0000 7fd331ffb700 1 -- 172.21.15.49:0/134132034 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c011610 con 0x7fd334154650 2023-11-30T17:07:45.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.592+0000 7fd33935d700 1 -- 172.21.15.49:0/134132034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd334154650 msgr2=0x7fd3340c6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:45.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.592+0000 7fd33935d700 1 --2- 172.21.15.49:0/134132034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd334154650 0x7fd3340c6650 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fd31c009760 tx=0x7fd31c009060).stop 2023-11-30T17:07:45.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.592+0000 7fd33935d700 1 -- 172.21.15.49:0/134132034 shutdown_connections 2023-11-30T17:07:45.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.592+0000 7fd33935d700 1 --2- 172.21.15.49:0/134132034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd334154650 0x7fd3340c6650 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:45.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.592+0000 7fd33935d700 1 -- 172.21.15.49:0/134132034 >> 172.21.15.49:0/134132034 conn(0x7fd3340649b0 msgr2=0x7fd334064dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:45.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.593+0000 7fd33935d700 1 -- 172.21.15.49:0/134132034 shutdown_connections 2023-11-30T17:07:45.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.593+0000 7fd33935d700 1 -- 172.21.15.49:0/134132034 wait complete. 2023-11-30T17:07:45.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.594+0000 7fd33935d700 1 Processor -- start 2023-11-30T17:07:45.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.594+0000 7fd33935d700 1 -- start start 2023-11-30T17:07:45.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.594+0000 7fd33935d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3340aa770 0x7fd3340b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:45.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.594+0000 7fd33935d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd334154270 0x7fd3340c2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:45.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.594+0000 7fd33935d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd334154650 0x7fd3340c2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:45.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.595+0000 7fd33935d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3340c2b30 con 0x7fd3340aa770 2023-11-30T17:07:45.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.595+0000 7fd33935d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3340aeaf0 con 0x7fd334154650 2023-11-30T17:07:45.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.595+0000 7fd33935d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd334156ad0 con 0x7fd334154270 2023-11-30T17:07:45.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.595+0000 7fd332ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3340aa770 0x7fd3340b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:45.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.595+0000 7fd332ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3340aa770 0x7fd3340b0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59658/0 (socket says 172.21.15.49:59658) 2023-11-30T17:07:45.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.595+0000 7fd332ffd700 1 -- 172.21.15.49:0/2076181295 learned_addr learned my addr 172.21.15.49:0/2076181295 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:45.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.595+0000 7fd3337fe700 1 --2- 172.21.15.49:0/2076181295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd334154650 0x7fd3340c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:45.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.595+0000 7fd3327fc700 1 --2- 172.21.15.49:0/2076181295 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd334154270 0x7fd3340c2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:45.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.595+0000 7fd332ffd700 1 -- 172.21.15.49:0/2076181295 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd334154270 msgr2=0x7fd3340c2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:45.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.595+0000 7fd332ffd700 1 --2- 172.21.15.49:0/2076181295 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd334154270 0x7fd3340c2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:45.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.595+0000 7fd332ffd700 1 -- 172.21.15.49:0/2076181295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd334154650 msgr2=0x7fd3340c2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:45.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.595+0000 7fd332ffd700 1 --2- 172.21.15.49:0/2076181295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd334154650 0x7fd3340c2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:45.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.595+0000 7fd332ffd700 1 -- 172.21.15.49:0/2076181295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31c0092a0 con 0x7fd3340aa770 2023-11-30T17:07:45.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.595+0000 7fd3337fe700 1 --2- 172.21.15.49:0/2076181295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd334154650 0x7fd3340c2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:45.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.595+0000 7fd332ffd700 1 --2- 172.21.15.49:0/2076181295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3340aa770 0x7fd3340b0b00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fd32c00c760 tx=0x7fd32c001ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:45.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.595+0000 7fd32affd700 1 -- 172.21.15.49:0/2076181295 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c007170 con 0x7fd3340aa770 2023-11-30T17:07:45.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.595+0000 7fd32affd700 1 -- 172.21.15.49:0/2076181295 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32c0072d0 con 0x7fd3340aa770 2023-11-30T17:07:45.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.595+0000 7fd33935d700 1 -- 172.21.15.49:0/2076181295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd334156db0 con 0x7fd3340aa770 2023-11-30T17:07:45.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.595+0000 7fd32affd700 1 -- 172.21.15.49:0/2076181295 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c0048c0 con 0x7fd3340aa770 2023-11-30T17:07:45.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.595+0000 7fd33935d700 1 -- 172.21.15.49:0/2076181295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd334157370 con 0x7fd3340aa770 2023-11-30T17:07:45.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.596+0000 7fd33935d700 1 -- 172.21.15.49:0/2076181295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd334062f00 con 0x7fd3340aa770 2023-11-30T17:07:45.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.597+0000 7fd32affd700 1 -- 172.21.15.49:0/2076181295 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd32c004c30 con 0x7fd3340aa770 2023-11-30T17:07:45.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.597+0000 7fd32affd700 1 --2- 172.21.15.49:0/2076181295 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd31405f150 0x7fd314061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:45.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.597+0000 7fd32affd700 1 -- 172.21.15.49:0/2076181295 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd32c079dc0 con 0x7fd3340aa770 2023-11-30T17:07:45.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.597+0000 7fd3327fc700 1 --2- 172.21.15.49:0/2076181295 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd31405f150 0x7fd314061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:45.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.598+0000 7fd3327fc700 1 --2- 172.21.15.49:0/2076181295 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd31405f150 0x7fd314061610 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fd334154a50 tx=0x7fd31c014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:45.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.601+0000 7fd32affd700 1 -- 172.21.15.49:0/2076181295 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd32c04b090 con 0x7fd3340aa770 2023-11-30T17:07:45.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.773+0000 7fd33935d700 1 -- 172.21.15.49:0/2076181295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd33406c7c0 con 0x7fd3340aa770 2023-11-30T17:07:45.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.774+0000 7fd32affd700 1 -- 172.21.15.49:0/2076181295 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd32c019030 con 0x7fd3340aa770 2023-11-30T17:07:45.776 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T17:07:45.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.776+0000 7fd33935d700 1 -- 172.21.15.49:0/2076181295 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd31405f150 msgr2=0x7fd314061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:45.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.776+0000 7fd33935d700 1 --2- 172.21.15.49:0/2076181295 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd31405f150 0x7fd314061610 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fd334154a50 tx=0x7fd31c014000).stop 2023-11-30T17:07:45.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.776+0000 7fd33935d700 1 -- 172.21.15.49:0/2076181295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3340aa770 msgr2=0x7fd3340b0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:45.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.776+0000 7fd33935d700 1 --2- 172.21.15.49:0/2076181295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3340aa770 0x7fd3340b0b00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fd32c00c760 tx=0x7fd32c001ad0).stop 2023-11-30T17:07:45.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.776+0000 7fd33935d700 1 -- 172.21.15.49:0/2076181295 shutdown_connections 2023-11-30T17:07:45.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.776+0000 7fd33935d700 1 --2- 172.21.15.49:0/2076181295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd334154650 0x7fd3340c2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:45.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.776+0000 7fd33935d700 1 --2- 172.21.15.49:0/2076181295 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd31405f150 0x7fd314061610 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:45.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.776+0000 7fd33935d700 1 --2- 172.21.15.49:0/2076181295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3340aa770 0x7fd3340b0b00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:45.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.776+0000 7fd33935d700 1 --2- 172.21.15.49:0/2076181295 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd334154270 0x7fd3340c2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:45.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.776+0000 7fd33935d700 1 -- 172.21.15.49:0/2076181295 >> 172.21.15.49:0/2076181295 conn(0x7fd3340649b0 msgr2=0x7fd33414dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:45.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.776+0000 7fd33935d700 1 -- 172.21.15.49:0/2076181295 shutdown_connections 2023-11-30T17:07:45.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.776+0000 7fd33935d700 1 -- 172.21.15.49:0/2076181295 wait complete. 2023-11-30T17:07:45.789 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:07:45.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.905+0000 7f07b3354700 1 Processor -- start 2023-11-30T17:07:45.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.905+0000 7f07b3354700 1 -- start start 2023-11-30T17:07:45.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.906+0000 7f07b3354700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07ac0c0180 0x7f07ac157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:45.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.906+0000 7f07b3354700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f07ac0c1750 0x7f07ac0c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:45.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.906+0000 7f07b3354700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07ac0c12c0 con 0x7f07ac157660 2023-11-30T17:07:45.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.906+0000 7f07b3354700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07ac0c06b0 con 0x7f07ac0c1750 2023-11-30T17:07:45.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.906+0000 7f07b3354700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac0c0990 con 0x7f07ac0c0180 2023-11-30T17:07:45.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.906+0000 7f07b2352700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f07ac157660 0x7f07ac1589c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51790/0 (socket says 172.21.15.49:51790) 2023-11-30T17:07:45.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.906+0000 7f07b2352700 1 -- 172.21.15.49:0/2625834628 learned_addr learned my addr 172.21.15.49:0/2625834628 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:45.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.906+0000 7f07b2b53700 1 --2- 172.21.15.49:0/2625834628 >> v2:172.21.15.49:3300/0 conn(0x7f07ac0c1750 0x7f07ac0c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:45.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.906+0000 7f07b1b51700 1 --2- 172.21.15.49:0/2625834628 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07ac0c0180 0x7f07ac157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:45.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.906+0000 7f07b1350700 1 -- 172.21.15.49:0/2625834628 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1766820099 0 0) 0x7f07ac0c12c0 con 0x7f07ac157660 2023-11-30T17:07:45.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.906+0000 7f07b1350700 1 -- 172.21.15.49:0/2625834628 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07980033f0 con 0x7f07ac157660 2023-11-30T17:07:45.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.906+0000 7f07b2b53700 1 -- 172.21.15.49:0/2625834628 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07ac0c0180 msgr2=0x7f07ac157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:45.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.906+0000 7f07b2b53700 1 --2- 172.21.15.49:0/2625834628 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07ac0c0180 0x7f07ac157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:45.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.906+0000 7f07b2b53700 1 -- 172.21.15.49:0/2625834628 >> v1:172.21.15.49:6789/0 conn(0x7f07ac157660 legacy=0x7f07ac1589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:45.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.906+0000 7f07b2b53700 1 -- 172.21.15.49:0/2625834628 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ac0c0c70 con 0x7f07ac0c1750 2023-11-30T17:07:45.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.906+0000 7f07b2b53700 1 --2- 172.21.15.49:0/2625834628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ac0c1750 0x7f07ac0c1ba0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f07a4009e60 tx=0x7f07a4009780).ready entity=mon.0 client_cookie=f8e24f2bbff23826 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:45.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.907+0000 7f07b1350700 1 -- 172.21.15.49:0/2625834628 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a400e070 con 0x7f07ac0c1750 2023-11-30T17:07:45.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.907+0000 7f07b1350700 1 -- 172.21.15.49:0/2625834628 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a400bab0 con 0x7f07ac0c1750 2023-11-30T17:07:45.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.907+0000 7f07b1350700 1 -- 172.21.15.49:0/2625834628 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a400be30 con 0x7f07ac0c1750 2023-11-30T17:07:45.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.907+0000 7f07b3354700 1 -- 172.21.15.49:0/2625834628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ac0c1750 msgr2=0x7f07ac0c1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:45.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.907+0000 7f07b3354700 1 --2- 172.21.15.49:0/2625834628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ac0c1750 0x7f07ac0c1ba0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f07a4009e60 tx=0x7f07a4009780).stop 2023-11-30T17:07:45.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.907+0000 7f07b3354700 1 -- 172.21.15.49:0/2625834628 shutdown_connections 2023-11-30T17:07:45.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.907+0000 7f07b3354700 1 --2- 172.21.15.49:0/2625834628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ac0c1750 0x7f07ac0c1ba0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:45.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.907+0000 7f07b3354700 1 --2- 172.21.15.49:0/2625834628 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07ac0c0180 0x7f07ac157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:45.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.907+0000 7f07b3354700 1 -- 172.21.15.49:0/2625834628 >> 172.21.15.49:0/2625834628 conn(0x7f07ac0cb000 msgr2=0x7f07ac0cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:45.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.907+0000 7f07b3354700 1 -- 172.21.15.49:0/2625834628 shutdown_connections 2023-11-30T17:07:45.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.907+0000 7f07b3354700 1 -- 172.21.15.49:0/2625834628 wait complete. 2023-11-30T17:07:45.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.908+0000 7f07b3354700 1 Processor -- start 2023-11-30T17:07:45.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.908+0000 7f07b3354700 1 -- start start 2023-11-30T17:07:45.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.909+0000 7f07b3354700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07ac0c0180 0x7f07ac0c3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:45.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.909+0000 7f07b3354700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07ac0c1750 0x7f07ac14e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:45.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.909+0000 7f07b3354700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ac157660 0x7f07ac0ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:45.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.909+0000 7f07b3354700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac0af930 con 0x7f07ac157660 2023-11-30T17:07:45.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.909+0000 7f07b3354700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac0c4e10 con 0x7f07ac0c1750 2023-11-30T17:07:45.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.909+0000 7f07b3354700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac0c4980 con 0x7f07ac0c0180 2023-11-30T17:07:45.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.909+0000 7f07b2b53700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ac157660 0x7f07ac0ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:45.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.909+0000 7f07b2b53700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ac157660 0x7f07ac0ac3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59680/0 (socket says 172.21.15.49:59680) 2023-11-30T17:07:45.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.909+0000 7f07b2b53700 1 -- 172.21.15.49:0/1833949429 learned_addr learned my addr 172.21.15.49:0/1833949429 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:45.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.909+0000 7f07b2352700 1 --2- 172.21.15.49:0/1833949429 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07ac0c0180 0x7f07ac0c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:45.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.909+0000 7f07b1b51700 1 --2- 172.21.15.49:0/1833949429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07ac0c1750 0x7f07ac14e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:45.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.909+0000 7f07b2b53700 1 -- 172.21.15.49:0/1833949429 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07ac0c0180 msgr2=0x7f07ac0c3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:45.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.909+0000 7f07b2b53700 1 --2- 172.21.15.49:0/1833949429 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07ac0c0180 0x7f07ac0c3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:45.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.910+0000 7f07b2b53700 1 -- 172.21.15.49:0/1833949429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07ac0c1750 msgr2=0x7f07ac14e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:45.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.910+0000 7f07b2b53700 1 --2- 172.21.15.49:0/1833949429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07ac0c1750 0x7f07ac14e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:45.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.910+0000 7f07b2b53700 1 -- 172.21.15.49:0/1833949429 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a4009a20 con 0x7f07ac157660 2023-11-30T17:07:45.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.910+0000 7f07b2352700 1 --2- 172.21.15.49:0/1833949429 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07ac0c0180 0x7f07ac0c3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:45.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.910+0000 7f07b1b51700 1 --2- 172.21.15.49:0/1833949429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07ac0c1750 0x7f07ac14e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:45.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.910+0000 7f07b2b53700 1 --2- 172.21.15.49:0/1833949429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ac157660 0x7f07ac0ac3e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f07a400b610 tx=0x7f07a4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:45.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.910+0000 7f07a27fc700 1 -- 172.21.15.49:0/1833949429 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a401d630 con 0x7f07ac157660 2023-11-30T17:07:45.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.910+0000 7f07a27fc700 1 -- 172.21.15.49:0/1833949429 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a401d790 con 0x7f07ac157660 2023-11-30T17:07:45.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.910+0000 7f07b3354700 1 -- 172.21.15.49:0/1833949429 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07ac0c3d70 con 0x7f07ac157660 2023-11-30T17:07:45.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.910+0000 7f07a27fc700 1 -- 172.21.15.49:0/1833949429 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a401db30 con 0x7f07ac157660 2023-11-30T17:07:45.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.910+0000 7f07b3354700 1 -- 172.21.15.49:0/1833949429 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07ac0c4330 con 0x7f07ac157660 2023-11-30T17:07:45.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.911+0000 7f07b3354700 1 -- 172.21.15.49:0/1833949429 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07ac06c7c0 con 0x7f07ac157660 2023-11-30T17:07:45.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.911+0000 7f07a27fc700 1 -- 172.21.15.49:0/1833949429 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f07a4003040 con 0x7f07ac157660 2023-11-30T17:07:45.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.911+0000 7f07a27fc700 1 --2- 172.21.15.49:0/1833949429 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f079005f150 0x7f0790061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:45.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.912+0000 7f07a27fc700 1 -- 172.21.15.49:0/1833949429 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f07a407bfc0 con 0x7f07ac157660 2023-11-30T17:07:45.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.912+0000 7f07b2352700 1 --2- 172.21.15.49:0/1833949429 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f079005f150 0x7f0790061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:45.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.912+0000 7f07b2352700 1 --2- 172.21.15.49:0/1833949429 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f079005f150 0x7f0790061610 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f07a8005750 tx=0x7f07a8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:45.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:45.916+0000 7f07a27fc700 1 -- 172.21.15.49:0/1833949429 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f07a40aab00 con 0x7f07ac157660 2023-11-30T17:07:46.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.088+0000 7f07b3354700 1 -- 172.21.15.49:0/1833949429 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07ac0c4ac0 con 0x7f07ac157660 2023-11-30T17:07:46.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.089+0000 7f07a27fc700 1 -- 172.21.15.49:0/1833949429 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f07a404d290 con 0x7f07ac157660 2023-11-30T17:07:46.091 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:46.091 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":22,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:07:17.283998+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:07:14.837882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-30T17:07:15.248549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:07:46.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.091+0000 7f07b3354700 1 -- 172.21.15.49:0/1833949429 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f079005f150 msgr2=0x7f0790061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:46.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.091+0000 7f07b3354700 1 --2- 172.21.15.49:0/1833949429 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f079005f150 0x7f0790061610 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f07a8005750 tx=0x7f07a8009040).stop 2023-11-30T17:07:46.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.091+0000 7f07b3354700 1 -- 172.21.15.49:0/1833949429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ac157660 msgr2=0x7f07ac0ac3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:46.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.091+0000 7f07b3354700 1 --2- 172.21.15.49:0/1833949429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ac157660 0x7f07ac0ac3e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f07a400b610 tx=0x7f07a4009780).stop 2023-11-30T17:07:46.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.091+0000 7f07b3354700 1 -- 172.21.15.49:0/1833949429 shutdown_connections 2023-11-30T17:07:46.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.091+0000 7f07b3354700 1 --2- 172.21.15.49:0/1833949429 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f079005f150 0x7f0790061610 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:46.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.091+0000 7f07b3354700 1 --2- 172.21.15.49:0/1833949429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ac157660 0x7f07ac0ac3e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:46.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.091+0000 7f07b3354700 1 --2- 172.21.15.49:0/1833949429 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07ac0c0180 0x7f07ac0c3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:46.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.091+0000 7f07b3354700 1 --2- 172.21.15.49:0/1833949429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07ac0c1750 0x7f07ac14e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:46.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.091+0000 7f07b3354700 1 -- 172.21.15.49:0/1833949429 >> 172.21.15.49:0/1833949429 conn(0x7f07ac0cb000 msgr2=0x7f07ac0ca740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:46.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.091+0000 7f07b3354700 1 -- 172.21.15.49:0/1833949429 shutdown_connections 2023-11-30T17:07:46.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.091+0000 7f07b3354700 1 -- 172.21.15.49:0/1833949429 wait complete. 2023-11-30T17:07:46.105 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-30T17:07:14.837882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-30T17:07:15.248549+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-30T17:07:46.106 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T17:07:46.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.224+0000 7f9282245700 1 Processor -- start 2023-11-30T17:07:46.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.225+0000 7f9282245700 1 -- start start 2023-11-30T17:07:46.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.225+0000 7f9282245700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f927c0c0250 0x7f927c0c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:46.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.225+0000 7f9282245700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f927c0ca3c0 0x7f927c0c1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:46.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.225+0000 7f9282245700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f927c0c12f0 con 0x7f927c157c10 2023-11-30T17:07:46.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.225+0000 7f9282245700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f927c0a8790 con 0x7f927c0c0250 2023-11-30T17:07:46.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.225+0000 7f9282245700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f927c0c06e0 con 0x7f927c0ca3c0 2023-11-30T17:07:46.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.226+0000 7f927bfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f927c0ca3c0 0x7f927c0c1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:46.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.226+0000 7f927affd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f927c0c0250 0x7f927c0c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:46.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.226+0000 7f927bfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f927c0ca3c0 0x7f927c0c1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:35386/0 (socket says 172.21.15.49:35386) 2023-11-30T17:07:46.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.226+0000 7f927bfff700 1 -- 172.21.15.49:0/3488203407 learned_addr learned my addr 172.21.15.49:0/3488203407 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:46.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.226+0000 7f927bfff700 1 -- 172.21.15.49:0/3488203407 >> v2:172.21.15.115:3300/0 conn(0x7f927c0c0250 msgr2=0x7f927c0c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:46.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.226+0000 7f927bfff700 1 --2- 172.21.15.49:0/3488203407 >> v2:172.21.15.115:3300/0 conn(0x7f927c0c0250 0x7f927c0c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:46.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.226+0000 7f927bfff700 1 -- 172.21.15.49:0/3488203407 >> v1:172.21.15.115:6789/0 conn(0x7f927c157c10 legacy=0x7f927c0a8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:46.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.226+0000 7f927bfff700 1 -- 172.21.15.49:0/3488203407 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927c0c09c0 con 0x7f927c0ca3c0 2023-11-30T17:07:46.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.226+0000 7f927affd700 1 --2- 172.21.15.49:0/3488203407 >> v2:172.21.15.115:3300/0 conn(0x7f927c0c0250 0x7f927c0c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:07:46.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.226+0000 7f927bfff700 1 --2- 172.21.15.49:0/3488203407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f927c0ca3c0 0x7f927c0c1780 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f9274009f20 tx=0x7f9274009840).ready entity=mon.2 client_cookie=c09ec62bed50e124 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:46.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.227+0000 7f927a7fc700 1 -- 172.21.15.49:0/3488203407 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927400e070 con 0x7f927c0ca3c0 2023-11-30T17:07:46.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.227+0000 7f927a7fc700 1 -- 172.21.15.49:0/3488203407 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927400b9d0 con 0x7f927c0ca3c0 2023-11-30T17:07:46.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.227+0000 7f927a7fc700 1 -- 172.21.15.49:0/3488203407 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927400bd50 con 0x7f927c0ca3c0 2023-11-30T17:07:46.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.227+0000 7f9282245700 1 -- 172.21.15.49:0/3488203407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f927c0ca3c0 msgr2=0x7f927c0c1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:46.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.227+0000 7f9282245700 1 --2- 172.21.15.49:0/3488203407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f927c0ca3c0 0x7f927c0c1780 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f9274009f20 tx=0x7f9274009840).stop 2023-11-30T17:07:46.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.227+0000 7f9282245700 1 -- 172.21.15.49:0/3488203407 shutdown_connections 2023-11-30T17:07:46.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.227+0000 7f9282245700 1 --2- 172.21.15.49:0/3488203407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f927c0ca3c0 0x7f927c0c1780 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:46.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.227+0000 7f9282245700 1 --2- 172.21.15.49:0/3488203407 >> v2:172.21.15.115:3300/0 conn(0x7f927c0c0250 0x7f927c0c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:46.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.227+0000 7f9282245700 1 -- 172.21.15.49:0/3488203407 >> 172.21.15.49:0/3488203407 conn(0x7f927c06a610 msgr2=0x7f927c0cb2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:46.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.227+0000 7f9282245700 1 -- 172.21.15.49:0/3488203407 shutdown_connections 2023-11-30T17:07:46.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.227+0000 7f9282245700 1 -- 172.21.15.49:0/3488203407 wait complete. 2023-11-30T17:07:46.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.228+0000 7f9282245700 1 Processor -- start 2023-11-30T17:07:46.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.228+0000 7f9282245700 1 -- start start 2023-11-30T17:07:46.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.229+0000 7f9282245700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f927c0ca3c0 0x7f927c150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:46.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.229+0000 7f9282245700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f927c157c10 0x7f927c0aa260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:46.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.229+0000 7f9282245700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f927c0aa750 0x7f927c153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:46.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.229+0000 7f9282245700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c0aabb0 con 0x7f927c157c10 2023-11-30T17:07:46.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.229+0000 7f9282245700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c0c4c30 con 0x7f927c0ca3c0 2023-11-30T17:07:46.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.229+0000 7f9282245700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f927c0c4020 con 0x7f927c0aa750 2023-11-30T17:07:46.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.229+0000 7f927affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f927c157c10 0x7f927c0aa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:46.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.229+0000 7f927affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f927c157c10 0x7f927c0aa260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59696/0 (socket says 172.21.15.49:59696) 2023-11-30T17:07:46.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.229+0000 7f927affd700 1 -- 172.21.15.49:0/297131147 learned_addr learned my addr 172.21.15.49:0/297131147 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:46.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.229+0000 7f927b7fe700 1 --2- 172.21.15.49:0/297131147 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f927c0ca3c0 0x7f927c150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:46.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.229+0000 7f927bfff700 1 --2- 172.21.15.49:0/297131147 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f927c0aa750 0x7f927c153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:46.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.230+0000 7f927affd700 1 -- 172.21.15.49:0/297131147 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f927c0aa750 msgr2=0x7f927c153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:46.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.230+0000 7f927affd700 1 --2- 172.21.15.49:0/297131147 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f927c0aa750 0x7f927c153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:46.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.230+0000 7f927affd700 1 -- 172.21.15.49:0/297131147 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f927c0ca3c0 msgr2=0x7f927c150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:46.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.230+0000 7f927affd700 1 --2- 172.21.15.49:0/297131147 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f927c0ca3c0 0x7f927c150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:46.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.230+0000 7f927affd700 1 -- 172.21.15.49:0/297131147 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92700092a0 con 0x7f927c157c10 2023-11-30T17:07:46.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.230+0000 7f927affd700 1 --2- 172.21.15.49:0/297131147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f927c157c10 0x7f927c0aa260 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f927000e980 tx=0x7f9270009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:46.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.230+0000 7f92637fe700 1 -- 172.21.15.49:0/297131147 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9270012600 con 0x7f927c157c10 2023-11-30T17:07:46.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.230+0000 7f92637fe700 1 -- 172.21.15.49:0/297131147 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9270012760 con 0x7f927c157c10 2023-11-30T17:07:46.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.230+0000 7f9282245700 1 -- 172.21.15.49:0/297131147 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9274009ae0 con 0x7f927c157c10 2023-11-30T17:07:46.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.230+0000 7f92637fe700 1 -- 172.21.15.49:0/297131147 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9270012ae0 con 0x7f927c157c10 2023-11-30T17:07:46.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.230+0000 7f9282245700 1 -- 172.21.15.49:0/297131147 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f927c0c45e0 con 0x7f927c157c10 2023-11-30T17:07:46.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.231+0000 7f9282245700 1 -- 172.21.15.49:0/297131147 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f927c0c4dc0 con 0x7f927c157c10 2023-11-30T17:07:46.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.231+0000 7f92637fe700 1 -- 172.21.15.49:0/297131147 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f927001b400 con 0x7f927c157c10 2023-11-30T17:07:46.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.232+0000 7f92637fe700 1 --2- 172.21.15.49:0/297131147 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f926805f150 0x7f9268061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:46.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.232+0000 7f92637fe700 1 -- 172.21.15.49:0/297131147 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f927007a680 con 0x7f927c157c10 2023-11-30T17:07:46.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.232+0000 7f927b7fe700 1 --2- 172.21.15.49:0/297131147 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f926805f150 0x7f9268061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:46.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.232+0000 7f927b7fe700 1 --2- 172.21.15.49:0/297131147 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f926805f150 0x7f9268061610 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f926c007fd0 tx=0x7f926c007d30).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:46.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.236+0000 7f92637fe700 1 -- 172.21.15.49:0/297131147 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f927004b8f0 con 0x7f927c157c10 2023-11-30T17:07:46.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.409+0000 7f9282245700 1 -- 172.21.15.49:0/297131147 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f927c06c860 con 0x7f927c157c10 2023-11-30T17:07:46.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.409+0000 7f92637fe700 1 -- 172.21.15.49:0/297131147 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f927004ef10 con 0x7f927c157c10 2023-11-30T17:07:46.411 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T17:07:46.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.411+0000 7f9282245700 1 -- 172.21.15.49:0/297131147 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f926805f150 msgr2=0x7f9268061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:46.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.411+0000 7f9282245700 1 --2- 172.21.15.49:0/297131147 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f926805f150 0x7f9268061610 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f926c007fd0 tx=0x7f926c007d30).stop 2023-11-30T17:07:46.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.411+0000 7f9282245700 1 -- 172.21.15.49:0/297131147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f927c157c10 msgr2=0x7f927c0aa260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:46.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.411+0000 7f9282245700 1 --2- 172.21.15.49:0/297131147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f927c157c10 0x7f927c0aa260 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f927000e980 tx=0x7f9270009060).stop 2023-11-30T17:07:46.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.411+0000 7f9282245700 1 -- 172.21.15.49:0/297131147 shutdown_connections 2023-11-30T17:07:46.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.411+0000 7f9282245700 1 --2- 172.21.15.49:0/297131147 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f927c0aa750 0x7f927c153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:46.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.411+0000 7f9282245700 1 --2- 172.21.15.49:0/297131147 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f927c0ca3c0 0x7f927c150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:46.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.411+0000 7f9282245700 1 --2- 172.21.15.49:0/297131147 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f926805f150 0x7f9268061610 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:46.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.411+0000 7f9282245700 1 --2- 172.21.15.49:0/297131147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f927c157c10 0x7f927c0aa260 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:46.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.411+0000 7f9282245700 1 -- 172.21.15.49:0/297131147 >> 172.21.15.49:0/297131147 conn(0x7f927c06a610 msgr2=0x7f927c0c97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:46.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.411+0000 7f9282245700 1 -- 172.21.15.49:0/297131147 shutdown_connections 2023-11-30T17:07:46.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.411+0000 7f9282245700 1 -- 172.21.15.49:0/297131147 wait complete. 2023-11-30T17:07:46.424 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T17:07:46.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.543+0000 7f22b1eb2700 1 Processor -- start 2023-11-30T17:07:46.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.543+0000 7f22b1eb2700 1 -- start start 2023-11-30T17:07:46.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.544+0000 7f22b1eb2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f22ac0c6190 0x7f22ac0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:46.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.544+0000 7f22b1eb2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22ac158320 0x7f22ac1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:46.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.544+0000 7f22b1eb2700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22ac158cc0 con 0x7f22ac098d10 2023-11-30T17:07:46.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.544+0000 7f22b1eb2700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ac0c72d0 con 0x7f22ac0c6190 2023-11-30T17:07:46.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.544+0000 7f22b1eb2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac064570 con 0x7f22ac158320 2023-11-30T17:07:46.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.544+0000 7f22aaffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f22ac0c6190 0x7f22ac0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:46.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.544+0000 7f22aaffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f22ac0c6190 0x7f22ac0c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59704/0 (socket says 172.21.15.49:59704) 2023-11-30T17:07:46.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.544+0000 7f22aaffd700 1 -- 172.21.15.49:0/2800048964 learned_addr learned my addr 172.21.15.49:0/2800048964 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:46.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.544+0000 7f22abfff700 1 --2- 172.21.15.49:0/2800048964 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22ac158320 0x7f22ac1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:46.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.545+0000 7f22aaffd700 1 -- 172.21.15.49:0/2800048964 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22ac158320 msgr2=0x7f22ac1587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:46.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.545+0000 7f22aaffd700 1 --2- 172.21.15.49:0/2800048964 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22ac158320 0x7f22ac1587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:46.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.545+0000 7f22aaffd700 1 -- 172.21.15.49:0/2800048964 >> v1:172.21.15.115:6789/0 conn(0x7f22ac098d10 legacy=0x7f22ac063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:46.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.545+0000 7f22aaffd700 1 -- 172.21.15.49:0/2800048964 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ac154bc0 con 0x7f22ac0c6190 2023-11-30T17:07:46.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.545+0000 7f22aaffd700 1 --2- 172.21.15.49:0/2800048964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22ac0c6190 0x7f22ac0c7760 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f22a0006fd0 tx=0x7f22a00090f0).ready entity=mon.0 client_cookie=aa9e23c93e08ef4d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:46.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.545+0000 7f22aa7fc700 1 -- 172.21.15.49:0/2800048964 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a000b580 con 0x7f22ac0c6190 2023-11-30T17:07:46.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.545+0000 7f22aa7fc700 1 -- 172.21.15.49:0/2800048964 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a000b6e0 con 0x7f22ac0c6190 2023-11-30T17:07:46.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.545+0000 7f22aa7fc700 1 -- 172.21.15.49:0/2800048964 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a000ba60 con 0x7f22ac0c6190 2023-11-30T17:07:46.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.545+0000 7f22b1eb2700 1 -- 172.21.15.49:0/2800048964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22ac0c6190 msgr2=0x7f22ac0c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:46.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.545+0000 7f22b1eb2700 1 --2- 172.21.15.49:0/2800048964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22ac0c6190 0x7f22ac0c7760 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f22a0006fd0 tx=0x7f22a00090f0).stop 2023-11-30T17:07:46.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.545+0000 7f22b1eb2700 1 -- 172.21.15.49:0/2800048964 shutdown_connections 2023-11-30T17:07:46.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.545+0000 7f22b1eb2700 1 --2- 172.21.15.49:0/2800048964 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22ac158320 0x7f22ac1587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:46.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.545+0000 7f22b1eb2700 1 --2- 172.21.15.49:0/2800048964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22ac0c6190 0x7f22ac0c7760 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:46.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.545+0000 7f22b1eb2700 1 -- 172.21.15.49:0/2800048964 >> 172.21.15.49:0/2800048964 conn(0x7f22ac0cb310 msgr2=0x7f22ac0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:46.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.545+0000 7f22b1eb2700 1 -- 172.21.15.49:0/2800048964 shutdown_connections 2023-11-30T17:07:46.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.545+0000 7f22b1eb2700 1 -- 172.21.15.49:0/2800048964 wait complete. 2023-11-30T17:07:46.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.547+0000 7f22b1eb2700 1 Processor -- start 2023-11-30T17:07:46.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.547+0000 7f22b1eb2700 1 -- start start 2023-11-30T17:07:46.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.547+0000 7f22b1eb2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22ac098d10 0x7f22ac152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:46.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.547+0000 7f22b1eb2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22ac0c6190 0x7f22ac0ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:46.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.547+0000 7f22b1eb2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22ac158320 0x7f22ac1517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:46.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.548+0000 7f22b1eb2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac152310 con 0x7f22ac0c6190 2023-11-30T17:07:46.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.548+0000 7f22b1eb2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac0aefb0 con 0x7f22ac098d10 2023-11-30T17:07:46.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.548+0000 7f22b1eb2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac0af290 con 0x7f22ac158320 2023-11-30T17:07:46.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.548+0000 7f22aaffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22ac0c6190 0x7f22ac0ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:46.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.548+0000 7f22aaffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22ac0c6190 0x7f22ac0ad7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59708/0 (socket says 172.21.15.49:59708) 2023-11-30T17:07:46.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.548+0000 7f22aaffd700 1 -- 172.21.15.49:0/3302454328 learned_addr learned my addr 172.21.15.49:0/3302454328 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:46.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.548+0000 7f22ab7fe700 1 --2- 172.21.15.49:0/3302454328 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22ac098d10 0x7f22ac152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:46.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.548+0000 7f22abfff700 1 --2- 172.21.15.49:0/3302454328 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22ac158320 0x7f22ac1517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:46.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.548+0000 7f22aaffd700 1 -- 172.21.15.49:0/3302454328 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22ac158320 msgr2=0x7f22ac1517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:46.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.548+0000 7f22aaffd700 1 --2- 172.21.15.49:0/3302454328 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22ac158320 0x7f22ac1517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:46.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.548+0000 7f22aaffd700 1 -- 172.21.15.49:0/3302454328 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22ac098d10 msgr2=0x7f22ac152520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:46.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.548+0000 7f22aaffd700 1 --2- 172.21.15.49:0/3302454328 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22ac098d10 0x7f22ac152520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:46.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.548+0000 7f22aaffd700 1 -- 172.21.15.49:0/3302454328 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a0009370 con 0x7f22ac0c6190 2023-11-30T17:07:46.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.548+0000 7f22aaffd700 1 --2- 172.21.15.49:0/3302454328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22ac0c6190 0x7f22ac0ad7d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f22a0009fd0 tx=0x7f22a0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:46.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.548+0000 7f22937fe700 1 -- 172.21.15.49:0/3302454328 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a000b850 con 0x7f22ac0c6190 2023-11-30T17:07:46.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.548+0000 7f22937fe700 1 -- 172.21.15.49:0/3302454328 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a000b9b0 con 0x7f22ac0c6190 2023-11-30T17:07:46.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.548+0000 7f22b1eb2700 1 -- 172.21.15.49:0/3302454328 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22ac0af570 con 0x7f22ac0c6190 2023-11-30T17:07:46.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.548+0000 7f22937fe700 1 -- 172.21.15.49:0/3302454328 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a001c670 con 0x7f22ac0c6190 2023-11-30T17:07:46.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.548+0000 7f22b1eb2700 1 -- 172.21.15.49:0/3302454328 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22ac0aec80 con 0x7f22ac0c6190 2023-11-30T17:07:46.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.549+0000 7f22b1eb2700 1 -- 172.21.15.49:0/3302454328 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22ac0afa70 con 0x7f22ac0c6190 2023-11-30T17:07:46.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.550+0000 7f22937fe700 1 -- 172.21.15.49:0/3302454328 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f22a001ca60 con 0x7f22ac0c6190 2023-11-30T17:07:46.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.550+0000 7f22937fe700 1 --2- 172.21.15.49:0/3302454328 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f229805f150 0x7f2298061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:46.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.550+0000 7f22937fe700 1 -- 172.21.15.49:0/3302454328 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f22a007be30 con 0x7f22ac0c6190 2023-11-30T17:07:46.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.550+0000 7f22ab7fe700 1 --2- 172.21.15.49:0/3302454328 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f229805f150 0x7f2298061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:46.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.551+0000 7f22ab7fe700 1 --2- 172.21.15.49:0/3302454328 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f229805f150 0x7f2298061610 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f229c003900 tx=0x7f229c007d40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:46.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.554+0000 7f22937fe700 1 -- 172.21.15.49:0/3302454328 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f22a004d100 con 0x7f22ac0c6190 2023-11-30T17:07:46.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.728+0000 7f22b1eb2700 1 -- 172.21.15.49:0/3302454328 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f22ac06c860 con 0x7f22ac0c6190 2023-11-30T17:07:46.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.728+0000 7f22937fe700 1 -- 172.21.15.49:0/3302454328 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f22a002a030 con 0x7f22ac0c6190 2023-11-30T17:07:46.730 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T17:07:46.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.730+0000 7f22b1eb2700 1 -- 172.21.15.49:0/3302454328 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f229805f150 msgr2=0x7f2298061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:46.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.730+0000 7f22b1eb2700 1 --2- 172.21.15.49:0/3302454328 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f229805f150 0x7f2298061610 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f229c003900 tx=0x7f229c007d40).stop 2023-11-30T17:07:46.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.730+0000 7f22b1eb2700 1 -- 172.21.15.49:0/3302454328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22ac0c6190 msgr2=0x7f22ac0ad7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:46.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.730+0000 7f22b1eb2700 1 --2- 172.21.15.49:0/3302454328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22ac0c6190 0x7f22ac0ad7d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f22a0009fd0 tx=0x7f22a0017000).stop 2023-11-30T17:07:46.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.730+0000 7f22b1eb2700 1 -- 172.21.15.49:0/3302454328 shutdown_connections 2023-11-30T17:07:46.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.730+0000 7f22b1eb2700 1 --2- 172.21.15.49:0/3302454328 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22ac158320 0x7f22ac1517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:46.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.730+0000 7f22b1eb2700 1 --2- 172.21.15.49:0/3302454328 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22ac098d10 0x7f22ac152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:46.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.730+0000 7f22b1eb2700 1 --2- 172.21.15.49:0/3302454328 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f229805f150 0x7f2298061610 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:46.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.730+0000 7f22b1eb2700 1 --2- 172.21.15.49:0/3302454328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22ac0c6190 0x7f22ac0ad7d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:46.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.730+0000 7f22b1eb2700 1 -- 172.21.15.49:0/3302454328 >> 172.21.15.49:0/3302454328 conn(0x7f22ac0cb310 msgr2=0x7f22ac1530d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:46.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.730+0000 7f22b1eb2700 1 -- 172.21.15.49:0/3302454328 shutdown_connections 2023-11-30T17:07:46.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.730+0000 7f22b1eb2700 1 -- 172.21.15.49:0/3302454328 wait complete. 2023-11-30T17:07:46.744 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-30T17:07:46.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.862+0000 7fee3b8a2700 1 Processor -- start 2023-11-30T17:07:46.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.862+0000 7fee3b8a2700 1 -- start start 2023-11-30T17:07:46.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.863+0000 7fee3b8a2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fee34098d10 0x7fee340c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.863+0000 7fee3b8a2700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fee340c6190 0x7fee34063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.863+0000 7fee3b8a2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee34064350 0x7fee34158320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.863+0000 7fee3b8a2700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee340c72d0 con 0x7fee34098d10 2023-11-30T17:07:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.863+0000 7fee3b8a2700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee34154bc0 con 0x7fee340c6190 2023-11-30T17:07:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.863+0000 7fee3b8a2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee340c66c0 con 0x7fee34064350 2023-11-30T17:07:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.863+0000 7fee3963e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fee34098d10 0x7fee340c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.863+0000 7fee3963e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fee34098d10 0x7fee340c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59724/0 (socket says 172.21.15.49:59724) 2023-11-30T17:07:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.863+0000 7fee3963e700 1 -- 172.21.15.49:0/2154943078 learned_addr learned my addr 172.21.15.49:0/2154943078 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.863+0000 7fee38e3d700 1 --2- 172.21.15.49:0/2154943078 >> v2:172.21.15.115:3300/0 conn(0x7fee340c6190 0x7fee34063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.863+0000 7fee39e3f700 1 --2- 172.21.15.49:0/2154943078 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee34064350 0x7fee34158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.863+0000 7fee3963e700 1 -- 172.21.15.49:0/2154943078 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee34064350 msgr2=0x7fee34158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.863+0000 7fee3963e700 1 --2- 172.21.15.49:0/2154943078 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee34064350 0x7fee34158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.863+0000 7fee3963e700 1 -- 172.21.15.49:0/2154943078 >> v2:172.21.15.115:3300/0 conn(0x7fee340c6190 msgr2=0x7fee34063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.863+0000 7fee3963e700 1 --2- 172.21.15.49:0/2154943078 >> v2:172.21.15.115:3300/0 conn(0x7fee340c6190 0x7fee34063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.863+0000 7fee3963e700 1 -- 172.21.15.49:0/2154943078 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee340c69a0 con 0x7fee34098d10 2023-11-30T17:07:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.863+0000 7fee38e3d700 1 --2- 172.21.15.49:0/2154943078 >> v2:172.21.15.115:3300/0 conn(0x7fee340c6190 0x7fee34063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.863+0000 7fee3963e700 1 --2- 172.21.15.49:0/2154943078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee34098d10 0x7fee340c7760 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fee340c5b40 tx=0x7fee2c009840).ready entity=mon.0 client_cookie=891a704d291e356f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.863+0000 7fee33fff700 1 -- 172.21.15.49:0/2154943078 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2c00e070 con 0x7fee34098d10 2023-11-30T17:07:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.863+0000 7fee33fff700 1 -- 172.21.15.49:0/2154943078 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2c00ba50 con 0x7fee34098d10 2023-11-30T17:07:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.863+0000 7fee33fff700 1 -- 172.21.15.49:0/2154943078 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2c00bdd0 con 0x7fee34098d10 2023-11-30T17:07:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.864+0000 7fee3b8a2700 1 -- 172.21.15.49:0/2154943078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee34098d10 msgr2=0x7fee340c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.864+0000 7fee3b8a2700 1 --2- 172.21.15.49:0/2154943078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee34098d10 0x7fee340c7760 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fee340c5b40 tx=0x7fee2c009840).stop 2023-11-30T17:07:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.864+0000 7fee3b8a2700 1 -- 172.21.15.49:0/2154943078 shutdown_connections 2023-11-30T17:07:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.864+0000 7fee3b8a2700 1 --2- 172.21.15.49:0/2154943078 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee34064350 0x7fee34158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.864+0000 7fee3b8a2700 1 --2- 172.21.15.49:0/2154943078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee34098d10 0x7fee340c7760 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.864+0000 7fee3b8a2700 1 --2- 172.21.15.49:0/2154943078 >> v2:172.21.15.115:3300/0 conn(0x7fee340c6190 0x7fee34063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.864+0000 7fee3b8a2700 1 -- 172.21.15.49:0/2154943078 >> 172.21.15.49:0/2154943078 conn(0x7fee340cb310 msgr2=0x7fee340cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:46.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.864+0000 7fee3b8a2700 1 -- 172.21.15.49:0/2154943078 shutdown_connections 2023-11-30T17:07:46.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.864+0000 7fee3b8a2700 1 -- 172.21.15.49:0/2154943078 wait complete. 2023-11-30T17:07:46.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.865+0000 7fee3b8a2700 1 Processor -- start 2023-11-30T17:07:46.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.865+0000 7fee3b8a2700 1 -- start start 2023-11-30T17:07:46.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.866+0000 7fee3b8a2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee34064350 0x7fee340ab510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:46.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.866+0000 7fee3b8a2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee34098d10 0x7fee340aa380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:46.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.866+0000 7fee3b8a2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee340c6190 0x7fee340ad160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:46.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.866+0000 7fee3b8a2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee34168250 con 0x7fee340c6190 2023-11-30T17:07:46.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.866+0000 7fee3b8a2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee340aba00 con 0x7fee34064350 2023-11-30T17:07:46.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.866+0000 7fee3b8a2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee34168460 con 0x7fee34098d10 2023-11-30T17:07:46.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.866+0000 7fee39e3f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee340c6190 0x7fee340ad160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:46.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.866+0000 7fee39e3f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee340c6190 0x7fee340ad160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59740/0 (socket says 172.21.15.49:59740) 2023-11-30T17:07:46.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.866+0000 7fee39e3f700 1 -- 172.21.15.49:0/4268758060 learned_addr learned my addr 172.21.15.49:0/4268758060 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:46.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.866+0000 7fee38e3d700 1 --2- 172.21.15.49:0/4268758060 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee34098d10 0x7fee340aa380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:46.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.866+0000 7fee3963e700 1 --2- 172.21.15.49:0/4268758060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee34064350 0x7fee340ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:46.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.866+0000 7fee39e3f700 1 -- 172.21.15.49:0/4268758060 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee34098d10 msgr2=0x7fee340aa380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:46.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.866+0000 7fee39e3f700 1 --2- 172.21.15.49:0/4268758060 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee34098d10 0x7fee340aa380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:46.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.866+0000 7fee39e3f700 1 -- 172.21.15.49:0/4268758060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee34064350 msgr2=0x7fee340ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:46.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.866+0000 7fee39e3f700 1 --2- 172.21.15.49:0/4268758060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee34064350 0x7fee340ab510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:46.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.866+0000 7fee39e3f700 1 -- 172.21.15.49:0/4268758060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2c009ae0 con 0x7fee340c6190 2023-11-30T17:07:46.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.867+0000 7fee39e3f700 1 --2- 172.21.15.49:0/4268758060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee340c6190 0x7fee340ad160 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fee2400d890 tx=0x7fee24008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:46.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.867+0000 7fee317fa700 1 -- 172.21.15.49:0/4268758060 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee24011590 con 0x7fee340c6190 2023-11-30T17:07:46.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.867+0000 7fee317fa700 1 -- 172.21.15.49:0/4268758060 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee240116f0 con 0x7fee340c6190 2023-11-30T17:07:46.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.867+0000 7fee317fa700 1 -- 172.21.15.49:0/4268758060 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee24011a70 con 0x7fee340c6190 2023-11-30T17:07:46.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.867+0000 7fee3b8a2700 1 -- 172.21.15.49:0/4268758060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee34168740 con 0x7fee340c6190 2023-11-30T17:07:46.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.867+0000 7fee3b8a2700 1 -- 172.21.15.49:0/4268758060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee34168d80 con 0x7fee340c6190 2023-11-30T17:07:46.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.868+0000 7fee3b8a2700 1 -- 172.21.15.49:0/4268758060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee3406c860 con 0x7fee340c6190 2023-11-30T17:07:46.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.868+0000 7fee317fa700 1 -- 172.21.15.49:0/4268758060 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fee24012420 con 0x7fee340c6190 2023-11-30T17:07:46.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.869+0000 7fee317fa700 1 --2- 172.21.15.49:0/4268758060 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fee2005f150 0x7fee20061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:46.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.869+0000 7fee317fa700 1 -- 172.21.15.49:0/4268758060 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fee24079ad0 con 0x7fee340c6190 2023-11-30T17:07:46.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.869+0000 7fee3963e700 1 --2- 172.21.15.49:0/4268758060 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fee2005f150 0x7fee20061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:46.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.869+0000 7fee3963e700 1 --2- 172.21.15.49:0/4268758060 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fee2005f150 0x7fee20061610 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fee2c003440 tx=0x7fee2c009840).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:46.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:46.873+0000 7fee317fa700 1 -- 172.21.15.49:0/4268758060 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fee2404ad40 con 0x7fee340c6190 2023-11-30T17:07:47.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.043+0000 7fee3b8a2700 1 -- 172.21.15.49:0/4268758060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fee340c6c80 con 0x7fee340c6190 2023-11-30T17:07:47.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.044+0000 7fee317fa700 1 -- 172.21.15.49:0/4268758060 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fee2404e360 con 0x7fee340c6190 2023-11-30T17:07:47.046 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T17:07:47.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.046+0000 7fee3b8a2700 1 -- 172.21.15.49:0/4268758060 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fee2005f150 msgr2=0x7fee20061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:47.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.046+0000 7fee3b8a2700 1 --2- 172.21.15.49:0/4268758060 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fee2005f150 0x7fee20061610 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fee2c003440 tx=0x7fee2c009840).stop 2023-11-30T17:07:47.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.046+0000 7fee3b8a2700 1 -- 172.21.15.49:0/4268758060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee340c6190 msgr2=0x7fee340ad160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:47.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.046+0000 7fee3b8a2700 1 --2- 172.21.15.49:0/4268758060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee340c6190 0x7fee340ad160 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fee2400d890 tx=0x7fee24008040).stop 2023-11-30T17:07:47.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.046+0000 7fee3b8a2700 1 -- 172.21.15.49:0/4268758060 shutdown_connections 2023-11-30T17:07:47.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.046+0000 7fee3b8a2700 1 --2- 172.21.15.49:0/4268758060 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fee2005f150 0x7fee20061610 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:47.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.046+0000 7fee3b8a2700 1 --2- 172.21.15.49:0/4268758060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee340c6190 0x7fee340ad160 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:47.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.046+0000 7fee3b8a2700 1 --2- 172.21.15.49:0/4268758060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee34064350 0x7fee340ab510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:47.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.046+0000 7fee3b8a2700 1 --2- 172.21.15.49:0/4268758060 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee34098d10 0x7fee340aa380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:47.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.046+0000 7fee3b8a2700 1 -- 172.21.15.49:0/4268758060 >> 172.21.15.49:0/4268758060 conn(0x7fee340cb310 msgr2=0x7fee340ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:47.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.046+0000 7fee3b8a2700 1 -- 172.21.15.49:0/4268758060 shutdown_connections 2023-11-30T17:07:47.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.046+0000 7fee3b8a2700 1 -- 172.21.15.49:0/4268758060 wait complete. 2023-11-30T17:07:47.060 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-30T17:07:47.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.178+0000 7fc9eb101700 1 Processor -- start 2023-11-30T17:07:47.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.178+0000 7fc9eb101700 1 -- start start 2023-11-30T17:07:47.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.179+0000 7fc9eb101700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9e40c6190 0x7fc9e40c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:47.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.179+0000 7fc9eb101700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc9e4158320 0x7fc9e41587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:47.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.179+0000 7fc9eb101700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9e4158cc0 con 0x7fc9e4098d10 2023-11-30T17:07:47.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.179+0000 7fc9eb101700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e40c72d0 con 0x7fc9e4158320 2023-11-30T17:07:47.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.179+0000 7fc9eb101700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e4064570 con 0x7fc9e40c6190 2023-11-30T17:07:47.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.180+0000 7fc9e3fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9e40c6190 0x7fc9e40c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:47.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.180+0000 7fc9e969e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc9e4158320 0x7fc9e41587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:47.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.180+0000 7fc9e8e9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc9e4098d10 0x7fc9e4063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:44574/0 (socket says 172.21.15.49:44574) 2023-11-30T17:07:47.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.180+0000 7fc9e8e9d700 1 -- 172.21.15.49:0/3486414810 learned_addr learned my addr 172.21.15.49:0/3486414810 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:47.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.180+0000 7fc9e3fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9e40c6190 0x7fc9e40c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:35418/0 (socket says 172.21.15.49:35418) 2023-11-30T17:07:47.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.180+0000 7fc9e969e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc9e4158320 0x7fc9e41587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:37804/0 (socket says 172.21.15.49:37804) 2023-11-30T17:07:47.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.180+0000 7fc9e37fe700 1 -- 172.21.15.49:0/3486414810 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3938330563 0 0) 0x7fc9dc001490 con 0x7fc9e4098d10 2023-11-30T17:07:47.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.180+0000 7fc9e37fe700 1 -- 172.21.15.49:0/3486414810 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9d00033f0 con 0x7fc9e4098d10 2023-11-30T17:07:47.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.180+0000 7fc9e3fff700 1 -- 172.21.15.49:0/3486414810 >> v2:172.21.15.115:3300/0 conn(0x7fc9e4158320 msgr2=0x7fc9e41587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:47.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.180+0000 7fc9e3fff700 1 --2- 172.21.15.49:0/3486414810 >> v2:172.21.15.115:3300/0 conn(0x7fc9e4158320 0x7fc9e41587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:47.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.180+0000 7fc9e3fff700 1 -- 172.21.15.49:0/3486414810 >> v1:172.21.15.115:6789/0 conn(0x7fc9e4098d10 legacy=0x7fc9e4063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:47.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.180+0000 7fc9e3fff700 1 -- 172.21.15.49:0/3486414810 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e4154bc0 con 0x7fc9e40c6190 2023-11-30T17:07:47.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.180+0000 7fc9e969e700 1 --2- 172.21.15.49:0/3486414810 >> v2:172.21.15.115:3300/0 conn(0x7fc9e4158320 0x7fc9e41587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:07:47.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.180+0000 7fc9e3fff700 1 --2- 172.21.15.49:0/3486414810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9e40c6190 0x7fc9e40c7760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fc9cc009760 tx=0x7fc9cc009060).ready entity=mon.2 client_cookie=37b6c927a3c65a03 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:47.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.180+0000 7fc9e37fe700 1 -- 172.21.15.49:0/3486414810 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc00d4a0 con 0x7fc9e40c6190 2023-11-30T17:07:47.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.180+0000 7fc9e37fe700 1 -- 172.21.15.49:0/3486414810 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9cc00d600 con 0x7fc9e40c6190 2023-11-30T17:07:47.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.180+0000 7fc9e37fe700 1 -- 172.21.15.49:0/3486414810 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc00d980 con 0x7fc9e40c6190 2023-11-30T17:07:47.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.181+0000 7fc9eb101700 1 -- 172.21.15.49:0/3486414810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9e40c6190 msgr2=0x7fc9e40c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:47.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.181+0000 7fc9eb101700 1 --2- 172.21.15.49:0/3486414810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9e40c6190 0x7fc9e40c7760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fc9cc009760 tx=0x7fc9cc009060).stop 2023-11-30T17:07:47.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.181+0000 7fc9eb101700 1 -- 172.21.15.49:0/3486414810 shutdown_connections 2023-11-30T17:07:47.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.181+0000 7fc9eb101700 1 --2- 172.21.15.49:0/3486414810 >> v2:172.21.15.115:3300/0 conn(0x7fc9e4158320 0x7fc9e41587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:47.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.181+0000 7fc9eb101700 1 --2- 172.21.15.49:0/3486414810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9e40c6190 0x7fc9e40c7760 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:47.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.181+0000 7fc9eb101700 1 -- 172.21.15.49:0/3486414810 >> 172.21.15.49:0/3486414810 conn(0x7fc9e40cb310 msgr2=0x7fc9e40cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:47.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.181+0000 7fc9eb101700 1 -- 172.21.15.49:0/3486414810 shutdown_connections 2023-11-30T17:07:47.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.181+0000 7fc9eb101700 1 -- 172.21.15.49:0/3486414810 wait complete. 2023-11-30T17:07:47.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.182+0000 7fc9eb101700 1 Processor -- start 2023-11-30T17:07:47.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.182+0000 7fc9eb101700 1 -- start start 2023-11-30T17:07:47.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.183+0000 7fc9eb101700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9e4098d10 0x7fc9e41566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:47.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.183+0000 7fc9eb101700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9e40c6190 0x7fc9e40aa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:47.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.183+0000 7fc9eb101700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9e4158320 0x7fc9e40c0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:47.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.183+0000 7fc9eb101700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e40a94b0 con 0x7fc9e4158320 2023-11-30T17:07:47.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.183+0000 7fc9eb101700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e4155050 con 0x7fc9e4098d10 2023-11-30T17:07:47.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.183+0000 7fc9eb101700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e40a8830 con 0x7fc9e40c6190 2023-11-30T17:07:47.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.183+0000 7fc9e969e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9e4158320 0x7fc9e40c0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:47.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.183+0000 7fc9e969e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9e4158320 0x7fc9e40c0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59754/0 (socket says 172.21.15.49:59754) 2023-11-30T17:07:47.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.183+0000 7fc9e969e700 1 -- 172.21.15.49:0/2291799243 learned_addr learned my addr 172.21.15.49:0/2291799243 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:47.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.183+0000 7fc9e8e9d700 1 --2- 172.21.15.49:0/2291799243 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9e4098d10 0x7fc9e41566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:47.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.183+0000 7fc9e3fff700 1 --2- 172.21.15.49:0/2291799243 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9e40c6190 0x7fc9e40aa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:47.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.184+0000 7fc9e969e700 1 -- 172.21.15.49:0/2291799243 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9e40c6190 msgr2=0x7fc9e40aa0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:47.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.184+0000 7fc9e969e700 1 --2- 172.21.15.49:0/2291799243 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9e40c6190 0x7fc9e40aa0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:47.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.184+0000 7fc9e969e700 1 -- 172.21.15.49:0/2291799243 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9e4098d10 msgr2=0x7fc9e41566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:47.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.184+0000 7fc9e969e700 1 --2- 172.21.15.49:0/2291799243 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9e4098d10 0x7fc9e41566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:47.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.184+0000 7fc9e969e700 1 -- 172.21.15.49:0/2291799243 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d40092a0 con 0x7fc9e4158320 2023-11-30T17:07:47.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.184+0000 7fc9e969e700 1 --2- 172.21.15.49:0/2291799243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9e4158320 0x7fc9e40c0ba0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fc9d400e900 tx=0x7fc9d4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:47.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.184+0000 7fc9e0ff9700 1 -- 172.21.15.49:0/2291799243 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4012600 con 0x7fc9e4158320 2023-11-30T17:07:47.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.184+0000 7fc9e0ff9700 1 -- 172.21.15.49:0/2291799243 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d4012760 con 0x7fc9e4158320 2023-11-30T17:07:47.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.184+0000 7fc9eb101700 1 -- 172.21.15.49:0/2291799243 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9cc0092a0 con 0x7fc9e4158320 2023-11-30T17:07:47.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.184+0000 7fc9e0ff9700 1 -- 172.21.15.49:0/2291799243 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4012b00 con 0x7fc9e4158320 2023-11-30T17:07:47.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.184+0000 7fc9eb101700 1 -- 172.21.15.49:0/2291799243 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e40a8bc0 con 0x7fc9e4158320 2023-11-30T17:07:47.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.185+0000 7fc9eb101700 1 -- 172.21.15.49:0/2291799243 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9e40a95f0 con 0x7fc9e4158320 2023-11-30T17:07:47.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.185+0000 7fc9e0ff9700 1 -- 172.21.15.49:0/2291799243 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc9d401b400 con 0x7fc9e4158320 2023-11-30T17:07:47.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.186+0000 7fc9e0ff9700 1 --2- 172.21.15.49:0/2291799243 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc9c405f120 0x7fc9c40615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:47.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.186+0000 7fc9e0ff9700 1 -- 172.21.15.49:0/2291799243 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc9d407a640 con 0x7fc9e4158320 2023-11-30T17:07:47.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.186+0000 7fc9e8e9d700 1 --2- 172.21.15.49:0/2291799243 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc9c405f120 0x7fc9c40615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:47.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.186+0000 7fc9e8e9d700 1 --2- 172.21.15.49:0/2291799243 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc9c405f120 0x7fc9c40615e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fc9dc007fd0 tx=0x7fc9dc000f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:47.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.190+0000 7fc9e0ff9700 1 -- 172.21.15.49:0/2291799243 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc9d404b8b0 con 0x7fc9e4158320 2023-11-30T17:07:47.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.362+0000 7fc9eb101700 1 -- 172.21.15.49:0/2291799243 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc9e406c860 con 0x7fc9e4158320 2023-11-30T17:07:47.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.363+0000 7fc9e0ff9700 1 -- 172.21.15.49:0/2291799243 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc9d4016020 con 0x7fc9e4158320 2023-11-30T17:07:47.365 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T17:07:47.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.365+0000 7fc9eb101700 1 -- 172.21.15.49:0/2291799243 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc9c405f120 msgr2=0x7fc9c40615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:47.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.365+0000 7fc9eb101700 1 --2- 172.21.15.49:0/2291799243 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc9c405f120 0x7fc9c40615e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fc9dc007fd0 tx=0x7fc9dc000f40).stop 2023-11-30T17:07:47.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.365+0000 7fc9eb101700 1 -- 172.21.15.49:0/2291799243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9e4158320 msgr2=0x7fc9e40c0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:47.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.365+0000 7fc9eb101700 1 --2- 172.21.15.49:0/2291799243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9e4158320 0x7fc9e40c0ba0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fc9d400e900 tx=0x7fc9d4009060).stop 2023-11-30T17:07:47.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.365+0000 7fc9eb101700 1 -- 172.21.15.49:0/2291799243 shutdown_connections 2023-11-30T17:07:47.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.365+0000 7fc9eb101700 1 --2- 172.21.15.49:0/2291799243 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc9c405f120 0x7fc9c40615e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:47.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.365+0000 7fc9eb101700 1 --2- 172.21.15.49:0/2291799243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9e4158320 0x7fc9e40c0ba0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:47.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.365+0000 7fc9eb101700 1 --2- 172.21.15.49:0/2291799243 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9e4098d10 0x7fc9e41566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:47.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.365+0000 7fc9eb101700 1 --2- 172.21.15.49:0/2291799243 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9e40c6190 0x7fc9e40aa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:47.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.365+0000 7fc9eb101700 1 -- 172.21.15.49:0/2291799243 >> 172.21.15.49:0/2291799243 conn(0x7fc9e40cb310 msgr2=0x7fc9e414f390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:47.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.365+0000 7fc9eb101700 1 -- 172.21.15.49:0/2291799243 shutdown_connections 2023-11-30T17:07:47.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.365+0000 7fc9eb101700 1 -- 172.21.15.49:0/2291799243 wait complete. 2023-11-30T17:07:47.379 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:07:47.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.495+0000 7f92f9d7e700 1 Processor -- start 2023-11-30T17:07:47.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.495+0000 7f92f9d7e700 1 -- start start 2023-11-30T17:07:47.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.496+0000 7f92f9d7e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92f40cae90 0x7f92f40c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:47.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.496+0000 7f92f9d7e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92f40a9a90 con 0x7f92f40ca180 2023-11-30T17:07:47.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.496+0000 7f92f9d7e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92f4154ce0 con 0x7f92f40caab0 2023-11-30T17:07:47.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.496+0000 7f92f9d7e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f40aab80 con 0x7f92f40cae90 2023-11-30T17:07:47.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.496+0000 7f92f3fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f92f40ca180 0x7f92f415e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51794/0 (socket says 172.21.15.49:51794) 2023-11-30T17:07:47.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.496+0000 7f92f3fff700 1 -- 172.21.15.49:0/3252761177 learned_addr learned my addr 172.21.15.49:0/3252761177 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:47.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.496+0000 7f92f2ffd700 1 --2- 172.21.15.49:0/3252761177 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92f40cae90 0x7f92f40c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:47.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.496+0000 7f92f27fc700 1 -- 172.21.15.49:0/3252761177 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2050987080 0 0) 0x7f92f40a9a90 con 0x7f92f40ca180 2023-11-30T17:07:47.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.496+0000 7f92f27fc700 1 -- 172.21.15.49:0/3252761177 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92e00033f0 con 0x7f92f40ca180 2023-11-30T17:07:47.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.496+0000 7f92f27fc700 1 -- 172.21.15.49:0/3252761177 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2881339803 0 0) 0x7f92f4154ce0 con 0x7f92f40caab0 2023-11-30T17:07:47.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.496+0000 7f92f27fc700 1 -- 172.21.15.49:0/3252761177 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92f40a9a90 con 0x7f92f40caab0 2023-11-30T17:07:47.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.496+0000 7f92f2ffd700 1 -- 172.21.15.49:0/3252761177 >> v1:172.21.15.115:6789/0 conn(0x7f92f40caab0 legacy=0x7f92f40aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:47.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.496+0000 7f92f2ffd700 1 -- 172.21.15.49:0/3252761177 >> v1:172.21.15.49:6789/0 conn(0x7f92f40ca180 legacy=0x7f92f415e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:47.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.496+0000 7f92f2ffd700 1 -- 172.21.15.49:0/3252761177 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f40a8e80 con 0x7f92f40cae90 2023-11-30T17:07:47.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.496+0000 7f92f2ffd700 1 --2- 172.21.15.49:0/3252761177 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92f40cae90 0x7f92f40c0ab0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f92dc009790 tx=0x7f92dc009060).ready entity=mon.2 client_cookie=6bdaaa6d926d0307 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:47.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.496+0000 7f92f27fc700 1 -- 172.21.15.49:0/3252761177 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92dc00f510 con 0x7f92f40cae90 2023-11-30T17:07:47.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.497+0000 7f92f27fc700 1 -- 172.21.15.49:0/3252761177 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92dc00f670 con 0x7f92f40cae90 2023-11-30T17:07:47.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.497+0000 7f92f27fc700 1 -- 172.21.15.49:0/3252761177 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92dc00f9f0 con 0x7f92f40cae90 2023-11-30T17:07:47.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.497+0000 7f92f9d7e700 1 -- 172.21.15.49:0/3252761177 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92f40cae90 msgr2=0x7f92f40c0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:47.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.497+0000 7f92f9d7e700 1 --2- 172.21.15.49:0/3252761177 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92f40cae90 0x7f92f40c0ab0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f92dc009790 tx=0x7f92dc009060).stop 2023-11-30T17:07:47.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.497+0000 7f92f9d7e700 1 -- 172.21.15.49:0/3252761177 shutdown_connections 2023-11-30T17:07:47.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.497+0000 7f92f9d7e700 1 --2- 172.21.15.49:0/3252761177 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92f40cae90 0x7f92f40c0ab0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:47.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.497+0000 7f92f9d7e700 1 -- 172.21.15.49:0/3252761177 >> 172.21.15.49:0/3252761177 conn(0x7f92f4094920 msgr2=0x7f92f406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:47.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.497+0000 7f92f9d7e700 1 -- 172.21.15.49:0/3252761177 shutdown_connections 2023-11-30T17:07:47.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.497+0000 7f92f9d7e700 1 -- 172.21.15.49:0/3252761177 wait complete. 2023-11-30T17:07:47.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.498+0000 7f92f9d7e700 1 Processor -- start 2023-11-30T17:07:47.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.498+0000 7f92f9d7e700 1 -- start start 2023-11-30T17:07:47.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.499+0000 7f92f9d7e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92f40ca180 0x7f92f414eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:47.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.499+0000 7f92f9d7e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92f40caab0 0x7f92f40c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:47.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.499+0000 7f92f9d7e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f40cae90 0x7f92f414cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:47.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.499+0000 7f92f9d7e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f40c36d0 con 0x7f92f40cae90 2023-11-30T17:07:47.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.499+0000 7f92f9d7e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f414fe30 con 0x7f92f40caab0 2023-11-30T17:07:47.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.499+0000 7f92f9d7e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f41502c0 con 0x7f92f40ca180 2023-11-30T17:07:47.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.499+0000 7f92f3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f40cae90 0x7f92f414cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:47.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.499+0000 7f92f3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f40cae90 0x7f92f414cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59770/0 (socket says 172.21.15.49:59770) 2023-11-30T17:07:47.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.499+0000 7f92f3fff700 1 -- 172.21.15.49:0/1940819579 learned_addr learned my addr 172.21.15.49:0/1940819579 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:47.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.499+0000 7f92f2ffd700 1 --2- 172.21.15.49:0/1940819579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92f40caab0 0x7f92f40c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:47.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.499+0000 7f92f37fe700 1 --2- 172.21.15.49:0/1940819579 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92f40ca180 0x7f92f414eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:47.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.499+0000 7f92f3fff700 1 -- 172.21.15.49:0/1940819579 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92f40ca180 msgr2=0x7f92f414eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:47.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.499+0000 7f92f3fff700 1 --2- 172.21.15.49:0/1940819579 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92f40ca180 0x7f92f414eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:47.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.499+0000 7f92f3fff700 1 -- 172.21.15.49:0/1940819579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92f40caab0 msgr2=0x7f92f40c31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:47.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.499+0000 7f92f3fff700 1 --2- 172.21.15.49:0/1940819579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92f40caab0 0x7f92f40c31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:47.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.500+0000 7f92f3fff700 1 -- 172.21.15.49:0/1940819579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92dc0092a0 con 0x7f92f40cae90 2023-11-30T17:07:47.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.500+0000 7f92f3fff700 1 --2- 172.21.15.49:0/1940819579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f40cae90 0x7f92f414cf20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f92ec00c490 tx=0x7f92ec007bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:47.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.500+0000 7f92eb7fe700 1 -- 172.21.15.49:0/1940819579 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec0072e0 con 0x7f92f40cae90 2023-11-30T17:07:47.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.500+0000 7f92eb7fe700 1 -- 172.21.15.49:0/1940819579 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ec007440 con 0x7f92f40cae90 2023-11-30T17:07:47.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.500+0000 7f92f9d7e700 1 -- 172.21.15.49:0/1940819579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92f40c2610 con 0x7f92f40cae90 2023-11-30T17:07:47.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.500+0000 7f92eb7fe700 1 -- 172.21.15.49:0/1940819579 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec0057a0 con 0x7f92f40cae90 2023-11-30T17:07:47.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.500+0000 7f92f9d7e700 1 -- 172.21.15.49:0/1940819579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f414f500 con 0x7f92f40cae90 2023-11-30T17:07:47.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.501+0000 7f92f9d7e700 1 -- 172.21.15.49:0/1940819579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92f406c860 con 0x7f92f40cae90 2023-11-30T17:07:47.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.501+0000 7f92eb7fe700 1 -- 172.21.15.49:0/1940819579 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f92ec005b10 con 0x7f92f40cae90 2023-11-30T17:07:47.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.501+0000 7f92eb7fe700 1 --2- 172.21.15.49:0/1940819579 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f92d405f150 0x7f92d4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:47.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.502+0000 7f92eb7fe700 1 -- 172.21.15.49:0/1940819579 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f92ec079920 con 0x7f92f40cae90 2023-11-30T17:07:47.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.502+0000 7f92f37fe700 1 --2- 172.21.15.49:0/1940819579 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f92d405f150 0x7f92d4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:47.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.502+0000 7f92f37fe700 1 --2- 172.21.15.49:0/1940819579 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f92d405f150 0x7f92d4061610 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f92e4003e40 tx=0x7f92e4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:47.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.505+0000 7f92eb7fe700 1 -- 172.21.15.49:0/1940819579 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f92ec04abf0 con 0x7f92f40cae90 2023-11-30T17:07:47.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.676+0000 7f92f9d7e700 1 -- 172.21.15.49:0/1940819579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92f40a9160 con 0x7f92f40cae90 2023-11-30T17:07:47.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.676+0000 7f92eb7fe700 1 -- 172.21.15.49:0/1940819579 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f92ec04e210 con 0x7f92f40cae90 2023-11-30T17:07:47.679 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:47.679 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":22,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:07:17.283998+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:07:14.837882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-30T17:07:15.248549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:07:47.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.678+0000 7f92f9d7e700 1 -- 172.21.15.49:0/1940819579 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f92d405f150 msgr2=0x7f92d4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:47.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.678+0000 7f92f9d7e700 1 --2- 172.21.15.49:0/1940819579 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f92d405f150 0x7f92d4061610 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f92e4003e40 tx=0x7f92e4009040).stop 2023-11-30T17:07:47.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.678+0000 7f92f9d7e700 1 -- 172.21.15.49:0/1940819579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f40cae90 msgr2=0x7f92f414cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:47.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.678+0000 7f92f9d7e700 1 --2- 172.21.15.49:0/1940819579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f40cae90 0x7f92f414cf20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f92ec00c490 tx=0x7f92ec007bf0).stop 2023-11-30T17:07:47.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.678+0000 7f92f9d7e700 1 -- 172.21.15.49:0/1940819579 shutdown_connections 2023-11-30T17:07:47.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.678+0000 7f92f9d7e700 1 --2- 172.21.15.49:0/1940819579 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f92d405f150 0x7f92d4061610 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:47.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.678+0000 7f92f9d7e700 1 --2- 172.21.15.49:0/1940819579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f40cae90 0x7f92f414cf20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:47.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.678+0000 7f92f9d7e700 1 --2- 172.21.15.49:0/1940819579 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92f40ca180 0x7f92f414eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:47.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.678+0000 7f92f9d7e700 1 --2- 172.21.15.49:0/1940819579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92f40caab0 0x7f92f40c31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:47.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.678+0000 7f92f9d7e700 1 -- 172.21.15.49:0/1940819579 >> 172.21.15.49:0/1940819579 conn(0x7f92f4094920 msgr2=0x7f92f40ae220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:47.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.678+0000 7f92f9d7e700 1 -- 172.21.15.49:0/1940819579 shutdown_connections 2023-11-30T17:07:47.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.679+0000 7f92f9d7e700 1 -- 172.21.15.49:0/1940819579 wait complete. 2023-11-30T17:07:47.693 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-30T17:07:14.837882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-30T17:07:15.248549+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-30T17:07:47.694 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T17:07:47.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.812+0000 7f1e7030c700 1 Processor -- start 2023-11-30T17:07:47.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.812+0000 7f1e7030c700 1 -- start start 2023-11-30T17:07:47.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.813+0000 7f1e7030c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1e68098d10 0x7f1e680c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:47.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.813+0000 7f1e7030c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e680c6190 0x7f1e68063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:47.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.813+0000 7f1e7030c700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e680c72d0 con 0x7f1e68064350 2023-11-30T17:07:47.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.813+0000 7f1e7030c700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e68154bc0 con 0x7f1e68098d10 2023-11-30T17:07:47.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.813+0000 7f1e7030c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e680c66c0 con 0x7f1e680c6190 2023-11-30T17:07:47.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.813+0000 7f1e6e8a9700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1e68064350 0x7f1e68158320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51808/0 (socket says 172.21.15.49:51808) 2023-11-30T17:07:47.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.813+0000 7f1e6e8a9700 1 -- 172.21.15.49:0/3663915110 learned_addr learned my addr 172.21.15.49:0/3663915110 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:47.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.814+0000 7f1e6e0a8700 1 --2- 172.21.15.49:0/3663915110 >> v2:172.21.15.115:3300/0 conn(0x7f1e68098d10 0x7f1e680c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:47.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.814+0000 7f1e6d8a7700 1 --2- 172.21.15.49:0/3663915110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e680c6190 0x7f1e68063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:47.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.814+0000 7f1e6d0a6700 1 -- 172.21.15.49:0/3663915110 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776282600 0 0) 0x7f1e680c72d0 con 0x7f1e68064350 2023-11-30T17:07:47.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.814+0000 7f1e6d0a6700 1 -- 172.21.15.49:0/3663915110 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e500033f0 con 0x7f1e68064350 2023-11-30T17:07:47.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.814+0000 7f1e6e0a8700 1 -- 172.21.15.49:0/3663915110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e680c6190 msgr2=0x7f1e68063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:47.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.814+0000 7f1e6e0a8700 1 --2- 172.21.15.49:0/3663915110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e680c6190 0x7f1e68063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:47.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.814+0000 7f1e6e0a8700 1 -- 172.21.15.49:0/3663915110 >> v1:172.21.15.49:6789/0 conn(0x7f1e68064350 legacy=0x7f1e68158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:47.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.814+0000 7f1e6e0a8700 1 -- 172.21.15.49:0/3663915110 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e680c69a0 con 0x7f1e68098d10 2023-11-30T17:07:47.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.814+0000 7f1e6d8a7700 1 --2- 172.21.15.49:0/3663915110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e680c6190 0x7f1e68063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:07:47.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.814+0000 7f1e6e0a8700 1 --2- 172.21.15.49:0/3663915110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e68098d10 0x7f1e680c7760 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f1e60009760 tx=0x7f1e60009060).ready entity=mon.1 client_cookie=954a09728a3eb746 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:47.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.814+0000 7f1e6d0a6700 1 -- 172.21.15.49:0/3663915110 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6000d4a0 con 0x7f1e68098d10 2023-11-30T17:07:47.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.814+0000 7f1e6d0a6700 1 -- 172.21.15.49:0/3663915110 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6000d600 con 0x7f1e68098d10 2023-11-30T17:07:47.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.814+0000 7f1e6d0a6700 1 -- 172.21.15.49:0/3663915110 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6000d980 con 0x7f1e68098d10 2023-11-30T17:07:47.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.815+0000 7f1e7030c700 1 -- 172.21.15.49:0/3663915110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e68098d10 msgr2=0x7f1e680c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:47.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.815+0000 7f1e7030c700 1 --2- 172.21.15.49:0/3663915110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e68098d10 0x7f1e680c7760 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f1e60009760 tx=0x7f1e60009060).stop 2023-11-30T17:07:47.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.815+0000 7f1e7030c700 1 -- 172.21.15.49:0/3663915110 shutdown_connections 2023-11-30T17:07:47.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.815+0000 7f1e7030c700 1 --2- 172.21.15.49:0/3663915110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e68098d10 0x7f1e680c7760 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:47.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.815+0000 7f1e7030c700 1 --2- 172.21.15.49:0/3663915110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e680c6190 0x7f1e68063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:47.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.815+0000 7f1e7030c700 1 -- 172.21.15.49:0/3663915110 >> 172.21.15.49:0/3663915110 conn(0x7f1e680cb310 msgr2=0x7f1e680cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:47.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.815+0000 7f1e7030c700 1 -- 172.21.15.49:0/3663915110 shutdown_connections 2023-11-30T17:07:47.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.815+0000 7f1e7030c700 1 -- 172.21.15.49:0/3663915110 wait complete. 2023-11-30T17:07:47.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.816+0000 7f1e7030c700 1 Processor -- start 2023-11-30T17:07:47.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.816+0000 7f1e7030c700 1 -- start start 2023-11-30T17:07:47.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.817+0000 7f1e7030c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e68064350 0x7f1e680b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:47.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.817+0000 7f1e7030c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e68098d10 0x7f1e68150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:47.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.817+0000 7f1e7030c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e680c6190 0x7f1e680b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:47.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.817+0000 7f1e7030c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e680ad8e0 con 0x7f1e68064350 2023-11-30T17:07:47.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.817+0000 7f1e7030c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e680afc90 con 0x7f1e680c6190 2023-11-30T17:07:47.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.817+0000 7f1e7030c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e680b0610 con 0x7f1e68098d10 2023-11-30T17:07:47.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.817+0000 7f1e6e0a8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e68064350 0x7f1e680b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:47.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.817+0000 7f1e6e0a8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e68064350 0x7f1e680b0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59778/0 (socket says 172.21.15.49:59778) 2023-11-30T17:07:47.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.817+0000 7f1e6e0a8700 1 -- 172.21.15.49:0/4074986281 learned_addr learned my addr 172.21.15.49:0/4074986281 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:47.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.817+0000 7f1e6d8a7700 1 --2- 172.21.15.49:0/4074986281 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e68098d10 0x7f1e68150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:47.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.817+0000 7f1e6e8a9700 1 --2- 172.21.15.49:0/4074986281 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e680c6190 0x7f1e680b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:47.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.817+0000 7f1e6e0a8700 1 -- 172.21.15.49:0/4074986281 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e68098d10 msgr2=0x7f1e68150970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:47.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.817+0000 7f1e6e0a8700 1 --2- 172.21.15.49:0/4074986281 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e68098d10 0x7f1e68150970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:47.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.817+0000 7f1e6e0a8700 1 -- 172.21.15.49:0/4074986281 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e680c6190 msgr2=0x7f1e680b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:47.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.817+0000 7f1e6e0a8700 1 --2- 172.21.15.49:0/4074986281 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e680c6190 0x7f1e680b0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:47.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.817+0000 7f1e6e0a8700 1 -- 172.21.15.49:0/4074986281 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e5c0092a0 con 0x7f1e68064350 2023-11-30T17:07:47.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.817+0000 7f1e6e8a9700 1 --2- 172.21.15.49:0/4074986281 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e680c6190 0x7f1e680b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:47.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.817+0000 7f1e6e0a8700 1 --2- 172.21.15.49:0/4074986281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e68064350 0x7f1e680b0120 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f1e60011fb0 tx=0x7f1e60016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:47.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.818+0000 7f1e667fc700 1 -- 172.21.15.49:0/4074986281 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e60021070 con 0x7f1e68064350 2023-11-30T17:07:47.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.818+0000 7f1e667fc700 1 -- 172.21.15.49:0/4074986281 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e60000bc0 con 0x7f1e68064350 2023-11-30T17:07:47.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.818+0000 7f1e7030c700 1 -- 172.21.15.49:0/4074986281 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e600092a0 con 0x7f1e68064350 2023-11-30T17:07:47.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.818+0000 7f1e667fc700 1 -- 172.21.15.49:0/4074986281 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6000d980 con 0x7f1e68064350 2023-11-30T17:07:47.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.818+0000 7f1e7030c700 1 -- 172.21.15.49:0/4074986281 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e680af6c0 con 0x7f1e68064350 2023-11-30T17:07:47.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.819+0000 7f1e7030c700 1 -- 172.21.15.49:0/4074986281 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e680aff70 con 0x7f1e68064350 2023-11-30T17:07:47.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.819+0000 7f1e667fc700 1 -- 172.21.15.49:0/4074986281 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1e6001d640 con 0x7f1e68064350 2023-11-30T17:07:47.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.819+0000 7f1e667fc700 1 --2- 172.21.15.49:0/4074986281 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1e5405f150 0x7f1e54061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:47.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.819+0000 7f1e667fc700 1 -- 172.21.15.49:0/4074986281 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1e6007b640 con 0x7f1e68064350 2023-11-30T17:07:47.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.819+0000 7f1e6d8a7700 1 --2- 172.21.15.49:0/4074986281 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1e5405f150 0x7f1e54061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:47.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.820+0000 7f1e6d8a7700 1 --2- 172.21.15.49:0/4074986281 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1e5405f150 0x7f1e54061610 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f1e680af050 tx=0x7f1e5c009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:47.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.823+0000 7f1e667fc700 1 -- 172.21.15.49:0/4074986281 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1e6004c910 con 0x7f1e68064350 2023-11-30T17:07:48.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.997+0000 7f1e7030c700 1 -- 172.21.15.49:0/4074986281 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1e680afa40 con 0x7f1e68064350 2023-11-30T17:07:48.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:47.998+0000 7f1e667fc700 1 -- 172.21.15.49:0/4074986281 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1e6004ff30 con 0x7f1e68064350 2023-11-30T17:07:48.000 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T17:07:48.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.000+0000 7f1e7030c700 1 -- 172.21.15.49:0/4074986281 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1e5405f150 msgr2=0x7f1e54061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:48.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.000+0000 7f1e7030c700 1 --2- 172.21.15.49:0/4074986281 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1e5405f150 0x7f1e54061610 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f1e680af050 tx=0x7f1e5c009060).stop 2023-11-30T17:07:48.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.000+0000 7f1e7030c700 1 -- 172.21.15.49:0/4074986281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e68064350 msgr2=0x7f1e680b0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:48.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.000+0000 7f1e7030c700 1 --2- 172.21.15.49:0/4074986281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e68064350 0x7f1e680b0120 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f1e60011fb0 tx=0x7f1e60016000).stop 2023-11-30T17:07:48.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.000+0000 7f1e7030c700 1 -- 172.21.15.49:0/4074986281 shutdown_connections 2023-11-30T17:07:48.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.000+0000 7f1e7030c700 1 --2- 172.21.15.49:0/4074986281 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e680c6190 0x7f1e680b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:48.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.000+0000 7f1e7030c700 1 --2- 172.21.15.49:0/4074986281 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1e5405f150 0x7f1e54061610 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:48.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.000+0000 7f1e7030c700 1 --2- 172.21.15.49:0/4074986281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e68064350 0x7f1e680b0120 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:48.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.000+0000 7f1e7030c700 1 --2- 172.21.15.49:0/4074986281 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e68098d10 0x7f1e68150970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:48.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.000+0000 7f1e7030c700 1 -- 172.21.15.49:0/4074986281 >> 172.21.15.49:0/4074986281 conn(0x7f1e680cb310 msgr2=0x7f1e680aa340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:48.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.000+0000 7f1e7030c700 1 -- 172.21.15.49:0/4074986281 shutdown_connections 2023-11-30T17:07:48.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.000+0000 7f1e7030c700 1 -- 172.21.15.49:0/4074986281 wait complete. 2023-11-30T17:07:48.015 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T17:07:48.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.133+0000 7f8feb59e700 1 Processor -- start 2023-11-30T17:07:48.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.133+0000 7f8feb59e700 1 -- start start 2023-11-30T17:07:48.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.134+0000 7f8feb59e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8fec1350a0 0x7f8fec135480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:48.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.134+0000 7f8feb59e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8fec062700 0x7f8fec062b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:48.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.134+0000 7f8feb59e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fec06a030 con 0x7f8fec152aa0 2023-11-30T17:07:48.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.134+0000 7f8feb59e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fec1537d0 con 0x7f8fec1350a0 2023-11-30T17:07:48.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.134+0000 7f8feb59e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fec06a4c0 con 0x7f8fec062700 2023-11-30T17:07:48.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.134+0000 7f8fea59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8fec1350a0 0x7f8fec135480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:48.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.134+0000 7f8fead9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8fec152aa0 0x7f8fec152ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51812/0 (socket says 172.21.15.49:51812) 2023-11-30T17:07:48.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.134+0000 7f8fead9d700 1 -- 172.21.15.49:0/2401401835 learned_addr learned my addr 172.21.15.49:0/2401401835 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:48.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.134+0000 7f8fea59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8fec1350a0 0x7f8fec135480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59792/0 (socket says 172.21.15.49:59792) 2023-11-30T17:07:48.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.134+0000 7f8fe9d9b700 1 --2- 172.21.15.49:0/2401401835 >> v2:172.21.15.115:3300/0 conn(0x7f8fec062700 0x7f8fec062b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:48.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.134+0000 7f8fea59c700 1 -- 172.21.15.49:0/2401401835 >> v2:172.21.15.115:3300/0 conn(0x7f8fec062700 msgr2=0x7f8fec062b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:48.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.134+0000 7f8fea59c700 1 --2- 172.21.15.49:0/2401401835 >> v2:172.21.15.115:3300/0 conn(0x7f8fec062700 0x7f8fec062b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:48.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.134+0000 7f8fea59c700 1 -- 172.21.15.49:0/2401401835 >> v1:172.21.15.49:6789/0 conn(0x7f8fec152aa0 legacy=0x7f8fec152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:48.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.134+0000 7f8fea59c700 1 -- 172.21.15.49:0/2401401835 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fec0c2d30 con 0x7f8fec1350a0 2023-11-30T17:07:48.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.134+0000 7f8fe959a700 1 -- 172.21.15.49:0/2401401835 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628213268 0 0) 0x7f8fec06a030 con 0x7f8fec152aa0 2023-11-30T17:07:48.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.134+0000 7f8fea59c700 1 --2- 172.21.15.49:0/2401401835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fec1350a0 0x7f8fec135480 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f8fec0adf40 tx=0x7f8fdc009060).ready entity=mon.0 client_cookie=d1fd629e5cb90534 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:48.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.135+0000 7f8fe959a700 1 -- 172.21.15.49:0/2401401835 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc0090d0 con 0x7f8fec1350a0 2023-11-30T17:07:48.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.135+0000 7f8fe959a700 1 -- 172.21.15.49:0/2401401835 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fdc00f510 con 0x7f8fec1350a0 2023-11-30T17:07:48.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.135+0000 7f8fe959a700 1 -- 172.21.15.49:0/2401401835 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc00f890 con 0x7f8fec1350a0 2023-11-30T17:07:48.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.135+0000 7f8feb59e700 1 -- 172.21.15.49:0/2401401835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fec1350a0 msgr2=0x7f8fec135480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:48.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.135+0000 7f8feb59e700 1 --2- 172.21.15.49:0/2401401835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fec1350a0 0x7f8fec135480 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f8fec0adf40 tx=0x7f8fdc009060).stop 2023-11-30T17:07:48.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.135+0000 7f8feb59e700 1 -- 172.21.15.49:0/2401401835 shutdown_connections 2023-11-30T17:07:48.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.135+0000 7f8feb59e700 1 --2- 172.21.15.49:0/2401401835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fec1350a0 0x7f8fec135480 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:48.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.135+0000 7f8feb59e700 1 --2- 172.21.15.49:0/2401401835 >> v2:172.21.15.115:3300/0 conn(0x7f8fec062700 0x7f8fec062b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:48.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.135+0000 7f8feb59e700 1 -- 172.21.15.49:0/2401401835 >> 172.21.15.49:0/2401401835 conn(0x7f8fec064320 msgr2=0x7f8fec0c7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:48.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.135+0000 7f8feb59e700 1 -- 172.21.15.49:0/2401401835 shutdown_connections 2023-11-30T17:07:48.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.135+0000 7f8feb59e700 1 -- 172.21.15.49:0/2401401835 wait complete. 2023-11-30T17:07:48.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.136+0000 7f8feb59e700 1 Processor -- start 2023-11-30T17:07:48.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.136+0000 7f8feb59e700 1 -- start start 2023-11-30T17:07:48.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.137+0000 7f8feb59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fec062700 0x7f8fec14bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:48.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.137+0000 7f8feb59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fec1350a0 0x7f8fec0bfde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:48.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.137+0000 7f8feb59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fec152aa0 0x7f8fec0c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:48.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.137+0000 7f8feb59e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec168e90 con 0x7f8fec062700 2023-11-30T17:07:48.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.137+0000 7f8feb59e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec14c210 con 0x7f8fec1350a0 2023-11-30T17:07:48.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.137+0000 7f8feb59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec0c7340 con 0x7f8fec152aa0 2023-11-30T17:07:48.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.137+0000 7f8fea59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fec062700 0x7f8fec14bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:48.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.137+0000 7f8fea59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fec062700 0x7f8fec14bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59798/0 (socket says 172.21.15.49:59798) 2023-11-30T17:07:48.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.137+0000 7f8fea59c700 1 -- 172.21.15.49:0/3600137178 learned_addr learned my addr 172.21.15.49:0/3600137178 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:48.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.138+0000 7f8fe9d9b700 1 --2- 172.21.15.49:0/3600137178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fec1350a0 0x7f8fec0bfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:48.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.138+0000 7f8fea59c700 1 -- 172.21.15.49:0/3600137178 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fec152aa0 msgr2=0x7f8fec0c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:48.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.138+0000 7f8fea59c700 1 --2- 172.21.15.49:0/3600137178 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fec152aa0 0x7f8fec0c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:07:48.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.138+0000 7f8fea59c700 1 -- 172.21.15.49:0/3600137178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fec1350a0 msgr2=0x7f8fec0bfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:48.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.138+0000 7f8fea59c700 1 --2- 172.21.15.49:0/3600137178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fec1350a0 0x7f8fec0bfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:48.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.138+0000 7f8fea59c700 1 -- 172.21.15.49:0/3600137178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fdc0092a0 con 0x7f8fec062700 2023-11-30T17:07:48.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.138+0000 7f8fe9d9b700 1 --2- 172.21.15.49:0/3600137178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fec1350a0 0x7f8fec0bfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:48.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.138+0000 7f8fea59c700 1 --2- 172.21.15.49:0/3600137178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fec062700 0x7f8fec14bd20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f8fec069070 tx=0x7f8fdc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:48.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.138+0000 7f8fe27fc700 1 -- 172.21.15.49:0/3600137178 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc011c60 con 0x7f8fec062700 2023-11-30T17:07:48.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.138+0000 7f8fe27fc700 1 -- 172.21.15.49:0/3600137178 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fdc011e00 con 0x7f8fec062700 2023-11-30T17:07:48.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.138+0000 7f8feb59e700 1 -- 172.21.15.49:0/3600137178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fec0a4a60 con 0x7f8fec062700 2023-11-30T17:07:48.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.138+0000 7f8fe27fc700 1 -- 172.21.15.49:0/3600137178 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc01b660 con 0x7f8fec062700 2023-11-30T17:07:48.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.138+0000 7f8feb59e700 1 -- 172.21.15.49:0/3600137178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fec0a5020 con 0x7f8fec062700 2023-11-30T17:07:48.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.139+0000 7f8feb59e700 1 -- 172.21.15.49:0/3600137178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fec0a51e0 con 0x7f8fec062700 2023-11-30T17:07:48.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.139+0000 7f8fe27fc700 1 -- 172.21.15.49:0/3600137178 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8fdc01ba10 con 0x7f8fec062700 2023-11-30T17:07:48.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.140+0000 7f8fe27fc700 1 --2- 172.21.15.49:0/3600137178 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8fcc05f150 0x7f8fcc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:48.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.140+0000 7f8fe27fc700 1 -- 172.21.15.49:0/3600137178 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8fdc07ba00 con 0x7f8fec062700 2023-11-30T17:07:48.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.140+0000 7f8fe9d9b700 1 --2- 172.21.15.49:0/3600137178 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8fcc05f150 0x7f8fcc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:48.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.140+0000 7f8fe9d9b700 1 --2- 172.21.15.49:0/3600137178 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8fcc05f150 0x7f8fcc061610 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f8fd4006d80 tx=0x7f8fd4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:48.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.144+0000 7f8fe27fc700 1 -- 172.21.15.49:0/3600137178 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8fdc04ccd0 con 0x7f8fec062700 2023-11-30T17:07:48.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.318+0000 7f8feb59e700 1 -- 172.21.15.49:0/3600137178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8fec0c70c0 con 0x7f8fec062700 2023-11-30T17:07:48.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.319+0000 7f8fe27fc700 1 -- 172.21.15.49:0/3600137178 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8fdc028070 con 0x7f8fec062700 2023-11-30T17:07:48.321 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T17:07:48.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.321+0000 7f8feb59e700 1 -- 172.21.15.49:0/3600137178 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8fcc05f150 msgr2=0x7f8fcc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:48.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.321+0000 7f8feb59e700 1 --2- 172.21.15.49:0/3600137178 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8fcc05f150 0x7f8fcc061610 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f8fd4006d80 tx=0x7f8fd4008040).stop 2023-11-30T17:07:48.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.321+0000 7f8feb59e700 1 -- 172.21.15.49:0/3600137178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fec062700 msgr2=0x7f8fec14bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:48.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.321+0000 7f8feb59e700 1 --2- 172.21.15.49:0/3600137178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fec062700 0x7f8fec14bd20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f8fec069070 tx=0x7f8fdc017000).stop 2023-11-30T17:07:48.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.321+0000 7f8feb59e700 1 -- 172.21.15.49:0/3600137178 shutdown_connections 2023-11-30T17:07:48.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.321+0000 7f8feb59e700 1 --2- 172.21.15.49:0/3600137178 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fec152aa0 0x7f8fec0c67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:07:48.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.321+0000 7f8feb59e700 1 --2- 172.21.15.49:0/3600137178 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8fcc05f150 0x7f8fcc061610 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:48.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.321+0000 7f8feb59e700 1 --2- 172.21.15.49:0/3600137178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fec062700 0x7f8fec14bd20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:48.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.321+0000 7f8feb59e700 1 --2- 172.21.15.49:0/3600137178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fec1350a0 0x7f8fec0bfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:48.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.321+0000 7f8feb59e700 1 -- 172.21.15.49:0/3600137178 >> 172.21.15.49:0/3600137178 conn(0x7f8fec064320 msgr2=0x7f8fec0be440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:48.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.321+0000 7f8feb59e700 1 -- 172.21.15.49:0/3600137178 shutdown_connections 2023-11-30T17:07:48.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.321+0000 7f8feb59e700 1 -- 172.21.15.49:0/3600137178 wait complete. 2023-11-30T17:07:48.335 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-30T17:07:48.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.453+0000 7f0a3f2e7700 1 Processor -- start 2023-11-30T17:07:48.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.453+0000 7f0a3f2e7700 1 -- start start 2023-11-30T17:07:48.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.454+0000 7f0a3f2e7700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0a38154950 0x7f0a380ca540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:48.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.454+0000 7f0a3f2e7700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a380c7bc0 con 0x7f0a380c66f0 2023-11-30T17:07:48.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.454+0000 7f0a3f2e7700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a38155920 con 0x7f0a3814e530 2023-11-30T17:07:48.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.454+0000 7f0a3f2e7700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a380c6ba0 con 0x7f0a38154950 2023-11-30T17:07:48.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.454+0000 7f0a3dae4700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0a380c66f0 0x7f0a38158570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51814/0 (socket says 172.21.15.49:51814) 2023-11-30T17:07:48.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.454+0000 7f0a3dae4700 1 -- 172.21.15.49:0/3805312026 learned_addr learned my addr 172.21.15.49:0/3805312026 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:48.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.455+0000 7f0a3eae6700 1 --2- 172.21.15.49:0/3805312026 >> v2:172.21.15.115:3300/0 conn(0x7f0a38154950 0x7f0a380ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:48.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.455+0000 7f0a3d2e3700 1 -- 172.21.15.49:0/3805312026 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 907627413 0 0) 0x7f0a380c7bc0 con 0x7f0a380c66f0 2023-11-30T17:07:48.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.455+0000 7f0a3d2e3700 1 -- 172.21.15.49:0/3805312026 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a200033f0 con 0x7f0a380c66f0 2023-11-30T17:07:48.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.455+0000 7f0a3d2e3700 1 -- 172.21.15.49:0/3805312026 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2997970991 0 0) 0x7f0a38155920 con 0x7f0a3814e530 2023-11-30T17:07:48.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.455+0000 7f0a3d2e3700 1 -- 172.21.15.49:0/3805312026 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a380c7bc0 con 0x7f0a3814e530 2023-11-30T17:07:48.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.455+0000 7f0a3d2e3700 1 -- 172.21.15.49:0/3805312026 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3455251298 0 0) 0x7f0a200033f0 con 0x7f0a380c66f0 2023-11-30T17:07:48.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.455+0000 7f0a3d2e3700 1 -- 172.21.15.49:0/3805312026 >> v2:172.21.15.115:3300/0 conn(0x7f0a38154950 msgr2=0x7f0a380ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:48.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.455+0000 7f0a3d2e3700 1 --2- 172.21.15.49:0/3805312026 >> v2:172.21.15.115:3300/0 conn(0x7f0a38154950 0x7f0a380ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:48.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.455+0000 7f0a3d2e3700 1 -- 172.21.15.49:0/3805312026 >> v1:172.21.15.115:6789/0 conn(0x7f0a3814e530 legacy=0x7f0a3814e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:48.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.455+0000 7f0a3d2e3700 1 -- 172.21.15.49:0/3805312026 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a38154de0 con 0x7f0a380c66f0 2023-11-30T17:07:48.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.455+0000 7f0a3d2e3700 1 -- 172.21.15.49:0/3805312026 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f0a2c001470 con 0x7f0a380c66f0 2023-11-30T17:07:48.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.455+0000 7f0a3d2e3700 1 -- 172.21.15.49:0/3805312026 >> v1:172.21.15.49:6789/0 conn(0x7f0a380c66f0 legacy=0x7f0a38158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:48.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.455+0000 7f0a3d2e3700 1 --2- 172.21.15.49:0/3805312026 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a20003a70 0x7f0a20003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:48.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.455+0000 7f0a3d2e3700 1 --2- 172.21.15.49:0/3805312026 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a20004690 0x7f0a20004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:48.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.455+0000 7f0a3d2e3700 1 --2- 172.21.15.49:0/3805312026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a20005000 0x7f0a2000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:48.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.455+0000 7f0a3d2e3700 1 -- 172.21.15.49:0/3805312026 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a380c6ba0 con 0x7f0a20005000 2023-11-30T17:07:48.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.455+0000 7f0a3d2e3700 1 -- 172.21.15.49:0/3805312026 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2000bf60 con 0x7f0a20003a70 2023-11-30T17:07:48.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.455+0000 7f0a3d2e3700 1 -- 172.21.15.49:0/3805312026 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2000c0d0 con 0x7f0a20004690 2023-11-30T17:07:48.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.455+0000 7f0a3eae6700 1 --2- 172.21.15.49:0/3805312026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a20005000 0x7f0a2000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:48.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.455+0000 7f0a3e2e5700 1 --2- 172.21.15.49:0/3805312026 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a20003a70 0x7f0a20003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:48.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.455+0000 7f0a3dae4700 1 --2- 172.21.15.49:0/3805312026 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a20004690 0x7f0a20004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:48.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.455+0000 7f0a3eae6700 1 -- 172.21.15.49:0/3805312026 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a20004690 msgr2=0x7f0a20004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:48.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.455+0000 7f0a3eae6700 1 --2- 172.21.15.49:0/3805312026 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a20004690 0x7f0a20004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:48.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.455+0000 7f0a3eae6700 1 -- 172.21.15.49:0/3805312026 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a20003a70 msgr2=0x7f0a20003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:48.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.455+0000 7f0a3eae6700 1 --2- 172.21.15.49:0/3805312026 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a20003a70 0x7f0a20003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:48.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.455+0000 7f0a3eae6700 1 -- 172.21.15.49:0/3805312026 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a200033f0 con 0x7f0a20005000 2023-11-30T17:07:48.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.456+0000 7f0a3eae6700 1 -- 172.21.15.49:0/3805312026 reap_dead start 2023-11-30T17:07:48.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.456+0000 7f0a3eae6700 1 --2- 172.21.15.49:0/3805312026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a20005000 0x7f0a2000b8e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f0a2800e210 tx=0x7f0a2800b040).ready entity=mon.0 client_cookie=f3991c50c3c36e6c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:48.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.456+0000 7f0a3d2e3700 1 -- 172.21.15.49:0/3805312026 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a28009ac0 con 0x7f0a20005000 2023-11-30T17:07:48.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.456+0000 7f0a3d2e3700 1 -- 172.21.15.49:0/3805312026 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2800f040 con 0x7f0a20005000 2023-11-30T17:07:48.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.456+0000 7f0a3d2e3700 1 -- 172.21.15.49:0/3805312026 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2800ecd0 con 0x7f0a20005000 2023-11-30T17:07:48.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.456+0000 7f0a3f2e7700 1 -- 172.21.15.49:0/3805312026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a20005000 msgr2=0x7f0a2000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:48.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.456+0000 7f0a3f2e7700 1 --2- 172.21.15.49:0/3805312026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a20005000 0x7f0a2000b8e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f0a2800e210 tx=0x7f0a2800b040).stop 2023-11-30T17:07:48.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.456+0000 7f0a3f2e7700 1 -- 172.21.15.49:0/3805312026 shutdown_connections 2023-11-30T17:07:48.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.456+0000 7f0a3f2e7700 1 --2- 172.21.15.49:0/3805312026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a20005000 0x7f0a2000b8e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:48.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.456+0000 7f0a3f2e7700 1 -- 172.21.15.49:0/3805312026 >> 172.21.15.49:0/3805312026 conn(0x7f0a38064990 msgr2=0x7f0a38064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:48.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.456+0000 7f0a3f2e7700 1 -- 172.21.15.49:0/3805312026 shutdown_connections 2023-11-30T17:07:48.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.456+0000 7f0a3f2e7700 1 -- 172.21.15.49:0/3805312026 wait complete. 2023-11-30T17:07:48.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.457+0000 7f0a3f2e7700 1 Processor -- start 2023-11-30T17:07:48.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.457+0000 7f0a3f2e7700 1 -- start start 2023-11-30T17:07:48.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.458+0000 7f0a3f2e7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a20005000 0x7f0a380b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:48.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.458+0000 7f0a3f2e7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a3814e050 0x7f0a38159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:48.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.458+0000 7f0a3f2e7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a380c2120 0x7f0a380c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:48.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.458+0000 7f0a3f2e7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3815ab80 con 0x7f0a3814e050 2023-11-30T17:07:48.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.458+0000 7f0a3f2e7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a380c2a70 con 0x7f0a380c2120 2023-11-30T17:07:48.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.458+0000 7f0a3f2e7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3815a2e0 con 0x7f0a20005000 2023-11-30T17:07:48.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.458+0000 7f0a3dae4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a3814e050 0x7f0a38159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:48.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.458+0000 7f0a3dae4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a3814e050 0x7f0a38159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59806/0 (socket says 172.21.15.49:59806) 2023-11-30T17:07:48.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.458+0000 7f0a3dae4700 1 -- 172.21.15.49:0/2115320662 learned_addr learned my addr 172.21.15.49:0/2115320662 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:48.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.458+0000 7f0a3e2e5700 1 --2- 172.21.15.49:0/2115320662 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a20005000 0x7f0a380b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:48.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.458+0000 7f0a3eae6700 1 --2- 172.21.15.49:0/2115320662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a380c2120 0x7f0a380c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:48.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.459+0000 7f0a3dae4700 1 -- 172.21.15.49:0/2115320662 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a20005000 msgr2=0x7f0a380b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:48.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.459+0000 7f0a3dae4700 1 --2- 172.21.15.49:0/2115320662 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a20005000 0x7f0a380b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:48.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.459+0000 7f0a3dae4700 1 -- 172.21.15.49:0/2115320662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a380c2120 msgr2=0x7f0a380c2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:48.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.459+0000 7f0a3dae4700 1 --2- 172.21.15.49:0/2115320662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a380c2120 0x7f0a380c2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:48.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.459+0000 7f0a3dae4700 1 -- 172.21.15.49:0/2115320662 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3815a5c0 con 0x7f0a3814e050 2023-11-30T17:07:48.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.459+0000 7f0a3dae4700 1 --2- 172.21.15.49:0/2115320662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a3814e050 0x7f0a38159a70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f0a2c001100 tx=0x7f0a2c001df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:48.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.459+0000 7f0a367fc700 1 -- 172.21.15.49:0/2115320662 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c0114c0 con 0x7f0a3814e050 2023-11-30T17:07:48.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.459+0000 7f0a367fc700 1 -- 172.21.15.49:0/2115320662 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2c011620 con 0x7f0a3814e050 2023-11-30T17:07:48.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.459+0000 7f0a367fc700 1 -- 172.21.15.49:0/2115320662 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c0119a0 con 0x7f0a3814e050 2023-11-30T17:07:48.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.459+0000 7f0a3f2e7700 1 -- 172.21.15.49:0/2115320662 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a3815a8a0 con 0x7f0a3814e050 2023-11-30T17:07:48.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.459+0000 7f0a3f2e7700 1 -- 172.21.15.49:0/2115320662 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a380b10a0 con 0x7f0a3814e050 2023-11-30T17:07:48.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.460+0000 7f0a3f2e7700 1 -- 172.21.15.49:0/2115320662 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a380aed90 con 0x7f0a3814e050 2023-11-30T17:07:48.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.460+0000 7f0a367fc700 1 -- 172.21.15.49:0/2115320662 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0a2c011d10 con 0x7f0a3814e050 2023-11-30T17:07:48.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.461+0000 7f0a367fc700 1 --2- 172.21.15.49:0/2115320662 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0a2405f150 0x7f0a24061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:48.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.461+0000 7f0a367fc700 1 -- 172.21.15.49:0/2115320662 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0a2c079980 con 0x7f0a3814e050 2023-11-30T17:07:48.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.461+0000 7f0a3e2e5700 1 --2- 172.21.15.49:0/2115320662 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0a2405f150 0x7f0a24061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:48.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.461+0000 7f0a3e2e5700 1 --2- 172.21.15.49:0/2115320662 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0a2405f150 0x7f0a24061610 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f0a30007fd0 tx=0x7f0a30007bb0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:48.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.465+0000 7f0a367fc700 1 -- 172.21.15.49:0/2115320662 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0a2c04aca0 con 0x7f0a3814e050 2023-11-30T17:07:48.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.636+0000 7f0a3f2e7700 1 -- 172.21.15.49:0/2115320662 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0a38062ee0 con 0x7f0a3814e050 2023-11-30T17:07:48.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.636+0000 7f0a367fc700 1 -- 172.21.15.49:0/2115320662 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0a2c019070 con 0x7f0a3814e050 2023-11-30T17:07:48.639 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T17:07:48.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.638+0000 7f0a3f2e7700 1 -- 172.21.15.49:0/2115320662 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0a2405f150 msgr2=0x7f0a24061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:48.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.638+0000 7f0a3f2e7700 1 --2- 172.21.15.49:0/2115320662 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0a2405f150 0x7f0a24061610 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f0a30007fd0 tx=0x7f0a30007bb0).stop 2023-11-30T17:07:48.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.638+0000 7f0a3f2e7700 1 -- 172.21.15.49:0/2115320662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a3814e050 msgr2=0x7f0a38159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:48.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.638+0000 7f0a3f2e7700 1 --2- 172.21.15.49:0/2115320662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a3814e050 0x7f0a38159a70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f0a2c001100 tx=0x7f0a2c001df0).stop 2023-11-30T17:07:48.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.638+0000 7f0a3f2e7700 1 -- 172.21.15.49:0/2115320662 shutdown_connections 2023-11-30T17:07:48.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.638+0000 7f0a3f2e7700 1 --2- 172.21.15.49:0/2115320662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a380c2120 0x7f0a380c2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:48.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.638+0000 7f0a3f2e7700 1 --2- 172.21.15.49:0/2115320662 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a20005000 0x7f0a380b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:48.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.638+0000 7f0a3f2e7700 1 --2- 172.21.15.49:0/2115320662 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0a2405f150 0x7f0a24061610 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:48.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.638+0000 7f0a3f2e7700 1 --2- 172.21.15.49:0/2115320662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a3814e050 0x7f0a38159a70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:48.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.638+0000 7f0a3f2e7700 1 -- 172.21.15.49:0/2115320662 >> 172.21.15.49:0/2115320662 conn(0x7f0a38064990 msgr2=0x7f0a3814e910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:48.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.638+0000 7f0a3f2e7700 1 -- 172.21.15.49:0/2115320662 shutdown_connections 2023-11-30T17:07:48.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.638+0000 7f0a3f2e7700 1 -- 172.21.15.49:0/2115320662 wait complete. 2023-11-30T17:07:48.653 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-30T17:07:48.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.771+0000 7f60d44fd700 1 Processor -- start 2023-11-30T17:07:48.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.771+0000 7f60d44fd700 1 -- start start 2023-11-30T17:07:48.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.772+0000 7f60d44fd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60cc098d10 0x7f60cc0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:48.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.772+0000 7f60d44fd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f60cc158320 0x7f60cc1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:48.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.772+0000 7f60d44fd700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60cc158cc0 con 0x7f60cc0c6190 2023-11-30T17:07:48.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.772+0000 7f60d44fd700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60cc0c72d0 con 0x7f60cc158320 2023-11-30T17:07:48.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.772+0000 7f60d44fd700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc064570 con 0x7f60cc098d10 2023-11-30T17:07:48.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.772+0000 7f60d2a9a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f60cc158320 0x7f60cc1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:48.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.772+0000 7f60d1a98700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f60cc0c6190 0x7f60cc063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51828/0 (socket says 172.21.15.49:51828) 2023-11-30T17:07:48.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.772+0000 7f60d1a98700 1 -- 172.21.15.49:0/3453401764 learned_addr learned my addr 172.21.15.49:0/3453401764 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:48.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.772+0000 7f60d2299700 1 --2- 172.21.15.49:0/3453401764 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60cc098d10 0x7f60cc0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:48.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.772+0000 7f60d2a9a700 1 -- 172.21.15.49:0/3453401764 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60cc098d10 msgr2=0x7f60cc0c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:48.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.773+0000 7f60d2a9a700 1 --2- 172.21.15.49:0/3453401764 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60cc098d10 0x7f60cc0c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:48.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.773+0000 7f60d2a9a700 1 -- 172.21.15.49:0/3453401764 >> v1:172.21.15.49:6789/0 conn(0x7f60cc0c6190 legacy=0x7f60cc063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:48.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.773+0000 7f60d2a9a700 1 -- 172.21.15.49:0/3453401764 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60cc154bc0 con 0x7f60cc158320 2023-11-30T17:07:48.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.773+0000 7f60d2299700 1 --2- 172.21.15.49:0/3453401764 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60cc098d10 0x7f60cc0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:48.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.773+0000 7f60d2a9a700 1 --2- 172.21.15.49:0/3453401764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60cc158320 0x7f60cc1587d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f60bc009760 tx=0x7f60bc009060).ready entity=mon.0 client_cookie=b461167c5294fbb4 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:48.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.773+0000 7f60d1297700 1 -- 172.21.15.49:0/3453401764 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc00b580 con 0x7f60cc158320 2023-11-30T17:07:48.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.773+0000 7f60d1297700 1 -- 172.21.15.49:0/3453401764 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60bc00b6e0 con 0x7f60cc158320 2023-11-30T17:07:48.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.773+0000 7f60d1297700 1 -- 172.21.15.49:0/3453401764 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc00ba60 con 0x7f60cc158320 2023-11-30T17:07:48.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.773+0000 7f60d44fd700 1 -- 172.21.15.49:0/3453401764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60cc158320 msgr2=0x7f60cc1587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:48.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.773+0000 7f60d44fd700 1 --2- 172.21.15.49:0/3453401764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60cc158320 0x7f60cc1587d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f60bc009760 tx=0x7f60bc009060).stop 2023-11-30T17:07:48.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.773+0000 7f60d44fd700 1 -- 172.21.15.49:0/3453401764 shutdown_connections 2023-11-30T17:07:48.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.773+0000 7f60d44fd700 1 --2- 172.21.15.49:0/3453401764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60cc158320 0x7f60cc1587d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:48.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.773+0000 7f60d44fd700 1 --2- 172.21.15.49:0/3453401764 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60cc098d10 0x7f60cc0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:48.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.773+0000 7f60d44fd700 1 -- 172.21.15.49:0/3453401764 >> 172.21.15.49:0/3453401764 conn(0x7f60cc0cb310 msgr2=0x7f60cc0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:48.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.773+0000 7f60d44fd700 1 -- 172.21.15.49:0/3453401764 shutdown_connections 2023-11-30T17:07:48.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.773+0000 7f60d44fd700 1 -- 172.21.15.49:0/3453401764 wait complete. 2023-11-30T17:07:48.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.775+0000 7f60d44fd700 1 Processor -- start 2023-11-30T17:07:48.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.775+0000 7f60d44fd700 1 -- start start 2023-11-30T17:07:48.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.775+0000 7f60d44fd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60cc098d10 0x7f60cc0c2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:48.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.775+0000 7f60d44fd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60cc0c6190 0x7f60cc0ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:48.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.775+0000 7f60d44fd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60cc158320 0x7f60cc13fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:48.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.775+0000 7f60d44fd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc0b10b0 con 0x7f60cc158320 2023-11-30T17:07:48.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.775+0000 7f60d44fd700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc0b1390 con 0x7f60cc098d10 2023-11-30T17:07:48.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.775+0000 7f60d44fd700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc0c2620 con 0x7f60cc0c6190 2023-11-30T17:07:48.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.776+0000 7f60d2a9a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60cc158320 0x7f60cc13fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:48.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.776+0000 7f60d2a9a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60cc158320 0x7f60cc13fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59818/0 (socket says 172.21.15.49:59818) 2023-11-30T17:07:48.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.776+0000 7f60d2a9a700 1 -- 172.21.15.49:0/621267309 learned_addr learned my addr 172.21.15.49:0/621267309 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:48.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.776+0000 7f60d1a98700 1 --2- 172.21.15.49:0/621267309 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60cc0c6190 0x7f60cc0ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:48.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.776+0000 7f60d2299700 1 --2- 172.21.15.49:0/621267309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60cc098d10 0x7f60cc0c2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:48.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.776+0000 7f60d2a9a700 1 -- 172.21.15.49:0/621267309 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60cc0c6190 msgr2=0x7f60cc0ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:48.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.776+0000 7f60d2a9a700 1 --2- 172.21.15.49:0/621267309 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60cc0c6190 0x7f60cc0ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:48.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.776+0000 7f60d2a9a700 1 -- 172.21.15.49:0/621267309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60cc098d10 msgr2=0x7f60cc0c2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:48.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.776+0000 7f60d2a9a700 1 --2- 172.21.15.49:0/621267309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60cc098d10 0x7f60cc0c2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:48.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.776+0000 7f60d2a9a700 1 -- 172.21.15.49:0/621267309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60bc0092a0 con 0x7f60cc158320 2023-11-30T17:07:48.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.776+0000 7f60d1a98700 1 --2- 172.21.15.49:0/621267309 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60cc0c6190 0x7f60cc0ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:48.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.776+0000 7f60d2a9a700 1 --2- 172.21.15.49:0/621267309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60cc158320 0x7f60cc13fd90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f60cc0c2360 tx=0x7f60bc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:48.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.776+0000 7f60ca7fc700 1 -- 172.21.15.49:0/621267309 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc00ba60 con 0x7f60cc158320 2023-11-30T17:07:48.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.776+0000 7f60ca7fc700 1 -- 172.21.15.49:0/621267309 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60bc01b410 con 0x7f60cc158320 2023-11-30T17:07:48.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.776+0000 7f60d44fd700 1 -- 172.21.15.49:0/621267309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60cc0c2900 con 0x7f60cc158320 2023-11-30T17:07:48.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.776+0000 7f60ca7fc700 1 -- 172.21.15.49:0/621267309 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc01b7b0 con 0x7f60cc158320 2023-11-30T17:07:48.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.776+0000 7f60d44fd700 1 -- 172.21.15.49:0/621267309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60cc0ae7b0 con 0x7f60cc158320 2023-11-30T17:07:48.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.777+0000 7f60d44fd700 1 -- 172.21.15.49:0/621267309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60cc0b0e10 con 0x7f60cc158320 2023-11-30T17:07:48.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.777+0000 7f60ca7fc700 1 -- 172.21.15.49:0/621267309 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f60bc01bba0 con 0x7f60cc158320 2023-11-30T17:07:48.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.778+0000 7f60ca7fc700 1 --2- 172.21.15.49:0/621267309 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f60b805f120 0x7f60b80615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:48.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.778+0000 7f60ca7fc700 1 -- 172.21.15.49:0/621267309 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f60bc07b910 con 0x7f60cc158320 2023-11-30T17:07:48.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.778+0000 7f60d2299700 1 --2- 172.21.15.49:0/621267309 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f60b805f120 0x7f60b80615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:48.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.778+0000 7f60d2299700 1 --2- 172.21.15.49:0/621267309 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f60b805f120 0x7f60b80615e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f60c40076a0 tx=0x7f60c40098f0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:48.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.782+0000 7f60ca7fc700 1 -- 172.21.15.49:0/621267309 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f60bc04cc80 con 0x7f60cc158320 2023-11-30T17:07:48.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.955+0000 7f60d44fd700 1 -- 172.21.15.49:0/621267309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f60cc06c860 con 0x7f60cc158320 2023-11-30T17:07:48.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.955+0000 7f60ca7fc700 1 -- 172.21.15.49:0/621267309 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f60bc0502a0 con 0x7f60cc158320 2023-11-30T17:07:48.958 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T17:07:48.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.957+0000 7f60d44fd700 1 -- 172.21.15.49:0/621267309 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f60b805f120 msgr2=0x7f60b80615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:48.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.957+0000 7f60d44fd700 1 --2- 172.21.15.49:0/621267309 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f60b805f120 0x7f60b80615e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f60c40076a0 tx=0x7f60c40098f0).stop 2023-11-30T17:07:48.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.957+0000 7f60d44fd700 1 -- 172.21.15.49:0/621267309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60cc158320 msgr2=0x7f60cc13fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:48.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.957+0000 7f60d44fd700 1 --2- 172.21.15.49:0/621267309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60cc158320 0x7f60cc13fd90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f60cc0c2360 tx=0x7f60bc017000).stop 2023-11-30T17:07:48.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.957+0000 7f60d44fd700 1 -- 172.21.15.49:0/621267309 shutdown_connections 2023-11-30T17:07:48.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.957+0000 7f60d44fd700 1 --2- 172.21.15.49:0/621267309 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f60b805f120 0x7f60b80615e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:48.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.957+0000 7f60d44fd700 1 --2- 172.21.15.49:0/621267309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60cc158320 0x7f60cc13fd90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:48.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.957+0000 7f60d44fd700 1 --2- 172.21.15.49:0/621267309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60cc098d10 0x7f60cc0c2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:48.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.957+0000 7f60d44fd700 1 --2- 172.21.15.49:0/621267309 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60cc0c6190 0x7f60cc0ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:48.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.957+0000 7f60d44fd700 1 -- 172.21.15.49:0/621267309 >> 172.21.15.49:0/621267309 conn(0x7f60cc0cb310 msgr2=0x7f60cc0c8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:48.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.957+0000 7f60d44fd700 1 -- 172.21.15.49:0/621267309 shutdown_connections 2023-11-30T17:07:48.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:48.957+0000 7f60d44fd700 1 -- 172.21.15.49:0/621267309 wait complete. 2023-11-30T17:07:48.983 INFO:tasks.cephfs_test_runner:Starting test: test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test concurrent snap creates in same file-system without db issues 2023-11-30T17:07:48.983 INFO:tasks.cephfs_test_runner:test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-11-30T17:07:48.983 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-11-30T17:07:49.046 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:07:49.048 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:07:49.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.099+0000 7f0fc7550700 1 Processor -- start 2023-11-30T17:07:49.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.100+0000 7f0fc7550700 1 -- start start 2023-11-30T17:07:49.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.100+0000 7f0fc7550700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0fc01542d0 0x7f0fc00697f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:49.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.100+0000 7f0fc7550700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc0065760 con 0x7f0fc0069ce0 2023-11-30T17:07:49.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.100+0000 7f0fc7550700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc00c3250 con 0x7f0fc0062e10 2023-11-30T17:07:49.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.101+0000 7f0fc7550700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc006a160 con 0x7f0fc01542d0 2023-11-30T17:07:49.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.101+0000 7f0fc4aeb700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0fc0069ce0 0x7f0fc0062700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51838/0 (socket says 172.21.15.49:51838) 2023-11-30T17:07:49.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.101+0000 7f0fc4aeb700 1 -- 172.21.15.49:0/1645668232 learned_addr learned my addr 172.21.15.49:0/1645668232 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:49.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.101+0000 7f0fc52ec700 1 --2- 172.21.15.49:0/1645668232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0fc01542d0 0x7f0fc00697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:49.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.101+0000 7f0fbffff700 1 -- 172.21.15.49:0/1645668232 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2085215607 0 0) 0x7f0fc0065760 con 0x7f0fc0069ce0 2023-11-30T17:07:49.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.101+0000 7f0fbffff700 1 -- 172.21.15.49:0/1645668232 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fa80033f0 con 0x7f0fc0069ce0 2023-11-30T17:07:49.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.101+0000 7f0fbffff700 1 -- 172.21.15.49:0/1645668232 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3201831358 0 0) 0x7f0fa80033f0 con 0x7f0fc0069ce0 2023-11-30T17:07:49.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.101+0000 7f0fbffff700 1 -- 172.21.15.49:0/1645668232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0fc01542d0 msgr2=0x7f0fc00697f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:49.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.101+0000 7f0fbffff700 1 --2- 172.21.15.49:0/1645668232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0fc01542d0 0x7f0fc00697f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:49.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.101+0000 7f0fbffff700 1 -- 172.21.15.49:0/1645668232 >> v1:172.21.15.115:6789/0 conn(0x7f0fc0062e10 legacy=0x7f0fc00661b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:49.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.101+0000 7f0fbffff700 1 -- 172.21.15.49:0/1645668232 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc006a340 con 0x7f0fc0069ce0 2023-11-30T17:07:49.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.101+0000 7f0fbffff700 1 -- 172.21.15.49:0/1645668232 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f0fb4001470 con 0x7f0fc0069ce0 2023-11-30T17:07:49.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.101+0000 7f0fbffff700 1 -- 172.21.15.49:0/1645668232 >> v1:172.21.15.49:6789/0 conn(0x7f0fc0069ce0 legacy=0x7f0fc0062700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:49.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.101+0000 7f0fbffff700 1 --2- 172.21.15.49:0/1645668232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fa8003910 0x7f0fa8003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:49.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.101+0000 7f0fbffff700 1 --2- 172.21.15.49:0/1645668232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0fc01542d0 0x7f0fa8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:49.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.101+0000 7f0fbffff700 1 --2- 172.21.15.49:0/1645668232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fa8004b80 0x7f0fa8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:49.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.101+0000 7f0fbffff700 1 -- 172.21.15.49:0/1645668232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc006a160 con 0x7f0fa8004b80 2023-11-30T17:07:49.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.101+0000 7f0fbffff700 1 -- 172.21.15.49:0/1645668232 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa800b8e0 con 0x7f0fa8003910 2023-11-30T17:07:49.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.101+0000 7f0fbffff700 1 -- 172.21.15.49:0/1645668232 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa800ba50 con 0x7f0fc01542d0 2023-11-30T17:07:49.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.101+0000 7f0fc5aed700 1 --2- 172.21.15.49:0/1645668232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fa8004b80 0x7f0fa8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:49.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.101+0000 7f0fc52ec700 1 --2- 172.21.15.49:0/1645668232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fa8003910 0x7f0fa8003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:49.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.102+0000 7f0fc4aeb700 1 --2- 172.21.15.49:0/1645668232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0fc01542d0 0x7f0fa8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:49.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.102+0000 7f0fc5aed700 1 -- 172.21.15.49:0/1645668232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0fc01542d0 msgr2=0x7f0fa8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:49.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.102+0000 7f0fc5aed700 1 --2- 172.21.15.49:0/1645668232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0fc01542d0 0x7f0fa8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:49.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.102+0000 7f0fc5aed700 1 -- 172.21.15.49:0/1645668232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fa8003910 msgr2=0x7f0fa8003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:49.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.102+0000 7f0fc5aed700 1 --2- 172.21.15.49:0/1645668232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fa8003910 0x7f0fa8003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:49.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.102+0000 7f0fc5aed700 1 -- 172.21.15.49:0/1645668232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa80033f0 con 0x7f0fa8004b80 2023-11-30T17:07:49.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.102+0000 7f0fc5aed700 1 --2- 172.21.15.49:0/1645668232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fa8004b80 0x7f0fa8005000 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f0fb0001f20 tx=0x7f0fb0007f10).ready entity=mon.0 client_cookie=15a71cac45fae73a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:49.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.102+0000 7f0fbffff700 1 -- 172.21.15.49:0/1645668232 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb00017e0 con 0x7f0fa8004b80 2023-11-30T17:07:49.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.102+0000 7f0fbffff700 1 -- 172.21.15.49:0/1645668232 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb000c670 con 0x7f0fa8004b80 2023-11-30T17:07:49.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.102+0000 7f0fbffff700 1 -- 172.21.15.49:0/1645668232 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb000c9f0 con 0x7f0fa8004b80 2023-11-30T17:07:49.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.102+0000 7f0fc7550700 1 -- 172.21.15.49:0/1645668232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fa8004b80 msgr2=0x7f0fa8005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:49.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.102+0000 7f0fc7550700 1 --2- 172.21.15.49:0/1645668232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fa8004b80 0x7f0fa8005000 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f0fb0001f20 tx=0x7f0fb0007f10).stop 2023-11-30T17:07:49.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.103+0000 7f0fc5aed700 1 -- 172.21.15.49:0/1645668232 reap_dead start 2023-11-30T17:07:49.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.103+0000 7f0fc7550700 1 -- 172.21.15.49:0/1645668232 shutdown_connections 2023-11-30T17:07:49.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.103+0000 7f0fc7550700 1 -- 172.21.15.49:0/1645668232 >> 172.21.15.49:0/1645668232 conn(0x7f0fc00c7fd0 msgr2=0x7f0fc00c83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:49.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.103+0000 7f0fc7550700 1 -- 172.21.15.49:0/1645668232 shutdown_connections 2023-11-30T17:07:49.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.103+0000 7f0fc7550700 1 -- 172.21.15.49:0/1645668232 wait complete. 2023-11-30T17:07:49.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.104+0000 7f0fc7550700 1 Processor -- start 2023-11-30T17:07:49.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.104+0000 7f0fc7550700 1 -- start start 2023-11-30T17:07:49.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.105+0000 7f0fc7550700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fc0066390 0x7f0fc0066770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:49.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.105+0000 7f0fc7550700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0fc00abdc0 0x7f0fc0164790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:49.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.105+0000 7f0fc7550700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fc014e7a0 0x7f0fc014ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:49.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.105+0000 7f0fc7550700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc00ac240 con 0x7f0fc0066390 2023-11-30T17:07:49.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.105+0000 7f0fc7550700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc0165090 con 0x7f0fc014e7a0 2023-11-30T17:07:49.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.105+0000 7f0fc7550700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc0165370 con 0x7f0fc00abdc0 2023-11-30T17:07:49.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.105+0000 7f0fc52ec700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fc0066390 0x7f0fc0066770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:49.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.105+0000 7f0fc52ec700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fc0066390 0x7f0fc0066770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59828/0 (socket says 172.21.15.49:59828) 2023-11-30T17:07:49.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.105+0000 7f0fc52ec700 1 -- 172.21.15.49:0/761996233 learned_addr learned my addr 172.21.15.49:0/761996233 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:49.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.105+0000 7f0fc5aed700 1 --2- 172.21.15.49:0/761996233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fc014e7a0 0x7f0fc014ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:49.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.105+0000 7f0fc4aeb700 1 --2- 172.21.15.49:0/761996233 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0fc00abdc0 0x7f0fc0164790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:49.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.105+0000 7f0fc52ec700 1 -- 172.21.15.49:0/761996233 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0fc00abdc0 msgr2=0x7f0fc0164790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:49.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.105+0000 7f0fc52ec700 1 --2- 172.21.15.49:0/761996233 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0fc00abdc0 0x7f0fc0164790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:49.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.105+0000 7f0fc52ec700 1 -- 172.21.15.49:0/761996233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fc014e7a0 msgr2=0x7f0fc014ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:49.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.105+0000 7f0fc52ec700 1 --2- 172.21.15.49:0/761996233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fc014e7a0 0x7f0fc014ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:49.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.105+0000 7f0fc52ec700 1 -- 172.21.15.49:0/761996233 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc0165650 con 0x7f0fc0066390 2023-11-30T17:07:49.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.105+0000 7f0fc52ec700 1 --2- 172.21.15.49:0/761996233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fc0066390 0x7f0fc0066770 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f0fb80119c0 tx=0x7f0fb8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:49.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.106+0000 7f0fbd7fa700 1 -- 172.21.15.49:0/761996233 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8011eb0 con 0x7f0fc0066390 2023-11-30T17:07:49.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.106+0000 7f0fbd7fa700 1 -- 172.21.15.49:0/761996233 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb800f8e0 con 0x7f0fc0066390 2023-11-30T17:07:49.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.106+0000 7f0fc7550700 1 -- 172.21.15.49:0/761996233 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc01659a0 con 0x7f0fc0066390 2023-11-30T17:07:49.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.106+0000 7f0fbd7fa700 1 -- 172.21.15.49:0/761996233 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb800fc60 con 0x7f0fc0066390 2023-11-30T17:07:49.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.106+0000 7f0fc7550700 1 -- 172.21.15.49:0/761996233 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc014f0f0 con 0x7f0fc0066390 2023-11-30T17:07:49.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.107+0000 7f0fc7550700 1 -- 172.21.15.49:0/761996233 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc006c860 con 0x7f0fc0066390 2023-11-30T17:07:49.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.107+0000 7f0fbd7fa700 1 -- 172.21.15.49:0/761996233 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0fb8014650 con 0x7f0fc0066390 2023-11-30T17:07:49.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.107+0000 7f0fbd7fa700 1 --2- 172.21.15.49:0/761996233 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0fac05f150 0x7f0fac061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:49.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.108+0000 7f0fbd7fa700 1 -- 172.21.15.49:0/761996233 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0fb807a6f0 con 0x7f0fc0066390 2023-11-30T17:07:49.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.108+0000 7f0fc4aeb700 1 --2- 172.21.15.49:0/761996233 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0fac05f150 0x7f0fac061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:49.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.108+0000 7f0fc4aeb700 1 --2- 172.21.15.49:0/761996233 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0fac05f150 0x7f0fac061610 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f0fb4001d00 tx=0x7f0fb4001e70).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:49.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.112+0000 7f0fbd7fa700 1 -- 172.21.15.49:0/761996233 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0fb804b9c0 con 0x7f0fc0066390 2023-11-30T17:07:49.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.355+0000 7f0fc7550700 1 -- 172.21.15.49:0/761996233 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7f0fc006a620 con 0x7f0fc0066390 2023-11-30T17:07:49.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.757+0000 7f0fbd7fa700 1 -- 172.21.15.49:0/761996233 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v49) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0fb804efe0 con 0x7f0fc0066390 2023-11-30T17:07:49.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.759+0000 7f0fc7550700 1 -- 172.21.15.49:0/761996233 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0fac05f150 msgr2=0x7f0fac061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:49.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.759+0000 7f0fc7550700 1 --2- 172.21.15.49:0/761996233 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0fac05f150 0x7f0fac061610 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f0fb4001d00 tx=0x7f0fb4001e70).stop 2023-11-30T17:07:49.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.759+0000 7f0fc7550700 1 -- 172.21.15.49:0/761996233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fc0066390 msgr2=0x7f0fc0066770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:49.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.759+0000 7f0fc7550700 1 --2- 172.21.15.49:0/761996233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fc0066390 0x7f0fc0066770 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f0fb80119c0 tx=0x7f0fb8009060).stop 2023-11-30T17:07:49.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.759+0000 7f0fc7550700 1 -- 172.21.15.49:0/761996233 shutdown_connections 2023-11-30T17:07:49.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.759+0000 7f0fc7550700 1 --2- 172.21.15.49:0/761996233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fc014e7a0 0x7f0fc014ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:49.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.759+0000 7f0fc7550700 1 --2- 172.21.15.49:0/761996233 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0fac05f150 0x7f0fac061610 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:49.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.759+0000 7f0fc7550700 1 --2- 172.21.15.49:0/761996233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fc0066390 0x7f0fc0066770 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:49.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.759+0000 7f0fc7550700 1 --2- 172.21.15.49:0/761996233 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0fc00abdc0 0x7f0fc0164790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:49.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.759+0000 7f0fc7550700 1 -- 172.21.15.49:0/761996233 >> 172.21.15.49:0/761996233 conn(0x7f0fc00c7fd0 msgr2=0x7f0fc00a7080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:49.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.759+0000 7f0fc7550700 1 -- 172.21.15.49:0/761996233 shutdown_connections 2023-11-30T17:07:49.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.759+0000 7f0fc7550700 1 -- 172.21.15.49:0/761996233 wait complete. 2023-11-30T17:07:49.774 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-30T17:07:49.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.935+0000 7fa82149a700 1 Processor -- start 2023-11-30T17:07:49.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.935+0000 7fa82149a700 1 -- start start 2023-11-30T17:07:49.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.935+0000 7fa82149a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa81c158a30 0x7fa81c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:49.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.935+0000 7fa82149a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa81c0c72d0 con 0x7fa81c098d10 2023-11-30T17:07:49.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.936+0000 7fa82149a700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa81c064570 con 0x7fa81c0c6190 2023-11-30T17:07:49.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.936+0000 7fa82149a700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa81c154bc0 con 0x7fa81c158a30 2023-11-30T17:07:49.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.936+0000 7fa81affd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa81c098d10 0x7fa81c063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51852/0 (socket says 172.21.15.49:51852) 2023-11-30T17:07:49.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.936+0000 7fa81affd700 1 -- 172.21.15.49:0/3273259421 learned_addr learned my addr 172.21.15.49:0/3273259421 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:49.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.936+0000 7fa81b7fe700 1 --2- 172.21.15.49:0/3273259421 >> v2:172.21.15.115:3300/0 conn(0x7fa81c158a30 0x7fa81c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:49.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.936+0000 7fa819ffb700 1 -- 172.21.15.49:0/3273259421 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3346152690 0 0) 0x7fa81c0c72d0 con 0x7fa81c098d10 2023-11-30T17:07:49.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.936+0000 7fa819ffb700 1 -- 172.21.15.49:0/3273259421 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8040033f0 con 0x7fa81c098d10 2023-11-30T17:07:49.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.936+0000 7fa819ffb700 1 -- 172.21.15.49:0/3273259421 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3201675351 0 0) 0x7fa8040033f0 con 0x7fa81c098d10 2023-11-30T17:07:49.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.936+0000 7fa819ffb700 1 -- 172.21.15.49:0/3273259421 >> v2:172.21.15.115:3300/0 conn(0x7fa81c158a30 msgr2=0x7fa81c0c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:49.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.936+0000 7fa819ffb700 1 --2- 172.21.15.49:0/3273259421 >> v2:172.21.15.115:3300/0 conn(0x7fa81c158a30 0x7fa81c0c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:49.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.936+0000 7fa819ffb700 1 -- 172.21.15.49:0/3273259421 >> v1:172.21.15.115:6789/0 conn(0x7fa81c0c6190 legacy=0x7fa81c158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:49.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.936+0000 7fa819ffb700 1 -- 172.21.15.49:0/3273259421 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c0c66c0 con 0x7fa81c098d10 2023-11-30T17:07:49.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.936+0000 7fa819ffb700 1 -- 172.21.15.49:0/3273259421 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fa80c001470 con 0x7fa81c098d10 2023-11-30T17:07:49.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.936+0000 7fa819ffb700 1 -- 172.21.15.49:0/3273259421 >> v1:172.21.15.49:6789/0 conn(0x7fa81c098d10 legacy=0x7fa81c063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:49.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.936+0000 7fa819ffb700 1 --2- 172.21.15.49:0/3273259421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8040038e0 0x7fa804003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:49.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.936+0000 7fa819ffb700 1 --2- 172.21.15.49:0/3273259421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa804004690 0x7fa804004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:49.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.936+0000 7fa819ffb700 1 --2- 172.21.15.49:0/3273259421 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa804005000 0x7fa80400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:49.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.936+0000 7fa819ffb700 1 -- 172.21.15.49:0/3273259421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c154bc0 con 0x7fa8040038e0 2023-11-30T17:07:49.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.936+0000 7fa819ffb700 1 -- 172.21.15.49:0/3273259421 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80400beb0 con 0x7fa804004690 2023-11-30T17:07:49.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.936+0000 7fa819ffb700 1 -- 172.21.15.49:0/3273259421 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa80400c070 con 0x7fa804005000 2023-11-30T17:07:49.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.936+0000 7fa81affd700 1 --2- 172.21.15.49:0/3273259421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8040038e0 0x7fa804003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:49.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.936+0000 7fa81a7fc700 1 --2- 172.21.15.49:0/3273259421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa804004690 0x7fa804004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:49.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.937+0000 7fa81b7fe700 1 --2- 172.21.15.49:0/3273259421 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa804005000 0x7fa80400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:49.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.937+0000 7fa81affd700 1 -- 172.21.15.49:0/3273259421 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa804005000 msgr2=0x7fa80400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:49.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.937+0000 7fa81affd700 1 --2- 172.21.15.49:0/3273259421 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa804005000 0x7fa80400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:49.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.937+0000 7fa81affd700 1 -- 172.21.15.49:0/3273259421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa804004690 msgr2=0x7fa804004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:49.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.937+0000 7fa81affd700 1 --2- 172.21.15.49:0/3273259421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa804004690 0x7fa804004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:49.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.937+0000 7fa81affd700 1 -- 172.21.15.49:0/3273259421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8040033f0 con 0x7fa8040038e0 2023-11-30T17:07:49.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.937+0000 7fa81b7fe700 1 --2- 172.21.15.49:0/3273259421 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa804005000 0x7fa80400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:49.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.937+0000 7fa81b7fe700 1 -- 172.21.15.49:0/3273259421 reap_dead start 2023-11-30T17:07:49.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.937+0000 7fa81affd700 1 --2- 172.21.15.49:0/3273259421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8040038e0 0x7fa804003d00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fa80c00c160 tx=0x7fa81c0a8040).ready entity=mon.0 client_cookie=a2bcc51fa372cdb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:49.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.937+0000 7fa819ffb700 1 -- 172.21.15.49:0/3273259421 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c00ca90 con 0x7fa8040038e0 2023-11-30T17:07:49.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.937+0000 7fa819ffb700 1 -- 172.21.15.49:0/3273259421 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80c00cbf0 con 0x7fa8040038e0 2023-11-30T17:07:49.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.937+0000 7fa819ffb700 1 -- 172.21.15.49:0/3273259421 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c0070d0 con 0x7fa8040038e0 2023-11-30T17:07:49.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.937+0000 7fa82149a700 1 -- 172.21.15.49:0/3273259421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8040038e0 msgr2=0x7fa804003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:49.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.937+0000 7fa82149a700 1 --2- 172.21.15.49:0/3273259421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8040038e0 0x7fa804003d00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fa80c00c160 tx=0x7fa81c0a8040).stop 2023-11-30T17:07:49.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.937+0000 7fa82149a700 1 -- 172.21.15.49:0/3273259421 shutdown_connections 2023-11-30T17:07:49.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.937+0000 7fa82149a700 1 --2- 172.21.15.49:0/3273259421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8040038e0 0x7fa804003d00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:49.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.937+0000 7fa82149a700 1 -- 172.21.15.49:0/3273259421 >> 172.21.15.49:0/3273259421 conn(0x7fa81c0cb310 msgr2=0x7fa81c0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:49.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.938+0000 7fa82149a700 1 -- 172.21.15.49:0/3273259421 shutdown_connections 2023-11-30T17:07:49.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.938+0000 7fa82149a700 1 -- 172.21.15.49:0/3273259421 wait complete. 2023-11-30T17:07:49.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.939+0000 7fa82149a700 1 Processor -- start 2023-11-30T17:07:49.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.939+0000 7fa82149a700 1 -- start start 2023-11-30T17:07:49.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.939+0000 7fa82149a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8040038e0 0x7fa81c163ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:49.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.940+0000 7fa82149a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa81c150e40 0x7fa81c1512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:49.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.940+0000 7fa82149a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa81c156010 0x7fa81c156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:49.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.940+0000 7fa82149a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c1578e0 con 0x7fa8040038e0 2023-11-30T17:07:49.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.940+0000 7fa82149a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c1517b0 con 0x7fa81c150e40 2023-11-30T17:07:49.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.940+0000 7fa82149a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c156cd0 con 0x7fa81c156010 2023-11-30T17:07:49.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.940+0000 7fa81affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8040038e0 0x7fa81c163ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:49.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.940+0000 7fa81affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8040038e0 0x7fa81c163ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59844/0 (socket says 172.21.15.49:59844) 2023-11-30T17:07:49.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.940+0000 7fa81affd700 1 -- 172.21.15.49:0/736474710 learned_addr learned my addr 172.21.15.49:0/736474710 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:49.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.940+0000 7fa81a7fc700 1 --2- 172.21.15.49:0/736474710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa81c150e40 0x7fa81c1512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:49.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.940+0000 7fa81b7fe700 1 --2- 172.21.15.49:0/736474710 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa81c156010 0x7fa81c156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:49.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.940+0000 7fa81affd700 1 -- 172.21.15.49:0/736474710 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa81c156010 msgr2=0x7fa81c156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:49.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.940+0000 7fa81affd700 1 --2- 172.21.15.49:0/736474710 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa81c156010 0x7fa81c156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:49.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.940+0000 7fa81affd700 1 -- 172.21.15.49:0/736474710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa81c150e40 msgr2=0x7fa81c1512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:49.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.940+0000 7fa81affd700 1 --2- 172.21.15.49:0/736474710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa81c150e40 0x7fa81c1512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:49.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.940+0000 7fa81affd700 1 -- 172.21.15.49:0/736474710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c156fb0 con 0x7fa8040038e0 2023-11-30T17:07:49.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.940+0000 7fa81affd700 1 --2- 172.21.15.49:0/736474710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8040038e0 0x7fa81c163ea0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fa80c001d30 tx=0x7fa80c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:49.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.940+0000 7fa802ffd700 1 -- 172.21.15.49:0/736474710 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c0046b0 con 0x7fa8040038e0 2023-11-30T17:07:49.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.940+0000 7fa802ffd700 1 -- 172.21.15.49:0/736474710 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80c004810 con 0x7fa8040038e0 2023-11-30T17:07:49.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.940+0000 7fa82149a700 1 -- 172.21.15.49:0/736474710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa81c157290 con 0x7fa8040038e0 2023-11-30T17:07:49.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.940+0000 7fa802ffd700 1 -- 172.21.15.49:0/736474710 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c004b90 con 0x7fa8040038e0 2023-11-30T17:07:49.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.940+0000 7fa82149a700 1 -- 172.21.15.49:0/736474710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa81c156980 con 0x7fa8040038e0 2023-11-30T17:07:49.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.941+0000 7fa82149a700 1 -- 172.21.15.49:0/736474710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa81c157bc0 con 0x7fa8040038e0 2023-11-30T17:07:49.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.941+0000 7fa802ffd700 1 -- 172.21.15.49:0/736474710 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa80c013450 con 0x7fa8040038e0 2023-11-30T17:07:49.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.942+0000 7fa802ffd700 1 --2- 172.21.15.49:0/736474710 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa80805f120 0x7fa8080615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:49.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.942+0000 7fa802ffd700 1 -- 172.21.15.49:0/736474710 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa80c07af00 con 0x7fa8040038e0 2023-11-30T17:07:49.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.942+0000 7fa81a7fc700 1 --2- 172.21.15.49:0/736474710 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa80805f120 0x7fa8080615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:49.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.943+0000 7fa81a7fc700 1 --2- 172.21.15.49:0/736474710 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa80805f120 0x7fa8080615e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fa810007fd0 tx=0x7fa810007bb0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:49.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:49.946+0000 7fa802ffd700 1 -- 172.21.15.49:0/736474710 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa80c04c170 con 0x7fa8040038e0 2023-11-30T17:07:50.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.121+0000 7fa82149a700 1 -- 172.21.15.49:0/736474710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa81c06c860 con 0x7fa8040038e0 2023-11-30T17:07:50.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.124+0000 7fa802ffd700 1 -- 172.21.15.49:0/736474710 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa80c025070 con 0x7fa8040038e0 2023-11-30T17:07:50.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.126+0000 7fa82149a700 1 -- 172.21.15.49:0/736474710 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa80805f120 msgr2=0x7fa8080615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:50.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.126+0000 7fa82149a700 1 --2- 172.21.15.49:0/736474710 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa80805f120 0x7fa8080615e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fa810007fd0 tx=0x7fa810007bb0).stop 2023-11-30T17:07:50.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.126+0000 7fa82149a700 1 -- 172.21.15.49:0/736474710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8040038e0 msgr2=0x7fa81c163ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:50.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.126+0000 7fa82149a700 1 --2- 172.21.15.49:0/736474710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8040038e0 0x7fa81c163ea0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fa80c001d30 tx=0x7fa80c015000).stop 2023-11-30T17:07:50.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.126+0000 7fa82149a700 1 -- 172.21.15.49:0/736474710 shutdown_connections 2023-11-30T17:07:50.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.126+0000 7fa82149a700 1 --2- 172.21.15.49:0/736474710 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa81c156010 0x7fa81c156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:50.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.126+0000 7fa82149a700 1 --2- 172.21.15.49:0/736474710 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa80805f120 0x7fa8080615e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:50.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.126+0000 7fa82149a700 1 --2- 172.21.15.49:0/736474710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8040038e0 0x7fa81c163ea0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:50.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.126+0000 7fa82149a700 1 --2- 172.21.15.49:0/736474710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa81c150e40 0x7fa81c1512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:50.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.126+0000 7fa82149a700 1 -- 172.21.15.49:0/736474710 >> 172.21.15.49:0/736474710 conn(0x7fa81c0cb310 msgr2=0x7fa81c1533d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:50.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.126+0000 7fa82149a700 1 -- 172.21.15.49:0/736474710 shutdown_connections 2023-11-30T17:07:50.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.126+0000 7fa82149a700 1 -- 172.21.15.49:0/736474710 wait complete. 2023-11-30T17:07:50.141 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-30T17:07:50.141 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T17:07:50.183 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T17:07:50.226 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-30T17:07:50.226 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-30T17:07:50.226 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:07:50.226 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-11-30T17:07:50.262 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-11-30T17:07:50.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:50.262 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-30T17:07:50.317 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-30T17:07:50.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:07:50.318 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-11-30T17:07:50.356 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-11-30T17:07:50.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:50.356 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-30T17:07:50.413 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-11-30T17:07:50.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:07:50.413 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-11-30T17:07:50.447 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-11-30T17:07:50.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:50.447 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-30T17:07:50.502 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-11-30T17:07:50.502 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:07:50.503 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-11-30T17:07:50.551 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-11-30T17:07:50.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:07:50.552 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-30T17:07:50.568 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-30T17:07:50.569 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:07:50.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.683+0000 7ffafa831700 1 Processor -- start 2023-11-30T17:07:50.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.683+0000 7ffafa831700 1 -- start start 2023-11-30T17:07:50.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.684+0000 7ffafa831700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffaf41520c0 0x7ffaf4066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:50.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.684+0000 7ffafa831700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ffaf41524a0 0x7ffaf4066a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:50.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.684+0000 7ffafa831700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffaf4067a40 0x7ffaf4067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:50.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.684+0000 7ffafa831700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf40683e0 con 0x7ffaf4067a40 2023-11-30T17:07:50.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.684+0000 7ffafa831700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf40be110 con 0x7ffaf41524a0 2023-11-30T17:07:50.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.684+0000 7ffafa831700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf4066fc0 con 0x7ffaf41520c0 2023-11-30T17:07:50.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.684+0000 7ffaf8dce700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffaf4067a40 0x7ffaf4067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:50.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.685+0000 7ffaf8dce700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffaf4067a40 0x7ffaf4067ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47732/0 (socket says 172.21.15.49:47732) 2023-11-30T17:07:50.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.685+0000 7ffaf8dce700 1 -- 172.21.15.49:0/3465634179 learned_addr learned my addr 172.21.15.49:0/3465634179 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:50.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.685+0000 7ffaf8dce700 1 -- 172.21.15.49:0/3465634179 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffaf41520c0 msgr2=0x7ffaf4066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:50.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.685+0000 7ffaf8dce700 1 --2- 172.21.15.49:0/3465634179 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffaf41520c0 0x7ffaf4066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-30T17:07:50.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.685+0000 7ffaf8dce700 1 -- 172.21.15.49:0/3465634179 >> v2:172.21.15.115:3300/0 conn(0x7ffaf41524a0 msgr2=0x7ffaf4066a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:50.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.685+0000 7ffaf8dce700 1 --2- 172.21.15.49:0/3465634179 >> v2:172.21.15.115:3300/0 conn(0x7ffaf41524a0 0x7ffaf4066a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-30T17:07:50.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.685+0000 7ffaf8dce700 1 -- 172.21.15.49:0/3465634179 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf40672a0 con 0x7ffaf4067a40 2023-11-30T17:07:50.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.685+0000 7ffaf8dce700 1 --2- 172.21.15.49:0/3465634179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffaf4067a40 0x7ffaf4067ef0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7ffaf40af3a0 tx=0x7ffaec009840).ready entity=mon.0 client_cookie=d6e0c9b22433d05a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:50.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.685+0000 7ffaf2ffd700 1 -- 172.21.15.49:0/3465634179 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaec00e070 con 0x7ffaf4067a40 2023-11-30T17:07:50.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.685+0000 7ffaf2ffd700 1 -- 172.21.15.49:0/3465634179 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaec00ba50 con 0x7ffaf4067a40 2023-11-30T17:07:50.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.685+0000 7ffaf2ffd700 1 -- 172.21.15.49:0/3465634179 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaec00bdd0 con 0x7ffaf4067a40 2023-11-30T17:07:50.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.685+0000 7ffafa831700 1 -- 172.21.15.49:0/3465634179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffaf4067a40 msgr2=0x7ffaf4067ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:50.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.685+0000 7ffafa831700 1 --2- 172.21.15.49:0/3465634179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffaf4067a40 0x7ffaf4067ef0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7ffaf40af3a0 tx=0x7ffaec009840).stop 2023-11-30T17:07:50.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.686+0000 7ffafa831700 1 -- 172.21.15.49:0/3465634179 shutdown_connections 2023-11-30T17:07:50.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.686+0000 7ffafa831700 1 --2- 172.21.15.49:0/3465634179 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffaf41520c0 0x7ffaf4066520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-30T17:07:50.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.686+0000 7ffafa831700 1 --2- 172.21.15.49:0/3465634179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffaf4067a40 0x7ffaf4067ef0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:50.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.686+0000 7ffafa831700 1 --2- 172.21.15.49:0/3465634179 >> v2:172.21.15.115:3300/0 conn(0x7ffaf41524a0 0x7ffaf4066a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-30T17:07:50.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.686+0000 7ffafa831700 1 -- 172.21.15.49:0/3465634179 >> 172.21.15.49:0/3465634179 conn(0x7ffaf40631d0 msgr2=0x7ffaf40c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:50.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.686+0000 7ffafa831700 1 -- 172.21.15.49:0/3465634179 shutdown_connections 2023-11-30T17:07:50.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.686+0000 7ffafa831700 1 -- 172.21.15.49:0/3465634179 wait complete. 2023-11-30T17:07:50.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.687+0000 7ffafa831700 1 Processor -- start 2023-11-30T17:07:50.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.687+0000 7ffafa831700 1 -- start start 2023-11-30T17:07:50.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.688+0000 7ffafa831700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffaf4067a40 0x7ffaf4162f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:50.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.688+0000 7ffafa831700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffaf41520c0 0x7ffaf40c2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:50.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.688+0000 7ffafa831700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaf41524a0 0x7ffaf4156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:50.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.688+0000 7ffafa831700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf40c7c80 con 0x7ffaf41520c0 2023-11-30T17:07:50.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.688+0000 7ffafa831700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf4163430 con 0x7ffaf41524a0 2023-11-30T17:07:50.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.688+0000 7ffafa831700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf40c7070 con 0x7ffaf4067a40 2023-11-30T17:07:50.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.688+0000 7ffaf37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffaf41520c0 0x7ffaf40c2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:50.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.688+0000 7ffaf37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffaf41520c0 0x7ffaf40c2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47738/0 (socket says 172.21.15.49:47738) 2023-11-30T17:07:50.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.688+0000 7ffaf37fe700 1 -- 172.21.15.49:0/2933786063 learned_addr learned my addr 172.21.15.49:0/2933786063 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:50.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.688+0000 7ffaf3fff700 1 --2- 172.21.15.49:0/2933786063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffaf4067a40 0x7ffaf4162f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:50.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.688+0000 7ffaf8dce700 1 --2- 172.21.15.49:0/2933786063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaf41524a0 0x7ffaf4156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:50.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.688+0000 7ffaf37fe700 1 -- 172.21.15.49:0/2933786063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffaf4067a40 msgr2=0x7ffaf4162f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:50.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.688+0000 7ffaf37fe700 1 --2- 172.21.15.49:0/2933786063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffaf4067a40 0x7ffaf4162f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:50.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.688+0000 7ffaf37fe700 1 -- 172.21.15.49:0/2933786063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaf41524a0 msgr2=0x7ffaf4156e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:50.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.688+0000 7ffaf37fe700 1 --2- 172.21.15.49:0/2933786063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaf41524a0 0x7ffaf4156e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:50.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.688+0000 7ffaf37fe700 1 -- 172.21.15.49:0/2933786063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaec009ae0 con 0x7ffaf41520c0 2023-11-30T17:07:50.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.688+0000 7ffaf37fe700 1 --2- 172.21.15.49:0/2933786063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffaf41520c0 0x7ffaf40c2970 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7ffae800b410 tx=0x7ffae8006f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:50.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.689+0000 7ffadbfff700 1 -- 172.21.15.49:0/2933786063 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae8012410 con 0x7ffaf41520c0 2023-11-30T17:07:50.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.689+0000 7ffadbfff700 1 -- 172.21.15.49:0/2933786063 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae8012590 con 0x7ffaf41520c0 2023-11-30T17:07:50.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.689+0000 7ffafa831700 1 -- 172.21.15.49:0/2933786063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf40c7350 con 0x7ffaf41520c0 2023-11-30T17:07:50.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.689+0000 7ffadbfff700 1 -- 172.21.15.49:0/2933786063 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae8012950 con 0x7ffaf41520c0 2023-11-30T17:07:50.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.689+0000 7ffafa831700 1 -- 172.21.15.49:0/2933786063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf40c7910 con 0x7ffaf41520c0 2023-11-30T17:07:50.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.690+0000 7ffafa831700 1 -- 172.21.15.49:0/2933786063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf406c860 con 0x7ffaf41520c0 2023-11-30T17:07:50.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.690+0000 7ffadbfff700 1 -- 172.21.15.49:0/2933786063 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ffae8012cc0 con 0x7ffaf41520c0 2023-11-30T17:07:50.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.690+0000 7ffadbfff700 1 --2- 172.21.15.49:0/2933786063 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ffae005f150 0x7ffae0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:50.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.690+0000 7ffadbfff700 1 -- 172.21.15.49:0/2933786063 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ffae8079e30 con 0x7ffaf41520c0 2023-11-30T17:07:50.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.691+0000 7ffaf3fff700 1 --2- 172.21.15.49:0/2933786063 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ffae005f150 0x7ffae0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:50.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.691+0000 7ffaf3fff700 1 --2- 172.21.15.49:0/2933786063 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ffae005f150 0x7ffae0061610 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7ffaf41511e0 tx=0x7ffae4009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:50.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.694+0000 7ffadbfff700 1 -- 172.21.15.49:0/2933786063 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ffae804b100 con 0x7ffaf41520c0 2023-11-30T17:07:50.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.911+0000 7ffafa831700 1 -- 172.21.15.49:0/2933786063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffaf40be380 con 0x7ffaf41520c0 2023-11-30T17:07:50.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.912+0000 7ffadbfff700 1 -- 172.21.15.49:0/2933786063 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4486 (secure 0 0 0) 0x7ffae804e720 con 0x7ffaf41520c0 2023-11-30T17:07:50.915 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:50.915 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/4055676379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":4055676379},{"type":"v1","addr":"172.21.15.115:6835","nonce":4055676379}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1595689264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1595689264},{"type":"v1","addr":"172.21.15.115:6837","nonce":1595689264}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/124650277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":124650277},{"type":"v1","addr":"172.21.15.49:6834","nonce":124650277}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:07:16.282510+0000","modified":"2023-11-30T17:07:19.293997+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2333639572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2333639572},{"type":"v1","addr":"172.21.15.49:6835","nonce":2333639572}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-11-30T17:07:50.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.914+0000 7ffafa831700 1 -- 172.21.15.49:0/2933786063 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ffae005f150 msgr2=0x7ffae0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:50.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.914+0000 7ffafa831700 1 --2- 172.21.15.49:0/2933786063 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ffae005f150 0x7ffae0061610 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7ffaf41511e0 tx=0x7ffae4009060).stop 2023-11-30T17:07:50.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.914+0000 7ffafa831700 1 -- 172.21.15.49:0/2933786063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffaf41520c0 msgr2=0x7ffaf40c2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:50.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.914+0000 7ffafa831700 1 --2- 172.21.15.49:0/2933786063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffaf41520c0 0x7ffaf40c2970 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7ffae800b410 tx=0x7ffae8006f50).stop 2023-11-30T17:07:50.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.914+0000 7ffafa831700 1 -- 172.21.15.49:0/2933786063 shutdown_connections 2023-11-30T17:07:50.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.914+0000 7ffafa831700 1 --2- 172.21.15.49:0/2933786063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaf41524a0 0x7ffaf4156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:50.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.914+0000 7ffafa831700 1 --2- 172.21.15.49:0/2933786063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffaf4067a40 0x7ffaf4162f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:50.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.914+0000 7ffafa831700 1 --2- 172.21.15.49:0/2933786063 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ffae005f150 0x7ffae0061610 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:50.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.914+0000 7ffafa831700 1 --2- 172.21.15.49:0/2933786063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffaf41520c0 0x7ffaf40c2970 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:50.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.914+0000 7ffafa831700 1 -- 172.21.15.49:0/2933786063 >> 172.21.15.49:0/2933786063 conn(0x7ffaf40631d0 msgr2=0x7ffaf414df20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:50.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.914+0000 7ffafa831700 1 -- 172.21.15.49:0/2933786063 shutdown_connections 2023-11-30T17:07:50.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:50.914+0000 7ffafa831700 1 -- 172.21.15.49:0/2933786063 wait complete. 2023-11-30T17:07:50.917 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 8 2023-11-30T17:07:50.928 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:07:51.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.044+0000 7faa483c3700 1 Processor -- start 2023-11-30T17:07:51.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.044+0000 7faa483c3700 1 -- start start 2023-11-30T17:07:51.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.045+0000 7faa483c3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa400ca180 0x7faa4015f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:51.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.045+0000 7faa483c3700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa400a9a90 con 0x7faa400cae90 2023-11-30T17:07:51.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.045+0000 7faa483c3700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa40154ce0 con 0x7faa400caab0 2023-11-30T17:07:51.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.045+0000 7faa483c3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa400aab80 con 0x7faa400ca180 2023-11-30T17:07:51.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.045+0000 7faa4595e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7faa400cae90 0x7faa400c0ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49896/0 (socket says 172.21.15.49:49896) 2023-11-30T17:07:51.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.045+0000 7faa4595e700 1 -- 172.21.15.49:0/2641512180 learned_addr learned my addr 172.21.15.49:0/2641512180 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:51.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.045+0000 7faa46960700 1 --2- 172.21.15.49:0/2641512180 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa400ca180 0x7faa4015f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:51.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.046+0000 7faa4515d700 1 -- 172.21.15.49:0/2641512180 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1775342171 0 0) 0x7faa400a9a90 con 0x7faa400cae90 2023-11-30T17:07:51.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.046+0000 7faa4515d700 1 -- 172.21.15.49:0/2641512180 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa280033f0 con 0x7faa400cae90 2023-11-30T17:07:51.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.046+0000 7faa4515d700 1 -- 172.21.15.49:0/2641512180 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3616238398 0 0) 0x7faa40154ce0 con 0x7faa400caab0 2023-11-30T17:07:51.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.046+0000 7faa4515d700 1 -- 172.21.15.49:0/2641512180 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa400a9a90 con 0x7faa400caab0 2023-11-30T17:07:51.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.046+0000 7faa46960700 1 -- 172.21.15.49:0/2641512180 >> v1:172.21.15.115:6789/0 conn(0x7faa400caab0 legacy=0x7faa400aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:51.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.046+0000 7faa46960700 1 -- 172.21.15.49:0/2641512180 >> v1:172.21.15.49:6789/0 conn(0x7faa400cae90 legacy=0x7faa400c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:51.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.046+0000 7faa46960700 1 -- 172.21.15.49:0/2641512180 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa400a8e80 con 0x7faa400ca180 2023-11-30T17:07:51.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.046+0000 7faa46960700 1 --2- 172.21.15.49:0/2641512180 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa400ca180 0x7faa4015f3d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7faa30009790 tx=0x7faa30009060).ready entity=mon.2 client_cookie=42e722d09da20cfe server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:51.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.046+0000 7faa4515d700 1 -- 172.21.15.49:0/2641512180 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3000f510 con 0x7faa400ca180 2023-11-30T17:07:51.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.046+0000 7faa4515d700 1 -- 172.21.15.49:0/2641512180 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3000f670 con 0x7faa400ca180 2023-11-30T17:07:51.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.046+0000 7faa4515d700 1 -- 172.21.15.49:0/2641512180 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3000f9f0 con 0x7faa400ca180 2023-11-30T17:07:51.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.046+0000 7faa483c3700 1 -- 172.21.15.49:0/2641512180 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa400ca180 msgr2=0x7faa4015f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:51.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.046+0000 7faa483c3700 1 --2- 172.21.15.49:0/2641512180 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa400ca180 0x7faa4015f3d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7faa30009790 tx=0x7faa30009060).stop 2023-11-30T17:07:51.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.047+0000 7faa483c3700 1 -- 172.21.15.49:0/2641512180 shutdown_connections 2023-11-30T17:07:51.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.047+0000 7faa483c3700 1 --2- 172.21.15.49:0/2641512180 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa400ca180 0x7faa4015f3d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:51.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.047+0000 7faa483c3700 1 -- 172.21.15.49:0/2641512180 >> 172.21.15.49:0/2641512180 conn(0x7faa40094920 msgr2=0x7faa4006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:51.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.047+0000 7faa483c3700 1 -- 172.21.15.49:0/2641512180 shutdown_connections 2023-11-30T17:07:51.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.047+0000 7faa483c3700 1 -- 172.21.15.49:0/2641512180 wait complete. 2023-11-30T17:07:51.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.048+0000 7faa483c3700 1 Processor -- start 2023-11-30T17:07:51.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.048+0000 7faa483c3700 1 -- start start 2023-11-30T17:07:51.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.048+0000 7faa483c3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa400ca180 0x7faa400aad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:51.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.048+0000 7faa483c3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa400caab0 0x7faa40152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:51.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.048+0000 7faa483c3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa400cae90 0x7faa400c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:51.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.048+0000 7faa483c3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa40156d10 con 0x7faa400caab0 2023-11-30T17:07:51.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.048+0000 7faa483c3700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa40156420 con 0x7faa400cae90 2023-11-30T17:07:51.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.048+0000 7faa483c3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa401566c0 con 0x7faa400ca180 2023-11-30T17:07:51.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.049+0000 7faa4595e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa400caab0 0x7faa40152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:51.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.049+0000 7faa4595e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa400caab0 0x7faa40152590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47748/0 (socket says 172.21.15.49:47748) 2023-11-30T17:07:51.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.049+0000 7faa4595e700 1 -- 172.21.15.49:0/3402019210 learned_addr learned my addr 172.21.15.49:0/3402019210 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:51.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.049+0000 7faa46960700 1 --2- 172.21.15.49:0/3402019210 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa400cae90 0x7faa400c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:51.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.049+0000 7faa4615f700 1 --2- 172.21.15.49:0/3402019210 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa400ca180 0x7faa400aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:51.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.049+0000 7faa4595e700 1 -- 172.21.15.49:0/3402019210 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa400ca180 msgr2=0x7faa400aad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:51.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.049+0000 7faa4595e700 1 --2- 172.21.15.49:0/3402019210 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa400ca180 0x7faa400aad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:51.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.049+0000 7faa4595e700 1 -- 172.21.15.49:0/3402019210 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa400cae90 msgr2=0x7faa400c62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:51.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.049+0000 7faa4595e700 1 --2- 172.21.15.49:0/3402019210 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa400cae90 0x7faa400c62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:51.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.049+0000 7faa4595e700 1 -- 172.21.15.49:0/3402019210 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa300092a0 con 0x7faa400caab0 2023-11-30T17:07:51.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.049+0000 7faa4595e700 1 --2- 172.21.15.49:0/3402019210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa400caab0 0x7faa40152590 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7faa3400c490 tx=0x7faa34007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:51.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.049+0000 7faa3e7fc700 1 -- 172.21.15.49:0/3402019210 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa340072e0 con 0x7faa400caab0 2023-11-30T17:07:51.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.049+0000 7faa3e7fc700 1 -- 172.21.15.49:0/3402019210 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa34007440 con 0x7faa400caab0 2023-11-30T17:07:51.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.049+0000 7faa483c3700 1 -- 172.21.15.49:0/3402019210 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa401569a0 con 0x7faa400caab0 2023-11-30T17:07:51.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.049+0000 7faa3e7fc700 1 -- 172.21.15.49:0/3402019210 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa340057a0 con 0x7faa400caab0 2023-11-30T17:07:51.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.049+0000 7faa483c3700 1 -- 172.21.15.49:0/3402019210 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa40152a80 con 0x7faa400caab0 2023-11-30T17:07:51.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.050+0000 7faa483c3700 1 -- 172.21.15.49:0/3402019210 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa4006c860 con 0x7faa400caab0 2023-11-30T17:07:51.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.051+0000 7faa3e7fc700 1 -- 172.21.15.49:0/3402019210 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7faa34005b90 con 0x7faa400caab0 2023-11-30T17:07:51.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.051+0000 7faa3e7fc700 1 --2- 172.21.15.49:0/3402019210 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faa2c05f120 0x7faa2c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:51.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.051+0000 7faa3e7fc700 1 -- 172.21.15.49:0/3402019210 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faa34079a00 con 0x7faa400caab0 2023-11-30T17:07:51.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.051+0000 7faa4615f700 1 --2- 172.21.15.49:0/3402019210 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faa2c05f120 0x7faa2c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:51.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.052+0000 7faa4615f700 1 --2- 172.21.15.49:0/3402019210 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faa2c05f120 0x7faa2c0615e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7faa38003e40 tx=0x7faa38009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:51.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.055+0000 7faa3e7fc700 1 -- 172.21.15.49:0/3402019210 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7faa3404acd0 con 0x7faa400caab0 2023-11-30T17:07:51.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.231+0000 7faa483c3700 1 -- 172.21.15.49:0/3402019210 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa400a9160 con 0x7faa400caab0 2023-11-30T17:07:51.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.232+0000 7faa3e7fc700 1 -- 172.21.15.49:0/3402019210 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16928 (secure 0 0 0) 0x7faa3404e2f0 con 0x7faa400caab0 2023-11-30T17:07:51.235 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:51.235 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":22,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:07:17.283998+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:07:14.837882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-30T17:07:15.248549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:07:51.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.234+0000 7faa483c3700 1 -- 172.21.15.49:0/3402019210 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faa2c05f120 msgr2=0x7faa2c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:51.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.234+0000 7faa483c3700 1 --2- 172.21.15.49:0/3402019210 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faa2c05f120 0x7faa2c0615e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7faa38003e40 tx=0x7faa38009040).stop 2023-11-30T17:07:51.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.234+0000 7faa483c3700 1 -- 172.21.15.49:0/3402019210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa400caab0 msgr2=0x7faa40152590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:51.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.234+0000 7faa483c3700 1 --2- 172.21.15.49:0/3402019210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa400caab0 0x7faa40152590 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7faa3400c490 tx=0x7faa34007d20).stop 2023-11-30T17:07:51.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.234+0000 7faa483c3700 1 -- 172.21.15.49:0/3402019210 shutdown_connections 2023-11-30T17:07:51.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.234+0000 7faa483c3700 1 --2- 172.21.15.49:0/3402019210 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa400cae90 0x7faa400c62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:51.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.234+0000 7faa483c3700 1 --2- 172.21.15.49:0/3402019210 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa400ca180 0x7faa400aad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:51.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.234+0000 7faa483c3700 1 --2- 172.21.15.49:0/3402019210 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faa2c05f120 0x7faa2c0615e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:51.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.234+0000 7faa483c3700 1 --2- 172.21.15.49:0/3402019210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa400caab0 0x7faa40152590 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:51.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.234+0000 7faa483c3700 1 -- 172.21.15.49:0/3402019210 >> 172.21.15.49:0/3402019210 conn(0x7faa40094920 msgr2=0x7faa400aa440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:51.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.234+0000 7faa483c3700 1 -- 172.21.15.49:0/3402019210 shutdown_connections 2023-11-30T17:07:51.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.234+0000 7faa483c3700 1 -- 172.21.15.49:0/3402019210 wait complete. 2023-11-30T17:07:51.249 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-30T17:07:14.837882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-30T17:07:15.248549+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-30T17:07:51.249 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T17:07:51.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.367+0000 7f6d9a517700 1 Processor -- start 2023-11-30T17:07:51.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.367+0000 7f6d9a517700 1 -- start start 2023-11-30T17:07:51.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.368+0000 7f6d9a517700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6d94098d10 0x7f6d940c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:51.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.368+0000 7f6d9a517700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d940c6190 0x7f6d94063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:51.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.368+0000 7f6d9a517700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6d94064350 0x7f6d94158320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:51.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.368+0000 7f6d9a517700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d940c72d0 con 0x7f6d94064350 2023-11-30T17:07:51.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.368+0000 7f6d9a517700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d94154bc0 con 0x7f6d94098d10 2023-11-30T17:07:51.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.368+0000 7f6d9a517700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d940c66c0 con 0x7f6d940c6190 2023-11-30T17:07:51.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.368+0000 7f6d98ab4700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6d94064350 0x7f6d94158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:51.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.368+0000 7f6d98ab4700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6d94064350 0x7f6d94158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47760/0 (socket says 172.21.15.49:47760) 2023-11-30T17:07:51.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.368+0000 7f6d98ab4700 1 -- 172.21.15.49:0/973962577 learned_addr learned my addr 172.21.15.49:0/973962577 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:51.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.368+0000 7f6d93fff700 1 --2- 172.21.15.49:0/973962577 >> v2:172.21.15.115:3300/0 conn(0x7f6d94098d10 0x7f6d940c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:51.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.368+0000 7f6d98ab4700 1 -- 172.21.15.49:0/973962577 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d940c6190 msgr2=0x7f6d94063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:51.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.369+0000 7f6d937fe700 1 --2- 172.21.15.49:0/973962577 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d940c6190 0x7f6d94063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:51.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.369+0000 7f6d98ab4700 1 --2- 172.21.15.49:0/973962577 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d940c6190 0x7f6d94063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:51.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.369+0000 7f6d98ab4700 1 -- 172.21.15.49:0/973962577 >> v2:172.21.15.115:3300/0 conn(0x7f6d94098d10 msgr2=0x7f6d940c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:51.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.369+0000 7f6d98ab4700 1 --2- 172.21.15.49:0/973962577 >> v2:172.21.15.115:3300/0 conn(0x7f6d94098d10 0x7f6d940c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:51.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.369+0000 7f6d98ab4700 1 -- 172.21.15.49:0/973962577 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d940c69a0 con 0x7f6d94064350 2023-11-30T17:07:51.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.369+0000 7f6d93fff700 1 --2- 172.21.15.49:0/973962577 >> v2:172.21.15.115:3300/0 conn(0x7f6d94098d10 0x7f6d940c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:51.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.369+0000 7f6d937fe700 1 --2- 172.21.15.49:0/973962577 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d940c6190 0x7f6d94063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:51.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.369+0000 7f6d98ab4700 1 --2- 172.21.15.49:0/973962577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d94064350 0x7f6d94158320 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f6d94083f80 tx=0x7f6d8c009840).ready entity=mon.0 client_cookie=57cd03b3ca298eb1 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:51.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.369+0000 7f6d92ffd700 1 -- 172.21.15.49:0/973962577 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c00e070 con 0x7f6d94064350 2023-11-30T17:07:51.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.369+0000 7f6d92ffd700 1 -- 172.21.15.49:0/973962577 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8c00ba50 con 0x7f6d94064350 2023-11-30T17:07:51.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.369+0000 7f6d92ffd700 1 -- 172.21.15.49:0/973962577 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c00bdd0 con 0x7f6d94064350 2023-11-30T17:07:51.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.369+0000 7f6d9a517700 1 -- 172.21.15.49:0/973962577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d94064350 msgr2=0x7f6d94158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:51.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.369+0000 7f6d9a517700 1 --2- 172.21.15.49:0/973962577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d94064350 0x7f6d94158320 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f6d94083f80 tx=0x7f6d8c009840).stop 2023-11-30T17:07:51.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.369+0000 7f6d9a517700 1 -- 172.21.15.49:0/973962577 shutdown_connections 2023-11-30T17:07:51.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.369+0000 7f6d9a517700 1 --2- 172.21.15.49:0/973962577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d94064350 0x7f6d94158320 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:51.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.369+0000 7f6d9a517700 1 --2- 172.21.15.49:0/973962577 >> v2:172.21.15.115:3300/0 conn(0x7f6d94098d10 0x7f6d940c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:51.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.369+0000 7f6d9a517700 1 --2- 172.21.15.49:0/973962577 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d940c6190 0x7f6d94063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:51.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.369+0000 7f6d9a517700 1 -- 172.21.15.49:0/973962577 >> 172.21.15.49:0/973962577 conn(0x7f6d940cb310 msgr2=0x7f6d940cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:51.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.369+0000 7f6d9a517700 1 -- 172.21.15.49:0/973962577 shutdown_connections 2023-11-30T17:07:51.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.369+0000 7f6d9a517700 1 -- 172.21.15.49:0/973962577 wait complete. 2023-11-30T17:07:51.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.370+0000 7f6d9a517700 1 Processor -- start 2023-11-30T17:07:51.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.371+0000 7f6d9a517700 1 -- start start 2023-11-30T17:07:51.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.371+0000 7f6d9a517700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d94064350 0x7f6d941575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:51.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.371+0000 7f6d9a517700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d94098d10 0x7f6d94142b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:51.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.371+0000 7f6d9a517700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d940c6190 0x7f6d94142ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:51.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.371+0000 7f6d9a517700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d940adb60 con 0x7f6d94098d10 2023-11-30T17:07:51.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.371+0000 7f6d9a517700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d94155260 con 0x7f6d94064350 2023-11-30T17:07:51.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.371+0000 7f6d9a517700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d941434e0 con 0x7f6d940c6190 2023-11-30T17:07:51.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.371+0000 7f6d937fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d94098d10 0x7f6d94142b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:51.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.372+0000 7f6d937fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d94098d10 0x7f6d94142b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47764/0 (socket says 172.21.15.49:47764) 2023-11-30T17:07:51.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.372+0000 7f6d937fe700 1 -- 172.21.15.49:0/523849949 learned_addr learned my addr 172.21.15.49:0/523849949 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:51.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.372+0000 7f6d93fff700 1 --2- 172.21.15.49:0/523849949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d94064350 0x7f6d941575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:51.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.372+0000 7f6d98ab4700 1 --2- 172.21.15.49:0/523849949 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d940c6190 0x7f6d94142ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:51.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.372+0000 7f6d937fe700 1 -- 172.21.15.49:0/523849949 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d940c6190 msgr2=0x7f6d94142ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:51.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.372+0000 7f6d937fe700 1 --2- 172.21.15.49:0/523849949 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d940c6190 0x7f6d94142ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:51.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.372+0000 7f6d937fe700 1 -- 172.21.15.49:0/523849949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d94064350 msgr2=0x7f6d941575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:51.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.372+0000 7f6d937fe700 1 --2- 172.21.15.49:0/523849949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d94064350 0x7f6d941575c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:51.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.372+0000 7f6d937fe700 1 -- 172.21.15.49:0/523849949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8c009ae0 con 0x7f6d94098d10 2023-11-30T17:07:51.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.372+0000 7f6d937fe700 1 --2- 172.21.15.49:0/523849949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d94098d10 0x7f6d94142b00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f6d8800c880 tx=0x7f6d88008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:51.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.372+0000 7f6d7bfff700 1 -- 172.21.15.49:0/523849949 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d88010580 con 0x7f6d94098d10 2023-11-30T17:07:51.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.372+0000 7f6d7bfff700 1 -- 172.21.15.49:0/523849949 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d880106e0 con 0x7f6d94098d10 2023-11-30T17:07:51.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.372+0000 7f6d9a517700 1 -- 172.21.15.49:0/523849949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d940ad5a0 con 0x7f6d94098d10 2023-11-30T17:07:51.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.372+0000 7f6d7bfff700 1 -- 172.21.15.49:0/523849949 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d88010a60 con 0x7f6d94098d10 2023-11-30T17:07:51.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.372+0000 7f6d9a517700 1 -- 172.21.15.49:0/523849949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d94154ef0 con 0x7f6d94098d10 2023-11-30T17:07:51.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.373+0000 7f6d9a517700 1 -- 172.21.15.49:0/523849949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d941553d0 con 0x7f6d94098d10 2023-11-30T17:07:51.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.373+0000 7f6d7bfff700 1 -- 172.21.15.49:0/523849949 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6d8801b460 con 0x7f6d94098d10 2023-11-30T17:07:51.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.374+0000 7f6d7bfff700 1 --2- 172.21.15.49:0/523849949 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6d8005f150 0x7f6d80061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:51.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.374+0000 7f6d7bfff700 1 -- 172.21.15.49:0/523849949 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6d8807a020 con 0x7f6d94098d10 2023-11-30T17:07:51.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.374+0000 7f6d93fff700 1 --2- 172.21.15.49:0/523849949 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6d8005f150 0x7f6d80061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:51.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.375+0000 7f6d93fff700 1 --2- 172.21.15.49:0/523849949 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6d8005f150 0x7f6d80061610 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f6d8400abd0 tx=0x7f6d84008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:51.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.378+0000 7f6d7bfff700 1 -- 172.21.15.49:0/523849949 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6d8804b290 con 0x7f6d94098d10 2023-11-30T17:07:51.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.551+0000 7f6d9a517700 1 -- 172.21.15.49:0/523849949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6d9406c860 con 0x7f6d94098d10 2023-11-30T17:07:51.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.552+0000 7f6d7bfff700 1 -- 172.21.15.49:0/523849949 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6d8804e8b0 con 0x7f6d94098d10 2023-11-30T17:07:51.554 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T17:07:51.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.554+0000 7f6d9a517700 1 -- 172.21.15.49:0/523849949 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6d8005f150 msgr2=0x7f6d80061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:51.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.554+0000 7f6d9a517700 1 --2- 172.21.15.49:0/523849949 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6d8005f150 0x7f6d80061610 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f6d8400abd0 tx=0x7f6d84008040).stop 2023-11-30T17:07:51.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.554+0000 7f6d9a517700 1 -- 172.21.15.49:0/523849949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d94098d10 msgr2=0x7f6d94142b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:51.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.554+0000 7f6d9a517700 1 --2- 172.21.15.49:0/523849949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d94098d10 0x7f6d94142b00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f6d8800c880 tx=0x7f6d88008040).stop 2023-11-30T17:07:51.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.554+0000 7f6d9a517700 1 -- 172.21.15.49:0/523849949 shutdown_connections 2023-11-30T17:07:51.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.554+0000 7f6d9a517700 1 --2- 172.21.15.49:0/523849949 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d940c6190 0x7f6d94142ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:51.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.554+0000 7f6d9a517700 1 --2- 172.21.15.49:0/523849949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d94064350 0x7f6d941575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:51.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.554+0000 7f6d9a517700 1 --2- 172.21.15.49:0/523849949 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6d8005f150 0x7f6d80061610 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:51.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.554+0000 7f6d9a517700 1 --2- 172.21.15.49:0/523849949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d94098d10 0x7f6d94142b00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:51.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.554+0000 7f6d9a517700 1 -- 172.21.15.49:0/523849949 >> 172.21.15.49:0/523849949 conn(0x7f6d940cb310 msgr2=0x7f6d940ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:51.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.554+0000 7f6d9a517700 1 -- 172.21.15.49:0/523849949 shutdown_connections 2023-11-30T17:07:51.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.554+0000 7f6d9a517700 1 -- 172.21.15.49:0/523849949 wait complete. 2023-11-30T17:07:51.568 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T17:07:51.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.686+0000 7f61e7d59700 1 Processor -- start 2023-11-30T17:07:51.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.686+0000 7f61e7d59700 1 -- start start 2023-11-30T17:07:51.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.687+0000 7f61e7d59700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f61e0098d10 0x7f61e00c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:51.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.687+0000 7f61e7d59700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f61e0158320 0x7f61e01587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:51.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.687+0000 7f61e7d59700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e0158cc0 con 0x7f61e00c6190 2023-11-30T17:07:51.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.687+0000 7f61e7d59700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61e00c72d0 con 0x7f61e0098d10 2023-11-30T17:07:51.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.687+0000 7f61e7d59700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61e0064570 con 0x7f61e0158320 2023-11-30T17:07:51.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.687+0000 7f61e5af5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f61e0098d10 0x7f61e00c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:51.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.687+0000 7f61e5af5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f61e0098d10 0x7f61e00c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47778/0 (socket says 172.21.15.49:47778) 2023-11-30T17:07:51.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.687+0000 7f61e5af5700 1 -- 172.21.15.49:0/3539169757 learned_addr learned my addr 172.21.15.49:0/3539169757 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:51.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.687+0000 7f61e62f6700 1 --2- 172.21.15.49:0/3539169757 >> v2:172.21.15.115:3300/0 conn(0x7f61e0158320 0x7f61e01587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:51.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.687+0000 7f61e5af5700 1 -- 172.21.15.49:0/3539169757 >> v2:172.21.15.115:3300/0 conn(0x7f61e0158320 msgr2=0x7f61e01587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:51.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.687+0000 7f61e5af5700 1 --2- 172.21.15.49:0/3539169757 >> v2:172.21.15.115:3300/0 conn(0x7f61e0158320 0x7f61e01587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:51.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.687+0000 7f61e5af5700 1 -- 172.21.15.49:0/3539169757 >> v1:172.21.15.115:6789/0 conn(0x7f61e00c6190 legacy=0x7f61e0063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:51.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.687+0000 7f61e5af5700 1 -- 172.21.15.49:0/3539169757 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e0154bc0 con 0x7f61e0098d10 2023-11-30T17:07:51.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.687+0000 7f61e5af5700 1 --2- 172.21.15.49:0/3539169757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61e0098d10 0x7f61e00c7760 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f61e00657a0 tx=0x7f61d00090f0).ready entity=mon.0 client_cookie=258ae930ef7f38d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:51.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.687+0000 7f61e4af3700 1 -- 172.21.15.49:0/3539169757 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d000b600 con 0x7f61e0098d10 2023-11-30T17:07:51.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.688+0000 7f61e4af3700 1 -- 172.21.15.49:0/3539169757 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d000b760 con 0x7f61e0098d10 2023-11-30T17:07:51.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.688+0000 7f61e4af3700 1 -- 172.21.15.49:0/3539169757 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d000bae0 con 0x7f61e0098d10 2023-11-30T17:07:51.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.688+0000 7f61e7d59700 1 -- 172.21.15.49:0/3539169757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61e0098d10 msgr2=0x7f61e00c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:51.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.688+0000 7f61e7d59700 1 --2- 172.21.15.49:0/3539169757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61e0098d10 0x7f61e00c7760 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f61e00657a0 tx=0x7f61d00090f0).stop 2023-11-30T17:07:51.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.688+0000 7f61e7d59700 1 -- 172.21.15.49:0/3539169757 shutdown_connections 2023-11-30T17:07:51.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.688+0000 7f61e7d59700 1 --2- 172.21.15.49:0/3539169757 >> v2:172.21.15.115:3300/0 conn(0x7f61e0158320 0x7f61e01587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:51.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.688+0000 7f61e7d59700 1 --2- 172.21.15.49:0/3539169757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61e0098d10 0x7f61e00c7760 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:51.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.688+0000 7f61e7d59700 1 -- 172.21.15.49:0/3539169757 >> 172.21.15.49:0/3539169757 conn(0x7f61e00cb310 msgr2=0x7f61e00cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:51.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.688+0000 7f61e7d59700 1 -- 172.21.15.49:0/3539169757 shutdown_connections 2023-11-30T17:07:51.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.688+0000 7f61e7d59700 1 -- 172.21.15.49:0/3539169757 wait complete. 2023-11-30T17:07:51.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.689+0000 7f61e7d59700 1 Processor -- start 2023-11-30T17:07:51.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.689+0000 7f61e7d59700 1 -- start start 2023-11-30T17:07:51.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.690+0000 7f61e7d59700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61e0098d10 0x7f61e0155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:51.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.690+0000 7f61e7d59700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61e00c6190 0x7f61e00a95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:51.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.690+0000 7f61e7d59700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61e0158320 0x7f61e00a9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:51.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.690+0000 7f61e7d59700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e0156280 con 0x7f61e00c6190 2023-11-30T17:07:51.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.690+0000 7f61e7d59700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e00a9fc0 con 0x7f61e0158320 2023-11-30T17:07:51.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.690+0000 7f61e7d59700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e00c38e0 con 0x7f61e0098d10 2023-11-30T17:07:51.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.690+0000 7f61e52f4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61e00c6190 0x7f61e00a95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:51.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.690+0000 7f61e52f4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61e00c6190 0x7f61e00a95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47788/0 (socket says 172.21.15.49:47788) 2023-11-30T17:07:51.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.690+0000 7f61e52f4700 1 -- 172.21.15.49:0/3374312147 learned_addr learned my addr 172.21.15.49:0/3374312147 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:51.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.690+0000 7f61e62f6700 1 --2- 172.21.15.49:0/3374312147 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61e0158320 0x7f61e00a9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:51.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.691+0000 7f61e5af5700 1 --2- 172.21.15.49:0/3374312147 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61e0098d10 0x7f61e0155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:51.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.691+0000 7f61e52f4700 1 -- 172.21.15.49:0/3374312147 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61e0098d10 msgr2=0x7f61e0155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:51.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.691+0000 7f61e52f4700 1 --2- 172.21.15.49:0/3374312147 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61e0098d10 0x7f61e0155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:51.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.691+0000 7f61e52f4700 1 -- 172.21.15.49:0/3374312147 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61e0158320 msgr2=0x7f61e00a9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:51.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.691+0000 7f61e52f4700 1 --2- 172.21.15.49:0/3374312147 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61e0158320 0x7f61e00a9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:51.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.691+0000 7f61e52f4700 1 -- 172.21.15.49:0/3374312147 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d0009370 con 0x7f61e00c6190 2023-11-30T17:07:51.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.691+0000 7f61e52f4700 1 --2- 172.21.15.49:0/3374312147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61e00c6190 0x7f61e00a95e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f61d400c4c0 tx=0x7f61d4007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:51.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.691+0000 7f61ddffb700 1 -- 172.21.15.49:0/3374312147 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d400ce10 con 0x7f61e00c6190 2023-11-30T17:07:51.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.691+0000 7f61ddffb700 1 -- 172.21.15.49:0/3374312147 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d4007020 con 0x7f61e00c6190 2023-11-30T17:07:51.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.691+0000 7f61e7d59700 1 -- 172.21.15.49:0/3374312147 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e01559e0 con 0x7f61e00c6190 2023-11-30T17:07:51.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.691+0000 7f61ddffb700 1 -- 172.21.15.49:0/3374312147 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d40073c0 con 0x7f61e00c6190 2023-11-30T17:07:51.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.691+0000 7f61e7d59700 1 -- 172.21.15.49:0/3374312147 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e0155fa0 con 0x7f61e00c6190 2023-11-30T17:07:51.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.692+0000 7f61e7d59700 1 -- 172.21.15.49:0/3374312147 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e00c36b0 con 0x7f61e00c6190 2023-11-30T17:07:51.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.692+0000 7f61ddffb700 1 -- 172.21.15.49:0/3374312147 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f61d40068b0 con 0x7f61e00c6190 2023-11-30T17:07:51.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.693+0000 7f61ddffb700 1 --2- 172.21.15.49:0/3374312147 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f61cc05f150 0x7f61cc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:51.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.693+0000 7f61ddffb700 1 -- 172.21.15.49:0/3374312147 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f61d4079310 con 0x7f61e00c6190 2023-11-30T17:07:51.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.693+0000 7f61e5af5700 1 --2- 172.21.15.49:0/3374312147 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f61cc05f150 0x7f61cc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:51.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.693+0000 7f61e5af5700 1 --2- 172.21.15.49:0/3374312147 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f61cc05f150 0x7f61cc061610 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f61d0009fd0 tx=0x7f61d0017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:51.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.697+0000 7f61ddffb700 1 -- 172.21.15.49:0/3374312147 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f61d4047b00 con 0x7f61e00c6190 2023-11-30T17:07:51.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.872+0000 7f61e7d59700 1 -- 172.21.15.49:0/3374312147 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f61e0158cc0 con 0x7f61e00c6190 2023-11-30T17:07:51.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.872+0000 7f61ddffb700 1 -- 172.21.15.49:0/3374312147 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f61e0158cc0 con 0x7f61e00c6190 2023-11-30T17:07:51.875 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T17:07:51.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.874+0000 7f61e7d59700 1 -- 172.21.15.49:0/3374312147 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f61cc05f150 msgr2=0x7f61cc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:51.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.874+0000 7f61e7d59700 1 --2- 172.21.15.49:0/3374312147 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f61cc05f150 0x7f61cc061610 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f61d0009fd0 tx=0x7f61d0017000).stop 2023-11-30T17:07:51.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.874+0000 7f61e7d59700 1 -- 172.21.15.49:0/3374312147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61e00c6190 msgr2=0x7f61e00a95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:51.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.874+0000 7f61e7d59700 1 --2- 172.21.15.49:0/3374312147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61e00c6190 0x7f61e00a95e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f61d400c4c0 tx=0x7f61d4007dd0).stop 2023-11-30T17:07:51.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.874+0000 7f61e7d59700 1 -- 172.21.15.49:0/3374312147 shutdown_connections 2023-11-30T17:07:51.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.874+0000 7f61e7d59700 1 --2- 172.21.15.49:0/3374312147 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61e0158320 0x7f61e00a9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:51.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.874+0000 7f61e7d59700 1 --2- 172.21.15.49:0/3374312147 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f61e0098d10 0x7f61e0155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:51.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.874+0000 7f61e7d59700 1 --2- 172.21.15.49:0/3374312147 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f61cc05f150 0x7f61cc061610 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:51.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.874+0000 7f61e7d59700 1 --2- 172.21.15.49:0/3374312147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61e00c6190 0x7f61e00a95e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:51.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.874+0000 7f61e7d59700 1 -- 172.21.15.49:0/3374312147 >> 172.21.15.49:0/3374312147 conn(0x7f61e00cb310 msgr2=0x7f61e014c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:51.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.874+0000 7f61e7d59700 1 -- 172.21.15.49:0/3374312147 shutdown_connections 2023-11-30T17:07:51.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:51.874+0000 7f61e7d59700 1 -- 172.21.15.49:0/3374312147 wait complete. 2023-11-30T17:07:51.889 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-30T17:07:52.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.007+0000 7f7c27125700 1 Processor -- start 2023-11-30T17:07:52.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.007+0000 7f7c27125700 1 -- start start 2023-11-30T17:07:52.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.008+0000 7f7c27125700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c20152510 0x7f7c200a67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:52.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.008+0000 7f7c27125700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7c200c6950 0x7f7c2015c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:52.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.008+0000 7f7c27125700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c20064090 con 0x7f7c200a6cd0 2023-11-30T17:07:52.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.008+0000 7f7c27125700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c20063480 con 0x7f7c200c6950 2023-11-30T17:07:52.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.008+0000 7f7c27125700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c20063760 con 0x7f7c20152510 2023-11-30T17:07:52.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.008+0000 7f7c256c2700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7c200c6950 0x7f7c2015c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:52.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.008+0000 7f7c24ec1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c20152510 0x7f7c200a67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:52.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.008+0000 7f7c256c2700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7c200c6950 0x7f7c2015c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:46106/0 (socket says 172.21.15.49:46106) 2023-11-30T17:07:52.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.008+0000 7f7c256c2700 1 -- 172.21.15.49:0/3688522401 learned_addr learned my addr 172.21.15.49:0/3688522401 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:52.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.008+0000 7f7c1ffff700 1 --1- 172.21.15.49:0/3688522401 >> v1:172.21.15.115:6789/0 conn(0x7f7c200a6cd0 0x7f7c200bc6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:46526/0 (socket says 172.21.15.49:46526) 2023-11-30T17:07:52.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.009+0000 7f7c256c2700 1 -- 172.21.15.49:0/3688522401 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c20152510 msgr2=0x7f7c200a67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:52.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.009+0000 7f7c256c2700 1 --2- 172.21.15.49:0/3688522401 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c20152510 0x7f7c200a67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:52.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.009+0000 7f7c256c2700 1 -- 172.21.15.49:0/3688522401 >> v1:172.21.15.115:6789/0 conn(0x7f7c200a6cd0 legacy=0x7f7c200bc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:52.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.009+0000 7f7c1f7fe700 1 -- 172.21.15.49:0/3688522401 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1721781598 0 0) 0x7f7c20064090 con 0x7f7c200a6cd0 2023-11-30T17:07:52.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.009+0000 7f7c256c2700 1 -- 172.21.15.49:0/3688522401 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c20063a40 con 0x7f7c200c6950 2023-11-30T17:07:52.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.009+0000 7f7c256c2700 1 --2- 172.21.15.49:0/3688522401 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c200c6950 0x7f7c2015c170 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f7c18009f20 tx=0x7f7c18009840).ready entity=mon.1 client_cookie=b78b3c3ace146384 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:52.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.009+0000 7f7c1f7fe700 1 -- 172.21.15.49:0/3688522401 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1800e070 con 0x7f7c200c6950 2023-11-30T17:07:52.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.009+0000 7f7c1f7fe700 1 -- 172.21.15.49:0/3688522401 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1800b9d0 con 0x7f7c200c6950 2023-11-30T17:07:52.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.009+0000 7f7c1f7fe700 1 -- 172.21.15.49:0/3688522401 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1800bd50 con 0x7f7c200c6950 2023-11-30T17:07:52.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.009+0000 7f7c27125700 1 -- 172.21.15.49:0/3688522401 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c200c6950 msgr2=0x7f7c2015c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:52.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.009+0000 7f7c27125700 1 --2- 172.21.15.49:0/3688522401 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c200c6950 0x7f7c2015c170 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f7c18009f20 tx=0x7f7c18009840).stop 2023-11-30T17:07:52.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.010+0000 7f7c27125700 1 -- 172.21.15.49:0/3688522401 shutdown_connections 2023-11-30T17:07:52.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.010+0000 7f7c27125700 1 --2- 172.21.15.49:0/3688522401 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c20152510 0x7f7c200a67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:52.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.010+0000 7f7c27125700 1 --2- 172.21.15.49:0/3688522401 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c200c6950 0x7f7c2015c170 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:52.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.010+0000 7f7c27125700 1 -- 172.21.15.49:0/3688522401 >> 172.21.15.49:0/3688522401 conn(0x7f7c200c8230 msgr2=0x7f7c200c4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:52.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.010+0000 7f7c27125700 1 -- 172.21.15.49:0/3688522401 shutdown_connections 2023-11-30T17:07:52.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.010+0000 7f7c27125700 1 -- 172.21.15.49:0/3688522401 wait complete. 2023-11-30T17:07:52.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.011+0000 7f7c27125700 1 Processor -- start 2023-11-30T17:07:52.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.011+0000 7f7c27125700 1 -- start start 2023-11-30T17:07:52.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.012+0000 7f7c27125700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c200a6cd0 0x7f7c20154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:52.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.012+0000 7f7c27125700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c200c6950 0x7f7c20169cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:52.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.012+0000 7f7c27125700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c20152510 0x7f7c20153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:52.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.012+0000 7f7c27125700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c201535a0 con 0x7f7c200c6950 2023-11-30T17:07:52.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.012+0000 7f7c27125700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c20152990 con 0x7f7c20152510 2023-11-30T17:07:52.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.012+0000 7f7c27125700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c20152c70 con 0x7f7c200a6cd0 2023-11-30T17:07:52.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.012+0000 7f7c1ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c200c6950 0x7f7c20169cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:52.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.012+0000 7f7c1ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c200c6950 0x7f7c20169cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47790/0 (socket says 172.21.15.49:47790) 2023-11-30T17:07:52.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.012+0000 7f7c1ffff700 1 -- 172.21.15.49:0/4074040021 learned_addr learned my addr 172.21.15.49:0/4074040021 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:52.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.012+0000 7f7c256c2700 1 --2- 172.21.15.49:0/4074040021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c20152510 0x7f7c20153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:52.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.012+0000 7f7c24ec1700 1 --2- 172.21.15.49:0/4074040021 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c200a6cd0 0x7f7c20154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:52.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.012+0000 7f7c1ffff700 1 -- 172.21.15.49:0/4074040021 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c200a6cd0 msgr2=0x7f7c20154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:52.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.012+0000 7f7c1ffff700 1 --2- 172.21.15.49:0/4074040021 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c200a6cd0 0x7f7c20154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:52.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.012+0000 7f7c1ffff700 1 -- 172.21.15.49:0/4074040021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c20152510 msgr2=0x7f7c20153a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:52.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.012+0000 7f7c1ffff700 1 --2- 172.21.15.49:0/4074040021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c20152510 0x7f7c20153a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:52.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.012+0000 7f7c1ffff700 1 -- 172.21.15.49:0/4074040021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c18009ae0 con 0x7f7c200c6950 2023-11-30T17:07:52.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.012+0000 7f7c1ffff700 1 --2- 172.21.15.49:0/4074040021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c200c6950 0x7f7c20169cc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f7c0c00c4a0 tx=0x7f7c0c007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:52.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.012+0000 7f7c1cff9700 1 -- 172.21.15.49:0/4074040021 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c00ce50 con 0x7f7c200c6950 2023-11-30T17:07:52.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.013+0000 7f7c1cff9700 1 -- 172.21.15.49:0/4074040021 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0c0072e0 con 0x7f7c200c6950 2023-11-30T17:07:52.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.013+0000 7f7c27125700 1 -- 172.21.15.49:0/4074040021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c20152f50 con 0x7f7c200c6950 2023-11-30T17:07:52.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.013+0000 7f7c1cff9700 1 -- 172.21.15.49:0/4074040021 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c005730 con 0x7f7c200c6950 2023-11-30T17:07:52.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.013+0000 7f7c27125700 1 -- 172.21.15.49:0/4074040021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c20154a80 con 0x7f7c200c6950 2023-11-30T17:07:52.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.014+0000 7f7c27125700 1 -- 172.21.15.49:0/4074040021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c200a9ea0 con 0x7f7c200c6950 2023-11-30T17:07:52.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.014+0000 7f7c1cff9700 1 -- 172.21.15.49:0/4074040021 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7c0c005b20 con 0x7f7c200c6950 2023-11-30T17:07:52.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.014+0000 7f7c1cff9700 1 --2- 172.21.15.49:0/4074040021 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7c0405f150 0x7f7c04061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:52.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.014+0000 7f7c1cff9700 1 -- 172.21.15.49:0/4074040021 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7c0c0799f0 con 0x7f7c200c6950 2023-11-30T17:07:52.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.014+0000 7f7c24ec1700 1 --2- 172.21.15.49:0/4074040021 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7c0405f150 0x7f7c04061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:52.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.015+0000 7f7c24ec1700 1 --2- 172.21.15.49:0/4074040021 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7c0405f150 0x7f7c04061610 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f7c14006fd0 tx=0x7f7c14006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:52.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.018+0000 7f7c1cff9700 1 -- 172.21.15.49:0/4074040021 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7c0c04acc0 con 0x7f7c200c6950 2023-11-30T17:07:52.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.190+0000 7f7c27125700 1 -- 172.21.15.49:0/4074040021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c2006c860 con 0x7f7c200c6950 2023-11-30T17:07:52.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.190+0000 7f7c1cff9700 1 -- 172.21.15.49:0/4074040021 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7c0c018070 con 0x7f7c200c6950 2023-11-30T17:07:52.193 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T17:07:52.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.192+0000 7f7c27125700 1 -- 172.21.15.49:0/4074040021 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7c0405f150 msgr2=0x7f7c04061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:52.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.192+0000 7f7c27125700 1 --2- 172.21.15.49:0/4074040021 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7c0405f150 0x7f7c04061610 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f7c14006fd0 tx=0x7f7c14006f40).stop 2023-11-30T17:07:52.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.192+0000 7f7c27125700 1 -- 172.21.15.49:0/4074040021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c200c6950 msgr2=0x7f7c20169cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:52.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.192+0000 7f7c27125700 1 --2- 172.21.15.49:0/4074040021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c200c6950 0x7f7c20169cc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f7c0c00c4a0 tx=0x7f7c0c007c30).stop 2023-11-30T17:07:52.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.192+0000 7f7c27125700 1 -- 172.21.15.49:0/4074040021 shutdown_connections 2023-11-30T17:07:52.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.192+0000 7f7c27125700 1 --2- 172.21.15.49:0/4074040021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c20152510 0x7f7c20153a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:52.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.192+0000 7f7c27125700 1 --2- 172.21.15.49:0/4074040021 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c200a6cd0 0x7f7c20154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:52.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.192+0000 7f7c27125700 1 --2- 172.21.15.49:0/4074040021 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7c0405f150 0x7f7c04061610 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:52.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.192+0000 7f7c27125700 1 --2- 172.21.15.49:0/4074040021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c200c6950 0x7f7c20169cc0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:52.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.192+0000 7f7c27125700 1 -- 172.21.15.49:0/4074040021 >> 172.21.15.49:0/4074040021 conn(0x7f7c200c8230 msgr2=0x7f7c20151560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:52.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.192+0000 7f7c27125700 1 -- 172.21.15.49:0/4074040021 shutdown_connections 2023-11-30T17:07:52.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.192+0000 7f7c27125700 1 -- 172.21.15.49:0/4074040021 wait complete. 2023-11-30T17:07:52.207 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-30T17:07:52.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.325+0000 7f3856b77700 1 Processor -- start 2023-11-30T17:07:52.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.325+0000 7f3856b77700 1 -- start start 2023-11-30T17:07:52.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.326+0000 7f3856b77700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3850098d10 0x7f38500c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:52.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.326+0000 7f3856b77700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38500c72d0 con 0x7f38500c6190 2023-11-30T17:07:52.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.326+0000 7f3856b77700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3850064570 con 0x7f3850158320 2023-11-30T17:07:52.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.326+0000 7f3856b77700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3850154bc0 con 0x7f3850098d10 2023-11-30T17:07:52.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.326+0000 7f384ffff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f38500c6190 0x7f3850063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49902/0 (socket says 172.21.15.49:49902) 2023-11-30T17:07:52.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.326+0000 7f384ffff700 1 -- 172.21.15.49:0/1724789117 learned_addr learned my addr 172.21.15.49:0/1724789117 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:52.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.327+0000 7f3854913700 1 --2- 172.21.15.49:0/1724789117 >> v2:172.21.15.115:3300/0 conn(0x7f3850098d10 0x7f38500c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:52.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.327+0000 7f384f7fe700 1 -- 172.21.15.49:0/1724789117 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2033806240 0 0) 0x7f38500c72d0 con 0x7f38500c6190 2023-11-30T17:07:52.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.327+0000 7f384f7fe700 1 -- 172.21.15.49:0/1724789117 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f383c0033f0 con 0x7f38500c6190 2023-11-30T17:07:52.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.327+0000 7f384f7fe700 1 -- 172.21.15.49:0/1724789117 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262513299 0 0) 0x7f3850064570 con 0x7f3850158320 2023-11-30T17:07:52.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.327+0000 7f384f7fe700 1 -- 172.21.15.49:0/1724789117 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38500c72d0 con 0x7f3850158320 2023-11-30T17:07:52.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.327+0000 7f384f7fe700 1 -- 172.21.15.49:0/1724789117 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 717603089 0 0) 0x7f383c0033f0 con 0x7f38500c6190 2023-11-30T17:07:52.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.327+0000 7f3854913700 1 -- 172.21.15.49:0/1724789117 >> v1:172.21.15.115:6789/0 conn(0x7f3850158320 legacy=0x7f38500a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:52.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.327+0000 7f3854913700 1 -- 172.21.15.49:0/1724789117 >> v1:172.21.15.49:6789/0 conn(0x7f38500c6190 legacy=0x7f3850063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:52.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.327+0000 7f3854913700 1 -- 172.21.15.49:0/1724789117 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38500c66c0 con 0x7f3850098d10 2023-11-30T17:07:52.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.327+0000 7f3854913700 1 --2- 172.21.15.49:0/1724789117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3850098d10 0x7f38500c7760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f3848009760 tx=0x7f3848009060).ready entity=mon.1 client_cookie=4ec57b26531ba407 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:52.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.327+0000 7f384f7fe700 1 -- 172.21.15.49:0/1724789117 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38400017f0 con 0x7f3850098d10 2023-11-30T17:07:52.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.327+0000 7f384f7fe700 1 -- 172.21.15.49:0/1724789117 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3848011400 con 0x7f3850098d10 2023-11-30T17:07:52.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.327+0000 7f384f7fe700 1 -- 172.21.15.49:0/1724789117 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3848011780 con 0x7f3850098d10 2023-11-30T17:07:52.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.328+0000 7f3856b77700 1 -- 172.21.15.49:0/1724789117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3850098d10 msgr2=0x7f38500c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:52.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.328+0000 7f3856b77700 1 --2- 172.21.15.49:0/1724789117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3850098d10 0x7f38500c7760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f3848009760 tx=0x7f3848009060).stop 2023-11-30T17:07:52.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.328+0000 7f3856b77700 1 -- 172.21.15.49:0/1724789117 shutdown_connections 2023-11-30T17:07:52.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.328+0000 7f3856b77700 1 --2- 172.21.15.49:0/1724789117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3850098d10 0x7f38500c7760 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:52.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.328+0000 7f3856b77700 1 -- 172.21.15.49:0/1724789117 >> 172.21.15.49:0/1724789117 conn(0x7f38500cb310 msgr2=0x7f38500cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:52.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.328+0000 7f3856b77700 1 -- 172.21.15.49:0/1724789117 shutdown_connections 2023-11-30T17:07:52.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.328+0000 7f3856b77700 1 -- 172.21.15.49:0/1724789117 wait complete. 2023-11-30T17:07:52.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.329+0000 7f3856b77700 1 Processor -- start 2023-11-30T17:07:52.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.329+0000 7f3856b77700 1 -- start start 2023-11-30T17:07:52.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.330+0000 7f3856b77700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3850098d10 0x7f3850148d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:52.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.330+0000 7f3856b77700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f38500c6190 0x7f3850154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:52.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.330+0000 7f3856b77700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3850158320 0x7f38501552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:52.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.330+0000 7f3856b77700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38500c55f0 con 0x7f3850158320 2023-11-30T17:07:52.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.330+0000 7f3856b77700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38500ae2c0 con 0x7f3850098d10 2023-11-30T17:07:52.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.330+0000 7f3856b77700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3850149240 con 0x7f38500c6190 2023-11-30T17:07:52.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.330+0000 7f3855114700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3850158320 0x7f38501552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:52.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.330+0000 7f3855114700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3850158320 0x7f38501552b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47806/0 (socket says 172.21.15.49:47806) 2023-11-30T17:07:52.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.330+0000 7f3855114700 1 -- 172.21.15.49:0/290322681 learned_addr learned my addr 172.21.15.49:0/290322681 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:52.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.330+0000 7f3854913700 1 --2- 172.21.15.49:0/290322681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3850098d10 0x7f3850148d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:52.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.330+0000 7f384ffff700 1 --2- 172.21.15.49:0/290322681 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f38500c6190 0x7f3850154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:52.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.330+0000 7f3855114700 1 -- 172.21.15.49:0/290322681 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f38500c6190 msgr2=0x7f3850154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:52.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.330+0000 7f3855114700 1 --2- 172.21.15.49:0/290322681 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f38500c6190 0x7f3850154dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:52.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.330+0000 7f3855114700 1 -- 172.21.15.49:0/290322681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3850098d10 msgr2=0x7f3850148d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:52.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.330+0000 7f3855114700 1 --2- 172.21.15.49:0/290322681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3850098d10 0x7f3850148d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:52.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.330+0000 7f3855114700 1 -- 172.21.15.49:0/290322681 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38480092a0 con 0x7f3850158320 2023-11-30T17:07:52.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.330+0000 7f384ffff700 1 --2- 172.21.15.49:0/290322681 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f38500c6190 0x7f3850154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:52.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.330+0000 7f3855114700 1 --2- 172.21.15.49:0/290322681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3850158320 0x7f38501552b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f383800c420 tx=0x7f3838007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:52.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.331+0000 7f384cff9700 1 -- 172.21.15.49:0/290322681 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383800f470 con 0x7f3850158320 2023-11-30T17:07:52.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.331+0000 7f384cff9700 1 -- 172.21.15.49:0/290322681 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383800f5d0 con 0x7f3850158320 2023-11-30T17:07:52.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.331+0000 7f3856b77700 1 -- 172.21.15.49:0/290322681 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38500ae510 con 0x7f3850158320 2023-11-30T17:07:52.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.331+0000 7f384cff9700 1 -- 172.21.15.49:0/290322681 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383800f950 con 0x7f3850158320 2023-11-30T17:07:52.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.331+0000 7f3856b77700 1 -- 172.21.15.49:0/290322681 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38500aead0 con 0x7f3850158320 2023-11-30T17:07:52.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.332+0000 7f3856b77700 1 -- 172.21.15.49:0/290322681 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f385006c860 con 0x7f3850158320 2023-11-30T17:07:52.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.332+0000 7f384cff9700 1 -- 172.21.15.49:0/290322681 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f383800fd40 con 0x7f3850158320 2023-11-30T17:07:52.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.332+0000 7f384cff9700 1 --2- 172.21.15.49:0/290322681 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f383005f150 0x7f3830061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:52.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.332+0000 7f384cff9700 1 -- 172.21.15.49:0/290322681 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f38380795f0 con 0x7f3850158320 2023-11-30T17:07:52.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.333+0000 7f3854913700 1 --2- 172.21.15.49:0/290322681 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f383005f150 0x7f3830061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:52.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.333+0000 7f3854913700 1 --2- 172.21.15.49:0/290322681 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f383005f150 0x7f3830061610 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f3848009760 tx=0x7f3848016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:52.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.336+0000 7f384cff9700 1 -- 172.21.15.49:0/290322681 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3838048b00 con 0x7f3850158320 2023-11-30T17:07:52.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.509+0000 7f3856b77700 1 -- 172.21.15.49:0/290322681 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3850155bc0 con 0x7f3850158320 2023-11-30T17:07:52.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.510+0000 7f384cff9700 1 -- 172.21.15.49:0/290322681 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f383804a970 con 0x7f3850158320 2023-11-30T17:07:52.512 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T17:07:52.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.512+0000 7f3856b77700 1 -- 172.21.15.49:0/290322681 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f383005f150 msgr2=0x7f3830061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:52.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.512+0000 7f3856b77700 1 --2- 172.21.15.49:0/290322681 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f383005f150 0x7f3830061610 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f3848009760 tx=0x7f3848016000).stop 2023-11-30T17:07:52.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.512+0000 7f3856b77700 1 -- 172.21.15.49:0/290322681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3850158320 msgr2=0x7f38501552b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:52.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.512+0000 7f3856b77700 1 --2- 172.21.15.49:0/290322681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3850158320 0x7f38501552b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f383800c420 tx=0x7f3838007c00).stop 2023-11-30T17:07:52.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.512+0000 7f3856b77700 1 -- 172.21.15.49:0/290322681 shutdown_connections 2023-11-30T17:07:52.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.512+0000 7f3856b77700 1 --2- 172.21.15.49:0/290322681 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f383005f150 0x7f3830061610 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:52.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.512+0000 7f3856b77700 1 --2- 172.21.15.49:0/290322681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3850158320 0x7f38501552b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:52.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.512+0000 7f3856b77700 1 --2- 172.21.15.49:0/290322681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3850098d10 0x7f3850148d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:52.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.512+0000 7f3856b77700 1 --2- 172.21.15.49:0/290322681 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f38500c6190 0x7f3850154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:52.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.512+0000 7f3856b77700 1 -- 172.21.15.49:0/290322681 >> 172.21.15.49:0/290322681 conn(0x7f38500cb310 msgr2=0x7f38500cab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:52.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.512+0000 7f3856b77700 1 -- 172.21.15.49:0/290322681 shutdown_connections 2023-11-30T17:07:52.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.512+0000 7f3856b77700 1 -- 172.21.15.49:0/290322681 wait complete. 2023-11-30T17:07:52.527 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:07:52.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.641+0000 7efc71d42700 1 Processor -- start 2023-11-30T17:07:52.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.641+0000 7efc71d42700 1 -- start start 2023-11-30T17:07:52.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.642+0000 7efc71d42700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc6c0cae90 0x7efc6c0c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:52.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.642+0000 7efc71d42700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efc6c0ca180 0x7efc6c0c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:52.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.642+0000 7efc71d42700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc6c0a9a90 con 0x7efc6c0caab0 2023-11-30T17:07:52.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.642+0000 7efc71d42700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6c0c1490 con 0x7efc6c0ca180 2023-11-30T17:07:52.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.642+0000 7efc71d42700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c154ce0 con 0x7efc6c0cae90 2023-11-30T17:07:52.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.642+0000 7efc6b7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7efc6c0caab0 0x7efc6c0aa470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49910/0 (socket says 172.21.15.49:49910) 2023-11-30T17:07:52.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.642+0000 7efc6b7fe700 1 -- 172.21.15.49:0/2299684901 learned_addr learned my addr 172.21.15.49:0/2299684901 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:52.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.642+0000 7efc6bfff700 1 --2- 172.21.15.49:0/2299684901 >> v2:172.21.15.115:3300/0 conn(0x7efc6c0ca180 0x7efc6c0c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:52.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.642+0000 7efc6affd700 1 --2- 172.21.15.49:0/2299684901 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc6c0cae90 0x7efc6c0c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:52.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.642+0000 7efc6a7fc700 1 -- 172.21.15.49:0/2299684901 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663609898 0 0) 0x7efc6c0a9a90 con 0x7efc6c0caab0 2023-11-30T17:07:52.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.642+0000 7efc6a7fc700 1 -- 172.21.15.49:0/2299684901 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc540033f0 con 0x7efc6c0caab0 2023-11-30T17:07:52.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.643+0000 7efc6a7fc700 1 -- 172.21.15.49:0/2299684901 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3148032552 0 0) 0x7efc540033f0 con 0x7efc6c0caab0 2023-11-30T17:07:52.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.643+0000 7efc6a7fc700 1 -- 172.21.15.49:0/2299684901 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc6c0cae90 msgr2=0x7efc6c0c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:52.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.643+0000 7efc6a7fc700 1 --2- 172.21.15.49:0/2299684901 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc6c0cae90 0x7efc6c0c0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:52.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.643+0000 7efc6a7fc700 1 -- 172.21.15.49:0/2299684901 >> v2:172.21.15.115:3300/0 conn(0x7efc6c0ca180 msgr2=0x7efc6c0c0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:52.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.643+0000 7efc6a7fc700 1 --2- 172.21.15.49:0/2299684901 >> v2:172.21.15.115:3300/0 conn(0x7efc6c0ca180 0x7efc6c0c0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:52.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.643+0000 7efc6a7fc700 1 -- 172.21.15.49:0/2299684901 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c0aab80 con 0x7efc6c0caab0 2023-11-30T17:07:52.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.643+0000 7efc6a7fc700 1 -- 172.21.15.49:0/2299684901 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7efc5c0015f0 con 0x7efc6c0caab0 2023-11-30T17:07:52.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.643+0000 7efc6a7fc700 1 -- 172.21.15.49:0/2299684901 >> v1:172.21.15.49:6789/0 conn(0x7efc6c0caab0 legacy=0x7efc6c0aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:52.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.643+0000 7efc6a7fc700 1 --2- 172.21.15.49:0/2299684901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc540038e0 0x7efc54003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:52.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.643+0000 7efc6a7fc700 1 --2- 172.21.15.49:0/2299684901 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc54004690 0x7efc54004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:52.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.643+0000 7efc6a7fc700 1 --2- 172.21.15.49:0/2299684901 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc54005000 0x7efc5400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:52.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.643+0000 7efc6a7fc700 1 -- 172.21.15.49:0/2299684901 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c0c1490 con 0x7efc540038e0 2023-11-30T17:07:52.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.643+0000 7efc6a7fc700 1 -- 172.21.15.49:0/2299684901 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c154ce0 con 0x7efc54004690 2023-11-30T17:07:52.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.643+0000 7efc6a7fc700 1 -- 172.21.15.49:0/2299684901 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5400bdd0 con 0x7efc54005000 2023-11-30T17:07:52.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.643+0000 7efc6bfff700 1 --2- 172.21.15.49:0/2299684901 >> v2:172.21.15.115:3300/0 conn(0x7efc6c0ca180 0x7efc6c0c0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:07:52.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.643+0000 7efc6b7fe700 1 --2- 172.21.15.49:0/2299684901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc540038e0 0x7efc54003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:52.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.643+0000 7efc6affd700 1 --2- 172.21.15.49:0/2299684901 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc6c0cae90 0x7efc6c0c0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:07:52.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.643+0000 7efc6affd700 1 --2- 172.21.15.49:0/2299684901 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc54004690 0x7efc54004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:52.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.643+0000 7efc6bfff700 1 --2- 172.21.15.49:0/2299684901 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc54005000 0x7efc5400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:52.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.643+0000 7efc6b7fe700 1 -- 172.21.15.49:0/2299684901 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc54005000 msgr2=0x7efc5400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:52.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.643+0000 7efc6b7fe700 1 --2- 172.21.15.49:0/2299684901 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc54005000 0x7efc5400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:52.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.643+0000 7efc6b7fe700 1 -- 172.21.15.49:0/2299684901 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc54004690 msgr2=0x7efc54004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:52.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.643+0000 7efc6b7fe700 1 --2- 172.21.15.49:0/2299684901 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc54004690 0x7efc54004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:52.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.643+0000 7efc6b7fe700 1 -- 172.21.15.49:0/2299684901 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc540033f0 con 0x7efc540038e0 2023-11-30T17:07:52.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.643+0000 7efc6b7fe700 1 --2- 172.21.15.49:0/2299684901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc540038e0 0x7efc54003d00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7efc5c00c240 tx=0x7efc5c0077a0).ready entity=mon.0 client_cookie=c5979f14b43ed498 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:52.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.644+0000 7efc6a7fc700 1 -- 172.21.15.49:0/2299684901 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c0079d0 con 0x7efc540038e0 2023-11-30T17:07:52.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.644+0000 7efc6a7fc700 1 -- 172.21.15.49:0/2299684901 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5c00cad0 con 0x7efc540038e0 2023-11-30T17:07:52.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.644+0000 7efc6a7fc700 1 -- 172.21.15.49:0/2299684901 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c00ce50 con 0x7efc540038e0 2023-11-30T17:07:52.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.644+0000 7efc71d42700 1 -- 172.21.15.49:0/2299684901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc540038e0 msgr2=0x7efc54003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:52.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.644+0000 7efc71d42700 1 --2- 172.21.15.49:0/2299684901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc540038e0 0x7efc54003d00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7efc5c00c240 tx=0x7efc5c0077a0).stop 2023-11-30T17:07:52.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.644+0000 7efc6bfff700 1 -- 172.21.15.49:0/2299684901 reap_dead start 2023-11-30T17:07:52.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.644+0000 7efc71d42700 1 -- 172.21.15.49:0/2299684901 shutdown_connections 2023-11-30T17:07:52.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.644+0000 7efc71d42700 1 -- 172.21.15.49:0/2299684901 >> 172.21.15.49:0/2299684901 conn(0x7efc6c094920 msgr2=0x7efc6c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:52.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.644+0000 7efc71d42700 1 -- 172.21.15.49:0/2299684901 shutdown_connections 2023-11-30T17:07:52.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.644+0000 7efc71d42700 1 -- 172.21.15.49:0/2299684901 wait complete. 2023-11-30T17:07:52.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.645+0000 7efc71d42700 1 Processor -- start 2023-11-30T17:07:52.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.645+0000 7efc71d42700 1 -- start start 2023-11-30T17:07:52.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.646+0000 7efc71d42700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc540038e0 0x7efc6c14f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:52.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.646+0000 7efc71d42700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc6c0ad0e0 0x7efc6c0afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:52.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.646+0000 7efc71d42700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc6c0ad560 0x7efc6c0b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:52.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.646+0000 7efc71d42700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c0b07d0 con 0x7efc6c0ad0e0 2023-11-30T17:07:52.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.646+0000 7efc71d42700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c0ab900 con 0x7efc540038e0 2023-11-30T17:07:52.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.646+0000 7efc71d42700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c0abbe0 con 0x7efc6c0ad560 2023-11-30T17:07:52.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.646+0000 7efc6affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc6c0ad0e0 0x7efc6c0afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:52.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.646+0000 7efc6affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc6c0ad0e0 0x7efc6c0afdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47818/0 (socket says 172.21.15.49:47818) 2023-11-30T17:07:52.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.646+0000 7efc6affd700 1 -- 172.21.15.49:0/23847523 learned_addr learned my addr 172.21.15.49:0/23847523 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:52.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.646+0000 7efc6b7fe700 1 --2- 172.21.15.49:0/23847523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc540038e0 0x7efc6c14f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:52.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.646+0000 7efc6bfff700 1 --2- 172.21.15.49:0/23847523 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc6c0ad560 0x7efc6c0b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:52.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.646+0000 7efc6affd700 1 -- 172.21.15.49:0/23847523 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc6c0ad560 msgr2=0x7efc6c0b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:52.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.646+0000 7efc6affd700 1 --2- 172.21.15.49:0/23847523 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc6c0ad560 0x7efc6c0b02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:52.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.646+0000 7efc6affd700 1 -- 172.21.15.49:0/23847523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc540038e0 msgr2=0x7efc6c14f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:52.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.646+0000 7efc6affd700 1 --2- 172.21.15.49:0/23847523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc540038e0 0x7efc6c14f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:52.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.647+0000 7efc6affd700 1 -- 172.21.15.49:0/23847523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c0abec0 con 0x7efc6c0ad0e0 2023-11-30T17:07:52.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.647+0000 7efc6affd700 1 --2- 172.21.15.49:0/23847523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc6c0ad0e0 0x7efc6c0afdf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7efc60011680 tx=0x7efc60008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:52.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.647+0000 7efc537fe700 1 -- 172.21.15.49:0/23847523 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc60013620 con 0x7efc6c0ad0e0 2023-11-30T17:07:52.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.647+0000 7efc537fe700 1 -- 172.21.15.49:0/23847523 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc60013780 con 0x7efc6c0ad0e0 2023-11-30T17:07:52.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.647+0000 7efc71d42700 1 -- 172.21.15.49:0/23847523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc6c0ac1a0 con 0x7efc6c0ad0e0 2023-11-30T17:07:52.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.647+0000 7efc537fe700 1 -- 172.21.15.49:0/23847523 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc60013b00 con 0x7efc6c0ad0e0 2023-11-30T17:07:52.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.647+0000 7efc71d42700 1 -- 172.21.15.49:0/23847523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc6c0afa20 con 0x7efc6c0ad0e0 2023-11-30T17:07:52.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.648+0000 7efc71d42700 1 -- 172.21.15.49:0/23847523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc6c14d4d0 con 0x7efc6c0ad0e0 2023-11-30T17:07:52.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.648+0000 7efc537fe700 1 -- 172.21.15.49:0/23847523 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7efc60015480 con 0x7efc6c0ad0e0 2023-11-30T17:07:52.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.648+0000 7efc537fe700 1 --2- 172.21.15.49:0/23847523 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc5805f120 0x7efc580615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:52.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.649+0000 7efc537fe700 1 -- 172.21.15.49:0/23847523 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7efc6007a9b0 con 0x7efc6c0ad0e0 2023-11-30T17:07:52.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.649+0000 7efc6b7fe700 1 --2- 172.21.15.49:0/23847523 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc5805f120 0x7efc580615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:52.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.649+0000 7efc6b7fe700 1 --2- 172.21.15.49:0/23847523 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc5805f120 0x7efc580615e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7efc5c00c160 tx=0x7efc5c013000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:52.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.653+0000 7efc537fe700 1 -- 172.21.15.49:0/23847523 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efc6004bc20 con 0x7efc6c0ad0e0 2023-11-30T17:07:52.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.868+0000 7efc71d42700 1 -- 172.21.15.49:0/23847523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc6c06c860 con 0x7efc6c0ad0e0 2023-11-30T17:07:52.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.869+0000 7efc537fe700 1 -- 172.21.15.49:0/23847523 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4486 (secure 0 0 0) 0x7efc6004f240 con 0x7efc6c0ad0e0 2023-11-30T17:07:52.871 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:52.872 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/4055676379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":4055676379},{"type":"v1","addr":"172.21.15.115:6835","nonce":4055676379}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1595689264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1595689264},{"type":"v1","addr":"172.21.15.115:6837","nonce":1595689264}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/124650277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":124650277},{"type":"v1","addr":"172.21.15.49:6834","nonce":124650277}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:07:16.282510+0000","modified":"2023-11-30T17:07:19.293997+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2333639572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2333639572},{"type":"v1","addr":"172.21.15.49:6835","nonce":2333639572}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-11-30T17:07:52.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.871+0000 7efc71d42700 1 -- 172.21.15.49:0/23847523 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc5805f120 msgr2=0x7efc580615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:52.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.871+0000 7efc71d42700 1 --2- 172.21.15.49:0/23847523 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc5805f120 0x7efc580615e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7efc5c00c160 tx=0x7efc5c013000).stop 2023-11-30T17:07:52.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.871+0000 7efc71d42700 1 -- 172.21.15.49:0/23847523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc6c0ad0e0 msgr2=0x7efc6c0afdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:52.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.871+0000 7efc71d42700 1 --2- 172.21.15.49:0/23847523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc6c0ad0e0 0x7efc6c0afdf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7efc60011680 tx=0x7efc60008040).stop 2023-11-30T17:07:52.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.871+0000 7efc71d42700 1 -- 172.21.15.49:0/23847523 shutdown_connections 2023-11-30T17:07:52.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.871+0000 7efc71d42700 1 --2- 172.21.15.49:0/23847523 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc6c0ad560 0x7efc6c0b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:52.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.871+0000 7efc71d42700 1 --2- 172.21.15.49:0/23847523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc540038e0 0x7efc6c14f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:52.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.871+0000 7efc71d42700 1 --2- 172.21.15.49:0/23847523 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc5805f120 0x7efc580615e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:52.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.871+0000 7efc71d42700 1 --2- 172.21.15.49:0/23847523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc6c0ad0e0 0x7efc6c0afdf0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:52.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.871+0000 7efc71d42700 1 -- 172.21.15.49:0/23847523 >> 172.21.15.49:0/23847523 conn(0x7efc6c094920 msgr2=0x7efc6c0a7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:52.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.871+0000 7efc71d42700 1 -- 172.21.15.49:0/23847523 shutdown_connections 2023-11-30T17:07:52.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:52.871+0000 7efc71d42700 1 -- 172.21.15.49:0/23847523 wait complete. 2023-11-30T17:07:52.875 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 8 2023-11-30T17:07:52.886 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:07:53.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.001+0000 7fd3b2791700 1 Processor -- start 2023-11-30T17:07:53.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.001+0000 7fd3b2791700 1 -- start start 2023-11-30T17:07:53.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.002+0000 7fd3b2791700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd3ac157660 0x7fd3ac157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:53.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.002+0000 7fd3b2791700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3ac0c1750 0x7fd3ac0c1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:53.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.002+0000 7fd3b2791700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3ac0c12c0 con 0x7fd3ac0c0180 2023-11-30T17:07:53.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.002+0000 7fd3b2791700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3ac0c06b0 con 0x7fd3ac157660 2023-11-30T17:07:53.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.002+0000 7fd3b2791700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac0c0990 con 0x7fd3ac0c1750 2023-11-30T17:07:53.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.002+0000 7fd3b178f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd3ac157660 0x7fd3ac157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:53.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.002+0000 7fd3b178f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd3ac157660 0x7fd3ac157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47826/0 (socket says 172.21.15.49:47826) 2023-11-30T17:07:53.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.002+0000 7fd3b178f700 1 -- 172.21.15.49:0/3070103766 learned_addr learned my addr 172.21.15.49:0/3070103766 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:53.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.003+0000 7fd3b1f90700 1 --2- 172.21.15.49:0/3070103766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3ac0c1750 0x7fd3ac0c1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:53.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.003+0000 7fd3b178f700 1 -- 172.21.15.49:0/3070103766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3ac0c1750 msgr2=0x7fd3ac0c1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:53.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.003+0000 7fd3b178f700 1 --2- 172.21.15.49:0/3070103766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3ac0c1750 0x7fd3ac0c1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:53.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.003+0000 7fd3b178f700 1 -- 172.21.15.49:0/3070103766 >> v1:172.21.15.115:6789/0 conn(0x7fd3ac0c0180 legacy=0x7fd3ac1589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:53.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.003+0000 7fd3b178f700 1 -- 172.21.15.49:0/3070103766 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ac0c0c70 con 0x7fd3ac157660 2023-11-30T17:07:53.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.003+0000 7fd3b178f700 1 --2- 172.21.15.49:0/3070103766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3ac157660 0x7fd3ac157a40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fd3a4006fd0 tx=0x7fd3a40090f0).ready entity=mon.0 client_cookie=47889d9f16273cef server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:53.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.003+0000 7fd3abfff700 1 -- 172.21.15.49:0/3070103766 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a400b600 con 0x7fd3ac157660 2023-11-30T17:07:53.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.003+0000 7fd3abfff700 1 -- 172.21.15.49:0/3070103766 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a400b760 con 0x7fd3ac157660 2023-11-30T17:07:53.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.003+0000 7fd3abfff700 1 -- 172.21.15.49:0/3070103766 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a400bae0 con 0x7fd3ac157660 2023-11-30T17:07:53.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.003+0000 7fd3b2791700 1 -- 172.21.15.49:0/3070103766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3ac157660 msgr2=0x7fd3ac157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:53.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.003+0000 7fd3b2791700 1 --2- 172.21.15.49:0/3070103766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3ac157660 0x7fd3ac157a40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fd3a4006fd0 tx=0x7fd3a40090f0).stop 2023-11-30T17:07:53.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.003+0000 7fd3b2791700 1 -- 172.21.15.49:0/3070103766 shutdown_connections 2023-11-30T17:07:53.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.003+0000 7fd3b2791700 1 --2- 172.21.15.49:0/3070103766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3ac0c1750 0x7fd3ac0c1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:53.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.003+0000 7fd3b2791700 1 --2- 172.21.15.49:0/3070103766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3ac157660 0x7fd3ac157a40 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:53.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.003+0000 7fd3b2791700 1 -- 172.21.15.49:0/3070103766 >> 172.21.15.49:0/3070103766 conn(0x7fd3ac0cb000 msgr2=0x7fd3ac0cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:53.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.004+0000 7fd3b2791700 1 -- 172.21.15.49:0/3070103766 shutdown_connections 2023-11-30T17:07:53.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.004+0000 7fd3b2791700 1 -- 172.21.15.49:0/3070103766 wait complete. 2023-11-30T17:07:53.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.005+0000 7fd3b2791700 1 Processor -- start 2023-11-30T17:07:53.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.005+0000 7fd3b2791700 1 -- start start 2023-11-30T17:07:53.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.006+0000 7fd3b2791700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3ac0c0180 0x7fd3ac0c2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:53.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.006+0000 7fd3b2791700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3ac0c1750 0x7fd3ac0c4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:53.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.006+0000 7fd3b2791700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3ac157660 0x7fd3ac147de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:53.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.006+0000 7fd3b2791700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac153b50 con 0x7fd3ac0c0180 2023-11-30T17:07:53.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.006+0000 7fd3b2791700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac164970 con 0x7fd3ac0c1750 2023-11-30T17:07:53.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.006+0000 7fd3b2791700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac0c3170 con 0x7fd3ac157660 2023-11-30T17:07:53.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.006+0000 7fd3b178f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3ac0c0180 0x7fd3ac0c2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:53.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.006+0000 7fd3b178f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3ac0c0180 0x7fd3ac0c2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47840/0 (socket says 172.21.15.49:47840) 2023-11-30T17:07:53.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.006+0000 7fd3b178f700 1 -- 172.21.15.49:0/3799766709 learned_addr learned my addr 172.21.15.49:0/3799766709 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:53.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.006+0000 7fd3b1f90700 1 --2- 172.21.15.49:0/3799766709 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3ac157660 0x7fd3ac147de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:53.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.006+0000 7fd3b0f8e700 1 --2- 172.21.15.49:0/3799766709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3ac0c1750 0x7fd3ac0c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:53.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.006+0000 7fd3b178f700 1 -- 172.21.15.49:0/3799766709 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3ac157660 msgr2=0x7fd3ac147de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:53.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.006+0000 7fd3b178f700 1 --2- 172.21.15.49:0/3799766709 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3ac157660 0x7fd3ac147de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:53.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.006+0000 7fd3b178f700 1 -- 172.21.15.49:0/3799766709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3ac0c1750 msgr2=0x7fd3ac0c4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:53.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.006+0000 7fd3b178f700 1 --2- 172.21.15.49:0/3799766709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3ac0c1750 0x7fd3ac0c4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:53.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.006+0000 7fd3b178f700 1 -- 172.21.15.49:0/3799766709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a4009370 con 0x7fd3ac0c0180 2023-11-30T17:07:53.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.006+0000 7fd3b178f700 1 --2- 172.21.15.49:0/3799766709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3ac0c0180 0x7fd3ac0c2b90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fd3ac084570 tx=0x7fd3a4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:53.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.006+0000 7fd3a97fa700 1 -- 172.21.15.49:0/3799766709 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a400bea0 con 0x7fd3ac0c0180 2023-11-30T17:07:53.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.006+0000 7fd3a97fa700 1 -- 172.21.15.49:0/3799766709 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a400b8d0 con 0x7fd3ac0c0180 2023-11-30T17:07:53.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.006+0000 7fd3b2791700 1 -- 172.21.15.49:0/3799766709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3ac0c3450 con 0x7fd3ac0c0180 2023-11-30T17:07:53.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.006+0000 7fd3a97fa700 1 -- 172.21.15.49:0/3799766709 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a401c650 con 0x7fd3ac0c0180 2023-11-30T17:07:53.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.006+0000 7fd3b2791700 1 -- 172.21.15.49:0/3799766709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3ac0c4960 con 0x7fd3ac0c0180 2023-11-30T17:07:53.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.007+0000 7fd3b2791700 1 -- 172.21.15.49:0/3799766709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3ac157c50 con 0x7fd3ac0c0180 2023-11-30T17:07:53.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.008+0000 7fd3a97fa700 1 -- 172.21.15.49:0/3799766709 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd3a401c9c0 con 0x7fd3ac0c0180 2023-11-30T17:07:53.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.008+0000 7fd3a97fa700 1 --2- 172.21.15.49:0/3799766709 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd39805f150 0x7fd398061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:53.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.008+0000 7fd3a97fa700 1 -- 172.21.15.49:0/3799766709 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd3a407bed0 con 0x7fd3ac0c0180 2023-11-30T17:07:53.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.008+0000 7fd3b0f8e700 1 --2- 172.21.15.49:0/3799766709 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd39805f150 0x7fd398061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:53.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.009+0000 7fd3b0f8e700 1 --2- 172.21.15.49:0/3799766709 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd39805f150 0x7fd398061610 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fd3a0000c00 tx=0x7fd3a0007d20).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:53.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.012+0000 7fd3a97fa700 1 -- 172.21.15.49:0/3799766709 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd3a404d1a0 con 0x7fd3ac0c0180 2023-11-30T17:07:53.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.187+0000 7fd3b2791700 1 -- 172.21.15.49:0/3799766709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3ac06c7c0 con 0x7fd3ac0c0180 2023-11-30T17:07:53.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.188+0000 7fd3a97fa700 1 -- 172.21.15.49:0/3799766709 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16928 (secure 0 0 0) 0x7fd3a402a030 con 0x7fd3ac0c0180 2023-11-30T17:07:53.193 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:53.194 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":22,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:07:17.283998+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:07:14.837882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-30T17:07:15.248549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:07:53.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.190+0000 7fd3b2791700 1 -- 172.21.15.49:0/3799766709 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd39805f150 msgr2=0x7fd398061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:53.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.190+0000 7fd3b2791700 1 --2- 172.21.15.49:0/3799766709 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd39805f150 0x7fd398061610 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fd3a0000c00 tx=0x7fd3a0007d20).stop 2023-11-30T17:07:53.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.190+0000 7fd3b2791700 1 -- 172.21.15.49:0/3799766709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3ac0c0180 msgr2=0x7fd3ac0c2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:53.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.190+0000 7fd3b2791700 1 --2- 172.21.15.49:0/3799766709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3ac0c0180 0x7fd3ac0c2b90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fd3ac084570 tx=0x7fd3a4017000).stop 2023-11-30T17:07:53.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.190+0000 7fd3b2791700 1 -- 172.21.15.49:0/3799766709 shutdown_connections 2023-11-30T17:07:53.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.190+0000 7fd3b2791700 1 --2- 172.21.15.49:0/3799766709 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3ac157660 0x7fd3ac147de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:53.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.190+0000 7fd3b2791700 1 --2- 172.21.15.49:0/3799766709 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd39805f150 0x7fd398061610 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:53.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.190+0000 7fd3b2791700 1 --2- 172.21.15.49:0/3799766709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3ac0c0180 0x7fd3ac0c2b90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:53.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.190+0000 7fd3b2791700 1 --2- 172.21.15.49:0/3799766709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3ac0c1750 0x7fd3ac0c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:53.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.190+0000 7fd3b2791700 1 -- 172.21.15.49:0/3799766709 >> 172.21.15.49:0/3799766709 conn(0x7fd3ac0cb000 msgr2=0x7fd3ac0aa590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:53.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.190+0000 7fd3b2791700 1 -- 172.21.15.49:0/3799766709 shutdown_connections 2023-11-30T17:07:53.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.190+0000 7fd3b2791700 1 -- 172.21.15.49:0/3799766709 wait complete. 2023-11-30T17:07:53.205 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-30T17:07:53.206 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:07:53.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.321+0000 7ff5cd4d6700 1 Processor -- start 2023-11-30T17:07:53.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.321+0000 7ff5cd4d6700 1 -- start start 2023-11-30T17:07:53.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.322+0000 7ff5cd4d6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff5c80cae90 0x7ff5c80c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:53.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.322+0000 7ff5cd4d6700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c80a9a90 con 0x7ff5c80caab0 2023-11-30T17:07:53.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.322+0000 7ff5cd4d6700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c8154ce0 con 0x7ff5c80ca180 2023-11-30T17:07:53.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.322+0000 7ff5cd4d6700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5c80aab80 con 0x7ff5c80cae90 2023-11-30T17:07:53.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.322+0000 7ff5c67fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff5c80cae90 0x7ff5c80c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:53.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.322+0000 7ff5c6ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff5c80caab0 0x7ff5c80aa470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49912/0 (socket says 172.21.15.49:49912) 2023-11-30T17:07:53.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.322+0000 7ff5c6ffd700 1 -- 172.21.15.49:0/3546443907 learned_addr learned my addr 172.21.15.49:0/3546443907 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:53.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.323+0000 7ff5c67fc700 1 -- 172.21.15.49:0/3546443907 >> v1:172.21.15.115:6789/0 conn(0x7ff5c80ca180 legacy=0x7ff5c815e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:53.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.323+0000 7ff5c67fc700 1 -- 172.21.15.49:0/3546443907 >> v1:172.21.15.49:6789/0 conn(0x7ff5c80caab0 legacy=0x7ff5c80aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:53.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.323+0000 7ff5c67fc700 1 -- 172.21.15.49:0/3546443907 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c80a8e80 con 0x7ff5c80cae90 2023-11-30T17:07:53.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.323+0000 7ff5c5ffb700 1 -- 172.21.15.49:0/3546443907 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2890472853 0 0) 0x7ff5c80a9a90 con 0x7ff5c80caab0 2023-11-30T17:07:53.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.323+0000 7ff5c67fc700 1 --2- 172.21.15.49:0/3546443907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5c80cae90 0x7ff5c80c0ab0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7ff5b0009760 tx=0x7ff5b0009060).ready entity=mon.0 client_cookie=a90a7f32bc2256ae server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:53.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.323+0000 7ff5c5ffb700 1 -- 172.21.15.49:0/3546443907 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b000b520 con 0x7ff5c80cae90 2023-11-30T17:07:53.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.323+0000 7ff5c5ffb700 1 -- 172.21.15.49:0/3546443907 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b000b680 con 0x7ff5c80cae90 2023-11-30T17:07:53.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.323+0000 7ff5c5ffb700 1 -- 172.21.15.49:0/3546443907 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b000ba00 con 0x7ff5c80cae90 2023-11-30T17:07:53.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.323+0000 7ff5cd4d6700 1 -- 172.21.15.49:0/3546443907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5c80cae90 msgr2=0x7ff5c80c0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:53.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.323+0000 7ff5cd4d6700 1 --2- 172.21.15.49:0/3546443907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5c80cae90 0x7ff5c80c0ab0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7ff5b0009760 tx=0x7ff5b0009060).stop 2023-11-30T17:07:53.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.323+0000 7ff5cd4d6700 1 -- 172.21.15.49:0/3546443907 shutdown_connections 2023-11-30T17:07:53.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.323+0000 7ff5cd4d6700 1 --2- 172.21.15.49:0/3546443907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5c80cae90 0x7ff5c80c0ab0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:53.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.323+0000 7ff5cd4d6700 1 -- 172.21.15.49:0/3546443907 >> 172.21.15.49:0/3546443907 conn(0x7ff5c8094920 msgr2=0x7ff5c806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:53.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.323+0000 7ff5cd4d6700 1 -- 172.21.15.49:0/3546443907 shutdown_connections 2023-11-30T17:07:53.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.323+0000 7ff5cd4d6700 1 -- 172.21.15.49:0/3546443907 wait complete. 2023-11-30T17:07:53.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.325+0000 7ff5cd4d6700 1 Processor -- start 2023-11-30T17:07:53.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.325+0000 7ff5cd4d6700 1 -- start start 2023-11-30T17:07:53.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.325+0000 7ff5cd4d6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5c80ca180 0x7ff5c814fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:53.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.325+0000 7ff5cd4d6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5c80caab0 0x7ff5c815a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:53.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.325+0000 7ff5cd4d6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5c80cae90 0x7ff5c81577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:53.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.325+0000 7ff5cd4d6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c815a430 con 0x7ff5c80ca180 2023-11-30T17:07:53.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.325+0000 7ff5cd4d6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c81501d0 con 0x7ff5c80cae90 2023-11-30T17:07:53.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.325+0000 7ff5cd4d6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c815adb0 con 0x7ff5c80caab0 2023-11-30T17:07:53.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.326+0000 7ff5c6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5c80ca180 0x7ff5c814fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:53.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.326+0000 7ff5c6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5c80ca180 0x7ff5c814fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47862/0 (socket says 172.21.15.49:47862) 2023-11-30T17:07:53.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.326+0000 7ff5c6ffd700 1 -- 172.21.15.49:0/1993044342 learned_addr learned my addr 172.21.15.49:0/1993044342 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:53.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.326+0000 7ff5c77fe700 1 --2- 172.21.15.49:0/1993044342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5c80cae90 0x7ff5c81577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:53.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.326+0000 7ff5c67fc700 1 --2- 172.21.15.49:0/1993044342 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5c80caab0 0x7ff5c815a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:53.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.326+0000 7ff5c6ffd700 1 -- 172.21.15.49:0/1993044342 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5c80caab0 msgr2=0x7ff5c815a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:53.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.326+0000 7ff5c6ffd700 1 --2- 172.21.15.49:0/1993044342 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5c80caab0 0x7ff5c815a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:53.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.326+0000 7ff5c6ffd700 1 -- 172.21.15.49:0/1993044342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5c80cae90 msgr2=0x7ff5c81577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:53.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.326+0000 7ff5c6ffd700 1 --2- 172.21.15.49:0/1993044342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5c80cae90 0x7ff5c81577b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:53.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.326+0000 7ff5c6ffd700 1 -- 172.21.15.49:0/1993044342 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b00092a0 con 0x7ff5c80ca180 2023-11-30T17:07:53.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.326+0000 7ff5c77fe700 1 --2- 172.21.15.49:0/1993044342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5c80cae90 0x7ff5c81577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:53.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.326+0000 7ff5c6ffd700 1 --2- 172.21.15.49:0/1993044342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5c80ca180 0x7ff5c814fce0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7ff5c000c870 tx=0x7ff5c0007e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:53.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.326+0000 7ff5beffd700 1 -- 172.21.15.49:0/1993044342 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c0005c00 con 0x7ff5c80ca180 2023-11-30T17:07:53.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.326+0000 7ff5beffd700 1 -- 172.21.15.49:0/1993044342 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c0005d60 con 0x7ff5c80ca180 2023-11-30T17:07:53.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.326+0000 7ff5cd4d6700 1 -- 172.21.15.49:0/1993044342 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c8157ca0 con 0x7ff5c80ca180 2023-11-30T17:07:53.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.326+0000 7ff5beffd700 1 -- 172.21.15.49:0/1993044342 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c0007340 con 0x7ff5c80ca180 2023-11-30T17:07:53.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.326+0000 7ff5cd4d6700 1 -- 172.21.15.49:0/1993044342 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c8159820 con 0x7ff5c80ca180 2023-11-30T17:07:53.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.327+0000 7ff5cd4d6700 1 -- 172.21.15.49:0/1993044342 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c806c860 con 0x7ff5c80ca180 2023-11-30T17:07:53.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.327+0000 7ff5beffd700 1 -- 172.21.15.49:0/1993044342 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff5c00076b0 con 0x7ff5c80ca180 2023-11-30T17:07:53.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.328+0000 7ff5beffd700 1 --2- 172.21.15.49:0/1993044342 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff5a805f150 0x7ff5a8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:53.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.328+0000 7ff5beffd700 1 -- 172.21.15.49:0/1993044342 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff5c007a270 con 0x7ff5c80ca180 2023-11-30T17:07:53.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.328+0000 7ff5c67fc700 1 --2- 172.21.15.49:0/1993044342 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff5a805f150 0x7ff5a8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:53.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.328+0000 7ff5c67fc700 1 --2- 172.21.15.49:0/1993044342 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff5a805f150 0x7ff5a8061610 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7ff5c81574d0 tx=0x7ff5b0017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:53.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.332+0000 7ff5beffd700 1 -- 172.21.15.49:0/1993044342 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff5c004b540 con 0x7ff5c80ca180 2023-11-30T17:07:53.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.546+0000 7ff5cd4d6700 1 -- 172.21.15.49:0/1993044342 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5c815a710 con 0x7ff5c80ca180 2023-11-30T17:07:53.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.547+0000 7ff5beffd700 1 -- 172.21.15.49:0/1993044342 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4486 (secure 0 0 0) 0x7ff5c004eb60 con 0x7ff5c80ca180 2023-11-30T17:07:53.550 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:53.550 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/4055676379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":4055676379},{"type":"v1","addr":"172.21.15.115:6835","nonce":4055676379}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1595689264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1595689264},{"type":"v1","addr":"172.21.15.115:6837","nonce":1595689264}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/124650277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":124650277},{"type":"v1","addr":"172.21.15.49:6834","nonce":124650277}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:07:16.282510+0000","modified":"2023-11-30T17:07:19.293997+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2333639572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2333639572},{"type":"v1","addr":"172.21.15.49:6835","nonce":2333639572}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-11-30T17:07:53.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.549+0000 7ff5cd4d6700 1 -- 172.21.15.49:0/1993044342 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff5a805f150 msgr2=0x7ff5a8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:53.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.549+0000 7ff5cd4d6700 1 --2- 172.21.15.49:0/1993044342 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff5a805f150 0x7ff5a8061610 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7ff5c81574d0 tx=0x7ff5b0017000).stop 2023-11-30T17:07:53.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.549+0000 7ff5cd4d6700 1 -- 172.21.15.49:0/1993044342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5c80ca180 msgr2=0x7ff5c814fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:53.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.549+0000 7ff5cd4d6700 1 --2- 172.21.15.49:0/1993044342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5c80ca180 0x7ff5c814fce0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7ff5c000c870 tx=0x7ff5c0007e80).stop 2023-11-30T17:07:53.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.549+0000 7ff5cd4d6700 1 -- 172.21.15.49:0/1993044342 shutdown_connections 2023-11-30T17:07:53.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.549+0000 7ff5cd4d6700 1 --2- 172.21.15.49:0/1993044342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5c80cae90 0x7ff5c81577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:53.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.549+0000 7ff5cd4d6700 1 --2- 172.21.15.49:0/1993044342 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff5a805f150 0x7ff5a8061610 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:53.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.549+0000 7ff5cd4d6700 1 --2- 172.21.15.49:0/1993044342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5c80ca180 0x7ff5c814fce0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:53.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.549+0000 7ff5cd4d6700 1 --2- 172.21.15.49:0/1993044342 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5c80caab0 0x7ff5c815a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:53.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.549+0000 7ff5cd4d6700 1 -- 172.21.15.49:0/1993044342 >> 172.21.15.49:0/1993044342 conn(0x7ff5c8094920 msgr2=0x7ff5c80acb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:53.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.549+0000 7ff5cd4d6700 1 -- 172.21.15.49:0/1993044342 shutdown_connections 2023-11-30T17:07:53.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.549+0000 7ff5cd4d6700 1 -- 172.21.15.49:0/1993044342 wait complete. 2023-11-30T17:07:53.554 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 8 2023-11-30T17:07:53.564 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:07:53.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.679+0000 7ffb03456700 1 Processor -- start 2023-11-30T17:07:53.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.680+0000 7ffb03456700 1 -- start start 2023-11-30T17:07:53.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.680+0000 7ffb03456700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffafc067cb0 0x7ffafc0c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:53.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.680+0000 7ffb03456700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ffafc068090 0x7ffafc0c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:53.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.680+0000 7ffb03456700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffafc154d20 con 0x7ffafc0c2640 2023-11-30T17:07:53.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.680+0000 7ffb03456700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffafc151670 con 0x7ffafc068090 2023-11-30T17:07:53.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.680+0000 7ffb03456700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffafc0c48a0 con 0x7ffafc067cb0 2023-11-30T17:07:53.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.681+0000 7ffb019f3700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ffafc0c2640 0x7ffafc0c2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49916/0 (socket says 172.21.15.49:49916) 2023-11-30T17:07:53.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.681+0000 7ffb019f3700 1 -- 172.21.15.49:0/1325136261 learned_addr learned my addr 172.21.15.49:0/1325136261 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:53.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.681+0000 7ffb011f2700 1 --2- 172.21.15.49:0/1325136261 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffafc067cb0 0x7ffafc0c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:53.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.681+0000 7ffb009f1700 1 --2- 172.21.15.49:0/1325136261 >> v2:172.21.15.115:3300/0 conn(0x7ffafc068090 0x7ffafc0c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:53.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.681+0000 7ffaf3fff700 1 -- 172.21.15.49:0/1325136261 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1156034502 0 0) 0x7ffafc154d20 con 0x7ffafc0c2640 2023-11-30T17:07:53.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.681+0000 7ffaf3fff700 1 -- 172.21.15.49:0/1325136261 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffae80033f0 con 0x7ffafc0c2640 2023-11-30T17:07:53.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.681+0000 7ffb009f1700 1 -- 172.21.15.49:0/1325136261 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffafc067cb0 msgr2=0x7ffafc0c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:53.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.681+0000 7ffb009f1700 1 --2- 172.21.15.49:0/1325136261 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffafc067cb0 0x7ffafc0c3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:53.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.681+0000 7ffb009f1700 1 -- 172.21.15.49:0/1325136261 >> v1:172.21.15.49:6789/0 conn(0x7ffafc0c2640 legacy=0x7ffafc0c2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:53.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.681+0000 7ffb009f1700 1 -- 172.21.15.49:0/1325136261 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffafc0a7490 con 0x7ffafc068090 2023-11-30T17:07:53.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.681+0000 7ffb011f2700 1 --2- 172.21.15.49:0/1325136261 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffafc067cb0 0x7ffafc0c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:07:53.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.681+0000 7ffb009f1700 1 --2- 172.21.15.49:0/1325136261 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffafc068090 0x7ffafc0c43b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7ffaec009760 tx=0x7ffaec009060).ready entity=mon.1 client_cookie=232075da43b14658 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:53.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.681+0000 7ffaf3fff700 1 -- 172.21.15.49:0/1325136261 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaec00d4a0 con 0x7ffafc068090 2023-11-30T17:07:53.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.681+0000 7ffaf3fff700 1 -- 172.21.15.49:0/1325136261 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaec00d600 con 0x7ffafc068090 2023-11-30T17:07:53.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.681+0000 7ffaf3fff700 1 -- 172.21.15.49:0/1325136261 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaec00d980 con 0x7ffafc068090 2023-11-30T17:07:53.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.682+0000 7ffb03456700 1 -- 172.21.15.49:0/1325136261 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffafc068090 msgr2=0x7ffafc0c43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:53.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.682+0000 7ffb03456700 1 --2- 172.21.15.49:0/1325136261 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffafc068090 0x7ffafc0c43b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7ffaec009760 tx=0x7ffaec009060).stop 2023-11-30T17:07:53.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.682+0000 7ffb03456700 1 -- 172.21.15.49:0/1325136261 shutdown_connections 2023-11-30T17:07:53.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.682+0000 7ffb03456700 1 --2- 172.21.15.49:0/1325136261 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffafc067cb0 0x7ffafc0c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:53.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.682+0000 7ffb03456700 1 --2- 172.21.15.49:0/1325136261 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffafc068090 0x7ffafc0c43b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:53.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.682+0000 7ffb03456700 1 -- 172.21.15.49:0/1325136261 >> 172.21.15.49:0/1325136261 conn(0x7ffafc0c7fd0 msgr2=0x7ffafc0c83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:53.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.682+0000 7ffb03456700 1 -- 172.21.15.49:0/1325136261 shutdown_connections 2023-11-30T17:07:53.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.682+0000 7ffb03456700 1 -- 172.21.15.49:0/1325136261 wait complete. 2023-11-30T17:07:53.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.683+0000 7ffb03456700 1 Processor -- start 2023-11-30T17:07:53.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.683+0000 7ffb03456700 1 -- start start 2023-11-30T17:07:53.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.684+0000 7ffb03456700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffafc067cb0 0x7ffafc1483d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:53.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.684+0000 7ffb03456700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffafc068090 0x7ffafc165430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:53.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.684+0000 7ffb03456700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffafc0c2640 0x7ffafc1517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:53.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.684+0000 7ffb03456700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffafc1488c0 con 0x7ffafc068090 2023-11-30T17:07:53.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.684+0000 7ffb03456700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffafc1526c0 con 0x7ffafc067cb0 2023-11-30T17:07:53.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.684+0000 7ffb03456700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffafc154200 con 0x7ffafc0c2640 2023-11-30T17:07:53.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.684+0000 7ffb009f1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffafc068090 0x7ffafc165430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:53.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.684+0000 7ffb009f1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffafc068090 0x7ffafc165430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47868/0 (socket says 172.21.15.49:47868) 2023-11-30T17:07:53.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.684+0000 7ffb009f1700 1 -- 172.21.15.49:0/286835316 learned_addr learned my addr 172.21.15.49:0/286835316 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:53.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.684+0000 7ffb019f3700 1 --2- 172.21.15.49:0/286835316 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffafc0c2640 0x7ffafc1517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:53.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.685+0000 7ffb011f2700 1 --2- 172.21.15.49:0/286835316 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffafc067cb0 0x7ffafc1483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:53.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.685+0000 7ffb009f1700 1 -- 172.21.15.49:0/286835316 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffafc0c2640 msgr2=0x7ffafc1517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:53.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.685+0000 7ffb009f1700 1 --2- 172.21.15.49:0/286835316 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffafc0c2640 0x7ffafc1517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:53.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.685+0000 7ffb009f1700 1 -- 172.21.15.49:0/286835316 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffafc067cb0 msgr2=0x7ffafc1483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:53.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.685+0000 7ffb009f1700 1 --2- 172.21.15.49:0/286835316 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffafc067cb0 0x7ffafc1483d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:53.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.685+0000 7ffb009f1700 1 -- 172.21.15.49:0/286835316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf80092a0 con 0x7ffafc068090 2023-11-30T17:07:53.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.685+0000 7ffb019f3700 1 --2- 172.21.15.49:0/286835316 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffafc0c2640 0x7ffafc1517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:53.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.685+0000 7ffb009f1700 1 --2- 172.21.15.49:0/286835316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffafc068090 0x7ffafc165430 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7ffaec009d50 tx=0x7ffaec016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:53.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.685+0000 7ffaf17fa700 1 -- 172.21.15.49:0/286835316 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaec01f070 con 0x7ffafc068090 2023-11-30T17:07:53.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.685+0000 7ffaf17fa700 1 -- 172.21.15.49:0/286835316 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaec000c90 con 0x7ffafc068090 2023-11-30T17:07:53.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.685+0000 7ffb03456700 1 -- 172.21.15.49:0/286835316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaec0092a0 con 0x7ffafc068090 2023-11-30T17:07:53.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.685+0000 7ffaf17fa700 1 -- 172.21.15.49:0/286835316 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaec00d770 con 0x7ffafc068090 2023-11-30T17:07:53.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.685+0000 7ffb03456700 1 -- 172.21.15.49:0/286835316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffafc152350 con 0x7ffafc068090 2023-11-30T17:07:53.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.686+0000 7ffb03456700 1 -- 172.21.15.49:0/286835316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffafc154720 con 0x7ffafc068090 2023-11-30T17:07:53.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.686+0000 7ffaf17fa700 1 -- 172.21.15.49:0/286835316 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ffaec018630 con 0x7ffafc068090 2023-11-30T17:07:53.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.686+0000 7ffaf17fa700 1 --2- 172.21.15.49:0/286835316 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ffae005f120 0x7ffae00615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:53.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.687+0000 7ffaf17fa700 1 -- 172.21.15.49:0/286835316 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ffaec07c730 con 0x7ffafc068090 2023-11-30T17:07:53.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.687+0000 7ffb011f2700 1 --2- 172.21.15.49:0/286835316 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ffae005f120 0x7ffae00615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:53.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.687+0000 7ffb011f2700 1 --2- 172.21.15.49:0/286835316 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ffae005f120 0x7ffae00615e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7ffaf8006d80 tx=0x7ffaf8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:53.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.691+0000 7ffaf17fa700 1 -- 172.21.15.49:0/286835316 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ffaec04da00 con 0x7ffafc068090 2023-11-30T17:07:53.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.913+0000 7ffb03456700 1 -- 172.21.15.49:0/286835316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffafc0a7490 con 0x7ffafc068090 2023-11-30T17:07:53.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.913+0000 7ffaf17fa700 1 -- 172.21.15.49:0/286835316 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4486 (secure 0 0 0) 0x7ffafc0a7490 con 0x7ffafc068090 2023-11-30T17:07:53.916 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:53.916 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/4055676379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":4055676379},{"type":"v1","addr":"172.21.15.115:6835","nonce":4055676379}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1595689264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1595689264},{"type":"v1","addr":"172.21.15.115:6837","nonce":1595689264}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/124650277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":124650277},{"type":"v1","addr":"172.21.15.49:6834","nonce":124650277}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:07:16.282510+0000","modified":"2023-11-30T17:07:19.293997+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2333639572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2333639572},{"type":"v1","addr":"172.21.15.49:6835","nonce":2333639572}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-11-30T17:07:53.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.915+0000 7ffb03456700 1 -- 172.21.15.49:0/286835316 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ffae005f120 msgr2=0x7ffae00615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:53.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.915+0000 7ffb03456700 1 --2- 172.21.15.49:0/286835316 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ffae005f120 0x7ffae00615e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7ffaf8006d80 tx=0x7ffaf8008040).stop 2023-11-30T17:07:53.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.915+0000 7ffb03456700 1 -- 172.21.15.49:0/286835316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffafc068090 msgr2=0x7ffafc165430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:53.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.915+0000 7ffb03456700 1 --2- 172.21.15.49:0/286835316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffafc068090 0x7ffafc165430 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7ffaec009d50 tx=0x7ffaec016000).stop 2023-11-30T17:07:53.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.915+0000 7ffb03456700 1 -- 172.21.15.49:0/286835316 shutdown_connections 2023-11-30T17:07:53.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.915+0000 7ffb03456700 1 --2- 172.21.15.49:0/286835316 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffafc0c2640 0x7ffafc1517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:53.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.915+0000 7ffb03456700 1 --2- 172.21.15.49:0/286835316 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffafc067cb0 0x7ffafc1483d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:53.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.915+0000 7ffb03456700 1 --2- 172.21.15.49:0/286835316 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ffae005f120 0x7ffae00615e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:53.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.915+0000 7ffb03456700 1 --2- 172.21.15.49:0/286835316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffafc068090 0x7ffafc165430 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:53.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.915+0000 7ffb03456700 1 -- 172.21.15.49:0/286835316 >> 172.21.15.49:0/286835316 conn(0x7ffafc0c7fd0 msgr2=0x7ffafc0c6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:53.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.915+0000 7ffb03456700 1 -- 172.21.15.49:0/286835316 shutdown_connections 2023-11-30T17:07:53.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:53.915+0000 7ffb03456700 1 -- 172.21.15.49:0/286835316 wait complete. 2023-11-30T17:07:53.919 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 8 2023-11-30T17:07:53.930 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:07:54.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.044+0000 7ff833f79700 1 Processor -- start 2023-11-30T17:07:54.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.045+0000 7ff833f79700 1 -- start start 2023-11-30T17:07:54.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.045+0000 7ff833f79700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff82c1548c0 0x7ff82c06a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:54.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.045+0000 7ff833f79700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff82c0c6e30 0x7ff82c0c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:54.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.045+0000 7ff833f79700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff82c0c69a0 con 0x7ff82c1544e0 2023-11-30T17:07:54.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.045+0000 7ff833f79700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff82c0c13a0 con 0x7ff82c1548c0 2023-11-30T17:07:54.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.045+0000 7ff833f79700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c0c1680 con 0x7ff82c0c6e30 2023-11-30T17:07:54.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.046+0000 7ff831514700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff82c1548c0 0x7ff82c06a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:54.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.046+0000 7ff831514700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff82c1548c0 0x7ff82c06a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47884/0 (socket says 172.21.15.49:47884) 2023-11-30T17:07:54.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.046+0000 7ff831514700 1 -- 172.21.15.49:0/2638712357 learned_addr learned my addr 172.21.15.49:0/2638712357 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:54.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.046+0000 7ff832516700 1 --2- 172.21.15.49:0/2638712357 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff82c0c6e30 0x7ff82c0c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:54.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.046+0000 7ff831514700 1 -- 172.21.15.49:0/2638712357 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff82c0c6e30 msgr2=0x7ff82c0c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:54.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.046+0000 7ff831514700 1 --2- 172.21.15.49:0/2638712357 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff82c0c6e30 0x7ff82c0c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:54.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.046+0000 7ff831514700 1 -- 172.21.15.49:0/2638712357 >> v1:172.21.15.115:6789/0 conn(0x7ff82c1544e0 legacy=0x7ff82c0c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:54.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.046+0000 7ff831514700 1 -- 172.21.15.49:0/2638712357 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c0c6630 con 0x7ff82c1548c0 2023-11-30T17:07:54.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.046+0000 7ff831514700 1 --2- 172.21.15.49:0/2638712357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff82c1548c0 0x7ff82c06a610 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7ff820006fd0 tx=0x7ff8200090f0).ready entity=mon.0 client_cookie=73a2a319267aaf15 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:54.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.046+0000 7ff830d13700 1 -- 172.21.15.49:0/2638712357 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82000b580 con 0x7ff82c1548c0 2023-11-30T17:07:54.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.046+0000 7ff830d13700 1 -- 172.21.15.49:0/2638712357 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82000b6e0 con 0x7ff82c1548c0 2023-11-30T17:07:54.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.046+0000 7ff830d13700 1 -- 172.21.15.49:0/2638712357 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82000ba60 con 0x7ff82c1548c0 2023-11-30T17:07:54.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.047+0000 7ff833f79700 1 -- 172.21.15.49:0/2638712357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff82c1548c0 msgr2=0x7ff82c06a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:54.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.047+0000 7ff833f79700 1 --2- 172.21.15.49:0/2638712357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff82c1548c0 0x7ff82c06a610 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7ff820006fd0 tx=0x7ff8200090f0).stop 2023-11-30T17:07:54.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.047+0000 7ff833f79700 1 -- 172.21.15.49:0/2638712357 shutdown_connections 2023-11-30T17:07:54.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.047+0000 7ff833f79700 1 --2- 172.21.15.49:0/2638712357 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff82c0c6e30 0x7ff82c0c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:54.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.047+0000 7ff833f79700 1 --2- 172.21.15.49:0/2638712357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff82c1548c0 0x7ff82c06a610 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:54.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.047+0000 7ff833f79700 1 -- 172.21.15.49:0/2638712357 >> 172.21.15.49:0/2638712357 conn(0x7ff82c085020 msgr2=0x7ff82c094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:54.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.047+0000 7ff833f79700 1 -- 172.21.15.49:0/2638712357 shutdown_connections 2023-11-30T17:07:54.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.047+0000 7ff833f79700 1 -- 172.21.15.49:0/2638712357 wait complete. 2023-11-30T17:07:54.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.048+0000 7ff833f79700 1 Processor -- start 2023-11-30T17:07:54.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.048+0000 7ff833f79700 1 -- start start 2023-11-30T17:07:54.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.049+0000 7ff833f79700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff82c0c6e30 0x7ff82c14cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:54.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.049+0000 7ff833f79700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff82c1544e0 0x7ff82c097100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:54.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.049+0000 7ff833f79700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff82c1548c0 0x7ff82c0a8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:54.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.049+0000 7ff833f79700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c1535f0 con 0x7ff82c1544e0 2023-11-30T17:07:54.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.049+0000 7ff833f79700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c0954b0 con 0x7ff82c1548c0 2023-11-30T17:07:54.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.049+0000 7ff833f79700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c0aa9c0 con 0x7ff82c0c6e30 2023-11-30T17:07:54.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.049+0000 7ff831514700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff82c1544e0 0x7ff82c097100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:54.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.049+0000 7ff831514700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff82c1544e0 0x7ff82c097100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47888/0 (socket says 172.21.15.49:47888) 2023-11-30T17:07:54.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.049+0000 7ff831514700 1 -- 172.21.15.49:0/910929441 learned_addr learned my addr 172.21.15.49:0/910929441 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:54.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.049+0000 7ff831d15700 1 --2- 172.21.15.49:0/910929441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff82c0c6e30 0x7ff82c14cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:54.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.049+0000 7ff832516700 1 --2- 172.21.15.49:0/910929441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff82c1548c0 0x7ff82c0a8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:54.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.049+0000 7ff831514700 1 -- 172.21.15.49:0/910929441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff82c0c6e30 msgr2=0x7ff82c14cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:54.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.049+0000 7ff831514700 1 --2- 172.21.15.49:0/910929441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff82c0c6e30 0x7ff82c14cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:54.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.049+0000 7ff831514700 1 -- 172.21.15.49:0/910929441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff82c1548c0 msgr2=0x7ff82c0a8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:54.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.049+0000 7ff831514700 1 --2- 172.21.15.49:0/910929441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff82c1548c0 0x7ff82c0a8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:54.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.049+0000 7ff831514700 1 -- 172.21.15.49:0/910929441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff820009370 con 0x7ff82c1544e0 2023-11-30T17:07:54.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.049+0000 7ff831514700 1 --2- 172.21.15.49:0/910929441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff82c1544e0 0x7ff82c097100 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7ff82c05fb30 tx=0x7ff820017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:54.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.049+0000 7ff829ffb700 1 -- 172.21.15.49:0/910929441 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff820000bc0 con 0x7ff82c1544e0 2023-11-30T17:07:54.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.049+0000 7ff829ffb700 1 -- 172.21.15.49:0/910929441 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82000b850 con 0x7ff82c1544e0 2023-11-30T17:07:54.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.049+0000 7ff833f79700 1 -- 172.21.15.49:0/910929441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff82c098840 con 0x7ff82c1544e0 2023-11-30T17:07:54.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.049+0000 7ff829ffb700 1 -- 172.21.15.49:0/910929441 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff820000d20 con 0x7ff82c1544e0 2023-11-30T17:07:54.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.050+0000 7ff833f79700 1 -- 172.21.15.49:0/910929441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff82c098e00 con 0x7ff82c1544e0 2023-11-30T17:07:54.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.051+0000 7ff833f79700 1 -- 172.21.15.49:0/910929441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff82c06c860 con 0x7ff82c1544e0 2023-11-30T17:07:54.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.051+0000 7ff829ffb700 1 -- 172.21.15.49:0/910929441 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff82001d890 con 0x7ff82c1544e0 2023-11-30T17:07:54.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.051+0000 7ff829ffb700 1 --2- 172.21.15.49:0/910929441 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff81805f150 0x7ff818061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:54.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.051+0000 7ff829ffb700 1 -- 172.21.15.49:0/910929441 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff82007be10 con 0x7ff82c1544e0 2023-11-30T17:07:54.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.051+0000 7ff831d15700 1 --2- 172.21.15.49:0/910929441 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff81805f150 0x7ff818061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:54.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.052+0000 7ff831d15700 1 --2- 172.21.15.49:0/910929441 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff81805f150 0x7ff818061610 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7ff824007fd0 tx=0x7ff824009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:54.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.055+0000 7ff829ffb700 1 -- 172.21.15.49:0/910929441 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff82004d0e0 con 0x7ff82c1544e0 2023-11-30T17:07:54.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.230+0000 7ff833f79700 1 -- 172.21.15.49:0/910929441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff82c0c6250 con 0x7ff82c1544e0 2023-11-30T17:07:54.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.231+0000 7ff829ffb700 1 -- 172.21.15.49:0/910929441 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16928 (secure 0 0 0) 0x7ff820050700 con 0x7ff82c1544e0 2023-11-30T17:07:54.234 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:54.234 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":22,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:07:17.283998+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:07:14.837882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-30T17:07:15.248549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:07:54.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.233+0000 7ff833f79700 1 -- 172.21.15.49:0/910929441 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff81805f150 msgr2=0x7ff818061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:54.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.233+0000 7ff833f79700 1 --2- 172.21.15.49:0/910929441 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff81805f150 0x7ff818061610 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7ff824007fd0 tx=0x7ff824009040).stop 2023-11-30T17:07:54.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.233+0000 7ff833f79700 1 -- 172.21.15.49:0/910929441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff82c1544e0 msgr2=0x7ff82c097100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:54.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.233+0000 7ff833f79700 1 --2- 172.21.15.49:0/910929441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff82c1544e0 0x7ff82c097100 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7ff82c05fb30 tx=0x7ff820017000).stop 2023-11-30T17:07:54.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.233+0000 7ff833f79700 1 -- 172.21.15.49:0/910929441 shutdown_connections 2023-11-30T17:07:54.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.233+0000 7ff833f79700 1 --2- 172.21.15.49:0/910929441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff82c1548c0 0x7ff82c0a8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:54.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.233+0000 7ff833f79700 1 --2- 172.21.15.49:0/910929441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff82c0c6e30 0x7ff82c14cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:54.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.233+0000 7ff833f79700 1 --2- 172.21.15.49:0/910929441 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff81805f150 0x7ff818061610 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:54.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.233+0000 7ff833f79700 1 --2- 172.21.15.49:0/910929441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff82c1544e0 0x7ff82c097100 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:54.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.233+0000 7ff833f79700 1 -- 172.21.15.49:0/910929441 >> 172.21.15.49:0/910929441 conn(0x7ff82c085020 msgr2=0x7ff82c0c9890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:54.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.233+0000 7ff833f79700 1 -- 172.21.15.49:0/910929441 shutdown_connections 2023-11-30T17:07:54.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.233+0000 7ff833f79700 1 -- 172.21.15.49:0/910929441 wait complete. 2023-11-30T17:07:54.248 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-30T17:07:54.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.364+0000 7f37fb7c1700 1 Processor -- start 2023-11-30T17:07:54.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.364+0000 7f37fb7c1700 1 -- start start 2023-11-30T17:07:54.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.365+0000 7f37fb7c1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f37f40c6190 0x7f37f40c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:54.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.365+0000 7f37fb7c1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f37f4158320 0x7f37f41587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:54.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.365+0000 7f37fb7c1700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37f4158cc0 con 0x7f37f4098d10 2023-11-30T17:07:54.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.365+0000 7f37fb7c1700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37f40c72d0 con 0x7f37f40c6190 2023-11-30T17:07:54.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.365+0000 7f37fb7c1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f4064570 con 0x7f37f4158320 2023-11-30T17:07:54.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.365+0000 7f37f8d5c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f37f40c6190 0x7f37f40c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:54.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.365+0000 7f37f8d5c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f37f40c6190 0x7f37f40c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47904/0 (socket says 172.21.15.49:47904) 2023-11-30T17:07:54.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.365+0000 7f37f8d5c700 1 -- 172.21.15.49:0/589639626 learned_addr learned my addr 172.21.15.49:0/589639626 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:54.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.365+0000 7f37f9d5e700 1 --2- 172.21.15.49:0/589639626 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f37f4158320 0x7f37f41587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:54.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.366+0000 7f37f8d5c700 1 -- 172.21.15.49:0/589639626 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f37f4158320 msgr2=0x7f37f41587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:54.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.366+0000 7f37f8d5c700 1 --2- 172.21.15.49:0/589639626 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f37f4158320 0x7f37f41587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:54.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.366+0000 7f37f8d5c700 1 -- 172.21.15.49:0/589639626 >> v1:172.21.15.115:6789/0 conn(0x7f37f4098d10 legacy=0x7f37f4063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:54.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.366+0000 7f37f8d5c700 1 -- 172.21.15.49:0/589639626 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f4154bc0 con 0x7f37f40c6190 2023-11-30T17:07:54.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.366+0000 7f37f8d5c700 1 --2- 172.21.15.49:0/589639626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37f40c6190 0x7f37f40c7760 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f37e8006fd0 tx=0x7f37e80090f0).ready entity=mon.0 client_cookie=7b388cf98e7e3342 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:54.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.366+0000 7f37f3fff700 1 -- 172.21.15.49:0/589639626 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e800b580 con 0x7f37f40c6190 2023-11-30T17:07:54.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.366+0000 7f37f3fff700 1 -- 172.21.15.49:0/589639626 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e800b6e0 con 0x7f37f40c6190 2023-11-30T17:07:54.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.366+0000 7f37f3fff700 1 -- 172.21.15.49:0/589639626 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e800ba60 con 0x7f37f40c6190 2023-11-30T17:07:54.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.366+0000 7f37fb7c1700 1 -- 172.21.15.49:0/589639626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37f40c6190 msgr2=0x7f37f40c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:54.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.366+0000 7f37fb7c1700 1 --2- 172.21.15.49:0/589639626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37f40c6190 0x7f37f40c7760 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f37e8006fd0 tx=0x7f37e80090f0).stop 2023-11-30T17:07:54.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.366+0000 7f37fb7c1700 1 -- 172.21.15.49:0/589639626 shutdown_connections 2023-11-30T17:07:54.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.366+0000 7f37fb7c1700 1 --2- 172.21.15.49:0/589639626 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f37f4158320 0x7f37f41587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:54.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.366+0000 7f37fb7c1700 1 --2- 172.21.15.49:0/589639626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37f40c6190 0x7f37f40c7760 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:54.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.366+0000 7f37fb7c1700 1 -- 172.21.15.49:0/589639626 >> 172.21.15.49:0/589639626 conn(0x7f37f40cb310 msgr2=0x7f37f40cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:54.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.366+0000 7f37fb7c1700 1 -- 172.21.15.49:0/589639626 shutdown_connections 2023-11-30T17:07:54.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.366+0000 7f37fb7c1700 1 -- 172.21.15.49:0/589639626 wait complete. 2023-11-30T17:07:54.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.368+0000 7f37fb7c1700 1 Processor -- start 2023-11-30T17:07:54.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.368+0000 7f37fb7c1700 1 -- start start 2023-11-30T17:07:54.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.368+0000 7f37fb7c1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37f4098d10 0x7f37f4097f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:54.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.368+0000 7f37fb7c1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f37f40c6190 0x7f37f40af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:54.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.369+0000 7f37fb7c1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37f4158320 0x7f37f41684c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:54.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.369+0000 7f37fb7c1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f40b13a0 con 0x7f37f4098d10 2023-11-30T17:07:54.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.369+0000 7f37fb7c1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f4098430 con 0x7f37f4158320 2023-11-30T17:07:54.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.369+0000 7f37fb7c1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f40b0720 con 0x7f37f40c6190 2023-11-30T17:07:54.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.369+0000 7f37f955d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37f4098d10 0x7f37f4097f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:54.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.369+0000 7f37f955d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37f4098d10 0x7f37f4097f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47908/0 (socket says 172.21.15.49:47908) 2023-11-30T17:07:54.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.369+0000 7f37f955d700 1 -- 172.21.15.49:0/2204683325 learned_addr learned my addr 172.21.15.49:0/2204683325 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:54.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.369+0000 7f37f9d5e700 1 --2- 172.21.15.49:0/2204683325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37f4158320 0x7f37f41684c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:54.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.369+0000 7f37f8d5c700 1 --2- 172.21.15.49:0/2204683325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f37f40c6190 0x7f37f40af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:54.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.369+0000 7f37f955d700 1 -- 172.21.15.49:0/2204683325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f37f40c6190 msgr2=0x7f37f40af2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:54.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.369+0000 7f37f955d700 1 --2- 172.21.15.49:0/2204683325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f37f40c6190 0x7f37f40af2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:54.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.369+0000 7f37f955d700 1 -- 172.21.15.49:0/2204683325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37f4158320 msgr2=0x7f37f41684c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:54.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.369+0000 7f37f955d700 1 --2- 172.21.15.49:0/2204683325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37f4158320 0x7f37f41684c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:54.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.369+0000 7f37f955d700 1 -- 172.21.15.49:0/2204683325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e8009370 con 0x7f37f4098d10 2023-11-30T17:07:54.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.369+0000 7f37f955d700 1 --2- 172.21.15.49:0/2204683325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37f4098d10 0x7f37f4097f40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f37ec00c470 tx=0x7f37ec007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:54.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.369+0000 7f37f17fa700 1 -- 172.21.15.49:0/2204683325 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ec007020 con 0x7f37f4098d10 2023-11-30T17:07:54.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.369+0000 7f37f17fa700 1 -- 172.21.15.49:0/2204683325 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37ec007180 con 0x7f37f4098d10 2023-11-30T17:07:54.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.369+0000 7f37fb7c1700 1 -- 172.21.15.49:0/2204683325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f40b0a00 con 0x7f37f4098d10 2023-11-30T17:07:54.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.369+0000 7f37f17fa700 1 -- 172.21.15.49:0/2204683325 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ec007520 con 0x7f37f4098d10 2023-11-30T17:07:54.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.369+0000 7f37fb7c1700 1 -- 172.21.15.49:0/2204683325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f40b0fc0 con 0x7f37f4098d10 2023-11-30T17:07:54.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.370+0000 7f37fb7c1700 1 -- 172.21.15.49:0/2204683325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f406c860 con 0x7f37f4098d10 2023-11-30T17:07:54.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.371+0000 7f37f17fa700 1 -- 172.21.15.49:0/2204683325 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f37ec0068b0 con 0x7f37f4098d10 2023-11-30T17:07:54.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.371+0000 7f37f17fa700 1 --2- 172.21.15.49:0/2204683325 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f37e005f120 0x7f37e00615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:54.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.371+0000 7f37f17fa700 1 -- 172.21.15.49:0/2204683325 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f37ec0792a0 con 0x7f37f4098d10 2023-11-30T17:07:54.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.371+0000 7f37f8d5c700 1 --2- 172.21.15.49:0/2204683325 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f37e005f120 0x7f37e00615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:54.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.372+0000 7f37f8d5c700 1 --2- 172.21.15.49:0/2204683325 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f37e005f120 0x7f37e00615e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f37e8006fd0 tx=0x7f37e8017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:54.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.375+0000 7f37f17fa700 1 -- 172.21.15.49:0/2204683325 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f37ec047b00 con 0x7f37f4098d10 2023-11-30T17:07:54.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.589+0000 7f37fb7c1700 1 -- 172.21.15.49:0/2204683325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f37f40c66c0 con 0x7f37f4098d10 2023-11-30T17:07:54.770 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-11-30T17:07:54.767+0000 7f3888d95700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-30T17:07:54.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.773+0000 7f37f17fa700 1 -- 172.21.15.49:0/2204683325 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f37ec04a570 con 0x7f37f4098d10 2023-11-30T17:07:54.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.775+0000 7f37fb7c1700 1 -- 172.21.15.49:0/2204683325 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f37e005f120 msgr2=0x7f37e00615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:54.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.775+0000 7f37fb7c1700 1 --2- 172.21.15.49:0/2204683325 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f37e005f120 0x7f37e00615e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f37e8006fd0 tx=0x7f37e8017000).stop 2023-11-30T17:07:54.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.775+0000 7f37fb7c1700 1 -- 172.21.15.49:0/2204683325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37f4098d10 msgr2=0x7f37f4097f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:54.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.775+0000 7f37fb7c1700 1 --2- 172.21.15.49:0/2204683325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37f4098d10 0x7f37f4097f40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f37ec00c470 tx=0x7f37ec007e00).stop 2023-11-30T17:07:54.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.775+0000 7f37fb7c1700 1 -- 172.21.15.49:0/2204683325 shutdown_connections 2023-11-30T17:07:54.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.775+0000 7f37fb7c1700 1 --2- 172.21.15.49:0/2204683325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37f4158320 0x7f37f41684c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:54.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.775+0000 7f37fb7c1700 1 --2- 172.21.15.49:0/2204683325 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f37e005f120 0x7f37e00615e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:54.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.775+0000 7f37fb7c1700 1 --2- 172.21.15.49:0/2204683325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37f4098d10 0x7f37f4097f40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:54.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.775+0000 7f37fb7c1700 1 --2- 172.21.15.49:0/2204683325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f37f40c6190 0x7f37f40af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:54.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.775+0000 7f37fb7c1700 1 -- 172.21.15.49:0/2204683325 >> 172.21.15.49:0/2204683325 conn(0x7f37f40cb310 msgr2=0x7f37f4151c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:54.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.776+0000 7f37fb7c1700 1 -- 172.21.15.49:0/2204683325 shutdown_connections 2023-11-30T17:07:54.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.776+0000 7f37fb7c1700 1 -- 172.21.15.49:0/2204683325 wait complete. 2023-11-30T17:07:54.779 INFO:tasks.ceph.mds.a.smithi049.stderr: -1736> 2023-11-30T17:07:21.980+0000 7f340fc0d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-30T17:07:54.780 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-30T17:07:54.791 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-30T17:07:54.801 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-11-30T17:07:54.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.909+0000 7fda28c53700 1 Processor -- start 2023-11-30T17:07:54.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.909+0000 7fda28c53700 1 -- start start 2023-11-30T17:07:54.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.910+0000 7fda28c53700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fda240c3090 0x7fda24155c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:54.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.910+0000 7fda28c53700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fda24155030 0x7fda240c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:54.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.910+0000 7fda28c53700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda24155470 con 0x7fda24155830 2023-11-30T17:07:54.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.910+0000 7fda28c53700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda241529c0 con 0x7fda240c3090 2023-11-30T17:07:54.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.910+0000 7fda28c53700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda24151db0 con 0x7fda24155030 2023-11-30T17:07:54.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.910+0000 7fda21d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fda240c3090 0x7fda24155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:54.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.910+0000 7fda21d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fda240c3090 0x7fda24155c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47928/0 (socket says 172.21.15.49:47928) 2023-11-30T17:07:54.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.910+0000 7fda21d9b700 1 -- 172.21.15.49:0/4242328830 learned_addr learned my addr 172.21.15.49:0/4242328830 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:54.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.910+0000 7fda22d9d700 1 --2- 172.21.15.49:0/4242328830 >> v2:172.21.15.115:3300/0 conn(0x7fda24155030 0x7fda240c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:54.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.910+0000 7fda21d9b700 1 -- 172.21.15.49:0/4242328830 >> v2:172.21.15.115:3300/0 conn(0x7fda24155030 msgr2=0x7fda240c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:54.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.910+0000 7fda21d9b700 1 --2- 172.21.15.49:0/4242328830 >> v2:172.21.15.115:3300/0 conn(0x7fda24155030 0x7fda240c5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:54.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.910+0000 7fda21d9b700 1 -- 172.21.15.49:0/4242328830 >> v1:172.21.15.115:6789/0 conn(0x7fda24155830 legacy=0x7fda240c2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:54.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.910+0000 7fda21d9b700 1 -- 172.21.15.49:0/4242328830 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda24152090 con 0x7fda240c3090 2023-11-30T17:07:54.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.910+0000 7fda21d9b700 1 --2- 172.21.15.49:0/4242328830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda240c3090 0x7fda24155c10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fda2405e6d0 tx=0x7fda1800b3b0).ready entity=mon.0 client_cookie=bc72b106a9c08f84 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:54.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.911+0000 7fda2159a700 1 -- 172.21.15.49:0/4242328830 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1800db10 con 0x7fda240c3090 2023-11-30T17:07:54.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.911+0000 7fda2159a700 1 -- 172.21.15.49:0/4242328830 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1800dc70 con 0x7fda240c3090 2023-11-30T17:07:54.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.911+0000 7fda2159a700 1 -- 172.21.15.49:0/4242328830 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18010470 con 0x7fda240c3090 2023-11-30T17:07:54.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.911+0000 7fda28c53700 1 -- 172.21.15.49:0/4242328830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda240c3090 msgr2=0x7fda24155c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:54.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.911+0000 7fda28c53700 1 --2- 172.21.15.49:0/4242328830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda240c3090 0x7fda24155c10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fda2405e6d0 tx=0x7fda1800b3b0).stop 2023-11-30T17:07:54.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.911+0000 7fda28c53700 1 -- 172.21.15.49:0/4242328830 shutdown_connections 2023-11-30T17:07:54.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.911+0000 7fda28c53700 1 --2- 172.21.15.49:0/4242328830 >> v2:172.21.15.115:3300/0 conn(0x7fda24155030 0x7fda240c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:54.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.911+0000 7fda28c53700 1 --2- 172.21.15.49:0/4242328830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda240c3090 0x7fda24155c10 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:54.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.911+0000 7fda28c53700 1 -- 172.21.15.49:0/4242328830 >> 172.21.15.49:0/4242328830 conn(0x7fda24062700 msgr2=0x7fda24062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:54.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.911+0000 7fda28c53700 1 -- 172.21.15.49:0/4242328830 shutdown_connections 2023-11-30T17:07:54.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.911+0000 7fda28c53700 1 -- 172.21.15.49:0/4242328830 wait complete. 2023-11-30T17:07:54.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.912+0000 7fda28c53700 1 Processor -- start 2023-11-30T17:07:54.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.912+0000 7fda28c53700 1 -- start start 2023-11-30T17:07:54.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.913+0000 7fda28c53700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda240c3090 0x7fda240ab5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:54.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.913+0000 7fda28c53700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda24155030 0x7fda24092260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:54.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.913+0000 7fda28c53700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda24155830 0x7fda24092750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:54.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.913+0000 7fda28c53700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda240acf30 con 0x7fda24155830 2023-11-30T17:07:54.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.913+0000 7fda28c53700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda240acaa0 con 0x7fda24155030 2023-11-30T17:07:54.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.913+0000 7fda28c53700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda240abe90 con 0x7fda240c3090 2023-11-30T17:07:54.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.913+0000 7fda22d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda24155830 0x7fda24092750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:54.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.913+0000 7fda22d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda24155830 0x7fda24092750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47934/0 (socket says 172.21.15.49:47934) 2023-11-30T17:07:54.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.913+0000 7fda22d9d700 1 -- 172.21.15.49:0/392157098 learned_addr learned my addr 172.21.15.49:0/392157098 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:54.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.913+0000 7fda21d9b700 1 --2- 172.21.15.49:0/392157098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda24155030 0x7fda24092260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:54.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.913+0000 7fda2259c700 1 --2- 172.21.15.49:0/392157098 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda240c3090 0x7fda240ab5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:54.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.913+0000 7fda22d9d700 1 -- 172.21.15.49:0/392157098 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda240c3090 msgr2=0x7fda240ab5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:54.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.913+0000 7fda22d9d700 1 --2- 172.21.15.49:0/392157098 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda240c3090 0x7fda240ab5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:54.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.913+0000 7fda22d9d700 1 -- 172.21.15.49:0/392157098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda24155030 msgr2=0x7fda24092260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:54.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.913+0000 7fda22d9d700 1 --2- 172.21.15.49:0/392157098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda24155030 0x7fda24092260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:54.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.913+0000 7fda22d9d700 1 -- 172.21.15.49:0/392157098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1800b610 con 0x7fda24155830 2023-11-30T17:07:54.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.914+0000 7fda22d9d700 1 --2- 172.21.15.49:0/392157098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda24155830 0x7fda24092750 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fda1c009fa0 tx=0x7fda1c009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:54.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.914+0000 7fda127fc700 1 -- 172.21.15.49:0/392157098 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c00ed20 con 0x7fda24155830 2023-11-30T17:07:54.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.914+0000 7fda127fc700 1 -- 172.21.15.49:0/392157098 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1c00ee80 con 0x7fda24155830 2023-11-30T17:07:54.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.914+0000 7fda28c53700 1 -- 172.21.15.49:0/392157098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda240ac170 con 0x7fda24155830 2023-11-30T17:07:54.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.914+0000 7fda127fc700 1 -- 172.21.15.49:0/392157098 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c014610 con 0x7fda24155830 2023-11-30T17:07:54.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.914+0000 7fda28c53700 1 -- 172.21.15.49:0/392157098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda240ac730 con 0x7fda24155830 2023-11-30T17:07:54.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.915+0000 7fda28c53700 1 -- 172.21.15.49:0/392157098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda240c5e40 con 0x7fda24155830 2023-11-30T17:07:54.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.916+0000 7fda127fc700 1 -- 172.21.15.49:0/392157098 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fda1c01d3b0 con 0x7fda24155830 2023-11-30T17:07:54.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.916+0000 7fda127fc700 1 --2- 172.21.15.49:0/392157098 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fda0405f150 0x7fda04061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:54.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.916+0000 7fda127fc700 1 -- 172.21.15.49:0/392157098 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fda1c07acd0 con 0x7fda24155830 2023-11-30T17:07:54.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.916+0000 7fda2259c700 1 --2- 172.21.15.49:0/392157098 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fda0405f150 0x7fda04061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:54.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.917+0000 7fda2259c700 1 --2- 172.21.15.49:0/392157098 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fda0405f150 0x7fda04061610 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fda14003630 tx=0x7fda14009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:54.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:54.920+0000 7fda127fc700 1 -- 172.21.15.49:0/392157098 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fda1c04beb0 con 0x7fda24155830 2023-11-30T17:07:55.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.136+0000 7fda28c53700 1 -- 172.21.15.49:0/392157098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fda2406c860 con 0x7fda24155830 2023-11-30T17:07:55.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.775+0000 7fda127fc700 1 -- 172.21.15.49:0/392157098 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fda1c04f4d0 con 0x7fda24155830 2023-11-30T17:07:55.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.778+0000 7fda28c53700 1 -- 172.21.15.49:0/392157098 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fda0405f150 msgr2=0x7fda04061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:55.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.778+0000 7fda28c53700 1 --2- 172.21.15.49:0/392157098 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fda0405f150 0x7fda04061610 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fda14003630 tx=0x7fda14009040).stop 2023-11-30T17:07:55.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.778+0000 7fda28c53700 1 -- 172.21.15.49:0/392157098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda24155830 msgr2=0x7fda24092750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:55.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.778+0000 7fda28c53700 1 --2- 172.21.15.49:0/392157098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda24155830 0x7fda24092750 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fda1c009fa0 tx=0x7fda1c009900).stop 2023-11-30T17:07:55.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.778+0000 7fda28c53700 1 -- 172.21.15.49:0/392157098 shutdown_connections 2023-11-30T17:07:55.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.778+0000 7fda28c53700 1 --2- 172.21.15.49:0/392157098 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fda0405f150 0x7fda04061610 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:55.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.778+0000 7fda28c53700 1 --2- 172.21.15.49:0/392157098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda24155830 0x7fda24092750 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:55.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.778+0000 7fda28c53700 1 --2- 172.21.15.49:0/392157098 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda240c3090 0x7fda240ab5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:55.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.778+0000 7fda28c53700 1 --2- 172.21.15.49:0/392157098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda24155030 0x7fda24092260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:55.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.778+0000 7fda28c53700 1 -- 172.21.15.49:0/392157098 >> 172.21.15.49:0/392157098 conn(0x7fda24062700 msgr2=0x7fda24150af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:55.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.778+0000 7fda28c53700 1 -- 172.21.15.49:0/392157098 shutdown_connections 2023-11-30T17:07:55.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.778+0000 7fda28c53700 1 -- 172.21.15.49:0/392157098 wait complete. 2023-11-30T17:07:55.794 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-30T17:07:55.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.958+0000 7f0f3448a700 1 Processor -- start 2023-11-30T17:07:55.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.958+0000 7f0f3448a700 1 -- start start 2023-11-30T17:07:55.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.959+0000 7f0f3448a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f2c154900 0x7f0f2c0bcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:55.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.959+0000 7f0f3448a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0f2c0bd3e0 0x7f0f2c0c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:55.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.959+0000 7f0f3448a700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f2c067840 con 0x7f0f2c154520 2023-11-30T17:07:55.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.959+0000 7f0f3448a700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f2c0bd870 con 0x7f0f2c0bd3e0 2023-11-30T17:07:55.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.959+0000 7f0f3448a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2c066c30 con 0x7f0f2c154900 2023-11-30T17:07:55.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.959+0000 7f0f32a27700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0f2c0bd3e0 0x7f0f2c0c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:55.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.959+0000 7f0f32a27700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0f2c0bd3e0 0x7f0f2c0c40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47950/0 (socket says 172.21.15.49:47950) 2023-11-30T17:07:55.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.959+0000 7f0f32a27700 1 -- 172.21.15.49:0/659093976 learned_addr learned my addr 172.21.15.49:0/659093976 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:55.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.959+0000 7f0f31a25700 1 --2- 172.21.15.49:0/659093976 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f2c154900 0x7f0f2c0bcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:55.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.960+0000 7f0f32a27700 1 -- 172.21.15.49:0/659093976 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f2c154900 msgr2=0x7f0f2c0bcef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:55.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.960+0000 7f0f32a27700 1 --2- 172.21.15.49:0/659093976 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f2c154900 0x7f0f2c0bcef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:55.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.960+0000 7f0f32a27700 1 -- 172.21.15.49:0/659093976 >> v1:172.21.15.115:6789/0 conn(0x7f0f2c154520 legacy=0x7f0f2c06a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:55.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.960+0000 7f0f32a27700 1 -- 172.21.15.49:0/659093976 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f2c066f10 con 0x7f0f2c0bd3e0 2023-11-30T17:07:55.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.960+0000 7f0f32a27700 1 --2- 172.21.15.49:0/659093976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f2c0bd3e0 0x7f0f2c0c40d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f0f1c009f20 tx=0x7f0f1c009840).ready entity=mon.0 client_cookie=b309f47058f8fedc server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:55.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.960+0000 7f0f31224700 1 -- 172.21.15.49:0/659093976 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c00e070 con 0x7f0f2c0bd3e0 2023-11-30T17:07:55.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.960+0000 7f0f31224700 1 -- 172.21.15.49:0/659093976 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1c00b9d0 con 0x7f0f2c0bd3e0 2023-11-30T17:07:55.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.960+0000 7f0f31224700 1 -- 172.21.15.49:0/659093976 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c00bd50 con 0x7f0f2c0bd3e0 2023-11-30T17:07:55.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.960+0000 7f0f3448a700 1 -- 172.21.15.49:0/659093976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f2c0bd3e0 msgr2=0x7f0f2c0c40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:55.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.960+0000 7f0f3448a700 1 --2- 172.21.15.49:0/659093976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f2c0bd3e0 0x7f0f2c0c40d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f0f1c009f20 tx=0x7f0f1c009840).stop 2023-11-30T17:07:55.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.961+0000 7f0f3448a700 1 -- 172.21.15.49:0/659093976 shutdown_connections 2023-11-30T17:07:55.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.961+0000 7f0f3448a700 1 --2- 172.21.15.49:0/659093976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f2c0bd3e0 0x7f0f2c0c40d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:55.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.961+0000 7f0f3448a700 1 --2- 172.21.15.49:0/659093976 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f2c154900 0x7f0f2c0bcef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:55.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.961+0000 7f0f3448a700 1 -- 172.21.15.49:0/659093976 >> 172.21.15.49:0/659093976 conn(0x7f0f2c063810 msgr2=0x7f0f2c063c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:55.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.961+0000 7f0f3448a700 1 -- 172.21.15.49:0/659093976 shutdown_connections 2023-11-30T17:07:55.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.961+0000 7f0f3448a700 1 -- 172.21.15.49:0/659093976 wait complete. 2023-11-30T17:07:55.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.962+0000 7f0f3448a700 1 Processor -- start 2023-11-30T17:07:55.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.962+0000 7f0f3448a700 1 -- start start 2023-11-30T17:07:55.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.962+0000 7f0f3448a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f2c0bd3e0 0x7f0f2c0a8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:55.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.962+0000 7f0f3448a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f2c154520 0x7f0f2c0c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:55.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.962+0000 7f0f3448a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f2c154900 0x7f0f2c0c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:55.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.962+0000 7f0f3448a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2c0c8a80 con 0x7f0f2c0bd3e0 2023-11-30T17:07:55.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.962+0000 7f0f3448a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2c0c3c40 con 0x7f0f2c154900 2023-11-30T17:07:55.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.962+0000 7f0f3448a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2c165530 con 0x7f0f2c154520 2023-11-30T17:07:55.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.963+0000 7f0f32226700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f2c0bd3e0 0x7f0f2c0a8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:55.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.963+0000 7f0f32226700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f2c0bd3e0 0x7f0f2c0a8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47968/0 (socket says 172.21.15.49:47968) 2023-11-30T17:07:55.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.963+0000 7f0f32226700 1 -- 172.21.15.49:0/989668248 learned_addr learned my addr 172.21.15.49:0/989668248 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:55.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.963+0000 7f0f31a25700 1 --2- 172.21.15.49:0/989668248 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f2c154520 0x7f0f2c0c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:55.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.963+0000 7f0f32a27700 1 --2- 172.21.15.49:0/989668248 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f2c154900 0x7f0f2c0c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:55.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.963+0000 7f0f32226700 1 -- 172.21.15.49:0/989668248 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f2c154520 msgr2=0x7f0f2c0c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:55.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.963+0000 7f0f32226700 1 --2- 172.21.15.49:0/989668248 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f2c154520 0x7f0f2c0c40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:55.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.963+0000 7f0f32226700 1 -- 172.21.15.49:0/989668248 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f2c154900 msgr2=0x7f0f2c0c45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:55.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.963+0000 7f0f32226700 1 --2- 172.21.15.49:0/989668248 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f2c154900 0x7f0f2c0c45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:55.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.963+0000 7f0f32226700 1 -- 172.21.15.49:0/989668248 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1c009ae0 con 0x7f0f2c0bd3e0 2023-11-30T17:07:55.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.963+0000 7f0f32226700 1 --2- 172.21.15.49:0/989668248 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f2c0bd3e0 0x7f0f2c0a8ca0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f0f2400c4c0 tx=0x7f0f24007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:55.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.963+0000 7f0f2a7fc700 1 -- 172.21.15.49:0/989668248 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2400ce70 con 0x7f0f2c0bd3e0 2023-11-30T17:07:55.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.963+0000 7f0f2a7fc700 1 -- 172.21.15.49:0/989668248 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f24001e90 con 0x7f0f2c0bd3e0 2023-11-30T17:07:55.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.963+0000 7f0f3448a700 1 -- 172.21.15.49:0/989668248 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f2c165810 con 0x7f0f2c0bd3e0 2023-11-30T17:07:55.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.963+0000 7f0f2a7fc700 1 -- 172.21.15.49:0/989668248 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f24007250 con 0x7f0f2c0bd3e0 2023-11-30T17:07:55.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.963+0000 7f0f3448a700 1 -- 172.21.15.49:0/989668248 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f2c0c3980 con 0x7f0f2c0bd3e0 2023-11-30T17:07:55.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.964+0000 7f0f3448a700 1 -- 172.21.15.49:0/989668248 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f2c0c5920 con 0x7f0f2c0bd3e0 2023-11-30T17:07:55.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.965+0000 7f0f2a7fc700 1 -- 172.21.15.49:0/989668248 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0f240066a0 con 0x7f0f2c0bd3e0 2023-11-30T17:07:55.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.965+0000 7f0f2a7fc700 1 --2- 172.21.15.49:0/989668248 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0f1805f150 0x7f0f18061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:55.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.965+0000 7f0f2a7fc700 1 -- 172.21.15.49:0/989668248 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f0f24079a70 con 0x7f0f2c0bd3e0 2023-11-30T17:07:55.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.965+0000 7f0f31a25700 1 --2- 172.21.15.49:0/989668248 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0f1805f150 0x7f0f18061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:55.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.966+0000 7f0f31a25700 1 --2- 172.21.15.49:0/989668248 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0f1805f150 0x7f0f18061610 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f0f2c1533e0 tx=0x7f0f20009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:55.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:55.969+0000 7f0f2a7fc700 1 -- 172.21.15.49:0/989668248 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0f2404acf0 con 0x7f0f2c0bd3e0 2023-11-30T17:07:56.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.143+0000 7f0f3448a700 1 -- 172.21.15.49:0/989668248 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0f2c0c3f20 con 0x7f0f2c0bd3e0 2023-11-30T17:07:56.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.780+0000 7f0f2a7fc700 1 -- 172.21.15.49:0/989668248 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0f2404e310 con 0x7f0f2c0bd3e0 2023-11-30T17:07:56.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.783+0000 7f0f3448a700 1 -- 172.21.15.49:0/989668248 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0f1805f150 msgr2=0x7f0f18061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:56.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.783+0000 7f0f3448a700 1 --2- 172.21.15.49:0/989668248 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0f1805f150 0x7f0f18061610 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f0f2c1533e0 tx=0x7f0f20009060).stop 2023-11-30T17:07:56.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.784+0000 7f0f3448a700 1 -- 172.21.15.49:0/989668248 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f2c0bd3e0 msgr2=0x7f0f2c0a8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:56.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.784+0000 7f0f3448a700 1 --2- 172.21.15.49:0/989668248 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f2c0bd3e0 0x7f0f2c0a8ca0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f0f2400c4c0 tx=0x7f0f24007e00).stop 2023-11-30T17:07:56.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.784+0000 7f0f3448a700 1 -- 172.21.15.49:0/989668248 shutdown_connections 2023-11-30T17:07:56.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.784+0000 7f0f3448a700 1 --2- 172.21.15.49:0/989668248 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f2c154900 0x7f0f2c0c45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:56.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.784+0000 7f0f3448a700 1 --2- 172.21.15.49:0/989668248 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0f1805f150 0x7f0f18061610 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:56.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.784+0000 7f0f3448a700 1 --2- 172.21.15.49:0/989668248 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f2c0bd3e0 0x7f0f2c0a8ca0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:56.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.784+0000 7f0f3448a700 1 --2- 172.21.15.49:0/989668248 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f2c154520 0x7f0f2c0c40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:56.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.784+0000 7f0f3448a700 1 -- 172.21.15.49:0/989668248 >> 172.21.15.49:0/989668248 conn(0x7f0f2c063810 msgr2=0x7f0f2c153560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:56.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.786+0000 7f0f3448a700 1 -- 172.21.15.49:0/989668248 shutdown_connections 2023-11-30T17:07:56.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.786+0000 7f0f3448a700 1 -- 172.21.15.49:0/989668248 wait complete. 2023-11-30T17:07:56.790 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2023-11-30T17:07:56.802 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-30T17:07:56.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.928+0000 7f2a5ff34700 1 Processor -- start 2023-11-30T17:07:56.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.928+0000 7f2a5ff34700 1 -- start start 2023-11-30T17:07:56.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.929+0000 7f2a5ff34700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a58154530 0x7f2a58154910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:56.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.929+0000 7f2a5ff34700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2a580a7ff0 0x7f2a580c8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:56.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.929+0000 7f2a5ff34700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a580c6630 con 0x7f2a580aa220 2023-11-30T17:07:56.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.929+0000 7f2a5ff34700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a580c6390 con 0x7f2a580a7ff0 2023-11-30T17:07:56.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.929+0000 7f2a5ff34700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a580a8470 con 0x7f2a58154530 2023-11-30T17:07:56.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.929+0000 7f2a5d4cf700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2a580a7ff0 0x7f2a580c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:56.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.929+0000 7f2a5e4d1700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2a580aa220 0x7f2a580c6ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49920/0 (socket says 172.21.15.49:49920) 2023-11-30T17:07:56.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.929+0000 7f2a5e4d1700 1 -- 172.21.15.49:0/455691055 learned_addr learned my addr 172.21.15.49:0/455691055 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:56.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.929+0000 7f2a5d4cf700 1 -- 172.21.15.49:0/455691055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a58154530 msgr2=0x7f2a58154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:56.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.929+0000 7f2a5d4cf700 1 --2- 172.21.15.49:0/455691055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a58154530 0x7f2a58154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-30T17:07:56.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.929+0000 7f2a5d4cf700 1 -- 172.21.15.49:0/455691055 >> v1:172.21.15.49:6789/0 conn(0x7f2a580aa220 legacy=0x7f2a580c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:56.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.929+0000 7f2a5ccce700 1 -- 172.21.15.49:0/455691055 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1487679845 0 0) 0x7f2a580c6630 con 0x7f2a580aa220 2023-11-30T17:07:56.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.929+0000 7f2a5d4cf700 1 -- 172.21.15.49:0/455691055 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a58064230 con 0x7f2a580a7ff0 2023-11-30T17:07:56.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.929+0000 7f2a5d4cf700 1 --2- 172.21.15.49:0/455691055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a580a7ff0 0x7f2a580c8580 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f2a4c009760 tx=0x7f2a4c009060).ready entity=mon.0 client_cookie=57689c1e4c221c93 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:56.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.929+0000 7f2a5ccce700 1 -- 172.21.15.49:0/455691055 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c00b580 con 0x7f2a580a7ff0 2023-11-30T17:07:56.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.929+0000 7f2a5ccce700 1 -- 172.21.15.49:0/455691055 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4c00b6e0 con 0x7f2a580a7ff0 2023-11-30T17:07:56.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.929+0000 7f2a5ccce700 1 -- 172.21.15.49:0/455691055 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c00ba60 con 0x7f2a580a7ff0 2023-11-30T17:07:56.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.930+0000 7f2a5ff34700 1 -- 172.21.15.49:0/455691055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a580a7ff0 msgr2=0x7f2a580c8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:56.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.930+0000 7f2a5ff34700 1 --2- 172.21.15.49:0/455691055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a580a7ff0 0x7f2a580c8580 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f2a4c009760 tx=0x7f2a4c009060).stop 2023-11-30T17:07:56.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.930+0000 7f2a5ff34700 1 -- 172.21.15.49:0/455691055 shutdown_connections 2023-11-30T17:07:56.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.930+0000 7f2a5ff34700 1 --2- 172.21.15.49:0/455691055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a58154530 0x7f2a58154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-30T17:07:56.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.930+0000 7f2a5ff34700 1 --2- 172.21.15.49:0/455691055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a580a7ff0 0x7f2a580c8580 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:56.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.930+0000 7f2a5ff34700 1 -- 172.21.15.49:0/455691055 >> 172.21.15.49:0/455691055 conn(0x7f2a58094930 msgr2=0x7f2a5806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:56.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.930+0000 7f2a5ff34700 1 -- 172.21.15.49:0/455691055 shutdown_connections 2023-11-30T17:07:56.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.930+0000 7f2a5ff34700 1 -- 172.21.15.49:0/455691055 wait complete. 2023-11-30T17:07:56.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.931+0000 7f2a5ff34700 1 Processor -- start 2023-11-30T17:07:56.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.931+0000 7f2a5ff34700 1 -- start start 2023-11-30T17:07:56.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.932+0000 7f2a5ff34700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a580a7ff0 0x7f2a580b0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:56.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.932+0000 7f2a5ff34700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a580aa220 0x7f2a580ab620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:56.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.932+0000 7f2a5ff34700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a58154530 0x7f2a5813b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:56.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.932+0000 7f2a5ff34700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a580b1400 con 0x7f2a580a7ff0 2023-11-30T17:07:56.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.932+0000 7f2a5ff34700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5814e6a0 con 0x7f2a58154530 2023-11-30T17:07:56.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.932+0000 7f2a5ff34700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a580abb10 con 0x7f2a580aa220 2023-11-30T17:07:56.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.932+0000 7f2a5dcd0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a580a7ff0 0x7f2a580b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:56.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.932+0000 7f2a5dcd0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a580a7ff0 0x7f2a580b0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47980/0 (socket says 172.21.15.49:47980) 2023-11-30T17:07:56.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.932+0000 7f2a5dcd0700 1 -- 172.21.15.49:0/4034297969 learned_addr learned my addr 172.21.15.49:0/4034297969 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:56.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.932+0000 7f2a5d4cf700 1 --2- 172.21.15.49:0/4034297969 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a580aa220 0x7f2a580ab620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:56.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.932+0000 7f2a5e4d1700 1 --2- 172.21.15.49:0/4034297969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a58154530 0x7f2a5813b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:56.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.932+0000 7f2a5dcd0700 1 -- 172.21.15.49:0/4034297969 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a580aa220 msgr2=0x7f2a580ab620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:56.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.932+0000 7f2a5dcd0700 1 --2- 172.21.15.49:0/4034297969 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a580aa220 0x7f2a580ab620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:56.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.932+0000 7f2a5dcd0700 1 -- 172.21.15.49:0/4034297969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a58154530 msgr2=0x7f2a5813b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:56.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.932+0000 7f2a5dcd0700 1 --2- 172.21.15.49:0/4034297969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a58154530 0x7f2a5813b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:56.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.932+0000 7f2a5dcd0700 1 -- 172.21.15.49:0/4034297969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4c0092a0 con 0x7f2a580a7ff0 2023-11-30T17:07:56.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.932+0000 7f2a5d4cf700 1 --2- 172.21.15.49:0/4034297969 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a580aa220 0x7f2a580ab620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:56.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.932+0000 7f2a5dcd0700 1 --2- 172.21.15.49:0/4034297969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a580a7ff0 0x7f2a580b0190 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f2a5000b490 tx=0x7f2a50009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:56.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.932+0000 7f2a55ffb700 1 -- 172.21.15.49:0/4034297969 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a50002320 con 0x7f2a580a7ff0 2023-11-30T17:07:56.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.932+0000 7f2a55ffb700 1 -- 172.21.15.49:0/4034297969 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a500024a0 con 0x7f2a580a7ff0 2023-11-30T17:07:56.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.932+0000 7f2a5ff34700 1 -- 172.21.15.49:0/4034297969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a580abd70 con 0x7f2a580a7ff0 2023-11-30T17:07:56.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.932+0000 7f2a55ffb700 1 -- 172.21.15.49:0/4034297969 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a50002860 con 0x7f2a580a7ff0 2023-11-30T17:07:56.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.933+0000 7f2a5ff34700 1 -- 172.21.15.49:0/4034297969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a580ac100 con 0x7f2a580a7ff0 2023-11-30T17:07:56.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.934+0000 7f2a5ff34700 1 -- 172.21.15.49:0/4034297969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a5806c860 con 0x7f2a580a7ff0 2023-11-30T17:07:56.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.934+0000 7f2a55ffb700 1 -- 172.21.15.49:0/4034297969 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2a50002c10 con 0x7f2a580a7ff0 2023-11-30T17:07:56.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.935+0000 7f2a55ffb700 1 --2- 172.21.15.49:0/4034297969 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2a4405f150 0x7f2a44061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:56.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.935+0000 7f2a55ffb700 1 -- 172.21.15.49:0/4034297969 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5769+0+0 (secure 0 0 0) 0x7f2a50079f90 con 0x7f2a580a7ff0 2023-11-30T17:07:56.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.935+0000 7f2a5d4cf700 1 --2- 172.21.15.49:0/4034297969 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2a4405f150 0x7f2a44061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:56.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.935+0000 7f2a5d4cf700 1 --2- 172.21.15.49:0/4034297969 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2a4405f150 0x7f2a44061610 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f2a4c009760 tx=0x7f2a4c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:56.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:56.939+0000 7f2a55ffb700 1 -- 172.21.15.49:0/4034297969 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2a5004b300 con 0x7f2a580a7ff0 2023-11-30T17:07:57.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:57.112+0000 7f2a5ff34700 1 -- 172.21.15.49:0/4034297969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2a58064510 con 0x7f2a580a7ff0 2023-11-30T17:07:57.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:57.784+0000 7f2a55ffb700 1 -- 172.21.15.49:0/4034297969 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2a5004e920 con 0x7f2a580a7ff0 2023-11-30T17:07:57.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:57.792+0000 7f2a5ff34700 1 -- 172.21.15.49:0/4034297969 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2a4405f150 msgr2=0x7f2a44061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:57.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:57.792+0000 7f2a5ff34700 1 --2- 172.21.15.49:0/4034297969 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2a4405f150 0x7f2a44061610 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f2a4c009760 tx=0x7f2a4c017000).stop 2023-11-30T17:07:57.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:57.792+0000 7f2a5ff34700 1 -- 172.21.15.49:0/4034297969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a580a7ff0 msgr2=0x7f2a580b0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:57.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:57.792+0000 7f2a5ff34700 1 --2- 172.21.15.49:0/4034297969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a580a7ff0 0x7f2a580b0190 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f2a5000b490 tx=0x7f2a50009060).stop 2023-11-30T17:07:57.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:57.792+0000 7f2a5ff34700 1 -- 172.21.15.49:0/4034297969 shutdown_connections 2023-11-30T17:07:57.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:57.792+0000 7f2a5ff34700 1 --2- 172.21.15.49:0/4034297969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a58154530 0x7f2a5813b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:57.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:57.792+0000 7f2a5ff34700 1 --2- 172.21.15.49:0/4034297969 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2a4405f150 0x7f2a44061610 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:57.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:57.792+0000 7f2a5ff34700 1 --2- 172.21.15.49:0/4034297969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a580a7ff0 0x7f2a580b0190 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:57.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:57.792+0000 7f2a5ff34700 1 --2- 172.21.15.49:0/4034297969 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a580aa220 0x7f2a580ab620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:57.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:57.792+0000 7f2a5ff34700 1 -- 172.21.15.49:0/4034297969 >> 172.21.15.49:0/4034297969 conn(0x7f2a58094930 msgr2=0x7f2a5814fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:57.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:57.793+0000 7f2a5ff34700 1 -- 172.21.15.49:0/4034297969 shutdown_connections 2023-11-30T17:07:57.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:57.793+0000 7f2a5ff34700 1 -- 172.21.15.49:0/4034297969 wait complete. 2023-11-30T17:07:57.796 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2023-11-30T17:07:57.810 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-30T17:07:57.811 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-30T17:07:57.811 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-30T17:07:57.811 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T17:07:57.811 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-30T17:07:57.811 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-30T17:07:57.811 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-30T17:07:57.811 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T17:07:57.812 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-30T17:07:57.812 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-30T17:07:57.812 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-30T17:07:57.812 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T17:07:57.812 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-30T17:07:57.812 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-30T17:07:57.812 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-30T17:07:57.813 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T17:07:57.821 INFO:tasks.ceph.mds.c:Stopped 2023-11-30T17:07:57.821 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-30T17:07:57.822 INFO:tasks.ceph.mds.a:Stopped 2023-11-30T17:07:57.822 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-30T17:07:57.823 INFO:tasks.ceph.mds.b:Stopped 2023-11-30T17:07:57.823 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-30T17:07:57.824 INFO:tasks.ceph.mds.d:Stopped 2023-11-30T17:07:57.824 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-30T17:07:57.864 INFO:tasks.ceph.mds.c:Started 2023-11-30T17:07:57.864 DEBUG:teuthology.parallel:result is None 2023-11-30T17:07:57.864 INFO:tasks.ceph.mds.a:Started 2023-11-30T17:07:57.865 DEBUG:teuthology.parallel:result is None 2023-11-30T17:07:57.867 INFO:tasks.ceph.mds.b:Started 2023-11-30T17:07:57.867 DEBUG:teuthology.parallel:result is None 2023-11-30T17:07:57.867 INFO:tasks.ceph.mds.d:Started 2023-11-30T17:07:57.868 DEBUG:teuthology.parallel:result is None 2023-11-30T17:07:57.868 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-30T17:07:57.942 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-11-30T17:07:57.943 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-11-30T17:07:57.949 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-11-30T17:07:57.950 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-11-30T17:07:58.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:57.999+0000 7fab3f1d8700 1 Processor -- start 2023-11-30T17:07:58.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:57.999+0000 7fab3f1d8700 1 -- start start 2023-11-30T17:07:58.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.000+0000 7fab3f1d8700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fab38098d10 0x7fab380c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:58.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.000+0000 7fab3f1d8700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fab38158320 0x7fab381587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:58.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.000+0000 7fab3f1d8700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab38158cc0 con 0x7fab380c6190 2023-11-30T17:07:58.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.000+0000 7fab3f1d8700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab380c72d0 con 0x7fab38098d10 2023-11-30T17:07:58.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.000+0000 7fab3f1d8700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab38064570 con 0x7fab38158320 2023-11-30T17:07:58.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.000+0000 7fab3cf74700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fab38098d10 0x7fab380c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:58.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.000+0000 7fab3cf74700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fab38098d10 0x7fab380c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48012/0 (socket says 172.21.15.49:48012) 2023-11-30T17:07:58.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.000+0000 7fab3cf74700 1 -- 172.21.15.49:0/1957511024 learned_addr learned my addr 172.21.15.49:0/1957511024 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:58.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.000+0000 7fab3d775700 1 --2- 172.21.15.49:0/1957511024 >> v2:172.21.15.115:3300/0 conn(0x7fab38158320 0x7fab381587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:58.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.001+0000 7fab3cf74700 1 -- 172.21.15.49:0/1957511024 >> v2:172.21.15.115:3300/0 conn(0x7fab38158320 msgr2=0x7fab381587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:58.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.001+0000 7fab3cf74700 1 --2- 172.21.15.49:0/1957511024 >> v2:172.21.15.115:3300/0 conn(0x7fab38158320 0x7fab381587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:58.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.001+0000 7fab3cf74700 1 -- 172.21.15.49:0/1957511024 >> v1:172.21.15.115:6789/0 conn(0x7fab380c6190 legacy=0x7fab38063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:58.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.001+0000 7fab3cf74700 1 -- 172.21.15.49:0/1957511024 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab38154bc0 con 0x7fab38098d10 2023-11-30T17:07:58.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.001+0000 7fab3cf74700 1 --2- 172.21.15.49:0/1957511024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab38098d10 0x7fab380c7760 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fab380657a0 tx=0x7fab280090f0).ready entity=mon.0 client_cookie=edce45824b35a54a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:58.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.001+0000 7fab377fe700 1 -- 172.21.15.49:0/1957511024 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2800b5a0 con 0x7fab38098d10 2023-11-30T17:07:58.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.001+0000 7fab377fe700 1 -- 172.21.15.49:0/1957511024 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2800b700 con 0x7fab38098d10 2023-11-30T17:07:58.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.001+0000 7fab377fe700 1 -- 172.21.15.49:0/1957511024 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2800ba80 con 0x7fab38098d10 2023-11-30T17:07:58.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.001+0000 7fab3f1d8700 1 -- 172.21.15.49:0/1957511024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab38098d10 msgr2=0x7fab380c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:58.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.001+0000 7fab3f1d8700 1 --2- 172.21.15.49:0/1957511024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab38098d10 0x7fab380c7760 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fab380657a0 tx=0x7fab280090f0).stop 2023-11-30T17:07:58.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.001+0000 7fab3f1d8700 1 -- 172.21.15.49:0/1957511024 shutdown_connections 2023-11-30T17:07:58.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.001+0000 7fab3f1d8700 1 --2- 172.21.15.49:0/1957511024 >> v2:172.21.15.115:3300/0 conn(0x7fab38158320 0x7fab381587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:58.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.001+0000 7fab3f1d8700 1 --2- 172.21.15.49:0/1957511024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab38098d10 0x7fab380c7760 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:58.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.001+0000 7fab3f1d8700 1 -- 172.21.15.49:0/1957511024 >> 172.21.15.49:0/1957511024 conn(0x7fab380cb310 msgr2=0x7fab380cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:58.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.002+0000 7fab3f1d8700 1 -- 172.21.15.49:0/1957511024 shutdown_connections 2023-11-30T17:07:58.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.002+0000 7fab3f1d8700 1 -- 172.21.15.49:0/1957511024 wait complete. 2023-11-30T17:07:58.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.003+0000 7fab3f1d8700 1 Processor -- start 2023-11-30T17:07:58.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.003+0000 7fab3f1d8700 1 -- start start 2023-11-30T17:07:58.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.004+0000 7fab3f1d8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab38098d10 0x7fab3814c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:58.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.004+0000 7fab3f1d8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab380c6190 0x7fab3814e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:58.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.004+0000 7fab3f1d8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab38158320 0x7fab380a8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:58.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.004+0000 7fab3f1d8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab380a99c0 con 0x7fab38098d10 2023-11-30T17:07:58.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.004+0000 7fab3f1d8700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab380a8b30 con 0x7fab38158320 2023-11-30T17:07:58.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.004+0000 7fab3f1d8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab380a8db0 con 0x7fab380c6190 2023-11-30T17:07:58.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.004+0000 7fab3cf74700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab38098d10 0x7fab3814c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:58.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.004+0000 7fab3cf74700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab38098d10 0x7fab3814c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48028/0 (socket says 172.21.15.49:48028) 2023-11-30T17:07:58.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.004+0000 7fab3cf74700 1 -- 172.21.15.49:0/1456403822 learned_addr learned my addr 172.21.15.49:0/1456403822 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:58.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.004+0000 7fab3d775700 1 --2- 172.21.15.49:0/1456403822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab38158320 0x7fab380a8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:58.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.004+0000 7fab37fff700 1 --2- 172.21.15.49:0/1456403822 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab380c6190 0x7fab3814e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:58.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.004+0000 7fab3cf74700 1 -- 172.21.15.49:0/1456403822 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab380c6190 msgr2=0x7fab3814e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:58.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.004+0000 7fab3cf74700 1 --2- 172.21.15.49:0/1456403822 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab380c6190 0x7fab3814e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:58.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.004+0000 7fab3cf74700 1 -- 172.21.15.49:0/1456403822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab38158320 msgr2=0x7fab380a8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:58.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.004+0000 7fab3cf74700 1 --2- 172.21.15.49:0/1456403822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab38158320 0x7fab380a8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:58.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.004+0000 7fab3cf74700 1 -- 172.21.15.49:0/1456403822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab28009370 con 0x7fab38098d10 2023-11-30T17:07:58.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.004+0000 7fab3cf74700 1 --2- 172.21.15.49:0/1456403822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab38098d10 0x7fab3814c530 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fab380c2360 tx=0x7fab28015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:58.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.004+0000 7fab34ff9700 1 -- 172.21.15.49:0/1456403822 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2800bec0 con 0x7fab38098d10 2023-11-30T17:07:58.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.004+0000 7fab34ff9700 1 -- 172.21.15.49:0/1456403822 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2800b870 con 0x7fab38098d10 2023-11-30T17:07:58.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.004+0000 7fab3f1d8700 1 -- 172.21.15.49:0/1456403822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab380a9090 con 0x7fab38098d10 2023-11-30T17:07:58.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.004+0000 7fab34ff9700 1 -- 172.21.15.49:0/1456403822 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab280246a0 con 0x7fab38098d10 2023-11-30T17:07:58.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.004+0000 7fab3f1d8700 1 -- 172.21.15.49:0/1456403822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab380a9650 con 0x7fab38098d10 2023-11-30T17:07:58.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.005+0000 7fab3f1d8700 1 -- 172.21.15.49:0/1456403822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab3806c860 con 0x7fab38098d10 2023-11-30T17:07:58.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.006+0000 7fab34ff9700 1 -- 172.21.15.49:0/1456403822 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fab28021070 con 0x7fab38098d10 2023-11-30T17:07:58.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.006+0000 7fab34ff9700 1 --2- 172.21.15.49:0/1456403822 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fab2405f120 0x7fab240615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:58.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.006+0000 7fab34ff9700 1 -- 172.21.15.49:0/1456403822 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fab2807b820 con 0x7fab38098d10 2023-11-30T17:07:58.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.006+0000 7fab37fff700 1 --2- 172.21.15.49:0/1456403822 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fab2405f120 0x7fab240615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:58.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.007+0000 7fab37fff700 1 --2- 172.21.15.49:0/1456403822 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fab2405f120 0x7fab240615e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fab380643a0 tx=0x7fab2c007d20).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:58.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.010+0000 7fab34ff9700 1 -- 172.21.15.49:0/1456403822 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fab2804cdf0 con 0x7fab38098d10 2023-11-30T17:07:58.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.198+0000 7fab3f1d8700 1 -- 172.21.15.49:0/1456403822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fab38158cc0 con 0x7fab38098d10 2023-11-30T17:07:58.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.973+0000 7fab34ff9700 1 -- 172.21.15.49:0/1456403822 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7fab38158cc0 con 0x7fab38098d10 2023-11-30T17:07:58.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.975+0000 7fab3f1d8700 1 -- 172.21.15.49:0/1456403822 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fab2405f120 msgr2=0x7fab240615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:58.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.975+0000 7fab3f1d8700 1 --2- 172.21.15.49:0/1456403822 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fab2405f120 0x7fab240615e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fab380643a0 tx=0x7fab2c007d20).stop 2023-11-30T17:07:58.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.975+0000 7fab3f1d8700 1 -- 172.21.15.49:0/1456403822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab38098d10 msgr2=0x7fab3814c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:58.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.975+0000 7fab3f1d8700 1 --2- 172.21.15.49:0/1456403822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab38098d10 0x7fab3814c530 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fab380c2360 tx=0x7fab28015000).stop 2023-11-30T17:07:58.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.976+0000 7fab3f1d8700 1 -- 172.21.15.49:0/1456403822 shutdown_connections 2023-11-30T17:07:58.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.976+0000 7fab3f1d8700 1 --2- 172.21.15.49:0/1456403822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab38158320 0x7fab380a8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:58.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.976+0000 7fab3f1d8700 1 --2- 172.21.15.49:0/1456403822 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fab2405f120 0x7fab240615e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:58.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.976+0000 7fab3f1d8700 1 --2- 172.21.15.49:0/1456403822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab38098d10 0x7fab3814c530 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:58.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.976+0000 7fab3f1d8700 1 --2- 172.21.15.49:0/1456403822 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab380c6190 0x7fab3814e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:58.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.976+0000 7fab3f1d8700 1 -- 172.21.15.49:0/1456403822 >> 172.21.15.49:0/1456403822 conn(0x7fab380cb310 msgr2=0x7fab3814f290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:58.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.976+0000 7fab3f1d8700 1 -- 172.21.15.49:0/1456403822 shutdown_connections 2023-11-30T17:07:58.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:58.976+0000 7fab3f1d8700 1 -- 172.21.15.49:0/1456403822 wait complete. 2023-11-30T17:07:58.979 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2023-11-30T17:07:58.991 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-30T17:07:59.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.111+0000 7f13d65d9700 1 Processor -- start 2023-11-30T17:07:59.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.111+0000 7f13d65d9700 1 -- start start 2023-11-30T17:07:59.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.112+0000 7f13d65d9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13d00cae90 0x7f13d00c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:59.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.112+0000 7f13d65d9700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f13d00ca180 0x7f13d00c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:59.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.112+0000 7f13d65d9700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d00a9a90 con 0x7f13d00caab0 2023-11-30T17:07:59.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.112+0000 7f13d65d9700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d00c1490 con 0x7f13d00ca180 2023-11-30T17:07:59.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.112+0000 7f13d65d9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d0154ce0 con 0x7f13d00cae90 2023-11-30T17:07:59.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.112+0000 7f13d4b76700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f13d00ca180 0x7f13d00c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:59.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.112+0000 7f13cffff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f13d00caab0 0x7f13d00aa470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49926/0 (socket says 172.21.15.49:49926) 2023-11-30T17:07:59.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.112+0000 7f13cffff700 1 -- 172.21.15.49:0/2499930803 learned_addr learned my addr 172.21.15.49:0/2499930803 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:59.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.112+0000 7f13cf7fe700 1 --2- 172.21.15.49:0/2499930803 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13d00cae90 0x7f13d00c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:59.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.112+0000 7f13d4b76700 1 -- 172.21.15.49:0/2499930803 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13d00cae90 msgr2=0x7f13d00c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:59.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.112+0000 7f13d4b76700 1 --2- 172.21.15.49:0/2499930803 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13d00cae90 0x7f13d00c0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:59.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.112+0000 7f13d4b76700 1 -- 172.21.15.49:0/2499930803 >> v1:172.21.15.49:6789/0 conn(0x7f13d00caab0 legacy=0x7f13d00aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:59.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.112+0000 7f13d4b76700 1 -- 172.21.15.49:0/2499930803 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d00aab80 con 0x7f13d00ca180 2023-11-30T17:07:59.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.112+0000 7f13ceffd700 1 -- 172.21.15.49:0/2499930803 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2748932038 0 0) 0x7f13d00a9a90 con 0x7f13d00caab0 2023-11-30T17:07:59.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.112+0000 7f13d4b76700 1 --2- 172.21.15.49:0/2499930803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13d00ca180 0x7f13d00c0fa0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f13c8009e60 tx=0x7f13c8009780).ready entity=mon.0 client_cookie=25475af94a2e6083 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:59.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.113+0000 7f13ceffd700 1 -- 172.21.15.49:0/2499930803 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c800e070 con 0x7f13d00ca180 2023-11-30T17:07:59.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.113+0000 7f13ceffd700 1 -- 172.21.15.49:0/2499930803 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c800bc30 con 0x7f13d00ca180 2023-11-30T17:07:59.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.113+0000 7f13ceffd700 1 -- 172.21.15.49:0/2499930803 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c8012410 con 0x7f13d00ca180 2023-11-30T17:07:59.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.113+0000 7f13d65d9700 1 -- 172.21.15.49:0/2499930803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13d00ca180 msgr2=0x7f13d00c0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:59.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.113+0000 7f13d65d9700 1 --2- 172.21.15.49:0/2499930803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13d00ca180 0x7f13d00c0fa0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f13c8009e60 tx=0x7f13c8009780).stop 2023-11-30T17:07:59.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.113+0000 7f13d65d9700 1 -- 172.21.15.49:0/2499930803 shutdown_connections 2023-11-30T17:07:59.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.113+0000 7f13d65d9700 1 --2- 172.21.15.49:0/2499930803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13d00ca180 0x7f13d00c0fa0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:59.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.113+0000 7f13d65d9700 1 --2- 172.21.15.49:0/2499930803 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13d00cae90 0x7f13d00c0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:59.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.113+0000 7f13d65d9700 1 -- 172.21.15.49:0/2499930803 >> 172.21.15.49:0/2499930803 conn(0x7f13d0094920 msgr2=0x7f13d006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:59.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.113+0000 7f13d65d9700 1 -- 172.21.15.49:0/2499930803 shutdown_connections 2023-11-30T17:07:59.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.113+0000 7f13d65d9700 1 -- 172.21.15.49:0/2499930803 wait complete. 2023-11-30T17:07:59.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.114+0000 7f13d65d9700 1 Processor -- start 2023-11-30T17:07:59.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.114+0000 7f13d65d9700 1 -- start start 2023-11-30T17:07:59.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.115+0000 7f13d65d9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13d00ca180 0x7f13d00c2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:59.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.115+0000 7f13d65d9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13d00caab0 0x7f13d0158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:59.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.115+0000 7f13d65d9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13d00cae90 0x7f13d0158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:59.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.115+0000 7f13d65d9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d0159010 con 0x7f13d00cae90 2023-11-30T17:07:59.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.115+0000 7f13d65d9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d0164770 con 0x7f13d00caab0 2023-11-30T17:07:59.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.115+0000 7f13d65d9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d0164a50 con 0x7f13d00ca180 2023-11-30T17:07:59.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.115+0000 7f13d4b76700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13d00cae90 0x7f13d0158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:59.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.115+0000 7f13d4b76700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13d00cae90 0x7f13d0158b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48044/0 (socket says 172.21.15.49:48044) 2023-11-30T17:07:59.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.115+0000 7f13d4b76700 1 -- 172.21.15.49:0/1142511350 learned_addr learned my addr 172.21.15.49:0/1142511350 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:59.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.115+0000 7f13cffff700 1 --2- 172.21.15.49:0/1142511350 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13d00ca180 0x7f13d00c2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:59.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.116+0000 7f13cf7fe700 1 --2- 172.21.15.49:0/1142511350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13d00caab0 0x7f13d0158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:59.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.116+0000 7f13d4b76700 1 -- 172.21.15.49:0/1142511350 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13d00ca180 msgr2=0x7f13d00c2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:59.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.116+0000 7f13d4b76700 1 --2- 172.21.15.49:0/1142511350 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13d00ca180 0x7f13d00c2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:59.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.116+0000 7f13d4b76700 1 -- 172.21.15.49:0/1142511350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13d00caab0 msgr2=0x7f13d0158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:59.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.116+0000 7f13d4b76700 1 --2- 172.21.15.49:0/1142511350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13d00caab0 0x7f13d0158630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:59.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.116+0000 7f13d4b76700 1 -- 172.21.15.49:0/1142511350 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c8009a20 con 0x7f13d00cae90 2023-11-30T17:07:59.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.116+0000 7f13cf7fe700 1 --2- 172.21.15.49:0/1142511350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13d00caab0 0x7f13d0158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:59.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.116+0000 7f13cffff700 1 --2- 172.21.15.49:0/1142511350 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13d00ca180 0x7f13d00c2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:07:59.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.116+0000 7f13d4b76700 1 --2- 172.21.15.49:0/1142511350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13d00cae90 0x7f13d0158b20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f13d0083c30 tx=0x7f13c8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:59.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.116+0000 7f13c7fff700 1 -- 172.21.15.49:0/1142511350 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c8011750 con 0x7f13d00cae90 2023-11-30T17:07:59.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.116+0000 7f13c7fff700 1 -- 172.21.15.49:0/1142511350 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c80118b0 con 0x7f13d00cae90 2023-11-30T17:07:59.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.116+0000 7f13d65d9700 1 -- 172.21.15.49:0/1142511350 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d0164d30 con 0x7f13d00cae90 2023-11-30T17:07:59.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.116+0000 7f13c7fff700 1 -- 172.21.15.49:0/1142511350 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c8011c70 con 0x7f13d00cae90 2023-11-30T17:07:59.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.116+0000 7f13d65d9700 1 -- 172.21.15.49:0/1142511350 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d015b1b0 con 0x7f13d00cae90 2023-11-30T17:07:59.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.117+0000 7f13d65d9700 1 -- 172.21.15.49:0/1142511350 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d01651d0 con 0x7f13d00cae90 2023-11-30T17:07:59.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.117+0000 7f13c7fff700 1 -- 172.21.15.49:0/1142511350 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f13c8003040 con 0x7f13d00cae90 2023-11-30T17:07:59.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.118+0000 7f13c7fff700 1 --2- 172.21.15.49:0/1142511350 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f13b005f150 0x7f13b0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:59.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.118+0000 7f13c7fff700 1 -- 172.21.15.49:0/1142511350 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f13c807bdb0 con 0x7f13d00cae90 2023-11-30T17:07:59.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.118+0000 7f13cffff700 1 --2- 172.21.15.49:0/1142511350 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f13b005f150 0x7f13b0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:59.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.118+0000 7f13cffff700 1 --2- 172.21.15.49:0/1142511350 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f13b005f150 0x7f13b0061610 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f13d00ad8f0 tx=0x7f13b8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:59.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.122+0000 7f13c7fff700 1 -- 172.21.15.49:0/1142511350 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f13c804d3d0 con 0x7f13d00cae90 2023-11-30T17:07:59.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.359+0000 7f13d65d9700 1 -- 172.21.15.49:0/1142511350 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f13d00abd70 con 0x7f13d00cae90 2023-11-30T17:07:59.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.359+0000 7f13c7fff700 1 -- 172.21.15.49:0/1142511350 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f13d00abd70 con 0x7f13d00cae90 2023-11-30T17:07:59.362 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:07:59.362 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T17:07:59.362 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2023-11-30T17:07:59.362 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:07:59.362 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2023-11-30T17:07:59.362 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlwm1FHxAAk+s9c60UZ5jB37wbpGzlcg==", 2023-11-30T17:07:59.362 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:07:59.362 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:07:59.362 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:07:59.362 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:07:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:07:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:07:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:07:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:07:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2023-11-30T17:07:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlADm0KhAArffesGGTXzQwY4NPnJ1Bjw==", 2023-11-30T17:07:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:07:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:07:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:07:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:07:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:07:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:07:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:07:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:07:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2023-11-30T17:07:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlYnY1JhAA+Lurauug0NhWnK8aZErR3g==", 2023-11-30T17:07:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:07:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:07:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:07:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:07:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:07:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:07:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:07:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:07:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2023-11-30T17:07:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlQdKCMRAA3h4O2NqkQ2zE3DxOqBoaQQ==", 2023-11-30T17:07:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:07:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:07:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:07:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:07:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:07:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:07:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:07:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:07:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2023-11-30T17:07:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAPwWhlGdbhFxAAOspNRLMhR59LSWatFbsYDA==", 2023-11-30T17:07:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:07:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:07:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:07:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:07:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:07:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:07:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:07:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2023-11-30T17:07:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQASwWhlfwUEFxAAuj0L8ooIGi1vsb7XWLVlDA==", 2023-11-30T17:07:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:07:59.366 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:07:59.366 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:07:59.366 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:07:59.366 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:07:59.366 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:07:59.366 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:07:59.366 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2023-11-30T17:07:59.366 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAVwWhl7XYwFBAAuSHZqdfRR8V1Y+hmPT5uuw==", 2023-11-30T17:07:59.366 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:07:59.366 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:07:59.366 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:07:59.366 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:07:59.366 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:07:59.366 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:07:59.366 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:07:59.367 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2023-11-30T17:07:59.367 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAYwWhlkhRCFRAAe3cRLcrhJ3ZoluXuRUhmew==", 2023-11-30T17:07:59.367 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:07:59.367 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:07:59.367 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:07:59.367 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:07:59.367 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:07:59.367 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:07:59.367 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:07:59.367 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2023-11-30T17:07:59.367 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAewWhlrq4qFBAAOSdqozO8iH25BQFrPI1SRQ==", 2023-11-30T17:07:59.367 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:07:59.367 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:07:59.367 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:07:59.367 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:07:59.368 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:07:59.368 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:07:59.368 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:07:59.368 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2023-11-30T17:07:59.368 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAhwWhlZL9WERAA90znWBLNuY5eem3yF6O0wg==", 2023-11-30T17:07:59.368 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:07:59.368 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:07:59.368 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:07:59.368 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:07:59.368 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:07:59.368 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:07:59.369 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:07:59.369 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2023-11-30T17:07:59.369 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAkwWhlCJDiEBAAETLCBNCdaWXFgkPPaulTAA==", 2023-11-30T17:07:59.369 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:07:59.369 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:07:59.369 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:07:59.369 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:07:59.370 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:07:59.370 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:07:59.370 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:07:59.370 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2023-11-30T17:07:59.370 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAnwWhl+IiYEBAAcI3AU5xrv0cYy9lckyu0dQ==", 2023-11-30T17:07:59.370 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:07:59.370 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:07:59.370 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:07:59.370 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:07:59.370 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:07:59.370 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:07:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:07:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2023-11-30T17:07:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhleYZcNRAA5PoPChH+s6XfbrQ0hmu2NA==", 2023-11-30T17:07:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:07:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:07:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T17:07:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T17:07:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T17:07:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:07:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:07:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:07:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2023-11-30T17:07:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAOwWhlFhcfAhAAzaBDtyRxuqeQ9BatfgUuXw==", 2023-11-30T17:07:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:07:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:07:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T17:07:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T17:07:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T17:07:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:07:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:07:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:07:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2023-11-30T17:07:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlLZrDOhAAHG/dYWYmPouk3+Iqafr7qw==", 2023-11-30T17:07:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:07:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:07:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T17:07:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T17:07:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T17:07:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:07:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:07:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:07:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2023-11-30T17:07:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAOwWhl6lxuBxAA/YXQDo+U2ppULGzK054Gzg==", 2023-11-30T17:07:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:07:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:07:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T17:07:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T17:07:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T17:07:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:07:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:07:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:07:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2023-11-30T17:07:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhl4JkLAxAAiaLgZ5eiazaT9VanG5ihyQ==", 2023-11-30T17:07:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:07:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T17:07:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:07:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:07:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:07:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:07:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:07:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:07:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-mds", 2023-11-30T17:07:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAxwWhlYDxLOxAA8Zc1zslt8h3gwFXqhMQOcA==", 2023-11-30T17:07:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:07:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-mds" 2023-11-30T17:07:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:07:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:07:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:07:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-mgr", 2023-11-30T17:07:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAxwWhldkdLOxAAI7wr/F4223lc3sC06RyjGQ==", 2023-11-30T17:07:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:07:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-30T17:07:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:07:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:07:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:07:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-osd", 2023-11-30T17:07:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAxwWhlZVJLOxAAvWQwBnL9HLeklpQmpneiRg==", 2023-11-30T17:07:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:07:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-osd" 2023-11-30T17:07:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:07:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:07:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:07:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-rbd", 2023-11-30T17:07:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAxwWhljFxLOxAA8yoZkkPb+PBnl9u9jwVNRw==", 2023-11-30T17:07:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:07:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-30T17:07:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:07:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:07:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:07:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-30T17:07:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAxwWhlYWVLOxAABzzQSMo2ZiZXP0klrB1u/w==", 2023-11-30T17:07:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:07:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-30T17:07:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:07:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:07:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:07:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-rgw", 2023-11-30T17:07:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAxwWhlZ25LOxAAz3XCCwwN/s36F0g2zz0G4A==", 2023-11-30T17:07:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:07:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-30T17:07:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:07:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:07:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:07:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2023-11-30T17:07:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlH1s2HBAA3ea9Utfv7fZoo2hO+ElDVQ==", 2023-11-30T17:07:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:07:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T17:07:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-11-30T17:07:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:07:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:07:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:07:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:07:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2023-11-30T17:07:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlpy+fFxAA3qmboR+PlQtK6T35ryj+Lw==", 2023-11-30T17:07:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:07:59.378 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T17:07:59.378 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-11-30T17:07:59.378 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:07:59.378 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:07:59.378 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:07:59.378 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-11-30T17:07:59.378 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T17:07:59.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.361+0000 7f13d65d9700 1 -- 172.21.15.49:0/1142511350 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f13b005f150 msgr2=0x7f13b0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:59.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.361+0000 7f13d65d9700 1 --2- 172.21.15.49:0/1142511350 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f13b005f150 0x7f13b0061610 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f13d00ad8f0 tx=0x7f13b8009040).stop 2023-11-30T17:07:59.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.361+0000 7f13d65d9700 1 -- 172.21.15.49:0/1142511350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13d00cae90 msgr2=0x7f13d0158b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:59.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.361+0000 7f13d65d9700 1 --2- 172.21.15.49:0/1142511350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13d00cae90 0x7f13d0158b20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f13d0083c30 tx=0x7f13c8009780).stop 2023-11-30T17:07:59.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.361+0000 7f13d65d9700 1 -- 172.21.15.49:0/1142511350 shutdown_connections 2023-11-30T17:07:59.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.361+0000 7f13d65d9700 1 --2- 172.21.15.49:0/1142511350 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f13b005f150 0x7f13b0061610 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:59.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.361+0000 7f13d65d9700 1 --2- 172.21.15.49:0/1142511350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13d00cae90 0x7f13d0158b20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:59.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.361+0000 7f13d65d9700 1 --2- 172.21.15.49:0/1142511350 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13d00ca180 0x7f13d00c2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:59.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.361+0000 7f13d65d9700 1 --2- 172.21.15.49:0/1142511350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13d00caab0 0x7f13d0158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:59.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.361+0000 7f13d65d9700 1 -- 172.21.15.49:0/1142511350 >> 172.21.15.49:0/1142511350 conn(0x7f13d0094920 msgr2=0x7f13d0064fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:59.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.361+0000 7f13d65d9700 1 -- 172.21.15.49:0/1142511350 shutdown_connections 2023-11-30T17:07:59.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.361+0000 7f13d65d9700 1 -- 172.21.15.49:0/1142511350 wait complete. 2023-11-30T17:07:59.381 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-30T17:07:59.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.496+0000 7f2004d77700 1 Processor -- start 2023-11-30T17:07:59.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.496+0000 7f2004d77700 1 -- start start 2023-11-30T17:07:59.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.497+0000 7f2004d77700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f20000a8280 0x7f20000a8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:59.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.497+0000 7f2004d77700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2000158160 0x7f2000155500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:59.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.497+0000 7f2004d77700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2000067770 con 0x7f200014e600 2023-11-30T17:07:59.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.497+0000 7f2004d77700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2000159180 con 0x7f20000a8280 2023-11-30T17:07:59.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.497+0000 7f2004d77700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20000be8d0 con 0x7f2000158160 2023-11-30T17:07:59.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.498+0000 7f1ffdd9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2000158160 0x7f2000155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:59.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.498+0000 7f1ffe59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f20000a8280 0x7f20000a8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:59.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.498+0000 7f1ffdd9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2000158160 0x7f2000155500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:45924/0 (socket says 172.21.15.49:45924) 2023-11-30T17:07:59.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.498+0000 7f1ffe59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f20000a8280 0x7f20000a8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:46336/0 (socket says 172.21.15.49:46336) 2023-11-30T17:07:59.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.498+0000 7f1ffdd9b700 1 -- 172.21.15.49:0/3830141627 learned_addr learned my addr 172.21.15.49:0/3830141627 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:59.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.498+0000 7f1ffed9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f200014e600 0x7f200014ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:46638/0 (socket says 172.21.15.49:46638) 2023-11-30T17:07:59.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.498+0000 7f1ffdd9b700 1 -- 172.21.15.49:0/3830141627 >> v2:172.21.15.115:3300/0 conn(0x7f20000a8280 msgr2=0x7f20000a8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:59.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.498+0000 7f1ffdd9b700 1 --2- 172.21.15.49:0/3830141627 >> v2:172.21.15.115:3300/0 conn(0x7f20000a8280 0x7f20000a8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:59.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.498+0000 7f1ffdd9b700 1 -- 172.21.15.49:0/3830141627 >> v1:172.21.15.115:6789/0 conn(0x7f200014e600 legacy=0x7f200014ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:59.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.498+0000 7f1ffdd9b700 1 -- 172.21.15.49:0/3830141627 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2000158600 con 0x7f2000158160 2023-11-30T17:07:59.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.498+0000 7f1ffe59c700 1 --2- 172.21.15.49:0/3830141627 >> v2:172.21.15.115:3300/0 conn(0x7f20000a8280 0x7f20000a8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:07:59.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.498+0000 7f1ffdd9b700 1 --2- 172.21.15.49:0/3830141627 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2000158160 0x7f2000155500 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f1fe8006fd0 tx=0x7f1fe80090f0).ready entity=mon.2 client_cookie=58c585e23c9cfca1 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:59.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.498+0000 7f1ffd59a700 1 -- 172.21.15.49:0/3830141627 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe800b580 con 0x7f2000158160 2023-11-30T17:07:59.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.499+0000 7f1ffd59a700 1 -- 172.21.15.49:0/3830141627 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe800b6e0 con 0x7f2000158160 2023-11-30T17:07:59.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.499+0000 7f1ffd59a700 1 -- 172.21.15.49:0/3830141627 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe800ba60 con 0x7f2000158160 2023-11-30T17:07:59.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.499+0000 7f2004d77700 1 -- 172.21.15.49:0/3830141627 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2000158160 msgr2=0x7f2000155500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:59.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.499+0000 7f2004d77700 1 --2- 172.21.15.49:0/3830141627 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2000158160 0x7f2000155500 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f1fe8006fd0 tx=0x7f1fe80090f0).stop 2023-11-30T17:07:59.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.499+0000 7f2004d77700 1 -- 172.21.15.49:0/3830141627 shutdown_connections 2023-11-30T17:07:59.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.499+0000 7f2004d77700 1 --2- 172.21.15.49:0/3830141627 >> v2:172.21.15.115:3300/0 conn(0x7f20000a8280 0x7f20000a8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:59.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.499+0000 7f2004d77700 1 --2- 172.21.15.49:0/3830141627 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2000158160 0x7f2000155500 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:59.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.499+0000 7f2004d77700 1 -- 172.21.15.49:0/3830141627 >> 172.21.15.49:0/3830141627 conn(0x7f2000062700 msgr2=0x7f2000062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:59.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.499+0000 7f2004d77700 1 -- 172.21.15.49:0/3830141627 shutdown_connections 2023-11-30T17:07:59.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.499+0000 7f2004d77700 1 -- 172.21.15.49:0/3830141627 wait complete. 2023-11-30T17:07:59.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.500+0000 7f2004d77700 1 Processor -- start 2023-11-30T17:07:59.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.500+0000 7f2004d77700 1 -- start start 2023-11-30T17:07:59.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.501+0000 7f2004d77700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20000a8280 0x7f2000141cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:59.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.501+0000 7f2004d77700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f200014e600 0x7f20000becb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:59.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.501+0000 7f2004d77700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2000158160 0x7f20000bf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:59.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.501+0000 7f2004d77700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20001421b0 con 0x7f2000158160 2023-11-30T17:07:59.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.501+0000 7f2004d77700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20000bf690 con 0x7f20000a8280 2023-11-30T17:07:59.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.501+0000 7f2004d77700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2000065430 con 0x7f200014e600 2023-11-30T17:07:59.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.501+0000 7f1ffed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2000158160 0x7f20000bf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:59.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.501+0000 7f1ffed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2000158160 0x7f20000bf1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48046/0 (socket says 172.21.15.49:48046) 2023-11-30T17:07:59.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.501+0000 7f1ffed9d700 1 -- 172.21.15.49:0/1836372993 learned_addr learned my addr 172.21.15.49:0/1836372993 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:59.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.501+0000 7f1ffdd9b700 1 --2- 172.21.15.49:0/1836372993 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f200014e600 0x7f20000becb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:59.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.501+0000 7f1ffe59c700 1 --2- 172.21.15.49:0/1836372993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20000a8280 0x7f2000141cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:59.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.501+0000 7f1ffed9d700 1 -- 172.21.15.49:0/1836372993 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f200014e600 msgr2=0x7f20000becb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:59.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.501+0000 7f1ffed9d700 1 --2- 172.21.15.49:0/1836372993 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f200014e600 0x7f20000becb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:59.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.502+0000 7f1ffed9d700 1 -- 172.21.15.49:0/1836372993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20000a8280 msgr2=0x7f2000141cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:59.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.502+0000 7f1ffed9d700 1 --2- 172.21.15.49:0/1836372993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20000a8280 0x7f2000141cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:59.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.502+0000 7f1ffed9d700 1 -- 172.21.15.49:0/1836372993 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff80092a0 con 0x7f2000158160 2023-11-30T17:07:59.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.502+0000 7f1ffed9d700 1 --2- 172.21.15.49:0/1836372993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2000158160 0x7f20000bf1a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f1ff000c7c0 tx=0x7f1ff00015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:59.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.502+0000 7f1ff67fc700 1 -- 172.21.15.49:0/1836372993 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0005c70 con 0x7f2000158160 2023-11-30T17:07:59.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.502+0000 7f1ff67fc700 1 -- 172.21.15.49:0/1836372993 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff0005dd0 con 0x7f2000158160 2023-11-30T17:07:59.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.502+0000 7f1ff67fc700 1 -- 172.21.15.49:0/1836372993 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff00072e0 con 0x7f2000158160 2023-11-30T17:07:59.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.502+0000 7f2004d77700 1 -- 172.21.15.49:0/1836372993 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe8009370 con 0x7f2000158160 2023-11-30T17:07:59.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.502+0000 7f2004d77700 1 -- 172.21.15.49:0/1836372993 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2000064b00 con 0x7f2000158160 2023-11-30T17:07:59.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.503+0000 7f2004d77700 1 -- 172.21.15.49:0/1836372993 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f200006c860 con 0x7f2000158160 2023-11-30T17:07:59.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.503+0000 7f1ff67fc700 1 -- 172.21.15.49:0/1836372993 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1ff0007690 con 0x7f2000158160 2023-11-30T17:07:59.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.504+0000 7f1ff67fc700 1 --2- 172.21.15.49:0/1836372993 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1fe005f150 0x7f1fe0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:59.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.504+0000 7f1ff67fc700 1 -- 172.21.15.49:0/1836372993 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f1ff00797f0 con 0x7f2000158160 2023-11-30T17:07:59.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.504+0000 7f1ffe59c700 1 --2- 172.21.15.49:0/1836372993 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1fe005f150 0x7f1fe0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:59.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.504+0000 7f1ffe59c700 1 --2- 172.21.15.49:0/1836372993 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1fe005f150 0x7f1fe0061610 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f1ff8009dc0 tx=0x7f1ff8009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:59.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.508+0000 7f1ff67fc700 1 -- 172.21.15.49:0/1836372993 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1ff004ae10 con 0x7f2000158160 2023-11-30T17:07:59.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.747+0000 7f2004d77700 1 -- 172.21.15.49:0/1836372993 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f2000065570 con 0x7f2000158160 2023-11-30T17:07:59.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.750+0000 7f1ff67fc700 1 -- 172.21.15.49:0/1836372993 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1ff004e430 con 0x7f2000158160 2023-11-30T17:07:59.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.752+0000 7f2004d77700 1 -- 172.21.15.49:0/1836372993 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1fe005f150 msgr2=0x7f1fe0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:59.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.752+0000 7f2004d77700 1 --2- 172.21.15.49:0/1836372993 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1fe005f150 0x7f1fe0061610 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f1ff8009dc0 tx=0x7f1ff8009060).stop 2023-11-30T17:07:59.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.752+0000 7f2004d77700 1 -- 172.21.15.49:0/1836372993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2000158160 msgr2=0x7f20000bf1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:59.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.752+0000 7f2004d77700 1 --2- 172.21.15.49:0/1836372993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2000158160 0x7f20000bf1a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f1ff000c7c0 tx=0x7f1ff00015e0).stop 2023-11-30T17:07:59.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.752+0000 7f2004d77700 1 -- 172.21.15.49:0/1836372993 shutdown_connections 2023-11-30T17:07:59.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.752+0000 7f2004d77700 1 --2- 172.21.15.49:0/1836372993 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1fe005f150 0x7f1fe0061610 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:59.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.752+0000 7f2004d77700 1 --2- 172.21.15.49:0/1836372993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2000158160 0x7f20000bf1a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:59.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.752+0000 7f2004d77700 1 --2- 172.21.15.49:0/1836372993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20000a8280 0x7f2000141cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:59.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.752+0000 7f2004d77700 1 --2- 172.21.15.49:0/1836372993 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f200014e600 0x7f20000becb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:59.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.752+0000 7f2004d77700 1 -- 172.21.15.49:0/1836372993 >> 172.21.15.49:0/1836372993 conn(0x7f2000062700 msgr2=0x7f200014ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:59.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.752+0000 7f2004d77700 1 -- 172.21.15.49:0/1836372993 shutdown_connections 2023-11-30T17:07:59.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.752+0000 7f2004d77700 1 -- 172.21.15.49:0/1836372993 wait complete. 2023-11-30T17:07:59.756 INFO:teuthology.orchestra.run.smithi049.stderr:updated 2023-11-30T17:07:59.767 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-30T17:07:59.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.883+0000 7fda8a776700 1 Processor -- start 2023-11-30T17:07:59.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.883+0000 7fda8a776700 1 -- start start 2023-11-30T17:07:59.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.884+0000 7fda8a776700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda840c6190 0x7fda840c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:59.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.884+0000 7fda8a776700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda840c72d0 con 0x7fda84098d10 2023-11-30T17:07:59.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.884+0000 7fda8a776700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda84064570 con 0x7fda84158320 2023-11-30T17:07:59.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.884+0000 7fda8a776700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda84154bc0 con 0x7fda840c6190 2023-11-30T17:07:59.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.884+0000 7fda83fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fda84098d10 0x7fda84063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49930/0 (socket says 172.21.15.49:49930) 2023-11-30T17:07:59.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.884+0000 7fda83fff700 1 -- 172.21.15.49:0/3805022553 learned_addr learned my addr 172.21.15.49:0/3805022553 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:07:59.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.884+0000 7fda82ffd700 1 -- 172.21.15.49:0/3805022553 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3509019698 0 0) 0x7fda840c72d0 con 0x7fda84098d10 2023-11-30T17:07:59.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.884+0000 7fda82ffd700 1 -- 172.21.15.49:0/3805022553 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda6c0033f0 con 0x7fda84098d10 2023-11-30T17:07:59.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.885+0000 7fda837fe700 1 --2- 172.21.15.49:0/3805022553 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda840c6190 0x7fda840c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:59.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.885+0000 7fda82ffd700 1 -- 172.21.15.49:0/3805022553 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 107134418 0 0) 0x7fda6c0033f0 con 0x7fda84098d10 2023-11-30T17:07:59.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.885+0000 7fda82ffd700 1 -- 172.21.15.49:0/3805022553 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda840c6190 msgr2=0x7fda840c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:59.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.885+0000 7fda82ffd700 1 --2- 172.21.15.49:0/3805022553 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda840c6190 0x7fda840c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:59.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.885+0000 7fda82ffd700 1 -- 172.21.15.49:0/3805022553 >> v1:172.21.15.115:6789/0 conn(0x7fda84158320 legacy=0x7fda840a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:59.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.885+0000 7fda82ffd700 1 -- 172.21.15.49:0/3805022553 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda840c66c0 con 0x7fda84098d10 2023-11-30T17:07:59.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.885+0000 7fda82ffd700 1 -- 172.21.15.49:0/3805022553 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fda74001470 con 0x7fda84098d10 2023-11-30T17:07:59.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.885+0000 7fda82ffd700 1 -- 172.21.15.49:0/3805022553 >> v1:172.21.15.49:6789/0 conn(0x7fda84098d10 legacy=0x7fda84063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:59.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.885+0000 7fda82ffd700 1 --2- 172.21.15.49:0/3805022553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda6c003910 0x7fda6c003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:59.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.885+0000 7fda82ffd700 1 --2- 172.21.15.49:0/3805022553 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda840c6190 0x7fda6c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:59.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.885+0000 7fda82ffd700 1 --2- 172.21.15.49:0/3805022553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda6c004b80 0x7fda6c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:59.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.885+0000 7fda82ffd700 1 -- 172.21.15.49:0/3805022553 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda84154bc0 con 0x7fda6c003910 2023-11-30T17:07:59.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.885+0000 7fda82ffd700 1 -- 172.21.15.49:0/3805022553 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c00b910 con 0x7fda6c004b80 2023-11-30T17:07:59.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.885+0000 7fda82ffd700 1 -- 172.21.15.49:0/3805022553 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c00bad0 con 0x7fda840c6190 2023-11-30T17:07:59.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.885+0000 7fda83fff700 1 --2- 172.21.15.49:0/3805022553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda6c003910 0x7fda6c003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:59.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.885+0000 7fda837fe700 1 --2- 172.21.15.49:0/3805022553 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda840c6190 0x7fda6c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:59.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.885+0000 7fda88d13700 1 --2- 172.21.15.49:0/3805022553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda6c004b80 0x7fda6c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:59.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.885+0000 7fda83fff700 1 -- 172.21.15.49:0/3805022553 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda840c6190 msgr2=0x7fda6c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:59.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.885+0000 7fda83fff700 1 --2- 172.21.15.49:0/3805022553 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda840c6190 0x7fda6c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:59.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.885+0000 7fda83fff700 1 -- 172.21.15.49:0/3805022553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda6c004b80 msgr2=0x7fda6c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:07:59.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.885+0000 7fda83fff700 1 --2- 172.21.15.49:0/3805022553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda6c004b80 0x7fda6c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:59.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.885+0000 7fda83fff700 1 -- 172.21.15.49:0/3805022553 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda6c0033f0 con 0x7fda6c003910 2023-11-30T17:07:59.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.885+0000 7fda83fff700 1 --2- 172.21.15.49:0/3805022553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda6c003910 0x7fda6c003d30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fda7400c190 tx=0x7fda74001e50).ready entity=mon.0 client_cookie=a1c0ad0bda419aee server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:59.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.886+0000 7fda82ffd700 1 -- 172.21.15.49:0/3805022553 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda74007a20 con 0x7fda6c003910 2023-11-30T17:07:59.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.886+0000 7fda82ffd700 1 -- 172.21.15.49:0/3805022553 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7400cac0 con 0x7fda6c003910 2023-11-30T17:07:59.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.886+0000 7fda82ffd700 1 -- 172.21.15.49:0/3805022553 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7400ce40 con 0x7fda6c003910 2023-11-30T17:07:59.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.886+0000 7fda8a776700 1 -- 172.21.15.49:0/3805022553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda6c003910 msgr2=0x7fda6c003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:59.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.886+0000 7fda8a776700 1 --2- 172.21.15.49:0/3805022553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda6c003910 0x7fda6c003d30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fda7400c190 tx=0x7fda74001e50).stop 2023-11-30T17:07:59.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.886+0000 7fda88d13700 1 -- 172.21.15.49:0/3805022553 reap_dead start 2023-11-30T17:07:59.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.886+0000 7fda8a776700 1 -- 172.21.15.49:0/3805022553 shutdown_connections 2023-11-30T17:07:59.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.886+0000 7fda8a776700 1 -- 172.21.15.49:0/3805022553 >> 172.21.15.49:0/3805022553 conn(0x7fda840cb310 msgr2=0x7fda840cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:07:59.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.886+0000 7fda8a776700 1 -- 172.21.15.49:0/3805022553 shutdown_connections 2023-11-30T17:07:59.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.886+0000 7fda8a776700 1 -- 172.21.15.49:0/3805022553 wait complete. 2023-11-30T17:07:59.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.887+0000 7fda8a776700 1 Processor -- start 2023-11-30T17:07:59.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.887+0000 7fda8a776700 1 -- start start 2023-11-30T17:07:59.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.888+0000 7fda8a776700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda6c003910 0x7fda84167560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:59.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.888+0000 7fda8a776700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda840afb60 0x7fda840c4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:59.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.888+0000 7fda8a776700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda840affe0 0x7fda840c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:59.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.888+0000 7fda8a776700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda840c4ee0 con 0x7fda6c003910 2023-11-30T17:07:59.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.888+0000 7fda8a776700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda840b1150 con 0x7fda840afb60 2023-11-30T17:07:59.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.888+0000 7fda8a776700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda840b0540 con 0x7fda840affe0 2023-11-30T17:07:59.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.888+0000 7fda83fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda6c003910 0x7fda84167560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:59.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.888+0000 7fda83fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda6c003910 0x7fda84167560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48064/0 (socket says 172.21.15.49:48064) 2023-11-30T17:07:59.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.888+0000 7fda83fff700 1 -- 172.21.15.49:0/2694034414 learned_addr learned my addr 172.21.15.49:0/2694034414 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:07:59.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.888+0000 7fda837fe700 1 --2- 172.21.15.49:0/2694034414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda840afb60 0x7fda840c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:59.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.888+0000 7fda88d13700 1 --2- 172.21.15.49:0/2694034414 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda840affe0 0x7fda840c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:59.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.889+0000 7fda83fff700 1 -- 172.21.15.49:0/2694034414 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda840affe0 msgr2=0x7fda840c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:59.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.889+0000 7fda83fff700 1 --2- 172.21.15.49:0/2694034414 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda840affe0 0x7fda840c49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:59.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.889+0000 7fda83fff700 1 -- 172.21.15.49:0/2694034414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda840afb60 msgr2=0x7fda840c4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:07:59.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.889+0000 7fda83fff700 1 --2- 172.21.15.49:0/2694034414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda840afb60 0x7fda840c4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:07:59.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.889+0000 7fda83fff700 1 -- 172.21.15.49:0/2694034414 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda840b0820 con 0x7fda6c003910 2023-11-30T17:07:59.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.889+0000 7fda837fe700 1 --2- 172.21.15.49:0/2694034414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda840afb60 0x7fda840c4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:07:59.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.889+0000 7fda83fff700 1 --2- 172.21.15.49:0/2694034414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda6c003910 0x7fda84167560 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7fda74001e90 tx=0x7fda74015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:59.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.889+0000 7fda6bfff700 1 -- 172.21.15.49:0/2694034414 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda740076c0 con 0x7fda6c003910 2023-11-30T17:07:59.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.889+0000 7fda6bfff700 1 -- 172.21.15.49:0/2694034414 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda740046b0 con 0x7fda6c003910 2023-11-30T17:07:59.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.889+0000 7fda8a776700 1 -- 172.21.15.49:0/2694034414 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda840b0b00 con 0x7fda6c003910 2023-11-30T17:07:59.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.889+0000 7fda6bfff700 1 -- 172.21.15.49:0/2694034414 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda74004a50 con 0x7fda6c003910 2023-11-30T17:07:59.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.889+0000 7fda8a776700 1 -- 172.21.15.49:0/2694034414 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda840c7e90 con 0x7fda6c003910 2023-11-30T17:07:59.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.890+0000 7fda8a776700 1 -- 172.21.15.49:0/2694034414 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda8406c860 con 0x7fda6c003910 2023-11-30T17:07:59.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.890+0000 7fda6bfff700 1 -- 172.21.15.49:0/2694034414 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fda74020480 con 0x7fda6c003910 2023-11-30T17:07:59.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.891+0000 7fda6bfff700 1 --2- 172.21.15.49:0/2694034414 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fda7005f120 0x7fda700615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:07:59.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.891+0000 7fda6bfff700 1 -- 172.21.15.49:0/2694034414 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fda7407ad70 con 0x7fda6c003910 2023-11-30T17:07:59.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.891+0000 7fda837fe700 1 --2- 172.21.15.49:0/2694034414 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fda7005f120 0x7fda700615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:07:59.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.891+0000 7fda837fe700 1 --2- 172.21.15.49:0/2694034414 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fda7005f120 0x7fda700615e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fda78009270 tx=0x7fda78008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:07:59.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:07:59.895+0000 7fda6bfff700 1 -- 172.21.15.49:0/2694034414 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fda7404c330 con 0x7fda6c003910 2023-11-30T17:08:00.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.136+0000 7fda8a776700 1 -- 172.21.15.49:0/2694034414 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fda840c69a0 con 0x7fda6c003910 2023-11-30T17:08:00.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.139+0000 7fda6bfff700 1 -- 172.21.15.49:0/2694034414 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7fda7404f950 con 0x7fda6c003910 2023-11-30T17:08:00.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.141+0000 7fda8a776700 1 -- 172.21.15.49:0/2694034414 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fda7005f120 msgr2=0x7fda700615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:00.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.141+0000 7fda8a776700 1 --2- 172.21.15.49:0/2694034414 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fda7005f120 0x7fda700615e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fda78009270 tx=0x7fda78008040).stop 2023-11-30T17:08:00.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.141+0000 7fda8a776700 1 -- 172.21.15.49:0/2694034414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda6c003910 msgr2=0x7fda84167560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:00.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.141+0000 7fda8a776700 1 --2- 172.21.15.49:0/2694034414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda6c003910 0x7fda84167560 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7fda74001e90 tx=0x7fda74015000).stop 2023-11-30T17:08:00.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.141+0000 7fda8a776700 1 -- 172.21.15.49:0/2694034414 shutdown_connections 2023-11-30T17:08:00.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.141+0000 7fda8a776700 1 --2- 172.21.15.49:0/2694034414 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda840affe0 0x7fda840c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:00.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.141+0000 7fda8a776700 1 --2- 172.21.15.49:0/2694034414 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fda7005f120 0x7fda700615e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:00.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.141+0000 7fda8a776700 1 --2- 172.21.15.49:0/2694034414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda6c003910 0x7fda84167560 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:00.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.141+0000 7fda8a776700 1 --2- 172.21.15.49:0/2694034414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda840afb60 0x7fda840c4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:00.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.141+0000 7fda8a776700 1 -- 172.21.15.49:0/2694034414 >> 172.21.15.49:0/2694034414 conn(0x7fda840cb310 msgr2=0x7fda84155160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:00.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.141+0000 7fda8a776700 1 -- 172.21.15.49:0/2694034414 shutdown_connections 2023-11-30T17:08:00.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.141+0000 7fda8a776700 1 -- 172.21.15.49:0/2694034414 wait complete. 2023-11-30T17:08:00.144 INFO:teuthology.orchestra.run.smithi049.stderr:updated 2023-11-30T17:08:00.155 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-30T17:08:00.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.271+0000 7ff5d2365700 1 Processor -- start 2023-11-30T17:08:00.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.271+0000 7ff5d2365700 1 -- start start 2023-11-30T17:08:00.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.272+0000 7ff5d2365700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff5cc14e530 0x7ff5cc0c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:00.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.272+0000 7ff5d2365700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff5cc158570 0x7ff5cc158a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:00.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.272+0000 7ff5d2365700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5cc0c7bc0 con 0x7ff5cc154950 2023-11-30T17:08:00.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.272+0000 7ff5d2365700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5cc155920 con 0x7ff5cc158570 2023-11-30T17:08:00.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.272+0000 7ff5d2365700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5cc154e00 con 0x7ff5cc14e530 2023-11-30T17:08:00.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.272+0000 7ff5d1b64700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff5cc158570 0x7ff5cc158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:00.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.272+0000 7ff5d1b64700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff5cc158570 0x7ff5cc158a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48078/0 (socket says 172.21.15.49:48078) 2023-11-30T17:08:00.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.272+0000 7ff5d1b64700 1 -- 172.21.15.49:0/2610856206 learned_addr learned my addr 172.21.15.49:0/2610856206 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:00.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.272+0000 7ff5d1363700 1 --2- 172.21.15.49:0/2610856206 >> v2:172.21.15.115:3300/0 conn(0x7ff5cc14e530 0x7ff5cc0c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:00.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.272+0000 7ff5d1b64700 1 -- 172.21.15.49:0/2610856206 >> v2:172.21.15.115:3300/0 conn(0x7ff5cc14e530 msgr2=0x7ff5cc0c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:00.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.272+0000 7ff5d1b64700 1 --2- 172.21.15.49:0/2610856206 >> v2:172.21.15.115:3300/0 conn(0x7ff5cc14e530 0x7ff5cc0c66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:00.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.272+0000 7ff5d1b64700 1 -- 172.21.15.49:0/2610856206 >> v1:172.21.15.115:6789/0 conn(0x7ff5cc154950 legacy=0x7ff5cc14e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:00.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.273+0000 7ff5d1b64700 1 -- 172.21.15.49:0/2610856206 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5cc155080 con 0x7ff5cc158570 2023-11-30T17:08:00.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.273+0000 7ff5d1b64700 1 --2- 172.21.15.49:0/2610856206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5cc158570 0x7ff5cc158a00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7ff5cc064450 tx=0x7ff5bc009840).ready entity=mon.0 client_cookie=29851bdf9dbe1afe server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:00.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.273+0000 7ff5cbfff700 1 -- 172.21.15.49:0/2610856206 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc00e070 con 0x7ff5cc158570 2023-11-30T17:08:00.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.273+0000 7ff5cbfff700 1 -- 172.21.15.49:0/2610856206 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5bc00ba20 con 0x7ff5cc158570 2023-11-30T17:08:00.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.273+0000 7ff5cbfff700 1 -- 172.21.15.49:0/2610856206 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc00bda0 con 0x7ff5cc158570 2023-11-30T17:08:00.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.273+0000 7ff5d2365700 1 -- 172.21.15.49:0/2610856206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5cc158570 msgr2=0x7ff5cc158a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:00.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.273+0000 7ff5d2365700 1 --2- 172.21.15.49:0/2610856206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5cc158570 0x7ff5cc158a00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7ff5cc064450 tx=0x7ff5bc009840).stop 2023-11-30T17:08:00.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.273+0000 7ff5d2365700 1 -- 172.21.15.49:0/2610856206 shutdown_connections 2023-11-30T17:08:00.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.273+0000 7ff5d2365700 1 --2- 172.21.15.49:0/2610856206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5cc158570 0x7ff5cc158a00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:00.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.273+0000 7ff5d2365700 1 --2- 172.21.15.49:0/2610856206 >> v2:172.21.15.115:3300/0 conn(0x7ff5cc14e530 0x7ff5cc0c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:00.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.273+0000 7ff5d2365700 1 -- 172.21.15.49:0/2610856206 >> 172.21.15.49:0/2610856206 conn(0x7ff5cc064990 msgr2=0x7ff5cc064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:00.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.273+0000 7ff5d2365700 1 -- 172.21.15.49:0/2610856206 shutdown_connections 2023-11-30T17:08:00.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.273+0000 7ff5d2365700 1 -- 172.21.15.49:0/2610856206 wait complete. 2023-11-30T17:08:00.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.274+0000 7ff5d2365700 1 Processor -- start 2023-11-30T17:08:00.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.275+0000 7ff5d2365700 1 -- start start 2023-11-30T17:08:00.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.275+0000 7ff5d2365700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5cc14e530 0x7ff5cc14de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:00.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.275+0000 7ff5d2365700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5cc154950 0x7ff5cc0af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:00.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.275+0000 7ff5d2365700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5cc158570 0x7ff5cc0bffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:00.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.275+0000 7ff5d2365700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc0c2330 con 0x7ff5cc14e530 2023-11-30T17:08:00.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.275+0000 7ff5d2365700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc14e330 con 0x7ff5cc154950 2023-11-30T17:08:00.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.275+0000 7ff5d2365700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc0af970 con 0x7ff5cc158570 2023-11-30T17:08:00.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.276+0000 7ff5d1363700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5cc14e530 0x7ff5cc14de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:00.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.276+0000 7ff5d1363700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5cc14e530 0x7ff5cc14de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48094/0 (socket says 172.21.15.49:48094) 2023-11-30T17:08:00.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.276+0000 7ff5d1363700 1 -- 172.21.15.49:0/394017770 learned_addr learned my addr 172.21.15.49:0/394017770 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:00.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.276+0000 7ff5d1b64700 1 --2- 172.21.15.49:0/394017770 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5cc158570 0x7ff5cc0bffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:00.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.276+0000 7ff5d0b62700 1 --2- 172.21.15.49:0/394017770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5cc154950 0x7ff5cc0af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:00.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.276+0000 7ff5d1363700 1 -- 172.21.15.49:0/394017770 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5cc158570 msgr2=0x7ff5cc0bffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:00.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.276+0000 7ff5d1363700 1 --2- 172.21.15.49:0/394017770 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5cc158570 0x7ff5cc0bffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:00.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.276+0000 7ff5d1363700 1 -- 172.21.15.49:0/394017770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5cc154950 msgr2=0x7ff5cc0af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:00.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.276+0000 7ff5d1363700 1 --2- 172.21.15.49:0/394017770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5cc154950 0x7ff5cc0af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:00.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.276+0000 7ff5d1363700 1 -- 172.21.15.49:0/394017770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5bc009ae0 con 0x7ff5cc14e530 2023-11-30T17:08:00.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.276+0000 7ff5d1363700 1 --2- 172.21.15.49:0/394017770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5cc14e530 0x7ff5cc14de40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7ff5c400e950 tx=0x7ff5c4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:00.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.276+0000 7ff5c97fa700 1 -- 172.21.15.49:0/394017770 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4009530 con 0x7ff5cc14e530 2023-11-30T17:08:00.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.276+0000 7ff5c97fa700 1 -- 172.21.15.49:0/394017770 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c400c850 con 0x7ff5cc14e530 2023-11-30T17:08:00.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.276+0000 7ff5d2365700 1 -- 172.21.15.49:0/394017770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5cc0afc50 con 0x7ff5cc14e530 2023-11-30T17:08:00.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.276+0000 7ff5c97fa700 1 -- 172.21.15.49:0/394017770 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c400cbd0 con 0x7ff5cc14e530 2023-11-30T17:08:00.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.276+0000 7ff5d2365700 1 -- 172.21.15.49:0/394017770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5cc0af4f0 con 0x7ff5cc14e530 2023-11-30T17:08:00.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.277+0000 7ff5d2365700 1 -- 172.21.15.49:0/394017770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5cc062ee0 con 0x7ff5cc14e530 2023-11-30T17:08:00.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.278+0000 7ff5c97fa700 1 -- 172.21.15.49:0/394017770 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff5c401b400 con 0x7ff5cc14e530 2023-11-30T17:08:00.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.278+0000 7ff5c97fa700 1 --2- 172.21.15.49:0/394017770 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff5b805f150 0x7ff5b8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:00.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.278+0000 7ff5c97fa700 1 -- 172.21.15.49:0/394017770 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7ff5c407a400 con 0x7ff5cc14e530 2023-11-30T17:08:00.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.278+0000 7ff5d0b62700 1 --2- 172.21.15.49:0/394017770 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff5b805f150 0x7ff5b8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:00.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.279+0000 7ff5d0b62700 1 --2- 172.21.15.49:0/394017770 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff5b805f150 0x7ff5b8061610 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7ff5cc0b0680 tx=0x7ff5c0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:00.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.282+0000 7ff5c97fa700 1 -- 172.21.15.49:0/394017770 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff5c404b9c0 con 0x7ff5cc14e530 2023-11-30T17:08:00.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.524+0000 7ff5d2365700 1 -- 172.21.15.49:0/394017770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7ff5cc0c2100 con 0x7ff5cc14e530 2023-11-30T17:08:00.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.528+0000 7ff5c97fa700 1 -- 172.21.15.49:0/394017770 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff5c404efe0 con 0x7ff5cc14e530 2023-11-30T17:08:00.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.530+0000 7ff5d2365700 1 -- 172.21.15.49:0/394017770 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff5b805f150 msgr2=0x7ff5b8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:00.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.530+0000 7ff5d2365700 1 --2- 172.21.15.49:0/394017770 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff5b805f150 0x7ff5b8061610 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7ff5cc0b0680 tx=0x7ff5c0009040).stop 2023-11-30T17:08:00.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.530+0000 7ff5d2365700 1 -- 172.21.15.49:0/394017770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5cc14e530 msgr2=0x7ff5cc14de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:00.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.530+0000 7ff5d2365700 1 --2- 172.21.15.49:0/394017770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5cc14e530 0x7ff5cc14de40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7ff5c400e950 tx=0x7ff5c4009060).stop 2023-11-30T17:08:00.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.530+0000 7ff5d2365700 1 -- 172.21.15.49:0/394017770 shutdown_connections 2023-11-30T17:08:00.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.530+0000 7ff5d2365700 1 --2- 172.21.15.49:0/394017770 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5cc158570 0x7ff5cc0bffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:00.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.530+0000 7ff5d2365700 1 --2- 172.21.15.49:0/394017770 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff5b805f150 0x7ff5b8061610 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:00.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.530+0000 7ff5d2365700 1 --2- 172.21.15.49:0/394017770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5cc14e530 0x7ff5cc14de40 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:00.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.530+0000 7ff5d2365700 1 --2- 172.21.15.49:0/394017770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5cc154950 0x7ff5cc0af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:00.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.530+0000 7ff5d2365700 1 -- 172.21.15.49:0/394017770 >> 172.21.15.49:0/394017770 conn(0x7ff5cc064990 msgr2=0x7ff5cc0cb700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:00.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.530+0000 7ff5d2365700 1 -- 172.21.15.49:0/394017770 shutdown_connections 2023-11-30T17:08:00.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.530+0000 7ff5d2365700 1 -- 172.21.15.49:0/394017770 wait complete. 2023-11-30T17:08:00.533 INFO:teuthology.orchestra.run.smithi049.stderr:updated 2023-11-30T17:08:00.544 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-30T17:08:00.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.661+0000 7f246580a700 1 Processor -- start 2023-11-30T17:08:00.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.661+0000 7f246580a700 1 -- start start 2023-11-30T17:08:00.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.662+0000 7f246580a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2460062e10 0x7f2460135480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:00.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.662+0000 7f246580a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f246006a030 con 0x7f2460152aa0 2023-11-30T17:08:00.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.662+0000 7f246580a700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24600c2d30 con 0x7f24601350a0 2023-11-30T17:08:00.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.662+0000 7f246580a700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24601535e0 con 0x7f2460062e10 2023-11-30T17:08:00.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.662+0000 7f245ffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2460062e10 0x7f2460135480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:00.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.662+0000 7f245ffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2460062e10 0x7f2460135480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39476/0 (socket says 172.21.15.49:39476) 2023-11-30T17:08:00.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.662+0000 7f2465009700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2460152aa0 0x7f2460152ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49316/0 (socket says 172.21.15.49:49316) 2023-11-30T17:08:00.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.662+0000 7f245ffff700 1 -- 172.21.15.49:0/1096521034 learned_addr learned my addr 172.21.15.49:0/1096521034 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:00.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.662+0000 7f245ffff700 1 -- 172.21.15.49:0/1096521034 >> v1:172.21.15.115:6789/0 conn(0x7f24601350a0 legacy=0x7f2460062700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:00.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.662+0000 7f245ffff700 1 -- 172.21.15.49:0/1096521034 >> v1:172.21.15.49:6789/0 conn(0x7f2460152aa0 legacy=0x7f2460152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:00.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.662+0000 7f245f7fe700 1 -- 172.21.15.49:0/1096521034 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1660569854 0 0) 0x7f246006a030 con 0x7f2460152aa0 2023-11-30T17:08:00.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.662+0000 7f245ffff700 1 -- 172.21.15.49:0/1096521034 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2460069700 con 0x7f2460062e10 2023-11-30T17:08:00.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.662+0000 7f245ffff700 1 --2- 172.21.15.49:0/1096521034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2460062e10 0x7f2460135480 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f2454006fd0 tx=0x7f24540090f0).ready entity=mon.0 client_cookie=906b77ecbd710f8b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:00.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.663+0000 7f245f7fe700 1 -- 172.21.15.49:0/1096521034 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245400b600 con 0x7f2460062e10 2023-11-30T17:08:00.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.663+0000 7f245f7fe700 1 -- 172.21.15.49:0/1096521034 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245400b760 con 0x7f2460062e10 2023-11-30T17:08:00.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.663+0000 7f245f7fe700 1 -- 172.21.15.49:0/1096521034 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245400bae0 con 0x7f2460062e10 2023-11-30T17:08:00.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.663+0000 7f246580a700 1 -- 172.21.15.49:0/1096521034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2460062e10 msgr2=0x7f2460135480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:00.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.663+0000 7f246580a700 1 --2- 172.21.15.49:0/1096521034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2460062e10 0x7f2460135480 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f2454006fd0 tx=0x7f24540090f0).stop 2023-11-30T17:08:00.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.663+0000 7f246580a700 1 -- 172.21.15.49:0/1096521034 shutdown_connections 2023-11-30T17:08:00.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.663+0000 7f246580a700 1 --2- 172.21.15.49:0/1096521034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2460062e10 0x7f2460135480 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:00.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.663+0000 7f246580a700 1 -- 172.21.15.49:0/1096521034 >> 172.21.15.49:0/1096521034 conn(0x7f2460064320 msgr2=0x7f24600c7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:00.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.663+0000 7f246580a700 1 -- 172.21.15.49:0/1096521034 shutdown_connections 2023-11-30T17:08:00.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.663+0000 7f246580a700 1 -- 172.21.15.49:0/1096521034 wait complete. 2023-11-30T17:08:00.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.664+0000 7f246580a700 1 Processor -- start 2023-11-30T17:08:00.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.664+0000 7f246580a700 1 -- start start 2023-11-30T17:08:00.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.665+0000 7f246580a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2460062e10 0x7f2460133e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:00.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.665+0000 7f246580a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24601350a0 0x7f24600ac7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:00.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.665+0000 7f246580a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2460152aa0 0x7f24600acce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:00.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.665+0000 7f246580a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24600ad1d0 con 0x7f2460062e10 2023-11-30T17:08:00.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.665+0000 7f246580a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24600a9150 con 0x7f2460152aa0 2023-11-30T17:08:00.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.665+0000 7f246580a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24600a8540 con 0x7f24601350a0 2023-11-30T17:08:00.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.665+0000 7f2464808700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2460062e10 0x7f2460133e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:00.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.665+0000 7f2464808700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2460062e10 0x7f2460133e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39478/0 (socket says 172.21.15.49:39478) 2023-11-30T17:08:00.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.665+0000 7f2464808700 1 -- 172.21.15.49:0/3555307470 learned_addr learned my addr 172.21.15.49:0/3555307470 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:00.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.665+0000 7f245ffff700 1 --2- 172.21.15.49:0/3555307470 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24601350a0 0x7f24600ac7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:00.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.665+0000 7f2465009700 1 --2- 172.21.15.49:0/3555307470 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2460152aa0 0x7f24600acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:00.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.666+0000 7f2464808700 1 -- 172.21.15.49:0/3555307470 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24601350a0 msgr2=0x7f24600ac7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:00.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.666+0000 7f2464808700 1 --2- 172.21.15.49:0/3555307470 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24601350a0 0x7f24600ac7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:00.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.666+0000 7f2464808700 1 -- 172.21.15.49:0/3555307470 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2460152aa0 msgr2=0x7f24600acce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:00.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.666+0000 7f2464808700 1 --2- 172.21.15.49:0/3555307470 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2460152aa0 0x7f24600acce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:00.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.666+0000 7f2464808700 1 -- 172.21.15.49:0/3555307470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2454009370 con 0x7f2460062e10 2023-11-30T17:08:00.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.666+0000 7f2464808700 1 --2- 172.21.15.49:0/3555307470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2460062e10 0x7f2460133e00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f245000c4c0 tx=0x7f2450007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:00.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.666+0000 7f245cff9700 1 -- 172.21.15.49:0/3555307470 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2450007020 con 0x7f2460062e10 2023-11-30T17:08:00.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.666+0000 7f245cff9700 1 -- 172.21.15.49:0/3555307470 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2450001e90 con 0x7f2460062e10 2023-11-30T17:08:00.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.666+0000 7f246580a700 1 -- 172.21.15.49:0/3555307470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24600a8820 con 0x7f2460062e10 2023-11-30T17:08:00.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.666+0000 7f245cff9700 1 -- 172.21.15.49:0/3555307470 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24500073b0 con 0x7f2460062e10 2023-11-30T17:08:00.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.666+0000 7f246580a700 1 -- 172.21.15.49:0/3555307470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24600a8de0 con 0x7f2460062e10 2023-11-30T17:08:00.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.667+0000 7f246580a700 1 -- 172.21.15.49:0/3555307470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24600c4240 con 0x7f2460062e10 2023-11-30T17:08:00.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.667+0000 7f245cff9700 1 -- 172.21.15.49:0/3555307470 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f24500068b0 con 0x7f2460062e10 2023-11-30T17:08:00.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.667+0000 7f245cff9700 1 --2- 172.21.15.49:0/3555307470 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f244c05f150 0x7f244c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:00.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.668+0000 7f245cff9700 1 -- 172.21.15.49:0/3555307470 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f2450079880 con 0x7f2460062e10 2023-11-30T17:08:00.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.668+0000 7f245ffff700 1 --2- 172.21.15.49:0/3555307470 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f244c05f150 0x7f244c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:00.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.668+0000 7f245ffff700 1 --2- 172.21.15.49:0/3555307470 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f244c05f150 0x7f244c061610 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f2454009130 tx=0x7f2454017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:00.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.672+0000 7f245cff9700 1 -- 172.21.15.49:0/3555307470 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f245004aea0 con 0x7f2460062e10 2023-11-30T17:08:00.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.918+0000 7f246580a700 1 -- 172.21.15.49:0/3555307470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f246006c7c0 con 0x7f2460062e10 2023-11-30T17:08:00.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.921+0000 7f245cff9700 1 -- 172.21.15.49:0/3555307470 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v10) v1 ==== 97+0+0 (secure 0 0 0) 0x7f245004e4c0 con 0x7f2460062e10 2023-11-30T17:08:00.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.923+0000 7f246580a700 1 -- 172.21.15.49:0/3555307470 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f244c05f150 msgr2=0x7f244c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:00.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.923+0000 7f246580a700 1 --2- 172.21.15.49:0/3555307470 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f244c05f150 0x7f244c061610 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f2454009130 tx=0x7f2454017000).stop 2023-11-30T17:08:00.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.923+0000 7f246580a700 1 -- 172.21.15.49:0/3555307470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2460062e10 msgr2=0x7f2460133e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:00.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.923+0000 7f246580a700 1 --2- 172.21.15.49:0/3555307470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2460062e10 0x7f2460133e00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f245000c4c0 tx=0x7f2450007e00).stop 2023-11-30T17:08:00.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.923+0000 7f246580a700 1 -- 172.21.15.49:0/3555307470 shutdown_connections 2023-11-30T17:08:00.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.923+0000 7f246580a700 1 --2- 172.21.15.49:0/3555307470 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2460152aa0 0x7f24600acce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:00.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.923+0000 7f246580a700 1 --2- 172.21.15.49:0/3555307470 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f244c05f150 0x7f244c061610 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:00.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.923+0000 7f246580a700 1 --2- 172.21.15.49:0/3555307470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2460062e10 0x7f2460133e00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:00.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.923+0000 7f246580a700 1 --2- 172.21.15.49:0/3555307470 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24601350a0 0x7f24600ac7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:00.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.923+0000 7f246580a700 1 -- 172.21.15.49:0/3555307470 >> 172.21.15.49:0/3555307470 conn(0x7f2460064320 msgr2=0x7f246014c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:00.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.923+0000 7f246580a700 1 -- 172.21.15.49:0/3555307470 shutdown_connections 2023-11-30T17:08:00.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:00.923+0000 7f246580a700 1 -- 172.21.15.49:0/3555307470 wait complete. 2023-11-30T17:08:00.927 INFO:teuthology.orchestra.run.smithi049.stderr:updated 2023-11-30T17:08:00.937 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-30T17:08:01.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.054+0000 7f6bb1cda700 1 Processor -- start 2023-11-30T17:08:01.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.054+0000 7f6bb1cda700 1 -- start start 2023-11-30T17:08:01.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.055+0000 7f6bb1cda700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6bac14e530 0x7f6bac0c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:01.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.055+0000 7f6bb1cda700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6bac154950 0x7f6bac14e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:01.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.055+0000 7f6bb1cda700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bac0c7bc0 con 0x7f6bac158570 2023-11-30T17:08:01.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.055+0000 7f6bb1cda700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bac155920 con 0x7f6bac154950 2023-11-30T17:08:01.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.055+0000 7f6bb1cda700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac154dd0 con 0x7f6bac14e530 2023-11-30T17:08:01.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.055+0000 7f6babfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6bac154950 0x7f6bac14e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:01.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.055+0000 7f6babfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6bac154950 0x7f6bac14e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39480/0 (socket says 172.21.15.49:39480) 2023-11-30T17:08:01.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.055+0000 7f6babfff700 1 -- 172.21.15.49:0/764511464 learned_addr learned my addr 172.21.15.49:0/764511464 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:01.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.055+0000 7f6bb0cd8700 1 --2- 172.21.15.49:0/764511464 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6bac14e530 0x7f6bac0c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:01.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.055+0000 7f6babfff700 1 -- 172.21.15.49:0/764511464 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6bac14e530 msgr2=0x7f6bac0c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:01.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.055+0000 7f6babfff700 1 --2- 172.21.15.49:0/764511464 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6bac14e530 0x7f6bac0c66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:01.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.055+0000 7f6babfff700 1 -- 172.21.15.49:0/764511464 >> v1:172.21.15.115:6789/0 conn(0x7f6bac158570 legacy=0x7f6bac0aa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:01.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.055+0000 7f6babfff700 1 -- 172.21.15.49:0/764511464 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bac155080 con 0x7f6bac154950 2023-11-30T17:08:01.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.056+0000 7f6babfff700 1 --2- 172.21.15.49:0/764511464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bac154950 0x7f6bac14e910 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f6b9c009f20 tx=0x7f6b9c009840).ready entity=mon.0 client_cookie=95030b87a1ca100f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:01.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.056+0000 7f6bab7fe700 1 -- 172.21.15.49:0/764511464 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c00e070 con 0x7f6bac154950 2023-11-30T17:08:01.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.056+0000 7f6bab7fe700 1 -- 172.21.15.49:0/764511464 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9c00ba80 con 0x7f6bac154950 2023-11-30T17:08:01.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.056+0000 7f6bab7fe700 1 -- 172.21.15.49:0/764511464 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c00be00 con 0x7f6bac154950 2023-11-30T17:08:01.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.056+0000 7f6bb1cda700 1 -- 172.21.15.49:0/764511464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bac154950 msgr2=0x7f6bac14e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:01.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.056+0000 7f6bb1cda700 1 --2- 172.21.15.49:0/764511464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bac154950 0x7f6bac14e910 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f6b9c009f20 tx=0x7f6b9c009840).stop 2023-11-30T17:08:01.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.056+0000 7f6bb1cda700 1 -- 172.21.15.49:0/764511464 shutdown_connections 2023-11-30T17:08:01.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.056+0000 7f6bb1cda700 1 --2- 172.21.15.49:0/764511464 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6bac14e530 0x7f6bac0c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:01.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.056+0000 7f6bb1cda700 1 --2- 172.21.15.49:0/764511464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bac154950 0x7f6bac14e910 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:01.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.056+0000 7f6bb1cda700 1 -- 172.21.15.49:0/764511464 >> 172.21.15.49:0/764511464 conn(0x7f6bac064990 msgr2=0x7f6bac064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:01.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.056+0000 7f6bb1cda700 1 -- 172.21.15.49:0/764511464 shutdown_connections 2023-11-30T17:08:01.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.056+0000 7f6bb1cda700 1 -- 172.21.15.49:0/764511464 wait complete. 2023-11-30T17:08:01.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.057+0000 7f6bb1cda700 1 Processor -- start 2023-11-30T17:08:01.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.058+0000 7f6bb1cda700 1 -- start start 2023-11-30T17:08:01.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.058+0000 7f6bb1cda700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bac14e530 0x7f6bac164ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:01.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.058+0000 7f6bb1cda700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6bac154950 0x7f6bac168a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:01.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.058+0000 7f6bb1cda700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bac158570 0x7f6bac0c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:01.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.058+0000 7f6bb1cda700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac165100 con 0x7f6bac14e530 2023-11-30T17:08:01.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.058+0000 7f6bb1cda700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac1653e0 con 0x7f6bac158570 2023-11-30T17:08:01.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.058+0000 7f6bb1cda700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac1656c0 con 0x7f6bac154950 2023-11-30T17:08:01.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.058+0000 7f6bb0cd8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bac14e530 0x7f6bac164ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:01.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.058+0000 7f6bb0cd8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bac14e530 0x7f6bac164ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39492/0 (socket says 172.21.15.49:39492) 2023-11-30T17:08:01.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.058+0000 7f6bb0cd8700 1 -- 172.21.15.49:0/2790633401 learned_addr learned my addr 172.21.15.49:0/2790633401 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:01.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.059+0000 7f6babfff700 1 --2- 172.21.15.49:0/2790633401 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6bac154950 0x7f6bac168a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:01.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.059+0000 7f6bb14d9700 1 --2- 172.21.15.49:0/2790633401 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bac158570 0x7f6bac0c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:01.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.059+0000 7f6bb0cd8700 1 -- 172.21.15.49:0/2790633401 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6bac154950 msgr2=0x7f6bac168a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:01.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.059+0000 7f6bb0cd8700 1 --2- 172.21.15.49:0/2790633401 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6bac154950 0x7f6bac168a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:01.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.059+0000 7f6bb0cd8700 1 -- 172.21.15.49:0/2790633401 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bac158570 msgr2=0x7f6bac0c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:01.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.059+0000 7f6bb0cd8700 1 --2- 172.21.15.49:0/2790633401 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bac158570 0x7f6bac0c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:01.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.059+0000 7f6bb0cd8700 1 -- 172.21.15.49:0/2790633401 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9c009ae0 con 0x7f6bac14e530 2023-11-30T17:08:01.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.059+0000 7f6babfff700 1 --2- 172.21.15.49:0/2790633401 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6bac154950 0x7f6bac168a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:08:01.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.059+0000 7f6bb14d9700 1 --2- 172.21.15.49:0/2790633401 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bac158570 0x7f6bac0c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:08:01.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.059+0000 7f6bb0cd8700 1 --2- 172.21.15.49:0/2790633401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bac14e530 0x7f6bac164ad0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f6ba400d890 tx=0x7f6ba4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:01.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.059+0000 7f6ba8ff9700 1 -- 172.21.15.49:0/2790633401 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba40125f0 con 0x7f6bac14e530 2023-11-30T17:08:01.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.059+0000 7f6ba8ff9700 1 -- 172.21.15.49:0/2790633401 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba4012750 con 0x7f6bac14e530 2023-11-30T17:08:01.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.059+0000 7f6bb1cda700 1 -- 172.21.15.49:0/2790633401 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bac1659a0 con 0x7f6bac14e530 2023-11-30T17:08:01.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.059+0000 7f6ba8ff9700 1 -- 172.21.15.49:0/2790633401 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4012ad0 con 0x7f6bac14e530 2023-11-30T17:08:01.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.059+0000 7f6bb1cda700 1 -- 172.21.15.49:0/2790633401 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bac168f10 con 0x7f6bac14e530 2023-11-30T17:08:01.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.060+0000 7f6bb1cda700 1 -- 172.21.15.49:0/2790633401 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bac165ee0 con 0x7f6bac14e530 2023-11-30T17:08:01.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.060+0000 7f6ba8ff9700 1 -- 172.21.15.49:0/2790633401 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6ba4013480 con 0x7f6bac14e530 2023-11-30T17:08:01.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.061+0000 7f6ba8ff9700 1 --2- 172.21.15.49:0/2790633401 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6b8c05f150 0x7f6b8c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:01.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.061+0000 7f6ba8ff9700 1 -- 172.21.15.49:0/2790633401 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f6ba407a040 con 0x7f6bac14e530 2023-11-30T17:08:01.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.061+0000 7f6babfff700 1 --2- 172.21.15.49:0/2790633401 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6b8c05f150 0x7f6b8c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:01.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.061+0000 7f6babfff700 1 --2- 172.21.15.49:0/2790633401 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6b8c05f150 0x7f6b8c061610 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f6b9c009f20 tx=0x7f6b9c009840).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:01.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.065+0000 7f6ba8ff9700 1 -- 172.21.15.49:0/2790633401 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6bac165ee0 con 0x7f6bac14e530 2023-11-30T17:08:01.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.304+0000 7f6bb1cda700 1 -- 172.21.15.49:0/2790633401 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f6bac062ee0 con 0x7f6bac14e530 2023-11-30T17:08:01.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.307+0000 7f6ba8ff9700 1 -- 172.21.15.49:0/2790633401 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6ba404b600 con 0x7f6bac14e530 2023-11-30T17:08:01.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.308+0000 7f6bb1cda700 1 -- 172.21.15.49:0/2790633401 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6b8c05f150 msgr2=0x7f6b8c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:01.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.308+0000 7f6bb1cda700 1 --2- 172.21.15.49:0/2790633401 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6b8c05f150 0x7f6b8c061610 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f6b9c009f20 tx=0x7f6b9c009840).stop 2023-11-30T17:08:01.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.308+0000 7f6bb1cda700 1 -- 172.21.15.49:0/2790633401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bac14e530 msgr2=0x7f6bac164ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:01.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.308+0000 7f6bb1cda700 1 --2- 172.21.15.49:0/2790633401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bac14e530 0x7f6bac164ad0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f6ba400d890 tx=0x7f6ba4008040).stop 2023-11-30T17:08:01.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.308+0000 7f6bb1cda700 1 -- 172.21.15.49:0/2790633401 shutdown_connections 2023-11-30T17:08:01.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.308+0000 7f6bb1cda700 1 --2- 172.21.15.49:0/2790633401 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bac158570 0x7f6bac0c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:01.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.308+0000 7f6bb1cda700 1 --2- 172.21.15.49:0/2790633401 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6b8c05f150 0x7f6b8c061610 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:01.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.308+0000 7f6bb1cda700 1 --2- 172.21.15.49:0/2790633401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bac14e530 0x7f6bac164ad0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:01.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.308+0000 7f6bb1cda700 1 --2- 172.21.15.49:0/2790633401 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6bac154950 0x7f6bac168a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:01.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.308+0000 7f6bb1cda700 1 -- 172.21.15.49:0/2790633401 >> 172.21.15.49:0/2790633401 conn(0x7f6bac064990 msgr2=0x7f6bac157160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:01.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.309+0000 7f6bb1cda700 1 -- 172.21.15.49:0/2790633401 shutdown_connections 2023-11-30T17:08:01.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.309+0000 7f6bb1cda700 1 -- 172.21.15.49:0/2790633401 wait complete. 2023-11-30T17:08:01.312 INFO:teuthology.orchestra.run.smithi049.stderr:updated 2023-11-30T17:08:01.323 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-30T17:08:01.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.439+0000 7f1407961700 1 Processor -- start 2023-11-30T17:08:01.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.439+0000 7f1407961700 1 -- start start 2023-11-30T17:08:01.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.440+0000 7f1407961700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1400064220 0x7f1400154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:01.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.440+0000 7f1407961700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14000c18b0 con 0x7f14000c1d40 2023-11-30T17:08:01.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.440+0000 7f1407961700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14000c0ca0 con 0x7f14000c7170 2023-11-30T17:08:01.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.440+0000 7f1407961700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14000c0f80 con 0x7f1400064220 2023-11-30T17:08:01.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.440+0000 7f1404efc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1400064220 0x7f1400154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:01.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.440+0000 7f1405efe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f14000c1d40 0x7f14001551c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49320/0 (socket says 172.21.15.49:49320) 2023-11-30T17:08:01.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.440+0000 7f1405efe700 1 -- 172.21.15.49:0/152187799 learned_addr learned my addr 172.21.15.49:0/152187799 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:08:01.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.440+0000 7f1404efc700 1 -- 172.21.15.49:0/152187799 >> v1:172.21.15.115:6789/0 conn(0x7f14000c7170 legacy=0x7f1400063b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:01.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.440+0000 7f1404efc700 1 -- 172.21.15.49:0/152187799 >> v1:172.21.15.49:6789/0 conn(0x7f14000c1d40 legacy=0x7f14001551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:01.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.440+0000 7f1404efc700 1 -- 172.21.15.49:0/152187799 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14000c1260 con 0x7f1400064220 2023-11-30T17:08:01.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.440+0000 7f13fffff700 1 -- 172.21.15.49:0/152187799 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1110638607 0 0) 0x7f14000c18b0 con 0x7f14000c1d40 2023-11-30T17:08:01.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.440+0000 7f1404efc700 1 --2- 172.21.15.49:0/152187799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1400064220 0x7f1400154cd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f13f4009760 tx=0x7f13f4009060).ready entity=mon.0 client_cookie=14688edbe754362e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:01.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.440+0000 7f13fffff700 1 -- 172.21.15.49:0/152187799 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f400b580 con 0x7f1400064220 2023-11-30T17:08:01.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.441+0000 7f13fffff700 1 -- 172.21.15.49:0/152187799 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f400b6e0 con 0x7f1400064220 2023-11-30T17:08:01.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.441+0000 7f13fffff700 1 -- 172.21.15.49:0/152187799 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f400ba60 con 0x7f1400064220 2023-11-30T17:08:01.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.441+0000 7f1407961700 1 -- 172.21.15.49:0/152187799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1400064220 msgr2=0x7f1400154cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:01.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.441+0000 7f1407961700 1 --2- 172.21.15.49:0/152187799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1400064220 0x7f1400154cd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f13f4009760 tx=0x7f13f4009060).stop 2023-11-30T17:08:01.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.441+0000 7f1407961700 1 -- 172.21.15.49:0/152187799 shutdown_connections 2023-11-30T17:08:01.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.441+0000 7f1407961700 1 --2- 172.21.15.49:0/152187799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1400064220 0x7f1400154cd0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:01.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.441+0000 7f1407961700 1 -- 172.21.15.49:0/152187799 >> 172.21.15.49:0/152187799 conn(0x7f14000cb260 msgr2=0x7f14000cb670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:01.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.441+0000 7f1407961700 1 -- 172.21.15.49:0/152187799 shutdown_connections 2023-11-30T17:08:01.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.441+0000 7f1407961700 1 -- 172.21.15.49:0/152187799 wait complete. 2023-11-30T17:08:01.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.442+0000 7f1407961700 1 Processor -- start 2023-11-30T17:08:01.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.442+0000 7f1407961700 1 -- start start 2023-11-30T17:08:01.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.443+0000 7f1407961700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1400064220 0x7f14000ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:01.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.443+0000 7f1407961700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14000c1d40 0x7f140014d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:01.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.443+0000 7f1407961700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14000c7170 0x7f1400168470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:01.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.443+0000 7f1407961700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140014f030 con 0x7f1400064220 2023-11-30T17:08:01.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.443+0000 7f1407961700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1400150340 con 0x7f14000c1d40 2023-11-30T17:08:01.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.443+0000 7f1407961700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14001505e0 con 0x7f14000c7170 2023-11-30T17:08:01.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.443+0000 7f14056fd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1400064220 0x7f14000ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:01.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.443+0000 7f14056fd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1400064220 0x7f14000ae210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39516/0 (socket says 172.21.15.49:39516) 2023-11-30T17:08:01.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.443+0000 7f14056fd700 1 -- 172.21.15.49:0/2242971657 learned_addr learned my addr 172.21.15.49:0/2242971657 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:01.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.443+0000 7f1404efc700 1 --2- 172.21.15.49:0/2242971657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14000c1d40 0x7f140014d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:01.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.443+0000 7f1405efe700 1 --2- 172.21.15.49:0/2242971657 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14000c7170 0x7f1400168470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:01.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.444+0000 7f14056fd700 1 -- 172.21.15.49:0/2242971657 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14000c7170 msgr2=0x7f1400168470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:01.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.444+0000 7f14056fd700 1 --2- 172.21.15.49:0/2242971657 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14000c7170 0x7f1400168470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:01.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.444+0000 7f14056fd700 1 -- 172.21.15.49:0/2242971657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14000c1d40 msgr2=0x7f140014d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:01.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.444+0000 7f14056fd700 1 --2- 172.21.15.49:0/2242971657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14000c1d40 0x7f140014d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:01.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.444+0000 7f14056fd700 1 -- 172.21.15.49:0/2242971657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f40092a0 con 0x7f1400064220 2023-11-30T17:08:01.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.444+0000 7f14056fd700 1 --2- 172.21.15.49:0/2242971657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1400064220 0x7f14000ae210 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f13f800c7c0 tx=0x7f13f80015c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:01.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.444+0000 7f13fd7fa700 1 -- 172.21.15.49:0/2242971657 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f8006a20 con 0x7f1400064220 2023-11-30T17:08:01.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.444+0000 7f13fd7fa700 1 -- 172.21.15.49:0/2242971657 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f8006b80 con 0x7f1400064220 2023-11-30T17:08:01.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.444+0000 7f1407961700 1 -- 172.21.15.49:0/2242971657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14001508c0 con 0x7f1400064220 2023-11-30T17:08:01.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.444+0000 7f13fd7fa700 1 -- 172.21.15.49:0/2242971657 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f8007020 con 0x7f1400064220 2023-11-30T17:08:01.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.444+0000 7f1407961700 1 -- 172.21.15.49:0/2242971657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f140014f4c0 con 0x7f1400064220 2023-11-30T17:08:01.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.445+0000 7f1407961700 1 -- 172.21.15.49:0/2242971657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14001545f0 con 0x7f1400064220 2023-11-30T17:08:01.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.445+0000 7f13fd7fa700 1 -- 172.21.15.49:0/2242971657 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f13f80073d0 con 0x7f1400064220 2023-11-30T17:08:01.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.445+0000 7f13fd7fa700 1 --2- 172.21.15.49:0/2242971657 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f13ec05f150 0x7f13ec061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:01.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.446+0000 7f13fd7fa700 1 -- 172.21.15.49:0/2242971657 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f13f80793c0 con 0x7f1400064220 2023-11-30T17:08:01.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.446+0000 7f1404efc700 1 --2- 172.21.15.49:0/2242971657 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f13ec05f150 0x7f13ec061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:01.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.446+0000 7f1404efc700 1 --2- 172.21.15.49:0/2242971657 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f13ec05f150 0x7f13ec061610 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f14000c6c10 tx=0x7f13f4017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:01.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.450+0000 7f13fd7fa700 1 -- 172.21.15.49:0/2242971657 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f13f8047b00 con 0x7f1400064220 2023-11-30T17:08:01.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.689+0000 7f1407961700 1 -- 172.21.15.49:0/2242971657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f140014f310 con 0x7f1400064220 2023-11-30T17:08:01.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.692+0000 7f13fd7fa700 1 -- 172.21.15.49:0/2242971657 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v12) v1 ==== 97+0+0 (secure 0 0 0) 0x7f13f804a9e0 con 0x7f1400064220 2023-11-30T17:08:01.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.694+0000 7f1407961700 1 -- 172.21.15.49:0/2242971657 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f13ec05f150 msgr2=0x7f13ec061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:01.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.694+0000 7f1407961700 1 --2- 172.21.15.49:0/2242971657 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f13ec05f150 0x7f13ec061610 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f14000c6c10 tx=0x7f13f4017000).stop 2023-11-30T17:08:01.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.694+0000 7f1407961700 1 -- 172.21.15.49:0/2242971657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1400064220 msgr2=0x7f14000ae210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:01.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.694+0000 7f1407961700 1 --2- 172.21.15.49:0/2242971657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1400064220 0x7f14000ae210 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f13f800c7c0 tx=0x7f13f80015c0).stop 2023-11-30T17:08:01.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.694+0000 7f1407961700 1 -- 172.21.15.49:0/2242971657 shutdown_connections 2023-11-30T17:08:01.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.694+0000 7f1407961700 1 --2- 172.21.15.49:0/2242971657 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14000c7170 0x7f1400168470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:01.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.694+0000 7f1407961700 1 --2- 172.21.15.49:0/2242971657 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f13ec05f150 0x7f13ec061610 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:01.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.694+0000 7f1407961700 1 --2- 172.21.15.49:0/2242971657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1400064220 0x7f14000ae210 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:01.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.694+0000 7f1407961700 1 --2- 172.21.15.49:0/2242971657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14000c1d40 0x7f140014d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:01.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.694+0000 7f1407961700 1 -- 172.21.15.49:0/2242971657 >> 172.21.15.49:0/2242971657 conn(0x7f14000cb260 msgr2=0x7f1400063b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:01.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.694+0000 7f1407961700 1 -- 172.21.15.49:0/2242971657 shutdown_connections 2023-11-30T17:08:01.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.694+0000 7f1407961700 1 -- 172.21.15.49:0/2242971657 wait complete. 2023-11-30T17:08:01.698 INFO:teuthology.orchestra.run.smithi049.stderr:updated 2023-11-30T17:08:01.708 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:08:01.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.824+0000 7f2c5a867700 1 Processor -- start 2023-11-30T17:08:01.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.824+0000 7f2c5a867700 1 -- start start 2023-11-30T17:08:01.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.825+0000 7f2c5a867700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2c54152230 0x7f2c54156a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:01.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.825+0000 7f2c5a867700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2c540686e0 0x7f2c54068b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:01.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.825+0000 7f2c5a867700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c540a4250 con 0x7f2c540a3da0 2023-11-30T17:08:01.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.825+0000 7f2c5a867700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c54069020 con 0x7f2c540686e0 2023-11-30T17:08:01.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.825+0000 7f2c5a867700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c540bbed0 con 0x7f2c54152230 2023-11-30T17:08:01.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.825+0000 7f2c58e04700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2c540686e0 0x7f2c54068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:01.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.825+0000 7f2c58e04700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2c540686e0 0x7f2c54068b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39532/0 (socket says 172.21.15.49:39532) 2023-11-30T17:08:01.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.825+0000 7f2c58e04700 1 -- 172.21.15.49:0/1619156619 learned_addr learned my addr 172.21.15.49:0/1619156619 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:01.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.825+0000 7f2c53fff700 1 --2- 172.21.15.49:0/1619156619 >> v2:172.21.15.115:3300/0 conn(0x7f2c54152230 0x7f2c54156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:01.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.825+0000 7f2c58e04700 1 -- 172.21.15.49:0/1619156619 >> v2:172.21.15.115:3300/0 conn(0x7f2c54152230 msgr2=0x7f2c54156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:01.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.825+0000 7f2c58e04700 1 --2- 172.21.15.49:0/1619156619 >> v2:172.21.15.115:3300/0 conn(0x7f2c54152230 0x7f2c54156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:01.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.825+0000 7f2c58e04700 1 -- 172.21.15.49:0/1619156619 >> v1:172.21.15.115:6789/0 conn(0x7f2c540a3da0 legacy=0x7f2c54066250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:01.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.825+0000 7f2c58e04700 1 -- 172.21.15.49:0/1619156619 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c540bc1b0 con 0x7f2c540686e0 2023-11-30T17:08:01.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.825+0000 7f2c53fff700 1 --2- 172.21.15.49:0/1619156619 >> v2:172.21.15.115:3300/0 conn(0x7f2c54152230 0x7f2c54156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:08:01.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.826+0000 7f2c58e04700 1 --2- 172.21.15.49:0/1619156619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c540686e0 0x7f2c54068b30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f2c540c6e00 tx=0x7f2c4c009840).ready entity=mon.0 client_cookie=be4892ec242c4e3d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:01.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.826+0000 7f2c52ffd700 1 -- 172.21.15.49:0/1619156619 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c00e070 con 0x7f2c540686e0 2023-11-30T17:08:01.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.826+0000 7f2c52ffd700 1 -- 172.21.15.49:0/1619156619 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4c00ba50 con 0x7f2c540686e0 2023-11-30T17:08:01.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.826+0000 7f2c52ffd700 1 -- 172.21.15.49:0/1619156619 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c00bdd0 con 0x7f2c540686e0 2023-11-30T17:08:01.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.826+0000 7f2c5a867700 1 -- 172.21.15.49:0/1619156619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c540686e0 msgr2=0x7f2c54068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:01.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.826+0000 7f2c5a867700 1 --2- 172.21.15.49:0/1619156619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c540686e0 0x7f2c54068b30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f2c540c6e00 tx=0x7f2c4c009840).stop 2023-11-30T17:08:01.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.826+0000 7f2c5a867700 1 -- 172.21.15.49:0/1619156619 shutdown_connections 2023-11-30T17:08:01.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.826+0000 7f2c5a867700 1 --2- 172.21.15.49:0/1619156619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c540686e0 0x7f2c54068b30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:01.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.826+0000 7f2c5a867700 1 --2- 172.21.15.49:0/1619156619 >> v2:172.21.15.115:3300/0 conn(0x7f2c54152230 0x7f2c54156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:01.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.826+0000 7f2c5a867700 1 -- 172.21.15.49:0/1619156619 >> 172.21.15.49:0/1619156619 conn(0x7f2c540631d0 msgr2=0x7f2c540c6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:01.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.826+0000 7f2c5a867700 1 -- 172.21.15.49:0/1619156619 shutdown_connections 2023-11-30T17:08:01.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.826+0000 7f2c5a867700 1 -- 172.21.15.49:0/1619156619 wait complete. 2023-11-30T17:08:01.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.827+0000 7f2c5a867700 1 Processor -- start 2023-11-30T17:08:01.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.828+0000 7f2c5a867700 1 -- start start 2023-11-30T17:08:01.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.828+0000 7f2c5a867700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c540686e0 0x7f2c54163120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:01.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.828+0000 7f2c5a867700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2c540a3da0 0x7f2c5414baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:01.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.828+0000 7f2c5a867700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c54152230 0x7f2c541513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:01.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.828+0000 7f2c5a867700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5414bfe0 con 0x7f2c54152230 2023-11-30T17:08:01.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.828+0000 7f2c5a867700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c541636b0 con 0x7f2c540686e0 2023-11-30T17:08:01.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.828+0000 7f2c5a867700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c541550e0 con 0x7f2c540a3da0 2023-11-30T17:08:01.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.828+0000 7f2c58e04700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c54152230 0x7f2c541513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:01.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.828+0000 7f2c58e04700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c54152230 0x7f2c541513b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39544/0 (socket says 172.21.15.49:39544) 2023-11-30T17:08:01.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.828+0000 7f2c58e04700 1 -- 172.21.15.49:0/3209367948 learned_addr learned my addr 172.21.15.49:0/3209367948 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:01.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.829+0000 7f2c53fff700 1 --2- 172.21.15.49:0/3209367948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c540686e0 0x7f2c54163120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:01.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.829+0000 7f2c537fe700 1 --2- 172.21.15.49:0/3209367948 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2c540a3da0 0x7f2c5414baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:01.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.829+0000 7f2c58e04700 1 -- 172.21.15.49:0/3209367948 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2c540a3da0 msgr2=0x7f2c5414baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:01.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.829+0000 7f2c58e04700 1 --2- 172.21.15.49:0/3209367948 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2c540a3da0 0x7f2c5414baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:01.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.829+0000 7f2c58e04700 1 -- 172.21.15.49:0/3209367948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c540686e0 msgr2=0x7f2c54163120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:01.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.829+0000 7f2c58e04700 1 --2- 172.21.15.49:0/3209367948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c540686e0 0x7f2c54163120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:01.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.829+0000 7f2c58e04700 1 -- 172.21.15.49:0/3209367948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4c009ae0 con 0x7f2c54152230 2023-11-30T17:08:01.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.829+0000 7f2c58e04700 1 --2- 172.21.15.49:0/3209367948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c54152230 0x7f2c541513b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f2c4c009fd0 tx=0x7f2c4c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:01.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.829+0000 7f2c3bfff700 1 -- 172.21.15.49:0/3209367948 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c0032d0 con 0x7f2c54152230 2023-11-30T17:08:01.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.829+0000 7f2c3bfff700 1 -- 172.21.15.49:0/3209367948 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4c013e30 con 0x7f2c54152230 2023-11-30T17:08:01.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.829+0000 7f2c5a867700 1 -- 172.21.15.49:0/3209367948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c541553c0 con 0x7f2c54152230 2023-11-30T17:08:01.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.829+0000 7f2c3bfff700 1 -- 172.21.15.49:0/3209367948 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c01d620 con 0x7f2c54152230 2023-11-30T17:08:01.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.829+0000 7f2c5a867700 1 -- 172.21.15.49:0/3209367948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c541518a0 con 0x7f2c54152230 2023-11-30T17:08:01.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.830+0000 7f2c5a867700 1 -- 172.21.15.49:0/3209367948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c54163bb0 con 0x7f2c54152230 2023-11-30T17:08:01.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.830+0000 7f2c3bfff700 1 -- 172.21.15.49:0/3209367948 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2c4c01da50 con 0x7f2c54152230 2023-11-30T17:08:01.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.831+0000 7f2c3bfff700 1 --2- 172.21.15.49:0/3209367948 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2c4005f120 0x7f2c400615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:01.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.831+0000 7f2c3bfff700 1 -- 172.21.15.49:0/3209367948 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f2c4c07b9e0 con 0x7f2c54152230 2023-11-30T17:08:01.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.831+0000 7f2c53fff700 1 --2- 172.21.15.49:0/3209367948 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2c4005f120 0x7f2c400615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:01.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.831+0000 7f2c53fff700 1 --2- 172.21.15.49:0/3209367948 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2c4005f120 0x7f2c400615e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f2c44006fd0 tx=0x7f2c44008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:01.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:01.835+0000 7f2c3bfff700 1 -- 172.21.15.49:0/3209367948 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2c54163bb0 con 0x7f2c54152230 2023-11-30T17:08:02.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.007+0000 7f2c5a867700 1 -- 172.21.15.49:0/3209367948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c54163bb0 con 0x7f2c54152230 2023-11-30T17:08:02.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.008+0000 7f2c3bfff700 1 -- 172.21.15.49:0/3209367948 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+13712 (secure 0 0 0) 0x7f2c54163bb0 con 0x7f2c54152230 2023-11-30T17:08:02.011 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:08:02.011 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":30,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:07:58.972230+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:08:02.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.010+0000 7f2c5a867700 1 -- 172.21.15.49:0/3209367948 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2c4005f120 msgr2=0x7f2c400615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:02.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.010+0000 7f2c5a867700 1 --2- 172.21.15.49:0/3209367948 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2c4005f120 0x7f2c400615e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f2c44006fd0 tx=0x7f2c44008040).stop 2023-11-30T17:08:02.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.010+0000 7f2c5a867700 1 -- 172.21.15.49:0/3209367948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c54152230 msgr2=0x7f2c541513b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:02.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.010+0000 7f2c5a867700 1 --2- 172.21.15.49:0/3209367948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c54152230 0x7f2c541513b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f2c4c009fd0 tx=0x7f2c4c009840).stop 2023-11-30T17:08:02.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.010+0000 7f2c5a867700 1 -- 172.21.15.49:0/3209367948 shutdown_connections 2023-11-30T17:08:02.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.010+0000 7f2c5a867700 1 --2- 172.21.15.49:0/3209367948 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2c4005f120 0x7f2c400615e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:02.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.010+0000 7f2c5a867700 1 --2- 172.21.15.49:0/3209367948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c54152230 0x7f2c541513b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:02.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.010+0000 7f2c5a867700 1 --2- 172.21.15.49:0/3209367948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c540686e0 0x7f2c54163120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:02.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.010+0000 7f2c5a867700 1 --2- 172.21.15.49:0/3209367948 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2c540a3da0 0x7f2c5414baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:02.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.010+0000 7f2c5a867700 1 -- 172.21.15.49:0/3209367948 >> 172.21.15.49:0/3209367948 conn(0x7f2c540631d0 msgr2=0x7f2c54065e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:02.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.010+0000 7f2c5a867700 1 -- 172.21.15.49:0/3209367948 shutdown_connections 2023-11-30T17:08:02.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.010+0000 7f2c5a867700 1 -- 172.21.15.49:0/3209367948 wait complete. 2023-11-30T17:08:02.025 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-11-30T17:08:02.025 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T17:08:02.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.143+0000 7f0c9db2c700 1 Processor -- start 2023-11-30T17:08:02.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.143+0000 7f0c9db2c700 1 -- start start 2023-11-30T17:08:02.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.144+0000 7f0c9db2c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0c98098d10 0x7f0c980c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:02.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.144+0000 7f0c9db2c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c980c6190 0x7f0c98063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:02.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.144+0000 7f0c9db2c700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c980c72d0 con 0x7f0c98064350 2023-11-30T17:08:02.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.144+0000 7f0c9db2c700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c98154bc0 con 0x7f0c98098d10 2023-11-30T17:08:02.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.144+0000 7f0c9db2c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c980c66c0 con 0x7f0c980c6190 2023-11-30T17:08:02.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.144+0000 7f0c97fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0c98064350 0x7f0c98158320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49324/0 (socket says 172.21.15.49:49324) 2023-11-30T17:08:02.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.144+0000 7f0c97fff700 1 -- 172.21.15.49:0/1810227016 learned_addr learned my addr 172.21.15.49:0/1810227016 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:08:02.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.144+0000 7f0c96ffd700 1 --2- 172.21.15.49:0/1810227016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c980c6190 0x7f0c98063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:02.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.144+0000 7f0c977fe700 1 --2- 172.21.15.49:0/1810227016 >> v2:172.21.15.115:3300/0 conn(0x7f0c98098d10 0x7f0c980c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:02.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.145+0000 7f0c967fc700 1 -- 172.21.15.49:0/1810227016 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4254168711 0 0) 0x7f0c980c72d0 con 0x7f0c98064350 2023-11-30T17:08:02.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.145+0000 7f0c967fc700 1 -- 172.21.15.49:0/1810227016 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c800033f0 con 0x7f0c98064350 2023-11-30T17:08:02.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.145+0000 7f0c977fe700 1 -- 172.21.15.49:0/1810227016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c980c6190 msgr2=0x7f0c98063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:02.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.145+0000 7f0c977fe700 1 --2- 172.21.15.49:0/1810227016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c980c6190 0x7f0c98063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:02.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.145+0000 7f0c977fe700 1 -- 172.21.15.49:0/1810227016 >> v1:172.21.15.49:6789/0 conn(0x7f0c98064350 legacy=0x7f0c98158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:02.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.145+0000 7f0c977fe700 1 -- 172.21.15.49:0/1810227016 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c980c69a0 con 0x7f0c98098d10 2023-11-30T17:08:02.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.145+0000 7f0c96ffd700 1 --2- 172.21.15.49:0/1810227016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c980c6190 0x7f0c98063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:08:02.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.145+0000 7f0c977fe700 1 --2- 172.21.15.49:0/1810227016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c98098d10 0x7f0c980c7760 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f0c88009760 tx=0x7f0c88009060).ready entity=mon.1 client_cookie=e6d34378549ba797 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:02.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.145+0000 7f0c967fc700 1 -- 172.21.15.49:0/1810227016 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8800d4a0 con 0x7f0c98098d10 2023-11-30T17:08:02.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.145+0000 7f0c967fc700 1 -- 172.21.15.49:0/1810227016 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8800d600 con 0x7f0c98098d10 2023-11-30T17:08:02.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.145+0000 7f0c967fc700 1 -- 172.21.15.49:0/1810227016 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8800d980 con 0x7f0c98098d10 2023-11-30T17:08:02.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.145+0000 7f0c9db2c700 1 -- 172.21.15.49:0/1810227016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c98098d10 msgr2=0x7f0c980c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:02.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.146+0000 7f0c9db2c700 1 --2- 172.21.15.49:0/1810227016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c98098d10 0x7f0c980c7760 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f0c88009760 tx=0x7f0c88009060).stop 2023-11-30T17:08:02.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.146+0000 7f0c9db2c700 1 -- 172.21.15.49:0/1810227016 shutdown_connections 2023-11-30T17:08:02.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.146+0000 7f0c9db2c700 1 --2- 172.21.15.49:0/1810227016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c98098d10 0x7f0c980c7760 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:02.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.146+0000 7f0c9db2c700 1 --2- 172.21.15.49:0/1810227016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c980c6190 0x7f0c98063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:02.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.146+0000 7f0c9db2c700 1 -- 172.21.15.49:0/1810227016 >> 172.21.15.49:0/1810227016 conn(0x7f0c980cb310 msgr2=0x7f0c980cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:02.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.146+0000 7f0c9db2c700 1 -- 172.21.15.49:0/1810227016 shutdown_connections 2023-11-30T17:08:02.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.146+0000 7f0c9db2c700 1 -- 172.21.15.49:0/1810227016 wait complete. 2023-11-30T17:08:02.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.147+0000 7f0c9db2c700 1 Processor -- start 2023-11-30T17:08:02.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.147+0000 7f0c9db2c700 1 -- start start 2023-11-30T17:08:02.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.148+0000 7f0c9db2c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c98064350 0x7f0c9814f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:02.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.148+0000 7f0c9db2c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c98098d10 0x7f0c98155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:02.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.148+0000 7f0c9db2c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c980c6190 0x7f0c980a93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:02.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.148+0000 7f0c9db2c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9814fe50 con 0x7f0c98098d10 2023-11-30T17:08:02.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.148+0000 7f0c9db2c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c98155c80 con 0x7f0c980c6190 2023-11-30T17:08:02.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.148+0000 7f0c9db2c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c98168630 con 0x7f0c98064350 2023-11-30T17:08:02.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.148+0000 7f0c96ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c98098d10 0x7f0c98155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:02.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.148+0000 7f0c96ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c98098d10 0x7f0c98155790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39558/0 (socket says 172.21.15.49:39558) 2023-11-30T17:08:02.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.148+0000 7f0c96ffd700 1 -- 172.21.15.49:0/819471846 learned_addr learned my addr 172.21.15.49:0/819471846 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:02.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.148+0000 7f0c97fff700 1 --2- 172.21.15.49:0/819471846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c980c6190 0x7f0c980a93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:02.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.148+0000 7f0c977fe700 1 --2- 172.21.15.49:0/819471846 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c98064350 0x7f0c9814f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:02.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.148+0000 7f0c96ffd700 1 -- 172.21.15.49:0/819471846 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c98064350 msgr2=0x7f0c9814f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:02.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.148+0000 7f0c96ffd700 1 --2- 172.21.15.49:0/819471846 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c98064350 0x7f0c9814f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:02.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.148+0000 7f0c96ffd700 1 -- 172.21.15.49:0/819471846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c980c6190 msgr2=0x7f0c980a93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:02.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.148+0000 7f0c96ffd700 1 --2- 172.21.15.49:0/819471846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c980c6190 0x7f0c980a93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:02.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.148+0000 7f0c96ffd700 1 -- 172.21.15.49:0/819471846 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8c0092a0 con 0x7f0c98098d10 2023-11-30T17:08:02.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.148+0000 7f0c96ffd700 1 --2- 172.21.15.49:0/819471846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c98098d10 0x7f0c98155790 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f0c8c00e930 tx=0x7f0c8c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:02.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.148+0000 7f0c7f7fe700 1 -- 172.21.15.49:0/819471846 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c012600 con 0x7f0c98098d10 2023-11-30T17:08:02.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.148+0000 7f0c7f7fe700 1 -- 172.21.15.49:0/819471846 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8c012760 con 0x7f0c98098d10 2023-11-30T17:08:02.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.148+0000 7f0c9db2c700 1 -- 172.21.15.49:0/819471846 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c880092a0 con 0x7f0c98098d10 2023-11-30T17:08:02.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.148+0000 7f0c7f7fe700 1 -- 172.21.15.49:0/819471846 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c012ae0 con 0x7f0c98098d10 2023-11-30T17:08:02.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.149+0000 7f0c9db2c700 1 -- 172.21.15.49:0/819471846 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c98168bf0 con 0x7f0c98098d10 2023-11-30T17:08:02.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.150+0000 7f0c9db2c700 1 -- 172.21.15.49:0/819471846 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c981564b0 con 0x7f0c98098d10 2023-11-30T17:08:02.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.150+0000 7f0c7f7fe700 1 -- 172.21.15.49:0/819471846 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0c8c01b400 con 0x7f0c98098d10 2023-11-30T17:08:02.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.150+0000 7f0c7f7fe700 1 --2- 172.21.15.49:0/819471846 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0c8405f150 0x7f0c84061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:02.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.150+0000 7f0c7f7fe700 1 -- 172.21.15.49:0/819471846 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f0c8c07a2c0 con 0x7f0c98098d10 2023-11-30T17:08:02.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.150+0000 7f0c977fe700 1 --2- 172.21.15.49:0/819471846 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0c8405f150 0x7f0c84061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:02.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.151+0000 7f0c977fe700 1 --2- 172.21.15.49:0/819471846 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0c8405f150 0x7f0c84061610 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f0c88009760 tx=0x7f0c88016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:02.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.154+0000 7f0c7f7fe700 1 -- 172.21.15.49:0/819471846 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0c981564b0 con 0x7f0c98098d10 2023-11-30T17:08:02.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.325+0000 7f0c9db2c700 1 -- 172.21.15.49:0/819471846 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0c981564b0 con 0x7f0c98098d10 2023-11-30T17:08:02.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.326+0000 7f0c7f7fe700 1 -- 172.21.15.49:0/819471846 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v30) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0c981564b0 con 0x7f0c98098d10 2023-11-30T17:08:02.328 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T17:08:02.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.328+0000 7f0c9db2c700 1 -- 172.21.15.49:0/819471846 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0c8405f150 msgr2=0x7f0c84061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:02.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.328+0000 7f0c9db2c700 1 --2- 172.21.15.49:0/819471846 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0c8405f150 0x7f0c84061610 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f0c88009760 tx=0x7f0c88016000).stop 2023-11-30T17:08:02.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.328+0000 7f0c9db2c700 1 -- 172.21.15.49:0/819471846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c98098d10 msgr2=0x7f0c98155790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:02.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.328+0000 7f0c9db2c700 1 --2- 172.21.15.49:0/819471846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c98098d10 0x7f0c98155790 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f0c8c00e930 tx=0x7f0c8c009060).stop 2023-11-30T17:08:02.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.328+0000 7f0c9db2c700 1 -- 172.21.15.49:0/819471846 shutdown_connections 2023-11-30T17:08:02.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.328+0000 7f0c9db2c700 1 --2- 172.21.15.49:0/819471846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c980c6190 0x7f0c980a93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:02.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.328+0000 7f0c9db2c700 1 --2- 172.21.15.49:0/819471846 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c98064350 0x7f0c9814f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:02.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.328+0000 7f0c9db2c700 1 --2- 172.21.15.49:0/819471846 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0c8405f150 0x7f0c84061610 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:02.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.328+0000 7f0c9db2c700 1 --2- 172.21.15.49:0/819471846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c98098d10 0x7f0c98155790 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:02.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.328+0000 7f0c9db2c700 1 -- 172.21.15.49:0/819471846 >> 172.21.15.49:0/819471846 conn(0x7f0c980cb310 msgr2=0x7f0c980c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:02.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.328+0000 7f0c9db2c700 1 -- 172.21.15.49:0/819471846 shutdown_connections 2023-11-30T17:08:02.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.328+0000 7f0c9db2c700 1 -- 172.21.15.49:0/819471846 wait complete. 2023-11-30T17:08:02.342 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T17:08:02.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.461+0000 7f20557be700 1 Processor -- start 2023-11-30T17:08:02.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.461+0000 7f20557be700 1 -- start start 2023-11-30T17:08:02.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.462+0000 7f20557be700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2050098d10 0x7f20500c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:02.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.462+0000 7f20557be700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2050158320 0x7f20501587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:02.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.462+0000 7f20557be700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2050158cc0 con 0x7f20500c6190 2023-11-30T17:08:02.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.462+0000 7f20557be700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20500c72d0 con 0x7f2050158320 2023-11-30T17:08:02.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.462+0000 7f20557be700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2050064570 con 0x7f2050098d10 2023-11-30T17:08:02.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.462+0000 7f204f7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2050158320 0x7f20501587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:02.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.462+0000 7f204e7fc700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f20500c6190 0x7f2050063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49328/0 (socket says 172.21.15.49:49328) 2023-11-30T17:08:02.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.462+0000 7f204f7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2050158320 0x7f20501587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39566/0 (socket says 172.21.15.49:39566) 2023-11-30T17:08:02.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.462+0000 7f204e7fc700 1 -- 172.21.15.49:0/3862664197 learned_addr learned my addr 172.21.15.49:0/3862664197 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:08:02.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.462+0000 7f204effd700 1 --2- 172.21.15.49:0/3862664197 >> v2:172.21.15.115:3300/0 conn(0x7f2050098d10 0x7f20500c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:02.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.462+0000 7f204f7fe700 1 -- 172.21.15.49:0/3862664197 >> v2:172.21.15.115:3300/0 conn(0x7f2050098d10 msgr2=0x7f20500c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:02.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.462+0000 7f204f7fe700 1 --2- 172.21.15.49:0/3862664197 >> v2:172.21.15.115:3300/0 conn(0x7f2050098d10 0x7f20500c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:02.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.462+0000 7f204f7fe700 1 -- 172.21.15.49:0/3862664197 >> v1:172.21.15.49:6789/0 conn(0x7f20500c6190 legacy=0x7f2050063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:02.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.462+0000 7f204dffb700 1 -- 172.21.15.49:0/3862664197 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3464885680 0 0) 0x7f2038001110 con 0x7f20500c6190 2023-11-30T17:08:02.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.462+0000 7f204f7fe700 1 -- 172.21.15.49:0/3862664197 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2050154bc0 con 0x7f2050158320 2023-11-30T17:08:02.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.463+0000 7f204f7fe700 1 --2- 172.21.15.49:0/3862664197 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2050158320 0x7f20501587d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f2050083f80 tx=0x7f2040009780).ready entity=mon.0 client_cookie=d38d48abf30a6f35 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:02.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.463+0000 7f204dffb700 1 -- 172.21.15.49:0/3862664197 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204000e070 con 0x7f2050158320 2023-11-30T17:08:02.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.463+0000 7f204dffb700 1 -- 172.21.15.49:0/3862664197 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204000bb60 con 0x7f2050158320 2023-11-30T17:08:02.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.463+0000 7f204dffb700 1 -- 172.21.15.49:0/3862664197 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2040012410 con 0x7f2050158320 2023-11-30T17:08:02.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.463+0000 7f20557be700 1 -- 172.21.15.49:0/3862664197 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2050158320 msgr2=0x7f20501587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:02.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.463+0000 7f20557be700 1 --2- 172.21.15.49:0/3862664197 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2050158320 0x7f20501587d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f2050083f80 tx=0x7f2040009780).stop 2023-11-30T17:08:02.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.463+0000 7f20557be700 1 -- 172.21.15.49:0/3862664197 shutdown_connections 2023-11-30T17:08:02.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.463+0000 7f20557be700 1 --2- 172.21.15.49:0/3862664197 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2050158320 0x7f20501587d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:02.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.463+0000 7f20557be700 1 --2- 172.21.15.49:0/3862664197 >> v2:172.21.15.115:3300/0 conn(0x7f2050098d10 0x7f20500c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:02.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.463+0000 7f20557be700 1 -- 172.21.15.49:0/3862664197 >> 172.21.15.49:0/3862664197 conn(0x7f20500cb310 msgr2=0x7f20500cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:02.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.463+0000 7f20557be700 1 -- 172.21.15.49:0/3862664197 shutdown_connections 2023-11-30T17:08:02.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.463+0000 7f20557be700 1 -- 172.21.15.49:0/3862664197 wait complete. 2023-11-30T17:08:02.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.465+0000 7f20557be700 1 Processor -- start 2023-11-30T17:08:02.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.465+0000 7f20557be700 1 -- start start 2023-11-30T17:08:02.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.465+0000 7f20557be700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2050098d10 0x7f2050156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:02.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.465+0000 7f20557be700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20500c6190 0x7f20500b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:02.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.465+0000 7f20557be700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2050158320 0x7f20500b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:02.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.465+0000 7f20557be700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20500c40f0 con 0x7f2050098d10 2023-11-30T17:08:02.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.465+0000 7f20557be700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2050148cc0 con 0x7f20500c6190 2023-11-30T17:08:02.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.465+0000 7f20557be700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2050155b00 con 0x7f2050158320 2023-11-30T17:08:02.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.465+0000 7f204effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2050098d10 0x7f2050156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:02.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.465+0000 7f204effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2050098d10 0x7f2050156530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39582/0 (socket says 172.21.15.49:39582) 2023-11-30T17:08:02.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.466+0000 7f204effd700 1 -- 172.21.15.49:0/3803890336 learned_addr learned my addr 172.21.15.49:0/3803890336 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:02.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.466+0000 7f204f7fe700 1 --2- 172.21.15.49:0/3803890336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2050158320 0x7f20500b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:02.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.466+0000 7f204e7fc700 1 --2- 172.21.15.49:0/3803890336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20500c6190 0x7f20500b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:02.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.466+0000 7f204effd700 1 -- 172.21.15.49:0/3803890336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2050158320 msgr2=0x7f20500b10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:02.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.466+0000 7f204effd700 1 --2- 172.21.15.49:0/3803890336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2050158320 0x7f20500b10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:02.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.466+0000 7f204effd700 1 -- 172.21.15.49:0/3803890336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20500c6190 msgr2=0x7f20500b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:02.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.466+0000 7f204effd700 1 --2- 172.21.15.49:0/3803890336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20500c6190 0x7f20500b0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:02.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.466+0000 7f204effd700 1 -- 172.21.15.49:0/3803890336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2040009a20 con 0x7f2050098d10 2023-11-30T17:08:02.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.466+0000 7f204e7fc700 1 --2- 172.21.15.49:0/3803890336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20500c6190 0x7f20500b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:08:02.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.466+0000 7f204effd700 1 --2- 172.21.15.49:0/3803890336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2050098d10 0x7f2050156530 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f204800e950 tx=0x7f2048009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:02.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.466+0000 7f2046ffd700 1 -- 172.21.15.49:0/3803890336 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204800c6a0 con 0x7f2050098d10 2023-11-30T17:08:02.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.466+0000 7f2046ffd700 1 -- 172.21.15.49:0/3803890336 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204800c800 con 0x7f2050098d10 2023-11-30T17:08:02.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.466+0000 7f20557be700 1 -- 172.21.15.49:0/3803890336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2050154ef0 con 0x7f2050098d10 2023-11-30T17:08:02.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.466+0000 7f2046ffd700 1 -- 172.21.15.49:0/3803890336 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204800cb80 con 0x7f2050098d10 2023-11-30T17:08:02.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.466+0000 7f20557be700 1 -- 172.21.15.49:0/3803890336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20501554b0 con 0x7f2050098d10 2023-11-30T17:08:02.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.467+0000 7f20557be700 1 -- 172.21.15.49:0/3803890336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f205006c860 con 0x7f2050098d10 2023-11-30T17:08:02.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.468+0000 7f2046ffd700 1 -- 172.21.15.49:0/3803890336 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f204801b400 con 0x7f2050098d10 2023-11-30T17:08:02.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.468+0000 7f2046ffd700 1 --2- 172.21.15.49:0/3803890336 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f203005f150 0x7f2030061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:02.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.468+0000 7f2046ffd700 1 -- 172.21.15.49:0/3803890336 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f204807a470 con 0x7f2050098d10 2023-11-30T17:08:02.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.468+0000 7f204e7fc700 1 --2- 172.21.15.49:0/3803890336 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f203005f150 0x7f2030061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:02.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.469+0000 7f204e7fc700 1 --2- 172.21.15.49:0/3803890336 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f203005f150 0x7f2030061610 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f2038007fd0 tx=0x7f2038009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:02.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.472+0000 7f2046ffd700 1 -- 172.21.15.49:0/3803890336 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f204804bae0 con 0x7f2050098d10 2023-11-30T17:08:02.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.644+0000 7f20557be700 1 -- 172.21.15.49:0/3803890336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f20500c66c0 con 0x7f2050098d10 2023-11-30T17:08:02.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.645+0000 7f2046ffd700 1 -- 172.21.15.49:0/3803890336 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f20480160a0 con 0x7f2050098d10 2023-11-30T17:08:02.647 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T17:08:02.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.646+0000 7f20557be700 1 -- 172.21.15.49:0/3803890336 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f203005f150 msgr2=0x7f2030061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:02.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.646+0000 7f20557be700 1 --2- 172.21.15.49:0/3803890336 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f203005f150 0x7f2030061610 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f2038007fd0 tx=0x7f2038009040).stop 2023-11-30T17:08:02.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.646+0000 7f20557be700 1 -- 172.21.15.49:0/3803890336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2050098d10 msgr2=0x7f2050156530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:02.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.646+0000 7f20557be700 1 --2- 172.21.15.49:0/3803890336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2050098d10 0x7f2050156530 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f204800e950 tx=0x7f2048009060).stop 2023-11-30T17:08:02.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.647+0000 7f20557be700 1 -- 172.21.15.49:0/3803890336 shutdown_connections 2023-11-30T17:08:02.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.647+0000 7f20557be700 1 --2- 172.21.15.49:0/3803890336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2050158320 0x7f20500b10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:02.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.647+0000 7f20557be700 1 --2- 172.21.15.49:0/3803890336 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f203005f150 0x7f2030061610 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:02.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.647+0000 7f20557be700 1 --2- 172.21.15.49:0/3803890336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2050098d10 0x7f2050156530 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:02.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.647+0000 7f20557be700 1 --2- 172.21.15.49:0/3803890336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20500c6190 0x7f20500b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:02.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.647+0000 7f20557be700 1 -- 172.21.15.49:0/3803890336 >> 172.21.15.49:0/3803890336 conn(0x7f20500cb310 msgr2=0x7f20500ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:02.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.647+0000 7f20557be700 1 -- 172.21.15.49:0/3803890336 shutdown_connections 2023-11-30T17:08:02.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.647+0000 7f20557be700 1 -- 172.21.15.49:0/3803890336 wait complete. 2023-11-30T17:08:02.661 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-30T17:08:02.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.776+0000 7fb7ee83a700 1 Processor -- start 2023-11-30T17:08:02.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.776+0000 7fb7ee83a700 1 -- start start 2023-11-30T17:08:02.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.777+0000 7fb7ee83a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb7e81544e0 0x7fb7e81548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:02.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.777+0000 7fb7ee83a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e80c69a0 con 0x7fb7e80c6e30 2023-11-30T17:08:02.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.777+0000 7fb7ee83a700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e80c13a0 con 0x7fb7e806a610 2023-11-30T17:08:02.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.777+0000 7fb7ee83a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e80c1680 con 0x7fb7e81544e0 2023-11-30T17:08:02.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.777+0000 7fb7ecdd7700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb7e80c6e30 0x7fb7e80a8000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49330/0 (socket says 172.21.15.49:49330) 2023-11-30T17:08:02.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.777+0000 7fb7ecdd7700 1 -- 172.21.15.49:0/4176783588 learned_addr learned my addr 172.21.15.49:0/4176783588 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:08:02.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.777+0000 7fb7e7fff700 1 --2- 172.21.15.49:0/4176783588 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb7e81544e0 0x7fb7e81548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:02.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.778+0000 7fb7e6ffd700 1 -- 172.21.15.49:0/4176783588 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569366157 0 0) 0x7fb7e80c69a0 con 0x7fb7e80c6e30 2023-11-30T17:08:02.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.778+0000 7fb7e6ffd700 1 -- 172.21.15.49:0/4176783588 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7d40033f0 con 0x7fb7e80c6e30 2023-11-30T17:08:02.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.778+0000 7fb7e6ffd700 1 -- 172.21.15.49:0/4176783588 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593477922 0 0) 0x7fb7e80c13a0 con 0x7fb7e806a610 2023-11-30T17:08:02.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.778+0000 7fb7e6ffd700 1 -- 172.21.15.49:0/4176783588 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7e80c69a0 con 0x7fb7e806a610 2023-11-30T17:08:02.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.778+0000 7fb7e7fff700 1 -- 172.21.15.49:0/4176783588 >> v1:172.21.15.115:6789/0 conn(0x7fb7e806a610 legacy=0x7fb7e80c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:02.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.778+0000 7fb7e7fff700 1 -- 172.21.15.49:0/4176783588 >> v1:172.21.15.49:6789/0 conn(0x7fb7e80c6e30 legacy=0x7fb7e80a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:02.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.778+0000 7fb7e7fff700 1 -- 172.21.15.49:0/4176783588 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e80c6630 con 0x7fb7e81544e0 2023-11-30T17:08:02.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.778+0000 7fb7e7fff700 1 --2- 172.21.15.49:0/4176783588 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb7e81544e0 0x7fb7e81548c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb7d8009760 tx=0x7fb7d8006f40).ready entity=mon.2 client_cookie=6bfa710c5e3fca1e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:02.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.778+0000 7fb7e6ffd700 1 -- 172.21.15.49:0/4176783588 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8005880 con 0x7fb7e81544e0 2023-11-30T17:08:02.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.778+0000 7fb7e6ffd700 1 -- 172.21.15.49:0/4176783588 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d80059e0 con 0x7fb7e81544e0 2023-11-30T17:08:02.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.778+0000 7fb7e6ffd700 1 -- 172.21.15.49:0/4176783588 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8005d60 con 0x7fb7e81544e0 2023-11-30T17:08:02.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.779+0000 7fb7ee83a700 1 -- 172.21.15.49:0/4176783588 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb7e81544e0 msgr2=0x7fb7e81548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:02.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.779+0000 7fb7ee83a700 1 --2- 172.21.15.49:0/4176783588 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb7e81544e0 0x7fb7e81548c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb7d8009760 tx=0x7fb7d8006f40).stop 2023-11-30T17:08:02.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.779+0000 7fb7ee83a700 1 -- 172.21.15.49:0/4176783588 shutdown_connections 2023-11-30T17:08:02.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.779+0000 7fb7ee83a700 1 --2- 172.21.15.49:0/4176783588 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb7e81544e0 0x7fb7e81548c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:02.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.779+0000 7fb7ee83a700 1 -- 172.21.15.49:0/4176783588 >> 172.21.15.49:0/4176783588 conn(0x7fb7e8085020 msgr2=0x7fb7e8094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:02.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.779+0000 7fb7ee83a700 1 -- 172.21.15.49:0/4176783588 shutdown_connections 2023-11-30T17:08:02.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.779+0000 7fb7ee83a700 1 -- 172.21.15.49:0/4176783588 wait complete. 2023-11-30T17:08:02.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.780+0000 7fb7ee83a700 1 Processor -- start 2023-11-30T17:08:02.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.780+0000 7fb7ee83a700 1 -- start start 2023-11-30T17:08:02.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.781+0000 7fb7ee83a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb7e806a610 0x7fb7e8145e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:02.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.781+0000 7fb7ee83a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7e80c6e30 0x7fb7e8097230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:02.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.781+0000 7fb7ee83a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7e81544e0 0x7fb7e8097720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:02.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.781+0000 7fb7ee83a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e8153520 con 0x7fb7e81544e0 2023-11-30T17:08:02.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.781+0000 7fb7ee83a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e8097da0 con 0x7fb7e80c6e30 2023-11-30T17:08:02.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.781+0000 7fb7ee83a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e8098080 con 0x7fb7e806a610 2023-11-30T17:08:02.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.781+0000 7fb7ecdd7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7e81544e0 0x7fb7e8097720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:02.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.781+0000 7fb7ecdd7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7e81544e0 0x7fb7e8097720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39586/0 (socket says 172.21.15.49:39586) 2023-11-30T17:08:02.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.781+0000 7fb7e7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb7e806a610 0x7fb7e8145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:02.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.781+0000 7fb7ecdd7700 1 -- 172.21.15.49:0/892466473 learned_addr learned my addr 172.21.15.49:0/892466473 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:02.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.781+0000 7fb7e77fe700 1 --2- 172.21.15.49:0/892466473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7e80c6e30 0x7fb7e8097230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:02.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.781+0000 7fb7ecdd7700 1 -- 172.21.15.49:0/892466473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb7e806a610 msgr2=0x7fb7e8145e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:02.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.781+0000 7fb7ecdd7700 1 --2- 172.21.15.49:0/892466473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb7e806a610 0x7fb7e8145e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:02.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.781+0000 7fb7ecdd7700 1 -- 172.21.15.49:0/892466473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7e80c6e30 msgr2=0x7fb7e8097230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:02.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.781+0000 7fb7ecdd7700 1 --2- 172.21.15.49:0/892466473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7e80c6e30 0x7fb7e8097230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:02.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.781+0000 7fb7ecdd7700 1 -- 172.21.15.49:0/892466473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d8009250 con 0x7fb7e81544e0 2023-11-30T17:08:02.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.781+0000 7fb7e7fff700 1 --2- 172.21.15.49:0/892466473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb7e806a610 0x7fb7e8145e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:08:02.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.781+0000 7fb7ecdd7700 1 --2- 172.21.15.49:0/892466473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7e81544e0 0x7fb7e8097720 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fb7e0001560 tx=0x7fb7e00015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:02.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.781+0000 7fb7dffff700 1 -- 172.21.15.49:0/892466473 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0005d30 con 0x7fb7e81544e0 2023-11-30T17:08:02.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.781+0000 7fb7dffff700 1 -- 172.21.15.49:0/892466473 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e0005e90 con 0x7fb7e81544e0 2023-11-30T17:08:02.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.781+0000 7fb7ee83a700 1 -- 172.21.15.49:0/892466473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e8098360 con 0x7fb7e81544e0 2023-11-30T17:08:02.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.781+0000 7fb7dffff700 1 -- 172.21.15.49:0/892466473 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0007320 con 0x7fb7e81544e0 2023-11-30T17:08:02.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.782+0000 7fb7ee83a700 1 -- 172.21.15.49:0/892466473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e8098920 con 0x7fb7e81544e0 2023-11-30T17:08:02.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.783+0000 7fb7ee83a700 1 -- 172.21.15.49:0/892466473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e8098b40 con 0x7fb7e81544e0 2023-11-30T17:08:02.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.783+0000 7fb7dffff700 1 -- 172.21.15.49:0/892466473 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb7e0007690 con 0x7fb7e81544e0 2023-11-30T17:08:02.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.783+0000 7fb7dffff700 1 --2- 172.21.15.49:0/892466473 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb7c805f180 0x7fb7c8061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:02.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.783+0000 7fb7dffff700 1 -- 172.21.15.49:0/892466473 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fb7e0079d50 con 0x7fb7e81544e0 2023-11-30T17:08:02.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.783+0000 7fb7e7fff700 1 --2- 172.21.15.49:0/892466473 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb7c805f180 0x7fb7c8061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:02.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.784+0000 7fb7e7fff700 1 --2- 172.21.15.49:0/892466473 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb7c805f180 0x7fb7c8061640 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fb7d8007fd0 tx=0x7fb7d8015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:02.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.788+0000 7fb7dffff700 1 -- 172.21.15.49:0/892466473 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb7e007d030 con 0x7fb7e81544e0 2023-11-30T17:08:02.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.965+0000 7fb7ee83a700 1 -- 172.21.15.49:0/892466473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb7e80c6250 con 0x7fb7e81544e0 2023-11-30T17:08:02.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.965+0000 7fb7dffff700 1 -- 172.21.15.49:0/892466473 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+143 (secure 0 0 0) 0x7fb7e004b370 con 0x7fb7e81544e0 2023-11-30T17:08:02.968 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:08:02.968 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-11-30T17:08:02.968 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:08:02.968 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2023-11-30T17:08:02.968 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "device_health_metrics" 2023-11-30T17:08:02.968 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:08:02.968 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:08:02.968 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 2, 2023-11-30T17:08:02.968 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "rbd" 2023-11-30T17:08:02.968 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:08:02.968 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-11-30T17:08:02.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.967+0000 7fb7ee83a700 1 -- 172.21.15.49:0/892466473 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb7c805f180 msgr2=0x7fb7c8061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:02.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.967+0000 7fb7ee83a700 1 --2- 172.21.15.49:0/892466473 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb7c805f180 0x7fb7c8061640 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fb7d8007fd0 tx=0x7fb7d8015000).stop 2023-11-30T17:08:02.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.967+0000 7fb7ee83a700 1 -- 172.21.15.49:0/892466473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7e81544e0 msgr2=0x7fb7e8097720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:02.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.967+0000 7fb7ee83a700 1 --2- 172.21.15.49:0/892466473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7e81544e0 0x7fb7e8097720 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fb7e0001560 tx=0x7fb7e00015b0).stop 2023-11-30T17:08:02.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.967+0000 7fb7ee83a700 1 -- 172.21.15.49:0/892466473 shutdown_connections 2023-11-30T17:08:02.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.967+0000 7fb7ee83a700 1 --2- 172.21.15.49:0/892466473 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb7c805f180 0x7fb7c8061640 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:02.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.967+0000 7fb7ee83a700 1 --2- 172.21.15.49:0/892466473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7e81544e0 0x7fb7e8097720 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:02.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.967+0000 7fb7ee83a700 1 --2- 172.21.15.49:0/892466473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb7e806a610 0x7fb7e8145e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:02.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.967+0000 7fb7ee83a700 1 --2- 172.21.15.49:0/892466473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7e80c6e30 0x7fb7e8097230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:02.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.967+0000 7fb7ee83a700 1 -- 172.21.15.49:0/892466473 >> 172.21.15.49:0/892466473 conn(0x7fb7e8085020 msgr2=0x7fb7e80c9890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:02.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.967+0000 7fb7ee83a700 1 -- 172.21.15.49:0/892466473 shutdown_connections 2023-11-30T17:08:02.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:02.967+0000 7fb7ee83a700 1 -- 172.21.15.49:0/892466473 wait complete. 2023-11-30T17:08:02.981 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-30T17:08:02.981 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-11-30T17:08:03.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.101+0000 7f0160a81700 1 Processor -- start 2023-11-30T17:08:03.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.101+0000 7f0160a81700 1 -- start start 2023-11-30T17:08:03.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.102+0000 7f0160a81700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f015c0c3ac0 0x7f015c13aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:03.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.102+0000 7f0160a81700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f015c0c2a60 0x7f015c0c2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:03.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.102+0000 7f0160a81700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f015c0c22f0 con 0x7f015c13a620 2023-11-30T17:08:03.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.102+0000 7f0160a81700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f015c0c33e0 con 0x7f015c0c3ac0 2023-11-30T17:08:03.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.102+0000 7f0160a81700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015c0c25d0 con 0x7f015c0c2a60 2023-11-30T17:08:03.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.102+0000 7f015bfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f015c0c2a60 0x7f015c0c2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:03.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.102+0000 7f015bfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f015c0c2a60 0x7f015c0c2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:42388/0 (socket says 172.21.15.49:42388) 2023-11-30T17:08:03.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.102+0000 7f015affd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f015c0c3ac0 0x7f015c13aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:03.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.102+0000 7f015bfff700 1 -- 172.21.15.49:0/3070150818 learned_addr learned my addr 172.21.15.49:0/3070150818 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:03.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.103+0000 7f015bfff700 1 -- 172.21.15.49:0/3070150818 >> v2:172.21.15.115:3300/0 conn(0x7f015c0c3ac0 msgr2=0x7f015c13aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:03.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.103+0000 7f015bfff700 1 --2- 172.21.15.49:0/3070150818 >> v2:172.21.15.115:3300/0 conn(0x7f015c0c3ac0 0x7f015c13aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:03.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.103+0000 7f015bfff700 1 -- 172.21.15.49:0/3070150818 >> v1:172.21.15.115:6789/0 conn(0x7f015c13a620 legacy=0x7f015c0bcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:03.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.103+0000 7f015bfff700 1 -- 172.21.15.49:0/3070150818 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f015c0bd480 con 0x7f015c0c2a60 2023-11-30T17:08:03.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.103+0000 7f015bfff700 1 --2- 172.21.15.49:0/3070150818 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f015c0c2a60 0x7f015c0c2ef0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f015400d1a0 tx=0x7f015400ba50).ready entity=mon.2 client_cookie=bd7864ae6055357b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:03.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.103+0000 7f015a7fc700 1 -- 172.21.15.49:0/3070150818 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0154010070 con 0x7f015c0c2a60 2023-11-30T17:08:03.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.103+0000 7f015a7fc700 1 -- 172.21.15.49:0/3070150818 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015400de10 con 0x7f015c0c2a60 2023-11-30T17:08:03.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.103+0000 7f015a7fc700 1 -- 172.21.15.49:0/3070150818 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015400b2e0 con 0x7f015c0c2a60 2023-11-30T17:08:03.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.103+0000 7f0160a81700 1 -- 172.21.15.49:0/3070150818 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f015c0c2a60 msgr2=0x7f015c0c2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:03.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.103+0000 7f0160a81700 1 --2- 172.21.15.49:0/3070150818 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f015c0c2a60 0x7f015c0c2ef0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f015400d1a0 tx=0x7f015400ba50).stop 2023-11-30T17:08:03.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.104+0000 7f0160a81700 1 -- 172.21.15.49:0/3070150818 shutdown_connections 2023-11-30T17:08:03.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.104+0000 7f0160a81700 1 --2- 172.21.15.49:0/3070150818 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f015c0c2a60 0x7f015c0c2ef0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:03.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.104+0000 7f0160a81700 1 --2- 172.21.15.49:0/3070150818 >> v2:172.21.15.115:3300/0 conn(0x7f015c0c3ac0 0x7f015c13aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:03.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.104+0000 7f0160a81700 1 -- 172.21.15.49:0/3070150818 >> 172.21.15.49:0/3070150818 conn(0x7f015c0642e0 msgr2=0x7f015c0c7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:03.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.104+0000 7f0160a81700 1 -- 172.21.15.49:0/3070150818 shutdown_connections 2023-11-30T17:08:03.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.104+0000 7f0160a81700 1 -- 172.21.15.49:0/3070150818 wait complete. 2023-11-30T17:08:03.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.105+0000 7f0160a81700 1 Processor -- start 2023-11-30T17:08:03.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.105+0000 7f0160a81700 1 -- start start 2023-11-30T17:08:03.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.106+0000 7f0160a81700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f015c0c2a60 0x7f015c0a8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:03.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.106+0000 7f0160a81700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f015c0c3ac0 0x7f015c150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:03.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.106+0000 7f0160a81700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f015c13a620 0x7f015c0a7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:03.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.106+0000 7f0160a81700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015c0a89f0 con 0x7f015c0c3ac0 2023-11-30T17:08:03.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.106+0000 7f0160a81700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015c0a7de0 con 0x7f015c13a620 2023-11-30T17:08:03.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.106+0000 7f0160a81700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015c0a80c0 con 0x7f015c0c2a60 2023-11-30T17:08:03.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.106+0000 7f015affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f015c0c3ac0 0x7f015c150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:03.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.106+0000 7f015affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f015c0c3ac0 0x7f015c150af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39594/0 (socket says 172.21.15.49:39594) 2023-11-30T17:08:03.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.106+0000 7f015affd700 1 -- 172.21.15.49:0/3625285234 learned_addr learned my addr 172.21.15.49:0/3625285234 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:03.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.106+0000 7f015b7fe700 1 --2- 172.21.15.49:0/3625285234 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f015c0c2a60 0x7f015c0a8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:03.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.106+0000 7f015bfff700 1 --2- 172.21.15.49:0/3625285234 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f015c13a620 0x7f015c0a7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:03.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.106+0000 7f015affd700 1 -- 172.21.15.49:0/3625285234 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f015c0c2a60 msgr2=0x7f015c0a8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:03.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.106+0000 7f015affd700 1 --2- 172.21.15.49:0/3625285234 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f015c0c2a60 0x7f015c0a8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:03.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.106+0000 7f015affd700 1 -- 172.21.15.49:0/3625285234 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f015c13a620 msgr2=0x7f015c0a7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:03.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.106+0000 7f015affd700 1 --2- 172.21.15.49:0/3625285234 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f015c13a620 0x7f015c0a7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:03.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.106+0000 7f015affd700 1 -- 172.21.15.49:0/3625285234 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f015400bcf0 con 0x7f015c0c3ac0 2023-11-30T17:08:03.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.106+0000 7f015affd700 1 --2- 172.21.15.49:0/3625285234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f015c0c3ac0 0x7f015c150af0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f015000e900 tx=0x7f0150009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:03.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.106+0000 7f01437fe700 1 -- 172.21.15.49:0/3625285234 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0150012600 con 0x7f015c0c3ac0 2023-11-30T17:08:03.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.106+0000 7f01437fe700 1 -- 172.21.15.49:0/3625285234 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0150012760 con 0x7f015c0c3ac0 2023-11-30T17:08:03.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.106+0000 7f0160a81700 1 -- 172.21.15.49:0/3625285234 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f015c0a83a0 con 0x7f015c0c3ac0 2023-11-30T17:08:03.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.106+0000 7f01437fe700 1 -- 172.21.15.49:0/3625285234 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0150012ae0 con 0x7f015c0c3ac0 2023-11-30T17:08:03.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.107+0000 7f0160a81700 1 -- 172.21.15.49:0/3625285234 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f015c160d20 con 0x7f015c0c3ac0 2023-11-30T17:08:03.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.108+0000 7f0160a81700 1 -- 172.21.15.49:0/3625285234 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f015c06c7c0 con 0x7f015c0c3ac0 2023-11-30T17:08:03.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.108+0000 7f01437fe700 1 -- 172.21.15.49:0/3625285234 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f015001b400 con 0x7f015c0c3ac0 2023-11-30T17:08:03.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.108+0000 7f01437fe700 1 --2- 172.21.15.49:0/3625285234 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f014805f120 0x7f01480615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:03.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.108+0000 7f01437fe700 1 -- 172.21.15.49:0/3625285234 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f015007a1a0 con 0x7f015c0c3ac0 2023-11-30T17:08:03.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.108+0000 7f015b7fe700 1 --2- 172.21.15.49:0/3625285234 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f014805f120 0x7f01480615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:03.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.109+0000 7f015b7fe700 1 --2- 172.21.15.49:0/3625285234 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f014805f120 0x7f01480615e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f015c066e80 tx=0x7f014c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:03.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.112+0000 7f01437fe700 1 -- 172.21.15.49:0/3625285234 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f015004b760 con 0x7f015c0c3ac0 2023-11-30T17:08:03.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.288+0000 7f0160a81700 1 -- 172.21.15.49:0/3625285234 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f015c06c1a0 con 0x7f015c0c3ac0 2023-11-30T17:08:03.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.802+0000 7f01437fe700 1 -- 172.21.15.49:0/3625285234 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 152+0+0 (secure 0 0 0) 0x7f015004ed80 con 0x7f015c0c3ac0 2023-11-30T17:08:03.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.805+0000 7f0160a81700 1 -- 172.21.15.49:0/3625285234 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f014805f120 msgr2=0x7f01480615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:03.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.805+0000 7f0160a81700 1 --2- 172.21.15.49:0/3625285234 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f014805f120 0x7f01480615e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f015c066e80 tx=0x7f014c009040).stop 2023-11-30T17:08:03.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.805+0000 7f0160a81700 1 -- 172.21.15.49:0/3625285234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f015c0c3ac0 msgr2=0x7f015c150af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:03.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.805+0000 7f0160a81700 1 --2- 172.21.15.49:0/3625285234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f015c0c3ac0 0x7f015c150af0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f015000e900 tx=0x7f0150009060).stop 2023-11-30T17:08:03.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.805+0000 7f0160a81700 1 -- 172.21.15.49:0/3625285234 shutdown_connections 2023-11-30T17:08:03.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.805+0000 7f0160a81700 1 --2- 172.21.15.49:0/3625285234 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f015c13a620 0x7f015c0a7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:03.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.805+0000 7f0160a81700 1 --2- 172.21.15.49:0/3625285234 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f015c0c2a60 0x7f015c0a8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:03.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.805+0000 7f0160a81700 1 --2- 172.21.15.49:0/3625285234 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f014805f120 0x7f01480615e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:03.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.805+0000 7f0160a81700 1 --2- 172.21.15.49:0/3625285234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f015c0c3ac0 0x7f015c150af0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:03.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.805+0000 7f0160a81700 1 -- 172.21.15.49:0/3625285234 >> 172.21.15.49:0/3625285234 conn(0x7f015c0642e0 msgr2=0x7f015c069420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:03.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.806+0000 7f0160a81700 1 -- 172.21.15.49:0/3625285234 shutdown_connections 2023-11-30T17:08:03.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.807+0000 7f0160a81700 1 -- 172.21.15.49:0/3625285234 wait complete. 2023-11-30T17:08:03.814 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2023-11-30T17:08:03.827 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-30T17:08:03.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.951+0000 7fc254425700 1 Processor -- start 2023-11-30T17:08:03.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.951+0000 7fc254425700 1 -- start start 2023-11-30T17:08:03.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.952+0000 7fc254425700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc24c0c6190 0x7fc24c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:03.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.952+0000 7fc254425700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc24c158320 0x7fc24c1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:03.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.952+0000 7fc254425700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc24c158cc0 con 0x7fc24c098d10 2023-11-30T17:08:03.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.952+0000 7fc254425700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc24c0c72d0 con 0x7fc24c158320 2023-11-30T17:08:03.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.952+0000 7fc254425700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c064570 con 0x7fc24c0c6190 2023-11-30T17:08:03.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.952+0000 7fc2529c2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc24c158320 0x7fc24c1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:03.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.952+0000 7fc2521c1700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc24c098d10 0x7fc24c063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49346/0 (socket says 172.21.15.49:49346) 2023-11-30T17:08:03.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.952+0000 7fc2521c1700 1 -- 172.21.15.49:0/1663620078 learned_addr learned my addr 172.21.15.49:0/1663620078 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:08:03.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.953+0000 7fc2519c0700 1 --2- 172.21.15.49:0/1663620078 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc24c0c6190 0x7fc24c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:03.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.953+0000 7fc2529c2700 1 -- 172.21.15.49:0/1663620078 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc24c0c6190 msgr2=0x7fc24c0c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:03.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.953+0000 7fc2529c2700 1 --2- 172.21.15.49:0/1663620078 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc24c0c6190 0x7fc24c0c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:03.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.953+0000 7fc2529c2700 1 -- 172.21.15.49:0/1663620078 >> v1:172.21.15.49:6789/0 conn(0x7fc24c098d10 legacy=0x7fc24c063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:03.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.953+0000 7fc2511bf700 1 -- 172.21.15.49:0/1663620078 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1774814742 0 0) 0x7fc244001490 con 0x7fc24c098d10 2023-11-30T17:08:03.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.953+0000 7fc2529c2700 1 -- 172.21.15.49:0/1663620078 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc24c154bc0 con 0x7fc24c158320 2023-11-30T17:08:03.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.953+0000 7fc2529c2700 1 --2- 172.21.15.49:0/1663620078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc24c158320 0x7fc24c1587d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7fc23c009760 tx=0x7fc23c009060).ready entity=mon.0 client_cookie=8b36e16b533985eb server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:03.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.953+0000 7fc2511bf700 1 -- 172.21.15.49:0/1663620078 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c00b580 con 0x7fc24c158320 2023-11-30T17:08:03.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.953+0000 7fc2511bf700 1 -- 172.21.15.49:0/1663620078 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23c00b6e0 con 0x7fc24c158320 2023-11-30T17:08:03.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.953+0000 7fc2511bf700 1 -- 172.21.15.49:0/1663620078 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c00ba60 con 0x7fc24c158320 2023-11-30T17:08:03.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.954+0000 7fc254425700 1 -- 172.21.15.49:0/1663620078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc24c158320 msgr2=0x7fc24c1587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:03.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.954+0000 7fc254425700 1 --2- 172.21.15.49:0/1663620078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc24c158320 0x7fc24c1587d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7fc23c009760 tx=0x7fc23c009060).stop 2023-11-30T17:08:03.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.954+0000 7fc254425700 1 -- 172.21.15.49:0/1663620078 shutdown_connections 2023-11-30T17:08:03.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.954+0000 7fc254425700 1 --2- 172.21.15.49:0/1663620078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc24c158320 0x7fc24c1587d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:03.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.954+0000 7fc254425700 1 --2- 172.21.15.49:0/1663620078 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc24c0c6190 0x7fc24c0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:03.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.954+0000 7fc254425700 1 -- 172.21.15.49:0/1663620078 >> 172.21.15.49:0/1663620078 conn(0x7fc24c0cb310 msgr2=0x7fc24c0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:03.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.954+0000 7fc254425700 1 -- 172.21.15.49:0/1663620078 shutdown_connections 2023-11-30T17:08:03.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.954+0000 7fc254425700 1 -- 172.21.15.49:0/1663620078 wait complete. 2023-11-30T17:08:03.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.955+0000 7fc254425700 1 Processor -- start 2023-11-30T17:08:03.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.955+0000 7fc254425700 1 -- start start 2023-11-30T17:08:03.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.956+0000 7fc254425700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc24c098d10 0x7fc24c0c3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.956+0000 7fc254425700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc24c0c6190 0x7fc24c152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.956+0000 7fc254425700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc24c158320 0x7fc24c152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.956+0000 7fc254425700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c164350 con 0x7fc24c0c6190 2023-11-30T17:08:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.956+0000 7fc254425700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c153270 con 0x7fc24c158320 2023-11-30T17:08:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.956+0000 7fc254425700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c168850 con 0x7fc24c098d10 2023-11-30T17:08:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.956+0000 7fc2519c0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc24c0c6190 0x7fc24c152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.956+0000 7fc2519c0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc24c0c6190 0x7fc24c152890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39626/0 (socket says 172.21.15.49:39626) 2023-11-30T17:08:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.956+0000 7fc2519c0700 1 -- 172.21.15.49:0/3823595383 learned_addr learned my addr 172.21.15.49:0/3823595383 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.956+0000 7fc2529c2700 1 --2- 172.21.15.49:0/3823595383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc24c158320 0x7fc24c152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.956+0000 7fc2521c1700 1 --2- 172.21.15.49:0/3823595383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc24c098d10 0x7fc24c0c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.956+0000 7fc2519c0700 1 -- 172.21.15.49:0/3823595383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc24c098d10 msgr2=0x7fc24c0c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.956+0000 7fc2519c0700 1 --2- 172.21.15.49:0/3823595383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc24c098d10 0x7fc24c0c3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:03.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.956+0000 7fc2519c0700 1 -- 172.21.15.49:0/3823595383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc24c158320 msgr2=0x7fc24c152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:03.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.956+0000 7fc2519c0700 1 --2- 172.21.15.49:0/3823595383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc24c158320 0x7fc24c152d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:03.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.956+0000 7fc2519c0700 1 -- 172.21.15.49:0/3823595383 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23c0092a0 con 0x7fc24c0c6190 2023-11-30T17:08:03.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.956+0000 7fc2519c0700 1 --2- 172.21.15.49:0/3823595383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc24c0c6190 0x7fc24c152890 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fc24000d890 tx=0x7fc240008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:03.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.956+0000 7fc24a7fc700 1 -- 172.21.15.49:0/3823595383 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24000f520 con 0x7fc24c0c6190 2023-11-30T17:08:03.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.956+0000 7fc24a7fc700 1 -- 172.21.15.49:0/3823595383 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24000f680 con 0x7fc24c0c6190 2023-11-30T17:08:03.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.956+0000 7fc254425700 1 -- 172.21.15.49:0/3823595383 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc24c164b80 con 0x7fc24c0c6190 2023-11-30T17:08:03.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.956+0000 7fc24a7fc700 1 -- 172.21.15.49:0/3823595383 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24000fa00 con 0x7fc24c0c6190 2023-11-30T17:08:03.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.956+0000 7fc254425700 1 -- 172.21.15.49:0/3823595383 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc24c1645b0 con 0x7fc24c0c6190 2023-11-30T17:08:03.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.958+0000 7fc254425700 1 -- 172.21.15.49:0/3823595383 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc24c164930 con 0x7fc24c0c6190 2023-11-30T17:08:03.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.958+0000 7fc24a7fc700 1 -- 172.21.15.49:0/3823595383 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc240013480 con 0x7fc24c0c6190 2023-11-30T17:08:03.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.958+0000 7fc24a7fc700 1 --2- 172.21.15.49:0/3823595383 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc23805f120 0x7fc2380615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:03.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.958+0000 7fc24a7fc700 1 -- 172.21.15.49:0/3823595383 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5639+0+0 (secure 0 0 0) 0x7fc240079b00 con 0x7fc24c0c6190 2023-11-30T17:08:03.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.958+0000 7fc2521c1700 1 --2- 172.21.15.49:0/3823595383 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc23805f120 0x7fc2380615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:03.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.959+0000 7fc2521c1700 1 --2- 172.21.15.49:0/3823595383 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc23805f120 0x7fc2380615e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fc24c0adc10 tx=0x7fc2440014d0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:03.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:03.963+0000 7fc24a7fc700 1 -- 172.21.15.49:0/3823595383 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc24004af50 con 0x7fc24c0c6190 2023-11-30T17:08:04.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.135+0000 7fc254425700 1 -- 172.21.15.49:0/3823595383 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc24c0c5530 con 0x7fc24c0c6190 2023-11-30T17:08:04.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.808+0000 7fc24a7fc700 1 -- 172.21.15.49:0/3823595383 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc24004e570 con 0x7fc24c0c6190 2023-11-30T17:08:04.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.819+0000 7fc254425700 1 -- 172.21.15.49:0/3823595383 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc23805f120 msgr2=0x7fc2380615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:04.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.820+0000 7fc254425700 1 --2- 172.21.15.49:0/3823595383 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc23805f120 0x7fc2380615e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fc24c0adc10 tx=0x7fc2440014d0).stop 2023-11-30T17:08:04.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.820+0000 7fc254425700 1 -- 172.21.15.49:0/3823595383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc24c0c6190 msgr2=0x7fc24c152890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:04.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.820+0000 7fc254425700 1 --2- 172.21.15.49:0/3823595383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc24c0c6190 0x7fc24c152890 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fc24000d890 tx=0x7fc240008040).stop 2023-11-30T17:08:04.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.820+0000 7fc254425700 1 -- 172.21.15.49:0/3823595383 shutdown_connections 2023-11-30T17:08:04.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.820+0000 7fc254425700 1 --2- 172.21.15.49:0/3823595383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc24c158320 0x7fc24c152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:04.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.820+0000 7fc254425700 1 --2- 172.21.15.49:0/3823595383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc24c098d10 0x7fc24c0c3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:04.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.820+0000 7fc254425700 1 --2- 172.21.15.49:0/3823595383 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc23805f120 0x7fc2380615e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:04.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.820+0000 7fc254425700 1 --2- 172.21.15.49:0/3823595383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc24c0c6190 0x7fc24c152890 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:04.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.820+0000 7fc254425700 1 -- 172.21.15.49:0/3823595383 >> 172.21.15.49:0/3823595383 conn(0x7fc24c0cb310 msgr2=0x7fc24c1534c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:04.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.821+0000 7fc254425700 1 -- 172.21.15.49:0/3823595383 shutdown_connections 2023-11-30T17:08:04.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.821+0000 7fc254425700 1 -- 172.21.15.49:0/3823595383 wait complete. 2023-11-30T17:08:04.835 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2023-11-30T17:08:04.850 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-30T17:08:04.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.971+0000 7fd4ad695700 1 Processor -- start 2023-11-30T17:08:04.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.971+0000 7fd4ad695700 1 -- start start 2023-11-30T17:08:04.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.972+0000 7fd4ad695700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd4a80c6190 0x7fd4a80c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:04.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.972+0000 7fd4ad695700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a80c72d0 con 0x7fd4a8158320 2023-11-30T17:08:04.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.972+0000 7fd4ad695700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a8064570 con 0x7fd4a8098d10 2023-11-30T17:08:04.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.972+0000 7fd4ad695700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a8154bc0 con 0x7fd4a80c6190 2023-11-30T17:08:04.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.972+0000 7fd4a67fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd4a80c6190 0x7fd4a80c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:04.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.972+0000 7fd4a77fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd4a8158320 0x7fd4a80a80f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49358/0 (socket says 172.21.15.49:49358) 2023-11-30T17:08:04.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.972+0000 7fd4a77fe700 1 -- 172.21.15.49:0/149192940 learned_addr learned my addr 172.21.15.49:0/149192940 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:08:04.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.973+0000 7fd4a67fc700 1 -- 172.21.15.49:0/149192940 >> v1:172.21.15.115:6789/0 conn(0x7fd4a8098d10 legacy=0x7fd4a8063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:04.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.973+0000 7fd4a67fc700 1 -- 172.21.15.49:0/149192940 >> v1:172.21.15.49:6789/0 conn(0x7fd4a8158320 legacy=0x7fd4a80a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:04.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.973+0000 7fd4a5ffb700 1 -- 172.21.15.49:0/149192940 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970539867 0 0) 0x7fd4a80c72d0 con 0x7fd4a8158320 2023-11-30T17:08:04.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.973+0000 7fd4a67fc700 1 -- 172.21.15.49:0/149192940 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a80c66c0 con 0x7fd4a80c6190 2023-11-30T17:08:04.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.973+0000 7fd4a67fc700 1 --2- 172.21.15.49:0/149192940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4a80c6190 0x7fd4a80c7760 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7fd490009760 tx=0x7fd490009060).ready entity=mon.0 client_cookie=7780819fcd7c1b13 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:04.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.973+0000 7fd4a5ffb700 1 -- 172.21.15.49:0/149192940 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49000b580 con 0x7fd4a80c6190 2023-11-30T17:08:04.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.973+0000 7fd4a5ffb700 1 -- 172.21.15.49:0/149192940 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49000b6e0 con 0x7fd4a80c6190 2023-11-30T17:08:04.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.973+0000 7fd4a5ffb700 1 -- 172.21.15.49:0/149192940 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49000ba60 con 0x7fd4a80c6190 2023-11-30T17:08:04.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.973+0000 7fd4ad695700 1 -- 172.21.15.49:0/149192940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4a80c6190 msgr2=0x7fd4a80c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:04.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.973+0000 7fd4ad695700 1 --2- 172.21.15.49:0/149192940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4a80c6190 0x7fd4a80c7760 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7fd490009760 tx=0x7fd490009060).stop 2023-11-30T17:08:04.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.973+0000 7fd4ad695700 1 -- 172.21.15.49:0/149192940 shutdown_connections 2023-11-30T17:08:04.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.973+0000 7fd4ad695700 1 --2- 172.21.15.49:0/149192940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4a80c6190 0x7fd4a80c7760 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:04.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.973+0000 7fd4ad695700 1 -- 172.21.15.49:0/149192940 >> 172.21.15.49:0/149192940 conn(0x7fd4a80cb310 msgr2=0x7fd4a80cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:04.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.973+0000 7fd4ad695700 1 -- 172.21.15.49:0/149192940 shutdown_connections 2023-11-30T17:08:04.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.973+0000 7fd4ad695700 1 -- 172.21.15.49:0/149192940 wait complete. 2023-11-30T17:08:04.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.975+0000 7fd4ad695700 1 Processor -- start 2023-11-30T17:08:04.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.975+0000 7fd4ad695700 1 -- start start 2023-11-30T17:08:04.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.975+0000 7fd4ad695700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4a8098d10 0x7fd4a81507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:04.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.975+0000 7fd4ad695700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4a80c6190 0x7fd4a8149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:04.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.975+0000 7fd4ad695700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4a8158320 0x7fd4a8156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:04.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.975+0000 7fd4ad695700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a8149680 con 0x7fd4a80c6190 2023-11-30T17:08:04.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.975+0000 7fd4ad695700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a80a8690 con 0x7fd4a8158320 2023-11-30T17:08:04.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.975+0000 7fd4ad695700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a8150dc0 con 0x7fd4a8098d10 2023-11-30T17:08:04.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.976+0000 7fd4a67fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4a80c6190 0x7fd4a8149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:04.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.976+0000 7fd4a67fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4a80c6190 0x7fd4a8149190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39638/0 (socket says 172.21.15.49:39638) 2023-11-30T17:08:04.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.976+0000 7fd4a67fc700 1 -- 172.21.15.49:0/2022652659 learned_addr learned my addr 172.21.15.49:0/2022652659 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:04.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.976+0000 7fd4a77fe700 1 --2- 172.21.15.49:0/2022652659 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4a8158320 0x7fd4a8156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:04.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.976+0000 7fd4a6ffd700 1 --2- 172.21.15.49:0/2022652659 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4a8098d10 0x7fd4a81507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:04.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.976+0000 7fd4a67fc700 1 -- 172.21.15.49:0/2022652659 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4a8098d10 msgr2=0x7fd4a81507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:04.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.976+0000 7fd4a67fc700 1 --2- 172.21.15.49:0/2022652659 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4a8098d10 0x7fd4a81507a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:04.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.976+0000 7fd4a67fc700 1 -- 172.21.15.49:0/2022652659 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4a8158320 msgr2=0x7fd4a8156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:04.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.976+0000 7fd4a67fc700 1 --2- 172.21.15.49:0/2022652659 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4a8158320 0x7fd4a8156d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:04.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.976+0000 7fd4a67fc700 1 -- 172.21.15.49:0/2022652659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4900092a0 con 0x7fd4a80c6190 2023-11-30T17:08:04.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.976+0000 7fd4a67fc700 1 --2- 172.21.15.49:0/2022652659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4a80c6190 0x7fd4a8149190 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7fd4a80c2360 tx=0x7fd490017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:04.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.976+0000 7fd49effd700 1 -- 172.21.15.49:0/2022652659 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49000b850 con 0x7fd4a80c6190 2023-11-30T17:08:04.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.976+0000 7fd49effd700 1 -- 172.21.15.49:0/2022652659 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49000b9b0 con 0x7fd4a80c6190 2023-11-30T17:08:04.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.976+0000 7fd4ad695700 1 -- 172.21.15.49:0/2022652659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a81510a0 con 0x7fd4a80c6190 2023-11-30T17:08:04.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.976+0000 7fd49effd700 1 -- 172.21.15.49:0/2022652659 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49001b640 con 0x7fd4a80c6190 2023-11-30T17:08:04.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.976+0000 7fd4ad695700 1 -- 172.21.15.49:0/2022652659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a8151660 con 0x7fd4a80c6190 2023-11-30T17:08:04.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.977+0000 7fd4ad695700 1 -- 172.21.15.49:0/2022652659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a80a8820 con 0x7fd4a80c6190 2023-11-30T17:08:04.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.978+0000 7fd49effd700 1 -- 172.21.15.49:0/2022652659 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd49001b9b0 con 0x7fd4a80c6190 2023-11-30T17:08:04.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.978+0000 7fd49effd700 1 --2- 172.21.15.49:0/2022652659 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd48805f120 0x7fd4880615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:04.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.978+0000 7fd49effd700 1 -- 172.21.15.49:0/2022652659 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6021+0+0 (secure 0 0 0) 0x7fd49007bd00 con 0x7fd4a80c6190 2023-11-30T17:08:04.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.978+0000 7fd4a6ffd700 1 --2- 172.21.15.49:0/2022652659 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd48805f120 0x7fd4880615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:04.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.979+0000 7fd4a6ffd700 1 --2- 172.21.15.49:0/2022652659 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd48805f120 0x7fd4880615e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fd4a0003900 tx=0x7fd4a0007d40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:04.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:04.983+0000 7fd49effd700 1 -- 172.21.15.49:0/2022652659 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd49004cf70 con 0x7fd4a80c6190 2023-11-30T17:08:05.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.198+0000 7fd4ad695700 1 -- 172.21.15.49:0/2022652659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd4a806c860 con 0x7fd4a80c6190 2023-11-30T17:08:05.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.203+0000 7fd49effd700 1 -- 172.21.15.49:0/2022652659 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd490050590 con 0x7fd4a80c6190 2023-11-30T17:08:05.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.207+0000 7fd4ad695700 1 -- 172.21.15.49:0/2022652659 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd48805f120 msgr2=0x7fd4880615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:05.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.207+0000 7fd4ad695700 1 --2- 172.21.15.49:0/2022652659 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd48805f120 0x7fd4880615e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fd4a0003900 tx=0x7fd4a0007d40).stop 2023-11-30T17:08:05.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.207+0000 7fd4ad695700 1 -- 172.21.15.49:0/2022652659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4a80c6190 msgr2=0x7fd4a8149190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:05.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.207+0000 7fd4ad695700 1 --2- 172.21.15.49:0/2022652659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4a80c6190 0x7fd4a8149190 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7fd4a80c2360 tx=0x7fd490017000).stop 2023-11-30T17:08:05.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.207+0000 7fd4ad695700 1 -- 172.21.15.49:0/2022652659 shutdown_connections 2023-11-30T17:08:05.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.207+0000 7fd4ad695700 1 --2- 172.21.15.49:0/2022652659 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4a8158320 0x7fd4a8156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:05.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.207+0000 7fd4ad695700 1 --2- 172.21.15.49:0/2022652659 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4a8098d10 0x7fd4a81507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:05.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.207+0000 7fd4ad695700 1 --2- 172.21.15.49:0/2022652659 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd48805f120 0x7fd4880615e0 secure :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0x7fd4a0003900 tx=0x7fd4a0007d40).stop 2023-11-30T17:08:05.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.207+0000 7fd4ad695700 1 --2- 172.21.15.49:0/2022652659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4a80c6190 0x7fd4a8149190 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:05.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.207+0000 7fd4ad695700 1 -- 172.21.15.49:0/2022652659 >> 172.21.15.49:0/2022652659 conn(0x7fd4a80cb310 msgr2=0x7fd4a814bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:05.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.209+0000 7fd4ad695700 1 -- 172.21.15.49:0/2022652659 shutdown_connections 2023-11-30T17:08:05.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.210+0000 7fd4ad695700 1 -- 172.21.15.49:0/2022652659 wait complete. 2023-11-30T17:08:05.218 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 5 and data pool 6 2023-11-30T17:08:05.235 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:08:05.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.351+0000 7f5abd883700 1 Processor -- start 2023-11-30T17:08:05.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.351+0000 7f5abd883700 1 -- start start 2023-11-30T17:08:05.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.352+0000 7f5abd883700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5ab81544e0 0x7f5ab80c6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:05.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.352+0000 7f5abd883700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ab80aaf30 0x7f5ab80ab3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:05.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.352+0000 7f5abd883700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ab80ab8b0 con 0x7f5ab8158ce0 2023-11-30T17:08:05.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.352+0000 7f5abd883700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab80c0fa0 con 0x7f5ab81544e0 2023-11-30T17:08:05.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.352+0000 7f5abd883700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab80c6930 con 0x7f5ab80aaf30 2023-11-30T17:08:05.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.352+0000 7f5ab6ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5ab81544e0 0x7f5ab80c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:05.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.352+0000 7f5ab6ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5ab81544e0 0x7f5ab80c6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39640/0 (socket says 172.21.15.49:39640) 2023-11-30T17:08:05.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.352+0000 7f5ab67fc700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5ab8158ce0 0x7f5ab80c1430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49364/0 (socket says 172.21.15.49:49364) 2023-11-30T17:08:05.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.352+0000 7f5ab6ffd700 1 -- 172.21.15.49:0/1155752030 learned_addr learned my addr 172.21.15.49:0/1155752030 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:05.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.352+0000 7f5ab77fe700 1 --2- 172.21.15.49:0/1155752030 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ab80aaf30 0x7f5ab80ab3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:05.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.352+0000 7f5ab6ffd700 1 -- 172.21.15.49:0/1155752030 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ab80aaf30 msgr2=0x7f5ab80ab3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:05.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.352+0000 7f5ab6ffd700 1 --2- 172.21.15.49:0/1155752030 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ab80aaf30 0x7f5ab80ab3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:05.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.352+0000 7f5ab6ffd700 1 -- 172.21.15.49:0/1155752030 >> v1:172.21.15.49:6789/0 conn(0x7f5ab8158ce0 legacy=0x7f5ab80c1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:05.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.352+0000 7f5ab6ffd700 1 -- 172.21.15.49:0/1155752030 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab80c06b0 con 0x7f5ab81544e0 2023-11-30T17:08:05.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.352+0000 7f5ab5ffb700 1 -- 172.21.15.49:0/1155752030 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2947591321 0 0) 0x7f5aa0001110 con 0x7f5ab8158ce0 2023-11-30T17:08:05.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.352+0000 7f5ab77fe700 1 --2- 172.21.15.49:0/1155752030 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ab80aaf30 0x7f5ab80ab3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:08:05.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.352+0000 7f5ab6ffd700 1 --2- 172.21.15.49:0/1155752030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ab81544e0 0x7f5ab80c6090 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f5ab0006fd0 tx=0x7f5ab00090f0).ready entity=mon.0 client_cookie=4b9375b74dde0004 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:05.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.353+0000 7f5ab5ffb700 1 -- 172.21.15.49:0/1155752030 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab000b600 con 0x7f5ab81544e0 2023-11-30T17:08:05.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.353+0000 7f5ab5ffb700 1 -- 172.21.15.49:0/1155752030 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab000b760 con 0x7f5ab81544e0 2023-11-30T17:08:05.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.353+0000 7f5ab5ffb700 1 -- 172.21.15.49:0/1155752030 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab000bae0 con 0x7f5ab81544e0 2023-11-30T17:08:05.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.353+0000 7f5abd883700 1 -- 172.21.15.49:0/1155752030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ab81544e0 msgr2=0x7f5ab80c6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:05.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.353+0000 7f5abd883700 1 --2- 172.21.15.49:0/1155752030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ab81544e0 0x7f5ab80c6090 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f5ab0006fd0 tx=0x7f5ab00090f0).stop 2023-11-30T17:08:05.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.353+0000 7f5abd883700 1 -- 172.21.15.49:0/1155752030 shutdown_connections 2023-11-30T17:08:05.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.353+0000 7f5abd883700 1 --2- 172.21.15.49:0/1155752030 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ab80aaf30 0x7f5ab80ab3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:05.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.353+0000 7f5abd883700 1 --2- 172.21.15.49:0/1155752030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ab81544e0 0x7f5ab80c6090 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:05.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.353+0000 7f5abd883700 1 -- 172.21.15.49:0/1155752030 >> 172.21.15.49:0/1155752030 conn(0x7f5ab80cb080 msgr2=0x7f5ab80cb490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:05.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.353+0000 7f5abd883700 1 -- 172.21.15.49:0/1155752030 shutdown_connections 2023-11-30T17:08:05.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.353+0000 7f5abd883700 1 -- 172.21.15.49:0/1155752030 wait complete. 2023-11-30T17:08:05.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.354+0000 7f5abd883700 1 Processor -- start 2023-11-30T17:08:05.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.354+0000 7f5abd883700 1 -- start start 2023-11-30T17:08:05.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.355+0000 7f5abd883700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ab80aaf30 0x7f5ab80aea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:05.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.355+0000 7f5abd883700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ab81544e0 0x7f5ab814f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:05.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.355+0000 7f5abd883700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ab8158ce0 0x7f5ab8156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:05.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.355+0000 7f5abd883700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab8154f50 con 0x7f5ab80aaf30 2023-11-30T17:08:05.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.355+0000 7f5abd883700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab8150f90 con 0x7f5ab8158ce0 2023-11-30T17:08:05.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.355+0000 7f5abd883700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab80af570 con 0x7f5ab81544e0 2023-11-30T17:08:05.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.355+0000 7f5ab6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ab80aaf30 0x7f5ab80aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:05.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.355+0000 7f5ab6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ab80aaf30 0x7f5ab80aea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39646/0 (socket says 172.21.15.49:39646) 2023-11-30T17:08:05.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.355+0000 7f5ab6ffd700 1 -- 172.21.15.49:0/3064972849 learned_addr learned my addr 172.21.15.49:0/3064972849 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:05.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.355+0000 7f5ab67fc700 1 --2- 172.21.15.49:0/3064972849 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ab81544e0 0x7f5ab814f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:05.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.356+0000 7f5ab77fe700 1 --2- 172.21.15.49:0/3064972849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ab8158ce0 0x7f5ab8156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:05.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.356+0000 7f5ab6ffd700 1 -- 172.21.15.49:0/3064972849 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ab81544e0 msgr2=0x7f5ab814f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:05.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.356+0000 7f5ab6ffd700 1 --2- 172.21.15.49:0/3064972849 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ab81544e0 0x7f5ab814f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:05.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.356+0000 7f5ab6ffd700 1 -- 172.21.15.49:0/3064972849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ab8158ce0 msgr2=0x7f5ab8156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:05.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.356+0000 7f5ab6ffd700 1 --2- 172.21.15.49:0/3064972849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ab8158ce0 0x7f5ab8156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:05.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.356+0000 7f5ab6ffd700 1 -- 172.21.15.49:0/3064972849 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab0009370 con 0x7f5ab80aaf30 2023-11-30T17:08:05.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.356+0000 7f5ab6ffd700 1 --2- 172.21.15.49:0/3064972849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ab80aaf30 0x7f5ab80aea00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f5ab0009f50 tx=0x7f5ab0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:05.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.356+0000 7f5aaeffd700 1 -- 172.21.15.49:0/3064972849 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab000bea0 con 0x7f5ab80aaf30 2023-11-30T17:08:05.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.356+0000 7f5aaeffd700 1 -- 172.21.15.49:0/3064972849 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab000b8d0 con 0x7f5ab80aaf30 2023-11-30T17:08:05.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.356+0000 7f5abd883700 1 -- 172.21.15.49:0/3064972849 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab8154c20 con 0x7f5ab80aaf30 2023-11-30T17:08:05.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.356+0000 7f5aaeffd700 1 -- 172.21.15.49:0/3064972849 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab001b660 con 0x7f5ab80aaf30 2023-11-30T17:08:05.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.356+0000 7f5abd883700 1 -- 172.21.15.49:0/3064972849 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab80af290 con 0x7f5ab80aaf30 2023-11-30T17:08:05.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.357+0000 7f5abd883700 1 -- 172.21.15.49:0/3064972849 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab806c7c0 con 0x7f5ab80aaf30 2023-11-30T17:08:05.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.357+0000 7f5aaeffd700 1 -- 172.21.15.49:0/3064972849 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5ab001b9d0 con 0x7f5ab80aaf30 2023-11-30T17:08:05.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.358+0000 7f5aaeffd700 1 --2- 172.21.15.49:0/3064972849 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5a9805f120 0x7f5a980615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:05.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.358+0000 7f5aaeffd700 1 -- 172.21.15.49:0/3064972849 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5ab007b9a0 con 0x7f5ab80aaf30 2023-11-30T17:08:05.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.358+0000 7f5ab67fc700 1 --2- 172.21.15.49:0/3064972849 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5a9805f120 0x7f5a980615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:05.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.358+0000 7f5ab67fc700 1 --2- 172.21.15.49:0/3064972849 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5a9805f120 0x7f5a980615e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f5ab8153f90 tx=0x7f5aa0007d70).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:05.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.362+0000 7f5aaeffd700 1 -- 172.21.15.49:0/3064972849 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5ab004cc70 con 0x7f5ab80aaf30 2023-11-30T17:08:05.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.533+0000 7f5abd883700 1 -- 172.21.15.49:0/3064972849 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ab80c6670 con 0x7f5ab80aaf30 2023-11-30T17:08:05.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.534+0000 7f5aaeffd700 1 -- 172.21.15.49:0/3064972849 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16941 (secure 0 0 0) 0x7f5ab001f070 con 0x7f5ab80aaf30 2023-11-30T17:08:05.537 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:08:05.537 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":33,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:08:05.200630+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:08:03.325011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-30T17:08:04.171666+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:08:05.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.536+0000 7f5abd883700 1 -- 172.21.15.49:0/3064972849 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5a9805f120 msgr2=0x7f5a980615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:05.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.536+0000 7f5abd883700 1 --2- 172.21.15.49:0/3064972849 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5a9805f120 0x7f5a980615e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f5ab8153f90 tx=0x7f5aa0007d70).stop 2023-11-30T17:08:05.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.536+0000 7f5abd883700 1 -- 172.21.15.49:0/3064972849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ab80aaf30 msgr2=0x7f5ab80aea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:05.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.536+0000 7f5abd883700 1 --2- 172.21.15.49:0/3064972849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ab80aaf30 0x7f5ab80aea00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f5ab0009f50 tx=0x7f5ab0017000).stop 2023-11-30T17:08:05.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.536+0000 7f5abd883700 1 -- 172.21.15.49:0/3064972849 shutdown_connections 2023-11-30T17:08:05.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.536+0000 7f5abd883700 1 --2- 172.21.15.49:0/3064972849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ab8158ce0 0x7f5ab8156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:05.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.536+0000 7f5abd883700 1 --2- 172.21.15.49:0/3064972849 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5a9805f120 0x7f5a980615e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:05.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.536+0000 7f5abd883700 1 --2- 172.21.15.49:0/3064972849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ab80aaf30 0x7f5ab80aea00 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:05.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.536+0000 7f5abd883700 1 --2- 172.21.15.49:0/3064972849 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ab81544e0 0x7f5ab814f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:05.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.536+0000 7f5abd883700 1 -- 172.21.15.49:0/3064972849 >> 172.21.15.49:0/3064972849 conn(0x7f5ab80cb080 msgr2=0x7f5ab80c5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:05.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.536+0000 7f5abd883700 1 -- 172.21.15.49:0/3064972849 shutdown_connections 2023-11-30T17:08:05.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.536+0000 7f5abd883700 1 -- 172.21.15.49:0/3064972849 wait complete. 2023-11-30T17:08:05.551 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:08:05.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.666+0000 7fd524e3e700 1 Processor -- start 2023-11-30T17:08:05.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.666+0000 7fd524e3e700 1 -- start start 2023-11-30T17:08:05.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.667+0000 7fd524e3e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd5200cae90 0x7fd5200c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:05.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.667+0000 7fd524e3e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd5200ca180 0x7fd5200c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:05.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.667+0000 7fd524e3e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5200a9a90 con 0x7fd5200caab0 2023-11-30T17:08:05.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.667+0000 7fd524e3e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5200c1490 con 0x7fd5200cae90 2023-11-30T17:08:05.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.667+0000 7fd524e3e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd520154ce0 con 0x7fd5200ca180 2023-11-30T17:08:05.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.668+0000 7fd51dd9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd5200cae90 0x7fd5200c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:05.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.668+0000 7fd51dd9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd5200cae90 0x7fd5200c0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39662/0 (socket says 172.21.15.49:39662) 2023-11-30T17:08:05.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.668+0000 7fd51dd9b700 1 -- 172.21.15.49:0/1582544337 learned_addr learned my addr 172.21.15.49:0/1582544337 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:05.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.668+0000 7fd51e59c700 1 --1- 172.21.15.49:0/1582544337 >> v1:172.21.15.49:6789/0 conn(0x7fd5200caab0 0x7fd5200aa470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49366/0 (socket says 172.21.15.49:49366) 2023-11-30T17:08:05.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.668+0000 7fd51ed9d700 1 --2- 172.21.15.49:0/1582544337 >> v2:172.21.15.115:3300/0 conn(0x7fd5200ca180 0x7fd5200c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:05.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.668+0000 7fd51dd9b700 1 -- 172.21.15.49:0/1582544337 >> v2:172.21.15.115:3300/0 conn(0x7fd5200ca180 msgr2=0x7fd5200c0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:05.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.668+0000 7fd51dd9b700 1 --2- 172.21.15.49:0/1582544337 >> v2:172.21.15.115:3300/0 conn(0x7fd5200ca180 0x7fd5200c0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:05.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.668+0000 7fd51dd9b700 1 -- 172.21.15.49:0/1582544337 >> v1:172.21.15.49:6789/0 conn(0x7fd5200caab0 legacy=0x7fd5200aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:05.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.668+0000 7fd51dd9b700 1 -- 172.21.15.49:0/1582544337 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5200aab80 con 0x7fd5200cae90 2023-11-30T17:08:05.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.668+0000 7fd51d59a700 1 -- 172.21.15.49:0/1582544337 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 918735992 0 0) 0x7fd5200a9a90 con 0x7fd5200caab0 2023-11-30T17:08:05.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.668+0000 7fd51dd9b700 1 --2- 172.21.15.49:0/1582544337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5200cae90 0x7fd5200c0ab0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fd5200a9a00 tx=0x7fd5080090f0).ready entity=mon.0 client_cookie=36a08ee373887398 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:05.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.668+0000 7fd51d59a700 1 -- 172.21.15.49:0/1582544337 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50800b600 con 0x7fd5200cae90 2023-11-30T17:08:05.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.668+0000 7fd51d59a700 1 -- 172.21.15.49:0/1582544337 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50800b760 con 0x7fd5200cae90 2023-11-30T17:08:05.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.668+0000 7fd51d59a700 1 -- 172.21.15.49:0/1582544337 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50800bae0 con 0x7fd5200cae90 2023-11-30T17:08:05.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.669+0000 7fd524e3e700 1 -- 172.21.15.49:0/1582544337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5200cae90 msgr2=0x7fd5200c0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:05.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.669+0000 7fd524e3e700 1 --2- 172.21.15.49:0/1582544337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5200cae90 0x7fd5200c0ab0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fd5200a9a00 tx=0x7fd5080090f0).stop 2023-11-30T17:08:05.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.669+0000 7fd524e3e700 1 -- 172.21.15.49:0/1582544337 shutdown_connections 2023-11-30T17:08:05.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.669+0000 7fd524e3e700 1 --2- 172.21.15.49:0/1582544337 >> v2:172.21.15.115:3300/0 conn(0x7fd5200ca180 0x7fd5200c0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:05.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.669+0000 7fd524e3e700 1 --2- 172.21.15.49:0/1582544337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5200cae90 0x7fd5200c0ab0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:05.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.669+0000 7fd524e3e700 1 -- 172.21.15.49:0/1582544337 >> 172.21.15.49:0/1582544337 conn(0x7fd520094920 msgr2=0x7fd52006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:05.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.669+0000 7fd524e3e700 1 -- 172.21.15.49:0/1582544337 shutdown_connections 2023-11-30T17:08:05.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.669+0000 7fd524e3e700 1 -- 172.21.15.49:0/1582544337 wait complete. 2023-11-30T17:08:05.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.670+0000 7fd524e3e700 1 Processor -- start 2023-11-30T17:08:05.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.670+0000 7fd524e3e700 1 -- start start 2023-11-30T17:08:05.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.671+0000 7fd524e3e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5200ca180 0x7fd52015a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:05.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.671+0000 7fd524e3e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5200caab0 0x7fd5200c2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:05.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.671+0000 7fd524e3e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5200cae90 0x7fd5201677f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:05.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.671+0000 7fd524e3e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5200c3bb0 con 0x7fd5200cae90 2023-11-30T17:08:05.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.671+0000 7fd524e3e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5200c2fa0 con 0x7fd5200ca180 2023-11-30T17:08:05.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.671+0000 7fd524e3e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5200c3280 con 0x7fd5200caab0 2023-11-30T17:08:05.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.671+0000 7fd51ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5200cae90 0x7fd5201677f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:05.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.671+0000 7fd51ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5200cae90 0x7fd5201677f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39676/0 (socket says 172.21.15.49:39676) 2023-11-30T17:08:05.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.671+0000 7fd51ed9d700 1 -- 172.21.15.49:0/945383428 learned_addr learned my addr 172.21.15.49:0/945383428 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:05.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.671+0000 7fd51e59c700 1 --2- 172.21.15.49:0/945383428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5200ca180 0x7fd52015a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:05.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.671+0000 7fd51dd9b700 1 --2- 172.21.15.49:0/945383428 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5200caab0 0x7fd5200c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:05.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.671+0000 7fd51ed9d700 1 -- 172.21.15.49:0/945383428 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5200caab0 msgr2=0x7fd5200c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:05.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.671+0000 7fd51ed9d700 1 --2- 172.21.15.49:0/945383428 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5200caab0 0x7fd5200c2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:05.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.671+0000 7fd51ed9d700 1 -- 172.21.15.49:0/945383428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5200ca180 msgr2=0x7fd52015a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:05.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.671+0000 7fd51ed9d700 1 --2- 172.21.15.49:0/945383428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5200ca180 0x7fd52015a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:05.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.671+0000 7fd51ed9d700 1 -- 172.21.15.49:0/945383428 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd508009370 con 0x7fd5200cae90 2023-11-30T17:08:05.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.671+0000 7fd51dd9b700 1 --2- 172.21.15.49:0/945383428 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5200caab0 0x7fd5200c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:08:05.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.671+0000 7fd51ed9d700 1 --2- 172.21.15.49:0/945383428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5200cae90 0x7fd5201677f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fd510007f20 tx=0x7fd510009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:05.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.671+0000 7fd5167fc700 1 -- 172.21.15.49:0/945383428 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51000ebf0 con 0x7fd5200cae90 2023-11-30T17:08:05.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.671+0000 7fd5167fc700 1 -- 172.21.15.49:0/945383428 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51000ed50 con 0x7fd5200cae90 2023-11-30T17:08:05.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.671+0000 7fd524e3e700 1 -- 172.21.15.49:0/945383428 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5200c3560 con 0x7fd5200cae90 2023-11-30T17:08:05.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.671+0000 7fd5167fc700 1 -- 172.21.15.49:0/945383428 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd510014610 con 0x7fd5200cae90 2023-11-30T17:08:05.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.672+0000 7fd524e3e700 1 -- 172.21.15.49:0/945383428 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd52015ab20 con 0x7fd5200cae90 2023-11-30T17:08:05.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.673+0000 7fd524e3e700 1 -- 172.21.15.49:0/945383428 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5200c3d20 con 0x7fd5200cae90 2023-11-30T17:08:05.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.673+0000 7fd5167fc700 1 -- 172.21.15.49:0/945383428 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd510014980 con 0x7fd5200cae90 2023-11-30T17:08:05.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.673+0000 7fd5167fc700 1 --2- 172.21.15.49:0/945383428 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd50005f150 0x7fd500061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:05.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.673+0000 7fd5167fc700 1 -- 172.21.15.49:0/945383428 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd51007a610 con 0x7fd5200cae90 2023-11-30T17:08:05.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.673+0000 7fd51e59c700 1 --2- 172.21.15.49:0/945383428 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd50005f150 0x7fd500061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:05.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.674+0000 7fd51e59c700 1 --2- 172.21.15.49:0/945383428 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd50005f150 0x7fd500061610 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fd5180012a0 tx=0x7fd518009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:05.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.677+0000 7fd5167fc700 1 -- 172.21.15.49:0/945383428 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd51004b8e0 con 0x7fd5200cae90 2023-11-30T17:08:05.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.853+0000 7fd524e3e700 1 -- 172.21.15.49:0/945383428 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd52006c860 con 0x7fd5200cae90 2023-11-30T17:08:05.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.854+0000 7fd5167fc700 1 -- 172.21.15.49:0/945383428 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16941 (secure 0 0 0) 0x7fd51004ef00 con 0x7fd5200cae90 2023-11-30T17:08:05.857 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:08:05.857 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":33,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:08:05.200630+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:08:03.325011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-30T17:08:04.171666+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:08:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.856+0000 7fd524e3e700 1 -- 172.21.15.49:0/945383428 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd50005f150 msgr2=0x7fd500061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.856+0000 7fd524e3e700 1 --2- 172.21.15.49:0/945383428 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd50005f150 0x7fd500061610 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fd5180012a0 tx=0x7fd518009040).stop 2023-11-30T17:08:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.856+0000 7fd524e3e700 1 -- 172.21.15.49:0/945383428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5200cae90 msgr2=0x7fd5201677f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.856+0000 7fd524e3e700 1 --2- 172.21.15.49:0/945383428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5200cae90 0x7fd5201677f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fd510007f20 tx=0x7fd510009860).stop 2023-11-30T17:08:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.856+0000 7fd524e3e700 1 -- 172.21.15.49:0/945383428 shutdown_connections 2023-11-30T17:08:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.856+0000 7fd524e3e700 1 --2- 172.21.15.49:0/945383428 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd50005f150 0x7fd500061610 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.856+0000 7fd524e3e700 1 --2- 172.21.15.49:0/945383428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5200cae90 0x7fd5201677f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.856+0000 7fd524e3e700 1 --2- 172.21.15.49:0/945383428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5200ca180 0x7fd52015a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.856+0000 7fd524e3e700 1 --2- 172.21.15.49:0/945383428 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5200caab0 0x7fd5200c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.856+0000 7fd524e3e700 1 -- 172.21.15.49:0/945383428 >> 172.21.15.49:0/945383428 conn(0x7fd520094920 msgr2=0x7fd5200b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:05.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.856+0000 7fd524e3e700 1 -- 172.21.15.49:0/945383428 shutdown_connections 2023-11-30T17:08:05.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.856+0000 7fd524e3e700 1 -- 172.21.15.49:0/945383428 wait complete. 2023-11-30T17:08:05.871 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-30T17:08:05.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.990+0000 7fb23940a700 1 Processor -- start 2023-11-30T17:08:05.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.990+0000 7fb23940a700 1 -- start start 2023-11-30T17:08:05.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.990+0000 7fb23940a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2340a8280 0x7fb2340a8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:05.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.990+0000 7fb23940a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb234158160 0x7fb234155500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:05.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.990+0000 7fb23940a700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb234067770 con 0x7fb23414e600 2023-11-30T17:08:05.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.990+0000 7fb23940a700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb234159180 con 0x7fb234158160 2023-11-30T17:08:05.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.990+0000 7fb23940a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2340be8d0 con 0x7fb2340a8280 2023-11-30T17:08:05.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.991+0000 7fb2327fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb234158160 0x7fb234155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:05.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.991+0000 7fb232ffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2340a8280 0x7fb2340a8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:05.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.991+0000 7fb2337fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fb23414e600 0x7fb23414eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:57756/0 (socket says 172.21.15.49:57756) 2023-11-30T17:08:05.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.991+0000 7fb2337fe700 1 -- 172.21.15.49:0/3679379942 learned_addr learned my addr 172.21.15.49:0/3679379942 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:08:05.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.991+0000 7fb2327fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb234158160 0x7fb234155500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:54852/0 (socket says 172.21.15.49:54852) 2023-11-30T17:08:05.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.991+0000 7fb231ffb700 1 -- 172.21.15.49:0/3679379942 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2927969415 0 0) 0x7fb234067770 con 0x7fb23414e600 2023-11-30T17:08:05.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.991+0000 7fb231ffb700 1 -- 172.21.15.49:0/3679379942 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2200033f0 con 0x7fb23414e600 2023-11-30T17:08:05.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.991+0000 7fb2327fc700 1 -- 172.21.15.49:0/3679379942 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2340a8280 msgr2=0x7fb2340a8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:05.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.991+0000 7fb2327fc700 1 --2- 172.21.15.49:0/3679379942 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2340a8280 0x7fb2340a8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:05.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.991+0000 7fb2327fc700 1 -- 172.21.15.49:0/3679379942 >> v1:172.21.15.115:6789/0 conn(0x7fb23414e600 legacy=0x7fb23414eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:05.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.991+0000 7fb2327fc700 1 -- 172.21.15.49:0/3679379942 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb234158600 con 0x7fb234158160 2023-11-30T17:08:05.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.991+0000 7fb232ffd700 1 --2- 172.21.15.49:0/3679379942 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2340a8280 0x7fb2340a8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:08:05.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.991+0000 7fb2327fc700 1 --2- 172.21.15.49:0/3679379942 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb234158160 0x7fb234155500 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fb21c009760 tx=0x7fb21c009060).ready entity=mon.1 client_cookie=d880dbc205b73aa5 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:05.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.992+0000 7fb231ffb700 1 -- 172.21.15.49:0/3679379942 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c00d4a0 con 0x7fb234158160 2023-11-30T17:08:05.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.992+0000 7fb231ffb700 1 -- 172.21.15.49:0/3679379942 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21c00d600 con 0x7fb234158160 2023-11-30T17:08:05.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.992+0000 7fb231ffb700 1 -- 172.21.15.49:0/3679379942 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c00d980 con 0x7fb234158160 2023-11-30T17:08:05.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.992+0000 7fb23940a700 1 -- 172.21.15.49:0/3679379942 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb234158160 msgr2=0x7fb234155500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:05.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.992+0000 7fb23940a700 1 --2- 172.21.15.49:0/3679379942 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb234158160 0x7fb234155500 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fb21c009760 tx=0x7fb21c009060).stop 2023-11-30T17:08:05.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.992+0000 7fb23940a700 1 -- 172.21.15.49:0/3679379942 shutdown_connections 2023-11-30T17:08:05.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.992+0000 7fb23940a700 1 --2- 172.21.15.49:0/3679379942 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2340a8280 0x7fb2340a8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:05.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.992+0000 7fb23940a700 1 --2- 172.21.15.49:0/3679379942 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb234158160 0x7fb234155500 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:05.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.992+0000 7fb23940a700 1 -- 172.21.15.49:0/3679379942 >> 172.21.15.49:0/3679379942 conn(0x7fb234062700 msgr2=0x7fb234062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:05.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.992+0000 7fb23940a700 1 -- 172.21.15.49:0/3679379942 shutdown_connections 2023-11-30T17:08:05.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.992+0000 7fb23940a700 1 -- 172.21.15.49:0/3679379942 wait complete. 2023-11-30T17:08:05.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.993+0000 7fb23940a700 1 Processor -- start 2023-11-30T17:08:05.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.993+0000 7fb23940a700 1 -- start start 2023-11-30T17:08:05.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.994+0000 7fb23940a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2340a8280 0x7fb234155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:05.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.994+0000 7fb23940a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb23414e600 0x7fb234157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:05.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.994+0000 7fb23940a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb234158160 0x7fb23414c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:05.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.994+0000 7fb23940a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb234157a60 con 0x7fb234158160 2023-11-30T17:08:05.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.994+0000 7fb23940a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2341570e0 con 0x7fb23414e600 2023-11-30T17:08:05.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.994+0000 7fb23940a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2340c3110 con 0x7fb2340a8280 2023-11-30T17:08:05.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.994+0000 7fb2337fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb234158160 0x7fb23414c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:05.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.994+0000 7fb2337fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb234158160 0x7fb23414c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39682/0 (socket says 172.21.15.49:39682) 2023-11-30T17:08:05.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.994+0000 7fb2337fe700 1 -- 172.21.15.49:0/2188759875 learned_addr learned my addr 172.21.15.49:0/2188759875 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:05.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.994+0000 7fb2327fc700 1 --2- 172.21.15.49:0/2188759875 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb23414e600 0x7fb234157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:05.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.994+0000 7fb232ffd700 1 --2- 172.21.15.49:0/2188759875 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2340a8280 0x7fb234155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:05.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.995+0000 7fb2337fe700 1 -- 172.21.15.49:0/2188759875 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2340a8280 msgr2=0x7fb234155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:05.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.995+0000 7fb2337fe700 1 --2- 172.21.15.49:0/2188759875 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2340a8280 0x7fb234155e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:05.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.995+0000 7fb2337fe700 1 -- 172.21.15.49:0/2188759875 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb23414e600 msgr2=0x7fb234157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:05.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.995+0000 7fb2337fe700 1 --2- 172.21.15.49:0/2188759875 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb23414e600 0x7fb234157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:05.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.995+0000 7fb2337fe700 1 -- 172.21.15.49:0/2188759875 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22c0092a0 con 0x7fb234158160 2023-11-30T17:08:05.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.995+0000 7fb2337fe700 1 --2- 172.21.15.49:0/2188759875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb234158160 0x7fb23414c480 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7fb224005ad0 tx=0x7fb224001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:05.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.995+0000 7fb22affd700 1 -- 172.21.15.49:0/2188759875 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb224005d30 con 0x7fb234158160 2023-11-30T17:08:05.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.995+0000 7fb22affd700 1 -- 172.21.15.49:0/2188759875 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb224005e90 con 0x7fb234158160 2023-11-30T17:08:05.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.995+0000 7fb23940a700 1 -- 172.21.15.49:0/2188759875 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb21c0092a0 con 0x7fb234158160 2023-11-30T17:08:05.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.995+0000 7fb22affd700 1 -- 172.21.15.49:0/2188759875 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb224007320 con 0x7fb234158160 2023-11-30T17:08:05.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.995+0000 7fb23940a700 1 -- 172.21.15.49:0/2188759875 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2341567b0 con 0x7fb234158160 2023-11-30T17:08:06.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.996+0000 7fb23940a700 1 -- 172.21.15.49:0/2188759875 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb234157270 con 0x7fb234158160 2023-11-30T17:08:06.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.996+0000 7fb22affd700 1 -- 172.21.15.49:0/2188759875 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb224007710 con 0x7fb234158160 2023-11-30T17:08:06.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.997+0000 7fb22affd700 1 --2- 172.21.15.49:0/2188759875 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb21405f150 0x7fb214061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:06.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.997+0000 7fb22affd700 1 -- 172.21.15.49:0/2188759875 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb22407a300 con 0x7fb234158160 2023-11-30T17:08:06.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.997+0000 7fb232ffd700 1 --2- 172.21.15.49:0/2188759875 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb21405f150 0x7fb214061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:06.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:05.997+0000 7fb232ffd700 1 --2- 172.21.15.49:0/2188759875 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb21405f150 0x7fb214061610 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fb22c009270 tx=0x7fb22c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:06.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:06.001+0000 7fb22affd700 1 -- 172.21.15.49:0/2188759875 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb22404b610 con 0x7fb234158160 2023-11-30T17:08:06.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:06.220+0000 7fb23940a700 1 -- 172.21.15.49:0/2188759875 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb23406c860 con 0x7fb234158160 2023-11-30T17:08:07.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.208+0000 7fb22affd700 1 -- 172.21.15.49:0/2188759875 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb22404ec30 con 0x7fb234158160 2023-11-30T17:08:07.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.211+0000 7fb23940a700 1 -- 172.21.15.49:0/2188759875 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb21405f150 msgr2=0x7fb214061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:07.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.211+0000 7fb23940a700 1 --2- 172.21.15.49:0/2188759875 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb21405f150 0x7fb214061610 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fb22c009270 tx=0x7fb22c008040).stop 2023-11-30T17:08:07.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.211+0000 7fb23940a700 1 -- 172.21.15.49:0/2188759875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb234158160 msgr2=0x7fb23414c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:07.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.211+0000 7fb23940a700 1 --2- 172.21.15.49:0/2188759875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb234158160 0x7fb23414c480 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7fb224005ad0 tx=0x7fb224001650).stop 2023-11-30T17:08:07.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.211+0000 7fb23940a700 1 -- 172.21.15.49:0/2188759875 shutdown_connections 2023-11-30T17:08:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.211+0000 7fb23940a700 1 --2- 172.21.15.49:0/2188759875 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb21405f150 0x7fb214061610 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.211+0000 7fb23940a700 1 --2- 172.21.15.49:0/2188759875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb234158160 0x7fb23414c480 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.211+0000 7fb23940a700 1 --2- 172.21.15.49:0/2188759875 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2340a8280 0x7fb234155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.211+0000 7fb23940a700 1 --2- 172.21.15.49:0/2188759875 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb23414e600 0x7fb234157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.211+0000 7fb23940a700 1 -- 172.21.15.49:0/2188759875 >> 172.21.15.49:0/2188759875 conn(0x7fb234062700 msgr2=0x7fb234062ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.211+0000 7fb23940a700 1 -- 172.21.15.49:0/2188759875 shutdown_connections 2023-11-30T17:08:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.211+0000 7fb23940a700 1 -- 172.21.15.49:0/2188759875 wait complete. 2023-11-30T17:08:07.228 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-30T17:08:07.228 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-30T17:08:07.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.355+0000 7f9c1a8a5700 1 Processor -- start 2023-11-30T17:08:07.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.355+0000 7f9c1a8a5700 1 -- start start 2023-11-30T17:08:07.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.356+0000 7f9c1a8a5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9c14155830 0x7f9c14155c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:07.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.356+0000 7f9c1a8a5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c140c3090 0x7f9c140c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:07.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.356+0000 7f9c1a8a5700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c141529c0 con 0x7f9c14155030 2023-11-30T17:08:07.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.356+0000 7f9c1a8a5700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c141554b0 con 0x7f9c14155830 2023-11-30T17:08:07.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.356+0000 7f9c1a8a5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c14151db0 con 0x7f9c140c3090 2023-11-30T17:08:07.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.356+0000 7f9c13fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9c14155830 0x7f9c14155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:07.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.356+0000 7f9c13fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9c14155830 0x7f9c14155c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39686/0 (socket says 172.21.15.49:39686) 2023-11-30T17:08:07.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.356+0000 7f9c13fff700 1 -- 172.21.15.49:0/710423066 learned_addr learned my addr 172.21.15.49:0/710423066 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:07.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.356+0000 7f9c137fe700 1 --1- 172.21.15.49:0/710423066 >> v1:172.21.15.49:6789/0 conn(0x7f9c14155030 0x7f9c140c2980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49372/0 (socket says 172.21.15.49:49372) 2023-11-30T17:08:07.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.356+0000 7f9c18e42700 1 --2- 172.21.15.49:0/710423066 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c140c3090 0x7f9c140c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:07.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.357+0000 7f9c13fff700 1 -- 172.21.15.49:0/710423066 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c140c3090 msgr2=0x7f9c140c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:07.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.357+0000 7f9c13fff700 1 --2- 172.21.15.49:0/710423066 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c140c3090 0x7f9c140c5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:07.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.357+0000 7f9c13fff700 1 -- 172.21.15.49:0/710423066 >> v1:172.21.15.49:6789/0 conn(0x7f9c14155030 legacy=0x7f9c140c2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:07.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.357+0000 7f9c12ffd700 1 -- 172.21.15.49:0/710423066 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4196296109 0 0) 0x7f9c141529c0 con 0x7f9c14155030 2023-11-30T17:08:07.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.357+0000 7f9c13fff700 1 -- 172.21.15.49:0/710423066 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c14152090 con 0x7f9c14155830 2023-11-30T17:08:07.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.357+0000 7f9c13fff700 1 --2- 172.21.15.49:0/710423066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c14155830 0x7f9c14155c10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f9c04006fd0 tx=0x7f9c0400b3b0).ready entity=mon.0 client_cookie=571a1d890aab048b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:07.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.357+0000 7f9c12ffd700 1 -- 172.21.15.49:0/710423066 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0400db40 con 0x7f9c14155830 2023-11-30T17:08:07.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.357+0000 7f9c12ffd700 1 -- 172.21.15.49:0/710423066 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0400dca0 con 0x7f9c14155830 2023-11-30T17:08:07.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.357+0000 7f9c12ffd700 1 -- 172.21.15.49:0/710423066 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c04010680 con 0x7f9c14155830 2023-11-30T17:08:07.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.357+0000 7f9c1a8a5700 1 -- 172.21.15.49:0/710423066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c14155830 msgr2=0x7f9c14155c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:07.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.357+0000 7f9c1a8a5700 1 --2- 172.21.15.49:0/710423066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c14155830 0x7f9c14155c10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f9c04006fd0 tx=0x7f9c0400b3b0).stop 2023-11-30T17:08:07.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.357+0000 7f9c1a8a5700 1 -- 172.21.15.49:0/710423066 shutdown_connections 2023-11-30T17:08:07.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.357+0000 7f9c1a8a5700 1 --2- 172.21.15.49:0/710423066 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c140c3090 0x7f9c140c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.357+0000 7f9c1a8a5700 1 --2- 172.21.15.49:0/710423066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c14155830 0x7f9c14155c10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.357+0000 7f9c1a8a5700 1 -- 172.21.15.49:0/710423066 >> 172.21.15.49:0/710423066 conn(0x7f9c14062700 msgr2=0x7f9c14062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.358+0000 7f9c1a8a5700 1 -- 172.21.15.49:0/710423066 shutdown_connections 2023-11-30T17:08:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.358+0000 7f9c1a8a5700 1 -- 172.21.15.49:0/710423066 wait complete. 2023-11-30T17:08:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.359+0000 7f9c1a8a5700 1 Processor -- start 2023-11-30T17:08:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.359+0000 7f9c1a8a5700 1 -- start start 2023-11-30T17:08:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.359+0000 7f9c1a8a5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c140c3090 0x7f9c140a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:07.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.360+0000 7f9c1a8a5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c14155030 0x7f9c141547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:07.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.360+0000 7f9c1a8a5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c14155830 0x7f9c14150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:07.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.360+0000 7f9c1a8a5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c14154eb0 con 0x7f9c14155830 2023-11-30T17:08:07.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.360+0000 7f9c1a8a5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c14150620 con 0x7f9c14155030 2023-11-30T17:08:07.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.360+0000 7f9c1a8a5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c14093650 con 0x7f9c140c3090 2023-11-30T17:08:07.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.360+0000 7f9c18e42700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c14155830 0x7f9c14150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:07.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.360+0000 7f9c18e42700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c14155830 0x7f9c14150130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39690/0 (socket says 172.21.15.49:39690) 2023-11-30T17:08:07.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.360+0000 7f9c18e42700 1 -- 172.21.15.49:0/2461191114 learned_addr learned my addr 172.21.15.49:0/2461191114 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:07.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.360+0000 7f9c13fff700 1 --2- 172.21.15.49:0/2461191114 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c140c3090 0x7f9c140a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:07.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.360+0000 7f9c137fe700 1 --2- 172.21.15.49:0/2461191114 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c14155030 0x7f9c141547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:07.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.360+0000 7f9c18e42700 1 -- 172.21.15.49:0/2461191114 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c140c3090 msgr2=0x7f9c140a9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:07.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.360+0000 7f9c18e42700 1 --2- 172.21.15.49:0/2461191114 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c140c3090 0x7f9c140a9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:07.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.360+0000 7f9c18e42700 1 -- 172.21.15.49:0/2461191114 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c14155030 msgr2=0x7f9c141547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:07.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.360+0000 7f9c18e42700 1 --2- 172.21.15.49:0/2461191114 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c14155030 0x7f9c141547f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:07.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.360+0000 7f9c18e42700 1 -- 172.21.15.49:0/2461191114 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0400b610 con 0x7f9c14155830 2023-11-30T17:08:07.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.360+0000 7f9c18e42700 1 --2- 172.21.15.49:0/2461191114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c14155830 0x7f9c14150130 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f9c0c007f80 tx=0x7f9c0c0098a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:07.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.360+0000 7f9bfbfff700 1 -- 172.21.15.49:0/2461191114 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c00ebf0 con 0x7f9c14155830 2023-11-30T17:08:07.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.360+0000 7f9bfbfff700 1 -- 172.21.15.49:0/2461191114 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0c00ed50 con 0x7f9c14155830 2023-11-30T17:08:07.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.360+0000 7f9c1a8a5700 1 -- 172.21.15.49:0/2461191114 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c14093340 con 0x7f9c14155830 2023-11-30T17:08:07.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.360+0000 7f9bfbfff700 1 -- 172.21.15.49:0/2461191114 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c014610 con 0x7f9c14155830 2023-11-30T17:08:07.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.360+0000 7f9c1a8a5700 1 -- 172.21.15.49:0/2461191114 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c14151060 con 0x7f9c14155830 2023-11-30T17:08:07.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.361+0000 7f9c1a8a5700 1 -- 172.21.15.49:0/2461191114 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c14151280 con 0x7f9c14155830 2023-11-30T17:08:07.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.362+0000 7f9bfbfff700 1 -- 172.21.15.49:0/2461191114 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9c0c01d3b0 con 0x7f9c14155830 2023-11-30T17:08:07.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.362+0000 7f9bfbfff700 1 --2- 172.21.15.49:0/2461191114 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9c0005f180 0x7f9c00061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:07.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.362+0000 7f9bfbfff700 1 -- 172.21.15.49:0/2461191114 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9c0c07a590 con 0x7f9c14155830 2023-11-30T17:08:07.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.362+0000 7f9c13fff700 1 --2- 172.21.15.49:0/2461191114 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9c0005f180 0x7f9c00061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:07.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.363+0000 7f9c13fff700 1 --2- 172.21.15.49:0/2461191114 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9c0005f180 0x7f9c00061640 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f9c0400bfd0 tx=0x7f9c0400b3b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:07.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.366+0000 7f9bfbfff700 1 -- 172.21.15.49:0/2461191114 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9c0c04b800 con 0x7f9c14155830 2023-11-30T17:08:07.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:07.582+0000 7f9c1a8a5700 1 -- 172.21.15.49:0/2461191114 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9c1406c860 con 0x7f9c14155830 2023-11-30T17:08:08.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.209+0000 7f9bfbfff700 1 -- 172.21.15.49:0/2461191114 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9c0c04ee20 con 0x7f9c14155830 2023-11-30T17:08:08.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.211+0000 7f9c1a8a5700 1 -- 172.21.15.49:0/2461191114 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9c0005f180 msgr2=0x7f9c00061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:08.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.211+0000 7f9c1a8a5700 1 --2- 172.21.15.49:0/2461191114 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9c0005f180 0x7f9c00061640 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f9c0400bfd0 tx=0x7f9c0400b3b0).stop 2023-11-30T17:08:08.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.211+0000 7f9c1a8a5700 1 -- 172.21.15.49:0/2461191114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c14155830 msgr2=0x7f9c14150130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:08.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.211+0000 7f9c1a8a5700 1 --2- 172.21.15.49:0/2461191114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c14155830 0x7f9c14150130 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f9c0c007f80 tx=0x7f9c0c0098a0).stop 2023-11-30T17:08:08.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.211+0000 7f9c1a8a5700 1 -- 172.21.15.49:0/2461191114 shutdown_connections 2023-11-30T17:08:08.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.211+0000 7f9c1a8a5700 1 --2- 172.21.15.49:0/2461191114 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9c0005f180 0x7f9c00061640 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:08.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.211+0000 7f9c1a8a5700 1 --2- 172.21.15.49:0/2461191114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c14155830 0x7f9c14150130 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:08.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.211+0000 7f9c1a8a5700 1 --2- 172.21.15.49:0/2461191114 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c140c3090 0x7f9c140a9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:08.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.211+0000 7f9c1a8a5700 1 --2- 172.21.15.49:0/2461191114 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c14155030 0x7f9c141547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:08.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.211+0000 7f9c1a8a5700 1 -- 172.21.15.49:0/2461191114 >> 172.21.15.49:0/2461191114 conn(0x7f9c14062700 msgr2=0x7f9c1414def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:08.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.212+0000 7f9c1a8a5700 1 -- 172.21.15.49:0/2461191114 shutdown_connections 2023-11-30T17:08:08.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.212+0000 7f9c1a8a5700 1 -- 172.21.15.49:0/2461191114 wait complete. 2023-11-30T17:08:08.227 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-30T17:08:08.227 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:08:08.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.347+0000 7f46c8937700 1 Processor -- start 2023-11-30T17:08:08.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.347+0000 7f46c8937700 1 -- start start 2023-11-30T17:08:08.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.348+0000 7f46c8937700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c40caab0 0x7f46c40aa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:08.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.348+0000 7f46c8937700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f46c40cae90 0x7f46c40c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:08.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.348+0000 7f46c8937700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c40a9a90 con 0x7f46c40aa960 2023-11-30T17:08:08.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.348+0000 7f46c8937700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c4154ce0 con 0x7f46c40cae90 2023-11-30T17:08:08.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.348+0000 7f46c8937700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c40a8e80 con 0x7f46c40caab0 2023-11-30T17:08:08.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.348+0000 7f46c1d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f46c40cae90 0x7f46c40c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:08.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.348+0000 7f46c1d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f46c40cae90 0x7f46c40c0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39692/0 (socket says 172.21.15.49:39692) 2023-11-30T17:08:08.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.348+0000 7f46c1d9b700 1 -- 172.21.15.49:0/590972231 learned_addr learned my addr 172.21.15.49:0/590972231 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:08.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.349+0000 7f46c259c700 1 --2- 172.21.15.49:0/590972231 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c40caab0 0x7f46c40aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:08.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.349+0000 7f46c1d9b700 1 -- 172.21.15.49:0/590972231 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c40caab0 msgr2=0x7f46c40aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:08.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.349+0000 7f46c1d9b700 1 --2- 172.21.15.49:0/590972231 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c40caab0 0x7f46c40aa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:08.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.349+0000 7f46c1d9b700 1 -- 172.21.15.49:0/590972231 >> v1:172.21.15.115:6789/0 conn(0x7f46c40aa960 legacy=0x7f46c40c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:08.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.349+0000 7f46c1d9b700 1 -- 172.21.15.49:0/590972231 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c40a9160 con 0x7f46c40cae90 2023-11-30T17:08:08.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.349+0000 7f46c1d9b700 1 --2- 172.21.15.49:0/590972231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46c40cae90 0x7f46c40c0ab0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f46ac006fd0 tx=0x7f46ac0090f0).ready entity=mon.0 client_cookie=209e9bbb978a9b75 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:08.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.349+0000 7f46c159a700 1 -- 172.21.15.49:0/590972231 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac00b600 con 0x7f46c40cae90 2023-11-30T17:08:08.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.349+0000 7f46c159a700 1 -- 172.21.15.49:0/590972231 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ac00b760 con 0x7f46c40cae90 2023-11-30T17:08:08.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.349+0000 7f46c159a700 1 -- 172.21.15.49:0/590972231 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac00bae0 con 0x7f46c40cae90 2023-11-30T17:08:08.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.349+0000 7f46c8937700 1 -- 172.21.15.49:0/590972231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46c40cae90 msgr2=0x7f46c40c0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:08.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.349+0000 7f46c8937700 1 --2- 172.21.15.49:0/590972231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46c40cae90 0x7f46c40c0ab0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f46ac006fd0 tx=0x7f46ac0090f0).stop 2023-11-30T17:08:08.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.349+0000 7f46c8937700 1 -- 172.21.15.49:0/590972231 shutdown_connections 2023-11-30T17:08:08.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.350+0000 7f46c8937700 1 --2- 172.21.15.49:0/590972231 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c40caab0 0x7f46c40aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:08.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.350+0000 7f46c8937700 1 --2- 172.21.15.49:0/590972231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46c40cae90 0x7f46c40c0ab0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:08.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.350+0000 7f46c8937700 1 -- 172.21.15.49:0/590972231 >> 172.21.15.49:0/590972231 conn(0x7f46c4094920 msgr2=0x7f46c406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:08.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.350+0000 7f46c8937700 1 -- 172.21.15.49:0/590972231 shutdown_connections 2023-11-30T17:08:08.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.350+0000 7f46c8937700 1 -- 172.21.15.49:0/590972231 wait complete. 2023-11-30T17:08:08.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.351+0000 7f46c8937700 1 Processor -- start 2023-11-30T17:08:08.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.351+0000 7f46c8937700 1 -- start start 2023-11-30T17:08:08.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.351+0000 7f46c8937700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46c40caab0 0x7f46c4153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:08.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.351+0000 7f46c8937700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c40cae90 0x7f46c41575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:08.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.351+0000 7f46c8937700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46c4157ad0 0x7f46c40cb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:08.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.351+0000 7f46c8937700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c40abc00 con 0x7f46c40caab0 2023-11-30T17:08:08.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.351+0000 7f46c8937700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c40aad50 con 0x7f46c4157ad0 2023-11-30T17:08:08.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.351+0000 7f46c8937700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c4156ba0 con 0x7f46c40cae90 2023-11-30T17:08:08.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.351+0000 7f46c259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46c40caab0 0x7f46c4153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:08.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.352+0000 7f46c259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46c40caab0 0x7f46c4153510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39696/0 (socket says 172.21.15.49:39696) 2023-11-30T17:08:08.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.352+0000 7f46c259c700 1 -- 172.21.15.49:0/2700390425 learned_addr learned my addr 172.21.15.49:0/2700390425 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:08.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.352+0000 7f46c1d9b700 1 --2- 172.21.15.49:0/2700390425 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c40cae90 0x7f46c41575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:08.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.352+0000 7f46c2d9d700 1 --2- 172.21.15.49:0/2700390425 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46c4157ad0 0x7f46c40cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:08.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.352+0000 7f46c259c700 1 -- 172.21.15.49:0/2700390425 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c40cae90 msgr2=0x7f46c41575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:08.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.352+0000 7f46c259c700 1 --2- 172.21.15.49:0/2700390425 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c40cae90 0x7f46c41575e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:08.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.352+0000 7f46c259c700 1 -- 172.21.15.49:0/2700390425 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46c4157ad0 msgr2=0x7f46c40cb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:08.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.352+0000 7f46c259c700 1 --2- 172.21.15.49:0/2700390425 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46c4157ad0 0x7f46c40cb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:08.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.352+0000 7f46c259c700 1 -- 172.21.15.49:0/2700390425 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ac009370 con 0x7f46c40caab0 2023-11-30T17:08:08.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.352+0000 7f46c259c700 1 --2- 172.21.15.49:0/2700390425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46c40caab0 0x7f46c4153510 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f46bc00a320 tx=0x7f46bc007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:08.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.352+0000 7f46ba7fc700 1 -- 172.21.15.49:0/2700390425 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc00e450 con 0x7f46c40caab0 2023-11-30T17:08:08.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.352+0000 7f46ba7fc700 1 -- 172.21.15.49:0/2700390425 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46bc00e5b0 con 0x7f46c40caab0 2023-11-30T17:08:08.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.352+0000 7f46c8937700 1 -- 172.21.15.49:0/2700390425 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c40aaff0 con 0x7f46c40caab0 2023-11-30T17:08:08.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.352+0000 7f46ba7fc700 1 -- 172.21.15.49:0/2700390425 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc00e930 con 0x7f46c40caab0 2023-11-30T17:08:08.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.352+0000 7f46c8937700 1 -- 172.21.15.49:0/2700390425 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c40ab5b0 con 0x7f46c40caab0 2023-11-30T17:08:08.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.353+0000 7f46c8937700 1 -- 172.21.15.49:0/2700390425 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c40abee0 con 0x7f46c40caab0 2023-11-30T17:08:08.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.354+0000 7f46ba7fc700 1 -- 172.21.15.49:0/2700390425 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f46bc00ed20 con 0x7f46c40caab0 2023-11-30T17:08:08.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.354+0000 7f46ba7fc700 1 --2- 172.21.15.49:0/2700390425 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f46a405f150 0x7f46a4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:08.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.354+0000 7f46ba7fc700 1 -- 172.21.15.49:0/2700390425 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f46bc07aed0 con 0x7f46c40caab0 2023-11-30T17:08:08.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.354+0000 7f46c1d9b700 1 --2- 172.21.15.49:0/2700390425 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f46a405f150 0x7f46a4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:08.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.355+0000 7f46c1d9b700 1 --2- 172.21.15.49:0/2700390425 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f46a405f150 0x7f46a4061610 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f46c40c6040 tx=0x7f46ac017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:08.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.358+0000 7f46ba7fc700 1 -- 172.21.15.49:0/2700390425 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f46bc04c1a0 con 0x7f46c40caab0 2023-11-30T17:08:08.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.572+0000 7f46c8937700 1 -- 172.21.15.49:0/2700390425 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46c406c860 con 0x7f46c40caab0 2023-11-30T17:08:08.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.573+0000 7f46ba7fc700 1 -- 172.21.15.49:0/2700390425 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4495 (secure 0 0 0) 0x7f46bc04f7c0 con 0x7f46c40caab0 2023-11-30T17:08:08.575 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:08:08.575 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1260333970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1260333970},{"type":"v1","addr":"172.21.15.115:6836","nonce":1260333970}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4938,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/2286472783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2286472783},{"type":"v1","addr":"172.21.15.49:6834","nonce":2286472783}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4941,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1299033463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1299033463},{"type":"v1","addr":"172.21.15.49:6835","nonce":1299033463}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:08:05.200966+0000","modified":"2023-11-30T17:08:08.207522+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4944},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4944":{"gid":4944,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/3449611740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3449611740},{"type":"v1","addr":"172.21.15.115:6837","nonce":3449611740}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-11-30T17:08:08.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.575+0000 7f46c8937700 1 -- 172.21.15.49:0/2700390425 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f46a405f150 msgr2=0x7f46a4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:08.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.575+0000 7f46c8937700 1 --2- 172.21.15.49:0/2700390425 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f46a405f150 0x7f46a4061610 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f46c40c6040 tx=0x7f46ac017000).stop 2023-11-30T17:08:08.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.575+0000 7f46c8937700 1 -- 172.21.15.49:0/2700390425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46c40caab0 msgr2=0x7f46c4153510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:08.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.575+0000 7f46c8937700 1 --2- 172.21.15.49:0/2700390425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46c40caab0 0x7f46c4153510 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f46bc00a320 tx=0x7f46bc007900).stop 2023-11-30T17:08:08.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.575+0000 7f46c8937700 1 -- 172.21.15.49:0/2700390425 shutdown_connections 2023-11-30T17:08:08.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.575+0000 7f46c8937700 1 --2- 172.21.15.49:0/2700390425 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46c4157ad0 0x7f46c40cb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:08.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.575+0000 7f46c8937700 1 --2- 172.21.15.49:0/2700390425 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f46a405f150 0x7f46a4061610 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:08.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.575+0000 7f46c8937700 1 --2- 172.21.15.49:0/2700390425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46c40caab0 0x7f46c4153510 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:08.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.575+0000 7f46c8937700 1 --2- 172.21.15.49:0/2700390425 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c40cae90 0x7f46c41575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:08.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.575+0000 7f46c8937700 1 -- 172.21.15.49:0/2700390425 >> 172.21.15.49:0/2700390425 conn(0x7f46c4094920 msgr2=0x7f46c40aea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:08.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.575+0000 7f46c8937700 1 -- 172.21.15.49:0/2700390425 shutdown_connections 2023-11-30T17:08:08.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.575+0000 7f46c8937700 1 -- 172.21.15.49:0/2700390425 wait complete. 2023-11-30T17:08:08.577 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 16 2023-11-30T17:08:08.589 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:08:08.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.706+0000 7f2f070d6700 1 Processor -- start 2023-11-30T17:08:08.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.706+0000 7f2f070d6700 1 -- start start 2023-11-30T17:08:08.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.707+0000 7f2f070d6700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2f00157660 0x7f2f00157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:08.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.707+0000 7f2f070d6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f000c0180 0x7f2f001589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:08.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.707+0000 7f2f070d6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2f000c1750 0x7f2f000c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:08.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.707+0000 7f2f070d6700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f000c12c0 con 0x7f2f000c1750 2023-11-30T17:08:08.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.707+0000 7f2f070d6700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f000c06b0 con 0x7f2f00157660 2023-11-30T17:08:08.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.707+0000 7f2f070d6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f000c0990 con 0x7f2f000c0180 2023-11-30T17:08:08.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.707+0000 7f2f068d5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2f000c1750 0x7f2f000c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:08.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.707+0000 7f2f068d5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2f000c1750 0x7f2f000c1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39706/0 (socket says 172.21.15.49:39706) 2023-11-30T17:08:08.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.707+0000 7f2f068d5700 1 -- 172.21.15.49:0/798794687 learned_addr learned my addr 172.21.15.49:0/798794687 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:08.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.707+0000 7f2f060d4700 1 --2- 172.21.15.49:0/798794687 >> v2:172.21.15.115:3300/0 conn(0x7f2f00157660 0x7f2f00157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:08.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.707+0000 7f2f058d3700 1 --2- 172.21.15.49:0/798794687 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f000c0180 0x7f2f001589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:08.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.707+0000 7f2f068d5700 1 -- 172.21.15.49:0/798794687 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f000c0180 msgr2=0x7f2f001589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:08.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.707+0000 7f2f068d5700 1 --2- 172.21.15.49:0/798794687 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f000c0180 0x7f2f001589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:08.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.707+0000 7f2f068d5700 1 -- 172.21.15.49:0/798794687 >> v2:172.21.15.115:3300/0 conn(0x7f2f00157660 msgr2=0x7f2f00157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:08.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.707+0000 7f2f068d5700 1 --2- 172.21.15.49:0/798794687 >> v2:172.21.15.115:3300/0 conn(0x7f2f00157660 0x7f2f00157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:08.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.707+0000 7f2f068d5700 1 -- 172.21.15.49:0/798794687 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f000c0c70 con 0x7f2f000c1750 2023-11-30T17:08:08.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.707+0000 7f2f068d5700 1 --2- 172.21.15.49:0/798794687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f000c1750 0x7f2f000c1ba0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f2f000839a0 tx=0x7f2ef8009840).ready entity=mon.0 client_cookie=7ac77e28133ab5bf server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:08.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.707+0000 7f2f050d2700 1 -- 172.21.15.49:0/798794687 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef800e070 con 0x7f2f000c1750 2023-11-30T17:08:08.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.708+0000 7f2f050d2700 1 -- 172.21.15.49:0/798794687 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef800ba50 con 0x7f2f000c1750 2023-11-30T17:08:08.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.708+0000 7f2f050d2700 1 -- 172.21.15.49:0/798794687 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef800bdd0 con 0x7f2f000c1750 2023-11-30T17:08:08.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.708+0000 7f2f070d6700 1 -- 172.21.15.49:0/798794687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f000c1750 msgr2=0x7f2f000c1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:08.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.708+0000 7f2f070d6700 1 --2- 172.21.15.49:0/798794687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f000c1750 0x7f2f000c1ba0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f2f000839a0 tx=0x7f2ef8009840).stop 2023-11-30T17:08:08.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.708+0000 7f2f070d6700 1 -- 172.21.15.49:0/798794687 shutdown_connections 2023-11-30T17:08:08.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.708+0000 7f2f070d6700 1 --2- 172.21.15.49:0/798794687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f000c1750 0x7f2f000c1ba0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:08.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.708+0000 7f2f070d6700 1 --2- 172.21.15.49:0/798794687 >> v2:172.21.15.115:3300/0 conn(0x7f2f00157660 0x7f2f00157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:08.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.708+0000 7f2f070d6700 1 --2- 172.21.15.49:0/798794687 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f000c0180 0x7f2f001589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:08.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.708+0000 7f2f070d6700 1 -- 172.21.15.49:0/798794687 >> 172.21.15.49:0/798794687 conn(0x7f2f000cb000 msgr2=0x7f2f000cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:08.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.708+0000 7f2f070d6700 1 -- 172.21.15.49:0/798794687 shutdown_connections 2023-11-30T17:08:08.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.708+0000 7f2f070d6700 1 -- 172.21.15.49:0/798794687 wait complete. 2023-11-30T17:08:08.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.709+0000 7f2f070d6700 1 Processor -- start 2023-11-30T17:08:08.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.709+0000 7f2f070d6700 1 -- start start 2023-11-30T17:08:08.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.710+0000 7f2f070d6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f000c0180 0x7f2f000b0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:08.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.710+0000 7f2f070d6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f000c1750 0x7f2f00164a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:08.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.710+0000 7f2f070d6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f00157660 0x7f2f000af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:08.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.710+0000 7f2f070d6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f000c37b0 con 0x7f2f000c0180 2023-11-30T17:08:08.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.710+0000 7f2f070d6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f00164f30 con 0x7f2f00157660 2023-11-30T17:08:08.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.710+0000 7f2f070d6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f000b0ae0 con 0x7f2f000c1750 2023-11-30T17:08:08.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.710+0000 7f2f060d4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f000c0180 0x7f2f000b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:08.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.710+0000 7f2f060d4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f000c0180 0x7f2f000b0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39708/0 (socket says 172.21.15.49:39708) 2023-11-30T17:08:08.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.710+0000 7f2f060d4700 1 -- 172.21.15.49:0/654303454 learned_addr learned my addr 172.21.15.49:0/654303454 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:08.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.710+0000 7f2f060d4700 1 -- 172.21.15.49:0/654303454 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f000c1750 msgr2=0x7f2f00164a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:08.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.710+0000 7f2f060d4700 1 --2- 172.21.15.49:0/654303454 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f000c1750 0x7f2f00164a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:08:08.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.710+0000 7f2f060d4700 1 -- 172.21.15.49:0/654303454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f00157660 msgr2=0x7f2f000af2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:08.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.710+0000 7f2f060d4700 1 --2- 172.21.15.49:0/654303454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f00157660 0x7f2f000af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:08:08.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.710+0000 7f2f060d4700 1 -- 172.21.15.49:0/654303454 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef8009ae0 con 0x7f2f000c0180 2023-11-30T17:08:08.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.710+0000 7f2f060d4700 1 --2- 172.21.15.49:0/654303454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f000c0180 0x7f2f000b0420 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f2efc00d8c0 tx=0x7f2efc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:08.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.711+0000 7f2ef67fc700 1 -- 172.21.15.49:0/654303454 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc0095b0 con 0x7f2f000c0180 2023-11-30T17:08:08.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.711+0000 7f2ef67fc700 1 -- 172.21.15.49:0/654303454 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2efc009710 con 0x7f2f000c0180 2023-11-30T17:08:08.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.711+0000 7f2f070d6700 1 -- 172.21.15.49:0/654303454 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f000b0dc0 con 0x7f2f000c0180 2023-11-30T17:08:08.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.711+0000 7f2ef67fc700 1 -- 172.21.15.49:0/654303454 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc009a90 con 0x7f2f000c0180 2023-11-30T17:08:08.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.711+0000 7f2f070d6700 1 -- 172.21.15.49:0/654303454 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f000af7a0 con 0x7f2f000c0180 2023-11-30T17:08:08.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.712+0000 7f2f070d6700 1 -- 172.21.15.49:0/654303454 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f000c32a0 con 0x7f2f000c0180 2023-11-30T17:08:08.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.712+0000 7f2ef67fc700 1 -- 172.21.15.49:0/654303454 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2efc013480 con 0x7f2f000c0180 2023-11-30T17:08:08.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.712+0000 7f2ef67fc700 1 --2- 172.21.15.49:0/654303454 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2ee405f150 0x7f2ee4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:08.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.712+0000 7f2ef67fc700 1 -- 172.21.15.49:0/654303454 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2efc079f50 con 0x7f2f000c0180 2023-11-30T17:08:08.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.713+0000 7f2f058d3700 1 --2- 172.21.15.49:0/654303454 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2ee405f150 0x7f2ee4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:08.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.713+0000 7f2f058d3700 1 --2- 172.21.15.49:0/654303454 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2ee405f150 0x7f2ee4061610 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f2f00152690 tx=0x7f2ef0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:08.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.717+0000 7f2ef67fc700 1 -- 172.21.15.49:0/654303454 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2f000c32a0 con 0x7f2f000c0180 2023-11-30T17:08:08.792 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-11-30T17:08:08.790+0000 7f6ce1955700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-30T17:08:08.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.891+0000 7f2f070d6700 1 -- 172.21.15.49:0/654303454 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f000c32a0 con 0x7f2f000c0180 2023-11-30T17:08:08.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.892+0000 7f2ef67fc700 1 -- 172.21.15.49:0/654303454 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f2f000c32a0 con 0x7f2f000c0180 2023-11-30T17:08:08.893 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:08:08.894 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":34,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:08:06.202698+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:08:03.325011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-30T17:08:04.171666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:08:08.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.894+0000 7f2f070d6700 1 -- 172.21.15.49:0/654303454 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2ee405f150 msgr2=0x7f2ee4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:08.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.894+0000 7f2f070d6700 1 --2- 172.21.15.49:0/654303454 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2ee405f150 0x7f2ee4061610 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f2f00152690 tx=0x7f2ef0008040).stop 2023-11-30T17:08:08.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.894+0000 7f2f070d6700 1 -- 172.21.15.49:0/654303454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f000c0180 msgr2=0x7f2f000b0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:08.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.894+0000 7f2f070d6700 1 --2- 172.21.15.49:0/654303454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f000c0180 0x7f2f000b0420 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f2efc00d8c0 tx=0x7f2efc008040).stop 2023-11-30T17:08:08.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.894+0000 7f2f070d6700 1 -- 172.21.15.49:0/654303454 shutdown_connections 2023-11-30T17:08:08.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.894+0000 7f2f070d6700 1 --2- 172.21.15.49:0/654303454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f00157660 0x7f2f000af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:08:08.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.894+0000 7f2f070d6700 1 --2- 172.21.15.49:0/654303454 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2ee405f150 0x7f2ee4061610 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:08.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.894+0000 7f2f070d6700 1 --2- 172.21.15.49:0/654303454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f000c0180 0x7f2f000b0420 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:08.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.894+0000 7f2f070d6700 1 --2- 172.21.15.49:0/654303454 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f000c1750 0x7f2f00164a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:08:08.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.894+0000 7f2f070d6700 1 -- 172.21.15.49:0/654303454 >> 172.21.15.49:0/654303454 conn(0x7f2f000cb000 msgr2=0x7f2f000632a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:08.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.894+0000 7f2f070d6700 1 -- 172.21.15.49:0/654303454 shutdown_connections 2023-11-30T17:08:08.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:08.894+0000 7f2f070d6700 1 -- 172.21.15.49:0/654303454 wait complete. 2023-11-30T17:08:08.907 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-30T17:08:08.908 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:08:09.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.024+0000 7f2babfff700 1 Processor -- start 2023-11-30T17:08:09.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.024+0000 7f2babfff700 1 -- start start 2023-11-30T17:08:09.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.025+0000 7f2babfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2bac154120 0x7f2bac0be510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:09.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.025+0000 7f2babfff700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bac0bfc00 con 0x7f2bac0c46e0 2023-11-30T17:08:09.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.025+0000 7f2babfff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bac0beff0 con 0x7f2bac154500 2023-11-30T17:08:09.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.025+0000 7f2babfff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bac0bf2d0 con 0x7f2bac154120 2023-11-30T17:08:09.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.025+0000 7f2bab7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2bac0c46e0 0x7f2bac15def0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49380/0 (socket says 172.21.15.49:49380) 2023-11-30T17:08:09.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.025+0000 7f2bab7fe700 1 -- 172.21.15.49:0/4116919229 learned_addr learned my addr 172.21.15.49:0/4116919229 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:08:09.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.025+0000 7f2baaffd700 1 --2- 172.21.15.49:0/4116919229 >> v2:172.21.15.115:3300/0 conn(0x7f2bac154120 0x7f2bac0be510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:09.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.025+0000 7f2ba9ffb700 1 -- 172.21.15.49:0/4116919229 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2729860985 0 0) 0x7f2bac0bfc00 con 0x7f2bac0c46e0 2023-11-30T17:08:09.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.025+0000 7f2ba9ffb700 1 -- 172.21.15.49:0/4116919229 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b980033f0 con 0x7f2bac0c46e0 2023-11-30T17:08:09.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.026+0000 7f2baaffd700 1 -- 172.21.15.49:0/4116919229 >> v1:172.21.15.115:6789/0 conn(0x7f2bac154500 legacy=0x7f2bac0c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:09.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.026+0000 7f2ba9ffb700 1 -- 172.21.15.49:0/4116919229 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 508284173 0 0) 0x7f2bac0beff0 con 0x7f2bac154500 2023-11-30T17:08:09.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.026+0000 7f2baaffd700 1 -- 172.21.15.49:0/4116919229 >> v1:172.21.15.49:6789/0 conn(0x7f2bac0c46e0 legacy=0x7f2bac15def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:09.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.026+0000 7f2baaffd700 1 -- 172.21.15.49:0/4116919229 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bac0bf5b0 con 0x7f2bac154120 2023-11-30T17:08:09.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.026+0000 7f2baaffd700 1 --2- 172.21.15.49:0/4116919229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bac154120 0x7f2bac0be510 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f2ba4009eb0 tx=0x7f2ba4009780).ready entity=mon.1 client_cookie=f67b048532e36e0e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:09.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.026+0000 7f2ba9ffb700 1 -- 172.21.15.49:0/4116919229 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba400e070 con 0x7f2bac154120 2023-11-30T17:08:09.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.026+0000 7f2ba9ffb700 1 -- 172.21.15.49:0/4116919229 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba400b920 con 0x7f2bac154120 2023-11-30T17:08:09.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.026+0000 7f2ba9ffb700 1 -- 172.21.15.49:0/4116919229 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c001470 con 0x7f2bac154120 2023-11-30T17:08:09.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.026+0000 7f2babfff700 1 -- 172.21.15.49:0/4116919229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bac154120 msgr2=0x7f2bac0be510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:09.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.026+0000 7f2babfff700 1 --2- 172.21.15.49:0/4116919229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bac154120 0x7f2bac0be510 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f2ba4009eb0 tx=0x7f2ba4009780).stop 2023-11-30T17:08:09.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.026+0000 7f2babfff700 1 -- 172.21.15.49:0/4116919229 shutdown_connections 2023-11-30T17:08:09.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.026+0000 7f2babfff700 1 --2- 172.21.15.49:0/4116919229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bac154120 0x7f2bac0be510 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:09.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.026+0000 7f2babfff700 1 -- 172.21.15.49:0/4116919229 >> 172.21.15.49:0/4116919229 conn(0x7f2bac083000 msgr2=0x7f2bac092540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:09.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.026+0000 7f2babfff700 1 -- 172.21.15.49:0/4116919229 shutdown_connections 2023-11-30T17:08:09.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.026+0000 7f2babfff700 1 -- 172.21.15.49:0/4116919229 wait complete. 2023-11-30T17:08:09.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.028+0000 7f2babfff700 1 Processor -- start 2023-11-30T17:08:09.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.028+0000 7f2babfff700 1 -- start start 2023-11-30T17:08:09.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.028+0000 7f2babfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bac0c46e0 0x7f2bac0bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:09.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.028+0000 7f2babfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bac154120 0x7f2bac14f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:09.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.028+0000 7f2babfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bac154500 0x7f2bac0ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:09.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.028+0000 7f2babfff700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac0aeda0 con 0x7f2bac154500 2023-11-30T17:08:09.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.028+0000 7f2babfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac0c03d0 con 0x7f2bac0c46e0 2023-11-30T17:08:09.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.028+0000 7f2babfff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac0ae7e0 con 0x7f2bac154120 2023-11-30T17:08:09.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.029+0000 7f2bab7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bac154500 0x7f2bac0ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:09.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.029+0000 7f2bab7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bac154500 0x7f2bac0ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39712/0 (socket says 172.21.15.49:39712) 2023-11-30T17:08:09.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.029+0000 7f2bab7fe700 1 -- 172.21.15.49:0/933361262 learned_addr learned my addr 172.21.15.49:0/933361262 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:09.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.029+0000 7f2baaffd700 1 --2- 172.21.15.49:0/933361262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bac0c46e0 0x7f2bac0bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:09.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.029+0000 7f2baa7fc700 1 --2- 172.21.15.49:0/933361262 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bac154120 0x7f2bac14f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:09.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.029+0000 7f2bab7fe700 1 -- 172.21.15.49:0/933361262 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bac154120 msgr2=0x7f2bac14f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:09.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.029+0000 7f2bab7fe700 1 --2- 172.21.15.49:0/933361262 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bac154120 0x7f2bac14f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:09.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.029+0000 7f2bab7fe700 1 -- 172.21.15.49:0/933361262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bac0c46e0 msgr2=0x7f2bac0bfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:09.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.029+0000 7f2bab7fe700 1 --2- 172.21.15.49:0/933361262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bac0c46e0 0x7f2bac0bfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:09.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.029+0000 7f2bab7fe700 1 -- 172.21.15.49:0/933361262 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba4009a20 con 0x7f2bac154500 2023-11-30T17:08:09.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.029+0000 7f2baaffd700 1 --2- 172.21.15.49:0/933361262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bac0c46e0 0x7f2bac0bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:08:09.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.029+0000 7f2bab7fe700 1 --2- 172.21.15.49:0/933361262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bac154500 0x7f2bac0ac8c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f2b9c00c810 tx=0x7f2b9c001b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:09.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.029+0000 7f2ba2ffd700 1 -- 172.21.15.49:0/933361262 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c007170 con 0x7f2bac154500 2023-11-30T17:08:09.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.029+0000 7f2ba2ffd700 1 -- 172.21.15.49:0/933361262 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9c0072d0 con 0x7f2bac154500 2023-11-30T17:08:09.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.029+0000 7f2babfff700 1 -- 172.21.15.49:0/933361262 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bac0ac5d0 con 0x7f2bac154500 2023-11-30T17:08:09.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.029+0000 7f2ba2ffd700 1 -- 172.21.15.49:0/933361262 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c0048c0 con 0x7f2bac154500 2023-11-30T17:08:09.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.029+0000 7f2babfff700 1 -- 172.21.15.49:0/933361262 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bac0ae500 con 0x7f2bac154500 2023-11-30T17:08:09.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.030+0000 7f2babfff700 1 -- 172.21.15.49:0/933361262 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bac06c7c0 con 0x7f2bac154500 2023-11-30T17:08:09.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.031+0000 7f2ba2ffd700 1 -- 172.21.15.49:0/933361262 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2b9c004cb0 con 0x7f2bac154500 2023-11-30T17:08:09.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.031+0000 7f2ba2ffd700 1 --2- 172.21.15.49:0/933361262 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2b8c05f150 0x7f2b8c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:09.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.031+0000 7f2ba2ffd700 1 -- 172.21.15.49:0/933361262 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2b9c07a270 con 0x7f2bac154500 2023-11-30T17:08:09.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.031+0000 7f2baaffd700 1 --2- 172.21.15.49:0/933361262 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2b8c05f150 0x7f2b8c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:09.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.032+0000 7f2baaffd700 1 --2- 172.21.15.49:0/933361262 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2b8c05f150 0x7f2b8c061610 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f2ba4009480 tx=0x7f2ba4009780).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:09.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.035+0000 7f2ba2ffd700 1 -- 172.21.15.49:0/933361262 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2b9c04b540 con 0x7f2bac154500 2023-11-30T17:08:09.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.202+0000 7f2babfff700 1 -- 172.21.15.49:0/933361262 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2bac0a86e0 con 0x7f2b8c05f150 2023-11-30T17:08:09.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.212+0000 7f2ba2ffd700 1 -- 172.21.15.49:0/933361262 <== mgr.4105 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+328104 (secure 0 0 0) 0x7f2bac0a86e0 con 0x7f2b8c05f150 2023-11-30T17:08:09.218 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:08:09.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.215+0000 7f2babfff700 1 -- 172.21.15.49:0/933361262 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2b8c05f150 msgr2=0x7f2b8c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:09.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.215+0000 7f2babfff700 1 --2- 172.21.15.49:0/933361262 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2b8c05f150 0x7f2b8c061610 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f2ba4009480 tx=0x7f2ba4009780).stop 2023-11-30T17:08:09.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.215+0000 7f2babfff700 1 -- 172.21.15.49:0/933361262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bac154500 msgr2=0x7f2bac0ac8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:09.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.215+0000 7f2babfff700 1 --2- 172.21.15.49:0/933361262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bac154500 0x7f2bac0ac8c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f2b9c00c810 tx=0x7f2b9c001b30).stop 2023-11-30T17:08:09.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.215+0000 7f2babfff700 1 -- 172.21.15.49:0/933361262 shutdown_connections 2023-11-30T17:08:09.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.215+0000 7f2babfff700 1 --2- 172.21.15.49:0/933361262 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2b8c05f150 0x7f2b8c061610 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:09.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.215+0000 7f2babfff700 1 --2- 172.21.15.49:0/933361262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2bac154500 0x7f2bac0ac8c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:09.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.215+0000 7f2babfff700 1 --2- 172.21.15.49:0/933361262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bac0c46e0 0x7f2bac0bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:09.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.215+0000 7f2babfff700 1 --2- 172.21.15.49:0/933361262 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bac154120 0x7f2bac14f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:09.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.215+0000 7f2babfff700 1 -- 172.21.15.49:0/933361262 >> 172.21.15.49:0/933361262 conn(0x7f2bac083000 msgr2=0x7f2bac0c3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:09.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.215+0000 7f2babfff700 1 -- 172.21.15.49:0/933361262 shutdown_connections 2023-11-30T17:08:09.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.216+0000 7f2babfff700 1 -- 172.21.15.49:0/933361262 wait complete. 2023-11-30T17:08:09.221 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:08:09.229 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2023-11-30T17:08:08.850354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2379392,"kb_used_data":2624,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752595328,"statfs":{"total":773094113280,"available":770657615872,"internally_reserved":0,"allocated":2686976,"data_stored":1055368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4305,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.935501"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809995+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808400+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809030+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805751+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812536+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808147+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.813568+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.813370+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808762+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805743+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812466+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808643+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812111+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807701+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807892+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.813006+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812423+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807542+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807433+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.811985+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808395+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807211+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.810406+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807394+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805679+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807960+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805677+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807975+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807250+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812037+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809819+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812141+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809426+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.810207+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805186+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807782+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807465+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.811383+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805164+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807600+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807542+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808005+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808306+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808589+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807396+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805293+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.810296+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812604+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.810700+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809116+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812817+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805134+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.811545+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812365+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.813156+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.811035+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.810668+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:07:58.974820+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:07:58.974820+0000","last_peered":"2023-11-30T17:07:58.974820+0000","last_clean":"2023-11-30T17:07:58.974820+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:07:58.974820+0000","last_undegraded":"2023-11-30T17:07:58.974820+0000","last_fullsized":"2023-11-30T17:07:58.974820+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.810695+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:07:59.139902+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:07:59.139902+0000","last_peered":"2023-11-30T17:07:59.139902+0000","last_clean":"2023-11-30T17:07:59.139902+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:07:59.139902+0000","last_undegraded":"2023-11-30T17:07:59.139902+0000","last_fullsized":"2023-11-30T17:07:59.139902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.810377+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:08:00.083180+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:08:00.083180+0000","last_peered":"2023-11-30T17:08:00.083180+0000","last_clean":"2023-11-30T17:08:00.083180+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:08:00.083180+0000","last_undegraded":"2023-11-30T17:08:00.083180+0000","last_fullsized":"2023-11-30T17:08:00.083180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.811554+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:07:59.139903+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:07:59.139903+0000","last_peered":"2023-11-30T17:07:59.139903+0000","last_clean":"2023-11-30T17:07:59.139903+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:07:59.139903+0000","last_undegraded":"2023-11-30T17:07:59.139903+0000","last_fullsized":"2023-11-30T17:07:59.139903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:08:00.083219+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:08:00.083219+0000","last_peered":"2023-11-30T17:08:00.083219+0000","last_clean":"2023-11-30T17:08:00.083219+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:08:00.083219+0000","last_undegraded":"2023-11-30T17:08:00.083219+0000","last_fullsized":"2023-11-30T17:08:00.083219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809064+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:08:00.083203+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:08:00.083203+0000","last_peered":"2023-11-30T17:08:00.083203+0000","last_clean":"2023-11-30T17:08:00.083203+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:08:00.083203+0000","last_undegraded":"2023-11-30T17:08:00.083203+0000","last_fullsized":"2023-11-30T17:08:00.083203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809456+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:08:00.083256+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:08:00.083256+0000","last_peered":"2023-11-30T17:08:00.083256+0000","last_clean":"2023-11-30T17:08:00.083256+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:08:00.083256+0000","last_undegraded":"2023-11-30T17:08:00.083256+0000","last_fullsized":"2023-11-30T17:08:00.083256+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809181+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:07:58.974806+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:07:58.974806+0000","last_peered":"2023-11-30T17:07:58.974806+0000","last_clean":"2023-11-30T17:07:58.974806+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:07:58.974806+0000","last_undegraded":"2023-11-30T17:07:58.974806+0000","last_fullsized":"2023-11-30T17:07:58.974806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807389+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:07:58.975375+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:07:58.975375+0000","last_peered":"2023-11-30T17:07:58.975375+0000","last_clean":"2023-11-30T17:07:58.975375+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:07:58.975375+0000","last_undegraded":"2023-11-30T17:07:58.975375+0000","last_fullsized":"2023-11-30T17:07:58.975375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:08:09.235 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:08:09.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.385+0000 7f950759e700 1 Processor -- start 2023-11-30T17:08:09.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.385+0000 7f950759e700 1 -- start start 2023-11-30T17:08:09.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.386+0000 7f950759e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95080c0180 0x7f9508157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:09.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.386+0000 7f950759e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95080c12c0 con 0x7f95080c1750 2023-11-30T17:08:09.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.386+0000 7f950759e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95080c06b0 con 0x7f9508157660 2023-11-30T17:08:09.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.386+0000 7f950759e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95080c0990 con 0x7f95080c0180 2023-11-30T17:08:09.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.386+0000 7f9506d9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f95080c1750 0x7f95080648d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49392/0 (socket says 172.21.15.49:49392) 2023-11-30T17:08:09.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.386+0000 7f9506d9d700 1 -- 172.21.15.49:0/2928723032 learned_addr learned my addr 172.21.15.49:0/2928723032 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:08:09.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.386+0000 7f9505d9b700 1 --2- 172.21.15.49:0/2928723032 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95080c0180 0x7f9508157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:09.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.386+0000 7f950559a700 1 -- 172.21.15.49:0/2928723032 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1070879271 0 0) 0x7f95080c12c0 con 0x7f95080c1750 2023-11-30T17:08:09.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.387+0000 7f950559a700 1 -- 172.21.15.49:0/2928723032 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94f40033f0 con 0x7f95080c1750 2023-11-30T17:08:09.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.387+0000 7f950559a700 1 -- 172.21.15.49:0/2928723032 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 564151470 0 0) 0x7f95080c06b0 con 0x7f9508157660 2023-11-30T17:08:09.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.387+0000 7f950559a700 1 -- 172.21.15.49:0/2928723032 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95080c12c0 con 0x7f9508157660 2023-11-30T17:08:09.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.387+0000 7f9505d9b700 1 -- 172.21.15.49:0/2928723032 >> v1:172.21.15.115:6789/0 conn(0x7f9508157660 legacy=0x7f95081589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:09.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.387+0000 7f9505d9b700 1 -- 172.21.15.49:0/2928723032 >> v1:172.21.15.49:6789/0 conn(0x7f95080c1750 legacy=0x7f95080648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:09.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.387+0000 7f9505d9b700 1 -- 172.21.15.49:0/2928723032 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95080c0c70 con 0x7f95080c0180 2023-11-30T17:08:09.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.387+0000 7f9505d9b700 1 --2- 172.21.15.49:0/2928723032 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95080c0180 0x7f9508157a40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f94f0009790 tx=0x7f94f0009060).ready entity=mon.2 client_cookie=52d00583e2f57fb3 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:09.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.387+0000 7f950559a700 1 -- 172.21.15.49:0/2928723032 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f000f510 con 0x7f95080c0180 2023-11-30T17:08:09.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.387+0000 7f950559a700 1 -- 172.21.15.49:0/2928723032 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f000f670 con 0x7f95080c0180 2023-11-30T17:08:09.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.387+0000 7f950559a700 1 -- 172.21.15.49:0/2928723032 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f000f9f0 con 0x7f95080c0180 2023-11-30T17:08:09.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.388+0000 7f950759e700 1 -- 172.21.15.49:0/2928723032 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95080c0180 msgr2=0x7f9508157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:09.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.388+0000 7f950759e700 1 --2- 172.21.15.49:0/2928723032 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95080c0180 0x7f9508157a40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f94f0009790 tx=0x7f94f0009060).stop 2023-11-30T17:08:09.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.388+0000 7f950759e700 1 -- 172.21.15.49:0/2928723032 shutdown_connections 2023-11-30T17:08:09.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.388+0000 7f950759e700 1 --2- 172.21.15.49:0/2928723032 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95080c0180 0x7f9508157a40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:09.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.388+0000 7f950759e700 1 -- 172.21.15.49:0/2928723032 >> 172.21.15.49:0/2928723032 conn(0x7f95080cb000 msgr2=0x7f95080cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:09.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.388+0000 7f950759e700 1 -- 172.21.15.49:0/2928723032 shutdown_connections 2023-11-30T17:08:09.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.388+0000 7f950759e700 1 -- 172.21.15.49:0/2928723032 wait complete. 2023-11-30T17:08:09.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.389+0000 7f950759e700 1 Processor -- start 2023-11-30T17:08:09.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.389+0000 7f950759e700 1 -- start start 2023-11-30T17:08:09.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.389+0000 7f950759e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95080c0180 0x7f950814ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:09.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.389+0000 7f950759e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95080c1750 0x7f95081689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:09.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.389+0000 7f950759e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9508157660 0x7f9508063700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:09.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.390+0000 7f950759e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9508164af0 con 0x7f9508157660 2023-11-30T17:08:09.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.390+0000 7f950759e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9508164db0 con 0x7f95080c1750 2023-11-30T17:08:09.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.390+0000 7f950759e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9508165090 con 0x7f95080c0180 2023-11-30T17:08:09.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.390+0000 7f9506d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9508157660 0x7f9508063700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:09.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.390+0000 7f9506d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9508157660 0x7f9508063700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39714/0 (socket says 172.21.15.49:39714) 2023-11-30T17:08:09.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.390+0000 7f9506d9d700 1 -- 172.21.15.49:0/3609367417 learned_addr learned my addr 172.21.15.49:0/3609367417 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:09.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.390+0000 7f950659c700 1 --2- 172.21.15.49:0/3609367417 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95080c0180 0x7f950814ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:09.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.390+0000 7f9505d9b700 1 --2- 172.21.15.49:0/3609367417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95080c1750 0x7f95081689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:09.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.390+0000 7f9506d9d700 1 -- 172.21.15.49:0/3609367417 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95080c0180 msgr2=0x7f950814ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:09.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.390+0000 7f9506d9d700 1 --2- 172.21.15.49:0/3609367417 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95080c0180 0x7f950814ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:09.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.390+0000 7f9506d9d700 1 -- 172.21.15.49:0/3609367417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95080c1750 msgr2=0x7f95081689e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:09.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.390+0000 7f9506d9d700 1 --2- 172.21.15.49:0/3609367417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95080c1750 0x7f95081689e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:09.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.390+0000 7f9506d9d700 1 -- 172.21.15.49:0/3609367417 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f00092a0 con 0x7f9508157660 2023-11-30T17:08:09.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.390+0000 7f9506d9d700 1 --2- 172.21.15.49:0/3609367417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9508157660 0x7f9508063700 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f94f800c490 tx=0x7f94f8007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:09.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.390+0000 7f94fe7fc700 1 -- 172.21.15.49:0/3609367417 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f80070d0 con 0x7f9508157660 2023-11-30T17:08:09.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.390+0000 7f94fe7fc700 1 -- 172.21.15.49:0/3609367417 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f8007230 con 0x7f9508157660 2023-11-30T17:08:09.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.390+0000 7f950759e700 1 -- 172.21.15.49:0/3609367417 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9508165370 con 0x7f9508157660 2023-11-30T17:08:09.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.390+0000 7f94fe7fc700 1 -- 172.21.15.49:0/3609367417 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f80075b0 con 0x7f9508157660 2023-11-30T17:08:09.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.390+0000 7f950759e700 1 -- 172.21.15.49:0/3609367417 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9508165930 con 0x7f9508157660 2023-11-30T17:08:09.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.391+0000 7f950759e700 1 -- 172.21.15.49:0/3609367417 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f950806c7c0 con 0x7f9508157660 2023-11-30T17:08:09.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.392+0000 7f94fe7fc700 1 -- 172.21.15.49:0/3609367417 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f94f8005bc0 con 0x7f9508157660 2023-11-30T17:08:09.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.392+0000 7f94fe7fc700 1 --2- 172.21.15.49:0/3609367417 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f94e805f150 0x7f94e8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:09.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.392+0000 7f94fe7fc700 1 -- 172.21.15.49:0/3609367417 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f94f8079990 con 0x7f9508157660 2023-11-30T17:08:09.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.392+0000 7f950659c700 1 --2- 172.21.15.49:0/3609367417 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f94e805f150 0x7f94e8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:09.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.393+0000 7f950659c700 1 --2- 172.21.15.49:0/3609367417 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f94e805f150 0x7f94e8061610 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f9500003fc0 tx=0x7f9500007f50).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:09.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.396+0000 7f94fe7fc700 1 -- 172.21.15.49:0/3609367417 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f94f804ac60 con 0x7f9508157660 2023-11-30T17:08:09.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.563+0000 7f950759e700 1 -- 172.21.15.49:0/3609367417 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9508154f60 con 0x7f94e805f150 2023-11-30T17:08:09.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.573+0000 7f94fe7fc700 1 -- 172.21.15.49:0/3609367417 <== mgr.4105 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+328104 (secure 0 0 0) 0x7f9508154f60 con 0x7f94e805f150 2023-11-30T17:08:09.578 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:08:09.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.576+0000 7f950759e700 1 -- 172.21.15.49:0/3609367417 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f94e805f150 msgr2=0x7f94e8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:09.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.576+0000 7f950759e700 1 --2- 172.21.15.49:0/3609367417 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f94e805f150 0x7f94e8061610 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f9500003fc0 tx=0x7f9500007f50).stop 2023-11-30T17:08:09.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.576+0000 7f950759e700 1 -- 172.21.15.49:0/3609367417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9508157660 msgr2=0x7f9508063700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:09.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.576+0000 7f950759e700 1 --2- 172.21.15.49:0/3609367417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9508157660 0x7f9508063700 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f94f800c490 tx=0x7f94f8007c50).stop 2023-11-30T17:08:09.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.576+0000 7f950759e700 1 -- 172.21.15.49:0/3609367417 shutdown_connections 2023-11-30T17:08:09.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.576+0000 7f950759e700 1 --2- 172.21.15.49:0/3609367417 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f94e805f150 0x7f94e8061610 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:09.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.576+0000 7f950759e700 1 --2- 172.21.15.49:0/3609367417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9508157660 0x7f9508063700 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:09.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.576+0000 7f950759e700 1 --2- 172.21.15.49:0/3609367417 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95080c0180 0x7f950814ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:09.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.576+0000 7f950759e700 1 --2- 172.21.15.49:0/3609367417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95080c1750 0x7f95081689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:09.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.576+0000 7f950759e700 1 -- 172.21.15.49:0/3609367417 >> 172.21.15.49:0/3609367417 conn(0x7f95080cb000 msgr2=0x7f9508151830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:09.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.576+0000 7f950759e700 1 -- 172.21.15.49:0/3609367417 shutdown_connections 2023-11-30T17:08:09.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.576+0000 7f950759e700 1 -- 172.21.15.49:0/3609367417 wait complete. 2023-11-30T17:08:09.581 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:08:09.589 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2023-11-30T17:08:08.850354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2379392,"kb_used_data":2624,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752595328,"statfs":{"total":773094113280,"available":770657615872,"internally_reserved":0,"allocated":2686976,"data_stored":1055368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4305,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.935501"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809995+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808400+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809030+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805751+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812536+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808147+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.813568+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.813370+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808762+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805743+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812466+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808643+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812111+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807701+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807892+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.813006+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812423+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807542+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807433+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.811985+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808395+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807211+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.810406+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807394+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805679+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807960+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805677+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807975+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807250+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812037+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809819+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812141+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809426+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.810207+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805186+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807782+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807465+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.811383+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805164+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807600+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807542+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808005+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808306+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808589+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807396+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805293+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.810296+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812604+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.810700+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809116+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812817+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805134+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.811545+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812365+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.813156+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.811035+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.810668+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:07:58.974820+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:07:58.974820+0000","last_peered":"2023-11-30T17:07:58.974820+0000","last_clean":"2023-11-30T17:07:58.974820+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:07:58.974820+0000","last_undegraded":"2023-11-30T17:07:58.974820+0000","last_fullsized":"2023-11-30T17:07:58.974820+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.810695+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:07:59.139902+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:07:59.139902+0000","last_peered":"2023-11-30T17:07:59.139902+0000","last_clean":"2023-11-30T17:07:59.139902+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:07:59.139902+0000","last_undegraded":"2023-11-30T17:07:59.139902+0000","last_fullsized":"2023-11-30T17:07:59.139902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.810377+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:08:00.083180+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:08:00.083180+0000","last_peered":"2023-11-30T17:08:00.083180+0000","last_clean":"2023-11-30T17:08:00.083180+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:08:00.083180+0000","last_undegraded":"2023-11-30T17:08:00.083180+0000","last_fullsized":"2023-11-30T17:08:00.083180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.811554+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:07:59.139903+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:07:59.139903+0000","last_peered":"2023-11-30T17:07:59.139903+0000","last_clean":"2023-11-30T17:07:59.139903+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:07:59.139903+0000","last_undegraded":"2023-11-30T17:07:59.139903+0000","last_fullsized":"2023-11-30T17:07:59.139903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:08:00.083219+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:08:00.083219+0000","last_peered":"2023-11-30T17:08:00.083219+0000","last_clean":"2023-11-30T17:08:00.083219+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:08:00.083219+0000","last_undegraded":"2023-11-30T17:08:00.083219+0000","last_fullsized":"2023-11-30T17:08:00.083219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809064+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:08:00.083203+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:08:00.083203+0000","last_peered":"2023-11-30T17:08:00.083203+0000","last_clean":"2023-11-30T17:08:00.083203+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:08:00.083203+0000","last_undegraded":"2023-11-30T17:08:00.083203+0000","last_fullsized":"2023-11-30T17:08:00.083203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809456+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:08:00.083256+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:08:00.083256+0000","last_peered":"2023-11-30T17:08:00.083256+0000","last_clean":"2023-11-30T17:08:00.083256+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:08:00.083256+0000","last_undegraded":"2023-11-30T17:08:00.083256+0000","last_fullsized":"2023-11-30T17:08:00.083256+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809181+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:07:58.974806+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:07:58.974806+0000","last_peered":"2023-11-30T17:07:58.974806+0000","last_clean":"2023-11-30T17:07:58.974806+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:07:58.974806+0000","last_undegraded":"2023-11-30T17:07:58.974806+0000","last_fullsized":"2023-11-30T17:07:58.974806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807389+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:07:58.975375+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:07:58.975375+0000","last_peered":"2023-11-30T17:07:58.975375+0000","last_clean":"2023-11-30T17:07:58.975375+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:07:58.975375+0000","last_undegraded":"2023-11-30T17:07:58.975375+0000","last_fullsized":"2023-11-30T17:07:58.975375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:08:09.594 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:08:09.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.745+0000 7f3157265700 1 Processor -- start 2023-11-30T17:08:09.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.745+0000 7f3157265700 1 -- start start 2023-11-30T17:08:09.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.746+0000 7f3157265700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f31501544e0 0x7f31501548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:09.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.746+0000 7f3157265700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f315006a610 0x7f31500c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:09.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.746+0000 7f3157265700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31500c69a0 con 0x7f31500c6e30 2023-11-30T17:08:09.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.746+0000 7f3157265700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31500c13a0 con 0x7f315006a610 2023-11-30T17:08:09.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.746+0000 7f3157265700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31500c1680 con 0x7f31501544e0 2023-11-30T17:08:09.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.746+0000 7f3154800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f315006a610 0x7f31500c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:09.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.746+0000 7f3154800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f315006a610 0x7f31500c0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39724/0 (socket says 172.21.15.49:39724) 2023-11-30T17:08:09.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.746+0000 7f3154800700 1 -- 172.21.15.49:0/3654211956 learned_addr learned my addr 172.21.15.49:0/3654211956 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:09.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.747+0000 7f3155001700 1 --2- 172.21.15.49:0/3654211956 >> v2:172.21.15.115:3300/0 conn(0x7f31501544e0 0x7f31501548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:09.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.747+0000 7f3154800700 1 -- 172.21.15.49:0/3654211956 >> v2:172.21.15.115:3300/0 conn(0x7f31501544e0 msgr2=0x7f31501548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:09.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.747+0000 7f3154800700 1 --2- 172.21.15.49:0/3654211956 >> v2:172.21.15.115:3300/0 conn(0x7f31501544e0 0x7f31501548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:09.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.747+0000 7f3154800700 1 -- 172.21.15.49:0/3654211956 >> v1:172.21.15.115:6789/0 conn(0x7f31500c6e30 legacy=0x7f31500a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:09.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.747+0000 7f3154800700 1 -- 172.21.15.49:0/3654211956 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31500c6630 con 0x7f315006a610 2023-11-30T17:08:09.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.747+0000 7f3154800700 1 --2- 172.21.15.49:0/3654211956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f315006a610 0x7f31500c0bc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f3150085760 tx=0x7f314c009840).ready entity=mon.0 client_cookie=d805108288ecfb4b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:09.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.747+0000 7f3147fff700 1 -- 172.21.15.49:0/3654211956 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c00e070 con 0x7f315006a610 2023-11-30T17:08:09.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.747+0000 7f3147fff700 1 -- 172.21.15.49:0/3654211956 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314c00ba50 con 0x7f315006a610 2023-11-30T17:08:09.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.747+0000 7f3147fff700 1 -- 172.21.15.49:0/3654211956 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c00bdd0 con 0x7f315006a610 2023-11-30T17:08:09.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.748+0000 7f3157265700 1 -- 172.21.15.49:0/3654211956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f315006a610 msgr2=0x7f31500c0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:09.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.748+0000 7f3157265700 1 --2- 172.21.15.49:0/3654211956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f315006a610 0x7f31500c0bc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f3150085760 tx=0x7f314c009840).stop 2023-11-30T17:08:09.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.748+0000 7f3157265700 1 -- 172.21.15.49:0/3654211956 shutdown_connections 2023-11-30T17:08:09.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.748+0000 7f3157265700 1 --2- 172.21.15.49:0/3654211956 >> v2:172.21.15.115:3300/0 conn(0x7f31501544e0 0x7f31501548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:09.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.748+0000 7f3157265700 1 --2- 172.21.15.49:0/3654211956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f315006a610 0x7f31500c0bc0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:09.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.748+0000 7f3157265700 1 -- 172.21.15.49:0/3654211956 >> 172.21.15.49:0/3654211956 conn(0x7f3150085020 msgr2=0x7f3150094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:09.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.748+0000 7f3157265700 1 -- 172.21.15.49:0/3654211956 shutdown_connections 2023-11-30T17:08:09.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.748+0000 7f3157265700 1 -- 172.21.15.49:0/3654211956 wait complete. 2023-11-30T17:08:09.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.749+0000 7f3157265700 1 Processor -- start 2023-11-30T17:08:09.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.749+0000 7f3157265700 1 -- start start 2023-11-30T17:08:09.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.750+0000 7f3157265700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f315006a610 0x7f3150143120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:09.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.750+0000 7f3157265700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31500c6e30 0x7f31500644a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:09.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.750+0000 7f3157265700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31501544e0 0x7f3150064990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:09.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.750+0000 7f3157265700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3150064e80 con 0x7f31501544e0 2023-11-30T17:08:09.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.750+0000 7f3157265700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3150098860 con 0x7f315006a610 2023-11-30T17:08:09.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.750+0000 7f3157265700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3150098b40 con 0x7f31500c6e30 2023-11-30T17:08:09.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.750+0000 7f3155802700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31501544e0 0x7f3150064990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:09.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.750+0000 7f3155802700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31501544e0 0x7f3150064990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39730/0 (socket says 172.21.15.49:39730) 2023-11-30T17:08:09.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.750+0000 7f3155802700 1 -- 172.21.15.49:0/2299233520 learned_addr learned my addr 172.21.15.49:0/2299233520 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:09.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.750+0000 7f3155001700 1 --2- 172.21.15.49:0/2299233520 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f315006a610 0x7f3150143120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:09.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.750+0000 7f3154800700 1 --2- 172.21.15.49:0/2299233520 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31500c6e30 0x7f31500644a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:09.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.750+0000 7f3155802700 1 -- 172.21.15.49:0/2299233520 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31500c6e30 msgr2=0x7f31500644a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:09.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.750+0000 7f3155802700 1 --2- 172.21.15.49:0/2299233520 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31500c6e30 0x7f31500644a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:09.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.750+0000 7f3155802700 1 -- 172.21.15.49:0/2299233520 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f315006a610 msgr2=0x7f3150143120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:09.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.750+0000 7f3155802700 1 --2- 172.21.15.49:0/2299233520 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f315006a610 0x7f3150143120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:09.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.750+0000 7f3155802700 1 -- 172.21.15.49:0/2299233520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314c009ae0 con 0x7f31501544e0 2023-11-30T17:08:09.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.750+0000 7f3155802700 1 --2- 172.21.15.49:0/2299233520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31501544e0 0x7f3150064990 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f314000c440 tx=0x7f3140007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:09.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.751+0000 7f31457fa700 1 -- 172.21.15.49:0/2299233520 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31400123f0 con 0x7f31501544e0 2023-11-30T17:08:09.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.751+0000 7f31457fa700 1 -- 172.21.15.49:0/2299233520 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3140001e90 con 0x7f31501544e0 2023-11-30T17:08:09.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.751+0000 7f3157265700 1 -- 172.21.15.49:0/2299233520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3150098e20 con 0x7f31501544e0 2023-11-30T17:08:09.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.751+0000 7f31457fa700 1 -- 172.21.15.49:0/2299233520 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3140012760 con 0x7f31501544e0 2023-11-30T17:08:09.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.751+0000 7f3157265700 1 -- 172.21.15.49:0/2299233520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3150152620 con 0x7f31501544e0 2023-11-30T17:08:09.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.752+0000 7f3157265700 1 -- 172.21.15.49:0/2299233520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3150152840 con 0x7f31501544e0 2023-11-30T17:08:09.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.752+0000 7f31457fa700 1 -- 172.21.15.49:0/2299233520 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3140012b50 con 0x7f31501544e0 2023-11-30T17:08:09.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.752+0000 7f31457fa700 1 --2- 172.21.15.49:0/2299233520 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f313405f150 0x7f3134061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:09.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.752+0000 7f31457fa700 1 -- 172.21.15.49:0/2299233520 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f31400794f0 con 0x7f31501544e0 2023-11-30T17:08:09.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.753+0000 7f3155001700 1 --2- 172.21.15.49:0/2299233520 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f313405f150 0x7f3134061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:09.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.753+0000 7f3155001700 1 --2- 172.21.15.49:0/2299233520 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f313405f150 0x7f3134061610 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f3148006fd0 tx=0x7f3148008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:09.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.756+0000 7f31457fa700 1 -- 172.21.15.49:0/2299233520 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3140047b00 con 0x7f31501544e0 2023-11-30T17:08:09.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.923+0000 7f3157265700 1 -- 172.21.15.49:0/2299233520 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f315006c860 con 0x7f313405f150 2023-11-30T17:08:09.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.932+0000 7f31457fa700 1 -- 172.21.15.49:0/2299233520 <== mgr.4105 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+328104 (secure 0 0 0) 0x7f315006c860 con 0x7f313405f150 2023-11-30T17:08:09.938 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:08:09.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.935+0000 7f3157265700 1 -- 172.21.15.49:0/2299233520 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f313405f150 msgr2=0x7f3134061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:09.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.935+0000 7f3157265700 1 --2- 172.21.15.49:0/2299233520 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f313405f150 0x7f3134061610 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f3148006fd0 tx=0x7f3148008040).stop 2023-11-30T17:08:09.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.935+0000 7f3157265700 1 -- 172.21.15.49:0/2299233520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31501544e0 msgr2=0x7f3150064990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:09.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.935+0000 7f3157265700 1 --2- 172.21.15.49:0/2299233520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31501544e0 0x7f3150064990 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f314000c440 tx=0x7f3140007d70).stop 2023-11-30T17:08:09.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.935+0000 7f3157265700 1 -- 172.21.15.49:0/2299233520 shutdown_connections 2023-11-30T17:08:09.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.935+0000 7f3157265700 1 --2- 172.21.15.49:0/2299233520 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f313405f150 0x7f3134061610 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:09.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.935+0000 7f3157265700 1 --2- 172.21.15.49:0/2299233520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31501544e0 0x7f3150064990 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:09.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.935+0000 7f3157265700 1 --2- 172.21.15.49:0/2299233520 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f315006a610 0x7f3150143120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:09.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.935+0000 7f3157265700 1 --2- 172.21.15.49:0/2299233520 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31500c6e30 0x7f31500644a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:09.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.936+0000 7f3157265700 1 -- 172.21.15.49:0/2299233520 >> 172.21.15.49:0/2299233520 conn(0x7f3150085020 msgr2=0x7f31500aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:09.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.936+0000 7f3157265700 1 -- 172.21.15.49:0/2299233520 shutdown_connections 2023-11-30T17:08:09.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:09.936+0000 7f3157265700 1 -- 172.21.15.49:0/2299233520 wait complete. 2023-11-30T17:08:09.943 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:08:09.949 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2023-11-30T17:08:08.850354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2379392,"kb_used_data":2624,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752595328,"statfs":{"total":773094113280,"available":770657615872,"internally_reserved":0,"allocated":2686976,"data_stored":1055368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4305,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.935501"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809995+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808400+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809030+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805751+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812536+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808147+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.813568+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.813370+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808762+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805743+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812466+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808643+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812111+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807701+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807892+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.813006+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812423+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807542+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807433+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.811985+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808395+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807211+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.810406+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807394+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805679+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807960+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805677+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807975+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807250+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812037+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809819+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812141+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809426+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.810207+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805186+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807782+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807465+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.811383+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805164+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807600+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807542+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808005+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808306+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808589+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807396+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805293+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.810296+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812604+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.810700+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809116+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812817+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805134+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.811545+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812365+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.813156+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.811035+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.810668+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:07:58.974820+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:07:58.974820+0000","last_peered":"2023-11-30T17:07:58.974820+0000","last_clean":"2023-11-30T17:07:58.974820+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:07:58.974820+0000","last_undegraded":"2023-11-30T17:07:58.974820+0000","last_fullsized":"2023-11-30T17:07:58.974820+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.810695+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:07:59.139902+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:07:59.139902+0000","last_peered":"2023-11-30T17:07:59.139902+0000","last_clean":"2023-11-30T17:07:59.139902+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:07:59.139902+0000","last_undegraded":"2023-11-30T17:07:59.139902+0000","last_fullsized":"2023-11-30T17:07:59.139902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.810377+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:08:00.083180+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:08:00.083180+0000","last_peered":"2023-11-30T17:08:00.083180+0000","last_clean":"2023-11-30T17:08:00.083180+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:08:00.083180+0000","last_undegraded":"2023-11-30T17:08:00.083180+0000","last_fullsized":"2023-11-30T17:08:00.083180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.811554+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:07:59.139903+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:07:59.139903+0000","last_peered":"2023-11-30T17:07:59.139903+0000","last_clean":"2023-11-30T17:07:59.139903+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:07:59.139903+0000","last_undegraded":"2023-11-30T17:07:59.139903+0000","last_fullsized":"2023-11-30T17:07:59.139903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:08:00.083219+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:08:00.083219+0000","last_peered":"2023-11-30T17:08:00.083219+0000","last_clean":"2023-11-30T17:08:00.083219+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:08:00.083219+0000","last_undegraded":"2023-11-30T17:08:00.083219+0000","last_fullsized":"2023-11-30T17:08:00.083219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809064+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:08:00.083203+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:08:00.083203+0000","last_peered":"2023-11-30T17:08:00.083203+0000","last_clean":"2023-11-30T17:08:00.083203+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:08:00.083203+0000","last_undegraded":"2023-11-30T17:08:00.083203+0000","last_fullsized":"2023-11-30T17:08:00.083203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809456+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:08:00.083256+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:08:00.083256+0000","last_peered":"2023-11-30T17:08:00.083256+0000","last_clean":"2023-11-30T17:08:00.083256+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:08:00.083256+0000","last_undegraded":"2023-11-30T17:08:00.083256+0000","last_fullsized":"2023-11-30T17:08:00.083256+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809181+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:07:58.974806+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:07:58.974806+0000","last_peered":"2023-11-30T17:07:58.974806+0000","last_clean":"2023-11-30T17:07:58.974806+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:07:58.974806+0000","last_undegraded":"2023-11-30T17:07:58.974806+0000","last_fullsized":"2023-11-30T17:07:58.974806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807389+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:07:58.975375+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:07:58.975375+0000","last_peered":"2023-11-30T17:07:58.975375+0000","last_clean":"2023-11-30T17:07:58.975375+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:07:58.975375+0000","last_undegraded":"2023-11-30T17:07:58.975375+0000","last_fullsized":"2023-11-30T17:07:58.975375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:08:09.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2023-11-30T17:08:09.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2023-11-30T17:08:09.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.809995+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-30T17:08:09.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2023-11-30T17:08:09.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2023-11-30T17:08:09.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.808400+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-30T17:08:09.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2023-11-30T17:08:09.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2023-11-30T17:08:09.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.809030+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-30T17:08:09.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2023-11-30T17:08:09.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2023-11-30T17:08:09.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.805751+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-30T17:08:09.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2023-11-30T17:08:09.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2023-11-30T17:08:09.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.812536+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-30T17:08:09.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2023-11-30T17:08:09.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2023-11-30T17:08:09.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.808147+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-30T17:08:09.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2023-11-30T17:08:09.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2023-11-30T17:08:09.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.813568+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-30T17:08:09.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2023-11-30T17:08:09.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2023-11-30T17:08:09.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.813370+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-30T17:08:09.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2023-11-30T17:08:09.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2023-11-30T17:08:09.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.808762+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-30T17:08:09.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2023-11-30T17:08:09.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2023-11-30T17:08:09.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.805743+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-30T17:08:09.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2023-11-30T17:08:09.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2023-11-30T17:08:09.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.812466+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-30T17:08:09.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2023-11-30T17:08:09.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2023-11-30T17:08:09.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.808643+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-30T17:08:09.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2023-11-30T17:08:09.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2023-11-30T17:08:09.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.812111+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-30T17:08:09.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2023-11-30T17:08:09.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2023-11-30T17:08:09.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.807701+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-30T17:08:09.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2023-11-30T17:08:09.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2023-11-30T17:08:09.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.807892+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-30T17:08:09.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2023-11-30T17:08:09.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2023-11-30T17:08:09.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.813006+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-30T17:08:09.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2023-11-30T17:08:09.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2023-11-30T17:08:09.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.812423+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-30T17:08:09.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2023-11-30T17:08:09.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2023-11-30T17:08:09.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.807542+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-30T17:08:09.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2023-11-30T17:08:09.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2023-11-30T17:08:09.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.807433+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-30T17:08:09.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2023-11-30T17:08:09.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2023-11-30T17:08:09.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.811985+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-30T17:08:09.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2023-11-30T17:08:09.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2023-11-30T17:08:09.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.808395+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-30T17:08:09.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2023-11-30T17:08:09.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2023-11-30T17:08:09.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.807211+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-30T17:08:09.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2023-11-30T17:08:09.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2023-11-30T17:08:09.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.810406+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-30T17:08:09.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2023-11-30T17:08:09.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2023-11-30T17:08:09.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.807394+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-30T17:08:09.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2023-11-30T17:08:09.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2023-11-30T17:08:09.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.805679+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-30T17:08:09.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2023-11-30T17:08:09.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2023-11-30T17:08:09.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.807960+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-30T17:08:09.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2023-11-30T17:08:09.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2023-11-30T17:08:09.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.805677+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-30T17:08:09.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2023-11-30T17:08:09.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2023-11-30T17:08:09.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.807975+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-30T17:08:09.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2023-11-30T17:08:09.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2023-11-30T17:08:09.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.807250+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-30T17:08:09.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2023-11-30T17:08:09.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2023-11-30T17:08:09.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.812037+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-30T17:08:09.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2023-11-30T17:08:09.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2023-11-30T17:08:09.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.809819+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-30T17:08:09.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2023-11-30T17:08:09.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2023-11-30T17:08:09.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.812141+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-30T17:08:09.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-11-30T17:08:09.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-11-30T17:08:09.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.809426+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-30T17:08:09.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-11-30T17:08:09.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-11-30T17:08:09.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.810207+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-30T17:08:09.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-11-30T17:08:09.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-11-30T17:08:09.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.805186+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-30T17:08:09.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-11-30T17:08:09.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-11-30T17:08:09.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.807782+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-30T17:08:09.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-11-30T17:08:09.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-11-30T17:08:09.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.807465+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-30T17:08:09.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-11-30T17:08:09.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-11-30T17:08:09.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.811383+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-30T17:08:09.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-11-30T17:08:09.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-11-30T17:08:09.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.805164+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-30T17:08:09.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-11-30T17:08:09.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-11-30T17:08:09.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.807600+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-30T17:08:09.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-11-30T17:08:09.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-11-30T17:08:09.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.807542+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-30T17:08:09.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-11-30T17:08:09.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-11-30T17:08:09.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.808005+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-30T17:08:09.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-11-30T17:08:09.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-11-30T17:08:09.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.808306+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-30T17:08:09.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-11-30T17:08:09.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-11-30T17:08:09.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.808589+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-30T17:08:09.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-11-30T17:08:09.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-11-30T17:08:09.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.807396+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-30T17:08:09.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-11-30T17:08:09.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-11-30T17:08:09.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.805293+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-30T17:08:09.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-11-30T17:08:09.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-11-30T17:08:09.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.810296+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-30T17:08:09.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-11-30T17:08:09.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-11-30T17:08:09.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.812604+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-30T17:08:09.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-11-30T17:08:09.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-11-30T17:08:09.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.810700+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-30T17:08:09.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-11-30T17:08:09.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-11-30T17:08:09.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.809116+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-30T17:08:09.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-11-30T17:08:09.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-11-30T17:08:09.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.812817+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-30T17:08:09.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-11-30T17:08:09.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-11-30T17:08:09.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.805134+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-30T17:08:09.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-11-30T17:08:09.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-11-30T17:08:09.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.811545+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-30T17:08:09.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-11-30T17:08:09.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-11-30T17:08:09.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.812365+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-30T17:08:09.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-11-30T17:08:09.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-11-30T17:08:09.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.813156+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-30T17:08:09.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-11-30T17:08:09.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-11-30T17:08:09.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.811035+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-30T17:08:09.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-11-30T17:08:09.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-11-30T17:08:09.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.810668+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-30T17:08:09.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-11-30T17:08:09.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-11-30T17:08:09.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.810695+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-30T17:08:09.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-11-30T17:08:09.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-11-30T17:08:09.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.810377+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-30T17:08:09.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-11-30T17:08:09.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-11-30T17:08:09.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.811554+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-30T17:08:09.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-11-30T17:08:09.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-11-30T17:08:09.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.809064+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-30T17:08:09.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-11-30T17:08:09.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-11-30T17:08:09.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.809456+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-30T17:08:09.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-11-30T17:08:09.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-11-30T17:08:09.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.809181+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-30T17:08:09.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-11-30T17:08:09.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:08:04.803120+0000', 'last_change': '2023-11-30T17:08:04.803120+0000', 'last_active': '2023-11-30T17:08:04.803120+0000', 'last_peered': '2023-11-30T17:08:04.803120+0000', 'last_clean': '2023-11-30T17:08:04.803120+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:04.803120+0000', 'last_undegraded': '2023-11-30T17:08:04.803120+0000', 'last_fullsized': '2023-11-30T17:08:04.803120+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:04.803120+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:08:09.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-11-30T17:08:09.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:08:03.798417+0000', 'last_change': '2023-11-30T17:08:03.807389+0000', 'last_active': '2023-11-30T17:08:03.798417+0000', 'last_peered': '2023-11-30T17:08:03.798417+0000', 'last_clean': '2023-11-30T17:08:03.798417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:08:03.798417+0000', 'last_undegraded': '2023-11-30T17:08:03.798417+0000', 'last_fullsized': '2023-11-30T17:08:03.798417+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'last_clean_scrub_stamp': '2023-11-30T17:08:03.798417+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-30T17:08:09.979 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-30T17:08:10.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.104+0000 7feebd957700 1 Processor -- start 2023-11-30T17:08:10.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.104+0000 7feebd957700 1 -- start start 2023-11-30T17:08:10.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.105+0000 7feebd957700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feeb8157660 0x7feeb8157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:10.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.105+0000 7feebd957700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feeb80c0180 0x7feeb81589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:10.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.105+0000 7feebd957700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7feeb80c1750 0x7feeb80c1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:10.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.105+0000 7feebd957700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb80c12c0 con 0x7feeb80c0180 2023-11-30T17:08:10.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.105+0000 7feebd957700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb80c06b0 con 0x7feeb80c1750 2023-11-30T17:08:10.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.105+0000 7feebd957700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb80c0990 con 0x7feeb8157660 2023-11-30T17:08:10.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.105+0000 7feeb7fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feeb80c0180 0x7feeb81589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:10.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.105+0000 7feeb7fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feeb80c0180 0x7feeb81589c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39740/0 (socket says 172.21.15.49:39740) 2023-11-30T17:08:10.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.105+0000 7feeb7fff700 1 -- 172.21.15.49:0/2774941716 learned_addr learned my addr 172.21.15.49:0/2774941716 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:10.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.105+0000 7feebc955700 1 --2- 172.21.15.49:0/2774941716 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feeb8157660 0x7feeb8157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:10.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.105+0000 7feebd156700 1 --2- 172.21.15.49:0/2774941716 >> v2:172.21.15.115:3300/0 conn(0x7feeb80c1750 0x7feeb80c1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:10.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.105+0000 7feeb7fff700 1 -- 172.21.15.49:0/2774941716 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feeb8157660 msgr2=0x7feeb8157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:10.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.105+0000 7feeb7fff700 1 --2- 172.21.15.49:0/2774941716 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feeb8157660 0x7feeb8157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:10.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.105+0000 7feeb7fff700 1 -- 172.21.15.49:0/2774941716 >> v2:172.21.15.115:3300/0 conn(0x7feeb80c1750 msgr2=0x7feeb80c1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:10.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.105+0000 7feeb7fff700 1 --2- 172.21.15.49:0/2774941716 >> v2:172.21.15.115:3300/0 conn(0x7feeb80c1750 0x7feeb80c1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:10.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.105+0000 7feeb7fff700 1 -- 172.21.15.49:0/2774941716 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb80c0c70 con 0x7feeb80c0180 2023-11-30T17:08:10.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.105+0000 7feeb7fff700 1 --2- 172.21.15.49:0/2774941716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feeb80c0180 0x7feeb81589c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7feeb80cbeb0 tx=0x7feea40090f0).ready entity=mon.0 client_cookie=ed419d52287c3534 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:10.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.106+0000 7feeb77fe700 1 -- 172.21.15.49:0/2774941716 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea400b600 con 0x7feeb80c0180 2023-11-30T17:08:10.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.106+0000 7feeb77fe700 1 -- 172.21.15.49:0/2774941716 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea400b760 con 0x7feeb80c0180 2023-11-30T17:08:10.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.106+0000 7feeb77fe700 1 -- 172.21.15.49:0/2774941716 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea400bae0 con 0x7feeb80c0180 2023-11-30T17:08:10.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.106+0000 7feebd957700 1 -- 172.21.15.49:0/2774941716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feeb80c0180 msgr2=0x7feeb81589c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:10.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.106+0000 7feebd957700 1 --2- 172.21.15.49:0/2774941716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feeb80c0180 0x7feeb81589c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7feeb80cbeb0 tx=0x7feea40090f0).stop 2023-11-30T17:08:10.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.106+0000 7feebd957700 1 -- 172.21.15.49:0/2774941716 shutdown_connections 2023-11-30T17:08:10.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.106+0000 7feebd957700 1 --2- 172.21.15.49:0/2774941716 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feeb8157660 0x7feeb8157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:10.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.106+0000 7feebd957700 1 --2- 172.21.15.49:0/2774941716 >> v2:172.21.15.115:3300/0 conn(0x7feeb80c1750 0x7feeb80c1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:10.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.106+0000 7feebd957700 1 --2- 172.21.15.49:0/2774941716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feeb80c0180 0x7feeb81589c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:10.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.106+0000 7feebd957700 1 -- 172.21.15.49:0/2774941716 >> 172.21.15.49:0/2774941716 conn(0x7feeb80cb000 msgr2=0x7feeb80cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:10.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.106+0000 7feebd957700 1 -- 172.21.15.49:0/2774941716 shutdown_connections 2023-11-30T17:08:10.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.106+0000 7feebd957700 1 -- 172.21.15.49:0/2774941716 wait complete. 2023-11-30T17:08:10.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.107+0000 7feebd957700 1 Processor -- start 2023-11-30T17:08:10.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.107+0000 7feebd957700 1 -- start start 2023-11-30T17:08:10.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.108+0000 7feebd957700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feeb80c0180 0x7feeb80c1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:10.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.108+0000 7feebd957700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feeb80c1750 0x7feeb8145400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:10.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.108+0000 7feebd957700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feeb8157660 0x7feeb8154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:10.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.108+0000 7feebd957700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb8152a80 con 0x7feeb80c1750 2023-11-30T17:08:10.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.108+0000 7feebd957700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb80c4170 con 0x7feeb80c0180 2023-11-30T17:08:10.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.108+0000 7feebd957700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb80c4450 con 0x7feeb8157660 2023-11-30T17:08:10.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.108+0000 7feeb7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feeb80c1750 0x7feeb8145400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:10.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.108+0000 7feeb7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feeb80c1750 0x7feeb8145400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39750/0 (socket says 172.21.15.49:39750) 2023-11-30T17:08:10.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.108+0000 7feeb7fff700 1 -- 172.21.15.49:0/1840364416 learned_addr learned my addr 172.21.15.49:0/1840364416 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:10.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.108+0000 7feebd156700 1 --2- 172.21.15.49:0/1840364416 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feeb8157660 0x7feeb8154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:10.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.108+0000 7feebc955700 1 --2- 172.21.15.49:0/1840364416 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feeb80c0180 0x7feeb80c1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:10.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.109+0000 7feeb7fff700 1 -- 172.21.15.49:0/1840364416 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feeb8157660 msgr2=0x7feeb8154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:10.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.109+0000 7feeb7fff700 1 --2- 172.21.15.49:0/1840364416 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feeb8157660 0x7feeb8154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:10.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.109+0000 7feeb7fff700 1 -- 172.21.15.49:0/1840364416 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feeb80c0180 msgr2=0x7feeb80c1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:10.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.109+0000 7feeb7fff700 1 --2- 172.21.15.49:0/1840364416 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feeb80c0180 0x7feeb80c1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:10.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.109+0000 7feeb7fff700 1 -- 172.21.15.49:0/1840364416 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea4009370 con 0x7feeb80c1750 2023-11-30T17:08:10.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.109+0000 7feebd156700 1 --2- 172.21.15.49:0/1840364416 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feeb8157660 0x7feeb8154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:08:10.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.109+0000 7feeb7fff700 1 --2- 172.21.15.49:0/1840364416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feeb80c1750 0x7feeb8145400 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7feea4009130 tx=0x7feea4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:10.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.109+0000 7feeb4ff9700 1 -- 172.21.15.49:0/1840364416 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea400b8d0 con 0x7feeb80c1750 2023-11-30T17:08:10.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.109+0000 7feeb4ff9700 1 -- 172.21.15.49:0/1840364416 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea400ba30 con 0x7feeb80c1750 2023-11-30T17:08:10.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.109+0000 7feebd957700 1 -- 172.21.15.49:0/1840364416 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb80c4730 con 0x7feeb80c1750 2023-11-30T17:08:10.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.109+0000 7feeb4ff9700 1 -- 172.21.15.49:0/1840364416 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea401c670 con 0x7feeb80c1750 2023-11-30T17:08:10.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.109+0000 7feebd957700 1 -- 172.21.15.49:0/1840364416 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb80c4cf0 con 0x7feeb80c1750 2023-11-30T17:08:10.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.110+0000 7feebd957700 1 -- 172.21.15.49:0/1840364416 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb806c7c0 con 0x7feeb80c1750 2023-11-30T17:08:10.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.110+0000 7feeb4ff9700 1 -- 172.21.15.49:0/1840364416 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7feea401c9e0 con 0x7feeb80c1750 2023-11-30T17:08:10.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.111+0000 7feeb4ff9700 1 --2- 172.21.15.49:0/1840364416 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fee9c05f150 0x7fee9c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:10.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.111+0000 7feeb4ff9700 1 -- 172.21.15.49:0/1840364416 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7feea407c040 con 0x7feeb80c1750 2023-11-30T17:08:10.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.111+0000 7feebc955700 1 --2- 172.21.15.49:0/1840364416 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fee9c05f150 0x7fee9c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:10.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.111+0000 7feebc955700 1 --2- 172.21.15.49:0/1840364416 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fee9c05f150 0x7fee9c061610 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7feeac006fd0 tx=0x7feeac008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:10.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.115+0000 7feeb4ff9700 1 -- 172.21.15.49:0/1840364416 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7feea404d310 con 0x7feeb80c1750 2023-11-30T17:08:10.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.353+0000 7feebd957700 1 -- 172.21.15.49:0/1840364416 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7feeb8154f90 con 0x7feeb80c1750 2023-11-30T17:08:10.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.354+0000 7feeb4ff9700 1 -- 172.21.15.49:0/1840364416 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+2462 (secure 0 0 0) 0x7feea402a020 con 0x7feeb80c1750 2023-11-30T17:08:10.356 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:08:10.356 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":72,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1701364027,"num_in_osds":8,"osd_in_since":1701364021,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"unknown","count":64},{"state_name":"active+clean","count":9}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2436497408,"bytes_avail":770657615872,"bytes_total":773094113280,"unknown_pgs_ratio":0.46715328097343445,"inactive_pgs_ratio":0.46715328097343445},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"b","status":"up:active","gid":4944}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-11-30T17:08:08.850410+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-30T17:08:10.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.356+0000 7feebd957700 1 -- 172.21.15.49:0/1840364416 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fee9c05f150 msgr2=0x7fee9c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:10.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.356+0000 7feebd957700 1 --2- 172.21.15.49:0/1840364416 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fee9c05f150 0x7fee9c061610 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7feeac006fd0 tx=0x7feeac008040).stop 2023-11-30T17:08:10.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.356+0000 7feebd957700 1 -- 172.21.15.49:0/1840364416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feeb80c1750 msgr2=0x7feeb8145400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:10.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.356+0000 7feebd957700 1 --2- 172.21.15.49:0/1840364416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feeb80c1750 0x7feeb8145400 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7feea4009130 tx=0x7feea4017000).stop 2023-11-30T17:08:10.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.356+0000 7feebd957700 1 -- 172.21.15.49:0/1840364416 shutdown_connections 2023-11-30T17:08:10.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.356+0000 7feebd957700 1 --2- 172.21.15.49:0/1840364416 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feeb8157660 0x7feeb8154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:10.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.356+0000 7feebd957700 1 --2- 172.21.15.49:0/1840364416 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feeb80c0180 0x7feeb80c1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:10.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.356+0000 7feebd957700 1 --2- 172.21.15.49:0/1840364416 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fee9c05f150 0x7fee9c061610 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:10.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.356+0000 7feebd957700 1 --2- 172.21.15.49:0/1840364416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feeb80c1750 0x7feeb8145400 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:10.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.356+0000 7feebd957700 1 -- 172.21.15.49:0/1840364416 >> 172.21.15.49:0/1840364416 conn(0x7feeb80cb000 msgr2=0x7feeb80ca780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:10.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.356+0000 7feebd957700 1 -- 172.21.15.49:0/1840364416 shutdown_connections 2023-11-30T17:08:10.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.356+0000 7feebd957700 1 -- 172.21.15.49:0/1840364416 wait complete. 2023-11-30T17:08:10.369 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-30T17:08:10.370 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:08:10.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.485+0000 7f4d51d19700 1 Processor -- start 2023-11-30T17:08:10.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.485+0000 7f4d51d19700 1 -- start start 2023-11-30T17:08:10.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.486+0000 7f4d51d19700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d4c064e20 0x7f4d4c155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:10.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.486+0000 7f4d51d19700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4d4c095e80 0x7f4d4c096310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:10.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.486+0000 7f4d51d19700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4c096800 con 0x7f4d4c1544d0 2023-11-30T17:08:10.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.486+0000 7f4d51d19700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4c067650 con 0x7f4d4c095e80 2023-11-30T17:08:10.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.486+0000 7f4d51d19700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c0683d0 con 0x7f4d4c064e20 2023-11-30T17:08:10.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.486+0000 7f4d4bfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4d4c095e80 0x7f4d4c096310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:10.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.486+0000 7f4d4b7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4d4c1544d0 0x7f4d4c066f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49404/0 (socket says 172.21.15.49:49404) 2023-11-30T17:08:10.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.486+0000 7f4d4b7fe700 1 -- 172.21.15.49:0/184423793 learned_addr learned my addr 172.21.15.49:0/184423793 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:08:10.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.486+0000 7f4d4bfff700 1 --2- 172.21.15.49:0/184423793 >> v2:172.21.15.49:3300/0 conn(0x7f4d4c095e80 0x7f4d4c096310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39752/0 (socket says 172.21.15.49:39752) 2023-11-30T17:08:10.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.487+0000 7f4d4affd700 1 --2- 172.21.15.49:0/184423793 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d4c064e20 0x7f4d4c155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:10.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.487+0000 7f4d4bfff700 1 -- 172.21.15.49:0/184423793 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d4c064e20 msgr2=0x7f4d4c155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:10.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.487+0000 7f4d4bfff700 1 --2- 172.21.15.49:0/184423793 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d4c064e20 0x7f4d4c155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:10.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.487+0000 7f4d4bfff700 1 -- 172.21.15.49:0/184423793 >> v1:172.21.15.49:6789/0 conn(0x7f4d4c1544d0 legacy=0x7f4d4c066f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:10.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.487+0000 7f4d4a7fc700 1 -- 172.21.15.49:0/184423793 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3527882452 0 0) 0x7f4d4c096800 con 0x7f4d4c1544d0 2023-11-30T17:08:10.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.487+0000 7f4d4bfff700 1 -- 172.21.15.49:0/184423793 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c067850 con 0x7f4d4c095e80 2023-11-30T17:08:10.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.487+0000 7f4d4bfff700 1 --2- 172.21.15.49:0/184423793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d4c095e80 0x7f4d4c096310 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f4d44009e60 tx=0x7f4d44009780).ready entity=mon.0 client_cookie=1924f0e82bf4f827 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:10.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.487+0000 7f4d4a7fc700 1 -- 172.21.15.49:0/184423793 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4400e070 con 0x7f4d4c095e80 2023-11-30T17:08:10.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.487+0000 7f4d4a7fc700 1 -- 172.21.15.49:0/184423793 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4400bc30 con 0x7f4d4c095e80 2023-11-30T17:08:10.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.487+0000 7f4d4a7fc700 1 -- 172.21.15.49:0/184423793 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d44012410 con 0x7f4d4c095e80 2023-11-30T17:08:10.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.487+0000 7f4d51d19700 1 -- 172.21.15.49:0/184423793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d4c095e80 msgr2=0x7f4d4c096310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:10.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.487+0000 7f4d51d19700 1 --2- 172.21.15.49:0/184423793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d4c095e80 0x7f4d4c096310 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f4d44009e60 tx=0x7f4d44009780).stop 2023-11-30T17:08:10.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.487+0000 7f4d51d19700 1 -- 172.21.15.49:0/184423793 shutdown_connections 2023-11-30T17:08:10.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.487+0000 7f4d51d19700 1 --2- 172.21.15.49:0/184423793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d4c095e80 0x7f4d4c096310 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:10.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.487+0000 7f4d51d19700 1 --2- 172.21.15.49:0/184423793 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d4c064e20 0x7f4d4c155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:10.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.487+0000 7f4d51d19700 1 -- 172.21.15.49:0/184423793 >> 172.21.15.49:0/184423793 conn(0x7f4d4c0631d0 msgr2=0x7f4d4c0c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:10.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.488+0000 7f4d51d19700 1 -- 172.21.15.49:0/184423793 shutdown_connections 2023-11-30T17:08:10.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.488+0000 7f4d51d19700 1 -- 172.21.15.49:0/184423793 wait complete. 2023-11-30T17:08:10.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.489+0000 7f4d51d19700 1 Processor -- start 2023-11-30T17:08:10.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.489+0000 7f4d51d19700 1 -- start start 2023-11-30T17:08:10.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.490+0000 7f4d51d19700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d4c064e20 0x7f4d4c1554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:10.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.490+0000 7f4d51d19700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d4c095e80 0x7f4d4c1525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:10.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.490+0000 7f4d51d19700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d4c1544d0 0x7f4d4c0c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:10.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.490+0000 7f4d51d19700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c153140 con 0x7f4d4c064e20 2023-11-30T17:08:10.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.490+0000 7f4d51d19700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c152e60 con 0x7f4d4c095e80 2023-11-30T17:08:10.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.490+0000 7f4d51d19700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c0be450 con 0x7f4d4c1544d0 2023-11-30T17:08:10.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.490+0000 7f4d4b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d4c064e20 0x7f4d4c1554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:10.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.490+0000 7f4d4b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d4c064e20 0x7f4d4c1554a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39754/0 (socket says 172.21.15.49:39754) 2023-11-30T17:08:10.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.490+0000 7f4d4b7fe700 1 -- 172.21.15.49:0/4239437445 learned_addr learned my addr 172.21.15.49:0/4239437445 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:10.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.490+0000 7f4d4bfff700 1 --2- 172.21.15.49:0/4239437445 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d4c1544d0 0x7f4d4c0c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:10.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.490+0000 7f4d4affd700 1 --2- 172.21.15.49:0/4239437445 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d4c095e80 0x7f4d4c1525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:10.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.490+0000 7f4d4b7fe700 1 -- 172.21.15.49:0/4239437445 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d4c1544d0 msgr2=0x7f4d4c0c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:10.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.490+0000 7f4d4b7fe700 1 --2- 172.21.15.49:0/4239437445 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d4c1544d0 0x7f4d4c0c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:10.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.490+0000 7f4d4b7fe700 1 -- 172.21.15.49:0/4239437445 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d4c095e80 msgr2=0x7f4d4c1525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:10.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.490+0000 7f4d4b7fe700 1 --2- 172.21.15.49:0/4239437445 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d4c095e80 0x7f4d4c1525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:10.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.490+0000 7f4d4b7fe700 1 -- 172.21.15.49:0/4239437445 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d44009a20 con 0x7f4d4c064e20 2023-11-30T17:08:10.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.490+0000 7f4d4bfff700 1 --2- 172.21.15.49:0/4239437445 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d4c1544d0 0x7f4d4c0c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:08:10.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.490+0000 7f4d4affd700 1 --2- 172.21.15.49:0/4239437445 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d4c095e80 0x7f4d4c1525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:08:10.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.490+0000 7f4d4b7fe700 1 --2- 172.21.15.49:0/4239437445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d4c064e20 0x7f4d4c1554a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f4d3c00c440 tx=0x7f4d3c007d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:10.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.490+0000 7f4d337fe700 1 -- 172.21.15.49:0/4239437445 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c0072e0 con 0x7f4d4c064e20 2023-11-30T17:08:10.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.490+0000 7f4d337fe700 1 -- 172.21.15.49:0/4239437445 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3c007440 con 0x7f4d4c064e20 2023-11-30T17:08:10.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.490+0000 7f4d337fe700 1 -- 172.21.15.49:0/4239437445 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c005880 con 0x7f4d4c064e20 2023-11-30T17:08:10.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.490+0000 7f4d51d19700 1 -- 172.21.15.49:0/4239437445 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d4c0be730 con 0x7f4d4c064e20 2023-11-30T17:08:10.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.490+0000 7f4d51d19700 1 -- 172.21.15.49:0/4239437445 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d4c152a90 con 0x7f4d4c064e20 2023-11-30T17:08:10.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.491+0000 7f4d51d19700 1 -- 172.21.15.49:0/4239437445 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d4c0bebd0 con 0x7f4d4c064e20 2023-11-30T17:08:10.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.492+0000 7f4d337fe700 1 -- 172.21.15.49:0/4239437445 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4d3c005c70 con 0x7f4d4c064e20 2023-11-30T17:08:10.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.492+0000 7f4d337fe700 1 --2- 172.21.15.49:0/4239437445 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4d3805f150 0x7f4d38061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:10.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.492+0000 7f4d337fe700 1 -- 172.21.15.49:0/4239437445 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4d3c079850 con 0x7f4d4c064e20 2023-11-30T17:08:10.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.492+0000 7f4d4affd700 1 --2- 172.21.15.49:0/4239437445 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4d3805f150 0x7f4d38061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:10.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.493+0000 7f4d4affd700 1 --2- 172.21.15.49:0/4239437445 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4d3805f150 0x7f4d38061610 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f4d4c150110 tx=0x7f4d40008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:10.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.496+0000 7f4d337fe700 1 -- 172.21.15.49:0/4239437445 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4d3c04aac0 con 0x7f4d4c064e20 2023-11-30T17:08:10.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.663+0000 7f4d51d19700 1 -- 172.21.15.49:0/4239437445 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4d4c06c860 con 0x7f4d3805f150 2023-11-30T17:08:10.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.673+0000 7f4d337fe700 1 -- 172.21.15.49:0/4239437445 <== mgr.4105 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+328104 (secure 0 0 0) 0x7f4d4c06c860 con 0x7f4d3805f150 2023-11-30T17:08:10.678 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:08:10.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.676+0000 7f4d51d19700 1 -- 172.21.15.49:0/4239437445 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4d3805f150 msgr2=0x7f4d38061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:10.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.676+0000 7f4d51d19700 1 --2- 172.21.15.49:0/4239437445 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4d3805f150 0x7f4d38061610 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f4d4c150110 tx=0x7f4d40008040).stop 2023-11-30T17:08:10.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.676+0000 7f4d51d19700 1 -- 172.21.15.49:0/4239437445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d4c064e20 msgr2=0x7f4d4c1554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:10.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.676+0000 7f4d51d19700 1 --2- 172.21.15.49:0/4239437445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d4c064e20 0x7f4d4c1554a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f4d3c00c440 tx=0x7f4d3c007d00).stop 2023-11-30T17:08:10.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.676+0000 7f4d51d19700 1 -- 172.21.15.49:0/4239437445 shutdown_connections 2023-11-30T17:08:10.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.676+0000 7f4d51d19700 1 --2- 172.21.15.49:0/4239437445 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d4c1544d0 0x7f4d4c0c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:10.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.676+0000 7f4d51d19700 1 --2- 172.21.15.49:0/4239437445 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4d3805f150 0x7f4d38061610 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:10.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.676+0000 7f4d51d19700 1 --2- 172.21.15.49:0/4239437445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d4c064e20 0x7f4d4c1554a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:10.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.676+0000 7f4d51d19700 1 --2- 172.21.15.49:0/4239437445 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d4c095e80 0x7f4d4c1525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:10.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.676+0000 7f4d51d19700 1 -- 172.21.15.49:0/4239437445 >> 172.21.15.49:0/4239437445 conn(0x7f4d4c0631d0 msgr2=0x7f4d4c14ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:10.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.677+0000 7f4d51d19700 1 -- 172.21.15.49:0/4239437445 shutdown_connections 2023-11-30T17:08:10.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:10.677+0000 7f4d51d19700 1 -- 172.21.15.49:0/4239437445 wait complete. 2023-11-30T17:08:10.682 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:08:10.690 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2023-11-30T17:08:08.850354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2379392,"kb_used_data":2624,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752595328,"statfs":{"total":773094113280,"available":770657615872,"internally_reserved":0,"allocated":2686976,"data_stored":1055368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4305,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.935501"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809995+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808400+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809030+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805751+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812536+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808147+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.813568+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.813370+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808762+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805743+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812466+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808643+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812111+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807701+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807892+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.813006+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812423+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807542+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807433+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.811985+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808395+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807211+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.810406+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807394+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805679+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807960+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805677+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807975+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807250+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812037+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809819+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812141+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809426+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.810207+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805186+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807782+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807465+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.811383+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805164+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807600+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807542+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808005+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808306+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.808589+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807396+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805293+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.810296+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812604+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.810700+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809116+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812817+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.805134+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.811545+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.812365+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.813156+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.811035+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.810668+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:07:58.974820+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:07:58.974820+0000","last_peered":"2023-11-30T17:07:58.974820+0000","last_clean":"2023-11-30T17:07:58.974820+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:07:58.974820+0000","last_undegraded":"2023-11-30T17:07:58.974820+0000","last_fullsized":"2023-11-30T17:07:58.974820+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.810695+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:07:59.139902+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:07:59.139902+0000","last_peered":"2023-11-30T17:07:59.139902+0000","last_clean":"2023-11-30T17:07:59.139902+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:07:59.139902+0000","last_undegraded":"2023-11-30T17:07:59.139902+0000","last_fullsized":"2023-11-30T17:07:59.139902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.810377+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:08:00.083180+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:08:00.083180+0000","last_peered":"2023-11-30T17:08:00.083180+0000","last_clean":"2023-11-30T17:08:00.083180+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:08:00.083180+0000","last_undegraded":"2023-11-30T17:08:00.083180+0000","last_fullsized":"2023-11-30T17:08:00.083180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.811554+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:07:59.139903+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:07:59.139903+0000","last_peered":"2023-11-30T17:07:59.139903+0000","last_clean":"2023-11-30T17:07:59.139903+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:07:59.139903+0000","last_undegraded":"2023-11-30T17:07:59.139903+0000","last_fullsized":"2023-11-30T17:07:59.139903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:08:00.083219+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:08:00.083219+0000","last_peered":"2023-11-30T17:08:00.083219+0000","last_clean":"2023-11-30T17:08:00.083219+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:08:00.083219+0000","last_undegraded":"2023-11-30T17:08:00.083219+0000","last_fullsized":"2023-11-30T17:08:00.083219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809064+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:08:00.083203+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:08:00.083203+0000","last_peered":"2023-11-30T17:08:00.083203+0000","last_clean":"2023-11-30T17:08:00.083203+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:08:00.083203+0000","last_undegraded":"2023-11-30T17:08:00.083203+0000","last_fullsized":"2023-11-30T17:08:00.083203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809456+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:08:00.083256+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:08:00.083256+0000","last_peered":"2023-11-30T17:08:00.083256+0000","last_clean":"2023-11-30T17:08:00.083256+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:08:00.083256+0000","last_undegraded":"2023-11-30T17:08:00.083256+0000","last_fullsized":"2023-11-30T17:08:00.083256+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.809181+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:07:58.974806+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:07:58.974806+0000","last_peered":"2023-11-30T17:07:58.974806+0000","last_clean":"2023-11-30T17:07:58.974806+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:07:58.974806+0000","last_undegraded":"2023-11-30T17:07:58.974806+0000","last_fullsized":"2023-11-30T17:07:58.974806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:08:04.803120+0000","last_change":"2023-11-30T17:08:04.803120+0000","last_active":"2023-11-30T17:08:04.803120+0000","last_peered":"2023-11-30T17:08:04.803120+0000","last_clean":"2023-11-30T17:08:04.803120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:04.803120+0000","last_undegraded":"2023-11-30T17:08:04.803120+0000","last_fullsized":"2023-11-30T17:08:04.803120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:08:03.798417+0000","last_change":"2023-11-30T17:08:03.807389+0000","last_active":"2023-11-30T17:08:03.798417+0000","last_peered":"2023-11-30T17:08:03.798417+0000","last_clean":"2023-11-30T17:08:03.798417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:08:03.798417+0000","last_undegraded":"2023-11-30T17:08:03.798417+0000","last_fullsized":"2023-11-30T17:08:03.798417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-30T17:07:58.975375+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:07:58.975375+0000","last_peered":"2023-11-30T17:07:58.975375+0000","last_clean":"2023-11-30T17:07:58.975375+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:07:58.975375+0000","last_undegraded":"2023-11-30T17:07:58.975375+0000","last_fullsized":"2023-11-30T17:07:58.975375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:08:13.697 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:08:13.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.827+0000 7fdbca2f0700 1 Processor -- start 2023-11-30T17:08:13.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.827+0000 7fdbca2f0700 1 -- start start 2023-11-30T17:08:13.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.828+0000 7fdbca2f0700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdbc4157660 0x7fdbc4157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:13.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.828+0000 7fdbca2f0700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc40c12c0 con 0x7fdbc40c0180 2023-11-30T17:08:13.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.828+0000 7fdbca2f0700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc40c06b0 con 0x7fdbc40c1750 2023-11-30T17:08:13.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.828+0000 7fdbca2f0700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc40c0990 con 0x7fdbc4157660 2023-11-30T17:08:13.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.828+0000 7fdbc92ee700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdbc4157660 0x7fdbc4157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:13.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.828+0000 7fdbc92ee700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdbc4157660 0x7fdbc4157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59366/0 (socket says 172.21.15.49:59366) 2023-11-30T17:08:13.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.828+0000 7fdbc8aed700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdbc40c0180 0x7fdbc41589c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35758/0 (socket says 172.21.15.49:35758) 2023-11-30T17:08:13.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.828+0000 7fdbc92ee700 1 -- 172.21.15.49:0/3152208764 learned_addr learned my addr 172.21.15.49:0/3152208764 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:13.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.828+0000 7fdbc92ee700 1 -- 172.21.15.49:0/3152208764 >> v1:172.21.15.115:6789/0 conn(0x7fdbc40c1750 legacy=0x7fdbc40648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:13.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.828+0000 7fdbc92ee700 1 -- 172.21.15.49:0/3152208764 >> v1:172.21.15.49:6789/0 conn(0x7fdbc40c0180 legacy=0x7fdbc41589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:13.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.828+0000 7fdbc3fff700 1 -- 172.21.15.49:0/3152208764 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3504356966 0 0) 0x7fdbc40c12c0 con 0x7fdbc40c0180 2023-11-30T17:08:13.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.828+0000 7fdbc92ee700 1 -- 172.21.15.49:0/3152208764 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc40c0c70 con 0x7fdbc4157660 2023-11-30T17:08:13.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.829+0000 7fdbc92ee700 1 --2- 172.21.15.49:0/3152208764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbc4157660 0x7fdbc4157a40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7fdbb4006fd0 tx=0x7fdbb40090f0).ready entity=mon.0 client_cookie=3cd8f00b198c078a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:13.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.829+0000 7fdbc3fff700 1 -- 172.21.15.49:0/3152208764 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb400b600 con 0x7fdbc4157660 2023-11-30T17:08:13.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.829+0000 7fdbc3fff700 1 -- 172.21.15.49:0/3152208764 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb400b760 con 0x7fdbc4157660 2023-11-30T17:08:13.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.829+0000 7fdbc3fff700 1 -- 172.21.15.49:0/3152208764 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb400bae0 con 0x7fdbc4157660 2023-11-30T17:08:13.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.829+0000 7fdbca2f0700 1 -- 172.21.15.49:0/3152208764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbc4157660 msgr2=0x7fdbc4157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:13.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.829+0000 7fdbca2f0700 1 --2- 172.21.15.49:0/3152208764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbc4157660 0x7fdbc4157a40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7fdbb4006fd0 tx=0x7fdbb40090f0).stop 2023-11-30T17:08:13.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.829+0000 7fdbca2f0700 1 -- 172.21.15.49:0/3152208764 shutdown_connections 2023-11-30T17:08:13.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.829+0000 7fdbca2f0700 1 --2- 172.21.15.49:0/3152208764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbc4157660 0x7fdbc4157a40 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:13.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.829+0000 7fdbca2f0700 1 -- 172.21.15.49:0/3152208764 >> 172.21.15.49:0/3152208764 conn(0x7fdbc40cb000 msgr2=0x7fdbc40cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:13.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.829+0000 7fdbca2f0700 1 -- 172.21.15.49:0/3152208764 shutdown_connections 2023-11-30T17:08:13.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.829+0000 7fdbca2f0700 1 -- 172.21.15.49:0/3152208764 wait complete. 2023-11-30T17:08:13.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.830+0000 7fdbca2f0700 1 Processor -- start 2023-11-30T17:08:13.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.831+0000 7fdbca2f0700 1 -- start start 2023-11-30T17:08:13.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.831+0000 7fdbca2f0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbc40c0180 0x7fdbc414f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:13.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.831+0000 7fdbca2f0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbc40c1750 0x7fdbc40b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:13.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.831+0000 7fdbca2f0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbc4157660 0x7fdbc4165160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:13.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.831+0000 7fdbca2f0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc414fc30 con 0x7fdbc4157660 2023-11-30T17:08:13.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.831+0000 7fdbca2f0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc40b07c0 con 0x7fdbc40c1750 2023-11-30T17:08:13.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.831+0000 7fdbca2f0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc41562e0 con 0x7fdbc40c0180 2023-11-30T17:08:13.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.832+0000 7fdbc9aef700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbc4157660 0x7fdbc4165160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:13.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.832+0000 7fdbc9aef700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbc4157660 0x7fdbc4165160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59376/0 (socket says 172.21.15.49:59376) 2023-11-30T17:08:13.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.832+0000 7fdbc9aef700 1 -- 172.21.15.49:0/3657991187 learned_addr learned my addr 172.21.15.49:0/3657991187 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:13.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.832+0000 7fdbc8aed700 1 --2- 172.21.15.49:0/3657991187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbc40c1750 0x7fdbc40b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:13.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.832+0000 7fdbc92ee700 1 --2- 172.21.15.49:0/3657991187 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbc40c0180 0x7fdbc414f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:13.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.832+0000 7fdbc9aef700 1 -- 172.21.15.49:0/3657991187 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbc40c0180 msgr2=0x7fdbc414f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:13.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.832+0000 7fdbc9aef700 1 --2- 172.21.15.49:0/3657991187 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbc40c0180 0x7fdbc414f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:13.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.832+0000 7fdbc9aef700 1 -- 172.21.15.49:0/3657991187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbc40c1750 msgr2=0x7fdbc40b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:13.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.832+0000 7fdbc9aef700 1 --2- 172.21.15.49:0/3657991187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbc40c1750 0x7fdbc40b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:13.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.832+0000 7fdbc9aef700 1 -- 172.21.15.49:0/3657991187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb4009370 con 0x7fdbc4157660 2023-11-30T17:08:13.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.832+0000 7fdbc9aef700 1 --2- 172.21.15.49:0/3657991187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbc4157660 0x7fdbc4165160 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fdbbc00c7c0 tx=0x7fdbbc0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:13.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.832+0000 7fdbc17fa700 1 -- 172.21.15.49:0/3657991187 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc00a580 con 0x7fdbc4157660 2023-11-30T17:08:13.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.832+0000 7fdbc17fa700 1 -- 172.21.15.49:0/3657991187 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbbc00a6e0 con 0x7fdbc4157660 2023-11-30T17:08:13.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.832+0000 7fdbca2f0700 1 -- 172.21.15.49:0/3657991187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc4165650 con 0x7fdbc4157660 2023-11-30T17:08:13.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.832+0000 7fdbc17fa700 1 -- 172.21.15.49:0/3657991187 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc00aa60 con 0x7fdbc4157660 2023-11-30T17:08:13.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.832+0000 7fdbca2f0700 1 -- 172.21.15.49:0/3657991187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc4155c90 con 0x7fdbc4157660 2023-11-30T17:08:13.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.833+0000 7fdbca2f0700 1 -- 172.21.15.49:0/3657991187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc406c7c0 con 0x7fdbc4157660 2023-11-30T17:08:13.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.834+0000 7fdbc17fa700 1 -- 172.21.15.49:0/3657991187 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdbbc01b400 con 0x7fdbc4157660 2023-11-30T17:08:13.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.834+0000 7fdbc17fa700 1 --2- 172.21.15.49:0/3657991187 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdbb005f150 0x7fdbb0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:13.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.834+0000 7fdbc17fa700 1 -- 172.21.15.49:0/3657991187 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdbbc07a050 con 0x7fdbc4157660 2023-11-30T17:08:13.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.834+0000 7fdbc92ee700 1 --2- 172.21.15.49:0/3657991187 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdbb005f150 0x7fdbb0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:13.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.835+0000 7fdbc92ee700 1 --2- 172.21.15.49:0/3657991187 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdbb005f150 0x7fdbb0061610 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fdbb4009130 tx=0x7fdbb4017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:13.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:13.838+0000 7fdbc17fa700 1 -- 172.21.15.49:0/3657991187 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdbbc04b2c0 con 0x7fdbc4157660 2023-11-30T17:08:14.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.006+0000 7fdbca2f0700 1 -- 172.21.15.49:0/3657991187 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdbc40c0f50 con 0x7fdbb005f150 2023-11-30T17:08:14.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.016+0000 7fdbc17fa700 1 -- 172.21.15.49:0/3657991187 <== mgr.4105 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+342764 (secure 0 0 0) 0x7fdbc40c0f50 con 0x7fdbb005f150 2023-11-30T17:08:14.022 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:08:14.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.019+0000 7fdbca2f0700 1 -- 172.21.15.49:0/3657991187 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdbb005f150 msgr2=0x7fdbb0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:14.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.019+0000 7fdbca2f0700 1 --2- 172.21.15.49:0/3657991187 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdbb005f150 0x7fdbb0061610 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fdbb4009130 tx=0x7fdbb4017000).stop 2023-11-30T17:08:14.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.019+0000 7fdbca2f0700 1 -- 172.21.15.49:0/3657991187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbc4157660 msgr2=0x7fdbc4165160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:14.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.019+0000 7fdbca2f0700 1 --2- 172.21.15.49:0/3657991187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbc4157660 0x7fdbc4165160 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fdbbc00c7c0 tx=0x7fdbbc0015e0).stop 2023-11-30T17:08:14.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.020+0000 7fdbca2f0700 1 -- 172.21.15.49:0/3657991187 shutdown_connections 2023-11-30T17:08:14.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.020+0000 7fdbca2f0700 1 --2- 172.21.15.49:0/3657991187 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdbb005f150 0x7fdbb0061610 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:14.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.020+0000 7fdbca2f0700 1 --2- 172.21.15.49:0/3657991187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbc4157660 0x7fdbc4165160 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:14.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.020+0000 7fdbca2f0700 1 --2- 172.21.15.49:0/3657991187 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbc40c0180 0x7fdbc414f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:14.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.020+0000 7fdbca2f0700 1 --2- 172.21.15.49:0/3657991187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbc40c1750 0x7fdbc40b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:14.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.020+0000 7fdbca2f0700 1 -- 172.21.15.49:0/3657991187 >> 172.21.15.49:0/3657991187 conn(0x7fdbc40cb000 msgr2=0x7fdbc4150dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:14.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.020+0000 7fdbca2f0700 1 -- 172.21.15.49:0/3657991187 shutdown_connections 2023-11-30T17:08:14.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.020+0000 7fdbca2f0700 1 -- 172.21.15.49:0/3657991187 wait complete. 2023-11-30T17:08:14.025 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:08:14.033 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2023-11-30T17:08:12.851640+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":263,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2379840,"kb_used_data":3072,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752594880,"statfs":{"total":773094113280,"available":770657157120,"internally_reserved":0,"allocated":3145728,"data_stored":1274244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4305,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.935902"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.227614+0000","last_change":"2023-11-30T17:08:05.226520+0000","last_active":"2023-11-30T17:08:05.227614+0000","last_peered":"2023-11-30T17:08:05.227614+0000","last_clean":"2023-11-30T17:08:05.227614+0000","last_became_active":"2023-11-30T17:08:05.225956+0000","last_became_peered":"2023-11-30T17:08:05.225956+0000","last_unstale":"2023-11-30T17:08:05.227614+0000","last_undegraded":"2023-11-30T17:08:05.227614+0000","last_fullsized":"2023-11-30T17:08:05.227614+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3f","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.235684+0000","last_change":"2023-11-30T17:08:04.823299+0000","last_active":"2023-11-30T17:08:05.235684+0000","last_peered":"2023-11-30T17:08:05.235684+0000","last_clean":"2023-11-30T17:08:05.235684+0000","last_became_active":"2023-11-30T17:08:04.822994+0000","last_became_peered":"2023-11-30T17:08:04.822994+0000","last_unstale":"2023-11-30T17:08:05.235684+0000","last_undegraded":"2023-11-30T17:08:05.235684+0000","last_fullsized":"2023-11-30T17:08:05.235684+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.226089+0000","last_change":"2023-11-30T17:08:05.223983+0000","last_active":"2023-11-30T17:08:05.226089+0000","last_peered":"2023-11-30T17:08:05.226089+0000","last_clean":"2023-11-30T17:08:05.226089+0000","last_became_active":"2023-11-30T17:08:05.223706+0000","last_became_peered":"2023-11-30T17:08:05.223706+0000","last_unstale":"2023-11-30T17:08:05.226089+0000","last_undegraded":"2023-11-30T17:08:05.226089+0000","last_fullsized":"2023-11-30T17:08:05.226089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.221253+0000","last_change":"2023-11-30T17:08:04.828051+0000","last_active":"2023-11-30T17:08:05.221253+0000","last_peered":"2023-11-30T17:08:05.221253+0000","last_clean":"2023-11-30T17:08:05.221253+0000","last_became_active":"2023-11-30T17:08:04.827384+0000","last_became_peered":"2023-11-30T17:08:04.827384+0000","last_unstale":"2023-11-30T17:08:05.221253+0000","last_undegraded":"2023-11-30T17:08:05.221253+0000","last_fullsized":"2023-11-30T17:08:05.221253+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.227077+0000","last_change":"2023-11-30T17:08:05.223409+0000","last_active":"2023-11-30T17:08:05.227077+0000","last_peered":"2023-11-30T17:08:05.227077+0000","last_clean":"2023-11-30T17:08:05.227077+0000","last_became_active":"2023-11-30T17:08:05.223128+0000","last_became_peered":"2023-11-30T17:08:05.223128+0000","last_unstale":"2023-11-30T17:08:05.227077+0000","last_undegraded":"2023-11-30T17:08:05.227077+0000","last_fullsized":"2023-11-30T17:08:05.227077+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.215920+0000","last_change":"2023-11-30T17:08:04.831126+0000","last_active":"2023-11-30T17:08:05.215920+0000","last_peered":"2023-11-30T17:08:05.215920+0000","last_clean":"2023-11-30T17:08:05.215920+0000","last_became_active":"2023-11-30T17:08:04.830837+0000","last_became_peered":"2023-11-30T17:08:04.830837+0000","last_unstale":"2023-11-30T17:08:05.215920+0000","last_undegraded":"2023-11-30T17:08:05.215920+0000","last_fullsized":"2023-11-30T17:08:05.215920+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.221455+0000","last_change":"2023-11-30T17:08:05.218858+0000","last_active":"2023-11-30T17:08:05.221455+0000","last_peered":"2023-11-30T17:08:05.221455+0000","last_clean":"2023-11-30T17:08:05.221455+0000","last_became_active":"2023-11-30T17:08:05.218564+0000","last_became_peered":"2023-11-30T17:08:05.218564+0000","last_unstale":"2023-11-30T17:08:05.221455+0000","last_undegraded":"2023-11-30T17:08:05.221455+0000","last_fullsized":"2023-11-30T17:08:05.221455+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.222838+0000","last_change":"2023-11-30T17:08:04.835307+0000","last_active":"2023-11-30T17:08:05.222838+0000","last_peered":"2023-11-30T17:08:05.222838+0000","last_clean":"2023-11-30T17:08:05.222838+0000","last_became_active":"2023-11-30T17:08:04.835036+0000","last_became_peered":"2023-11-30T17:08:04.835036+0000","last_unstale":"2023-11-30T17:08:05.222838+0000","last_undegraded":"2023-11-30T17:08:05.222838+0000","last_fullsized":"2023-11-30T17:08:05.222838+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.227130+0000","last_change":"2023-11-30T17:08:05.225287+0000","last_active":"2023-11-30T17:08:05.227130+0000","last_peered":"2023-11-30T17:08:05.227130+0000","last_clean":"2023-11-30T17:08:05.227130+0000","last_became_active":"2023-11-30T17:08:05.225059+0000","last_became_peered":"2023-11-30T17:08:05.225059+0000","last_unstale":"2023-11-30T17:08:05.227130+0000","last_undegraded":"2023-11-30T17:08:05.227130+0000","last_fullsized":"2023-11-30T17:08:05.227130+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.218576+0000","last_change":"2023-11-30T17:08:04.824039+0000","last_active":"2023-11-30T17:08:05.218576+0000","last_peered":"2023-11-30T17:08:05.218576+0000","last_clean":"2023-11-30T17:08:05.218576+0000","last_became_active":"2023-11-30T17:08:04.823742+0000","last_became_peered":"2023-11-30T17:08:04.823742+0000","last_unstale":"2023-11-30T17:08:05.218576+0000","last_undegraded":"2023-11-30T17:08:05.218576+0000","last_fullsized":"2023-11-30T17:08:05.218576+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.230918+0000","last_change":"2023-11-30T17:08:05.225443+0000","last_active":"2023-11-30T17:08:05.230918+0000","last_peered":"2023-11-30T17:08:05.230918+0000","last_clean":"2023-11-30T17:08:05.230918+0000","last_became_active":"2023-11-30T17:08:05.224663+0000","last_became_peered":"2023-11-30T17:08:05.224663+0000","last_unstale":"2023-11-30T17:08:05.230918+0000","last_undegraded":"2023-11-30T17:08:05.230918+0000","last_fullsized":"2023-11-30T17:08:05.230918+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.225040+0000","last_change":"2023-11-30T17:08:04.825515+0000","last_active":"2023-11-30T17:08:05.225040+0000","last_peered":"2023-11-30T17:08:05.225040+0000","last_clean":"2023-11-30T17:08:05.225040+0000","last_became_active":"2023-11-30T17:08:04.825196+0000","last_became_peered":"2023-11-30T17:08:04.825196+0000","last_unstale":"2023-11-30T17:08:05.225040+0000","last_undegraded":"2023-11-30T17:08:05.225040+0000","last_fullsized":"2023-11-30T17:08:05.225040+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.226998+0000","last_change":"2023-11-30T17:08:05.224179+0000","last_active":"2023-11-30T17:08:05.226998+0000","last_peered":"2023-11-30T17:08:05.226998+0000","last_clean":"2023-11-30T17:08:05.226998+0000","last_became_active":"2023-11-30T17:08:05.223871+0000","last_became_peered":"2023-11-30T17:08:05.223871+0000","last_unstale":"2023-11-30T17:08:05.226998+0000","last_undegraded":"2023-11-30T17:08:05.226998+0000","last_fullsized":"2023-11-30T17:08:05.226998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.227335+0000","last_change":"2023-11-30T17:08:04.829158+0000","last_active":"2023-11-30T17:08:05.227335+0000","last_peered":"2023-11-30T17:08:05.227335+0000","last_clean":"2023-11-30T17:08:05.227335+0000","last_became_active":"2023-11-30T17:08:04.828465+0000","last_became_peered":"2023-11-30T17:08:04.828465+0000","last_unstale":"2023-11-30T17:08:05.227335+0000","last_undegraded":"2023-11-30T17:08:05.227335+0000","last_fullsized":"2023-11-30T17:08:05.227335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.227616+0000","last_change":"2023-11-30T17:08:05.226583+0000","last_active":"2023-11-30T17:08:05.227616+0000","last_peered":"2023-11-30T17:08:05.227616+0000","last_clean":"2023-11-30T17:08:05.227616+0000","last_became_active":"2023-11-30T17:08:05.226308+0000","last_became_peered":"2023-11-30T17:08:05.226308+0000","last_unstale":"2023-11-30T17:08:05.227616+0000","last_undegraded":"2023-11-30T17:08:05.227616+0000","last_fullsized":"2023-11-30T17:08:05.227616+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.227294+0000","last_change":"2023-11-30T17:08:04.830609+0000","last_active":"2023-11-30T17:08:05.227294+0000","last_peered":"2023-11-30T17:08:05.227294+0000","last_clean":"2023-11-30T17:08:05.227294+0000","last_became_active":"2023-11-30T17:08:04.830323+0000","last_became_peered":"2023-11-30T17:08:04.830323+0000","last_unstale":"2023-11-30T17:08:05.227294+0000","last_undegraded":"2023-11-30T17:08:05.227294+0000","last_fullsized":"2023-11-30T17:08:05.227294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.214461+0000","last_change":"2023-11-30T17:08:05.211614+0000","last_active":"2023-11-30T17:08:05.214461+0000","last_peered":"2023-11-30T17:08:05.214461+0000","last_clean":"2023-11-30T17:08:05.214461+0000","last_became_active":"2023-11-30T17:08:05.211340+0000","last_became_peered":"2023-11-30T17:08:05.211340+0000","last_unstale":"2023-11-30T17:08:05.214461+0000","last_undegraded":"2023-11-30T17:08:05.214461+0000","last_fullsized":"2023-11-30T17:08:05.214461+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.220685+0000","last_change":"2023-11-30T17:08:04.839762+0000","last_active":"2023-11-30T17:08:05.220685+0000","last_peered":"2023-11-30T17:08:05.220685+0000","last_clean":"2023-11-30T17:08:05.220685+0000","last_became_active":"2023-11-30T17:08:04.839450+0000","last_became_peered":"2023-11-30T17:08:04.839450+0000","last_unstale":"2023-11-30T17:08:05.220685+0000","last_undegraded":"2023-11-30T17:08:05.220685+0000","last_fullsized":"2023-11-30T17:08:05.220685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.231391+0000","last_change":"2023-11-30T17:08:05.227220+0000","last_active":"2023-11-30T17:08:05.231391+0000","last_peered":"2023-11-30T17:08:05.231391+0000","last_clean":"2023-11-30T17:08:05.231391+0000","last_became_active":"2023-11-30T17:08:05.226922+0000","last_became_peered":"2023-11-30T17:08:05.226922+0000","last_unstale":"2023-11-30T17:08:05.231391+0000","last_undegraded":"2023-11-30T17:08:05.231391+0000","last_fullsized":"2023-11-30T17:08:05.231391+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.209086+0000","last_change":"2023-11-30T17:08:04.830188+0000","last_active":"2023-11-30T17:08:05.209086+0000","last_peered":"2023-11-30T17:08:05.209086+0000","last_clean":"2023-11-30T17:08:05.209086+0000","last_became_active":"2023-11-30T17:08:04.829877+0000","last_became_peered":"2023-11-30T17:08:04.829877+0000","last_unstale":"2023-11-30T17:08:05.209086+0000","last_undegraded":"2023-11-30T17:08:05.209086+0000","last_fullsized":"2023-11-30T17:08:05.209086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.237698+0000","last_change":"2023-11-30T17:08:05.230663+0000","last_active":"2023-11-30T17:08:05.237698+0000","last_peered":"2023-11-30T17:08:05.237698+0000","last_clean":"2023-11-30T17:08:05.237698+0000","last_became_active":"2023-11-30T17:08:05.230390+0000","last_became_peered":"2023-11-30T17:08:05.230390+0000","last_unstale":"2023-11-30T17:08:05.237698+0000","last_undegraded":"2023-11-30T17:08:05.237698+0000","last_fullsized":"2023-11-30T17:08:05.237698+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.226748+0000","last_change":"2023-11-30T17:08:04.833242+0000","last_active":"2023-11-30T17:08:05.226748+0000","last_peered":"2023-11-30T17:08:05.226748+0000","last_clean":"2023-11-30T17:08:05.226748+0000","last_became_active":"2023-11-30T17:08:04.832984+0000","last_became_peered":"2023-11-30T17:08:04.832984+0000","last_unstale":"2023-11-30T17:08:05.226748+0000","last_undegraded":"2023-11-30T17:08:05.226748+0000","last_fullsized":"2023-11-30T17:08:05.226748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.230006+0000","last_change":"2023-11-30T17:08:05.229369+0000","last_active":"2023-11-30T17:08:05.230006+0000","last_peered":"2023-11-30T17:08:05.230006+0000","last_clean":"2023-11-30T17:08:05.230006+0000","last_became_active":"2023-11-30T17:08:05.229048+0000","last_became_peered":"2023-11-30T17:08:05.229048+0000","last_unstale":"2023-11-30T17:08:05.230006+0000","last_undegraded":"2023-11-30T17:08:05.230006+0000","last_fullsized":"2023-11-30T17:08:05.230006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.231016+0000","last_change":"2023-11-30T17:08:04.825390+0000","last_active":"2023-11-30T17:08:05.231016+0000","last_peered":"2023-11-30T17:08:05.231016+0000","last_clean":"2023-11-30T17:08:05.231016+0000","last_became_active":"2023-11-30T17:08:04.825103+0000","last_became_peered":"2023-11-30T17:08:04.825103+0000","last_unstale":"2023-11-30T17:08:05.231016+0000","last_undegraded":"2023-11-30T17:08:05.231016+0000","last_fullsized":"2023-11-30T17:08:05.231016+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.238771+0000","last_change":"2023-11-30T17:08:05.237665+0000","last_active":"2023-11-30T17:08:05.238771+0000","last_peered":"2023-11-30T17:08:05.238771+0000","last_clean":"2023-11-30T17:08:05.238771+0000","last_became_active":"2023-11-30T17:08:05.237366+0000","last_became_peered":"2023-11-30T17:08:05.237366+0000","last_unstale":"2023-11-30T17:08:05.238771+0000","last_undegraded":"2023-11-30T17:08:05.238771+0000","last_fullsized":"2023-11-30T17:08:05.238771+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.33","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.223790+0000","last_change":"2023-11-30T17:08:04.828651+0000","last_active":"2023-11-30T17:08:05.223790+0000","last_peered":"2023-11-30T17:08:05.223790+0000","last_clean":"2023-11-30T17:08:05.223790+0000","last_became_active":"2023-11-30T17:08:04.828366+0000","last_became_peered":"2023-11-30T17:08:04.828366+0000","last_unstale":"2023-11-30T17:08:05.223790+0000","last_undegraded":"2023-11-30T17:08:05.223790+0000","last_fullsized":"2023-11-30T17:08:05.223790+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.228897+0000","last_change":"2023-11-30T17:08:05.224409+0000","last_active":"2023-11-30T17:08:05.228897+0000","last_peered":"2023-11-30T17:08:05.228897+0000","last_clean":"2023-11-30T17:08:05.228897+0000","last_became_active":"2023-11-30T17:08:05.224074+0000","last_became_peered":"2023-11-30T17:08:05.224074+0000","last_unstale":"2023-11-30T17:08:05.228897+0000","last_undegraded":"2023-11-30T17:08:05.228897+0000","last_fullsized":"2023-11-30T17:08:05.228897+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.217166+0000","last_change":"2023-11-30T17:08:04.829309+0000","last_active":"2023-11-30T17:08:05.217166+0000","last_peered":"2023-11-30T17:08:05.217166+0000","last_clean":"2023-11-30T17:08:05.217166+0000","last_became_active":"2023-11-30T17:08:04.828747+0000","last_became_peered":"2023-11-30T17:08:04.828747+0000","last_unstale":"2023-11-30T17:08:05.217166+0000","last_undegraded":"2023-11-30T17:08:05.217166+0000","last_fullsized":"2023-11-30T17:08:05.217166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.234241+0000","last_change":"2023-11-30T17:08:05.229373+0000","last_active":"2023-11-30T17:08:05.234241+0000","last_peered":"2023-11-30T17:08:05.234241+0000","last_clean":"2023-11-30T17:08:05.234241+0000","last_became_active":"2023-11-30T17:08:05.229144+0000","last_became_peered":"2023-11-30T17:08:05.229144+0000","last_unstale":"2023-11-30T17:08:05.234241+0000","last_undegraded":"2023-11-30T17:08:05.234241+0000","last_fullsized":"2023-11-30T17:08:05.234241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.215341+0000","last_change":"2023-11-30T17:08:04.818979+0000","last_active":"2023-11-30T17:08:05.215341+0000","last_peered":"2023-11-30T17:08:05.215341+0000","last_clean":"2023-11-30T17:08:05.215341+0000","last_became_active":"2023-11-30T17:08:04.818658+0000","last_became_peered":"2023-11-30T17:08:04.818658+0000","last_unstale":"2023-11-30T17:08:05.215341+0000","last_undegraded":"2023-11-30T17:08:05.215341+0000","last_fullsized":"2023-11-30T17:08:05.215341+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.237692+0000","last_change":"2023-11-30T17:08:05.234966+0000","last_active":"2023-11-30T17:08:05.237692+0000","last_peered":"2023-11-30T17:08:05.237692+0000","last_clean":"2023-11-30T17:08:05.237692+0000","last_became_active":"2023-11-30T17:08:05.234659+0000","last_became_peered":"2023-11-30T17:08:05.234659+0000","last_unstale":"2023-11-30T17:08:05.237692+0000","last_undegraded":"2023-11-30T17:08:05.237692+0000","last_fullsized":"2023-11-30T17:08:05.237692+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.236858+0000","last_change":"2023-11-30T17:08:04.830055+0000","last_active":"2023-11-30T17:08:05.236858+0000","last_peered":"2023-11-30T17:08:05.236858+0000","last_clean":"2023-11-30T17:08:05.236858+0000","last_became_active":"2023-11-30T17:08:04.828978+0000","last_became_peered":"2023-11-30T17:08:04.828978+0000","last_unstale":"2023-11-30T17:08:05.236858+0000","last_undegraded":"2023-11-30T17:08:05.236858+0000","last_fullsized":"2023-11-30T17:08:05.236858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.227596+0000","last_change":"2023-11-30T17:08:05.218506+0000","last_active":"2023-11-30T17:08:05.227596+0000","last_peered":"2023-11-30T17:08:05.227596+0000","last_clean":"2023-11-30T17:08:05.227596+0000","last_became_active":"2023-11-30T17:08:05.218121+0000","last_became_peered":"2023-11-30T17:08:05.218121+0000","last_unstale":"2023-11-30T17:08:05.227596+0000","last_undegraded":"2023-11-30T17:08:05.227596+0000","last_fullsized":"2023-11-30T17:08:05.227596+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.226320+0000","last_change":"2023-11-30T17:08:04.829558+0000","last_active":"2023-11-30T17:08:05.226320+0000","last_peered":"2023-11-30T17:08:05.226320+0000","last_clean":"2023-11-30T17:08:05.226320+0000","last_became_active":"2023-11-30T17:08:04.828388+0000","last_became_peered":"2023-11-30T17:08:04.828388+0000","last_unstale":"2023-11-30T17:08:05.226320+0000","last_undegraded":"2023-11-30T17:08:05.226320+0000","last_fullsized":"2023-11-30T17:08:05.226320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.213540+0000","last_change":"2023-11-30T17:08:05.211072+0000","last_active":"2023-11-30T17:08:05.213540+0000","last_peered":"2023-11-30T17:08:05.213540+0000","last_clean":"2023-11-30T17:08:05.213540+0000","last_became_active":"2023-11-30T17:08:05.210773+0000","last_became_peered":"2023-11-30T17:08:05.210773+0000","last_unstale":"2023-11-30T17:08:05.213540+0000","last_undegraded":"2023-11-30T17:08:05.213540+0000","last_fullsized":"2023-11-30T17:08:05.213540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.221061+0000","last_change":"2023-11-30T17:08:04.833933+0000","last_active":"2023-11-30T17:08:05.221061+0000","last_peered":"2023-11-30T17:08:05.221061+0000","last_clean":"2023-11-30T17:08:05.221061+0000","last_became_active":"2023-11-30T17:08:04.833561+0000","last_became_peered":"2023-11-30T17:08:04.833561+0000","last_unstale":"2023-11-30T17:08:05.221061+0000","last_undegraded":"2023-11-30T17:08:05.221061+0000","last_fullsized":"2023-11-30T17:08:05.221061+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.234068+0000","last_change":"2023-11-30T17:08:05.225542+0000","last_active":"2023-11-30T17:08:05.234068+0000","last_peered":"2023-11-30T17:08:05.234068+0000","last_clean":"2023-11-30T17:08:05.234068+0000","last_became_active":"2023-11-30T17:08:05.225257+0000","last_became_peered":"2023-11-30T17:08:05.225257+0000","last_unstale":"2023-11-30T17:08:05.234068+0000","last_undegraded":"2023-11-30T17:08:05.234068+0000","last_fullsized":"2023-11-30T17:08:05.234068+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.226736+0000","last_change":"2023-11-30T17:08:04.833961+0000","last_active":"2023-11-30T17:08:05.226736+0000","last_peered":"2023-11-30T17:08:05.226736+0000","last_clean":"2023-11-30T17:08:05.226736+0000","last_became_active":"2023-11-30T17:08:04.833596+0000","last_became_peered":"2023-11-30T17:08:04.833596+0000","last_unstale":"2023-11-30T17:08:05.226736+0000","last_undegraded":"2023-11-30T17:08:05.226736+0000","last_fullsized":"2023-11-30T17:08:05.226736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.239783+0000","last_change":"2023-11-30T17:08:05.239224+0000","last_active":"2023-11-30T17:08:05.239783+0000","last_peered":"2023-11-30T17:08:05.239783+0000","last_clean":"2023-11-30T17:08:05.239783+0000","last_became_active":"2023-11-30T17:08:05.238943+0000","last_became_peered":"2023-11-30T17:08:05.238943+0000","last_unstale":"2023-11-30T17:08:05.239783+0000","last_undegraded":"2023-11-30T17:08:05.239783+0000","last_fullsized":"2023-11-30T17:08:05.239783+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.205877+0000","last_change":"2023-11-30T17:08:04.817133+0000","last_active":"2023-11-30T17:08:05.205877+0000","last_peered":"2023-11-30T17:08:05.205877+0000","last_clean":"2023-11-30T17:08:05.205877+0000","last_became_active":"2023-11-30T17:08:04.816828+0000","last_became_peered":"2023-11-30T17:08:04.816828+0000","last_unstale":"2023-11-30T17:08:05.205877+0000","last_undegraded":"2023-11-30T17:08:05.205877+0000","last_fullsized":"2023-11-30T17:08:05.205877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.234231+0000","last_change":"2023-11-30T17:08:05.232735+0000","last_active":"2023-11-30T17:08:05.234231+0000","last_peered":"2023-11-30T17:08:05.234231+0000","last_clean":"2023-11-30T17:08:05.234231+0000","last_became_active":"2023-11-30T17:08:05.232497+0000","last_became_peered":"2023-11-30T17:08:05.232497+0000","last_unstale":"2023-11-30T17:08:05.234231+0000","last_undegraded":"2023-11-30T17:08:05.234231+0000","last_fullsized":"2023-11-30T17:08:05.234231+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.223355+0000","last_change":"2023-11-30T17:08:04.840352+0000","last_active":"2023-11-30T17:08:05.223355+0000","last_peered":"2023-11-30T17:08:05.223355+0000","last_clean":"2023-11-30T17:08:05.223355+0000","last_became_active":"2023-11-30T17:08:04.840024+0000","last_became_peered":"2023-11-30T17:08:04.840024+0000","last_unstale":"2023-11-30T17:08:05.223355+0000","last_undegraded":"2023-11-30T17:08:05.223355+0000","last_fullsized":"2023-11-30T17:08:05.223355+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.238338+0000","last_change":"2023-11-30T17:08:05.236096+0000","last_active":"2023-11-30T17:08:05.238338+0000","last_peered":"2023-11-30T17:08:05.238338+0000","last_clean":"2023-11-30T17:08:05.238338+0000","last_became_active":"2023-11-30T17:08:05.235752+0000","last_became_peered":"2023-11-30T17:08:05.235752+0000","last_unstale":"2023-11-30T17:08:05.238338+0000","last_undegraded":"2023-11-30T17:08:05.238338+0000","last_fullsized":"2023-11-30T17:08:05.238338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.218805+0000","last_change":"2023-11-30T17:08:04.839882+0000","last_active":"2023-11-30T17:08:05.218805+0000","last_peered":"2023-11-30T17:08:05.218805+0000","last_clean":"2023-11-30T17:08:05.218805+0000","last_became_active":"2023-11-30T17:08:04.839580+0000","last_became_peered":"2023-11-30T17:08:04.839580+0000","last_unstale":"2023-11-30T17:08:05.218805+0000","last_undegraded":"2023-11-30T17:08:05.218805+0000","last_fullsized":"2023-11-30T17:08:05.218805+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.222694+0000","last_change":"2023-11-30T17:08:05.221409+0000","last_active":"2023-11-30T17:08:05.222694+0000","last_peered":"2023-11-30T17:08:05.222694+0000","last_clean":"2023-11-30T17:08:05.222694+0000","last_became_active":"2023-11-30T17:08:05.221116+0000","last_became_peered":"2023-11-30T17:08:05.221116+0000","last_unstale":"2023-11-30T17:08:05.222694+0000","last_undegraded":"2023-11-30T17:08:05.222694+0000","last_fullsized":"2023-11-30T17:08:05.222694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.208497+0000","last_change":"2023-11-30T17:08:04.826136+0000","last_active":"2023-11-30T17:08:05.208497+0000","last_peered":"2023-11-30T17:08:05.208497+0000","last_clean":"2023-11-30T17:08:05.208497+0000","last_became_active":"2023-11-30T17:08:04.825821+0000","last_became_peered":"2023-11-30T17:08:04.825821+0000","last_unstale":"2023-11-30T17:08:05.208497+0000","last_undegraded":"2023-11-30T17:08:05.208497+0000","last_fullsized":"2023-11-30T17:08:05.208497+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.231038+0000","last_change":"2023-11-30T17:08:05.229538+0000","last_active":"2023-11-30T17:08:05.231038+0000","last_peered":"2023-11-30T17:08:05.231038+0000","last_clean":"2023-11-30T17:08:05.231038+0000","last_became_active":"2023-11-30T17:08:05.229247+0000","last_became_peered":"2023-11-30T17:08:05.229247+0000","last_unstale":"2023-11-30T17:08:05.231038+0000","last_undegraded":"2023-11-30T17:08:05.231038+0000","last_fullsized":"2023-11-30T17:08:05.231038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.215372+0000","last_change":"2023-11-30T17:08:04.825934+0000","last_active":"2023-11-30T17:08:05.215372+0000","last_peered":"2023-11-30T17:08:05.215372+0000","last_clean":"2023-11-30T17:08:05.215372+0000","last_became_active":"2023-11-30T17:08:04.825612+0000","last_became_peered":"2023-11-30T17:08:04.825612+0000","last_unstale":"2023-11-30T17:08:05.215372+0000","last_undegraded":"2023-11-30T17:08:05.215372+0000","last_fullsized":"2023-11-30T17:08:05.215372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.228962+0000","last_change":"2023-11-30T17:08:05.224590+0000","last_active":"2023-11-30T17:08:05.228962+0000","last_peered":"2023-11-30T17:08:05.228962+0000","last_clean":"2023-11-30T17:08:05.228962+0000","last_became_active":"2023-11-30T17:08:05.224124+0000","last_became_peered":"2023-11-30T17:08:05.224124+0000","last_unstale":"2023-11-30T17:08:05.228962+0000","last_undegraded":"2023-11-30T17:08:05.228962+0000","last_fullsized":"2023-11-30T17:08:05.228962+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.207498+0000","last_change":"2023-11-30T17:08:04.830537+0000","last_active":"2023-11-30T17:08:05.207498+0000","last_peered":"2023-11-30T17:08:05.207498+0000","last_clean":"2023-11-30T17:08:05.207498+0000","last_became_active":"2023-11-30T17:08:04.830212+0000","last_became_peered":"2023-11-30T17:08:04.830212+0000","last_unstale":"2023-11-30T17:08:05.207498+0000","last_undegraded":"2023-11-30T17:08:05.207498+0000","last_fullsized":"2023-11-30T17:08:05.207498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.222521+0000","last_change":"2023-11-30T17:08:05.214818+0000","last_active":"2023-11-30T17:08:05.222521+0000","last_peered":"2023-11-30T17:08:05.222521+0000","last_clean":"2023-11-30T17:08:05.222521+0000","last_became_active":"2023-11-30T17:08:05.214061+0000","last_became_peered":"2023-11-30T17:08:05.214061+0000","last_unstale":"2023-11-30T17:08:05.222521+0000","last_undegraded":"2023-11-30T17:08:05.222521+0000","last_fullsized":"2023-11-30T17:08:05.222521+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.26","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-30T17:08:06.209844+0000","last_change":"2023-11-30T17:08:04.832508+0000","last_active":"2023-11-30T17:08:06.209844+0000","last_peered":"2023-11-30T17:08:06.209844+0000","last_clean":"2023-11-30T17:08:06.209844+0000","last_became_active":"2023-11-30T17:08:04.832016+0000","last_became_peered":"2023-11-30T17:08:04.832016+0000","last_unstale":"2023-11-30T17:08:06.209844+0000","last_undegraded":"2023-11-30T17:08:06.209844+0000","last_fullsized":"2023-11-30T17:08:06.209844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.227253+0000","last_change":"2023-11-30T17:08:05.226012+0000","last_active":"2023-11-30T17:08:05.227253+0000","last_peered":"2023-11-30T17:08:05.227253+0000","last_clean":"2023-11-30T17:08:05.227253+0000","last_became_active":"2023-11-30T17:08:05.225733+0000","last_became_peered":"2023-11-30T17:08:05.225733+0000","last_unstale":"2023-11-30T17:08:05.227253+0000","last_undegraded":"2023-11-30T17:08:05.227253+0000","last_fullsized":"2023-11-30T17:08:05.227253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.208498+0000","last_change":"2023-11-30T17:08:04.840836+0000","last_active":"2023-11-30T17:08:05.208498+0000","last_peered":"2023-11-30T17:08:05.208498+0000","last_clean":"2023-11-30T17:08:05.208498+0000","last_became_active":"2023-11-30T17:08:04.840515+0000","last_became_peered":"2023-11-30T17:08:04.840515+0000","last_unstale":"2023-11-30T17:08:05.208498+0000","last_undegraded":"2023-11-30T17:08:05.208498+0000","last_fullsized":"2023-11-30T17:08:05.208498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.231750+0000","last_change":"2023-11-30T17:08:05.218998+0000","last_active":"2023-11-30T17:08:05.231750+0000","last_peered":"2023-11-30T17:08:05.231750+0000","last_clean":"2023-11-30T17:08:05.231750+0000","last_became_active":"2023-11-30T17:08:05.218689+0000","last_became_peered":"2023-11-30T17:08:05.218689+0000","last_unstale":"2023-11-30T17:08:05.231750+0000","last_undegraded":"2023-11-30T17:08:05.231750+0000","last_fullsized":"2023-11-30T17:08:05.231750+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.216605+0000","last_change":"2023-11-30T17:08:04.822779+0000","last_active":"2023-11-30T17:08:05.216605+0000","last_peered":"2023-11-30T17:08:05.216605+0000","last_clean":"2023-11-30T17:08:05.216605+0000","last_became_active":"2023-11-30T17:08:04.822440+0000","last_became_peered":"2023-11-30T17:08:04.822440+0000","last_unstale":"2023-11-30T17:08:05.216605+0000","last_undegraded":"2023-11-30T17:08:05.216605+0000","last_fullsized":"2023-11-30T17:08:05.216605+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.222744+0000","last_change":"2023-11-30T17:08:05.214086+0000","last_active":"2023-11-30T17:08:05.222744+0000","last_peered":"2023-11-30T17:08:05.222744+0000","last_clean":"2023-11-30T17:08:05.222744+0000","last_became_active":"2023-11-30T17:08:05.213641+0000","last_became_peered":"2023-11-30T17:08:05.213641+0000","last_unstale":"2023-11-30T17:08:05.222744+0000","last_undegraded":"2023-11-30T17:08:05.222744+0000","last_fullsized":"2023-11-30T17:08:05.222744+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.218875+0000","last_change":"2023-11-30T17:08:04.839831+0000","last_active":"2023-11-30T17:08:05.218875+0000","last_peered":"2023-11-30T17:08:05.218875+0000","last_clean":"2023-11-30T17:08:05.218875+0000","last_became_active":"2023-11-30T17:08:04.839522+0000","last_became_peered":"2023-11-30T17:08:04.839522+0000","last_unstale":"2023-11-30T17:08:05.218875+0000","last_undegraded":"2023-11-30T17:08:05.218875+0000","last_fullsized":"2023-11-30T17:08:05.218875+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.238357+0000","last_change":"2023-11-30T17:08:05.236134+0000","last_active":"2023-11-30T17:08:05.238357+0000","last_peered":"2023-11-30T17:08:05.238357+0000","last_clean":"2023-11-30T17:08:05.238357+0000","last_became_active":"2023-11-30T17:08:05.235587+0000","last_became_peered":"2023-11-30T17:08:05.235587+0000","last_unstale":"2023-11-30T17:08:05.238357+0000","last_undegraded":"2023-11-30T17:08:05.238357+0000","last_fullsized":"2023-11-30T17:08:05.238357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.225688+0000","last_change":"2023-11-30T17:08:04.830082+0000","last_active":"2023-11-30T17:08:05.225688+0000","last_peered":"2023-11-30T17:08:05.225688+0000","last_clean":"2023-11-30T17:08:05.225688+0000","last_became_active":"2023-11-30T17:08:04.829876+0000","last_became_peered":"2023-11-30T17:08:04.829876+0000","last_unstale":"2023-11-30T17:08:05.225688+0000","last_undegraded":"2023-11-30T17:08:05.225688+0000","last_fullsized":"2023-11-30T17:08:05.225688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.231976+0000","last_change":"2023-11-30T17:08:05.220144+0000","last_active":"2023-11-30T17:08:05.231976+0000","last_peered":"2023-11-30T17:08:05.231976+0000","last_clean":"2023-11-30T17:08:05.231976+0000","last_became_active":"2023-11-30T17:08:05.219676+0000","last_became_peered":"2023-11-30T17:08:05.219676+0000","last_unstale":"2023-11-30T17:08:05.231976+0000","last_undegraded":"2023-11-30T17:08:05.231976+0000","last_fullsized":"2023-11-30T17:08:05.231976+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.209225+0000","last_change":"2023-11-30T17:08:04.827307+0000","last_active":"2023-11-30T17:08:05.209225+0000","last_peered":"2023-11-30T17:08:05.209225+0000","last_clean":"2023-11-30T17:08:05.209225+0000","last_became_active":"2023-11-30T17:08:04.826978+0000","last_became_peered":"2023-11-30T17:08:04.826978+0000","last_unstale":"2023-11-30T17:08:05.209225+0000","last_undegraded":"2023-11-30T17:08:05.209225+0000","last_fullsized":"2023-11-30T17:08:05.209225+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.227663+0000","last_change":"2023-11-30T17:08:05.218963+0000","last_active":"2023-11-30T17:08:05.227663+0000","last_peered":"2023-11-30T17:08:05.227663+0000","last_clean":"2023-11-30T17:08:05.227663+0000","last_became_active":"2023-11-30T17:08:05.218551+0000","last_became_peered":"2023-11-30T17:08:05.218551+0000","last_unstale":"2023-11-30T17:08:05.227663+0000","last_undegraded":"2023-11-30T17:08:05.227663+0000","last_fullsized":"2023-11-30T17:08:05.227663+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.226705+0000","last_change":"2023-11-30T17:08:04.840004+0000","last_active":"2023-11-30T17:08:05.226705+0000","last_peered":"2023-11-30T17:08:05.226705+0000","last_clean":"2023-11-30T17:08:05.226705+0000","last_became_active":"2023-11-30T17:08:04.839724+0000","last_became_peered":"2023-11-30T17:08:04.839724+0000","last_unstale":"2023-11-30T17:08:05.226705+0000","last_undegraded":"2023-11-30T17:08:05.226705+0000","last_fullsized":"2023-11-30T17:08:05.226705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.237794+0000","last_change":"2023-11-30T17:08:05.233479+0000","last_active":"2023-11-30T17:08:05.237794+0000","last_peered":"2023-11-30T17:08:05.237794+0000","last_clean":"2023-11-30T17:08:05.237794+0000","last_became_active":"2023-11-30T17:08:05.233190+0000","last_became_peered":"2023-11-30T17:08:05.233190+0000","last_unstale":"2023-11-30T17:08:05.237794+0000","last_undegraded":"2023-11-30T17:08:05.237794+0000","last_fullsized":"2023-11-30T17:08:05.237794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.218450+0000","last_change":"2023-11-30T17:08:04.841210+0000","last_active":"2023-11-30T17:08:05.218450+0000","last_peered":"2023-11-30T17:08:05.218450+0000","last_clean":"2023-11-30T17:08:05.218450+0000","last_became_active":"2023-11-30T17:08:04.840771+0000","last_became_peered":"2023-11-30T17:08:04.840771+0000","last_unstale":"2023-11-30T17:08:05.218450+0000","last_undegraded":"2023-11-30T17:08:05.218450+0000","last_fullsized":"2023-11-30T17:08:05.218450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.230288+0000","last_change":"2023-11-30T17:08:05.229721+0000","last_active":"2023-11-30T17:08:05.230288+0000","last_peered":"2023-11-30T17:08:05.230288+0000","last_clean":"2023-11-30T17:08:05.230288+0000","last_became_active":"2023-11-30T17:08:05.229404+0000","last_became_peered":"2023-11-30T17:08:05.229404+0000","last_unstale":"2023-11-30T17:08:05.230288+0000","last_undegraded":"2023-11-30T17:08:05.230288+0000","last_fullsized":"2023-11-30T17:08:05.230288+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.214083+0000","last_change":"2023-11-30T17:08:04.825249+0000","last_active":"2023-11-30T17:08:05.214083+0000","last_peered":"2023-11-30T17:08:05.214083+0000","last_clean":"2023-11-30T17:08:05.214083+0000","last_became_active":"2023-11-30T17:08:04.824955+0000","last_became_peered":"2023-11-30T17:08:04.824955+0000","last_unstale":"2023-11-30T17:08:05.214083+0000","last_undegraded":"2023-11-30T17:08:05.214083+0000","last_fullsized":"2023-11-30T17:08:05.214083+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.234392+0000","last_change":"2023-11-30T17:08:05.231054+0000","last_active":"2023-11-30T17:08:05.234392+0000","last_peered":"2023-11-30T17:08:05.234392+0000","last_clean":"2023-11-30T17:08:05.234392+0000","last_became_active":"2023-11-30T17:08:05.230803+0000","last_became_peered":"2023-11-30T17:08:05.230803+0000","last_unstale":"2023-11-30T17:08:05.234392+0000","last_undegraded":"2023-11-30T17:08:05.234392+0000","last_fullsized":"2023-11-30T17:08:05.234392+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.222551+0000","last_change":"2023-11-30T17:08:04.835901+0000","last_active":"2023-11-30T17:08:05.222551+0000","last_peered":"2023-11-30T17:08:05.222551+0000","last_clean":"2023-11-30T17:08:05.222551+0000","last_became_active":"2023-11-30T17:08:04.835635+0000","last_became_peered":"2023-11-30T17:08:04.835635+0000","last_unstale":"2023-11-30T17:08:05.222551+0000","last_undegraded":"2023-11-30T17:08:05.222551+0000","last_fullsized":"2023-11-30T17:08:05.222551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.235164+0000","last_change":"2023-11-30T17:08:05.233769+0000","last_active":"2023-11-30T17:08:05.235164+0000","last_peered":"2023-11-30T17:08:05.235164+0000","last_clean":"2023-11-30T17:08:05.235164+0000","last_became_active":"2023-11-30T17:08:05.233458+0000","last_became_peered":"2023-11-30T17:08:05.233458+0000","last_unstale":"2023-11-30T17:08:05.235164+0000","last_undegraded":"2023-11-30T17:08:05.235164+0000","last_fullsized":"2023-11-30T17:08:05.235164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.220331+0000","last_change":"2023-11-30T17:08:04.834628+0000","last_active":"2023-11-30T17:08:05.220331+0000","last_peered":"2023-11-30T17:08:05.220331+0000","last_clean":"2023-11-30T17:08:05.220331+0000","last_became_active":"2023-11-30T17:08:04.834278+0000","last_became_peered":"2023-11-30T17:08:04.834278+0000","last_unstale":"2023-11-30T17:08:05.220331+0000","last_undegraded":"2023-11-30T17:08:05.220331+0000","last_fullsized":"2023-11-30T17:08:05.220331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.214033+0000","last_change":"2023-11-30T17:08:05.212559+0000","last_active":"2023-11-30T17:08:05.214033+0000","last_peered":"2023-11-30T17:08:05.214033+0000","last_clean":"2023-11-30T17:08:05.214033+0000","last_became_active":"2023-11-30T17:08:05.212314+0000","last_became_peered":"2023-11-30T17:08:05.212314+0000","last_unstale":"2023-11-30T17:08:05.214033+0000","last_undegraded":"2023-11-30T17:08:05.214033+0000","last_fullsized":"2023-11-30T17:08:05.214033+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.215881+0000","last_change":"2023-11-30T17:08:04.821529+0000","last_active":"2023-11-30T17:08:05.215881+0000","last_peered":"2023-11-30T17:08:05.215881+0000","last_clean":"2023-11-30T17:08:05.215881+0000","last_became_active":"2023-11-30T17:08:04.821238+0000","last_became_peered":"2023-11-30T17:08:04.821238+0000","last_unstale":"2023-11-30T17:08:05.215881+0000","last_undegraded":"2023-11-30T17:08:05.215881+0000","last_fullsized":"2023-11-30T17:08:05.215881+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.228922+0000","last_change":"2023-11-30T17:08:05.224463+0000","last_active":"2023-11-30T17:08:05.228922+0000","last_peered":"2023-11-30T17:08:05.228922+0000","last_clean":"2023-11-30T17:08:05.228922+0000","last_became_active":"2023-11-30T17:08:05.224150+0000","last_became_peered":"2023-11-30T17:08:05.224150+0000","last_unstale":"2023-11-30T17:08:05.228922+0000","last_undegraded":"2023-11-30T17:08:05.228922+0000","last_fullsized":"2023-11-30T17:08:05.228922+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.225567+0000","last_change":"2023-11-30T17:08:04.840744+0000","last_active":"2023-11-30T17:08:05.225567+0000","last_peered":"2023-11-30T17:08:05.225567+0000","last_clean":"2023-11-30T17:08:05.225567+0000","last_became_active":"2023-11-30T17:08:04.840486+0000","last_became_peered":"2023-11-30T17:08:04.840486+0000","last_unstale":"2023-11-30T17:08:05.225567+0000","last_undegraded":"2023-11-30T17:08:05.225567+0000","last_fullsized":"2023-11-30T17:08:05.225567+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.234220+0000","last_change":"2023-11-30T17:08:05.228648+0000","last_active":"2023-11-30T17:08:05.234220+0000","last_peered":"2023-11-30T17:08:05.234220+0000","last_clean":"2023-11-30T17:08:05.234220+0000","last_became_active":"2023-11-30T17:08:05.228352+0000","last_became_peered":"2023-11-30T17:08:05.228352+0000","last_unstale":"2023-11-30T17:08:05.234220+0000","last_undegraded":"2023-11-30T17:08:05.234220+0000","last_fullsized":"2023-11-30T17:08:05.234220+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.208907+0000","last_change":"2023-11-30T17:08:04.832330+0000","last_active":"2023-11-30T17:08:05.208907+0000","last_peered":"2023-11-30T17:08:05.208907+0000","last_clean":"2023-11-30T17:08:05.208907+0000","last_became_active":"2023-11-30T17:08:04.831979+0000","last_became_peered":"2023-11-30T17:08:04.831979+0000","last_unstale":"2023-11-30T17:08:05.208907+0000","last_undegraded":"2023-11-30T17:08:05.208907+0000","last_fullsized":"2023-11-30T17:08:05.208907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.234735+0000","last_change":"2023-11-30T17:08:05.233406+0000","last_active":"2023-11-30T17:08:05.234735+0000","last_peered":"2023-11-30T17:08:05.234735+0000","last_clean":"2023-11-30T17:08:05.234735+0000","last_became_active":"2023-11-30T17:08:05.232960+0000","last_became_peered":"2023-11-30T17:08:05.232960+0000","last_unstale":"2023-11-30T17:08:05.234735+0000","last_undegraded":"2023-11-30T17:08:05.234735+0000","last_fullsized":"2023-11-30T17:08:05.234735+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.218467+0000","last_change":"2023-11-30T17:08:04.834480+0000","last_active":"2023-11-30T17:08:05.218467+0000","last_peered":"2023-11-30T17:08:05.218467+0000","last_clean":"2023-11-30T17:08:05.218467+0000","last_became_active":"2023-11-30T17:08:04.834175+0000","last_became_peered":"2023-11-30T17:08:04.834175+0000","last_unstale":"2023-11-30T17:08:05.218467+0000","last_undegraded":"2023-11-30T17:08:05.218467+0000","last_fullsized":"2023-11-30T17:08:05.218467+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.227633+0000","last_change":"2023-11-30T17:08:05.226645+0000","last_active":"2023-11-30T17:08:05.227633+0000","last_peered":"2023-11-30T17:08:05.227633+0000","last_clean":"2023-11-30T17:08:05.227633+0000","last_became_active":"2023-11-30T17:08:05.226347+0000","last_became_peered":"2023-11-30T17:08:05.226347+0000","last_unstale":"2023-11-30T17:08:05.227633+0000","last_undegraded":"2023-11-30T17:08:05.227633+0000","last_fullsized":"2023-11-30T17:08:05.227633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.218286+0000","last_change":"2023-11-30T17:08:04.834104+0000","last_active":"2023-11-30T17:08:05.218286+0000","last_peered":"2023-11-30T17:08:05.218286+0000","last_clean":"2023-11-30T17:08:05.218286+0000","last_became_active":"2023-11-30T17:08:04.833804+0000","last_became_peered":"2023-11-30T17:08:04.833804+0000","last_unstale":"2023-11-30T17:08:05.218286+0000","last_undegraded":"2023-11-30T17:08:05.218286+0000","last_fullsized":"2023-11-30T17:08:05.218286+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.238783+0000","last_change":"2023-11-30T17:08:05.237630+0000","last_active":"2023-11-30T17:08:05.238783+0000","last_peered":"2023-11-30T17:08:05.238783+0000","last_clean":"2023-11-30T17:08:05.238783+0000","last_became_active":"2023-11-30T17:08:05.237269+0000","last_became_peered":"2023-11-30T17:08:05.237269+0000","last_unstale":"2023-11-30T17:08:05.238783+0000","last_undegraded":"2023-11-30T17:08:05.238783+0000","last_fullsized":"2023-11-30T17:08:05.238783+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.219700+0000","last_change":"2023-11-30T17:08:04.826514+0000","last_active":"2023-11-30T17:08:05.219700+0000","last_peered":"2023-11-30T17:08:05.219700+0000","last_clean":"2023-11-30T17:08:05.219700+0000","last_became_active":"2023-11-30T17:08:04.826204+0000","last_became_peered":"2023-11-30T17:08:04.826204+0000","last_unstale":"2023-11-30T17:08:05.219700+0000","last_undegraded":"2023-11-30T17:08:05.219700+0000","last_fullsized":"2023-11-30T17:08:05.219700+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.235400+0000","last_change":"2023-11-30T17:08:05.234739+0000","last_active":"2023-11-30T17:08:05.235400+0000","last_peered":"2023-11-30T17:08:05.235400+0000","last_clean":"2023-11-30T17:08:05.235400+0000","last_became_active":"2023-11-30T17:08:05.234406+0000","last_became_peered":"2023-11-30T17:08:05.234406+0000","last_unstale":"2023-11-30T17:08:05.235400+0000","last_undegraded":"2023-11-30T17:08:05.235400+0000","last_fullsized":"2023-11-30T17:08:05.235400+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.230086+0000","last_change":"2023-11-30T17:08:04.830992+0000","last_active":"2023-11-30T17:08:05.230086+0000","last_peered":"2023-11-30T17:08:05.230086+0000","last_clean":"2023-11-30T17:08:05.230086+0000","last_became_active":"2023-11-30T17:08:04.830712+0000","last_became_peered":"2023-11-30T17:08:04.830712+0000","last_unstale":"2023-11-30T17:08:05.230086+0000","last_undegraded":"2023-11-30T17:08:05.230086+0000","last_fullsized":"2023-11-30T17:08:05.230086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.224710+0000","last_change":"2023-11-30T17:08:05.222188+0000","last_active":"2023-11-30T17:08:05.224710+0000","last_peered":"2023-11-30T17:08:05.224710+0000","last_clean":"2023-11-30T17:08:05.224710+0000","last_became_active":"2023-11-30T17:08:05.221833+0000","last_became_peered":"2023-11-30T17:08:05.221833+0000","last_unstale":"2023-11-30T17:08:05.224710+0000","last_undegraded":"2023-11-30T17:08:05.224710+0000","last_fullsized":"2023-11-30T17:08:05.224710+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.232351+0000","last_change":"2023-11-30T17:08:04.832203+0000","last_active":"2023-11-30T17:08:05.232351+0000","last_peered":"2023-11-30T17:08:05.232351+0000","last_clean":"2023-11-30T17:08:05.232351+0000","last_became_active":"2023-11-30T17:08:04.831893+0000","last_became_peered":"2023-11-30T17:08:04.831893+0000","last_unstale":"2023-11-30T17:08:05.232351+0000","last_undegraded":"2023-11-30T17:08:05.232351+0000","last_fullsized":"2023-11-30T17:08:05.232351+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.226136+0000","last_change":"2023-11-30T17:08:05.224904+0000","last_active":"2023-11-30T17:08:05.226136+0000","last_peered":"2023-11-30T17:08:05.226136+0000","last_clean":"2023-11-30T17:08:05.226136+0000","last_became_active":"2023-11-30T17:08:05.224611+0000","last_became_peered":"2023-11-30T17:08:05.224611+0000","last_unstale":"2023-11-30T17:08:05.226136+0000","last_undegraded":"2023-11-30T17:08:05.226136+0000","last_fullsized":"2023-11-30T17:08:05.226136+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.222732+0000","last_change":"2023-11-30T17:08:04.824129+0000","last_active":"2023-11-30T17:08:05.222732+0000","last_peered":"2023-11-30T17:08:05.222732+0000","last_clean":"2023-11-30T17:08:05.222732+0000","last_became_active":"2023-11-30T17:08:04.823589+0000","last_became_peered":"2023-11-30T17:08:04.823589+0000","last_unstale":"2023-11-30T17:08:05.222732+0000","last_undegraded":"2023-11-30T17:08:05.222732+0000","last_fullsized":"2023-11-30T17:08:05.222732+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.218372+0000","last_change":"2023-11-30T17:08:05.217498+0000","last_active":"2023-11-30T17:08:05.218372+0000","last_peered":"2023-11-30T17:08:05.218372+0000","last_clean":"2023-11-30T17:08:05.218372+0000","last_became_active":"2023-11-30T17:08:05.217135+0000","last_became_peered":"2023-11-30T17:08:05.217135+0000","last_unstale":"2023-11-30T17:08:05.218372+0000","last_undegraded":"2023-11-30T17:08:05.218372+0000","last_fullsized":"2023-11-30T17:08:05.218372+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.208438+0000","last_change":"2023-11-30T17:08:04.823718+0000","last_active":"2023-11-30T17:08:05.208438+0000","last_peered":"2023-11-30T17:08:05.208438+0000","last_clean":"2023-11-30T17:08:05.208438+0000","last_became_active":"2023-11-30T17:08:04.823446+0000","last_became_peered":"2023-11-30T17:08:04.823446+0000","last_unstale":"2023-11-30T17:08:05.208438+0000","last_undegraded":"2023-11-30T17:08:05.208438+0000","last_fullsized":"2023-11-30T17:08:05.208438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.238254+0000","last_change":"2023-11-30T17:08:05.235603+0000","last_active":"2023-11-30T17:08:05.238254+0000","last_peered":"2023-11-30T17:08:05.238254+0000","last_clean":"2023-11-30T17:08:05.238254+0000","last_became_active":"2023-11-30T17:08:05.234444+0000","last_became_peered":"2023-11-30T17:08:05.234444+0000","last_unstale":"2023-11-30T17:08:05.238254+0000","last_undegraded":"2023-11-30T17:08:05.238254+0000","last_fullsized":"2023-11-30T17:08:05.238254+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.209209+0000","last_change":"2023-11-30T17:08:04.835169+0000","last_active":"2023-11-30T17:08:05.209209+0000","last_peered":"2023-11-30T17:08:05.209209+0000","last_clean":"2023-11-30T17:08:05.209209+0000","last_became_active":"2023-11-30T17:08:04.834940+0000","last_became_peered":"2023-11-30T17:08:04.834940+0000","last_unstale":"2023-11-30T17:08:05.209209+0000","last_undegraded":"2023-11-30T17:08:05.209209+0000","last_fullsized":"2023-11-30T17:08:05.209209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.225895+0000","last_change":"2023-11-30T17:08:05.222578+0000","last_active":"2023-11-30T17:08:05.225895+0000","last_peered":"2023-11-30T17:08:05.225895+0000","last_clean":"2023-11-30T17:08:05.225895+0000","last_became_active":"2023-11-30T17:08:05.222336+0000","last_became_peered":"2023-11-30T17:08:05.222336+0000","last_unstale":"2023-11-30T17:08:05.225895+0000","last_undegraded":"2023-11-30T17:08:05.225895+0000","last_fullsized":"2023-11-30T17:08:05.225895+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.238266+0000","last_change":"2023-11-30T17:08:04.840207+0000","last_active":"2023-11-30T17:08:05.238266+0000","last_peered":"2023-11-30T17:08:05.238266+0000","last_clean":"2023-11-30T17:08:05.238266+0000","last_became_active":"2023-11-30T17:08:04.839905+0000","last_became_peered":"2023-11-30T17:08:04.839905+0000","last_unstale":"2023-11-30T17:08:05.238266+0000","last_undegraded":"2023-11-30T17:08:05.238266+0000","last_fullsized":"2023-11-30T17:08:05.238266+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.235310+0000","last_change":"2023-11-30T17:08:05.233618+0000","last_active":"2023-11-30T17:08:05.235310+0000","last_peered":"2023-11-30T17:08:05.235310+0000","last_clean":"2023-11-30T17:08:05.235310+0000","last_became_active":"2023-11-30T17:08:05.233334+0000","last_became_peered":"2023-11-30T17:08:05.233334+0000","last_unstale":"2023-11-30T17:08:05.235310+0000","last_undegraded":"2023-11-30T17:08:05.235310+0000","last_fullsized":"2023-11-30T17:08:05.235310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.231623+0000","last_change":"2023-11-30T17:08:04.840896+0000","last_active":"2023-11-30T17:08:05.231623+0000","last_peered":"2023-11-30T17:08:05.231623+0000","last_clean":"2023-11-30T17:08:05.231623+0000","last_became_active":"2023-11-30T17:08:04.840593+0000","last_became_peered":"2023-11-30T17:08:04.840593+0000","last_unstale":"2023-11-30T17:08:05.231623+0000","last_undegraded":"2023-11-30T17:08:05.231623+0000","last_fullsized":"2023-11-30T17:08:05.231623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.231430+0000","last_change":"2023-11-30T17:08:05.229938+0000","last_active":"2023-11-30T17:08:05.231430+0000","last_peered":"2023-11-30T17:08:05.231430+0000","last_clean":"2023-11-30T17:08:05.231430+0000","last_became_active":"2023-11-30T17:08:05.228414+0000","last_became_peered":"2023-11-30T17:08:05.228414+0000","last_unstale":"2023-11-30T17:08:05.231430+0000","last_undegraded":"2023-11-30T17:08:05.231430+0000","last_fullsized":"2023-11-30T17:08:05.231430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.233780+0000","last_change":"2023-11-30T17:08:04.841290+0000","last_active":"2023-11-30T17:08:05.233780+0000","last_peered":"2023-11-30T17:08:05.233780+0000","last_clean":"2023-11-30T17:08:05.233780+0000","last_became_active":"2023-11-30T17:08:04.841024+0000","last_became_peered":"2023-11-30T17:08:04.841024+0000","last_unstale":"2023-11-30T17:08:05.233780+0000","last_undegraded":"2023-11-30T17:08:05.233780+0000","last_fullsized":"2023-11-30T17:08:05.233780+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.233961+0000","last_change":"2023-11-30T17:08:05.227180+0000","last_active":"2023-11-30T17:08:05.233961+0000","last_peered":"2023-11-30T17:08:05.233961+0000","last_clean":"2023-11-30T17:08:05.233961+0000","last_became_active":"2023-11-30T17:08:05.226875+0000","last_became_peered":"2023-11-30T17:08:05.226875+0000","last_unstale":"2023-11-30T17:08:05.233961+0000","last_undegraded":"2023-11-30T17:08:05.233961+0000","last_fullsized":"2023-11-30T17:08:05.233961+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.206477+0000","last_change":"2023-11-30T17:08:04.825146+0000","last_active":"2023-11-30T17:08:05.206477+0000","last_peered":"2023-11-30T17:08:05.206477+0000","last_clean":"2023-11-30T17:08:05.206477+0000","last_became_active":"2023-11-30T17:08:04.824845+0000","last_became_peered":"2023-11-30T17:08:04.824845+0000","last_unstale":"2023-11-30T17:08:05.206477+0000","last_undegraded":"2023-11-30T17:08:05.206477+0000","last_fullsized":"2023-11-30T17:08:05.206477+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.222520+0000","last_change":"2023-11-30T17:08:05.220108+0000","last_active":"2023-11-30T17:08:05.222520+0000","last_peered":"2023-11-30T17:08:05.222520+0000","last_clean":"2023-11-30T17:08:05.222520+0000","last_became_active":"2023-11-30T17:08:05.219837+0000","last_became_peered":"2023-11-30T17:08:05.219837+0000","last_unstale":"2023-11-30T17:08:05.222520+0000","last_undegraded":"2023-11-30T17:08:05.222520+0000","last_fullsized":"2023-11-30T17:08:05.222520+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.209554+0000","last_change":"2023-11-30T17:08:04.835308+0000","last_active":"2023-11-30T17:08:05.209554+0000","last_peered":"2023-11-30T17:08:05.209554+0000","last_clean":"2023-11-30T17:08:05.209554+0000","last_became_active":"2023-11-30T17:08:04.834994+0000","last_became_peered":"2023-11-30T17:08:04.834994+0000","last_unstale":"2023-11-30T17:08:05.209554+0000","last_undegraded":"2023-11-30T17:08:05.209554+0000","last_fullsized":"2023-11-30T17:08:05.209554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.238334+0000","last_change":"2023-11-30T17:08:05.235200+0000","last_active":"2023-11-30T17:08:05.238334+0000","last_peered":"2023-11-30T17:08:05.238334+0000","last_clean":"2023-11-30T17:08:05.238334+0000","last_became_active":"2023-11-30T17:08:05.234898+0000","last_became_peered":"2023-11-30T17:08:05.234898+0000","last_unstale":"2023-11-30T17:08:05.238334+0000","last_undegraded":"2023-11-30T17:08:05.238334+0000","last_fullsized":"2023-11-30T17:08:05.238334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.216491+0000","last_change":"2023-11-30T17:08:04.820113+0000","last_active":"2023-11-30T17:08:05.216491+0000","last_peered":"2023-11-30T17:08:05.216491+0000","last_clean":"2023-11-30T17:08:05.216491+0000","last_became_active":"2023-11-30T17:08:04.819827+0000","last_became_peered":"2023-11-30T17:08:04.819827+0000","last_unstale":"2023-11-30T17:08:05.216491+0000","last_undegraded":"2023-11-30T17:08:05.216491+0000","last_fullsized":"2023-11-30T17:08:05.216491+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.234119+0000","last_change":"2023-11-30T17:08:05.232235+0000","last_active":"2023-11-30T17:08:05.234119+0000","last_peered":"2023-11-30T17:08:05.234119+0000","last_clean":"2023-11-30T17:08:05.234119+0000","last_became_active":"2023-11-30T17:08:05.231970+0000","last_became_peered":"2023-11-30T17:08:05.231970+0000","last_unstale":"2023-11-30T17:08:05.234119+0000","last_undegraded":"2023-11-30T17:08:05.234119+0000","last_fullsized":"2023-11-30T17:08:05.234119+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.204243+0000","last_change":"2023-11-30T17:08:04.840796+0000","last_active":"2023-11-30T17:08:05.204243+0000","last_peered":"2023-11-30T17:08:05.204243+0000","last_clean":"2023-11-30T17:08:05.204243+0000","last_became_active":"2023-11-30T17:08:04.840523+0000","last_became_peered":"2023-11-30T17:08:04.840523+0000","last_unstale":"2023-11-30T17:08:05.204243+0000","last_undegraded":"2023-11-30T17:08:05.204243+0000","last_fullsized":"2023-11-30T17:08:05.204243+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.231140+0000","last_change":"2023-11-30T17:08:05.226526+0000","last_active":"2023-11-30T17:08:05.231140+0000","last_peered":"2023-11-30T17:08:05.231140+0000","last_clean":"2023-11-30T17:08:05.231140+0000","last_became_active":"2023-11-30T17:08:05.226252+0000","last_became_peered":"2023-11-30T17:08:05.226252+0000","last_unstale":"2023-11-30T17:08:05.231140+0000","last_undegraded":"2023-11-30T17:08:05.231140+0000","last_fullsized":"2023-11-30T17:08:05.231140+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.227219+0000","last_change":"2023-11-30T17:08:04.829343+0000","last_active":"2023-11-30T17:08:05.227219+0000","last_peered":"2023-11-30T17:08:05.227219+0000","last_clean":"2023-11-30T17:08:05.227219+0000","last_became_active":"2023-11-30T17:08:04.828848+0000","last_became_peered":"2023-11-30T17:08:04.828848+0000","last_unstale":"2023-11-30T17:08:05.227219+0000","last_undegraded":"2023-11-30T17:08:05.227219+0000","last_fullsized":"2023-11-30T17:08:05.227219+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.234707+0000","last_change":"2023-11-30T17:08:05.233236+0000","last_active":"2023-11-30T17:08:05.234707+0000","last_peered":"2023-11-30T17:08:05.234707+0000","last_clean":"2023-11-30T17:08:05.234707+0000","last_became_active":"2023-11-30T17:08:05.232611+0000","last_became_peered":"2023-11-30T17:08:05.232611+0000","last_unstale":"2023-11-30T17:08:05.234707+0000","last_undegraded":"2023-11-30T17:08:05.234707+0000","last_fullsized":"2023-11-30T17:08:05.234707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.204339+0000","last_change":"2023-11-30T17:08:04.820740+0000","last_active":"2023-11-30T17:08:05.204339+0000","last_peered":"2023-11-30T17:08:05.204339+0000","last_clean":"2023-11-30T17:08:05.204339+0000","last_became_active":"2023-11-30T17:08:04.820413+0000","last_became_peered":"2023-11-30T17:08:04.820413+0000","last_unstale":"2023-11-30T17:08:05.204339+0000","last_undegraded":"2023-11-30T17:08:05.204339+0000","last_fullsized":"2023-11-30T17:08:05.204339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.221818+0000","last_change":"2023-11-30T17:08:05.220215+0000","last_active":"2023-11-30T17:08:05.221818+0000","last_peered":"2023-11-30T17:08:05.221818+0000","last_clean":"2023-11-30T17:08:05.221818+0000","last_became_active":"2023-11-30T17:08:05.219973+0000","last_became_peered":"2023-11-30T17:08:05.219973+0000","last_unstale":"2023-11-30T17:08:05.221818+0000","last_undegraded":"2023-11-30T17:08:05.221818+0000","last_fullsized":"2023-11-30T17:08:05.221818+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.207731+0000","last_change":"2023-11-30T17:08:04.825488+0000","last_active":"2023-11-30T17:08:05.207731+0000","last_peered":"2023-11-30T17:08:05.207731+0000","last_clean":"2023-11-30T17:08:05.207731+0000","last_became_active":"2023-11-30T17:08:04.824935+0000","last_became_peered":"2023-11-30T17:08:04.824935+0000","last_unstale":"2023-11-30T17:08:05.207731+0000","last_undegraded":"2023-11-30T17:08:05.207731+0000","last_fullsized":"2023-11-30T17:08:05.207731+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.209632+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:08:05.209632+0000","last_peered":"2023-11-30T17:08:05.209632+0000","last_clean":"2023-11-30T17:08:05.209632+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:08:05.209632+0000","last_undegraded":"2023-11-30T17:08:05.209632+0000","last_fullsized":"2023-11-30T17:08:05.209632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.235559+0000","last_change":"2023-11-30T17:08:05.234913+0000","last_active":"2023-11-30T17:08:05.235559+0000","last_peered":"2023-11-30T17:08:05.235559+0000","last_clean":"2023-11-30T17:08:05.235559+0000","last_became_active":"2023-11-30T17:08:05.234666+0000","last_became_peered":"2023-11-30T17:08:05.234666+0000","last_unstale":"2023-11-30T17:08:05.235559+0000","last_undegraded":"2023-11-30T17:08:05.235559+0000","last_fullsized":"2023-11-30T17:08:05.235559+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.207675+0000","last_change":"2023-11-30T17:08:04.822652+0000","last_active":"2023-11-30T17:08:05.207675+0000","last_peered":"2023-11-30T17:08:05.207675+0000","last_clean":"2023-11-30T17:08:05.207675+0000","last_became_active":"2023-11-30T17:08:04.822358+0000","last_became_peered":"2023-11-30T17:08:04.822358+0000","last_unstale":"2023-11-30T17:08:05.207675+0000","last_undegraded":"2023-11-30T17:08:05.207675+0000","last_fullsized":"2023-11-30T17:08:05.207675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.215627+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:08:05.215627+0000","last_peered":"2023-11-30T17:08:05.215627+0000","last_clean":"2023-11-30T17:08:05.215627+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:08:05.215627+0000","last_undegraded":"2023-11-30T17:08:05.215627+0000","last_fullsized":"2023-11-30T17:08:05.215627+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.238271+0000","last_change":"2023-11-30T17:08:05.235044+0000","last_active":"2023-11-30T17:08:05.238271+0000","last_peered":"2023-11-30T17:08:05.238271+0000","last_clean":"2023-11-30T17:08:05.238271+0000","last_became_active":"2023-11-30T17:08:05.234680+0000","last_became_peered":"2023-11-30T17:08:05.234680+0000","last_unstale":"2023-11-30T17:08:05.238271+0000","last_undegraded":"2023-11-30T17:08:05.238271+0000","last_fullsized":"2023-11-30T17:08:05.238271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.206436+0000","last_change":"2023-11-30T17:08:04.817955+0000","last_active":"2023-11-30T17:08:05.206436+0000","last_peered":"2023-11-30T17:08:05.206436+0000","last_clean":"2023-11-30T17:08:05.206436+0000","last_became_active":"2023-11-30T17:08:04.817357+0000","last_became_peered":"2023-11-30T17:08:04.817357+0000","last_unstale":"2023-11-30T17:08:05.206436+0000","last_undegraded":"2023-11-30T17:08:05.206436+0000","last_fullsized":"2023-11-30T17:08:05.206436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.204220+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:08:05.204220+0000","last_peered":"2023-11-30T17:08:05.204220+0000","last_clean":"2023-11-30T17:08:05.204220+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:08:05.204220+0000","last_undegraded":"2023-11-30T17:08:05.204220+0000","last_fullsized":"2023-11-30T17:08:05.204220+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.231262+0000","last_change":"2023-11-30T17:08:05.227846+0000","last_active":"2023-11-30T17:08:05.231262+0000","last_peered":"2023-11-30T17:08:05.231262+0000","last_clean":"2023-11-30T17:08:05.231262+0000","last_became_active":"2023-11-30T17:08:05.227580+0000","last_became_peered":"2023-11-30T17:08:05.227580+0000","last_unstale":"2023-11-30T17:08:05.231262+0000","last_undegraded":"2023-11-30T17:08:05.231262+0000","last_fullsized":"2023-11-30T17:08:05.231262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.226393+0000","last_change":"2023-11-30T17:08:04.829753+0000","last_active":"2023-11-30T17:08:05.226393+0000","last_peered":"2023-11-30T17:08:05.226393+0000","last_clean":"2023-11-30T17:08:05.226393+0000","last_became_active":"2023-11-30T17:08:04.829436+0000","last_became_peered":"2023-11-30T17:08:04.829436+0000","last_unstale":"2023-11-30T17:08:05.226393+0000","last_undegraded":"2023-11-30T17:08:05.226393+0000","last_fullsized":"2023-11-30T17:08:05.226393+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.215748+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:08:05.215748+0000","last_peered":"2023-11-30T17:08:05.215748+0000","last_clean":"2023-11-30T17:08:05.215748+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:08:05.215748+0000","last_undegraded":"2023-11-30T17:08:05.215748+0000","last_fullsized":"2023-11-30T17:08:05.215748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.226810+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:08:05.226810+0000","last_peered":"2023-11-30T17:08:05.226810+0000","last_clean":"2023-11-30T17:08:05.226810+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:08:05.226810+0000","last_undegraded":"2023-11-30T17:08:05.226810+0000","last_fullsized":"2023-11-30T17:08:05.226810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.227327+0000","last_change":"2023-11-30T17:08:05.226280+0000","last_active":"2023-11-30T17:08:05.227327+0000","last_peered":"2023-11-30T17:08:05.227327+0000","last_clean":"2023-11-30T17:08:05.227327+0000","last_became_active":"2023-11-30T17:08:05.225764+0000","last_became_peered":"2023-11-30T17:08:05.225764+0000","last_unstale":"2023-11-30T17:08:05.227327+0000","last_undegraded":"2023-11-30T17:08:05.227327+0000","last_fullsized":"2023-11-30T17:08:05.227327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.229027+0000","last_change":"2023-11-30T17:08:04.831853+0000","last_active":"2023-11-30T17:08:05.229027+0000","last_peered":"2023-11-30T17:08:05.229027+0000","last_clean":"2023-11-30T17:08:05.229027+0000","last_became_active":"2023-11-30T17:08:04.831569+0000","last_became_peered":"2023-11-30T17:08:04.831569+0000","last_unstale":"2023-11-30T17:08:05.229027+0000","last_undegraded":"2023-11-30T17:08:05.229027+0000","last_fullsized":"2023-11-30T17:08:05.229027+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.227062+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:08:05.227062+0000","last_peered":"2023-11-30T17:08:05.227062+0000","last_clean":"2023-11-30T17:08:05.227062+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:08:05.227062+0000","last_undegraded":"2023-11-30T17:08:05.227062+0000","last_fullsized":"2023-11-30T17:08:05.227062+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.226244+0000","last_change":"2023-11-30T17:08:05.222358+0000","last_active":"2023-11-30T17:08:05.226244+0000","last_peered":"2023-11-30T17:08:05.226244+0000","last_clean":"2023-11-30T17:08:05.226244+0000","last_became_active":"2023-11-30T17:08:05.221970+0000","last_became_peered":"2023-11-30T17:08:05.221970+0000","last_unstale":"2023-11-30T17:08:05.226244+0000","last_undegraded":"2023-11-30T17:08:05.226244+0000","last_fullsized":"2023-11-30T17:08:05.226244+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.209141+0000","last_change":"2023-11-30T17:08:04.819980+0000","last_active":"2023-11-30T17:08:05.209141+0000","last_peered":"2023-11-30T17:08:05.209141+0000","last_clean":"2023-11-30T17:08:05.209141+0000","last_became_active":"2023-11-30T17:08:04.819736+0000","last_became_peered":"2023-11-30T17:08:04.819736+0000","last_unstale":"2023-11-30T17:08:05.209141+0000","last_undegraded":"2023-11-30T17:08:05.209141+0000","last_fullsized":"2023-11-30T17:08:05.209141+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.226621+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:08:05.226621+0000","last_peered":"2023-11-30T17:08:05.226621+0000","last_clean":"2023-11-30T17:08:05.226621+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:08:05.226621+0000","last_undegraded":"2023-11-30T17:08:05.226621+0000","last_fullsized":"2023-11-30T17:08:05.226621+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.229266+0000","last_change":"2023-11-30T17:08:05.223774+0000","last_active":"2023-11-30T17:08:05.229266+0000","last_peered":"2023-11-30T17:08:05.229266+0000","last_clean":"2023-11-30T17:08:05.229266+0000","last_became_active":"2023-11-30T17:08:05.223459+0000","last_became_peered":"2023-11-30T17:08:05.223459+0000","last_unstale":"2023-11-30T17:08:05.229266+0000","last_undegraded":"2023-11-30T17:08:05.229266+0000","last_fullsized":"2023-11-30T17:08:05.229266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.218328+0000","last_change":"2023-11-30T17:08:04.834633+0000","last_active":"2023-11-30T17:08:05.218328+0000","last_peered":"2023-11-30T17:08:05.218328+0000","last_clean":"2023-11-30T17:08:05.218328+0000","last_became_active":"2023-11-30T17:08:04.834306+0000","last_became_peered":"2023-11-30T17:08:04.834306+0000","last_unstale":"2023-11-30T17:08:05.218328+0000","last_undegraded":"2023-11-30T17:08:05.218328+0000","last_fullsized":"2023-11-30T17:08:05.218328+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.209176+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:08:05.209176+0000","last_peered":"2023-11-30T17:08:05.209176+0000","last_clean":"2023-11-30T17:08:05.209176+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:08:05.209176+0000","last_undegraded":"2023-11-30T17:08:05.209176+0000","last_fullsized":"2023-11-30T17:08:05.209176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.238392+0000","last_change":"2023-11-30T17:08:05.235772+0000","last_active":"2023-11-30T17:08:05.238392+0000","last_peered":"2023-11-30T17:08:05.238392+0000","last_clean":"2023-11-30T17:08:05.238392+0000","last_became_active":"2023-11-30T17:08:05.235238+0000","last_became_peered":"2023-11-30T17:08:05.235238+0000","last_unstale":"2023-11-30T17:08:05.238392+0000","last_undegraded":"2023-11-30T17:08:05.238392+0000","last_fullsized":"2023-11-30T17:08:05.238392+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:04.803120+0000","last_clean_scrub_stamp":"2023-11-30T17:08:04.803120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.213416+0000","last_change":"2023-11-30T17:08:04.832589+0000","last_active":"2023-11-30T17:08:05.213416+0000","last_peered":"2023-11-30T17:08:05.213416+0000","last_clean":"2023-11-30T17:08:05.213416+0000","last_became_active":"2023-11-30T17:08:04.832296+0000","last_became_peered":"2023-11-30T17:08:04.832296+0000","last_unstale":"2023-11-30T17:08:05.213416+0000","last_undegraded":"2023-11-30T17:08:05.213416+0000","last_fullsized":"2023-11-30T17:08:05.213416+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:08:03.798417+0000","last_clean_scrub_stamp":"2023-11-30T17:08:03.798417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-30T17:08:05.209473+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:08:05.209473+0000","last_peered":"2023-11-30T17:08:05.209473+0000","last_clean":"2023-11-30T17:08:05.209473+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:08:05.209473+0000","last_undegraded":"2023-11-30T17:08:05.209473+0000","last_fullsized":"2023-11-30T17:08:05.209473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297480,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074360,"statfs":{"total":96636764160,"available":96332144640,"internally_reserved":0,"allocated":393216,"data_stored":159348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.37},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.50800000000000001}]},{"osd":1,"last update":"Thu Nov 30 17:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Nov 30 17:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.41499999999999998}]},{"osd":3,"last update":"Thu Nov 30 17:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Nov 30 17:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Nov 30 17:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.623},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Nov 30 17:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.63400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297476,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074364,"statfs":{"total":96636764160,"available":96332148736,"internally_reserved":0,"allocated":389120,"data_stored":159258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297480,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074360,"statfs":{"total":96636764160,"available":96332144640,"internally_reserved":0,"allocated":393216,"data_stored":158864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297476,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074364,"statfs":{"total":96636764160,"available":96332148736,"internally_reserved":0,"allocated":389120,"data_stored":158738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 17:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.312,"15min":0.312},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Nov 30 17:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Nov 30 17:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Nov 30 17:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.63},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.70499999999999996}]},{"osd":6,"last update":"Thu Nov 30 17:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Nov 30 17:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.68799999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297472,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074368,"statfs":{"total":96636764160,"available":96332152832,"internally_reserved":0,"allocated":385024,"data_stored":158704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":405504,"data_stored":160344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297476,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074364,"statfs":{"total":96636764160,"available":96332148736,"internally_reserved":0,"allocated":389120,"data_stored":158726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":401408,"data_stored":160262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:08:14.038 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-30T17:08:14.039 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-30T17:08:14.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.197+0000 7f22e1deb700 1 Processor -- start 2023-11-30T17:08:14.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.197+0000 7f22e1deb700 1 -- start start 2023-11-30T17:08:14.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.197+0000 7f22e1deb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22dc0c5ac0 0x7f22dc0c51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:14.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.197+0000 7f22e1deb700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f22dc153390 0x7f22dc0c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:14.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.197+0000 7f22e1deb700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f22dc156690 0x7f22dc156b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:14.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.197+0000 7f22e1deb700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22dc153990 con 0x7f22dc156690 2023-11-30T17:08:14.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.197+0000 7f22e1deb700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22dc155f20 con 0x7f22dc153390 2023-11-30T17:08:14.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.197+0000 7f22e1deb700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc156200 con 0x7f22dc0c5ac0 2023-11-30T17:08:14.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.198+0000 7f22dbfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f22dc156690 0x7f22dc156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:14.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.198+0000 7f22dbfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f22dc156690 0x7f22dc156b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59380/0 (socket says 172.21.15.49:59380) 2023-11-30T17:08:14.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.198+0000 7f22dbfff700 1 -- 172.21.15.49:0/3999483000 learned_addr learned my addr 172.21.15.49:0/3999483000 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:14.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.198+0000 7f22db7fe700 1 --2- 172.21.15.49:0/3999483000 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22dc0c5ac0 0x7f22dc0c51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:14.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.198+0000 7f22daffd700 1 --2- 172.21.15.49:0/3999483000 >> v2:172.21.15.115:3300/0 conn(0x7f22dc153390 0x7f22dc0c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:14.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.198+0000 7f22dbfff700 1 -- 172.21.15.49:0/3999483000 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22dc0c5ac0 msgr2=0x7f22dc0c51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:14.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.198+0000 7f22dbfff700 1 --2- 172.21.15.49:0/3999483000 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22dc0c5ac0 0x7f22dc0c51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:14.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.198+0000 7f22dbfff700 1 -- 172.21.15.49:0/3999483000 >> v2:172.21.15.115:3300/0 conn(0x7f22dc153390 msgr2=0x7f22dc0c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:14.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.198+0000 7f22dbfff700 1 --2- 172.21.15.49:0/3999483000 >> v2:172.21.15.115:3300/0 conn(0x7f22dc153390 0x7f22dc0c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:14.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.198+0000 7f22dbfff700 1 -- 172.21.15.49:0/3999483000 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc0bff70 con 0x7f22dc156690 2023-11-30T17:08:14.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.198+0000 7f22daffd700 1 --2- 172.21.15.49:0/3999483000 >> v2:172.21.15.115:3300/0 conn(0x7f22dc153390 0x7f22dc0c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:08:14.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.198+0000 7f22dbfff700 1 --2- 172.21.15.49:0/3999483000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22dc156690 0x7f22dc156b00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f22dc0ca1b0 tx=0x7f22d4009840).ready entity=mon.0 client_cookie=1a8811fccc8a0700 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:14.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.198+0000 7f22da7fc700 1 -- 172.21.15.49:0/3999483000 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d400e070 con 0x7f22dc156690 2023-11-30T17:08:14.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.198+0000 7f22da7fc700 1 -- 172.21.15.49:0/3999483000 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d400ba50 con 0x7f22dc156690 2023-11-30T17:08:14.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.198+0000 7f22da7fc700 1 -- 172.21.15.49:0/3999483000 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d400bdd0 con 0x7f22dc156690 2023-11-30T17:08:14.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.199+0000 7f22e1deb700 1 -- 172.21.15.49:0/3999483000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22dc156690 msgr2=0x7f22dc156b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:14.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.199+0000 7f22e1deb700 1 --2- 172.21.15.49:0/3999483000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22dc156690 0x7f22dc156b00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f22dc0ca1b0 tx=0x7f22d4009840).stop 2023-11-30T17:08:14.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.199+0000 7f22e1deb700 1 -- 172.21.15.49:0/3999483000 shutdown_connections 2023-11-30T17:08:14.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.199+0000 7f22e1deb700 1 --2- 172.21.15.49:0/3999483000 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22dc0c5ac0 0x7f22dc0c51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:14.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.199+0000 7f22e1deb700 1 --2- 172.21.15.49:0/3999483000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22dc156690 0x7f22dc156b00 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:14.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.199+0000 7f22e1deb700 1 --2- 172.21.15.49:0/3999483000 >> v2:172.21.15.115:3300/0 conn(0x7f22dc153390 0x7f22dc0c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:14.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.199+0000 7f22e1deb700 1 -- 172.21.15.49:0/3999483000 >> 172.21.15.49:0/3999483000 conn(0x7f22dc062700 msgr2=0x7f22dc062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:14.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.199+0000 7f22e1deb700 1 -- 172.21.15.49:0/3999483000 shutdown_connections 2023-11-30T17:08:14.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.199+0000 7f22e1deb700 1 -- 172.21.15.49:0/3999483000 wait complete. 2023-11-30T17:08:14.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.200+0000 7f22e1deb700 1 Processor -- start 2023-11-30T17:08:14.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.200+0000 7f22e1deb700 1 -- start start 2023-11-30T17:08:14.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.201+0000 7f22e1deb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22dc0c5ac0 0x7f22dc14df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:14.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.201+0000 7f22e1deb700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22dc153390 0x7f22dc0c0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:14.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.201+0000 7f22e1deb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22dc156690 0x7f22dc0c2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:14.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.201+0000 7f22e1deb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc0c01e0 con 0x7f22dc156690 2023-11-30T17:08:14.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.201+0000 7f22e1deb700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc0c0a80 con 0x7f22dc153390 2023-11-30T17:08:14.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.201+0000 7f22e1deb700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc158f70 con 0x7f22dc0c5ac0 2023-11-30T17:08:14.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.201+0000 7f22dbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22dc156690 0x7f22dc0c2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:14.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.201+0000 7f22dbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22dc156690 0x7f22dc0c2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59392/0 (socket says 172.21.15.49:59392) 2023-11-30T17:08:14.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.201+0000 7f22dbfff700 1 -- 172.21.15.49:0/1731165579 learned_addr learned my addr 172.21.15.49:0/1731165579 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:14.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.201+0000 7f22db7fe700 1 --2- 172.21.15.49:0/1731165579 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22dc0c5ac0 0x7f22dc14df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:14.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.201+0000 7f22daffd700 1 --2- 172.21.15.49:0/1731165579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22dc153390 0x7f22dc0c0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:14.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.201+0000 7f22dbfff700 1 -- 172.21.15.49:0/1731165579 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22dc0c5ac0 msgr2=0x7f22dc14df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:14.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.201+0000 7f22dbfff700 1 --2- 172.21.15.49:0/1731165579 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22dc0c5ac0 0x7f22dc14df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:14.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.201+0000 7f22dbfff700 1 -- 172.21.15.49:0/1731165579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22dc153390 msgr2=0x7f22dc0c0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:14.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.201+0000 7f22dbfff700 1 --2- 172.21.15.49:0/1731165579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22dc153390 0x7f22dc0c0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:14.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.201+0000 7f22dbfff700 1 -- 172.21.15.49:0/1731165579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d4009ae0 con 0x7f22dc156690 2023-11-30T17:08:14.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.201+0000 7f22dbfff700 1 --2- 172.21.15.49:0/1731165579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22dc156690 0x7f22dc0c2840 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f22d400ba20 tx=0x7f22dc068a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:14.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.202+0000 7f22c37fe700 1 -- 172.21.15.49:0/1731165579 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d400b6c0 con 0x7f22dc156690 2023-11-30T17:08:14.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.202+0000 7f22c37fe700 1 -- 172.21.15.49:0/1731165579 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d40092e0 con 0x7f22dc156690 2023-11-30T17:08:14.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.202+0000 7f22e1deb700 1 -- 172.21.15.49:0/1731165579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22dc0c0430 con 0x7f22dc156690 2023-11-30T17:08:14.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.202+0000 7f22c37fe700 1 -- 172.21.15.49:0/1731165579 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d401e6a0 con 0x7f22dc156690 2023-11-30T17:08:14.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.202+0000 7f22e1deb700 1 -- 172.21.15.49:0/1731165579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22dc0c1400 con 0x7f22dc156690 2023-11-30T17:08:14.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.203+0000 7f22e1deb700 1 -- 172.21.15.49:0/1731165579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22dc06c860 con 0x7f22dc156690 2023-11-30T17:08:14.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.203+0000 7f22c37fe700 1 -- 172.21.15.49:0/1731165579 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f22d4003040 con 0x7f22dc156690 2023-11-30T17:08:14.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.203+0000 7f22c37fe700 1 --2- 172.21.15.49:0/1731165579 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f22c805f150 0x7f22c8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:14.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.203+0000 7f22c37fe700 1 -- 172.21.15.49:0/1731165579 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f22d407b680 con 0x7f22dc156690 2023-11-30T17:08:14.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.204+0000 7f22db7fe700 1 --2- 172.21.15.49:0/1731165579 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f22c805f150 0x7f22c8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:14.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.204+0000 7f22db7fe700 1 --2- 172.21.15.49:0/1731165579 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f22c805f150 0x7f22c8061610 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f22dc165a70 tx=0x7f22cc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:14.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.208+0000 7f22c37fe700 1 -- 172.21.15.49:0/1731165579 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f22d404c950 con 0x7f22dc156690 2023-11-30T17:08:14.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.448+0000 7f22e1deb700 1 -- 172.21.15.49:0/1731165579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f22dc0c4f80 con 0x7f22dc156690 2023-11-30T17:08:14.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.451+0000 7f22c37fe700 1 -- 172.21.15.49:0/1731165579 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f22d4023070 con 0x7f22dc156690 2023-11-30T17:08:14.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.453+0000 7f22e1deb700 1 -- 172.21.15.49:0/1731165579 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f22c805f150 msgr2=0x7f22c8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:14.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.453+0000 7f22e1deb700 1 --2- 172.21.15.49:0/1731165579 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f22c805f150 0x7f22c8061610 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f22dc165a70 tx=0x7f22cc008040).stop 2023-11-30T17:08:14.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.453+0000 7f22e1deb700 1 -- 172.21.15.49:0/1731165579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22dc156690 msgr2=0x7f22dc0c2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:14.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.453+0000 7f22e1deb700 1 --2- 172.21.15.49:0/1731165579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22dc156690 0x7f22dc0c2840 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f22d400ba20 tx=0x7f22dc068a90).stop 2023-11-30T17:08:14.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.453+0000 7f22e1deb700 1 -- 172.21.15.49:0/1731165579 shutdown_connections 2023-11-30T17:08:14.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.453+0000 7f22e1deb700 1 --2- 172.21.15.49:0/1731165579 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f22c805f150 0x7f22c8061610 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:14.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.453+0000 7f22e1deb700 1 --2- 172.21.15.49:0/1731165579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22dc156690 0x7f22dc0c2840 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:14.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.453+0000 7f22e1deb700 1 --2- 172.21.15.49:0/1731165579 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22dc0c5ac0 0x7f22dc14df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:14.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.453+0000 7f22e1deb700 1 --2- 172.21.15.49:0/1731165579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22dc153390 0x7f22dc0c0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:14.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.453+0000 7f22e1deb700 1 -- 172.21.15.49:0/1731165579 >> 172.21.15.49:0/1731165579 conn(0x7f22dc062700 msgr2=0x7f22dc153c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:14.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.453+0000 7f22e1deb700 1 -- 172.21.15.49:0/1731165579 shutdown_connections 2023-11-30T17:08:14.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.453+0000 7f22e1deb700 1 -- 172.21.15.49:0/1731165579 wait complete. 2023-11-30T17:08:14.456 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2023-11-30T17:08:14.467 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:08:14.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.583+0000 7faf13947700 1 Processor -- start 2023-11-30T17:08:14.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.584+0000 7faf13947700 1 -- start start 2023-11-30T17:08:14.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.584+0000 7faf13947700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7faf0c1548c0 0x7faf0c06a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:14.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.584+0000 7faf13947700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf0c0c69a0 con 0x7faf0c0c6e30 2023-11-30T17:08:14.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.584+0000 7faf13947700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf0c0c13a0 con 0x7faf0c1544e0 2023-11-30T17:08:14.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.584+0000 7faf13947700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf0c0c1680 con 0x7faf0c1548c0 2023-11-30T17:08:14.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.585+0000 7faf11ee4700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7faf0c0c6e30 0x7faf0c0a8000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35774/0 (socket says 172.21.15.49:35774) 2023-11-30T17:08:14.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.585+0000 7faf11ee4700 1 -- 172.21.15.49:0/3537192750 learned_addr learned my addr 172.21.15.49:0/3537192750 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:08:14.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.585+0000 7faf10ee2700 1 --2- 172.21.15.49:0/3537192750 >> v2:172.21.15.115:3300/0 conn(0x7faf0c1548c0 0x7faf0c06a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:14.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.585+0000 7faf0bfff700 1 -- 172.21.15.49:0/3537192750 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104590460 0 0) 0x7faf0c0c69a0 con 0x7faf0c0c6e30 2023-11-30T17:08:14.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.585+0000 7faf0bfff700 1 -- 172.21.15.49:0/3537192750 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faef40033f0 con 0x7faf0c0c6e30 2023-11-30T17:08:14.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.585+0000 7faf10ee2700 1 -- 172.21.15.49:0/3537192750 >> v1:172.21.15.115:6789/0 conn(0x7faf0c1544e0 legacy=0x7faf0c0c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:14.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.585+0000 7faf10ee2700 1 -- 172.21.15.49:0/3537192750 >> v1:172.21.15.49:6789/0 conn(0x7faf0c0c6e30 legacy=0x7faf0c0a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:14.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.585+0000 7faf10ee2700 1 -- 172.21.15.49:0/3537192750 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0c0c6630 con 0x7faf0c1548c0 2023-11-30T17:08:14.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.585+0000 7faf10ee2700 1 --2- 172.21.15.49:0/3537192750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf0c1548c0 0x7faf0c06a610 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7faf00009760 tx=0x7faf00009060).ready entity=mon.1 client_cookie=9e25ce078f5e1414 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:14.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.585+0000 7faf0bfff700 1 -- 172.21.15.49:0/3537192750 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0000f510 con 0x7faf0c1548c0 2023-11-30T17:08:14.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.585+0000 7faf0bfff700 1 -- 172.21.15.49:0/3537192750 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0000f670 con 0x7faf0c1548c0 2023-11-30T17:08:14.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.585+0000 7faf0bfff700 1 -- 172.21.15.49:0/3537192750 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0000f9f0 con 0x7faf0c1548c0 2023-11-30T17:08:14.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.586+0000 7faf13947700 1 -- 172.21.15.49:0/3537192750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf0c1548c0 msgr2=0x7faf0c06a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:14.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.586+0000 7faf13947700 1 --2- 172.21.15.49:0/3537192750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf0c1548c0 0x7faf0c06a610 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7faf00009760 tx=0x7faf00009060).stop 2023-11-30T17:08:14.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.586+0000 7faf13947700 1 -- 172.21.15.49:0/3537192750 shutdown_connections 2023-11-30T17:08:14.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.586+0000 7faf13947700 1 --2- 172.21.15.49:0/3537192750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf0c1548c0 0x7faf0c06a610 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:14.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.586+0000 7faf13947700 1 -- 172.21.15.49:0/3537192750 >> 172.21.15.49:0/3537192750 conn(0x7faf0c085020 msgr2=0x7faf0c094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:14.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.586+0000 7faf13947700 1 -- 172.21.15.49:0/3537192750 shutdown_connections 2023-11-30T17:08:14.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.586+0000 7faf13947700 1 -- 172.21.15.49:0/3537192750 wait complete. 2023-11-30T17:08:14.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.587+0000 7faf13947700 1 Processor -- start 2023-11-30T17:08:14.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.587+0000 7faf13947700 1 -- start start 2023-11-30T17:08:14.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.588+0000 7faf13947700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf0c0c6e30 0x7faf0c1479a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:14.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.588+0000 7faf13947700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf0c1544e0 0x7faf0c0971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:14.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.588+0000 7faf13947700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf0c1548c0 0x7faf0c0976b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:14.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.588+0000 7faf13947700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c097ba0 con 0x7faf0c1548c0 2023-11-30T17:08:14.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.588+0000 7faf13947700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c0c4d50 con 0x7faf0c0c6e30 2023-11-30T17:08:14.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.588+0000 7faf13947700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c095b00 con 0x7faf0c1544e0 2023-11-30T17:08:14.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.588+0000 7faf11ee4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf0c1548c0 0x7faf0c0976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:14.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.588+0000 7faf11ee4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf0c1548c0 0x7faf0c0976b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59402/0 (socket says 172.21.15.49:59402) 2023-11-30T17:08:14.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.588+0000 7faf11ee4700 1 -- 172.21.15.49:0/3140526798 learned_addr learned my addr 172.21.15.49:0/3140526798 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:14.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.588+0000 7faf116e3700 1 --2- 172.21.15.49:0/3140526798 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf0c0c6e30 0x7faf0c1479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:14.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.588+0000 7faf10ee2700 1 --2- 172.21.15.49:0/3140526798 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf0c1544e0 0x7faf0c0971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:14.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.589+0000 7faf11ee4700 1 -- 172.21.15.49:0/3140526798 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf0c1544e0 msgr2=0x7faf0c0971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:14.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.589+0000 7faf11ee4700 1 --2- 172.21.15.49:0/3140526798 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf0c1544e0 0x7faf0c0971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:14.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.589+0000 7faf11ee4700 1 -- 172.21.15.49:0/3140526798 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf0c0c6e30 msgr2=0x7faf0c1479a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:14.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.589+0000 7faf11ee4700 1 --2- 172.21.15.49:0/3140526798 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf0c0c6e30 0x7faf0c1479a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:14.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.589+0000 7faf11ee4700 1 -- 172.21.15.49:0/3140526798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf000092a0 con 0x7faf0c1548c0 2023-11-30T17:08:14.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.589+0000 7faf11ee4700 1 --2- 172.21.15.49:0/3140526798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf0c1548c0 0x7faf0c0976b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7faefc00c410 tx=0x7faefc007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:14.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.589+0000 7faf097fa700 1 -- 172.21.15.49:0/3140526798 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc00ce30 con 0x7faf0c1548c0 2023-11-30T17:08:14.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.589+0000 7faf097fa700 1 -- 172.21.15.49:0/3140526798 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc0072e0 con 0x7faf0c1548c0 2023-11-30T17:08:14.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.589+0000 7faf13947700 1 -- 172.21.15.49:0/3140526798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf0c0951d0 con 0x7faf0c1548c0 2023-11-30T17:08:14.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.589+0000 7faf097fa700 1 -- 172.21.15.49:0/3140526798 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc007660 con 0x7faf0c1548c0 2023-11-30T17:08:14.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.589+0000 7faf13947700 1 -- 172.21.15.49:0/3140526798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0c095790 con 0x7faf0c1548c0 2023-11-30T17:08:14.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.590+0000 7faf13947700 1 -- 172.21.15.49:0/3140526798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf0c06c860 con 0x7faf0c1548c0 2023-11-30T17:08:14.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.590+0000 7faf097fa700 1 -- 172.21.15.49:0/3140526798 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7faefc0059b0 con 0x7faf0c1548c0 2023-11-30T17:08:14.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.591+0000 7faf097fa700 1 --2- 172.21.15.49:0/3140526798 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faef805f150 0x7faef8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:14.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.591+0000 7faf097fa700 1 -- 172.21.15.49:0/3140526798 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faefc079890 con 0x7faf0c1548c0 2023-11-30T17:08:14.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.591+0000 7faf116e3700 1 --2- 172.21.15.49:0/3140526798 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faef805f150 0x7faef8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:14.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.591+0000 7faf116e3700 1 --2- 172.21.15.49:0/3140526798 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faef805f150 0x7faef8061610 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7faf04002d20 tx=0x7faf040015b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:14.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.595+0000 7faf097fa700 1 -- 172.21.15.49:0/3140526798 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7faefc04ab60 con 0x7faf0c1548c0 2023-11-30T17:08:14.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.811+0000 7faf13947700 1 -- 172.21.15.49:0/3140526798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf0c095c40 con 0x7faf0c1548c0 2023-11-30T17:08:14.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.811+0000 7faf097fa700 1 -- 172.21.15.49:0/3140526798 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4495 (secure 0 0 0) 0x7faefc04e180 con 0x7faf0c1548c0 2023-11-30T17:08:14.813 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:08:14.813 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1260333970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1260333970},{"type":"v1","addr":"172.21.15.115:6836","nonce":1260333970}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4938,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/2286472783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2286472783},{"type":"v1","addr":"172.21.15.49:6834","nonce":2286472783}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4941,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1299033463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1299033463},{"type":"v1","addr":"172.21.15.49:6835","nonce":1299033463}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:08:05.200966+0000","modified":"2023-11-30T17:08:08.207522+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4944},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4944":{"gid":4944,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/3449611740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3449611740},{"type":"v1","addr":"172.21.15.115:6837","nonce":3449611740}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-11-30T17:08:14.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.813+0000 7faf13947700 1 -- 172.21.15.49:0/3140526798 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faef805f150 msgr2=0x7faef8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:14.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.813+0000 7faf13947700 1 --2- 172.21.15.49:0/3140526798 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faef805f150 0x7faef8061610 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7faf04002d20 tx=0x7faf040015b0).stop 2023-11-30T17:08:14.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.813+0000 7faf13947700 1 -- 172.21.15.49:0/3140526798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf0c1548c0 msgr2=0x7faf0c0976b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:14.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.813+0000 7faf13947700 1 --2- 172.21.15.49:0/3140526798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf0c1548c0 0x7faf0c0976b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7faefc00c410 tx=0x7faefc007c50).stop 2023-11-30T17:08:14.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.813+0000 7faf13947700 1 -- 172.21.15.49:0/3140526798 shutdown_connections 2023-11-30T17:08:14.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.813+0000 7faf13947700 1 --2- 172.21.15.49:0/3140526798 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faef805f150 0x7faef8061610 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:14.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.813+0000 7faf13947700 1 --2- 172.21.15.49:0/3140526798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf0c1548c0 0x7faf0c0976b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:14.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.813+0000 7faf13947700 1 --2- 172.21.15.49:0/3140526798 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf0c0c6e30 0x7faf0c1479a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:14.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.813+0000 7faf13947700 1 --2- 172.21.15.49:0/3140526798 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf0c1544e0 0x7faf0c0971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:14.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.813+0000 7faf13947700 1 -- 172.21.15.49:0/3140526798 >> 172.21.15.49:0/3140526798 conn(0x7faf0c085020 msgr2=0x7faf0c064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:14.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.813+0000 7faf13947700 1 -- 172.21.15.49:0/3140526798 shutdown_connections 2023-11-30T17:08:14.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:14.813+0000 7faf13947700 1 -- 172.21.15.49:0/3140526798 wait complete. 2023-11-30T17:08:14.816 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 16 2023-11-30T17:08:15.229 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-30T17:08:05.200966+0000', 'modified': '2023-11-30T17:08:08.207522+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4944}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4944': {'gid': 4944, 'name': 'b', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.115:6837/3449611740', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6835', 'nonce': 3449611740}, {'type': 'v1', 'addr': '172.21.15.115:6837', 'nonce': 3449611740}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-11-30T17:08:15.229 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-30T17:08:15.229 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-30T17:08:15.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.348+0000 7fdd69dc5700 1 Processor -- start 2023-11-30T17:08:15.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.349+0000 7fdd69dc5700 1 -- start start 2023-11-30T17:08:15.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.349+0000 7fdd69dc5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd640c3360 0x7fdd640c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:15.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.349+0000 7fdd69dc5700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd641555b0 con 0x7fdd640c3af0 2023-11-30T17:08:15.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.349+0000 7fdd69dc5700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd64155890 con 0x7fdd641516b0 2023-11-30T17:08:15.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.349+0000 7fdd69dc5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd640c4460 con 0x7fdd640c3360 2023-11-30T17:08:15.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.349+0000 7fdd62ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdd640c3af0 0x7fdd640c2c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35780/0 (socket says 172.21.15.49:35780) 2023-11-30T17:08:15.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.350+0000 7fdd62ffd700 1 -- 172.21.15.49:0/829427006 learned_addr learned my addr 172.21.15.49:0/829427006 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:08:15.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.350+0000 7fdd63fff700 1 --2- 172.21.15.49:0/829427006 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd640c3360 0x7fdd640c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:15.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.350+0000 7fdd627fc700 1 -- 172.21.15.49:0/829427006 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2901681182 0 0) 0x7fdd641555b0 con 0x7fdd640c3af0 2023-11-30T17:08:15.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.350+0000 7fdd627fc700 1 -- 172.21.15.49:0/829427006 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd4c0033f0 con 0x7fdd640c3af0 2023-11-30T17:08:15.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.350+0000 7fdd627fc700 1 -- 172.21.15.49:0/829427006 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1642483018 0 0) 0x7fdd4c0033f0 con 0x7fdd640c3af0 2023-11-30T17:08:15.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.350+0000 7fdd627fc700 1 -- 172.21.15.49:0/829427006 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd640c3360 msgr2=0x7fdd640c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:15.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.350+0000 7fdd627fc700 1 --2- 172.21.15.49:0/829427006 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd640c3360 0x7fdd640c3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.350+0000 7fdd627fc700 1 -- 172.21.15.49:0/829427006 >> v1:172.21.15.115:6789/0 conn(0x7fdd641516b0 legacy=0x7fdd64069c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:15.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.350+0000 7fdd627fc700 1 -- 172.21.15.49:0/829427006 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd64155b70 con 0x7fdd640c3af0 2023-11-30T17:08:15.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.350+0000 7fdd627fc700 1 -- 172.21.15.49:0/829427006 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fdd58001470 con 0x7fdd640c3af0 2023-11-30T17:08:15.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.350+0000 7fdd627fc700 1 -- 172.21.15.49:0/829427006 >> v1:172.21.15.49:6789/0 conn(0x7fdd640c3af0 legacy=0x7fdd640c2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:15.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.350+0000 7fdd627fc700 1 --2- 172.21.15.49:0/829427006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd4c003910 0x7fdd4c003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:15.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.350+0000 7fdd627fc700 1 --2- 172.21.15.49:0/829427006 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd640c3360 0x7fdd4c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:15.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.350+0000 7fdd627fc700 1 --2- 172.21.15.49:0/829427006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd4c004b80 0x7fdd4c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:15.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.350+0000 7fdd627fc700 1 -- 172.21.15.49:0/829427006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd640c4460 con 0x7fdd4c004b80 2023-11-30T17:08:15.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.350+0000 7fdd627fc700 1 -- 172.21.15.49:0/829427006 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c00b8e0 con 0x7fdd4c003910 2023-11-30T17:08:15.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.350+0000 7fdd627fc700 1 -- 172.21.15.49:0/829427006 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c00ba50 con 0x7fdd640c3360 2023-11-30T17:08:15.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.350+0000 7fdd63fff700 1 --2- 172.21.15.49:0/829427006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd4c004b80 0x7fdd4c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:15.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.350+0000 7fdd62ffd700 1 --2- 172.21.15.49:0/829427006 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd640c3360 0x7fdd4c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:15.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.350+0000 7fdd637fe700 1 --2- 172.21.15.49:0/829427006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd4c003910 0x7fdd4c003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:15.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.350+0000 7fdd63fff700 1 -- 172.21.15.49:0/829427006 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd640c3360 msgr2=0x7fdd4c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:15.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.351+0000 7fdd63fff700 1 --2- 172.21.15.49:0/829427006 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd640c3360 0x7fdd4c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.351+0000 7fdd63fff700 1 -- 172.21.15.49:0/829427006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd4c003910 msgr2=0x7fdd4c003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:15.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.351+0000 7fdd63fff700 1 --2- 172.21.15.49:0/829427006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd4c003910 0x7fdd4c003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.351+0000 7fdd63fff700 1 -- 172.21.15.49:0/829427006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4c0033f0 con 0x7fdd4c004b80 2023-11-30T17:08:15.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.351+0000 7fdd63fff700 1 --2- 172.21.15.49:0/829427006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd4c004b80 0x7fdd4c005000 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fdd640c3760 tx=0x7fdd5c00b040).ready entity=mon.0 client_cookie=6098c9fe9b894a65 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:15.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.351+0000 7fdd627fc700 1 -- 172.21.15.49:0/829427006 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c009ac0 con 0x7fdd4c004b80 2023-11-30T17:08:15.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.351+0000 7fdd627fc700 1 -- 172.21.15.49:0/829427006 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5c00f040 con 0x7fdd4c004b80 2023-11-30T17:08:15.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.351+0000 7fdd627fc700 1 -- 172.21.15.49:0/829427006 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c00ec40 con 0x7fdd4c004b80 2023-11-30T17:08:15.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.351+0000 7fdd69dc5700 1 -- 172.21.15.49:0/829427006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd4c004b80 msgr2=0x7fdd4c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:15.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.351+0000 7fdd69dc5700 1 --2- 172.21.15.49:0/829427006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd4c004b80 0x7fdd4c005000 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fdd640c3760 tx=0x7fdd5c00b040).stop 2023-11-30T17:08:15.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.351+0000 7fdd63fff700 1 -- 172.21.15.49:0/829427006 reap_dead start 2023-11-30T17:08:15.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.351+0000 7fdd69dc5700 1 -- 172.21.15.49:0/829427006 shutdown_connections 2023-11-30T17:08:15.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.351+0000 7fdd69dc5700 1 -- 172.21.15.49:0/829427006 >> 172.21.15.49:0/829427006 conn(0x7fdd64063810 msgr2=0x7fdd64063c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:15.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.351+0000 7fdd69dc5700 1 -- 172.21.15.49:0/829427006 shutdown_connections 2023-11-30T17:08:15.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.351+0000 7fdd69dc5700 1 -- 172.21.15.49:0/829427006 wait complete. 2023-11-30T17:08:15.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.353+0000 7fdd69dc5700 1 Processor -- start 2023-11-30T17:08:15.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.353+0000 7fdd69dc5700 1 -- start start 2023-11-30T17:08:15.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.353+0000 7fdd69dc5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd641455f0 0x7fdd640c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:15.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.353+0000 7fdd69dc5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd640a9ee0 0x7fdd640c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:15.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.353+0000 7fdd69dc5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd640ad870 0x7fdd64164c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:15.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.353+0000 7fdd69dc5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd640c6ec0 con 0x7fdd640a9ee0 2023-11-30T17:08:15.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.353+0000 7fdd69dc5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd640aaf90 con 0x7fdd640ad870 2023-11-30T17:08:15.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.353+0000 7fdd69dc5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd640c1ea0 con 0x7fdd641455f0 2023-11-30T17:08:15.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.353+0000 7fdd62ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd640a9ee0 0x7fdd640c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:15.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.354+0000 7fdd62ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd640a9ee0 0x7fdd640c69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59420/0 (socket says 172.21.15.49:59420) 2023-11-30T17:08:15.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.354+0000 7fdd62ffd700 1 -- 172.21.15.49:0/1705602848 learned_addr learned my addr 172.21.15.49:0/1705602848 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:15.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.354+0000 7fdd637fe700 1 --2- 172.21.15.49:0/1705602848 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd641455f0 0x7fdd640c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:15.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.354+0000 7fdd63fff700 1 --2- 172.21.15.49:0/1705602848 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd640ad870 0x7fdd64164c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:15.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.354+0000 7fdd62ffd700 1 -- 172.21.15.49:0/1705602848 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd641455f0 msgr2=0x7fdd640c64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:15.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.354+0000 7fdd62ffd700 1 --2- 172.21.15.49:0/1705602848 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd641455f0 0x7fdd640c64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.354+0000 7fdd62ffd700 1 -- 172.21.15.49:0/1705602848 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd640ad870 msgr2=0x7fdd64164c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:15.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.354+0000 7fdd62ffd700 1 --2- 172.21.15.49:0/1705602848 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd640ad870 0x7fdd64164c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.354+0000 7fdd62ffd700 1 -- 172.21.15.49:0/1705602848 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd640c1890 con 0x7fdd640a9ee0 2023-11-30T17:08:15.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.354+0000 7fdd63fff700 1 --2- 172.21.15.49:0/1705602848 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd640ad870 0x7fdd64164c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:08:15.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.354+0000 7fdd62ffd700 1 --2- 172.21.15.49:0/1705602848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd640a9ee0 0x7fdd640c69d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7fdd58004aa0 tx=0x7fdd58001e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:15.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.354+0000 7fdd4b7fe700 1 -- 172.21.15.49:0/1705602848 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd58011890 con 0x7fdd640a9ee0 2023-11-30T17:08:15.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.354+0000 7fdd4b7fe700 1 -- 172.21.15.49:0/1705602848 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd580119f0 con 0x7fdd640a9ee0 2023-11-30T17:08:15.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.354+0000 7fdd69dc5700 1 -- 172.21.15.49:0/1705602848 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd640bf760 con 0x7fdd640a9ee0 2023-11-30T17:08:15.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.354+0000 7fdd4b7fe700 1 -- 172.21.15.49:0/1705602848 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd58011d70 con 0x7fdd640a9ee0 2023-11-30T17:08:15.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.354+0000 7fdd69dc5700 1 -- 172.21.15.49:0/1705602848 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd640c1b30 con 0x7fdd640a9ee0 2023-11-30T17:08:15.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.356+0000 7fdd4b7fe700 1 -- 172.21.15.49:0/1705602848 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdd58017640 con 0x7fdd640a9ee0 2023-11-30T17:08:15.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.356+0000 7fdd4b7fe700 1 --2- 172.21.15.49:0/1705602848 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdd5005f150 0x7fdd50061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:15.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.356+0000 7fdd4b7fe700 1 -- 172.21.15.49:0/1705602848 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdd5807c760 con 0x7fdd640a9ee0 2023-11-30T17:08:15.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.356+0000 7fdd637fe700 1 --2- 172.21.15.49:0/1705602848 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdd5005f150 0x7fdd50061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:15.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.357+0000 7fdd637fe700 1 --2- 172.21.15.49:0/1705602848 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdd5005f150 0x7fdd50061610 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fdd54000f60 tx=0x7fdd54007b90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:15.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.358+0000 7fdd7b75db80 1 Processor -- start 2023-11-30T17:08:15.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.358+0000 7fdd7b75db80 1 -- start start 2023-11-30T17:08:15.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.359+0000 7fdd7b75db80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e832a1ae40 0x55e832c86d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:15.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.359+0000 7fdd7b75db80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55e832ca7ea0 0x55e832c5e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:15.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.359+0000 7fdd7b75db80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e832c5ecb0 0x55e832c59600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:15.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.359+0000 7fdd7b75db80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e832c24060 con 0x55e832c5ecb0 2023-11-30T17:08:15.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.359+0000 7fdd7b75db80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e832b9b1f0 con 0x55e832a1ae40 2023-11-30T17:08:15.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.359+0000 7fdd7b75db80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e832bb0440 con 0x55e832ca7ea0 2023-11-30T17:08:15.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.359+0000 7fdd63fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e832c5ecb0 0x55e832c59600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:15.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.359+0000 7fdd63fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e832c5ecb0 0x55e832c59600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59432/0 (socket says 172.21.15.49:59432) 2023-11-30T17:08:15.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.359+0000 7fdd63fff700 1 -- 172.21.15.49:0/1897513366 learned_addr learned my addr 172.21.15.49:0/1897513366 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:15.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.359+0000 7fdd637fe700 1 --2- 172.21.15.49:0/1897513366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e832a1ae40 0x55e832c86d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:15.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.359+0000 7fdd62ffd700 1 --2- 172.21.15.49:0/1897513366 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55e832ca7ea0 0x55e832c5e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:15.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.359+0000 7fdd63fff700 1 -- 172.21.15.49:0/1897513366 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55e832ca7ea0 msgr2=0x55e832c5e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:15.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.359+0000 7fdd63fff700 1 --2- 172.21.15.49:0/1897513366 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55e832ca7ea0 0x55e832c5e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.359+0000 7fdd63fff700 1 -- 172.21.15.49:0/1897513366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e832a1ae40 msgr2=0x55e832c86d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:15.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.359+0000 7fdd63fff700 1 --2- 172.21.15.49:0/1897513366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e832a1ae40 0x55e832c86d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.359+0000 7fdd63fff700 1 -- 172.21.15.49:0/1897513366 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e832ba9620 con 0x55e832c5ecb0 2023-11-30T17:08:15.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.359+0000 7fdd63fff700 1 --2- 172.21.15.49:0/1897513366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e832c5ecb0 0x55e832c59600 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fdd4c0045b0 tx=0x7fdd5c01a000).ready entity=mon.0 client_cookie=c08f4336f8d1a742 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:15.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.359+0000 7fdd48ff9700 1 -- 172.21.15.49:0/1897513366 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c009ac0 con 0x55e832c5ecb0 2023-11-30T17:08:15.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.360+0000 7fdd48ff9700 1 -- 172.21.15.49:0/1897513366 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5c00ea30 con 0x55e832c5ecb0 2023-11-30T17:08:15.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.360+0000 7fdd48ff9700 1 -- 172.21.15.49:0/1897513366 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c01d610 con 0x55e832c5ecb0 2023-11-30T17:08:15.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.360+0000 7fdd7b75db80 1 -- 172.21.15.49:0/1897513366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e832c5ecb0 msgr2=0x55e832c59600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:15.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.360+0000 7fdd7b75db80 1 --2- 172.21.15.49:0/1897513366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e832c5ecb0 0x55e832c59600 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fdd4c0045b0 tx=0x7fdd5c01a000).stop 2023-11-30T17:08:15.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.360+0000 7fdd7b75db80 1 -- 172.21.15.49:0/1897513366 shutdown_connections 2023-11-30T17:08:15.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.360+0000 7fdd7b75db80 1 --2- 172.21.15.49:0/1897513366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e832c5ecb0 0x55e832c59600 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.360+0000 7fdd7b75db80 1 --2- 172.21.15.49:0/1897513366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e832a1ae40 0x55e832c86d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.360+0000 7fdd7b75db80 1 --2- 172.21.15.49:0/1897513366 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55e832ca7ea0 0x55e832c5e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.360+0000 7fdd7b75db80 1 -- 172.21.15.49:0/1897513366 >> 172.21.15.49:0/1897513366 conn(0x55e832ac84a0 msgr2=0x55e832ca7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:15.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.360+0000 7fdd7b75db80 1 -- 172.21.15.49:0/1897513366 shutdown_connections 2023-11-30T17:08:15.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.360+0000 7fdd7b75db80 1 -- 172.21.15.49:0/1897513366 wait complete. 2023-11-30T17:08:15.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.361+0000 7fdd7b75db80 1 -- start start 2023-11-30T17:08:15.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.361+0000 7fdd7b75db80 1 Processor -- start 2023-11-30T17:08:15.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.362+0000 7fdd7b75db80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e832a1ae40 0x55e832c857d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:15.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.362+0000 7fdd7b75db80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e832c5ecb0 0x55e832ca2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:15.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.362+0000 7fdd7b75db80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55e832ca7ea0 0x55e832ca33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:15.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.362+0000 7fdd7b75db80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e832bb0580 con 0x55e832a1ae40 2023-11-30T17:08:15.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.362+0000 7fdd7b75db80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e832bb0800 con 0x55e832c5ecb0 2023-11-30T17:08:15.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.362+0000 7fdd7b75db80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e832b7be10 con 0x55e832ca7ea0 2023-11-30T17:08:15.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.362+0000 7fdd7b75db80 10 client.0 ll_register_callbacks cb 0x55e832c1e460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-30T17:08:15.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.362+0000 7fdd637fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e832a1ae40 0x55e832c857d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:15.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.362+0000 7fdd637fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e832a1ae40 0x55e832c857d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59444/0 (socket says 172.21.15.49:59444) 2023-11-30T17:08:15.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.362+0000 7fdd637fe700 1 -- 172.21.15.49:0/4287611633 learned_addr learned my addr 172.21.15.49:0/4287611633 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:15.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.362+0000 7fdd63fff700 1 --2- 172.21.15.49:0/4287611633 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55e832ca7ea0 0x55e832ca33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:15.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.362+0000 7fdd62ffd700 1 --2- 172.21.15.49:0/4287611633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e832c5ecb0 0x55e832ca2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:15.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.362+0000 7fdd637fe700 1 -- 172.21.15.49:0/4287611633 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55e832ca7ea0 msgr2=0x55e832ca33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:15.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.362+0000 7fdd637fe700 1 --2- 172.21.15.49:0/4287611633 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55e832ca7ea0 0x55e832ca33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.362+0000 7fdd637fe700 1 -- 172.21.15.49:0/4287611633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e832c5ecb0 msgr2=0x55e832ca2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:15.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.362+0000 7fdd637fe700 1 --2- 172.21.15.49:0/4287611633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e832c5ecb0 0x55e832ca2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.362+0000 7fdd637fe700 1 -- 172.21.15.49:0/4287611633 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd4c0033f0 con 0x55e832a1ae40 2023-11-30T17:08:15.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.362+0000 7fdd637fe700 1 --2- 172.21.15.49:0/4287611633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e832a1ae40 0x55e832c857d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7fdd540157d0 tx=0x7fdd54016000).ready entity=mon.0 client_cookie=53f3ae1c768a4673 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:15.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.362+0000 7fdd41ffb700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-30T17:08:15.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.362+0000 7fdd41ffb700 1 -- 172.21.15.49:0/4287611633 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd54014680 con 0x55e832a1ae40 2023-11-30T17:08:15.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.362+0000 7fdd41ffb700 1 -- 172.21.15.49:0/4287611633 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdd5401a030 con 0x55e832a1ae40 2023-11-30T17:08:15.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.362+0000 7fdd7b75db80 1 -- 172.21.15.49:0/4287611633 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e832c52720 con 0x55e832a1ae40 2023-11-30T17:08:15.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.363+0000 7fdd41ffb700 1 -- 172.21.15.49:0/4287611633 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd54007710 con 0x55e832a1ae40 2023-11-30T17:08:15.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.363+0000 7fdd7b75db80 10 client.5154 fetch_fsmap learned FSMap version 16 2023-11-30T17:08:15.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.363+0000 7fdd7b75db80 1 -- 172.21.15.49:0/4287611633 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55e832ba49c0 con 0x55e832a1ae40 2023-11-30T17:08:15.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.363+0000 7fdd41ffb700 1 -- 172.21.15.49:0/4287611633 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e832c52720 con 0x55e832a1ae40 2023-11-30T17:08:15.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.363+0000 7fdd41ffb700 1 -- 172.21.15.49:0/4287611633 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdd540149f0 con 0x55e832a1ae40 2023-11-30T17:08:15.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.363+0000 7fdd7b75db80 10 client.5154 fetch_fsmap finished waiting for FSMap version 16 2023-11-30T17:08:15.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.363+0000 7fdd7b75db80 10 client.5154 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-30T17:08:15.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.363+0000 7fdd7b75db80 20 client.5154 populate_metadata read hostname 'smithi049' 2023-11-30T17:08:15.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.363+0000 7fdd7b75db80 1 --2- 172.21.15.49:0/4287611633 >> [v2:172.21.15.115:6835/3449611740,v1:172.21.15.115:6837/3449611740] conn(0x55e832c8cd90 0x55e832c8d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:15.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.363+0000 7fdd7b75db80 4 client.5154 mds_command: new command op to 4944 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-30T17:08:15.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.363+0000 7fdd7b75db80 1 -- 172.21.15.49:0/4287611633 --> [v2:172.21.15.115:6835/3449611740,v1:172.21.15.115:6837/3449611740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e832a16ca0 con 0x55e832c8cd90 2023-11-30T17:08:15.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.363+0000 7fdd62ffd700 1 --2- 172.21.15.49:0/4287611633 >> [v2:172.21.15.115:6835/3449611740,v1:172.21.15.115:6837/3449611740] conn(0x55e832c8cd90 0x55e832c8d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:15.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.363+0000 7fdd41ffb700 10 client.5154 ms_handle_connect on v2:172.21.15.115:6835/3449611740 2023-11-30T17:08:15.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.363+0000 7fdd62ffd700 1 --2- 172.21.15.49:0/4287611633 >> [v2:172.21.15.115:6835/3449611740,v1:172.21.15.115:6837/3449611740] conn(0x55e832c8cd90 0x55e832c8d170 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=dd18fae1b19d9e9c server_cookie=c2cb8bae7754043e in_seq=0 out_seq=0 2023-11-30T17:08:15.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.364+0000 7fdd41ffb700 1 -- 172.21.15.49:0/4287611633 <== mds.0 v2:172.21.15.115:6835/3449611740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55e832a16ca0 con 0x55e832c8cd90 2023-11-30T17:08:15.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.364+0000 7fdd41ffb700 10 client.5154 handle_command_reply: tid=0 2023-11-30T17:08:15.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.364+0000 7fdd7b75db80 1 client.5154 shutdown 2023-11-30T17:08:15.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.364+0000 7fdd7b75db80 1 -- 172.21.15.49:0/4287611633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e832a1ae40 msgr2=0x55e832c857d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:15.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.364+0000 7fdd7b75db80 1 --2- 172.21.15.49:0/4287611633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e832a1ae40 0x55e832c857d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7fdd540157d0 tx=0x7fdd54016000).stop 2023-11-30T17:08:15.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.364+0000 7fdd7b75db80 1 -- 172.21.15.49:0/4287611633 shutdown_connections 2023-11-30T17:08:15.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.364+0000 7fdd7b75db80 1 --2- 172.21.15.49:0/4287611633 >> [v2:172.21.15.115:6835/3449611740,v1:172.21.15.115:6837/3449611740] conn(0x55e832c8cd90 0x55e832c8d170 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.364+0000 7fdd7b75db80 1 --2- 172.21.15.49:0/4287611633 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55e832ca7ea0 0x55e832ca33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.364+0000 7fdd41ffb700 0 client.5154 ms_handle_reset on v2:172.21.15.115:6835/3449611740 2023-11-30T17:08:15.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.364+0000 7fdd7b75db80 1 --2- 172.21.15.49:0/4287611633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e832a1ae40 0x55e832c857d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.364+0000 7fdd7b75db80 1 --2- 172.21.15.49:0/4287611633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e832c5ecb0 0x55e832ca2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.364+0000 7fdd7b75db80 1 -- 172.21.15.49:0/4287611633 >> 172.21.15.49:0/4287611633 conn(0x55e832ac84a0 msgr2=0x55e832c5f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:15.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.365+0000 7fdd7b75db80 1 -- 172.21.15.49:0/4287611633 shutdown_connections 2023-11-30T17:08:15.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.365+0000 7fdd7b75db80 1 -- 172.21.15.49:0/4287611633 wait complete. 2023-11-30T17:08:15.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.365+0000 7fdd7b75db80 20 client.5154 trim_cache size 0 max 16384 2023-11-30T17:08:15.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.381+0000 7fdd7b75db80 1 Processor -- start 2023-11-30T17:08:15.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.381+0000 7fdd7b75db80 1 -- start start 2023-11-30T17:08:15.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.382+0000 7fdd7b75db80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e832ac84a0 0x55e832c5fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:15.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.382+0000 7fdd7b75db80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e832a1ae40 0x55e832c58840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:15.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.382+0000 7fdd7b75db80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55e832c5ecb0 0x55e832ca1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:15.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.382+0000 7fdd7b75db80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e832c5e160 con 0x55e832a1ae40 2023-11-30T17:08:15.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.382+0000 7fdd7b75db80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e832c5d710 con 0x55e832ac84a0 2023-11-30T17:08:15.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.382+0000 7fdd7b75db80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e832c52360 con 0x55e832c5ecb0 2023-11-30T17:08:15.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.382+0000 7fdd637fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e832ac84a0 0x55e832c5fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:15.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.382+0000 7fdd63fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55e832c5ecb0 0x55e832ca1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:15.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.382+0000 7fdd637fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e832ac84a0 0x55e832c5fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:59328/0 (socket says 172.21.15.49:59328) 2023-11-30T17:08:15.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.382+0000 7fdd63fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55e832c5ecb0 0x55e832ca1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:55072/0 (socket says 172.21.15.49:55072) 2023-11-30T17:08:15.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.382+0000 7fdd637fe700 1 -- 172.21.15.49:0/2433789603 learned_addr learned my addr 172.21.15.49:0/2433789603 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:15.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.382+0000 7fdd62ffd700 1 --2- 172.21.15.49:0/2433789603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e832a1ae40 0x55e832c58840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:15.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.382+0000 7fdd637fe700 1 -- 172.21.15.49:0/2433789603 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55e832c5ecb0 msgr2=0x55e832ca1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:15.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.382+0000 7fdd637fe700 1 --2- 172.21.15.49:0/2433789603 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55e832c5ecb0 0x55e832ca1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.382+0000 7fdd637fe700 1 -- 172.21.15.49:0/2433789603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e832a1ae40 msgr2=0x55e832c58840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:15.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.382+0000 7fdd637fe700 1 --2- 172.21.15.49:0/2433789603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e832a1ae40 0x55e832c58840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.382+0000 7fdd637fe700 1 -- 172.21.15.49:0/2433789603 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e832ba4710 con 0x55e832ac84a0 2023-11-30T17:08:15.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.382+0000 7fdd62ffd700 1 --2- 172.21.15.49:0/2433789603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e832a1ae40 0x55e832c58840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:08:15.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.382+0000 7fdd637fe700 1 --2- 172.21.15.49:0/2433789603 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e832ac84a0 0x55e832c5fee0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fdd54014f90 tx=0x7fdd54026000).ready entity=mon.1 client_cookie=962c463e90c0af26 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:15.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.383+0000 7fdd497fa700 1 -- 172.21.15.49:0/2433789603 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd54007710 con 0x55e832ac84a0 2023-11-30T17:08:15.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.383+0000 7fdd497fa700 1 -- 172.21.15.49:0/2433789603 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd540149f0 con 0x55e832ac84a0 2023-11-30T17:08:15.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.383+0000 7fdd497fa700 1 -- 172.21.15.49:0/2433789603 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd54014b60 con 0x55e832ac84a0 2023-11-30T17:08:15.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.383+0000 7fdd7b75db80 1 -- 172.21.15.49:0/2433789603 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e832ac84a0 msgr2=0x55e832c5fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:15.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.383+0000 7fdd7b75db80 1 --2- 172.21.15.49:0/2433789603 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e832ac84a0 0x55e832c5fee0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fdd54014f90 tx=0x7fdd54026000).stop 2023-11-30T17:08:15.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.383+0000 7fdd7b75db80 1 -- 172.21.15.49:0/2433789603 shutdown_connections 2023-11-30T17:08:15.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.383+0000 7fdd7b75db80 1 --2- 172.21.15.49:0/2433789603 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55e832c5ecb0 0x55e832ca1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.383+0000 7fdd7b75db80 1 --2- 172.21.15.49:0/2433789603 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e832ac84a0 0x55e832c5fee0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.383+0000 7fdd7b75db80 1 --2- 172.21.15.49:0/2433789603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e832a1ae40 0x55e832c58840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.383+0000 7fdd7b75db80 1 -- 172.21.15.49:0/2433789603 >> 172.21.15.49:0/2433789603 conn(0x55e832c9e1b0 msgr2=0x55e832ca7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:15.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.383+0000 7fdd7b75db80 1 -- 172.21.15.49:0/2433789603 shutdown_connections 2023-11-30T17:08:15.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.383+0000 7fdd7b75db80 1 -- 172.21.15.49:0/2433789603 wait complete. 2023-11-30T17:08:15.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.384+0000 7fdd7b75db80 1 -- start start 2023-11-30T17:08:15.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.384+0000 7fdd7b75db80 1 Processor -- start 2023-11-30T17:08:15.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.385+0000 7fdd7b75db80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e832a1ae40 0x55e832c87c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:15.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.385+0000 7fdd7b75db80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55e832ac84a0 0x55e832c89900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:15.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.385+0000 7fdd7b75db80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e832c5ecb0 0x55e832c89df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:15.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.385+0000 7fdd7b75db80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e832c8b670 con 0x55e832a1ae40 2023-11-30T17:08:15.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.385+0000 7fdd7b75db80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e832c8b950 con 0x55e832c5ecb0 2023-11-30T17:08:15.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.385+0000 7fdd7b75db80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e832c8bc30 con 0x55e832ac84a0 2023-11-30T17:08:15.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.385+0000 7fdd7b75db80 10 client.0 ll_register_callbacks cb 0x55e832c1e460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-30T17:08:15.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.385+0000 7fdd637fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e832a1ae40 0x55e832c87c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:15.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.385+0000 7fdd637fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e832a1ae40 0x55e832c87c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59476/0 (socket says 172.21.15.49:59476) 2023-11-30T17:08:15.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.385+0000 7fdd637fe700 1 -- 172.21.15.49:0/3856144419 learned_addr learned my addr 172.21.15.49:0/3856144419 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:15.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.385+0000 7fdd62ffd700 1 --2- 172.21.15.49:0/3856144419 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55e832ac84a0 0x55e832c89900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:15.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.385+0000 7fdd63fff700 1 --2- 172.21.15.49:0/3856144419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e832c5ecb0 0x55e832c89df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:15.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.385+0000 7fdd637fe700 1 -- 172.21.15.49:0/3856144419 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55e832ac84a0 msgr2=0x55e832c89900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:15.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.385+0000 7fdd637fe700 1 --2- 172.21.15.49:0/3856144419 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55e832ac84a0 0x55e832c89900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.385+0000 7fdd637fe700 1 -- 172.21.15.49:0/3856144419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e832c5ecb0 msgr2=0x55e832c89df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:15.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.385+0000 7fdd637fe700 1 --2- 172.21.15.49:0/3856144419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e832c5ecb0 0x55e832c89df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.385+0000 7fdd637fe700 1 -- 172.21.15.49:0/3856144419 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd640c1b30 con 0x55e832a1ae40 2023-11-30T17:08:15.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.385+0000 7fdd637fe700 1 --2- 172.21.15.49:0/3856144419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e832a1ae40 0x55e832c87c70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7fdd54003820 tx=0x7fdd54035040).ready entity=mon.0 client_cookie=d90fc0eb4e49b5b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:15.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.385+0000 7fdd41ffb700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-30T17:08:15.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.385+0000 7fdd41ffb700 1 -- 172.21.15.49:0/3856144419 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd54002f90 con 0x55e832a1ae40 2023-11-30T17:08:15.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.385+0000 7fdd41ffb700 1 -- 172.21.15.49:0/3856144419 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdd5401a040 con 0x55e832a1ae40 2023-11-30T17:08:15.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.385+0000 7fdd7b75db80 1 -- 172.21.15.49:0/3856144419 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdd5c00ea30 con 0x55e832a1ae40 2023-11-30T17:08:15.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.386+0000 7fdd41ffb700 1 -- 172.21.15.49:0/3856144419 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd540030f0 con 0x55e832a1ae40 2023-11-30T17:08:15.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.386+0000 7fdd7b75db80 10 client.5160 fetch_fsmap learned FSMap version 16 2023-11-30T17:08:15.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.386+0000 7fdd7b75db80 1 -- 172.21.15.49:0/3856144419 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55e832ba49c0 con 0x55e832a1ae40 2023-11-30T17:08:15.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.386+0000 7fdd41ffb700 1 -- 172.21.15.49:0/3856144419 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5c00ea30 con 0x55e832a1ae40 2023-11-30T17:08:15.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.386+0000 7fdd41ffb700 1 -- 172.21.15.49:0/3856144419 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdd540143a0 con 0x55e832a1ae40 2023-11-30T17:08:15.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.386+0000 7fdd7b75db80 10 client.5160 fetch_fsmap finished waiting for FSMap version 16 2023-11-30T17:08:15.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.386+0000 7fdd7b75db80 10 client.5160 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-30T17:08:15.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.386+0000 7fdd7b75db80 20 client.5160 populate_metadata read hostname 'smithi049' 2023-11-30T17:08:15.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.386+0000 7fdd7b75db80 1 --2- 172.21.15.49:0/3856144419 >> [v2:172.21.15.115:6835/3449611740,v1:172.21.15.115:6837/3449611740] conn(0x55e832ca7ea0 0x55e832c81c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:15.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.386+0000 7fdd7b75db80 4 client.5160 mds_command: new command op to 4944 tid=0[{"prefix": "status"}] 2023-11-30T17:08:15.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.386+0000 7fdd7b75db80 1 -- 172.21.15.49:0/3856144419 --> [v2:172.21.15.115:6835/3449611740,v1:172.21.15.115:6837/3449611740] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e832a4dca0 con 0x55e832ca7ea0 2023-11-30T17:08:15.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.387+0000 7fdd62ffd700 1 --2- 172.21.15.49:0/3856144419 >> [v2:172.21.15.115:6835/3449611740,v1:172.21.15.115:6837/3449611740] conn(0x55e832ca7ea0 0x55e832c81c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:15.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.387+0000 7fdd62ffd700 1 --2- 172.21.15.49:0/3856144419 >> [v2:172.21.15.115:6835/3449611740,v1:172.21.15.115:6837/3449611740] conn(0x55e832ca7ea0 0x55e832c81c00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7772b910bbdef4af server_cookie=60e6b3f990ca5e43 in_seq=0 out_seq=0 2023-11-30T17:08:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.387+0000 7fdd41ffb700 10 client.5160 ms_handle_connect on v2:172.21.15.115:6835/3449611740 2023-11-30T17:08:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.387+0000 7fdd41ffb700 1 -- 172.21.15.49:0/3856144419 <== mds.0 v2:172.21.15.115:6835/3449611740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55e832a4dca0 con 0x55e832ca7ea0 2023-11-30T17:08:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.387+0000 7fdd41ffb700 10 client.5160 handle_command_reply: tid=0 2023-11-30T17:08:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.387+0000 7fdd7b75db80 1 client.5160 shutdown 2023-11-30T17:08:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.387+0000 7fdd7b75db80 1 -- 172.21.15.49:0/3856144419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e832a1ae40 msgr2=0x55e832c87c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.387+0000 7fdd7b75db80 1 --2- 172.21.15.49:0/3856144419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e832a1ae40 0x55e832c87c70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7fdd54003820 tx=0x7fdd54035040).stop 2023-11-30T17:08:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.387+0000 7fdd7b75db80 1 -- 172.21.15.49:0/3856144419 shutdown_connections 2023-11-30T17:08:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.387+0000 7fdd7b75db80 1 --2- 172.21.15.49:0/3856144419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e832c5ecb0 0x55e832c89df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.387+0000 7fdd7b75db80 1 --2- 172.21.15.49:0/3856144419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e832a1ae40 0x55e832c87c70 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.387+0000 7fdd7b75db80 1 --2- 172.21.15.49:0/3856144419 >> [v2:172.21.15.115:6835/3449611740,v1:172.21.15.115:6837/3449611740] conn(0x55e832ca7ea0 0x55e832c81c00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.387+0000 7fdd7b75db80 1 --2- 172.21.15.49:0/3856144419 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55e832ac84a0 0x55e832c89900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.387+0000 7fdd7b75db80 1 -- 172.21.15.49:0/3856144419 >> 172.21.15.49:0/3856144419 conn(0x55e832c9e1b0 msgr2=0x55e832c5fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.387+0000 7fdd41ffb700 0 client.5160 ms_handle_reset on v2:172.21.15.115:6835/3449611740 2023-11-30T17:08:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.387+0000 7fdd7b75db80 1 -- 172.21.15.49:0/3856144419 shutdown_connections 2023-11-30T17:08:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.387+0000 7fdd7b75db80 1 -- 172.21.15.49:0/3856144419 wait complete. 2023-11-30T17:08:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.387+0000 7fdd7b75db80 20 client.5160 trim_cache size 0 max 16384 2023-11-30T17:08:15.395 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T17:08:15.395 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "ef213ed4-8f62-4ad5-b55f-7510fd0ee359", 2023-11-30T17:08:15.395 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2023-11-30T17:08:15.395 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4944, 2023-11-30T17:08:15.395 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-11-30T17:08:15.395 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-11-30T17:08:15.395 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-11-30T17:08:15.395 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 10.184862985000001, 2023-11-30T17:08:15.395 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 16, 2023-11-30T17:08:15.396 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 34, 2023-11-30T17:08:15.396 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 34, 2023-11-30T17:08:15.396 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 17.436912005 2023-11-30T17:08:15.396 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T17:08:15.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.388+0000 7fdd69dc5700 1 -- 172.21.15.49:0/1705602848 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdd5005f150 msgr2=0x7fdd50061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:15.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.388+0000 7fdd69dc5700 1 --2- 172.21.15.49:0/1705602848 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdd5005f150 0x7fdd50061610 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fdd54000f60 tx=0x7fdd54007b90).stop 2023-11-30T17:08:15.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.388+0000 7fdd69dc5700 1 -- 172.21.15.49:0/1705602848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd640a9ee0 msgr2=0x7fdd640c69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:15.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.388+0000 7fdd69dc5700 1 --2- 172.21.15.49:0/1705602848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd640a9ee0 0x7fdd640c69d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7fdd58004aa0 tx=0x7fdd58001e70).stop 2023-11-30T17:08:15.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.388+0000 7fdd69dc5700 1 -- 172.21.15.49:0/1705602848 shutdown_connections 2023-11-30T17:08:15.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.388+0000 7fdd69dc5700 1 --2- 172.21.15.49:0/1705602848 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd640ad870 0x7fdd64164c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.388+0000 7fdd69dc5700 1 --2- 172.21.15.49:0/1705602848 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd641455f0 0x7fdd640c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.388+0000 7fdd69dc5700 1 --2- 172.21.15.49:0/1705602848 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdd5005f150 0x7fdd50061610 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.388+0000 7fdd69dc5700 1 --2- 172.21.15.49:0/1705602848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd640a9ee0 0x7fdd640c69d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.388+0000 7fdd69dc5700 1 -- 172.21.15.49:0/1705602848 >> 172.21.15.49:0/1705602848 conn(0x7fdd64063810 msgr2=0x7fdd64069b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:15.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.388+0000 7fdd69dc5700 1 -- 172.21.15.49:0/1705602848 shutdown_connections 2023-11-30T17:08:15.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.388+0000 7fdd69dc5700 1 -- 172.21.15.49:0/1705602848 wait complete. 2023-11-30T17:08:15.401 DEBUG:teuthology.orchestra.run.smithi049:> ceph fs ls 2023-11-30T17:08:15.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.504+0000 7fd11694d700 1 Processor -- start 2023-11-30T17:08:15.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.504+0000 7fd11694d700 1 -- start start 2023-11-30T17:08:15.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.505+0000 7fd11694d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd110064130 0x7fd11015c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:15.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.505+0000 7fd11694d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd1100c4520 0x7fd11015e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:15.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.505+0000 7fd11694d700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1100651a0 con 0x7fd1100c64d0 2023-11-30T17:08:15.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.505+0000 7fd11694d700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1100c68b0 con 0x7fd1100c4520 2023-11-30T17:08:15.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.505+0000 7fd11694d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1100645b0 con 0x7fd110064130 2023-11-30T17:08:15.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.505+0000 7fd11614c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd1100c4520 0x7fd11015e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:15.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.505+0000 7fd11594b700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd1100c64d0 0x7fd1100be710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35796/0 (socket says 172.21.15.49:35796) 2023-11-30T17:08:15.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.505+0000 7fd11614c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd1100c4520 0x7fd11015e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59478/0 (socket says 172.21.15.49:59478) 2023-11-30T17:08:15.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.505+0000 7fd11594b700 1 -- 172.21.15.49:0/2730354178 learned_addr learned my addr 172.21.15.49:0/2730354178 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:08:15.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.505+0000 7fd11514a700 1 --2- 172.21.15.49:0/2730354178 >> v2:172.21.15.115:3300/0 conn(0x7fd110064130 0x7fd11015c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:15.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.505+0000 7fd11614c700 1 -- 172.21.15.49:0/2730354178 >> v2:172.21.15.115:3300/0 conn(0x7fd110064130 msgr2=0x7fd11015c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:15.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.505+0000 7fd11614c700 1 --2- 172.21.15.49:0/2730354178 >> v2:172.21.15.115:3300/0 conn(0x7fd110064130 0x7fd11015c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.505+0000 7fd11614c700 1 -- 172.21.15.49:0/2730354178 >> v1:172.21.15.49:6789/0 conn(0x7fd1100c64d0 legacy=0x7fd1100be710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:15.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.505+0000 7fd11614c700 1 -- 172.21.15.49:0/2730354178 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd110064870 con 0x7fd1100c4520 2023-11-30T17:08:15.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.505+0000 7fd114949700 1 -- 172.21.15.49:0/2730354178 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3750673377 0 0) 0x7fd1100651a0 con 0x7fd1100c64d0 2023-11-30T17:08:15.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.506+0000 7fd11614c700 1 --2- 172.21.15.49:0/2730354178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1100c4520 0x7fd11015e5a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fd110069880 tx=0x7fd108009060).ready entity=mon.0 client_cookie=f4816dd268a04349 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:15.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.506+0000 7fd114949700 1 -- 172.21.15.49:0/2730354178 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10800b580 con 0x7fd1100c4520 2023-11-30T17:08:15.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.506+0000 7fd114949700 1 -- 172.21.15.49:0/2730354178 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10800b6e0 con 0x7fd1100c4520 2023-11-30T17:08:15.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.506+0000 7fd114949700 1 -- 172.21.15.49:0/2730354178 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10800ba60 con 0x7fd1100c4520 2023-11-30T17:08:15.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.506+0000 7fd11694d700 1 -- 172.21.15.49:0/2730354178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1100c4520 msgr2=0x7fd11015e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:15.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.506+0000 7fd11694d700 1 --2- 172.21.15.49:0/2730354178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1100c4520 0x7fd11015e5a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fd110069880 tx=0x7fd108009060).stop 2023-11-30T17:08:15.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.506+0000 7fd11694d700 1 -- 172.21.15.49:0/2730354178 shutdown_connections 2023-11-30T17:08:15.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.506+0000 7fd11694d700 1 --2- 172.21.15.49:0/2730354178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1100c4520 0x7fd11015e5a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.506+0000 7fd11694d700 1 --2- 172.21.15.49:0/2730354178 >> v2:172.21.15.115:3300/0 conn(0x7fd110064130 0x7fd11015c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.506+0000 7fd11694d700 1 -- 172.21.15.49:0/2730354178 >> 172.21.15.49:0/2730354178 conn(0x7fd110082f80 msgr2=0x7fd110062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:15.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.506+0000 7fd11694d700 1 -- 172.21.15.49:0/2730354178 shutdown_connections 2023-11-30T17:08:15.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.506+0000 7fd11694d700 1 -- 172.21.15.49:0/2730354178 wait complete. 2023-11-30T17:08:15.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.507+0000 7fd11694d700 1 Processor -- start 2023-11-30T17:08:15.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.508+0000 7fd11694d700 1 -- start start 2023-11-30T17:08:15.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.508+0000 7fd11694d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd110064130 0x7fd110167720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:15.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.508+0000 7fd11694d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1100c4520 0x7fd110154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:15.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.508+0000 7fd11694d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1100c64d0 0x7fd110155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:15.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.508+0000 7fd11694d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd110155560 con 0x7fd110064130 2023-11-30T17:08:15.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.508+0000 7fd11694d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1100c9070 con 0x7fd1100c64d0 2023-11-30T17:08:15.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.508+0000 7fd11694d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd110155740 con 0x7fd1100c4520 2023-11-30T17:08:15.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.508+0000 7fd11594b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd110064130 0x7fd110167720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:15.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.508+0000 7fd11594b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd110064130 0x7fd110167720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59494/0 (socket says 172.21.15.49:59494) 2023-11-30T17:08:15.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.508+0000 7fd11594b700 1 -- 172.21.15.49:0/134403612 learned_addr learned my addr 172.21.15.49:0/134403612 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:15.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.508+0000 7fd11514a700 1 --2- 172.21.15.49:0/134403612 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1100c4520 0x7fd110154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:15.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.508+0000 7fd11614c700 1 --2- 172.21.15.49:0/134403612 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1100c64d0 0x7fd110155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:15.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.509+0000 7fd11594b700 1 -- 172.21.15.49:0/134403612 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1100c4520 msgr2=0x7fd110154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:15.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.509+0000 7fd11594b700 1 --2- 172.21.15.49:0/134403612 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1100c4520 0x7fd110154b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.509+0000 7fd11594b700 1 -- 172.21.15.49:0/134403612 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1100c64d0 msgr2=0x7fd110155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:15.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.509+0000 7fd11594b700 1 --2- 172.21.15.49:0/134403612 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1100c64d0 0x7fd110155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.509+0000 7fd11594b700 1 -- 172.21.15.49:0/134403612 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1080092a0 con 0x7fd110064130 2023-11-30T17:08:15.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.509+0000 7fd11594b700 1 --2- 172.21.15.49:0/134403612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd110064130 0x7fd110167720 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7fd10000c810 tx=0x7fd100001570).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:15.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.509+0000 7fd10dffb700 1 -- 172.21.15.49:0/134403612 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd100005d30 con 0x7fd110064130 2023-11-30T17:08:15.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.509+0000 7fd10dffb700 1 -- 172.21.15.49:0/134403612 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd100005e90 con 0x7fd110064130 2023-11-30T17:08:15.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.509+0000 7fd11694d700 1 -- 172.21.15.49:0/134403612 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd110155a20 con 0x7fd110064130 2023-11-30T17:08:15.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.509+0000 7fd10dffb700 1 -- 172.21.15.49:0/134403612 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd100007320 con 0x7fd110064130 2023-11-30T17:08:15.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.509+0000 7fd11694d700 1 -- 172.21.15.49:0/134403612 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1101562c0 con 0x7fd110064130 2023-11-30T17:08:15.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.510+0000 7fd11694d700 1 -- 172.21.15.49:0/134403612 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd110155c10 con 0x7fd110064130 2023-11-30T17:08:15.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.510+0000 7fd10dffb700 1 -- 172.21.15.49:0/134403612 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd100007750 con 0x7fd110064130 2023-11-30T17:08:15.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.511+0000 7fd10dffb700 1 --2- 172.21.15.49:0/134403612 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd0fc05f150 0x7fd0fc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:15.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.511+0000 7fd10dffb700 1 -- 172.21.15.49:0/134403612 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd10007a190 con 0x7fd110064130 2023-11-30T17:08:15.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.511+0000 7fd11514a700 1 --2- 172.21.15.49:0/134403612 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd0fc05f150 0x7fd0fc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:15.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.511+0000 7fd11514a700 1 --2- 172.21.15.49:0/134403612 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd0fc05f150 0x7fd0fc061610 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fd110156750 tx=0x7fd104008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:15.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.515+0000 7fd10dffb700 1 -- 172.21.15.49:0/134403612 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd10004b3a0 con 0x7fd110064130 2023-11-30T17:08:15.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.731+0000 7fd11694d700 1 -- 172.21.15.49:0/134403612 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd1101564e0 con 0x7fd110064130 2023-11-30T17:08:15.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.731+0000 7fd10dffb700 1 -- 172.21.15.49:0/134403612 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd1000016b0 con 0x7fd110064130 2023-11-30T17:08:15.733 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-30T17:08:15.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.733+0000 7fd11694d700 1 -- 172.21.15.49:0/134403612 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd0fc05f150 msgr2=0x7fd0fc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:15.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.733+0000 7fd11694d700 1 --2- 172.21.15.49:0/134403612 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd0fc05f150 0x7fd0fc061610 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fd110156750 tx=0x7fd104008040).stop 2023-11-30T17:08:15.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.733+0000 7fd11694d700 1 -- 172.21.15.49:0/134403612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd110064130 msgr2=0x7fd110167720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:15.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.733+0000 7fd11694d700 1 --2- 172.21.15.49:0/134403612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd110064130 0x7fd110167720 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7fd10000c810 tx=0x7fd100001570).stop 2023-11-30T17:08:15.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.733+0000 7fd11694d700 1 -- 172.21.15.49:0/134403612 shutdown_connections 2023-11-30T17:08:15.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.733+0000 7fd11694d700 1 --2- 172.21.15.49:0/134403612 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1100c64d0 0x7fd110155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.733+0000 7fd11694d700 1 --2- 172.21.15.49:0/134403612 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd0fc05f150 0x7fd0fc061610 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.733+0000 7fd11694d700 1 --2- 172.21.15.49:0/134403612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd110064130 0x7fd110167720 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.733+0000 7fd11694d700 1 --2- 172.21.15.49:0/134403612 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1100c4520 0x7fd110154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:15.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.733+0000 7fd11694d700 1 -- 172.21.15.49:0/134403612 >> 172.21.15.49:0/134403612 conn(0x7fd110082f80 msgr2=0x7fd110153d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:15.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.733+0000 7fd11694d700 1 -- 172.21.15.49:0/134403612 shutdown_connections 2023-11-30T17:08:15.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:15.733+0000 7fd11694d700 1 -- 172.21.15.49:0/134403612 wait complete. 2023-11-30T17:08:15.746 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-30T17:08:15.746 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-30T17:08:15.746 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-11-30T17:08:15.746 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-30T17:08:15.746 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-30T17:08:15.750 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-30T17:08:15.750 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-30T17:08:15.750 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-30T17:08:15.750 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-30T17:08:15.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:08:15.751 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-11-30T17:08:15.766 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-30T17:08:15.767 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-30T17:08:15.767 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-11-30T17:08:15.767 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:08:15.767 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-11-30T17:08:15.767 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:08:15.767 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:08:15.767 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:08:15.767 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-11-30T17:08:15.767 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:08:15.767 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:08:15.767 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-11-30T17:08:15.767 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-30T17:08:15.767 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:08:15.768 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-11-30T17:08:15.768 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-30T17:08:15.768 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42379sec preferred_lft 42379sec 2023-11-30T17:08:15.768 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2023-11-30T17:08:15.768 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:08:15.768 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:08:15.768 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:08:15.768 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-11-30T17:08:15.768 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-30T17:08:15.768 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 32:bf:40:53:4c:5d brd ff:ff:ff:ff:ff:ff 2023-11-30T17:08:15.768 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-30T17:08:15.768 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:08:15.768 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::8b6:11ff:fe93:7174/64 scope link 2023-11-30T17:08:15.768 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:08:15.768 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-30T17:08:15.769 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 3e:e9:3c:a8:7a:95 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-30T17:08:15.769 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::3ce9:3cff:fea8:7a95/64 scope link 2023-11-30T17:08:15.769 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:08:15.769 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-30T17:08:15.769 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 32:bf:40:53:4c:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-30T17:08:15.769 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::30bf:40ff:fe53:4c5d/64 scope link 2023-11-30T17:08:15.769 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:08:15.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:08:15.769 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-30T17:08:15.831 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-11-30T17:08:15.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:08:15.832 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-11-30T17:08:15.889 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-11-30T17:08:15.889 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-30T17:08:15.889 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-30T17:08:15.889 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-30T17:08:15.889 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-30T17:08:15.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:08:15.890 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-11-30T17:08:15.890 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-11-30T17:08:15.890 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-30T17:08:15.890 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-30T17:08:15.890 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-30T17:08:15.890 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-11-30T17:08:15.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:08:15.992 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-11-30T17:08:16.006 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-30T17:08:16.006 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-30T17:08:16.007 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-30T17:08:16.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:08:16.007 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-11-30T17:08:16.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:08:16.072 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-11-30T17:08:16.127 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-30T17:08:16.127 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:08:16.207 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:08:16.207 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-30T17:08:16.233 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:08:16.233 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-30T17:08:16.235 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-30T17:08:16.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:08:16.236 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-30T17:08:16.303 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-30T17:08:16.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.459+0000 7fd2fce8c700 1 Processor -- start 2023-11-30T17:08:16.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.459+0000 7fd2fce8c700 1 -- start start 2023-11-30T17:08:16.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.460+0000 7fd2fce8c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2f80c6190 0x7fd2f80c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:16.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.460+0000 7fd2fce8c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd2f8158320 0x7fd2f81587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:16.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.460+0000 7fd2fce8c700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2f8158cc0 con 0x7fd2f8098d10 2023-11-30T17:08:16.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.460+0000 7fd2fce8c700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2f80c72d0 con 0x7fd2f8158320 2023-11-30T17:08:16.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.460+0000 7fd2fce8c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f8064570 con 0x7fd2f80c6190 2023-11-30T17:08:16.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.461+0000 7fd2f6d9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd2f8158320 0x7fd2f81587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:16.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.461+0000 7fd2f5d9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2f80c6190 0x7fd2f80c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:16.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.461+0000 7fd2f659c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd2f8098d10 0x7fd2f8063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:34618/0 (socket says 172.21.15.49:34618) 2023-11-30T17:08:16.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.461+0000 7fd2f659c700 1 -- 172.21.15.49:0/1907875604 learned_addr learned my addr 172.21.15.49:0/1907875604 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:08:16.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.461+0000 7fd2f559a700 1 -- 172.21.15.49:0/1907875604 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1801786456 0 0) 0x7fd2f0001110 con 0x7fd2f8098d10 2023-11-30T17:08:16.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.461+0000 7fd2f559a700 1 -- 172.21.15.49:0/1907875604 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2e40033f0 con 0x7fd2f8098d10 2023-11-30T17:08:16.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.461+0000 7fd2f5d9b700 1 -- 172.21.15.49:0/1907875604 >> v2:172.21.15.115:3300/0 conn(0x7fd2f8158320 msgr2=0x7fd2f81587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:16.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.461+0000 7fd2f5d9b700 1 --2- 172.21.15.49:0/1907875604 >> v2:172.21.15.115:3300/0 conn(0x7fd2f8158320 0x7fd2f81587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:16.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.461+0000 7fd2f5d9b700 1 -- 172.21.15.49:0/1907875604 >> v1:172.21.15.115:6789/0 conn(0x7fd2f8098d10 legacy=0x7fd2f8063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:16.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.461+0000 7fd2f5d9b700 1 -- 172.21.15.49:0/1907875604 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f8154bc0 con 0x7fd2f80c6190 2023-11-30T17:08:16.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.461+0000 7fd2f6d9d700 1 --2- 172.21.15.49:0/1907875604 >> v2:172.21.15.115:3300/0 conn(0x7fd2f8158320 0x7fd2f81587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:08:16.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.461+0000 7fd2f5d9b700 1 --2- 172.21.15.49:0/1907875604 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2f80c6190 0x7fd2f80c7760 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd2e0009760 tx=0x7fd2e0009060).ready entity=mon.2 client_cookie=3f2a36a0dc28f1a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:16.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.462+0000 7fd2f559a700 1 -- 172.21.15.49:0/1907875604 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e000d4a0 con 0x7fd2f80c6190 2023-11-30T17:08:16.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.462+0000 7fd2f559a700 1 -- 172.21.15.49:0/1907875604 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e000d600 con 0x7fd2f80c6190 2023-11-30T17:08:16.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.462+0000 7fd2f559a700 1 -- 172.21.15.49:0/1907875604 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e000d980 con 0x7fd2f80c6190 2023-11-30T17:08:16.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.462+0000 7fd2fce8c700 1 -- 172.21.15.49:0/1907875604 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2f80c6190 msgr2=0x7fd2f80c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:16.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.462+0000 7fd2fce8c700 1 --2- 172.21.15.49:0/1907875604 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2f80c6190 0x7fd2f80c7760 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd2e0009760 tx=0x7fd2e0009060).stop 2023-11-30T17:08:16.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.462+0000 7fd2fce8c700 1 -- 172.21.15.49:0/1907875604 shutdown_connections 2023-11-30T17:08:16.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.462+0000 7fd2fce8c700 1 --2- 172.21.15.49:0/1907875604 >> v2:172.21.15.115:3300/0 conn(0x7fd2f8158320 0x7fd2f81587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:16.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.462+0000 7fd2fce8c700 1 --2- 172.21.15.49:0/1907875604 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2f80c6190 0x7fd2f80c7760 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:16.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.462+0000 7fd2fce8c700 1 -- 172.21.15.49:0/1907875604 >> 172.21.15.49:0/1907875604 conn(0x7fd2f80cb310 msgr2=0x7fd2f80cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:16.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.462+0000 7fd2fce8c700 1 -- 172.21.15.49:0/1907875604 shutdown_connections 2023-11-30T17:08:16.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.462+0000 7fd2fce8c700 1 -- 172.21.15.49:0/1907875604 wait complete. 2023-11-30T17:08:16.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.463+0000 7fd2fce8c700 1 Processor -- start 2023-11-30T17:08:16.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.463+0000 7fd2fce8c700 1 -- start start 2023-11-30T17:08:16.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.464+0000 7fd2fce8c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2f8098d10 0x7fd2f81577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:16.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.464+0000 7fd2fce8c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2f80c6190 0x7fd2f81685c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:16.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.464+0000 7fd2fce8c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2f8158320 0x7fd2f814bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:16.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.464+0000 7fd2fce8c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f81552b0 con 0x7fd2f8098d10 2023-11-30T17:08:16.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.464+0000 7fd2fce8c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f80c3210 con 0x7fd2f80c6190 2023-11-30T17:08:16.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.464+0000 7fd2fce8c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f80af5d0 con 0x7fd2f8158320 2023-11-30T17:08:16.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.464+0000 7fd2f659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2f8098d10 0x7fd2f81577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:16.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.464+0000 7fd2f659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2f8098d10 0x7fd2f81577b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59500/0 (socket says 172.21.15.49:59500) 2023-11-30T17:08:16.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.464+0000 7fd2f659c700 1 -- 172.21.15.49:0/1959386424 learned_addr learned my addr 172.21.15.49:0/1959386424 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:16.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.464+0000 7fd2f6d9d700 1 --2- 172.21.15.49:0/1959386424 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2f8158320 0x7fd2f814bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:16.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.464+0000 7fd2f5d9b700 1 --2- 172.21.15.49:0/1959386424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2f80c6190 0x7fd2f81685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:16.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.464+0000 7fd2f659c700 1 -- 172.21.15.49:0/1959386424 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2f8158320 msgr2=0x7fd2f814bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:16.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.464+0000 7fd2f659c700 1 --2- 172.21.15.49:0/1959386424 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2f8158320 0x7fd2f814bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:16.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.464+0000 7fd2f659c700 1 -- 172.21.15.49:0/1959386424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2f80c6190 msgr2=0x7fd2f81685c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:16.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.465+0000 7fd2f659c700 1 --2- 172.21.15.49:0/1959386424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2f80c6190 0x7fd2f81685c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:16.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.465+0000 7fd2f659c700 1 -- 172.21.15.49:0/1959386424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e8009a20 con 0x7fd2f8098d10 2023-11-30T17:08:16.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.465+0000 7fd2f659c700 1 --2- 172.21.15.49:0/1959386424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2f8098d10 0x7fd2f81577b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7fd2f000c4a0 tx=0x7fd2f0007af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:16.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.465+0000 7fd2ee7fc700 1 -- 172.21.15.49:0/1959386424 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f00072e0 con 0x7fd2f8098d10 2023-11-30T17:08:16.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.465+0000 7fd2ee7fc700 1 -- 172.21.15.49:0/1959386424 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f0007440 con 0x7fd2f8098d10 2023-11-30T17:08:16.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.465+0000 7fd2fce8c700 1 -- 172.21.15.49:0/1959386424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e00092a0 con 0x7fd2f8098d10 2023-11-30T17:08:16.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.465+0000 7fd2ee7fc700 1 -- 172.21.15.49:0/1959386424 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f00057a0 con 0x7fd2f8098d10 2023-11-30T17:08:16.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.465+0000 7fd2fce8c700 1 -- 172.21.15.49:0/1959386424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2f80b0c50 con 0x7fd2f8098d10 2023-11-30T17:08:16.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.466+0000 7fd2fce8c700 1 -- 172.21.15.49:0/1959386424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2f81553f0 con 0x7fd2f8098d10 2023-11-30T17:08:16.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.466+0000 7fd2ee7fc700 1 -- 172.21.15.49:0/1959386424 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd2f0005bd0 con 0x7fd2f8098d10 2023-11-30T17:08:16.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.467+0000 7fd2ee7fc700 1 --2- 172.21.15.49:0/1959386424 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd2d805f150 0x7fd2d8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:16.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.467+0000 7fd2ee7fc700 1 -- 172.21.15.49:0/1959386424 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd2f0079820 con 0x7fd2f8098d10 2023-11-30T17:08:16.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.467+0000 7fd2f5d9b700 1 --2- 172.21.15.49:0/1959386424 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd2d805f150 0x7fd2d8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:16.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.467+0000 7fd2f5d9b700 1 --2- 172.21.15.49:0/1959386424 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd2d805f150 0x7fd2d8061610 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fd2e0009760 tx=0x7fd2e0016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:16.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.471+0000 7fd2ee7fc700 1 -- 172.21.15.49:0/1959386424 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd2f004aaf0 con 0x7fd2f8098d10 2023-11-30T17:08:16.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.670+0000 7fd2fce8c700 1 -- 172.21.15.49:0/1959386424 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2f8158cc0 con 0x7fd2d805f150 2023-11-30T17:08:16.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.672+0000 7fd2ee7fc700 1 -- 172.21.15.49:0/1959386424 <== mgr.4105 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fd2f8158cc0 con 0x7fd2d805f150 2023-11-30T17:08:16.674 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-11-30T17:08:16.674 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:08:16.674 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cephfs" 2023-11-30T17:08:16.674 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:08:16.674 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-11-30T17:08:16.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.674+0000 7fd2fce8c700 1 -- 172.21.15.49:0/1959386424 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd2d805f150 msgr2=0x7fd2d8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:16.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.674+0000 7fd2fce8c700 1 --2- 172.21.15.49:0/1959386424 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd2d805f150 0x7fd2d8061610 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fd2e0009760 tx=0x7fd2e0016000).stop 2023-11-30T17:08:16.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.674+0000 7fd2fce8c700 1 -- 172.21.15.49:0/1959386424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2f8098d10 msgr2=0x7fd2f81577b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:16.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.674+0000 7fd2fce8c700 1 --2- 172.21.15.49:0/1959386424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2f8098d10 0x7fd2f81577b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7fd2f000c4a0 tx=0x7fd2f0007af0).stop 2023-11-30T17:08:16.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.674+0000 7fd2fce8c700 1 -- 172.21.15.49:0/1959386424 shutdown_connections 2023-11-30T17:08:16.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.674+0000 7fd2fce8c700 1 --2- 172.21.15.49:0/1959386424 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2f8158320 0x7fd2f814bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:16.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.674+0000 7fd2fce8c700 1 --2- 172.21.15.49:0/1959386424 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd2d805f150 0x7fd2d8061610 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:16.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.674+0000 7fd2fce8c700 1 --2- 172.21.15.49:0/1959386424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2f8098d10 0x7fd2f81577b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:16.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.674+0000 7fd2fce8c700 1 --2- 172.21.15.49:0/1959386424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2f80c6190 0x7fd2f81685c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:16.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.674+0000 7fd2fce8c700 1 -- 172.21.15.49:0/1959386424 >> 172.21.15.49:0/1959386424 conn(0x7fd2f80cb310 msgr2=0x7fd2f80ca8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:16.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.674+0000 7fd2fce8c700 1 -- 172.21.15.49:0/1959386424 shutdown_connections 2023-11-30T17:08:16.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.674+0000 7fd2fce8c700 1 -- 172.21.15.49:0/1959386424 wait complete. 2023-11-30T17:08:16.687 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-11-30T17:08:16.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.805+0000 7fb5d8265700 1 Processor -- start 2023-11-30T17:08:16.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.805+0000 7fb5d8265700 1 -- start start 2023-11-30T17:08:16.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.806+0000 7fb5d8265700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb5d0098d10 0x7fb5d00c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:16.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.806+0000 7fb5d8265700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5d0158320 0x7fb5d01587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:16.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.806+0000 7fb5d8265700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d0158cc0 con 0x7fb5d00c6190 2023-11-30T17:08:16.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.806+0000 7fb5d8265700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5d00c72d0 con 0x7fb5d0098d10 2023-11-30T17:08:16.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.806+0000 7fb5d8265700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d0064570 con 0x7fb5d0158320 2023-11-30T17:08:16.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.807+0000 7fb5d5800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb5d00c6190 0x7fb5d0063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35800/0 (socket says 172.21.15.49:35800) 2023-11-30T17:08:16.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.807+0000 7fb5d5800700 1 -- 172.21.15.49:0/794773303 learned_addr learned my addr 172.21.15.49:0/794773303 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:08:16.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.807+0000 7fb5d6001700 1 --2- 172.21.15.49:0/794773303 >> v2:172.21.15.115:3300/0 conn(0x7fb5d0098d10 0x7fb5d00c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:16.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.807+0000 7fb5d6802700 1 --2- 172.21.15.49:0/794773303 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5d0158320 0x7fb5d01587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:16.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.807+0000 7fb5d4fff700 1 -- 172.21.15.49:0/794773303 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1429280360 0 0) 0x7fb5cc001110 con 0x7fb5d00c6190 2023-11-30T17:08:16.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.807+0000 7fb5d4fff700 1 -- 172.21.15.49:0/794773303 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5bc0033f0 con 0x7fb5d00c6190 2023-11-30T17:08:16.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.807+0000 7fb5d6001700 1 -- 172.21.15.49:0/794773303 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5d0158320 msgr2=0x7fb5d01587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:16.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.807+0000 7fb5d6001700 1 --2- 172.21.15.49:0/794773303 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5d0158320 0x7fb5d01587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:16.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.807+0000 7fb5d6001700 1 -- 172.21.15.49:0/794773303 >> v1:172.21.15.49:6789/0 conn(0x7fb5d00c6190 legacy=0x7fb5d0063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:16.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.807+0000 7fb5d6001700 1 -- 172.21.15.49:0/794773303 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d0154bc0 con 0x7fb5d0098d10 2023-11-30T17:08:16.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.807+0000 7fb5d6802700 1 --2- 172.21.15.49:0/794773303 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5d0158320 0x7fb5d01587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:08:16.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.807+0000 7fb5d6001700 1 --2- 172.21.15.49:0/794773303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5d0098d10 0x7fb5d00c7760 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fb5c8009e60 tx=0x7fb5c8009780).ready entity=mon.1 client_cookie=a694bc12433e4b43 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:16.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.807+0000 7fb5d4fff700 1 -- 172.21.15.49:0/794773303 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c800e070 con 0x7fb5d0098d10 2023-11-30T17:08:16.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.807+0000 7fb5d4fff700 1 -- 172.21.15.49:0/794773303 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c800bab0 con 0x7fb5d0098d10 2023-11-30T17:08:16.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.807+0000 7fb5d4fff700 1 -- 172.21.15.49:0/794773303 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c800be30 con 0x7fb5d0098d10 2023-11-30T17:08:16.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.808+0000 7fb5d8265700 1 -- 172.21.15.49:0/794773303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5d0098d10 msgr2=0x7fb5d00c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:16.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.808+0000 7fb5d8265700 1 --2- 172.21.15.49:0/794773303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5d0098d10 0x7fb5d00c7760 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fb5c8009e60 tx=0x7fb5c8009780).stop 2023-11-30T17:08:16.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.808+0000 7fb5d8265700 1 -- 172.21.15.49:0/794773303 shutdown_connections 2023-11-30T17:08:16.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.808+0000 7fb5d8265700 1 --2- 172.21.15.49:0/794773303 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5d0158320 0x7fb5d01587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:16.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.808+0000 7fb5d8265700 1 --2- 172.21.15.49:0/794773303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5d0098d10 0x7fb5d00c7760 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:16.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.808+0000 7fb5d8265700 1 -- 172.21.15.49:0/794773303 >> 172.21.15.49:0/794773303 conn(0x7fb5d00cb310 msgr2=0x7fb5d00cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:16.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.808+0000 7fb5d8265700 1 -- 172.21.15.49:0/794773303 shutdown_connections 2023-11-30T17:08:16.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.808+0000 7fb5d8265700 1 -- 172.21.15.49:0/794773303 wait complete. 2023-11-30T17:08:16.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.809+0000 7fb5d8265700 1 Processor -- start 2023-11-30T17:08:16.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.809+0000 7fb5d8265700 1 -- start start 2023-11-30T17:08:16.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.810+0000 7fb5d8265700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5d0098d10 0x7fb5d0154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:16.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.810+0000 7fb5d8265700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5d00c6190 0x7fb5d00a9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:16.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.810+0000 7fb5d8265700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5d0158320 0x7fb5d014af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:16.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.810+0000 7fb5d8265700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d00ac020 con 0x7fb5d0098d10 2023-11-30T17:08:16.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.810+0000 7fb5d8265700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d00ae2c0 con 0x7fb5d00c6190 2023-11-30T17:08:16.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.810+0000 7fb5d8265700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d00ac630 con 0x7fb5d0158320 2023-11-30T17:08:16.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.810+0000 7fb5d6001700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5d0098d10 0x7fb5d0154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:16.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.810+0000 7fb5d6001700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5d0098d10 0x7fb5d0154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59508/0 (socket says 172.21.15.49:59508) 2023-11-30T17:08:16.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.810+0000 7fb5d6001700 1 -- 172.21.15.49:0/1900260762 learned_addr learned my addr 172.21.15.49:0/1900260762 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:16.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.811+0000 7fb5d6802700 1 --2- 172.21.15.49:0/1900260762 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5d0158320 0x7fb5d014af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:16.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.811+0000 7fb5d6001700 1 -- 172.21.15.49:0/1900260762 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5d0158320 msgr2=0x7fb5d014af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:16.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.811+0000 7fb5d6001700 1 --2- 172.21.15.49:0/1900260762 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5d0158320 0x7fb5d014af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:16.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.811+0000 7fb5d5800700 1 --2- 172.21.15.49:0/1900260762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5d00c6190 0x7fb5d00a9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:16.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.811+0000 7fb5d6001700 1 -- 172.21.15.49:0/1900260762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5d00c6190 msgr2=0x7fb5d00a9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:16.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.811+0000 7fb5d6001700 1 --2- 172.21.15.49:0/1900260762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5d00c6190 0x7fb5d00a9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:16.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.811+0000 7fb5d6001700 1 -- 172.21.15.49:0/1900260762 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c00092a0 con 0x7fb5d0098d10 2023-11-30T17:08:16.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.811+0000 7fb5d6802700 1 --2- 172.21.15.49:0/1900260762 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5d0158320 0x7fb5d014af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:08:16.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.811+0000 7fb5d6001700 1 --2- 172.21.15.49:0/1900260762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5d0098d10 0x7fb5d0154d50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7fb5c8013960 tx=0x7fb5d00a8040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:16.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.811+0000 7fb5c5ffb700 1 -- 172.21.15.49:0/1900260762 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c801d420 con 0x7fb5d0098d10 2023-11-30T17:08:16.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.811+0000 7fb5c5ffb700 1 -- 172.21.15.49:0/1900260762 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c801d580 con 0x7fb5d0098d10 2023-11-30T17:08:16.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.811+0000 7fb5c5ffb700 1 -- 172.21.15.49:0/1900260762 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c801d900 con 0x7fb5d0098d10 2023-11-30T17:08:16.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.811+0000 7fb5d8265700 1 -- 172.21.15.49:0/1900260762 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c8009a20 con 0x7fb5d0098d10 2023-11-30T17:08:16.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.811+0000 7fb5d8265700 1 -- 172.21.15.49:0/1900260762 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d01554a0 con 0x7fb5d0098d10 2023-11-30T17:08:16.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.812+0000 7fb5d8265700 1 -- 172.21.15.49:0/1900260762 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5d006c860 con 0x7fb5d0098d10 2023-11-30T17:08:16.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.812+0000 7fb5c5ffb700 1 -- 172.21.15.49:0/1900260762 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb5c8003040 con 0x7fb5d0098d10 2023-11-30T17:08:16.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.813+0000 7fb5c5ffb700 1 --2- 172.21.15.49:0/1900260762 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb5b405f150 0x7fb5b4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:16.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.813+0000 7fb5c5ffb700 1 -- 172.21.15.49:0/1900260762 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb5c807be50 con 0x7fb5d0098d10 2023-11-30T17:08:16.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.813+0000 7fb5d5800700 1 --2- 172.21.15.49:0/1900260762 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb5b405f150 0x7fb5b4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:16.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.813+0000 7fb5d5800700 1 --2- 172.21.15.49:0/1900260762 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb5b405f150 0x7fb5b4061610 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fb5cc005750 tx=0x7fb5cc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:16.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:16.817+0000 7fb5c5ffb700 1 -- 172.21.15.49:0/1900260762 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb5c804d120 con 0x7fb5d0098d10 2023-11-30T17:08:17.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:17.037+0000 7fb5d8265700 1 -- 172.21.15.49:0/1900260762 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fb5d00c66c0 con 0x7fb5d0098d10 2023-11-30T17:08:17.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:17.918+0000 7fb5c5ffb700 1 -- 172.21.15.49:0/1900260762 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 5) v1 ==== 75463+0+0 (secure 0 0 0) 0x7fb5c8079c20 con 0x7fb5d0098d10 2023-11-30T17:08:17.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:17.920+0000 7fb5c5ffb700 1 -- 172.21.15.49:0/1900260762 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v5) v1 ==== 92+0+0 (secure 0 0 0) 0x7fb5c8043040 con 0x7fb5d0098d10 2023-11-30T17:08:17.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:17.922+0000 7fb5d8265700 1 -- 172.21.15.49:0/1900260762 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb5b405f150 msgr2=0x7fb5b4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:17.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:17.922+0000 7fb5d8265700 1 --2- 172.21.15.49:0/1900260762 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb5b405f150 0x7fb5b4061610 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fb5cc005750 tx=0x7fb5cc009040).stop 2023-11-30T17:08:17.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:17.922+0000 7fb5d8265700 1 -- 172.21.15.49:0/1900260762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5d0098d10 msgr2=0x7fb5d0154d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:17.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:17.922+0000 7fb5d8265700 1 --2- 172.21.15.49:0/1900260762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5d0098d10 0x7fb5d0154d50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7fb5c8013960 tx=0x7fb5d00a8040).stop 2023-11-30T17:08:17.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:17.922+0000 7fb5d8265700 1 -- 172.21.15.49:0/1900260762 shutdown_connections 2023-11-30T17:08:17.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:17.922+0000 7fb5d8265700 1 --2- 172.21.15.49:0/1900260762 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5d0158320 0x7fb5d014af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:17.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:17.922+0000 7fb5d8265700 1 --2- 172.21.15.49:0/1900260762 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb5b405f150 0x7fb5b4061610 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:17.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:17.922+0000 7fb5d8265700 1 --2- 172.21.15.49:0/1900260762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5d0098d10 0x7fb5d0154d50 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:17.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:17.922+0000 7fb5d8265700 1 --2- 172.21.15.49:0/1900260762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5d00c6190 0x7fb5d00a9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:17.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:17.922+0000 7fb5d8265700 1 -- 172.21.15.49:0/1900260762 >> 172.21.15.49:0/1900260762 conn(0x7fb5d00cb310 msgr2=0x7fb5d014c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:17.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:17.922+0000 7fb5d8265700 1 -- 172.21.15.49:0/1900260762 shutdown_connections 2023-11-30T17:08:17.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:17.922+0000 7fb5d8265700 1 -- 172.21.15.49:0/1900260762 wait complete. 2023-11-30T17:08:17.939 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-11-30T17:08:18.058 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:18.056+0000 7f46ac785680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T17:08:18.067 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:08:18.066+0000 7fb582485680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T17:08:18.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.066+0000 7f64d7103700 1 Processor -- start 2023-11-30T17:08:18.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.066+0000 7f64d7103700 1 -- start start 2023-11-30T17:08:18.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.067+0000 7f64d7103700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64d014e530 0x7f64d00c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:18.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.067+0000 7f64d7103700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f64d0154950 0x7f64d014e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:18.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.067+0000 7f64d7103700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64d00c7bc0 con 0x7f64d0158570 2023-11-30T17:08:18.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.067+0000 7f64d7103700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d0155920 con 0x7f64d0154950 2023-11-30T17:08:18.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.067+0000 7f64d7103700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d0154dd0 con 0x7f64d014e530 2023-11-30T17:08:18.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.067+0000 7f64d5900700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f64d0154950 0x7f64d014e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:18.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.067+0000 7f64d6101700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64d014e530 0x7f64d00c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:18.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.067+0000 7f64d6902700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f64d0158570 0x7f64d00aa030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:34630/0 (socket says 172.21.15.49:34630) 2023-11-30T17:08:18.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.067+0000 7f64d6902700 1 -- 172.21.15.49:0/28307742 learned_addr learned my addr 172.21.15.49:0/28307742 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:08:18.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.067+0000 7f64d6101700 1 -- 172.21.15.49:0/28307742 >> v2:172.21.15.115:3300/0 conn(0x7f64d0154950 msgr2=0x7f64d014e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:18.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.067+0000 7f64d6101700 1 --2- 172.21.15.49:0/28307742 >> v2:172.21.15.115:3300/0 conn(0x7f64d0154950 0x7f64d014e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:18.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.067+0000 7f64d6101700 1 -- 172.21.15.49:0/28307742 >> v1:172.21.15.115:6789/0 conn(0x7f64d0158570 legacy=0x7f64d00aa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:18.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.067+0000 7f64d50ff700 1 -- 172.21.15.49:0/28307742 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1662796740 0 0) 0x7f64d00c7bc0 con 0x7f64d0158570 2023-11-30T17:08:18.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.067+0000 7f64d6101700 1 -- 172.21.15.49:0/28307742 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d0155080 con 0x7f64d014e530 2023-11-30T17:08:18.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.067+0000 7f64d5900700 1 --2- 172.21.15.49:0/28307742 >> v2:172.21.15.115:3300/0 conn(0x7f64d0154950 0x7f64d014e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:08:18.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.068+0000 7f64d6101700 1 --2- 172.21.15.49:0/28307742 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64d014e530 0x7f64d00c66f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f64cc009760 tx=0x7f64cc009060).ready entity=mon.2 client_cookie=cab896a18e738f9d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:18.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.068+0000 7f64d50ff700 1 -- 172.21.15.49:0/28307742 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc00f510 con 0x7f64d014e530 2023-11-30T17:08:18.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.068+0000 7f64d50ff700 1 -- 172.21.15.49:0/28307742 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64cc00f670 con 0x7f64d014e530 2023-11-30T17:08:18.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.068+0000 7f64d50ff700 1 -- 172.21.15.49:0/28307742 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc00f9f0 con 0x7f64d014e530 2023-11-30T17:08:18.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.068+0000 7f64d7103700 1 -- 172.21.15.49:0/28307742 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64d014e530 msgr2=0x7f64d00c66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:18.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.068+0000 7f64d7103700 1 --2- 172.21.15.49:0/28307742 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64d014e530 0x7f64d00c66f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f64cc009760 tx=0x7f64cc009060).stop 2023-11-30T17:08:18.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.068+0000 7f64d7103700 1 -- 172.21.15.49:0/28307742 shutdown_connections 2023-11-30T17:08:18.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.069+0000 7f64d7103700 1 --2- 172.21.15.49:0/28307742 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64d014e530 0x7f64d00c66f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:18.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.069+0000 7f64d7103700 1 --2- 172.21.15.49:0/28307742 >> v2:172.21.15.115:3300/0 conn(0x7f64d0154950 0x7f64d014e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:18.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.069+0000 7f64d7103700 1 -- 172.21.15.49:0/28307742 >> 172.21.15.49:0/28307742 conn(0x7f64d0064990 msgr2=0x7f64d0064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:18.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.069+0000 7f64d7103700 1 -- 172.21.15.49:0/28307742 shutdown_connections 2023-11-30T17:08:18.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.069+0000 7f64d7103700 1 -- 172.21.15.49:0/28307742 wait complete. 2023-11-30T17:08:18.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.070+0000 7f64d7103700 1 Processor -- start 2023-11-30T17:08:18.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.070+0000 7f64d7103700 1 -- start start 2023-11-30T17:08:18.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.070+0000 7f64d7103700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64d014e530 0x7f64d00b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:18.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.070+0000 7f64d7103700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64d0154950 0x7f64d01684d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:18.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.070+0000 7f64d7103700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64d0158570 0x7f64d0153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:18.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.070+0000 7f64d7103700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d014d6c0 con 0x7f64d014e530 2023-11-30T17:08:18.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.070+0000 7f64d7103700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d00aede0 con 0x7f64d0154950 2023-11-30T17:08:18.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.070+0000 7f64d7103700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d01689c0 con 0x7f64d0158570 2023-11-30T17:08:18.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.071+0000 7f64d6101700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64d014e530 0x7f64d00b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:18.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.071+0000 7f64d6902700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64d0158570 0x7f64d0153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:18.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.071+0000 7f64d5900700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64d0154950 0x7f64d01684d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:18.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.071+0000 7f64d6101700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64d014e530 0x7f64d00b0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59534/0 (socket says 172.21.15.49:59534) 2023-11-30T17:08:18.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.071+0000 7f64d6902700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64d0158570 0x7f64d0153630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:55164/0 (socket says 172.21.15.49:55164) 2023-11-30T17:08:18.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.071+0000 7f64d5900700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64d0154950 0x7f64d01684d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:59428/0 (socket says 172.21.15.49:59428) 2023-11-30T17:08:18.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.071+0000 7f64d6101700 1 -- 172.21.15.49:0/2106449417 learned_addr learned my addr 172.21.15.49:0/2106449417 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:18.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.071+0000 7f64d6902700 1 -- 172.21.15.49:0/2106449417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64d0154950 msgr2=0x7f64d01684d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:18.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.071+0000 7f64d6902700 1 --2- 172.21.15.49:0/2106449417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64d0154950 0x7f64d01684d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:18.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.071+0000 7f64d6902700 1 -- 172.21.15.49:0/2106449417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64d014e530 msgr2=0x7f64d00b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:18.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.071+0000 7f64d6902700 1 --2- 172.21.15.49:0/2106449417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64d014e530 0x7f64d00b0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:18.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.071+0000 7f64d6902700 1 -- 172.21.15.49:0/2106449417 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c00092a0 con 0x7f64d0158570 2023-11-30T17:08:18.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.071+0000 7f64d6101700 1 --2- 172.21.15.49:0/2106449417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64d014e530 0x7f64d00b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:08:18.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.071+0000 7f64d6902700 1 --2- 172.21.15.49:0/2106449417 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64d0158570 0x7f64d0153630 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f64c800c810 tx=0x7f64c8007f90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:18.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.071+0000 7f64c67fc700 1 -- 172.21.15.49:0/2106449417 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c8005d30 con 0x7f64d0158570 2023-11-30T17:08:18.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.071+0000 7f64c67fc700 1 -- 172.21.15.49:0/2106449417 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c8005e90 con 0x7f64d0158570 2023-11-30T17:08:18.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.071+0000 7f64d7103700 1 -- 172.21.15.49:0/2106449417 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64cc0092a0 con 0x7f64d0158570 2023-11-30T17:08:18.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.071+0000 7f64c67fc700 1 -- 172.21.15.49:0/2106449417 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c8007300 con 0x7f64d0158570 2023-11-30T17:08:18.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.071+0000 7f64d7103700 1 -- 172.21.15.49:0/2106449417 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d00ae4b0 con 0x7f64d0158570 2023-11-30T17:08:18.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.072+0000 7f64d7103700 1 -- 172.21.15.49:0/2106449417 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64d0062ee0 con 0x7f64d0158570 2023-11-30T17:08:18.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.073+0000 7f64c67fc700 1 -- 172.21.15.49:0/2106449417 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f64c80076f0 con 0x7f64d0158570 2023-11-30T17:08:18.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.073+0000 7f64c67fc700 1 --2- 172.21.15.49:0/2106449417 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f64b405f1a0 0x7f64b4061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:18.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.073+0000 7f64c67fc700 1 -- 172.21.15.49:0/2106449417 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f64c8079ae0 con 0x7f64d0158570 2023-11-30T17:08:18.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.073+0000 7f64d6101700 1 -- 172.21.15.49:0/2106449417 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f64b405f1a0 msgr2=0x7f64b4061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:08:18.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.073+0000 7f64d6101700 1 --2- 172.21.15.49:0/2106449417 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f64b405f1a0 0x7f64b4061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:08:18.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.077+0000 7f64c67fc700 1 -- 172.21.15.49:0/2106449417 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f64c804adb0 con 0x7f64d0158570 2023-11-30T17:08:18.122 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:18.119+0000 7f46ac785680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T17:08:18.134 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:08:18.132+0000 7fb582485680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T17:08:18.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.253+0000 7f64d7103700 1 -- 172.21.15.49:0/2106449417 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f64d00aef20 con 0x7f64d0158570 2023-11-30T17:08:18.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.259+0000 7f64c67fc700 1 -- 172.21.15.49:0/2106449417 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v3)=0 v3) v1 ==== 138+0+0 (secure 0 0 0) 0x7f64c80079a0 con 0x7f64d0158570 2023-11-30T17:08:18.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.261+0000 7f64d7103700 1 -- 172.21.15.49:0/2106449417 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f64b405f1a0 msgr2=0x7f64b4061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:08:18.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.261+0000 7f64d7103700 1 --2- 172.21.15.49:0/2106449417 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f64b405f1a0 0x7f64b4061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:08:18.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.261+0000 7f64d7103700 1 -- 172.21.15.49:0/2106449417 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64d0158570 msgr2=0x7f64d0153630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:18.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.261+0000 7f64d7103700 1 --2- 172.21.15.49:0/2106449417 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64d0158570 0x7f64d0153630 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f64c800c810 tx=0x7f64c8007f90).stop 2023-11-30T17:08:18.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.261+0000 7f64d7103700 1 -- 172.21.15.49:0/2106449417 shutdown_connections 2023-11-30T17:08:18.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.261+0000 7f64d7103700 1 --2- 172.21.15.49:0/2106449417 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64d0158570 0x7f64d0153630 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:18.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.261+0000 7f64d7103700 1 --2- 172.21.15.49:0/2106449417 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f64b405f1a0 0x7f64b4061660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:08:18.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.261+0000 7f64d7103700 1 --2- 172.21.15.49:0/2106449417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64d014e530 0x7f64d00b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:18.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.261+0000 7f64d7103700 1 --2- 172.21.15.49:0/2106449417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64d0154950 0x7f64d01684d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:18.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.261+0000 7f64d7103700 1 -- 172.21.15.49:0/2106449417 >> 172.21.15.49:0/2106449417 conn(0x7f64d0064990 msgr2=0x7f64d00aa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:18.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.261+0000 7f64d7103700 1 -- 172.21.15.49:0/2106449417 shutdown_connections 2023-11-30T17:08:18.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.261+0000 7f64d7103700 1 -- 172.21.15.49:0/2106449417 wait complete. 2023-11-30T17:08:18.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:08:18.275 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-11-30T17:08:18.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:08:18.294 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir0) 2023-11-30T17:08:18.351 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir0 1M 2023-11-30T17:08:18.395 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:18.392+0000 7f46ac785680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T17:08:18.425 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:08:18.424+0000 7fb582485680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T17:08:18.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.515+0000 7fbd7f820700 1 Processor -- start 2023-11-30T17:08:18.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.515+0000 7fbd7f820700 1 -- start start 2023-11-30T17:08:18.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.516+0000 7fbd7f820700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd78154910 0x7fbd780a7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:18.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.516+0000 7fbd7f820700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbd780aa220 0x7fbd780aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:18.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.516+0000 7fbd7f820700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd780c6630 con 0x7fbd78154530 2023-11-30T17:08:18.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.516+0000 7fbd7f820700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd780c6390 con 0x7fbd780aa220 2023-11-30T17:08:18.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.516+0000 7fbd7f820700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd780a84e0 con 0x7fbd78154910 2023-11-30T17:08:18.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.516+0000 7fbd7ddbd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbd780aa220 0x7fbd780aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:18.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.516+0000 7fbd7ddbd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbd780aa220 0x7fbd780aa6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59548/0 (socket says 172.21.15.49:59548) 2023-11-30T17:08:18.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.516+0000 7fbd7ddbd700 1 -- 172.21.15.49:0/943151174 learned_addr learned my addr 172.21.15.49:0/943151174 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:18.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.516+0000 7fbd7cdbb700 1 --2- 172.21.15.49:0/943151174 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd78154910 0x7fbd780a7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:18.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.516+0000 7fbd6ffff700 1 -- 172.21.15.49:0/943151174 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4142854718 0 0) 0x7fbd780c6630 con 0x7fbd78154530 2023-11-30T17:08:18.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.516+0000 7fbd7ddbd700 1 -- 172.21.15.49:0/943151174 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd78154910 msgr2=0x7fbd780a7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:18.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.516+0000 7fbd7ddbd700 1 --2- 172.21.15.49:0/943151174 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd78154910 0x7fbd780a7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:18.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.516+0000 7fbd7ddbd700 1 -- 172.21.15.49:0/943151174 >> v1:172.21.15.115:6789/0 conn(0x7fbd78154530 legacy=0x7fbd780c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:18.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.516+0000 7fbd7ddbd700 1 -- 172.21.15.49:0/943151174 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd780aaba0 con 0x7fbd780aa220 2023-11-30T17:08:18.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.516+0000 7fbd7ddbd700 1 --2- 172.21.15.49:0/943151174 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd780aa220 0x7fbd780aa6b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7fbd70009f20 tx=0x7fbd70009840).ready entity=mon.0 client_cookie=f175a98d01c9f392 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:18.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.517+0000 7fbd6ffff700 1 -- 172.21.15.49:0/943151174 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7000e070 con 0x7fbd780aa220 2023-11-30T17:08:18.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.517+0000 7fbd6ffff700 1 -- 172.21.15.49:0/943151174 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd7000b9d0 con 0x7fbd780aa220 2023-11-30T17:08:18.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.517+0000 7fbd6ffff700 1 -- 172.21.15.49:0/943151174 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7000bd50 con 0x7fbd780aa220 2023-11-30T17:08:18.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.517+0000 7fbd7f820700 1 -- 172.21.15.49:0/943151174 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd780aa220 msgr2=0x7fbd780aa6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:18.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.517+0000 7fbd7f820700 1 --2- 172.21.15.49:0/943151174 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd780aa220 0x7fbd780aa6b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7fbd70009f20 tx=0x7fbd70009840).stop 2023-11-30T17:08:18.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.517+0000 7fbd7f820700 1 -- 172.21.15.49:0/943151174 shutdown_connections 2023-11-30T17:08:18.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.517+0000 7fbd7f820700 1 --2- 172.21.15.49:0/943151174 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd780aa220 0x7fbd780aa6b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:18.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.517+0000 7fbd7f820700 1 --2- 172.21.15.49:0/943151174 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd78154910 0x7fbd780a7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:18.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.517+0000 7fbd7f820700 1 -- 172.21.15.49:0/943151174 >> 172.21.15.49:0/943151174 conn(0x7fbd78094930 msgr2=0x7fbd7806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:18.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.517+0000 7fbd7f820700 1 -- 172.21.15.49:0/943151174 shutdown_connections 2023-11-30T17:08:18.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.517+0000 7fbd7f820700 1 -- 172.21.15.49:0/943151174 wait complete. 2023-11-30T17:08:18.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.519+0000 7fbd7f820700 1 Processor -- start 2023-11-30T17:08:18.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.519+0000 7fbd7f820700 1 -- start start 2023-11-30T17:08:18.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.520+0000 7fbd7f820700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd780aa220 0x7fbd7814dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:18.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.520+0000 7fbd7f820700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd78154530 0x7fbd78147570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:18.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.520+0000 7fbd7f820700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd78154910 0x7fbd780a8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:18.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.520+0000 7fbd7f820700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd78151c90 con 0x7fbd780aa220 2023-11-30T17:08:18.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.520+0000 7fbd7f820700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd78148490 con 0x7fbd78154910 2023-11-30T17:08:18.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.520+0000 7fbd7f820700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd78147a60 con 0x7fbd78154530 2023-11-30T17:08:18.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.520+0000 7fbd7d5bc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd780aa220 0x7fbd7814dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:18.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.520+0000 7fbd7d5bc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd780aa220 0x7fbd7814dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59566/0 (socket says 172.21.15.49:59566) 2023-11-30T17:08:18.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.520+0000 7fbd7d5bc700 1 -- 172.21.15.49:0/1999022169 learned_addr learned my addr 172.21.15.49:0/1999022169 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:18.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.520+0000 7fbd7cdbb700 1 --2- 172.21.15.49:0/1999022169 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd78154530 0x7fbd78147570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:18.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.520+0000 7fbd7ddbd700 1 --2- 172.21.15.49:0/1999022169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd78154910 0x7fbd780a8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:18.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.520+0000 7fbd7ddbd700 1 -- 172.21.15.49:0/1999022169 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd78154530 msgr2=0x7fbd78147570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:18.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.520+0000 7fbd7ddbd700 1 --2- 172.21.15.49:0/1999022169 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd78154530 0x7fbd78147570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:18.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.520+0000 7fbd7ddbd700 1 -- 172.21.15.49:0/1999022169 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd780aa220 msgr2=0x7fbd7814dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:18.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.520+0000 7fbd7ddbd700 1 --2- 172.21.15.49:0/1999022169 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd780aa220 0x7fbd7814dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:18.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.520+0000 7fbd7ddbd700 1 -- 172.21.15.49:0/1999022169 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd70009ae0 con 0x7fbd78154910 2023-11-30T17:08:18.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.520+0000 7fbd7cdbb700 1 --2- 172.21.15.49:0/1999022169 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd78154530 0x7fbd78147570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:08:18.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.520+0000 7fbd7d5bc700 1 --2- 172.21.15.49:0/1999022169 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd780aa220 0x7fbd7814dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:08:18.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.520+0000 7fbd7ddbd700 1 --2- 172.21.15.49:0/1999022169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd78154910 0x7fbd780a8e90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fbd70013000 tx=0x7fbd70009840).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:18.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.520+0000 7fbd6d7fa700 1 -- 172.21.15.49:0/1999022169 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7000b640 con 0x7fbd78154910 2023-11-30T17:08:18.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.520+0000 7fbd6d7fa700 1 -- 172.21.15.49:0/1999022169 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd70009500 con 0x7fbd78154910 2023-11-30T17:08:18.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.520+0000 7fbd7f820700 1 -- 172.21.15.49:0/1999022169 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd78151ef0 con 0x7fbd78154910 2023-11-30T17:08:18.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.520+0000 7fbd6d7fa700 1 -- 172.21.15.49:0/1999022169 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7001d620 con 0x7fbd78154910 2023-11-30T17:08:18.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.521+0000 7fbd7f820700 1 -- 172.21.15.49:0/1999022169 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd781524b0 con 0x7fbd78154910 2023-11-30T17:08:18.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.521+0000 7fbd7f820700 1 -- 172.21.15.49:0/1999022169 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd7806c860 con 0x7fbd78154910 2023-11-30T17:08:18.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.522+0000 7fbd6d7fa700 1 -- 172.21.15.49:0/1999022169 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 75463+0+0 (secure 0 0 0) 0x7fbd7001da50 con 0x7fbd78154910 2023-11-30T17:08:18.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.522+0000 7fbd6d7fa700 1 --2- 172.21.15.49:0/1999022169 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbd5c05f1a0 0x7fbd5c061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:18.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.522+0000 7fbd7d5bc700 1 -- 172.21.15.49:0/1999022169 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbd5c05f1a0 msgr2=0x7fbd5c061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:08:18.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.522+0000 7fbd6d7fa700 1 -- 172.21.15.49:0/1999022169 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbd7007bbd0 con 0x7fbd78154910 2023-11-30T17:08:18.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.522+0000 7fbd7d5bc700 1 --2- 172.21.15.49:0/1999022169 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbd5c05f1a0 0x7fbd5c061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:08:18.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.527+0000 7fbd6d7fa700 1 -- 172.21.15.49:0/1999022169 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbd7004cea0 con 0x7fbd78154910 2023-11-30T17:08:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.723+0000 7fbd7d5bc700 1 -- 172.21.15.49:0/1999022169 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbd5c05f1a0 msgr2=0x7fbd5c061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:08:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.723+0000 7fbd7d5bc700 1 --2- 172.21.15.49:0/1999022169 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbd5c05f1a0 0x7fbd5c061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:08:18.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:18.727+0000 7fbd7f820700 1 -- 172.21.15.49:0/1999022169 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd78064230 con 0x7fbd5c05f1a0 2023-11-30T17:08:19.003 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:19.001+0000 7f46ac785680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T17:08:19.075 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:19.073+0000 7f46ac785680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T17:08:19.093 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:08:19.092+0000 7fb582485680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T17:08:19.106 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:08:19.108 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:08:19.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:19.124+0000 7fbd7d5bc700 1 -- 172.21.15.49:0/1999022169 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbd5c05f1a0 msgr2=0x7fbd5c061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:08:19.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:19.124+0000 7fbd7d5bc700 1 --2- 172.21.15.49:0/1999022169 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbd5c05f1a0 0x7fbd5c061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-11-30T17:08:19.162 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:08:19.161+0000 7fb582485680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T17:08:19.263 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:19.261+0000 7f46ac785680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T17:08:19.355 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:08:19.354+0000 7fb582485680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T17:08:19.679 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:19.677+0000 7f46ac785680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T17:08:19.781 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:19.779+0000 7f46ac785680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:08:19.792 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:08:19.790+0000 7fb582485680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T17:08:19.900 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:08:19.899+0000 7fb582485680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:08:19.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:19.925+0000 7fbd7d5bc700 1 -- 172.21.15.49:0/1999022169 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbd5c05f1a0 msgr2=0x7fbd5c061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:08:19.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:19.925+0000 7fbd7d5bc700 1 --2- 172.21.15.49:0/1999022169 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbd5c05f1a0 0x7fbd5c061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-11-30T17:08:19.932 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:19.929+0000 7f46ac785680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T17:08:20.006 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:20.004+0000 7f46ac785680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T17:08:20.058 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:08:20.056+0000 7fb582485680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T17:08:20.073 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:20.070+0000 7f46ac785680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T17:08:20.135 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:08:20.134+0000 7fb582485680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T17:08:20.205 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:08:20.204+0000 7fb582485680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T17:08:20.329 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:20.327+0000 7f46ac785680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T17:08:20.477 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:08:20.475+0000 7fb582485680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T17:08:20.508 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:20.506+0000 7f46ac785680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T17:08:20.665 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:08:20.664+0000 7fb582485680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T17:08:21.157 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:21.154+0000 7f46ac785680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T17:08:21.224 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:21.222+0000 7f46ac785680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T17:08:21.301 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:21.299+0000 7f46ac785680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T17:08:21.351 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:08:21.350+0000 7fb582485680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T17:08:21.423 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:08:21.421+0000 7fb582485680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T17:08:21.446 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:21.444+0000 7f46ac785680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T17:08:21.500 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:08:21.498+0000 7fb582485680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T17:08:21.515 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:21.513+0000 7f46ac785680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T17:08:21.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:21.526+0000 7fbd7d5bc700 1 -- 172.21.15.49:0/1999022169 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbd5c05f1a0 msgr2=0x7fbd5c061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:08:21.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:21.526+0000 7fbd7d5bc700 1 --2- 172.21.15.49:0/1999022169 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbd5c05f1a0 0x7fbd5c061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-11-30T17:08:21.629 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:21.627+0000 7f46ac785680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T17:08:21.651 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:08:21.649+0000 7fb582485680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T17:08:21.724 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:08:21.722+0000 7fb582485680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T17:08:21.735 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:21.733+0000 7f46ac785680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:08:21.844 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:08:21.842+0000 7fb582485680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T17:08:21.956 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:08:21.954+0000 7fb582485680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:08:22.023 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:22.020+0000 7f46ac785680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T17:08:22.092 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:22.090+0000 7f46ac785680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T17:08:22.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:22.110+0000 7fbd6d7fa700 1 -- 172.21.15.49:0/1999022169 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mgrmap(e 6) v1 ==== 75287+0+0 (secure 0 0 0) 0x7fbd700799a0 con 0x7fbd78154910 2023-11-30T17:08:22.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:22.110+0000 7fbd6d7fa700 1 -- 172.21.15.49:0/1999022169 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbd5c05f1a0 msgr2=0x7fbd5c061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:08:22.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:22.110+0000 7fbd6d7fa700 1 --2- 172.21.15.49:0/1999022169 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbd5c05f1a0 0x7fbd5c061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:08:22.174 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:22.171+0000 7f462070a700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:08:22.174 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:22.171+0000 7f462070a700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:08:22.174 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:22.171+0000 7f462070a700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:08:22.174 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:22.171+0000 7f462070a700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:08:22.174 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:22.171+0000 7f462070a700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:08:22.174 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:22.171+0000 7f4623710700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:08:22.174 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:22.171+0000 7f4623710700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:08:22.174 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:22.171+0000 7f4623710700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:08:22.174 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:22.171+0000 7f4623710700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:08:22.175 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:08:22.171+0000 7f4623710700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:08:22.263 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:08:22.260+0000 7fb582485680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T17:08:22.336 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:08:22.334+0000 7fb582485680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T17:08:23.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.117+0000 7fbd6d7fa700 1 -- 172.21.15.49:0/1999022169 <== mon.1 v2:172.21.15.115:3300/0 8 ==== mgrmap(e 7) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fbd70079d20 con 0x7fbd78154910 2023-11-30T17:08:23.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.118+0000 7fbd6d7fa700 1 --2- 172.21.15.49:0/1999022169 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbd5c05f1a0 0x7fbd5c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:23.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.118+0000 7fbd6d7fa700 1 -- 172.21.15.49:0/1999022169 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd78064230 con 0x7fbd5c05f1a0 2023-11-30T17:08:23.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.118+0000 7fbd7d5bc700 1 --2- 172.21.15.49:0/1999022169 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbd5c05f1a0 0x7fbd5c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:23.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.118+0000 7fbd7d5bc700 1 --2- 172.21.15.49:0/1999022169 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbd5c05f1a0 0x7fbd5c0615e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fbd68007ed0 tx=0x7fbd68009040).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:23.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.141+0000 7fbd6d7fa700 1 -- 172.21.15.49:0/1999022169 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fbd78064230 con 0x7fbd5c05f1a0 2023-11-30T17:08:23.144 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule set for path /snap_test_dir1/dir0 2023-11-30T17:08:23.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.143+0000 7fbd7f820700 1 -- 172.21.15.49:0/1999022169 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbd5c05f1a0 msgr2=0x7fbd5c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:23.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.143+0000 7fbd7f820700 1 --2- 172.21.15.49:0/1999022169 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbd5c05f1a0 0x7fbd5c0615e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fbd68007ed0 tx=0x7fbd68009040).stop 2023-11-30T17:08:23.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.143+0000 7fbd7f820700 1 -- 172.21.15.49:0/1999022169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd78154910 msgr2=0x7fbd780a8e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:23.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.143+0000 7fbd7f820700 1 --2- 172.21.15.49:0/1999022169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd78154910 0x7fbd780a8e90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fbd70013000 tx=0x7fbd70009840).stop 2023-11-30T17:08:23.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.143+0000 7fbd7f820700 1 -- 172.21.15.49:0/1999022169 shutdown_connections 2023-11-30T17:08:23.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.143+0000 7fbd7f820700 1 --2- 172.21.15.49:0/1999022169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd78154910 0x7fbd780a8e90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:23.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.143+0000 7fbd7f820700 1 --2- 172.21.15.49:0/1999022169 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbd5c05f1a0 0x7fbd5c0615e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:23.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.143+0000 7fbd7f820700 1 --2- 172.21.15.49:0/1999022169 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd780aa220 0x7fbd7814dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:23.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.143+0000 7fbd7f820700 1 --2- 172.21.15.49:0/1999022169 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd78154530 0x7fbd78147570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:23.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.143+0000 7fbd7f820700 1 -- 172.21.15.49:0/1999022169 >> 172.21.15.49:0/1999022169 conn(0x7fbd78094930 msgr2=0x7fbd780ca9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:23.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.143+0000 7fbd7f820700 1 -- 172.21.15.49:0/1999022169 shutdown_connections 2023-11-30T17:08:23.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.143+0000 7fbd7f820700 1 -- 172.21.15.49:0/1999022169 wait complete. 2023-11-30T17:08:23.161 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir0 2023-11-30T17:08:23.162 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:08:23.162 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir1) 2023-11-30T17:08:23.181 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir1 1M 2023-11-30T17:08:23.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.343+0000 7f116f79d700 1 Processor -- start 2023-11-30T17:08:23.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.343+0000 7f116f79d700 1 -- start start 2023-11-30T17:08:23.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.344+0000 7f116f79d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1168154530 0x7f1168154910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:23.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.344+0000 7f116f79d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f11680a7ff0 0x7f11680c8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:23.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.344+0000 7f116f79d700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11680c6630 con 0x7f11680aa220 2023-11-30T17:08:23.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.344+0000 7f116f79d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11680c6390 con 0x7f11680a7ff0 2023-11-30T17:08:23.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.344+0000 7f116f79d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11680a8470 con 0x7f1168154530 2023-11-30T17:08:23.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.344+0000 7f116dd3a700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f11680aa220 0x7f11680c6ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48976/0 (socket says 172.21.15.49:48976) 2023-11-30T17:08:23.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.344+0000 7f116dd3a700 1 -- 172.21.15.49:0/4161660842 learned_addr learned my addr 172.21.15.49:0/4161660842 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:08:23.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.344+0000 7f116cd38700 1 --2- 172.21.15.49:0/4161660842 >> v2:172.21.15.115:3300/0 conn(0x7f11680a7ff0 0x7f11680c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:23.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.344+0000 7f116d539700 1 --2- 172.21.15.49:0/4161660842 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1168154530 0x7f1168154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:23.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.344+0000 7f115ffff700 1 -- 172.21.15.49:0/4161660842 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1003613882 0 0) 0x7f11680c6630 con 0x7f11680aa220 2023-11-30T17:08:23.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.344+0000 7f115ffff700 1 -- 172.21.15.49:0/4161660842 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11540033f0 con 0x7f11680aa220 2023-11-30T17:08:23.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.344+0000 7f115ffff700 1 -- 172.21.15.49:0/4161660842 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2196740296 0 0) 0x7f11540033f0 con 0x7f11680aa220 2023-11-30T17:08:23.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.344+0000 7f115ffff700 1 -- 172.21.15.49:0/4161660842 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1168154530 msgr2=0x7f1168154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:23.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.344+0000 7f115ffff700 1 --2- 172.21.15.49:0/4161660842 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1168154530 0x7f1168154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:23.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.345+0000 7f115ffff700 1 -- 172.21.15.49:0/4161660842 >> v2:172.21.15.115:3300/0 conn(0x7f11680a7ff0 msgr2=0x7f11680c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:23.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.345+0000 7f115ffff700 1 --2- 172.21.15.49:0/4161660842 >> v2:172.21.15.115:3300/0 conn(0x7f11680a7ff0 0x7f11680c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:23.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.345+0000 7f115ffff700 1 -- 172.21.15.49:0/4161660842 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1168064230 con 0x7f11680aa220 2023-11-30T17:08:23.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.345+0000 7f115ffff700 1 -- 172.21.15.49:0/4161660842 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f11600017f0 con 0x7f11680aa220 2023-11-30T17:08:23.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.345+0000 7f116cd38700 1 --2- 172.21.15.49:0/4161660842 >> v2:172.21.15.115:3300/0 conn(0x7f11680a7ff0 0x7f11680c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:08:23.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.345+0000 7f115ffff700 1 -- 172.21.15.49:0/4161660842 >> v1:172.21.15.49:6789/0 conn(0x7f11680aa220 legacy=0x7f11680c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:23.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.345+0000 7f115ffff700 1 --2- 172.21.15.49:0/4161660842 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11540038e0 0x7f1154003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:23.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.345+0000 7f115ffff700 1 --2- 172.21.15.49:0/4161660842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1154004690 0x7f1154004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:23.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.345+0000 7f115ffff700 1 --2- 172.21.15.49:0/4161660842 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1168154530 0x7f1154005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:23.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.345+0000 7f115ffff700 1 -- 172.21.15.49:0/4161660842 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11680c6390 con 0x7f11540038e0 2023-11-30T17:08:23.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.345+0000 7f115ffff700 1 -- 172.21.15.49:0/4161660842 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11680a8470 con 0x7f1154004690 2023-11-30T17:08:23.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.345+0000 7f115ffff700 1 -- 172.21.15.49:0/4161660842 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f115400b8e0 con 0x7f1168154530 2023-11-30T17:08:23.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.345+0000 7f116d539700 1 --2- 172.21.15.49:0/4161660842 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11540038e0 0x7f1154003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:23.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.345+0000 7f116cd38700 1 --2- 172.21.15.49:0/4161660842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1154004690 0x7f1154004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:23.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.345+0000 7f116dd3a700 1 --2- 172.21.15.49:0/4161660842 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1168154530 0x7f1154005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:23.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.345+0000 7f116d539700 1 -- 172.21.15.49:0/4161660842 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1168154530 msgr2=0x7f1154005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:23.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.345+0000 7f116d539700 1 --2- 172.21.15.49:0/4161660842 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1168154530 0x7f1154005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:23.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.345+0000 7f116d539700 1 -- 172.21.15.49:0/4161660842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1154004690 msgr2=0x7f1154004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:23.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.345+0000 7f116d539700 1 --2- 172.21.15.49:0/4161660842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1154004690 0x7f1154004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:23.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.345+0000 7f116d539700 1 -- 172.21.15.49:0/4161660842 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11540033f0 con 0x7f11540038e0 2023-11-30T17:08:23.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.345+0000 7f116d539700 1 --2- 172.21.15.49:0/4161660842 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11540038e0 0x7f1154003d00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f1164006fd0 tx=0x7f1164006f40).ready entity=mon.0 client_cookie=4390cb1b1fcad2b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:23.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.345+0000 7f115ffff700 1 -- 172.21.15.49:0/4161660842 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1164009430 con 0x7f11540038e0 2023-11-30T17:08:23.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.345+0000 7f115ffff700 1 -- 172.21.15.49:0/4161660842 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116400e640 con 0x7f11540038e0 2023-11-30T17:08:23.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.345+0000 7f115ffff700 1 -- 172.21.15.49:0/4161660842 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116400e9c0 con 0x7f11540038e0 2023-11-30T17:08:23.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.346+0000 7f116f79d700 1 -- 172.21.15.49:0/4161660842 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11540038e0 msgr2=0x7f1154003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:23.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.346+0000 7f116f79d700 1 --2- 172.21.15.49:0/4161660842 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11540038e0 0x7f1154003d00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f1164006fd0 tx=0x7f1164006f40).stop 2023-11-30T17:08:23.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.346+0000 7f116dd3a700 1 -- 172.21.15.49:0/4161660842 reap_dead start 2023-11-30T17:08:23.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.346+0000 7f116f79d700 1 -- 172.21.15.49:0/4161660842 shutdown_connections 2023-11-30T17:08:23.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.346+0000 7f116f79d700 1 -- 172.21.15.49:0/4161660842 >> 172.21.15.49:0/4161660842 conn(0x7f1168094930 msgr2=0x7f116806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:23.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.346+0000 7f116f79d700 1 -- 172.21.15.49:0/4161660842 shutdown_connections 2023-11-30T17:08:23.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.346+0000 7f116f79d700 1 -- 172.21.15.49:0/4161660842 wait complete. 2023-11-30T17:08:23.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.347+0000 7f116f79d700 1 Processor -- start 2023-11-30T17:08:23.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.347+0000 7f116f79d700 1 -- start start 2023-11-30T17:08:23.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.348+0000 7f116f79d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11680afae0 0x7f11680c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:23.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.348+0000 7f116f79d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11680aec00 0x7f11680c2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:23.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.348+0000 7f116f79d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11680c2810 0x7f11680accf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:23.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.348+0000 7f116f79d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11680c51a0 con 0x7f11680afae0 2023-11-30T17:08:23.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.348+0000 7f116f79d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11680abfe0 con 0x7f11680c2810 2023-11-30T17:08:23.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.348+0000 7f116f79d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11681526b0 con 0x7f11680aec00 2023-11-30T17:08:23.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.348+0000 7f116d539700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11680afae0 0x7f11680c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:23.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.348+0000 7f116d539700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11680afae0 0x7f11680c4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46006/0 (socket says 172.21.15.49:46006) 2023-11-30T17:08:23.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.348+0000 7f116d539700 1 -- 172.21.15.49:0/2258687735 learned_addr learned my addr 172.21.15.49:0/2258687735 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:23.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.348+0000 7f116cd38700 1 --2- 172.21.15.49:0/2258687735 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11680aec00 0x7f11680c2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:23.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.348+0000 7f116dd3a700 1 --2- 172.21.15.49:0/2258687735 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11680c2810 0x7f11680accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:23.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.349+0000 7f116d539700 1 -- 172.21.15.49:0/2258687735 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11680aec00 msgr2=0x7f11680c2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:23.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.349+0000 7f116d539700 1 --2- 172.21.15.49:0/2258687735 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11680aec00 0x7f11680c2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:23.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.349+0000 7f116d539700 1 -- 172.21.15.49:0/2258687735 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11680c2810 msgr2=0x7f11680accf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:23.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.349+0000 7f116d539700 1 --2- 172.21.15.49:0/2258687735 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11680c2810 0x7f11680accf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:23.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.349+0000 7f116d539700 1 -- 172.21.15.49:0/2258687735 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11680af620 con 0x7f11680afae0 2023-11-30T17:08:23.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.349+0000 7f116d539700 1 --2- 172.21.15.49:0/2258687735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11680afae0 0x7f11680c4cb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f1154004480 tx=0x7f116401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:23.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.349+0000 7f115d7fa700 1 -- 172.21.15.49:0/2258687735 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1164009430 con 0x7f11680afae0 2023-11-30T17:08:23.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.349+0000 7f115d7fa700 1 -- 172.21.15.49:0/2258687735 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116400ed30 con 0x7f11680afae0 2023-11-30T17:08:23.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.349+0000 7f116f79d700 1 -- 172.21.15.49:0/2258687735 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11680af080 con 0x7f11680afae0 2023-11-30T17:08:23.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.349+0000 7f115d7fa700 1 -- 172.21.15.49:0/2258687735 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116400eea0 con 0x7f11680afae0 2023-11-30T17:08:23.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.349+0000 7f116f79d700 1 -- 172.21.15.49:0/2258687735 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11680ac210 con 0x7f11680afae0 2023-11-30T17:08:23.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.350+0000 7f116f79d700 1 -- 172.21.15.49:0/2258687735 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11680acb40 con 0x7f11680afae0 2023-11-30T17:08:23.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.350+0000 7f115d7fa700 1 -- 172.21.15.49:0/2258687735 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 7) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f116402f440 con 0x7f11680afae0 2023-11-30T17:08:23.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.351+0000 7f115d7fa700 1 --2- 172.21.15.49:0/2258687735 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f114c05f080 0x7f114c061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:23.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.351+0000 7f115d7fa700 1 -- 172.21.15.49:0/2258687735 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f116407bcc0 con 0x7f11680afae0 2023-11-30T17:08:23.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.351+0000 7f116cd38700 1 --2- 172.21.15.49:0/2258687735 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f114c05f080 0x7f114c061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:23.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.351+0000 7f116cd38700 1 --2- 172.21.15.49:0/2258687735 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f114c05f080 0x7f114c061540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f11680c4340 tx=0x7f1158009060).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:23.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.355+0000 7f115d7fa700 1 -- 172.21.15.49:0/2258687735 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f116404d050 con 0x7f11680afae0 2023-11-30T17:08:23.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.552+0000 7f116f79d700 1 -- 172.21.15.49:0/2258687735 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f116806c860 con 0x7f114c05f080 2023-11-30T17:08:23.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.557+0000 7f115d7fa700 1 -- 172.21.15.49:0/2258687735 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f116806c860 con 0x7f114c05f080 2023-11-30T17:08:23.560 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule set for path /snap_test_dir1/dir1 2023-11-30T17:08:23.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.559+0000 7f116f79d700 1 -- 172.21.15.49:0/2258687735 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f114c05f080 msgr2=0x7f114c061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:23.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.559+0000 7f116f79d700 1 --2- 172.21.15.49:0/2258687735 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f114c05f080 0x7f114c061540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f11680c4340 tx=0x7f1158009060).stop 2023-11-30T17:08:23.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.559+0000 7f116f79d700 1 -- 172.21.15.49:0/2258687735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11680afae0 msgr2=0x7f11680c4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:23.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.559+0000 7f116f79d700 1 --2- 172.21.15.49:0/2258687735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11680afae0 0x7f11680c4cb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f1154004480 tx=0x7f116401a000).stop 2023-11-30T17:08:23.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.559+0000 7f116f79d700 1 -- 172.21.15.49:0/2258687735 shutdown_connections 2023-11-30T17:08:23.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.559+0000 7f116f79d700 1 --2- 172.21.15.49:0/2258687735 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11680c2810 0x7f11680accf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:23.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.559+0000 7f116f79d700 1 --2- 172.21.15.49:0/2258687735 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f114c05f080 0x7f114c061540 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:23.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.559+0000 7f116f79d700 1 --2- 172.21.15.49:0/2258687735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11680afae0 0x7f11680c4cb0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:23.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.559+0000 7f116f79d700 1 --2- 172.21.15.49:0/2258687735 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11680aec00 0x7f11680c2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:23.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.559+0000 7f116f79d700 1 -- 172.21.15.49:0/2258687735 >> 172.21.15.49:0/2258687735 conn(0x7f1168094930 msgr2=0x7f11680a85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:23.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.559+0000 7f116f79d700 1 -- 172.21.15.49:0/2258687735 shutdown_connections 2023-11-30T17:08:23.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.559+0000 7f116f79d700 1 -- 172.21.15.49:0/2258687735 wait complete. 2023-11-30T17:08:23.574 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir1 2023-11-30T17:08:23.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:08:23.574 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir2) 2023-11-30T17:08:23.591 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir2 1M 2023-11-30T17:08:23.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.751+0000 7f1146825700 1 Processor -- start 2023-11-30T17:08:23.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.751+0000 7f1146825700 1 -- start start 2023-11-30T17:08:23.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.752+0000 7f1146825700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f11400aa930 0x7f11400a7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:23.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.752+0000 7f1146825700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11400c6630 con 0x7f1140154910 2023-11-30T17:08:23.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.752+0000 7f1146825700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1140064230 con 0x7f1140154530 2023-11-30T17:08:23.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.752+0000 7f1146825700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11400c6390 con 0x7f11400aa930 2023-11-30T17:08:23.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.752+0000 7f113f7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1140154910 0x7f11400aa220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48992/0 (socket says 172.21.15.49:48992) 2023-11-30T17:08:23.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.752+0000 7f113f7fe700 1 -- 172.21.15.49:0/2638654347 learned_addr learned my addr 172.21.15.49:0/2638654347 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:08:23.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.753+0000 7f113effd700 1 -- 172.21.15.49:0/2638654347 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 542606313 0 0) 0x7f11400c6630 con 0x7f1140154910 2023-11-30T17:08:23.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.753+0000 7f1144dc2700 1 --2- 172.21.15.49:0/2638654347 >> v2:172.21.15.115:3300/0 conn(0x7f11400aa930 0x7f11400a7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:23.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.753+0000 7f113effd700 1 -- 172.21.15.49:0/2638654347 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f112c0033f0 con 0x7f1140154910 2023-11-30T17:08:23.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.753+0000 7f113effd700 1 -- 172.21.15.49:0/2638654347 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3325823636 0 0) 0x7f112c0033f0 con 0x7f1140154910 2023-11-30T17:08:23.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.753+0000 7f113effd700 1 -- 172.21.15.49:0/2638654347 >> v2:172.21.15.115:3300/0 conn(0x7f11400aa930 msgr2=0x7f11400a7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:23.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.753+0000 7f113effd700 1 --2- 172.21.15.49:0/2638654347 >> v2:172.21.15.115:3300/0 conn(0x7f11400aa930 0x7f11400a7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:23.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.753+0000 7f113effd700 1 -- 172.21.15.49:0/2638654347 >> v1:172.21.15.115:6789/0 conn(0x7f1140154530 legacy=0x7f11400c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:23.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.753+0000 7f113effd700 1 -- 172.21.15.49:0/2638654347 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1140064510 con 0x7f1140154910 2023-11-30T17:08:23.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.753+0000 7f113effd700 1 -- 172.21.15.49:0/2638654347 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f1130001470 con 0x7f1140154910 2023-11-30T17:08:23.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.753+0000 7f113effd700 1 -- 172.21.15.49:0/2638654347 >> v1:172.21.15.49:6789/0 conn(0x7f1140154910 legacy=0x7f11400aa220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:23.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.753+0000 7f113effd700 1 --2- 172.21.15.49:0/2638654347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f112c0038e0 0x7f112c003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:23.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.753+0000 7f113effd700 1 --2- 172.21.15.49:0/2638654347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f112c004690 0x7f112c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:23.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.753+0000 7f113effd700 1 --2- 172.21.15.49:0/2638654347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f112c005000 0x7f112c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:23.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.753+0000 7f113effd700 1 -- 172.21.15.49:0/2638654347 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11400c6390 con 0x7f112c004690 2023-11-30T17:08:23.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.753+0000 7f113effd700 1 -- 172.21.15.49:0/2638654347 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112c00beb0 con 0x7f112c0038e0 2023-11-30T17:08:23.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.753+0000 7f113effd700 1 -- 172.21.15.49:0/2638654347 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112c00c070 con 0x7f112c005000 2023-11-30T17:08:23.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.753+0000 7f113f7fe700 1 --2- 172.21.15.49:0/2638654347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f112c004690 0x7f112c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:23.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.753+0000 7f113ffff700 1 --2- 172.21.15.49:0/2638654347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f112c0038e0 0x7f112c003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:23.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.753+0000 7f1144dc2700 1 --2- 172.21.15.49:0/2638654347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f112c005000 0x7f112c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:23.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.753+0000 7f113f7fe700 1 -- 172.21.15.49:0/2638654347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f112c005000 msgr2=0x7f112c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:23.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.753+0000 7f113f7fe700 1 --2- 172.21.15.49:0/2638654347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f112c005000 0x7f112c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:23.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.753+0000 7f113f7fe700 1 -- 172.21.15.49:0/2638654347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f112c0038e0 msgr2=0x7f112c003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:23.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.753+0000 7f113f7fe700 1 --2- 172.21.15.49:0/2638654347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f112c0038e0 0x7f112c003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:23.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.754+0000 7f113f7fe700 1 -- 172.21.15.49:0/2638654347 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112c0033f0 con 0x7f112c004690 2023-11-30T17:08:23.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.754+0000 7f1144dc2700 1 -- 172.21.15.49:0/2638654347 reap_dead start 2023-11-30T17:08:23.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.754+0000 7f113f7fe700 1 --2- 172.21.15.49:0/2638654347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f112c004690 0x7f112c004b10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f113000c190 tx=0x7f1130001e70).ready entity=mon.0 client_cookie=18b3a9da93da43a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:23.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.754+0000 7f113effd700 1 -- 172.21.15.49:0/2638654347 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130007a40 con 0x7f112c004690 2023-11-30T17:08:23.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.754+0000 7f113effd700 1 -- 172.21.15.49:0/2638654347 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113000ca40 con 0x7f112c004690 2023-11-30T17:08:23.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.754+0000 7f113effd700 1 -- 172.21.15.49:0/2638654347 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113000cdc0 con 0x7f112c004690 2023-11-30T17:08:23.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.754+0000 7f1146825700 1 -- 172.21.15.49:0/2638654347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f112c004690 msgr2=0x7f112c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:23.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.754+0000 7f1146825700 1 --2- 172.21.15.49:0/2638654347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f112c004690 0x7f112c004b10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f113000c190 tx=0x7f1130001e70).stop 2023-11-30T17:08:23.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.754+0000 7f1146825700 1 -- 172.21.15.49:0/2638654347 shutdown_connections 2023-11-30T17:08:23.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.754+0000 7f1146825700 1 --2- 172.21.15.49:0/2638654347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f112c004690 0x7f112c004b10 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:23.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.754+0000 7f1146825700 1 -- 172.21.15.49:0/2638654347 >> 172.21.15.49:0/2638654347 conn(0x7f1140094930 msgr2=0x7f114006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:23.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.754+0000 7f1146825700 1 -- 172.21.15.49:0/2638654347 shutdown_connections 2023-11-30T17:08:23.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.754+0000 7f1146825700 1 -- 172.21.15.49:0/2638654347 wait complete. 2023-11-30T17:08:23.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.755+0000 7f1146825700 1 Processor -- start 2023-11-30T17:08:23.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.756+0000 7f1146825700 1 -- start start 2023-11-30T17:08:23.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.756+0000 7f1146825700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f112c004690 0x7f11401513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:23.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.756+0000 7f1146825700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f114014c6e0 0x7f11400c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:23.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.756+0000 7f1146825700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11400c7ee0 0x7f11400c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:23.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.756+0000 7f1146825700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11400aae70 con 0x7f11400c7ee0 2023-11-30T17:08:23.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.756+0000 7f1146825700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11401525b0 con 0x7f112c004690 2023-11-30T17:08:23.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.756+0000 7f1146825700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11400c8810 con 0x7f114014c6e0 2023-11-30T17:08:23.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.757+0000 7f1144dc2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11400c7ee0 0x7f11400c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:23.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.757+0000 7f1144dc2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11400c7ee0 0x7f11400c8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46018/0 (socket says 172.21.15.49:46018) 2023-11-30T17:08:23.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.757+0000 7f1144dc2700 1 -- 172.21.15.49:0/3109095680 learned_addr learned my addr 172.21.15.49:0/3109095680 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:23.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.757+0000 7f113ffff700 1 --2- 172.21.15.49:0/3109095680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f112c004690 0x7f11401513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:23.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.757+0000 7f113f7fe700 1 --2- 172.21.15.49:0/3109095680 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f114014c6e0 0x7f11400c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:23.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.757+0000 7f1144dc2700 1 -- 172.21.15.49:0/3109095680 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f114014c6e0 msgr2=0x7f11400c3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:23.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.757+0000 7f1144dc2700 1 --2- 172.21.15.49:0/3109095680 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f114014c6e0 0x7f11400c3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:23.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.757+0000 7f1144dc2700 1 -- 172.21.15.49:0/3109095680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f112c004690 msgr2=0x7f11401513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:23.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.757+0000 7f1144dc2700 1 --2- 172.21.15.49:0/3109095680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f112c004690 0x7f11401513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:23.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.757+0000 7f1144dc2700 1 -- 172.21.15.49:0/3109095680 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11401519a0 con 0x7f11400c7ee0 2023-11-30T17:08:23.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.757+0000 7f113f7fe700 1 --2- 172.21.15.49:0/3109095680 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f114014c6e0 0x7f11400c3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:08:23.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.757+0000 7f1144dc2700 1 --2- 172.21.15.49:0/3109095680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11400c7ee0 0x7f11400c8320 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f11400a9fe0 tx=0x7f113800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:23.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.757+0000 7f1137fff700 1 -- 172.21.15.49:0/3109095680 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113800e040 con 0x7f11400c7ee0 2023-11-30T17:08:23.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.757+0000 7f1137fff700 1 -- 172.21.15.49:0/3109095680 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113800f040 con 0x7f11400c7ee0 2023-11-30T17:08:23.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.757+0000 7f1137fff700 1 -- 172.21.15.49:0/3109095680 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113800fe50 con 0x7f11400c7ee0 2023-11-30T17:08:23.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.757+0000 7f1146825700 1 -- 172.21.15.49:0/3109095680 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1140151c80 con 0x7f11400c7ee0 2023-11-30T17:08:23.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.757+0000 7f1146825700 1 -- 172.21.15.49:0/3109095680 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1140152240 con 0x7f11400c7ee0 2023-11-30T17:08:23.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.758+0000 7f1146825700 1 -- 172.21.15.49:0/3109095680 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f114006c860 con 0x7f11400c7ee0 2023-11-30T17:08:23.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.758+0000 7f1137fff700 1 -- 172.21.15.49:0/3109095680 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 7) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f1138015660 con 0x7f11400c7ee0 2023-11-30T17:08:23.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.759+0000 7f1137fff700 1 --2- 172.21.15.49:0/3109095680 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f112005f080 0x7f1120061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:23.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.759+0000 7f1137fff700 1 -- 172.21.15.49:0/3109095680 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f113807acc0 con 0x7f11400c7ee0 2023-11-30T17:08:23.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.759+0000 7f113ffff700 1 --2- 172.21.15.49:0/3109095680 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f112005f080 0x7f1120061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:23.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.759+0000 7f113ffff700 1 --2- 172.21.15.49:0/3109095680 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f112005f080 0x7f1120061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f1128000c00 tx=0x7f1128007be0).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:23.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.763+0000 7f1137fff700 1 -- 172.21.15.49:0/3109095680 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f113804c0b0 con 0x7f11400c7ee0 2023-11-30T17:08:23.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.961+0000 7f1146825700 1 -- 172.21.15.49:0/3109095680 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f11400647f0 con 0x7f112005f080 2023-11-30T17:08:23.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.966+0000 7f1137fff700 1 -- 172.21.15.49:0/3109095680 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f11400647f0 con 0x7f112005f080 2023-11-30T17:08:23.968 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule set for path /snap_test_dir1/dir2 2023-11-30T17:08:23.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.968+0000 7f1146825700 1 -- 172.21.15.49:0/3109095680 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f112005f080 msgr2=0x7f1120061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:23.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.968+0000 7f1146825700 1 --2- 172.21.15.49:0/3109095680 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f112005f080 0x7f1120061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f1128000c00 tx=0x7f1128007be0).stop 2023-11-30T17:08:23.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.968+0000 7f1146825700 1 -- 172.21.15.49:0/3109095680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11400c7ee0 msgr2=0x7f11400c8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:23.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.968+0000 7f1146825700 1 --2- 172.21.15.49:0/3109095680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11400c7ee0 0x7f11400c8320 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f11400a9fe0 tx=0x7f113800b040).stop 2023-11-30T17:08:23.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.968+0000 7f1146825700 1 -- 172.21.15.49:0/3109095680 shutdown_connections 2023-11-30T17:08:23.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.968+0000 7f1146825700 1 --2- 172.21.15.49:0/3109095680 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f112005f080 0x7f1120061540 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:23.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.968+0000 7f1146825700 1 --2- 172.21.15.49:0/3109095680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11400c7ee0 0x7f11400c8320 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:23.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.968+0000 7f1146825700 1 --2- 172.21.15.49:0/3109095680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f112c004690 0x7f11401513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:23.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.968+0000 7f1146825700 1 --2- 172.21.15.49:0/3109095680 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f114014c6e0 0x7f11400c3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:23.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.968+0000 7f1146825700 1 -- 172.21.15.49:0/3109095680 >> 172.21.15.49:0/3109095680 conn(0x7f1140094930 msgr2=0x7f114014f460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:23.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.968+0000 7f1146825700 1 -- 172.21.15.49:0/3109095680 shutdown_connections 2023-11-30T17:08:23.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:23.968+0000 7f1146825700 1 -- 172.21.15.49:0/3109095680 wait complete. 2023-11-30T17:08:23.982 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir2 2023-11-30T17:08:23.982 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:08:23.982 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir3) 2023-11-30T17:08:24.000 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir3 1M 2023-11-30T17:08:24.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.161+0000 7fbbd3b85700 1 Processor -- start 2023-11-30T17:08:24.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.161+0000 7fbbd3b85700 1 -- start start 2023-11-30T17:08:24.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.162+0000 7fbbd3b85700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbbcc154520 0x7fbbcc06a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:24.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.162+0000 7fbbd3b85700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbcc0bd600 0x7fbbcc06a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:24.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.162+0000 7fbbd3b85700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbcc067840 con 0x7fbbcc154900 2023-11-30T17:08:24.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.162+0000 7fbbd3b85700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbcc0c50e0 con 0x7fbbcc154520 2023-11-30T17:08:24.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.162+0000 7fbbd3b85700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbcc066c30 con 0x7fbbcc0bd600 2023-11-30T17:08:24.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.162+0000 7fbbd1921700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbbcc154520 0x7fbbcc06a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:24.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.162+0000 7fbbd1120700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbbcc154900 0x7fbbcc0bcef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49006/0 (socket says 172.21.15.49:49006) 2023-11-30T17:08:24.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.162+0000 7fbbd1921700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbbcc154520 0x7fbbcc06a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46030/0 (socket says 172.21.15.49:46030) 2023-11-30T17:08:24.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.162+0000 7fbbd1120700 1 -- 172.21.15.49:0/4221311382 learned_addr learned my addr 172.21.15.49:0/4221311382 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:08:24.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.162+0000 7fbbd2122700 1 --2- 172.21.15.49:0/4221311382 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbcc0bd600 0x7fbbcc06a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:24.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.163+0000 7fbbd1921700 1 -- 172.21.15.49:0/4221311382 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbcc0bd600 msgr2=0x7fbbcc06a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:24.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.163+0000 7fbbd1921700 1 --2- 172.21.15.49:0/4221311382 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbcc0bd600 0x7fbbcc06a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:24.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.163+0000 7fbbd1921700 1 -- 172.21.15.49:0/4221311382 >> v1:172.21.15.49:6789/0 conn(0x7fbbcc154900 legacy=0x7fbbcc0bcef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:24.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.163+0000 7fbbd091f700 1 -- 172.21.15.49:0/4221311382 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 195622682 0 0) 0x7fbbcc067840 con 0x7fbbcc154900 2023-11-30T17:08:24.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.163+0000 7fbbd1921700 1 -- 172.21.15.49:0/4221311382 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbcc066f10 con 0x7fbbcc154520 2023-11-30T17:08:24.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.163+0000 7fbbd1921700 1 --2- 172.21.15.49:0/4221311382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbcc154520 0x7fbbcc06a3b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7fbbc8009760 tx=0x7fbbc8009060).ready entity=mon.0 client_cookie=4597be3ac4363a64 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:24.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.163+0000 7fbbd091f700 1 -- 172.21.15.49:0/4221311382 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc80090d0 con 0x7fbbcc154520 2023-11-30T17:08:24.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.163+0000 7fbbd091f700 1 -- 172.21.15.49:0/4221311382 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc800f510 con 0x7fbbcc154520 2023-11-30T17:08:24.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.163+0000 7fbbd091f700 1 -- 172.21.15.49:0/4221311382 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc800f890 con 0x7fbbcc154520 2023-11-30T17:08:24.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.163+0000 7fbbd3b85700 1 -- 172.21.15.49:0/4221311382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbcc154520 msgr2=0x7fbbcc06a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:24.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.163+0000 7fbbd3b85700 1 --2- 172.21.15.49:0/4221311382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbcc154520 0x7fbbcc06a3b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7fbbc8009760 tx=0x7fbbc8009060).stop 2023-11-30T17:08:24.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.163+0000 7fbbd3b85700 1 -- 172.21.15.49:0/4221311382 shutdown_connections 2023-11-30T17:08:24.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.163+0000 7fbbd3b85700 1 --2- 172.21.15.49:0/4221311382 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbcc0bd600 0x7fbbcc06a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:24.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.163+0000 7fbbd3b85700 1 --2- 172.21.15.49:0/4221311382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbcc154520 0x7fbbcc06a3b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:24.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.163+0000 7fbbd3b85700 1 -- 172.21.15.49:0/4221311382 >> 172.21.15.49:0/4221311382 conn(0x7fbbcc063810 msgr2=0x7fbbcc063c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:24.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.164+0000 7fbbd3b85700 1 -- 172.21.15.49:0/4221311382 shutdown_connections 2023-11-30T17:08:24.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.164+0000 7fbbd3b85700 1 -- 172.21.15.49:0/4221311382 wait complete. 2023-11-30T17:08:24.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.165+0000 7fbbd3b85700 1 Processor -- start 2023-11-30T17:08:24.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.165+0000 7fbbd3b85700 1 -- start start 2023-11-30T17:08:24.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.165+0000 7fbbd3b85700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbcc0bd600 0x7fbbcc14dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:24.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.165+0000 7fbbd3b85700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbcc154520 0x7fbbcc155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:24.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.165+0000 7fbbd3b85700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbcc154900 0x7fbbcc0aca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:24.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.165+0000 7fbbd3b85700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbcc156440 con 0x7fbbcc154520 2023-11-30T17:08:24.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.166+0000 7fbbd3b85700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbcc151a80 con 0x7fbbcc154900 2023-11-30T17:08:24.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.166+0000 7fbbd3b85700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbcc156160 con 0x7fbbcc0bd600 2023-11-30T17:08:24.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.166+0000 7fbbd1120700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbcc154520 0x7fbbcc155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:24.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.166+0000 7fbbd1120700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbcc154520 0x7fbbcc155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46036/0 (socket says 172.21.15.49:46036) 2023-11-30T17:08:24.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.166+0000 7fbbd1120700 1 -- 172.21.15.49:0/3467874750 learned_addr learned my addr 172.21.15.49:0/3467874750 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:24.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.166+0000 7fbbd1921700 1 --2- 172.21.15.49:0/3467874750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbcc0bd600 0x7fbbcc14dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:24.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.166+0000 7fbbd2122700 1 --2- 172.21.15.49:0/3467874750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbcc154900 0x7fbbcc0aca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:24.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.166+0000 7fbbd1120700 1 -- 172.21.15.49:0/3467874750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbcc0bd600 msgr2=0x7fbbcc14dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:24.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.166+0000 7fbbd1120700 1 --2- 172.21.15.49:0/3467874750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbcc0bd600 0x7fbbcc14dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:24.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.166+0000 7fbbd1120700 1 -- 172.21.15.49:0/3467874750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbcc154900 msgr2=0x7fbbcc0aca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:24.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.166+0000 7fbbd1120700 1 --2- 172.21.15.49:0/3467874750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbcc154900 0x7fbbcc0aca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:24.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.166+0000 7fbbd1120700 1 -- 172.21.15.49:0/3467874750 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc80092a0 con 0x7fbbcc154520 2023-11-30T17:08:24.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.166+0000 7fbbd2122700 1 --2- 172.21.15.49:0/3467874750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbcc154900 0x7fbbcc0aca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:08:24.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.166+0000 7fbbd1120700 1 --2- 172.21.15.49:0/3467874750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbcc154520 0x7fbbcc155710 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fbbbc001eb0 tx=0x7fbbbc007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:24.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.166+0000 7fbbc1ffb700 1 -- 172.21.15.49:0/3467874750 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc0072e0 con 0x7fbbcc154520 2023-11-30T17:08:24.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.166+0000 7fbbc1ffb700 1 -- 172.21.15.49:0/3467874750 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbbc007440 con 0x7fbbcc154520 2023-11-30T17:08:24.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.166+0000 7fbbc1ffb700 1 -- 172.21.15.49:0/3467874750 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc0057a0 con 0x7fbbcc154520 2023-11-30T17:08:24.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.166+0000 7fbbd3b85700 1 -- 172.21.15.49:0/3467874750 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbcc151430 con 0x7fbbcc154520 2023-11-30T17:08:24.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.166+0000 7fbbd3b85700 1 -- 172.21.15.49:0/3467874750 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbcc14e200 con 0x7fbbcc154520 2023-11-30T17:08:24.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.167+0000 7fbbd3b85700 1 -- 172.21.15.49:0/3467874750 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbcc06c860 con 0x7fbbcc154520 2023-11-30T17:08:24.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.167+0000 7fbbc1ffb700 1 -- 172.21.15.49:0/3467874750 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 7) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fbbbc005b90 con 0x7fbbcc154520 2023-11-30T17:08:24.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.168+0000 7fbbc1ffb700 1 --2- 172.21.15.49:0/3467874750 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbbb005f080 0x7fbbb0061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:24.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.168+0000 7fbbc1ffb700 1 -- 172.21.15.49:0/3467874750 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fbbbc079830 con 0x7fbbcc154520 2023-11-30T17:08:24.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.168+0000 7fbbd1921700 1 --2- 172.21.15.49:0/3467874750 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbbb005f080 0x7fbbb0061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:24.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.168+0000 7fbbd1921700 1 --2- 172.21.15.49:0/3467874750 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbbb005f080 0x7fbbb0061540 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fbbc8009fd0 tx=0x7fbbc8017000).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:24.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.172+0000 7fbbc1ffb700 1 -- 172.21.15.49:0/3467874750 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbbbc04ac20 con 0x7fbbcc154520 2023-11-30T17:08:24.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.370+0000 7fbbd3b85700 1 -- 172.21.15.49:0/3467874750 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbbcc0671f0 con 0x7fbbb005f080 2023-11-30T17:08:24.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.375+0000 7fbbc1ffb700 1 -- 172.21.15.49:0/3467874750 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fbbcc0671f0 con 0x7fbbb005f080 2023-11-30T17:08:24.377 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule set for path /snap_test_dir1/dir3 2023-11-30T17:08:24.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.377+0000 7fbbd3b85700 1 -- 172.21.15.49:0/3467874750 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbbb005f080 msgr2=0x7fbbb0061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:24.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.377+0000 7fbbd3b85700 1 --2- 172.21.15.49:0/3467874750 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbbb005f080 0x7fbbb0061540 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fbbc8009fd0 tx=0x7fbbc8017000).stop 2023-11-30T17:08:24.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.377+0000 7fbbd3b85700 1 -- 172.21.15.49:0/3467874750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbcc154520 msgr2=0x7fbbcc155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:24.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.377+0000 7fbbd3b85700 1 --2- 172.21.15.49:0/3467874750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbcc154520 0x7fbbcc155710 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fbbbc001eb0 tx=0x7fbbbc007e90).stop 2023-11-30T17:08:24.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.377+0000 7fbbd3b85700 1 -- 172.21.15.49:0/3467874750 shutdown_connections 2023-11-30T17:08:24.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.377+0000 7fbbd3b85700 1 --2- 172.21.15.49:0/3467874750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbcc154900 0x7fbbcc0aca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:24.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.377+0000 7fbbd3b85700 1 --2- 172.21.15.49:0/3467874750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbcc0bd600 0x7fbbcc14dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:24.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.377+0000 7fbbd3b85700 1 --2- 172.21.15.49:0/3467874750 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbbb005f080 0x7fbbb0061540 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:24.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.377+0000 7fbbd3b85700 1 --2- 172.21.15.49:0/3467874750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbcc154520 0x7fbbcc155710 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:24.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.377+0000 7fbbd3b85700 1 -- 172.21.15.49:0/3467874750 >> 172.21.15.49:0/3467874750 conn(0x7fbbcc063810 msgr2=0x7fbbcc153670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:24.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.377+0000 7fbbd3b85700 1 -- 172.21.15.49:0/3467874750 shutdown_connections 2023-11-30T17:08:24.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.377+0000 7fbbd3b85700 1 -- 172.21.15.49:0/3467874750 wait complete. 2023-11-30T17:08:24.391 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir3 2023-11-30T17:08:24.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:08:24.391 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir4) 2023-11-30T17:08:24.408 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir4 1M 2023-11-30T17:08:24.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.569+0000 7ff67f657700 1 Processor -- start 2023-11-30T17:08:24.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.569+0000 7ff67f657700 1 -- start start 2023-11-30T17:08:24.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.570+0000 7ff67f657700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff678154530 0x7ff678154910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:24.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.570+0000 7ff67f657700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6780aa220 0x7ff6780aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:24.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.570+0000 7ff67f657700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6780c6630 con 0x7ff6780a7ff0 2023-11-30T17:08:24.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.570+0000 7ff67f657700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6780c6390 con 0x7ff678154530 2023-11-30T17:08:24.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.570+0000 7ff67f657700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6780aaba0 con 0x7ff6780aa220 2023-11-30T17:08:24.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.570+0000 7ff67d3f3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff678154530 0x7ff678154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:24.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.570+0000 7ff67d3f3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff678154530 0x7ff678154910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46052/0 (socket says 172.21.15.49:46052) 2023-11-30T17:08:24.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.570+0000 7ff67d3f3700 1 -- 172.21.15.49:0/1968740444 learned_addr learned my addr 172.21.15.49:0/1968740444 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:24.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.570+0000 7ff67dbf4700 1 --2- 172.21.15.49:0/1968740444 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6780aa220 0x7ff6780aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:24.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.570+0000 7ff67d3f3700 1 -- 172.21.15.49:0/1968740444 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6780aa220 msgr2=0x7ff6780aa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:24.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.570+0000 7ff67d3f3700 1 --2- 172.21.15.49:0/1968740444 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6780aa220 0x7ff6780aa6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:24.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.570+0000 7ff67d3f3700 1 -- 172.21.15.49:0/1968740444 >> v1:172.21.15.115:6789/0 conn(0x7ff6780a7ff0 legacy=0x7ff6780c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:24.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.570+0000 7ff67d3f3700 1 -- 172.21.15.49:0/1968740444 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6780a8470 con 0x7ff678154530 2023-11-30T17:08:24.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.570+0000 7ff67d3f3700 1 --2- 172.21.15.49:0/1968740444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff678154530 0x7ff678154910 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7ff670009810 tx=0x7ff670009060).ready entity=mon.0 client_cookie=9832886dda6e2175 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:24.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.570+0000 7ff677fff700 1 -- 172.21.15.49:0/1968740444 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff670005880 con 0x7ff678154530 2023-11-30T17:08:24.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.570+0000 7ff677fff700 1 -- 172.21.15.49:0/1968740444 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6700059e0 con 0x7ff678154530 2023-11-30T17:08:24.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.570+0000 7ff677fff700 1 -- 172.21.15.49:0/1968740444 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff670005d60 con 0x7ff678154530 2023-11-30T17:08:24.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.571+0000 7ff67f657700 1 -- 172.21.15.49:0/1968740444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff678154530 msgr2=0x7ff678154910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:24.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.571+0000 7ff67f657700 1 --2- 172.21.15.49:0/1968740444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff678154530 0x7ff678154910 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7ff670009810 tx=0x7ff670009060).stop 2023-11-30T17:08:24.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.571+0000 7ff67f657700 1 -- 172.21.15.49:0/1968740444 shutdown_connections 2023-11-30T17:08:24.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.571+0000 7ff67f657700 1 --2- 172.21.15.49:0/1968740444 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6780aa220 0x7ff6780aa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:24.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.571+0000 7ff67f657700 1 --2- 172.21.15.49:0/1968740444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff678154530 0x7ff678154910 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:24.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.571+0000 7ff67f657700 1 -- 172.21.15.49:0/1968740444 >> 172.21.15.49:0/1968740444 conn(0x7ff678094930 msgr2=0x7ff67806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:24.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.571+0000 7ff67f657700 1 -- 172.21.15.49:0/1968740444 shutdown_connections 2023-11-30T17:08:24.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.571+0000 7ff67f657700 1 -- 172.21.15.49:0/1968740444 wait complete. 2023-11-30T17:08:24.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.572+0000 7ff67f657700 1 Processor -- start 2023-11-30T17:08:24.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.572+0000 7ff67f657700 1 -- start start 2023-11-30T17:08:24.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.573+0000 7ff67f657700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6780a7ff0 0x7ff67814f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:24.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.573+0000 7ff67f657700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6780aa220 0x7ff6781525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:24.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.573+0000 7ff67f657700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff678154530 0x7ff678152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:24.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.573+0000 7ff67f657700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6780c4db0 con 0x7ff6780a7ff0 2023-11-30T17:08:24.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.573+0000 7ff67f657700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6780ab210 con 0x7ff6780aa220 2023-11-30T17:08:24.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.573+0000 7ff67f657700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6780ab4f0 con 0x7ff678154530 2023-11-30T17:08:24.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.573+0000 7ff67d3f3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6780a7ff0 0x7ff67814f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:24.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.573+0000 7ff67d3f3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6780a7ff0 0x7ff67814f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46060/0 (socket says 172.21.15.49:46060) 2023-11-30T17:08:24.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.573+0000 7ff67d3f3700 1 -- 172.21.15.49:0/2567003663 learned_addr learned my addr 172.21.15.49:0/2567003663 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:24.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.573+0000 7ff67d3f3700 1 -- 172.21.15.49:0/2567003663 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff678154530 msgr2=0x7ff678152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:24.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.573+0000 7ff67d3f3700 1 --2- 172.21.15.49:0/2567003663 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff678154530 0x7ff678152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:08:24.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.573+0000 7ff67cbf2700 1 --2- 172.21.15.49:0/2567003663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6780aa220 0x7ff6781525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:24.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.574+0000 7ff67d3f3700 1 -- 172.21.15.49:0/2567003663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6780aa220 msgr2=0x7ff6781525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:24.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.574+0000 7ff67d3f3700 1 --2- 172.21.15.49:0/2567003663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6780aa220 0x7ff6781525c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:24.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.574+0000 7ff67d3f3700 1 -- 172.21.15.49:0/2567003663 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff670009300 con 0x7ff6780a7ff0 2023-11-30T17:08:24.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.574+0000 7ff67d3f3700 1 --2- 172.21.15.49:0/2567003663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6780a7ff0 0x7ff67814f330 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7ff67806ae10 tx=0x7ff670016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:24.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.574+0000 7ff6757fa700 1 -- 172.21.15.49:0/2567003663 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67000b810 con 0x7ff6780a7ff0 2023-11-30T17:08:24.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.574+0000 7ff6757fa700 1 -- 172.21.15.49:0/2567003663 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67000b970 con 0x7ff6780a7ff0 2023-11-30T17:08:24.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.574+0000 7ff67f657700 1 -- 172.21.15.49:0/2567003663 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6780ab7d0 con 0x7ff6780a7ff0 2023-11-30T17:08:24.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.574+0000 7ff6757fa700 1 -- 172.21.15.49:0/2567003663 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67000bd30 con 0x7ff6780a7ff0 2023-11-30T17:08:24.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.574+0000 7ff67f657700 1 -- 172.21.15.49:0/2567003663 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6780abd90 con 0x7ff6780a7ff0 2023-11-30T17:08:24.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.575+0000 7ff67f657700 1 -- 172.21.15.49:0/2567003663 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6780abf80 con 0x7ff6780a7ff0 2023-11-30T17:08:24.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.575+0000 7ff6757fa700 1 -- 172.21.15.49:0/2567003663 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 7) v1 ==== 75357+0+0 (secure 0 0 0) 0x7ff670011650 con 0x7ff6780a7ff0 2023-11-30T17:08:24.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.576+0000 7ff6757fa700 1 --2- 172.21.15.49:0/2567003663 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff66405f080 0x7ff664061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:24.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.576+0000 7ff6757fa700 1 -- 172.21.15.49:0/2567003663 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7ff67007b710 con 0x7ff6780a7ff0 2023-11-30T17:08:24.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.576+0000 7ff67cbf2700 1 --2- 172.21.15.49:0/2567003663 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff66405f080 0x7ff664061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:24.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.576+0000 7ff67cbf2700 1 --2- 172.21.15.49:0/2567003663 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff66405f080 0x7ff664061540 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7ff66c007fd0 tx=0x7ff66c009040).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:24.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.580+0000 7ff6757fa700 1 -- 172.21.15.49:0/2567003663 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff67004caa0 con 0x7ff6780a7ff0 2023-11-30T17:08:24.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.777+0000 7ff67f657700 1 -- 172.21.15.49:0/2567003663 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff67806c860 con 0x7ff66405f080 2023-11-30T17:08:24.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.782+0000 7ff6757fa700 1 -- 172.21.15.49:0/2567003663 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7ff67806c860 con 0x7ff66405f080 2023-11-30T17:08:24.784 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule set for path /snap_test_dir1/dir4 2023-11-30T17:08:24.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.784+0000 7ff67f657700 1 -- 172.21.15.49:0/2567003663 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff66405f080 msgr2=0x7ff664061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:24.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.784+0000 7ff67f657700 1 --2- 172.21.15.49:0/2567003663 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff66405f080 0x7ff664061540 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7ff66c007fd0 tx=0x7ff66c009040).stop 2023-11-30T17:08:24.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.784+0000 7ff67f657700 1 -- 172.21.15.49:0/2567003663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6780a7ff0 msgr2=0x7ff67814f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:24.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.784+0000 7ff67f657700 1 --2- 172.21.15.49:0/2567003663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6780a7ff0 0x7ff67814f330 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7ff67806ae10 tx=0x7ff670016000).stop 2023-11-30T17:08:24.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.784+0000 7ff67f657700 1 -- 172.21.15.49:0/2567003663 shutdown_connections 2023-11-30T17:08:24.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.784+0000 7ff67f657700 1 --2- 172.21.15.49:0/2567003663 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff678154530 0x7ff678152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:08:24.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.784+0000 7ff67f657700 1 --2- 172.21.15.49:0/2567003663 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff66405f080 0x7ff664061540 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:24.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.784+0000 7ff67f657700 1 --2- 172.21.15.49:0/2567003663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6780a7ff0 0x7ff67814f330 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:24.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.784+0000 7ff67f657700 1 --2- 172.21.15.49:0/2567003663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6780aa220 0x7ff6781525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:24.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.784+0000 7ff67f657700 1 -- 172.21.15.49:0/2567003663 >> 172.21.15.49:0/2567003663 conn(0x7ff678094930 msgr2=0x7ff6780c8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:24.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.784+0000 7ff67f657700 1 -- 172.21.15.49:0/2567003663 shutdown_connections 2023-11-30T17:08:24.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.784+0000 7ff67f657700 1 -- 172.21.15.49:0/2567003663 wait complete. 2023-11-30T17:08:24.798 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir4 2023-11-30T17:08:24.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:08:24.799 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir5) 2023-11-30T17:08:24.816 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir5 1M 2023-11-30T17:08:24.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.977+0000 7fc640fbc700 1 Processor -- start 2023-11-30T17:08:24.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.977+0000 7fc640fbc700 1 -- start start 2023-11-30T17:08:24.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.978+0000 7fc640fbc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc63c0aa680 0x7fc63c0c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:24.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.978+0000 7fc640fbc700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc63c158d50 con 0x7fc63c1546b0 2023-11-30T17:08:24.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.978+0000 7fc640fbc700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc63c158140 con 0x7fc63c1542d0 2023-11-30T17:08:24.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.978+0000 7fc640fbc700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc63c158420 con 0x7fc63c0aa680 2023-11-30T17:08:24.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.978+0000 7fc63affd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc63c0aa680 0x7fc63c0c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:24.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.978+0000 7fc63bfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc63c1546b0 0x7fc63c0c64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49016/0 (socket says 172.21.15.49:49016) 2023-11-30T17:08:24.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.978+0000 7fc63bfff700 1 -- 172.21.15.49:0/1026409732 learned_addr learned my addr 172.21.15.49:0/1026409732 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:08:24.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.978+0000 7fc63affd700 1 -- 172.21.15.49:0/1026409732 >> v1:172.21.15.115:6789/0 conn(0x7fc63c1542d0 legacy=0x7fc63c0a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:24.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.978+0000 7fc63affd700 1 -- 172.21.15.49:0/1026409732 >> v1:172.21.15.49:6789/0 conn(0x7fc63c1546b0 legacy=0x7fc63c0c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:24.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.978+0000 7fc63a7fc700 1 -- 172.21.15.49:0/1026409732 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1388200207 0 0) 0x7fc63c158d50 con 0x7fc63c1546b0 2023-11-30T17:08:24.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.978+0000 7fc63affd700 1 -- 172.21.15.49:0/1026409732 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c158700 con 0x7fc63c0aa680 2023-11-30T17:08:24.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.978+0000 7fc63affd700 1 --2- 172.21.15.49:0/1026409732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc63c0aa680 0x7fc63c0c5fc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fc630009760 tx=0x7fc630009060).ready entity=mon.0 client_cookie=47ea7ea64898de59 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:24.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.978+0000 7fc63a7fc700 1 -- 172.21.15.49:0/1026409732 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63000b580 con 0x7fc63c0aa680 2023-11-30T17:08:24.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.978+0000 7fc63a7fc700 1 -- 172.21.15.49:0/1026409732 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63000b6e0 con 0x7fc63c0aa680 2023-11-30T17:08:24.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.978+0000 7fc63a7fc700 1 -- 172.21.15.49:0/1026409732 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63000ba60 con 0x7fc63c0aa680 2023-11-30T17:08:24.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.979+0000 7fc640fbc700 1 -- 172.21.15.49:0/1026409732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc63c0aa680 msgr2=0x7fc63c0c5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:24.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.979+0000 7fc640fbc700 1 --2- 172.21.15.49:0/1026409732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc63c0aa680 0x7fc63c0c5fc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fc630009760 tx=0x7fc630009060).stop 2023-11-30T17:08:24.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.979+0000 7fc640fbc700 1 -- 172.21.15.49:0/1026409732 shutdown_connections 2023-11-30T17:08:24.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.979+0000 7fc640fbc700 1 --2- 172.21.15.49:0/1026409732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc63c0aa680 0x7fc63c0c5fc0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:24.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.979+0000 7fc640fbc700 1 -- 172.21.15.49:0/1026409732 >> 172.21.15.49:0/1026409732 conn(0x7fc63c0cb010 msgr2=0x7fc63c0cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:24.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.979+0000 7fc640fbc700 1 -- 172.21.15.49:0/1026409732 shutdown_connections 2023-11-30T17:08:24.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.979+0000 7fc640fbc700 1 -- 172.21.15.49:0/1026409732 wait complete. 2023-11-30T17:08:24.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.980+0000 7fc640fbc700 1 Processor -- start 2023-11-30T17:08:24.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.980+0000 7fc640fbc700 1 -- start start 2023-11-30T17:08:24.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.981+0000 7fc640fbc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc63c0aa680 0x7fc63c168580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:24.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.981+0000 7fc640fbc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc63c1542d0 0x7fc63c0b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:24.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.981+0000 7fc640fbc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc63c1546b0 0x7fc63c14cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:24.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.981+0000 7fc640fbc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c14dd30 con 0x7fc63c1542d0 2023-11-30T17:08:24.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.981+0000 7fc640fbc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c0af7c0 con 0x7fc63c1546b0 2023-11-30T17:08:24.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.981+0000 7fc640fbc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c0ae720 con 0x7fc63c0aa680 2023-11-30T17:08:24.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.981+0000 7fc63affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc63c1542d0 0x7fc63c0b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:24.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.981+0000 7fc63affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc63c1542d0 0x7fc63c0b0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46082/0 (socket says 172.21.15.49:46082) 2023-11-30T17:08:24.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.981+0000 7fc63affd700 1 -- 172.21.15.49:0/2115618728 learned_addr learned my addr 172.21.15.49:0/2115618728 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:24.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.981+0000 7fc63affd700 1 -- 172.21.15.49:0/2115618728 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc63c0aa680 msgr2=0x7fc63c168580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:24.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.981+0000 7fc63affd700 1 --2- 172.21.15.49:0/2115618728 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc63c0aa680 0x7fc63c168580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:08:24.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.981+0000 7fc63affd700 1 -- 172.21.15.49:0/2115618728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc63c1546b0 msgr2=0x7fc63c14cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:24.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.981+0000 7fc63affd700 1 --2- 172.21.15.49:0/2115618728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc63c1546b0 0x7fc63c14cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:08:24.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.981+0000 7fc63affd700 1 -- 172.21.15.49:0/2115618728 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6300092a0 con 0x7fc63c1542d0 2023-11-30T17:08:24.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.982+0000 7fc63affd700 1 --2- 172.21.15.49:0/2115618728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc63c1542d0 0x7fc63c0b0c30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7fc63c060090 tx=0x7fc630017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:24.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.982+0000 7fc6237fe700 1 -- 172.21.15.49:0/2115618728 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63000ba60 con 0x7fc63c1542d0 2023-11-30T17:08:24.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.982+0000 7fc6237fe700 1 -- 172.21.15.49:0/2115618728 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc630000c90 con 0x7fc63c1542d0 2023-11-30T17:08:24.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.982+0000 7fc640fbc700 1 -- 172.21.15.49:0/2115618728 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc63c0aea00 con 0x7fc63c1542d0 2023-11-30T17:08:24.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.982+0000 7fc6237fe700 1 -- 172.21.15.49:0/2115618728 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63001b640 con 0x7fc63c1542d0 2023-11-30T17:08:24.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.982+0000 7fc640fbc700 1 -- 172.21.15.49:0/2115618728 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc63c0aefc0 con 0x7fc63c1542d0 2023-11-30T17:08:24.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.983+0000 7fc6237fe700 1 -- 172.21.15.49:0/2115618728 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 7) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fc63001ba30 con 0x7fc63c1542d0 2023-11-30T17:08:24.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.983+0000 7fc640fbc700 1 -- 172.21.15.49:0/2115618728 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc63c06c7c0 con 0x7fc63c1542d0 2023-11-30T17:08:24.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.983+0000 7fc6237fe700 1 --2- 172.21.15.49:0/2115618728 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc62805f080 0x7fc628061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:24.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.983+0000 7fc6237fe700 1 -- 172.21.15.49:0/2115618728 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fc63007bca0 con 0x7fc63c1542d0 2023-11-30T17:08:24.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.984+0000 7fc63b7fe700 1 --2- 172.21.15.49:0/2115618728 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc62805f080 0x7fc628061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:24.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.984+0000 7fc63b7fe700 1 --2- 172.21.15.49:0/2115618728 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc62805f080 0x7fc628061540 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fc62c001510 tx=0x7fc62c0079c0).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:24.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:24.988+0000 7fc6237fe700 1 -- 172.21.15.49:0/2115618728 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc630080070 con 0x7fc63c1542d0 2023-11-30T17:08:25.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.119+0000 7fc6237fe700 1 -- 172.21.15.49:0/2115618728 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7fc63001bce0 con 0x7fc63c1542d0 2023-11-30T17:08:25.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.186+0000 7fc640fbc700 1 -- 172.21.15.49:0/2115618728 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc63c0c0120 con 0x7fc62805f080 2023-11-30T17:08:25.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.191+0000 7fc6237fe700 1 -- 172.21.15.49:0/2115618728 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fc63c0c0120 con 0x7fc62805f080 2023-11-30T17:08:25.193 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule set for path /snap_test_dir1/dir5 2023-11-30T17:08:25.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.193+0000 7fc640fbc700 1 -- 172.21.15.49:0/2115618728 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc62805f080 msgr2=0x7fc628061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:25.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.193+0000 7fc640fbc700 1 --2- 172.21.15.49:0/2115618728 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc62805f080 0x7fc628061540 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fc62c001510 tx=0x7fc62c0079c0).stop 2023-11-30T17:08:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.193+0000 7fc640fbc700 1 -- 172.21.15.49:0/2115618728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc63c1542d0 msgr2=0x7fc63c0b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.193+0000 7fc640fbc700 1 --2- 172.21.15.49:0/2115618728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc63c1542d0 0x7fc63c0b0c30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7fc63c060090 tx=0x7fc630017000).stop 2023-11-30T17:08:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.193+0000 7fc640fbc700 1 -- 172.21.15.49:0/2115618728 shutdown_connections 2023-11-30T17:08:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.193+0000 7fc640fbc700 1 --2- 172.21.15.49:0/2115618728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc63c1546b0 0x7fc63c14cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:08:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.193+0000 7fc640fbc700 1 --2- 172.21.15.49:0/2115618728 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc63c0aa680 0x7fc63c168580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:08:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.193+0000 7fc640fbc700 1 --2- 172.21.15.49:0/2115618728 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc62805f080 0x7fc628061540 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.193+0000 7fc640fbc700 1 --2- 172.21.15.49:0/2115618728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc63c1542d0 0x7fc63c0b0c30 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.193+0000 7fc640fbc700 1 -- 172.21.15.49:0/2115618728 >> 172.21.15.49:0/2115618728 conn(0x7fc63c0cb010 msgr2=0x7fc63c0c5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.193+0000 7fc640fbc700 1 -- 172.21.15.49:0/2115618728 shutdown_connections 2023-11-30T17:08:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.193+0000 7fc640fbc700 1 -- 172.21.15.49:0/2115618728 wait complete. 2023-11-30T17:08:25.207 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir5 2023-11-30T17:08:25.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:08:25.207 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir6) 2023-11-30T17:08:25.224 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir6 1M 2023-11-30T17:08:25.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.384+0000 7f4164da2700 1 Processor -- start 2023-11-30T17:08:25.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.384+0000 7f4164da2700 1 -- start start 2023-11-30T17:08:25.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.385+0000 7f4164da2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4160154530 0x7f4160154910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:25.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.385+0000 7f4164da2700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41600c6630 con 0x7f41600aa220 2023-11-30T17:08:25.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.385+0000 7f4164da2700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41600a8470 con 0x7f41600a7ff0 2023-11-30T17:08:25.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.385+0000 7f4164da2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41600c6390 con 0x7f4160154530 2023-11-30T17:08:25.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.386+0000 7f415ed9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f41600aa220 0x7f41600c6ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49026/0 (socket says 172.21.15.49:49026) 2023-11-30T17:08:25.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.386+0000 7f415ed9d700 1 -- 172.21.15.49:0/3623946074 learned_addr learned my addr 172.21.15.49:0/3623946074 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:08:25.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.386+0000 7f415e59c700 1 --2- 172.21.15.49:0/3623946074 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4160154530 0x7f4160154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:25.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.386+0000 7f415d59a700 1 -- 172.21.15.49:0/3623946074 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488354025 0 0) 0x7f41600c6630 con 0x7f41600aa220 2023-11-30T17:08:25.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.386+0000 7f415d59a700 1 -- 172.21.15.49:0/3623946074 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f414c0033f0 con 0x7f41600aa220 2023-11-30T17:08:25.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.386+0000 7f415d59a700 1 -- 172.21.15.49:0/3623946074 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2925314033 0 0) 0x7f41600a8470 con 0x7f41600a7ff0 2023-11-30T17:08:25.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.386+0000 7f415d59a700 1 -- 172.21.15.49:0/3623946074 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41600c6630 con 0x7f41600a7ff0 2023-11-30T17:08:25.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.386+0000 7f415e59c700 1 -- 172.21.15.49:0/3623946074 >> v1:172.21.15.115:6789/0 conn(0x7f41600a7ff0 legacy=0x7f41600c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:25.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.386+0000 7f415e59c700 1 -- 172.21.15.49:0/3623946074 >> v1:172.21.15.49:6789/0 conn(0x7f41600aa220 legacy=0x7f41600c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:25.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.386+0000 7f415e59c700 1 -- 172.21.15.49:0/3623946074 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4160064230 con 0x7f4160154530 2023-11-30T17:08:25.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.386+0000 7f415e59c700 1 --2- 172.21.15.49:0/3623946074 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4160154530 0x7f4160154910 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f4158009760 tx=0x7f4158006f40).ready entity=mon.2 client_cookie=9e7bcc3f2952878 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:25.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.386+0000 7f415d59a700 1 -- 172.21.15.49:0/3623946074 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4158005880 con 0x7f4160154530 2023-11-30T17:08:25.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.386+0000 7f415d59a700 1 -- 172.21.15.49:0/3623946074 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41580059e0 con 0x7f4160154530 2023-11-30T17:08:25.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.387+0000 7f415d59a700 1 -- 172.21.15.49:0/3623946074 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4158005d60 con 0x7f4160154530 2023-11-30T17:08:25.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.387+0000 7f4164da2700 1 -- 172.21.15.49:0/3623946074 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4160154530 msgr2=0x7f4160154910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:25.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.387+0000 7f4164da2700 1 --2- 172.21.15.49:0/3623946074 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4160154530 0x7f4160154910 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f4158009760 tx=0x7f4158006f40).stop 2023-11-30T17:08:25.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.387+0000 7f4164da2700 1 -- 172.21.15.49:0/3623946074 shutdown_connections 2023-11-30T17:08:25.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.387+0000 7f4164da2700 1 --2- 172.21.15.49:0/3623946074 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4160154530 0x7f4160154910 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:25.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.387+0000 7f4164da2700 1 -- 172.21.15.49:0/3623946074 >> 172.21.15.49:0/3623946074 conn(0x7f4160094930 msgr2=0x7f416006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:25.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.387+0000 7f4164da2700 1 -- 172.21.15.49:0/3623946074 shutdown_connections 2023-11-30T17:08:25.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.387+0000 7f4164da2700 1 -- 172.21.15.49:0/3623946074 wait complete. 2023-11-30T17:08:25.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.388+0000 7f4164da2700 1 Processor -- start 2023-11-30T17:08:25.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.388+0000 7f4164da2700 1 -- start start 2023-11-30T17:08:25.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.389+0000 7f4164da2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41600a7ff0 0x7f4160147e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:25.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.389+0000 7f4164da2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41600aa220 0x7f41600c9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:25.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.389+0000 7f4164da2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4160154530 0x7f41600c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:25.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.389+0000 7f4164da2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41600ca260 con 0x7f4160154530 2023-11-30T17:08:25.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.389+0000 7f4164da2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41600ac840 con 0x7f41600aa220 2023-11-30T17:08:25.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.389+0000 7f4164da2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41600abf10 con 0x7f41600a7ff0 2023-11-30T17:08:25.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.389+0000 7f415ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4160154530 0x7f41600c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:25.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.389+0000 7f415ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4160154530 0x7f41600c9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46094/0 (socket says 172.21.15.49:46094) 2023-11-30T17:08:25.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.389+0000 7f415ed9d700 1 -- 172.21.15.49:0/1278568307 learned_addr learned my addr 172.21.15.49:0/1278568307 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:25.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.389+0000 7f415e59c700 1 --2- 172.21.15.49:0/1278568307 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41600a7ff0 0x7f4160147e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:25.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.389+0000 7f415ed9d700 1 -- 172.21.15.49:0/1278568307 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41600a7ff0 msgr2=0x7f4160147e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:25.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.389+0000 7f415dd9b700 1 --2- 172.21.15.49:0/1278568307 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41600aa220 0x7f41600c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:25.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.389+0000 7f415ed9d700 1 --2- 172.21.15.49:0/1278568307 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41600a7ff0 0x7f4160147e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:25.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.389+0000 7f415ed9d700 1 -- 172.21.15.49:0/1278568307 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41600aa220 msgr2=0x7f41600c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:25.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.389+0000 7f415ed9d700 1 --2- 172.21.15.49:0/1278568307 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41600aa220 0x7f41600c9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:25.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.389+0000 7f415ed9d700 1 -- 172.21.15.49:0/1278568307 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4158009250 con 0x7f4160154530 2023-11-30T17:08:25.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.390+0000 7f415ed9d700 1 --2- 172.21.15.49:0/1278568307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4160154530 0x7f41600c9d70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f4150001560 tx=0x7f4150001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:25.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.390+0000 7f41567fc700 1 -- 172.21.15.49:0/1278568307 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4150005d30 con 0x7f4160154530 2023-11-30T17:08:25.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.390+0000 7f41567fc700 1 -- 172.21.15.49:0/1278568307 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4150005e90 con 0x7f4160154530 2023-11-30T17:08:25.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.390+0000 7f4164da2700 1 -- 172.21.15.49:0/1278568307 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41600ac1f0 con 0x7f4160154530 2023-11-30T17:08:25.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.390+0000 7f41567fc700 1 -- 172.21.15.49:0/1278568307 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4150007320 con 0x7f4160154530 2023-11-30T17:08:25.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.390+0000 7f4164da2700 1 -- 172.21.15.49:0/1278568307 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4160148340 con 0x7f4160154530 2023-11-30T17:08:25.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.391+0000 7f4164da2700 1 -- 172.21.15.49:0/1278568307 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4160064a30 con 0x7f4160154530 2023-11-30T17:08:25.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.391+0000 7f41567fc700 1 -- 172.21.15.49:0/1278568307 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f4150007690 con 0x7f4160154530 2023-11-30T17:08:25.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.391+0000 7f41567fc700 1 --2- 172.21.15.49:0/1278568307 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f414005f350 0x7f4140061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:25.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.392+0000 7f41567fc700 1 -- 172.21.15.49:0/1278568307 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f415007a660 con 0x7f4160154530 2023-11-30T17:08:25.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.392+0000 7f415e59c700 1 --2- 172.21.15.49:0/1278568307 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f414005f350 0x7f4140061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:25.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.392+0000 7f415e59c700 1 --2- 172.21.15.49:0/1278568307 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f414005f350 0x7f4140061810 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f4158007fd0 tx=0x7f4158015000).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:25.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.396+0000 7f41567fc700 1 -- 172.21.15.49:0/1278568307 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f415004b680 con 0x7f4160154530 2023-11-30T17:08:25.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.591+0000 7f4164da2700 1 -- 172.21.15.49:0/1278568307 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f41600add40 con 0x7f414005f350 2023-11-30T17:08:25.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.596+0000 7f41567fc700 1 -- 172.21.15.49:0/1278568307 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f41600add40 con 0x7f414005f350 2023-11-30T17:08:25.598 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule set for path /snap_test_dir1/dir6 2023-11-30T17:08:25.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.598+0000 7f4164da2700 1 -- 172.21.15.49:0/1278568307 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f414005f350 msgr2=0x7f4140061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:25.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.598+0000 7f4164da2700 1 --2- 172.21.15.49:0/1278568307 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f414005f350 0x7f4140061810 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f4158007fd0 tx=0x7f4158015000).stop 2023-11-30T17:08:25.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.598+0000 7f4164da2700 1 -- 172.21.15.49:0/1278568307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4160154530 msgr2=0x7f41600c9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:25.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.598+0000 7f4164da2700 1 --2- 172.21.15.49:0/1278568307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4160154530 0x7f41600c9d70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f4150001560 tx=0x7f4150001650).stop 2023-11-30T17:08:25.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.598+0000 7f4164da2700 1 -- 172.21.15.49:0/1278568307 shutdown_connections 2023-11-30T17:08:25.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.598+0000 7f4164da2700 1 --2- 172.21.15.49:0/1278568307 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f414005f350 0x7f4140061810 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:25.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.598+0000 7f4164da2700 1 --2- 172.21.15.49:0/1278568307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4160154530 0x7f41600c9d70 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:25.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.598+0000 7f4164da2700 1 --2- 172.21.15.49:0/1278568307 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41600a7ff0 0x7f4160147e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:25.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.598+0000 7f4164da2700 1 --2- 172.21.15.49:0/1278568307 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41600aa220 0x7f41600c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:25.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.598+0000 7f4164da2700 1 -- 172.21.15.49:0/1278568307 >> 172.21.15.49:0/1278568307 conn(0x7f4160094930 msgr2=0x7f41600a8630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:25.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.598+0000 7f4164da2700 1 -- 172.21.15.49:0/1278568307 shutdown_connections 2023-11-30T17:08:25.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.598+0000 7f4164da2700 1 -- 172.21.15.49:0/1278568307 wait complete. 2023-11-30T17:08:25.612 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir6 2023-11-30T17:08:25.612 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:08:25.612 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir7) 2023-11-30T17:08:25.630 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir7 1M 2023-11-30T17:08:25.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.791+0000 7f234af97700 1 Processor -- start 2023-11-30T17:08:25.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.791+0000 7f234af97700 1 -- start start 2023-11-30T17:08:25.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.792+0000 7f234af97700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2344154530 0x7f2344154910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:25.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.792+0000 7f234af97700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f23440aa220 0x7f23440aa690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:25.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.792+0000 7f234af97700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23440c6630 con 0x7f23440a7ff0 2023-11-30T17:08:25.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.792+0000 7f234af97700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23440c6390 con 0x7f2344154530 2023-11-30T17:08:25.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.792+0000 7f234af97700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23440a8470 con 0x7f23440aa220 2023-11-30T17:08:25.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.792+0000 7f2348d33700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2344154530 0x7f2344154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:25.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.792+0000 7f2348d33700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2344154530 0x7f2344154910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46102/0 (socket says 172.21.15.49:46102) 2023-11-30T17:08:25.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.792+0000 7f2348d33700 1 -- 172.21.15.49:0/3311402959 learned_addr learned my addr 172.21.15.49:0/3311402959 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:25.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.792+0000 7f2343fff700 1 --1- 172.21.15.49:0/3311402959 >> v1:172.21.15.49:6789/0 conn(0x7f23440a7ff0 0x7f23440c8580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49040/0 (socket says 172.21.15.49:49040) 2023-11-30T17:08:25.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.792+0000 7f2349534700 1 --2- 172.21.15.49:0/3311402959 >> v2:172.21.15.115:3300/0 conn(0x7f23440aa220 0x7f23440aa690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:25.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.792+0000 7f2348d33700 1 -- 172.21.15.49:0/3311402959 >> v2:172.21.15.115:3300/0 conn(0x7f23440aa220 msgr2=0x7f23440aa690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:25.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.792+0000 7f2348d33700 1 --2- 172.21.15.49:0/3311402959 >> v2:172.21.15.115:3300/0 conn(0x7f23440aa220 0x7f23440aa690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:25.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.792+0000 7f2348d33700 1 -- 172.21.15.49:0/3311402959 >> v1:172.21.15.49:6789/0 conn(0x7f23440a7ff0 legacy=0x7f23440c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:25.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.792+0000 7f23437fe700 1 -- 172.21.15.49:0/3311402959 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 366421462 0 0) 0x7f23440c6630 con 0x7f23440a7ff0 2023-11-30T17:08:25.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.792+0000 7f2348d33700 1 -- 172.21.15.49:0/3311402959 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23440aab80 con 0x7f2344154530 2023-11-30T17:08:25.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.793+0000 7f2348d33700 1 --2- 172.21.15.49:0/3311402959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2344154530 0x7f2344154910 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f2344084a60 tx=0x7f233c009840).ready entity=mon.0 client_cookie=6923bf03af16bc4 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:25.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.793+0000 7f23437fe700 1 -- 172.21.15.49:0/3311402959 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c00e070 con 0x7f2344154530 2023-11-30T17:08:25.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.793+0000 7f23437fe700 1 -- 172.21.15.49:0/3311402959 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c00bad0 con 0x7f2344154530 2023-11-30T17:08:25.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.793+0000 7f23437fe700 1 -- 172.21.15.49:0/3311402959 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c00be50 con 0x7f2344154530 2023-11-30T17:08:25.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.793+0000 7f234af97700 1 -- 172.21.15.49:0/3311402959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2344154530 msgr2=0x7f2344154910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:25.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.793+0000 7f234af97700 1 --2- 172.21.15.49:0/3311402959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2344154530 0x7f2344154910 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f2344084a60 tx=0x7f233c009840).stop 2023-11-30T17:08:25.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.793+0000 7f234af97700 1 -- 172.21.15.49:0/3311402959 shutdown_connections 2023-11-30T17:08:25.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.793+0000 7f234af97700 1 --2- 172.21.15.49:0/3311402959 >> v2:172.21.15.115:3300/0 conn(0x7f23440aa220 0x7f23440aa690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:25.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.793+0000 7f234af97700 1 --2- 172.21.15.49:0/3311402959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2344154530 0x7f2344154910 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:25.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.793+0000 7f234af97700 1 -- 172.21.15.49:0/3311402959 >> 172.21.15.49:0/3311402959 conn(0x7f2344094930 msgr2=0x7f234406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:25.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.793+0000 7f234af97700 1 -- 172.21.15.49:0/3311402959 shutdown_connections 2023-11-30T17:08:25.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.793+0000 7f234af97700 1 -- 172.21.15.49:0/3311402959 wait complete. 2023-11-30T17:08:25.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.794+0000 7f234af97700 1 Processor -- start 2023-11-30T17:08:25.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.795+0000 7f234af97700 1 -- start start 2023-11-30T17:08:25.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.795+0000 7f234af97700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23440a7ff0 0x7f2344152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:25.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.795+0000 7f234af97700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23440aa220 0x7f23440aadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:25.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.795+0000 7f234af97700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2344154530 0x7f23440aca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:25.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.795+0000 7f234af97700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234413da50 con 0x7f23440aa220 2023-11-30T17:08:25.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.795+0000 7f234af97700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23440c2a90 con 0x7f23440a7ff0 2023-11-30T17:08:25.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.795+0000 7f234af97700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23440c2d70 con 0x7f2344154530 2023-11-30T17:08:25.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.795+0000 7f2343fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23440aa220 0x7f23440aadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:25.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.796+0000 7f2343fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23440aa220 0x7f23440aadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46108/0 (socket says 172.21.15.49:46108) 2023-11-30T17:08:25.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.796+0000 7f2343fff700 1 -- 172.21.15.49:0/1493665080 learned_addr learned my addr 172.21.15.49:0/1493665080 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:25.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.796+0000 7f2348d33700 1 --2- 172.21.15.49:0/1493665080 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23440a7ff0 0x7f2344152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:25.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.796+0000 7f2343fff700 1 -- 172.21.15.49:0/1493665080 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2344154530 msgr2=0x7f23440aca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:25.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.796+0000 7f2343fff700 1 --2- 172.21.15.49:0/1493665080 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2344154530 0x7f23440aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:08:25.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.796+0000 7f2343fff700 1 -- 172.21.15.49:0/1493665080 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23440a7ff0 msgr2=0x7f2344152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:25.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.796+0000 7f2343fff700 1 --2- 172.21.15.49:0/1493665080 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23440a7ff0 0x7f2344152dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:25.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.796+0000 7f2343fff700 1 -- 172.21.15.49:0/1493665080 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c009ae0 con 0x7f23440aa220 2023-11-30T17:08:25.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.796+0000 7f2343fff700 1 --2- 172.21.15.49:0/1493665080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23440aa220 0x7f23440aadd0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f232c00c560 tx=0x7f232c007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:25.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.796+0000 7f2340ff9700 1 -- 172.21.15.49:0/1493665080 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c0072e0 con 0x7f23440aa220 2023-11-30T17:08:25.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.796+0000 7f2340ff9700 1 -- 172.21.15.49:0/1493665080 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232c007440 con 0x7f23440aa220 2023-11-30T17:08:25.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.796+0000 7f234af97700 1 -- 172.21.15.49:0/1493665080 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23440c3050 con 0x7f23440aa220 2023-11-30T17:08:25.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.796+0000 7f2340ff9700 1 -- 172.21.15.49:0/1493665080 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c0058f0 con 0x7f23440aa220 2023-11-30T17:08:25.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.796+0000 7f234af97700 1 -- 172.21.15.49:0/1493665080 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23440c3610 con 0x7f23440aa220 2023-11-30T17:08:25.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.797+0000 7f234af97700 1 -- 172.21.15.49:0/1493665080 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23440c3830 con 0x7f23440aa220 2023-11-30T17:08:25.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.797+0000 7f2340ff9700 1 -- 172.21.15.49:0/1493665080 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f232c005ca0 con 0x7f23440aa220 2023-11-30T17:08:25.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.798+0000 7f2340ff9700 1 --2- 172.21.15.49:0/1493665080 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f232405f350 0x7f2324061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:25.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.798+0000 7f2340ff9700 1 -- 172.21.15.49:0/1493665080 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f232c079e90 con 0x7f23440aa220 2023-11-30T17:08:25.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.798+0000 7f2348d33700 1 --2- 172.21.15.49:0/1493665080 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f232405f350 0x7f2324061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:25.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.798+0000 7f2348d33700 1 --2- 172.21.15.49:0/1493665080 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f232405f350 0x7f2324061810 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f233c009fd0 tx=0x7f233c009840).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:25.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.802+0000 7f2340ff9700 1 -- 172.21.15.49:0/1493665080 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f232c04aeb0 con 0x7f23440aa220 2023-11-30T17:08:26.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:25.998+0000 7f234af97700 1 -- 172.21.15.49:0/1493665080 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f234406c860 con 0x7f232405f350 2023-11-30T17:08:26.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.002+0000 7f2340ff9700 1 -- 172.21.15.49:0/1493665080 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f234406c860 con 0x7f232405f350 2023-11-30T17:08:26.005 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule set for path /snap_test_dir1/dir7 2023-11-30T17:08:26.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.004+0000 7f234af97700 1 -- 172.21.15.49:0/1493665080 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f232405f350 msgr2=0x7f2324061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:26.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.004+0000 7f234af97700 1 --2- 172.21.15.49:0/1493665080 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f232405f350 0x7f2324061810 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f233c009fd0 tx=0x7f233c009840).stop 2023-11-30T17:08:26.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.004+0000 7f234af97700 1 -- 172.21.15.49:0/1493665080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23440aa220 msgr2=0x7f23440aadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:26.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.004+0000 7f234af97700 1 --2- 172.21.15.49:0/1493665080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23440aa220 0x7f23440aadd0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f232c00c560 tx=0x7f232c007c90).stop 2023-11-30T17:08:26.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.004+0000 7f234af97700 1 -- 172.21.15.49:0/1493665080 shutdown_connections 2023-11-30T17:08:26.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.004+0000 7f234af97700 1 --2- 172.21.15.49:0/1493665080 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2344154530 0x7f23440aca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:08:26.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.004+0000 7f234af97700 1 --2- 172.21.15.49:0/1493665080 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23440a7ff0 0x7f2344152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:26.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.004+0000 7f234af97700 1 --2- 172.21.15.49:0/1493665080 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f232405f350 0x7f2324061810 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:26.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.004+0000 7f234af97700 1 --2- 172.21.15.49:0/1493665080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23440aa220 0x7f23440aadd0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:26.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.004+0000 7f234af97700 1 -- 172.21.15.49:0/1493665080 >> 172.21.15.49:0/1493665080 conn(0x7f2344094930 msgr2=0x7f23440c6960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:26.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.005+0000 7f234af97700 1 -- 172.21.15.49:0/1493665080 shutdown_connections 2023-11-30T17:08:26.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.005+0000 7f234af97700 1 -- 172.21.15.49:0/1493665080 wait complete. 2023-11-30T17:08:26.019 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir7 2023-11-30T17:08:26.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:08:26.019 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir8) 2023-11-30T17:08:26.036 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir8 1M 2023-11-30T17:08:26.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.197+0000 7f9a264bc700 1 Processor -- start 2023-11-30T17:08:26.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.197+0000 7f9a264bc700 1 -- start start 2023-11-30T17:08:26.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.198+0000 7f9a264bc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9a20154610 0x7f9a201582e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:26.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.198+0000 7f9a264bc700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a20159210 con 0x7f9a200aa1c0 2023-11-30T17:08:26.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.198+0000 7f9a264bc700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a200c0c70 con 0x7f9a200ab3b0 2023-11-30T17:08:26.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.198+0000 7f9a264bc700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a20158970 con 0x7f9a20154610 2023-11-30T17:08:26.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.198+0000 7f9a1ffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9a20154610 0x7f9a201582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:26.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.198+0000 7f9a24a59700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9a200aa1c0 0x7f9a200c1100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49056/0 (socket says 172.21.15.49:49056) 2023-11-30T17:08:26.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.198+0000 7f9a24a59700 1 -- 172.21.15.49:0/1854219144 learned_addr learned my addr 172.21.15.49:0/1854219144 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:08:26.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.199+0000 7f9a1ffff700 1 -- 172.21.15.49:0/1854219144 >> v1:172.21.15.115:6789/0 conn(0x7f9a200ab3b0 legacy=0x7f9a200c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:26.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.199+0000 7f9a1ffff700 1 -- 172.21.15.49:0/1854219144 >> v1:172.21.15.49:6789/0 conn(0x7f9a200aa1c0 legacy=0x7f9a200c1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:26.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.199+0000 7f9a1ffff700 1 -- 172.21.15.49:0/1854219144 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a20158c50 con 0x7f9a20154610 2023-11-30T17:08:26.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.199+0000 7f9a1effd700 1 -- 172.21.15.49:0/1854219144 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1422751876 0 0) 0x7f9a20159210 con 0x7f9a200aa1c0 2023-11-30T17:08:26.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.199+0000 7f9a1ffff700 1 --2- 172.21.15.49:0/1854219144 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a20154610 0x7f9a201582e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f9a10009760 tx=0x7f9a10009060).ready entity=mon.0 client_cookie=29647855e09f789e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:26.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.199+0000 7f9a1effd700 1 -- 172.21.15.49:0/1854219144 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1000b580 con 0x7f9a20154610 2023-11-30T17:08:26.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.199+0000 7f9a1effd700 1 -- 172.21.15.49:0/1854219144 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1000b6e0 con 0x7f9a20154610 2023-11-30T17:08:26.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.199+0000 7f9a1effd700 1 -- 172.21.15.49:0/1854219144 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1000ba60 con 0x7f9a20154610 2023-11-30T17:08:26.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.199+0000 7f9a264bc700 1 -- 172.21.15.49:0/1854219144 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a20154610 msgr2=0x7f9a201582e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:26.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.199+0000 7f9a264bc700 1 --2- 172.21.15.49:0/1854219144 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a20154610 0x7f9a201582e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f9a10009760 tx=0x7f9a10009060).stop 2023-11-30T17:08:26.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.199+0000 7f9a264bc700 1 -- 172.21.15.49:0/1854219144 shutdown_connections 2023-11-30T17:08:26.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.199+0000 7f9a264bc700 1 --2- 172.21.15.49:0/1854219144 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a20154610 0x7f9a201582e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:26.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.199+0000 7f9a264bc700 1 -- 172.21.15.49:0/1854219144 >> 172.21.15.49:0/1854219144 conn(0x7f9a200655a0 msgr2=0x7f9a20069e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:26.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.200+0000 7f9a264bc700 1 -- 172.21.15.49:0/1854219144 shutdown_connections 2023-11-30T17:08:26.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.200+0000 7f9a264bc700 1 -- 172.21.15.49:0/1854219144 wait complete. 2023-11-30T17:08:26.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.201+0000 7f9a264bc700 1 Processor -- start 2023-11-30T17:08:26.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.201+0000 7f9a264bc700 1 -- start start 2023-11-30T17:08:26.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.202+0000 7f9a264bc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a200aa1c0 0x7f9a201570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:26.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.202+0000 7f9a264bc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a20154610 0x7f9a201556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:26.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.202+0000 7f9a264bc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a200c2cd0 0x7f9a200b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:26.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.202+0000 7f9a264bc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a201549f0 con 0x7f9a20154610 2023-11-30T17:08:26.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.202+0000 7f9a264bc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a201575d0 con 0x7f9a200c2cd0 2023-11-30T17:08:26.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.202+0000 7f9a264bc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a20155ba0 con 0x7f9a200aa1c0 2023-11-30T17:08:26.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.202+0000 7f9a1f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a20154610 0x7f9a201556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:26.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.202+0000 7f9a1f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a20154610 0x7f9a201556b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46122/0 (socket says 172.21.15.49:46122) 2023-11-30T17:08:26.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.202+0000 7f9a1f7fe700 1 -- 172.21.15.49:0/3077519002 learned_addr learned my addr 172.21.15.49:0/3077519002 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:26.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.202+0000 7f9a1ffff700 1 --2- 172.21.15.49:0/3077519002 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a200aa1c0 0x7f9a201570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:26.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.202+0000 7f9a24a59700 1 --2- 172.21.15.49:0/3077519002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a200c2cd0 0x7f9a200b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:26.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.202+0000 7f9a1f7fe700 1 -- 172.21.15.49:0/3077519002 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a200aa1c0 msgr2=0x7f9a201570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:26.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.202+0000 7f9a1f7fe700 1 --2- 172.21.15.49:0/3077519002 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a200aa1c0 0x7f9a201570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:26.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.202+0000 7f9a1f7fe700 1 -- 172.21.15.49:0/3077519002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a200c2cd0 msgr2=0x7f9a200b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:26.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.202+0000 7f9a1f7fe700 1 --2- 172.21.15.49:0/3077519002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a200c2cd0 0x7f9a200b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:26.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.202+0000 7f9a1f7fe700 1 -- 172.21.15.49:0/3077519002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a100092a0 con 0x7f9a20154610 2023-11-30T17:08:26.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.202+0000 7f9a1ffff700 1 --2- 172.21.15.49:0/3077519002 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a200aa1c0 0x7f9a201570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:08:26.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.202+0000 7f9a24a59700 1 --2- 172.21.15.49:0/3077519002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a200c2cd0 0x7f9a200b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:08:26.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.202+0000 7f9a1f7fe700 1 --2- 172.21.15.49:0/3077519002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a20154610 0x7f9a201556b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f9a0800c4f0 tx=0x7f9a08007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:26.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.202+0000 7f9a17fff700 1 -- 172.21.15.49:0/3077519002 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a08007020 con 0x7f9a20154610 2023-11-30T17:08:26.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.202+0000 7f9a17fff700 1 -- 172.21.15.49:0/3077519002 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a08007180 con 0x7f9a20154610 2023-11-30T17:08:26.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.202+0000 7f9a264bc700 1 -- 172.21.15.49:0/3077519002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a201577c0 con 0x7f9a20154610 2023-11-30T17:08:26.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.202+0000 7f9a17fff700 1 -- 172.21.15.49:0/3077519002 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a08007520 con 0x7f9a20154610 2023-11-30T17:08:26.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.202+0000 7f9a264bc700 1 -- 172.21.15.49:0/3077519002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a20154eb0 con 0x7f9a20154610 2023-11-30T17:08:26.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.204+0000 7f9a264bc700 1 -- 172.21.15.49:0/3077519002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a2006c860 con 0x7f9a20154610 2023-11-30T17:08:26.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.204+0000 7f9a17fff700 1 -- 172.21.15.49:0/3077519002 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f9a080068b0 con 0x7f9a20154610 2023-11-30T17:08:26.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.204+0000 7f9a17fff700 1 --2- 172.21.15.49:0/3077519002 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a0005f380 0x7f9a00061840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:26.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.204+0000 7f9a17fff700 1 -- 172.21.15.49:0/3077519002 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f9a08079960 con 0x7f9a20154610 2023-11-30T17:08:26.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.204+0000 7f9a1ffff700 1 --2- 172.21.15.49:0/3077519002 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a0005f380 0x7f9a00061840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:26.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.205+0000 7f9a1ffff700 1 --2- 172.21.15.49:0/3077519002 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a0005f380 0x7f9a00061840 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f9a1000b340 tx=0x7f9a10017000).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:26.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.208+0000 7f9a17fff700 1 -- 172.21.15.49:0/3077519002 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9a08047b00 con 0x7f9a20154610 2023-11-30T17:08:26.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.408+0000 7f9a264bc700 1 -- 172.21.15.49:0/3077519002 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a200ad7c0 con 0x7f9a0005f380 2023-11-30T17:08:26.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.413+0000 7f9a17fff700 1 -- 172.21.15.49:0/3077519002 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f9a200ad7c0 con 0x7f9a0005f380 2023-11-30T17:08:26.415 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule set for path /snap_test_dir1/dir8 2023-11-30T17:08:26.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.415+0000 7f9a264bc700 1 -- 172.21.15.49:0/3077519002 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a0005f380 msgr2=0x7f9a00061840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:26.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.415+0000 7f9a264bc700 1 --2- 172.21.15.49:0/3077519002 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a0005f380 0x7f9a00061840 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f9a1000b340 tx=0x7f9a10017000).stop 2023-11-30T17:08:26.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.415+0000 7f9a264bc700 1 -- 172.21.15.49:0/3077519002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a20154610 msgr2=0x7f9a201556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:26.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.415+0000 7f9a264bc700 1 --2- 172.21.15.49:0/3077519002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a20154610 0x7f9a201556b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f9a0800c4f0 tx=0x7f9a08007dd0).stop 2023-11-30T17:08:26.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.415+0000 7f9a264bc700 1 -- 172.21.15.49:0/3077519002 shutdown_connections 2023-11-30T17:08:26.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.415+0000 7f9a264bc700 1 --2- 172.21.15.49:0/3077519002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a200c2cd0 0x7f9a200b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:26.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.415+0000 7f9a264bc700 1 --2- 172.21.15.49:0/3077519002 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a200aa1c0 0x7f9a201570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:26.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.415+0000 7f9a264bc700 1 --2- 172.21.15.49:0/3077519002 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a0005f380 0x7f9a00061840 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:26.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.415+0000 7f9a264bc700 1 --2- 172.21.15.49:0/3077519002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a20154610 0x7f9a201556b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:26.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.415+0000 7f9a264bc700 1 -- 172.21.15.49:0/3077519002 >> 172.21.15.49:0/3077519002 conn(0x7f9a200655a0 msgr2=0x7f9a201534d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:26.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.415+0000 7f9a264bc700 1 -- 172.21.15.49:0/3077519002 shutdown_connections 2023-11-30T17:08:26.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.415+0000 7f9a264bc700 1 -- 172.21.15.49:0/3077519002 wait complete. 2023-11-30T17:08:26.431 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir8 2023-11-30T17:08:26.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:08:26.431 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir9) 2023-11-30T17:08:26.448 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir9 1M 2023-11-30T17:08:26.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.608+0000 7fd794d66700 1 Processor -- start 2023-11-30T17:08:26.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.608+0000 7fd794d66700 1 -- start start 2023-11-30T17:08:26.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.609+0000 7fd794d66700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd7901542d0 0x7fd7900a9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:26.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.609+0000 7fd794d66700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd7900c66d0 0x7fd7900aa460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:26.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.609+0000 7fd794d66700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd790158d50 con 0x7fd7901546b0 2023-11-30T17:08:26.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.609+0000 7fd794d66700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7900c6b60 con 0x7fd7901542d0 2023-11-30T17:08:26.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.609+0000 7fd794d66700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7900aa950 con 0x7fd7900c66d0 2023-11-30T17:08:26.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.609+0000 7fd78effd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd7901546b0 0x7fd7900c5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49064/0 (socket says 172.21.15.49:49064) 2023-11-30T17:08:26.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.609+0000 7fd78effd700 1 -- 172.21.15.49:0/3289319660 learned_addr learned my addr 172.21.15.49:0/3289319660 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:08:26.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.609+0000 7fd78f7fe700 1 --2- 172.21.15.49:0/3289319660 >> v2:172.21.15.115:3300/0 conn(0x7fd7901542d0 0x7fd7900a9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:26.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.609+0000 7fd78ffff700 1 --2- 172.21.15.49:0/3289319660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd7900c66d0 0x7fd7900aa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:26.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.609+0000 7fd78e7fc700 1 -- 172.21.15.49:0/3289319660 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3886383019 0 0) 0x7fd790158d50 con 0x7fd7901546b0 2023-11-30T17:08:26.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.609+0000 7fd78e7fc700 1 -- 172.21.15.49:0/3289319660 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7780033f0 con 0x7fd7901546b0 2023-11-30T17:08:26.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.609+0000 7fd78e7fc700 1 -- 172.21.15.49:0/3289319660 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2559851167 0 0) 0x7fd7780033f0 con 0x7fd7901546b0 2023-11-30T17:08:26.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.609+0000 7fd78e7fc700 1 -- 172.21.15.49:0/3289319660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd7900c66d0 msgr2=0x7fd7900aa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:26.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.609+0000 7fd78e7fc700 1 --2- 172.21.15.49:0/3289319660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd7900c66d0 0x7fd7900aa460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:26.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.609+0000 7fd78e7fc700 1 -- 172.21.15.49:0/3289319660 >> v2:172.21.15.115:3300/0 conn(0x7fd7901542d0 msgr2=0x7fd7900a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:26.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.609+0000 7fd78e7fc700 1 --2- 172.21.15.49:0/3289319660 >> v2:172.21.15.115:3300/0 conn(0x7fd7901542d0 0x7fd7900a9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:26.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.609+0000 7fd78e7fc700 1 -- 172.21.15.49:0/3289319660 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd790158140 con 0x7fd7901546b0 2023-11-30T17:08:26.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.609+0000 7fd78e7fc700 1 -- 172.21.15.49:0/3289319660 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fd784001470 con 0x7fd7901546b0 2023-11-30T17:08:26.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.609+0000 7fd78e7fc700 1 -- 172.21.15.49:0/3289319660 >> v1:172.21.15.49:6789/0 conn(0x7fd7901546b0 legacy=0x7fd7900c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:26.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.610+0000 7fd78e7fc700 1 --2- 172.21.15.49:0/3289319660 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7780038e0 0x7fd778003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:26.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.610+0000 7fd78e7fc700 1 --2- 172.21.15.49:0/3289319660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd7900c66d0 0x7fd778004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:26.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.610+0000 7fd78e7fc700 1 --2- 172.21.15.49:0/3289319660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd778004b80 0x7fd778005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:26.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.610+0000 7fd78e7fc700 1 -- 172.21.15.49:0/3289319660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7900aa950 con 0x7fd778004b80 2023-11-30T17:08:26.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.610+0000 7fd78e7fc700 1 -- 172.21.15.49:0/3289319660 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7780044f0 con 0x7fd7780038e0 2023-11-30T17:08:26.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.610+0000 7fd78e7fc700 1 -- 172.21.15.49:0/3289319660 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77800b960 con 0x7fd7900c66d0 2023-11-30T17:08:26.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.610+0000 7fd78ffff700 1 --2- 172.21.15.49:0/3289319660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd778004b80 0x7fd778005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:26.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.610+0000 7fd78f7fe700 1 --2- 172.21.15.49:0/3289319660 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7780038e0 0x7fd778003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:26.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.610+0000 7fd78effd700 1 --2- 172.21.15.49:0/3289319660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd7900c66d0 0x7fd778004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:26.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.610+0000 7fd78ffff700 1 -- 172.21.15.49:0/3289319660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd7900c66d0 msgr2=0x7fd778004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:26.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.610+0000 7fd78ffff700 1 --2- 172.21.15.49:0/3289319660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd7900c66d0 0x7fd778004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:26.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.610+0000 7fd78ffff700 1 -- 172.21.15.49:0/3289319660 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7780038e0 msgr2=0x7fd778003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:26.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.610+0000 7fd78ffff700 1 --2- 172.21.15.49:0/3289319660 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7780038e0 0x7fd778003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:26.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.610+0000 7fd78ffff700 1 -- 172.21.15.49:0/3289319660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7780033f0 con 0x7fd778004b80 2023-11-30T17:08:26.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.610+0000 7fd78ffff700 1 --2- 172.21.15.49:0/3289319660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd778004b80 0x7fd778005000 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7fd78800e210 tx=0x7fd78800b040).ready entity=mon.0 client_cookie=58653ecadc6768f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:26.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.610+0000 7fd78e7fc700 1 -- 172.21.15.49:0/3289319660 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd788009ac0 con 0x7fd778004b80 2023-11-30T17:08:26.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.610+0000 7fd78e7fc700 1 -- 172.21.15.49:0/3289319660 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78800f040 con 0x7fd778004b80 2023-11-30T17:08:26.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.610+0000 7fd78e7fc700 1 -- 172.21.15.49:0/3289319660 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78800ecd0 con 0x7fd778004b80 2023-11-30T17:08:26.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.611+0000 7fd794d66700 1 -- 172.21.15.49:0/3289319660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd778004b80 msgr2=0x7fd778005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:26.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.611+0000 7fd794d66700 1 --2- 172.21.15.49:0/3289319660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd778004b80 0x7fd778005000 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7fd78800e210 tx=0x7fd78800b040).stop 2023-11-30T17:08:26.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.611+0000 7fd78ffff700 1 -- 172.21.15.49:0/3289319660 reap_dead start 2023-11-30T17:08:26.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.611+0000 7fd794d66700 1 -- 172.21.15.49:0/3289319660 shutdown_connections 2023-11-30T17:08:26.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.611+0000 7fd794d66700 1 -- 172.21.15.49:0/3289319660 >> 172.21.15.49:0/3289319660 conn(0x7fd7900cb010 msgr2=0x7fd7900cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:26.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.611+0000 7fd794d66700 1 -- 172.21.15.49:0/3289319660 shutdown_connections 2023-11-30T17:08:26.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.611+0000 7fd794d66700 1 -- 172.21.15.49:0/3289319660 wait complete. 2023-11-30T17:08:26.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.612+0000 7fd794d66700 1 Processor -- start 2023-11-30T17:08:26.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.612+0000 7fd794d66700 1 -- start start 2023-11-30T17:08:26.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.613+0000 7fd794d66700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd778004b80 0x7fd790155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:26.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.613+0000 7fd794d66700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd790163f70 0x7fd7901643f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:26.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.613+0000 7fd794d66700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd790156ce0 0x7fd790157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:26.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.613+0000 7fd794d66700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7900ab750 con 0x7fd778004b80 2023-11-30T17:08:26.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.613+0000 7fd794d66700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7900abd10 con 0x7fd790163f70 2023-11-30T17:08:26.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.613+0000 7fd794d66700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7900b0da0 con 0x7fd790156ce0 2023-11-30T17:08:26.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.613+0000 7fd78f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd778004b80 0x7fd790155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:26.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.613+0000 7fd78f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd778004b80 0x7fd790155260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46140/0 (socket says 172.21.15.49:46140) 2023-11-30T17:08:26.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.613+0000 7fd78f7fe700 1 -- 172.21.15.49:0/397496228 learned_addr learned my addr 172.21.15.49:0/397496228 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:26.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.613+0000 7fd78effd700 1 --2- 172.21.15.49:0/397496228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd790163f70 0x7fd7901643f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:26.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.613+0000 7fd78ffff700 1 --2- 172.21.15.49:0/397496228 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd790156ce0 0x7fd790157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:26.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.613+0000 7fd78f7fe700 1 -- 172.21.15.49:0/397496228 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd790156ce0 msgr2=0x7fd790157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:26.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.613+0000 7fd78f7fe700 1 --2- 172.21.15.49:0/397496228 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd790156ce0 0x7fd790157140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:26.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.613+0000 7fd78f7fe700 1 -- 172.21.15.49:0/397496228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd790163f70 msgr2=0x7fd7901643f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:26.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.613+0000 7fd78f7fe700 1 --2- 172.21.15.49:0/397496228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd790163f70 0x7fd7901643f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:26.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.613+0000 7fd78f7fe700 1 -- 172.21.15.49:0/397496228 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd790164aa0 con 0x7fd778004b80 2023-11-30T17:08:26.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.613+0000 7fd78f7fe700 1 --2- 172.21.15.49:0/397496228 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd778004b80 0x7fd790155260 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fd7800119f0 tx=0x7fd780009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:26.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.613+0000 7fd7777fe700 1 -- 172.21.15.49:0/397496228 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78000f8e0 con 0x7fd778004b80 2023-11-30T17:08:26.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.614+0000 7fd7777fe700 1 -- 172.21.15.49:0/397496228 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78000fa40 con 0x7fd778004b80 2023-11-30T17:08:26.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.614+0000 7fd794d66700 1 -- 172.21.15.49:0/397496228 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd790164d80 con 0x7fd778004b80 2023-11-30T17:08:26.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.614+0000 7fd7777fe700 1 -- 172.21.15.49:0/397496228 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78000fdc0 con 0x7fd778004b80 2023-11-30T17:08:26.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.614+0000 7fd794d66700 1 -- 172.21.15.49:0/397496228 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd790157630 con 0x7fd778004b80 2023-11-30T17:08:26.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.615+0000 7fd794d66700 1 -- 172.21.15.49:0/397496228 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7900abb60 con 0x7fd778004b80 2023-11-30T17:08:26.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.615+0000 7fd7777fe700 1 -- 172.21.15.49:0/397496228 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7fd780014650 con 0x7fd778004b80 2023-11-30T17:08:26.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.615+0000 7fd7777fe700 1 --2- 172.21.15.49:0/397496228 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd77c05f350 0x7fd77c061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:26.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.615+0000 7fd7777fe700 1 -- 172.21.15.49:0/397496228 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fd78007b030 con 0x7fd778004b80 2023-11-30T17:08:26.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.615+0000 7fd78effd700 1 --2- 172.21.15.49:0/397496228 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd77c05f350 0x7fd77c061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:26.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.616+0000 7fd78effd700 1 --2- 172.21.15.49:0/397496228 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd77c05f350 0x7fd77c061810 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fd784000e10 tx=0x7fd784009040).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:26.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.619+0000 7fd7777fe700 1 -- 172.21.15.49:0/397496228 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd78004c050 con 0x7fd778004b80 2023-11-30T17:08:26.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.818+0000 7fd794d66700 1 -- 172.21.15.49:0/397496228 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7900abe50 con 0x7fd77c05f350 2023-11-30T17:08:26.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.823+0000 7fd7777fe700 1 -- 172.21.15.49:0/397496228 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fd784007a60 con 0x7fd77c05f350 2023-11-30T17:08:26.825 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule set for path /snap_test_dir1/dir9 2023-11-30T17:08:26.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.825+0000 7fd794d66700 1 -- 172.21.15.49:0/397496228 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd77c05f350 msgr2=0x7fd77c061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:26.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.825+0000 7fd794d66700 1 --2- 172.21.15.49:0/397496228 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd77c05f350 0x7fd77c061810 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fd784000e10 tx=0x7fd784009040).stop 2023-11-30T17:08:26.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.825+0000 7fd794d66700 1 -- 172.21.15.49:0/397496228 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd778004b80 msgr2=0x7fd790155260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:26.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.825+0000 7fd794d66700 1 --2- 172.21.15.49:0/397496228 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd778004b80 0x7fd790155260 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fd7800119f0 tx=0x7fd780009060).stop 2023-11-30T17:08:26.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.825+0000 7fd794d66700 1 -- 172.21.15.49:0/397496228 shutdown_connections 2023-11-30T17:08:26.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.825+0000 7fd794d66700 1 --2- 172.21.15.49:0/397496228 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd790156ce0 0x7fd790157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:26.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.825+0000 7fd794d66700 1 --2- 172.21.15.49:0/397496228 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd77c05f350 0x7fd77c061810 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:26.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.825+0000 7fd794d66700 1 --2- 172.21.15.49:0/397496228 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd778004b80 0x7fd790155260 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:26.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.825+0000 7fd794d66700 1 --2- 172.21.15.49:0/397496228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd790163f70 0x7fd7901643f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:26.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.825+0000 7fd794d66700 1 -- 172.21.15.49:0/397496228 >> 172.21.15.49:0/397496228 conn(0x7fd7900cb010 msgr2=0x7fd790064880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:26.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.825+0000 7fd794d66700 1 -- 172.21.15.49:0/397496228 shutdown_connections 2023-11-30T17:08:26.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.825+0000 7fd794d66700 1 -- 172.21.15.49:0/397496228 wait complete. 2023-11-30T17:08:26.843 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir9 2023-11-30T17:08:26.843 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir0 1M 2023-11-30T17:08:26.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.963+0000 7f0ac4014700 1 Processor -- start 2023-11-30T17:08:26.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.963+0000 7f0ac4014700 1 -- start start 2023-11-30T17:08:26.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.964+0000 7f0ac4014700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0abc13ab60 0x7f0abc067780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:26.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.964+0000 7f0ac4014700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0abc1556f0 0x7f0abc0bd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:26.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.964+0000 7f0ac4014700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0abc0bddb0 con 0x7f0abc13af40 2023-11-30T17:08:26.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.964+0000 7f0ac4014700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0abc067c70 con 0x7f0abc13ab60 2023-11-30T17:08:26.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.964+0000 7f0ac4014700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc0c3510 con 0x7f0abc1556f0 2023-11-30T17:08:26.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.964+0000 7f0ac25b1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0abc1556f0 0x7f0abc0bd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:26.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.964+0000 7f0ac15af700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f0abc13af40 0x7f0abc154fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:55692/0 (socket says 172.21.15.49:55692) 2023-11-30T17:08:26.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.964+0000 7f0ac1db0700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0abc13ab60 0x7f0abc067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:26.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.964+0000 7f0ac15af700 1 -- 172.21.15.49:0/2484025824 learned_addr learned my addr 172.21.15.49:0/2484025824 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:08:26.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.965+0000 7f0ac1db0700 1 -- 172.21.15.49:0/2484025824 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0abc1556f0 msgr2=0x7f0abc0bd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:26.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.965+0000 7f0ac1db0700 1 --2- 172.21.15.49:0/2484025824 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0abc1556f0 0x7f0abc0bd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:26.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.965+0000 7f0ac1db0700 1 -- 172.21.15.49:0/2484025824 >> v1:172.21.15.115:6789/0 conn(0x7f0abc13af40 legacy=0x7f0abc154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:26.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.965+0000 7f0ac0dae700 1 -- 172.21.15.49:0/2484025824 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50733208 0 0) 0x7f0abc0bddb0 con 0x7f0abc13af40 2023-11-30T17:08:26.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.965+0000 7f0ac1db0700 1 -- 172.21.15.49:0/2484025824 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0abc0bdfe0 con 0x7f0abc13ab60 2023-11-30T17:08:26.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.965+0000 7f0ac1db0700 1 --2- 172.21.15.49:0/2484025824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0abc13ab60 0x7f0abc067780 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f0aac009e60 tx=0x7f0aac009780).ready entity=mon.1 client_cookie=91002de001894307 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:26.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.965+0000 7f0ac0dae700 1 -- 172.21.15.49:0/2484025824 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac00e070 con 0x7f0abc13ab60 2023-11-30T17:08:26.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.965+0000 7f0ac0dae700 1 -- 172.21.15.49:0/2484025824 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aac00bb60 con 0x7f0abc13ab60 2023-11-30T17:08:26.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.965+0000 7f0ac0dae700 1 -- 172.21.15.49:0/2484025824 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac012410 con 0x7f0abc13ab60 2023-11-30T17:08:26.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.966+0000 7f0ac4014700 1 -- 172.21.15.49:0/2484025824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0abc13ab60 msgr2=0x7f0abc067780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:26.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.966+0000 7f0ac4014700 1 --2- 172.21.15.49:0/2484025824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0abc13ab60 0x7f0abc067780 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f0aac009e60 tx=0x7f0aac009780).stop 2023-11-30T17:08:26.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.966+0000 7f0ac4014700 1 -- 172.21.15.49:0/2484025824 shutdown_connections 2023-11-30T17:08:26.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.966+0000 7f0ac4014700 1 --2- 172.21.15.49:0/2484025824 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0abc1556f0 0x7f0abc0bd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:26.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.966+0000 7f0ac4014700 1 --2- 172.21.15.49:0/2484025824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0abc13ab60 0x7f0abc067780 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:26.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.966+0000 7f0ac4014700 1 -- 172.21.15.49:0/2484025824 >> 172.21.15.49:0/2484025824 conn(0x7f0abc063810 msgr2=0x7f0abc063c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:26.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.966+0000 7f0ac4014700 1 -- 172.21.15.49:0/2484025824 shutdown_connections 2023-11-30T17:08:26.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.966+0000 7f0ac4014700 1 -- 172.21.15.49:0/2484025824 wait complete. 2023-11-30T17:08:26.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.967+0000 7f0ac4014700 1 Processor -- start 2023-11-30T17:08:26.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.967+0000 7f0ac4014700 1 -- start start 2023-11-30T17:08:26.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.968+0000 7f0ac4014700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0abc13ab60 0x7f0abc0a7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:26.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.968+0000 7f0ac4014700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0abc13af40 0x7f0abc150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:26.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.968+0000 7f0ac4014700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0abc1556f0 0x7f0abc153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:26.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.968+0000 7f0ac4014700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc0a7f90 con 0x7f0abc13af40 2023-11-30T17:08:26.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.968+0000 7f0ac4014700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc0aaab0 con 0x7f0abc13ab60 2023-11-30T17:08:26.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.968+0000 7f0ac4014700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc1650d0 con 0x7f0abc1556f0 2023-11-30T17:08:26.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.968+0000 7f0ac15af700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0abc13af40 0x7f0abc150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:26.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.968+0000 7f0ac15af700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0abc13af40 0x7f0abc150c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46146/0 (socket says 172.21.15.49:46146) 2023-11-30T17:08:26.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.968+0000 7f0ac15af700 1 -- 172.21.15.49:0/3378189904 learned_addr learned my addr 172.21.15.49:0/3378189904 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:26.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.968+0000 7f0ac1db0700 1 --2- 172.21.15.49:0/3378189904 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0abc13ab60 0x7f0abc0a7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:26.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.968+0000 7f0ac25b1700 1 --2- 172.21.15.49:0/3378189904 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0abc1556f0 0x7f0abc153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:26.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.968+0000 7f0ac15af700 1 -- 172.21.15.49:0/3378189904 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0abc1556f0 msgr2=0x7f0abc153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:26.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.968+0000 7f0ac15af700 1 --2- 172.21.15.49:0/3378189904 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0abc1556f0 0x7f0abc153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:26.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.968+0000 7f0ac15af700 1 -- 172.21.15.49:0/3378189904 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0abc13ab60 msgr2=0x7f0abc0a7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:26.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.968+0000 7f0ac15af700 1 --2- 172.21.15.49:0/3378189904 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0abc13ab60 0x7f0abc0a7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:26.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.968+0000 7f0ac15af700 1 -- 172.21.15.49:0/3378189904 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aac009a20 con 0x7f0abc13af40 2023-11-30T17:08:26.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.968+0000 7f0ac1db0700 1 --2- 172.21.15.49:0/3378189904 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0abc13ab60 0x7f0abc0a7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:08:26.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.968+0000 7f0ac15af700 1 --2- 172.21.15.49:0/3378189904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0abc13af40 0x7f0abc150c40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f0ab000c4e0 tx=0x7f0ab0007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:26.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.968+0000 7f0ab9ffb700 1 -- 172.21.15.49:0/3378189904 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab000ce90 con 0x7f0abc13af40 2023-11-30T17:08:26.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.968+0000 7f0ab9ffb700 1 -- 172.21.15.49:0/3378189904 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab00072e0 con 0x7f0abc13af40 2023-11-30T17:08:26.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.968+0000 7f0ac4014700 1 -- 172.21.15.49:0/3378189904 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0abc1653b0 con 0x7f0abc13af40 2023-11-30T17:08:26.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.968+0000 7f0ab9ffb700 1 -- 172.21.15.49:0/3378189904 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0007660 con 0x7f0abc13af40 2023-11-30T17:08:26.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.969+0000 7f0ac4014700 1 -- 172.21.15.49:0/3378189904 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0abc165970 con 0x7f0abc13af40 2023-11-30T17:08:26.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.970+0000 7f0ac4014700 1 -- 172.21.15.49:0/3378189904 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0abc06c860 con 0x7f0abc13af40 2023-11-30T17:08:26.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.970+0000 7f0ab9ffb700 1 -- 172.21.15.49:0/3378189904 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f0ab00059b0 con 0x7f0abc13af40 2023-11-30T17:08:26.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.970+0000 7f0ab9ffb700 1 --2- 172.21.15.49:0/3378189904 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0aa805f350 0x7f0aa8061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:26.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.970+0000 7f0ab9ffb700 1 -- 172.21.15.49:0/3378189904 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f0ab0079c60 con 0x7f0abc13af40 2023-11-30T17:08:26.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.970+0000 7f0ac1db0700 1 --2- 172.21.15.49:0/3378189904 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0aa805f350 0x7f0aa8061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:26.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.971+0000 7f0ac1db0700 1 --2- 172.21.15.49:0/3378189904 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0aa805f350 0x7f0aa8061810 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f0aac009fd0 tx=0x7f0aac009780).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:26.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:26.975+0000 7f0ab9ffb700 1 -- 172.21.15.49:0/3378189904 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0ab004ac80 con 0x7f0abc13af40 2023-11-30T17:08:27.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.174+0000 7f0ac4014700 1 -- 172.21.15.49:0/3378189904 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f0abc05ecf0 con 0x7f0aa805f350 2023-11-30T17:08:27.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.180+0000 7f0ab9ffb700 1 -- 172.21.15.49:0/3378189904 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f0abc05ecf0 con 0x7f0aa805f350 2023-11-30T17:08:27.182 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule activated for path /snap_test_dir1/dir0 2023-11-30T17:08:27.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.182+0000 7f0ac4014700 1 -- 172.21.15.49:0/3378189904 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0aa805f350 msgr2=0x7f0aa8061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:27.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.182+0000 7f0ac4014700 1 --2- 172.21.15.49:0/3378189904 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0aa805f350 0x7f0aa8061810 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f0aac009fd0 tx=0x7f0aac009780).stop 2023-11-30T17:08:27.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.182+0000 7f0ac4014700 1 -- 172.21.15.49:0/3378189904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0abc13af40 msgr2=0x7f0abc150c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:27.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.182+0000 7f0ac4014700 1 --2- 172.21.15.49:0/3378189904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0abc13af40 0x7f0abc150c40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f0ab000c4e0 tx=0x7f0ab0007c70).stop 2023-11-30T17:08:27.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.182+0000 7f0ac4014700 1 -- 172.21.15.49:0/3378189904 shutdown_connections 2023-11-30T17:08:27.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.182+0000 7f0ac4014700 1 --2- 172.21.15.49:0/3378189904 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0abc1556f0 0x7f0abc153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:27.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.182+0000 7f0ac4014700 1 --2- 172.21.15.49:0/3378189904 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0abc13ab60 0x7f0abc0a7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:27.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.182+0000 7f0ac4014700 1 --2- 172.21.15.49:0/3378189904 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0aa805f350 0x7f0aa8061810 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:27.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.182+0000 7f0ac4014700 1 --2- 172.21.15.49:0/3378189904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0abc13af40 0x7f0abc150c40 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:27.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.182+0000 7f0ac4014700 1 -- 172.21.15.49:0/3378189904 >> 172.21.15.49:0/3378189904 conn(0x7f0abc063810 msgr2=0x7f0abc137c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:27.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.182+0000 7f0ac4014700 1 -- 172.21.15.49:0/3378189904 shutdown_connections 2023-11-30T17:08:27.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.182+0000 7f0ac4014700 1 -- 172.21.15.49:0/3378189904 wait complete. 2023-11-30T17:08:27.197 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir0 2023-11-30T17:08:27.197 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir1 1M 2023-11-30T17:08:27.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.318+0000 7fcbf253b700 1 Processor -- start 2023-11-30T17:08:27.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.318+0000 7fcbf253b700 1 -- start start 2023-11-30T17:08:27.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.318+0000 7fcbf253b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbec0ab3b0 0x7fcbec1582e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:27.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.318+0000 7fcbf253b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcbec0aa1c0 0x7fcbec0aa630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:27.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.318+0000 7fcbf253b700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbec159210 con 0x7fcbec154610 2023-11-30T17:08:27.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.318+0000 7fcbf253b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbec0c0c70 con 0x7fcbec0aa1c0 2023-11-30T17:08:27.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.318+0000 7fcbf253b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec0c2110 con 0x7fcbec0ab3b0 2023-11-30T17:08:27.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.319+0000 7fcbebfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcbec154610 0x7fcbec0c80c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49076/0 (socket says 172.21.15.49:49076) 2023-11-30T17:08:27.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.319+0000 7fcbebfff700 1 -- 172.21.15.49:0/1762033853 learned_addr learned my addr 172.21.15.49:0/1762033853 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:08:27.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.319+0000 7fcbf0ad8700 1 --2- 172.21.15.49:0/1762033853 >> v2:172.21.15.115:3300/0 conn(0x7fcbec0aa1c0 0x7fcbec0aa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:27.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.319+0000 7fcbeb7fe700 1 --2- 172.21.15.49:0/1762033853 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbec0ab3b0 0x7fcbec1582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:27.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.319+0000 7fcbeaffd700 1 -- 172.21.15.49:0/1762033853 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2193578136 0 0) 0x7fcbec159210 con 0x7fcbec154610 2023-11-30T17:08:27.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.319+0000 7fcbeaffd700 1 -- 172.21.15.49:0/1762033853 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbd40033f0 con 0x7fcbec154610 2023-11-30T17:08:27.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.319+0000 7fcbeaffd700 1 -- 172.21.15.49:0/1762033853 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 799343731 0 0) 0x7fcbd40033f0 con 0x7fcbec154610 2023-11-30T17:08:27.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.319+0000 7fcbeaffd700 1 -- 172.21.15.49:0/1762033853 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbec0ab3b0 msgr2=0x7fcbec1582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:27.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.319+0000 7fcbeaffd700 1 --2- 172.21.15.49:0/1762033853 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbec0ab3b0 0x7fcbec1582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:27.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.319+0000 7fcbeaffd700 1 -- 172.21.15.49:0/1762033853 >> v2:172.21.15.115:3300/0 conn(0x7fcbec0aa1c0 msgr2=0x7fcbec0aa630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:27.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.319+0000 7fcbeaffd700 1 --2- 172.21.15.49:0/1762033853 >> v2:172.21.15.115:3300/0 conn(0x7fcbec0aa1c0 0x7fcbec0aa630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:27.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.319+0000 7fcbeaffd700 1 -- 172.21.15.49:0/1762033853 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbec0aab20 con 0x7fcbec154610 2023-11-30T17:08:27.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.319+0000 7fcbeaffd700 1 -- 172.21.15.49:0/1762033853 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fcbdc001470 con 0x7fcbec154610 2023-11-30T17:08:27.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.319+0000 7fcbeaffd700 1 -- 172.21.15.49:0/1762033853 >> v1:172.21.15.49:6789/0 conn(0x7fcbec154610 legacy=0x7fcbec0c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:27.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.319+0000 7fcbeaffd700 1 --2- 172.21.15.49:0/1762033853 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbd40038e0 0x7fcbd4003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:27.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.319+0000 7fcbeaffd700 1 --2- 172.21.15.49:0/1762033853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbd40041f0 0x7fcbd40046d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:27.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.319+0000 7fcbeaffd700 1 --2- 172.21.15.49:0/1762033853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbd4004cf0 0x7fcbd4005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:27.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.319+0000 7fcbeaffd700 1 -- 172.21.15.49:0/1762033853 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec0c0c70 con 0x7fcbd4004cf0 2023-11-30T17:08:27.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.319+0000 7fcbeaffd700 1 -- 172.21.15.49:0/1762033853 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec0c2110 con 0x7fcbd40041f0 2023-11-30T17:08:27.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.319+0000 7fcbeaffd700 1 -- 172.21.15.49:0/1762033853 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd400bc20 con 0x7fcbd40038e0 2023-11-30T17:08:27.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.319+0000 7fcbf0ad8700 1 --2- 172.21.15.49:0/1762033853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbd4004cf0 0x7fcbd4005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:27.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.319+0000 7fcbebfff700 1 --2- 172.21.15.49:0/1762033853 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbd40038e0 0x7fcbd4003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:27.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.319+0000 7fcbeb7fe700 1 --2- 172.21.15.49:0/1762033853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbd40041f0 0x7fcbd40046d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:27.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.320+0000 7fcbf0ad8700 1 -- 172.21.15.49:0/1762033853 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbd40038e0 msgr2=0x7fcbd4003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:27.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.320+0000 7fcbf0ad8700 1 --2- 172.21.15.49:0/1762033853 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbd40038e0 0x7fcbd4003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:27.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.320+0000 7fcbf0ad8700 1 -- 172.21.15.49:0/1762033853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbd40041f0 msgr2=0x7fcbd40046d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:27.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.320+0000 7fcbf0ad8700 1 --2- 172.21.15.49:0/1762033853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbd40041f0 0x7fcbd40046d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:27.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.320+0000 7fcbf0ad8700 1 -- 172.21.15.49:0/1762033853 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd40033f0 con 0x7fcbd4004cf0 2023-11-30T17:08:27.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.320+0000 7fcbf0ad8700 1 --2- 172.21.15.49:0/1762033853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbd4004cf0 0x7fcbd4005170 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7fcbe400e210 tx=0x7fcbe400b040).ready entity=mon.0 client_cookie=58c416c3805600a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:27.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.320+0000 7fcbeaffd700 1 -- 172.21.15.49:0/1762033853 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4009ac0 con 0x7fcbd4004cf0 2023-11-30T17:08:27.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.320+0000 7fcbeaffd700 1 -- 172.21.15.49:0/1762033853 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe400f040 con 0x7fcbd4004cf0 2023-11-30T17:08:27.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.320+0000 7fcbeaffd700 1 -- 172.21.15.49:0/1762033853 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe400ecd0 con 0x7fcbd4004cf0 2023-11-30T17:08:27.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.320+0000 7fcbf253b700 1 -- 172.21.15.49:0/1762033853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbd4004cf0 msgr2=0x7fcbd4005170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:27.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.320+0000 7fcbf253b700 1 --2- 172.21.15.49:0/1762033853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbd4004cf0 0x7fcbd4005170 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7fcbe400e210 tx=0x7fcbe400b040).stop 2023-11-30T17:08:27.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.320+0000 7fcbf0ad8700 1 -- 172.21.15.49:0/1762033853 reap_dead start 2023-11-30T17:08:27.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.320+0000 7fcbf253b700 1 -- 172.21.15.49:0/1762033853 shutdown_connections 2023-11-30T17:08:27.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.320+0000 7fcbf253b700 1 -- 172.21.15.49:0/1762033853 >> 172.21.15.49:0/1762033853 conn(0x7fcbec0655a0 msgr2=0x7fcbec069e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:27.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.321+0000 7fcbf253b700 1 -- 172.21.15.49:0/1762033853 shutdown_connections 2023-11-30T17:08:27.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.321+0000 7fcbf253b700 1 -- 172.21.15.49:0/1762033853 wait complete. 2023-11-30T17:08:27.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.322+0000 7fcbf253b700 1 Processor -- start 2023-11-30T17:08:27.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.322+0000 7fcbf253b700 1 -- start start 2023-11-30T17:08:27.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.323+0000 7fcbf253b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbd4004cf0 0x7fcbec0afa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:27.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.323+0000 7fcbf253b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbec1647d0 0x7fcbec14d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:27.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.323+0000 7fcbf253b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbec14da80 0x7fcbec0c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:27.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.323+0000 7fcbf253b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec14dee0 con 0x7fcbec14da80 2023-11-30T17:08:27.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.323+0000 7fcbf253b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec0c5010 con 0x7fcbec1647d0 2023-11-30T17:08:27.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.323+0000 7fcbf253b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec0c52f0 con 0x7fcbd4004cf0 2023-11-30T17:08:27.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.323+0000 7fcbf0ad8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbec14da80 0x7fcbec0c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:27.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.323+0000 7fcbf0ad8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbec14da80 0x7fcbec0c3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46158/0 (socket says 172.21.15.49:46158) 2023-11-30T17:08:27.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.323+0000 7fcbf0ad8700 1 -- 172.21.15.49:0/4038431008 learned_addr learned my addr 172.21.15.49:0/4038431008 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:27.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.323+0000 7fcbebfff700 1 --2- 172.21.15.49:0/4038431008 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbd4004cf0 0x7fcbec0afa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:27.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.323+0000 7fcbeb7fe700 1 --2- 172.21.15.49:0/4038431008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbec1647d0 0x7fcbec14d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:27.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.323+0000 7fcbf0ad8700 1 -- 172.21.15.49:0/4038431008 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbd4004cf0 msgr2=0x7fcbec0afa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:27.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.323+0000 7fcbf0ad8700 1 --2- 172.21.15.49:0/4038431008 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbd4004cf0 0x7fcbec0afa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:27.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.323+0000 7fcbf0ad8700 1 -- 172.21.15.49:0/4038431008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbec1647d0 msgr2=0x7fcbec14d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:27.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.323+0000 7fcbf0ad8700 1 --2- 172.21.15.49:0/4038431008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbec1647d0 0x7fcbec14d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:27.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.323+0000 7fcbf0ad8700 1 -- 172.21.15.49:0/4038431008 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbec154d50 con 0x7fcbec14da80 2023-11-30T17:08:27.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.323+0000 7fcbf0ad8700 1 --2- 172.21.15.49:0/4038431008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbec14da80 0x7fcbec0c3f90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7fcbe4014000 tx=0x7fcbe401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:27.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.323+0000 7fcbd3fff700 1 -- 172.21.15.49:0/4038431008 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4021030 con 0x7fcbec14da80 2023-11-30T17:08:27.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.323+0000 7fcbd3fff700 1 -- 172.21.15.49:0/4038431008 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe4009ac0 con 0x7fcbec14da80 2023-11-30T17:08:27.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.323+0000 7fcbf253b700 1 -- 172.21.15.49:0/4038431008 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbec155030 con 0x7fcbec14da80 2023-11-30T17:08:27.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.323+0000 7fcbd3fff700 1 -- 172.21.15.49:0/4038431008 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4013d10 con 0x7fcbec14da80 2023-11-30T17:08:27.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.323+0000 7fcbf253b700 1 -- 172.21.15.49:0/4038431008 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbec0c4480 con 0x7fcbec14da80 2023-11-30T17:08:27.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.324+0000 7fcbf253b700 1 -- 172.21.15.49:0/4038431008 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbec06c860 con 0x7fcbec14da80 2023-11-30T17:08:27.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.325+0000 7fcbd3fff700 1 -- 172.21.15.49:0/4038431008 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7fcbe4024070 con 0x7fcbec14da80 2023-11-30T17:08:27.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.325+0000 7fcbd3fff700 1 --2- 172.21.15.49:0/4038431008 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcbd805f350 0x7fcbd8061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:27.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.325+0000 7fcbd3fff700 1 -- 172.21.15.49:0/4038431008 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fcbe4022070 con 0x7fcbec14da80 2023-11-30T17:08:27.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.325+0000 7fcbebfff700 1 --2- 172.21.15.49:0/4038431008 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcbd805f350 0x7fcbd8061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:27.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.326+0000 7fcbebfff700 1 --2- 172.21.15.49:0/4038431008 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcbd805f350 0x7fcbd8061810 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fcbdc007860 tx=0x7fcbdc001e90).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:27.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.329+0000 7fcbd3fff700 1 -- 172.21.15.49:0/4038431008 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcbe404cbc0 con 0x7fcbec14da80 2023-11-30T17:08:27.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.530+0000 7fcbf253b700 1 -- 172.21.15.49:0/4038431008 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbec0c0540 con 0x7fcbd805f350 2023-11-30T17:08:27.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.535+0000 7fcbd3fff700 1 -- 172.21.15.49:0/4038431008 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fcbec0c0540 con 0x7fcbd805f350 2023-11-30T17:08:27.537 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule activated for path /snap_test_dir1/dir1 2023-11-30T17:08:27.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.536+0000 7fcbf253b700 1 -- 172.21.15.49:0/4038431008 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcbd805f350 msgr2=0x7fcbd8061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:27.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.536+0000 7fcbf253b700 1 --2- 172.21.15.49:0/4038431008 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcbd805f350 0x7fcbd8061810 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fcbdc007860 tx=0x7fcbdc001e90).stop 2023-11-30T17:08:27.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.536+0000 7fcbf253b700 1 -- 172.21.15.49:0/4038431008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbec14da80 msgr2=0x7fcbec0c3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:27.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.536+0000 7fcbf253b700 1 --2- 172.21.15.49:0/4038431008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbec14da80 0x7fcbec0c3f90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7fcbe4014000 tx=0x7fcbe401a000).stop 2023-11-30T17:08:27.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.536+0000 7fcbf253b700 1 -- 172.21.15.49:0/4038431008 shutdown_connections 2023-11-30T17:08:27.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.536+0000 7fcbf253b700 1 --2- 172.21.15.49:0/4038431008 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcbd805f350 0x7fcbd8061810 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:27.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.536+0000 7fcbf253b700 1 --2- 172.21.15.49:0/4038431008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbec14da80 0x7fcbec0c3f90 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:27.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.536+0000 7fcbf253b700 1 --2- 172.21.15.49:0/4038431008 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbd4004cf0 0x7fcbec0afa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:27.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.536+0000 7fcbf253b700 1 --2- 172.21.15.49:0/4038431008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbec1647d0 0x7fcbec14d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.536+0000 7fcbf253b700 1 -- 172.21.15.49:0/4038431008 >> 172.21.15.49:0/4038431008 conn(0x7fcbec0655a0 msgr2=0x7fcbec0c9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.537+0000 7fcbf253b700 1 -- 172.21.15.49:0/4038431008 shutdown_connections 2023-11-30T17:08:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.537+0000 7fcbf253b700 1 -- 172.21.15.49:0/4038431008 wait complete. 2023-11-30T17:08:27.551 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir1 2023-11-30T17:08:27.551 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir2 1M 2023-11-30T17:08:27.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.673+0000 7f9d4002b700 1 Processor -- start 2023-11-30T17:08:27.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.673+0000 7f9d4002b700 1 -- start start 2023-11-30T17:08:27.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.674+0000 7f9d4002b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d3814b320 0x7f9d38151f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:27.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.674+0000 7f9d4002b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9d3814b700 0x7f9d380bbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:27.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.674+0000 7f9d4002b700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d381523f0 con 0x7f9d380646a0 2023-11-30T17:08:27.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.674+0000 7f9d4002b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d380c3040 con 0x7f9d3814b700 2023-11-30T17:08:27.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.674+0000 7f9d4002b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380bd140 con 0x7f9d3814b320 2023-11-30T17:08:27.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.674+0000 7f9d3e5c8700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9d380646a0 0x7f9d38064ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49082/0 (socket says 172.21.15.49:49082) 2023-11-30T17:08:27.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.674+0000 7f9d3e5c8700 1 -- 172.21.15.49:0/1485982226 learned_addr learned my addr 172.21.15.49:0/1485982226 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:08:27.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.674+0000 7f9d3d5c6700 1 --2- 172.21.15.49:0/1485982226 >> v2:172.21.15.115:3300/0 conn(0x7f9d3814b700 0x7f9d380bbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:27.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.674+0000 7f9d3ddc7700 1 --2- 172.21.15.49:0/1485982226 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d3814b320 0x7f9d38151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:27.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.674+0000 7f9d3cdc5700 1 -- 172.21.15.49:0/1485982226 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1841555291 0 0) 0x7f9d381523f0 con 0x7f9d380646a0 2023-11-30T17:08:27.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.674+0000 7f9d3cdc5700 1 -- 172.21.15.49:0/1485982226 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d200033f0 con 0x7f9d380646a0 2023-11-30T17:08:27.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.675+0000 7f9d3cdc5700 1 -- 172.21.15.49:0/1485982226 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1787752153 0 0) 0x7f9d200033f0 con 0x7f9d380646a0 2023-11-30T17:08:27.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.675+0000 7f9d3cdc5700 1 -- 172.21.15.49:0/1485982226 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d3814b320 msgr2=0x7f9d38151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:27.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.675+0000 7f9d3cdc5700 1 --2- 172.21.15.49:0/1485982226 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d3814b320 0x7f9d38151f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:27.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.675+0000 7f9d3cdc5700 1 -- 172.21.15.49:0/1485982226 >> v2:172.21.15.115:3300/0 conn(0x7f9d3814b700 msgr2=0x7f9d380bbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:27.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.675+0000 7f9d3cdc5700 1 --2- 172.21.15.49:0/1485982226 >> v2:172.21.15.115:3300/0 conn(0x7f9d3814b700 0x7f9d380bbde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:27.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.675+0000 7f9d3cdc5700 1 -- 172.21.15.49:0/1485982226 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d380bc2d0 con 0x7f9d380646a0 2023-11-30T17:08:27.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.675+0000 7f9d3cdc5700 1 -- 172.21.15.49:0/1485982226 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f9d280017f0 con 0x7f9d380646a0 2023-11-30T17:08:27.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.675+0000 7f9d3cdc5700 1 -- 172.21.15.49:0/1485982226 >> v1:172.21.15.49:6789/0 conn(0x7f9d380646a0 legacy=0x7f9d38064ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:27.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.675+0000 7f9d3cdc5700 1 --2- 172.21.15.49:0/1485982226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d200038e0 0x7f9d20003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:27.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.675+0000 7f9d3cdc5700 1 --2- 172.21.15.49:0/1485982226 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d3814b320 0x7f9d20004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:27.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.675+0000 7f9d3cdc5700 1 --2- 172.21.15.49:0/1485982226 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d20004b80 0x7f9d20005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:27.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.675+0000 7f9d3cdc5700 1 -- 172.21.15.49:0/1485982226 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380c3040 con 0x7f9d20004b80 2023-11-30T17:08:27.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.675+0000 7f9d3cdc5700 1 -- 172.21.15.49:0/1485982226 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380bd140 con 0x7f9d200038e0 2023-11-30T17:08:27.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.675+0000 7f9d3cdc5700 1 -- 172.21.15.49:0/1485982226 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2000b8e0 con 0x7f9d3814b320 2023-11-30T17:08:27.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.675+0000 7f9d3e5c8700 1 --2- 172.21.15.49:0/1485982226 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d20004b80 0x7f9d20005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:27.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.675+0000 7f9d3ddc7700 1 --2- 172.21.15.49:0/1485982226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d200038e0 0x7f9d20003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:27.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.675+0000 7f9d3d5c6700 1 --2- 172.21.15.49:0/1485982226 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d3814b320 0x7f9d20004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:27.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.675+0000 7f9d3ddc7700 1 -- 172.21.15.49:0/1485982226 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d3814b320 msgr2=0x7f9d20004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:27.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.675+0000 7f9d3ddc7700 1 --2- 172.21.15.49:0/1485982226 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d3814b320 0x7f9d20004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:27.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.675+0000 7f9d3ddc7700 1 -- 172.21.15.49:0/1485982226 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d20004b80 msgr2=0x7f9d20005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:27.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.675+0000 7f9d3ddc7700 1 --2- 172.21.15.49:0/1485982226 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d20004b80 0x7f9d20005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:27.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.675+0000 7f9d3ddc7700 1 -- 172.21.15.49:0/1485982226 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d200033f0 con 0x7f9d200038e0 2023-11-30T17:08:27.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.675+0000 7f9d3e5c8700 1 --2- 172.21.15.49:0/1485982226 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d20004b80 0x7f9d20005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:08:27.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.675+0000 7f9d3ddc7700 1 --2- 172.21.15.49:0/1485982226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d200038e0 0x7f9d20003d00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f9d30009a80 tx=0x7f9d30009060).ready entity=mon.1 client_cookie=9061d66c4d03e082 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:27.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.675+0000 7f9d3cdc5700 1 -- 172.21.15.49:0/1485982226 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d30009430 con 0x7f9d200038e0 2023-11-30T17:08:27.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.676+0000 7f9d3cdc5700 1 -- 172.21.15.49:0/1485982226 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3000e640 con 0x7f9d200038e0 2023-11-30T17:08:27.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.676+0000 7f9d3cdc5700 1 -- 172.21.15.49:0/1485982226 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3000e9c0 con 0x7f9d200038e0 2023-11-30T17:08:27.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.676+0000 7f9d4002b700 1 -- 172.21.15.49:0/1485982226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d200038e0 msgr2=0x7f9d20003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:27.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.676+0000 7f9d4002b700 1 --2- 172.21.15.49:0/1485982226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d200038e0 0x7f9d20003d00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f9d30009a80 tx=0x7f9d30009060).stop 2023-11-30T17:08:27.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.676+0000 7f9d3e5c8700 1 -- 172.21.15.49:0/1485982226 reap_dead start 2023-11-30T17:08:27.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.676+0000 7f9d4002b700 1 -- 172.21.15.49:0/1485982226 shutdown_connections 2023-11-30T17:08:27.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.676+0000 7f9d4002b700 1 -- 172.21.15.49:0/1485982226 >> 172.21.15.49:0/1485982226 conn(0x7f9d38062700 msgr2=0x7f9d38062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:27.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.676+0000 7f9d4002b700 1 -- 172.21.15.49:0/1485982226 shutdown_connections 2023-11-30T17:08:27.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.676+0000 7f9d4002b700 1 -- 172.21.15.49:0/1485982226 wait complete. 2023-11-30T17:08:27.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.677+0000 7f9d4002b700 1 Processor -- start 2023-11-30T17:08:27.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.677+0000 7f9d4002b700 1 -- start start 2023-11-30T17:08:27.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.678+0000 7f9d4002b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d200038e0 0x7f9d3814bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:27.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.678+0000 7f9d4002b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d3813c490 0x7f9d3813c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:27.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.678+0000 7f9d4002b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d3814d820 0x7f9d3814dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:27.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.678+0000 7f9d4002b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3814ecd0 con 0x7f9d3814d820 2023-11-30T17:08:27.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.678+0000 7f9d4002b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380c5210 con 0x7f9d3813c490 2023-11-30T17:08:27.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.678+0000 7f9d4002b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3814bfd0 con 0x7f9d200038e0 2023-11-30T17:08:27.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.678+0000 7f9d3e5c8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d3814d820 0x7f9d3814dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:27.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.678+0000 7f9d3e5c8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d3814d820 0x7f9d3814dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46176/0 (socket says 172.21.15.49:46176) 2023-11-30T17:08:27.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.678+0000 7f9d3e5c8700 1 -- 172.21.15.49:0/2928277406 learned_addr learned my addr 172.21.15.49:0/2928277406 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:27.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.678+0000 7f9d3ddc7700 1 --2- 172.21.15.49:0/2928277406 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d200038e0 0x7f9d3814bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:27.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.679+0000 7f9d3d5c6700 1 --2- 172.21.15.49:0/2928277406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d3813c490 0x7f9d3813c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:27.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.679+0000 7f9d3e5c8700 1 -- 172.21.15.49:0/2928277406 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d200038e0 msgr2=0x7f9d3814bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:27.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.679+0000 7f9d3e5c8700 1 --2- 172.21.15.49:0/2928277406 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d200038e0 0x7f9d3814bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:27.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.679+0000 7f9d3e5c8700 1 -- 172.21.15.49:0/2928277406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d3813c490 msgr2=0x7f9d3813c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:27.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.679+0000 7f9d3e5c8700 1 --2- 172.21.15.49:0/2928277406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d3813c490 0x7f9d3813c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:27.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.679+0000 7f9d3e5c8700 1 -- 172.21.15.49:0/2928277406 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3814e710 con 0x7f9d3814d820 2023-11-30T17:08:27.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.679+0000 7f9d3d5c6700 1 --2- 172.21.15.49:0/2928277406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d3813c490 0x7f9d3813c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:08:27.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.679+0000 7f9d3e5c8700 1 --2- 172.21.15.49:0/2928277406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d3814d820 0x7f9d3814dc60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f9d28000f80 tx=0x7f9d380bd280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:27.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.679+0000 7f9d35ffb700 1 -- 172.21.15.49:0/2928277406 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d28007e70 con 0x7f9d3814d820 2023-11-30T17:08:27.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.679+0000 7f9d35ffb700 1 -- 172.21.15.49:0/2928277406 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2800ca80 con 0x7f9d3814d820 2023-11-30T17:08:27.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.679+0000 7f9d4002b700 1 -- 172.21.15.49:0/2928277406 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d3814e9f0 con 0x7f9d3814d820 2023-11-30T17:08:27.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.679+0000 7f9d35ffb700 1 -- 172.21.15.49:0/2928277406 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2800ce40 con 0x7f9d3814d820 2023-11-30T17:08:27.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.679+0000 7f9d4002b700 1 -- 172.21.15.49:0/2928277406 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d3813ce00 con 0x7f9d3814d820 2023-11-30T17:08:27.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.680+0000 7f9d4002b700 1 -- 172.21.15.49:0/2928277406 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d380c4d00 con 0x7f9d3814d820 2023-11-30T17:08:27.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.681+0000 7f9d35ffb700 1 -- 172.21.15.49:0/2928277406 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f9d28012560 con 0x7f9d3814d820 2023-11-30T17:08:27.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.681+0000 7f9d35ffb700 1 --2- 172.21.15.49:0/2928277406 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9d2405f350 0x7f9d24061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:27.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.681+0000 7f9d35ffb700 1 -- 172.21.15.49:0/2928277406 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f9d2807a080 con 0x7f9d3814d820 2023-11-30T17:08:27.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.681+0000 7f9d3ddc7700 1 --2- 172.21.15.49:0/2928277406 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9d2405f350 0x7f9d24061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:27.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.682+0000 7f9d3ddc7700 1 --2- 172.21.15.49:0/2928277406 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9d2405f350 0x7f9d24061810 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f9d30006d50 tx=0x7f9d3001a000).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:27.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.685+0000 7f9d35ffb700 1 -- 172.21.15.49:0/2928277406 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9d380c4d00 con 0x7f9d3814d820 2023-11-30T17:08:27.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.887+0000 7f9d4002b700 1 -- 172.21.15.49:0/2928277406 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d380c4d00 con 0x7f9d2405f350 2023-11-30T17:08:27.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.892+0000 7f9d35ffb700 1 -- 172.21.15.49:0/2928277406 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f9d380c4d00 con 0x7f9d2405f350 2023-11-30T17:08:27.894 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule activated for path /snap_test_dir1/dir2 2023-11-30T17:08:27.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.894+0000 7f9d4002b700 1 -- 172.21.15.49:0/2928277406 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9d2405f350 msgr2=0x7f9d24061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:27.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.894+0000 7f9d4002b700 1 --2- 172.21.15.49:0/2928277406 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9d2405f350 0x7f9d24061810 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f9d30006d50 tx=0x7f9d3001a000).stop 2023-11-30T17:08:27.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.894+0000 7f9d4002b700 1 -- 172.21.15.49:0/2928277406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d3814d820 msgr2=0x7f9d3814dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:27.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.894+0000 7f9d4002b700 1 --2- 172.21.15.49:0/2928277406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d3814d820 0x7f9d3814dc60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f9d28000f80 tx=0x7f9d380bd280).stop 2023-11-30T17:08:27.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.894+0000 7f9d4002b700 1 -- 172.21.15.49:0/2928277406 shutdown_connections 2023-11-30T17:08:27.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.894+0000 7f9d4002b700 1 --2- 172.21.15.49:0/2928277406 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9d2405f350 0x7f9d24061810 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:27.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.894+0000 7f9d4002b700 1 --2- 172.21.15.49:0/2928277406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d3814d820 0x7f9d3814dc60 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:27.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.894+0000 7f9d4002b700 1 --2- 172.21.15.49:0/2928277406 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d200038e0 0x7f9d3814bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:27.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.894+0000 7f9d4002b700 1 --2- 172.21.15.49:0/2928277406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d3813c490 0x7f9d3813c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:27.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.894+0000 7f9d4002b700 1 -- 172.21.15.49:0/2928277406 >> 172.21.15.49:0/2928277406 conn(0x7f9d38062700 msgr2=0x7f9d38064a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:27.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.894+0000 7f9d4002b700 1 -- 172.21.15.49:0/2928277406 shutdown_connections 2023-11-30T17:08:27.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:27.894+0000 7f9d4002b700 1 -- 172.21.15.49:0/2928277406 wait complete. 2023-11-30T17:08:27.908 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir2 2023-11-30T17:08:27.908 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir3 1M 2023-11-30T17:08:28.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.029+0000 7eff2393d700 1 Processor -- start 2023-11-30T17:08:28.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.029+0000 7eff2393d700 1 -- start start 2023-11-30T17:08:28.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.030+0000 7eff2393d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff1c154910 0x7eff1c0a7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:28.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.030+0000 7eff2393d700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1c0c6630 con 0x7eff1c0aa220 2023-11-30T17:08:28.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.030+0000 7eff2393d700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1c064230 con 0x7eff1c154530 2023-11-30T17:08:28.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.030+0000 7eff2393d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c0c6390 con 0x7eff1c154910 2023-11-30T17:08:28.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.030+0000 7eff21eda700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7eff1c0aa220 0x7eff1c0c6ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49088/0 (socket says 172.21.15.49:49088) 2023-11-30T17:08:28.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.030+0000 7eff21eda700 1 -- 172.21.15.49:0/2532365493 learned_addr learned my addr 172.21.15.49:0/2532365493 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:08:28.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.030+0000 7eff20ed8700 1 --2- 172.21.15.49:0/2532365493 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff1c154910 0x7eff1c0a7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:28.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.030+0000 7eff1bfff700 1 -- 172.21.15.49:0/2532365493 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2691859376 0 0) 0x7eff1c0c6630 con 0x7eff1c0aa220 2023-11-30T17:08:28.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.030+0000 7eff1bfff700 1 -- 172.21.15.49:0/2532365493 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff040033f0 con 0x7eff1c0aa220 2023-11-30T17:08:28.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.031+0000 7eff1bfff700 1 -- 172.21.15.49:0/2532365493 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3704258008 0 0) 0x7eff1c064230 con 0x7eff1c154530 2023-11-30T17:08:28.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.031+0000 7eff1bfff700 1 -- 172.21.15.49:0/2532365493 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff1c0c6630 con 0x7eff1c154530 2023-11-30T17:08:28.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.031+0000 7eff1bfff700 1 -- 172.21.15.49:0/2532365493 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2761252427 0 0) 0x7eff040033f0 con 0x7eff1c0aa220 2023-11-30T17:08:28.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.031+0000 7eff1bfff700 1 -- 172.21.15.49:0/2532365493 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff1c154910 msgr2=0x7eff1c0a7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:28.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.031+0000 7eff1bfff700 1 --2- 172.21.15.49:0/2532365493 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff1c154910 0x7eff1c0a7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:28.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.031+0000 7eff1bfff700 1 -- 172.21.15.49:0/2532365493 >> v1:172.21.15.115:6789/0 conn(0x7eff1c154530 legacy=0x7eff1c0c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:28.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.031+0000 7eff1bfff700 1 -- 172.21.15.49:0/2532365493 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c064510 con 0x7eff1c0aa220 2023-11-30T17:08:28.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.031+0000 7eff1bfff700 1 -- 172.21.15.49:0/2532365493 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7eff140017f0 con 0x7eff1c0aa220 2023-11-30T17:08:28.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.031+0000 7eff20ed8700 1 --2- 172.21.15.49:0/2532365493 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff1c154910 0x7eff1c0a7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:08:28.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.031+0000 7eff1bfff700 1 -- 172.21.15.49:0/2532365493 >> v1:172.21.15.49:6789/0 conn(0x7eff1c0aa220 legacy=0x7eff1c0c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:28.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.031+0000 7eff1bfff700 1 --2- 172.21.15.49:0/2532365493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff04003aa0 0x7eff04003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:28.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.031+0000 7eff1bfff700 1 --2- 172.21.15.49:0/2532365493 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff1c154910 0x7eff04004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:28.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.031+0000 7eff1bfff700 1 --2- 172.21.15.49:0/2532365493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff04004b80 0x7eff04005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:28.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.031+0000 7eff1bfff700 1 -- 172.21.15.49:0/2532365493 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c0c6390 con 0x7eff04004b80 2023-11-30T17:08:28.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.031+0000 7eff1bfff700 1 -- 172.21.15.49:0/2532365493 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0400b8e0 con 0x7eff04003aa0 2023-11-30T17:08:28.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.031+0000 7eff1bfff700 1 -- 172.21.15.49:0/2532365493 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0400ba70 con 0x7eff1c154910 2023-11-30T17:08:28.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.031+0000 7eff21eda700 1 --2- 172.21.15.49:0/2532365493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff04004b80 0x7eff04005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:28.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.031+0000 7eff216d9700 1 --2- 172.21.15.49:0/2532365493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff04003aa0 0x7eff04003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:28.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.031+0000 7eff20ed8700 1 --2- 172.21.15.49:0/2532365493 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff1c154910 0x7eff04004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:28.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.031+0000 7eff21eda700 1 -- 172.21.15.49:0/2532365493 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff1c154910 msgr2=0x7eff04004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:28.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.031+0000 7eff21eda700 1 --2- 172.21.15.49:0/2532365493 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff1c154910 0x7eff04004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:28.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.031+0000 7eff21eda700 1 -- 172.21.15.49:0/2532365493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff04003aa0 msgr2=0x7eff04003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:28.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.031+0000 7eff21eda700 1 --2- 172.21.15.49:0/2532365493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff04003aa0 0x7eff04003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:28.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.031+0000 7eff21eda700 1 -- 172.21.15.49:0/2532365493 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff100092a0 con 0x7eff04004b80 2023-11-30T17:08:28.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.031+0000 7eff21eda700 1 --2- 172.21.15.49:0/2532365493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff04004b80 0x7eff04005000 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7eff1400c5c0 tx=0x7eff14007f40).ready entity=mon.0 client_cookie=935ab13e00ec589d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:28.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.032+0000 7eff1bfff700 1 -- 172.21.15.49:0/2532365493 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1400cdc0 con 0x7eff04004b80 2023-11-30T17:08:28.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.032+0000 7eff1bfff700 1 -- 172.21.15.49:0/2532365493 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff14005b20 con 0x7eff04004b80 2023-11-30T17:08:28.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.032+0000 7eff1bfff700 1 -- 172.21.15.49:0/2532365493 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff14005ea0 con 0x7eff04004b80 2023-11-30T17:08:28.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.032+0000 7eff2393d700 1 -- 172.21.15.49:0/2532365493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff04004b80 msgr2=0x7eff04005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:28.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.032+0000 7eff2393d700 1 --2- 172.21.15.49:0/2532365493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff04004b80 0x7eff04005000 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7eff1400c5c0 tx=0x7eff14007f40).stop 2023-11-30T17:08:28.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.032+0000 7eff21eda700 1 -- 172.21.15.49:0/2532365493 reap_dead start 2023-11-30T17:08:28.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.032+0000 7eff2393d700 1 -- 172.21.15.49:0/2532365493 shutdown_connections 2023-11-30T17:08:28.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.032+0000 7eff2393d700 1 -- 172.21.15.49:0/2532365493 >> 172.21.15.49:0/2532365493 conn(0x7eff1c094930 msgr2=0x7eff1c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:28.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.032+0000 7eff2393d700 1 -- 172.21.15.49:0/2532365493 shutdown_connections 2023-11-30T17:08:28.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.032+0000 7eff2393d700 1 -- 172.21.15.49:0/2532365493 wait complete. 2023-11-30T17:08:28.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.033+0000 7eff2393d700 1 Processor -- start 2023-11-30T17:08:28.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.033+0000 7eff2393d700 1 -- start start 2023-11-30T17:08:28.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.034+0000 7eff2393d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff1c0af150 0x7eff1c0b01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:28.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.034+0000 7eff2393d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff1c0af530 0x7eff1c165550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:28.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.034+0000 7eff2393d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff1c0ae230 0x7eff1c155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:28.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.034+0000 7eff2393d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c165a40 con 0x7eff1c0ae230 2023-11-30T17:08:28.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.034+0000 7eff2393d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c0b0870 con 0x7eff1c0af150 2023-11-30T17:08:28.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.034+0000 7eff2393d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c0b0b50 con 0x7eff1c0af530 2023-11-30T17:08:28.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.034+0000 7eff21eda700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff1c0ae230 0x7eff1c155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:28.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.034+0000 7eff21eda700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff1c0ae230 0x7eff1c155fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46194/0 (socket says 172.21.15.49:46194) 2023-11-30T17:08:28.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.034+0000 7eff21eda700 1 -- 172.21.15.49:0/1594804084 learned_addr learned my addr 172.21.15.49:0/1594804084 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:28.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.034+0000 7eff216d9700 1 --2- 172.21.15.49:0/1594804084 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff1c0af150 0x7eff1c0b01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:28.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.034+0000 7eff20ed8700 1 --2- 172.21.15.49:0/1594804084 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff1c0af530 0x7eff1c165550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:28.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.035+0000 7eff21eda700 1 -- 172.21.15.49:0/1594804084 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff1c0af530 msgr2=0x7eff1c165550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:28.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.035+0000 7eff21eda700 1 --2- 172.21.15.49:0/1594804084 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff1c0af530 0x7eff1c165550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:28.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.035+0000 7eff21eda700 1 -- 172.21.15.49:0/1594804084 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff1c0af150 msgr2=0x7eff1c0b01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:28.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.035+0000 7eff21eda700 1 --2- 172.21.15.49:0/1594804084 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff1c0af150 0x7eff1c0b01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.035+0000 7eff21eda700 1 -- 172.21.15.49:0/1594804084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c0b0e30 con 0x7eff1c0ae230 2023-11-30T17:08:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.035+0000 7eff21eda700 1 --2- 172.21.15.49:0/1594804084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff1c0ae230 0x7eff1c155fa0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7eff1400a000 tx=0x7eff14015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.035+0000 7eff197fa700 1 -- 172.21.15.49:0/1594804084 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1400cdc0 con 0x7eff1c0ae230 2023-11-30T17:08:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.035+0000 7eff197fa700 1 -- 172.21.15.49:0/1594804084 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff14013450 con 0x7eff1c0ae230 2023-11-30T17:08:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.035+0000 7eff197fa700 1 -- 172.21.15.49:0/1594804084 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff140137d0 con 0x7eff1c0ae230 2023-11-30T17:08:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.035+0000 7eff2393d700 1 -- 172.21.15.49:0/1594804084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1c0c3390 con 0x7eff1c0ae230 2023-11-30T17:08:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.035+0000 7eff2393d700 1 -- 172.21.15.49:0/1594804084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1c0ae6b0 con 0x7eff1c0ae230 2023-11-30T17:08:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.036+0000 7eff2393d700 1 -- 172.21.15.49:0/1594804084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1c0c3580 con 0x7eff1c0ae230 2023-11-30T17:08:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.036+0000 7eff197fa700 1 -- 172.21.15.49:0/1594804084 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7eff14013b40 con 0x7eff1c0ae230 2023-11-30T17:08:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.037+0000 7eff197fa700 1 --2- 172.21.15.49:0/1594804084 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7eff0805f350 0x7eff08061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.037+0000 7eff197fa700 1 -- 172.21.15.49:0/1594804084 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7eff1407b650 con 0x7eff1c0ae230 2023-11-30T17:08:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.037+0000 7eff216d9700 1 --2- 172.21.15.49:0/1594804084 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7eff0805f350 0x7eff08061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.037+0000 7eff216d9700 1 --2- 172.21.15.49:0/1594804084 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7eff0805f350 0x7eff08061810 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7eff0c000fb0 tx=0x7eff0c007c00).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:28.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.041+0000 7eff197fa700 1 -- 172.21.15.49:0/1594804084 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7eff1404c670 con 0x7eff1c0ae230 2023-11-30T17:08:28.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.240+0000 7eff2393d700 1 -- 172.21.15.49:0/1594804084 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7eff1c0ae8a0 con 0x7eff0805f350 2023-11-30T17:08:28.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.245+0000 7eff197fa700 1 -- 172.21.15.49:0/1594804084 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7eff0c003800 con 0x7eff0805f350 2023-11-30T17:08:28.247 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule activated for path /snap_test_dir1/dir3 2023-11-30T17:08:28.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.247+0000 7eff2393d700 1 -- 172.21.15.49:0/1594804084 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7eff0805f350 msgr2=0x7eff08061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:28.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.247+0000 7eff2393d700 1 --2- 172.21.15.49:0/1594804084 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7eff0805f350 0x7eff08061810 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7eff0c000fb0 tx=0x7eff0c007c00).stop 2023-11-30T17:08:28.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.247+0000 7eff2393d700 1 -- 172.21.15.49:0/1594804084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff1c0ae230 msgr2=0x7eff1c155fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:28.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.247+0000 7eff2393d700 1 --2- 172.21.15.49:0/1594804084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff1c0ae230 0x7eff1c155fa0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7eff1400a000 tx=0x7eff14015000).stop 2023-11-30T17:08:28.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.247+0000 7eff2393d700 1 -- 172.21.15.49:0/1594804084 shutdown_connections 2023-11-30T17:08:28.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.247+0000 7eff2393d700 1 --2- 172.21.15.49:0/1594804084 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7eff0805f350 0x7eff08061810 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:28.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.247+0000 7eff2393d700 1 --2- 172.21.15.49:0/1594804084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff1c0ae230 0x7eff1c155fa0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:28.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.247+0000 7eff2393d700 1 --2- 172.21.15.49:0/1594804084 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff1c0af150 0x7eff1c0b01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:28.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.247+0000 7eff2393d700 1 --2- 172.21.15.49:0/1594804084 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff1c0af530 0x7eff1c165550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:28.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.247+0000 7eff2393d700 1 -- 172.21.15.49:0/1594804084 >> 172.21.15.49:0/1594804084 conn(0x7eff1c094930 msgr2=0x7eff1c0a8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:28.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.247+0000 7eff2393d700 1 -- 172.21.15.49:0/1594804084 shutdown_connections 2023-11-30T17:08:28.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.247+0000 7eff2393d700 1 -- 172.21.15.49:0/1594804084 wait complete. 2023-11-30T17:08:28.261 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir3 2023-11-30T17:08:28.262 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir4 1M 2023-11-30T17:08:28.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.382+0000 7f9c873a5700 1 Processor -- start 2023-11-30T17:08:28.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.382+0000 7f9c873a5700 1 -- start start 2023-11-30T17:08:28.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.383+0000 7f9c873a5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c80154610 0x7f9c801582e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:28.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.383+0000 7f9c873a5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9c800ab3b0 0x7f9c800c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:28.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.383+0000 7f9c873a5700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c80159210 con 0x7f9c800aa1c0 2023-11-30T17:08:28.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.383+0000 7f9c873a5700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c800c0c70 con 0x7f9c800ab3b0 2023-11-30T17:08:28.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.383+0000 7f9c873a5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c800c2110 con 0x7f9c80154610 2023-11-30T17:08:28.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.383+0000 7f9c84940700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9c800ab3b0 0x7f9c800c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:28.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.383+0000 7f9c84940700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9c800ab3b0 0x7f9c800c80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46210/0 (socket says 172.21.15.49:46210) 2023-11-30T17:08:28.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.383+0000 7f9c84940700 1 -- 172.21.15.49:0/4076135039 learned_addr learned my addr 172.21.15.49:0/4076135039 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:28.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.383+0000 7f9c85141700 1 --2- 172.21.15.49:0/4076135039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c80154610 0x7f9c801582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:28.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.383+0000 7f9c84940700 1 -- 172.21.15.49:0/4076135039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c80154610 msgr2=0x7f9c801582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:28.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.383+0000 7f9c84940700 1 --2- 172.21.15.49:0/4076135039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c80154610 0x7f9c801582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:28.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.383+0000 7f9c84940700 1 -- 172.21.15.49:0/4076135039 >> v1:172.21.15.115:6789/0 conn(0x7f9c800aa1c0 legacy=0x7f9c800aa5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:28.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.383+0000 7f9c84940700 1 -- 172.21.15.49:0/4076135039 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c80158970 con 0x7f9c800ab3b0 2023-11-30T17:08:28.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.383+0000 7f9c84940700 1 --2- 172.21.15.49:0/4076135039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c800ab3b0 0x7f9c800c80c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f9c74006fd0 tx=0x7f9c740090f0).ready entity=mon.0 client_cookie=d27c3fea6ca2e1ae server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:28.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.383+0000 7f9c7ffff700 1 -- 172.21.15.49:0/4076135039 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7400b600 con 0x7f9c800ab3b0 2023-11-30T17:08:28.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.383+0000 7f9c7ffff700 1 -- 172.21.15.49:0/4076135039 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7400b760 con 0x7f9c800ab3b0 2023-11-30T17:08:28.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.383+0000 7f9c7ffff700 1 -- 172.21.15.49:0/4076135039 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7400bae0 con 0x7f9c800ab3b0 2023-11-30T17:08:28.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.384+0000 7f9c873a5700 1 -- 172.21.15.49:0/4076135039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c800ab3b0 msgr2=0x7f9c800c80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:28.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.384+0000 7f9c873a5700 1 --2- 172.21.15.49:0/4076135039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c800ab3b0 0x7f9c800c80c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f9c74006fd0 tx=0x7f9c740090f0).stop 2023-11-30T17:08:28.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.384+0000 7f9c873a5700 1 -- 172.21.15.49:0/4076135039 shutdown_connections 2023-11-30T17:08:28.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.384+0000 7f9c873a5700 1 --2- 172.21.15.49:0/4076135039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c80154610 0x7f9c801582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:28.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.384+0000 7f9c873a5700 1 --2- 172.21.15.49:0/4076135039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c800ab3b0 0x7f9c800c80c0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:28.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.384+0000 7f9c873a5700 1 -- 172.21.15.49:0/4076135039 >> 172.21.15.49:0/4076135039 conn(0x7f9c800655a0 msgr2=0x7f9c80069e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:28.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.384+0000 7f9c873a5700 1 -- 172.21.15.49:0/4076135039 shutdown_connections 2023-11-30T17:08:28.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.384+0000 7f9c873a5700 1 -- 172.21.15.49:0/4076135039 wait complete. 2023-11-30T17:08:28.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.385+0000 7f9c873a5700 1 Processor -- start 2023-11-30T17:08:28.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.385+0000 7f9c873a5700 1 -- start start 2023-11-30T17:08:28.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.386+0000 7f9c873a5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c800aa1c0 0x7f9c80156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:28.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.386+0000 7f9c873a5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c80154610 0x7f9c800c2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:28.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.386+0000 7f9c873a5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c80157420 0x7f9c800c27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:28.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.386+0000 7f9c873a5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c800c2ce0 con 0x7f9c80157420 2023-11-30T17:08:28.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.386+0000 7f9c873a5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c800afb80 con 0x7f9c800aa1c0 2023-11-30T17:08:28.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.386+0000 7f9c873a5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c800aef70 con 0x7f9c80154610 2023-11-30T17:08:28.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.386+0000 7f9c85942700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c80157420 0x7f9c800c27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:28.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.386+0000 7f9c85942700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c80157420 0x7f9c800c27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46218/0 (socket says 172.21.15.49:46218) 2023-11-30T17:08:28.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.386+0000 7f9c85942700 1 -- 172.21.15.49:0/4172235787 learned_addr learned my addr 172.21.15.49:0/4172235787 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:28.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.386+0000 7f9c85141700 1 --2- 172.21.15.49:0/4172235787 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c800aa1c0 0x7f9c80156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:28.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.386+0000 7f9c84940700 1 --2- 172.21.15.49:0/4172235787 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c80154610 0x7f9c800c2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:28.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.386+0000 7f9c85942700 1 -- 172.21.15.49:0/4172235787 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c80154610 msgr2=0x7f9c800c2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:28.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.386+0000 7f9c85942700 1 --2- 172.21.15.49:0/4172235787 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c80154610 0x7f9c800c2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:28.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.386+0000 7f9c85942700 1 -- 172.21.15.49:0/4172235787 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c800aa1c0 msgr2=0x7f9c80156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:28.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.386+0000 7f9c85942700 1 --2- 172.21.15.49:0/4172235787 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c800aa1c0 0x7f9c80156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:28.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.386+0000 7f9c85942700 1 -- 172.21.15.49:0/4172235787 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c74009370 con 0x7f9c80157420 2023-11-30T17:08:28.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.386+0000 7f9c84940700 1 --2- 172.21.15.49:0/4172235787 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c80154610 0x7f9c800c2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:08:28.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.387+0000 7f9c85942700 1 --2- 172.21.15.49:0/4172235787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c80157420 0x7f9c800c27f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f9c7800c440 tx=0x7f9c78007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:28.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.387+0000 7f9c7d7fa700 1 -- 172.21.15.49:0/4172235787 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7800ce40 con 0x7f9c80157420 2023-11-30T17:08:28.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.387+0000 7f9c7d7fa700 1 -- 172.21.15.49:0/4172235787 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7800f470 con 0x7f9c80157420 2023-11-30T17:08:28.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.387+0000 7f9c873a5700 1 -- 172.21.15.49:0/4172235787 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c800af250 con 0x7f9c80157420 2023-11-30T17:08:28.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.387+0000 7f9c7d7fa700 1 -- 172.21.15.49:0/4172235787 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7800f7f0 con 0x7f9c80157420 2023-11-30T17:08:28.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.387+0000 7f9c873a5700 1 -- 172.21.15.49:0/4172235787 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c800af810 con 0x7f9c80157420 2023-11-30T17:08:28.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.388+0000 7f9c873a5700 1 -- 172.21.15.49:0/4172235787 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8006c860 con 0x7f9c80157420 2023-11-30T17:08:28.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.388+0000 7f9c7d7fa700 1 -- 172.21.15.49:0/4172235787 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f9c7800fbe0 con 0x7f9c80157420 2023-11-30T17:08:28.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.388+0000 7f9c7d7fa700 1 --2- 172.21.15.49:0/4172235787 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9c6c05f320 0x7f9c6c0617e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:28.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.389+0000 7f9c7d7fa700 1 -- 172.21.15.49:0/4172235787 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f9c78079a10 con 0x7f9c80157420 2023-11-30T17:08:28.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.389+0000 7f9c85141700 1 --2- 172.21.15.49:0/4172235787 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9c6c05f320 0x7f9c6c0617e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:28.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.389+0000 7f9c85141700 1 --2- 172.21.15.49:0/4172235787 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9c6c05f320 0x7f9c6c0617e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9c70007640 tx=0x7f9c70009850).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:28.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.393+0000 7f9c7d7fa700 1 -- 172.21.15.49:0/4172235787 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9c78047b00 con 0x7f9c80157420 2023-11-30T17:08:28.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.591+0000 7f9c873a5700 1 -- 172.21.15.49:0/4172235787 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c800afcf0 con 0x7f9c6c05f320 2023-11-30T17:08:28.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.596+0000 7f9c7d7fa700 1 -- 172.21.15.49:0/4172235787 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f9c800afcf0 con 0x7f9c6c05f320 2023-11-30T17:08:28.598 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule activated for path /snap_test_dir1/dir4 2023-11-30T17:08:28.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.598+0000 7f9c873a5700 1 -- 172.21.15.49:0/4172235787 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9c6c05f320 msgr2=0x7f9c6c0617e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:28.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.598+0000 7f9c873a5700 1 --2- 172.21.15.49:0/4172235787 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9c6c05f320 0x7f9c6c0617e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9c70007640 tx=0x7f9c70009850).stop 2023-11-30T17:08:28.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.598+0000 7f9c873a5700 1 -- 172.21.15.49:0/4172235787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c80157420 msgr2=0x7f9c800c27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:28.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.598+0000 7f9c873a5700 1 --2- 172.21.15.49:0/4172235787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c80157420 0x7f9c800c27f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f9c7800c440 tx=0x7f9c78007dd0).stop 2023-11-30T17:08:28.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.598+0000 7f9c873a5700 1 -- 172.21.15.49:0/4172235787 shutdown_connections 2023-11-30T17:08:28.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.598+0000 7f9c873a5700 1 --2- 172.21.15.49:0/4172235787 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9c6c05f320 0x7f9c6c0617e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:28.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.598+0000 7f9c873a5700 1 --2- 172.21.15.49:0/4172235787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c80157420 0x7f9c800c27f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:28.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.598+0000 7f9c873a5700 1 --2- 172.21.15.49:0/4172235787 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c800aa1c0 0x7f9c80156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:28.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.598+0000 7f9c873a5700 1 --2- 172.21.15.49:0/4172235787 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c80154610 0x7f9c800c2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:28.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.598+0000 7f9c873a5700 1 -- 172.21.15.49:0/4172235787 >> 172.21.15.49:0/4172235787 conn(0x7f9c800655a0 msgr2=0x7f9c800c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:28.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.598+0000 7f9c873a5700 1 -- 172.21.15.49:0/4172235787 shutdown_connections 2023-11-30T17:08:28.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.598+0000 7f9c873a5700 1 -- 172.21.15.49:0/4172235787 wait complete. 2023-11-30T17:08:28.612 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir4 2023-11-30T17:08:28.612 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir5 1M 2023-11-30T17:08:28.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.732+0000 7f2532cef700 1 Processor -- start 2023-11-30T17:08:28.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.732+0000 7f2532cef700 1 -- start start 2023-11-30T17:08:28.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.733+0000 7f2532cef700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f252c0aa680 0x7f252c0c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:28.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.733+0000 7f2532cef700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f252c158d50 con 0x7f252c1542d0 2023-11-30T17:08:28.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.733+0000 7f2532cef700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f252c158140 con 0x7f252c1546b0 2023-11-30T17:08:28.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.733+0000 7f2532cef700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f252c158420 con 0x7f252c0aa680 2023-11-30T17:08:28.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.733+0000 7f2531ced700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f252c1542d0 0x7f252c0a9f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49102/0 (socket says 172.21.15.49:49102) 2023-11-30T17:08:28.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.733+0000 7f2531ced700 1 -- 172.21.15.49:0/860269109 learned_addr learned my addr 172.21.15.49:0/860269109 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:08:28.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.733+0000 7f2530ceb700 1 -- 172.21.15.49:0/860269109 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3525204213 0 0) 0x7f252c158d50 con 0x7f252c1542d0 2023-11-30T17:08:28.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.733+0000 7f2530ceb700 1 -- 172.21.15.49:0/860269109 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25180033f0 con 0x7f252c1542d0 2023-11-30T17:08:28.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.733+0000 7f25314ec700 1 --2- 172.21.15.49:0/860269109 >> v2:172.21.15.115:3300/0 conn(0x7f252c0aa680 0x7f252c0c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:28.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.733+0000 7f2530ceb700 1 -- 172.21.15.49:0/860269109 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 963379003 0 0) 0x7f25180033f0 con 0x7f252c1542d0 2023-11-30T17:08:28.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.733+0000 7f2530ceb700 1 -- 172.21.15.49:0/860269109 >> v2:172.21.15.115:3300/0 conn(0x7f252c0aa680 msgr2=0x7f252c0c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:28.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.733+0000 7f2530ceb700 1 --2- 172.21.15.49:0/860269109 >> v2:172.21.15.115:3300/0 conn(0x7f252c0aa680 0x7f252c0c5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:28.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.733+0000 7f2530ceb700 1 -- 172.21.15.49:0/860269109 >> v1:172.21.15.115:6789/0 conn(0x7f252c1546b0 legacy=0x7f252c0c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:28.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.734+0000 7f2530ceb700 1 -- 172.21.15.49:0/860269109 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f252c158700 con 0x7f252c1542d0 2023-11-30T17:08:28.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.734+0000 7f2530ceb700 1 -- 172.21.15.49:0/860269109 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f2528001470 con 0x7f252c1542d0 2023-11-30T17:08:28.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.734+0000 7f2530ceb700 1 -- 172.21.15.49:0/860269109 >> v1:172.21.15.49:6789/0 conn(0x7f252c1542d0 legacy=0x7f252c0a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:28.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.734+0000 7f2530ceb700 1 --2- 172.21.15.49:0/860269109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25180038e0 0x7f2518003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:28.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.734+0000 7f2530ceb700 1 --2- 172.21.15.49:0/860269109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2518004690 0x7f2518004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:28.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.734+0000 7f2530ceb700 1 --2- 172.21.15.49:0/860269109 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2518005000 0x7f251800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:28.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.734+0000 7f2530ceb700 1 -- 172.21.15.49:0/860269109 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252c158420 con 0x7f25180038e0 2023-11-30T17:08:28.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.734+0000 7f2530ceb700 1 -- 172.21.15.49:0/860269109 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251800bf60 con 0x7f2518004690 2023-11-30T17:08:28.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.734+0000 7f2530ceb700 1 -- 172.21.15.49:0/860269109 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251800c0f0 con 0x7f2518005000 2023-11-30T17:08:28.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.734+0000 7f2531ced700 1 --2- 172.21.15.49:0/860269109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25180038e0 0x7f2518003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:28.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.734+0000 7f25314ec700 1 --2- 172.21.15.49:0/860269109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2518004690 0x7f2518004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:28.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.734+0000 7f25324ee700 1 --2- 172.21.15.49:0/860269109 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2518005000 0x7f251800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:28.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.734+0000 7f2531ced700 1 -- 172.21.15.49:0/860269109 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2518005000 msgr2=0x7f251800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:28.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.734+0000 7f2531ced700 1 --2- 172.21.15.49:0/860269109 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2518005000 0x7f251800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:28.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.734+0000 7f2531ced700 1 -- 172.21.15.49:0/860269109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2518004690 msgr2=0x7f2518004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:28.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.734+0000 7f2531ced700 1 --2- 172.21.15.49:0/860269109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2518004690 0x7f2518004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:28.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.734+0000 7f25324ee700 1 -- 172.21.15.49:0/860269109 reap_dead start 2023-11-30T17:08:28.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.734+0000 7f2531ced700 1 -- 172.21.15.49:0/860269109 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25180033f0 con 0x7f25180038e0 2023-11-30T17:08:28.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.734+0000 7f25314ec700 1 --2- 172.21.15.49:0/860269109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2518004690 0x7f2518004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:08:28.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.734+0000 7f2531ced700 1 --2- 172.21.15.49:0/860269109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25180038e0 0x7f2518003d00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f252800c190 tx=0x7f2528001e50).ready entity=mon.0 client_cookie=b6c6822b6a00abbf server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:28.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.734+0000 7f2530ceb700 1 -- 172.21.15.49:0/860269109 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2528007a20 con 0x7f25180038e0 2023-11-30T17:08:28.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.734+0000 7f2530ceb700 1 -- 172.21.15.49:0/860269109 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252800ca80 con 0x7f25180038e0 2023-11-30T17:08:28.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.734+0000 7f2530ceb700 1 -- 172.21.15.49:0/860269109 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252800ce00 con 0x7f25180038e0 2023-11-30T17:08:28.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.735+0000 7f2532cef700 1 -- 172.21.15.49:0/860269109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25180038e0 msgr2=0x7f2518003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:28.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.735+0000 7f2532cef700 1 --2- 172.21.15.49:0/860269109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25180038e0 0x7f2518003d00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f252800c190 tx=0x7f2528001e50).stop 2023-11-30T17:08:28.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.735+0000 7f2532cef700 1 -- 172.21.15.49:0/860269109 shutdown_connections 2023-11-30T17:08:28.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.735+0000 7f2532cef700 1 --2- 172.21.15.49:0/860269109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25180038e0 0x7f2518003d00 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:28.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.735+0000 7f2532cef700 1 -- 172.21.15.49:0/860269109 >> 172.21.15.49:0/860269109 conn(0x7f252c0cb010 msgr2=0x7f252c0cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:28.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.735+0000 7f2532cef700 1 -- 172.21.15.49:0/860269109 shutdown_connections 2023-11-30T17:08:28.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.735+0000 7f2532cef700 1 -- 172.21.15.49:0/860269109 wait complete. 2023-11-30T17:08:28.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.736+0000 7f2532cef700 1 Processor -- start 2023-11-30T17:08:28.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.736+0000 7f2532cef700 1 -- start start 2023-11-30T17:08:28.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.737+0000 7f2532cef700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25180038e0 0x7f252c144ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:28.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.737+0000 7f2532cef700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f252c0c8e20 0x7f252c0c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:28.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.737+0000 7f2532cef700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f252c155530 0x7f252c1559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:28.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.737+0000 7f2532cef700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252c0ae0d0 con 0x7f25180038e0 2023-11-30T17:08:28.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.737+0000 7f2532cef700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252c0c33b0 con 0x7f252c0c8e20 2023-11-30T17:08:28.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.737+0000 7f2532cef700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f252c0c1e80 con 0x7f252c155530 2023-11-30T17:08:28.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.737+0000 7f2531ced700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25180038e0 0x7f252c144ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:28.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.737+0000 7f2531ced700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25180038e0 0x7f252c144ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46238/0 (socket says 172.21.15.49:46238) 2023-11-30T17:08:28.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.737+0000 7f2531ced700 1 -- 172.21.15.49:0/1218533352 learned_addr learned my addr 172.21.15.49:0/1218533352 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:28.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.737+0000 7f25314ec700 1 --2- 172.21.15.49:0/1218533352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f252c0c8e20 0x7f252c0c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:28.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.737+0000 7f25324ee700 1 --2- 172.21.15.49:0/1218533352 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f252c155530 0x7f252c1559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:28.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.737+0000 7f2531ced700 1 -- 172.21.15.49:0/1218533352 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f252c155530 msgr2=0x7f252c1559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:28.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.737+0000 7f2531ced700 1 --2- 172.21.15.49:0/1218533352 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f252c155530 0x7f252c1559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:28.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.737+0000 7f2531ced700 1 -- 172.21.15.49:0/1218533352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f252c0c8e20 msgr2=0x7f252c0c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:28.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.737+0000 7f2531ced700 1 --2- 172.21.15.49:0/1218533352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f252c0c8e20 0x7f252c0c92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:28.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.737+0000 7f2531ced700 1 -- 172.21.15.49:0/1218533352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f252c0c9790 con 0x7f25180038e0 2023-11-30T17:08:28.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.738+0000 7f2531ced700 1 --2- 172.21.15.49:0/1218533352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25180038e0 0x7f252c144ee0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f2518005640 tx=0x7f2528015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:28.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.738+0000 7f2521ffb700 1 -- 172.21.15.49:0/1218533352 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25280073b0 con 0x7f25180038e0 2023-11-30T17:08:28.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.738+0000 7f2521ffb700 1 -- 172.21.15.49:0/1218533352 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2528007510 con 0x7f25180038e0 2023-11-30T17:08:28.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.738+0000 7f2532cef700 1 -- 172.21.15.49:0/1218533352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f252c0c3080 con 0x7f25180038e0 2023-11-30T17:08:28.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.738+0000 7f2521ffb700 1 -- 172.21.15.49:0/1218533352 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25280048e0 con 0x7f25180038e0 2023-11-30T17:08:28.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.738+0000 7f2532cef700 1 -- 172.21.15.49:0/1218533352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f252c156150 con 0x7f25180038e0 2023-11-30T17:08:28.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.739+0000 7f2532cef700 1 -- 172.21.15.49:0/1218533352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f252c06c7c0 con 0x7f25180038e0 2023-11-30T17:08:28.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.739+0000 7f2521ffb700 1 -- 172.21.15.49:0/1218533352 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f252801c070 con 0x7f25180038e0 2023-11-30T17:08:28.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.740+0000 7f2521ffb700 1 --2- 172.21.15.49:0/1218533352 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f251005f320 0x7f25100617e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:28.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.740+0000 7f2521ffb700 1 -- 172.21.15.49:0/1218533352 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f252807ab80 con 0x7f25180038e0 2023-11-30T17:08:28.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.740+0000 7f25314ec700 1 --2- 172.21.15.49:0/1218533352 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f251005f320 0x7f25100617e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:28.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.740+0000 7f25314ec700 1 --2- 172.21.15.49:0/1218533352 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f251005f320 0x7f25100617e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f251c009580 tx=0x7f251c009060).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:28.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.744+0000 7f2521ffb700 1 -- 172.21.15.49:0/1218533352 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f252804bba0 con 0x7f25180038e0 2023-11-30T17:08:28.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.947+0000 7f2532cef700 1 -- 172.21.15.49:0/1218533352 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f252c0c3210 con 0x7f251005f320 2023-11-30T17:08:28.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.952+0000 7f2521ffb700 1 -- 172.21.15.49:0/1218533352 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f251c019070 con 0x7f251005f320 2023-11-30T17:08:28.955 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule activated for path /snap_test_dir1/dir5 2023-11-30T17:08:28.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.954+0000 7f2532cef700 1 -- 172.21.15.49:0/1218533352 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f251005f320 msgr2=0x7f25100617e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:28.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.954+0000 7f2532cef700 1 --2- 172.21.15.49:0/1218533352 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f251005f320 0x7f25100617e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f251c009580 tx=0x7f251c009060).stop 2023-11-30T17:08:28.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.954+0000 7f2532cef700 1 -- 172.21.15.49:0/1218533352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25180038e0 msgr2=0x7f252c144ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:28.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.954+0000 7f2532cef700 1 --2- 172.21.15.49:0/1218533352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25180038e0 0x7f252c144ee0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f2518005640 tx=0x7f2528015000).stop 2023-11-30T17:08:28.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.954+0000 7f2532cef700 1 -- 172.21.15.49:0/1218533352 shutdown_connections 2023-11-30T17:08:28.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.954+0000 7f2532cef700 1 --2- 172.21.15.49:0/1218533352 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f252c155530 0x7f252c1559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:28.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.954+0000 7f2532cef700 1 --2- 172.21.15.49:0/1218533352 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f251005f320 0x7f25100617e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:28.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.954+0000 7f2532cef700 1 --2- 172.21.15.49:0/1218533352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25180038e0 0x7f252c144ee0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:28.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.954+0000 7f2532cef700 1 --2- 172.21.15.49:0/1218533352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f252c0c8e20 0x7f252c0c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:28.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.954+0000 7f2532cef700 1 -- 172.21.15.49:0/1218533352 >> 172.21.15.49:0/1218533352 conn(0x7f252c0cb010 msgr2=0x7f252c0ad590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:28.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.954+0000 7f2532cef700 1 -- 172.21.15.49:0/1218533352 shutdown_connections 2023-11-30T17:08:28.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:28.954+0000 7f2532cef700 1 -- 172.21.15.49:0/1218533352 wait complete. 2023-11-30T17:08:28.969 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir5 2023-11-30T17:08:28.969 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir6 1M 2023-11-30T17:08:29.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.089+0000 7f855519e700 1 Processor -- start 2023-11-30T17:08:29.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.089+0000 7f855519e700 1 -- start start 2023-11-30T17:08:29.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.090+0000 7f855519e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8550154530 0x7f8550154910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:29.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.090+0000 7f855519e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f85500aa220 0x7f85500aa6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:29.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.090+0000 7f855519e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85500aabc0 con 0x7f85500a7ff0 2023-11-30T17:08:29.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.090+0000 7f855519e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85500c6390 con 0x7f85500aa220 2023-11-30T17:08:29.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.090+0000 7f855519e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85500c6630 con 0x7f8550154530 2023-11-30T17:08:29.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.090+0000 7f854e59c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f85500a7ff0 0x7f85500c8580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49108/0 (socket says 172.21.15.49:49108) 2023-11-30T17:08:29.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.090+0000 7f854e59c700 1 -- 172.21.15.49:0/15250861 learned_addr learned my addr 172.21.15.49:0/15250861 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:08:29.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.091+0000 7f854f59e700 1 --2- 172.21.15.49:0/15250861 >> v2:172.21.15.115:3300/0 conn(0x7f85500aa220 0x7f85500aa6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:29.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.091+0000 7f854ed9d700 1 --2- 172.21.15.49:0/15250861 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8550154530 0x7f8550154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:29.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.091+0000 7f854dd9b700 1 -- 172.21.15.49:0/15250861 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3113418841 0 0) 0x7f8538001110 con 0x7f85500a7ff0 2023-11-30T17:08:29.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.091+0000 7f854dd9b700 1 -- 172.21.15.49:0/15250861 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f853c0033f0 con 0x7f85500a7ff0 2023-11-30T17:08:29.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.091+0000 7f854f59e700 1 -- 172.21.15.49:0/15250861 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8550154530 msgr2=0x7f8550154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:29.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.091+0000 7f854f59e700 1 --2- 172.21.15.49:0/15250861 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8550154530 0x7f8550154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:29.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.091+0000 7f854f59e700 1 -- 172.21.15.49:0/15250861 >> v1:172.21.15.49:6789/0 conn(0x7f85500a7ff0 legacy=0x7f85500c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:29.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.091+0000 7f854f59e700 1 -- 172.21.15.49:0/15250861 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85500a8470 con 0x7f85500aa220 2023-11-30T17:08:29.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.091+0000 7f854f59e700 1 --2- 172.21.15.49:0/15250861 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85500aa220 0x7f85500aa6d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f8540009e60 tx=0x7f8540009780).ready entity=mon.1 client_cookie=9acbddd21172ff07 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:29.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.091+0000 7f854dd9b700 1 -- 172.21.15.49:0/15250861 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854000e070 con 0x7f85500aa220 2023-11-30T17:08:29.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.091+0000 7f854dd9b700 1 -- 172.21.15.49:0/15250861 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854000bab0 con 0x7f85500aa220 2023-11-30T17:08:29.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.091+0000 7f854dd9b700 1 -- 172.21.15.49:0/15250861 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854000be30 con 0x7f85500aa220 2023-11-30T17:08:29.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.092+0000 7f855519e700 1 -- 172.21.15.49:0/15250861 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85500aa220 msgr2=0x7f85500aa6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:29.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.092+0000 7f855519e700 1 --2- 172.21.15.49:0/15250861 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85500aa220 0x7f85500aa6d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f8540009e60 tx=0x7f8540009780).stop 2023-11-30T17:08:29.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.092+0000 7f855519e700 1 -- 172.21.15.49:0/15250861 shutdown_connections 2023-11-30T17:08:29.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.092+0000 7f855519e700 1 --2- 172.21.15.49:0/15250861 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85500aa220 0x7f85500aa6d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:29.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.092+0000 7f855519e700 1 --2- 172.21.15.49:0/15250861 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8550154530 0x7f8550154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:29.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.092+0000 7f855519e700 1 -- 172.21.15.49:0/15250861 >> 172.21.15.49:0/15250861 conn(0x7f8550094930 msgr2=0x7f855006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:29.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.092+0000 7f855519e700 1 -- 172.21.15.49:0/15250861 shutdown_connections 2023-11-30T17:08:29.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.092+0000 7f855519e700 1 -- 172.21.15.49:0/15250861 wait complete. 2023-11-30T17:08:29.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.093+0000 7f855519e700 1 Processor -- start 2023-11-30T17:08:29.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.093+0000 7f855519e700 1 -- start start 2023-11-30T17:08:29.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.094+0000 7f855519e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85500a7ff0 0x7f85501501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:29.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.094+0000 7f855519e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85500aa220 0x7f85500acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:29.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.094+0000 7f855519e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8550154530 0x7f85500ad010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:29.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.094+0000 7f855519e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85501506e0 con 0x7f8550154530 2023-11-30T17:08:29.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.094+0000 7f855519e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85500c3210 con 0x7f85500a7ff0 2023-11-30T17:08:29.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.094+0000 7f855519e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85500c2320 con 0x7f85500aa220 2023-11-30T17:08:29.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.094+0000 7f854f59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8550154530 0x7f85500ad010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:29.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.094+0000 7f854f59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8550154530 0x7f85500ad010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46246/0 (socket says 172.21.15.49:46246) 2023-11-30T17:08:29.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.094+0000 7f854f59e700 1 -- 172.21.15.49:0/2113234172 learned_addr learned my addr 172.21.15.49:0/2113234172 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:29.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.094+0000 7f854ed9d700 1 --2- 172.21.15.49:0/2113234172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85500a7ff0 0x7f85501501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:29.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.094+0000 7f854e59c700 1 --2- 172.21.15.49:0/2113234172 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85500aa220 0x7f85500acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:29.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.094+0000 7f854f59e700 1 -- 172.21.15.49:0/2113234172 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85500aa220 msgr2=0x7f85500acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:29.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.094+0000 7f854f59e700 1 --2- 172.21.15.49:0/2113234172 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85500aa220 0x7f85500acb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:29.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.094+0000 7f854f59e700 1 -- 172.21.15.49:0/2113234172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85500a7ff0 msgr2=0x7f85501501f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:29.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.094+0000 7f854f59e700 1 --2- 172.21.15.49:0/2113234172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85500a7ff0 0x7f85501501f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:29.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.094+0000 7f854f59e700 1 -- 172.21.15.49:0/2113234172 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8540009a20 con 0x7f8550154530 2023-11-30T17:08:29.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.094+0000 7f854f59e700 1 --2- 172.21.15.49:0/2113234172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8550154530 0x7f85500ad010 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f854000b610 tx=0x7f8540009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:29.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.095+0000 7f8546ffd700 1 -- 172.21.15.49:0/2113234172 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8540012ea0 con 0x7f8550154530 2023-11-30T17:08:29.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.095+0000 7f8546ffd700 1 -- 172.21.15.49:0/2113234172 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854001d630 con 0x7f8550154530 2023-11-30T17:08:29.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.095+0000 7f855519e700 1 -- 172.21.15.49:0/2113234172 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85500c2600 con 0x7f8550154530 2023-11-30T17:08:29.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.095+0000 7f8546ffd700 1 -- 172.21.15.49:0/2113234172 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854001d9f0 con 0x7f8550154530 2023-11-30T17:08:29.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.095+0000 7f855519e700 1 -- 172.21.15.49:0/2113234172 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85500c2bc0 con 0x7f8550154530 2023-11-30T17:08:29.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.096+0000 7f855519e700 1 -- 172.21.15.49:0/2113234172 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85500c33a0 con 0x7f8550154530 2023-11-30T17:08:29.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.096+0000 7f8546ffd700 1 -- 172.21.15.49:0/2113234172 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f8540026410 con 0x7f8550154530 2023-11-30T17:08:29.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.096+0000 7f8546ffd700 1 --2- 172.21.15.49:0/2113234172 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f853005f380 0x7f8530061840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:29.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.096+0000 7f8546ffd700 1 -- 172.21.15.49:0/2113234172 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f854007c390 con 0x7f8550154530 2023-11-30T17:08:29.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.096+0000 7f854ed9d700 1 --2- 172.21.15.49:0/2113234172 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f853005f380 0x7f8530061840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:29.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.097+0000 7f854ed9d700 1 --2- 172.21.15.49:0/2113234172 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f853005f380 0x7f8530061840 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f8548006fd0 tx=0x7f8548006f40).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:29.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.100+0000 7f8546ffd700 1 -- 172.21.15.49:0/2113234172 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f854004d240 con 0x7f8550154530 2023-11-30T17:08:29.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.302+0000 7f855519e700 1 -- 172.21.15.49:0/2113234172 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f855006c860 con 0x7f853005f380 2023-11-30T17:08:29.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.307+0000 7f8546ffd700 1 -- 172.21.15.49:0/2113234172 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f855006c860 con 0x7f853005f380 2023-11-30T17:08:29.310 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule activated for path /snap_test_dir1/dir6 2023-11-30T17:08:29.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.309+0000 7f855519e700 1 -- 172.21.15.49:0/2113234172 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f853005f380 msgr2=0x7f8530061840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:29.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.309+0000 7f855519e700 1 --2- 172.21.15.49:0/2113234172 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f853005f380 0x7f8530061840 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f8548006fd0 tx=0x7f8548006f40).stop 2023-11-30T17:08:29.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.309+0000 7f855519e700 1 -- 172.21.15.49:0/2113234172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8550154530 msgr2=0x7f85500ad010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:29.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.309+0000 7f855519e700 1 --2- 172.21.15.49:0/2113234172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8550154530 0x7f85500ad010 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f854000b610 tx=0x7f8540009780).stop 2023-11-30T17:08:29.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.309+0000 7f855519e700 1 -- 172.21.15.49:0/2113234172 shutdown_connections 2023-11-30T17:08:29.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.309+0000 7f855519e700 1 --2- 172.21.15.49:0/2113234172 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f853005f380 0x7f8530061840 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:29.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.309+0000 7f855519e700 1 --2- 172.21.15.49:0/2113234172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8550154530 0x7f85500ad010 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:29.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.309+0000 7f855519e700 1 --2- 172.21.15.49:0/2113234172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85500a7ff0 0x7f85501501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:29.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.309+0000 7f855519e700 1 --2- 172.21.15.49:0/2113234172 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85500aa220 0x7f85500acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:29.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.309+0000 7f855519e700 1 -- 172.21.15.49:0/2113234172 >> 172.21.15.49:0/2113234172 conn(0x7f8550094930 msgr2=0x7f85500c0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:29.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.309+0000 7f855519e700 1 -- 172.21.15.49:0/2113234172 shutdown_connections 2023-11-30T17:08:29.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.309+0000 7f855519e700 1 -- 172.21.15.49:0/2113234172 wait complete. 2023-11-30T17:08:29.324 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir6 2023-11-30T17:08:29.324 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir7 1M 2023-11-30T17:08:29.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.444+0000 7f8f58f24700 1 Processor -- start 2023-11-30T17:08:29.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.444+0000 7f8f58f24700 1 -- start start 2023-11-30T17:08:29.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.445+0000 7f8f58f24700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f541373a0 0x7f8f540c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:29.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.445+0000 7f8f58f24700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8f540c5f30 0x7f8f540c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:29.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.445+0000 7f8f58f24700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f54158e20 con 0x7f8f540669a0 2023-11-30T17:08:29.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.445+0000 7f8f58f24700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f540c68a0 con 0x7f8f540c5f30 2023-11-30T17:08:29.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.445+0000 7f8f58f24700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f541582a0 con 0x7f8f541373a0 2023-11-30T17:08:29.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.445+0000 7f8f51d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8f540c5f30 0x7f8f540c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:29.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.445+0000 7f8f51d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8f540c5f30 0x7f8f540c63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46258/0 (socket says 172.21.15.49:46258) 2023-11-30T17:08:29.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.445+0000 7f8f51d9b700 1 -- 172.21.15.49:0/3640109703 learned_addr learned my addr 172.21.15.49:0/3640109703 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:29.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.445+0000 7f8f5259c700 1 --2- 172.21.15.49:0/3640109703 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f541373a0 0x7f8f540c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:29.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.445+0000 7f8f51d9b700 1 -- 172.21.15.49:0/3640109703 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f541373a0 msgr2=0x7f8f540c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:29.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.446+0000 7f8f51d9b700 1 --2- 172.21.15.49:0/3640109703 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f541373a0 0x7f8f540c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:29.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.446+0000 7f8f51d9b700 1 -- 172.21.15.49:0/3640109703 >> v1:172.21.15.115:6789/0 conn(0x7f8f540669a0 legacy=0x7f8f54066e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:29.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.446+0000 7f8f51d9b700 1 -- 172.21.15.49:0/3640109703 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f54158580 con 0x7f8f540c5f30 2023-11-30T17:08:29.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.446+0000 7f8f5259c700 1 --2- 172.21.15.49:0/3640109703 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f541373a0 0x7f8f540c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:08:29.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.446+0000 7f8f51d9b700 1 --2- 172.21.15.49:0/3640109703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f540c5f30 0x7f8f540c63b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f8f3c006fd0 tx=0x7f8f3c0090f0).ready entity=mon.0 client_cookie=6da0860b55005a85 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:29.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.446+0000 7f8f5159a700 1 -- 172.21.15.49:0/3640109703 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c00b600 con 0x7f8f540c5f30 2023-11-30T17:08:29.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.446+0000 7f8f5159a700 1 -- 172.21.15.49:0/3640109703 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3c00b760 con 0x7f8f540c5f30 2023-11-30T17:08:29.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.446+0000 7f8f5159a700 1 -- 172.21.15.49:0/3640109703 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c00bae0 con 0x7f8f540c5f30 2023-11-30T17:08:29.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.446+0000 7f8f58f24700 1 -- 172.21.15.49:0/3640109703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f540c5f30 msgr2=0x7f8f540c63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:29.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.446+0000 7f8f58f24700 1 --2- 172.21.15.49:0/3640109703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f540c5f30 0x7f8f540c63b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f8f3c006fd0 tx=0x7f8f3c0090f0).stop 2023-11-30T17:08:29.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.446+0000 7f8f58f24700 1 -- 172.21.15.49:0/3640109703 shutdown_connections 2023-11-30T17:08:29.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.446+0000 7f8f58f24700 1 --2- 172.21.15.49:0/3640109703 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f541373a0 0x7f8f540c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:29.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.446+0000 7f8f58f24700 1 --2- 172.21.15.49:0/3640109703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f540c5f30 0x7f8f540c63b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:29.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.446+0000 7f8f58f24700 1 -- 172.21.15.49:0/3640109703 >> 172.21.15.49:0/3640109703 conn(0x7f8f540628f0 msgr2=0x7f8f54062d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:29.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.446+0000 7f8f58f24700 1 -- 172.21.15.49:0/3640109703 shutdown_connections 2023-11-30T17:08:29.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.446+0000 7f8f58f24700 1 -- 172.21.15.49:0/3640109703 wait complete. 2023-11-30T17:08:29.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.448+0000 7f8f58f24700 1 Processor -- start 2023-11-30T17:08:29.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.448+0000 7f8f58f24700 1 -- start start 2023-11-30T17:08:29.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.448+0000 7f8f58f24700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f540669a0 0x7f8f54164400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:29.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.448+0000 7f8f58f24700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f540c5f30 0x7f8f541670f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:29.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.448+0000 7f8f58f24700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f541373a0 0x7f8f540aabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:29.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.448+0000 7f8f58f24700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f540a91c0 con 0x7f8f540669a0 2023-11-30T17:08:29.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.448+0000 7f8f58f24700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f540a8bb0 con 0x7f8f540c5f30 2023-11-30T17:08:29.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.448+0000 7f8f58f24700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f54139ae0 con 0x7f8f541373a0 2023-11-30T17:08:29.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.448+0000 7f8f5259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f540669a0 0x7f8f54164400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:29.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.448+0000 7f8f5259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f540669a0 0x7f8f54164400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46268/0 (socket says 172.21.15.49:46268) 2023-11-30T17:08:29.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.448+0000 7f8f5259c700 1 -- 172.21.15.49:0/3750022019 learned_addr learned my addr 172.21.15.49:0/3750022019 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:29.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.449+0000 7f8f51d9b700 1 --2- 172.21.15.49:0/3750022019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f540c5f30 0x7f8f541670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:29.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.449+0000 7f8f52d9d700 1 --2- 172.21.15.49:0/3750022019 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f541373a0 0x7f8f540aabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:29.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.449+0000 7f8f5259c700 1 -- 172.21.15.49:0/3750022019 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f541373a0 msgr2=0x7f8f540aabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:29.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.449+0000 7f8f5259c700 1 --2- 172.21.15.49:0/3750022019 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f541373a0 0x7f8f540aabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:29.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.449+0000 7f8f5259c700 1 -- 172.21.15.49:0/3750022019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f540c5f30 msgr2=0x7f8f541670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:29.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.449+0000 7f8f5259c700 1 --2- 172.21.15.49:0/3750022019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f540c5f30 0x7f8f541670f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:29.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.449+0000 7f8f5259c700 1 -- 172.21.15.49:0/3750022019 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3c009370 con 0x7f8f540669a0 2023-11-30T17:08:29.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.449+0000 7f8f51d9b700 1 --2- 172.21.15.49:0/3750022019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f540c5f30 0x7f8f541670f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:08:29.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.449+0000 7f8f5259c700 1 --2- 172.21.15.49:0/3750022019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f540669a0 0x7f8f54164400 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f8f4c00c880 tx=0x7f8f4c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:29.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.449+0000 7f8f4a7fc700 1 -- 172.21.15.49:0/3750022019 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c010580 con 0x7f8f540669a0 2023-11-30T17:08:29.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.449+0000 7f8f4a7fc700 1 -- 172.21.15.49:0/3750022019 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4c0106e0 con 0x7f8f540669a0 2023-11-30T17:08:29.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.449+0000 7f8f58f24700 1 -- 172.21.15.49:0/3750022019 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f540a8e50 con 0x7f8f540669a0 2023-11-30T17:08:29.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.449+0000 7f8f4a7fc700 1 -- 172.21.15.49:0/3750022019 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c010a80 con 0x7f8f540669a0 2023-11-30T17:08:29.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.449+0000 7f8f58f24700 1 -- 172.21.15.49:0/3750022019 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f541675e0 con 0x7f8f540669a0 2023-11-30T17:08:29.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.450+0000 7f8f58f24700 1 -- 172.21.15.49:0/3750022019 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f5406c860 con 0x7f8f540669a0 2023-11-30T17:08:29.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.450+0000 7f8f4a7fc700 1 -- 172.21.15.49:0/3750022019 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f8f4c01b460 con 0x7f8f540669a0 2023-11-30T17:08:29.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.451+0000 7f8f4a7fc700 1 --2- 172.21.15.49:0/3750022019 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8f3405f350 0x7f8f34061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:29.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.451+0000 7f8f4a7fc700 1 -- 172.21.15.49:0/3750022019 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f8f4c07a5f0 con 0x7f8f540669a0 2023-11-30T17:08:29.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.451+0000 7f8f51d9b700 1 --2- 172.21.15.49:0/3750022019 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8f3405f350 0x7f8f34061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:29.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.452+0000 7f8f51d9b700 1 --2- 172.21.15.49:0/3750022019 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8f3405f350 0x7f8f34061810 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f8f3c006fd0 tx=0x7f8f3c017000).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:29.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.455+0000 7f8f4a7fc700 1 -- 172.21.15.49:0/3750022019 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8f4c04b4a0 con 0x7f8f540669a0 2023-11-30T17:08:29.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.655+0000 7f8f58f24700 1 -- 172.21.15.49:0/3750022019 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f540a9300 con 0x7f8f3405f350 2023-11-30T17:08:29.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.659+0000 7f8f4a7fc700 1 -- 172.21.15.49:0/3750022019 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f8f3c00b8d0 con 0x7f8f3405f350 2023-11-30T17:08:29.662 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule activated for path /snap_test_dir1/dir7 2023-11-30T17:08:29.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.661+0000 7f8f58f24700 1 -- 172.21.15.49:0/3750022019 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8f3405f350 msgr2=0x7f8f34061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:29.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.661+0000 7f8f58f24700 1 --2- 172.21.15.49:0/3750022019 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8f3405f350 0x7f8f34061810 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f8f3c006fd0 tx=0x7f8f3c017000).stop 2023-11-30T17:08:29.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.661+0000 7f8f58f24700 1 -- 172.21.15.49:0/3750022019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f540669a0 msgr2=0x7f8f54164400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:29.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.661+0000 7f8f58f24700 1 --2- 172.21.15.49:0/3750022019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f540669a0 0x7f8f54164400 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f8f4c00c880 tx=0x7f8f4c008040).stop 2023-11-30T17:08:29.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.661+0000 7f8f58f24700 1 -- 172.21.15.49:0/3750022019 shutdown_connections 2023-11-30T17:08:29.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.662+0000 7f8f58f24700 1 --2- 172.21.15.49:0/3750022019 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f541373a0 0x7f8f540aabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:29.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.662+0000 7f8f58f24700 1 --2- 172.21.15.49:0/3750022019 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8f3405f350 0x7f8f34061810 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:29.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.662+0000 7f8f58f24700 1 --2- 172.21.15.49:0/3750022019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f540669a0 0x7f8f54164400 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:29.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.662+0000 7f8f58f24700 1 --2- 172.21.15.49:0/3750022019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f540c5f30 0x7f8f541670f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:29.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.662+0000 7f8f58f24700 1 -- 172.21.15.49:0/3750022019 >> 172.21.15.49:0/3750022019 conn(0x7f8f540628f0 msgr2=0x7f8f540aeac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:29.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.662+0000 7f8f58f24700 1 -- 172.21.15.49:0/3750022019 shutdown_connections 2023-11-30T17:08:29.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.662+0000 7f8f58f24700 1 -- 172.21.15.49:0/3750022019 wait complete. 2023-11-30T17:08:29.676 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir7 2023-11-30T17:08:29.676 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir8 1M 2023-11-30T17:08:29.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.797+0000 7f8acf2a1700 1 Processor -- start 2023-11-30T17:08:29.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.797+0000 7f8acf2a1700 1 -- start start 2023-11-30T17:08:29.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.798+0000 7f8acf2a1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ac8064db0 0x7f8ac8151f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:29.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.798+0000 7f8acf2a1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8ac814b700 0x7f8ac80bbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:29.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.798+0000 7f8acf2a1700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ac81523f0 con 0x7f8ac814b320 2023-11-30T17:08:29.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.798+0000 7f8acf2a1700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ac80c3040 con 0x7f8ac814b700 2023-11-30T17:08:29.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.798+0000 7f8acf2a1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac80bd140 con 0x7f8ac8064db0 2023-11-30T17:08:29.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.798+0000 7f8acd83e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8ac814b700 0x7f8ac80bbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:29.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.798+0000 7f8acd83e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8ac814b700 0x7f8ac80bbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46270/0 (socket says 172.21.15.49:46270) 2023-11-30T17:08:29.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.798+0000 7f8acd83e700 1 -- 172.21.15.49:0/451840993 learned_addr learned my addr 172.21.15.49:0/451840993 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:29.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.798+0000 7f8acc83c700 1 --2- 172.21.15.49:0/451840993 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ac8064db0 0x7f8ac8151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:29.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.798+0000 7f8acd83e700 1 -- 172.21.15.49:0/451840993 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ac8064db0 msgr2=0x7f8ac8151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:08:29.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.798+0000 7f8acd83e700 1 --2- 172.21.15.49:0/451840993 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ac8064db0 0x7f8ac8151f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:29.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.798+0000 7f8acd83e700 1 -- 172.21.15.49:0/451840993 >> v1:172.21.15.115:6789/0 conn(0x7f8ac814b320 legacy=0x7f8ac80646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:29.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.798+0000 7f8acd83e700 1 -- 172.21.15.49:0/451840993 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac80bc2d0 con 0x7f8ac814b700 2023-11-30T17:08:29.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.799+0000 7f8acd83e700 1 --2- 172.21.15.49:0/451840993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac814b700 0x7f8ac80bbde0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f8ab8006fd0 tx=0x7f8ab80090f0).ready entity=mon.0 client_cookie=bce26826f4c0df36 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:29.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.799+0000 7f8ac7fff700 1 -- 172.21.15.49:0/451840993 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab800b600 con 0x7f8ac814b700 2023-11-30T17:08:29.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.799+0000 7f8ac7fff700 1 -- 172.21.15.49:0/451840993 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab800b760 con 0x7f8ac814b700 2023-11-30T17:08:29.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.799+0000 7f8ac7fff700 1 -- 172.21.15.49:0/451840993 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab800bb00 con 0x7f8ac814b700 2023-11-30T17:08:29.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.799+0000 7f8acf2a1700 1 -- 172.21.15.49:0/451840993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac814b700 msgr2=0x7f8ac80bbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:29.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.799+0000 7f8acf2a1700 1 --2- 172.21.15.49:0/451840993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac814b700 0x7f8ac80bbde0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f8ab8006fd0 tx=0x7f8ab80090f0).stop 2023-11-30T17:08:29.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.799+0000 7f8acf2a1700 1 -- 172.21.15.49:0/451840993 shutdown_connections 2023-11-30T17:08:29.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.799+0000 7f8acf2a1700 1 --2- 172.21.15.49:0/451840993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac814b700 0x7f8ac80bbde0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:29.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.799+0000 7f8acf2a1700 1 --2- 172.21.15.49:0/451840993 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ac8064db0 0x7f8ac8151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:29.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.799+0000 7f8acf2a1700 1 -- 172.21.15.49:0/451840993 >> 172.21.15.49:0/451840993 conn(0x7f8ac8062700 msgr2=0x7f8ac8062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:29.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.799+0000 7f8acf2a1700 1 -- 172.21.15.49:0/451840993 shutdown_connections 2023-11-30T17:08:29.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.799+0000 7f8acf2a1700 1 -- 172.21.15.49:0/451840993 wait complete. 2023-11-30T17:08:29.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.800+0000 7f8acf2a1700 1 Processor -- start 2023-11-30T17:08:29.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.800+0000 7f8acf2a1700 1 -- start start 2023-11-30T17:08:29.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.801+0000 7f8acf2a1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ac8064db0 0x7f8ac8148a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:29.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.801+0000 7f8acf2a1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac814b320 0x7f8ac814c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:29.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.801+0000 7f8acf2a1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ac814b700 0x7f8ac814c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:29.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.801+0000 7f8acf2a1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac814ca50 con 0x7f8ac814b320 2023-11-30T17:08:29.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.801+0000 7f8acf2a1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac80a6960 con 0x7f8ac8064db0 2023-11-30T17:08:29.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.801+0000 7f8acf2a1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac80a77c0 con 0x7f8ac814b700 2023-11-30T17:08:29.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.801+0000 7f8acc83c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac814b320 0x7f8ac814c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:29.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.802+0000 7f8acc83c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac814b320 0x7f8ac814c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46276/0 (socket says 172.21.15.49:46276) 2023-11-30T17:08:29.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.802+0000 7f8acc83c700 1 -- 172.21.15.49:0/1161005967 learned_addr learned my addr 172.21.15.49:0/1161005967 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:29.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.802+0000 7f8acc83c700 1 -- 172.21.15.49:0/1161005967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ac814b700 msgr2=0x7f8ac814c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:29.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.802+0000 7f8acd83e700 1 --2- 172.21.15.49:0/1161005967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ac814b700 0x7f8ac814c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:29.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.802+0000 7f8acd03d700 1 --2- 172.21.15.49:0/1161005967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ac8064db0 0x7f8ac8148a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:29.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.802+0000 7f8acc83c700 1 --2- 172.21.15.49:0/1161005967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ac814b700 0x7f8ac814c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:29.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.802+0000 7f8acc83c700 1 -- 172.21.15.49:0/1161005967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ac8064db0 msgr2=0x7f8ac8148a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:29.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.802+0000 7f8acc83c700 1 --2- 172.21.15.49:0/1161005967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ac8064db0 0x7f8ac8148a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:29.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.802+0000 7f8acc83c700 1 -- 172.21.15.49:0/1161005967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab8009370 con 0x7f8ac814b320 2023-11-30T17:08:29.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.802+0000 7f8acd03d700 1 --2- 172.21.15.49:0/1161005967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ac8064db0 0x7f8ac8148a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:08:29.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.802+0000 7f8acc83c700 1 --2- 172.21.15.49:0/1161005967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac814b320 0x7f8ac814c070 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f8abc00d860 tx=0x7f8abc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:29.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.802+0000 7f8ac57fa700 1 -- 172.21.15.49:0/1161005967 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8abc0125f0 con 0x7f8ac814b320 2023-11-30T17:08:29.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.802+0000 7f8ac57fa700 1 -- 172.21.15.49:0/1161005967 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8abc012750 con 0x7f8ac814b320 2023-11-30T17:08:29.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.802+0000 7f8acf2a1700 1 -- 172.21.15.49:0/1161005967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac80a6bb0 con 0x7f8ac814b320 2023-11-30T17:08:29.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.802+0000 7f8ac57fa700 1 -- 172.21.15.49:0/1161005967 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8abc012ad0 con 0x7f8ac814b320 2023-11-30T17:08:29.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.802+0000 7f8acf2a1700 1 -- 172.21.15.49:0/1161005967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac80a7170 con 0x7f8ac814b320 2023-11-30T17:08:29.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.803+0000 7f8acf2a1700 1 -- 172.21.15.49:0/1161005967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac806c860 con 0x7f8ac814b320 2023-11-30T17:08:29.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.803+0000 7f8ac57fa700 1 -- 172.21.15.49:0/1161005967 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f8abc013480 con 0x7f8ac814b320 2023-11-30T17:08:29.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.804+0000 7f8ac57fa700 1 --2- 172.21.15.49:0/1161005967 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8ab405f350 0x7f8ab4061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:29.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.804+0000 7f8ac57fa700 1 -- 172.21.15.49:0/1161005967 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f8abc07a760 con 0x7f8ac814b320 2023-11-30T17:08:29.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.804+0000 7f8acd03d700 1 --2- 172.21.15.49:0/1161005967 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8ab405f350 0x7f8ab4061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:29.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.804+0000 7f8acd03d700 1 --2- 172.21.15.49:0/1161005967 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8ab405f350 0x7f8ab4061810 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f8ac0007fd0 tx=0x7f8ac0009040).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:29.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:29.808+0000 7f8ac57fa700 1 -- 172.21.15.49:0/1161005967 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8abc04b720 con 0x7f8ac814b320 2023-11-30T17:08:30.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.007+0000 7f8acf2a1700 1 -- 172.21.15.49:0/1161005967 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ac80bc530 con 0x7f8ab405f350 2023-11-30T17:08:30.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.012+0000 7f8ac57fa700 1 -- 172.21.15.49:0/1161005967 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f8ac80bc530 con 0x7f8ab405f350 2023-11-30T17:08:30.015 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule activated for path /snap_test_dir1/dir8 2023-11-30T17:08:30.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.014+0000 7f8acf2a1700 1 -- 172.21.15.49:0/1161005967 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8ab405f350 msgr2=0x7f8ab4061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:30.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.014+0000 7f8acf2a1700 1 --2- 172.21.15.49:0/1161005967 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8ab405f350 0x7f8ab4061810 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f8ac0007fd0 tx=0x7f8ac0009040).stop 2023-11-30T17:08:30.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.014+0000 7f8acf2a1700 1 -- 172.21.15.49:0/1161005967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac814b320 msgr2=0x7f8ac814c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:30.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.014+0000 7f8acf2a1700 1 --2- 172.21.15.49:0/1161005967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac814b320 0x7f8ac814c070 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f8abc00d860 tx=0x7f8abc008040).stop 2023-11-30T17:08:30.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.014+0000 7f8acf2a1700 1 -- 172.21.15.49:0/1161005967 shutdown_connections 2023-11-30T17:08:30.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.014+0000 7f8acf2a1700 1 --2- 172.21.15.49:0/1161005967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ac814b700 0x7f8ac814c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:30.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.014+0000 7f8acf2a1700 1 --2- 172.21.15.49:0/1161005967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ac8064db0 0x7f8ac8148a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:30.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.014+0000 7f8acf2a1700 1 --2- 172.21.15.49:0/1161005967 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8ab405f350 0x7f8ab4061810 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:30.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.014+0000 7f8acf2a1700 1 --2- 172.21.15.49:0/1161005967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac814b320 0x7f8ac814c070 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:30.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.014+0000 7f8acf2a1700 1 -- 172.21.15.49:0/1161005967 >> 172.21.15.49:0/1161005967 conn(0x7f8ac8062700 msgr2=0x7f8ac8062ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:30.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.014+0000 7f8acf2a1700 1 -- 172.21.15.49:0/1161005967 shutdown_connections 2023-11-30T17:08:30.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.014+0000 7f8acf2a1700 1 -- 172.21.15.49:0/1161005967 wait complete. 2023-11-30T17:08:30.029 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir8 2023-11-30T17:08:30.029 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir9 1M 2023-11-30T17:08:30.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.150+0000 7fd9e4f80700 1 Processor -- start 2023-11-30T17:08:30.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.150+0000 7fd9e4f80700 1 -- start start 2023-11-30T17:08:30.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.151+0000 7fd9e4f80700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9e01542d0 0x7fd9e00a9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:30.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.151+0000 7fd9e4f80700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9e0158d50 con 0x7fd9e01546b0 2023-11-30T17:08:30.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.151+0000 7fd9e4f80700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9e0158140 con 0x7fd9e00c66d0 2023-11-30T17:08:30.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.151+0000 7fd9e4f80700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e0158420 con 0x7fd9e01542d0 2023-11-30T17:08:30.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.151+0000 7fd9df7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9e01542d0 0x7fd9e00a9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:30.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.151+0000 7fd9dffff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd9e00c66d0 0x7fd9e00c0890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:55748/0 (socket says 172.21.15.49:55748) 2023-11-30T17:08:30.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.151+0000 7fd9dffff700 1 -- 172.21.15.49:0/931205399 learned_addr learned my addr 172.21.15.49:0/931205399 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:08:30.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.152+0000 7fd9de7fc700 1 -- 172.21.15.49:0/931205399 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682906723 0 0) 0x7fd9e0158140 con 0x7fd9e00c66d0 2023-11-30T17:08:30.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.152+0000 7fd9de7fc700 1 -- 172.21.15.49:0/931205399 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9cc0033f0 con 0x7fd9e00c66d0 2023-11-30T17:08:30.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.152+0000 7fd9df7fe700 1 -- 172.21.15.49:0/931205399 >> v1:172.21.15.115:6789/0 conn(0x7fd9e00c66d0 legacy=0x7fd9e00c0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:30.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.152+0000 7fd9df7fe700 1 -- 172.21.15.49:0/931205399 >> v1:172.21.15.49:6789/0 conn(0x7fd9e01546b0 legacy=0x7fd9e00c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:30.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.152+0000 7fd9de7fc700 1 -- 172.21.15.49:0/931205399 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 218825295 0 0) 0x7fd9e0158d50 con 0x7fd9e01546b0 2023-11-30T17:08:30.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.152+0000 7fd9df7fe700 1 -- 172.21.15.49:0/931205399 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e0158700 con 0x7fd9e01542d0 2023-11-30T17:08:30.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.152+0000 7fd9df7fe700 1 --2- 172.21.15.49:0/931205399 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9e01542d0 0x7fd9e00a9f70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fd9d0009790 tx=0x7fd9d0009060).ready entity=mon.2 client_cookie=e1ebe919067ce61a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:30.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.152+0000 7fd9de7fc700 1 -- 172.21.15.49:0/931205399 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d000f510 con 0x7fd9e01542d0 2023-11-30T17:08:30.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.152+0000 7fd9de7fc700 1 -- 172.21.15.49:0/931205399 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d000f670 con 0x7fd9e01542d0 2023-11-30T17:08:30.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.152+0000 7fd9de7fc700 1 -- 172.21.15.49:0/931205399 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d000f9f0 con 0x7fd9e01542d0 2023-11-30T17:08:30.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.152+0000 7fd9e4f80700 1 -- 172.21.15.49:0/931205399 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9e01542d0 msgr2=0x7fd9e00a9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:30.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.152+0000 7fd9e4f80700 1 --2- 172.21.15.49:0/931205399 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9e01542d0 0x7fd9e00a9f70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fd9d0009790 tx=0x7fd9d0009060).stop 2023-11-30T17:08:30.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.153+0000 7fd9e4f80700 1 -- 172.21.15.49:0/931205399 shutdown_connections 2023-11-30T17:08:30.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.153+0000 7fd9e4f80700 1 --2- 172.21.15.49:0/931205399 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9e01542d0 0x7fd9e00a9f70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:30.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.153+0000 7fd9e4f80700 1 -- 172.21.15.49:0/931205399 >> 172.21.15.49:0/931205399 conn(0x7fd9e00cb010 msgr2=0x7fd9e00cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:30.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.153+0000 7fd9e4f80700 1 -- 172.21.15.49:0/931205399 shutdown_connections 2023-11-30T17:08:30.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.153+0000 7fd9e4f80700 1 -- 172.21.15.49:0/931205399 wait complete. 2023-11-30T17:08:30.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.154+0000 7fd9e4f80700 1 Processor -- start 2023-11-30T17:08:30.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.154+0000 7fd9e4f80700 1 -- start start 2023-11-30T17:08:30.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.155+0000 7fd9e4f80700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9e00c66d0 0x7fd9e00c4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:30.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.155+0000 7fd9e4f80700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9e01542d0 0x7fd9e00ae810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:30.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.155+0000 7fd9e4f80700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9e01546b0 0x7fd9e00aed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:30.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.155+0000 7fd9e4f80700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e00af1f0 con 0x7fd9e01546b0 2023-11-30T17:08:30.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.155+0000 7fd9e4f80700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e014c300 con 0x7fd9e00c66d0 2023-11-30T17:08:30.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.155+0000 7fd9e4f80700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e014c5e0 con 0x7fd9e01542d0 2023-11-30T17:08:30.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.155+0000 7fd9dffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9e01546b0 0x7fd9e00aed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:30.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.155+0000 7fd9dffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9e01546b0 0x7fd9e00aed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46282/0 (socket says 172.21.15.49:46282) 2023-11-30T17:08:30.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.155+0000 7fd9dffff700 1 -- 172.21.15.49:0/2115478103 learned_addr learned my addr 172.21.15.49:0/2115478103 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:08:30.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.155+0000 7fd9df7fe700 1 --2- 172.21.15.49:0/2115478103 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9e00c66d0 0x7fd9e00c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:30.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.155+0000 7fd9deffd700 1 --2- 172.21.15.49:0/2115478103 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9e01542d0 0x7fd9e00ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:30.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.155+0000 7fd9dffff700 1 -- 172.21.15.49:0/2115478103 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9e01542d0 msgr2=0x7fd9e00ae810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:30.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.155+0000 7fd9dffff700 1 --2- 172.21.15.49:0/2115478103 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9e01542d0 0x7fd9e00ae810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:30.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.155+0000 7fd9dffff700 1 -- 172.21.15.49:0/2115478103 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9e00c66d0 msgr2=0x7fd9e00c4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:30.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.155+0000 7fd9dffff700 1 --2- 172.21.15.49:0/2115478103 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9e00c66d0 0x7fd9e00c4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:30.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.155+0000 7fd9dffff700 1 -- 172.21.15.49:0/2115478103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d00092a0 con 0x7fd9e01546b0 2023-11-30T17:08:30.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.155+0000 7fd9df7fe700 1 --2- 172.21.15.49:0/2115478103 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9e00c66d0 0x7fd9e00c4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:08:30.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.155+0000 7fd9dffff700 1 --2- 172.21.15.49:0/2115478103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9e01546b0 0x7fd9e00aed00 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fd9d8005ad0 tx=0x7fd9d8001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:30.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.155+0000 7fd9d77fe700 1 -- 172.21.15.49:0/2115478103 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d8005d30 con 0x7fd9e01546b0 2023-11-30T17:08:30.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.155+0000 7fd9d77fe700 1 -- 172.21.15.49:0/2115478103 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d8005e90 con 0x7fd9e01546b0 2023-11-30T17:08:30.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.155+0000 7fd9e4f80700 1 -- 172.21.15.49:0/2115478103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9e014c8c0 con 0x7fd9e01546b0 2023-11-30T17:08:30.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.155+0000 7fd9d77fe700 1 -- 172.21.15.49:0/2115478103 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d8007320 con 0x7fd9e01546b0 2023-11-30T17:08:30.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.156+0000 7fd9e4f80700 1 -- 172.21.15.49:0/2115478103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e00c4b20 con 0x7fd9e01546b0 2023-11-30T17:08:30.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.157+0000 7fd9e4f80700 1 -- 172.21.15.49:0/2115478103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e0155f70 con 0x7fd9e01546b0 2023-11-30T17:08:30.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.157+0000 7fd9d77fe700 1 -- 172.21.15.49:0/2115478103 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7fd9d8007710 con 0x7fd9e01546b0 2023-11-30T17:08:30.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.157+0000 7fd9d77fe700 1 --2- 172.21.15.49:0/2115478103 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd9c005f350 0x7fd9c0061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:08:30.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.157+0000 7fd9d77fe700 1 -- 172.21.15.49:0/2115478103 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fd9d807a670 con 0x7fd9e01546b0 2023-11-30T17:08:30.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.158+0000 7fd9df7fe700 1 --2- 172.21.15.49:0/2115478103 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd9c005f350 0x7fd9c0061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:08:30.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.158+0000 7fd9df7fe700 1 --2- 172.21.15.49:0/2115478103 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd9c005f350 0x7fd9c0061810 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fd9d00096e0 tx=0x7fd9d0017000).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:08:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.161+0000 7fd9d77fe700 1 -- 172.21.15.49:0/2115478103 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd9e0155f70 con 0x7fd9e01546b0 2023-11-30T17:08:30.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.362+0000 7fd9e4f80700 1 -- 172.21.15.49:0/2115478103 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9e0155f70 con 0x7fd9c005f350 2023-11-30T17:08:30.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.367+0000 7fd9d77fe700 1 -- 172.21.15.49:0/2115478103 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fd9e0155f70 con 0x7fd9c005f350 2023-11-30T17:08:30.369 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule activated for path /snap_test_dir1/dir9 2023-11-30T17:08:30.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.368+0000 7fd9e4f80700 1 -- 172.21.15.49:0/2115478103 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd9c005f350 msgr2=0x7fd9c0061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:30.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.368+0000 7fd9e4f80700 1 --2- 172.21.15.49:0/2115478103 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd9c005f350 0x7fd9c0061810 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fd9d00096e0 tx=0x7fd9d0017000).stop 2023-11-30T17:08:30.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.368+0000 7fd9e4f80700 1 -- 172.21.15.49:0/2115478103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9e01546b0 msgr2=0x7fd9e00aed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:08:30.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.368+0000 7fd9e4f80700 1 --2- 172.21.15.49:0/2115478103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9e01546b0 0x7fd9e00aed00 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fd9d8005ad0 tx=0x7fd9d8001650).stop 2023-11-30T17:08:30.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.369+0000 7fd9e4f80700 1 -- 172.21.15.49:0/2115478103 shutdown_connections 2023-11-30T17:08:30.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.369+0000 7fd9e4f80700 1 --2- 172.21.15.49:0/2115478103 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd9c005f350 0x7fd9c0061810 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:30.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.369+0000 7fd9e4f80700 1 --2- 172.21.15.49:0/2115478103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9e01546b0 0x7fd9e00aed00 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:30.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.369+0000 7fd9e4f80700 1 --2- 172.21.15.49:0/2115478103 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9e00c66d0 0x7fd9e00c4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:30.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.369+0000 7fd9e4f80700 1 --2- 172.21.15.49:0/2115478103 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9e01542d0 0x7fd9e00ae810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:08:30.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.369+0000 7fd9e4f80700 1 -- 172.21.15.49:0/2115478103 >> 172.21.15.49:0/2115478103 conn(0x7fd9e00cb010 msgr2=0x7fd9e00c0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:08:30.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.369+0000 7fd9e4f80700 1 -- 172.21.15.49:0/2115478103 shutdown_connections 2023-11-30T17:08:30.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:08:30.369+0000 7fd9e4f80700 1 -- 172.21.15.49:0/2115478103 wait complete. 2023-11-30T17:08:30.383 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir9 2023-11-30T17:08:49.190 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:08:49.193 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:09:00.019 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:09:00.017+0000 7f460fee9700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:09:00.019 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:09:00.017+0000 7f460fee9700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:09:00.019 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:09:00.017+0000 7f460fee9700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:09:00.020 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:09:00.017+0000 7f460fee9700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:09:00.020 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:09:00.017+0000 7f460fee9700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:09:19.261 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:09:19.265 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:09:49.360 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:09:49.364 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:10:19.458 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:10:19.461 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:10:49.545 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:10:49.549 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:11:19.631 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:11:19.634 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:11:49.710 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:11:49.713 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:12:19.780 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:12:19.784 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:12:49.842 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:12:49.845 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:13:19.911 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:13:19.914 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:13:49.998 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:13:50.001 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:14:20.076 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:14:20.079 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:14:50.140 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:14:50.144 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:15:20.207 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:15:20.210 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:15:50.301 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:15:50.304 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:16:20.371 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:16:20.375 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:16:50.451 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:16:50.454 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:17:20.520 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:17:20.523 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:17:50.590 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:17:50.593 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:18:20.652 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:18:20.655 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:18:50.722 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:18:50.726 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:19:19.385 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir0 1M 2023-11-30T17:19:19.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.520+0000 7f577c1ce700 1 Processor -- start 2023-11-30T17:19:19.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.520+0000 7f577c1ce700 1 -- start start 2023-11-30T17:19:19.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.521+0000 7f577c1ce700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5774154610 0x7f57741582e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:19.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.521+0000 7f577c1ce700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f57740ab3b0 0x7f57740c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:19.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.521+0000 7f577c1ce700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5774159210 con 0x7f57740aa1c0 2023-11-30T17:19:19.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.521+0000 7f577c1ce700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57740c0c70 con 0x7f5774154610 2023-11-30T17:19:19.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.521+0000 7f577c1ce700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57740c2110 con 0x7f57740ab3b0 2023-11-30T17:19:19.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.522+0000 7f5779769700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f57740ab3b0 0x7f57740c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:19.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.522+0000 7f5779f6a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5774154610 0x7f57741582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:19.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.522+0000 7f5779769700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f57740ab3b0 0x7f57740c80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:41688/0 (socket says 172.21.15.49:41688) 2023-11-30T17:19:19.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.522+0000 7f5779769700 1 -- 172.21.15.49:0/1438965174 learned_addr learned my addr 172.21.15.49:0/1438965174 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:19.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.522+0000 7f5779f6a700 1 -- 172.21.15.49:0/1438965174 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f57740ab3b0 msgr2=0x7f57740c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:19.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.522+0000 7f5779f6a700 1 --2- 172.21.15.49:0/1438965174 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f57740ab3b0 0x7f57740c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:19.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.522+0000 7f5779f6a700 1 -- 172.21.15.49:0/1438965174 >> v1:172.21.15.115:6789/0 conn(0x7f57740aa1c0 legacy=0x7f5774063550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:19.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.522+0000 7f5779f6a700 1 -- 172.21.15.49:0/1438965174 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5774158970 con 0x7f5774154610 2023-11-30T17:19:19.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.522+0000 7f5779769700 1 --2- 172.21.15.49:0/1438965174 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f57740ab3b0 0x7f57740c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:19:19.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.522+0000 7f5778f68700 1 -- 172.21.15.49:0/1438965174 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 441985733 0 0) 0x7f5774159210 con 0x7f57740aa1c0 2023-11-30T17:19:19.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.522+0000 7f5779f6a700 1 --2- 172.21.15.49:0/1438965174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5774154610 0x7f57741582e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f576c009760 tx=0x7f576c009060).ready entity=mon.1 client_cookie=f89890be6e2f23b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:19.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.522+0000 7f5778f68700 1 -- 172.21.15.49:0/1438965174 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c00f510 con 0x7f5774154610 2023-11-30T17:19:19.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.522+0000 7f5778f68700 1 -- 172.21.15.49:0/1438965174 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576c00f670 con 0x7f5774154610 2023-11-30T17:19:19.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.522+0000 7f5778f68700 1 -- 172.21.15.49:0/1438965174 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c00f9f0 con 0x7f5774154610 2023-11-30T17:19:19.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.523+0000 7f577c1ce700 1 -- 172.21.15.49:0/1438965174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5774154610 msgr2=0x7f57741582e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:19.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.523+0000 7f577c1ce700 1 --2- 172.21.15.49:0/1438965174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5774154610 0x7f57741582e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f576c009760 tx=0x7f576c009060).stop 2023-11-30T17:19:19.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.523+0000 7f577c1ce700 1 -- 172.21.15.49:0/1438965174 shutdown_connections 2023-11-30T17:19:19.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.523+0000 7f577c1ce700 1 --2- 172.21.15.49:0/1438965174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5774154610 0x7f57741582e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:19.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.523+0000 7f577c1ce700 1 --2- 172.21.15.49:0/1438965174 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f57740ab3b0 0x7f57740c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:19.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.523+0000 7f577c1ce700 1 -- 172.21.15.49:0/1438965174 >> 172.21.15.49:0/1438965174 conn(0x7f57740655a0 msgr2=0x7f5774069e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:19.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.523+0000 7f577c1ce700 1 -- 172.21.15.49:0/1438965174 shutdown_connections 2023-11-30T17:19:19.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.523+0000 7f577c1ce700 1 -- 172.21.15.49:0/1438965174 wait complete. 2023-11-30T17:19:19.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.524+0000 7f577c1ce700 1 Processor -- start 2023-11-30T17:19:19.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.524+0000 7f577c1ce700 1 -- start start 2023-11-30T17:19:19.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.525+0000 7f577c1ce700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57740aa1c0 0x7f577414c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:19.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.525+0000 7f577c1ce700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5774154610 0x7f57740ae950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:19.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.525+0000 7f577c1ce700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f577414c910 0x7f57740aee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:19.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.525+0000 7f577c1ce700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57740af330 con 0x7f57740aa1c0 2023-11-30T17:19:19.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.525+0000 7f577c1ce700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57740abeb0 con 0x7f577414c910 2023-11-30T17:19:19.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.525+0000 7f577c1ce700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57740b1170 con 0x7f5774154610 2023-11-30T17:19:19.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.525+0000 7f5779f6a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57740aa1c0 0x7f577414c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:19.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.525+0000 7f5779f6a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57740aa1c0 0x7f577414c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43812/0 (socket says 172.21.15.49:43812) 2023-11-30T17:19:19.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.525+0000 7f5779f6a700 1 -- 172.21.15.49:0/2945593434 learned_addr learned my addr 172.21.15.49:0/2945593434 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:19.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.526+0000 7f5779769700 1 --2- 172.21.15.49:0/2945593434 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5774154610 0x7f57740ae950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:19.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.526+0000 7f577a76b700 1 --2- 172.21.15.49:0/2945593434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f577414c910 0x7f57740aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:19.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.526+0000 7f5779f6a700 1 -- 172.21.15.49:0/2945593434 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5774154610 msgr2=0x7f57740ae950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:19.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.526+0000 7f5779f6a700 1 --2- 172.21.15.49:0/2945593434 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5774154610 0x7f57740ae950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:19.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.526+0000 7f5779f6a700 1 -- 172.21.15.49:0/2945593434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f577414c910 msgr2=0x7f57740aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:19.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.526+0000 7f5779f6a700 1 --2- 172.21.15.49:0/2945593434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f577414c910 0x7f57740aee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:19.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.526+0000 7f5779f6a700 1 -- 172.21.15.49:0/2945593434 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5768009370 con 0x7f57740aa1c0 2023-11-30T17:19:19.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.526+0000 7f5779f6a700 1 --2- 172.21.15.49:0/2945593434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57740aa1c0 0x7f577414c0d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f576c009e00 tx=0x7f576c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:19.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.526+0000 7f5771ffb700 1 -- 172.21.15.49:0/2945593434 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c00f7e0 con 0x7f57740aa1c0 2023-11-30T17:19:19.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.526+0000 7f5771ffb700 1 -- 172.21.15.49:0/2945593434 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576c00f940 con 0x7f57740aa1c0 2023-11-30T17:19:19.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.526+0000 7f577c1ce700 1 -- 172.21.15.49:0/2945593434 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f576c0092a0 con 0x7f57740aa1c0 2023-11-30T17:19:19.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.526+0000 7f5771ffb700 1 -- 172.21.15.49:0/2945593434 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c01b660 con 0x7f57740aa1c0 2023-11-30T17:19:19.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.526+0000 7f577c1ce700 1 -- 172.21.15.49:0/2945593434 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5774155f40 con 0x7f57740aa1c0 2023-11-30T17:19:19.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.527+0000 7f577c1ce700 1 -- 172.21.15.49:0/2945593434 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f577406c860 con 0x7f57740aa1c0 2023-11-30T17:19:19.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.528+0000 7f5771ffb700 1 -- 172.21.15.49:0/2945593434 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f576c01ba50 con 0x7f57740aa1c0 2023-11-30T17:19:19.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.528+0000 7f5771ffb700 1 --2- 172.21.15.49:0/2945593434 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f576005f2c0 0x7f5760061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:19.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.528+0000 7f5771ffb700 1 -- 172.21.15.49:0/2945593434 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f576c07bd90 con 0x7f57740aa1c0 2023-11-30T17:19:19.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.528+0000 7f5779769700 1 --2- 172.21.15.49:0/2945593434 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f576005f2c0 0x7f5760061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:19.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.529+0000 7f5779769700 1 --2- 172.21.15.49:0/2945593434 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f576005f2c0 0x7f5760061780 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f57740adca0 tx=0x7f5768008040).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:19.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.532+0000 7f5771ffb700 1 -- 172.21.15.49:0/2945593434 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f576c04ce10 con 0x7f57740aa1c0 2023-11-30T17:19:19.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.732+0000 7f577c1ce700 1 -- 172.21.15.49:0/2945593434 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f57740c0540 con 0x7f576005f2c0 2023-11-30T17:19:19.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.737+0000 7f5771ffb700 1 -- 172.21.15.49:0/2945593434 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f57740c0540 con 0x7f576005f2c0 2023-11-30T17:19:19.738 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule deactivated for path /snap_test_dir1/dir0 2023-11-30T17:19:19.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.739+0000 7f577c1ce700 1 -- 172.21.15.49:0/2945593434 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f576005f2c0 msgr2=0x7f5760061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:19.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.739+0000 7f577c1ce700 1 --2- 172.21.15.49:0/2945593434 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f576005f2c0 0x7f5760061780 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f57740adca0 tx=0x7f5768008040).stop 2023-11-30T17:19:19.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.739+0000 7f577c1ce700 1 -- 172.21.15.49:0/2945593434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57740aa1c0 msgr2=0x7f577414c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:19.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.739+0000 7f577c1ce700 1 --2- 172.21.15.49:0/2945593434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57740aa1c0 0x7f577414c0d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f576c009e00 tx=0x7f576c017000).stop 2023-11-30T17:19:19.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.739+0000 7f577c1ce700 1 -- 172.21.15.49:0/2945593434 shutdown_connections 2023-11-30T17:19:19.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.739+0000 7f577c1ce700 1 --2- 172.21.15.49:0/2945593434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f577414c910 0x7f57740aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:19.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.739+0000 7f577c1ce700 1 --2- 172.21.15.49:0/2945593434 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f576005f2c0 0x7f5760061780 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:19.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.739+0000 7f577c1ce700 1 --2- 172.21.15.49:0/2945593434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57740aa1c0 0x7f577414c0d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:19.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.739+0000 7f577c1ce700 1 --2- 172.21.15.49:0/2945593434 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5774154610 0x7f57740ae950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:19.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.739+0000 7f577c1ce700 1 -- 172.21.15.49:0/2945593434 >> 172.21.15.49:0/2945593434 conn(0x7f57740655a0 msgr2=0x7f57740cb260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:19.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.739+0000 7f577c1ce700 1 -- 172.21.15.49:0/2945593434 shutdown_connections 2023-11-30T17:19:19.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.739+0000 7f577c1ce700 1 -- 172.21.15.49:0/2945593434 wait complete. 2023-11-30T17:19:19.752 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir0 2023-11-30T17:19:19.752 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir1 1M 2023-11-30T17:19:19.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.872+0000 7fa5356fd700 1 Processor -- start 2023-11-30T17:19:19.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.872+0000 7fa5356fd700 1 -- start start 2023-11-30T17:19:19.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.873+0000 7fa5356fd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa530137930 0x7fa5300c2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:19.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.873+0000 7fa5356fd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa5300c62f0 0x7fa5300bbb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:19.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.873+0000 7fa5356fd700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa53006a440 con 0x7fa530137550 2023-11-30T17:19:19.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.873+0000 7fa5356fd700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5300c3090 con 0x7fa5300c62f0 2023-11-30T17:19:19.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.873+0000 7fa5356fd700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa530069830 con 0x7fa530137930 2023-11-30T17:19:19.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.873+0000 7fa52ffff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa530137550 0x7fa5300c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50264/0 (socket says 172.21.15.49:50264) 2023-11-30T17:19:19.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.873+0000 7fa52ffff700 1 -- 172.21.15.49:0/2945054936 learned_addr learned my addr 172.21.15.49:0/2945054936 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:19.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.873+0000 7fa52f7fe700 1 --2- 172.21.15.49:0/2945054936 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa530137930 0x7fa5300c2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:19.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.873+0000 7fa534efc700 1 --2- 172.21.15.49:0/2945054936 >> v2:172.21.15.115:3300/0 conn(0x7fa5300c62f0 0x7fa5300bbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:19.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.873+0000 7fa52effd700 1 -- 172.21.15.49:0/2945054936 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2349459506 0 0) 0x7fa53006a440 con 0x7fa530137550 2023-11-30T17:19:19.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.873+0000 7fa52effd700 1 -- 172.21.15.49:0/2945054936 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa51c0033f0 con 0x7fa530137550 2023-11-30T17:19:19.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.873+0000 7fa52effd700 1 -- 172.21.15.49:0/2945054936 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3185581388 0 0) 0x7fa51c0033f0 con 0x7fa530137550 2023-11-30T17:19:19.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.873+0000 7fa52effd700 1 -- 172.21.15.49:0/2945054936 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa530137930 msgr2=0x7fa5300c2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:19.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.873+0000 7fa52effd700 1 --2- 172.21.15.49:0/2945054936 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa530137930 0x7fa5300c2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:19.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.873+0000 7fa52effd700 1 -- 172.21.15.49:0/2945054936 >> v2:172.21.15.115:3300/0 conn(0x7fa5300c62f0 msgr2=0x7fa5300bbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:19.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.873+0000 7fa52effd700 1 --2- 172.21.15.49:0/2945054936 >> v2:172.21.15.115:3300/0 conn(0x7fa5300c62f0 0x7fa5300bbb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:19.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.873+0000 7fa52effd700 1 -- 172.21.15.49:0/2945054936 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa530069b10 con 0x7fa530137550 2023-11-30T17:19:19.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.874+0000 7fa52effd700 1 -- 172.21.15.49:0/2945054936 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fa520001470 con 0x7fa530137550 2023-11-30T17:19:19.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.874+0000 7fa52effd700 1 -- 172.21.15.49:0/2945054936 >> v1:172.21.15.49:6789/0 conn(0x7fa530137550 legacy=0x7fa5300c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:19.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.874+0000 7fa52effd700 1 --2- 172.21.15.49:0/2945054936 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa530137930 0x7fa51c0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:19.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.874+0000 7fa52effd700 1 --2- 172.21.15.49:0/2945054936 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa51c003e10 0x7fa51c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:19.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.874+0000 7fa52effd700 1 --2- 172.21.15.49:0/2945054936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa51c004b80 0x7fa51c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:19.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.874+0000 7fa52effd700 1 -- 172.21.15.49:0/2945054936 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5300c3090 con 0x7fa51c003e10 2023-11-30T17:19:19.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.874+0000 7fa52effd700 1 -- 172.21.15.49:0/2945054936 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa530069830 con 0x7fa51c004b80 2023-11-30T17:19:19.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.874+0000 7fa52effd700 1 -- 172.21.15.49:0/2945054936 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c00b8e0 con 0x7fa530137930 2023-11-30T17:19:19.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.874+0000 7fa52f7fe700 1 --2- 172.21.15.49:0/2945054936 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa51c003e10 0x7fa51c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:19.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.874+0000 7fa52ffff700 1 --2- 172.21.15.49:0/2945054936 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa530137930 0x7fa51c0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:19.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.874+0000 7fa534efc700 1 --2- 172.21.15.49:0/2945054936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa51c004b80 0x7fa51c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:19.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.874+0000 7fa52f7fe700 1 -- 172.21.15.49:0/2945054936 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa530137930 msgr2=0x7fa51c0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:19.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.874+0000 7fa52f7fe700 1 --2- 172.21.15.49:0/2945054936 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa530137930 0x7fa51c0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:19.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.874+0000 7fa52f7fe700 1 -- 172.21.15.49:0/2945054936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa51c004b80 msgr2=0x7fa51c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:19.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.874+0000 7fa52f7fe700 1 --2- 172.21.15.49:0/2945054936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa51c004b80 0x7fa51c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:19.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.874+0000 7fa52f7fe700 1 -- 172.21.15.49:0/2945054936 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51c0033f0 con 0x7fa51c003e10 2023-11-30T17:19:19.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.874+0000 7fa52f7fe700 1 --2- 172.21.15.49:0/2945054936 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa51c003e10 0x7fa51c004690 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7fa518009260 tx=0x7fa518009060).ready entity=mon.0 client_cookie=d2ea6c6c6d4245b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:19.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.874+0000 7fa52effd700 1 -- 172.21.15.49:0/2945054936 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa518009ea0 con 0x7fa51c003e10 2023-11-30T17:19:19.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.874+0000 7fa52effd700 1 -- 172.21.15.49:0/2945054936 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa518009430 con 0x7fa51c003e10 2023-11-30T17:19:19.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.874+0000 7fa52effd700 1 -- 172.21.15.49:0/2945054936 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51800e870 con 0x7fa51c003e10 2023-11-30T17:19:19.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.875+0000 7fa5356fd700 1 -- 172.21.15.49:0/2945054936 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa51c003e10 msgr2=0x7fa51c004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:19.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.875+0000 7fa5356fd700 1 --2- 172.21.15.49:0/2945054936 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa51c003e10 0x7fa51c004690 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7fa518009260 tx=0x7fa518009060).stop 2023-11-30T17:19:19.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.875+0000 7fa534efc700 1 -- 172.21.15.49:0/2945054936 reap_dead start 2023-11-30T17:19:19.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.875+0000 7fa5356fd700 1 -- 172.21.15.49:0/2945054936 shutdown_connections 2023-11-30T17:19:19.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.875+0000 7fa5356fd700 1 -- 172.21.15.49:0/2945054936 >> 172.21.15.49:0/2945054936 conn(0x7fa5300631d0 msgr2=0x7fa5300c6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:19.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.875+0000 7fa5356fd700 1 -- 172.21.15.49:0/2945054936 shutdown_connections 2023-11-30T17:19:19.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.875+0000 7fa5356fd700 1 -- 172.21.15.49:0/2945054936 wait complete. 2023-11-30T17:19:19.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.876+0000 7fa5356fd700 1 Processor -- start 2023-11-30T17:19:19.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.876+0000 7fa5356fd700 1 -- start start 2023-11-30T17:19:19.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.877+0000 7fa5356fd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa51c003e10 0x7fa530160280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:19.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.877+0000 7fa5356fd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5300a7720 0x7fa530163120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:19.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.877+0000 7fa5356fd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5300a8a40 0x7fa5300bbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:19.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.877+0000 7fa5356fd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5300a87c0 con 0x7fa5300a8a40 2023-11-30T17:19:19.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.877+0000 7fa5356fd700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa530163610 con 0x7fa5300a7720 2023-11-30T17:19:19.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.877+0000 7fa5356fd700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5300a7bb0 con 0x7fa51c003e10 2023-11-30T17:19:19.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.877+0000 7fa534efc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5300a8a40 0x7fa5300bbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:19.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.877+0000 7fa534efc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5300a8a40 0x7fa5300bbbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43836/0 (socket says 172.21.15.49:43836) 2023-11-30T17:19:19.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.877+0000 7fa534efc700 1 -- 172.21.15.49:0/3717485528 learned_addr learned my addr 172.21.15.49:0/3717485528 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:19.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.877+0000 7fa52ffff700 1 --2- 172.21.15.49:0/3717485528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa51c003e10 0x7fa530160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:19.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.877+0000 7fa52f7fe700 1 --2- 172.21.15.49:0/3717485528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5300a7720 0x7fa530163120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:19.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.877+0000 7fa534efc700 1 -- 172.21.15.49:0/3717485528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa51c003e10 msgr2=0x7fa530160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:19.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.877+0000 7fa534efc700 1 --2- 172.21.15.49:0/3717485528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa51c003e10 0x7fa530160280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:19.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.877+0000 7fa534efc700 1 -- 172.21.15.49:0/3717485528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5300a7720 msgr2=0x7fa530163120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:19.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.877+0000 7fa534efc700 1 --2- 172.21.15.49:0/3717485528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5300a7720 0x7fa530163120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:19.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.877+0000 7fa534efc700 1 -- 172.21.15.49:0/3717485528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5300a7e90 con 0x7fa5300a8a40 2023-11-30T17:19:19.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.878+0000 7fa534efc700 1 --2- 172.21.15.49:0/3717485528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5300a8a40 0x7fa5300bbbb0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fa53006afe0 tx=0x7fa52800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:19.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.878+0000 7fa527fff700 1 -- 172.21.15.49:0/3717485528 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52800e040 con 0x7fa5300a8a40 2023-11-30T17:19:19.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.878+0000 7fa527fff700 1 -- 172.21.15.49:0/3717485528 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa52800f040 con 0x7fa5300a8a40 2023-11-30T17:19:19.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.878+0000 7fa527fff700 1 -- 172.21.15.49:0/3717485528 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52800fd70 con 0x7fa5300a8a40 2023-11-30T17:19:19.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.878+0000 7fa5356fd700 1 -- 172.21.15.49:0/3717485528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5300a8170 con 0x7fa5300a8a40 2023-11-30T17:19:19.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.878+0000 7fa5356fd700 1 -- 172.21.15.49:0/3717485528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5300a8ec0 con 0x7fa5300a8a40 2023-11-30T17:19:19.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.879+0000 7fa5356fd700 1 -- 172.21.15.49:0/3717485528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5300a8610 con 0x7fa5300a8a40 2023-11-30T17:19:19.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.879+0000 7fa527fff700 1 -- 172.21.15.49:0/3717485528 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fa528015660 con 0x7fa5300a8a40 2023-11-30T17:19:19.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.879+0000 7fa527fff700 1 --2- 172.21.15.49:0/3717485528 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa51005f2c0 0x7fa510061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:19.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.879+0000 7fa527fff700 1 -- 172.21.15.49:0/3717485528 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fa52807af60 con 0x7fa5300a8a40 2023-11-30T17:19:19.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.880+0000 7fa52ffff700 1 --2- 172.21.15.49:0/3717485528 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa51005f2c0 0x7fa510061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:19.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.880+0000 7fa52ffff700 1 --2- 172.21.15.49:0/3717485528 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa51005f2c0 0x7fa510061780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fa520000fd0 tx=0x7fa520001e90).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:19.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:19.884+0000 7fa527fff700 1 -- 172.21.15.49:0/3717485528 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa52804bfe0 con 0x7fa5300a8a40 2023-11-30T17:19:20.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.086+0000 7fa5356fd700 1 -- 172.21.15.49:0/3717485528 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5300c4c40 con 0x7fa51005f2c0 2023-11-30T17:19:20.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.090+0000 7fa527fff700 1 -- 172.21.15.49:0/3717485528 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fa5300c4c40 con 0x7fa51005f2c0 2023-11-30T17:19:20.093 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule deactivated for path /snap_test_dir1/dir1 2023-11-30T17:19:20.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.092+0000 7fa5356fd700 1 -- 172.21.15.49:0/3717485528 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa51005f2c0 msgr2=0x7fa510061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:20.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.092+0000 7fa5356fd700 1 --2- 172.21.15.49:0/3717485528 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa51005f2c0 0x7fa510061780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fa520000fd0 tx=0x7fa520001e90).stop 2023-11-30T17:19:20.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.092+0000 7fa5356fd700 1 -- 172.21.15.49:0/3717485528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5300a8a40 msgr2=0x7fa5300bbbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:20.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.092+0000 7fa5356fd700 1 --2- 172.21.15.49:0/3717485528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5300a8a40 0x7fa5300bbbb0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fa53006afe0 tx=0x7fa52800b040).stop 2023-11-30T17:19:20.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.092+0000 7fa5356fd700 1 -- 172.21.15.49:0/3717485528 shutdown_connections 2023-11-30T17:19:20.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.093+0000 7fa5356fd700 1 --2- 172.21.15.49:0/3717485528 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa51005f2c0 0x7fa510061780 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:20.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.093+0000 7fa5356fd700 1 --2- 172.21.15.49:0/3717485528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5300a8a40 0x7fa5300bbbb0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:20.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.093+0000 7fa5356fd700 1 --2- 172.21.15.49:0/3717485528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa51c003e10 0x7fa530160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:20.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.093+0000 7fa5356fd700 1 --2- 172.21.15.49:0/3717485528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5300a7720 0x7fa530163120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:20.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.093+0000 7fa5356fd700 1 -- 172.21.15.49:0/3717485528 >> 172.21.15.49:0/3717485528 conn(0x7fa5300631d0 msgr2=0x7fa5300643c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:20.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.093+0000 7fa5356fd700 1 -- 172.21.15.49:0/3717485528 shutdown_connections 2023-11-30T17:19:20.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.093+0000 7fa5356fd700 1 -- 172.21.15.49:0/3717485528 wait complete. 2023-11-30T17:19:20.107 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir1 2023-11-30T17:19:20.107 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir2 1M 2023-11-30T17:19:20.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.227+0000 7f425b5a9700 1 Processor -- start 2023-11-30T17:19:20.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.227+0000 7f425b5a9700 1 -- start start 2023-11-30T17:19:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.228+0000 7f425b5a9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4254154910 0x7f42540a7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.228+0000 7f425b5a9700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f42540aa220 0x7f42540aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.228+0000 7f425b5a9700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42540c6630 con 0x7f4254154530 2023-11-30T17:19:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.228+0000 7f425b5a9700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42540c6390 con 0x7f42540aa220 2023-11-30T17:19:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.228+0000 7f425b5a9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42540a84e0 con 0x7f4254154910 2023-11-30T17:19:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.228+0000 7f4259b46700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f42540aa220 0x7f42540aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.228+0000 7f4258b44700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4254154910 0x7f42540a7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.228+0000 7f4259345700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f4254154530 0x7f42540c8580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:57668/0 (socket says 172.21.15.49:57668) 2023-11-30T17:19:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.228+0000 7f4259345700 1 -- 172.21.15.49:0/1489519031 learned_addr learned my addr 172.21.15.49:0/1489519031 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:20.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.229+0000 7f4259b46700 1 -- 172.21.15.49:0/1489519031 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4254154910 msgr2=0x7f42540a7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:20.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.229+0000 7f4259b46700 1 --2- 172.21.15.49:0/1489519031 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4254154910 0x7f42540a7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:20.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.229+0000 7f4259b46700 1 -- 172.21.15.49:0/1489519031 >> v1:172.21.15.115:6789/0 conn(0x7f4254154530 legacy=0x7f42540c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:20.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.229+0000 7f4253fff700 1 -- 172.21.15.49:0/1489519031 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2491670721 0 0) 0x7f42540c6630 con 0x7f4254154530 2023-11-30T17:19:20.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.229+0000 7f4259b46700 1 -- 172.21.15.49:0/1489519031 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42540aaba0 con 0x7f42540aa220 2023-11-30T17:19:20.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.229+0000 7f4259b46700 1 --2- 172.21.15.49:0/1489519031 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42540aa220 0x7f42540aa6b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f424c009760 tx=0x7f424c009060).ready entity=mon.1 client_cookie=8d8f1158a13da9d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:20.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.229+0000 7f4253fff700 1 -- 172.21.15.49:0/1489519031 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c00f510 con 0x7f42540aa220 2023-11-30T17:19:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.229+0000 7f4253fff700 1 -- 172.21.15.49:0/1489519031 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424c00f670 con 0x7f42540aa220 2023-11-30T17:19:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.229+0000 7f4253fff700 1 -- 172.21.15.49:0/1489519031 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c00f9f0 con 0x7f42540aa220 2023-11-30T17:19:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.230+0000 7f425b5a9700 1 -- 172.21.15.49:0/1489519031 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42540aa220 msgr2=0x7f42540aa6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.230+0000 7f425b5a9700 1 --2- 172.21.15.49:0/1489519031 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42540aa220 0x7f42540aa6b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f424c009760 tx=0x7f424c009060).stop 2023-11-30T17:19:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.230+0000 7f425b5a9700 1 -- 172.21.15.49:0/1489519031 shutdown_connections 2023-11-30T17:19:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.230+0000 7f425b5a9700 1 --2- 172.21.15.49:0/1489519031 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42540aa220 0x7f42540aa6b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.230+0000 7f425b5a9700 1 --2- 172.21.15.49:0/1489519031 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4254154910 0x7f42540a7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.230+0000 7f425b5a9700 1 -- 172.21.15.49:0/1489519031 >> 172.21.15.49:0/1489519031 conn(0x7f4254094930 msgr2=0x7f425406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.230+0000 7f425b5a9700 1 -- 172.21.15.49:0/1489519031 shutdown_connections 2023-11-30T17:19:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.230+0000 7f425b5a9700 1 -- 172.21.15.49:0/1489519031 wait complete. 2023-11-30T17:19:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.231+0000 7f425b5a9700 1 Processor -- start 2023-11-30T17:19:20.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.231+0000 7f425b5a9700 1 -- start start 2023-11-30T17:19:20.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.232+0000 7f425b5a9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42540aa220 0x7f425414dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:20.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.232+0000 7f425b5a9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4254154530 0x7f4254147570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:20.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.232+0000 7f425b5a9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4254154910 0x7f42540a8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:20.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.232+0000 7f425b5a9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4254151c90 con 0x7f4254154530 2023-11-30T17:19:20.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.232+0000 7f425b5a9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4254148490 con 0x7f42540aa220 2023-11-30T17:19:20.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.232+0000 7f425b5a9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4254147a60 con 0x7f4254154910 2023-11-30T17:19:20.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.232+0000 7f4258b44700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4254154530 0x7f4254147570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:20.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.232+0000 7f4258b44700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4254154530 0x7f4254147570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43850/0 (socket says 172.21.15.49:43850) 2023-11-30T17:19:20.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.232+0000 7f4258b44700 1 -- 172.21.15.49:0/769403960 learned_addr learned my addr 172.21.15.49:0/769403960 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:20.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.232+0000 7f4259345700 1 --2- 172.21.15.49:0/769403960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42540aa220 0x7f425414dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:20.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.232+0000 7f4259b46700 1 --2- 172.21.15.49:0/769403960 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4254154910 0x7f42540a8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:20.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.232+0000 7f4258b44700 1 -- 172.21.15.49:0/769403960 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4254154910 msgr2=0x7f42540a8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:20.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.232+0000 7f4258b44700 1 --2- 172.21.15.49:0/769403960 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4254154910 0x7f42540a8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:20.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.232+0000 7f4258b44700 1 -- 172.21.15.49:0/769403960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42540aa220 msgr2=0x7f425414dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:20.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.232+0000 7f4258b44700 1 --2- 172.21.15.49:0/769403960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42540aa220 0x7f425414dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:20.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.232+0000 7f4258b44700 1 -- 172.21.15.49:0/769403960 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f424c0092a0 con 0x7f4254154530 2023-11-30T17:19:20.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.233+0000 7f4258b44700 1 --2- 172.21.15.49:0/769403960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4254154530 0x7f4254147570 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f424800e900 tx=0x7f4248009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:20.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.233+0000 7f42517fa700 1 -- 172.21.15.49:0/769403960 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4248012600 con 0x7f4254154530 2023-11-30T17:19:20.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.233+0000 7f42517fa700 1 -- 172.21.15.49:0/769403960 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4248012760 con 0x7f4254154530 2023-11-30T17:19:20.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.233+0000 7f42517fa700 1 -- 172.21.15.49:0/769403960 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4248012ae0 con 0x7f4254154530 2023-11-30T17:19:20.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.233+0000 7f425b5a9700 1 -- 172.21.15.49:0/769403960 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4254151ef0 con 0x7f4254154530 2023-11-30T17:19:20.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.233+0000 7f425b5a9700 1 -- 172.21.15.49:0/769403960 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42541524b0 con 0x7f4254154530 2023-11-30T17:19:20.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.234+0000 7f425b5a9700 1 -- 172.21.15.49:0/769403960 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f425406c860 con 0x7f4254154530 2023-11-30T17:19:20.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.234+0000 7f42517fa700 1 -- 172.21.15.49:0/769403960 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f424801b400 con 0x7f4254154530 2023-11-30T17:19:20.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.235+0000 7f42517fa700 1 --2- 172.21.15.49:0/769403960 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f424005f2c0 0x7f4240061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:20.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.235+0000 7f42517fa700 1 -- 172.21.15.49:0/769403960 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f424807a810 con 0x7f4254154530 2023-11-30T17:19:20.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.235+0000 7f4259345700 1 --2- 172.21.15.49:0/769403960 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f424005f2c0 0x7f4240061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:20.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.235+0000 7f4259345700 1 --2- 172.21.15.49:0/769403960 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f424005f2c0 0x7f4240061780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f4244001fd0 tx=0x7f4244009040).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:20.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.239+0000 7f42517fa700 1 -- 172.21.15.49:0/769403960 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f424804b830 con 0x7f4254154530 2023-11-30T17:19:20.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.442+0000 7f425b5a9700 1 -- 172.21.15.49:0/769403960 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4254064230 con 0x7f424005f2c0 2023-11-30T17:19:20.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.446+0000 7f42517fa700 1 -- 172.21.15.49:0/769403960 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f4254064230 con 0x7f424005f2c0 2023-11-30T17:19:20.448 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule deactivated for path /snap_test_dir1/dir2 2023-11-30T17:19:20.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.448+0000 7f425b5a9700 1 -- 172.21.15.49:0/769403960 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f424005f2c0 msgr2=0x7f4240061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:20.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.448+0000 7f425b5a9700 1 --2- 172.21.15.49:0/769403960 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f424005f2c0 0x7f4240061780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f4244001fd0 tx=0x7f4244009040).stop 2023-11-30T17:19:20.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.448+0000 7f425b5a9700 1 -- 172.21.15.49:0/769403960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4254154530 msgr2=0x7f4254147570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:20.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.448+0000 7f425b5a9700 1 --2- 172.21.15.49:0/769403960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4254154530 0x7f4254147570 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f424800e900 tx=0x7f4248009060).stop 2023-11-30T17:19:20.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.448+0000 7f425b5a9700 1 -- 172.21.15.49:0/769403960 shutdown_connections 2023-11-30T17:19:20.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.448+0000 7f425b5a9700 1 --2- 172.21.15.49:0/769403960 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4254154910 0x7f42540a8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:20.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.448+0000 7f425b5a9700 1 --2- 172.21.15.49:0/769403960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42540aa220 0x7f425414dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:20.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.448+0000 7f425b5a9700 1 --2- 172.21.15.49:0/769403960 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f424005f2c0 0x7f4240061780 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:20.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.448+0000 7f425b5a9700 1 --2- 172.21.15.49:0/769403960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4254154530 0x7f4254147570 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:20.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.448+0000 7f425b5a9700 1 -- 172.21.15.49:0/769403960 >> 172.21.15.49:0/769403960 conn(0x7f4254094930 msgr2=0x7f42540ca9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:20.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.448+0000 7f425b5a9700 1 -- 172.21.15.49:0/769403960 shutdown_connections 2023-11-30T17:19:20.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.448+0000 7f425b5a9700 1 -- 172.21.15.49:0/769403960 wait complete. 2023-11-30T17:19:20.462 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir2 2023-11-30T17:19:20.462 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir3 1M 2023-11-30T17:19:20.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.581+0000 7f30b359e700 1 Processor -- start 2023-11-30T17:19:20.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.581+0000 7f30b359e700 1 -- start start 2023-11-30T17:19:20.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.582+0000 7f30b359e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f30b41542d0 0x7f30b40a9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:20.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.582+0000 7f30b359e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30b40c66d0 0x7f30b40aa460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:20.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.582+0000 7f30b359e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30b4158d50 con 0x7f30b41546b0 2023-11-30T17:19:20.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.582+0000 7f30b359e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30b40c6b60 con 0x7f30b41542d0 2023-11-30T17:19:20.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.582+0000 7f30b359e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30b40aa950 con 0x7f30b40c66d0 2023-11-30T17:19:20.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.582+0000 7f30b1d9b700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f30b41546b0 0x7f30b40c5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50274/0 (socket says 172.21.15.49:50274) 2023-11-30T17:19:20.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.582+0000 7f30b1d9b700 1 -- 172.21.15.49:0/1431237932 learned_addr learned my addr 172.21.15.49:0/1431237932 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:20.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.583+0000 7f30b259c700 1 --2- 172.21.15.49:0/1431237932 >> v2:172.21.15.115:3300/0 conn(0x7f30b41542d0 0x7f30b40a9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:20.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.583+0000 7f30b2d9d700 1 --2- 172.21.15.49:0/1431237932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30b40c66d0 0x7f30b40aa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:20.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.583+0000 7f30b159a700 1 -- 172.21.15.49:0/1431237932 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 494043599 0 0) 0x7f30b4158d50 con 0x7f30b41546b0 2023-11-30T17:19:20.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.583+0000 7f30b159a700 1 -- 172.21.15.49:0/1431237932 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30a00033f0 con 0x7f30b41546b0 2023-11-30T17:19:20.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.583+0000 7f30b259c700 1 -- 172.21.15.49:0/1431237932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30b40c66d0 msgr2=0x7f30b40aa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:20.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.583+0000 7f30b259c700 1 --2- 172.21.15.49:0/1431237932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30b40c66d0 0x7f30b40aa460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:20.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.583+0000 7f30b259c700 1 -- 172.21.15.49:0/1431237932 >> v1:172.21.15.49:6789/0 conn(0x7f30b41546b0 legacy=0x7f30b40c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:20.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.583+0000 7f30b259c700 1 -- 172.21.15.49:0/1431237932 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b4158140 con 0x7f30b41542d0 2023-11-30T17:19:20.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.583+0000 7f30b259c700 1 --2- 172.21.15.49:0/1431237932 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30b41542d0 0x7f30b40a9f70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f30ac009760 tx=0x7f30ac009060).ready entity=mon.1 client_cookie=ed30ce9e89da9ac0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:20.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.583+0000 7f30b159a700 1 -- 172.21.15.49:0/1431237932 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac00d4a0 con 0x7f30b41542d0 2023-11-30T17:19:20.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.583+0000 7f30b159a700 1 -- 172.21.15.49:0/1431237932 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ac00d600 con 0x7f30b41542d0 2023-11-30T17:19:20.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.583+0000 7f30b159a700 1 -- 172.21.15.49:0/1431237932 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac00d980 con 0x7f30b41542d0 2023-11-30T17:19:20.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.584+0000 7f30b359e700 1 -- 172.21.15.49:0/1431237932 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30b41542d0 msgr2=0x7f30b40a9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:20.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.584+0000 7f30b359e700 1 --2- 172.21.15.49:0/1431237932 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30b41542d0 0x7f30b40a9f70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f30ac009760 tx=0x7f30ac009060).stop 2023-11-30T17:19:20.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.584+0000 7f30b359e700 1 -- 172.21.15.49:0/1431237932 shutdown_connections 2023-11-30T17:19:20.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.584+0000 7f30b359e700 1 --2- 172.21.15.49:0/1431237932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30b40c66d0 0x7f30b40aa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:20.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.584+0000 7f30b359e700 1 --2- 172.21.15.49:0/1431237932 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30b41542d0 0x7f30b40a9f70 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:20.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.584+0000 7f30b359e700 1 -- 172.21.15.49:0/1431237932 >> 172.21.15.49:0/1431237932 conn(0x7f30b40cb010 msgr2=0x7f30b40cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:20.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.584+0000 7f30b359e700 1 -- 172.21.15.49:0/1431237932 shutdown_connections 2023-11-30T17:19:20.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.584+0000 7f30b359e700 1 -- 172.21.15.49:0/1431237932 wait complete. 2023-11-30T17:19:20.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.585+0000 7f30b359e700 1 Processor -- start 2023-11-30T17:19:20.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.585+0000 7f30b359e700 1 -- start start 2023-11-30T17:19:20.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.586+0000 7f30b359e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30b40c66d0 0x7f30b414dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:20.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.586+0000 7f30b359e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30b41542d0 0x7f30b4167e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:20.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.586+0000 7f30b359e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30b41546b0 0x7f30b40c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:20.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.586+0000 7f30b359e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b4168e20 con 0x7f30b40c66d0 2023-11-30T17:19:20.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.586+0000 7f30b359e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b4164920 con 0x7f30b41546b0 2023-11-30T17:19:20.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.586+0000 7f30b359e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30b4155040 con 0x7f30b41542d0 2023-11-30T17:19:20.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.586+0000 7f30b259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30b40c66d0 0x7f30b414dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:20.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.586+0000 7f30b259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30b40c66d0 0x7f30b414dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44186/0 (socket says 172.21.15.49:44186) 2023-11-30T17:19:20.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.586+0000 7f30b259c700 1 -- 172.21.15.49:0/2604857137 learned_addr learned my addr 172.21.15.49:0/2604857137 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:20.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.586+0000 7f30b1d9b700 1 --2- 172.21.15.49:0/2604857137 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30b41542d0 0x7f30b4167e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:20.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.586+0000 7f30b2d9d700 1 --2- 172.21.15.49:0/2604857137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30b41546b0 0x7f30b40c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:20.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.586+0000 7f30b259c700 1 -- 172.21.15.49:0/2604857137 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30b41542d0 msgr2=0x7f30b4167e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.586+0000 7f30b259c700 1 --2- 172.21.15.49:0/2604857137 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30b41542d0 0x7f30b4167e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.586+0000 7f30b259c700 1 -- 172.21.15.49:0/2604857137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30b41546b0 msgr2=0x7f30b40c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.586+0000 7f30b259c700 1 --2- 172.21.15.49:0/2604857137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30b41546b0 0x7f30b40c40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.586+0000 7f30b259c700 1 -- 172.21.15.49:0/2604857137 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ac0092a0 con 0x7f30b40c66d0 2023-11-30T17:19:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.586+0000 7f30b259c700 1 --2- 172.21.15.49:0/2604857137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30b40c66d0 0x7f30b414dce0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f30ac009d50 tx=0x7f30ac016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.587+0000 7f30aa7fc700 1 -- 172.21.15.49:0/2604857137 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac00de10 con 0x7f30b40c66d0 2023-11-30T17:19:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.587+0000 7f30aa7fc700 1 -- 172.21.15.49:0/2604857137 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ac00d770 con 0x7f30b40c66d0 2023-11-30T17:19:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.587+0000 7f30b359e700 1 -- 172.21.15.49:0/2604857137 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30b4168860 con 0x7f30b40c66d0 2023-11-30T17:19:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.587+0000 7f30aa7fc700 1 -- 172.21.15.49:0/2604857137 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac01d660 con 0x7f30b40c66d0 2023-11-30T17:19:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.587+0000 7f30b359e700 1 -- 172.21.15.49:0/2604857137 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30b4154cd0 con 0x7f30b40c66d0 2023-11-30T17:19:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.588+0000 7f30b359e700 1 -- 172.21.15.49:0/2604857137 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30b4154b30 con 0x7f30b40c66d0 2023-11-30T17:19:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.588+0000 7f30aa7fc700 1 -- 172.21.15.49:0/2604857137 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f30ac01da10 con 0x7f30b40c66d0 2023-11-30T17:19:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.588+0000 7f30aa7fc700 1 --2- 172.21.15.49:0/2604857137 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f309405f2c0 0x7f3094061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.588+0000 7f30aa7fc700 1 -- 172.21.15.49:0/2604857137 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f30ac07bc90 con 0x7f30b40c66d0 2023-11-30T17:19:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.588+0000 7f30b1d9b700 1 --2- 172.21.15.49:0/2604857137 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f309405f2c0 0x7f3094061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:20.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.589+0000 7f30b1d9b700 1 --2- 172.21.15.49:0/2604857137 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f309405f2c0 0x7f3094061780 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f30b40aa230 tx=0x7f309c009040).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:20.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.592+0000 7f30aa7fc700 1 -- 172.21.15.49:0/2604857137 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f30b4154b30 con 0x7f30b40c66d0 2023-11-30T17:19:20.791 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:19:20.793 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:19:20.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.793+0000 7f30b359e700 1 -- 172.21.15.49:0/2604857137 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f30b4155180 con 0x7f309405f2c0 2023-11-30T17:19:20.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.797+0000 7f30aa7fc700 1 -- 172.21.15.49:0/2604857137 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f309c007110 con 0x7f309405f2c0 2023-11-30T17:19:20.799 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule deactivated for path /snap_test_dir1/dir3 2023-11-30T17:19:20.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.799+0000 7f30b359e700 1 -- 172.21.15.49:0/2604857137 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f309405f2c0 msgr2=0x7f3094061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:20.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.799+0000 7f30b359e700 1 --2- 172.21.15.49:0/2604857137 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f309405f2c0 0x7f3094061780 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f30b40aa230 tx=0x7f309c009040).stop 2023-11-30T17:19:20.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.799+0000 7f30b359e700 1 -- 172.21.15.49:0/2604857137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30b40c66d0 msgr2=0x7f30b414dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:20.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.799+0000 7f30b359e700 1 --2- 172.21.15.49:0/2604857137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30b40c66d0 0x7f30b414dce0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f30ac009d50 tx=0x7f30ac016000).stop 2023-11-30T17:19:20.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.799+0000 7f30b359e700 1 -- 172.21.15.49:0/2604857137 shutdown_connections 2023-11-30T17:19:20.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.799+0000 7f30b359e700 1 --2- 172.21.15.49:0/2604857137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30b41546b0 0x7f30b40c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:20.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.799+0000 7f30b359e700 1 --2- 172.21.15.49:0/2604857137 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f309405f2c0 0x7f3094061780 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:20.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.799+0000 7f30b359e700 1 --2- 172.21.15.49:0/2604857137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30b40c66d0 0x7f30b414dce0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:20.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.799+0000 7f30b359e700 1 --2- 172.21.15.49:0/2604857137 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30b41542d0 0x7f30b4167e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:20.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.799+0000 7f30b359e700 1 -- 172.21.15.49:0/2604857137 >> 172.21.15.49:0/2604857137 conn(0x7f30b40cb010 msgr2=0x7f30b40ad550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:20.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.799+0000 7f30b359e700 1 -- 172.21.15.49:0/2604857137 shutdown_connections 2023-11-30T17:19:20.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:20.799+0000 7f30b359e700 1 -- 172.21.15.49:0/2604857137 wait complete. 2023-11-30T17:19:20.813 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir3 2023-11-30T17:19:20.814 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir4 1M 2023-11-30T17:19:21.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.005+0000 7fd550d9a700 1 Processor -- start 2023-11-30T17:19:21.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.005+0000 7fd550d9a700 1 -- start start 2023-11-30T17:19:21.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.006+0000 7fd550d9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd54c154170 0x7fd54c154550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:21.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.006+0000 7fd550d9a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd54c064880 0x7fd54c064d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:21.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.006+0000 7fd550d9a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd54c065200 con 0x7fd54c158040 2023-11-30T17:19:21.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.006+0000 7fd550d9a700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd54c0aa840 con 0x7fd54c064880 2023-11-30T17:19:21.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.006+0000 7fd550d9a700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd54c1584d0 con 0x7fd54c154170 2023-11-30T17:19:21.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.006+0000 7fd54bfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd54c064880 0x7fd54c064d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:21.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.006+0000 7fd54bfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd54c064880 0x7fd54c064d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44200/0 (socket says 172.21.15.49:44200) 2023-11-30T17:19:21.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.006+0000 7fd54affd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd54c158040 0x7fd54c0aa130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46584/0 (socket says 172.21.15.49:46584) 2023-11-30T17:19:21.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.006+0000 7fd54bfff700 1 -- 172.21.15.49:0/1446320223 learned_addr learned my addr 172.21.15.49:0/1446320223 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:21.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.006+0000 7fd54b7fe700 1 --2- 172.21.15.49:0/1446320223 >> v2:172.21.15.115:3300/0 conn(0x7fd54c154170 0x7fd54c154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:21.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.006+0000 7fd54bfff700 1 -- 172.21.15.49:0/1446320223 >> v2:172.21.15.115:3300/0 conn(0x7fd54c154170 msgr2=0x7fd54c154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:21.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.006+0000 7fd54bfff700 1 --2- 172.21.15.49:0/1446320223 >> v2:172.21.15.115:3300/0 conn(0x7fd54c154170 0x7fd54c154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:21.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.006+0000 7fd54bfff700 1 -- 172.21.15.49:0/1446320223 >> v1:172.21.15.49:6789/0 conn(0x7fd54c158040 legacy=0x7fd54c0aa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:21.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.006+0000 7fd54a7fc700 1 -- 172.21.15.49:0/1446320223 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1841376442 0 0) 0x7fd54c065200 con 0x7fd54c158040 2023-11-30T17:19:21.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.006+0000 7fd54bfff700 1 -- 172.21.15.49:0/1446320223 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c1587b0 con 0x7fd54c064880 2023-11-30T17:19:21.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.006+0000 7fd54bfff700 1 --2- 172.21.15.49:0/1446320223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54c064880 0x7fd54c064d10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fd54c0aa9e0 tx=0x7fd544009840).ready entity=mon.0 client_cookie=de349b5726b62236 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:21.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.006+0000 7fd54a7fc700 1 -- 172.21.15.49:0/1446320223 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54400e070 con 0x7fd54c064880 2023-11-30T17:19:21.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.007+0000 7fd54a7fc700 1 -- 172.21.15.49:0/1446320223 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54400ba50 con 0x7fd54c064880 2023-11-30T17:19:21.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.007+0000 7fd54a7fc700 1 -- 172.21.15.49:0/1446320223 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54400bdd0 con 0x7fd54c064880 2023-11-30T17:19:21.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.007+0000 7fd550d9a700 1 -- 172.21.15.49:0/1446320223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54c064880 msgr2=0x7fd54c064d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:21.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.007+0000 7fd550d9a700 1 --2- 172.21.15.49:0/1446320223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54c064880 0x7fd54c064d10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fd54c0aa9e0 tx=0x7fd544009840).stop 2023-11-30T17:19:21.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.007+0000 7fd550d9a700 1 -- 172.21.15.49:0/1446320223 shutdown_connections 2023-11-30T17:19:21.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.007+0000 7fd550d9a700 1 --2- 172.21.15.49:0/1446320223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54c064880 0x7fd54c064d10 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:21.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.007+0000 7fd550d9a700 1 --2- 172.21.15.49:0/1446320223 >> v2:172.21.15.115:3300/0 conn(0x7fd54c154170 0x7fd54c154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:21.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.007+0000 7fd550d9a700 1 -- 172.21.15.49:0/1446320223 >> 172.21.15.49:0/1446320223 conn(0x7fd54c0cb010 msgr2=0x7fd54c0cb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:21.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.007+0000 7fd550d9a700 1 -- 172.21.15.49:0/1446320223 shutdown_connections 2023-11-30T17:19:21.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.007+0000 7fd550d9a700 1 -- 172.21.15.49:0/1446320223 wait complete. 2023-11-30T17:19:21.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.008+0000 7fd550d9a700 1 Processor -- start 2023-11-30T17:19:21.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.008+0000 7fd550d9a700 1 -- start start 2023-11-30T17:19:21.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.009+0000 7fd550d9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd54c064880 0x7fd54c147d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:21.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.009+0000 7fd550d9a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd54c154170 0x7fd54c154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:21.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.009+0000 7fd550d9a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54c154fd0 0x7fd54c0af150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:21.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.009+0000 7fd550d9a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c0aecc0 con 0x7fd54c154fd0 2023-11-30T17:19:21.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.009+0000 7fd550d9a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c155450 con 0x7fd54c064880 2023-11-30T17:19:21.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.009+0000 7fd550d9a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c0ae0b0 con 0x7fd54c154170 2023-11-30T17:19:21.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.009+0000 7fd54bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54c154fd0 0x7fd54c0af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:21.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.009+0000 7fd54bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54c154fd0 0x7fd54c0af150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44214/0 (socket says 172.21.15.49:44214) 2023-11-30T17:19:21.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.009+0000 7fd54bfff700 1 -- 172.21.15.49:0/3834222032 learned_addr learned my addr 172.21.15.49:0/3834222032 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:21.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.009+0000 7fd54affd700 1 --2- 172.21.15.49:0/3834222032 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd54c154170 0x7fd54c154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:21.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.010+0000 7fd54b7fe700 1 --2- 172.21.15.49:0/3834222032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd54c064880 0x7fd54c147d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:21.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.010+0000 7fd54bfff700 1 -- 172.21.15.49:0/3834222032 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd54c154170 msgr2=0x7fd54c154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:21.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.010+0000 7fd54bfff700 1 --2- 172.21.15.49:0/3834222032 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd54c154170 0x7fd54c154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:21.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.010+0000 7fd54bfff700 1 -- 172.21.15.49:0/3834222032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd54c064880 msgr2=0x7fd54c147d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:21.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.010+0000 7fd54bfff700 1 --2- 172.21.15.49:0/3834222032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd54c064880 0x7fd54c147d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:21.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.010+0000 7fd54bfff700 1 -- 172.21.15.49:0/3834222032 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd544009ae0 con 0x7fd54c154fd0 2023-11-30T17:19:21.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.010+0000 7fd54b7fe700 1 --2- 172.21.15.49:0/3834222032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd54c064880 0x7fd54c147d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:19:21.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.010+0000 7fd54bfff700 1 --2- 172.21.15.49:0/3834222032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54c154fd0 0x7fd54c0af150 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7fd54400bef0 tx=0x7fd544009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:21.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.010+0000 7fd5337fe700 1 -- 172.21.15.49:0/3834222032 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5440092e0 con 0x7fd54c154fd0 2023-11-30T17:19:21.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.010+0000 7fd5337fe700 1 -- 172.21.15.49:0/3834222032 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd544009460 con 0x7fd54c154fd0 2023-11-30T17:19:21.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.010+0000 7fd550d9a700 1 -- 172.21.15.49:0/3834222032 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd54c0ae390 con 0x7fd54c154fd0 2023-11-30T17:19:21.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.010+0000 7fd5337fe700 1 -- 172.21.15.49:0/3834222032 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54401e6a0 con 0x7fd54c154fd0 2023-11-30T17:19:21.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.010+0000 7fd550d9a700 1 -- 172.21.15.49:0/3834222032 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd54c0ae950 con 0x7fd54c154fd0 2023-11-30T17:19:21.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.011+0000 7fd550d9a700 1 -- 172.21.15.49:0/3834222032 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd54c06c7c0 con 0x7fd54c154fd0 2023-11-30T17:19:21.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.011+0000 7fd5337fe700 1 -- 172.21.15.49:0/3834222032 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fd544003040 con 0x7fd54c154fd0 2023-11-30T17:19:21.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.012+0000 7fd5337fe700 1 --2- 172.21.15.49:0/3834222032 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd53805f2c0 0x7fd538061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:21.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.012+0000 7fd5337fe700 1 -- 172.21.15.49:0/3834222032 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fd54407ba00 con 0x7fd54c154fd0 2023-11-30T17:19:21.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.012+0000 7fd54b7fe700 1 --2- 172.21.15.49:0/3834222032 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd53805f2c0 0x7fd538061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:21.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.012+0000 7fd54b7fe700 1 --2- 172.21.15.49:0/3834222032 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd53805f2c0 0x7fd538061780 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fd53c0098c0 tx=0x7fd53c008040).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:21.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.016+0000 7fd5337fe700 1 -- 172.21.15.49:0/3834222032 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd54404cbf0 con 0x7fd54c154fd0 2023-11-30T17:19:21.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.214+0000 7fd550d9a700 1 -- 172.21.15.49:0/3834222032 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd54c158a90 con 0x7fd53805f2c0 2023-11-30T17:19:21.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.219+0000 7fd5337fe700 1 -- 172.21.15.49:0/3834222032 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fd54c158a90 con 0x7fd53805f2c0 2023-11-30T17:19:21.221 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule deactivated for path /snap_test_dir1/dir4 2023-11-30T17:19:21.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.220+0000 7fd550d9a700 1 -- 172.21.15.49:0/3834222032 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd53805f2c0 msgr2=0x7fd538061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:21.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.220+0000 7fd550d9a700 1 --2- 172.21.15.49:0/3834222032 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd53805f2c0 0x7fd538061780 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fd53c0098c0 tx=0x7fd53c008040).stop 2023-11-30T17:19:21.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.220+0000 7fd550d9a700 1 -- 172.21.15.49:0/3834222032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54c154fd0 msgr2=0x7fd54c0af150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:21.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.220+0000 7fd550d9a700 1 --2- 172.21.15.49:0/3834222032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54c154fd0 0x7fd54c0af150 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7fd54400bef0 tx=0x7fd544009840).stop 2023-11-30T17:19:21.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.220+0000 7fd550d9a700 1 -- 172.21.15.49:0/3834222032 shutdown_connections 2023-11-30T17:19:21.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.220+0000 7fd550d9a700 1 --2- 172.21.15.49:0/3834222032 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd53805f2c0 0x7fd538061780 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:21.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.220+0000 7fd550d9a700 1 --2- 172.21.15.49:0/3834222032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54c154fd0 0x7fd54c0af150 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:21.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.220+0000 7fd550d9a700 1 --2- 172.21.15.49:0/3834222032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd54c064880 0x7fd54c147d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:21.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.220+0000 7fd550d9a700 1 --2- 172.21.15.49:0/3834222032 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd54c154170 0x7fd54c154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:21.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.220+0000 7fd550d9a700 1 -- 172.21.15.49:0/3834222032 >> 172.21.15.49:0/3834222032 conn(0x7fd54c0cb010 msgr2=0x7fd54c0c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:21.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.220+0000 7fd550d9a700 1 -- 172.21.15.49:0/3834222032 shutdown_connections 2023-11-30T17:19:21.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.220+0000 7fd550d9a700 1 -- 172.21.15.49:0/3834222032 wait complete. 2023-11-30T17:19:21.235 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir4 2023-11-30T17:19:21.235 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir5 1M 2023-11-30T17:19:21.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.355+0000 7fa6edb05700 1 Processor -- start 2023-11-30T17:19:21.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.355+0000 7fa6edb05700 1 -- start start 2023-11-30T17:19:21.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.356+0000 7fa6edb05700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e8154610 0x7fa6e81582e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:21.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.356+0000 7fa6edb05700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e8159210 con 0x7fa6e80aa1c0 2023-11-30T17:19:21.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.356+0000 7fa6edb05700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e80c0c70 con 0x7fa6e80ab3b0 2023-11-30T17:19:21.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.356+0000 7fa6edb05700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e80c2110 con 0x7fa6e8154610 2023-11-30T17:19:21.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.356+0000 7fa6e7fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa6e80aa1c0 0x7fa6e80aa5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46588/0 (socket says 172.21.15.49:46588) 2023-11-30T17:19:21.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.356+0000 7fa6e7fff700 1 -- 172.21.15.49:0/2212442090 learned_addr learned my addr 172.21.15.49:0/2212442090 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:21.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.356+0000 7fa6e77fe700 1 --2- 172.21.15.49:0/2212442090 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e8154610 0x7fa6e81582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:21.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.356+0000 7fa6e67fc700 1 -- 172.21.15.49:0/2212442090 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2046519055 0 0) 0x7fa6e8159210 con 0x7fa6e80aa1c0 2023-11-30T17:19:21.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.356+0000 7fa6e67fc700 1 -- 172.21.15.49:0/2212442090 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6d40033f0 con 0x7fa6e80aa1c0 2023-11-30T17:19:21.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.356+0000 7fa6e67fc700 1 -- 172.21.15.49:0/2212442090 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 758015028 0 0) 0x7fa6e80c0c70 con 0x7fa6e80ab3b0 2023-11-30T17:19:21.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.356+0000 7fa6e67fc700 1 -- 172.21.15.49:0/2212442090 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6e8159210 con 0x7fa6e80ab3b0 2023-11-30T17:19:21.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.356+0000 7fa6e67fc700 1 -- 172.21.15.49:0/2212442090 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 794288678 0 0) 0x7fa6d40033f0 con 0x7fa6e80aa1c0 2023-11-30T17:19:21.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.356+0000 7fa6e67fc700 1 -- 172.21.15.49:0/2212442090 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e8154610 msgr2=0x7fa6e81582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:21.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.356+0000 7fa6e67fc700 1 --2- 172.21.15.49:0/2212442090 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e8154610 0x7fa6e81582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:21.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.356+0000 7fa6e67fc700 1 -- 172.21.15.49:0/2212442090 >> v1:172.21.15.115:6789/0 conn(0x7fa6e80ab3b0 legacy=0x7fa6e80c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:21.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.356+0000 7fa6e67fc700 1 -- 172.21.15.49:0/2212442090 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e8158970 con 0x7fa6e80aa1c0 2023-11-30T17:19:21.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.356+0000 7fa6e67fc700 1 -- 172.21.15.49:0/2212442090 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fa6e0001470 con 0x7fa6e80aa1c0 2023-11-30T17:19:21.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.356+0000 7fa6e67fc700 1 -- 172.21.15.49:0/2212442090 >> v1:172.21.15.49:6789/0 conn(0x7fa6e80aa1c0 legacy=0x7fa6e80aa5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:21.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.357+0000 7fa6e67fc700 1 --2- 172.21.15.49:0/2212442090 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e8154610 0x7fa6d4003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:21.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.357+0000 7fa6e67fc700 1 --2- 172.21.15.49:0/2212442090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6d4003fb0 0x7fa6d4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:21.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.357+0000 7fa6e67fc700 1 --2- 172.21.15.49:0/2212442090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6d4004b80 0x7fa6d4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:21.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.357+0000 7fa6e67fc700 1 -- 172.21.15.49:0/2212442090 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e80c2110 con 0x7fa6d4004b80 2023-11-30T17:19:21.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.357+0000 7fa6e67fc700 1 -- 172.21.15.49:0/2212442090 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d400b990 con 0x7fa6d4003fb0 2023-11-30T17:19:21.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.357+0000 7fa6e67fc700 1 -- 172.21.15.49:0/2212442090 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d400bb50 con 0x7fa6e8154610 2023-11-30T17:19:21.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.357+0000 7fa6e7fff700 1 --2- 172.21.15.49:0/2212442090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6d4004b80 0x7fa6d4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:21.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.357+0000 7fa6e77fe700 1 --2- 172.21.15.49:0/2212442090 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e8154610 0x7fa6d4003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:21.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.357+0000 7fa6e6ffd700 1 --2- 172.21.15.49:0/2212442090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6d4003fb0 0x7fa6d4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:21.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.357+0000 7fa6e7fff700 1 -- 172.21.15.49:0/2212442090 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e8154610 msgr2=0x7fa6d4003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:21.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.357+0000 7fa6e7fff700 1 --2- 172.21.15.49:0/2212442090 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e8154610 0x7fa6d4003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:21.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.357+0000 7fa6e7fff700 1 -- 172.21.15.49:0/2212442090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6d4003fb0 msgr2=0x7fa6d4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:21.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.357+0000 7fa6e7fff700 1 --2- 172.21.15.49:0/2212442090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6d4003fb0 0x7fa6d4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:21.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.357+0000 7fa6e7fff700 1 -- 172.21.15.49:0/2212442090 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d40033f0 con 0x7fa6d4004b80 2023-11-30T17:19:21.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.357+0000 7fa6e7fff700 1 --2- 172.21.15.49:0/2212442090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6d4004b80 0x7fa6d4005000 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fa6e000c110 tx=0x7fa6e0001e10).ready entity=mon.0 client_cookie=6a0ce4bd40c88aa8 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:21.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.357+0000 7fa6e67fc700 1 -- 172.21.15.49:0/2212442090 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e000ca40 con 0x7fa6d4004b80 2023-11-30T17:19:21.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.357+0000 7fa6e67fc700 1 -- 172.21.15.49:0/2212442090 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e000cba0 con 0x7fa6d4004b80 2023-11-30T17:19:21.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.357+0000 7fa6e67fc700 1 -- 172.21.15.49:0/2212442090 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e00070d0 con 0x7fa6d4004b80 2023-11-30T17:19:21.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.358+0000 7fa6edb05700 1 -- 172.21.15.49:0/2212442090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6d4004b80 msgr2=0x7fa6d4005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:21.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.358+0000 7fa6edb05700 1 --2- 172.21.15.49:0/2212442090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6d4004b80 0x7fa6d4005000 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fa6e000c110 tx=0x7fa6e0001e10).stop 2023-11-30T17:19:21.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.358+0000 7fa6e7fff700 1 -- 172.21.15.49:0/2212442090 reap_dead start 2023-11-30T17:19:21.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.358+0000 7fa6edb05700 1 -- 172.21.15.49:0/2212442090 shutdown_connections 2023-11-30T17:19:21.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.358+0000 7fa6edb05700 1 -- 172.21.15.49:0/2212442090 >> 172.21.15.49:0/2212442090 conn(0x7fa6e80655a0 msgr2=0x7fa6e8069e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:21.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.358+0000 7fa6edb05700 1 -- 172.21.15.49:0/2212442090 shutdown_connections 2023-11-30T17:19:21.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.358+0000 7fa6edb05700 1 -- 172.21.15.49:0/2212442090 wait complete. 2023-11-30T17:19:21.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.359+0000 7fa6edb05700 1 Processor -- start 2023-11-30T17:19:21.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.359+0000 7fa6edb05700 1 -- start start 2023-11-30T17:19:21.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.360+0000 7fa6edb05700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e80c3da0 0x7fa6e80b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:21.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.360+0000 7fa6edb05700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6e80c4180 0x7fa6e814d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:21.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.360+0000 7fa6edb05700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6e8167da0 0x7fa6e81681e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:21.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.360+0000 7fa6edb05700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e8155fa0 con 0x7fa6e8167da0 2023-11-30T17:19:21.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.360+0000 7fa6edb05700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e8156280 con 0x7fa6e80c4180 2023-11-30T17:19:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.360+0000 7fa6edb05700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e8156560 con 0x7fa6e80c3da0 2023-11-30T17:19:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.360+0000 7fa6e7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6e8167da0 0x7fa6e81681e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.360+0000 7fa6e7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6e8167da0 0x7fa6e81681e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44238/0 (socket says 172.21.15.49:44238) 2023-11-30T17:19:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.360+0000 7fa6e7fff700 1 -- 172.21.15.49:0/4119352251 learned_addr learned my addr 172.21.15.49:0/4119352251 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.360+0000 7fa6e77fe700 1 --2- 172.21.15.49:0/4119352251 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e80c3da0 0x7fa6e80b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.360+0000 7fa6e6ffd700 1 --2- 172.21.15.49:0/4119352251 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6e80c4180 0x7fa6e814d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.360+0000 7fa6e7fff700 1 -- 172.21.15.49:0/4119352251 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e80c3da0 msgr2=0x7fa6e80b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.360+0000 7fa6e7fff700 1 --2- 172.21.15.49:0/4119352251 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e80c3da0 0x7fa6e80b0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.360+0000 7fa6e7fff700 1 -- 172.21.15.49:0/4119352251 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6e80c4180 msgr2=0x7fa6e814d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.360+0000 7fa6e7fff700 1 --2- 172.21.15.49:0/4119352251 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6e80c4180 0x7fa6e814d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.360+0000 7fa6e7fff700 1 -- 172.21.15.49:0/4119352251 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e814d600 con 0x7fa6e8167da0 2023-11-30T17:19:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.360+0000 7fa6e77fe700 1 --2- 172.21.15.49:0/4119352251 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e80c3da0 0x7fa6e80b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:19:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.360+0000 7fa6e6ffd700 1 --2- 172.21.15.49:0/4119352251 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6e80c4180 0x7fa6e814d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:19:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.360+0000 7fa6e7fff700 1 --2- 172.21.15.49:0/4119352251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6e8167da0 0x7fa6e81681e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7fa6e000a000 tx=0x7fa6e0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.361+0000 7fa6df7fe700 1 -- 172.21.15.49:0/4119352251 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e00014f0 con 0x7fa6e8167da0 2023-11-30T17:19:21.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.361+0000 7fa6df7fe700 1 -- 172.21.15.49:0/4119352251 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e0018070 con 0x7fa6e8167da0 2023-11-30T17:19:21.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.361+0000 7fa6edb05700 1 -- 172.21.15.49:0/4119352251 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6e81686d0 con 0x7fa6e8167da0 2023-11-30T17:19:21.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.361+0000 7fa6df7fe700 1 -- 172.21.15.49:0/4119352251 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e00136a0 con 0x7fa6e8167da0 2023-11-30T17:19:21.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.361+0000 7fa6edb05700 1 -- 172.21.15.49:0/4119352251 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6e8168b70 con 0x7fa6e8167da0 2023-11-30T17:19:21.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.362+0000 7fa6edb05700 1 -- 172.21.15.49:0/4119352251 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6e80c4560 con 0x7fa6e8167da0 2023-11-30T17:19:21.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.362+0000 7fa6df7fe700 1 -- 172.21.15.49:0/4119352251 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fa6e0013ad0 con 0x7fa6e8167da0 2023-11-30T17:19:21.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.362+0000 7fa6df7fe700 1 --2- 172.21.15.49:0/4119352251 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa6c805f2f0 0x7fa6c80617b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:21.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.362+0000 7fa6df7fe700 1 -- 172.21.15.49:0/4119352251 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fa6e007ab40 con 0x7fa6e8167da0 2023-11-30T17:19:21.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.362+0000 7fa6e77fe700 1 --2- 172.21.15.49:0/4119352251 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa6c805f2f0 0x7fa6c80617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:21.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.363+0000 7fa6e77fe700 1 --2- 172.21.15.49:0/4119352251 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa6c805f2f0 0x7fa6c80617b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fa6d8009fd0 tx=0x7fa6d800b040).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:21.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.366+0000 7fa6df7fe700 1 -- 172.21.15.49:0/4119352251 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa6e004bbc0 con 0x7fa6e8167da0 2023-11-30T17:19:21.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.565+0000 7fa6edb05700 1 -- 172.21.15.49:0/4119352251 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6e8156720 con 0x7fa6c805f2f0 2023-11-30T17:19:21.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.569+0000 7fa6df7fe700 1 -- 172.21.15.49:0/4119352251 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fa6e8156720 con 0x7fa6c805f2f0 2023-11-30T17:19:21.572 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule deactivated for path /snap_test_dir1/dir5 2023-11-30T17:19:21.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.571+0000 7fa6edb05700 1 -- 172.21.15.49:0/4119352251 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa6c805f2f0 msgr2=0x7fa6c80617b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:21.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.571+0000 7fa6edb05700 1 --2- 172.21.15.49:0/4119352251 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa6c805f2f0 0x7fa6c80617b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fa6d8009fd0 tx=0x7fa6d800b040).stop 2023-11-30T17:19:21.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.571+0000 7fa6edb05700 1 -- 172.21.15.49:0/4119352251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6e8167da0 msgr2=0x7fa6e81681e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:21.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.571+0000 7fa6edb05700 1 --2- 172.21.15.49:0/4119352251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6e8167da0 0x7fa6e81681e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7fa6e000a000 tx=0x7fa6e0015000).stop 2023-11-30T17:19:21.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.571+0000 7fa6edb05700 1 -- 172.21.15.49:0/4119352251 shutdown_connections 2023-11-30T17:19:21.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.571+0000 7fa6edb05700 1 --2- 172.21.15.49:0/4119352251 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa6c805f2f0 0x7fa6c80617b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:21.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.571+0000 7fa6edb05700 1 --2- 172.21.15.49:0/4119352251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6e8167da0 0x7fa6e81681e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:21.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.571+0000 7fa6edb05700 1 --2- 172.21.15.49:0/4119352251 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e80c3da0 0x7fa6e80b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:21.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.571+0000 7fa6edb05700 1 --2- 172.21.15.49:0/4119352251 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6e80c4180 0x7fa6e814d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:21.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.571+0000 7fa6edb05700 1 -- 172.21.15.49:0/4119352251 >> 172.21.15.49:0/4119352251 conn(0x7fa6e80655a0 msgr2=0x7fa6e80ad7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:21.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.571+0000 7fa6edb05700 1 -- 172.21.15.49:0/4119352251 shutdown_connections 2023-11-30T17:19:21.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.571+0000 7fa6edb05700 1 -- 172.21.15.49:0/4119352251 wait complete. 2023-11-30T17:19:21.585 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir5 2023-11-30T17:19:21.585 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir6 1M 2023-11-30T17:19:21.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.705+0000 7fbe508db700 1 Processor -- start 2023-11-30T17:19:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.705+0000 7fbe508db700 1 -- start start 2023-11-30T17:19:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.706+0000 7fbe508db700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe4c0aa680 0x7fbe4c0c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.706+0000 7fbe508db700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe4c158d50 con 0x7fbe4c1542d0 2023-11-30T17:19:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.706+0000 7fbe508db700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe4c158140 con 0x7fbe4c1546b0 2023-11-30T17:19:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.706+0000 7fbe508db700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c158420 con 0x7fbe4c0aa680 2023-11-30T17:19:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.706+0000 7fbe4ad9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbe4c1542d0 0x7fbe4c0a9f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46602/0 (socket says 172.21.15.49:46602) 2023-11-30T17:19:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.706+0000 7fbe4ad9d700 1 -- 172.21.15.49:0/849282704 learned_addr learned my addr 172.21.15.49:0/849282704 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.706+0000 7fbe4a59c700 1 --2- 172.21.15.49:0/849282704 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe4c0aa680 0x7fbe4c0c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.706+0000 7fbe49d9b700 1 -- 172.21.15.49:0/849282704 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244184671 0 0) 0x7fbe4c158d50 con 0x7fbe4c1542d0 2023-11-30T17:19:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.706+0000 7fbe49d9b700 1 -- 172.21.15.49:0/849282704 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe340033f0 con 0x7fbe4c1542d0 2023-11-30T17:19:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.706+0000 7fbe49d9b700 1 -- 172.21.15.49:0/849282704 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2817780109 0 0) 0x7fbe4c158140 con 0x7fbe4c1546b0 2023-11-30T17:19:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.706+0000 7fbe49d9b700 1 -- 172.21.15.49:0/849282704 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe4c158d50 con 0x7fbe4c1546b0 2023-11-30T17:19:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.706+0000 7fbe4a59c700 1 -- 172.21.15.49:0/849282704 >> v1:172.21.15.115:6789/0 conn(0x7fbe4c1546b0 legacy=0x7fbe4c0c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:21.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.706+0000 7fbe49d9b700 1 -- 172.21.15.49:0/849282704 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1905133294 0 0) 0x7fbe340033f0 con 0x7fbe4c1542d0 2023-11-30T17:19:21.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.706+0000 7fbe4a59c700 1 -- 172.21.15.49:0/849282704 >> v1:172.21.15.49:6789/0 conn(0x7fbe4c1542d0 legacy=0x7fbe4c0a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:21.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.706+0000 7fbe4a59c700 1 -- 172.21.15.49:0/849282704 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4c158700 con 0x7fbe4c0aa680 2023-11-30T17:19:21.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.706+0000 7fbe4a59c700 1 --2- 172.21.15.49:0/849282704 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe4c0aa680 0x7fbe4c0c5fc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fbe40009790 tx=0x7fbe40009060).ready entity=mon.2 client_cookie=3e6f4c2c80278db4 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:21.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.707+0000 7fbe49d9b700 1 -- 172.21.15.49:0/849282704 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c001470 con 0x7fbe4c0aa680 2023-11-30T17:19:21.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.707+0000 7fbe49d9b700 1 -- 172.21.15.49:0/849282704 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe40011400 con 0x7fbe4c0aa680 2023-11-30T17:19:21.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.707+0000 7fbe49d9b700 1 -- 172.21.15.49:0/849282704 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe40011780 con 0x7fbe4c0aa680 2023-11-30T17:19:21.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.707+0000 7fbe508db700 1 -- 172.21.15.49:0/849282704 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe4c0aa680 msgr2=0x7fbe4c0c5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:21.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.707+0000 7fbe508db700 1 --2- 172.21.15.49:0/849282704 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe4c0aa680 0x7fbe4c0c5fc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fbe40009790 tx=0x7fbe40009060).stop 2023-11-30T17:19:21.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.707+0000 7fbe508db700 1 -- 172.21.15.49:0/849282704 shutdown_connections 2023-11-30T17:19:21.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.707+0000 7fbe508db700 1 --2- 172.21.15.49:0/849282704 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe4c0aa680 0x7fbe4c0c5fc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:21.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.707+0000 7fbe508db700 1 -- 172.21.15.49:0/849282704 >> 172.21.15.49:0/849282704 conn(0x7fbe4c0cb010 msgr2=0x7fbe4c0cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:21.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.707+0000 7fbe508db700 1 -- 172.21.15.49:0/849282704 shutdown_connections 2023-11-30T17:19:21.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.707+0000 7fbe508db700 1 -- 172.21.15.49:0/849282704 wait complete. 2023-11-30T17:19:21.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.708+0000 7fbe508db700 1 Processor -- start 2023-11-30T17:19:21.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.708+0000 7fbe508db700 1 -- start start 2023-11-30T17:19:21.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.709+0000 7fbe508db700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe4c0aa680 0x7fbe4c0adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:21.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.709+0000 7fbe508db700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe4c1542d0 0x7fbe4c165200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:21.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.709+0000 7fbe508db700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe4c1546b0 0x7fbe4c147430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:21.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.709+0000 7fbe508db700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c0adbe0 con 0x7fbe4c1546b0 2023-11-30T17:19:21.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.709+0000 7fbe508db700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c168c40 con 0x7fbe4c0aa680 2023-11-30T17:19:21.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.709+0000 7fbe508db700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c1687b0 con 0x7fbe4c1542d0 2023-11-30T17:19:21.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.709+0000 7fbe4b59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe4c1546b0 0x7fbe4c147430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:21.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.709+0000 7fbe4b59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe4c1546b0 0x7fbe4c147430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44246/0 (socket says 172.21.15.49:44246) 2023-11-30T17:19:21.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.709+0000 7fbe4b59e700 1 -- 172.21.15.49:0/3081604062 learned_addr learned my addr 172.21.15.49:0/3081604062 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:21.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.709+0000 7fbe4ad9d700 1 --2- 172.21.15.49:0/3081604062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe4c0aa680 0x7fbe4c0adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:21.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.709+0000 7fbe4a59c700 1 --2- 172.21.15.49:0/3081604062 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe4c1542d0 0x7fbe4c165200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:21.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.710+0000 7fbe4b59e700 1 -- 172.21.15.49:0/3081604062 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe4c1542d0 msgr2=0x7fbe4c165200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:21.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.710+0000 7fbe4b59e700 1 --2- 172.21.15.49:0/3081604062 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe4c1542d0 0x7fbe4c165200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:21.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.710+0000 7fbe4b59e700 1 -- 172.21.15.49:0/3081604062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe4c0aa680 msgr2=0x7fbe4c0adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:21.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.710+0000 7fbe4b59e700 1 --2- 172.21.15.49:0/3081604062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe4c0aa680 0x7fbe4c0adfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:21.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.710+0000 7fbe4b59e700 1 -- 172.21.15.49:0/3081604062 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe400092a0 con 0x7fbe4c1546b0 2023-11-30T17:19:21.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.710+0000 7fbe4ad9d700 1 --2- 172.21.15.49:0/3081604062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe4c0aa680 0x7fbe4c0adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:19:21.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.710+0000 7fbe4b59e700 1 --2- 172.21.15.49:0/3081604062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe4c1546b0 0x7fbe4c147430 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7fbe4400c7c0 tx=0x7fbe4400cb80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:21.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.710+0000 7fbe32ffd700 1 -- 172.21.15.49:0/3081604062 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44002020 con 0x7fbe4c1546b0 2023-11-30T17:19:21.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.710+0000 7fbe32ffd700 1 -- 172.21.15.49:0/3081604062 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe44002180 con 0x7fbe4c1546b0 2023-11-30T17:19:21.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.710+0000 7fbe508db700 1 -- 172.21.15.49:0/3081604062 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe4c0afb00 con 0x7fbe4c1546b0 2023-11-30T17:19:21.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.710+0000 7fbe32ffd700 1 -- 172.21.15.49:0/3081604062 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44001590 con 0x7fbe4c1546b0 2023-11-30T17:19:21.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.710+0000 7fbe508db700 1 -- 172.21.15.49:0/3081604062 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe4c167f00 con 0x7fbe4c1546b0 2023-11-30T17:19:21.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.711+0000 7fbe508db700 1 -- 172.21.15.49:0/3081604062 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe4c06c7c0 con 0x7fbe4c1546b0 2023-11-30T17:19:21.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.711+0000 7fbe32ffd700 1 -- 172.21.15.49:0/3081604062 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fbe44001980 con 0x7fbe4c1546b0 2023-11-30T17:19:21.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.712+0000 7fbe32ffd700 1 --2- 172.21.15.49:0/3081604062 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbe3805f2c0 0x7fbe38061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:21.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.712+0000 7fbe32ffd700 1 -- 172.21.15.49:0/3081604062 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fbe44079c00 con 0x7fbe4c1546b0 2023-11-30T17:19:21.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.712+0000 7fbe4ad9d700 1 --2- 172.21.15.49:0/3081604062 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbe3805f2c0 0x7fbe38061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:21.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.712+0000 7fbe4ad9d700 1 --2- 172.21.15.49:0/3081604062 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbe3805f2c0 0x7fbe38061780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fbe3c000c00 tx=0x7fbe3c0015a0).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:21.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.716+0000 7fbe32ffd700 1 -- 172.21.15.49:0/3081604062 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbe44048b00 con 0x7fbe4c1546b0 2023-11-30T17:19:21.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.917+0000 7fbe508db700 1 -- 172.21.15.49:0/3081604062 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe4c1688f0 con 0x7fbe3805f2c0 2023-11-30T17:19:21.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.922+0000 7fbe32ffd700 1 -- 172.21.15.49:0/3081604062 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fbe4c1688f0 con 0x7fbe3805f2c0 2023-11-30T17:19:21.924 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule deactivated for path /snap_test_dir1/dir6 2023-11-30T17:19:21.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.924+0000 7fbe508db700 1 -- 172.21.15.49:0/3081604062 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbe3805f2c0 msgr2=0x7fbe38061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:21.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.924+0000 7fbe508db700 1 --2- 172.21.15.49:0/3081604062 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbe3805f2c0 0x7fbe38061780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fbe3c000c00 tx=0x7fbe3c0015a0).stop 2023-11-30T17:19:21.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.924+0000 7fbe508db700 1 -- 172.21.15.49:0/3081604062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe4c1546b0 msgr2=0x7fbe4c147430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:21.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.924+0000 7fbe508db700 1 --2- 172.21.15.49:0/3081604062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe4c1546b0 0x7fbe4c147430 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7fbe4400c7c0 tx=0x7fbe4400cb80).stop 2023-11-30T17:19:21.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.924+0000 7fbe508db700 1 -- 172.21.15.49:0/3081604062 shutdown_connections 2023-11-30T17:19:21.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.924+0000 7fbe508db700 1 --2- 172.21.15.49:0/3081604062 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbe3805f2c0 0x7fbe38061780 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:21.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.924+0000 7fbe508db700 1 --2- 172.21.15.49:0/3081604062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe4c1546b0 0x7fbe4c147430 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:21.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.924+0000 7fbe508db700 1 --2- 172.21.15.49:0/3081604062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe4c0aa680 0x7fbe4c0adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:21.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.924+0000 7fbe508db700 1 --2- 172.21.15.49:0/3081604062 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe4c1542d0 0x7fbe4c165200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:21.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.924+0000 7fbe508db700 1 -- 172.21.15.49:0/3081604062 >> 172.21.15.49:0/3081604062 conn(0x7fbe4c0cb010 msgr2=0x7fbe4c0c7ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:21.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.924+0000 7fbe508db700 1 -- 172.21.15.49:0/3081604062 shutdown_connections 2023-11-30T17:19:21.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:21.924+0000 7fbe508db700 1 -- 172.21.15.49:0/3081604062 wait complete. 2023-11-30T17:19:21.938 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir6 2023-11-30T17:19:21.938 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir7 1M 2023-11-30T17:19:22.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.058+0000 7fbdf56e8700 1 Processor -- start 2023-11-30T17:19:22.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.058+0000 7fbdf56e8700 1 -- start start 2023-11-30T17:19:22.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.059+0000 7fbdf56e8700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbdf00c18a0 0x7fbdf00c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:22.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.059+0000 7fbdf56e8700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf0158d50 con 0x7fbdf00aa680 2023-11-30T17:19:22.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.059+0000 7fbdf56e8700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf0158140 con 0x7fbdf01542d0 2023-11-30T17:19:22.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.059+0000 7fbdf56e8700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf0158420 con 0x7fbdf00c18a0 2023-11-30T17:19:22.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.059+0000 7fbdef7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbdf00aa680 0x7fbdf00c5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46604/0 (socket says 172.21.15.49:46604) 2023-11-30T17:19:22.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.059+0000 7fbdef7fe700 1 -- 172.21.15.49:0/1145181297 learned_addr learned my addr 172.21.15.49:0/1145181297 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:22.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.059+0000 7fbdf4ee7700 1 --2- 172.21.15.49:0/1145181297 >> v2:172.21.15.115:3300/0 conn(0x7fbdf00c18a0 0x7fbdf00c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:22.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.059+0000 7fbdeeffd700 1 -- 172.21.15.49:0/1145181297 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684112131 0 0) 0x7fbdf0158d50 con 0x7fbdf00aa680 2023-11-30T17:19:22.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.059+0000 7fbdeeffd700 1 -- 172.21.15.49:0/1145181297 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdd80033f0 con 0x7fbdf00aa680 2023-11-30T17:19:22.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.059+0000 7fbdeeffd700 1 -- 172.21.15.49:0/1145181297 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 870341143 0 0) 0x7fbdd80033f0 con 0x7fbdf00aa680 2023-11-30T17:19:22.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.059+0000 7fbdf4ee7700 1 -- 172.21.15.49:0/1145181297 >> v1:172.21.15.115:6789/0 conn(0x7fbdf01542d0 legacy=0x7fbdf00a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:22.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.060+0000 7fbdf4ee7700 1 -- 172.21.15.49:0/1145181297 >> v1:172.21.15.49:6789/0 conn(0x7fbdf00aa680 legacy=0x7fbdf00c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:22.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.060+0000 7fbdf4ee7700 1 -- 172.21.15.49:0/1145181297 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf0158700 con 0x7fbdf00c18a0 2023-11-30T17:19:22.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.060+0000 7fbdf4ee7700 1 --2- 172.21.15.49:0/1145181297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdf00c18a0 0x7fbdf00c66d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fbde8009e60 tx=0x7fbde8009780).ready entity=mon.1 client_cookie=44198a8341445f51 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:22.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.060+0000 7fbdeeffd700 1 -- 172.21.15.49:0/1145181297 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde800e070 con 0x7fbdf00c18a0 2023-11-30T17:19:22.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.060+0000 7fbdeeffd700 1 -- 172.21.15.49:0/1145181297 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde800b850 con 0x7fbdf00c18a0 2023-11-30T17:19:22.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.060+0000 7fbdeeffd700 1 -- 172.21.15.49:0/1145181297 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde4001470 con 0x7fbdf00c18a0 2023-11-30T17:19:22.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.060+0000 7fbdf56e8700 1 -- 172.21.15.49:0/1145181297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdf00c18a0 msgr2=0x7fbdf00c66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:22.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.060+0000 7fbdf56e8700 1 --2- 172.21.15.49:0/1145181297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdf00c18a0 0x7fbdf00c66d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fbde8009e60 tx=0x7fbde8009780).stop 2023-11-30T17:19:22.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.060+0000 7fbdf56e8700 1 -- 172.21.15.49:0/1145181297 shutdown_connections 2023-11-30T17:19:22.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.060+0000 7fbdf56e8700 1 --2- 172.21.15.49:0/1145181297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdf00c18a0 0x7fbdf00c66d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:22.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.060+0000 7fbdf56e8700 1 -- 172.21.15.49:0/1145181297 >> 172.21.15.49:0/1145181297 conn(0x7fbdf00cb010 msgr2=0x7fbdf00cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:22.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.060+0000 7fbdf56e8700 1 -- 172.21.15.49:0/1145181297 shutdown_connections 2023-11-30T17:19:22.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.060+0000 7fbdf56e8700 1 -- 172.21.15.49:0/1145181297 wait complete. 2023-11-30T17:19:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.061+0000 7fbdf56e8700 1 Processor -- start 2023-11-30T17:19:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.062+0000 7fbdf56e8700 1 -- start start 2023-11-30T17:19:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.062+0000 7fbdf56e8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdf00aa680 0x7fbdf00c3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.062+0000 7fbdf56e8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdf00c18a0 0x7fbdf013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.062+0000 7fbdf56e8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbdf01542d0 0x7fbdf0150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.062+0000 7fbdf56e8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf00c4550 con 0x7fbdf00c18a0 2023-11-30T17:19:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.062+0000 7fbdf56e8700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf00c49e0 con 0x7fbdf00aa680 2023-11-30T17:19:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.062+0000 7fbdf56e8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf00c3940 con 0x7fbdf01542d0 2023-11-30T17:19:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.062+0000 7fbdef7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdf00c18a0 0x7fbdf013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.062+0000 7fbdef7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdf00c18a0 0x7fbdf013bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44258/0 (socket says 172.21.15.49:44258) 2023-11-30T17:19:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.062+0000 7fbdef7fe700 1 -- 172.21.15.49:0/768324778 learned_addr learned my addr 172.21.15.49:0/768324778 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.063+0000 7fbdeffff700 1 --2- 172.21.15.49:0/768324778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdf00aa680 0x7fbdf00c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.063+0000 7fbdf4ee7700 1 --2- 172.21.15.49:0/768324778 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbdf01542d0 0x7fbdf0150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:22.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.063+0000 7fbdef7fe700 1 -- 172.21.15.49:0/768324778 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbdf01542d0 msgr2=0x7fbdf0150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:22.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.063+0000 7fbdef7fe700 1 --2- 172.21.15.49:0/768324778 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbdf01542d0 0x7fbdf0150780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:22.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.063+0000 7fbdef7fe700 1 -- 172.21.15.49:0/768324778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdf00aa680 msgr2=0x7fbdf00c3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:22.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.063+0000 7fbdef7fe700 1 --2- 172.21.15.49:0/768324778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdf00aa680 0x7fbdf00c3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:22.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.063+0000 7fbdef7fe700 1 -- 172.21.15.49:0/768324778 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde8009a20 con 0x7fbdf00c18a0 2023-11-30T17:19:22.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.063+0000 7fbdf4ee7700 1 --2- 172.21.15.49:0/768324778 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbdf01542d0 0x7fbdf0150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:19:22.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.063+0000 7fbdef7fe700 1 --2- 172.21.15.49:0/768324778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdf00c18a0 0x7fbdf013bd30 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7fbde400c7e0 tx=0x7fbde4001a10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:22.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.063+0000 7fbdd7fff700 1 -- 172.21.15.49:0/768324778 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde4007320 con 0x7fbdf00c18a0 2023-11-30T17:19:22.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.063+0000 7fbdd7fff700 1 -- 172.21.15.49:0/768324778 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde4007480 con 0x7fbdf00c18a0 2023-11-30T17:19:22.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.063+0000 7fbdf56e8700 1 -- 172.21.15.49:0/768324778 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf00c3c20 con 0x7fbdf00c18a0 2023-11-30T17:19:22.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.063+0000 7fbdd7fff700 1 -- 172.21.15.49:0/768324778 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde40059d0 con 0x7fbdf00c18a0 2023-11-30T17:19:22.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.063+0000 7fbdf56e8700 1 -- 172.21.15.49:0/768324778 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf00c41e0 con 0x7fbdf00c18a0 2023-11-30T17:19:22.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.064+0000 7fbdf56e8700 1 -- 172.21.15.49:0/768324778 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf00c46c0 con 0x7fbdf00c18a0 2023-11-30T17:19:22.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.065+0000 7fbdd7fff700 1 -- 172.21.15.49:0/768324778 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fbde4005d40 con 0x7fbdf00c18a0 2023-11-30T17:19:22.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.065+0000 7fbdd7fff700 1 --2- 172.21.15.49:0/768324778 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbddc05f2c0 0x7fbddc061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:22.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.065+0000 7fbdd7fff700 1 -- 172.21.15.49:0/768324778 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fbde407a560 con 0x7fbdf00c18a0 2023-11-30T17:19:22.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.065+0000 7fbdeffff700 1 --2- 172.21.15.49:0/768324778 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbddc05f2c0 0x7fbddc061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:22.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.066+0000 7fbdeffff700 1 --2- 172.21.15.49:0/768324778 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbddc05f2c0 0x7fbddc061780 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fbde0003630 tx=0x7fbde0009040).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:22.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.069+0000 7fbdd7fff700 1 -- 172.21.15.49:0/768324778 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbde404b5e0 con 0x7fbdf00c18a0 2023-11-30T17:19:22.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.268+0000 7fbdf56e8700 1 -- 172.21.15.49:0/768324778 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbdf006c7c0 con 0x7fbddc05f2c0 2023-11-30T17:19:22.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.272+0000 7fbdd7fff700 1 -- 172.21.15.49:0/768324778 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fbdf006c7c0 con 0x7fbddc05f2c0 2023-11-30T17:19:22.275 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule deactivated for path /snap_test_dir1/dir7 2023-11-30T17:19:22.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.274+0000 7fbdf56e8700 1 -- 172.21.15.49:0/768324778 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbddc05f2c0 msgr2=0x7fbddc061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:22.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.274+0000 7fbdf56e8700 1 --2- 172.21.15.49:0/768324778 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbddc05f2c0 0x7fbddc061780 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fbde0003630 tx=0x7fbde0009040).stop 2023-11-30T17:19:22.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.274+0000 7fbdf56e8700 1 -- 172.21.15.49:0/768324778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdf00c18a0 msgr2=0x7fbdf013bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:22.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.274+0000 7fbdf56e8700 1 --2- 172.21.15.49:0/768324778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdf00c18a0 0x7fbdf013bd30 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7fbde400c7e0 tx=0x7fbde4001a10).stop 2023-11-30T17:19:22.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.274+0000 7fbdf56e8700 1 -- 172.21.15.49:0/768324778 shutdown_connections 2023-11-30T17:19:22.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.274+0000 7fbdf56e8700 1 --2- 172.21.15.49:0/768324778 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbdf01542d0 0x7fbdf0150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:22.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.274+0000 7fbdf56e8700 1 --2- 172.21.15.49:0/768324778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdf00aa680 0x7fbdf00c3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:22.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.274+0000 7fbdf56e8700 1 --2- 172.21.15.49:0/768324778 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbddc05f2c0 0x7fbddc061780 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:22.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.274+0000 7fbdf56e8700 1 --2- 172.21.15.49:0/768324778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdf00c18a0 0x7fbdf013bd30 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:22.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.274+0000 7fbdf56e8700 1 -- 172.21.15.49:0/768324778 >> 172.21.15.49:0/768324778 conn(0x7fbdf00cb010 msgr2=0x7fbdf0064880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:22.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.274+0000 7fbdf56e8700 1 -- 172.21.15.49:0/768324778 shutdown_connections 2023-11-30T17:19:22.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.274+0000 7fbdf56e8700 1 -- 172.21.15.49:0/768324778 wait complete. 2023-11-30T17:19:22.288 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir7 2023-11-30T17:19:22.289 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir8 1M 2023-11-30T17:19:22.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.409+0000 7f21464ee700 1 Processor -- start 2023-11-30T17:19:22.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.409+0000 7f21464ee700 1 -- start start 2023-11-30T17:19:22.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.410+0000 7f21464ee700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2140151f60 0x7f21400673e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:22.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.410+0000 7f21464ee700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f21400be140 0x7f2140155c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:22.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.410+0000 7f21464ee700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21400659e0 con 0x7f21401560f0 2023-11-30T17:19:22.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.410+0000 7f21464ee700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21400640e0 con 0x7f21400be140 2023-11-30T17:19:22.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.410+0000 7f21464ee700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2140156990 con 0x7f2140151f60 2023-11-30T17:19:22.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.410+0000 7f2144ceb700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f21400be140 0x7f2140155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:22.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.411+0000 7f2145ced700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f21401560f0 0x7f21400bc850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46620/0 (socket says 172.21.15.49:46620) 2023-11-30T17:19:22.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.411+0000 7f2145ced700 1 -- 172.21.15.49:0/3245118046 learned_addr learned my addr 172.21.15.49:0/3245118046 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:22.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.411+0000 7f2144ceb700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f21400be140 0x7f2140155c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44274/0 (socket says 172.21.15.49:44274) 2023-11-30T17:19:22.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.411+0000 7f21454ec700 1 --2- 172.21.15.49:0/3245118046 >> v2:172.21.15.115:3300/0 conn(0x7f2140151f60 0x7f21400673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:22.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.411+0000 7f2144ceb700 1 -- 172.21.15.49:0/3245118046 >> v2:172.21.15.115:3300/0 conn(0x7f2140151f60 msgr2=0x7f21400673e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:22.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.411+0000 7f2144ceb700 1 --2- 172.21.15.49:0/3245118046 >> v2:172.21.15.115:3300/0 conn(0x7f2140151f60 0x7f21400673e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:22.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.411+0000 7f2144ceb700 1 -- 172.21.15.49:0/3245118046 >> v1:172.21.15.49:6789/0 conn(0x7f21401560f0 legacy=0x7f21400bc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:22.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.411+0000 7f213ffff700 1 -- 172.21.15.49:0/3245118046 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 890792274 0 0) 0x7f21400659e0 con 0x7f21401560f0 2023-11-30T17:19:22.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.411+0000 7f2144ceb700 1 -- 172.21.15.49:0/3245118046 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21400bd900 con 0x7f21400be140 2023-11-30T17:19:22.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.411+0000 7f21454ec700 1 --2- 172.21.15.49:0/3245118046 >> v2:172.21.15.115:3300/0 conn(0x7f2140151f60 0x7f21400673e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:19:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.411+0000 7f2144ceb700 1 --2- 172.21.15.49:0/3245118046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21400be140 0x7f2140155c00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f21400c3de0 tx=0x7f2134009060).ready entity=mon.0 client_cookie=784ba10d79483a0a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.411+0000 7f213ffff700 1 -- 172.21.15.49:0/3245118046 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213400b580 con 0x7f21400be140 2023-11-30T17:19:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.411+0000 7f213ffff700 1 -- 172.21.15.49:0/3245118046 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213400b6e0 con 0x7f21400be140 2023-11-30T17:19:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.411+0000 7f213ffff700 1 -- 172.21.15.49:0/3245118046 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213400ba60 con 0x7f21400be140 2023-11-30T17:19:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.412+0000 7f21464ee700 1 -- 172.21.15.49:0/3245118046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21400be140 msgr2=0x7f2140155c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.412+0000 7f21464ee700 1 --2- 172.21.15.49:0/3245118046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21400be140 0x7f2140155c00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f21400c3de0 tx=0x7f2134009060).stop 2023-11-30T17:19:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.412+0000 7f21464ee700 1 -- 172.21.15.49:0/3245118046 shutdown_connections 2023-11-30T17:19:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.412+0000 7f21464ee700 1 --2- 172.21.15.49:0/3245118046 >> v2:172.21.15.115:3300/0 conn(0x7f2140151f60 0x7f21400673e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.412+0000 7f21464ee700 1 --2- 172.21.15.49:0/3245118046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21400be140 0x7f2140155c00 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.412+0000 7f21464ee700 1 -- 172.21.15.49:0/3245118046 >> 172.21.15.49:0/3245118046 conn(0x7f21400c3f40 msgr2=0x7f21400c4350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.412+0000 7f21464ee700 1 -- 172.21.15.49:0/3245118046 shutdown_connections 2023-11-30T17:19:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.412+0000 7f21464ee700 1 -- 172.21.15.49:0/3245118046 wait complete. 2023-11-30T17:19:22.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.413+0000 7f21464ee700 1 Processor -- start 2023-11-30T17:19:22.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.413+0000 7f21464ee700 1 -- start start 2023-11-30T17:19:22.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.414+0000 7f21464ee700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21400be140 0x7f2140144880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:22.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.414+0000 7f21464ee700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2140151f60 0x7f21400c0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:22.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.414+0000 7f21464ee700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21401560f0 0x7f21400c0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:22.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.414+0000 7f21464ee700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21400ab340 con 0x7f21400be140 2023-11-30T17:19:22.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.414+0000 7f21464ee700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21400aa450 con 0x7f2140151f60 2023-11-30T17:19:22.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.414+0000 7f21464ee700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21400aa730 con 0x7f21401560f0 2023-11-30T17:19:22.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.414+0000 7f21454ec700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21400be140 0x7f2140144880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:22.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.414+0000 7f21454ec700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21400be140 0x7f2140144880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44278/0 (socket says 172.21.15.49:44278) 2023-11-30T17:19:22.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.414+0000 7f21454ec700 1 -- 172.21.15.49:0/249375044 learned_addr learned my addr 172.21.15.49:0/249375044 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:22.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.414+0000 7f2144ceb700 1 --2- 172.21.15.49:0/249375044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2140151f60 0x7f21400c0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:22.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.414+0000 7f2145ced700 1 --2- 172.21.15.49:0/249375044 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21401560f0 0x7f21400c0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:22.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.414+0000 7f21454ec700 1 -- 172.21.15.49:0/249375044 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21401560f0 msgr2=0x7f21400c0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:22.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.414+0000 7f21454ec700 1 --2- 172.21.15.49:0/249375044 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21401560f0 0x7f21400c0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:22.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.414+0000 7f21454ec700 1 -- 172.21.15.49:0/249375044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2140151f60 msgr2=0x7f21400c0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:22.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.414+0000 7f21454ec700 1 --2- 172.21.15.49:0/249375044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2140151f60 0x7f21400c0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:22.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.414+0000 7f21454ec700 1 -- 172.21.15.49:0/249375044 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21340092a0 con 0x7f21400be140 2023-11-30T17:19:22.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.414+0000 7f21454ec700 1 --2- 172.21.15.49:0/249375044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21400be140 0x7f2140144880 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f213800d180 tx=0x7f21380099f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:22.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.414+0000 7f213d7fa700 1 -- 172.21.15.49:0/249375044 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213800dcc0 con 0x7f21400be140 2023-11-30T17:19:22.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.414+0000 7f213d7fa700 1 -- 172.21.15.49:0/249375044 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213800f040 con 0x7f21400be140 2023-11-30T17:19:22.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.414+0000 7f21464ee700 1 -- 172.21.15.49:0/249375044 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21400aaa10 con 0x7f21400be140 2023-11-30T17:19:22.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.414+0000 7f213d7fa700 1 -- 172.21.15.49:0/249375044 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2138013600 con 0x7f21400be140 2023-11-30T17:19:22.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.415+0000 7f21464ee700 1 -- 172.21.15.49:0/249375044 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21400aafd0 con 0x7f21400be140 2023-11-30T17:19:22.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.415+0000 7f21464ee700 1 -- 172.21.15.49:0/249375044 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f214006c7c0 con 0x7f21400be140 2023-11-30T17:19:22.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.416+0000 7f213d7fa700 1 -- 172.21.15.49:0/249375044 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f21380139f0 con 0x7f21400be140 2023-11-30T17:19:22.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.416+0000 7f213d7fa700 1 --2- 172.21.15.49:0/249375044 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f212c05f2c0 0x7f212c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:22.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.416+0000 7f213d7fa700 1 -- 172.21.15.49:0/249375044 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f213807aae0 con 0x7f21400be140 2023-11-30T17:19:22.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.416+0000 7f2144ceb700 1 --2- 172.21.15.49:0/249375044 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f212c05f2c0 0x7f212c061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:22.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.417+0000 7f2144ceb700 1 --2- 172.21.15.49:0/249375044 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f212c05f2c0 0x7f212c061780 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f2134009fd0 tx=0x7f2134017000).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:22.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.420+0000 7f213d7fa700 1 -- 172.21.15.49:0/249375044 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f213804bb00 con 0x7f21400be140 2023-11-30T17:19:22.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.619+0000 7f21464ee700 1 -- 172.21.15.49:0/249375044 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f21400ab480 con 0x7f212c05f2c0 2023-11-30T17:19:22.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.623+0000 7f213d7fa700 1 -- 172.21.15.49:0/249375044 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f2134000d00 con 0x7f212c05f2c0 2023-11-30T17:19:22.626 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule deactivated for path /snap_test_dir1/dir8 2023-11-30T17:19:22.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.625+0000 7f21464ee700 1 -- 172.21.15.49:0/249375044 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f212c05f2c0 msgr2=0x7f212c061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:22.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.625+0000 7f21464ee700 1 --2- 172.21.15.49:0/249375044 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f212c05f2c0 0x7f212c061780 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f2134009fd0 tx=0x7f2134017000).stop 2023-11-30T17:19:22.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.625+0000 7f21464ee700 1 -- 172.21.15.49:0/249375044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21400be140 msgr2=0x7f2140144880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:22.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.625+0000 7f21464ee700 1 --2- 172.21.15.49:0/249375044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21400be140 0x7f2140144880 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f213800d180 tx=0x7f21380099f0).stop 2023-11-30T17:19:22.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.625+0000 7f21464ee700 1 -- 172.21.15.49:0/249375044 shutdown_connections 2023-11-30T17:19:22.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.625+0000 7f21464ee700 1 --2- 172.21.15.49:0/249375044 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21401560f0 0x7f21400c0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:22.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.625+0000 7f21464ee700 1 --2- 172.21.15.49:0/249375044 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f212c05f2c0 0x7f212c061780 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:22.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.625+0000 7f21464ee700 1 --2- 172.21.15.49:0/249375044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21400be140 0x7f2140144880 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:22.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.625+0000 7f21464ee700 1 --2- 172.21.15.49:0/249375044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2140151f60 0x7f21400c0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:22.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.625+0000 7f21464ee700 1 -- 172.21.15.49:0/249375044 >> 172.21.15.49:0/249375044 conn(0x7f21400c3f40 msgr2=0x7f2140145e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:22.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.625+0000 7f21464ee700 1 -- 172.21.15.49:0/249375044 shutdown_connections 2023-11-30T17:19:22.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.625+0000 7f21464ee700 1 -- 172.21.15.49:0/249375044 wait complete. 2023-11-30T17:19:22.639 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir8 2023-11-30T17:19:22.640 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir9 1M 2023-11-30T17:19:22.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.759+0000 7fc8c5deb700 1 Processor -- start 2023-11-30T17:19:22.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.759+0000 7fc8c5deb700 1 -- start start 2023-11-30T17:19:22.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.760+0000 7fc8c5deb700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc8c0154530 0x7fc8c0154910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:22.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.760+0000 7fc8c5deb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8c00a7ff0 0x7fc8c00c8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:22.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.760+0000 7fc8c5deb700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c00c6630 con 0x7fc8c00aa220 2023-11-30T17:19:22.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.760+0000 7fc8c5deb700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c00c6390 con 0x7fc8c0154530 2023-11-30T17:19:22.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.760+0000 7fc8c5deb700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c00a8470 con 0x7fc8c00a7ff0 2023-11-30T17:19:22.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.760+0000 7fc8bf7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc8c0154530 0x7fc8c0154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:22.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.760+0000 7fc8beffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8c00a7ff0 0x7fc8c00c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:22.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.761+0000 7fc8bf7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc8c0154530 0x7fc8c0154910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:41138/0 (socket says 172.21.15.49:41138) 2023-11-30T17:19:22.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.761+0000 7fc8bffff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc8c00aa220 0x7fc8c00c6ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:55974/0 (socket says 172.21.15.49:55974) 2023-11-30T17:19:22.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.761+0000 7fc8bf7fe700 1 -- 172.21.15.49:0/3498782897 learned_addr learned my addr 172.21.15.49:0/3498782897 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:22.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.761+0000 7fc8bf7fe700 1 -- 172.21.15.49:0/3498782897 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8c00a7ff0 msgr2=0x7fc8c00c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:22.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.761+0000 7fc8bf7fe700 1 --2- 172.21.15.49:0/3498782897 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8c00a7ff0 0x7fc8c00c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:22.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.761+0000 7fc8bf7fe700 1 -- 172.21.15.49:0/3498782897 >> v1:172.21.15.115:6789/0 conn(0x7fc8c00aa220 legacy=0x7fc8c00c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:22.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.761+0000 7fc8bf7fe700 1 -- 172.21.15.49:0/3498782897 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c0064230 con 0x7fc8c0154530 2023-11-30T17:19:22.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.761+0000 7fc8beffd700 1 --2- 172.21.15.49:0/3498782897 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8c00a7ff0 0x7fc8c00c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:19:22.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.761+0000 7fc8bf7fe700 1 --2- 172.21.15.49:0/3498782897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8c0154530 0x7fc8c0154910 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fc8b0009810 tx=0x7fc8b0009060).ready entity=mon.1 client_cookie=6838ebe3412c541 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:22.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.761+0000 7fc8be7fc700 1 -- 172.21.15.49:0/3498782897 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0005880 con 0x7fc8c0154530 2023-11-30T17:19:22.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.761+0000 7fc8be7fc700 1 -- 172.21.15.49:0/3498782897 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b00059e0 con 0x7fc8c0154530 2023-11-30T17:19:22.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.761+0000 7fc8be7fc700 1 -- 172.21.15.49:0/3498782897 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0005d60 con 0x7fc8c0154530 2023-11-30T17:19:22.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.762+0000 7fc8c5deb700 1 -- 172.21.15.49:0/3498782897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8c0154530 msgr2=0x7fc8c0154910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:22.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.762+0000 7fc8c5deb700 1 --2- 172.21.15.49:0/3498782897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8c0154530 0x7fc8c0154910 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fc8b0009810 tx=0x7fc8b0009060).stop 2023-11-30T17:19:22.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.762+0000 7fc8c5deb700 1 -- 172.21.15.49:0/3498782897 shutdown_connections 2023-11-30T17:19:22.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.762+0000 7fc8c5deb700 1 --2- 172.21.15.49:0/3498782897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8c0154530 0x7fc8c0154910 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:22.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.762+0000 7fc8c5deb700 1 --2- 172.21.15.49:0/3498782897 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8c00a7ff0 0x7fc8c00c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:22.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.762+0000 7fc8c5deb700 1 -- 172.21.15.49:0/3498782897 >> 172.21.15.49:0/3498782897 conn(0x7fc8c0094930 msgr2=0x7fc8c006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:22.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.762+0000 7fc8c5deb700 1 -- 172.21.15.49:0/3498782897 shutdown_connections 2023-11-30T17:19:22.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.762+0000 7fc8c5deb700 1 -- 172.21.15.49:0/3498782897 wait complete. 2023-11-30T17:19:22.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.763+0000 7fc8c5deb700 1 Processor -- start 2023-11-30T17:19:22.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.763+0000 7fc8c5deb700 1 -- start start 2023-11-30T17:19:22.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.764+0000 7fc8c5deb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8c00a7ff0 0x7fc8c0167ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:22.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.764+0000 7fc8c5deb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8c00aa220 0x7fc8c0150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:22.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.764+0000 7fc8c5deb700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8c0150e40 0x7fc8c00c3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:22.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.764+0000 7fc8c5deb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c00c45c0 con 0x7fc8c00a7ff0 2023-11-30T17:19:22.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.764+0000 7fc8c5deb700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c00c2e00 con 0x7fc8c0150e40 2023-11-30T17:19:22.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.764+0000 7fc8c5deb700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c00af490 con 0x7fc8c00aa220 2023-11-30T17:19:22.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.764+0000 7fc8bf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8c00a7ff0 0x7fc8c0167ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:22.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.764+0000 7fc8bf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8c00a7ff0 0x7fc8c0167ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44290/0 (socket says 172.21.15.49:44290) 2023-11-30T17:19:22.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.764+0000 7fc8bf7fe700 1 -- 172.21.15.49:0/4104573100 learned_addr learned my addr 172.21.15.49:0/4104573100 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:22.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.764+0000 7fc8bffff700 1 --2- 172.21.15.49:0/4104573100 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8c0150e40 0x7fc8c00c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:22.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.764+0000 7fc8beffd700 1 --2- 172.21.15.49:0/4104573100 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8c00aa220 0x7fc8c0150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:22.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.764+0000 7fc8bf7fe700 1 -- 172.21.15.49:0/4104573100 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8c00aa220 msgr2=0x7fc8c0150950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:22.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.764+0000 7fc8bf7fe700 1 --2- 172.21.15.49:0/4104573100 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8c00aa220 0x7fc8c0150950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:22.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.764+0000 7fc8bf7fe700 1 -- 172.21.15.49:0/4104573100 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8c0150e40 msgr2=0x7fc8c00c3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:22.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.764+0000 7fc8bf7fe700 1 --2- 172.21.15.49:0/4104573100 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8c0150e40 0x7fc8c00c3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:22.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.764+0000 7fc8bf7fe700 1 -- 172.21.15.49:0/4104573100 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b40092a0 con 0x7fc8c00a7ff0 2023-11-30T17:19:22.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.764+0000 7fc8beffd700 1 --2- 172.21.15.49:0/4104573100 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8c00aa220 0x7fc8c0150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:19:22.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.764+0000 7fc8bffff700 1 --2- 172.21.15.49:0/4104573100 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8c0150e40 0x7fc8c00c3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:19:22.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.764+0000 7fc8bf7fe700 1 --2- 172.21.15.49:0/4104573100 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8c00a7ff0 0x7fc8c0167ae0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fc8c006ae10 tx=0x7fc8b0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:22.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.765+0000 7fc8a77fe700 1 -- 172.21.15.49:0/4104573100 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0005880 con 0x7fc8c00a7ff0 2023-11-30T17:19:22.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.765+0000 7fc8a77fe700 1 -- 172.21.15.49:0/4104573100 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b000b790 con 0x7fc8c00a7ff0 2023-11-30T17:19:22.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.765+0000 7fc8c5deb700 1 -- 172.21.15.49:0/4104573100 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b0009300 con 0x7fc8c00a7ff0 2023-11-30T17:19:22.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.765+0000 7fc8a77fe700 1 -- 172.21.15.49:0/4104573100 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b000bb10 con 0x7fc8c00a7ff0 2023-11-30T17:19:22.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.765+0000 7fc8c5deb700 1 -- 172.21.15.49:0/4104573100 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c0151280 con 0x7fc8c00a7ff0 2023-11-30T17:19:22.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.766+0000 7fc8c5deb700 1 -- 172.21.15.49:0/4104573100 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c006c860 con 0x7fc8c00a7ff0 2023-11-30T17:19:22.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.766+0000 7fc8a77fe700 1 -- 172.21.15.49:0/4104573100 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fc8b0018070 con 0x7fc8c00a7ff0 2023-11-30T17:19:22.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.766+0000 7fc8a77fe700 1 --2- 172.21.15.49:0/4104573100 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc8ac05f2c0 0x7fc8ac061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:22.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.766+0000 7fc8a77fe700 1 -- 172.21.15.49:0/4104573100 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fc8b007b4f0 con 0x7fc8c00a7ff0 2023-11-30T17:19:22.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.767+0000 7fc8beffd700 1 --2- 172.21.15.49:0/4104573100 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc8ac05f2c0 0x7fc8ac061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:22.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.767+0000 7fc8beffd700 1 --2- 172.21.15.49:0/4104573100 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc8ac05f2c0 0x7fc8ac061780 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fc8b4009270 tx=0x7fc8b4008040).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:22.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.771+0000 7fc8a77fe700 1 -- 172.21.15.49:0/4104573100 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc8b004c570 con 0x7fc8c00a7ff0 2023-11-30T17:19:22.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.978+0000 7fc8c5deb700 1 -- 172.21.15.49:0/4104573100 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8c00af5d0 con 0x7fc8ac05f2c0 2023-11-30T17:19:22.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.983+0000 7fc8a77fe700 1 -- 172.21.15.49:0/4104573100 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fc8b40099e0 con 0x7fc8ac05f2c0 2023-11-30T17:19:22.986 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule deactivated for path /snap_test_dir1/dir9 2023-11-30T17:19:22.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.985+0000 7fc8c5deb700 1 -- 172.21.15.49:0/4104573100 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc8ac05f2c0 msgr2=0x7fc8ac061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:22.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.985+0000 7fc8c5deb700 1 --2- 172.21.15.49:0/4104573100 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc8ac05f2c0 0x7fc8ac061780 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fc8b4009270 tx=0x7fc8b4008040).stop 2023-11-30T17:19:22.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.985+0000 7fc8c5deb700 1 -- 172.21.15.49:0/4104573100 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8c00a7ff0 msgr2=0x7fc8c0167ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:22.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.985+0000 7fc8c5deb700 1 --2- 172.21.15.49:0/4104573100 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8c00a7ff0 0x7fc8c0167ae0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fc8c006ae10 tx=0x7fc8b0016000).stop 2023-11-30T17:19:22.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.986+0000 7fc8c5deb700 1 -- 172.21.15.49:0/4104573100 shutdown_connections 2023-11-30T17:19:22.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.986+0000 7fc8c5deb700 1 --2- 172.21.15.49:0/4104573100 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8c0150e40 0x7fc8c00c3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:22.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.986+0000 7fc8c5deb700 1 --2- 172.21.15.49:0/4104573100 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc8ac05f2c0 0x7fc8ac061780 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:22.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.986+0000 7fc8c5deb700 1 --2- 172.21.15.49:0/4104573100 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8c00a7ff0 0x7fc8c0167ae0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:22.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.986+0000 7fc8c5deb700 1 --2- 172.21.15.49:0/4104573100 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8c00aa220 0x7fc8c0150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:22.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.986+0000 7fc8c5deb700 1 -- 172.21.15.49:0/4104573100 >> 172.21.15.49:0/4104573100 conn(0x7fc8c0094930 msgr2=0x7fc8c00c7440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:22.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.986+0000 7fc8c5deb700 1 -- 172.21.15.49:0/4104573100 shutdown_connections 2023-11-30T17:19:22.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:22.986+0000 7fc8c5deb700 1 -- 172.21.15.49:0/4104573100 wait complete. 2023-11-30T17:19:23.000 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir9 2023-11-30T17:19:23.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:23.000 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-11-30T17:19:23.017 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_09_00_UTC 2023-11-30T17:19:23.017 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_10_00_UTC 2023-11-30T17:19:23.017 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_11_00_UTC 2023-11-30T17:19:23.017 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_12_00_UTC 2023-11-30T17:19:23.018 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_13_00_UTC 2023-11-30T17:19:23.018 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_14_00_UTC 2023-11-30T17:19:23.018 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_15_00_UTC 2023-11-30T17:19:23.018 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_16_00_UTC 2023-11-30T17:19:23.018 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_17_00_UTC 2023-11-30T17:19:23.018 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_18_00_UTC 2023-11-30T17:19:23.018 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_19_00_UTC 2023-11-30T17:19:23.018 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-11-30-17_09_00_UTC', 'scheduled-2023-11-30-17_10_00_UTC', 'scheduled-2023-11-30-17_11_00_UTC', 'scheduled-2023-11-30-17_12_00_UTC', 'scheduled-2023-11-30-17_13_00_UTC', 'scheduled-2023-11-30-17_14_00_UTC', 'scheduled-2023-11-30-17_15_00_UTC', 'scheduled-2023-11-30-17_16_00_UTC', 'scheduled-2023-11-30-17_17_00_UTC', 'scheduled-2023-11-30-17_18_00_UTC', 'scheduled-2023-11-30-17_19_00_UTC'] 2023-11-30T17:19:23.018 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir0 2023-11-30T17:19:23.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.176+0000 7f3065c64700 1 Processor -- start 2023-11-30T17:19:23.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.176+0000 7f3065c64700 1 -- start start 2023-11-30T17:19:23.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.177+0000 7f3065c64700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3060154910 0x7f30600a7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:23.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.177+0000 7f3065c64700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f30600aa220 0x7f30600aa690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:23.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.177+0000 7f3065c64700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30600c6630 con 0x7f3060154530 2023-11-30T17:19:23.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.177+0000 7f3065c64700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30600c6390 con 0x7f3060154910 2023-11-30T17:19:23.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.177+0000 7f3065c64700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30600a84e0 con 0x7f30600aa220 2023-11-30T17:19:23.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.177+0000 7f305effd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3060154910 0x7f30600a7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:23.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.177+0000 7f305effd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3060154910 0x7f30600a7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44298/0 (socket says 172.21.15.49:44298) 2023-11-30T17:19:23.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.177+0000 7f305f7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3060154530 0x7f30600c8580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46628/0 (socket says 172.21.15.49:46628) 2023-11-30T17:19:23.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.177+0000 7f305effd700 1 -- 172.21.15.49:0/3853306876 learned_addr learned my addr 172.21.15.49:0/3853306876 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:23.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.177+0000 7f305ffff700 1 --2- 172.21.15.49:0/3853306876 >> v2:172.21.15.115:3300/0 conn(0x7f30600aa220 0x7f30600aa690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:23.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.178+0000 7f305effd700 1 -- 172.21.15.49:0/3853306876 >> v2:172.21.15.115:3300/0 conn(0x7f30600aa220 msgr2=0x7f30600aa690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:23.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.178+0000 7f305effd700 1 --2- 172.21.15.49:0/3853306876 >> v2:172.21.15.115:3300/0 conn(0x7f30600aa220 0x7f30600aa690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:23.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.178+0000 7f305effd700 1 -- 172.21.15.49:0/3853306876 >> v1:172.21.15.49:6789/0 conn(0x7f3060154530 legacy=0x7f30600c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:23.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.178+0000 7f305e7fc700 1 -- 172.21.15.49:0/3853306876 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1667234753 0 0) 0x7f30600c6630 con 0x7f3060154530 2023-11-30T17:19:23.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.178+0000 7f305effd700 1 -- 172.21.15.49:0/3853306876 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30600aab80 con 0x7f3060154910 2023-11-30T17:19:23.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.178+0000 7f305effd700 1 --2- 172.21.15.49:0/3853306876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3060154910 0x7f30600a7ff0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f3060084a60 tx=0x7f30540090f0).ready entity=mon.0 client_cookie=75a1c8834a61016b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:23.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.178+0000 7f305e7fc700 1 -- 172.21.15.49:0/3853306876 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305400b520 con 0x7f3060154910 2023-11-30T17:19:23.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.178+0000 7f305e7fc700 1 -- 172.21.15.49:0/3853306876 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305400b680 con 0x7f3060154910 2023-11-30T17:19:23.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.178+0000 7f305e7fc700 1 -- 172.21.15.49:0/3853306876 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305400ba00 con 0x7f3060154910 2023-11-30T17:19:23.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.178+0000 7f3065c64700 1 -- 172.21.15.49:0/3853306876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3060154910 msgr2=0x7f30600a7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:23.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.178+0000 7f3065c64700 1 --2- 172.21.15.49:0/3853306876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3060154910 0x7f30600a7ff0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f3060084a60 tx=0x7f30540090f0).stop 2023-11-30T17:19:23.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.178+0000 7f3065c64700 1 -- 172.21.15.49:0/3853306876 shutdown_connections 2023-11-30T17:19:23.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.178+0000 7f3065c64700 1 --2- 172.21.15.49:0/3853306876 >> v2:172.21.15.115:3300/0 conn(0x7f30600aa220 0x7f30600aa690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:23.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.178+0000 7f3065c64700 1 --2- 172.21.15.49:0/3853306876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3060154910 0x7f30600a7ff0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:23.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.178+0000 7f3065c64700 1 -- 172.21.15.49:0/3853306876 >> 172.21.15.49:0/3853306876 conn(0x7f3060094930 msgr2=0x7f306006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:23.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.178+0000 7f3065c64700 1 -- 172.21.15.49:0/3853306876 shutdown_connections 2023-11-30T17:19:23.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.178+0000 7f3065c64700 1 -- 172.21.15.49:0/3853306876 wait complete. 2023-11-30T17:19:23.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.180+0000 7f3065c64700 1 Processor -- start 2023-11-30T17:19:23.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.180+0000 7f3065c64700 1 -- start start 2023-11-30T17:19:23.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.180+0000 7f3065c64700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30600aa220 0x7f30600c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:23.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.180+0000 7f3065c64700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3060154530 0x7f30600c2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:23.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.180+0000 7f3065c64700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3060154910 0x7f30600c2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:23.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.180+0000 7f3065c64700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30600c2d00 con 0x7f3060154910 2023-11-30T17:19:23.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.180+0000 7f3065c64700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30600ab3b0 con 0x7f3060154530 2023-11-30T17:19:23.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.180+0000 7f3065c64700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30600c3c80 con 0x7f30600aa220 2023-11-30T17:19:23.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.180+0000 7f305ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3060154910 0x7f30600c2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:23.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.181+0000 7f305ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3060154910 0x7f30600c2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44312/0 (socket says 172.21.15.49:44312) 2023-11-30T17:19:23.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.181+0000 7f305ffff700 1 -- 172.21.15.49:0/2624734227 learned_addr learned my addr 172.21.15.49:0/2624734227 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:23.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.181+0000 7f305effd700 1 --2- 172.21.15.49:0/2624734227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3060154530 0x7f30600c2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:23.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.181+0000 7f305f7fe700 1 --2- 172.21.15.49:0/2624734227 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30600aa220 0x7f30600c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:23.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.181+0000 7f305ffff700 1 -- 172.21.15.49:0/2624734227 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30600aa220 msgr2=0x7f30600c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:23.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.181+0000 7f305ffff700 1 --2- 172.21.15.49:0/2624734227 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30600aa220 0x7f30600c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:23.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.181+0000 7f305ffff700 1 -- 172.21.15.49:0/2624734227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3060154530 msgr2=0x7f30600c2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:23.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.181+0000 7f305ffff700 1 --2- 172.21.15.49:0/2624734227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3060154530 0x7f30600c2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:23.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.181+0000 7f305ffff700 1 -- 172.21.15.49:0/2624734227 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3054009370 con 0x7f3060154910 2023-11-30T17:19:23.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.181+0000 7f305f7fe700 1 --2- 172.21.15.49:0/2624734227 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30600aa220 0x7f30600c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:19:23.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.181+0000 7f305ffff700 1 --2- 172.21.15.49:0/2624734227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3060154910 0x7f30600c2810 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f3058009e90 tx=0x7f305800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:23.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.181+0000 7f30477fe700 1 -- 172.21.15.49:0/2624734227 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305800cb50 con 0x7f3060154910 2023-11-30T17:19:23.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.181+0000 7f30477fe700 1 -- 172.21.15.49:0/2624734227 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305800f040 con 0x7f3060154910 2023-11-30T17:19:23.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.181+0000 7f3065c64700 1 -- 172.21.15.49:0/2624734227 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30600c2f00 con 0x7f3060154910 2023-11-30T17:19:23.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.181+0000 7f30477fe700 1 -- 172.21.15.49:0/2624734227 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305800cec0 con 0x7f3060154910 2023-11-30T17:19:23.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.181+0000 7f3065c64700 1 -- 172.21.15.49:0/2624734227 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30600aade0 con 0x7f3060154910 2023-11-30T17:19:23.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.182+0000 7f3065c64700 1 -- 172.21.15.49:0/2624734227 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306006c860 con 0x7f3060154910 2023-11-30T17:19:23.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.183+0000 7f30477fe700 1 -- 172.21.15.49:0/2624734227 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f3058013610 con 0x7f3060154910 2023-11-30T17:19:23.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.183+0000 7f30477fe700 1 --2- 172.21.15.49:0/2624734227 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f304c05f2c0 0x7f304c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:23.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.183+0000 7f30477fe700 1 -- 172.21.15.49:0/2624734227 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f305807adb0 con 0x7f3060154910 2023-11-30T17:19:23.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.183+0000 7f305f7fe700 1 --2- 172.21.15.49:0/2624734227 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f304c05f2c0 0x7f304c061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.183+0000 7f305f7fe700 1 --2- 172.21.15.49:0/2624734227 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f304c05f2c0 0x7f304c061780 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f3050007fd0 tx=0x7f3050009040).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.187+0000 7f30477fe700 1 -- 172.21.15.49:0/2624734227 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f305804f860 con 0x7f3060154910 2023-11-30T17:19:23.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.384+0000 7f3065c64700 1 -- 172.21.15.49:0/2624734227 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3060064230 con 0x7f304c05f2c0 2023-11-30T17:19:23.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.386+0000 7f30477fe700 1 -- 172.21.15.49:0/2624734227 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f3060064230 con 0x7f304c05f2c0 2023-11-30T17:19:23.388 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:19:23.388 INFO:teuthology.orchestra.run.smithi049.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-11-30T00:00:00", "created": "2023-11-30T17:08:23", "first": "2023-11-30T17:09:00", "last": "2023-11-30T17:19:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-30T17:19:23.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.388+0000 7f3065c64700 1 -- 172.21.15.49:0/2624734227 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f304c05f2c0 msgr2=0x7f304c061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:23.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.388+0000 7f3065c64700 1 --2- 172.21.15.49:0/2624734227 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f304c05f2c0 0x7f304c061780 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f3050007fd0 tx=0x7f3050009040).stop 2023-11-30T17:19:23.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.388+0000 7f3065c64700 1 -- 172.21.15.49:0/2624734227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3060154910 msgr2=0x7f30600c2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:23.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.388+0000 7f3065c64700 1 --2- 172.21.15.49:0/2624734227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3060154910 0x7f30600c2810 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f3058009e90 tx=0x7f305800b040).stop 2023-11-30T17:19:23.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.388+0000 7f3065c64700 1 -- 172.21.15.49:0/2624734227 shutdown_connections 2023-11-30T17:19:23.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.388+0000 7f3065c64700 1 --2- 172.21.15.49:0/2624734227 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f304c05f2c0 0x7f304c061780 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:23.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.388+0000 7f3065c64700 1 --2- 172.21.15.49:0/2624734227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3060154910 0x7f30600c2810 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:23.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.388+0000 7f3065c64700 1 --2- 172.21.15.49:0/2624734227 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30600aa220 0x7f30600c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:23.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.388+0000 7f3065c64700 1 --2- 172.21.15.49:0/2624734227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3060154530 0x7f30600c2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:23.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.388+0000 7f3065c64700 1 -- 172.21.15.49:0/2624734227 >> 172.21.15.49:0/2624734227 conn(0x7f3060094930 msgr2=0x7f306014ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:23.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.388+0000 7f3065c64700 1 -- 172.21.15.49:0/2624734227 shutdown_connections 2023-11-30T17:19:23.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.388+0000 7f3065c64700 1 -- 172.21.15.49:0/2624734227 wait complete. 2023-11-30T17:19:23.402 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-11-30T00:00:00", "created": "2023-11-30T17:08:23", "first": "2023-11-30T17:09:00", "last": "2023-11-30T17:19:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-30T17:19:23.403 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir0', 'rel_path': '/snap_test_dir1/dir0', 'schedule': '1M', 'retention': {}, 'start': '2023-11-30T00:00:00', 'created': '2023-11-30T17:08:23', 'first': '2023-11-30T17:09:00', 'last': '2023-11-30T17:19:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-11-30T17:19:23.403 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-11-30T17:19:23.403 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-11-30T17:19:23.403 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:23.403 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-11-30T17:19:23.419 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_09_00_UTC 2023-11-30T17:19:23.420 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_10_00_UTC 2023-11-30T17:19:23.420 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_11_00_UTC 2023-11-30T17:19:23.420 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_12_00_UTC 2023-11-30T17:19:23.420 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_13_00_UTC 2023-11-30T17:19:23.420 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_14_00_UTC 2023-11-30T17:19:23.420 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_15_00_UTC 2023-11-30T17:19:23.420 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_16_00_UTC 2023-11-30T17:19:23.420 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_17_00_UTC 2023-11-30T17:19:23.420 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_18_00_UTC 2023-11-30T17:19:23.420 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_19_00_UTC 2023-11-30T17:19:23.421 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-11-30-17_09_00_UTC', 'scheduled-2023-11-30-17_10_00_UTC', 'scheduled-2023-11-30-17_11_00_UTC', 'scheduled-2023-11-30-17_12_00_UTC', 'scheduled-2023-11-30-17_13_00_UTC', 'scheduled-2023-11-30-17_14_00_UTC', 'scheduled-2023-11-30-17_15_00_UTC', 'scheduled-2023-11-30-17_16_00_UTC', 'scheduled-2023-11-30-17_17_00_UTC', 'scheduled-2023-11-30-17_18_00_UTC', 'scheduled-2023-11-30-17_19_00_UTC'] 2023-11-30T17:19:23.421 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir1 2023-11-30T17:19:23.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.579+0000 7f7666050700 1 Processor -- start 2023-11-30T17:19:23.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.579+0000 7f7666050700 1 -- start start 2023-11-30T17:19:23.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.580+0000 7f7666050700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7660154610 0x7f76601582e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:23.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.580+0000 7f7666050700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f76600aa1c0 0x7f76600aa600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:23.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.580+0000 7f7666050700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7660159210 con 0x7f76600ab3b0 2023-11-30T17:19:23.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.580+0000 7f7666050700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76600c0c70 con 0x7f76600aa1c0 2023-11-30T17:19:23.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.580+0000 7f7666050700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76600c2110 con 0x7f7660154610 2023-11-30T17:19:23.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.580+0000 7f765ffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f76600aa1c0 0x7f76600aa600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:23.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.580+0000 7f765ffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f76600aa1c0 0x7f76600aa600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44318/0 (socket says 172.21.15.49:44318) 2023-11-30T17:19:23.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.580+0000 7f765ffff700 1 -- 172.21.15.49:0/508517068 learned_addr learned my addr 172.21.15.49:0/508517068 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:23.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.580+0000 7f765effd700 1 --1- 172.21.15.49:0/508517068 >> v1:172.21.15.49:6789/0 conn(0x7f76600ab3b0 0x7f76600c80c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46638/0 (socket says 172.21.15.49:46638) 2023-11-30T17:19:23.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.580+0000 7f765f7fe700 1 --2- 172.21.15.49:0/508517068 >> v2:172.21.15.115:3300/0 conn(0x7f7660154610 0x7f76601582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:23.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.580+0000 7f765ffff700 1 -- 172.21.15.49:0/508517068 >> v2:172.21.15.115:3300/0 conn(0x7f7660154610 msgr2=0x7f76601582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:23.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.580+0000 7f765ffff700 1 --2- 172.21.15.49:0/508517068 >> v2:172.21.15.115:3300/0 conn(0x7f7660154610 0x7f76601582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:23.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.580+0000 7f765ffff700 1 -- 172.21.15.49:0/508517068 >> v1:172.21.15.49:6789/0 conn(0x7f76600ab3b0 legacy=0x7f76600c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:23.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.580+0000 7f765ffff700 1 -- 172.21.15.49:0/508517068 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76600aaaf0 con 0x7f76600aa1c0 2023-11-30T17:19:23.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.580+0000 7f765e7fc700 1 -- 172.21.15.49:0/508517068 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 870896072 0 0) 0x7f7660159210 con 0x7f76600ab3b0 2023-11-30T17:19:23.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.580+0000 7f765ffff700 1 --2- 172.21.15.49:0/508517068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76600aa1c0 0x7f76600aa600 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f7660062e70 tx=0x7f76580090f0).ready entity=mon.0 client_cookie=6364b22142440ebc server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:23.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.581+0000 7f765e7fc700 1 -- 172.21.15.49:0/508517068 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765800b520 con 0x7f76600aa1c0 2023-11-30T17:19:23.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.581+0000 7f765e7fc700 1 -- 172.21.15.49:0/508517068 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765800b680 con 0x7f76600aa1c0 2023-11-30T17:19:23.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.581+0000 7f765e7fc700 1 -- 172.21.15.49:0/508517068 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765800ba00 con 0x7f76600aa1c0 2023-11-30T17:19:23.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.581+0000 7f7666050700 1 -- 172.21.15.49:0/508517068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76600aa1c0 msgr2=0x7f76600aa600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:23.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.581+0000 7f7666050700 1 --2- 172.21.15.49:0/508517068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76600aa1c0 0x7f76600aa600 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f7660062e70 tx=0x7f76580090f0).stop 2023-11-30T17:19:23.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.581+0000 7f7666050700 1 -- 172.21.15.49:0/508517068 shutdown_connections 2023-11-30T17:19:23.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.581+0000 7f7666050700 1 --2- 172.21.15.49:0/508517068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76600aa1c0 0x7f76600aa600 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:23.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.581+0000 7f7666050700 1 --2- 172.21.15.49:0/508517068 >> v2:172.21.15.115:3300/0 conn(0x7f7660154610 0x7f76601582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:23.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.581+0000 7f7666050700 1 -- 172.21.15.49:0/508517068 >> 172.21.15.49:0/508517068 conn(0x7f76600655a0 msgr2=0x7f7660069e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:23.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.581+0000 7f7666050700 1 -- 172.21.15.49:0/508517068 shutdown_connections 2023-11-30T17:19:23.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.581+0000 7f7666050700 1 -- 172.21.15.49:0/508517068 wait complete. 2023-11-30T17:19:23.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.582+0000 7f7666050700 1 Processor -- start 2023-11-30T17:19:23.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.582+0000 7f7666050700 1 -- start start 2023-11-30T17:19:23.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.583+0000 7f7666050700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76600aa1c0 0x7f76600aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:23.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.583+0000 7f7666050700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7660154610 0x7f76600af580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:23.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.583+0000 7f7666050700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7660144c90 0x7f766014d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:23.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.583+0000 7f7666050700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76600c2300 con 0x7f7660144c90 2023-11-30T17:19:23.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.583+0000 7f7666050700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76600afe40 con 0x7f7660154610 2023-11-30T17:19:23.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.583+0000 7f7666050700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76600b0120 con 0x7f76600aa1c0 2023-11-30T17:19:23.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.583+0000 7f765ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7660144c90 0x7f766014d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:23.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.583+0000 7f765ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7660144c90 0x7f766014d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44326/0 (socket says 172.21.15.49:44326) 2023-11-30T17:19:23.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.583+0000 7f765ffff700 1 -- 172.21.15.49:0/1018297430 learned_addr learned my addr 172.21.15.49:0/1018297430 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:23.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.584+0000 7f765effd700 1 --2- 172.21.15.49:0/1018297430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7660154610 0x7f76600af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:23.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.584+0000 7f765ffff700 1 -- 172.21.15.49:0/1018297430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76600aa1c0 msgr2=0x7f76600aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:23.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.584+0000 7f765f7fe700 1 --2- 172.21.15.49:0/1018297430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76600aa1c0 0x7f76600aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.584+0000 7f765ffff700 1 --2- 172.21.15.49:0/1018297430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76600aa1c0 0x7f76600aee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.584+0000 7f765ffff700 1 -- 172.21.15.49:0/1018297430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7660154610 msgr2=0x7f76600af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.584+0000 7f765ffff700 1 --2- 172.21.15.49:0/1018297430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7660154610 0x7f76600af580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.584+0000 7f765ffff700 1 -- 172.21.15.49:0/1018297430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7658009370 con 0x7f7660144c90 2023-11-30T17:19:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.584+0000 7f765effd700 1 --2- 172.21.15.49:0/1018297430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7660154610 0x7f76600af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:19:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.584+0000 7f765ffff700 1 --2- 172.21.15.49:0/1018297430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7660144c90 0x7f766014d130 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f76600cc2d0 tx=0x7f7658017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.584+0000 7f76577fe700 1 -- 172.21.15.49:0/1018297430 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765800b7f0 con 0x7f7660144c90 2023-11-30T17:19:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.584+0000 7f76577fe700 1 -- 172.21.15.49:0/1018297430 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765800b950 con 0x7f7660144c90 2023-11-30T17:19:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.584+0000 7f7666050700 1 -- 172.21.15.49:0/1018297430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76600b0400 con 0x7f7660144c90 2023-11-30T17:19:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.584+0000 7f76577fe700 1 -- 172.21.15.49:0/1018297430 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765801c670 con 0x7f7660144c90 2023-11-30T17:19:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.584+0000 7f7666050700 1 -- 172.21.15.49:0/1018297430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76600afa70 con 0x7f7660144c90 2023-11-30T17:19:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.585+0000 7f7666050700 1 -- 172.21.15.49:0/1018297430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76600b08a0 con 0x7f7660144c90 2023-11-30T17:19:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.585+0000 7f76577fe700 1 -- 172.21.15.49:0/1018297430 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f765801ca20 con 0x7f7660144c90 2023-11-30T17:19:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.586+0000 7f76577fe700 1 --2- 172.21.15.49:0/1018297430 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f764005f2c0 0x7f7640061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.586+0000 7f76577fe700 1 -- 172.21.15.49:0/1018297430 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f765807c270 con 0x7f7660144c90 2023-11-30T17:19:23.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.586+0000 7f765f7fe700 1 --2- 172.21.15.49:0/1018297430 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f764005f2c0 0x7f7640061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:23.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.586+0000 7f765f7fe700 1 --2- 172.21.15.49:0/1018297430 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f764005f2c0 0x7f7640061780 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f76500094d0 tx=0x7f765000b040).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:23.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.590+0000 7f76577fe700 1 -- 172.21.15.49:0/1018297430 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f765804d2f0 con 0x7f7660144c90 2023-11-30T17:19:23.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.787+0000 7f7666050700 1 -- 172.21.15.49:0/1018297430 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7660158970 con 0x7f764005f2c0 2023-11-30T17:19:23.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.789+0000 7f76577fe700 1 -- 172.21.15.49:0/1018297430 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f7660158970 con 0x7f764005f2c0 2023-11-30T17:19:23.791 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:19:23.791 INFO:teuthology.orchestra.run.smithi049.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-11-30T00:00:00", "created": "2023-11-30T17:08:23", "first": "2023-11-30T17:09:00", "last": "2023-11-30T17:19:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-30T17:19:23.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.790+0000 7f7666050700 1 -- 172.21.15.49:0/1018297430 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f764005f2c0 msgr2=0x7f7640061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:23.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.790+0000 7f7666050700 1 --2- 172.21.15.49:0/1018297430 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f764005f2c0 0x7f7640061780 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f76500094d0 tx=0x7f765000b040).stop 2023-11-30T17:19:23.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.790+0000 7f7666050700 1 -- 172.21.15.49:0/1018297430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7660144c90 msgr2=0x7f766014d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:23.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.790+0000 7f7666050700 1 --2- 172.21.15.49:0/1018297430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7660144c90 0x7f766014d130 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f76600cc2d0 tx=0x7f7658017000).stop 2023-11-30T17:19:23.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.790+0000 7f7666050700 1 -- 172.21.15.49:0/1018297430 shutdown_connections 2023-11-30T17:19:23.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.790+0000 7f7666050700 1 --2- 172.21.15.49:0/1018297430 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f764005f2c0 0x7f7640061780 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:23.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.790+0000 7f7666050700 1 --2- 172.21.15.49:0/1018297430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7660144c90 0x7f766014d130 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:23.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.790+0000 7f7666050700 1 --2- 172.21.15.49:0/1018297430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76600aa1c0 0x7f76600aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:23.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.790+0000 7f7666050700 1 --2- 172.21.15.49:0/1018297430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7660154610 0x7f76600af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:23.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.790+0000 7f7666050700 1 -- 172.21.15.49:0/1018297430 >> 172.21.15.49:0/1018297430 conn(0x7f76600655a0 msgr2=0x7f766014fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:23.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.790+0000 7f7666050700 1 -- 172.21.15.49:0/1018297430 shutdown_connections 2023-11-30T17:19:23.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.790+0000 7f7666050700 1 -- 172.21.15.49:0/1018297430 wait complete. 2023-11-30T17:19:23.805 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-11-30T00:00:00", "created": "2023-11-30T17:08:23", "first": "2023-11-30T17:09:00", "last": "2023-11-30T17:19:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-30T17:19:23.805 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir1', 'rel_path': '/snap_test_dir1/dir1', 'schedule': '1M', 'retention': {}, 'start': '2023-11-30T00:00:00', 'created': '2023-11-30T17:08:23', 'first': '2023-11-30T17:09:00', 'last': '2023-11-30T17:19:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-11-30T17:19:23.805 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-11-30T17:19:23.805 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-11-30T17:19:23.805 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:23.805 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-11-30T17:19:23.822 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_09_00_UTC 2023-11-30T17:19:23.822 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_10_00_UTC 2023-11-30T17:19:23.822 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_11_00_UTC 2023-11-30T17:19:23.823 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_12_00_UTC 2023-11-30T17:19:23.823 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_13_00_UTC 2023-11-30T17:19:23.823 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_14_00_UTC 2023-11-30T17:19:23.823 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_15_00_UTC 2023-11-30T17:19:23.823 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_16_00_UTC 2023-11-30T17:19:23.823 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_17_00_UTC 2023-11-30T17:19:23.823 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_18_00_UTC 2023-11-30T17:19:23.823 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_19_00_UTC 2023-11-30T17:19:23.823 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-11-30-17_09_00_UTC', 'scheduled-2023-11-30-17_10_00_UTC', 'scheduled-2023-11-30-17_11_00_UTC', 'scheduled-2023-11-30-17_12_00_UTC', 'scheduled-2023-11-30-17_13_00_UTC', 'scheduled-2023-11-30-17_14_00_UTC', 'scheduled-2023-11-30-17_15_00_UTC', 'scheduled-2023-11-30-17_16_00_UTC', 'scheduled-2023-11-30-17_17_00_UTC', 'scheduled-2023-11-30-17_18_00_UTC', 'scheduled-2023-11-30-17_19_00_UTC'] 2023-11-30T17:19:23.823 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir2 2023-11-30T17:19:23.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.981+0000 7fd9a9ab8700 1 Processor -- start 2023-11-30T17:19:23.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.981+0000 7fd9a9ab8700 1 -- start start 2023-11-30T17:19:23.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.982+0000 7fd9a9ab8700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd9a40c18a0 0x7fd9a40c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:23.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.982+0000 7fd9a9ab8700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a4158d50 con 0x7fd9a40aa680 2023-11-30T17:19:23.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.982+0000 7fd9a9ab8700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a4158140 con 0x7fd9a41542d0 2023-11-30T17:19:23.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.982+0000 7fd9a9ab8700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9a4158420 con 0x7fd9a40c18a0 2023-11-30T17:19:23.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.982+0000 7fd9a92b7700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd9a40c18a0 0x7fd9a40c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:23.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.982+0000 7fd9a92b7700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd9a40c18a0 0x7fd9a40c66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44332/0 (socket says 172.21.15.49:44332) 2023-11-30T17:19:23.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.982+0000 7fd9a92b7700 1 -- 172.21.15.49:0/263146585 learned_addr learned my addr 172.21.15.49:0/263146585 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:23.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.982+0000 7fd9a3fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd9a40aa680 0x7fd9a40c5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46646/0 (socket says 172.21.15.49:46646) 2023-11-30T17:19:23.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.982+0000 7fd9a92b7700 1 -- 172.21.15.49:0/263146585 >> v1:172.21.15.115:6789/0 conn(0x7fd9a41542d0 legacy=0x7fd9a40a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:23.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.982+0000 7fd9a92b7700 1 -- 172.21.15.49:0/263146585 >> v1:172.21.15.49:6789/0 conn(0x7fd9a40aa680 legacy=0x7fd9a40c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:23.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.982+0000 7fd9a92b7700 1 -- 172.21.15.49:0/263146585 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a4158700 con 0x7fd9a40c18a0 2023-11-30T17:19:23.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.982+0000 7fd9a37fe700 1 -- 172.21.15.49:0/263146585 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1678463869 0 0) 0x7fd9a4158d50 con 0x7fd9a40aa680 2023-11-30T17:19:23.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.983+0000 7fd9a92b7700 1 --2- 172.21.15.49:0/263146585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9a40c18a0 0x7fd9a40c66d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fd99c009f20 tx=0x7fd99c009840).ready entity=mon.0 client_cookie=1929c0632384e2ba server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:23.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.983+0000 7fd9a37fe700 1 -- 172.21.15.49:0/263146585 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c00e070 con 0x7fd9a40c18a0 2023-11-30T17:19:23.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.983+0000 7fd9a37fe700 1 -- 172.21.15.49:0/263146585 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99c00ba80 con 0x7fd9a40c18a0 2023-11-30T17:19:23.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.983+0000 7fd9a37fe700 1 -- 172.21.15.49:0/263146585 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c00be00 con 0x7fd9a40c18a0 2023-11-30T17:19:23.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.983+0000 7fd9a9ab8700 1 -- 172.21.15.49:0/263146585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9a40c18a0 msgr2=0x7fd9a40c66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:23.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.983+0000 7fd9a9ab8700 1 --2- 172.21.15.49:0/263146585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9a40c18a0 0x7fd9a40c66d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fd99c009f20 tx=0x7fd99c009840).stop 2023-11-30T17:19:23.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.983+0000 7fd9a9ab8700 1 -- 172.21.15.49:0/263146585 shutdown_connections 2023-11-30T17:19:23.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.983+0000 7fd9a9ab8700 1 --2- 172.21.15.49:0/263146585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9a40c18a0 0x7fd9a40c66d0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:23.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.983+0000 7fd9a9ab8700 1 -- 172.21.15.49:0/263146585 >> 172.21.15.49:0/263146585 conn(0x7fd9a40cb010 msgr2=0x7fd9a40cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:23.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.983+0000 7fd9a9ab8700 1 -- 172.21.15.49:0/263146585 shutdown_connections 2023-11-30T17:19:23.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.983+0000 7fd9a9ab8700 1 -- 172.21.15.49:0/263146585 wait complete. 2023-11-30T17:19:23.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.984+0000 7fd9a9ab8700 1 Processor -- start 2023-11-30T17:19:23.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.985+0000 7fd9a9ab8700 1 -- start start 2023-11-30T17:19:23.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.985+0000 7fd9a9ab8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9a40aa680 0x7fd9a4141ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:23.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.985+0000 7fd9a9ab8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9a40c18a0 0x7fd9a40c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:23.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.985+0000 7fd9a9ab8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a41542d0 0x7fd9a40c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:23.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.985+0000 7fd9a9ab8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a40ca170 con 0x7fd9a40aa680 2023-11-30T17:19:23.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.985+0000 7fd9a9ab8700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a4157c30 con 0x7fd9a41542d0 2023-11-30T17:19:23.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.985+0000 7fd9a9ab8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a41577a0 con 0x7fd9a40c18a0 2023-11-30T17:19:23.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.986+0000 7fd9a8ab6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9a40aa680 0x7fd9a4141ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:23.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.986+0000 7fd9a8ab6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9a40aa680 0x7fd9a4141ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44348/0 (socket says 172.21.15.49:44348) 2023-11-30T17:19:23.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.986+0000 7fd9a8ab6700 1 -- 172.21.15.49:0/2574666425 learned_addr learned my addr 172.21.15.49:0/2574666425 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:23.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.986+0000 7fd9a92b7700 1 --2- 172.21.15.49:0/2574666425 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a41542d0 0x7fd9a40c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:23.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.986+0000 7fd9a3fff700 1 --2- 172.21.15.49:0/2574666425 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9a40c18a0 0x7fd9a40c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:23.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.986+0000 7fd9a8ab6700 1 -- 172.21.15.49:0/2574666425 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9a40c18a0 msgr2=0x7fd9a40c9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:23.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.986+0000 7fd9a8ab6700 1 --2- 172.21.15.49:0/2574666425 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9a40c18a0 0x7fd9a40c9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:23.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.986+0000 7fd9a8ab6700 1 -- 172.21.15.49:0/2574666425 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a41542d0 msgr2=0x7fd9a40c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:23.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.986+0000 7fd9a8ab6700 1 --2- 172.21.15.49:0/2574666425 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a41542d0 0x7fd9a40c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:23.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.986+0000 7fd9a8ab6700 1 -- 172.21.15.49:0/2574666425 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd99c009ae0 con 0x7fd9a40aa680 2023-11-30T17:19:23.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.986+0000 7fd9a3fff700 1 --2- 172.21.15.49:0/2574666425 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9a40c18a0 0x7fd9a40c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:19:23.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.986+0000 7fd9a8ab6700 1 --2- 172.21.15.49:0/2574666425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9a40aa680 0x7fd9a4141ac0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fd99400c470 tx=0x7fd994007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:23.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.986+0000 7fd9a0ff9700 1 -- 172.21.15.49:0/2574666425 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99400ce30 con 0x7fd9a40aa680 2023-11-30T17:19:23.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.986+0000 7fd9a0ff9700 1 -- 172.21.15.49:0/2574666425 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd994007020 con 0x7fd9a40aa680 2023-11-30T17:19:23.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.986+0000 7fd9a9ab8700 1 -- 172.21.15.49:0/2574666425 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a4156b90 con 0x7fd9a40aa680 2023-11-30T17:19:23.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.986+0000 7fd9a0ff9700 1 -- 172.21.15.49:0/2574666425 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9940073c0 con 0x7fd9a40aa680 2023-11-30T17:19:23.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.986+0000 7fd9a9ab8700 1 -- 172.21.15.49:0/2574666425 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a4157150 con 0x7fd9a40aa680 2023-11-30T17:19:23.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.987+0000 7fd9a9ab8700 1 -- 172.21.15.49:0/2574666425 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a406c7c0 con 0x7fd9a40aa680 2023-11-30T17:19:23.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.988+0000 7fd9a0ff9700 1 -- 172.21.15.49:0/2574666425 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fd9940068b0 con 0x7fd9a40aa680 2023-11-30T17:19:23.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.988+0000 7fd9a0ff9700 1 --2- 172.21.15.49:0/2574666425 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd99005f2c0 0x7fd990061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:23.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.988+0000 7fd9a0ff9700 1 -- 172.21.15.49:0/2574666425 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fd9940797f0 con 0x7fd9a40aa680 2023-11-30T17:19:23.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.988+0000 7fd9a3fff700 1 --2- 172.21.15.49:0/2574666425 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd99005f2c0 0x7fd990061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:23.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.989+0000 7fd9a3fff700 1 --2- 172.21.15.49:0/2574666425 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd99005f2c0 0x7fd990061780 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fd998007fd0 tx=0x7fd998007af0).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:23.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:23.992+0000 7fd9a0ff9700 1 -- 172.21.15.49:0/2574666425 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd994047b00 con 0x7fd9a40aa680 2023-11-30T17:19:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.191+0000 7fd9a9ab8700 1 -- 172.21.15.49:0/2574666425 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd9a40c0120 con 0x7fd99005f2c0 2023-11-30T17:19:24.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.193+0000 7fd9a0ff9700 1 -- 172.21.15.49:0/2574666425 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fd9a40c0120 con 0x7fd99005f2c0 2023-11-30T17:19:24.196 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:19:24.196 INFO:teuthology.orchestra.run.smithi049.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-11-30T00:00:00", "created": "2023-11-30T17:08:23", "first": "2023-11-30T17:09:00", "last": "2023-11-30T17:19:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-30T17:19:24.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.195+0000 7fd9a9ab8700 1 -- 172.21.15.49:0/2574666425 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd99005f2c0 msgr2=0x7fd990061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:24.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.195+0000 7fd9a9ab8700 1 --2- 172.21.15.49:0/2574666425 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd99005f2c0 0x7fd990061780 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fd998007fd0 tx=0x7fd998007af0).stop 2023-11-30T17:19:24.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.195+0000 7fd9a9ab8700 1 -- 172.21.15.49:0/2574666425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9a40aa680 msgr2=0x7fd9a4141ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.195+0000 7fd9a9ab8700 1 --2- 172.21.15.49:0/2574666425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9a40aa680 0x7fd9a4141ac0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fd99400c470 tx=0x7fd994007e00).stop 2023-11-30T17:19:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.195+0000 7fd9a9ab8700 1 -- 172.21.15.49:0/2574666425 shutdown_connections 2023-11-30T17:19:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.195+0000 7fd9a9ab8700 1 --2- 172.21.15.49:0/2574666425 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a41542d0 0x7fd9a40c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.195+0000 7fd9a9ab8700 1 --2- 172.21.15.49:0/2574666425 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd99005f2c0 0x7fd990061780 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.195+0000 7fd9a9ab8700 1 --2- 172.21.15.49:0/2574666425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9a40aa680 0x7fd9a4141ac0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.195+0000 7fd9a9ab8700 1 --2- 172.21.15.49:0/2574666425 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9a40c18a0 0x7fd9a40c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.195+0000 7fd9a9ab8700 1 -- 172.21.15.49:0/2574666425 >> 172.21.15.49:0/2574666425 conn(0x7fd9a40cb010 msgr2=0x7fd9a4064880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.195+0000 7fd9a9ab8700 1 -- 172.21.15.49:0/2574666425 shutdown_connections 2023-11-30T17:19:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.195+0000 7fd9a9ab8700 1 -- 172.21.15.49:0/2574666425 wait complete. 2023-11-30T17:19:24.209 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-11-30T00:00:00", "created": "2023-11-30T17:08:23", "first": "2023-11-30T17:09:00", "last": "2023-11-30T17:19:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-30T17:19:24.209 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir2', 'rel_path': '/snap_test_dir1/dir2', 'schedule': '1M', 'retention': {}, 'start': '2023-11-30T00:00:00', 'created': '2023-11-30T17:08:23', 'first': '2023-11-30T17:09:00', 'last': '2023-11-30T17:19:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-11-30T17:19:24.209 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-11-30T17:19:24.209 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-11-30T17:19:24.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:24.209 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-11-30T17:19:24.225 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_09_00_UTC 2023-11-30T17:19:24.225 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_10_00_UTC 2023-11-30T17:19:24.225 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_11_00_UTC 2023-11-30T17:19:24.226 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_12_00_UTC 2023-11-30T17:19:24.226 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_13_00_UTC 2023-11-30T17:19:24.226 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_14_00_UTC 2023-11-30T17:19:24.226 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_15_00_UTC 2023-11-30T17:19:24.226 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_16_00_UTC 2023-11-30T17:19:24.226 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_17_00_UTC 2023-11-30T17:19:24.226 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_18_00_UTC 2023-11-30T17:19:24.226 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_19_00_UTC 2023-11-30T17:19:24.226 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-11-30-17_09_00_UTC', 'scheduled-2023-11-30-17_10_00_UTC', 'scheduled-2023-11-30-17_11_00_UTC', 'scheduled-2023-11-30-17_12_00_UTC', 'scheduled-2023-11-30-17_13_00_UTC', 'scheduled-2023-11-30-17_14_00_UTC', 'scheduled-2023-11-30-17_15_00_UTC', 'scheduled-2023-11-30-17_16_00_UTC', 'scheduled-2023-11-30-17_17_00_UTC', 'scheduled-2023-11-30-17_18_00_UTC', 'scheduled-2023-11-30-17_19_00_UTC'] 2023-11-30T17:19:24.226 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir3 2023-11-30T17:19:24.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.385+0000 7f84b575a700 1 Processor -- start 2023-11-30T17:19:24.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.385+0000 7f84b575a700 1 -- start start 2023-11-30T17:19:24.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.386+0000 7f84b575a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f84b01373a0 0x7f84b00c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:24.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.386+0000 7f84b575a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b0158e20 con 0x7f84b00c5f30 2023-11-30T17:19:24.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.386+0000 7f84b575a700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b00677c0 con 0x7f84b0064b00 2023-11-30T17:19:24.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.386+0000 7f84b575a700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b01582a0 con 0x7f84b01373a0 2023-11-30T17:19:24.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.386+0000 7f84ae7fc700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f84b00c5f30 0x7f84b00669a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46652/0 (socket says 172.21.15.49:46652) 2023-11-30T17:19:24.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.386+0000 7f84ae7fc700 1 -- 172.21.15.49:0/3851300226 learned_addr learned my addr 172.21.15.49:0/3851300226 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:24.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.386+0000 7f84aeffd700 1 --2- 172.21.15.49:0/3851300226 >> v2:172.21.15.115:3300/0 conn(0x7f84b01373a0 0x7f84b00c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:24.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.386+0000 7f84adffb700 1 -- 172.21.15.49:0/3851300226 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 454275066 0 0) 0x7f84b0158e20 con 0x7f84b00c5f30 2023-11-30T17:19:24.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.386+0000 7f84adffb700 1 -- 172.21.15.49:0/3851300226 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f849c0033f0 con 0x7f84b00c5f30 2023-11-30T17:19:24.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.387+0000 7f84adffb700 1 -- 172.21.15.49:0/3851300226 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638502276 0 0) 0x7f84b00677c0 con 0x7f84b0064b00 2023-11-30T17:19:24.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.387+0000 7f84adffb700 1 -- 172.21.15.49:0/3851300226 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84b0158e20 con 0x7f84b0064b00 2023-11-30T17:19:24.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.387+0000 7f84aeffd700 1 -- 172.21.15.49:0/3851300226 >> v1:172.21.15.115:6789/0 conn(0x7f84b0064b00 legacy=0x7f84b00670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:24.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.387+0000 7f84adffb700 1 -- 172.21.15.49:0/3851300226 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1112584748 0 0) 0x7f849c0033f0 con 0x7f84b00c5f30 2023-11-30T17:19:24.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.387+0000 7f84aeffd700 1 -- 172.21.15.49:0/3851300226 >> v1:172.21.15.49:6789/0 conn(0x7f84b00c5f30 legacy=0x7f84b00669a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:24.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.387+0000 7f84aeffd700 1 -- 172.21.15.49:0/3851300226 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b0158580 con 0x7f84b01373a0 2023-11-30T17:19:24.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.387+0000 7f84aeffd700 1 --2- 172.21.15.49:0/3851300226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84b01373a0 0x7f84b00c72e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f84a0009e60 tx=0x7f84a0009780).ready entity=mon.1 client_cookie=5898c22bc7860632 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:24.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.387+0000 7f84adffb700 1 -- 172.21.15.49:0/3851300226 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a000e070 con 0x7f84b01373a0 2023-11-30T17:19:24.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.387+0000 7f84adffb700 1 -- 172.21.15.49:0/3851300226 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a000b7a0 con 0x7f84b01373a0 2023-11-30T17:19:24.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.387+0000 7f84adffb700 1 -- 172.21.15.49:0/3851300226 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8498001470 con 0x7f84b01373a0 2023-11-30T17:19:24.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.387+0000 7f84b575a700 1 -- 172.21.15.49:0/3851300226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84b01373a0 msgr2=0x7f84b00c72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:24.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.387+0000 7f84b575a700 1 --2- 172.21.15.49:0/3851300226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84b01373a0 0x7f84b00c72e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f84a0009e60 tx=0x7f84a0009780).stop 2023-11-30T17:19:24.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.387+0000 7f84b575a700 1 -- 172.21.15.49:0/3851300226 shutdown_connections 2023-11-30T17:19:24.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.387+0000 7f84b575a700 1 --2- 172.21.15.49:0/3851300226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84b01373a0 0x7f84b00c72e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:24.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.387+0000 7f84b575a700 1 -- 172.21.15.49:0/3851300226 >> 172.21.15.49:0/3851300226 conn(0x7f84b00628f0 msgr2=0x7f84b0062d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:24.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.388+0000 7f84b575a700 1 -- 172.21.15.49:0/3851300226 shutdown_connections 2023-11-30T17:19:24.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.388+0000 7f84b575a700 1 -- 172.21.15.49:0/3851300226 wait complete. 2023-11-30T17:19:24.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.389+0000 7f84b575a700 1 Processor -- start 2023-11-30T17:19:24.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.389+0000 7f84b575a700 1 -- start start 2023-11-30T17:19:24.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.389+0000 7f84b575a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84b0064b00 0x7f84b00ab770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:24.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.389+0000 7f84b575a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84b00c5f30 0x7f84b0168620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:24.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.389+0000 7f84b575a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84b01373a0 0x7f84b00aa580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:24.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.389+0000 7f84b575a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b0167bd0 con 0x7f84b01373a0 2023-11-30T17:19:24.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.390+0000 7f84b575a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b0168b10 con 0x7f84b0064b00 2023-11-30T17:19:24.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.390+0000 7f84b575a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b00aaa70 con 0x7f84b00c5f30 2023-11-30T17:19:24.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.390+0000 7f84af7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84b01373a0 0x7f84b00aa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:24.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.390+0000 7f84af7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84b01373a0 0x7f84b00aa580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44352/0 (socket says 172.21.15.49:44352) 2023-11-30T17:19:24.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.390+0000 7f84af7fe700 1 -- 172.21.15.49:0/3442206593 learned_addr learned my addr 172.21.15.49:0/3442206593 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:24.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.390+0000 7f84ae7fc700 1 --2- 172.21.15.49:0/3442206593 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84b00c5f30 0x7f84b0168620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:24.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.390+0000 7f84aeffd700 1 --2- 172.21.15.49:0/3442206593 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84b0064b00 0x7f84b00ab770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:24.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.390+0000 7f84af7fe700 1 -- 172.21.15.49:0/3442206593 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84b00c5f30 msgr2=0x7f84b0168620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:24.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.390+0000 7f84af7fe700 1 --2- 172.21.15.49:0/3442206593 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84b00c5f30 0x7f84b0168620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:24.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.390+0000 7f84af7fe700 1 -- 172.21.15.49:0/3442206593 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84b0064b00 msgr2=0x7f84b00ab770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:24.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.390+0000 7f84af7fe700 1 --2- 172.21.15.49:0/3442206593 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84b0064b00 0x7f84b00ab770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:24.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.390+0000 7f84af7fe700 1 -- 172.21.15.49:0/3442206593 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a0009a20 con 0x7f84b01373a0 2023-11-30T17:19:24.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.390+0000 7f84af7fe700 1 --2- 172.21.15.49:0/3442206593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84b01373a0 0x7f84b00aa580 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f84a800c4f0 tx=0x7f84a8007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:24.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.390+0000 7f84a6ffd700 1 -- 172.21.15.49:0/3442206593 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a800ce00 con 0x7f84b01373a0 2023-11-30T17:19:24.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.390+0000 7f84a6ffd700 1 -- 172.21.15.49:0/3442206593 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a800f470 con 0x7f84b01373a0 2023-11-30T17:19:24.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.390+0000 7f84b575a700 1 -- 172.21.15.49:0/3442206593 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b00aad40 con 0x7f84b01373a0 2023-11-30T17:19:24.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.390+0000 7f84a6ffd700 1 -- 172.21.15.49:0/3442206593 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a800f7f0 con 0x7f84b01373a0 2023-11-30T17:19:24.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.390+0000 7f84b575a700 1 -- 172.21.15.49:0/3442206593 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b0167e20 con 0x7f84b01373a0 2023-11-30T17:19:24.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.391+0000 7f84b575a700 1 -- 172.21.15.49:0/3442206593 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b00ab260 con 0x7f84b01373a0 2023-11-30T17:19:24.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.392+0000 7f84a6ffd700 1 -- 172.21.15.49:0/3442206593 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f84a800fbe0 con 0x7f84b01373a0 2023-11-30T17:19:24.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.392+0000 7f84a6ffd700 1 --2- 172.21.15.49:0/3442206593 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f849005f2c0 0x7f8490061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:24.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.392+0000 7f84a6ffd700 1 -- 172.21.15.49:0/3442206593 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f84a8079800 con 0x7f84b01373a0 2023-11-30T17:19:24.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.392+0000 7f84aeffd700 1 --2- 172.21.15.49:0/3442206593 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f849005f2c0 0x7f8490061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:24.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.393+0000 7f84aeffd700 1 --2- 172.21.15.49:0/3442206593 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f849005f2c0 0x7f8490061780 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f84a000baf0 tx=0x7f84a0009780).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:24.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.396+0000 7f84a6ffd700 1 -- 172.21.15.49:0/3442206593 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f84a8048b00 con 0x7f84b01373a0 2023-11-30T17:19:24.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.593+0000 7f84b575a700 1 -- 172.21.15.49:0/3442206593 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f84b0168460 con 0x7f849005f2c0 2023-11-30T17:19:24.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.595+0000 7f84a6ffd700 1 -- 172.21.15.49:0/3442206593 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f84b0168460 con 0x7f849005f2c0 2023-11-30T17:19:24.597 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:19:24.597 INFO:teuthology.orchestra.run.smithi049.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-11-30T00:00:00", "created": "2023-11-30T17:08:24", "first": "2023-11-30T17:09:00", "last": "2023-11-30T17:19:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-30T17:19:24.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.596+0000 7f84b575a700 1 -- 172.21.15.49:0/3442206593 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f849005f2c0 msgr2=0x7f8490061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:24.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.596+0000 7f84b575a700 1 --2- 172.21.15.49:0/3442206593 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f849005f2c0 0x7f8490061780 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f84a000baf0 tx=0x7f84a0009780).stop 2023-11-30T17:19:24.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.596+0000 7f84b575a700 1 -- 172.21.15.49:0/3442206593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84b01373a0 msgr2=0x7f84b00aa580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:24.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.596+0000 7f84b575a700 1 --2- 172.21.15.49:0/3442206593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84b01373a0 0x7f84b00aa580 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f84a800c4f0 tx=0x7f84a8007c00).stop 2023-11-30T17:19:24.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.596+0000 7f84b575a700 1 -- 172.21.15.49:0/3442206593 shutdown_connections 2023-11-30T17:19:24.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.596+0000 7f84b575a700 1 --2- 172.21.15.49:0/3442206593 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f849005f2c0 0x7f8490061780 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:24.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.596+0000 7f84b575a700 1 --2- 172.21.15.49:0/3442206593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84b01373a0 0x7f84b00aa580 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:24.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.596+0000 7f84b575a700 1 --2- 172.21.15.49:0/3442206593 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84b0064b00 0x7f84b00ab770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:24.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.596+0000 7f84b575a700 1 --2- 172.21.15.49:0/3442206593 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84b00c5f30 0x7f84b0168620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:24.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.596+0000 7f84b575a700 1 -- 172.21.15.49:0/3442206593 >> 172.21.15.49:0/3442206593 conn(0x7f84b00628f0 msgr2=0x7f84b00c9310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:24.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.596+0000 7f84b575a700 1 -- 172.21.15.49:0/3442206593 shutdown_connections 2023-11-30T17:19:24.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.596+0000 7f84b575a700 1 -- 172.21.15.49:0/3442206593 wait complete. 2023-11-30T17:19:24.611 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-11-30T00:00:00", "created": "2023-11-30T17:08:24", "first": "2023-11-30T17:09:00", "last": "2023-11-30T17:19:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-30T17:19:24.611 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir3', 'rel_path': '/snap_test_dir1/dir3', 'schedule': '1M', 'retention': {}, 'start': '2023-11-30T00:00:00', 'created': '2023-11-30T17:08:24', 'first': '2023-11-30T17:09:00', 'last': '2023-11-30T17:19:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-11-30T17:19:24.611 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-11-30T17:19:24.611 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-11-30T17:19:24.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:24.611 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-11-30T17:19:24.628 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_09_00_UTC 2023-11-30T17:19:24.628 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_10_00_UTC 2023-11-30T17:19:24.628 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_11_00_UTC 2023-11-30T17:19:24.628 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_12_00_UTC 2023-11-30T17:19:24.628 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_13_00_UTC 2023-11-30T17:19:24.628 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_14_00_UTC 2023-11-30T17:19:24.628 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_15_00_UTC 2023-11-30T17:19:24.628 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_16_00_UTC 2023-11-30T17:19:24.629 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_17_00_UTC 2023-11-30T17:19:24.629 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_18_00_UTC 2023-11-30T17:19:24.629 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_19_00_UTC 2023-11-30T17:19:24.629 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-11-30-17_09_00_UTC', 'scheduled-2023-11-30-17_10_00_UTC', 'scheduled-2023-11-30-17_11_00_UTC', 'scheduled-2023-11-30-17_12_00_UTC', 'scheduled-2023-11-30-17_13_00_UTC', 'scheduled-2023-11-30-17_14_00_UTC', 'scheduled-2023-11-30-17_15_00_UTC', 'scheduled-2023-11-30-17_16_00_UTC', 'scheduled-2023-11-30-17_17_00_UTC', 'scheduled-2023-11-30-17_18_00_UTC', 'scheduled-2023-11-30-17_19_00_UTC'] 2023-11-30T17:19:24.629 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir4 2023-11-30T17:19:24.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.786+0000 7ff85f351700 1 Processor -- start 2023-11-30T17:19:24.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.786+0000 7ff85f351700 1 -- start start 2023-11-30T17:19:24.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.787+0000 7ff85f351700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff85814eb50 0x7ff8580bcb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:24.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.787+0000 7ff85f351700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8580bdd50 con 0x7ff858155430 2023-11-30T17:19:24.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.787+0000 7ff85f351700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff85814ef30 con 0x7ff8580c2b90 2023-11-30T17:19:24.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.787+0000 7ff85f351700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8580bd140 con 0x7ff85814eb50 2023-11-30T17:19:24.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.787+0000 7ff85e34f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff85814eb50 0x7ff8580bcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:24.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.787+0000 7ff85db4e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff858155430 0x7ff8580c2480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46660/0 (socket says 172.21.15.49:46660) 2023-11-30T17:19:24.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.788+0000 7ff85db4e700 1 -- 172.21.15.49:0/1727521070 learned_addr learned my addr 172.21.15.49:0/1727521070 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:24.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.788+0000 7ff85e34f700 1 -- 172.21.15.49:0/1727521070 >> v1:172.21.15.115:6789/0 conn(0x7ff8580c2b90 legacy=0x7ff858062700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:24.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.788+0000 7ff85d34d700 1 -- 172.21.15.49:0/1727521070 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3357884371 0 0) 0x7ff8580bdd50 con 0x7ff858155430 2023-11-30T17:19:24.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.788+0000 7ff85e34f700 1 -- 172.21.15.49:0/1727521070 >> v1:172.21.15.49:6789/0 conn(0x7ff858155430 legacy=0x7ff8580c2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:24.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.788+0000 7ff85e34f700 1 -- 172.21.15.49:0/1727521070 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8580bd420 con 0x7ff85814eb50 2023-11-30T17:19:24.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.788+0000 7ff85e34f700 1 --2- 172.21.15.49:0/1727521070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff85814eb50 0x7ff8580bcb60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7ff848009e60 tx=0x7ff848009780).ready entity=mon.0 client_cookie=3e02d4155f59119f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:24.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.788+0000 7ff85d34d700 1 -- 172.21.15.49:0/1727521070 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84800e070 con 0x7ff85814eb50 2023-11-30T17:19:24.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.788+0000 7ff85d34d700 1 -- 172.21.15.49:0/1727521070 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84800bbf0 con 0x7ff85814eb50 2023-11-30T17:19:24.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.788+0000 7ff85d34d700 1 -- 172.21.15.49:0/1727521070 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff848012410 con 0x7ff85814eb50 2023-11-30T17:19:24.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.789+0000 7ff85f351700 1 -- 172.21.15.49:0/1727521070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff85814eb50 msgr2=0x7ff8580bcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:24.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.789+0000 7ff85f351700 1 --2- 172.21.15.49:0/1727521070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff85814eb50 0x7ff8580bcb60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7ff848009e60 tx=0x7ff848009780).stop 2023-11-30T17:19:24.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.789+0000 7ff85f351700 1 -- 172.21.15.49:0/1727521070 shutdown_connections 2023-11-30T17:19:24.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.789+0000 7ff85f351700 1 --2- 172.21.15.49:0/1727521070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff85814eb50 0x7ff8580bcb60 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:24.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.789+0000 7ff85f351700 1 -- 172.21.15.49:0/1727521070 >> 172.21.15.49:0/1727521070 conn(0x7ff8580c3f40 msgr2=0x7ff8580c4350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:24.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.789+0000 7ff85f351700 1 -- 172.21.15.49:0/1727521070 shutdown_connections 2023-11-30T17:19:24.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.789+0000 7ff85f351700 1 -- 172.21.15.49:0/1727521070 wait complete. 2023-11-30T17:19:24.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.790+0000 7ff85f351700 1 Processor -- start 2023-11-30T17:19:24.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.790+0000 7ff85f351700 1 -- start start 2023-11-30T17:19:24.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.790+0000 7ff85f351700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8580c2b90 0x7ff8580be0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:24.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.790+0000 7ff85f351700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff85814eb50 0x7ff85814b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:24.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.791+0000 7ff85f351700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff858155430 0x7ff8580ac360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:24.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.791+0000 7ff85f351700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff858158610 con 0x7ff858155430 2023-11-30T17:19:24.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.791+0000 7ff85f351700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8581582e0 con 0x7ff8580c2b90 2023-11-30T17:19:24.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.791+0000 7ff85f351700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8580acdb0 con 0x7ff85814eb50 2023-11-30T17:19:24.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.791+0000 7ff85eb50700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff858155430 0x7ff8580ac360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:24.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.791+0000 7ff85eb50700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff858155430 0x7ff8580ac360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44360/0 (socket says 172.21.15.49:44360) 2023-11-30T17:19:24.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.791+0000 7ff85eb50700 1 -- 172.21.15.49:0/396957855 learned_addr learned my addr 172.21.15.49:0/396957855 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:24.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.791+0000 7ff85e34f700 1 --2- 172.21.15.49:0/396957855 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8580c2b90 0x7ff8580be0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:24.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.791+0000 7ff85db4e700 1 --2- 172.21.15.49:0/396957855 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff85814eb50 0x7ff85814b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:24.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.791+0000 7ff85eb50700 1 -- 172.21.15.49:0/396957855 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff85814eb50 msgr2=0x7ff85814b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:24.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.791+0000 7ff85eb50700 1 --2- 172.21.15.49:0/396957855 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff85814eb50 0x7ff85814b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:24.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.791+0000 7ff85eb50700 1 -- 172.21.15.49:0/396957855 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8580c2b90 msgr2=0x7ff8580be0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:24.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.791+0000 7ff85eb50700 1 --2- 172.21.15.49:0/396957855 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8580c2b90 0x7ff8580be0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:24.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.791+0000 7ff85eb50700 1 -- 172.21.15.49:0/396957855 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff848009a20 con 0x7ff858155430 2023-11-30T17:19:24.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.791+0000 7ff85db4e700 1 --2- 172.21.15.49:0/396957855 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff85814eb50 0x7ff85814b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:19:24.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.791+0000 7ff85e34f700 1 --2- 172.21.15.49:0/396957855 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8580c2b90 0x7ff8580be0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:19:24.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.791+0000 7ff85eb50700 1 --2- 172.21.15.49:0/396957855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff858155430 0x7ff8580ac360 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7ff850009440 tx=0x7ff850006e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:24.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.791+0000 7ff8567fc700 1 -- 172.21.15.49:0/396957855 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff850013460 con 0x7ff858155430 2023-11-30T17:19:24.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.791+0000 7ff8567fc700 1 -- 172.21.15.49:0/396957855 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8500135e0 con 0x7ff858155430 2023-11-30T17:19:24.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.791+0000 7ff85f351700 1 -- 172.21.15.49:0/396957855 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8580ad090 con 0x7ff858155430 2023-11-30T17:19:24.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.791+0000 7ff8567fc700 1 -- 172.21.15.49:0/396957855 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8500139a0 con 0x7ff858155430 2023-11-30T17:19:24.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.791+0000 7ff85f351700 1 -- 172.21.15.49:0/396957855 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff85814b510 con 0x7ff858155430 2023-11-30T17:19:24.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.792+0000 7ff85f351700 1 -- 172.21.15.49:0/396957855 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff858158780 con 0x7ff858155430 2023-11-30T17:19:24.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.792+0000 7ff8567fc700 1 -- 172.21.15.49:0/396957855 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7ff850013d50 con 0x7ff858155430 2023-11-30T17:19:24.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.793+0000 7ff8567fc700 1 --2- 172.21.15.49:0/396957855 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff84405f2c0 0x7ff844061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:24.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.793+0000 7ff8567fc700 1 -- 172.21.15.49:0/396957855 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7ff850079e70 con 0x7ff858155430 2023-11-30T17:19:24.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.793+0000 7ff85e34f700 1 --2- 172.21.15.49:0/396957855 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff84405f2c0 0x7ff844061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:24.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.793+0000 7ff85e34f700 1 --2- 172.21.15.49:0/396957855 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff84405f2c0 0x7ff844061780 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7ff848009e60 tx=0x7ff848009780).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:24.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.797+0000 7ff8567fc700 1 -- 172.21.15.49:0/396957855 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff85004aef0 con 0x7ff858155430 2023-11-30T17:19:24.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.997+0000 7ff85f351700 1 -- 172.21.15.49:0/396957855 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff85806c7c0 con 0x7ff84405f2c0 2023-11-30T17:19:25.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:24.999+0000 7ff8567fc700 1 -- 172.21.15.49:0/396957855 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7ff85806c7c0 con 0x7ff84405f2c0 2023-11-30T17:19:25.002 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:19:25.002 INFO:teuthology.orchestra.run.smithi049.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-11-30T00:00:00", "created": "2023-11-30T17:08:24", "first": "2023-11-30T17:09:00", "last": "2023-11-30T17:19:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-30T17:19:25.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.001+0000 7ff85f351700 1 -- 172.21.15.49:0/396957855 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff84405f2c0 msgr2=0x7ff844061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:25.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.001+0000 7ff85f351700 1 --2- 172.21.15.49:0/396957855 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff84405f2c0 0x7ff844061780 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7ff848009e60 tx=0x7ff848009780).stop 2023-11-30T17:19:25.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.001+0000 7ff85f351700 1 -- 172.21.15.49:0/396957855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff858155430 msgr2=0x7ff8580ac360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:25.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.001+0000 7ff85f351700 1 --2- 172.21.15.49:0/396957855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff858155430 0x7ff8580ac360 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7ff850009440 tx=0x7ff850006e70).stop 2023-11-30T17:19:25.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.001+0000 7ff85f351700 1 -- 172.21.15.49:0/396957855 shutdown_connections 2023-11-30T17:19:25.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.001+0000 7ff85f351700 1 --2- 172.21.15.49:0/396957855 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff84405f2c0 0x7ff844061780 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:25.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.001+0000 7ff85f351700 1 --2- 172.21.15.49:0/396957855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff858155430 0x7ff8580ac360 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:25.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.001+0000 7ff85f351700 1 --2- 172.21.15.49:0/396957855 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8580c2b90 0x7ff8580be0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:25.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.001+0000 7ff85f351700 1 --2- 172.21.15.49:0/396957855 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff85814eb50 0x7ff85814b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:25.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.001+0000 7ff85f351700 1 -- 172.21.15.49:0/396957855 >> 172.21.15.49:0/396957855 conn(0x7ff8580c3f40 msgr2=0x7ff858152d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:25.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.001+0000 7ff85f351700 1 -- 172.21.15.49:0/396957855 shutdown_connections 2023-11-30T17:19:25.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.001+0000 7ff85f351700 1 -- 172.21.15.49:0/396957855 wait complete. 2023-11-30T17:19:25.016 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-11-30T00:00:00", "created": "2023-11-30T17:08:24", "first": "2023-11-30T17:09:00", "last": "2023-11-30T17:19:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-30T17:19:25.016 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir4', 'rel_path': '/snap_test_dir1/dir4', 'schedule': '1M', 'retention': {}, 'start': '2023-11-30T00:00:00', 'created': '2023-11-30T17:08:24', 'first': '2023-11-30T17:09:00', 'last': '2023-11-30T17:19:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-11-30T17:19:25.016 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-11-30T17:19:25.016 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-11-30T17:19:25.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:25.016 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-11-30T17:19:25.033 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_09_00_UTC 2023-11-30T17:19:25.033 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_10_00_UTC 2023-11-30T17:19:25.033 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_11_00_UTC 2023-11-30T17:19:25.034 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_12_00_UTC 2023-11-30T17:19:25.034 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_13_00_UTC 2023-11-30T17:19:25.034 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_14_00_UTC 2023-11-30T17:19:25.034 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_15_00_UTC 2023-11-30T17:19:25.034 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_16_00_UTC 2023-11-30T17:19:25.034 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_17_00_UTC 2023-11-30T17:19:25.034 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_18_00_UTC 2023-11-30T17:19:25.034 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_19_00_UTC 2023-11-30T17:19:25.034 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-11-30-17_09_00_UTC', 'scheduled-2023-11-30-17_10_00_UTC', 'scheduled-2023-11-30-17_11_00_UTC', 'scheduled-2023-11-30-17_12_00_UTC', 'scheduled-2023-11-30-17_13_00_UTC', 'scheduled-2023-11-30-17_14_00_UTC', 'scheduled-2023-11-30-17_15_00_UTC', 'scheduled-2023-11-30-17_16_00_UTC', 'scheduled-2023-11-30-17_17_00_UTC', 'scheduled-2023-11-30-17_18_00_UTC', 'scheduled-2023-11-30-17_19_00_UTC'] 2023-11-30T17:19:25.035 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir5 2023-11-30T17:19:25.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.191+0000 7fb41d9e1700 1 Processor -- start 2023-11-30T17:19:25.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.191+0000 7fb41d9e1700 1 -- start start 2023-11-30T17:19:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.192+0000 7fb41d9e1700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb41813acd0 0x7fb41813b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.192+0000 7fb41d9e1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4180c6770 0x7fb4180c7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:25.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.192+0000 7fb41d9e1700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb418156d50 con 0x7fb41813b660 2023-11-30T17:19:25.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.192+0000 7fb41d9e1700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb418156140 con 0x7fb41813acd0 2023-11-30T17:19:25.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.192+0000 7fb41d9e1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb418156420 con 0x7fb4180c6770 2023-11-30T17:19:25.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.192+0000 7fb4167fc700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb41813b660 0x7fb4180c6060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46666/0 (socket says 172.21.15.49:46666) 2023-11-30T17:19:25.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.192+0000 7fb4167fc700 1 -- 172.21.15.49:0/2283717534 learned_addr learned my addr 172.21.15.49:0/2283717534 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:25.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.193+0000 7fb4177fe700 1 --2- 172.21.15.49:0/2283717534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4180c6770 0x7fb4180c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:25.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.193+0000 7fb416ffd700 1 --2- 172.21.15.49:0/2283717534 >> v2:172.21.15.115:3300/0 conn(0x7fb41813acd0 0x7fb41813b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:25.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.193+0000 7fb415ffb700 1 -- 172.21.15.49:0/2283717534 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3455760510 0 0) 0x7fb418156d50 con 0x7fb41813b660 2023-11-30T17:19:25.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.193+0000 7fb415ffb700 1 -- 172.21.15.49:0/2283717534 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4040033f0 con 0x7fb41813b660 2023-11-30T17:19:25.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.193+0000 7fb4177fe700 1 -- 172.21.15.49:0/2283717534 >> v2:172.21.15.115:3300/0 conn(0x7fb41813acd0 msgr2=0x7fb41813b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:25.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.193+0000 7fb4177fe700 1 --2- 172.21.15.49:0/2283717534 >> v2:172.21.15.115:3300/0 conn(0x7fb41813acd0 0x7fb41813b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:25.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.193+0000 7fb4177fe700 1 -- 172.21.15.49:0/2283717534 >> v1:172.21.15.49:6789/0 conn(0x7fb41813b660 legacy=0x7fb4180c6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:25.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.193+0000 7fb4177fe700 1 -- 172.21.15.49:0/2283717534 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb418156700 con 0x7fb4180c6770 2023-11-30T17:19:25.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.193+0000 7fb416ffd700 1 --2- 172.21.15.49:0/2283717534 >> v2:172.21.15.115:3300/0 conn(0x7fb41813acd0 0x7fb41813b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:19:25.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.193+0000 7fb4177fe700 1 --2- 172.21.15.49:0/2283717534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4180c6770 0x7fb4180c7100 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fb410009760 tx=0x7fb410009060).ready entity=mon.2 client_cookie=26862749c8e2a28f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.193+0000 7fb415ffb700 1 -- 172.21.15.49:0/2283717534 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4100090d0 con 0x7fb4180c6770 2023-11-30T17:19:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.193+0000 7fb415ffb700 1 -- 172.21.15.49:0/2283717534 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41000d4a0 con 0x7fb4180c6770 2023-11-30T17:19:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.193+0000 7fb415ffb700 1 -- 172.21.15.49:0/2283717534 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41000d820 con 0x7fb4180c6770 2023-11-30T17:19:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.194+0000 7fb41d9e1700 1 -- 172.21.15.49:0/2283717534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4180c6770 msgr2=0x7fb4180c7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.194+0000 7fb41d9e1700 1 --2- 172.21.15.49:0/2283717534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4180c6770 0x7fb4180c7100 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fb410009760 tx=0x7fb410009060).stop 2023-11-30T17:19:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.194+0000 7fb41d9e1700 1 -- 172.21.15.49:0/2283717534 shutdown_connections 2023-11-30T17:19:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.194+0000 7fb41d9e1700 1 --2- 172.21.15.49:0/2283717534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4180c6770 0x7fb4180c7100 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.194+0000 7fb41d9e1700 1 --2- 172.21.15.49:0/2283717534 >> v2:172.21.15.115:3300/0 conn(0x7fb41813acd0 0x7fb41813b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.194+0000 7fb41d9e1700 1 -- 172.21.15.49:0/2283717534 >> 172.21.15.49:0/2283717534 conn(0x7fb4180628f0 msgr2=0x7fb418062d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.194+0000 7fb41d9e1700 1 -- 172.21.15.49:0/2283717534 shutdown_connections 2023-11-30T17:19:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.194+0000 7fb41d9e1700 1 -- 172.21.15.49:0/2283717534 wait complete. 2023-11-30T17:19:25.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.195+0000 7fb41d9e1700 1 Processor -- start 2023-11-30T17:19:25.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.195+0000 7fb41d9e1700 1 -- start start 2023-11-30T17:19:25.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.196+0000 7fb41d9e1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4180c6770 0x7fb418153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:25.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.196+0000 7fb41d9e1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb41813acd0 0x7fb418137c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:25.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.196+0000 7fb41d9e1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb41813b660 0x7fb418155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.196+0000 7fb41d9e1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb418154180 con 0x7fb41813b660 2023-11-30T17:19:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.196+0000 7fb41d9e1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb418154fa0 con 0x7fb41813acd0 2023-11-30T17:19:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.196+0000 7fb41d9e1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4181536f0 con 0x7fb4180c6770 2023-11-30T17:19:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.196+0000 7fb4177fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb41813b660 0x7fb418155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.196+0000 7fb4177fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb41813b660 0x7fb418155430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44372/0 (socket says 172.21.15.49:44372) 2023-11-30T17:19:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.196+0000 7fb4177fe700 1 -- 172.21.15.49:0/1651110435 learned_addr learned my addr 172.21.15.49:0/1651110435 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.196+0000 7fb416ffd700 1 --2- 172.21.15.49:0/1651110435 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4180c6770 0x7fb418153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.196+0000 7fb4167fc700 1 --2- 172.21.15.49:0/1651110435 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb41813acd0 0x7fb418137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.196+0000 7fb4177fe700 1 -- 172.21.15.49:0/1651110435 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4180c6770 msgr2=0x7fb418153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.196+0000 7fb4177fe700 1 --2- 172.21.15.49:0/1651110435 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4180c6770 0x7fb418153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.196+0000 7fb4177fe700 1 -- 172.21.15.49:0/1651110435 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb41813acd0 msgr2=0x7fb418137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.196+0000 7fb4177fe700 1 --2- 172.21.15.49:0/1651110435 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb41813acd0 0x7fb418137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.196+0000 7fb4177fe700 1 -- 172.21.15.49:0/1651110435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb408009a20 con 0x7fb41813b660 2023-11-30T17:19:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.197+0000 7fb4177fe700 1 --2- 172.21.15.49:0/1651110435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb41813b660 0x7fb418155430 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fb418156560 tx=0x7fb410016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.197+0000 7fb40effd700 1 -- 172.21.15.49:0/1651110435 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb410009d80 con 0x7fb41813b660 2023-11-30T17:19:25.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.197+0000 7fb40effd700 1 -- 172.21.15.49:0/1651110435 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb410012c70 con 0x7fb41813b660 2023-11-30T17:19:25.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.197+0000 7fb41d9e1700 1 -- 172.21.15.49:0/1651110435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4100092a0 con 0x7fb41813b660 2023-11-30T17:19:25.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.197+0000 7fb40effd700 1 -- 172.21.15.49:0/1651110435 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41001c420 con 0x7fb41813b660 2023-11-30T17:19:25.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.197+0000 7fb41d9e1700 1 -- 172.21.15.49:0/1651110435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4181546b0 con 0x7fb41813b660 2023-11-30T17:19:25.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.198+0000 7fb41d9e1700 1 -- 172.21.15.49:0/1651110435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb418155110 con 0x7fb41813b660 2023-11-30T17:19:25.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.198+0000 7fb40effd700 1 -- 172.21.15.49:0/1651110435 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fb41001c810 con 0x7fb41813b660 2023-11-30T17:19:25.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.198+0000 7fb40effd700 1 --2- 172.21.15.49:0/1651110435 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb3f805f2c0 0x7fb3f8061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:25.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.199+0000 7fb40effd700 1 -- 172.21.15.49:0/1651110435 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fb41007bc10 con 0x7fb41813b660 2023-11-30T17:19:25.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.199+0000 7fb416ffd700 1 --2- 172.21.15.49:0/1651110435 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb3f805f2c0 0x7fb3f8061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:25.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.199+0000 7fb416ffd700 1 --2- 172.21.15.49:0/1651110435 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb3f805f2c0 0x7fb3f8061780 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fb4080099f0 tx=0x7fb40800b040).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:25.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.203+0000 7fb40effd700 1 -- 172.21.15.49:0/1651110435 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb41004cc90 con 0x7fb41813b660 2023-11-30T17:19:25.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.402+0000 7fb41d9e1700 1 -- 172.21.15.49:0/1651110435 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb41806c860 con 0x7fb3f805f2c0 2023-11-30T17:19:25.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.403+0000 7fb40effd700 1 -- 172.21.15.49:0/1651110435 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fb41806c860 con 0x7fb3f805f2c0 2023-11-30T17:19:25.406 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:19:25.406 INFO:teuthology.orchestra.run.smithi049.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-11-30T00:00:00", "created": "2023-11-30T17:08:25", "first": "2023-11-30T17:09:00", "last": "2023-11-30T17:19:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-30T17:19:25.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.405+0000 7fb41d9e1700 1 -- 172.21.15.49:0/1651110435 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb3f805f2c0 msgr2=0x7fb3f8061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:25.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.405+0000 7fb41d9e1700 1 --2- 172.21.15.49:0/1651110435 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb3f805f2c0 0x7fb3f8061780 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fb4080099f0 tx=0x7fb40800b040).stop 2023-11-30T17:19:25.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.405+0000 7fb41d9e1700 1 -- 172.21.15.49:0/1651110435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb41813b660 msgr2=0x7fb418155430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:25.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.405+0000 7fb41d9e1700 1 --2- 172.21.15.49:0/1651110435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb41813b660 0x7fb418155430 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fb418156560 tx=0x7fb410016000).stop 2023-11-30T17:19:25.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.405+0000 7fb41d9e1700 1 -- 172.21.15.49:0/1651110435 shutdown_connections 2023-11-30T17:19:25.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.405+0000 7fb41d9e1700 1 --2- 172.21.15.49:0/1651110435 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb3f805f2c0 0x7fb3f8061780 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:25.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.405+0000 7fb41d9e1700 1 --2- 172.21.15.49:0/1651110435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb41813b660 0x7fb418155430 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:25.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.405+0000 7fb41d9e1700 1 --2- 172.21.15.49:0/1651110435 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4180c6770 0x7fb418153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:25.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.405+0000 7fb41d9e1700 1 --2- 172.21.15.49:0/1651110435 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb41813acd0 0x7fb418137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:25.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.405+0000 7fb41d9e1700 1 -- 172.21.15.49:0/1651110435 >> 172.21.15.49:0/1651110435 conn(0x7fb4180628f0 msgr2=0x7fb4180bf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:25.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.405+0000 7fb41d9e1700 1 -- 172.21.15.49:0/1651110435 shutdown_connections 2023-11-30T17:19:25.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.405+0000 7fb41d9e1700 1 -- 172.21.15.49:0/1651110435 wait complete. 2023-11-30T17:19:25.419 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-11-30T00:00:00", "created": "2023-11-30T17:08:25", "first": "2023-11-30T17:09:00", "last": "2023-11-30T17:19:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-30T17:19:25.419 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir5', 'rel_path': '/snap_test_dir1/dir5', 'schedule': '1M', 'retention': {}, 'start': '2023-11-30T00:00:00', 'created': '2023-11-30T17:08:25', 'first': '2023-11-30T17:09:00', 'last': '2023-11-30T17:19:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-11-30T17:19:25.419 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-11-30T17:19:25.419 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-11-30T17:19:25.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:25.420 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-11-30T17:19:25.436 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_09_00_UTC 2023-11-30T17:19:25.436 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_10_00_UTC 2023-11-30T17:19:25.436 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_11_00_UTC 2023-11-30T17:19:25.436 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_12_00_UTC 2023-11-30T17:19:25.436 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_13_00_UTC 2023-11-30T17:19:25.437 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_14_00_UTC 2023-11-30T17:19:25.437 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_15_00_UTC 2023-11-30T17:19:25.437 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_16_00_UTC 2023-11-30T17:19:25.437 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_17_00_UTC 2023-11-30T17:19:25.437 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_18_00_UTC 2023-11-30T17:19:25.437 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_19_00_UTC 2023-11-30T17:19:25.437 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-11-30-17_09_00_UTC', 'scheduled-2023-11-30-17_10_00_UTC', 'scheduled-2023-11-30-17_11_00_UTC', 'scheduled-2023-11-30-17_12_00_UTC', 'scheduled-2023-11-30-17_13_00_UTC', 'scheduled-2023-11-30-17_14_00_UTC', 'scheduled-2023-11-30-17_15_00_UTC', 'scheduled-2023-11-30-17_16_00_UTC', 'scheduled-2023-11-30-17_17_00_UTC', 'scheduled-2023-11-30-17_18_00_UTC', 'scheduled-2023-11-30-17_19_00_UTC'] 2023-11-30T17:19:25.437 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir6 2023-11-30T17:19:25.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.594+0000 7fe6ddd41700 1 Processor -- start 2023-11-30T17:19:25.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.594+0000 7fe6ddd41700 1 -- start start 2023-11-30T17:19:25.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.595+0000 7fe6ddd41700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6d8154530 0x7fe6d8154910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:25.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.595+0000 7fe6ddd41700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe6d80a7ff0 0x7fe6d80c8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:25.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.595+0000 7fe6ddd41700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d80c6630 con 0x7fe6d80aa220 2023-11-30T17:19:25.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.595+0000 7fe6ddd41700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d80c6390 con 0x7fe6d80a7ff0 2023-11-30T17:19:25.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.595+0000 7fe6ddd41700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d80a8470 con 0x7fe6d8154530 2023-11-30T17:19:25.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.595+0000 7fe6d7fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe6d80aa220 0x7fe6d80c6ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46676/0 (socket says 172.21.15.49:46676) 2023-11-30T17:19:25.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.595+0000 7fe6d7fff700 1 -- 172.21.15.49:0/3789476629 learned_addr learned my addr 172.21.15.49:0/3789476629 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:25.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.596+0000 7fe6d6ffd700 1 --2- 172.21.15.49:0/3789476629 >> v2:172.21.15.115:3300/0 conn(0x7fe6d80a7ff0 0x7fe6d80c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:25.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.596+0000 7fe6d77fe700 1 --2- 172.21.15.49:0/3789476629 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6d8154530 0x7fe6d8154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:25.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.596+0000 7fe6d67fc700 1 -- 172.21.15.49:0/3789476629 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 236697763 0 0) 0x7fe6d80c6630 con 0x7fe6d80aa220 2023-11-30T17:19:25.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.596+0000 7fe6d67fc700 1 -- 172.21.15.49:0/3789476629 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6c00033f0 con 0x7fe6d80aa220 2023-11-30T17:19:25.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.596+0000 7fe6d67fc700 1 -- 172.21.15.49:0/3789476629 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 885162898 0 0) 0x7fe6c00033f0 con 0x7fe6d80aa220 2023-11-30T17:19:25.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.596+0000 7fe6d67fc700 1 -- 172.21.15.49:0/3789476629 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6d8154530 msgr2=0x7fe6d8154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:25.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.596+0000 7fe6d67fc700 1 --2- 172.21.15.49:0/3789476629 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6d8154530 0x7fe6d8154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:25.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.596+0000 7fe6d67fc700 1 -- 172.21.15.49:0/3789476629 >> v2:172.21.15.115:3300/0 conn(0x7fe6d80a7ff0 msgr2=0x7fe6d80c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:25.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.596+0000 7fe6d67fc700 1 --2- 172.21.15.49:0/3789476629 >> v2:172.21.15.115:3300/0 conn(0x7fe6d80a7ff0 0x7fe6d80c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:25.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.596+0000 7fe6d67fc700 1 -- 172.21.15.49:0/3789476629 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d8064230 con 0x7fe6d80aa220 2023-11-30T17:19:25.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.596+0000 7fe6d67fc700 1 -- 172.21.15.49:0/3789476629 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fe6d00017f0 con 0x7fe6d80aa220 2023-11-30T17:19:25.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.596+0000 7fe6d67fc700 1 -- 172.21.15.49:0/3789476629 >> v1:172.21.15.49:6789/0 conn(0x7fe6d80aa220 legacy=0x7fe6d80c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:25.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.596+0000 7fe6d67fc700 1 --2- 172.21.15.49:0/3789476629 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6d8154530 0x7fe6c00038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:25.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.596+0000 7fe6d67fc700 1 --2- 172.21.15.49:0/3789476629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6c0003e10 0x7fe6c0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:25.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.596+0000 7fe6d67fc700 1 --2- 172.21.15.49:0/3789476629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6c0004b80 0x7fe6c0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:25.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.596+0000 7fe6d67fc700 1 -- 172.21.15.49:0/3789476629 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d80c6390 con 0x7fe6c0003e10 2023-11-30T17:19:25.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.596+0000 7fe6d67fc700 1 -- 172.21.15.49:0/3789476629 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d80a8470 con 0x7fe6c0004b80 2023-11-30T17:19:25.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.596+0000 7fe6d67fc700 1 -- 172.21.15.49:0/3789476629 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c000b8e0 con 0x7fe6d8154530 2023-11-30T17:19:25.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.596+0000 7fe6d6ffd700 1 --2- 172.21.15.49:0/3789476629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6c0003e10 0x7fe6c0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:25.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.596+0000 7fe6d77fe700 1 --2- 172.21.15.49:0/3789476629 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6d8154530 0x7fe6c00038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:25.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.596+0000 7fe6d7fff700 1 --2- 172.21.15.49:0/3789476629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6c0004b80 0x7fe6c0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:25.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.597+0000 7fe6d6ffd700 1 -- 172.21.15.49:0/3789476629 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6d8154530 msgr2=0x7fe6c00038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:25.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.597+0000 7fe6d6ffd700 1 --2- 172.21.15.49:0/3789476629 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6d8154530 0x7fe6c00038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:25.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.597+0000 7fe6d6ffd700 1 -- 172.21.15.49:0/3789476629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6c0004b80 msgr2=0x7fe6c0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:25.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.597+0000 7fe6d6ffd700 1 --2- 172.21.15.49:0/3789476629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6c0004b80 0x7fe6c0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:25.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.597+0000 7fe6d6ffd700 1 -- 172.21.15.49:0/3789476629 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c00033f0 con 0x7fe6c0003e10 2023-11-30T17:19:25.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.597+0000 7fe6d6ffd700 1 --2- 172.21.15.49:0/3789476629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6c0003e10 0x7fe6c0004690 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fe6cc009a80 tx=0x7fe6cc009060).ready entity=mon.0 client_cookie=ddbcdc1fbd40ff2 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:25.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.597+0000 7fe6d67fc700 1 -- 172.21.15.49:0/3789476629 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc009430 con 0x7fe6c0003e10 2023-11-30T17:19:25.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.597+0000 7fe6d67fc700 1 -- 172.21.15.49:0/3789476629 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6cc00e640 con 0x7fe6c0003e10 2023-11-30T17:19:25.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.597+0000 7fe6d67fc700 1 -- 172.21.15.49:0/3789476629 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc00e9c0 con 0x7fe6c0003e10 2023-11-30T17:19:25.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.597+0000 7fe6ddd41700 1 -- 172.21.15.49:0/3789476629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6c0003e10 msgr2=0x7fe6c0004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:25.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.597+0000 7fe6ddd41700 1 --2- 172.21.15.49:0/3789476629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6c0003e10 0x7fe6c0004690 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fe6cc009a80 tx=0x7fe6cc009060).stop 2023-11-30T17:19:25.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.597+0000 7fe6d7fff700 1 -- 172.21.15.49:0/3789476629 reap_dead start 2023-11-30T17:19:25.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.597+0000 7fe6ddd41700 1 -- 172.21.15.49:0/3789476629 shutdown_connections 2023-11-30T17:19:25.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.597+0000 7fe6ddd41700 1 -- 172.21.15.49:0/3789476629 >> 172.21.15.49:0/3789476629 conn(0x7fe6d8094930 msgr2=0x7fe6d806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:25.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.597+0000 7fe6ddd41700 1 -- 172.21.15.49:0/3789476629 shutdown_connections 2023-11-30T17:19:25.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.597+0000 7fe6ddd41700 1 -- 172.21.15.49:0/3789476629 wait complete. 2023-11-30T17:19:25.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.599+0000 7fe6ddd41700 1 Processor -- start 2023-11-30T17:19:25.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.599+0000 7fe6ddd41700 1 -- start start 2023-11-30T17:19:25.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.599+0000 7fe6ddd41700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6c0003e10 0x7fe6d8146f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:25.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.599+0000 7fe6ddd41700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6d8147400 0x7fe6d80afe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:25.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.599+0000 7fe6ddd41700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6d80b0320 0x7fe6d8151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:25.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.599+0000 7fe6ddd41700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d8150bd0 con 0x7fe6c0003e10 2023-11-30T17:19:25.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.599+0000 7fe6ddd41700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d8150e20 con 0x7fe6d80b0320 2023-11-30T17:19:25.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.599+0000 7fe6ddd41700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d8151100 con 0x7fe6d8147400 2023-11-30T17:19:25.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.600+0000 7fe6d77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6c0003e10 0x7fe6d8146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:25.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.600+0000 7fe6d77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6c0003e10 0x7fe6d8146f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44378/0 (socket says 172.21.15.49:44378) 2023-11-30T17:19:25.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.600+0000 7fe6d77fe700 1 -- 172.21.15.49:0/2017082926 learned_addr learned my addr 172.21.15.49:0/2017082926 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:25.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.600+0000 7fe6d6ffd700 1 --2- 172.21.15.49:0/2017082926 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6d8147400 0x7fe6d80afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:25.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.600+0000 7fe6d7fff700 1 --2- 172.21.15.49:0/2017082926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6d80b0320 0x7fe6d8151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:25.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.600+0000 7fe6d77fe700 1 -- 172.21.15.49:0/2017082926 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6d8147400 msgr2=0x7fe6d80afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:25.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.600+0000 7fe6d77fe700 1 --2- 172.21.15.49:0/2017082926 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6d8147400 0x7fe6d80afe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:25.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.600+0000 7fe6d77fe700 1 -- 172.21.15.49:0/2017082926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6d80b0320 msgr2=0x7fe6d8151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:25.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.600+0000 7fe6d77fe700 1 --2- 172.21.15.49:0/2017082926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6d80b0320 0x7fe6d8151be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:25.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.600+0000 7fe6d77fe700 1 -- 172.21.15.49:0/2017082926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d81513e0 con 0x7fe6c0003e10 2023-11-30T17:19:25.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.600+0000 7fe6d77fe700 1 --2- 172.21.15.49:0/2017082926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6c0003e10 0x7fe6d8146f10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7fe6c80119f0 tx=0x7fe6c8006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:25.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.600+0000 7fe6bf7fe700 1 -- 172.21.15.49:0/2017082926 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c800f790 con 0x7fe6c0003e10 2023-11-30T17:19:25.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.600+0000 7fe6bf7fe700 1 -- 172.21.15.49:0/2017082926 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c800f8f0 con 0x7fe6c0003e10 2023-11-30T17:19:25.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.600+0000 7fe6ddd41700 1 -- 172.21.15.49:0/2017082926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d81516c0 con 0x7fe6c0003e10 2023-11-30T17:19:25.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.600+0000 7fe6bf7fe700 1 -- 172.21.15.49:0/2017082926 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c800fc70 con 0x7fe6c0003e10 2023-11-30T17:19:25.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.600+0000 7fe6ddd41700 1 -- 172.21.15.49:0/2017082926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d80ae3f0 con 0x7fe6c0003e10 2023-11-30T17:19:25.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.601+0000 7fe6ddd41700 1 -- 172.21.15.49:0/2017082926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d806c860 con 0x7fe6c0003e10 2023-11-30T17:19:25.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.601+0000 7fe6bf7fe700 1 -- 172.21.15.49:0/2017082926 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fe6c8014650 con 0x7fe6c0003e10 2023-11-30T17:19:25.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.602+0000 7fe6bf7fe700 1 --2- 172.21.15.49:0/2017082926 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe6c405f2c0 0x7fe6c4061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:25.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.602+0000 7fe6bf7fe700 1 -- 172.21.15.49:0/2017082926 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fe6c807ad50 con 0x7fe6c0003e10 2023-11-30T17:19:25.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.602+0000 7fe6d6ffd700 1 --2- 172.21.15.49:0/2017082926 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe6c405f2c0 0x7fe6c4061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:25.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.602+0000 7fe6d6ffd700 1 --2- 172.21.15.49:0/2017082926 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe6c405f2c0 0x7fe6c4061780 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fe6cc006d50 tx=0x7fe6cc01a000).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:25.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.606+0000 7fe6bf7fe700 1 -- 172.21.15.49:0/2017082926 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe6c804bdd0 con 0x7fe6c0003e10 2023-11-30T17:19:25.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.804+0000 7fe6ddd41700 1 -- 172.21.15.49:0/2017082926 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe6d8150f90 con 0x7fe6c405f2c0 2023-11-30T17:19:25.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.806+0000 7fe6bf7fe700 1 -- 172.21.15.49:0/2017082926 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fe6d8150f90 con 0x7fe6c405f2c0 2023-11-30T17:19:25.808 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:19:25.808 INFO:teuthology.orchestra.run.smithi049.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-11-30T00:00:00", "created": "2023-11-30T17:08:25", "first": "2023-11-30T17:09:00", "last": "2023-11-30T17:19:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-30T17:19:25.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.807+0000 7fe6ddd41700 1 -- 172.21.15.49:0/2017082926 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe6c405f2c0 msgr2=0x7fe6c4061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:25.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.807+0000 7fe6ddd41700 1 --2- 172.21.15.49:0/2017082926 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe6c405f2c0 0x7fe6c4061780 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fe6cc006d50 tx=0x7fe6cc01a000).stop 2023-11-30T17:19:25.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.807+0000 7fe6ddd41700 1 -- 172.21.15.49:0/2017082926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6c0003e10 msgr2=0x7fe6d8146f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:25.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.807+0000 7fe6ddd41700 1 --2- 172.21.15.49:0/2017082926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6c0003e10 0x7fe6d8146f10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7fe6c80119f0 tx=0x7fe6c8006f40).stop 2023-11-30T17:19:25.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.807+0000 7fe6ddd41700 1 -- 172.21.15.49:0/2017082926 shutdown_connections 2023-11-30T17:19:25.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.807+0000 7fe6ddd41700 1 --2- 172.21.15.49:0/2017082926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6d80b0320 0x7fe6d8151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:25.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.807+0000 7fe6ddd41700 1 --2- 172.21.15.49:0/2017082926 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe6c405f2c0 0x7fe6c4061780 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:25.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.807+0000 7fe6ddd41700 1 --2- 172.21.15.49:0/2017082926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6c0003e10 0x7fe6d8146f10 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:25.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.807+0000 7fe6ddd41700 1 --2- 172.21.15.49:0/2017082926 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6d8147400 0x7fe6d80afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:25.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.807+0000 7fe6ddd41700 1 -- 172.21.15.49:0/2017082926 >> 172.21.15.49:0/2017082926 conn(0x7fe6d8094930 msgr2=0x7fe6d80c69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:25.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.807+0000 7fe6ddd41700 1 -- 172.21.15.49:0/2017082926 shutdown_connections 2023-11-30T17:19:25.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.807+0000 7fe6ddd41700 1 -- 172.21.15.49:0/2017082926 wait complete. 2023-11-30T17:19:25.821 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-11-30T00:00:00", "created": "2023-11-30T17:08:25", "first": "2023-11-30T17:09:00", "last": "2023-11-30T17:19:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-30T17:19:25.822 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir6', 'rel_path': '/snap_test_dir1/dir6', 'schedule': '1M', 'retention': {}, 'start': '2023-11-30T00:00:00', 'created': '2023-11-30T17:08:25', 'first': '2023-11-30T17:09:00', 'last': '2023-11-30T17:19:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-11-30T17:19:25.822 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-11-30T17:19:25.822 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-11-30T17:19:25.822 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:25.822 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-11-30T17:19:25.839 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_09_00_UTC 2023-11-30T17:19:25.839 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_10_00_UTC 2023-11-30T17:19:25.840 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_11_00_UTC 2023-11-30T17:19:25.840 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_12_00_UTC 2023-11-30T17:19:25.840 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_13_00_UTC 2023-11-30T17:19:25.840 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_14_00_UTC 2023-11-30T17:19:25.840 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_15_00_UTC 2023-11-30T17:19:25.840 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_16_00_UTC 2023-11-30T17:19:25.841 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_17_00_UTC 2023-11-30T17:19:25.841 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_18_00_UTC 2023-11-30T17:19:25.841 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_19_00_UTC 2023-11-30T17:19:25.841 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-11-30-17_09_00_UTC', 'scheduled-2023-11-30-17_10_00_UTC', 'scheduled-2023-11-30-17_11_00_UTC', 'scheduled-2023-11-30-17_12_00_UTC', 'scheduled-2023-11-30-17_13_00_UTC', 'scheduled-2023-11-30-17_14_00_UTC', 'scheduled-2023-11-30-17_15_00_UTC', 'scheduled-2023-11-30-17_16_00_UTC', 'scheduled-2023-11-30-17_17_00_UTC', 'scheduled-2023-11-30-17_18_00_UTC', 'scheduled-2023-11-30-17_19_00_UTC'] 2023-11-30T17:19:25.841 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir7 2023-11-30T17:19:26.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.998+0000 7f44cc7fc700 1 Processor -- start 2023-11-30T17:19:26.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.998+0000 7f44cc7fc700 1 -- start start 2023-11-30T17:19:26.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.999+0000 7f44cc7fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c4154610 0x7f44c41582e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:26.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.999+0000 7f44cc7fc700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c4159210 con 0x7f44c40ab3b0 2023-11-30T17:19:26.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.999+0000 7f44cc7fc700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c40c0c70 con 0x7f44c40aa1c0 2023-11-30T17:19:26.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.999+0000 7f44cc7fc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c40c2110 con 0x7f44c4154610 2023-11-30T17:19:26.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.999+0000 7f44c9d97700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f44c40ab3b0 0x7f44c40c80c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46688/0 (socket says 172.21.15.49:46688) 2023-11-30T17:19:26.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.999+0000 7f44c9d97700 1 -- 172.21.15.49:0/2123497465 learned_addr learned my addr 172.21.15.49:0/2123497465 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:26.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.999+0000 7f44ca598700 1 --2- 172.21.15.49:0/2123497465 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c4154610 0x7f44c41582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:26.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.999+0000 7f44c9596700 1 -- 172.21.15.49:0/2123497465 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2693024905 0 0) 0x7f44c4159210 con 0x7f44c40ab3b0 2023-11-30T17:19:26.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.999+0000 7f44c9596700 1 -- 172.21.15.49:0/2123497465 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44ac0033f0 con 0x7f44c40ab3b0 2023-11-30T17:19:26.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.999+0000 7f44c9596700 1 -- 172.21.15.49:0/2123497465 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1639016935 0 0) 0x7f44c40c0c70 con 0x7f44c40aa1c0 2023-11-30T17:19:26.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.999+0000 7f44c9596700 1 -- 172.21.15.49:0/2123497465 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44c4159210 con 0x7f44c40aa1c0 2023-11-30T17:19:26.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.999+0000 7f44ca598700 1 -- 172.21.15.49:0/2123497465 >> v1:172.21.15.115:6789/0 conn(0x7f44c40aa1c0 legacy=0x7f44c40aa5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:26.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.999+0000 7f44ca598700 1 -- 172.21.15.49:0/2123497465 >> v1:172.21.15.49:6789/0 conn(0x7f44c40ab3b0 legacy=0x7f44c40c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:26.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.999+0000 7f44c9596700 1 -- 172.21.15.49:0/2123497465 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1416869557 0 0) 0x7f44ac0033f0 con 0x7f44c40ab3b0 2023-11-30T17:19:26.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.999+0000 7f44ca598700 1 -- 172.21.15.49:0/2123497465 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c4158970 con 0x7f44c4154610 2023-11-30T17:19:26.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:25.999+0000 7f44ca598700 1 --2- 172.21.15.49:0/2123497465 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c4154610 0x7f44c41582e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f44bc009790 tx=0x7f44bc009060).ready entity=mon.2 client_cookie=7d7664a9d9bde014 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:26.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.000+0000 7f44c9596700 1 -- 172.21.15.49:0/2123497465 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b8001470 con 0x7f44c4154610 2023-11-30T17:19:26.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.000+0000 7f44c9596700 1 -- 172.21.15.49:0/2123497465 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44bc011400 con 0x7f44c4154610 2023-11-30T17:19:26.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.000+0000 7f44c9596700 1 -- 172.21.15.49:0/2123497465 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc011780 con 0x7f44c4154610 2023-11-30T17:19:26.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.000+0000 7f44cc7fc700 1 -- 172.21.15.49:0/2123497465 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c4154610 msgr2=0x7f44c41582e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:26.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.000+0000 7f44cc7fc700 1 --2- 172.21.15.49:0/2123497465 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c4154610 0x7f44c41582e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f44bc009790 tx=0x7f44bc009060).stop 2023-11-30T17:19:26.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.000+0000 7f44cc7fc700 1 -- 172.21.15.49:0/2123497465 shutdown_connections 2023-11-30T17:19:26.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.000+0000 7f44cc7fc700 1 --2- 172.21.15.49:0/2123497465 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c4154610 0x7f44c41582e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:26.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.000+0000 7f44cc7fc700 1 -- 172.21.15.49:0/2123497465 >> 172.21.15.49:0/2123497465 conn(0x7f44c40655a0 msgr2=0x7f44c4069e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:26.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.000+0000 7f44cc7fc700 1 -- 172.21.15.49:0/2123497465 shutdown_connections 2023-11-30T17:19:26.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.000+0000 7f44cc7fc700 1 -- 172.21.15.49:0/2123497465 wait complete. 2023-11-30T17:19:26.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.001+0000 7f44cc7fc700 1 Processor -- start 2023-11-30T17:19:26.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.001+0000 7f44cc7fc700 1 -- start start 2023-11-30T17:19:26.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.002+0000 7f44cc7fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c40aa1c0 0x7f44c414d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:26.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.002+0000 7f44cc7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44c4154610 0x7f44c40c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:26.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.002+0000 7f44cc7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44c40c9560 0x7f44c40c2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:26.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.002+0000 7f44cc7fc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c414d560 con 0x7f44c4154610 2023-11-30T17:19:26.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.002+0000 7f44cc7fc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c40c9fa0 con 0x7f44c40c9560 2023-11-30T17:19:26.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.002+0000 7f44cc7fc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c40cae40 con 0x7f44c40aa1c0 2023-11-30T17:19:26.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.002+0000 7f44c9d97700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44c4154610 0x7f44c40c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:26.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.002+0000 7f44c9d97700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44c4154610 0x7f44c40c9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44390/0 (socket says 172.21.15.49:44390) 2023-11-30T17:19:26.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.002+0000 7f44c9d97700 1 -- 172.21.15.49:0/3625015459 learned_addr learned my addr 172.21.15.49:0/3625015459 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:26.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.003+0000 7f44ca598700 1 --2- 172.21.15.49:0/3625015459 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c40aa1c0 0x7f44c414d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:26.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.003+0000 7f44cad99700 1 --2- 172.21.15.49:0/3625015459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44c40c9560 0x7f44c40c2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:26.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.003+0000 7f44c9d97700 1 -- 172.21.15.49:0/3625015459 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c40aa1c0 msgr2=0x7f44c414d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:26.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.003+0000 7f44c9d97700 1 --2- 172.21.15.49:0/3625015459 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c40aa1c0 0x7f44c414d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:26.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.003+0000 7f44c9d97700 1 -- 172.21.15.49:0/3625015459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44c40c9560 msgr2=0x7f44c40c2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:26.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.003+0000 7f44c9d97700 1 --2- 172.21.15.49:0/3625015459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44c40c9560 0x7f44c40c2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:26.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.003+0000 7f44c9d97700 1 -- 172.21.15.49:0/3625015459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44bc0092a0 con 0x7f44c4154610 2023-11-30T17:19:26.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.003+0000 7f44c9d97700 1 --2- 172.21.15.49:0/3625015459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44c4154610 0x7f44c40c9070 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f44b800c790 tx=0x7f44b8001560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:26.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.003+0000 7f44c27fc700 1 -- 172.21.15.49:0/3625015459 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b8007320 con 0x7f44c4154610 2023-11-30T17:19:26.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.003+0000 7f44c27fc700 1 -- 172.21.15.49:0/3625015459 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b80074a0 con 0x7f44c4154610 2023-11-30T17:19:26.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.003+0000 7f44cc7fc700 1 -- 172.21.15.49:0/3625015459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c40c99e0 con 0x7f44c4154610 2023-11-30T17:19:26.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.003+0000 7f44c27fc700 1 -- 172.21.15.49:0/3625015459 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b80059b0 con 0x7f44c4154610 2023-11-30T17:19:26.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.003+0000 7f44cc7fc700 1 -- 172.21.15.49:0/3625015459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c40caad0 con 0x7f44c4154610 2023-11-30T17:19:26.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.004+0000 7f44cc7fc700 1 -- 172.21.15.49:0/3625015459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c406c860 con 0x7f44c4154610 2023-11-30T17:19:26.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.004+0000 7f44c27fc700 1 -- 172.21.15.49:0/3625015459 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f44b8005d20 con 0x7f44c4154610 2023-11-30T17:19:26.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.005+0000 7f44c27fc700 1 --2- 172.21.15.49:0/3625015459 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f44b005f2c0 0x7f44b0061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:26.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.005+0000 7f44c27fc700 1 -- 172.21.15.49:0/3625015459 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f44b807a4b0 con 0x7f44c4154610 2023-11-30T17:19:26.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.005+0000 7f44ca598700 1 --2- 172.21.15.49:0/3625015459 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f44b005f2c0 0x7f44b0061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:26.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.005+0000 7f44ca598700 1 --2- 172.21.15.49:0/3625015459 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f44b005f2c0 0x7f44b0061780 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f44c4157360 tx=0x7f44bc016000).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:26.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.009+0000 7f44c27fc700 1 -- 172.21.15.49:0/3625015459 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f44b804b530 con 0x7f44c4154610 2023-11-30T17:19:26.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.205+0000 7f44cc7fc700 1 -- 172.21.15.49:0/3625015459 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f44c40c02f0 con 0x7f44b005f2c0 2023-11-30T17:19:26.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.207+0000 7f44c27fc700 1 -- 172.21.15.49:0/3625015459 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f44c40c02f0 con 0x7f44b005f2c0 2023-11-30T17:19:26.209 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:19:26.209 INFO:teuthology.orchestra.run.smithi049.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-11-30T00:00:00", "created": "2023-11-30T17:08:26", "first": "2023-11-30T17:09:00", "last": "2023-11-30T17:19:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-30T17:19:26.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.208+0000 7f44cc7fc700 1 -- 172.21.15.49:0/3625015459 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f44b005f2c0 msgr2=0x7f44b0061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:26.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.208+0000 7f44cc7fc700 1 --2- 172.21.15.49:0/3625015459 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f44b005f2c0 0x7f44b0061780 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f44c4157360 tx=0x7f44bc016000).stop 2023-11-30T17:19:26.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.208+0000 7f44cc7fc700 1 -- 172.21.15.49:0/3625015459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44c4154610 msgr2=0x7f44c40c9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:26.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.208+0000 7f44cc7fc700 1 --2- 172.21.15.49:0/3625015459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44c4154610 0x7f44c40c9070 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f44b800c790 tx=0x7f44b8001560).stop 2023-11-30T17:19:26.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.208+0000 7f44cc7fc700 1 -- 172.21.15.49:0/3625015459 shutdown_connections 2023-11-30T17:19:26.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.208+0000 7f44cc7fc700 1 --2- 172.21.15.49:0/3625015459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44c40c9560 0x7f44c40c2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:26.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.208+0000 7f44cc7fc700 1 --2- 172.21.15.49:0/3625015459 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c40aa1c0 0x7f44c414d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:26.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.208+0000 7f44cc7fc700 1 --2- 172.21.15.49:0/3625015459 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f44b005f2c0 0x7f44b0061780 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:26.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.208+0000 7f44cc7fc700 1 --2- 172.21.15.49:0/3625015459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44c4154610 0x7f44c40c9070 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:26.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.208+0000 7f44cc7fc700 1 -- 172.21.15.49:0/3625015459 >> 172.21.15.49:0/3625015459 conn(0x7f44c40655a0 msgr2=0x7f44c40ad110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:26.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.208+0000 7f44cc7fc700 1 -- 172.21.15.49:0/3625015459 shutdown_connections 2023-11-30T17:19:26.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.208+0000 7f44cc7fc700 1 -- 172.21.15.49:0/3625015459 wait complete. 2023-11-30T17:19:26.222 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-11-30T00:00:00", "created": "2023-11-30T17:08:26", "first": "2023-11-30T17:09:00", "last": "2023-11-30T17:19:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-30T17:19:26.223 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir7', 'rel_path': '/snap_test_dir1/dir7', 'schedule': '1M', 'retention': {}, 'start': '2023-11-30T00:00:00', 'created': '2023-11-30T17:08:26', 'first': '2023-11-30T17:09:00', 'last': '2023-11-30T17:19:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-11-30T17:19:26.223 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-11-30T17:19:26.223 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-11-30T17:19:26.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:26.223 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-11-30T17:19:26.239 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_09_00_UTC 2023-11-30T17:19:26.239 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_10_00_UTC 2023-11-30T17:19:26.240 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_11_00_UTC 2023-11-30T17:19:26.240 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_12_00_UTC 2023-11-30T17:19:26.240 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_13_00_UTC 2023-11-30T17:19:26.240 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_14_00_UTC 2023-11-30T17:19:26.240 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_15_00_UTC 2023-11-30T17:19:26.240 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_16_00_UTC 2023-11-30T17:19:26.240 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_17_00_UTC 2023-11-30T17:19:26.240 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_18_00_UTC 2023-11-30T17:19:26.240 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_19_00_UTC 2023-11-30T17:19:26.240 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-11-30-17_09_00_UTC', 'scheduled-2023-11-30-17_10_00_UTC', 'scheduled-2023-11-30-17_11_00_UTC', 'scheduled-2023-11-30-17_12_00_UTC', 'scheduled-2023-11-30-17_13_00_UTC', 'scheduled-2023-11-30-17_14_00_UTC', 'scheduled-2023-11-30-17_15_00_UTC', 'scheduled-2023-11-30-17_16_00_UTC', 'scheduled-2023-11-30-17_17_00_UTC', 'scheduled-2023-11-30-17_18_00_UTC', 'scheduled-2023-11-30-17_19_00_UTC'] 2023-11-30T17:19:26.241 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir8 2023-11-30T17:19:26.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.399+0000 7fd5d5195700 1 Processor -- start 2023-11-30T17:19:26.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.399+0000 7fd5d5195700 1 -- start start 2023-11-30T17:19:26.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.400+0000 7fd5d5195700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd5d0154530 0x7fd5d0154910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:26.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.400+0000 7fd5d5195700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5d00aa220 0x7fd5d00aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:26.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.400+0000 7fd5d5195700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d00c6630 con 0x7fd5d00a7ff0 2023-11-30T17:19:26.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.400+0000 7fd5d5195700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d00c6390 con 0x7fd5d0154530 2023-11-30T17:19:26.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.400+0000 7fd5d5195700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d00aaba0 con 0x7fd5d00aa220 2023-11-30T17:19:26.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.400+0000 7fd5ced9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd5d0154530 0x7fd5d0154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:26.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.400+0000 7fd5ce59c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd5d00a7ff0 0x7fd5d00c8580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46700/0 (socket says 172.21.15.49:46700) 2023-11-30T17:19:26.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.400+0000 7fd5ce59c700 1 -- 172.21.15.49:0/1980312565 learned_addr learned my addr 172.21.15.49:0/1980312565 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:26.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.400+0000 7fd5cf59e700 1 --2- 172.21.15.49:0/1980312565 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5d00aa220 0x7fd5d00aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:26.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.400+0000 7fd5ced9d700 1 -- 172.21.15.49:0/1980312565 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5d00aa220 msgr2=0x7fd5d00aa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:26.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.400+0000 7fd5ced9d700 1 --2- 172.21.15.49:0/1980312565 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5d00aa220 0x7fd5d00aa6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:26.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.400+0000 7fd5ced9d700 1 -- 172.21.15.49:0/1980312565 >> v1:172.21.15.49:6789/0 conn(0x7fd5d00a7ff0 legacy=0x7fd5d00c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:26.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.400+0000 7fd5ced9d700 1 -- 172.21.15.49:0/1980312565 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d00a8470 con 0x7fd5d0154530 2023-11-30T17:19:26.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.400+0000 7fd5cdd9b700 1 -- 172.21.15.49:0/1980312565 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 380711140 0 0) 0x7fd5d00c6630 con 0x7fd5d00a7ff0 2023-11-30T17:19:26.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.400+0000 7fd5ced9d700 1 --2- 172.21.15.49:0/1980312565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5d0154530 0x7fd5d0154910 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fd5c0006fd0 tx=0x7fd5c0006f40).ready entity=mon.0 client_cookie=cf8ef402a633359d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:26.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.401+0000 7fd5cdd9b700 1 -- 172.21.15.49:0/1980312565 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0005880 con 0x7fd5d0154530 2023-11-30T17:19:26.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.401+0000 7fd5cdd9b700 1 -- 172.21.15.49:0/1980312565 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c00059e0 con 0x7fd5d0154530 2023-11-30T17:19:26.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.401+0000 7fd5cdd9b700 1 -- 172.21.15.49:0/1980312565 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0005d60 con 0x7fd5d0154530 2023-11-30T17:19:26.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.401+0000 7fd5d5195700 1 -- 172.21.15.49:0/1980312565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5d0154530 msgr2=0x7fd5d0154910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:26.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.401+0000 7fd5d5195700 1 --2- 172.21.15.49:0/1980312565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5d0154530 0x7fd5d0154910 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fd5c0006fd0 tx=0x7fd5c0006f40).stop 2023-11-30T17:19:26.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.401+0000 7fd5d5195700 1 -- 172.21.15.49:0/1980312565 shutdown_connections 2023-11-30T17:19:26.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.401+0000 7fd5d5195700 1 --2- 172.21.15.49:0/1980312565 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5d00aa220 0x7fd5d00aa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:26.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.401+0000 7fd5d5195700 1 --2- 172.21.15.49:0/1980312565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5d0154530 0x7fd5d0154910 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:26.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.401+0000 7fd5d5195700 1 -- 172.21.15.49:0/1980312565 >> 172.21.15.49:0/1980312565 conn(0x7fd5d0094930 msgr2=0x7fd5d006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:26.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.401+0000 7fd5d5195700 1 -- 172.21.15.49:0/1980312565 shutdown_connections 2023-11-30T17:19:26.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.401+0000 7fd5d5195700 1 -- 172.21.15.49:0/1980312565 wait complete. 2023-11-30T17:19:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.402+0000 7fd5d5195700 1 Processor -- start 2023-11-30T17:19:26.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.402+0000 7fd5d5195700 1 -- start start 2023-11-30T17:19:26.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.403+0000 7fd5d5195700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5d00a7ff0 0x7fd5d0146f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:26.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.403+0000 7fd5d5195700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5d00aa220 0x7fd5d0153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:26.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.403+0000 7fd5d5195700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5d0154530 0x7fd5d00a8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:26.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.403+0000 7fd5d5195700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d0168060 con 0x7fd5d00a7ff0 2023-11-30T17:19:26.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.403+0000 7fd5d5195700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d0168340 con 0x7fd5d00aa220 2023-11-30T17:19:26.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.403+0000 7fd5d5195700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d0168620 con 0x7fd5d0154530 2023-11-30T17:19:26.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.403+0000 7fd5ced9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5d00a7ff0 0x7fd5d0146f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:26.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.403+0000 7fd5ced9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5d00a7ff0 0x7fd5d0146f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44412/0 (socket says 172.21.15.49:44412) 2023-11-30T17:19:26.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.403+0000 7fd5ced9d700 1 -- 172.21.15.49:0/981146011 learned_addr learned my addr 172.21.15.49:0/981146011 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:26.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.403+0000 7fd5cf59e700 1 --2- 172.21.15.49:0/981146011 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5d0154530 0x7fd5d00a8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:26.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.403+0000 7fd5ced9d700 1 -- 172.21.15.49:0/981146011 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5d0154530 msgr2=0x7fd5d00a8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:26.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.404+0000 7fd5ced9d700 1 --2- 172.21.15.49:0/981146011 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5d0154530 0x7fd5d00a8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:26.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.404+0000 7fd5ce59c700 1 --2- 172.21.15.49:0/981146011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5d00aa220 0x7fd5d0153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.404+0000 7fd5ced9d700 1 -- 172.21.15.49:0/981146011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5d00aa220 msgr2=0x7fd5d0153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.404+0000 7fd5ced9d700 1 --2- 172.21.15.49:0/981146011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5d00aa220 0x7fd5d0153240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.404+0000 7fd5ced9d700 1 -- 172.21.15.49:0/981146011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c0009250 con 0x7fd5d00a7ff0 2023-11-30T17:19:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.404+0000 7fd5ced9d700 1 --2- 172.21.15.49:0/981146011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5d00a7ff0 0x7fd5d0146f30 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fd5d006ae10 tx=0x7fd5c0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.404+0000 7fd5b6ffd700 1 -- 172.21.15.49:0/981146011 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c000b860 con 0x7fd5d00a7ff0 2023-11-30T17:19:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.404+0000 7fd5b6ffd700 1 -- 172.21.15.49:0/981146011 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c000b9c0 con 0x7fd5d00a7ff0 2023-11-30T17:19:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.404+0000 7fd5d5195700 1 -- 172.21.15.49:0/981146011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d0168900 con 0x7fd5d00a7ff0 2023-11-30T17:19:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.404+0000 7fd5b6ffd700 1 -- 172.21.15.49:0/981146011 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c000bd80 con 0x7fd5d00a7ff0 2023-11-30T17:19:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.404+0000 7fd5d5195700 1 -- 172.21.15.49:0/981146011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d0147420 con 0x7fd5d00a7ff0 2023-11-30T17:19:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.405+0000 7fd5d5195700 1 -- 172.21.15.49:0/981146011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d00ac7c0 con 0x7fd5d00a7ff0 2023-11-30T17:19:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.405+0000 7fd5b6ffd700 1 -- 172.21.15.49:0/981146011 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fd5c0011650 con 0x7fd5d00a7ff0 2023-11-30T17:19:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.406+0000 7fd5b6ffd700 1 --2- 172.21.15.49:0/981146011 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd5bc05f2c0 0x7fd5bc061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.406+0000 7fd5b6ffd700 1 -- 172.21.15.49:0/981146011 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fd5c007b510 con 0x7fd5d00a7ff0 2023-11-30T17:19:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.406+0000 7fd5ce59c700 1 --2- 172.21.15.49:0/981146011 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd5bc05f2c0 0x7fd5bc061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:26.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.406+0000 7fd5ce59c700 1 --2- 172.21.15.49:0/981146011 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd5bc05f2c0 0x7fd5bc061780 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fd5c4007fd0 tx=0x7fd5c4009040).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:26.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.410+0000 7fd5b6ffd700 1 -- 172.21.15.49:0/981146011 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd5c004c590 con 0x7fd5d00a7ff0 2023-11-30T17:19:26.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.610+0000 7fd5d5195700 1 -- 172.21.15.49:0/981146011 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd5d006c860 con 0x7fd5bc05f2c0 2023-11-30T17:19:26.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.612+0000 7fd5b6ffd700 1 -- 172.21.15.49:0/981146011 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fd5d006c860 con 0x7fd5bc05f2c0 2023-11-30T17:19:26.615 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:19:26.615 INFO:teuthology.orchestra.run.smithi049.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-11-30T00:00:00", "created": "2023-11-30T17:08:26", "first": "2023-11-30T17:09:00", "last": "2023-11-30T17:19:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-30T17:19:26.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.614+0000 7fd5d5195700 1 -- 172.21.15.49:0/981146011 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd5bc05f2c0 msgr2=0x7fd5bc061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:26.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.614+0000 7fd5d5195700 1 --2- 172.21.15.49:0/981146011 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd5bc05f2c0 0x7fd5bc061780 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fd5c4007fd0 tx=0x7fd5c4009040).stop 2023-11-30T17:19:26.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.614+0000 7fd5d5195700 1 -- 172.21.15.49:0/981146011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5d00a7ff0 msgr2=0x7fd5d0146f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:26.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.614+0000 7fd5d5195700 1 --2- 172.21.15.49:0/981146011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5d00a7ff0 0x7fd5d0146f30 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fd5d006ae10 tx=0x7fd5c0016000).stop 2023-11-30T17:19:26.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.614+0000 7fd5d5195700 1 -- 172.21.15.49:0/981146011 shutdown_connections 2023-11-30T17:19:26.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.614+0000 7fd5d5195700 1 --2- 172.21.15.49:0/981146011 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5d0154530 0x7fd5d00a8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:26.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.614+0000 7fd5d5195700 1 --2- 172.21.15.49:0/981146011 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd5bc05f2c0 0x7fd5bc061780 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:26.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.614+0000 7fd5d5195700 1 --2- 172.21.15.49:0/981146011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5d00a7ff0 0x7fd5d0146f30 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:26.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.614+0000 7fd5d5195700 1 --2- 172.21.15.49:0/981146011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5d00aa220 0x7fd5d0153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:26.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.614+0000 7fd5d5195700 1 -- 172.21.15.49:0/981146011 >> 172.21.15.49:0/981146011 conn(0x7fd5d0094930 msgr2=0x7fd5d0148e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:26.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.614+0000 7fd5d5195700 1 -- 172.21.15.49:0/981146011 shutdown_connections 2023-11-30T17:19:26.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.614+0000 7fd5d5195700 1 -- 172.21.15.49:0/981146011 wait complete. 2023-11-30T17:19:26.628 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-11-30T00:00:00", "created": "2023-11-30T17:08:26", "first": "2023-11-30T17:09:00", "last": "2023-11-30T17:19:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-30T17:19:26.629 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir8', 'rel_path': '/snap_test_dir1/dir8', 'schedule': '1M', 'retention': {}, 'start': '2023-11-30T00:00:00', 'created': '2023-11-30T17:08:26', 'first': '2023-11-30T17:09:00', 'last': '2023-11-30T17:19:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-11-30T17:19:26.629 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-11-30T17:19:26.629 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-11-30T17:19:26.629 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:26.629 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-11-30T17:19:26.646 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_09_00_UTC 2023-11-30T17:19:26.646 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_10_00_UTC 2023-11-30T17:19:26.646 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_11_00_UTC 2023-11-30T17:19:26.646 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_12_00_UTC 2023-11-30T17:19:26.646 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_13_00_UTC 2023-11-30T17:19:26.646 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_14_00_UTC 2023-11-30T17:19:26.646 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_15_00_UTC 2023-11-30T17:19:26.646 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_16_00_UTC 2023-11-30T17:19:26.646 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_17_00_UTC 2023-11-30T17:19:26.646 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_18_00_UTC 2023-11-30T17:19:26.646 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_19_00_UTC 2023-11-30T17:19:26.647 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-11-30-17_09_00_UTC', 'scheduled-2023-11-30-17_10_00_UTC', 'scheduled-2023-11-30-17_11_00_UTC', 'scheduled-2023-11-30-17_12_00_UTC', 'scheduled-2023-11-30-17_13_00_UTC', 'scheduled-2023-11-30-17_14_00_UTC', 'scheduled-2023-11-30-17_15_00_UTC', 'scheduled-2023-11-30-17_16_00_UTC', 'scheduled-2023-11-30-17_17_00_UTC', 'scheduled-2023-11-30-17_18_00_UTC', 'scheduled-2023-11-30-17_19_00_UTC'] 2023-11-30T17:19:26.647 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir9 2023-11-30T17:19:26.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.804+0000 7f5b7026b700 1 Processor -- start 2023-11-30T17:19:26.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.804+0000 7f5b7026b700 1 -- start start 2023-11-30T17:19:26.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.805+0000 7f5b7026b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5b68154910 0x7f5b680a7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:26.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.805+0000 7f5b7026b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5b680aa220 0x7f5b680aa690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:26.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.805+0000 7f5b7026b700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b680c6630 con 0x7f5b68154530 2023-11-30T17:19:26.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.805+0000 7f5b7026b700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b680c6390 con 0x7f5b680aa220 2023-11-30T17:19:26.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.805+0000 7f5b7026b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b680a84e0 con 0x7f5b68154910 2023-11-30T17:19:26.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.805+0000 7f5b6e007700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5b68154530 0x7f5b680c8580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46702/0 (socket says 172.21.15.49:46702) 2023-11-30T17:19:26.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.805+0000 7f5b6e808700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5b680aa220 0x7f5b680aa690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:26.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.805+0000 7f5b6e007700 1 -- 172.21.15.49:0/2635742631 learned_addr learned my addr 172.21.15.49:0/2635742631 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:26.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.806+0000 7f5b6d005700 1 -- 172.21.15.49:0/2635742631 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 336757986 0 0) 0x7f5b680c6630 con 0x7f5b68154530 2023-11-30T17:19:26.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.806+0000 7f5b6d005700 1 -- 172.21.15.49:0/2635742631 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b500033f0 con 0x7f5b68154530 2023-11-30T17:19:26.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.806+0000 7f5b6d806700 1 --2- 172.21.15.49:0/2635742631 >> v2:172.21.15.115:3300/0 conn(0x7f5b68154910 0x7f5b680a7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:26.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.806+0000 7f5b6e808700 1 -- 172.21.15.49:0/2635742631 >> v2:172.21.15.115:3300/0 conn(0x7f5b68154910 msgr2=0x7f5b680a7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:26.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.806+0000 7f5b6e808700 1 --2- 172.21.15.49:0/2635742631 >> v2:172.21.15.115:3300/0 conn(0x7f5b68154910 0x7f5b680a7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:26.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.806+0000 7f5b6e808700 1 -- 172.21.15.49:0/2635742631 >> v1:172.21.15.49:6789/0 conn(0x7f5b68154530 legacy=0x7f5b680c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:26.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.806+0000 7f5b6e808700 1 -- 172.21.15.49:0/2635742631 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b680aab80 con 0x7f5b680aa220 2023-11-30T17:19:26.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.806+0000 7f5b6d806700 1 --2- 172.21.15.49:0/2635742631 >> v2:172.21.15.115:3300/0 conn(0x7f5b68154910 0x7f5b680a7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:19:26.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.806+0000 7f5b6e808700 1 --2- 172.21.15.49:0/2635742631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b680aa220 0x7f5b680aa690 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f5b680adfd0 tx=0x7f5b58009780).ready entity=mon.0 client_cookie=a27b181374e96258 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:26.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.806+0000 7f5b6d005700 1 -- 172.21.15.49:0/2635742631 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5800e070 con 0x7f5b680aa220 2023-11-30T17:19:26.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.806+0000 7f5b6d005700 1 -- 172.21.15.49:0/2635742631 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5800bb60 con 0x7f5b680aa220 2023-11-30T17:19:26.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.806+0000 7f5b6d005700 1 -- 172.21.15.49:0/2635742631 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b58012410 con 0x7f5b680aa220 2023-11-30T17:19:26.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.806+0000 7f5b7026b700 1 -- 172.21.15.49:0/2635742631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b680aa220 msgr2=0x7f5b680aa690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:26.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.806+0000 7f5b7026b700 1 --2- 172.21.15.49:0/2635742631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b680aa220 0x7f5b680aa690 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f5b680adfd0 tx=0x7f5b58009780).stop 2023-11-30T17:19:26.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.807+0000 7f5b7026b700 1 -- 172.21.15.49:0/2635742631 shutdown_connections 2023-11-30T17:19:26.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.807+0000 7f5b7026b700 1 --2- 172.21.15.49:0/2635742631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b680aa220 0x7f5b680aa690 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:26.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.807+0000 7f5b7026b700 1 --2- 172.21.15.49:0/2635742631 >> v2:172.21.15.115:3300/0 conn(0x7f5b68154910 0x7f5b680a7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:26.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.807+0000 7f5b7026b700 1 -- 172.21.15.49:0/2635742631 >> 172.21.15.49:0/2635742631 conn(0x7f5b68094930 msgr2=0x7f5b6806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:26.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.807+0000 7f5b7026b700 1 -- 172.21.15.49:0/2635742631 shutdown_connections 2023-11-30T17:19:26.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.807+0000 7f5b7026b700 1 -- 172.21.15.49:0/2635742631 wait complete. 2023-11-30T17:19:26.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.808+0000 7f5b7026b700 1 Processor -- start 2023-11-30T17:19:26.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.808+0000 7f5b7026b700 1 -- start start 2023-11-30T17:19:26.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.808+0000 7f5b7026b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b680aa220 0x7f5b680c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:26.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.808+0000 7f5b7026b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b68154530 0x7f5b6814f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:26.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.808+0000 7f5b7026b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b68154910 0x7f5b6814f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:26.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.808+0000 7f5b7026b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6814fd70 con 0x7f5b680aa220 2023-11-30T17:19:26.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.809+0000 7f5b7026b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b680ac210 con 0x7f5b68154530 2023-11-30T17:19:26.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.809+0000 7f5b7026b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b680c4790 con 0x7f5b68154910 2023-11-30T17:19:26.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.809+0000 7f5b6e007700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b680aa220 0x7f5b680c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:26.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.809+0000 7f5b6e007700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b680aa220 0x7f5b680c3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44444/0 (socket says 172.21.15.49:44444) 2023-11-30T17:19:26.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.809+0000 7f5b6e007700 1 -- 172.21.15.49:0/3411516603 learned_addr learned my addr 172.21.15.49:0/3411516603 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:26.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.809+0000 7f5b6e808700 1 --2- 172.21.15.49:0/3411516603 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b68154910 0x7f5b6814f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:26.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.809+0000 7f5b6d806700 1 --2- 172.21.15.49:0/3411516603 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b68154530 0x7f5b6814f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:26.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.809+0000 7f5b6e007700 1 -- 172.21.15.49:0/3411516603 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b68154910 msgr2=0x7f5b6814f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:26.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.809+0000 7f5b6e007700 1 --2- 172.21.15.49:0/3411516603 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b68154910 0x7f5b6814f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:26.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.809+0000 7f5b6e007700 1 -- 172.21.15.49:0/3411516603 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b68154530 msgr2=0x7f5b6814f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:26.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.809+0000 7f5b6e007700 1 --2- 172.21.15.49:0/3411516603 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b68154530 0x7f5b6814f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:26.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.809+0000 7f5b6e007700 1 -- 172.21.15.49:0/3411516603 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b58009a20 con 0x7f5b680aa220 2023-11-30T17:19:26.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.809+0000 7f5b6e007700 1 --2- 172.21.15.49:0/3411516603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b680aa220 0x7f5b680c3e20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f5b6000c4b0 tx=0x7f5b60007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:26.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.809+0000 7f5b667fc700 1 -- 172.21.15.49:0/3411516603 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b600072e0 con 0x7f5b680aa220 2023-11-30T17:19:26.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.809+0000 7f5b667fc700 1 -- 172.21.15.49:0/3411516603 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b60007440 con 0x7f5b680aa220 2023-11-30T17:19:26.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.809+0000 7f5b7026b700 1 -- 172.21.15.49:0/3411516603 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b680c4a70 con 0x7f5b680aa220 2023-11-30T17:19:26.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.809+0000 7f5b667fc700 1 -- 172.21.15.49:0/3411516603 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b60005880 con 0x7f5b680aa220 2023-11-30T17:19:26.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.809+0000 7f5b7026b700 1 -- 172.21.15.49:0/3411516603 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b680abda0 con 0x7f5b680aa220 2023-11-30T17:19:26.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.810+0000 7f5b7026b700 1 -- 172.21.15.49:0/3411516603 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b680abff0 con 0x7f5b680aa220 2023-11-30T17:19:26.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.811+0000 7f5b667fc700 1 -- 172.21.15.49:0/3411516603 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f5b60005c70 con 0x7f5b680aa220 2023-11-30T17:19:26.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.811+0000 7f5b667fc700 1 --2- 172.21.15.49:0/3411516603 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5b5405f2c0 0x7f5b54061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:26.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.811+0000 7f5b667fc700 1 -- 172.21.15.49:0/3411516603 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f5b60079da0 con 0x7f5b680aa220 2023-11-30T17:19:26.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.811+0000 7f5b6d806700 1 --2- 172.21.15.49:0/3411516603 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5b5405f2c0 0x7f5b54061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:26.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.812+0000 7f5b6d806700 1 --2- 172.21.15.49:0/3411516603 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5b5405f2c0 0x7f5b54061780 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f5b680a9690 tx=0x7f5b5c008040).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:26.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:26.815+0000 7f5b667fc700 1 -- 172.21.15.49:0/3411516603 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5b6004ae20 con 0x7f5b680aa220 2023-11-30T17:19:27.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.015+0000 7f5b7026b700 1 -- 172.21.15.49:0/3411516603 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5b680ac350 con 0x7f5b5405f2c0 2023-11-30T17:19:27.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.018+0000 7f5b667fc700 1 -- 172.21.15.49:0/3411516603 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f5b5c00c040 con 0x7f5b5405f2c0 2023-11-30T17:19:27.020 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:19:27.020 INFO:teuthology.orchestra.run.smithi049.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-11-30T00:00:00", "created": "2023-11-30T17:08:26", "first": "2023-11-30T17:09:00", "last": "2023-11-30T17:19:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-30T17:19:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.019+0000 7f5b7026b700 1 -- 172.21.15.49:0/3411516603 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5b5405f2c0 msgr2=0x7f5b54061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.019+0000 7f5b7026b700 1 --2- 172.21.15.49:0/3411516603 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5b5405f2c0 0x7f5b54061780 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f5b680a9690 tx=0x7f5b5c008040).stop 2023-11-30T17:19:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.019+0000 7f5b7026b700 1 -- 172.21.15.49:0/3411516603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b680aa220 msgr2=0x7f5b680c3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.019+0000 7f5b7026b700 1 --2- 172.21.15.49:0/3411516603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b680aa220 0x7f5b680c3e20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f5b6000c4b0 tx=0x7f5b60007b00).stop 2023-11-30T17:19:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.019+0000 7f5b7026b700 1 -- 172.21.15.49:0/3411516603 shutdown_connections 2023-11-30T17:19:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.019+0000 7f5b7026b700 1 --2- 172.21.15.49:0/3411516603 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b68154910 0x7f5b6814f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.019+0000 7f5b7026b700 1 --2- 172.21.15.49:0/3411516603 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5b5405f2c0 0x7f5b54061780 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.019+0000 7f5b7026b700 1 --2- 172.21.15.49:0/3411516603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b680aa220 0x7f5b680c3e20 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.019+0000 7f5b7026b700 1 --2- 172.21.15.49:0/3411516603 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b68154530 0x7f5b6814f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.019+0000 7f5b7026b700 1 -- 172.21.15.49:0/3411516603 >> 172.21.15.49:0/3411516603 conn(0x7f5b68094930 msgr2=0x7f5b680c01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:27.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.019+0000 7f5b7026b700 1 -- 172.21.15.49:0/3411516603 shutdown_connections 2023-11-30T17:19:27.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.019+0000 7f5b7026b700 1 -- 172.21.15.49:0/3411516603 wait complete. 2023-11-30T17:19:27.033 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-11-30T00:00:00", "created": "2023-11-30T17:08:26", "first": "2023-11-30T17:09:00", "last": "2023-11-30T17:19:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-30T17:19:27.033 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir9', 'rel_path': '/snap_test_dir1/dir9', 'schedule': '1M', 'retention': {}, 'start': '2023-11-30T00:00:00', 'created': '2023-11-30T17:08:26', 'first': '2023-11-30T17:09:00', 'last': '2023-11-30T17:19:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-11-30T17:19:27.033 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-11-30T17:19:27.033 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-11-30T17:19:27.034 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir0 1M 2023-11-30T17:19:27.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.154+0000 7f7bd9576700 1 Processor -- start 2023-11-30T17:19:27.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.154+0000 7f7bd9576700 1 -- start start 2023-11-30T17:19:27.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.154+0000 7f7bd9576700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bd41513c0 0x7f7bd4062700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:27.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.154+0000 7f7bd9576700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7bd4062bf0 0x7f7bd40c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:27.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.154+0000 7f7bd9576700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bd40c46d0 con 0x7f7bd4150fe0 2023-11-30T17:19:27.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.154+0000 7f7bd9576700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bd40c49b0 con 0x7f7bd4062bf0 2023-11-30T17:19:27.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.154+0000 7f7bd9576700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd40c4c90 con 0x7f7bd41513c0 2023-11-30T17:19:27.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.155+0000 7f7bd37fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7bd4062bf0 0x7f7bd40c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:27.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.155+0000 7f7bd37fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7bd4062bf0 0x7f7bd40c61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44454/0 (socket says 172.21.15.49:44454) 2023-11-30T17:19:27.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.155+0000 7f7bd37fe700 1 -- 172.21.15.49:0/3295782002 learned_addr learned my addr 172.21.15.49:0/3295782002 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:27.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.155+0000 7f7bd27fc700 1 --2- 172.21.15.49:0/3295782002 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bd41513c0 0x7f7bd4062700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:27.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.155+0000 7f7bd37fe700 1 -- 172.21.15.49:0/3295782002 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bd41513c0 msgr2=0x7f7bd4062700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:27.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.155+0000 7f7bd37fe700 1 --2- 172.21.15.49:0/3295782002 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bd41513c0 0x7f7bd4062700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:27.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.155+0000 7f7bd37fe700 1 -- 172.21.15.49:0/3295782002 >> v1:172.21.15.115:6789/0 conn(0x7f7bd4150fe0 legacy=0x7f7bd40c59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:27.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.155+0000 7f7bd37fe700 1 -- 172.21.15.49:0/3295782002 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd40c2b30 con 0x7f7bd4062bf0 2023-11-30T17:19:27.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.155+0000 7f7bd37fe700 1 --2- 172.21.15.49:0/3295782002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bd4062bf0 0x7f7bd40c61c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f7bc4006fd0 tx=0x7f7bc40090f0).ready entity=mon.0 client_cookie=c38177774391c66d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:27.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.155+0000 7f7bd1ffb700 1 -- 172.21.15.49:0/3295782002 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc400b580 con 0x7f7bd4062bf0 2023-11-30T17:19:27.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.155+0000 7f7bd1ffb700 1 -- 172.21.15.49:0/3295782002 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc400b6e0 con 0x7f7bd4062bf0 2023-11-30T17:19:27.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.155+0000 7f7bd1ffb700 1 -- 172.21.15.49:0/3295782002 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc400ba60 con 0x7f7bd4062bf0 2023-11-30T17:19:27.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.156+0000 7f7bd9576700 1 -- 172.21.15.49:0/3295782002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bd4062bf0 msgr2=0x7f7bd40c61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:27.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.156+0000 7f7bd9576700 1 --2- 172.21.15.49:0/3295782002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bd4062bf0 0x7f7bd40c61c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f7bc4006fd0 tx=0x7f7bc40090f0).stop 2023-11-30T17:19:27.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.156+0000 7f7bd9576700 1 -- 172.21.15.49:0/3295782002 shutdown_connections 2023-11-30T17:19:27.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.156+0000 7f7bd9576700 1 --2- 172.21.15.49:0/3295782002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bd4062bf0 0x7f7bd40c61c0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:27.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.156+0000 7f7bd9576700 1 --2- 172.21.15.49:0/3295782002 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bd41513c0 0x7f7bd4062700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:27.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.156+0000 7f7bd9576700 1 -- 172.21.15.49:0/3295782002 >> 172.21.15.49:0/3295782002 conn(0x7f7bd40c7f10 msgr2=0x7f7bd40c3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:27.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.156+0000 7f7bd9576700 1 -- 172.21.15.49:0/3295782002 shutdown_connections 2023-11-30T17:19:27.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.156+0000 7f7bd9576700 1 -- 172.21.15.49:0/3295782002 wait complete. 2023-11-30T17:19:27.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.157+0000 7f7bd9576700 1 Processor -- start 2023-11-30T17:19:27.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.157+0000 7f7bd9576700 1 -- start start 2023-11-30T17:19:27.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.158+0000 7f7bd9576700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bd4150fe0 0x7f7bd4144820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:27.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.158+0000 7f7bd9576700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bd41513c0 0x7f7bd414ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:27.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.158+0000 7f7bd9576700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bd40c3180 0x7f7bd40c3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:27.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.158+0000 7f7bd9576700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd40aa500 con 0x7f7bd40c3180 2023-11-30T17:19:27.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.158+0000 7f7bd9576700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd40aa7e0 con 0x7f7bd41513c0 2023-11-30T17:19:27.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.158+0000 7f7bd9576700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd40c3af0 con 0x7f7bd4150fe0 2023-11-30T17:19:27.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.158+0000 7f7bd37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bd40c3180 0x7f7bd40c3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:27.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.158+0000 7f7bd37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bd40c3180 0x7f7bd40c3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44466/0 (socket says 172.21.15.49:44466) 2023-11-30T17:19:27.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.158+0000 7f7bd37fe700 1 -- 172.21.15.49:0/3185535063 learned_addr learned my addr 172.21.15.49:0/3185535063 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:27.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.158+0000 7f7bd27fc700 1 --2- 172.21.15.49:0/3185535063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bd41513c0 0x7f7bd414ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:27.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.158+0000 7f7bd2ffd700 1 --2- 172.21.15.49:0/3185535063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bd4150fe0 0x7f7bd4144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:27.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.158+0000 7f7bd37fe700 1 -- 172.21.15.49:0/3185535063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bd4150fe0 msgr2=0x7f7bd4144820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:27.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.158+0000 7f7bd37fe700 1 --2- 172.21.15.49:0/3185535063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bd4150fe0 0x7f7bd4144820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:27.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.158+0000 7f7bd37fe700 1 -- 172.21.15.49:0/3185535063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bd41513c0 msgr2=0x7f7bd414ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:27.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.158+0000 7f7bd37fe700 1 --2- 172.21.15.49:0/3185535063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bd41513c0 0x7f7bd414ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:27.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.158+0000 7f7bd37fe700 1 -- 172.21.15.49:0/3185535063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc4009370 con 0x7f7bd40c3180 2023-11-30T17:19:27.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.158+0000 7f7bd27fc700 1 --2- 172.21.15.49:0/3185535063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bd41513c0 0x7f7bd414ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:19:27.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.158+0000 7f7bd2ffd700 1 --2- 172.21.15.49:0/3185535063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bd4150fe0 0x7f7bd4144820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:19:27.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.158+0000 7f7bd37fe700 1 --2- 172.21.15.49:0/3185535063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bd40c3180 0x7f7bd40c3600 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f7bc4011000 tx=0x7f7bc4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:27.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.159+0000 7f7bcaffd700 1 -- 172.21.15.49:0/3185535063 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc400b850 con 0x7f7bd40c3180 2023-11-30T17:19:27.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.159+0000 7f7bcaffd700 1 -- 172.21.15.49:0/3185535063 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc400b9b0 con 0x7f7bd40c3180 2023-11-30T17:19:27.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.159+0000 7f7bcaffd700 1 -- 172.21.15.49:0/3185535063 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc401c670 con 0x7f7bd40c3180 2023-11-30T17:19:27.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.159+0000 7f7bd9576700 1 -- 172.21.15.49:0/3185535063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd4149890 con 0x7f7bd40c3180 2023-11-30T17:19:27.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.159+0000 7f7bd9576700 1 -- 172.21.15.49:0/3185535063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd4149e50 con 0x7f7bd40c3180 2023-11-30T17:19:27.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.160+0000 7f7bd9576700 1 -- 172.21.15.49:0/3185535063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd406c7c0 con 0x7f7bd40c3180 2023-11-30T17:19:27.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.160+0000 7f7bcaffd700 1 -- 172.21.15.49:0/3185535063 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f7bc401ccb0 con 0x7f7bd40c3180 2023-11-30T17:19:27.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.160+0000 7f7bcaffd700 1 --2- 172.21.15.49:0/3185535063 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7bb405f2c0 0x7f7bb4061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:27.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.160+0000 7f7bcaffd700 1 -- 172.21.15.49:0/3185535063 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f7bc407c5f0 con 0x7f7bd40c3180 2023-11-30T17:19:27.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.161+0000 7f7bd2ffd700 1 --2- 172.21.15.49:0/3185535063 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7bb405f2c0 0x7f7bb4061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:27.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.161+0000 7f7bd2ffd700 1 --2- 172.21.15.49:0/3185535063 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7bb405f2c0 0x7f7bb4061780 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f7bcc001e30 tx=0x7f7bcc009040).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:27.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.164+0000 7f7bcaffd700 1 -- 172.21.15.49:0/3185535063 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7bc404d670 con 0x7f7bd40c3180 2023-11-30T17:19:27.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.362+0000 7f7bd9576700 1 -- 172.21.15.49:0/3185535063 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f7bd40c2e10 con 0x7f7bb405f2c0 2023-11-30T17:19:27.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.366+0000 7f7bcaffd700 1 -- 172.21.15.49:0/3185535063 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f7bd40c2e10 con 0x7f7bb405f2c0 2023-11-30T17:19:27.368 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule removed for path /snap_test_dir1/dir0 2023-11-30T17:19:27.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.368+0000 7f7bd9576700 1 -- 172.21.15.49:0/3185535063 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7bb405f2c0 msgr2=0x7f7bb4061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:27.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.368+0000 7f7bd9576700 1 --2- 172.21.15.49:0/3185535063 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7bb405f2c0 0x7f7bb4061780 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f7bcc001e30 tx=0x7f7bcc009040).stop 2023-11-30T17:19:27.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.368+0000 7f7bd9576700 1 -- 172.21.15.49:0/3185535063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bd40c3180 msgr2=0x7f7bd40c3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:27.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.368+0000 7f7bd9576700 1 --2- 172.21.15.49:0/3185535063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bd40c3180 0x7f7bd40c3600 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f7bc4011000 tx=0x7f7bc4017000).stop 2023-11-30T17:19:27.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.368+0000 7f7bd9576700 1 -- 172.21.15.49:0/3185535063 shutdown_connections 2023-11-30T17:19:27.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.368+0000 7f7bd9576700 1 --2- 172.21.15.49:0/3185535063 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7bb405f2c0 0x7f7bb4061780 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:27.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.368+0000 7f7bd9576700 1 --2- 172.21.15.49:0/3185535063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bd40c3180 0x7f7bd40c3600 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:27.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.368+0000 7f7bd9576700 1 --2- 172.21.15.49:0/3185535063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bd4150fe0 0x7f7bd4144820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:27.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.368+0000 7f7bd9576700 1 --2- 172.21.15.49:0/3185535063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bd41513c0 0x7f7bd414ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:27.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.368+0000 7f7bd9576700 1 -- 172.21.15.49:0/3185535063 >> 172.21.15.49:0/3185535063 conn(0x7f7bd40c7f10 msgr2=0x7f7bd40658a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:27.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.368+0000 7f7bd9576700 1 -- 172.21.15.49:0/3185535063 shutdown_connections 2023-11-30T17:19:27.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:27.368+0000 7f7bd9576700 1 -- 172.21.15.49:0/3185535063 wait complete. 2023-11-30T17:19:27.383 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir0 2023-11-30T17:19:27.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:27.383 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-11-30T17:19:27.399 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_09_00_UTC 2023-11-30T17:19:27.399 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_10_00_UTC 2023-11-30T17:19:27.399 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_11_00_UTC 2023-11-30T17:19:27.399 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_12_00_UTC 2023-11-30T17:19:27.399 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_13_00_UTC 2023-11-30T17:19:27.399 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_14_00_UTC 2023-11-30T17:19:27.399 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_15_00_UTC 2023-11-30T17:19:27.399 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_16_00_UTC 2023-11-30T17:19:27.399 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_17_00_UTC 2023-11-30T17:19:27.400 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_18_00_UTC 2023-11-30T17:19:27.400 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_19_00_UTC 2023-11-30T17:19:27.400 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-11-30-17_09_00_UTC 2023-11-30T17:19:27.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:27.400 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-11-30-17_09_00_UTC) 2023-11-30T17:19:27.461 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-11-30-17_10_00_UTC 2023-11-30T17:19:27.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:27.461 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-11-30-17_10_00_UTC) 2023-11-30T17:19:27.522 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-11-30-17_11_00_UTC 2023-11-30T17:19:27.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:27.523 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-11-30-17_11_00_UTC) 2023-11-30T17:19:27.583 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-11-30-17_12_00_UTC 2023-11-30T17:19:27.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:27.584 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-11-30-17_12_00_UTC) 2023-11-30T17:19:27.644 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-11-30-17_13_00_UTC 2023-11-30T17:19:27.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:27.645 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-11-30-17_13_00_UTC) 2023-11-30T17:19:27.707 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-11-30-17_14_00_UTC 2023-11-30T17:19:27.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:27.708 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-11-30-17_14_00_UTC) 2023-11-30T17:19:27.771 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-11-30-17_15_00_UTC 2023-11-30T17:19:27.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:27.771 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-11-30-17_15_00_UTC) 2023-11-30T17:19:27.832 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-11-30-17_16_00_UTC 2023-11-30T17:19:27.833 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:27.833 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-11-30-17_16_00_UTC) 2023-11-30T17:19:27.896 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-11-30-17_17_00_UTC 2023-11-30T17:19:27.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:27.896 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-11-30-17_17_00_UTC) 2023-11-30T17:19:27.958 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-11-30-17_18_00_UTC 2023-11-30T17:19:27.958 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:27.959 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-11-30-17_18_00_UTC) 2023-11-30T17:19:28.020 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-11-30-17_19_00_UTC 2023-11-30T17:19:28.020 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:28.020 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-11-30-17_19_00_UTC) 2023-11-30T17:19:28.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:28.082 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0) 2023-11-30T17:19:28.141 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir1 1M 2023-11-30T17:19:28.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.301+0000 7fc0dc9fa700 1 Processor -- start 2023-11-30T17:19:28.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.301+0000 7fc0dc9fa700 1 -- start start 2023-11-30T17:19:28.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.302+0000 7fc0dc9fa700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0d81542d0 0x7fc0d80a9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:28.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.302+0000 7fc0dc9fa700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc0d81546b0 0x7fc0d80aa460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:28.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.302+0000 7fc0dc9fa700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0d8158d50 con 0x7fc0d80c5fc0 2023-11-30T17:19:28.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.302+0000 7fc0dc9fa700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d80aa950 con 0x7fc0d81546b0 2023-11-30T17:19:28.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.302+0000 7fc0dc9fa700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d8158140 con 0x7fc0d81542d0 2023-11-30T17:19:28.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.302+0000 7fc0d77fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0d81542d0 0x7fc0d80a9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:28.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.302+0000 7fc0d6ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc0d81546b0 0x7fc0d80aa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:28.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.302+0000 7fc0d77fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0d81542d0 0x7fc0d80a9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:47304/0 (socket says 172.21.15.49:47304) 2023-11-30T17:19:28.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.302+0000 7fc0d77fe700 1 -- 172.21.15.49:0/4160064194 learned_addr learned my addr 172.21.15.49:0/4160064194 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:28.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.303+0000 7fc0d6ffd700 1 -- 172.21.15.49:0/4160064194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0d81542d0 msgr2=0x7fc0d80a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:28.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.303+0000 7fc0d6ffd700 1 --2- 172.21.15.49:0/4160064194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0d81542d0 0x7fc0d80a9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:28.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.303+0000 7fc0d6ffd700 1 -- 172.21.15.49:0/4160064194 >> v1:172.21.15.115:6789/0 conn(0x7fc0d80c5fc0 legacy=0x7fc0d80c6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:28.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.303+0000 7fc0d6ffd700 1 -- 172.21.15.49:0/4160064194 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d8158420 con 0x7fc0d81546b0 2023-11-30T17:19:28.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.303+0000 7fc0d67fc700 1 -- 172.21.15.49:0/4160064194 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2096614218 0 0) 0x7fc0d8158d50 con 0x7fc0d80c5fc0 2023-11-30T17:19:28.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.303+0000 7fc0d77fe700 1 --2- 172.21.15.49:0/4160064194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0d81542d0 0x7fc0d80a9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:19:28.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.303+0000 7fc0d6ffd700 1 --2- 172.21.15.49:0/4160064194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0d81546b0 0x7fc0d80aa460 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fc0c0009760 tx=0x7fc0c0009060).ready entity=mon.1 client_cookie=998e0d1093c1a152 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:28.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.303+0000 7fc0d67fc700 1 -- 172.21.15.49:0/4160064194 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c000f510 con 0x7fc0d81546b0 2023-11-30T17:19:28.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.303+0000 7fc0d67fc700 1 -- 172.21.15.49:0/4160064194 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c000f670 con 0x7fc0d81546b0 2023-11-30T17:19:28.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.303+0000 7fc0d67fc700 1 -- 172.21.15.49:0/4160064194 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c000f9f0 con 0x7fc0d81546b0 2023-11-30T17:19:28.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.303+0000 7fc0dc9fa700 1 -- 172.21.15.49:0/4160064194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0d81546b0 msgr2=0x7fc0d80aa460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:28.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.303+0000 7fc0dc9fa700 1 --2- 172.21.15.49:0/4160064194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0d81546b0 0x7fc0d80aa460 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fc0c0009760 tx=0x7fc0c0009060).stop 2023-11-30T17:19:28.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.303+0000 7fc0dc9fa700 1 -- 172.21.15.49:0/4160064194 shutdown_connections 2023-11-30T17:19:28.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.303+0000 7fc0dc9fa700 1 --2- 172.21.15.49:0/4160064194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0d81542d0 0x7fc0d80a9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:28.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.303+0000 7fc0dc9fa700 1 --2- 172.21.15.49:0/4160064194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0d81546b0 0x7fc0d80aa460 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:28.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.303+0000 7fc0dc9fa700 1 -- 172.21.15.49:0/4160064194 >> 172.21.15.49:0/4160064194 conn(0x7fc0d80cb010 msgr2=0x7fc0d80cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:28.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.304+0000 7fc0dc9fa700 1 -- 172.21.15.49:0/4160064194 shutdown_connections 2023-11-30T17:19:28.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.304+0000 7fc0dc9fa700 1 -- 172.21.15.49:0/4160064194 wait complete. 2023-11-30T17:19:28.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.305+0000 7fc0dc9fa700 1 Processor -- start 2023-11-30T17:19:28.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.305+0000 7fc0dc9fa700 1 -- start start 2023-11-30T17:19:28.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.305+0000 7fc0dc9fa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0d80c5fc0 0x7fc0d814c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:28.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.305+0000 7fc0dc9fa700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0d81542d0 0x7fc0d81686e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:28.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.306+0000 7fc0dc9fa700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0d81546b0 0x7fc0d80ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:28.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.306+0000 7fc0dc9fa700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d80b0fa0 con 0x7fc0d80c5fc0 2023-11-30T17:19:28.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.306+0000 7fc0dc9fa700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d8156290 con 0x7fc0d81546b0 2023-11-30T17:19:28.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.306+0000 7fc0dc9fa700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d80c4000 con 0x7fc0d81542d0 2023-11-30T17:19:28.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.306+0000 7fc0d77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0d80c5fc0 0x7fc0d814c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:28.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.306+0000 7fc0d77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0d80c5fc0 0x7fc0d814c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44482/0 (socket says 172.21.15.49:44482) 2023-11-30T17:19:28.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.306+0000 7fc0d77fe700 1 -- 172.21.15.49:0/2894233882 learned_addr learned my addr 172.21.15.49:0/2894233882 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:28.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.306+0000 7fc0d6ffd700 1 --2- 172.21.15.49:0/2894233882 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0d81542d0 0x7fc0d81686e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:28.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.306+0000 7fc0d7fff700 1 --2- 172.21.15.49:0/2894233882 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0d81546b0 0x7fc0d80ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:28.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.306+0000 7fc0d77fe700 1 -- 172.21.15.49:0/2894233882 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0d81542d0 msgr2=0x7fc0d81686e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:28.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.306+0000 7fc0d77fe700 1 --2- 172.21.15.49:0/2894233882 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0d81542d0 0x7fc0d81686e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:28.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.306+0000 7fc0d77fe700 1 -- 172.21.15.49:0/2894233882 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0d81546b0 msgr2=0x7fc0d80ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:28.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.306+0000 7fc0d77fe700 1 --2- 172.21.15.49:0/2894233882 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0d81546b0 0x7fc0d80ca1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:28.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.306+0000 7fc0d77fe700 1 -- 172.21.15.49:0/2894233882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d0009ae0 con 0x7fc0d80c5fc0 2023-11-30T17:19:28.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.306+0000 7fc0d77fe700 1 --2- 172.21.15.49:0/2894233882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0d80c5fc0 0x7fc0d814c640 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fc0d000c170 tx=0x7fc0d000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:28.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.306+0000 7fc0cf7fe700 1 -- 172.21.15.49:0/2894233882 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d000cc00 con 0x7fc0d80c5fc0 2023-11-30T17:19:28.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.306+0000 7fc0cf7fe700 1 -- 172.21.15.49:0/2894233882 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d000f040 con 0x7fc0d80c5fc0 2023-11-30T17:19:28.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.306+0000 7fc0dc9fa700 1 -- 172.21.15.49:0/2894233882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0c00092a0 con 0x7fc0d80c5fc0 2023-11-30T17:19:28.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.306+0000 7fc0cf7fe700 1 -- 172.21.15.49:0/2894233882 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d0014460 con 0x7fc0d80c5fc0 2023-11-30T17:19:28.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.306+0000 7fc0dc9fa700 1 -- 172.21.15.49:0/2894233882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d80c33f0 con 0x7fc0d80c5fc0 2023-11-30T17:19:28.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.308+0000 7fc0dc9fa700 1 -- 172.21.15.49:0/2894233882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0d806c7c0 con 0x7fc0d80c5fc0 2023-11-30T17:19:28.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.308+0000 7fc0cf7fe700 1 -- 172.21.15.49:0/2894233882 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fc0d0014810 con 0x7fc0d80c5fc0 2023-11-30T17:19:28.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.308+0000 7fc0cf7fe700 1 --2- 172.21.15.49:0/2894233882 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc0b805f290 0x7fc0b8061750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:28.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.308+0000 7fc0cf7fe700 1 -- 172.21.15.49:0/2894233882 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fc0d007a660 con 0x7fc0d80c5fc0 2023-11-30T17:19:28.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.309+0000 7fc0d6ffd700 1 --2- 172.21.15.49:0/2894233882 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc0b805f290 0x7fc0b8061750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:28.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.309+0000 7fc0d6ffd700 1 --2- 172.21.15.49:0/2894233882 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc0b805f290 0x7fc0b8061750 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fc0c0009760 tx=0x7fc0c0017000).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:28.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.312+0000 7fc0cf7fe700 1 -- 172.21.15.49:0/2894233882 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc0d004ab00 con 0x7fc0d80c5fc0 2023-11-30T17:19:28.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.513+0000 7fc0dc9fa700 1 -- 172.21.15.49:0/2894233882 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0d80c0120 con 0x7fc0b805f290 2023-11-30T17:19:28.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.517+0000 7fc0cf7fe700 1 -- 172.21.15.49:0/2894233882 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fc0d80c0120 con 0x7fc0b805f290 2023-11-30T17:19:28.520 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule removed for path /snap_test_dir1/dir1 2023-11-30T17:19:28.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.519+0000 7fc0dc9fa700 1 -- 172.21.15.49:0/2894233882 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc0b805f290 msgr2=0x7fc0b8061750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:28.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.519+0000 7fc0dc9fa700 1 --2- 172.21.15.49:0/2894233882 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc0b805f290 0x7fc0b8061750 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fc0c0009760 tx=0x7fc0c0017000).stop 2023-11-30T17:19:28.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.519+0000 7fc0dc9fa700 1 -- 172.21.15.49:0/2894233882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0d80c5fc0 msgr2=0x7fc0d814c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:28.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.519+0000 7fc0dc9fa700 1 --2- 172.21.15.49:0/2894233882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0d80c5fc0 0x7fc0d814c640 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fc0d000c170 tx=0x7fc0d000b040).stop 2023-11-30T17:19:28.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.519+0000 7fc0dc9fa700 1 -- 172.21.15.49:0/2894233882 shutdown_connections 2023-11-30T17:19:28.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.519+0000 7fc0dc9fa700 1 --2- 172.21.15.49:0/2894233882 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0d81546b0 0x7fc0d80ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:28.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.519+0000 7fc0dc9fa700 1 --2- 172.21.15.49:0/2894233882 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc0b805f290 0x7fc0b8061750 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:28.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.519+0000 7fc0dc9fa700 1 --2- 172.21.15.49:0/2894233882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0d80c5fc0 0x7fc0d814c640 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:28.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.519+0000 7fc0dc9fa700 1 --2- 172.21.15.49:0/2894233882 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0d81542d0 0x7fc0d81686e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:28.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.519+0000 7fc0dc9fa700 1 -- 172.21.15.49:0/2894233882 >> 172.21.15.49:0/2894233882 conn(0x7fc0d80cb010 msgr2=0x7fc0d80c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:28.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.519+0000 7fc0dc9fa700 1 -- 172.21.15.49:0/2894233882 shutdown_connections 2023-11-30T17:19:28.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:28.519+0000 7fc0dc9fa700 1 -- 172.21.15.49:0/2894233882 wait complete. 2023-11-30T17:19:28.533 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir1 2023-11-30T17:19:28.533 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:28.534 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-11-30T17:19:28.550 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_09_00_UTC 2023-11-30T17:19:28.550 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_10_00_UTC 2023-11-30T17:19:28.550 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_11_00_UTC 2023-11-30T17:19:28.550 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_12_00_UTC 2023-11-30T17:19:28.550 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_13_00_UTC 2023-11-30T17:19:28.550 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_14_00_UTC 2023-11-30T17:19:28.550 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_15_00_UTC 2023-11-30T17:19:28.550 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_16_00_UTC 2023-11-30T17:19:28.550 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_17_00_UTC 2023-11-30T17:19:28.551 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_18_00_UTC 2023-11-30T17:19:28.551 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_19_00_UTC 2023-11-30T17:19:28.551 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-11-30-17_09_00_UTC 2023-11-30T17:19:28.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:28.551 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-11-30-17_09_00_UTC) 2023-11-30T17:19:28.614 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-11-30-17_10_00_UTC 2023-11-30T17:19:28.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:28.615 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-11-30-17_10_00_UTC) 2023-11-30T17:19:28.675 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-11-30-17_11_00_UTC 2023-11-30T17:19:28.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:28.676 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-11-30-17_11_00_UTC) 2023-11-30T17:19:28.738 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-11-30-17_12_00_UTC 2023-11-30T17:19:28.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:28.738 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-11-30-17_12_00_UTC) 2023-11-30T17:19:28.799 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-11-30-17_13_00_UTC 2023-11-30T17:19:28.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:28.800 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-11-30-17_13_00_UTC) 2023-11-30T17:19:28.861 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-11-30-17_14_00_UTC 2023-11-30T17:19:28.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:28.861 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-11-30-17_14_00_UTC) 2023-11-30T17:19:28.923 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-11-30-17_15_00_UTC 2023-11-30T17:19:28.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:28.923 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-11-30-17_15_00_UTC) 2023-11-30T17:19:28.993 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-11-30-17_16_00_UTC 2023-11-30T17:19:28.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:28.994 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-11-30-17_16_00_UTC) 2023-11-30T17:19:29.055 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-11-30-17_17_00_UTC 2023-11-30T17:19:29.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:29.056 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-11-30-17_17_00_UTC) 2023-11-30T17:19:29.119 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-11-30-17_18_00_UTC 2023-11-30T17:19:29.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:29.119 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-11-30-17_18_00_UTC) 2023-11-30T17:19:29.182 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-11-30-17_19_00_UTC 2023-11-30T17:19:29.182 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:29.182 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-11-30-17_19_00_UTC) 2023-11-30T17:19:29.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:29.243 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1) 2023-11-30T17:19:29.303 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir2 1M 2023-11-30T17:19:29.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.463+0000 7fd32d3d5700 1 Processor -- start 2023-11-30T17:19:29.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.463+0000 7fd32d3d5700 1 -- start start 2023-11-30T17:19:29.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.464+0000 7fd32d3d5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd328154910 0x7fd3280a7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:29.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.464+0000 7fd32d3d5700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3280c6630 con 0x7fd3280aa220 2023-11-30T17:19:29.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.464+0000 7fd32d3d5700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd328064230 con 0x7fd328154530 2023-11-30T17:19:29.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.464+0000 7fd32d3d5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3280c6390 con 0x7fd328154910 2023-11-30T17:19:29.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.464+0000 7fd3277fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd3280aa220 0x7fd3280c6ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46718/0 (socket says 172.21.15.49:46718) 2023-11-30T17:19:29.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.464+0000 7fd3277fe700 1 -- 172.21.15.49:0/442380161 learned_addr learned my addr 172.21.15.49:0/442380161 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:29.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.464+0000 7fd3267fc700 1 --2- 172.21.15.49:0/442380161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd328154910 0x7fd3280a7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:29.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.465+0000 7fd325ffb700 1 -- 172.21.15.49:0/442380161 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3470385749 0 0) 0x7fd3280c6630 con 0x7fd3280aa220 2023-11-30T17:19:29.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.465+0000 7fd325ffb700 1 -- 172.21.15.49:0/442380161 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3140033f0 con 0x7fd3280aa220 2023-11-30T17:19:29.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.465+0000 7fd325ffb700 1 -- 172.21.15.49:0/442380161 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1662875332 0 0) 0x7fd328064230 con 0x7fd328154530 2023-11-30T17:19:29.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.465+0000 7fd325ffb700 1 -- 172.21.15.49:0/442380161 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3280c6630 con 0x7fd328154530 2023-11-30T17:19:29.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.465+0000 7fd3267fc700 1 -- 172.21.15.49:0/442380161 >> v1:172.21.15.115:6789/0 conn(0x7fd328154530 legacy=0x7fd3280c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:29.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.465+0000 7fd3267fc700 1 -- 172.21.15.49:0/442380161 >> v1:172.21.15.49:6789/0 conn(0x7fd3280aa220 legacy=0x7fd3280c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:29.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.465+0000 7fd3267fc700 1 -- 172.21.15.49:0/442380161 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd328064510 con 0x7fd328154910 2023-11-30T17:19:29.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.465+0000 7fd3267fc700 1 --2- 172.21.15.49:0/442380161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd328154910 0x7fd3280a7ff0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fd310009790 tx=0x7fd310009060).ready entity=mon.2 client_cookie=dfdccbc0b21a1ee8 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:29.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.465+0000 7fd325ffb700 1 -- 172.21.15.49:0/442380161 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31000f510 con 0x7fd328154910 2023-11-30T17:19:29.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.465+0000 7fd325ffb700 1 -- 172.21.15.49:0/442380161 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31000f670 con 0x7fd328154910 2023-11-30T17:19:29.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.465+0000 7fd325ffb700 1 -- 172.21.15.49:0/442380161 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31000f9f0 con 0x7fd328154910 2023-11-30T17:19:29.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.466+0000 7fd32d3d5700 1 -- 172.21.15.49:0/442380161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd328154910 msgr2=0x7fd3280a7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:29.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.466+0000 7fd32d3d5700 1 --2- 172.21.15.49:0/442380161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd328154910 0x7fd3280a7ff0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fd310009790 tx=0x7fd310009060).stop 2023-11-30T17:19:29.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.466+0000 7fd32d3d5700 1 -- 172.21.15.49:0/442380161 shutdown_connections 2023-11-30T17:19:29.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.466+0000 7fd32d3d5700 1 --2- 172.21.15.49:0/442380161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd328154910 0x7fd3280a7ff0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:29.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.466+0000 7fd32d3d5700 1 -- 172.21.15.49:0/442380161 >> 172.21.15.49:0/442380161 conn(0x7fd328094930 msgr2=0x7fd32806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:29.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.466+0000 7fd32d3d5700 1 -- 172.21.15.49:0/442380161 shutdown_connections 2023-11-30T17:19:29.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.466+0000 7fd32d3d5700 1 -- 172.21.15.49:0/442380161 wait complete. 2023-11-30T17:19:29.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.467+0000 7fd32d3d5700 1 Processor -- start 2023-11-30T17:19:29.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.467+0000 7fd32d3d5700 1 -- start start 2023-11-30T17:19:29.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.468+0000 7fd32d3d5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3280aa220 0x7fd3280c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:29.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.468+0000 7fd32d3d5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd328154530 0x7fd3280ac3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:29.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.468+0000 7fd32d3d5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd328154910 0x7fd32814f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:29.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.468+0000 7fd32d3d5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3280c41b0 con 0x7fd3280aa220 2023-11-30T17:19:29.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.468+0000 7fd32d3d5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3280ac8b0 con 0x7fd328154530 2023-11-30T17:19:29.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.468+0000 7fd32d3d5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3280afc40 con 0x7fd328154910 2023-11-30T17:19:29.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.468+0000 7fd326ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3280aa220 0x7fd3280c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:29.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.468+0000 7fd3267fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd328154530 0x7fd3280ac3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:29.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.468+0000 7fd3277fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd328154910 0x7fd32814f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:29.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.468+0000 7fd326ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3280aa220 0x7fd3280c3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44488/0 (socket says 172.21.15.49:44488) 2023-11-30T17:19:29.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.468+0000 7fd326ffd700 1 -- 172.21.15.49:0/3808427239 learned_addr learned my addr 172.21.15.49:0/3808427239 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:29.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.468+0000 7fd3267fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd328154530 0x7fd3280ac3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:41354/0 (socket says 172.21.15.49:41354) 2023-11-30T17:19:29.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.468+0000 7fd326ffd700 1 -- 172.21.15.49:0/3808427239 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd328154910 msgr2=0x7fd32814f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:29.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.468+0000 7fd326ffd700 1 --2- 172.21.15.49:0/3808427239 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd328154910 0x7fd32814f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:29.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.468+0000 7fd326ffd700 1 -- 172.21.15.49:0/3808427239 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd328154530 msgr2=0x7fd3280ac3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:29.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.468+0000 7fd326ffd700 1 --2- 172.21.15.49:0/3808427239 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd328154530 0x7fd3280ac3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:29.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.468+0000 7fd326ffd700 1 -- 172.21.15.49:0/3808427239 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3100092a0 con 0x7fd3280aa220 2023-11-30T17:19:29.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.468+0000 7fd3267fc700 1 --2- 172.21.15.49:0/3808427239 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd328154530 0x7fd3280ac3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:19:29.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.468+0000 7fd326ffd700 1 --2- 172.21.15.49:0/3808427239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3280aa220 0x7fd3280c3cc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fd32000c4c0 tx=0x7fd320007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:29.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.468+0000 7fd31effd700 1 -- 172.21.15.49:0/3808427239 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32000ce30 con 0x7fd3280aa220 2023-11-30T17:19:29.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.468+0000 7fd31effd700 1 -- 172.21.15.49:0/3808427239 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32000f470 con 0x7fd3280aa220 2023-11-30T17:19:29.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.468+0000 7fd32d3d5700 1 -- 172.21.15.49:0/3808427239 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3280acac0 con 0x7fd3280aa220 2023-11-30T17:19:29.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.468+0000 7fd31effd700 1 -- 172.21.15.49:0/3808427239 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32000f810 con 0x7fd3280aa220 2023-11-30T17:19:29.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.469+0000 7fd32d3d5700 1 -- 172.21.15.49:0/3808427239 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3280ad080 con 0x7fd3280aa220 2023-11-30T17:19:29.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.470+0000 7fd32d3d5700 1 -- 172.21.15.49:0/3808427239 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd32806c860 con 0x7fd3280aa220 2023-11-30T17:19:29.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.470+0000 7fd31effd700 1 -- 172.21.15.49:0/3808427239 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fd32000fbc0 con 0x7fd3280aa220 2023-11-30T17:19:29.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.470+0000 7fd31effd700 1 --2- 172.21.15.49:0/3808427239 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd30805f2c0 0x7fd308061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:29.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.470+0000 7fd31effd700 1 -- 172.21.15.49:0/3808427239 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6634+0+0 (secure 0 0 0) 0x7fd320079b50 con 0x7fd3280aa220 2023-11-30T17:19:29.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.470+0000 7fd3267fc700 1 --2- 172.21.15.49:0/3808427239 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd30805f2c0 0x7fd308061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:29.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.471+0000 7fd3267fc700 1 --2- 172.21.15.49:0/3808427239 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd30805f2c0 0x7fd308061780 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fd310009fd0 tx=0x7fd310017000).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:29.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.474+0000 7fd31effd700 1 -- 172.21.15.49:0/3808427239 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd32004aa40 con 0x7fd3280aa220 2023-11-30T17:19:29.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.670+0000 7fd32d3d5700 1 -- 172.21.15.49:0/3808427239 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3280afd80 con 0x7fd30805f2c0 2023-11-30T17:19:29.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.675+0000 7fd31effd700 1 -- 172.21.15.49:0/3808427239 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fd310000bc0 con 0x7fd30805f2c0 2023-11-30T17:19:29.677 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule removed for path /snap_test_dir1/dir2 2023-11-30T17:19:29.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.677+0000 7fd32d3d5700 1 -- 172.21.15.49:0/3808427239 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd30805f2c0 msgr2=0x7fd308061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:29.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.677+0000 7fd32d3d5700 1 --2- 172.21.15.49:0/3808427239 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd30805f2c0 0x7fd308061780 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fd310009fd0 tx=0x7fd310017000).stop 2023-11-30T17:19:29.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.677+0000 7fd32d3d5700 1 -- 172.21.15.49:0/3808427239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3280aa220 msgr2=0x7fd3280c3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:29.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.677+0000 7fd32d3d5700 1 --2- 172.21.15.49:0/3808427239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3280aa220 0x7fd3280c3cc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fd32000c4c0 tx=0x7fd320007c80).stop 2023-11-30T17:19:29.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.677+0000 7fd32d3d5700 1 -- 172.21.15.49:0/3808427239 shutdown_connections 2023-11-30T17:19:29.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.677+0000 7fd32d3d5700 1 --2- 172.21.15.49:0/3808427239 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd328154910 0x7fd32814f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:29.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.677+0000 7fd32d3d5700 1 --2- 172.21.15.49:0/3808427239 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd30805f2c0 0x7fd308061780 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:29.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.677+0000 7fd32d3d5700 1 --2- 172.21.15.49:0/3808427239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3280aa220 0x7fd3280c3cc0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:29.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.677+0000 7fd32d3d5700 1 --2- 172.21.15.49:0/3808427239 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd328154530 0x7fd3280ac3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:29.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.677+0000 7fd32d3d5700 1 -- 172.21.15.49:0/3808427239 >> 172.21.15.49:0/3808427239 conn(0x7fd328094930 msgr2=0x7fd3280a8650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:29.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.677+0000 7fd32d3d5700 1 -- 172.21.15.49:0/3808427239 shutdown_connections 2023-11-30T17:19:29.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:29.677+0000 7fd32d3d5700 1 -- 172.21.15.49:0/3808427239 wait complete. 2023-11-30T17:19:29.691 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir2 2023-11-30T17:19:29.691 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:29.691 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-11-30T17:19:29.707 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_09_00_UTC 2023-11-30T17:19:29.707 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_10_00_UTC 2023-11-30T17:19:29.707 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_11_00_UTC 2023-11-30T17:19:29.708 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_12_00_UTC 2023-11-30T17:19:29.708 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_13_00_UTC 2023-11-30T17:19:29.708 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_14_00_UTC 2023-11-30T17:19:29.708 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_15_00_UTC 2023-11-30T17:19:29.708 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_16_00_UTC 2023-11-30T17:19:29.708 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_17_00_UTC 2023-11-30T17:19:29.708 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_18_00_UTC 2023-11-30T17:19:29.708 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_19_00_UTC 2023-11-30T17:19:29.709 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-11-30-17_09_00_UTC 2023-11-30T17:19:29.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:29.709 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-11-30-17_09_00_UTC) 2023-11-30T17:19:29.772 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-11-30-17_10_00_UTC 2023-11-30T17:19:29.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:29.772 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-11-30-17_10_00_UTC) 2023-11-30T17:19:29.833 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-11-30-17_11_00_UTC 2023-11-30T17:19:29.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:29.834 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-11-30-17_11_00_UTC) 2023-11-30T17:19:29.896 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-11-30-17_12_00_UTC 2023-11-30T17:19:29.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:29.896 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-11-30-17_12_00_UTC) 2023-11-30T17:19:29.957 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-11-30-17_13_00_UTC 2023-11-30T17:19:29.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:29.958 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-11-30-17_13_00_UTC) 2023-11-30T17:19:30.028 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-11-30-17_14_00_UTC 2023-11-30T17:19:30.029 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:30.029 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-11-30-17_14_00_UTC) 2023-11-30T17:19:30.091 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-11-30-17_15_00_UTC 2023-11-30T17:19:30.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:30.092 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-11-30-17_15_00_UTC) 2023-11-30T17:19:30.154 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-11-30-17_16_00_UTC 2023-11-30T17:19:30.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:30.155 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-11-30-17_16_00_UTC) 2023-11-30T17:19:30.226 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-11-30-17_17_00_UTC 2023-11-30T17:19:30.226 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:30.226 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-11-30-17_17_00_UTC) 2023-11-30T17:19:30.287 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-11-30-17_18_00_UTC 2023-11-30T17:19:30.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:30.288 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-11-30-17_18_00_UTC) 2023-11-30T17:19:30.348 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-11-30-17_19_00_UTC 2023-11-30T17:19:30.348 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:30.349 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-11-30-17_19_00_UTC) 2023-11-30T17:19:30.409 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:30.409 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2) 2023-11-30T17:19:30.467 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir3 1M 2023-11-30T17:19:30.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.627+0000 7fc5ddadb700 1 Processor -- start 2023-11-30T17:19:30.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.627+0000 7fc5ddadb700 1 -- start start 2023-11-30T17:19:30.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.628+0000 7fc5ddadb700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc5d80c8800 0x7fc5d80a7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:30.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.628+0000 7fc5ddadb700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc5d80a8370 0x7fc5d80be880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:30.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.628+0000 7fc5ddadb700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d80a87f0 con 0x7fc5d80bed70 2023-11-30T17:19:30.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.628+0000 7fc5ddadb700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d80a6610 con 0x7fc5d80c8800 2023-11-30T17:19:30.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.628+0000 7fc5ddadb700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d80bf1c0 con 0x7fc5d80a8370 2023-11-30T17:19:30.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.628+0000 7fc5dcad9700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc5d80c8800 0x7fc5d80a7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:30.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.628+0000 7fc5dcad9700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc5d80c8800 0x7fc5d80a7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53748/0 (socket says 172.21.15.49:53748) 2023-11-30T17:19:30.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.628+0000 7fc5dcad9700 1 -- 172.21.15.49:0/2103286815 learned_addr learned my addr 172.21.15.49:0/2103286815 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:30.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.628+0000 7fc5d7fff700 1 --2- 172.21.15.49:0/2103286815 >> v2:172.21.15.115:3300/0 conn(0x7fc5d80a8370 0x7fc5d80be880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:30.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.628+0000 7fc5dcad9700 1 -- 172.21.15.49:0/2103286815 >> v2:172.21.15.115:3300/0 conn(0x7fc5d80a8370 msgr2=0x7fc5d80be880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:30.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.628+0000 7fc5dcad9700 1 --2- 172.21.15.49:0/2103286815 >> v2:172.21.15.115:3300/0 conn(0x7fc5d80a8370 0x7fc5d80be880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:30.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.628+0000 7fc5dcad9700 1 -- 172.21.15.49:0/2103286815 >> v1:172.21.15.115:6789/0 conn(0x7fc5d80bed70 legacy=0x7fc5d80c6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:30.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.628+0000 7fc5dcad9700 1 -- 172.21.15.49:0/2103286815 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d80a6800 con 0x7fc5d80c8800 2023-11-30T17:19:30.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.629+0000 7fc5dcad9700 1 --2- 172.21.15.49:0/2103286815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5d80c8800 0x7fc5d80a7e80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fc5d806a360 tx=0x7fc5cc009060).ready entity=mon.0 client_cookie=6b63046cb5e48342 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:30.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.629+0000 7fc5d77fe700 1 -- 172.21.15.49:0/2103286815 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc005880 con 0x7fc5d80c8800 2023-11-30T17:19:30.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.629+0000 7fc5d77fe700 1 -- 172.21.15.49:0/2103286815 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5cc0059e0 con 0x7fc5d80c8800 2023-11-30T17:19:30.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.629+0000 7fc5d77fe700 1 -- 172.21.15.49:0/2103286815 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc005d60 con 0x7fc5d80c8800 2023-11-30T17:19:30.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.629+0000 7fc5ddadb700 1 -- 172.21.15.49:0/2103286815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5d80c8800 msgr2=0x7fc5d80a7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:30.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.629+0000 7fc5ddadb700 1 --2- 172.21.15.49:0/2103286815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5d80c8800 0x7fc5d80a7e80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fc5d806a360 tx=0x7fc5cc009060).stop 2023-11-30T17:19:30.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.629+0000 7fc5ddadb700 1 -- 172.21.15.49:0/2103286815 shutdown_connections 2023-11-30T17:19:30.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.629+0000 7fc5ddadb700 1 --2- 172.21.15.49:0/2103286815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5d80c8800 0x7fc5d80a7e80 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:30.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.629+0000 7fc5ddadb700 1 --2- 172.21.15.49:0/2103286815 >> v2:172.21.15.115:3300/0 conn(0x7fc5d80a8370 0x7fc5d80be880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:30.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.629+0000 7fc5ddadb700 1 -- 172.21.15.49:0/2103286815 >> 172.21.15.49:0/2103286815 conn(0x7fc5d8092520 msgr2=0x7fc5d8062ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:30.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.629+0000 7fc5ddadb700 1 -- 172.21.15.49:0/2103286815 shutdown_connections 2023-11-30T17:19:30.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.629+0000 7fc5ddadb700 1 -- 172.21.15.49:0/2103286815 wait complete. 2023-11-30T17:19:30.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.630+0000 7fc5ddadb700 1 Processor -- start 2023-11-30T17:19:30.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.631+0000 7fc5ddadb700 1 -- start start 2023-11-30T17:19:30.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.631+0000 7fc5ddadb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc5d80a8370 0x7fc5d81555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:30.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.631+0000 7fc5ddadb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5d80bed70 0x7fc5d8157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:30.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.631+0000 7fc5ddadb700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5d80c8800 0x7fc5d8153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:30.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.631+0000 7fc5ddadb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d80ac890 con 0x7fc5d80bed70 2023-11-30T17:19:30.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.631+0000 7fc5ddadb700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d80abf60 con 0x7fc5d80c8800 2023-11-30T17:19:30.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.631+0000 7fc5ddadb700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d80ac240 con 0x7fc5d80a8370 2023-11-30T17:19:30.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.631+0000 7fc5d7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5d80bed70 0x7fc5d8157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:30.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.631+0000 7fc5d7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5d80bed70 0x7fc5d8157690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53752/0 (socket says 172.21.15.49:53752) 2023-11-30T17:19:30.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.631+0000 7fc5d7fff700 1 -- 172.21.15.49:0/633496169 learned_addr learned my addr 172.21.15.49:0/633496169 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:30.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.632+0000 7fc5dd2da700 1 --2- 172.21.15.49:0/633496169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5d80c8800 0x7fc5d8153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:30.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.632+0000 7fc5d7fff700 1 -- 172.21.15.49:0/633496169 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc5d80a8370 msgr2=0x7fc5d81555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:30.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.632+0000 7fc5d7fff700 1 --2- 172.21.15.49:0/633496169 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc5d80a8370 0x7fc5d81555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:30.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.632+0000 7fc5d7fff700 1 -- 172.21.15.49:0/633496169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5d80c8800 msgr2=0x7fc5d8153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:30.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.632+0000 7fc5d7fff700 1 --2- 172.21.15.49:0/633496169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5d80c8800 0x7fc5d8153b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:30.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.632+0000 7fc5d7fff700 1 -- 172.21.15.49:0/633496169 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5cc009300 con 0x7fc5d80bed70 2023-11-30T17:19:30.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.632+0000 7fc5dd2da700 1 --2- 172.21.15.49:0/633496169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5d80c8800 0x7fc5d8153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:19:30.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.632+0000 7fc5d7fff700 1 --2- 172.21.15.49:0/633496169 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5d80bed70 0x7fc5d8157690 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7fc5c400e900 tx=0x7fc5c4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:30.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.632+0000 7fc5d4ff9700 1 -- 172.21.15.49:0/633496169 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c400c640 con 0x7fc5d80bed70 2023-11-30T17:19:30.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.632+0000 7fc5d4ff9700 1 -- 172.21.15.49:0/633496169 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c400c7a0 con 0x7fc5d80bed70 2023-11-30T17:19:30.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.632+0000 7fc5ddadb700 1 -- 172.21.15.49:0/633496169 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d80ac520 con 0x7fc5d80bed70 2023-11-30T17:19:30.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.632+0000 7fc5d4ff9700 1 -- 172.21.15.49:0/633496169 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c400cb20 con 0x7fc5d80bed70 2023-11-30T17:19:30.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.632+0000 7fc5ddadb700 1 -- 172.21.15.49:0/633496169 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d80acd20 con 0x7fc5d80bed70 2023-11-30T17:19:30.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.633+0000 7fc5ddadb700 1 -- 172.21.15.49:0/633496169 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5d80acb70 con 0x7fc5d80bed70 2023-11-30T17:19:30.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.633+0000 7fc5d4ff9700 1 -- 172.21.15.49:0/633496169 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fc5c401b400 con 0x7fc5d80bed70 2023-11-30T17:19:30.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.634+0000 7fc5d4ff9700 1 --2- 172.21.15.49:0/633496169 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc5bc05f2c0 0x7fc5bc061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:30.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.634+0000 7fc5d4ff9700 1 -- 172.21.15.49:0/633496169 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6762+0+0 (secure 0 0 0) 0x7fc5c407ab40 con 0x7fc5d80bed70 2023-11-30T17:19:30.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.634+0000 7fc5dcad9700 1 --2- 172.21.15.49:0/633496169 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc5bc05f2c0 0x7fc5bc061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:30.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.634+0000 7fc5dcad9700 1 --2- 172.21.15.49:0/633496169 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc5bc05f2c0 0x7fc5bc061780 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fc5cc00b340 tx=0x7fc5cc016000).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:30.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.638+0000 7fc5d4ff9700 1 -- 172.21.15.49:0/633496169 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc5c404b9b0 con 0x7fc5d80bed70 2023-11-30T17:19:30.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.834+0000 7fc5ddadb700 1 -- 172.21.15.49:0/633496169 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5d80acf70 con 0x7fc5bc05f2c0 2023-11-30T17:19:30.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.838+0000 7fc5d4ff9700 1 -- 172.21.15.49:0/633496169 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fc5d80acf70 con 0x7fc5bc05f2c0 2023-11-30T17:19:30.841 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule removed for path /snap_test_dir1/dir3 2023-11-30T17:19:30.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.840+0000 7fc5ddadb700 1 -- 172.21.15.49:0/633496169 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc5bc05f2c0 msgr2=0x7fc5bc061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:30.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.840+0000 7fc5ddadb700 1 --2- 172.21.15.49:0/633496169 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc5bc05f2c0 0x7fc5bc061780 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fc5cc00b340 tx=0x7fc5cc016000).stop 2023-11-30T17:19:30.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.840+0000 7fc5ddadb700 1 -- 172.21.15.49:0/633496169 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5d80bed70 msgr2=0x7fc5d8157690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:30.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.840+0000 7fc5ddadb700 1 --2- 172.21.15.49:0/633496169 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5d80bed70 0x7fc5d8157690 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7fc5c400e900 tx=0x7fc5c4009060).stop 2023-11-30T17:19:30.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.840+0000 7fc5ddadb700 1 -- 172.21.15.49:0/633496169 shutdown_connections 2023-11-30T17:19:30.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.840+0000 7fc5ddadb700 1 --2- 172.21.15.49:0/633496169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5d80c8800 0x7fc5d8153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:30.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.840+0000 7fc5ddadb700 1 --2- 172.21.15.49:0/633496169 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc5d80a8370 0x7fc5d81555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:30.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.840+0000 7fc5ddadb700 1 --2- 172.21.15.49:0/633496169 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc5bc05f2c0 0x7fc5bc061780 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:30.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.840+0000 7fc5ddadb700 1 --2- 172.21.15.49:0/633496169 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5d80bed70 0x7fc5d8157690 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:30.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.840+0000 7fc5ddadb700 1 -- 172.21.15.49:0/633496169 >> 172.21.15.49:0/633496169 conn(0x7fc5d8092520 msgr2=0x7fc5d80c3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:30.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.840+0000 7fc5ddadb700 1 -- 172.21.15.49:0/633496169 shutdown_connections 2023-11-30T17:19:30.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:30.840+0000 7fc5ddadb700 1 -- 172.21.15.49:0/633496169 wait complete. 2023-11-30T17:19:30.854 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir3 2023-11-30T17:19:30.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:30.855 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-11-30T17:19:30.871 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_09_00_UTC 2023-11-30T17:19:30.871 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_10_00_UTC 2023-11-30T17:19:30.872 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_11_00_UTC 2023-11-30T17:19:30.872 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_12_00_UTC 2023-11-30T17:19:30.872 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_13_00_UTC 2023-11-30T17:19:30.872 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_14_00_UTC 2023-11-30T17:19:30.872 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_15_00_UTC 2023-11-30T17:19:30.872 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_16_00_UTC 2023-11-30T17:19:30.872 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_17_00_UTC 2023-11-30T17:19:30.872 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_18_00_UTC 2023-11-30T17:19:30.872 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_19_00_UTC 2023-11-30T17:19:30.872 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-11-30-17_09_00_UTC 2023-11-30T17:19:30.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:30.873 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-11-30-17_09_00_UTC) 2023-11-30T17:19:30.935 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-11-30-17_10_00_UTC 2023-11-30T17:19:30.935 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:30.936 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-11-30-17_10_00_UTC) 2023-11-30T17:19:31.015 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-11-30-17_11_00_UTC 2023-11-30T17:19:31.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:31.016 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-11-30-17_11_00_UTC) 2023-11-30T17:19:31.077 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-11-30-17_12_00_UTC 2023-11-30T17:19:31.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:31.077 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-11-30-17_12_00_UTC) 2023-11-30T17:19:31.139 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-11-30-17_13_00_UTC 2023-11-30T17:19:31.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:31.140 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-11-30-17_13_00_UTC) 2023-11-30T17:19:31.205 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-11-30-17_14_00_UTC 2023-11-30T17:19:31.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:31.205 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-11-30-17_14_00_UTC) 2023-11-30T17:19:31.266 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-11-30-17_15_00_UTC 2023-11-30T17:19:31.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:31.266 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-11-30-17_15_00_UTC) 2023-11-30T17:19:31.334 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-11-30-17_16_00_UTC 2023-11-30T17:19:31.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:31.334 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-11-30-17_16_00_UTC) 2023-11-30T17:19:31.395 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-11-30-17_17_00_UTC 2023-11-30T17:19:31.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:31.395 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-11-30-17_17_00_UTC) 2023-11-30T17:19:31.456 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-11-30-17_18_00_UTC 2023-11-30T17:19:31.456 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:31.456 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-11-30-17_18_00_UTC) 2023-11-30T17:19:31.517 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-11-30-17_19_00_UTC 2023-11-30T17:19:31.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:31.517 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-11-30-17_19_00_UTC) 2023-11-30T17:19:31.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:31.578 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3) 2023-11-30T17:19:31.636 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir4 1M 2023-11-30T17:19:31.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.796+0000 7ff2e1f2a700 1 Processor -- start 2023-11-30T17:19:31.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.796+0000 7ff2e1f2a700 1 -- start start 2023-11-30T17:19:31.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.797+0000 7ff2e1f2a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff2dc1373a0 0x7ff2dc0c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:31.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.797+0000 7ff2e1f2a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff2dc0c5f30 0x7ff2dc0c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:31.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.797+0000 7ff2e1f2a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2dc158e20 con 0x7ff2dc0669a0 2023-11-30T17:19:31.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.797+0000 7ff2e1f2a700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2dc0c68a0 con 0x7ff2dc1373a0 2023-11-30T17:19:31.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.797+0000 7ff2e1f2a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc1582a0 con 0x7ff2dc0c5f30 2023-11-30T17:19:31.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.797+0000 7ff2db7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff2dc1373a0 0x7ff2dc0c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:31.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.797+0000 7ff2dbfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff2dc0669a0 0x7ff2dc066e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55096/0 (socket says 172.21.15.49:55096) 2023-11-30T17:19:31.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.797+0000 7ff2dbfff700 1 -- 172.21.15.49:0/1170270266 learned_addr learned my addr 172.21.15.49:0/1170270266 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:31.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.797+0000 7ff2db7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff2dc1373a0 0x7ff2dc0c72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53754/0 (socket says 172.21.15.49:53754) 2023-11-30T17:19:31.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.797+0000 7ff2daffd700 1 --2- 172.21.15.49:0/1170270266 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff2dc0c5f30 0x7ff2dc0c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:31.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.797+0000 7ff2db7fe700 1 -- 172.21.15.49:0/1170270266 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff2dc0c5f30 msgr2=0x7ff2dc0c63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:31.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.798+0000 7ff2db7fe700 1 --2- 172.21.15.49:0/1170270266 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff2dc0c5f30 0x7ff2dc0c63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:31.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.798+0000 7ff2db7fe700 1 -- 172.21.15.49:0/1170270266 >> v1:172.21.15.49:6789/0 conn(0x7ff2dc0669a0 legacy=0x7ff2dc066e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:31.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.798+0000 7ff2da7fc700 1 -- 172.21.15.49:0/1170270266 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3481602708 0 0) 0x7ff2dc158e20 con 0x7ff2dc0669a0 2023-11-30T17:19:31.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.798+0000 7ff2db7fe700 1 -- 172.21.15.49:0/1170270266 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2dc158580 con 0x7ff2dc1373a0 2023-11-30T17:19:31.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.798+0000 7ff2db7fe700 1 --2- 172.21.15.49:0/1170270266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2dc1373a0 0x7ff2dc0c72e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7ff2cc009760 tx=0x7ff2cc009060).ready entity=mon.0 client_cookie=a1d3262b5393bc9c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:31.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.798+0000 7ff2da7fc700 1 -- 172.21.15.49:0/1170270266 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc00b580 con 0x7ff2dc1373a0 2023-11-30T17:19:31.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.798+0000 7ff2da7fc700 1 -- 172.21.15.49:0/1170270266 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2cc00b6e0 con 0x7ff2dc1373a0 2023-11-30T17:19:31.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.798+0000 7ff2da7fc700 1 -- 172.21.15.49:0/1170270266 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc00ba60 con 0x7ff2dc1373a0 2023-11-30T17:19:31.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.798+0000 7ff2e1f2a700 1 -- 172.21.15.49:0/1170270266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2dc1373a0 msgr2=0x7ff2dc0c72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:31.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.798+0000 7ff2e1f2a700 1 --2- 172.21.15.49:0/1170270266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2dc1373a0 0x7ff2dc0c72e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7ff2cc009760 tx=0x7ff2cc009060).stop 2023-11-30T17:19:31.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.798+0000 7ff2e1f2a700 1 -- 172.21.15.49:0/1170270266 shutdown_connections 2023-11-30T17:19:31.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.798+0000 7ff2e1f2a700 1 --2- 172.21.15.49:0/1170270266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2dc1373a0 0x7ff2dc0c72e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:31.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.798+0000 7ff2e1f2a700 1 --2- 172.21.15.49:0/1170270266 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff2dc0c5f30 0x7ff2dc0c63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:31.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.798+0000 7ff2e1f2a700 1 -- 172.21.15.49:0/1170270266 >> 172.21.15.49:0/1170270266 conn(0x7ff2dc0628f0 msgr2=0x7ff2dc062d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:31.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.798+0000 7ff2e1f2a700 1 -- 172.21.15.49:0/1170270266 shutdown_connections 2023-11-30T17:19:31.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.798+0000 7ff2e1f2a700 1 -- 172.21.15.49:0/1170270266 wait complete. 2023-11-30T17:19:31.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.800+0000 7ff2e1f2a700 1 Processor -- start 2023-11-30T17:19:31.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.800+0000 7ff2e1f2a700 1 -- start start 2023-11-30T17:19:31.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.800+0000 7ff2e1f2a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2dc0669a0 0x7ff2dc150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:31.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.800+0000 7ff2e1f2a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2dc0c5f30 0x7ff2dc1368c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:31.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.800+0000 7ff2e1f2a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff2dc1373a0 0x7ff2dc155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:31.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.800+0000 7ff2e1f2a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc0a9aa0 con 0x7ff2dc0c5f30 2023-11-30T17:19:31.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.800+0000 7ff2e1f2a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc0a9d80 con 0x7ff2dc0669a0 2023-11-30T17:19:31.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.800+0000 7ff2e1f2a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc0aa060 con 0x7ff2dc1373a0 2023-11-30T17:19:31.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.801+0000 7ff2daffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2dc0c5f30 0x7ff2dc1368c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:31.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.801+0000 7ff2daffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2dc0c5f30 0x7ff2dc1368c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53762/0 (socket says 172.21.15.49:53762) 2023-11-30T17:19:31.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.801+0000 7ff2daffd700 1 -- 172.21.15.49:0/1279361969 learned_addr learned my addr 172.21.15.49:0/1279361969 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:31.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.801+0000 7ff2dbfff700 1 --2- 172.21.15.49:0/1279361969 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff2dc1373a0 0x7ff2dc155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:31.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.801+0000 7ff2db7fe700 1 --2- 172.21.15.49:0/1279361969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2dc0669a0 0x7ff2dc150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:31.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.801+0000 7ff2daffd700 1 -- 172.21.15.49:0/1279361969 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff2dc1373a0 msgr2=0x7ff2dc155dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:31.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.801+0000 7ff2daffd700 1 --2- 172.21.15.49:0/1279361969 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff2dc1373a0 0x7ff2dc155dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:31.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.801+0000 7ff2daffd700 1 -- 172.21.15.49:0/1279361969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2dc0669a0 msgr2=0x7ff2dc150b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:31.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.801+0000 7ff2daffd700 1 --2- 172.21.15.49:0/1279361969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2dc0669a0 0x7ff2dc150b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:31.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.801+0000 7ff2daffd700 1 -- 172.21.15.49:0/1279361969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2cc0092a0 con 0x7ff2dc0c5f30 2023-11-30T17:19:31.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.801+0000 7ff2daffd700 1 --2- 172.21.15.49:0/1279361969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2dc0c5f30 0x7ff2dc1368c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7ff2d000d890 tx=0x7ff2d0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:31.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.801+0000 7ff2c37fe700 1 -- 172.21.15.49:0/1279361969 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0011590 con 0x7ff2dc0c5f30 2023-11-30T17:19:31.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.801+0000 7ff2c37fe700 1 -- 172.21.15.49:0/1279361969 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d00116f0 con 0x7ff2dc0c5f30 2023-11-30T17:19:31.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.801+0000 7ff2e1f2a700 1 -- 172.21.15.49:0/1279361969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2dc0aa340 con 0x7ff2dc0c5f30 2023-11-30T17:19:31.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.801+0000 7ff2c37fe700 1 -- 172.21.15.49:0/1279361969 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0011a70 con 0x7ff2dc0c5f30 2023-11-30T17:19:31.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.801+0000 7ff2e1f2a700 1 -- 172.21.15.49:0/1279361969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2dc0ac040 con 0x7ff2dc0c5f30 2023-11-30T17:19:31.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.802+0000 7ff2e1f2a700 1 -- 172.21.15.49:0/1279361969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2dc0aa7e0 con 0x7ff2dc0c5f30 2023-11-30T17:19:31.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.802+0000 7ff2c37fe700 1 -- 172.21.15.49:0/1279361969 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7ff2d001c460 con 0x7ff2dc0c5f30 2023-11-30T17:19:31.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.803+0000 7ff2c37fe700 1 --2- 172.21.15.49:0/1279361969 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff2c805f2c0 0x7ff2c8061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:31.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.803+0000 7ff2c37fe700 1 -- 172.21.15.49:0/1279361969 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6922+0+0 (secure 0 0 0) 0x7ff2d007a420 con 0x7ff2dc0c5f30 2023-11-30T17:19:31.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.803+0000 7ff2db7fe700 1 --2- 172.21.15.49:0/1279361969 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff2c805f2c0 0x7ff2c8061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:31.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.803+0000 7ff2db7fe700 1 --2- 172.21.15.49:0/1279361969 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff2c805f2c0 0x7ff2c8061780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7ff2cc00b340 tx=0x7ff2cc017000).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:31.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:31.807+0000 7ff2c37fe700 1 -- 172.21.15.49:0/1279361969 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff2d004b1f0 con 0x7ff2dc0c5f30 2023-11-30T17:19:32.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.022+0000 7ff2e1f2a700 1 -- 172.21.15.49:0/1279361969 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2dc0a9ef0 con 0x7ff2c805f2c0 2023-11-30T17:19:32.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.025+0000 7ff2c37fe700 1 -- 172.21.15.49:0/1279361969 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7ff2dc0a9ef0 con 0x7ff2c805f2c0 2023-11-30T17:19:32.028 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule removed for path /snap_test_dir1/dir4 2023-11-30T17:19:32.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.027+0000 7ff2e1f2a700 1 -- 172.21.15.49:0/1279361969 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff2c805f2c0 msgr2=0x7ff2c8061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:32.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.027+0000 7ff2e1f2a700 1 --2- 172.21.15.49:0/1279361969 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff2c805f2c0 0x7ff2c8061780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7ff2cc00b340 tx=0x7ff2cc017000).stop 2023-11-30T17:19:32.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.027+0000 7ff2e1f2a700 1 -- 172.21.15.49:0/1279361969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2dc0c5f30 msgr2=0x7ff2dc1368c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:32.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.027+0000 7ff2e1f2a700 1 --2- 172.21.15.49:0/1279361969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2dc0c5f30 0x7ff2dc1368c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7ff2d000d890 tx=0x7ff2d0008040).stop 2023-11-30T17:19:32.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.027+0000 7ff2e1f2a700 1 -- 172.21.15.49:0/1279361969 shutdown_connections 2023-11-30T17:19:32.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.027+0000 7ff2e1f2a700 1 --2- 172.21.15.49:0/1279361969 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff2dc1373a0 0x7ff2dc155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:32.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.027+0000 7ff2e1f2a700 1 --2- 172.21.15.49:0/1279361969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2dc0669a0 0x7ff2dc150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:32.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.027+0000 7ff2e1f2a700 1 --2- 172.21.15.49:0/1279361969 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff2c805f2c0 0x7ff2c8061780 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:32.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.027+0000 7ff2e1f2a700 1 --2- 172.21.15.49:0/1279361969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2dc0c5f30 0x7ff2dc1368c0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:32.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.027+0000 7ff2e1f2a700 1 -- 172.21.15.49:0/1279361969 >> 172.21.15.49:0/1279361969 conn(0x7ff2dc0628f0 msgr2=0x7ff2dc064a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:32.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.027+0000 7ff2e1f2a700 1 -- 172.21.15.49:0/1279361969 shutdown_connections 2023-11-30T17:19:32.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.027+0000 7ff2e1f2a700 1 -- 172.21.15.49:0/1279361969 wait complete. 2023-11-30T17:19:32.042 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir4 2023-11-30T17:19:32.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:32.042 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-11-30T17:19:32.059 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_09_00_UTC 2023-11-30T17:19:32.059 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_10_00_UTC 2023-11-30T17:19:32.059 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_11_00_UTC 2023-11-30T17:19:32.059 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_12_00_UTC 2023-11-30T17:19:32.059 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_13_00_UTC 2023-11-30T17:19:32.059 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_14_00_UTC 2023-11-30T17:19:32.059 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_15_00_UTC 2023-11-30T17:19:32.059 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_16_00_UTC 2023-11-30T17:19:32.059 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_17_00_UTC 2023-11-30T17:19:32.059 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_18_00_UTC 2023-11-30T17:19:32.059 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_19_00_UTC 2023-11-30T17:19:32.059 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-11-30-17_09_00_UTC 2023-11-30T17:19:32.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:32.060 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-11-30-17_09_00_UTC) 2023-11-30T17:19:32.129 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-11-30-17_10_00_UTC 2023-11-30T17:19:32.129 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:32.129 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-11-30-17_10_00_UTC) 2023-11-30T17:19:32.190 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-11-30-17_11_00_UTC 2023-11-30T17:19:32.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:32.190 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-11-30-17_11_00_UTC) 2023-11-30T17:19:32.251 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-11-30-17_12_00_UTC 2023-11-30T17:19:32.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:32.251 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-11-30-17_12_00_UTC) 2023-11-30T17:19:32.312 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-11-30-17_13_00_UTC 2023-11-30T17:19:32.312 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:32.312 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-11-30-17_13_00_UTC) 2023-11-30T17:19:32.374 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-11-30-17_14_00_UTC 2023-11-30T17:19:32.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:32.374 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-11-30-17_14_00_UTC) 2023-11-30T17:19:32.435 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-11-30-17_15_00_UTC 2023-11-30T17:19:32.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:32.435 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-11-30-17_15_00_UTC) 2023-11-30T17:19:32.496 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-11-30-17_16_00_UTC 2023-11-30T17:19:32.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:32.496 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-11-30-17_16_00_UTC) 2023-11-30T17:19:32.557 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-11-30-17_17_00_UTC 2023-11-30T17:19:32.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:32.558 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-11-30-17_17_00_UTC) 2023-11-30T17:19:32.619 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-11-30-17_18_00_UTC 2023-11-30T17:19:32.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:32.620 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-11-30-17_18_00_UTC) 2023-11-30T17:19:32.681 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-11-30-17_19_00_UTC 2023-11-30T17:19:32.681 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:32.681 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-11-30-17_19_00_UTC) 2023-11-30T17:19:32.742 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:32.743 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4) 2023-11-30T17:19:32.801 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir5 1M 2023-11-30T17:19:32.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.962+0000 7f404956f700 1 Processor -- start 2023-11-30T17:19:32.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.962+0000 7f404956f700 1 -- start start 2023-11-30T17:19:32.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.963+0000 7f404956f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f40441542d0 0x7f40440a9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:32.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.963+0000 7f404956f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40441546b0 0x7f40440aa460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:32.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.963+0000 7f404956f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4044158d50 con 0x7f40440c5fc0 2023-11-30T17:19:32.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.963+0000 7f404956f700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40440c6b60 con 0x7f40441542d0 2023-11-30T17:19:32.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.963+0000 7f404956f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40440aa950 con 0x7f40441546b0 2023-11-30T17:19:32.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.963+0000 7f4043fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f40441542d0 0x7f40440a9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:32.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.963+0000 7f4048d6e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f40440c5fc0 0x7f40440c6450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55108/0 (socket says 172.21.15.49:55108) 2023-11-30T17:19:32.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.963+0000 7f4043fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f40441542d0 0x7f40440a9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53776/0 (socket says 172.21.15.49:53776) 2023-11-30T17:19:32.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.963+0000 7f4048d6e700 1 -- 172.21.15.49:0/3121325239 learned_addr learned my addr 172.21.15.49:0/3121325239 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:32.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.963+0000 7f40437fe700 1 --2- 172.21.15.49:0/3121325239 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40441546b0 0x7f40440aa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:32.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.963+0000 7f4043fff700 1 -- 172.21.15.49:0/3121325239 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40441546b0 msgr2=0x7f40440aa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:32.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.963+0000 7f4043fff700 1 --2- 172.21.15.49:0/3121325239 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40441546b0 0x7f40440aa460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:32.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.963+0000 7f4043fff700 1 -- 172.21.15.49:0/3121325239 >> v1:172.21.15.49:6789/0 conn(0x7f40440c5fc0 legacy=0x7f40440c6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:32.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.963+0000 7f4043fff700 1 -- 172.21.15.49:0/3121325239 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4044158140 con 0x7f40441542d0 2023-11-30T17:19:32.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.963+0000 7f4042ffd700 1 -- 172.21.15.49:0/3121325239 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 475049374 0 0) 0x7f4044158d50 con 0x7f40440c5fc0 2023-11-30T17:19:32.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.963+0000 7f4043fff700 1 --2- 172.21.15.49:0/3121325239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40441542d0 0x7f40440a9f70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f4034009760 tx=0x7f4034009060).ready entity=mon.0 client_cookie=e28d939def79fe8c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:32.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.964+0000 7f4042ffd700 1 -- 172.21.15.49:0/3121325239 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403400f510 con 0x7f40441542d0 2023-11-30T17:19:32.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.964+0000 7f4042ffd700 1 -- 172.21.15.49:0/3121325239 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403400f670 con 0x7f40441542d0 2023-11-30T17:19:32.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.964+0000 7f4042ffd700 1 -- 172.21.15.49:0/3121325239 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403400f9f0 con 0x7f40441542d0 2023-11-30T17:19:32.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.964+0000 7f404956f700 1 -- 172.21.15.49:0/3121325239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40441542d0 msgr2=0x7f40440a9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:32.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.964+0000 7f404956f700 1 --2- 172.21.15.49:0/3121325239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40441542d0 0x7f40440a9f70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f4034009760 tx=0x7f4034009060).stop 2023-11-30T17:19:32.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.964+0000 7f404956f700 1 -- 172.21.15.49:0/3121325239 shutdown_connections 2023-11-30T17:19:32.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.964+0000 7f404956f700 1 --2- 172.21.15.49:0/3121325239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40441542d0 0x7f40440a9f70 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:32.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.964+0000 7f404956f700 1 --2- 172.21.15.49:0/3121325239 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40441546b0 0x7f40440aa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:32.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.964+0000 7f404956f700 1 -- 172.21.15.49:0/3121325239 >> 172.21.15.49:0/3121325239 conn(0x7f40440cb010 msgr2=0x7f40440cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:32.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.964+0000 7f404956f700 1 -- 172.21.15.49:0/3121325239 shutdown_connections 2023-11-30T17:19:32.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.964+0000 7f404956f700 1 -- 172.21.15.49:0/3121325239 wait complete. 2023-11-30T17:19:32.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.965+0000 7f404956f700 1 Processor -- start 2023-11-30T17:19:32.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.966+0000 7f404956f700 1 -- start start 2023-11-30T17:19:32.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.966+0000 7f404956f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40440c5fc0 0x7f40440c4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:32.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.966+0000 7f404956f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40441542d0 0x7f4044144d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:32.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.966+0000 7f404956f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40441546b0 0x7f404414e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:32.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.966+0000 7f404956f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40440aef20 con 0x7f40441546b0 2023-11-30T17:19:32.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.966+0000 7f404956f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40440c46c0 con 0x7f40440c5fc0 2023-11-30T17:19:32.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.966+0000 7f404956f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40440aec40 con 0x7f40441542d0 2023-11-30T17:19:32.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.966+0000 7f4048d6e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40441546b0 0x7f404414e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:32.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.967+0000 7f4048d6e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40441546b0 0x7f404414e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53782/0 (socket says 172.21.15.49:53782) 2023-11-30T17:19:32.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.967+0000 7f4048d6e700 1 -- 172.21.15.49:0/3437792414 learned_addr learned my addr 172.21.15.49:0/3437792414 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:32.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.967+0000 7f40437fe700 1 --2- 172.21.15.49:0/3437792414 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40441542d0 0x7f4044144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:32.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.967+0000 7f4043fff700 1 --2- 172.21.15.49:0/3437792414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40440c5fc0 0x7f40440c4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:32.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.967+0000 7f4048d6e700 1 -- 172.21.15.49:0/3437792414 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40441542d0 msgr2=0x7f4044144d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:32.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.967+0000 7f4048d6e700 1 --2- 172.21.15.49:0/3437792414 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40441542d0 0x7f4044144d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:32.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.967+0000 7f4048d6e700 1 -- 172.21.15.49:0/3437792414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40440c5fc0 msgr2=0x7f40440c4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:32.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.967+0000 7f4048d6e700 1 --2- 172.21.15.49:0/3437792414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40440c5fc0 0x7f40440c4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:32.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.967+0000 7f4048d6e700 1 -- 172.21.15.49:0/3437792414 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40340092a0 con 0x7f40441546b0 2023-11-30T17:19:32.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.967+0000 7f4048d6e700 1 --2- 172.21.15.49:0/3437792414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40441546b0 0x7f404414e400 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f403c00c810 tx=0x7f403c0014d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:32.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.967+0000 7f402bfff700 1 -- 172.21.15.49:0/3437792414 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c005d30 con 0x7f40441546b0 2023-11-30T17:19:32.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.967+0000 7f402bfff700 1 -- 172.21.15.49:0/3437792414 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403c005e90 con 0x7f40441546b0 2023-11-30T17:19:32.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.967+0000 7f404956f700 1 -- 172.21.15.49:0/3437792414 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40440c4070 con 0x7f40441546b0 2023-11-30T17:19:32.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.967+0000 7f402bfff700 1 -- 172.21.15.49:0/3437792414 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c0072e0 con 0x7f40441546b0 2023-11-30T17:19:32.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.967+0000 7f404956f700 1 -- 172.21.15.49:0/3437792414 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40441451f0 con 0x7f40441546b0 2023-11-30T17:19:32.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.968+0000 7f404956f700 1 -- 172.21.15.49:0/3437792414 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40440c3eb0 con 0x7f40441546b0 2023-11-30T17:19:32.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.969+0000 7f402bfff700 1 -- 172.21.15.49:0/3437792414 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f403c007710 con 0x7f40441546b0 2023-11-30T17:19:32.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.969+0000 7f402bfff700 1 --2- 172.21.15.49:0/3437792414 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f403005f2c0 0x7f4030061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:32.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.969+0000 7f402bfff700 1 -- 172.21.15.49:0/3437792414 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 7018+0+0 (secure 0 0 0) 0x7f403c07a0e0 con 0x7f40441546b0 2023-11-30T17:19:32.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.969+0000 7f4043fff700 1 --2- 172.21.15.49:0/3437792414 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f403005f2c0 0x7f4030061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:32.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.970+0000 7f4043fff700 1 --2- 172.21.15.49:0/3437792414 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f403005f2c0 0x7f4030061780 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f4034009fd0 tx=0x7f4034017000).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:32.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:32.974+0000 7f402bfff700 1 -- 172.21.15.49:0/3437792414 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f403c04aeb0 con 0x7f40441546b0 2023-11-30T17:19:33.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:33.239+0000 7f404956f700 1 -- 172.21.15.49:0/3437792414 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f40440c4830 con 0x7f403005f2c0 2023-11-30T17:19:33.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:33.243+0000 7f402bfff700 1 -- 172.21.15.49:0/3437792414 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f40440c4830 con 0x7f403005f2c0 2023-11-30T17:19:33.248 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule removed for path /snap_test_dir1/dir5 2023-11-30T17:19:33.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:33.247+0000 7f404956f700 1 -- 172.21.15.49:0/3437792414 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f403005f2c0 msgr2=0x7f4030061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:33.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:33.247+0000 7f404956f700 1 --2- 172.21.15.49:0/3437792414 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f403005f2c0 0x7f4030061780 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f4034009fd0 tx=0x7f4034017000).stop 2023-11-30T17:19:33.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:33.247+0000 7f404956f700 1 -- 172.21.15.49:0/3437792414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40441546b0 msgr2=0x7f404414e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:33.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:33.247+0000 7f404956f700 1 --2- 172.21.15.49:0/3437792414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40441546b0 0x7f404414e400 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f403c00c810 tx=0x7f403c0014d0).stop 2023-11-30T17:19:33.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:33.247+0000 7f404956f700 1 -- 172.21.15.49:0/3437792414 shutdown_connections 2023-11-30T17:19:33.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:33.247+0000 7f404956f700 1 --2- 172.21.15.49:0/3437792414 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f403005f2c0 0x7f4030061780 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:33.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:33.247+0000 7f404956f700 1 --2- 172.21.15.49:0/3437792414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40441546b0 0x7f404414e400 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:33.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:33.247+0000 7f404956f700 1 --2- 172.21.15.49:0/3437792414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40440c5fc0 0x7f40440c4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:33.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:33.247+0000 7f404956f700 1 --2- 172.21.15.49:0/3437792414 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40441542d0 0x7f4044144d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:33.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:33.247+0000 7f404956f700 1 -- 172.21.15.49:0/3437792414 >> 172.21.15.49:0/3437792414 conn(0x7f40440cb010 msgr2=0x7f40440c0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:33.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:33.247+0000 7f404956f700 1 -- 172.21.15.49:0/3437792414 shutdown_connections 2023-11-30T17:19:33.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:33.247+0000 7f404956f700 1 -- 172.21.15.49:0/3437792414 wait complete. 2023-11-30T17:19:33.269 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir5 2023-11-30T17:19:33.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:33.269 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-11-30T17:19:33.292 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_09_00_UTC 2023-11-30T17:19:33.293 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_10_00_UTC 2023-11-30T17:19:33.293 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_11_00_UTC 2023-11-30T17:19:33.293 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_12_00_UTC 2023-11-30T17:19:33.293 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_13_00_UTC 2023-11-30T17:19:33.293 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_14_00_UTC 2023-11-30T17:19:33.293 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_15_00_UTC 2023-11-30T17:19:33.293 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_16_00_UTC 2023-11-30T17:19:33.293 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_17_00_UTC 2023-11-30T17:19:33.293 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_18_00_UTC 2023-11-30T17:19:33.293 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_19_00_UTC 2023-11-30T17:19:33.294 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-11-30-17_09_00_UTC 2023-11-30T17:19:33.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:33.294 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-11-30-17_09_00_UTC) 2023-11-30T17:19:33.359 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-11-30-17_10_00_UTC 2023-11-30T17:19:33.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:33.359 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-11-30-17_10_00_UTC) 2023-11-30T17:19:33.423 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-11-30-17_11_00_UTC 2023-11-30T17:19:33.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:33.423 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-11-30-17_11_00_UTC) 2023-11-30T17:19:33.485 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-11-30-17_12_00_UTC 2023-11-30T17:19:33.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:33.485 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-11-30-17_12_00_UTC) 2023-11-30T17:19:33.546 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-11-30-17_13_00_UTC 2023-11-30T17:19:33.546 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:33.546 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-11-30-17_13_00_UTC) 2023-11-30T17:19:33.614 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-11-30-17_14_00_UTC 2023-11-30T17:19:33.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:33.614 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-11-30-17_14_00_UTC) 2023-11-30T17:19:33.675 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-11-30-17_15_00_UTC 2023-11-30T17:19:33.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:33.676 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-11-30-17_15_00_UTC) 2023-11-30T17:19:33.735 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-11-30-17_16_00_UTC 2023-11-30T17:19:33.736 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:33.736 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-11-30-17_16_00_UTC) 2023-11-30T17:19:33.797 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-11-30-17_17_00_UTC 2023-11-30T17:19:33.797 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:33.797 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-11-30-17_17_00_UTC) 2023-11-30T17:19:33.859 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-11-30-17_18_00_UTC 2023-11-30T17:19:33.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:33.859 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-11-30-17_18_00_UTC) 2023-11-30T17:19:33.919 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-11-30-17_19_00_UTC 2023-11-30T17:19:33.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:33.919 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-11-30-17_19_00_UTC) 2023-11-30T17:19:33.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:33.980 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5) 2023-11-30T17:19:34.039 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir6 1M 2023-11-30T17:19:34.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.199+0000 7f4931de3700 1 Processor -- start 2023-11-30T17:19:34.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.199+0000 7f4931de3700 1 -- start start 2023-11-30T17:19:34.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.200+0000 7f4931de3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f492c154910 0x7f492c0a7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:34.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.200+0000 7f4931de3700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f492c0c6630 con 0x7f492c0aa220 2023-11-30T17:19:34.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.200+0000 7f4931de3700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f492c064230 con 0x7f492c154530 2023-11-30T17:19:34.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.200+0000 7f4931de3700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f492c0c6390 con 0x7f492c154910 2023-11-30T17:19:34.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.200+0000 7f492affd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f492c154910 0x7f492c0a7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:34.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.200+0000 7f492affd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f492c154910 0x7f492c0a7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53786/0 (socket says 172.21.15.49:53786) 2023-11-30T17:19:34.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.200+0000 7f492affd700 1 -- 172.21.15.49:0/3022330946 learned_addr learned my addr 172.21.15.49:0/3022330946 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:34.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.200+0000 7f492bfff700 1 --1- 172.21.15.49:0/3022330946 >> v1:172.21.15.49:6789/0 conn(0x7f492c0aa220 0x7f492c0c6ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55114/0 (socket says 172.21.15.49:55114) 2023-11-30T17:19:34.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.200+0000 7f492affd700 1 -- 172.21.15.49:0/3022330946 >> v1:172.21.15.115:6789/0 conn(0x7f492c154530 legacy=0x7f492c0c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:34.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.200+0000 7f492affd700 1 -- 172.21.15.49:0/3022330946 >> v1:172.21.15.49:6789/0 conn(0x7f492c0aa220 legacy=0x7f492c0c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:34.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.201+0000 7f492affd700 1 -- 172.21.15.49:0/3022330946 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492c064510 con 0x7f492c154910 2023-11-30T17:19:34.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.201+0000 7f492affd700 1 --2- 172.21.15.49:0/3022330946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f492c154910 0x7f492c0a7ff0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f4914006fd0 tx=0x7f49140090f0).ready entity=mon.0 client_cookie=736c3b6abfb2ac92 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:34.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.201+0000 7f492a7fc700 1 -- 172.21.15.49:0/3022330946 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491400f510 con 0x7f492c154910 2023-11-30T17:19:34.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.201+0000 7f492a7fc700 1 -- 172.21.15.49:0/3022330946 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491400f670 con 0x7f492c154910 2023-11-30T17:19:34.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.201+0000 7f492a7fc700 1 -- 172.21.15.49:0/3022330946 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491400fa10 con 0x7f492c154910 2023-11-30T17:19:34.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.201+0000 7f4931de3700 1 -- 172.21.15.49:0/3022330946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f492c154910 msgr2=0x7f492c0a7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:34.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.201+0000 7f4931de3700 1 --2- 172.21.15.49:0/3022330946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f492c154910 0x7f492c0a7ff0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f4914006fd0 tx=0x7f49140090f0).stop 2023-11-30T17:19:34.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.201+0000 7f4931de3700 1 -- 172.21.15.49:0/3022330946 shutdown_connections 2023-11-30T17:19:34.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.201+0000 7f4931de3700 1 --2- 172.21.15.49:0/3022330946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f492c154910 0x7f492c0a7ff0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:34.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.201+0000 7f4931de3700 1 -- 172.21.15.49:0/3022330946 >> 172.21.15.49:0/3022330946 conn(0x7f492c094930 msgr2=0x7f492c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:34.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.201+0000 7f4931de3700 1 -- 172.21.15.49:0/3022330946 shutdown_connections 2023-11-30T17:19:34.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.201+0000 7f4931de3700 1 -- 172.21.15.49:0/3022330946 wait complete. 2023-11-30T17:19:34.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.203+0000 7f4931de3700 1 Processor -- start 2023-11-30T17:19:34.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.203+0000 7f4931de3700 1 -- start start 2023-11-30T17:19:34.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.203+0000 7f4931de3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f492c0aa220 0x7f492c0c40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:34.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.203+0000 7f4931de3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f492c154530 0x7f492c14f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:34.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.203+0000 7f4931de3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f492c154910 0x7f492c155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:34.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.203+0000 7f4931de3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492c1584e0 con 0x7f492c154530 2023-11-30T17:19:34.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.203+0000 7f4931de3700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492c1587c0 con 0x7f492c0aa220 2023-11-30T17:19:34.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.203+0000 7f4931de3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492c158aa0 con 0x7f492c154910 2023-11-30T17:19:34.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.203+0000 7f492affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f492c154530 0x7f492c14f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:34.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.203+0000 7f492affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f492c154530 0x7f492c14f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53796/0 (socket says 172.21.15.49:53796) 2023-11-30T17:19:34.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.203+0000 7f492affd700 1 -- 172.21.15.49:0/2073467639 learned_addr learned my addr 172.21.15.49:0/2073467639 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:34.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.203+0000 7f492b7fe700 1 --2- 172.21.15.49:0/2073467639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f492c0aa220 0x7f492c0c40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:34.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.204+0000 7f492bfff700 1 --2- 172.21.15.49:0/2073467639 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f492c154910 0x7f492c155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:34.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.204+0000 7f492affd700 1 -- 172.21.15.49:0/2073467639 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f492c154910 msgr2=0x7f492c155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:34.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.204+0000 7f492affd700 1 --2- 172.21.15.49:0/2073467639 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f492c154910 0x7f492c155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:34.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.204+0000 7f492affd700 1 -- 172.21.15.49:0/2073467639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f492c0aa220 msgr2=0x7f492c0c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:34.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.204+0000 7f492affd700 1 --2- 172.21.15.49:0/2073467639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f492c0aa220 0x7f492c0c40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:34.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.204+0000 7f492affd700 1 -- 172.21.15.49:0/2073467639 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4914009370 con 0x7f492c154530 2023-11-30T17:19:34.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.204+0000 7f492affd700 1 --2- 172.21.15.49:0/2073467639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f492c154530 0x7f492c14f250 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f4914009f50 tx=0x7f4914017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:34.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.204+0000 7f49237fe700 1 -- 172.21.15.49:0/2073467639 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491400fea0 con 0x7f492c154530 2023-11-30T17:19:34.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.204+0000 7f49237fe700 1 -- 172.21.15.49:0/2073467639 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4914006950 con 0x7f492c154530 2023-11-30T17:19:34.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.204+0000 7f4931de3700 1 -- 172.21.15.49:0/2073467639 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f492c158d80 con 0x7f492c154530 2023-11-30T17:19:34.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.204+0000 7f49237fe700 1 -- 172.21.15.49:0/2073467639 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491400f7e0 con 0x7f492c154530 2023-11-30T17:19:34.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.204+0000 7f4931de3700 1 -- 172.21.15.49:0/2073467639 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f492c0c3c10 con 0x7f492c154530 2023-11-30T17:19:34.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.205+0000 7f4931de3700 1 -- 172.21.15.49:0/2073467639 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f492c06c860 con 0x7f492c154530 2023-11-30T17:19:34.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.205+0000 7f49237fe700 1 -- 172.21.15.49:0/2073467639 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f4914022020 con 0x7f492c154530 2023-11-30T17:19:34.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.206+0000 7f49237fe700 1 --2- 172.21.15.49:0/2073467639 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f490c05f2c0 0x7f490c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:34.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.206+0000 7f49237fe700 1 -- 172.21.15.49:0/2073467639 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6906+0+0 (secure 0 0 0) 0x7f491407bea0 con 0x7f492c154530 2023-11-30T17:19:34.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.206+0000 7f492b7fe700 1 --2- 172.21.15.49:0/2073467639 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f490c05f2c0 0x7f490c061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:34.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.206+0000 7f492b7fe700 1 --2- 172.21.15.49:0/2073467639 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f490c05f2c0 0x7f490c061780 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f491c002d20 tx=0x7f491c0015b0).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:34.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.210+0000 7f49237fe700 1 -- 172.21.15.49:0/2073467639 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f491404cce0 con 0x7f492c154530 2023-11-30T17:19:34.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.409+0000 7f4931de3700 1 -- 172.21.15.49:0/2073467639 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f492c158930 con 0x7f490c05f2c0 2023-11-30T17:19:34.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.414+0000 7f49237fe700 1 -- 172.21.15.49:0/2073467639 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f492c158930 con 0x7f490c05f2c0 2023-11-30T17:19:34.416 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule removed for path /snap_test_dir1/dir6 2023-11-30T17:19:34.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.416+0000 7f4931de3700 1 -- 172.21.15.49:0/2073467639 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f490c05f2c0 msgr2=0x7f490c061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:34.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.416+0000 7f4931de3700 1 --2- 172.21.15.49:0/2073467639 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f490c05f2c0 0x7f490c061780 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f491c002d20 tx=0x7f491c0015b0).stop 2023-11-30T17:19:34.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.416+0000 7f4931de3700 1 -- 172.21.15.49:0/2073467639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f492c154530 msgr2=0x7f492c14f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:34.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.416+0000 7f4931de3700 1 --2- 172.21.15.49:0/2073467639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f492c154530 0x7f492c14f250 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f4914009f50 tx=0x7f4914017000).stop 2023-11-30T17:19:34.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.416+0000 7f4931de3700 1 -- 172.21.15.49:0/2073467639 shutdown_connections 2023-11-30T17:19:34.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.416+0000 7f4931de3700 1 --2- 172.21.15.49:0/2073467639 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f492c154910 0x7f492c155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:34.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.416+0000 7f4931de3700 1 --2- 172.21.15.49:0/2073467639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f492c0aa220 0x7f492c0c40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:34.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.416+0000 7f4931de3700 1 --2- 172.21.15.49:0/2073467639 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f490c05f2c0 0x7f490c061780 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:34.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.416+0000 7f4931de3700 1 --2- 172.21.15.49:0/2073467639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f492c154530 0x7f492c14f250 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:34.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.416+0000 7f4931de3700 1 -- 172.21.15.49:0/2073467639 >> 172.21.15.49:0/2073467639 conn(0x7f492c094930 msgr2=0x7f492c156f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:34.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.416+0000 7f4931de3700 1 -- 172.21.15.49:0/2073467639 shutdown_connections 2023-11-30T17:19:34.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:34.416+0000 7f4931de3700 1 -- 172.21.15.49:0/2073467639 wait complete. 2023-11-30T17:19:34.430 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir6 2023-11-30T17:19:34.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:34.430 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-11-30T17:19:34.446 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_09_00_UTC 2023-11-30T17:19:34.447 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_10_00_UTC 2023-11-30T17:19:34.447 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_11_00_UTC 2023-11-30T17:19:34.447 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_12_00_UTC 2023-11-30T17:19:34.447 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_13_00_UTC 2023-11-30T17:19:34.447 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_14_00_UTC 2023-11-30T17:19:34.447 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_15_00_UTC 2023-11-30T17:19:34.447 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_16_00_UTC 2023-11-30T17:19:34.447 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_17_00_UTC 2023-11-30T17:19:34.447 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_18_00_UTC 2023-11-30T17:19:34.447 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_19_00_UTC 2023-11-30T17:19:34.448 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-11-30-17_09_00_UTC 2023-11-30T17:19:34.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:34.448 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-11-30-17_09_00_UTC) 2023-11-30T17:19:34.511 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-11-30-17_10_00_UTC 2023-11-30T17:19:34.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:34.511 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-11-30-17_10_00_UTC) 2023-11-30T17:19:34.572 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-11-30-17_11_00_UTC 2023-11-30T17:19:34.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:34.572 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-11-30-17_11_00_UTC) 2023-11-30T17:19:34.633 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-11-30-17_12_00_UTC 2023-11-30T17:19:34.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:34.634 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-11-30-17_12_00_UTC) 2023-11-30T17:19:34.697 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-11-30-17_13_00_UTC 2023-11-30T17:19:34.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:34.697 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-11-30-17_13_00_UTC) 2023-11-30T17:19:34.761 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-11-30-17_14_00_UTC 2023-11-30T17:19:34.761 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:34.761 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-11-30-17_14_00_UTC) 2023-11-30T17:19:34.823 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-11-30-17_15_00_UTC 2023-11-30T17:19:34.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:34.823 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-11-30-17_15_00_UTC) 2023-11-30T17:19:34.885 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-11-30-17_16_00_UTC 2023-11-30T17:19:34.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:34.886 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-11-30-17_16_00_UTC) 2023-11-30T17:19:34.946 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-11-30-17_17_00_UTC 2023-11-30T17:19:34.946 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:34.946 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-11-30-17_17_00_UTC) 2023-11-30T17:19:35.018 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-11-30-17_18_00_UTC 2023-11-30T17:19:35.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:35.018 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-11-30-17_18_00_UTC) 2023-11-30T17:19:35.080 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-11-30-17_19_00_UTC 2023-11-30T17:19:35.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:35.080 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-11-30-17_19_00_UTC) 2023-11-30T17:19:35.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:35.141 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6) 2023-11-30T17:19:35.202 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir7 1M 2023-11-30T17:19:35.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.373+0000 7f79bebb6700 1 Processor -- start 2023-11-30T17:19:35.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.373+0000 7f79bebb6700 1 -- start start 2023-11-30T17:19:35.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.374+0000 7f79bebb6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f79b8154610 0x7f79b81582e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:35.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.374+0000 7f79bebb6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79b80ab3b0 0x7f79b80c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:35.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.374+0000 7f79bebb6700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f79b80aa1c0 0x7f79b80aa630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:35.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.374+0000 7f79bebb6700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b8159210 con 0x7f79b8154610 2023-11-30T17:19:35.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.374+0000 7f79bebb6700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80c0c70 con 0x7f79b80aa1c0 2023-11-30T17:19:35.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.374+0000 7f79bebb6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b80aab20 con 0x7f79b80ab3b0 2023-11-30T17:19:35.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.374+0000 7f79bc952700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f79b8154610 0x7f79b81582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:35.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.374+0000 7f79bc952700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f79b8154610 0x7f79b81582e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53802/0 (socket says 172.21.15.49:53802) 2023-11-30T17:19:35.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.374+0000 7f79bc952700 1 -- 172.21.15.49:0/1659178332 learned_addr learned my addr 172.21.15.49:0/1659178332 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:35.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.374+0000 7f79b7fff700 1 --2- 172.21.15.49:0/1659178332 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79b80ab3b0 0x7f79b80c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:35.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.374+0000 7f79bd153700 1 --2- 172.21.15.49:0/1659178332 >> v2:172.21.15.115:3300/0 conn(0x7f79b80aa1c0 0x7f79b80aa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:35.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.374+0000 7f79bc952700 1 -- 172.21.15.49:0/1659178332 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79b80ab3b0 msgr2=0x7f79b80c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:35.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.374+0000 7f79bc952700 1 --2- 172.21.15.49:0/1659178332 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79b80ab3b0 0x7f79b80c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:35.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.374+0000 7f79bc952700 1 -- 172.21.15.49:0/1659178332 >> v2:172.21.15.115:3300/0 conn(0x7f79b80aa1c0 msgr2=0x7f79b80aa630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:35.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.374+0000 7f79bc952700 1 --2- 172.21.15.49:0/1659178332 >> v2:172.21.15.115:3300/0 conn(0x7f79b80aa1c0 0x7f79b80aa630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:35.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.374+0000 7f79bc952700 1 -- 172.21.15.49:0/1659178332 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b8158970 con 0x7f79b8154610 2023-11-30T17:19:35.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.374+0000 7f79bc952700 1 --2- 172.21.15.49:0/1659178332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79b8154610 0x7f79b81582e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f79b80c5a10 tx=0x7f79ac0090f0).ready entity=mon.0 client_cookie=1c7c1398b9e55419 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:35.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.374+0000 7f79b77fe700 1 -- 172.21.15.49:0/1659178332 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac00b600 con 0x7f79b8154610 2023-11-30T17:19:35.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.374+0000 7f79b77fe700 1 -- 172.21.15.49:0/1659178332 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ac00b760 con 0x7f79b8154610 2023-11-30T17:19:35.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.374+0000 7f79b77fe700 1 -- 172.21.15.49:0/1659178332 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac00bae0 con 0x7f79b8154610 2023-11-30T17:19:35.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.375+0000 7f79bebb6700 1 -- 172.21.15.49:0/1659178332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79b8154610 msgr2=0x7f79b81582e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:35.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.375+0000 7f79bebb6700 1 --2- 172.21.15.49:0/1659178332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79b8154610 0x7f79b81582e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f79b80c5a10 tx=0x7f79ac0090f0).stop 2023-11-30T17:19:35.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.375+0000 7f79bebb6700 1 -- 172.21.15.49:0/1659178332 shutdown_connections 2023-11-30T17:19:35.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.375+0000 7f79bebb6700 1 --2- 172.21.15.49:0/1659178332 >> v2:172.21.15.115:3300/0 conn(0x7f79b80aa1c0 0x7f79b80aa630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:35.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.375+0000 7f79bebb6700 1 --2- 172.21.15.49:0/1659178332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79b8154610 0x7f79b81582e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:35.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.375+0000 7f79bebb6700 1 --2- 172.21.15.49:0/1659178332 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79b80ab3b0 0x7f79b80c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:35.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.375+0000 7f79bebb6700 1 -- 172.21.15.49:0/1659178332 >> 172.21.15.49:0/1659178332 conn(0x7f79b80655a0 msgr2=0x7f79b8069e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:35.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.375+0000 7f79bebb6700 1 -- 172.21.15.49:0/1659178332 shutdown_connections 2023-11-30T17:19:35.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.375+0000 7f79bebb6700 1 -- 172.21.15.49:0/1659178332 wait complete. 2023-11-30T17:19:35.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.376+0000 7f79bebb6700 1 Processor -- start 2023-11-30T17:19:35.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.376+0000 7f79bebb6700 1 -- start start 2023-11-30T17:19:35.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.377+0000 7f79bebb6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79b80aa1c0 0x7f79b81549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:35.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.377+0000 7f79bebb6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79b8154610 0x7f79b8156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:35.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.377+0000 7f79bebb6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79b8165ae0 0x7f79b8159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:35.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.377+0000 7f79bebb6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b8155f00 con 0x7f79b8165ae0 2023-11-30T17:19:35.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.377+0000 7f79bebb6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b81552f0 con 0x7f79b8154610 2023-11-30T17:19:35.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.377+0000 7f79bebb6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b81555d0 con 0x7f79b80aa1c0 2023-11-30T17:19:35.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.377+0000 7f79bd153700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79b8165ae0 0x7f79b8159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:35.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.377+0000 7f79bd153700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79b8165ae0 0x7f79b8159c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53804/0 (socket says 172.21.15.49:53804) 2023-11-30T17:19:35.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.377+0000 7f79bd153700 1 -- 172.21.15.49:0/3952745503 learned_addr learned my addr 172.21.15.49:0/3952745503 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:35.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.377+0000 7f79bc952700 1 --2- 172.21.15.49:0/3952745503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79b80aa1c0 0x7f79b81549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:35.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.377+0000 7f79b7fff700 1 --2- 172.21.15.49:0/3952745503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79b8154610 0x7f79b8156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:35.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.377+0000 7f79bd153700 1 -- 172.21.15.49:0/3952745503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79b80aa1c0 msgr2=0x7f79b81549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:35.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.377+0000 7f79bd153700 1 --2- 172.21.15.49:0/3952745503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79b80aa1c0 0x7f79b81549f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:35.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.377+0000 7f79bd153700 1 -- 172.21.15.49:0/3952745503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79b8154610 msgr2=0x7f79b8156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:35.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.377+0000 7f79bd153700 1 --2- 172.21.15.49:0/3952745503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79b8154610 0x7f79b8156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:35.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.377+0000 7f79bd153700 1 -- 172.21.15.49:0/3952745503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ac009370 con 0x7f79b8165ae0 2023-11-30T17:19:35.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.377+0000 7f79b7fff700 1 --2- 172.21.15.49:0/3952745503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79b8154610 0x7f79b8156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:19:35.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.378+0000 7f79bd153700 1 --2- 172.21.15.49:0/3952745503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79b8165ae0 0x7f79b8159c30 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f79b0007f20 tx=0x7f79b0009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:35.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.378+0000 7f79b4ff9700 1 -- 172.21.15.49:0/3952745503 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b000ebf0 con 0x7f79b8165ae0 2023-11-30T17:19:35.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.378+0000 7f79b4ff9700 1 -- 172.21.15.49:0/3952745503 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b000ed50 con 0x7f79b8165ae0 2023-11-30T17:19:35.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.378+0000 7f79bebb6700 1 -- 172.21.15.49:0/3952745503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b81558b0 con 0x7f79b8165ae0 2023-11-30T17:19:35.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.378+0000 7f79b4ff9700 1 -- 172.21.15.49:0/3952745503 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b0014610 con 0x7f79b8165ae0 2023-11-30T17:19:35.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.378+0000 7f79bebb6700 1 -- 172.21.15.49:0/3952745503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b8154ee0 con 0x7f79b8165ae0 2023-11-30T17:19:35.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.379+0000 7f79bebb6700 1 -- 172.21.15.49:0/3952745503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b8156070 con 0x7f79b8165ae0 2023-11-30T17:19:35.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.379+0000 7f79b4ff9700 1 -- 172.21.15.49:0/3952745503 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f79b0014980 con 0x7f79b8165ae0 2023-11-30T17:19:35.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.379+0000 7f79b4ff9700 1 --2- 172.21.15.49:0/3952745503 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f799c05f2c0 0x7f799c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:35.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.380+0000 7f79b4ff9700 1 -- 172.21.15.49:0/3952745503 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 7034+0+0 (secure 0 0 0) 0x7f79b007abe0 con 0x7f79b8165ae0 2023-11-30T17:19:35.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.380+0000 7f79bc952700 1 --2- 172.21.15.49:0/3952745503 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f799c05f2c0 0x7f799c061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:35.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.380+0000 7f79bc952700 1 --2- 172.21.15.49:0/3952745503 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f799c05f2c0 0x7f799c061780 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f79ac009130 tx=0x7f79ac017000).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:35.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.384+0000 7f79b4ff9700 1 -- 172.21.15.49:0/3952745503 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f79b004b9a0 con 0x7f79b8165ae0 2023-11-30T17:19:35.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.596+0000 7f79bebb6700 1 -- 172.21.15.49:0/3952745503 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f79b8158c50 con 0x7f799c05f2c0 2023-11-30T17:19:35.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.600+0000 7f79b4ff9700 1 -- 172.21.15.49:0/3952745503 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f79b8158c50 con 0x7f799c05f2c0 2023-11-30T17:19:35.603 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule removed for path /snap_test_dir1/dir7 2023-11-30T17:19:35.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.602+0000 7f79bebb6700 1 -- 172.21.15.49:0/3952745503 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f799c05f2c0 msgr2=0x7f799c061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:35.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.602+0000 7f79bebb6700 1 --2- 172.21.15.49:0/3952745503 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f799c05f2c0 0x7f799c061780 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f79ac009130 tx=0x7f79ac017000).stop 2023-11-30T17:19:35.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.602+0000 7f79bebb6700 1 -- 172.21.15.49:0/3952745503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79b8165ae0 msgr2=0x7f79b8159c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:35.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.602+0000 7f79bebb6700 1 --2- 172.21.15.49:0/3952745503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79b8165ae0 0x7f79b8159c30 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f79b0007f20 tx=0x7f79b0009860).stop 2023-11-30T17:19:35.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.602+0000 7f79bebb6700 1 -- 172.21.15.49:0/3952745503 shutdown_connections 2023-11-30T17:19:35.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.602+0000 7f79bebb6700 1 --2- 172.21.15.49:0/3952745503 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f799c05f2c0 0x7f799c061780 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:35.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.602+0000 7f79bebb6700 1 --2- 172.21.15.49:0/3952745503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79b8165ae0 0x7f79b8159c30 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:35.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.602+0000 7f79bebb6700 1 --2- 172.21.15.49:0/3952745503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79b80aa1c0 0x7f79b81549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:35.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.602+0000 7f79bebb6700 1 --2- 172.21.15.49:0/3952745503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79b8154610 0x7f79b8156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:35.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.602+0000 7f79bebb6700 1 -- 172.21.15.49:0/3952745503 >> 172.21.15.49:0/3952745503 conn(0x7f79b80655a0 msgr2=0x7f79b80c1100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:35.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.602+0000 7f79bebb6700 1 -- 172.21.15.49:0/3952745503 shutdown_connections 2023-11-30T17:19:35.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:35.602+0000 7f79bebb6700 1 -- 172.21.15.49:0/3952745503 wait complete. 2023-11-30T17:19:35.616 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir7 2023-11-30T17:19:35.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:35.617 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-11-30T17:19:35.633 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_09_00_UTC 2023-11-30T17:19:35.633 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_10_00_UTC 2023-11-30T17:19:35.633 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_11_00_UTC 2023-11-30T17:19:35.633 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_12_00_UTC 2023-11-30T17:19:35.633 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_13_00_UTC 2023-11-30T17:19:35.633 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_14_00_UTC 2023-11-30T17:19:35.633 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_15_00_UTC 2023-11-30T17:19:35.633 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_16_00_UTC 2023-11-30T17:19:35.634 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_17_00_UTC 2023-11-30T17:19:35.634 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_18_00_UTC 2023-11-30T17:19:35.634 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_19_00_UTC 2023-11-30T17:19:35.634 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-11-30-17_09_00_UTC 2023-11-30T17:19:35.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:35.634 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-11-30-17_09_00_UTC) 2023-11-30T17:19:35.696 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-11-30-17_10_00_UTC 2023-11-30T17:19:35.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:35.696 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-11-30-17_10_00_UTC) 2023-11-30T17:19:35.757 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-11-30-17_11_00_UTC 2023-11-30T17:19:35.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:35.757 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-11-30-17_11_00_UTC) 2023-11-30T17:19:35.818 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-11-30-17_12_00_UTC 2023-11-30T17:19:35.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:35.818 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-11-30-17_12_00_UTC) 2023-11-30T17:19:35.880 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-11-30-17_13_00_UTC 2023-11-30T17:19:35.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:35.880 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-11-30-17_13_00_UTC) 2023-11-30T17:19:35.943 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-11-30-17_14_00_UTC 2023-11-30T17:19:35.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:35.943 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-11-30-17_14_00_UTC) 2023-11-30T17:19:36.005 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-11-30-17_15_00_UTC 2023-11-30T17:19:36.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:36.005 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-11-30-17_15_00_UTC) 2023-11-30T17:19:36.077 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-11-30-17_16_00_UTC 2023-11-30T17:19:36.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:36.078 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-11-30-17_16_00_UTC) 2023-11-30T17:19:36.139 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-11-30-17_17_00_UTC 2023-11-30T17:19:36.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:36.139 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-11-30-17_17_00_UTC) 2023-11-30T17:19:36.200 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-11-30-17_18_00_UTC 2023-11-30T17:19:36.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:36.200 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-11-30-17_18_00_UTC) 2023-11-30T17:19:36.262 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-11-30-17_19_00_UTC 2023-11-30T17:19:36.263 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:36.263 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-11-30-17_19_00_UTC) 2023-11-30T17:19:36.329 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:36.329 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7) 2023-11-30T17:19:36.387 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir8 1M 2023-11-30T17:19:36.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.556+0000 7efc9a7d6700 1 Processor -- start 2023-11-30T17:19:36.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.556+0000 7efc9a7d6700 1 -- start start 2023-11-30T17:19:36.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.556+0000 7efc9a7d6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc941373a0 0x7efc940c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:36.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.556+0000 7efc9a7d6700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efc94064b00 0x7efc940c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:36.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.556+0000 7efc9a7d6700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc940c68d0 con 0x7efc940c5f30 2023-11-30T17:19:36.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.556+0000 7efc9a7d6700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc94158e20 con 0x7efc941373a0 2023-11-30T17:19:36.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.556+0000 7efc9a7d6700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc941582a0 con 0x7efc94064b00 2023-11-30T17:19:36.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.557+0000 7efc93fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc941373a0 0x7efc940c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:36.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.557+0000 7efc937fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7efc940c5f30 0x7efc940669a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55126/0 (socket says 172.21.15.49:55126) 2023-11-30T17:19:36.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.557+0000 7efc93fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc941373a0 0x7efc940c72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53812/0 (socket says 172.21.15.49:53812) 2023-11-30T17:19:36.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.557+0000 7efc937fe700 1 -- 172.21.15.49:0/613575881 learned_addr learned my addr 172.21.15.49:0/613575881 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:36.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.557+0000 7efc98d73700 1 --2- 172.21.15.49:0/613575881 >> v2:172.21.15.115:3300/0 conn(0x7efc94064b00 0x7efc940c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:36.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.557+0000 7efc93fff700 1 -- 172.21.15.49:0/613575881 >> v2:172.21.15.115:3300/0 conn(0x7efc94064b00 msgr2=0x7efc940c63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:36.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.557+0000 7efc93fff700 1 --2- 172.21.15.49:0/613575881 >> v2:172.21.15.115:3300/0 conn(0x7efc94064b00 0x7efc940c63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:36.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.557+0000 7efc93fff700 1 -- 172.21.15.49:0/613575881 >> v1:172.21.15.49:6789/0 conn(0x7efc940c5f30 legacy=0x7efc940669a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:36.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.557+0000 7efc92ffd700 1 -- 172.21.15.49:0/613575881 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 498309680 0 0) 0x7efc88001110 con 0x7efc940c5f30 2023-11-30T17:19:36.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.557+0000 7efc93fff700 1 -- 172.21.15.49:0/613575881 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc94158580 con 0x7efc941373a0 2023-11-30T17:19:36.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.557+0000 7efc93fff700 1 --2- 172.21.15.49:0/613575881 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc941373a0 0x7efc940c72e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7efc940c5b00 tx=0x7efc84009060).ready entity=mon.0 client_cookie=c490a6b9d724783c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:36.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.557+0000 7efc92ffd700 1 -- 172.21.15.49:0/613575881 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8400b580 con 0x7efc941373a0 2023-11-30T17:19:36.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.557+0000 7efc92ffd700 1 -- 172.21.15.49:0/613575881 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8400b6e0 con 0x7efc941373a0 2023-11-30T17:19:36.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.557+0000 7efc92ffd700 1 -- 172.21.15.49:0/613575881 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8400ba60 con 0x7efc941373a0 2023-11-30T17:19:36.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.558+0000 7efc9a7d6700 1 -- 172.21.15.49:0/613575881 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc941373a0 msgr2=0x7efc940c72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:36.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.558+0000 7efc9a7d6700 1 --2- 172.21.15.49:0/613575881 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc941373a0 0x7efc940c72e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7efc940c5b00 tx=0x7efc84009060).stop 2023-11-30T17:19:36.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.558+0000 7efc9a7d6700 1 -- 172.21.15.49:0/613575881 shutdown_connections 2023-11-30T17:19:36.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.558+0000 7efc9a7d6700 1 --2- 172.21.15.49:0/613575881 >> v2:172.21.15.115:3300/0 conn(0x7efc94064b00 0x7efc940c63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:36.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.558+0000 7efc9a7d6700 1 --2- 172.21.15.49:0/613575881 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc941373a0 0x7efc940c72e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:36.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.558+0000 7efc9a7d6700 1 -- 172.21.15.49:0/613575881 >> 172.21.15.49:0/613575881 conn(0x7efc940628f0 msgr2=0x7efc94062d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:36.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.558+0000 7efc9a7d6700 1 -- 172.21.15.49:0/613575881 shutdown_connections 2023-11-30T17:19:36.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.558+0000 7efc9a7d6700 1 -- 172.21.15.49:0/613575881 wait complete. 2023-11-30T17:19:36.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.559+0000 7efc9a7d6700 1 Processor -- start 2023-11-30T17:19:36.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.559+0000 7efc9a7d6700 1 -- start start 2023-11-30T17:19:36.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.560+0000 7efc9a7d6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc94064b00 0x7efc94156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:36.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.560+0000 7efc9a7d6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc940c5f30 0x7efc94156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:36.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.560+0000 7efc9a7d6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc941373a0 0x7efc94138a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:36.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.560+0000 7efc9a7d6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc941574a0 con 0x7efc940c5f30 2023-11-30T17:19:36.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.560+0000 7efc9a7d6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc941384c0 con 0x7efc94064b00 2023-11-30T17:19:36.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.560+0000 7efc9a7d6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc941378b0 con 0x7efc941373a0 2023-11-30T17:19:36.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.560+0000 7efc937fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc940c5f30 0x7efc94156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:36.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.560+0000 7efc937fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc940c5f30 0x7efc94156fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53822/0 (socket says 172.21.15.49:53822) 2023-11-30T17:19:36.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.560+0000 7efc937fe700 1 -- 172.21.15.49:0/1070522849 learned_addr learned my addr 172.21.15.49:0/1070522849 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:36.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.560+0000 7efc93fff700 1 --2- 172.21.15.49:0/1070522849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc94064b00 0x7efc94156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:36.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.560+0000 7efc98d73700 1 --2- 172.21.15.49:0/1070522849 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc941373a0 0x7efc94138a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:36.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.560+0000 7efc937fe700 1 -- 172.21.15.49:0/1070522849 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc941373a0 msgr2=0x7efc94138a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:36.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.560+0000 7efc937fe700 1 --2- 172.21.15.49:0/1070522849 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc941373a0 0x7efc94138a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:36.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.560+0000 7efc937fe700 1 -- 172.21.15.49:0/1070522849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc94064b00 msgr2=0x7efc94156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:36.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.560+0000 7efc937fe700 1 --2- 172.21.15.49:0/1070522849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc94064b00 0x7efc94156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:36.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.560+0000 7efc937fe700 1 -- 172.21.15.49:0/1070522849 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc840092a0 con 0x7efc940c5f30 2023-11-30T17:19:36.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.560+0000 7efc93fff700 1 --2- 172.21.15.49:0/1070522849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc94064b00 0x7efc94156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:19:36.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.560+0000 7efc937fe700 1 --2- 172.21.15.49:0/1070522849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc940c5f30 0x7efc94156fb0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7efc8800c510 tx=0x7efc88007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:36.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.561+0000 7efc7bfff700 1 -- 172.21.15.49:0/1070522849 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc880072e0 con 0x7efc940c5f30 2023-11-30T17:19:36.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.561+0000 7efc7bfff700 1 -- 172.21.15.49:0/1070522849 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc88007440 con 0x7efc940c5f30 2023-11-30T17:19:36.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.561+0000 7efc9a7d6700 1 -- 172.21.15.49:0/1070522849 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc94137b90 con 0x7efc940c5f30 2023-11-30T17:19:36.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.561+0000 7efc7bfff700 1 -- 172.21.15.49:0/1070522849 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc880057a0 con 0x7efc940c5f30 2023-11-30T17:19:36.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.561+0000 7efc9a7d6700 1 -- 172.21.15.49:0/1070522849 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc94138150 con 0x7efc940c5f30 2023-11-30T17:19:36.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.562+0000 7efc9a7d6700 1 -- 172.21.15.49:0/1070522849 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc94138670 con 0x7efc940c5f30 2023-11-30T17:19:36.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.562+0000 7efc7bfff700 1 -- 172.21.15.49:0/1070522849 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7efc88005bd0 con 0x7efc940c5f30 2023-11-30T17:19:36.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.562+0000 7efc7bfff700 1 --2- 172.21.15.49:0/1070522849 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc8005f2c0 0x7efc80061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:36.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.562+0000 7efc7bfff700 1 -- 172.21.15.49:0/1070522849 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 7018+0+0 (secure 0 0 0) 0x7efc88079e40 con 0x7efc940c5f30 2023-11-30T17:19:36.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.563+0000 7efc93fff700 1 --2- 172.21.15.49:0/1070522849 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc8005f2c0 0x7efc80061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:36.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.563+0000 7efc93fff700 1 --2- 172.21.15.49:0/1070522849 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc8005f2c0 0x7efc80061780 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7efc8400b340 tx=0x7efc84017000).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:36.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.567+0000 7efc7bfff700 1 -- 172.21.15.49:0/1070522849 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efc94138670 con 0x7efc940c5f30 2023-11-30T17:19:36.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.766+0000 7efc9a7d6700 1 -- 172.21.15.49:0/1070522849 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7efc940c68d0 con 0x7efc8005f2c0 2023-11-30T17:19:36.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.771+0000 7efc7bfff700 1 -- 172.21.15.49:0/1070522849 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7efc940c68d0 con 0x7efc8005f2c0 2023-11-30T17:19:36.773 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule removed for path /snap_test_dir1/dir8 2023-11-30T17:19:36.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.773+0000 7efc9a7d6700 1 -- 172.21.15.49:0/1070522849 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc8005f2c0 msgr2=0x7efc80061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:36.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.773+0000 7efc9a7d6700 1 --2- 172.21.15.49:0/1070522849 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc8005f2c0 0x7efc80061780 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7efc8400b340 tx=0x7efc84017000).stop 2023-11-30T17:19:36.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.773+0000 7efc9a7d6700 1 -- 172.21.15.49:0/1070522849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc940c5f30 msgr2=0x7efc94156fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:36.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.773+0000 7efc9a7d6700 1 --2- 172.21.15.49:0/1070522849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc940c5f30 0x7efc94156fb0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7efc8800c510 tx=0x7efc88007ad0).stop 2023-11-30T17:19:36.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.773+0000 7efc9a7d6700 1 -- 172.21.15.49:0/1070522849 shutdown_connections 2023-11-30T17:19:36.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.773+0000 7efc9a7d6700 1 --2- 172.21.15.49:0/1070522849 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc941373a0 0x7efc94138a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:36.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.773+0000 7efc9a7d6700 1 --2- 172.21.15.49:0/1070522849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc94064b00 0x7efc94156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:36.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.773+0000 7efc9a7d6700 1 --2- 172.21.15.49:0/1070522849 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc8005f2c0 0x7efc80061780 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:36.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.773+0000 7efc9a7d6700 1 --2- 172.21.15.49:0/1070522849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc940c5f30 0x7efc94156fb0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:36.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.773+0000 7efc9a7d6700 1 -- 172.21.15.49:0/1070522849 >> 172.21.15.49:0/1070522849 conn(0x7efc940628f0 msgr2=0x7efc940ae7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:36.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.773+0000 7efc9a7d6700 1 -- 172.21.15.49:0/1070522849 shutdown_connections 2023-11-30T17:19:36.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:36.773+0000 7efc9a7d6700 1 -- 172.21.15.49:0/1070522849 wait complete. 2023-11-30T17:19:36.789 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir8 2023-11-30T17:19:36.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:36.789 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-11-30T17:19:36.806 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_09_00_UTC 2023-11-30T17:19:36.806 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_10_00_UTC 2023-11-30T17:19:36.806 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_11_00_UTC 2023-11-30T17:19:36.806 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_12_00_UTC 2023-11-30T17:19:36.807 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_13_00_UTC 2023-11-30T17:19:36.807 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_14_00_UTC 2023-11-30T17:19:36.807 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_15_00_UTC 2023-11-30T17:19:36.807 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_16_00_UTC 2023-11-30T17:19:36.807 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_17_00_UTC 2023-11-30T17:19:36.807 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_18_00_UTC 2023-11-30T17:19:36.807 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_19_00_UTC 2023-11-30T17:19:36.807 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-11-30-17_09_00_UTC 2023-11-30T17:19:36.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:36.807 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-11-30-17_09_00_UTC) 2023-11-30T17:19:36.869 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-11-30-17_10_00_UTC 2023-11-30T17:19:36.870 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:36.870 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-11-30-17_10_00_UTC) 2023-11-30T17:19:36.930 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-11-30-17_11_00_UTC 2023-11-30T17:19:36.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:36.930 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-11-30-17_11_00_UTC) 2023-11-30T17:19:36.991 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-11-30-17_12_00_UTC 2023-11-30T17:19:36.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:36.991 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-11-30-17_12_00_UTC) 2023-11-30T17:19:37.075 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-11-30-17_13_00_UTC 2023-11-30T17:19:37.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:37.075 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-11-30-17_13_00_UTC) 2023-11-30T17:19:37.136 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-11-30-17_14_00_UTC 2023-11-30T17:19:37.136 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:37.136 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-11-30-17_14_00_UTC) 2023-11-30T17:19:37.199 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-11-30-17_15_00_UTC 2023-11-30T17:19:37.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:37.200 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-11-30-17_15_00_UTC) 2023-11-30T17:19:37.262 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-11-30-17_16_00_UTC 2023-11-30T17:19:37.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:37.262 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-11-30-17_16_00_UTC) 2023-11-30T17:19:37.323 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-11-30-17_17_00_UTC 2023-11-30T17:19:37.323 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:37.324 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-11-30-17_17_00_UTC) 2023-11-30T17:19:37.385 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-11-30-17_18_00_UTC 2023-11-30T17:19:37.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:37.385 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-11-30-17_18_00_UTC) 2023-11-30T17:19:37.448 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-11-30-17_19_00_UTC 2023-11-30T17:19:37.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:37.448 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-11-30-17_19_00_UTC) 2023-11-30T17:19:37.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:37.509 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8) 2023-11-30T17:19:37.567 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir9 1M 2023-11-30T17:19:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.728+0000 7f2e6d115700 1 Processor -- start 2023-11-30T17:19:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.728+0000 7f2e6d115700 1 -- start start 2023-11-30T17:19:37.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.728+0000 7f2e6d115700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e68154530 0x7f2e68154910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:37.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.728+0000 7f2e6d115700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2e680a7ff0 0x7f2e680c8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:37.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.728+0000 7f2e6d115700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e680c6630 con 0x7f2e680aa220 2023-11-30T17:19:37.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.728+0000 7f2e6d115700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e680c6390 con 0x7f2e680a7ff0 2023-11-30T17:19:37.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.728+0000 7f2e6d115700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e680a8470 con 0x7f2e68154530 2023-11-30T17:19:37.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.729+0000 7f2e6659c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2e680a7ff0 0x7f2e680c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:37.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.729+0000 7f2e6759e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2e680aa220 0x7f2e680c6ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55128/0 (socket says 172.21.15.49:55128) 2023-11-30T17:19:37.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.729+0000 7f2e6659c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2e680a7ff0 0x7f2e680c8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53836/0 (socket says 172.21.15.49:53836) 2023-11-30T17:19:37.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.729+0000 7f2e6759e700 1 -- 172.21.15.49:0/2547339067 learned_addr learned my addr 172.21.15.49:0/2547339067 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:37.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.729+0000 7f2e66d9d700 1 --2- 172.21.15.49:0/2547339067 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e68154530 0x7f2e68154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:37.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.729+0000 7f2e6659c700 1 -- 172.21.15.49:0/2547339067 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e68154530 msgr2=0x7f2e68154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:37.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.729+0000 7f2e6659c700 1 --2- 172.21.15.49:0/2547339067 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e68154530 0x7f2e68154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:37.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.729+0000 7f2e6659c700 1 -- 172.21.15.49:0/2547339067 >> v1:172.21.15.49:6789/0 conn(0x7f2e680aa220 legacy=0x7f2e680c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:37.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.729+0000 7f2e65d9b700 1 -- 172.21.15.49:0/2547339067 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1260740421 0 0) 0x7f2e680c6630 con 0x7f2e680aa220 2023-11-30T17:19:37.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.729+0000 7f2e6659c700 1 -- 172.21.15.49:0/2547339067 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e68064230 con 0x7f2e680a7ff0 2023-11-30T17:19:37.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.729+0000 7f2e6659c700 1 --2- 172.21.15.49:0/2547339067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e680a7ff0 0x7f2e680c8580 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f2e5c009760 tx=0x7f2e5c009060).ready entity=mon.0 client_cookie=eb6a3605665c31b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:37.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.729+0000 7f2e65d9b700 1 -- 172.21.15.49:0/2547339067 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c00b580 con 0x7f2e680a7ff0 2023-11-30T17:19:37.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.729+0000 7f2e65d9b700 1 -- 172.21.15.49:0/2547339067 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5c00b6e0 con 0x7f2e680a7ff0 2023-11-30T17:19:37.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.729+0000 7f2e65d9b700 1 -- 172.21.15.49:0/2547339067 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c00ba60 con 0x7f2e680a7ff0 2023-11-30T17:19:37.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.730+0000 7f2e6d115700 1 -- 172.21.15.49:0/2547339067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e680a7ff0 msgr2=0x7f2e680c8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:37.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.730+0000 7f2e6d115700 1 --2- 172.21.15.49:0/2547339067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e680a7ff0 0x7f2e680c8580 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f2e5c009760 tx=0x7f2e5c009060).stop 2023-11-30T17:19:37.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.730+0000 7f2e6d115700 1 -- 172.21.15.49:0/2547339067 shutdown_connections 2023-11-30T17:19:37.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.730+0000 7f2e6d115700 1 --2- 172.21.15.49:0/2547339067 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e68154530 0x7f2e68154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:37.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.730+0000 7f2e6d115700 1 --2- 172.21.15.49:0/2547339067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e680a7ff0 0x7f2e680c8580 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:37.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.730+0000 7f2e6d115700 1 -- 172.21.15.49:0/2547339067 >> 172.21.15.49:0/2547339067 conn(0x7f2e68094930 msgr2=0x7f2e6806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:37.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.730+0000 7f2e6d115700 1 -- 172.21.15.49:0/2547339067 shutdown_connections 2023-11-30T17:19:37.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.730+0000 7f2e6d115700 1 -- 172.21.15.49:0/2547339067 wait complete. 2023-11-30T17:19:37.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.731+0000 7f2e6d115700 1 Processor -- start 2023-11-30T17:19:37.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.731+0000 7f2e6d115700 1 -- start start 2023-11-30T17:19:37.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.732+0000 7f2e6d115700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e680a7ff0 0x7f2e6814dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:37.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.732+0000 7f2e6d115700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e680aa220 0x7f2e68151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:37.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.732+0000 7f2e6d115700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e68154530 0x7f2e680ac260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:37.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.732+0000 7f2e6d115700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e680c6d10 con 0x7f2e680a7ff0 2023-11-30T17:19:37.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.732+0000 7f2e6d115700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e680aa6f0 con 0x7f2e680aa220 2023-11-30T17:19:37.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.732+0000 7f2e6d115700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e680ace40 con 0x7f2e68154530 2023-11-30T17:19:37.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.732+0000 7f2e66d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e680a7ff0 0x7f2e6814dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:37.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.732+0000 7f2e66d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e680a7ff0 0x7f2e6814dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53850/0 (socket says 172.21.15.49:53850) 2023-11-30T17:19:37.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.732+0000 7f2e66d9d700 1 -- 172.21.15.49:0/367849093 learned_addr learned my addr 172.21.15.49:0/367849093 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:37.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.732+0000 7f2e6759e700 1 --2- 172.21.15.49:0/367849093 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e68154530 0x7f2e680ac260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:37.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.732+0000 7f2e6659c700 1 --2- 172.21.15.49:0/367849093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e680aa220 0x7f2e68151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:37.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.732+0000 7f2e66d9d700 1 -- 172.21.15.49:0/367849093 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e68154530 msgr2=0x7f2e680ac260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:37.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.732+0000 7f2e66d9d700 1 --2- 172.21.15.49:0/367849093 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e68154530 0x7f2e680ac260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:37.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.732+0000 7f2e66d9d700 1 -- 172.21.15.49:0/367849093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e680aa220 msgr2=0x7f2e68151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:37.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.732+0000 7f2e66d9d700 1 --2- 172.21.15.49:0/367849093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e680aa220 0x7f2e68151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:37.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.732+0000 7f2e66d9d700 1 -- 172.21.15.49:0/367849093 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5c0092a0 con 0x7f2e680a7ff0 2023-11-30T17:19:37.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.732+0000 7f2e66d9d700 1 --2- 172.21.15.49:0/367849093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e680a7ff0 0x7f2e6814dcf0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f2e58006920 tx=0x7f2e58008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:37.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.733+0000 7f2e4effd700 1 -- 172.21.15.49:0/367849093 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e58011590 con 0x7f2e680a7ff0 2023-11-30T17:19:37.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.733+0000 7f2e4effd700 1 -- 172.21.15.49:0/367849093 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e580116f0 con 0x7f2e680a7ff0 2023-11-30T17:19:37.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.733+0000 7f2e6d115700 1 -- 172.21.15.49:0/367849093 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e680ad120 con 0x7f2e680a7ff0 2023-11-30T17:19:37.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.733+0000 7f2e4effd700 1 -- 172.21.15.49:0/367849093 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e58011a70 con 0x7f2e680a7ff0 2023-11-30T17:19:37.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.733+0000 7f2e6d115700 1 -- 172.21.15.49:0/367849093 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e680ad400 con 0x7f2e680a7ff0 2023-11-30T17:19:37.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.734+0000 7f2e6d115700 1 -- 172.21.15.49:0/367849093 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e680aad00 con 0x7f2e680a7ff0 2023-11-30T17:19:37.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.734+0000 7f2e4effd700 1 -- 172.21.15.49:0/367849093 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f2e5801c460 con 0x7f2e680a7ff0 2023-11-30T17:19:37.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.734+0000 7f2e4effd700 1 --2- 172.21.15.49:0/367849093 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2e5405f2c0 0x7f2e54061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:37.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.734+0000 7f2e4effd700 1 -- 172.21.15.49:0/367849093 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6954+0+0 (secure 0 0 0) 0x7f2e5807a740 con 0x7f2e680a7ff0 2023-11-30T17:19:37.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.735+0000 7f2e6659c700 1 --2- 172.21.15.49:0/367849093 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2e5405f2c0 0x7f2e54061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:37.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.735+0000 7f2e6659c700 1 --2- 172.21.15.49:0/367849093 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2e5405f2c0 0x7f2e54061780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f2e5c009760 tx=0x7f2e5c017000).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:37.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.739+0000 7f2e4effd700 1 -- 172.21.15.49:0/367849093 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2e5804b4f0 con 0x7f2e680a7ff0 2023-11-30T17:19:37.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.963+0000 7f2e6d115700 1 -- 172.21.15.49:0/367849093 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e6806c860 con 0x7f2e5405f2c0 2023-11-30T17:19:37.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.967+0000 7f2e4effd700 1 -- 172.21.15.49:0/367849093 <== mgr.5143 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f2e6806c860 con 0x7f2e5405f2c0 2023-11-30T17:19:37.969 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule removed for path /snap_test_dir1/dir9 2023-11-30T17:19:37.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.969+0000 7f2e6d115700 1 -- 172.21.15.49:0/367849093 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2e5405f2c0 msgr2=0x7f2e54061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:37.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.969+0000 7f2e6d115700 1 --2- 172.21.15.49:0/367849093 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2e5405f2c0 0x7f2e54061780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f2e5c009760 tx=0x7f2e5c017000).stop 2023-11-30T17:19:37.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.969+0000 7f2e6d115700 1 -- 172.21.15.49:0/367849093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e680a7ff0 msgr2=0x7f2e6814dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:37.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.969+0000 7f2e6d115700 1 --2- 172.21.15.49:0/367849093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e680a7ff0 0x7f2e6814dcf0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f2e58006920 tx=0x7f2e58008040).stop 2023-11-30T17:19:37.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.969+0000 7f2e6d115700 1 -- 172.21.15.49:0/367849093 shutdown_connections 2023-11-30T17:19:37.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.969+0000 7f2e6d115700 1 --2- 172.21.15.49:0/367849093 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e68154530 0x7f2e680ac260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:37.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.969+0000 7f2e6d115700 1 --2- 172.21.15.49:0/367849093 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2e5405f2c0 0x7f2e54061780 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:37.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.969+0000 7f2e6d115700 1 --2- 172.21.15.49:0/367849093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e680a7ff0 0x7f2e6814dcf0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:37.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.969+0000 7f2e6d115700 1 --2- 172.21.15.49:0/367849093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e680aa220 0x7f2e68151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:37.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.969+0000 7f2e6d115700 1 -- 172.21.15.49:0/367849093 >> 172.21.15.49:0/367849093 conn(0x7f2e68094930 msgr2=0x7f2e680c0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:37.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.970+0000 7f2e6d115700 1 -- 172.21.15.49:0/367849093 shutdown_connections 2023-11-30T17:19:37.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:37.970+0000 7f2e6d115700 1 -- 172.21.15.49:0/367849093 wait complete. 2023-11-30T17:19:37.991 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir9 2023-11-30T17:19:37.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:37.991 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-11-30T17:19:38.007 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_09_00_UTC 2023-11-30T17:19:38.008 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_10_00_UTC 2023-11-30T17:19:38.008 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_11_00_UTC 2023-11-30T17:19:38.008 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_12_00_UTC 2023-11-30T17:19:38.008 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_13_00_UTC 2023-11-30T17:19:38.008 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_14_00_UTC 2023-11-30T17:19:38.008 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_15_00_UTC 2023-11-30T17:19:38.008 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_16_00_UTC 2023-11-30T17:19:38.008 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_17_00_UTC 2023-11-30T17:19:38.008 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_18_00_UTC 2023-11-30T17:19:38.008 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_19_00_UTC 2023-11-30T17:19:38.008 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-11-30-17_09_00_UTC 2023-11-30T17:19:38.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:38.009 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-11-30-17_09_00_UTC) 2023-11-30T17:19:38.069 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-11-30-17_10_00_UTC 2023-11-30T17:19:38.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:38.070 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-11-30-17_10_00_UTC) 2023-11-30T17:19:38.137 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-11-30-17_11_00_UTC 2023-11-30T17:19:38.137 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:38.138 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-11-30-17_11_00_UTC) 2023-11-30T17:19:38.199 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-11-30-17_12_00_UTC 2023-11-30T17:19:38.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:38.199 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-11-30-17_12_00_UTC) 2023-11-30T17:19:38.262 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-11-30-17_13_00_UTC 2023-11-30T17:19:38.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:38.263 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-11-30-17_13_00_UTC) 2023-11-30T17:19:38.323 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-11-30-17_14_00_UTC 2023-11-30T17:19:38.323 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:38.323 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-11-30-17_14_00_UTC) 2023-11-30T17:19:38.384 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-11-30-17_15_00_UTC 2023-11-30T17:19:38.384 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:38.384 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-11-30-17_15_00_UTC) 2023-11-30T17:19:38.445 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-11-30-17_16_00_UTC 2023-11-30T17:19:38.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:38.446 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-11-30-17_16_00_UTC) 2023-11-30T17:19:38.508 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-11-30-17_17_00_UTC 2023-11-30T17:19:38.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:38.508 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-11-30-17_17_00_UTC) 2023-11-30T17:19:38.571 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-11-30-17_18_00_UTC 2023-11-30T17:19:38.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:38.571 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-11-30-17_18_00_UTC) 2023-11-30T17:19:38.635 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-11-30-17_19_00_UTC 2023-11-30T17:19:38.635 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:38.635 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-11-30-17_19_00_UTC) 2023-11-30T17:19:38.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:38.696 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9) 2023-11-30T17:19:38.755 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-11-30T17:19:38.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.929+0000 7f320d1a0700 1 Processor -- start 2023-11-30T17:19:38.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.929+0000 7f320d1a0700 1 -- start start 2023-11-30T17:19:38.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.929+0000 7f320d1a0700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f32080c6190 0x7f32080c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:38.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.929+0000 7f320d1a0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3208158320 0x7f32081587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:38.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.929+0000 7f320d1a0700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3208158cc0 con 0x7f3208098d10 2023-11-30T17:19:38.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.929+0000 7f320d1a0700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32080c72d0 con 0x7f32080c6190 2023-11-30T17:19:38.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.929+0000 7f320d1a0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3208064570 con 0x7f3208158320 2023-11-30T17:19:38.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.930+0000 7f320659c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f32080c6190 0x7f32080c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:38.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.930+0000 7f320659c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f32080c6190 0x7f32080c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53864/0 (socket says 172.21.15.49:53864) 2023-11-30T17:19:38.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.930+0000 7f320659c700 1 -- 172.21.15.49:0/3584308108 learned_addr learned my addr 172.21.15.49:0/3584308108 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:38.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.930+0000 7f320759e700 1 --2- 172.21.15.49:0/3584308108 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3208158320 0x7f32081587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:38.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.930+0000 7f320659c700 1 -- 172.21.15.49:0/3584308108 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3208158320 msgr2=0x7f32081587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:38.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.930+0000 7f320659c700 1 --2- 172.21.15.49:0/3584308108 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3208158320 0x7f32081587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:38.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.930+0000 7f320659c700 1 -- 172.21.15.49:0/3584308108 >> v1:172.21.15.115:6789/0 conn(0x7f3208098d10 legacy=0x7f3208063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:38.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.930+0000 7f3205d9b700 1 -- 172.21.15.49:0/3584308108 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3503096629 0 0) 0x7f31f8001110 con 0x7f3208098d10 2023-11-30T17:19:38.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.930+0000 7f320659c700 1 -- 172.21.15.49:0/3584308108 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3208154bc0 con 0x7f32080c6190 2023-11-30T17:19:38.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.930+0000 7f320659c700 1 --2- 172.21.15.49:0/3584308108 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32080c6190 0x7f32080c7760 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f31f0006fd0 tx=0x7f31f00090f0).ready entity=mon.0 client_cookie=8259d3fda5745107 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:38.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.930+0000 7f3205d9b700 1 -- 172.21.15.49:0/3584308108 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f000b580 con 0x7f32080c6190 2023-11-30T17:19:38.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.930+0000 7f3205d9b700 1 -- 172.21.15.49:0/3584308108 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f000b6e0 con 0x7f32080c6190 2023-11-30T17:19:38.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.930+0000 7f3205d9b700 1 -- 172.21.15.49:0/3584308108 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f000ba60 con 0x7f32080c6190 2023-11-30T17:19:38.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.931+0000 7f320d1a0700 1 -- 172.21.15.49:0/3584308108 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32080c6190 msgr2=0x7f32080c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:38.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.931+0000 7f320d1a0700 1 --2- 172.21.15.49:0/3584308108 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32080c6190 0x7f32080c7760 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f31f0006fd0 tx=0x7f31f00090f0).stop 2023-11-30T17:19:38.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.931+0000 7f320d1a0700 1 -- 172.21.15.49:0/3584308108 shutdown_connections 2023-11-30T17:19:38.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.931+0000 7f320d1a0700 1 --2- 172.21.15.49:0/3584308108 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3208158320 0x7f32081587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:38.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.931+0000 7f320d1a0700 1 --2- 172.21.15.49:0/3584308108 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32080c6190 0x7f32080c7760 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:38.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.931+0000 7f320d1a0700 1 -- 172.21.15.49:0/3584308108 >> 172.21.15.49:0/3584308108 conn(0x7f32080cb310 msgr2=0x7f32080cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:38.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.931+0000 7f320d1a0700 1 -- 172.21.15.49:0/3584308108 shutdown_connections 2023-11-30T17:19:38.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.931+0000 7f320d1a0700 1 -- 172.21.15.49:0/3584308108 wait complete. 2023-11-30T17:19:38.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.932+0000 7f320d1a0700 1 Processor -- start 2023-11-30T17:19:38.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.932+0000 7f320d1a0700 1 -- start start 2023-11-30T17:19:38.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.933+0000 7f320d1a0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3208098d10 0x7f32080ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:38.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.933+0000 7f320d1a0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32080c6190 0x7f32080aba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:38.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.933+0000 7f320d1a0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3208158320 0x7f32080abef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:38.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.933+0000 7f320d1a0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32080ac810 con 0x7f32080c6190 2023-11-30T17:19:38.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.933+0000 7f320d1a0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32080acaf0 con 0x7f3208098d10 2023-11-30T17:19:38.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.933+0000 7f320d1a0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32080acdd0 con 0x7f3208158320 2023-11-30T17:19:38.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.933+0000 7f320659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32080c6190 0x7f32080aba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:38.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.933+0000 7f320659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32080c6190 0x7f32080aba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53880/0 (socket says 172.21.15.49:53880) 2023-11-30T17:19:38.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.933+0000 7f320659c700 1 -- 172.21.15.49:0/1603670738 learned_addr learned my addr 172.21.15.49:0/1603670738 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:38.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.933+0000 7f3206d9d700 1 --2- 172.21.15.49:0/1603670738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3208098d10 0x7f32080ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:38.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.933+0000 7f320759e700 1 --2- 172.21.15.49:0/1603670738 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3208158320 0x7f32080abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:38.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.933+0000 7f320659c700 1 -- 172.21.15.49:0/1603670738 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3208158320 msgr2=0x7f32080abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:38.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.933+0000 7f320659c700 1 --2- 172.21.15.49:0/1603670738 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3208158320 0x7f32080abef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:38.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.933+0000 7f320659c700 1 -- 172.21.15.49:0/1603670738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3208098d10 msgr2=0x7f32080ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:38.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.933+0000 7f320659c700 1 --2- 172.21.15.49:0/1603670738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3208098d10 0x7f32080ad8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:38.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.933+0000 7f320659c700 1 -- 172.21.15.49:0/1603670738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f0009370 con 0x7f32080c6190 2023-11-30T17:19:38.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.933+0000 7f320659c700 1 --2- 172.21.15.49:0/1603670738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32080c6190 0x7f32080aba00 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f31f0011000 tx=0x7f31f0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:38.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.934+0000 7f31feffd700 1 -- 172.21.15.49:0/1603670738 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f0000bc0 con 0x7f32080c6190 2023-11-30T17:19:38.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.934+0000 7f31feffd700 1 -- 172.21.15.49:0/1603670738 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f000b850 con 0x7f32080c6190 2023-11-30T17:19:38.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.934+0000 7f320d1a0700 1 -- 172.21.15.49:0/1603670738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32080ad0b0 con 0x7f32080c6190 2023-11-30T17:19:38.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.934+0000 7f31feffd700 1 -- 172.21.15.49:0/1603670738 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f0000d20 con 0x7f32080c6190 2023-11-30T17:19:38.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.934+0000 7f320d1a0700 1 -- 172.21.15.49:0/1603670738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32080adda0 con 0x7f32080c6190 2023-11-30T17:19:38.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.935+0000 7f320d1a0700 1 -- 172.21.15.49:0/1603670738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32080ad5d0 con 0x7f32080c6190 2023-11-30T17:19:38.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.935+0000 7f31feffd700 1 -- 172.21.15.49:0/1603670738 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f31f001cad0 con 0x7f32080c6190 2023-11-30T17:19:38.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.935+0000 7f31feffd700 1 --2- 172.21.15.49:0/1603670738 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f31e805f290 0x7f31e8061750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:38.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.935+0000 7f31feffd700 1 -- 172.21.15.49:0/1603670738 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 7034+0+0 (secure 0 0 0) 0x7f31f007c670 con 0x7f32080c6190 2023-11-30T17:19:38.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.936+0000 7f3206d9d700 1 --2- 172.21.15.49:0/1603670738 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f31e805f290 0x7f31e8061750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:38.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.936+0000 7f3206d9d700 1 --2- 172.21.15.49:0/1603670738 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f31e805f290 0x7f31e8061750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f31f8001370 tx=0x7f31f8007a20).ready entity=mgr.5143 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:38.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:38.940+0000 7f31feffd700 1 -- 172.21.15.49:0/1603670738 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f32080ad5d0 con 0x7f32080c6190 2023-11-30T17:19:39.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:39.183+0000 7f320d1a0700 1 -- 172.21.15.49:0/1603670738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f32080ad5d0 con 0x7f32080c6190 2023-11-30T17:19:40.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.035+0000 7f31feffd700 1 -- 172.21.15.49:0/1603670738 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f31f0079f30 con 0x7f32080c6190 2023-11-30T17:19:40.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.036+0000 7f31feffd700 1 -- 172.21.15.49:0/1603670738 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v11) v1 ==== 93+0+0 (secure 0 0 0) 0x7f31f0043710 con 0x7f32080c6190 2023-11-30T17:19:40.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.038+0000 7f320d1a0700 1 -- 172.21.15.49:0/1603670738 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f31e805f290 msgr2=0x7f31e8061750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:40.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.038+0000 7f320d1a0700 1 --2- 172.21.15.49:0/1603670738 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f31e805f290 0x7f31e8061750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f31f8001370 tx=0x7f31f8007a20).stop 2023-11-30T17:19:40.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.038+0000 7f320d1a0700 1 -- 172.21.15.49:0/1603670738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32080c6190 msgr2=0x7f32080aba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:40.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.038+0000 7f320d1a0700 1 --2- 172.21.15.49:0/1603670738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32080c6190 0x7f32080aba00 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f31f0011000 tx=0x7f31f0017000).stop 2023-11-30T17:19:40.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.038+0000 7f320d1a0700 1 -- 172.21.15.49:0/1603670738 shutdown_connections 2023-11-30T17:19:40.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.038+0000 7f320d1a0700 1 --2- 172.21.15.49:0/1603670738 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3208158320 0x7f32080abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:40.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.038+0000 7f320d1a0700 1 --2- 172.21.15.49:0/1603670738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3208098d10 0x7f32080ad8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:40.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.038+0000 7f320d1a0700 1 --2- 172.21.15.49:0/1603670738 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f31e805f290 0x7f31e8061750 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:40.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.038+0000 7f320d1a0700 1 --2- 172.21.15.49:0/1603670738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32080c6190 0x7f32080aba00 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:40.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.038+0000 7f320d1a0700 1 -- 172.21.15.49:0/1603670738 >> 172.21.15.49:0/1603670738 conn(0x7f32080cb310 msgr2=0x7f32080ca210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:40.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.038+0000 7f320d1a0700 1 -- 172.21.15.49:0/1603670738 shutdown_connections 2023-11-30T17:19:40.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.038+0000 7f320d1a0700 1 -- 172.21.15.49:0/1603670738 wait complete. 2023-11-30T17:19:40.054 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-30T17:19:40.054 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T17:19:40.113 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T17:19:40.176 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-30T17:19:40.176 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-30T17:19:40.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:19:40.177 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-30T17:19:40.211 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:40.210+0000 7f89818bb680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T17:19:40.215 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:19:40.214+0000 7f4b630b8680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T17:19:40.216 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-11-30T17:19:40.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:19:40.216 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-30T17:19:40.271 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:19:40.275 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:40.274+0000 7f89818bb680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T17:19:40.282 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:19:40.280+0000 7f4b630b8680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T17:19:40.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.400+0000 7fcadf8c9700 1 Processor -- start 2023-11-30T17:19:40.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.400+0000 7fcadf8c9700 1 -- start start 2023-11-30T17:19:40.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.401+0000 7fcadf8c9700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcad81544d0 0x7fcad8155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:40.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.401+0000 7fcadf8c9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcad8066f40 0x7fcad8095e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:40.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.401+0000 7fcadf8c9700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcad80673c0 0x7fcad8096370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:40.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.401+0000 7fcadf8c9700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad8096860 con 0x7fcad80673c0 2023-11-30T17:19:40.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.401+0000 7fcadf8c9700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad80683d0 con 0x7fcad81544d0 2023-11-30T17:19:40.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.401+0000 7fcadf8c9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad8067850 con 0x7fcad8066f40 2023-11-30T17:19:40.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.401+0000 7fcadde66700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcad80673c0 0x7fcad8096370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:40.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.401+0000 7fcadde66700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcad80673c0 0x7fcad8096370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53898/0 (socket says 172.21.15.49:53898) 2023-11-30T17:19:40.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.401+0000 7fcadde66700 1 -- 172.21.15.49:0/682184252 learned_addr learned my addr 172.21.15.49:0/682184252 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:40.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.401+0000 7fcadd665700 1 --2- 172.21.15.49:0/682184252 >> v2:172.21.15.115:3300/0 conn(0x7fcad81544d0 0x7fcad8155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:40.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.401+0000 7fcadce64700 1 --2- 172.21.15.49:0/682184252 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcad8066f40 0x7fcad8095e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:40.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.401+0000 7fcadde66700 1 -- 172.21.15.49:0/682184252 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcad8066f40 msgr2=0x7fcad8095e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:40.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.401+0000 7fcadde66700 1 --2- 172.21.15.49:0/682184252 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcad8066f40 0x7fcad8095e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:40.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.401+0000 7fcadde66700 1 -- 172.21.15.49:0/682184252 >> v2:172.21.15.115:3300/0 conn(0x7fcad81544d0 msgr2=0x7fcad8155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:40.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.401+0000 7fcadde66700 1 --2- 172.21.15.49:0/682184252 >> v2:172.21.15.115:3300/0 conn(0x7fcad81544d0 0x7fcad8155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:40.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.401+0000 7fcadde66700 1 -- 172.21.15.49:0/682184252 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad8067b30 con 0x7fcad80673c0 2023-11-30T17:19:40.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.401+0000 7fcadde66700 1 --2- 172.21.15.49:0/682184252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcad80673c0 0x7fcad8096370 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7fcad806c7c0 tx=0x7fcad0009840).ready entity=mon.0 client_cookie=3ee171310a17d09c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:40.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.402+0000 7fcacffff700 1 -- 172.21.15.49:0/682184252 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad000e070 con 0x7fcad80673c0 2023-11-30T17:19:40.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.402+0000 7fcacffff700 1 -- 172.21.15.49:0/682184252 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad000b970 con 0x7fcad80673c0 2023-11-30T17:19:40.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.402+0000 7fcacffff700 1 -- 172.21.15.49:0/682184252 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad000bcf0 con 0x7fcad80673c0 2023-11-30T17:19:40.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.402+0000 7fcadf8c9700 1 -- 172.21.15.49:0/682184252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcad80673c0 msgr2=0x7fcad8096370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:40.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.402+0000 7fcadf8c9700 1 --2- 172.21.15.49:0/682184252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcad80673c0 0x7fcad8096370 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7fcad806c7c0 tx=0x7fcad0009840).stop 2023-11-30T17:19:40.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.402+0000 7fcadf8c9700 1 -- 172.21.15.49:0/682184252 shutdown_connections 2023-11-30T17:19:40.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.402+0000 7fcadf8c9700 1 --2- 172.21.15.49:0/682184252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcad80673c0 0x7fcad8096370 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:40.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.402+0000 7fcadf8c9700 1 --2- 172.21.15.49:0/682184252 >> v2:172.21.15.115:3300/0 conn(0x7fcad81544d0 0x7fcad8155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:40.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.402+0000 7fcadf8c9700 1 --2- 172.21.15.49:0/682184252 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcad8066f40 0x7fcad8095e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:40.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.402+0000 7fcadf8c9700 1 -- 172.21.15.49:0/682184252 >> 172.21.15.49:0/682184252 conn(0x7fcad80631d0 msgr2=0x7fcad80c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:40.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.402+0000 7fcadf8c9700 1 -- 172.21.15.49:0/682184252 shutdown_connections 2023-11-30T17:19:40.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.402+0000 7fcadf8c9700 1 -- 172.21.15.49:0/682184252 wait complete. 2023-11-30T17:19:40.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.403+0000 7fcadf8c9700 1 Processor -- start 2023-11-30T17:19:40.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.403+0000 7fcadf8c9700 1 -- start start 2023-11-30T17:19:40.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.404+0000 7fcadf8c9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcad8066f40 0x7fcad8161550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:40.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.404+0000 7fcadf8c9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcad81544d0 0x7fcad8155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:40.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.404+0000 7fcadf8c9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcad81564d0 0x7fcad80c0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:40.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.404+0000 7fcadf8c9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad814e4d0 con 0x7fcad8066f40 2023-11-30T17:19:40.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.404+0000 7fcadf8c9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad8156930 con 0x7fcad81564d0 2023-11-30T17:19:40.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.404+0000 7fcadf8c9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad8157760 con 0x7fcad81544d0 2023-11-30T17:19:40.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.404+0000 7fcadd665700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcad8066f40 0x7fcad8161550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:40.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.404+0000 7fcadd665700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcad8066f40 0x7fcad8161550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53902/0 (socket says 172.21.15.49:53902) 2023-11-30T17:19:40.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.404+0000 7fcadd665700 1 -- 172.21.15.49:0/598273060 learned_addr learned my addr 172.21.15.49:0/598273060 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:40.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.405+0000 7fcadce64700 1 --2- 172.21.15.49:0/598273060 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcad81544d0 0x7fcad8155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:40.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.405+0000 7fcadde66700 1 --2- 172.21.15.49:0/598273060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcad81564d0 0x7fcad80c0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:40.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.405+0000 7fcadd665700 1 -- 172.21.15.49:0/598273060 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcad81544d0 msgr2=0x7fcad8155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:40.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.405+0000 7fcadd665700 1 --2- 172.21.15.49:0/598273060 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcad81544d0 0x7fcad8155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:40.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.405+0000 7fcadd665700 1 -- 172.21.15.49:0/598273060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcad81564d0 msgr2=0x7fcad80c0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:40.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.405+0000 7fcadd665700 1 --2- 172.21.15.49:0/598273060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcad81564d0 0x7fcad80c0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:40.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.405+0000 7fcadd665700 1 -- 172.21.15.49:0/598273060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad0009ae0 con 0x7fcad8066f40 2023-11-30T17:19:40.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.405+0000 7fcadd665700 1 --2- 172.21.15.49:0/598273060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcad8066f40 0x7fcad8161550 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7fcad400e900 tx=0x7fcad4006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:40.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.405+0000 7fcacd7fa700 1 -- 172.21.15.49:0/598273060 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad4012600 con 0x7fcad8066f40 2023-11-30T17:19:40.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.405+0000 7fcadf8c9700 1 -- 172.21.15.49:0/598273060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad8161a40 con 0x7fcad8066f40 2023-11-30T17:19:40.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.405+0000 7fcacd7fa700 1 -- 172.21.15.49:0/598273060 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad4012760 con 0x7fcad8066f40 2023-11-30T17:19:40.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.405+0000 7fcacd7fa700 1 -- 172.21.15.49:0/598273060 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad4012ae0 con 0x7fcad8066f40 2023-11-30T17:19:40.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.405+0000 7fcadf8c9700 1 -- 172.21.15.49:0/598273060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad8156bd0 con 0x7fcad8066f40 2023-11-30T17:19:40.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.406+0000 7fcadf8c9700 1 -- 172.21.15.49:0/598273060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad806c860 con 0x7fcad8066f40 2023-11-30T17:19:40.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.407+0000 7fcacd7fa700 1 -- 172.21.15.49:0/598273060 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fcad401b400 con 0x7fcad8066f40 2023-11-30T17:19:40.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.407+0000 7fcacd7fa700 1 --2- 172.21.15.49:0/598273060 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcabc05f270 0x7fcabc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:40.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.407+0000 7fcadce64700 1 -- 172.21.15.49:0/598273060 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcabc05f270 msgr2=0x7fcabc061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:19:40.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.407+0000 7fcacd7fa700 1 -- 172.21.15.49:0/598273060 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 7082+0+0 (secure 0 0 0) 0x7fcad407aa60 con 0x7fcad8066f40 2023-11-30T17:19:40.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.407+0000 7fcadce64700 1 --2- 172.21.15.49:0/598273060 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcabc05f270 0x7fcabc061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:19:40.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.412+0000 7fcacd7fa700 1 -- 172.21.15.49:0/598273060 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcad404b790 con 0x7fcad8066f40 2023-11-30T17:19:40.548 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:40.547+0000 7f89818bb680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T17:19:40.577 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:19:40.576+0000 7f4b630b8680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T17:19:40.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.608+0000 7fcadce64700 1 -- 172.21.15.49:0/598273060 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcabc05f270 msgr2=0x7fcabc061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:19:40.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.608+0000 7fcadce64700 1 --2- 172.21.15.49:0/598273060 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcabc05f270 0x7fcabc061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:19:40.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.627+0000 7fcadf8c9700 1 -- 172.21.15.49:0/598273060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcad8067e10 con 0x7fcad8066f40 2023-11-30T17:19:40.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.627+0000 7fcacd7fa700 1 -- 172.21.15.49:0/598273060 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4495 (secure 0 0 0) 0x7fcad4016020 con 0x7fcad8066f40 2023-11-30T17:19:40.629 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:19:40.629 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1260333970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1260333970},{"type":"v1","addr":"172.21.15.115:6836","nonce":1260333970}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4938,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/2286472783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2286472783},{"type":"v1","addr":"172.21.15.49:6834","nonce":2286472783}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4941,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1299033463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1299033463},{"type":"v1","addr":"172.21.15.49:6835","nonce":1299033463}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:08:05.200966+0000","modified":"2023-11-30T17:08:08.207522+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4944},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4944":{"gid":4944,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/3449611740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3449611740},{"type":"v1","addr":"172.21.15.115:6837","nonce":3449611740}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-11-30T17:19:40.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.629+0000 7fcadf8c9700 1 -- 172.21.15.49:0/598273060 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcabc05f270 msgr2=0x7fcabc061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:19:40.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.629+0000 7fcadf8c9700 1 --2- 172.21.15.49:0/598273060 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcabc05f270 0x7fcabc061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:40.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.629+0000 7fcadf8c9700 1 -- 172.21.15.49:0/598273060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcad8066f40 msgr2=0x7fcad8161550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:40.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.629+0000 7fcadf8c9700 1 --2- 172.21.15.49:0/598273060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcad8066f40 0x7fcad8161550 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7fcad400e900 tx=0x7fcad4006f40).stop 2023-11-30T17:19:40.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.629+0000 7fcadf8c9700 1 -- 172.21.15.49:0/598273060 shutdown_connections 2023-11-30T17:19:40.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.629+0000 7fcadf8c9700 1 --2- 172.21.15.49:0/598273060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcad81564d0 0x7fcad80c0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:40.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.629+0000 7fcadf8c9700 1 --2- 172.21.15.49:0/598273060 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcabc05f270 0x7fcabc061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:40.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.629+0000 7fcadf8c9700 1 --2- 172.21.15.49:0/598273060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcad8066f40 0x7fcad8161550 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:40.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.629+0000 7fcadf8c9700 1 --2- 172.21.15.49:0/598273060 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcad81544d0 0x7fcad8155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:40.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.629+0000 7fcadf8c9700 1 -- 172.21.15.49:0/598273060 >> 172.21.15.49:0/598273060 conn(0x7fcad80631d0 msgr2=0x7fcad8153270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:40.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.630+0000 7fcadf8c9700 1 -- 172.21.15.49:0/598273060 shutdown_connections 2023-11-30T17:19:40.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.630+0000 7fcadf8c9700 1 -- 172.21.15.49:0/598273060 wait complete. 2023-11-30T17:19:40.632 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 16 2023-11-30T17:19:40.643 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:19:40.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.761+0000 7efed0444700 1 Processor -- start 2023-11-30T17:19:40.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.761+0000 7efed0444700 1 -- start start 2023-11-30T17:19:40.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.762+0000 7efed0444700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efec8064e20 0x7efec8155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:40.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.762+0000 7efed0444700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efec8095e80 0x7efec8096310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:40.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.762+0000 7efed0444700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec8096800 con 0x7efec81544d0 2023-11-30T17:19:40.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.762+0000 7efed0444700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec8067650 con 0x7efec8095e80 2023-11-30T17:19:40.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.762+0000 7efed0444700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec80683d0 con 0x7efec8064e20 2023-11-30T17:19:40.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.763+0000 7efece9e1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efec8095e80 0x7efec8096310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:40.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.763+0000 7efece1e0700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7efec81544d0 0x7efec8066f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52886/0 (socket says 172.21.15.49:52886) 2023-11-30T17:19:40.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.763+0000 7efece1e0700 1 -- 172.21.15.49:0/1242721018 learned_addr learned my addr 172.21.15.49:0/1242721018 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:40.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.763+0000 7efecd9df700 1 --2- 172.21.15.49:0/1242721018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efec8064e20 0x7efec8155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:40.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.763+0000 7efece9e1700 1 -- 172.21.15.49:0/1242721018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efec8064e20 msgr2=0x7efec8155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:40.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.763+0000 7efece9e1700 1 --2- 172.21.15.49:0/1242721018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efec8064e20 0x7efec8155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:40.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.763+0000 7efece9e1700 1 -- 172.21.15.49:0/1242721018 >> v1:172.21.15.49:6789/0 conn(0x7efec81544d0 legacy=0x7efec8066f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:40.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.763+0000 7efece9e1700 1 -- 172.21.15.49:0/1242721018 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec8067850 con 0x7efec8095e80 2023-11-30T17:19:40.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.763+0000 7efecd1de700 1 -- 172.21.15.49:0/1242721018 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1502072473 0 0) 0x7efec8096800 con 0x7efec81544d0 2023-11-30T17:19:40.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.763+0000 7efece9e1700 1 --2- 172.21.15.49:0/1242721018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efec8095e80 0x7efec8096310 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7efec0009e60 tx=0x7efec0009780).ready entity=mon.0 client_cookie=92940b35a089ffdc server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:40.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.763+0000 7efecd1de700 1 -- 172.21.15.49:0/1242721018 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec000e070 con 0x7efec8095e80 2023-11-30T17:19:40.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.763+0000 7efecd1de700 1 -- 172.21.15.49:0/1242721018 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec000bb60 con 0x7efec8095e80 2023-11-30T17:19:40.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.763+0000 7efecd1de700 1 -- 172.21.15.49:0/1242721018 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec0012410 con 0x7efec8095e80 2023-11-30T17:19:40.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.764+0000 7efed0444700 1 -- 172.21.15.49:0/1242721018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efec8095e80 msgr2=0x7efec8096310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:40.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.764+0000 7efed0444700 1 --2- 172.21.15.49:0/1242721018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efec8095e80 0x7efec8096310 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7efec0009e60 tx=0x7efec0009780).stop 2023-11-30T17:19:40.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.764+0000 7efed0444700 1 -- 172.21.15.49:0/1242721018 shutdown_connections 2023-11-30T17:19:40.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.764+0000 7efed0444700 1 --2- 172.21.15.49:0/1242721018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efec8095e80 0x7efec8096310 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:40.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.764+0000 7efed0444700 1 --2- 172.21.15.49:0/1242721018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efec8064e20 0x7efec8155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:40.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.764+0000 7efed0444700 1 -- 172.21.15.49:0/1242721018 >> 172.21.15.49:0/1242721018 conn(0x7efec80631d0 msgr2=0x7efec80c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:40.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.764+0000 7efed0444700 1 -- 172.21.15.49:0/1242721018 shutdown_connections 2023-11-30T17:19:40.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.764+0000 7efed0444700 1 -- 172.21.15.49:0/1242721018 wait complete. 2023-11-30T17:19:40.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.765+0000 7efed0444700 1 Processor -- start 2023-11-30T17:19:40.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.765+0000 7efed0444700 1 -- start start 2023-11-30T17:19:40.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.766+0000 7efed0444700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efec8064e20 0x7efec8164bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:40.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.766+0000 7efed0444700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efec8095e80 0x7efec81615f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:40.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.766+0000 7efed0444700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efec81544d0 0x7efec80a8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:40.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.766+0000 7efed0444700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec81554a0 con 0x7efec81544d0 2023-11-30T17:19:40.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.766+0000 7efed0444700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec8155780 con 0x7efec8064e20 2023-11-30T17:19:40.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.766+0000 7efed0444700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec80a8ef0 con 0x7efec8095e80 2023-11-30T17:19:40.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.766+0000 7efece9e1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efec81544d0 0x7efec80a8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.766+0000 7efece9e1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efec81544d0 0x7efec80a8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53038/0 (socket says 172.21.15.49:53038) 2023-11-30T17:19:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.766+0000 7efece9e1700 1 -- 172.21.15.49:0/1965360782 learned_addr learned my addr 172.21.15.49:0/1965360782 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.766+0000 7efecd9df700 1 --2- 172.21.15.49:0/1965360782 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efec8095e80 0x7efec81615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.766+0000 7efece1e0700 1 --2- 172.21.15.49:0/1965360782 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efec8064e20 0x7efec8164bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.766+0000 7efece9e1700 1 -- 172.21.15.49:0/1965360782 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efec8095e80 msgr2=0x7efec81615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.766+0000 7efece9e1700 1 --2- 172.21.15.49:0/1965360782 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efec8095e80 0x7efec81615f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.766+0000 7efece9e1700 1 -- 172.21.15.49:0/1965360782 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efec8064e20 msgr2=0x7efec8164bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.766+0000 7efece9e1700 1 --2- 172.21.15.49:0/1965360782 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efec8064e20 0x7efec8164bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.766+0000 7efece9e1700 1 -- 172.21.15.49:0/1965360782 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec0009a20 con 0x7efec81544d0 2023-11-30T17:19:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.767+0000 7efece9e1700 1 --2- 172.21.15.49:0/1965360782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efec81544d0 0x7efec80a8a00 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7efec0012fd0 tx=0x7efec0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.767+0000 7efebe7fc700 1 -- 172.21.15.49:0/1965360782 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec001d630 con 0x7efec81544d0 2023-11-30T17:19:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.767+0000 7efebe7fc700 1 -- 172.21.15.49:0/1965360782 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec001d790 con 0x7efec81544d0 2023-11-30T17:19:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.767+0000 7efed0444700 1 -- 172.21.15.49:0/1965360782 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec80a91c0 con 0x7efec81544d0 2023-11-30T17:19:40.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.767+0000 7efebe7fc700 1 -- 172.21.15.49:0/1965360782 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec001db50 con 0x7efec81544d0 2023-11-30T17:19:40.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.767+0000 7efed0444700 1 -- 172.21.15.49:0/1965360782 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec80a9780 con 0x7efec81544d0 2023-11-30T17:19:40.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.768+0000 7efed0444700 1 -- 172.21.15.49:0/1965360782 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec80a99a0 con 0x7efec81544d0 2023-11-30T17:19:40.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.768+0000 7efebe7fc700 1 -- 172.21.15.49:0/1965360782 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7efec0026410 con 0x7efec81544d0 2023-11-30T17:19:40.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.768+0000 7efebe7fc700 1 --2- 172.21.15.49:0/1965360782 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efeac05f270 0x7efeac061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:40.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.769+0000 7efece1e0700 1 -- 172.21.15.49:0/1965360782 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efeac05f270 msgr2=0x7efeac061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:19:40.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.769+0000 7efebe7fc700 1 -- 172.21.15.49:0/1965360782 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 7082+0+0 (secure 0 0 0) 0x7efec007c8a0 con 0x7efec81544d0 2023-11-30T17:19:40.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.769+0000 7efece1e0700 1 --2- 172.21.15.49:0/1965360782 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efeac05f270 0x7efeac061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:19:40.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.773+0000 7efebe7fc700 1 -- 172.21.15.49:0/1965360782 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efec00510b0 con 0x7efec81544d0 2023-11-30T17:19:40.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.951+0000 7efed0444700 1 -- 172.21.15.49:0/1965360782 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efec8155910 con 0x7efec81544d0 2023-11-30T17:19:40.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.952+0000 7efebe7fc700 1 -- 172.21.15.49:0/1965360782 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+18396 (secure 0 0 0) 0x7efec0050ca0 con 0x7efec81544d0 2023-11-30T17:19:40.953 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:19:40.954 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":49,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:19:39.873581+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:08:03.325011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-30T17:08:04.171666+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":220,"snap_epoch":49,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.10","mappings":[{"from":5,"to":1}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/2453164493":"2023-12-01T17:08:22.105096+0000","172.21.15.115:6833/89956":"2023-12-01T17:08:22.105096+0000","172.21.15.115:0/3230559129":"2023-12-01T17:08:22.105096+0000","172.21.15.115:6832/89956":"2023-12-01T17:08:22.105096+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":4,"length":3},{"begin":8,"length":2},{"begin":11,"length":2},{"begin":14,"length":3},{"begin":18,"length":2},{"begin":21,"length":2},{"begin":24,"length":3},{"begin":28,"length":2},{"begin":31,"length":2},{"begin":34,"length":3},{"begin":38,"length":2},{"begin":41,"length":2},{"begin":44,"length":3},{"begin":48,"length":2},{"begin":51,"length":2},{"begin":54,"length":3},{"begin":58,"length":2},{"begin":61,"length":3},{"begin":65,"length":3},{"begin":69,"length":2},{"begin":72,"length":2},{"begin":75,"length":3},{"begin":79,"length":2},{"begin":82,"length":2},{"begin":85,"length":3},{"begin":89,"length":2},{"begin":92,"length":2},{"begin":95,"length":3},{"begin":99,"length":2},{"begin":102,"length":2},{"begin":105,"length":2},{"begin":109,"length":2},{"begin":145,"length":76}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":6,"length":1},{"begin":16,"length":1},{"begin":26,"length":1},{"begin":36,"length":1},{"begin":46,"length":1},{"begin":56,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":210,"length":11}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:19:40.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.954+0000 7efed0444700 1 -- 172.21.15.49:0/1965360782 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efeac05f270 msgr2=0x7efeac061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:19:40.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.954+0000 7efed0444700 1 --2- 172.21.15.49:0/1965360782 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efeac05f270 0x7efeac061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:40.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.954+0000 7efed0444700 1 -- 172.21.15.49:0/1965360782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efec81544d0 msgr2=0x7efec80a8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:40.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.954+0000 7efed0444700 1 --2- 172.21.15.49:0/1965360782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efec81544d0 0x7efec80a8a00 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7efec0012fd0 tx=0x7efec0009780).stop 2023-11-30T17:19:40.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.954+0000 7efed0444700 1 -- 172.21.15.49:0/1965360782 shutdown_connections 2023-11-30T17:19:40.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.954+0000 7efed0444700 1 --2- 172.21.15.49:0/1965360782 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efeac05f270 0x7efeac061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:40.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.954+0000 7efed0444700 1 --2- 172.21.15.49:0/1965360782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efec81544d0 0x7efec80a8a00 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:40.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.954+0000 7efed0444700 1 --2- 172.21.15.49:0/1965360782 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efec8064e20 0x7efec8164bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:40.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.954+0000 7efed0444700 1 --2- 172.21.15.49:0/1965360782 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efec8095e80 0x7efec81615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:40.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.954+0000 7efed0444700 1 -- 172.21.15.49:0/1965360782 >> 172.21.15.49:0/1965360782 conn(0x7efec80631d0 msgr2=0x7efec8150720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:40.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.954+0000 7efed0444700 1 -- 172.21.15.49:0/1965360782 shutdown_connections 2023-11-30T17:19:40.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:40.954+0000 7efed0444700 1 -- 172.21.15.49:0/1965360782 wait complete. 2023-11-30T17:19:40.968 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-30T17:08:03.325011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-11-30T17:08:04.171666+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 220, 'snap_epoch': 49, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-30T17:19:40.968 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T17:19:41.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.092+0000 7f0cf3fff700 1 Processor -- start 2023-11-30T17:19:41.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.092+0000 7f0cf3fff700 1 -- start start 2023-11-30T17:19:41.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.093+0000 7f0cf3fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0cf40c66f0 0x7f0cf4154950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:41.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.094+0000 7f0cf3fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0cf4158570 0x7f0cf4158a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:41.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.094+0000 7f0cf3fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf4154e40 con 0x7f0cf414e530 2023-11-30T17:19:41.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.094+0000 7f0cf3fff700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf40c6b70 con 0x7f0cf4158570 2023-11-30T17:19:41.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.094+0000 7f0cf3fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf40c7bc0 con 0x7f0cf40c66f0 2023-11-30T17:19:41.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.094+0000 7f0cf37fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0cf4158570 0x7f0cf4158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:41.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.094+0000 7f0cf2ffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f0cf414e530 0x7f0cf414e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:35966/0 (socket says 172.21.15.49:35966) 2023-11-30T17:19:41.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.094+0000 7f0cf37fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0cf4158570 0x7f0cf4158a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53050/0 (socket says 172.21.15.49:53050) 2023-11-30T17:19:41.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.094+0000 7f0cf2ffd700 1 -- 172.21.15.49:0/2285610660 learned_addr learned my addr 172.21.15.49:0/2285610660 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:41.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.094+0000 7f0cf27fc700 1 --2- 172.21.15.49:0/2285610660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0cf40c66f0 0x7f0cf4154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:41.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.094+0000 7f0cf1ffb700 1 -- 172.21.15.49:0/2285610660 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 859016721 0 0) 0x7f0cdc001110 con 0x7f0cf414e530 2023-11-30T17:19:41.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.094+0000 7f0cf37fe700 1 -- 172.21.15.49:0/2285610660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0cf40c66f0 msgr2=0x7f0cf4154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:41.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.094+0000 7f0cf37fe700 1 --2- 172.21.15.49:0/2285610660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0cf40c66f0 0x7f0cf4154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:41.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.094+0000 7f0cf37fe700 1 -- 172.21.15.49:0/2285610660 >> v1:172.21.15.115:6789/0 conn(0x7f0cf414e530 legacy=0x7f0cf414e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:41.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.094+0000 7f0cf37fe700 1 -- 172.21.15.49:0/2285610660 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf4155920 con 0x7f0cf4158570 2023-11-30T17:19:41.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.094+0000 7f0cf37fe700 1 --2- 172.21.15.49:0/2285610660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0cf4158570 0x7f0cf4158a00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f0cec009e60 tx=0x7f0cec009780).ready entity=mon.0 client_cookie=e6527b2a48e1d687 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:41.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.094+0000 7f0cf1ffb700 1 -- 172.21.15.49:0/2285610660 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec00e070 con 0x7f0cf4158570 2023-11-30T17:19:41.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.094+0000 7f0cf1ffb700 1 -- 172.21.15.49:0/2285610660 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec00bb60 con 0x7f0cf4158570 2023-11-30T17:19:41.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.094+0000 7f0cf1ffb700 1 -- 172.21.15.49:0/2285610660 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec012410 con 0x7f0cf4158570 2023-11-30T17:19:41.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.095+0000 7f0cf3fff700 1 -- 172.21.15.49:0/2285610660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0cf4158570 msgr2=0x7f0cf4158a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:41.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.095+0000 7f0cf3fff700 1 --2- 172.21.15.49:0/2285610660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0cf4158570 0x7f0cf4158a00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f0cec009e60 tx=0x7f0cec009780).stop 2023-11-30T17:19:41.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.095+0000 7f0cf3fff700 1 -- 172.21.15.49:0/2285610660 shutdown_connections 2023-11-30T17:19:41.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.095+0000 7f0cf3fff700 1 --2- 172.21.15.49:0/2285610660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0cf4158570 0x7f0cf4158a00 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:41.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.095+0000 7f0cf3fff700 1 --2- 172.21.15.49:0/2285610660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0cf40c66f0 0x7f0cf4154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:41.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.095+0000 7f0cf3fff700 1 -- 172.21.15.49:0/2285610660 >> 172.21.15.49:0/2285610660 conn(0x7f0cf4064990 msgr2=0x7f0cf4064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:41.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.095+0000 7f0cf3fff700 1 -- 172.21.15.49:0/2285610660 shutdown_connections 2023-11-30T17:19:41.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.095+0000 7f0cf3fff700 1 -- 172.21.15.49:0/2285610660 wait complete. 2023-11-30T17:19:41.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.097+0000 7f0cf3fff700 1 Processor -- start 2023-11-30T17:19:41.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.097+0000 7f0cf3fff700 1 -- start start 2023-11-30T17:19:41.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.099+0000 7f0cf3fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cf40c66f0 0x7f0cf4164d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:41.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.099+0000 7f0cf3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0cf414e530 0x7f0cf4167c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:41.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.099+0000 7f0cf3fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0cf4158570 0x7f0cf40afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:41.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.099+0000 7f0cf3fff700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf4165200 con 0x7f0cf414e530 2023-11-30T17:19:41.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.099+0000 7f0cf3fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf4168110 con 0x7f0cf40c66f0 2023-11-30T17:19:41.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.099+0000 7f0cf3fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf40c2120 con 0x7f0cf4158570 2023-11-30T17:19:41.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.099+0000 7f0cf27fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0cf414e530 0x7f0cf4167c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:41.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.099+0000 7f0cf2ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cf40c66f0 0x7f0cf4164d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:41.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.099+0000 7f0cf27fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0cf414e530 0x7f0cf4167c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53062/0 (socket says 172.21.15.49:53062) 2023-11-30T17:19:41.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.099+0000 7f0cf27fc700 1 -- 172.21.15.49:0/4069237952 learned_addr learned my addr 172.21.15.49:0/4069237952 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:41.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.099+0000 7f0cf37fe700 1 --2- 172.21.15.49:0/4069237952 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0cf4158570 0x7f0cf40afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:41.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.099+0000 7f0cf27fc700 1 -- 172.21.15.49:0/4069237952 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0cf4158570 msgr2=0x7f0cf40afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:41.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.099+0000 7f0cf27fc700 1 --2- 172.21.15.49:0/4069237952 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0cf4158570 0x7f0cf40afc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:41.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.099+0000 7f0cf27fc700 1 -- 172.21.15.49:0/4069237952 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cf40c66f0 msgr2=0x7f0cf4164d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:41.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.099+0000 7f0cf27fc700 1 --2- 172.21.15.49:0/4069237952 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cf40c66f0 0x7f0cf4164d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:41.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.099+0000 7f0cf27fc700 1 -- 172.21.15.49:0/4069237952 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec009a20 con 0x7f0cf414e530 2023-11-30T17:19:41.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.099+0000 7f0cf27fc700 1 --2- 172.21.15.49:0/4069237952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0cf414e530 0x7f0cf4167c20 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f0ce400e930 tx=0x7f0ce4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:41.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.099+0000 7f0ceaffd700 1 -- 172.21.15.49:0/4069237952 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4012600 con 0x7f0cf414e530 2023-11-30T17:19:41.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.099+0000 7f0ceaffd700 1 -- 172.21.15.49:0/4069237952 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce4012760 con 0x7f0cf414e530 2023-11-30T17:19:41.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.099+0000 7f0ceaffd700 1 -- 172.21.15.49:0/4069237952 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4012ae0 con 0x7f0cf414e530 2023-11-30T17:19:41.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.099+0000 7f0cf3fff700 1 -- 172.21.15.49:0/4069237952 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf40c23e0 con 0x7f0cf414e530 2023-11-30T17:19:41.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.100+0000 7f0cf3fff700 1 -- 172.21.15.49:0/4069237952 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf40c29a0 con 0x7f0cf414e530 2023-11-30T17:19:41.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.101+0000 7f0cf3fff700 1 -- 172.21.15.49:0/4069237952 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf4062ee0 con 0x7f0cf414e530 2023-11-30T17:19:41.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.101+0000 7f0ceaffd700 1 -- 172.21.15.49:0/4069237952 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f0ce401b400 con 0x7f0cf414e530 2023-11-30T17:19:41.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.101+0000 7f0ceaffd700 1 --2- 172.21.15.49:0/4069237952 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0cd405f270 0x7f0cd4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:41.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.102+0000 7f0cf2ffd700 1 -- 172.21.15.49:0/4069237952 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0cd405f270 msgr2=0x7f0cd4061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:19:41.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.102+0000 7f0ceaffd700 1 -- 172.21.15.49:0/4069237952 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 7082+0+0 (secure 0 0 0) 0x7f0ce407ac30 con 0x7f0cf414e530 2023-11-30T17:19:41.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.102+0000 7f0cf2ffd700 1 --2- 172.21.15.49:0/4069237952 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0cd405f270 0x7f0cd4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:19:41.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.105+0000 7f0ceaffd700 1 -- 172.21.15.49:0/4069237952 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0ce404b960 con 0x7f0cf414e530 2023-11-30T17:19:41.164 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:41.162+0000 7f89818bb680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T17:19:41.235 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:41.234+0000 7f89818bb680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T17:19:41.254 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:19:41.252+0000 7f4b630b8680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T17:19:41.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.303+0000 7f0cf2ffd700 1 -- 172.21.15.49:0/4069237952 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0cd405f270 msgr2=0x7f0cd4061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:19:41.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.303+0000 7f0cf2ffd700 1 --2- 172.21.15.49:0/4069237952 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0cd405f270 0x7f0cd4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:19:41.324 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:19:41.323+0000 7f4b630b8680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T17:19:41.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.327+0000 7f0cf3fff700 1 -- 172.21.15.49:0/4069237952 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0cf406c7c0 con 0x7f0cf414e530 2023-11-30T17:19:41.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.327+0000 7f0ceaffd700 1 -- 172.21.15.49:0/4069237952 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v49) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0ce404ef80 con 0x7f0cf414e530 2023-11-30T17:19:41.328 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T17:19:41.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.329+0000 7f0cf3fff700 1 -- 172.21.15.49:0/4069237952 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0cd405f270 msgr2=0x7f0cd4061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:19:41.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.329+0000 7f0cf3fff700 1 --2- 172.21.15.49:0/4069237952 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0cd405f270 0x7f0cd4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:41.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.329+0000 7f0cf3fff700 1 -- 172.21.15.49:0/4069237952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0cf414e530 msgr2=0x7f0cf4167c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:41.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.329+0000 7f0cf3fff700 1 --2- 172.21.15.49:0/4069237952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0cf414e530 0x7f0cf4167c20 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f0ce400e930 tx=0x7f0ce4009060).stop 2023-11-30T17:19:41.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.329+0000 7f0cf3fff700 1 -- 172.21.15.49:0/4069237952 shutdown_connections 2023-11-30T17:19:41.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.329+0000 7f0cf3fff700 1 --2- 172.21.15.49:0/4069237952 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0cf4158570 0x7f0cf40afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:41.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.329+0000 7f0cf3fff700 1 --2- 172.21.15.49:0/4069237952 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cf40c66f0 0x7f0cf4164d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:41.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.329+0000 7f0cf3fff700 1 --2- 172.21.15.49:0/4069237952 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0cd405f270 0x7f0cd4061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:41.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.329+0000 7f0cf3fff700 1 --2- 172.21.15.49:0/4069237952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0cf414e530 0x7f0cf4167c20 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:41.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.329+0000 7f0cf3fff700 1 -- 172.21.15.49:0/4069237952 >> 172.21.15.49:0/4069237952 conn(0x7f0cf4064990 msgr2=0x7f0cf4153f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:41.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.329+0000 7f0cf3fff700 1 -- 172.21.15.49:0/4069237952 shutdown_connections 2023-11-30T17:19:41.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.329+0000 7f0cf3fff700 1 -- 172.21.15.49:0/4069237952 wait complete. 2023-11-30T17:19:41.343 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T17:19:41.422 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:41.421+0000 7f89818bb680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T17:19:41.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.467+0000 7fb9ff991700 1 Processor -- start 2023-11-30T17:19:41.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.467+0000 7fb9ff991700 1 -- start start 2023-11-30T17:19:41.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.468+0000 7fb9ff991700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb9f8098d10 0x7fb9f80c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:41.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.468+0000 7fb9ff991700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f80c72d0 con 0x7fb9f80c6190 2023-11-30T17:19:41.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.468+0000 7fb9ff991700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f8064570 con 0x7fb9f8158320 2023-11-30T17:19:41.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.468+0000 7fb9ff991700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f8154bc0 con 0x7fb9f8098d10 2023-11-30T17:19:41.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.468+0000 7fb9fcf2c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb9f80c6190 0x7fb9f8063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52890/0 (socket says 172.21.15.49:52890) 2023-11-30T17:19:41.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.468+0000 7fb9fcf2c700 1 -- 172.21.15.49:0/738601524 learned_addr learned my addr 172.21.15.49:0/738601524 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:41.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.468+0000 7fb9fd72d700 1 --2- 172.21.15.49:0/738601524 >> v2:172.21.15.115:3300/0 conn(0x7fb9f8098d10 0x7fb9f80c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:41.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.468+0000 7fb9effff700 1 -- 172.21.15.49:0/738601524 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 775752704 0 0) 0x7fb9f80c72d0 con 0x7fb9f80c6190 2023-11-30T17:19:41.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.468+0000 7fb9effff700 1 -- 172.21.15.49:0/738601524 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9e40033f0 con 0x7fb9f80c6190 2023-11-30T17:19:41.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.468+0000 7fb9effff700 1 -- 172.21.15.49:0/738601524 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2467349889 0 0) 0x7fb9f8064570 con 0x7fb9f8158320 2023-11-30T17:19:41.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.468+0000 7fb9effff700 1 -- 172.21.15.49:0/738601524 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9f80c72d0 con 0x7fb9f8158320 2023-11-30T17:19:41.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.468+0000 7fb9fd72d700 1 -- 172.21.15.49:0/738601524 >> v1:172.21.15.115:6789/0 conn(0x7fb9f8158320 legacy=0x7fb9f80a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:41.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.468+0000 7fb9fd72d700 1 -- 172.21.15.49:0/738601524 >> v1:172.21.15.49:6789/0 conn(0x7fb9f80c6190 legacy=0x7fb9f8063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:41.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.468+0000 7fb9fd72d700 1 -- 172.21.15.49:0/738601524 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f80c66c0 con 0x7fb9f8098d10 2023-11-30T17:19:41.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.469+0000 7fb9fd72d700 1 --2- 172.21.15.49:0/738601524 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9f8098d10 0x7fb9f80c7760 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fb9f4009760 tx=0x7fb9f4009060).ready entity=mon.1 client_cookie=df7c7a0dcc73e7c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:41.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.469+0000 7fb9effff700 1 -- 172.21.15.49:0/738601524 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f400d4a0 con 0x7fb9f8098d10 2023-11-30T17:19:41.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.469+0000 7fb9effff700 1 -- 172.21.15.49:0/738601524 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f400d600 con 0x7fb9f8098d10 2023-11-30T17:19:41.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.469+0000 7fb9effff700 1 -- 172.21.15.49:0/738601524 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f400d980 con 0x7fb9f8098d10 2023-11-30T17:19:41.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.469+0000 7fb9ff991700 1 -- 172.21.15.49:0/738601524 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9f8098d10 msgr2=0x7fb9f80c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:41.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.469+0000 7fb9ff991700 1 --2- 172.21.15.49:0/738601524 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9f8098d10 0x7fb9f80c7760 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fb9f4009760 tx=0x7fb9f4009060).stop 2023-11-30T17:19:41.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.469+0000 7fb9ff991700 1 -- 172.21.15.49:0/738601524 shutdown_connections 2023-11-30T17:19:41.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.469+0000 7fb9ff991700 1 --2- 172.21.15.49:0/738601524 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9f8098d10 0x7fb9f80c7760 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:41.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.469+0000 7fb9ff991700 1 -- 172.21.15.49:0/738601524 >> 172.21.15.49:0/738601524 conn(0x7fb9f80cb310 msgr2=0x7fb9f80cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:41.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.469+0000 7fb9ff991700 1 -- 172.21.15.49:0/738601524 shutdown_connections 2023-11-30T17:19:41.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.470+0000 7fb9ff991700 1 -- 172.21.15.49:0/738601524 wait complete. 2023-11-30T17:19:41.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.471+0000 7fb9ff991700 1 Processor -- start 2023-11-30T17:19:41.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.471+0000 7fb9ff991700 1 -- start start 2023-11-30T17:19:41.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.471+0000 7fb9ff991700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9f8098d10 0x7fb9f8165070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:41.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.472+0000 7fb9ff991700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9f80c6190 0x7fb9f8168dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:41.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.472+0000 7fb9ff991700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9f8158320 0x7fb9f8156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:41.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.472+0000 7fb9ff991700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f8168660 con 0x7fb9f80c6190 2023-11-30T17:19:41.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.472+0000 7fb9ff991700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f81658c0 con 0x7fb9f8098d10 2023-11-30T17:19:41.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.472+0000 7fb9ff991700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f8165ba0 con 0x7fb9f8158320 2023-11-30T17:19:41.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.472+0000 7fb9fcf2c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9f80c6190 0x7fb9f8168dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:41.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.472+0000 7fb9fd72d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9f8098d10 0x7fb9f8165070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:41.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.472+0000 7fb9fcf2c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9f80c6190 0x7fb9f8168dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53074/0 (socket says 172.21.15.49:53074) 2023-11-30T17:19:41.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.472+0000 7fb9fd72d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9f8098d10 0x7fb9f8165070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:55630/0 (socket says 172.21.15.49:55630) 2023-11-30T17:19:41.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.472+0000 7fb9fcf2c700 1 -- 172.21.15.49:0/4208443783 learned_addr learned my addr 172.21.15.49:0/4208443783 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:41.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.472+0000 7fb9fdf2e700 1 --2- 172.21.15.49:0/4208443783 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9f8158320 0x7fb9f8156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:41.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.472+0000 7fb9fd72d700 1 -- 172.21.15.49:0/4208443783 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9f8158320 msgr2=0x7fb9f8156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:41.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.472+0000 7fb9fd72d700 1 --2- 172.21.15.49:0/4208443783 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9f8158320 0x7fb9f8156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:41.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.472+0000 7fb9fd72d700 1 -- 172.21.15.49:0/4208443783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9f80c6190 msgr2=0x7fb9f8168dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:41.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.472+0000 7fb9fd72d700 1 --2- 172.21.15.49:0/4208443783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9f80c6190 0x7fb9f8168dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:41.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.472+0000 7fb9fd72d700 1 -- 172.21.15.49:0/4208443783 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f40092a0 con 0x7fb9f8098d10 2023-11-30T17:19:41.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.472+0000 7fb9fd72d700 1 --2- 172.21.15.49:0/4208443783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9f8098d10 0x7fb9f8165070 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fb9f4013000 tx=0x7fb9f4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:41.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.472+0000 7fb9ed7fa700 1 -- 172.21.15.49:0/4208443783 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4021070 con 0x7fb9f8098d10 2023-11-30T17:19:41.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.472+0000 7fb9ed7fa700 1 -- 172.21.15.49:0/4208443783 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f400dcf0 con 0x7fb9f8098d10 2023-11-30T17:19:41.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.472+0000 7fb9ed7fa700 1 -- 172.21.15.49:0/4208443783 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f400d980 con 0x7fb9f8098d10 2023-11-30T17:19:41.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.472+0000 7fb9ff991700 1 -- 172.21.15.49:0/4208443783 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f8165e80 con 0x7fb9f8098d10 2023-11-30T17:19:41.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.472+0000 7fb9ff991700 1 -- 172.21.15.49:0/4208443783 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f8165560 con 0x7fb9f8098d10 2023-11-30T17:19:41.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.473+0000 7fb9ff991700 1 -- 172.21.15.49:0/4208443783 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f8165ce0 con 0x7fb9f8098d10 2023-11-30T17:19:41.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.474+0000 7fb9ed7fa700 1 -- 172.21.15.49:0/4208443783 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fb9f401d640 con 0x7fb9f8098d10 2023-11-30T17:19:41.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.474+0000 7fb9ed7fa700 1 --2- 172.21.15.49:0/4208443783 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb9dc05f270 0x7fb9dc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:41.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.474+0000 7fb9ed7fa700 1 -- 172.21.15.49:0/4208443783 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 7082+0+0 (secure 0 0 0) 0x7fb9f407ba90 con 0x7fb9f8098d10 2023-11-30T17:19:41.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.474+0000 7fb9fcf2c700 1 -- 172.21.15.49:0/4208443783 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb9dc05f270 msgr2=0x7fb9dc061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:19:41.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.474+0000 7fb9fcf2c700 1 --2- 172.21.15.49:0/4208443783 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb9dc05f270 0x7fb9dc061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:19:41.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.479+0000 7fb9ed7fa700 1 -- 172.21.15.49:0/4208443783 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb9f8165ce0 con 0x7fb9f8098d10 2023-11-30T17:19:41.524 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:19:41.523+0000 7f4b630b8680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T17:19:41.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.653+0000 7fb9ff991700 1 -- 172.21.15.49:0/4208443783 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb9f8165ce0 con 0x7fb9f8098d10 2023-11-30T17:19:41.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.654+0000 7fb9ed7fa700 1 -- 172.21.15.49:0/4208443783 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v49) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb9f8165ce0 con 0x7fb9f8098d10 2023-11-30T17:19:41.655 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T17:19:41.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.656+0000 7fb9ff991700 1 -- 172.21.15.49:0/4208443783 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb9dc05f270 msgr2=0x7fb9dc061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:19:41.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.656+0000 7fb9ff991700 1 --2- 172.21.15.49:0/4208443783 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb9dc05f270 0x7fb9dc061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:41.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.656+0000 7fb9ff991700 1 -- 172.21.15.49:0/4208443783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9f8098d10 msgr2=0x7fb9f8165070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:41.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.656+0000 7fb9ff991700 1 --2- 172.21.15.49:0/4208443783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9f8098d10 0x7fb9f8165070 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fb9f4013000 tx=0x7fb9f4016000).stop 2023-11-30T17:19:41.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.656+0000 7fb9ff991700 1 -- 172.21.15.49:0/4208443783 shutdown_connections 2023-11-30T17:19:41.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.656+0000 7fb9ff991700 1 --2- 172.21.15.49:0/4208443783 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9f8158320 0x7fb9f8156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:41.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.656+0000 7fb9ff991700 1 --2- 172.21.15.49:0/4208443783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9f8098d10 0x7fb9f8165070 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:41.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.656+0000 7fb9ff991700 1 --2- 172.21.15.49:0/4208443783 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb9dc05f270 0x7fb9dc061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:41.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.656+0000 7fb9ff991700 1 --2- 172.21.15.49:0/4208443783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9f80c6190 0x7fb9f8168dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:41.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.656+0000 7fb9ff991700 1 -- 172.21.15.49:0/4208443783 >> 172.21.15.49:0/4208443783 conn(0x7fb9f80cb310 msgr2=0x7fb9f80c7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:41.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.656+0000 7fb9ff991700 1 -- 172.21.15.49:0/4208443783 shutdown_connections 2023-11-30T17:19:41.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.656+0000 7fb9ff991700 1 -- 172.21.15.49:0/4208443783 wait complete. 2023-11-30T17:19:41.670 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-30T17:19:41.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.794+0000 7f7b3ffff700 1 Processor -- start 2023-11-30T17:19:41.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.794+0000 7f7b3ffff700 1 -- start start 2023-11-30T17:19:41.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.796+0000 7f7b3ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b4014e530 0x7f7b400c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:41.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.796+0000 7f7b3ffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7b40158570 0x7f7b40158a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:41.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.796+0000 7f7b3ffff700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b400c7bc0 con 0x7f7b40154950 2023-11-30T17:19:41.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.796+0000 7f7b3ffff700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b40155920 con 0x7f7b40158570 2023-11-30T17:19:41.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.796+0000 7f7b3ffff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b40154dd0 con 0x7f7b4014e530 2023-11-30T17:19:41.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.796+0000 7f7b3f7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7b40158570 0x7f7b40158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:41.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.796+0000 7f7b3e7fc700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7b40154950 0x7f7b4014e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52906/0 (socket says 172.21.15.49:52906) 2023-11-30T17:19:41.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.796+0000 7f7b3e7fc700 1 -- 172.21.15.49:0/1835582737 learned_addr learned my addr 172.21.15.49:0/1835582737 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:41.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.796+0000 7f7b3effd700 1 --2- 172.21.15.49:0/1835582737 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b4014e530 0x7f7b400c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:41.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.796+0000 7f7b3f7fe700 1 -- 172.21.15.49:0/1835582737 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b4014e530 msgr2=0x7f7b400c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:41.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.796+0000 7f7b3f7fe700 1 --2- 172.21.15.49:0/1835582737 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b4014e530 0x7f7b400c66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:41.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.796+0000 7f7b3f7fe700 1 -- 172.21.15.49:0/1835582737 >> v1:172.21.15.49:6789/0 conn(0x7f7b40154950 legacy=0x7f7b4014e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:41.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.796+0000 7f7b3dffb700 1 -- 172.21.15.49:0/1835582737 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 787544157 0 0) 0x7f7b400c7bc0 con 0x7f7b40154950 2023-11-30T17:19:41.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.796+0000 7f7b3f7fe700 1 -- 172.21.15.49:0/1835582737 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b40155080 con 0x7f7b40158570 2023-11-30T17:19:41.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.796+0000 7f7b3f7fe700 1 --2- 172.21.15.49:0/1835582737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b40158570 0x7f7b40158a20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f7b38009e60 tx=0x7f7b38009780).ready entity=mon.0 client_cookie=5d4a8f829efeeb29 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:41.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.796+0000 7f7b3dffb700 1 -- 172.21.15.49:0/1835582737 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3800e070 con 0x7f7b40158570 2023-11-30T17:19:41.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.796+0000 7f7b3dffb700 1 -- 172.21.15.49:0/1835582737 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3800bb60 con 0x7f7b40158570 2023-11-30T17:19:41.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.796+0000 7f7b3dffb700 1 -- 172.21.15.49:0/1835582737 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b38012410 con 0x7f7b40158570 2023-11-30T17:19:41.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.797+0000 7f7b3ffff700 1 -- 172.21.15.49:0/1835582737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b40158570 msgr2=0x7f7b40158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:41.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.797+0000 7f7b3ffff700 1 --2- 172.21.15.49:0/1835582737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b40158570 0x7f7b40158a20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f7b38009e60 tx=0x7f7b38009780).stop 2023-11-30T17:19:41.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.797+0000 7f7b3ffff700 1 -- 172.21.15.49:0/1835582737 shutdown_connections 2023-11-30T17:19:41.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.797+0000 7f7b3ffff700 1 --2- 172.21.15.49:0/1835582737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b40158570 0x7f7b40158a20 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:41.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.797+0000 7f7b3ffff700 1 --2- 172.21.15.49:0/1835582737 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b4014e530 0x7f7b400c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:41.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.797+0000 7f7b3ffff700 1 -- 172.21.15.49:0/1835582737 >> 172.21.15.49:0/1835582737 conn(0x7f7b40064990 msgr2=0x7f7b40064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:41.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.797+0000 7f7b3ffff700 1 -- 172.21.15.49:0/1835582737 shutdown_connections 2023-11-30T17:19:41.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.797+0000 7f7b3ffff700 1 -- 172.21.15.49:0/1835582737 wait complete. 2023-11-30T17:19:41.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.799+0000 7f7b3ffff700 1 Processor -- start 2023-11-30T17:19:41.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.799+0000 7f7b3ffff700 1 -- start start 2023-11-30T17:19:41.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.800+0000 7f7b3ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b4014e530 0x7f7b400c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:41.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.800+0000 7f7b3ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b40154950 0x7f7b4014baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:41.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.800+0000 7f7b3ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b40158570 0x7f7b400ac1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:41.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.800+0000 7f7b3ffff700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b400c5c30 con 0x7f7b40158570 2023-11-30T17:19:41.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.800+0000 7f7b3ffff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b400af580 con 0x7f7b40154950 2023-11-30T17:19:41.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.800+0000 7f7b3ffff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b400c5390 con 0x7f7b4014e530 2023-11-30T17:19:41.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.801+0000 7f7b3f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b40158570 0x7f7b400ac1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:41.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.801+0000 7f7b3f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b40158570 0x7f7b400ac1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53096/0 (socket says 172.21.15.49:53096) 2023-11-30T17:19:41.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.801+0000 7f7b3f7fe700 1 -- 172.21.15.49:0/3400876990 learned_addr learned my addr 172.21.15.49:0/3400876990 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:41.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.801+0000 7f7b3e7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b40154950 0x7f7b4014baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:41.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.801+0000 7f7b3effd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b4014e530 0x7f7b400c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:41.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.801+0000 7f7b3f7fe700 1 -- 172.21.15.49:0/3400876990 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b4014e530 msgr2=0x7f7b400c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:41.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.801+0000 7f7b3f7fe700 1 --2- 172.21.15.49:0/3400876990 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b4014e530 0x7f7b400c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:41.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.801+0000 7f7b3f7fe700 1 -- 172.21.15.49:0/3400876990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b40154950 msgr2=0x7f7b4014baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:41.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.801+0000 7f7b3f7fe700 1 --2- 172.21.15.49:0/3400876990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b40154950 0x7f7b4014baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:41.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.801+0000 7f7b3f7fe700 1 -- 172.21.15.49:0/3400876990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b38009a20 con 0x7f7b40158570 2023-11-30T17:19:41.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.801+0000 7f7b3e7fc700 1 --2- 172.21.15.49:0/3400876990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b40154950 0x7f7b4014baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:19:41.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.801+0000 7f7b3f7fe700 1 --2- 172.21.15.49:0/3400876990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b40158570 0x7f7b400ac1c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f7b40064480 tx=0x7f7b38009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:41.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.801+0000 7f7b36ffd700 1 -- 172.21.15.49:0/3400876990 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3800b6f0 con 0x7f7b40158570 2023-11-30T17:19:41.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.801+0000 7f7b36ffd700 1 -- 172.21.15.49:0/3400876990 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3801d630 con 0x7f7b40158570 2023-11-30T17:19:41.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.801+0000 7f7b3ffff700 1 -- 172.21.15.49:0/3400876990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b400c5670 con 0x7f7b40158570 2023-11-30T17:19:41.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.801+0000 7f7b36ffd700 1 -- 172.21.15.49:0/3400876990 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3801d9d0 con 0x7f7b40158570 2023-11-30T17:19:41.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.801+0000 7f7b3ffff700 1 -- 172.21.15.49:0/3400876990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b400c4f30 con 0x7f7b40158570 2023-11-30T17:19:41.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.802+0000 7f7b3ffff700 1 -- 172.21.15.49:0/3400876990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b400af860 con 0x7f7b40158570 2023-11-30T17:19:41.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.803+0000 7f7b36ffd700 1 -- 172.21.15.49:0/3400876990 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f7b38003040 con 0x7f7b40158570 2023-11-30T17:19:41.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.803+0000 7f7b36ffd700 1 --2- 172.21.15.49:0/3400876990 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7b2005f270 0x7f7b20061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:41.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.803+0000 7f7b3effd700 1 -- 172.21.15.49:0/3400876990 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7b2005f270 msgr2=0x7f7b20061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:19:41.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.803+0000 7f7b36ffd700 1 -- 172.21.15.49:0/3400876990 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 7082+0+0 (secure 0 0 0) 0x7f7b3807c4b0 con 0x7f7b40158570 2023-11-30T17:19:41.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.803+0000 7f7b3effd700 1 --2- 172.21.15.49:0/3400876990 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7b2005f270 0x7f7b20061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:19:41.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.807+0000 7f7b36ffd700 1 -- 172.21.15.49:0/3400876990 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7b3804d240 con 0x7f7b40158570 2023-11-30T17:19:41.843 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:41.842+0000 7f89818bb680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T17:19:41.945 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:41.944+0000 7f89818bb680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:19:41.973 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:19:41.971+0000 7f4b630b8680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T17:19:41.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.977+0000 7f7b3ffff700 1 -- 172.21.15.49:0/3400876990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7b400c5150 con 0x7f7b40158570 2023-11-30T17:19:41.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.978+0000 7f7b36ffd700 1 -- 172.21.15.49:0/3400876990 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7b400c5150 con 0x7f7b40158570 2023-11-30T17:19:41.979 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T17:19:41.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.980+0000 7f7b3ffff700 1 -- 172.21.15.49:0/3400876990 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7b2005f270 msgr2=0x7f7b20061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:19:41.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.980+0000 7f7b3ffff700 1 --2- 172.21.15.49:0/3400876990 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7b2005f270 0x7f7b20061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:41.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.980+0000 7f7b3ffff700 1 -- 172.21.15.49:0/3400876990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b40158570 msgr2=0x7f7b400ac1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:41.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.980+0000 7f7b3ffff700 1 --2- 172.21.15.49:0/3400876990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b40158570 0x7f7b400ac1c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f7b40064480 tx=0x7f7b38009780).stop 2023-11-30T17:19:41.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.980+0000 7f7b3ffff700 1 -- 172.21.15.49:0/3400876990 shutdown_connections 2023-11-30T17:19:41.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.980+0000 7f7b3ffff700 1 --2- 172.21.15.49:0/3400876990 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7b2005f270 0x7f7b20061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:41.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.980+0000 7f7b3ffff700 1 --2- 172.21.15.49:0/3400876990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b40158570 0x7f7b400ac1c0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:41.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.980+0000 7f7b3ffff700 1 --2- 172.21.15.49:0/3400876990 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b4014e530 0x7f7b400c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:41.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.980+0000 7f7b3ffff700 1 --2- 172.21.15.49:0/3400876990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b40154950 0x7f7b4014baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:41.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.980+0000 7f7b3ffff700 1 -- 172.21.15.49:0/3400876990 >> 172.21.15.49:0/3400876990 conn(0x7f7b40064990 msgr2=0x7f7b40153e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:41.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.980+0000 7f7b3ffff700 1 -- 172.21.15.49:0/3400876990 shutdown_connections 2023-11-30T17:19:41.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:41.980+0000 7f7b3ffff700 1 -- 172.21.15.49:0/3400876990 wait complete. 2023-11-30T17:19:41.994 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-30T17:19:42.086 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:19:42.085+0000 7f4b630b8680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:19:42.098 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:42.097+0000 7f89818bb680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T17:19:42.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.115+0000 7efd093dc700 1 Processor -- start 2023-11-30T17:19:42.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.115+0000 7efd093dc700 1 -- start start 2023-11-30T17:19:42.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.116+0000 7efd093dc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efd04064350 0x7efd04158800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:42.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.116+0000 7efd093dc700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd040c12d0 con 0x7efd040987b0 2023-11-30T17:19:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.116+0000 7efd093dc700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd040c61c0 con 0x7efd04158420 2023-11-30T17:19:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.116+0000 7efd093dc700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd040c5e90 con 0x7efd04064350 2023-11-30T17:19:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.116+0000 7efd037fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7efd040987b0 0x7efd040c6650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52910/0 (socket says 172.21.15.49:52910) 2023-11-30T17:19:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.116+0000 7efd037fe700 1 -- 172.21.15.49:0/1810096105 learned_addr learned my addr 172.21.15.49:0/1810096105 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.117+0000 7efd027fc700 1 --2- 172.21.15.49:0/1810096105 >> v2:172.21.15.115:3300/0 conn(0x7efd04064350 0x7efd04158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.117+0000 7efd01ffb700 1 -- 172.21.15.49:0/1810096105 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3296159802 0 0) 0x7efd040c12d0 con 0x7efd040987b0 2023-11-30T17:19:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.117+0000 7efd01ffb700 1 -- 172.21.15.49:0/1810096105 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcf00033f0 con 0x7efd040987b0 2023-11-30T17:19:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.117+0000 7efd01ffb700 1 -- 172.21.15.49:0/1810096105 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724264385 0 0) 0x7efd040c61c0 con 0x7efd04158420 2023-11-30T17:19:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.117+0000 7efd01ffb700 1 -- 172.21.15.49:0/1810096105 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd040c12d0 con 0x7efd04158420 2023-11-30T17:19:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.117+0000 7efd027fc700 1 -- 172.21.15.49:0/1810096105 >> v1:172.21.15.115:6789/0 conn(0x7efd04158420 legacy=0x7efd040c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.117+0000 7efd027fc700 1 -- 172.21.15.49:0/1810096105 >> v1:172.21.15.49:6789/0 conn(0x7efd040987b0 legacy=0x7efd040c6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.117+0000 7efd01ffb700 1 -- 172.21.15.49:0/1810096105 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4123203479 0 0) 0x7efcf00033f0 con 0x7efd040987b0 2023-11-30T17:19:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.117+0000 7efd027fc700 1 -- 172.21.15.49:0/1810096105 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd040c1500 con 0x7efd04064350 2023-11-30T17:19:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.117+0000 7efd027fc700 1 --2- 172.21.15.49:0/1810096105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd04064350 0x7efd04158800 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7efcf4009760 tx=0x7efcf4009060).ready entity=mon.1 client_cookie=de25a3fe79d0176c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:42.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.117+0000 7efd01ffb700 1 -- 172.21.15.49:0/1810096105 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf400d4a0 con 0x7efd04064350 2023-11-30T17:19:42.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.117+0000 7efd01ffb700 1 -- 172.21.15.49:0/1810096105 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf400d600 con 0x7efd04064350 2023-11-30T17:19:42.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.117+0000 7efd01ffb700 1 -- 172.21.15.49:0/1810096105 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf400d980 con 0x7efd04064350 2023-11-30T17:19:42.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.118+0000 7efd093dc700 1 -- 172.21.15.49:0/1810096105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd04064350 msgr2=0x7efd04158800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:42.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.118+0000 7efd093dc700 1 --2- 172.21.15.49:0/1810096105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd04064350 0x7efd04158800 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7efcf4009760 tx=0x7efcf4009060).stop 2023-11-30T17:19:42.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.118+0000 7efd093dc700 1 -- 172.21.15.49:0/1810096105 shutdown_connections 2023-11-30T17:19:42.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.118+0000 7efd093dc700 1 --2- 172.21.15.49:0/1810096105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd04064350 0x7efd04158800 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:42.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.118+0000 7efd093dc700 1 -- 172.21.15.49:0/1810096105 >> 172.21.15.49:0/1810096105 conn(0x7efd040cb290 msgr2=0x7efd040cb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:42.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.118+0000 7efd093dc700 1 -- 172.21.15.49:0/1810096105 shutdown_connections 2023-11-30T17:19:42.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.118+0000 7efd093dc700 1 -- 172.21.15.49:0/1810096105 wait complete. 2023-11-30T17:19:42.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.119+0000 7efd093dc700 1 Processor -- start 2023-11-30T17:19:42.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.119+0000 7efd093dc700 1 -- start start 2023-11-30T17:19:42.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.120+0000 7efd093dc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd04064350 0x7efd040cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:42.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.120+0000 7efd093dc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd040987b0 0x7efd040abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:42.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.120+0000 7efd093dc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd04158420 0x7efd04144dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:42.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.120+0000 7efd093dc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd040ac230 con 0x7efd040987b0 2023-11-30T17:19:42.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.120+0000 7efd093dc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd040c65e0 con 0x7efd04158420 2023-11-30T17:19:42.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.120+0000 7efd093dc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd040ac470 con 0x7efd04064350 2023-11-30T17:19:42.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.120+0000 7efd027fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd040987b0 0x7efd040abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:42.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.120+0000 7efd027fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd040987b0 0x7efd040abd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53106/0 (socket says 172.21.15.49:53106) 2023-11-30T17:19:42.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.120+0000 7efd027fc700 1 -- 172.21.15.49:0/3171773122 learned_addr learned my addr 172.21.15.49:0/3171773122 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:42.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.120+0000 7efd02ffd700 1 --2- 172.21.15.49:0/3171773122 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd04064350 0x7efd040cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:42.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.120+0000 7efd037fe700 1 --2- 172.21.15.49:0/3171773122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd04158420 0x7efd04144dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:42.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.121+0000 7efd027fc700 1 -- 172.21.15.49:0/3171773122 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd04064350 msgr2=0x7efd040cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:42.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.121+0000 7efd027fc700 1 --2- 172.21.15.49:0/3171773122 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd04064350 0x7efd040cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:42.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.121+0000 7efd027fc700 1 -- 172.21.15.49:0/3171773122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd04158420 msgr2=0x7efd04144dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:42.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.121+0000 7efd027fc700 1 --2- 172.21.15.49:0/3171773122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd04158420 0x7efd04144dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:42.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.121+0000 7efd027fc700 1 -- 172.21.15.49:0/3171773122 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf40092a0 con 0x7efd040987b0 2023-11-30T17:19:42.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.121+0000 7efd027fc700 1 --2- 172.21.15.49:0/3171773122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd040987b0 0x7efd040abd40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7efd04062e00 tx=0x7efcf4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:42.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.121+0000 7efcfaffd700 1 -- 172.21.15.49:0/3171773122 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf400dcf0 con 0x7efd040987b0 2023-11-30T17:19:42.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.121+0000 7efcfaffd700 1 -- 172.21.15.49:0/3171773122 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf400de50 con 0x7efd040987b0 2023-11-30T17:19:42.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.121+0000 7efd093dc700 1 -- 172.21.15.49:0/3171773122 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd040ac750 con 0x7efd040987b0 2023-11-30T17:19:42.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.121+0000 7efcfaffd700 1 -- 172.21.15.49:0/3171773122 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf400d980 con 0x7efd040987b0 2023-11-30T17:19:42.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.121+0000 7efd093dc700 1 -- 172.21.15.49:0/3171773122 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd040acd10 con 0x7efd040987b0 2023-11-30T17:19:42.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.122+0000 7efd093dc700 1 -- 172.21.15.49:0/3171773122 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd0406c830 con 0x7efd040987b0 2023-11-30T17:19:42.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.122+0000 7efcfaffd700 1 -- 172.21.15.49:0/3171773122 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7efcf401d640 con 0x7efd040987b0 2023-11-30T17:19:42.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.123+0000 7efcfaffd700 1 --2- 172.21.15.49:0/3171773122 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efce405f270 0x7efce4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:42.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.123+0000 7efcfaffd700 1 -- 172.21.15.49:0/3171773122 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 7082+0+0 (secure 0 0 0) 0x7efcf407be60 con 0x7efd040987b0 2023-11-30T17:19:42.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.123+0000 7efd02ffd700 1 -- 172.21.15.49:0/3171773122 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efce405f270 msgr2=0x7efce4061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:19:42.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.123+0000 7efd02ffd700 1 --2- 172.21.15.49:0/3171773122 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efce405f270 0x7efce4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:19:42.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.127+0000 7efcfaffd700 1 -- 172.21.15.49:0/3171773122 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efcf404cbf0 con 0x7efd040987b0 2023-11-30T17:19:42.174 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:42.173+0000 7f89818bb680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T17:19:42.241 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:42.239+0000 7f89818bb680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T17:19:42.247 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:19:42.246+0000 7f4b630b8680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T17:19:42.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.301+0000 7efd093dc700 1 -- 172.21.15.49:0/3171773122 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efd040c6720 con 0x7efd040987b0 2023-11-30T17:19:42.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.301+0000 7efcfaffd700 1 -- 172.21.15.49:0/3171773122 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7efcf4050210 con 0x7efd040987b0 2023-11-30T17:19:42.303 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T17:19:42.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.303+0000 7efd093dc700 1 -- 172.21.15.49:0/3171773122 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efce405f270 msgr2=0x7efce4061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:19:42.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.303+0000 7efd093dc700 1 --2- 172.21.15.49:0/3171773122 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efce405f270 0x7efce4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:42.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.303+0000 7efd093dc700 1 -- 172.21.15.49:0/3171773122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd040987b0 msgr2=0x7efd040abd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:42.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.303+0000 7efd093dc700 1 --2- 172.21.15.49:0/3171773122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd040987b0 0x7efd040abd40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7efd04062e00 tx=0x7efcf4016000).stop 2023-11-30T17:19:42.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.303+0000 7efd093dc700 1 -- 172.21.15.49:0/3171773122 shutdown_connections 2023-11-30T17:19:42.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.303+0000 7efd093dc700 1 --2- 172.21.15.49:0/3171773122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd04158420 0x7efd04144dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:42.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.303+0000 7efd093dc700 1 --2- 172.21.15.49:0/3171773122 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd04064350 0x7efd040cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:42.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.303+0000 7efd093dc700 1 --2- 172.21.15.49:0/3171773122 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efce405f270 0x7efce4061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:42.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.303+0000 7efd093dc700 1 --2- 172.21.15.49:0/3171773122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd040987b0 0x7efd040abd40 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:42.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.303+0000 7efd093dc700 1 -- 172.21.15.49:0/3171773122 >> 172.21.15.49:0/3171773122 conn(0x7efd040cb290 msgr2=0x7efd04151050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:42.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.303+0000 7efd093dc700 1 -- 172.21.15.49:0/3171773122 shutdown_connections 2023-11-30T17:19:42.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.304+0000 7efd093dc700 1 -- 172.21.15.49:0/3171773122 wait complete. 2023-11-30T17:19:42.317 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:19:42.327 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:19:42.326+0000 7f4b630b8680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T17:19:42.400 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:19:42.398+0000 7f4b630b8680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T17:19:42.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.436+0000 7ff7ef438700 1 Processor -- start 2023-11-30T17:19:42.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.436+0000 7ff7ef438700 1 -- start start 2023-11-30T17:19:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.437+0000 7ff7ef438700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff7e8150890 0x7ff7e80bbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.437+0000 7ff7ef438700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff7e80bc320 0x7ff7e8069900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.437+0000 7ff7ef438700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e80c28c0 con 0x7ff7e8069df0 2023-11-30T17:19:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.437+0000 7ff7ef438700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7e806a260 con 0x7ff7e80bc320 2023-11-30T17:19:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.437+0000 7ff7ef438700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7e81552e0 con 0x7ff7e8150890 2023-11-30T17:19:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.437+0000 7ff7ec9d3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff7e80bc320 0x7ff7e8069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.437+0000 7ff7ec9d3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff7e80bc320 0x7ff7e8069900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53120/0 (socket says 172.21.15.49:53120) 2023-11-30T17:19:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.437+0000 7ff7ec9d3700 1 -- 172.21.15.49:0/317168130 learned_addr learned my addr 172.21.15.49:0/317168130 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.437+0000 7ff7ed1d4700 1 --2- 172.21.15.49:0/317168130 >> v2:172.21.15.115:3300/0 conn(0x7ff7e8150890 0x7ff7e80bbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.437+0000 7ff7ec9d3700 1 -- 172.21.15.49:0/317168130 >> v2:172.21.15.115:3300/0 conn(0x7ff7e8150890 msgr2=0x7ff7e80bbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.437+0000 7ff7ec9d3700 1 --2- 172.21.15.49:0/317168130 >> v2:172.21.15.115:3300/0 conn(0x7ff7e8150890 0x7ff7e80bbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.437+0000 7ff7ec9d3700 1 -- 172.21.15.49:0/317168130 >> v1:172.21.15.115:6789/0 conn(0x7ff7e8069df0 legacy=0x7ff7e81544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.437+0000 7ff7ec9d3700 1 -- 172.21.15.49:0/317168130 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e806a4b0 con 0x7ff7e80bc320 2023-11-30T17:19:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.437+0000 7ff7dffff700 1 -- 172.21.15.49:0/317168130 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3094216117 0 0) 0x7ff7e80c28c0 con 0x7ff7e8069df0 2023-11-30T17:19:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.437+0000 7ff7ed1d4700 1 --2- 172.21.15.49:0/317168130 >> v2:172.21.15.115:3300/0 conn(0x7ff7e8150890 0x7ff7e80bbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:19:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.437+0000 7ff7ec9d3700 1 --2- 172.21.15.49:0/317168130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7e80bc320 0x7ff7e8069900 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7ff7e80c7ed0 tx=0x7ff7e400a2b0).ready entity=mon.0 client_cookie=44db5ddfa873ce55 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.438+0000 7ff7dffff700 1 -- 172.21.15.49:0/317168130 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e400ae90 con 0x7ff7e80bc320 2023-11-30T17:19:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.438+0000 7ff7dffff700 1 -- 172.21.15.49:0/317168130 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e400c940 con 0x7ff7e80bc320 2023-11-30T17:19:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.438+0000 7ff7dffff700 1 -- 172.21.15.49:0/317168130 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e400ccc0 con 0x7ff7e80bc320 2023-11-30T17:19:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.438+0000 7ff7ef438700 1 -- 172.21.15.49:0/317168130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7e80bc320 msgr2=0x7ff7e8069900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.438+0000 7ff7ef438700 1 --2- 172.21.15.49:0/317168130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7e80bc320 0x7ff7e8069900 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7ff7e80c7ed0 tx=0x7ff7e400a2b0).stop 2023-11-30T17:19:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.438+0000 7ff7ef438700 1 -- 172.21.15.49:0/317168130 shutdown_connections 2023-11-30T17:19:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.438+0000 7ff7ef438700 1 --2- 172.21.15.49:0/317168130 >> v2:172.21.15.115:3300/0 conn(0x7ff7e8150890 0x7ff7e80bbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.438+0000 7ff7ef438700 1 --2- 172.21.15.49:0/317168130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7e80bc320 0x7ff7e8069900 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.438+0000 7ff7ef438700 1 -- 172.21.15.49:0/317168130 >> 172.21.15.49:0/317168130 conn(0x7ff7e80631d0 msgr2=0x7ff7e80c6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:42.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.438+0000 7ff7ef438700 1 -- 172.21.15.49:0/317168130 shutdown_connections 2023-11-30T17:19:42.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.438+0000 7ff7ef438700 1 -- 172.21.15.49:0/317168130 wait complete. 2023-11-30T17:19:42.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.439+0000 7ff7ef438700 1 Processor -- start 2023-11-30T17:19:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.439+0000 7ff7ef438700 1 -- start start 2023-11-30T17:19:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.440+0000 7ff7ef438700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7e8069df0 0x7ff7e814ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.440+0000 7ff7ef438700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7e80bc320 0x7ff7e8164eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.440+0000 7ff7ef438700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff7e8150890 0x7ff7e80abae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.440+0000 7ff7ef438700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e80ac450 con 0x7ff7e80bc320 2023-11-30T17:19:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.440+0000 7ff7ef438700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e80ac730 con 0x7ff7e8069df0 2023-11-30T17:19:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.440+0000 7ff7ef438700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e81646b0 con 0x7ff7e8150890 2023-11-30T17:19:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.441+0000 7ff7ec9d3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7e80bc320 0x7ff7e8164eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.441+0000 7ff7ec9d3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7e80bc320 0x7ff7e8164eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53130/0 (socket says 172.21.15.49:53130) 2023-11-30T17:19:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.441+0000 7ff7ec9d3700 1 -- 172.21.15.49:0/1031160818 learned_addr learned my addr 172.21.15.49:0/1031160818 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.441+0000 7ff7ed1d4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7e8069df0 0x7ff7e814ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.441+0000 7ff7ed9d5700 1 --2- 172.21.15.49:0/1031160818 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff7e8150890 0x7ff7e80abae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.441+0000 7ff7ed1d4700 1 -- 172.21.15.49:0/1031160818 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff7e8150890 msgr2=0x7ff7e80abae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:42.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.441+0000 7ff7ed1d4700 1 --2- 172.21.15.49:0/1031160818 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff7e8150890 0x7ff7e80abae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:42.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.441+0000 7ff7ed1d4700 1 -- 172.21.15.49:0/1031160818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7e80bc320 msgr2=0x7ff7e8164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:42.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.441+0000 7ff7ed1d4700 1 --2- 172.21.15.49:0/1031160818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7e80bc320 0x7ff7e8164eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:42.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.441+0000 7ff7ed1d4700 1 -- 172.21.15.49:0/1031160818 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d80092a0 con 0x7ff7e8069df0 2023-11-30T17:19:42.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.441+0000 7ff7ec9d3700 1 --2- 172.21.15.49:0/1031160818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7e80bc320 0x7ff7e8164eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:19:42.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.441+0000 7ff7ed1d4700 1 --2- 172.21.15.49:0/1031160818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7e8069df0 0x7ff7e814ac20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7ff7d800e880 tx=0x7ff7d8009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:42.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.441+0000 7ff7dd7fa700 1 -- 172.21.15.49:0/1031160818 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d8012600 con 0x7ff7e8069df0 2023-11-30T17:19:42.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.441+0000 7ff7dd7fa700 1 -- 172.21.15.49:0/1031160818 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d8012760 con 0x7ff7e8069df0 2023-11-30T17:19:42.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.441+0000 7ff7ef438700 1 -- 172.21.15.49:0/1031160818 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7e400a510 con 0x7ff7e8069df0 2023-11-30T17:19:42.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.441+0000 7ff7dd7fa700 1 -- 172.21.15.49:0/1031160818 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d8012ae0 con 0x7ff7e8069df0 2023-11-30T17:19:42.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.441+0000 7ff7ef438700 1 -- 172.21.15.49:0/1031160818 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e80aca10 con 0x7ff7e8069df0 2023-11-30T17:19:42.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.442+0000 7ff7ef438700 1 -- 172.21.15.49:0/1031160818 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e8164510 con 0x7ff7e8069df0 2023-11-30T17:19:42.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.443+0000 7ff7dd7fa700 1 -- 172.21.15.49:0/1031160818 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7ff7d801b400 con 0x7ff7e8069df0 2023-11-30T17:19:42.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.443+0000 7ff7dd7fa700 1 --2- 172.21.15.49:0/1031160818 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff7cc05f270 0x7ff7cc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:42.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.443+0000 7ff7ec9d3700 1 -- 172.21.15.49:0/1031160818 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff7cc05f270 msgr2=0x7ff7cc061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:19:42.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.443+0000 7ff7dd7fa700 1 -- 172.21.15.49:0/1031160818 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 7082+0+0 (secure 0 0 0) 0x7ff7d807ab60 con 0x7ff7e8069df0 2023-11-30T17:19:42.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.443+0000 7ff7ec9d3700 1 --2- 172.21.15.49:0/1031160818 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff7cc05f270 0x7ff7cc061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:19:42.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.447+0000 7ff7dd7fa700 1 -- 172.21.15.49:0/1031160818 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff7e8164510 con 0x7ff7e8069df0 2023-11-30T17:19:42.498 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:42.497+0000 7f89818bb680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T17:19:42.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.644+0000 7ff7ec9d3700 1 -- 172.21.15.49:0/1031160818 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff7cc05f270 msgr2=0x7ff7cc061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:19:42.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.644+0000 7ff7ec9d3700 1 --2- 172.21.15.49:0/1031160818 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff7cc05f270 0x7ff7cc061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:19:42.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.663+0000 7ff7ef438700 1 -- 172.21.15.49:0/1031160818 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7e8164510 con 0x7ff7e8069df0 2023-11-30T17:19:42.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.663+0000 7ff7dd7fa700 1 -- 172.21.15.49:0/1031160818 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4495 (secure 0 0 0) 0x7ff7e8164510 con 0x7ff7e8069df0 2023-11-30T17:19:42.665 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:19:42.665 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1260333970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1260333970},{"type":"v1","addr":"172.21.15.115:6836","nonce":1260333970}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4938,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/2286472783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2286472783},{"type":"v1","addr":"172.21.15.49:6834","nonce":2286472783}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4941,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1299033463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1299033463},{"type":"v1","addr":"172.21.15.49:6835","nonce":1299033463}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:08:05.200966+0000","modified":"2023-11-30T17:08:08.207522+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4944},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4944":{"gid":4944,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/3449611740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3449611740},{"type":"v1","addr":"172.21.15.115:6837","nonce":3449611740}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-11-30T17:19:42.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.665+0000 7ff7ef438700 1 -- 172.21.15.49:0/1031160818 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff7cc05f270 msgr2=0x7ff7cc061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:19:42.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.665+0000 7ff7ef438700 1 --2- 172.21.15.49:0/1031160818 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff7cc05f270 0x7ff7cc061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:42.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.665+0000 7ff7ef438700 1 -- 172.21.15.49:0/1031160818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7e8069df0 msgr2=0x7ff7e814ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:42.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.665+0000 7ff7ef438700 1 --2- 172.21.15.49:0/1031160818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7e8069df0 0x7ff7e814ac20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7ff7d800e880 tx=0x7ff7d8009060).stop 2023-11-30T17:19:42.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.665+0000 7ff7ef438700 1 -- 172.21.15.49:0/1031160818 shutdown_connections 2023-11-30T17:19:42.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.665+0000 7ff7ef438700 1 --2- 172.21.15.49:0/1031160818 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff7e8150890 0x7ff7e80abae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:42.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.665+0000 7ff7ef438700 1 --2- 172.21.15.49:0/1031160818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7e8069df0 0x7ff7e814ac20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:42.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.665+0000 7ff7ef438700 1 --2- 172.21.15.49:0/1031160818 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff7cc05f270 0x7ff7cc061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:42.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.665+0000 7ff7ef438700 1 --2- 172.21.15.49:0/1031160818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7e80bc320 0x7ff7e8164eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:42.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.665+0000 7ff7ef438700 1 -- 172.21.15.49:0/1031160818 >> 172.21.15.49:0/1031160818 conn(0x7ff7e80631d0 msgr2=0x7ff7e80c5450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:42.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.665+0000 7ff7ef438700 1 -- 172.21.15.49:0/1031160818 shutdown_connections 2023-11-30T17:19:42.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.665+0000 7ff7ef438700 1 -- 172.21.15.49:0/1031160818 wait complete. 2023-11-30T17:19:42.668 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 16 2023-11-30T17:19:42.677 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:19:42.676+0000 7f4b630b8680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T17:19:42.678 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:42.677+0000 7f89818bb680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T17:19:42.679 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:19:42.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.841+0000 7f962550f700 1 Processor -- start 2023-11-30T17:19:42.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.841+0000 7f962550f700 1 -- start start 2023-11-30T17:19:42.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.841+0000 7f962550f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96201548c0 0x7f962006a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:42.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.841+0000 7f962550f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f96200c6e30 0x7f96200c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:42.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.841+0000 7f962550f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96200c69a0 con 0x7f96201544e0 2023-11-30T17:19:42.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.841+0000 7f962550f700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96200c13a0 con 0x7f96200c6e30 2023-11-30T17:19:42.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.841+0000 7f962550f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96200c1680 con 0x7f96201548c0 2023-11-30T17:19:42.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.842+0000 7f961f7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f96200c6e30 0x7f96200c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:42.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.842+0000 7f961f7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f96200c6e30 0x7f96200c72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53134/0 (socket says 172.21.15.49:53134) 2023-11-30T17:19:42.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.842+0000 7f961f7fe700 1 -- 172.21.15.49:0/4041249514 learned_addr learned my addr 172.21.15.49:0/4041249514 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:42.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.842+0000 7f961effd700 1 --1- 172.21.15.49:0/4041249514 >> v1:172.21.15.49:6789/0 conn(0x7f96201544e0 0x7f96200c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52924/0 (socket says 172.21.15.49:52924) 2023-11-30T17:19:42.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.842+0000 7f961e7fc700 1 --2- 172.21.15.49:0/4041249514 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96201548c0 0x7f962006a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:42.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.842+0000 7f961f7fe700 1 -- 172.21.15.49:0/4041249514 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96201548c0 msgr2=0x7f962006a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:42.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.842+0000 7f961f7fe700 1 --2- 172.21.15.49:0/4041249514 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96201548c0 0x7f962006a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:42.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.842+0000 7f961f7fe700 1 -- 172.21.15.49:0/4041249514 >> v1:172.21.15.49:6789/0 conn(0x7f96201544e0 legacy=0x7f96200c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:42.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.842+0000 7f961dffb700 1 -- 172.21.15.49:0/4041249514 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2328975846 0 0) 0x7f96200c69a0 con 0x7f96201544e0 2023-11-30T17:19:42.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.842+0000 7f961f7fe700 1 -- 172.21.15.49:0/4041249514 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96200c6630 con 0x7f96200c6e30 2023-11-30T17:19:42.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.842+0000 7f961f7fe700 1 --2- 172.21.15.49:0/4041249514 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96200c6e30 0x7f96200c72e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f9618009f20 tx=0x7f9618009840).ready entity=mon.0 client_cookie=97c552c65867e81a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:42.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.842+0000 7f961dffb700 1 -- 172.21.15.49:0/4041249514 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961800e070 con 0x7f96200c6e30 2023-11-30T17:19:42.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.842+0000 7f961dffb700 1 -- 172.21.15.49:0/4041249514 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961800b9d0 con 0x7f96200c6e30 2023-11-30T17:19:42.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.842+0000 7f961dffb700 1 -- 172.21.15.49:0/4041249514 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961800bd50 con 0x7f96200c6e30 2023-11-30T17:19:42.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.843+0000 7f962550f700 1 -- 172.21.15.49:0/4041249514 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96200c6e30 msgr2=0x7f96200c72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:42.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.843+0000 7f962550f700 1 --2- 172.21.15.49:0/4041249514 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96200c6e30 0x7f96200c72e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f9618009f20 tx=0x7f9618009840).stop 2023-11-30T17:19:42.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.843+0000 7f962550f700 1 -- 172.21.15.49:0/4041249514 shutdown_connections 2023-11-30T17:19:42.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.843+0000 7f962550f700 1 --2- 172.21.15.49:0/4041249514 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96200c6e30 0x7f96200c72e0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:42.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.843+0000 7f962550f700 1 --2- 172.21.15.49:0/4041249514 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96201548c0 0x7f962006a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:42.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.843+0000 7f962550f700 1 -- 172.21.15.49:0/4041249514 >> 172.21.15.49:0/4041249514 conn(0x7f9620085020 msgr2=0x7f9620094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:42.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.843+0000 7f962550f700 1 -- 172.21.15.49:0/4041249514 shutdown_connections 2023-11-30T17:19:42.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.843+0000 7f962550f700 1 -- 172.21.15.49:0/4041249514 wait complete. 2023-11-30T17:19:42.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.844+0000 7f962550f700 1 Processor -- start 2023-11-30T17:19:42.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.844+0000 7f962550f700 1 -- start start 2023-11-30T17:19:42.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.845+0000 7f962550f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96200c6e30 0x7f96200987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:42.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.845+0000 7f962550f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96201544e0 0x7f96200c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:42.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.845+0000 7f962550f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96201548c0 0x7f96200c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:42.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.845+0000 7f962550f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96200ca270 con 0x7f96200c6e30 2023-11-30T17:19:42.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.845+0000 7f962550f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96201662f0 con 0x7f96201548c0 2023-11-30T17:19:42.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.845+0000 7f962550f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9620145c10 con 0x7f96201544e0 2023-11-30T17:19:42.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.845+0000 7f961effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96200c6e30 0x7f96200987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:42.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.845+0000 7f961effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96200c6e30 0x7f96200987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53136/0 (socket says 172.21.15.49:53136) 2023-11-30T17:19:42.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.845+0000 7f961effd700 1 -- 172.21.15.49:0/3832899477 learned_addr learned my addr 172.21.15.49:0/3832899477 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:42.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.845+0000 7f961e7fc700 1 --2- 172.21.15.49:0/3832899477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96201544e0 0x7f96200c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:42.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.845+0000 7f961f7fe700 1 --2- 172.21.15.49:0/3832899477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96201548c0 0x7f96200c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:42.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.845+0000 7f961effd700 1 -- 172.21.15.49:0/3832899477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96201544e0 msgr2=0x7f96200c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:42.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.845+0000 7f961effd700 1 --2- 172.21.15.49:0/3832899477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96201544e0 0x7f96200c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:42.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.845+0000 7f961effd700 1 -- 172.21.15.49:0/3832899477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96201548c0 msgr2=0x7f96200c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:42.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.845+0000 7f961effd700 1 --2- 172.21.15.49:0/3832899477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96201548c0 0x7f96200c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:42.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.845+0000 7f961effd700 1 -- 172.21.15.49:0/3832899477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9618009ae0 con 0x7f96200c6e30 2023-11-30T17:19:42.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.846+0000 7f961effd700 1 --2- 172.21.15.49:0/3832899477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96200c6e30 0x7f96200987e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f961000c490 tx=0x7f9610007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:42.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.846+0000 7f9616ffd700 1 -- 172.21.15.49:0/3832899477 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96100070d0 con 0x7f96200c6e30 2023-11-30T17:19:42.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.846+0000 7f9616ffd700 1 -- 172.21.15.49:0/3832899477 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9610007230 con 0x7f96200c6e30 2023-11-30T17:19:42.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.846+0000 7f962550f700 1 -- 172.21.15.49:0/3832899477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96201659c0 con 0x7f96200c6e30 2023-11-30T17:19:42.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.846+0000 7f9616ffd700 1 -- 172.21.15.49:0/3832899477 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9610005670 con 0x7f96200c6e30 2023-11-30T17:19:42.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.846+0000 7f962550f700 1 -- 172.21.15.49:0/3832899477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9620165f80 con 0x7f96200c6e30 2023-11-30T17:19:42.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.847+0000 7f962550f700 1 -- 172.21.15.49:0/3832899477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f962006c860 con 0x7f96200c6e30 2023-11-30T17:19:42.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.847+0000 7f9616ffd700 1 -- 172.21.15.49:0/3832899477 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f9610005c70 con 0x7f96200c6e30 2023-11-30T17:19:42.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.848+0000 7f9616ffd700 1 --2- 172.21.15.49:0/3832899477 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f960005f270 0x7f9600061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:42.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.848+0000 7f961e7fc700 1 -- 172.21.15.49:0/3832899477 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f960005f270 msgr2=0x7f9600061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:19:42.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.848+0000 7f9616ffd700 1 -- 172.21.15.49:0/3832899477 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 7082+0+0 (secure 0 0 0) 0x7f9610079ea0 con 0x7f96200c6e30 2023-11-30T17:19:42.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.848+0000 7f961e7fc700 1 --2- 172.21.15.49:0/3832899477 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f960005f270 0x7f9600061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:19:42.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:42.857+0000 7f9616ffd700 1 -- 172.21.15.49:0/3832899477 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f961004ac30 con 0x7f96200c6e30 2023-11-30T17:19:42.872 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:19:42.871+0000 7f4b630b8680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T17:19:43.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.041+0000 7f962550f700 1 -- 172.21.15.49:0/3832899477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96200c5890 con 0x7f96200c6e30 2023-11-30T17:19:43.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.042+0000 7f9616ffd700 1 -- 172.21.15.49:0/3832899477 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18588 (secure 0 0 0) 0x7f961004e250 con 0x7f96200c6e30 2023-11-30T17:19:43.043 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:19:43.044 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":50,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:19:42.872478+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:08:03.325011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-30T17:08:04.171666+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":220,"snap_epoch":49,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.10","mappings":[{"from":5,"to":1}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/2453164493":"2023-12-01T17:08:22.105096+0000","172.21.15.115:6833/89956":"2023-12-01T17:08:22.105096+0000","172.21.15.115:0/3230559129":"2023-12-01T17:08:22.105096+0000","172.21.15.115:6832/89956":"2023-12-01T17:08:22.105096+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":6,"length":1},{"begin":16,"length":1},{"begin":22,"length":1},{"begin":26,"length":1},{"begin":32,"length":1},{"begin":36,"length":1},{"begin":42,"length":1},{"begin":46,"length":1},{"begin":52,"length":1},{"begin":56,"length":1},{"begin":63,"length":1},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":77,"length":1},{"begin":83,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":202,"length":19}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":4,"length":2},{"begin":8,"length":2},{"begin":11,"length":2},{"begin":14,"length":2},{"begin":18,"length":2},{"begin":21,"length":1},{"begin":24,"length":2},{"begin":28,"length":2},{"begin":31,"length":1},{"begin":34,"length":2},{"begin":38,"length":2},{"begin":41,"length":1},{"begin":44,"length":2},{"begin":48,"length":2},{"begin":51,"length":1},{"begin":54,"length":2},{"begin":58,"length":2},{"begin":61,"length":2},{"begin":65,"length":2},{"begin":69,"length":2},{"begin":72,"length":1},{"begin":75,"length":2},{"begin":79,"length":2},{"begin":82,"length":1},{"begin":85,"length":2},{"begin":89,"length":2},{"begin":92,"length":1},{"begin":95,"length":2},{"begin":99,"length":2},{"begin":102,"length":1},{"begin":105,"length":2},{"begin":109,"length":2},{"begin":145,"length":57}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:19:43.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.044+0000 7f962550f700 1 -- 172.21.15.49:0/3832899477 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f960005f270 msgr2=0x7f9600061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:19:43.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.044+0000 7f962550f700 1 --2- 172.21.15.49:0/3832899477 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f960005f270 0x7f9600061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:43.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.044+0000 7f962550f700 1 -- 172.21.15.49:0/3832899477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96200c6e30 msgr2=0x7f96200987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:43.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.044+0000 7f962550f700 1 --2- 172.21.15.49:0/3832899477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96200c6e30 0x7f96200987e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f961000c490 tx=0x7f9610007dc0).stop 2023-11-30T17:19:43.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.044+0000 7f962550f700 1 -- 172.21.15.49:0/3832899477 shutdown_connections 2023-11-30T17:19:43.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.044+0000 7f962550f700 1 --2- 172.21.15.49:0/3832899477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96201548c0 0x7f96200c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:43.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.044+0000 7f962550f700 1 --2- 172.21.15.49:0/3832899477 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f960005f270 0x7f9600061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:43.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.044+0000 7f962550f700 1 --2- 172.21.15.49:0/3832899477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96200c6e30 0x7f96200987e0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:43.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.044+0000 7f962550f700 1 --2- 172.21.15.49:0/3832899477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96201544e0 0x7f96200c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:43.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.044+0000 7f962550f700 1 -- 172.21.15.49:0/3832899477 >> 172.21.15.49:0/3832899477 conn(0x7f9620085020 msgr2=0x7f96200ca6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:43.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.044+0000 7f962550f700 1 -- 172.21.15.49:0/3832899477 shutdown_connections 2023-11-30T17:19:43.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.044+0000 7f962550f700 1 -- 172.21.15.49:0/3832899477 wait complete. 2023-11-30T17:19:43.058 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-30T17:19:43.058 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:19:43.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.176+0000 7f5966629700 1 Processor -- start 2023-11-30T17:19:43.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.176+0000 7f5966629700 1 -- start start 2023-11-30T17:19:43.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.177+0000 7f5966629700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5960154230 0x7f59600a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:43.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.177+0000 7f5966629700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f59600c2cb0 0x7f59600a6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:43.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.177+0000 7f5966629700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5960062700 0x7f5960062b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:43.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.177+0000 7f5966629700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5960063060 con 0x7f59600c2cb0 2023-11-30T17:19:43.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.177+0000 7f5966629700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59600c2540 con 0x7f5960154230 2023-11-30T17:19:43.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.177+0000 7f5966629700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59600a4f70 con 0x7f5960062700 2023-11-30T17:19:43.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.177+0000 7f5964e26700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f59600c2cb0 0x7f59600a6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:43.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.177+0000 7f5964e26700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f59600c2cb0 0x7f59600a6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53140/0 (socket says 172.21.15.49:53140) 2023-11-30T17:19:43.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.177+0000 7f5964e26700 1 -- 172.21.15.49:0/319232814 learned_addr learned my addr 172.21.15.49:0/319232814 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:43.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.177+0000 7f5965627700 1 --2- 172.21.15.49:0/319232814 >> v2:172.21.15.115:3300/0 conn(0x7f5960154230 0x7f59600a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:43.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.177+0000 7f5965e28700 1 --2- 172.21.15.49:0/319232814 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5960062700 0x7f5960062b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:43.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.178+0000 7f5964e26700 1 -- 172.21.15.49:0/319232814 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5960062700 msgr2=0x7f5960062b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:43.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.178+0000 7f5964e26700 1 --2- 172.21.15.49:0/319232814 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5960062700 0x7f5960062b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:43.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.178+0000 7f5964e26700 1 -- 172.21.15.49:0/319232814 >> v2:172.21.15.115:3300/0 conn(0x7f5960154230 msgr2=0x7f59600a48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:43.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.178+0000 7f5964e26700 1 --2- 172.21.15.49:0/319232814 >> v2:172.21.15.115:3300/0 conn(0x7f5960154230 0x7f59600a48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:43.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.178+0000 7f5964e26700 1 -- 172.21.15.49:0/319232814 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59600a5250 con 0x7f59600c2cb0 2023-11-30T17:19:43.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.178+0000 7f5964e26700 1 --2- 172.21.15.49:0/319232814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59600c2cb0 0x7f59600a6010 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f596006a970 tx=0x7f595c0090f0).ready entity=mon.0 client_cookie=13359369f7ef023 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:43.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.178+0000 7f5957fff700 1 -- 172.21.15.49:0/319232814 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c00f510 con 0x7f59600c2cb0 2023-11-30T17:19:43.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.178+0000 7f5957fff700 1 -- 172.21.15.49:0/319232814 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595c00f670 con 0x7f59600c2cb0 2023-11-30T17:19:43.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.178+0000 7f5957fff700 1 -- 172.21.15.49:0/319232814 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c00f9f0 con 0x7f59600c2cb0 2023-11-30T17:19:43.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.178+0000 7f5966629700 1 -- 172.21.15.49:0/319232814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59600c2cb0 msgr2=0x7f59600a6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:43.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.178+0000 7f5966629700 1 --2- 172.21.15.49:0/319232814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59600c2cb0 0x7f59600a6010 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f596006a970 tx=0x7f595c0090f0).stop 2023-11-30T17:19:43.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.178+0000 7f5966629700 1 -- 172.21.15.49:0/319232814 shutdown_connections 2023-11-30T17:19:43.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.178+0000 7f5966629700 1 --2- 172.21.15.49:0/319232814 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5960062700 0x7f5960062b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:43.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.178+0000 7f5966629700 1 --2- 172.21.15.49:0/319232814 >> v2:172.21.15.115:3300/0 conn(0x7f5960154230 0x7f59600a48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:43.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.178+0000 7f5966629700 1 --2- 172.21.15.49:0/319232814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59600c2cb0 0x7f59600a6010 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:43.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.178+0000 7f5966629700 1 -- 172.21.15.49:0/319232814 >> 172.21.15.49:0/319232814 conn(0x7f59600c7ca0 msgr2=0x7f59600c80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:43.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.179+0000 7f5966629700 1 -- 172.21.15.49:0/319232814 shutdown_connections 2023-11-30T17:19:43.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.179+0000 7f5966629700 1 -- 172.21.15.49:0/319232814 wait complete. 2023-11-30T17:19:43.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.180+0000 7f5966629700 1 Processor -- start 2023-11-30T17:19:43.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.180+0000 7f5966629700 1 -- start start 2023-11-30T17:19:43.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.181+0000 7f5966629700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5960062700 0x7f596014dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:43.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.181+0000 7f5966629700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59600c2cb0 0x7f5960154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:43.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.181+0000 7f5966629700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5960154230 0x7f59601566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:43.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.181+0000 7f5966629700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59600ac630 con 0x7f5960062700 2023-11-30T17:19:43.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.181+0000 7f5966629700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5960157120 con 0x7f59600c2cb0 2023-11-30T17:19:43.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.181+0000 7f5966629700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59600abd00 con 0x7f5960154230 2023-11-30T17:19:43.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.181+0000 7f5965627700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5960062700 0x7f596014dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:43.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.181+0000 7f5965627700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5960062700 0x7f596014dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53146/0 (socket says 172.21.15.49:53146) 2023-11-30T17:19:43.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.181+0000 7f5965627700 1 -- 172.21.15.49:0/2597358783 learned_addr learned my addr 172.21.15.49:0/2597358783 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:43.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.181+0000 7f5965e28700 1 --2- 172.21.15.49:0/2597358783 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5960154230 0x7f59601566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:43.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.181+0000 7f5964e26700 1 --2- 172.21.15.49:0/2597358783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59600c2cb0 0x7f5960154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:43.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.181+0000 7f5965627700 1 -- 172.21.15.49:0/2597358783 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5960154230 msgr2=0x7f59601566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:43.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.181+0000 7f5965627700 1 --2- 172.21.15.49:0/2597358783 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5960154230 0x7f59601566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:43.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.181+0000 7f5965627700 1 -- 172.21.15.49:0/2597358783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59600c2cb0 msgr2=0x7f5960154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:43.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.181+0000 7f5965627700 1 --2- 172.21.15.49:0/2597358783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59600c2cb0 0x7f5960154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:43.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.181+0000 7f5965627700 1 -- 172.21.15.49:0/2597358783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595c009370 con 0x7f5960062700 2023-11-30T17:19:43.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.181+0000 7f5965627700 1 --2- 172.21.15.49:0/2597358783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5960062700 0x7f596014dd70 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f595000e930 tx=0x7f5950009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:43.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.181+0000 7f59557fa700 1 -- 172.21.15.49:0/2597358783 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5950012600 con 0x7f5960062700 2023-11-30T17:19:43.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.181+0000 7f59557fa700 1 -- 172.21.15.49:0/2597358783 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5950012760 con 0x7f5960062700 2023-11-30T17:19:43.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.181+0000 7f5966629700 1 -- 172.21.15.49:0/2597358783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59600abfe0 con 0x7f5960062700 2023-11-30T17:19:43.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.181+0000 7f59557fa700 1 -- 172.21.15.49:0/2597358783 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5950012ae0 con 0x7f5960062700 2023-11-30T17:19:43.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.181+0000 7f5966629700 1 -- 172.21.15.49:0/2597358783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59600c6310 con 0x7f5960062700 2023-11-30T17:19:43.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.182+0000 7f5966629700 1 -- 172.21.15.49:0/2597358783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f596006c7c0 con 0x7f5960062700 2023-11-30T17:19:43.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.183+0000 7f59557fa700 1 -- 172.21.15.49:0/2597358783 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f595001b400 con 0x7f5960062700 2023-11-30T17:19:43.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.183+0000 7f59557fa700 1 --2- 172.21.15.49:0/2597358783 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f594405f270 0x7f5944061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:43.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.183+0000 7f59557fa700 1 -- 172.21.15.49:0/2597358783 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 7210+0+0 (secure 0 0 0) 0x7f595007acb0 con 0x7f5960062700 2023-11-30T17:19:43.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.183+0000 7f5964e26700 1 -- 172.21.15.49:0/2597358783 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f594405f270 msgr2=0x7f5944061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:19:43.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.183+0000 7f5964e26700 1 --2- 172.21.15.49:0/2597358783 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f594405f270 0x7f5944061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:19:43.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.187+0000 7f59557fa700 1 -- 172.21.15.49:0/2597358783 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f595004b960 con 0x7f5960062700 2023-11-30T17:19:43.338 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:43.337+0000 7f89818bb680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T17:19:43.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.384+0000 7f5964e26700 1 -- 172.21.15.49:0/2597358783 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f594405f270 msgr2=0x7f5944061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:19:43.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.384+0000 7f5964e26700 1 --2- 172.21.15.49:0/2597358783 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f594405f270 0x7f5944061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:19:43.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.402+0000 7f5966629700 1 -- 172.21.15.49:0/2597358783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59600a5530 con 0x7f5960062700 2023-11-30T17:19:43.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.403+0000 7f59557fa700 1 -- 172.21.15.49:0/2597358783 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4495 (secure 0 0 0) 0x7f595004ef80 con 0x7f5960062700 2023-11-30T17:19:43.404 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:19:43.404 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1260333970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1260333970},{"type":"v1","addr":"172.21.15.115:6836","nonce":1260333970}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4938,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/2286472783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2286472783},{"type":"v1","addr":"172.21.15.49:6834","nonce":2286472783}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4941,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1299033463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1299033463},{"type":"v1","addr":"172.21.15.49:6835","nonce":1299033463}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:08:05.200966+0000","modified":"2023-11-30T17:08:08.207522+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4944},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4944":{"gid":4944,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/3449611740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3449611740},{"type":"v1","addr":"172.21.15.115:6837","nonce":3449611740}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-11-30T17:19:43.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.405+0000 7f5966629700 1 -- 172.21.15.49:0/2597358783 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f594405f270 msgr2=0x7f5944061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:19:43.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.405+0000 7f5966629700 1 --2- 172.21.15.49:0/2597358783 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f594405f270 0x7f5944061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.405+0000 7f5966629700 1 -- 172.21.15.49:0/2597358783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5960062700 msgr2=0x7f596014dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.405+0000 7f5966629700 1 --2- 172.21.15.49:0/2597358783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5960062700 0x7f596014dd70 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f595000e930 tx=0x7f5950009060).stop 2023-11-30T17:19:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.405+0000 7f5966629700 1 -- 172.21.15.49:0/2597358783 shutdown_connections 2023-11-30T17:19:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.405+0000 7f5966629700 1 --2- 172.21.15.49:0/2597358783 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5960154230 0x7f59601566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.405+0000 7f5966629700 1 --2- 172.21.15.49:0/2597358783 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f594405f270 0x7f5944061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.405+0000 7f5966629700 1 --2- 172.21.15.49:0/2597358783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5960062700 0x7f596014dd70 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.405+0000 7f5966629700 1 --2- 172.21.15.49:0/2597358783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59600c2cb0 0x7f5960154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.405+0000 7f5966629700 1 -- 172.21.15.49:0/2597358783 >> 172.21.15.49:0/2597358783 conn(0x7f59600c7ca0 msgr2=0x7f59600be400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.405+0000 7f5966629700 1 -- 172.21.15.49:0/2597358783 shutdown_connections 2023-11-30T17:19:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.405+0000 7f5966629700 1 -- 172.21.15.49:0/2597358783 wait complete. 2023-11-30T17:19:43.408 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:43.405+0000 7f89818bb680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T17:19:43.408 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 16 2023-11-30T17:19:43.419 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:19:43.483 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:43.479+0000 7f89818bb680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T17:19:43.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.540+0000 7f7b6263e700 1 Processor -- start 2023-11-30T17:19:43.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.540+0000 7f7b6263e700 1 -- start start 2023-11-30T17:19:43.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.541+0000 7f7b6263e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7b5c06a610 0x7f7b5c0a8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:43.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.541+0000 7f7b6263e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b5c0c69a0 con 0x7f7b5c1548c0 2023-11-30T17:19:43.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.541+0000 7f7b6263e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b5c0c13a0 con 0x7f7b5c1544e0 2023-11-30T17:19:43.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.541+0000 7f7b6263e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b5c0c1680 con 0x7f7b5c06a610 2023-11-30T17:19:43.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.541+0000 7f7b60bdb700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7b5c06a610 0x7f7b5c0a8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:43.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.541+0000 7f7b5b7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7b5c1548c0 0x7f7b5c0c6e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52938/0 (socket says 172.21.15.49:52938) 2023-11-30T17:19:43.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.541+0000 7f7b5b7fe700 1 -- 172.21.15.49:0/4128539055 learned_addr learned my addr 172.21.15.49:0/4128539055 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:43.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.542+0000 7f7b60bdb700 1 -- 172.21.15.49:0/4128539055 >> v1:172.21.15.115:6789/0 conn(0x7f7b5c1544e0 legacy=0x7f7b5c0c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:43.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.542+0000 7f7b60bdb700 1 -- 172.21.15.49:0/4128539055 >> v1:172.21.15.49:6789/0 conn(0x7f7b5c1548c0 legacy=0x7f7b5c0c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:43.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.542+0000 7f7b60bdb700 1 -- 172.21.15.49:0/4128539055 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5c0c6630 con 0x7f7b5c06a610 2023-11-30T17:19:43.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.542+0000 7f7b5affd700 1 -- 172.21.15.49:0/4128539055 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052696903 0 0) 0x7f7b5c0c69a0 con 0x7f7b5c1548c0 2023-11-30T17:19:43.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.542+0000 7f7b60bdb700 1 --2- 172.21.15.49:0/4128539055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b5c06a610 0x7f7b5c0a8000 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f7b54009e60 tx=0x7f7b54009780).ready entity=mon.0 client_cookie=35302ec607dd9117 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:43.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.542+0000 7f7b5affd700 1 -- 172.21.15.49:0/4128539055 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5400e070 con 0x7f7b5c06a610 2023-11-30T17:19:43.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.542+0000 7f7b5affd700 1 -- 172.21.15.49:0/4128539055 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5400bc30 con 0x7f7b5c06a610 2023-11-30T17:19:43.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.542+0000 7f7b5affd700 1 -- 172.21.15.49:0/4128539055 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b54012410 con 0x7f7b5c06a610 2023-11-30T17:19:43.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.543+0000 7f7b6263e700 1 -- 172.21.15.49:0/4128539055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b5c06a610 msgr2=0x7f7b5c0a8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:43.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.543+0000 7f7b6263e700 1 --2- 172.21.15.49:0/4128539055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b5c06a610 0x7f7b5c0a8000 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f7b54009e60 tx=0x7f7b54009780).stop 2023-11-30T17:19:43.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.543+0000 7f7b6263e700 1 -- 172.21.15.49:0/4128539055 shutdown_connections 2023-11-30T17:19:43.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.543+0000 7f7b6263e700 1 --2- 172.21.15.49:0/4128539055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b5c06a610 0x7f7b5c0a8000 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:43.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.543+0000 7f7b6263e700 1 -- 172.21.15.49:0/4128539055 >> 172.21.15.49:0/4128539055 conn(0x7f7b5c085020 msgr2=0x7f7b5c094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:43.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.543+0000 7f7b6263e700 1 -- 172.21.15.49:0/4128539055 shutdown_connections 2023-11-30T17:19:43.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.543+0000 7f7b6263e700 1 -- 172.21.15.49:0/4128539055 wait complete. 2023-11-30T17:19:43.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.544+0000 7f7b6263e700 1 Processor -- start 2023-11-30T17:19:43.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.544+0000 7f7b6263e700 1 -- start start 2023-11-30T17:19:43.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.545+0000 7f7b6263e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b5c06a610 0x7f7b5c148b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:43.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.545+0000 7f7b6263e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b5c1544e0 0x7f7b5c0c3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:43.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.545+0000 7f7b6263e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b5c1548c0 0x7f7b5c0956d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:43.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.545+0000 7f7b6263e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c0980e0 con 0x7f7b5c1548c0 2023-11-30T17:19:43.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.545+0000 7f7b6263e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c097540 con 0x7f7b5c1544e0 2023-11-30T17:19:43.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.545+0000 7f7b6263e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c0977b0 con 0x7f7b5c06a610 2023-11-30T17:19:43.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.545+0000 7f7b60bdb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b5c1548c0 0x7f7b5c0956d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:43.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.545+0000 7f7b60bdb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b5c1548c0 0x7f7b5c0956d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53152/0 (socket says 172.21.15.49:53152) 2023-11-30T17:19:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.545+0000 7f7b60bdb700 1 -- 172.21.15.49:0/3776066215 learned_addr learned my addr 172.21.15.49:0/3776066215 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.545+0000 7f7b5b7fe700 1 --2- 172.21.15.49:0/3776066215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b5c1544e0 0x7f7b5c0c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.545+0000 7f7b5bfff700 1 --2- 172.21.15.49:0/3776066215 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b5c06a610 0x7f7b5c148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.545+0000 7f7b60bdb700 1 -- 172.21.15.49:0/3776066215 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b5c06a610 msgr2=0x7f7b5c148b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.545+0000 7f7b60bdb700 1 --2- 172.21.15.49:0/3776066215 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b5c06a610 0x7f7b5c148b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.546+0000 7f7b60bdb700 1 -- 172.21.15.49:0/3776066215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b5c1544e0 msgr2=0x7f7b5c0c3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.546+0000 7f7b60bdb700 1 --2- 172.21.15.49:0/3776066215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b5c1544e0 0x7f7b5c0c3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.546+0000 7f7b60bdb700 1 -- 172.21.15.49:0/3776066215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b54009a20 con 0x7f7b5c1548c0 2023-11-30T17:19:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.546+0000 7f7b5b7fe700 1 --2- 172.21.15.49:0/3776066215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b5c1544e0 0x7f7b5c0c3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:19:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.546+0000 7f7b60bdb700 1 --2- 172.21.15.49:0/3776066215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b5c1548c0 0x7f7b5c0956d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f7b540094c0 tx=0x7f7b54009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.546+0000 7f7b53fff700 1 -- 172.21.15.49:0/3776066215 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b540063a0 con 0x7f7b5c1548c0 2023-11-30T17:19:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.546+0000 7f7b53fff700 1 -- 172.21.15.49:0/3776066215 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b54006500 con 0x7f7b5c1548c0 2023-11-30T17:19:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.546+0000 7f7b53fff700 1 -- 172.21.15.49:0/3776066215 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b540068a0 con 0x7f7b5c1548c0 2023-11-30T17:19:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.546+0000 7f7b6263e700 1 -- 172.21.15.49:0/3776066215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b5c097a90 con 0x7f7b5c1548c0 2023-11-30T17:19:43.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.546+0000 7f7b6263e700 1 -- 172.21.15.49:0/3776066215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b5c0951f0 con 0x7f7b5c1548c0 2023-11-30T17:19:43.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.547+0000 7f7b6263e700 1 -- 172.21.15.49:0/3776066215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b5c06c860 con 0x7f7b5c1548c0 2023-11-30T17:19:43.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.547+0000 7f7b53fff700 1 -- 172.21.15.49:0/3776066215 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f7b54027460 con 0x7f7b5c1548c0 2023-11-30T17:19:43.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.548+0000 7f7b53fff700 1 --2- 172.21.15.49:0/3776066215 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7b3c05f270 0x7f7b3c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:43.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.548+0000 7f7b5bfff700 1 -- 172.21.15.49:0/3776066215 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7b3c05f270 msgr2=0x7f7b3c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:19:43.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.548+0000 7f7b53fff700 1 -- 172.21.15.49:0/3776066215 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 7210+0+0 (secure 0 0 0) 0x7f7b5407cc70 con 0x7f7b5c1548c0 2023-11-30T17:19:43.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.548+0000 7f7b5bfff700 1 --2- 172.21.15.49:0/3776066215 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7b3c05f270 0x7f7b3c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:19:43.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.552+0000 7f7b53fff700 1 -- 172.21.15.49:0/3776066215 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7b5404d920 con 0x7f7b5c1548c0 2023-11-30T17:19:43.576 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:19:43.575+0000 7f4b630b8680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T17:19:43.628 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:43.626+0000 7f89818bb680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T17:19:43.648 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:19:43.647+0000 7f4b630b8680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T17:19:43.697 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:43.695+0000 7f89818bb680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T17:19:43.727 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:19:43.726+0000 7f4b630b8680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T17:19:43.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.749+0000 7f7b5bfff700 1 -- 172.21.15.49:0/3776066215 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7b3c05f270 msgr2=0x7f7b3c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:19:43.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.749+0000 7f7b5bfff700 1 --2- 172.21.15.49:0/3776066215 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7b3c05f270 0x7f7b3c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:19:43.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.766+0000 7f7b6263e700 1 -- 172.21.15.49:0/3776066215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b5c0c7540 con 0x7f7b5c1548c0 2023-11-30T17:19:43.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.766+0000 7f7b53fff700 1 -- 172.21.15.49:0/3776066215 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4495 (secure 0 0 0) 0x7f7b54050f40 con 0x7f7b5c1548c0 2023-11-30T17:19:43.768 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:19:43.768 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1260333970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1260333970},{"type":"v1","addr":"172.21.15.115:6836","nonce":1260333970}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4938,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/2286472783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2286472783},{"type":"v1","addr":"172.21.15.49:6834","nonce":2286472783}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4941,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1299033463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1299033463},{"type":"v1","addr":"172.21.15.49:6835","nonce":1299033463}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:08:05.200966+0000","modified":"2023-11-30T17:08:08.207522+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4944},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4944":{"gid":4944,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/3449611740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3449611740},{"type":"v1","addr":"172.21.15.115:6837","nonce":3449611740}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-11-30T17:19:43.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.768+0000 7f7b6263e700 1 -- 172.21.15.49:0/3776066215 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7b3c05f270 msgr2=0x7f7b3c061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:19:43.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.768+0000 7f7b6263e700 1 --2- 172.21.15.49:0/3776066215 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7b3c05f270 0x7f7b3c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:43.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.768+0000 7f7b6263e700 1 -- 172.21.15.49:0/3776066215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b5c1548c0 msgr2=0x7f7b5c0956d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:43.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.768+0000 7f7b6263e700 1 --2- 172.21.15.49:0/3776066215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b5c1548c0 0x7f7b5c0956d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f7b540094c0 tx=0x7f7b54009780).stop 2023-11-30T17:19:43.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.768+0000 7f7b6263e700 1 -- 172.21.15.49:0/3776066215 shutdown_connections 2023-11-30T17:19:43.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.768+0000 7f7b6263e700 1 --2- 172.21.15.49:0/3776066215 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7b3c05f270 0x7f7b3c061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:43.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.768+0000 7f7b6263e700 1 --2- 172.21.15.49:0/3776066215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b5c1548c0 0x7f7b5c0956d0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:43.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.768+0000 7f7b6263e700 1 --2- 172.21.15.49:0/3776066215 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b5c06a610 0x7f7b5c148b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:43.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.768+0000 7f7b6263e700 1 --2- 172.21.15.49:0/3776066215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b5c1544e0 0x7f7b5c0c3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:43.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.768+0000 7f7b6263e700 1 -- 172.21.15.49:0/3776066215 >> 172.21.15.49:0/3776066215 conn(0x7f7b5c085020 msgr2=0x7f7b5c0c0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:43.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.769+0000 7f7b6263e700 1 -- 172.21.15.49:0/3776066215 shutdown_connections 2023-11-30T17:19:43.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.769+0000 7f7b6263e700 1 -- 172.21.15.49:0/3776066215 wait complete. 2023-11-30T17:19:43.771 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 16 2023-11-30T17:19:43.782 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:19:43.810 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:43.809+0000 7f89818bb680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T17:19:43.890 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:19:43.888+0000 7f4b630b8680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T17:19:43.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.907+0000 7f7e15f95700 1 Processor -- start 2023-11-30T17:19:43.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.907+0000 7f7e15f95700 1 -- start start 2023-11-30T17:19:43.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.908+0000 7f7e15f95700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7e1014ed60 0x7f7e10152220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:43.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.908+0000 7f7e15f95700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7e10155470 0x7f7e100c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:43.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.908+0000 7f7e15f95700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1006bbc0 con 0x7f7e1014e980 2023-11-30T17:19:43.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.908+0000 7f7e15f95700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e100c1df0 con 0x7f7e10155470 2023-11-30T17:19:43.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.908+0000 7f7e15f95700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e10154fe0 con 0x7f7e1014ed60 2023-11-30T17:19:43.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.908+0000 7f7e15794700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7e10155470 0x7f7e100c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:43.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.908+0000 7f7e14f93700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7e1014e980 0x7f7e100c45f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52946/0 (socket says 172.21.15.49:52946) 2023-11-30T17:19:43.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.908+0000 7f7e15794700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7e10155470 0x7f7e100c61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53162/0 (socket says 172.21.15.49:53162) 2023-11-30T17:19:43.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.908+0000 7f7e14f93700 1 -- 172.21.15.49:0/1788612443 learned_addr learned my addr 172.21.15.49:0/1788612443 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:43.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.908+0000 7f7e0ffff700 1 --2- 172.21.15.49:0/1788612443 >> v2:172.21.15.115:3300/0 conn(0x7f7e1014ed60 0x7f7e10152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:43.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.909+0000 7f7e15794700 1 -- 172.21.15.49:0/1788612443 >> v2:172.21.15.115:3300/0 conn(0x7f7e1014ed60 msgr2=0x7f7e10152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:43.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.909+0000 7f7e15794700 1 --2- 172.21.15.49:0/1788612443 >> v2:172.21.15.115:3300/0 conn(0x7f7e1014ed60 0x7f7e10152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:43.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.909+0000 7f7e15794700 1 -- 172.21.15.49:0/1788612443 >> v1:172.21.15.49:6789/0 conn(0x7f7e1014e980 legacy=0x7f7e100c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:43.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.909+0000 7f7e15794700 1 -- 172.21.15.49:0/1788612443 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1006b640 con 0x7f7e10155470 2023-11-30T17:19:43.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.909+0000 7f7e0f7fe700 1 -- 172.21.15.49:0/1788612443 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 344929476 0 0) 0x7f7e1006bbc0 con 0x7f7e1014e980 2023-11-30T17:19:43.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.909+0000 7f7e15794700 1 --2- 172.21.15.49:0/1788612443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e10155470 0x7f7e100c61c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f7e100c4d00 tx=0x7f7e08009780).ready entity=mon.0 client_cookie=1685423db36b38ad server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:43.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.909+0000 7f7e0f7fe700 1 -- 172.21.15.49:0/1788612443 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0800e070 con 0x7f7e10155470 2023-11-30T17:19:43.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.909+0000 7f7e0f7fe700 1 -- 172.21.15.49:0/1788612443 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0800bb60 con 0x7f7e10155470 2023-11-30T17:19:43.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.909+0000 7f7e0f7fe700 1 -- 172.21.15.49:0/1788612443 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e08012410 con 0x7f7e10155470 2023-11-30T17:19:43.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.909+0000 7f7e15f95700 1 -- 172.21.15.49:0/1788612443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e10155470 msgr2=0x7f7e100c61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:43.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.909+0000 7f7e15f95700 1 --2- 172.21.15.49:0/1788612443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e10155470 0x7f7e100c61c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f7e100c4d00 tx=0x7f7e08009780).stop 2023-11-30T17:19:43.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.909+0000 7f7e15f95700 1 -- 172.21.15.49:0/1788612443 shutdown_connections 2023-11-30T17:19:43.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.909+0000 7f7e15f95700 1 --2- 172.21.15.49:0/1788612443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e10155470 0x7f7e100c61c0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:43.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.909+0000 7f7e15f95700 1 --2- 172.21.15.49:0/1788612443 >> v2:172.21.15.115:3300/0 conn(0x7f7e1014ed60 0x7f7e10152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:43.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.910+0000 7f7e15f95700 1 -- 172.21.15.49:0/1788612443 >> 172.21.15.49:0/1788612443 conn(0x7f7e100c7eb0 msgr2=0x7f7e100c3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:43.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.910+0000 7f7e15f95700 1 -- 172.21.15.49:0/1788612443 shutdown_connections 2023-11-30T17:19:43.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.910+0000 7f7e15f95700 1 -- 172.21.15.49:0/1788612443 wait complete. 2023-11-30T17:19:43.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.911+0000 7f7e15f95700 1 Processor -- start 2023-11-30T17:19:43.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.911+0000 7f7e15f95700 1 -- start start 2023-11-30T17:19:43.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.912+0000 7f7e15f95700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e1014e980 0x7f7e100aaee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:43.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.912+0000 7f7e15f95700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e1014ed60 0x7f7e10131900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:43.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.912+0000 7f7e15f95700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e10155470 0x7f7e100acad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:43.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.912+0000 7f7e15f95700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e10162580 con 0x7f7e10155470 2023-11-30T17:19:43.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.912+0000 7f7e15f95700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e10163380 con 0x7f7e1014e980 2023-11-30T17:19:43.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.912+0000 7f7e15f95700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e10162770 con 0x7f7e1014ed60 2023-11-30T17:19:43.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.912+0000 7f7e15794700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e10155470 0x7f7e100acad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:43.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.912+0000 7f7e15794700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e10155470 0x7f7e100acad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53164/0 (socket says 172.21.15.49:53164) 2023-11-30T17:19:43.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.912+0000 7f7e14f93700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e1014e980 0x7f7e100aaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:43.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.912+0000 7f7e15794700 1 -- 172.21.15.49:0/2020740615 learned_addr learned my addr 172.21.15.49:0/2020740615 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:43.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.912+0000 7f7e0ffff700 1 --2- 172.21.15.49:0/2020740615 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e1014ed60 0x7f7e10131900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:43.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.912+0000 7f7e15794700 1 -- 172.21.15.49:0/2020740615 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e1014ed60 msgr2=0x7f7e10131900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:43.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.912+0000 7f7e15794700 1 --2- 172.21.15.49:0/2020740615 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e1014ed60 0x7f7e10131900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:43.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.912+0000 7f7e15794700 1 -- 172.21.15.49:0/2020740615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e1014e980 msgr2=0x7f7e100aaee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:43.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.912+0000 7f7e15794700 1 --2- 172.21.15.49:0/2020740615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e1014e980 0x7f7e100aaee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:43.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.912+0000 7f7e15794700 1 -- 172.21.15.49:0/2020740615 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e08009a20 con 0x7f7e10155470 2023-11-30T17:19:43.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.912+0000 7f7e15794700 1 --2- 172.21.15.49:0/2020740615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e10155470 0x7f7e100acad0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f7e1006c470 tx=0x7f7e08009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:43.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.912+0000 7f7e0cff9700 1 -- 172.21.15.49:0/2020740615 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e08012410 con 0x7f7e10155470 2023-11-30T17:19:43.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.913+0000 7f7e15f95700 1 -- 172.21.15.49:0/2020740615 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e10162a50 con 0x7f7e10155470 2023-11-30T17:19:43.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.913+0000 7f7e0cff9700 1 -- 172.21.15.49:0/2020740615 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e08007080 con 0x7f7e10155470 2023-11-30T17:19:43.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.913+0000 7f7e0cff9700 1 -- 172.21.15.49:0/2020740615 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0801d880 con 0x7f7e10155470 2023-11-30T17:19:43.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.913+0000 7f7e15f95700 1 -- 172.21.15.49:0/2020740615 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e10163010 con 0x7f7e10155470 2023-11-30T17:19:43.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.914+0000 7f7e15f95700 1 -- 172.21.15.49:0/2020740615 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e1006c7c0 con 0x7f7e10155470 2023-11-30T17:19:43.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.914+0000 7f7e0cff9700 1 -- 172.21.15.49:0/2020740615 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f7e0801dbf0 con 0x7f7e10155470 2023-11-30T17:19:43.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.915+0000 7f7e0cff9700 1 --2- 172.21.15.49:0/2020740615 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7df405f270 0x7f7df4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:43.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.915+0000 7f7e14f93700 1 -- 172.21.15.49:0/2020740615 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7df405f270 msgr2=0x7f7df4061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:19:43.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.915+0000 7f7e0cff9700 1 -- 172.21.15.49:0/2020740615 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6714+0+0 (secure 0 0 0) 0x7f7e0807c450 con 0x7f7e10155470 2023-11-30T17:19:43.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.915+0000 7f7e14f93700 1 --2- 172.21.15.49:0/2020740615 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7df405f270 0x7f7df4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:19:43.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:43.918+0000 7f7e0cff9700 1 -- 172.21.15.49:0/2020740615 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7e0804d350 con 0x7f7e10155470 2023-11-30T17:19:43.927 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:43.925+0000 7f89818bb680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:19:43.968 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:19:43.967+0000 7f4b630b8680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T17:19:44.092 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:19:44.090+0000 7f4b630b8680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T17:19:44.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.092+0000 7f7e15f95700 1 -- 172.21.15.49:0/2020740615 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e100ad3e0 con 0x7f7e10155470 2023-11-30T17:19:44.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.093+0000 7f7e0cff9700 1 -- 172.21.15.49:0/2020740615 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+17845 (secure 0 0 0) 0x7f7e08050970 con 0x7f7e10155470 2023-11-30T17:19:44.095 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:19:44.095 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":51,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:19:43.874177+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:08:03.325011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-30T17:08:04.171666+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":51,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.10","mappings":[{"from":5,"to":1}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/2453164493":"2023-12-01T17:08:22.105096+0000","172.21.15.115:6833/89956":"2023-12-01T17:08:22.105096+0000","172.21.15.115:0/3230559129":"2023-12-01T17:08:22.105096+0000","172.21.15.115:6832/89956":"2023-12-01T17:08:22.105096+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":6,"length":1},{"begin":16,"length":1},{"begin":22,"length":1},{"begin":26,"length":1},{"begin":32,"length":1},{"begin":36,"length":1},{"begin":42,"length":1},{"begin":46,"length":1},{"begin":52,"length":1},{"begin":56,"length":1},{"begin":63,"length":1},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":77,"length":1},{"begin":83,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":202,"length":20}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:19:44.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.095+0000 7f7e15f95700 1 -- 172.21.15.49:0/2020740615 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7df405f270 msgr2=0x7f7df4061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:19:44.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.095+0000 7f7e15f95700 1 --2- 172.21.15.49:0/2020740615 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7df405f270 0x7f7df4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:44.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.095+0000 7f7e15f95700 1 -- 172.21.15.49:0/2020740615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e10155470 msgr2=0x7f7e100acad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:44.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.095+0000 7f7e15f95700 1 --2- 172.21.15.49:0/2020740615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e10155470 0x7f7e100acad0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f7e1006c470 tx=0x7f7e08009780).stop 2023-11-30T17:19:44.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.095+0000 7f7e15f95700 1 -- 172.21.15.49:0/2020740615 shutdown_connections 2023-11-30T17:19:44.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.095+0000 7f7e15f95700 1 --2- 172.21.15.49:0/2020740615 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7df405f270 0x7f7df4061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:44.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.095+0000 7f7e15f95700 1 --2- 172.21.15.49:0/2020740615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e10155470 0x7f7e100acad0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:44.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.095+0000 7f7e15f95700 1 --2- 172.21.15.49:0/2020740615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e1014e980 0x7f7e100aaee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:44.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.095+0000 7f7e15f95700 1 --2- 172.21.15.49:0/2020740615 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e1014ed60 0x7f7e10131900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:44.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.096+0000 7f7e15f95700 1 -- 172.21.15.49:0/2020740615 >> 172.21.15.49:0/2020740615 conn(0x7f7e100c7eb0 msgr2=0x7f7e100bd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:44.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.096+0000 7f7e15f95700 1 -- 172.21.15.49:0/2020740615 shutdown_connections 2023-11-30T17:19:44.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.096+0000 7f7e15f95700 1 -- 172.21.15.49:0/2020740615 wait complete. 2023-11-30T17:19:44.110 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-30T17:19:44.208 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:19:44.207+0000 7f4b630b8680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:19:44.214 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:44.213+0000 7f89818bb680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T17:19:44.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.229+0000 7f751e39a700 1 Processor -- start 2023-11-30T17:19:44.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.229+0000 7f751e39a700 1 -- start start 2023-11-30T17:19:44.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.230+0000 7f751e39a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75180c51a0 0x7f7518153390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:44.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.230+0000 7f751e39a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f75180c5ea0 0x7f7518066a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:44.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.230+0000 7f751e39a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7518155f20 con 0x7f75180c5ac0 2023-11-30T17:19:44.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.230+0000 7f751e39a700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7518153990 con 0x7f75180c5ea0 2023-11-30T17:19:44.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.230+0000 7f751e39a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7518156200 con 0x7f75180c51a0 2023-11-30T17:19:44.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.230+0000 7f7517fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f75180c5ac0 0x7f7518156690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52960/0 (socket says 172.21.15.49:52960) 2023-11-30T17:19:44.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.230+0000 7f7517fff700 1 -- 172.21.15.49:0/2854509896 learned_addr learned my addr 172.21.15.49:0/2854509896 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:44.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.230+0000 7f75177fe700 1 --2- 172.21.15.49:0/2854509896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75180c51a0 0x7f7518153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:44.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.230+0000 7f751c937700 1 --2- 172.21.15.49:0/2854509896 >> v2:172.21.15.115:3300/0 conn(0x7f75180c5ea0 0x7f7518066a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:44.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.230+0000 7f7516ffd700 1 -- 172.21.15.49:0/2854509896 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1248835193 0 0) 0x7f7518155f20 con 0x7f75180c5ac0 2023-11-30T17:19:44.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.230+0000 7f7516ffd700 1 -- 172.21.15.49:0/2854509896 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75000033f0 con 0x7f75180c5ac0 2023-11-30T17:19:44.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.230+0000 7f75177fe700 1 -- 172.21.15.49:0/2854509896 >> v2:172.21.15.115:3300/0 conn(0x7f75180c5ea0 msgr2=0x7f7518066a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:44.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.230+0000 7f75177fe700 1 --2- 172.21.15.49:0/2854509896 >> v2:172.21.15.115:3300/0 conn(0x7f75180c5ea0 0x7f7518066a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:44.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.230+0000 7f75177fe700 1 -- 172.21.15.49:0/2854509896 >> v1:172.21.15.49:6789/0 conn(0x7f75180c5ac0 legacy=0x7f7518156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:44.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.230+0000 7f75177fe700 1 -- 172.21.15.49:0/2854509896 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75180bff70 con 0x7f75180c51a0 2023-11-30T17:19:44.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.230+0000 7f75177fe700 1 --2- 172.21.15.49:0/2854509896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75180c51a0 0x7f7518153390 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f750c009760 tx=0x7f750c009060).ready entity=mon.2 client_cookie=90964a4eb37a060b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:44.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.231+0000 7f7516ffd700 1 -- 172.21.15.49:0/2854509896 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c0090d0 con 0x7f75180c51a0 2023-11-30T17:19:44.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.231+0000 7f7516ffd700 1 -- 172.21.15.49:0/2854509896 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c00d4a0 con 0x7f75180c51a0 2023-11-30T17:19:44.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.231+0000 7f7516ffd700 1 -- 172.21.15.49:0/2854509896 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c00d820 con 0x7f75180c51a0 2023-11-30T17:19:44.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.231+0000 7f751e39a700 1 -- 172.21.15.49:0/2854509896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75180c51a0 msgr2=0x7f7518153390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:44.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.231+0000 7f751e39a700 1 --2- 172.21.15.49:0/2854509896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75180c51a0 0x7f7518153390 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f750c009760 tx=0x7f750c009060).stop 2023-11-30T17:19:44.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.231+0000 7f751e39a700 1 -- 172.21.15.49:0/2854509896 shutdown_connections 2023-11-30T17:19:44.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.231+0000 7f751e39a700 1 --2- 172.21.15.49:0/2854509896 >> v2:172.21.15.115:3300/0 conn(0x7f75180c5ea0 0x7f7518066a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:44.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.231+0000 7f751e39a700 1 --2- 172.21.15.49:0/2854509896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75180c51a0 0x7f7518153390 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:44.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.231+0000 7f751e39a700 1 -- 172.21.15.49:0/2854509896 >> 172.21.15.49:0/2854509896 conn(0x7f7518062700 msgr2=0x7f7518062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:44.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.231+0000 7f751e39a700 1 -- 172.21.15.49:0/2854509896 shutdown_connections 2023-11-30T17:19:44.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.231+0000 7f751e39a700 1 -- 172.21.15.49:0/2854509896 wait complete. 2023-11-30T17:19:44.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.232+0000 7f751e39a700 1 Processor -- start 2023-11-30T17:19:44.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.233+0000 7f751e39a700 1 -- start start 2023-11-30T17:19:44.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.233+0000 7f751e39a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75180c51a0 0x7f75180c21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:44.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.233+0000 7f751e39a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75180c5ac0 0x7f75180c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:44.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.233+0000 7f751e39a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75180c5ea0 0x7f7518141900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:44.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.233+0000 7f751e39a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751814f640 con 0x7f75180c5ea0 2023-11-30T17:19:44.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.233+0000 7f751e39a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75180c1130 con 0x7f75180c51a0 2023-11-30T17:19:44.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.233+0000 7f751e39a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75180c1410 con 0x7f75180c5ac0 2023-11-30T17:19:44.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.234+0000 7f751c937700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75180c5ea0 0x7f7518141900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:44.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.234+0000 7f751c937700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75180c5ea0 0x7f7518141900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53170/0 (socket says 172.21.15.49:53170) 2023-11-30T17:19:44.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.234+0000 7f751c937700 1 -- 172.21.15.49:0/2929881188 learned_addr learned my addr 172.21.15.49:0/2929881188 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:44.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.234+0000 7f7517fff700 1 --2- 172.21.15.49:0/2929881188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75180c51a0 0x7f75180c21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:44.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.234+0000 7f75177fe700 1 --2- 172.21.15.49:0/2929881188 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75180c5ac0 0x7f75180c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:44.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.234+0000 7f751c937700 1 -- 172.21.15.49:0/2929881188 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75180c5ac0 msgr2=0x7f75180c2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:44.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.234+0000 7f751c937700 1 --2- 172.21.15.49:0/2929881188 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75180c5ac0 0x7f75180c2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:44.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.234+0000 7f751c937700 1 -- 172.21.15.49:0/2929881188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75180c51a0 msgr2=0x7f75180c21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:44.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.234+0000 7f751c937700 1 --2- 172.21.15.49:0/2929881188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75180c51a0 0x7f75180c21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:44.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.234+0000 7f751c937700 1 -- 172.21.15.49:0/2929881188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750c0092a0 con 0x7f75180c5ea0 2023-11-30T17:19:44.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.234+0000 7f751c937700 1 --2- 172.21.15.49:0/2929881188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75180c5ea0 0x7f7518141900 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f7510009e90 tx=0x7f751000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:44.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.234+0000 7f74fffff700 1 -- 172.21.15.49:0/2929881188 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751000cb30 con 0x7f75180c5ea0 2023-11-30T17:19:44.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.234+0000 7f74fffff700 1 -- 172.21.15.49:0/2929881188 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751000f040 con 0x7f75180c5ea0 2023-11-30T17:19:44.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.234+0000 7f751e39a700 1 -- 172.21.15.49:0/2929881188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75180c16f0 con 0x7f75180c5ea0 2023-11-30T17:19:44.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.234+0000 7f74fffff700 1 -- 172.21.15.49:0/2929881188 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751000cea0 con 0x7f75180c5ea0 2023-11-30T17:19:44.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.234+0000 7f751e39a700 1 -- 172.21.15.49:0/2929881188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75180c1cb0 con 0x7f75180c5ea0 2023-11-30T17:19:44.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.235+0000 7f751e39a700 1 -- 172.21.15.49:0/2929881188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f751806c860 con 0x7f75180c5ea0 2023-11-30T17:19:44.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.236+0000 7f74fffff700 1 -- 172.21.15.49:0/2929881188 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f7510013610 con 0x7f75180c5ea0 2023-11-30T17:19:44.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.236+0000 7f74fffff700 1 --2- 172.21.15.49:0/2929881188 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f750405f270 0x7f7504061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:44.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.236+0000 7f7517fff700 1 -- 172.21.15.49:0/2929881188 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f750405f270 msgr2=0x7f7504061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:19:44.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.236+0000 7f74fffff700 1 -- 172.21.15.49:0/2929881188 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6714+0+0 (secure 0 0 0) 0x7f751007af00 con 0x7f75180c5ea0 2023-11-30T17:19:44.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.236+0000 7f7517fff700 1 --2- 172.21.15.49:0/2929881188 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f750405f270 0x7f7504061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:19:44.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.240+0000 7f74fffff700 1 -- 172.21.15.49:0/2929881188 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f751004f830 con 0x7f75180c5ea0 2023-11-30T17:19:44.286 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:44.284+0000 7f89818bb680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T17:19:44.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.307+0000 7f74fffff700 1 -- 172.21.15.49:0/2929881188 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 12) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f7510078900 con 0x7f75180c5ea0 2023-11-30T17:19:44.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.308+0000 7f74fffff700 1 -- 172.21.15.49:0/2929881188 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f750405f270 msgr2=0x7f7504061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:19:44.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.308+0000 7f74fffff700 1 --2- 172.21.15.49:0/2929881188 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f750405f270 0x7f7504061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:44.359 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:44.358+0000 7f88fc84e700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:19:44.360 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:44.358+0000 7f8900055700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:19:44.360 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:44.358+0000 7f88fc84e700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:19:44.360 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:44.358+0000 7f8900055700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:19:44.360 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:44.358+0000 7f88fc84e700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:19:44.360 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:44.358+0000 7f88fc84e700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:19:44.360 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:44.358+0000 7f88fc84e700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:19:44.360 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:44.358+0000 7f8900055700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:19:44.360 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:44.358+0000 7f8900055700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:19:44.360 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:19:44.358+0000 7f8900055700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:19:44.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:44.465+0000 7f751e39a700 1 -- 172.21.15.49:0/2929881188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f75180c4f80 con 0x7f75180c5ea0 2023-11-30T17:19:44.519 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:19:44.518+0000 7f4b630b8680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T17:19:44.593 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:19:44.592+0000 7f4b630b8680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T17:19:45.305 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-11-30T17:19:45.304+0000 7f3888d95700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-30T17:19:45.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.306+0000 7f74fffff700 1 -- 172.21.15.49:0/2929881188 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f75100719b0 con 0x7f75180c5ea0 2023-11-30T17:19:45.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.309+0000 7f751e39a700 1 -- 172.21.15.49:0/2929881188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75180c5ea0 msgr2=0x7f7518141900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:45.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.309+0000 7f751e39a700 1 --2- 172.21.15.49:0/2929881188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75180c5ea0 0x7f7518141900 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f7510009e90 tx=0x7f751000b040).stop 2023-11-30T17:19:45.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.309+0000 7f751e39a700 1 -- 172.21.15.49:0/2929881188 shutdown_connections 2023-11-30T17:19:45.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.309+0000 7f751e39a700 1 --2- 172.21.15.49:0/2929881188 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f750405f270 0x7f7504061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:45.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.309+0000 7f751e39a700 1 --2- 172.21.15.49:0/2929881188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75180c5ea0 0x7f7518141900 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:45.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.309+0000 7f751e39a700 1 --2- 172.21.15.49:0/2929881188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75180c51a0 0x7f75180c21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:45.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.309+0000 7f751e39a700 1 --2- 172.21.15.49:0/2929881188 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75180c5ac0 0x7f75180c2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:45.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.309+0000 7f751e39a700 1 -- 172.21.15.49:0/2929881188 >> 172.21.15.49:0/2929881188 conn(0x7f7518062700 msgr2=0x7f75180c39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:45.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.309+0000 7f751e39a700 1 -- 172.21.15.49:0/2929881188 shutdown_connections 2023-11-30T17:19:45.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.309+0000 7f751e39a700 1 -- 172.21.15.49:0/2929881188 wait complete. 2023-11-30T17:19:45.311 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-30T17:19:45.329 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-30T17:19:45.344 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-11-30T17:19:45.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.452+0000 7fc5ecf73700 1 Processor -- start 2023-11-30T17:19:45.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.452+0000 7fc5ecf73700 1 -- start start 2023-11-30T17:19:45.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.453+0000 7fc5ecf73700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc5e80a8280 0x7fc5e80a8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:45.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.453+0000 7fc5ecf73700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e8067770 con 0x7fc5e8158160 2023-11-30T17:19:45.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.453+0000 7fc5ecf73700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e80be8d0 con 0x7fc5e814e600 2023-11-30T17:19:45.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.453+0000 7fc5ecf73700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e8159180 con 0x7fc5e80a8280 2023-11-30T17:19:45.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.454+0000 7fc5e659c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc5e80a8280 0x7fc5e80a8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:45.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.454+0000 7fc5e659c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc5e80a8280 0x7fc5e80a8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53176/0 (socket says 172.21.15.49:53176) 2023-11-30T17:19:45.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.454+0000 7fc5e5d9b700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc5e8158160 0x7fc5e8155500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52964/0 (socket says 172.21.15.49:52964) 2023-11-30T17:19:45.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.454+0000 7fc5e659c700 1 -- 172.21.15.49:0/4214526270 learned_addr learned my addr 172.21.15.49:0/4214526270 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:45.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.454+0000 7fc5e659c700 1 -- 172.21.15.49:0/4214526270 >> v1:172.21.15.115:6789/0 conn(0x7fc5e814e600 legacy=0x7fc5e814ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:45.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.454+0000 7fc5e659c700 1 -- 172.21.15.49:0/4214526270 >> v1:172.21.15.49:6789/0 conn(0x7fc5e8158160 legacy=0x7fc5e8155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:45.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.454+0000 7fc5e559a700 1 -- 172.21.15.49:0/4214526270 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3512565745 0 0) 0x7fc5e8067770 con 0x7fc5e8158160 2023-11-30T17:19:45.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.454+0000 7fc5e659c700 1 -- 172.21.15.49:0/4214526270 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e8158600 con 0x7fc5e80a8280 2023-11-30T17:19:45.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.454+0000 7fc5e659c700 1 --2- 172.21.15.49:0/4214526270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5e80a8280 0x7fc5e80a8660 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7fc5d8006fd0 tx=0x7fc5d80090f0).ready entity=mon.0 client_cookie=55d656827e3b27de server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:45.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.454+0000 7fc5e559a700 1 -- 172.21.15.49:0/4214526270 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d800b600 con 0x7fc5e80a8280 2023-11-30T17:19:45.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.454+0000 7fc5e559a700 1 -- 172.21.15.49:0/4214526270 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d800b760 con 0x7fc5e80a8280 2023-11-30T17:19:45.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.454+0000 7fc5e559a700 1 -- 172.21.15.49:0/4214526270 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d800bae0 con 0x7fc5e80a8280 2023-11-30T17:19:45.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.455+0000 7fc5ecf73700 1 -- 172.21.15.49:0/4214526270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5e80a8280 msgr2=0x7fc5e80a8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:45.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.455+0000 7fc5ecf73700 1 --2- 172.21.15.49:0/4214526270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5e80a8280 0x7fc5e80a8660 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7fc5d8006fd0 tx=0x7fc5d80090f0).stop 2023-11-30T17:19:45.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.455+0000 7fc5ecf73700 1 -- 172.21.15.49:0/4214526270 shutdown_connections 2023-11-30T17:19:45.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.455+0000 7fc5ecf73700 1 --2- 172.21.15.49:0/4214526270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5e80a8280 0x7fc5e80a8660 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:45.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.455+0000 7fc5ecf73700 1 -- 172.21.15.49:0/4214526270 >> 172.21.15.49:0/4214526270 conn(0x7fc5e8062700 msgr2=0x7fc5e8062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:45.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.455+0000 7fc5ecf73700 1 -- 172.21.15.49:0/4214526270 shutdown_connections 2023-11-30T17:19:45.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.455+0000 7fc5ecf73700 1 -- 172.21.15.49:0/4214526270 wait complete. 2023-11-30T17:19:45.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.456+0000 7fc5ecf73700 1 Processor -- start 2023-11-30T17:19:45.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.456+0000 7fc5ecf73700 1 -- start start 2023-11-30T17:19:45.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.457+0000 7fc5ecf73700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc5e80a8280 0x7fc5e80a9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:45.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.457+0000 7fc5ecf73700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5e814e600 0x7fc5e8141a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:45.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.457+0000 7fc5ecf73700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5e8158160 0x7fc5e8064de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:45.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.457+0000 7fc5ecf73700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e80c17f0 con 0x7fc5e814e600 2023-11-30T17:19:45.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.457+0000 7fc5ecf73700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e80c1ad0 con 0x7fc5e8158160 2023-11-30T17:19:45.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.457+0000 7fc5ecf73700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e80c1db0 con 0x7fc5e80a8280 2023-11-30T17:19:45.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.457+0000 7fc5e5d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5e814e600 0x7fc5e8141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:45.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.457+0000 7fc5e5d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5e814e600 0x7fc5e8141a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53178/0 (socket says 172.21.15.49:53178) 2023-11-30T17:19:45.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.457+0000 7fc5e5d9b700 1 -- 172.21.15.49:0/2309656756 learned_addr learned my addr 172.21.15.49:0/2309656756 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:45.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.457+0000 7fc5e659c700 1 --2- 172.21.15.49:0/2309656756 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc5e80a8280 0x7fc5e80a9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:45.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.457+0000 7fc5e6d9d700 1 --2- 172.21.15.49:0/2309656756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5e8158160 0x7fc5e8064de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:45.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.457+0000 7fc5e5d9b700 1 -- 172.21.15.49:0/2309656756 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc5e80a8280 msgr2=0x7fc5e80a9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:45.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.457+0000 7fc5e5d9b700 1 --2- 172.21.15.49:0/2309656756 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc5e80a8280 0x7fc5e80a9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:45.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.457+0000 7fc5e5d9b700 1 -- 172.21.15.49:0/2309656756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5e8158160 msgr2=0x7fc5e8064de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:45.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.457+0000 7fc5e5d9b700 1 --2- 172.21.15.49:0/2309656756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5e8158160 0x7fc5e8064de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:45.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.457+0000 7fc5e5d9b700 1 -- 172.21.15.49:0/2309656756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d8009370 con 0x7fc5e814e600 2023-11-30T17:19:45.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.457+0000 7fc5e659c700 1 --2- 172.21.15.49:0/2309656756 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc5e80a8280 0x7fc5e80a9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:19:45.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.457+0000 7fc5e5d9b700 1 --2- 172.21.15.49:0/2309656756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5e814e600 0x7fc5e8141a50 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7fc5dc00c4c0 tx=0x7fc5dc007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:45.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.457+0000 7fc5d67fc700 1 -- 172.21.15.49:0/2309656756 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc00ce30 con 0x7fc5e814e600 2023-11-30T17:19:45.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.457+0000 7fc5d67fc700 1 -- 172.21.15.49:0/2309656756 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5dc0072e0 con 0x7fc5e814e600 2023-11-30T17:19:45.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.458+0000 7fc5ecf73700 1 -- 172.21.15.49:0/2309656756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e80c2090 con 0x7fc5e814e600 2023-11-30T17:19:45.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.458+0000 7fc5d67fc700 1 -- 172.21.15.49:0/2309656756 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc0056e0 con 0x7fc5e814e600 2023-11-30T17:19:45.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.458+0000 7fc5ecf73700 1 -- 172.21.15.49:0/2309656756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e80a9fe0 con 0x7fc5e814e600 2023-11-30T17:19:45.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.459+0000 7fc5ecf73700 1 -- 172.21.15.49:0/2309656756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e814efe0 con 0x7fc5e814e600 2023-11-30T17:19:45.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.459+0000 7fc5d67fc700 1 -- 172.21.15.49:0/2309656756 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fc5dc005a90 con 0x7fc5e814e600 2023-11-30T17:19:45.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.459+0000 7fc5d67fc700 1 --2- 172.21.15.49:0/2309656756 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc5c805f000 0x7fc5c80614c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:45.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.459+0000 7fc5d67fc700 1 -- 172.21.15.49:0/2309656756 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6928+0+0 (secure 0 0 0) 0x7fc5dc0799a0 con 0x7fc5e814e600 2023-11-30T17:19:45.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.459+0000 7fc5e659c700 1 --2- 172.21.15.49:0/2309656756 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc5c805f000 0x7fc5c80614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:45.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.460+0000 7fc5e659c700 1 --2- 172.21.15.49:0/2309656756 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc5c805f000 0x7fc5c80614c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fc5d8009130 tx=0x7fc5d8017000).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:45.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.464+0000 7fc5d67fc700 1 -- 172.21.15.49:0/2309656756 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc5dc04ab20 con 0x7fc5e814e600 2023-11-30T17:19:45.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:45.681+0000 7fc5ecf73700 1 -- 172.21.15.49:0/2309656756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc5e806c860 con 0x7fc5e814e600 2023-11-30T17:19:46.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.317+0000 7fc5d67fc700 1 -- 172.21.15.49:0/2309656756 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc5dc018020 con 0x7fc5e814e600 2023-11-30T17:19:46.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.319+0000 7fc5ecf73700 1 -- 172.21.15.49:0/2309656756 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc5c805f000 msgr2=0x7fc5c80614c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:46.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.319+0000 7fc5ecf73700 1 --2- 172.21.15.49:0/2309656756 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc5c805f000 0x7fc5c80614c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fc5d8009130 tx=0x7fc5d8017000).stop 2023-11-30T17:19:46.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.319+0000 7fc5ecf73700 1 -- 172.21.15.49:0/2309656756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5e814e600 msgr2=0x7fc5e8141a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:46.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.319+0000 7fc5ecf73700 1 --2- 172.21.15.49:0/2309656756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5e814e600 0x7fc5e8141a50 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7fc5dc00c4c0 tx=0x7fc5dc007c10).stop 2023-11-30T17:19:46.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.319+0000 7fc5ecf73700 1 -- 172.21.15.49:0/2309656756 shutdown_connections 2023-11-30T17:19:46.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.319+0000 7fc5ecf73700 1 --2- 172.21.15.49:0/2309656756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5e8158160 0x7fc5e8064de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:46.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.319+0000 7fc5ecf73700 1 --2- 172.21.15.49:0/2309656756 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc5e80a8280 0x7fc5e80a9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:46.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.319+0000 7fc5ecf73700 1 --2- 172.21.15.49:0/2309656756 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc5c805f000 0x7fc5c80614c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:46.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.319+0000 7fc5ecf73700 1 --2- 172.21.15.49:0/2309656756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5e814e600 0x7fc5e8141a50 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:46.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.319+0000 7fc5ecf73700 1 -- 172.21.15.49:0/2309656756 >> 172.21.15.49:0/2309656756 conn(0x7fc5e8062700 msgr2=0x7fc5e8062ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:46.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.319+0000 7fc5ecf73700 1 -- 172.21.15.49:0/2309656756 shutdown_connections 2023-11-30T17:19:46.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.319+0000 7fc5ecf73700 1 -- 172.21.15.49:0/2309656756 wait complete. 2023-11-30T17:19:46.335 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-30T17:19:46.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.461+0000 7efc6f4d3700 1 Processor -- start 2023-11-30T17:19:46.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.462+0000 7efc6f4d3700 1 -- start start 2023-11-30T17:19:46.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.462+0000 7efc6f4d3700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efc68154530 0x7efc68154910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:46.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.462+0000 7efc6f4d3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc680a7ff0 0x7efc680c8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:46.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.462+0000 7efc6f4d3700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc680c6630 con 0x7efc680aa220 2023-11-30T17:19:46.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.462+0000 7efc6f4d3700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc680c6390 con 0x7efc680a7ff0 2023-11-30T17:19:46.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.463+0000 7efc6f4d3700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc680a8470 con 0x7efc68154530 2023-11-30T17:19:46.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.463+0000 7efc6ca6e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc680a7ff0 0x7efc680c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:46.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.463+0000 7efc6da70700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7efc680aa220 0x7efc680c6ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52966/0 (socket says 172.21.15.49:52966) 2023-11-30T17:19:46.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.463+0000 7efc6da70700 1 -- 172.21.15.49:0/1597595806 learned_addr learned my addr 172.21.15.49:0/1597595806 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:46.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.463+0000 7efc6d26f700 1 --2- 172.21.15.49:0/1597595806 >> v2:172.21.15.115:3300/0 conn(0x7efc68154530 0x7efc68154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:46.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.463+0000 7efc6ca6e700 1 -- 172.21.15.49:0/1597595806 >> v2:172.21.15.115:3300/0 conn(0x7efc68154530 msgr2=0x7efc68154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:46.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.463+0000 7efc6ca6e700 1 --2- 172.21.15.49:0/1597595806 >> v2:172.21.15.115:3300/0 conn(0x7efc68154530 0x7efc68154910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:46.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.463+0000 7efc6ca6e700 1 -- 172.21.15.49:0/1597595806 >> v1:172.21.15.49:6789/0 conn(0x7efc680aa220 legacy=0x7efc680c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:46.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.463+0000 7efc67fff700 1 -- 172.21.15.49:0/1597595806 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3997487470 0 0) 0x7efc680c6630 con 0x7efc680aa220 2023-11-30T17:19:46.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.463+0000 7efc6ca6e700 1 -- 172.21.15.49:0/1597595806 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc68064230 con 0x7efc680a7ff0 2023-11-30T17:19:46.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.463+0000 7efc6ca6e700 1 --2- 172.21.15.49:0/1597595806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc680a7ff0 0x7efc680c8580 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7efc680c9080 tx=0x7efc5c009060).ready entity=mon.0 client_cookie=45eb71bfb1452e2c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:46.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.463+0000 7efc67fff700 1 -- 172.21.15.49:0/1597595806 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c00b580 con 0x7efc680a7ff0 2023-11-30T17:19:46.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.463+0000 7efc67fff700 1 -- 172.21.15.49:0/1597595806 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5c00b6e0 con 0x7efc680a7ff0 2023-11-30T17:19:46.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.463+0000 7efc67fff700 1 -- 172.21.15.49:0/1597595806 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c00ba60 con 0x7efc680a7ff0 2023-11-30T17:19:46.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.464+0000 7efc6f4d3700 1 -- 172.21.15.49:0/1597595806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc680a7ff0 msgr2=0x7efc680c8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:46.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.464+0000 7efc6f4d3700 1 --2- 172.21.15.49:0/1597595806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc680a7ff0 0x7efc680c8580 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7efc680c9080 tx=0x7efc5c009060).stop 2023-11-30T17:19:46.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.464+0000 7efc6f4d3700 1 -- 172.21.15.49:0/1597595806 shutdown_connections 2023-11-30T17:19:46.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.464+0000 7efc6f4d3700 1 --2- 172.21.15.49:0/1597595806 >> v2:172.21.15.115:3300/0 conn(0x7efc68154530 0x7efc68154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:46.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.464+0000 7efc6f4d3700 1 --2- 172.21.15.49:0/1597595806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc680a7ff0 0x7efc680c8580 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:46.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.464+0000 7efc6f4d3700 1 -- 172.21.15.49:0/1597595806 >> 172.21.15.49:0/1597595806 conn(0x7efc68094930 msgr2=0x7efc6806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:46.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.464+0000 7efc6f4d3700 1 -- 172.21.15.49:0/1597595806 shutdown_connections 2023-11-30T17:19:46.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.464+0000 7efc6f4d3700 1 -- 172.21.15.49:0/1597595806 wait complete. 2023-11-30T17:19:46.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.465+0000 7efc6f4d3700 1 Processor -- start 2023-11-30T17:19:46.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.465+0000 7efc6f4d3700 1 -- start start 2023-11-30T17:19:46.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.466+0000 7efc6f4d3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc680a7ff0 0x7efc68153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:46.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.466+0000 7efc6f4d3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc680aa220 0x7efc680ab800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:46.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.466+0000 7efc6f4d3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc68154530 0x7efc68167d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:46.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.466+0000 7efc6f4d3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc68147c20 con 0x7efc680a7ff0 2023-11-30T17:19:46.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.466+0000 7efc6f4d3700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc680b1040 con 0x7efc680aa220 2023-11-30T17:19:46.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.466+0000 7efc6f4d3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc680ae920 con 0x7efc68154530 2023-11-30T17:19:46.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.466+0000 7efc6d26f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc680a7ff0 0x7efc68153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:46.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.466+0000 7efc6d26f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc680a7ff0 0x7efc68153030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53210/0 (socket says 172.21.15.49:53210) 2023-11-30T17:19:46.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.466+0000 7efc6d26f700 1 -- 172.21.15.49:0/3094151449 learned_addr learned my addr 172.21.15.49:0/3094151449 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:46.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.466+0000 7efc6ca6e700 1 --2- 172.21.15.49:0/3094151449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc680aa220 0x7efc680ab800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:46.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.466+0000 7efc6d26f700 1 -- 172.21.15.49:0/3094151449 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc68154530 msgr2=0x7efc68167d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:46.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.466+0000 7efc6d26f700 1 --2- 172.21.15.49:0/3094151449 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc68154530 0x7efc68167d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:46.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.466+0000 7efc6d26f700 1 -- 172.21.15.49:0/3094151449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc680aa220 msgr2=0x7efc680ab800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:46.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.466+0000 7efc6d26f700 1 --2- 172.21.15.49:0/3094151449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc680aa220 0x7efc680ab800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:46.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.466+0000 7efc6d26f700 1 -- 172.21.15.49:0/3094151449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5c0092a0 con 0x7efc680a7ff0 2023-11-30T17:19:46.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.466+0000 7efc6d26f700 1 --2- 172.21.15.49:0/3094151449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc680a7ff0 0x7efc68153030 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7efc5800ceb0 tx=0x7efc58007860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:46.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.467+0000 7efc657fa700 1 -- 172.21.15.49:0/3094151449 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5800adf0 con 0x7efc680a7ff0 2023-11-30T17:19:46.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.467+0000 7efc657fa700 1 -- 172.21.15.49:0/3094151449 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5800f450 con 0x7efc680a7ff0 2023-11-30T17:19:46.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.467+0000 7efc6f4d3700 1 -- 172.21.15.49:0/3094151449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc68168920 con 0x7efc680a7ff0 2023-11-30T17:19:46.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.467+0000 7efc657fa700 1 -- 172.21.15.49:0/3094151449 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5800f7d0 con 0x7efc680a7ff0 2023-11-30T17:19:46.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.467+0000 7efc6f4d3700 1 -- 172.21.15.49:0/3094151449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc680ae2d0 con 0x7efc680a7ff0 2023-11-30T17:19:46.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.468+0000 7efc6f4d3700 1 -- 172.21.15.49:0/3094151449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc6806c860 con 0x7efc680a7ff0 2023-11-30T17:19:46.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.468+0000 7efc657fa700 1 -- 172.21.15.49:0/3094151449 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 75340+0+0 (secure 0 0 0) 0x7efc5800fbc0 con 0x7efc680a7ff0 2023-11-30T17:19:46.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.468+0000 7efc657fa700 1 --2- 172.21.15.49:0/3094151449 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc5405f030 0x7efc540614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:46.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.468+0000 7efc657fa700 1 -- 172.21.15.49:0/3094151449 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6928+0+0 (secure 0 0 0) 0x7efc5807ad30 con 0x7efc680a7ff0 2023-11-30T17:19:46.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.469+0000 7efc6ca6e700 1 --2- 172.21.15.49:0/3094151449 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc5405f030 0x7efc540614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:46.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.469+0000 7efc6ca6e700 1 --2- 172.21.15.49:0/3094151449 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc5405f030 0x7efc540614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7efc68149a30 tx=0x7efc5c017000).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.473+0000 7efc657fa700 1 -- 172.21.15.49:0/3094151449 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efc5804beb0 con 0x7efc680a7ff0 2023-11-30T17:19:46.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:46.650+0000 7efc6f4d3700 1 -- 172.21.15.49:0/3094151449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efc68168690 con 0x7efc680a7ff0 2023-11-30T17:19:47.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.044+0000 7efc657fa700 1 -- 172.21.15.49:0/3094151449 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7efc58003020 con 0x7efc680a7ff0 2023-11-30T17:19:47.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.321+0000 7efc657fa700 1 -- 172.21.15.49:0/3094151449 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v55) v1 ==== 181+0+0 (secure 0 0 0) 0x7efc580730b0 con 0x7efc680a7ff0 2023-11-30T17:19:47.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.324+0000 7efc6f4d3700 1 -- 172.21.15.49:0/3094151449 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc5405f030 msgr2=0x7efc540614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:47.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.324+0000 7efc6f4d3700 1 --2- 172.21.15.49:0/3094151449 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc5405f030 0x7efc540614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7efc68149a30 tx=0x7efc5c017000).stop 2023-11-30T17:19:47.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.324+0000 7efc6f4d3700 1 -- 172.21.15.49:0/3094151449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc680a7ff0 msgr2=0x7efc68153030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:47.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.324+0000 7efc6f4d3700 1 --2- 172.21.15.49:0/3094151449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc680a7ff0 0x7efc68153030 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7efc5800ceb0 tx=0x7efc58007860).stop 2023-11-30T17:19:47.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.324+0000 7efc6f4d3700 1 -- 172.21.15.49:0/3094151449 shutdown_connections 2023-11-30T17:19:47.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.324+0000 7efc6f4d3700 1 --2- 172.21.15.49:0/3094151449 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc68154530 0x7efc68167d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:47.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.324+0000 7efc6f4d3700 1 --2- 172.21.15.49:0/3094151449 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc5405f030 0x7efc540614f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:47.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.324+0000 7efc6f4d3700 1 --2- 172.21.15.49:0/3094151449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc680a7ff0 0x7efc68153030 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:47.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.324+0000 7efc6f4d3700 1 --2- 172.21.15.49:0/3094151449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc680aa220 0x7efc680ab800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:47.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.325+0000 7efc6f4d3700 1 -- 172.21.15.49:0/3094151449 >> 172.21.15.49:0/3094151449 conn(0x7efc68094930 msgr2=0x7efc680c0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:47.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.325+0000 7efc6f4d3700 1 -- 172.21.15.49:0/3094151449 shutdown_connections 2023-11-30T17:19:47.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.325+0000 7efc6f4d3700 1 -- 172.21.15.49:0/3094151449 wait complete. 2023-11-30T17:19:47.329 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2023-11-30T17:19:47.339 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-30T17:19:47.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.461+0000 7fcfc573d700 1 Processor -- start 2023-11-30T17:19:47.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.461+0000 7fcfc573d700 1 -- start start 2023-11-30T17:19:47.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.462+0000 7fcfc573d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcfc0154610 0x7fcfc01582e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:47.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.462+0000 7fcfc573d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcfc00ab3b0 0x7fcfc00c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:47.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.462+0000 7fcfc573d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfc00aa1c0 0x7fcfc00aa600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:47.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.462+0000 7fcfc573d700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfc0159210 con 0x7fcfc0154610 2023-11-30T17:19:47.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.462+0000 7fcfc573d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfc00c0c70 con 0x7fcfc00ab3b0 2023-11-30T17:19:47.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.462+0000 7fcfc573d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc00aaaf0 con 0x7fcfc00aa1c0 2023-11-30T17:19:47.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.462+0000 7fcfbeffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcfc0154610 0x7fcfc01582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:47.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.462+0000 7fcfbeffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcfc0154610 0x7fcfc01582e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53220/0 (socket says 172.21.15.49:53220) 2023-11-30T17:19:47.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.462+0000 7fcfbeffd700 1 -- 172.21.15.49:0/1910973240 learned_addr learned my addr 172.21.15.49:0/1910973240 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:47.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.463+0000 7fcfbf7fe700 1 --2- 172.21.15.49:0/1910973240 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfc00aa1c0 0x7fcfc00aa600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:47.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.463+0000 7fcfbe7fc700 1 --2- 172.21.15.49:0/1910973240 >> v2:172.21.15.115:3300/0 conn(0x7fcfc00ab3b0 0x7fcfc00c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:47.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.463+0000 7fcfbeffd700 1 -- 172.21.15.49:0/1910973240 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfc00aa1c0 msgr2=0x7fcfc00aa600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:47.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.463+0000 7fcfbeffd700 1 --2- 172.21.15.49:0/1910973240 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfc00aa1c0 0x7fcfc00aa600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:47.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.463+0000 7fcfbeffd700 1 -- 172.21.15.49:0/1910973240 >> v2:172.21.15.115:3300/0 conn(0x7fcfc00ab3b0 msgr2=0x7fcfc00c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:47.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.463+0000 7fcfbeffd700 1 --2- 172.21.15.49:0/1910973240 >> v2:172.21.15.115:3300/0 conn(0x7fcfc00ab3b0 0x7fcfc00c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:47.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.463+0000 7fcfbeffd700 1 -- 172.21.15.49:0/1910973240 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc0158970 con 0x7fcfc0154610 2023-11-30T17:19:47.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.463+0000 7fcfbeffd700 1 --2- 172.21.15.49:0/1910973240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfc0154610 0x7fcfc01582e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7fcfc00c5770 tx=0x7fcfb80090f0).ready entity=mon.0 client_cookie=369ee9fd1bacd575 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:47.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.463+0000 7fcfbdffb700 1 -- 172.21.15.49:0/1910973240 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb800b600 con 0x7fcfc0154610 2023-11-30T17:19:47.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.463+0000 7fcfbdffb700 1 -- 172.21.15.49:0/1910973240 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb800b760 con 0x7fcfc0154610 2023-11-30T17:19:47.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.463+0000 7fcfbdffb700 1 -- 172.21.15.49:0/1910973240 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb800bae0 con 0x7fcfc0154610 2023-11-30T17:19:47.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.463+0000 7fcfc573d700 1 -- 172.21.15.49:0/1910973240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfc0154610 msgr2=0x7fcfc01582e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:47.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.463+0000 7fcfc573d700 1 --2- 172.21.15.49:0/1910973240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfc0154610 0x7fcfc01582e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7fcfc00c5770 tx=0x7fcfb80090f0).stop 2023-11-30T17:19:47.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.463+0000 7fcfc573d700 1 -- 172.21.15.49:0/1910973240 shutdown_connections 2023-11-30T17:19:47.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.464+0000 7fcfc573d700 1 --2- 172.21.15.49:0/1910973240 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfc00aa1c0 0x7fcfc00aa600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:47.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.464+0000 7fcfc573d700 1 --2- 172.21.15.49:0/1910973240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfc0154610 0x7fcfc01582e0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:47.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.464+0000 7fcfc573d700 1 --2- 172.21.15.49:0/1910973240 >> v2:172.21.15.115:3300/0 conn(0x7fcfc00ab3b0 0x7fcfc00c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:47.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.464+0000 7fcfc573d700 1 -- 172.21.15.49:0/1910973240 >> 172.21.15.49:0/1910973240 conn(0x7fcfc00655a0 msgr2=0x7fcfc0069e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:47.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.464+0000 7fcfc573d700 1 -- 172.21.15.49:0/1910973240 shutdown_connections 2023-11-30T17:19:47.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.464+0000 7fcfc573d700 1 -- 172.21.15.49:0/1910973240 wait complete. 2023-11-30T17:19:47.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.465+0000 7fcfc573d700 1 Processor -- start 2023-11-30T17:19:47.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.465+0000 7fcfc573d700 1 -- start start 2023-11-30T17:19:47.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.466+0000 7fcfc573d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfc00aa1c0 0x7fcfc0154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:47.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.466+0000 7fcfc573d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfc0154610 0x7fcfc014ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:47.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.466+0000 7fcfc573d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfc014f480 0x7fcfc00af370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:47.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.466+0000 7fcfc573d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc00c4f60 con 0x7fcfc014f480 2023-11-30T17:19:47.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.466+0000 7fcfc573d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc014f8e0 con 0x7fcfc00aa1c0 2023-11-30T17:19:47.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.466+0000 7fcfc573d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc00c4630 con 0x7fcfc0154610 2023-11-30T17:19:47.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.466+0000 7fcfbf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfc014f480 0x7fcfc00af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:47.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.466+0000 7fcfbf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfc014f480 0x7fcfc00af370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53236/0 (socket says 172.21.15.49:53236) 2023-11-30T17:19:47.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.466+0000 7fcfbf7fe700 1 -- 172.21.15.49:0/295949132 learned_addr learned my addr 172.21.15.49:0/295949132 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:47.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.466+0000 7fcfbeffd700 1 --2- 172.21.15.49:0/295949132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfc00aa1c0 0x7fcfc0154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:47.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.466+0000 7fcfbe7fc700 1 --2- 172.21.15.49:0/295949132 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfc0154610 0x7fcfc014ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:47.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.466+0000 7fcfbf7fe700 1 -- 172.21.15.49:0/295949132 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfc0154610 msgr2=0x7fcfc014ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:47.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.466+0000 7fcfbf7fe700 1 --2- 172.21.15.49:0/295949132 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfc0154610 0x7fcfc014ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:47.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.466+0000 7fcfbf7fe700 1 -- 172.21.15.49:0/295949132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfc00aa1c0 msgr2=0x7fcfc0154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:47.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.466+0000 7fcfbf7fe700 1 --2- 172.21.15.49:0/295949132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfc00aa1c0 0x7fcfc0154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:47.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.466+0000 7fcfbf7fe700 1 -- 172.21.15.49:0/295949132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb8009370 con 0x7fcfc014f480 2023-11-30T17:19:47.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.466+0000 7fcfbf7fe700 1 --2- 172.21.15.49:0/295949132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfc014f480 0x7fcfc00af370 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7fcfb0007f20 tx=0x7fcfb0009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:47.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.466+0000 7fcfb6ffd700 1 -- 172.21.15.49:0/295949132 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb000eb90 con 0x7fcfc014f480 2023-11-30T17:19:47.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.466+0000 7fcfb6ffd700 1 -- 172.21.15.49:0/295949132 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb000ecf0 con 0x7fcfc014f480 2023-11-30T17:19:47.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.466+0000 7fcfb6ffd700 1 -- 172.21.15.49:0/295949132 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0014610 con 0x7fcfc014f480 2023-11-30T17:19:47.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.466+0000 7fcfc573d700 1 -- 172.21.15.49:0/295949132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc00c4910 con 0x7fcfc014f480 2023-11-30T17:19:47.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.467+0000 7fcfc573d700 1 -- 172.21.15.49:0/295949132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc00af860 con 0x7fcfc014f480 2023-11-30T17:19:47.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.468+0000 7fcfc573d700 1 -- 172.21.15.49:0/295949132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc00c4400 con 0x7fcfc014f480 2023-11-30T17:19:47.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.468+0000 7fcfb6ffd700 1 -- 172.21.15.49:0/295949132 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fcfb0014980 con 0x7fcfc014f480 2023-11-30T17:19:47.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.468+0000 7fcfb6ffd700 1 --2- 172.21.15.49:0/295949132 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcfa005f270 0x7fcfa0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:47.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.468+0000 7fcfb6ffd700 1 -- 172.21.15.49:0/295949132 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6490+0+0 (secure 0 0 0) 0x7fcfb007a890 con 0x7fcfc014f480 2023-11-30T17:19:47.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.469+0000 7fcfbeffd700 1 --2- 172.21.15.49:0/295949132 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcfa005f270 0x7fcfa0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:47.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.469+0000 7fcfbeffd700 1 --2- 172.21.15.49:0/295949132 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcfa005f270 0x7fcfa0061730 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fcfb8009130 tx=0x7fcfb8017000).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:47.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.472+0000 7fcfb6ffd700 1 -- 172.21.15.49:0/295949132 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcfb004b870 con 0x7fcfc014f480 2023-11-30T17:19:47.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.644+0000 7fcfc573d700 1 -- 172.21.15.49:0/295949132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcfc0158c50 con 0x7fcfc014f480 2023-11-30T17:19:47.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.877+0000 7fcfb6ffd700 1 -- 172.21.15.49:0/295949132 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v56) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcfb000ee60 con 0x7fcfc014f480 2023-11-30T17:19:47.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.880+0000 7fcfc573d700 1 -- 172.21.15.49:0/295949132 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcfa005f270 msgr2=0x7fcfa0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:47.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.880+0000 7fcfc573d700 1 --2- 172.21.15.49:0/295949132 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcfa005f270 0x7fcfa0061730 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fcfb8009130 tx=0x7fcfb8017000).stop 2023-11-30T17:19:47.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.880+0000 7fcfc573d700 1 -- 172.21.15.49:0/295949132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfc014f480 msgr2=0x7fcfc00af370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:47.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.880+0000 7fcfc573d700 1 --2- 172.21.15.49:0/295949132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfc014f480 0x7fcfc00af370 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7fcfb0007f20 tx=0x7fcfb0009860).stop 2023-11-30T17:19:47.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.880+0000 7fcfc573d700 1 -- 172.21.15.49:0/295949132 shutdown_connections 2023-11-30T17:19:47.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.880+0000 7fcfc573d700 1 --2- 172.21.15.49:0/295949132 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcfa005f270 0x7fcfa0061730 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:47.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.880+0000 7fcfc573d700 1 --2- 172.21.15.49:0/295949132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfc014f480 0x7fcfc00af370 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:47.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.880+0000 7fcfc573d700 1 --2- 172.21.15.49:0/295949132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfc00aa1c0 0x7fcfc0154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:47.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.880+0000 7fcfc573d700 1 --2- 172.21.15.49:0/295949132 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfc0154610 0x7fcfc014ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:47.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.880+0000 7fcfc573d700 1 -- 172.21.15.49:0/295949132 >> 172.21.15.49:0/295949132 conn(0x7fcfc00655a0 msgr2=0x7fcfc00ca1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:47.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.880+0000 7fcfc573d700 1 -- 172.21.15.49:0/295949132 shutdown_connections 2023-11-30T17:19:47.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:47.880+0000 7fcfc573d700 1 -- 172.21.15.49:0/295949132 wait complete. 2023-11-30T17:19:47.884 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2023-11-30T17:19:47.902 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-30T17:19:48.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.029+0000 7f910d493700 1 Processor -- start 2023-11-30T17:19:48.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.029+0000 7f910d493700 1 -- start start 2023-11-30T17:19:48.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.030+0000 7f910d493700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9108098d10 0x7f91080c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:48.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.030+0000 7f910d493700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f91080c6190 0x7f9108063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:48.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.030+0000 7f910d493700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9108064350 0x7f9108158320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:48.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.030+0000 7f910d493700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91080c72d0 con 0x7f91080c6190 2023-11-30T17:19:48.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.030+0000 7f910d493700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9108154bc0 con 0x7f9108064350 2023-11-30T17:19:48.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.030+0000 7f910d493700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91080c66c0 con 0x7f9108098d10 2023-11-30T17:19:48.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.030+0000 7f90fe7fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f91080c6190 0x7f9108063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:48.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.030+0000 7f90fe7fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f91080c6190 0x7f9108063e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53246/0 (socket says 172.21.15.49:53246) 2023-11-30T17:19:48.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.030+0000 7f90fe7fc700 1 -- 172.21.15.49:0/3446060673 learned_addr learned my addr 172.21.15.49:0/3446060673 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:48.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.030+0000 7f9106ffd700 1 --2- 172.21.15.49:0/3446060673 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9108098d10 0x7f91080c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:48.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.030+0000 7f91077fe700 1 --2- 172.21.15.49:0/3446060673 >> v2:172.21.15.115:3300/0 conn(0x7f9108064350 0x7f9108158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:48.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.030+0000 7f90fe7fc700 1 -- 172.21.15.49:0/3446060673 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9108098d10 msgr2=0x7f91080c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:48.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.030+0000 7f90fe7fc700 1 --2- 172.21.15.49:0/3446060673 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9108098d10 0x7f91080c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:48.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.030+0000 7f90fe7fc700 1 -- 172.21.15.49:0/3446060673 >> v2:172.21.15.115:3300/0 conn(0x7f9108064350 msgr2=0x7f9108158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:48.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.030+0000 7f90fe7fc700 1 --2- 172.21.15.49:0/3446060673 >> v2:172.21.15.115:3300/0 conn(0x7f9108064350 0x7f9108158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:48.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.030+0000 7f90fe7fc700 1 -- 172.21.15.49:0/3446060673 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91080c69a0 con 0x7f91080c6190 2023-11-30T17:19:48.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.030+0000 7f9106ffd700 1 --2- 172.21.15.49:0/3446060673 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9108098d10 0x7f91080c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:19:48.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.030+0000 7f91077fe700 1 --2- 172.21.15.49:0/3446060673 >> v2:172.21.15.115:3300/0 conn(0x7f9108064350 0x7f9108158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:19:48.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.031+0000 7f90fe7fc700 1 --2- 172.21.15.49:0/3446060673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91080c6190 0x7f9108063e60 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f9108084570 tx=0x7f90f00090f0).ready entity=mon.0 client_cookie=3fea508c60f3f2f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:48.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.031+0000 7f91067fc700 1 -- 172.21.15.49:0/3446060673 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f000b600 con 0x7f91080c6190 2023-11-30T17:19:48.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.031+0000 7f91067fc700 1 -- 172.21.15.49:0/3446060673 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f000b760 con 0x7f91080c6190 2023-11-30T17:19:48.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.031+0000 7f91067fc700 1 -- 172.21.15.49:0/3446060673 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f000bae0 con 0x7f91080c6190 2023-11-30T17:19:48.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.031+0000 7f910d493700 1 -- 172.21.15.49:0/3446060673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91080c6190 msgr2=0x7f9108063e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:48.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.031+0000 7f910d493700 1 --2- 172.21.15.49:0/3446060673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91080c6190 0x7f9108063e60 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f9108084570 tx=0x7f90f00090f0).stop 2023-11-30T17:19:48.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.031+0000 7f910d493700 1 -- 172.21.15.49:0/3446060673 shutdown_connections 2023-11-30T17:19:48.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.031+0000 7f910d493700 1 --2- 172.21.15.49:0/3446060673 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9108098d10 0x7f91080c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:48.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.031+0000 7f910d493700 1 --2- 172.21.15.49:0/3446060673 >> v2:172.21.15.115:3300/0 conn(0x7f9108064350 0x7f9108158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:48.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.031+0000 7f910d493700 1 --2- 172.21.15.49:0/3446060673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91080c6190 0x7f9108063e60 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:48.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.031+0000 7f910d493700 1 -- 172.21.15.49:0/3446060673 >> 172.21.15.49:0/3446060673 conn(0x7f91080cb310 msgr2=0x7f91080cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:48.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.031+0000 7f910d493700 1 -- 172.21.15.49:0/3446060673 shutdown_connections 2023-11-30T17:19:48.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.031+0000 7f910d493700 1 -- 172.21.15.49:0/3446060673 wait complete. 2023-11-30T17:19:48.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.033+0000 7f910d493700 1 Processor -- start 2023-11-30T17:19:48.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.033+0000 7f910d493700 1 -- start start 2023-11-30T17:19:48.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.033+0000 7f910d493700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9108064350 0x7f910813ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:48.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.033+0000 7f910d493700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9108098d10 0x7f91080c2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:48.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.033+0000 7f910d493700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91080c6190 0x7f91080c2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:48.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.033+0000 7f910d493700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9108156320 con 0x7f91080c6190 2023-11-30T17:19:48.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.033+0000 7f910d493700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9108155710 con 0x7f9108064350 2023-11-30T17:19:48.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.033+0000 7f910d493700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91081559f0 con 0x7f9108098d10 2023-11-30T17:19:48.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.033+0000 7f91077fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91080c6190 0x7f91080c2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:48.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.033+0000 7f91077fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91080c6190 0x7f91080c2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53250/0 (socket says 172.21.15.49:53250) 2023-11-30T17:19:48.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.034+0000 7f91077fe700 1 -- 172.21.15.49:0/1381682756 learned_addr learned my addr 172.21.15.49:0/1381682756 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:48.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.034+0000 7f90fe7fc700 1 --2- 172.21.15.49:0/1381682756 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9108098d10 0x7f91080c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:48.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.034+0000 7f9106ffd700 1 --2- 172.21.15.49:0/1381682756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9108064350 0x7f910813ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:48.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.034+0000 7f91077fe700 1 -- 172.21.15.49:0/1381682756 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9108098d10 msgr2=0x7f91080c2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:48.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.034+0000 7f91077fe700 1 --2- 172.21.15.49:0/1381682756 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9108098d10 0x7f91080c2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:48.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.034+0000 7f91077fe700 1 -- 172.21.15.49:0/1381682756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9108064350 msgr2=0x7f910813ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:48.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.034+0000 7f91077fe700 1 --2- 172.21.15.49:0/1381682756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9108064350 0x7f910813ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:48.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.034+0000 7f91077fe700 1 -- 172.21.15.49:0/1381682756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f0009370 con 0x7f91080c6190 2023-11-30T17:19:48.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.034+0000 7f91077fe700 1 --2- 172.21.15.49:0/1381682756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91080c6190 0x7f91080c2b70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f910000d180 tx=0x7f9100009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:48.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.034+0000 7f90ff7fe700 1 -- 172.21.15.49:0/1381682756 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910000dcc0 con 0x7f91080c6190 2023-11-30T17:19:48.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.034+0000 7f90ff7fe700 1 -- 172.21.15.49:0/1381682756 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910000f040 con 0x7f91080c6190 2023-11-30T17:19:48.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.034+0000 7f910d493700 1 -- 172.21.15.49:0/1381682756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9108155cd0 con 0x7f91080c6190 2023-11-30T17:19:48.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.034+0000 7f90ff7fe700 1 -- 172.21.15.49:0/1381682756 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9100013600 con 0x7f91080c6190 2023-11-30T17:19:48.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.034+0000 7f910d493700 1 -- 172.21.15.49:0/1381682756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91080c3060 con 0x7f91080c6190 2023-11-30T17:19:48.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.035+0000 7f910d493700 1 -- 172.21.15.49:0/1381682756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9108156490 con 0x7f91080c6190 2023-11-30T17:19:48.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.035+0000 7f90ff7fe700 1 -- 172.21.15.49:0/1381682756 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f91000139f0 con 0x7f91080c6190 2023-11-30T17:19:48.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.036+0000 7f90ff7fe700 1 --2- 172.21.15.49:0/1381682756 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f90e805f2a0 0x7f90e8061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:48.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.036+0000 7f90ff7fe700 1 -- 172.21.15.49:0/1381682756 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f910007a880 con 0x7f91080c6190 2023-11-30T17:19:48.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.036+0000 7f9106ffd700 1 --2- 172.21.15.49:0/1381682756 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f90e805f2a0 0x7f90e8061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:48.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.037+0000 7f9106ffd700 1 --2- 172.21.15.49:0/1381682756 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f90e805f2a0 0x7f90e8061760 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f90f8006fd0 tx=0x7f90f8008040).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:48.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.040+0000 7f90ff7fe700 1 -- 172.21.15.49:0/1381682756 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f910004b9c0 con 0x7f91080c6190 2023-11-30T17:19:48.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.217+0000 7f910d493700 1 -- 172.21.15.49:0/1381682756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f910806c860 con 0x7f91080c6190 2023-11-30T17:19:48.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.220+0000 7f90ff7fe700 1 -- 172.21.15.49:0/1381682756 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v4) v1 ==== 104+0+0 (secure 0 0 0) 0x7f910004efe0 con 0x7f91080c6190 2023-11-30T17:19:48.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.222+0000 7f910d493700 1 -- 172.21.15.49:0/1381682756 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f90e805f2a0 msgr2=0x7f90e8061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:48.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.222+0000 7f910d493700 1 --2- 172.21.15.49:0/1381682756 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f90e805f2a0 0x7f90e8061760 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f90f8006fd0 tx=0x7f90f8008040).stop 2023-11-30T17:19:48.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.222+0000 7f910d493700 1 -- 172.21.15.49:0/1381682756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91080c6190 msgr2=0x7f91080c2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:48.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.222+0000 7f910d493700 1 --2- 172.21.15.49:0/1381682756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91080c6190 0x7f91080c2b70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f910000d180 tx=0x7f9100009a50).stop 2023-11-30T17:19:48.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.222+0000 7f910d493700 1 -- 172.21.15.49:0/1381682756 shutdown_connections 2023-11-30T17:19:48.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.222+0000 7f910d493700 1 --2- 172.21.15.49:0/1381682756 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f90e805f2a0 0x7f90e8061760 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:48.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.222+0000 7f910d493700 1 --2- 172.21.15.49:0/1381682756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91080c6190 0x7f91080c2b70 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:48.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.222+0000 7f910d493700 1 --2- 172.21.15.49:0/1381682756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9108064350 0x7f910813ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:48.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.222+0000 7f910d493700 1 --2- 172.21.15.49:0/1381682756 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9108098d10 0x7f91080c2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:48.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.222+0000 7f910d493700 1 -- 172.21.15.49:0/1381682756 >> 172.21.15.49:0/1381682756 conn(0x7f91080cb310 msgr2=0x7f9108158000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:48.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.222+0000 7f910d493700 1 -- 172.21.15.49:0/1381682756 shutdown_connections 2023-11-30T17:19:48.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.222+0000 7f910d493700 1 -- 172.21.15.49:0/1381682756 wait complete. 2023-11-30T17:19:48.235 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-11-30T17:19:48.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.354+0000 7f0ec7736700 1 Processor -- start 2023-11-30T17:19:48.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.354+0000 7f0ec7736700 1 -- start start 2023-11-30T17:19:48.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.355+0000 7f0ec7736700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0ec00c6190 0x7f0ec00c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:48.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.355+0000 7f0ec7736700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec00c72d0 con 0x7f0ec0158320 2023-11-30T17:19:48.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.355+0000 7f0ec7736700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec0064570 con 0x7f0ec0098d10 2023-11-30T17:19:48.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.355+0000 7f0ec7736700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec0154bc0 con 0x7f0ec00c6190 2023-11-30T17:19:48.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.355+0000 7f0ec5cd3700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0ec0158320 0x7f0ec00a80f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52972/0 (socket says 172.21.15.49:52972) 2023-11-30T17:19:48.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.355+0000 7f0ec5cd3700 1 -- 172.21.15.49:0/1891558617 learned_addr learned my addr 172.21.15.49:0/1891558617 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:48.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.355+0000 7f0ec4cd1700 1 --2- 172.21.15.49:0/1891558617 >> v2:172.21.15.115:3300/0 conn(0x7f0ec00c6190 0x7f0ec00c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:48.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.355+0000 7f0ebffff700 1 -- 172.21.15.49:0/1891558617 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 972438381 0 0) 0x7f0ec00c72d0 con 0x7f0ec0158320 2023-11-30T17:19:48.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.355+0000 7f0ebffff700 1 -- 172.21.15.49:0/1891558617 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ea80033f0 con 0x7f0ec0158320 2023-11-30T17:19:48.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.355+0000 7f0ebffff700 1 -- 172.21.15.49:0/1891558617 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 640931214 0 0) 0x7f0ea80033f0 con 0x7f0ec0158320 2023-11-30T17:19:48.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.355+0000 7f0ebffff700 1 -- 172.21.15.49:0/1891558617 >> v2:172.21.15.115:3300/0 conn(0x7f0ec00c6190 msgr2=0x7f0ec00c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:48.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.355+0000 7f0ebffff700 1 --2- 172.21.15.49:0/1891558617 >> v2:172.21.15.115:3300/0 conn(0x7f0ec00c6190 0x7f0ec00c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:48.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.355+0000 7f0ebffff700 1 -- 172.21.15.49:0/1891558617 >> v1:172.21.15.115:6789/0 conn(0x7f0ec0098d10 legacy=0x7f0ec0063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:48.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.355+0000 7f0ebffff700 1 -- 172.21.15.49:0/1891558617 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec00c66c0 con 0x7f0ec0158320 2023-11-30T17:19:48.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.355+0000 7f0ebffff700 1 -- 172.21.15.49:0/1891558617 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f0eb00017f0 con 0x7f0ec0158320 2023-11-30T17:19:48.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.355+0000 7f0ebffff700 1 -- 172.21.15.49:0/1891558617 >> v1:172.21.15.49:6789/0 conn(0x7f0ec0158320 legacy=0x7f0ec00a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:48.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.355+0000 7f0ebffff700 1 --2- 172.21.15.49:0/1891558617 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ea80038e0 0x7f0ea8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:48.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.355+0000 7f0ebffff700 1 --2- 172.21.15.49:0/1891558617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ea8004690 0x7f0ea8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:48.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.355+0000 7f0ebffff700 1 --2- 172.21.15.49:0/1891558617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ea8005000 0x7f0ea800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:48.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.355+0000 7f0ebffff700 1 -- 172.21.15.49:0/1891558617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec0154bc0 con 0x7f0ea8004690 2023-11-30T17:19:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.355+0000 7f0ebffff700 1 -- 172.21.15.49:0/1891558617 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea800beb0 con 0x7f0ea8005000 2023-11-30T17:19:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.355+0000 7f0ebffff700 1 -- 172.21.15.49:0/1891558617 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea800c070 con 0x7f0ea80038e0 2023-11-30T17:19:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.356+0000 7f0ec4cd1700 1 --2- 172.21.15.49:0/1891558617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ea8004690 0x7f0ea8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.356+0000 7f0ec54d2700 1 --2- 172.21.15.49:0/1891558617 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ea80038e0 0x7f0ea8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.356+0000 7f0ec5cd3700 1 --2- 172.21.15.49:0/1891558617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ea8005000 0x7f0ea800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.356+0000 7f0ec4cd1700 1 -- 172.21.15.49:0/1891558617 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ea80038e0 msgr2=0x7f0ea8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.356+0000 7f0ec4cd1700 1 --2- 172.21.15.49:0/1891558617 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ea80038e0 0x7f0ea8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.356+0000 7f0ec4cd1700 1 -- 172.21.15.49:0/1891558617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ea8005000 msgr2=0x7f0ea800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.356+0000 7f0ec4cd1700 1 --2- 172.21.15.49:0/1891558617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ea8005000 0x7f0ea800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.356+0000 7f0ec4cd1700 1 -- 172.21.15.49:0/1891558617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea80033f0 con 0x7f0ea8004690 2023-11-30T17:19:48.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.356+0000 7f0ec5cd3700 1 --2- 172.21.15.49:0/1891558617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ea8005000 0x7f0ea800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:19:48.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.356+0000 7f0ec5cd3700 1 -- 172.21.15.49:0/1891558617 reap_dead start 2023-11-30T17:19:48.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.356+0000 7f0ec4cd1700 1 --2- 172.21.15.49:0/1891558617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ea8004690 0x7f0ea8004b10 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f0ec00c65f0 tx=0x7f0eb4009060).ready entity=mon.0 client_cookie=a40fbb92798ae553 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:48.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.356+0000 7f0ebffff700 1 -- 172.21.15.49:0/1891558617 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4009e90 con 0x7f0ea8004690 2023-11-30T17:19:48.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.356+0000 7f0ebffff700 1 -- 172.21.15.49:0/1891558617 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb4009430 con 0x7f0ea8004690 2023-11-30T17:19:48.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.356+0000 7f0ebffff700 1 -- 172.21.15.49:0/1891558617 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb400e850 con 0x7f0ea8004690 2023-11-30T17:19:48.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.357+0000 7f0ec7736700 1 -- 172.21.15.49:0/1891558617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ea8004690 msgr2=0x7f0ea8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:48.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.357+0000 7f0ec7736700 1 --2- 172.21.15.49:0/1891558617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ea8004690 0x7f0ea8004b10 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f0ec00c65f0 tx=0x7f0eb4009060).stop 2023-11-30T17:19:48.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.357+0000 7f0ec7736700 1 -- 172.21.15.49:0/1891558617 shutdown_connections 2023-11-30T17:19:48.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.357+0000 7f0ec7736700 1 --2- 172.21.15.49:0/1891558617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ea8004690 0x7f0ea8004b10 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:48.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.357+0000 7f0ec7736700 1 -- 172.21.15.49:0/1891558617 >> 172.21.15.49:0/1891558617 conn(0x7f0ec00cb310 msgr2=0x7f0ec00cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:48.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.357+0000 7f0ec7736700 1 -- 172.21.15.49:0/1891558617 shutdown_connections 2023-11-30T17:19:48.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.357+0000 7f0ec7736700 1 -- 172.21.15.49:0/1891558617 wait complete. 2023-11-30T17:19:48.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.358+0000 7f0ec7736700 1 Processor -- start 2023-11-30T17:19:48.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.358+0000 7f0ec7736700 1 -- start start 2023-11-30T17:19:48.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.359+0000 7f0ec7736700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ea8004690 0x7f0ec014aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:48.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.359+0000 7f0ec7736700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ec0154dc0 0x7f0ec0155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:48.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.359+0000 7f0ec7736700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ec00a8660 0x7f0ec00a8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:48.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.359+0000 7f0ec7736700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec0165e70 con 0x7f0ec00a8660 2023-11-30T17:19:48.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.359+0000 7f0ec7736700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec0155730 con 0x7f0ea8004690 2023-11-30T17:19:48.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.359+0000 7f0ec7736700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00a9410 con 0x7f0ec0154dc0 2023-11-30T17:19:48.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.359+0000 7f0ec5cd3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ec00a8660 0x7f0ec00a8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:48.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.359+0000 7f0ec5cd3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ec00a8660 0x7f0ec00a8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53278/0 (socket says 172.21.15.49:53278) 2023-11-30T17:19:48.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.359+0000 7f0ec5cd3700 1 -- 172.21.15.49:0/3635739719 learned_addr learned my addr 172.21.15.49:0/3635739719 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:48.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.359+0000 7f0ec54d2700 1 --2- 172.21.15.49:0/3635739719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ea8004690 0x7f0ec014aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:48.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.359+0000 7f0ec4cd1700 1 --2- 172.21.15.49:0/3635739719 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ec0154dc0 0x7f0ec0155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:48.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.359+0000 7f0ec5cd3700 1 -- 172.21.15.49:0/3635739719 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ec0154dc0 msgr2=0x7f0ec0155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:48.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.359+0000 7f0ec5cd3700 1 --2- 172.21.15.49:0/3635739719 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ec0154dc0 0x7f0ec0155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:48.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.359+0000 7f0ec5cd3700 1 -- 172.21.15.49:0/3635739719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ea8004690 msgr2=0x7f0ec014aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:48.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.359+0000 7f0ec5cd3700 1 --2- 172.21.15.49:0/3635739719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ea8004690 0x7f0ec014aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:48.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.359+0000 7f0ec5cd3700 1 -- 172.21.15.49:0/3635739719 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec00a96f0 con 0x7f0ec00a8660 2023-11-30T17:19:48.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.359+0000 7f0ec5cd3700 1 --2- 172.21.15.49:0/3635739719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ec00a8660 0x7f0ec00a8aa0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f0ec0158700 tx=0x7f0eb0007ca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:48.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.359+0000 7f0ebd7fa700 1 -- 172.21.15.49:0/3635739719 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb000e830 con 0x7f0ec00a8660 2023-11-30T17:19:48.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.360+0000 7f0ebd7fa700 1 -- 172.21.15.49:0/3635739719 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb000e990 con 0x7f0ec00a8660 2023-11-30T17:19:48.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.360+0000 7f0ebd7fa700 1 -- 172.21.15.49:0/3635739719 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb000ed10 con 0x7f0ec00a8660 2023-11-30T17:19:48.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.360+0000 7f0ec7736700 1 -- 172.21.15.49:0/3635739719 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec00a99d0 con 0x7f0ec00a8660 2023-11-30T17:19:48.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.360+0000 7f0ec7736700 1 -- 172.21.15.49:0/3635739719 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec014b3e0 con 0x7f0ec00a8660 2023-11-30T17:19:48.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.361+0000 7f0ec7736700 1 -- 172.21.15.49:0/3635739719 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec0158120 con 0x7f0ec00a8660 2023-11-30T17:19:48.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.361+0000 7f0ebd7fa700 1 -- 172.21.15.49:0/3635739719 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0eb0014640 con 0x7f0ec00a8660 2023-11-30T17:19:48.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.361+0000 7f0ebd7fa700 1 --2- 172.21.15.49:0/3635739719 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0eac05f240 0x7f0eac061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:48.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.361+0000 7f0ebd7fa700 1 -- 172.21.15.49:0/3635739719 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f0eb0079ce0 con 0x7f0ec00a8660 2023-11-30T17:19:48.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.362+0000 7f0ec54d2700 1 --2- 172.21.15.49:0/3635739719 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0eac05f240 0x7f0eac061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:48.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.362+0000 7f0ec54d2700 1 --2- 172.21.15.49:0/3635739719 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0eac05f240 0x7f0eac061700 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f0eb8000f60 tx=0x7f0eb8009040).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:48.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.365+0000 7f0ebd7fa700 1 -- 172.21.15.49:0/3635739719 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0eb007e070 con 0x7f0ec00a8660 2023-11-30T17:19:48.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.539+0000 7f0ec7736700 1 -- 172.21.15.49:0/3635739719 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f0ec006c860 con 0x7f0ec00a8660 2023-11-30T17:19:48.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.543+0000 7f0ebd7fa700 1 -- 172.21.15.49:0/3635739719 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v5) v1 ==== 120+0+0 (secure 0 0 0) 0x7f0eb001c0b0 con 0x7f0ec00a8660 2023-11-30T17:19:48.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.545+0000 7f0ec7736700 1 -- 172.21.15.49:0/3635739719 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0eac05f240 msgr2=0x7f0eac061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:48.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.545+0000 7f0ec7736700 1 --2- 172.21.15.49:0/3635739719 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0eac05f240 0x7f0eac061700 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f0eb8000f60 tx=0x7f0eb8009040).stop 2023-11-30T17:19:48.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.545+0000 7f0ec7736700 1 -- 172.21.15.49:0/3635739719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ec00a8660 msgr2=0x7f0ec00a8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:48.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.545+0000 7f0ec7736700 1 --2- 172.21.15.49:0/3635739719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ec00a8660 0x7f0ec00a8aa0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f0ec0158700 tx=0x7f0eb0007ca0).stop 2023-11-30T17:19:48.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.545+0000 7f0ec7736700 1 -- 172.21.15.49:0/3635739719 shutdown_connections 2023-11-30T17:19:48.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.545+0000 7f0ec7736700 1 --2- 172.21.15.49:0/3635739719 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0eac05f240 0x7f0eac061700 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:48.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.545+0000 7f0ec7736700 1 --2- 172.21.15.49:0/3635739719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ec00a8660 0x7f0ec00a8aa0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:48.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.545+0000 7f0ec7736700 1 --2- 172.21.15.49:0/3635739719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ea8004690 0x7f0ec014aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:48.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.545+0000 7f0ec7736700 1 --2- 172.21.15.49:0/3635739719 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ec0154dc0 0x7f0ec0155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:48.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.545+0000 7f0ec7736700 1 -- 172.21.15.49:0/3635739719 >> 172.21.15.49:0/3635739719 conn(0x7f0ec00cb310 msgr2=0x7f0ec00ca4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:48.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.545+0000 7f0ec7736700 1 -- 172.21.15.49:0/3635739719 shutdown_connections 2023-11-30T17:19:48.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.545+0000 7f0ec7736700 1 -- 172.21.15.49:0/3635739719 wait complete. 2023-11-30T17:19:48.558 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-11-30T17:19:48.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.675+0000 7f99119e6700 1 Processor -- start 2023-11-30T17:19:48.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.675+0000 7f99119e6700 1 -- start start 2023-11-30T17:19:48.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.676+0000 7f99119e6700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f990c1544e0 0x7f990c1548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:48.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.676+0000 7f99119e6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f990c0c6e30 0x7f990c0c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:48.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.676+0000 7f99119e6700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f990c0c69a0 con 0x7f990c06a610 2023-11-30T17:19:48.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.676+0000 7f99119e6700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f990c0c13a0 con 0x7f990c0c6e30 2023-11-30T17:19:48.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.676+0000 7f99119e6700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f990c0c1680 con 0x7f990c1544e0 2023-11-30T17:19:48.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.676+0000 7f990b7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f990c0c6e30 0x7f990c0c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:48.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.676+0000 7f990a7fc700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f990c06a610 0x7f990c0c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52978/0 (socket says 172.21.15.49:52978) 2023-11-30T17:19:48.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.676+0000 7f990b7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f990c0c6e30 0x7f990c0c72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53290/0 (socket says 172.21.15.49:53290) 2023-11-30T17:19:48.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.676+0000 7f990a7fc700 1 -- 172.21.15.49:0/355106674 learned_addr learned my addr 172.21.15.49:0/355106674 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:48.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.676+0000 7f990affd700 1 --2- 172.21.15.49:0/355106674 >> v2:172.21.15.115:3300/0 conn(0x7f990c1544e0 0x7f990c1548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:48.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.677+0000 7f990b7fe700 1 -- 172.21.15.49:0/355106674 >> v2:172.21.15.115:3300/0 conn(0x7f990c1544e0 msgr2=0x7f990c1548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:48.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.677+0000 7f990b7fe700 1 --2- 172.21.15.49:0/355106674 >> v2:172.21.15.115:3300/0 conn(0x7f990c1544e0 0x7f990c1548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:48.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.677+0000 7f990b7fe700 1 -- 172.21.15.49:0/355106674 >> v1:172.21.15.49:6789/0 conn(0x7f990c06a610 legacy=0x7f990c0c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:48.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.677+0000 7f9909ffb700 1 -- 172.21.15.49:0/355106674 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2202940929 0 0) 0x7f990c0c69a0 con 0x7f990c06a610 2023-11-30T17:19:48.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.677+0000 7f990b7fe700 1 -- 172.21.15.49:0/355106674 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990c0c6630 con 0x7f990c0c6e30 2023-11-30T17:19:48.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.677+0000 7f990b7fe700 1 --2- 172.21.15.49:0/355106674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f990c0c6e30 0x7f990c0c72a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f990c085760 tx=0x7f9904009780).ready entity=mon.0 client_cookie=b57dc3bbd1868fb3 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:48.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.677+0000 7f9909ffb700 1 -- 172.21.15.49:0/355106674 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990400e070 con 0x7f990c0c6e30 2023-11-30T17:19:48.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.677+0000 7f9909ffb700 1 -- 172.21.15.49:0/355106674 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990400bc30 con 0x7f990c0c6e30 2023-11-30T17:19:48.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.677+0000 7f9909ffb700 1 -- 172.21.15.49:0/355106674 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9904012410 con 0x7f990c0c6e30 2023-11-30T17:19:48.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.677+0000 7f99119e6700 1 -- 172.21.15.49:0/355106674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f990c0c6e30 msgr2=0x7f990c0c72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:48.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.677+0000 7f99119e6700 1 --2- 172.21.15.49:0/355106674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f990c0c6e30 0x7f990c0c72a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f990c085760 tx=0x7f9904009780).stop 2023-11-30T17:19:48.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.677+0000 7f99119e6700 1 -- 172.21.15.49:0/355106674 shutdown_connections 2023-11-30T17:19:48.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.677+0000 7f99119e6700 1 --2- 172.21.15.49:0/355106674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f990c0c6e30 0x7f990c0c72a0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:48.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.677+0000 7f99119e6700 1 --2- 172.21.15.49:0/355106674 >> v2:172.21.15.115:3300/0 conn(0x7f990c1544e0 0x7f990c1548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:48.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.677+0000 7f99119e6700 1 -- 172.21.15.49:0/355106674 >> 172.21.15.49:0/355106674 conn(0x7f990c085020 msgr2=0x7f990c094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:48.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.677+0000 7f99119e6700 1 -- 172.21.15.49:0/355106674 shutdown_connections 2023-11-30T17:19:48.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.677+0000 7f99119e6700 1 -- 172.21.15.49:0/355106674 wait complete. 2023-11-30T17:19:48.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.679+0000 7f99119e6700 1 Processor -- start 2023-11-30T17:19:48.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.679+0000 7f99119e6700 1 -- start start 2023-11-30T17:19:48.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.679+0000 7f99119e6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f990c06a610 0x7f990c165130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:48.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.679+0000 7f99119e6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f990c0c6e30 0x7f990c0a8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:48.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.679+0000 7f99119e6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f990c1544e0 0x7f990c0a8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:48.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.679+0000 7f99119e6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990c0969e0 con 0x7f990c1544e0 2023-11-30T17:19:48.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.679+0000 7f99119e6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990c0a9050 con 0x7f990c06a610 2023-11-30T17:19:48.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.679+0000 7f99119e6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990c095d60 con 0x7f990c0c6e30 2023-11-30T17:19:48.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.680+0000 7f990b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f990c1544e0 0x7f990c0a8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:48.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.680+0000 7f990b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f990c1544e0 0x7f990c0a8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53302/0 (socket says 172.21.15.49:53302) 2023-11-30T17:19:48.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.680+0000 7f990b7fe700 1 -- 172.21.15.49:0/617927038 learned_addr learned my addr 172.21.15.49:0/617927038 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:48.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.680+0000 7f990a7fc700 1 --2- 172.21.15.49:0/617927038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f990c0c6e30 0x7f990c0a8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:48.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.680+0000 7f990affd700 1 --2- 172.21.15.49:0/617927038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f990c06a610 0x7f990c165130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:48.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.680+0000 7f990b7fe700 1 -- 172.21.15.49:0/617927038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f990c0c6e30 msgr2=0x7f990c0a8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:48.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.680+0000 7f990b7fe700 1 --2- 172.21.15.49:0/617927038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f990c0c6e30 0x7f990c0a8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:48.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.680+0000 7f990b7fe700 1 -- 172.21.15.49:0/617927038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f990c06a610 msgr2=0x7f990c165130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:48.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.680+0000 7f990b7fe700 1 --2- 172.21.15.49:0/617927038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f990c06a610 0x7f990c165130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:48.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.680+0000 7f990b7fe700 1 -- 172.21.15.49:0/617927038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9904009a20 con 0x7f990c1544e0 2023-11-30T17:19:48.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.680+0000 7f990b7fe700 1 --2- 172.21.15.49:0/617927038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f990c1544e0 0x7f990c0a8b60 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f990c05fb30 tx=0x7f9904009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:48.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.680+0000 7f9902ffd700 1 -- 172.21.15.49:0/617927038 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9904009440 con 0x7f990c1544e0 2023-11-30T17:19:48.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.680+0000 7f9902ffd700 1 -- 172.21.15.49:0/617927038 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99040116d0 con 0x7f990c1544e0 2023-11-30T17:19:48.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.680+0000 7f99119e6700 1 -- 172.21.15.49:0/617927038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f990c096040 con 0x7f990c1544e0 2023-11-30T17:19:48.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.680+0000 7f9902ffd700 1 -- 172.21.15.49:0/617927038 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9904011a90 con 0x7f990c1544e0 2023-11-30T17:19:48.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.680+0000 7f99119e6700 1 -- 172.21.15.49:0/617927038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f990c096600 con 0x7f990c1544e0 2023-11-30T17:19:48.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.681+0000 7f99119e6700 1 -- 172.21.15.49:0/617927038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f990c06c860 con 0x7f990c1544e0 2023-11-30T17:19:48.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.682+0000 7f9902ffd700 1 -- 172.21.15.49:0/617927038 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f9904003040 con 0x7f990c1544e0 2023-11-30T17:19:48.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.682+0000 7f9902ffd700 1 --2- 172.21.15.49:0/617927038 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f98ec05f270 0x7f98ec061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:48.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.682+0000 7f9902ffd700 1 -- 172.21.15.49:0/617927038 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f990407c2c0 con 0x7f990c1544e0 2023-11-30T17:19:48.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.682+0000 7f990affd700 1 --2- 172.21.15.49:0/617927038 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f98ec05f270 0x7f98ec061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:48.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.683+0000 7f990affd700 1 --2- 172.21.15.49:0/617927038 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f98ec05f270 0x7f98ec061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f98fc006fd0 tx=0x7f98fc008040).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:48.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.686+0000 7f9902ffd700 1 -- 172.21.15.49:0/617927038 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f990404d460 con 0x7f990c1544e0 2023-11-30T17:19:48.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:48.929+0000 7f99119e6700 1 -- 172.21.15.49:0/617927038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7f990c0c6250 con 0x7f990c1544e0 2023-11-30T17:19:49.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.052+0000 7f9902ffd700 1 -- 172.21.15.49:0/617927038 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v442) v1 ==== 158+0+0 (secure 0 0 0) 0x7f9904050a80 con 0x7f990c1544e0 2023-11-30T17:19:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.054+0000 7f99119e6700 1 -- 172.21.15.49:0/617927038 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f98ec05f270 msgr2=0x7f98ec061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.054+0000 7f99119e6700 1 --2- 172.21.15.49:0/617927038 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f98ec05f270 0x7f98ec061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f98fc006fd0 tx=0x7f98fc008040).stop 2023-11-30T17:19:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.054+0000 7f99119e6700 1 -- 172.21.15.49:0/617927038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f990c1544e0 msgr2=0x7f990c0a8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.054+0000 7f99119e6700 1 --2- 172.21.15.49:0/617927038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f990c1544e0 0x7f990c0a8b60 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f990c05fb30 tx=0x7f9904009780).stop 2023-11-30T17:19:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.054+0000 7f99119e6700 1 -- 172.21.15.49:0/617927038 shutdown_connections 2023-11-30T17:19:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.054+0000 7f99119e6700 1 --2- 172.21.15.49:0/617927038 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f98ec05f270 0x7f98ec061730 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.054+0000 7f99119e6700 1 --2- 172.21.15.49:0/617927038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f990c1544e0 0x7f990c0a8b60 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.054+0000 7f99119e6700 1 --2- 172.21.15.49:0/617927038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f990c06a610 0x7f990c165130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.054+0000 7f99119e6700 1 --2- 172.21.15.49:0/617927038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f990c0c6e30 0x7f990c0a8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.054+0000 7f99119e6700 1 -- 172.21.15.49:0/617927038 >> 172.21.15.49:0/617927038 conn(0x7f990c085020 msgr2=0x7f990c0cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.054+0000 7f99119e6700 1 -- 172.21.15.49:0/617927038 shutdown_connections 2023-11-30T17:19:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.054+0000 7f99119e6700 1 -- 172.21.15.49:0/617927038 wait complete. 2023-11-30T17:19:49.067 INFO:tasks.cephfs_test_runner:Test concurrent snap creates in same file-system without db issues ... ok 2023-11-30T17:19:49.068 INFO:tasks.cephfs_test_runner:Starting test: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test exisitence of multiple scheduled snapshots 2023-11-30T17:19:49.068 INFO:tasks.cephfs_test_runner:test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-11-30T17:19:49.068 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-11-30T17:19:49.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.184+0000 7ff3353ad700 1 Processor -- start 2023-11-30T17:19:49.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.185+0000 7ff3353ad700 1 -- start start 2023-11-30T17:19:49.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.185+0000 7ff3353ad700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff330150890 0x7ff3300bbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:49.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.185+0000 7ff3353ad700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff3300bc320 0x7ff330069900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:49.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.185+0000 7ff3353ad700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff330069df0 0x7ff3301544f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:49.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.185+0000 7ff3353ad700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3300c28c0 con 0x7ff330069df0 2023-11-30T17:19:49.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.185+0000 7ff3353ad700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33006a240 con 0x7ff3300bc320 2023-11-30T17:19:49.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.185+0000 7ff3353ad700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3301552e0 con 0x7ff330150890 2023-11-30T17:19:49.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.186+0000 7ff32f7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff330069df0 0x7ff3301544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:49.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.186+0000 7ff32f7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff330069df0 0x7ff3301544f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53306/0 (socket says 172.21.15.49:53306) 2023-11-30T17:19:49.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.186+0000 7ff32f7fe700 1 -- 172.21.15.49:0/2954222761 learned_addr learned my addr 172.21.15.49:0/2954222761 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:49.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.186+0000 7ff32effd700 1 --2- 172.21.15.49:0/2954222761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff330150890 0x7ff3300bbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:49.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.186+0000 7ff32e7fc700 1 --2- 172.21.15.49:0/2954222761 >> v2:172.21.15.115:3300/0 conn(0x7ff3300bc320 0x7ff330069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:49.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.186+0000 7ff32f7fe700 1 -- 172.21.15.49:0/2954222761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff330150890 msgr2=0x7ff3300bbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:49.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.186+0000 7ff32f7fe700 1 --2- 172.21.15.49:0/2954222761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff330150890 0x7ff3300bbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:49.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.186+0000 7ff32f7fe700 1 -- 172.21.15.49:0/2954222761 >> v2:172.21.15.115:3300/0 conn(0x7ff3300bc320 msgr2=0x7ff330069900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:49.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.186+0000 7ff32f7fe700 1 --2- 172.21.15.49:0/2954222761 >> v2:172.21.15.115:3300/0 conn(0x7ff3300bc320 0x7ff330069900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:49.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.186+0000 7ff32f7fe700 1 -- 172.21.15.49:0/2954222761 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33006a4b0 con 0x7ff330069df0 2023-11-30T17:19:49.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.186+0000 7ff32f7fe700 1 --2- 172.21.15.49:0/2954222761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff330069df0 0x7ff3301544f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7ff3300685e0 tx=0x7ff3200090f0).ready entity=mon.0 client_cookie=fcfa67d44387968e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:49.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.186+0000 7ff32dffb700 1 -- 172.21.15.49:0/2954222761 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32000b600 con 0x7ff330069df0 2023-11-30T17:19:49.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.186+0000 7ff32dffb700 1 -- 172.21.15.49:0/2954222761 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32000b760 con 0x7ff330069df0 2023-11-30T17:19:49.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.186+0000 7ff32dffb700 1 -- 172.21.15.49:0/2954222761 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32000bae0 con 0x7ff330069df0 2023-11-30T17:19:49.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.187+0000 7ff3353ad700 1 -- 172.21.15.49:0/2954222761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff330069df0 msgr2=0x7ff3301544f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:49.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.187+0000 7ff3353ad700 1 --2- 172.21.15.49:0/2954222761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff330069df0 0x7ff3301544f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7ff3300685e0 tx=0x7ff3200090f0).stop 2023-11-30T17:19:49.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.187+0000 7ff3353ad700 1 -- 172.21.15.49:0/2954222761 shutdown_connections 2023-11-30T17:19:49.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.187+0000 7ff3353ad700 1 --2- 172.21.15.49:0/2954222761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff330150890 0x7ff3300bbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:49.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.187+0000 7ff3353ad700 1 --2- 172.21.15.49:0/2954222761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff330069df0 0x7ff3301544f0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:49.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.187+0000 7ff3353ad700 1 --2- 172.21.15.49:0/2954222761 >> v2:172.21.15.115:3300/0 conn(0x7ff3300bc320 0x7ff330069900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:49.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.187+0000 7ff3353ad700 1 -- 172.21.15.49:0/2954222761 >> 172.21.15.49:0/2954222761 conn(0x7ff3300631d0 msgr2=0x7ff3300c6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:49.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.187+0000 7ff3353ad700 1 -- 172.21.15.49:0/2954222761 shutdown_connections 2023-11-30T17:19:49.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.187+0000 7ff3353ad700 1 -- 172.21.15.49:0/2954222761 wait complete. 2023-11-30T17:19:49.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.188+0000 7ff3353ad700 1 Processor -- start 2023-11-30T17:19:49.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.188+0000 7ff3353ad700 1 -- start start 2023-11-30T17:19:49.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.189+0000 7ff3353ad700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff330069df0 0x7ff330167af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:49.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.189+0000 7ff3353ad700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3300bc320 0x7ff330167fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:49.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.189+0000 7ff3353ad700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff330150890 0x7ff3300c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:49.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.189+0000 7ff3353ad700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3301684d0 con 0x7ff330150890 2023-11-30T17:19:49.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.189+0000 7ff3353ad700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3300bf6f0 con 0x7ff3300bc320 2023-11-30T17:19:49.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.189+0000 7ff3353ad700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3300beb20 con 0x7ff330069df0 2023-11-30T17:19:49.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.189+0000 7ff32f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff330150890 0x7ff3300c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:49.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.189+0000 7ff32f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff330150890 0x7ff3300c6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53310/0 (socket says 172.21.15.49:53310) 2023-11-30T17:19:49.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.189+0000 7ff32f7fe700 1 -- 172.21.15.49:0/1396068389 learned_addr learned my addr 172.21.15.49:0/1396068389 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:49.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.189+0000 7ff32effd700 1 --2- 172.21.15.49:0/1396068389 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff330069df0 0x7ff330167af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:49.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.189+0000 7ff32e7fc700 1 --2- 172.21.15.49:0/1396068389 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3300bc320 0x7ff330167fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:49.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.189+0000 7ff32f7fe700 1 -- 172.21.15.49:0/1396068389 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff330069df0 msgr2=0x7ff330167af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:49.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.189+0000 7ff32f7fe700 1 --2- 172.21.15.49:0/1396068389 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff330069df0 0x7ff330167af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:49.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.189+0000 7ff32f7fe700 1 -- 172.21.15.49:0/1396068389 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3300bc320 msgr2=0x7ff330167fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:49.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.189+0000 7ff32f7fe700 1 --2- 172.21.15.49:0/1396068389 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3300bc320 0x7ff330167fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:49.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.189+0000 7ff32f7fe700 1 -- 172.21.15.49:0/1396068389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff320009370 con 0x7ff330150890 2023-11-30T17:19:49.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.189+0000 7ff32e7fc700 1 --2- 172.21.15.49:0/1396068389 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3300bc320 0x7ff330167fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:19:49.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.189+0000 7ff32effd700 1 --2- 172.21.15.49:0/1396068389 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff330069df0 0x7ff330167af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:19:49.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.189+0000 7ff32f7fe700 1 --2- 172.21.15.49:0/1396068389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff330150890 0x7ff3300c6e10 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7ff3300c7f00 tx=0x7ff320017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:49.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.190+0000 7ff326ffd700 1 -- 172.21.15.49:0/1396068389 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32000bae0 con 0x7ff330150890 2023-11-30T17:19:49.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.190+0000 7ff326ffd700 1 -- 172.21.15.49:0/1396068389 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32000bea0 con 0x7ff330150890 2023-11-30T17:19:49.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.190+0000 7ff3353ad700 1 -- 172.21.15.49:0/1396068389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3300bedc0 con 0x7ff330150890 2023-11-30T17:19:49.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.190+0000 7ff326ffd700 1 -- 172.21.15.49:0/1396068389 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32001b640 con 0x7ff330150890 2023-11-30T17:19:49.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.190+0000 7ff3353ad700 1 -- 172.21.15.49:0/1396068389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3300bf380 con 0x7ff330150890 2023-11-30T17:19:49.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.191+0000 7ff3353ad700 1 -- 172.21.15.49:0/1396068389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3300bf860 con 0x7ff330150890 2023-11-30T17:19:49.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.191+0000 7ff326ffd700 1 -- 172.21.15.49:0/1396068389 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff32001b9b0 con 0x7ff330150890 2023-11-30T17:19:49.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.191+0000 7ff326ffd700 1 --2- 172.21.15.49:0/1396068389 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff31005f270 0x7ff310061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:49.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.192+0000 7ff326ffd700 1 -- 172.21.15.49:0/1396068389 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6047+0+0 (secure 0 0 0) 0x7ff32007bd60 con 0x7ff330150890 2023-11-30T17:19:49.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.192+0000 7ff32effd700 1 --2- 172.21.15.49:0/1396068389 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff31005f270 0x7ff310061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:49.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.192+0000 7ff32effd700 1 --2- 172.21.15.49:0/1396068389 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff31005f270 0x7ff310061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7ff32800ae40 tx=0x7ff32800c040).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:49.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.196+0000 7ff326ffd700 1 -- 172.21.15.49:0/1396068389 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff32004cf00 con 0x7ff330150890 2023-11-30T17:19:49.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:49.437+0000 7ff3353ad700 1 -- 172.21.15.49:0/1396068389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7ff33006c860 con 0x7ff330150890 2023-11-30T17:19:50.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.053+0000 7ff326ffd700 1 -- 172.21.15.49:0/1396068389 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v443) v1 ==== 157+0+0 (secure 0 0 0) 0x7ff320050520 con 0x7ff330150890 2023-11-30T17:19:50.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.056+0000 7ff3353ad700 1 -- 172.21.15.49:0/1396068389 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff31005f270 msgr2=0x7ff310061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:50.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.056+0000 7ff3353ad700 1 --2- 172.21.15.49:0/1396068389 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff31005f270 0x7ff310061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7ff32800ae40 tx=0x7ff32800c040).stop 2023-11-30T17:19:50.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.056+0000 7ff3353ad700 1 -- 172.21.15.49:0/1396068389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff330150890 msgr2=0x7ff3300c6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:50.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.056+0000 7ff3353ad700 1 --2- 172.21.15.49:0/1396068389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff330150890 0x7ff3300c6e10 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7ff3300c7f00 tx=0x7ff320017000).stop 2023-11-30T17:19:50.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.056+0000 7ff3353ad700 1 -- 172.21.15.49:0/1396068389 shutdown_connections 2023-11-30T17:19:50.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.056+0000 7ff3353ad700 1 --2- 172.21.15.49:0/1396068389 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff31005f270 0x7ff310061730 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:50.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.056+0000 7ff3353ad700 1 --2- 172.21.15.49:0/1396068389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff330150890 0x7ff3300c6e10 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:50.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.056+0000 7ff3353ad700 1 --2- 172.21.15.49:0/1396068389 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff330069df0 0x7ff330167af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:50.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.056+0000 7ff3353ad700 1 --2- 172.21.15.49:0/1396068389 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3300bc320 0x7ff330167fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:50.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.056+0000 7ff3353ad700 1 -- 172.21.15.49:0/1396068389 >> 172.21.15.49:0/1396068389 conn(0x7ff3300631d0 msgr2=0x7ff3300a5090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:50.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.056+0000 7ff3353ad700 1 -- 172.21.15.49:0/1396068389 shutdown_connections 2023-11-30T17:19:50.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.056+0000 7ff3353ad700 1 -- 172.21.15.49:0/1396068389 wait complete. 2023-11-30T17:19:50.071 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-30T17:19:50.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.194+0000 7fd4a3de8700 1 Processor -- start 2023-11-30T17:19:50.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.194+0000 7fd4a3de8700 1 -- start start 2023-11-30T17:19:50.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.195+0000 7fd4a3de8700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd49c098d10 0x7fd49c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:50.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.195+0000 7fd4a3de8700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd49c158320 0x7fd49c1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:50.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.195+0000 7fd4a3de8700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd49c158cc0 con 0x7fd49c0c6190 2023-11-30T17:19:50.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.195+0000 7fd4a3de8700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd49c0c72d0 con 0x7fd49c098d10 2023-11-30T17:19:50.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.195+0000 7fd4a3de8700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd49c064570 con 0x7fd49c158320 2023-11-30T17:19:50.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.195+0000 7fd4a1b84700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd49c098d10 0x7fd49c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:50.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.195+0000 7fd4a1b84700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd49c098d10 0x7fd49c0c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53318/0 (socket says 172.21.15.49:53318) 2023-11-30T17:19:50.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.195+0000 7fd4a1b84700 1 -- 172.21.15.49:0/3866375243 learned_addr learned my addr 172.21.15.49:0/3866375243 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:50.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.195+0000 7fd4a2385700 1 --2- 172.21.15.49:0/3866375243 >> v2:172.21.15.115:3300/0 conn(0x7fd49c158320 0x7fd49c1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:50.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.196+0000 7fd4a1b84700 1 -- 172.21.15.49:0/3866375243 >> v2:172.21.15.115:3300/0 conn(0x7fd49c158320 msgr2=0x7fd49c1587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:50.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.196+0000 7fd4a1b84700 1 --2- 172.21.15.49:0/3866375243 >> v2:172.21.15.115:3300/0 conn(0x7fd49c158320 0x7fd49c1587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:50.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.196+0000 7fd4a1b84700 1 -- 172.21.15.49:0/3866375243 >> v1:172.21.15.115:6789/0 conn(0x7fd49c0c6190 legacy=0x7fd49c063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:50.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.196+0000 7fd4a1b84700 1 -- 172.21.15.49:0/3866375243 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49c154bc0 con 0x7fd49c098d10 2023-11-30T17:19:50.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.196+0000 7fd4a2385700 1 --2- 172.21.15.49:0/3866375243 >> v2:172.21.15.115:3300/0 conn(0x7fd49c158320 0x7fd49c1587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:19:50.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.196+0000 7fd4a1b84700 1 --2- 172.21.15.49:0/3866375243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd49c098d10 0x7fd49c0c7760 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7fd49c0657a0 tx=0x7fd4940090f0).ready entity=mon.0 client_cookie=e653b2a0689d824a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:50.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.196+0000 7fd4a0b82700 1 -- 172.21.15.49:0/3866375243 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49400b600 con 0x7fd49c098d10 2023-11-30T17:19:50.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.196+0000 7fd4a0b82700 1 -- 172.21.15.49:0/3866375243 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49400b760 con 0x7fd49c098d10 2023-11-30T17:19:50.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.196+0000 7fd4a0b82700 1 -- 172.21.15.49:0/3866375243 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49400bae0 con 0x7fd49c098d10 2023-11-30T17:19:50.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.196+0000 7fd4a3de8700 1 -- 172.21.15.49:0/3866375243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd49c098d10 msgr2=0x7fd49c0c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:50.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.196+0000 7fd4a3de8700 1 --2- 172.21.15.49:0/3866375243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd49c098d10 0x7fd49c0c7760 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7fd49c0657a0 tx=0x7fd4940090f0).stop 2023-11-30T17:19:50.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.196+0000 7fd4a3de8700 1 -- 172.21.15.49:0/3866375243 shutdown_connections 2023-11-30T17:19:50.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.196+0000 7fd4a3de8700 1 --2- 172.21.15.49:0/3866375243 >> v2:172.21.15.115:3300/0 conn(0x7fd49c158320 0x7fd49c1587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:50.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.196+0000 7fd4a3de8700 1 --2- 172.21.15.49:0/3866375243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd49c098d10 0x7fd49c0c7760 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:50.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.196+0000 7fd4a3de8700 1 -- 172.21.15.49:0/3866375243 >> 172.21.15.49:0/3866375243 conn(0x7fd49c0cb310 msgr2=0x7fd49c0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:50.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.197+0000 7fd4a3de8700 1 -- 172.21.15.49:0/3866375243 shutdown_connections 2023-11-30T17:19:50.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.197+0000 7fd4a3de8700 1 -- 172.21.15.49:0/3866375243 wait complete. 2023-11-30T17:19:50.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.198+0000 7fd4a3de8700 1 Processor -- start 2023-11-30T17:19:50.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.198+0000 7fd4a3de8700 1 -- start start 2023-11-30T17:19:50.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.198+0000 7fd4a3de8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd49c098d10 0x7fd49c0c23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:50.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.198+0000 7fd4a3de8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd49c0c6190 0x7fd49c14b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:50.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.198+0000 7fd4a3de8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd49c158320 0x7fd49c155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:50.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.198+0000 7fd4a3de8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c0c28a0 con 0x7fd49c158320 2023-11-30T17:19:50.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.198+0000 7fd4a3de8700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c156040 con 0x7fd49c0c6190 2023-11-30T17:19:50.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.198+0000 7fd4a3de8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c0ac300 con 0x7fd49c098d10 2023-11-30T17:19:50.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.199+0000 7fd4a2385700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd49c158320 0x7fd49c155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:50.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.199+0000 7fd4a2385700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd49c158320 0x7fd49c155760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53324/0 (socket says 172.21.15.49:53324) 2023-11-30T17:19:50.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.199+0000 7fd4a2385700 1 -- 172.21.15.49:0/4181363101 learned_addr learned my addr 172.21.15.49:0/4181363101 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:50.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.199+0000 7fd4a1383700 1 --2- 172.21.15.49:0/4181363101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd49c0c6190 0x7fd49c14b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:50.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.199+0000 7fd4a1b84700 1 --2- 172.21.15.49:0/4181363101 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd49c098d10 0x7fd49c0c23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:50.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.199+0000 7fd4a2385700 1 -- 172.21.15.49:0/4181363101 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd49c098d10 msgr2=0x7fd49c0c23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:50.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.199+0000 7fd4a2385700 1 --2- 172.21.15.49:0/4181363101 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd49c098d10 0x7fd49c0c23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:50.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.199+0000 7fd4a2385700 1 -- 172.21.15.49:0/4181363101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd49c0c6190 msgr2=0x7fd49c14b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:50.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.199+0000 7fd4a2385700 1 --2- 172.21.15.49:0/4181363101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd49c0c6190 0x7fd49c14b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:50.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.199+0000 7fd4a2385700 1 -- 172.21.15.49:0/4181363101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd494009370 con 0x7fd49c158320 2023-11-30T17:19:50.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.199+0000 7fd4a1383700 1 --2- 172.21.15.49:0/4181363101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd49c0c6190 0x7fd49c14b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:19:50.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.199+0000 7fd4a2385700 1 --2- 172.21.15.49:0/4181363101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd49c158320 0x7fd49c155760 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7fd48c00d100 tx=0x7fd48c0099b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:50.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.199+0000 7fd499ffb700 1 -- 172.21.15.49:0/4181363101 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c00dda0 con 0x7fd49c158320 2023-11-30T17:19:50.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.199+0000 7fd499ffb700 1 -- 172.21.15.49:0/4181363101 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48c00f040 con 0x7fd49c158320 2023-11-30T17:19:50.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.199+0000 7fd4a3de8700 1 -- 172.21.15.49:0/4181363101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd49c0ab740 con 0x7fd49c158320 2023-11-30T17:19:50.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.199+0000 7fd499ffb700 1 -- 172.21.15.49:0/4181363101 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c013600 con 0x7fd49c158320 2023-11-30T17:19:50.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.199+0000 7fd4a3de8700 1 -- 172.21.15.49:0/4181363101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd49c0abcb0 con 0x7fd49c158320 2023-11-30T17:19:50.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.201+0000 7fd499ffb700 1 -- 172.21.15.49:0/4181363101 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fd48c0139b0 con 0x7fd49c158320 2023-11-30T17:19:50.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.201+0000 7fd4a3de8700 1 -- 172.21.15.49:0/4181363101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd49c06c860 con 0x7fd49c158320 2023-11-30T17:19:50.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.201+0000 7fd499ffb700 1 --2- 172.21.15.49:0/4181363101 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd48805f270 0x7fd488061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:50.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.201+0000 7fd499ffb700 1 -- 172.21.15.49:0/4181363101 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fd48c07aa50 con 0x7fd49c158320 2023-11-30T17:19:50.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.201+0000 7fd4a1b84700 1 --2- 172.21.15.49:0/4181363101 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd48805f270 0x7fd488061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:50.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.202+0000 7fd4a1b84700 1 --2- 172.21.15.49:0/4181363101 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd48805f270 0x7fd488061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fd494009130 tx=0x7fd494017000).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:50.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.205+0000 7fd499ffb700 1 -- 172.21.15.49:0/4181363101 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd48c04bb90 con 0x7fd49c158320 2023-11-30T17:19:50.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.376+0000 7fd4a3de8700 1 -- 172.21.15.49:0/4181363101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd49c0c66c0 con 0x7fd49c158320 2023-11-30T17:19:50.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.380+0000 7fd499ffb700 1 -- 172.21.15.49:0/4181363101 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd48c04f1b0 con 0x7fd49c158320 2023-11-30T17:19:50.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.382+0000 7fd4a3de8700 1 -- 172.21.15.49:0/4181363101 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd48805f270 msgr2=0x7fd488061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:50.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.382+0000 7fd4a3de8700 1 --2- 172.21.15.49:0/4181363101 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd48805f270 0x7fd488061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fd494009130 tx=0x7fd494017000).stop 2023-11-30T17:19:50.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.382+0000 7fd4a3de8700 1 -- 172.21.15.49:0/4181363101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd49c158320 msgr2=0x7fd49c155760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:50.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.382+0000 7fd4a3de8700 1 --2- 172.21.15.49:0/4181363101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd49c158320 0x7fd49c155760 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7fd48c00d100 tx=0x7fd48c0099b0).stop 2023-11-30T17:19:50.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.382+0000 7fd4a3de8700 1 -- 172.21.15.49:0/4181363101 shutdown_connections 2023-11-30T17:19:50.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.382+0000 7fd4a3de8700 1 --2- 172.21.15.49:0/4181363101 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd48805f270 0x7fd488061730 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:50.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.382+0000 7fd4a3de8700 1 --2- 172.21.15.49:0/4181363101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd49c158320 0x7fd49c155760 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:50.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.382+0000 7fd4a3de8700 1 --2- 172.21.15.49:0/4181363101 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd49c098d10 0x7fd49c0c23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:50.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.382+0000 7fd4a3de8700 1 --2- 172.21.15.49:0/4181363101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd49c0c6190 0x7fd49c14b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:50.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.382+0000 7fd4a3de8700 1 -- 172.21.15.49:0/4181363101 >> 172.21.15.49:0/4181363101 conn(0x7fd49c0cb310 msgr2=0x7fd49c14c060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:50.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.382+0000 7fd4a3de8700 1 -- 172.21.15.49:0/4181363101 shutdown_connections 2023-11-30T17:19:50.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.382+0000 7fd4a3de8700 1 -- 172.21.15.49:0/4181363101 wait complete. 2023-11-30T17:19:50.395 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-30T17:19:50.395 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T17:19:50.432 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T17:19:50.482 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-30T17:19:50.482 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-30T17:19:50.482 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:19:50.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.598+0000 7fc9afeb6700 1 Processor -- start 2023-11-30T17:19:50.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.598+0000 7fc9afeb6700 1 -- start start 2023-11-30T17:19:50.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.599+0000 7fc9afeb6700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc9a81544e0 0x7fc9a81548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:50.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.599+0000 7fc9afeb6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9a80c6e30 0x7fc9a80c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:50.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.599+0000 7fc9afeb6700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a80c69a0 con 0x7fc9a806a610 2023-11-30T17:19:50.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.599+0000 7fc9afeb6700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a80c13a0 con 0x7fc9a81544e0 2023-11-30T17:19:50.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.599+0000 7fc9afeb6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a80c1680 con 0x7fc9a80c6e30 2023-11-30T17:19:50.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.600+0000 7fc9adc52700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc9a81544e0 0x7fc9a81548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:50.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.600+0000 7fc9ae453700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9a80c6e30 0x7fc9a80c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:50.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.600+0000 7fc9adc52700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc9a81544e0 0x7fc9a81548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:34382/0 (socket says 172.21.15.49:34382) 2023-11-30T17:19:50.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.600+0000 7fc9ae453700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9a80c6e30 0x7fc9a80c72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:50744/0 (socket says 172.21.15.49:50744) 2023-11-30T17:19:50.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.600+0000 7fc9ad451700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc9a806a610 0x7fc9a80c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:42106/0 (socket says 172.21.15.49:42106) 2023-11-30T17:19:50.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.600+0000 7fc9adc52700 1 -- 172.21.15.49:0/3051747295 learned_addr learned my addr 172.21.15.49:0/3051747295 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:50.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.600+0000 7fc9adc52700 1 -- 172.21.15.49:0/3051747295 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9a80c6e30 msgr2=0x7fc9a80c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:50.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.600+0000 7fc9adc52700 1 --2- 172.21.15.49:0/3051747295 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9a80c6e30 0x7fc9a80c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:50.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.600+0000 7fc9adc52700 1 -- 172.21.15.49:0/3051747295 >> v1:172.21.15.115:6789/0 conn(0x7fc9a806a610 legacy=0x7fc9a80c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:50.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.600+0000 7fc9adc52700 1 -- 172.21.15.49:0/3051747295 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a80c6630 con 0x7fc9a81544e0 2023-11-30T17:19:50.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.600+0000 7fc9ae453700 1 --2- 172.21.15.49:0/3051747295 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9a80c6e30 0x7fc9a80c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:19:50.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.600+0000 7fc9acc50700 1 -- 172.21.15.49:0/3051747295 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3447172356 0 0) 0x7fc9a80c69a0 con 0x7fc9a806a610 2023-11-30T17:19:50.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.600+0000 7fc9adc52700 1 --2- 172.21.15.49:0/3051747295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9a81544e0 0x7fc9a81548c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fc9a0009810 tx=0x7fc9a0009060).ready entity=mon.1 client_cookie=3eb166d5e6e7ff77 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:50.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.601+0000 7fc9acc50700 1 -- 172.21.15.49:0/3051747295 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0005880 con 0x7fc9a81544e0 2023-11-30T17:19:50.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.601+0000 7fc9acc50700 1 -- 172.21.15.49:0/3051747295 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a00059e0 con 0x7fc9a81544e0 2023-11-30T17:19:50.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.601+0000 7fc9acc50700 1 -- 172.21.15.49:0/3051747295 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0005d60 con 0x7fc9a81544e0 2023-11-30T17:19:50.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.601+0000 7fc9afeb6700 1 -- 172.21.15.49:0/3051747295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9a81544e0 msgr2=0x7fc9a81548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:50.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.601+0000 7fc9afeb6700 1 --2- 172.21.15.49:0/3051747295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9a81544e0 0x7fc9a81548c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fc9a0009810 tx=0x7fc9a0009060).stop 2023-11-30T17:19:50.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.601+0000 7fc9afeb6700 1 -- 172.21.15.49:0/3051747295 shutdown_connections 2023-11-30T17:19:50.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.601+0000 7fc9afeb6700 1 --2- 172.21.15.49:0/3051747295 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9a80c6e30 0x7fc9a80c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:50.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.601+0000 7fc9afeb6700 1 --2- 172.21.15.49:0/3051747295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9a81544e0 0x7fc9a81548c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:50.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.601+0000 7fc9afeb6700 1 -- 172.21.15.49:0/3051747295 >> 172.21.15.49:0/3051747295 conn(0x7fc9a8085020 msgr2=0x7fc9a8094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:50.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.601+0000 7fc9afeb6700 1 -- 172.21.15.49:0/3051747295 shutdown_connections 2023-11-30T17:19:50.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.601+0000 7fc9afeb6700 1 -- 172.21.15.49:0/3051747295 wait complete. 2023-11-30T17:19:50.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.602+0000 7fc9afeb6700 1 Processor -- start 2023-11-30T17:19:50.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.602+0000 7fc9afeb6700 1 -- start start 2023-11-30T17:19:50.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.603+0000 7fc9afeb6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9a806a610 0x7fc9a80ad7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:50.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.603+0000 7fc9afeb6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9a80c6e30 0x7fc9a8096910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:50.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.603+0000 7fc9afeb6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9a81544e0 0x7fc9a8098360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:50.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.603+0000 7fc9afeb6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a8097ed0 con 0x7fc9a80c6e30 2023-11-30T17:19:50.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.603+0000 7fc9afeb6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a80972c0 con 0x7fc9a81544e0 2023-11-30T17:19:50.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.603+0000 7fc9afeb6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a80975a0 con 0x7fc9a806a610 2023-11-30T17:19:50.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.603+0000 7fc9ad451700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9a80c6e30 0x7fc9a8096910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:50.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.603+0000 7fc9ad451700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9a80c6e30 0x7fc9a8096910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58918/0 (socket says 172.21.15.49:58918) 2023-11-30T17:19:50.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.603+0000 7fc9ad451700 1 -- 172.21.15.49:0/242524834 learned_addr learned my addr 172.21.15.49:0/242524834 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:50.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.603+0000 7fc9adc52700 1 --2- 172.21.15.49:0/242524834 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9a806a610 0x7fc9a80ad7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:50.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.603+0000 7fc9ae453700 1 --2- 172.21.15.49:0/242524834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9a81544e0 0x7fc9a8098360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:50.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.604+0000 7fc9ad451700 1 -- 172.21.15.49:0/242524834 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9a806a610 msgr2=0x7fc9a80ad7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:50.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.604+0000 7fc9ad451700 1 --2- 172.21.15.49:0/242524834 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9a806a610 0x7fc9a80ad7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:50.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.604+0000 7fc9ad451700 1 -- 172.21.15.49:0/242524834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9a81544e0 msgr2=0x7fc9a8098360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:50.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.604+0000 7fc9ad451700 1 --2- 172.21.15.49:0/242524834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9a81544e0 0x7fc9a8098360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:50.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.604+0000 7fc9ad451700 1 -- 172.21.15.49:0/242524834 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc998009a20 con 0x7fc9a80c6e30 2023-11-30T17:19:50.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.604+0000 7fc9adc52700 1 --2- 172.21.15.49:0/242524834 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9a806a610 0x7fc9a80ad7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:19:50.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.604+0000 7fc9ad451700 1 --2- 172.21.15.49:0/242524834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9a80c6e30 0x7fc9a8096910 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7fc99c00c490 tx=0x7fc99c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:50.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.604+0000 7fc9a5ffb700 1 -- 172.21.15.49:0/242524834 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c0072e0 con 0x7fc9a80c6e30 2023-11-30T17:19:50.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.604+0000 7fc9a5ffb700 1 -- 172.21.15.49:0/242524834 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99c007440 con 0x7fc9a80c6e30 2023-11-30T17:19:50.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.604+0000 7fc9a5ffb700 1 -- 172.21.15.49:0/242524834 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c005930 con 0x7fc9a80c6e30 2023-11-30T17:19:50.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.604+0000 7fc9afeb6700 1 -- 172.21.15.49:0/242524834 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a0009300 con 0x7fc9a80c6e30 2023-11-30T17:19:50.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.604+0000 7fc9afeb6700 1 -- 172.21.15.49:0/242524834 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a8097b60 con 0x7fc9a80c6e30 2023-11-30T17:19:50.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.605+0000 7fc9afeb6700 1 -- 172.21.15.49:0/242524834 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a8098040 con 0x7fc9a80c6e30 2023-11-30T17:19:50.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.605+0000 7fc9a5ffb700 1 -- 172.21.15.49:0/242524834 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc99c005ce0 con 0x7fc9a80c6e30 2023-11-30T17:19:50.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.606+0000 7fc9a5ffb700 1 --2- 172.21.15.49:0/242524834 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc99405f270 0x7fc994061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:50.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.606+0000 7fc9a5ffb700 1 -- 172.21.15.49:0/242524834 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fc99c079af0 con 0x7fc9a80c6e30 2023-11-30T17:19:50.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.606+0000 7fc9adc52700 1 --2- 172.21.15.49:0/242524834 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc99405f270 0x7fc994061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:50.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.606+0000 7fc9adc52700 1 --2- 172.21.15.49:0/242524834 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc99405f270 0x7fc994061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fc9a000b340 tx=0x7fc9a0016000).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:50.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.610+0000 7fc9a5ffb700 1 -- 172.21.15.49:0/242524834 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc99c04ac90 con 0x7fc9a80c6e30 2023-11-30T17:19:50.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.823+0000 7fc9afeb6700 1 -- 172.21.15.49:0/242524834 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9a80c6250 con 0x7fc9a80c6e30 2023-11-30T17:19:50.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.823+0000 7fc9a5ffb700 1 -- 172.21.15.49:0/242524834 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fc99c04e2b0 con 0x7fc9a80c6e30 2023-11-30T17:19:50.825 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:19:50.825 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1260333970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1260333970},{"type":"v1","addr":"172.21.15.115:6836","nonce":1260333970}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4938,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/2286472783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2286472783},{"type":"v1","addr":"172.21.15.49:6834","nonce":2286472783}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4941,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1299033463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1299033463},{"type":"v1","addr":"172.21.15.49:6835","nonce":1299033463}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/570376079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":570376079},{"type":"v1","addr":"172.21.15.115:6837","nonce":570376079}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[]} 2023-11-30T17:19:50.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.825+0000 7fc9afeb6700 1 -- 172.21.15.49:0/242524834 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc99405f270 msgr2=0x7fc994061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:50.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.825+0000 7fc9afeb6700 1 --2- 172.21.15.49:0/242524834 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc99405f270 0x7fc994061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fc9a000b340 tx=0x7fc9a0016000).stop 2023-11-30T17:19:50.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.825+0000 7fc9afeb6700 1 -- 172.21.15.49:0/242524834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9a80c6e30 msgr2=0x7fc9a8096910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:50.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.825+0000 7fc9afeb6700 1 --2- 172.21.15.49:0/242524834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9a80c6e30 0x7fc9a8096910 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7fc99c00c490 tx=0x7fc99c007e00).stop 2023-11-30T17:19:50.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.825+0000 7fc9afeb6700 1 -- 172.21.15.49:0/242524834 shutdown_connections 2023-11-30T17:19:50.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.825+0000 7fc9afeb6700 1 --2- 172.21.15.49:0/242524834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9a81544e0 0x7fc9a8098360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:50.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.825+0000 7fc9afeb6700 1 --2- 172.21.15.49:0/242524834 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9a806a610 0x7fc9a80ad7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:50.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.825+0000 7fc9afeb6700 1 --2- 172.21.15.49:0/242524834 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc99405f270 0x7fc994061730 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:50.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.825+0000 7fc9afeb6700 1 --2- 172.21.15.49:0/242524834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9a80c6e30 0x7fc9a8096910 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:50.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.825+0000 7fc9afeb6700 1 -- 172.21.15.49:0/242524834 >> 172.21.15.49:0/242524834 conn(0x7fc9a8085020 msgr2=0x7fc9a80ca8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:50.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.825+0000 7fc9afeb6700 1 -- 172.21.15.49:0/242524834 shutdown_connections 2023-11-30T17:19:50.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:50.825+0000 7fc9afeb6700 1 -- 172.21.15.49:0/242524834 wait complete. 2023-11-30T17:19:50.828 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 18 2023-11-30T17:19:50.839 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-30T17:19:50.839 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-30T17:19:50.839 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-30T17:19:50.840 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T17:19:50.840 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-30T17:19:50.840 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-30T17:19:50.840 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-30T17:19:50.840 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T17:19:50.840 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-30T17:19:50.840 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-30T17:19:50.841 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-30T17:19:50.841 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T17:19:50.841 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-30T17:19:50.841 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-30T17:19:50.841 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-30T17:19:50.841 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T17:19:50.851 INFO:tasks.ceph.mds.a:Stopped 2023-11-30T17:19:50.851 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-30T17:19:50.852 INFO:tasks.ceph.mds.c:Stopped 2023-11-30T17:19:50.852 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-30T17:19:50.854 INFO:tasks.ceph.mds.b:Stopped 2023-11-30T17:19:50.855 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-30T17:19:50.855 INFO:tasks.ceph.mds.d:Stopped 2023-11-30T17:19:50.855 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-30T17:19:50.861 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:19:50.893 INFO:tasks.ceph.mds.a:Started 2023-11-30T17:19:50.894 DEBUG:teuthology.parallel:result is None 2023-11-30T17:19:50.894 INFO:tasks.ceph.mds.c:Started 2023-11-30T17:19:50.895 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:19:50.895 DEBUG:teuthology.parallel:result is None 2023-11-30T17:19:50.898 INFO:tasks.ceph.mds.b:Started 2023-11-30T17:19:50.898 DEBUG:teuthology.parallel:result is None 2023-11-30T17:19:50.899 INFO:tasks.ceph.mds.d:Started 2023-11-30T17:19:50.899 DEBUG:teuthology.parallel:result is None 2023-11-30T17:19:50.900 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-30T17:19:50.969 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-11-30T17:19:50.969 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-11-30T17:19:50.981 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-11-30T17:19:50.982 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-11-30T17:19:51.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.060+0000 7ff687393700 1 Processor -- start 2023-11-30T17:19:51.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.061+0000 7ff687393700 1 -- start start 2023-11-30T17:19:51.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.061+0000 7ff687393700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff680098d10 0x7ff6800c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:51.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.062+0000 7ff687393700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff680158320 0x7ff6801587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:51.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.062+0000 7ff687393700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff680158cc0 con 0x7ff6800c6190 2023-11-30T17:19:51.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.062+0000 7ff687393700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6800c72d0 con 0x7ff680158320 2023-11-30T17:19:51.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.062+0000 7ff687393700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff680064570 con 0x7ff680098d10 2023-11-30T17:19:51.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.062+0000 7ff685930700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff680158320 0x7ff6801587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:51.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.062+0000 7ff685930700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff680158320 0x7ff6801587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58950/0 (socket says 172.21.15.49:58950) 2023-11-30T17:19:51.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.062+0000 7ff685930700 1 -- 172.21.15.49:0/1638030669 learned_addr learned my addr 172.21.15.49:0/1638030669 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:51.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.062+0000 7ff68512f700 1 --2- 172.21.15.49:0/1638030669 >> v2:172.21.15.115:3300/0 conn(0x7ff680098d10 0x7ff6800c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:51.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.062+0000 7ff685930700 1 -- 172.21.15.49:0/1638030669 >> v2:172.21.15.115:3300/0 conn(0x7ff680098d10 msgr2=0x7ff6800c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:51.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.062+0000 7ff685930700 1 --2- 172.21.15.49:0/1638030669 >> v2:172.21.15.115:3300/0 conn(0x7ff680098d10 0x7ff6800c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:51.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.062+0000 7ff685930700 1 -- 172.21.15.49:0/1638030669 >> v1:172.21.15.115:6789/0 conn(0x7ff6800c6190 legacy=0x7ff680063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:51.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.062+0000 7ff685930700 1 -- 172.21.15.49:0/1638030669 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff680154bc0 con 0x7ff680158320 2023-11-30T17:19:51.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.062+0000 7ff685930700 1 --2- 172.21.15.49:0/1638030669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff680158320 0x7ff6801587d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7ff680083f80 tx=0x7ff678009840).ready entity=mon.0 client_cookie=6295e71cb49a111b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:51.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.062+0000 7ff673fff700 1 -- 172.21.15.49:0/1638030669 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67800e070 con 0x7ff680158320 2023-11-30T17:19:51.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.062+0000 7ff673fff700 1 -- 172.21.15.49:0/1638030669 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67800ba20 con 0x7ff680158320 2023-11-30T17:19:51.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.062+0000 7ff673fff700 1 -- 172.21.15.49:0/1638030669 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67800bda0 con 0x7ff680158320 2023-11-30T17:19:51.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.063+0000 7ff687393700 1 -- 172.21.15.49:0/1638030669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff680158320 msgr2=0x7ff6801587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:51.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.063+0000 7ff687393700 1 --2- 172.21.15.49:0/1638030669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff680158320 0x7ff6801587d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7ff680083f80 tx=0x7ff678009840).stop 2023-11-30T17:19:51.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.063+0000 7ff687393700 1 -- 172.21.15.49:0/1638030669 shutdown_connections 2023-11-30T17:19:51.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.063+0000 7ff687393700 1 --2- 172.21.15.49:0/1638030669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff680158320 0x7ff6801587d0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:51.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.063+0000 7ff687393700 1 --2- 172.21.15.49:0/1638030669 >> v2:172.21.15.115:3300/0 conn(0x7ff680098d10 0x7ff6800c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:51.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.063+0000 7ff687393700 1 -- 172.21.15.49:0/1638030669 >> 172.21.15.49:0/1638030669 conn(0x7ff6800cb310 msgr2=0x7ff6800cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:51.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.063+0000 7ff687393700 1 -- 172.21.15.49:0/1638030669 shutdown_connections 2023-11-30T17:19:51.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.063+0000 7ff687393700 1 -- 172.21.15.49:0/1638030669 wait complete. 2023-11-30T17:19:51.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.064+0000 7ff687393700 1 Processor -- start 2023-11-30T17:19:51.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.064+0000 7ff687393700 1 -- start start 2023-11-30T17:19:51.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.065+0000 7ff687393700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff680098d10 0x7ff6800af300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:51.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.065+0000 7ff687393700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6800c6190 0x7ff680148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:51.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.065+0000 7ff687393700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff680158320 0x7ff680155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:51.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.065+0000 7ff687393700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800af7f0 con 0x7ff6800c6190 2023-11-30T17:19:51.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.065+0000 7ff687393700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6801561e0 con 0x7ff680158320 2023-11-30T17:19:51.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.065+0000 7ff687393700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800c2450 con 0x7ff680098d10 2023-11-30T17:19:51.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.065+0000 7ff68492e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6800c6190 0x7ff680148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:51.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.065+0000 7ff68492e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6800c6190 0x7ff680148b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58960/0 (socket says 172.21.15.49:58960) 2023-11-30T17:19:51.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.065+0000 7ff68492e700 1 -- 172.21.15.49:0/173969796 learned_addr learned my addr 172.21.15.49:0/173969796 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:51.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.065+0000 7ff685930700 1 --2- 172.21.15.49:0/173969796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff680158320 0x7ff680155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:51.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.065+0000 7ff68512f700 1 --2- 172.21.15.49:0/173969796 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff680098d10 0x7ff6800af300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:51.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.066+0000 7ff68492e700 1 -- 172.21.15.49:0/173969796 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff680098d10 msgr2=0x7ff6800af300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:51.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.066+0000 7ff68492e700 1 --2- 172.21.15.49:0/173969796 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff680098d10 0x7ff6800af300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:51.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.066+0000 7ff68492e700 1 -- 172.21.15.49:0/173969796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff680158320 msgr2=0x7ff680155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:51.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.066+0000 7ff68492e700 1 --2- 172.21.15.49:0/173969796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff680158320 0x7ff680155720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:51.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.066+0000 7ff68492e700 1 -- 172.21.15.49:0/173969796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff678009ae0 con 0x7ff6800c6190 2023-11-30T17:19:51.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.066+0000 7ff68492e700 1 --2- 172.21.15.49:0/173969796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6800c6190 0x7ff680148b20 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7ff67400c4c0 tx=0x7ff674007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:51.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.066+0000 7ff6717fa700 1 -- 172.21.15.49:0/173969796 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67400ce10 con 0x7ff6800c6190 2023-11-30T17:19:51.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.066+0000 7ff6717fa700 1 -- 172.21.15.49:0/173969796 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff674007020 con 0x7ff6800c6190 2023-11-30T17:19:51.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.066+0000 7ff687393700 1 -- 172.21.15.49:0/173969796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6800c2730 con 0x7ff6800c6190 2023-11-30T17:19:51.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.066+0000 7ff6717fa700 1 -- 172.21.15.49:0/173969796 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6740073c0 con 0x7ff6800c6190 2023-11-30T17:19:51.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.066+0000 7ff687393700 1 -- 172.21.15.49:0/173969796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6800c2cf0 con 0x7ff6800c6190 2023-11-30T17:19:51.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.067+0000 7ff687393700 1 -- 172.21.15.49:0/173969796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6800c2f10 con 0x7ff6800c6190 2023-11-30T17:19:51.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.067+0000 7ff6717fa700 1 -- 172.21.15.49:0/173969796 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff6740068b0 con 0x7ff6800c6190 2023-11-30T17:19:51.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.068+0000 7ff6717fa700 1 --2- 172.21.15.49:0/173969796 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff66405f270 0x7ff664061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:51.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.068+0000 7ff6717fa700 1 -- 172.21.15.49:0/173969796 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5699+0+0 (secure 0 0 0) 0x7ff674079350 con 0x7ff6800c6190 2023-11-30T17:19:51.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.068+0000 7ff68512f700 1 --2- 172.21.15.49:0/173969796 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff66405f270 0x7ff664061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:51.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.068+0000 7ff68512f700 1 --2- 172.21.15.49:0/173969796 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff66405f270 0x7ff664061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7ff67c009c30 tx=0x7ff67c009060).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:51.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.072+0000 7ff6717fa700 1 -- 172.21.15.49:0/173969796 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff674047b00 con 0x7ff6800c6190 2023-11-30T17:19:51.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:51.260+0000 7ff687393700 1 -- 172.21.15.49:0/173969796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff680158cc0 con 0x7ff6800c6190 2023-11-30T17:19:52.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.059+0000 7ff6717fa700 1 -- 172.21.15.49:0/173969796 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v61) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff680158cc0 con 0x7ff6800c6190 2023-11-30T17:19:52.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.062+0000 7ff687393700 1 -- 172.21.15.49:0/173969796 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff66405f270 msgr2=0x7ff664061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:52.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.062+0000 7ff687393700 1 --2- 172.21.15.49:0/173969796 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff66405f270 0x7ff664061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7ff67c009c30 tx=0x7ff67c009060).stop 2023-11-30T17:19:52.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.062+0000 7ff687393700 1 -- 172.21.15.49:0/173969796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6800c6190 msgr2=0x7ff680148b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:52.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.062+0000 7ff687393700 1 --2- 172.21.15.49:0/173969796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6800c6190 0x7ff680148b20 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7ff67400c4c0 tx=0x7ff674007dd0).stop 2023-11-30T17:19:52.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.062+0000 7ff687393700 1 -- 172.21.15.49:0/173969796 shutdown_connections 2023-11-30T17:19:52.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.062+0000 7ff687393700 1 --2- 172.21.15.49:0/173969796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff680158320 0x7ff680155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:52.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.062+0000 7ff687393700 1 --2- 172.21.15.49:0/173969796 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff680098d10 0x7ff6800af300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:52.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.062+0000 7ff687393700 1 --2- 172.21.15.49:0/173969796 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff66405f270 0x7ff664061730 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:52.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.062+0000 7ff687393700 1 --2- 172.21.15.49:0/173969796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6800c6190 0x7ff680148b20 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:52.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.062+0000 7ff687393700 1 -- 172.21.15.49:0/173969796 >> 172.21.15.49:0/173969796 conn(0x7ff6800cb310 msgr2=0x7ff680159480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:52.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.062+0000 7ff687393700 1 -- 172.21.15.49:0/173969796 shutdown_connections 2023-11-30T17:19:52.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.062+0000 7ff687393700 1 -- 172.21.15.49:0/173969796 wait complete. 2023-11-30T17:19:52.065 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2023-11-30T17:19:52.079 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-30T17:19:52.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.244+0000 7f8da2808700 1 Processor -- start 2023-11-30T17:19:52.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.244+0000 7f8da2808700 1 -- start start 2023-11-30T17:19:52.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.244+0000 7f8da2808700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d9c1544e0 0x7f8d9c1548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:52.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.244+0000 7f8da2808700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8d9c0c6e30 0x7f8d9c0c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:52.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.244+0000 7f8da2808700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d9c0c69a0 con 0x7f8d9c06a610 2023-11-30T17:19:52.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.244+0000 7f8da2808700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d9c0c13a0 con 0x7f8d9c0c6e30 2023-11-30T17:19:52.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.244+0000 7f8da2808700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c0c1680 con 0x7f8d9c1544e0 2023-11-30T17:19:52.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.245+0000 7f8d9bfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d9c1544e0 0x7f8d9c1548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:52.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.245+0000 7f8da0da5700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8d9c0c6e30 0x7f8d9c0c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:52.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.245+0000 7f8d9bfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d9c1544e0 0x7f8d9c1548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:50794/0 (socket says 172.21.15.49:50794) 2023-11-30T17:19:52.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.245+0000 7f8d9bfff700 1 -- 172.21.15.49:0/1951686490 learned_addr learned my addr 172.21.15.49:0/1951686490 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:52.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.245+0000 7f8d9b7fe700 1 --1- 172.21.15.49:0/1951686490 >> v1:172.21.15.115:6789/0 conn(0x7f8d9c06a610 0x7f8d9c0c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:42130/0 (socket says 172.21.15.49:42130) 2023-11-30T17:19:52.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.245+0000 7f8d9bfff700 1 -- 172.21.15.49:0/1951686490 >> v2:172.21.15.115:3300/0 conn(0x7f8d9c0c6e30 msgr2=0x7f8d9c0c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:52.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.245+0000 7f8d9bfff700 1 --2- 172.21.15.49:0/1951686490 >> v2:172.21.15.115:3300/0 conn(0x7f8d9c0c6e30 0x7f8d9c0c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:52.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.245+0000 7f8d9bfff700 1 -- 172.21.15.49:0/1951686490 >> v1:172.21.15.115:6789/0 conn(0x7f8d9c06a610 legacy=0x7f8d9c0c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:52.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.245+0000 7f8d9affd700 1 -- 172.21.15.49:0/1951686490 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1338537854 0 0) 0x7f8d9c0c69a0 con 0x7f8d9c06a610 2023-11-30T17:19:52.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.245+0000 7f8d9bfff700 1 -- 172.21.15.49:0/1951686490 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9c0c6630 con 0x7f8d9c1544e0 2023-11-30T17:19:52.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.245+0000 7f8da0da5700 1 --2- 172.21.15.49:0/1951686490 >> v2:172.21.15.115:3300/0 conn(0x7f8d9c0c6e30 0x7f8d9c0c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:19:52.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.245+0000 7f8d9bfff700 1 --2- 172.21.15.49:0/1951686490 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d9c1544e0 0x7f8d9c1548c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f8d8c009810 tx=0x7f8d8c009060).ready entity=mon.2 client_cookie=8b96b08e75ea4f6b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:52.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.246+0000 7f8d9affd700 1 -- 172.21.15.49:0/1951686490 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c005880 con 0x7f8d9c1544e0 2023-11-30T17:19:52.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.246+0000 7f8d9affd700 1 -- 172.21.15.49:0/1951686490 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8c0059e0 con 0x7f8d9c1544e0 2023-11-30T17:19:52.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.246+0000 7f8d9affd700 1 -- 172.21.15.49:0/1951686490 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c005d60 con 0x7f8d9c1544e0 2023-11-30T17:19:52.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.246+0000 7f8da2808700 1 -- 172.21.15.49:0/1951686490 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d9c1544e0 msgr2=0x7f8d9c1548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:52.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.246+0000 7f8da2808700 1 --2- 172.21.15.49:0/1951686490 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d9c1544e0 0x7f8d9c1548c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f8d8c009810 tx=0x7f8d8c009060).stop 2023-11-30T17:19:52.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.246+0000 7f8da2808700 1 -- 172.21.15.49:0/1951686490 shutdown_connections 2023-11-30T17:19:52.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.246+0000 7f8da2808700 1 --2- 172.21.15.49:0/1951686490 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d9c1544e0 0x7f8d9c1548c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:52.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.246+0000 7f8da2808700 1 --2- 172.21.15.49:0/1951686490 >> v2:172.21.15.115:3300/0 conn(0x7f8d9c0c6e30 0x7f8d9c0c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:52.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.246+0000 7f8da2808700 1 -- 172.21.15.49:0/1951686490 >> 172.21.15.49:0/1951686490 conn(0x7f8d9c085020 msgr2=0x7f8d9c094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:52.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.246+0000 7f8da2808700 1 -- 172.21.15.49:0/1951686490 shutdown_connections 2023-11-30T17:19:52.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.246+0000 7f8da2808700 1 -- 172.21.15.49:0/1951686490 wait complete. 2023-11-30T17:19:52.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.247+0000 7f8da2808700 1 Processor -- start 2023-11-30T17:19:52.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.247+0000 7f8da2808700 1 -- start start 2023-11-30T17:19:52.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.248+0000 7f8da2808700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d9c06a610 0x7f8d9c164260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:52.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.248+0000 7f8da2808700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d9c0c6e30 0x7f8d9c167ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:52.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.248+0000 7f8da2808700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d9c1544e0 0x7f8d9c168390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:52.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.248+0000 7f8da2808700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c168880 con 0x7f8d9c0c6e30 2023-11-30T17:19:52.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.248+0000 7f8da2808700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c153900 con 0x7f8d9c1544e0 2023-11-30T17:19:52.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.248+0000 7f8da2808700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c0ad2d0 con 0x7f8d9c06a610 2023-11-30T17:19:52.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.248+0000 7f8d9b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d9c0c6e30 0x7f8d9c167ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:52.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.248+0000 7f8d9b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d9c0c6e30 0x7f8d9c167ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58976/0 (socket says 172.21.15.49:58976) 2023-11-30T17:19:52.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.248+0000 7f8d9b7fe700 1 -- 172.21.15.49:0/3315908621 learned_addr learned my addr 172.21.15.49:0/3315908621 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:52.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.248+0000 7f8d9bfff700 1 --2- 172.21.15.49:0/3315908621 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d9c06a610 0x7f8d9c164260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:52.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.248+0000 7f8da0da5700 1 --2- 172.21.15.49:0/3315908621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d9c1544e0 0x7f8d9c168390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:52.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.249+0000 7f8d9b7fe700 1 -- 172.21.15.49:0/3315908621 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d9c06a610 msgr2=0x7f8d9c164260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:52.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.249+0000 7f8d9b7fe700 1 --2- 172.21.15.49:0/3315908621 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d9c06a610 0x7f8d9c164260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:52.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.249+0000 7f8d9b7fe700 1 -- 172.21.15.49:0/3315908621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d9c1544e0 msgr2=0x7f8d9c168390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:52.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.249+0000 7f8d9b7fe700 1 --2- 172.21.15.49:0/3315908621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d9c1544e0 0x7f8d9c168390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:52.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.249+0000 7f8d9b7fe700 1 -- 172.21.15.49:0/3315908621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d94009a20 con 0x7f8d9c0c6e30 2023-11-30T17:19:52.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.249+0000 7f8d9bfff700 1 --2- 172.21.15.49:0/3315908621 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d9c06a610 0x7f8d9c164260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:19:52.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.249+0000 7f8d9b7fe700 1 --2- 172.21.15.49:0/3315908621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d9c0c6e30 0x7f8d9c167ea0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f8d9000c4c0 tx=0x7f8d90007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:52.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.249+0000 7f8d83fff700 1 -- 172.21.15.49:0/3315908621 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9000ce80 con 0x7f8d9c0c6e30 2023-11-30T17:19:52.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.249+0000 7f8d83fff700 1 -- 172.21.15.49:0/3315908621 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d900072e0 con 0x7f8d9c0c6e30 2023-11-30T17:19:52.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.249+0000 7f8da2808700 1 -- 172.21.15.49:0/3315908621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d8c009300 con 0x7f8d9c0c6e30 2023-11-30T17:19:52.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.249+0000 7f8d83fff700 1 -- 172.21.15.49:0/3315908621 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d900056e0 con 0x7f8d9c0c6e30 2023-11-30T17:19:52.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.249+0000 7f8da2808700 1 -- 172.21.15.49:0/3315908621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d9c0ac770 con 0x7f8d9c0c6e30 2023-11-30T17:19:52.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.250+0000 7f8da2808700 1 -- 172.21.15.49:0/3315908621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d9c06c860 con 0x7f8d9c0c6e30 2023-11-30T17:19:52.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.250+0000 7f8d83fff700 1 -- 172.21.15.49:0/3315908621 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8d90005a50 con 0x7f8d9c0c6e30 2023-11-30T17:19:52.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.251+0000 7f8d83fff700 1 --2- 172.21.15.49:0/3315908621 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8d8805f270 0x7f8d88061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:52.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.251+0000 7f8d83fff700 1 -- 172.21.15.49:0/3315908621 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f8d900796f0 con 0x7f8d9c0c6e30 2023-11-30T17:19:52.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.251+0000 7f8d9bfff700 1 --2- 172.21.15.49:0/3315908621 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8d8805f270 0x7f8d88061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:52.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.251+0000 7f8d9bfff700 1 --2- 172.21.15.49:0/3315908621 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8d8805f270 0x7f8d88061730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f8d8c00b340 tx=0x7f8d8c016000).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:52.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.255+0000 7f8d83fff700 1 -- 172.21.15.49:0/3315908621 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8d9004ab90 con 0x7f8d9c0c6e30 2023-11-30T17:19:52.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.499+0000 7f8da2808700 1 -- 172.21.15.49:0/3315908621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8d9c0c89b0 con 0x7f8d9c0c6e30 2023-11-30T17:19:52.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.500+0000 7f8d83fff700 1 -- 172.21.15.49:0/3315908621 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f8d9004e1b0 con 0x7f8d9c0c6e30 2023-11-30T17:19:52.501 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:19:52.501 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T17:19:52.501 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2023-11-30T17:19:52.501 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:19:52.502 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2023-11-30T17:19:52.502 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlwm1FHxAAk+s9c60UZ5jB37wbpGzlcg==", 2023-11-30T17:19:52.502 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:19:52.502 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:19:52.502 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:19:52.502 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:19:52.502 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:19:52.502 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:19:52.502 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:19:52.502 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:19:52.502 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2023-11-30T17:19:52.502 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlADm0KhAArffesGGTXzQwY4NPnJ1Bjw==", 2023-11-30T17:19:52.502 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:19:52.502 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:19:52.502 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:19:52.503 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:19:52.503 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:19:52.503 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:19:52.503 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:19:52.503 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:19:52.503 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2023-11-30T17:19:52.503 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlYnY1JhAA+Lurauug0NhWnK8aZErR3g==", 2023-11-30T17:19:52.503 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:19:52.503 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:19:52.503 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:19:52.503 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:19:52.503 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:19:52.503 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:19:52.503 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:19:52.503 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:19:52.504 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2023-11-30T17:19:52.504 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlQdKCMRAA3h4O2NqkQ2zE3DxOqBoaQQ==", 2023-11-30T17:19:52.504 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:19:52.504 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:19:52.504 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:19:52.504 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:19:52.504 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:19:52.504 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:19:52.504 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:19:52.504 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:19:52.504 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2023-11-30T17:19:52.504 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAPwWhlGdbhFxAAOspNRLMhR59LSWatFbsYDA==", 2023-11-30T17:19:52.504 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:19:52.504 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:19:52.504 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:19:52.505 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:19:52.505 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:19:52.505 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:19:52.505 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:19:52.505 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2023-11-30T17:19:52.505 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQASwWhlfwUEFxAAuj0L8ooIGi1vsb7XWLVlDA==", 2023-11-30T17:19:52.505 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:19:52.505 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:19:52.505 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:19:52.505 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:19:52.505 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:19:52.505 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:19:52.505 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:19:52.505 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2023-11-30T17:19:52.505 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAVwWhl7XYwFBAAuSHZqdfRR8V1Y+hmPT5uuw==", 2023-11-30T17:19:52.506 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:19:52.506 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:19:52.506 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:19:52.506 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:19:52.506 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:19:52.506 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:19:52.506 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:19:52.506 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2023-11-30T17:19:52.506 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAYwWhlkhRCFRAAe3cRLcrhJ3ZoluXuRUhmew==", 2023-11-30T17:19:52.506 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:19:52.506 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:19:52.506 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:19:52.506 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:19:52.506 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:19:52.506 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:19:52.507 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:19:52.507 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2023-11-30T17:19:52.507 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAewWhlrq4qFBAAOSdqozO8iH25BQFrPI1SRQ==", 2023-11-30T17:19:52.507 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:19:52.507 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:19:52.507 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:19:52.507 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:19:52.507 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:19:52.507 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:19:52.507 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:19:52.507 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2023-11-30T17:19:52.507 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAhwWhlZL9WERAA90znWBLNuY5eem3yF6O0wg==", 2023-11-30T17:19:52.507 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:19:52.507 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:19:52.508 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:19:52.508 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:19:52.508 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:19:52.508 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:19:52.508 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:19:52.508 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2023-11-30T17:19:52.508 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAkwWhlCJDiEBAAETLCBNCdaWXFgkPPaulTAA==", 2023-11-30T17:19:52.508 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:19:52.508 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:19:52.508 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:19:52.508 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:19:52.508 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:19:52.508 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:19:52.508 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:19:52.508 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2023-11-30T17:19:52.508 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAnwWhl+IiYEBAAcI3AU5xrv0cYy9lckyu0dQ==", 2023-11-30T17:19:52.509 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:19:52.509 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:19:52.509 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:19:52.509 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:19:52.509 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:19:52.509 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:19:52.509 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:19:52.509 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2023-11-30T17:19:52.509 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhleYZcNRAA5PoPChH+s6XfbrQ0hmu2NA==", 2023-11-30T17:19:52.509 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:19:52.509 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:19:52.509 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2023-11-30T17:19:52.509 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-30T17:19:52.509 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:19:52.509 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:19:52.510 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:19:52.510 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2023-11-30T17:19:52.510 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAOwWhlFhcfAhAAzaBDtyRxuqeQ9BatfgUuXw==", 2023-11-30T17:19:52.510 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:19:52.510 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:19:52.510 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T17:19:52.510 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T17:19:52.510 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T17:19:52.510 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:19:52.510 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:19:52.510 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:19:52.510 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2023-11-30T17:19:52.510 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlLZrDOhAAHG/dYWYmPouk3+Iqafr7qw==", 2023-11-30T17:19:52.510 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:19:52.511 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:19:52.511 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T17:19:52.511 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T17:19:52.511 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T17:19:52.511 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:19:52.511 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:19:52.511 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:19:52.511 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2023-11-30T17:19:52.511 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAOwWhl6lxuBxAA/YXQDo+U2ppULGzK054Gzg==", 2023-11-30T17:19:52.511 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:19:52.511 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:19:52.511 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T17:19:52.511 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T17:19:52.511 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T17:19:52.511 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:19:52.512 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:19:52.512 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:19:52.512 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2023-11-30T17:19:52.512 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhl4JkLAxAAiaLgZ5eiazaT9VanG5ihyQ==", 2023-11-30T17:19:52.512 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:19:52.512 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T17:19:52.512 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:19:52.512 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:19:52.512 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:19:52.512 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:19:52.512 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:19:52.512 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:19:52.512 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2023-11-30T17:19:52.512 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlH1s2HBAA3ea9Utfv7fZoo2hO+ElDVQ==", 2023-11-30T17:19:52.512 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:19:52.513 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T17:19:52.513 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-11-30T17:19:52.513 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:19:52.513 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:19:52.513 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:19:52.513 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:19:52.513 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2023-11-30T17:19:52.513 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlpy+fFxAA3qmboR+PlQtK6T35ryj+Lw==", 2023-11-30T17:19:52.513 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:19:52.513 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T17:19:52.513 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-11-30T17:19:52.513 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:19:52.513 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:19:52.513 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:19:52.513 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-11-30T17:19:52.513 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T17:19:52.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.501+0000 7f8da2808700 1 -- 172.21.15.49:0/3315908621 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8d8805f270 msgr2=0x7f8d88061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:52.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.501+0000 7f8da2808700 1 --2- 172.21.15.49:0/3315908621 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8d8805f270 0x7f8d88061730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f8d8c00b340 tx=0x7f8d8c016000).stop 2023-11-30T17:19:52.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.501+0000 7f8da2808700 1 -- 172.21.15.49:0/3315908621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d9c0c6e30 msgr2=0x7f8d9c167ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:52.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.501+0000 7f8da2808700 1 --2- 172.21.15.49:0/3315908621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d9c0c6e30 0x7f8d9c167ea0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f8d9000c4c0 tx=0x7f8d90007e00).stop 2023-11-30T17:19:52.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.501+0000 7f8da2808700 1 -- 172.21.15.49:0/3315908621 shutdown_connections 2023-11-30T17:19:52.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.501+0000 7f8da2808700 1 --2- 172.21.15.49:0/3315908621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d9c1544e0 0x7f8d9c168390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:52.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.501+0000 7f8da2808700 1 --2- 172.21.15.49:0/3315908621 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d9c06a610 0x7f8d9c164260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:52.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.501+0000 7f8da2808700 1 --2- 172.21.15.49:0/3315908621 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8d8805f270 0x7f8d88061730 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:52.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.501+0000 7f8da2808700 1 --2- 172.21.15.49:0/3315908621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d9c0c6e30 0x7f8d9c167ea0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:52.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.501+0000 7f8da2808700 1 -- 172.21.15.49:0/3315908621 >> 172.21.15.49:0/3315908621 conn(0x7f8d9c085020 msgr2=0x7f8d9c0c9070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:52.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.501+0000 7f8da2808700 1 -- 172.21.15.49:0/3315908621 shutdown_connections 2023-11-30T17:19:52.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.501+0000 7f8da2808700 1 -- 172.21.15.49:0/3315908621 wait complete. 2023-11-30T17:19:52.516 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:19:52.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.632+0000 7f39fdfcd700 1 Processor -- start 2023-11-30T17:19:52.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.633+0000 7f39fdfcd700 1 -- start start 2023-11-30T17:19:52.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.633+0000 7f39fdfcd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f39f81542d0 0x7f39f80697f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:52.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.633+0000 7f39fdfcd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39f8062e10 0x7f39f80661b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:52.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.633+0000 7f39fdfcd700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39f8065760 con 0x7f39f8069ce0 2023-11-30T17:19:52.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.633+0000 7f39fdfcd700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f80c3250 con 0x7f39f81542d0 2023-11-30T17:19:52.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.633+0000 7f39fdfcd700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f806a340 con 0x7f39f8062e10 2023-11-30T17:19:52.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.634+0000 7f39f6ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f39f8069ce0 0x7f39f8062700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58370/0 (socket says 172.21.15.49:58370) 2023-11-30T17:19:52.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.634+0000 7f39f6ffd700 1 -- 172.21.15.49:0/2345668511 learned_addr learned my addr 172.21.15.49:0/2345668511 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:52.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.634+0000 7f39f77fe700 1 --2- 172.21.15.49:0/2345668511 >> v2:172.21.15.115:3300/0 conn(0x7f39f81542d0 0x7f39f80697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:52.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.634+0000 7f39f7fff700 1 --2- 172.21.15.49:0/2345668511 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39f8062e10 0x7f39f80661b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:52.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.634+0000 7f39f67fc700 1 -- 172.21.15.49:0/2345668511 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3896920296 0 0) 0x7f39f8065760 con 0x7f39f8069ce0 2023-11-30T17:19:52.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.634+0000 7f39f67fc700 1 -- 172.21.15.49:0/2345668511 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39e00033f0 con 0x7f39f8069ce0 2023-11-30T17:19:52.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.634+0000 7f39f67fc700 1 -- 172.21.15.49:0/2345668511 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1890148901 0 0) 0x7f39e00033f0 con 0x7f39f8069ce0 2023-11-30T17:19:52.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.634+0000 7f39f7fff700 1 -- 172.21.15.49:0/2345668511 >> v2:172.21.15.115:3300/0 conn(0x7f39f81542d0 msgr2=0x7f39f80697f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:52.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.634+0000 7f39f7fff700 1 --2- 172.21.15.49:0/2345668511 >> v2:172.21.15.115:3300/0 conn(0x7f39f81542d0 0x7f39f80697f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:52.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.634+0000 7f39f7fff700 1 -- 172.21.15.49:0/2345668511 >> v1:172.21.15.49:6789/0 conn(0x7f39f8069ce0 legacy=0x7f39f8062700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:52.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.634+0000 7f39f7fff700 1 -- 172.21.15.49:0/2345668511 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f806a620 con 0x7f39f8062e10 2023-11-30T17:19:52.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.634+0000 7f39f77fe700 1 --2- 172.21.15.49:0/2345668511 >> v2:172.21.15.115:3300/0 conn(0x7f39f81542d0 0x7f39f80697f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:19:52.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.634+0000 7f39f7fff700 1 --2- 172.21.15.49:0/2345668511 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39f8062e10 0x7f39f80661b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f39f0009e60 tx=0x7f39f0009780).ready entity=mon.2 client_cookie=eb4ca6463d41a5ba server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:52.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.634+0000 7f39f67fc700 1 -- 172.21.15.49:0/2345668511 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f000e070 con 0x7f39f8062e10 2023-11-30T17:19:52.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.635+0000 7f39f67fc700 1 -- 172.21.15.49:0/2345668511 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f000b7a0 con 0x7f39f8062e10 2023-11-30T17:19:52.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.635+0000 7f39f67fc700 1 -- 172.21.15.49:0/2345668511 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec001470 con 0x7f39f8062e10 2023-11-30T17:19:52.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.635+0000 7f39fdfcd700 1 -- 172.21.15.49:0/2345668511 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39f8062e10 msgr2=0x7f39f80661b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:52.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.635+0000 7f39fdfcd700 1 --2- 172.21.15.49:0/2345668511 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39f8062e10 0x7f39f80661b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f39f0009e60 tx=0x7f39f0009780).stop 2023-11-30T17:19:52.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.635+0000 7f39fdfcd700 1 -- 172.21.15.49:0/2345668511 shutdown_connections 2023-11-30T17:19:52.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.635+0000 7f39fdfcd700 1 --2- 172.21.15.49:0/2345668511 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39f8062e10 0x7f39f80661b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:52.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.635+0000 7f39fdfcd700 1 --2- 172.21.15.49:0/2345668511 >> v2:172.21.15.115:3300/0 conn(0x7f39f81542d0 0x7f39f80697f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:52.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.635+0000 7f39fdfcd700 1 -- 172.21.15.49:0/2345668511 >> 172.21.15.49:0/2345668511 conn(0x7f39f80c7fd0 msgr2=0x7f39f80c83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:52.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.635+0000 7f39fdfcd700 1 -- 172.21.15.49:0/2345668511 shutdown_connections 2023-11-30T17:19:52.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.635+0000 7f39fdfcd700 1 -- 172.21.15.49:0/2345668511 wait complete. 2023-11-30T17:19:52.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.636+0000 7f39fdfcd700 1 Processor -- start 2023-11-30T17:19:52.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.636+0000 7f39fdfcd700 1 -- start start 2023-11-30T17:19:52.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.637+0000 7f39fdfcd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39f8062e10 0x7f39f81546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:52.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.637+0000 7f39fdfcd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39f8069ce0 0x7f39f815a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:52.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.637+0000 7f39fdfcd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39f81542d0 0x7f39f8167a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:52.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.637+0000 7f39fdfcd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f8154ba0 con 0x7f39f8069ce0 2023-11-30T17:19:52.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.637+0000 7f39fdfcd700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f80ac260 con 0x7f39f8062e10 2023-11-30T17:19:52.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.637+0000 7f39fdfcd700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f80ab650 con 0x7f39f81542d0 2023-11-30T17:19:52.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.637+0000 7f39f6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39f8069ce0 0x7f39f815a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:52.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.637+0000 7f39f6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39f8069ce0 0x7f39f815a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58986/0 (socket says 172.21.15.49:58986) 2023-11-30T17:19:52.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.637+0000 7f39f6ffd700 1 -- 172.21.15.49:0/1562641371 learned_addr learned my addr 172.21.15.49:0/1562641371 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:52.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.637+0000 7f39f77fe700 1 --2- 172.21.15.49:0/1562641371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39f8062e10 0x7f39f81546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:52.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.637+0000 7f39f7fff700 1 --2- 172.21.15.49:0/1562641371 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39f81542d0 0x7f39f8167a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:52.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.637+0000 7f39f6ffd700 1 -- 172.21.15.49:0/1562641371 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39f81542d0 msgr2=0x7f39f8167a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:52.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.637+0000 7f39f6ffd700 1 --2- 172.21.15.49:0/1562641371 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39f81542d0 0x7f39f8167a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:52.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.637+0000 7f39f6ffd700 1 -- 172.21.15.49:0/1562641371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39f8062e10 msgr2=0x7f39f81546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:52.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.637+0000 7f39f6ffd700 1 --2- 172.21.15.49:0/1562641371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39f8062e10 0x7f39f81546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:52.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.638+0000 7f39f6ffd700 1 -- 172.21.15.49:0/1562641371 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e80092a0 con 0x7f39f8069ce0 2023-11-30T17:19:52.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.638+0000 7f39f77fe700 1 --2- 172.21.15.49:0/1562641371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39f8062e10 0x7f39f81546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:19:52.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.638+0000 7f39f6ffd700 1 --2- 172.21.15.49:0/1562641371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39f8069ce0 0x7f39f815a650 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f39ec00c810 tx=0x7f39ec001aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:52.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.638+0000 7f39df7fe700 1 -- 172.21.15.49:0/1562641371 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec007170 con 0x7f39f8069ce0 2023-11-30T17:19:52.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.638+0000 7f39df7fe700 1 -- 172.21.15.49:0/1562641371 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ec0072d0 con 0x7f39f8069ce0 2023-11-30T17:19:52.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.638+0000 7f39df7fe700 1 -- 172.21.15.49:0/1562641371 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec0048c0 con 0x7f39f8069ce0 2023-11-30T17:19:52.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.638+0000 7f39fdfcd700 1 -- 172.21.15.49:0/1562641371 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f0009a20 con 0x7f39f8069ce0 2023-11-30T17:19:52.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.638+0000 7f39fdfcd700 1 -- 172.21.15.49:0/1562641371 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f80abc10 con 0x7f39f8069ce0 2023-11-30T17:19:52.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.639+0000 7f39fdfcd700 1 -- 172.21.15.49:0/1562641371 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f806a0f0 con 0x7f39f8069ce0 2023-11-30T17:19:52.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.639+0000 7f39df7fe700 1 -- 172.21.15.49:0/1562641371 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f39ec004cb0 con 0x7f39f8069ce0 2023-11-30T17:19:52.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.639+0000 7f39df7fe700 1 --2- 172.21.15.49:0/1562641371 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f39e405f270 0x7f39e4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:52.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.640+0000 7f39df7fe700 1 -- 172.21.15.49:0/1562641371 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f39ec079c20 con 0x7f39f8069ce0 2023-11-30T17:19:52.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.640+0000 7f39f77fe700 1 --2- 172.21.15.49:0/1562641371 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f39e405f270 0x7f39e4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:52.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.640+0000 7f39f77fe700 1 --2- 172.21.15.49:0/1562641371 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f39e405f270 0x7f39e4061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f39e8009270 tx=0x7f39e8008040).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:52.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.644+0000 7f39df7fe700 1 -- 172.21.15.49:0/1562641371 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f39ec04b0c0 con 0x7f39f8069ce0 2023-11-30T17:19:52.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.820+0000 7f39fdfcd700 1 -- 172.21.15.49:0/1562641371 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39f805f660 con 0x7f39f8069ce0 2023-11-30T17:19:52.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.820+0000 7f39df7fe700 1 -- 172.21.15.49:0/1562641371 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+13712 (secure 0 0 0) 0x7f39ec04e6e0 con 0x7f39f8069ce0 2023-11-30T17:19:52.822 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:19:52.822 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":61,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:19:52.056448+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:19:52.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.822+0000 7f39fdfcd700 1 -- 172.21.15.49:0/1562641371 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f39e405f270 msgr2=0x7f39e4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:52.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.822+0000 7f39fdfcd700 1 --2- 172.21.15.49:0/1562641371 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f39e405f270 0x7f39e4061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f39e8009270 tx=0x7f39e8008040).stop 2023-11-30T17:19:52.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.822+0000 7f39fdfcd700 1 -- 172.21.15.49:0/1562641371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39f8069ce0 msgr2=0x7f39f815a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:52.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.822+0000 7f39fdfcd700 1 --2- 172.21.15.49:0/1562641371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39f8069ce0 0x7f39f815a650 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f39ec00c810 tx=0x7f39ec001aa0).stop 2023-11-30T17:19:52.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.823+0000 7f39fdfcd700 1 -- 172.21.15.49:0/1562641371 shutdown_connections 2023-11-30T17:19:52.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.823+0000 7f39fdfcd700 1 --2- 172.21.15.49:0/1562641371 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39f81542d0 0x7f39f8167a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:52.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.823+0000 7f39fdfcd700 1 --2- 172.21.15.49:0/1562641371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39f8062e10 0x7f39f81546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:52.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.823+0000 7f39fdfcd700 1 --2- 172.21.15.49:0/1562641371 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f39e405f270 0x7f39e4061730 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:52.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.823+0000 7f39fdfcd700 1 --2- 172.21.15.49:0/1562641371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39f8069ce0 0x7f39f815a650 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:52.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.823+0000 7f39fdfcd700 1 -- 172.21.15.49:0/1562641371 >> 172.21.15.49:0/1562641371 conn(0x7f39f80c7fd0 msgr2=0x7f39f8066000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:52.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.823+0000 7f39fdfcd700 1 -- 172.21.15.49:0/1562641371 shutdown_connections 2023-11-30T17:19:52.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.823+0000 7f39fdfcd700 1 -- 172.21.15.49:0/1562641371 wait complete. 2023-11-30T17:19:52.836 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-11-30T17:19:52.837 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T17:19:52.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.956+0000 7f564cafa700 1 Processor -- start 2023-11-30T17:19:52.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.956+0000 7f564cafa700 1 -- start start 2023-11-30T17:19:52.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.957+0000 7f564cafa700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f564814e7e0 0x7f56480bccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:52.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.957+0000 7f564cafa700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5648069770 con 0x7f5648062e10 2023-11-30T17:19:52.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.957+0000 7f564cafa700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5648069a50 con 0x7f564814ebc0 2023-11-30T17:19:52.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.957+0000 7f564cafa700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f564806a3f0 con 0x7f564814e7e0 2023-11-30T17:19:52.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.957+0000 7f56477fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f564814e7e0 0x7f56480bccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:52.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.957+0000 7f5647fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5648062e10 0x7f56480c59f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58376/0 (socket says 172.21.15.49:58376) 2023-11-30T17:19:52.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.957+0000 7f5647fff700 1 -- 172.21.15.49:0/4186663901 learned_addr learned my addr 172.21.15.49:0/4186663901 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:52.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.957+0000 7f56477fe700 1 -- 172.21.15.49:0/4186663901 >> v1:172.21.15.115:6789/0 conn(0x7f564814ebc0 legacy=0x7f5648062700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:52.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.957+0000 7f56477fe700 1 -- 172.21.15.49:0/4186663901 >> v1:172.21.15.49:6789/0 conn(0x7f5648062e10 legacy=0x7f56480c59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:52.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.957+0000 7f56467fc700 1 -- 172.21.15.49:0/4186663901 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1510819808 0 0) 0x7f5648069770 con 0x7f5648062e10 2023-11-30T17:19:52.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.957+0000 7f56477fe700 1 -- 172.21.15.49:0/4186663901 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5648069d30 con 0x7f564814e7e0 2023-11-30T17:19:52.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.958+0000 7f56477fe700 1 --2- 172.21.15.49:0/4186663901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f564814e7e0 0x7f56480bccd0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f5638009760 tx=0x7f5638009060).ready entity=mon.0 client_cookie=1ee7f2f82061c6b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:52.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.958+0000 7f56467fc700 1 -- 172.21.15.49:0/4186663901 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563800b580 con 0x7f564814e7e0 2023-11-30T17:19:52.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.958+0000 7f56467fc700 1 -- 172.21.15.49:0/4186663901 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563800b6e0 con 0x7f564814e7e0 2023-11-30T17:19:52.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.958+0000 7f56467fc700 1 -- 172.21.15.49:0/4186663901 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563800ba60 con 0x7f564814e7e0 2023-11-30T17:19:52.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.958+0000 7f564cafa700 1 -- 172.21.15.49:0/4186663901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f564814e7e0 msgr2=0x7f56480bccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:52.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.958+0000 7f564cafa700 1 --2- 172.21.15.49:0/4186663901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f564814e7e0 0x7f56480bccd0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f5638009760 tx=0x7f5638009060).stop 2023-11-30T17:19:52.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.958+0000 7f564cafa700 1 -- 172.21.15.49:0/4186663901 shutdown_connections 2023-11-30T17:19:52.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.958+0000 7f564cafa700 1 --2- 172.21.15.49:0/4186663901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f564814e7e0 0x7f56480bccd0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:52.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.958+0000 7f564cafa700 1 -- 172.21.15.49:0/4186663901 >> 172.21.15.49:0/4186663901 conn(0x7f5648064320 msgr2=0x7f56480c7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:52.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.958+0000 7f564cafa700 1 -- 172.21.15.49:0/4186663901 shutdown_connections 2023-11-30T17:19:52.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.958+0000 7f564cafa700 1 -- 172.21.15.49:0/4186663901 wait complete. 2023-11-30T17:19:52.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.960+0000 7f564cafa700 1 Processor -- start 2023-11-30T17:19:52.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.960+0000 7f564cafa700 1 -- start start 2023-11-30T17:19:52.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.960+0000 7f564cafa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5648062e10 0x7f56480ad750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:52.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.960+0000 7f564cafa700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f564814e7e0 0x7f5648155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:52.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.960+0000 7f564cafa700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f564814ebc0 0x7f564814c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:52.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.960+0000 7f564cafa700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56480abbe0 con 0x7f5648062e10 2023-11-30T17:19:52.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.960+0000 7f564cafa700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56480ac070 con 0x7f564814ebc0 2023-11-30T17:19:52.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.960+0000 7f564cafa700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56480aafd0 con 0x7f564814e7e0 2023-11-30T17:19:52.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.960+0000 7f56477fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5648062e10 0x7f56480ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:52.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.961+0000 7f56477fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5648062e10 0x7f56480ad750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59002/0 (socket says 172.21.15.49:59002) 2023-11-30T17:19:52.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.961+0000 7f56477fe700 1 -- 172.21.15.49:0/1653897060 learned_addr learned my addr 172.21.15.49:0/1653897060 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:52.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.961+0000 7f56477fe700 1 -- 172.21.15.49:0/1653897060 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f564814e7e0 msgr2=0x7f5648155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:52.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.961+0000 7f56477fe700 1 --2- 172.21.15.49:0/1653897060 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f564814e7e0 0x7f5648155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:52.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.961+0000 7f56477fe700 1 -- 172.21.15.49:0/1653897060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f564814ebc0 msgr2=0x7f564814c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:52.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.961+0000 7f56477fe700 1 --2- 172.21.15.49:0/1653897060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f564814ebc0 0x7f564814c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:52.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.961+0000 7f56477fe700 1 -- 172.21.15.49:0/1653897060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56380092a0 con 0x7f5648062e10 2023-11-30T17:19:52.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.961+0000 7f56477fe700 1 --2- 172.21.15.49:0/1653897060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5648062e10 0x7f56480ad750 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f5638009eb0 tx=0x7f5638017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:52.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.961+0000 7f562f7fe700 1 -- 172.21.15.49:0/1653897060 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563800ba60 con 0x7f5648062e10 2023-11-30T17:19:52.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.961+0000 7f562f7fe700 1 -- 172.21.15.49:0/1653897060 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5638000c90 con 0x7f5648062e10 2023-11-30T17:19:52.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.961+0000 7f564cafa700 1 -- 172.21.15.49:0/1653897060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56480ab2b0 con 0x7f5648062e10 2023-11-30T17:19:52.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.961+0000 7f562f7fe700 1 -- 172.21.15.49:0/1653897060 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563801b640 con 0x7f5648062e10 2023-11-30T17:19:52.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.961+0000 7f564cafa700 1 -- 172.21.15.49:0/1653897060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56480ab870 con 0x7f5648062e10 2023-11-30T17:19:52.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.962+0000 7f564cafa700 1 -- 172.21.15.49:0/1653897060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56480abec0 con 0x7f5648062e10 2023-11-30T17:19:52.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.962+0000 7f562f7fe700 1 -- 172.21.15.49:0/1653897060 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f563801ba30 con 0x7f5648062e10 2023-11-30T17:19:52.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.963+0000 7f562f7fe700 1 --2- 172.21.15.49:0/1653897060 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f563405f2a0 0x7f5634061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:52.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.963+0000 7f562f7fe700 1 -- 172.21.15.49:0/1653897060 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f563807bc70 con 0x7f5648062e10 2023-11-30T17:19:52.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.963+0000 7f5646ffd700 1 --2- 172.21.15.49:0/1653897060 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f563405f2a0 0x7f5634061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:52.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.963+0000 7f5646ffd700 1 --2- 172.21.15.49:0/1653897060 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f563405f2a0 0x7f5634061760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f5648066f80 tx=0x7f563c0079c0).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:52.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:52.967+0000 7f562f7fe700 1 -- 172.21.15.49:0/1653897060 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f563804d110 con 0x7f5648062e10 2023-11-30T17:19:53.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.141+0000 7f564cafa700 1 -- 172.21.15.49:0/1653897060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f564806c7c0 con 0x7f5648062e10 2023-11-30T17:19:53.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.141+0000 7f562f7fe700 1 -- 172.21.15.49:0/1653897060 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v61) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5638050730 con 0x7f5648062e10 2023-11-30T17:19:53.143 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T17:19:53.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.143+0000 7f564cafa700 1 -- 172.21.15.49:0/1653897060 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f563405f2a0 msgr2=0x7f5634061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:53.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.143+0000 7f564cafa700 1 --2- 172.21.15.49:0/1653897060 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f563405f2a0 0x7f5634061760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f5648066f80 tx=0x7f563c0079c0).stop 2023-11-30T17:19:53.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.143+0000 7f564cafa700 1 -- 172.21.15.49:0/1653897060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5648062e10 msgr2=0x7f56480ad750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:53.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.143+0000 7f564cafa700 1 --2- 172.21.15.49:0/1653897060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5648062e10 0x7f56480ad750 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f5638009eb0 tx=0x7f5638017000).stop 2023-11-30T17:19:53.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.143+0000 7f564cafa700 1 -- 172.21.15.49:0/1653897060 shutdown_connections 2023-11-30T17:19:53.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.143+0000 7f564cafa700 1 --2- 172.21.15.49:0/1653897060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f564814ebc0 0x7f564814c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:53.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.143+0000 7f564cafa700 1 --2- 172.21.15.49:0/1653897060 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f563405f2a0 0x7f5634061760 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:53.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.143+0000 7f564cafa700 1 --2- 172.21.15.49:0/1653897060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5648062e10 0x7f56480ad750 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:53.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.143+0000 7f564cafa700 1 --2- 172.21.15.49:0/1653897060 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f564814e7e0 0x7f5648155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:53.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.143+0000 7f564cafa700 1 -- 172.21.15.49:0/1653897060 >> 172.21.15.49:0/1653897060 conn(0x7f5648064320 msgr2=0x7f56480c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:53.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.143+0000 7f564cafa700 1 -- 172.21.15.49:0/1653897060 shutdown_connections 2023-11-30T17:19:53.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.143+0000 7f564cafa700 1 -- 172.21.15.49:0/1653897060 wait complete. 2023-11-30T17:19:53.156 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T17:19:53.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.275+0000 7f5b0882e700 1 Processor -- start 2023-11-30T17:19:53.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.275+0000 7f5b0882e700 1 -- start start 2023-11-30T17:19:53.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.276+0000 7f5b0882e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5b040c6190 0x7f5b040c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:53.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.276+0000 7f5b0882e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5b04158320 0x7f5b041587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:53.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.276+0000 7f5b0882e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b04158cc0 con 0x7f5b04098d10 2023-11-30T17:19:53.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.276+0000 7f5b0882e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b040c72d0 con 0x7f5b04158320 2023-11-30T17:19:53.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.276+0000 7f5b0882e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b04064570 con 0x7f5b040c6190 2023-11-30T17:19:53.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.276+0000 7f5b02d9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5b04158320 0x7f5b041587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:53.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.277+0000 7f5b02d9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5b04158320 0x7f5b041587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59016/0 (socket says 172.21.15.49:59016) 2023-11-30T17:19:53.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.277+0000 7f5b02d9d700 1 -- 172.21.15.49:0/29171509 learned_addr learned my addr 172.21.15.49:0/29171509 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:53.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.277+0000 7f5b01d9b700 1 --2- 172.21.15.49:0/29171509 >> v2:172.21.15.115:3300/0 conn(0x7f5b040c6190 0x7f5b040c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:53.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.277+0000 7f5b02d9d700 1 -- 172.21.15.49:0/29171509 >> v2:172.21.15.115:3300/0 conn(0x7f5b040c6190 msgr2=0x7f5b040c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:53.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.277+0000 7f5b02d9d700 1 --2- 172.21.15.49:0/29171509 >> v2:172.21.15.115:3300/0 conn(0x7f5b040c6190 0x7f5b040c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:53.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.277+0000 7f5b02d9d700 1 -- 172.21.15.49:0/29171509 >> v1:172.21.15.115:6789/0 conn(0x7f5b04098d10 legacy=0x7f5b04063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:53.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.277+0000 7f5b02d9d700 1 -- 172.21.15.49:0/29171509 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b04154bc0 con 0x7f5b04158320 2023-11-30T17:19:53.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.277+0000 7f5b02d9d700 1 --2- 172.21.15.49:0/29171509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b04158320 0x7f5b041587d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f5b040c5b40 tx=0x7f5af40090f0).ready entity=mon.0 client_cookie=7e41de8f33ef8dbc server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:53.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.277+0000 7f5b0159a700 1 -- 172.21.15.49:0/29171509 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af400b520 con 0x7f5b04158320 2023-11-30T17:19:53.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.277+0000 7f5b0159a700 1 -- 172.21.15.49:0/29171509 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af400b680 con 0x7f5b04158320 2023-11-30T17:19:53.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.277+0000 7f5b0159a700 1 -- 172.21.15.49:0/29171509 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af400ba00 con 0x7f5b04158320 2023-11-30T17:19:53.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.278+0000 7f5b0882e700 1 -- 172.21.15.49:0/29171509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b04158320 msgr2=0x7f5b041587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:53.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.278+0000 7f5b0882e700 1 --2- 172.21.15.49:0/29171509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b04158320 0x7f5b041587d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f5b040c5b40 tx=0x7f5af40090f0).stop 2023-11-30T17:19:53.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.278+0000 7f5b0882e700 1 -- 172.21.15.49:0/29171509 shutdown_connections 2023-11-30T17:19:53.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.278+0000 7f5b0882e700 1 --2- 172.21.15.49:0/29171509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b04158320 0x7f5b041587d0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:53.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.278+0000 7f5b0882e700 1 --2- 172.21.15.49:0/29171509 >> v2:172.21.15.115:3300/0 conn(0x7f5b040c6190 0x7f5b040c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:53.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.278+0000 7f5b0882e700 1 -- 172.21.15.49:0/29171509 >> 172.21.15.49:0/29171509 conn(0x7f5b040cb310 msgr2=0x7f5b040cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:53.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.278+0000 7f5b0882e700 1 -- 172.21.15.49:0/29171509 shutdown_connections 2023-11-30T17:19:53.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.278+0000 7f5b0882e700 1 -- 172.21.15.49:0/29171509 wait complete. 2023-11-30T17:19:53.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.279+0000 7f5b0882e700 1 Processor -- start 2023-11-30T17:19:53.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.279+0000 7f5b0882e700 1 -- start start 2023-11-30T17:19:53.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.280+0000 7f5b0882e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b04098d10 0x7f5b04156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:53.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.280+0000 7f5b0882e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b040c6190 0x7f5b04148480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:53.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.280+0000 7f5b0882e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b04158320 0x7f5b040ae780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:53.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.280+0000 7f5b0882e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b04156ce0 con 0x7f5b04158320 2023-11-30T17:19:53.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.280+0000 7f5b0882e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b04156720 con 0x7f5b040c6190 2023-11-30T17:19:53.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.280+0000 7f5b0882e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b04156a00 con 0x7f5b04098d10 2023-11-30T17:19:53.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.280+0000 7f5b02d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b04158320 0x7f5b040ae780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:53.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.280+0000 7f5b02d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b04158320 0x7f5b040ae780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59026/0 (socket says 172.21.15.49:59026) 2023-11-30T17:19:53.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.280+0000 7f5b02d9d700 1 -- 172.21.15.49:0/1361485578 learned_addr learned my addr 172.21.15.49:0/1361485578 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:53.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.280+0000 7f5b01d9b700 1 --2- 172.21.15.49:0/1361485578 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b040c6190 0x7f5b04148480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:53.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.280+0000 7f5b0259c700 1 --2- 172.21.15.49:0/1361485578 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b04098d10 0x7f5b04156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:53.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.280+0000 7f5b02d9d700 1 -- 172.21.15.49:0/1361485578 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b04098d10 msgr2=0x7f5b04156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:53.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.280+0000 7f5b02d9d700 1 --2- 172.21.15.49:0/1361485578 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b04098d10 0x7f5b04156140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:53.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.280+0000 7f5b02d9d700 1 -- 172.21.15.49:0/1361485578 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b040c6190 msgr2=0x7f5b04148480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:53.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.280+0000 7f5b02d9d700 1 --2- 172.21.15.49:0/1361485578 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b040c6190 0x7f5b04148480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:53.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.280+0000 7f5b02d9d700 1 -- 172.21.15.49:0/1361485578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af4009370 con 0x7f5b04158320 2023-11-30T17:19:53.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.280+0000 7f5b02d9d700 1 --2- 172.21.15.49:0/1361485578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b04158320 0x7f5b040ae780 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f5af4009130 tx=0x7f5af4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:53.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.280+0000 7f5afa7fc700 1 -- 172.21.15.49:0/1361485578 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af400b520 con 0x7f5b04158320 2023-11-30T17:19:53.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.281+0000 7f5afa7fc700 1 -- 172.21.15.49:0/1361485578 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af400b7f0 con 0x7f5b04158320 2023-11-30T17:19:53.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.281+0000 7f5b0882e700 1 -- 172.21.15.49:0/1361485578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b040c3490 con 0x7f5b04158320 2023-11-30T17:19:53.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.281+0000 7f5afa7fc700 1 -- 172.21.15.49:0/1361485578 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af401c670 con 0x7f5b04158320 2023-11-30T17:19:53.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.281+0000 7f5b0882e700 1 -- 172.21.15.49:0/1361485578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b04148970 con 0x7f5b04158320 2023-11-30T17:19:53.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.281+0000 7f5b0882e700 1 -- 172.21.15.49:0/1361485578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b040c6df0 con 0x7f5b04158320 2023-11-30T17:19:53.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.282+0000 7f5afa7fc700 1 -- 172.21.15.49:0/1361485578 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f5af401c9e0 con 0x7f5b04158320 2023-11-30T17:19:53.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.282+0000 7f5afa7fc700 1 --2- 172.21.15.49:0/1361485578 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5ae405f240 0x7f5ae4061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:53.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.282+0000 7f5afa7fc700 1 -- 172.21.15.49:0/1361485578 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f5af407b250 con 0x7f5b04158320 2023-11-30T17:19:53.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.282+0000 7f5b0259c700 1 --2- 172.21.15.49:0/1361485578 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5ae405f240 0x7f5ae4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:53.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.283+0000 7f5b0259c700 1 --2- 172.21.15.49:0/1361485578 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5ae405f240 0x7f5ae4061700 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f5afc004290 tx=0x7f5afc001560).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:53.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.286+0000 7f5afa7fc700 1 -- 172.21.15.49:0/1361485578 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5af404c690 con 0x7f5b04158320 2023-11-30T17:19:53.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.458+0000 7f5b0882e700 1 -- 172.21.15.49:0/1361485578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5b0406c860 con 0x7f5b04158320 2023-11-30T17:19:53.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.459+0000 7f5afa7fc700 1 -- 172.21.15.49:0/1361485578 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v61) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5af404fcb0 con 0x7f5b04158320 2023-11-30T17:19:53.490 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T17:19:53.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.461+0000 7f5b0882e700 1 -- 172.21.15.49:0/1361485578 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5ae405f240 msgr2=0x7f5ae4061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:53.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.461+0000 7f5b0882e700 1 --2- 172.21.15.49:0/1361485578 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5ae405f240 0x7f5ae4061700 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f5afc004290 tx=0x7f5afc001560).stop 2023-11-30T17:19:53.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.461+0000 7f5b0882e700 1 -- 172.21.15.49:0/1361485578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b04158320 msgr2=0x7f5b040ae780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:53.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.461+0000 7f5b0882e700 1 --2- 172.21.15.49:0/1361485578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b04158320 0x7f5b040ae780 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f5af4009130 tx=0x7f5af4017000).stop 2023-11-30T17:19:53.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.461+0000 7f5b0882e700 1 -- 172.21.15.49:0/1361485578 shutdown_connections 2023-11-30T17:19:53.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.461+0000 7f5b0882e700 1 --2- 172.21.15.49:0/1361485578 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5ae405f240 0x7f5ae4061700 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:53.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.461+0000 7f5b0882e700 1 --2- 172.21.15.49:0/1361485578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b04158320 0x7f5b040ae780 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:53.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.461+0000 7f5b0882e700 1 --2- 172.21.15.49:0/1361485578 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b04098d10 0x7f5b04156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:53.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.461+0000 7f5b0882e700 1 --2- 172.21.15.49:0/1361485578 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b040c6190 0x7f5b04148480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:53.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.461+0000 7f5b0882e700 1 -- 172.21.15.49:0/1361485578 >> 172.21.15.49:0/1361485578 conn(0x7f5b040cb310 msgr2=0x7f5b040c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:53.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.461+0000 7f5b0882e700 1 -- 172.21.15.49:0/1361485578 shutdown_connections 2023-11-30T17:19:53.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.461+0000 7f5b0882e700 1 -- 172.21.15.49:0/1361485578 wait complete. 2023-11-30T17:19:53.493 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-30T17:19:53.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.609+0000 7f9f8b9de700 1 Processor -- start 2023-11-30T17:19:53.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.609+0000 7f9f8b9de700 1 -- start start 2023-11-30T17:19:53.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.610+0000 7f9f8b9de700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9f841544e0 0x7f9f841548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:53.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.610+0000 7f9f8b9de700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f8406a610 0x7f9f840c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:53.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.610+0000 7f9f8b9de700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9f840c6e30 0x7f9f840c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:53.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.610+0000 7f9f8b9de700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f840c69a0 con 0x7f9f840c6e30 2023-11-30T17:19:53.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.610+0000 7f9f8b9de700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f840c13a0 con 0x7f9f841544e0 2023-11-30T17:19:53.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.610+0000 7f9f8b9de700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f840c1680 con 0x7f9f8406a610 2023-11-30T17:19:53.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.610+0000 7f9f89f7b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9f840c6e30 0x7f9f840c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:53.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.610+0000 7f9f89f7b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9f840c6e30 0x7f9f840c72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59038/0 (socket says 172.21.15.49:59038) 2023-11-30T17:19:53.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.610+0000 7f9f89f7b700 1 -- 172.21.15.49:0/1797208619 learned_addr learned my addr 172.21.15.49:0/1797208619 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:53.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.610+0000 7f9f88f79700 1 --2- 172.21.15.49:0/1797208619 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f8406a610 0x7f9f840c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:53.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.610+0000 7f9f8977a700 1 --2- 172.21.15.49:0/1797208619 >> v2:172.21.15.115:3300/0 conn(0x7f9f841544e0 0x7f9f841548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:53.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.610+0000 7f9f89f7b700 1 -- 172.21.15.49:0/1797208619 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f8406a610 msgr2=0x7f9f840c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:53.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.610+0000 7f9f89f7b700 1 --2- 172.21.15.49:0/1797208619 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f8406a610 0x7f9f840c0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:53.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.610+0000 7f9f89f7b700 1 -- 172.21.15.49:0/1797208619 >> v2:172.21.15.115:3300/0 conn(0x7f9f841544e0 msgr2=0x7f9f841548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:53.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.610+0000 7f9f89f7b700 1 --2- 172.21.15.49:0/1797208619 >> v2:172.21.15.115:3300/0 conn(0x7f9f841544e0 0x7f9f841548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:53.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.610+0000 7f9f89f7b700 1 -- 172.21.15.49:0/1797208619 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f840c6630 con 0x7f9f840c6e30 2023-11-30T17:19:53.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.610+0000 7f9f89f7b700 1 --2- 172.21.15.49:0/1797208619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f840c6e30 0x7f9f840c72a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f9f84085760 tx=0x7f9f7c009840).ready entity=mon.0 client_cookie=1020f83d8890932 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:53.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.610+0000 7f9f7bfff700 1 -- 172.21.15.49:0/1797208619 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c00e070 con 0x7f9f840c6e30 2023-11-30T17:19:53.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.611+0000 7f9f7bfff700 1 -- 172.21.15.49:0/1797208619 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7c00ba50 con 0x7f9f840c6e30 2023-11-30T17:19:53.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.611+0000 7f9f7bfff700 1 -- 172.21.15.49:0/1797208619 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c00bdd0 con 0x7f9f840c6e30 2023-11-30T17:19:53.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.611+0000 7f9f8b9de700 1 -- 172.21.15.49:0/1797208619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f840c6e30 msgr2=0x7f9f840c72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:53.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.611+0000 7f9f8b9de700 1 --2- 172.21.15.49:0/1797208619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f840c6e30 0x7f9f840c72a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f9f84085760 tx=0x7f9f7c009840).stop 2023-11-30T17:19:53.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.611+0000 7f9f8b9de700 1 -- 172.21.15.49:0/1797208619 shutdown_connections 2023-11-30T17:19:53.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.611+0000 7f9f8b9de700 1 --2- 172.21.15.49:0/1797208619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f840c6e30 0x7f9f840c72a0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:53.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.611+0000 7f9f8b9de700 1 --2- 172.21.15.49:0/1797208619 >> v2:172.21.15.115:3300/0 conn(0x7f9f841544e0 0x7f9f841548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:53.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.611+0000 7f9f8b9de700 1 --2- 172.21.15.49:0/1797208619 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f8406a610 0x7f9f840c0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:53.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.611+0000 7f9f8b9de700 1 -- 172.21.15.49:0/1797208619 >> 172.21.15.49:0/1797208619 conn(0x7f9f84085020 msgr2=0x7f9f84094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:53.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.611+0000 7f9f8b9de700 1 -- 172.21.15.49:0/1797208619 shutdown_connections 2023-11-30T17:19:53.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.611+0000 7f9f8b9de700 1 -- 172.21.15.49:0/1797208619 wait complete. 2023-11-30T17:19:53.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.612+0000 7f9f8b9de700 1 Processor -- start 2023-11-30T17:19:53.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.612+0000 7f9f8b9de700 1 -- start start 2023-11-30T17:19:53.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.613+0000 7f9f8b9de700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f8406a610 0x7f9f84094940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:53.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.613+0000 7f9f8b9de700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f840c6e30 0x7f9f840a8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:53.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.613+0000 7f9f8b9de700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f841544e0 0x7f9f8414d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:53.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.613+0000 7f9f8b9de700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f840a8720 con 0x7f9f840c6e30 2023-11-30T17:19:53.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.613+0000 7f9f8b9de700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f84095bc0 con 0x7f9f8406a610 2023-11-30T17:19:53.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.613+0000 7f9f8b9de700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f84094fb0 con 0x7f9f841544e0 2023-11-30T17:19:53.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.613+0000 7f9f88f79700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f840c6e30 0x7f9f840a8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:53.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.613+0000 7f9f88f79700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f840c6e30 0x7f9f840a8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59042/0 (socket says 172.21.15.49:59042) 2023-11-30T17:19:53.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.613+0000 7f9f88f79700 1 -- 172.21.15.49:0/3984828560 learned_addr learned my addr 172.21.15.49:0/3984828560 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:53.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.613+0000 7f9f8977a700 1 --2- 172.21.15.49:0/3984828560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f8406a610 0x7f9f84094940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:53.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.614+0000 7f9f89f7b700 1 --2- 172.21.15.49:0/3984828560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f841544e0 0x7f9f8414d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:53.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.614+0000 7f9f88f79700 1 -- 172.21.15.49:0/3984828560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f841544e0 msgr2=0x7f9f8414d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:53.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.614+0000 7f9f88f79700 1 --2- 172.21.15.49:0/3984828560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f841544e0 0x7f9f8414d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:53.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.614+0000 7f9f88f79700 1 -- 172.21.15.49:0/3984828560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f8406a610 msgr2=0x7f9f84094940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:53.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.614+0000 7f9f88f79700 1 --2- 172.21.15.49:0/3984828560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f8406a610 0x7f9f84094940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:53.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.614+0000 7f9f88f79700 1 -- 172.21.15.49:0/3984828560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7c009ae0 con 0x7f9f840c6e30 2023-11-30T17:19:53.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.614+0000 7f9f89f7b700 1 --2- 172.21.15.49:0/3984828560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f841544e0 0x7f9f8414d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:19:53.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.614+0000 7f9f88f79700 1 --2- 172.21.15.49:0/3984828560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f840c6e30 0x7f9f840a8230 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f9f7400d890 tx=0x7f9f74008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:53.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.614+0000 7f9f797fa700 1 -- 172.21.15.49:0/3984828560 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f740125f0 con 0x7f9f840c6e30 2023-11-30T17:19:53.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.614+0000 7f9f797fa700 1 -- 172.21.15.49:0/3984828560 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f74012750 con 0x7f9f840c6e30 2023-11-30T17:19:53.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.614+0000 7f9f8b9de700 1 -- 172.21.15.49:0/3984828560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f84095290 con 0x7f9f840c6e30 2023-11-30T17:19:53.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.614+0000 7f9f797fa700 1 -- 172.21.15.49:0/3984828560 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f74012ad0 con 0x7f9f840c6e30 2023-11-30T17:19:53.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.614+0000 7f9f8b9de700 1 -- 172.21.15.49:0/3984828560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f84095850 con 0x7f9f840c6e30 2023-11-30T17:19:53.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.615+0000 7f9f8b9de700 1 -- 172.21.15.49:0/3984828560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f8406c860 con 0x7f9f840c6e30 2023-11-30T17:19:53.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.615+0000 7f9f797fa700 1 -- 172.21.15.49:0/3984828560 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f9f74013480 con 0x7f9f840c6e30 2023-11-30T17:19:53.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.616+0000 7f9f797fa700 1 --2- 172.21.15.49:0/3984828560 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9f6805f270 0x7f9f68061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:53.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.616+0000 7f9f797fa700 1 -- 172.21.15.49:0/3984828560 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f9f74079e50 con 0x7f9f840c6e30 2023-11-30T17:19:53.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.616+0000 7f9f8977a700 1 --2- 172.21.15.49:0/3984828560 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9f6805f270 0x7f9f68061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:53.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.616+0000 7f9f8977a700 1 --2- 172.21.15.49:0/3984828560 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9f6805f270 0x7f9f68061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f9f80006920 tx=0x7f9f80008040).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:53.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.620+0000 7f9f797fa700 1 -- 172.21.15.49:0/3984828560 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9f7404b290 con 0x7f9f840c6e30 2023-11-30T17:19:53.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.796+0000 7f9f8b9de700 1 -- 172.21.15.49:0/3984828560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9f840c10b0 con 0x7f9f840c6e30 2023-11-30T17:19:53.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.796+0000 7f9f797fa700 1 -- 172.21.15.49:0/3984828560 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v61) v1 ==== 84+0+143 (secure 0 0 0) 0x7f9f7404e8b0 con 0x7f9f840c6e30 2023-11-30T17:19:53.798 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:19:53.798 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-11-30T17:19:53.798 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:19:53.798 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2023-11-30T17:19:53.798 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "device_health_metrics" 2023-11-30T17:19:53.798 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:19:53.798 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:19:53.798 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 2, 2023-11-30T17:19:53.799 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "rbd" 2023-11-30T17:19:53.799 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:19:53.799 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-11-30T17:19:53.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.798+0000 7f9f8b9de700 1 -- 172.21.15.49:0/3984828560 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9f6805f270 msgr2=0x7f9f68061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:53.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.798+0000 7f9f8b9de700 1 --2- 172.21.15.49:0/3984828560 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9f6805f270 0x7f9f68061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f9f80006920 tx=0x7f9f80008040).stop 2023-11-30T17:19:53.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.798+0000 7f9f8b9de700 1 -- 172.21.15.49:0/3984828560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f840c6e30 msgr2=0x7f9f840a8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:53.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.798+0000 7f9f8b9de700 1 --2- 172.21.15.49:0/3984828560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f840c6e30 0x7f9f840a8230 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f9f7400d890 tx=0x7f9f74008040).stop 2023-11-30T17:19:53.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.798+0000 7f9f8b9de700 1 -- 172.21.15.49:0/3984828560 shutdown_connections 2023-11-30T17:19:53.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.798+0000 7f9f8b9de700 1 --2- 172.21.15.49:0/3984828560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f841544e0 0x7f9f8414d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:53.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.798+0000 7f9f8b9de700 1 --2- 172.21.15.49:0/3984828560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f8406a610 0x7f9f84094940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:53.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.798+0000 7f9f8b9de700 1 --2- 172.21.15.49:0/3984828560 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9f6805f270 0x7f9f68061730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:53.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.798+0000 7f9f8b9de700 1 --2- 172.21.15.49:0/3984828560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f840c6e30 0x7f9f840a8230 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:53.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.798+0000 7f9f8b9de700 1 -- 172.21.15.49:0/3984828560 >> 172.21.15.49:0/3984828560 conn(0x7f9f84085020 msgr2=0x7f9f840ae960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:53.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.799+0000 7f9f8b9de700 1 -- 172.21.15.49:0/3984828560 shutdown_connections 2023-11-30T17:19:53.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.799+0000 7f9f8b9de700 1 -- 172.21.15.49:0/3984828560 wait complete. 2023-11-30T17:19:53.812 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-30T17:19:53.812 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-11-30T17:19:53.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.933+0000 7f074cb27700 1 Processor -- start 2023-11-30T17:19:53.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.933+0000 7f074cb27700 1 -- start start 2023-11-30T17:19:53.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.934+0000 7f074cb27700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0748154530 0x7f0748154910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:53.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.934+0000 7f074cb27700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f07480a7ff0 0x7f07480c8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:53.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.934+0000 7f074cb27700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07480c6630 con 0x7f07480aa220 2023-11-30T17:19:53.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.934+0000 7f074cb27700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07480c6390 con 0x7f0748154530 2023-11-30T17:19:53.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.934+0000 7f074cb27700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07480a8470 con 0x7f07480a7ff0 2023-11-30T17:19:53.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.934+0000 7f074659c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0748154530 0x7f0748154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:53.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.934+0000 7f074659c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0748154530 0x7f0748154910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59048/0 (socket says 172.21.15.49:59048) 2023-11-30T17:19:53.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.934+0000 7f074659c700 1 -- 172.21.15.49:0/1170853509 learned_addr learned my addr 172.21.15.49:0/1170853509 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:53.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.934+0000 7f0745d9b700 1 --2- 172.21.15.49:0/1170853509 >> v2:172.21.15.115:3300/0 conn(0x7f07480a7ff0 0x7f07480c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:53.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.934+0000 7f074659c700 1 -- 172.21.15.49:0/1170853509 >> v2:172.21.15.115:3300/0 conn(0x7f07480a7ff0 msgr2=0x7f07480c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:53.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.934+0000 7f074659c700 1 --2- 172.21.15.49:0/1170853509 >> v2:172.21.15.115:3300/0 conn(0x7f07480a7ff0 0x7f07480c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:53.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.934+0000 7f074659c700 1 -- 172.21.15.49:0/1170853509 >> v1:172.21.15.115:6789/0 conn(0x7f07480aa220 legacy=0x7f07480c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:53.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.934+0000 7f074659c700 1 -- 172.21.15.49:0/1170853509 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0748064230 con 0x7f0748154530 2023-11-30T17:19:53.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.935+0000 7f074659c700 1 --2- 172.21.15.49:0/1170853509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0748154530 0x7f0748154910 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f07480adfd0 tx=0x7f0740009840).ready entity=mon.0 client_cookie=aeb4f5ed9a2a5f8c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:53.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.935+0000 7f074559a700 1 -- 172.21.15.49:0/1170853509 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074000e070 con 0x7f0748154530 2023-11-30T17:19:53.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.935+0000 7f074559a700 1 -- 172.21.15.49:0/1170853509 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074000bad0 con 0x7f0748154530 2023-11-30T17:19:53.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.935+0000 7f074559a700 1 -- 172.21.15.49:0/1170853509 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074000be50 con 0x7f0748154530 2023-11-30T17:19:53.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.935+0000 7f074cb27700 1 -- 172.21.15.49:0/1170853509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0748154530 msgr2=0x7f0748154910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:53.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.935+0000 7f074cb27700 1 --2- 172.21.15.49:0/1170853509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0748154530 0x7f0748154910 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f07480adfd0 tx=0x7f0740009840).stop 2023-11-30T17:19:53.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.935+0000 7f074cb27700 1 -- 172.21.15.49:0/1170853509 shutdown_connections 2023-11-30T17:19:53.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.935+0000 7f074cb27700 1 --2- 172.21.15.49:0/1170853509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0748154530 0x7f0748154910 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:53.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.935+0000 7f074cb27700 1 --2- 172.21.15.49:0/1170853509 >> v2:172.21.15.115:3300/0 conn(0x7f07480a7ff0 0x7f07480c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:53.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.935+0000 7f074cb27700 1 -- 172.21.15.49:0/1170853509 >> 172.21.15.49:0/1170853509 conn(0x7f0748094930 msgr2=0x7f074806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:53.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.935+0000 7f074cb27700 1 -- 172.21.15.49:0/1170853509 shutdown_connections 2023-11-30T17:19:53.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.935+0000 7f074cb27700 1 -- 172.21.15.49:0/1170853509 wait complete. 2023-11-30T17:19:53.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.936+0000 7f074cb27700 1 Processor -- start 2023-11-30T17:19:53.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.937+0000 7f074cb27700 1 -- start start 2023-11-30T17:19:53.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.937+0000 7f074cb27700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07480a7ff0 0x7f0748151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:53.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.937+0000 7f074cb27700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07480aa220 0x7f0748150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:53.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.937+0000 7f074cb27700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0748154530 0x7f07480c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:53.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.937+0000 7f074cb27700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07480c3240 con 0x7f0748154530 2023-11-30T17:19:53.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.937+0000 7f074cb27700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07480c2630 con 0x7f07480a7ff0 2023-11-30T17:19:53.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.937+0000 7f074cb27700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07480c2910 con 0x7f07480aa220 2023-11-30T17:19:53.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.937+0000 7f0746d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0748154530 0x7f07480c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:53.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.937+0000 7f0746d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0748154530 0x7f07480c9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59062/0 (socket says 172.21.15.49:59062) 2023-11-30T17:19:53.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.937+0000 7f0746d9d700 1 -- 172.21.15.49:0/2825368550 learned_addr learned my addr 172.21.15.49:0/2825368550 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:53.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.937+0000 7f074659c700 1 --2- 172.21.15.49:0/2825368550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07480a7ff0 0x7f0748151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:53.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.938+0000 7f0745d9b700 1 --2- 172.21.15.49:0/2825368550 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07480aa220 0x7f0748150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:53.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.938+0000 7f0746d9d700 1 -- 172.21.15.49:0/2825368550 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07480aa220 msgr2=0x7f0748150330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:53.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.938+0000 7f0746d9d700 1 --2- 172.21.15.49:0/2825368550 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07480aa220 0x7f0748150330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:53.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.938+0000 7f0746d9d700 1 -- 172.21.15.49:0/2825368550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07480a7ff0 msgr2=0x7f0748151030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:53.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.938+0000 7f0746d9d700 1 --2- 172.21.15.49:0/2825368550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07480a7ff0 0x7f0748151030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:53.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.938+0000 7f0746d9d700 1 -- 172.21.15.49:0/2825368550 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0740009ae0 con 0x7f0748154530 2023-11-30T17:19:53.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.938+0000 7f0746d9d700 1 --2- 172.21.15.49:0/2825368550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0748154530 0x7f07480c9d90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f073800c440 tx=0x7f0738007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:53.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.938+0000 7f073e7fc700 1 -- 172.21.15.49:0/2825368550 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07380123f0 con 0x7f0748154530 2023-11-30T17:19:53.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.938+0000 7f073e7fc700 1 -- 172.21.15.49:0/2825368550 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0738001e90 con 0x7f0748154530 2023-11-30T17:19:53.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.938+0000 7f074cb27700 1 -- 172.21.15.49:0/2825368550 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07480c2bf0 con 0x7f0748154530 2023-11-30T17:19:53.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.938+0000 7f073e7fc700 1 -- 172.21.15.49:0/2825368550 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0738012760 con 0x7f0748154530 2023-11-30T17:19:53.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.938+0000 7f074cb27700 1 -- 172.21.15.49:0/2825368550 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07480c2320 con 0x7f0748154530 2023-11-30T17:19:53.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.939+0000 7f074cb27700 1 -- 172.21.15.49:0/2825368550 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f074806c860 con 0x7f0748154530 2023-11-30T17:19:53.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.939+0000 7f073e7fc700 1 -- 172.21.15.49:0/2825368550 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0738012b50 con 0x7f0748154530 2023-11-30T17:19:53.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.940+0000 7f073e7fc700 1 --2- 172.21.15.49:0/2825368550 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f072805f240 0x7f0728061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:53.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.940+0000 7f073e7fc700 1 -- 172.21.15.49:0/2825368550 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f0738079360 con 0x7f0748154530 2023-11-30T17:19:53.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.940+0000 7f074659c700 1 --2- 172.21.15.49:0/2825368550 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f072805f240 0x7f0728061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:53.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.940+0000 7f074659c700 1 --2- 172.21.15.49:0/2825368550 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f072805f240 0x7f0728061700 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f0740009fd0 tx=0x7f0740009840).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:53.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:53.944+0000 7f073e7fc700 1 -- 172.21.15.49:0/2825368550 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0738047b00 con 0x7f0748154530 2023-11-30T17:19:54.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:54.117+0000 7f074cb27700 1 -- 172.21.15.49:0/2825368550 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f07480c3380 con 0x7f0748154530 2023-11-30T17:19:55.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.073+0000 7f073e7fc700 1 -- 172.21.15.49:0/2825368550 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v62) v1 ==== 152+0+0 (secure 0 0 0) 0x7f07480c3380 con 0x7f0748154530 2023-11-30T17:19:55.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.079+0000 7f074cb27700 1 -- 172.21.15.49:0/2825368550 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f072805f240 msgr2=0x7f0728061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:55.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.079+0000 7f074cb27700 1 --2- 172.21.15.49:0/2825368550 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f072805f240 0x7f0728061700 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f0740009fd0 tx=0x7f0740009840).stop 2023-11-30T17:19:55.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.079+0000 7f074cb27700 1 -- 172.21.15.49:0/2825368550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0748154530 msgr2=0x7f07480c9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:55.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.079+0000 7f074cb27700 1 --2- 172.21.15.49:0/2825368550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0748154530 0x7f07480c9d90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f073800c440 tx=0x7f0738007d70).stop 2023-11-30T17:19:55.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.081+0000 7f074cb27700 1 -- 172.21.15.49:0/2825368550 shutdown_connections 2023-11-30T17:19:55.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.081+0000 7f074cb27700 1 --2- 172.21.15.49:0/2825368550 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f072805f240 0x7f0728061700 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:55.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.081+0000 7f074cb27700 1 --2- 172.21.15.49:0/2825368550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0748154530 0x7f07480c9d90 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:55.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.081+0000 7f074cb27700 1 --2- 172.21.15.49:0/2825368550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07480a7ff0 0x7f0748151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:55.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.081+0000 7f074cb27700 1 --2- 172.21.15.49:0/2825368550 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07480aa220 0x7f0748150330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:55.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.081+0000 7f074cb27700 1 -- 172.21.15.49:0/2825368550 >> 172.21.15.49:0/2825368550 conn(0x7f0748094930 msgr2=0x7f07480c0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:55.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.082+0000 7f074cb27700 1 -- 172.21.15.49:0/2825368550 shutdown_connections 2023-11-30T17:19:55.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.082+0000 7f074cb27700 1 -- 172.21.15.49:0/2825368550 wait complete. 2023-11-30T17:19:55.086 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2023-11-30T17:19:55.100 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-30T17:19:55.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.229+0000 7fd239b84700 1 Processor -- start 2023-11-30T17:19:55.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.229+0000 7fd239b84700 1 -- start start 2023-11-30T17:19:55.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.230+0000 7fd239b84700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd234098d10 0x7fd2340c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:55.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.230+0000 7fd239b84700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd2340c6190 0x7fd234063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:55.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.230+0000 7fd239b84700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2340c72d0 con 0x7fd234064350 2023-11-30T17:19:55.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.230+0000 7fd239b84700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd234154bc0 con 0x7fd2340c6190 2023-11-30T17:19:55.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.230+0000 7fd239b84700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2340c66c0 con 0x7fd234098d10 2023-11-30T17:19:55.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.230+0000 7fd232ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd2340c6190 0x7fd234063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:55.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.230+0000 7fd232ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd2340c6190 0x7fd234063e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59076/0 (socket says 172.21.15.49:59076) 2023-11-30T17:19:55.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.230+0000 7fd232ffd700 1 -- 172.21.15.49:0/1248561885 learned_addr learned my addr 172.21.15.49:0/1248561885 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:55.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.230+0000 7fd2337fe700 1 --2- 172.21.15.49:0/1248561885 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd234098d10 0x7fd2340c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:55.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.230+0000 7fd232ffd700 1 -- 172.21.15.49:0/1248561885 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd234098d10 msgr2=0x7fd2340c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:55.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.230+0000 7fd232ffd700 1 --2- 172.21.15.49:0/1248561885 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd234098d10 0x7fd2340c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:55.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.230+0000 7fd232ffd700 1 -- 172.21.15.49:0/1248561885 >> v1:172.21.15.115:6789/0 conn(0x7fd234064350 legacy=0x7fd234158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:55.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.230+0000 7fd232ffd700 1 -- 172.21.15.49:0/1248561885 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2340c69a0 con 0x7fd2340c6190 2023-11-30T17:19:55.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.230+0000 7fd2327fc700 1 -- 172.21.15.49:0/1248561885 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189833349 0 0) 0x7fd2340c72d0 con 0x7fd234064350 2023-11-30T17:19:55.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.230+0000 7fd232ffd700 1 --2- 172.21.15.49:0/1248561885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2340c6190 0x7fd234063e60 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fd228006fd0 tx=0x7fd2280090f0).ready entity=mon.0 client_cookie=43b62ec54c999fff server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:55.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.230+0000 7fd2327fc700 1 -- 172.21.15.49:0/1248561885 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22800b580 con 0x7fd2340c6190 2023-11-30T17:19:55.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.230+0000 7fd2327fc700 1 -- 172.21.15.49:0/1248561885 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22800b6e0 con 0x7fd2340c6190 2023-11-30T17:19:55.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.231+0000 7fd2327fc700 1 -- 172.21.15.49:0/1248561885 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22800ba60 con 0x7fd2340c6190 2023-11-30T17:19:55.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.231+0000 7fd239b84700 1 -- 172.21.15.49:0/1248561885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2340c6190 msgr2=0x7fd234063e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:55.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.231+0000 7fd239b84700 1 --2- 172.21.15.49:0/1248561885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2340c6190 0x7fd234063e60 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fd228006fd0 tx=0x7fd2280090f0).stop 2023-11-30T17:19:55.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.231+0000 7fd239b84700 1 -- 172.21.15.49:0/1248561885 shutdown_connections 2023-11-30T17:19:55.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.231+0000 7fd239b84700 1 --2- 172.21.15.49:0/1248561885 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd234098d10 0x7fd2340c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:55.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.231+0000 7fd239b84700 1 --2- 172.21.15.49:0/1248561885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2340c6190 0x7fd234063e60 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:55.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.231+0000 7fd239b84700 1 -- 172.21.15.49:0/1248561885 >> 172.21.15.49:0/1248561885 conn(0x7fd2340cb310 msgr2=0x7fd2340cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:55.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.231+0000 7fd239b84700 1 -- 172.21.15.49:0/1248561885 shutdown_connections 2023-11-30T17:19:55.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.231+0000 7fd239b84700 1 -- 172.21.15.49:0/1248561885 wait complete. 2023-11-30T17:19:55.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.232+0000 7fd239b84700 1 Processor -- start 2023-11-30T17:19:55.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.232+0000 7fd239b84700 1 -- start start 2023-11-30T17:19:55.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.233+0000 7fd239b84700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd234064350 0x7fd234146ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:55.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.233+0000 7fd239b84700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd234098d10 0x7fd234156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:55.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.233+0000 7fd239b84700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2340c6190 0x7fd2340c1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:55.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.233+0000 7fd239b84700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd234155180 con 0x7fd234098d10 2023-11-30T17:19:55.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.233+0000 7fd239b84700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd234155460 con 0x7fd2340c6190 2023-11-30T17:19:55.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.233+0000 7fd239b84700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd234155740 con 0x7fd234064350 2023-11-30T17:19:55.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.233+0000 7fd232ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd234098d10 0x7fd234156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:55.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.233+0000 7fd232ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd234098d10 0x7fd234156220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59086/0 (socket says 172.21.15.49:59086) 2023-11-30T17:19:55.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.233+0000 7fd232ffd700 1 -- 172.21.15.49:0/1851627178 learned_addr learned my addr 172.21.15.49:0/1851627178 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:55.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.233+0000 7fd2337fe700 1 --2- 172.21.15.49:0/1851627178 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd234064350 0x7fd234146ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:55.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.233+0000 7fd233fff700 1 --2- 172.21.15.49:0/1851627178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2340c6190 0x7fd2340c1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:55.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.233+0000 7fd232ffd700 1 -- 172.21.15.49:0/1851627178 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd234064350 msgr2=0x7fd234146ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:55.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.233+0000 7fd232ffd700 1 --2- 172.21.15.49:0/1851627178 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd234064350 0x7fd234146ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:55.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.233+0000 7fd232ffd700 1 -- 172.21.15.49:0/1851627178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2340c6190 msgr2=0x7fd2340c1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:55.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.233+0000 7fd232ffd700 1 --2- 172.21.15.49:0/1851627178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2340c6190 0x7fd2340c1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:55.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.234+0000 7fd232ffd700 1 -- 172.21.15.49:0/1851627178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd228009370 con 0x7fd234098d10 2023-11-30T17:19:55.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.234+0000 7fd232ffd700 1 --2- 172.21.15.49:0/1851627178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd234098d10 0x7fd234156220 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fd228009fd0 tx=0x7fd228017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:55.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.234+0000 7fd21b7fe700 1 -- 172.21.15.49:0/1851627178 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22800b850 con 0x7fd234098d10 2023-11-30T17:19:55.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.234+0000 7fd21b7fe700 1 -- 172.21.15.49:0/1851627178 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22800b9b0 con 0x7fd234098d10 2023-11-30T17:19:55.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.234+0000 7fd239b84700 1 -- 172.21.15.49:0/1851627178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd234155a20 con 0x7fd234098d10 2023-11-30T17:19:55.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.234+0000 7fd21b7fe700 1 -- 172.21.15.49:0/1851627178 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22801b660 con 0x7fd234098d10 2023-11-30T17:19:55.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.234+0000 7fd239b84700 1 -- 172.21.15.49:0/1851627178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd234147090 con 0x7fd234098d10 2023-11-30T17:19:55.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.235+0000 7fd239b84700 1 -- 172.21.15.49:0/1851627178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23406c860 con 0x7fd234098d10 2023-11-30T17:19:55.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.235+0000 7fd21b7fe700 1 -- 172.21.15.49:0/1851627178 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fd22801ba50 con 0x7fd234098d10 2023-11-30T17:19:55.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.236+0000 7fd21b7fe700 1 --2- 172.21.15.49:0/1851627178 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd22005f270 0x7fd220061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:55.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.236+0000 7fd21b7fe700 1 -- 172.21.15.49:0/1851627178 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5639+0+0 (secure 0 0 0) 0x7fd22807bc10 con 0x7fd234098d10 2023-11-30T17:19:55.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.236+0000 7fd2337fe700 1 --2- 172.21.15.49:0/1851627178 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd22005f270 0x7fd220061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:55.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.236+0000 7fd2337fe700 1 --2- 172.21.15.49:0/1851627178 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd22005f270 0x7fd220061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fd224009ba0 tx=0x7fd224008040).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:55.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.240+0000 7fd21b7fe700 1 -- 172.21.15.49:0/1851627178 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd22804cf40 con 0x7fd234098d10 2023-11-30T17:19:55.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:55.415+0000 7fd239b84700 1 -- 172.21.15.49:0/1851627178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd2340c6c80 con 0x7fd234098d10 2023-11-30T17:19:56.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.079+0000 7fd21b7fe700 1 -- 172.21.15.49:0/1851627178 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v63) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd22801f070 con 0x7fd234098d10 2023-11-30T17:19:56.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.087+0000 7fd239b84700 1 -- 172.21.15.49:0/1851627178 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd22005f270 msgr2=0x7fd220061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:56.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.087+0000 7fd239b84700 1 --2- 172.21.15.49:0/1851627178 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd22005f270 0x7fd220061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fd224009ba0 tx=0x7fd224008040).stop 2023-11-30T17:19:56.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.087+0000 7fd239b84700 1 -- 172.21.15.49:0/1851627178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd234098d10 msgr2=0x7fd234156220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:56.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.087+0000 7fd239b84700 1 --2- 172.21.15.49:0/1851627178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd234098d10 0x7fd234156220 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fd228009fd0 tx=0x7fd228017000).stop 2023-11-30T17:19:56.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.087+0000 7fd239b84700 1 -- 172.21.15.49:0/1851627178 shutdown_connections 2023-11-30T17:19:56.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.087+0000 7fd239b84700 1 --2- 172.21.15.49:0/1851627178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2340c6190 0x7fd2340c1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:56.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.087+0000 7fd239b84700 1 --2- 172.21.15.49:0/1851627178 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd234064350 0x7fd234146ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:56.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.087+0000 7fd239b84700 1 --2- 172.21.15.49:0/1851627178 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd22005f270 0x7fd220061730 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:56.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.087+0000 7fd239b84700 1 --2- 172.21.15.49:0/1851627178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd234098d10 0x7fd234156220 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:56.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.088+0000 7fd239b84700 1 -- 172.21.15.49:0/1851627178 >> 172.21.15.49:0/1851627178 conn(0x7fd2340cb310 msgr2=0x7fd234148940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:56.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.090+0000 7fd239b84700 1 -- 172.21.15.49:0/1851627178 shutdown_connections 2023-11-30T17:19:56.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.090+0000 7fd239b84700 1 -- 172.21.15.49:0/1851627178 wait complete. 2023-11-30T17:19:56.097 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2023-11-30T17:19:56.118 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-30T17:19:56.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.239+0000 7f68e2549700 1 Processor -- start 2023-11-30T17:19:56.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.239+0000 7f68e2549700 1 -- start start 2023-11-30T17:19:56.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.240+0000 7f68e2549700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f68dc098d10 0x7f68dc0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:56.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.240+0000 7f68e2549700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f68dc0c6190 0x7f68dc063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:56.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.240+0000 7f68e2549700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f68dc064350 0x7f68dc158320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:56.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.240+0000 7f68e2549700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68dc0c72d0 con 0x7f68dc098d10 2023-11-30T17:19:56.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.240+0000 7f68e2549700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68dc154bc0 con 0x7f68dc064350 2023-11-30T17:19:56.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.240+0000 7f68e2549700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc0c66c0 con 0x7f68dc0c6190 2023-11-30T17:19:56.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.240+0000 7f68dbfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f68dc098d10 0x7f68dc0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:56.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.240+0000 7f68dbfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f68dc098d10 0x7f68dc0c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59102/0 (socket says 172.21.15.49:59102) 2023-11-30T17:19:56.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.240+0000 7f68dbfff700 1 -- 172.21.15.49:0/4051209879 learned_addr learned my addr 172.21.15.49:0/4051209879 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:56.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.241+0000 7f68e0ae6700 1 --2- 172.21.15.49:0/4051209879 >> v2:172.21.15.115:3300/0 conn(0x7f68dc064350 0x7f68dc158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:56.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.241+0000 7f68db7fe700 1 --2- 172.21.15.49:0/4051209879 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f68dc0c6190 0x7f68dc063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:56.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.241+0000 7f68dbfff700 1 -- 172.21.15.49:0/4051209879 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f68dc0c6190 msgr2=0x7f68dc063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:56.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.241+0000 7f68dbfff700 1 --2- 172.21.15.49:0/4051209879 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f68dc0c6190 0x7f68dc063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:56.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.241+0000 7f68dbfff700 1 -- 172.21.15.49:0/4051209879 >> v2:172.21.15.115:3300/0 conn(0x7f68dc064350 msgr2=0x7f68dc158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:56.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.241+0000 7f68dbfff700 1 --2- 172.21.15.49:0/4051209879 >> v2:172.21.15.115:3300/0 conn(0x7f68dc064350 0x7f68dc158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:56.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.241+0000 7f68dbfff700 1 -- 172.21.15.49:0/4051209879 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68dc0c69a0 con 0x7f68dc098d10 2023-11-30T17:19:56.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.241+0000 7f68dbfff700 1 --2- 172.21.15.49:0/4051209879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68dc098d10 0x7f68dc0c7760 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f68dc084b10 tx=0x7f68cc0090f0).ready entity=mon.0 client_cookie=4b7f6cb98779ae29 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:56.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.241+0000 7f68daffd700 1 -- 172.21.15.49:0/4051209879 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68cc00b600 con 0x7f68dc098d10 2023-11-30T17:19:56.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.241+0000 7f68daffd700 1 -- 172.21.15.49:0/4051209879 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68cc00b760 con 0x7f68dc098d10 2023-11-30T17:19:56.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.241+0000 7f68daffd700 1 -- 172.21.15.49:0/4051209879 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68cc00bae0 con 0x7f68dc098d10 2023-11-30T17:19:56.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.241+0000 7f68e2549700 1 -- 172.21.15.49:0/4051209879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68dc098d10 msgr2=0x7f68dc0c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:56.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.241+0000 7f68e2549700 1 --2- 172.21.15.49:0/4051209879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68dc098d10 0x7f68dc0c7760 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f68dc084b10 tx=0x7f68cc0090f0).stop 2023-11-30T17:19:56.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.241+0000 7f68e2549700 1 -- 172.21.15.49:0/4051209879 shutdown_connections 2023-11-30T17:19:56.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.241+0000 7f68e2549700 1 --2- 172.21.15.49:0/4051209879 >> v2:172.21.15.115:3300/0 conn(0x7f68dc064350 0x7f68dc158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:56.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.241+0000 7f68e2549700 1 --2- 172.21.15.49:0/4051209879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68dc098d10 0x7f68dc0c7760 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:56.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.241+0000 7f68e2549700 1 --2- 172.21.15.49:0/4051209879 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f68dc0c6190 0x7f68dc063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:56.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.241+0000 7f68e2549700 1 -- 172.21.15.49:0/4051209879 >> 172.21.15.49:0/4051209879 conn(0x7f68dc0cb310 msgr2=0x7f68dc0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:56.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.242+0000 7f68e2549700 1 -- 172.21.15.49:0/4051209879 shutdown_connections 2023-11-30T17:19:56.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.242+0000 7f68e2549700 1 -- 172.21.15.49:0/4051209879 wait complete. 2023-11-30T17:19:56.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.243+0000 7f68e2549700 1 Processor -- start 2023-11-30T17:19:56.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.243+0000 7f68e2549700 1 -- start start 2023-11-30T17:19:56.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.243+0000 7f68e2549700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f68dc064350 0x7f68dc165480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:56.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.243+0000 7f68e2549700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68dc098d10 0x7f68dc1562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:56.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.243+0000 7f68e2549700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68dc0c6190 0x7f68dc0abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:56.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.244+0000 7f68e2549700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc0aad70 con 0x7f68dc098d10 2023-11-30T17:19:56.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.244+0000 7f68e2549700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc0aaf80 con 0x7f68dc0c6190 2023-11-30T17:19:56.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.244+0000 7f68e2549700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc0ab260 con 0x7f68dc064350 2023-11-30T17:19:56.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.244+0000 7f68db7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68dc098d10 0x7f68dc1562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:56.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.244+0000 7f68db7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68dc098d10 0x7f68dc1562f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59108/0 (socket says 172.21.15.49:59108) 2023-11-30T17:19:56.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.244+0000 7f68db7fe700 1 -- 172.21.15.49:0/3366001828 learned_addr learned my addr 172.21.15.49:0/3366001828 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:56.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.244+0000 7f68e0ae6700 1 --2- 172.21.15.49:0/3366001828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68dc0c6190 0x7f68dc0abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:56.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.244+0000 7f68dbfff700 1 --2- 172.21.15.49:0/3366001828 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f68dc064350 0x7f68dc165480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:56.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.244+0000 7f68db7fe700 1 -- 172.21.15.49:0/3366001828 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f68dc064350 msgr2=0x7f68dc165480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:56.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.244+0000 7f68db7fe700 1 --2- 172.21.15.49:0/3366001828 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f68dc064350 0x7f68dc165480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:56.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.244+0000 7f68db7fe700 1 -- 172.21.15.49:0/3366001828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68dc0c6190 msgr2=0x7f68dc0abd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:56.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.244+0000 7f68db7fe700 1 --2- 172.21.15.49:0/3366001828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68dc0c6190 0x7f68dc0abd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:56.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.244+0000 7f68db7fe700 1 -- 172.21.15.49:0/3366001828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68cc009370 con 0x7f68dc098d10 2023-11-30T17:19:56.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.244+0000 7f68db7fe700 1 --2- 172.21.15.49:0/3366001828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68dc098d10 0x7f68dc1562f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f68d0006980 tx=0x7f68d0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:56.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.244+0000 7f68c3fff700 1 -- 172.21.15.49:0/3366001828 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d0011590 con 0x7f68dc098d10 2023-11-30T17:19:56.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.244+0000 7f68c3fff700 1 -- 172.21.15.49:0/3366001828 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d00116f0 con 0x7f68dc098d10 2023-11-30T17:19:56.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.244+0000 7f68e2549700 1 -- 172.21.15.49:0/3366001828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68dc0ab540 con 0x7f68dc098d10 2023-11-30T17:19:56.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.244+0000 7f68c3fff700 1 -- 172.21.15.49:0/3366001828 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d0011a90 con 0x7f68dc098d10 2023-11-30T17:19:56.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.244+0000 7f68e2549700 1 -- 172.21.15.49:0/3366001828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68dc151180 con 0x7f68dc098d10 2023-11-30T17:19:56.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.245+0000 7f68e2549700 1 -- 172.21.15.49:0/3366001828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68dc06c860 con 0x7f68dc098d10 2023-11-30T17:19:56.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.246+0000 7f68c3fff700 1 -- 172.21.15.49:0/3366001828 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f68d0012420 con 0x7f68dc098d10 2023-11-30T17:19:56.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.246+0000 7f68c3fff700 1 --2- 172.21.15.49:0/3366001828 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f68c805f270 0x7f68c8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:56.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.246+0000 7f68c3fff700 1 -- 172.21.15.49:0/3366001828 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f68d0079cd0 con 0x7f68dc098d10 2023-11-30T17:19:56.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.246+0000 7f68dbfff700 1 --2- 172.21.15.49:0/3366001828 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f68c805f270 0x7f68c8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:56.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.247+0000 7f68dbfff700 1 --2- 172.21.15.49:0/3366001828 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f68c805f270 0x7f68c8061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f68cc009130 tx=0x7f68cc017000).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:56.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.251+0000 7f68c3fff700 1 -- 172.21.15.49:0/3366001828 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f68d004ae20 con 0x7f68dc098d10 2023-11-30T17:19:56.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.466+0000 7f68e2549700 1 -- 172.21.15.49:0/3366001828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f68dc0c6c80 con 0x7f68dc098d10 2023-11-30T17:19:56.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.473+0000 7f68c3fff700 1 -- 172.21.15.49:0/3366001828 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v20) v1 ==== 172+0+0 (secure 0 0 0) 0x7f68d004e440 con 0x7f68dc098d10 2023-11-30T17:19:56.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.477+0000 7f68e2549700 1 -- 172.21.15.49:0/3366001828 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f68c805f270 msgr2=0x7f68c8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:56.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.477+0000 7f68e2549700 1 --2- 172.21.15.49:0/3366001828 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f68c805f270 0x7f68c8061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f68cc009130 tx=0x7f68cc017000).stop 2023-11-30T17:19:56.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.477+0000 7f68e2549700 1 -- 172.21.15.49:0/3366001828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68dc098d10 msgr2=0x7f68dc1562f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:56.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.477+0000 7f68e2549700 1 --2- 172.21.15.49:0/3366001828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68dc098d10 0x7f68dc1562f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f68d0006980 tx=0x7f68d0008040).stop 2023-11-30T17:19:56.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.479+0000 7f68e2549700 1 -- 172.21.15.49:0/3366001828 shutdown_connections 2023-11-30T17:19:56.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.479+0000 7f68e2549700 1 --2- 172.21.15.49:0/3366001828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68dc0c6190 0x7f68dc0abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:56.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.479+0000 7f68e2549700 1 --2- 172.21.15.49:0/3366001828 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f68dc064350 0x7f68dc165480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:56.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.479+0000 7f68e2549700 1 --2- 172.21.15.49:0/3366001828 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f68c805f270 0x7f68c8061730 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:56.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.479+0000 7f68e2549700 1 --2- 172.21.15.49:0/3366001828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68dc098d10 0x7f68dc1562f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:56.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.479+0000 7f68e2549700 1 -- 172.21.15.49:0/3366001828 >> 172.21.15.49:0/3366001828 conn(0x7f68dc0cb310 msgr2=0x7f68dc151a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:56.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.493+0000 7f68e2549700 1 -- 172.21.15.49:0/3366001828 shutdown_connections 2023-11-30T17:19:56.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.493+0000 7f68e2549700 1 -- 172.21.15.49:0/3366001828 wait complete. 2023-11-30T17:19:56.497 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 7 and data pool 8 2023-11-30T17:19:56.512 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:19:56.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.626+0000 7f6c7307f700 1 Processor -- start 2023-11-30T17:19:56.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.626+0000 7f6c7307f700 1 -- start start 2023-11-30T17:19:56.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.627+0000 7f6c7307f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c6c0cae90 0x7f6c6c0c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:56.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.627+0000 7f6c7307f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c6c0a9a90 con 0x7f6c6c0caab0 2023-11-30T17:19:56.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.627+0000 7f6c7307f700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c6c154ce0 con 0x7f6c6c0ca180 2023-11-30T17:19:56.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.627+0000 7f6c7307f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c0aab80 con 0x7f6c6c0cae90 2023-11-30T17:19:56.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.627+0000 7f6c70e1b700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6c6c0caab0 0x7f6c6c0aa470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58378/0 (socket says 172.21.15.49:58378) 2023-11-30T17:19:56.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.627+0000 7f6c70e1b700 1 -- 172.21.15.49:0/4125637706 learned_addr learned my addr 172.21.15.49:0/4125637706 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:56.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.627+0000 7f6c6bfff700 1 --2- 172.21.15.49:0/4125637706 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c6c0cae90 0x7f6c6c0c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:56.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.627+0000 7f6c6b7fe700 1 -- 172.21.15.49:0/4125637706 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4083841654 0 0) 0x7f6c6c0a9a90 con 0x7f6c6c0caab0 2023-11-30T17:19:56.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.628+0000 7f6c6b7fe700 1 -- 172.21.15.49:0/4125637706 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c540033f0 con 0x7f6c6c0caab0 2023-11-30T17:19:56.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.628+0000 7f6c6b7fe700 1 -- 172.21.15.49:0/4125637706 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2467446271 0 0) 0x7f6c540033f0 con 0x7f6c6c0caab0 2023-11-30T17:19:56.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.628+0000 7f6c6b7fe700 1 -- 172.21.15.49:0/4125637706 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c6c0cae90 msgr2=0x7f6c6c0c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:56.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.628+0000 7f6c6b7fe700 1 --2- 172.21.15.49:0/4125637706 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c6c0cae90 0x7f6c6c0c0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:56.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.628+0000 7f6c6b7fe700 1 -- 172.21.15.49:0/4125637706 >> v1:172.21.15.115:6789/0 conn(0x7f6c6c0ca180 legacy=0x7f6c6c15e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:56.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.628+0000 7f6c6b7fe700 1 -- 172.21.15.49:0/4125637706 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6c0a8e80 con 0x7f6c6c0caab0 2023-11-30T17:19:56.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.628+0000 7f6c6b7fe700 1 -- 172.21.15.49:0/4125637706 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f6c64001970 con 0x7f6c6c0caab0 2023-11-30T17:19:56.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.628+0000 7f6c6b7fe700 1 -- 172.21.15.49:0/4125637706 >> v1:172.21.15.49:6789/0 conn(0x7f6c6c0caab0 legacy=0x7f6c6c0aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:56.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.628+0000 7f6c6b7fe700 1 --2- 172.21.15.49:0/4125637706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c54003910 0x7f6c54003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:56.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.628+0000 7f6c6b7fe700 1 --2- 172.21.15.49:0/4125637706 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c6c0cae90 0x7f6c54004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:56.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.628+0000 7f6c6b7fe700 1 --2- 172.21.15.49:0/4125637706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c54004b80 0x7f6c54005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:56.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.628+0000 7f6c6b7fe700 1 -- 172.21.15.49:0/4125637706 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c0aab80 con 0x7f6c54004b80 2023-11-30T17:19:56.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.628+0000 7f6c6b7fe700 1 -- 172.21.15.49:0/4125637706 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5400b8e0 con 0x7f6c54003910 2023-11-30T17:19:56.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.628+0000 7f6c6b7fe700 1 -- 172.21.15.49:0/4125637706 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5400ba50 con 0x7f6c6c0cae90 2023-11-30T17:19:56.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.628+0000 7f6c70e1b700 1 --2- 172.21.15.49:0/4125637706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c54003910 0x7f6c54003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:56.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.628+0000 7f6c7161c700 1 --2- 172.21.15.49:0/4125637706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c54004b80 0x7f6c54005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:56.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.628+0000 7f6c6bfff700 1 --2- 172.21.15.49:0/4125637706 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c6c0cae90 0x7f6c54004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:56.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.628+0000 7f6c7161c700 1 -- 172.21.15.49:0/4125637706 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c6c0cae90 msgr2=0x7f6c54004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:56.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.628+0000 7f6c7161c700 1 --2- 172.21.15.49:0/4125637706 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c6c0cae90 0x7f6c54004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:56.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.628+0000 7f6c7161c700 1 -- 172.21.15.49:0/4125637706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c54003910 msgr2=0x7f6c54003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:56.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.628+0000 7f6c7161c700 1 --2- 172.21.15.49:0/4125637706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c54003910 0x7f6c54003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:56.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.628+0000 7f6c7161c700 1 -- 172.21.15.49:0/4125637706 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c540033f0 con 0x7f6c54004b80 2023-11-30T17:19:56.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.628+0000 7f6c7161c700 1 --2- 172.21.15.49:0/4125637706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c54004b80 0x7f6c54005000 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f6c6c084890 tx=0x7f6c5c007b90).ready entity=mon.0 client_cookie=992553d3deb21fea server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:56.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.629+0000 7f6c6b7fe700 1 -- 172.21.15.49:0/4125637706 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c007ea0 con 0x7f6c54004b80 2023-11-30T17:19:56.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.629+0000 7f6c6b7fe700 1 -- 172.21.15.49:0/4125637706 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5c012400 con 0x7f6c54004b80 2023-11-30T17:19:56.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.629+0000 7f6c6b7fe700 1 -- 172.21.15.49:0/4125637706 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c0127a0 con 0x7f6c54004b80 2023-11-30T17:19:56.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.629+0000 7f6c7307f700 1 -- 172.21.15.49:0/4125637706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c54004b80 msgr2=0x7f6c54005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:56.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.629+0000 7f6c7307f700 1 --2- 172.21.15.49:0/4125637706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c54004b80 0x7f6c54005000 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f6c6c084890 tx=0x7f6c5c007b90).stop 2023-11-30T17:19:56.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.629+0000 7f6c7161c700 1 -- 172.21.15.49:0/4125637706 reap_dead start 2023-11-30T17:19:56.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.629+0000 7f6c7307f700 1 -- 172.21.15.49:0/4125637706 shutdown_connections 2023-11-30T17:19:56.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.629+0000 7f6c7307f700 1 -- 172.21.15.49:0/4125637706 >> 172.21.15.49:0/4125637706 conn(0x7f6c6c094920 msgr2=0x7f6c6c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:56.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.629+0000 7f6c7307f700 1 -- 172.21.15.49:0/4125637706 shutdown_connections 2023-11-30T17:19:56.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.629+0000 7f6c7307f700 1 -- 172.21.15.49:0/4125637706 wait complete. 2023-11-30T17:19:56.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.630+0000 7f6c7307f700 1 Processor -- start 2023-11-30T17:19:56.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.630+0000 7f6c7307f700 1 -- start start 2023-11-30T17:19:56.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.631+0000 7f6c7307f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c54004b80 0x7f6c6c0c2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:56.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.631+0000 7f6c7307f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c6c0acf90 0x7f6c6c14dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:56.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.631+0000 7f6c7307f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c6c14e390 0x7f6c6c0aa000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:56.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.631+0000 7f6c7307f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c0c2af0 con 0x7f6c6c14e390 2023-11-30T17:19:56.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.631+0000 7f6c7307f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c0c2dd0 con 0x7f6c6c0acf90 2023-11-30T17:19:56.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.631+0000 7f6c7307f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c0c30b0 con 0x7f6c54004b80 2023-11-30T17:19:56.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.631+0000 7f6c7161c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c6c14e390 0x7f6c6c0aa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:56.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.631+0000 7f6c7161c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c6c14e390 0x7f6c6c0aa000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59126/0 (socket says 172.21.15.49:59126) 2023-11-30T17:19:56.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.631+0000 7f6c7161c700 1 -- 172.21.15.49:0/171125421 learned_addr learned my addr 172.21.15.49:0/171125421 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:56.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.631+0000 7f6c6bfff700 1 --2- 172.21.15.49:0/171125421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c6c0acf90 0x7f6c6c14dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:56.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.631+0000 7f6c70e1b700 1 --2- 172.21.15.49:0/171125421 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c54004b80 0x7f6c6c0c2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:56.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.632+0000 7f6c7161c700 1 -- 172.21.15.49:0/171125421 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c54004b80 msgr2=0x7f6c6c0c2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:56.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.632+0000 7f6c7161c700 1 --2- 172.21.15.49:0/171125421 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c54004b80 0x7f6c6c0c2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:56.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.632+0000 7f6c7161c700 1 -- 172.21.15.49:0/171125421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c6c0acf90 msgr2=0x7f6c6c14dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:56.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.632+0000 7f6c7161c700 1 --2- 172.21.15.49:0/171125421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c6c0acf90 0x7f6c6c14dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:56.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.632+0000 7f6c7161c700 1 -- 172.21.15.49:0/171125421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6c0aec70 con 0x7f6c6c14e390 2023-11-30T17:19:56.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.632+0000 7f6c7161c700 1 --2- 172.21.15.49:0/171125421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c6c14e390 0x7f6c6c0aa000 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f6c540045b0 tx=0x7f6c5c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:56.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.632+0000 7f6c68ff9700 1 -- 172.21.15.49:0/171125421 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c007ea0 con 0x7f6c6c14e390 2023-11-30T17:19:56.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.632+0000 7f6c68ff9700 1 -- 172.21.15.49:0/171125421 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5c011ad0 con 0x7f6c6c14e390 2023-11-30T17:19:56.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.632+0000 7f6c68ff9700 1 -- 172.21.15.49:0/171125421 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c011e90 con 0x7f6c6c14e390 2023-11-30T17:19:56.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.632+0000 7f6c7307f700 1 -- 172.21.15.49:0/171125421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c6c0c2800 con 0x7f6c6c14e390 2023-11-30T17:19:56.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.632+0000 7f6c7307f700 1 -- 172.21.15.49:0/171125421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c6c0aa4f0 con 0x7f6c6c14e390 2023-11-30T17:19:56.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.633+0000 7f6c7307f700 1 -- 172.21.15.49:0/171125421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c6c0aee00 con 0x7f6c6c14e390 2023-11-30T17:19:56.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.633+0000 7f6c68ff9700 1 -- 172.21.15.49:0/171125421 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6c5c019070 con 0x7f6c6c14e390 2023-11-30T17:19:56.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.634+0000 7f6c68ff9700 1 --2- 172.21.15.49:0/171125421 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6c5805f240 0x7f6c58061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:56.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.634+0000 7f6c68ff9700 1 -- 172.21.15.49:0/171125421 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6c5c07a8e0 con 0x7f6c6c14e390 2023-11-30T17:19:56.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.634+0000 7f6c70e1b700 1 --2- 172.21.15.49:0/171125421 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6c5805f240 0x7f6c58061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:56.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.634+0000 7f6c70e1b700 1 --2- 172.21.15.49:0/171125421 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6c5805f240 0x7f6c58061700 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f6c64001190 tx=0x7f6c64009040).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:56.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.638+0000 7f6c68ff9700 1 -- 172.21.15.49:0/171125421 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6c5c04b970 con 0x7f6c6c14e390 2023-11-30T17:19:56.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.812+0000 7f6c7307f700 1 -- 172.21.15.49:0/171125421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c6c06c860 con 0x7f6c6c14e390 2023-11-30T17:19:56.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.813+0000 7f6c68ff9700 1 -- 172.21.15.49:0/171125421 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16941 (secure 0 0 0) 0x7f6c5c021070 con 0x7f6c6c14e390 2023-11-30T17:19:56.816 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:19:56.816 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":64,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:19:56.468220+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:19:54.153609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-30T17:19:55.451988+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:19:56.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.815+0000 7f6c7307f700 1 -- 172.21.15.49:0/171125421 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6c5805f240 msgr2=0x7f6c58061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:56.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.815+0000 7f6c7307f700 1 --2- 172.21.15.49:0/171125421 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6c5805f240 0x7f6c58061700 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f6c64001190 tx=0x7f6c64009040).stop 2023-11-30T17:19:56.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.815+0000 7f6c7307f700 1 -- 172.21.15.49:0/171125421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c6c14e390 msgr2=0x7f6c6c0aa000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:56.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.815+0000 7f6c7307f700 1 --2- 172.21.15.49:0/171125421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c6c14e390 0x7f6c6c0aa000 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f6c540045b0 tx=0x7f6c5c017000).stop 2023-11-30T17:19:56.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.815+0000 7f6c7307f700 1 -- 172.21.15.49:0/171125421 shutdown_connections 2023-11-30T17:19:56.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.815+0000 7f6c7307f700 1 --2- 172.21.15.49:0/171125421 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6c5805f240 0x7f6c58061700 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:56.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.815+0000 7f6c7307f700 1 --2- 172.21.15.49:0/171125421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c6c14e390 0x7f6c6c0aa000 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:56.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.815+0000 7f6c7307f700 1 --2- 172.21.15.49:0/171125421 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c54004b80 0x7f6c6c0c2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:56.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.815+0000 7f6c7307f700 1 --2- 172.21.15.49:0/171125421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c6c0acf90 0x7f6c6c14dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:56.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.815+0000 7f6c7307f700 1 -- 172.21.15.49:0/171125421 >> 172.21.15.49:0/171125421 conn(0x7f6c6c094920 msgr2=0x7f6c6c159fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:56.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.815+0000 7f6c7307f700 1 -- 172.21.15.49:0/171125421 shutdown_connections 2023-11-30T17:19:56.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.815+0000 7f6c7307f700 1 -- 172.21.15.49:0/171125421 wait complete. 2023-11-30T17:19:56.830 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:19:56.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.946+0000 7f96b7178700 1 Processor -- start 2023-11-30T17:19:56.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.946+0000 7f96b7178700 1 -- start start 2023-11-30T17:19:56.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.947+0000 7f96b7178700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f96b0069900 0x7f96b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:56.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.947+0000 7f96b7178700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b006a270 con 0x7f96b0150890 2023-11-30T17:19:56.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.947+0000 7f96b7178700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b00c28c0 con 0x7f96b01544f0 2023-11-30T17:19:56.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.947+0000 7f96b7178700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96b01552e0 con 0x7f96b0069900 2023-11-30T17:19:56.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.947+0000 7f96b4f14700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f96b0150890 0x7f96b00bbe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58386/0 (socket says 172.21.15.49:58386) 2023-11-30T17:19:56.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.947+0000 7f96affff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f96b0069900 0x7f96b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:56.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.947+0000 7f96b4f14700 1 -- 172.21.15.49:0/2548658239 learned_addr learned my addr 172.21.15.49:0/2548658239 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:56.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.947+0000 7f96affff700 1 -- 172.21.15.49:0/2548658239 >> v1:172.21.15.115:6789/0 conn(0x7f96b01544f0 legacy=0x7f96b00c2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:56.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.947+0000 7f96affff700 1 -- 172.21.15.49:0/2548658239 >> v1:172.21.15.49:6789/0 conn(0x7f96b0150890 legacy=0x7f96b00bbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:56.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.947+0000 7f96affff700 1 -- 172.21.15.49:0/2548658239 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b00bc540 con 0x7f96b0069900 2023-11-30T17:19:56.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.947+0000 7f96af7fe700 1 -- 172.21.15.49:0/2548658239 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2812112073 0 0) 0x7f96a8001490 con 0x7f96b0150890 2023-11-30T17:19:56.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.947+0000 7f96affff700 1 --2- 172.21.15.49:0/2548658239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96b0069900 0x7f96b0069d80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f9698009760 tx=0x7f9698009060).ready entity=mon.0 client_cookie=9dd27b3453e5e81b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:56.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.947+0000 7f96af7fe700 1 -- 172.21.15.49:0/2548658239 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969800b520 con 0x7f96b0069900 2023-11-30T17:19:56.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.947+0000 7f96af7fe700 1 -- 172.21.15.49:0/2548658239 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969800b680 con 0x7f96b0069900 2023-11-30T17:19:56.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.947+0000 7f96af7fe700 1 -- 172.21.15.49:0/2548658239 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969800ba00 con 0x7f96b0069900 2023-11-30T17:19:56.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.948+0000 7f96b7178700 1 -- 172.21.15.49:0/2548658239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96b0069900 msgr2=0x7f96b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:56.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.948+0000 7f96b7178700 1 --2- 172.21.15.49:0/2548658239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96b0069900 0x7f96b0069d80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f9698009760 tx=0x7f9698009060).stop 2023-11-30T17:19:56.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.948+0000 7f96b7178700 1 -- 172.21.15.49:0/2548658239 shutdown_connections 2023-11-30T17:19:56.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.948+0000 7f96b7178700 1 --2- 172.21.15.49:0/2548658239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96b0069900 0x7f96b0069d80 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:56.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.948+0000 7f96b7178700 1 -- 172.21.15.49:0/2548658239 >> 172.21.15.49:0/2548658239 conn(0x7f96b00631d0 msgr2=0x7f96b00c6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:56.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.948+0000 7f96b7178700 1 -- 172.21.15.49:0/2548658239 shutdown_connections 2023-11-30T17:19:56.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.948+0000 7f96b7178700 1 -- 172.21.15.49:0/2548658239 wait complete. 2023-11-30T17:19:56.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.949+0000 7f96b7178700 1 Processor -- start 2023-11-30T17:19:56.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.949+0000 7f96b7178700 1 -- start start 2023-11-30T17:19:56.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.950+0000 7f96b7178700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96b0069900 0x7f96b00c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:56.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.950+0000 7f96b7178700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96b0150890 0x7f96b00c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:56.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.950+0000 7f96b7178700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96b01544f0 0x7f96b01530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:56.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.950+0000 7f96b7178700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b00c6c50 con 0x7f96b0069900 2023-11-30T17:19:56.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.950+0000 7f96b7178700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b00c6040 con 0x7f96b01544f0 2023-11-30T17:19:56.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.950+0000 7f96b7178700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b00c6320 con 0x7f96b0150890 2023-11-30T17:19:56.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.950+0000 7f96b4f14700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96b0069900 0x7f96b00c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:56.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.950+0000 7f96b4f14700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96b0069900 0x7f96b00c5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59150/0 (socket says 172.21.15.49:59150) 2023-11-30T17:19:56.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.950+0000 7f96b4f14700 1 -- 172.21.15.49:0/2977122613 learned_addr learned my addr 172.21.15.49:0/2977122613 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.950+0000 7f96b5715700 1 --2- 172.21.15.49:0/2977122613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96b01544f0 0x7f96b01530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.950+0000 7f96affff700 1 --2- 172.21.15.49:0/2977122613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96b0150890 0x7f96b00c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.950+0000 7f96b4f14700 1 -- 172.21.15.49:0/2977122613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96b0150890 msgr2=0x7f96b00c70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.950+0000 7f96b4f14700 1 --2- 172.21.15.49:0/2977122613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96b0150890 0x7f96b00c70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.950+0000 7f96b4f14700 1 -- 172.21.15.49:0/2977122613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96b01544f0 msgr2=0x7f96b01530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.950+0000 7f96b4f14700 1 --2- 172.21.15.49:0/2977122613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96b01544f0 0x7f96b01530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.950+0000 7f96b4f14700 1 -- 172.21.15.49:0/2977122613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96980092a0 con 0x7f96b0069900 2023-11-30T17:19:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.951+0000 7f96b4f14700 1 --2- 172.21.15.49:0/2977122613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96b0069900 0x7f96b00c5a60 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f96a800eb70 tx=0x7f96a8007ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.951+0000 7f96acff9700 1 -- 172.21.15.49:0/2977122613 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a8005d30 con 0x7f96b0069900 2023-11-30T17:19:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.951+0000 7f96acff9700 1 -- 172.21.15.49:0/2977122613 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a8005e90 con 0x7f96b0069900 2023-11-30T17:19:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.951+0000 7f96b7178700 1 -- 172.21.15.49:0/2977122613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b00c6600 con 0x7f96b0069900 2023-11-30T17:19:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.951+0000 7f96acff9700 1 -- 172.21.15.49:0/2977122613 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a800c9f0 con 0x7f96b0069900 2023-11-30T17:19:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.951+0000 7f96b7178700 1 -- 172.21.15.49:0/2977122613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b01535a0 con 0x7f96b0069900 2023-11-30T17:19:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.952+0000 7f96b7178700 1 -- 172.21.15.49:0/2977122613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b006c860 con 0x7f96b0069900 2023-11-30T17:19:56.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.952+0000 7f96acff9700 1 -- 172.21.15.49:0/2977122613 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f96a8007110 con 0x7f96b0069900 2023-11-30T17:19:56.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.952+0000 7f96acff9700 1 --2- 172.21.15.49:0/2977122613 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f969005f270 0x7f9690061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:56.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.952+0000 7f96acff9700 1 -- 172.21.15.49:0/2977122613 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f96a807c7f0 con 0x7f96b0069900 2023-11-30T17:19:56.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.953+0000 7f96affff700 1 --2- 172.21.15.49:0/2977122613 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f969005f270 0x7f9690061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:56.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.953+0000 7f96affff700 1 --2- 172.21.15.49:0/2977122613 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f969005f270 0x7f9690061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f969800b2e0 tx=0x7f9698017000).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:56.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:56.957+0000 7f96acff9700 1 -- 172.21.15.49:0/2977122613 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f96a804d8e0 con 0x7f96b0069900 2023-11-30T17:19:57.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.131+0000 7f96b7178700 1 -- 172.21.15.49:0/2977122613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96b006a270 con 0x7f96b0069900 2023-11-30T17:19:57.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.132+0000 7f96acff9700 1 -- 172.21.15.49:0/2977122613 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16941 (secure 0 0 0) 0x7f96b006a270 con 0x7f96b0069900 2023-11-30T17:19:57.135 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:19:57.135 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":64,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:19:56.468220+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:19:54.153609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-30T17:19:55.451988+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:19:57.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.134+0000 7f96b7178700 1 -- 172.21.15.49:0/2977122613 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f969005f270 msgr2=0x7f9690061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:57.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.134+0000 7f96b7178700 1 --2- 172.21.15.49:0/2977122613 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f969005f270 0x7f9690061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f969800b2e0 tx=0x7f9698017000).stop 2023-11-30T17:19:57.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.134+0000 7f96b7178700 1 -- 172.21.15.49:0/2977122613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96b0069900 msgr2=0x7f96b00c5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:57.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.134+0000 7f96b7178700 1 --2- 172.21.15.49:0/2977122613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96b0069900 0x7f96b00c5a60 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f96a800eb70 tx=0x7f96a8007ee0).stop 2023-11-30T17:19:57.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.134+0000 7f96b7178700 1 -- 172.21.15.49:0/2977122613 shutdown_connections 2023-11-30T17:19:57.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.134+0000 7f96b7178700 1 --2- 172.21.15.49:0/2977122613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96b01544f0 0x7f96b01530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:57.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.134+0000 7f96b7178700 1 --2- 172.21.15.49:0/2977122613 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f969005f270 0x7f9690061730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:57.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.134+0000 7f96b7178700 1 --2- 172.21.15.49:0/2977122613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96b0069900 0x7f96b00c5a60 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:57.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.134+0000 7f96b7178700 1 --2- 172.21.15.49:0/2977122613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96b0150890 0x7f96b00c70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:57.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.134+0000 7f96b7178700 1 -- 172.21.15.49:0/2977122613 >> 172.21.15.49:0/2977122613 conn(0x7f96b00631d0 msgr2=0x7f96b00c05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:57.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.134+0000 7f96b7178700 1 -- 172.21.15.49:0/2977122613 shutdown_connections 2023-11-30T17:19:57.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.134+0000 7f96b7178700 1 -- 172.21.15.49:0/2977122613 wait complete. 2023-11-30T17:19:57.149 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-30T17:19:57.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.268+0000 7f70f18c8700 1 Processor -- start 2023-11-30T17:19:57.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.268+0000 7f70f18c8700 1 -- start start 2023-11-30T17:19:57.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.269+0000 7f70f18c8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70ec0a8280 0x7f70ec0a8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:57.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.269+0000 7f70f18c8700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70ec067770 con 0x7f70ec14e600 2023-11-30T17:19:57.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.269+0000 7f70f18c8700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70ec0be8d0 con 0x7f70ec158160 2023-11-30T17:19:57.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.269+0000 7f70f18c8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec159180 con 0x7f70ec0a8280 2023-11-30T17:19:57.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.269+0000 7f70eb7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f70ec14e600 0x7f70ec14eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58388/0 (socket says 172.21.15.49:58388) 2023-11-30T17:19:57.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.269+0000 7f70eb7fe700 1 -- 172.21.15.49:0/374642602 learned_addr learned my addr 172.21.15.49:0/374642602 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:57.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.269+0000 7f70eaffd700 1 --2- 172.21.15.49:0/374642602 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70ec0a8280 0x7f70ec0a8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:57.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.270+0000 7f70e9ffb700 1 -- 172.21.15.49:0/374642602 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 796809043 0 0) 0x7f70ec067770 con 0x7f70ec14e600 2023-11-30T17:19:57.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.270+0000 7f70e9ffb700 1 -- 172.21.15.49:0/374642602 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70d80033f0 con 0x7f70ec14e600 2023-11-30T17:19:57.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.270+0000 7f70e9ffb700 1 -- 172.21.15.49:0/374642602 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2120806726 0 0) 0x7f70ec0be8d0 con 0x7f70ec158160 2023-11-30T17:19:57.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.270+0000 7f70e9ffb700 1 -- 172.21.15.49:0/374642602 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70ec067770 con 0x7f70ec158160 2023-11-30T17:19:57.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.270+0000 7f70eaffd700 1 -- 172.21.15.49:0/374642602 >> v1:172.21.15.115:6789/0 conn(0x7f70ec158160 legacy=0x7f70ec155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:57.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.270+0000 7f70eaffd700 1 -- 172.21.15.49:0/374642602 >> v1:172.21.15.49:6789/0 conn(0x7f70ec14e600 legacy=0x7f70ec14eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:57.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.270+0000 7f70eaffd700 1 -- 172.21.15.49:0/374642602 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec158600 con 0x7f70ec0a8280 2023-11-30T17:19:57.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.270+0000 7f70eaffd700 1 --2- 172.21.15.49:0/374642602 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70ec0a8280 0x7f70ec0a8660 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f70e4009790 tx=0x7f70e4009060).ready entity=mon.2 client_cookie=988beb0f31bd4900 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:57.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.270+0000 7f70e9ffb700 1 -- 172.21.15.49:0/374642602 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e400f510 con 0x7f70ec0a8280 2023-11-30T17:19:57.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.270+0000 7f70e9ffb700 1 -- 172.21.15.49:0/374642602 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e400f670 con 0x7f70ec0a8280 2023-11-30T17:19:57.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.270+0000 7f70e9ffb700 1 -- 172.21.15.49:0/374642602 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e400f9f0 con 0x7f70ec0a8280 2023-11-30T17:19:57.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.270+0000 7f70f18c8700 1 -- 172.21.15.49:0/374642602 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70ec0a8280 msgr2=0x7f70ec0a8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:57.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.270+0000 7f70f18c8700 1 --2- 172.21.15.49:0/374642602 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70ec0a8280 0x7f70ec0a8660 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f70e4009790 tx=0x7f70e4009060).stop 2023-11-30T17:19:57.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.271+0000 7f70f18c8700 1 -- 172.21.15.49:0/374642602 shutdown_connections 2023-11-30T17:19:57.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.271+0000 7f70f18c8700 1 --2- 172.21.15.49:0/374642602 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70ec0a8280 0x7f70ec0a8660 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:57.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.271+0000 7f70f18c8700 1 -- 172.21.15.49:0/374642602 >> 172.21.15.49:0/374642602 conn(0x7f70ec062700 msgr2=0x7f70ec062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:57.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.271+0000 7f70f18c8700 1 -- 172.21.15.49:0/374642602 shutdown_connections 2023-11-30T17:19:57.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.271+0000 7f70f18c8700 1 -- 172.21.15.49:0/374642602 wait complete. 2023-11-30T17:19:57.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.272+0000 7f70f18c8700 1 Processor -- start 2023-11-30T17:19:57.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.272+0000 7f70f18c8700 1 -- start start 2023-11-30T17:19:57.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.273+0000 7f70f18c8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ec0a8280 0x7f70ec0651b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:57.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.273+0000 7f70f18c8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70ec14e600 0x7f70ec063810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:57.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.273+0000 7f70f18c8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70ec158160 0x7f70ec141b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:57.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.273+0000 7f70f18c8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec064110 con 0x7f70ec158160 2023-11-30T17:19:57.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.273+0000 7f70f18c8700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec0643f0 con 0x7f70ec0a8280 2023-11-30T17:19:57.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.273+0000 7f70f18c8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec0646d0 con 0x7f70ec14e600 2023-11-30T17:19:57.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.273+0000 7f70eb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70ec158160 0x7f70ec141b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:57.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.273+0000 7f70eaffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ec0a8280 0x7f70ec0651b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:57.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.273+0000 7f70eb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70ec158160 0x7f70ec141b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59164/0 (socket says 172.21.15.49:59164) 2023-11-30T17:19:57.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.273+0000 7f70eb7fe700 1 -- 172.21.15.49:0/3132241633 learned_addr learned my addr 172.21.15.49:0/3132241633 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:57.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.273+0000 7f70eaffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ec0a8280 0x7f70ec0651b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:34572/0 (socket says 172.21.15.49:34572) 2023-11-30T17:19:57.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.273+0000 7f70ea7fc700 1 --2- 172.21.15.49:0/3132241633 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70ec14e600 0x7f70ec063810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:57.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.273+0000 7f70eb7fe700 1 -- 172.21.15.49:0/3132241633 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70ec14e600 msgr2=0x7f70ec063810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:57.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.273+0000 7f70eb7fe700 1 --2- 172.21.15.49:0/3132241633 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70ec14e600 0x7f70ec063810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:57.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.273+0000 7f70eb7fe700 1 -- 172.21.15.49:0/3132241633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ec0a8280 msgr2=0x7f70ec0651b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:57.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.273+0000 7f70eb7fe700 1 --2- 172.21.15.49:0/3132241633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ec0a8280 0x7f70ec0651b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:57.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.273+0000 7f70eb7fe700 1 -- 172.21.15.49:0/3132241633 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e40092a0 con 0x7f70ec158160 2023-11-30T17:19:57.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.273+0000 7f70eaffd700 1 --2- 172.21.15.49:0/3132241633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ec0a8280 0x7f70ec0651b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:19:57.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.273+0000 7f70eb7fe700 1 --2- 172.21.15.49:0/3132241633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70ec158160 0x7f70ec141b90 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f70dc001560 tx=0x7f70dc001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:57.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.273+0000 7f70e2ffd700 1 -- 172.21.15.49:0/3132241633 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc005d30 con 0x7f70ec158160 2023-11-30T17:19:57.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.273+0000 7f70e2ffd700 1 -- 172.21.15.49:0/3132241633 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70dc005e90 con 0x7f70ec158160 2023-11-30T17:19:57.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.273+0000 7f70f18c8700 1 -- 172.21.15.49:0/3132241633 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70ec0649b0 con 0x7f70ec158160 2023-11-30T17:19:57.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.273+0000 7f70e2ffd700 1 -- 172.21.15.49:0/3132241633 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc007340 con 0x7f70ec158160 2023-11-30T17:19:57.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.274+0000 7f70f18c8700 1 -- 172.21.15.49:0/3132241633 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70ec063d00 con 0x7f70ec158160 2023-11-30T17:19:57.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.274+0000 7f70f18c8700 1 -- 172.21.15.49:0/3132241633 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70ec064ed0 con 0x7f70ec158160 2023-11-30T17:19:57.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.275+0000 7f70e2ffd700 1 -- 172.21.15.49:0/3132241633 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f70dc0076b0 con 0x7f70ec158160 2023-11-30T17:19:57.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.275+0000 7f70e2ffd700 1 --2- 172.21.15.49:0/3132241633 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f70cc05f270 0x7f70cc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:57.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.275+0000 7f70e2ffd700 1 -- 172.21.15.49:0/3132241633 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f70dc07a2c0 con 0x7f70ec158160 2023-11-30T17:19:57.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.275+0000 7f70eaffd700 1 --2- 172.21.15.49:0/3132241633 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f70cc05f270 0x7f70cc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:57.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.276+0000 7f70eaffd700 1 --2- 172.21.15.49:0/3132241633 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f70cc05f270 0x7f70cc061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f70e4009fd0 tx=0x7f70e4017000).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:57.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.279+0000 7f70e2ffd700 1 -- 172.21.15.49:0/3132241633 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f70ec064ed0 con 0x7f70ec158160 2023-11-30T17:19:57.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:57.502+0000 7f70f18c8700 1 -- 172.21.15.49:0/3132241633 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f70ec064ed0 con 0x7f70ec158160 2023-11-30T17:19:58.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.476+0000 7f70e2ffd700 1 -- 172.21.15.49:0/3132241633 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v23) v1 ==== 118+0+0 (secure 0 0 0) 0x7f70ec064ed0 con 0x7f70ec158160 2023-11-30T17:19:58.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.478+0000 7f70f18c8700 1 -- 172.21.15.49:0/3132241633 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f70cc05f270 msgr2=0x7f70cc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:58.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.478+0000 7f70f18c8700 1 --2- 172.21.15.49:0/3132241633 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f70cc05f270 0x7f70cc061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f70e4009fd0 tx=0x7f70e4017000).stop 2023-11-30T17:19:58.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.478+0000 7f70f18c8700 1 -- 172.21.15.49:0/3132241633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70ec158160 msgr2=0x7f70ec141b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:58.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.478+0000 7f70f18c8700 1 --2- 172.21.15.49:0/3132241633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70ec158160 0x7f70ec141b90 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f70dc001560 tx=0x7f70dc001650).stop 2023-11-30T17:19:58.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.478+0000 7f70f18c8700 1 -- 172.21.15.49:0/3132241633 shutdown_connections 2023-11-30T17:19:58.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.478+0000 7f70f18c8700 1 --2- 172.21.15.49:0/3132241633 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f70cc05f270 0x7f70cc061730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:58.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.478+0000 7f70f18c8700 1 --2- 172.21.15.49:0/3132241633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70ec158160 0x7f70ec141b90 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:58.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.478+0000 7f70f18c8700 1 --2- 172.21.15.49:0/3132241633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ec0a8280 0x7f70ec0651b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:58.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.478+0000 7f70f18c8700 1 --2- 172.21.15.49:0/3132241633 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70ec14e600 0x7f70ec063810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:58.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.478+0000 7f70f18c8700 1 -- 172.21.15.49:0/3132241633 >> 172.21.15.49:0/3132241633 conn(0x7f70ec062700 msgr2=0x7f70ec14ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:58.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.478+0000 7f70f18c8700 1 -- 172.21.15.49:0/3132241633 shutdown_connections 2023-11-30T17:19:58.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.478+0000 7f70f18c8700 1 -- 172.21.15.49:0/3132241633 wait complete. 2023-11-30T17:19:58.495 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-30T17:19:58.496 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-30T17:19:58.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.621+0000 7f9748847700 1 Processor -- start 2023-11-30T17:19:58.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.621+0000 7f9748847700 1 -- start start 2023-11-30T17:19:58.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.622+0000 7f9748847700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9744069d10 0x7f974406a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:58.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.622+0000 7f9748847700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9744151a20 0x7f97440be1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:58.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.622+0000 7f9748847700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97440c3470 con 0x7f97440be6a0 2023-11-30T17:19:58.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.622+0000 7f9748847700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97440c48f0 con 0x7f9744151a20 2023-11-30T17:19:58.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.622+0000 7f9748847700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9744151ea0 con 0x7f9744069d10 2023-11-30T17:19:58.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.622+0000 7f9741d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9744151a20 0x7f97440be1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:58.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.622+0000 7f9741d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9744151a20 0x7f97440be1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59168/0 (socket says 172.21.15.49:59168) 2023-11-30T17:19:58.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.622+0000 7f9741d9b700 1 -- 172.21.15.49:0/873483979 learned_addr learned my addr 172.21.15.49:0/873483979 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:58.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.623+0000 7f9741d9b700 1 -- 172.21.15.49:0/873483979 >> v2:172.21.15.115:3300/0 conn(0x7f9744069d10 msgr2=0x7f974406a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:58.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.623+0000 7f9741d9b700 1 --2- 172.21.15.49:0/873483979 >> v2:172.21.15.115:3300/0 conn(0x7f9744069d10 0x7f974406a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:58.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.623+0000 7f9741d9b700 1 -- 172.21.15.49:0/873483979 >> v1:172.21.15.115:6789/0 conn(0x7f97440be6a0 legacy=0x7f97440bd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:58.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.623+0000 7f9741d9b700 1 -- 172.21.15.49:0/873483979 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9744152180 con 0x7f9744151a20 2023-11-30T17:19:58.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.623+0000 7f9741d9b700 1 --2- 172.21.15.49:0/873483979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9744151a20 0x7f97440be1b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f974405f7f0 tx=0x7f972c0090f0).ready entity=mon.0 client_cookie=bf71d18c95248b53 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:58.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.623+0000 7f974159a700 1 -- 172.21.15.49:0/873483979 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c00b5a0 con 0x7f9744151a20 2023-11-30T17:19:58.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.623+0000 7f974159a700 1 -- 172.21.15.49:0/873483979 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972c00b700 con 0x7f9744151a20 2023-11-30T17:19:58.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.623+0000 7f974159a700 1 -- 172.21.15.49:0/873483979 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c00ba80 con 0x7f9744151a20 2023-11-30T17:19:58.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.623+0000 7f9748847700 1 -- 172.21.15.49:0/873483979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9744151a20 msgr2=0x7f97440be1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:58.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.623+0000 7f9748847700 1 --2- 172.21.15.49:0/873483979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9744151a20 0x7f97440be1b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f974405f7f0 tx=0x7f972c0090f0).stop 2023-11-30T17:19:58.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.624+0000 7f9748847700 1 -- 172.21.15.49:0/873483979 shutdown_connections 2023-11-30T17:19:58.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.624+0000 7f9748847700 1 --2- 172.21.15.49:0/873483979 >> v2:172.21.15.115:3300/0 conn(0x7f9744069d10 0x7f974406a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-30T17:19:58.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.624+0000 7f9748847700 1 --2- 172.21.15.49:0/873483979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9744151a20 0x7f97440be1b0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:58.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.624+0000 7f9748847700 1 -- 172.21.15.49:0/873483979 >> 172.21.15.49:0/873483979 conn(0x7f97440642d0 msgr2=0x7f97440c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:58.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.624+0000 7f9748847700 1 -- 172.21.15.49:0/873483979 shutdown_connections 2023-11-30T17:19:58.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.624+0000 7f9748847700 1 -- 172.21.15.49:0/873483979 wait complete. 2023-11-30T17:19:58.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.625+0000 7f9748847700 1 Processor -- start 2023-11-30T17:19:58.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.625+0000 7f9748847700 1 -- start start 2023-11-30T17:19:58.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.625+0000 7f9748847700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9744069d10 0x7f974414df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:58.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.625+0000 7f9748847700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97440be6a0 0x7f97440bf120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:58.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.625+0000 7f9748847700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9744151a20 0x7f97440c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:58.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.625+0000 7f9748847700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9744156930 con 0x7f97440be6a0 2023-11-30T17:19:58.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.625+0000 7f9748847700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97440a5fb0 con 0x7f9744151a20 2023-11-30T17:19:58.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.625+0000 7f9748847700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97440a56b0 con 0x7f9744069d10 2023-11-30T17:19:58.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.626+0000 7f9741d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97440be6a0 0x7f97440bf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:58.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.626+0000 7f9741d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97440be6a0 0x7f97440bf120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59184/0 (socket says 172.21.15.49:59184) 2023-11-30T17:19:58.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.626+0000 7f9741d9b700 1 -- 172.21.15.49:0/1875363104 learned_addr learned my addr 172.21.15.49:0/1875363104 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:58.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.626+0000 7f9742d9d700 1 --2- 172.21.15.49:0/1875363104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9744151a20 0x7f97440c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:58.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.626+0000 7f974259c700 1 --2- 172.21.15.49:0/1875363104 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9744069d10 0x7f974414df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:58.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.626+0000 7f9741d9b700 1 -- 172.21.15.49:0/1875363104 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9744069d10 msgr2=0x7f974414df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:58.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.626+0000 7f9741d9b700 1 --2- 172.21.15.49:0/1875363104 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9744069d10 0x7f974414df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:58.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.626+0000 7f9741d9b700 1 -- 172.21.15.49:0/1875363104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9744151a20 msgr2=0x7f97440c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:58.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.626+0000 7f9741d9b700 1 --2- 172.21.15.49:0/1875363104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9744151a20 0x7f97440c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:58.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.626+0000 7f9741d9b700 1 -- 172.21.15.49:0/1875363104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972c009370 con 0x7f97440be6a0 2023-11-30T17:19:58.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.626+0000 7f9741d9b700 1 --2- 172.21.15.49:0/1875363104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97440be6a0 0x7f97440bf120 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f972c011000 tx=0x7f972c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:58.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.626+0000 7f973a7fc700 1 -- 172.21.15.49:0/1875363104 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c00bec0 con 0x7f97440be6a0 2023-11-30T17:19:58.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.626+0000 7f973a7fc700 1 -- 172.21.15.49:0/1875363104 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972c00b870 con 0x7f97440be6a0 2023-11-30T17:19:58.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.626+0000 7f9748847700 1 -- 172.21.15.49:0/1875363104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9744156650 con 0x7f97440be6a0 2023-11-30T17:19:58.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.626+0000 7f973a7fc700 1 -- 172.21.15.49:0/1875363104 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c01b620 con 0x7f97440be6a0 2023-11-30T17:19:58.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.626+0000 7f9748847700 1 -- 172.21.15.49:0/1875363104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97440a5c40 con 0x7f97440be6a0 2023-11-30T17:19:58.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.627+0000 7f9748847700 1 -- 172.21.15.49:0/1875363104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97440a6140 con 0x7f97440be6a0 2023-11-30T17:19:58.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.628+0000 7f973a7fc700 1 -- 172.21.15.49:0/1875363104 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f972c01ba50 con 0x7f97440be6a0 2023-11-30T17:19:58.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.628+0000 7f973a7fc700 1 --2- 172.21.15.49:0/1875363104 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f972405f270 0x7f9724061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:58.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.628+0000 7f973a7fc700 1 -- 172.21.15.49:0/1875363104 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f972c07b8a0 con 0x7f97440be6a0 2023-11-30T17:19:58.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.628+0000 7f974259c700 1 --2- 172.21.15.49:0/1875363104 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f972405f270 0x7f9724061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:58.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.629+0000 7f974259c700 1 --2- 172.21.15.49:0/1875363104 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f972405f270 0x7f9724061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f973c001250 tx=0x7f973c009620).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:58.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.632+0000 7f973a7fc700 1 -- 172.21.15.49:0/1875363104 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f972c04c9f0 con 0x7f97440be6a0 2023-11-30T17:19:58.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:58.848+0000 7f9748847700 1 -- 172.21.15.49:0/1875363104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f974406c860 con 0x7f97440be6a0 2023-11-30T17:19:59.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.479+0000 7f973a7fc700 1 -- 172.21.15.49:0/1875363104 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f972c050010 con 0x7f97440be6a0 2023-11-30T17:19:59.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.482+0000 7f9748847700 1 -- 172.21.15.49:0/1875363104 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f972405f270 msgr2=0x7f9724061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:59.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.482+0000 7f9748847700 1 --2- 172.21.15.49:0/1875363104 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f972405f270 0x7f9724061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f973c001250 tx=0x7f973c009620).stop 2023-11-30T17:19:59.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.482+0000 7f9748847700 1 -- 172.21.15.49:0/1875363104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97440be6a0 msgr2=0x7f97440bf120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:59.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.482+0000 7f9748847700 1 --2- 172.21.15.49:0/1875363104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97440be6a0 0x7f97440bf120 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f972c011000 tx=0x7f972c015000).stop 2023-11-30T17:19:59.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.482+0000 7f9748847700 1 -- 172.21.15.49:0/1875363104 shutdown_connections 2023-11-30T17:19:59.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.482+0000 7f9748847700 1 --2- 172.21.15.49:0/1875363104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9744151a20 0x7f97440c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:59.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.482+0000 7f9748847700 1 --2- 172.21.15.49:0/1875363104 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9744069d10 0x7f974414df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:59.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.482+0000 7f9748847700 1 --2- 172.21.15.49:0/1875363104 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f972405f270 0x7f9724061730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:59.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.482+0000 7f9748847700 1 --2- 172.21.15.49:0/1875363104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97440be6a0 0x7f97440bf120 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:59.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.482+0000 7f9748847700 1 -- 172.21.15.49:0/1875363104 >> 172.21.15.49:0/1875363104 conn(0x7f97440642d0 msgr2=0x7f97441584c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:59.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.482+0000 7f9748847700 1 -- 172.21.15.49:0/1875363104 shutdown_connections 2023-11-30T17:19:59.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.482+0000 7f9748847700 1 -- 172.21.15.49:0/1875363104 wait complete. 2023-11-30T17:19:59.497 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-30T17:19:59.498 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:19:59.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.616+0000 7f6ce1360700 1 Processor -- start 2023-11-30T17:19:59.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.616+0000 7f6ce1360700 1 -- start start 2023-11-30T17:19:59.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.616+0000 7f6ce1360700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6cdc0caab0 0x7f6cdc0aa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:59.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.616+0000 7f6ce1360700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6cdc0cae90 0x7f6cdc0c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:59.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.616+0000 7f6ce1360700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6cdc0aa960 0x7f6cdc0c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:59.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.616+0000 7f6ce1360700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cdc0c1490 con 0x7f6cdc0aa960 2023-11-30T17:19:59.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.616+0000 7f6ce1360700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cdc0a9a90 con 0x7f6cdc0cae90 2023-11-30T17:19:59.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.616+0000 7f6ce1360700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cdc154ce0 con 0x7f6cdc0caab0 2023-11-30T17:19:59.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.617+0000 7f6cdb7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6cdc0aa960 0x7f6cdc0c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:59.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.617+0000 7f6cdb7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6cdc0aa960 0x7f6cdc0c0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59196/0 (socket says 172.21.15.49:59196) 2023-11-30T17:19:59.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.617+0000 7f6cdb7fe700 1 -- 172.21.15.49:0/2392182052 learned_addr learned my addr 172.21.15.49:0/2392182052 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:59.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.617+0000 7f6cda7fc700 1 --2- 172.21.15.49:0/2392182052 >> v2:172.21.15.115:3300/0 conn(0x7f6cdc0cae90 0x7f6cdc0c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:59.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.617+0000 7f6cdaffd700 1 --2- 172.21.15.49:0/2392182052 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6cdc0caab0 0x7f6cdc0aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:59.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.617+0000 7f6cdb7fe700 1 -- 172.21.15.49:0/2392182052 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6cdc0caab0 msgr2=0x7f6cdc0aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:59.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.617+0000 7f6cdb7fe700 1 --2- 172.21.15.49:0/2392182052 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6cdc0caab0 0x7f6cdc0aa470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:59.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.617+0000 7f6cdb7fe700 1 -- 172.21.15.49:0/2392182052 >> v2:172.21.15.115:3300/0 conn(0x7f6cdc0cae90 msgr2=0x7f6cdc0c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:19:59.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.617+0000 7f6cdb7fe700 1 --2- 172.21.15.49:0/2392182052 >> v2:172.21.15.115:3300/0 conn(0x7f6cdc0cae90 0x7f6cdc0c0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:59.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.617+0000 7f6cdb7fe700 1 -- 172.21.15.49:0/2392182052 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cdc0a8e80 con 0x7f6cdc0aa960 2023-11-30T17:19:59.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.617+0000 7f6cdb7fe700 1 --2- 172.21.15.49:0/2392182052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6cdc0aa960 0x7f6cdc0c0fa0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f6cdc0c9070 tx=0x7f6cd4009840).ready entity=mon.0 client_cookie=6f4f84fe5e0c677d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:59.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.617+0000 7f6cd9ffb700 1 -- 172.21.15.49:0/2392182052 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd400e070 con 0x7f6cdc0aa960 2023-11-30T17:19:59.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.617+0000 7f6cd9ffb700 1 -- 172.21.15.49:0/2392182052 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd400ba50 con 0x7f6cdc0aa960 2023-11-30T17:19:59.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.617+0000 7f6cd9ffb700 1 -- 172.21.15.49:0/2392182052 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd400bdd0 con 0x7f6cdc0aa960 2023-11-30T17:19:59.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.618+0000 7f6ce1360700 1 -- 172.21.15.49:0/2392182052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6cdc0aa960 msgr2=0x7f6cdc0c0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:59.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.618+0000 7f6ce1360700 1 --2- 172.21.15.49:0/2392182052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6cdc0aa960 0x7f6cdc0c0fa0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f6cdc0c9070 tx=0x7f6cd4009840).stop 2023-11-30T17:19:59.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.618+0000 7f6ce1360700 1 -- 172.21.15.49:0/2392182052 shutdown_connections 2023-11-30T17:19:59.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.618+0000 7f6ce1360700 1 --2- 172.21.15.49:0/2392182052 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6cdc0caab0 0x7f6cdc0aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:59.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.618+0000 7f6ce1360700 1 --2- 172.21.15.49:0/2392182052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6cdc0aa960 0x7f6cdc0c0fa0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:59.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.618+0000 7f6ce1360700 1 --2- 172.21.15.49:0/2392182052 >> v2:172.21.15.115:3300/0 conn(0x7f6cdc0cae90 0x7f6cdc0c0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:59.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.618+0000 7f6ce1360700 1 -- 172.21.15.49:0/2392182052 >> 172.21.15.49:0/2392182052 conn(0x7f6cdc094920 msgr2=0x7f6cdc06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:59.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.618+0000 7f6ce1360700 1 -- 172.21.15.49:0/2392182052 shutdown_connections 2023-11-30T17:19:59.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.618+0000 7f6ce1360700 1 -- 172.21.15.49:0/2392182052 wait complete. 2023-11-30T17:19:59.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.619+0000 7f6ce1360700 1 Processor -- start 2023-11-30T17:19:59.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.619+0000 7f6ce1360700 1 -- start start 2023-11-30T17:19:59.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.620+0000 7f6ce1360700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6cdc0caab0 0x7f6cdc0af4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:59.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.620+0000 7f6ce1360700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6cdc0cae90 0x7f6cdc153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:59.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.620+0000 7f6ce1360700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6cdc154150 0x7f6cdc1646e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:59.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.620+0000 7f6ce1360700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cdc155170 con 0x7f6cdc0cae90 2023-11-30T17:19:59.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.620+0000 7f6ce1360700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cdc155430 con 0x7f6cdc0caab0 2023-11-30T17:19:59.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.620+0000 7f6ce1360700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cdc155710 con 0x7f6cdc154150 2023-11-30T17:19:59.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.620+0000 7f6cda7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6cdc0cae90 0x7f6cdc153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:59.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.620+0000 7f6cda7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6cdc0cae90 0x7f6cdc153c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59200/0 (socket says 172.21.15.49:59200) 2023-11-30T17:19:59.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.620+0000 7f6cda7fc700 1 -- 172.21.15.49:0/2221380101 learned_addr learned my addr 172.21.15.49:0/2221380101 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:59.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.620+0000 7f6cdaffd700 1 --2- 172.21.15.49:0/2221380101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6cdc0caab0 0x7f6cdc0af4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:59.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.620+0000 7f6cdb7fe700 1 --2- 172.21.15.49:0/2221380101 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6cdc154150 0x7f6cdc1646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:59.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.620+0000 7f6cda7fc700 1 -- 172.21.15.49:0/2221380101 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6cdc154150 msgr2=0x7f6cdc1646e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:59.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.620+0000 7f6cda7fc700 1 --2- 172.21.15.49:0/2221380101 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6cdc154150 0x7f6cdc1646e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:59.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.620+0000 7f6cda7fc700 1 -- 172.21.15.49:0/2221380101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6cdc0caab0 msgr2=0x7f6cdc0af4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:59.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.620+0000 7f6cda7fc700 1 --2- 172.21.15.49:0/2221380101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6cdc0caab0 0x7f6cdc0af4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:59.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.620+0000 7f6cda7fc700 1 -- 172.21.15.49:0/2221380101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd4009ae0 con 0x7f6cdc0cae90 2023-11-30T17:19:59.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.620+0000 7f6cda7fc700 1 --2- 172.21.15.49:0/2221380101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6cdc0cae90 0x7f6cdc153c60 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f6cd000d630 tx=0x7f6cd0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:59.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.621+0000 7f6cc2ffd700 1 -- 172.21.15.49:0/2221380101 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0011590 con 0x7f6cdc0cae90 2023-11-30T17:19:59.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.621+0000 7f6cc2ffd700 1 -- 172.21.15.49:0/2221380101 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd00116f0 con 0x7f6cdc0cae90 2023-11-30T17:19:59.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.621+0000 7f6ce1360700 1 -- 172.21.15.49:0/2221380101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cdc1559f0 con 0x7f6cdc0cae90 2023-11-30T17:19:59.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.621+0000 7f6cc2ffd700 1 -- 172.21.15.49:0/2221380101 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0011a70 con 0x7f6cdc0cae90 2023-11-30T17:19:59.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.621+0000 7f6ce1360700 1 -- 172.21.15.49:0/2221380101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cdc0af9a0 con 0x7f6cdc0cae90 2023-11-30T17:19:59.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.622+0000 7f6ce1360700 1 -- 172.21.15.49:0/2221380101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cdc06c860 con 0x7f6cdc0cae90 2023-11-30T17:19:59.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.622+0000 7f6cc2ffd700 1 -- 172.21.15.49:0/2221380101 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6cd001c460 con 0x7f6cdc0cae90 2023-11-30T17:19:59.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.622+0000 7f6cc2ffd700 1 --2- 172.21.15.49:0/2221380101 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6cc805f270 0x7f6cc8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:59.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.623+0000 7f6cc2ffd700 1 -- 172.21.15.49:0/2221380101 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6cd007a210 con 0x7f6cdc0cae90 2023-11-30T17:19:59.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.623+0000 7f6cdaffd700 1 --2- 172.21.15.49:0/2221380101 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6cc805f270 0x7f6cc8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:59.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.623+0000 7f6cdaffd700 1 --2- 172.21.15.49:0/2221380101 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6cc805f270 0x7f6cc8061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f6ccc006fd0 tx=0x7f6ccc008040).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:59.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.627+0000 7f6cc2ffd700 1 -- 172.21.15.49:0/2221380101 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6cd004b300 con 0x7f6cdc0cae90 2023-11-30T17:19:59.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.839+0000 7f6ce1360700 1 -- 172.21.15.49:0/2221380101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6cdc0a9160 con 0x7f6cdc0cae90 2023-11-30T17:19:59.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.840+0000 7f6cc2ffd700 1 -- 172.21.15.49:0/2221380101 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4495 (secure 0 0 0) 0x7f6cd0011e60 con 0x7f6cdc0cae90 2023-11-30T17:19:59.843 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:19:59.843 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1605498959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1605498959},{"type":"v1","addr":"172.21.15.115:6836","nonce":1605498959}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1471786970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1471786970},{"type":"v1","addr":"172.21.15.115:6837","nonce":1471786970}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5763,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1757467688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1757467688},{"type":"v1","addr":"172.21.15.49:6834","nonce":1757467688}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:19:56.468670+0000","modified":"2023-11-30T17:19:59.475872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5766},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5766":{"gid":5766,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2424233798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2424233798},{"type":"v1","addr":"172.21.15.49:6835","nonce":2424233798}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-11-30T17:19:59.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.842+0000 7f6ce1360700 1 -- 172.21.15.49:0/2221380101 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6cc805f270 msgr2=0x7f6cc8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:59.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.842+0000 7f6ce1360700 1 --2- 172.21.15.49:0/2221380101 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6cc805f270 0x7f6cc8061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f6ccc006fd0 tx=0x7f6ccc008040).stop 2023-11-30T17:19:59.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.842+0000 7f6ce1360700 1 -- 172.21.15.49:0/2221380101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6cdc0cae90 msgr2=0x7f6cdc153c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:59.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.842+0000 7f6ce1360700 1 --2- 172.21.15.49:0/2221380101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6cdc0cae90 0x7f6cdc153c60 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f6cd000d630 tx=0x7f6cd0008040).stop 2023-11-30T17:19:59.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.842+0000 7f6ce1360700 1 -- 172.21.15.49:0/2221380101 shutdown_connections 2023-11-30T17:19:59.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.842+0000 7f6ce1360700 1 --2- 172.21.15.49:0/2221380101 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6cdc154150 0x7f6cdc1646e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:59.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.842+0000 7f6ce1360700 1 --2- 172.21.15.49:0/2221380101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6cdc0caab0 0x7f6cdc0af4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:59.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.842+0000 7f6ce1360700 1 --2- 172.21.15.49:0/2221380101 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6cc805f270 0x7f6cc8061730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:59.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.842+0000 7f6ce1360700 1 --2- 172.21.15.49:0/2221380101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6cdc0cae90 0x7f6cdc153c60 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:59.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.842+0000 7f6ce1360700 1 -- 172.21.15.49:0/2221380101 >> 172.21.15.49:0/2221380101 conn(0x7f6cdc094920 msgr2=0x7f6cdc0c62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:59.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.842+0000 7f6ce1360700 1 -- 172.21.15.49:0/2221380101 shutdown_connections 2023-11-30T17:19:59.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.842+0000 7f6ce1360700 1 -- 172.21.15.49:0/2221380101 wait complete. 2023-11-30T17:19:59.845 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 24 2023-11-30T17:19:59.856 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:19:59.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.971+0000 7f5188ff4700 1 Processor -- start 2023-11-30T17:19:59.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.971+0000 7f5188ff4700 1 -- start start 2023-11-30T17:19:59.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.972+0000 7f5188ff4700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5184064e20 0x7f5184155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:59.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.972+0000 7f5188ff4700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51840683d0 con 0x7f5184095e80 2023-11-30T17:19:59.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.972+0000 7f5188ff4700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5184067850 con 0x7f51841544d0 2023-11-30T17:19:59.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.972+0000 7f5188ff4700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5184067650 con 0x7f5184064e20 2023-11-30T17:19:59.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.972+0000 7f5182d9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5184095e80 0x7f518415e0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58392/0 (socket says 172.21.15.49:58392) 2023-11-30T17:19:59.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.973+0000 7f5182d9d700 1 -- 172.21.15.49:0/3273947617 learned_addr learned my addr 172.21.15.49:0/3273947617 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:19:59.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.973+0000 7f5181d9b700 1 --2- 172.21.15.49:0/3273947617 >> v2:172.21.15.115:3300/0 conn(0x7f5184064e20 0x7f5184155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:59.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.973+0000 7f518159a700 1 -- 172.21.15.49:0/3273947617 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507290849 0 0) 0x7f51840683d0 con 0x7f5184095e80 2023-11-30T17:19:59.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.973+0000 7f518159a700 1 -- 172.21.15.49:0/3273947617 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51700033f0 con 0x7f5184095e80 2023-11-30T17:19:59.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.973+0000 7f518159a700 1 -- 172.21.15.49:0/3273947617 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 323799176 0 0) 0x7f5184067850 con 0x7f51841544d0 2023-11-30T17:19:59.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.973+0000 7f518159a700 1 -- 172.21.15.49:0/3273947617 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51840683d0 con 0x7f51841544d0 2023-11-30T17:19:59.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.973+0000 7f5181d9b700 1 -- 172.21.15.49:0/3273947617 >> v1:172.21.15.115:6789/0 conn(0x7f51841544d0 legacy=0x7f5184066f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:59.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.973+0000 7f5181d9b700 1 -- 172.21.15.49:0/3273947617 >> v1:172.21.15.49:6789/0 conn(0x7f5184095e80 legacy=0x7f518415e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:59.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.973+0000 7f5181d9b700 1 -- 172.21.15.49:0/3273947617 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5184067b30 con 0x7f5184064e20 2023-11-30T17:19:59.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.973+0000 7f5181d9b700 1 --2- 172.21.15.49:0/3273947617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5184064e20 0x7f5184155750 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f516c009760 tx=0x7f516c009060).ready entity=mon.1 client_cookie=a984c72cf2505515 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:59.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.973+0000 7f518159a700 1 -- 172.21.15.49:0/3273947617 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c00d4a0 con 0x7f5184064e20 2023-11-30T17:19:59.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.973+0000 7f518159a700 1 -- 172.21.15.49:0/3273947617 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516c00d600 con 0x7f5184064e20 2023-11-30T17:19:59.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.973+0000 7f518159a700 1 -- 172.21.15.49:0/3273947617 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c00d980 con 0x7f5184064e20 2023-11-30T17:19:59.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.974+0000 7f5188ff4700 1 -- 172.21.15.49:0/3273947617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5184064e20 msgr2=0x7f5184155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:59.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.974+0000 7f5188ff4700 1 --2- 172.21.15.49:0/3273947617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5184064e20 0x7f5184155750 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f516c009760 tx=0x7f516c009060).stop 2023-11-30T17:19:59.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.974+0000 7f5188ff4700 1 -- 172.21.15.49:0/3273947617 shutdown_connections 2023-11-30T17:19:59.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.974+0000 7f5188ff4700 1 --2- 172.21.15.49:0/3273947617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5184064e20 0x7f5184155750 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:59.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.974+0000 7f5188ff4700 1 -- 172.21.15.49:0/3273947617 >> 172.21.15.49:0/3273947617 conn(0x7f51840631d0 msgr2=0x7f51840c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:19:59.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.974+0000 7f5188ff4700 1 -- 172.21.15.49:0/3273947617 shutdown_connections 2023-11-30T17:19:59.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.974+0000 7f5188ff4700 1 -- 172.21.15.49:0/3273947617 wait complete. 2023-11-30T17:19:59.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.975+0000 7f5188ff4700 1 Processor -- start 2023-11-30T17:19:59.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.975+0000 7f5188ff4700 1 -- start start 2023-11-30T17:19:59.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.976+0000 7f5188ff4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5184064e20 0x7f51840c1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:59.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.976+0000 7f5188ff4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5184095e80 0x7f51840a6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:59.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.976+0000 7f5188ff4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f51841544d0 0x7f518414eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:59.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.976+0000 7f5188ff4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51840c1850 con 0x7f5184064e20 2023-11-30T17:19:59.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.976+0000 7f5188ff4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51840a6d60 con 0x7f5184095e80 2023-11-30T17:19:59.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.976+0000 7f5188ff4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51840a82a0 con 0x7f51841544d0 2023-11-30T17:19:59.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.976+0000 7f518259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5184064e20 0x7f51840c1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:59.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.976+0000 7f518259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5184064e20 0x7f51840c1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59204/0 (socket says 172.21.15.49:59204) 2023-11-30T17:19:59.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.976+0000 7f518259c700 1 -- 172.21.15.49:0/1034519322 learned_addr learned my addr 172.21.15.49:0/1034519322 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:19:59.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.976+0000 7f5182d9d700 1 --2- 172.21.15.49:0/1034519322 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f51841544d0 0x7f518414eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:59.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.976+0000 7f5181d9b700 1 --2- 172.21.15.49:0/1034519322 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5184095e80 0x7f51840a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:59.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.976+0000 7f518259c700 1 -- 172.21.15.49:0/1034519322 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f51841544d0 msgr2=0x7f518414eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:59.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.976+0000 7f518259c700 1 --2- 172.21.15.49:0/1034519322 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f51841544d0 0x7f518414eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:59.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.976+0000 7f518259c700 1 -- 172.21.15.49:0/1034519322 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5184095e80 msgr2=0x7f51840a6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:19:59.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.976+0000 7f518259c700 1 --2- 172.21.15.49:0/1034519322 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5184095e80 0x7f51840a6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:19:59.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.976+0000 7f518259c700 1 -- 172.21.15.49:0/1034519322 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f516c0092a0 con 0x7f5184064e20 2023-11-30T17:19:59.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.976+0000 7f518259c700 1 --2- 172.21.15.49:0/1034519322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5184064e20 0x7f51840c1360 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f517c00c710 tx=0x7f517c002610).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:59.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.977+0000 7f517a7fc700 1 -- 172.21.15.49:0/1034519322 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c002020 con 0x7f5184064e20 2023-11-30T17:19:59.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.977+0000 7f517a7fc700 1 -- 172.21.15.49:0/1034519322 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517c002180 con 0x7f5184064e20 2023-11-30T17:19:59.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.977+0000 7f5188ff4700 1 -- 172.21.15.49:0/1034519322 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5184164dc0 con 0x7f5184064e20 2023-11-30T17:19:59.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.977+0000 7f517a7fc700 1 -- 172.21.15.49:0/1034519322 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c0015c0 con 0x7f5184064e20 2023-11-30T17:19:59.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.977+0000 7f5188ff4700 1 -- 172.21.15.49:0/1034519322 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5184165380 con 0x7f5184064e20 2023-11-30T17:19:59.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.978+0000 7f5188ff4700 1 -- 172.21.15.49:0/1034519322 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f518406c860 con 0x7f5184064e20 2023-11-30T17:19:59.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.978+0000 7f517a7fc700 1 -- 172.21.15.49:0/1034519322 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f517c001930 con 0x7f5184064e20 2023-11-30T17:19:59.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.978+0000 7f517a7fc700 1 --2- 172.21.15.49:0/1034519322 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f516405f240 0x7f5164061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:19:59.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.978+0000 7f517a7fc700 1 -- 172.21.15.49:0/1034519322 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f517c079bd0 con 0x7f5184064e20 2023-11-30T17:19:59.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.979+0000 7f5181d9b700 1 --2- 172.21.15.49:0/1034519322 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f516405f240 0x7f5164061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:19:59.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.979+0000 7f5181d9b700 1 --2- 172.21.15.49:0/1034519322 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f516405f240 0x7f5164061700 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f516c00d260 tx=0x7f516c016000).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:19:59.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:19:59.982+0000 7f517a7fc700 1 -- 172.21.15.49:0/1034519322 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f517c048b00 con 0x7f5184064e20 2023-11-30T17:20:00.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.159+0000 7f5188ff4700 1 -- 172.21.15.49:0/1034519322 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5184067e10 con 0x7f5184064e20 2023-11-30T17:20:00.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.159+0000 7f517a7fc700 1 -- 172.21.15.49:0/1034519322 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f517c04ac60 con 0x7f5184064e20 2023-11-30T17:20:00.162 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:20:00.163 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":65,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:19:57.470450+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:19:54.153609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-30T17:19:55.451988+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:20:00.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.161+0000 7f5188ff4700 1 -- 172.21.15.49:0/1034519322 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f516405f240 msgr2=0x7f5164061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:00.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.161+0000 7f5188ff4700 1 --2- 172.21.15.49:0/1034519322 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f516405f240 0x7f5164061700 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f516c00d260 tx=0x7f516c016000).stop 2023-11-30T17:20:00.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.162+0000 7f5188ff4700 1 -- 172.21.15.49:0/1034519322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5184064e20 msgr2=0x7f51840c1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:00.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.162+0000 7f5188ff4700 1 --2- 172.21.15.49:0/1034519322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5184064e20 0x7f51840c1360 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f517c00c710 tx=0x7f517c002610).stop 2023-11-30T17:20:00.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.162+0000 7f5188ff4700 1 -- 172.21.15.49:0/1034519322 shutdown_connections 2023-11-30T17:20:00.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.162+0000 7f5188ff4700 1 --2- 172.21.15.49:0/1034519322 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f51841544d0 0x7f518414eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:00.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.162+0000 7f5188ff4700 1 --2- 172.21.15.49:0/1034519322 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f516405f240 0x7f5164061700 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:00.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.162+0000 7f5188ff4700 1 --2- 172.21.15.49:0/1034519322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5184064e20 0x7f51840c1360 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:00.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.162+0000 7f5188ff4700 1 --2- 172.21.15.49:0/1034519322 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5184095e80 0x7f51840a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:00.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.162+0000 7f5188ff4700 1 -- 172.21.15.49:0/1034519322 >> 172.21.15.49:0/1034519322 conn(0x7f51840631d0 msgr2=0x7f518414fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:00.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.162+0000 7f5188ff4700 1 -- 172.21.15.49:0/1034519322 shutdown_connections 2023-11-30T17:20:00.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.162+0000 7f5188ff4700 1 -- 172.21.15.49:0/1034519322 wait complete. 2023-11-30T17:20:00.176 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-30T17:20:00.177 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:20:00.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.293+0000 7f5affce1700 1 Processor -- start 2023-11-30T17:20:00.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.293+0000 7f5affce1700 1 -- start start 2023-11-30T17:20:00.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.294+0000 7f5affce1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5af80cae90 0x7f5af80c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:00.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.294+0000 7f5affce1700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5af80ca180 0x7f5af80c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:00.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.294+0000 7f5affce1700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af80a9a90 con 0x7f5af80caab0 2023-11-30T17:20:00.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.294+0000 7f5affce1700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af80c1490 con 0x7f5af80ca180 2023-11-30T17:20:00.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.294+0000 7f5affce1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af8154ce0 con 0x7f5af80cae90 2023-11-30T17:20:00.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.295+0000 7f5afd27c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5af80cae90 0x7f5af80c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:00.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.295+0000 7f5afe27e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5af80ca180 0x7f5af80c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:00.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.295+0000 7f5afd27c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5af80cae90 0x7f5af80c0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:51010/0 (socket says 172.21.15.49:51010) 2023-11-30T17:20:00.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.295+0000 7f5afe27e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5af80ca180 0x7f5af80c0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:34632/0 (socket says 172.21.15.49:34632) 2023-11-30T17:20:00.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.295+0000 7f5afd27c700 1 -- 172.21.15.49:0/399639018 learned_addr learned my addr 172.21.15.49:0/399639018 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:20:00.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.295+0000 7f5afd27c700 1 -- 172.21.15.49:0/399639018 >> v2:172.21.15.115:3300/0 conn(0x7f5af80ca180 msgr2=0x7f5af80c0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:00.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.295+0000 7f5afd27c700 1 --2- 172.21.15.49:0/399639018 >> v2:172.21.15.115:3300/0 conn(0x7f5af80ca180 0x7f5af80c0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:00.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.295+0000 7f5afd27c700 1 -- 172.21.15.49:0/399639018 >> v1:172.21.15.115:6789/0 conn(0x7f5af80caab0 legacy=0x7f5af80aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:00.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.295+0000 7f5afd27c700 1 -- 172.21.15.49:0/399639018 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af80aab80 con 0x7f5af80cae90 2023-11-30T17:20:00.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.295+0000 7f5afca7b700 1 -- 172.21.15.49:0/399639018 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2510205111 0 0) 0x7f5af80a9a90 con 0x7f5af80caab0 2023-11-30T17:20:00.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.295+0000 7f5afe27e700 1 --2- 172.21.15.49:0/399639018 >> v2:172.21.15.115:3300/0 conn(0x7f5af80ca180 0x7f5af80c0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:20:00.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.295+0000 7f5afd27c700 1 --2- 172.21.15.49:0/399639018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5af80cae90 0x7f5af80c0ab0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f5aec006fd0 tx=0x7f5aec0090f0).ready entity=mon.2 client_cookie=7755366d197d4528 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:00.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.295+0000 7f5afca7b700 1 -- 172.21.15.49:0/399639018 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec00b580 con 0x7f5af80cae90 2023-11-30T17:20:00.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.295+0000 7f5afca7b700 1 -- 172.21.15.49:0/399639018 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec00b6e0 con 0x7f5af80cae90 2023-11-30T17:20:00.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.295+0000 7f5afca7b700 1 -- 172.21.15.49:0/399639018 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec00ba60 con 0x7f5af80cae90 2023-11-30T17:20:00.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.296+0000 7f5affce1700 1 -- 172.21.15.49:0/399639018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5af80cae90 msgr2=0x7f5af80c0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:00.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.296+0000 7f5affce1700 1 --2- 172.21.15.49:0/399639018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5af80cae90 0x7f5af80c0ab0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f5aec006fd0 tx=0x7f5aec0090f0).stop 2023-11-30T17:20:00.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.296+0000 7f5affce1700 1 -- 172.21.15.49:0/399639018 shutdown_connections 2023-11-30T17:20:00.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.296+0000 7f5affce1700 1 --2- 172.21.15.49:0/399639018 >> v2:172.21.15.115:3300/0 conn(0x7f5af80ca180 0x7f5af80c0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:00.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.296+0000 7f5affce1700 1 --2- 172.21.15.49:0/399639018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5af80cae90 0x7f5af80c0ab0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:00.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.296+0000 7f5affce1700 1 -- 172.21.15.49:0/399639018 >> 172.21.15.49:0/399639018 conn(0x7f5af8094920 msgr2=0x7f5af806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:00.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.296+0000 7f5affce1700 1 -- 172.21.15.49:0/399639018 shutdown_connections 2023-11-30T17:20:00.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.296+0000 7f5affce1700 1 -- 172.21.15.49:0/399639018 wait complete. 2023-11-30T17:20:00.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.297+0000 7f5affce1700 1 Processor -- start 2023-11-30T17:20:00.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.297+0000 7f5affce1700 1 -- start start 2023-11-30T17:20:00.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.298+0000 7f5affce1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5af80ca180 0x7f5af80c3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:00.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.298+0000 7f5affce1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5af80caab0 0x7f5af8154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:00.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.298+0000 7f5affce1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5af80cae90 0x7f5af81677d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:00.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.298+0000 7f5affce1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af81538e0 con 0x7f5af80cae90 2023-11-30T17:20:00.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.298+0000 7f5affce1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af80c4050 con 0x7f5af80caab0 2023-11-30T17:20:00.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.298+0000 7f5affce1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af81574c0 con 0x7f5af80ca180 2023-11-30T17:20:00.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.298+0000 7f5afe27e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5af80cae90 0x7f5af81677d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:00.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.298+0000 7f5afe27e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5af80cae90 0x7f5af81677d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59212/0 (socket says 172.21.15.49:59212) 2023-11-30T17:20:00.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.298+0000 7f5afe27e700 1 -- 172.21.15.49:0/958606721 learned_addr learned my addr 172.21.15.49:0/958606721 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:20:00.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.298+0000 7f5afd27c700 1 --2- 172.21.15.49:0/958606721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5af80caab0 0x7f5af8154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:00.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.298+0000 7f5afda7d700 1 --2- 172.21.15.49:0/958606721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5af80ca180 0x7f5af80c3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:00.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.298+0000 7f5afe27e700 1 -- 172.21.15.49:0/958606721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5af80ca180 msgr2=0x7f5af80c3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:00.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.298+0000 7f5afe27e700 1 --2- 172.21.15.49:0/958606721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5af80ca180 0x7f5af80c3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:00.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.299+0000 7f5afe27e700 1 -- 172.21.15.49:0/958606721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5af80caab0 msgr2=0x7f5af8154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:00.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.299+0000 7f5afe27e700 1 --2- 172.21.15.49:0/958606721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5af80caab0 0x7f5af8154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:00.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.299+0000 7f5afe27e700 1 -- 172.21.15.49:0/958606721 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae8009a20 con 0x7f5af80cae90 2023-11-30T17:20:00.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.299+0000 7f5afda7d700 1 --2- 172.21.15.49:0/958606721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5af80ca180 0x7f5af80c3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:20:00.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.299+0000 7f5afe27e700 1 --2- 172.21.15.49:0/958606721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5af80cae90 0x7f5af81677d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f5ae8009f60 tx=0x7f5ae800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:00.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.299+0000 7f5af5ffb700 1 -- 172.21.15.49:0/958606721 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae800cc20 con 0x7f5af80cae90 2023-11-30T17:20:00.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.299+0000 7f5af5ffb700 1 -- 172.21.15.49:0/958606721 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae800f040 con 0x7f5af80cae90 2023-11-30T17:20:00.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.299+0000 7f5affce1700 1 -- 172.21.15.49:0/958606721 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aec009370 con 0x7f5af80cae90 2023-11-30T17:20:00.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.299+0000 7f5af5ffb700 1 -- 172.21.15.49:0/958606721 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8013400 con 0x7f5af80cae90 2023-11-30T17:20:00.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.299+0000 7f5affce1700 1 -- 172.21.15.49:0/958606721 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af81579f0 con 0x7f5af80cae90 2023-11-30T17:20:00.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.300+0000 7f5affce1700 1 -- 172.21.15.49:0/958606721 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af80c5550 con 0x7f5af80cae90 2023-11-30T17:20:00.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.300+0000 7f5af5ffb700 1 -- 172.21.15.49:0/958606721 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f5ae80137b0 con 0x7f5af80cae90 2023-11-30T17:20:00.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.301+0000 7f5af5ffb700 1 --2- 172.21.15.49:0/958606721 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5ae405f270 0x7f5ae4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:00.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.301+0000 7f5af5ffb700 1 -- 172.21.15.49:0/958606721 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5ae807ac60 con 0x7f5af80cae90 2023-11-30T17:20:00.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.301+0000 7f5afda7d700 1 --2- 172.21.15.49:0/958606721 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5ae405f270 0x7f5ae4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:00.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.301+0000 7f5afda7d700 1 --2- 172.21.15.49:0/958606721 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5ae405f270 0x7f5ae4061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f5af0001740 tx=0x7f5af0009040).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:00.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.305+0000 7f5af5ffb700 1 -- 172.21.15.49:0/958606721 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5ae804bdb0 con 0x7f5af80cae90 2023-11-30T17:20:00.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.473+0000 7f5affce1700 1 -- 172.21.15.49:0/958606721 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5af806c860 con 0x7f5ae405f270 2023-11-30T17:20:00.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.484+0000 7f5af5ffb700 1 -- 172.21.15.49:0/958606721 <== mgr.5449 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359186 (secure 0 0 0) 0x7f5af806c860 con 0x7f5ae405f270 2023-11-30T17:20:00.490 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:20:00.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.487+0000 7f5affce1700 1 -- 172.21.15.49:0/958606721 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5ae405f270 msgr2=0x7f5ae4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:00.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.487+0000 7f5affce1700 1 --2- 172.21.15.49:0/958606721 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5ae405f270 0x7f5ae4061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f5af0001740 tx=0x7f5af0009040).stop 2023-11-30T17:20:00.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.487+0000 7f5affce1700 1 -- 172.21.15.49:0/958606721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5af80cae90 msgr2=0x7f5af81677d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:00.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.487+0000 7f5affce1700 1 --2- 172.21.15.49:0/958606721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5af80cae90 0x7f5af81677d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f5ae8009f60 tx=0x7f5ae800b040).stop 2023-11-30T17:20:00.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.487+0000 7f5affce1700 1 -- 172.21.15.49:0/958606721 shutdown_connections 2023-11-30T17:20:00.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.487+0000 7f5affce1700 1 --2- 172.21.15.49:0/958606721 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5ae405f270 0x7f5ae4061730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:00.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.487+0000 7f5affce1700 1 --2- 172.21.15.49:0/958606721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5af80cae90 0x7f5af81677d0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:00.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.487+0000 7f5affce1700 1 --2- 172.21.15.49:0/958606721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5af80ca180 0x7f5af80c3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:00.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.487+0000 7f5affce1700 1 --2- 172.21.15.49:0/958606721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5af80caab0 0x7f5af8154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:00.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.487+0000 7f5affce1700 1 -- 172.21.15.49:0/958606721 >> 172.21.15.49:0/958606721 conn(0x7f5af8094920 msgr2=0x7f5af80a7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:00.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.487+0000 7f5affce1700 1 -- 172.21.15.49:0/958606721 shutdown_connections 2023-11-30T17:20:00.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.487+0000 7f5affce1700 1 -- 172.21.15.49:0/958606721 wait complete. 2023-11-30T17:20:00.494 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:20:00.501 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-30T17:20:00.322110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2236,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":252,"acting":252,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":213,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2415544,"kb_used_data":6008,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752559176,"statfs":{"total":773094113280,"available":770620596224,"internally_reserved":0,"allocated":6152192,"data_stored":2991902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14996153,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-721,"num_write_kb":-15547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.999924"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491141+0000","last_change":"2023-11-30T17:19:56.485959+0000","last_active":"2023-11-30T17:19:56.491141+0000","last_peered":"2023-11-30T17:19:56.491141+0000","last_clean":"2023-11-30T17:19:56.491141+0000","last_became_active":"2023-11-30T17:19:56.485404+0000","last_became_peered":"2023-11-30T17:19:56.485404+0000","last_unstale":"2023-11-30T17:19:56.491141+0000","last_undegraded":"2023-11-30T17:19:56.491141+0000","last_fullsized":"2023-11-30T17:19:56.491141+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"64'3","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.497937+0000","last_change":"2023-11-30T17:19:56.097294+0000","last_active":"2023-11-30T17:19:56.497937+0000","last_peered":"2023-11-30T17:19:56.497937+0000","last_clean":"2023-11-30T17:19:56.497937+0000","last_became_active":"2023-11-30T17:19:56.097026+0000","last_became_peered":"2023-11-30T17:19:56.097026+0000","last_unstale":"2023-11-30T17:19:56.497937+0000","last_undegraded":"2023-11-30T17:19:56.497937+0000","last_fullsized":"2023-11-30T17:19:56.497937+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496181+0000","last_change":"2023-11-30T17:19:56.492152+0000","last_active":"2023-11-30T17:19:56.496181+0000","last_peered":"2023-11-30T17:19:56.496181+0000","last_clean":"2023-11-30T17:19:56.496181+0000","last_became_active":"2023-11-30T17:19:56.491843+0000","last_became_peered":"2023-11-30T17:19:56.491843+0000","last_unstale":"2023-11-30T17:19:56.496181+0000","last_undegraded":"2023-11-30T17:19:56.496181+0000","last_fullsized":"2023-11-30T17:19:56.496181+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.480790+0000","last_change":"2023-11-30T17:19:56.112352+0000","last_active":"2023-11-30T17:19:56.480790+0000","last_peered":"2023-11-30T17:19:56.480790+0000","last_clean":"2023-11-30T17:19:56.480790+0000","last_became_active":"2023-11-30T17:19:56.112039+0000","last_became_peered":"2023-11-30T17:19:56.112039+0000","last_unstale":"2023-11-30T17:19:56.480790+0000","last_undegraded":"2023-11-30T17:19:56.480790+0000","last_fullsized":"2023-11-30T17:19:56.480790+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500856+0000","last_change":"2023-11-30T17:19:56.496678+0000","last_active":"2023-11-30T17:19:56.500856+0000","last_peered":"2023-11-30T17:19:56.500856+0000","last_clean":"2023-11-30T17:19:56.500856+0000","last_became_active":"2023-11-30T17:19:56.492155+0000","last_became_peered":"2023-11-30T17:19:56.492155+0000","last_unstale":"2023-11-30T17:19:56.500856+0000","last_undegraded":"2023-11-30T17:19:56.500856+0000","last_fullsized":"2023-11-30T17:19:56.500856+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.082730+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.495745+0000","last_change":"2023-11-30T17:19:56.486081+0000","last_active":"2023-11-30T17:19:56.495745+0000","last_peered":"2023-11-30T17:19:56.495745+0000","last_clean":"2023-11-30T17:19:56.495745+0000","last_became_active":"2023-11-30T17:19:56.485781+0000","last_became_peered":"2023-11-30T17:19:56.485781+0000","last_unstale":"2023-11-30T17:19:56.495745+0000","last_undegraded":"2023-11-30T17:19:56.495745+0000","last_fullsized":"2023-11-30T17:19:56.495745+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"64'2","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.502495+0000","last_change":"2023-11-30T17:19:56.099441+0000","last_active":"2023-11-30T17:19:56.502495+0000","last_peered":"2023-11-30T17:19:56.502495+0000","last_clean":"2023-11-30T17:19:56.502495+0000","last_became_active":"2023-11-30T17:19:56.099054+0000","last_became_peered":"2023-11-30T17:19:56.099054+0000","last_unstale":"2023-11-30T17:19:56.502495+0000","last_undegraded":"2023-11-30T17:19:56.502495+0000","last_fullsized":"2023-11-30T17:19:56.502495+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493845+0000","last_change":"2023-11-30T17:19:56.492808+0000","last_active":"2023-11-30T17:19:56.493845+0000","last_peered":"2023-11-30T17:19:56.493845+0000","last_clean":"2023-11-30T17:19:56.493845+0000","last_became_active":"2023-11-30T17:19:56.492327+0000","last_became_peered":"2023-11-30T17:19:56.492327+0000","last_unstale":"2023-11-30T17:19:56.493845+0000","last_undegraded":"2023-11-30T17:19:56.493845+0000","last_fullsized":"2023-11-30T17:19:56.493845+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3b","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.490891+0000","last_change":"2023-11-30T17:19:56.112328+0000","last_active":"2023-11-30T17:19:56.490891+0000","last_peered":"2023-11-30T17:19:56.490891+0000","last_clean":"2023-11-30T17:19:56.490891+0000","last_became_active":"2023-11-30T17:19:56.112089+0000","last_became_peered":"2023-11-30T17:19:56.112089+0000","last_unstale":"2023-11-30T17:19:56.490891+0000","last_undegraded":"2023-11-30T17:19:56.490891+0000","last_fullsized":"2023-11-30T17:19:56.490891+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.492758+0000","last_change":"2023-11-30T17:19:56.489355+0000","last_active":"2023-11-30T17:19:56.492758+0000","last_peered":"2023-11-30T17:19:56.492758+0000","last_clean":"2023-11-30T17:19:56.492758+0000","last_became_active":"2023-11-30T17:19:56.489081+0000","last_became_peered":"2023-11-30T17:19:56.489081+0000","last_unstale":"2023-11-30T17:19:56.492758+0000","last_undegraded":"2023-11-30T17:19:56.492758+0000","last_fullsized":"2023-11-30T17:19:56.492758+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.489898+0000","last_change":"2023-11-30T17:19:56.095586+0000","last_active":"2023-11-30T17:19:56.489898+0000","last_peered":"2023-11-30T17:19:56.489898+0000","last_clean":"2023-11-30T17:19:56.489898+0000","last_became_active":"2023-11-30T17:19:56.095250+0000","last_became_peered":"2023-11-30T17:19:56.095250+0000","last_unstale":"2023-11-30T17:19:56.489898+0000","last_undegraded":"2023-11-30T17:19:56.489898+0000","last_fullsized":"2023-11-30T17:19:56.489898+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491110+0000","last_change":"2023-11-30T17:19:56.485707+0000","last_active":"2023-11-30T17:19:56.491110+0000","last_peered":"2023-11-30T17:19:56.491110+0000","last_clean":"2023-11-30T17:19:56.491110+0000","last_became_active":"2023-11-30T17:19:56.485420+0000","last_became_peered":"2023-11-30T17:19:56.485420+0000","last_unstale":"2023-11-30T17:19:56.491110+0000","last_undegraded":"2023-11-30T17:19:56.491110+0000","last_fullsized":"2023-11-30T17:19:56.491110+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.483241+0000","last_change":"2023-11-30T17:19:56.096279+0000","last_active":"2023-11-30T17:19:56.483241+0000","last_peered":"2023-11-30T17:19:56.483241+0000","last_clean":"2023-11-30T17:19:56.483241+0000","last_became_active":"2023-11-30T17:19:56.095989+0000","last_became_peered":"2023-11-30T17:19:56.095989+0000","last_unstale":"2023-11-30T17:19:56.483241+0000","last_undegraded":"2023-11-30T17:19:56.483241+0000","last_fullsized":"2023-11-30T17:19:56.483241+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.503846+0000","last_change":"2023-11-30T17:19:56.501562+0000","last_active":"2023-11-30T17:19:56.503846+0000","last_peered":"2023-11-30T17:19:56.503846+0000","last_clean":"2023-11-30T17:19:56.503846+0000","last_became_active":"2023-11-30T17:19:56.501259+0000","last_became_peered":"2023-11-30T17:19:56.501259+0000","last_unstale":"2023-11-30T17:19:56.503846+0000","last_undegraded":"2023-11-30T17:19:56.503846+0000","last_fullsized":"2023-11-30T17:19:56.503846+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.487885+0000","last_change":"2023-11-30T17:19:56.105956+0000","last_active":"2023-11-30T17:19:56.487885+0000","last_peered":"2023-11-30T17:19:56.487885+0000","last_clean":"2023-11-30T17:19:56.487885+0000","last_became_active":"2023-11-30T17:19:56.102562+0000","last_became_peered":"2023-11-30T17:19:56.102562+0000","last_unstale":"2023-11-30T17:19:56.487885+0000","last_undegraded":"2023-11-30T17:19:56.487885+0000","last_fullsized":"2023-11-30T17:19:56.487885+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496983+0000","last_change":"2023-11-30T17:19:56.495039+0000","last_active":"2023-11-30T17:19:56.496983+0000","last_peered":"2023-11-30T17:19:56.496983+0000","last_clean":"2023-11-30T17:19:56.496983+0000","last_became_active":"2023-11-30T17:19:56.494575+0000","last_became_peered":"2023-11-30T17:19:56.494575+0000","last_unstale":"2023-11-30T17:19:56.496983+0000","last_undegraded":"2023-11-30T17:19:56.496983+0000","last_fullsized":"2023-11-30T17:19:56.496983+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.499089+0000","last_change":"2023-11-30T17:19:56.110873+0000","last_active":"2023-11-30T17:19:56.499089+0000","last_peered":"2023-11-30T17:19:56.499089+0000","last_clean":"2023-11-30T17:19:56.499089+0000","last_became_active":"2023-11-30T17:19:56.110385+0000","last_became_peered":"2023-11-30T17:19:56.110385+0000","last_unstale":"2023-11-30T17:19:56.499089+0000","last_undegraded":"2023-11-30T17:19:56.499089+0000","last_fullsized":"2023-11-30T17:19:56.499089+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500826+0000","last_change":"2023-11-30T17:19:56.496567+0000","last_active":"2023-11-30T17:19:56.500826+0000","last_peered":"2023-11-30T17:19:56.500826+0000","last_clean":"2023-11-30T17:19:56.500826+0000","last_became_active":"2023-11-30T17:19:56.496282+0000","last_became_peered":"2023-11-30T17:19:56.496282+0000","last_unstale":"2023-11-30T17:19:56.500826+0000","last_undegraded":"2023-11-30T17:19:56.500826+0000","last_fullsized":"2023-11-30T17:19:56.500826+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.494906+0000","last_change":"2023-11-30T17:19:56.105548+0000","last_active":"2023-11-30T17:19:56.494906+0000","last_peered":"2023-11-30T17:19:56.494906+0000","last_clean":"2023-11-30T17:19:56.494906+0000","last_became_active":"2023-11-30T17:19:56.099867+0000","last_became_peered":"2023-11-30T17:19:56.099867+0000","last_unstale":"2023-11-30T17:19:56.494906+0000","last_undegraded":"2023-11-30T17:19:56.494906+0000","last_fullsized":"2023-11-30T17:19:56.494906+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.495750+0000","last_change":"2023-11-30T17:19:56.490226+0000","last_active":"2023-11-30T17:19:56.495750+0000","last_peered":"2023-11-30T17:19:56.495750+0000","last_clean":"2023-11-30T17:19:56.495750+0000","last_became_active":"2023-11-30T17:19:56.490008+0000","last_became_peered":"2023-11-30T17:19:56.490008+0000","last_unstale":"2023-11-30T17:19:56.495750+0000","last_undegraded":"2023-11-30T17:19:56.495750+0000","last_fullsized":"2023-11-30T17:19:56.495750+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498921+0000","last_change":"2023-11-30T17:19:56.110057+0000","last_active":"2023-11-30T17:19:56.498921+0000","last_peered":"2023-11-30T17:19:56.498921+0000","last_clean":"2023-11-30T17:19:56.498921+0000","last_became_active":"2023-11-30T17:19:56.109561+0000","last_became_peered":"2023-11-30T17:19:56.109561+0000","last_unstale":"2023-11-30T17:19:56.498921+0000","last_undegraded":"2023-11-30T17:19:56.498921+0000","last_fullsized":"2023-11-30T17:19:56.498921+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"64'4","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498286+0000","last_change":"2023-11-30T17:19:56.099632+0000","last_active":"2023-11-30T17:19:56.498286+0000","last_peered":"2023-11-30T17:19:56.498286+0000","last_clean":"2023-11-30T17:19:56.498286+0000","last_became_active":"2023-11-30T17:19:56.099366+0000","last_became_peered":"2023-11-30T17:19:56.099366+0000","last_unstale":"2023-11-30T17:19:56.498286+0000","last_undegraded":"2023-11-30T17:19:56.498286+0000","last_fullsized":"2023-11-30T17:19:56.498286+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.492794+0000","last_change":"2023-11-30T17:19:56.490274+0000","last_active":"2023-11-30T17:19:56.492794+0000","last_peered":"2023-11-30T17:19:56.492794+0000","last_clean":"2023-11-30T17:19:56.492794+0000","last_became_active":"2023-11-30T17:19:56.490014+0000","last_became_peered":"2023-11-30T17:19:56.490014+0000","last_unstale":"2023-11-30T17:19:56.492794+0000","last_undegraded":"2023-11-30T17:19:56.492794+0000","last_fullsized":"2023-11-30T17:19:56.492794+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.492148+0000","last_change":"2023-11-30T17:19:56.104864+0000","last_active":"2023-11-30T17:19:56.492148+0000","last_peered":"2023-11-30T17:19:56.492148+0000","last_clean":"2023-11-30T17:19:56.492148+0000","last_became_active":"2023-11-30T17:19:56.104590+0000","last_became_peered":"2023-11-30T17:19:56.104590+0000","last_unstale":"2023-11-30T17:19:56.492148+0000","last_undegraded":"2023-11-30T17:19:56.492148+0000","last_fullsized":"2023-11-30T17:19:56.492148+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.502029+0000","last_change":"2023-11-30T17:19:56.499597+0000","last_active":"2023-11-30T17:19:56.502029+0000","last_peered":"2023-11-30T17:19:56.502029+0000","last_clean":"2023-11-30T17:19:56.502029+0000","last_became_active":"2023-11-30T17:19:56.499146+0000","last_became_peered":"2023-11-30T17:19:56.499146+0000","last_unstale":"2023-11-30T17:19:56.502029+0000","last_undegraded":"2023-11-30T17:19:56.502029+0000","last_fullsized":"2023-11-30T17:19:56.502029+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.487477+0000","last_change":"2023-11-30T17:19:56.110204+0000","last_active":"2023-11-30T17:19:56.487477+0000","last_peered":"2023-11-30T17:19:56.487477+0000","last_clean":"2023-11-30T17:19:56.487477+0000","last_became_active":"2023-11-30T17:19:56.109745+0000","last_became_peered":"2023-11-30T17:19:56.109745+0000","last_unstale":"2023-11-30T17:19:56.487477+0000","last_undegraded":"2023-11-30T17:19:56.487477+0000","last_fullsized":"2023-11-30T17:19:56.487477+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498693+0000","last_change":"2023-11-30T17:19:56.494965+0000","last_active":"2023-11-30T17:19:56.498693+0000","last_peered":"2023-11-30T17:19:56.498693+0000","last_clean":"2023-11-30T17:19:56.498693+0000","last_became_active":"2023-11-30T17:19:56.494662+0000","last_became_peered":"2023-11-30T17:19:56.494662+0000","last_unstale":"2023-11-30T17:19:56.498693+0000","last_undegraded":"2023-11-30T17:19:56.498693+0000","last_fullsized":"2023-11-30T17:19:56.498693+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.476196+0000","last_change":"2023-11-30T17:19:56.100686+0000","last_active":"2023-11-30T17:19:56.476196+0000","last_peered":"2023-11-30T17:19:56.476196+0000","last_clean":"2023-11-30T17:19:56.476196+0000","last_became_active":"2023-11-30T17:19:56.100418+0000","last_became_peered":"2023-11-30T17:19:56.100418+0000","last_unstale":"2023-11-30T17:19:56.476196+0000","last_undegraded":"2023-11-30T17:19:56.476196+0000","last_fullsized":"2023-11-30T17:19:56.476196+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496351+0000","last_change":"2023-11-30T17:19:56.493474+0000","last_active":"2023-11-30T17:19:56.496351+0000","last_peered":"2023-11-30T17:19:56.496351+0000","last_clean":"2023-11-30T17:19:56.496351+0000","last_became_active":"2023-11-30T17:19:56.493191+0000","last_became_peered":"2023-11-30T17:19:56.493191+0000","last_unstale":"2023-11-30T17:19:56.496351+0000","last_undegraded":"2023-11-30T17:19:56.496351+0000","last_fullsized":"2023-11-30T17:19:56.496351+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.077396+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493563+0000","last_change":"2023-11-30T17:19:56.486088+0000","last_active":"2023-11-30T17:19:56.493563+0000","last_peered":"2023-11-30T17:19:56.493563+0000","last_clean":"2023-11-30T17:19:56.493563+0000","last_became_active":"2023-11-30T17:19:56.485651+0000","last_became_peered":"2023-11-30T17:19:56.485651+0000","last_unstale":"2023-11-30T17:19:56.493563+0000","last_undegraded":"2023-11-30T17:19:56.493563+0000","last_fullsized":"2023-11-30T17:19:56.493563+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.083264+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.495220+0000","last_change":"2023-11-30T17:19:56.491494+0000","last_active":"2023-11-30T17:19:56.495220+0000","last_peered":"2023-11-30T17:19:56.495220+0000","last_clean":"2023-11-30T17:19:56.495220+0000","last_became_active":"2023-11-30T17:19:56.491200+0000","last_became_peered":"2023-11-30T17:19:56.491200+0000","last_unstale":"2023-11-30T17:19:56.495220+0000","last_undegraded":"2023-11-30T17:19:56.495220+0000","last_fullsized":"2023-11-30T17:19:56.495220+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.084005+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.499018+0000","last_change":"2023-11-30T17:19:56.496795+0000","last_active":"2023-11-30T17:19:56.499018+0000","last_peered":"2023-11-30T17:19:56.499018+0000","last_clean":"2023-11-30T17:19:56.499018+0000","last_became_active":"2023-11-30T17:19:56.496519+0000","last_became_peered":"2023-11-30T17:19:56.496519+0000","last_unstale":"2023-11-30T17:19:56.499018+0000","last_undegraded":"2023-11-30T17:19:56.499018+0000","last_fullsized":"2023-11-30T17:19:56.499018+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.078100+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500642+0000","last_change":"2023-11-30T17:19:56.494936+0000","last_active":"2023-11-30T17:19:56.500642+0000","last_peered":"2023-11-30T17:19:56.500642+0000","last_clean":"2023-11-30T17:19:56.500642+0000","last_became_active":"2023-11-30T17:19:56.494628+0000","last_became_peered":"2023-11-30T17:19:56.494628+0000","last_unstale":"2023-11-30T17:19:56.500642+0000","last_undegraded":"2023-11-30T17:19:56.500642+0000","last_fullsized":"2023-11-30T17:19:56.500642+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.476989+0000","last_change":"2023-11-30T17:19:56.103835+0000","last_active":"2023-11-30T17:19:56.476989+0000","last_peered":"2023-11-30T17:19:56.476989+0000","last_clean":"2023-11-30T17:19:56.476989+0000","last_became_active":"2023-11-30T17:19:56.103532+0000","last_became_peered":"2023-11-30T17:19:56.103532+0000","last_unstale":"2023-11-30T17:19:56.476989+0000","last_undegraded":"2023-11-30T17:19:56.476989+0000","last_fullsized":"2023-11-30T17:19:56.476989+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.488294+0000","last_change":"2023-11-30T17:19:56.105248+0000","last_active":"2023-11-30T17:19:56.488294+0000","last_peered":"2023-11-30T17:19:56.488294+0000","last_clean":"2023-11-30T17:19:56.488294+0000","last_became_active":"2023-11-30T17:19:56.104768+0000","last_became_peered":"2023-11-30T17:19:56.104768+0000","last_unstale":"2023-11-30T17:19:56.488294+0000","last_undegraded":"2023-11-30T17:19:56.488294+0000","last_fullsized":"2023-11-30T17:19:56.488294+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496346+0000","last_change":"2023-11-30T17:19:56.490952+0000","last_active":"2023-11-30T17:19:56.496346+0000","last_peered":"2023-11-30T17:19:56.496346+0000","last_clean":"2023-11-30T17:19:56.496346+0000","last_became_active":"2023-11-30T17:19:56.490730+0000","last_became_peered":"2023-11-30T17:19:56.490730+0000","last_unstale":"2023-11-30T17:19:56.496346+0000","last_undegraded":"2023-11-30T17:19:56.496346+0000","last_fullsized":"2023-11-30T17:19:56.496346+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.487354+0000","last_change":"2023-11-30T17:19:56.105606+0000","last_active":"2023-11-30T17:19:56.487354+0000","last_peered":"2023-11-30T17:19:56.487354+0000","last_clean":"2023-11-30T17:19:56.487354+0000","last_became_active":"2023-11-30T17:19:56.104380+0000","last_became_peered":"2023-11-30T17:19:56.104380+0000","last_unstale":"2023-11-30T17:19:56.487354+0000","last_undegraded":"2023-11-30T17:19:56.487354+0000","last_fullsized":"2023-11-30T17:19:56.487354+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491376+0000","last_change":"2023-11-30T17:19:56.488970+0000","last_active":"2023-11-30T17:19:56.491376+0000","last_peered":"2023-11-30T17:19:56.491376+0000","last_clean":"2023-11-30T17:19:56.491376+0000","last_became_active":"2023-11-30T17:19:56.488343+0000","last_became_peered":"2023-11-30T17:19:56.488343+0000","last_unstale":"2023-11-30T17:19:56.491376+0000","last_undegraded":"2023-11-30T17:19:56.491376+0000","last_fullsized":"2023-11-30T17:19:56.491376+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.077908+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498741+0000","last_change":"2023-11-30T17:19:56.490432+0000","last_active":"2023-11-30T17:19:56.498741+0000","last_peered":"2023-11-30T17:19:56.498741+0000","last_clean":"2023-11-30T17:19:56.498741+0000","last_became_active":"2023-11-30T17:19:56.490159+0000","last_became_peered":"2023-11-30T17:19:56.490159+0000","last_unstale":"2023-11-30T17:19:56.498741+0000","last_undegraded":"2023-11-30T17:19:56.498741+0000","last_fullsized":"2023-11-30T17:19:56.498741+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.076864+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.494582+0000","last_change":"2023-11-30T17:19:56.490029+0000","last_active":"2023-11-30T17:19:56.494582+0000","last_peered":"2023-11-30T17:19:56.494582+0000","last_clean":"2023-11-30T17:19:56.494582+0000","last_became_active":"2023-11-30T17:19:56.488809+0000","last_became_peered":"2023-11-30T17:19:56.488809+0000","last_unstale":"2023-11-30T17:19:56.494582+0000","last_undegraded":"2023-11-30T17:19:56.494582+0000","last_fullsized":"2023-11-30T17:19:56.494582+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.079249+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493787+0000","last_change":"2023-11-30T17:19:56.492227+0000","last_active":"2023-11-30T17:19:56.493787+0000","last_peered":"2023-11-30T17:19:56.493787+0000","last_clean":"2023-11-30T17:19:56.493787+0000","last_became_active":"2023-11-30T17:19:56.491955+0000","last_became_peered":"2023-11-30T17:19:56.491955+0000","last_unstale":"2023-11-30T17:19:56.493787+0000","last_undegraded":"2023-11-30T17:19:56.493787+0000","last_fullsized":"2023-11-30T17:19:56.493787+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.475983+0000","last_change":"2023-11-30T17:19:56.105360+0000","last_active":"2023-11-30T17:19:56.475983+0000","last_peered":"2023-11-30T17:19:56.475983+0000","last_clean":"2023-11-30T17:19:56.475983+0000","last_became_active":"2023-11-30T17:19:56.105084+0000","last_became_peered":"2023-11-30T17:19:56.105084+0000","last_unstale":"2023-11-30T17:19:56.475983+0000","last_undegraded":"2023-11-30T17:19:56.475983+0000","last_fullsized":"2023-11-30T17:19:56.475983+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491335+0000","last_change":"2023-11-30T17:19:56.488160+0000","last_active":"2023-11-30T17:19:56.491335+0000","last_peered":"2023-11-30T17:19:56.491335+0000","last_clean":"2023-11-30T17:19:56.491335+0000","last_became_active":"2023-11-30T17:19:56.487871+0000","last_became_peered":"2023-11-30T17:19:56.487871+0000","last_unstale":"2023-11-30T17:19:56.491335+0000","last_undegraded":"2023-11-30T17:19:56.491335+0000","last_fullsized":"2023-11-30T17:19:56.491335+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.082342+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.479299+0000","last_change":"2023-11-30T17:19:56.098747+0000","last_active":"2023-11-30T17:19:56.479299+0000","last_peered":"2023-11-30T17:19:56.479299+0000","last_clean":"2023-11-30T17:19:56.479299+0000","last_became_active":"2023-11-30T17:19:56.098096+0000","last_became_peered":"2023-11-30T17:19:56.098096+0000","last_unstale":"2023-11-30T17:19:56.479299+0000","last_undegraded":"2023-11-30T17:19:56.479299+0000","last_fullsized":"2023-11-30T17:19:56.479299+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.076958+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.502012+0000","last_change":"2023-11-30T17:19:56.499411+0000","last_active":"2023-11-30T17:19:56.502012+0000","last_peered":"2023-11-30T17:19:56.502012+0000","last_clean":"2023-11-30T17:19:56.502012+0000","last_became_active":"2023-11-30T17:19:56.497013+0000","last_became_peered":"2023-11-30T17:19:56.497013+0000","last_unstale":"2023-11-30T17:19:56.502012+0000","last_undegraded":"2023-11-30T17:19:56.502012+0000","last_fullsized":"2023-11-30T17:19:56.502012+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.082939+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498714+0000","last_change":"2023-11-30T17:19:56.495065+0000","last_active":"2023-11-30T17:19:56.498714+0000","last_peered":"2023-11-30T17:19:56.498714+0000","last_clean":"2023-11-30T17:19:56.498714+0000","last_became_active":"2023-11-30T17:19:56.494734+0000","last_became_peered":"2023-11-30T17:19:56.494734+0000","last_unstale":"2023-11-30T17:19:56.498714+0000","last_undegraded":"2023-11-30T17:19:56.498714+0000","last_fullsized":"2023-11-30T17:19:56.498714+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.476094+0000","last_change":"2023-11-30T17:19:56.100559+0000","last_active":"2023-11-30T17:19:56.476094+0000","last_peered":"2023-11-30T17:19:56.476094+0000","last_clean":"2023-11-30T17:19:56.476094+0000","last_became_active":"2023-11-30T17:19:56.100267+0000","last_became_peered":"2023-11-30T17:19:56.100267+0000","last_unstale":"2023-11-30T17:19:56.476094+0000","last_undegraded":"2023-11-30T17:19:56.476094+0000","last_fullsized":"2023-11-30T17:19:56.476094+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.502077+0000","last_change":"2023-11-30T17:19:56.499755+0000","last_active":"2023-11-30T17:19:56.502077+0000","last_peered":"2023-11-30T17:19:56.502077+0000","last_clean":"2023-11-30T17:19:56.502077+0000","last_became_active":"2023-11-30T17:19:56.499465+0000","last_became_peered":"2023-11-30T17:19:56.499465+0000","last_unstale":"2023-11-30T17:19:56.502077+0000","last_undegraded":"2023-11-30T17:19:56.502077+0000","last_fullsized":"2023-11-30T17:19:56.502077+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.477375+0000","last_change":"2023-11-30T17:19:56.088985+0000","last_active":"2023-11-30T17:19:56.477375+0000","last_peered":"2023-11-30T17:19:56.477375+0000","last_clean":"2023-11-30T17:19:56.477375+0000","last_became_active":"2023-11-30T17:19:56.088686+0000","last_became_peered":"2023-11-30T17:19:56.088686+0000","last_unstale":"2023-11-30T17:19:56.477375+0000","last_undegraded":"2023-11-30T17:19:56.477375+0000","last_fullsized":"2023-11-30T17:19:56.477375+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.499116+0000","last_change":"2023-11-30T17:19:56.495412+0000","last_active":"2023-11-30T17:19:56.499116+0000","last_peered":"2023-11-30T17:19:56.499116+0000","last_clean":"2023-11-30T17:19:56.499116+0000","last_became_active":"2023-11-30T17:19:56.494719+0000","last_became_peered":"2023-11-30T17:19:56.494719+0000","last_unstale":"2023-11-30T17:19:56.499116+0000","last_undegraded":"2023-11-30T17:19:56.499116+0000","last_fullsized":"2023-11-30T17:19:56.499116+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.078834+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.497842+0000","last_change":"2023-11-30T17:19:56.496872+0000","last_active":"2023-11-30T17:19:56.497842+0000","last_peered":"2023-11-30T17:19:56.497842+0000","last_clean":"2023-11-30T17:19:56.497842+0000","last_became_active":"2023-11-30T17:19:56.496614+0000","last_became_peered":"2023-11-30T17:19:56.496614+0000","last_unstale":"2023-11-30T17:19:56.497842+0000","last_undegraded":"2023-11-30T17:19:56.497842+0000","last_fullsized":"2023-11-30T17:19:56.497842+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491029+0000","last_change":"2023-11-30T17:19:56.104114+0000","last_active":"2023-11-30T17:19:56.491029+0000","last_peered":"2023-11-30T17:19:56.491029+0000","last_clean":"2023-11-30T17:19:56.491029+0000","last_became_active":"2023-11-30T17:19:56.103835+0000","last_became_peered":"2023-11-30T17:19:56.103835+0000","last_unstale":"2023-11-30T17:19:56.491029+0000","last_undegraded":"2023-11-30T17:19:56.491029+0000","last_fullsized":"2023-11-30T17:19:56.491029+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"64'2","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500313+0000","last_change":"2023-11-30T17:19:56.087339+0000","last_active":"2023-11-30T17:19:56.500313+0000","last_peered":"2023-11-30T17:19:56.500313+0000","last_clean":"2023-11-30T17:19:56.500313+0000","last_became_active":"2023-11-30T17:19:56.086993+0000","last_became_peered":"2023-11-30T17:19:56.086993+0000","last_unstale":"2023-11-30T17:19:56.500313+0000","last_undegraded":"2023-11-30T17:19:56.500313+0000","last_fullsized":"2023-11-30T17:19:56.500313+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491920+0000","last_change":"2023-11-30T17:19:56.489159+0000","last_active":"2023-11-30T17:19:56.491920+0000","last_peered":"2023-11-30T17:19:56.491920+0000","last_clean":"2023-11-30T17:19:56.491920+0000","last_became_active":"2023-11-30T17:19:56.488952+0000","last_became_peered":"2023-11-30T17:19:56.488952+0000","last_unstale":"2023-11-30T17:19:56.491920+0000","last_undegraded":"2023-11-30T17:19:56.491920+0000","last_fullsized":"2023-11-30T17:19:56.491920+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.479404+0000","last_change":"2023-11-30T17:19:56.098371+0000","last_active":"2023-11-30T17:19:56.479404+0000","last_peered":"2023-11-30T17:19:56.479404+0000","last_clean":"2023-11-30T17:19:56.479404+0000","last_became_active":"2023-11-30T17:19:56.097768+0000","last_became_peered":"2023-11-30T17:19:56.097768+0000","last_unstale":"2023-11-30T17:19:56.479404+0000","last_undegraded":"2023-11-30T17:19:56.479404+0000","last_fullsized":"2023-11-30T17:19:56.479404+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.494168+0000","last_change":"2023-11-30T17:19:56.107222+0000","last_active":"2023-11-30T17:19:56.494168+0000","last_peered":"2023-11-30T17:19:56.494168+0000","last_clean":"2023-11-30T17:19:56.494168+0000","last_became_active":"2023-11-30T17:19:56.106944+0000","last_became_peered":"2023-11-30T17:19:56.106944+0000","last_unstale":"2023-11-30T17:19:56.494168+0000","last_undegraded":"2023-11-30T17:19:56.494168+0000","last_fullsized":"2023-11-30T17:19:56.494168+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.499076+0000","last_change":"2023-11-30T17:19:56.497589+0000","last_active":"2023-11-30T17:19:56.499076+0000","last_peered":"2023-11-30T17:19:56.499076+0000","last_clean":"2023-11-30T17:19:56.499076+0000","last_became_active":"2023-11-30T17:19:56.497315+0000","last_became_peered":"2023-11-30T17:19:56.497315+0000","last_unstale":"2023-11-30T17:19:56.499076+0000","last_undegraded":"2023-11-30T17:19:56.499076+0000","last_fullsized":"2023-11-30T17:19:56.499076+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.082279+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491354+0000","last_change":"2023-11-30T17:19:56.488325+0000","last_active":"2023-11-30T17:19:56.491354+0000","last_peered":"2023-11-30T17:19:56.491354+0000","last_clean":"2023-11-30T17:19:56.491354+0000","last_became_active":"2023-11-30T17:19:56.488024+0000","last_became_peered":"2023-11-30T17:19:56.488024+0000","last_unstale":"2023-11-30T17:19:56.491354+0000","last_undegraded":"2023-11-30T17:19:56.491354+0000","last_fullsized":"2023-11-30T17:19:56.491354+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.077413+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.502394+0000","last_change":"2023-11-30T17:19:56.501622+0000","last_active":"2023-11-30T17:19:56.502394+0000","last_peered":"2023-11-30T17:19:56.502394+0000","last_clean":"2023-11-30T17:19:56.502394+0000","last_became_active":"2023-11-30T17:19:56.501307+0000","last_became_peered":"2023-11-30T17:19:56.501307+0000","last_unstale":"2023-11-30T17:19:56.502394+0000","last_undegraded":"2023-11-30T17:19:56.502394+0000","last_fullsized":"2023-11-30T17:19:56.502394+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.487985+0000","last_change":"2023-11-30T17:19:56.104353+0000","last_active":"2023-11-30T17:19:56.487985+0000","last_peered":"2023-11-30T17:19:56.487985+0000","last_clean":"2023-11-30T17:19:56.487985+0000","last_became_active":"2023-11-30T17:19:56.102240+0000","last_became_peered":"2023-11-30T17:19:56.102240+0000","last_unstale":"2023-11-30T17:19:56.487985+0000","last_undegraded":"2023-11-30T17:19:56.487985+0000","last_fullsized":"2023-11-30T17:19:56.487985+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.484948+0000","last_change":"2023-11-30T17:19:56.103000+0000","last_active":"2023-11-30T17:19:56.484948+0000","last_peered":"2023-11-30T17:19:56.484948+0000","last_clean":"2023-11-30T17:19:56.484948+0000","last_became_active":"2023-11-30T17:19:56.102778+0000","last_became_peered":"2023-11-30T17:19:56.102778+0000","last_unstale":"2023-11-30T17:19:56.484948+0000","last_undegraded":"2023-11-30T17:19:56.484948+0000","last_fullsized":"2023-11-30T17:19:56.484948+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.494098+0000","last_change":"2023-11-30T17:19:56.490277+0000","last_active":"2023-11-30T17:19:56.494098+0000","last_peered":"2023-11-30T17:19:56.494098+0000","last_clean":"2023-11-30T17:19:56.494098+0000","last_became_active":"2023-11-30T17:19:56.490009+0000","last_became_peered":"2023-11-30T17:19:56.490009+0000","last_unstale":"2023-11-30T17:19:56.494098+0000","last_undegraded":"2023-11-30T17:19:56.494098+0000","last_fullsized":"2023-11-30T17:19:56.494098+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.083351+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.501207+0000","last_change":"2023-11-30T17:19:56.499008+0000","last_active":"2023-11-30T17:19:56.501207+0000","last_peered":"2023-11-30T17:19:56.501207+0000","last_clean":"2023-11-30T17:19:56.501207+0000","last_became_active":"2023-11-30T17:19:56.498726+0000","last_became_peered":"2023-11-30T17:19:56.498726+0000","last_unstale":"2023-11-30T17:19:56.501207+0000","last_undegraded":"2023-11-30T17:19:56.501207+0000","last_fullsized":"2023-11-30T17:19:56.501207+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"64'3","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.497982+0000","last_change":"2023-11-30T17:19:56.099588+0000","last_active":"2023-11-30T17:19:56.497982+0000","last_peered":"2023-11-30T17:19:56.497982+0000","last_clean":"2023-11-30T17:19:56.497982+0000","last_became_active":"2023-11-30T17:19:56.099307+0000","last_became_peered":"2023-11-30T17:19:56.099307+0000","last_unstale":"2023-11-30T17:19:56.497982+0000","last_undegraded":"2023-11-30T17:19:56.497982+0000","last_fullsized":"2023-11-30T17:19:56.497982+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"64'2","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493354+0000","last_change":"2023-11-30T17:19:56.099031+0000","last_active":"2023-11-30T17:19:56.493354+0000","last_peered":"2023-11-30T17:19:56.493354+0000","last_clean":"2023-11-30T17:19:56.493354+0000","last_became_active":"2023-11-30T17:19:56.098676+0000","last_became_peered":"2023-11-30T17:19:56.098676+0000","last_unstale":"2023-11-30T17:19:56.493354+0000","last_undegraded":"2023-11-30T17:19:56.493354+0000","last_fullsized":"2023-11-30T17:19:56.493354+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498229+0000","last_change":"2023-11-30T17:19:56.493423+0000","last_active":"2023-11-30T17:19:56.498229+0000","last_peered":"2023-11-30T17:19:56.498229+0000","last_clean":"2023-11-30T17:19:56.498229+0000","last_became_active":"2023-11-30T17:19:56.493141+0000","last_became_peered":"2023-11-30T17:19:56.493141+0000","last_unstale":"2023-11-30T17:19:56.498229+0000","last_undegraded":"2023-11-30T17:19:56.498229+0000","last_fullsized":"2023-11-30T17:19:56.498229+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.501063+0000","last_change":"2023-11-30T17:19:56.106743+0000","last_active":"2023-11-30T17:19:56.501063+0000","last_peered":"2023-11-30T17:19:56.501063+0000","last_clean":"2023-11-30T17:19:56.501063+0000","last_became_active":"2023-11-30T17:19:56.106450+0000","last_became_peered":"2023-11-30T17:19:56.106450+0000","last_unstale":"2023-11-30T17:19:56.501063+0000","last_undegraded":"2023-11-30T17:19:56.501063+0000","last_fullsized":"2023-11-30T17:19:56.501063+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500981+0000","last_change":"2023-11-30T17:19:56.497411+0000","last_active":"2023-11-30T17:19:56.500981+0000","last_peered":"2023-11-30T17:19:56.500981+0000","last_clean":"2023-11-30T17:19:56.500981+0000","last_became_active":"2023-11-30T17:19:56.487506+0000","last_became_peered":"2023-11-30T17:19:56.487506+0000","last_unstale":"2023-11-30T17:19:56.500981+0000","last_undegraded":"2023-11-30T17:19:56.500981+0000","last_fullsized":"2023-11-30T17:19:56.500981+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.078221+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491429+0000","last_change":"2023-11-30T17:19:56.490367+0000","last_active":"2023-11-30T17:19:56.491429+0000","last_peered":"2023-11-30T17:19:56.491429+0000","last_clean":"2023-11-30T17:19:56.491429+0000","last_became_active":"2023-11-30T17:19:56.490117+0000","last_became_peered":"2023-11-30T17:19:56.490117+0000","last_unstale":"2023-11-30T17:19:56.491429+0000","last_undegraded":"2023-11-30T17:19:56.491429+0000","last_fullsized":"2023-11-30T17:19:56.491429+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.483337+0000","last_change":"2023-11-30T17:19:56.100665+0000","last_active":"2023-11-30T17:19:56.483337+0000","last_peered":"2023-11-30T17:19:56.483337+0000","last_clean":"2023-11-30T17:19:56.483337+0000","last_became_active":"2023-11-30T17:19:56.100289+0000","last_became_peered":"2023-11-30T17:19:56.100289+0000","last_unstale":"2023-11-30T17:19:56.483337+0000","last_undegraded":"2023-11-30T17:19:56.483337+0000","last_fullsized":"2023-11-30T17:19:56.483337+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.501995+0000","last_change":"2023-11-30T17:19:56.499238+0000","last_active":"2023-11-30T17:19:56.501995+0000","last_peered":"2023-11-30T17:19:56.501995+0000","last_clean":"2023-11-30T17:19:56.501995+0000","last_became_active":"2023-11-30T17:19:56.498862+0000","last_became_peered":"2023-11-30T17:19:56.498862+0000","last_unstale":"2023-11-30T17:19:56.501995+0000","last_undegraded":"2023-11-30T17:19:56.501995+0000","last_fullsized":"2023-11-30T17:19:56.501995+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"64'4","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493785+0000","last_change":"2023-11-30T17:19:56.104095+0000","last_active":"2023-11-30T17:19:56.493785+0000","last_peered":"2023-11-30T17:19:56.493785+0000","last_clean":"2023-11-30T17:19:56.493785+0000","last_became_active":"2023-11-30T17:19:56.103816+0000","last_became_peered":"2023-11-30T17:19:56.103816+0000","last_unstale":"2023-11-30T17:19:56.493785+0000","last_undegraded":"2023-11-30T17:19:56.493785+0000","last_fullsized":"2023-11-30T17:19:56.493785+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496102+0000","last_change":"2023-11-30T17:19:56.494855+0000","last_active":"2023-11-30T17:19:56.496102+0000","last_peered":"2023-11-30T17:19:56.496102+0000","last_clean":"2023-11-30T17:19:56.496102+0000","last_became_active":"2023-11-30T17:19:56.494231+0000","last_became_peered":"2023-11-30T17:19:56.494231+0000","last_unstale":"2023-11-30T17:19:56.496102+0000","last_undegraded":"2023-11-30T17:19:56.496102+0000","last_fullsized":"2023-11-30T17:19:56.496102+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.504017+0000","last_change":"2023-11-30T17:19:56.108216+0000","last_active":"2023-11-30T17:19:56.504017+0000","last_peered":"2023-11-30T17:19:56.504017+0000","last_clean":"2023-11-30T17:19:56.504017+0000","last_became_active":"2023-11-30T17:19:56.107938+0000","last_became_peered":"2023-11-30T17:19:56.107938+0000","last_unstale":"2023-11-30T17:19:56.504017+0000","last_undegraded":"2023-11-30T17:19:56.504017+0000","last_fullsized":"2023-11-30T17:19:56.504017+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.495894+0000","last_change":"2023-11-30T17:19:56.490237+0000","last_active":"2023-11-30T17:19:56.495894+0000","last_peered":"2023-11-30T17:19:56.495894+0000","last_clean":"2023-11-30T17:19:56.495894+0000","last_became_active":"2023-11-30T17:19:56.489940+0000","last_became_peered":"2023-11-30T17:19:56.489940+0000","last_unstale":"2023-11-30T17:19:56.495894+0000","last_undegraded":"2023-11-30T17:19:56.495894+0000","last_fullsized":"2023-11-30T17:19:56.495894+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"64'2","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.492593+0000","last_change":"2023-11-30T17:19:56.100743+0000","last_active":"2023-11-30T17:19:56.492593+0000","last_peered":"2023-11-30T17:19:56.492593+0000","last_clean":"2023-11-30T17:19:56.492593+0000","last_became_active":"2023-11-30T17:19:56.100431+0000","last_became_peered":"2023-11-30T17:19:56.100431+0000","last_unstale":"2023-11-30T17:19:56.492593+0000","last_undegraded":"2023-11-30T17:19:56.492593+0000","last_fullsized":"2023-11-30T17:19:56.492593+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.077671+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496432+0000","last_change":"2023-11-30T17:19:56.493539+0000","last_active":"2023-11-30T17:19:56.496432+0000","last_peered":"2023-11-30T17:19:56.496432+0000","last_clean":"2023-11-30T17:19:56.496432+0000","last_became_active":"2023-11-30T17:19:56.493211+0000","last_became_peered":"2023-11-30T17:19:56.493211+0000","last_unstale":"2023-11-30T17:19:56.496432+0000","last_undegraded":"2023-11-30T17:19:56.496432+0000","last_fullsized":"2023-11-30T17:19:56.496432+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.078432+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498207+0000","last_change":"2023-11-30T17:19:56.492263+0000","last_active":"2023-11-30T17:19:56.498207+0000","last_peered":"2023-11-30T17:19:56.498207+0000","last_clean":"2023-11-30T17:19:56.498207+0000","last_became_active":"2023-11-30T17:19:56.491997+0000","last_became_peered":"2023-11-30T17:19:56.491997+0000","last_unstale":"2023-11-30T17:19:56.498207+0000","last_undegraded":"2023-11-30T17:19:56.498207+0000","last_fullsized":"2023-11-30T17:19:56.498207+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493638+0000","last_change":"2023-11-30T17:19:56.101187+0000","last_active":"2023-11-30T17:19:56.493638+0000","last_peered":"2023-11-30T17:19:56.493638+0000","last_clean":"2023-11-30T17:19:56.493638+0000","last_became_active":"2023-11-30T17:19:56.100914+0000","last_became_peered":"2023-11-30T17:19:56.100914+0000","last_unstale":"2023-11-30T17:19:56.493638+0000","last_undegraded":"2023-11-30T17:19:56.493638+0000","last_fullsized":"2023-11-30T17:19:56.493638+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.476956+0000","last_change":"2023-11-30T17:19:56.099958+0000","last_active":"2023-11-30T17:19:56.476956+0000","last_peered":"2023-11-30T17:19:56.476956+0000","last_clean":"2023-11-30T17:19:56.476956+0000","last_became_active":"2023-11-30T17:19:56.099666+0000","last_became_peered":"2023-11-30T17:19:56.099666+0000","last_unstale":"2023-11-30T17:19:56.476956+0000","last_undegraded":"2023-11-30T17:19:56.476956+0000","last_fullsized":"2023-11-30T17:19:56.476956+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500920+0000","last_change":"2023-11-30T17:19:56.497005+0000","last_active":"2023-11-30T17:19:56.500920+0000","last_peered":"2023-11-30T17:19:56.500920+0000","last_clean":"2023-11-30T17:19:56.500920+0000","last_became_active":"2023-11-30T17:19:56.496751+0000","last_became_peered":"2023-11-30T17:19:56.496751+0000","last_unstale":"2023-11-30T17:19:56.500920+0000","last_undegraded":"2023-11-30T17:19:56.500920+0000","last_fullsized":"2023-11-30T17:19:56.500920+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.485997+0000","last_change":"2023-11-30T17:19:56.109945+0000","last_active":"2023-11-30T17:19:56.485997+0000","last_peered":"2023-11-30T17:19:56.485997+0000","last_clean":"2023-11-30T17:19:56.485997+0000","last_became_active":"2023-11-30T17:19:56.109524+0000","last_became_peered":"2023-11-30T17:19:56.109524+0000","last_unstale":"2023-11-30T17:19:56.485997+0000","last_undegraded":"2023-11-30T17:19:56.485997+0000","last_fullsized":"2023-11-30T17:19:56.485997+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.484983+0000","last_change":"2023-11-30T17:19:56.481568+0000","last_active":"2023-11-30T17:19:56.484983+0000","last_peered":"2023-11-30T17:19:56.484983+0000","last_clean":"2023-11-30T17:19:56.484983+0000","last_became_active":"2023-11-30T17:19:56.481250+0000","last_became_peered":"2023-11-30T17:19:56.481250+0000","last_unstale":"2023-11-30T17:19:56.484983+0000","last_undegraded":"2023-11-30T17:19:56.484983+0000","last_fullsized":"2023-11-30T17:19:56.484983+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.477452+0000","last_change":"2023-11-30T17:19:56.094800+0000","last_active":"2023-11-30T17:19:56.477452+0000","last_peered":"2023-11-30T17:19:56.477452+0000","last_clean":"2023-11-30T17:19:56.477452+0000","last_became_active":"2023-11-30T17:19:56.094502+0000","last_became_peered":"2023-11-30T17:19:56.094502+0000","last_unstale":"2023-11-30T17:19:56.477452+0000","last_undegraded":"2023-11-30T17:19:56.477452+0000","last_fullsized":"2023-11-30T17:19:56.477452+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493507+0000","last_change":"2023-11-30T17:19:56.490881+0000","last_active":"2023-11-30T17:19:56.493507+0000","last_peered":"2023-11-30T17:19:56.493507+0000","last_clean":"2023-11-30T17:19:56.493507+0000","last_became_active":"2023-11-30T17:19:56.490557+0000","last_became_peered":"2023-11-30T17:19:56.490557+0000","last_unstale":"2023-11-30T17:19:56.493507+0000","last_undegraded":"2023-11-30T17:19:56.493507+0000","last_fullsized":"2023-11-30T17:19:56.493507+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.082283+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.472480+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:19:56.472480+0000","last_peered":"2023-11-30T17:19:56.472480+0000","last_clean":"2023-11-30T17:19:56.472480+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:19:56.472480+0000","last_undegraded":"2023-11-30T17:19:56.472480+0000","last_fullsized":"2023-11-30T17:19:56.472480+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493542+0000","last_change":"2023-11-30T17:19:56.485917+0000","last_active":"2023-11-30T17:19:56.493542+0000","last_peered":"2023-11-30T17:19:56.493542+0000","last_clean":"2023-11-30T17:19:56.493542+0000","last_became_active":"2023-11-30T17:19:56.485355+0000","last_became_peered":"2023-11-30T17:19:56.485355+0000","last_unstale":"2023-11-30T17:19:56.493542+0000","last_undegraded":"2023-11-30T17:19:56.493542+0000","last_fullsized":"2023-11-30T17:19:56.493542+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.077495+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.479090+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:19:56.479090+0000","last_peered":"2023-11-30T17:19:56.479090+0000","last_clean":"2023-11-30T17:19:56.479090+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:19:56.479090+0000","last_undegraded":"2023-11-30T17:19:56.479090+0000","last_fullsized":"2023-11-30T17:19:56.479090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491937+0000","last_change":"2023-11-30T17:19:56.489558+0000","last_active":"2023-11-30T17:19:56.491937+0000","last_peered":"2023-11-30T17:19:56.491937+0000","last_clean":"2023-11-30T17:19:56.491937+0000","last_became_active":"2023-11-30T17:19:56.489367+0000","last_became_peered":"2023-11-30T17:19:56.489367+0000","last_unstale":"2023-11-30T17:19:56.491937+0000","last_undegraded":"2023-11-30T17:19:56.491937+0000","last_fullsized":"2023-11-30T17:19:56.491937+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.495220+0000","last_change":"2023-11-30T17:19:56.099447+0000","last_active":"2023-11-30T17:19:56.495220+0000","last_peered":"2023-11-30T17:19:56.495220+0000","last_clean":"2023-11-30T17:19:56.495220+0000","last_became_active":"2023-11-30T17:19:56.098752+0000","last_became_peered":"2023-11-30T17:19:56.098752+0000","last_unstale":"2023-11-30T17:19:56.495220+0000","last_undegraded":"2023-11-30T17:19:56.495220+0000","last_fullsized":"2023-11-30T17:19:56.495220+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.476345+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:19:56.476345+0000","last_peered":"2023-11-30T17:19:56.476345+0000","last_clean":"2023-11-30T17:19:56.476345+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:19:56.476345+0000","last_undegraded":"2023-11-30T17:19:56.476345+0000","last_fullsized":"2023-11-30T17:19:56.476345+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496649+0000","last_change":"2023-11-30T17:19:56.106136+0000","last_active":"2023-11-30T17:19:56.496649+0000","last_peered":"2023-11-30T17:19:56.496649+0000","last_clean":"2023-11-30T17:19:56.496649+0000","last_became_active":"2023-11-30T17:19:56.105756+0000","last_became_peered":"2023-11-30T17:19:56.105756+0000","last_unstale":"2023-11-30T17:19:56.496649+0000","last_undegraded":"2023-11-30T17:19:56.496649+0000","last_fullsized":"2023-11-30T17:19:56.496649+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.480220+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:19:56.480220+0000","last_peered":"2023-11-30T17:19:56.480220+0000","last_clean":"2023-11-30T17:19:56.480220+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:19:56.480220+0000","last_undegraded":"2023-11-30T17:19:56.480220+0000","last_fullsized":"2023-11-30T17:19:56.480220+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":51,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.481994+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:19:56.481994+0000","last_peered":"2023-11-30T17:19:56.481994+0000","last_clean":"2023-11-30T17:19:56.481994+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:19:56.481994+0000","last_undegraded":"2023-11-30T17:19:56.481994+0000","last_fullsized":"2023-11-30T17:19:56.481994+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.484755+0000","last_change":"2023-11-30T17:19:56.482476+0000","last_active":"2023-11-30T17:19:56.484755+0000","last_peered":"2023-11-30T17:19:56.484755+0000","last_clean":"2023-11-30T17:19:56.484755+0000","last_became_active":"2023-11-30T17:19:56.482179+0000","last_became_peered":"2023-11-30T17:19:56.482179+0000","last_unstale":"2023-11-30T17:19:56.484755+0000","last_undegraded":"2023-11-30T17:19:56.484755+0000","last_fullsized":"2023-11-30T17:19:56.484755+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.485102+0000","last_change":"2023-11-30T17:19:56.097211+0000","last_active":"2023-11-30T17:19:56.485102+0000","last_peered":"2023-11-30T17:19:56.485102+0000","last_clean":"2023-11-30T17:19:56.485102+0000","last_became_active":"2023-11-30T17:19:56.096945+0000","last_became_peered":"2023-11-30T17:19:56.096945+0000","last_unstale":"2023-11-30T17:19:56.485102+0000","last_undegraded":"2023-11-30T17:19:56.485102+0000","last_fullsized":"2023-11-30T17:19:56.485102+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.482083+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:19:56.482083+0000","last_peered":"2023-11-30T17:19:56.482083+0000","last_clean":"2023-11-30T17:19:56.482083+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:19:56.482083+0000","last_undegraded":"2023-11-30T17:19:56.482083+0000","last_fullsized":"2023-11-30T17:19:56.482083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491458+0000","last_change":"2023-11-30T17:19:56.489737+0000","last_active":"2023-11-30T17:19:56.491458+0000","last_peered":"2023-11-30T17:19:56.491458+0000","last_clean":"2023-11-30T17:19:56.491458+0000","last_became_active":"2023-11-30T17:19:56.487977+0000","last_became_peered":"2023-11-30T17:19:56.487977+0000","last_unstale":"2023-11-30T17:19:56.491458+0000","last_undegraded":"2023-11-30T17:19:56.491458+0000","last_fullsized":"2023-11-30T17:19:56.491458+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.479316+0000","last_change":"2023-11-30T17:19:56.104936+0000","last_active":"2023-11-30T17:19:56.479316+0000","last_peered":"2023-11-30T17:19:56.479316+0000","last_clean":"2023-11-30T17:19:56.479316+0000","last_became_active":"2023-11-30T17:19:56.104707+0000","last_became_peered":"2023-11-30T17:19:56.104707+0000","last_unstale":"2023-11-30T17:19:56.479316+0000","last_undegraded":"2023-11-30T17:19:56.479316+0000","last_fullsized":"2023-11-30T17:19:56.479316+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.485161+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:19:56.485161+0000","last_peered":"2023-11-30T17:19:56.485161+0000","last_clean":"2023-11-30T17:19:56.485161+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:19:56.485161+0000","last_undegraded":"2023-11-30T17:19:56.485161+0000","last_fullsized":"2023-11-30T17:19:56.485161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.487502+0000","last_change":"2023-11-30T17:19:56.486862+0000","last_active":"2023-11-30T17:19:56.487502+0000","last_peered":"2023-11-30T17:19:56.487502+0000","last_clean":"2023-11-30T17:19:56.487502+0000","last_became_active":"2023-11-30T17:19:56.486600+0000","last_became_peered":"2023-11-30T17:19:56.486600+0000","last_unstale":"2023-11-30T17:19:56.487502+0000","last_undegraded":"2023-11-30T17:19:56.487502+0000","last_fullsized":"2023-11-30T17:19:56.487502+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.478581+0000","last_change":"2023-11-30T17:19:56.108142+0000","last_active":"2023-11-30T17:19:56.478581+0000","last_peered":"2023-11-30T17:19:56.478581+0000","last_clean":"2023-11-30T17:19:56.478581+0000","last_became_active":"2023-11-30T17:19:56.107685+0000","last_became_peered":"2023-11-30T17:19:56.107685+0000","last_unstale":"2023-11-30T17:19:56.478581+0000","last_undegraded":"2023-11-30T17:19:56.478581+0000","last_fullsized":"2023-11-30T17:19:56.478581+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.472945+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:19:56.472945+0000","last_peered":"2023-11-30T17:19:56.472945+0000","last_clean":"2023-11-30T17:19:56.472945+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:19:56.472945+0000","last_undegraded":"2023-11-30T17:19:56.472945+0000","last_fullsized":"2023-11-30T17:19:56.472945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.494336+0000","last_change":"2023-11-30T17:19:56.489210+0000","last_active":"2023-11-30T17:19:56.494336+0000","last_peered":"2023-11-30T17:19:56.494336+0000","last_clean":"2023-11-30T17:19:56.494336+0000","last_became_active":"2023-11-30T17:19:56.488914+0000","last_became_peered":"2023-11-30T17:19:56.488914+0000","last_unstale":"2023-11-30T17:19:56.494336+0000","last_undegraded":"2023-11-30T17:19:56.494336+0000","last_fullsized":"2023-11-30T17:19:56.494336+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.477075+0000","last_change":"2023-11-30T17:19:56.102213+0000","last_active":"2023-11-30T17:19:56.477075+0000","last_peered":"2023-11-30T17:19:56.477075+0000","last_clean":"2023-11-30T17:19:56.477075+0000","last_became_active":"2023-11-30T17:19:56.101927+0000","last_became_peered":"2023-11-30T17:19:56.101927+0000","last_unstale":"2023-11-30T17:19:56.477075+0000","last_undegraded":"2023-11-30T17:19:56.477075+0000","last_fullsized":"2023-11-30T17:19:56.477075+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-30T17:19:52.060819+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:19:52.060819+0000","last_peered":"2023-11-30T17:19:52.060819+0000","last_clean":"2023-11-30T17:19:52.060819+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:19:52.060819+0000","last_undegraded":"2023-11-30T17:19:52.060819+0000","last_fullsized":"2023-11-30T17:19:52.060819+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":2236,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":106,"acting":106,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575004,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297864,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":786432,"data_stored":380863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58699999999999997,"15min":0.55800000000000005},"min":{"1min":0.374,"5min":0.317,"15min":0.23899999999999999},"max":{"1min":0.73099999999999998,"5min":0.78700000000000003,"15min":0.81100000000000005},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58599999999999997,"15min":0.56599999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.32200000000000001},"max":{"1min":0.76400000000000001,"5min":0.76700000000000002,"15min":0.81899999999999995},"last":0.56100000000000005}]},{"osd":1,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55200000000000005,"15min":0.53000000000000003},"min":{"1min":0.39400000000000002,"5min":0.34599999999999997,"15min":0.33600000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.79400000000000004},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.28799999999999998},"max":{"1min":0.63400000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.46700000000000003}]},{"osd":2,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.32800000000000001},"max":{"1min":0.67600000000000005,"5min":0.77200000000000002,"15min":0.78300000000000003},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.28699999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.83899999999999997},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54400000000000004,"15min":0.53700000000000003},"min":{"1min":0.375,"5min":0.36899999999999999,"15min":0.33200000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.78000000000000003},"last":0.623},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.33900000000000002},"max":{"1min":0.72999999999999998,"5min":0.80500000000000005,"15min":0.81200000000000006},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.44800000000000001,"15min":0.47099999999999997},"min":{"1min":0.313,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.61899999999999999,"5min":0.77500000000000002,"15min":0.79900000000000004},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.442,"5min":0.46899999999999997,"15min":0.5},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.66600000000000004,"5min":0.69999999999999996,"15min":1.3180000000000001},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47499999999999998,"15min":0.501},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68100000000000005,"5min":0.71499999999999997,"15min":0.82899999999999996},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.51000000000000001,"15min":0.53300000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69099999999999995,"5min":0.76000000000000001,"15min":0.872},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53300000000000003,"15min":0.55700000000000005},"min":{"1min":0.376,"5min":0.372,"15min":0.36099999999999999},"max":{"1min":0.71599999999999997,"5min":0.745,"15min":0.85199999999999998},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.55600000000000005},"min":{"1min":0.35399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72099999999999997,"5min":0.78100000000000003,"15min":0.81499999999999995},"last":0.69799999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575002,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301900,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069940,"statfs":{"total":96636764160,"available":96327618560,"internally_reserved":0,"allocated":724992,"data_stored":353402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.75,"5min":0.80000000000000004,"15min":0.82699999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59499999999999997,"15min":0.57799999999999996},"min":{"1min":0.33500000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.78500000000000003,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57899999999999996,"15min":0.55600000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.26400000000000001},"max":{"1min":0.76900000000000002,"5min":0.77500000000000002,"15min":0.82799999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.60199999999999998,"15min":0.58499999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.82499999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.59399999999999997}]},{"osd":2,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.58499999999999996,"15min":0.56200000000000006},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.82599999999999996},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58499999999999996,"15min":0.57099999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80800000000000005,"5min":0.80900000000000005,"15min":0.82499999999999996},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.70299999999999996,"5min":0.755,"15min":0.755},"last":0.442},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54100000000000004,"15min":0.52900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32200000000000001},"max":{"1min":0.72799999999999998,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.44700000000000001,"15min":0.45700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28999999999999998},"max":{"1min":0.61699999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.623,"5min":0.78800000000000003,"15min":0.83899999999999997},"last":0.504}]},{"osd":5,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46899999999999997,"15min":0.46999999999999997},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.28299999999999997},"max":{"1min":0.61099999999999999,"5min":0.69399999999999995,"15min":0.74299999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.5,"15min":0.50900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.31900000000000001},"max":{"1min":0.68799999999999994,"5min":0.745,"15min":0.78500000000000003},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52200000000000002,"15min":0.53600000000000003},"min":{"1min":0.375,"5min":0.34699999999999998,"15min":0.34000000000000002},"max":{"1min":0.69499999999999995,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56100000000000005,"15min":0.56399999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":0.70299999999999996,"5min":0.83499999999999996,"15min":0.86499999999999999},"last":0.64100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575003,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301952,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069888,"statfs":{"total":96636764160,"available":96327565312,"internally_reserved":0,"allocated":778240,"data_stored":380275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35799999999999998,"15min":0.34100000000000003},"min":{"1min":0.23899999999999999,"5min":0.23599999999999999,"15min":0.23000000000000001},"max":{"1min":0.52900000000000003,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.46899999999999997,"15min":0.44900000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.309},"max":{"1min":0.57999999999999996,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.38900000000000001,"15min":0.36799999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.222},"max":{"1min":0.57099999999999995,"5min":0.628,"15min":0.67300000000000004},"last":0.313},{"interface":"front","average":{"1min":0.499,"5min":0.51000000000000001,"15min":0.47299999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.29499999999999998},"max":{"1min":0.63400000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.33400000000000002}]},{"osd":3,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45800000000000002,"15min":0.43099999999999999},"min":{"1min":0.32900000000000001,"5min":0.32000000000000001,"15min":0.23899999999999999},"max":{"1min":0.60999999999999999,"5min":0.749,"15min":0.749},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.442,"15min":0.41599999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.28599999999999998},"max":{"1min":0.65100000000000002,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.35299999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58999999999999997,"15min":0.57599999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.89100000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.39900000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.111},"last":0.42499999999999999}]},{"osd":5,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59899999999999998,"15min":0.58799999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.377},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60599999999999998,"15min":0.59899999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77500000000000002,"5min":0.88200000000000001,"15min":0.91300000000000003},"last":0.36899999999999999}]},{"osd":6,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.44600000000000001,"5min":0.433,"15min":0.39600000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":1.0600000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.65400000000000003,"15min":0.64900000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.379},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.0780000000000001},"last":0.45500000000000002}]},{"osd":7,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.67400000000000004,"15min":0.65300000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.41699999999999998},"max":{"1min":0.91500000000000004,"5min":0.92300000000000004,"15min":0.98699999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.65000000000000002,"15min":0.63900000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.39900000000000002},"max":{"1min":0.85199999999999998,"5min":0.879,"15min":0.94199999999999995},"last":0.442}]}]},{"osd":0,"up_from":13,"seq":55834575003,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301960,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069880,"statfs":{"total":96636764160,"available":96327557120,"internally_reserved":0,"allocated":786432,"data_stored":380311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.37,"15min":0.35199999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.22700000000000001},"max":{"1min":0.54700000000000004,"5min":0.59999999999999998,"15min":0.71199999999999997},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.39500000000000002,"15min":0.372},"min":{"1min":0.27300000000000002,"5min":0.24099999999999999,"15min":0.22600000000000001},"max":{"1min":0.53100000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.216}]},{"osd":2,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39500000000000002,"15min":0.373},"min":{"1min":0.28999999999999998,"5min":0.247,"15min":0.23899999999999999},"max":{"1min":0.58899999999999997,"5min":0.623,"15min":0.623},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47099999999999997,"15min":0.44600000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.31900000000000001},"max":{"1min":0.60999999999999999,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.30099999999999999}]},{"osd":3,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.439,"15min":0.41999999999999998},"min":{"1min":0.32600000000000001,"5min":0.29499999999999998,"15min":0.252},"max":{"1min":0.629,"5min":0.66100000000000003,"15min":0.70999999999999996},"last":0.249},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45200000000000001,"15min":0.42499999999999999},"min":{"1min":0.33600000000000002,"5min":0.317,"15min":0.26700000000000002},"max":{"1min":0.64700000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.28299999999999997}]},{"osd":4,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61899999999999999,"15min":0.59199999999999997},"min":{"1min":0.46500000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82599999999999996,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63300000000000001,"15min":0.60699999999999998},"min":{"1min":0.435,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79100000000000004,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.58599999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.36199999999999999},"max":{"1min":0.81000000000000005,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.501},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64700000000000002,"15min":0.61599999999999999},"min":{"1min":0.51500000000000001,"5min":0.442,"15min":0.38},"max":{"1min":0.88,"5min":1.004,"15min":1.004},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.65600000000000003,"15min":0.63},"min":{"1min":0.47199999999999998,"5min":0.435,"15min":0.39200000000000002},"max":{"1min":0.86699999999999999,"5min":1.002,"15min":1.002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64900000000000002,"15min":0.622},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.42999999999999999},"max":{"1min":0.81699999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.47599999999999998}]},{"osd":7,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.66700000000000004,"15min":0.63900000000000001},"min":{"1min":0.49199999999999999,"5min":0.48799999999999999,"15min":0.44800000000000001},"max":{"1min":0.92700000000000005,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69799999999999995,"15min":0.67300000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.44700000000000001},"max":{"1min":0.90500000000000003,"5min":1.026,"15min":1.026},"last":0.56399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575003,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306056,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065784,"statfs":{"total":96636764160,"available":96323362816,"internally_reserved":0,"allocated":786432,"data_stored":381721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.41399999999999998,"15min":0.38},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.44,"5min":0.44700000000000001,"15min":0.42099999999999999},"min":{"1min":0.28000000000000003,"5min":0.26400000000000001,"15min":0.255},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46200000000000002,"15min":0.433},"min":{"1min":0.254,"5min":0.254,"15min":0.24299999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49299999999999999,"15min":0.45500000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.373}]},{"osd":3,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.42599999999999999,"15min":0.39300000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63500000000000001,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48999999999999999,"15min":0.45100000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.26200000000000001},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.31900000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64400000000000002,"15min":0.59899999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63900000000000001,"15min":0.59699999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66300000000000003,"15min":0.621},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66400000000000003,"15min":0.61699999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38100000000000001},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.66000000000000003,"15min":0.61399999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68999999999999995,"15min":0.65000000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.69999999999999996,"15min":0.66100000000000003},"min":{"1min":0.48899999999999999,"5min":0.45200000000000001,"15min":0.40300000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.71299999999999997,"15min":0.66800000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.41499999999999998},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.69399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575003,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306056,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065784,"statfs":{"total":96636764160,"available":96323362816,"internally_reserved":0,"allocated":786432,"data_stored":380851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.379,"15min":0.35699999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.217},"max":{"1min":0.56599999999999995,"5min":0.58799999999999997,"15min":0.66200000000000003},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.41299999999999998,"15min":0.38800000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.246},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39600000000000002,"15min":0.378},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.255},"max":{"1min":0.59499999999999997,"5min":0.63300000000000001,"15min":0.64300000000000002},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.44,"15min":0.42499999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.25900000000000001},"max":{"1min":0.51500000000000001,"5min":0.69099999999999995,"15min":0.84399999999999997},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46500000000000002,"15min":0.438},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.26000000000000001},"max":{"1min":0.72999999999999998,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.52900000000000003,"15min":0.48899999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.33400000000000002},"max":{"1min":0.68999999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61599999999999999,"15min":0.59499999999999997},"min":{"1min":0.42799999999999999,"5min":0.42599999999999999,"15min":0.35099999999999998},"max":{"1min":0.91500000000000004,"5min":0.91600000000000004,"15min":0.97599999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.624,"15min":0.61099999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.34799999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.91400000000000003},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61699999999999999,"15min":0.60599999999999998},"min":{"1min":0.41699999999999998,"5min":0.40000000000000002,"15min":0.378},"max":{"1min":0.85399999999999998,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.504},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.64600000000000002,"15min":0.629},"min":{"1min":0.46700000000000003,"5min":0.45100000000000001,"15min":0.36399999999999999},"max":{"1min":0.80500000000000005,"5min":0.88900000000000001,"15min":1.008},"last":0.623}]},{"osd":6,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.39000000000000001},"max":{"1min":0.84599999999999997,"5min":0.94999999999999996,"15min":1.0389999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.65800000000000003,"15min":0.64400000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.41399999999999998},"max":{"1min":0.89500000000000002,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.63800000000000001}]},{"osd":7,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67500000000000004,"15min":0.66500000000000004},"min":{"1min":0.51300000000000001,"5min":0.44700000000000001,"15min":0.39100000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.67000000000000004,"15min":0.65100000000000002},"min":{"1min":0.46200000000000002,"5min":0.432,"15min":0.41899999999999998},"max":{"1min":0.89200000000000002,"5min":0.93700000000000006,"15min":1.004},"last":0.65000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575002,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297804,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074036,"statfs":{"total":96636764160,"available":96331812864,"internally_reserved":0,"allocated":724992,"data_stored":353402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52700000000000002,"15min":0.52300000000000002},"min":{"1min":0.39400000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71699999999999997,"5min":0.77700000000000002,"15min":0.80900000000000005},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.379,"5min":0.32200000000000001,"15min":0.317},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.47499999999999998}]},{"osd":1,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.55100000000000005,"15min":0.53400000000000003},"min":{"1min":0.36899999999999999,"5min":0.314,"15min":0.25800000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.79600000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54400000000000004,"15min":0.54100000000000004},"min":{"1min":0.44700000000000001,"5min":0.36699999999999999,"15min":0.246},"max":{"1min":0.71299999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58199999999999996,"15min":0.56100000000000005},"min":{"1min":0.46500000000000002,"5min":0.38400000000000001,"15min":0.27800000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.58999999999999997},"min":{"1min":0.436,"5min":0.41299999999999998,"15min":0.36899999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.60799999999999998}]},{"osd":3,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55400000000000005,"15min":0.54300000000000004},"min":{"1min":0.41499999999999998,"5min":0.40600000000000003,"15min":0.32900000000000001},"max":{"1min":0.76400000000000001,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.45000000000000001,"5min":0.372,"15min":0.35799999999999998},"max":{"1min":0.69699999999999995,"5min":0.78900000000000003,"15min":0.80600000000000005},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.43099999999999999,"15min":0.45600000000000002},"min":{"1min":0.33000000000000002,"5min":0.30099999999999999,"15min":0.27400000000000002},"max":{"1min":0.54900000000000004,"5min":0.72499999999999998,"15min":0.83299999999999996},"last":0.623},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.44400000000000001,"15min":0.47199999999999998},"min":{"1min":0.374,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59999999999999998,"5min":0.66400000000000003,"15min":0.85099999999999998},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.49399999999999999,"15min":0.51200000000000001},"min":{"1min":0.371,"5min":0.33100000000000002,"15min":0.314},"max":{"1min":0.64200000000000002,"5min":0.754,"15min":0.98799999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53200000000000003,"15min":0.54400000000000004},"min":{"1min":0.45100000000000001,"5min":0.39900000000000002,"15min":0.33800000000000002},"max":{"1min":0.65700000000000003,"5min":0.74099999999999999,"15min":0.95999999999999996},"last":0.73299999999999998}]},{"osd":7,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.35999999999999999,"5min":0.318,"15min":0.29899999999999999},"max":{"1min":0.68799999999999994,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56599999999999995,"15min":0.57799999999999996},"min":{"1min":0.50700000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.69699999999999995,"5min":0.79500000000000004,"15min":0.85399999999999998},"last":0.754}]}]},{"osd":5,"up_from":13,"seq":55834575003,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301952,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069888,"statfs":{"total":96636764160,"available":96327565312,"internally_reserved":0,"allocated":778240,"data_stored":381077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.35799999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.627,"5min":0.73399999999999999,"15min":0.76500000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.67000000000000004,"5min":0.76200000000000001,"15min":0.81799999999999995},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.52600000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.318},"max":{"1min":0.59999999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.56100000000000005,"15min":0.53900000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.36199999999999999},"max":{"1min":0.65800000000000003,"5min":0.754,"15min":0.77000000000000002},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60399999999999998,"15min":0.58399999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.30599999999999999},"max":{"1min":0.74099999999999999,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.60599999999999998,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.34499999999999997},"max":{"1min":0.69099999999999995,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55600000000000005,"15min":0.54100000000000004},"min":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64600000000000002,"5min":0.72399999999999998,"15min":0.73799999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57299999999999995,"15min":0.56799999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.71299999999999997,"5min":0.79200000000000004,"15min":0.82099999999999995},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.42899999999999999,"15min":0.44600000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.53900000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.46100000000000002,"15min":0.47099999999999997},"min":{"1min":0.34499999999999997,"5min":0.33000000000000002,"15min":0.32100000000000001},"max":{"1min":0.55600000000000005,"5min":0.66700000000000004,"15min":0.77600000000000002},"last":0.40200000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.48199999999999998,"15min":0.48899999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28499999999999998},"max":{"1min":0.63100000000000001,"5min":0.73999999999999999,"15min":0.82099999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54600000000000004,"15min":0.55600000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.33400000000000002},"max":{"1min":0.67300000000000004,"5min":0.81399999999999995,"15min":0.88200000000000001},"last":0.54400000000000004}]},{"osd":7,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.52700000000000002,"15min":0.53100000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68200000000000005,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57499999999999996,"15min":0.58099999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73099999999999998,"5min":0.79300000000000004,"15min":0.84599999999999997},"last":0.439}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:20:00.508 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:20:00.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.656+0000 7f0e335c7700 1 Processor -- start 2023-11-30T17:20:00.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.656+0000 7f0e335c7700 1 -- start start 2023-11-30T17:20:00.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.657+0000 7f0e335c7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e2c069900 0x7f0e2c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:00.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.657+0000 7f0e335c7700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0e2c1544f0 0x7f0e2c154980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:00.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.657+0000 7f0e335c7700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e2c06a270 con 0x7f0e2c150890 2023-11-30T17:20:00.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.657+0000 7f0e335c7700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e2c0c28c0 con 0x7f0e2c1544f0 2023-11-30T17:20:00.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.657+0000 7f0e335c7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c154e70 con 0x7f0e2c069900 2023-11-30T17:20:00.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.657+0000 7f0e31363700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0e2c150890 0x7f0e2c0bbe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34806/0 (socket says 172.21.15.49:34806) 2023-11-30T17:20:00.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.657+0000 7f0e31363700 1 -- 172.21.15.49:0/2245552816 learned_addr learned my addr 172.21.15.49:0/2245552816 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:20:00.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.658+0000 7f0e30b62700 1 --2- 172.21.15.49:0/2245552816 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e2c069900 0x7f0e2c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:00.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.658+0000 7f0e31b64700 1 --2- 172.21.15.49:0/2245552816 >> v2:172.21.15.115:3300/0 conn(0x7f0e2c1544f0 0x7f0e2c154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:00.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.658+0000 7f0e2bfff700 1 -- 172.21.15.49:0/2245552816 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886995742 0 0) 0x7f0e24001110 con 0x7f0e2c150890 2023-11-30T17:20:00.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.658+0000 7f0e2bfff700 1 -- 172.21.15.49:0/2245552816 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e140033f0 con 0x7f0e2c150890 2023-11-30T17:20:00.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.658+0000 7f0e2bfff700 1 -- 172.21.15.49:0/2245552816 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1700816777 0 0) 0x7f0e140033f0 con 0x7f0e2c150890 2023-11-30T17:20:00.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.658+0000 7f0e30b62700 1 -- 172.21.15.49:0/2245552816 >> v2:172.21.15.115:3300/0 conn(0x7f0e2c1544f0 msgr2=0x7f0e2c154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:00.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.658+0000 7f0e30b62700 1 --2- 172.21.15.49:0/2245552816 >> v2:172.21.15.115:3300/0 conn(0x7f0e2c1544f0 0x7f0e2c154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:00.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.658+0000 7f0e30b62700 1 -- 172.21.15.49:0/2245552816 >> v1:172.21.15.49:6789/0 conn(0x7f0e2c150890 legacy=0x7f0e2c0bbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:00.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.658+0000 7f0e30b62700 1 -- 172.21.15.49:0/2245552816 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2c1552e0 con 0x7f0e2c069900 2023-11-30T17:20:00.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.658+0000 7f0e30b62700 1 --2- 172.21.15.49:0/2245552816 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e2c069900 0x7f0e2c069d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f0e20009760 tx=0x7f0e20009060).ready entity=mon.2 client_cookie=ac3ec9f76b82c5ea server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:00.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.658+0000 7f0e2bfff700 1 -- 172.21.15.49:0/2245552816 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e24001600 con 0x7f0e2c069900 2023-11-30T17:20:00.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.658+0000 7f0e2bfff700 1 -- 172.21.15.49:0/2245552816 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e20011400 con 0x7f0e2c069900 2023-11-30T17:20:00.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.658+0000 7f0e2bfff700 1 -- 172.21.15.49:0/2245552816 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e20011780 con 0x7f0e2c069900 2023-11-30T17:20:00.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.659+0000 7f0e335c7700 1 -- 172.21.15.49:0/2245552816 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e2c069900 msgr2=0x7f0e2c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:00.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.659+0000 7f0e335c7700 1 --2- 172.21.15.49:0/2245552816 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e2c069900 0x7f0e2c069d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f0e20009760 tx=0x7f0e20009060).stop 2023-11-30T17:20:00.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.659+0000 7f0e335c7700 1 -- 172.21.15.49:0/2245552816 shutdown_connections 2023-11-30T17:20:00.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.659+0000 7f0e335c7700 1 --2- 172.21.15.49:0/2245552816 >> v2:172.21.15.115:3300/0 conn(0x7f0e2c1544f0 0x7f0e2c154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:00.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.659+0000 7f0e335c7700 1 --2- 172.21.15.49:0/2245552816 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e2c069900 0x7f0e2c069d80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:00.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.659+0000 7f0e335c7700 1 -- 172.21.15.49:0/2245552816 >> 172.21.15.49:0/2245552816 conn(0x7f0e2c0631d0 msgr2=0x7f0e2c0c6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:00.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.659+0000 7f0e335c7700 1 -- 172.21.15.49:0/2245552816 shutdown_connections 2023-11-30T17:20:00.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.659+0000 7f0e335c7700 1 -- 172.21.15.49:0/2245552816 wait complete. 2023-11-30T17:20:00.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.660+0000 7f0e335c7700 1 Processor -- start 2023-11-30T17:20:00.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.660+0000 7f0e335c7700 1 -- start start 2023-11-30T17:20:00.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.661+0000 7f0e335c7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e2c069900 0x7f0e2c0c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:00.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.661+0000 7f0e335c7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e2c150890 0x7f0e2c147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:00.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.661+0000 7f0e335c7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e2c1544f0 0x7f0e2c145ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:00.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.661+0000 7f0e335c7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c0c6950 con 0x7f0e2c150890 2023-11-30T17:20:00.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.661+0000 7f0e335c7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c1480e0 con 0x7f0e2c1544f0 2023-11-30T17:20:00.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.661+0000 7f0e335c7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c0c5d40 con 0x7f0e2c069900 2023-11-30T17:20:00.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.661+0000 7f0e30b62700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e2c150890 0x7f0e2c147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:00.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.661+0000 7f0e30b62700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e2c150890 0x7f0e2c147bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35008/0 (socket says 172.21.15.49:35008) 2023-11-30T17:20:00.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.661+0000 7f0e30b62700 1 -- 172.21.15.49:0/1659635931 learned_addr learned my addr 172.21.15.49:0/1659635931 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:20:00.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.661+0000 7f0e31b64700 1 --2- 172.21.15.49:0/1659635931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e2c1544f0 0x7f0e2c145ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:00.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.661+0000 7f0e31363700 1 --2- 172.21.15.49:0/1659635931 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e2c069900 0x7f0e2c0c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:00.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.661+0000 7f0e30b62700 1 -- 172.21.15.49:0/1659635931 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e2c069900 msgr2=0x7f0e2c0c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:00.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.661+0000 7f0e30b62700 1 --2- 172.21.15.49:0/1659635931 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e2c069900 0x7f0e2c0c56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:00.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.661+0000 7f0e30b62700 1 -- 172.21.15.49:0/1659635931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e2c1544f0 msgr2=0x7f0e2c145ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:00.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.661+0000 7f0e30b62700 1 --2- 172.21.15.49:0/1659635931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e2c1544f0 0x7f0e2c145ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:00.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.661+0000 7f0e30b62700 1 -- 172.21.15.49:0/1659635931 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e200092a0 con 0x7f0e2c150890 2023-11-30T17:20:00.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.661+0000 7f0e30b62700 1 --2- 172.21.15.49:0/1659635931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e2c150890 0x7f0e2c147bf0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f0e20009d50 tx=0x7f0e20016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:00.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.662+0000 7f0e297fa700 1 -- 172.21.15.49:0/1659635931 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e200107c0 con 0x7f0e2c150890 2023-11-30T17:20:00.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.662+0000 7f0e297fa700 1 -- 172.21.15.49:0/1659635931 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e20010920 con 0x7f0e2c150890 2023-11-30T17:20:00.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.662+0000 7f0e297fa700 1 -- 172.21.15.49:0/1659635931 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e20010cc0 con 0x7f0e2c150890 2023-11-30T17:20:00.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.662+0000 7f0e335c7700 1 -- 172.21.15.49:0/1659635931 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e2c0c6020 con 0x7f0e2c150890 2023-11-30T17:20:00.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.662+0000 7f0e335c7700 1 -- 172.21.15.49:0/1659635931 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e2c0c65e0 con 0x7f0e2c150890 2023-11-30T17:20:00.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.663+0000 7f0e335c7700 1 -- 172.21.15.49:0/1659635931 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e2c0c6ac0 con 0x7f0e2c150890 2023-11-30T17:20:00.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.663+0000 7f0e297fa700 1 -- 172.21.15.49:0/1659635931 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0e2001d640 con 0x7f0e2c150890 2023-11-30T17:20:00.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.663+0000 7f0e297fa700 1 --2- 172.21.15.49:0/1659635931 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0e1805f270 0x7f0e18061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:00.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.663+0000 7f0e297fa700 1 -- 172.21.15.49:0/1659635931 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0e2007b950 con 0x7f0e2c150890 2023-11-30T17:20:00.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.664+0000 7f0e31363700 1 --2- 172.21.15.49:0/1659635931 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0e1805f270 0x7f0e18061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:00.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.664+0000 7f0e31363700 1 --2- 172.21.15.49:0/1659635931 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0e1805f270 0x7f0e18061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f0e24001870 tx=0x7f0e24001300).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:00.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.667+0000 7f0e297fa700 1 -- 172.21.15.49:0/1659635931 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0e2004caa0 con 0x7f0e2c150890 2023-11-30T17:20:00.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.836+0000 7f0e335c7700 1 -- 172.21.15.49:0/1659635931 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0e2c06c860 con 0x7f0e1805f270 2023-11-30T17:20:00.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.846+0000 7f0e297fa700 1 -- 172.21.15.49:0/1659635931 <== mgr.5449 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359186 (secure 0 0 0) 0x7f0e2c06c860 con 0x7f0e1805f270 2023-11-30T17:20:00.852 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:20:00.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.849+0000 7f0e335c7700 1 -- 172.21.15.49:0/1659635931 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0e1805f270 msgr2=0x7f0e18061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:00.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.849+0000 7f0e335c7700 1 --2- 172.21.15.49:0/1659635931 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0e1805f270 0x7f0e18061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f0e24001870 tx=0x7f0e24001300).stop 2023-11-30T17:20:00.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.849+0000 7f0e335c7700 1 -- 172.21.15.49:0/1659635931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e2c150890 msgr2=0x7f0e2c147bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:00.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.849+0000 7f0e335c7700 1 --2- 172.21.15.49:0/1659635931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e2c150890 0x7f0e2c147bf0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f0e20009d50 tx=0x7f0e20016000).stop 2023-11-30T17:20:00.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.849+0000 7f0e335c7700 1 -- 172.21.15.49:0/1659635931 shutdown_connections 2023-11-30T17:20:00.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.849+0000 7f0e335c7700 1 --2- 172.21.15.49:0/1659635931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e2c1544f0 0x7f0e2c145ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:00.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.849+0000 7f0e335c7700 1 --2- 172.21.15.49:0/1659635931 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e2c069900 0x7f0e2c0c56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:00.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.849+0000 7f0e335c7700 1 --2- 172.21.15.49:0/1659635931 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0e1805f270 0x7f0e18061730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:00.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.849+0000 7f0e335c7700 1 --2- 172.21.15.49:0/1659635931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e2c150890 0x7f0e2c147bf0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:00.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.849+0000 7f0e335c7700 1 -- 172.21.15.49:0/1659635931 >> 172.21.15.49:0/1659635931 conn(0x7f0e2c0631d0 msgr2=0x7f0e2c14bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:00.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.849+0000 7f0e335c7700 1 -- 172.21.15.49:0/1659635931 shutdown_connections 2023-11-30T17:20:00.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:00.849+0000 7f0e335c7700 1 -- 172.21.15.49:0/1659635931 wait complete. 2023-11-30T17:20:00.856 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:20:00.863 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-30T17:20:00.322110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2236,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":252,"acting":252,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":213,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2415544,"kb_used_data":6008,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752559176,"statfs":{"total":773094113280,"available":770620596224,"internally_reserved":0,"allocated":6152192,"data_stored":2991902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14996153,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-721,"num_write_kb":-15547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.999924"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491141+0000","last_change":"2023-11-30T17:19:56.485959+0000","last_active":"2023-11-30T17:19:56.491141+0000","last_peered":"2023-11-30T17:19:56.491141+0000","last_clean":"2023-11-30T17:19:56.491141+0000","last_became_active":"2023-11-30T17:19:56.485404+0000","last_became_peered":"2023-11-30T17:19:56.485404+0000","last_unstale":"2023-11-30T17:19:56.491141+0000","last_undegraded":"2023-11-30T17:19:56.491141+0000","last_fullsized":"2023-11-30T17:19:56.491141+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"64'3","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.497937+0000","last_change":"2023-11-30T17:19:56.097294+0000","last_active":"2023-11-30T17:19:56.497937+0000","last_peered":"2023-11-30T17:19:56.497937+0000","last_clean":"2023-11-30T17:19:56.497937+0000","last_became_active":"2023-11-30T17:19:56.097026+0000","last_became_peered":"2023-11-30T17:19:56.097026+0000","last_unstale":"2023-11-30T17:19:56.497937+0000","last_undegraded":"2023-11-30T17:19:56.497937+0000","last_fullsized":"2023-11-30T17:19:56.497937+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496181+0000","last_change":"2023-11-30T17:19:56.492152+0000","last_active":"2023-11-30T17:19:56.496181+0000","last_peered":"2023-11-30T17:19:56.496181+0000","last_clean":"2023-11-30T17:19:56.496181+0000","last_became_active":"2023-11-30T17:19:56.491843+0000","last_became_peered":"2023-11-30T17:19:56.491843+0000","last_unstale":"2023-11-30T17:19:56.496181+0000","last_undegraded":"2023-11-30T17:19:56.496181+0000","last_fullsized":"2023-11-30T17:19:56.496181+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.480790+0000","last_change":"2023-11-30T17:19:56.112352+0000","last_active":"2023-11-30T17:19:56.480790+0000","last_peered":"2023-11-30T17:19:56.480790+0000","last_clean":"2023-11-30T17:19:56.480790+0000","last_became_active":"2023-11-30T17:19:56.112039+0000","last_became_peered":"2023-11-30T17:19:56.112039+0000","last_unstale":"2023-11-30T17:19:56.480790+0000","last_undegraded":"2023-11-30T17:19:56.480790+0000","last_fullsized":"2023-11-30T17:19:56.480790+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500856+0000","last_change":"2023-11-30T17:19:56.496678+0000","last_active":"2023-11-30T17:19:56.500856+0000","last_peered":"2023-11-30T17:19:56.500856+0000","last_clean":"2023-11-30T17:19:56.500856+0000","last_became_active":"2023-11-30T17:19:56.492155+0000","last_became_peered":"2023-11-30T17:19:56.492155+0000","last_unstale":"2023-11-30T17:19:56.500856+0000","last_undegraded":"2023-11-30T17:19:56.500856+0000","last_fullsized":"2023-11-30T17:19:56.500856+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.082730+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.495745+0000","last_change":"2023-11-30T17:19:56.486081+0000","last_active":"2023-11-30T17:19:56.495745+0000","last_peered":"2023-11-30T17:19:56.495745+0000","last_clean":"2023-11-30T17:19:56.495745+0000","last_became_active":"2023-11-30T17:19:56.485781+0000","last_became_peered":"2023-11-30T17:19:56.485781+0000","last_unstale":"2023-11-30T17:19:56.495745+0000","last_undegraded":"2023-11-30T17:19:56.495745+0000","last_fullsized":"2023-11-30T17:19:56.495745+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"64'2","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.502495+0000","last_change":"2023-11-30T17:19:56.099441+0000","last_active":"2023-11-30T17:19:56.502495+0000","last_peered":"2023-11-30T17:19:56.502495+0000","last_clean":"2023-11-30T17:19:56.502495+0000","last_became_active":"2023-11-30T17:19:56.099054+0000","last_became_peered":"2023-11-30T17:19:56.099054+0000","last_unstale":"2023-11-30T17:19:56.502495+0000","last_undegraded":"2023-11-30T17:19:56.502495+0000","last_fullsized":"2023-11-30T17:19:56.502495+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493845+0000","last_change":"2023-11-30T17:19:56.492808+0000","last_active":"2023-11-30T17:19:56.493845+0000","last_peered":"2023-11-30T17:19:56.493845+0000","last_clean":"2023-11-30T17:19:56.493845+0000","last_became_active":"2023-11-30T17:19:56.492327+0000","last_became_peered":"2023-11-30T17:19:56.492327+0000","last_unstale":"2023-11-30T17:19:56.493845+0000","last_undegraded":"2023-11-30T17:19:56.493845+0000","last_fullsized":"2023-11-30T17:19:56.493845+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3b","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.490891+0000","last_change":"2023-11-30T17:19:56.112328+0000","last_active":"2023-11-30T17:19:56.490891+0000","last_peered":"2023-11-30T17:19:56.490891+0000","last_clean":"2023-11-30T17:19:56.490891+0000","last_became_active":"2023-11-30T17:19:56.112089+0000","last_became_peered":"2023-11-30T17:19:56.112089+0000","last_unstale":"2023-11-30T17:19:56.490891+0000","last_undegraded":"2023-11-30T17:19:56.490891+0000","last_fullsized":"2023-11-30T17:19:56.490891+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.492758+0000","last_change":"2023-11-30T17:19:56.489355+0000","last_active":"2023-11-30T17:19:56.492758+0000","last_peered":"2023-11-30T17:19:56.492758+0000","last_clean":"2023-11-30T17:19:56.492758+0000","last_became_active":"2023-11-30T17:19:56.489081+0000","last_became_peered":"2023-11-30T17:19:56.489081+0000","last_unstale":"2023-11-30T17:19:56.492758+0000","last_undegraded":"2023-11-30T17:19:56.492758+0000","last_fullsized":"2023-11-30T17:19:56.492758+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.489898+0000","last_change":"2023-11-30T17:19:56.095586+0000","last_active":"2023-11-30T17:19:56.489898+0000","last_peered":"2023-11-30T17:19:56.489898+0000","last_clean":"2023-11-30T17:19:56.489898+0000","last_became_active":"2023-11-30T17:19:56.095250+0000","last_became_peered":"2023-11-30T17:19:56.095250+0000","last_unstale":"2023-11-30T17:19:56.489898+0000","last_undegraded":"2023-11-30T17:19:56.489898+0000","last_fullsized":"2023-11-30T17:19:56.489898+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491110+0000","last_change":"2023-11-30T17:19:56.485707+0000","last_active":"2023-11-30T17:19:56.491110+0000","last_peered":"2023-11-30T17:19:56.491110+0000","last_clean":"2023-11-30T17:19:56.491110+0000","last_became_active":"2023-11-30T17:19:56.485420+0000","last_became_peered":"2023-11-30T17:19:56.485420+0000","last_unstale":"2023-11-30T17:19:56.491110+0000","last_undegraded":"2023-11-30T17:19:56.491110+0000","last_fullsized":"2023-11-30T17:19:56.491110+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.483241+0000","last_change":"2023-11-30T17:19:56.096279+0000","last_active":"2023-11-30T17:19:56.483241+0000","last_peered":"2023-11-30T17:19:56.483241+0000","last_clean":"2023-11-30T17:19:56.483241+0000","last_became_active":"2023-11-30T17:19:56.095989+0000","last_became_peered":"2023-11-30T17:19:56.095989+0000","last_unstale":"2023-11-30T17:19:56.483241+0000","last_undegraded":"2023-11-30T17:19:56.483241+0000","last_fullsized":"2023-11-30T17:19:56.483241+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.503846+0000","last_change":"2023-11-30T17:19:56.501562+0000","last_active":"2023-11-30T17:19:56.503846+0000","last_peered":"2023-11-30T17:19:56.503846+0000","last_clean":"2023-11-30T17:19:56.503846+0000","last_became_active":"2023-11-30T17:19:56.501259+0000","last_became_peered":"2023-11-30T17:19:56.501259+0000","last_unstale":"2023-11-30T17:19:56.503846+0000","last_undegraded":"2023-11-30T17:19:56.503846+0000","last_fullsized":"2023-11-30T17:19:56.503846+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.487885+0000","last_change":"2023-11-30T17:19:56.105956+0000","last_active":"2023-11-30T17:19:56.487885+0000","last_peered":"2023-11-30T17:19:56.487885+0000","last_clean":"2023-11-30T17:19:56.487885+0000","last_became_active":"2023-11-30T17:19:56.102562+0000","last_became_peered":"2023-11-30T17:19:56.102562+0000","last_unstale":"2023-11-30T17:19:56.487885+0000","last_undegraded":"2023-11-30T17:19:56.487885+0000","last_fullsized":"2023-11-30T17:19:56.487885+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496983+0000","last_change":"2023-11-30T17:19:56.495039+0000","last_active":"2023-11-30T17:19:56.496983+0000","last_peered":"2023-11-30T17:19:56.496983+0000","last_clean":"2023-11-30T17:19:56.496983+0000","last_became_active":"2023-11-30T17:19:56.494575+0000","last_became_peered":"2023-11-30T17:19:56.494575+0000","last_unstale":"2023-11-30T17:19:56.496983+0000","last_undegraded":"2023-11-30T17:19:56.496983+0000","last_fullsized":"2023-11-30T17:19:56.496983+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.499089+0000","last_change":"2023-11-30T17:19:56.110873+0000","last_active":"2023-11-30T17:19:56.499089+0000","last_peered":"2023-11-30T17:19:56.499089+0000","last_clean":"2023-11-30T17:19:56.499089+0000","last_became_active":"2023-11-30T17:19:56.110385+0000","last_became_peered":"2023-11-30T17:19:56.110385+0000","last_unstale":"2023-11-30T17:19:56.499089+0000","last_undegraded":"2023-11-30T17:19:56.499089+0000","last_fullsized":"2023-11-30T17:19:56.499089+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500826+0000","last_change":"2023-11-30T17:19:56.496567+0000","last_active":"2023-11-30T17:19:56.500826+0000","last_peered":"2023-11-30T17:19:56.500826+0000","last_clean":"2023-11-30T17:19:56.500826+0000","last_became_active":"2023-11-30T17:19:56.496282+0000","last_became_peered":"2023-11-30T17:19:56.496282+0000","last_unstale":"2023-11-30T17:19:56.500826+0000","last_undegraded":"2023-11-30T17:19:56.500826+0000","last_fullsized":"2023-11-30T17:19:56.500826+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.494906+0000","last_change":"2023-11-30T17:19:56.105548+0000","last_active":"2023-11-30T17:19:56.494906+0000","last_peered":"2023-11-30T17:19:56.494906+0000","last_clean":"2023-11-30T17:19:56.494906+0000","last_became_active":"2023-11-30T17:19:56.099867+0000","last_became_peered":"2023-11-30T17:19:56.099867+0000","last_unstale":"2023-11-30T17:19:56.494906+0000","last_undegraded":"2023-11-30T17:19:56.494906+0000","last_fullsized":"2023-11-30T17:19:56.494906+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.495750+0000","last_change":"2023-11-30T17:19:56.490226+0000","last_active":"2023-11-30T17:19:56.495750+0000","last_peered":"2023-11-30T17:19:56.495750+0000","last_clean":"2023-11-30T17:19:56.495750+0000","last_became_active":"2023-11-30T17:19:56.490008+0000","last_became_peered":"2023-11-30T17:19:56.490008+0000","last_unstale":"2023-11-30T17:19:56.495750+0000","last_undegraded":"2023-11-30T17:19:56.495750+0000","last_fullsized":"2023-11-30T17:19:56.495750+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498921+0000","last_change":"2023-11-30T17:19:56.110057+0000","last_active":"2023-11-30T17:19:56.498921+0000","last_peered":"2023-11-30T17:19:56.498921+0000","last_clean":"2023-11-30T17:19:56.498921+0000","last_became_active":"2023-11-30T17:19:56.109561+0000","last_became_peered":"2023-11-30T17:19:56.109561+0000","last_unstale":"2023-11-30T17:19:56.498921+0000","last_undegraded":"2023-11-30T17:19:56.498921+0000","last_fullsized":"2023-11-30T17:19:56.498921+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"64'4","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498286+0000","last_change":"2023-11-30T17:19:56.099632+0000","last_active":"2023-11-30T17:19:56.498286+0000","last_peered":"2023-11-30T17:19:56.498286+0000","last_clean":"2023-11-30T17:19:56.498286+0000","last_became_active":"2023-11-30T17:19:56.099366+0000","last_became_peered":"2023-11-30T17:19:56.099366+0000","last_unstale":"2023-11-30T17:19:56.498286+0000","last_undegraded":"2023-11-30T17:19:56.498286+0000","last_fullsized":"2023-11-30T17:19:56.498286+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.492794+0000","last_change":"2023-11-30T17:19:56.490274+0000","last_active":"2023-11-30T17:19:56.492794+0000","last_peered":"2023-11-30T17:19:56.492794+0000","last_clean":"2023-11-30T17:19:56.492794+0000","last_became_active":"2023-11-30T17:19:56.490014+0000","last_became_peered":"2023-11-30T17:19:56.490014+0000","last_unstale":"2023-11-30T17:19:56.492794+0000","last_undegraded":"2023-11-30T17:19:56.492794+0000","last_fullsized":"2023-11-30T17:19:56.492794+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.492148+0000","last_change":"2023-11-30T17:19:56.104864+0000","last_active":"2023-11-30T17:19:56.492148+0000","last_peered":"2023-11-30T17:19:56.492148+0000","last_clean":"2023-11-30T17:19:56.492148+0000","last_became_active":"2023-11-30T17:19:56.104590+0000","last_became_peered":"2023-11-30T17:19:56.104590+0000","last_unstale":"2023-11-30T17:19:56.492148+0000","last_undegraded":"2023-11-30T17:19:56.492148+0000","last_fullsized":"2023-11-30T17:19:56.492148+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.502029+0000","last_change":"2023-11-30T17:19:56.499597+0000","last_active":"2023-11-30T17:19:56.502029+0000","last_peered":"2023-11-30T17:19:56.502029+0000","last_clean":"2023-11-30T17:19:56.502029+0000","last_became_active":"2023-11-30T17:19:56.499146+0000","last_became_peered":"2023-11-30T17:19:56.499146+0000","last_unstale":"2023-11-30T17:19:56.502029+0000","last_undegraded":"2023-11-30T17:19:56.502029+0000","last_fullsized":"2023-11-30T17:19:56.502029+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.487477+0000","last_change":"2023-11-30T17:19:56.110204+0000","last_active":"2023-11-30T17:19:56.487477+0000","last_peered":"2023-11-30T17:19:56.487477+0000","last_clean":"2023-11-30T17:19:56.487477+0000","last_became_active":"2023-11-30T17:19:56.109745+0000","last_became_peered":"2023-11-30T17:19:56.109745+0000","last_unstale":"2023-11-30T17:19:56.487477+0000","last_undegraded":"2023-11-30T17:19:56.487477+0000","last_fullsized":"2023-11-30T17:19:56.487477+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498693+0000","last_change":"2023-11-30T17:19:56.494965+0000","last_active":"2023-11-30T17:19:56.498693+0000","last_peered":"2023-11-30T17:19:56.498693+0000","last_clean":"2023-11-30T17:19:56.498693+0000","last_became_active":"2023-11-30T17:19:56.494662+0000","last_became_peered":"2023-11-30T17:19:56.494662+0000","last_unstale":"2023-11-30T17:19:56.498693+0000","last_undegraded":"2023-11-30T17:19:56.498693+0000","last_fullsized":"2023-11-30T17:19:56.498693+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.476196+0000","last_change":"2023-11-30T17:19:56.100686+0000","last_active":"2023-11-30T17:19:56.476196+0000","last_peered":"2023-11-30T17:19:56.476196+0000","last_clean":"2023-11-30T17:19:56.476196+0000","last_became_active":"2023-11-30T17:19:56.100418+0000","last_became_peered":"2023-11-30T17:19:56.100418+0000","last_unstale":"2023-11-30T17:19:56.476196+0000","last_undegraded":"2023-11-30T17:19:56.476196+0000","last_fullsized":"2023-11-30T17:19:56.476196+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496351+0000","last_change":"2023-11-30T17:19:56.493474+0000","last_active":"2023-11-30T17:19:56.496351+0000","last_peered":"2023-11-30T17:19:56.496351+0000","last_clean":"2023-11-30T17:19:56.496351+0000","last_became_active":"2023-11-30T17:19:56.493191+0000","last_became_peered":"2023-11-30T17:19:56.493191+0000","last_unstale":"2023-11-30T17:19:56.496351+0000","last_undegraded":"2023-11-30T17:19:56.496351+0000","last_fullsized":"2023-11-30T17:19:56.496351+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.077396+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493563+0000","last_change":"2023-11-30T17:19:56.486088+0000","last_active":"2023-11-30T17:19:56.493563+0000","last_peered":"2023-11-30T17:19:56.493563+0000","last_clean":"2023-11-30T17:19:56.493563+0000","last_became_active":"2023-11-30T17:19:56.485651+0000","last_became_peered":"2023-11-30T17:19:56.485651+0000","last_unstale":"2023-11-30T17:19:56.493563+0000","last_undegraded":"2023-11-30T17:19:56.493563+0000","last_fullsized":"2023-11-30T17:19:56.493563+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.083264+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.495220+0000","last_change":"2023-11-30T17:19:56.491494+0000","last_active":"2023-11-30T17:19:56.495220+0000","last_peered":"2023-11-30T17:19:56.495220+0000","last_clean":"2023-11-30T17:19:56.495220+0000","last_became_active":"2023-11-30T17:19:56.491200+0000","last_became_peered":"2023-11-30T17:19:56.491200+0000","last_unstale":"2023-11-30T17:19:56.495220+0000","last_undegraded":"2023-11-30T17:19:56.495220+0000","last_fullsized":"2023-11-30T17:19:56.495220+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.084005+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.499018+0000","last_change":"2023-11-30T17:19:56.496795+0000","last_active":"2023-11-30T17:19:56.499018+0000","last_peered":"2023-11-30T17:19:56.499018+0000","last_clean":"2023-11-30T17:19:56.499018+0000","last_became_active":"2023-11-30T17:19:56.496519+0000","last_became_peered":"2023-11-30T17:19:56.496519+0000","last_unstale":"2023-11-30T17:19:56.499018+0000","last_undegraded":"2023-11-30T17:19:56.499018+0000","last_fullsized":"2023-11-30T17:19:56.499018+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.078100+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500642+0000","last_change":"2023-11-30T17:19:56.494936+0000","last_active":"2023-11-30T17:19:56.500642+0000","last_peered":"2023-11-30T17:19:56.500642+0000","last_clean":"2023-11-30T17:19:56.500642+0000","last_became_active":"2023-11-30T17:19:56.494628+0000","last_became_peered":"2023-11-30T17:19:56.494628+0000","last_unstale":"2023-11-30T17:19:56.500642+0000","last_undegraded":"2023-11-30T17:19:56.500642+0000","last_fullsized":"2023-11-30T17:19:56.500642+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.476989+0000","last_change":"2023-11-30T17:19:56.103835+0000","last_active":"2023-11-30T17:19:56.476989+0000","last_peered":"2023-11-30T17:19:56.476989+0000","last_clean":"2023-11-30T17:19:56.476989+0000","last_became_active":"2023-11-30T17:19:56.103532+0000","last_became_peered":"2023-11-30T17:19:56.103532+0000","last_unstale":"2023-11-30T17:19:56.476989+0000","last_undegraded":"2023-11-30T17:19:56.476989+0000","last_fullsized":"2023-11-30T17:19:56.476989+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.488294+0000","last_change":"2023-11-30T17:19:56.105248+0000","last_active":"2023-11-30T17:19:56.488294+0000","last_peered":"2023-11-30T17:19:56.488294+0000","last_clean":"2023-11-30T17:19:56.488294+0000","last_became_active":"2023-11-30T17:19:56.104768+0000","last_became_peered":"2023-11-30T17:19:56.104768+0000","last_unstale":"2023-11-30T17:19:56.488294+0000","last_undegraded":"2023-11-30T17:19:56.488294+0000","last_fullsized":"2023-11-30T17:19:56.488294+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496346+0000","last_change":"2023-11-30T17:19:56.490952+0000","last_active":"2023-11-30T17:19:56.496346+0000","last_peered":"2023-11-30T17:19:56.496346+0000","last_clean":"2023-11-30T17:19:56.496346+0000","last_became_active":"2023-11-30T17:19:56.490730+0000","last_became_peered":"2023-11-30T17:19:56.490730+0000","last_unstale":"2023-11-30T17:19:56.496346+0000","last_undegraded":"2023-11-30T17:19:56.496346+0000","last_fullsized":"2023-11-30T17:19:56.496346+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.487354+0000","last_change":"2023-11-30T17:19:56.105606+0000","last_active":"2023-11-30T17:19:56.487354+0000","last_peered":"2023-11-30T17:19:56.487354+0000","last_clean":"2023-11-30T17:19:56.487354+0000","last_became_active":"2023-11-30T17:19:56.104380+0000","last_became_peered":"2023-11-30T17:19:56.104380+0000","last_unstale":"2023-11-30T17:19:56.487354+0000","last_undegraded":"2023-11-30T17:19:56.487354+0000","last_fullsized":"2023-11-30T17:19:56.487354+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491376+0000","last_change":"2023-11-30T17:19:56.488970+0000","last_active":"2023-11-30T17:19:56.491376+0000","last_peered":"2023-11-30T17:19:56.491376+0000","last_clean":"2023-11-30T17:19:56.491376+0000","last_became_active":"2023-11-30T17:19:56.488343+0000","last_became_peered":"2023-11-30T17:19:56.488343+0000","last_unstale":"2023-11-30T17:19:56.491376+0000","last_undegraded":"2023-11-30T17:19:56.491376+0000","last_fullsized":"2023-11-30T17:19:56.491376+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.077908+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498741+0000","last_change":"2023-11-30T17:19:56.490432+0000","last_active":"2023-11-30T17:19:56.498741+0000","last_peered":"2023-11-30T17:19:56.498741+0000","last_clean":"2023-11-30T17:19:56.498741+0000","last_became_active":"2023-11-30T17:19:56.490159+0000","last_became_peered":"2023-11-30T17:19:56.490159+0000","last_unstale":"2023-11-30T17:19:56.498741+0000","last_undegraded":"2023-11-30T17:19:56.498741+0000","last_fullsized":"2023-11-30T17:19:56.498741+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.076864+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.494582+0000","last_change":"2023-11-30T17:19:56.490029+0000","last_active":"2023-11-30T17:19:56.494582+0000","last_peered":"2023-11-30T17:19:56.494582+0000","last_clean":"2023-11-30T17:19:56.494582+0000","last_became_active":"2023-11-30T17:19:56.488809+0000","last_became_peered":"2023-11-30T17:19:56.488809+0000","last_unstale":"2023-11-30T17:19:56.494582+0000","last_undegraded":"2023-11-30T17:19:56.494582+0000","last_fullsized":"2023-11-30T17:19:56.494582+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.079249+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493787+0000","last_change":"2023-11-30T17:19:56.492227+0000","last_active":"2023-11-30T17:19:56.493787+0000","last_peered":"2023-11-30T17:19:56.493787+0000","last_clean":"2023-11-30T17:19:56.493787+0000","last_became_active":"2023-11-30T17:19:56.491955+0000","last_became_peered":"2023-11-30T17:19:56.491955+0000","last_unstale":"2023-11-30T17:19:56.493787+0000","last_undegraded":"2023-11-30T17:19:56.493787+0000","last_fullsized":"2023-11-30T17:19:56.493787+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.475983+0000","last_change":"2023-11-30T17:19:56.105360+0000","last_active":"2023-11-30T17:19:56.475983+0000","last_peered":"2023-11-30T17:19:56.475983+0000","last_clean":"2023-11-30T17:19:56.475983+0000","last_became_active":"2023-11-30T17:19:56.105084+0000","last_became_peered":"2023-11-30T17:19:56.105084+0000","last_unstale":"2023-11-30T17:19:56.475983+0000","last_undegraded":"2023-11-30T17:19:56.475983+0000","last_fullsized":"2023-11-30T17:19:56.475983+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491335+0000","last_change":"2023-11-30T17:19:56.488160+0000","last_active":"2023-11-30T17:19:56.491335+0000","last_peered":"2023-11-30T17:19:56.491335+0000","last_clean":"2023-11-30T17:19:56.491335+0000","last_became_active":"2023-11-30T17:19:56.487871+0000","last_became_peered":"2023-11-30T17:19:56.487871+0000","last_unstale":"2023-11-30T17:19:56.491335+0000","last_undegraded":"2023-11-30T17:19:56.491335+0000","last_fullsized":"2023-11-30T17:19:56.491335+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.082342+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.479299+0000","last_change":"2023-11-30T17:19:56.098747+0000","last_active":"2023-11-30T17:19:56.479299+0000","last_peered":"2023-11-30T17:19:56.479299+0000","last_clean":"2023-11-30T17:19:56.479299+0000","last_became_active":"2023-11-30T17:19:56.098096+0000","last_became_peered":"2023-11-30T17:19:56.098096+0000","last_unstale":"2023-11-30T17:19:56.479299+0000","last_undegraded":"2023-11-30T17:19:56.479299+0000","last_fullsized":"2023-11-30T17:19:56.479299+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.076958+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.502012+0000","last_change":"2023-11-30T17:19:56.499411+0000","last_active":"2023-11-30T17:19:56.502012+0000","last_peered":"2023-11-30T17:19:56.502012+0000","last_clean":"2023-11-30T17:19:56.502012+0000","last_became_active":"2023-11-30T17:19:56.497013+0000","last_became_peered":"2023-11-30T17:19:56.497013+0000","last_unstale":"2023-11-30T17:19:56.502012+0000","last_undegraded":"2023-11-30T17:19:56.502012+0000","last_fullsized":"2023-11-30T17:19:56.502012+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.082939+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498714+0000","last_change":"2023-11-30T17:19:56.495065+0000","last_active":"2023-11-30T17:19:56.498714+0000","last_peered":"2023-11-30T17:19:56.498714+0000","last_clean":"2023-11-30T17:19:56.498714+0000","last_became_active":"2023-11-30T17:19:56.494734+0000","last_became_peered":"2023-11-30T17:19:56.494734+0000","last_unstale":"2023-11-30T17:19:56.498714+0000","last_undegraded":"2023-11-30T17:19:56.498714+0000","last_fullsized":"2023-11-30T17:19:56.498714+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.476094+0000","last_change":"2023-11-30T17:19:56.100559+0000","last_active":"2023-11-30T17:19:56.476094+0000","last_peered":"2023-11-30T17:19:56.476094+0000","last_clean":"2023-11-30T17:19:56.476094+0000","last_became_active":"2023-11-30T17:19:56.100267+0000","last_became_peered":"2023-11-30T17:19:56.100267+0000","last_unstale":"2023-11-30T17:19:56.476094+0000","last_undegraded":"2023-11-30T17:19:56.476094+0000","last_fullsized":"2023-11-30T17:19:56.476094+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.502077+0000","last_change":"2023-11-30T17:19:56.499755+0000","last_active":"2023-11-30T17:19:56.502077+0000","last_peered":"2023-11-30T17:19:56.502077+0000","last_clean":"2023-11-30T17:19:56.502077+0000","last_became_active":"2023-11-30T17:19:56.499465+0000","last_became_peered":"2023-11-30T17:19:56.499465+0000","last_unstale":"2023-11-30T17:19:56.502077+0000","last_undegraded":"2023-11-30T17:19:56.502077+0000","last_fullsized":"2023-11-30T17:19:56.502077+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.477375+0000","last_change":"2023-11-30T17:19:56.088985+0000","last_active":"2023-11-30T17:19:56.477375+0000","last_peered":"2023-11-30T17:19:56.477375+0000","last_clean":"2023-11-30T17:19:56.477375+0000","last_became_active":"2023-11-30T17:19:56.088686+0000","last_became_peered":"2023-11-30T17:19:56.088686+0000","last_unstale":"2023-11-30T17:19:56.477375+0000","last_undegraded":"2023-11-30T17:19:56.477375+0000","last_fullsized":"2023-11-30T17:19:56.477375+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.499116+0000","last_change":"2023-11-30T17:19:56.495412+0000","last_active":"2023-11-30T17:19:56.499116+0000","last_peered":"2023-11-30T17:19:56.499116+0000","last_clean":"2023-11-30T17:19:56.499116+0000","last_became_active":"2023-11-30T17:19:56.494719+0000","last_became_peered":"2023-11-30T17:19:56.494719+0000","last_unstale":"2023-11-30T17:19:56.499116+0000","last_undegraded":"2023-11-30T17:19:56.499116+0000","last_fullsized":"2023-11-30T17:19:56.499116+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.078834+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.497842+0000","last_change":"2023-11-30T17:19:56.496872+0000","last_active":"2023-11-30T17:19:56.497842+0000","last_peered":"2023-11-30T17:19:56.497842+0000","last_clean":"2023-11-30T17:19:56.497842+0000","last_became_active":"2023-11-30T17:19:56.496614+0000","last_became_peered":"2023-11-30T17:19:56.496614+0000","last_unstale":"2023-11-30T17:19:56.497842+0000","last_undegraded":"2023-11-30T17:19:56.497842+0000","last_fullsized":"2023-11-30T17:19:56.497842+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491029+0000","last_change":"2023-11-30T17:19:56.104114+0000","last_active":"2023-11-30T17:19:56.491029+0000","last_peered":"2023-11-30T17:19:56.491029+0000","last_clean":"2023-11-30T17:19:56.491029+0000","last_became_active":"2023-11-30T17:19:56.103835+0000","last_became_peered":"2023-11-30T17:19:56.103835+0000","last_unstale":"2023-11-30T17:19:56.491029+0000","last_undegraded":"2023-11-30T17:19:56.491029+0000","last_fullsized":"2023-11-30T17:19:56.491029+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"64'2","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500313+0000","last_change":"2023-11-30T17:19:56.087339+0000","last_active":"2023-11-30T17:19:56.500313+0000","last_peered":"2023-11-30T17:19:56.500313+0000","last_clean":"2023-11-30T17:19:56.500313+0000","last_became_active":"2023-11-30T17:19:56.086993+0000","last_became_peered":"2023-11-30T17:19:56.086993+0000","last_unstale":"2023-11-30T17:19:56.500313+0000","last_undegraded":"2023-11-30T17:19:56.500313+0000","last_fullsized":"2023-11-30T17:19:56.500313+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491920+0000","last_change":"2023-11-30T17:19:56.489159+0000","last_active":"2023-11-30T17:19:56.491920+0000","last_peered":"2023-11-30T17:19:56.491920+0000","last_clean":"2023-11-30T17:19:56.491920+0000","last_became_active":"2023-11-30T17:19:56.488952+0000","last_became_peered":"2023-11-30T17:19:56.488952+0000","last_unstale":"2023-11-30T17:19:56.491920+0000","last_undegraded":"2023-11-30T17:19:56.491920+0000","last_fullsized":"2023-11-30T17:19:56.491920+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.479404+0000","last_change":"2023-11-30T17:19:56.098371+0000","last_active":"2023-11-30T17:19:56.479404+0000","last_peered":"2023-11-30T17:19:56.479404+0000","last_clean":"2023-11-30T17:19:56.479404+0000","last_became_active":"2023-11-30T17:19:56.097768+0000","last_became_peered":"2023-11-30T17:19:56.097768+0000","last_unstale":"2023-11-30T17:19:56.479404+0000","last_undegraded":"2023-11-30T17:19:56.479404+0000","last_fullsized":"2023-11-30T17:19:56.479404+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.494168+0000","last_change":"2023-11-30T17:19:56.107222+0000","last_active":"2023-11-30T17:19:56.494168+0000","last_peered":"2023-11-30T17:19:56.494168+0000","last_clean":"2023-11-30T17:19:56.494168+0000","last_became_active":"2023-11-30T17:19:56.106944+0000","last_became_peered":"2023-11-30T17:19:56.106944+0000","last_unstale":"2023-11-30T17:19:56.494168+0000","last_undegraded":"2023-11-30T17:19:56.494168+0000","last_fullsized":"2023-11-30T17:19:56.494168+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.499076+0000","last_change":"2023-11-30T17:19:56.497589+0000","last_active":"2023-11-30T17:19:56.499076+0000","last_peered":"2023-11-30T17:19:56.499076+0000","last_clean":"2023-11-30T17:19:56.499076+0000","last_became_active":"2023-11-30T17:19:56.497315+0000","last_became_peered":"2023-11-30T17:19:56.497315+0000","last_unstale":"2023-11-30T17:19:56.499076+0000","last_undegraded":"2023-11-30T17:19:56.499076+0000","last_fullsized":"2023-11-30T17:19:56.499076+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.082279+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491354+0000","last_change":"2023-11-30T17:19:56.488325+0000","last_active":"2023-11-30T17:19:56.491354+0000","last_peered":"2023-11-30T17:19:56.491354+0000","last_clean":"2023-11-30T17:19:56.491354+0000","last_became_active":"2023-11-30T17:19:56.488024+0000","last_became_peered":"2023-11-30T17:19:56.488024+0000","last_unstale":"2023-11-30T17:19:56.491354+0000","last_undegraded":"2023-11-30T17:19:56.491354+0000","last_fullsized":"2023-11-30T17:19:56.491354+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.077413+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.502394+0000","last_change":"2023-11-30T17:19:56.501622+0000","last_active":"2023-11-30T17:19:56.502394+0000","last_peered":"2023-11-30T17:19:56.502394+0000","last_clean":"2023-11-30T17:19:56.502394+0000","last_became_active":"2023-11-30T17:19:56.501307+0000","last_became_peered":"2023-11-30T17:19:56.501307+0000","last_unstale":"2023-11-30T17:19:56.502394+0000","last_undegraded":"2023-11-30T17:19:56.502394+0000","last_fullsized":"2023-11-30T17:19:56.502394+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.487985+0000","last_change":"2023-11-30T17:19:56.104353+0000","last_active":"2023-11-30T17:19:56.487985+0000","last_peered":"2023-11-30T17:19:56.487985+0000","last_clean":"2023-11-30T17:19:56.487985+0000","last_became_active":"2023-11-30T17:19:56.102240+0000","last_became_peered":"2023-11-30T17:19:56.102240+0000","last_unstale":"2023-11-30T17:19:56.487985+0000","last_undegraded":"2023-11-30T17:19:56.487985+0000","last_fullsized":"2023-11-30T17:19:56.487985+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.484948+0000","last_change":"2023-11-30T17:19:56.103000+0000","last_active":"2023-11-30T17:19:56.484948+0000","last_peered":"2023-11-30T17:19:56.484948+0000","last_clean":"2023-11-30T17:19:56.484948+0000","last_became_active":"2023-11-30T17:19:56.102778+0000","last_became_peered":"2023-11-30T17:19:56.102778+0000","last_unstale":"2023-11-30T17:19:56.484948+0000","last_undegraded":"2023-11-30T17:19:56.484948+0000","last_fullsized":"2023-11-30T17:19:56.484948+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.494098+0000","last_change":"2023-11-30T17:19:56.490277+0000","last_active":"2023-11-30T17:19:56.494098+0000","last_peered":"2023-11-30T17:19:56.494098+0000","last_clean":"2023-11-30T17:19:56.494098+0000","last_became_active":"2023-11-30T17:19:56.490009+0000","last_became_peered":"2023-11-30T17:19:56.490009+0000","last_unstale":"2023-11-30T17:19:56.494098+0000","last_undegraded":"2023-11-30T17:19:56.494098+0000","last_fullsized":"2023-11-30T17:19:56.494098+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.083351+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.501207+0000","last_change":"2023-11-30T17:19:56.499008+0000","last_active":"2023-11-30T17:19:56.501207+0000","last_peered":"2023-11-30T17:19:56.501207+0000","last_clean":"2023-11-30T17:19:56.501207+0000","last_became_active":"2023-11-30T17:19:56.498726+0000","last_became_peered":"2023-11-30T17:19:56.498726+0000","last_unstale":"2023-11-30T17:19:56.501207+0000","last_undegraded":"2023-11-30T17:19:56.501207+0000","last_fullsized":"2023-11-30T17:19:56.501207+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"64'3","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.497982+0000","last_change":"2023-11-30T17:19:56.099588+0000","last_active":"2023-11-30T17:19:56.497982+0000","last_peered":"2023-11-30T17:19:56.497982+0000","last_clean":"2023-11-30T17:19:56.497982+0000","last_became_active":"2023-11-30T17:19:56.099307+0000","last_became_peered":"2023-11-30T17:19:56.099307+0000","last_unstale":"2023-11-30T17:19:56.497982+0000","last_undegraded":"2023-11-30T17:19:56.497982+0000","last_fullsized":"2023-11-30T17:19:56.497982+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"64'2","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493354+0000","last_change":"2023-11-30T17:19:56.099031+0000","last_active":"2023-11-30T17:19:56.493354+0000","last_peered":"2023-11-30T17:19:56.493354+0000","last_clean":"2023-11-30T17:19:56.493354+0000","last_became_active":"2023-11-30T17:19:56.098676+0000","last_became_peered":"2023-11-30T17:19:56.098676+0000","last_unstale":"2023-11-30T17:19:56.493354+0000","last_undegraded":"2023-11-30T17:19:56.493354+0000","last_fullsized":"2023-11-30T17:19:56.493354+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498229+0000","last_change":"2023-11-30T17:19:56.493423+0000","last_active":"2023-11-30T17:19:56.498229+0000","last_peered":"2023-11-30T17:19:56.498229+0000","last_clean":"2023-11-30T17:19:56.498229+0000","last_became_active":"2023-11-30T17:19:56.493141+0000","last_became_peered":"2023-11-30T17:19:56.493141+0000","last_unstale":"2023-11-30T17:19:56.498229+0000","last_undegraded":"2023-11-30T17:19:56.498229+0000","last_fullsized":"2023-11-30T17:19:56.498229+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.501063+0000","last_change":"2023-11-30T17:19:56.106743+0000","last_active":"2023-11-30T17:19:56.501063+0000","last_peered":"2023-11-30T17:19:56.501063+0000","last_clean":"2023-11-30T17:19:56.501063+0000","last_became_active":"2023-11-30T17:19:56.106450+0000","last_became_peered":"2023-11-30T17:19:56.106450+0000","last_unstale":"2023-11-30T17:19:56.501063+0000","last_undegraded":"2023-11-30T17:19:56.501063+0000","last_fullsized":"2023-11-30T17:19:56.501063+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500981+0000","last_change":"2023-11-30T17:19:56.497411+0000","last_active":"2023-11-30T17:19:56.500981+0000","last_peered":"2023-11-30T17:19:56.500981+0000","last_clean":"2023-11-30T17:19:56.500981+0000","last_became_active":"2023-11-30T17:19:56.487506+0000","last_became_peered":"2023-11-30T17:19:56.487506+0000","last_unstale":"2023-11-30T17:19:56.500981+0000","last_undegraded":"2023-11-30T17:19:56.500981+0000","last_fullsized":"2023-11-30T17:19:56.500981+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.078221+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491429+0000","last_change":"2023-11-30T17:19:56.490367+0000","last_active":"2023-11-30T17:19:56.491429+0000","last_peered":"2023-11-30T17:19:56.491429+0000","last_clean":"2023-11-30T17:19:56.491429+0000","last_became_active":"2023-11-30T17:19:56.490117+0000","last_became_peered":"2023-11-30T17:19:56.490117+0000","last_unstale":"2023-11-30T17:19:56.491429+0000","last_undegraded":"2023-11-30T17:19:56.491429+0000","last_fullsized":"2023-11-30T17:19:56.491429+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.483337+0000","last_change":"2023-11-30T17:19:56.100665+0000","last_active":"2023-11-30T17:19:56.483337+0000","last_peered":"2023-11-30T17:19:56.483337+0000","last_clean":"2023-11-30T17:19:56.483337+0000","last_became_active":"2023-11-30T17:19:56.100289+0000","last_became_peered":"2023-11-30T17:19:56.100289+0000","last_unstale":"2023-11-30T17:19:56.483337+0000","last_undegraded":"2023-11-30T17:19:56.483337+0000","last_fullsized":"2023-11-30T17:19:56.483337+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.501995+0000","last_change":"2023-11-30T17:19:56.499238+0000","last_active":"2023-11-30T17:19:56.501995+0000","last_peered":"2023-11-30T17:19:56.501995+0000","last_clean":"2023-11-30T17:19:56.501995+0000","last_became_active":"2023-11-30T17:19:56.498862+0000","last_became_peered":"2023-11-30T17:19:56.498862+0000","last_unstale":"2023-11-30T17:19:56.501995+0000","last_undegraded":"2023-11-30T17:19:56.501995+0000","last_fullsized":"2023-11-30T17:19:56.501995+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"64'4","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493785+0000","last_change":"2023-11-30T17:19:56.104095+0000","last_active":"2023-11-30T17:19:56.493785+0000","last_peered":"2023-11-30T17:19:56.493785+0000","last_clean":"2023-11-30T17:19:56.493785+0000","last_became_active":"2023-11-30T17:19:56.103816+0000","last_became_peered":"2023-11-30T17:19:56.103816+0000","last_unstale":"2023-11-30T17:19:56.493785+0000","last_undegraded":"2023-11-30T17:19:56.493785+0000","last_fullsized":"2023-11-30T17:19:56.493785+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496102+0000","last_change":"2023-11-30T17:19:56.494855+0000","last_active":"2023-11-30T17:19:56.496102+0000","last_peered":"2023-11-30T17:19:56.496102+0000","last_clean":"2023-11-30T17:19:56.496102+0000","last_became_active":"2023-11-30T17:19:56.494231+0000","last_became_peered":"2023-11-30T17:19:56.494231+0000","last_unstale":"2023-11-30T17:19:56.496102+0000","last_undegraded":"2023-11-30T17:19:56.496102+0000","last_fullsized":"2023-11-30T17:19:56.496102+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.504017+0000","last_change":"2023-11-30T17:19:56.108216+0000","last_active":"2023-11-30T17:19:56.504017+0000","last_peered":"2023-11-30T17:19:56.504017+0000","last_clean":"2023-11-30T17:19:56.504017+0000","last_became_active":"2023-11-30T17:19:56.107938+0000","last_became_peered":"2023-11-30T17:19:56.107938+0000","last_unstale":"2023-11-30T17:19:56.504017+0000","last_undegraded":"2023-11-30T17:19:56.504017+0000","last_fullsized":"2023-11-30T17:19:56.504017+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.495894+0000","last_change":"2023-11-30T17:19:56.490237+0000","last_active":"2023-11-30T17:19:56.495894+0000","last_peered":"2023-11-30T17:19:56.495894+0000","last_clean":"2023-11-30T17:19:56.495894+0000","last_became_active":"2023-11-30T17:19:56.489940+0000","last_became_peered":"2023-11-30T17:19:56.489940+0000","last_unstale":"2023-11-30T17:19:56.495894+0000","last_undegraded":"2023-11-30T17:19:56.495894+0000","last_fullsized":"2023-11-30T17:19:56.495894+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"64'2","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.492593+0000","last_change":"2023-11-30T17:19:56.100743+0000","last_active":"2023-11-30T17:19:56.492593+0000","last_peered":"2023-11-30T17:19:56.492593+0000","last_clean":"2023-11-30T17:19:56.492593+0000","last_became_active":"2023-11-30T17:19:56.100431+0000","last_became_peered":"2023-11-30T17:19:56.100431+0000","last_unstale":"2023-11-30T17:19:56.492593+0000","last_undegraded":"2023-11-30T17:19:56.492593+0000","last_fullsized":"2023-11-30T17:19:56.492593+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.077671+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496432+0000","last_change":"2023-11-30T17:19:56.493539+0000","last_active":"2023-11-30T17:19:56.496432+0000","last_peered":"2023-11-30T17:19:56.496432+0000","last_clean":"2023-11-30T17:19:56.496432+0000","last_became_active":"2023-11-30T17:19:56.493211+0000","last_became_peered":"2023-11-30T17:19:56.493211+0000","last_unstale":"2023-11-30T17:19:56.496432+0000","last_undegraded":"2023-11-30T17:19:56.496432+0000","last_fullsized":"2023-11-30T17:19:56.496432+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.078432+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498207+0000","last_change":"2023-11-30T17:19:56.492263+0000","last_active":"2023-11-30T17:19:56.498207+0000","last_peered":"2023-11-30T17:19:56.498207+0000","last_clean":"2023-11-30T17:19:56.498207+0000","last_became_active":"2023-11-30T17:19:56.491997+0000","last_became_peered":"2023-11-30T17:19:56.491997+0000","last_unstale":"2023-11-30T17:19:56.498207+0000","last_undegraded":"2023-11-30T17:19:56.498207+0000","last_fullsized":"2023-11-30T17:19:56.498207+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493638+0000","last_change":"2023-11-30T17:19:56.101187+0000","last_active":"2023-11-30T17:19:56.493638+0000","last_peered":"2023-11-30T17:19:56.493638+0000","last_clean":"2023-11-30T17:19:56.493638+0000","last_became_active":"2023-11-30T17:19:56.100914+0000","last_became_peered":"2023-11-30T17:19:56.100914+0000","last_unstale":"2023-11-30T17:19:56.493638+0000","last_undegraded":"2023-11-30T17:19:56.493638+0000","last_fullsized":"2023-11-30T17:19:56.493638+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.476956+0000","last_change":"2023-11-30T17:19:56.099958+0000","last_active":"2023-11-30T17:19:56.476956+0000","last_peered":"2023-11-30T17:19:56.476956+0000","last_clean":"2023-11-30T17:19:56.476956+0000","last_became_active":"2023-11-30T17:19:56.099666+0000","last_became_peered":"2023-11-30T17:19:56.099666+0000","last_unstale":"2023-11-30T17:19:56.476956+0000","last_undegraded":"2023-11-30T17:19:56.476956+0000","last_fullsized":"2023-11-30T17:19:56.476956+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500920+0000","last_change":"2023-11-30T17:19:56.497005+0000","last_active":"2023-11-30T17:19:56.500920+0000","last_peered":"2023-11-30T17:19:56.500920+0000","last_clean":"2023-11-30T17:19:56.500920+0000","last_became_active":"2023-11-30T17:19:56.496751+0000","last_became_peered":"2023-11-30T17:19:56.496751+0000","last_unstale":"2023-11-30T17:19:56.500920+0000","last_undegraded":"2023-11-30T17:19:56.500920+0000","last_fullsized":"2023-11-30T17:19:56.500920+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.485997+0000","last_change":"2023-11-30T17:19:56.109945+0000","last_active":"2023-11-30T17:19:56.485997+0000","last_peered":"2023-11-30T17:19:56.485997+0000","last_clean":"2023-11-30T17:19:56.485997+0000","last_became_active":"2023-11-30T17:19:56.109524+0000","last_became_peered":"2023-11-30T17:19:56.109524+0000","last_unstale":"2023-11-30T17:19:56.485997+0000","last_undegraded":"2023-11-30T17:19:56.485997+0000","last_fullsized":"2023-11-30T17:19:56.485997+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.484983+0000","last_change":"2023-11-30T17:19:56.481568+0000","last_active":"2023-11-30T17:19:56.484983+0000","last_peered":"2023-11-30T17:19:56.484983+0000","last_clean":"2023-11-30T17:19:56.484983+0000","last_became_active":"2023-11-30T17:19:56.481250+0000","last_became_peered":"2023-11-30T17:19:56.481250+0000","last_unstale":"2023-11-30T17:19:56.484983+0000","last_undegraded":"2023-11-30T17:19:56.484983+0000","last_fullsized":"2023-11-30T17:19:56.484983+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.477452+0000","last_change":"2023-11-30T17:19:56.094800+0000","last_active":"2023-11-30T17:19:56.477452+0000","last_peered":"2023-11-30T17:19:56.477452+0000","last_clean":"2023-11-30T17:19:56.477452+0000","last_became_active":"2023-11-30T17:19:56.094502+0000","last_became_peered":"2023-11-30T17:19:56.094502+0000","last_unstale":"2023-11-30T17:19:56.477452+0000","last_undegraded":"2023-11-30T17:19:56.477452+0000","last_fullsized":"2023-11-30T17:19:56.477452+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493507+0000","last_change":"2023-11-30T17:19:56.490881+0000","last_active":"2023-11-30T17:19:56.493507+0000","last_peered":"2023-11-30T17:19:56.493507+0000","last_clean":"2023-11-30T17:19:56.493507+0000","last_became_active":"2023-11-30T17:19:56.490557+0000","last_became_peered":"2023-11-30T17:19:56.490557+0000","last_unstale":"2023-11-30T17:19:56.493507+0000","last_undegraded":"2023-11-30T17:19:56.493507+0000","last_fullsized":"2023-11-30T17:19:56.493507+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.082283+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.472480+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:19:56.472480+0000","last_peered":"2023-11-30T17:19:56.472480+0000","last_clean":"2023-11-30T17:19:56.472480+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:19:56.472480+0000","last_undegraded":"2023-11-30T17:19:56.472480+0000","last_fullsized":"2023-11-30T17:19:56.472480+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493542+0000","last_change":"2023-11-30T17:19:56.485917+0000","last_active":"2023-11-30T17:19:56.493542+0000","last_peered":"2023-11-30T17:19:56.493542+0000","last_clean":"2023-11-30T17:19:56.493542+0000","last_became_active":"2023-11-30T17:19:56.485355+0000","last_became_peered":"2023-11-30T17:19:56.485355+0000","last_unstale":"2023-11-30T17:19:56.493542+0000","last_undegraded":"2023-11-30T17:19:56.493542+0000","last_fullsized":"2023-11-30T17:19:56.493542+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.077495+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.479090+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:19:56.479090+0000","last_peered":"2023-11-30T17:19:56.479090+0000","last_clean":"2023-11-30T17:19:56.479090+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:19:56.479090+0000","last_undegraded":"2023-11-30T17:19:56.479090+0000","last_fullsized":"2023-11-30T17:19:56.479090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491937+0000","last_change":"2023-11-30T17:19:56.489558+0000","last_active":"2023-11-30T17:19:56.491937+0000","last_peered":"2023-11-30T17:19:56.491937+0000","last_clean":"2023-11-30T17:19:56.491937+0000","last_became_active":"2023-11-30T17:19:56.489367+0000","last_became_peered":"2023-11-30T17:19:56.489367+0000","last_unstale":"2023-11-30T17:19:56.491937+0000","last_undegraded":"2023-11-30T17:19:56.491937+0000","last_fullsized":"2023-11-30T17:19:56.491937+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.495220+0000","last_change":"2023-11-30T17:19:56.099447+0000","last_active":"2023-11-30T17:19:56.495220+0000","last_peered":"2023-11-30T17:19:56.495220+0000","last_clean":"2023-11-30T17:19:56.495220+0000","last_became_active":"2023-11-30T17:19:56.098752+0000","last_became_peered":"2023-11-30T17:19:56.098752+0000","last_unstale":"2023-11-30T17:19:56.495220+0000","last_undegraded":"2023-11-30T17:19:56.495220+0000","last_fullsized":"2023-11-30T17:19:56.495220+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.476345+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:19:56.476345+0000","last_peered":"2023-11-30T17:19:56.476345+0000","last_clean":"2023-11-30T17:19:56.476345+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:19:56.476345+0000","last_undegraded":"2023-11-30T17:19:56.476345+0000","last_fullsized":"2023-11-30T17:19:56.476345+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496649+0000","last_change":"2023-11-30T17:19:56.106136+0000","last_active":"2023-11-30T17:19:56.496649+0000","last_peered":"2023-11-30T17:19:56.496649+0000","last_clean":"2023-11-30T17:19:56.496649+0000","last_became_active":"2023-11-30T17:19:56.105756+0000","last_became_peered":"2023-11-30T17:19:56.105756+0000","last_unstale":"2023-11-30T17:19:56.496649+0000","last_undegraded":"2023-11-30T17:19:56.496649+0000","last_fullsized":"2023-11-30T17:19:56.496649+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.480220+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:19:56.480220+0000","last_peered":"2023-11-30T17:19:56.480220+0000","last_clean":"2023-11-30T17:19:56.480220+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:19:56.480220+0000","last_undegraded":"2023-11-30T17:19:56.480220+0000","last_fullsized":"2023-11-30T17:19:56.480220+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":51,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.481994+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:19:56.481994+0000","last_peered":"2023-11-30T17:19:56.481994+0000","last_clean":"2023-11-30T17:19:56.481994+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:19:56.481994+0000","last_undegraded":"2023-11-30T17:19:56.481994+0000","last_fullsized":"2023-11-30T17:19:56.481994+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.484755+0000","last_change":"2023-11-30T17:19:56.482476+0000","last_active":"2023-11-30T17:19:56.484755+0000","last_peered":"2023-11-30T17:19:56.484755+0000","last_clean":"2023-11-30T17:19:56.484755+0000","last_became_active":"2023-11-30T17:19:56.482179+0000","last_became_peered":"2023-11-30T17:19:56.482179+0000","last_unstale":"2023-11-30T17:19:56.484755+0000","last_undegraded":"2023-11-30T17:19:56.484755+0000","last_fullsized":"2023-11-30T17:19:56.484755+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.485102+0000","last_change":"2023-11-30T17:19:56.097211+0000","last_active":"2023-11-30T17:19:56.485102+0000","last_peered":"2023-11-30T17:19:56.485102+0000","last_clean":"2023-11-30T17:19:56.485102+0000","last_became_active":"2023-11-30T17:19:56.096945+0000","last_became_peered":"2023-11-30T17:19:56.096945+0000","last_unstale":"2023-11-30T17:19:56.485102+0000","last_undegraded":"2023-11-30T17:19:56.485102+0000","last_fullsized":"2023-11-30T17:19:56.485102+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.482083+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:19:56.482083+0000","last_peered":"2023-11-30T17:19:56.482083+0000","last_clean":"2023-11-30T17:19:56.482083+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:19:56.482083+0000","last_undegraded":"2023-11-30T17:19:56.482083+0000","last_fullsized":"2023-11-30T17:19:56.482083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491458+0000","last_change":"2023-11-30T17:19:56.489737+0000","last_active":"2023-11-30T17:19:56.491458+0000","last_peered":"2023-11-30T17:19:56.491458+0000","last_clean":"2023-11-30T17:19:56.491458+0000","last_became_active":"2023-11-30T17:19:56.487977+0000","last_became_peered":"2023-11-30T17:19:56.487977+0000","last_unstale":"2023-11-30T17:19:56.491458+0000","last_undegraded":"2023-11-30T17:19:56.491458+0000","last_fullsized":"2023-11-30T17:19:56.491458+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.479316+0000","last_change":"2023-11-30T17:19:56.104936+0000","last_active":"2023-11-30T17:19:56.479316+0000","last_peered":"2023-11-30T17:19:56.479316+0000","last_clean":"2023-11-30T17:19:56.479316+0000","last_became_active":"2023-11-30T17:19:56.104707+0000","last_became_peered":"2023-11-30T17:19:56.104707+0000","last_unstale":"2023-11-30T17:19:56.479316+0000","last_undegraded":"2023-11-30T17:19:56.479316+0000","last_fullsized":"2023-11-30T17:19:56.479316+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.485161+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:19:56.485161+0000","last_peered":"2023-11-30T17:19:56.485161+0000","last_clean":"2023-11-30T17:19:56.485161+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:19:56.485161+0000","last_undegraded":"2023-11-30T17:19:56.485161+0000","last_fullsized":"2023-11-30T17:19:56.485161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.487502+0000","last_change":"2023-11-30T17:19:56.486862+0000","last_active":"2023-11-30T17:19:56.487502+0000","last_peered":"2023-11-30T17:19:56.487502+0000","last_clean":"2023-11-30T17:19:56.487502+0000","last_became_active":"2023-11-30T17:19:56.486600+0000","last_became_peered":"2023-11-30T17:19:56.486600+0000","last_unstale":"2023-11-30T17:19:56.487502+0000","last_undegraded":"2023-11-30T17:19:56.487502+0000","last_fullsized":"2023-11-30T17:19:56.487502+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.478581+0000","last_change":"2023-11-30T17:19:56.108142+0000","last_active":"2023-11-30T17:19:56.478581+0000","last_peered":"2023-11-30T17:19:56.478581+0000","last_clean":"2023-11-30T17:19:56.478581+0000","last_became_active":"2023-11-30T17:19:56.107685+0000","last_became_peered":"2023-11-30T17:19:56.107685+0000","last_unstale":"2023-11-30T17:19:56.478581+0000","last_undegraded":"2023-11-30T17:19:56.478581+0000","last_fullsized":"2023-11-30T17:19:56.478581+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.472945+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:19:56.472945+0000","last_peered":"2023-11-30T17:19:56.472945+0000","last_clean":"2023-11-30T17:19:56.472945+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:19:56.472945+0000","last_undegraded":"2023-11-30T17:19:56.472945+0000","last_fullsized":"2023-11-30T17:19:56.472945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.494336+0000","last_change":"2023-11-30T17:19:56.489210+0000","last_active":"2023-11-30T17:19:56.494336+0000","last_peered":"2023-11-30T17:19:56.494336+0000","last_clean":"2023-11-30T17:19:56.494336+0000","last_became_active":"2023-11-30T17:19:56.488914+0000","last_became_peered":"2023-11-30T17:19:56.488914+0000","last_unstale":"2023-11-30T17:19:56.494336+0000","last_undegraded":"2023-11-30T17:19:56.494336+0000","last_fullsized":"2023-11-30T17:19:56.494336+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.477075+0000","last_change":"2023-11-30T17:19:56.102213+0000","last_active":"2023-11-30T17:19:56.477075+0000","last_peered":"2023-11-30T17:19:56.477075+0000","last_clean":"2023-11-30T17:19:56.477075+0000","last_became_active":"2023-11-30T17:19:56.101927+0000","last_became_peered":"2023-11-30T17:19:56.101927+0000","last_unstale":"2023-11-30T17:19:56.477075+0000","last_undegraded":"2023-11-30T17:19:56.477075+0000","last_fullsized":"2023-11-30T17:19:56.477075+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-30T17:19:52.060819+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:19:52.060819+0000","last_peered":"2023-11-30T17:19:52.060819+0000","last_clean":"2023-11-30T17:19:52.060819+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:19:52.060819+0000","last_undegraded":"2023-11-30T17:19:52.060819+0000","last_fullsized":"2023-11-30T17:19:52.060819+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":2236,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":106,"acting":106,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575004,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297864,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":786432,"data_stored":380863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58699999999999997,"15min":0.55800000000000005},"min":{"1min":0.374,"5min":0.317,"15min":0.23899999999999999},"max":{"1min":0.73099999999999998,"5min":0.78700000000000003,"15min":0.81100000000000005},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58599999999999997,"15min":0.56599999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.32200000000000001},"max":{"1min":0.76400000000000001,"5min":0.76700000000000002,"15min":0.81899999999999995},"last":0.56100000000000005}]},{"osd":1,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55200000000000005,"15min":0.53000000000000003},"min":{"1min":0.39400000000000002,"5min":0.34599999999999997,"15min":0.33600000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.79400000000000004},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.28799999999999998},"max":{"1min":0.63400000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.46700000000000003}]},{"osd":2,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.32800000000000001},"max":{"1min":0.67600000000000005,"5min":0.77200000000000002,"15min":0.78300000000000003},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.28699999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.83899999999999997},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54400000000000004,"15min":0.53700000000000003},"min":{"1min":0.375,"5min":0.36899999999999999,"15min":0.33200000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.78000000000000003},"last":0.623},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.33900000000000002},"max":{"1min":0.72999999999999998,"5min":0.80500000000000005,"15min":0.81200000000000006},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.44800000000000001,"15min":0.47099999999999997},"min":{"1min":0.313,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.61899999999999999,"5min":0.77500000000000002,"15min":0.79900000000000004},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.442,"5min":0.46899999999999997,"15min":0.5},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.66600000000000004,"5min":0.69999999999999996,"15min":1.3180000000000001},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47499999999999998,"15min":0.501},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68100000000000005,"5min":0.71499999999999997,"15min":0.82899999999999996},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.51000000000000001,"15min":0.53300000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69099999999999995,"5min":0.76000000000000001,"15min":0.872},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53300000000000003,"15min":0.55700000000000005},"min":{"1min":0.376,"5min":0.372,"15min":0.36099999999999999},"max":{"1min":0.71599999999999997,"5min":0.745,"15min":0.85199999999999998},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.55600000000000005},"min":{"1min":0.35399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72099999999999997,"5min":0.78100000000000003,"15min":0.81499999999999995},"last":0.69799999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575002,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301900,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069940,"statfs":{"total":96636764160,"available":96327618560,"internally_reserved":0,"allocated":724992,"data_stored":353402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.75,"5min":0.80000000000000004,"15min":0.82699999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59499999999999997,"15min":0.57799999999999996},"min":{"1min":0.33500000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.78500000000000003,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57899999999999996,"15min":0.55600000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.26400000000000001},"max":{"1min":0.76900000000000002,"5min":0.77500000000000002,"15min":0.82799999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.60199999999999998,"15min":0.58499999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.82499999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.59399999999999997}]},{"osd":2,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.58499999999999996,"15min":0.56200000000000006},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.82599999999999996},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58499999999999996,"15min":0.57099999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80800000000000005,"5min":0.80900000000000005,"15min":0.82499999999999996},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.70299999999999996,"5min":0.755,"15min":0.755},"last":0.442},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54100000000000004,"15min":0.52900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32200000000000001},"max":{"1min":0.72799999999999998,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.44700000000000001,"15min":0.45700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28999999999999998},"max":{"1min":0.61699999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.623,"5min":0.78800000000000003,"15min":0.83899999999999997},"last":0.504}]},{"osd":5,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46899999999999997,"15min":0.46999999999999997},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.28299999999999997},"max":{"1min":0.61099999999999999,"5min":0.69399999999999995,"15min":0.74299999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.5,"15min":0.50900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.31900000000000001},"max":{"1min":0.68799999999999994,"5min":0.745,"15min":0.78500000000000003},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52200000000000002,"15min":0.53600000000000003},"min":{"1min":0.375,"5min":0.34699999999999998,"15min":0.34000000000000002},"max":{"1min":0.69499999999999995,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56100000000000005,"15min":0.56399999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":0.70299999999999996,"5min":0.83499999999999996,"15min":0.86499999999999999},"last":0.64100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575003,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301952,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069888,"statfs":{"total":96636764160,"available":96327565312,"internally_reserved":0,"allocated":778240,"data_stored":380275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35799999999999998,"15min":0.34100000000000003},"min":{"1min":0.23899999999999999,"5min":0.23599999999999999,"15min":0.23000000000000001},"max":{"1min":0.52900000000000003,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.46899999999999997,"15min":0.44900000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.309},"max":{"1min":0.57999999999999996,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.38900000000000001,"15min":0.36799999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.222},"max":{"1min":0.57099999999999995,"5min":0.628,"15min":0.67300000000000004},"last":0.313},{"interface":"front","average":{"1min":0.499,"5min":0.51000000000000001,"15min":0.47299999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.29499999999999998},"max":{"1min":0.63400000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.33400000000000002}]},{"osd":3,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45800000000000002,"15min":0.43099999999999999},"min":{"1min":0.32900000000000001,"5min":0.32000000000000001,"15min":0.23899999999999999},"max":{"1min":0.60999999999999999,"5min":0.749,"15min":0.749},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.442,"15min":0.41599999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.28599999999999998},"max":{"1min":0.65100000000000002,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.35299999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58999999999999997,"15min":0.57599999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.89100000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.39900000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.111},"last":0.42499999999999999}]},{"osd":5,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59899999999999998,"15min":0.58799999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.377},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60599999999999998,"15min":0.59899999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77500000000000002,"5min":0.88200000000000001,"15min":0.91300000000000003},"last":0.36899999999999999}]},{"osd":6,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.44600000000000001,"5min":0.433,"15min":0.39600000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":1.0600000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.65400000000000003,"15min":0.64900000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.379},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.0780000000000001},"last":0.45500000000000002}]},{"osd":7,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.67400000000000004,"15min":0.65300000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.41699999999999998},"max":{"1min":0.91500000000000004,"5min":0.92300000000000004,"15min":0.98699999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.65000000000000002,"15min":0.63900000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.39900000000000002},"max":{"1min":0.85199999999999998,"5min":0.879,"15min":0.94199999999999995},"last":0.442}]}]},{"osd":0,"up_from":13,"seq":55834575003,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301960,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069880,"statfs":{"total":96636764160,"available":96327557120,"internally_reserved":0,"allocated":786432,"data_stored":380311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.37,"15min":0.35199999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.22700000000000001},"max":{"1min":0.54700000000000004,"5min":0.59999999999999998,"15min":0.71199999999999997},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.39500000000000002,"15min":0.372},"min":{"1min":0.27300000000000002,"5min":0.24099999999999999,"15min":0.22600000000000001},"max":{"1min":0.53100000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.216}]},{"osd":2,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39500000000000002,"15min":0.373},"min":{"1min":0.28999999999999998,"5min":0.247,"15min":0.23899999999999999},"max":{"1min":0.58899999999999997,"5min":0.623,"15min":0.623},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47099999999999997,"15min":0.44600000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.31900000000000001},"max":{"1min":0.60999999999999999,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.30099999999999999}]},{"osd":3,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.439,"15min":0.41999999999999998},"min":{"1min":0.32600000000000001,"5min":0.29499999999999998,"15min":0.252},"max":{"1min":0.629,"5min":0.66100000000000003,"15min":0.70999999999999996},"last":0.249},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45200000000000001,"15min":0.42499999999999999},"min":{"1min":0.33600000000000002,"5min":0.317,"15min":0.26700000000000002},"max":{"1min":0.64700000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.28299999999999997}]},{"osd":4,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61899999999999999,"15min":0.59199999999999997},"min":{"1min":0.46500000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82599999999999996,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63300000000000001,"15min":0.60699999999999998},"min":{"1min":0.435,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79100000000000004,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.58599999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.36199999999999999},"max":{"1min":0.81000000000000005,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.501},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64700000000000002,"15min":0.61599999999999999},"min":{"1min":0.51500000000000001,"5min":0.442,"15min":0.38},"max":{"1min":0.88,"5min":1.004,"15min":1.004},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.65600000000000003,"15min":0.63},"min":{"1min":0.47199999999999998,"5min":0.435,"15min":0.39200000000000002},"max":{"1min":0.86699999999999999,"5min":1.002,"15min":1.002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64900000000000002,"15min":0.622},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.42999999999999999},"max":{"1min":0.81699999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.47599999999999998}]},{"osd":7,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.66700000000000004,"15min":0.63900000000000001},"min":{"1min":0.49199999999999999,"5min":0.48799999999999999,"15min":0.44800000000000001},"max":{"1min":0.92700000000000005,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69799999999999995,"15min":0.67300000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.44700000000000001},"max":{"1min":0.90500000000000003,"5min":1.026,"15min":1.026},"last":0.56399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575003,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306056,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065784,"statfs":{"total":96636764160,"available":96323362816,"internally_reserved":0,"allocated":786432,"data_stored":381721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.41399999999999998,"15min":0.38},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.44,"5min":0.44700000000000001,"15min":0.42099999999999999},"min":{"1min":0.28000000000000003,"5min":0.26400000000000001,"15min":0.255},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46200000000000002,"15min":0.433},"min":{"1min":0.254,"5min":0.254,"15min":0.24299999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49299999999999999,"15min":0.45500000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.373}]},{"osd":3,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.42599999999999999,"15min":0.39300000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63500000000000001,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48999999999999999,"15min":0.45100000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.26200000000000001},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.31900000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64400000000000002,"15min":0.59899999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63900000000000001,"15min":0.59699999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66300000000000003,"15min":0.621},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66400000000000003,"15min":0.61699999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38100000000000001},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.66000000000000003,"15min":0.61399999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68999999999999995,"15min":0.65000000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.69999999999999996,"15min":0.66100000000000003},"min":{"1min":0.48899999999999999,"5min":0.45200000000000001,"15min":0.40300000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.71299999999999997,"15min":0.66800000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.41499999999999998},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.69399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575003,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306056,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065784,"statfs":{"total":96636764160,"available":96323362816,"internally_reserved":0,"allocated":786432,"data_stored":380851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.379,"15min":0.35699999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.217},"max":{"1min":0.56599999999999995,"5min":0.58799999999999997,"15min":0.66200000000000003},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.41299999999999998,"15min":0.38800000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.246},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39600000000000002,"15min":0.378},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.255},"max":{"1min":0.59499999999999997,"5min":0.63300000000000001,"15min":0.64300000000000002},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.44,"15min":0.42499999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.25900000000000001},"max":{"1min":0.51500000000000001,"5min":0.69099999999999995,"15min":0.84399999999999997},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46500000000000002,"15min":0.438},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.26000000000000001},"max":{"1min":0.72999999999999998,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.52900000000000003,"15min":0.48899999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.33400000000000002},"max":{"1min":0.68999999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61599999999999999,"15min":0.59499999999999997},"min":{"1min":0.42799999999999999,"5min":0.42599999999999999,"15min":0.35099999999999998},"max":{"1min":0.91500000000000004,"5min":0.91600000000000004,"15min":0.97599999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.624,"15min":0.61099999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.34799999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.91400000000000003},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61699999999999999,"15min":0.60599999999999998},"min":{"1min":0.41699999999999998,"5min":0.40000000000000002,"15min":0.378},"max":{"1min":0.85399999999999998,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.504},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.64600000000000002,"15min":0.629},"min":{"1min":0.46700000000000003,"5min":0.45100000000000001,"15min":0.36399999999999999},"max":{"1min":0.80500000000000005,"5min":0.88900000000000001,"15min":1.008},"last":0.623}]},{"osd":6,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.39000000000000001},"max":{"1min":0.84599999999999997,"5min":0.94999999999999996,"15min":1.0389999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.65800000000000003,"15min":0.64400000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.41399999999999998},"max":{"1min":0.89500000000000002,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.63800000000000001}]},{"osd":7,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67500000000000004,"15min":0.66500000000000004},"min":{"1min":0.51300000000000001,"5min":0.44700000000000001,"15min":0.39100000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.67000000000000004,"15min":0.65100000000000002},"min":{"1min":0.46200000000000002,"5min":0.432,"15min":0.41899999999999998},"max":{"1min":0.89200000000000002,"5min":0.93700000000000006,"15min":1.004},"last":0.65000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575002,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297804,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074036,"statfs":{"total":96636764160,"available":96331812864,"internally_reserved":0,"allocated":724992,"data_stored":353402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52700000000000002,"15min":0.52300000000000002},"min":{"1min":0.39400000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71699999999999997,"5min":0.77700000000000002,"15min":0.80900000000000005},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.379,"5min":0.32200000000000001,"15min":0.317},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.47499999999999998}]},{"osd":1,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.55100000000000005,"15min":0.53400000000000003},"min":{"1min":0.36899999999999999,"5min":0.314,"15min":0.25800000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.79600000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54400000000000004,"15min":0.54100000000000004},"min":{"1min":0.44700000000000001,"5min":0.36699999999999999,"15min":0.246},"max":{"1min":0.71299999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58199999999999996,"15min":0.56100000000000005},"min":{"1min":0.46500000000000002,"5min":0.38400000000000001,"15min":0.27800000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.58999999999999997},"min":{"1min":0.436,"5min":0.41299999999999998,"15min":0.36899999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.60799999999999998}]},{"osd":3,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55400000000000005,"15min":0.54300000000000004},"min":{"1min":0.41499999999999998,"5min":0.40600000000000003,"15min":0.32900000000000001},"max":{"1min":0.76400000000000001,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.45000000000000001,"5min":0.372,"15min":0.35799999999999998},"max":{"1min":0.69699999999999995,"5min":0.78900000000000003,"15min":0.80600000000000005},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.43099999999999999,"15min":0.45600000000000002},"min":{"1min":0.33000000000000002,"5min":0.30099999999999999,"15min":0.27400000000000002},"max":{"1min":0.54900000000000004,"5min":0.72499999999999998,"15min":0.83299999999999996},"last":0.623},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.44400000000000001,"15min":0.47199999999999998},"min":{"1min":0.374,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59999999999999998,"5min":0.66400000000000003,"15min":0.85099999999999998},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.49399999999999999,"15min":0.51200000000000001},"min":{"1min":0.371,"5min":0.33100000000000002,"15min":0.314},"max":{"1min":0.64200000000000002,"5min":0.754,"15min":0.98799999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53200000000000003,"15min":0.54400000000000004},"min":{"1min":0.45100000000000001,"5min":0.39900000000000002,"15min":0.33800000000000002},"max":{"1min":0.65700000000000003,"5min":0.74099999999999999,"15min":0.95999999999999996},"last":0.73299999999999998}]},{"osd":7,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.35999999999999999,"5min":0.318,"15min":0.29899999999999999},"max":{"1min":0.68799999999999994,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56599999999999995,"15min":0.57799999999999996},"min":{"1min":0.50700000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.69699999999999995,"5min":0.79500000000000004,"15min":0.85399999999999998},"last":0.754}]}]},{"osd":5,"up_from":13,"seq":55834575003,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301952,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069888,"statfs":{"total":96636764160,"available":96327565312,"internally_reserved":0,"allocated":778240,"data_stored":381077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.35799999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.627,"5min":0.73399999999999999,"15min":0.76500000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.67000000000000004,"5min":0.76200000000000001,"15min":0.81799999999999995},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.52600000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.318},"max":{"1min":0.59999999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.56100000000000005,"15min":0.53900000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.36199999999999999},"max":{"1min":0.65800000000000003,"5min":0.754,"15min":0.77000000000000002},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60399999999999998,"15min":0.58399999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.30599999999999999},"max":{"1min":0.74099999999999999,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.60599999999999998,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.34499999999999997},"max":{"1min":0.69099999999999995,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55600000000000005,"15min":0.54100000000000004},"min":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64600000000000002,"5min":0.72399999999999998,"15min":0.73799999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57299999999999995,"15min":0.56799999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.71299999999999997,"5min":0.79200000000000004,"15min":0.82099999999999995},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.42899999999999999,"15min":0.44600000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.53900000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.46100000000000002,"15min":0.47099999999999997},"min":{"1min":0.34499999999999997,"5min":0.33000000000000002,"15min":0.32100000000000001},"max":{"1min":0.55600000000000005,"5min":0.66700000000000004,"15min":0.77600000000000002},"last":0.40200000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.48199999999999998,"15min":0.48899999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28499999999999998},"max":{"1min":0.63100000000000001,"5min":0.73999999999999999,"15min":0.82099999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54600000000000004,"15min":0.55600000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.33400000000000002},"max":{"1min":0.67300000000000004,"5min":0.81399999999999995,"15min":0.88200000000000001},"last":0.54400000000000004}]},{"osd":7,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.52700000000000002,"15min":0.53100000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68200000000000005,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57499999999999996,"15min":0.58099999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73099999999999998,"5min":0.79300000000000004,"15min":0.84599999999999997},"last":0.439}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:20:00.869 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:20:01.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.020+0000 7f5534f18700 1 Processor -- start 2023-11-30T17:20:01.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.020+0000 7f5534f18700 1 -- start start 2023-11-30T17:20:01.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.021+0000 7f5534f18700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f55301544d0 0x7f5530155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:01.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.021+0000 7f5534f18700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5530066f40 0x7f5530095e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:01.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.021+0000 7f5534f18700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55300673c0 0x7f5530096370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:01.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.021+0000 7f5534f18700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5530096860 con 0x7f55301544d0 2023-11-30T17:20:01.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.021+0000 7f5534f18700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55300683d0 con 0x7f5530066f40 2023-11-30T17:20:01.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.021+0000 7f5534f18700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5530067850 con 0x7f55300673c0 2023-11-30T17:20:01.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.021+0000 7f552e59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f55301544d0 0x7f5530155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:01.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.021+0000 7f552e59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f55301544d0 0x7f5530155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35010/0 (socket says 172.21.15.49:35010) 2023-11-30T17:20:01.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.021+0000 7f552e59c700 1 -- 172.21.15.49:0/1765480513 learned_addr learned my addr 172.21.15.49:0/1765480513 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:20:01.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.022+0000 7f552dd9b700 1 --2- 172.21.15.49:0/1765480513 >> v2:172.21.15.115:3300/0 conn(0x7f5530066f40 0x7f5530095e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:01.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.022+0000 7f552ed9d700 1 --2- 172.21.15.49:0/1765480513 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55300673c0 0x7f5530096370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:01.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.022+0000 7f552e59c700 1 -- 172.21.15.49:0/1765480513 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55300673c0 msgr2=0x7f5530096370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:01.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.022+0000 7f552e59c700 1 --2- 172.21.15.49:0/1765480513 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55300673c0 0x7f5530096370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:01.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.022+0000 7f552e59c700 1 -- 172.21.15.49:0/1765480513 >> v2:172.21.15.115:3300/0 conn(0x7f5530066f40 msgr2=0x7f5530095e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:01.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.022+0000 7f552e59c700 1 --2- 172.21.15.49:0/1765480513 >> v2:172.21.15.115:3300/0 conn(0x7f5530066f40 0x7f5530095e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:01.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.022+0000 7f552e59c700 1 -- 172.21.15.49:0/1765480513 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5530067b30 con 0x7f55301544d0 2023-11-30T17:20:01.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.022+0000 7f552e59c700 1 --2- 172.21.15.49:0/1765480513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55301544d0 0x7f5530155750 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f553006a7d0 tx=0x7f5528009060).ready entity=mon.0 client_cookie=cb7b819785075d81 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:01.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.022+0000 7f552d59a700 1 -- 172.21.15.49:0/1765480513 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5528005880 con 0x7f55301544d0 2023-11-30T17:20:01.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.022+0000 7f552d59a700 1 -- 172.21.15.49:0/1765480513 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55280059e0 con 0x7f55301544d0 2023-11-30T17:20:01.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.022+0000 7f552d59a700 1 -- 172.21.15.49:0/1765480513 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5528005d60 con 0x7f55301544d0 2023-11-30T17:20:01.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.022+0000 7f5534f18700 1 -- 172.21.15.49:0/1765480513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55301544d0 msgr2=0x7f5530155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:01.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.023+0000 7f5534f18700 1 --2- 172.21.15.49:0/1765480513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55301544d0 0x7f5530155750 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f553006a7d0 tx=0x7f5528009060).stop 2023-11-30T17:20:01.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.023+0000 7f5534f18700 1 -- 172.21.15.49:0/1765480513 shutdown_connections 2023-11-30T17:20:01.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.023+0000 7f5534f18700 1 --2- 172.21.15.49:0/1765480513 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55300673c0 0x7f5530096370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:01.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.023+0000 7f5534f18700 1 --2- 172.21.15.49:0/1765480513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55301544d0 0x7f5530155750 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:01.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.023+0000 7f5534f18700 1 --2- 172.21.15.49:0/1765480513 >> v2:172.21.15.115:3300/0 conn(0x7f5530066f40 0x7f5530095e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:01.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.023+0000 7f5534f18700 1 -- 172.21.15.49:0/1765480513 >> 172.21.15.49:0/1765480513 conn(0x7f55300631d0 msgr2=0x7f55300c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:01.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.023+0000 7f5534f18700 1 -- 172.21.15.49:0/1765480513 shutdown_connections 2023-11-30T17:20:01.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.023+0000 7f5534f18700 1 -- 172.21.15.49:0/1765480513 wait complete. 2023-11-30T17:20:01.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.024+0000 7f5534f18700 1 Processor -- start 2023-11-30T17:20:01.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.024+0000 7f5534f18700 1 -- start start 2023-11-30T17:20:01.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.025+0000 7f5534f18700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5530066f40 0x7f55300c15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:01.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.025+0000 7f5534f18700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55301544d0 0x7f55300a6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:01.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.025+0000 7f5534f18700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55301554a0 0x7f553014eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:01.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.025+0000 7f5534f18700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55301559a0 con 0x7f55301554a0 2023-11-30T17:20:01.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.025+0000 7f5534f18700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5530155c80 con 0x7f55301544d0 2023-11-30T17:20:01.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.025+0000 7f5534f18700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5530155f60 con 0x7f5530066f40 2023-11-30T17:20:01.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.025+0000 7f552ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55301554a0 0x7f553014eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:01.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.025+0000 7f552ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55301554a0 0x7f553014eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35022/0 (socket says 172.21.15.49:35022) 2023-11-30T17:20:01.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.025+0000 7f552ed9d700 1 -- 172.21.15.49:0/592583161 learned_addr learned my addr 172.21.15.49:0/592583161 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:20:01.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.025+0000 7f552e59c700 1 --2- 172.21.15.49:0/592583161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5530066f40 0x7f55300c15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:01.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.025+0000 7f552dd9b700 1 --2- 172.21.15.49:0/592583161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55301544d0 0x7f55300a6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:01.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.025+0000 7f552ed9d700 1 -- 172.21.15.49:0/592583161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5530066f40 msgr2=0x7f55300c15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:01.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.025+0000 7f552ed9d700 1 --2- 172.21.15.49:0/592583161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5530066f40 0x7f55300c15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:01.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.025+0000 7f552ed9d700 1 -- 172.21.15.49:0/592583161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55301544d0 msgr2=0x7f55300a6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:01.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.025+0000 7f552ed9d700 1 --2- 172.21.15.49:0/592583161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55301544d0 0x7f55300a6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:01.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.025+0000 7f552ed9d700 1 -- 172.21.15.49:0/592583161 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5528009300 con 0x7f55301554a0 2023-11-30T17:20:01.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.025+0000 7f552ed9d700 1 --2- 172.21.15.49:0/592583161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55301554a0 0x7f553014eb00 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f5520009ec0 tx=0x7f552000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:01.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.025+0000 7f55267fc700 1 -- 172.21.15.49:0/592583161 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552000cb70 con 0x7f55301554a0 2023-11-30T17:20:01.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.025+0000 7f55267fc700 1 -- 172.21.15.49:0/592583161 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552000f040 con 0x7f55301554a0 2023-11-30T17:20:01.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.025+0000 7f5534f18700 1 -- 172.21.15.49:0/592583161 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5530156240 con 0x7f55301554a0 2023-11-30T17:20:01.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.025+0000 7f55267fc700 1 -- 172.21.15.49:0/592583161 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5520013400 con 0x7f55301554a0 2023-11-30T17:20:01.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.025+0000 7f5534f18700 1 -- 172.21.15.49:0/592583161 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55300a8a00 con 0x7f55301554a0 2023-11-30T17:20:01.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.027+0000 7f5534f18700 1 -- 172.21.15.49:0/592583161 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5530156760 con 0x7f55301554a0 2023-11-30T17:20:01.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.027+0000 7f55267fc700 1 -- 172.21.15.49:0/592583161 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f5520013770 con 0x7f55301554a0 2023-11-30T17:20:01.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.027+0000 7f55267fc700 1 --2- 172.21.15.49:0/592583161 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f551005f240 0x7f5510061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:01.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.027+0000 7f55267fc700 1 -- 172.21.15.49:0/592583161 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f552007abc0 con 0x7f55301554a0 2023-11-30T17:20:01.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.027+0000 7f552e59c700 1 --2- 172.21.15.49:0/592583161 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f551005f240 0x7f5510061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:01.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.028+0000 7f552e59c700 1 --2- 172.21.15.49:0/592583161 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f551005f240 0x7f5510061700 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f5528006c40 tx=0x7f5528016000).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:01.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.031+0000 7f55267fc700 1 -- 172.21.15.49:0/592583161 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5530156760 con 0x7f55301554a0 2023-11-30T17:20:01.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.200+0000 7f5534f18700 1 -- 172.21.15.49:0/592583161 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5530155df0 con 0x7f551005f240 2023-11-30T17:20:01.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.210+0000 7f55267fc700 1 -- 172.21.15.49:0/592583161 <== mgr.5449 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359186 (secure 0 0 0) 0x7f5530155df0 con 0x7f551005f240 2023-11-30T17:20:01.218 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:20:01.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.214+0000 7f5534f18700 1 -- 172.21.15.49:0/592583161 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f551005f240 msgr2=0x7f5510061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:01.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.214+0000 7f5534f18700 1 --2- 172.21.15.49:0/592583161 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f551005f240 0x7f5510061700 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f5528006c40 tx=0x7f5528016000).stop 2023-11-30T17:20:01.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.214+0000 7f5534f18700 1 -- 172.21.15.49:0/592583161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55301554a0 msgr2=0x7f553014eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:01.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.214+0000 7f5534f18700 1 --2- 172.21.15.49:0/592583161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55301554a0 0x7f553014eb00 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f5520009ec0 tx=0x7f552000b040).stop 2023-11-30T17:20:01.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.214+0000 7f5534f18700 1 -- 172.21.15.49:0/592583161 shutdown_connections 2023-11-30T17:20:01.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.214+0000 7f5534f18700 1 --2- 172.21.15.49:0/592583161 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f551005f240 0x7f5510061700 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:01.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.214+0000 7f5534f18700 1 --2- 172.21.15.49:0/592583161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55301554a0 0x7f553014eb00 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:01.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.214+0000 7f5534f18700 1 --2- 172.21.15.49:0/592583161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5530066f40 0x7f55300c15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:01.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.214+0000 7f5534f18700 1 --2- 172.21.15.49:0/592583161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55301544d0 0x7f55300a6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:01.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.214+0000 7f5534f18700 1 -- 172.21.15.49:0/592583161 >> 172.21.15.49:0/592583161 conn(0x7f55300631d0 msgr2=0x7f55300c3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:01.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.214+0000 7f5534f18700 1 -- 172.21.15.49:0/592583161 shutdown_connections 2023-11-30T17:20:01.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.214+0000 7f5534f18700 1 -- 172.21.15.49:0/592583161 wait complete. 2023-11-30T17:20:01.222 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:20:01.228 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-30T17:20:00.322110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2236,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":252,"acting":252,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":213,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2415544,"kb_used_data":6008,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752559176,"statfs":{"total":773094113280,"available":770620596224,"internally_reserved":0,"allocated":6152192,"data_stored":2991902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14996153,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-721,"num_write_kb":-15547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.999924"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491141+0000","last_change":"2023-11-30T17:19:56.485959+0000","last_active":"2023-11-30T17:19:56.491141+0000","last_peered":"2023-11-30T17:19:56.491141+0000","last_clean":"2023-11-30T17:19:56.491141+0000","last_became_active":"2023-11-30T17:19:56.485404+0000","last_became_peered":"2023-11-30T17:19:56.485404+0000","last_unstale":"2023-11-30T17:19:56.491141+0000","last_undegraded":"2023-11-30T17:19:56.491141+0000","last_fullsized":"2023-11-30T17:19:56.491141+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"64'3","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.497937+0000","last_change":"2023-11-30T17:19:56.097294+0000","last_active":"2023-11-30T17:19:56.497937+0000","last_peered":"2023-11-30T17:19:56.497937+0000","last_clean":"2023-11-30T17:19:56.497937+0000","last_became_active":"2023-11-30T17:19:56.097026+0000","last_became_peered":"2023-11-30T17:19:56.097026+0000","last_unstale":"2023-11-30T17:19:56.497937+0000","last_undegraded":"2023-11-30T17:19:56.497937+0000","last_fullsized":"2023-11-30T17:19:56.497937+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496181+0000","last_change":"2023-11-30T17:19:56.492152+0000","last_active":"2023-11-30T17:19:56.496181+0000","last_peered":"2023-11-30T17:19:56.496181+0000","last_clean":"2023-11-30T17:19:56.496181+0000","last_became_active":"2023-11-30T17:19:56.491843+0000","last_became_peered":"2023-11-30T17:19:56.491843+0000","last_unstale":"2023-11-30T17:19:56.496181+0000","last_undegraded":"2023-11-30T17:19:56.496181+0000","last_fullsized":"2023-11-30T17:19:56.496181+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.480790+0000","last_change":"2023-11-30T17:19:56.112352+0000","last_active":"2023-11-30T17:19:56.480790+0000","last_peered":"2023-11-30T17:19:56.480790+0000","last_clean":"2023-11-30T17:19:56.480790+0000","last_became_active":"2023-11-30T17:19:56.112039+0000","last_became_peered":"2023-11-30T17:19:56.112039+0000","last_unstale":"2023-11-30T17:19:56.480790+0000","last_undegraded":"2023-11-30T17:19:56.480790+0000","last_fullsized":"2023-11-30T17:19:56.480790+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500856+0000","last_change":"2023-11-30T17:19:56.496678+0000","last_active":"2023-11-30T17:19:56.500856+0000","last_peered":"2023-11-30T17:19:56.500856+0000","last_clean":"2023-11-30T17:19:56.500856+0000","last_became_active":"2023-11-30T17:19:56.492155+0000","last_became_peered":"2023-11-30T17:19:56.492155+0000","last_unstale":"2023-11-30T17:19:56.500856+0000","last_undegraded":"2023-11-30T17:19:56.500856+0000","last_fullsized":"2023-11-30T17:19:56.500856+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.082730+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.495745+0000","last_change":"2023-11-30T17:19:56.486081+0000","last_active":"2023-11-30T17:19:56.495745+0000","last_peered":"2023-11-30T17:19:56.495745+0000","last_clean":"2023-11-30T17:19:56.495745+0000","last_became_active":"2023-11-30T17:19:56.485781+0000","last_became_peered":"2023-11-30T17:19:56.485781+0000","last_unstale":"2023-11-30T17:19:56.495745+0000","last_undegraded":"2023-11-30T17:19:56.495745+0000","last_fullsized":"2023-11-30T17:19:56.495745+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"64'2","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.502495+0000","last_change":"2023-11-30T17:19:56.099441+0000","last_active":"2023-11-30T17:19:56.502495+0000","last_peered":"2023-11-30T17:19:56.502495+0000","last_clean":"2023-11-30T17:19:56.502495+0000","last_became_active":"2023-11-30T17:19:56.099054+0000","last_became_peered":"2023-11-30T17:19:56.099054+0000","last_unstale":"2023-11-30T17:19:56.502495+0000","last_undegraded":"2023-11-30T17:19:56.502495+0000","last_fullsized":"2023-11-30T17:19:56.502495+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493845+0000","last_change":"2023-11-30T17:19:56.492808+0000","last_active":"2023-11-30T17:19:56.493845+0000","last_peered":"2023-11-30T17:19:56.493845+0000","last_clean":"2023-11-30T17:19:56.493845+0000","last_became_active":"2023-11-30T17:19:56.492327+0000","last_became_peered":"2023-11-30T17:19:56.492327+0000","last_unstale":"2023-11-30T17:19:56.493845+0000","last_undegraded":"2023-11-30T17:19:56.493845+0000","last_fullsized":"2023-11-30T17:19:56.493845+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3b","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.490891+0000","last_change":"2023-11-30T17:19:56.112328+0000","last_active":"2023-11-30T17:19:56.490891+0000","last_peered":"2023-11-30T17:19:56.490891+0000","last_clean":"2023-11-30T17:19:56.490891+0000","last_became_active":"2023-11-30T17:19:56.112089+0000","last_became_peered":"2023-11-30T17:19:56.112089+0000","last_unstale":"2023-11-30T17:19:56.490891+0000","last_undegraded":"2023-11-30T17:19:56.490891+0000","last_fullsized":"2023-11-30T17:19:56.490891+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.492758+0000","last_change":"2023-11-30T17:19:56.489355+0000","last_active":"2023-11-30T17:19:56.492758+0000","last_peered":"2023-11-30T17:19:56.492758+0000","last_clean":"2023-11-30T17:19:56.492758+0000","last_became_active":"2023-11-30T17:19:56.489081+0000","last_became_peered":"2023-11-30T17:19:56.489081+0000","last_unstale":"2023-11-30T17:19:56.492758+0000","last_undegraded":"2023-11-30T17:19:56.492758+0000","last_fullsized":"2023-11-30T17:19:56.492758+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.489898+0000","last_change":"2023-11-30T17:19:56.095586+0000","last_active":"2023-11-30T17:19:56.489898+0000","last_peered":"2023-11-30T17:19:56.489898+0000","last_clean":"2023-11-30T17:19:56.489898+0000","last_became_active":"2023-11-30T17:19:56.095250+0000","last_became_peered":"2023-11-30T17:19:56.095250+0000","last_unstale":"2023-11-30T17:19:56.489898+0000","last_undegraded":"2023-11-30T17:19:56.489898+0000","last_fullsized":"2023-11-30T17:19:56.489898+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491110+0000","last_change":"2023-11-30T17:19:56.485707+0000","last_active":"2023-11-30T17:19:56.491110+0000","last_peered":"2023-11-30T17:19:56.491110+0000","last_clean":"2023-11-30T17:19:56.491110+0000","last_became_active":"2023-11-30T17:19:56.485420+0000","last_became_peered":"2023-11-30T17:19:56.485420+0000","last_unstale":"2023-11-30T17:19:56.491110+0000","last_undegraded":"2023-11-30T17:19:56.491110+0000","last_fullsized":"2023-11-30T17:19:56.491110+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.483241+0000","last_change":"2023-11-30T17:19:56.096279+0000","last_active":"2023-11-30T17:19:56.483241+0000","last_peered":"2023-11-30T17:19:56.483241+0000","last_clean":"2023-11-30T17:19:56.483241+0000","last_became_active":"2023-11-30T17:19:56.095989+0000","last_became_peered":"2023-11-30T17:19:56.095989+0000","last_unstale":"2023-11-30T17:19:56.483241+0000","last_undegraded":"2023-11-30T17:19:56.483241+0000","last_fullsized":"2023-11-30T17:19:56.483241+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.503846+0000","last_change":"2023-11-30T17:19:56.501562+0000","last_active":"2023-11-30T17:19:56.503846+0000","last_peered":"2023-11-30T17:19:56.503846+0000","last_clean":"2023-11-30T17:19:56.503846+0000","last_became_active":"2023-11-30T17:19:56.501259+0000","last_became_peered":"2023-11-30T17:19:56.501259+0000","last_unstale":"2023-11-30T17:19:56.503846+0000","last_undegraded":"2023-11-30T17:19:56.503846+0000","last_fullsized":"2023-11-30T17:19:56.503846+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.487885+0000","last_change":"2023-11-30T17:19:56.105956+0000","last_active":"2023-11-30T17:19:56.487885+0000","last_peered":"2023-11-30T17:19:56.487885+0000","last_clean":"2023-11-30T17:19:56.487885+0000","last_became_active":"2023-11-30T17:19:56.102562+0000","last_became_peered":"2023-11-30T17:19:56.102562+0000","last_unstale":"2023-11-30T17:19:56.487885+0000","last_undegraded":"2023-11-30T17:19:56.487885+0000","last_fullsized":"2023-11-30T17:19:56.487885+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496983+0000","last_change":"2023-11-30T17:19:56.495039+0000","last_active":"2023-11-30T17:19:56.496983+0000","last_peered":"2023-11-30T17:19:56.496983+0000","last_clean":"2023-11-30T17:19:56.496983+0000","last_became_active":"2023-11-30T17:19:56.494575+0000","last_became_peered":"2023-11-30T17:19:56.494575+0000","last_unstale":"2023-11-30T17:19:56.496983+0000","last_undegraded":"2023-11-30T17:19:56.496983+0000","last_fullsized":"2023-11-30T17:19:56.496983+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.499089+0000","last_change":"2023-11-30T17:19:56.110873+0000","last_active":"2023-11-30T17:19:56.499089+0000","last_peered":"2023-11-30T17:19:56.499089+0000","last_clean":"2023-11-30T17:19:56.499089+0000","last_became_active":"2023-11-30T17:19:56.110385+0000","last_became_peered":"2023-11-30T17:19:56.110385+0000","last_unstale":"2023-11-30T17:19:56.499089+0000","last_undegraded":"2023-11-30T17:19:56.499089+0000","last_fullsized":"2023-11-30T17:19:56.499089+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500826+0000","last_change":"2023-11-30T17:19:56.496567+0000","last_active":"2023-11-30T17:19:56.500826+0000","last_peered":"2023-11-30T17:19:56.500826+0000","last_clean":"2023-11-30T17:19:56.500826+0000","last_became_active":"2023-11-30T17:19:56.496282+0000","last_became_peered":"2023-11-30T17:19:56.496282+0000","last_unstale":"2023-11-30T17:19:56.500826+0000","last_undegraded":"2023-11-30T17:19:56.500826+0000","last_fullsized":"2023-11-30T17:19:56.500826+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.494906+0000","last_change":"2023-11-30T17:19:56.105548+0000","last_active":"2023-11-30T17:19:56.494906+0000","last_peered":"2023-11-30T17:19:56.494906+0000","last_clean":"2023-11-30T17:19:56.494906+0000","last_became_active":"2023-11-30T17:19:56.099867+0000","last_became_peered":"2023-11-30T17:19:56.099867+0000","last_unstale":"2023-11-30T17:19:56.494906+0000","last_undegraded":"2023-11-30T17:19:56.494906+0000","last_fullsized":"2023-11-30T17:19:56.494906+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.495750+0000","last_change":"2023-11-30T17:19:56.490226+0000","last_active":"2023-11-30T17:19:56.495750+0000","last_peered":"2023-11-30T17:19:56.495750+0000","last_clean":"2023-11-30T17:19:56.495750+0000","last_became_active":"2023-11-30T17:19:56.490008+0000","last_became_peered":"2023-11-30T17:19:56.490008+0000","last_unstale":"2023-11-30T17:19:56.495750+0000","last_undegraded":"2023-11-30T17:19:56.495750+0000","last_fullsized":"2023-11-30T17:19:56.495750+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498921+0000","last_change":"2023-11-30T17:19:56.110057+0000","last_active":"2023-11-30T17:19:56.498921+0000","last_peered":"2023-11-30T17:19:56.498921+0000","last_clean":"2023-11-30T17:19:56.498921+0000","last_became_active":"2023-11-30T17:19:56.109561+0000","last_became_peered":"2023-11-30T17:19:56.109561+0000","last_unstale":"2023-11-30T17:19:56.498921+0000","last_undegraded":"2023-11-30T17:19:56.498921+0000","last_fullsized":"2023-11-30T17:19:56.498921+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"64'4","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498286+0000","last_change":"2023-11-30T17:19:56.099632+0000","last_active":"2023-11-30T17:19:56.498286+0000","last_peered":"2023-11-30T17:19:56.498286+0000","last_clean":"2023-11-30T17:19:56.498286+0000","last_became_active":"2023-11-30T17:19:56.099366+0000","last_became_peered":"2023-11-30T17:19:56.099366+0000","last_unstale":"2023-11-30T17:19:56.498286+0000","last_undegraded":"2023-11-30T17:19:56.498286+0000","last_fullsized":"2023-11-30T17:19:56.498286+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.492794+0000","last_change":"2023-11-30T17:19:56.490274+0000","last_active":"2023-11-30T17:19:56.492794+0000","last_peered":"2023-11-30T17:19:56.492794+0000","last_clean":"2023-11-30T17:19:56.492794+0000","last_became_active":"2023-11-30T17:19:56.490014+0000","last_became_peered":"2023-11-30T17:19:56.490014+0000","last_unstale":"2023-11-30T17:19:56.492794+0000","last_undegraded":"2023-11-30T17:19:56.492794+0000","last_fullsized":"2023-11-30T17:19:56.492794+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.492148+0000","last_change":"2023-11-30T17:19:56.104864+0000","last_active":"2023-11-30T17:19:56.492148+0000","last_peered":"2023-11-30T17:19:56.492148+0000","last_clean":"2023-11-30T17:19:56.492148+0000","last_became_active":"2023-11-30T17:19:56.104590+0000","last_became_peered":"2023-11-30T17:19:56.104590+0000","last_unstale":"2023-11-30T17:19:56.492148+0000","last_undegraded":"2023-11-30T17:19:56.492148+0000","last_fullsized":"2023-11-30T17:19:56.492148+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.502029+0000","last_change":"2023-11-30T17:19:56.499597+0000","last_active":"2023-11-30T17:19:56.502029+0000","last_peered":"2023-11-30T17:19:56.502029+0000","last_clean":"2023-11-30T17:19:56.502029+0000","last_became_active":"2023-11-30T17:19:56.499146+0000","last_became_peered":"2023-11-30T17:19:56.499146+0000","last_unstale":"2023-11-30T17:19:56.502029+0000","last_undegraded":"2023-11-30T17:19:56.502029+0000","last_fullsized":"2023-11-30T17:19:56.502029+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.487477+0000","last_change":"2023-11-30T17:19:56.110204+0000","last_active":"2023-11-30T17:19:56.487477+0000","last_peered":"2023-11-30T17:19:56.487477+0000","last_clean":"2023-11-30T17:19:56.487477+0000","last_became_active":"2023-11-30T17:19:56.109745+0000","last_became_peered":"2023-11-30T17:19:56.109745+0000","last_unstale":"2023-11-30T17:19:56.487477+0000","last_undegraded":"2023-11-30T17:19:56.487477+0000","last_fullsized":"2023-11-30T17:19:56.487477+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498693+0000","last_change":"2023-11-30T17:19:56.494965+0000","last_active":"2023-11-30T17:19:56.498693+0000","last_peered":"2023-11-30T17:19:56.498693+0000","last_clean":"2023-11-30T17:19:56.498693+0000","last_became_active":"2023-11-30T17:19:56.494662+0000","last_became_peered":"2023-11-30T17:19:56.494662+0000","last_unstale":"2023-11-30T17:19:56.498693+0000","last_undegraded":"2023-11-30T17:19:56.498693+0000","last_fullsized":"2023-11-30T17:19:56.498693+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.476196+0000","last_change":"2023-11-30T17:19:56.100686+0000","last_active":"2023-11-30T17:19:56.476196+0000","last_peered":"2023-11-30T17:19:56.476196+0000","last_clean":"2023-11-30T17:19:56.476196+0000","last_became_active":"2023-11-30T17:19:56.100418+0000","last_became_peered":"2023-11-30T17:19:56.100418+0000","last_unstale":"2023-11-30T17:19:56.476196+0000","last_undegraded":"2023-11-30T17:19:56.476196+0000","last_fullsized":"2023-11-30T17:19:56.476196+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496351+0000","last_change":"2023-11-30T17:19:56.493474+0000","last_active":"2023-11-30T17:19:56.496351+0000","last_peered":"2023-11-30T17:19:56.496351+0000","last_clean":"2023-11-30T17:19:56.496351+0000","last_became_active":"2023-11-30T17:19:56.493191+0000","last_became_peered":"2023-11-30T17:19:56.493191+0000","last_unstale":"2023-11-30T17:19:56.496351+0000","last_undegraded":"2023-11-30T17:19:56.496351+0000","last_fullsized":"2023-11-30T17:19:56.496351+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.077396+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493563+0000","last_change":"2023-11-30T17:19:56.486088+0000","last_active":"2023-11-30T17:19:56.493563+0000","last_peered":"2023-11-30T17:19:56.493563+0000","last_clean":"2023-11-30T17:19:56.493563+0000","last_became_active":"2023-11-30T17:19:56.485651+0000","last_became_peered":"2023-11-30T17:19:56.485651+0000","last_unstale":"2023-11-30T17:19:56.493563+0000","last_undegraded":"2023-11-30T17:19:56.493563+0000","last_fullsized":"2023-11-30T17:19:56.493563+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.083264+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.495220+0000","last_change":"2023-11-30T17:19:56.491494+0000","last_active":"2023-11-30T17:19:56.495220+0000","last_peered":"2023-11-30T17:19:56.495220+0000","last_clean":"2023-11-30T17:19:56.495220+0000","last_became_active":"2023-11-30T17:19:56.491200+0000","last_became_peered":"2023-11-30T17:19:56.491200+0000","last_unstale":"2023-11-30T17:19:56.495220+0000","last_undegraded":"2023-11-30T17:19:56.495220+0000","last_fullsized":"2023-11-30T17:19:56.495220+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.084005+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.499018+0000","last_change":"2023-11-30T17:19:56.496795+0000","last_active":"2023-11-30T17:19:56.499018+0000","last_peered":"2023-11-30T17:19:56.499018+0000","last_clean":"2023-11-30T17:19:56.499018+0000","last_became_active":"2023-11-30T17:19:56.496519+0000","last_became_peered":"2023-11-30T17:19:56.496519+0000","last_unstale":"2023-11-30T17:19:56.499018+0000","last_undegraded":"2023-11-30T17:19:56.499018+0000","last_fullsized":"2023-11-30T17:19:56.499018+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.078100+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500642+0000","last_change":"2023-11-30T17:19:56.494936+0000","last_active":"2023-11-30T17:19:56.500642+0000","last_peered":"2023-11-30T17:19:56.500642+0000","last_clean":"2023-11-30T17:19:56.500642+0000","last_became_active":"2023-11-30T17:19:56.494628+0000","last_became_peered":"2023-11-30T17:19:56.494628+0000","last_unstale":"2023-11-30T17:19:56.500642+0000","last_undegraded":"2023-11-30T17:19:56.500642+0000","last_fullsized":"2023-11-30T17:19:56.500642+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.476989+0000","last_change":"2023-11-30T17:19:56.103835+0000","last_active":"2023-11-30T17:19:56.476989+0000","last_peered":"2023-11-30T17:19:56.476989+0000","last_clean":"2023-11-30T17:19:56.476989+0000","last_became_active":"2023-11-30T17:19:56.103532+0000","last_became_peered":"2023-11-30T17:19:56.103532+0000","last_unstale":"2023-11-30T17:19:56.476989+0000","last_undegraded":"2023-11-30T17:19:56.476989+0000","last_fullsized":"2023-11-30T17:19:56.476989+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.488294+0000","last_change":"2023-11-30T17:19:56.105248+0000","last_active":"2023-11-30T17:19:56.488294+0000","last_peered":"2023-11-30T17:19:56.488294+0000","last_clean":"2023-11-30T17:19:56.488294+0000","last_became_active":"2023-11-30T17:19:56.104768+0000","last_became_peered":"2023-11-30T17:19:56.104768+0000","last_unstale":"2023-11-30T17:19:56.488294+0000","last_undegraded":"2023-11-30T17:19:56.488294+0000","last_fullsized":"2023-11-30T17:19:56.488294+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496346+0000","last_change":"2023-11-30T17:19:56.490952+0000","last_active":"2023-11-30T17:19:56.496346+0000","last_peered":"2023-11-30T17:19:56.496346+0000","last_clean":"2023-11-30T17:19:56.496346+0000","last_became_active":"2023-11-30T17:19:56.490730+0000","last_became_peered":"2023-11-30T17:19:56.490730+0000","last_unstale":"2023-11-30T17:19:56.496346+0000","last_undegraded":"2023-11-30T17:19:56.496346+0000","last_fullsized":"2023-11-30T17:19:56.496346+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.487354+0000","last_change":"2023-11-30T17:19:56.105606+0000","last_active":"2023-11-30T17:19:56.487354+0000","last_peered":"2023-11-30T17:19:56.487354+0000","last_clean":"2023-11-30T17:19:56.487354+0000","last_became_active":"2023-11-30T17:19:56.104380+0000","last_became_peered":"2023-11-30T17:19:56.104380+0000","last_unstale":"2023-11-30T17:19:56.487354+0000","last_undegraded":"2023-11-30T17:19:56.487354+0000","last_fullsized":"2023-11-30T17:19:56.487354+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491376+0000","last_change":"2023-11-30T17:19:56.488970+0000","last_active":"2023-11-30T17:19:56.491376+0000","last_peered":"2023-11-30T17:19:56.491376+0000","last_clean":"2023-11-30T17:19:56.491376+0000","last_became_active":"2023-11-30T17:19:56.488343+0000","last_became_peered":"2023-11-30T17:19:56.488343+0000","last_unstale":"2023-11-30T17:19:56.491376+0000","last_undegraded":"2023-11-30T17:19:56.491376+0000","last_fullsized":"2023-11-30T17:19:56.491376+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.077908+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498741+0000","last_change":"2023-11-30T17:19:56.490432+0000","last_active":"2023-11-30T17:19:56.498741+0000","last_peered":"2023-11-30T17:19:56.498741+0000","last_clean":"2023-11-30T17:19:56.498741+0000","last_became_active":"2023-11-30T17:19:56.490159+0000","last_became_peered":"2023-11-30T17:19:56.490159+0000","last_unstale":"2023-11-30T17:19:56.498741+0000","last_undegraded":"2023-11-30T17:19:56.498741+0000","last_fullsized":"2023-11-30T17:19:56.498741+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.076864+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.494582+0000","last_change":"2023-11-30T17:19:56.490029+0000","last_active":"2023-11-30T17:19:56.494582+0000","last_peered":"2023-11-30T17:19:56.494582+0000","last_clean":"2023-11-30T17:19:56.494582+0000","last_became_active":"2023-11-30T17:19:56.488809+0000","last_became_peered":"2023-11-30T17:19:56.488809+0000","last_unstale":"2023-11-30T17:19:56.494582+0000","last_undegraded":"2023-11-30T17:19:56.494582+0000","last_fullsized":"2023-11-30T17:19:56.494582+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.079249+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493787+0000","last_change":"2023-11-30T17:19:56.492227+0000","last_active":"2023-11-30T17:19:56.493787+0000","last_peered":"2023-11-30T17:19:56.493787+0000","last_clean":"2023-11-30T17:19:56.493787+0000","last_became_active":"2023-11-30T17:19:56.491955+0000","last_became_peered":"2023-11-30T17:19:56.491955+0000","last_unstale":"2023-11-30T17:19:56.493787+0000","last_undegraded":"2023-11-30T17:19:56.493787+0000","last_fullsized":"2023-11-30T17:19:56.493787+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.475983+0000","last_change":"2023-11-30T17:19:56.105360+0000","last_active":"2023-11-30T17:19:56.475983+0000","last_peered":"2023-11-30T17:19:56.475983+0000","last_clean":"2023-11-30T17:19:56.475983+0000","last_became_active":"2023-11-30T17:19:56.105084+0000","last_became_peered":"2023-11-30T17:19:56.105084+0000","last_unstale":"2023-11-30T17:19:56.475983+0000","last_undegraded":"2023-11-30T17:19:56.475983+0000","last_fullsized":"2023-11-30T17:19:56.475983+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491335+0000","last_change":"2023-11-30T17:19:56.488160+0000","last_active":"2023-11-30T17:19:56.491335+0000","last_peered":"2023-11-30T17:19:56.491335+0000","last_clean":"2023-11-30T17:19:56.491335+0000","last_became_active":"2023-11-30T17:19:56.487871+0000","last_became_peered":"2023-11-30T17:19:56.487871+0000","last_unstale":"2023-11-30T17:19:56.491335+0000","last_undegraded":"2023-11-30T17:19:56.491335+0000","last_fullsized":"2023-11-30T17:19:56.491335+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.082342+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.479299+0000","last_change":"2023-11-30T17:19:56.098747+0000","last_active":"2023-11-30T17:19:56.479299+0000","last_peered":"2023-11-30T17:19:56.479299+0000","last_clean":"2023-11-30T17:19:56.479299+0000","last_became_active":"2023-11-30T17:19:56.098096+0000","last_became_peered":"2023-11-30T17:19:56.098096+0000","last_unstale":"2023-11-30T17:19:56.479299+0000","last_undegraded":"2023-11-30T17:19:56.479299+0000","last_fullsized":"2023-11-30T17:19:56.479299+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.076958+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.502012+0000","last_change":"2023-11-30T17:19:56.499411+0000","last_active":"2023-11-30T17:19:56.502012+0000","last_peered":"2023-11-30T17:19:56.502012+0000","last_clean":"2023-11-30T17:19:56.502012+0000","last_became_active":"2023-11-30T17:19:56.497013+0000","last_became_peered":"2023-11-30T17:19:56.497013+0000","last_unstale":"2023-11-30T17:19:56.502012+0000","last_undegraded":"2023-11-30T17:19:56.502012+0000","last_fullsized":"2023-11-30T17:19:56.502012+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.082939+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498714+0000","last_change":"2023-11-30T17:19:56.495065+0000","last_active":"2023-11-30T17:19:56.498714+0000","last_peered":"2023-11-30T17:19:56.498714+0000","last_clean":"2023-11-30T17:19:56.498714+0000","last_became_active":"2023-11-30T17:19:56.494734+0000","last_became_peered":"2023-11-30T17:19:56.494734+0000","last_unstale":"2023-11-30T17:19:56.498714+0000","last_undegraded":"2023-11-30T17:19:56.498714+0000","last_fullsized":"2023-11-30T17:19:56.498714+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.476094+0000","last_change":"2023-11-30T17:19:56.100559+0000","last_active":"2023-11-30T17:19:56.476094+0000","last_peered":"2023-11-30T17:19:56.476094+0000","last_clean":"2023-11-30T17:19:56.476094+0000","last_became_active":"2023-11-30T17:19:56.100267+0000","last_became_peered":"2023-11-30T17:19:56.100267+0000","last_unstale":"2023-11-30T17:19:56.476094+0000","last_undegraded":"2023-11-30T17:19:56.476094+0000","last_fullsized":"2023-11-30T17:19:56.476094+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.502077+0000","last_change":"2023-11-30T17:19:56.499755+0000","last_active":"2023-11-30T17:19:56.502077+0000","last_peered":"2023-11-30T17:19:56.502077+0000","last_clean":"2023-11-30T17:19:56.502077+0000","last_became_active":"2023-11-30T17:19:56.499465+0000","last_became_peered":"2023-11-30T17:19:56.499465+0000","last_unstale":"2023-11-30T17:19:56.502077+0000","last_undegraded":"2023-11-30T17:19:56.502077+0000","last_fullsized":"2023-11-30T17:19:56.502077+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.477375+0000","last_change":"2023-11-30T17:19:56.088985+0000","last_active":"2023-11-30T17:19:56.477375+0000","last_peered":"2023-11-30T17:19:56.477375+0000","last_clean":"2023-11-30T17:19:56.477375+0000","last_became_active":"2023-11-30T17:19:56.088686+0000","last_became_peered":"2023-11-30T17:19:56.088686+0000","last_unstale":"2023-11-30T17:19:56.477375+0000","last_undegraded":"2023-11-30T17:19:56.477375+0000","last_fullsized":"2023-11-30T17:19:56.477375+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.499116+0000","last_change":"2023-11-30T17:19:56.495412+0000","last_active":"2023-11-30T17:19:56.499116+0000","last_peered":"2023-11-30T17:19:56.499116+0000","last_clean":"2023-11-30T17:19:56.499116+0000","last_became_active":"2023-11-30T17:19:56.494719+0000","last_became_peered":"2023-11-30T17:19:56.494719+0000","last_unstale":"2023-11-30T17:19:56.499116+0000","last_undegraded":"2023-11-30T17:19:56.499116+0000","last_fullsized":"2023-11-30T17:19:56.499116+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.078834+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.497842+0000","last_change":"2023-11-30T17:19:56.496872+0000","last_active":"2023-11-30T17:19:56.497842+0000","last_peered":"2023-11-30T17:19:56.497842+0000","last_clean":"2023-11-30T17:19:56.497842+0000","last_became_active":"2023-11-30T17:19:56.496614+0000","last_became_peered":"2023-11-30T17:19:56.496614+0000","last_unstale":"2023-11-30T17:19:56.497842+0000","last_undegraded":"2023-11-30T17:19:56.497842+0000","last_fullsized":"2023-11-30T17:19:56.497842+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491029+0000","last_change":"2023-11-30T17:19:56.104114+0000","last_active":"2023-11-30T17:19:56.491029+0000","last_peered":"2023-11-30T17:19:56.491029+0000","last_clean":"2023-11-30T17:19:56.491029+0000","last_became_active":"2023-11-30T17:19:56.103835+0000","last_became_peered":"2023-11-30T17:19:56.103835+0000","last_unstale":"2023-11-30T17:19:56.491029+0000","last_undegraded":"2023-11-30T17:19:56.491029+0000","last_fullsized":"2023-11-30T17:19:56.491029+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"64'2","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500313+0000","last_change":"2023-11-30T17:19:56.087339+0000","last_active":"2023-11-30T17:19:56.500313+0000","last_peered":"2023-11-30T17:19:56.500313+0000","last_clean":"2023-11-30T17:19:56.500313+0000","last_became_active":"2023-11-30T17:19:56.086993+0000","last_became_peered":"2023-11-30T17:19:56.086993+0000","last_unstale":"2023-11-30T17:19:56.500313+0000","last_undegraded":"2023-11-30T17:19:56.500313+0000","last_fullsized":"2023-11-30T17:19:56.500313+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491920+0000","last_change":"2023-11-30T17:19:56.489159+0000","last_active":"2023-11-30T17:19:56.491920+0000","last_peered":"2023-11-30T17:19:56.491920+0000","last_clean":"2023-11-30T17:19:56.491920+0000","last_became_active":"2023-11-30T17:19:56.488952+0000","last_became_peered":"2023-11-30T17:19:56.488952+0000","last_unstale":"2023-11-30T17:19:56.491920+0000","last_undegraded":"2023-11-30T17:19:56.491920+0000","last_fullsized":"2023-11-30T17:19:56.491920+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.479404+0000","last_change":"2023-11-30T17:19:56.098371+0000","last_active":"2023-11-30T17:19:56.479404+0000","last_peered":"2023-11-30T17:19:56.479404+0000","last_clean":"2023-11-30T17:19:56.479404+0000","last_became_active":"2023-11-30T17:19:56.097768+0000","last_became_peered":"2023-11-30T17:19:56.097768+0000","last_unstale":"2023-11-30T17:19:56.479404+0000","last_undegraded":"2023-11-30T17:19:56.479404+0000","last_fullsized":"2023-11-30T17:19:56.479404+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.494168+0000","last_change":"2023-11-30T17:19:56.107222+0000","last_active":"2023-11-30T17:19:56.494168+0000","last_peered":"2023-11-30T17:19:56.494168+0000","last_clean":"2023-11-30T17:19:56.494168+0000","last_became_active":"2023-11-30T17:19:56.106944+0000","last_became_peered":"2023-11-30T17:19:56.106944+0000","last_unstale":"2023-11-30T17:19:56.494168+0000","last_undegraded":"2023-11-30T17:19:56.494168+0000","last_fullsized":"2023-11-30T17:19:56.494168+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.499076+0000","last_change":"2023-11-30T17:19:56.497589+0000","last_active":"2023-11-30T17:19:56.499076+0000","last_peered":"2023-11-30T17:19:56.499076+0000","last_clean":"2023-11-30T17:19:56.499076+0000","last_became_active":"2023-11-30T17:19:56.497315+0000","last_became_peered":"2023-11-30T17:19:56.497315+0000","last_unstale":"2023-11-30T17:19:56.499076+0000","last_undegraded":"2023-11-30T17:19:56.499076+0000","last_fullsized":"2023-11-30T17:19:56.499076+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.082279+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491354+0000","last_change":"2023-11-30T17:19:56.488325+0000","last_active":"2023-11-30T17:19:56.491354+0000","last_peered":"2023-11-30T17:19:56.491354+0000","last_clean":"2023-11-30T17:19:56.491354+0000","last_became_active":"2023-11-30T17:19:56.488024+0000","last_became_peered":"2023-11-30T17:19:56.488024+0000","last_unstale":"2023-11-30T17:19:56.491354+0000","last_undegraded":"2023-11-30T17:19:56.491354+0000","last_fullsized":"2023-11-30T17:19:56.491354+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.077413+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.502394+0000","last_change":"2023-11-30T17:19:56.501622+0000","last_active":"2023-11-30T17:19:56.502394+0000","last_peered":"2023-11-30T17:19:56.502394+0000","last_clean":"2023-11-30T17:19:56.502394+0000","last_became_active":"2023-11-30T17:19:56.501307+0000","last_became_peered":"2023-11-30T17:19:56.501307+0000","last_unstale":"2023-11-30T17:19:56.502394+0000","last_undegraded":"2023-11-30T17:19:56.502394+0000","last_fullsized":"2023-11-30T17:19:56.502394+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.487985+0000","last_change":"2023-11-30T17:19:56.104353+0000","last_active":"2023-11-30T17:19:56.487985+0000","last_peered":"2023-11-30T17:19:56.487985+0000","last_clean":"2023-11-30T17:19:56.487985+0000","last_became_active":"2023-11-30T17:19:56.102240+0000","last_became_peered":"2023-11-30T17:19:56.102240+0000","last_unstale":"2023-11-30T17:19:56.487985+0000","last_undegraded":"2023-11-30T17:19:56.487985+0000","last_fullsized":"2023-11-30T17:19:56.487985+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.484948+0000","last_change":"2023-11-30T17:19:56.103000+0000","last_active":"2023-11-30T17:19:56.484948+0000","last_peered":"2023-11-30T17:19:56.484948+0000","last_clean":"2023-11-30T17:19:56.484948+0000","last_became_active":"2023-11-30T17:19:56.102778+0000","last_became_peered":"2023-11-30T17:19:56.102778+0000","last_unstale":"2023-11-30T17:19:56.484948+0000","last_undegraded":"2023-11-30T17:19:56.484948+0000","last_fullsized":"2023-11-30T17:19:56.484948+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.494098+0000","last_change":"2023-11-30T17:19:56.490277+0000","last_active":"2023-11-30T17:19:56.494098+0000","last_peered":"2023-11-30T17:19:56.494098+0000","last_clean":"2023-11-30T17:19:56.494098+0000","last_became_active":"2023-11-30T17:19:56.490009+0000","last_became_peered":"2023-11-30T17:19:56.490009+0000","last_unstale":"2023-11-30T17:19:56.494098+0000","last_undegraded":"2023-11-30T17:19:56.494098+0000","last_fullsized":"2023-11-30T17:19:56.494098+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.083351+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.501207+0000","last_change":"2023-11-30T17:19:56.499008+0000","last_active":"2023-11-30T17:19:56.501207+0000","last_peered":"2023-11-30T17:19:56.501207+0000","last_clean":"2023-11-30T17:19:56.501207+0000","last_became_active":"2023-11-30T17:19:56.498726+0000","last_became_peered":"2023-11-30T17:19:56.498726+0000","last_unstale":"2023-11-30T17:19:56.501207+0000","last_undegraded":"2023-11-30T17:19:56.501207+0000","last_fullsized":"2023-11-30T17:19:56.501207+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"64'3","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.497982+0000","last_change":"2023-11-30T17:19:56.099588+0000","last_active":"2023-11-30T17:19:56.497982+0000","last_peered":"2023-11-30T17:19:56.497982+0000","last_clean":"2023-11-30T17:19:56.497982+0000","last_became_active":"2023-11-30T17:19:56.099307+0000","last_became_peered":"2023-11-30T17:19:56.099307+0000","last_unstale":"2023-11-30T17:19:56.497982+0000","last_undegraded":"2023-11-30T17:19:56.497982+0000","last_fullsized":"2023-11-30T17:19:56.497982+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"64'2","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493354+0000","last_change":"2023-11-30T17:19:56.099031+0000","last_active":"2023-11-30T17:19:56.493354+0000","last_peered":"2023-11-30T17:19:56.493354+0000","last_clean":"2023-11-30T17:19:56.493354+0000","last_became_active":"2023-11-30T17:19:56.098676+0000","last_became_peered":"2023-11-30T17:19:56.098676+0000","last_unstale":"2023-11-30T17:19:56.493354+0000","last_undegraded":"2023-11-30T17:19:56.493354+0000","last_fullsized":"2023-11-30T17:19:56.493354+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498229+0000","last_change":"2023-11-30T17:19:56.493423+0000","last_active":"2023-11-30T17:19:56.498229+0000","last_peered":"2023-11-30T17:19:56.498229+0000","last_clean":"2023-11-30T17:19:56.498229+0000","last_became_active":"2023-11-30T17:19:56.493141+0000","last_became_peered":"2023-11-30T17:19:56.493141+0000","last_unstale":"2023-11-30T17:19:56.498229+0000","last_undegraded":"2023-11-30T17:19:56.498229+0000","last_fullsized":"2023-11-30T17:19:56.498229+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.501063+0000","last_change":"2023-11-30T17:19:56.106743+0000","last_active":"2023-11-30T17:19:56.501063+0000","last_peered":"2023-11-30T17:19:56.501063+0000","last_clean":"2023-11-30T17:19:56.501063+0000","last_became_active":"2023-11-30T17:19:56.106450+0000","last_became_peered":"2023-11-30T17:19:56.106450+0000","last_unstale":"2023-11-30T17:19:56.501063+0000","last_undegraded":"2023-11-30T17:19:56.501063+0000","last_fullsized":"2023-11-30T17:19:56.501063+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500981+0000","last_change":"2023-11-30T17:19:56.497411+0000","last_active":"2023-11-30T17:19:56.500981+0000","last_peered":"2023-11-30T17:19:56.500981+0000","last_clean":"2023-11-30T17:19:56.500981+0000","last_became_active":"2023-11-30T17:19:56.487506+0000","last_became_peered":"2023-11-30T17:19:56.487506+0000","last_unstale":"2023-11-30T17:19:56.500981+0000","last_undegraded":"2023-11-30T17:19:56.500981+0000","last_fullsized":"2023-11-30T17:19:56.500981+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.078221+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491429+0000","last_change":"2023-11-30T17:19:56.490367+0000","last_active":"2023-11-30T17:19:56.491429+0000","last_peered":"2023-11-30T17:19:56.491429+0000","last_clean":"2023-11-30T17:19:56.491429+0000","last_became_active":"2023-11-30T17:19:56.490117+0000","last_became_peered":"2023-11-30T17:19:56.490117+0000","last_unstale":"2023-11-30T17:19:56.491429+0000","last_undegraded":"2023-11-30T17:19:56.491429+0000","last_fullsized":"2023-11-30T17:19:56.491429+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.483337+0000","last_change":"2023-11-30T17:19:56.100665+0000","last_active":"2023-11-30T17:19:56.483337+0000","last_peered":"2023-11-30T17:19:56.483337+0000","last_clean":"2023-11-30T17:19:56.483337+0000","last_became_active":"2023-11-30T17:19:56.100289+0000","last_became_peered":"2023-11-30T17:19:56.100289+0000","last_unstale":"2023-11-30T17:19:56.483337+0000","last_undegraded":"2023-11-30T17:19:56.483337+0000","last_fullsized":"2023-11-30T17:19:56.483337+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.501995+0000","last_change":"2023-11-30T17:19:56.499238+0000","last_active":"2023-11-30T17:19:56.501995+0000","last_peered":"2023-11-30T17:19:56.501995+0000","last_clean":"2023-11-30T17:19:56.501995+0000","last_became_active":"2023-11-30T17:19:56.498862+0000","last_became_peered":"2023-11-30T17:19:56.498862+0000","last_unstale":"2023-11-30T17:19:56.501995+0000","last_undegraded":"2023-11-30T17:19:56.501995+0000","last_fullsized":"2023-11-30T17:19:56.501995+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"64'4","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493785+0000","last_change":"2023-11-30T17:19:56.104095+0000","last_active":"2023-11-30T17:19:56.493785+0000","last_peered":"2023-11-30T17:19:56.493785+0000","last_clean":"2023-11-30T17:19:56.493785+0000","last_became_active":"2023-11-30T17:19:56.103816+0000","last_became_peered":"2023-11-30T17:19:56.103816+0000","last_unstale":"2023-11-30T17:19:56.493785+0000","last_undegraded":"2023-11-30T17:19:56.493785+0000","last_fullsized":"2023-11-30T17:19:56.493785+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496102+0000","last_change":"2023-11-30T17:19:56.494855+0000","last_active":"2023-11-30T17:19:56.496102+0000","last_peered":"2023-11-30T17:19:56.496102+0000","last_clean":"2023-11-30T17:19:56.496102+0000","last_became_active":"2023-11-30T17:19:56.494231+0000","last_became_peered":"2023-11-30T17:19:56.494231+0000","last_unstale":"2023-11-30T17:19:56.496102+0000","last_undegraded":"2023-11-30T17:19:56.496102+0000","last_fullsized":"2023-11-30T17:19:56.496102+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.504017+0000","last_change":"2023-11-30T17:19:56.108216+0000","last_active":"2023-11-30T17:19:56.504017+0000","last_peered":"2023-11-30T17:19:56.504017+0000","last_clean":"2023-11-30T17:19:56.504017+0000","last_became_active":"2023-11-30T17:19:56.107938+0000","last_became_peered":"2023-11-30T17:19:56.107938+0000","last_unstale":"2023-11-30T17:19:56.504017+0000","last_undegraded":"2023-11-30T17:19:56.504017+0000","last_fullsized":"2023-11-30T17:19:56.504017+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.495894+0000","last_change":"2023-11-30T17:19:56.490237+0000","last_active":"2023-11-30T17:19:56.495894+0000","last_peered":"2023-11-30T17:19:56.495894+0000","last_clean":"2023-11-30T17:19:56.495894+0000","last_became_active":"2023-11-30T17:19:56.489940+0000","last_became_peered":"2023-11-30T17:19:56.489940+0000","last_unstale":"2023-11-30T17:19:56.495894+0000","last_undegraded":"2023-11-30T17:19:56.495894+0000","last_fullsized":"2023-11-30T17:19:56.495894+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"64'2","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.492593+0000","last_change":"2023-11-30T17:19:56.100743+0000","last_active":"2023-11-30T17:19:56.492593+0000","last_peered":"2023-11-30T17:19:56.492593+0000","last_clean":"2023-11-30T17:19:56.492593+0000","last_became_active":"2023-11-30T17:19:56.100431+0000","last_became_peered":"2023-11-30T17:19:56.100431+0000","last_unstale":"2023-11-30T17:19:56.492593+0000","last_undegraded":"2023-11-30T17:19:56.492593+0000","last_fullsized":"2023-11-30T17:19:56.492593+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.077671+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496432+0000","last_change":"2023-11-30T17:19:56.493539+0000","last_active":"2023-11-30T17:19:56.496432+0000","last_peered":"2023-11-30T17:19:56.496432+0000","last_clean":"2023-11-30T17:19:56.496432+0000","last_became_active":"2023-11-30T17:19:56.493211+0000","last_became_peered":"2023-11-30T17:19:56.493211+0000","last_unstale":"2023-11-30T17:19:56.496432+0000","last_undegraded":"2023-11-30T17:19:56.496432+0000","last_fullsized":"2023-11-30T17:19:56.496432+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.078432+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498207+0000","last_change":"2023-11-30T17:19:56.492263+0000","last_active":"2023-11-30T17:19:56.498207+0000","last_peered":"2023-11-30T17:19:56.498207+0000","last_clean":"2023-11-30T17:19:56.498207+0000","last_became_active":"2023-11-30T17:19:56.491997+0000","last_became_peered":"2023-11-30T17:19:56.491997+0000","last_unstale":"2023-11-30T17:19:56.498207+0000","last_undegraded":"2023-11-30T17:19:56.498207+0000","last_fullsized":"2023-11-30T17:19:56.498207+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493638+0000","last_change":"2023-11-30T17:19:56.101187+0000","last_active":"2023-11-30T17:19:56.493638+0000","last_peered":"2023-11-30T17:19:56.493638+0000","last_clean":"2023-11-30T17:19:56.493638+0000","last_became_active":"2023-11-30T17:19:56.100914+0000","last_became_peered":"2023-11-30T17:19:56.100914+0000","last_unstale":"2023-11-30T17:19:56.493638+0000","last_undegraded":"2023-11-30T17:19:56.493638+0000","last_fullsized":"2023-11-30T17:19:56.493638+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.476956+0000","last_change":"2023-11-30T17:19:56.099958+0000","last_active":"2023-11-30T17:19:56.476956+0000","last_peered":"2023-11-30T17:19:56.476956+0000","last_clean":"2023-11-30T17:19:56.476956+0000","last_became_active":"2023-11-30T17:19:56.099666+0000","last_became_peered":"2023-11-30T17:19:56.099666+0000","last_unstale":"2023-11-30T17:19:56.476956+0000","last_undegraded":"2023-11-30T17:19:56.476956+0000","last_fullsized":"2023-11-30T17:19:56.476956+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500920+0000","last_change":"2023-11-30T17:19:56.497005+0000","last_active":"2023-11-30T17:19:56.500920+0000","last_peered":"2023-11-30T17:19:56.500920+0000","last_clean":"2023-11-30T17:19:56.500920+0000","last_became_active":"2023-11-30T17:19:56.496751+0000","last_became_peered":"2023-11-30T17:19:56.496751+0000","last_unstale":"2023-11-30T17:19:56.500920+0000","last_undegraded":"2023-11-30T17:19:56.500920+0000","last_fullsized":"2023-11-30T17:19:56.500920+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.485997+0000","last_change":"2023-11-30T17:19:56.109945+0000","last_active":"2023-11-30T17:19:56.485997+0000","last_peered":"2023-11-30T17:19:56.485997+0000","last_clean":"2023-11-30T17:19:56.485997+0000","last_became_active":"2023-11-30T17:19:56.109524+0000","last_became_peered":"2023-11-30T17:19:56.109524+0000","last_unstale":"2023-11-30T17:19:56.485997+0000","last_undegraded":"2023-11-30T17:19:56.485997+0000","last_fullsized":"2023-11-30T17:19:56.485997+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.484983+0000","last_change":"2023-11-30T17:19:56.481568+0000","last_active":"2023-11-30T17:19:56.484983+0000","last_peered":"2023-11-30T17:19:56.484983+0000","last_clean":"2023-11-30T17:19:56.484983+0000","last_became_active":"2023-11-30T17:19:56.481250+0000","last_became_peered":"2023-11-30T17:19:56.481250+0000","last_unstale":"2023-11-30T17:19:56.484983+0000","last_undegraded":"2023-11-30T17:19:56.484983+0000","last_fullsized":"2023-11-30T17:19:56.484983+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.477452+0000","last_change":"2023-11-30T17:19:56.094800+0000","last_active":"2023-11-30T17:19:56.477452+0000","last_peered":"2023-11-30T17:19:56.477452+0000","last_clean":"2023-11-30T17:19:56.477452+0000","last_became_active":"2023-11-30T17:19:56.094502+0000","last_became_peered":"2023-11-30T17:19:56.094502+0000","last_unstale":"2023-11-30T17:19:56.477452+0000","last_undegraded":"2023-11-30T17:19:56.477452+0000","last_fullsized":"2023-11-30T17:19:56.477452+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493507+0000","last_change":"2023-11-30T17:19:56.490881+0000","last_active":"2023-11-30T17:19:56.493507+0000","last_peered":"2023-11-30T17:19:56.493507+0000","last_clean":"2023-11-30T17:19:56.493507+0000","last_became_active":"2023-11-30T17:19:56.490557+0000","last_became_peered":"2023-11-30T17:19:56.490557+0000","last_unstale":"2023-11-30T17:19:56.493507+0000","last_undegraded":"2023-11-30T17:19:56.493507+0000","last_fullsized":"2023-11-30T17:19:56.493507+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.082283+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.472480+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:19:56.472480+0000","last_peered":"2023-11-30T17:19:56.472480+0000","last_clean":"2023-11-30T17:19:56.472480+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:19:56.472480+0000","last_undegraded":"2023-11-30T17:19:56.472480+0000","last_fullsized":"2023-11-30T17:19:56.472480+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493542+0000","last_change":"2023-11-30T17:19:56.485917+0000","last_active":"2023-11-30T17:19:56.493542+0000","last_peered":"2023-11-30T17:19:56.493542+0000","last_clean":"2023-11-30T17:19:56.493542+0000","last_became_active":"2023-11-30T17:19:56.485355+0000","last_became_peered":"2023-11-30T17:19:56.485355+0000","last_unstale":"2023-11-30T17:19:56.493542+0000","last_undegraded":"2023-11-30T17:19:56.493542+0000","last_fullsized":"2023-11-30T17:19:56.493542+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.077495+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.479090+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:19:56.479090+0000","last_peered":"2023-11-30T17:19:56.479090+0000","last_clean":"2023-11-30T17:19:56.479090+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:19:56.479090+0000","last_undegraded":"2023-11-30T17:19:56.479090+0000","last_fullsized":"2023-11-30T17:19:56.479090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491937+0000","last_change":"2023-11-30T17:19:56.489558+0000","last_active":"2023-11-30T17:19:56.491937+0000","last_peered":"2023-11-30T17:19:56.491937+0000","last_clean":"2023-11-30T17:19:56.491937+0000","last_became_active":"2023-11-30T17:19:56.489367+0000","last_became_peered":"2023-11-30T17:19:56.489367+0000","last_unstale":"2023-11-30T17:19:56.491937+0000","last_undegraded":"2023-11-30T17:19:56.491937+0000","last_fullsized":"2023-11-30T17:19:56.491937+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.495220+0000","last_change":"2023-11-30T17:19:56.099447+0000","last_active":"2023-11-30T17:19:56.495220+0000","last_peered":"2023-11-30T17:19:56.495220+0000","last_clean":"2023-11-30T17:19:56.495220+0000","last_became_active":"2023-11-30T17:19:56.098752+0000","last_became_peered":"2023-11-30T17:19:56.098752+0000","last_unstale":"2023-11-30T17:19:56.495220+0000","last_undegraded":"2023-11-30T17:19:56.495220+0000","last_fullsized":"2023-11-30T17:19:56.495220+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.476345+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:19:56.476345+0000","last_peered":"2023-11-30T17:19:56.476345+0000","last_clean":"2023-11-30T17:19:56.476345+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:19:56.476345+0000","last_undegraded":"2023-11-30T17:19:56.476345+0000","last_fullsized":"2023-11-30T17:19:56.476345+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496649+0000","last_change":"2023-11-30T17:19:56.106136+0000","last_active":"2023-11-30T17:19:56.496649+0000","last_peered":"2023-11-30T17:19:56.496649+0000","last_clean":"2023-11-30T17:19:56.496649+0000","last_became_active":"2023-11-30T17:19:56.105756+0000","last_became_peered":"2023-11-30T17:19:56.105756+0000","last_unstale":"2023-11-30T17:19:56.496649+0000","last_undegraded":"2023-11-30T17:19:56.496649+0000","last_fullsized":"2023-11-30T17:19:56.496649+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.480220+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:19:56.480220+0000","last_peered":"2023-11-30T17:19:56.480220+0000","last_clean":"2023-11-30T17:19:56.480220+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:19:56.480220+0000","last_undegraded":"2023-11-30T17:19:56.480220+0000","last_fullsized":"2023-11-30T17:19:56.480220+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":51,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.481994+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:19:56.481994+0000","last_peered":"2023-11-30T17:19:56.481994+0000","last_clean":"2023-11-30T17:19:56.481994+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:19:56.481994+0000","last_undegraded":"2023-11-30T17:19:56.481994+0000","last_fullsized":"2023-11-30T17:19:56.481994+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.484755+0000","last_change":"2023-11-30T17:19:56.482476+0000","last_active":"2023-11-30T17:19:56.484755+0000","last_peered":"2023-11-30T17:19:56.484755+0000","last_clean":"2023-11-30T17:19:56.484755+0000","last_became_active":"2023-11-30T17:19:56.482179+0000","last_became_peered":"2023-11-30T17:19:56.482179+0000","last_unstale":"2023-11-30T17:19:56.484755+0000","last_undegraded":"2023-11-30T17:19:56.484755+0000","last_fullsized":"2023-11-30T17:19:56.484755+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.485102+0000","last_change":"2023-11-30T17:19:56.097211+0000","last_active":"2023-11-30T17:19:56.485102+0000","last_peered":"2023-11-30T17:19:56.485102+0000","last_clean":"2023-11-30T17:19:56.485102+0000","last_became_active":"2023-11-30T17:19:56.096945+0000","last_became_peered":"2023-11-30T17:19:56.096945+0000","last_unstale":"2023-11-30T17:19:56.485102+0000","last_undegraded":"2023-11-30T17:19:56.485102+0000","last_fullsized":"2023-11-30T17:19:56.485102+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.482083+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:19:56.482083+0000","last_peered":"2023-11-30T17:19:56.482083+0000","last_clean":"2023-11-30T17:19:56.482083+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:19:56.482083+0000","last_undegraded":"2023-11-30T17:19:56.482083+0000","last_fullsized":"2023-11-30T17:19:56.482083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491458+0000","last_change":"2023-11-30T17:19:56.489737+0000","last_active":"2023-11-30T17:19:56.491458+0000","last_peered":"2023-11-30T17:19:56.491458+0000","last_clean":"2023-11-30T17:19:56.491458+0000","last_became_active":"2023-11-30T17:19:56.487977+0000","last_became_peered":"2023-11-30T17:19:56.487977+0000","last_unstale":"2023-11-30T17:19:56.491458+0000","last_undegraded":"2023-11-30T17:19:56.491458+0000","last_fullsized":"2023-11-30T17:19:56.491458+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.479316+0000","last_change":"2023-11-30T17:19:56.104936+0000","last_active":"2023-11-30T17:19:56.479316+0000","last_peered":"2023-11-30T17:19:56.479316+0000","last_clean":"2023-11-30T17:19:56.479316+0000","last_became_active":"2023-11-30T17:19:56.104707+0000","last_became_peered":"2023-11-30T17:19:56.104707+0000","last_unstale":"2023-11-30T17:19:56.479316+0000","last_undegraded":"2023-11-30T17:19:56.479316+0000","last_fullsized":"2023-11-30T17:19:56.479316+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.485161+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:19:56.485161+0000","last_peered":"2023-11-30T17:19:56.485161+0000","last_clean":"2023-11-30T17:19:56.485161+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:19:56.485161+0000","last_undegraded":"2023-11-30T17:19:56.485161+0000","last_fullsized":"2023-11-30T17:19:56.485161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.487502+0000","last_change":"2023-11-30T17:19:56.486862+0000","last_active":"2023-11-30T17:19:56.487502+0000","last_peered":"2023-11-30T17:19:56.487502+0000","last_clean":"2023-11-30T17:19:56.487502+0000","last_became_active":"2023-11-30T17:19:56.486600+0000","last_became_peered":"2023-11-30T17:19:56.486600+0000","last_unstale":"2023-11-30T17:19:56.487502+0000","last_undegraded":"2023-11-30T17:19:56.487502+0000","last_fullsized":"2023-11-30T17:19:56.487502+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.478581+0000","last_change":"2023-11-30T17:19:56.108142+0000","last_active":"2023-11-30T17:19:56.478581+0000","last_peered":"2023-11-30T17:19:56.478581+0000","last_clean":"2023-11-30T17:19:56.478581+0000","last_became_active":"2023-11-30T17:19:56.107685+0000","last_became_peered":"2023-11-30T17:19:56.107685+0000","last_unstale":"2023-11-30T17:19:56.478581+0000","last_undegraded":"2023-11-30T17:19:56.478581+0000","last_fullsized":"2023-11-30T17:19:56.478581+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.472945+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:19:56.472945+0000","last_peered":"2023-11-30T17:19:56.472945+0000","last_clean":"2023-11-30T17:19:56.472945+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:19:56.472945+0000","last_undegraded":"2023-11-30T17:19:56.472945+0000","last_fullsized":"2023-11-30T17:19:56.472945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.494336+0000","last_change":"2023-11-30T17:19:56.489210+0000","last_active":"2023-11-30T17:19:56.494336+0000","last_peered":"2023-11-30T17:19:56.494336+0000","last_clean":"2023-11-30T17:19:56.494336+0000","last_became_active":"2023-11-30T17:19:56.488914+0000","last_became_peered":"2023-11-30T17:19:56.488914+0000","last_unstale":"2023-11-30T17:19:56.494336+0000","last_undegraded":"2023-11-30T17:19:56.494336+0000","last_fullsized":"2023-11-30T17:19:56.494336+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.477075+0000","last_change":"2023-11-30T17:19:56.102213+0000","last_active":"2023-11-30T17:19:56.477075+0000","last_peered":"2023-11-30T17:19:56.477075+0000","last_clean":"2023-11-30T17:19:56.477075+0000","last_became_active":"2023-11-30T17:19:56.101927+0000","last_became_peered":"2023-11-30T17:19:56.101927+0000","last_unstale":"2023-11-30T17:19:56.477075+0000","last_undegraded":"2023-11-30T17:19:56.477075+0000","last_fullsized":"2023-11-30T17:19:56.477075+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-30T17:19:52.060819+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:19:52.060819+0000","last_peered":"2023-11-30T17:19:52.060819+0000","last_clean":"2023-11-30T17:19:52.060819+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:19:52.060819+0000","last_undegraded":"2023-11-30T17:19:52.060819+0000","last_fullsized":"2023-11-30T17:19:52.060819+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":2236,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":106,"acting":106,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575004,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297864,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":786432,"data_stored":380863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58699999999999997,"15min":0.55800000000000005},"min":{"1min":0.374,"5min":0.317,"15min":0.23899999999999999},"max":{"1min":0.73099999999999998,"5min":0.78700000000000003,"15min":0.81100000000000005},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58599999999999997,"15min":0.56599999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.32200000000000001},"max":{"1min":0.76400000000000001,"5min":0.76700000000000002,"15min":0.81899999999999995},"last":0.56100000000000005}]},{"osd":1,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55200000000000005,"15min":0.53000000000000003},"min":{"1min":0.39400000000000002,"5min":0.34599999999999997,"15min":0.33600000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.79400000000000004},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.28799999999999998},"max":{"1min":0.63400000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.46700000000000003}]},{"osd":2,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.32800000000000001},"max":{"1min":0.67600000000000005,"5min":0.77200000000000002,"15min":0.78300000000000003},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.28699999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.83899999999999997},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54400000000000004,"15min":0.53700000000000003},"min":{"1min":0.375,"5min":0.36899999999999999,"15min":0.33200000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.78000000000000003},"last":0.623},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.33900000000000002},"max":{"1min":0.72999999999999998,"5min":0.80500000000000005,"15min":0.81200000000000006},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.44800000000000001,"15min":0.47099999999999997},"min":{"1min":0.313,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.61899999999999999,"5min":0.77500000000000002,"15min":0.79900000000000004},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.442,"5min":0.46899999999999997,"15min":0.5},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.66600000000000004,"5min":0.69999999999999996,"15min":1.3180000000000001},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47499999999999998,"15min":0.501},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68100000000000005,"5min":0.71499999999999997,"15min":0.82899999999999996},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.51000000000000001,"15min":0.53300000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69099999999999995,"5min":0.76000000000000001,"15min":0.872},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53300000000000003,"15min":0.55700000000000005},"min":{"1min":0.376,"5min":0.372,"15min":0.36099999999999999},"max":{"1min":0.71599999999999997,"5min":0.745,"15min":0.85199999999999998},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.55600000000000005},"min":{"1min":0.35399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72099999999999997,"5min":0.78100000000000003,"15min":0.81499999999999995},"last":0.69799999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575002,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301900,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069940,"statfs":{"total":96636764160,"available":96327618560,"internally_reserved":0,"allocated":724992,"data_stored":353402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.75,"5min":0.80000000000000004,"15min":0.82699999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59499999999999997,"15min":0.57799999999999996},"min":{"1min":0.33500000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.78500000000000003,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57899999999999996,"15min":0.55600000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.26400000000000001},"max":{"1min":0.76900000000000002,"5min":0.77500000000000002,"15min":0.82799999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.60199999999999998,"15min":0.58499999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.82499999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.59399999999999997}]},{"osd":2,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.58499999999999996,"15min":0.56200000000000006},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.82599999999999996},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58499999999999996,"15min":0.57099999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80800000000000005,"5min":0.80900000000000005,"15min":0.82499999999999996},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.70299999999999996,"5min":0.755,"15min":0.755},"last":0.442},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54100000000000004,"15min":0.52900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32200000000000001},"max":{"1min":0.72799999999999998,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.44700000000000001,"15min":0.45700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28999999999999998},"max":{"1min":0.61699999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.623,"5min":0.78800000000000003,"15min":0.83899999999999997},"last":0.504}]},{"osd":5,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46899999999999997,"15min":0.46999999999999997},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.28299999999999997},"max":{"1min":0.61099999999999999,"5min":0.69399999999999995,"15min":0.74299999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.5,"15min":0.50900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.31900000000000001},"max":{"1min":0.68799999999999994,"5min":0.745,"15min":0.78500000000000003},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52200000000000002,"15min":0.53600000000000003},"min":{"1min":0.375,"5min":0.34699999999999998,"15min":0.34000000000000002},"max":{"1min":0.69499999999999995,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56100000000000005,"15min":0.56399999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":0.70299999999999996,"5min":0.83499999999999996,"15min":0.86499999999999999},"last":0.64100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575003,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301952,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069888,"statfs":{"total":96636764160,"available":96327565312,"internally_reserved":0,"allocated":778240,"data_stored":380275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35799999999999998,"15min":0.34100000000000003},"min":{"1min":0.23899999999999999,"5min":0.23599999999999999,"15min":0.23000000000000001},"max":{"1min":0.52900000000000003,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.46899999999999997,"15min":0.44900000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.309},"max":{"1min":0.57999999999999996,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.38900000000000001,"15min":0.36799999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.222},"max":{"1min":0.57099999999999995,"5min":0.628,"15min":0.67300000000000004},"last":0.313},{"interface":"front","average":{"1min":0.499,"5min":0.51000000000000001,"15min":0.47299999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.29499999999999998},"max":{"1min":0.63400000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.33400000000000002}]},{"osd":3,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45800000000000002,"15min":0.43099999999999999},"min":{"1min":0.32900000000000001,"5min":0.32000000000000001,"15min":0.23899999999999999},"max":{"1min":0.60999999999999999,"5min":0.749,"15min":0.749},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.442,"15min":0.41599999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.28599999999999998},"max":{"1min":0.65100000000000002,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.35299999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58999999999999997,"15min":0.57599999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.89100000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.39900000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.111},"last":0.42499999999999999}]},{"osd":5,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59899999999999998,"15min":0.58799999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.377},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60599999999999998,"15min":0.59899999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77500000000000002,"5min":0.88200000000000001,"15min":0.91300000000000003},"last":0.36899999999999999}]},{"osd":6,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.44600000000000001,"5min":0.433,"15min":0.39600000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":1.0600000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.65400000000000003,"15min":0.64900000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.379},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.0780000000000001},"last":0.45500000000000002}]},{"osd":7,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.67400000000000004,"15min":0.65300000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.41699999999999998},"max":{"1min":0.91500000000000004,"5min":0.92300000000000004,"15min":0.98699999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.65000000000000002,"15min":0.63900000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.39900000000000002},"max":{"1min":0.85199999999999998,"5min":0.879,"15min":0.94199999999999995},"last":0.442}]}]},{"osd":0,"up_from":13,"seq":55834575003,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301960,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069880,"statfs":{"total":96636764160,"available":96327557120,"internally_reserved":0,"allocated":786432,"data_stored":380311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.37,"15min":0.35199999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.22700000000000001},"max":{"1min":0.54700000000000004,"5min":0.59999999999999998,"15min":0.71199999999999997},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.39500000000000002,"15min":0.372},"min":{"1min":0.27300000000000002,"5min":0.24099999999999999,"15min":0.22600000000000001},"max":{"1min":0.53100000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.216}]},{"osd":2,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39500000000000002,"15min":0.373},"min":{"1min":0.28999999999999998,"5min":0.247,"15min":0.23899999999999999},"max":{"1min":0.58899999999999997,"5min":0.623,"15min":0.623},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47099999999999997,"15min":0.44600000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.31900000000000001},"max":{"1min":0.60999999999999999,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.30099999999999999}]},{"osd":3,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.439,"15min":0.41999999999999998},"min":{"1min":0.32600000000000001,"5min":0.29499999999999998,"15min":0.252},"max":{"1min":0.629,"5min":0.66100000000000003,"15min":0.70999999999999996},"last":0.249},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45200000000000001,"15min":0.42499999999999999},"min":{"1min":0.33600000000000002,"5min":0.317,"15min":0.26700000000000002},"max":{"1min":0.64700000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.28299999999999997}]},{"osd":4,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61899999999999999,"15min":0.59199999999999997},"min":{"1min":0.46500000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82599999999999996,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63300000000000001,"15min":0.60699999999999998},"min":{"1min":0.435,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79100000000000004,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.58599999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.36199999999999999},"max":{"1min":0.81000000000000005,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.501},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64700000000000002,"15min":0.61599999999999999},"min":{"1min":0.51500000000000001,"5min":0.442,"15min":0.38},"max":{"1min":0.88,"5min":1.004,"15min":1.004},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.65600000000000003,"15min":0.63},"min":{"1min":0.47199999999999998,"5min":0.435,"15min":0.39200000000000002},"max":{"1min":0.86699999999999999,"5min":1.002,"15min":1.002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64900000000000002,"15min":0.622},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.42999999999999999},"max":{"1min":0.81699999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.47599999999999998}]},{"osd":7,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.66700000000000004,"15min":0.63900000000000001},"min":{"1min":0.49199999999999999,"5min":0.48799999999999999,"15min":0.44800000000000001},"max":{"1min":0.92700000000000005,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69799999999999995,"15min":0.67300000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.44700000000000001},"max":{"1min":0.90500000000000003,"5min":1.026,"15min":1.026},"last":0.56399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575003,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306056,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065784,"statfs":{"total":96636764160,"available":96323362816,"internally_reserved":0,"allocated":786432,"data_stored":381721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.41399999999999998,"15min":0.38},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.44,"5min":0.44700000000000001,"15min":0.42099999999999999},"min":{"1min":0.28000000000000003,"5min":0.26400000000000001,"15min":0.255},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46200000000000002,"15min":0.433},"min":{"1min":0.254,"5min":0.254,"15min":0.24299999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49299999999999999,"15min":0.45500000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.373}]},{"osd":3,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.42599999999999999,"15min":0.39300000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63500000000000001,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48999999999999999,"15min":0.45100000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.26200000000000001},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.31900000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64400000000000002,"15min":0.59899999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63900000000000001,"15min":0.59699999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66300000000000003,"15min":0.621},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66400000000000003,"15min":0.61699999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38100000000000001},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.66000000000000003,"15min":0.61399999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68999999999999995,"15min":0.65000000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.69999999999999996,"15min":0.66100000000000003},"min":{"1min":0.48899999999999999,"5min":0.45200000000000001,"15min":0.40300000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.71299999999999997,"15min":0.66800000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.41499999999999998},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.69399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575003,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306056,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065784,"statfs":{"total":96636764160,"available":96323362816,"internally_reserved":0,"allocated":786432,"data_stored":380851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.379,"15min":0.35699999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.217},"max":{"1min":0.56599999999999995,"5min":0.58799999999999997,"15min":0.66200000000000003},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.41299999999999998,"15min":0.38800000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.246},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39600000000000002,"15min":0.378},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.255},"max":{"1min":0.59499999999999997,"5min":0.63300000000000001,"15min":0.64300000000000002},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.44,"15min":0.42499999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.25900000000000001},"max":{"1min":0.51500000000000001,"5min":0.69099999999999995,"15min":0.84399999999999997},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46500000000000002,"15min":0.438},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.26000000000000001},"max":{"1min":0.72999999999999998,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.52900000000000003,"15min":0.48899999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.33400000000000002},"max":{"1min":0.68999999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61599999999999999,"15min":0.59499999999999997},"min":{"1min":0.42799999999999999,"5min":0.42599999999999999,"15min":0.35099999999999998},"max":{"1min":0.91500000000000004,"5min":0.91600000000000004,"15min":0.97599999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.624,"15min":0.61099999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.34799999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.91400000000000003},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61699999999999999,"15min":0.60599999999999998},"min":{"1min":0.41699999999999998,"5min":0.40000000000000002,"15min":0.378},"max":{"1min":0.85399999999999998,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.504},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.64600000000000002,"15min":0.629},"min":{"1min":0.46700000000000003,"5min":0.45100000000000001,"15min":0.36399999999999999},"max":{"1min":0.80500000000000005,"5min":0.88900000000000001,"15min":1.008},"last":0.623}]},{"osd":6,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.39000000000000001},"max":{"1min":0.84599999999999997,"5min":0.94999999999999996,"15min":1.0389999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.65800000000000003,"15min":0.64400000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.41399999999999998},"max":{"1min":0.89500000000000002,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.63800000000000001}]},{"osd":7,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67500000000000004,"15min":0.66500000000000004},"min":{"1min":0.51300000000000001,"5min":0.44700000000000001,"15min":0.39100000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.67000000000000004,"15min":0.65100000000000002},"min":{"1min":0.46200000000000002,"5min":0.432,"15min":0.41899999999999998},"max":{"1min":0.89200000000000002,"5min":0.93700000000000006,"15min":1.004},"last":0.65000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575002,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297804,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074036,"statfs":{"total":96636764160,"available":96331812864,"internally_reserved":0,"allocated":724992,"data_stored":353402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52700000000000002,"15min":0.52300000000000002},"min":{"1min":0.39400000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71699999999999997,"5min":0.77700000000000002,"15min":0.80900000000000005},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.379,"5min":0.32200000000000001,"15min":0.317},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.47499999999999998}]},{"osd":1,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.55100000000000005,"15min":0.53400000000000003},"min":{"1min":0.36899999999999999,"5min":0.314,"15min":0.25800000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.79600000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54400000000000004,"15min":0.54100000000000004},"min":{"1min":0.44700000000000001,"5min":0.36699999999999999,"15min":0.246},"max":{"1min":0.71299999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58199999999999996,"15min":0.56100000000000005},"min":{"1min":0.46500000000000002,"5min":0.38400000000000001,"15min":0.27800000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.58999999999999997},"min":{"1min":0.436,"5min":0.41299999999999998,"15min":0.36899999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.60799999999999998}]},{"osd":3,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55400000000000005,"15min":0.54300000000000004},"min":{"1min":0.41499999999999998,"5min":0.40600000000000003,"15min":0.32900000000000001},"max":{"1min":0.76400000000000001,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.45000000000000001,"5min":0.372,"15min":0.35799999999999998},"max":{"1min":0.69699999999999995,"5min":0.78900000000000003,"15min":0.80600000000000005},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.43099999999999999,"15min":0.45600000000000002},"min":{"1min":0.33000000000000002,"5min":0.30099999999999999,"15min":0.27400000000000002},"max":{"1min":0.54900000000000004,"5min":0.72499999999999998,"15min":0.83299999999999996},"last":0.623},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.44400000000000001,"15min":0.47199999999999998},"min":{"1min":0.374,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59999999999999998,"5min":0.66400000000000003,"15min":0.85099999999999998},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.49399999999999999,"15min":0.51200000000000001},"min":{"1min":0.371,"5min":0.33100000000000002,"15min":0.314},"max":{"1min":0.64200000000000002,"5min":0.754,"15min":0.98799999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53200000000000003,"15min":0.54400000000000004},"min":{"1min":0.45100000000000001,"5min":0.39900000000000002,"15min":0.33800000000000002},"max":{"1min":0.65700000000000003,"5min":0.74099999999999999,"15min":0.95999999999999996},"last":0.73299999999999998}]},{"osd":7,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.35999999999999999,"5min":0.318,"15min":0.29899999999999999},"max":{"1min":0.68799999999999994,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56599999999999995,"15min":0.57799999999999996},"min":{"1min":0.50700000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.69699999999999995,"5min":0.79500000000000004,"15min":0.85399999999999998},"last":0.754}]}]},{"osd":5,"up_from":13,"seq":55834575003,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301952,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069888,"statfs":{"total":96636764160,"available":96327565312,"internally_reserved":0,"allocated":778240,"data_stored":381077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.35799999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.627,"5min":0.73399999999999999,"15min":0.76500000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.67000000000000004,"5min":0.76200000000000001,"15min":0.81799999999999995},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.52600000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.318},"max":{"1min":0.59999999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.56100000000000005,"15min":0.53900000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.36199999999999999},"max":{"1min":0.65800000000000003,"5min":0.754,"15min":0.77000000000000002},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60399999999999998,"15min":0.58399999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.30599999999999999},"max":{"1min":0.74099999999999999,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.60599999999999998,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.34499999999999997},"max":{"1min":0.69099999999999995,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55600000000000005,"15min":0.54100000000000004},"min":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64600000000000002,"5min":0.72399999999999998,"15min":0.73799999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57299999999999995,"15min":0.56799999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.71299999999999997,"5min":0.79200000000000004,"15min":0.82099999999999995},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.42899999999999999,"15min":0.44600000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.53900000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.46100000000000002,"15min":0.47099999999999997},"min":{"1min":0.34499999999999997,"5min":0.33000000000000002,"15min":0.32100000000000001},"max":{"1min":0.55600000000000005,"5min":0.66700000000000004,"15min":0.77600000000000002},"last":0.40200000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.48199999999999998,"15min":0.48899999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28499999999999998},"max":{"1min":0.63100000000000001,"5min":0.73999999999999999,"15min":0.82099999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54600000000000004,"15min":0.55600000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.33400000000000002},"max":{"1min":0.67300000000000004,"5min":0.81399999999999995,"15min":0.88200000000000001},"last":0.54400000000000004}]},{"osd":7,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.52700000000000002,"15min":0.53100000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68200000000000005,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57499999999999996,"15min":0.58099999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73099999999999998,"5min":0.79300000000000004,"15min":0.84599999999999997},"last":0.439}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:20:01.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2023-11-30T17:20:01.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:19:55.068004+0000', 'last_change': '2023-11-30T17:19:55.082730+0000', 'last_active': '2023-11-30T17:19:55.068004+0000', 'last_peered': '2023-11-30T17:19:55.068004+0000', 'last_clean': '2023-11-30T17:19:55.068004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:55.068004+0000', 'last_undegraded': '2023-11-30T17:19:55.068004+0000', 'last_fullsized': '2023-11-30T17:19:55.068004+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-30T17:20:01.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3b is not active+clean 2023-11-30T17:20:01.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:19:56.073560+0000', 'last_change': '2023-11-30T17:19:56.073560+0000', 'last_active': '2023-11-30T17:19:56.073560+0000', 'last_peered': '2023-11-30T17:19:56.073560+0000', 'last_clean': '2023-11-30T17:19:56.073560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:56.073560+0000', 'last_undegraded': '2023-11-30T17:19:56.073560+0000', 'last_fullsized': '2023-11-30T17:19:56.073560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:20:01.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2023-11-30T17:20:01.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:19:55.068004+0000', 'last_change': '2023-11-30T17:19:55.077396+0000', 'last_active': '2023-11-30T17:19:55.068004+0000', 'last_peered': '2023-11-30T17:19:55.068004+0000', 'last_clean': '2023-11-30T17:19:55.068004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:55.068004+0000', 'last_undegraded': '2023-11-30T17:19:55.068004+0000', 'last_fullsized': '2023-11-30T17:19:55.068004+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-30T17:20:01.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2023-11-30T17:20:01.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:19:55.068004+0000', 'last_change': '2023-11-30T17:19:55.083264+0000', 'last_active': '2023-11-30T17:19:55.068004+0000', 'last_peered': '2023-11-30T17:19:55.068004+0000', 'last_clean': '2023-11-30T17:19:55.068004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:55.068004+0000', 'last_undegraded': '2023-11-30T17:19:55.068004+0000', 'last_fullsized': '2023-11-30T17:19:55.068004+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-30T17:20:01.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2023-11-30T17:20:01.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:19:55.068004+0000', 'last_change': '2023-11-30T17:19:55.084005+0000', 'last_active': '2023-11-30T17:19:55.068004+0000', 'last_peered': '2023-11-30T17:19:55.068004+0000', 'last_clean': '2023-11-30T17:19:55.068004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:55.068004+0000', 'last_undegraded': '2023-11-30T17:19:55.068004+0000', 'last_fullsized': '2023-11-30T17:19:55.068004+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-30T17:20:01.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2023-11-30T17:20:01.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:19:55.068004+0000', 'last_change': '2023-11-30T17:19:55.078100+0000', 'last_active': '2023-11-30T17:19:55.068004+0000', 'last_peered': '2023-11-30T17:19:55.068004+0000', 'last_clean': '2023-11-30T17:19:55.068004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:55.068004+0000', 'last_undegraded': '2023-11-30T17:19:55.068004+0000', 'last_fullsized': '2023-11-30T17:19:55.068004+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-30T17:20:01.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.24 is not active+clean 2023-11-30T17:20:01.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:19:56.073560+0000', 'last_change': '2023-11-30T17:19:56.073560+0000', 'last_active': '2023-11-30T17:19:56.073560+0000', 'last_peered': '2023-11-30T17:19:56.073560+0000', 'last_clean': '2023-11-30T17:19:56.073560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:56.073560+0000', 'last_undegraded': '2023-11-30T17:19:56.073560+0000', 'last_fullsized': '2023-11-30T17:19:56.073560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:20:01.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2023-11-30T17:20:01.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:19:55.068004+0000', 'last_change': '2023-11-30T17:19:55.077908+0000', 'last_active': '2023-11-30T17:19:55.068004+0000', 'last_peered': '2023-11-30T17:19:55.068004+0000', 'last_clean': '2023-11-30T17:19:55.068004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:55.068004+0000', 'last_undegraded': '2023-11-30T17:19:55.068004+0000', 'last_fullsized': '2023-11-30T17:19:55.068004+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-30T17:20:01.236 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2023-11-30T17:20:01.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:19:55.068004+0000', 'last_change': '2023-11-30T17:19:55.076864+0000', 'last_active': '2023-11-30T17:19:55.068004+0000', 'last_peered': '2023-11-30T17:19:55.068004+0000', 'last_clean': '2023-11-30T17:19:55.068004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:55.068004+0000', 'last_undegraded': '2023-11-30T17:19:55.068004+0000', 'last_fullsized': '2023-11-30T17:19:55.068004+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-30T17:20:01.236 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2023-11-30T17:20:01.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:19:55.068004+0000', 'last_change': '2023-11-30T17:19:55.079249+0000', 'last_active': '2023-11-30T17:19:55.068004+0000', 'last_peered': '2023-11-30T17:19:55.068004+0000', 'last_clean': '2023-11-30T17:19:55.068004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:55.068004+0000', 'last_undegraded': '2023-11-30T17:19:55.068004+0000', 'last_fullsized': '2023-11-30T17:19:55.068004+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-30T17:20:01.236 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2023-11-30T17:20:01.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:19:55.068004+0000', 'last_change': '2023-11-30T17:19:55.082342+0000', 'last_active': '2023-11-30T17:19:55.068004+0000', 'last_peered': '2023-11-30T17:19:55.068004+0000', 'last_clean': '2023-11-30T17:19:55.068004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:55.068004+0000', 'last_undegraded': '2023-11-30T17:19:55.068004+0000', 'last_fullsized': '2023-11-30T17:19:55.068004+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-30T17:20:01.236 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2b is not active+clean 2023-11-30T17:20:01.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:19:56.073560+0000', 'last_change': '2023-11-30T17:19:56.073560+0000', 'last_active': '2023-11-30T17:19:56.073560+0000', 'last_peered': '2023-11-30T17:19:56.073560+0000', 'last_clean': '2023-11-30T17:19:56.073560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:56.073560+0000', 'last_undegraded': '2023-11-30T17:19:56.073560+0000', 'last_fullsized': '2023-11-30T17:19:56.073560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:20:01.236 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2c is not active+clean 2023-11-30T17:20:01.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:19:56.073560+0000', 'last_change': '2023-11-30T17:19:56.073560+0000', 'last_active': '2023-11-30T17:19:56.073560+0000', 'last_peered': '2023-11-30T17:19:56.073560+0000', 'last_clean': '2023-11-30T17:19:56.073560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:56.073560+0000', 'last_undegraded': '2023-11-30T17:19:56.073560+0000', 'last_fullsized': '2023-11-30T17:19:56.073560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:20:01.236 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2023-11-30T17:20:01.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:19:55.068004+0000', 'last_change': '2023-11-30T17:19:55.076958+0000', 'last_active': '2023-11-30T17:19:55.068004+0000', 'last_peered': '2023-11-30T17:19:55.068004+0000', 'last_clean': '2023-11-30T17:19:55.068004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:55.068004+0000', 'last_undegraded': '2023-11-30T17:19:55.068004+0000', 'last_fullsized': '2023-11-30T17:19:55.068004+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-30T17:20:01.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2023-11-30T17:20:01.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:19:55.068004+0000', 'last_change': '2023-11-30T17:19:55.082939+0000', 'last_active': '2023-11-30T17:19:55.068004+0000', 'last_peered': '2023-11-30T17:19:55.068004+0000', 'last_clean': '2023-11-30T17:19:55.068004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:55.068004+0000', 'last_undegraded': '2023-11-30T17:19:55.068004+0000', 'last_fullsized': '2023-11-30T17:19:55.068004+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-30T17:20:01.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2023-11-30T17:20:01.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:19:55.068004+0000', 'last_change': '2023-11-30T17:19:55.078834+0000', 'last_active': '2023-11-30T17:19:55.068004+0000', 'last_peered': '2023-11-30T17:19:55.068004+0000', 'last_clean': '2023-11-30T17:19:55.068004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:55.068004+0000', 'last_undegraded': '2023-11-30T17:19:55.068004+0000', 'last_fullsized': '2023-11-30T17:19:55.068004+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-30T17:20:01.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2023-11-30T17:20:01.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:19:56.073560+0000', 'last_change': '2023-11-30T17:19:56.073560+0000', 'last_active': '2023-11-30T17:19:56.073560+0000', 'last_peered': '2023-11-30T17:19:56.073560+0000', 'last_clean': '2023-11-30T17:19:56.073560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:56.073560+0000', 'last_undegraded': '2023-11-30T17:19:56.073560+0000', 'last_fullsized': '2023-11-30T17:19:56.073560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:20:01.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2023-11-30T17:20:01.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:19:56.073560+0000', 'last_change': '2023-11-30T17:19:56.073560+0000', 'last_active': '2023-11-30T17:19:56.073560+0000', 'last_peered': '2023-11-30T17:19:56.073560+0000', 'last_clean': '2023-11-30T17:19:56.073560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:56.073560+0000', 'last_undegraded': '2023-11-30T17:19:56.073560+0000', 'last_fullsized': '2023-11-30T17:19:56.073560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:20:01.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-11-30T17:20:01.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:19:55.068004+0000', 'last_change': '2023-11-30T17:19:55.082279+0000', 'last_active': '2023-11-30T17:19:55.068004+0000', 'last_peered': '2023-11-30T17:19:55.068004+0000', 'last_clean': '2023-11-30T17:19:55.068004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:55.068004+0000', 'last_undegraded': '2023-11-30T17:19:55.068004+0000', 'last_fullsized': '2023-11-30T17:19:55.068004+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-30T17:20:01.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-11-30T17:20:01.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:19:55.068004+0000', 'last_change': '2023-11-30T17:19:55.077413+0000', 'last_active': '2023-11-30T17:19:55.068004+0000', 'last_peered': '2023-11-30T17:19:55.068004+0000', 'last_clean': '2023-11-30T17:19:55.068004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:55.068004+0000', 'last_undegraded': '2023-11-30T17:19:55.068004+0000', 'last_fullsized': '2023-11-30T17:19:55.068004+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-30T17:20:01.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2023-11-30T17:20:01.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:19:56.073560+0000', 'last_change': '2023-11-30T17:19:56.073560+0000', 'last_active': '2023-11-30T17:19:56.073560+0000', 'last_peered': '2023-11-30T17:19:56.073560+0000', 'last_clean': '2023-11-30T17:19:56.073560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:56.073560+0000', 'last_undegraded': '2023-11-30T17:19:56.073560+0000', 'last_fullsized': '2023-11-30T17:19:56.073560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:20:01.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-11-30T17:20:01.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:19:55.068004+0000', 'last_change': '2023-11-30T17:19:55.083351+0000', 'last_active': '2023-11-30T17:19:55.068004+0000', 'last_peered': '2023-11-30T17:19:55.068004+0000', 'last_clean': '2023-11-30T17:19:55.068004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:55.068004+0000', 'last_undegraded': '2023-11-30T17:19:55.068004+0000', 'last_fullsized': '2023-11-30T17:19:55.068004+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-30T17:20:01.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2023-11-30T17:20:01.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:19:56.073560+0000', 'last_change': '2023-11-30T17:19:56.073560+0000', 'last_active': '2023-11-30T17:19:56.073560+0000', 'last_peered': '2023-11-30T17:19:56.073560+0000', 'last_clean': '2023-11-30T17:19:56.073560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:56.073560+0000', 'last_undegraded': '2023-11-30T17:19:56.073560+0000', 'last_fullsized': '2023-11-30T17:19:56.073560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:20:01.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2023-11-30T17:20:01.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:19:55.068004+0000', 'last_change': '2023-11-30T17:19:55.078221+0000', 'last_active': '2023-11-30T17:19:55.068004+0000', 'last_peered': '2023-11-30T17:19:55.068004+0000', 'last_clean': '2023-11-30T17:19:55.068004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:55.068004+0000', 'last_undegraded': '2023-11-30T17:19:55.068004+0000', 'last_fullsized': '2023-11-30T17:19:55.068004+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-30T17:20:01.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2023-11-30T17:20:01.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:19:56.073560+0000', 'last_change': '2023-11-30T17:19:56.073560+0000', 'last_active': '2023-11-30T17:19:56.073560+0000', 'last_peered': '2023-11-30T17:19:56.073560+0000', 'last_clean': '2023-11-30T17:19:56.073560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:56.073560+0000', 'last_undegraded': '2023-11-30T17:19:56.073560+0000', 'last_fullsized': '2023-11-30T17:19:56.073560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:20:01.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-11-30T17:20:01.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:19:55.068004+0000', 'last_change': '2023-11-30T17:19:55.077671+0000', 'last_active': '2023-11-30T17:19:55.068004+0000', 'last_peered': '2023-11-30T17:19:55.068004+0000', 'last_clean': '2023-11-30T17:19:55.068004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:55.068004+0000', 'last_undegraded': '2023-11-30T17:19:55.068004+0000', 'last_fullsized': '2023-11-30T17:19:55.068004+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-30T17:20:01.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2023-11-30T17:20:01.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:19:55.068004+0000', 'last_change': '2023-11-30T17:19:55.078432+0000', 'last_active': '2023-11-30T17:19:55.068004+0000', 'last_peered': '2023-11-30T17:19:55.068004+0000', 'last_clean': '2023-11-30T17:19:55.068004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:55.068004+0000', 'last_undegraded': '2023-11-30T17:19:55.068004+0000', 'last_fullsized': '2023-11-30T17:19:55.068004+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-30T17:20:01.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2023-11-30T17:20:01.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:19:56.073560+0000', 'last_change': '2023-11-30T17:19:56.073560+0000', 'last_active': '2023-11-30T17:19:56.073560+0000', 'last_peered': '2023-11-30T17:19:56.073560+0000', 'last_clean': '2023-11-30T17:19:56.073560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:56.073560+0000', 'last_undegraded': '2023-11-30T17:19:56.073560+0000', 'last_fullsized': '2023-11-30T17:19:56.073560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:20:01.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2023-11-30T17:20:01.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:19:55.068004+0000', 'last_change': '2023-11-30T17:19:55.082283+0000', 'last_active': '2023-11-30T17:19:55.068004+0000', 'last_peered': '2023-11-30T17:19:55.068004+0000', 'last_clean': '2023-11-30T17:19:55.068004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:55.068004+0000', 'last_undegraded': '2023-11-30T17:19:55.068004+0000', 'last_fullsized': '2023-11-30T17:19:55.068004+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-30T17:20:01.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2023-11-30T17:20:01.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-11-30T17:19:55.068004+0000', 'last_change': '2023-11-30T17:19:55.077495+0000', 'last_active': '2023-11-30T17:19:55.068004+0000', 'last_peered': '2023-11-30T17:19:55.068004+0000', 'last_clean': '2023-11-30T17:19:55.068004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:55.068004+0000', 'last_undegraded': '2023-11-30T17:19:55.068004+0000', 'last_fullsized': '2023-11-30T17:19:55.068004+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:55.068004+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-30T17:20:01.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2023-11-30T17:20:01.240 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:19:56.073560+0000', 'last_change': '2023-11-30T17:19:56.073560+0000', 'last_active': '2023-11-30T17:19:56.073560+0000', 'last_peered': '2023-11-30T17:19:56.073560+0000', 'last_clean': '2023-11-30T17:19:56.073560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:19:56.073560+0000', 'last_undegraded': '2023-11-30T17:19:56.073560+0000', 'last_fullsized': '2023-11-30T17:19:56.073560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'last_clean_scrub_stamp': '2023-11-30T17:19:56.073560+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:20:01.240 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-30T17:20:01.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.382+0000 7f7f170ea700 1 Processor -- start 2023-11-30T17:20:01.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.382+0000 7f7f170ea700 1 -- start start 2023-11-30T17:20:01.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.383+0000 7f7f170ea700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7f101520c0 0x7f7f10066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:01.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.383+0000 7f7f170ea700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f10068150 0x7f7f10066a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:01.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.383+0000 7f7f170ea700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f100be110 con 0x7f7f101524a0 2023-11-30T17:20:01.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.383+0000 7f7f170ea700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f10066fc0 con 0x7f7f101520c0 2023-11-30T17:20:01.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.383+0000 7f7f170ea700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f100672a0 con 0x7f7f10068150 2023-11-30T17:20:01.386 INFO:tasks.ceph.mds.a.smithi049.stderr:2023-11-30T17:20:01.383+0000 7ff35eb93700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-30T17:20:01.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.383+0000 7f7f15687700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f10068150 0x7f7f10066a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:01.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.383+0000 7f7f14e86700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7f101520c0 0x7f7f10066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:01.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.383+0000 7f7f0ffff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f7f101524a0 0x7f7f10067a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:54108/0 (socket says 172.21.15.49:54108) 2023-11-30T17:20:01.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.383+0000 7f7f0ffff700 1 -- 172.21.15.49:0/4071082312 learned_addr learned my addr 172.21.15.49:0/4071082312 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:20:01.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.383+0000 7f7f15687700 1 -- 172.21.15.49:0/4071082312 >> v2:172.21.15.115:3300/0 conn(0x7f7f101520c0 msgr2=0x7f7f10066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:01.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.383+0000 7f7f15687700 1 --2- 172.21.15.49:0/4071082312 >> v2:172.21.15.115:3300/0 conn(0x7f7f101520c0 0x7f7f10066520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:01.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.383+0000 7f7f15687700 1 -- 172.21.15.49:0/4071082312 >> v1:172.21.15.115:6789/0 conn(0x7f7f101524a0 legacy=0x7f7f10067a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:01.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.383+0000 7f7f15687700 1 -- 172.21.15.49:0/4071082312 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f100be380 con 0x7f7f10068150 2023-11-30T17:20:01.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.383+0000 7f7f15687700 1 --2- 172.21.15.49:0/4071082312 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f10068150 0x7f7f10066a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f7ef8009760 tx=0x7f7ef8009060).ready entity=mon.2 client_cookie=8198acf816a7382a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:01.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.384+0000 7f7f0f7fe700 1 -- 172.21.15.49:0/4071082312 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef800f510 con 0x7f7f10068150 2023-11-30T17:20:01.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.384+0000 7f7f0f7fe700 1 -- 172.21.15.49:0/4071082312 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef800f670 con 0x7f7f10068150 2023-11-30T17:20:01.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.384+0000 7f7f0f7fe700 1 -- 172.21.15.49:0/4071082312 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef800f9f0 con 0x7f7f10068150 2023-11-30T17:20:01.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.384+0000 7f7f170ea700 1 -- 172.21.15.49:0/4071082312 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f10068150 msgr2=0x7f7f10066a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:01.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.384+0000 7f7f170ea700 1 --2- 172.21.15.49:0/4071082312 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f10068150 0x7f7f10066a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f7ef8009760 tx=0x7f7ef8009060).stop 2023-11-30T17:20:01.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.384+0000 7f7f170ea700 1 -- 172.21.15.49:0/4071082312 shutdown_connections 2023-11-30T17:20:01.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.384+0000 7f7f170ea700 1 --2- 172.21.15.49:0/4071082312 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f10068150 0x7f7f10066a10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:01.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.384+0000 7f7f170ea700 1 --2- 172.21.15.49:0/4071082312 >> v2:172.21.15.115:3300/0 conn(0x7f7f101520c0 0x7f7f10066520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:01.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.384+0000 7f7f170ea700 1 -- 172.21.15.49:0/4071082312 >> 172.21.15.49:0/4071082312 conn(0x7f7f100631d0 msgr2=0x7f7f100c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:01.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.384+0000 7f7f170ea700 1 -- 172.21.15.49:0/4071082312 shutdown_connections 2023-11-30T17:20:01.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.384+0000 7f7f170ea700 1 -- 172.21.15.49:0/4071082312 wait complete. 2023-11-30T17:20:01.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.385+0000 7f7f170ea700 1 Processor -- start 2023-11-30T17:20:01.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.385+0000 7f7f170ea700 1 -- start start 2023-11-30T17:20:01.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.386+0000 7f7f170ea700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f10068150 0x7f7f10146b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:01.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.386+0000 7f7f170ea700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f101520c0 0x7f7f10163270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:01.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.386+0000 7f7f170ea700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f101524a0 0x7f7f100c2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:01.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.386+0000 7f7f170ea700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f10147260 con 0x7f7f101524a0 2023-11-30T17:20:01.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.386+0000 7f7f170ea700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f100c2bf0 con 0x7f7f10068150 2023-11-30T17:20:01.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.386+0000 7f7f170ea700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f10166820 con 0x7f7f101520c0 2023-11-30T17:20:01.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.386+0000 7f7f15687700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f101524a0 0x7f7f100c2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:01.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.386+0000 7f7f15687700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f101524a0 0x7f7f100c2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35028/0 (socket says 172.21.15.49:35028) 2023-11-30T17:20:01.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.386+0000 7f7f15687700 1 -- 172.21.15.49:0/1566808897 learned_addr learned my addr 172.21.15.49:0/1566808897 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:20:01.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.387+0000 7f7f14e86700 1 --2- 172.21.15.49:0/1566808897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f10068150 0x7f7f10146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:01.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.387+0000 7f7f0ffff700 1 --2- 172.21.15.49:0/1566808897 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f101520c0 0x7f7f10163270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:01.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.387+0000 7f7f15687700 1 -- 172.21.15.49:0/1566808897 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f101520c0 msgr2=0x7f7f10163270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:01.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.387+0000 7f7f15687700 1 --2- 172.21.15.49:0/1566808897 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f101520c0 0x7f7f10163270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:01.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.387+0000 7f7f15687700 1 -- 172.21.15.49:0/1566808897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f10068150 msgr2=0x7f7f10146b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:01.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.387+0000 7f7f15687700 1 --2- 172.21.15.49:0/1566808897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f10068150 0x7f7f10146b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:01.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.387+0000 7f7f15687700 1 -- 172.21.15.49:0/1566808897 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef80092a0 con 0x7f7f101524a0 2023-11-30T17:20:01.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.387+0000 7f7f15687700 1 --2- 172.21.15.49:0/1566808897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f101524a0 0x7f7f100c2700 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f7ef8009e00 tx=0x7f7ef8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:01.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.387+0000 7f7f0cff9700 1 -- 172.21.15.49:0/1566808897 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef800f9f0 con 0x7f7f101524a0 2023-11-30T17:20:01.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.387+0000 7f7f0cff9700 1 -- 172.21.15.49:0/1566808897 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef801b410 con 0x7f7f101524a0 2023-11-30T17:20:01.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.387+0000 7f7f0cff9700 1 -- 172.21.15.49:0/1566808897 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef801b7d0 con 0x7f7f101524a0 2023-11-30T17:20:01.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.387+0000 7f7f170ea700 1 -- 172.21.15.49:0/1566808897 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f10166b00 con 0x7f7f101524a0 2023-11-30T17:20:01.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.387+0000 7f7f170ea700 1 -- 172.21.15.49:0/1566808897 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f10162a70 con 0x7f7f101524a0 2023-11-30T17:20:01.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.388+0000 7f7f170ea700 1 -- 172.21.15.49:0/1566808897 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f1006c860 con 0x7f7f101524a0 2023-11-30T17:20:01.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.388+0000 7f7f0cff9700 1 -- 172.21.15.49:0/1566808897 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f7ef801bb40 con 0x7f7f101524a0 2023-11-30T17:20:01.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.389+0000 7f7f0cff9700 1 --2- 172.21.15.49:0/1566808897 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7ef005f270 0x7f7ef0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:01.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.389+0000 7f7f0cff9700 1 -- 172.21.15.49:0/1566808897 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7ef807c020 con 0x7f7f101524a0 2023-11-30T17:20:01.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.389+0000 7f7f14e86700 1 --2- 172.21.15.49:0/1566808897 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7ef005f270 0x7f7ef0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:01.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.390+0000 7f7f14e86700 1 --2- 172.21.15.49:0/1566808897 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7ef005f270 0x7f7ef0061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f7f100a7b60 tx=0x7f7f0800b040).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:01.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.393+0000 7f7f0cff9700 1 -- 172.21.15.49:0/1566808897 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7ef804d170 con 0x7f7f101524a0 2023-11-30T17:20:01.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.634+0000 7f7f170ea700 1 -- 172.21.15.49:0/1566808897 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f7f100c5880 con 0x7f7f101524a0 2023-11-30T17:20:01.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.634+0000 7f7f0cff9700 1 -- 172.21.15.49:0/1566808897 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1115 (secure 0 0 0) 0x7f7ef8050790 con 0x7f7f101524a0 2023-11-30T17:20:01.636 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:20:01.637 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":783,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":65,"num_osds":8,"num_up_osds":8,"osd_up_since":1701364027,"num_in_osds":8,"osd_in_since":1701364021,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":106},{"state_name":"creating+peering","count":20},{"state_name":"unknown","count":11}],"num_pgs":137,"num_pools":4,"num_objects":17,"data_bytes":2236,"bytes_used":2473517056,"bytes_avail":770620596224,"bytes_total":773094113280,"unknown_pgs_ratio":0.080291971564292908,"inactive_pgs_ratio":0.14598539471626282},"fsmap":{"epoch":24,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5766}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-11-30T17:09:24.133555+0000","services":{}},"progress_events":{}} 2023-11-30T17:20:01.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.636+0000 7f7f170ea700 1 -- 172.21.15.49:0/1566808897 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7ef005f270 msgr2=0x7f7ef0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:01.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.636+0000 7f7f170ea700 1 --2- 172.21.15.49:0/1566808897 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7ef005f270 0x7f7ef0061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f7f100a7b60 tx=0x7f7f0800b040).stop 2023-11-30T17:20:01.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.636+0000 7f7f170ea700 1 -- 172.21.15.49:0/1566808897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f101524a0 msgr2=0x7f7f100c2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:01.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.636+0000 7f7f170ea700 1 --2- 172.21.15.49:0/1566808897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f101524a0 0x7f7f100c2700 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f7ef8009e00 tx=0x7f7ef8017000).stop 2023-11-30T17:20:01.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.636+0000 7f7f170ea700 1 -- 172.21.15.49:0/1566808897 shutdown_connections 2023-11-30T17:20:01.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.636+0000 7f7f170ea700 1 --2- 172.21.15.49:0/1566808897 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7ef005f270 0x7f7ef0061730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:01.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.636+0000 7f7f170ea700 1 --2- 172.21.15.49:0/1566808897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f101524a0 0x7f7f100c2700 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:01.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.636+0000 7f7f170ea700 1 --2- 172.21.15.49:0/1566808897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f10068150 0x7f7f10146b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:01.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.636+0000 7f7f170ea700 1 --2- 172.21.15.49:0/1566808897 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f101520c0 0x7f7f10163270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:01.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.636+0000 7f7f170ea700 1 -- 172.21.15.49:0/1566808897 >> 172.21.15.49:0/1566808897 conn(0x7f7f100631d0 msgr2=0x7f7f1014ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:01.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.636+0000 7f7f170ea700 1 -- 172.21.15.49:0/1566808897 shutdown_connections 2023-11-30T17:20:01.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.636+0000 7f7f170ea700 1 -- 172.21.15.49:0/1566808897 wait complete. 2023-11-30T17:20:01.650 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-30T17:20:01.651 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:20:01.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.765+0000 7f6747694700 1 Processor -- start 2023-11-30T17:20:01.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.766+0000 7f6747694700 1 -- start start 2023-11-30T17:20:01.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.766+0000 7f6747694700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f67400cae90 0x7f67400c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:01.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.766+0000 7f6747694700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f67400ca180 0x7f67400c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:01.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.766+0000 7f6747694700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67400a9a90 con 0x7f67400caab0 2023-11-30T17:20:01.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.766+0000 7f6747694700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67400c1490 con 0x7f67400cae90 2023-11-30T17:20:01.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.766+0000 7f6747694700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6740154ce0 con 0x7f67400ca180 2023-11-30T17:20:01.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.767+0000 7f6744c2f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f67400cae90 0x7f67400c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:01.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.767+0000 7f6745430700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f67400caab0 0x7f67400aa470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34822/0 (socket says 172.21.15.49:34822) 2023-11-30T17:20:01.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.767+0000 7f6745430700 1 -- 172.21.15.49:0/2945745334 learned_addr learned my addr 172.21.15.49:0/2945745334 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:20:01.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.767+0000 7f6745c31700 1 --2- 172.21.15.49:0/2945745334 >> v2:172.21.15.115:3300/0 conn(0x7f67400ca180 0x7f67400c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:01.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.767+0000 7f6744c2f700 1 -- 172.21.15.49:0/2945745334 >> v2:172.21.15.115:3300/0 conn(0x7f67400ca180 msgr2=0x7f67400c0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:01.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.767+0000 7f6744c2f700 1 --2- 172.21.15.49:0/2945745334 >> v2:172.21.15.115:3300/0 conn(0x7f67400ca180 0x7f67400c0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:01.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.767+0000 7f6744c2f700 1 -- 172.21.15.49:0/2945745334 >> v1:172.21.15.49:6789/0 conn(0x7f67400caab0 legacy=0x7f67400aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:01.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.767+0000 7f6744c2f700 1 -- 172.21.15.49:0/2945745334 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67400aab80 con 0x7f67400cae90 2023-11-30T17:20:01.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.767+0000 7f6744c2f700 1 --2- 172.21.15.49:0/2945745334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67400cae90 0x7f67400c0ab0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f67400a9a00 tx=0x7f6734009060).ready entity=mon.0 client_cookie=e228b78335b0cefc server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:01.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.767+0000 7f673ffff700 1 -- 172.21.15.49:0/2945745334 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673400b580 con 0x7f67400cae90 2023-11-30T17:20:01.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.767+0000 7f673ffff700 1 -- 172.21.15.49:0/2945745334 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673400b6e0 con 0x7f67400cae90 2023-11-30T17:20:01.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.767+0000 7f673ffff700 1 -- 172.21.15.49:0/2945745334 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673400ba60 con 0x7f67400cae90 2023-11-30T17:20:01.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.768+0000 7f6747694700 1 -- 172.21.15.49:0/2945745334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67400cae90 msgr2=0x7f67400c0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:01.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.768+0000 7f6747694700 1 --2- 172.21.15.49:0/2945745334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67400cae90 0x7f67400c0ab0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f67400a9a00 tx=0x7f6734009060).stop 2023-11-30T17:20:01.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.768+0000 7f6747694700 1 -- 172.21.15.49:0/2945745334 shutdown_connections 2023-11-30T17:20:01.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.768+0000 7f6747694700 1 --2- 172.21.15.49:0/2945745334 >> v2:172.21.15.115:3300/0 conn(0x7f67400ca180 0x7f67400c0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:01.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.768+0000 7f6747694700 1 --2- 172.21.15.49:0/2945745334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67400cae90 0x7f67400c0ab0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:01.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.768+0000 7f6747694700 1 -- 172.21.15.49:0/2945745334 >> 172.21.15.49:0/2945745334 conn(0x7f6740094920 msgr2=0x7f674006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:01.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.768+0000 7f6747694700 1 -- 172.21.15.49:0/2945745334 shutdown_connections 2023-11-30T17:20:01.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.768+0000 7f6747694700 1 -- 172.21.15.49:0/2945745334 wait complete. 2023-11-30T17:20:01.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.769+0000 7f6747694700 1 Processor -- start 2023-11-30T17:20:01.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.769+0000 7f6747694700 1 -- start start 2023-11-30T17:20:01.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.770+0000 7f6747694700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67400ca180 0x7f6740152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:01.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.770+0000 7f6747694700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67400caab0 0x7f67400afa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:01.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.770+0000 7f6747694700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67400cae90 0x7f6740155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:01.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.770+0000 7f6747694700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67400c8220 con 0x7f67400cae90 2023-11-30T17:20:01.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.770+0000 7f6747694700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6740167e80 con 0x7f67400caab0 2023-11-30T17:20:01.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.770+0000 7f6747694700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67400c8470 con 0x7f67400ca180 2023-11-30T17:20:01.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.770+0000 7f6745c31700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67400cae90 0x7f6740155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:01.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.770+0000 7f6745c31700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67400cae90 0x7f6740155ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35046/0 (socket says 172.21.15.49:35046) 2023-11-30T17:20:01.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.770+0000 7f6745c31700 1 -- 172.21.15.49:0/550241991 learned_addr learned my addr 172.21.15.49:0/550241991 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:20:01.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.770+0000 7f6744c2f700 1 --2- 172.21.15.49:0/550241991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67400caab0 0x7f67400afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:01.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.770+0000 7f6745430700 1 --2- 172.21.15.49:0/550241991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67400ca180 0x7f6740152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:01.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.770+0000 7f6745c31700 1 -- 172.21.15.49:0/550241991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67400ca180 msgr2=0x7f6740152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:01.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.770+0000 7f6745c31700 1 --2- 172.21.15.49:0/550241991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67400ca180 0x7f6740152730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:01.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.770+0000 7f6745c31700 1 -- 172.21.15.49:0/550241991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67400caab0 msgr2=0x7f67400afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:01.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.770+0000 7f6745c31700 1 --2- 172.21.15.49:0/550241991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67400caab0 0x7f67400afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:01.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.770+0000 7f6745c31700 1 -- 172.21.15.49:0/550241991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67340092a0 con 0x7f67400cae90 2023-11-30T17:20:01.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.771+0000 7f6745c31700 1 --2- 172.21.15.49:0/550241991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67400cae90 0x7f6740155ed0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f673000bfd0 tx=0x7f6730008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:01.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.771+0000 7f673d7fa700 1 -- 172.21.15.49:0/550241991 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6730011590 con 0x7f67400cae90 2023-11-30T17:20:01.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.771+0000 7f673d7fa700 1 -- 172.21.15.49:0/550241991 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67300116f0 con 0x7f67400cae90 2023-11-30T17:20:01.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.771+0000 7f6747694700 1 -- 172.21.15.49:0/550241991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67400c8750 con 0x7f67400cae90 2023-11-30T17:20:01.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.771+0000 7f673d7fa700 1 -- 172.21.15.49:0/550241991 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6730011a70 con 0x7f67400cae90 2023-11-30T17:20:01.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.771+0000 7f6747694700 1 -- 172.21.15.49:0/550241991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67400c8d10 con 0x7f67400cae90 2023-11-30T17:20:01.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.772+0000 7f6747694700 1 -- 172.21.15.49:0/550241991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6740167ff0 con 0x7f67400cae90 2023-11-30T17:20:01.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.772+0000 7f673d7fa700 1 -- 172.21.15.49:0/550241991 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6730012420 con 0x7f67400cae90 2023-11-30T17:20:01.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.772+0000 7f673d7fa700 1 --2- 172.21.15.49:0/550241991 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f672c05f240 0x7f672c061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:01.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.773+0000 7f673d7fa700 1 -- 172.21.15.49:0/550241991 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6730079dd0 con 0x7f67400cae90 2023-11-30T17:20:01.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.773+0000 7f6745430700 1 --2- 172.21.15.49:0/550241991 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f672c05f240 0x7f672c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:01.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.773+0000 7f6745430700 1 --2- 172.21.15.49:0/550241991 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f672c05f240 0x7f672c061700 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f6738001460 tx=0x7f6738009040).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:01.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.777+0000 7f673d7fa700 1 -- 172.21.15.49:0/550241991 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f673004aec0 con 0x7f67400cae90 2023-11-30T17:20:01.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.944+0000 7f6747694700 1 -- 172.21.15.49:0/550241991 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f674006c860 con 0x7f672c05f240 2023-11-30T17:20:01.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.954+0000 7f673d7fa700 1 -- 172.21.15.49:0/550241991 <== mgr.5449 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359186 (secure 0 0 0) 0x7f674006c860 con 0x7f672c05f240 2023-11-30T17:20:01.960 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:20:01.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.957+0000 7f6747694700 1 -- 172.21.15.49:0/550241991 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f672c05f240 msgr2=0x7f672c061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:01.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.957+0000 7f6747694700 1 --2- 172.21.15.49:0/550241991 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f672c05f240 0x7f672c061700 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f6738001460 tx=0x7f6738009040).stop 2023-11-30T17:20:01.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.957+0000 7f6747694700 1 -- 172.21.15.49:0/550241991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67400cae90 msgr2=0x7f6740155ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:01.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.957+0000 7f6747694700 1 --2- 172.21.15.49:0/550241991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67400cae90 0x7f6740155ed0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f673000bfd0 tx=0x7f6730008040).stop 2023-11-30T17:20:01.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.957+0000 7f6747694700 1 -- 172.21.15.49:0/550241991 shutdown_connections 2023-11-30T17:20:01.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.957+0000 7f6747694700 1 --2- 172.21.15.49:0/550241991 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f672c05f240 0x7f672c061700 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:01.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.957+0000 7f6747694700 1 --2- 172.21.15.49:0/550241991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67400cae90 0x7f6740155ed0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:01.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.957+0000 7f6747694700 1 --2- 172.21.15.49:0/550241991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67400ca180 0x7f6740152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:01.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.957+0000 7f6747694700 1 --2- 172.21.15.49:0/550241991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67400caab0 0x7f67400afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:01.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.957+0000 7f6747694700 1 -- 172.21.15.49:0/550241991 >> 172.21.15.49:0/550241991 conn(0x7f6740094920 msgr2=0x7f67400a9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:01.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.957+0000 7f6747694700 1 -- 172.21.15.49:0/550241991 shutdown_connections 2023-11-30T17:20:01.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:01.957+0000 7f6747694700 1 -- 172.21.15.49:0/550241991 wait complete. 2023-11-30T17:20:01.964 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:20:01.971 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-30T17:20:00.322110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2236,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":252,"acting":252,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":213,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2415544,"kb_used_data":6008,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752559176,"statfs":{"total":773094113280,"available":770620596224,"internally_reserved":0,"allocated":6152192,"data_stored":2991902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14996153,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-721,"num_write_kb":-15547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.999924"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491141+0000","last_change":"2023-11-30T17:19:56.485959+0000","last_active":"2023-11-30T17:19:56.491141+0000","last_peered":"2023-11-30T17:19:56.491141+0000","last_clean":"2023-11-30T17:19:56.491141+0000","last_became_active":"2023-11-30T17:19:56.485404+0000","last_became_peered":"2023-11-30T17:19:56.485404+0000","last_unstale":"2023-11-30T17:19:56.491141+0000","last_undegraded":"2023-11-30T17:19:56.491141+0000","last_fullsized":"2023-11-30T17:19:56.491141+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"64'3","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.497937+0000","last_change":"2023-11-30T17:19:56.097294+0000","last_active":"2023-11-30T17:19:56.497937+0000","last_peered":"2023-11-30T17:19:56.497937+0000","last_clean":"2023-11-30T17:19:56.497937+0000","last_became_active":"2023-11-30T17:19:56.097026+0000","last_became_peered":"2023-11-30T17:19:56.097026+0000","last_unstale":"2023-11-30T17:19:56.497937+0000","last_undegraded":"2023-11-30T17:19:56.497937+0000","last_fullsized":"2023-11-30T17:19:56.497937+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496181+0000","last_change":"2023-11-30T17:19:56.492152+0000","last_active":"2023-11-30T17:19:56.496181+0000","last_peered":"2023-11-30T17:19:56.496181+0000","last_clean":"2023-11-30T17:19:56.496181+0000","last_became_active":"2023-11-30T17:19:56.491843+0000","last_became_peered":"2023-11-30T17:19:56.491843+0000","last_unstale":"2023-11-30T17:19:56.496181+0000","last_undegraded":"2023-11-30T17:19:56.496181+0000","last_fullsized":"2023-11-30T17:19:56.496181+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.480790+0000","last_change":"2023-11-30T17:19:56.112352+0000","last_active":"2023-11-30T17:19:56.480790+0000","last_peered":"2023-11-30T17:19:56.480790+0000","last_clean":"2023-11-30T17:19:56.480790+0000","last_became_active":"2023-11-30T17:19:56.112039+0000","last_became_peered":"2023-11-30T17:19:56.112039+0000","last_unstale":"2023-11-30T17:19:56.480790+0000","last_undegraded":"2023-11-30T17:19:56.480790+0000","last_fullsized":"2023-11-30T17:19:56.480790+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500856+0000","last_change":"2023-11-30T17:19:56.496678+0000","last_active":"2023-11-30T17:19:56.500856+0000","last_peered":"2023-11-30T17:19:56.500856+0000","last_clean":"2023-11-30T17:19:56.500856+0000","last_became_active":"2023-11-30T17:19:56.492155+0000","last_became_peered":"2023-11-30T17:19:56.492155+0000","last_unstale":"2023-11-30T17:19:56.500856+0000","last_undegraded":"2023-11-30T17:19:56.500856+0000","last_fullsized":"2023-11-30T17:19:56.500856+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.082730+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.495745+0000","last_change":"2023-11-30T17:19:56.486081+0000","last_active":"2023-11-30T17:19:56.495745+0000","last_peered":"2023-11-30T17:19:56.495745+0000","last_clean":"2023-11-30T17:19:56.495745+0000","last_became_active":"2023-11-30T17:19:56.485781+0000","last_became_peered":"2023-11-30T17:19:56.485781+0000","last_unstale":"2023-11-30T17:19:56.495745+0000","last_undegraded":"2023-11-30T17:19:56.495745+0000","last_fullsized":"2023-11-30T17:19:56.495745+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"64'2","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.502495+0000","last_change":"2023-11-30T17:19:56.099441+0000","last_active":"2023-11-30T17:19:56.502495+0000","last_peered":"2023-11-30T17:19:56.502495+0000","last_clean":"2023-11-30T17:19:56.502495+0000","last_became_active":"2023-11-30T17:19:56.099054+0000","last_became_peered":"2023-11-30T17:19:56.099054+0000","last_unstale":"2023-11-30T17:19:56.502495+0000","last_undegraded":"2023-11-30T17:19:56.502495+0000","last_fullsized":"2023-11-30T17:19:56.502495+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493845+0000","last_change":"2023-11-30T17:19:56.492808+0000","last_active":"2023-11-30T17:19:56.493845+0000","last_peered":"2023-11-30T17:19:56.493845+0000","last_clean":"2023-11-30T17:19:56.493845+0000","last_became_active":"2023-11-30T17:19:56.492327+0000","last_became_peered":"2023-11-30T17:19:56.492327+0000","last_unstale":"2023-11-30T17:19:56.493845+0000","last_undegraded":"2023-11-30T17:19:56.493845+0000","last_fullsized":"2023-11-30T17:19:56.493845+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3b","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.490891+0000","last_change":"2023-11-30T17:19:56.112328+0000","last_active":"2023-11-30T17:19:56.490891+0000","last_peered":"2023-11-30T17:19:56.490891+0000","last_clean":"2023-11-30T17:19:56.490891+0000","last_became_active":"2023-11-30T17:19:56.112089+0000","last_became_peered":"2023-11-30T17:19:56.112089+0000","last_unstale":"2023-11-30T17:19:56.490891+0000","last_undegraded":"2023-11-30T17:19:56.490891+0000","last_fullsized":"2023-11-30T17:19:56.490891+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.492758+0000","last_change":"2023-11-30T17:19:56.489355+0000","last_active":"2023-11-30T17:19:56.492758+0000","last_peered":"2023-11-30T17:19:56.492758+0000","last_clean":"2023-11-30T17:19:56.492758+0000","last_became_active":"2023-11-30T17:19:56.489081+0000","last_became_peered":"2023-11-30T17:19:56.489081+0000","last_unstale":"2023-11-30T17:19:56.492758+0000","last_undegraded":"2023-11-30T17:19:56.492758+0000","last_fullsized":"2023-11-30T17:19:56.492758+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.489898+0000","last_change":"2023-11-30T17:19:56.095586+0000","last_active":"2023-11-30T17:19:56.489898+0000","last_peered":"2023-11-30T17:19:56.489898+0000","last_clean":"2023-11-30T17:19:56.489898+0000","last_became_active":"2023-11-30T17:19:56.095250+0000","last_became_peered":"2023-11-30T17:19:56.095250+0000","last_unstale":"2023-11-30T17:19:56.489898+0000","last_undegraded":"2023-11-30T17:19:56.489898+0000","last_fullsized":"2023-11-30T17:19:56.489898+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491110+0000","last_change":"2023-11-30T17:19:56.485707+0000","last_active":"2023-11-30T17:19:56.491110+0000","last_peered":"2023-11-30T17:19:56.491110+0000","last_clean":"2023-11-30T17:19:56.491110+0000","last_became_active":"2023-11-30T17:19:56.485420+0000","last_became_peered":"2023-11-30T17:19:56.485420+0000","last_unstale":"2023-11-30T17:19:56.491110+0000","last_undegraded":"2023-11-30T17:19:56.491110+0000","last_fullsized":"2023-11-30T17:19:56.491110+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.483241+0000","last_change":"2023-11-30T17:19:56.096279+0000","last_active":"2023-11-30T17:19:56.483241+0000","last_peered":"2023-11-30T17:19:56.483241+0000","last_clean":"2023-11-30T17:19:56.483241+0000","last_became_active":"2023-11-30T17:19:56.095989+0000","last_became_peered":"2023-11-30T17:19:56.095989+0000","last_unstale":"2023-11-30T17:19:56.483241+0000","last_undegraded":"2023-11-30T17:19:56.483241+0000","last_fullsized":"2023-11-30T17:19:56.483241+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.503846+0000","last_change":"2023-11-30T17:19:56.501562+0000","last_active":"2023-11-30T17:19:56.503846+0000","last_peered":"2023-11-30T17:19:56.503846+0000","last_clean":"2023-11-30T17:19:56.503846+0000","last_became_active":"2023-11-30T17:19:56.501259+0000","last_became_peered":"2023-11-30T17:19:56.501259+0000","last_unstale":"2023-11-30T17:19:56.503846+0000","last_undegraded":"2023-11-30T17:19:56.503846+0000","last_fullsized":"2023-11-30T17:19:56.503846+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.487885+0000","last_change":"2023-11-30T17:19:56.105956+0000","last_active":"2023-11-30T17:19:56.487885+0000","last_peered":"2023-11-30T17:19:56.487885+0000","last_clean":"2023-11-30T17:19:56.487885+0000","last_became_active":"2023-11-30T17:19:56.102562+0000","last_became_peered":"2023-11-30T17:19:56.102562+0000","last_unstale":"2023-11-30T17:19:56.487885+0000","last_undegraded":"2023-11-30T17:19:56.487885+0000","last_fullsized":"2023-11-30T17:19:56.487885+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496983+0000","last_change":"2023-11-30T17:19:56.495039+0000","last_active":"2023-11-30T17:19:56.496983+0000","last_peered":"2023-11-30T17:19:56.496983+0000","last_clean":"2023-11-30T17:19:56.496983+0000","last_became_active":"2023-11-30T17:19:56.494575+0000","last_became_peered":"2023-11-30T17:19:56.494575+0000","last_unstale":"2023-11-30T17:19:56.496983+0000","last_undegraded":"2023-11-30T17:19:56.496983+0000","last_fullsized":"2023-11-30T17:19:56.496983+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.499089+0000","last_change":"2023-11-30T17:19:56.110873+0000","last_active":"2023-11-30T17:19:56.499089+0000","last_peered":"2023-11-30T17:19:56.499089+0000","last_clean":"2023-11-30T17:19:56.499089+0000","last_became_active":"2023-11-30T17:19:56.110385+0000","last_became_peered":"2023-11-30T17:19:56.110385+0000","last_unstale":"2023-11-30T17:19:56.499089+0000","last_undegraded":"2023-11-30T17:19:56.499089+0000","last_fullsized":"2023-11-30T17:19:56.499089+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500826+0000","last_change":"2023-11-30T17:19:56.496567+0000","last_active":"2023-11-30T17:19:56.500826+0000","last_peered":"2023-11-30T17:19:56.500826+0000","last_clean":"2023-11-30T17:19:56.500826+0000","last_became_active":"2023-11-30T17:19:56.496282+0000","last_became_peered":"2023-11-30T17:19:56.496282+0000","last_unstale":"2023-11-30T17:19:56.500826+0000","last_undegraded":"2023-11-30T17:19:56.500826+0000","last_fullsized":"2023-11-30T17:19:56.500826+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.494906+0000","last_change":"2023-11-30T17:19:56.105548+0000","last_active":"2023-11-30T17:19:56.494906+0000","last_peered":"2023-11-30T17:19:56.494906+0000","last_clean":"2023-11-30T17:19:56.494906+0000","last_became_active":"2023-11-30T17:19:56.099867+0000","last_became_peered":"2023-11-30T17:19:56.099867+0000","last_unstale":"2023-11-30T17:19:56.494906+0000","last_undegraded":"2023-11-30T17:19:56.494906+0000","last_fullsized":"2023-11-30T17:19:56.494906+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.495750+0000","last_change":"2023-11-30T17:19:56.490226+0000","last_active":"2023-11-30T17:19:56.495750+0000","last_peered":"2023-11-30T17:19:56.495750+0000","last_clean":"2023-11-30T17:19:56.495750+0000","last_became_active":"2023-11-30T17:19:56.490008+0000","last_became_peered":"2023-11-30T17:19:56.490008+0000","last_unstale":"2023-11-30T17:19:56.495750+0000","last_undegraded":"2023-11-30T17:19:56.495750+0000","last_fullsized":"2023-11-30T17:19:56.495750+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498921+0000","last_change":"2023-11-30T17:19:56.110057+0000","last_active":"2023-11-30T17:19:56.498921+0000","last_peered":"2023-11-30T17:19:56.498921+0000","last_clean":"2023-11-30T17:19:56.498921+0000","last_became_active":"2023-11-30T17:19:56.109561+0000","last_became_peered":"2023-11-30T17:19:56.109561+0000","last_unstale":"2023-11-30T17:19:56.498921+0000","last_undegraded":"2023-11-30T17:19:56.498921+0000","last_fullsized":"2023-11-30T17:19:56.498921+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"64'4","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498286+0000","last_change":"2023-11-30T17:19:56.099632+0000","last_active":"2023-11-30T17:19:56.498286+0000","last_peered":"2023-11-30T17:19:56.498286+0000","last_clean":"2023-11-30T17:19:56.498286+0000","last_became_active":"2023-11-30T17:19:56.099366+0000","last_became_peered":"2023-11-30T17:19:56.099366+0000","last_unstale":"2023-11-30T17:19:56.498286+0000","last_undegraded":"2023-11-30T17:19:56.498286+0000","last_fullsized":"2023-11-30T17:19:56.498286+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.492794+0000","last_change":"2023-11-30T17:19:56.490274+0000","last_active":"2023-11-30T17:19:56.492794+0000","last_peered":"2023-11-30T17:19:56.492794+0000","last_clean":"2023-11-30T17:19:56.492794+0000","last_became_active":"2023-11-30T17:19:56.490014+0000","last_became_peered":"2023-11-30T17:19:56.490014+0000","last_unstale":"2023-11-30T17:19:56.492794+0000","last_undegraded":"2023-11-30T17:19:56.492794+0000","last_fullsized":"2023-11-30T17:19:56.492794+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.492148+0000","last_change":"2023-11-30T17:19:56.104864+0000","last_active":"2023-11-30T17:19:56.492148+0000","last_peered":"2023-11-30T17:19:56.492148+0000","last_clean":"2023-11-30T17:19:56.492148+0000","last_became_active":"2023-11-30T17:19:56.104590+0000","last_became_peered":"2023-11-30T17:19:56.104590+0000","last_unstale":"2023-11-30T17:19:56.492148+0000","last_undegraded":"2023-11-30T17:19:56.492148+0000","last_fullsized":"2023-11-30T17:19:56.492148+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.502029+0000","last_change":"2023-11-30T17:19:56.499597+0000","last_active":"2023-11-30T17:19:56.502029+0000","last_peered":"2023-11-30T17:19:56.502029+0000","last_clean":"2023-11-30T17:19:56.502029+0000","last_became_active":"2023-11-30T17:19:56.499146+0000","last_became_peered":"2023-11-30T17:19:56.499146+0000","last_unstale":"2023-11-30T17:19:56.502029+0000","last_undegraded":"2023-11-30T17:19:56.502029+0000","last_fullsized":"2023-11-30T17:19:56.502029+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.487477+0000","last_change":"2023-11-30T17:19:56.110204+0000","last_active":"2023-11-30T17:19:56.487477+0000","last_peered":"2023-11-30T17:19:56.487477+0000","last_clean":"2023-11-30T17:19:56.487477+0000","last_became_active":"2023-11-30T17:19:56.109745+0000","last_became_peered":"2023-11-30T17:19:56.109745+0000","last_unstale":"2023-11-30T17:19:56.487477+0000","last_undegraded":"2023-11-30T17:19:56.487477+0000","last_fullsized":"2023-11-30T17:19:56.487477+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498693+0000","last_change":"2023-11-30T17:19:56.494965+0000","last_active":"2023-11-30T17:19:56.498693+0000","last_peered":"2023-11-30T17:19:56.498693+0000","last_clean":"2023-11-30T17:19:56.498693+0000","last_became_active":"2023-11-30T17:19:56.494662+0000","last_became_peered":"2023-11-30T17:19:56.494662+0000","last_unstale":"2023-11-30T17:19:56.498693+0000","last_undegraded":"2023-11-30T17:19:56.498693+0000","last_fullsized":"2023-11-30T17:19:56.498693+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.476196+0000","last_change":"2023-11-30T17:19:56.100686+0000","last_active":"2023-11-30T17:19:56.476196+0000","last_peered":"2023-11-30T17:19:56.476196+0000","last_clean":"2023-11-30T17:19:56.476196+0000","last_became_active":"2023-11-30T17:19:56.100418+0000","last_became_peered":"2023-11-30T17:19:56.100418+0000","last_unstale":"2023-11-30T17:19:56.476196+0000","last_undegraded":"2023-11-30T17:19:56.476196+0000","last_fullsized":"2023-11-30T17:19:56.476196+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496351+0000","last_change":"2023-11-30T17:19:56.493474+0000","last_active":"2023-11-30T17:19:56.496351+0000","last_peered":"2023-11-30T17:19:56.496351+0000","last_clean":"2023-11-30T17:19:56.496351+0000","last_became_active":"2023-11-30T17:19:56.493191+0000","last_became_peered":"2023-11-30T17:19:56.493191+0000","last_unstale":"2023-11-30T17:19:56.496351+0000","last_undegraded":"2023-11-30T17:19:56.496351+0000","last_fullsized":"2023-11-30T17:19:56.496351+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.077396+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493563+0000","last_change":"2023-11-30T17:19:56.486088+0000","last_active":"2023-11-30T17:19:56.493563+0000","last_peered":"2023-11-30T17:19:56.493563+0000","last_clean":"2023-11-30T17:19:56.493563+0000","last_became_active":"2023-11-30T17:19:56.485651+0000","last_became_peered":"2023-11-30T17:19:56.485651+0000","last_unstale":"2023-11-30T17:19:56.493563+0000","last_undegraded":"2023-11-30T17:19:56.493563+0000","last_fullsized":"2023-11-30T17:19:56.493563+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.083264+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.495220+0000","last_change":"2023-11-30T17:19:56.491494+0000","last_active":"2023-11-30T17:19:56.495220+0000","last_peered":"2023-11-30T17:19:56.495220+0000","last_clean":"2023-11-30T17:19:56.495220+0000","last_became_active":"2023-11-30T17:19:56.491200+0000","last_became_peered":"2023-11-30T17:19:56.491200+0000","last_unstale":"2023-11-30T17:19:56.495220+0000","last_undegraded":"2023-11-30T17:19:56.495220+0000","last_fullsized":"2023-11-30T17:19:56.495220+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.084005+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.499018+0000","last_change":"2023-11-30T17:19:56.496795+0000","last_active":"2023-11-30T17:19:56.499018+0000","last_peered":"2023-11-30T17:19:56.499018+0000","last_clean":"2023-11-30T17:19:56.499018+0000","last_became_active":"2023-11-30T17:19:56.496519+0000","last_became_peered":"2023-11-30T17:19:56.496519+0000","last_unstale":"2023-11-30T17:19:56.499018+0000","last_undegraded":"2023-11-30T17:19:56.499018+0000","last_fullsized":"2023-11-30T17:19:56.499018+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.078100+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500642+0000","last_change":"2023-11-30T17:19:56.494936+0000","last_active":"2023-11-30T17:19:56.500642+0000","last_peered":"2023-11-30T17:19:56.500642+0000","last_clean":"2023-11-30T17:19:56.500642+0000","last_became_active":"2023-11-30T17:19:56.494628+0000","last_became_peered":"2023-11-30T17:19:56.494628+0000","last_unstale":"2023-11-30T17:19:56.500642+0000","last_undegraded":"2023-11-30T17:19:56.500642+0000","last_fullsized":"2023-11-30T17:19:56.500642+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.476989+0000","last_change":"2023-11-30T17:19:56.103835+0000","last_active":"2023-11-30T17:19:56.476989+0000","last_peered":"2023-11-30T17:19:56.476989+0000","last_clean":"2023-11-30T17:19:56.476989+0000","last_became_active":"2023-11-30T17:19:56.103532+0000","last_became_peered":"2023-11-30T17:19:56.103532+0000","last_unstale":"2023-11-30T17:19:56.476989+0000","last_undegraded":"2023-11-30T17:19:56.476989+0000","last_fullsized":"2023-11-30T17:19:56.476989+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.488294+0000","last_change":"2023-11-30T17:19:56.105248+0000","last_active":"2023-11-30T17:19:56.488294+0000","last_peered":"2023-11-30T17:19:56.488294+0000","last_clean":"2023-11-30T17:19:56.488294+0000","last_became_active":"2023-11-30T17:19:56.104768+0000","last_became_peered":"2023-11-30T17:19:56.104768+0000","last_unstale":"2023-11-30T17:19:56.488294+0000","last_undegraded":"2023-11-30T17:19:56.488294+0000","last_fullsized":"2023-11-30T17:19:56.488294+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496346+0000","last_change":"2023-11-30T17:19:56.490952+0000","last_active":"2023-11-30T17:19:56.496346+0000","last_peered":"2023-11-30T17:19:56.496346+0000","last_clean":"2023-11-30T17:19:56.496346+0000","last_became_active":"2023-11-30T17:19:56.490730+0000","last_became_peered":"2023-11-30T17:19:56.490730+0000","last_unstale":"2023-11-30T17:19:56.496346+0000","last_undegraded":"2023-11-30T17:19:56.496346+0000","last_fullsized":"2023-11-30T17:19:56.496346+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.487354+0000","last_change":"2023-11-30T17:19:56.105606+0000","last_active":"2023-11-30T17:19:56.487354+0000","last_peered":"2023-11-30T17:19:56.487354+0000","last_clean":"2023-11-30T17:19:56.487354+0000","last_became_active":"2023-11-30T17:19:56.104380+0000","last_became_peered":"2023-11-30T17:19:56.104380+0000","last_unstale":"2023-11-30T17:19:56.487354+0000","last_undegraded":"2023-11-30T17:19:56.487354+0000","last_fullsized":"2023-11-30T17:19:56.487354+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491376+0000","last_change":"2023-11-30T17:19:56.488970+0000","last_active":"2023-11-30T17:19:56.491376+0000","last_peered":"2023-11-30T17:19:56.491376+0000","last_clean":"2023-11-30T17:19:56.491376+0000","last_became_active":"2023-11-30T17:19:56.488343+0000","last_became_peered":"2023-11-30T17:19:56.488343+0000","last_unstale":"2023-11-30T17:19:56.491376+0000","last_undegraded":"2023-11-30T17:19:56.491376+0000","last_fullsized":"2023-11-30T17:19:56.491376+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.077908+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498741+0000","last_change":"2023-11-30T17:19:56.490432+0000","last_active":"2023-11-30T17:19:56.498741+0000","last_peered":"2023-11-30T17:19:56.498741+0000","last_clean":"2023-11-30T17:19:56.498741+0000","last_became_active":"2023-11-30T17:19:56.490159+0000","last_became_peered":"2023-11-30T17:19:56.490159+0000","last_unstale":"2023-11-30T17:19:56.498741+0000","last_undegraded":"2023-11-30T17:19:56.498741+0000","last_fullsized":"2023-11-30T17:19:56.498741+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.076864+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.494582+0000","last_change":"2023-11-30T17:19:56.490029+0000","last_active":"2023-11-30T17:19:56.494582+0000","last_peered":"2023-11-30T17:19:56.494582+0000","last_clean":"2023-11-30T17:19:56.494582+0000","last_became_active":"2023-11-30T17:19:56.488809+0000","last_became_peered":"2023-11-30T17:19:56.488809+0000","last_unstale":"2023-11-30T17:19:56.494582+0000","last_undegraded":"2023-11-30T17:19:56.494582+0000","last_fullsized":"2023-11-30T17:19:56.494582+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.079249+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493787+0000","last_change":"2023-11-30T17:19:56.492227+0000","last_active":"2023-11-30T17:19:56.493787+0000","last_peered":"2023-11-30T17:19:56.493787+0000","last_clean":"2023-11-30T17:19:56.493787+0000","last_became_active":"2023-11-30T17:19:56.491955+0000","last_became_peered":"2023-11-30T17:19:56.491955+0000","last_unstale":"2023-11-30T17:19:56.493787+0000","last_undegraded":"2023-11-30T17:19:56.493787+0000","last_fullsized":"2023-11-30T17:19:56.493787+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.475983+0000","last_change":"2023-11-30T17:19:56.105360+0000","last_active":"2023-11-30T17:19:56.475983+0000","last_peered":"2023-11-30T17:19:56.475983+0000","last_clean":"2023-11-30T17:19:56.475983+0000","last_became_active":"2023-11-30T17:19:56.105084+0000","last_became_peered":"2023-11-30T17:19:56.105084+0000","last_unstale":"2023-11-30T17:19:56.475983+0000","last_undegraded":"2023-11-30T17:19:56.475983+0000","last_fullsized":"2023-11-30T17:19:56.475983+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491335+0000","last_change":"2023-11-30T17:19:56.488160+0000","last_active":"2023-11-30T17:19:56.491335+0000","last_peered":"2023-11-30T17:19:56.491335+0000","last_clean":"2023-11-30T17:19:56.491335+0000","last_became_active":"2023-11-30T17:19:56.487871+0000","last_became_peered":"2023-11-30T17:19:56.487871+0000","last_unstale":"2023-11-30T17:19:56.491335+0000","last_undegraded":"2023-11-30T17:19:56.491335+0000","last_fullsized":"2023-11-30T17:19:56.491335+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.082342+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.479299+0000","last_change":"2023-11-30T17:19:56.098747+0000","last_active":"2023-11-30T17:19:56.479299+0000","last_peered":"2023-11-30T17:19:56.479299+0000","last_clean":"2023-11-30T17:19:56.479299+0000","last_became_active":"2023-11-30T17:19:56.098096+0000","last_became_peered":"2023-11-30T17:19:56.098096+0000","last_unstale":"2023-11-30T17:19:56.479299+0000","last_undegraded":"2023-11-30T17:19:56.479299+0000","last_fullsized":"2023-11-30T17:19:56.479299+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.076958+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.502012+0000","last_change":"2023-11-30T17:19:56.499411+0000","last_active":"2023-11-30T17:19:56.502012+0000","last_peered":"2023-11-30T17:19:56.502012+0000","last_clean":"2023-11-30T17:19:56.502012+0000","last_became_active":"2023-11-30T17:19:56.497013+0000","last_became_peered":"2023-11-30T17:19:56.497013+0000","last_unstale":"2023-11-30T17:19:56.502012+0000","last_undegraded":"2023-11-30T17:19:56.502012+0000","last_fullsized":"2023-11-30T17:19:56.502012+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.082939+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498714+0000","last_change":"2023-11-30T17:19:56.495065+0000","last_active":"2023-11-30T17:19:56.498714+0000","last_peered":"2023-11-30T17:19:56.498714+0000","last_clean":"2023-11-30T17:19:56.498714+0000","last_became_active":"2023-11-30T17:19:56.494734+0000","last_became_peered":"2023-11-30T17:19:56.494734+0000","last_unstale":"2023-11-30T17:19:56.498714+0000","last_undegraded":"2023-11-30T17:19:56.498714+0000","last_fullsized":"2023-11-30T17:19:56.498714+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.476094+0000","last_change":"2023-11-30T17:19:56.100559+0000","last_active":"2023-11-30T17:19:56.476094+0000","last_peered":"2023-11-30T17:19:56.476094+0000","last_clean":"2023-11-30T17:19:56.476094+0000","last_became_active":"2023-11-30T17:19:56.100267+0000","last_became_peered":"2023-11-30T17:19:56.100267+0000","last_unstale":"2023-11-30T17:19:56.476094+0000","last_undegraded":"2023-11-30T17:19:56.476094+0000","last_fullsized":"2023-11-30T17:19:56.476094+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.502077+0000","last_change":"2023-11-30T17:19:56.499755+0000","last_active":"2023-11-30T17:19:56.502077+0000","last_peered":"2023-11-30T17:19:56.502077+0000","last_clean":"2023-11-30T17:19:56.502077+0000","last_became_active":"2023-11-30T17:19:56.499465+0000","last_became_peered":"2023-11-30T17:19:56.499465+0000","last_unstale":"2023-11-30T17:19:56.502077+0000","last_undegraded":"2023-11-30T17:19:56.502077+0000","last_fullsized":"2023-11-30T17:19:56.502077+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.477375+0000","last_change":"2023-11-30T17:19:56.088985+0000","last_active":"2023-11-30T17:19:56.477375+0000","last_peered":"2023-11-30T17:19:56.477375+0000","last_clean":"2023-11-30T17:19:56.477375+0000","last_became_active":"2023-11-30T17:19:56.088686+0000","last_became_peered":"2023-11-30T17:19:56.088686+0000","last_unstale":"2023-11-30T17:19:56.477375+0000","last_undegraded":"2023-11-30T17:19:56.477375+0000","last_fullsized":"2023-11-30T17:19:56.477375+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.499116+0000","last_change":"2023-11-30T17:19:56.495412+0000","last_active":"2023-11-30T17:19:56.499116+0000","last_peered":"2023-11-30T17:19:56.499116+0000","last_clean":"2023-11-30T17:19:56.499116+0000","last_became_active":"2023-11-30T17:19:56.494719+0000","last_became_peered":"2023-11-30T17:19:56.494719+0000","last_unstale":"2023-11-30T17:19:56.499116+0000","last_undegraded":"2023-11-30T17:19:56.499116+0000","last_fullsized":"2023-11-30T17:19:56.499116+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.078834+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.497842+0000","last_change":"2023-11-30T17:19:56.496872+0000","last_active":"2023-11-30T17:19:56.497842+0000","last_peered":"2023-11-30T17:19:56.497842+0000","last_clean":"2023-11-30T17:19:56.497842+0000","last_became_active":"2023-11-30T17:19:56.496614+0000","last_became_peered":"2023-11-30T17:19:56.496614+0000","last_unstale":"2023-11-30T17:19:56.497842+0000","last_undegraded":"2023-11-30T17:19:56.497842+0000","last_fullsized":"2023-11-30T17:19:56.497842+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491029+0000","last_change":"2023-11-30T17:19:56.104114+0000","last_active":"2023-11-30T17:19:56.491029+0000","last_peered":"2023-11-30T17:19:56.491029+0000","last_clean":"2023-11-30T17:19:56.491029+0000","last_became_active":"2023-11-30T17:19:56.103835+0000","last_became_peered":"2023-11-30T17:19:56.103835+0000","last_unstale":"2023-11-30T17:19:56.491029+0000","last_undegraded":"2023-11-30T17:19:56.491029+0000","last_fullsized":"2023-11-30T17:19:56.491029+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"64'2","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500313+0000","last_change":"2023-11-30T17:19:56.087339+0000","last_active":"2023-11-30T17:19:56.500313+0000","last_peered":"2023-11-30T17:19:56.500313+0000","last_clean":"2023-11-30T17:19:56.500313+0000","last_became_active":"2023-11-30T17:19:56.086993+0000","last_became_peered":"2023-11-30T17:19:56.086993+0000","last_unstale":"2023-11-30T17:19:56.500313+0000","last_undegraded":"2023-11-30T17:19:56.500313+0000","last_fullsized":"2023-11-30T17:19:56.500313+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491920+0000","last_change":"2023-11-30T17:19:56.489159+0000","last_active":"2023-11-30T17:19:56.491920+0000","last_peered":"2023-11-30T17:19:56.491920+0000","last_clean":"2023-11-30T17:19:56.491920+0000","last_became_active":"2023-11-30T17:19:56.488952+0000","last_became_peered":"2023-11-30T17:19:56.488952+0000","last_unstale":"2023-11-30T17:19:56.491920+0000","last_undegraded":"2023-11-30T17:19:56.491920+0000","last_fullsized":"2023-11-30T17:19:56.491920+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.479404+0000","last_change":"2023-11-30T17:19:56.098371+0000","last_active":"2023-11-30T17:19:56.479404+0000","last_peered":"2023-11-30T17:19:56.479404+0000","last_clean":"2023-11-30T17:19:56.479404+0000","last_became_active":"2023-11-30T17:19:56.097768+0000","last_became_peered":"2023-11-30T17:19:56.097768+0000","last_unstale":"2023-11-30T17:19:56.479404+0000","last_undegraded":"2023-11-30T17:19:56.479404+0000","last_fullsized":"2023-11-30T17:19:56.479404+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.494168+0000","last_change":"2023-11-30T17:19:56.107222+0000","last_active":"2023-11-30T17:19:56.494168+0000","last_peered":"2023-11-30T17:19:56.494168+0000","last_clean":"2023-11-30T17:19:56.494168+0000","last_became_active":"2023-11-30T17:19:56.106944+0000","last_became_peered":"2023-11-30T17:19:56.106944+0000","last_unstale":"2023-11-30T17:19:56.494168+0000","last_undegraded":"2023-11-30T17:19:56.494168+0000","last_fullsized":"2023-11-30T17:19:56.494168+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.499076+0000","last_change":"2023-11-30T17:19:56.497589+0000","last_active":"2023-11-30T17:19:56.499076+0000","last_peered":"2023-11-30T17:19:56.499076+0000","last_clean":"2023-11-30T17:19:56.499076+0000","last_became_active":"2023-11-30T17:19:56.497315+0000","last_became_peered":"2023-11-30T17:19:56.497315+0000","last_unstale":"2023-11-30T17:19:56.499076+0000","last_undegraded":"2023-11-30T17:19:56.499076+0000","last_fullsized":"2023-11-30T17:19:56.499076+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.082279+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491354+0000","last_change":"2023-11-30T17:19:56.488325+0000","last_active":"2023-11-30T17:19:56.491354+0000","last_peered":"2023-11-30T17:19:56.491354+0000","last_clean":"2023-11-30T17:19:56.491354+0000","last_became_active":"2023-11-30T17:19:56.488024+0000","last_became_peered":"2023-11-30T17:19:56.488024+0000","last_unstale":"2023-11-30T17:19:56.491354+0000","last_undegraded":"2023-11-30T17:19:56.491354+0000","last_fullsized":"2023-11-30T17:19:56.491354+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.077413+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.502394+0000","last_change":"2023-11-30T17:19:56.501622+0000","last_active":"2023-11-30T17:19:56.502394+0000","last_peered":"2023-11-30T17:19:56.502394+0000","last_clean":"2023-11-30T17:19:56.502394+0000","last_became_active":"2023-11-30T17:19:56.501307+0000","last_became_peered":"2023-11-30T17:19:56.501307+0000","last_unstale":"2023-11-30T17:19:56.502394+0000","last_undegraded":"2023-11-30T17:19:56.502394+0000","last_fullsized":"2023-11-30T17:19:56.502394+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.487985+0000","last_change":"2023-11-30T17:19:56.104353+0000","last_active":"2023-11-30T17:19:56.487985+0000","last_peered":"2023-11-30T17:19:56.487985+0000","last_clean":"2023-11-30T17:19:56.487985+0000","last_became_active":"2023-11-30T17:19:56.102240+0000","last_became_peered":"2023-11-30T17:19:56.102240+0000","last_unstale":"2023-11-30T17:19:56.487985+0000","last_undegraded":"2023-11-30T17:19:56.487985+0000","last_fullsized":"2023-11-30T17:19:56.487985+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.484948+0000","last_change":"2023-11-30T17:19:56.103000+0000","last_active":"2023-11-30T17:19:56.484948+0000","last_peered":"2023-11-30T17:19:56.484948+0000","last_clean":"2023-11-30T17:19:56.484948+0000","last_became_active":"2023-11-30T17:19:56.102778+0000","last_became_peered":"2023-11-30T17:19:56.102778+0000","last_unstale":"2023-11-30T17:19:56.484948+0000","last_undegraded":"2023-11-30T17:19:56.484948+0000","last_fullsized":"2023-11-30T17:19:56.484948+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.494098+0000","last_change":"2023-11-30T17:19:56.490277+0000","last_active":"2023-11-30T17:19:56.494098+0000","last_peered":"2023-11-30T17:19:56.494098+0000","last_clean":"2023-11-30T17:19:56.494098+0000","last_became_active":"2023-11-30T17:19:56.490009+0000","last_became_peered":"2023-11-30T17:19:56.490009+0000","last_unstale":"2023-11-30T17:19:56.494098+0000","last_undegraded":"2023-11-30T17:19:56.494098+0000","last_fullsized":"2023-11-30T17:19:56.494098+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.083351+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.501207+0000","last_change":"2023-11-30T17:19:56.499008+0000","last_active":"2023-11-30T17:19:56.501207+0000","last_peered":"2023-11-30T17:19:56.501207+0000","last_clean":"2023-11-30T17:19:56.501207+0000","last_became_active":"2023-11-30T17:19:56.498726+0000","last_became_peered":"2023-11-30T17:19:56.498726+0000","last_unstale":"2023-11-30T17:19:56.501207+0000","last_undegraded":"2023-11-30T17:19:56.501207+0000","last_fullsized":"2023-11-30T17:19:56.501207+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"64'3","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.497982+0000","last_change":"2023-11-30T17:19:56.099588+0000","last_active":"2023-11-30T17:19:56.497982+0000","last_peered":"2023-11-30T17:19:56.497982+0000","last_clean":"2023-11-30T17:19:56.497982+0000","last_became_active":"2023-11-30T17:19:56.099307+0000","last_became_peered":"2023-11-30T17:19:56.099307+0000","last_unstale":"2023-11-30T17:19:56.497982+0000","last_undegraded":"2023-11-30T17:19:56.497982+0000","last_fullsized":"2023-11-30T17:19:56.497982+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"64'2","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493354+0000","last_change":"2023-11-30T17:19:56.099031+0000","last_active":"2023-11-30T17:19:56.493354+0000","last_peered":"2023-11-30T17:19:56.493354+0000","last_clean":"2023-11-30T17:19:56.493354+0000","last_became_active":"2023-11-30T17:19:56.098676+0000","last_became_peered":"2023-11-30T17:19:56.098676+0000","last_unstale":"2023-11-30T17:19:56.493354+0000","last_undegraded":"2023-11-30T17:19:56.493354+0000","last_fullsized":"2023-11-30T17:19:56.493354+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498229+0000","last_change":"2023-11-30T17:19:56.493423+0000","last_active":"2023-11-30T17:19:56.498229+0000","last_peered":"2023-11-30T17:19:56.498229+0000","last_clean":"2023-11-30T17:19:56.498229+0000","last_became_active":"2023-11-30T17:19:56.493141+0000","last_became_peered":"2023-11-30T17:19:56.493141+0000","last_unstale":"2023-11-30T17:19:56.498229+0000","last_undegraded":"2023-11-30T17:19:56.498229+0000","last_fullsized":"2023-11-30T17:19:56.498229+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.501063+0000","last_change":"2023-11-30T17:19:56.106743+0000","last_active":"2023-11-30T17:19:56.501063+0000","last_peered":"2023-11-30T17:19:56.501063+0000","last_clean":"2023-11-30T17:19:56.501063+0000","last_became_active":"2023-11-30T17:19:56.106450+0000","last_became_peered":"2023-11-30T17:19:56.106450+0000","last_unstale":"2023-11-30T17:19:56.501063+0000","last_undegraded":"2023-11-30T17:19:56.501063+0000","last_fullsized":"2023-11-30T17:19:56.501063+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500981+0000","last_change":"2023-11-30T17:19:56.497411+0000","last_active":"2023-11-30T17:19:56.500981+0000","last_peered":"2023-11-30T17:19:56.500981+0000","last_clean":"2023-11-30T17:19:56.500981+0000","last_became_active":"2023-11-30T17:19:56.487506+0000","last_became_peered":"2023-11-30T17:19:56.487506+0000","last_unstale":"2023-11-30T17:19:56.500981+0000","last_undegraded":"2023-11-30T17:19:56.500981+0000","last_fullsized":"2023-11-30T17:19:56.500981+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.078221+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491429+0000","last_change":"2023-11-30T17:19:56.490367+0000","last_active":"2023-11-30T17:19:56.491429+0000","last_peered":"2023-11-30T17:19:56.491429+0000","last_clean":"2023-11-30T17:19:56.491429+0000","last_became_active":"2023-11-30T17:19:56.490117+0000","last_became_peered":"2023-11-30T17:19:56.490117+0000","last_unstale":"2023-11-30T17:19:56.491429+0000","last_undegraded":"2023-11-30T17:19:56.491429+0000","last_fullsized":"2023-11-30T17:19:56.491429+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.483337+0000","last_change":"2023-11-30T17:19:56.100665+0000","last_active":"2023-11-30T17:19:56.483337+0000","last_peered":"2023-11-30T17:19:56.483337+0000","last_clean":"2023-11-30T17:19:56.483337+0000","last_became_active":"2023-11-30T17:19:56.100289+0000","last_became_peered":"2023-11-30T17:19:56.100289+0000","last_unstale":"2023-11-30T17:19:56.483337+0000","last_undegraded":"2023-11-30T17:19:56.483337+0000","last_fullsized":"2023-11-30T17:19:56.483337+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.501995+0000","last_change":"2023-11-30T17:19:56.499238+0000","last_active":"2023-11-30T17:19:56.501995+0000","last_peered":"2023-11-30T17:19:56.501995+0000","last_clean":"2023-11-30T17:19:56.501995+0000","last_became_active":"2023-11-30T17:19:56.498862+0000","last_became_peered":"2023-11-30T17:19:56.498862+0000","last_unstale":"2023-11-30T17:19:56.501995+0000","last_undegraded":"2023-11-30T17:19:56.501995+0000","last_fullsized":"2023-11-30T17:19:56.501995+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"64'4","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493785+0000","last_change":"2023-11-30T17:19:56.104095+0000","last_active":"2023-11-30T17:19:56.493785+0000","last_peered":"2023-11-30T17:19:56.493785+0000","last_clean":"2023-11-30T17:19:56.493785+0000","last_became_active":"2023-11-30T17:19:56.103816+0000","last_became_peered":"2023-11-30T17:19:56.103816+0000","last_unstale":"2023-11-30T17:19:56.493785+0000","last_undegraded":"2023-11-30T17:19:56.493785+0000","last_fullsized":"2023-11-30T17:19:56.493785+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496102+0000","last_change":"2023-11-30T17:19:56.494855+0000","last_active":"2023-11-30T17:19:56.496102+0000","last_peered":"2023-11-30T17:19:56.496102+0000","last_clean":"2023-11-30T17:19:56.496102+0000","last_became_active":"2023-11-30T17:19:56.494231+0000","last_became_peered":"2023-11-30T17:19:56.494231+0000","last_unstale":"2023-11-30T17:19:56.496102+0000","last_undegraded":"2023-11-30T17:19:56.496102+0000","last_fullsized":"2023-11-30T17:19:56.496102+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.504017+0000","last_change":"2023-11-30T17:19:56.108216+0000","last_active":"2023-11-30T17:19:56.504017+0000","last_peered":"2023-11-30T17:19:56.504017+0000","last_clean":"2023-11-30T17:19:56.504017+0000","last_became_active":"2023-11-30T17:19:56.107938+0000","last_became_peered":"2023-11-30T17:19:56.107938+0000","last_unstale":"2023-11-30T17:19:56.504017+0000","last_undegraded":"2023-11-30T17:19:56.504017+0000","last_fullsized":"2023-11-30T17:19:56.504017+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.495894+0000","last_change":"2023-11-30T17:19:56.490237+0000","last_active":"2023-11-30T17:19:56.495894+0000","last_peered":"2023-11-30T17:19:56.495894+0000","last_clean":"2023-11-30T17:19:56.495894+0000","last_became_active":"2023-11-30T17:19:56.489940+0000","last_became_peered":"2023-11-30T17:19:56.489940+0000","last_unstale":"2023-11-30T17:19:56.495894+0000","last_undegraded":"2023-11-30T17:19:56.495894+0000","last_fullsized":"2023-11-30T17:19:56.495894+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"64'2","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.492593+0000","last_change":"2023-11-30T17:19:56.100743+0000","last_active":"2023-11-30T17:19:56.492593+0000","last_peered":"2023-11-30T17:19:56.492593+0000","last_clean":"2023-11-30T17:19:56.492593+0000","last_became_active":"2023-11-30T17:19:56.100431+0000","last_became_peered":"2023-11-30T17:19:56.100431+0000","last_unstale":"2023-11-30T17:19:56.492593+0000","last_undegraded":"2023-11-30T17:19:56.492593+0000","last_fullsized":"2023-11-30T17:19:56.492593+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.077671+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496432+0000","last_change":"2023-11-30T17:19:56.493539+0000","last_active":"2023-11-30T17:19:56.496432+0000","last_peered":"2023-11-30T17:19:56.496432+0000","last_clean":"2023-11-30T17:19:56.496432+0000","last_became_active":"2023-11-30T17:19:56.493211+0000","last_became_peered":"2023-11-30T17:19:56.493211+0000","last_unstale":"2023-11-30T17:19:56.496432+0000","last_undegraded":"2023-11-30T17:19:56.496432+0000","last_fullsized":"2023-11-30T17:19:56.496432+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.078432+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498207+0000","last_change":"2023-11-30T17:19:56.492263+0000","last_active":"2023-11-30T17:19:56.498207+0000","last_peered":"2023-11-30T17:19:56.498207+0000","last_clean":"2023-11-30T17:19:56.498207+0000","last_became_active":"2023-11-30T17:19:56.491997+0000","last_became_peered":"2023-11-30T17:19:56.491997+0000","last_unstale":"2023-11-30T17:19:56.498207+0000","last_undegraded":"2023-11-30T17:19:56.498207+0000","last_fullsized":"2023-11-30T17:19:56.498207+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493638+0000","last_change":"2023-11-30T17:19:56.101187+0000","last_active":"2023-11-30T17:19:56.493638+0000","last_peered":"2023-11-30T17:19:56.493638+0000","last_clean":"2023-11-30T17:19:56.493638+0000","last_became_active":"2023-11-30T17:19:56.100914+0000","last_became_peered":"2023-11-30T17:19:56.100914+0000","last_unstale":"2023-11-30T17:19:56.493638+0000","last_undegraded":"2023-11-30T17:19:56.493638+0000","last_fullsized":"2023-11-30T17:19:56.493638+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.476956+0000","last_change":"2023-11-30T17:19:56.099958+0000","last_active":"2023-11-30T17:19:56.476956+0000","last_peered":"2023-11-30T17:19:56.476956+0000","last_clean":"2023-11-30T17:19:56.476956+0000","last_became_active":"2023-11-30T17:19:56.099666+0000","last_became_peered":"2023-11-30T17:19:56.099666+0000","last_unstale":"2023-11-30T17:19:56.476956+0000","last_undegraded":"2023-11-30T17:19:56.476956+0000","last_fullsized":"2023-11-30T17:19:56.476956+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500920+0000","last_change":"2023-11-30T17:19:56.497005+0000","last_active":"2023-11-30T17:19:56.500920+0000","last_peered":"2023-11-30T17:19:56.500920+0000","last_clean":"2023-11-30T17:19:56.500920+0000","last_became_active":"2023-11-30T17:19:56.496751+0000","last_became_peered":"2023-11-30T17:19:56.496751+0000","last_unstale":"2023-11-30T17:19:56.500920+0000","last_undegraded":"2023-11-30T17:19:56.500920+0000","last_fullsized":"2023-11-30T17:19:56.500920+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.485997+0000","last_change":"2023-11-30T17:19:56.109945+0000","last_active":"2023-11-30T17:19:56.485997+0000","last_peered":"2023-11-30T17:19:56.485997+0000","last_clean":"2023-11-30T17:19:56.485997+0000","last_became_active":"2023-11-30T17:19:56.109524+0000","last_became_peered":"2023-11-30T17:19:56.109524+0000","last_unstale":"2023-11-30T17:19:56.485997+0000","last_undegraded":"2023-11-30T17:19:56.485997+0000","last_fullsized":"2023-11-30T17:19:56.485997+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.484983+0000","last_change":"2023-11-30T17:19:56.481568+0000","last_active":"2023-11-30T17:19:56.484983+0000","last_peered":"2023-11-30T17:19:56.484983+0000","last_clean":"2023-11-30T17:19:56.484983+0000","last_became_active":"2023-11-30T17:19:56.481250+0000","last_became_peered":"2023-11-30T17:19:56.481250+0000","last_unstale":"2023-11-30T17:19:56.484983+0000","last_undegraded":"2023-11-30T17:19:56.484983+0000","last_fullsized":"2023-11-30T17:19:56.484983+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.477452+0000","last_change":"2023-11-30T17:19:56.094800+0000","last_active":"2023-11-30T17:19:56.477452+0000","last_peered":"2023-11-30T17:19:56.477452+0000","last_clean":"2023-11-30T17:19:56.477452+0000","last_became_active":"2023-11-30T17:19:56.094502+0000","last_became_peered":"2023-11-30T17:19:56.094502+0000","last_unstale":"2023-11-30T17:19:56.477452+0000","last_undegraded":"2023-11-30T17:19:56.477452+0000","last_fullsized":"2023-11-30T17:19:56.477452+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493507+0000","last_change":"2023-11-30T17:19:56.490881+0000","last_active":"2023-11-30T17:19:56.493507+0000","last_peered":"2023-11-30T17:19:56.493507+0000","last_clean":"2023-11-30T17:19:56.493507+0000","last_became_active":"2023-11-30T17:19:56.490557+0000","last_became_peered":"2023-11-30T17:19:56.490557+0000","last_unstale":"2023-11-30T17:19:56.493507+0000","last_undegraded":"2023-11-30T17:19:56.493507+0000","last_fullsized":"2023-11-30T17:19:56.493507+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.082283+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.472480+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:19:56.472480+0000","last_peered":"2023-11-30T17:19:56.472480+0000","last_clean":"2023-11-30T17:19:56.472480+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:19:56.472480+0000","last_undegraded":"2023-11-30T17:19:56.472480+0000","last_fullsized":"2023-11-30T17:19:56.472480+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493542+0000","last_change":"2023-11-30T17:19:56.485917+0000","last_active":"2023-11-30T17:19:56.493542+0000","last_peered":"2023-11-30T17:19:56.493542+0000","last_clean":"2023-11-30T17:19:56.493542+0000","last_became_active":"2023-11-30T17:19:56.485355+0000","last_became_peered":"2023-11-30T17:19:56.485355+0000","last_unstale":"2023-11-30T17:19:56.493542+0000","last_undegraded":"2023-11-30T17:19:56.493542+0000","last_fullsized":"2023-11-30T17:19:56.493542+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-11-30T17:19:55.068004+0000","last_change":"2023-11-30T17:19:55.077495+0000","last_active":"2023-11-30T17:19:55.068004+0000","last_peered":"2023-11-30T17:19:55.068004+0000","last_clean":"2023-11-30T17:19:55.068004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:55.068004+0000","last_undegraded":"2023-11-30T17:19:55.068004+0000","last_fullsized":"2023-11-30T17:19:55.068004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.479090+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:19:56.479090+0000","last_peered":"2023-11-30T17:19:56.479090+0000","last_clean":"2023-11-30T17:19:56.479090+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:19:56.479090+0000","last_undegraded":"2023-11-30T17:19:56.479090+0000","last_fullsized":"2023-11-30T17:19:56.479090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491937+0000","last_change":"2023-11-30T17:19:56.489558+0000","last_active":"2023-11-30T17:19:56.491937+0000","last_peered":"2023-11-30T17:19:56.491937+0000","last_clean":"2023-11-30T17:19:56.491937+0000","last_became_active":"2023-11-30T17:19:56.489367+0000","last_became_peered":"2023-11-30T17:19:56.489367+0000","last_unstale":"2023-11-30T17:19:56.491937+0000","last_undegraded":"2023-11-30T17:19:56.491937+0000","last_fullsized":"2023-11-30T17:19:56.491937+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.495220+0000","last_change":"2023-11-30T17:19:56.099447+0000","last_active":"2023-11-30T17:19:56.495220+0000","last_peered":"2023-11-30T17:19:56.495220+0000","last_clean":"2023-11-30T17:19:56.495220+0000","last_became_active":"2023-11-30T17:19:56.098752+0000","last_became_peered":"2023-11-30T17:19:56.098752+0000","last_unstale":"2023-11-30T17:19:56.495220+0000","last_undegraded":"2023-11-30T17:19:56.495220+0000","last_fullsized":"2023-11-30T17:19:56.495220+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.476345+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:19:56.476345+0000","last_peered":"2023-11-30T17:19:56.476345+0000","last_clean":"2023-11-30T17:19:56.476345+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:19:56.476345+0000","last_undegraded":"2023-11-30T17:19:56.476345+0000","last_fullsized":"2023-11-30T17:19:56.476345+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:19:56.073560+0000","last_change":"2023-11-30T17:19:56.073560+0000","last_active":"2023-11-30T17:19:56.073560+0000","last_peered":"2023-11-30T17:19:56.073560+0000","last_clean":"2023-11-30T17:19:56.073560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:19:56.073560+0000","last_undegraded":"2023-11-30T17:19:56.073560+0000","last_fullsized":"2023-11-30T17:19:56.073560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496649+0000","last_change":"2023-11-30T17:19:56.106136+0000","last_active":"2023-11-30T17:19:56.496649+0000","last_peered":"2023-11-30T17:19:56.496649+0000","last_clean":"2023-11-30T17:19:56.496649+0000","last_became_active":"2023-11-30T17:19:56.105756+0000","last_became_peered":"2023-11-30T17:19:56.105756+0000","last_unstale":"2023-11-30T17:19:56.496649+0000","last_undegraded":"2023-11-30T17:19:56.496649+0000","last_fullsized":"2023-11-30T17:19:56.496649+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.480220+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:19:56.480220+0000","last_peered":"2023-11-30T17:19:56.480220+0000","last_clean":"2023-11-30T17:19:56.480220+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:19:56.480220+0000","last_undegraded":"2023-11-30T17:19:56.480220+0000","last_fullsized":"2023-11-30T17:19:56.480220+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":51,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.481994+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:19:56.481994+0000","last_peered":"2023-11-30T17:19:56.481994+0000","last_clean":"2023-11-30T17:19:56.481994+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:19:56.481994+0000","last_undegraded":"2023-11-30T17:19:56.481994+0000","last_fullsized":"2023-11-30T17:19:56.481994+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.484755+0000","last_change":"2023-11-30T17:19:56.482476+0000","last_active":"2023-11-30T17:19:56.484755+0000","last_peered":"2023-11-30T17:19:56.484755+0000","last_clean":"2023-11-30T17:19:56.484755+0000","last_became_active":"2023-11-30T17:19:56.482179+0000","last_became_peered":"2023-11-30T17:19:56.482179+0000","last_unstale":"2023-11-30T17:19:56.484755+0000","last_undegraded":"2023-11-30T17:19:56.484755+0000","last_fullsized":"2023-11-30T17:19:56.484755+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.485102+0000","last_change":"2023-11-30T17:19:56.097211+0000","last_active":"2023-11-30T17:19:56.485102+0000","last_peered":"2023-11-30T17:19:56.485102+0000","last_clean":"2023-11-30T17:19:56.485102+0000","last_became_active":"2023-11-30T17:19:56.096945+0000","last_became_peered":"2023-11-30T17:19:56.096945+0000","last_unstale":"2023-11-30T17:19:56.485102+0000","last_undegraded":"2023-11-30T17:19:56.485102+0000","last_fullsized":"2023-11-30T17:19:56.485102+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.482083+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:19:56.482083+0000","last_peered":"2023-11-30T17:19:56.482083+0000","last_clean":"2023-11-30T17:19:56.482083+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:19:56.482083+0000","last_undegraded":"2023-11-30T17:19:56.482083+0000","last_fullsized":"2023-11-30T17:19:56.482083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491458+0000","last_change":"2023-11-30T17:19:56.489737+0000","last_active":"2023-11-30T17:19:56.491458+0000","last_peered":"2023-11-30T17:19:56.491458+0000","last_clean":"2023-11-30T17:19:56.491458+0000","last_became_active":"2023-11-30T17:19:56.487977+0000","last_became_peered":"2023-11-30T17:19:56.487977+0000","last_unstale":"2023-11-30T17:19:56.491458+0000","last_undegraded":"2023-11-30T17:19:56.491458+0000","last_fullsized":"2023-11-30T17:19:56.491458+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.479316+0000","last_change":"2023-11-30T17:19:56.104936+0000","last_active":"2023-11-30T17:19:56.479316+0000","last_peered":"2023-11-30T17:19:56.479316+0000","last_clean":"2023-11-30T17:19:56.479316+0000","last_became_active":"2023-11-30T17:19:56.104707+0000","last_became_peered":"2023-11-30T17:19:56.104707+0000","last_unstale":"2023-11-30T17:19:56.479316+0000","last_undegraded":"2023-11-30T17:19:56.479316+0000","last_fullsized":"2023-11-30T17:19:56.479316+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.485161+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:19:56.485161+0000","last_peered":"2023-11-30T17:19:56.485161+0000","last_clean":"2023-11-30T17:19:56.485161+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:19:56.485161+0000","last_undegraded":"2023-11-30T17:19:56.485161+0000","last_fullsized":"2023-11-30T17:19:56.485161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.487502+0000","last_change":"2023-11-30T17:19:56.486862+0000","last_active":"2023-11-30T17:19:56.487502+0000","last_peered":"2023-11-30T17:19:56.487502+0000","last_clean":"2023-11-30T17:19:56.487502+0000","last_became_active":"2023-11-30T17:19:56.486600+0000","last_became_peered":"2023-11-30T17:19:56.486600+0000","last_unstale":"2023-11-30T17:19:56.487502+0000","last_undegraded":"2023-11-30T17:19:56.487502+0000","last_fullsized":"2023-11-30T17:19:56.487502+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.478581+0000","last_change":"2023-11-30T17:19:56.108142+0000","last_active":"2023-11-30T17:19:56.478581+0000","last_peered":"2023-11-30T17:19:56.478581+0000","last_clean":"2023-11-30T17:19:56.478581+0000","last_became_active":"2023-11-30T17:19:56.107685+0000","last_became_peered":"2023-11-30T17:19:56.107685+0000","last_unstale":"2023-11-30T17:19:56.478581+0000","last_undegraded":"2023-11-30T17:19:56.478581+0000","last_fullsized":"2023-11-30T17:19:56.478581+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.472945+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:19:56.472945+0000","last_peered":"2023-11-30T17:19:56.472945+0000","last_clean":"2023-11-30T17:19:56.472945+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:19:56.472945+0000","last_undegraded":"2023-11-30T17:19:56.472945+0000","last_fullsized":"2023-11-30T17:19:56.472945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.494336+0000","last_change":"2023-11-30T17:19:56.489210+0000","last_active":"2023-11-30T17:19:56.494336+0000","last_peered":"2023-11-30T17:19:56.494336+0000","last_clean":"2023-11-30T17:19:56.494336+0000","last_became_active":"2023-11-30T17:19:56.488914+0000","last_became_peered":"2023-11-30T17:19:56.488914+0000","last_unstale":"2023-11-30T17:19:56.494336+0000","last_undegraded":"2023-11-30T17:19:56.494336+0000","last_fullsized":"2023-11-30T17:19:56.494336+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.477075+0000","last_change":"2023-11-30T17:19:56.102213+0000","last_active":"2023-11-30T17:19:56.477075+0000","last_peered":"2023-11-30T17:19:56.477075+0000","last_clean":"2023-11-30T17:19:56.477075+0000","last_became_active":"2023-11-30T17:19:56.101927+0000","last_became_peered":"2023-11-30T17:19:56.101927+0000","last_unstale":"2023-11-30T17:19:56.477075+0000","last_undegraded":"2023-11-30T17:19:56.477075+0000","last_fullsized":"2023-11-30T17:19:56.477075+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-30T17:19:52.060819+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:19:52.060819+0000","last_peered":"2023-11-30T17:19:52.060819+0000","last_clean":"2023-11-30T17:19:52.060819+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:19:52.060819+0000","last_undegraded":"2023-11-30T17:19:52.060819+0000","last_fullsized":"2023-11-30T17:19:52.060819+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":2236,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":106,"acting":106,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575004,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297864,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":786432,"data_stored":380863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58699999999999997,"15min":0.55800000000000005},"min":{"1min":0.374,"5min":0.317,"15min":0.23899999999999999},"max":{"1min":0.73099999999999998,"5min":0.78700000000000003,"15min":0.81100000000000005},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58599999999999997,"15min":0.56599999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.32200000000000001},"max":{"1min":0.76400000000000001,"5min":0.76700000000000002,"15min":0.81899999999999995},"last":0.56100000000000005}]},{"osd":1,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55200000000000005,"15min":0.53000000000000003},"min":{"1min":0.39400000000000002,"5min":0.34599999999999997,"15min":0.33600000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.79400000000000004},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.28799999999999998},"max":{"1min":0.63400000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.46700000000000003}]},{"osd":2,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.32800000000000001},"max":{"1min":0.67600000000000005,"5min":0.77200000000000002,"15min":0.78300000000000003},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.28699999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.83899999999999997},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54400000000000004,"15min":0.53700000000000003},"min":{"1min":0.375,"5min":0.36899999999999999,"15min":0.33200000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.78000000000000003},"last":0.623},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.33900000000000002},"max":{"1min":0.72999999999999998,"5min":0.80500000000000005,"15min":0.81200000000000006},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.44800000000000001,"15min":0.47099999999999997},"min":{"1min":0.313,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.61899999999999999,"5min":0.77500000000000002,"15min":0.79900000000000004},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.442,"5min":0.46899999999999997,"15min":0.5},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.66600000000000004,"5min":0.69999999999999996,"15min":1.3180000000000001},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47499999999999998,"15min":0.501},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68100000000000005,"5min":0.71499999999999997,"15min":0.82899999999999996},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.51000000000000001,"15min":0.53300000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69099999999999995,"5min":0.76000000000000001,"15min":0.872},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53300000000000003,"15min":0.55700000000000005},"min":{"1min":0.376,"5min":0.372,"15min":0.36099999999999999},"max":{"1min":0.71599999999999997,"5min":0.745,"15min":0.85199999999999998},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.55600000000000005},"min":{"1min":0.35399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72099999999999997,"5min":0.78100000000000003,"15min":0.81499999999999995},"last":0.69799999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575002,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301900,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069940,"statfs":{"total":96636764160,"available":96327618560,"internally_reserved":0,"allocated":724992,"data_stored":353402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.75,"5min":0.80000000000000004,"15min":0.82699999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59499999999999997,"15min":0.57799999999999996},"min":{"1min":0.33500000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.78500000000000003,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57899999999999996,"15min":0.55600000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.26400000000000001},"max":{"1min":0.76900000000000002,"5min":0.77500000000000002,"15min":0.82799999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.60199999999999998,"15min":0.58499999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.82499999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.59399999999999997}]},{"osd":2,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.58499999999999996,"15min":0.56200000000000006},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.82599999999999996},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58499999999999996,"15min":0.57099999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80800000000000005,"5min":0.80900000000000005,"15min":0.82499999999999996},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.70299999999999996,"5min":0.755,"15min":0.755},"last":0.442},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54100000000000004,"15min":0.52900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32200000000000001},"max":{"1min":0.72799999999999998,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.44700000000000001,"15min":0.45700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28999999999999998},"max":{"1min":0.61699999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.623,"5min":0.78800000000000003,"15min":0.83899999999999997},"last":0.504}]},{"osd":5,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46899999999999997,"15min":0.46999999999999997},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.28299999999999997},"max":{"1min":0.61099999999999999,"5min":0.69399999999999995,"15min":0.74299999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.5,"15min":0.50900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.31900000000000001},"max":{"1min":0.68799999999999994,"5min":0.745,"15min":0.78500000000000003},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52200000000000002,"15min":0.53600000000000003},"min":{"1min":0.375,"5min":0.34699999999999998,"15min":0.34000000000000002},"max":{"1min":0.69499999999999995,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56100000000000005,"15min":0.56399999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":0.70299999999999996,"5min":0.83499999999999996,"15min":0.86499999999999999},"last":0.64100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575003,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301952,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069888,"statfs":{"total":96636764160,"available":96327565312,"internally_reserved":0,"allocated":778240,"data_stored":380275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35799999999999998,"15min":0.34100000000000003},"min":{"1min":0.23899999999999999,"5min":0.23599999999999999,"15min":0.23000000000000001},"max":{"1min":0.52900000000000003,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.46899999999999997,"15min":0.44900000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.309},"max":{"1min":0.57999999999999996,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.38900000000000001,"15min":0.36799999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.222},"max":{"1min":0.57099999999999995,"5min":0.628,"15min":0.67300000000000004},"last":0.313},{"interface":"front","average":{"1min":0.499,"5min":0.51000000000000001,"15min":0.47299999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.29499999999999998},"max":{"1min":0.63400000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.33400000000000002}]},{"osd":3,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45800000000000002,"15min":0.43099999999999999},"min":{"1min":0.32900000000000001,"5min":0.32000000000000001,"15min":0.23899999999999999},"max":{"1min":0.60999999999999999,"5min":0.749,"15min":0.749},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.442,"15min":0.41599999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.28599999999999998},"max":{"1min":0.65100000000000002,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.35299999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58999999999999997,"15min":0.57599999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.89100000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.39900000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.111},"last":0.42499999999999999}]},{"osd":5,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59899999999999998,"15min":0.58799999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.377},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60599999999999998,"15min":0.59899999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77500000000000002,"5min":0.88200000000000001,"15min":0.91300000000000003},"last":0.36899999999999999}]},{"osd":6,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.44600000000000001,"5min":0.433,"15min":0.39600000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":1.0600000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.65400000000000003,"15min":0.64900000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.379},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.0780000000000001},"last":0.45500000000000002}]},{"osd":7,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.67400000000000004,"15min":0.65300000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.41699999999999998},"max":{"1min":0.91500000000000004,"5min":0.92300000000000004,"15min":0.98699999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.65000000000000002,"15min":0.63900000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.39900000000000002},"max":{"1min":0.85199999999999998,"5min":0.879,"15min":0.94199999999999995},"last":0.442}]}]},{"osd":0,"up_from":13,"seq":55834575003,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301960,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069880,"statfs":{"total":96636764160,"available":96327557120,"internally_reserved":0,"allocated":786432,"data_stored":380311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.37,"15min":0.35199999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.22700000000000001},"max":{"1min":0.54700000000000004,"5min":0.59999999999999998,"15min":0.71199999999999997},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.39500000000000002,"15min":0.372},"min":{"1min":0.27300000000000002,"5min":0.24099999999999999,"15min":0.22600000000000001},"max":{"1min":0.53100000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.216}]},{"osd":2,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39500000000000002,"15min":0.373},"min":{"1min":0.28999999999999998,"5min":0.247,"15min":0.23899999999999999},"max":{"1min":0.58899999999999997,"5min":0.623,"15min":0.623},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47099999999999997,"15min":0.44600000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.31900000000000001},"max":{"1min":0.60999999999999999,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.30099999999999999}]},{"osd":3,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.439,"15min":0.41999999999999998},"min":{"1min":0.32600000000000001,"5min":0.29499999999999998,"15min":0.252},"max":{"1min":0.629,"5min":0.66100000000000003,"15min":0.70999999999999996},"last":0.249},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45200000000000001,"15min":0.42499999999999999},"min":{"1min":0.33600000000000002,"5min":0.317,"15min":0.26700000000000002},"max":{"1min":0.64700000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.28299999999999997}]},{"osd":4,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61899999999999999,"15min":0.59199999999999997},"min":{"1min":0.46500000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82599999999999996,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63300000000000001,"15min":0.60699999999999998},"min":{"1min":0.435,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79100000000000004,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.58599999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.36199999999999999},"max":{"1min":0.81000000000000005,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.501},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64700000000000002,"15min":0.61599999999999999},"min":{"1min":0.51500000000000001,"5min":0.442,"15min":0.38},"max":{"1min":0.88,"5min":1.004,"15min":1.004},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.65600000000000003,"15min":0.63},"min":{"1min":0.47199999999999998,"5min":0.435,"15min":0.39200000000000002},"max":{"1min":0.86699999999999999,"5min":1.002,"15min":1.002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64900000000000002,"15min":0.622},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.42999999999999999},"max":{"1min":0.81699999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.47599999999999998}]},{"osd":7,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.66700000000000004,"15min":0.63900000000000001},"min":{"1min":0.49199999999999999,"5min":0.48799999999999999,"15min":0.44800000000000001},"max":{"1min":0.92700000000000005,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69799999999999995,"15min":0.67300000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.44700000000000001},"max":{"1min":0.90500000000000003,"5min":1.026,"15min":1.026},"last":0.56399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575003,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306056,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065784,"statfs":{"total":96636764160,"available":96323362816,"internally_reserved":0,"allocated":786432,"data_stored":381721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.41399999999999998,"15min":0.38},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.44,"5min":0.44700000000000001,"15min":0.42099999999999999},"min":{"1min":0.28000000000000003,"5min":0.26400000000000001,"15min":0.255},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46200000000000002,"15min":0.433},"min":{"1min":0.254,"5min":0.254,"15min":0.24299999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49299999999999999,"15min":0.45500000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.373}]},{"osd":3,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.42599999999999999,"15min":0.39300000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63500000000000001,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48999999999999999,"15min":0.45100000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.26200000000000001},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.31900000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64400000000000002,"15min":0.59899999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63900000000000001,"15min":0.59699999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66300000000000003,"15min":0.621},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66400000000000003,"15min":0.61699999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38100000000000001},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.66000000000000003,"15min":0.61399999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68999999999999995,"15min":0.65000000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.69999999999999996,"15min":0.66100000000000003},"min":{"1min":0.48899999999999999,"5min":0.45200000000000001,"15min":0.40300000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.71299999999999997,"15min":0.66800000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.41499999999999998},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.69399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575003,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306056,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065784,"statfs":{"total":96636764160,"available":96323362816,"internally_reserved":0,"allocated":786432,"data_stored":380851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.379,"15min":0.35699999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.217},"max":{"1min":0.56599999999999995,"5min":0.58799999999999997,"15min":0.66200000000000003},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.41299999999999998,"15min":0.38800000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.246},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39600000000000002,"15min":0.378},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.255},"max":{"1min":0.59499999999999997,"5min":0.63300000000000001,"15min":0.64300000000000002},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.44,"15min":0.42499999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.25900000000000001},"max":{"1min":0.51500000000000001,"5min":0.69099999999999995,"15min":0.84399999999999997},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46500000000000002,"15min":0.438},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.26000000000000001},"max":{"1min":0.72999999999999998,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.52900000000000003,"15min":0.48899999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.33400000000000002},"max":{"1min":0.68999999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61599999999999999,"15min":0.59499999999999997},"min":{"1min":0.42799999999999999,"5min":0.42599999999999999,"15min":0.35099999999999998},"max":{"1min":0.91500000000000004,"5min":0.91600000000000004,"15min":0.97599999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.624,"15min":0.61099999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.34799999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.91400000000000003},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61699999999999999,"15min":0.60599999999999998},"min":{"1min":0.41699999999999998,"5min":0.40000000000000002,"15min":0.378},"max":{"1min":0.85399999999999998,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.504},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.64600000000000002,"15min":0.629},"min":{"1min":0.46700000000000003,"5min":0.45100000000000001,"15min":0.36399999999999999},"max":{"1min":0.80500000000000005,"5min":0.88900000000000001,"15min":1.008},"last":0.623}]},{"osd":6,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.39000000000000001},"max":{"1min":0.84599999999999997,"5min":0.94999999999999996,"15min":1.0389999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.65800000000000003,"15min":0.64400000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.41399999999999998},"max":{"1min":0.89500000000000002,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.63800000000000001}]},{"osd":7,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67500000000000004,"15min":0.66500000000000004},"min":{"1min":0.51300000000000001,"5min":0.44700000000000001,"15min":0.39100000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.67000000000000004,"15min":0.65100000000000002},"min":{"1min":0.46200000000000002,"5min":0.432,"15min":0.41899999999999998},"max":{"1min":0.89200000000000002,"5min":0.93700000000000006,"15min":1.004},"last":0.65000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575002,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297804,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074036,"statfs":{"total":96636764160,"available":96331812864,"internally_reserved":0,"allocated":724992,"data_stored":353402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52700000000000002,"15min":0.52300000000000002},"min":{"1min":0.39400000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71699999999999997,"5min":0.77700000000000002,"15min":0.80900000000000005},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.379,"5min":0.32200000000000001,"15min":0.317},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.47499999999999998}]},{"osd":1,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.55100000000000005,"15min":0.53400000000000003},"min":{"1min":0.36899999999999999,"5min":0.314,"15min":0.25800000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.79600000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54400000000000004,"15min":0.54100000000000004},"min":{"1min":0.44700000000000001,"5min":0.36699999999999999,"15min":0.246},"max":{"1min":0.71299999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58199999999999996,"15min":0.56100000000000005},"min":{"1min":0.46500000000000002,"5min":0.38400000000000001,"15min":0.27800000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.58999999999999997},"min":{"1min":0.436,"5min":0.41299999999999998,"15min":0.36899999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.60799999999999998}]},{"osd":3,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55400000000000005,"15min":0.54300000000000004},"min":{"1min":0.41499999999999998,"5min":0.40600000000000003,"15min":0.32900000000000001},"max":{"1min":0.76400000000000001,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.45000000000000001,"5min":0.372,"15min":0.35799999999999998},"max":{"1min":0.69699999999999995,"5min":0.78900000000000003,"15min":0.80600000000000005},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.43099999999999999,"15min":0.45600000000000002},"min":{"1min":0.33000000000000002,"5min":0.30099999999999999,"15min":0.27400000000000002},"max":{"1min":0.54900000000000004,"5min":0.72499999999999998,"15min":0.83299999999999996},"last":0.623},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.44400000000000001,"15min":0.47199999999999998},"min":{"1min":0.374,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59999999999999998,"5min":0.66400000000000003,"15min":0.85099999999999998},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.49399999999999999,"15min":0.51200000000000001},"min":{"1min":0.371,"5min":0.33100000000000002,"15min":0.314},"max":{"1min":0.64200000000000002,"5min":0.754,"15min":0.98799999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53200000000000003,"15min":0.54400000000000004},"min":{"1min":0.45100000000000001,"5min":0.39900000000000002,"15min":0.33800000000000002},"max":{"1min":0.65700000000000003,"5min":0.74099999999999999,"15min":0.95999999999999996},"last":0.73299999999999998}]},{"osd":7,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.35999999999999999,"5min":0.318,"15min":0.29899999999999999},"max":{"1min":0.68799999999999994,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56599999999999995,"15min":0.57799999999999996},"min":{"1min":0.50700000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.69699999999999995,"5min":0.79500000000000004,"15min":0.85399999999999998},"last":0.754}]}]},{"osd":5,"up_from":13,"seq":55834575003,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301952,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069888,"statfs":{"total":96636764160,"available":96327565312,"internally_reserved":0,"allocated":778240,"data_stored":381077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.35799999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.627,"5min":0.73399999999999999,"15min":0.76500000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.67000000000000004,"5min":0.76200000000000001,"15min":0.81799999999999995},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.52600000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.318},"max":{"1min":0.59999999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.56100000000000005,"15min":0.53900000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.36199999999999999},"max":{"1min":0.65800000000000003,"5min":0.754,"15min":0.77000000000000002},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60399999999999998,"15min":0.58399999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.30599999999999999},"max":{"1min":0.74099999999999999,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.60599999999999998,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.34499999999999997},"max":{"1min":0.69099999999999995,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55600000000000005,"15min":0.54100000000000004},"min":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64600000000000002,"5min":0.72399999999999998,"15min":0.73799999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57299999999999995,"15min":0.56799999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.71299999999999997,"5min":0.79200000000000004,"15min":0.82099999999999995},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.42899999999999999,"15min":0.44600000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.53900000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.46100000000000002,"15min":0.47099999999999997},"min":{"1min":0.34499999999999997,"5min":0.33000000000000002,"15min":0.32100000000000001},"max":{"1min":0.55600000000000005,"5min":0.66700000000000004,"15min":0.77600000000000002},"last":0.40200000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.48199999999999998,"15min":0.48899999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28499999999999998},"max":{"1min":0.63100000000000001,"5min":0.73999999999999999,"15min":0.82099999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54600000000000004,"15min":0.55600000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.33400000000000002},"max":{"1min":0.67300000000000004,"5min":0.81399999999999995,"15min":0.88200000000000001},"last":0.54400000000000004}]},{"osd":7,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.52700000000000002,"15min":0.53100000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68200000000000005,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57499999999999996,"15min":0.58099999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73099999999999998,"5min":0.79300000000000004,"15min":0.84599999999999997},"last":0.439}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:20:04.978 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:20:05.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.105+0000 7fc2bc8f5700 1 Processor -- start 2023-11-30T17:20:05.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.106+0000 7fc2bc8f5700 1 -- start start 2023-11-30T17:20:05.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.106+0000 7fc2bc8f5700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc2b8157660 0x7fc2b8157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:05.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.106+0000 7fc2bc8f5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc2b80c0180 0x7fc2b81589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:05.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.106+0000 7fc2bc8f5700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b80c12c0 con 0x7fc2b80c1750 2023-11-30T17:20:05.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.106+0000 7fc2bc8f5700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b80c06b0 con 0x7fc2b80c0180 2023-11-30T17:20:05.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.106+0000 7fc2bc8f5700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b80c0990 con 0x7fc2b8157660 2023-11-30T17:20:05.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.106+0000 7fc2b659c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc2b80c0180 0x7fc2b81589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:05.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.107+0000 7fc2b659c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc2b80c0180 0x7fc2b81589c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35056/0 (socket says 172.21.15.49:35056) 2023-11-30T17:20:05.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.107+0000 7fc2b659c700 1 -- 172.21.15.49:0/3555216416 learned_addr learned my addr 172.21.15.49:0/3555216416 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:20:05.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.107+0000 7fc2b6d9d700 1 --2- 172.21.15.49:0/3555216416 >> v2:172.21.15.115:3300/0 conn(0x7fc2b8157660 0x7fc2b8157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:05.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.107+0000 7fc2b659c700 1 -- 172.21.15.49:0/3555216416 >> v2:172.21.15.115:3300/0 conn(0x7fc2b8157660 msgr2=0x7fc2b8157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:05.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.107+0000 7fc2b659c700 1 --2- 172.21.15.49:0/3555216416 >> v2:172.21.15.115:3300/0 conn(0x7fc2b8157660 0x7fc2b8157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:05.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.107+0000 7fc2b659c700 1 -- 172.21.15.49:0/3555216416 >> v1:172.21.15.115:6789/0 conn(0x7fc2b80c1750 legacy=0x7fc2b80648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:05.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.107+0000 7fc2b659c700 1 -- 172.21.15.49:0/3555216416 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b80c0c70 con 0x7fc2b80c0180 2023-11-30T17:20:05.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.107+0000 7fc2b659c700 1 --2- 172.21.15.49:0/3555216416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2b80c0180 0x7fc2b81589c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fc2b80839a0 tx=0x7fc2a00090f0).ready entity=mon.0 client_cookie=61df1b48f575a917 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:05.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.107+0000 7fc2b5d9b700 1 -- 172.21.15.49:0/3555216416 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a000b600 con 0x7fc2b80c0180 2023-11-30T17:20:05.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.107+0000 7fc2b5d9b700 1 -- 172.21.15.49:0/3555216416 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a000b760 con 0x7fc2b80c0180 2023-11-30T17:20:05.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.107+0000 7fc2b5d9b700 1 -- 172.21.15.49:0/3555216416 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a000bae0 con 0x7fc2b80c0180 2023-11-30T17:20:05.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.108+0000 7fc2bc8f5700 1 -- 172.21.15.49:0/3555216416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2b80c0180 msgr2=0x7fc2b81589c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:05.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.108+0000 7fc2bc8f5700 1 --2- 172.21.15.49:0/3555216416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2b80c0180 0x7fc2b81589c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fc2b80839a0 tx=0x7fc2a00090f0).stop 2023-11-30T17:20:05.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.108+0000 7fc2bc8f5700 1 -- 172.21.15.49:0/3555216416 shutdown_connections 2023-11-30T17:20:05.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.108+0000 7fc2bc8f5700 1 --2- 172.21.15.49:0/3555216416 >> v2:172.21.15.115:3300/0 conn(0x7fc2b8157660 0x7fc2b8157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:05.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.108+0000 7fc2bc8f5700 1 --2- 172.21.15.49:0/3555216416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2b80c0180 0x7fc2b81589c0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:05.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.108+0000 7fc2bc8f5700 1 -- 172.21.15.49:0/3555216416 >> 172.21.15.49:0/3555216416 conn(0x7fc2b80cb000 msgr2=0x7fc2b80cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:05.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.108+0000 7fc2bc8f5700 1 -- 172.21.15.49:0/3555216416 shutdown_connections 2023-11-30T17:20:05.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.108+0000 7fc2bc8f5700 1 -- 172.21.15.49:0/3555216416 wait complete. 2023-11-30T17:20:05.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.109+0000 7fc2bc8f5700 1 Processor -- start 2023-11-30T17:20:05.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.109+0000 7fc2bc8f5700 1 -- start start 2023-11-30T17:20:05.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.110+0000 7fc2bc8f5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2b80c0180 0x7fc2b8164c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:05.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.110+0000 7fc2bc8f5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2b80c1750 0x7fc2b80c4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:05.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.110+0000 7fc2bc8f5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2b8157660 0x7fc2b80af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:05.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.110+0000 7fc2bc8f5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b80c3ea0 con 0x7fc2b80c1750 2023-11-30T17:20:05.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.110+0000 7fc2bc8f5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b80b0740 con 0x7fc2b8157660 2023-11-30T17:20:05.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.110+0000 7fc2bc8f5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b80c3850 con 0x7fc2b80c0180 2023-11-30T17:20:05.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.110+0000 7fc2b659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2b80c1750 0x7fc2b80c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:05.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.110+0000 7fc2b659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2b80c1750 0x7fc2b80c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35058/0 (socket says 172.21.15.49:35058) 2023-11-30T17:20:05.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.110+0000 7fc2b659c700 1 -- 172.21.15.49:0/419863187 learned_addr learned my addr 172.21.15.49:0/419863187 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:20:05.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.110+0000 7fc2b759e700 1 --2- 172.21.15.49:0/419863187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2b8157660 0x7fc2b80af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:05.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.110+0000 7fc2b6d9d700 1 --2- 172.21.15.49:0/419863187 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2b80c0180 0x7fc2b8164c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:05.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.110+0000 7fc2b659c700 1 -- 172.21.15.49:0/419863187 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2b80c0180 msgr2=0x7fc2b8164c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:05.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.110+0000 7fc2b659c700 1 --2- 172.21.15.49:0/419863187 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2b80c0180 0x7fc2b8164c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:05.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.110+0000 7fc2b659c700 1 -- 172.21.15.49:0/419863187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2b8157660 msgr2=0x7fc2b80af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:05.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.110+0000 7fc2b659c700 1 --2- 172.21.15.49:0/419863187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2b8157660 0x7fc2b80af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:05.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.110+0000 7fc2b659c700 1 -- 172.21.15.49:0/419863187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a0009370 con 0x7fc2b80c1750 2023-11-30T17:20:05.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.110+0000 7fc2b6d9d700 1 --2- 172.21.15.49:0/419863187 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2b80c0180 0x7fc2b8164c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:20:05.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.110+0000 7fc2b659c700 1 --2- 172.21.15.49:0/419863187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2b80c1750 0x7fc2b80c4330 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fc2a0009130 tx=0x7fc2a0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:05.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.111+0000 7fc2aeffd700 1 -- 172.21.15.49:0/419863187 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a000bae0 con 0x7fc2b80c1750 2023-11-30T17:20:05.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.111+0000 7fc2aeffd700 1 -- 172.21.15.49:0/419863187 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a0000c90 con 0x7fc2b80c1750 2023-11-30T17:20:05.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.111+0000 7fc2bc8f5700 1 -- 172.21.15.49:0/419863187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b80c3b30 con 0x7fc2b80c1750 2023-11-30T17:20:05.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.111+0000 7fc2aeffd700 1 -- 172.21.15.49:0/419863187 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a001c670 con 0x7fc2b80c1750 2023-11-30T17:20:05.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.111+0000 7fc2bc8f5700 1 -- 172.21.15.49:0/419863187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b8165130 con 0x7fc2b80c1750 2023-11-30T17:20:05.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.112+0000 7fc2bc8f5700 1 -- 172.21.15.49:0/419863187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b80c4050 con 0x7fc2b80c1750 2023-11-30T17:20:05.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.112+0000 7fc2aeffd700 1 -- 172.21.15.49:0/419863187 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc2a001ca20 con 0x7fc2b80c1750 2023-11-30T17:20:05.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.112+0000 7fc2aeffd700 1 --2- 172.21.15.49:0/419863187 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc29805f240 0x7fc298061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:05.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.113+0000 7fc2aeffd700 1 -- 172.21.15.49:0/419863187 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc2a007c300 con 0x7fc2b80c1750 2023-11-30T17:20:05.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.113+0000 7fc2b6d9d700 1 --2- 172.21.15.49:0/419863187 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc29805f240 0x7fc298061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:05.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.113+0000 7fc2b6d9d700 1 --2- 172.21.15.49:0/419863187 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc29805f240 0x7fc298061700 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fc2b0009810 tx=0x7fc2b0008040).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:05.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.117+0000 7fc2aeffd700 1 -- 172.21.15.49:0/419863187 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc2b80c4050 con 0x7fc2b80c1750 2023-11-30T17:20:05.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.284+0000 7fc2bc8f5700 1 -- 172.21.15.49:0/419863187 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc2b806c7c0 con 0x7fc29805f240 2023-11-30T17:20:05.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.294+0000 7fc2aeffd700 1 -- 172.21.15.49:0/419863187 <== mgr.5449 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361153 (secure 0 0 0) 0x7fc2b806c7c0 con 0x7fc29805f240 2023-11-30T17:20:05.301 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:20:05.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.298+0000 7fc2bc8f5700 1 -- 172.21.15.49:0/419863187 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc29805f240 msgr2=0x7fc298061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:05.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.298+0000 7fc2bc8f5700 1 --2- 172.21.15.49:0/419863187 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc29805f240 0x7fc298061700 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fc2b0009810 tx=0x7fc2b0008040).stop 2023-11-30T17:20:05.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.298+0000 7fc2bc8f5700 1 -- 172.21.15.49:0/419863187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2b80c1750 msgr2=0x7fc2b80c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:05.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.298+0000 7fc2bc8f5700 1 --2- 172.21.15.49:0/419863187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2b80c1750 0x7fc2b80c4330 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fc2a0009130 tx=0x7fc2a0017000).stop 2023-11-30T17:20:05.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.298+0000 7fc2bc8f5700 1 -- 172.21.15.49:0/419863187 shutdown_connections 2023-11-30T17:20:05.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.298+0000 7fc2bc8f5700 1 --2- 172.21.15.49:0/419863187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2b8157660 0x7fc2b80af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:05.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.298+0000 7fc2bc8f5700 1 --2- 172.21.15.49:0/419863187 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2b80c0180 0x7fc2b8164c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:05.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.298+0000 7fc2bc8f5700 1 --2- 172.21.15.49:0/419863187 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc29805f240 0x7fc298061700 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:05.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.298+0000 7fc2bc8f5700 1 --2- 172.21.15.49:0/419863187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2b80c1750 0x7fc2b80c4330 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:05.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.298+0000 7fc2bc8f5700 1 -- 172.21.15.49:0/419863187 >> 172.21.15.49:0/419863187 conn(0x7fc2b80cb000 msgr2=0x7fc2b80ace90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:05.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.298+0000 7fc2bc8f5700 1 -- 172.21.15.49:0/419863187 shutdown_connections 2023-11-30T17:20:05.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.298+0000 7fc2bc8f5700 1 -- 172.21.15.49:0/419863187 wait complete. 2023-11-30T17:20:05.305 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:20:05.312 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-11-30T17:20:04.323249+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":271,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2419744,"kb_used_data":6112,"kb_used_omap":0,"kb_used_meta":2413568,"kb_avail":752554976,"statfs":{"total":773094113280,"available":770616295424,"internally_reserved":0,"allocated":6258688,"data_stored":3046092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2471493632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14996083,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-711,"num_write_kb":-15546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001063"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491141+0000","last_change":"2023-11-30T17:19:56.485959+0000","last_active":"2023-11-30T17:19:56.491141+0000","last_peered":"2023-11-30T17:19:56.491141+0000","last_clean":"2023-11-30T17:19:56.491141+0000","last_became_active":"2023-11-30T17:19:56.485404+0000","last_became_peered":"2023-11-30T17:19:56.485404+0000","last_unstale":"2023-11-30T17:19:56.491141+0000","last_undegraded":"2023-11-30T17:19:56.491141+0000","last_fullsized":"2023-11-30T17:19:56.491141+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"64'3","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.497937+0000","last_change":"2023-11-30T17:19:56.097294+0000","last_active":"2023-11-30T17:19:56.497937+0000","last_peered":"2023-11-30T17:19:56.497937+0000","last_clean":"2023-11-30T17:19:56.497937+0000","last_became_active":"2023-11-30T17:19:56.097026+0000","last_became_peered":"2023-11-30T17:19:56.097026+0000","last_unstale":"2023-11-30T17:19:56.497937+0000","last_undegraded":"2023-11-30T17:19:56.497937+0000","last_fullsized":"2023-11-30T17:19:56.497937+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496181+0000","last_change":"2023-11-30T17:19:56.492152+0000","last_active":"2023-11-30T17:19:56.496181+0000","last_peered":"2023-11-30T17:19:56.496181+0000","last_clean":"2023-11-30T17:19:56.496181+0000","last_became_active":"2023-11-30T17:19:56.491843+0000","last_became_peered":"2023-11-30T17:19:56.491843+0000","last_unstale":"2023-11-30T17:19:56.496181+0000","last_undegraded":"2023-11-30T17:19:56.496181+0000","last_fullsized":"2023-11-30T17:19:56.496181+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.480790+0000","last_change":"2023-11-30T17:19:56.112352+0000","last_active":"2023-11-30T17:19:56.480790+0000","last_peered":"2023-11-30T17:19:56.480790+0000","last_clean":"2023-11-30T17:19:56.480790+0000","last_became_active":"2023-11-30T17:19:56.112039+0000","last_became_peered":"2023-11-30T17:19:56.112039+0000","last_unstale":"2023-11-30T17:19:56.480790+0000","last_undegraded":"2023-11-30T17:19:56.480790+0000","last_fullsized":"2023-11-30T17:19:56.480790+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500856+0000","last_change":"2023-11-30T17:19:56.496678+0000","last_active":"2023-11-30T17:19:56.500856+0000","last_peered":"2023-11-30T17:19:56.500856+0000","last_clean":"2023-11-30T17:19:56.500856+0000","last_became_active":"2023-11-30T17:19:56.492155+0000","last_became_peered":"2023-11-30T17:19:56.492155+0000","last_unstale":"2023-11-30T17:19:56.500856+0000","last_undegraded":"2023-11-30T17:19:56.500856+0000","last_fullsized":"2023-11-30T17:19:56.500856+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.480841+0000","last_change":"2023-11-30T17:19:56.088316+0000","last_active":"2023-11-30T17:19:56.480841+0000","last_peered":"2023-11-30T17:19:56.480841+0000","last_clean":"2023-11-30T17:19:56.480841+0000","last_became_active":"2023-11-30T17:19:56.088022+0000","last_became_peered":"2023-11-30T17:19:56.088022+0000","last_unstale":"2023-11-30T17:19:56.480841+0000","last_undegraded":"2023-11-30T17:19:56.480841+0000","last_fullsized":"2023-11-30T17:19:56.480841+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.495745+0000","last_change":"2023-11-30T17:19:56.486081+0000","last_active":"2023-11-30T17:19:56.495745+0000","last_peered":"2023-11-30T17:19:56.495745+0000","last_clean":"2023-11-30T17:19:56.495745+0000","last_became_active":"2023-11-30T17:19:56.485781+0000","last_became_peered":"2023-11-30T17:19:56.485781+0000","last_unstale":"2023-11-30T17:19:56.495745+0000","last_undegraded":"2023-11-30T17:19:56.495745+0000","last_fullsized":"2023-11-30T17:19:56.495745+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"64'2","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.502495+0000","last_change":"2023-11-30T17:19:56.099441+0000","last_active":"2023-11-30T17:19:56.502495+0000","last_peered":"2023-11-30T17:19:56.502495+0000","last_clean":"2023-11-30T17:19:56.502495+0000","last_became_active":"2023-11-30T17:19:56.099054+0000","last_became_peered":"2023-11-30T17:19:56.099054+0000","last_unstale":"2023-11-30T17:19:56.502495+0000","last_undegraded":"2023-11-30T17:19:56.502495+0000","last_fullsized":"2023-11-30T17:19:56.502495+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493845+0000","last_change":"2023-11-30T17:19:56.492808+0000","last_active":"2023-11-30T17:19:56.493845+0000","last_peered":"2023-11-30T17:19:56.493845+0000","last_clean":"2023-11-30T17:19:56.493845+0000","last_became_active":"2023-11-30T17:19:56.492327+0000","last_became_peered":"2023-11-30T17:19:56.492327+0000","last_unstale":"2023-11-30T17:19:56.493845+0000","last_undegraded":"2023-11-30T17:19:56.493845+0000","last_fullsized":"2023-11-30T17:19:56.493845+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3b","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.490891+0000","last_change":"2023-11-30T17:19:56.112328+0000","last_active":"2023-11-30T17:19:56.490891+0000","last_peered":"2023-11-30T17:19:56.490891+0000","last_clean":"2023-11-30T17:19:56.490891+0000","last_became_active":"2023-11-30T17:19:56.112089+0000","last_became_peered":"2023-11-30T17:19:56.112089+0000","last_unstale":"2023-11-30T17:19:56.490891+0000","last_undegraded":"2023-11-30T17:19:56.490891+0000","last_fullsized":"2023-11-30T17:19:56.490891+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.492758+0000","last_change":"2023-11-30T17:19:56.489355+0000","last_active":"2023-11-30T17:19:56.492758+0000","last_peered":"2023-11-30T17:19:56.492758+0000","last_clean":"2023-11-30T17:19:56.492758+0000","last_became_active":"2023-11-30T17:19:56.489081+0000","last_became_peered":"2023-11-30T17:19:56.489081+0000","last_unstale":"2023-11-30T17:19:56.492758+0000","last_undegraded":"2023-11-30T17:19:56.492758+0000","last_fullsized":"2023-11-30T17:19:56.492758+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.489898+0000","last_change":"2023-11-30T17:19:56.095586+0000","last_active":"2023-11-30T17:19:56.489898+0000","last_peered":"2023-11-30T17:19:56.489898+0000","last_clean":"2023-11-30T17:19:56.489898+0000","last_became_active":"2023-11-30T17:19:56.095250+0000","last_became_peered":"2023-11-30T17:19:56.095250+0000","last_unstale":"2023-11-30T17:19:56.489898+0000","last_undegraded":"2023-11-30T17:19:56.489898+0000","last_fullsized":"2023-11-30T17:19:56.489898+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491110+0000","last_change":"2023-11-30T17:19:56.485707+0000","last_active":"2023-11-30T17:19:56.491110+0000","last_peered":"2023-11-30T17:19:56.491110+0000","last_clean":"2023-11-30T17:19:56.491110+0000","last_became_active":"2023-11-30T17:19:56.485420+0000","last_became_peered":"2023-11-30T17:19:56.485420+0000","last_unstale":"2023-11-30T17:19:56.491110+0000","last_undegraded":"2023-11-30T17:19:56.491110+0000","last_fullsized":"2023-11-30T17:19:56.491110+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.483241+0000","last_change":"2023-11-30T17:19:56.096279+0000","last_active":"2023-11-30T17:19:56.483241+0000","last_peered":"2023-11-30T17:19:56.483241+0000","last_clean":"2023-11-30T17:19:56.483241+0000","last_became_active":"2023-11-30T17:19:56.095989+0000","last_became_peered":"2023-11-30T17:19:56.095989+0000","last_unstale":"2023-11-30T17:19:56.483241+0000","last_undegraded":"2023-11-30T17:19:56.483241+0000","last_fullsized":"2023-11-30T17:19:56.483241+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.503846+0000","last_change":"2023-11-30T17:19:56.501562+0000","last_active":"2023-11-30T17:19:56.503846+0000","last_peered":"2023-11-30T17:19:56.503846+0000","last_clean":"2023-11-30T17:19:56.503846+0000","last_became_active":"2023-11-30T17:19:56.501259+0000","last_became_peered":"2023-11-30T17:19:56.501259+0000","last_unstale":"2023-11-30T17:19:56.503846+0000","last_undegraded":"2023-11-30T17:19:56.503846+0000","last_fullsized":"2023-11-30T17:19:56.503846+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.487885+0000","last_change":"2023-11-30T17:19:56.105956+0000","last_active":"2023-11-30T17:19:56.487885+0000","last_peered":"2023-11-30T17:19:56.487885+0000","last_clean":"2023-11-30T17:19:56.487885+0000","last_became_active":"2023-11-30T17:19:56.102562+0000","last_became_peered":"2023-11-30T17:19:56.102562+0000","last_unstale":"2023-11-30T17:19:56.487885+0000","last_undegraded":"2023-11-30T17:19:56.487885+0000","last_fullsized":"2023-11-30T17:19:56.487885+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496983+0000","last_change":"2023-11-30T17:19:56.495039+0000","last_active":"2023-11-30T17:19:56.496983+0000","last_peered":"2023-11-30T17:19:56.496983+0000","last_clean":"2023-11-30T17:19:56.496983+0000","last_became_active":"2023-11-30T17:19:56.494575+0000","last_became_peered":"2023-11-30T17:19:56.494575+0000","last_unstale":"2023-11-30T17:19:56.496983+0000","last_undegraded":"2023-11-30T17:19:56.496983+0000","last_fullsized":"2023-11-30T17:19:56.496983+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.499089+0000","last_change":"2023-11-30T17:19:56.110873+0000","last_active":"2023-11-30T17:19:56.499089+0000","last_peered":"2023-11-30T17:19:56.499089+0000","last_clean":"2023-11-30T17:19:56.499089+0000","last_became_active":"2023-11-30T17:19:56.110385+0000","last_became_peered":"2023-11-30T17:19:56.110385+0000","last_unstale":"2023-11-30T17:19:56.499089+0000","last_undegraded":"2023-11-30T17:19:56.499089+0000","last_fullsized":"2023-11-30T17:19:56.499089+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500826+0000","last_change":"2023-11-30T17:19:56.496567+0000","last_active":"2023-11-30T17:19:56.500826+0000","last_peered":"2023-11-30T17:19:56.500826+0000","last_clean":"2023-11-30T17:19:56.500826+0000","last_became_active":"2023-11-30T17:19:56.496282+0000","last_became_peered":"2023-11-30T17:19:56.496282+0000","last_unstale":"2023-11-30T17:19:56.500826+0000","last_undegraded":"2023-11-30T17:19:56.500826+0000","last_fullsized":"2023-11-30T17:19:56.500826+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.494906+0000","last_change":"2023-11-30T17:19:56.105548+0000","last_active":"2023-11-30T17:19:56.494906+0000","last_peered":"2023-11-30T17:19:56.494906+0000","last_clean":"2023-11-30T17:19:56.494906+0000","last_became_active":"2023-11-30T17:19:56.099867+0000","last_became_peered":"2023-11-30T17:19:56.099867+0000","last_unstale":"2023-11-30T17:19:56.494906+0000","last_undegraded":"2023-11-30T17:19:56.494906+0000","last_fullsized":"2023-11-30T17:19:56.494906+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.495750+0000","last_change":"2023-11-30T17:19:56.490226+0000","last_active":"2023-11-30T17:19:56.495750+0000","last_peered":"2023-11-30T17:19:56.495750+0000","last_clean":"2023-11-30T17:19:56.495750+0000","last_became_active":"2023-11-30T17:19:56.490008+0000","last_became_peered":"2023-11-30T17:19:56.490008+0000","last_unstale":"2023-11-30T17:19:56.495750+0000","last_undegraded":"2023-11-30T17:19:56.495750+0000","last_fullsized":"2023-11-30T17:19:56.495750+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498921+0000","last_change":"2023-11-30T17:19:56.110057+0000","last_active":"2023-11-30T17:19:56.498921+0000","last_peered":"2023-11-30T17:19:56.498921+0000","last_clean":"2023-11-30T17:19:56.498921+0000","last_became_active":"2023-11-30T17:19:56.109561+0000","last_became_peered":"2023-11-30T17:19:56.109561+0000","last_unstale":"2023-11-30T17:19:56.498921+0000","last_undegraded":"2023-11-30T17:19:56.498921+0000","last_fullsized":"2023-11-30T17:19:56.498921+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.495975+0000","last_change":"2023-11-30T17:19:56.489294+0000","last_active":"2023-11-30T17:19:56.495975+0000","last_peered":"2023-11-30T17:19:56.495975+0000","last_clean":"2023-11-30T17:19:56.495975+0000","last_became_active":"2023-11-30T17:19:56.489005+0000","last_became_peered":"2023-11-30T17:19:56.489005+0000","last_unstale":"2023-11-30T17:19:56.495975+0000","last_undegraded":"2023-11-30T17:19:56.495975+0000","last_fullsized":"2023-11-30T17:19:56.495975+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.34","version":"64'4","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498286+0000","last_change":"2023-11-30T17:19:56.099632+0000","last_active":"2023-11-30T17:19:56.498286+0000","last_peered":"2023-11-30T17:19:56.498286+0000","last_clean":"2023-11-30T17:19:56.498286+0000","last_became_active":"2023-11-30T17:19:56.099366+0000","last_became_peered":"2023-11-30T17:19:56.099366+0000","last_unstale":"2023-11-30T17:19:56.498286+0000","last_undegraded":"2023-11-30T17:19:56.498286+0000","last_fullsized":"2023-11-30T17:19:56.498286+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.492794+0000","last_change":"2023-11-30T17:19:56.490274+0000","last_active":"2023-11-30T17:19:56.492794+0000","last_peered":"2023-11-30T17:19:56.492794+0000","last_clean":"2023-11-30T17:19:56.492794+0000","last_became_active":"2023-11-30T17:19:56.490014+0000","last_became_peered":"2023-11-30T17:19:56.490014+0000","last_unstale":"2023-11-30T17:19:56.492794+0000","last_undegraded":"2023-11-30T17:19:56.492794+0000","last_fullsized":"2023-11-30T17:19:56.492794+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.492148+0000","last_change":"2023-11-30T17:19:56.104864+0000","last_active":"2023-11-30T17:19:56.492148+0000","last_peered":"2023-11-30T17:19:56.492148+0000","last_clean":"2023-11-30T17:19:56.492148+0000","last_became_active":"2023-11-30T17:19:56.104590+0000","last_became_peered":"2023-11-30T17:19:56.104590+0000","last_unstale":"2023-11-30T17:19:56.492148+0000","last_undegraded":"2023-11-30T17:19:56.492148+0000","last_fullsized":"2023-11-30T17:19:56.492148+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.502029+0000","last_change":"2023-11-30T17:19:56.499597+0000","last_active":"2023-11-30T17:19:56.502029+0000","last_peered":"2023-11-30T17:19:56.502029+0000","last_clean":"2023-11-30T17:19:56.502029+0000","last_became_active":"2023-11-30T17:19:56.499146+0000","last_became_peered":"2023-11-30T17:19:56.499146+0000","last_unstale":"2023-11-30T17:19:56.502029+0000","last_undegraded":"2023-11-30T17:19:56.502029+0000","last_fullsized":"2023-11-30T17:19:56.502029+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.487477+0000","last_change":"2023-11-30T17:19:56.110204+0000","last_active":"2023-11-30T17:19:56.487477+0000","last_peered":"2023-11-30T17:19:56.487477+0000","last_clean":"2023-11-30T17:19:56.487477+0000","last_became_active":"2023-11-30T17:19:56.109745+0000","last_became_peered":"2023-11-30T17:19:56.109745+0000","last_unstale":"2023-11-30T17:19:56.487477+0000","last_undegraded":"2023-11-30T17:19:56.487477+0000","last_fullsized":"2023-11-30T17:19:56.487477+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498693+0000","last_change":"2023-11-30T17:19:56.494965+0000","last_active":"2023-11-30T17:19:56.498693+0000","last_peered":"2023-11-30T17:19:56.498693+0000","last_clean":"2023-11-30T17:19:56.498693+0000","last_became_active":"2023-11-30T17:19:56.494662+0000","last_became_peered":"2023-11-30T17:19:56.494662+0000","last_unstale":"2023-11-30T17:19:56.498693+0000","last_undegraded":"2023-11-30T17:19:56.498693+0000","last_fullsized":"2023-11-30T17:19:56.498693+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.476196+0000","last_change":"2023-11-30T17:19:56.100686+0000","last_active":"2023-11-30T17:19:56.476196+0000","last_peered":"2023-11-30T17:19:56.476196+0000","last_clean":"2023-11-30T17:19:56.476196+0000","last_became_active":"2023-11-30T17:19:56.100418+0000","last_became_peered":"2023-11-30T17:19:56.100418+0000","last_unstale":"2023-11-30T17:19:56.476196+0000","last_undegraded":"2023-11-30T17:19:56.476196+0000","last_fullsized":"2023-11-30T17:19:56.476196+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496351+0000","last_change":"2023-11-30T17:19:56.493474+0000","last_active":"2023-11-30T17:19:56.496351+0000","last_peered":"2023-11-30T17:19:56.496351+0000","last_clean":"2023-11-30T17:19:56.496351+0000","last_became_active":"2023-11-30T17:19:56.493191+0000","last_became_peered":"2023-11-30T17:19:56.493191+0000","last_unstale":"2023-11-30T17:19:56.496351+0000","last_undegraded":"2023-11-30T17:19:56.496351+0000","last_fullsized":"2023-11-30T17:19:56.496351+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.30","version":"64'4","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.502258+0000","last_change":"2023-11-30T17:19:56.109880+0000","last_active":"2023-11-30T17:19:56.502258+0000","last_peered":"2023-11-30T17:19:56.502258+0000","last_clean":"2023-11-30T17:19:56.502258+0000","last_became_active":"2023-11-30T17:19:56.109596+0000","last_became_peered":"2023-11-30T17:19:56.109596+0000","last_unstale":"2023-11-30T17:19:56.502258+0000","last_undegraded":"2023-11-30T17:19:56.502258+0000","last_fullsized":"2023-11-30T17:19:56.502258+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493563+0000","last_change":"2023-11-30T17:19:56.486088+0000","last_active":"2023-11-30T17:19:56.493563+0000","last_peered":"2023-11-30T17:19:56.493563+0000","last_clean":"2023-11-30T17:19:56.493563+0000","last_became_active":"2023-11-30T17:19:56.485651+0000","last_became_peered":"2023-11-30T17:19:56.485651+0000","last_unstale":"2023-11-30T17:19:56.493563+0000","last_undegraded":"2023-11-30T17:19:56.493563+0000","last_fullsized":"2023-11-30T17:19:56.493563+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.481069+0000","last_change":"2023-11-30T17:19:56.100541+0000","last_active":"2023-11-30T17:19:56.481069+0000","last_peered":"2023-11-30T17:19:56.481069+0000","last_clean":"2023-11-30T17:19:56.481069+0000","last_became_active":"2023-11-30T17:19:56.100235+0000","last_became_peered":"2023-11-30T17:19:56.100235+0000","last_unstale":"2023-11-30T17:19:56.481069+0000","last_undegraded":"2023-11-30T17:19:56.481069+0000","last_fullsized":"2023-11-30T17:19:56.481069+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.495220+0000","last_change":"2023-11-30T17:19:56.491494+0000","last_active":"2023-11-30T17:19:56.495220+0000","last_peered":"2023-11-30T17:19:56.495220+0000","last_clean":"2023-11-30T17:19:56.495220+0000","last_became_active":"2023-11-30T17:19:56.491200+0000","last_became_peered":"2023-11-30T17:19:56.491200+0000","last_unstale":"2023-11-30T17:19:56.495220+0000","last_undegraded":"2023-11-30T17:19:56.495220+0000","last_fullsized":"2023-11-30T17:19:56.495220+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.481247+0000","last_change":"2023-11-30T17:19:56.110258+0000","last_active":"2023-11-30T17:19:56.481247+0000","last_peered":"2023-11-30T17:19:56.481247+0000","last_clean":"2023-11-30T17:19:56.481247+0000","last_became_active":"2023-11-30T17:19:56.110018+0000","last_became_peered":"2023-11-30T17:19:56.110018+0000","last_unstale":"2023-11-30T17:19:56.481247+0000","last_undegraded":"2023-11-30T17:19:56.481247+0000","last_fullsized":"2023-11-30T17:19:56.481247+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.499018+0000","last_change":"2023-11-30T17:19:56.496795+0000","last_active":"2023-11-30T17:19:56.499018+0000","last_peered":"2023-11-30T17:19:56.499018+0000","last_clean":"2023-11-30T17:19:56.499018+0000","last_became_active":"2023-11-30T17:19:56.496519+0000","last_became_peered":"2023-11-30T17:19:56.496519+0000","last_unstale":"2023-11-30T17:19:56.499018+0000","last_undegraded":"2023-11-30T17:19:56.499018+0000","last_fullsized":"2023-11-30T17:19:56.499018+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2d","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.502425+0000","last_change":"2023-11-30T17:19:56.112107+0000","last_active":"2023-11-30T17:19:56.502425+0000","last_peered":"2023-11-30T17:19:56.502425+0000","last_clean":"2023-11-30T17:19:56.502425+0000","last_became_active":"2023-11-30T17:19:56.111754+0000","last_became_peered":"2023-11-30T17:19:56.111754+0000","last_unstale":"2023-11-30T17:19:56.502425+0000","last_undegraded":"2023-11-30T17:19:56.502425+0000","last_fullsized":"2023-11-30T17:19:56.502425+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500642+0000","last_change":"2023-11-30T17:19:56.494936+0000","last_active":"2023-11-30T17:19:56.500642+0000","last_peered":"2023-11-30T17:19:56.500642+0000","last_clean":"2023-11-30T17:19:56.500642+0000","last_became_active":"2023-11-30T17:19:56.494628+0000","last_became_peered":"2023-11-30T17:19:56.494628+0000","last_unstale":"2023-11-30T17:19:56.500642+0000","last_undegraded":"2023-11-30T17:19:56.500642+0000","last_fullsized":"2023-11-30T17:19:56.500642+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.476989+0000","last_change":"2023-11-30T17:19:56.103835+0000","last_active":"2023-11-30T17:19:56.476989+0000","last_peered":"2023-11-30T17:19:56.476989+0000","last_clean":"2023-11-30T17:19:56.476989+0000","last_became_active":"2023-11-30T17:19:56.103532+0000","last_became_peered":"2023-11-30T17:19:56.103532+0000","last_unstale":"2023-11-30T17:19:56.476989+0000","last_undegraded":"2023-11-30T17:19:56.476989+0000","last_fullsized":"2023-11-30T17:19:56.476989+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500118+0000","last_change":"2023-11-30T17:19:56.494092+0000","last_active":"2023-11-30T17:19:56.500118+0000","last_peered":"2023-11-30T17:19:56.500118+0000","last_clean":"2023-11-30T17:19:56.500118+0000","last_became_active":"2023-11-30T17:19:56.493703+0000","last_became_peered":"2023-11-30T17:19:56.493703+0000","last_unstale":"2023-11-30T17:19:56.500118+0000","last_undegraded":"2023-11-30T17:19:56.500118+0000","last_fullsized":"2023-11-30T17:19:56.500118+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2b","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.488294+0000","last_change":"2023-11-30T17:19:56.105248+0000","last_active":"2023-11-30T17:19:56.488294+0000","last_peered":"2023-11-30T17:19:56.488294+0000","last_clean":"2023-11-30T17:19:56.488294+0000","last_became_active":"2023-11-30T17:19:56.104768+0000","last_became_peered":"2023-11-30T17:19:56.104768+0000","last_unstale":"2023-11-30T17:19:56.488294+0000","last_undegraded":"2023-11-30T17:19:56.488294+0000","last_fullsized":"2023-11-30T17:19:56.488294+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496346+0000","last_change":"2023-11-30T17:19:56.490952+0000","last_active":"2023-11-30T17:19:56.496346+0000","last_peered":"2023-11-30T17:19:56.496346+0000","last_clean":"2023-11-30T17:19:56.496346+0000","last_became_active":"2023-11-30T17:19:56.490730+0000","last_became_peered":"2023-11-30T17:19:56.490730+0000","last_unstale":"2023-11-30T17:19:56.496346+0000","last_undegraded":"2023-11-30T17:19:56.496346+0000","last_fullsized":"2023-11-30T17:19:56.496346+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.487354+0000","last_change":"2023-11-30T17:19:56.105606+0000","last_active":"2023-11-30T17:19:56.487354+0000","last_peered":"2023-11-30T17:19:56.487354+0000","last_clean":"2023-11-30T17:19:56.487354+0000","last_became_active":"2023-11-30T17:19:56.104380+0000","last_became_peered":"2023-11-30T17:19:56.104380+0000","last_unstale":"2023-11-30T17:19:56.487354+0000","last_undegraded":"2023-11-30T17:19:56.487354+0000","last_fullsized":"2023-11-30T17:19:56.487354+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491376+0000","last_change":"2023-11-30T17:19:56.488970+0000","last_active":"2023-11-30T17:19:56.491376+0000","last_peered":"2023-11-30T17:19:56.491376+0000","last_clean":"2023-11-30T17:19:56.491376+0000","last_became_active":"2023-11-30T17:19:56.488343+0000","last_became_peered":"2023-11-30T17:19:56.488343+0000","last_unstale":"2023-11-30T17:19:56.491376+0000","last_undegraded":"2023-11-30T17:19:56.491376+0000","last_fullsized":"2023-11-30T17:19:56.491376+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.482899+0000","last_change":"2023-11-30T17:19:56.095270+0000","last_active":"2023-11-30T17:19:56.482899+0000","last_peered":"2023-11-30T17:19:56.482899+0000","last_clean":"2023-11-30T17:19:56.482899+0000","last_became_active":"2023-11-30T17:19:56.094960+0000","last_became_peered":"2023-11-30T17:19:56.094960+0000","last_unstale":"2023-11-30T17:19:56.482899+0000","last_undegraded":"2023-11-30T17:19:56.482899+0000","last_fullsized":"2023-11-30T17:19:56.482899+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498741+0000","last_change":"2023-11-30T17:19:56.490432+0000","last_active":"2023-11-30T17:19:56.498741+0000","last_peered":"2023-11-30T17:19:56.498741+0000","last_clean":"2023-11-30T17:19:56.498741+0000","last_became_active":"2023-11-30T17:19:56.490159+0000","last_became_peered":"2023-11-30T17:19:56.490159+0000","last_unstale":"2023-11-30T17:19:56.498741+0000","last_undegraded":"2023-11-30T17:19:56.498741+0000","last_fullsized":"2023-11-30T17:19:56.498741+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.488093+0000","last_change":"2023-11-30T17:19:56.094150+0000","last_active":"2023-11-30T17:19:56.488093+0000","last_peered":"2023-11-30T17:19:56.488093+0000","last_clean":"2023-11-30T17:19:56.488093+0000","last_became_active":"2023-11-30T17:19:56.093825+0000","last_became_peered":"2023-11-30T17:19:56.093825+0000","last_unstale":"2023-11-30T17:19:56.488093+0000","last_undegraded":"2023-11-30T17:19:56.488093+0000","last_fullsized":"2023-11-30T17:19:56.488093+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.494582+0000","last_change":"2023-11-30T17:19:56.490029+0000","last_active":"2023-11-30T17:19:56.494582+0000","last_peered":"2023-11-30T17:19:56.494582+0000","last_clean":"2023-11-30T17:19:56.494582+0000","last_became_active":"2023-11-30T17:19:56.488809+0000","last_became_peered":"2023-11-30T17:19:56.488809+0000","last_unstale":"2023-11-30T17:19:56.494582+0000","last_undegraded":"2023-11-30T17:19:56.494582+0000","last_fullsized":"2023-11-30T17:19:56.494582+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.483718+0000","last_change":"2023-11-30T17:19:56.096312+0000","last_active":"2023-11-30T17:19:56.483718+0000","last_peered":"2023-11-30T17:19:56.483718+0000","last_clean":"2023-11-30T17:19:56.483718+0000","last_became_active":"2023-11-30T17:19:56.095545+0000","last_became_peered":"2023-11-30T17:19:56.095545+0000","last_unstale":"2023-11-30T17:19:56.483718+0000","last_undegraded":"2023-11-30T17:19:56.483718+0000","last_fullsized":"2023-11-30T17:19:56.483718+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493787+0000","last_change":"2023-11-30T17:19:56.492227+0000","last_active":"2023-11-30T17:19:56.493787+0000","last_peered":"2023-11-30T17:19:56.493787+0000","last_clean":"2023-11-30T17:19:56.493787+0000","last_became_active":"2023-11-30T17:19:56.491955+0000","last_became_peered":"2023-11-30T17:19:56.491955+0000","last_unstale":"2023-11-30T17:19:56.493787+0000","last_undegraded":"2023-11-30T17:19:56.493787+0000","last_fullsized":"2023-11-30T17:19:56.493787+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.475983+0000","last_change":"2023-11-30T17:19:56.105360+0000","last_active":"2023-11-30T17:19:56.475983+0000","last_peered":"2023-11-30T17:19:56.475983+0000","last_clean":"2023-11-30T17:19:56.475983+0000","last_became_active":"2023-11-30T17:19:56.105084+0000","last_became_peered":"2023-11-30T17:19:56.105084+0000","last_unstale":"2023-11-30T17:19:56.475983+0000","last_undegraded":"2023-11-30T17:19:56.475983+0000","last_fullsized":"2023-11-30T17:19:56.475983+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491335+0000","last_change":"2023-11-30T17:19:56.488160+0000","last_active":"2023-11-30T17:19:56.491335+0000","last_peered":"2023-11-30T17:19:56.491335+0000","last_clean":"2023-11-30T17:19:56.491335+0000","last_became_active":"2023-11-30T17:19:56.487871+0000","last_became_peered":"2023-11-30T17:19:56.487871+0000","last_unstale":"2023-11-30T17:19:56.491335+0000","last_undegraded":"2023-11-30T17:19:56.491335+0000","last_fullsized":"2023-11-30T17:19:56.491335+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.480944+0000","last_change":"2023-11-30T17:19:56.098559+0000","last_active":"2023-11-30T17:19:56.480944+0000","last_peered":"2023-11-30T17:19:56.480944+0000","last_clean":"2023-11-30T17:19:56.480944+0000","last_became_active":"2023-11-30T17:19:56.098296+0000","last_became_peered":"2023-11-30T17:19:56.098296+0000","last_unstale":"2023-11-30T17:19:56.480944+0000","last_undegraded":"2023-11-30T17:19:56.480944+0000","last_fullsized":"2023-11-30T17:19:56.480944+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500158+0000","last_change":"2023-11-30T17:19:56.494137+0000","last_active":"2023-11-30T17:19:56.500158+0000","last_peered":"2023-11-30T17:19:56.500158+0000","last_clean":"2023-11-30T17:19:56.500158+0000","last_became_active":"2023-11-30T17:19:56.493850+0000","last_became_peered":"2023-11-30T17:19:56.493850+0000","last_unstale":"2023-11-30T17:19:56.500158+0000","last_undegraded":"2023-11-30T17:19:56.500158+0000","last_fullsized":"2023-11-30T17:19:56.500158+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.479299+0000","last_change":"2023-11-30T17:19:56.098747+0000","last_active":"2023-11-30T17:19:56.479299+0000","last_peered":"2023-11-30T17:19:56.479299+0000","last_clean":"2023-11-30T17:19:56.479299+0000","last_became_active":"2023-11-30T17:19:56.098096+0000","last_became_peered":"2023-11-30T17:19:56.098096+0000","last_unstale":"2023-11-30T17:19:56.479299+0000","last_undegraded":"2023-11-30T17:19:56.479299+0000","last_fullsized":"2023-11-30T17:19:56.479299+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500265+0000","last_change":"2023-11-30T17:19:56.498069+0000","last_active":"2023-11-30T17:19:56.500265+0000","last_peered":"2023-11-30T17:19:56.500265+0000","last_clean":"2023-11-30T17:19:56.500265+0000","last_became_active":"2023-11-30T17:19:56.497804+0000","last_became_peered":"2023-11-30T17:19:56.497804+0000","last_unstale":"2023-11-30T17:19:56.500265+0000","last_undegraded":"2023-11-30T17:19:56.500265+0000","last_fullsized":"2023-11-30T17:19:56.500265+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.486879+0000","last_change":"2023-11-30T17:19:56.095025+0000","last_active":"2023-11-30T17:19:56.486879+0000","last_peered":"2023-11-30T17:19:56.486879+0000","last_clean":"2023-11-30T17:19:56.486879+0000","last_became_active":"2023-11-30T17:19:56.094733+0000","last_became_peered":"2023-11-30T17:19:56.094733+0000","last_unstale":"2023-11-30T17:19:56.486879+0000","last_undegraded":"2023-11-30T17:19:56.486879+0000","last_fullsized":"2023-11-30T17:19:56.486879+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.502012+0000","last_change":"2023-11-30T17:19:56.499411+0000","last_active":"2023-11-30T17:19:56.502012+0000","last_peered":"2023-11-30T17:19:56.502012+0000","last_clean":"2023-11-30T17:19:56.502012+0000","last_became_active":"2023-11-30T17:19:56.497013+0000","last_became_peered":"2023-11-30T17:19:56.497013+0000","last_unstale":"2023-11-30T17:19:56.502012+0000","last_undegraded":"2023-11-30T17:19:56.502012+0000","last_fullsized":"2023-11-30T17:19:56.502012+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.481132+0000","last_change":"2023-11-30T17:19:56.095308+0000","last_active":"2023-11-30T17:19:56.481132+0000","last_peered":"2023-11-30T17:19:56.481132+0000","last_clean":"2023-11-30T17:19:56.481132+0000","last_became_active":"2023-11-30T17:19:56.094983+0000","last_became_peered":"2023-11-30T17:19:56.094983+0000","last_unstale":"2023-11-30T17:19:56.481132+0000","last_undegraded":"2023-11-30T17:19:56.481132+0000","last_fullsized":"2023-11-30T17:19:56.481132+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498714+0000","last_change":"2023-11-30T17:19:56.495065+0000","last_active":"2023-11-30T17:19:56.498714+0000","last_peered":"2023-11-30T17:19:56.498714+0000","last_clean":"2023-11-30T17:19:56.498714+0000","last_became_active":"2023-11-30T17:19:56.494734+0000","last_became_peered":"2023-11-30T17:19:56.494734+0000","last_unstale":"2023-11-30T17:19:56.498714+0000","last_undegraded":"2023-11-30T17:19:56.498714+0000","last_fullsized":"2023-11-30T17:19:56.498714+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.476094+0000","last_change":"2023-11-30T17:19:56.100559+0000","last_active":"2023-11-30T17:19:56.476094+0000","last_peered":"2023-11-30T17:19:56.476094+0000","last_clean":"2023-11-30T17:19:56.476094+0000","last_became_active":"2023-11-30T17:19:56.100267+0000","last_became_peered":"2023-11-30T17:19:56.100267+0000","last_unstale":"2023-11-30T17:19:56.476094+0000","last_undegraded":"2023-11-30T17:19:56.476094+0000","last_fullsized":"2023-11-30T17:19:56.476094+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.502077+0000","last_change":"2023-11-30T17:19:56.499755+0000","last_active":"2023-11-30T17:19:56.502077+0000","last_peered":"2023-11-30T17:19:56.502077+0000","last_clean":"2023-11-30T17:19:56.502077+0000","last_became_active":"2023-11-30T17:19:56.499465+0000","last_became_peered":"2023-11-30T17:19:56.499465+0000","last_unstale":"2023-11-30T17:19:56.502077+0000","last_undegraded":"2023-11-30T17:19:56.502077+0000","last_fullsized":"2023-11-30T17:19:56.502077+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.477375+0000","last_change":"2023-11-30T17:19:56.088985+0000","last_active":"2023-11-30T17:19:56.477375+0000","last_peered":"2023-11-30T17:19:56.477375+0000","last_clean":"2023-11-30T17:19:56.477375+0000","last_became_active":"2023-11-30T17:19:56.088686+0000","last_became_peered":"2023-11-30T17:19:56.088686+0000","last_unstale":"2023-11-30T17:19:56.477375+0000","last_undegraded":"2023-11-30T17:19:56.477375+0000","last_fullsized":"2023-11-30T17:19:56.477375+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.499116+0000","last_change":"2023-11-30T17:19:56.495412+0000","last_active":"2023-11-30T17:19:56.499116+0000","last_peered":"2023-11-30T17:19:56.499116+0000","last_clean":"2023-11-30T17:19:56.499116+0000","last_became_active":"2023-11-30T17:19:56.494719+0000","last_became_peered":"2023-11-30T17:19:56.494719+0000","last_unstale":"2023-11-30T17:19:56.499116+0000","last_undegraded":"2023-11-30T17:19:56.499116+0000","last_fullsized":"2023-11-30T17:19:56.499116+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498840+0000","last_change":"2023-11-30T17:19:56.092247+0000","last_active":"2023-11-30T17:19:56.498840+0000","last_peered":"2023-11-30T17:19:56.498840+0000","last_clean":"2023-11-30T17:19:56.498840+0000","last_became_active":"2023-11-30T17:19:56.091959+0000","last_became_peered":"2023-11-30T17:19:56.091959+0000","last_unstale":"2023-11-30T17:19:56.498840+0000","last_undegraded":"2023-11-30T17:19:56.498840+0000","last_fullsized":"2023-11-30T17:19:56.498840+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.497842+0000","last_change":"2023-11-30T17:19:56.496872+0000","last_active":"2023-11-30T17:19:56.497842+0000","last_peered":"2023-11-30T17:19:56.497842+0000","last_clean":"2023-11-30T17:19:56.497842+0000","last_became_active":"2023-11-30T17:19:56.496614+0000","last_became_peered":"2023-11-30T17:19:56.496614+0000","last_unstale":"2023-11-30T17:19:56.497842+0000","last_undegraded":"2023-11-30T17:19:56.497842+0000","last_fullsized":"2023-11-30T17:19:56.497842+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491029+0000","last_change":"2023-11-30T17:19:56.104114+0000","last_active":"2023-11-30T17:19:56.491029+0000","last_peered":"2023-11-30T17:19:56.491029+0000","last_clean":"2023-11-30T17:19:56.491029+0000","last_became_active":"2023-11-30T17:19:56.103835+0000","last_became_peered":"2023-11-30T17:19:56.103835+0000","last_unstale":"2023-11-30T17:19:56.491029+0000","last_undegraded":"2023-11-30T17:19:56.491029+0000","last_fullsized":"2023-11-30T17:19:56.491029+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.499970+0000","last_change":"2023-11-30T17:19:56.493548+0000","last_active":"2023-11-30T17:19:56.499970+0000","last_peered":"2023-11-30T17:19:56.499970+0000","last_clean":"2023-11-30T17:19:56.499970+0000","last_became_active":"2023-11-30T17:19:56.493246+0000","last_became_peered":"2023-11-30T17:19:56.493246+0000","last_unstale":"2023-11-30T17:19:56.499970+0000","last_undegraded":"2023-11-30T17:19:56.499970+0000","last_fullsized":"2023-11-30T17:19:56.499970+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"64'2","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500313+0000","last_change":"2023-11-30T17:19:56.087339+0000","last_active":"2023-11-30T17:19:56.500313+0000","last_peered":"2023-11-30T17:19:56.500313+0000","last_clean":"2023-11-30T17:19:56.500313+0000","last_became_active":"2023-11-30T17:19:56.086993+0000","last_became_peered":"2023-11-30T17:19:56.086993+0000","last_unstale":"2023-11-30T17:19:56.500313+0000","last_undegraded":"2023-11-30T17:19:56.500313+0000","last_fullsized":"2023-11-30T17:19:56.500313+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491920+0000","last_change":"2023-11-30T17:19:56.489159+0000","last_active":"2023-11-30T17:19:56.491920+0000","last_peered":"2023-11-30T17:19:56.491920+0000","last_clean":"2023-11-30T17:19:56.491920+0000","last_became_active":"2023-11-30T17:19:56.488952+0000","last_became_peered":"2023-11-30T17:19:56.488952+0000","last_unstale":"2023-11-30T17:19:56.491920+0000","last_undegraded":"2023-11-30T17:19:56.491920+0000","last_fullsized":"2023-11-30T17:19:56.491920+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.479404+0000","last_change":"2023-11-30T17:19:56.098371+0000","last_active":"2023-11-30T17:19:56.479404+0000","last_peered":"2023-11-30T17:19:56.479404+0000","last_clean":"2023-11-30T17:19:56.479404+0000","last_became_active":"2023-11-30T17:19:56.097768+0000","last_became_peered":"2023-11-30T17:19:56.097768+0000","last_unstale":"2023-11-30T17:19:56.479404+0000","last_undegraded":"2023-11-30T17:19:56.479404+0000","last_fullsized":"2023-11-30T17:19:56.479404+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.495898+0000","last_change":"2023-11-30T17:19:56.488390+0000","last_active":"2023-11-30T17:19:56.495898+0000","last_peered":"2023-11-30T17:19:56.495898+0000","last_clean":"2023-11-30T17:19:56.495898+0000","last_became_active":"2023-11-30T17:19:56.488106+0000","last_became_peered":"2023-11-30T17:19:56.488106+0000","last_unstale":"2023-11-30T17:19:56.495898+0000","last_undegraded":"2023-11-30T17:19:56.495898+0000","last_fullsized":"2023-11-30T17:19:56.495898+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.494168+0000","last_change":"2023-11-30T17:19:56.107222+0000","last_active":"2023-11-30T17:19:56.494168+0000","last_peered":"2023-11-30T17:19:56.494168+0000","last_clean":"2023-11-30T17:19:56.494168+0000","last_became_active":"2023-11-30T17:19:56.106944+0000","last_became_peered":"2023-11-30T17:19:56.106944+0000","last_unstale":"2023-11-30T17:19:56.494168+0000","last_undegraded":"2023-11-30T17:19:56.494168+0000","last_fullsized":"2023-11-30T17:19:56.494168+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.499076+0000","last_change":"2023-11-30T17:19:56.497589+0000","last_active":"2023-11-30T17:19:56.499076+0000","last_peered":"2023-11-30T17:19:56.499076+0000","last_clean":"2023-11-30T17:19:56.499076+0000","last_became_active":"2023-11-30T17:19:56.497315+0000","last_became_peered":"2023-11-30T17:19:56.497315+0000","last_unstale":"2023-11-30T17:19:56.499076+0000","last_undegraded":"2023-11-30T17:19:56.499076+0000","last_fullsized":"2023-11-30T17:19:56.499076+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.481229+0000","last_change":"2023-11-30T17:19:56.089588+0000","last_active":"2023-11-30T17:19:56.481229+0000","last_peered":"2023-11-30T17:19:56.481229+0000","last_clean":"2023-11-30T17:19:56.481229+0000","last_became_active":"2023-11-30T17:19:56.089308+0000","last_became_peered":"2023-11-30T17:19:56.089308+0000","last_unstale":"2023-11-30T17:19:56.481229+0000","last_undegraded":"2023-11-30T17:19:56.481229+0000","last_fullsized":"2023-11-30T17:19:56.481229+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491354+0000","last_change":"2023-11-30T17:19:56.488325+0000","last_active":"2023-11-30T17:19:56.491354+0000","last_peered":"2023-11-30T17:19:56.491354+0000","last_clean":"2023-11-30T17:19:56.491354+0000","last_became_active":"2023-11-30T17:19:56.488024+0000","last_became_peered":"2023-11-30T17:19:56.488024+0000","last_unstale":"2023-11-30T17:19:56.491354+0000","last_undegraded":"2023-11-30T17:19:56.491354+0000","last_fullsized":"2023-11-30T17:19:56.491354+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.483007+0000","last_change":"2023-11-30T17:19:56.094548+0000","last_active":"2023-11-30T17:19:56.483007+0000","last_peered":"2023-11-30T17:19:56.483007+0000","last_clean":"2023-11-30T17:19:56.483007+0000","last_became_active":"2023-11-30T17:19:56.094228+0000","last_became_peered":"2023-11-30T17:19:56.094228+0000","last_unstale":"2023-11-30T17:19:56.483007+0000","last_undegraded":"2023-11-30T17:19:56.483007+0000","last_fullsized":"2023-11-30T17:19:56.483007+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.502394+0000","last_change":"2023-11-30T17:19:56.501622+0000","last_active":"2023-11-30T17:19:56.502394+0000","last_peered":"2023-11-30T17:19:56.502394+0000","last_clean":"2023-11-30T17:19:56.502394+0000","last_became_active":"2023-11-30T17:19:56.501307+0000","last_became_peered":"2023-11-30T17:19:56.501307+0000","last_unstale":"2023-11-30T17:19:56.502394+0000","last_undegraded":"2023-11-30T17:19:56.502394+0000","last_fullsized":"2023-11-30T17:19:56.502394+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.487985+0000","last_change":"2023-11-30T17:19:56.104353+0000","last_active":"2023-11-30T17:19:56.487985+0000","last_peered":"2023-11-30T17:19:56.487985+0000","last_clean":"2023-11-30T17:19:56.487985+0000","last_became_active":"2023-11-30T17:19:56.102240+0000","last_became_peered":"2023-11-30T17:19:56.102240+0000","last_unstale":"2023-11-30T17:19:56.487985+0000","last_undegraded":"2023-11-30T17:19:56.487985+0000","last_fullsized":"2023-11-30T17:19:56.487985+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.492773+0000","last_change":"2023-11-30T17:19:56.484307+0000","last_active":"2023-11-30T17:19:56.492773+0000","last_peered":"2023-11-30T17:19:56.492773+0000","last_clean":"2023-11-30T17:19:56.492773+0000","last_became_active":"2023-11-30T17:19:56.484028+0000","last_became_peered":"2023-11-30T17:19:56.484028+0000","last_unstale":"2023-11-30T17:19:56.492773+0000","last_undegraded":"2023-11-30T17:19:56.492773+0000","last_fullsized":"2023-11-30T17:19:56.492773+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.484948+0000","last_change":"2023-11-30T17:19:56.103000+0000","last_active":"2023-11-30T17:19:56.484948+0000","last_peered":"2023-11-30T17:19:56.484948+0000","last_clean":"2023-11-30T17:19:56.484948+0000","last_became_active":"2023-11-30T17:19:56.102778+0000","last_became_peered":"2023-11-30T17:19:56.102778+0000","last_unstale":"2023-11-30T17:19:56.484948+0000","last_undegraded":"2023-11-30T17:19:56.484948+0000","last_fullsized":"2023-11-30T17:19:56.484948+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.494098+0000","last_change":"2023-11-30T17:19:56.490277+0000","last_active":"2023-11-30T17:19:56.494098+0000","last_peered":"2023-11-30T17:19:56.494098+0000","last_clean":"2023-11-30T17:19:56.494098+0000","last_became_active":"2023-11-30T17:19:56.490009+0000","last_became_peered":"2023-11-30T17:19:56.490009+0000","last_unstale":"2023-11-30T17:19:56.494098+0000","last_undegraded":"2023-11-30T17:19:56.494098+0000","last_fullsized":"2023-11-30T17:19:56.494098+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.481344+0000","last_change":"2023-11-30T17:19:56.110164+0000","last_active":"2023-11-30T17:19:56.481344+0000","last_peered":"2023-11-30T17:19:56.481344+0000","last_clean":"2023-11-30T17:19:56.481344+0000","last_became_active":"2023-11-30T17:19:56.109711+0000","last_became_peered":"2023-11-30T17:19:56.109711+0000","last_unstale":"2023-11-30T17:19:56.481344+0000","last_undegraded":"2023-11-30T17:19:56.481344+0000","last_fullsized":"2023-11-30T17:19:56.481344+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.501207+0000","last_change":"2023-11-30T17:19:56.499008+0000","last_active":"2023-11-30T17:19:56.501207+0000","last_peered":"2023-11-30T17:19:56.501207+0000","last_clean":"2023-11-30T17:19:56.501207+0000","last_became_active":"2023-11-30T17:19:56.498726+0000","last_became_peered":"2023-11-30T17:19:56.498726+0000","last_unstale":"2023-11-30T17:19:56.501207+0000","last_undegraded":"2023-11-30T17:19:56.501207+0000","last_fullsized":"2023-11-30T17:19:56.501207+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"64'3","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.497982+0000","last_change":"2023-11-30T17:19:56.099588+0000","last_active":"2023-11-30T17:19:56.497982+0000","last_peered":"2023-11-30T17:19:56.497982+0000","last_clean":"2023-11-30T17:19:56.497982+0000","last_became_active":"2023-11-30T17:19:56.099307+0000","last_became_peered":"2023-11-30T17:19:56.099307+0000","last_unstale":"2023-11-30T17:19:56.497982+0000","last_undegraded":"2023-11-30T17:19:56.497982+0000","last_fullsized":"2023-11-30T17:19:56.497982+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493048+0000","last_change":"2023-11-30T17:19:56.486135+0000","last_active":"2023-11-30T17:19:56.493048+0000","last_peered":"2023-11-30T17:19:56.493048+0000","last_clean":"2023-11-30T17:19:56.493048+0000","last_became_active":"2023-11-30T17:19:56.484719+0000","last_became_peered":"2023-11-30T17:19:56.484719+0000","last_unstale":"2023-11-30T17:19:56.493048+0000","last_undegraded":"2023-11-30T17:19:56.493048+0000","last_fullsized":"2023-11-30T17:19:56.493048+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"64'2","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493354+0000","last_change":"2023-11-30T17:19:56.099031+0000","last_active":"2023-11-30T17:19:56.493354+0000","last_peered":"2023-11-30T17:19:56.493354+0000","last_clean":"2023-11-30T17:19:56.493354+0000","last_became_active":"2023-11-30T17:19:56.098676+0000","last_became_peered":"2023-11-30T17:19:56.098676+0000","last_unstale":"2023-11-30T17:19:56.493354+0000","last_undegraded":"2023-11-30T17:19:56.493354+0000","last_fullsized":"2023-11-30T17:19:56.493354+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498229+0000","last_change":"2023-11-30T17:19:56.493423+0000","last_active":"2023-11-30T17:19:56.498229+0000","last_peered":"2023-11-30T17:19:56.498229+0000","last_clean":"2023-11-30T17:19:56.498229+0000","last_became_active":"2023-11-30T17:19:56.493141+0000","last_became_peered":"2023-11-30T17:19:56.493141+0000","last_unstale":"2023-11-30T17:19:56.498229+0000","last_undegraded":"2023-11-30T17:19:56.498229+0000","last_fullsized":"2023-11-30T17:19:56.498229+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.501063+0000","last_change":"2023-11-30T17:19:56.106743+0000","last_active":"2023-11-30T17:19:56.501063+0000","last_peered":"2023-11-30T17:19:56.501063+0000","last_clean":"2023-11-30T17:19:56.501063+0000","last_became_active":"2023-11-30T17:19:56.106450+0000","last_became_peered":"2023-11-30T17:19:56.106450+0000","last_unstale":"2023-11-30T17:19:56.501063+0000","last_undegraded":"2023-11-30T17:19:56.501063+0000","last_fullsized":"2023-11-30T17:19:56.501063+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500981+0000","last_change":"2023-11-30T17:19:56.497411+0000","last_active":"2023-11-30T17:19:56.500981+0000","last_peered":"2023-11-30T17:19:56.500981+0000","last_clean":"2023-11-30T17:19:56.500981+0000","last_became_active":"2023-11-30T17:19:56.487506+0000","last_became_peered":"2023-11-30T17:19:56.487506+0000","last_unstale":"2023-11-30T17:19:56.500981+0000","last_undegraded":"2023-11-30T17:19:56.500981+0000","last_fullsized":"2023-11-30T17:19:56.500981+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.483641+0000","last_change":"2023-11-30T17:19:56.113820+0000","last_active":"2023-11-30T17:19:56.483641+0000","last_peered":"2023-11-30T17:19:56.483641+0000","last_clean":"2023-11-30T17:19:56.483641+0000","last_became_active":"2023-11-30T17:19:56.113528+0000","last_became_peered":"2023-11-30T17:19:56.113528+0000","last_unstale":"2023-11-30T17:19:56.483641+0000","last_undegraded":"2023-11-30T17:19:56.483641+0000","last_fullsized":"2023-11-30T17:19:56.483641+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491429+0000","last_change":"2023-11-30T17:19:56.490367+0000","last_active":"2023-11-30T17:19:56.491429+0000","last_peered":"2023-11-30T17:19:56.491429+0000","last_clean":"2023-11-30T17:19:56.491429+0000","last_became_active":"2023-11-30T17:19:56.490117+0000","last_became_peered":"2023-11-30T17:19:56.490117+0000","last_unstale":"2023-11-30T17:19:56.491429+0000","last_undegraded":"2023-11-30T17:19:56.491429+0000","last_fullsized":"2023-11-30T17:19:56.491429+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.483337+0000","last_change":"2023-11-30T17:19:56.100665+0000","last_active":"2023-11-30T17:19:56.483337+0000","last_peered":"2023-11-30T17:19:56.483337+0000","last_clean":"2023-11-30T17:19:56.483337+0000","last_became_active":"2023-11-30T17:19:56.100289+0000","last_became_peered":"2023-11-30T17:19:56.100289+0000","last_unstale":"2023-11-30T17:19:56.483337+0000","last_undegraded":"2023-11-30T17:19:56.483337+0000","last_fullsized":"2023-11-30T17:19:56.483337+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.501995+0000","last_change":"2023-11-30T17:19:56.499238+0000","last_active":"2023-11-30T17:19:56.501995+0000","last_peered":"2023-11-30T17:19:56.501995+0000","last_clean":"2023-11-30T17:19:56.501995+0000","last_became_active":"2023-11-30T17:19:56.498862+0000","last_became_peered":"2023-11-30T17:19:56.498862+0000","last_unstale":"2023-11-30T17:19:56.501995+0000","last_undegraded":"2023-11-30T17:19:56.501995+0000","last_fullsized":"2023-11-30T17:19:56.501995+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"64'4","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493785+0000","last_change":"2023-11-30T17:19:56.104095+0000","last_active":"2023-11-30T17:19:56.493785+0000","last_peered":"2023-11-30T17:19:56.493785+0000","last_clean":"2023-11-30T17:19:56.493785+0000","last_became_active":"2023-11-30T17:19:56.103816+0000","last_became_peered":"2023-11-30T17:19:56.103816+0000","last_unstale":"2023-11-30T17:19:56.493785+0000","last_undegraded":"2023-11-30T17:19:56.493785+0000","last_fullsized":"2023-11-30T17:19:56.493785+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496102+0000","last_change":"2023-11-30T17:19:56.494855+0000","last_active":"2023-11-30T17:19:56.496102+0000","last_peered":"2023-11-30T17:19:56.496102+0000","last_clean":"2023-11-30T17:19:56.496102+0000","last_became_active":"2023-11-30T17:19:56.494231+0000","last_became_peered":"2023-11-30T17:19:56.494231+0000","last_unstale":"2023-11-30T17:19:56.496102+0000","last_undegraded":"2023-11-30T17:19:56.496102+0000","last_fullsized":"2023-11-30T17:19:56.496102+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.504017+0000","last_change":"2023-11-30T17:19:56.108216+0000","last_active":"2023-11-30T17:19:56.504017+0000","last_peered":"2023-11-30T17:19:56.504017+0000","last_clean":"2023-11-30T17:19:56.504017+0000","last_became_active":"2023-11-30T17:19:56.107938+0000","last_became_peered":"2023-11-30T17:19:56.107938+0000","last_unstale":"2023-11-30T17:19:56.504017+0000","last_undegraded":"2023-11-30T17:19:56.504017+0000","last_fullsized":"2023-11-30T17:19:56.504017+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.495894+0000","last_change":"2023-11-30T17:19:56.490237+0000","last_active":"2023-11-30T17:19:56.495894+0000","last_peered":"2023-11-30T17:19:56.495894+0000","last_clean":"2023-11-30T17:19:56.495894+0000","last_became_active":"2023-11-30T17:19:56.489940+0000","last_became_peered":"2023-11-30T17:19:56.489940+0000","last_unstale":"2023-11-30T17:19:56.495894+0000","last_undegraded":"2023-11-30T17:19:56.495894+0000","last_fullsized":"2023-11-30T17:19:56.495894+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"64'2","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.492593+0000","last_change":"2023-11-30T17:19:56.100743+0000","last_active":"2023-11-30T17:19:56.492593+0000","last_peered":"2023-11-30T17:19:56.492593+0000","last_clean":"2023-11-30T17:19:56.492593+0000","last_became_active":"2023-11-30T17:19:56.100431+0000","last_became_peered":"2023-11-30T17:19:56.100431+0000","last_unstale":"2023-11-30T17:19:56.492593+0000","last_undegraded":"2023-11-30T17:19:56.492593+0000","last_fullsized":"2023-11-30T17:19:56.492593+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.495805+0000","last_change":"2023-11-30T17:19:56.490216+0000","last_active":"2023-11-30T17:19:56.495805+0000","last_peered":"2023-11-30T17:19:56.495805+0000","last_clean":"2023-11-30T17:19:56.495805+0000","last_became_active":"2023-11-30T17:19:56.489904+0000","last_became_peered":"2023-11-30T17:19:56.489904+0000","last_unstale":"2023-11-30T17:19:56.495805+0000","last_undegraded":"2023-11-30T17:19:56.495805+0000","last_fullsized":"2023-11-30T17:19:56.495805+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.490352+0000","last_change":"2023-11-30T17:19:56.089508+0000","last_active":"2023-11-30T17:19:56.490352+0000","last_peered":"2023-11-30T17:19:56.490352+0000","last_clean":"2023-11-30T17:19:56.490352+0000","last_became_active":"2023-11-30T17:19:56.089211+0000","last_became_peered":"2023-11-30T17:19:56.089211+0000","last_unstale":"2023-11-30T17:19:56.490352+0000","last_undegraded":"2023-11-30T17:19:56.490352+0000","last_fullsized":"2023-11-30T17:19:56.490352+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496432+0000","last_change":"2023-11-30T17:19:56.493539+0000","last_active":"2023-11-30T17:19:56.496432+0000","last_peered":"2023-11-30T17:19:56.496432+0000","last_clean":"2023-11-30T17:19:56.496432+0000","last_became_active":"2023-11-30T17:19:56.493211+0000","last_became_peered":"2023-11-30T17:19:56.493211+0000","last_unstale":"2023-11-30T17:19:56.496432+0000","last_undegraded":"2023-11-30T17:19:56.496432+0000","last_fullsized":"2023-11-30T17:19:56.496432+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.487341+0000","last_change":"2023-11-30T17:19:56.094986+0000","last_active":"2023-11-30T17:19:56.487341+0000","last_peered":"2023-11-30T17:19:56.487341+0000","last_clean":"2023-11-30T17:19:56.487341+0000","last_became_active":"2023-11-30T17:19:56.094657+0000","last_became_peered":"2023-11-30T17:19:56.094657+0000","last_unstale":"2023-11-30T17:19:56.487341+0000","last_undegraded":"2023-11-30T17:19:56.487341+0000","last_fullsized":"2023-11-30T17:19:56.487341+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.498207+0000","last_change":"2023-11-30T17:19:56.492263+0000","last_active":"2023-11-30T17:19:56.498207+0000","last_peered":"2023-11-30T17:19:56.498207+0000","last_clean":"2023-11-30T17:19:56.498207+0000","last_became_active":"2023-11-30T17:19:56.491997+0000","last_became_peered":"2023-11-30T17:19:56.491997+0000","last_unstale":"2023-11-30T17:19:56.498207+0000","last_undegraded":"2023-11-30T17:19:56.498207+0000","last_fullsized":"2023-11-30T17:19:56.498207+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493638+0000","last_change":"2023-11-30T17:19:56.101187+0000","last_active":"2023-11-30T17:19:56.493638+0000","last_peered":"2023-11-30T17:19:56.493638+0000","last_clean":"2023-11-30T17:19:56.493638+0000","last_became_active":"2023-11-30T17:19:56.100914+0000","last_became_peered":"2023-11-30T17:19:56.100914+0000","last_unstale":"2023-11-30T17:19:56.493638+0000","last_undegraded":"2023-11-30T17:19:56.493638+0000","last_fullsized":"2023-11-30T17:19:56.493638+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500297+0000","last_change":"2023-11-30T17:19:56.499308+0000","last_active":"2023-11-30T17:19:56.500297+0000","last_peered":"2023-11-30T17:19:56.500297+0000","last_clean":"2023-11-30T17:19:56.500297+0000","last_became_active":"2023-11-30T17:19:56.499046+0000","last_became_peered":"2023-11-30T17:19:56.499046+0000","last_unstale":"2023-11-30T17:19:56.500297+0000","last_undegraded":"2023-11-30T17:19:56.500297+0000","last_fullsized":"2023-11-30T17:19:56.500297+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.476956+0000","last_change":"2023-11-30T17:19:56.099958+0000","last_active":"2023-11-30T17:19:56.476956+0000","last_peered":"2023-11-30T17:19:56.476956+0000","last_clean":"2023-11-30T17:19:56.476956+0000","last_became_active":"2023-11-30T17:19:56.099666+0000","last_became_peered":"2023-11-30T17:19:56.099666+0000","last_unstale":"2023-11-30T17:19:56.476956+0000","last_undegraded":"2023-11-30T17:19:56.476956+0000","last_fullsized":"2023-11-30T17:19:56.476956+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.500920+0000","last_change":"2023-11-30T17:19:56.497005+0000","last_active":"2023-11-30T17:19:56.500920+0000","last_peered":"2023-11-30T17:19:56.500920+0000","last_clean":"2023-11-30T17:19:56.500920+0000","last_became_active":"2023-11-30T17:19:56.496751+0000","last_became_peered":"2023-11-30T17:19:56.496751+0000","last_unstale":"2023-11-30T17:19:56.500920+0000","last_undegraded":"2023-11-30T17:19:56.500920+0000","last_fullsized":"2023-11-30T17:19:56.500920+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.485997+0000","last_change":"2023-11-30T17:19:56.109945+0000","last_active":"2023-11-30T17:19:56.485997+0000","last_peered":"2023-11-30T17:19:56.485997+0000","last_clean":"2023-11-30T17:19:56.485997+0000","last_became_active":"2023-11-30T17:19:56.109524+0000","last_became_peered":"2023-11-30T17:19:56.109524+0000","last_unstale":"2023-11-30T17:19:56.485997+0000","last_undegraded":"2023-11-30T17:19:56.485997+0000","last_fullsized":"2023-11-30T17:19:56.485997+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.484983+0000","last_change":"2023-11-30T17:19:56.481568+0000","last_active":"2023-11-30T17:19:56.484983+0000","last_peered":"2023-11-30T17:19:56.484983+0000","last_clean":"2023-11-30T17:19:56.484983+0000","last_became_active":"2023-11-30T17:19:56.481250+0000","last_became_peered":"2023-11-30T17:19:56.481250+0000","last_unstale":"2023-11-30T17:19:56.484983+0000","last_undegraded":"2023-11-30T17:19:56.484983+0000","last_fullsized":"2023-11-30T17:19:56.484983+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.477452+0000","last_change":"2023-11-30T17:19:56.094800+0000","last_active":"2023-11-30T17:19:56.477452+0000","last_peered":"2023-11-30T17:19:56.477452+0000","last_clean":"2023-11-30T17:19:56.477452+0000","last_became_active":"2023-11-30T17:19:56.094502+0000","last_became_peered":"2023-11-30T17:19:56.094502+0000","last_unstale":"2023-11-30T17:19:56.477452+0000","last_undegraded":"2023-11-30T17:19:56.477452+0000","last_fullsized":"2023-11-30T17:19:56.477452+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493507+0000","last_change":"2023-11-30T17:19:56.490881+0000","last_active":"2023-11-30T17:19:56.493507+0000","last_peered":"2023-11-30T17:19:56.493507+0000","last_clean":"2023-11-30T17:19:56.493507+0000","last_became_active":"2023-11-30T17:19:56.490557+0000","last_became_peered":"2023-11-30T17:19:56.490557+0000","last_unstale":"2023-11-30T17:19:56.493507+0000","last_undegraded":"2023-11-30T17:19:56.493507+0000","last_fullsized":"2023-11-30T17:19:56.493507+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.480824+0000","last_change":"2023-11-30T17:19:56.098722+0000","last_active":"2023-11-30T17:19:56.480824+0000","last_peered":"2023-11-30T17:19:56.480824+0000","last_clean":"2023-11-30T17:19:56.480824+0000","last_became_active":"2023-11-30T17:19:56.098432+0000","last_became_peered":"2023-11-30T17:19:56.098432+0000","last_unstale":"2023-11-30T17:19:56.480824+0000","last_undegraded":"2023-11-30T17:19:56.480824+0000","last_fullsized":"2023-11-30T17:19:56.480824+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.472480+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:19:56.472480+0000","last_peered":"2023-11-30T17:19:56.472480+0000","last_clean":"2023-11-30T17:19:56.472480+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:19:56.472480+0000","last_undegraded":"2023-11-30T17:19:56.472480+0000","last_fullsized":"2023-11-30T17:19:56.472480+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.493542+0000","last_change":"2023-11-30T17:19:56.485917+0000","last_active":"2023-11-30T17:19:56.493542+0000","last_peered":"2023-11-30T17:19:56.493542+0000","last_clean":"2023-11-30T17:19:56.493542+0000","last_became_active":"2023-11-30T17:19:56.485355+0000","last_became_peered":"2023-11-30T17:19:56.485355+0000","last_unstale":"2023-11-30T17:19:56.493542+0000","last_undegraded":"2023-11-30T17:19:56.493542+0000","last_fullsized":"2023-11-30T17:19:56.493542+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"64'2","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.501362+0000","last_change":"2023-11-30T17:19:56.113868+0000","last_active":"2023-11-30T17:19:56.501362+0000","last_peered":"2023-11-30T17:19:56.501362+0000","last_clean":"2023-11-30T17:19:56.501362+0000","last_became_active":"2023-11-30T17:19:56.113613+0000","last_became_peered":"2023-11-30T17:19:56.113613+0000","last_unstale":"2023-11-30T17:19:56.501362+0000","last_undegraded":"2023-11-30T17:19:56.501362+0000","last_fullsized":"2023-11-30T17:19:56.501362+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.479090+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:19:56.479090+0000","last_peered":"2023-11-30T17:19:56.479090+0000","last_clean":"2023-11-30T17:19:56.479090+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:19:56.479090+0000","last_undegraded":"2023-11-30T17:19:56.479090+0000","last_fullsized":"2023-11-30T17:19:56.479090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491937+0000","last_change":"2023-11-30T17:19:56.489558+0000","last_active":"2023-11-30T17:19:56.491937+0000","last_peered":"2023-11-30T17:19:56.491937+0000","last_clean":"2023-11-30T17:19:56.491937+0000","last_became_active":"2023-11-30T17:19:56.489367+0000","last_became_peered":"2023-11-30T17:19:56.489367+0000","last_unstale":"2023-11-30T17:19:56.491937+0000","last_undegraded":"2023-11-30T17:19:56.491937+0000","last_fullsized":"2023-11-30T17:19:56.491937+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.495220+0000","last_change":"2023-11-30T17:19:56.099447+0000","last_active":"2023-11-30T17:19:56.495220+0000","last_peered":"2023-11-30T17:19:56.495220+0000","last_clean":"2023-11-30T17:19:56.495220+0000","last_became_active":"2023-11-30T17:19:56.098752+0000","last_became_peered":"2023-11-30T17:19:56.098752+0000","last_unstale":"2023-11-30T17:19:56.495220+0000","last_undegraded":"2023-11-30T17:19:56.495220+0000","last_fullsized":"2023-11-30T17:19:56.495220+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.476345+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:19:56.476345+0000","last_peered":"2023-11-30T17:19:56.476345+0000","last_clean":"2023-11-30T17:19:56.476345+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:19:56.476345+0000","last_undegraded":"2023-11-30T17:19:56.476345+0000","last_fullsized":"2023-11-30T17:19:56.476345+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.499982+0000","last_change":"2023-11-30T17:19:56.493598+0000","last_active":"2023-11-30T17:19:56.499982+0000","last_peered":"2023-11-30T17:19:56.499982+0000","last_clean":"2023-11-30T17:19:56.499982+0000","last_became_active":"2023-11-30T17:19:56.493247+0000","last_became_peered":"2023-11-30T17:19:56.493247+0000","last_unstale":"2023-11-30T17:19:56.499982+0000","last_undegraded":"2023-11-30T17:19:56.499982+0000","last_fullsized":"2023-11-30T17:19:56.499982+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.496649+0000","last_change":"2023-11-30T17:19:56.106136+0000","last_active":"2023-11-30T17:19:56.496649+0000","last_peered":"2023-11-30T17:19:56.496649+0000","last_clean":"2023-11-30T17:19:56.496649+0000","last_became_active":"2023-11-30T17:19:56.105756+0000","last_became_peered":"2023-11-30T17:19:56.105756+0000","last_unstale":"2023-11-30T17:19:56.496649+0000","last_undegraded":"2023-11-30T17:19:56.496649+0000","last_fullsized":"2023-11-30T17:19:56.496649+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.480220+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:19:56.480220+0000","last_peered":"2023-11-30T17:19:56.480220+0000","last_clean":"2023-11-30T17:19:56.480220+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:19:56.480220+0000","last_undegraded":"2023-11-30T17:19:56.480220+0000","last_fullsized":"2023-11-30T17:19:56.480220+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":51,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.481994+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:19:56.481994+0000","last_peered":"2023-11-30T17:19:56.481994+0000","last_clean":"2023-11-30T17:19:56.481994+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:19:56.481994+0000","last_undegraded":"2023-11-30T17:19:56.481994+0000","last_fullsized":"2023-11-30T17:19:56.481994+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.484755+0000","last_change":"2023-11-30T17:19:56.482476+0000","last_active":"2023-11-30T17:19:56.484755+0000","last_peered":"2023-11-30T17:19:56.484755+0000","last_clean":"2023-11-30T17:19:56.484755+0000","last_became_active":"2023-11-30T17:19:56.482179+0000","last_became_peered":"2023-11-30T17:19:56.482179+0000","last_unstale":"2023-11-30T17:19:56.484755+0000","last_undegraded":"2023-11-30T17:19:56.484755+0000","last_fullsized":"2023-11-30T17:19:56.484755+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.485102+0000","last_change":"2023-11-30T17:19:56.097211+0000","last_active":"2023-11-30T17:19:56.485102+0000","last_peered":"2023-11-30T17:19:56.485102+0000","last_clean":"2023-11-30T17:19:56.485102+0000","last_became_active":"2023-11-30T17:19:56.096945+0000","last_became_peered":"2023-11-30T17:19:56.096945+0000","last_unstale":"2023-11-30T17:19:56.485102+0000","last_undegraded":"2023-11-30T17:19:56.485102+0000","last_fullsized":"2023-11-30T17:19:56.485102+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.482083+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:19:56.482083+0000","last_peered":"2023-11-30T17:19:56.482083+0000","last_clean":"2023-11-30T17:19:56.482083+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:19:56.482083+0000","last_undegraded":"2023-11-30T17:19:56.482083+0000","last_fullsized":"2023-11-30T17:19:56.482083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.491458+0000","last_change":"2023-11-30T17:19:56.489737+0000","last_active":"2023-11-30T17:19:56.491458+0000","last_peered":"2023-11-30T17:19:56.491458+0000","last_clean":"2023-11-30T17:19:56.491458+0000","last_became_active":"2023-11-30T17:19:56.487977+0000","last_became_peered":"2023-11-30T17:19:56.487977+0000","last_unstale":"2023-11-30T17:19:56.491458+0000","last_undegraded":"2023-11-30T17:19:56.491458+0000","last_fullsized":"2023-11-30T17:19:56.491458+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.479316+0000","last_change":"2023-11-30T17:19:56.104936+0000","last_active":"2023-11-30T17:19:56.479316+0000","last_peered":"2023-11-30T17:19:56.479316+0000","last_clean":"2023-11-30T17:19:56.479316+0000","last_became_active":"2023-11-30T17:19:56.104707+0000","last_became_peered":"2023-11-30T17:19:56.104707+0000","last_unstale":"2023-11-30T17:19:56.479316+0000","last_undegraded":"2023-11-30T17:19:56.479316+0000","last_fullsized":"2023-11-30T17:19:56.479316+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.485161+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:19:56.485161+0000","last_peered":"2023-11-30T17:19:56.485161+0000","last_clean":"2023-11-30T17:19:56.485161+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:19:56.485161+0000","last_undegraded":"2023-11-30T17:19:56.485161+0000","last_fullsized":"2023-11-30T17:19:56.485161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.487502+0000","last_change":"2023-11-30T17:19:56.486862+0000","last_active":"2023-11-30T17:19:56.487502+0000","last_peered":"2023-11-30T17:19:56.487502+0000","last_clean":"2023-11-30T17:19:56.487502+0000","last_became_active":"2023-11-30T17:19:56.486600+0000","last_became_peered":"2023-11-30T17:19:56.486600+0000","last_unstale":"2023-11-30T17:19:56.487502+0000","last_undegraded":"2023-11-30T17:19:56.487502+0000","last_fullsized":"2023-11-30T17:19:56.487502+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.478581+0000","last_change":"2023-11-30T17:19:56.108142+0000","last_active":"2023-11-30T17:19:56.478581+0000","last_peered":"2023-11-30T17:19:56.478581+0000","last_clean":"2023-11-30T17:19:56.478581+0000","last_became_active":"2023-11-30T17:19:56.107685+0000","last_became_peered":"2023-11-30T17:19:56.107685+0000","last_unstale":"2023-11-30T17:19:56.478581+0000","last_undegraded":"2023-11-30T17:19:56.478581+0000","last_fullsized":"2023-11-30T17:19:56.478581+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.472945+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:19:56.472945+0000","last_peered":"2023-11-30T17:19:56.472945+0000","last_clean":"2023-11-30T17:19:56.472945+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:19:56.472945+0000","last_undegraded":"2023-11-30T17:19:56.472945+0000","last_fullsized":"2023-11-30T17:19:56.472945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.494336+0000","last_change":"2023-11-30T17:19:56.489210+0000","last_active":"2023-11-30T17:19:56.494336+0000","last_peered":"2023-11-30T17:19:56.494336+0000","last_clean":"2023-11-30T17:19:56.494336+0000","last_became_active":"2023-11-30T17:19:56.488914+0000","last_became_peered":"2023-11-30T17:19:56.488914+0000","last_unstale":"2023-11-30T17:19:56.494336+0000","last_undegraded":"2023-11-30T17:19:56.494336+0000","last_fullsized":"2023-11-30T17:19:56.494336+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:56.073560+0000","last_clean_scrub_stamp":"2023-11-30T17:19:56.073560+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.477075+0000","last_change":"2023-11-30T17:19:56.102213+0000","last_active":"2023-11-30T17:19:56.477075+0000","last_peered":"2023-11-30T17:19:56.477075+0000","last_clean":"2023-11-30T17:19:56.477075+0000","last_became_active":"2023-11-30T17:19:56.101927+0000","last_became_peered":"2023-11-30T17:19:56.101927+0000","last_unstale":"2023-11-30T17:19:56.477075+0000","last_undegraded":"2023-11-30T17:19:56.477075+0000","last_fullsized":"2023-11-30T17:19:56.477075+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:19:55.068004+0000","last_clean_scrub_stamp":"2023-11-30T17:19:55.068004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-30T17:19:56.486724+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:19:56.486724+0000","last_peered":"2023-11-30T17:19:56.486724+0000","last_clean":"2023-11-30T17:19:56.486724+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:19:56.486724+0000","last_undegraded":"2023-11-30T17:19:56.486724+0000","last_fullsized":"2023-11-30T17:19:56.486724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575004,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297864,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":786432,"data_stored":380863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58699999999999997,"15min":0.55800000000000005},"min":{"1min":0.374,"5min":0.317,"15min":0.23899999999999999},"max":{"1min":0.73099999999999998,"5min":0.78700000000000003,"15min":0.81100000000000005},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58599999999999997,"15min":0.56599999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.32200000000000001},"max":{"1min":0.76400000000000001,"5min":0.76700000000000002,"15min":0.81899999999999995},"last":0.56100000000000005}]},{"osd":1,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55200000000000005,"15min":0.53000000000000003},"min":{"1min":0.39400000000000002,"5min":0.34599999999999997,"15min":0.33600000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.79400000000000004},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.28799999999999998},"max":{"1min":0.63400000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.46700000000000003}]},{"osd":2,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.32800000000000001},"max":{"1min":0.67600000000000005,"5min":0.77200000000000002,"15min":0.78300000000000003},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.28699999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.83899999999999997},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54400000000000004,"15min":0.53700000000000003},"min":{"1min":0.375,"5min":0.36899999999999999,"15min":0.33200000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.78000000000000003},"last":0.623},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.33900000000000002},"max":{"1min":0.72999999999999998,"5min":0.80500000000000005,"15min":0.81200000000000006},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.44800000000000001,"15min":0.47099999999999997},"min":{"1min":0.313,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.61899999999999999,"5min":0.77500000000000002,"15min":0.79900000000000004},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.442,"5min":0.46899999999999997,"15min":0.5},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.66600000000000004,"5min":0.69999999999999996,"15min":1.3180000000000001},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47499999999999998,"15min":0.501},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68100000000000005,"5min":0.71499999999999997,"15min":0.82899999999999996},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.51000000000000001,"15min":0.53300000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69099999999999995,"5min":0.76000000000000001,"15min":0.872},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53300000000000003,"15min":0.55700000000000005},"min":{"1min":0.376,"5min":0.372,"15min":0.36099999999999999},"max":{"1min":0.71599999999999997,"5min":0.745,"15min":0.85199999999999998},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.55600000000000005},"min":{"1min":0.35399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72099999999999997,"5min":0.78100000000000003,"15min":0.81499999999999995},"last":0.69799999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575003,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301952,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069888,"statfs":{"total":96636764160,"available":96327565312,"internally_reserved":0,"allocated":778240,"data_stored":380255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.75,"5min":0.80000000000000004,"15min":0.82699999999999996},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59499999999999997,"15min":0.57799999999999996},"min":{"1min":0.33500000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.78500000000000003,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.58999999999999997}]},{"osd":1,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57899999999999996,"15min":0.55600000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.26400000000000001},"max":{"1min":0.76900000000000002,"5min":0.77500000000000002,"15min":0.82799999999999996},"last":0.442},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.60199999999999998,"15min":0.58499999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.82499999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.58499999999999996,"15min":0.56200000000000006},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.82599999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58499999999999996,"15min":0.57099999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80800000000000005,"5min":0.80900000000000005,"15min":0.82499999999999996},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.70299999999999996,"5min":0.755,"15min":0.755},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54100000000000004,"15min":0.52900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32200000000000001},"max":{"1min":0.72799999999999998,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.38800000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.44700000000000001,"15min":0.45700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28999999999999998},"max":{"1min":0.61699999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.623,"5min":0.78800000000000003,"15min":0.83899999999999997},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46899999999999997,"15min":0.46999999999999997},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.28299999999999997},"max":{"1min":0.61099999999999999,"5min":0.69399999999999995,"15min":0.74299999999999999},"last":0.502},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.5,"15min":0.50900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.31900000000000001},"max":{"1min":0.68799999999999994,"5min":0.745,"15min":0.78500000000000003},"last":0.46400000000000002}]},{"osd":7,"last update":"Thu Nov 30 17:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52200000000000002,"15min":0.53600000000000003},"min":{"1min":0.375,"5min":0.34699999999999998,"15min":0.34000000000000002},"max":{"1min":0.69499999999999995,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.622},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56100000000000005,"15min":0.56399999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":0.70299999999999996,"5min":0.83499999999999996,"15min":0.86499999999999999},"last":0.47099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575003,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301952,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069888,"statfs":{"total":96636764160,"available":96327565312,"internally_reserved":0,"allocated":778240,"data_stored":380275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35799999999999998,"15min":0.34100000000000003},"min":{"1min":0.23899999999999999,"5min":0.23599999999999999,"15min":0.23000000000000001},"max":{"1min":0.52900000000000003,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.46899999999999997,"15min":0.44900000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.309},"max":{"1min":0.57999999999999996,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.38900000000000001,"15min":0.36799999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.222},"max":{"1min":0.57099999999999995,"5min":0.628,"15min":0.67300000000000004},"last":0.313},{"interface":"front","average":{"1min":0.499,"5min":0.51000000000000001,"15min":0.47299999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.29499999999999998},"max":{"1min":0.63400000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.33400000000000002}]},{"osd":3,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45800000000000002,"15min":0.43099999999999999},"min":{"1min":0.32900000000000001,"5min":0.32000000000000001,"15min":0.23899999999999999},"max":{"1min":0.60999999999999999,"5min":0.749,"15min":0.749},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.442,"15min":0.41599999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.28599999999999998},"max":{"1min":0.65100000000000002,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.35299999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58999999999999997,"15min":0.57599999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.89100000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.39900000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.111},"last":0.42499999999999999}]},{"osd":5,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59899999999999998,"15min":0.58799999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.377},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60599999999999998,"15min":0.59899999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77500000000000002,"5min":0.88200000000000001,"15min":0.91300000000000003},"last":0.36899999999999999}]},{"osd":6,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.44600000000000001,"5min":0.433,"15min":0.39600000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":1.0600000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.65400000000000003,"15min":0.64900000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.379},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.0780000000000001},"last":0.45500000000000002}]},{"osd":7,"last update":"Thu Nov 30 17:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.67400000000000004,"15min":0.65300000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.41699999999999998},"max":{"1min":0.91500000000000004,"5min":0.92300000000000004,"15min":0.98699999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.65000000000000002,"15min":0.63900000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.39900000000000002},"max":{"1min":0.85199999999999998,"5min":0.879,"15min":0.94199999999999995},"last":0.442}]}]},{"osd":0,"up_from":13,"seq":55834575003,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301960,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069880,"statfs":{"total":96636764160,"available":96327557120,"internally_reserved":0,"allocated":786432,"data_stored":380311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.37,"15min":0.35199999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.22700000000000001},"max":{"1min":0.54700000000000004,"5min":0.59999999999999998,"15min":0.71199999999999997},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.39500000000000002,"15min":0.372},"min":{"1min":0.27300000000000002,"5min":0.24099999999999999,"15min":0.22600000000000001},"max":{"1min":0.53100000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.216}]},{"osd":2,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39500000000000002,"15min":0.373},"min":{"1min":0.28999999999999998,"5min":0.247,"15min":0.23899999999999999},"max":{"1min":0.58899999999999997,"5min":0.623,"15min":0.623},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47099999999999997,"15min":0.44600000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.31900000000000001},"max":{"1min":0.60999999999999999,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.30099999999999999}]},{"osd":3,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.439,"15min":0.41999999999999998},"min":{"1min":0.32600000000000001,"5min":0.29499999999999998,"15min":0.252},"max":{"1min":0.629,"5min":0.66100000000000003,"15min":0.70999999999999996},"last":0.249},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45200000000000001,"15min":0.42499999999999999},"min":{"1min":0.33600000000000002,"5min":0.317,"15min":0.26700000000000002},"max":{"1min":0.64700000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.28299999999999997}]},{"osd":4,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61899999999999999,"15min":0.59199999999999997},"min":{"1min":0.46500000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82599999999999996,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63300000000000001,"15min":0.60699999999999998},"min":{"1min":0.435,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79100000000000004,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.58599999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.36199999999999999},"max":{"1min":0.81000000000000005,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.501},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64700000000000002,"15min":0.61599999999999999},"min":{"1min":0.51500000000000001,"5min":0.442,"15min":0.38},"max":{"1min":0.88,"5min":1.004,"15min":1.004},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.65600000000000003,"15min":0.63},"min":{"1min":0.47199999999999998,"5min":0.435,"15min":0.39200000000000002},"max":{"1min":0.86699999999999999,"5min":1.002,"15min":1.002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64900000000000002,"15min":0.622},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.42999999999999999},"max":{"1min":0.81699999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.47599999999999998}]},{"osd":7,"last update":"Thu Nov 30 17:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.66700000000000004,"15min":0.63900000000000001},"min":{"1min":0.49199999999999999,"5min":0.48799999999999999,"15min":0.44800000000000001},"max":{"1min":0.92700000000000005,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69799999999999995,"15min":0.67300000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.44700000000000001},"max":{"1min":0.90500000000000003,"5min":1.026,"15min":1.026},"last":0.56399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575003,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306056,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065784,"statfs":{"total":96636764160,"available":96323362816,"internally_reserved":0,"allocated":786432,"data_stored":381721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.41399999999999998,"15min":0.38},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.44,"5min":0.44700000000000001,"15min":0.42099999999999999},"min":{"1min":0.28000000000000003,"5min":0.26400000000000001,"15min":0.255},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46200000000000002,"15min":0.433},"min":{"1min":0.254,"5min":0.254,"15min":0.24299999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49299999999999999,"15min":0.45500000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.373}]},{"osd":3,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.42599999999999999,"15min":0.39300000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63500000000000001,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48999999999999999,"15min":0.45100000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.26200000000000001},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.31900000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64400000000000002,"15min":0.59899999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63900000000000001,"15min":0.59699999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66300000000000003,"15min":0.621},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66400000000000003,"15min":0.61699999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38100000000000001},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.66000000000000003,"15min":0.61399999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68999999999999995,"15min":0.65000000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Nov 30 17:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.69999999999999996,"15min":0.66100000000000003},"min":{"1min":0.48899999999999999,"5min":0.45200000000000001,"15min":0.40300000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.71299999999999997,"15min":0.66800000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.41499999999999998},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.69399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575003,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306056,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065784,"statfs":{"total":96636764160,"available":96323362816,"internally_reserved":0,"allocated":786432,"data_stored":380851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.379,"15min":0.35699999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.217},"max":{"1min":0.56599999999999995,"5min":0.58799999999999997,"15min":0.66200000000000003},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.41299999999999998,"15min":0.38800000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.246},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39600000000000002,"15min":0.378},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.255},"max":{"1min":0.59499999999999997,"5min":0.63300000000000001,"15min":0.64300000000000002},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.44,"15min":0.42499999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.25900000000000001},"max":{"1min":0.51500000000000001,"5min":0.69099999999999995,"15min":0.84399999999999997},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46500000000000002,"15min":0.438},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.26000000000000001},"max":{"1min":0.72999999999999998,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.52900000000000003,"15min":0.48899999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.33400000000000002},"max":{"1min":0.68999999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61599999999999999,"15min":0.59499999999999997},"min":{"1min":0.42799999999999999,"5min":0.42599999999999999,"15min":0.35099999999999998},"max":{"1min":0.91500000000000004,"5min":0.91600000000000004,"15min":0.97599999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.624,"15min":0.61099999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.34799999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.91400000000000003},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61699999999999999,"15min":0.60599999999999998},"min":{"1min":0.41699999999999998,"5min":0.40000000000000002,"15min":0.378},"max":{"1min":0.85399999999999998,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.504},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.64600000000000002,"15min":0.629},"min":{"1min":0.46700000000000003,"5min":0.45100000000000001,"15min":0.36399999999999999},"max":{"1min":0.80500000000000005,"5min":0.88900000000000001,"15min":1.008},"last":0.623}]},{"osd":6,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.39000000000000001},"max":{"1min":0.84599999999999997,"5min":0.94999999999999996,"15min":1.0389999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.65800000000000003,"15min":0.64400000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.41399999999999998},"max":{"1min":0.89500000000000002,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.63800000000000001}]},{"osd":7,"last update":"Thu Nov 30 17:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67500000000000004,"15min":0.66500000000000004},"min":{"1min":0.51300000000000001,"5min":0.44700000000000001,"15min":0.39100000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.67000000000000004,"15min":0.65100000000000002},"min":{"1min":0.46200000000000002,"5min":0.432,"15min":0.41899999999999998},"max":{"1min":0.89200000000000002,"5min":0.93700000000000006,"15min":1.004},"last":0.65000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575003,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301952,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069888,"statfs":{"total":96636764160,"available":96327565312,"internally_reserved":0,"allocated":778240,"data_stored":380739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52700000000000002,"15min":0.52300000000000002},"min":{"1min":0.39400000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71699999999999997,"5min":0.77700000000000002,"15min":0.80900000000000005},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.379,"5min":0.32200000000000001,"15min":0.317},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.46500000000000002}]},{"osd":1,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.55100000000000005,"15min":0.53400000000000003},"min":{"1min":0.36899999999999999,"5min":0.314,"15min":0.25800000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.79600000000000004},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54400000000000004,"15min":0.54100000000000004},"min":{"1min":0.44700000000000001,"5min":0.36699999999999999,"15min":0.246},"max":{"1min":0.71299999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58199999999999996,"15min":0.56100000000000005},"min":{"1min":0.46500000000000002,"5min":0.38400000000000001,"15min":0.27800000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.58999999999999997},"min":{"1min":0.436,"5min":0.41299999999999998,"15min":0.36899999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55400000000000005,"15min":0.54300000000000004},"min":{"1min":0.41499999999999998,"5min":0.40600000000000003,"15min":0.32900000000000001},"max":{"1min":0.76400000000000001,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.434},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.45000000000000001,"5min":0.372,"15min":0.35799999999999998},"max":{"1min":0.69699999999999995,"5min":0.78900000000000003,"15min":0.80600000000000005},"last":0.5}]},{"osd":5,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.43099999999999999,"15min":0.45600000000000002},"min":{"1min":0.33000000000000002,"5min":0.30099999999999999,"15min":0.27400000000000002},"max":{"1min":0.54900000000000004,"5min":0.72499999999999998,"15min":0.83299999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.44400000000000001,"15min":0.47199999999999998},"min":{"1min":0.374,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59999999999999998,"5min":0.66400000000000003,"15min":0.85099999999999998},"last":0.48699999999999999}]},{"osd":6,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.49399999999999999,"15min":0.51200000000000001},"min":{"1min":0.371,"5min":0.33100000000000002,"15min":0.314},"max":{"1min":0.64200000000000002,"5min":0.754,"15min":0.98799999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53200000000000003,"15min":0.54400000000000004},"min":{"1min":0.45100000000000001,"5min":0.39900000000000002,"15min":0.33800000000000002},"max":{"1min":0.65700000000000003,"5min":0.74099999999999999,"15min":0.95999999999999996},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Nov 30 17:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.35999999999999999,"5min":0.318,"15min":0.29899999999999999},"max":{"1min":0.68799999999999994,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56599999999999995,"15min":0.57799999999999996},"min":{"1min":0.50700000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.69699999999999995,"5min":0.79500000000000004,"15min":0.85399999999999998},"last":0.57999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575003,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301952,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069888,"statfs":{"total":96636764160,"available":96327565312,"internally_reserved":0,"allocated":778240,"data_stored":381077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.35799999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.627,"5min":0.73399999999999999,"15min":0.76500000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.67000000000000004,"5min":0.76200000000000001,"15min":0.81799999999999995},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.52600000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.318},"max":{"1min":0.59999999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.56100000000000005,"15min":0.53900000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.36199999999999999},"max":{"1min":0.65800000000000003,"5min":0.754,"15min":0.77000000000000002},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60399999999999998,"15min":0.58399999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.30599999999999999},"max":{"1min":0.74099999999999999,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.60599999999999998,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.34499999999999997},"max":{"1min":0.69099999999999995,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55600000000000005,"15min":0.54100000000000004},"min":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64600000000000002,"5min":0.72399999999999998,"15min":0.73799999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57299999999999995,"15min":0.56799999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.71299999999999997,"5min":0.79200000000000004,"15min":0.82099999999999995},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.42899999999999999,"15min":0.44600000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.53900000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.46100000000000002,"15min":0.47099999999999997},"min":{"1min":0.34499999999999997,"5min":0.33000000000000002,"15min":0.32100000000000001},"max":{"1min":0.55600000000000005,"5min":0.66700000000000004,"15min":0.77600000000000002},"last":0.40200000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.48199999999999998,"15min":0.48899999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28499999999999998},"max":{"1min":0.63100000000000001,"5min":0.73999999999999999,"15min":0.82099999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54600000000000004,"15min":0.55600000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.33400000000000002},"max":{"1min":0.67300000000000004,"5min":0.81399999999999995,"15min":0.88200000000000001},"last":0.54400000000000004}]},{"osd":7,"last update":"Thu Nov 30 17:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.52700000000000002,"15min":0.53100000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68200000000000005,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57499999999999996,"15min":0.58099999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73099999999999998,"5min":0.79300000000000004,"15min":0.84599999999999997},"last":0.439}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:20:05.318 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-30T17:20:05.319 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-30T17:20:05.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.474+0000 7fa20063b700 1 Processor -- start 2023-11-30T17:20:05.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.474+0000 7fa20063b700 1 -- start start 2023-11-30T17:20:05.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.475+0000 7fa20063b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1f8098d10 0x7fa1f80c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:05.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.475+0000 7fa20063b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa1f80c6190 0x7fa1f8063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:05.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.475+0000 7fa20063b700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f80c72d0 con 0x7fa1f8064350 2023-11-30T17:20:05.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.475+0000 7fa20063b700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f8154bc0 con 0x7fa1f80c6190 2023-11-30T17:20:05.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.475+0000 7fa20063b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f80c66c0 con 0x7fa1f8098d10 2023-11-30T17:20:05.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.475+0000 7fa1fdbd6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa1f80c6190 0x7fa1f8063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:05.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.475+0000 7fa1fdbd6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa1f80c6190 0x7fa1f8063e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35068/0 (socket says 172.21.15.49:35068) 2023-11-30T17:20:05.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.475+0000 7fa1febd8700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa1f8064350 0x7fa1f8158320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34830/0 (socket says 172.21.15.49:34830) 2023-11-30T17:20:05.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.475+0000 7fa1fdbd6700 1 -- 172.21.15.49:0/4170868911 learned_addr learned my addr 172.21.15.49:0/4170868911 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:20:05.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.476+0000 7fa1fe3d7700 1 --2- 172.21.15.49:0/4170868911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1f8098d10 0x7fa1f80c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:05.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.476+0000 7fa1fdbd6700 1 -- 172.21.15.49:0/4170868911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1f8098d10 msgr2=0x7fa1f80c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:05.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.476+0000 7fa1fdbd6700 1 --2- 172.21.15.49:0/4170868911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1f8098d10 0x7fa1f80c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:05.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.476+0000 7fa1fdbd6700 1 -- 172.21.15.49:0/4170868911 >> v1:172.21.15.49:6789/0 conn(0x7fa1f8064350 legacy=0x7fa1f8158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:05.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.476+0000 7fa1fd3d5700 1 -- 172.21.15.49:0/4170868911 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 509194028 0 0) 0x7fa1f80c72d0 con 0x7fa1f8064350 2023-11-30T17:20:05.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.476+0000 7fa1fdbd6700 1 -- 172.21.15.49:0/4170868911 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f80c69a0 con 0x7fa1f80c6190 2023-11-30T17:20:05.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.476+0000 7fa1fe3d7700 1 --2- 172.21.15.49:0/4170868911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1f8098d10 0x7fa1f80c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:20:05.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.476+0000 7fa1fdbd6700 1 --2- 172.21.15.49:0/4170868911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1f80c6190 0x7fa1f8063e60 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fa1ec006fd0 tx=0x7fa1ec0090f0).ready entity=mon.0 client_cookie=7dc46d3fdeb11dc0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:05.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.476+0000 7fa1fd3d5700 1 -- 172.21.15.49:0/4170868911 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec00b600 con 0x7fa1f80c6190 2023-11-30T17:20:05.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.476+0000 7fa1fd3d5700 1 -- 172.21.15.49:0/4170868911 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ec00b760 con 0x7fa1f80c6190 2023-11-30T17:20:05.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.476+0000 7fa1fd3d5700 1 -- 172.21.15.49:0/4170868911 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec00bae0 con 0x7fa1f80c6190 2023-11-30T17:20:05.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.476+0000 7fa20063b700 1 -- 172.21.15.49:0/4170868911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1f80c6190 msgr2=0x7fa1f8063e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:05.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.476+0000 7fa20063b700 1 --2- 172.21.15.49:0/4170868911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1f80c6190 0x7fa1f8063e60 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fa1ec006fd0 tx=0x7fa1ec0090f0).stop 2023-11-30T17:20:05.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.477+0000 7fa20063b700 1 -- 172.21.15.49:0/4170868911 shutdown_connections 2023-11-30T17:20:05.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.477+0000 7fa20063b700 1 --2- 172.21.15.49:0/4170868911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1f8098d10 0x7fa1f80c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:05.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.477+0000 7fa20063b700 1 --2- 172.21.15.49:0/4170868911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1f80c6190 0x7fa1f8063e60 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:05.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.477+0000 7fa20063b700 1 -- 172.21.15.49:0/4170868911 >> 172.21.15.49:0/4170868911 conn(0x7fa1f80cb310 msgr2=0x7fa1f80cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:05.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.477+0000 7fa20063b700 1 -- 172.21.15.49:0/4170868911 shutdown_connections 2023-11-30T17:20:05.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.477+0000 7fa20063b700 1 -- 172.21.15.49:0/4170868911 wait complete. 2023-11-30T17:20:05.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.478+0000 7fa20063b700 1 Processor -- start 2023-11-30T17:20:05.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.478+0000 7fa20063b700 1 -- start start 2023-11-30T17:20:05.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.479+0000 7fa20063b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1f8064350 0x7fa1f80c4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:05.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.479+0000 7fa20063b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1f8098d10 0x7fa1f80c2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:05.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.479+0000 7fa20063b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1f80c6190 0x7fa1f80c2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:05.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.479+0000 7fa20063b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f80c3100 con 0x7fa1f8098d10 2023-11-30T17:20:05.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.479+0000 7fa20063b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f8168c80 con 0x7fa1f8064350 2023-11-30T17:20:05.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.479+0000 7fa20063b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f8168100 con 0x7fa1f80c6190 2023-11-30T17:20:05.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.479+0000 7fa1fdbd6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1f8098d10 0x7fa1f80c2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:05.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.479+0000 7fa1fdbd6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1f8098d10 0x7fa1f80c2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35072/0 (socket says 172.21.15.49:35072) 2023-11-30T17:20:05.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.479+0000 7fa1fdbd6700 1 -- 172.21.15.49:0/134403274 learned_addr learned my addr 172.21.15.49:0/134403274 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:20:05.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.479+0000 7fa1fe3d7700 1 --2- 172.21.15.49:0/134403274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1f8064350 0x7fa1f80c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:05.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.479+0000 7fa1febd8700 1 --2- 172.21.15.49:0/134403274 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1f80c6190 0x7fa1f80c2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:05.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.479+0000 7fa1fdbd6700 1 -- 172.21.15.49:0/134403274 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1f80c6190 msgr2=0x7fa1f80c2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:05.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.479+0000 7fa1fdbd6700 1 --2- 172.21.15.49:0/134403274 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1f80c6190 0x7fa1f80c2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:05.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.479+0000 7fa1fdbd6700 1 -- 172.21.15.49:0/134403274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1f8064350 msgr2=0x7fa1f80c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:05.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.479+0000 7fa1fdbd6700 1 --2- 172.21.15.49:0/134403274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1f8064350 0x7fa1f80c4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:05.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.479+0000 7fa1fdbd6700 1 -- 172.21.15.49:0/134403274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ec009370 con 0x7fa1f8098d10 2023-11-30T17:20:05.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.479+0000 7fa1fdbd6700 1 --2- 172.21.15.49:0/134403274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1f8098d10 0x7fa1f80c2720 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7fa1f80c2360 tx=0x7fa1ec017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:05.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.479+0000 7fa1f67fc700 1 -- 172.21.15.49:0/134403274 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec00b8d0 con 0x7fa1f8098d10 2023-11-30T17:20:05.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.479+0000 7fa1f67fc700 1 -- 172.21.15.49:0/134403274 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ec00ba30 con 0x7fa1f8098d10 2023-11-30T17:20:05.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.479+0000 7fa1f67fc700 1 -- 172.21.15.49:0/134403274 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec01b660 con 0x7fa1f8098d10 2023-11-30T17:20:05.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.479+0000 7fa20063b700 1 -- 172.21.15.49:0/134403274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f81683e0 con 0x7fa1f8098d10 2023-11-30T17:20:05.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.480+0000 7fa20063b700 1 -- 172.21.15.49:0/134403274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f81689a0 con 0x7fa1f8098d10 2023-11-30T17:20:05.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.481+0000 7fa20063b700 1 -- 172.21.15.49:0/134403274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f806c860 con 0x7fa1f8098d10 2023-11-30T17:20:05.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.481+0000 7fa1f67fc700 1 -- 172.21.15.49:0/134403274 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa1ec01b9d0 con 0x7fa1f8098d10 2023-11-30T17:20:05.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.481+0000 7fa1f67fc700 1 --2- 172.21.15.49:0/134403274 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa1e405f270 0x7fa1e4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:05.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.481+0000 7fa1f67fc700 1 -- 172.21.15.49:0/134403274 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa1ec07bd50 con 0x7fa1f8098d10 2023-11-30T17:20:05.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.482+0000 7fa1fe3d7700 1 --2- 172.21.15.49:0/134403274 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa1e405f270 0x7fa1e4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:05.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.482+0000 7fa1fe3d7700 1 --2- 172.21.15.49:0/134403274 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa1e405f270 0x7fa1e4061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fa1f000abd0 tx=0x7fa1f0008040).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:05.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.486+0000 7fa1f67fc700 1 -- 172.21.15.49:0/134403274 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa1ec04cea0 con 0x7fa1f8098d10 2023-11-30T17:20:05.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.723+0000 7fa20063b700 1 -- 172.21.15.49:0/134403274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa1f80c6c80 con 0x7fa1f8098d10 2023-11-30T17:20:05.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.727+0000 7fa1f67fc700 1 -- 172.21.15.49:0/134403274 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7fa1ec01f070 con 0x7fa1f8098d10 2023-11-30T17:20:05.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.729+0000 7fa20063b700 1 -- 172.21.15.49:0/134403274 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa1e405f270 msgr2=0x7fa1e4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:05.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.729+0000 7fa20063b700 1 --2- 172.21.15.49:0/134403274 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa1e405f270 0x7fa1e4061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fa1f000abd0 tx=0x7fa1f0008040).stop 2023-11-30T17:20:05.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.729+0000 7fa20063b700 1 -- 172.21.15.49:0/134403274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1f8098d10 msgr2=0x7fa1f80c2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:05.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.729+0000 7fa20063b700 1 --2- 172.21.15.49:0/134403274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1f8098d10 0x7fa1f80c2720 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7fa1f80c2360 tx=0x7fa1ec017000).stop 2023-11-30T17:20:05.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.729+0000 7fa20063b700 1 -- 172.21.15.49:0/134403274 shutdown_connections 2023-11-30T17:20:05.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.729+0000 7fa20063b700 1 --2- 172.21.15.49:0/134403274 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1f80c6190 0x7fa1f80c2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:05.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.729+0000 7fa20063b700 1 --2- 172.21.15.49:0/134403274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1f8064350 0x7fa1f80c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:05.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.729+0000 7fa20063b700 1 --2- 172.21.15.49:0/134403274 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa1e405f270 0x7fa1e4061730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:05.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.729+0000 7fa20063b700 1 --2- 172.21.15.49:0/134403274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1f8098d10 0x7fa1f80c2720 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:05.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.729+0000 7fa20063b700 1 -- 172.21.15.49:0/134403274 >> 172.21.15.49:0/134403274 conn(0x7fa1f80cb310 msgr2=0x7fa1f8063990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:05.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.729+0000 7fa20063b700 1 -- 172.21.15.49:0/134403274 shutdown_connections 2023-11-30T17:20:05.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.729+0000 7fa20063b700 1 -- 172.21.15.49:0/134403274 wait complete. 2023-11-30T17:20:05.732 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2023-11-30T17:20:05.743 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:20:05.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.858+0000 7efcd3dc4700 1 Processor -- start 2023-11-30T17:20:05.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.858+0000 7efcd3dc4700 1 -- start start 2023-11-30T17:20:05.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.859+0000 7efcd3dc4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efccc0cae90 0x7efccc0c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:05.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.859+0000 7efcd3dc4700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efccc0a9a90 con 0x7efccc0caab0 2023-11-30T17:20:05.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.859+0000 7efcd3dc4700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efccc154ce0 con 0x7efccc0ca180 2023-11-30T17:20:05.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.859+0000 7efcd3dc4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efccc0aab80 con 0x7efccc0cae90 2023-11-30T17:20:05.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.859+0000 7efcd1b60700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7efccc0caab0 0x7efccc0aa470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34842/0 (socket says 172.21.15.49:34842) 2023-11-30T17:20:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.859+0000 7efcd1b60700 1 -- 172.21.15.49:0/2112855165 learned_addr learned my addr 172.21.15.49:0/2112855165 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:20:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.859+0000 7efcd135f700 1 --2- 172.21.15.49:0/2112855165 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efccc0cae90 0x7efccc0c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.860+0000 7efcd0b5e700 1 -- 172.21.15.49:0/2112855165 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3568438359 0 0) 0x7efccc0a9a90 con 0x7efccc0caab0 2023-11-30T17:20:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.860+0000 7efcd0b5e700 1 -- 172.21.15.49:0/2112855165 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcb40033f0 con 0x7efccc0caab0 2023-11-30T17:20:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.860+0000 7efcd0b5e700 1 -- 172.21.15.49:0/2112855165 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 359662916 0 0) 0x7efccc154ce0 con 0x7efccc0ca180 2023-11-30T17:20:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.860+0000 7efcd0b5e700 1 -- 172.21.15.49:0/2112855165 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efccc0a9a90 con 0x7efccc0ca180 2023-11-30T17:20:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.860+0000 7efcd0b5e700 1 -- 172.21.15.49:0/2112855165 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1867163824 0 0) 0x7efcb40033f0 con 0x7efccc0caab0 2023-11-30T17:20:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.860+0000 7efcd0b5e700 1 -- 172.21.15.49:0/2112855165 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efccc0cae90 msgr2=0x7efccc0c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.860+0000 7efcd0b5e700 1 --2- 172.21.15.49:0/2112855165 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efccc0cae90 0x7efccc0c0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.860+0000 7efcd0b5e700 1 -- 172.21.15.49:0/2112855165 >> v1:172.21.15.115:6789/0 conn(0x7efccc0ca180 legacy=0x7efccc15e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.860+0000 7efcd0b5e700 1 -- 172.21.15.49:0/2112855165 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efccc0a8e80 con 0x7efccc0caab0 2023-11-30T17:20:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.860+0000 7efcd0b5e700 1 -- 172.21.15.49:0/2112855165 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7efcc4001970 con 0x7efccc0caab0 2023-11-30T17:20:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.860+0000 7efcd0b5e700 1 -- 172.21.15.49:0/2112855165 >> v1:172.21.15.49:6789/0 conn(0x7efccc0caab0 legacy=0x7efccc0aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.860+0000 7efcd0b5e700 1 --2- 172.21.15.49:0/2112855165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcb4003aa0 0x7efcb4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.860+0000 7efcd0b5e700 1 --2- 172.21.15.49:0/2112855165 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efccc0cae90 0x7efcb4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.860+0000 7efcd0b5e700 1 --2- 172.21.15.49:0/2112855165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcb4004b80 0x7efcb4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.860+0000 7efcd0b5e700 1 -- 172.21.15.49:0/2112855165 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efccc0aab80 con 0x7efcb4004b80 2023-11-30T17:20:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.860+0000 7efcd0b5e700 1 -- 172.21.15.49:0/2112855165 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb400b990 con 0x7efcb4003aa0 2023-11-30T17:20:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.860+0000 7efcd0b5e700 1 -- 172.21.15.49:0/2112855165 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb400bb00 con 0x7efccc0cae90 2023-11-30T17:20:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.860+0000 7efcd2361700 1 --2- 172.21.15.49:0/2112855165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcb4004b80 0x7efcb4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.860+0000 7efcd1b60700 1 --2- 172.21.15.49:0/2112855165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcb4003aa0 0x7efcb4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.860+0000 7efcd135f700 1 --2- 172.21.15.49:0/2112855165 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efccc0cae90 0x7efcb4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.860+0000 7efcd2361700 1 -- 172.21.15.49:0/2112855165 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efccc0cae90 msgr2=0x7efcb4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.860+0000 7efcd2361700 1 --2- 172.21.15.49:0/2112855165 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efccc0cae90 0x7efcb4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.860+0000 7efcd2361700 1 -- 172.21.15.49:0/2112855165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcb4003aa0 msgr2=0x7efcb4003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.860+0000 7efcd2361700 1 --2- 172.21.15.49:0/2112855165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcb4003aa0 0x7efcb4003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.860+0000 7efcd2361700 1 -- 172.21.15.49:0/2112855165 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb40033f0 con 0x7efcb4004b80 2023-11-30T17:20:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.861+0000 7efcd2361700 1 --2- 172.21.15.49:0/2112855165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcb4004b80 0x7efcb4005000 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7efccc084890 tx=0x7efcbc007bb0).ready entity=mon.0 client_cookie=e2c98b2e307e800f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.861+0000 7efcd0b5e700 1 -- 172.21.15.49:0/2112855165 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc007020 con 0x7efcb4004b80 2023-11-30T17:20:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.861+0000 7efcd0b5e700 1 -- 172.21.15.49:0/2112855165 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcbc007180 con 0x7efcb4004b80 2023-11-30T17:20:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.861+0000 7efcd0b5e700 1 -- 172.21.15.49:0/2112855165 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc007500 con 0x7efcb4004b80 2023-11-30T17:20:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.861+0000 7efcd3dc4700 1 -- 172.21.15.49:0/2112855165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcb4004b80 msgr2=0x7efcb4005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.861+0000 7efcd3dc4700 1 --2- 172.21.15.49:0/2112855165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcb4004b80 0x7efcb4005000 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7efccc084890 tx=0x7efcbc007bb0).stop 2023-11-30T17:20:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.861+0000 7efcd2361700 1 -- 172.21.15.49:0/2112855165 reap_dead start 2023-11-30T17:20:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.861+0000 7efcd3dc4700 1 -- 172.21.15.49:0/2112855165 shutdown_connections 2023-11-30T17:20:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.861+0000 7efcd3dc4700 1 -- 172.21.15.49:0/2112855165 >> 172.21.15.49:0/2112855165 conn(0x7efccc094920 msgr2=0x7efccc06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.861+0000 7efcd3dc4700 1 -- 172.21.15.49:0/2112855165 shutdown_connections 2023-11-30T17:20:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.861+0000 7efcd3dc4700 1 -- 172.21.15.49:0/2112855165 wait complete. 2023-11-30T17:20:05.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.862+0000 7efcd3dc4700 1 Processor -- start 2023-11-30T17:20:05.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.862+0000 7efcd3dc4700 1 -- start start 2023-11-30T17:20:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.863+0000 7efcd3dc4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcb4004b80 0x7efccc164f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.863+0000 7efcd3dc4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efccc0c7bc0 0x7efccc0c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.863+0000 7efcd3dc4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efccc15a3b0 0x7efccc15a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.863+0000 7efcd3dc4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efccc0c9f70 con 0x7efcb4004b80 2023-11-30T17:20:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.863+0000 7efcd3dc4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efccc0c2de0 con 0x7efccc15a3b0 2023-11-30T17:20:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.863+0000 7efcd3dc4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efccc15ad20 con 0x7efccc0c7bc0 2023-11-30T17:20:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.863+0000 7efcd1b60700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcb4004b80 0x7efccc164f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.863+0000 7efcd1b60700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcb4004b80 0x7efccc164f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35088/0 (socket says 172.21.15.49:35088) 2023-11-30T17:20:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.863+0000 7efcd1b60700 1 -- 172.21.15.49:0/263690773 learned_addr learned my addr 172.21.15.49:0/263690773 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:20:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.863+0000 7efcd2361700 1 --2- 172.21.15.49:0/263690773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efccc15a3b0 0x7efccc15a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.864+0000 7efcd135f700 1 --2- 172.21.15.49:0/263690773 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efccc0c7bc0 0x7efccc0c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.864+0000 7efcd1b60700 1 -- 172.21.15.49:0/263690773 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efccc0c7bc0 msgr2=0x7efccc0c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.864+0000 7efcd1b60700 1 --2- 172.21.15.49:0/263690773 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efccc0c7bc0 0x7efccc0c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.864+0000 7efcd1b60700 1 -- 172.21.15.49:0/263690773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efccc15a3b0 msgr2=0x7efccc15a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:05.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.864+0000 7efcd1b60700 1 --2- 172.21.15.49:0/263690773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efccc15a3b0 0x7efccc15a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:05.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.864+0000 7efcd1b60700 1 -- 172.21.15.49:0/263690773 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efccc0c24b0 con 0x7efcb4004b80 2023-11-30T17:20:05.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.864+0000 7efcd2361700 1 --2- 172.21.15.49:0/263690773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efccc15a3b0 0x7efccc15a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:20:05.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.864+0000 7efcd135f700 1 --2- 172.21.15.49:0/263690773 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efccc0c7bc0 0x7efccc0c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:20:05.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.864+0000 7efcd1b60700 1 --2- 172.21.15.49:0/263690773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcb4004b80 0x7efccc164f70 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7efcc400fc60 tx=0x7efcc4009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:05.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.864+0000 7efcc9ffb700 1 -- 172.21.15.49:0/263690773 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc40059f0 con 0x7efcb4004b80 2023-11-30T17:20:05.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.864+0000 7efcc9ffb700 1 -- 172.21.15.49:0/263690773 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc4005b50 con 0x7efcb4004b80 2023-11-30T17:20:05.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.864+0000 7efcc9ffb700 1 -- 172.21.15.49:0/263690773 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc400d970 con 0x7efcb4004b80 2023-11-30T17:20:05.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.864+0000 7efcd3dc4700 1 -- 172.21.15.49:0/263690773 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efccc0c2790 con 0x7efcb4004b80 2023-11-30T17:20:05.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.864+0000 7efcd3dc4700 1 -- 172.21.15.49:0/263690773 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efccc0c3270 con 0x7efcb4004b80 2023-11-30T17:20:05.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.865+0000 7efcd3dc4700 1 -- 172.21.15.49:0/263690773 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efccc0c3490 con 0x7efcb4004b80 2023-11-30T17:20:05.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.865+0000 7efcc9ffb700 1 -- 172.21.15.49:0/263690773 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7efcc400dd20 con 0x7efcb4004b80 2023-11-30T17:20:05.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.866+0000 7efcc9ffb700 1 --2- 172.21.15.49:0/263690773 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efcb805f240 0x7efcb8061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:05.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.866+0000 7efcc9ffb700 1 -- 172.21.15.49:0/263690773 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6121+0+0 (secure 0 0 0) 0x7efcc4079fa0 con 0x7efcb4004b80 2023-11-30T17:20:05.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.866+0000 7efcd135f700 1 --2- 172.21.15.49:0/263690773 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efcb805f240 0x7efcb8061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:05.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.866+0000 7efcd135f700 1 --2- 172.21.15.49:0/263690773 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efcb805f240 0x7efcb8061700 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7efcc0009270 tx=0x7efcc0008040).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:05.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:05.870+0000 7efcc9ffb700 1 -- 172.21.15.49:0/263690773 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efccc0c3490 con 0x7efcb4004b80 2023-11-30T17:20:06.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.086+0000 7efcd3dc4700 1 -- 172.21.15.49:0/263690773 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efccc0c3490 con 0x7efcb4004b80 2023-11-30T17:20:06.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.087+0000 7efcc9ffb700 1 -- 172.21.15.49:0/263690773 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4495 (secure 0 0 0) 0x7efccc0c3490 con 0x7efcb4004b80 2023-11-30T17:20:06.090 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:20:06.090 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1605498959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1605498959},{"type":"v1","addr":"172.21.15.115:6836","nonce":1605498959}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1471786970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1471786970},{"type":"v1","addr":"172.21.15.115:6837","nonce":1471786970}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5763,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1757467688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1757467688},{"type":"v1","addr":"172.21.15.49:6834","nonce":1757467688}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:19:56.468670+0000","modified":"2023-11-30T17:19:59.475872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5766},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5766":{"gid":5766,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2424233798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2424233798},{"type":"v1","addr":"172.21.15.49:6835","nonce":2424233798}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-11-30T17:20:06.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.089+0000 7efcd3dc4700 1 -- 172.21.15.49:0/263690773 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efcb805f240 msgr2=0x7efcb8061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:06.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.089+0000 7efcd3dc4700 1 --2- 172.21.15.49:0/263690773 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efcb805f240 0x7efcb8061700 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7efcc0009270 tx=0x7efcc0008040).stop 2023-11-30T17:20:06.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.089+0000 7efcd3dc4700 1 -- 172.21.15.49:0/263690773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcb4004b80 msgr2=0x7efccc164f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:06.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.089+0000 7efcd3dc4700 1 --2- 172.21.15.49:0/263690773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcb4004b80 0x7efccc164f70 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7efcc400fc60 tx=0x7efcc4009040).stop 2023-11-30T17:20:06.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.089+0000 7efcd3dc4700 1 -- 172.21.15.49:0/263690773 shutdown_connections 2023-11-30T17:20:06.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.089+0000 7efcd3dc4700 1 --2- 172.21.15.49:0/263690773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efccc15a3b0 0x7efccc15a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.089+0000 7efcd3dc4700 1 --2- 172.21.15.49:0/263690773 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efcb805f240 0x7efcb8061700 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.089+0000 7efcd3dc4700 1 --2- 172.21.15.49:0/263690773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcb4004b80 0x7efccc164f70 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.089+0000 7efcd3dc4700 1 --2- 172.21.15.49:0/263690773 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efccc0c7bc0 0x7efccc0c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.089+0000 7efcd3dc4700 1 -- 172.21.15.49:0/263690773 >> 172.21.15.49:0/263690773 conn(0x7efccc094920 msgr2=0x7efccc153da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:06.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.089+0000 7efcd3dc4700 1 -- 172.21.15.49:0/263690773 shutdown_connections 2023-11-30T17:20:06.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.089+0000 7efcd3dc4700 1 -- 172.21.15.49:0/263690773 wait complete. 2023-11-30T17:20:06.093 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 24 2023-11-30T17:20:06.505 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-30T17:19:56.468670+0000', 'modified': '2023-11-30T17:19:59.475872+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5766}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5766': {'gid': 5766, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6835/2424233798', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6833', 'nonce': 2424233798}, {'type': 'v1', 'addr': '172.21.15.49:6835', 'nonce': 2424233798}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-11-30T17:20:06.506 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-30T17:20:06.506 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-30T17:20:06.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.624+0000 7fb649fac700 1 Processor -- start 2023-11-30T17:20:06.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.624+0000 7fb649fac700 1 -- start start 2023-11-30T17:20:06.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.625+0000 7fb649fac700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb644158160 0x7fb6440a8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:06.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.625+0000 7fb649fac700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb64414e600 0x7fb64414ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:06.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.625+0000 7fb649fac700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb644067770 con 0x7fb6440a8280 2023-11-30T17:20:06.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.625+0000 7fb649fac700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb644159180 con 0x7fb64414e600 2023-11-30T17:20:06.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.625+0000 7fb649fac700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440be8d0 con 0x7fb644158160 2023-11-30T17:20:06.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.625+0000 7fb643fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb64414e600 0x7fb64414ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:06.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.625+0000 7fb643fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb64414e600 0x7fb64414ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35098/0 (socket says 172.21.15.49:35098) 2023-11-30T17:20:06.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.625+0000 7fb643fff700 1 -- 172.21.15.49:0/1259072193 learned_addr learned my addr 172.21.15.49:0/1259072193 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:20:06.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.625+0000 7fb642ffd700 1 --2- 172.21.15.49:0/1259072193 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb644158160 0x7fb6440a8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:06.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.626+0000 7fb643fff700 1 -- 172.21.15.49:0/1259072193 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb644158160 msgr2=0x7fb6440a8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:06.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.626+0000 7fb643fff700 1 --2- 172.21.15.49:0/1259072193 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb644158160 0x7fb6440a8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.626+0000 7fb643fff700 1 -- 172.21.15.49:0/1259072193 >> v1:172.21.15.115:6789/0 conn(0x7fb6440a8280 legacy=0x7fb644155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:06.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.626+0000 7fb643fff700 1 -- 172.21.15.49:0/1259072193 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb644158600 con 0x7fb64414e600 2023-11-30T17:20:06.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.626+0000 7fb643fff700 1 --2- 172.21.15.49:0/1259072193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb64414e600 0x7fb64414ea90 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7fb63c009f20 tx=0x7fb63c009840).ready entity=mon.0 client_cookie=8cb53428e6146aba server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:06.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.626+0000 7fb6427fc700 1 -- 172.21.15.49:0/1259072193 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c00e070 con 0x7fb64414e600 2023-11-30T17:20:06.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.626+0000 7fb6427fc700 1 -- 172.21.15.49:0/1259072193 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63c00b9d0 con 0x7fb64414e600 2023-11-30T17:20:06.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.626+0000 7fb6427fc700 1 -- 172.21.15.49:0/1259072193 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c00bd50 con 0x7fb64414e600 2023-11-30T17:20:06.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.626+0000 7fb649fac700 1 -- 172.21.15.49:0/1259072193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb64414e600 msgr2=0x7fb64414ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:06.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.626+0000 7fb649fac700 1 --2- 172.21.15.49:0/1259072193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb64414e600 0x7fb64414ea90 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7fb63c009f20 tx=0x7fb63c009840).stop 2023-11-30T17:20:06.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.627+0000 7fb649fac700 1 -- 172.21.15.49:0/1259072193 shutdown_connections 2023-11-30T17:20:06.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.627+0000 7fb649fac700 1 --2- 172.21.15.49:0/1259072193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb64414e600 0x7fb64414ea90 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.627+0000 7fb649fac700 1 --2- 172.21.15.49:0/1259072193 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb644158160 0x7fb6440a8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.627+0000 7fb649fac700 1 -- 172.21.15.49:0/1259072193 >> 172.21.15.49:0/1259072193 conn(0x7fb644062700 msgr2=0x7fb644062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:06.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.627+0000 7fb649fac700 1 -- 172.21.15.49:0/1259072193 shutdown_connections 2023-11-30T17:20:06.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.627+0000 7fb649fac700 1 -- 172.21.15.49:0/1259072193 wait complete. 2023-11-30T17:20:06.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.628+0000 7fb649fac700 1 Processor -- start 2023-11-30T17:20:06.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.628+0000 7fb649fac700 1 -- start start 2023-11-30T17:20:06.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.629+0000 7fb649fac700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6440a8280 0x7fb644155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:06.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.629+0000 7fb649fac700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb64414e600 0x7fb64414c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:06.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.629+0000 7fb649fac700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb644158160 0x7fb644157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:06.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.629+0000 7fb649fac700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64414c5a0 con 0x7fb6440a8280 2023-11-30T17:20:06.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.629+0000 7fb649fac700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb644157850 con 0x7fb64414e600 2023-11-30T17:20:06.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.629+0000 7fb649fac700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb644156ed0 con 0x7fb644158160 2023-11-30T17:20:06.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.629+0000 7fb6437fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6440a8280 0x7fb644155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:06.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.629+0000 7fb6437fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6440a8280 0x7fb644155d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35100/0 (socket says 172.21.15.49:35100) 2023-11-30T17:20:06.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.629+0000 7fb6437fe700 1 -- 172.21.15.49:0/2701801073 learned_addr learned my addr 172.21.15.49:0/2701801073 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:20:06.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.629+0000 7fb642ffd700 1 --2- 172.21.15.49:0/2701801073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb64414e600 0x7fb64414c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:06.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.629+0000 7fb643fff700 1 --2- 172.21.15.49:0/2701801073 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb644158160 0x7fb644157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:06.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.629+0000 7fb6437fe700 1 -- 172.21.15.49:0/2701801073 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb644158160 msgr2=0x7fb644157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:06.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.629+0000 7fb6437fe700 1 --2- 172.21.15.49:0/2701801073 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb644158160 0x7fb644157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.629+0000 7fb6437fe700 1 -- 172.21.15.49:0/2701801073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb64414e600 msgr2=0x7fb64414c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:06.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.629+0000 7fb6437fe700 1 --2- 172.21.15.49:0/2701801073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb64414e600 0x7fb64414c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.629+0000 7fb6437fe700 1 -- 172.21.15.49:0/2701801073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63c009ae0 con 0x7fb6440a8280 2023-11-30T17:20:06.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.629+0000 7fb6437fe700 1 --2- 172.21.15.49:0/2701801073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6440a8280 0x7fb644155d20 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7fb63400c440 tx=0x7fb634007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:06.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.629+0000 7fb63b7fe700 1 -- 172.21.15.49:0/2701801073 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb634007020 con 0x7fb6440a8280 2023-11-30T17:20:06.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.629+0000 7fb63b7fe700 1 -- 172.21.15.49:0/2701801073 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb634007180 con 0x7fb6440a8280 2023-11-30T17:20:06.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.629+0000 7fb649fac700 1 -- 172.21.15.49:0/2701801073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6441562c0 con 0x7fb6440a8280 2023-11-30T17:20:06.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.629+0000 7fb63b7fe700 1 -- 172.21.15.49:0/2701801073 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb634007520 con 0x7fb6440a8280 2023-11-30T17:20:06.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.629+0000 7fb649fac700 1 -- 172.21.15.49:0/2701801073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb644156880 con 0x7fb6440a8280 2023-11-30T17:20:06.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.631+0000 7fb63b7fe700 1 -- 172.21.15.49:0/2701801073 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb6340068b0 con 0x7fb6440a8280 2023-11-30T17:20:06.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.631+0000 7fb63b7fe700 1 --2- 172.21.15.49:0/2701801073 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb62405f270 0x7fb624061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:06.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.631+0000 7fb63b7fe700 1 -- 172.21.15.49:0/2701801073 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb634079720 con 0x7fb6440a8280 2023-11-30T17:20:06.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.631+0000 7fb642ffd700 1 --2- 172.21.15.49:0/2701801073 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb62405f270 0x7fb624061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:06.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.632+0000 7fb642ffd700 1 --2- 172.21.15.49:0/2701801073 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb62405f270 0x7fb624061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fb62c009c30 tx=0x7fb62c009060).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:06.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.633+0000 7fb65b944b80 1 Processor -- start 2023-11-30T17:20:06.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.633+0000 7fb65b944b80 1 -- start start 2023-11-30T17:20:06.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.634+0000 7fb65b944b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5584703f3e40 0x55847065fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:06.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.634+0000 7fb65b944b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558470680ea0 0x5584706377c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:06.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.634+0000 7fb65b944b80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558470637cb0 0x558470632600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:06.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.634+0000 7fb65b944b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584705fd060 con 0x5584703f3e40 2023-11-30T17:20:06.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.634+0000 7fb65b944b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584705741f0 con 0x558470680ea0 2023-11-30T17:20:06.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.634+0000 7fb65b944b80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x558470589440 con 0x558470637cb0 2023-11-30T17:20:06.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.634+0000 7fb6437fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5584703f3e40 0x55847065fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:06.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.634+0000 7fb6437fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5584703f3e40 0x55847065fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35106/0 (socket says 172.21.15.49:35106) 2023-11-30T17:20:06.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.634+0000 7fb6437fe700 1 -- 172.21.15.49:0/2587826525 learned_addr learned my addr 172.21.15.49:0/2587826525 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:20:06.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.634+0000 7fb643fff700 1 --2- 172.21.15.49:0/2587826525 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558470637cb0 0x558470632600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:06.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.634+0000 7fb642ffd700 1 --2- 172.21.15.49:0/2587826525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558470680ea0 0x5584706377c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:06.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.635+0000 7fb6437fe700 1 -- 172.21.15.49:0/2587826525 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558470637cb0 msgr2=0x558470632600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:06.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.635+0000 7fb6437fe700 1 --2- 172.21.15.49:0/2587826525 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558470637cb0 0x558470632600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.635+0000 7fb6437fe700 1 -- 172.21.15.49:0/2587826525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558470680ea0 msgr2=0x5584706377c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:06.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.635+0000 7fb6437fe700 1 --2- 172.21.15.49:0/2587826525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558470680ea0 0x5584706377c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.635+0000 7fb6437fe700 1 -- 172.21.15.49:0/2587826525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558470582620 con 0x5584703f3e40 2023-11-30T17:20:06.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.635+0000 7fb642ffd700 1 --2- 172.21.15.49:0/2587826525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558470680ea0 0x5584706377c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:20:06.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.635+0000 7fb643fff700 1 --2- 172.21.15.49:0/2587826525 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558470637cb0 0x558470632600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:20:06.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.635+0000 7fb6437fe700 1 --2- 172.21.15.49:0/2587826525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5584703f3e40 0x55847065fd90 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7fb63404a920 tx=0x7fb63400f000).ready entity=mon.0 client_cookie=a4f233151e293974 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:06.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.635+0000 7fb638ff9700 1 -- 172.21.15.49:0/2587826525 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63404e1e0 con 0x5584703f3e40 2023-11-30T17:20:06.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.635+0000 7fb638ff9700 1 -- 172.21.15.49:0/2587826525 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb634077b70 con 0x5584703f3e40 2023-11-30T17:20:06.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.635+0000 7fb638ff9700 1 -- 172.21.15.49:0/2587826525 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63404ab80 con 0x5584703f3e40 2023-11-30T17:20:06.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.635+0000 7fb65b944b80 1 -- 172.21.15.49:0/2587826525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5584703f3e40 msgr2=0x55847065fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:06.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.635+0000 7fb65b944b80 1 --2- 172.21.15.49:0/2587826525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5584703f3e40 0x55847065fd90 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7fb63404a920 tx=0x7fb63400f000).stop 2023-11-30T17:20:06.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.636+0000 7fb65b944b80 1 -- 172.21.15.49:0/2587826525 shutdown_connections 2023-11-30T17:20:06.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.636+0000 7fb65b944b80 1 --2- 172.21.15.49:0/2587826525 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558470637cb0 0x558470632600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.636+0000 7fb65b944b80 1 --2- 172.21.15.49:0/2587826525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5584703f3e40 0x55847065fd90 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.636+0000 7fb65b944b80 1 --2- 172.21.15.49:0/2587826525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558470680ea0 0x5584706377c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.636+0000 7fb65b944b80 1 -- 172.21.15.49:0/2587826525 >> 172.21.15.49:0/2587826525 conn(0x5584704a14a0 msgr2=0x558470680790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:06.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.636+0000 7fb65b944b80 1 -- 172.21.15.49:0/2587826525 shutdown_connections 2023-11-30T17:20:06.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.636+0000 7fb65b944b80 1 -- 172.21.15.49:0/2587826525 wait complete. 2023-11-30T17:20:06.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.636+0000 7fb65b944b80 1 -- start start 2023-11-30T17:20:06.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.636+0000 7fb65b944b80 1 Processor -- start 2023-11-30T17:20:06.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.637+0000 7fb65b944b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5584703f3e40 0x55847064d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:06.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.637+0000 7fb65b944b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558470637cb0 0x558470677920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:06.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.637+0000 7fb65b944b80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558470680ea0 0x558470677e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:06.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.637+0000 7fb65b944b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x558470589580 con 0x5584703f3e40 2023-11-30T17:20:06.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.637+0000 7fb65b944b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x558470589800 con 0x558470637cb0 2023-11-30T17:20:06.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.637+0000 7fb65b944b80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x558470554e10 con 0x558470680ea0 2023-11-30T17:20:06.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.637+0000 7fb65b944b80 10 client.0 ll_register_callbacks cb 0x5584705f7460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-30T17:20:06.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.637+0000 7fb6437fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5584703f3e40 0x55847064d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:06.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.637+0000 7fb6437fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5584703f3e40 0x55847064d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35118/0 (socket says 172.21.15.49:35118) 2023-11-30T17:20:06.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.637+0000 7fb6437fe700 1 -- 172.21.15.49:0/1971907446 learned_addr learned my addr 172.21.15.49:0/1971907446 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:20:06.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.637+0000 7fb642ffd700 1 --2- 172.21.15.49:0/1971907446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558470637cb0 0x558470677920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:06.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.637+0000 7fb643fff700 1 --2- 172.21.15.49:0/1971907446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558470680ea0 0x558470677e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:06.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.637+0000 7fb6437fe700 1 -- 172.21.15.49:0/1971907446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558470680ea0 msgr2=0x558470677e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:06.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.638+0000 7fb6437fe700 1 --2- 172.21.15.49:0/1971907446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558470680ea0 0x558470677e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.638+0000 7fb6437fe700 1 -- 172.21.15.49:0/1971907446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558470637cb0 msgr2=0x558470677920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:06.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.638+0000 7fb6437fe700 1 --2- 172.21.15.49:0/1971907446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558470637cb0 0x558470677920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.638+0000 7fb6437fe700 1 -- 172.21.15.49:0/1971907446 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb644156880 con 0x5584703f3e40 2023-11-30T17:20:06.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.638+0000 7fb6437fe700 1 --2- 172.21.15.49:0/1971907446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5584703f3e40 0x55847064d750 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7fb63400c410 tx=0x7fb634053000).ready entity=mon.0 client_cookie=ef6f05f70628e622 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:06.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.638+0000 7fb621ffb700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-30T17:20:06.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.638+0000 7fb621ffb700 1 -- 172.21.15.49:0/1971907446 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63404c890 con 0x5584703f3e40 2023-11-30T17:20:06.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.638+0000 7fb621ffb700 1 -- 172.21.15.49:0/1971907446 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb634077e40 con 0x5584703f3e40 2023-11-30T17:20:06.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.638+0000 7fb65b944b80 1 -- 172.21.15.49:0/1971907446 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55847062b720 con 0x5584703f3e40 2023-11-30T17:20:06.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.638+0000 7fb621ffb700 1 -- 172.21.15.49:0/1971907446 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb63404a260 con 0x5584703f3e40 2023-11-30T17:20:06.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.638+0000 7fb65b944b80 10 client.5925 fetch_fsmap learned FSMap version 24 2023-11-30T17:20:06.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.638+0000 7fb65b944b80 1 -- 172.21.15.49:0/1971907446 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55847057d9c0 con 0x5584703f3e40 2023-11-30T17:20:06.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.638+0000 7fb621ffb700 1 -- 172.21.15.49:0/1971907446 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55847062b720 con 0x5584703f3e40 2023-11-30T17:20:06.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.638+0000 7fb621ffb700 1 -- 172.21.15.49:0/1971907446 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 24) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb63404a3c0 con 0x5584703f3e40 2023-11-30T17:20:06.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.638+0000 7fb65b944b80 10 client.5925 fetch_fsmap finished waiting for FSMap version 24 2023-11-30T17:20:06.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.638+0000 7fb65b944b80 10 client.5925 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-30T17:20:06.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.638+0000 7fb65b944b80 20 client.5925 populate_metadata read hostname 'smithi049' 2023-11-30T17:20:06.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.638+0000 7fb65b944b80 1 --2- 172.21.15.49:0/1971907446 >> [v2:172.21.15.49:6833/2424233798,v1:172.21.15.49:6835/2424233798] conn(0x558470665790 0x558470665b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:06.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.638+0000 7fb65b944b80 4 client.5925 mds_command: new command op to 5766 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-30T17:20:06.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.638+0000 7fb65b944b80 1 -- 172.21.15.49:0/1971907446 --> [v2:172.21.15.49:6833/2424233798,v1:172.21.15.49:6835/2424233798] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5584703efca0 con 0x558470665790 2023-11-30T17:20:06.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.638+0000 7fb642ffd700 1 --2- 172.21.15.49:0/1971907446 >> [v2:172.21.15.49:6833/2424233798,v1:172.21.15.49:6835/2424233798] conn(0x558470665790 0x558470665b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:06.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.639+0000 7fb621ffb700 10 client.5925 ms_handle_connect on v2:172.21.15.49:6833/2424233798 2023-11-30T17:20:06.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.639+0000 7fb642ffd700 1 --2- 172.21.15.49:0/1971907446 >> [v2:172.21.15.49:6833/2424233798,v1:172.21.15.49:6835/2424233798] conn(0x558470665790 0x558470665b70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=baaf18ab903fb0c1 server_cookie=da1a2cddf08a0261 in_seq=0 out_seq=0 2023-11-30T17:20:06.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.639+0000 7fb621ffb700 1 -- 172.21.15.49:0/1971907446 <== mds.0 v2:172.21.15.49:6833/2424233798 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5584703efca0 con 0x558470665790 2023-11-30T17:20:06.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.639+0000 7fb621ffb700 10 client.5925 handle_command_reply: tid=0 2023-11-30T17:20:06.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.639+0000 7fb65b944b80 1 client.5925 shutdown 2023-11-30T17:20:06.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.639+0000 7fb65b944b80 1 -- 172.21.15.49:0/1971907446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5584703f3e40 msgr2=0x55847064d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:06.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.639+0000 7fb65b944b80 1 --2- 172.21.15.49:0/1971907446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5584703f3e40 0x55847064d750 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7fb63400c410 tx=0x7fb634053000).stop 2023-11-30T17:20:06.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.639+0000 7fb65b944b80 1 -- 172.21.15.49:0/1971907446 shutdown_connections 2023-11-30T17:20:06.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.639+0000 7fb65b944b80 1 --2- 172.21.15.49:0/1971907446 >> [v2:172.21.15.49:6833/2424233798,v1:172.21.15.49:6835/2424233798] conn(0x558470665790 0x558470665b70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.640+0000 7fb621ffb700 0 client.5925 ms_handle_reset on v2:172.21.15.49:6833/2424233798 2023-11-30T17:20:06.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.639+0000 7fb65b944b80 1 --2- 172.21.15.49:0/1971907446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558470680ea0 0x558470677e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.640+0000 7fb65b944b80 1 --2- 172.21.15.49:0/1971907446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5584703f3e40 0x55847064d750 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.640+0000 7fb65b944b80 1 --2- 172.21.15.49:0/1971907446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558470637cb0 0x558470677920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.640+0000 7fb65b944b80 1 -- 172.21.15.49:0/1971907446 >> 172.21.15.49:0/1971907446 conn(0x5584704a14a0 msgr2=0x558470638110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:06.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.640+0000 7fb65b944b80 1 -- 172.21.15.49:0/1971907446 shutdown_connections 2023-11-30T17:20:06.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.640+0000 7fb65b944b80 1 -- 172.21.15.49:0/1971907446 wait complete. 2023-11-30T17:20:06.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.640+0000 7fb65b944b80 20 client.5925 trim_cache size 0 max 16384 2023-11-30T17:20:06.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.656+0000 7fb65b944b80 1 Processor -- start 2023-11-30T17:20:06.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.656+0000 7fb65b944b80 1 -- start start 2023-11-30T17:20:06.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.657+0000 7fb65b944b80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5584703f3e40 0x558470636bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:06.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.657+0000 7fb65b944b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558470637cb0 0x558470677a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:06.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.657+0000 7fb65b944b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558470665790 0x55847065e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:06.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.657+0000 7fb65b944b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584706342d0 con 0x558470637cb0 2023-11-30T17:20:06.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.657+0000 7fb65b944b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x558470666900 con 0x558470665790 2023-11-30T17:20:06.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.657+0000 7fb65b944b80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55847064d500 con 0x5584703f3e40 2023-11-30T17:20:06.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.657+0000 7fb642ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558470637cb0 0x558470677a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:06.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.657+0000 7fb642ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558470637cb0 0x558470677a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35134/0 (socket says 172.21.15.49:35134) 2023-11-30T17:20:06.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.657+0000 7fb642ffd700 1 -- 172.21.15.49:0/2795783806 learned_addr learned my addr 172.21.15.49:0/2795783806 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:20:06.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.657+0000 7fb643fff700 1 --2- 172.21.15.49:0/2795783806 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558470665790 0x55847065e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:06.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.657+0000 7fb6437fe700 1 --2- 172.21.15.49:0/2795783806 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5584703f3e40 0x558470636bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:06.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.658+0000 7fb642ffd700 1 -- 172.21.15.49:0/2795783806 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5584703f3e40 msgr2=0x558470636bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:06.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.658+0000 7fb642ffd700 1 --2- 172.21.15.49:0/2795783806 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5584703f3e40 0x558470636bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.658+0000 7fb642ffd700 1 -- 172.21.15.49:0/2795783806 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558470665790 msgr2=0x55847065e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:06.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.658+0000 7fb642ffd700 1 --2- 172.21.15.49:0/2795783806 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558470665790 0x55847065e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.658+0000 7fb642ffd700 1 -- 172.21.15.49:0/2795783806 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55847062b340 con 0x558470637cb0 2023-11-30T17:20:06.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.658+0000 7fb6437fe700 1 --2- 172.21.15.49:0/2795783806 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5584703f3e40 0x558470636bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:20:06.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.658+0000 7fb642ffd700 1 --2- 172.21.15.49:0/2795783806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558470637cb0 0x558470677a80 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7fb62c011ed0 tx=0x7fb62c027280).ready entity=mon.0 client_cookie=e2ce08c67e0fd7a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:06.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.658+0000 7fb6397fa700 1 -- 172.21.15.49:0/2795783806 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c0099a0 con 0x558470637cb0 2023-11-30T17:20:06.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.658+0000 7fb6397fa700 1 -- 172.21.15.49:0/2795783806 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62c027040 con 0x558470637cb0 2023-11-30T17:20:06.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.658+0000 7fb6397fa700 1 -- 172.21.15.49:0/2795783806 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c021c70 con 0x558470637cb0 2023-11-30T17:20:06.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.658+0000 7fb65b944b80 1 -- 172.21.15.49:0/2795783806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558470637cb0 msgr2=0x558470677a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:06.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.658+0000 7fb65b944b80 1 --2- 172.21.15.49:0/2795783806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558470637cb0 0x558470677a80 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7fb62c011ed0 tx=0x7fb62c027280).stop 2023-11-30T17:20:06.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.658+0000 7fb65b944b80 1 -- 172.21.15.49:0/2795783806 shutdown_connections 2023-11-30T17:20:06.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.658+0000 7fb65b944b80 1 --2- 172.21.15.49:0/2795783806 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558470665790 0x55847065e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.658+0000 7fb65b944b80 1 --2- 172.21.15.49:0/2795783806 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5584703f3e40 0x558470636bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.658+0000 7fb65b944b80 1 --2- 172.21.15.49:0/2795783806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558470637cb0 0x558470677a80 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.658+0000 7fb65b944b80 1 -- 172.21.15.49:0/2795783806 >> 172.21.15.49:0/2795783806 conn(0x5584704a14a0 msgr2=0x558470676f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:06.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.658+0000 7fb65b944b80 1 -- 172.21.15.49:0/2795783806 shutdown_connections 2023-11-30T17:20:06.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.658+0000 7fb65b944b80 1 -- 172.21.15.49:0/2795783806 wait complete. 2023-11-30T17:20:06.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.659+0000 7fb65b944b80 1 -- start start 2023-11-30T17:20:06.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.659+0000 7fb65b944b80 1 Processor -- start 2023-11-30T17:20:06.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.660+0000 7fb65b944b80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5584703f3e40 0x558470680720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:06.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.660+0000 7fb65b944b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558470637cb0 0x558470677a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:06.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.660+0000 7fb65b944b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558470665790 0x55847067adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:06.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.660+0000 7fb65b944b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584706e2290 con 0x558470637cb0 2023-11-30T17:20:06.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.660+0000 7fb65b944b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x558470680c10 con 0x558470665790 2023-11-30T17:20:06.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.660+0000 7fb65b944b80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x5584706797a0 con 0x5584703f3e40 2023-11-30T17:20:06.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.660+0000 7fb65b944b80 10 client.0 ll_register_callbacks cb 0x5584705f7460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-30T17:20:06.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.660+0000 7fb642ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558470637cb0 0x558470677a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:06.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.660+0000 7fb642ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558470637cb0 0x558470677a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35138/0 (socket says 172.21.15.49:35138) 2023-11-30T17:20:06.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.660+0000 7fb642ffd700 1 -- 172.21.15.49:0/2595508283 learned_addr learned my addr 172.21.15.49:0/2595508283 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:20:06.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.660+0000 7fb6437fe700 1 --2- 172.21.15.49:0/2595508283 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5584703f3e40 0x558470680720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:06.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.660+0000 7fb643fff700 1 --2- 172.21.15.49:0/2595508283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558470665790 0x55847067adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:06.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.660+0000 7fb642ffd700 1 -- 172.21.15.49:0/2595508283 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5584703f3e40 msgr2=0x558470680720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:06.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.660+0000 7fb642ffd700 1 --2- 172.21.15.49:0/2595508283 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5584703f3e40 0x558470680720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.660+0000 7fb642ffd700 1 -- 172.21.15.49:0/2595508283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558470665790 msgr2=0x55847067adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:06.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.660+0000 7fb642ffd700 1 --2- 172.21.15.49:0/2595508283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558470665790 0x55847067adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.660+0000 7fb642ffd700 1 -- 172.21.15.49:0/2595508283 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb62c011cc0 con 0x558470637cb0 2023-11-30T17:20:06.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.660+0000 7fb642ffd700 1 --2- 172.21.15.49:0/2595508283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558470637cb0 0x558470677a80 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fb62c012010 tx=0x7fb62c02a000).ready entity=mon.0 client_cookie=1ae5ce9ddf28f0ea server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:06.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.660+0000 7fb621ffb700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-30T17:20:06.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.660+0000 7fb621ffb700 1 -- 172.21.15.49:0/2595508283 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c021e40 con 0x558470637cb0 2023-11-30T17:20:06.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.661+0000 7fb621ffb700 1 -- 172.21.15.49:0/2595508283 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb62c014860 con 0x558470637cb0 2023-11-30T17:20:06.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.661+0000 7fb65b944b80 1 -- 172.21.15.49:0/2595508283 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb634077b70 con 0x558470637cb0 2023-11-30T17:20:06.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.661+0000 7fb621ffb700 1 -- 172.21.15.49:0/2595508283 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb62c014c30 con 0x558470637cb0 2023-11-30T17:20:06.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.661+0000 7fb65b944b80 10 client.5931 fetch_fsmap learned FSMap version 24 2023-11-30T17:20:06.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.661+0000 7fb65b944b80 1 -- 172.21.15.49:0/2595508283 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55847057d710 con 0x558470637cb0 2023-11-30T17:20:06.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.661+0000 7fb621ffb700 1 -- 172.21.15.49:0/2595508283 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb634077b70 con 0x558470637cb0 2023-11-30T17:20:06.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.661+0000 7fb621ffb700 1 -- 172.21.15.49:0/2595508283 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 24) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb62c030070 con 0x558470637cb0 2023-11-30T17:20:06.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.661+0000 7fb65b944b80 10 client.5931 fetch_fsmap finished waiting for FSMap version 24 2023-11-30T17:20:06.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.661+0000 7fb65b944b80 10 client.5931 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-30T17:20:06.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.661+0000 7fb65b944b80 20 client.5931 populate_metadata read hostname 'smithi049' 2023-11-30T17:20:06.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.661+0000 7fb65b944b80 1 --2- 172.21.15.49:0/2595508283 >> [v2:172.21.15.49:6833/2424233798,v1:172.21.15.49:6835/2424233798] conn(0x558470680ea0 0x5584706e0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:06.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.661+0000 7fb65b944b80 4 client.5931 mds_command: new command op to 5766 tid=0[{"prefix": "status"}] 2023-11-30T17:20:06.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.661+0000 7fb65b944b80 1 -- 172.21.15.49:0/2595508283 --> [v2:172.21.15.49:6833/2424233798,v1:172.21.15.49:6835/2424233798] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558470426ca0 con 0x558470680ea0 2023-11-30T17:20:06.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.661+0000 7fb6437fe700 1 --2- 172.21.15.49:0/2595508283 >> [v2:172.21.15.49:6833/2424233798,v1:172.21.15.49:6835/2424233798] conn(0x558470680ea0 0x5584706e0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:06.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.661+0000 7fb6437fe700 1 --2- 172.21.15.49:0/2595508283 >> [v2:172.21.15.49:6833/2424233798,v1:172.21.15.49:6835/2424233798] conn(0x558470680ea0 0x5584706e0380 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c7c7585941d87223 server_cookie=516a2a04dc320e8e in_seq=0 out_seq=0 2023-11-30T17:20:06.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.661+0000 7fb621ffb700 10 client.5931 ms_handle_connect on v2:172.21.15.49:6833/2424233798 2023-11-30T17:20:06.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.662+0000 7fb621ffb700 1 -- 172.21.15.49:0/2595508283 <== mds.0 v2:172.21.15.49:6833/2424233798 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x558470426ca0 con 0x558470680ea0 2023-11-30T17:20:06.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.662+0000 7fb621ffb700 10 client.5931 handle_command_reply: tid=0 2023-11-30T17:20:06.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.662+0000 7fb65b944b80 1 client.5931 shutdown 2023-11-30T17:20:06.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.662+0000 7fb65b944b80 1 -- 172.21.15.49:0/2595508283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558470637cb0 msgr2=0x558470677a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:06.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.662+0000 7fb65b944b80 1 --2- 172.21.15.49:0/2595508283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558470637cb0 0x558470677a80 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fb62c012010 tx=0x7fb62c02a000).stop 2023-11-30T17:20:06.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.662+0000 7fb65b944b80 1 -- 172.21.15.49:0/2595508283 shutdown_connections 2023-11-30T17:20:06.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.662+0000 7fb65b944b80 1 --2- 172.21.15.49:0/2595508283 >> [v2:172.21.15.49:6833/2424233798,v1:172.21.15.49:6835/2424233798] conn(0x558470680ea0 0x5584706e0380 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.662+0000 7fb65b944b80 1 --2- 172.21.15.49:0/2595508283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558470665790 0x55847067adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.662+0000 7fb621ffb700 0 client.5931 ms_handle_reset on v2:172.21.15.49:6833/2424233798 2023-11-30T17:20:06.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.662+0000 7fb65b944b80 1 --2- 172.21.15.49:0/2595508283 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5584703f3e40 0x558470680720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.662+0000 7fb65b944b80 1 --2- 172.21.15.49:0/2595508283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558470637cb0 0x558470677a80 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.662+0000 7fb65b944b80 1 -- 172.21.15.49:0/2595508283 >> 172.21.15.49:0/2595508283 conn(0x5584704a14a0 msgr2=0x558470636450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:06.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.662+0000 7fb65b944b80 1 -- 172.21.15.49:0/2595508283 shutdown_connections 2023-11-30T17:20:06.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.662+0000 7fb65b944b80 1 -- 172.21.15.49:0/2595508283 wait complete. 2023-11-30T17:20:06.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.662+0000 7fb65b944b80 20 client.5931 trim_cache size 0 max 16384 2023-11-30T17:20:06.670 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T17:20:06.671 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "ef213ed4-8f62-4ad5-b55f-7510fd0ee359", 2023-11-30T17:20:06.671 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2023-11-30T17:20:06.671 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 5766, 2023-11-30T17:20:06.671 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-11-30T17:20:06.671 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-11-30T17:20:06.671 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-11-30T17:20:06.671 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 10.192778880000001, 2023-11-30T17:20:06.671 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 24, 2023-11-30T17:20:06.671 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 65, 2023-11-30T17:20:06.671 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 65, 2023-11-30T17:20:06.671 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 15.6925843 2023-11-30T17:20:06.671 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T17:20:06.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.662+0000 7fb649fac700 1 -- 172.21.15.49:0/2701801073 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb62405f270 msgr2=0x7fb624061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:06.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.662+0000 7fb649fac700 1 --2- 172.21.15.49:0/2701801073 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb62405f270 0x7fb624061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fb62c009c30 tx=0x7fb62c009060).stop 2023-11-30T17:20:06.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.662+0000 7fb649fac700 1 -- 172.21.15.49:0/2701801073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6440a8280 msgr2=0x7fb644155d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:06.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.662+0000 7fb649fac700 1 --2- 172.21.15.49:0/2701801073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6440a8280 0x7fb644155d20 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7fb63400c440 tx=0x7fb634007e00).stop 2023-11-30T17:20:06.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.662+0000 7fb649fac700 1 -- 172.21.15.49:0/2701801073 shutdown_connections 2023-11-30T17:20:06.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.662+0000 7fb649fac700 1 --2- 172.21.15.49:0/2701801073 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb644158160 0x7fb644157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.662+0000 7fb649fac700 1 --2- 172.21.15.49:0/2701801073 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb62405f270 0x7fb624061730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.662+0000 7fb649fac700 1 --2- 172.21.15.49:0/2701801073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6440a8280 0x7fb644155d20 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.662+0000 7fb649fac700 1 --2- 172.21.15.49:0/2701801073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb64414e600 0x7fb64414c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.662+0000 7fb649fac700 1 -- 172.21.15.49:0/2701801073 >> 172.21.15.49:0/2701801073 conn(0x7fb644062700 msgr2=0x7fb6440a6580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:06.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.662+0000 7fb649fac700 1 -- 172.21.15.49:0/2701801073 shutdown_connections 2023-11-30T17:20:06.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.662+0000 7fb649fac700 1 -- 172.21.15.49:0/2701801073 wait complete. 2023-11-30T17:20:06.676 DEBUG:teuthology.orchestra.run.smithi049:> ceph fs ls 2023-11-30T17:20:06.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.779+0000 7fb666227700 1 Processor -- start 2023-11-30T17:20:06.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.779+0000 7fb666227700 1 -- start start 2023-11-30T17:20:06.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.780+0000 7fb666227700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb660154700 0x7fb6600c7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:06.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.780+0000 7fb666227700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6600c7c50 0x7fb6600c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:06.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.780+0000 7fb666227700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6600c6d80 con 0x7fb6600c7700 2023-11-30T17:20:06.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.780+0000 7fb666227700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6600c85d0 con 0x7fb660154700 2023-11-30T17:20:06.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.780+0000 7fb666227700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb660154ae0 con 0x7fb6600c7c50 2023-11-30T17:20:06.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.780+0000 7fb65f7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb660154700 0x7fb6600c7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:06.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.780+0000 7fb65ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6600c7c50 0x7fb6600c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:06.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.780+0000 7fb65effd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fb6600c7700 0x7fb6600aa1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:54154/0 (socket says 172.21.15.49:54154) 2023-11-30T17:20:06.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.780+0000 7fb65effd700 1 -- 172.21.15.49:0/99787082 learned_addr learned my addr 172.21.15.49:0/99787082 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:20:06.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.780+0000 7fb65e7fc700 1 -- 172.21.15.49:0/99787082 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575520016 0 0) 0x7fb6600c6d80 con 0x7fb6600c7700 2023-11-30T17:20:06.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.780+0000 7fb65e7fc700 1 -- 172.21.15.49:0/99787082 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6480033f0 con 0x7fb6600c7700 2023-11-30T17:20:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.780+0000 7fb65ffff700 1 -- 172.21.15.49:0/99787082 >> v2:172.21.15.115:3300/0 conn(0x7fb660154700 msgr2=0x7fb6600c7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.780+0000 7fb65ffff700 1 --2- 172.21.15.49:0/99787082 >> v2:172.21.15.115:3300/0 conn(0x7fb660154700 0x7fb6600c7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.780+0000 7fb65ffff700 1 -- 172.21.15.49:0/99787082 >> v1:172.21.15.115:6789/0 conn(0x7fb6600c7700 legacy=0x7fb6600aa1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.780+0000 7fb65ffff700 1 -- 172.21.15.49:0/99787082 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb660064c30 con 0x7fb6600c7c50 2023-11-30T17:20:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.780+0000 7fb65f7fe700 1 --2- 172.21.15.49:0/99787082 >> v2:172.21.15.115:3300/0 conn(0x7fb660154700 0x7fb6600c7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:20:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.781+0000 7fb65ffff700 1 --2- 172.21.15.49:0/99787082 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6600c7c50 0x7fb6600c80e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fb658009e60 tx=0x7fb658009780).ready entity=mon.2 client_cookie=7d796a55e68487cf server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.781+0000 7fb65e7fc700 1 -- 172.21.15.49:0/99787082 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65800e070 con 0x7fb6600c7c50 2023-11-30T17:20:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.781+0000 7fb65e7fc700 1 -- 172.21.15.49:0/99787082 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65800bab0 con 0x7fb6600c7c50 2023-11-30T17:20:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.781+0000 7fb65e7fc700 1 -- 172.21.15.49:0/99787082 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65800be30 con 0x7fb6600c7c50 2023-11-30T17:20:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.781+0000 7fb666227700 1 -- 172.21.15.49:0/99787082 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6600c7c50 msgr2=0x7fb6600c80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.781+0000 7fb666227700 1 --2- 172.21.15.49:0/99787082 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6600c7c50 0x7fb6600c80e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fb658009e60 tx=0x7fb658009780).stop 2023-11-30T17:20:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.781+0000 7fb666227700 1 -- 172.21.15.49:0/99787082 shutdown_connections 2023-11-30T17:20:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.781+0000 7fb666227700 1 --2- 172.21.15.49:0/99787082 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6600c7c50 0x7fb6600c80e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.781+0000 7fb666227700 1 --2- 172.21.15.49:0/99787082 >> v2:172.21.15.115:3300/0 conn(0x7fb660154700 0x7fb6600c7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.781+0000 7fb666227700 1 -- 172.21.15.49:0/99787082 >> 172.21.15.49:0/99787082 conn(0x7fb6600948b0 msgr2=0x7fb66006a690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.781+0000 7fb666227700 1 -- 172.21.15.49:0/99787082 shutdown_connections 2023-11-30T17:20:06.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.781+0000 7fb666227700 1 -- 172.21.15.49:0/99787082 wait complete. 2023-11-30T17:20:06.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.782+0000 7fb666227700 1 Processor -- start 2023-11-30T17:20:06.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.782+0000 7fb666227700 1 -- start start 2023-11-30T17:20:06.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.783+0000 7fb666227700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6600c7700 0x7fb660154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:06.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.783+0000 7fb666227700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6600c7c50 0x7fb66014dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:06.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.783+0000 7fb65f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6600c7700 0x7fb660154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:06.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.783+0000 7fb65f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6600c7700 0x7fb660154c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35150/0 (socket says 172.21.15.49:35150) 2023-11-30T17:20:06.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.783+0000 7fb666227700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb660154700 0x7fb6600c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:06.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.783+0000 7fb65f7fe700 1 -- 172.21.15.49:0/3323918739 learned_addr learned my addr 172.21.15.49:0/3323918739 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:20:06.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.783+0000 7fb666227700 1 -- 172.21.15.49:0/3323918739 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6601573e0 con 0x7fb6600c7700 2023-11-30T17:20:06.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.783+0000 7fb666227700 1 -- 172.21.15.49:0/3323918739 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6600c30b0 con 0x7fb6600c7c50 2023-11-30T17:20:06.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.783+0000 7fb666227700 1 -- 172.21.15.49:0/3323918739 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb660155140 con 0x7fb660154700 2023-11-30T17:20:06.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.783+0000 7fb65effd700 1 --2- 172.21.15.49:0/3323918739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6600c7c50 0x7fb66014dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:06.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.784+0000 7fb65ffff700 1 --2- 172.21.15.49:0/3323918739 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb660154700 0x7fb6600c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:06.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.784+0000 7fb65f7fe700 1 -- 172.21.15.49:0/3323918739 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb660154700 msgr2=0x7fb6600c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:06.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.784+0000 7fb65f7fe700 1 --2- 172.21.15.49:0/3323918739 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb660154700 0x7fb6600c8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.784+0000 7fb65f7fe700 1 -- 172.21.15.49:0/3323918739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6600c7c50 msgr2=0x7fb66014dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:06.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.784+0000 7fb65f7fe700 1 --2- 172.21.15.49:0/3323918739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6600c7c50 0x7fb66014dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:06.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.784+0000 7fb65f7fe700 1 -- 172.21.15.49:0/3323918739 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6500092a0 con 0x7fb6600c7700 2023-11-30T17:20:06.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.784+0000 7fb65ffff700 1 --2- 172.21.15.49:0/3323918739 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb660154700 0x7fb6600c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:20:06.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.784+0000 7fb65f7fe700 1 --2- 172.21.15.49:0/3323918739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6600c7700 0x7fb660154c50 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fb65000ea20 tx=0x7fb650009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:06.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.784+0000 7fb6477fe700 1 -- 172.21.15.49:0/3323918739 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65000c8e0 con 0x7fb6600c7700 2023-11-30T17:20:06.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.784+0000 7fb6477fe700 1 -- 172.21.15.49:0/3323918739 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65000ca40 con 0x7fb6600c7700 2023-11-30T17:20:06.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.784+0000 7fb666227700 1 -- 172.21.15.49:0/3323918739 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb658009a20 con 0x7fb6600c7700 2023-11-30T17:20:06.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.784+0000 7fb6477fe700 1 -- 172.21.15.49:0/3323918739 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65000cdc0 con 0x7fb6600c7700 2023-11-30T17:20:06.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.784+0000 7fb666227700 1 -- 172.21.15.49:0/3323918739 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb660155470 con 0x7fb6600c7700 2023-11-30T17:20:06.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.785+0000 7fb666227700 1 -- 172.21.15.49:0/3323918739 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6600475e0 con 0x7fb6600c7700 2023-11-30T17:20:06.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.785+0000 7fb6477fe700 1 -- 172.21.15.49:0/3323918739 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb650012600 con 0x7fb6600c7700 2023-11-30T17:20:06.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.786+0000 7fb6477fe700 1 --2- 172.21.15.49:0/3323918739 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb64c05f2a0 0x7fb64c061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:06.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.786+0000 7fb6477fe700 1 -- 172.21.15.49:0/3323918739 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb65007aa10 con 0x7fb6600c7700 2023-11-30T17:20:06.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.786+0000 7fb65effd700 1 --2- 172.21.15.49:0/3323918739 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb64c05f2a0 0x7fb64c061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:06.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.786+0000 7fb65effd700 1 --2- 172.21.15.49:0/3323918739 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb64c05f2a0 0x7fb64c061760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fb660157c80 tx=0x7fb654009040).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:06.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:06.790+0000 7fb6477fe700 1 -- 172.21.15.49:0/3323918739 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb65004bb60 con 0x7fb6600c7700 2023-11-30T17:20:07.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.007+0000 7fb666227700 1 -- 172.21.15.49:0/3323918739 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb6600c6450 con 0x7fb6600c7700 2023-11-30T17:20:07.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.008+0000 7fb6477fe700 1 -- 172.21.15.49:0/3323918739 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb65004f180 con 0x7fb6600c7700 2023-11-30T17:20:07.010 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-30T17:20:07.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.010+0000 7fb666227700 1 -- 172.21.15.49:0/3323918739 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb64c05f2a0 msgr2=0x7fb64c061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:07.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.010+0000 7fb666227700 1 --2- 172.21.15.49:0/3323918739 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb64c05f2a0 0x7fb64c061760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fb660157c80 tx=0x7fb654009040).stop 2023-11-30T17:20:07.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.010+0000 7fb666227700 1 -- 172.21.15.49:0/3323918739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6600c7700 msgr2=0x7fb660154c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:07.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.010+0000 7fb666227700 1 --2- 172.21.15.49:0/3323918739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6600c7700 0x7fb660154c50 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fb65000ea20 tx=0x7fb650009060).stop 2023-11-30T17:20:07.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.010+0000 7fb666227700 1 -- 172.21.15.49:0/3323918739 shutdown_connections 2023-11-30T17:20:07.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.010+0000 7fb666227700 1 --2- 172.21.15.49:0/3323918739 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb660154700 0x7fb6600c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:07.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.010+0000 7fb666227700 1 --2- 172.21.15.49:0/3323918739 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb64c05f2a0 0x7fb64c061760 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:07.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.010+0000 7fb666227700 1 --2- 172.21.15.49:0/3323918739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6600c7700 0x7fb660154c50 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:07.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.010+0000 7fb666227700 1 --2- 172.21.15.49:0/3323918739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6600c7c50 0x7fb66014dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:07.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.010+0000 7fb666227700 1 -- 172.21.15.49:0/3323918739 >> 172.21.15.49:0/3323918739 conn(0x7fb6600948b0 msgr2=0x7fb6600ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:07.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.010+0000 7fb666227700 1 -- 172.21.15.49:0/3323918739 shutdown_connections 2023-11-30T17:20:07.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.010+0000 7fb666227700 1 -- 172.21.15.49:0/3323918739 wait complete. 2023-11-30T17:20:07.023 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-30T17:20:07.023 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-30T17:20:07.023 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-11-30T17:20:07.023 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-30T17:20:07.023 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-30T17:20:07.023 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-30T17:20:07.023 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-30T17:20:07.023 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-30T17:20:07.023 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-30T17:20:07.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:20:07.024 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-11-30T17:20:07.039 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-30T17:20:07.039 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-30T17:20:07.039 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-11-30T17:20:07.039 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:20:07.040 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-11-30T17:20:07.040 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:20:07.040 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:20:07.040 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:20:07.040 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-11-30T17:20:07.040 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:20:07.040 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:20:07.040 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-11-30T17:20:07.040 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-30T17:20:07.040 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:20:07.040 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-11-30T17:20:07.040 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-30T17:20:07.040 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 41668sec preferred_lft 41668sec 2023-11-30T17:20:07.040 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2023-11-30T17:20:07.040 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:20:07.041 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:20:07.041 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:20:07.041 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-11-30T17:20:07.041 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-30T17:20:07.041 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 32:bf:40:53:4c:5d brd ff:ff:ff:ff:ff:ff 2023-11-30T17:20:07.041 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-30T17:20:07.041 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:20:07.041 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::8b6:11ff:fe93:7174/64 scope link 2023-11-30T17:20:07.041 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:20:07.041 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-30T17:20:07.041 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 3e:e9:3c:a8:7a:95 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-30T17:20:07.041 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::3ce9:3cff:fea8:7a95/64 scope link 2023-11-30T17:20:07.042 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:20:07.042 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-30T17:20:07.042 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 32:bf:40:53:4c:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-30T17:20:07.042 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::30bf:40ff:fe53:4c5d/64 scope link 2023-11-30T17:20:07.042 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:20:07.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:20:07.042 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-30T17:20:07.104 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-11-30T17:20:07.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:20:07.105 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-11-30T17:20:07.163 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-11-30T17:20:07.163 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-30T17:20:07.163 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-30T17:20:07.163 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-30T17:20:07.163 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-30T17:20:07.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:20:07.163 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-11-30T17:20:07.163 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-11-30T17:20:07.163 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-30T17:20:07.164 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-30T17:20:07.164 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-30T17:20:07.164 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-11-30T17:20:07.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:20:07.265 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-11-30T17:20:07.280 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-30T17:20:07.280 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-30T17:20:07.280 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-30T17:20:07.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:20:07.281 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-11-30T17:20:07.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:20:07.345 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-11-30T17:20:07.400 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-30T17:20:07.400 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:20:07.481 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:20:07.481 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-30T17:20:07.505 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:20:07.505 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-30T17:20:07.507 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-30T17:20:07.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:20:07.507 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-30T17:20:07.573 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-30T17:20:07.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.730+0000 7fca11f4b700 1 Processor -- start 2023-11-30T17:20:07.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.730+0000 7fca11f4b700 1 -- start start 2023-11-30T17:20:07.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.731+0000 7fca11f4b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca0c066a30 0x7fca0c066e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:07.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.731+0000 7fca11f4b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fca0c0c6eb0 0x7fca0c13db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:07.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.731+0000 7fca11f4b700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca0c1586a0 con 0x7fca0c0c6a30 2023-11-30T17:20:07.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.731+0000 7fca11f4b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca0c157de0 con 0x7fca0c0c6eb0 2023-11-30T17:20:07.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.731+0000 7fca11f4b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c064820 con 0x7fca0c066a30 2023-11-30T17:20:07.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.731+0000 7fca0bfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fca0c0c6a30 0x7fca0c13d450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34844/0 (socket says 172.21.15.49:34844) 2023-11-30T17:20:07.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.731+0000 7fca0bfff700 1 -- 172.21.15.49:0/2794900909 learned_addr learned my addr 172.21.15.49:0/2794900909 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:20:07.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.731+0000 7fca10f49700 1 --2- 172.21.15.49:0/2794900909 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca0c066a30 0x7fca0c066e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:07.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.731+0000 7fca1174a700 1 --2- 172.21.15.49:0/2794900909 >> v2:172.21.15.115:3300/0 conn(0x7fca0c0c6eb0 0x7fca0c13db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:07.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.731+0000 7fca0b7fe700 1 -- 172.21.15.49:0/2794900909 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 186648946 0 0) 0x7fca0c1586a0 con 0x7fca0c0c6a30 2023-11-30T17:20:07.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.731+0000 7fca0b7fe700 1 -- 172.21.15.49:0/2794900909 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9fc0033f0 con 0x7fca0c0c6a30 2023-11-30T17:20:07.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.731+0000 7fca0b7fe700 1 -- 172.21.15.49:0/2794900909 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 132092236 0 0) 0x7fc9fc0033f0 con 0x7fca0c0c6a30 2023-11-30T17:20:07.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.731+0000 7fca0b7fe700 1 -- 172.21.15.49:0/2794900909 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca0c066a30 msgr2=0x7fca0c066e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:07.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.731+0000 7fca0b7fe700 1 --2- 172.21.15.49:0/2794900909 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca0c066a30 0x7fca0c066e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:07.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.731+0000 7fca0b7fe700 1 -- 172.21.15.49:0/2794900909 >> v2:172.21.15.115:3300/0 conn(0x7fca0c0c6eb0 msgr2=0x7fca0c13db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:07.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.731+0000 7fca0b7fe700 1 --2- 172.21.15.49:0/2794900909 >> v2:172.21.15.115:3300/0 conn(0x7fca0c0c6eb0 0x7fca0c13db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:07.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.731+0000 7fca0b7fe700 1 -- 172.21.15.49:0/2794900909 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca0c158050 con 0x7fca0c0c6a30 2023-11-30T17:20:07.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.731+0000 7fca0b7fe700 1 -- 172.21.15.49:0/2794900909 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fc9f8001470 con 0x7fca0c0c6a30 2023-11-30T17:20:07.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.731+0000 7fca0b7fe700 1 -- 172.21.15.49:0/2794900909 >> v1:172.21.15.49:6789/0 conn(0x7fca0c0c6a30 legacy=0x7fca0c13d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:07.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.732+0000 7fca0b7fe700 1 --2- 172.21.15.49:0/2794900909 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca0c066a30 0x7fc9fc0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:07.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.732+0000 7fca0b7fe700 1 --2- 172.21.15.49:0/2794900909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9fc003e10 0x7fc9fc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:07.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.732+0000 7fca0b7fe700 1 --2- 172.21.15.49:0/2794900909 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9fc004b80 0x7fc9fc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:07.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.732+0000 7fca0b7fe700 1 -- 172.21.15.49:0/2794900909 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c157de0 con 0x7fc9fc003e10 2023-11-30T17:20:07.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.732+0000 7fca0b7fe700 1 -- 172.21.15.49:0/2794900909 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c064820 con 0x7fc9fc004b80 2023-11-30T17:20:07.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.732+0000 7fca0b7fe700 1 -- 172.21.15.49:0/2794900909 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc00b8e0 con 0x7fca0c066a30 2023-11-30T17:20:07.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.732+0000 7fca0bfff700 1 --2- 172.21.15.49:0/2794900909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9fc003e10 0x7fc9fc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:07.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.732+0000 7fca10f49700 1 --2- 172.21.15.49:0/2794900909 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca0c066a30 0x7fc9fc0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:07.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.732+0000 7fca1174a700 1 --2- 172.21.15.49:0/2794900909 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9fc004b80 0x7fc9fc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:07.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.732+0000 7fca0bfff700 1 -- 172.21.15.49:0/2794900909 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca0c066a30 msgr2=0x7fc9fc0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:07.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.732+0000 7fca0bfff700 1 --2- 172.21.15.49:0/2794900909 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca0c066a30 0x7fc9fc0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:07.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.732+0000 7fca0bfff700 1 -- 172.21.15.49:0/2794900909 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9fc004b80 msgr2=0x7fc9fc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:07.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.732+0000 7fca0bfff700 1 --2- 172.21.15.49:0/2794900909 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9fc004b80 0x7fc9fc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:07.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.732+0000 7fca0bfff700 1 -- 172.21.15.49:0/2794900909 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9fc0033f0 con 0x7fc9fc003e10 2023-11-30T17:20:07.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.732+0000 7fca1174a700 1 --2- 172.21.15.49:0/2794900909 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9fc004b80 0x7fc9fc005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:20:07.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.732+0000 7fca0bfff700 1 --2- 172.21.15.49:0/2794900909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9fc003e10 0x7fc9fc004690 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7fc9f800c190 tx=0x7fc9f8001e50).ready entity=mon.0 client_cookie=c6cb592b856c657a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:07.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.732+0000 7fca0b7fe700 1 -- 172.21.15.49:0/2794900909 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f8007a20 con 0x7fc9fc003e10 2023-11-30T17:20:07.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.732+0000 7fca0b7fe700 1 -- 172.21.15.49:0/2794900909 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f800ca80 con 0x7fc9fc003e10 2023-11-30T17:20:07.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.732+0000 7fca0b7fe700 1 -- 172.21.15.49:0/2794900909 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f800ce00 con 0x7fc9fc003e10 2023-11-30T17:20:07.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.733+0000 7fca11f4b700 1 -- 172.21.15.49:0/2794900909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9fc003e10 msgr2=0x7fc9fc004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:07.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.733+0000 7fca11f4b700 1 --2- 172.21.15.49:0/2794900909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9fc003e10 0x7fc9fc004690 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7fc9f800c190 tx=0x7fc9f8001e50).stop 2023-11-30T17:20:07.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.733+0000 7fca1174a700 1 -- 172.21.15.49:0/2794900909 reap_dead start 2023-11-30T17:20:07.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.733+0000 7fca11f4b700 1 -- 172.21.15.49:0/2794900909 shutdown_connections 2023-11-30T17:20:07.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.733+0000 7fca11f4b700 1 -- 172.21.15.49:0/2794900909 >> 172.21.15.49:0/2794900909 conn(0x7fca0c0c8ed0 msgr2=0x7fca0c0c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:07.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.733+0000 7fca11f4b700 1 -- 172.21.15.49:0/2794900909 shutdown_connections 2023-11-30T17:20:07.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.733+0000 7fca11f4b700 1 -- 172.21.15.49:0/2794900909 wait complete. 2023-11-30T17:20:07.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.734+0000 7fca11f4b700 1 Processor -- start 2023-11-30T17:20:07.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.734+0000 7fca11f4b700 1 -- start start 2023-11-30T17:20:07.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.735+0000 7fca11f4b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9fc003e10 0x7fca0c139ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:07.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.735+0000 7fca11f4b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca0c0ad230 0x7fca0c0c0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:07.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.735+0000 7fca11f4b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca0c0c0f60 0x7fca0c0c4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:07.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.735+0000 7fca11f4b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c0acda0 con 0x7fca0c0c0f60 2023-11-30T17:20:07.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.735+0000 7fca11f4b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c139fd0 con 0x7fca0c0ad230 2023-11-30T17:20:07.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.735+0000 7fca11f4b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c0ac190 con 0x7fc9fc003e10 2023-11-30T17:20:07.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.735+0000 7fca1174a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca0c0c0f60 0x7fca0c0c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:07.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.735+0000 7fca1174a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca0c0c0f60 0x7fca0c0c4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35180/0 (socket says 172.21.15.49:35180) 2023-11-30T17:20:07.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.735+0000 7fca1174a700 1 -- 172.21.15.49:0/3251411395 learned_addr learned my addr 172.21.15.49:0/3251411395 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:20:07.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.735+0000 7fca0bfff700 1 --2- 172.21.15.49:0/3251411395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca0c0ad230 0x7fca0c0c0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:07.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.735+0000 7fca10f49700 1 --2- 172.21.15.49:0/3251411395 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9fc003e10 0x7fca0c139ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:07.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.735+0000 7fca1174a700 1 -- 172.21.15.49:0/3251411395 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9fc003e10 msgr2=0x7fca0c139ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:07.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.735+0000 7fca1174a700 1 --2- 172.21.15.49:0/3251411395 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9fc003e10 0x7fca0c139ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:07.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.735+0000 7fca1174a700 1 -- 172.21.15.49:0/3251411395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca0c0ad230 msgr2=0x7fca0c0c0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:07.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.735+0000 7fca1174a700 1 --2- 172.21.15.49:0/3251411395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca0c0ad230 0x7fca0c0c0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:07.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.735+0000 7fca1174a700 1 -- 172.21.15.49:0/3251411395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca0c0ac470 con 0x7fca0c0c0f60 2023-11-30T17:20:07.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.735+0000 7fca1174a700 1 --2- 172.21.15.49:0/3251411395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca0c0c0f60 0x7fca0c0c4210 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fca0c0c7340 tx=0x7fca0400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:07.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.736+0000 7fca08ff9700 1 -- 172.21.15.49:0/3251411395 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0400e030 con 0x7fca0c0c0f60 2023-11-30T17:20:07.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.736+0000 7fca08ff9700 1 -- 172.21.15.49:0/3251411395 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca04011b80 con 0x7fca0c0c0f60 2023-11-30T17:20:07.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.736+0000 7fca11f4b700 1 -- 172.21.15.49:0/3251411395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca0c0ac750 con 0x7fca0c0c0f60 2023-11-30T17:20:07.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.736+0000 7fca08ff9700 1 -- 172.21.15.49:0/3251411395 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca04009b70 con 0x7fca0c0c0f60 2023-11-30T17:20:07.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.736+0000 7fca11f4b700 1 -- 172.21.15.49:0/3251411395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca0c0abe60 con 0x7fca0c0c0f60 2023-11-30T17:20:07.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.737+0000 7fca11f4b700 1 -- 172.21.15.49:0/3251411395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca0c0ad080 con 0x7fca0c0c0f60 2023-11-30T17:20:07.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.737+0000 7fca08ff9700 1 -- 172.21.15.49:0/3251411395 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fca04015600 con 0x7fca0c0c0f60 2023-11-30T17:20:07.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.737+0000 7fca08ff9700 1 --2- 172.21.15.49:0/3251411395 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc9f005f270 0x7fc9f0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:07.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.737+0000 7fca08ff9700 1 -- 172.21.15.49:0/3251411395 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fca0400f070 con 0x7fca0c0c0f60 2023-11-30T17:20:07.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.738+0000 7fca10f49700 1 --2- 172.21.15.49:0/3251411395 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc9f005f270 0x7fc9f0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:07.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.738+0000 7fca10f49700 1 --2- 172.21.15.49:0/3251411395 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc9f005f270 0x7fc9f0061730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fca00006d80 tx=0x7fca00009060).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:07.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.742+0000 7fca08ff9700 1 -- 172.21.15.49:0/3251411395 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fca0404bd20 con 0x7fca0c0c0f60 2023-11-30T17:20:07.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.943+0000 7fca11f4b700 1 -- 172.21.15.49:0/3251411395 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fca0c066e10 con 0x7fc9f005f270 2023-11-30T17:20:07.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.945+0000 7fca08ff9700 1 -- 172.21.15.49:0/3251411395 <== mgr.5449 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fca0c066e10 con 0x7fc9f005f270 2023-11-30T17:20:07.947 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-11-30T17:20:07.947 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:20:07.947 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cephfs" 2023-11-30T17:20:07.947 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:20:07.947 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-11-30T17:20:07.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.947+0000 7fca11f4b700 1 -- 172.21.15.49:0/3251411395 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc9f005f270 msgr2=0x7fc9f0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:07.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.947+0000 7fca11f4b700 1 --2- 172.21.15.49:0/3251411395 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc9f005f270 0x7fc9f0061730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fca00006d80 tx=0x7fca00009060).stop 2023-11-30T17:20:07.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.947+0000 7fca11f4b700 1 -- 172.21.15.49:0/3251411395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca0c0c0f60 msgr2=0x7fca0c0c4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:07.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.947+0000 7fca11f4b700 1 --2- 172.21.15.49:0/3251411395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca0c0c0f60 0x7fca0c0c4210 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fca0c0c7340 tx=0x7fca0400b040).stop 2023-11-30T17:20:07.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.947+0000 7fca11f4b700 1 -- 172.21.15.49:0/3251411395 shutdown_connections 2023-11-30T17:20:07.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.947+0000 7fca11f4b700 1 --2- 172.21.15.49:0/3251411395 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc9f005f270 0x7fc9f0061730 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:07.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.947+0000 7fca11f4b700 1 --2- 172.21.15.49:0/3251411395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca0c0c0f60 0x7fca0c0c4210 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:07.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.947+0000 7fca11f4b700 1 --2- 172.21.15.49:0/3251411395 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9fc003e10 0x7fca0c139ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:07.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.947+0000 7fca11f4b700 1 --2- 172.21.15.49:0/3251411395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca0c0ad230 0x7fca0c0c0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:07.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.947+0000 7fca11f4b700 1 -- 172.21.15.49:0/3251411395 >> 172.21.15.49:0/3251411395 conn(0x7fca0c0c8ed0 msgr2=0x7fca0c068a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:07.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.947+0000 7fca11f4b700 1 -- 172.21.15.49:0/3251411395 shutdown_connections 2023-11-30T17:20:07.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:07.947+0000 7fca11f4b700 1 -- 172.21.15.49:0/3251411395 wait complete. 2023-11-30T17:20:07.961 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-11-30T17:20:08.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.078+0000 7f8bb7362700 1 Processor -- start 2023-11-30T17:20:08.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.079+0000 7f8bb7362700 1 -- start start 2023-11-30T17:20:08.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.079+0000 7f8bb7362700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8bb0151a20 0x7f8bb006a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:08.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.079+0000 7f8bb7362700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb00c3470 con 0x7f8bb0069d10 2023-11-30T17:20:08.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.079+0000 7f8bb7362700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb0151ea0 con 0x7f8bb00bd1f0 2023-11-30T17:20:08.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.079+0000 7f8bb7362700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb0152180 con 0x7f8bb0151a20 2023-11-30T17:20:08.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.079+0000 7f8bb50fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8bb0069d10 0x7f8bb00be1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34858/0 (socket says 172.21.15.49:34858) 2023-11-30T17:20:08.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.079+0000 7f8bb50fe700 1 -- 172.21.15.49:0/3718915916 learned_addr learned my addr 172.21.15.49:0/3718915916 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:20:08.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.080+0000 7f8baffff700 1 -- 172.21.15.49:0/3718915916 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1347394478 0 0) 0x7f8bb00c3470 con 0x7f8bb0069d10 2023-11-30T17:20:08.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.080+0000 7f8baffff700 1 -- 172.21.15.49:0/3718915916 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b980033f0 con 0x7f8bb0069d10 2023-11-30T17:20:08.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.080+0000 7f8bb48fd700 1 --2- 172.21.15.49:0/3718915916 >> v2:172.21.15.115:3300/0 conn(0x7f8bb0151a20 0x7f8bb006a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:08.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.080+0000 7f8baffff700 1 -- 172.21.15.49:0/3718915916 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1232309218 0 0) 0x7f8b980033f0 con 0x7f8bb0069d10 2023-11-30T17:20:08.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.080+0000 7f8baffff700 1 -- 172.21.15.49:0/3718915916 >> v2:172.21.15.115:3300/0 conn(0x7f8bb0151a20 msgr2=0x7f8bb006a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:08.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.080+0000 7f8baffff700 1 --2- 172.21.15.49:0/3718915916 >> v2:172.21.15.115:3300/0 conn(0x7f8bb0151a20 0x7f8bb006a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:08.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.080+0000 7f8baffff700 1 -- 172.21.15.49:0/3718915916 >> v1:172.21.15.115:6789/0 conn(0x7f8bb00bd1f0 legacy=0x7f8bb00c38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:08.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.080+0000 7f8baffff700 1 -- 172.21.15.49:0/3718915916 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb0152460 con 0x7f8bb0069d10 2023-11-30T17:20:08.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.080+0000 7f8baffff700 1 -- 172.21.15.49:0/3718915916 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f8ba8001470 con 0x7f8bb0069d10 2023-11-30T17:20:08.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.080+0000 7f8baffff700 1 -- 172.21.15.49:0/3718915916 >> v1:172.21.15.49:6789/0 conn(0x7f8bb0069d10 legacy=0x7f8bb00be1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:08.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.080+0000 7f8baffff700 1 --2- 172.21.15.49:0/3718915916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b980038e0 0x7f8b98003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:08.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.080+0000 7f8baffff700 1 --2- 172.21.15.49:0/3718915916 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b98004690 0x7f8b98004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:08.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.080+0000 7f8baffff700 1 --2- 172.21.15.49:0/3718915916 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b98005050 0x7f8b9800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:08.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.080+0000 7f8baffff700 1 -- 172.21.15.49:0/3718915916 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb0152180 con 0x7f8b980038e0 2023-11-30T17:20:08.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.080+0000 7f8baffff700 1 -- 172.21.15.49:0/3718915916 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9800bfe0 con 0x7f8b98005050 2023-11-30T17:20:08.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.080+0000 7f8baffff700 1 -- 172.21.15.49:0/3718915916 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9800c1a0 con 0x7f8b98004690 2023-11-30T17:20:08.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.080+0000 7f8bb50fe700 1 --2- 172.21.15.49:0/3718915916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b980038e0 0x7f8b98003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:08.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.080+0000 7f8bb58ff700 1 --2- 172.21.15.49:0/3718915916 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b98005050 0x7f8b9800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:08.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.080+0000 7f8bb48fd700 1 --2- 172.21.15.49:0/3718915916 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b98004690 0x7f8b98004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:08.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.081+0000 7f8bb50fe700 1 -- 172.21.15.49:0/3718915916 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b98004690 msgr2=0x7f8b98004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:08.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.081+0000 7f8bb50fe700 1 --2- 172.21.15.49:0/3718915916 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b98004690 0x7f8b98004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:08.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.081+0000 7f8bb50fe700 1 -- 172.21.15.49:0/3718915916 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b98005050 msgr2=0x7f8b9800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:08.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.081+0000 7f8bb50fe700 1 --2- 172.21.15.49:0/3718915916 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b98005050 0x7f8b9800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:08.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.081+0000 7f8bb58ff700 1 -- 172.21.15.49:0/3718915916 reap_dead start 2023-11-30T17:20:08.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.081+0000 7f8bb50fe700 1 -- 172.21.15.49:0/3718915916 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b980033f0 con 0x7f8b980038e0 2023-11-30T17:20:08.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.081+0000 7f8bb50fe700 1 --2- 172.21.15.49:0/3718915916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b980038e0 0x7f8b98003d00 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f8ba800c190 tx=0x7f8ba8001e50).ready entity=mon.0 client_cookie=e170191d87451468 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:08.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.081+0000 7f8baffff700 1 -- 172.21.15.49:0/3718915916 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8007a20 con 0x7f8b980038e0 2023-11-30T17:20:08.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.081+0000 7f8baffff700 1 -- 172.21.15.49:0/3718915916 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba800cac0 con 0x7f8b980038e0 2023-11-30T17:20:08.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.081+0000 7f8baffff700 1 -- 172.21.15.49:0/3718915916 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba800ce40 con 0x7f8b980038e0 2023-11-30T17:20:08.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.081+0000 7f8bb7362700 1 -- 172.21.15.49:0/3718915916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b980038e0 msgr2=0x7f8b98003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:08.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.081+0000 7f8bb7362700 1 --2- 172.21.15.49:0/3718915916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b980038e0 0x7f8b98003d00 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f8ba800c190 tx=0x7f8ba8001e50).stop 2023-11-30T17:20:08.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.081+0000 7f8bb7362700 1 -- 172.21.15.49:0/3718915916 shutdown_connections 2023-11-30T17:20:08.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.081+0000 7f8bb7362700 1 --2- 172.21.15.49:0/3718915916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b980038e0 0x7f8b98003d00 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:08.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.081+0000 7f8bb7362700 1 -- 172.21.15.49:0/3718915916 >> 172.21.15.49:0/3718915916 conn(0x7f8bb00642d0 msgr2=0x7f8bb00c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:08.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.081+0000 7f8bb7362700 1 -- 172.21.15.49:0/3718915916 shutdown_connections 2023-11-30T17:20:08.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.081+0000 7f8bb7362700 1 -- 172.21.15.49:0/3718915916 wait complete. 2023-11-30T17:20:08.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.083+0000 7f8bb7362700 1 Processor -- start 2023-11-30T17:20:08.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.083+0000 7f8bb7362700 1 -- start start 2023-11-30T17:20:08.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.083+0000 7f8bb7362700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b980038e0 0x7f8bb00bfd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:08.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.083+0000 7f8bb7362700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bb0168270 0x7f8bb00aa030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:08.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.083+0000 7f8bb7362700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bb0062700 0x7f8bb0062b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:08.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.084+0000 7f8bb7362700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb014da10 con 0x7f8bb0168270 2023-11-30T17:20:08.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.084+0000 7f8bb7362700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb00c3eb0 con 0x7f8bb0062700 2023-11-30T17:20:08.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.084+0000 7f8bb7362700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb0063030 con 0x7f8b980038e0 2023-11-30T17:20:08.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.084+0000 7f8bb48fd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bb0168270 0x7f8bb00aa030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:08.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.084+0000 7f8bb48fd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bb0168270 0x7f8bb00aa030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35198/0 (socket says 172.21.15.49:35198) 2023-11-30T17:20:08.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.084+0000 7f8bb48fd700 1 -- 172.21.15.49:0/2988835949 learned_addr learned my addr 172.21.15.49:0/2988835949 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:20:08.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.084+0000 7f8bb50fe700 1 --2- 172.21.15.49:0/2988835949 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b980038e0 0x7f8bb00bfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:08.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.084+0000 7f8bb58ff700 1 --2- 172.21.15.49:0/2988835949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bb0062700 0x7f8bb0062b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:08.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.084+0000 7f8bb48fd700 1 -- 172.21.15.49:0/2988835949 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b980038e0 msgr2=0x7f8bb00bfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:08.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.084+0000 7f8bb48fd700 1 --2- 172.21.15.49:0/2988835949 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b980038e0 0x7f8bb00bfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:08.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.084+0000 7f8bb48fd700 1 -- 172.21.15.49:0/2988835949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bb0062700 msgr2=0x7f8bb0062b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:08.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.084+0000 7f8bb48fd700 1 --2- 172.21.15.49:0/2988835949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bb0062700 0x7f8bb0062b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:08.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.084+0000 7f8bb48fd700 1 -- 172.21.15.49:0/2988835949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb0168ac0 con 0x7f8bb0168270 2023-11-30T17:20:08.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.084+0000 7f8bb58ff700 1 --2- 172.21.15.49:0/2988835949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bb0062700 0x7f8bb0062b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:20:08.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.084+0000 7f8bb48fd700 1 --2- 172.21.15.49:0/2988835949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bb0168270 0x7f8bb00aa030 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f8ba4010980 tx=0x7f8ba4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:08.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.084+0000 7f8bad7fa700 1 -- 172.21.15.49:0/2988835949 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba400e6c0 con 0x7f8bb0168270 2023-11-30T17:20:08.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.084+0000 7f8bad7fa700 1 -- 172.21.15.49:0/2988835949 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba400e820 con 0x7f8bb0168270 2023-11-30T17:20:08.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.084+0000 7f8bb7362700 1 -- 172.21.15.49:0/2988835949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb0168da0 con 0x7f8bb0168270 2023-11-30T17:20:08.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.084+0000 7f8bad7fa700 1 -- 172.21.15.49:0/2988835949 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba400eba0 con 0x7f8bb0168270 2023-11-30T17:20:08.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.084+0000 7f8bb7362700 1 -- 172.21.15.49:0/2988835949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb00c3b40 con 0x7f8bb0168270 2023-11-30T17:20:08.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.085+0000 7f8bb7362700 1 -- 172.21.15.49:0/2988835949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb006ab50 con 0x7f8bb0168270 2023-11-30T17:20:08.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.086+0000 7f8bad7fa700 1 -- 172.21.15.49:0/2988835949 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8ba4014470 con 0x7f8bb0168270 2023-11-30T17:20:08.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.086+0000 7f8bad7fa700 1 --2- 172.21.15.49:0/2988835949 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8b9c05f270 0x7f8b9c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:08.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.086+0000 7f8bad7fa700 1 -- 172.21.15.49:0/2988835949 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8ba407a810 con 0x7f8bb0168270 2023-11-30T17:20:08.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.086+0000 7f8bb50fe700 1 --2- 172.21.15.49:0/2988835949 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8b9c05f270 0x7f8b9c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:08.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.087+0000 7f8bb50fe700 1 --2- 172.21.15.49:0/2988835949 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8b9c05f270 0x7f8b9c061730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f8ba8001ed0 tx=0x7f8ba8015000).ready entity=mgr.5449 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:08.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.090+0000 7f8bad7fa700 1 -- 172.21.15.49:0/2988835949 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8ba404b900 con 0x7f8bb0168270 2023-11-30T17:20:08.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.306+0000 7f8bb7362700 1 -- 172.21.15.49:0/2988835949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f8bb006c860 con 0x7f8bb0168270 2023-11-30T17:20:08.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.899+0000 7f8bad7fa700 1 -- 172.21.15.49:0/2988835949 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 15) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f8ba4078460 con 0x7f8bb0168270 2023-11-30T17:20:08.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.901+0000 7f8bad7fa700 1 -- 172.21.15.49:0/2988835949 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v15) v1 ==== 92+0+0 (secure 0 0 0) 0x7f8ba4071ef0 con 0x7f8bb0168270 2023-11-30T17:20:08.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.903+0000 7f8bb7362700 1 -- 172.21.15.49:0/2988835949 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8b9c05f270 msgr2=0x7f8b9c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:08.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.903+0000 7f8bb7362700 1 --2- 172.21.15.49:0/2988835949 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8b9c05f270 0x7f8b9c061730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f8ba8001ed0 tx=0x7f8ba8015000).stop 2023-11-30T17:20:08.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.903+0000 7f8bb7362700 1 -- 172.21.15.49:0/2988835949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bb0168270 msgr2=0x7f8bb00aa030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:08.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.903+0000 7f8bb7362700 1 --2- 172.21.15.49:0/2988835949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bb0168270 0x7f8bb00aa030 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f8ba4010980 tx=0x7f8ba4008040).stop 2023-11-30T17:20:08.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.903+0000 7f8bb7362700 1 -- 172.21.15.49:0/2988835949 shutdown_connections 2023-11-30T17:20:08.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.903+0000 7f8bb7362700 1 --2- 172.21.15.49:0/2988835949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bb0062700 0x7f8bb0062b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:08.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.903+0000 7f8bb7362700 1 --2- 172.21.15.49:0/2988835949 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b980038e0 0x7f8bb00bfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:08.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.903+0000 7f8bb7362700 1 --2- 172.21.15.49:0/2988835949 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8b9c05f270 0x7f8b9c061730 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:08.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.903+0000 7f8bb7362700 1 --2- 172.21.15.49:0/2988835949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bb0168270 0x7f8bb00aa030 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:08.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.903+0000 7f8bb7362700 1 -- 172.21.15.49:0/2988835949 >> 172.21.15.49:0/2988835949 conn(0x7f8bb00642d0 msgr2=0x7f8bb014e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:08.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.903+0000 7f8bb7362700 1 -- 172.21.15.49:0/2988835949 shutdown_connections 2023-11-30T17:20:08.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:08.903+0000 7f8bb7362700 1 -- 172.21.15.49:0/2988835949 wait complete. 2023-11-30T17:20:08.922 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-11-30T17:20:09.041 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:09.039+0000 7f445442a680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T17:20:09.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.052+0000 7f6280723700 1 Processor -- start 2023-11-30T17:20:09.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.052+0000 7f6280723700 1 -- start start 2023-11-30T17:20:09.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.053+0000 7f6280723700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6278098d10 0x7f62780c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:09.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.053+0000 7f6280723700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f62780c6190 0x7f6278063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:09.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.053+0000 7f6280723700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62780c72d0 con 0x7f6278064350 2023-11-30T17:20:09.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.053+0000 7f6280723700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6278154bc0 con 0x7f6278098d10 2023-11-30T17:20:09.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.053+0000 7f6280723700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62780c66c0 con 0x7f62780c6190 2023-11-30T17:20:09.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.053+0000 7f627e4bf700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6278098d10 0x7f62780c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:09.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.053+0000 7f627e4bf700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6278098d10 0x7f62780c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35214/0 (socket says 172.21.15.49:35214) 2023-11-30T17:20:09.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.053+0000 7f627ecc0700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6278064350 0x7f6278158320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34872/0 (socket says 172.21.15.49:34872) 2023-11-30T17:20:09.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.053+0000 7f627e4bf700 1 -- 172.21.15.49:0/3935405841 learned_addr learned my addr 172.21.15.49:0/3935405841 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:20:09.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.053+0000 7f627dcbe700 1 --2- 172.21.15.49:0/3935405841 >> v2:172.21.15.115:3300/0 conn(0x7f62780c6190 0x7f6278063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:09.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.054+0000 7f627e4bf700 1 -- 172.21.15.49:0/3935405841 >> v2:172.21.15.115:3300/0 conn(0x7f62780c6190 msgr2=0x7f6278063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:09.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.054+0000 7f627e4bf700 1 --2- 172.21.15.49:0/3935405841 >> v2:172.21.15.115:3300/0 conn(0x7f62780c6190 0x7f6278063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:09.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.054+0000 7f627e4bf700 1 -- 172.21.15.49:0/3935405841 >> v1:172.21.15.49:6789/0 conn(0x7f6278064350 legacy=0x7f6278158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:09.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.054+0000 7f627e4bf700 1 -- 172.21.15.49:0/3935405841 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62780c69a0 con 0x7f6278098d10 2023-11-30T17:20:09.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.054+0000 7f627d4bd700 1 -- 172.21.15.49:0/3935405841 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2762385651 0 0) 0x7f62780c72d0 con 0x7f6278064350 2023-11-30T17:20:09.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.054+0000 7f627e4bf700 1 --2- 172.21.15.49:0/3935405841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6278098d10 0x7f62780c7760 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f62780c5b40 tx=0x7f62680090f0).ready entity=mon.0 client_cookie=311d9983d81da1d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:09.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.054+0000 7f627d4bd700 1 -- 172.21.15.49:0/3935405841 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626800b520 con 0x7f6278098d10 2023-11-30T17:20:09.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.054+0000 7f627d4bd700 1 -- 172.21.15.49:0/3935405841 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626800b680 con 0x7f6278098d10 2023-11-30T17:20:09.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.054+0000 7f627d4bd700 1 -- 172.21.15.49:0/3935405841 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626800ba00 con 0x7f6278098d10 2023-11-30T17:20:09.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.054+0000 7f6280723700 1 -- 172.21.15.49:0/3935405841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6278098d10 msgr2=0x7f62780c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:09.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.054+0000 7f6280723700 1 --2- 172.21.15.49:0/3935405841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6278098d10 0x7f62780c7760 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f62780c5b40 tx=0x7f62680090f0).stop 2023-11-30T17:20:09.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.055+0000 7f6280723700 1 -- 172.21.15.49:0/3935405841 shutdown_connections 2023-11-30T17:20:09.059 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:20:09.055+0000 7f61d5472680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T17:20:09.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.055+0000 7f6280723700 1 --2- 172.21.15.49:0/3935405841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6278098d10 0x7f62780c7760 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:09.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.055+0000 7f6280723700 1 --2- 172.21.15.49:0/3935405841 >> v2:172.21.15.115:3300/0 conn(0x7f62780c6190 0x7f6278063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:09.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.055+0000 7f6280723700 1 -- 172.21.15.49:0/3935405841 >> 172.21.15.49:0/3935405841 conn(0x7f62780cb310 msgr2=0x7f62780cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:09.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.055+0000 7f6280723700 1 -- 172.21.15.49:0/3935405841 shutdown_connections 2023-11-30T17:20:09.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.055+0000 7f6280723700 1 -- 172.21.15.49:0/3935405841 wait complete. 2023-11-30T17:20:09.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.056+0000 7f6280723700 1 Processor -- start 2023-11-30T17:20:09.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.056+0000 7f6280723700 1 -- start start 2023-11-30T17:20:09.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.056+0000 7f6280723700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6278064350 0x7f62780b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:09.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.057+0000 7f6280723700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6278098d10 0x7f62780aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:09.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.057+0000 7f6280723700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62780c6190 0x7f627814c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:09.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.057+0000 7f6280723700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62781557c0 con 0x7f6278064350 2023-11-30T17:20:09.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.057+0000 7f6280723700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6278154e90 con 0x7f62780c6190 2023-11-30T17:20:09.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.057+0000 7f6280723700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6278155170 con 0x7f6278098d10 2023-11-30T17:20:09.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.057+0000 7f627e4bf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6278064350 0x7f62780b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:09.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.057+0000 7f627e4bf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6278064350 0x7f62780b0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35218/0 (socket says 172.21.15.49:35218) 2023-11-30T17:20:09.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.057+0000 7f627e4bf700 1 -- 172.21.15.49:0/2458535633 learned_addr learned my addr 172.21.15.49:0/2458535633 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:20:09.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.057+0000 7f627dcbe700 1 --2- 172.21.15.49:0/2458535633 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6278098d10 0x7f62780aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:09.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.057+0000 7f627ecc0700 1 --2- 172.21.15.49:0/2458535633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62780c6190 0x7f627814c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:09.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.057+0000 7f627e4bf700 1 -- 172.21.15.49:0/2458535633 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6278098d10 msgr2=0x7f62780aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:09.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.057+0000 7f627e4bf700 1 --2- 172.21.15.49:0/2458535633 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6278098d10 0x7f62780aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:09.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.057+0000 7f627e4bf700 1 -- 172.21.15.49:0/2458535633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62780c6190 msgr2=0x7f627814c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:09.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.057+0000 7f627e4bf700 1 --2- 172.21.15.49:0/2458535633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62780c6190 0x7f627814c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:09.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.057+0000 7f627e4bf700 1 -- 172.21.15.49:0/2458535633 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6268009370 con 0x7f6278064350 2023-11-30T17:20:09.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.057+0000 7f627e4bf700 1 --2- 172.21.15.49:0/2458535633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6278064350 0x7f62780b0be0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f6268009130 tx=0x7f6268017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:09.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.057+0000 7f626e7fc700 1 -- 172.21.15.49:0/2458535633 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6268000bc0 con 0x7f6278064350 2023-11-30T17:20:09.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.057+0000 7f626e7fc700 1 -- 172.21.15.49:0/2458535633 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626800b7f0 con 0x7f6278064350 2023-11-30T17:20:09.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.057+0000 7f6280723700 1 -- 172.21.15.49:0/2458535633 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6278155450 con 0x7f6278064350 2023-11-30T17:20:09.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.057+0000 7f626e7fc700 1 -- 172.21.15.49:0/2458535633 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6268000d20 con 0x7f6278064350 2023-11-30T17:20:09.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.057+0000 7f6280723700 1 -- 172.21.15.49:0/2458535633 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62780af380 con 0x7f6278064350 2023-11-30T17:20:09.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.059+0000 7f6280723700 1 -- 172.21.15.49:0/2458535633 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f627806c860 con 0x7f6278064350 2023-11-30T17:20:09.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.059+0000 7f626e7fc700 1 -- 172.21.15.49:0/2458535633 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 15) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f626801c8c0 con 0x7f6278064350 2023-11-30T17:20:09.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.059+0000 7f626e7fc700 1 --2- 172.21.15.49:0/2458535633 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f625c05f290 0x7f625c061750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:09.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.060+0000 7f627dcbe700 1 -- 172.21.15.49:0/2458535633 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f625c05f290 msgr2=0x7f625c061750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:20:09.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.060+0000 7f626e7fc700 1 -- 172.21.15.49:0/2458535633 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f626807c140 con 0x7f6278064350 2023-11-30T17:20:09.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.060+0000 7f627dcbe700 1 --2- 172.21.15.49:0/2458535633 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f625c05f290 0x7f625c061750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:20:09.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.064+0000 7f626e7fc700 1 -- 172.21.15.49:0/2458535633 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f626804d230 con 0x7f6278064350 2023-11-30T17:20:09.105 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:09.103+0000 7f445442a680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T17:20:09.125 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:20:09.123+0000 7f61d5472680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T17:20:09.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.240+0000 7f6280723700 1 -- 172.21.15.49:0/2458535633 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f62780c6c80 con 0x7f6278064350 2023-11-30T17:20:09.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.244+0000 7f626e7fc700 1 -- 172.21.15.49:0/2458535633 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v7)=0 v7) v1 ==== 138+0+0 (secure 0 0 0) 0x7f626802a020 con 0x7f6278064350 2023-11-30T17:20:09.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.246+0000 7f6280723700 1 -- 172.21.15.49:0/2458535633 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f625c05f290 msgr2=0x7f625c061750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:20:09.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.246+0000 7f6280723700 1 --2- 172.21.15.49:0/2458535633 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f625c05f290 0x7f625c061750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:20:09.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.246+0000 7f6280723700 1 -- 172.21.15.49:0/2458535633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6278064350 msgr2=0x7f62780b0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:09.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.246+0000 7f6280723700 1 --2- 172.21.15.49:0/2458535633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6278064350 0x7f62780b0be0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f6268009130 tx=0x7f6268017000).stop 2023-11-30T17:20:09.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.246+0000 7f6280723700 1 -- 172.21.15.49:0/2458535633 shutdown_connections 2023-11-30T17:20:09.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.246+0000 7f6280723700 1 --2- 172.21.15.49:0/2458535633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62780c6190 0x7f627814c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:09.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.246+0000 7f6280723700 1 --2- 172.21.15.49:0/2458535633 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f625c05f290 0x7f625c061750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:20:09.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.247+0000 7f6280723700 1 --2- 172.21.15.49:0/2458535633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6278064350 0x7f62780b0be0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:09.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.247+0000 7f6280723700 1 --2- 172.21.15.49:0/2458535633 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6278098d10 0x7f62780aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:09.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.247+0000 7f6280723700 1 -- 172.21.15.49:0/2458535633 >> 172.21.15.49:0/2458535633 conn(0x7f62780cb310 msgr2=0x7f6278152d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:09.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.247+0000 7f6280723700 1 -- 172.21.15.49:0/2458535633 shutdown_connections 2023-11-30T17:20:09.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.247+0000 7f6280723700 1 -- 172.21.15.49:0/2458535633 wait complete. 2023-11-30T17:20:09.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:09.262 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-11-30T17:20:09.282 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-11-30T17:20:09.379 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:09.377+0000 7f445442a680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T17:20:09.419 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:20:09.416+0000 7f61d5472680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T17:20:09.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.444+0000 7f04d46ca700 1 Processor -- start 2023-11-30T17:20:09.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.444+0000 7f04d46ca700 1 -- start start 2023-11-30T17:20:09.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.445+0000 7f04d46ca700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f04cc14ea80 0x7f04cc14ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:09.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.445+0000 7f04d46ca700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04cc062e80 0x7f04cc0bcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:09.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.445+0000 7f04d46ca700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04cc0bcfb0 con 0x7f04cc0bc660 2023-11-30T17:20:09.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.445+0000 7f04d46ca700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04cc0640f0 con 0x7f04cc14ea80 2023-11-30T17:20:09.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.445+0000 7f04d46ca700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc0634e0 con 0x7f04cc062e80 2023-11-30T17:20:09.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.445+0000 7f04d2466700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f04cc14ea80 0x7f04cc14ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:09.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.445+0000 7f04d1c65700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f04cc0bc660 0x7f04cc062770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:54180/0 (socket says 172.21.15.49:54180) 2023-11-30T17:20:09.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.445+0000 7f04d1c65700 1 -- 172.21.15.49:0/2768116027 learned_addr learned my addr 172.21.15.49:0/2768116027 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:20:09.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.445+0000 7f04d2c67700 1 --2- 172.21.15.49:0/2768116027 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04cc062e80 0x7f04cc0bcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:09.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.445+0000 7f04d2c67700 1 -- 172.21.15.49:0/2768116027 >> v2:172.21.15.115:3300/0 conn(0x7f04cc14ea80 msgr2=0x7f04cc14ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:09.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.445+0000 7f04d2c67700 1 --2- 172.21.15.49:0/2768116027 >> v2:172.21.15.115:3300/0 conn(0x7f04cc14ea80 0x7f04cc14ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:09.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.445+0000 7f04d2c67700 1 -- 172.21.15.49:0/2768116027 >> v1:172.21.15.115:6789/0 conn(0x7f04cc0bc660 legacy=0x7f04cc062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:09.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.445+0000 7f04d2c67700 1 -- 172.21.15.49:0/2768116027 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc0637c0 con 0x7f04cc062e80 2023-11-30T17:20:09.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.445+0000 7f04d1464700 1 -- 172.21.15.49:0/2768116027 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556866595 0 0) 0x7f04cc0bcfb0 con 0x7f04cc0bc660 2023-11-30T17:20:09.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.445+0000 7f04d2466700 1 --2- 172.21.15.49:0/2768116027 >> v2:172.21.15.115:3300/0 conn(0x7f04cc14ea80 0x7f04cc14ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:20:09.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.446+0000 7f04d2c67700 1 --2- 172.21.15.49:0/2768116027 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04cc062e80 0x7f04cc0bcac0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f04c4009e60 tx=0x7f04c4009780).ready entity=mon.2 client_cookie=c588822ef41709b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:09.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.446+0000 7f04d1464700 1 -- 172.21.15.49:0/2768116027 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c400e070 con 0x7f04cc062e80 2023-11-30T17:20:09.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.446+0000 7f04d1464700 1 -- 172.21.15.49:0/2768116027 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c400bb60 con 0x7f04cc062e80 2023-11-30T17:20:09.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.446+0000 7f04d1464700 1 -- 172.21.15.49:0/2768116027 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c4012410 con 0x7f04cc062e80 2023-11-30T17:20:09.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.446+0000 7f04d46ca700 1 -- 172.21.15.49:0/2768116027 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04cc062e80 msgr2=0x7f04cc0bcac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:09.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.446+0000 7f04d46ca700 1 --2- 172.21.15.49:0/2768116027 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04cc062e80 0x7f04cc0bcac0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f04c4009e60 tx=0x7f04c4009780).stop 2023-11-30T17:20:09.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.446+0000 7f04d46ca700 1 -- 172.21.15.49:0/2768116027 shutdown_connections 2023-11-30T17:20:09.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.446+0000 7f04d46ca700 1 --2- 172.21.15.49:0/2768116027 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04cc062e80 0x7f04cc0bcac0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:09.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.446+0000 7f04d46ca700 1 --2- 172.21.15.49:0/2768116027 >> v2:172.21.15.115:3300/0 conn(0x7f04cc14ea80 0x7f04cc14ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:09.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.446+0000 7f04d46ca700 1 -- 172.21.15.49:0/2768116027 >> 172.21.15.49:0/2768116027 conn(0x7f04cc0c8170 msgr2=0x7f04cc0c41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:09.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.446+0000 7f04d46ca700 1 -- 172.21.15.49:0/2768116027 shutdown_connections 2023-11-30T17:20:09.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.446+0000 7f04d46ca700 1 -- 172.21.15.49:0/2768116027 wait complete. 2023-11-30T17:20:09.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.448+0000 7f04d46ca700 1 Processor -- start 2023-11-30T17:20:09.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.448+0000 7f04d46ca700 1 -- start start 2023-11-30T17:20:09.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.448+0000 7f04d46ca700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04cc062e80 0x7f04cc13df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:09.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.448+0000 7f04d46ca700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04cc0bc660 0x7f04cc1363e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:09.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.448+0000 7f04d46ca700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04cc14ea80 0x7f04cc0ac000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:09.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.448+0000 7f04d46ca700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc1368d0 con 0x7f04cc14ea80 2023-11-30T17:20:09.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.448+0000 7f04d46ca700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc0ad0f0 con 0x7f04cc0bc660 2023-11-30T17:20:09.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.448+0000 7f04d46ca700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc0ac850 con 0x7f04cc062e80 2023-11-30T17:20:09.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.449+0000 7f04d2c67700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04cc14ea80 0x7f04cc0ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:09.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.449+0000 7f04d2466700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04cc062e80 0x7f04cc13df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:09.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.449+0000 7f04d2c67700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04cc14ea80 0x7f04cc0ac000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35234/0 (socket says 172.21.15.49:35234) 2023-11-30T17:20:09.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.449+0000 7f04d2c67700 1 -- 172.21.15.49:0/1304729558 learned_addr learned my addr 172.21.15.49:0/1304729558 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:20:09.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.449+0000 7f04d1c65700 1 --2- 172.21.15.49:0/1304729558 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04cc0bc660 0x7f04cc1363e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:09.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.449+0000 7f04d2466700 1 -- 172.21.15.49:0/1304729558 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04cc0bc660 msgr2=0x7f04cc1363e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:09.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.449+0000 7f04d2466700 1 --2- 172.21.15.49:0/1304729558 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04cc0bc660 0x7f04cc1363e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:09.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.449+0000 7f04d2466700 1 -- 172.21.15.49:0/1304729558 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04cc14ea80 msgr2=0x7f04cc0ac000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:09.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.449+0000 7f04d2466700 1 --2- 172.21.15.49:0/1304729558 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04cc14ea80 0x7f04cc0ac000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:09.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.449+0000 7f04d2466700 1 -- 172.21.15.49:0/1304729558 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c80092a0 con 0x7f04cc062e80 2023-11-30T17:20:09.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.449+0000 7f04d2c67700 1 --2- 172.21.15.49:0/1304729558 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04cc14ea80 0x7f04cc0ac000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:20:09.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.449+0000 7f04d2466700 1 --2- 172.21.15.49:0/1304729558 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04cc062e80 0x7f04cc13df40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f04c800e880 tx=0x7f04c8009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:09.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.449+0000 7f04c27fc700 1 -- 172.21.15.49:0/1304729558 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c8012600 con 0x7f04cc062e80 2023-11-30T17:20:09.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.449+0000 7f04c27fc700 1 -- 172.21.15.49:0/1304729558 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c8012760 con 0x7f04cc062e80 2023-11-30T17:20:09.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.449+0000 7f04c27fc700 1 -- 172.21.15.49:0/1304729558 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c8012ae0 con 0x7f04cc062e80 2023-11-30T17:20:09.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.449+0000 7f04d46ca700 1 -- 172.21.15.49:0/1304729558 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c4009a20 con 0x7f04cc062e80 2023-11-30T17:20:09.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.449+0000 7f04d46ca700 1 -- 172.21.15.49:0/1304729558 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04cc0ace10 con 0x7f04cc062e80 2023-11-30T17:20:09.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.450+0000 7f04d46ca700 1 -- 172.21.15.49:0/1304729558 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04cc0bebb0 con 0x7f04cc062e80 2023-11-30T17:20:09.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.451+0000 7f04c27fc700 1 -- 172.21.15.49:0/1304729558 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 15) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f04c801b400 con 0x7f04cc062e80 2023-11-30T17:20:09.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.451+0000 7f04c27fc700 1 --2- 172.21.15.49:0/1304729558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f04b005f2c0 0x7f04b0061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:09.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.452+0000 7f04c27fc700 1 -- 172.21.15.49:0/1304729558 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f04c807a7e0 con 0x7f04cc062e80 2023-11-30T17:20:09.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.452+0000 7f04d1c65700 1 -- 172.21.15.49:0/1304729558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f04b005f2c0 msgr2=0x7f04b0061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:20:09.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.452+0000 7f04d1c65700 1 --2- 172.21.15.49:0/1304729558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f04b005f2c0 0x7f04b0061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:20:09.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.456+0000 7f04c27fc700 1 -- 172.21.15.49:0/1304729558 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f04c804b8d0 con 0x7f04cc062e80 2023-11-30T17:20:09.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.653+0000 7f04d1c65700 1 -- 172.21.15.49:0/1304729558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f04b005f2c0 msgr2=0x7f04b0061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:20:09.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.653+0000 7f04d1c65700 1 --2- 172.21.15.49:0/1304729558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f04b005f2c0 0x7f04b0061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:20:09.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:09.659+0000 7f04d46ca700 1 -- 172.21.15.49:0/1304729558 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f04cc0c8580 con 0x7f04b005f2c0 2023-11-30T17:20:10.001 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:09.991+0000 7f445442a680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T17:20:10.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:10.054+0000 7f04d1c65700 1 -- 172.21.15.49:0/1304729558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f04b005f2c0 msgr2=0x7f04b0061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:20:10.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:10.054+0000 7f04d1c65700 1 --2- 172.21.15.49:0/1304729558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f04b005f2c0 0x7f04b0061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-11-30T17:20:10.064 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:10.063+0000 7f445442a680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T17:20:10.087 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:20:10.085+0000 7f61d5472680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T17:20:10.157 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:20:10.155+0000 7f61d5472680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T17:20:10.251 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:10.249+0000 7f445442a680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T17:20:10.352 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:20:10.349+0000 7f61d5472680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T17:20:10.669 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:10.668+0000 7f445442a680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T17:20:10.773 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:10.772+0000 7f445442a680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:20:10.790 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:20:10.787+0000 7f61d5472680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T17:20:10.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:10.855+0000 7f04d1c65700 1 -- 172.21.15.49:0/1304729558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f04b005f2c0 msgr2=0x7f04b0061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:20:10.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:10.855+0000 7f04d1c65700 1 --2- 172.21.15.49:0/1304729558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f04b005f2c0 0x7f04b0061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-11-30T17:20:10.898 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:20:10.896+0000 7f61d5472680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:20:10.925 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:10.924+0000 7f445442a680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T17:20:11.000 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:10.998+0000 7f445442a680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T17:20:11.056 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:20:11.054+0000 7f61d5472680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T17:20:11.067 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:11.066+0000 7f445442a680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T17:20:11.134 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:20:11.132+0000 7f61d5472680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T17:20:11.204 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:20:11.202+0000 7f61d5472680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T17:20:11.327 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:11.325+0000 7f445442a680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T17:20:11.476 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:20:11.474+0000 7f61d5472680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T17:20:11.513 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:11.511+0000 7f445442a680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T17:20:11.665 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:20:11.663+0000 7f61d5472680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T17:20:12.160 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:12.158+0000 7f445442a680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T17:20:12.228 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:12.226+0000 7f445442a680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T17:20:12.302 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:12.301+0000 7f445442a680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T17:20:12.350 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:20:12.347+0000 7f61d5472680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T17:20:12.420 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:20:12.418+0000 7f61d5472680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T17:20:12.448 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:12.446+0000 7f445442a680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T17:20:12.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:12.456+0000 7f04d1c65700 1 -- 172.21.15.49:0/1304729558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f04b005f2c0 msgr2=0x7f04b0061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:20:12.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:12.456+0000 7f04d1c65700 1 --2- 172.21.15.49:0/1304729558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f04b005f2c0 0x7f04b0061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-11-30T17:20:12.501 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:20:12.498+0000 7f61d5472680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T17:20:12.519 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:12.518+0000 7f445442a680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T17:20:12.633 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:12.631+0000 7f445442a680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T17:20:12.654 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:20:12.652+0000 7f61d5472680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T17:20:12.727 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:20:12.725+0000 7f61d5472680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T17:20:12.739 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:12.738+0000 7f445442a680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:20:12.848 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:20:12.845+0000 7f61d5472680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T17:20:12.962 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:20:12.960+0000 7f61d5472680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:20:13.026 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:13.024+0000 7f445442a680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T17:20:13.096 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:13.094+0000 7f445442a680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T17:20:13.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:13.116+0000 7f04c27fc700 1 -- 172.21.15.49:0/1304729558 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mgrmap(e 16) v1 ==== 75287+0+0 (secure 0 0 0) 0x7f04c8078430 con 0x7f04cc062e80 2023-11-30T17:20:13.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:13.116+0000 7f04c27fc700 1 -- 172.21.15.49:0/1304729558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f04b005f2c0 msgr2=0x7f04b0061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:20:13.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:13.116+0000 7f04c27fc700 1 --2- 172.21.15.49:0/1304729558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f04b005f2c0 0x7f04b0061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:20:13.181 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:13.179+0000 7f43c8bb0700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:20:13.181 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:13.179+0000 7f43c8bb0700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:20:13.181 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:13.179+0000 7f43c8bb0700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:20:13.182 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:13.179+0000 7f43c8bb0700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:20:13.182 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:13.179+0000 7f43c8bb0700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:20:13.182 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:13.180+0000 7f43cabb4700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:20:13.182 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:13.180+0000 7f43cabb4700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:20:13.182 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:13.180+0000 7f43cabb4700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:20:13.182 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:13.180+0000 7f43cabb4700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:20:13.182 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:20:13.180+0000 7f43cabb4700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:20:13.268 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:20:13.265+0000 7f61d5472680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T17:20:13.341 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:20:13.339+0000 7f61d5472680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T17:20:14.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.121+0000 7f04c27fc700 1 -- 172.21.15.49:0/1304729558 <== mon.2 v2:172.21.15.115:3301/0 8 ==== mgrmap(e 17) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f04c80787b0 con 0x7f04cc062e80 2023-11-30T17:20:14.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.122+0000 7f04c27fc700 1 --2- 172.21.15.49:0/1304729558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f04b005f2c0 0x7f04b0061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:14.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.122+0000 7f04c27fc700 1 -- 172.21.15.49:0/1304729558 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f04cc0c8580 con 0x7f04b005f2c0 2023-11-30T17:20:14.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.123+0000 7f04d1c65700 1 --2- 172.21.15.49:0/1304729558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f04b005f2c0 0x7f04b0061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:14.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.124+0000 7f04d1c65700 1 --2- 172.21.15.49:0/1304729558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f04b005f2c0 0x7f04b0061700 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f04cc157bd0 tx=0x7f04bc007bb0).ready entity=mgr.5830 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:14.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.144+0000 7f04c27fc700 1 -- 172.21.15.49:0/1304729558 <== mgr.5830 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f04cc0c8580 con 0x7f04b005f2c0 2023-11-30T17:20:14.146 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule set for path snap_test_dir1 2023-11-30T17:20:14.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.146+0000 7f04d46ca700 1 -- 172.21.15.49:0/1304729558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f04b005f2c0 msgr2=0x7f04b0061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:14.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.146+0000 7f04d46ca700 1 --2- 172.21.15.49:0/1304729558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f04b005f2c0 0x7f04b0061700 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f04cc157bd0 tx=0x7f04bc007bb0).stop 2023-11-30T17:20:14.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.146+0000 7f04d46ca700 1 -- 172.21.15.49:0/1304729558 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04cc062e80 msgr2=0x7f04cc13df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:14.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.146+0000 7f04d46ca700 1 --2- 172.21.15.49:0/1304729558 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04cc062e80 0x7f04cc13df40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f04c800e880 tx=0x7f04c8009060).stop 2023-11-30T17:20:14.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.146+0000 7f04d46ca700 1 -- 172.21.15.49:0/1304729558 shutdown_connections 2023-11-30T17:20:14.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.146+0000 7f04d46ca700 1 --2- 172.21.15.49:0/1304729558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f04b005f2c0 0x7f04b0061700 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:14.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.146+0000 7f04d46ca700 1 --2- 172.21.15.49:0/1304729558 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04cc14ea80 0x7f04cc0ac000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:14.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.146+0000 7f04d46ca700 1 --2- 172.21.15.49:0/1304729558 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04cc062e80 0x7f04cc13df40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:14.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.146+0000 7f04d46ca700 1 --2- 172.21.15.49:0/1304729558 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04cc0bc660 0x7f04cc1363e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:14.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.146+0000 7f04d46ca700 1 -- 172.21.15.49:0/1304729558 >> 172.21.15.49:0/1304729558 conn(0x7f04cc0c8170 msgr2=0x7f04cc0c69e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:14.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.146+0000 7f04d46ca700 1 -- 172.21.15.49:0/1304729558 shutdown_connections 2023-11-30T17:20:14.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.146+0000 7f04d46ca700 1 -- 172.21.15.49:0/1304729558 wait complete. 2023-11-30T17:20:14.162 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-11-30T17:20:14.162 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 2M 2023-11-30T17:20:14.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.288+0000 7f67a1c9c700 1 Processor -- start 2023-11-30T17:20:14.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.288+0000 7f67a1c9c700 1 -- start start 2023-11-30T17:20:14.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.289+0000 7f67a1c9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f679c0aa680 0x7f679c0c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:14.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.289+0000 7f67a1c9c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f679c1546b0 0x7f679c0c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:14.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.289+0000 7f67a1c9c700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f679c158d50 con 0x7f679c1542d0 2023-11-30T17:20:14.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.289+0000 7f67a1c9c700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f679c158140 con 0x7f679c1546b0 2023-11-30T17:20:14.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.289+0000 7f67a1c9c700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f679c158420 con 0x7f679c0aa680 2023-11-30T17:20:14.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.289+0000 7f67a149b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f679c1546b0 0x7f679c0c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:14.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.289+0000 7f67a0c9a700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f679c1542d0 0x7f679c0a9f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46226/0 (socket says 172.21.15.49:46226) 2023-11-30T17:20:14.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.289+0000 7f67a0c9a700 1 -- 172.21.15.49:0/4268996211 learned_addr learned my addr 172.21.15.49:0/4268996211 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:20:14.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.289+0000 7f67a149b700 1 --2- 172.21.15.49:0/4268996211 >> v2:172.21.15.49:3300/0 conn(0x7f679c1546b0 0x7f679c0c64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48564/0 (socket says 172.21.15.49:48564) 2023-11-30T17:20:14.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.289+0000 7f679bfff700 1 --2- 172.21.15.49:0/4268996211 >> v2:172.21.15.115:3300/0 conn(0x7f679c0aa680 0x7f679c0c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:14.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.289+0000 7f67a149b700 1 -- 172.21.15.49:0/4268996211 >> v2:172.21.15.115:3300/0 conn(0x7f679c0aa680 msgr2=0x7f679c0c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:14.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.289+0000 7f67a149b700 1 --2- 172.21.15.49:0/4268996211 >> v2:172.21.15.115:3300/0 conn(0x7f679c0aa680 0x7f679c0c5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:14.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.289+0000 7f67a149b700 1 -- 172.21.15.49:0/4268996211 >> v1:172.21.15.49:6789/0 conn(0x7f679c1542d0 legacy=0x7f679c0a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:14.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.289+0000 7f67a149b700 1 -- 172.21.15.49:0/4268996211 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f679c158700 con 0x7f679c1546b0 2023-11-30T17:20:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.289+0000 7f679b7fe700 1 -- 172.21.15.49:0/4268996211 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3585192248 0 0) 0x7f679c158d50 con 0x7f679c1542d0 2023-11-30T17:20:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.289+0000 7f67a149b700 1 --2- 172.21.15.49:0/4268996211 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f679c1546b0 0x7f679c0c64b0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f679c0add40 tx=0x7f6794009780).ready entity=mon.0 client_cookie=8f146200ca0f013 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.289+0000 7f679b7fe700 1 -- 172.21.15.49:0/4268996211 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679400e070 con 0x7f679c1546b0 2023-11-30T17:20:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.289+0000 7f679b7fe700 1 -- 172.21.15.49:0/4268996211 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679400bb60 con 0x7f679c1546b0 2023-11-30T17:20:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.290+0000 7f679b7fe700 1 -- 172.21.15.49:0/4268996211 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6794012410 con 0x7f679c1546b0 2023-11-30T17:20:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.290+0000 7f67a1c9c700 1 -- 172.21.15.49:0/4268996211 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f679c1546b0 msgr2=0x7f679c0c64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.290+0000 7f67a1c9c700 1 --2- 172.21.15.49:0/4268996211 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f679c1546b0 0x7f679c0c64b0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f679c0add40 tx=0x7f6794009780).stop 2023-11-30T17:20:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.290+0000 7f67a1c9c700 1 -- 172.21.15.49:0/4268996211 shutdown_connections 2023-11-30T17:20:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.290+0000 7f67a1c9c700 1 --2- 172.21.15.49:0/4268996211 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f679c1546b0 0x7f679c0c64b0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.290+0000 7f67a1c9c700 1 --2- 172.21.15.49:0/4268996211 >> v2:172.21.15.115:3300/0 conn(0x7f679c0aa680 0x7f679c0c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.290+0000 7f67a1c9c700 1 -- 172.21.15.49:0/4268996211 >> 172.21.15.49:0/4268996211 conn(0x7f679c0cb010 msgr2=0x7f679c0cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.290+0000 7f67a1c9c700 1 -- 172.21.15.49:0/4268996211 shutdown_connections 2023-11-30T17:20:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.290+0000 7f67a1c9c700 1 -- 172.21.15.49:0/4268996211 wait complete. 2023-11-30T17:20:14.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.291+0000 7f67a1c9c700 1 Processor -- start 2023-11-30T17:20:14.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.291+0000 7f67a1c9c700 1 -- start start 2023-11-30T17:20:14.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.292+0000 7f67a1c9c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f679c0aa680 0x7f679c1571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:14.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.292+0000 7f67a1c9c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f679c1542d0 0x7f679c0c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:14.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.292+0000 7f67a1c9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f679c1546b0 0x7f679c0c4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:14.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.292+0000 7f67a1c9c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679c154ac0 con 0x7f679c0aa680 2023-11-30T17:20:14.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.292+0000 7f67a1c9c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679c155640 con 0x7f679c1546b0 2023-11-30T17:20:14.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.292+0000 7f67a1c9c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679c154d10 con 0x7f679c1542d0 2023-11-30T17:20:14.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.292+0000 7f67a0c9a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f679c0aa680 0x7f679c1571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:14.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.292+0000 7f67a0c9a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f679c0aa680 0x7f679c1571a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48578/0 (socket says 172.21.15.49:48578) 2023-11-30T17:20:14.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.292+0000 7f67a0c9a700 1 -- 172.21.15.49:0/322922510 learned_addr learned my addr 172.21.15.49:0/322922510 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:20:14.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.292+0000 7f67a149b700 1 --2- 172.21.15.49:0/322922510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f679c1546b0 0x7f679c0c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:14.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.292+0000 7f679bfff700 1 --2- 172.21.15.49:0/322922510 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f679c1542d0 0x7f679c0c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:14.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.293+0000 7f67a0c9a700 1 -- 172.21.15.49:0/322922510 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f679c1542d0 msgr2=0x7f679c0c3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:14.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.293+0000 7f67a0c9a700 1 --2- 172.21.15.49:0/322922510 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f679c1542d0 0x7f679c0c3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:14.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.293+0000 7f67a0c9a700 1 -- 172.21.15.49:0/322922510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f679c1546b0 msgr2=0x7f679c0c4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:14.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.293+0000 7f67a0c9a700 1 --2- 172.21.15.49:0/322922510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f679c1546b0 0x7f679c0c4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:14.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.293+0000 7f67a0c9a700 1 -- 172.21.15.49:0/322922510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6794009a20 con 0x7f679c0aa680 2023-11-30T17:20:14.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.293+0000 7f67a149b700 1 --2- 172.21.15.49:0/322922510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f679c1546b0 0x7f679c0c4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:20:14.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.293+0000 7f67a0c9a700 1 --2- 172.21.15.49:0/322922510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f679c0aa680 0x7f679c1571a0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f678c00c510 tx=0x7f678c007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:14.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.293+0000 7f6798ff9700 1 -- 172.21.15.49:0/322922510 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c0072e0 con 0x7f679c0aa680 2023-11-30T17:20:14.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.293+0000 7f6798ff9700 1 -- 172.21.15.49:0/322922510 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678c007440 con 0x7f679c0aa680 2023-11-30T17:20:14.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.293+0000 7f67a1c9c700 1 -- 172.21.15.49:0/322922510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f679c154ff0 con 0x7f679c0aa680 2023-11-30T17:20:14.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.293+0000 7f6798ff9700 1 -- 172.21.15.49:0/322922510 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c0057a0 con 0x7f679c0aa680 2023-11-30T17:20:14.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.293+0000 7f67a1c9c700 1 -- 172.21.15.49:0/322922510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f679c147e90 con 0x7f679c0aa680 2023-11-30T17:20:14.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.294+0000 7f67a1c9c700 1 -- 172.21.15.49:0/322922510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f679c06c7c0 con 0x7f679c0aa680 2023-11-30T17:20:14.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.294+0000 7f6798ff9700 1 -- 172.21.15.49:0/322922510 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f678c005bd0 con 0x7f679c0aa680 2023-11-30T17:20:14.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.294+0000 7f6798ff9700 1 --2- 172.21.15.49:0/322922510 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f678805f080 0x7f6788061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:14.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.295+0000 7f6798ff9700 1 -- 172.21.15.49:0/322922510 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6379+0+0 (secure 0 0 0) 0x7f678c079980 con 0x7f679c0aa680 2023-11-30T17:20:14.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.295+0000 7f679bfff700 1 --2- 172.21.15.49:0/322922510 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f678805f080 0x7f6788061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:14.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.295+0000 7f679bfff700 1 --2- 172.21.15.49:0/322922510 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f678805f080 0x7f6788061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f679c0ad3d0 tx=0x7f6790008040).ready entity=mgr.5830 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:14.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.299+0000 7f6798ff9700 1 -- 172.21.15.49:0/322922510 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f678c04ad20 con 0x7f679c0aa680 2023-11-30T17:20:14.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.496+0000 7f67a1c9c700 1 -- 172.21.15.49:0/322922510 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "2M", "target": ["mon-mgr", ""]}) v1 -- 0x7f679c0b0f10 con 0x7f678805f080 2023-11-30T17:20:14.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.501+0000 7f6798ff9700 1 -- 172.21.15.49:0/322922510 <== mgr.5830 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f679c0b0f10 con 0x7f678805f080 2023-11-30T17:20:14.503 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule set for path snap_test_dir1 2023-11-30T17:20:14.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.503+0000 7f67a1c9c700 1 -- 172.21.15.49:0/322922510 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f678805f080 msgr2=0x7f6788061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:14.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.503+0000 7f67a1c9c700 1 --2- 172.21.15.49:0/322922510 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f678805f080 0x7f6788061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f679c0ad3d0 tx=0x7f6790008040).stop 2023-11-30T17:20:14.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.503+0000 7f67a1c9c700 1 -- 172.21.15.49:0/322922510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f679c0aa680 msgr2=0x7f679c1571a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:14.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.503+0000 7f67a1c9c700 1 --2- 172.21.15.49:0/322922510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f679c0aa680 0x7f679c1571a0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f678c00c510 tx=0x7f678c007c70).stop 2023-11-30T17:20:14.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.503+0000 7f67a1c9c700 1 -- 172.21.15.49:0/322922510 shutdown_connections 2023-11-30T17:20:14.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.503+0000 7f67a1c9c700 1 --2- 172.21.15.49:0/322922510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f679c1546b0 0x7f679c0c4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:14.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.503+0000 7f67a1c9c700 1 --2- 172.21.15.49:0/322922510 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f678805f080 0x7f6788061540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:14.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.503+0000 7f67a1c9c700 1 --2- 172.21.15.49:0/322922510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f679c0aa680 0x7f679c1571a0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:14.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.503+0000 7f67a1c9c700 1 --2- 172.21.15.49:0/322922510 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f679c1542d0 0x7f679c0c3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:14.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.503+0000 7f67a1c9c700 1 -- 172.21.15.49:0/322922510 >> 172.21.15.49:0/322922510 conn(0x7f679c0cb010 msgr2=0x7f679c14fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:14.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.503+0000 7f67a1c9c700 1 -- 172.21.15.49:0/322922510 shutdown_connections 2023-11-30T17:20:14.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.503+0000 7f67a1c9c700 1 -- 172.21.15.49:0/322922510 wait complete. 2023-11-30T17:20:14.516 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-11-30T17:20:14.516 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-11-30-17_21_00 in ~46s... 2023-11-30T17:20:14.516 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-11-30-17_22_00 in ~106s... 2023-11-30T17:20:14.517 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M', '2M'], expected_retention: [] 2023-11-30T17:20:14.517 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-11-30T17:20:14.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.636+0000 7fed284eb700 1 Processor -- start 2023-11-30T17:20:14.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.636+0000 7fed284eb700 1 -- start start 2023-11-30T17:20:14.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.637+0000 7fed284eb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed200ab3b0 0x7fed201582e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:14.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.637+0000 7fed284eb700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fed200aa1c0 0x7fed200aa630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:14.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.637+0000 7fed284eb700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed20159210 con 0x7fed20154610 2023-11-30T17:20:14.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.637+0000 7fed284eb700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed200c0c70 con 0x7fed200aa1c0 2023-11-30T17:20:14.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.637+0000 7fed284eb700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed200c2110 con 0x7fed200ab3b0 2023-11-30T17:20:14.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.637+0000 7fed26a88700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fed200aa1c0 0x7fed200aa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:14.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.637+0000 7fed26a88700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fed200aa1c0 0x7fed200aa630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48588/0 (socket says 172.21.15.49:48588) 2023-11-30T17:20:14.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.637+0000 7fed26a88700 1 -- 172.21.15.49:0/1118794628 learned_addr learned my addr 172.21.15.49:0/1118794628 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:20:14.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.637+0000 7fed25a86700 1 --2- 172.21.15.49:0/1118794628 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed200ab3b0 0x7fed201582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:14.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.637+0000 7fed26a88700 1 -- 172.21.15.49:0/1118794628 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed200ab3b0 msgr2=0x7fed201582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:20:14.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.638+0000 7fed26a88700 1 --2- 172.21.15.49:0/1118794628 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed200ab3b0 0x7fed201582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:14.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.638+0000 7fed26a88700 1 -- 172.21.15.49:0/1118794628 >> v1:172.21.15.115:6789/0 conn(0x7fed20154610 legacy=0x7fed200c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:14.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.638+0000 7fed26a88700 1 -- 172.21.15.49:0/1118794628 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed200aab20 con 0x7fed200aa1c0 2023-11-30T17:20:14.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.638+0000 7fed26a88700 1 --2- 172.21.15.49:0/1118794628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed200aa1c0 0x7fed200aa630 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7fed10009f20 tx=0x7fed10009840).ready entity=mon.0 client_cookie=54f41cd1f9512871 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:14.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.638+0000 7fed25285700 1 -- 172.21.15.49:0/1118794628 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1000e070 con 0x7fed200aa1c0 2023-11-30T17:20:14.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.638+0000 7fed25285700 1 -- 172.21.15.49:0/1118794628 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1000ba80 con 0x7fed200aa1c0 2023-11-30T17:20:14.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.638+0000 7fed25285700 1 -- 172.21.15.49:0/1118794628 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1000be00 con 0x7fed200aa1c0 2023-11-30T17:20:14.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.638+0000 7fed284eb700 1 -- 172.21.15.49:0/1118794628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed200aa1c0 msgr2=0x7fed200aa630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:14.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.638+0000 7fed284eb700 1 --2- 172.21.15.49:0/1118794628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed200aa1c0 0x7fed200aa630 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7fed10009f20 tx=0x7fed10009840).stop 2023-11-30T17:20:14.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.638+0000 7fed284eb700 1 -- 172.21.15.49:0/1118794628 shutdown_connections 2023-11-30T17:20:14.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.638+0000 7fed284eb700 1 --2- 172.21.15.49:0/1118794628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed200aa1c0 0x7fed200aa630 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:14.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.638+0000 7fed284eb700 1 --2- 172.21.15.49:0/1118794628 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed200ab3b0 0x7fed201582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:14.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.638+0000 7fed284eb700 1 -- 172.21.15.49:0/1118794628 >> 172.21.15.49:0/1118794628 conn(0x7fed200655a0 msgr2=0x7fed20069e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:14.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.638+0000 7fed284eb700 1 -- 172.21.15.49:0/1118794628 shutdown_connections 2023-11-30T17:20:14.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.638+0000 7fed284eb700 1 -- 172.21.15.49:0/1118794628 wait complete. 2023-11-30T17:20:14.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.640+0000 7fed284eb700 1 Processor -- start 2023-11-30T17:20:14.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.640+0000 7fed284eb700 1 -- start start 2023-11-30T17:20:14.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.640+0000 7fed284eb700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed200aa1c0 0x7fed20168170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:14.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.640+0000 7fed284eb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed20154610 0x7fed2014c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:14.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.640+0000 7fed284eb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed20168660 0x7fed2014ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:14.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.640+0000 7fed284eb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2014d330 con 0x7fed20154610 2023-11-30T17:20:14.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.640+0000 7fed284eb700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed200ad5f0 con 0x7fed200aa1c0 2023-11-30T17:20:14.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.640+0000 7fed284eb700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed20155940 con 0x7fed20168660 2023-11-30T17:20:14.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.640+0000 7fed25a86700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed20154610 0x7fed2014c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:14.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.640+0000 7fed25a86700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed20154610 0x7fed2014c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48602/0 (socket says 172.21.15.49:48602) 2023-11-30T17:20:14.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.640+0000 7fed25a86700 1 -- 172.21.15.49:0/3300989799 learned_addr learned my addr 172.21.15.49:0/3300989799 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:20:14.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.641+0000 7fed26287700 1 --2- 172.21.15.49:0/3300989799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed200aa1c0 0x7fed20168170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:14.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.641+0000 7fed26a88700 1 --2- 172.21.15.49:0/3300989799 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed20168660 0x7fed2014ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:14.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.641+0000 7fed25a86700 1 -- 172.21.15.49:0/3300989799 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed20168660 msgr2=0x7fed2014ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:14.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.641+0000 7fed25a86700 1 --2- 172.21.15.49:0/3300989799 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed20168660 0x7fed2014ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:14.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.641+0000 7fed25a86700 1 -- 172.21.15.49:0/3300989799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed200aa1c0 msgr2=0x7fed20168170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:14.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.641+0000 7fed25a86700 1 --2- 172.21.15.49:0/3300989799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed200aa1c0 0x7fed20168170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:14.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.641+0000 7fed25a86700 1 -- 172.21.15.49:0/3300989799 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed10009ae0 con 0x7fed20154610 2023-11-30T17:20:14.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.641+0000 7fed25a86700 1 --2- 172.21.15.49:0/3300989799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed20154610 0x7fed2014c950 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7fed1400d890 tx=0x7fed14008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:14.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.641+0000 7fed1e7fc700 1 -- 172.21.15.49:0/3300989799 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1400f520 con 0x7fed20154610 2023-11-30T17:20:14.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.641+0000 7fed1e7fc700 1 -- 172.21.15.49:0/3300989799 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1400f680 con 0x7fed20154610 2023-11-30T17:20:14.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.641+0000 7fed284eb700 1 -- 172.21.15.49:0/3300989799 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed20155c20 con 0x7fed20154610 2023-11-30T17:20:14.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.641+0000 7fed1e7fc700 1 -- 172.21.15.49:0/3300989799 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1400fa00 con 0x7fed20154610 2023-11-30T17:20:14.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.641+0000 7fed284eb700 1 -- 172.21.15.49:0/3300989799 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed200b0e30 con 0x7fed20154610 2023-11-30T17:20:14.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.642+0000 7fed284eb700 1 -- 172.21.15.49:0/3300989799 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed2006c860 con 0x7fed20154610 2023-11-30T17:20:14.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.642+0000 7fed1e7fc700 1 -- 172.21.15.49:0/3300989799 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fed14013480 con 0x7fed20154610 2023-11-30T17:20:14.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.643+0000 7fed1e7fc700 1 --2- 172.21.15.49:0/3300989799 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fed0c05f080 0x7fed0c061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:20:14.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.643+0000 7fed1e7fc700 1 -- 172.21.15.49:0/3300989799 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6379+0+0 (secure 0 0 0) 0x7fed14079ba0 con 0x7fed20154610 2023-11-30T17:20:14.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.643+0000 7fed26287700 1 --2- 172.21.15.49:0/3300989799 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fed0c05f080 0x7fed0c061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:20:14.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.643+0000 7fed26287700 1 --2- 172.21.15.49:0/3300989799 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fed0c05f080 0x7fed0c061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fed18003900 tx=0x7fed18007d40).ready entity=mgr.5830 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:20:14.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.647+0000 7fed1e7fc700 1 -- 172.21.15.49:0/3300989799 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fed1404aee0 con 0x7fed20154610 2023-11-30T17:20:14.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.844+0000 7fed284eb700 1 -- 172.21.15.49:0/3300989799 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fed201557c0 con 0x7fed0c05f080 2023-11-30T17:20:14.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.847+0000 7fed1e7fc700 1 -- 172.21.15.49:0/3300989799 <== mgr.5830 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+76 (secure 0 0 0) 0x7fed18003590 con 0x7fed0c05f080 2023-11-30T17:20:14.849 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:20:14.849 INFO:teuthology.orchestra.run.smithi049.stdout:{"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-11-30T17:20:14.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.849+0000 7fed284eb700 1 -- 172.21.15.49:0/3300989799 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fed0c05f080 msgr2=0x7fed0c061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:14.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.849+0000 7fed284eb700 1 --2- 172.21.15.49:0/3300989799 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fed0c05f080 0x7fed0c061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fed18003900 tx=0x7fed18007d40).stop 2023-11-30T17:20:14.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.849+0000 7fed284eb700 1 -- 172.21.15.49:0/3300989799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed20154610 msgr2=0x7fed2014c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:20:14.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.849+0000 7fed284eb700 1 --2- 172.21.15.49:0/3300989799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed20154610 0x7fed2014c950 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7fed1400d890 tx=0x7fed14008040).stop 2023-11-30T17:20:14.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.849+0000 7fed284eb700 1 -- 172.21.15.49:0/3300989799 shutdown_connections 2023-11-30T17:20:14.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.849+0000 7fed284eb700 1 --2- 172.21.15.49:0/3300989799 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed20168660 0x7fed2014ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:14.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.849+0000 7fed284eb700 1 --2- 172.21.15.49:0/3300989799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed200aa1c0 0x7fed20168170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:14.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.849+0000 7fed284eb700 1 --2- 172.21.15.49:0/3300989799 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fed0c05f080 0x7fed0c061540 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:14.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.849+0000 7fed284eb700 1 --2- 172.21.15.49:0/3300989799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed20154610 0x7fed2014c950 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:20:14.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.849+0000 7fed284eb700 1 -- 172.21.15.49:0/3300989799 >> 172.21.15.49:0/3300989799 conn(0x7fed200655a0 msgr2=0x7fed200ca250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:20:14.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.849+0000 7fed284eb700 1 -- 172.21.15.49:0/3300989799 shutdown_connections 2023-11-30T17:20:14.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:20:14.849+0000 7fed284eb700 1 -- 172.21.15.49:0/3300989799 wait complete. 2023-11-30T17:20:14.862 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-11-30T17:20:14.862 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M', '2M'], 'retention': [{}, {}]} 2023-11-30T17:20:14.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:14.863 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:15.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:15.880 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:16.899 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:16.900 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:17.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:17.919 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:18.940 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:18.940 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:19.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:19.961 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:20.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:20.982 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:21.007 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:20:21.045 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:20:22.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:22.003 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:23.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:23.023 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:24.043 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:24.043 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:25.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:25.063 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:26.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:26.084 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:27.103 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:27.104 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:28.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:28.124 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:29.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:29.146 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:30.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:30.166 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:31.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:31.187 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:32.208 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:32.209 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:33.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:33.230 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:34.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:34.251 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:35.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:35.272 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:36.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:36.293 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:37.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:37.314 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:38.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:38.334 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:39.355 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:39.355 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:40.376 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:40.376 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:41.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:41.397 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:42.417 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:42.417 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:43.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:43.438 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:44.459 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:44.459 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:45.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:45.479 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:46.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:46.499 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:47.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:47.520 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:48.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:48.539 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:49.559 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:49.559 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:50.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:50.581 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:51.123 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:20:51.127 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:20:51.601 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:51.601 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:52.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:52.622 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:53.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:53.642 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:54.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:54.663 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:55.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:55.684 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:56.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:56.705 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:57.725 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:57.726 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:58.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:58.746 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:20:59.766 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:20:59.766 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:00.507 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:21:00.504+0000 7f43bab94700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:21:00.507 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:21:00.504+0000 7f43bab94700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:21:00.507 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:21:00.504+0000 7f43bab94700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:21:00.507 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:21:00.504+0000 7f43bab94700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:21:00.507 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:21:00.504+0000 7f43bab94700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:21:00.787 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:00.787 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:00.807 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:00.807 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-11-30-17_21_00_UTC'] 2023-11-30T17:21:00.807 DEBUG:tasks.cephfs.test_snap_schedules:exec=1701364814.5167687, now = 1701364860.8076942, timo = 46 2023-11-30T17:21:01.808 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:01.808 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:01.828 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:02.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:02.830 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:02.849 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:03.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:03.850 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:03.869 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:04.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:04.872 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:04.892 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:05.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:05.893 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:05.913 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:06.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:06.914 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:06.934 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:07.935 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:07.935 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:07.954 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:08.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:08.956 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:08.976 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:09.977 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:09.977 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:09.997 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:10.997 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:10.998 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:11.017 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:12.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:12.018 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:12.038 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:13.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:13.039 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:13.058 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:14.058 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:14.059 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:14.078 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:15.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:15.079 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:15.098 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:16.100 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:16.100 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:16.120 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:17.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:17.121 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:17.139 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:18.140 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:18.141 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:18.159 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:19.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:19.161 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:19.181 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:20.182 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:20.182 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:20.202 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:21.187 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:21:21.190 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:21:21.203 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:21.203 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:21.250 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:22.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:22.251 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:22.270 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:23.274 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:23.274 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:23.292 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:24.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:24.294 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:24.313 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:25.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:25.315 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:25.335 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:26.336 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:26.336 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:26.356 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:27.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:27.358 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:27.377 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:28.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:28.378 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:28.397 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:29.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:29.399 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:29.418 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:30.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:30.420 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:30.439 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:31.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:31.441 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:31.460 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:32.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:32.462 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:32.480 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:33.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:33.483 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:33.503 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:34.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:34.504 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:34.523 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:35.525 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:35.525 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:35.545 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:36.546 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:36.546 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:36.566 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:37.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:37.567 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:37.586 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:38.588 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:38.588 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:38.608 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:39.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:39.609 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:39.628 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:40.629 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:40.629 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:40.649 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:41.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:41.650 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:41.669 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:42.670 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:42.671 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:42.689 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:43.690 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:43.691 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:43.710 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:44.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:44.711 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:44.730 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:45.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:45.732 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:45.751 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:46.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:46.752 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:46.772 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:47.773 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:47.774 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:47.792 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:48.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:48.796 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:48.815 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:49.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:49.816 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:49.835 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:50.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:50.836 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:50.856 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:51.259 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:21:51.262 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:21:51.857 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:51.857 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:51.877 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:52.878 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:52.878 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:52.898 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:53.899 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:53.899 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:53.919 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:54.920 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:54.920 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:54.940 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:55.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:55.941 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:55.960 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:56.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:56.962 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:56.982 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:57.983 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:57.984 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:58.002 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:21:59.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:21:59.004 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:21:59.024 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:22:00.025 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:22:00.026 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:22:00.045 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:22:01.047 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:22:01.047 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:22:01.067 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:22:01.067 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_22_00_UTC 2023-11-30T17:22:01.067 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-11-30-17_22_00_UTC'] 2023-11-30T17:22:01.067 DEBUG:tasks.cephfs.test_snap_schedules:exec=1701364814.5167687, now = 1701364921.0679016, timo = 106 2023-11-30T17:22:02.068 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-11-30T17:22:02.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.199+0000 7f9ab4ffb700 1 Processor -- start 2023-11-30T17:22:02.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.199+0000 7f9ab4ffb700 1 -- start start 2023-11-30T17:22:02.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.200+0000 7f9ab4ffb700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9ab01373a0 0x7f9ab00c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:02.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.200+0000 7f9ab4ffb700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9ab0064b00 0x7f9ab00c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:02.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.200+0000 7f9ab4ffb700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab00c68d0 con 0x7f9ab00c5f30 2023-11-30T17:22:02.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.200+0000 7f9ab4ffb700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab0158e20 con 0x7f9ab0064b00 2023-11-30T17:22:02.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.200+0000 7f9ab4ffb700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab01582a0 con 0x7f9ab01373a0 2023-11-30T17:22:02.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.201+0000 7f9aaed9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9ab0064b00 0x7f9ab00c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:02.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.201+0000 7f9aaed9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9ab0064b00 0x7f9ab00c63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42332/0 (socket says 172.21.15.49:42332) 2023-11-30T17:22:02.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.201+0000 7f9aaed9d700 1 -- 172.21.15.49:0/4094530102 learned_addr learned my addr 172.21.15.49:0/4094530102 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:02.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.201+0000 7f9aae59c700 1 --2- 172.21.15.49:0/4094530102 >> v2:172.21.15.115:3300/0 conn(0x7f9ab01373a0 0x7f9ab00c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:02.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.201+0000 7f9aaed9d700 1 -- 172.21.15.49:0/4094530102 >> v2:172.21.15.115:3300/0 conn(0x7f9ab01373a0 msgr2=0x7f9ab00c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:02.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.201+0000 7f9aaed9d700 1 --2- 172.21.15.49:0/4094530102 >> v2:172.21.15.115:3300/0 conn(0x7f9ab01373a0 0x7f9ab00c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:02.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.201+0000 7f9aaed9d700 1 -- 172.21.15.49:0/4094530102 >> v1:172.21.15.115:6789/0 conn(0x7f9ab00c5f30 legacy=0x7f9ab00669a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:02.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.201+0000 7f9aaed9d700 1 -- 172.21.15.49:0/4094530102 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab0158580 con 0x7f9ab0064b00 2023-11-30T17:22:02.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.201+0000 7f9aaed9d700 1 --2- 172.21.15.49:0/4094530102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ab0064b00 0x7f9ab00c63e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f9ab00c6ba0 tx=0x7f9aa0009840).ready entity=mon.0 client_cookie=ee74b594a6ab4128 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:02.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.201+0000 7f9aad59a700 1 -- 172.21.15.49:0/4094530102 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa000e070 con 0x7f9ab0064b00 2023-11-30T17:22:02.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.201+0000 7f9aad59a700 1 -- 172.21.15.49:0/4094530102 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa000ba50 con 0x7f9ab0064b00 2023-11-30T17:22:02.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.201+0000 7f9aad59a700 1 -- 172.21.15.49:0/4094530102 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa000bdd0 con 0x7f9ab0064b00 2023-11-30T17:22:02.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.202+0000 7f9ab4ffb700 1 -- 172.21.15.49:0/4094530102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ab0064b00 msgr2=0x7f9ab00c63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:02.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.202+0000 7f9ab4ffb700 1 --2- 172.21.15.49:0/4094530102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ab0064b00 0x7f9ab00c63e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f9ab00c6ba0 tx=0x7f9aa0009840).stop 2023-11-30T17:22:02.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.202+0000 7f9ab4ffb700 1 -- 172.21.15.49:0/4094530102 shutdown_connections 2023-11-30T17:22:02.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.202+0000 7f9ab4ffb700 1 --2- 172.21.15.49:0/4094530102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ab0064b00 0x7f9ab00c63e0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:02.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.202+0000 7f9ab4ffb700 1 --2- 172.21.15.49:0/4094530102 >> v2:172.21.15.115:3300/0 conn(0x7f9ab01373a0 0x7f9ab00c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:02.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.202+0000 7f9ab4ffb700 1 -- 172.21.15.49:0/4094530102 >> 172.21.15.49:0/4094530102 conn(0x7f9ab00628f0 msgr2=0x7f9ab0062d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:02.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.202+0000 7f9ab4ffb700 1 -- 172.21.15.49:0/4094530102 shutdown_connections 2023-11-30T17:22:02.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.202+0000 7f9ab4ffb700 1 -- 172.21.15.49:0/4094530102 wait complete. 2023-11-30T17:22:02.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.203+0000 7f9ab4ffb700 1 Processor -- start 2023-11-30T17:22:02.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.203+0000 7f9ab4ffb700 1 -- start start 2023-11-30T17:22:02.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.204+0000 7f9ab4ffb700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ab0064b00 0x7f9ab0165a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:02.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.204+0000 7f9ab4ffb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ab00c5f30 0x7f9ab00ae720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:02.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.204+0000 7f9ab4ffb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ab01373a0 0x7f9ab00aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:02.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.204+0000 7f9ab4ffb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab00a9ae0 con 0x7f9ab01373a0 2023-11-30T17:22:02.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.204+0000 7f9ab4ffb700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab00aa660 con 0x7f9ab0064b00 2023-11-30T17:22:02.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.204+0000 7f9ab4ffb700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab00a9d30 con 0x7f9ab00c5f30 2023-11-30T17:22:02.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.204+0000 7f9aaed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ab01373a0 0x7f9ab00aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:02.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.204+0000 7f9aaed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ab01373a0 0x7f9ab00aec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42338/0 (socket says 172.21.15.49:42338) 2023-11-30T17:22:02.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.204+0000 7f9aaed9d700 1 -- 172.21.15.49:0/1963078558 learned_addr learned my addr 172.21.15.49:0/1963078558 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:02.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.204+0000 7f9aae59c700 1 --2- 172.21.15.49:0/1963078558 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ab0064b00 0x7f9ab0165a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:02.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.204+0000 7f9aadd9b700 1 --2- 172.21.15.49:0/1963078558 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ab00c5f30 0x7f9ab00ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:02.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.204+0000 7f9aaed9d700 1 -- 172.21.15.49:0/1963078558 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ab00c5f30 msgr2=0x7f9ab00ae720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:02.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.204+0000 7f9aaed9d700 1 --2- 172.21.15.49:0/1963078558 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ab00c5f30 0x7f9ab00ae720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:02.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.204+0000 7f9aaed9d700 1 -- 172.21.15.49:0/1963078558 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ab0064b00 msgr2=0x7f9ab0165a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:02.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.204+0000 7f9aaed9d700 1 --2- 172.21.15.49:0/1963078558 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ab0064b00 0x7f9ab0165a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:02.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.204+0000 7f9aaed9d700 1 -- 172.21.15.49:0/1963078558 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa0009ae0 con 0x7f9ab01373a0 2023-11-30T17:22:02.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.204+0000 7f9aadd9b700 1 --2- 172.21.15.49:0/1963078558 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ab00c5f30 0x7f9ab00ae720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:02.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.204+0000 7f9aaed9d700 1 --2- 172.21.15.49:0/1963078558 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ab01373a0 0x7f9ab00aec10 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f9aa0009fd0 tx=0x7f9aa0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:02.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.205+0000 7f9aa67fc700 1 -- 172.21.15.49:0/1963078558 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0009500 con 0x7f9ab01373a0 2023-11-30T17:22:02.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.205+0000 7f9aa67fc700 1 -- 172.21.15.49:0/1963078558 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa00092e0 con 0x7f9ab01373a0 2023-11-30T17:22:02.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.205+0000 7f9ab4ffb700 1 -- 172.21.15.49:0/1963078558 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab00aa010 con 0x7f9ab01373a0 2023-11-30T17:22:02.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.205+0000 7f9aa67fc700 1 -- 172.21.15.49:0/1963078558 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa001d620 con 0x7f9ab01373a0 2023-11-30T17:22:02.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.205+0000 7f9ab4ffb700 1 -- 172.21.15.49:0/1963078558 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab0168bd0 con 0x7f9ab01373a0 2023-11-30T17:22:02.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.206+0000 7f9ab4ffb700 1 -- 172.21.15.49:0/1963078558 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab006c860 con 0x7f9ab01373a0 2023-11-30T17:22:02.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.206+0000 7f9aa67fc700 1 -- 172.21.15.49:0/1963078558 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 20) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f9aa001da50 con 0x7f9ab01373a0 2023-11-30T17:22:02.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.206+0000 7f9aa67fc700 1 --2- 172.21.15.49:0/1963078558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a9005f2c0 0x7f9a90061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:02.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.207+0000 7f9aa67fc700 1 -- 172.21.15.49:0/1963078558 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6495+0+0 (secure 0 0 0) 0x7f9aa007c150 con 0x7f9ab01373a0 2023-11-30T17:22:02.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.207+0000 7f9aae59c700 1 --2- 172.21.15.49:0/1963078558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a9005f2c0 0x7f9a90061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:02.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.207+0000 7f9aae59c700 1 --2- 172.21.15.49:0/1963078558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a9005f2c0 0x7f9a90061780 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f9ab00ab710 tx=0x7f9aa8008040).ready entity=mgr.5830 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:02.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.211+0000 7f9aa67fc700 1 -- 172.21.15.49:0/1963078558 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9aa004d130 con 0x7f9ab01373a0 2023-11-30T17:22:02.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.412+0000 7f9ab4ffb700 1 -- 172.21.15.49:0/1963078558 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ab0168df0 con 0x7f9a9005f2c0 2023-11-30T17:22:02.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.416+0000 7f9aa67fc700 1 -- 172.21.15.49:0/1963078558 <== mgr.5830 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f9ab0168df0 con 0x7f9a9005f2c0 2023-11-30T17:22:02.418 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule removed for path snap_test_dir1 2023-11-30T17:22:02.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.419+0000 7f9ab4ffb700 1 -- 172.21.15.49:0/1963078558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a9005f2c0 msgr2=0x7f9a90061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:02.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.419+0000 7f9ab4ffb700 1 --2- 172.21.15.49:0/1963078558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a9005f2c0 0x7f9a90061780 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f9ab00ab710 tx=0x7f9aa8008040).stop 2023-11-30T17:22:02.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.419+0000 7f9ab4ffb700 1 -- 172.21.15.49:0/1963078558 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ab01373a0 msgr2=0x7f9ab00aec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:02.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.419+0000 7f9ab4ffb700 1 --2- 172.21.15.49:0/1963078558 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ab01373a0 0x7f9ab00aec10 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f9aa0009fd0 tx=0x7f9aa0009840).stop 2023-11-30T17:22:02.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.419+0000 7f9ab4ffb700 1 -- 172.21.15.49:0/1963078558 shutdown_connections 2023-11-30T17:22:02.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.419+0000 7f9ab4ffb700 1 --2- 172.21.15.49:0/1963078558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a9005f2c0 0x7f9a90061780 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:02.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.419+0000 7f9ab4ffb700 1 --2- 172.21.15.49:0/1963078558 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ab01373a0 0x7f9ab00aec10 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:02.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.419+0000 7f9ab4ffb700 1 --2- 172.21.15.49:0/1963078558 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ab0064b00 0x7f9ab0165a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:02.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.419+0000 7f9ab4ffb700 1 --2- 172.21.15.49:0/1963078558 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ab00c5f30 0x7f9ab00ae720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:02.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.419+0000 7f9ab4ffb700 1 -- 172.21.15.49:0/1963078558 >> 172.21.15.49:0/1963078558 conn(0x7f9ab00628f0 msgr2=0x7f9ab0136540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:02.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.419+0000 7f9ab4ffb700 1 -- 172.21.15.49:0/1963078558 shutdown_connections 2023-11-30T17:22:02.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.419+0000 7f9ab4ffb700 1 -- 172.21.15.49:0/1963078558 wait complete. 2023-11-30T17:22:02.432 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-11-30T17:22:02.432 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:22:02.432 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:22:02.452 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:22:02.452 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_22_00_UTC 2023-11-30T17:22:02.452 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_21_00_UTC 2023-11-30T17:22:02.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:22:02.453 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_21_00_UTC) 2023-11-30T17:22:02.512 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_22_00_UTC 2023-11-30T17:22:02.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:22:02.513 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_22_00_UTC) 2023-11-30T17:22:02.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:22:02.572 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-11-30T17:22:02.630 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-11-30T17:22:02.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.788+0000 7f6e3bf4c700 1 Processor -- start 2023-11-30T17:22:02.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.788+0000 7f6e3bf4c700 1 -- start start 2023-11-30T17:22:02.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.789+0000 7f6e3bf4c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6e340c6190 0x7f6e340c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:02.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.789+0000 7f6e3bf4c700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e340c72d0 con 0x7f6e34098d10 2023-11-30T17:22:02.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.789+0000 7f6e3bf4c700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e34064570 con 0x7f6e34158320 2023-11-30T17:22:02.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.789+0000 7f6e3bf4c700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e34154bc0 con 0x7f6e340c6190 2023-11-30T17:22:02.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.789+0000 7f6e39ce8700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6e34098d10 0x7f6e34063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55204/0 (socket says 172.21.15.49:55204) 2023-11-30T17:22:02.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.789+0000 7f6e39ce8700 1 -- 172.21.15.49:0/659109124 learned_addr learned my addr 172.21.15.49:0/659109124 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:02.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.790+0000 7f6e394e7700 1 --2- 172.21.15.49:0/659109124 >> v2:172.21.15.115:3300/0 conn(0x7f6e340c6190 0x7f6e340c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:02.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.790+0000 7f6e38ce6700 1 -- 172.21.15.49:0/659109124 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2285495145 0 0) 0x7f6e340c72d0 con 0x7f6e34098d10 2023-11-30T17:22:02.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.790+0000 7f6e38ce6700 1 -- 172.21.15.49:0/659109124 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e1c0033f0 con 0x7f6e34098d10 2023-11-30T17:22:02.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.790+0000 7f6e38ce6700 1 -- 172.21.15.49:0/659109124 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 851570777 0 0) 0x7f6e34064570 con 0x7f6e34158320 2023-11-30T17:22:02.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.790+0000 7f6e38ce6700 1 -- 172.21.15.49:0/659109124 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e340c72d0 con 0x7f6e34158320 2023-11-30T17:22:02.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.790+0000 7f6e394e7700 1 -- 172.21.15.49:0/659109124 >> v1:172.21.15.115:6789/0 conn(0x7f6e34158320 legacy=0x7f6e340a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:02.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.790+0000 7f6e394e7700 1 -- 172.21.15.49:0/659109124 >> v1:172.21.15.49:6789/0 conn(0x7f6e34098d10 legacy=0x7f6e34063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:02.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.790+0000 7f6e394e7700 1 -- 172.21.15.49:0/659109124 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e340c66c0 con 0x7f6e340c6190 2023-11-30T17:22:02.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.790+0000 7f6e394e7700 1 --2- 172.21.15.49:0/659109124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e340c6190 0x7f6e340c7760 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f6e28009760 tx=0x7f6e28009060).ready entity=mon.1 client_cookie=24fb4bc7c86ba766 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:02.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.790+0000 7f6e38ce6700 1 -- 172.21.15.49:0/659109124 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2800d4a0 con 0x7f6e340c6190 2023-11-30T17:22:02.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.790+0000 7f6e38ce6700 1 -- 172.21.15.49:0/659109124 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2800d600 con 0x7f6e340c6190 2023-11-30T17:22:02.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.790+0000 7f6e38ce6700 1 -- 172.21.15.49:0/659109124 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2800d980 con 0x7f6e340c6190 2023-11-30T17:22:02.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.791+0000 7f6e3bf4c700 1 -- 172.21.15.49:0/659109124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e340c6190 msgr2=0x7f6e340c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:02.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.791+0000 7f6e3bf4c700 1 --2- 172.21.15.49:0/659109124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e340c6190 0x7f6e340c7760 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f6e28009760 tx=0x7f6e28009060).stop 2023-11-30T17:22:02.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.791+0000 7f6e3bf4c700 1 -- 172.21.15.49:0/659109124 shutdown_connections 2023-11-30T17:22:02.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.791+0000 7f6e3bf4c700 1 --2- 172.21.15.49:0/659109124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e340c6190 0x7f6e340c7760 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:02.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.791+0000 7f6e3bf4c700 1 -- 172.21.15.49:0/659109124 >> 172.21.15.49:0/659109124 conn(0x7f6e340cb310 msgr2=0x7f6e340cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:02.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.791+0000 7f6e3bf4c700 1 -- 172.21.15.49:0/659109124 shutdown_connections 2023-11-30T17:22:02.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.791+0000 7f6e3bf4c700 1 -- 172.21.15.49:0/659109124 wait complete. 2023-11-30T17:22:02.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.792+0000 7f6e3bf4c700 1 Processor -- start 2023-11-30T17:22:02.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.792+0000 7f6e3bf4c700 1 -- start start 2023-11-30T17:22:02.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.793+0000 7f6e3bf4c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e34098d10 0x7f6e340a8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:02.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.793+0000 7f6e3bf4c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e340c6190 0x7f6e340b0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:02.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.793+0000 7f6e3bf4c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e34158320 0x7f6e34153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:02.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.793+0000 7f6e3bf4c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e340aee80 con 0x7f6e340c6190 2023-11-30T17:22:02.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.793+0000 7f6e3bf4c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e340aa370 con 0x7f6e34098d10 2023-11-30T17:22:02.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.793+0000 7f6e3bf4c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e340a92e0 con 0x7f6e34158320 2023-11-30T17:22:02.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.793+0000 7f6e394e7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e340c6190 0x7f6e340b0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:02.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.793+0000 7f6e394e7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e340c6190 0x7f6e340b0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42352/0 (socket says 172.21.15.49:42352) 2023-11-30T17:22:02.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.793+0000 7f6e394e7700 1 -- 172.21.15.49:0/1530015224 learned_addr learned my addr 172.21.15.49:0/1530015224 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:02.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.793+0000 7f6e39ce8700 1 --2- 172.21.15.49:0/1530015224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e34098d10 0x7f6e340a8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:02.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.793+0000 7f6e3a4e9700 1 --2- 172.21.15.49:0/1530015224 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e34158320 0x7f6e34153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:02.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.793+0000 7f6e394e7700 1 -- 172.21.15.49:0/1530015224 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e34158320 msgr2=0x7f6e34153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:02.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.793+0000 7f6e394e7700 1 --2- 172.21.15.49:0/1530015224 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e34158320 0x7f6e34153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:02.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.793+0000 7f6e394e7700 1 -- 172.21.15.49:0/1530015224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e34098d10 msgr2=0x7f6e340a8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:02.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.793+0000 7f6e394e7700 1 --2- 172.21.15.49:0/1530015224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e34098d10 0x7f6e340a8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:02.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.793+0000 7f6e394e7700 1 -- 172.21.15.49:0/1530015224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e280092a0 con 0x7f6e340c6190 2023-11-30T17:22:02.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.793+0000 7f6e394e7700 1 --2- 172.21.15.49:0/1530015224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e340c6190 0x7f6e340b0de0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f6e28010000 tx=0x7f6e28016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:02.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.794+0000 7f6e31ffb700 1 -- 172.21.15.49:0/1530015224 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e28021070 con 0x7f6e340c6190 2023-11-30T17:22:02.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.794+0000 7f6e31ffb700 1 -- 172.21.15.49:0/1530015224 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2800dcf0 con 0x7f6e340c6190 2023-11-30T17:22:02.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.794+0000 7f6e3bf4c700 1 -- 172.21.15.49:0/1530015224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e341568d0 con 0x7f6e340c6190 2023-11-30T17:22:02.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.794+0000 7f6e31ffb700 1 -- 172.21.15.49:0/1530015224 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2800d980 con 0x7f6e340c6190 2023-11-30T17:22:02.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.794+0000 7f6e3bf4c700 1 -- 172.21.15.49:0/1530015224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e34156e90 con 0x7f6e340c6190 2023-11-30T17:22:02.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.795+0000 7f6e3bf4c700 1 -- 172.21.15.49:0/1530015224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e340af010 con 0x7f6e340c6190 2023-11-30T17:22:02.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.795+0000 7f6e31ffb700 1 -- 172.21.15.49:0/1530015224 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 20) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f6e2801d640 con 0x7f6e340c6190 2023-11-30T17:22:02.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.795+0000 7f6e31ffb700 1 --2- 172.21.15.49:0/1530015224 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6e2005f2c0 0x7f6e20061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:02.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.796+0000 7f6e31ffb700 1 -- 172.21.15.49:0/1530015224 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6495+0+0 (secure 0 0 0) 0x7f6e2807b9e0 con 0x7f6e340c6190 2023-11-30T17:22:02.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.796+0000 7f6e39ce8700 1 --2- 172.21.15.49:0/1530015224 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6e2005f2c0 0x7f6e20061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:02.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.796+0000 7f6e39ce8700 1 --2- 172.21.15.49:0/1530015224 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6e2005f2c0 0x7f6e20061780 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f6e24005750 tx=0x7f6e24009040).ready entity=mgr.5830 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:02.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:02.800+0000 7f6e31ffb700 1 -- 172.21.15.49:0/1530015224 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6e340af010 con 0x7f6e340c6190 2023-11-30T17:22:03.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:03.020+0000 7f6e3bf4c700 1 -- 172.21.15.49:0/1530015224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f6e340af010 con 0x7f6e340c6190 2023-11-30T17:22:03.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:03.967+0000 7f6e31ffb700 1 -- 172.21.15.49:0/1530015224 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f6e2807bd50 con 0x7f6e340c6190 2023-11-30T17:22:03.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:03.969+0000 7f6e31ffb700 1 -- 172.21.15.49:0/1530015224 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v21) v1 ==== 93+0+0 (secure 0 0 0) 0x7f6e280427b0 con 0x7f6e340c6190 2023-11-30T17:22:03.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:03.971+0000 7f6e3bf4c700 1 -- 172.21.15.49:0/1530015224 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6e2005f2c0 msgr2=0x7f6e20061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:03.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:03.971+0000 7f6e3bf4c700 1 --2- 172.21.15.49:0/1530015224 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6e2005f2c0 0x7f6e20061780 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f6e24005750 tx=0x7f6e24009040).stop 2023-11-30T17:22:03.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:03.971+0000 7f6e3bf4c700 1 -- 172.21.15.49:0/1530015224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e340c6190 msgr2=0x7f6e340b0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:03.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:03.971+0000 7f6e3bf4c700 1 --2- 172.21.15.49:0/1530015224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e340c6190 0x7f6e340b0de0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f6e28010000 tx=0x7f6e28016000).stop 2023-11-30T17:22:03.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:03.972+0000 7f6e3bf4c700 1 -- 172.21.15.49:0/1530015224 shutdown_connections 2023-11-30T17:22:03.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:03.972+0000 7f6e3bf4c700 1 --2- 172.21.15.49:0/1530015224 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e34158320 0x7f6e34153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:03.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:03.972+0000 7f6e3bf4c700 1 --2- 172.21.15.49:0/1530015224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e34098d10 0x7f6e340a8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:03.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:03.972+0000 7f6e3bf4c700 1 --2- 172.21.15.49:0/1530015224 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6e2005f2c0 0x7f6e20061780 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:03.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:03.972+0000 7f6e3bf4c700 1 --2- 172.21.15.49:0/1530015224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e340c6190 0x7f6e340b0de0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:03.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:03.972+0000 7f6e3bf4c700 1 -- 172.21.15.49:0/1530015224 >> 172.21.15.49:0/1530015224 conn(0x7f6e340cb310 msgr2=0x7f6e340c7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:03.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:03.972+0000 7f6e3bf4c700 1 -- 172.21.15.49:0/1530015224 shutdown_connections 2023-11-30T17:22:03.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:03.972+0000 7f6e3bf4c700 1 -- 172.21.15.49:0/1530015224 wait complete. 2023-11-30T17:22:03.989 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-30T17:22:03.989 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T17:22:04.035 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T17:22:04.076 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-30T17:22:04.076 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-30T17:22:04.076 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:22:04.076 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-30T17:22:04.119 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:04.118+0000 7f0c99c3d680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T17:22:04.120 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-11-30T17:22:04.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:22:04.120 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-30T17:22:04.128 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:04.126+0000 7fa027b86680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T17:22:04.143 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:22:04.183 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:04.182+0000 7f0c99c3d680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T17:22:04.195 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:04.194+0000 7fa027b86680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T17:22:04.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.303+0000 7f0dedff7700 1 Processor -- start 2023-11-30T17:22:04.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.303+0000 7f0dedff7700 1 -- start start 2023-11-30T17:22:04.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.304+0000 7f0dedff7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0de806b510 0x7f0de81546f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:04.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.304+0000 7f0dedff7700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de8063380 con 0x7f0de80c10f0 2023-11-30T17:22:04.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.304+0000 7f0dedff7700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de8062770 con 0x7f0de80c0d10 2023-11-30T17:22:04.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.304+0000 7f0dedff7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de80c19e0 con 0x7f0de806b510 2023-11-30T17:22:04.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.304+0000 7f0de7fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0de80c10f0 0x7f0de80c2ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55214/0 (socket says 172.21.15.49:55214) 2023-11-30T17:22:04.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.304+0000 7f0de7fff700 1 -- 172.21.15.49:0/28783766 learned_addr learned my addr 172.21.15.49:0/28783766 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:04.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.304+0000 7f0de6ffd700 1 --2- 172.21.15.49:0/28783766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0de806b510 0x7f0de81546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:04.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.304+0000 7f0de67fc700 1 -- 172.21.15.49:0/28783766 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2457848006 0 0) 0x7f0de8063380 con 0x7f0de80c10f0 2023-11-30T17:22:04.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.304+0000 7f0de67fc700 1 -- 172.21.15.49:0/28783766 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dd00033f0 con 0x7f0de80c10f0 2023-11-30T17:22:04.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.304+0000 7f0de67fc700 1 -- 172.21.15.49:0/28783766 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3972237843 0 0) 0x7f0de8062770 con 0x7f0de80c0d10 2023-11-30T17:22:04.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.304+0000 7f0de67fc700 1 -- 172.21.15.49:0/28783766 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0de8063380 con 0x7f0de80c0d10 2023-11-30T17:22:04.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.304+0000 7f0de6ffd700 1 -- 172.21.15.49:0/28783766 >> v1:172.21.15.115:6789/0 conn(0x7f0de80c0d10 legacy=0x7f0de8153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:04.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.304+0000 7f0de6ffd700 1 -- 172.21.15.49:0/28783766 >> v1:172.21.15.49:6789/0 conn(0x7f0de80c10f0 legacy=0x7f0de80c2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:04.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.304+0000 7f0de67fc700 1 -- 172.21.15.49:0/28783766 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1203400699 0 0) 0x7f0dd00033f0 con 0x7f0de80c10f0 2023-11-30T17:22:04.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.304+0000 7f0de6ffd700 1 -- 172.21.15.49:0/28783766 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de8062a50 con 0x7f0de806b510 2023-11-30T17:22:04.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.305+0000 7f0de6ffd700 1 --2- 172.21.15.49:0/28783766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0de806b510 0x7f0de81546f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f0ddc009790 tx=0x7f0ddc009060).ready entity=mon.2 client_cookie=c8cffc257a2971d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:04.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.305+0000 7f0de67fc700 1 -- 172.21.15.49:0/28783766 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de00017f0 con 0x7f0de806b510 2023-11-30T17:22:04.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.305+0000 7f0de67fc700 1 -- 172.21.15.49:0/28783766 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ddc011400 con 0x7f0de806b510 2023-11-30T17:22:04.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.305+0000 7f0de67fc700 1 -- 172.21.15.49:0/28783766 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc011780 con 0x7f0de806b510 2023-11-30T17:22:04.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.305+0000 7f0dedff7700 1 -- 172.21.15.49:0/28783766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0de806b510 msgr2=0x7f0de81546f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:04.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.305+0000 7f0dedff7700 1 --2- 172.21.15.49:0/28783766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0de806b510 0x7f0de81546f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f0ddc009790 tx=0x7f0ddc009060).stop 2023-11-30T17:22:04.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.305+0000 7f0dedff7700 1 -- 172.21.15.49:0/28783766 shutdown_connections 2023-11-30T17:22:04.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.305+0000 7f0dedff7700 1 --2- 172.21.15.49:0/28783766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0de806b510 0x7f0de81546f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:04.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.305+0000 7f0dedff7700 1 -- 172.21.15.49:0/28783766 >> 172.21.15.49:0/28783766 conn(0x7f0de80c7760 msgr2=0x7f0de80c7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:04.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.305+0000 7f0dedff7700 1 -- 172.21.15.49:0/28783766 shutdown_connections 2023-11-30T17:22:04.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.305+0000 7f0dedff7700 1 -- 172.21.15.49:0/28783766 wait complete. 2023-11-30T17:22:04.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.307+0000 7f0dedff7700 1 Processor -- start 2023-11-30T17:22:04.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.307+0000 7f0dedff7700 1 -- start start 2023-11-30T17:22:04.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.307+0000 7f0dedff7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0de806b510 0x7f0de816ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:04.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.307+0000 7f0dedff7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0de80c0d10 0x7f0de8169f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:04.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.307+0000 7f0dedff7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0de80c10f0 0x7f0de816a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:04.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.307+0000 7f0dedff7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de816b5d0 con 0x7f0de80c10f0 2023-11-30T17:22:04.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.307+0000 7f0dedff7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de816a9c0 con 0x7f0de80c0d10 2023-11-30T17:22:04.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.307+0000 7f0dedff7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de816aca0 con 0x7f0de806b510 2023-11-30T17:22:04.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.308+0000 7f0de7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0de80c10f0 0x7f0de816a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:04.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.308+0000 7f0de7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0de80c10f0 0x7f0de816a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42374/0 (socket says 172.21.15.49:42374) 2023-11-30T17:22:04.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.308+0000 7f0de7fff700 1 -- 172.21.15.49:0/2060612039 learned_addr learned my addr 172.21.15.49:0/2060612039 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:04.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.308+0000 7f0de6ffd700 1 --2- 172.21.15.49:0/2060612039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0de80c0d10 0x7f0de8169f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:04.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.308+0000 7f0de77fe700 1 --2- 172.21.15.49:0/2060612039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0de806b510 0x7f0de816ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:04.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.308+0000 7f0de7fff700 1 -- 172.21.15.49:0/2060612039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0de806b510 msgr2=0x7f0de816ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:04.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.308+0000 7f0de7fff700 1 --2- 172.21.15.49:0/2060612039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0de806b510 0x7f0de816ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:04.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.308+0000 7f0de7fff700 1 -- 172.21.15.49:0/2060612039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0de80c0d10 msgr2=0x7f0de8169f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:04.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.308+0000 7f0de7fff700 1 --2- 172.21.15.49:0/2060612039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0de80c0d10 0x7f0de8169f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:04.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.308+0000 7f0de7fff700 1 -- 172.21.15.49:0/2060612039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ddc0092a0 con 0x7f0de80c10f0 2023-11-30T17:22:04.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.308+0000 7f0de7fff700 1 --2- 172.21.15.49:0/2060612039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0de80c10f0 0x7f0de816a430 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f0de000cb70 tx=0x7f0de0007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:04.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.308+0000 7f0dcf7fe700 1 -- 172.21.15.49:0/2060612039 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de0004c40 con 0x7f0de80c10f0 2023-11-30T17:22:04.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.308+0000 7f0dcf7fe700 1 -- 172.21.15.49:0/2060612039 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de0004da0 con 0x7f0de80c10f0 2023-11-30T17:22:04.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.308+0000 7f0dedff7700 1 -- 172.21.15.49:0/2060612039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de816af80 con 0x7f0de80c10f0 2023-11-30T17:22:04.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.308+0000 7f0dcf7fe700 1 -- 172.21.15.49:0/2060612039 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de0007380 con 0x7f0de80c10f0 2023-11-30T17:22:04.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.308+0000 7f0dedff7700 1 -- 172.21.15.49:0/2060612039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de8154df0 con 0x7f0de80c10f0 2023-11-30T17:22:04.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.309+0000 7f0dedff7700 1 -- 172.21.15.49:0/2060612039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de806c860 con 0x7f0de80c10f0 2023-11-30T17:22:04.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.310+0000 7f0dcf7fe700 1 -- 172.21.15.49:0/2060612039 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f0de0007770 con 0x7f0de80c10f0 2023-11-30T17:22:04.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.310+0000 7f0dcf7fe700 1 --2- 172.21.15.49:0/2060612039 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0dd405f270 0x7f0dd4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:04.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.310+0000 7f0dcf7fe700 1 -- 172.21.15.49:0/2060612039 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6495+0+0 (secure 0 0 0) 0x7f0de007a290 con 0x7f0de80c10f0 2023-11-30T17:22:04.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.310+0000 7f0de77fe700 1 -- 172.21.15.49:0/2060612039 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0dd405f270 msgr2=0x7f0dd4061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:04.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.310+0000 7f0de77fe700 1 --2- 172.21.15.49:0/2060612039 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0dd405f270 0x7f0dd4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:22:04.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.314+0000 7f0dcf7fe700 1 -- 172.21.15.49:0/2060612039 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0de004b270 con 0x7f0de80c10f0 2023-11-30T17:22:04.456 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:04.455+0000 7f0c99c3d680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T17:22:04.488 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:04.487+0000 7fa027b86680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T17:22:04.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.511+0000 7f0de77fe700 1 -- 172.21.15.49:0/2060612039 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0dd405f270 msgr2=0x7f0dd4061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:04.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.511+0000 7f0de77fe700 1 --2- 172.21.15.49:0/2060612039 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0dd405f270 0x7f0dd4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:22:04.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.536+0000 7f0dedff7700 1 -- 172.21.15.49:0/2060612039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0de816b710 con 0x7f0de80c10f0 2023-11-30T17:22:04.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.537+0000 7f0dcf7fe700 1 -- 172.21.15.49:0/2060612039 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4495 (secure 0 0 0) 0x7f0de004e890 con 0x7f0de80c10f0 2023-11-30T17:22:04.538 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:04.538 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1605498959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1605498959},{"type":"v1","addr":"172.21.15.115:6836","nonce":1605498959}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1471786970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1471786970},{"type":"v1","addr":"172.21.15.115:6837","nonce":1471786970}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5763,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1757467688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1757467688},{"type":"v1","addr":"172.21.15.49:6834","nonce":1757467688}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:19:56.468670+0000","modified":"2023-11-30T17:19:59.475872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5766},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5766":{"gid":5766,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2424233798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2424233798},{"type":"v1","addr":"172.21.15.49:6835","nonce":2424233798}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-11-30T17:22:04.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.539+0000 7f0dedff7700 1 -- 172.21.15.49:0/2060612039 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0dd405f270 msgr2=0x7f0dd4061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:22:04.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.539+0000 7f0dedff7700 1 --2- 172.21.15.49:0/2060612039 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0dd405f270 0x7f0dd4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:04.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.539+0000 7f0dedff7700 1 -- 172.21.15.49:0/2060612039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0de80c10f0 msgr2=0x7f0de816a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:04.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.539+0000 7f0dedff7700 1 --2- 172.21.15.49:0/2060612039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0de80c10f0 0x7f0de816a430 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f0de000cb70 tx=0x7f0de0007bd0).stop 2023-11-30T17:22:04.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.539+0000 7f0dedff7700 1 -- 172.21.15.49:0/2060612039 shutdown_connections 2023-11-30T17:22:04.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.539+0000 7f0dedff7700 1 --2- 172.21.15.49:0/2060612039 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0dd405f270 0x7f0dd4061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:04.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.539+0000 7f0dedff7700 1 --2- 172.21.15.49:0/2060612039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0de80c10f0 0x7f0de816a430 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:04.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.539+0000 7f0dedff7700 1 --2- 172.21.15.49:0/2060612039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0de806b510 0x7f0de816ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:04.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.539+0000 7f0dedff7700 1 --2- 172.21.15.49:0/2060612039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0de80c0d10 0x7f0de8169f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:04.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.539+0000 7f0dedff7700 1 -- 172.21.15.49:0/2060612039 >> 172.21.15.49:0/2060612039 conn(0x7f0de80c7760 msgr2=0x7f0de8149550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:04.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.539+0000 7f0dedff7700 1 -- 172.21.15.49:0/2060612039 shutdown_connections 2023-11-30T17:22:04.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.539+0000 7f0dedff7700 1 -- 172.21.15.49:0/2060612039 wait complete. 2023-11-30T17:22:04.542 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 24 2023-11-30T17:22:04.553 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:22:04.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.710+0000 7ff60a6a6700 1 Processor -- start 2023-11-30T17:22:04.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.710+0000 7ff60a6a6700 1 -- start start 2023-11-30T17:22:04.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.711+0000 7ff60a6a6700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff6041544e0 0x7ff6041548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:04.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.711+0000 7ff60a6a6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff6040c6e30 0x7ff6040c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:04.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.711+0000 7ff60a6a6700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6040c69a0 con 0x7ff60406a610 2023-11-30T17:22:04.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.711+0000 7ff60a6a6700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6040c13a0 con 0x7ff6040c6e30 2023-11-30T17:22:04.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.711+0000 7ff60a6a6700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6040c1680 con 0x7ff6041544e0 2023-11-30T17:22:04.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.711+0000 7ff608c43700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff6040c6e30 0x7ff6040c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:04.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.711+0000 7ff608c43700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff6040c6e30 0x7ff6040c72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42388/0 (socket says 172.21.15.49:42388) 2023-11-30T17:22:04.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.711+0000 7ff608c43700 1 -- 172.21.15.49:0/4243618382 learned_addr learned my addr 172.21.15.49:0/4243618382 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:04.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.711+0000 7ff6037fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff60406a610 0x7ff6040c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55216/0 (socket says 172.21.15.49:55216) 2023-11-30T17:22:04.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.712+0000 7ff603fff700 1 --2- 172.21.15.49:0/4243618382 >> v2:172.21.15.115:3300/0 conn(0x7ff6041544e0 0x7ff6041548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:04.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.712+0000 7ff608c43700 1 -- 172.21.15.49:0/4243618382 >> v2:172.21.15.115:3300/0 conn(0x7ff6041544e0 msgr2=0x7ff6041548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:04.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.712+0000 7ff608c43700 1 --2- 172.21.15.49:0/4243618382 >> v2:172.21.15.115:3300/0 conn(0x7ff6041544e0 0x7ff6041548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:04.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.712+0000 7ff608c43700 1 -- 172.21.15.49:0/4243618382 >> v1:172.21.15.49:6789/0 conn(0x7ff60406a610 legacy=0x7ff6040c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:04.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.712+0000 7ff608c43700 1 -- 172.21.15.49:0/4243618382 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6040c6630 con 0x7ff6040c6e30 2023-11-30T17:22:04.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.712+0000 7ff602ffd700 1 -- 172.21.15.49:0/4243618382 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767837400 0 0) 0x7ff6040c69a0 con 0x7ff60406a610 2023-11-30T17:22:04.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.712+0000 7ff608c43700 1 --2- 172.21.15.49:0/4243618382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6040c6e30 0x7ff6040c72a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7ff604085760 tx=0x7ff5fc009840).ready entity=mon.0 client_cookie=93036af03eb85d5d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:04.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.712+0000 7ff602ffd700 1 -- 172.21.15.49:0/4243618382 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc00e070 con 0x7ff6040c6e30 2023-11-30T17:22:04.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.712+0000 7ff602ffd700 1 -- 172.21.15.49:0/4243618382 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5fc00ba20 con 0x7ff6040c6e30 2023-11-30T17:22:04.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.712+0000 7ff602ffd700 1 -- 172.21.15.49:0/4243618382 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc00bda0 con 0x7ff6040c6e30 2023-11-30T17:22:04.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.713+0000 7ff60a6a6700 1 -- 172.21.15.49:0/4243618382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6040c6e30 msgr2=0x7ff6040c72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:04.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.713+0000 7ff60a6a6700 1 --2- 172.21.15.49:0/4243618382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6040c6e30 0x7ff6040c72a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7ff604085760 tx=0x7ff5fc009840).stop 2023-11-30T17:22:04.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.713+0000 7ff60a6a6700 1 -- 172.21.15.49:0/4243618382 shutdown_connections 2023-11-30T17:22:04.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.713+0000 7ff60a6a6700 1 --2- 172.21.15.49:0/4243618382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6040c6e30 0x7ff6040c72a0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:04.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.713+0000 7ff60a6a6700 1 --2- 172.21.15.49:0/4243618382 >> v2:172.21.15.115:3300/0 conn(0x7ff6041544e0 0x7ff6041548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:04.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.713+0000 7ff60a6a6700 1 -- 172.21.15.49:0/4243618382 >> 172.21.15.49:0/4243618382 conn(0x7ff604085020 msgr2=0x7ff604094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:04.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.713+0000 7ff60a6a6700 1 -- 172.21.15.49:0/4243618382 shutdown_connections 2023-11-30T17:22:04.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.713+0000 7ff60a6a6700 1 -- 172.21.15.49:0/4243618382 wait complete. 2023-11-30T17:22:04.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.714+0000 7ff60a6a6700 1 Processor -- start 2023-11-30T17:22:04.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.714+0000 7ff60a6a6700 1 -- start start 2023-11-30T17:22:04.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.715+0000 7ff60a6a6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff60406a610 0x7ff6040962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:04.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.715+0000 7ff60a6a6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6040c6e30 0x7ff6040967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:04.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.715+0000 7ff60a6a6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6041544e0 0x7ff604097be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:04.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.715+0000 7ff60a6a6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6041539e0 con 0x7ff6040c6e30 2023-11-30T17:22:04.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.715+0000 7ff60a6a6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6040a86b0 con 0x7ff60406a610 2023-11-30T17:22:04.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.715+0000 7ff60a6a6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6040ab230 con 0x7ff6041544e0 2023-11-30T17:22:04.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.715+0000 7ff6037fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6040c6e30 0x7ff6040967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:04.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.715+0000 7ff603fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff60406a610 0x7ff6040962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:04.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.715+0000 7ff6037fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6040c6e30 0x7ff6040967d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42396/0 (socket says 172.21.15.49:42396) 2023-11-30T17:22:04.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.715+0000 7ff6037fe700 1 -- 172.21.15.49:0/3300810418 learned_addr learned my addr 172.21.15.49:0/3300810418 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:04.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.715+0000 7ff608c43700 1 --2- 172.21.15.49:0/3300810418 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6041544e0 0x7ff604097be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:04.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.715+0000 7ff608c43700 1 -- 172.21.15.49:0/3300810418 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff60406a610 msgr2=0x7ff6040962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:04.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.715+0000 7ff608c43700 1 --2- 172.21.15.49:0/3300810418 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff60406a610 0x7ff6040962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:04.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.715+0000 7ff608c43700 1 -- 172.21.15.49:0/3300810418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6040c6e30 msgr2=0x7ff6040967d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:04.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.715+0000 7ff608c43700 1 --2- 172.21.15.49:0/3300810418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6040c6e30 0x7ff6040967d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:04.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.715+0000 7ff608c43700 1 -- 172.21.15.49:0/3300810418 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5fc009ae0 con 0x7ff6041544e0 2023-11-30T17:22:04.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.715+0000 7ff6037fe700 1 --2- 172.21.15.49:0/3300810418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6040c6e30 0x7ff6040967d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:22:04.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.715+0000 7ff603fff700 1 --2- 172.21.15.49:0/3300810418 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff60406a610 0x7ff6040962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:22:04.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.715+0000 7ff608c43700 1 --2- 172.21.15.49:0/3300810418 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6041544e0 0x7ff604097be0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7ff604084fb0 tx=0x7ff5fc009840).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:04.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.716+0000 7ff5ebfff700 1 -- 172.21.15.49:0/3300810418 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc00bda0 con 0x7ff6041544e0 2023-11-30T17:22:04.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.716+0000 7ff5ebfff700 1 -- 172.21.15.49:0/3300810418 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5fc0092e0 con 0x7ff6041544e0 2023-11-30T17:22:04.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.716+0000 7ff5ebfff700 1 -- 172.21.15.49:0/3300810418 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc01d6b0 con 0x7ff6041544e0 2023-11-30T17:22:04.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.716+0000 7ff60a6a6700 1 -- 172.21.15.49:0/3300810418 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6040a80a0 con 0x7ff6041544e0 2023-11-30T17:22:04.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.716+0000 7ff60a6a6700 1 -- 172.21.15.49:0/3300810418 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff604096f70 con 0x7ff6041544e0 2023-11-30T17:22:04.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.717+0000 7ff5ebfff700 1 -- 172.21.15.49:0/3300810418 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7ff5fc003040 con 0x7ff6041544e0 2023-11-30T17:22:04.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.717+0000 7ff60a6a6700 1 -- 172.21.15.49:0/3300810418 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6040a8860 con 0x7ff6041544e0 2023-11-30T17:22:04.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.717+0000 7ff5ebfff700 1 --2- 172.21.15.49:0/3300810418 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff5f005f270 0x7ff5f0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:04.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.717+0000 7ff603fff700 1 -- 172.21.15.49:0/3300810418 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff5f005f270 msgr2=0x7ff5f0061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:04.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.717+0000 7ff5ebfff700 1 -- 172.21.15.49:0/3300810418 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6495+0+0 (secure 0 0 0) 0x7ff5fc07b5b0 con 0x7ff6041544e0 2023-11-30T17:22:04.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.717+0000 7ff603fff700 1 --2- 172.21.15.49:0/3300810418 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff5f005f270 0x7ff5f0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:22:04.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.722+0000 7ff5ebfff700 1 -- 172.21.15.49:0/3300810418 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff6040a8860 con 0x7ff6041544e0 2023-11-30T17:22:04.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.897+0000 7ff60a6a6700 1 -- 172.21.15.49:0/3300810418 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6040a8860 con 0x7ff6041544e0 2023-11-30T17:22:04.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.898+0000 7ff5ebfff700 1 -- 172.21.15.49:0/3300810418 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+17488 (secure 0 0 0) 0x7ff6040a8860 con 0x7ff6041544e0 2023-11-30T17:22:04.900 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:04.900 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":68,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:21:14.909891+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:19:54.153609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-30T17:19:55.451988+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.16","mappings":[{"from":0,"to":5}]},{"pgid":"7.2c","mappings":[{"from":0,"to":4}]},{"pgid":"8.c","mappings":[{"from":0,"to":6}]},{"pgid":"8.38","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/352667093":"2023-12-01T17:20:13.108922+0000","172.21.15.115:6832/89956":"2023-12-01T17:20:13.108922+0000","172.21.15.115:0/975065917":"2023-12-01T17:20:13.108922+0000","172.21.15.115:0/2727001384":"2023-12-01T17:20:13.108922+0000","172.21.15.115:6833/89956":"2023-12-01T17:20:13.108922+0000","172.21.15.115:0/4139500051":"2023-12-01T17:20:13.108922+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:22:04.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.900+0000 7ff60a6a6700 1 -- 172.21.15.49:0/3300810418 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff5f005f270 msgr2=0x7ff5f0061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:22:04.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.900+0000 7ff60a6a6700 1 --2- 172.21.15.49:0/3300810418 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff5f005f270 0x7ff5f0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:04.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.900+0000 7ff60a6a6700 1 -- 172.21.15.49:0/3300810418 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6041544e0 msgr2=0x7ff604097be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:04.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.900+0000 7ff60a6a6700 1 --2- 172.21.15.49:0/3300810418 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6041544e0 0x7ff604097be0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7ff604084fb0 tx=0x7ff5fc009840).stop 2023-11-30T17:22:04.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.900+0000 7ff60a6a6700 1 -- 172.21.15.49:0/3300810418 shutdown_connections 2023-11-30T17:22:04.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.900+0000 7ff60a6a6700 1 --2- 172.21.15.49:0/3300810418 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6041544e0 0x7ff604097be0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:04.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.900+0000 7ff60a6a6700 1 --2- 172.21.15.49:0/3300810418 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff60406a610 0x7ff6040962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:04.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.900+0000 7ff60a6a6700 1 --2- 172.21.15.49:0/3300810418 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff5f005f270 0x7ff5f0061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:04.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.900+0000 7ff60a6a6700 1 --2- 172.21.15.49:0/3300810418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6040c6e30 0x7ff6040967d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:04.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.900+0000 7ff60a6a6700 1 -- 172.21.15.49:0/3300810418 >> 172.21.15.49:0/3300810418 conn(0x7ff604085020 msgr2=0x7ff604064630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:04.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.900+0000 7ff60a6a6700 1 -- 172.21.15.49:0/3300810418 shutdown_connections 2023-11-30T17:22:04.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:04.900+0000 7ff60a6a6700 1 -- 172.21.15.49:0/3300810418 wait complete. 2023-11-30T17:22:04.915 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-30T17:19:54.153609+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-11-30T17:19:55.451988+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-30T17:22:04.915 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T17:22:05.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.038+0000 7eff8619d700 1 Processor -- start 2023-11-30T17:22:05.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.039+0000 7eff8619d700 1 -- start start 2023-11-30T17:22:05.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.039+0000 7eff8619d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7eff80098d10 0x7eff800c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:05.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.039+0000 7eff8619d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff80158320 0x7eff801587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:05.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.039+0000 7eff8619d700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff80158cc0 con 0x7eff800c6190 2023-11-30T17:22:05.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.039+0000 7eff8619d700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff800c72d0 con 0x7eff80098d10 2023-11-30T17:22:05.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.039+0000 7eff8619d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff80064570 con 0x7eff80158320 2023-11-30T17:22:05.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.040+0000 7eff7f7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7eff80098d10 0x7eff800c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:05.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.040+0000 7eff7f7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7eff80098d10 0x7eff800c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42402/0 (socket says 172.21.15.49:42402) 2023-11-30T17:22:05.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.040+0000 7eff7effd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7eff800c6190 0x7eff80063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55218/0 (socket says 172.21.15.49:55218) 2023-11-30T17:22:05.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.040+0000 7eff7f7fe700 1 -- 172.21.15.49:0/345029846 learned_addr learned my addr 172.21.15.49:0/345029846 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:05.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.040+0000 7eff7ffff700 1 --2- 172.21.15.49:0/345029846 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff80158320 0x7eff801587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:05.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.040+0000 7eff7f7fe700 1 -- 172.21.15.49:0/345029846 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff80158320 msgr2=0x7eff801587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:05.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.040+0000 7eff7f7fe700 1 --2- 172.21.15.49:0/345029846 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff80158320 0x7eff801587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:05.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.040+0000 7eff7f7fe700 1 -- 172.21.15.49:0/345029846 >> v1:172.21.15.49:6789/0 conn(0x7eff800c6190 legacy=0x7eff80063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:05.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.040+0000 7eff7e7fc700 1 -- 172.21.15.49:0/345029846 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2398371180 0 0) 0x7eff74001110 con 0x7eff800c6190 2023-11-30T17:22:05.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.040+0000 7eff7f7fe700 1 -- 172.21.15.49:0/345029846 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff80154bc0 con 0x7eff80098d10 2023-11-30T17:22:05.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.040+0000 7eff7f7fe700 1 --2- 172.21.15.49:0/345029846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff80098d10 0x7eff800c7760 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7eff70006fd0 tx=0x7eff700090f0).ready entity=mon.0 client_cookie=a48682fee3eccf04 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:05.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.040+0000 7eff7e7fc700 1 -- 172.21.15.49:0/345029846 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7000b600 con 0x7eff80098d10 2023-11-30T17:22:05.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.040+0000 7eff7e7fc700 1 -- 172.21.15.49:0/345029846 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7000b760 con 0x7eff80098d10 2023-11-30T17:22:05.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.040+0000 7eff7e7fc700 1 -- 172.21.15.49:0/345029846 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7000bae0 con 0x7eff80098d10 2023-11-30T17:22:05.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.041+0000 7eff8619d700 1 -- 172.21.15.49:0/345029846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff80098d10 msgr2=0x7eff800c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:05.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.041+0000 7eff8619d700 1 --2- 172.21.15.49:0/345029846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff80098d10 0x7eff800c7760 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7eff70006fd0 tx=0x7eff700090f0).stop 2023-11-30T17:22:05.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.041+0000 7eff8619d700 1 -- 172.21.15.49:0/345029846 shutdown_connections 2023-11-30T17:22:05.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.041+0000 7eff8619d700 1 --2- 172.21.15.49:0/345029846 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff80158320 0x7eff801587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:05.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.041+0000 7eff8619d700 1 --2- 172.21.15.49:0/345029846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff80098d10 0x7eff800c7760 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:05.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.041+0000 7eff8619d700 1 -- 172.21.15.49:0/345029846 >> 172.21.15.49:0/345029846 conn(0x7eff800cb310 msgr2=0x7eff800cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:05.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.041+0000 7eff8619d700 1 -- 172.21.15.49:0/345029846 shutdown_connections 2023-11-30T17:22:05.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.041+0000 7eff8619d700 1 -- 172.21.15.49:0/345029846 wait complete. 2023-11-30T17:22:05.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.042+0000 7eff8619d700 1 Processor -- start 2023-11-30T17:22:05.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.042+0000 7eff8619d700 1 -- start start 2023-11-30T17:22:05.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.043+0000 7eff8619d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff80098d10 0x7eff801571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:05.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.043+0000 7eff8619d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff800c6190 0x7eff800ad3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:05.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.043+0000 7eff8619d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff80158320 0x7eff8014b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:05.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.043+0000 7eff8619d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff80156d40 con 0x7eff800c6190 2023-11-30T17:22:05.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.043+0000 7eff8619d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff800b13f0 con 0x7eff80098d10 2023-11-30T17:22:05.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.043+0000 7eff8619d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff80156410 con 0x7eff80158320 2023-11-30T17:22:05.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.043+0000 7eff7effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff800c6190 0x7eff800ad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:05.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.043+0000 7eff7effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff800c6190 0x7eff800ad3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42406/0 (socket says 172.21.15.49:42406) 2023-11-30T17:22:05.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.043+0000 7eff7ffff700 1 --2- 172.21.15.49:0/2607753814 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff80158320 0x7eff8014b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.043+0000 7eff7effd700 1 -- 172.21.15.49:0/2607753814 learned_addr learned my addr 172.21.15.49:0/2607753814 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.043+0000 7eff7f7fe700 1 --2- 172.21.15.49:0/2607753814 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff80098d10 0x7eff801571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.043+0000 7eff7effd700 1 -- 172.21.15.49:0/2607753814 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff80158320 msgr2=0x7eff8014b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.043+0000 7eff7effd700 1 --2- 172.21.15.49:0/2607753814 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff80158320 0x7eff8014b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.043+0000 7eff7effd700 1 -- 172.21.15.49:0/2607753814 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff80098d10 msgr2=0x7eff801571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.044+0000 7eff7effd700 1 --2- 172.21.15.49:0/2607753814 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff80098d10 0x7eff801571d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.044+0000 7eff7effd700 1 -- 172.21.15.49:0/2607753814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff70009370 con 0x7eff800c6190 2023-11-30T17:22:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.044+0000 7eff7effd700 1 --2- 172.21.15.49:0/2607753814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff800c6190 0x7eff800ad3f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7eff7400c4f0 tx=0x7eff74007ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.044+0000 7eff677fe700 1 -- 172.21.15.49:0/2607753814 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7400ce60 con 0x7eff800c6190 2023-11-30T17:22:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.044+0000 7eff677fe700 1 -- 172.21.15.49:0/2607753814 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff740072e0 con 0x7eff800c6190 2023-11-30T17:22:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.044+0000 7eff8619d700 1 -- 172.21.15.49:0/2607753814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff801566f0 con 0x7eff800c6190 2023-11-30T17:22:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.044+0000 7eff677fe700 1 -- 172.21.15.49:0/2607753814 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff740056e0 con 0x7eff800c6190 2023-11-30T17:22:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.044+0000 7eff8619d700 1 -- 172.21.15.49:0/2607753814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff800adc60 con 0x7eff800c6190 2023-11-30T17:22:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.045+0000 7eff8619d700 1 -- 172.21.15.49:0/2607753814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff80156eb0 con 0x7eff800c6190 2023-11-30T17:22:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.046+0000 7eff677fe700 1 -- 172.21.15.49:0/2607753814 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7eff74005a90 con 0x7eff800c6190 2023-11-30T17:22:05.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.046+0000 7eff677fe700 1 --2- 172.21.15.49:0/2607753814 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7eff6c05f270 0x7eff6c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:05.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.046+0000 7eff7f7fe700 1 -- 172.21.15.49:0/2607753814 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7eff6c05f270 msgr2=0x7eff6c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:05.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.046+0000 7eff677fe700 1 -- 172.21.15.49:0/2607753814 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6495+0+0 (secure 0 0 0) 0x7eff74079990 con 0x7eff800c6190 2023-11-30T17:22:05.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.046+0000 7eff7f7fe700 1 --2- 172.21.15.49:0/2607753814 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7eff6c05f270 0x7eff6c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:22:05.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.051+0000 7eff677fe700 1 -- 172.21.15.49:0/2607753814 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7eff7404a910 con 0x7eff800c6190 2023-11-30T17:22:05.073 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:05.072+0000 7f0c99c3d680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T17:22:05.145 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:05.144+0000 7f0c99c3d680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T17:22:05.159 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:05.157+0000 7fa027b86680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T17:22:05.229 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:05.227+0000 7fa027b86680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T17:22:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.247+0000 7eff7f7fe700 1 -- 172.21.15.49:0/2607753814 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7eff6c05f270 msgr2=0x7eff6c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.247+0000 7eff7f7fe700 1 --2- 172.21.15.49:0/2607753814 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7eff6c05f270 0x7eff6c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:22:05.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.270+0000 7eff8619d700 1 -- 172.21.15.49:0/2607753814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7eff80158cc0 con 0x7eff800c6190 2023-11-30T17:22:05.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.270+0000 7eff677fe700 1 -- 172.21.15.49:0/2607753814 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v68) v1 ==== 110+0+10 (secure 0 0 0) 0x7eff80158cc0 con 0x7eff800c6190 2023-11-30T17:22:05.272 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T17:22:05.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.272+0000 7eff8619d700 1 -- 172.21.15.49:0/2607753814 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7eff6c05f270 msgr2=0x7eff6c061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:22:05.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.272+0000 7eff8619d700 1 --2- 172.21.15.49:0/2607753814 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7eff6c05f270 0x7eff6c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:05.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.272+0000 7eff8619d700 1 -- 172.21.15.49:0/2607753814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff800c6190 msgr2=0x7eff800ad3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:05.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.272+0000 7eff8619d700 1 --2- 172.21.15.49:0/2607753814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff800c6190 0x7eff800ad3f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7eff7400c4f0 tx=0x7eff74007ab0).stop 2023-11-30T17:22:05.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.272+0000 7eff8619d700 1 -- 172.21.15.49:0/2607753814 shutdown_connections 2023-11-30T17:22:05.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.272+0000 7eff8619d700 1 --2- 172.21.15.49:0/2607753814 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff80158320 0x7eff8014b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:05.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.272+0000 7eff8619d700 1 --2- 172.21.15.49:0/2607753814 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff80098d10 0x7eff801571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:05.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.272+0000 7eff8619d700 1 --2- 172.21.15.49:0/2607753814 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7eff6c05f270 0x7eff6c061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:05.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.272+0000 7eff8619d700 1 --2- 172.21.15.49:0/2607753814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff800c6190 0x7eff800ad3f0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:05.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.272+0000 7eff8619d700 1 -- 172.21.15.49:0/2607753814 >> 172.21.15.49:0/2607753814 conn(0x7eff800cb310 msgr2=0x7eff8014c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:05.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.272+0000 7eff8619d700 1 -- 172.21.15.49:0/2607753814 shutdown_connections 2023-11-30T17:22:05.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.273+0000 7eff8619d700 1 -- 172.21.15.49:0/2607753814 wait complete. 2023-11-30T17:22:05.288 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T17:22:05.330 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:05.328+0000 7f0c99c3d680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T17:22:05.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.409+0000 7f094cf75700 1 Processor -- start 2023-11-30T17:22:05.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.409+0000 7f094cf75700 1 -- start start 2023-11-30T17:22:05.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.410+0000 7f094cf75700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f09480c86f0 0x7f09480a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:05.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.411+0000 7f094cf75700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09480c7e30 con 0x7f0948062700 2023-11-30T17:22:05.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.411+0000 7f094cf75700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09480bcf40 con 0x7f09481547f0 2023-11-30T17:22:05.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.411+0000 7f094cf75700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09480c6b20 con 0x7f09480c86f0 2023-11-30T17:22:05.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.411+0000 7f0945d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f09480c86f0 0x7f09480a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:05.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.411+0000 7f0946d9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0948062700 0x7f09480a4db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55232/0 (socket says 172.21.15.49:55232) 2023-11-30T17:22:05.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.411+0000 7f0946d9d700 1 -- 172.21.15.49:0/3104525242 learned_addr learned my addr 172.21.15.49:0/3104525242 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:05.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.411+0000 7f0945d9b700 1 -- 172.21.15.49:0/3104525242 >> v1:172.21.15.115:6789/0 conn(0x7f09481547f0 legacy=0x7f09480c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:05.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.411+0000 7f0945d9b700 1 -- 172.21.15.49:0/3104525242 >> v1:172.21.15.49:6789/0 conn(0x7f0948062700 legacy=0x7f09480a4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:05.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.411+0000 7f094559a700 1 -- 172.21.15.49:0/3104525242 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195649013 0 0) 0x7f09480bcf40 con 0x7f09481547f0 2023-11-30T17:22:05.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.411+0000 7f0945d9b700 1 -- 172.21.15.49:0/3104525242 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09480a77d0 con 0x7f09480c86f0 2023-11-30T17:22:05.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.411+0000 7f0945d9b700 1 --2- 172.21.15.49:0/3104525242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09480c86f0 0x7f09480a72e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f0938009760 tx=0x7f0938009060).ready entity=mon.0 client_cookie=651dd6d17f8efd06 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:05.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.411+0000 7f094559a700 1 -- 172.21.15.49:0/3104525242 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09380090d0 con 0x7f09480c86f0 2023-11-30T17:22:05.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.411+0000 7f094559a700 1 -- 172.21.15.49:0/3104525242 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093800f510 con 0x7f09480c86f0 2023-11-30T17:22:05.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.411+0000 7f094559a700 1 -- 172.21.15.49:0/3104525242 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093800f890 con 0x7f09480c86f0 2023-11-30T17:22:05.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.412+0000 7f094cf75700 1 -- 172.21.15.49:0/3104525242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09480c86f0 msgr2=0x7f09480a72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:05.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.412+0000 7f094cf75700 1 --2- 172.21.15.49:0/3104525242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09480c86f0 0x7f09480a72e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f0938009760 tx=0x7f0938009060).stop 2023-11-30T17:22:05.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.412+0000 7f094cf75700 1 -- 172.21.15.49:0/3104525242 shutdown_connections 2023-11-30T17:22:05.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.412+0000 7f094cf75700 1 --2- 172.21.15.49:0/3104525242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09480c86f0 0x7f09480a72e0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:05.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.412+0000 7f094cf75700 1 -- 172.21.15.49:0/3104525242 >> 172.21.15.49:0/3104525242 conn(0x7f09480642d0 msgr2=0x7f09480c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:05.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.412+0000 7f094cf75700 1 -- 172.21.15.49:0/3104525242 shutdown_connections 2023-11-30T17:22:05.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.412+0000 7f094cf75700 1 -- 172.21.15.49:0/3104525242 wait complete. 2023-11-30T17:22:05.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.413+0000 7f094cf75700 1 Processor -- start 2023-11-30T17:22:05.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.413+0000 7f094cf75700 1 -- start start 2023-11-30T17:22:05.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.414+0000 7f094cf75700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0948062700 0x7f09480a9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:05.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.414+0000 7f094cf75700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09480c86f0 0x7f09480bf120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:05.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.414+0000 7f094cf75700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09481547f0 0x7f09481507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:05.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.414+0000 7f094cf75700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09480a9570 con 0x7f0948062700 2023-11-30T17:22:05.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.414+0000 7f094cf75700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09480bf610 con 0x7f09480c86f0 2023-11-30T17:22:05.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.414+0000 7f094cf75700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09480c0430 con 0x7f09481547f0 2023-11-30T17:22:05.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.414+0000 7f094659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0948062700 0x7f09480a9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:05.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.414+0000 7f094659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0948062700 0x7f09480a9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42414/0 (socket says 172.21.15.49:42414) 2023-11-30T17:22:05.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.414+0000 7f094659c700 1 -- 172.21.15.49:0/880347325 learned_addr learned my addr 172.21.15.49:0/880347325 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:05.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.414+0000 7f0945d9b700 1 --2- 172.21.15.49:0/880347325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09480c86f0 0x7f09480bf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:05.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.414+0000 7f0946d9d700 1 --2- 172.21.15.49:0/880347325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09481547f0 0x7f09481507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:05.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.414+0000 7f094659c700 1 -- 172.21.15.49:0/880347325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09481547f0 msgr2=0x7f09481507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:05.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.414+0000 7f094659c700 1 --2- 172.21.15.49:0/880347325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09481547f0 0x7f09481507a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:05.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.414+0000 7f094659c700 1 -- 172.21.15.49:0/880347325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09480c86f0 msgr2=0x7f09480bf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:05.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.414+0000 7f094659c700 1 --2- 172.21.15.49:0/880347325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09480c86f0 0x7f09480bf120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:05.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.414+0000 7f094659c700 1 -- 172.21.15.49:0/880347325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09380092a0 con 0x7f0948062700 2023-11-30T17:22:05.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.415+0000 7f094659c700 1 --2- 172.21.15.49:0/880347325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0948062700 0x7f09480a9080 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f0930001eb0 tx=0x7f0930007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:05.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.415+0000 7f093e7fc700 1 -- 172.21.15.49:0/880347325 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093000ce60 con 0x7f0948062700 2023-11-30T17:22:05.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.415+0000 7f093e7fc700 1 -- 172.21.15.49:0/880347325 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093000f470 con 0x7f0948062700 2023-11-30T17:22:05.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.415+0000 7f094cf75700 1 -- 172.21.15.49:0/880347325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09480bf820 con 0x7f0948062700 2023-11-30T17:22:05.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.415+0000 7f093e7fc700 1 -- 172.21.15.49:0/880347325 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093000f810 con 0x7f0948062700 2023-11-30T17:22:05.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.415+0000 7f094cf75700 1 -- 172.21.15.49:0/880347325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09480c00c0 con 0x7f0948062700 2023-11-30T17:22:05.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.416+0000 7f094cf75700 1 -- 172.21.15.49:0/880347325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09480c0710 con 0x7f0948062700 2023-11-30T17:22:05.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.416+0000 7f093e7fc700 1 -- 172.21.15.49:0/880347325 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f093000fb80 con 0x7f0948062700 2023-11-30T17:22:05.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.417+0000 7f093e7fc700 1 --2- 172.21.15.49:0/880347325 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f092805f270 0x7f0928061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:05.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.417+0000 7f093e7fc700 1 -- 172.21.15.49:0/880347325 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6495+0+0 (secure 0 0 0) 0x7f093007a000 con 0x7f0948062700 2023-11-30T17:22:05.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.417+0000 7f0945d9b700 1 -- 172.21.15.49:0/880347325 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f092805f270 msgr2=0x7f0928061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:05.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.417+0000 7f0945d9b700 1 --2- 172.21.15.49:0/880347325 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f092805f270 0x7f0928061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:22:05.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.420+0000 7f093e7fc700 1 -- 172.21.15.49:0/880347325 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f093004b0a0 con 0x7f0948062700 2023-11-30T17:22:05.426 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:05.425+0000 7fa027b86680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T17:22:05.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.594+0000 7f094cf75700 1 -- 172.21.15.49:0/880347325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f094806c860 con 0x7f0948062700 2023-11-30T17:22:05.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.595+0000 7f093e7fc700 1 -- 172.21.15.49:0/880347325 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v68) v1 ==== 92+0+10 (secure 0 0 0) 0x7f093004e6c0 con 0x7f0948062700 2023-11-30T17:22:05.596 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T17:22:05.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.597+0000 7f094cf75700 1 -- 172.21.15.49:0/880347325 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f092805f270 msgr2=0x7f0928061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:22:05.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.597+0000 7f094cf75700 1 --2- 172.21.15.49:0/880347325 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f092805f270 0x7f0928061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:05.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.597+0000 7f094cf75700 1 -- 172.21.15.49:0/880347325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0948062700 msgr2=0x7f09480a9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:05.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.597+0000 7f094cf75700 1 --2- 172.21.15.49:0/880347325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0948062700 0x7f09480a9080 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f0930001eb0 tx=0x7f0930007c70).stop 2023-11-30T17:22:05.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.597+0000 7f094cf75700 1 -- 172.21.15.49:0/880347325 shutdown_connections 2023-11-30T17:22:05.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.597+0000 7f094cf75700 1 --2- 172.21.15.49:0/880347325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09481547f0 0x7f09481507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:05.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.597+0000 7f094cf75700 1 --2- 172.21.15.49:0/880347325 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f092805f270 0x7f0928061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:05.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.597+0000 7f094cf75700 1 --2- 172.21.15.49:0/880347325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0948062700 0x7f09480a9080 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:05.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.597+0000 7f094cf75700 1 --2- 172.21.15.49:0/880347325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09480c86f0 0x7f09480bf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:05.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.597+0000 7f094cf75700 1 -- 172.21.15.49:0/880347325 >> 172.21.15.49:0/880347325 conn(0x7f09480642d0 msgr2=0x7f09480661e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:05.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.597+0000 7f094cf75700 1 -- 172.21.15.49:0/880347325 shutdown_connections 2023-11-30T17:22:05.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.597+0000 7f094cf75700 1 -- 172.21.15.49:0/880347325 wait complete. 2023-11-30T17:22:05.610 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-30T17:22:05.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.733+0000 7f959ada4700 1 Processor -- start 2023-11-30T17:22:05.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.733+0000 7f959ada4700 1 -- start start 2023-11-30T17:22:05.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.734+0000 7f959ada4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9594150930 0x7f95940c6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:05.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.734+0000 7f959ada4700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f95940bcfa0 0x7f95940bd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:05.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.734+0000 7f959ada4700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9594062910 con 0x7f9594150d10 2023-11-30T17:22:05.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.734+0000 7f959ada4700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95940c2460 con 0x7f95940bcfa0 2023-11-30T17:22:05.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.734+0000 7f959ada4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95940bd920 con 0x7f9594150930 2023-11-30T17:22:05.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.734+0000 7f9598b40700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9594150930 0x7f95940c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:05.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.734+0000 7f9599341700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f95940bcfa0 0x7f95940bd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:05.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.734+0000 7f9593fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f9594150d10 0x7f95940a6ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:59226/0 (socket says 172.21.15.49:59226) 2023-11-30T17:22:05.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.734+0000 7f9593fff700 1 -- 172.21.15.49:0/832350420 learned_addr learned my addr 172.21.15.49:0/832350420 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:05.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.734+0000 7f95937fe700 1 -- 172.21.15.49:0/832350420 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1200161094 0 0) 0x7f9594062910 con 0x7f9594150d10 2023-11-30T17:22:05.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.734+0000 7f95937fe700 1 -- 172.21.15.49:0/832350420 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95840033f0 con 0x7f9594150d10 2023-11-30T17:22:05.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.735+0000 7f9599341700 1 -- 172.21.15.49:0/832350420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9594150930 msgr2=0x7f95940c6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:05.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.735+0000 7f9599341700 1 --2- 172.21.15.49:0/832350420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9594150930 0x7f95940c6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:05.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.735+0000 7f9599341700 1 -- 172.21.15.49:0/832350420 >> v1:172.21.15.115:6789/0 conn(0x7f9594150d10 legacy=0x7f95940a6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:05.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.735+0000 7f9599341700 1 -- 172.21.15.49:0/832350420 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95940c6c00 con 0x7f95940bcfa0 2023-11-30T17:22:05.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.735+0000 7f9598b40700 1 --2- 172.21.15.49:0/832350420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9594150930 0x7f95940c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:22:05.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.735+0000 7f9599341700 1 --2- 172.21.15.49:0/832350420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95940bcfa0 0x7f95940bd430 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f958c00af70 tx=0x7f958c00a890).ready entity=mon.1 client_cookie=38cb76e288a70287 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:05.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.735+0000 7f95937fe700 1 -- 172.21.15.49:0/832350420 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c00f070 con 0x7f95940bcfa0 2023-11-30T17:22:05.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.735+0000 7f95937fe700 1 -- 172.21.15.49:0/832350420 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958c00a2e0 con 0x7f95940bcfa0 2023-11-30T17:22:05.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.735+0000 7f95937fe700 1 -- 172.21.15.49:0/832350420 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c00cb80 con 0x7f95940bcfa0 2023-11-30T17:22:05.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.736+0000 7f959ada4700 1 -- 172.21.15.49:0/832350420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95940bcfa0 msgr2=0x7f95940bd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:05.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.736+0000 7f959ada4700 1 --2- 172.21.15.49:0/832350420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95940bcfa0 0x7f95940bd430 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f958c00af70 tx=0x7f958c00a890).stop 2023-11-30T17:22:05.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.736+0000 7f959ada4700 1 -- 172.21.15.49:0/832350420 shutdown_connections 2023-11-30T17:22:05.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.736+0000 7f959ada4700 1 --2- 172.21.15.49:0/832350420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9594150930 0x7f95940c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:05.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.736+0000 7f959ada4700 1 --2- 172.21.15.49:0/832350420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95940bcfa0 0x7f95940bd430 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:05.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.736+0000 7f959ada4700 1 -- 172.21.15.49:0/832350420 >> 172.21.15.49:0/832350420 conn(0x7f95940c8230 msgr2=0x7f95940c4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:05.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.736+0000 7f959ada4700 1 -- 172.21.15.49:0/832350420 shutdown_connections 2023-11-30T17:22:05.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.736+0000 7f959ada4700 1 -- 172.21.15.49:0/832350420 wait complete. 2023-11-30T17:22:05.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.737+0000 7f959ada4700 1 Processor -- start 2023-11-30T17:22:05.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.737+0000 7f959ada4700 1 -- start start 2023-11-30T17:22:05.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.738+0000 7f959ada4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95940bcfa0 0x7f9594143490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:05.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.738+0000 7f959ada4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9594150930 0x7f95940ab360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:05.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.738+0000 7f959ada4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9594150d10 0x7f95940a7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:05.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.738+0000 7f959ada4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95940a4a80 con 0x7f9594150930 2023-11-30T17:22:05.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.738+0000 7f959ada4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95940a4d60 con 0x7f9594150d10 2023-11-30T17:22:05.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.738+0000 7f959ada4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95940a5040 con 0x7f95940bcfa0 2023-11-30T17:22:05.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.738+0000 7f9593fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9594150930 0x7f95940ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:05.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.738+0000 7f9593fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9594150930 0x7f95940ab360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42418/0 (socket says 172.21.15.49:42418) 2023-11-30T17:22:05.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.738+0000 7f9593fff700 1 -- 172.21.15.49:0/1609838143 learned_addr learned my addr 172.21.15.49:0/1609838143 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:05.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.738+0000 7f9598b40700 1 --2- 172.21.15.49:0/1609838143 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95940bcfa0 0x7f9594143490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:05.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.738+0000 7f9599341700 1 --2- 172.21.15.49:0/1609838143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9594150d10 0x7f95940a7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:05.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.738+0000 7f9593fff700 1 -- 172.21.15.49:0/1609838143 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95940bcfa0 msgr2=0x7f9594143490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:05.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.738+0000 7f9593fff700 1 --2- 172.21.15.49:0/1609838143 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95940bcfa0 0x7f9594143490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:05.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.738+0000 7f9593fff700 1 -- 172.21.15.49:0/1609838143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9594150d10 msgr2=0x7f95940a7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:05.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.738+0000 7f9593fff700 1 --2- 172.21.15.49:0/1609838143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9594150d10 0x7f95940a7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:05.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.738+0000 7f9593fff700 1 -- 172.21.15.49:0/1609838143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9588009250 con 0x7f9594150930 2023-11-30T17:22:05.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.738+0000 7f9593fff700 1 --2- 172.21.15.49:0/1609838143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9594150930 0x7f95940ab360 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f958000c420 tx=0x7f9580007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:05.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.739+0000 7f9590ff9700 1 -- 172.21.15.49:0/1609838143 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95800070d0 con 0x7f9594150930 2023-11-30T17:22:05.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.739+0000 7f9590ff9700 1 -- 172.21.15.49:0/1609838143 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9580007230 con 0x7f9594150930 2023-11-30T17:22:05.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.739+0000 7f9590ff9700 1 -- 172.21.15.49:0/1609838143 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95800075b0 con 0x7f9594150930 2023-11-30T17:22:05.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.739+0000 7f959ada4700 1 -- 172.21.15.49:0/1609838143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f958c00ab30 con 0x7f9594150930 2023-11-30T17:22:05.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.739+0000 7f959ada4700 1 -- 172.21.15.49:0/1609838143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9594143980 con 0x7f9594150930 2023-11-30T17:22:05.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.740+0000 7f959ada4700 1 -- 172.21.15.49:0/1609838143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f959406c860 con 0x7f9594150930 2023-11-30T17:22:05.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.740+0000 7f9590ff9700 1 -- 172.21.15.49:0/1609838143 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f9580005a00 con 0x7f9594150930 2023-11-30T17:22:05.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.741+0000 7f9590ff9700 1 --2- 172.21.15.49:0/1609838143 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f957805f270 0x7f9578061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:05.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.741+0000 7f9598b40700 1 -- 172.21.15.49:0/1609838143 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f957805f270 msgr2=0x7f9578061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:05.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.741+0000 7f9590ff9700 1 -- 172.21.15.49:0/1609838143 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6495+0+0 (secure 0 0 0) 0x7f9580079b80 con 0x7f9594150930 2023-11-30T17:22:05.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.741+0000 7f9598b40700 1 --2- 172.21.15.49:0/1609838143 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f957805f270 0x7f9578061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:22:05.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.745+0000 7f9590ff9700 1 -- 172.21.15.49:0/1609838143 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f958004ab60 con 0x7f9594150930 2023-11-30T17:22:05.752 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:05.750+0000 7f0c99c3d680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T17:22:05.855 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:05.853+0000 7f0c99c3d680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:22:05.871 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:05.869+0000 7fa027b86680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T17:22:05.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.917+0000 7f959ada4700 1 -- 172.21.15.49:0/1609838143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f95940c5730 con 0x7f9594150930 2023-11-30T17:22:05.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.918+0000 7f9590ff9700 1 -- 172.21.15.49:0/1609838143 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v68) v1 ==== 104+0+11 (secure 0 0 0) 0x7f958004e180 con 0x7f9594150930 2023-11-30T17:22:05.919 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T17:22:05.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.920+0000 7f959ada4700 1 -- 172.21.15.49:0/1609838143 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f957805f270 msgr2=0x7f9578061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:22:05.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.920+0000 7f959ada4700 1 --2- 172.21.15.49:0/1609838143 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f957805f270 0x7f9578061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:05.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.920+0000 7f959ada4700 1 -- 172.21.15.49:0/1609838143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9594150930 msgr2=0x7f95940ab360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:05.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.920+0000 7f959ada4700 1 --2- 172.21.15.49:0/1609838143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9594150930 0x7f95940ab360 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f958000c420 tx=0x7f9580007c40).stop 2023-11-30T17:22:05.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.920+0000 7f959ada4700 1 -- 172.21.15.49:0/1609838143 shutdown_connections 2023-11-30T17:22:05.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.920+0000 7f959ada4700 1 --2- 172.21.15.49:0/1609838143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9594150d10 0x7f95940a7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:05.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.920+0000 7f959ada4700 1 --2- 172.21.15.49:0/1609838143 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95940bcfa0 0x7f9594143490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:05.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.920+0000 7f959ada4700 1 --2- 172.21.15.49:0/1609838143 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f957805f270 0x7f9578061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:05.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.920+0000 7f959ada4700 1 --2- 172.21.15.49:0/1609838143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9594150930 0x7f95940ab360 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:05.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.920+0000 7f959ada4700 1 -- 172.21.15.49:0/1609838143 >> 172.21.15.49:0/1609838143 conn(0x7f95940c8230 msgr2=0x7f9594147bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:05.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.920+0000 7f959ada4700 1 -- 172.21.15.49:0/1609838143 shutdown_connections 2023-11-30T17:22:05.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:05.920+0000 7f959ada4700 1 -- 172.21.15.49:0/1609838143 wait complete. 2023-11-30T17:22:05.934 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-30T17:22:05.984 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:05.983+0000 7fa027b86680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:22:06.007 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:06.006+0000 7f0c99c3d680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T17:22:06.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.056+0000 7f3766f35700 1 Processor -- start 2023-11-30T17:22:06.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.057+0000 7f3766f35700 1 -- start start 2023-11-30T17:22:06.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.057+0000 7f3766f35700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f37600c6950 0x7f376014eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:06.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.057+0000 7f3766f35700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37600634a0 con 0x7f376014eb00 2023-11-30T17:22:06.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.057+0000 7f3766f35700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3760063780 con 0x7f37600bcdd0 2023-11-30T17:22:06.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.057+0000 7f3766f35700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3760137d90 con 0x7f37600c6950 2023-11-30T17:22:06.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.058+0000 7f3764cd1700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f376014eb00 0x7f37600bc6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55244/0 (socket says 172.21.15.49:55244) 2023-11-30T17:22:06.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.058+0000 7f3764cd1700 1 -- 172.21.15.49:0/2819710917 learned_addr learned my addr 172.21.15.49:0/2819710917 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:06.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.058+0000 7f37654d2700 1 --2- 172.21.15.49:0/2819710917 >> v2:172.21.15.115:3300/0 conn(0x7f37600c6950 0x7f376014eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:06.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.058+0000 7f375f7fe700 1 -- 172.21.15.49:0/2819710917 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3043551153 0 0) 0x7f37600634a0 con 0x7f376014eb00 2023-11-30T17:22:06.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.058+0000 7f375f7fe700 1 -- 172.21.15.49:0/2819710917 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37500033f0 con 0x7f376014eb00 2023-11-30T17:22:06.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.058+0000 7f375f7fe700 1 -- 172.21.15.49:0/2819710917 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251754065 0 0) 0x7f3760063780 con 0x7f37600bcdd0 2023-11-30T17:22:06.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.058+0000 7f375f7fe700 1 -- 172.21.15.49:0/2819710917 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37600634a0 con 0x7f37600bcdd0 2023-11-30T17:22:06.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.058+0000 7f37654d2700 1 -- 172.21.15.49:0/2819710917 >> v1:172.21.15.115:6789/0 conn(0x7f37600bcdd0 legacy=0x7f3760062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:06.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.058+0000 7f37654d2700 1 -- 172.21.15.49:0/2819710917 >> v1:172.21.15.49:6789/0 conn(0x7f376014eb00 legacy=0x7f37600bc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:06.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.058+0000 7f37654d2700 1 -- 172.21.15.49:0/2819710917 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3760063a60 con 0x7f37600c6950 2023-11-30T17:22:06.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.058+0000 7f37654d2700 1 --2- 172.21.15.49:0/2819710917 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37600c6950 0x7f376014eee0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f3758009e60 tx=0x7f3758009780).ready entity=mon.1 client_cookie=3fd19d97b63d1ab3 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:06.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.058+0000 7f375f7fe700 1 -- 172.21.15.49:0/2819710917 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375800e070 con 0x7f37600c6950 2023-11-30T17:22:06.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.058+0000 7f375f7fe700 1 -- 172.21.15.49:0/2819710917 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375800bab0 con 0x7f37600c6950 2023-11-30T17:22:06.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.058+0000 7f375f7fe700 1 -- 172.21.15.49:0/2819710917 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375800be30 con 0x7f37600c6950 2023-11-30T17:22:06.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.059+0000 7f3766f35700 1 -- 172.21.15.49:0/2819710917 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37600c6950 msgr2=0x7f376014eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:06.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.059+0000 7f3766f35700 1 --2- 172.21.15.49:0/2819710917 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37600c6950 0x7f376014eee0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f3758009e60 tx=0x7f3758009780).stop 2023-11-30T17:22:06.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.059+0000 7f3766f35700 1 -- 172.21.15.49:0/2819710917 shutdown_connections 2023-11-30T17:22:06.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.059+0000 7f3766f35700 1 --2- 172.21.15.49:0/2819710917 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37600c6950 0x7f376014eee0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:06.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.059+0000 7f3766f35700 1 -- 172.21.15.49:0/2819710917 >> 172.21.15.49:0/2819710917 conn(0x7f37600c8230 msgr2=0x7f37600c4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:06.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.059+0000 7f3766f35700 1 -- 172.21.15.49:0/2819710917 shutdown_connections 2023-11-30T17:22:06.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.059+0000 7f3766f35700 1 -- 172.21.15.49:0/2819710917 wait complete. 2023-11-30T17:22:06.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.060+0000 7f3766f35700 1 Processor -- start 2023-11-30T17:22:06.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.061+0000 7f3766f35700 1 -- start start 2023-11-30T17:22:06.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.061+0000 7f3766f35700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f37600bcdd0 0x7f3760065340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:06.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.061+0000 7f3766f35700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37600c6950 0x7f37600a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:06.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.061+0000 7f3766f35700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f376014eb00 0x7f37600a9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:06.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.061+0000 7f3766f35700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376013b360 con 0x7f376014eb00 2023-11-30T17:22:06.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.061+0000 7f3766f35700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376013c1c0 con 0x7f37600c6950 2023-11-30T17:22:06.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.061+0000 7f3766f35700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376013e2c0 con 0x7f37600bcdd0 2023-11-30T17:22:06.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.062+0000 7f37654d2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f376014eb00 0x7f37600a9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:06.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.062+0000 7f37654d2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f376014eb00 0x7f37600a9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42420/0 (socket says 172.21.15.49:42420) 2023-11-30T17:22:06.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.062+0000 7f37654d2700 1 -- 172.21.15.49:0/4193440000 learned_addr learned my addr 172.21.15.49:0/4193440000 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:06.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.062+0000 7f3764cd1700 1 --2- 172.21.15.49:0/4193440000 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f37600bcdd0 0x7f3760065340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:06.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.062+0000 7f375ffff700 1 --2- 172.21.15.49:0/4193440000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37600c6950 0x7f37600a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:06.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.062+0000 7f37654d2700 1 -- 172.21.15.49:0/4193440000 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f37600bcdd0 msgr2=0x7f3760065340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:06.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.062+0000 7f37654d2700 1 --2- 172.21.15.49:0/4193440000 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f37600bcdd0 0x7f3760065340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:06.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.062+0000 7f37654d2700 1 -- 172.21.15.49:0/4193440000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37600c6950 msgr2=0x7f37600a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:06.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.062+0000 7f37654d2700 1 --2- 172.21.15.49:0/4193440000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37600c6950 0x7f37600a98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:06.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.062+0000 7f37654d2700 1 -- 172.21.15.49:0/4193440000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3758009a20 con 0x7f376014eb00 2023-11-30T17:22:06.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.062+0000 7f37654d2700 1 --2- 172.21.15.49:0/4193440000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f376014eb00 0x7f37600a9dc0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f375800b610 tx=0x7f3758009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:06.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.062+0000 7f375cff9700 1 -- 172.21.15.49:0/4193440000 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3758012e60 con 0x7f376014eb00 2023-11-30T17:22:06.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.062+0000 7f375cff9700 1 -- 172.21.15.49:0/4193440000 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375801d630 con 0x7f376014eb00 2023-11-30T17:22:06.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.062+0000 7f3766f35700 1 -- 172.21.15.49:0/4193440000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f376013b5b0 con 0x7f376014eb00 2023-11-30T17:22:06.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.062+0000 7f375cff9700 1 -- 172.21.15.49:0/4193440000 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375801d9b0 con 0x7f376014eb00 2023-11-30T17:22:06.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.062+0000 7f3766f35700 1 -- 172.21.15.49:0/4193440000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f376013bb70 con 0x7f376014eb00 2023-11-30T17:22:06.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.063+0000 7f3766f35700 1 -- 172.21.15.49:0/4193440000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f376013b1a0 con 0x7f376014eb00 2023-11-30T17:22:06.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.064+0000 7f375cff9700 1 -- 172.21.15.49:0/4193440000 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f3758026410 con 0x7f376014eb00 2023-11-30T17:22:06.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.064+0000 7f375cff9700 1 --2- 172.21.15.49:0/4193440000 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f374405f270 0x7f3744061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:06.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.064+0000 7f3764cd1700 1 -- 172.21.15.49:0/4193440000 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f374405f270 msgr2=0x7f3744061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:06.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.064+0000 7f375cff9700 1 -- 172.21.15.49:0/4193440000 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6495+0+0 (secure 0 0 0) 0x7f375807c330 con 0x7f376014eb00 2023-11-30T17:22:06.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.064+0000 7f3764cd1700 1 --2- 172.21.15.49:0/4193440000 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f374405f270 0x7f3744061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:22:06.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.069+0000 7f375cff9700 1 -- 172.21.15.49:0/4193440000 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f375804d1f0 con 0x7f376014eb00 2023-11-30T17:22:06.082 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:06.080+0000 7f0c99c3d680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T17:22:06.146 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:06.145+0000 7fa027b86680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T17:22:06.149 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:06.148+0000 7f0c99c3d680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T17:22:06.224 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:06.223+0000 7fa027b86680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T17:22:06.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.241+0000 7f3766f35700 1 -- 172.21.15.49:0/4193440000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f376013c330 con 0x7f376014eb00 2023-11-30T17:22:06.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.242+0000 7f375cff9700 1 -- 172.21.15.49:0/4193440000 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v68) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3758050810 con 0x7f376014eb00 2023-11-30T17:22:06.243 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T17:22:06.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.244+0000 7f3766f35700 1 -- 172.21.15.49:0/4193440000 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f374405f270 msgr2=0x7f3744061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:22:06.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.244+0000 7f3766f35700 1 --2- 172.21.15.49:0/4193440000 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f374405f270 0x7f3744061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:06.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.244+0000 7f3766f35700 1 -- 172.21.15.49:0/4193440000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f376014eb00 msgr2=0x7f37600a9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:06.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.244+0000 7f3766f35700 1 --2- 172.21.15.49:0/4193440000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f376014eb00 0x7f37600a9dc0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f375800b610 tx=0x7f3758009780).stop 2023-11-30T17:22:06.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.244+0000 7f3766f35700 1 -- 172.21.15.49:0/4193440000 shutdown_connections 2023-11-30T17:22:06.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.244+0000 7f3766f35700 1 --2- 172.21.15.49:0/4193440000 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f374405f270 0x7f3744061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:06.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.244+0000 7f3766f35700 1 --2- 172.21.15.49:0/4193440000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f376014eb00 0x7f37600a9dc0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:06.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.244+0000 7f3766f35700 1 --2- 172.21.15.49:0/4193440000 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f37600bcdd0 0x7f3760065340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:06.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.244+0000 7f3766f35700 1 --2- 172.21.15.49:0/4193440000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37600c6950 0x7f37600a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:06.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.244+0000 7f3766f35700 1 -- 172.21.15.49:0/4193440000 >> 172.21.15.49:0/4193440000 conn(0x7f37600c8230 msgr2=0x7f37601362d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:06.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.244+0000 7f3766f35700 1 -- 172.21.15.49:0/4193440000 shutdown_connections 2023-11-30T17:22:06.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.244+0000 7f3766f35700 1 -- 172.21.15.49:0/4193440000 wait complete. 2023-11-30T17:22:06.258 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:22:06.298 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:06.296+0000 7fa027b86680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T17:22:06.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.376+0000 7fd22773e700 1 Processor -- start 2023-11-30T17:22:06.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.376+0000 7fd22773e700 1 -- start start 2023-11-30T17:22:06.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.377+0000 7fd22773e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd2200c0d10 0x7fd2200c10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:06.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.377+0000 7fd22773e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd2201546f0 0x7fd220158b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:06.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.377+0000 7fd22773e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd220063380 con 0x7fd22006b510 2023-11-30T17:22:06.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.377+0000 7fd22773e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2200c19e0 con 0x7fd2200c0d10 2023-11-30T17:22:06.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.377+0000 7fd22773e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd220159060 con 0x7fd2201546f0 2023-11-30T17:22:06.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.377+0000 7fd2254da700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd2200c0d10 0x7fd2200c10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:06.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.378+0000 7fd2254da700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd2200c0d10 0x7fd2200c10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42432/0 (socket says 172.21.15.49:42432) 2023-11-30T17:22:06.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.378+0000 7fd2254da700 1 -- 172.21.15.49:0/3584892685 learned_addr learned my addr 172.21.15.49:0/3584892685 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:06.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.378+0000 7fd225cdb700 1 --2- 172.21.15.49:0/3584892685 >> v2:172.21.15.115:3300/0 conn(0x7fd2201546f0 0x7fd220158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:06.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.378+0000 7fd2254da700 1 -- 172.21.15.49:0/3584892685 >> v2:172.21.15.115:3300/0 conn(0x7fd2201546f0 msgr2=0x7fd220158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:06.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.378+0000 7fd2254da700 1 --2- 172.21.15.49:0/3584892685 >> v2:172.21.15.115:3300/0 conn(0x7fd2201546f0 0x7fd220158b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:06.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.378+0000 7fd2254da700 1 -- 172.21.15.49:0/3584892685 >> v1:172.21.15.115:6789/0 conn(0x7fd22006b510 legacy=0x7fd220153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:06.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.378+0000 7fd2254da700 1 -- 172.21.15.49:0/3584892685 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd220062770 con 0x7fd2200c0d10 2023-11-30T17:22:06.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.378+0000 7fd2254da700 1 --2- 172.21.15.49:0/3584892685 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2200c0d10 0x7fd2200c10f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7fd2200632f0 tx=0x7fd2100090f0).ready entity=mon.0 client_cookie=152b94c16bb85bcd server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:06.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.378+0000 7fd217fff700 1 -- 172.21.15.49:0/3584892685 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21000b520 con 0x7fd2200c0d10 2023-11-30T17:22:06.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.378+0000 7fd217fff700 1 -- 172.21.15.49:0/3584892685 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21000b680 con 0x7fd2200c0d10 2023-11-30T17:22:06.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.378+0000 7fd217fff700 1 -- 172.21.15.49:0/3584892685 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21000ba00 con 0x7fd2200c0d10 2023-11-30T17:22:06.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.379+0000 7fd22773e700 1 -- 172.21.15.49:0/3584892685 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2200c0d10 msgr2=0x7fd2200c10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:06.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.379+0000 7fd22773e700 1 --2- 172.21.15.49:0/3584892685 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2200c0d10 0x7fd2200c10f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7fd2200632f0 tx=0x7fd2100090f0).stop 2023-11-30T17:22:06.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.379+0000 7fd22773e700 1 -- 172.21.15.49:0/3584892685 shutdown_connections 2023-11-30T17:22:06.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.379+0000 7fd22773e700 1 --2- 172.21.15.49:0/3584892685 >> v2:172.21.15.115:3300/0 conn(0x7fd2201546f0 0x7fd220158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:06.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.379+0000 7fd22773e700 1 --2- 172.21.15.49:0/3584892685 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2200c0d10 0x7fd2200c10f0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:06.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.379+0000 7fd22773e700 1 -- 172.21.15.49:0/3584892685 >> 172.21.15.49:0/3584892685 conn(0x7fd2200c7760 msgr2=0x7fd2200c7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:06.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.379+0000 7fd22773e700 1 -- 172.21.15.49:0/3584892685 shutdown_connections 2023-11-30T17:22:06.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.379+0000 7fd22773e700 1 -- 172.21.15.49:0/3584892685 wait complete. 2023-11-30T17:22:06.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.380+0000 7fd22773e700 1 Processor -- start 2023-11-30T17:22:06.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.380+0000 7fd22773e700 1 -- start start 2023-11-30T17:22:06.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.381+0000 7fd22773e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd22006b510 0x7fd22014fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:06.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.381+0000 7fd22773e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2200c0d10 0x7fd2200a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:06.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.381+0000 7fd22773e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2201546f0 0x7fd220155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:06.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.381+0000 7fd22773e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd220156060 con 0x7fd2201546f0 2023-11-30T17:22:06.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.381+0000 7fd22773e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2200ad8b0 con 0x7fd2200c0d10 2023-11-30T17:22:06.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.381+0000 7fd22773e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2200a0b50 con 0x7fd22006b510 2023-11-30T17:22:06.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.381+0000 7fd225cdb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2201546f0 0x7fd220155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:06.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.381+0000 7fd225cdb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2201546f0 0x7fd220155610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42436/0 (socket says 172.21.15.49:42436) 2023-11-30T17:22:06.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.381+0000 7fd225cdb700 1 -- 172.21.15.49:0/461784605 learned_addr learned my addr 172.21.15.49:0/461784605 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:06.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.381+0000 7fd2254da700 1 --2- 172.21.15.49:0/461784605 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd22006b510 0x7fd22014fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:06.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.381+0000 7fd224cd9700 1 --2- 172.21.15.49:0/461784605 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2200c0d10 0x7fd2200a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:06.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.381+0000 7fd225cdb700 1 -- 172.21.15.49:0/461784605 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd22006b510 msgr2=0x7fd22014fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:06.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.381+0000 7fd225cdb700 1 --2- 172.21.15.49:0/461784605 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd22006b510 0x7fd22014fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:06.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.381+0000 7fd225cdb700 1 -- 172.21.15.49:0/461784605 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2200c0d10 msgr2=0x7fd2200a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:06.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.381+0000 7fd225cdb700 1 --2- 172.21.15.49:0/461784605 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2200c0d10 0x7fd2200a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:06.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.381+0000 7fd225cdb700 1 -- 172.21.15.49:0/461784605 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd210009370 con 0x7fd2201546f0 2023-11-30T17:22:06.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.382+0000 7fd225cdb700 1 --2- 172.21.15.49:0/461784605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2201546f0 0x7fd220155610 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7fd218009e20 tx=0x7fd21800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:06.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.382+0000 7fd2157fa700 1 -- 172.21.15.49:0/461784605 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21800caa0 con 0x7fd2201546f0 2023-11-30T17:22:06.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.382+0000 7fd2157fa700 1 -- 172.21.15.49:0/461784605 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21800f040 con 0x7fd2201546f0 2023-11-30T17:22:06.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.382+0000 7fd22773e700 1 -- 172.21.15.49:0/461784605 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd22014fc40 con 0x7fd2201546f0 2023-11-30T17:22:06.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.382+0000 7fd2157fa700 1 -- 172.21.15.49:0/461784605 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21800ce10 con 0x7fd2201546f0 2023-11-30T17:22:06.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.382+0000 7fd22773e700 1 -- 172.21.15.49:0/461784605 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2200aafe0 con 0x7fd2201546f0 2023-11-30T17:22:06.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.383+0000 7fd22773e700 1 -- 172.21.15.49:0/461784605 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd220155de0 con 0x7fd2201546f0 2023-11-30T17:22:06.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.383+0000 7fd2157fa700 1 -- 172.21.15.49:0/461784605 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fd218013610 con 0x7fd2201546f0 2023-11-30T17:22:06.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.384+0000 7fd2157fa700 1 --2- 172.21.15.49:0/461784605 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd20405f270 0x7fd204061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:06.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.384+0000 7fd2157fa700 1 -- 172.21.15.49:0/461784605 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6495+0+0 (secure 0 0 0) 0x7fd21807aba0 con 0x7fd2201546f0 2023-11-30T17:22:06.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.384+0000 7fd2254da700 1 -- 172.21.15.49:0/461784605 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd20405f270 msgr2=0x7fd204061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:06.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.384+0000 7fd2254da700 1 --2- 172.21.15.49:0/461784605 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd20405f270 0x7fd204061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:22:06.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.388+0000 7fd2157fa700 1 -- 172.21.15.49:0/461784605 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd21804bb80 con 0x7fd2201546f0 2023-11-30T17:22:06.408 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:06.406+0000 7f0c99c3d680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T17:22:06.575 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:06.574+0000 7fa027b86680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T17:22:06.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.585+0000 7fd2254da700 1 -- 172.21.15.49:0/461784605 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd20405f270 msgr2=0x7fd204061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:06.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.585+0000 7fd2254da700 1 --2- 172.21.15.49:0/461784605 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd20405f270 0x7fd204061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:22:06.590 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:06.589+0000 7f0c99c3d680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T17:22:06.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.605+0000 7fd22773e700 1 -- 172.21.15.49:0/461784605 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd22006c860 con 0x7fd2201546f0 2023-11-30T17:22:06.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.606+0000 7fd2157fa700 1 -- 172.21.15.49:0/461784605 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4495 (secure 0 0 0) 0x7fd21804f1a0 con 0x7fd2201546f0 2023-11-30T17:22:06.607 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:06.608 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1605498959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1605498959},{"type":"v1","addr":"172.21.15.115:6836","nonce":1605498959}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1471786970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1471786970},{"type":"v1","addr":"172.21.15.115:6837","nonce":1471786970}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5763,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1757467688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1757467688},{"type":"v1","addr":"172.21.15.49:6834","nonce":1757467688}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:19:56.468670+0000","modified":"2023-11-30T17:19:59.475872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5766},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5766":{"gid":5766,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2424233798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2424233798},{"type":"v1","addr":"172.21.15.49:6835","nonce":2424233798}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-11-30T17:22:06.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.608+0000 7fd22773e700 1 -- 172.21.15.49:0/461784605 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd20405f270 msgr2=0x7fd204061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:22:06.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.608+0000 7fd22773e700 1 --2- 172.21.15.49:0/461784605 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd20405f270 0x7fd204061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:06.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.608+0000 7fd22773e700 1 -- 172.21.15.49:0/461784605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2201546f0 msgr2=0x7fd220155610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:06.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.608+0000 7fd22773e700 1 --2- 172.21.15.49:0/461784605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2201546f0 0x7fd220155610 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7fd218009e20 tx=0x7fd21800b040).stop 2023-11-30T17:22:06.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.608+0000 7fd22773e700 1 -- 172.21.15.49:0/461784605 shutdown_connections 2023-11-30T17:22:06.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.608+0000 7fd22773e700 1 --2- 172.21.15.49:0/461784605 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd20405f270 0x7fd204061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:06.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.608+0000 7fd22773e700 1 --2- 172.21.15.49:0/461784605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2201546f0 0x7fd220155610 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:06.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.608+0000 7fd22773e700 1 --2- 172.21.15.49:0/461784605 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd22006b510 0x7fd22014fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:06.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.608+0000 7fd22773e700 1 --2- 172.21.15.49:0/461784605 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2200c0d10 0x7fd2200a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:06.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.608+0000 7fd22773e700 1 -- 172.21.15.49:0/461784605 >> 172.21.15.49:0/461784605 conn(0x7fd2200c7760 msgr2=0x7fd2200c6530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:06.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.608+0000 7fd22773e700 1 -- 172.21.15.49:0/461784605 shutdown_connections 2023-11-30T17:22:06.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.608+0000 7fd22773e700 1 -- 172.21.15.49:0/461784605 wait complete. 2023-11-30T17:22:06.610 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 24 2023-11-30T17:22:06.622 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:22:06.767 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:06.766+0000 7fa027b86680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T17:22:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.783+0000 7fded38d7700 1 Processor -- start 2023-11-30T17:22:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.783+0000 7fded38d7700 1 -- start start 2023-11-30T17:22:06.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.784+0000 7fded38d7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdecc0caab0 0x7fdecc0aa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:06.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.784+0000 7fded38d7700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdecc0cae90 0x7fdecc0c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:06.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.784+0000 7fded38d7700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdecc0a9a90 con 0x7fdecc0aa960 2023-11-30T17:22:06.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.784+0000 7fded38d7700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdecc154ce0 con 0x7fdecc0cae90 2023-11-30T17:22:06.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.784+0000 7fded38d7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc0a8e80 con 0x7fdecc0caab0 2023-11-30T17:22:06.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.784+0000 7fded0e72700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdecc0cae90 0x7fdecc0c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:06.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.784+0000 7fded0e72700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdecc0cae90 0x7fdecc0c0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42446/0 (socket says 172.21.15.49:42446) 2023-11-30T17:22:06.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.784+0000 7fded0e72700 1 -- 172.21.15.49:0/447460302 learned_addr learned my addr 172.21.15.49:0/447460302 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:06.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.785+0000 7fded1673700 1 --2- 172.21.15.49:0/447460302 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdecc0caab0 0x7fdecc0aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:06.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.785+0000 7fded0e72700 1 -- 172.21.15.49:0/447460302 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdecc0caab0 msgr2=0x7fdecc0aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:06.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.785+0000 7fded0e72700 1 --2- 172.21.15.49:0/447460302 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdecc0caab0 0x7fdecc0aa470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:06.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.785+0000 7fded0e72700 1 -- 172.21.15.49:0/447460302 >> v1:172.21.15.115:6789/0 conn(0x7fdecc0aa960 legacy=0x7fdecc0c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:06.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.785+0000 7fded0e72700 1 -- 172.21.15.49:0/447460302 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdecc0a9160 con 0x7fdecc0cae90 2023-11-30T17:22:06.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.785+0000 7fded1673700 1 --2- 172.21.15.49:0/447460302 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdecc0caab0 0x7fdecc0aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:06.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.785+0000 7fded0e72700 1 --2- 172.21.15.49:0/447460302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdecc0cae90 0x7fdecc0c0ab0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7fdec8006fd0 tx=0x7fdec80090f0).ready entity=mon.0 client_cookie=53b1a066166debee server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:06.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.785+0000 7fdec3fff700 1 -- 172.21.15.49:0/447460302 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec800b600 con 0x7fdecc0cae90 2023-11-30T17:22:06.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.785+0000 7fdec3fff700 1 -- 172.21.15.49:0/447460302 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec800b760 con 0x7fdecc0cae90 2023-11-30T17:22:06.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.785+0000 7fdec3fff700 1 -- 172.21.15.49:0/447460302 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec800bae0 con 0x7fdecc0cae90 2023-11-30T17:22:06.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.786+0000 7fded38d7700 1 -- 172.21.15.49:0/447460302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdecc0cae90 msgr2=0x7fdecc0c0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:06.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.786+0000 7fded38d7700 1 --2- 172.21.15.49:0/447460302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdecc0cae90 0x7fdecc0c0ab0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7fdec8006fd0 tx=0x7fdec80090f0).stop 2023-11-30T17:22:06.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.786+0000 7fded38d7700 1 -- 172.21.15.49:0/447460302 shutdown_connections 2023-11-30T17:22:06.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.786+0000 7fded38d7700 1 --2- 172.21.15.49:0/447460302 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdecc0caab0 0x7fdecc0aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:06.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.786+0000 7fded38d7700 1 --2- 172.21.15.49:0/447460302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdecc0cae90 0x7fdecc0c0ab0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:06.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.786+0000 7fded38d7700 1 -- 172.21.15.49:0/447460302 >> 172.21.15.49:0/447460302 conn(0x7fdecc094920 msgr2=0x7fdecc06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:06.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.786+0000 7fded38d7700 1 -- 172.21.15.49:0/447460302 shutdown_connections 2023-11-30T17:22:06.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.786+0000 7fded38d7700 1 -- 172.21.15.49:0/447460302 wait complete. 2023-11-30T17:22:06.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.787+0000 7fded38d7700 1 Processor -- start 2023-11-30T17:22:06.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.787+0000 7fded38d7700 1 -- start start 2023-11-30T17:22:06.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.788+0000 7fded38d7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdecc0caab0 0x7fdecc164b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:06.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.788+0000 7fded38d7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdecc0cae90 0x7fdecc0c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:06.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.788+0000 7fded38d7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdecc0c4f20 0x7fdecc1677b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:06.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.788+0000 7fded38d7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc094fe0 con 0x7fdecc0caab0 2023-11-30T17:22:06.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.788+0000 7fded38d7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc165010 con 0x7fdecc0cae90 2023-11-30T17:22:06.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.788+0000 7fded38d7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc168530 con 0x7fdecc0c4f20 2023-11-30T17:22:06.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.788+0000 7fded1673700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdecc0caab0 0x7fdecc164b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:06.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.788+0000 7fded1673700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdecc0caab0 0x7fdecc164b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42448/0 (socket says 172.21.15.49:42448) 2023-11-30T17:22:06.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.788+0000 7fded1673700 1 -- 172.21.15.49:0/2375425404 learned_addr learned my addr 172.21.15.49:0/2375425404 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:06.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.788+0000 7fded1e74700 1 --2- 172.21.15.49:0/2375425404 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdecc0c4f20 0x7fdecc1677b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:06.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.788+0000 7fded0e72700 1 --2- 172.21.15.49:0/2375425404 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdecc0cae90 0x7fdecc0c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:06.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.788+0000 7fded1673700 1 -- 172.21.15.49:0/2375425404 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdecc0c4f20 msgr2=0x7fdecc1677b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:06.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.789+0000 7fded1673700 1 --2- 172.21.15.49:0/2375425404 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdecc0c4f20 0x7fdecc1677b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:06.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.789+0000 7fded1673700 1 -- 172.21.15.49:0/2375425404 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdecc0cae90 msgr2=0x7fdecc0c4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:06.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.789+0000 7fded1673700 1 --2- 172.21.15.49:0/2375425404 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdecc0cae90 0x7fdecc0c4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:06.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.789+0000 7fded1673700 1 -- 172.21.15.49:0/2375425404 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec8009370 con 0x7fdecc0caab0 2023-11-30T17:22:06.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.789+0000 7fded1673700 1 --2- 172.21.15.49:0/2375425404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdecc0caab0 0x7fdecc164b20 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fdebc00d890 tx=0x7fdebc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:06.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.789+0000 7fdec17fa700 1 -- 172.21.15.49:0/2375425404 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc016070 con 0x7fdecc0caab0 2023-11-30T17:22:06.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.789+0000 7fdec17fa700 1 -- 172.21.15.49:0/2375425404 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdebc005880 con 0x7fdecc0caab0 2023-11-30T17:22:06.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.789+0000 7fded38d7700 1 -- 172.21.15.49:0/2375425404 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdecc168810 con 0x7fdecc0caab0 2023-11-30T17:22:06.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.789+0000 7fdec17fa700 1 -- 172.21.15.49:0/2375425404 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc005c00 con 0x7fdecc0caab0 2023-11-30T17:22:06.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.789+0000 7fded38d7700 1 -- 172.21.15.49:0/2375425404 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdecc168dd0 con 0x7fdecc0caab0 2023-11-30T17:22:06.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.790+0000 7fded38d7700 1 -- 172.21.15.49:0/2375425404 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdecc06c860 con 0x7fdecc0caab0 2023-11-30T17:22:06.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.790+0000 7fdec17fa700 1 -- 172.21.15.49:0/2375425404 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fdebc005fb0 con 0x7fdecc0caab0 2023-11-30T17:22:06.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.791+0000 7fdec17fa700 1 --2- 172.21.15.49:0/2375425404 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdeb005f270 0x7fdeb0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:06.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.791+0000 7fdec17fa700 1 -- 172.21.15.49:0/2375425404 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6495+0+0 (secure 0 0 0) 0x7fdebc07a130 con 0x7fdecc0caab0 2023-11-30T17:22:06.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.791+0000 7fded0e72700 1 -- 172.21.15.49:0/2375425404 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdeb005f270 msgr2=0x7fdeb0061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:06.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.791+0000 7fded0e72700 1 --2- 172.21.15.49:0/2375425404 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdeb005f270 0x7fdeb0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:22:06.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.795+0000 7fdec17fa700 1 -- 172.21.15.49:0/2375425404 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdebc04b110 con 0x7fdecc0caab0 2023-11-30T17:22:06.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.970+0000 7fded38d7700 1 -- 172.21.15.49:0/2375425404 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdecc0a9440 con 0x7fdecc0caab0 2023-11-30T17:22:06.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.972+0000 7fdec17fa700 1 -- 172.21.15.49:0/2375425404 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+17596 (secure 0 0 0) 0x7fdebc04e730 con 0x7fdecc0caab0 2023-11-30T17:22:06.974 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:06.974 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":69,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:22:06.966578+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:19:54.153609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-30T17:19:55.451988+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":69,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.16","mappings":[{"from":0,"to":5}]},{"pgid":"7.2c","mappings":[{"from":0,"to":4}]},{"pgid":"8.c","mappings":[{"from":0,"to":6}]},{"pgid":"8.38","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/352667093":"2023-12-01T17:20:13.108922+0000","172.21.15.115:6832/89956":"2023-12-01T17:20:13.108922+0000","172.21.15.115:0/975065917":"2023-12-01T17:20:13.108922+0000","172.21.15.115:0/2727001384":"2023-12-01T17:20:13.108922+0000","172.21.15.115:6833/89956":"2023-12-01T17:20:13.108922+0000","172.21.15.115:0/4139500051":"2023-12-01T17:20:13.108922+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:22:06.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.975+0000 7fded38d7700 1 -- 172.21.15.49:0/2375425404 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdeb005f270 msgr2=0x7fdeb0061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:22:06.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.975+0000 7fded38d7700 1 --2- 172.21.15.49:0/2375425404 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdeb005f270 0x7fdeb0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:06.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.975+0000 7fded38d7700 1 -- 172.21.15.49:0/2375425404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdecc0caab0 msgr2=0x7fdecc164b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:06.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.975+0000 7fded38d7700 1 --2- 172.21.15.49:0/2375425404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdecc0caab0 0x7fdecc164b20 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fdebc00d890 tx=0x7fdebc008040).stop 2023-11-30T17:22:06.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.975+0000 7fded38d7700 1 -- 172.21.15.49:0/2375425404 shutdown_connections 2023-11-30T17:22:06.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.975+0000 7fded38d7700 1 --2- 172.21.15.49:0/2375425404 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdecc0c4f20 0x7fdecc1677b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:06.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.975+0000 7fded38d7700 1 --2- 172.21.15.49:0/2375425404 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdeb005f270 0x7fdeb0061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:06.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.975+0000 7fded38d7700 1 --2- 172.21.15.49:0/2375425404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdecc0caab0 0x7fdecc164b20 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:06.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.975+0000 7fded38d7700 1 --2- 172.21.15.49:0/2375425404 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdecc0cae90 0x7fdecc0c4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:06.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.975+0000 7fded38d7700 1 -- 172.21.15.49:0/2375425404 >> 172.21.15.49:0/2375425404 conn(0x7fdecc094920 msgr2=0x7fdecc0ac4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:06.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.975+0000 7fded38d7700 1 -- 172.21.15.49:0/2375425404 shutdown_connections 2023-11-30T17:22:06.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:06.975+0000 7fded38d7700 1 -- 172.21.15.49:0/2375425404 wait complete. 2023-11-30T17:22:06.992 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-30T17:22:06.992 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:22:07.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.118+0000 7f312ba44700 1 Processor -- start 2023-11-30T17:22:07.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.118+0000 7f312ba44700 1 -- start start 2023-11-30T17:22:07.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.119+0000 7f312ba44700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3124064e20 0x7f3124155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:07.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.119+0000 7f312ba44700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3124095e80 0x7f31240962f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:07.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.119+0000 7f312ba44700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31240967e0 con 0x7f31241544d0 2023-11-30T17:22:07.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.119+0000 7f312ba44700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3124067650 con 0x7f3124064e20 2023-11-30T17:22:07.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.119+0000 7f312ba44700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31240683d0 con 0x7f3124095e80 2023-11-30T17:22:07.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.119+0000 7f3128fdf700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3124064e20 0x7f3124155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:07.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.119+0000 7f31297e0700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f31241544d0 0x7f3124066f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55252/0 (socket says 172.21.15.49:55252) 2023-11-30T17:22:07.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.119+0000 7f31297e0700 1 -- 172.21.15.49:0/1915689652 learned_addr learned my addr 172.21.15.49:0/1915689652 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:07.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.119+0000 7f3129fe1700 1 --2- 172.21.15.49:0/1915689652 >> v2:172.21.15.115:3300/0 conn(0x7f3124095e80 0x7f31240962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:07.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.119+0000 7f3128fdf700 1 -- 172.21.15.49:0/1915689652 >> v2:172.21.15.115:3300/0 conn(0x7f3124095e80 msgr2=0x7f31240962f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:07.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.119+0000 7f3128fdf700 1 --2- 172.21.15.49:0/1915689652 >> v2:172.21.15.115:3300/0 conn(0x7f3124095e80 0x7f31240962f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:07.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.119+0000 7f3128fdf700 1 -- 172.21.15.49:0/1915689652 >> v1:172.21.15.49:6789/0 conn(0x7f31241544d0 legacy=0x7f3124066f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:07.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.119+0000 7f311bfff700 1 -- 172.21.15.49:0/1915689652 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1971755119 0 0) 0x7f31240967e0 con 0x7f31241544d0 2023-11-30T17:22:07.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.119+0000 7f3128fdf700 1 -- 172.21.15.49:0/1915689652 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3124067850 con 0x7f3124064e20 2023-11-30T17:22:07.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.119+0000 7f3128fdf700 1 --2- 172.21.15.49:0/1915689652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3124064e20 0x7f3124155750 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f31240c9020 tx=0x7f3120009060).ready entity=mon.0 client_cookie=5aed4aeb35ef8e71 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:07.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.119+0000 7f311bfff700 1 -- 172.21.15.49:0/1915689652 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312000b580 con 0x7f3124064e20 2023-11-30T17:22:07.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.120+0000 7f311bfff700 1 -- 172.21.15.49:0/1915689652 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312000b6e0 con 0x7f3124064e20 2023-11-30T17:22:07.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.120+0000 7f311bfff700 1 -- 172.21.15.49:0/1915689652 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312000ba60 con 0x7f3124064e20 2023-11-30T17:22:07.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.120+0000 7f312ba44700 1 -- 172.21.15.49:0/1915689652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3124064e20 msgr2=0x7f3124155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:07.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.120+0000 7f312ba44700 1 --2- 172.21.15.49:0/1915689652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3124064e20 0x7f3124155750 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f31240c9020 tx=0x7f3120009060).stop 2023-11-30T17:22:07.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.120+0000 7f312ba44700 1 -- 172.21.15.49:0/1915689652 shutdown_connections 2023-11-30T17:22:07.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.120+0000 7f312ba44700 1 --2- 172.21.15.49:0/1915689652 >> v2:172.21.15.115:3300/0 conn(0x7f3124095e80 0x7f31240962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:07.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.120+0000 7f312ba44700 1 --2- 172.21.15.49:0/1915689652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3124064e20 0x7f3124155750 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:07.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.120+0000 7f312ba44700 1 -- 172.21.15.49:0/1915689652 >> 172.21.15.49:0/1915689652 conn(0x7f31240631d0 msgr2=0x7f31240c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:07.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.120+0000 7f312ba44700 1 -- 172.21.15.49:0/1915689652 shutdown_connections 2023-11-30T17:22:07.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.120+0000 7f312ba44700 1 -- 172.21.15.49:0/1915689652 wait complete. 2023-11-30T17:22:07.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.121+0000 7f312ba44700 1 Processor -- start 2023-11-30T17:22:07.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.121+0000 7f312ba44700 1 -- start start 2023-11-30T17:22:07.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.122+0000 7f312ba44700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3124064e20 0x7f31240a8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:07.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.122+0000 7f312ba44700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3124095e80 0x7f312414daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:07.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.122+0000 7f312ba44700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31241544d0 0x7f31241554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:07.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.122+0000 7f312ba44700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3124156b00 con 0x7f31241544d0 2023-11-30T17:22:07.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.122+0000 7f312ba44700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3124155ef0 con 0x7f3124064e20 2023-11-30T17:22:07.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.122+0000 7f312ba44700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31241561d0 con 0x7f3124095e80 2023-11-30T17:22:07.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.122+0000 7f3129fe1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31241544d0 0x7f31241554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:07.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.123+0000 7f3129fe1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31241544d0 0x7f31241554a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42456/0 (socket says 172.21.15.49:42456) 2023-11-30T17:22:07.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.123+0000 7f3129fe1700 1 -- 172.21.15.49:0/3131750821 learned_addr learned my addr 172.21.15.49:0/3131750821 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:07.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.123+0000 7f31297e0700 1 --2- 172.21.15.49:0/3131750821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3124064e20 0x7f31240a8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:07.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.123+0000 7f3128fdf700 1 --2- 172.21.15.49:0/3131750821 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3124095e80 0x7f312414daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:07.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.123+0000 7f3129fe1700 1 -- 172.21.15.49:0/3131750821 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3124095e80 msgr2=0x7f312414daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:07.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.123+0000 7f3129fe1700 1 --2- 172.21.15.49:0/3131750821 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3124095e80 0x7f312414daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:07.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.123+0000 7f3129fe1700 1 -- 172.21.15.49:0/3131750821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3124064e20 msgr2=0x7f31240a8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:07.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.123+0000 7f3129fe1700 1 --2- 172.21.15.49:0/3131750821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3124064e20 0x7f31240a8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:07.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.123+0000 7f3129fe1700 1 -- 172.21.15.49:0/3131750821 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31200092a0 con 0x7f31241544d0 2023-11-30T17:22:07.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.123+0000 7f31297e0700 1 --2- 172.21.15.49:0/3131750821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3124064e20 0x7f31240a8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:22:07.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.123+0000 7f3129fe1700 1 --2- 172.21.15.49:0/3131750821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31241544d0 0x7f31241554a0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f311c009fa0 tx=0x7f311c009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:07.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.123+0000 7f31197fa700 1 -- 172.21.15.49:0/3131750821 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311c00ebc0 con 0x7f31241544d0 2023-11-30T17:22:07.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.123+0000 7f31197fa700 1 -- 172.21.15.49:0/3131750821 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f311c00ed20 con 0x7f31241544d0 2023-11-30T17:22:07.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.123+0000 7f312ba44700 1 -- 172.21.15.49:0/3131750821 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31241564b0 con 0x7f31241544d0 2023-11-30T17:22:07.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.123+0000 7f31197fa700 1 -- 172.21.15.49:0/3131750821 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311c014610 con 0x7f31241544d0 2023-11-30T17:22:07.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.123+0000 7f312ba44700 1 -- 172.21.15.49:0/3131750821 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31240a8ef0 con 0x7f31241544d0 2023-11-30T17:22:07.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.124+0000 7f312ba44700 1 -- 172.21.15.49:0/3131750821 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3124156c70 con 0x7f31241544d0 2023-11-30T17:22:07.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.125+0000 7f31197fa700 1 -- 172.21.15.49:0/3131750821 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f311c01d3b0 con 0x7f31241544d0 2023-11-30T17:22:07.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.125+0000 7f31197fa700 1 --2- 172.21.15.49:0/3131750821 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f310805f270 0x7f3108061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:07.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.125+0000 7f31197fa700 1 -- 172.21.15.49:0/3131750821 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6551+0+0 (secure 0 0 0) 0x7f311c07aa10 con 0x7f31241544d0 2023-11-30T17:22:07.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.125+0000 7f31297e0700 1 -- 172.21.15.49:0/3131750821 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f310805f270 msgr2=0x7f3108061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:07.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.125+0000 7f31297e0700 1 --2- 172.21.15.49:0/3131750821 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f310805f270 0x7f3108061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:22:07.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.129+0000 7f31197fa700 1 -- 172.21.15.49:0/3131750821 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f311c04b950 con 0x7f31241544d0 2023-11-30T17:22:07.252 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:07.251+0000 7f0c99c3d680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T17:22:07.321 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:07.320+0000 7f0c99c3d680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T17:22:07.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.326+0000 7f31297e0700 1 -- 172.21.15.49:0/3131750821 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f310805f270 msgr2=0x7f3108061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:07.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.326+0000 7f31297e0700 1 --2- 172.21.15.49:0/3131750821 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f310805f270 0x7f3108061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:22:07.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.347+0000 7f312ba44700 1 -- 172.21.15.49:0/3131750821 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f312406c860 con 0x7f31241544d0 2023-11-30T17:22:07.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.348+0000 7f31197fa700 1 -- 172.21.15.49:0/3131750821 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4495 (secure 0 0 0) 0x7f311c04ef70 con 0x7f31241544d0 2023-11-30T17:22:07.349 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:07.349 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1605498959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1605498959},{"type":"v1","addr":"172.21.15.115:6836","nonce":1605498959}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1471786970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1471786970},{"type":"v1","addr":"172.21.15.115:6837","nonce":1471786970}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5763,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1757467688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1757467688},{"type":"v1","addr":"172.21.15.49:6834","nonce":1757467688}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:19:56.468670+0000","modified":"2023-11-30T17:19:59.475872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5766},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5766":{"gid":5766,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2424233798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2424233798},{"type":"v1","addr":"172.21.15.49:6835","nonce":2424233798}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-11-30T17:22:07.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.350+0000 7f312ba44700 1 -- 172.21.15.49:0/3131750821 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f310805f270 msgr2=0x7f3108061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:22:07.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.350+0000 7f312ba44700 1 --2- 172.21.15.49:0/3131750821 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f310805f270 0x7f3108061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:07.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.350+0000 7f312ba44700 1 -- 172.21.15.49:0/3131750821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31241544d0 msgr2=0x7f31241554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:07.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.350+0000 7f312ba44700 1 --2- 172.21.15.49:0/3131750821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31241544d0 0x7f31241554a0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f311c009fa0 tx=0x7f311c009900).stop 2023-11-30T17:22:07.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.350+0000 7f312ba44700 1 -- 172.21.15.49:0/3131750821 shutdown_connections 2023-11-30T17:22:07.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.350+0000 7f312ba44700 1 --2- 172.21.15.49:0/3131750821 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f310805f270 0x7f3108061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:07.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.350+0000 7f312ba44700 1 --2- 172.21.15.49:0/3131750821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31241544d0 0x7f31241554a0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:07.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.350+0000 7f312ba44700 1 --2- 172.21.15.49:0/3131750821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3124064e20 0x7f31240a8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:07.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.350+0000 7f312ba44700 1 --2- 172.21.15.49:0/3131750821 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3124095e80 0x7f312414daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:07.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.350+0000 7f312ba44700 1 -- 172.21.15.49:0/3131750821 >> 172.21.15.49:0/3131750821 conn(0x7f31240631d0 msgr2=0x7f31240c90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:07.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.350+0000 7f312ba44700 1 -- 172.21.15.49:0/3131750821 shutdown_connections 2023-11-30T17:22:07.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.350+0000 7f312ba44700 1 -- 172.21.15.49:0/3131750821 wait complete. 2023-11-30T17:22:07.353 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 24 2023-11-30T17:22:07.365 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:22:07.397 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:07.396+0000 7f0c99c3d680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T17:22:07.479 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:07.478+0000 7fa027b86680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T17:22:07.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.484+0000 7f9d7c5ab700 1 Processor -- start 2023-11-30T17:22:07.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.484+0000 7f9d7c5ab700 1 -- start start 2023-11-30T17:22:07.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.485+0000 7f9d7c5ab700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9d740ad6a0 0x7f9d74155550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:07.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.485+0000 7f9d7c5ab700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d740c6710 0x7f9d740c7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:07.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.485+0000 7f9d7c5ab700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9d740ada80 0x7f9d740c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:07.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.485+0000 7f9d7c5ab700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d74158ee0 con 0x7f9d740ad6a0 2023-11-30T17:22:07.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.485+0000 7f9d7c5ab700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d74155a40 con 0x7f9d740ada80 2023-11-30T17:22:07.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.485+0000 7f9d7c5ab700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d74158080 con 0x7f9d740c6710 2023-11-30T17:22:07.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.485+0000 7f9d7a347700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9d740ad6a0 0x7f9d74155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:07.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.485+0000 7f9d7a347700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9d740ad6a0 0x7f9d74155550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42458/0 (socket says 172.21.15.49:42458) 2023-11-30T17:22:07.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.485+0000 7f9d7a347700 1 -- 172.21.15.49:0/4261946465 learned_addr learned my addr 172.21.15.49:0/4261946465 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:07.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.486+0000 7f9d7ab48700 1 --2- 172.21.15.49:0/4261946465 >> v2:172.21.15.115:3300/0 conn(0x7f9d740ada80 0x7f9d740c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:07.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.486+0000 7f9d79b46700 1 --2- 172.21.15.49:0/4261946465 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d740c6710 0x7f9d740c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:07.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.486+0000 7f9d7a347700 1 -- 172.21.15.49:0/4261946465 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d740c6710 msgr2=0x7f9d740c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:07.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.486+0000 7f9d7a347700 1 --2- 172.21.15.49:0/4261946465 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d740c6710 0x7f9d740c7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:07.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.486+0000 7f9d7a347700 1 -- 172.21.15.49:0/4261946465 >> v2:172.21.15.115:3300/0 conn(0x7f9d740ada80 msgr2=0x7f9d740c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:07.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.486+0000 7f9d7a347700 1 --2- 172.21.15.49:0/4261946465 >> v2:172.21.15.115:3300/0 conn(0x7f9d740ada80 0x7f9d740c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:07.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.486+0000 7f9d7a347700 1 -- 172.21.15.49:0/4261946465 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d741582d0 con 0x7f9d740ad6a0 2023-11-30T17:22:07.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.486+0000 7f9d7ab48700 1 --2- 172.21.15.49:0/4261946465 >> v2:172.21.15.115:3300/0 conn(0x7f9d740ada80 0x7f9d740c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:22:07.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.486+0000 7f9d7a347700 1 --2- 172.21.15.49:0/4261946465 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d740ad6a0 0x7f9d74155550 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f9d740c6570 tx=0x7f9d640090f0).ready entity=mon.0 client_cookie=d89de03f67688b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:07.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.486+0000 7f9d79345700 1 -- 172.21.15.49:0/4261946465 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6400f510 con 0x7f9d740ad6a0 2023-11-30T17:22:07.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.486+0000 7f9d79345700 1 -- 172.21.15.49:0/4261946465 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6400f670 con 0x7f9d740ad6a0 2023-11-30T17:22:07.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.486+0000 7f9d79345700 1 -- 172.21.15.49:0/4261946465 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6400fa10 con 0x7f9d740ad6a0 2023-11-30T17:22:07.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.487+0000 7f9d7c5ab700 1 -- 172.21.15.49:0/4261946465 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d740ad6a0 msgr2=0x7f9d74155550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:07.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.487+0000 7f9d7c5ab700 1 --2- 172.21.15.49:0/4261946465 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d740ad6a0 0x7f9d74155550 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f9d740c6570 tx=0x7f9d640090f0).stop 2023-11-30T17:22:07.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.487+0000 7f9d7c5ab700 1 -- 172.21.15.49:0/4261946465 shutdown_connections 2023-11-30T17:22:07.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.487+0000 7f9d7c5ab700 1 --2- 172.21.15.49:0/4261946465 >> v2:172.21.15.115:3300/0 conn(0x7f9d740ada80 0x7f9d740c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:07.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.487+0000 7f9d7c5ab700 1 --2- 172.21.15.49:0/4261946465 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d740ad6a0 0x7f9d74155550 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:07.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.487+0000 7f9d7c5ab700 1 --2- 172.21.15.49:0/4261946465 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d740c6710 0x7f9d740c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:07.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.487+0000 7f9d7c5ab700 1 -- 172.21.15.49:0/4261946465 >> 172.21.15.49:0/4261946465 conn(0x7f9d740649c0 msgr2=0x7f9d74064dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:07.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.487+0000 7f9d7c5ab700 1 -- 172.21.15.49:0/4261946465 shutdown_connections 2023-11-30T17:22:07.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.487+0000 7f9d7c5ab700 1 -- 172.21.15.49:0/4261946465 wait complete. 2023-11-30T17:22:07.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.488+0000 7f9d7c5ab700 1 Processor -- start 2023-11-30T17:22:07.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.488+0000 7f9d7c5ab700 1 -- start start 2023-11-30T17:22:07.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.489+0000 7f9d7c5ab700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d740ad6a0 0x7f9d7414ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:07.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.489+0000 7f9d7c5ab700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d740ada80 0x7f9d74156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:07.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.489+0000 7f9d7c5ab700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d740c6710 0x7f9d7414e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:07.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.489+0000 7f9d7c5ab700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d740c4ff0 con 0x7f9d740ad6a0 2023-11-30T17:22:07.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.489+0000 7f9d7c5ab700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d74156ec0 con 0x7f9d740c6710 2023-11-30T17:22:07.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.489+0000 7f9d7c5ab700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d741571a0 con 0x7f9d740ada80 2023-11-30T17:22:07.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.489+0000 7f9d7a347700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d740ad6a0 0x7f9d7414ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:07.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.489+0000 7f9d7a347700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d740ad6a0 0x7f9d7414ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42468/0 (socket says 172.21.15.49:42468) 2023-11-30T17:22:07.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.489+0000 7f9d7a347700 1 -- 172.21.15.49:0/3810973342 learned_addr learned my addr 172.21.15.49:0/3810973342 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:07.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.489+0000 7f9d79b46700 1 --2- 172.21.15.49:0/3810973342 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d740ada80 0x7f9d74156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:07.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.489+0000 7f9d7ab48700 1 --2- 172.21.15.49:0/3810973342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d740c6710 0x7f9d7414e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:07.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.489+0000 7f9d79b46700 1 -- 172.21.15.49:0/3810973342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d740c6710 msgr2=0x7f9d7414e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:07.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.489+0000 7f9d79b46700 1 --2- 172.21.15.49:0/3810973342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d740c6710 0x7f9d7414e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:07.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.489+0000 7f9d79b46700 1 -- 172.21.15.49:0/3810973342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d740ad6a0 msgr2=0x7f9d7414ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:07.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.489+0000 7f9d79b46700 1 --2- 172.21.15.49:0/3810973342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d740ad6a0 0x7f9d7414ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:07.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.489+0000 7f9d79b46700 1 -- 172.21.15.49:0/3810973342 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d6c009a20 con 0x7f9d740ada80 2023-11-30T17:22:07.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.489+0000 7f9d7ab48700 1 --2- 172.21.15.49:0/3810973342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d740c6710 0x7f9d7414e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:22:07.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.489+0000 7f9d7a347700 1 --2- 172.21.15.49:0/3810973342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d740ad6a0 0x7f9d7414ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:22:07.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.489+0000 7f9d79b46700 1 --2- 172.21.15.49:0/3810973342 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d740ada80 0x7f9d74156670 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f9d7000e6c0 tx=0x7f9d70009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:07.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.490+0000 7f9d6a7fc700 1 -- 172.21.15.49:0/3810973342 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d70012600 con 0x7f9d740ada80 2023-11-30T17:22:07.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.490+0000 7f9d6a7fc700 1 -- 172.21.15.49:0/3810973342 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d70012760 con 0x7f9d740ada80 2023-11-30T17:22:07.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.490+0000 7f9d7c5ab700 1 -- 172.21.15.49:0/3810973342 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d64009370 con 0x7f9d740ada80 2023-11-30T17:22:07.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.490+0000 7f9d6a7fc700 1 -- 172.21.15.49:0/3810973342 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d70012ae0 con 0x7f9d740ada80 2023-11-30T17:22:07.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.490+0000 7f9d7c5ab700 1 -- 172.21.15.49:0/3810973342 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d740c2640 con 0x7f9d740ada80 2023-11-30T17:22:07.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.491+0000 7f9d6a7fc700 1 -- 172.21.15.49:0/3810973342 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f9d7001b400 con 0x7f9d740ada80 2023-11-30T17:22:07.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.491+0000 7f9d7c5ab700 1 -- 172.21.15.49:0/3810973342 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d7406c830 con 0x7f9d740ada80 2023-11-30T17:22:07.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.491+0000 7f9d6a7fc700 1 --2- 172.21.15.49:0/3810973342 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9d5805f270 0x7f9d58061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:07.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.491+0000 7f9d6a7fc700 1 -- 172.21.15.49:0/3810973342 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6551+0+0 (secure 0 0 0) 0x7f9d7007a7e0 con 0x7f9d740ada80 2023-11-30T17:22:07.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.491+0000 7f9d7a347700 1 -- 172.21.15.49:0/3810973342 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9d5805f270 msgr2=0x7f9d58061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:07.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.491+0000 7f9d7a347700 1 --2- 172.21.15.49:0/3810973342 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9d5805f270 0x7f9d58061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:22:07.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.496+0000 7f9d6a7fc700 1 -- 172.21.15.49:0/3810973342 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9d7004b720 con 0x7f9d740ada80 2023-11-30T17:22:07.544 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:07.543+0000 7f0c99c3d680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T17:22:07.553 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:07.552+0000 7fa027b86680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T17:22:07.614 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:07.613+0000 7f0c99c3d680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T17:22:07.632 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:07.631+0000 7fa027b86680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T17:22:07.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.692+0000 7f9d7a347700 1 -- 172.21.15.49:0/3810973342 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9d5805f270 msgr2=0x7f9d58061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:07.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.692+0000 7f9d7a347700 1 --2- 172.21.15.49:0/3810973342 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9d5805f270 0x7f9d58061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:22:07.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.712+0000 7f9d7c5ab700 1 -- 172.21.15.49:0/3810973342 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d740c9040 con 0x7f9d740ada80 2023-11-30T17:22:07.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.712+0000 7f9d6a7fc700 1 -- 172.21.15.49:0/3810973342 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4495 (secure 0 0 0) 0x7f9d7004ed40 con 0x7f9d740ada80 2023-11-30T17:22:07.714 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:07.714 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1605498959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1605498959},{"type":"v1","addr":"172.21.15.115:6836","nonce":1605498959}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1471786970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1471786970},{"type":"v1","addr":"172.21.15.115:6837","nonce":1471786970}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5763,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1757467688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1757467688},{"type":"v1","addr":"172.21.15.49:6834","nonce":1757467688}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:19:56.468670+0000","modified":"2023-11-30T17:19:59.475872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5766},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5766":{"gid":5766,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2424233798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2424233798},{"type":"v1","addr":"172.21.15.49:6835","nonce":2424233798}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-11-30T17:22:07.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.714+0000 7f9d7c5ab700 1 -- 172.21.15.49:0/3810973342 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9d5805f270 msgr2=0x7f9d58061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:22:07.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.714+0000 7f9d7c5ab700 1 --2- 172.21.15.49:0/3810973342 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9d5805f270 0x7f9d58061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:07.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.714+0000 7f9d7c5ab700 1 -- 172.21.15.49:0/3810973342 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d740ada80 msgr2=0x7f9d74156670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:07.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.714+0000 7f9d7c5ab700 1 --2- 172.21.15.49:0/3810973342 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d740ada80 0x7f9d74156670 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f9d7000e6c0 tx=0x7f9d70009060).stop 2023-11-30T17:22:07.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.714+0000 7f9d7c5ab700 1 -- 172.21.15.49:0/3810973342 shutdown_connections 2023-11-30T17:22:07.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.714+0000 7f9d7c5ab700 1 --2- 172.21.15.49:0/3810973342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d740c6710 0x7f9d7414e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:07.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.714+0000 7f9d7c5ab700 1 --2- 172.21.15.49:0/3810973342 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9d5805f270 0x7f9d58061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:07.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.714+0000 7f9d7c5ab700 1 --2- 172.21.15.49:0/3810973342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d740ad6a0 0x7f9d7414ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:07.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.714+0000 7f9d7c5ab700 1 --2- 172.21.15.49:0/3810973342 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d740ada80 0x7f9d74156670 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:07.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.714+0000 7f9d7c5ab700 1 -- 172.21.15.49:0/3810973342 >> 172.21.15.49:0/3810973342 conn(0x7f9d740649c0 msgr2=0x7f9d7415aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:07.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.715+0000 7f9d7c5ab700 1 -- 172.21.15.49:0/3810973342 shutdown_connections 2023-11-30T17:22:07.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.715+0000 7f9d7c5ab700 1 -- 172.21.15.49:0/3810973342 wait complete. 2023-11-30T17:22:07.717 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 24 2023-11-30T17:22:07.729 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:22:07.730 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:07.728+0000 7f0c99c3d680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T17:22:07.787 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:07.785+0000 7fa027b86680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T17:22:07.838 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:07.836+0000 7f0c99c3d680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:22:07.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.846+0000 7fd8a9338700 1 Processor -- start 2023-11-30T17:22:07.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.846+0000 7fd8a9338700 1 -- start start 2023-11-30T17:22:07.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.847+0000 7fd8a9338700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd8a40cae90 0x7fd8a40c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:07.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.847+0000 7fd8a9338700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd8a40ca180 0x7fd8a40c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:07.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.847+0000 7fd8a9338700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a40a9a90 con 0x7fd8a40caab0 2023-11-30T17:22:07.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.847+0000 7fd8a9338700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a40c1490 con 0x7fd8a40cae90 2023-11-30T17:22:07.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.847+0000 7fd8a9338700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a4154ce0 con 0x7fd8a40ca180 2023-11-30T17:22:07.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.847+0000 7fd8a27fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd8a40cae90 0x7fd8a40c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:07.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.847+0000 7fd8a27fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd8a40cae90 0x7fd8a40c0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42478/0 (socket says 172.21.15.49:42478) 2023-11-30T17:22:07.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.847+0000 7fd8a27fc700 1 -- 172.21.15.49:0/4101659885 learned_addr learned my addr 172.21.15.49:0/4101659885 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:07.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.847+0000 7fd8a37fe700 1 --2- 172.21.15.49:0/4101659885 >> v2:172.21.15.115:3300/0 conn(0x7fd8a40ca180 0x7fd8a40c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:07.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.847+0000 7fd8a1ffb700 1 -- 172.21.15.49:0/4101659885 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3641388320 0 0) 0x7fd8a40a9a90 con 0x7fd8a40caab0 2023-11-30T17:22:07.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.847+0000 7fd8a27fc700 1 -- 172.21.15.49:0/4101659885 >> v2:172.21.15.115:3300/0 conn(0x7fd8a40ca180 msgr2=0x7fd8a40c0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:07.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.847+0000 7fd8a27fc700 1 --2- 172.21.15.49:0/4101659885 >> v2:172.21.15.115:3300/0 conn(0x7fd8a40ca180 0x7fd8a40c0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:07.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.847+0000 7fd8a27fc700 1 -- 172.21.15.49:0/4101659885 >> v1:172.21.15.115:6789/0 conn(0x7fd8a40caab0 legacy=0x7fd8a40aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:07.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.847+0000 7fd8a27fc700 1 -- 172.21.15.49:0/4101659885 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a40aab80 con 0x7fd8a40cae90 2023-11-30T17:22:07.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.847+0000 7fd8a27fc700 1 --2- 172.21.15.49:0/4101659885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8a40cae90 0x7fd8a40c0ab0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fd8a40a9a00 tx=0x7fd8940090f0).ready entity=mon.0 client_cookie=9499b22e9a9db0e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:07.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.848+0000 7fd8a1ffb700 1 -- 172.21.15.49:0/4101659885 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89400b520 con 0x7fd8a40cae90 2023-11-30T17:22:07.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.848+0000 7fd8a1ffb700 1 -- 172.21.15.49:0/4101659885 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89400b680 con 0x7fd8a40cae90 2023-11-30T17:22:07.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.848+0000 7fd8a1ffb700 1 -- 172.21.15.49:0/4101659885 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89400ba00 con 0x7fd8a40cae90 2023-11-30T17:22:07.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.848+0000 7fd8a9338700 1 -- 172.21.15.49:0/4101659885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8a40cae90 msgr2=0x7fd8a40c0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:07.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.848+0000 7fd8a9338700 1 --2- 172.21.15.49:0/4101659885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8a40cae90 0x7fd8a40c0ab0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fd8a40a9a00 tx=0x7fd8940090f0).stop 2023-11-30T17:22:07.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.848+0000 7fd8a9338700 1 -- 172.21.15.49:0/4101659885 shutdown_connections 2023-11-30T17:22:07.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.848+0000 7fd8a9338700 1 --2- 172.21.15.49:0/4101659885 >> v2:172.21.15.115:3300/0 conn(0x7fd8a40ca180 0x7fd8a40c0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:07.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.848+0000 7fd8a9338700 1 --2- 172.21.15.49:0/4101659885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8a40cae90 0x7fd8a40c0ab0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:07.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.848+0000 7fd8a9338700 1 -- 172.21.15.49:0/4101659885 >> 172.21.15.49:0/4101659885 conn(0x7fd8a4094920 msgr2=0x7fd8a406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:07.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.848+0000 7fd8a9338700 1 -- 172.21.15.49:0/4101659885 shutdown_connections 2023-11-30T17:22:07.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.848+0000 7fd8a9338700 1 -- 172.21.15.49:0/4101659885 wait complete. 2023-11-30T17:22:07.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.850+0000 7fd8a9338700 1 Processor -- start 2023-11-30T17:22:07.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.850+0000 7fd8a9338700 1 -- start start 2023-11-30T17:22:07.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.850+0000 7fd8a9338700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8a40ca180 0x7fd8a414e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:07.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.850+0000 7fd8a9338700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8a40caab0 0x7fd8a40c2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:07.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.850+0000 7fd8a9338700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8a40cae90 0x7fd8a40c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:07.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.850+0000 7fd8a9338700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a414e980 con 0x7fd8a40cae90 2023-11-30T17:22:07.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.850+0000 7fd8a9338700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a414e6b0 con 0x7fd8a40caab0 2023-11-30T17:22:07.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.850+0000 7fd8a9338700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a4064f60 con 0x7fd8a40ca180 2023-11-30T17:22:07.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.850+0000 7fd8a37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8a40cae90 0x7fd8a40c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:07.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.850+0000 7fd8a37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8a40cae90 0x7fd8a40c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42482/0 (socket says 172.21.15.49:42482) 2023-11-30T17:22:07.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.851+0000 7fd8a37fe700 1 -- 172.21.15.49:0/1970201674 learned_addr learned my addr 172.21.15.49:0/1970201674 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:07.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.851+0000 7fd8a27fc700 1 --2- 172.21.15.49:0/1970201674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8a40caab0 0x7fd8a40c2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:07.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.851+0000 7fd8a2ffd700 1 --2- 172.21.15.49:0/1970201674 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8a40ca180 0x7fd8a414e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:07.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.851+0000 7fd8a27fc700 1 -- 172.21.15.49:0/1970201674 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8a40ca180 msgr2=0x7fd8a414e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:07.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.851+0000 7fd8a27fc700 1 --2- 172.21.15.49:0/1970201674 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8a40ca180 0x7fd8a414e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:07.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.851+0000 7fd8a27fc700 1 -- 172.21.15.49:0/1970201674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8a40cae90 msgr2=0x7fd8a40c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:07.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.851+0000 7fd8a27fc700 1 --2- 172.21.15.49:0/1970201674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8a40cae90 0x7fd8a40c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:07.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.851+0000 7fd8a27fc700 1 -- 172.21.15.49:0/1970201674 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd894009370 con 0x7fd8a40caab0 2023-11-30T17:22:07.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.851+0000 7fd8a37fe700 1 --2- 172.21.15.49:0/1970201674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8a40cae90 0x7fd8a40c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:22:07.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.851+0000 7fd8a27fc700 1 --2- 172.21.15.49:0/1970201674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8a40caab0 0x7fd8a40c2310 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7fd894014000 tx=0x7fd894017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:07.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.851+0000 7fd88affd700 1 -- 172.21.15.49:0/1970201674 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd894000bc0 con 0x7fd8a40caab0 2023-11-30T17:22:07.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.851+0000 7fd88affd700 1 -- 172.21.15.49:0/1970201674 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89400b7f0 con 0x7fd8a40caab0 2023-11-30T17:22:07.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.851+0000 7fd88affd700 1 -- 172.21.15.49:0/1970201674 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd894000d20 con 0x7fd8a40caab0 2023-11-30T17:22:07.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.851+0000 7fd8a9338700 1 -- 172.21.15.49:0/1970201674 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a4065240 con 0x7fd8a40caab0 2023-11-30T17:22:07.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.851+0000 7fd8a9338700 1 -- 172.21.15.49:0/1970201674 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a414ebd0 con 0x7fd8a40caab0 2023-11-30T17:22:07.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.852+0000 7fd8a9338700 1 -- 172.21.15.49:0/1970201674 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a406c860 con 0x7fd8a40caab0 2023-11-30T17:22:07.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.852+0000 7fd88affd700 1 -- 172.21.15.49:0/1970201674 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fd89401c860 con 0x7fd8a40caab0 2023-11-30T17:22:07.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.853+0000 7fd88affd700 1 --2- 172.21.15.49:0/1970201674 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd89005f270 0x7fd890061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:07.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.853+0000 7fd8a2ffd700 1 -- 172.21.15.49:0/1970201674 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd89005f270 msgr2=0x7fd890061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:07.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.853+0000 7fd88affd700 1 -- 172.21.15.49:0/1970201674 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6551+0+0 (secure 0 0 0) 0x7fd89407c010 con 0x7fd8a40caab0 2023-11-30T17:22:07.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.853+0000 7fd8a2ffd700 1 --2- 172.21.15.49:0/1970201674 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd89005f270 0x7fd890061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:22:07.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:07.857+0000 7fd88affd700 1 -- 172.21.15.49:0/1970201674 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd89404cfb0 con 0x7fd8a40caab0 2023-11-30T17:22:07.864 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:07.863+0000 7fa027b86680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T17:22:07.988 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:07.987+0000 7fa027b86680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T17:22:08.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.038+0000 7fd8a9338700 1 -- 172.21.15.49:0/1970201674 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8a40a8e80 con 0x7fd8a40caab0 2023-11-30T17:22:08.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.039+0000 7fd88affd700 1 -- 172.21.15.49:0/1970201674 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+17596 (secure 0 0 0) 0x7fd89402a020 con 0x7fd8a40caab0 2023-11-30T17:22:08.041 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:08.041 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":69,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:22:06.966578+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:19:54.153609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-30T17:19:55.451988+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":69,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.16","mappings":[{"from":0,"to":5}]},{"pgid":"7.2c","mappings":[{"from":0,"to":4}]},{"pgid":"8.c","mappings":[{"from":0,"to":6}]},{"pgid":"8.38","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/352667093":"2023-12-01T17:20:13.108922+0000","172.21.15.115:6832/89956":"2023-12-01T17:20:13.108922+0000","172.21.15.115:0/975065917":"2023-12-01T17:20:13.108922+0000","172.21.15.115:0/2727001384":"2023-12-01T17:20:13.108922+0000","172.21.15.115:6833/89956":"2023-12-01T17:20:13.108922+0000","172.21.15.115:0/4139500051":"2023-12-01T17:20:13.108922+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:22:08.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.041+0000 7fd8a9338700 1 -- 172.21.15.49:0/1970201674 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd89005f270 msgr2=0x7fd890061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:22:08.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.041+0000 7fd8a9338700 1 --2- 172.21.15.49:0/1970201674 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd89005f270 0x7fd890061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:08.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.041+0000 7fd8a9338700 1 -- 172.21.15.49:0/1970201674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8a40caab0 msgr2=0x7fd8a40c2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:08.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.041+0000 7fd8a9338700 1 --2- 172.21.15.49:0/1970201674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8a40caab0 0x7fd8a40c2310 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7fd894014000 tx=0x7fd894017000).stop 2023-11-30T17:22:08.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.042+0000 7fd8a9338700 1 -- 172.21.15.49:0/1970201674 shutdown_connections 2023-11-30T17:22:08.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.042+0000 7fd8a9338700 1 --2- 172.21.15.49:0/1970201674 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd89005f270 0x7fd890061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:08.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.042+0000 7fd8a9338700 1 --2- 172.21.15.49:0/1970201674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8a40cae90 0x7fd8a40c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:08.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.042+0000 7fd8a9338700 1 --2- 172.21.15.49:0/1970201674 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8a40ca180 0x7fd8a414e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:08.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.042+0000 7fd8a9338700 1 --2- 172.21.15.49:0/1970201674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8a40caab0 0x7fd8a40c2310 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:08.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.042+0000 7fd8a9338700 1 -- 172.21.15.49:0/1970201674 >> 172.21.15.49:0/1970201674 conn(0x7fd8a4094920 msgr2=0x7fd8a40ab530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:08.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.042+0000 7fd8a9338700 1 -- 172.21.15.49:0/1970201674 shutdown_connections 2023-11-30T17:22:08.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.042+0000 7fd8a9338700 1 -- 172.21.15.49:0/1970201674 wait complete. 2023-11-30T17:22:08.056 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-30T17:22:08.106 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:08.104+0000 7fa027b86680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:22:08.131 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:08.129+0000 7f0c99c3d680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T17:22:08.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.177+0000 7f98c732a700 1 Processor -- start 2023-11-30T17:22:08.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.177+0000 7f98c732a700 1 -- start start 2023-11-30T17:22:08.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.178+0000 7f98c732a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f98c0152510 0x7f98c00a67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:08.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.178+0000 7f98c732a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f98c00a6cd0 0x7f98c00bc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:08.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.178+0000 7f98c732a700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c0064090 con 0x7f98c00bcbb0 2023-11-30T17:22:08.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.178+0000 7f98c732a700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c0063480 con 0x7f98c00a6cd0 2023-11-30T17:22:08.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.178+0000 7f98c732a700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c0063760 con 0x7f98c0152510 2023-11-30T17:22:08.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.178+0000 7f98c48c5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f98c00a6cd0 0x7f98c00bc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:08.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.178+0000 7f98c48c5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f98c00a6cd0 0x7f98c00bc6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42496/0 (socket says 172.21.15.49:42496) 2023-11-30T17:22:08.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.178+0000 7f98c48c5700 1 -- 172.21.15.49:0/64807349 learned_addr learned my addr 172.21.15.49:0/64807349 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:08.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.178+0000 7f98c50c6700 1 --2- 172.21.15.49:0/64807349 >> v2:172.21.15.115:3300/0 conn(0x7f98c0152510 0x7f98c00a67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:08.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.179+0000 7f98c48c5700 1 -- 172.21.15.49:0/64807349 >> v2:172.21.15.115:3300/0 conn(0x7f98c0152510 msgr2=0x7f98c00a67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:08.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.179+0000 7f98c48c5700 1 --2- 172.21.15.49:0/64807349 >> v2:172.21.15.115:3300/0 conn(0x7f98c0152510 0x7f98c00a67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:08.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.179+0000 7f98c48c5700 1 -- 172.21.15.49:0/64807349 >> v1:172.21.15.115:6789/0 conn(0x7f98c00bcbb0 legacy=0x7f98c00c5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:08.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.179+0000 7f98c48c5700 1 -- 172.21.15.49:0/64807349 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c0063a40 con 0x7f98c00a6cd0 2023-11-30T17:22:08.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.179+0000 7f98c50c6700 1 --2- 172.21.15.49:0/64807349 >> v2:172.21.15.115:3300/0 conn(0x7f98c0152510 0x7f98c00a67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:08.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.179+0000 7f98c48c5700 1 --2- 172.21.15.49:0/64807349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98c00a6cd0 0x7f98c00bc6c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f98c0064940 tx=0x7f98bc009060).ready entity=mon.0 client_cookie=24c306bfecd49adc server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:08.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.179+0000 7f98b3fff700 1 -- 172.21.15.49:0/64807349 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98bc005880 con 0x7f98c00a6cd0 2023-11-30T17:22:08.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.179+0000 7f98b3fff700 1 -- 172.21.15.49:0/64807349 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98bc0059e0 con 0x7f98c00a6cd0 2023-11-30T17:22:08.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.179+0000 7f98b3fff700 1 -- 172.21.15.49:0/64807349 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98bc005d60 con 0x7f98c00a6cd0 2023-11-30T17:22:08.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.180+0000 7f98c732a700 1 -- 172.21.15.49:0/64807349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98c00a6cd0 msgr2=0x7f98c00bc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:08.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.180+0000 7f98c732a700 1 --2- 172.21.15.49:0/64807349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98c00a6cd0 0x7f98c00bc6c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f98c0064940 tx=0x7f98bc009060).stop 2023-11-30T17:22:08.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.180+0000 7f98c732a700 1 -- 172.21.15.49:0/64807349 shutdown_connections 2023-11-30T17:22:08.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.180+0000 7f98c732a700 1 --2- 172.21.15.49:0/64807349 >> v2:172.21.15.115:3300/0 conn(0x7f98c0152510 0x7f98c00a67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:08.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.180+0000 7f98c732a700 1 --2- 172.21.15.49:0/64807349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98c00a6cd0 0x7f98c00bc6c0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:08.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.180+0000 7f98c732a700 1 -- 172.21.15.49:0/64807349 >> 172.21.15.49:0/64807349 conn(0x7f98c00c8230 msgr2=0x7f98c00c4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:08.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.180+0000 7f98c732a700 1 -- 172.21.15.49:0/64807349 shutdown_connections 2023-11-30T17:22:08.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.180+0000 7f98c732a700 1 -- 172.21.15.49:0/64807349 wait complete. 2023-11-30T17:22:08.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.181+0000 7f98c732a700 1 Processor -- start 2023-11-30T17:22:08.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.181+0000 7f98c732a700 1 -- start start 2023-11-30T17:22:08.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.182+0000 7f98c732a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98c00a6cd0 0x7f98c01528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:08.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.182+0000 7f98c732a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98c00bcbb0 0x7f98c00a6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:08.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.182+0000 7f98c732a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98c0152510 0x7f98c01541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:08.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.182+0000 7f98c732a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c01546b0 con 0x7f98c00bcbb0 2023-11-30T17:22:08.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.182+0000 7f98c732a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c0168b60 con 0x7f98c0152510 2023-11-30T17:22:08.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.182+0000 7f98c732a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c0168df0 con 0x7f98c00a6cd0 2023-11-30T17:22:08.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.182+0000 7f98c48c5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98c00bcbb0 0x7f98c00a6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:08.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.182+0000 7f98c48c5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98c00bcbb0 0x7f98c00a6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42512/0 (socket says 172.21.15.49:42512) 2023-11-30T17:22:08.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.182+0000 7f98c48c5700 1 -- 172.21.15.49:0/2289530346 learned_addr learned my addr 172.21.15.49:0/2289530346 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:08.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.182+0000 7f98c50c6700 1 --2- 172.21.15.49:0/2289530346 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98c00a6cd0 0x7f98c01528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:08.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.182+0000 7f98c58c7700 1 --2- 172.21.15.49:0/2289530346 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98c0152510 0x7f98c01541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:08.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.182+0000 7f98c48c5700 1 -- 172.21.15.49:0/2289530346 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98c00a6cd0 msgr2=0x7f98c01528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:08.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.182+0000 7f98c48c5700 1 --2- 172.21.15.49:0/2289530346 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98c00a6cd0 0x7f98c01528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:08.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.182+0000 7f98c48c5700 1 -- 172.21.15.49:0/2289530346 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98c0152510 msgr2=0x7f98c01541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:08.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.182+0000 7f98c48c5700 1 --2- 172.21.15.49:0/2289530346 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98c0152510 0x7f98c01541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:08.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.182+0000 7f98c48c5700 1 -- 172.21.15.49:0/2289530346 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98bc009300 con 0x7f98c00bcbb0 2023-11-30T17:22:08.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.183+0000 7f98c48c5700 1 --2- 172.21.15.49:0/2289530346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98c00bcbb0 0x7f98c00a6040 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f98c0064220 tx=0x7f98bc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:08.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.183+0000 7f98b17fa700 1 -- 172.21.15.49:0/2289530346 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98bc006770 con 0x7f98c00bcbb0 2023-11-30T17:22:08.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.183+0000 7f98b17fa700 1 -- 172.21.15.49:0/2289530346 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98bc00b810 con 0x7f98c00bcbb0 2023-11-30T17:22:08.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.183+0000 7f98c732a700 1 -- 172.21.15.49:0/2289530346 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c00c39d0 con 0x7f98c00bcbb0 2023-11-30T17:22:08.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.183+0000 7f98b17fa700 1 -- 172.21.15.49:0/2289530346 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98bc00bbb0 con 0x7f98c00bcbb0 2023-11-30T17:22:08.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.183+0000 7f98c732a700 1 -- 172.21.15.49:0/2289530346 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c00c1e00 con 0x7f98c00bcbb0 2023-11-30T17:22:08.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.184+0000 7f98c732a700 1 -- 172.21.15.49:0/2289530346 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c006c860 con 0x7f98c00bcbb0 2023-11-30T17:22:08.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.185+0000 7f98b17fa700 1 -- 172.21.15.49:0/2289530346 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f98bc025460 con 0x7f98c00bcbb0 2023-11-30T17:22:08.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.185+0000 7f98b17fa700 1 --2- 172.21.15.49:0/2289530346 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f98a405f270 0x7f98a4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:08.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.185+0000 7f98b17fa700 1 -- 172.21.15.49:0/2289530346 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6551+0+0 (secure 0 0 0) 0x7f98bc07c0e0 con 0x7f98c00bcbb0 2023-11-30T17:22:08.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.185+0000 7f98c50c6700 1 -- 172.21.15.49:0/2289530346 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f98a405f270 msgr2=0x7f98a4061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:08.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.185+0000 7f98c50c6700 1 --2- 172.21.15.49:0/2289530346 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f98a405f270 0x7f98a4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:22:08.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.189+0000 7f98b17fa700 1 -- 172.21.15.49:0/2289530346 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f98bc04d0e0 con 0x7f98c00bcbb0 2023-11-30T17:22:08.201 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:08.200+0000 7f0c99c3d680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T17:22:08.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.224+0000 7f98b17fa700 1 -- 172.21.15.49:0/2289530346 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 22) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f98bc079c40 con 0x7f98c00bcbb0 2023-11-30T17:22:08.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.224+0000 7f98b17fa700 1 -- 172.21.15.49:0/2289530346 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f98a405f270 msgr2=0x7f98a4061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:22:08.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.224+0000 7f98b17fa700 1 --2- 172.21.15.49:0/2289530346 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f98a405f270 0x7f98a4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:08.282 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:08.280+0000 7f0c123cb700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:22:08.282 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:08.280+0000 7f0c123cb700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:22:08.282 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:08.280+0000 7f0c123cb700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:22:08.282 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:08.280+0000 7f0c123cb700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:22:08.282 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:08.280+0000 7f0c123cb700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:22:08.282 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:08.280+0000 7f0c163d3700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:22:08.282 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:08.280+0000 7f0c163d3700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:22:08.282 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:08.280+0000 7f0c163d3700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:22:08.282 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:08.280+0000 7f0c163d3700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:22:08.283 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:08.280+0000 7f0c163d3700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:22:08.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:08.411+0000 7f98c732a700 1 -- 172.21.15.49:0/2289530346 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f98c0063d20 con 0x7f98c00bcbb0 2023-11-30T17:22:08.415 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:08.414+0000 7fa027b86680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T17:22:08.492 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:08.490+0000 7fa027b86680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T17:22:09.218 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-11-30T17:22:09.217+0000 7f3888d95700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-30T17:22:09.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.223+0000 7f98b17fa700 1 -- 172.21.15.49:0/2289530346 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mgrmap(e 23) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f98bc079fc0 con 0x7f98c00bcbb0 2023-11-30T17:22:09.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.224+0000 7f98b17fa700 1 --2- 172.21.15.49:0/2289530346 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f98a405f270 0x7f98a40616b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:09.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.225+0000 7f98c50c6700 1 --2- 172.21.15.49:0/2289530346 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f98a405f270 0x7f98a40616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:09.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.226+0000 7f98c50c6700 1 --2- 172.21.15.49:0/2289530346 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f98a405f270 0x7f98a40616b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f98b400b410 tx=0x7f98b4008040).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:09.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.229+0000 7f98b17fa700 1 -- 172.21.15.49:0/2289530346 <== mon.0 v2:172.21.15.49:3300/0 9 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 161+0+0 (secure 0 0 0) 0x7f98bc04e0f0 con 0x7f98c00bcbb0 2023-11-30T17:22:09.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.231+0000 7f98c732a700 1 -- 172.21.15.49:0/2289530346 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f98a405f270 msgr2=0x7f98a40616b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:09.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.231+0000 7f98c732a700 1 --2- 172.21.15.49:0/2289530346 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f98a405f270 0x7f98a40616b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f98b400b410 tx=0x7f98b4008040).stop 2023-11-30T17:22:09.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.231+0000 7f98c732a700 1 -- 172.21.15.49:0/2289530346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98c00bcbb0 msgr2=0x7f98c00a6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:09.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.231+0000 7f98c732a700 1 --2- 172.21.15.49:0/2289530346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98c00bcbb0 0x7f98c00a6040 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f98c0064220 tx=0x7f98bc016000).stop 2023-11-30T17:22:09.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.231+0000 7f98c732a700 1 -- 172.21.15.49:0/2289530346 shutdown_connections 2023-11-30T17:22:09.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.231+0000 7f98c732a700 1 --2- 172.21.15.49:0/2289530346 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98c0152510 0x7f98c01541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:09.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.231+0000 7f98c732a700 1 --2- 172.21.15.49:0/2289530346 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98c00a6cd0 0x7f98c01528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:09.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.231+0000 7f98c732a700 1 --2- 172.21.15.49:0/2289530346 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f98a405f270 0x7f98a40616b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:09.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.231+0000 7f98c732a700 1 --2- 172.21.15.49:0/2289530346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98c00bcbb0 0x7f98c00a6040 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:09.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.231+0000 7f98c732a700 1 -- 172.21.15.49:0/2289530346 >> 172.21.15.49:0/2289530346 conn(0x7f98c00c8230 msgr2=0x7f98c0069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:09.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.231+0000 7f98c732a700 1 -- 172.21.15.49:0/2289530346 shutdown_connections 2023-11-30T17:22:09.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.231+0000 7f98c732a700 1 -- 172.21.15.49:0/2289530346 wait complete. 2023-11-30T17:22:09.234 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-30T17:22:09.247 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-30T17:22:09.265 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-11-30T17:22:09.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.369+0000 7f88e1b9c700 1 Processor -- start 2023-11-30T17:22:09.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.369+0000 7f88e1b9c700 1 -- start start 2023-11-30T17:22:09.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.369+0000 7f88e1b9c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f88dc098d10 0x7f88dc0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:09.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.369+0000 7f88e1b9c700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88dc0c72d0 con 0x7f88dc158320 2023-11-30T17:22:09.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.369+0000 7f88e1b9c700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88dc064570 con 0x7f88dc0c6190 2023-11-30T17:22:09.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.369+0000 7f88e1b9c700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88dc154bc0 con 0x7f88dc098d10 2023-11-30T17:22:09.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.370+0000 7f88db7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f88dc098d10 0x7f88dc0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:09.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.370+0000 7f88dbfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f88dc158320 0x7f88dc0a80f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55262/0 (socket says 172.21.15.49:55262) 2023-11-30T17:22:09.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.370+0000 7f88db7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f88dc098d10 0x7f88dc0c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42546/0 (socket says 172.21.15.49:42546) 2023-11-30T17:22:09.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.370+0000 7f88dbfff700 1 -- 172.21.15.49:0/3705025184 learned_addr learned my addr 172.21.15.49:0/3705025184 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:09.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.370+0000 7f88db7fe700 1 -- 172.21.15.49:0/3705025184 >> v1:172.21.15.115:6789/0 conn(0x7f88dc0c6190 legacy=0x7f88dc063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:09.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.370+0000 7f88db7fe700 1 -- 172.21.15.49:0/3705025184 >> v1:172.21.15.49:6789/0 conn(0x7f88dc158320 legacy=0x7f88dc0a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:09.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.370+0000 7f88da7fc700 1 -- 172.21.15.49:0/3705025184 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 867384509 0 0) 0x7f88dc064570 con 0x7f88dc0c6190 2023-11-30T17:22:09.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.370+0000 7f88db7fe700 1 -- 172.21.15.49:0/3705025184 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88dc0c66c0 con 0x7f88dc098d10 2023-11-30T17:22:09.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.370+0000 7f88db7fe700 1 --2- 172.21.15.49:0/3705025184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88dc098d10 0x7f88dc0c7760 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f88cc009760 tx=0x7f88cc009060).ready entity=mon.0 client_cookie=8701f3ae0644d053 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:09.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.370+0000 7f88da7fc700 1 -- 172.21.15.49:0/3705025184 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc00b580 con 0x7f88dc098d10 2023-11-30T17:22:09.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.370+0000 7f88da7fc700 1 -- 172.21.15.49:0/3705025184 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88cc00b6e0 con 0x7f88dc098d10 2023-11-30T17:22:09.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.370+0000 7f88da7fc700 1 -- 172.21.15.49:0/3705025184 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc00ba60 con 0x7f88dc098d10 2023-11-30T17:22:09.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.371+0000 7f88e1b9c700 1 -- 172.21.15.49:0/3705025184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88dc098d10 msgr2=0x7f88dc0c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:09.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.371+0000 7f88e1b9c700 1 --2- 172.21.15.49:0/3705025184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88dc098d10 0x7f88dc0c7760 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f88cc009760 tx=0x7f88cc009060).stop 2023-11-30T17:22:09.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.371+0000 7f88e1b9c700 1 -- 172.21.15.49:0/3705025184 shutdown_connections 2023-11-30T17:22:09.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.371+0000 7f88e1b9c700 1 --2- 172.21.15.49:0/3705025184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88dc098d10 0x7f88dc0c7760 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:09.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.371+0000 7f88e1b9c700 1 -- 172.21.15.49:0/3705025184 >> 172.21.15.49:0/3705025184 conn(0x7f88dc0cb310 msgr2=0x7f88dc0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:09.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.371+0000 7f88e1b9c700 1 -- 172.21.15.49:0/3705025184 shutdown_connections 2023-11-30T17:22:09.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.371+0000 7f88e1b9c700 1 -- 172.21.15.49:0/3705025184 wait complete. 2023-11-30T17:22:09.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.372+0000 7f88e1b9c700 1 Processor -- start 2023-11-30T17:22:09.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.372+0000 7f88e1b9c700 1 -- start start 2023-11-30T17:22:09.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.373+0000 7f88e1b9c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88dc098d10 0x7f88dc14b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:09.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.373+0000 7f88e1b9c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88dc0c6190 0x7f88dc0c0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:09.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.373+0000 7f88e1b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88dc158320 0x7f88dc0c1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:09.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.373+0000 7f88e1b9c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0c4920 con 0x7f88dc0c6190 2023-11-30T17:22:09.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.373+0000 7f88e1b9c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0c1630 con 0x7f88dc158320 2023-11-30T17:22:09.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.373+0000 7f88e1b9c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0c2550 con 0x7f88dc098d10 2023-11-30T17:22:09.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.373+0000 7f88daffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88dc0c6190 0x7f88dc0c0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:09.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.373+0000 7f88daffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88dc0c6190 0x7f88dc0c0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42550/0 (socket says 172.21.15.49:42550) 2023-11-30T17:22:09.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.373+0000 7f88daffd700 1 -- 172.21.15.49:0/4025696422 learned_addr learned my addr 172.21.15.49:0/4025696422 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:09.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.373+0000 7f88db7fe700 1 --2- 172.21.15.49:0/4025696422 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88dc098d10 0x7f88dc14b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:09.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.373+0000 7f88dbfff700 1 --2- 172.21.15.49:0/4025696422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88dc158320 0x7f88dc0c1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:09.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.373+0000 7f88daffd700 1 -- 172.21.15.49:0/4025696422 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88dc098d10 msgr2=0x7f88dc14b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:09.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.373+0000 7f88daffd700 1 --2- 172.21.15.49:0/4025696422 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88dc098d10 0x7f88dc14b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:09.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.373+0000 7f88daffd700 1 -- 172.21.15.49:0/4025696422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88dc158320 msgr2=0x7f88dc0c1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:09.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.373+0000 7f88daffd700 1 --2- 172.21.15.49:0/4025696422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88dc158320 0x7f88dc0c1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:09.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.373+0000 7f88daffd700 1 -- 172.21.15.49:0/4025696422 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88cc0092a0 con 0x7f88dc0c6190 2023-11-30T17:22:09.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.373+0000 7f88daffd700 1 --2- 172.21.15.49:0/4025696422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88dc0c6190 0x7f88dc0c0c50 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f88d0007fd0 tx=0x7f88d0007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:09.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.374+0000 7f88c37fe700 1 -- 172.21.15.49:0/4025696422 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d000ce20 con 0x7f88dc0c6190 2023-11-30T17:22:09.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.374+0000 7f88c37fe700 1 -- 172.21.15.49:0/4025696422 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d000f470 con 0x7f88dc0c6190 2023-11-30T17:22:09.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.374+0000 7f88e1b9c700 1 -- 172.21.15.49:0/4025696422 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88dc0c2830 con 0x7f88dc0c6190 2023-11-30T17:22:09.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.374+0000 7f88c37fe700 1 -- 172.21.15.49:0/4025696422 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d000f830 con 0x7f88dc0c6190 2023-11-30T17:22:09.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.374+0000 7f88e1b9c700 1 -- 172.21.15.49:0/4025696422 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88dc0c2df0 con 0x7f88dc0c6190 2023-11-30T17:22:09.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.375+0000 7f88e1b9c700 1 -- 172.21.15.49:0/4025696422 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88dc0c3160 con 0x7f88dc0c6190 2023-11-30T17:22:09.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.375+0000 7f88c37fe700 1 -- 172.21.15.49:0/4025696422 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 23) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f88d000fba0 con 0x7f88dc0c6190 2023-11-30T17:22:09.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.375+0000 7f88c37fe700 1 --2- 172.21.15.49:0/4025696422 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f88c805f000 0x7f88c80614c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:09.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.376+0000 7f88c37fe700 1 -- 172.21.15.49:0/4025696422 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f88d00796b0 con 0x7f88dc0c6190 2023-11-30T17:22:09.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.376+0000 7f88db7fe700 1 --2- 172.21.15.49:0/4025696422 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f88c805f000 0x7f88c80614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:09.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.376+0000 7f88db7fe700 1 --2- 172.21.15.49:0/4025696422 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f88c805f000 0x7f88c80614c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f88cc00b340 tx=0x7f88cc017000).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:09.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.380+0000 7f88c37fe700 1 -- 172.21.15.49:0/4025696422 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f88d004a8c0 con 0x7f88dc0c6190 2023-11-30T17:22:09.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:09.597+0000 7f88e1b9c700 1 -- 172.21.15.49:0/4025696422 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f88dc06c860 con 0x7f88dc0c6190 2023-11-30T17:22:10.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.233+0000 7f88c37fe700 1 -- 172.21.15.49:0/4025696422 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 104+0+0 (secure 0 0 0) 0x7f88d004dee0 con 0x7f88dc0c6190 2023-11-30T17:22:10.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.235+0000 7f88e1b9c700 1 -- 172.21.15.49:0/4025696422 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f88c805f000 msgr2=0x7f88c80614c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:10.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.235+0000 7f88e1b9c700 1 --2- 172.21.15.49:0/4025696422 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f88c805f000 0x7f88c80614c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f88cc00b340 tx=0x7f88cc017000).stop 2023-11-30T17:22:10.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.235+0000 7f88e1b9c700 1 -- 172.21.15.49:0/4025696422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88dc0c6190 msgr2=0x7f88dc0c0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:10.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.235+0000 7f88e1b9c700 1 --2- 172.21.15.49:0/4025696422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88dc0c6190 0x7f88dc0c0c50 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f88d0007fd0 tx=0x7f88d0007c40).stop 2023-11-30T17:22:10.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.235+0000 7f88e1b9c700 1 -- 172.21.15.49:0/4025696422 shutdown_connections 2023-11-30T17:22:10.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.235+0000 7f88e1b9c700 1 --2- 172.21.15.49:0/4025696422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88dc158320 0x7f88dc0c1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:10.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.235+0000 7f88e1b9c700 1 --2- 172.21.15.49:0/4025696422 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88dc098d10 0x7f88dc14b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:10.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.235+0000 7f88e1b9c700 1 --2- 172.21.15.49:0/4025696422 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f88c805f000 0x7f88c80614c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:10.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.235+0000 7f88e1b9c700 1 --2- 172.21.15.49:0/4025696422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88dc0c6190 0x7f88dc0c0c50 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:10.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.235+0000 7f88e1b9c700 1 -- 172.21.15.49:0/4025696422 >> 172.21.15.49:0/4025696422 conn(0x7f88dc0cb310 msgr2=0x7f88dc0ca520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:10.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.235+0000 7f88e1b9c700 1 -- 172.21.15.49:0/4025696422 shutdown_connections 2023-11-30T17:22:10.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.235+0000 7f88e1b9c700 1 -- 172.21.15.49:0/4025696422 wait complete. 2023-11-30T17:22:10.250 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-30T17:22:10.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.414+0000 7f64e571c700 1 Processor -- start 2023-11-30T17:22:10.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.415+0000 7f64e571c700 1 -- start start 2023-11-30T17:22:10.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.415+0000 7f64e571c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f64e00c5f30 0x7f64e00c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:10.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.415+0000 7f64e571c700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e00c68d0 con 0x7f64e0063af0 2023-11-30T17:22:10.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.415+0000 7f64e571c700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e0158e20 con 0x7f64e01373a0 2023-11-30T17:22:10.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.415+0000 7f64e571c700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e01582a0 con 0x7f64e00c5f30 2023-11-30T17:22:10.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.416+0000 7f64de7fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f64e00c5f30 0x7f64e00c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:10.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.416+0000 7f64df7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f64e0063af0 0x7f64e0063f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55266/0 (socket says 172.21.15.49:55266) 2023-11-30T17:22:10.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.416+0000 7f64de7fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f64e00c5f30 0x7f64e00c63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42566/0 (socket says 172.21.15.49:42566) 2023-11-30T17:22:10.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.416+0000 7f64de7fc700 1 -- 172.21.15.49:0/1547843116 learned_addr learned my addr 172.21.15.49:0/1547843116 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:10.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.416+0000 7f64de7fc700 1 -- 172.21.15.49:0/1547843116 >> v1:172.21.15.115:6789/0 conn(0x7f64e01373a0 legacy=0x7f64e00c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:10.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.416+0000 7f64de7fc700 1 -- 172.21.15.49:0/1547843116 >> v1:172.21.15.49:6789/0 conn(0x7f64e0063af0 legacy=0x7f64e0063f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:10.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.416+0000 7f64de7fc700 1 -- 172.21.15.49:0/1547843116 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e0158580 con 0x7f64e00c5f30 2023-11-30T17:22:10.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.416+0000 7f64de7fc700 1 --2- 172.21.15.49:0/1547843116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64e00c5f30 0x7f64e00c63e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f64c8006fd0 tx=0x7f64c80090f0).ready entity=mon.0 client_cookie=a8cabed18a431763 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:10.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.416+0000 7f64ddffb700 1 -- 172.21.15.49:0/1547843116 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c800b600 con 0x7f64e00c5f30 2023-11-30T17:22:10.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.416+0000 7f64ddffb700 1 -- 172.21.15.49:0/1547843116 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c800b760 con 0x7f64e00c5f30 2023-11-30T17:22:10.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.416+0000 7f64ddffb700 1 -- 172.21.15.49:0/1547843116 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c800bae0 con 0x7f64e00c5f30 2023-11-30T17:22:10.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.417+0000 7f64e571c700 1 -- 172.21.15.49:0/1547843116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64e00c5f30 msgr2=0x7f64e00c63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:10.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.417+0000 7f64e571c700 1 --2- 172.21.15.49:0/1547843116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64e00c5f30 0x7f64e00c63e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f64c8006fd0 tx=0x7f64c80090f0).stop 2023-11-30T17:22:10.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.417+0000 7f64e571c700 1 -- 172.21.15.49:0/1547843116 shutdown_connections 2023-11-30T17:22:10.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.417+0000 7f64e571c700 1 --2- 172.21.15.49:0/1547843116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64e00c5f30 0x7f64e00c63e0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:10.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.417+0000 7f64e571c700 1 -- 172.21.15.49:0/1547843116 >> 172.21.15.49:0/1547843116 conn(0x7f64e00628f0 msgr2=0x7f64e0062d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:10.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.417+0000 7f64e571c700 1 -- 172.21.15.49:0/1547843116 shutdown_connections 2023-11-30T17:22:10.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.417+0000 7f64e571c700 1 -- 172.21.15.49:0/1547843116 wait complete. 2023-11-30T17:22:10.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.418+0000 7f64e571c700 1 Processor -- start 2023-11-30T17:22:10.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.418+0000 7f64e571c700 1 -- start start 2023-11-30T17:22:10.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.419+0000 7f64e571c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64e0063af0 0x7f64e01568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:10.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.419+0000 7f64e571c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64e00c5f30 0x7f64e01530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:10.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.419+0000 7f64e571c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64e01373a0 0x7f64e0153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:10.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.419+0000 7f64e571c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e014e6a0 con 0x7f64e00c5f30 2023-11-30T17:22:10.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.419+0000 7f64e571c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e0153a80 con 0x7f64e01373a0 2023-11-30T17:22:10.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.419+0000 7f64e571c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e0157c40 con 0x7f64e0063af0 2023-11-30T17:22:10.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.419+0000 7f64de7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64e00c5f30 0x7f64e01530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:10.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.419+0000 7f64de7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64e00c5f30 0x7f64e01530a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42570/0 (socket says 172.21.15.49:42570) 2023-11-30T17:22:10.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.419+0000 7f64de7fc700 1 -- 172.21.15.49:0/1753401013 learned_addr learned my addr 172.21.15.49:0/1753401013 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:10.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.419+0000 7f64df7fe700 1 --2- 172.21.15.49:0/1753401013 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64e01373a0 0x7f64e0153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:10.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.419+0000 7f64deffd700 1 --2- 172.21.15.49:0/1753401013 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64e0063af0 0x7f64e01568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:10.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.419+0000 7f64de7fc700 1 -- 172.21.15.49:0/1753401013 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64e0063af0 msgr2=0x7f64e01568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:10.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.419+0000 7f64de7fc700 1 --2- 172.21.15.49:0/1753401013 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64e0063af0 0x7f64e01568a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:10.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.419+0000 7f64de7fc700 1 -- 172.21.15.49:0/1753401013 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64e01373a0 msgr2=0x7f64e0153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:10.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.419+0000 7f64de7fc700 1 --2- 172.21.15.49:0/1753401013 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64e01373a0 0x7f64e0153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:10.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.419+0000 7f64de7fc700 1 -- 172.21.15.49:0/1753401013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c8009370 con 0x7f64e00c5f30 2023-11-30T17:22:10.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.419+0000 7f64de7fc700 1 --2- 172.21.15.49:0/1753401013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64e00c5f30 0x7f64e01530a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f64e0067c10 tx=0x7f64c8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:10.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.419+0000 7f64d6ffd700 1 -- 172.21.15.49:0/1753401013 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c800b8d0 con 0x7f64e00c5f30 2023-11-30T17:22:10.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.419+0000 7f64d6ffd700 1 -- 172.21.15.49:0/1753401013 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c800ba30 con 0x7f64e00c5f30 2023-11-30T17:22:10.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.419+0000 7f64e571c700 1 -- 172.21.15.49:0/1753401013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e0156d90 con 0x7f64e00c5f30 2023-11-30T17:22:10.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.420+0000 7f64d6ffd700 1 -- 172.21.15.49:0/1753401013 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c801c670 con 0x7f64e00c5f30 2023-11-30T17:22:10.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.420+0000 7f64e571c700 1 -- 172.21.15.49:0/1753401013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e01575f0 con 0x7f64e00c5f30 2023-11-30T17:22:10.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.421+0000 7f64e571c700 1 -- 172.21.15.49:0/1753401013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e006c860 con 0x7f64e00c5f30 2023-11-30T17:22:10.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.421+0000 7f64d6ffd700 1 -- 172.21.15.49:0/1753401013 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 23) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f64c801ca20 con 0x7f64e00c5f30 2023-11-30T17:22:10.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.421+0000 7f64d6ffd700 1 --2- 172.21.15.49:0/1753401013 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f64c005f030 0x7f64c00614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:10.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.421+0000 7f64d6ffd700 1 -- 172.21.15.49:0/1753401013 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f64c807b9e0 con 0x7f64e00c5f30 2023-11-30T17:22:10.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.422+0000 7f64deffd700 1 --2- 172.21.15.49:0/1753401013 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f64c005f030 0x7f64c00614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:10.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.422+0000 7f64deffd700 1 --2- 172.21.15.49:0/1753401013 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f64c005f030 0x7f64c00614f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f64d8003840 tx=0x7f64d8007d40).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:10.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.426+0000 7f64d6ffd700 1 -- 172.21.15.49:0/1753401013 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f64c804cbf0 con 0x7f64e00c5f30 2023-11-30T17:22:10.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.600+0000 7f64e571c700 1 -- 172.21.15.49:0/1753401013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f64e0158860 con 0x7f64e00c5f30 2023-11-30T17:22:10.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:10.987+0000 7f64d6ffd700 1 -- 172.21.15.49:0/1753401013 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f64c80796f0 con 0x7f64e00c5f30 2023-11-30T17:22:11.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.238+0000 7f64d6ffd700 1 -- 172.21.15.49:0/1753401013 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v73) v1 ==== 181+0+0 (secure 0 0 0) 0x7f64c80432e0 con 0x7f64e00c5f30 2023-11-30T17:22:11.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.240+0000 7f64e571c700 1 -- 172.21.15.49:0/1753401013 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f64c005f030 msgr2=0x7f64c00614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:11.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.240+0000 7f64e571c700 1 --2- 172.21.15.49:0/1753401013 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f64c005f030 0x7f64c00614f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f64d8003840 tx=0x7f64d8007d40).stop 2023-11-30T17:22:11.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.240+0000 7f64e571c700 1 -- 172.21.15.49:0/1753401013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64e00c5f30 msgr2=0x7f64e01530a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:11.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.240+0000 7f64e571c700 1 --2- 172.21.15.49:0/1753401013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64e00c5f30 0x7f64e01530a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f64e0067c10 tx=0x7f64c8017000).stop 2023-11-30T17:22:11.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.240+0000 7f64e571c700 1 -- 172.21.15.49:0/1753401013 shutdown_connections 2023-11-30T17:22:11.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.240+0000 7f64e571c700 1 --2- 172.21.15.49:0/1753401013 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64e01373a0 0x7f64e0153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:11.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.240+0000 7f64e571c700 1 --2- 172.21.15.49:0/1753401013 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64e0063af0 0x7f64e01568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:11.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.240+0000 7f64e571c700 1 --2- 172.21.15.49:0/1753401013 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f64c005f030 0x7f64c00614f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:11.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.240+0000 7f64e571c700 1 --2- 172.21.15.49:0/1753401013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64e00c5f30 0x7f64e01530a0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:11.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.240+0000 7f64e571c700 1 -- 172.21.15.49:0/1753401013 >> 172.21.15.49:0/1753401013 conn(0x7f64e00628f0 msgr2=0x7f64e00643a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:11.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.240+0000 7f64e571c700 1 -- 172.21.15.49:0/1753401013 shutdown_connections 2023-11-30T17:22:11.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.240+0000 7f64e571c700 1 -- 172.21.15.49:0/1753401013 wait complete. 2023-11-30T17:22:11.244 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2023-11-30T17:22:11.259 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-30T17:22:11.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.379+0000 7fe1a1770700 1 Processor -- start 2023-11-30T17:22:11.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.379+0000 7fe1a1770700 1 -- start start 2023-11-30T17:22:11.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.379+0000 7fe1a1770700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe19c154910 0x7fe19c0a7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:11.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.379+0000 7fe1a1770700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe19c0aa220 0x7fe19c0aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:11.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.379+0000 7fe1a1770700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe19c0c6630 con 0x7fe19c154530 2023-11-30T17:22:11.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.379+0000 7fe1a1770700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe19c0c6390 con 0x7fe19c0aa220 2023-11-30T17:22:11.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.379+0000 7fe1a1770700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c0a84e0 con 0x7fe19c154910 2023-11-30T17:22:11.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.380+0000 7fe19a7fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe19c154910 0x7fe19c0a7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:11.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.380+0000 7fe19b7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe19c0aa220 0x7fe19c0aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:11.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.380+0000 7fe19a7fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe19c154910 0x7fe19c0a7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:35498/0 (socket says 172.21.15.49:35498) 2023-11-30T17:22:11.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.380+0000 7fe19a7fc700 1 -- 172.21.15.49:0/1268292931 learned_addr learned my addr 172.21.15.49:0/1268292931 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:11.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.380+0000 7fe19a7fc700 1 -- 172.21.15.49:0/1268292931 >> v2:172.21.15.115:3300/0 conn(0x7fe19c0aa220 msgr2=0x7fe19c0aa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:11.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.380+0000 7fe19a7fc700 1 --2- 172.21.15.49:0/1268292931 >> v2:172.21.15.115:3300/0 conn(0x7fe19c0aa220 0x7fe19c0aa6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:11.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.380+0000 7fe19a7fc700 1 -- 172.21.15.49:0/1268292931 >> v1:172.21.15.115:6789/0 conn(0x7fe19c154530 legacy=0x7fe19c0c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:11.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.380+0000 7fe19a7fc700 1 -- 172.21.15.49:0/1268292931 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19c0aaba0 con 0x7fe19c154910 2023-11-30T17:22:11.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.380+0000 7fe19b7fe700 1 --2- 172.21.15.49:0/1268292931 >> v2:172.21.15.115:3300/0 conn(0x7fe19c0aa220 0x7fe19c0aa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:22:11.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.381+0000 7fe19a7fc700 1 --2- 172.21.15.49:0/1268292931 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe19c154910 0x7fe19c0a7ff0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fe184006fd0 tx=0x7fe1840090f0).ready entity=mon.2 client_cookie=cf51efd65b6d7ca7 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:11.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.381+0000 7fe199ffb700 1 -- 172.21.15.49:0/1268292931 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18400b580 con 0x7fe19c154910 2023-11-30T17:22:11.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.381+0000 7fe199ffb700 1 -- 172.21.15.49:0/1268292931 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18400b6e0 con 0x7fe19c154910 2023-11-30T17:22:11.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.381+0000 7fe199ffb700 1 -- 172.21.15.49:0/1268292931 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18400ba60 con 0x7fe19c154910 2023-11-30T17:22:11.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.381+0000 7fe1a1770700 1 -- 172.21.15.49:0/1268292931 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe19c154910 msgr2=0x7fe19c0a7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:11.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.381+0000 7fe1a1770700 1 --2- 172.21.15.49:0/1268292931 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe19c154910 0x7fe19c0a7ff0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fe184006fd0 tx=0x7fe1840090f0).stop 2023-11-30T17:22:11.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.381+0000 7fe1a1770700 1 -- 172.21.15.49:0/1268292931 shutdown_connections 2023-11-30T17:22:11.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.381+0000 7fe1a1770700 1 --2- 172.21.15.49:0/1268292931 >> v2:172.21.15.115:3300/0 conn(0x7fe19c0aa220 0x7fe19c0aa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:11.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.381+0000 7fe1a1770700 1 --2- 172.21.15.49:0/1268292931 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe19c154910 0x7fe19c0a7ff0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:11.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.381+0000 7fe1a1770700 1 -- 172.21.15.49:0/1268292931 >> 172.21.15.49:0/1268292931 conn(0x7fe19c094930 msgr2=0x7fe19c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:11.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.381+0000 7fe1a1770700 1 -- 172.21.15.49:0/1268292931 shutdown_connections 2023-11-30T17:22:11.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.381+0000 7fe1a1770700 1 -- 172.21.15.49:0/1268292931 wait complete. 2023-11-30T17:22:11.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.382+0000 7fe1a1770700 1 Processor -- start 2023-11-30T17:22:11.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.383+0000 7fe1a1770700 1 -- start start 2023-11-30T17:22:11.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.383+0000 7fe1a1770700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe19c0aa220 0x7fe19c163cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:11.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.383+0000 7fe1a1770700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe19c154530 0x7fe19c0ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:11.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.383+0000 7fe1a1770700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe19c154910 0x7fe19c0c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:11.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.383+0000 7fe1a1770700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c1641e0 con 0x7fe19c0aa220 2023-11-30T17:22:11.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.383+0000 7fe1a1770700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c0c4370 con 0x7fe19c154910 2023-11-30T17:22:11.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.383+0000 7fe1a1770700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c0abcf0 con 0x7fe19c154530 2023-11-30T17:22:11.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.383+0000 7fe19affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe19c0aa220 0x7fe19c163cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:11.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.383+0000 7fe19affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe19c0aa220 0x7fe19c163cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51750/0 (socket says 172.21.15.49:51750) 2023-11-30T17:22:11.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.383+0000 7fe19affd700 1 -- 172.21.15.49:0/3477874758 learned_addr learned my addr 172.21.15.49:0/3477874758 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:11.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.384+0000 7fe19a7fc700 1 --2- 172.21.15.49:0/3477874758 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe19c154530 0x7fe19c0ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:11.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.384+0000 7fe19b7fe700 1 --2- 172.21.15.49:0/3477874758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe19c154910 0x7fe19c0c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:11.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.384+0000 7fe19affd700 1 -- 172.21.15.49:0/3477874758 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe19c154530 msgr2=0x7fe19c0ae230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:11.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.384+0000 7fe19affd700 1 --2- 172.21.15.49:0/3477874758 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe19c154530 0x7fe19c0ae230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:11.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.384+0000 7fe19affd700 1 -- 172.21.15.49:0/3477874758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe19c154910 msgr2=0x7fe19c0c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:11.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.384+0000 7fe19affd700 1 --2- 172.21.15.49:0/3477874758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe19c154910 0x7fe19c0c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:11.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.384+0000 7fe19affd700 1 -- 172.21.15.49:0/3477874758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18c0092a0 con 0x7fe19c0aa220 2023-11-30T17:22:11.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.384+0000 7fe19affd700 1 --2- 172.21.15.49:0/3477874758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe19c0aa220 0x7fe19c163cf0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fe19400c7f0 tx=0x7fe194001630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:11.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.384+0000 7fe192ffd700 1 -- 172.21.15.49:0/3477874758 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe194010510 con 0x7fe19c0aa220 2023-11-30T17:22:11.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.384+0000 7fe192ffd700 1 -- 172.21.15.49:0/3477874758 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe194010670 con 0x7fe19c0aa220 2023-11-30T17:22:11.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.384+0000 7fe1a1770700 1 -- 172.21.15.49:0/3477874758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe184009370 con 0x7fe19c0aa220 2023-11-30T17:22:11.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.384+0000 7fe192ffd700 1 -- 172.21.15.49:0/3477874758 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe194010a10 con 0x7fe19c0aa220 2023-11-30T17:22:11.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.384+0000 7fe1a1770700 1 -- 172.21.15.49:0/3477874758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe19c0c31e0 con 0x7fe19c0aa220 2023-11-30T17:22:11.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.385+0000 7fe1a1770700 1 -- 172.21.15.49:0/3477874758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe19c06c860 con 0x7fe19c0aa220 2023-11-30T17:22:11.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.385+0000 7fe192ffd700 1 -- 172.21.15.49:0/3477874758 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe19401b400 con 0x7fe19c0aa220 2023-11-30T17:22:11.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.386+0000 7fe192ffd700 1 --2- 172.21.15.49:0/3477874758 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe17c05f270 0x7fe17c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:11.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.386+0000 7fe192ffd700 1 -- 172.21.15.49:0/3477874758 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6285+0+0 (secure 0 0 0) 0x7fe19407a270 con 0x7fe19c0aa220 2023-11-30T17:22:11.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.386+0000 7fe19a7fc700 1 --2- 172.21.15.49:0/3477874758 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe17c05f270 0x7fe17c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:11.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.386+0000 7fe19a7fc700 1 --2- 172.21.15.49:0/3477874758 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe17c05f270 0x7fe17c061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe184009130 tx=0x7fe184017000).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:11.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.390+0000 7fe192ffd700 1 -- 172.21.15.49:0/3477874758 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe19404b2c0 con 0x7fe19c0aa220 2023-11-30T17:22:11.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:11.568+0000 7fe1a1770700 1 -- 172.21.15.49:0/3477874758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe19c064230 con 0x7fe19c0aa220 2023-11-30T17:22:12.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.242+0000 7fe192ffd700 1 -- 172.21.15.49:0/3477874758 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v74) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe19404e8e0 con 0x7fe19c0aa220 2023-11-30T17:22:12.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.246+0000 7fe1a1770700 1 -- 172.21.15.49:0/3477874758 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe17c05f270 msgr2=0x7fe17c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:12.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.246+0000 7fe1a1770700 1 --2- 172.21.15.49:0/3477874758 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe17c05f270 0x7fe17c061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe184009130 tx=0x7fe184017000).stop 2023-11-30T17:22:12.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.246+0000 7fe1a1770700 1 -- 172.21.15.49:0/3477874758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe19c0aa220 msgr2=0x7fe19c163cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:12.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.246+0000 7fe1a1770700 1 --2- 172.21.15.49:0/3477874758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe19c0aa220 0x7fe19c163cf0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fe19400c7f0 tx=0x7fe194001630).stop 2023-11-30T17:22:12.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.246+0000 7fe1a1770700 1 -- 172.21.15.49:0/3477874758 shutdown_connections 2023-11-30T17:22:12.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.246+0000 7fe1a1770700 1 --2- 172.21.15.49:0/3477874758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe19c154910 0x7fe19c0c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:12.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.246+0000 7fe1a1770700 1 --2- 172.21.15.49:0/3477874758 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe17c05f270 0x7fe17c061730 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:12.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.246+0000 7fe1a1770700 1 --2- 172.21.15.49:0/3477874758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe19c0aa220 0x7fe19c163cf0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:12.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.246+0000 7fe1a1770700 1 --2- 172.21.15.49:0/3477874758 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe19c154530 0x7fe19c0ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:12.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.246+0000 7fe1a1770700 1 -- 172.21.15.49:0/3477874758 >> 172.21.15.49:0/3477874758 conn(0x7fe19c094930 msgr2=0x7fe19c0c90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:12.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.247+0000 7fe1a1770700 1 -- 172.21.15.49:0/3477874758 shutdown_connections 2023-11-30T17:22:12.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.247+0000 7fe1a1770700 1 -- 172.21.15.49:0/3477874758 wait complete. 2023-11-30T17:22:12.250 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2023-11-30T17:22:12.264 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-30T17:22:12.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.385+0000 7f096b73f700 1 Processor -- start 2023-11-30T17:22:12.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.385+0000 7f096b73f700 1 -- start start 2023-11-30T17:22:12.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.386+0000 7f096b73f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0964158a30 0x7f09640c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:12.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.386+0000 7f096b73f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09640c72d0 con 0x7f09640c6190 2023-11-30T17:22:12.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.386+0000 7f096b73f700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0964064570 con 0x7f0964098d10 2023-11-30T17:22:12.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.386+0000 7f096b73f700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0964154bc0 con 0x7f0964158a30 2023-11-30T17:22:12.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.386+0000 7f0969cdc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0964158a30 0x7f09640c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:12.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.386+0000 7f0968cda700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f09640c6190 0x7f0964158320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39156/0 (socket says 172.21.15.49:39156) 2023-11-30T17:22:12.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.387+0000 7f0968cda700 1 -- 172.21.15.49:0/622062195 learned_addr learned my addr 172.21.15.49:0/622062195 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:12.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.387+0000 7f0969cdc700 1 -- 172.21.15.49:0/622062195 >> v1:172.21.15.115:6789/0 conn(0x7f0964098d10 legacy=0x7f0964063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:12.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.387+0000 7f0969cdc700 1 -- 172.21.15.49:0/622062195 >> v1:172.21.15.49:6789/0 conn(0x7f09640c6190 legacy=0x7f0964158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:12.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.387+0000 7f0969cdc700 1 -- 172.21.15.49:0/622062195 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09640c66c0 con 0x7f0964158a30 2023-11-30T17:22:12.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.387+0000 7f0963fff700 1 -- 172.21.15.49:0/622062195 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2938792716 0 0) 0x7f09640c72d0 con 0x7f09640c6190 2023-11-30T17:22:12.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.387+0000 7f0969cdc700 1 --2- 172.21.15.49:0/622062195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0964158a30 0x7f09640c7760 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f0954009e60 tx=0x7f0954009780).ready entity=mon.0 client_cookie=bd5456f862e51cba server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:12.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.387+0000 7f0963fff700 1 -- 172.21.15.49:0/622062195 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095400e070 con 0x7f0964158a30 2023-11-30T17:22:12.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.387+0000 7f0963fff700 1 -- 172.21.15.49:0/622062195 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095400bc30 con 0x7f0964158a30 2023-11-30T17:22:12.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.387+0000 7f0963fff700 1 -- 172.21.15.49:0/622062195 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0954012410 con 0x7f0964158a30 2023-11-30T17:22:12.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.388+0000 7f096b73f700 1 -- 172.21.15.49:0/622062195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0964158a30 msgr2=0x7f09640c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:12.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.388+0000 7f096b73f700 1 --2- 172.21.15.49:0/622062195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0964158a30 0x7f09640c7760 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f0954009e60 tx=0x7f0954009780).stop 2023-11-30T17:22:12.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.388+0000 7f096b73f700 1 -- 172.21.15.49:0/622062195 shutdown_connections 2023-11-30T17:22:12.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.388+0000 7f096b73f700 1 --2- 172.21.15.49:0/622062195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0964158a30 0x7f09640c7760 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:12.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.388+0000 7f096b73f700 1 -- 172.21.15.49:0/622062195 >> 172.21.15.49:0/622062195 conn(0x7f09640cb310 msgr2=0x7f09640cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:12.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.388+0000 7f096b73f700 1 -- 172.21.15.49:0/622062195 shutdown_connections 2023-11-30T17:22:12.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.388+0000 7f096b73f700 1 -- 172.21.15.49:0/622062195 wait complete. 2023-11-30T17:22:12.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.389+0000 7f096b73f700 1 Processor -- start 2023-11-30T17:22:12.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.389+0000 7f096b73f700 1 -- start start 2023-11-30T17:22:12.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.390+0000 7f096b73f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0964098d10 0x7f09641688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:12.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.390+0000 7f096b73f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09640c6190 0x7f09641568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:12.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.390+0000 7f096b73f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0964158a30 0x7f09640ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:12.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.390+0000 7f096b73f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0964168d90 con 0x7f0964098d10 2023-11-30T17:22:12.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.390+0000 7f096b73f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09640b0b40 con 0x7f09640c6190 2023-11-30T17:22:12.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.390+0000 7f096b73f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09640afaa0 con 0x7f0964158a30 2023-11-30T17:22:12.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.390+0000 7f09694db700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0964098d10 0x7f09641688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:12.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.390+0000 7f09694db700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0964098d10 0x7f09641688a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51764/0 (socket says 172.21.15.49:51764) 2023-11-30T17:22:12.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.390+0000 7f09694db700 1 -- 172.21.15.49:0/1502916600 learned_addr learned my addr 172.21.15.49:0/1502916600 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:12.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.390+0000 7f0969cdc700 1 --2- 172.21.15.49:0/1502916600 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0964158a30 0x7f09640ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:12.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.390+0000 7f0968cda700 1 --2- 172.21.15.49:0/1502916600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09640c6190 0x7f09641568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:12.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.390+0000 7f09694db700 1 -- 172.21.15.49:0/1502916600 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0964158a30 msgr2=0x7f09640ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:12.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.390+0000 7f09694db700 1 --2- 172.21.15.49:0/1502916600 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0964158a30 0x7f09640ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:12.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.390+0000 7f09694db700 1 -- 172.21.15.49:0/1502916600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09640c6190 msgr2=0x7f09641568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:12.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.390+0000 7f09694db700 1 --2- 172.21.15.49:0/1502916600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09640c6190 0x7f09641568b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:12.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.390+0000 7f09694db700 1 -- 172.21.15.49:0/1502916600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0954009a20 con 0x7f0964098d10 2023-11-30T17:22:12.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.390+0000 7f09694db700 1 --2- 172.21.15.49:0/1502916600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0964098d10 0x7f09641688a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f095c00c4c0 tx=0x7f095c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:12.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.390+0000 7f09617fa700 1 -- 172.21.15.49:0/1502916600 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c007020 con 0x7f0964098d10 2023-11-30T17:22:12.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.390+0000 7f09617fa700 1 -- 172.21.15.49:0/1502916600 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095c001e90 con 0x7f0964098d10 2023-11-30T17:22:12.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.390+0000 7f096b73f700 1 -- 172.21.15.49:0/1502916600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09640afd80 con 0x7f0964098d10 2023-11-30T17:22:12.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.391+0000 7f09617fa700 1 -- 172.21.15.49:0/1502916600 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c0073d0 con 0x7f0964098d10 2023-11-30T17:22:12.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.391+0000 7f096b73f700 1 -- 172.21.15.49:0/1502916600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09640b0340 con 0x7f0964098d10 2023-11-30T17:22:12.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.392+0000 7f096b73f700 1 -- 172.21.15.49:0/1502916600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09640b0990 con 0x7f0964098d10 2023-11-30T17:22:12.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.392+0000 7f09617fa700 1 -- 172.21.15.49:0/1502916600 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f095c0068b0 con 0x7f0964098d10 2023-11-30T17:22:12.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.392+0000 7f09617fa700 1 --2- 172.21.15.49:0/1502916600 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f095005f270 0x7f0950061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:12.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.392+0000 7f09617fa700 1 -- 172.21.15.49:0/1502916600 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5813+0+0 (secure 0 0 0) 0x7f095c079b80 con 0x7f0964098d10 2023-11-30T17:22:12.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.393+0000 7f0968cda700 1 --2- 172.21.15.49:0/1502916600 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f095005f270 0x7f0950061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:12.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.393+0000 7f0968cda700 1 --2- 172.21.15.49:0/1502916600 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f095005f270 0x7f0950061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f0964151660 tx=0x7f0958009040).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:12.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.396+0000 7f09617fa700 1 -- 172.21.15.49:0/1502916600 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f095c04ae00 con 0x7f0964098d10 2023-11-30T17:22:12.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.573+0000 7f096b73f700 1 -- 172.21.15.49:0/1502916600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f096406c860 con 0x7f0964098d10 2023-11-30T17:22:12.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.577+0000 7f09617fa700 1 -- 172.21.15.49:0/1502916600 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f095c04e420 con 0x7f0964098d10 2023-11-30T17:22:12.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.579+0000 7f096b73f700 1 -- 172.21.15.49:0/1502916600 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f095005f270 msgr2=0x7f0950061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:12.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.579+0000 7f096b73f700 1 --2- 172.21.15.49:0/1502916600 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f095005f270 0x7f0950061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f0964151660 tx=0x7f0958009040).stop 2023-11-30T17:22:12.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.579+0000 7f096b73f700 1 -- 172.21.15.49:0/1502916600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0964098d10 msgr2=0x7f09641688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:12.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.579+0000 7f096b73f700 1 --2- 172.21.15.49:0/1502916600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0964098d10 0x7f09641688a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f095c00c4c0 tx=0x7f095c007e00).stop 2023-11-30T17:22:12.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.579+0000 7f096b73f700 1 -- 172.21.15.49:0/1502916600 shutdown_connections 2023-11-30T17:22:12.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.579+0000 7f096b73f700 1 --2- 172.21.15.49:0/1502916600 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0964158a30 0x7f09640ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:12.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.579+0000 7f096b73f700 1 --2- 172.21.15.49:0/1502916600 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f095005f270 0x7f0950061730 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:12.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.579+0000 7f096b73f700 1 --2- 172.21.15.49:0/1502916600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0964098d10 0x7f09641688a0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:12.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.579+0000 7f096b73f700 1 --2- 172.21.15.49:0/1502916600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09640c6190 0x7f09641568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:12.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.579+0000 7f096b73f700 1 -- 172.21.15.49:0/1502916600 >> 172.21.15.49:0/1502916600 conn(0x7f09640cb310 msgr2=0x7f09640c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:12.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.579+0000 7f096b73f700 1 -- 172.21.15.49:0/1502916600 shutdown_connections 2023-11-30T17:22:12.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.579+0000 7f096b73f700 1 -- 172.21.15.49:0/1502916600 wait complete. 2023-11-30T17:22:12.593 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-11-30T17:22:12.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.710+0000 7ff27ddc2700 1 Processor -- start 2023-11-30T17:22:12.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.710+0000 7ff27ddc2700 1 -- start start 2023-11-30T17:22:12.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.711+0000 7ff27ddc2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff278154520 0x7ff2780a8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:12.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.711+0000 7ff27ddc2700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2780bf600 con 0x7ff278154900 2023-11-30T17:22:12.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.711+0000 7ff27ddc2700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2780a8930 con 0x7ff278066a70 2023-11-30T17:22:12.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.711+0000 7ff27ddc2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2780ca060 con 0x7ff278154520 2023-11-30T17:22:12.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.711+0000 7ff276ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff278154900 0x7ff2780bfa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39162/0 (socket says 172.21.15.49:39162) 2023-11-30T17:22:12.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.711+0000 7ff276ffd700 1 -- 172.21.15.49:0/2759062081 learned_addr learned my addr 172.21.15.49:0/2759062081 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:12.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.711+0000 7ff2777fe700 1 --2- 172.21.15.49:0/2759062081 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff278154520 0x7ff2780a8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:12.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.711+0000 7ff2767fc700 1 -- 172.21.15.49:0/2759062081 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1593378807 0 0) 0x7ff2780bf600 con 0x7ff278154900 2023-11-30T17:22:12.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.711+0000 7ff2767fc700 1 -- 172.21.15.49:0/2759062081 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2600033f0 con 0x7ff278154900 2023-11-30T17:22:12.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.711+0000 7ff2767fc700 1 -- 172.21.15.49:0/2759062081 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594002036 0 0) 0x7ff2780a8930 con 0x7ff278066a70 2023-11-30T17:22:12.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.711+0000 7ff2767fc700 1 -- 172.21.15.49:0/2759062081 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2780bf600 con 0x7ff278066a70 2023-11-30T17:22:12.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.711+0000 7ff2767fc700 1 -- 172.21.15.49:0/2759062081 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3487171195 0 0) 0x7ff2600033f0 con 0x7ff278154900 2023-11-30T17:22:12.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.711+0000 7ff2777fe700 1 -- 172.21.15.49:0/2759062081 >> v1:172.21.15.115:6789/0 conn(0x7ff278066a70 legacy=0x7ff278095e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:12.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.711+0000 7ff2777fe700 1 -- 172.21.15.49:0/2759062081 >> v1:172.21.15.49:6789/0 conn(0x7ff278154900 legacy=0x7ff2780bfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:12.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.711+0000 7ff2777fe700 1 -- 172.21.15.49:0/2759062081 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2780befb0 con 0x7ff278154520 2023-11-30T17:22:12.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.712+0000 7ff2777fe700 1 --2- 172.21.15.49:0/2759062081 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff278154520 0x7ff2780a8370 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7ff268009790 tx=0x7ff268009060).ready entity=mon.2 client_cookie=f77436c5ffa2f732 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:12.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.712+0000 7ff2767fc700 1 -- 172.21.15.49:0/2759062081 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c001470 con 0x7ff278154520 2023-11-30T17:22:12.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.712+0000 7ff2767fc700 1 -- 172.21.15.49:0/2759062081 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2680090d0 con 0x7ff278154520 2023-11-30T17:22:12.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.712+0000 7ff2767fc700 1 -- 172.21.15.49:0/2759062081 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff268011610 con 0x7ff278154520 2023-11-30T17:22:12.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.712+0000 7ff27ddc2700 1 -- 172.21.15.49:0/2759062081 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff278154520 msgr2=0x7ff2780a8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:12.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.712+0000 7ff27ddc2700 1 --2- 172.21.15.49:0/2759062081 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff278154520 0x7ff2780a8370 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7ff268009790 tx=0x7ff268009060).stop 2023-11-30T17:22:12.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.712+0000 7ff27ddc2700 1 -- 172.21.15.49:0/2759062081 shutdown_connections 2023-11-30T17:22:12.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.712+0000 7ff27ddc2700 1 --2- 172.21.15.49:0/2759062081 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff278154520 0x7ff2780a8370 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:12.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.712+0000 7ff27ddc2700 1 -- 172.21.15.49:0/2759062081 >> 172.21.15.49:0/2759062081 conn(0x7ff2780631d0 msgr2=0x7ff2780c9160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:12.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.712+0000 7ff27ddc2700 1 -- 172.21.15.49:0/2759062081 shutdown_connections 2023-11-30T17:22:12.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.712+0000 7ff27ddc2700 1 -- 172.21.15.49:0/2759062081 wait complete. 2023-11-30T17:22:12.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.714+0000 7ff27ddc2700 1 Processor -- start 2023-11-30T17:22:12.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.714+0000 7ff27ddc2700 1 -- start start 2023-11-30T17:22:12.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.714+0000 7ff27ddc2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff278066a70 0x7ff27813bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:12.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.714+0000 7ff27ddc2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff278154520 0x7ff278152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:12.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.714+0000 7ff27ddc2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff278154900 0x7ff2780ac310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:12.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.714+0000 7ff27ddc2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff278153a50 con 0x7ff278154520 2023-11-30T17:22:12.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.714+0000 7ff27ddc2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff278152e40 con 0x7ff278066a70 2023-11-30T17:22:12.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.714+0000 7ff27ddc2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff278153120 con 0x7ff278154900 2023-11-30T17:22:12.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.714+0000 7ff276ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff278154520 0x7ff278152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:12.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.714+0000 7ff276ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff278154520 0x7ff278152490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51766/0 (socket says 172.21.15.49:51766) 2023-11-30T17:22:12.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.714+0000 7ff276ffd700 1 -- 172.21.15.49:0/2392405542 learned_addr learned my addr 172.21.15.49:0/2392405542 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:12.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.715+0000 7ff2777fe700 1 --2- 172.21.15.49:0/2392405542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff278066a70 0x7ff27813bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:12.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.715+0000 7ff277fff700 1 --2- 172.21.15.49:0/2392405542 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff278154900 0x7ff2780ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:12.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.715+0000 7ff276ffd700 1 -- 172.21.15.49:0/2392405542 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff278154900 msgr2=0x7ff2780ac310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:12.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.715+0000 7ff276ffd700 1 --2- 172.21.15.49:0/2392405542 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff278154900 0x7ff2780ac310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:12.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.715+0000 7ff276ffd700 1 -- 172.21.15.49:0/2392405542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff278066a70 msgr2=0x7ff27813bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:12.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.715+0000 7ff276ffd700 1 --2- 172.21.15.49:0/2392405542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff278066a70 0x7ff27813bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:12.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.715+0000 7ff276ffd700 1 -- 172.21.15.49:0/2392405542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2680092a0 con 0x7ff278154520 2023-11-30T17:22:12.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.715+0000 7ff2777fe700 1 --2- 172.21.15.49:0/2392405542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff278066a70 0x7ff27813bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:12.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.715+0000 7ff276ffd700 1 --2- 172.21.15.49:0/2392405542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff278154520 0x7ff278152490 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7ff2780a8860 tx=0x7ff26c001a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:12.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.715+0000 7ff25f7fe700 1 -- 172.21.15.49:0/2392405542 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c007320 con 0x7ff278154520 2023-11-30T17:22:12.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.715+0000 7ff27ddc2700 1 -- 172.21.15.49:0/2392405542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff278153400 con 0x7ff278154520 2023-11-30T17:22:12.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.715+0000 7ff25f7fe700 1 -- 172.21.15.49:0/2392405542 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26c007480 con 0x7ff278154520 2023-11-30T17:22:12.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.715+0000 7ff25f7fe700 1 -- 172.21.15.49:0/2392405542 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c005970 con 0x7ff278154520 2023-11-30T17:22:12.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.715+0000 7ff27ddc2700 1 -- 172.21.15.49:0/2392405542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff27813c000 con 0x7ff278154520 2023-11-30T17:22:12.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.716+0000 7ff27ddc2700 1 -- 172.21.15.49:0/2392405542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff278153c00 con 0x7ff278154520 2023-11-30T17:22:12.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.716+0000 7ff25f7fe700 1 -- 172.21.15.49:0/2392405542 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff26c013410 con 0x7ff278154520 2023-11-30T17:22:12.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.717+0000 7ff25f7fe700 1 --2- 172.21.15.49:0/2392405542 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff26405f240 0x7ff264061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:12.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.717+0000 7ff25f7fe700 1 -- 172.21.15.49:0/2392405542 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5813+0+0 (secure 0 0 0) 0x7ff26c07a290 con 0x7ff278154520 2023-11-30T17:22:12.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.717+0000 7ff2777fe700 1 --2- 172.21.15.49:0/2392405542 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff26405f240 0x7ff264061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:12.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.717+0000 7ff2777fe700 1 --2- 172.21.15.49:0/2392405542 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff26405f240 0x7ff264061700 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7ff2680096e0 tx=0x7ff268016000).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:12.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.721+0000 7ff25f7fe700 1 -- 172.21.15.49:0/2392405542 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff26c04b510 con 0x7ff278154520 2023-11-30T17:22:12.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.894+0000 7ff27ddc2700 1 -- 172.21.15.49:0/2392405542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7ff2780ac110 con 0x7ff278154520 2023-11-30T17:22:12.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.898+0000 7ff25f7fe700 1 -- 172.21.15.49:0/2392405542 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v9) v1 ==== 120+0+0 (secure 0 0 0) 0x7ff26c001ac0 con 0x7ff278154520 2023-11-30T17:22:12.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.900+0000 7ff27ddc2700 1 -- 172.21.15.49:0/2392405542 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff26405f240 msgr2=0x7ff264061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:12.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.900+0000 7ff27ddc2700 1 --2- 172.21.15.49:0/2392405542 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff26405f240 0x7ff264061700 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7ff2680096e0 tx=0x7ff268016000).stop 2023-11-30T17:22:12.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.900+0000 7ff27ddc2700 1 -- 172.21.15.49:0/2392405542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff278154520 msgr2=0x7ff278152490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:12.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.900+0000 7ff27ddc2700 1 --2- 172.21.15.49:0/2392405542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff278154520 0x7ff278152490 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7ff2780a8860 tx=0x7ff26c001a50).stop 2023-11-30T17:22:12.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.900+0000 7ff27ddc2700 1 -- 172.21.15.49:0/2392405542 shutdown_connections 2023-11-30T17:22:12.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.900+0000 7ff27ddc2700 1 --2- 172.21.15.49:0/2392405542 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff278154900 0x7ff2780ac310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:12.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.900+0000 7ff27ddc2700 1 --2- 172.21.15.49:0/2392405542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff278066a70 0x7ff27813bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:12.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.900+0000 7ff27ddc2700 1 --2- 172.21.15.49:0/2392405542 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff26405f240 0x7ff264061700 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:12.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.900+0000 7ff27ddc2700 1 --2- 172.21.15.49:0/2392405542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff278154520 0x7ff278152490 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:12.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.900+0000 7ff27ddc2700 1 -- 172.21.15.49:0/2392405542 >> 172.21.15.49:0/2392405542 conn(0x7ff2780631d0 msgr2=0x7ff2780c90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:12.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.900+0000 7ff27ddc2700 1 -- 172.21.15.49:0/2392405542 shutdown_connections 2023-11-30T17:22:12.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:12.900+0000 7ff27ddc2700 1 -- 172.21.15.49:0/2392405542 wait complete. 2023-11-30T17:22:12.915 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-11-30T17:22:13.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.030+0000 7fbe8e1b6700 1 Processor -- start 2023-11-30T17:22:13.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.030+0000 7fbe8e1b6700 1 -- start start 2023-11-30T17:22:13.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.031+0000 7fbe8e1b6700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbe88157660 0x7fbe88157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:13.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.031+0000 7fbe8e1b6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe880c0180 0x7fbe881589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:13.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.031+0000 7fbe8e1b6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbe880c1750 0x7fbe880c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:13.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.031+0000 7fbe8e1b6700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe880c12c0 con 0x7fbe880c1750 2023-11-30T17:22:13.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.031+0000 7fbe8e1b6700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe880c06b0 con 0x7fbe88157660 2023-11-30T17:22:13.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.031+0000 7fbe8e1b6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe880c0990 con 0x7fbe880c0180 2023-11-30T17:22:13.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.031+0000 7fbe8d9b5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbe880c1750 0x7fbe880c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:13.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.031+0000 7fbe8d9b5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbe880c1750 0x7fbe880c1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51770/0 (socket says 172.21.15.49:51770) 2023-11-30T17:22:13.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.031+0000 7fbe8d9b5700 1 -- 172.21.15.49:0/1027519462 learned_addr learned my addr 172.21.15.49:0/1027519462 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:13.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.032+0000 7fbe8d1b4700 1 --2- 172.21.15.49:0/1027519462 >> v2:172.21.15.115:3300/0 conn(0x7fbe88157660 0x7fbe88157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:13.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.032+0000 7fbe8c9b3700 1 --2- 172.21.15.49:0/1027519462 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe880c0180 0x7fbe881589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:13.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.032+0000 7fbe8d9b5700 1 -- 172.21.15.49:0/1027519462 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe880c0180 msgr2=0x7fbe881589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:13.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.032+0000 7fbe8d9b5700 1 --2- 172.21.15.49:0/1027519462 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe880c0180 0x7fbe881589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:13.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.032+0000 7fbe8d9b5700 1 -- 172.21.15.49:0/1027519462 >> v2:172.21.15.115:3300/0 conn(0x7fbe88157660 msgr2=0x7fbe88157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:13.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.032+0000 7fbe8d9b5700 1 --2- 172.21.15.49:0/1027519462 >> v2:172.21.15.115:3300/0 conn(0x7fbe88157660 0x7fbe88157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:13.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.032+0000 7fbe8d9b5700 1 -- 172.21.15.49:0/1027519462 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe880c0c70 con 0x7fbe880c1750 2023-11-30T17:22:13.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.032+0000 7fbe8c9b3700 1 --2- 172.21.15.49:0/1027519462 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe880c0180 0x7fbe881589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:22:13.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.032+0000 7fbe8d9b5700 1 --2- 172.21.15.49:0/1027519462 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe880c1750 0x7fbe880c1ba0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7fbe880839a0 tx=0x7fbe780090f0).ready entity=mon.0 client_cookie=b4ce6a0063ebac4c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:13.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.032+0000 7fbe87fff700 1 -- 172.21.15.49:0/1027519462 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7800b600 con 0x7fbe880c1750 2023-11-30T17:22:13.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.032+0000 7fbe87fff700 1 -- 172.21.15.49:0/1027519462 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7800b760 con 0x7fbe880c1750 2023-11-30T17:22:13.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.032+0000 7fbe87fff700 1 -- 172.21.15.49:0/1027519462 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7800bae0 con 0x7fbe880c1750 2023-11-30T17:22:13.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.032+0000 7fbe8e1b6700 1 -- 172.21.15.49:0/1027519462 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe880c1750 msgr2=0x7fbe880c1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:13.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.032+0000 7fbe8e1b6700 1 --2- 172.21.15.49:0/1027519462 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe880c1750 0x7fbe880c1ba0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7fbe880839a0 tx=0x7fbe780090f0).stop 2023-11-30T17:22:13.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.032+0000 7fbe8e1b6700 1 -- 172.21.15.49:0/1027519462 shutdown_connections 2023-11-30T17:22:13.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.032+0000 7fbe8e1b6700 1 --2- 172.21.15.49:0/1027519462 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe880c1750 0x7fbe880c1ba0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:13.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.032+0000 7fbe8e1b6700 1 --2- 172.21.15.49:0/1027519462 >> v2:172.21.15.115:3300/0 conn(0x7fbe88157660 0x7fbe88157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:13.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.032+0000 7fbe8e1b6700 1 --2- 172.21.15.49:0/1027519462 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe880c0180 0x7fbe881589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:13.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.032+0000 7fbe8e1b6700 1 -- 172.21.15.49:0/1027519462 >> 172.21.15.49:0/1027519462 conn(0x7fbe880cb000 msgr2=0x7fbe880cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:13.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.033+0000 7fbe8e1b6700 1 -- 172.21.15.49:0/1027519462 shutdown_connections 2023-11-30T17:22:13.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.033+0000 7fbe8e1b6700 1 -- 172.21.15.49:0/1027519462 wait complete. 2023-11-30T17:22:13.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.034+0000 7fbe8e1b6700 1 Processor -- start 2023-11-30T17:22:13.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.034+0000 7fbe8e1b6700 1 -- start start 2023-11-30T17:22:13.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.035+0000 7fbe8e1b6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe880c0180 0x7fbe880aa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:13.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.035+0000 7fbe8e1b6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe880c1750 0x7fbe88152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:13.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.035+0000 7fbe8e1b6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe88157660 0x7fbe881541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:13.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.035+0000 7fbe8e1b6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe88163f40 con 0x7fbe880c1750 2023-11-30T17:22:13.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.035+0000 7fbe8e1b6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe88152540 con 0x7fbe880c0180 2023-11-30T17:22:13.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.035+0000 7fbe8e1b6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe88164a20 con 0x7fbe88157660 2023-11-30T17:22:13.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.035+0000 7fbe8c9b3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe880c1750 0x7fbe88152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:13.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.035+0000 7fbe8c9b3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe880c1750 0x7fbe88152050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51784/0 (socket says 172.21.15.49:51784) 2023-11-30T17:22:13.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.035+0000 7fbe8c9b3700 1 -- 172.21.15.49:0/1743965819 learned_addr learned my addr 172.21.15.49:0/1743965819 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:13.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.035+0000 7fbe8d1b4700 1 --2- 172.21.15.49:0/1743965819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe880c0180 0x7fbe880aa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:13.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.035+0000 7fbe8d9b5700 1 --2- 172.21.15.49:0/1743965819 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe88157660 0x7fbe881541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:13.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.035+0000 7fbe8c9b3700 1 -- 172.21.15.49:0/1743965819 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe88157660 msgr2=0x7fbe881541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:13.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.035+0000 7fbe8c9b3700 1 --2- 172.21.15.49:0/1743965819 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe88157660 0x7fbe881541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:13.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.035+0000 7fbe8c9b3700 1 -- 172.21.15.49:0/1743965819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe880c0180 msgr2=0x7fbe880aa6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:13.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.035+0000 7fbe8c9b3700 1 --2- 172.21.15.49:0/1743965819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe880c0180 0x7fbe880aa6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:13.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.035+0000 7fbe8c9b3700 1 -- 172.21.15.49:0/1743965819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe78009370 con 0x7fbe880c1750 2023-11-30T17:22:13.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.035+0000 7fbe8c9b3700 1 --2- 172.21.15.49:0/1743965819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe880c1750 0x7fbe88152050 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7fbe7c00c880 tx=0x7fbe7c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:13.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.035+0000 7fbe857fa700 1 -- 172.21.15.49:0/1743965819 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c010580 con 0x7fbe880c1750 2023-11-30T17:22:13.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.035+0000 7fbe857fa700 1 -- 172.21.15.49:0/1743965819 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7c0106e0 con 0x7fbe880c1750 2023-11-30T17:22:13.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.035+0000 7fbe8e1b6700 1 -- 172.21.15.49:0/1743965819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe88164130 con 0x7fbe880c1750 2023-11-30T17:22:13.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.035+0000 7fbe857fa700 1 -- 172.21.15.49:0/1743965819 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c010a60 con 0x7fbe880c1750 2023-11-30T17:22:13.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.036+0000 7fbe8e1b6700 1 -- 172.21.15.49:0/1743965819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe88154740 con 0x7fbe880c1750 2023-11-30T17:22:13.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.037+0000 7fbe8e1b6700 1 -- 172.21.15.49:0/1743965819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe8806c7c0 con 0x7fbe880c1750 2023-11-30T17:22:13.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.037+0000 7fbe857fa700 1 -- 172.21.15.49:0/1743965819 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fbe7c01b460 con 0x7fbe880c1750 2023-11-30T17:22:13.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.037+0000 7fbe857fa700 1 --2- 172.21.15.49:0/1743965819 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbe7405f270 0x7fbe74061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:13.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.037+0000 7fbe857fa700 1 -- 172.21.15.49:0/1743965819 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5813+0+0 (secure 0 0 0) 0x7fbe7c07a120 con 0x7fbe880c1750 2023-11-30T17:22:13.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.037+0000 7fbe8d1b4700 1 --2- 172.21.15.49:0/1743965819 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbe7405f270 0x7fbe74061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:13.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.038+0000 7fbe8d1b4700 1 --2- 172.21.15.49:0/1743965819 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbe7405f270 0x7fbe74061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fbe800075a0 tx=0x7fbe800097e0).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:13.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.041+0000 7fbe857fa700 1 -- 172.21.15.49:0/1743965819 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbe7c04b340 con 0x7fbe880c1750 2023-11-30T17:22:13.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:13.280+0000 7fbe8e1b6700 1 -- 172.21.15.49:0/1743965819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7fbe880c0f50 con 0x7fbe880c1750 2023-11-30T17:22:14.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.243+0000 7fbe857fa700 1 -- 172.21.15.49:0/1743965819 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v532) v1 ==== 154+0+0 (secure 0 0 0) 0x7fbe7c04e960 con 0x7fbe880c1750 2023-11-30T17:22:14.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.246+0000 7fbe8e1b6700 1 -- 172.21.15.49:0/1743965819 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbe7405f270 msgr2=0x7fbe74061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:14.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.246+0000 7fbe8e1b6700 1 --2- 172.21.15.49:0/1743965819 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbe7405f270 0x7fbe74061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fbe800075a0 tx=0x7fbe800097e0).stop 2023-11-30T17:22:14.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.246+0000 7fbe8e1b6700 1 -- 172.21.15.49:0/1743965819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe880c1750 msgr2=0x7fbe88152050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:14.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.246+0000 7fbe8e1b6700 1 --2- 172.21.15.49:0/1743965819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe880c1750 0x7fbe88152050 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7fbe7c00c880 tx=0x7fbe7c008040).stop 2023-11-30T17:22:14.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.246+0000 7fbe8e1b6700 1 -- 172.21.15.49:0/1743965819 shutdown_connections 2023-11-30T17:22:14.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.246+0000 7fbe8e1b6700 1 --2- 172.21.15.49:0/1743965819 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe88157660 0x7fbe881541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:14.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.246+0000 7fbe8e1b6700 1 --2- 172.21.15.49:0/1743965819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe880c0180 0x7fbe880aa6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:14.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.246+0000 7fbe8e1b6700 1 --2- 172.21.15.49:0/1743965819 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbe7405f270 0x7fbe74061730 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:14.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.246+0000 7fbe8e1b6700 1 --2- 172.21.15.49:0/1743965819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe880c1750 0x7fbe88152050 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:14.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.246+0000 7fbe8e1b6700 1 -- 172.21.15.49:0/1743965819 >> 172.21.15.49:0/1743965819 conn(0x7fbe880cb000 msgr2=0x7fbe880abbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:14.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.246+0000 7fbe8e1b6700 1 -- 172.21.15.49:0/1743965819 shutdown_connections 2023-11-30T17:22:14.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.246+0000 7fbe8e1b6700 1 -- 172.21.15.49:0/1743965819 wait complete. 2023-11-30T17:22:14.263 INFO:tasks.cephfs_test_runner:Test exisitence of multiple scheduled snapshots ... ok 2023-11-30T17:22:14.264 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing non-existing snap schedules failure 2023-11-30T17:22:14.264 INFO:tasks.cephfs_test_runner:test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-11-30T17:22:14.264 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-11-30T17:22:14.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.386+0000 7f38af759700 1 Processor -- start 2023-11-30T17:22:14.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.386+0000 7f38af759700 1 -- start start 2023-11-30T17:22:14.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.387+0000 7f38af759700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f38a8154500 0x7f38a80bc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:14.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.387+0000 7f38af759700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f38a80bc7f0 0x7f38a80c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:14.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.387+0000 7f38af759700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a8069b90 con 0x7f38a8154120 2023-11-30T17:22:14.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.387+0000 7f38af759700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a8065ca0 con 0x7f38a80bc7f0 2023-11-30T17:22:14.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.387+0000 7f38af759700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a8154960 con 0x7f38a8154500 2023-11-30T17:22:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.387+0000 7f38ad4f5700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f38a8154120 0x7f38a8065590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39164/0 (socket says 172.21.15.49:39164) 2023-11-30T17:22:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.387+0000 7f38ad4f5700 1 -- 172.21.15.49:0/69061124 learned_addr learned my addr 172.21.15.49:0/69061124 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.387+0000 7f38accf4700 1 --2- 172.21.15.49:0/69061124 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f38a8154500 0x7f38a80bc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.387+0000 7f38adcf6700 1 --2- 172.21.15.49:0/69061124 >> v2:172.21.15.115:3300/0 conn(0x7f38a80bc7f0 0x7f38a80c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.387+0000 7f389ffff700 1 -- 172.21.15.49:0/69061124 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54389916 0 0) 0x7f38a8069b90 con 0x7f38a8154120 2023-11-30T17:22:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.387+0000 7f389ffff700 1 -- 172.21.15.49:0/69061124 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38940033f0 con 0x7f38a8154120 2023-11-30T17:22:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.387+0000 7f389ffff700 1 -- 172.21.15.49:0/69061124 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 38487159 0 0) 0x7f38940033f0 con 0x7f38a8154120 2023-11-30T17:22:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.387+0000 7f389ffff700 1 -- 172.21.15.49:0/69061124 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f38a8154500 msgr2=0x7f38a80bc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.387+0000 7f389ffff700 1 --2- 172.21.15.49:0/69061124 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f38a8154500 0x7f38a80bc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.387+0000 7f389ffff700 1 -- 172.21.15.49:0/69061124 >> v2:172.21.15.115:3300/0 conn(0x7f38a80bc7f0 msgr2=0x7f38a80c1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.387+0000 7f389ffff700 1 --2- 172.21.15.49:0/69061124 >> v2:172.21.15.115:3300/0 conn(0x7f38a80bc7f0 0x7f38a80c1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.387+0000 7f389ffff700 1 -- 172.21.15.49:0/69061124 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a80bcc60 con 0x7f38a8154120 2023-11-30T17:22:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.387+0000 7f38accf4700 1 --2- 172.21.15.49:0/69061124 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f38a8154500 0x7f38a80bc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:22:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.387+0000 7f389ffff700 1 -- 172.21.15.49:0/69061124 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f38a4001470 con 0x7f38a8154120 2023-11-30T17:22:14.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.387+0000 7f389ffff700 1 -- 172.21.15.49:0/69061124 >> v1:172.21.15.49:6789/0 conn(0x7f38a8154120 legacy=0x7f38a8065590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:14.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.388+0000 7f389ffff700 1 --2- 172.21.15.49:0/69061124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3894003910 0x7f3894003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:14.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.388+0000 7f389ffff700 1 --2- 172.21.15.49:0/69061124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3894004690 0x7f3894004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:14.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.388+0000 7f389ffff700 1 --2- 172.21.15.49:0/69061124 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f38a8154500 0x7f3894005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:14.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.388+0000 7f389ffff700 1 -- 172.21.15.49:0/69061124 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a8065ca0 con 0x7f3894004690 2023-11-30T17:22:14.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.388+0000 7f389ffff700 1 -- 172.21.15.49:0/69061124 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a8154960 con 0x7f3894003910 2023-11-30T17:22:14.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.388+0000 7f389ffff700 1 -- 172.21.15.49:0/69061124 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f389400b8e0 con 0x7f38a8154500 2023-11-30T17:22:14.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.388+0000 7f38accf4700 1 --2- 172.21.15.49:0/69061124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3894004690 0x7f3894004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:14.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.388+0000 7f38ad4f5700 1 --2- 172.21.15.49:0/69061124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3894003910 0x7f3894003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:14.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.388+0000 7f38adcf6700 1 --2- 172.21.15.49:0/69061124 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f38a8154500 0x7f3894005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:14.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.388+0000 7f38accf4700 1 -- 172.21.15.49:0/69061124 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f38a8154500 msgr2=0x7f3894005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:14.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.388+0000 7f38accf4700 1 --2- 172.21.15.49:0/69061124 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f38a8154500 0x7f3894005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:14.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.388+0000 7f38accf4700 1 -- 172.21.15.49:0/69061124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3894003910 msgr2=0x7f3894003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:14.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.388+0000 7f38accf4700 1 --2- 172.21.15.49:0/69061124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3894003910 0x7f3894003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:14.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.388+0000 7f38accf4700 1 -- 172.21.15.49:0/69061124 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38980092a0 con 0x7f3894004690 2023-11-30T17:22:14.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.388+0000 7f38accf4700 1 --2- 172.21.15.49:0/69061124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3894004690 0x7f3894004b10 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f3898009c70 tx=0x7f3898009060).ready entity=mon.0 client_cookie=92828a1326660451 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:14.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.388+0000 7f389ffff700 1 -- 172.21.15.49:0/69061124 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38980095c0 con 0x7f3894004690 2023-11-30T17:22:14.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.388+0000 7f389ffff700 1 -- 172.21.15.49:0/69061124 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389800e690 con 0x7f3894004690 2023-11-30T17:22:14.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.388+0000 7f389ffff700 1 -- 172.21.15.49:0/69061124 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389800ea10 con 0x7f3894004690 2023-11-30T17:22:14.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.389+0000 7f38af759700 1 -- 172.21.15.49:0/69061124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3894004690 msgr2=0x7f3894004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:14.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.389+0000 7f38af759700 1 --2- 172.21.15.49:0/69061124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3894004690 0x7f3894004b10 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f3898009c70 tx=0x7f3898009060).stop 2023-11-30T17:22:14.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.389+0000 7f38adcf6700 1 -- 172.21.15.49:0/69061124 reap_dead start 2023-11-30T17:22:14.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.389+0000 7f38af759700 1 -- 172.21.15.49:0/69061124 shutdown_connections 2023-11-30T17:22:14.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.389+0000 7f38af759700 1 -- 172.21.15.49:0/69061124 >> 172.21.15.49:0/69061124 conn(0x7f38a806b510 msgr2=0x7f38a806b920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:14.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.389+0000 7f38af759700 1 -- 172.21.15.49:0/69061124 shutdown_connections 2023-11-30T17:22:14.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.389+0000 7f38af759700 1 -- 172.21.15.49:0/69061124 wait complete. 2023-11-30T17:22:14.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.390+0000 7f38af759700 1 Processor -- start 2023-11-30T17:22:14.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.390+0000 7f38af759700 1 -- start start 2023-11-30T17:22:14.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.391+0000 7f38af759700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3894004690 0x7f38a8154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:14.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.391+0000 7f38af759700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38a8147900 0x7f38a814c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:14.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.391+0000 7f38af759700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f38a8147d80 0x7f38a814ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:14.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.391+0000 7f38af759700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a8168c90 con 0x7f3894004690 2023-11-30T17:22:14.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.391+0000 7f38af759700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a814d330 con 0x7f38a8147900 2023-11-30T17:22:14.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.391+0000 7f38af759700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a80c0060 con 0x7f38a8147d80 2023-11-30T17:22:14.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.391+0000 7f38ad4f5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3894004690 0x7f38a8154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:14.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.391+0000 7f38ad4f5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3894004690 0x7f38a8154ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51798/0 (socket says 172.21.15.49:51798) 2023-11-30T17:22:14.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.391+0000 7f38ad4f5700 1 -- 172.21.15.49:0/157076694 learned_addr learned my addr 172.21.15.49:0/157076694 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:14.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.391+0000 7f38accf4700 1 --2- 172.21.15.49:0/157076694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38a8147900 0x7f38a814c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:14.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.391+0000 7f38adcf6700 1 --2- 172.21.15.49:0/157076694 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f38a8147d80 0x7f38a814ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:14.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.391+0000 7f38ad4f5700 1 -- 172.21.15.49:0/157076694 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f38a8147d80 msgr2=0x7f38a814ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:14.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.391+0000 7f38ad4f5700 1 --2- 172.21.15.49:0/157076694 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f38a8147d80 0x7f38a814ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:14.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.391+0000 7f38ad4f5700 1 -- 172.21.15.49:0/157076694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38a8147900 msgr2=0x7f38a814c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:14.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.391+0000 7f38ad4f5700 1 --2- 172.21.15.49:0/157076694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38a8147900 0x7f38a814c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:14.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.391+0000 7f38ad4f5700 1 -- 172.21.15.49:0/157076694 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a81689b0 con 0x7f3894004690 2023-11-30T17:22:14.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.391+0000 7f38accf4700 1 --2- 172.21.15.49:0/157076694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38a8147900 0x7f38a814c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:22:14.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.391+0000 7f38ad4f5700 1 --2- 172.21.15.49:0/157076694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3894004690 0x7f38a8154ae0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f38a4000e10 tx=0x7f38a80c1960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:14.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.392+0000 7f389d7fa700 1 -- 172.21.15.49:0/157076694 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a4011590 con 0x7f3894004690 2023-11-30T17:22:14.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.392+0000 7f389d7fa700 1 -- 172.21.15.49:0/157076694 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a40116f0 con 0x7f3894004690 2023-11-30T17:22:14.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.392+0000 7f38af759700 1 -- 172.21.15.49:0/157076694 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a80bfa10 con 0x7f3894004690 2023-11-30T17:22:14.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.392+0000 7f389d7fa700 1 -- 172.21.15.49:0/157076694 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a4011a70 con 0x7f3894004690 2023-11-30T17:22:14.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.392+0000 7f38af759700 1 -- 172.21.15.49:0/157076694 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a8167cc0 con 0x7f3894004690 2023-11-30T17:22:14.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.393+0000 7f38af759700 1 -- 172.21.15.49:0/157076694 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a80bf870 con 0x7f3894004690 2023-11-30T17:22:14.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.393+0000 7f389d7fa700 1 -- 172.21.15.49:0/157076694 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f38a401d3b0 con 0x7f3894004690 2023-11-30T17:22:14.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.393+0000 7f389d7fa700 1 --2- 172.21.15.49:0/157076694 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f388c05f270 0x7f388c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:14.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.394+0000 7f389d7fa700 1 -- 172.21.15.49:0/157076694 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5813+0+0 (secure 0 0 0) 0x7f38a4079a90 con 0x7f3894004690 2023-11-30T17:22:14.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.394+0000 7f38accf4700 1 --2- 172.21.15.49:0/157076694 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f388c05f270 0x7f388c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:14.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.394+0000 7f38accf4700 1 --2- 172.21.15.49:0/157076694 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f388c05f270 0x7f388c061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f38a8148a00 tx=0x7f389801a000).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:14.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.398+0000 7f389d7fa700 1 -- 172.21.15.49:0/157076694 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f38a80bf870 con 0x7f3894004690 2023-11-30T17:22:14.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:14.639+0000 7f38af759700 1 -- 172.21.15.49:0/157076694 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7f38a80bf870 con 0x7f3894004690 2023-11-30T17:22:15.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.245+0000 7f389d7fa700 1 -- 172.21.15.49:0/157076694 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v533) v1 ==== 159+0+0 (secure 0 0 0) 0x7f38a80bf870 con 0x7f3894004690 2023-11-30T17:22:15.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.247+0000 7f38af759700 1 -- 172.21.15.49:0/157076694 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f388c05f270 msgr2=0x7f388c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:15.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.247+0000 7f38af759700 1 --2- 172.21.15.49:0/157076694 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f388c05f270 0x7f388c061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f38a8148a00 tx=0x7f389801a000).stop 2023-11-30T17:22:15.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.247+0000 7f38af759700 1 -- 172.21.15.49:0/157076694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3894004690 msgr2=0x7f38a8154ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:15.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.247+0000 7f38af759700 1 --2- 172.21.15.49:0/157076694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3894004690 0x7f38a8154ae0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f38a4000e10 tx=0x7f38a80c1960).stop 2023-11-30T17:22:15.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.247+0000 7f38af759700 1 -- 172.21.15.49:0/157076694 shutdown_connections 2023-11-30T17:22:15.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.247+0000 7f38af759700 1 --2- 172.21.15.49:0/157076694 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f38a8147d80 0x7f38a814ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:15.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.247+0000 7f38af759700 1 --2- 172.21.15.49:0/157076694 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f388c05f270 0x7f388c061730 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:15.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.247+0000 7f38af759700 1 --2- 172.21.15.49:0/157076694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3894004690 0x7f38a8154ae0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:15.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.247+0000 7f38af759700 1 --2- 172.21.15.49:0/157076694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38a8147900 0x7f38a814c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:15.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.247+0000 7f38af759700 1 -- 172.21.15.49:0/157076694 >> 172.21.15.49:0/157076694 conn(0x7f38a806b510 msgr2=0x7f38a8153160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:15.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.247+0000 7f38af759700 1 -- 172.21.15.49:0/157076694 shutdown_connections 2023-11-30T17:22:15.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.247+0000 7f38af759700 1 -- 172.21.15.49:0/157076694 wait complete. 2023-11-30T17:22:15.263 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-30T17:22:15.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.382+0000 7f62a82a6700 1 Processor -- start 2023-11-30T17:22:15.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.383+0000 7f62a82a6700 1 -- start start 2023-11-30T17:22:15.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.383+0000 7f62a82a6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62a0098d10 0x7f62a00c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:15.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.383+0000 7f62a82a6700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f62a00c6190 0x7f62a0063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:15.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.383+0000 7f62a82a6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f62a0064350 0x7f62a0158320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:15.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.383+0000 7f62a82a6700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62a00c72d0 con 0x7f62a0064350 2023-11-30T17:22:15.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.383+0000 7f62a82a6700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62a0154bc0 con 0x7f62a00c6190 2023-11-30T17:22:15.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.383+0000 7f62a82a6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a00c66c0 con 0x7f62a0098d10 2023-11-30T17:22:15.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.384+0000 7f62a6843700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f62a0064350 0x7f62a0158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:15.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.384+0000 7f62a6843700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f62a0064350 0x7f62a0158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51802/0 (socket says 172.21.15.49:51802) 2023-11-30T17:22:15.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.384+0000 7f62a6843700 1 -- 172.21.15.49:0/2221011927 learned_addr learned my addr 172.21.15.49:0/2221011927 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:15.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.384+0000 7f62a6042700 1 --2- 172.21.15.49:0/2221011927 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62a0098d10 0x7f62a00c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:15.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.384+0000 7f62a5841700 1 --2- 172.21.15.49:0/2221011927 >> v2:172.21.15.115:3300/0 conn(0x7f62a00c6190 0x7f62a0063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:15.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.384+0000 7f62a6843700 1 -- 172.21.15.49:0/2221011927 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62a0098d10 msgr2=0x7f62a00c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:15.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.384+0000 7f62a6843700 1 --2- 172.21.15.49:0/2221011927 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62a0098d10 0x7f62a00c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:15.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.384+0000 7f62a6843700 1 -- 172.21.15.49:0/2221011927 >> v2:172.21.15.115:3300/0 conn(0x7f62a00c6190 msgr2=0x7f62a0063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:15.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.384+0000 7f62a6843700 1 --2- 172.21.15.49:0/2221011927 >> v2:172.21.15.115:3300/0 conn(0x7f62a00c6190 0x7f62a0063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:15.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.384+0000 7f62a6843700 1 -- 172.21.15.49:0/2221011927 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a00c69a0 con 0x7f62a0064350 2023-11-30T17:22:15.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.384+0000 7f62a6843700 1 --2- 172.21.15.49:0/2221011927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62a0064350 0x7f62a0158320 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f62a00c8e20 tx=0x7f6290009840).ready entity=mon.0 client_cookie=de69a13c580e059e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:15.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.384+0000 7f62a5040700 1 -- 172.21.15.49:0/2221011927 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629000e070 con 0x7f62a0064350 2023-11-30T17:22:15.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.384+0000 7f62a5040700 1 -- 172.21.15.49:0/2221011927 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629000ba50 con 0x7f62a0064350 2023-11-30T17:22:15.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.384+0000 7f62a5040700 1 -- 172.21.15.49:0/2221011927 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629000bdd0 con 0x7f62a0064350 2023-11-30T17:22:15.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.385+0000 7f62a82a6700 1 -- 172.21.15.49:0/2221011927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62a0064350 msgr2=0x7f62a0158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:15.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.385+0000 7f62a82a6700 1 --2- 172.21.15.49:0/2221011927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62a0064350 0x7f62a0158320 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f62a00c8e20 tx=0x7f6290009840).stop 2023-11-30T17:22:15.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.385+0000 7f62a82a6700 1 -- 172.21.15.49:0/2221011927 shutdown_connections 2023-11-30T17:22:15.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.385+0000 7f62a82a6700 1 --2- 172.21.15.49:0/2221011927 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62a0098d10 0x7f62a00c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:15.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.385+0000 7f62a82a6700 1 --2- 172.21.15.49:0/2221011927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62a0064350 0x7f62a0158320 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:15.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.385+0000 7f62a82a6700 1 --2- 172.21.15.49:0/2221011927 >> v2:172.21.15.115:3300/0 conn(0x7f62a00c6190 0x7f62a0063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:15.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.385+0000 7f62a82a6700 1 -- 172.21.15.49:0/2221011927 >> 172.21.15.49:0/2221011927 conn(0x7f62a00cb310 msgr2=0x7f62a00cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:15.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.385+0000 7f62a82a6700 1 -- 172.21.15.49:0/2221011927 shutdown_connections 2023-11-30T17:22:15.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.385+0000 7f62a82a6700 1 -- 172.21.15.49:0/2221011927 wait complete. 2023-11-30T17:22:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.386+0000 7f62a82a6700 1 Processor -- start 2023-11-30T17:22:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.386+0000 7f62a82a6700 1 -- start start 2023-11-30T17:22:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.387+0000 7f62a82a6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62a0064350 0x7f62a00aad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.387+0000 7f62a82a6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62a0098d10 0x7f62a0157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.387+0000 7f62a82a6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62a00c6190 0x7f62a0155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.387+0000 7f62a82a6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a00a8230 con 0x7f62a0098d10 2023-11-30T17:22:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.387+0000 7f62a82a6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a00a8db0 con 0x7f62a00c6190 2023-11-30T17:22:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.387+0000 7f62a82a6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a00a8480 con 0x7f62a0064350 2023-11-30T17:22:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.387+0000 7f62a5841700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62a0098d10 0x7f62a0157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.387+0000 7f62a5841700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62a0098d10 0x7f62a0157710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51816/0 (socket says 172.21.15.49:51816) 2023-11-30T17:22:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.387+0000 7f62a5841700 1 -- 172.21.15.49:0/2747911660 learned_addr learned my addr 172.21.15.49:0/2747911660 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.387+0000 7f62a6042700 1 --2- 172.21.15.49:0/2747911660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62a0064350 0x7f62a00aad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.387+0000 7f62a6843700 1 --2- 172.21.15.49:0/2747911660 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62a00c6190 0x7f62a0155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.387+0000 7f62a5841700 1 -- 172.21.15.49:0/2747911660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62a0064350 msgr2=0x7f62a00aad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.387+0000 7f62a5841700 1 --2- 172.21.15.49:0/2747911660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62a0064350 0x7f62a00aad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.387+0000 7f62a5841700 1 -- 172.21.15.49:0/2747911660 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62a00c6190 msgr2=0x7f62a0155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.387+0000 7f62a5841700 1 --2- 172.21.15.49:0/2747911660 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62a00c6190 0x7f62a0155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.387+0000 7f62a5841700 1 -- 172.21.15.49:0/2747911660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6290009ae0 con 0x7f62a0098d10 2023-11-30T17:22:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.387+0000 7f62a5841700 1 --2- 172.21.15.49:0/2747911660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62a0098d10 0x7f62a0157710 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f629400d8c0 tx=0x7f6294008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.388+0000 7f629e7fc700 1 -- 172.21.15.49:0/2747911660 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629400f520 con 0x7f62a0098d10 2023-11-30T17:22:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.388+0000 7f629e7fc700 1 -- 172.21.15.49:0/2747911660 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629400f680 con 0x7f62a0098d10 2023-11-30T17:22:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.388+0000 7f62a82a6700 1 -- 172.21.15.49:0/2747911660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a00a8760 con 0x7f62a0098d10 2023-11-30T17:22:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.388+0000 7f629e7fc700 1 -- 172.21.15.49:0/2747911660 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629400fa00 con 0x7f62a0098d10 2023-11-30T17:22:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.388+0000 7f62a82a6700 1 -- 172.21.15.49:0/2747911660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a013fe60 con 0x7f62a0098d10 2023-11-30T17:22:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.389+0000 7f62a82a6700 1 -- 172.21.15.49:0/2747911660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a00990f0 con 0x7f62a0098d10 2023-11-30T17:22:15.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.389+0000 7f629e7fc700 1 -- 172.21.15.49:0/2747911660 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6294013480 con 0x7f62a0098d10 2023-11-30T17:22:15.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.389+0000 7f629e7fc700 1 --2- 172.21.15.49:0/2747911660 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f628c05f270 0x7f628c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:15.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.389+0000 7f629e7fc700 1 -- 172.21.15.49:0/2747911660 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5813+0+0 (secure 0 0 0) 0x7f6294079cc0 con 0x7f62a0098d10 2023-11-30T17:22:15.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.389+0000 7f62a6042700 1 --2- 172.21.15.49:0/2747911660 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f628c05f270 0x7f628c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:15.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.390+0000 7f62a6042700 1 --2- 172.21.15.49:0/2747911660 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f628c05f270 0x7f628c061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f629800bbc0 tx=0x7f6298008040).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:15.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.393+0000 7f629e7fc700 1 -- 172.21.15.49:0/2747911660 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f629404aee0 con 0x7f62a0098d10 2023-11-30T17:22:15.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.569+0000 7f62a82a6700 1 -- 172.21.15.49:0/2747911660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f62a006c860 con 0x7f62a0098d10 2023-11-30T17:22:15.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.572+0000 7f629e7fc700 1 -- 172.21.15.49:0/2747911660 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f629404e500 con 0x7f62a0098d10 2023-11-30T17:22:15.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.574+0000 7f62a82a6700 1 -- 172.21.15.49:0/2747911660 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f628c05f270 msgr2=0x7f628c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:15.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.574+0000 7f62a82a6700 1 --2- 172.21.15.49:0/2747911660 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f628c05f270 0x7f628c061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f629800bbc0 tx=0x7f6298008040).stop 2023-11-30T17:22:15.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.574+0000 7f62a82a6700 1 -- 172.21.15.49:0/2747911660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62a0098d10 msgr2=0x7f62a0157710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:15.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.574+0000 7f62a82a6700 1 --2- 172.21.15.49:0/2747911660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62a0098d10 0x7f62a0157710 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f629400d8c0 tx=0x7f6294008040).stop 2023-11-30T17:22:15.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.574+0000 7f62a82a6700 1 -- 172.21.15.49:0/2747911660 shutdown_connections 2023-11-30T17:22:15.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.574+0000 7f62a82a6700 1 --2- 172.21.15.49:0/2747911660 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62a00c6190 0x7f62a0155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:15.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.574+0000 7f62a82a6700 1 --2- 172.21.15.49:0/2747911660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62a0064350 0x7f62a00aad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:15.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.574+0000 7f62a82a6700 1 --2- 172.21.15.49:0/2747911660 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f628c05f270 0x7f628c061730 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:15.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.574+0000 7f62a82a6700 1 --2- 172.21.15.49:0/2747911660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62a0098d10 0x7f62a0157710 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:15.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.574+0000 7f62a82a6700 1 -- 172.21.15.49:0/2747911660 >> 172.21.15.49:0/2747911660 conn(0x7f62a00cb310 msgr2=0x7f62a00c1490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:15.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.574+0000 7f62a82a6700 1 -- 172.21.15.49:0/2747911660 shutdown_connections 2023-11-30T17:22:15.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.574+0000 7f62a82a6700 1 -- 172.21.15.49:0/2747911660 wait complete. 2023-11-30T17:22:15.589 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-30T17:22:15.589 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T17:22:15.629 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T17:22:15.675 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-30T17:22:15.675 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-30T17:22:15.675 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:22:15.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.790+0000 7ff8d9fa2700 1 Processor -- start 2023-11-30T17:22:15.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.791+0000 7ff8d9fa2700 1 -- start start 2023-11-30T17:22:15.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.791+0000 7ff8d9fa2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff8d413a8d0 0x7ff8d4066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:15.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.791+0000 7ff8d9fa2700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff8d4155510 0x7ff8d40694e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:15.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.791+0000 7ff8d9fa2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8d40699d0 0x7ff8d40c5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:15.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.791+0000 7ff8d9fa2700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8d4069e20 con 0x7ff8d413a8d0 2023-11-30T17:22:15.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.791+0000 7ff8d9fa2700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8d4066e60 con 0x7ff8d4155510 2023-11-30T17:22:15.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.791+0000 7ff8d9fa2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d4067140 con 0x7ff8d40699d0 2023-11-30T17:22:15.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.791+0000 7ff8d8fa0700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff8d413a8d0 0x7ff8d4066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:15.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.792+0000 7ff8d8fa0700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff8d413a8d0 0x7ff8d4066880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51822/0 (socket says 172.21.15.49:51822) 2023-11-30T17:22:15.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.792+0000 7ff8d8fa0700 1 -- 172.21.15.49:0/369557085 learned_addr learned my addr 172.21.15.49:0/369557085 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:15.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.792+0000 7ff8d8fa0700 1 -- 172.21.15.49:0/369557085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8d40699d0 msgr2=0x7ff8d40c5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:15.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.792+0000 7ff8d8fa0700 1 --2- 172.21.15.49:0/369557085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8d40699d0 0x7ff8d40c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:15.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.792+0000 7ff8d8fa0700 1 -- 172.21.15.49:0/369557085 >> v2:172.21.15.115:3300/0 conn(0x7ff8d4155510 msgr2=0x7ff8d40694e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:15.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.792+0000 7ff8d8fa0700 1 --2- 172.21.15.49:0/369557085 >> v2:172.21.15.115:3300/0 conn(0x7ff8d4155510 0x7ff8d40694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:15.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.792+0000 7ff8d8fa0700 1 -- 172.21.15.49:0/369557085 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d4067420 con 0x7ff8d413a8d0 2023-11-30T17:22:15.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.792+0000 7ff8d8fa0700 1 --2- 172.21.15.49:0/369557085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8d413a8d0 0x7ff8d4066880 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7ff8d40c57b0 tx=0x7ff8cc0090f0).ready entity=mon.0 client_cookie=98825c6bcafc6333 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:15.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.792+0000 7ff8d37fe700 1 -- 172.21.15.49:0/369557085 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc00f6b0 con 0x7ff8d413a8d0 2023-11-30T17:22:15.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.792+0000 7ff8d37fe700 1 -- 172.21.15.49:0/369557085 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8cc00f810 con 0x7ff8d413a8d0 2023-11-30T17:22:15.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.792+0000 7ff8d37fe700 1 -- 172.21.15.49:0/369557085 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc00fb90 con 0x7ff8d413a8d0 2023-11-30T17:22:15.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.792+0000 7ff8d9fa2700 1 -- 172.21.15.49:0/369557085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8d413a8d0 msgr2=0x7ff8d4066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:15.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.792+0000 7ff8d9fa2700 1 --2- 172.21.15.49:0/369557085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8d413a8d0 0x7ff8d4066880 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7ff8d40c57b0 tx=0x7ff8cc0090f0).stop 2023-11-30T17:22:15.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.793+0000 7ff8d9fa2700 1 -- 172.21.15.49:0/369557085 shutdown_connections 2023-11-30T17:22:15.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.793+0000 7ff8d9fa2700 1 --2- 172.21.15.49:0/369557085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8d40699d0 0x7ff8d40c5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:15.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.793+0000 7ff8d9fa2700 1 --2- 172.21.15.49:0/369557085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8d413a8d0 0x7ff8d4066880 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:15.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.793+0000 7ff8d9fa2700 1 --2- 172.21.15.49:0/369557085 >> v2:172.21.15.115:3300/0 conn(0x7ff8d4155510 0x7ff8d40694e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:15.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.793+0000 7ff8d9fa2700 1 -- 172.21.15.49:0/369557085 >> 172.21.15.49:0/369557085 conn(0x7ff8d40c7ca0 msgr2=0x7ff8d40c80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:15.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.793+0000 7ff8d9fa2700 1 -- 172.21.15.49:0/369557085 shutdown_connections 2023-11-30T17:22:15.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.793+0000 7ff8d9fa2700 1 -- 172.21.15.49:0/369557085 wait complete. 2023-11-30T17:22:15.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.794+0000 7ff8d9fa2700 1 Processor -- start 2023-11-30T17:22:15.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.794+0000 7ff8d9fa2700 1 -- start start 2023-11-30T17:22:15.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.795+0000 7ff8d9fa2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8d40699d0 0x7ff8d40c2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:15.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.795+0000 7ff8d9fa2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8d413a8d0 0x7ff8d40a6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:15.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.795+0000 7ff8d9fa2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8d4155510 0x7ff8d4160520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:15.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.795+0000 7ff8d9fa2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d413a250 con 0x7ff8d40699d0 2023-11-30T17:22:15.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.795+0000 7ff8d9fa2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d40c2e20 con 0x7ff8d413a8d0 2023-11-30T17:22:15.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.795+0000 7ff8d9fa2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d4152160 con 0x7ff8d4155510 2023-11-30T17:22:15.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.795+0000 7ff8d8fa0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8d40699d0 0x7ff8d40c2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:15.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.795+0000 7ff8d8fa0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8d40699d0 0x7ff8d40c2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51826/0 (socket says 172.21.15.49:51826) 2023-11-30T17:22:15.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.795+0000 7ff8d8fa0700 1 -- 172.21.15.49:0/4110008453 learned_addr learned my addr 172.21.15.49:0/4110008453 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:15.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.795+0000 7ff8d97a1700 1 --2- 172.21.15.49:0/4110008453 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8d4155510 0x7ff8d4160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:15.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.795+0000 7ff8d3fff700 1 --2- 172.21.15.49:0/4110008453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8d413a8d0 0x7ff8d40a6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:15.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.795+0000 7ff8d8fa0700 1 -- 172.21.15.49:0/4110008453 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8d4155510 msgr2=0x7ff8d4160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:15.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.795+0000 7ff8d8fa0700 1 --2- 172.21.15.49:0/4110008453 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8d4155510 0x7ff8d4160520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:15.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.795+0000 7ff8d8fa0700 1 -- 172.21.15.49:0/4110008453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8d413a8d0 msgr2=0x7ff8d40a6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:15.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.795+0000 7ff8d8fa0700 1 --2- 172.21.15.49:0/4110008453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8d413a8d0 0x7ff8d40a6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:15.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.795+0000 7ff8d8fa0700 1 -- 172.21.15.49:0/4110008453 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8cc009370 con 0x7ff8d40699d0 2023-11-30T17:22:15.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.795+0000 7ff8d3fff700 1 --2- 172.21.15.49:0/4110008453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8d413a8d0 0x7ff8d40a6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:15.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.795+0000 7ff8d97a1700 1 --2- 172.21.15.49:0/4110008453 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8d4155510 0x7ff8d4160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:15.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.795+0000 7ff8d8fa0700 1 --2- 172.21.15.49:0/4110008453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8d40699d0 0x7ff8d40c2930 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7ff8d40becd0 tx=0x7ff8cc019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:15.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.795+0000 7ff8d0ff9700 1 -- 172.21.15.49:0/4110008453 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc01f070 con 0x7ff8d40699d0 2023-11-30T17:22:15.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.795+0000 7ff8d0ff9700 1 -- 172.21.15.49:0/4110008453 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8cc000c90 con 0x7ff8d40699d0 2023-11-30T17:22:15.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.795+0000 7ff8d9fa2700 1 -- 172.21.15.49:0/4110008453 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d4154b50 con 0x7ff8d40699d0 2023-11-30T17:22:15.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.795+0000 7ff8d0ff9700 1 -- 172.21.15.49:0/4110008453 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc00fb90 con 0x7ff8d40699d0 2023-11-30T17:22:15.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.795+0000 7ff8d9fa2700 1 -- 172.21.15.49:0/4110008453 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d4151550 con 0x7ff8d40699d0 2023-11-30T17:22:15.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.796+0000 7ff8d9fa2700 1 -- 172.21.15.49:0/4110008453 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d406c7c0 con 0x7ff8d40699d0 2023-11-30T17:22:15.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.797+0000 7ff8d0ff9700 1 -- 172.21.15.49:0/4110008453 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff8cc024940 con 0x7ff8d40699d0 2023-11-30T17:22:15.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.797+0000 7ff8d0ff9700 1 --2- 172.21.15.49:0/4110008453 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff8b405f270 0x7ff8b4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:15.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.797+0000 7ff8d0ff9700 1 -- 172.21.15.49:0/4110008453 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5813+0+0 (secure 0 0 0) 0x7ff8cc07d960 con 0x7ff8d40699d0 2023-11-30T17:22:15.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.798+0000 7ff8d3fff700 1 --2- 172.21.15.49:0/4110008453 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff8b405f270 0x7ff8b4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:15.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.798+0000 7ff8d3fff700 1 --2- 172.21.15.49:0/4110008453 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff8b405f270 0x7ff8b4061730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7ff8d40be870 tx=0x7ff8c40096a0).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:15.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:15.801+0000 7ff8d0ff9700 1 -- 172.21.15.49:0/4110008453 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff8cc04eca0 con 0x7ff8d40699d0 2023-11-30T17:22:16.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.016+0000 7ff8d9fa2700 1 -- 172.21.15.49:0/4110008453 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8d40c68e0 con 0x7ff8d40699d0 2023-11-30T17:22:16.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.017+0000 7ff8d0ff9700 1 -- 172.21.15.49:0/4110008453 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3535 (secure 0 0 0) 0x7ff8cc0522c0 con 0x7ff8d40699d0 2023-11-30T17:22:16.020 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:16.020 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1605498959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1605498959},{"type":"v1","addr":"172.21.15.115:6836","nonce":1605498959}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1471786970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1471786970},{"type":"v1","addr":"172.21.15.115:6837","nonce":1471786970}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5763,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1757467688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1757467688},{"type":"v1","addr":"172.21.15.49:6834","nonce":1757467688}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":6156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1770356821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1770356821},{"type":"v1","addr":"172.21.15.49:6835","nonce":1770356821}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[]} 2023-11-30T17:22:16.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.019+0000 7ff8d9fa2700 1 -- 172.21.15.49:0/4110008453 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff8b405f270 msgr2=0x7ff8b4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:16.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.019+0000 7ff8d9fa2700 1 --2- 172.21.15.49:0/4110008453 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff8b405f270 0x7ff8b4061730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7ff8d40be870 tx=0x7ff8c40096a0).stop 2023-11-30T17:22:16.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.019+0000 7ff8d9fa2700 1 -- 172.21.15.49:0/4110008453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8d40699d0 msgr2=0x7ff8d40c2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:16.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.019+0000 7ff8d9fa2700 1 --2- 172.21.15.49:0/4110008453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8d40699d0 0x7ff8d40c2930 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7ff8d40becd0 tx=0x7ff8cc019000).stop 2023-11-30T17:22:16.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.019+0000 7ff8d9fa2700 1 -- 172.21.15.49:0/4110008453 shutdown_connections 2023-11-30T17:22:16.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.019+0000 7ff8d9fa2700 1 --2- 172.21.15.49:0/4110008453 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8d4155510 0x7ff8d4160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:16.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.019+0000 7ff8d9fa2700 1 --2- 172.21.15.49:0/4110008453 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff8b405f270 0x7ff8b4061730 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:16.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.019+0000 7ff8d9fa2700 1 --2- 172.21.15.49:0/4110008453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8d40699d0 0x7ff8d40c2930 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:16.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.019+0000 7ff8d9fa2700 1 --2- 172.21.15.49:0/4110008453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8d413a8d0 0x7ff8d40a6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:16.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.019+0000 7ff8d9fa2700 1 -- 172.21.15.49:0/4110008453 >> 172.21.15.49:0/4110008453 conn(0x7ff8d40c7ca0 msgr2=0x7ff8d40abaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:16.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.019+0000 7ff8d9fa2700 1 -- 172.21.15.49:0/4110008453 shutdown_connections 2023-11-30T17:22:16.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.019+0000 7ff8d9fa2700 1 -- 172.21.15.49:0/4110008453 wait complete. 2023-11-30T17:22:16.023 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2023-11-30T17:22:16.034 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-30T17:22:16.034 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-30T17:22:16.034 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-30T17:22:16.034 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T17:22:16.034 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-30T17:22:16.034 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-30T17:22:16.035 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-30T17:22:16.035 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T17:22:16.035 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-30T17:22:16.035 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-30T17:22:16.035 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-30T17:22:16.036 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T17:22:16.036 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-30T17:22:16.036 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-30T17:22:16.036 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-30T17:22:16.036 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T17:22:16.043 INFO:tasks.ceph.mds.a:Stopped 2023-11-30T17:22:16.043 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-30T17:22:16.044 INFO:tasks.ceph.mds.c:Stopped 2023-11-30T17:22:16.044 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-30T17:22:16.046 INFO:tasks.ceph.mds.b:Stopped 2023-11-30T17:22:16.047 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-30T17:22:16.049 INFO:tasks.ceph.mds.d:Stopped 2023-11-30T17:22:16.049 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-30T17:22:16.085 INFO:tasks.ceph.mds.a:Started 2023-11-30T17:22:16.086 DEBUG:teuthology.parallel:result is None 2023-11-30T17:22:16.086 INFO:tasks.ceph.mds.c:Started 2023-11-30T17:22:16.086 DEBUG:teuthology.parallel:result is None 2023-11-30T17:22:16.088 INFO:tasks.ceph.mds.b:Started 2023-11-30T17:22:16.089 DEBUG:teuthology.parallel:result is None 2023-11-30T17:22:16.089 INFO:tasks.ceph.mds.d:Started 2023-11-30T17:22:16.089 DEBUG:teuthology.parallel:result is None 2023-11-30T17:22:16.089 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-30T17:22:16.161 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-11-30T17:22:16.161 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-11-30T17:22:16.173 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-11-30T17:22:16.173 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-11-30T17:22:16.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.214+0000 7f893857f700 1 Processor -- start 2023-11-30T17:22:16.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.214+0000 7f893857f700 1 -- start start 2023-11-30T17:22:16.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.215+0000 7f893857f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89300bd900 0x7f893006a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:16.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.215+0000 7f893857f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89300c3470 con 0x7f8930069d10 2023-11-30T17:22:16.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.215+0000 7f893857f700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89300c48f0 con 0x7f8930151a20 2023-11-30T17:22:16.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.215+0000 7f893857f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8930151ea0 con 0x7f89300bd900 2023-11-30T17:22:16.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.215+0000 7f893631b700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8930069d10 0x7f89300be1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39180/0 (socket says 172.21.15.49:39180) 2023-11-30T17:22:16.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.216+0000 7f893631b700 1 -- 172.21.15.49:0/1339858991 learned_addr learned my addr 172.21.15.49:0/1339858991 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:16.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.216+0000 7f8936b1c700 1 --2- 172.21.15.49:0/1339858991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89300bd900 0x7f893006a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:16.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.216+0000 7f8935319700 1 -- 172.21.15.49:0/1339858991 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3050493152 0 0) 0x7f89300c3470 con 0x7f8930069d10 2023-11-30T17:22:16.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.216+0000 7f8935319700 1 -- 172.21.15.49:0/1339858991 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89180033f0 con 0x7f8930069d10 2023-11-30T17:22:16.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.216+0000 7f8935319700 1 -- 172.21.15.49:0/1339858991 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3697500150 0 0) 0x7f89300c48f0 con 0x7f8930151a20 2023-11-30T17:22:16.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.216+0000 7f8935319700 1 -- 172.21.15.49:0/1339858991 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89300c3470 con 0x7f8930151a20 2023-11-30T17:22:16.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.216+0000 7f8936b1c700 1 -- 172.21.15.49:0/1339858991 >> v1:172.21.15.115:6789/0 conn(0x7f8930151a20 legacy=0x7f89300bd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:16.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.216+0000 7f8936b1c700 1 -- 172.21.15.49:0/1339858991 >> v1:172.21.15.49:6789/0 conn(0x7f8930069d10 legacy=0x7f89300be1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:16.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.216+0000 7f8936b1c700 1 -- 172.21.15.49:0/1339858991 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8930152180 con 0x7f89300bd900 2023-11-30T17:22:16.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.216+0000 7f8936b1c700 1 --2- 172.21.15.49:0/1339858991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89300bd900 0x7f893006a0f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f8928009790 tx=0x7f8928009060).ready entity=mon.2 client_cookie=cdb7b8d4fab3d013 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:16.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.216+0000 7f8935319700 1 -- 172.21.15.49:0/1339858991 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892800f510 con 0x7f89300bd900 2023-11-30T17:22:16.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.216+0000 7f8935319700 1 -- 172.21.15.49:0/1339858991 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892800f670 con 0x7f89300bd900 2023-11-30T17:22:16.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.216+0000 7f8935319700 1 -- 172.21.15.49:0/1339858991 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892800f9f0 con 0x7f89300bd900 2023-11-30T17:22:16.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.217+0000 7f893857f700 1 -- 172.21.15.49:0/1339858991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89300bd900 msgr2=0x7f893006a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:16.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.217+0000 7f893857f700 1 --2- 172.21.15.49:0/1339858991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89300bd900 0x7f893006a0f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f8928009790 tx=0x7f8928009060).stop 2023-11-30T17:22:16.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.217+0000 7f893857f700 1 -- 172.21.15.49:0/1339858991 shutdown_connections 2023-11-30T17:22:16.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.217+0000 7f893857f700 1 --2- 172.21.15.49:0/1339858991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89300bd900 0x7f893006a0f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:16.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.217+0000 7f893857f700 1 -- 172.21.15.49:0/1339858991 >> 172.21.15.49:0/1339858991 conn(0x7f89300642d0 msgr2=0x7f89300c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:16.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.217+0000 7f893857f700 1 -- 172.21.15.49:0/1339858991 shutdown_connections 2023-11-30T17:22:16.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.217+0000 7f893857f700 1 -- 172.21.15.49:0/1339858991 wait complete. 2023-11-30T17:22:16.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.218+0000 7f893857f700 1 Processor -- start 2023-11-30T17:22:16.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.218+0000 7f893857f700 1 -- start start 2023-11-30T17:22:16.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.219+0000 7f893857f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8930069d10 0x7f8930141790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:16.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.219+0000 7f893857f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89300bd900 0x7f89301621b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:16.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.219+0000 7f893857f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8930151a20 0x7f8930141f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:16.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.219+0000 7f893857f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89300a6340 con 0x7f89300bd900 2023-11-30T17:22:16.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.219+0000 7f893857f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8930141c80 con 0x7f8930069d10 2023-11-30T17:22:16.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.219+0000 7f893857f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89300a5780 con 0x7f8930151a20 2023-11-30T17:22:16.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.219+0000 7f8935b1a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89300bd900 0x7f89301621b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:16.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.219+0000 7f8935b1a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89300bd900 0x7f89301621b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51868/0 (socket says 172.21.15.49:51868) 2023-11-30T17:22:16.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.219+0000 7f8935b1a700 1 -- 172.21.15.49:0/695035580 learned_addr learned my addr 172.21.15.49:0/695035580 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:16.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.219+0000 7f893631b700 1 --2- 172.21.15.49:0/695035580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8930069d10 0x7f8930141790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:16.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.219+0000 7f8936b1c700 1 --2- 172.21.15.49:0/695035580 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8930151a20 0x7f8930141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:16.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.219+0000 7f8935b1a700 1 -- 172.21.15.49:0/695035580 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8930151a20 msgr2=0x7f8930141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:16.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.219+0000 7f8935b1a700 1 --2- 172.21.15.49:0/695035580 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8930151a20 0x7f8930141f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:16.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.219+0000 7f8935b1a700 1 -- 172.21.15.49:0/695035580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8930069d10 msgr2=0x7f8930141790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:16.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.219+0000 7f8935b1a700 1 --2- 172.21.15.49:0/695035580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8930069d10 0x7f8930141790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:16.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.219+0000 7f8935b1a700 1 -- 172.21.15.49:0/695035580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89280092a0 con 0x7f89300bd900 2023-11-30T17:22:16.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.219+0000 7f8935b1a700 1 --2- 172.21.15.49:0/695035580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89300bd900 0x7f89301621b0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f892400c4c0 tx=0x7f8924007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:16.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.220+0000 7f892e7fc700 1 -- 172.21.15.49:0/695035580 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892400ce30 con 0x7f89300bd900 2023-11-30T17:22:16.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.220+0000 7f892e7fc700 1 -- 172.21.15.49:0/695035580 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892400f470 con 0x7f89300bd900 2023-11-30T17:22:16.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.220+0000 7f893857f700 1 -- 172.21.15.49:0/695035580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89300a5a10 con 0x7f89300bd900 2023-11-30T17:22:16.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.220+0000 7f892e7fc700 1 -- 172.21.15.49:0/695035580 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892400f810 con 0x7f89300bd900 2023-11-30T17:22:16.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.220+0000 7f893857f700 1 -- 172.21.15.49:0/695035580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89300a5fd0 con 0x7f89300bd900 2023-11-30T17:22:16.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.221+0000 7f893857f700 1 -- 172.21.15.49:0/695035580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89300c8ec0 con 0x7f89300bd900 2023-11-30T17:22:16.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.221+0000 7f892e7fc700 1 -- 172.21.15.49:0/695035580 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f892400fbc0 con 0x7f89300bd900 2023-11-30T17:22:16.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.221+0000 7f892e7fc700 1 --2- 172.21.15.49:0/695035580 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f891c05f270 0x7f891c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:16.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.221+0000 7f892e7fc700 1 -- 172.21.15.49:0/695035580 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5813+0+0 (secure 0 0 0) 0x7f8924079880 con 0x7f89300bd900 2023-11-30T17:22:16.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.222+0000 7f893631b700 1 --2- 172.21.15.49:0/695035580 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f891c05f270 0x7f891c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:16.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.222+0000 7f893631b700 1 --2- 172.21.15.49:0/695035580 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f891c05f270 0x7f891c061730 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f8930145000 tx=0x7f8920009040).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:16.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.225+0000 7f892e7fc700 1 -- 172.21.15.49:0/695035580 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f892404aa40 con 0x7f89300bd900 2023-11-30T17:22:16.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:16.416+0000 7f893857f700 1 -- 172.21.15.49:0/695035580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f893006c860 con 0x7f89300bd900 2023-11-30T17:22:17.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.251+0000 7f892e7fc700 1 -- 172.21.15.49:0/695035580 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v79) v1 ==== 97+0+0 (secure 0 0 0) 0x7f892404e060 con 0x7f89300bd900 2023-11-30T17:22:17.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.254+0000 7f893857f700 1 -- 172.21.15.49:0/695035580 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f891c05f270 msgr2=0x7f891c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:17.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.254+0000 7f893857f700 1 --2- 172.21.15.49:0/695035580 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f891c05f270 0x7f891c061730 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f8930145000 tx=0x7f8920009040).stop 2023-11-30T17:22:17.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.254+0000 7f893857f700 1 -- 172.21.15.49:0/695035580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89300bd900 msgr2=0x7f89301621b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:17.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.254+0000 7f893857f700 1 --2- 172.21.15.49:0/695035580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89300bd900 0x7f89301621b0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f892400c4c0 tx=0x7f8924007c30).stop 2023-11-30T17:22:17.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.254+0000 7f893857f700 1 -- 172.21.15.49:0/695035580 shutdown_connections 2023-11-30T17:22:17.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.254+0000 7f893857f700 1 --2- 172.21.15.49:0/695035580 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8930151a20 0x7f8930141f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:17.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.254+0000 7f893857f700 1 --2- 172.21.15.49:0/695035580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8930069d10 0x7f8930141790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:17.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.254+0000 7f893857f700 1 --2- 172.21.15.49:0/695035580 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f891c05f270 0x7f891c061730 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:17.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.254+0000 7f893857f700 1 --2- 172.21.15.49:0/695035580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89300bd900 0x7f89301621b0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:17.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.254+0000 7f893857f700 1 -- 172.21.15.49:0/695035580 >> 172.21.15.49:0/695035580 conn(0x7f89300642d0 msgr2=0x7f89300657a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:17.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.254+0000 7f893857f700 1 -- 172.21.15.49:0/695035580 shutdown_connections 2023-11-30T17:22:17.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.254+0000 7f893857f700 1 -- 172.21.15.49:0/695035580 wait complete. 2023-11-30T17:22:17.258 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2023-11-30T17:22:17.271 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-30T17:22:17.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.393+0000 7fec6caf9700 1 Processor -- start 2023-11-30T17:22:17.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.393+0000 7fec6caf9700 1 -- start start 2023-11-30T17:22:17.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.394+0000 7fec6caf9700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fec681548c0 0x7fec6806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:17.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.394+0000 7fec6caf9700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec680c69a0 con 0x7fec681544e0 2023-11-30T17:22:17.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.394+0000 7fec6caf9700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec680c13a0 con 0x7fec680c6e30 2023-11-30T17:22:17.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.394+0000 7fec6caf9700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec680c1680 con 0x7fec681548c0 2023-11-30T17:22:17.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.394+0000 7fec6659c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fec681544e0 0x7fec680c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39186/0 (socket says 172.21.15.49:39186) 2023-11-30T17:22:17.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.395+0000 7fec6659c700 1 -- 172.21.15.49:0/3894497953 learned_addr learned my addr 172.21.15.49:0/3894497953 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:17.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.395+0000 7fec65d9b700 1 --2- 172.21.15.49:0/3894497953 >> v2:172.21.15.115:3300/0 conn(0x7fec681548c0 0x7fec6806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:17.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.395+0000 7fec6559a700 1 -- 172.21.15.49:0/3894497953 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 909044707 0 0) 0x7fec680c69a0 con 0x7fec681544e0 2023-11-30T17:22:17.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.395+0000 7fec6559a700 1 -- 172.21.15.49:0/3894497953 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec540033f0 con 0x7fec681544e0 2023-11-30T17:22:17.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.395+0000 7fec6559a700 1 -- 172.21.15.49:0/3894497953 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 672790585 0 0) 0x7fec540033f0 con 0x7fec681544e0 2023-11-30T17:22:17.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.395+0000 7fec6559a700 1 -- 172.21.15.49:0/3894497953 >> v2:172.21.15.115:3300/0 conn(0x7fec681548c0 msgr2=0x7fec6806a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:17.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.395+0000 7fec6559a700 1 --2- 172.21.15.49:0/3894497953 >> v2:172.21.15.115:3300/0 conn(0x7fec681548c0 0x7fec6806a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:17.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.395+0000 7fec6559a700 1 -- 172.21.15.49:0/3894497953 >> v1:172.21.15.115:6789/0 conn(0x7fec680c6e30 legacy=0x7fec680a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:17.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.395+0000 7fec6559a700 1 -- 172.21.15.49:0/3894497953 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec680c6630 con 0x7fec681544e0 2023-11-30T17:22:17.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.395+0000 7fec6559a700 1 -- 172.21.15.49:0/3894497953 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fec600015f0 con 0x7fec681544e0 2023-11-30T17:22:17.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.395+0000 7fec6559a700 1 -- 172.21.15.49:0/3894497953 >> v1:172.21.15.49:6789/0 conn(0x7fec681544e0 legacy=0x7fec680c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:17.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.395+0000 7fec6559a700 1 --2- 172.21.15.49:0/3894497953 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec540038e0 0x7fec54003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:17.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.395+0000 7fec6559a700 1 --2- 172.21.15.49:0/3894497953 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec54004690 0x7fec54004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:17.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.395+0000 7fec6559a700 1 --2- 172.21.15.49:0/3894497953 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec54005000 0x7fec5400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:17.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.395+0000 7fec6559a700 1 -- 172.21.15.49:0/3894497953 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec680c1680 con 0x7fec54004690 2023-11-30T17:22:17.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.395+0000 7fec6559a700 1 -- 172.21.15.49:0/3894497953 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5400beb0 con 0x7fec540038e0 2023-11-30T17:22:17.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.395+0000 7fec6559a700 1 -- 172.21.15.49:0/3894497953 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5400c070 con 0x7fec54005000 2023-11-30T17:22:17.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.395+0000 7fec65d9b700 1 --2- 172.21.15.49:0/3894497953 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec54004690 0x7fec54004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:17.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.395+0000 7fec6659c700 1 --2- 172.21.15.49:0/3894497953 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec540038e0 0x7fec54003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:17.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.395+0000 7fec66d9d700 1 --2- 172.21.15.49:0/3894497953 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec54005000 0x7fec5400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:17.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.395+0000 7fec65d9b700 1 -- 172.21.15.49:0/3894497953 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec54005000 msgr2=0x7fec5400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:17.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.395+0000 7fec65d9b700 1 --2- 172.21.15.49:0/3894497953 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec54005000 0x7fec5400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:17.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.395+0000 7fec65d9b700 1 -- 172.21.15.49:0/3894497953 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec540038e0 msgr2=0x7fec54003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:17.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.395+0000 7fec65d9b700 1 --2- 172.21.15.49:0/3894497953 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec540038e0 0x7fec54003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:17.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.396+0000 7fec65d9b700 1 -- 172.21.15.49:0/3894497953 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec540033f0 con 0x7fec54004690 2023-11-30T17:22:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.396+0000 7fec6659c700 1 --2- 172.21.15.49:0/3894497953 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec540038e0 0x7fec54003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.396+0000 7fec66d9d700 1 -- 172.21.15.49:0/3894497953 reap_dead start 2023-11-30T17:22:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.396+0000 7fec65d9b700 1 --2- 172.21.15.49:0/3894497953 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec54004690 0x7fec54004b10 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7fec50009a80 tx=0x7fec50009060).ready entity=mon.0 client_cookie=7a56efafd9ca1e9c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.396+0000 7fec6559a700 1 -- 172.21.15.49:0/3894497953 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec50009430 con 0x7fec54004690 2023-11-30T17:22:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.396+0000 7fec6559a700 1 -- 172.21.15.49:0/3894497953 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5000e640 con 0x7fec54004690 2023-11-30T17:22:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.396+0000 7fec6559a700 1 -- 172.21.15.49:0/3894497953 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5000e9c0 con 0x7fec54004690 2023-11-30T17:22:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.396+0000 7fec6caf9700 1 -- 172.21.15.49:0/3894497953 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec54004690 msgr2=0x7fec54004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.396+0000 7fec6caf9700 1 --2- 172.21.15.49:0/3894497953 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec54004690 0x7fec54004b10 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7fec50009a80 tx=0x7fec50009060).stop 2023-11-30T17:22:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.396+0000 7fec6caf9700 1 -- 172.21.15.49:0/3894497953 shutdown_connections 2023-11-30T17:22:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.396+0000 7fec6caf9700 1 --2- 172.21.15.49:0/3894497953 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec54004690 0x7fec54004b10 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.396+0000 7fec6caf9700 1 -- 172.21.15.49:0/3894497953 >> 172.21.15.49:0/3894497953 conn(0x7fec68085020 msgr2=0x7fec68094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.396+0000 7fec6caf9700 1 -- 172.21.15.49:0/3894497953 shutdown_connections 2023-11-30T17:22:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.396+0000 7fec6caf9700 1 -- 172.21.15.49:0/3894497953 wait complete. 2023-11-30T17:22:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.397+0000 7fec6caf9700 1 Processor -- start 2023-11-30T17:22:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.397+0000 7fec6caf9700 1 -- start start 2023-11-30T17:22:17.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.398+0000 7fec6caf9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec54004690 0x7fec680cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:17.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.398+0000 7fec6caf9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec680a8000 0x7fec680aa710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:17.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.398+0000 7fec6caf9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec680aac00 0x7fec680ab080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:17.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.398+0000 7fec6caf9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec68153640 con 0x7fec680a8000 2023-11-30T17:22:17.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.398+0000 7fec6caf9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec680ac4d0 con 0x7fec680aac00 2023-11-30T17:22:17.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.398+0000 7fec6caf9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec680ab8c0 con 0x7fec54004690 2023-11-30T17:22:17.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.398+0000 7fec65d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec680a8000 0x7fec680aa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:17.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.398+0000 7fec65d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec680a8000 0x7fec680aa710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51890/0 (socket says 172.21.15.49:51890) 2023-11-30T17:22:17.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.398+0000 7fec65d9b700 1 -- 172.21.15.49:0/1994703804 learned_addr learned my addr 172.21.15.49:0/1994703804 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:17.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.398+0000 7fec66d9d700 1 --2- 172.21.15.49:0/1994703804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec680aac00 0x7fec680ab080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:17.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.398+0000 7fec6659c700 1 --2- 172.21.15.49:0/1994703804 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec54004690 0x7fec680cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:17.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.399+0000 7fec65d9b700 1 -- 172.21.15.49:0/1994703804 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec54004690 msgr2=0x7fec680cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:17.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.399+0000 7fec65d9b700 1 --2- 172.21.15.49:0/1994703804 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec54004690 0x7fec680cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:17.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.399+0000 7fec65d9b700 1 -- 172.21.15.49:0/1994703804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec680aac00 msgr2=0x7fec680ab080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:17.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.399+0000 7fec65d9b700 1 --2- 172.21.15.49:0/1994703804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec680aac00 0x7fec680ab080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:17.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.399+0000 7fec65d9b700 1 -- 172.21.15.49:0/1994703804 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec680abba0 con 0x7fec680a8000 2023-11-30T17:22:17.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.399+0000 7fec65d9b700 1 --2- 172.21.15.49:0/1994703804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec680a8000 0x7fec680aa710 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7fec5400be80 tx=0x7fec5001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:17.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.399+0000 7fec5e7fc700 1 -- 172.21.15.49:0/1994703804 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec50009ec0 con 0x7fec680a8000 2023-11-30T17:22:17.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.399+0000 7fec5e7fc700 1 -- 172.21.15.49:0/1994703804 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5000ed70 con 0x7fec680a8000 2023-11-30T17:22:17.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.399+0000 7fec5e7fc700 1 -- 172.21.15.49:0/1994703804 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5000eee0 con 0x7fec680a8000 2023-11-30T17:22:17.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.399+0000 7fec6caf9700 1 -- 172.21.15.49:0/1994703804 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec680abe80 con 0x7fec680a8000 2023-11-30T17:22:17.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.399+0000 7fec6caf9700 1 -- 172.21.15.49:0/1994703804 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec680ab570 con 0x7fec680a8000 2023-11-30T17:22:17.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.400+0000 7fec6caf9700 1 -- 172.21.15.49:0/1994703804 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec680ac320 con 0x7fec680a8000 2023-11-30T17:22:17.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.400+0000 7fec5e7fc700 1 -- 172.21.15.49:0/1994703804 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fec50024600 con 0x7fec680a8000 2023-11-30T17:22:17.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.401+0000 7fec5e7fc700 1 --2- 172.21.15.49:0/1994703804 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fec4805f270 0x7fec48061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:17.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.401+0000 7fec5e7fc700 1 -- 172.21.15.49:0/1994703804 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5297+0+0 (secure 0 0 0) 0x7fec5007b3a0 con 0x7fec680a8000 2023-11-30T17:22:17.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.401+0000 7fec6659c700 1 --2- 172.21.15.49:0/1994703804 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fec4805f270 0x7fec48061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:17.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.401+0000 7fec6659c700 1 --2- 172.21.15.49:0/1994703804 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fec4805f270 0x7fec48061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fec60001170 tx=0x7fec60009040).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:17.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.405+0000 7fec5e7fc700 1 -- 172.21.15.49:0/1994703804 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fec5004c8d0 con 0x7fec680a8000 2023-11-30T17:22:17.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.645+0000 7fec6caf9700 1 -- 172.21.15.49:0/1994703804 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fec6806c860 con 0x7fec680a8000 2023-11-30T17:22:17.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.645+0000 7fec5e7fc700 1 -- 172.21.15.49:0/1994703804 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fec50029090 con 0x7fec680a8000 2023-11-30T17:22:17.648 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:17.648 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T17:22:17.648 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2023-11-30T17:22:17.648 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:17.648 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2023-11-30T17:22:17.648 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlwm1FHxAAk+s9c60UZ5jB37wbpGzlcg==", 2023-11-30T17:22:17.648 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:17.648 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:22:17.648 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:22:17.648 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:22:17.648 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:22:17.648 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:17.648 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:17.648 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:17.649 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2023-11-30T17:22:17.649 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlADm0KhAArffesGGTXzQwY4NPnJ1Bjw==", 2023-11-30T17:22:17.649 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:17.649 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:22:17.649 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:22:17.649 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:22:17.649 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:22:17.649 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:17.649 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:17.649 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:17.649 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2023-11-30T17:22:17.649 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlYnY1JhAA+Lurauug0NhWnK8aZErR3g==", 2023-11-30T17:22:17.649 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:17.649 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:22:17.649 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:22:17.650 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:22:17.650 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:22:17.650 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:17.650 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:17.650 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:17.650 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2023-11-30T17:22:17.650 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlQdKCMRAA3h4O2NqkQ2zE3DxOqBoaQQ==", 2023-11-30T17:22:17.650 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:17.650 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:22:17.650 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:22:17.650 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:22:17.650 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:22:17.650 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:17.650 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:17.650 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:17.651 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2023-11-30T17:22:17.651 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAPwWhlGdbhFxAAOspNRLMhR59LSWatFbsYDA==", 2023-11-30T17:22:17.651 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:17.651 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:22:17.651 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:22:17.651 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:22:17.651 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:17.651 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:17.651 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:17.651 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2023-11-30T17:22:17.651 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQASwWhlfwUEFxAAuj0L8ooIGi1vsb7XWLVlDA==", 2023-11-30T17:22:17.651 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:17.651 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:22:17.651 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:22:17.652 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:22:17.652 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:17.652 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:17.652 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:17.652 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2023-11-30T17:22:17.652 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAVwWhl7XYwFBAAuSHZqdfRR8V1Y+hmPT5uuw==", 2023-11-30T17:22:17.652 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:17.652 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:22:17.652 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:22:17.652 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:22:17.652 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:17.652 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:17.652 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:17.652 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2023-11-30T17:22:17.652 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAYwWhlkhRCFRAAe3cRLcrhJ3ZoluXuRUhmew==", 2023-11-30T17:22:17.653 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:17.653 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:22:17.653 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:22:17.653 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:22:17.653 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:17.653 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:17.653 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:17.653 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2023-11-30T17:22:17.653 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAewWhlrq4qFBAAOSdqozO8iH25BQFrPI1SRQ==", 2023-11-30T17:22:17.653 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:17.654 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:22:17.654 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:22:17.654 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:22:17.654 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:17.654 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:17.654 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:17.654 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2023-11-30T17:22:17.654 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAhwWhlZL9WERAA90znWBLNuY5eem3yF6O0wg==", 2023-11-30T17:22:17.654 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:17.654 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:22:17.654 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:22:17.654 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:22:17.654 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:17.654 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:17.655 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:17.655 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2023-11-30T17:22:17.655 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAkwWhlCJDiEBAAETLCBNCdaWXFgkPPaulTAA==", 2023-11-30T17:22:17.655 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:17.655 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:22:17.655 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:22:17.655 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:22:17.655 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:17.655 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:17.655 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:17.655 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2023-11-30T17:22:17.655 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAnwWhl+IiYEBAAcI3AU5xrv0cYy9lckyu0dQ==", 2023-11-30T17:22:17.655 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:17.655 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:22:17.655 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:22:17.656 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:22:17.656 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:17.656 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:17.656 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:17.656 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2023-11-30T17:22:17.656 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhleYZcNRAA5PoPChH+s6XfbrQ0hmu2NA==", 2023-11-30T17:22:17.656 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:17.656 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:22:17.656 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2023-11-30T17:22:17.656 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-30T17:22:17.656 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:17.656 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:17.656 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:17.656 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2023-11-30T17:22:17.656 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAOwWhlFhcfAhAAzaBDtyRxuqeQ9BatfgUuXw==", 2023-11-30T17:22:17.657 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:17.657 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:22:17.657 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T17:22:17.657 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T17:22:17.657 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T17:22:17.657 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:17.657 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:17.657 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:17.657 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2023-11-30T17:22:17.657 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlLZrDOhAAHG/dYWYmPouk3+Iqafr7qw==", 2023-11-30T17:22:17.657 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:17.657 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:22:17.657 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T17:22:17.657 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T17:22:17.657 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T17:22:17.657 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:17.658 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:17.658 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:17.658 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2023-11-30T17:22:17.658 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAOwWhl6lxuBxAA/YXQDo+U2ppULGzK054Gzg==", 2023-11-30T17:22:17.658 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:17.658 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:22:17.658 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T17:22:17.658 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T17:22:17.658 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T17:22:17.658 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:17.659 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:17.659 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:17.659 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2023-11-30T17:22:17.659 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhl4JkLAxAAiaLgZ5eiazaT9VanG5ihyQ==", 2023-11-30T17:22:17.659 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:17.659 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T17:22:17.659 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:22:17.659 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:22:17.659 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:22:17.659 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:17.659 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:17.659 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:17.659 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2023-11-30T17:22:17.659 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlH1s2HBAA3ea9Utfv7fZoo2hO+ElDVQ==", 2023-11-30T17:22:17.659 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T17:22:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-11-30T17:22:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:22:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2023-11-30T17:22:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlpy+fFxAA3qmboR+PlQtK6T35ryj+Lw==", 2023-11-30T17:22:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T17:22:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-11-30T17:22:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:22:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-11-30T17:22:17.660 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T17:22:17.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.647+0000 7fec6caf9700 1 -- 172.21.15.49:0/1994703804 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fec4805f270 msgr2=0x7fec48061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:17.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.647+0000 7fec6caf9700 1 --2- 172.21.15.49:0/1994703804 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fec4805f270 0x7fec48061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fec60001170 tx=0x7fec60009040).stop 2023-11-30T17:22:17.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.647+0000 7fec6caf9700 1 -- 172.21.15.49:0/1994703804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec680a8000 msgr2=0x7fec680aa710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:17.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.647+0000 7fec6caf9700 1 --2- 172.21.15.49:0/1994703804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec680a8000 0x7fec680aa710 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7fec5400be80 tx=0x7fec5001a000).stop 2023-11-30T17:22:17.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.647+0000 7fec6caf9700 1 -- 172.21.15.49:0/1994703804 shutdown_connections 2023-11-30T17:22:17.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.647+0000 7fec6caf9700 1 --2- 172.21.15.49:0/1994703804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec680aac00 0x7fec680ab080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:17.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.647+0000 7fec6caf9700 1 --2- 172.21.15.49:0/1994703804 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec54004690 0x7fec680cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:17.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.647+0000 7fec6caf9700 1 --2- 172.21.15.49:0/1994703804 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fec4805f270 0x7fec48061730 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:17.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.647+0000 7fec6caf9700 1 --2- 172.21.15.49:0/1994703804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec680a8000 0x7fec680aa710 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:17.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.647+0000 7fec6caf9700 1 -- 172.21.15.49:0/1994703804 >> 172.21.15.49:0/1994703804 conn(0x7fec68085020 msgr2=0x7fec680c9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:17.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.647+0000 7fec6caf9700 1 -- 172.21.15.49:0/1994703804 shutdown_connections 2023-11-30T17:22:17.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.647+0000 7fec6caf9700 1 -- 172.21.15.49:0/1994703804 wait complete. 2023-11-30T17:22:17.663 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:22:17.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.778+0000 7f4f4623f700 1 Processor -- start 2023-11-30T17:22:17.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.778+0000 7f4f4623f700 1 -- start start 2023-11-30T17:22:17.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.779+0000 7f4f4623f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4f401548c0 0x7f4f4006a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:17.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.779+0000 7f4f4623f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f400c69a0 con 0x7f4f400c6e30 2023-11-30T17:22:17.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.779+0000 7f4f4623f700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f400c13a0 con 0x7f4f401544e0 2023-11-30T17:22:17.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.779+0000 7f4f4623f700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f400c1680 con 0x7f4f401548c0 2023-11-30T17:22:17.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.779+0000 7f4f3effd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4f401548c0 0x7f4f4006a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:17.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.779+0000 7f4f3ffff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4f400c6e30 0x7f4f400a8000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39200/0 (socket says 172.21.15.49:39200) 2023-11-30T17:22:17.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.779+0000 7f4f3effd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4f401548c0 0x7f4f4006a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51892/0 (socket says 172.21.15.49:51892) 2023-11-30T17:22:17.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.779+0000 7f4f3ffff700 1 -- 172.21.15.49:0/3897531274 learned_addr learned my addr 172.21.15.49:0/3897531274 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:17.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.780+0000 7f4f3effd700 1 -- 172.21.15.49:0/3897531274 >> v1:172.21.15.115:6789/0 conn(0x7f4f401544e0 legacy=0x7f4f400c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:17.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.780+0000 7f4f3effd700 1 -- 172.21.15.49:0/3897531274 >> v1:172.21.15.49:6789/0 conn(0x7f4f400c6e30 legacy=0x7f4f400a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:17.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.780+0000 7f4f3effd700 1 -- 172.21.15.49:0/3897531274 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f400c6630 con 0x7f4f401548c0 2023-11-30T17:22:17.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.780+0000 7f4f3e7fc700 1 -- 172.21.15.49:0/3897531274 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2517687334 0 0) 0x7f4f400c69a0 con 0x7f4f400c6e30 2023-11-30T17:22:17.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.780+0000 7f4f3effd700 1 --2- 172.21.15.49:0/3897531274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f401548c0 0x7f4f4006a610 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f4f34009760 tx=0x7f4f34009060).ready entity=mon.0 client_cookie=7689e89bd5e6d2ee server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:17.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.780+0000 7f4f3e7fc700 1 -- 172.21.15.49:0/3897531274 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3400b580 con 0x7f4f401548c0 2023-11-30T17:22:17.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.780+0000 7f4f3e7fc700 1 -- 172.21.15.49:0/3897531274 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3400b6e0 con 0x7f4f401548c0 2023-11-30T17:22:17.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.780+0000 7f4f3e7fc700 1 -- 172.21.15.49:0/3897531274 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3400ba60 con 0x7f4f401548c0 2023-11-30T17:22:17.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.780+0000 7f4f4623f700 1 -- 172.21.15.49:0/3897531274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f401548c0 msgr2=0x7f4f4006a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:17.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.780+0000 7f4f4623f700 1 --2- 172.21.15.49:0/3897531274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f401548c0 0x7f4f4006a610 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f4f34009760 tx=0x7f4f34009060).stop 2023-11-30T17:22:17.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.781+0000 7f4f4623f700 1 -- 172.21.15.49:0/3897531274 shutdown_connections 2023-11-30T17:22:17.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.781+0000 7f4f4623f700 1 --2- 172.21.15.49:0/3897531274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f401548c0 0x7f4f4006a610 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:17.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.781+0000 7f4f4623f700 1 -- 172.21.15.49:0/3897531274 >> 172.21.15.49:0/3897531274 conn(0x7f4f40085020 msgr2=0x7f4f40094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:17.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.781+0000 7f4f4623f700 1 -- 172.21.15.49:0/3897531274 shutdown_connections 2023-11-30T17:22:17.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.781+0000 7f4f4623f700 1 -- 172.21.15.49:0/3897531274 wait complete. 2023-11-30T17:22:17.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.782+0000 7f4f4623f700 1 Processor -- start 2023-11-30T17:22:17.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.782+0000 7f4f4623f700 1 -- start start 2023-11-30T17:22:17.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.783+0000 7f4f4623f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f400c6e30 0x7f4f400956d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:17.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.783+0000 7f4f4623f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f401544e0 0x7f4f400ad090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:17.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.783+0000 7f4f4623f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f401548c0 0x7f4f401653e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:17.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.783+0000 7f4f4623f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f400968c0 con 0x7f4f401544e0 2023-11-30T17:22:17.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.783+0000 7f4f4623f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f401658d0 con 0x7f4f400c6e30 2023-11-30T17:22:17.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.783+0000 7f4f4623f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f40095cb0 con 0x7f4f401548c0 2023-11-30T17:22:17.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.783+0000 7f4f3effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f401544e0 0x7f4f400ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.783+0000 7f4f3effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f401544e0 0x7f4f400ad090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51898/0 (socket says 172.21.15.49:51898) 2023-11-30T17:22:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.783+0000 7f4f3effd700 1 -- 172.21.15.49:0/3824901819 learned_addr learned my addr 172.21.15.49:0/3824901819 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.783+0000 7f4f3f7fe700 1 --2- 172.21.15.49:0/3824901819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f400c6e30 0x7f4f400956d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.783+0000 7f4f3ffff700 1 --2- 172.21.15.49:0/3824901819 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f401548c0 0x7f4f401653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.783+0000 7f4f3effd700 1 -- 172.21.15.49:0/3824901819 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f401548c0 msgr2=0x7f4f401653e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.783+0000 7f4f3effd700 1 --2- 172.21.15.49:0/3824901819 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f401548c0 0x7f4f401653e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.783+0000 7f4f3effd700 1 -- 172.21.15.49:0/3824901819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f400c6e30 msgr2=0x7f4f400956d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.783+0000 7f4f3effd700 1 --2- 172.21.15.49:0/3824901819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f400c6e30 0x7f4f400956d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.783+0000 7f4f3effd700 1 -- 172.21.15.49:0/3824901819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f340092a0 con 0x7f4f401544e0 2023-11-30T17:22:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.783+0000 7f4f3effd700 1 --2- 172.21.15.49:0/3824901819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f401544e0 0x7f4f400ad090 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f4f34009eb0 tx=0x7f4f34017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.783+0000 7f4f277fe700 1 -- 172.21.15.49:0/3824901819 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3400b850 con 0x7f4f401544e0 2023-11-30T17:22:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.783+0000 7f4f277fe700 1 -- 172.21.15.49:0/3824901819 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3400b9b0 con 0x7f4f401544e0 2023-11-30T17:22:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.784+0000 7f4f4623f700 1 -- 172.21.15.49:0/3824901819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f40095f90 con 0x7f4f401544e0 2023-11-30T17:22:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.784+0000 7f4f277fe700 1 -- 172.21.15.49:0/3824901819 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3401c630 con 0x7f4f401544e0 2023-11-30T17:22:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.784+0000 7f4f4623f700 1 -- 172.21.15.49:0/3824901819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f40096550 con 0x7f4f401544e0 2023-11-30T17:22:17.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.785+0000 7f4f4623f700 1 -- 172.21.15.49:0/3824901819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f4006ab00 con 0x7f4f401544e0 2023-11-30T17:22:17.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.785+0000 7f4f277fe700 1 -- 172.21.15.49:0/3824901819 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4f3401c9a0 con 0x7f4f401544e0 2023-11-30T17:22:17.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.785+0000 7f4f277fe700 1 --2- 172.21.15.49:0/3824901819 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4f2c05f270 0x7f4f2c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:17.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.785+0000 7f4f277fe700 1 -- 172.21.15.49:0/3824901819 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5297+0+0 (secure 0 0 0) 0x7f4f3407be20 con 0x7f4f401544e0 2023-11-30T17:22:17.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.786+0000 7f4f3f7fe700 1 --2- 172.21.15.49:0/3824901819 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4f2c05f270 0x7f4f2c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:17.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.786+0000 7f4f3f7fe700 1 --2- 172.21.15.49:0/3824901819 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4f2c05f270 0x7f4f2c061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f4f30007fd0 tx=0x7f4f30007d30).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:17.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.790+0000 7f4f277fe700 1 -- 172.21.15.49:0/3824901819 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4f3404d360 con 0x7f4f401544e0 2023-11-30T17:22:17.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.961+0000 7f4f4623f700 1 -- 172.21.15.49:0/3824901819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f400c6250 con 0x7f4f401544e0 2023-11-30T17:22:17.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.962+0000 7f4f277fe700 1 -- 172.21.15.49:0/3824901819 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+13755 (secure 0 0 0) 0x7f4f3402a020 con 0x7f4f401544e0 2023-11-30T17:22:17.965 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:17.965 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":79,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:22:17.246505+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:22:17.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.964+0000 7f4f4623f700 1 -- 172.21.15.49:0/3824901819 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4f2c05f270 msgr2=0x7f4f2c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:17.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.964+0000 7f4f4623f700 1 --2- 172.21.15.49:0/3824901819 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4f2c05f270 0x7f4f2c061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f4f30007fd0 tx=0x7f4f30007d30).stop 2023-11-30T17:22:17.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.964+0000 7f4f4623f700 1 -- 172.21.15.49:0/3824901819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f401544e0 msgr2=0x7f4f400ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:17.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.964+0000 7f4f4623f700 1 --2- 172.21.15.49:0/3824901819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f401544e0 0x7f4f400ad090 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f4f34009eb0 tx=0x7f4f34017000).stop 2023-11-30T17:22:17.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.964+0000 7f4f4623f700 1 -- 172.21.15.49:0/3824901819 shutdown_connections 2023-11-30T17:22:17.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.964+0000 7f4f4623f700 1 --2- 172.21.15.49:0/3824901819 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f401548c0 0x7f4f401653e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:17.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.964+0000 7f4f4623f700 1 --2- 172.21.15.49:0/3824901819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f400c6e30 0x7f4f400956d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:17.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.964+0000 7f4f4623f700 1 --2- 172.21.15.49:0/3824901819 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4f2c05f270 0x7f4f2c061730 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:17.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.964+0000 7f4f4623f700 1 --2- 172.21.15.49:0/3824901819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f401544e0 0x7f4f400ad090 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:17.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.964+0000 7f4f4623f700 1 -- 172.21.15.49:0/3824901819 >> 172.21.15.49:0/3824901819 conn(0x7f4f40085020 msgr2=0x7f4f400caa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:17.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.964+0000 7f4f4623f700 1 -- 172.21.15.49:0/3824901819 shutdown_connections 2023-11-30T17:22:17.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:17.964+0000 7f4f4623f700 1 -- 172.21.15.49:0/3824901819 wait complete. 2023-11-30T17:22:17.979 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-11-30T17:22:17.979 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T17:22:18.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.097+0000 7f30c11c6700 1 Processor -- start 2023-11-30T17:22:18.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.097+0000 7f30c11c6700 1 -- start start 2023-11-30T17:22:18.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.098+0000 7f30c11c6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30bc0a5ac0 0x7f30bc0bd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:18.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.098+0000 7f30c11c6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f30bc0c1ee0 0x7f30bc065290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:18.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.098+0000 7f30c11c6700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30bc064e00 con 0x7f30bc0bca60 2023-11-30T17:22:18.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.098+0000 7f30c11c6700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30bc0a5ea0 con 0x7f30bc0c1ee0 2023-11-30T17:22:18.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.098+0000 7f30c11c6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc0a3fe0 con 0x7f30bc0a5ac0 2023-11-30T17:22:18.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.098+0000 7f30c09c5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f30bc0c1ee0 0x7f30bc065290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:18.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.098+0000 7f30bb7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f30bc0bca60 0x7f30bc0c17d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39204/0 (socket says 172.21.15.49:39204) 2023-11-30T17:22:18.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.098+0000 7f30bb7fe700 1 -- 172.21.15.49:0/1965622247 learned_addr learned my addr 172.21.15.49:0/1965622247 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:18.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.098+0000 7f30c09c5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f30bc0c1ee0 0x7f30bc065290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51904/0 (socket says 172.21.15.49:51904) 2023-11-30T17:22:18.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.098+0000 7f30bbfff700 1 --2- 172.21.15.49:0/1965622247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30bc0a5ac0 0x7f30bc0bd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:18.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.098+0000 7f30c09c5700 1 -- 172.21.15.49:0/1965622247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30bc0a5ac0 msgr2=0x7f30bc0bd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:18.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.098+0000 7f30c09c5700 1 --2- 172.21.15.49:0/1965622247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30bc0a5ac0 0x7f30bc0bd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:18.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.098+0000 7f30c09c5700 1 -- 172.21.15.49:0/1965622247 >> v1:172.21.15.49:6789/0 conn(0x7f30bc0bca60 legacy=0x7f30bc0c17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:18.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.098+0000 7f30baffd700 1 -- 172.21.15.49:0/1965622247 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2459451520 0 0) 0x7f30bc064e00 con 0x7f30bc0bca60 2023-11-30T17:22:18.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.098+0000 7f30c09c5700 1 -- 172.21.15.49:0/1965622247 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30bc0bcf80 con 0x7f30bc0c1ee0 2023-11-30T17:22:18.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.098+0000 7f30c09c5700 1 --2- 172.21.15.49:0/1965622247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30bc0c1ee0 0x7f30bc065290 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f30b4009e60 tx=0x7f30b4009780).ready entity=mon.0 client_cookie=b790cd66a8f9de42 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:18.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.098+0000 7f30baffd700 1 -- 172.21.15.49:0/1965622247 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b400e070 con 0x7f30bc0c1ee0 2023-11-30T17:22:18.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.099+0000 7f30baffd700 1 -- 172.21.15.49:0/1965622247 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b400bc30 con 0x7f30bc0c1ee0 2023-11-30T17:22:18.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.099+0000 7f30baffd700 1 -- 172.21.15.49:0/1965622247 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b4012410 con 0x7f30bc0c1ee0 2023-11-30T17:22:18.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.099+0000 7f30c11c6700 1 -- 172.21.15.49:0/1965622247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30bc0c1ee0 msgr2=0x7f30bc065290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:18.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.099+0000 7f30c11c6700 1 --2- 172.21.15.49:0/1965622247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30bc0c1ee0 0x7f30bc065290 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f30b4009e60 tx=0x7f30b4009780).stop 2023-11-30T17:22:18.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.099+0000 7f30c11c6700 1 -- 172.21.15.49:0/1965622247 shutdown_connections 2023-11-30T17:22:18.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.099+0000 7f30c11c6700 1 --2- 172.21.15.49:0/1965622247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30bc0c1ee0 0x7f30bc065290 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:18.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.099+0000 7f30c11c6700 1 --2- 172.21.15.49:0/1965622247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30bc0a5ac0 0x7f30bc0bd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:18.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.099+0000 7f30c11c6700 1 -- 172.21.15.49:0/1965622247 >> 172.21.15.49:0/1965622247 conn(0x7f30bc0c7130 msgr2=0x7f30bc0c7540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:18.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.099+0000 7f30c11c6700 1 -- 172.21.15.49:0/1965622247 shutdown_connections 2023-11-30T17:22:18.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.099+0000 7f30c11c6700 1 -- 172.21.15.49:0/1965622247 wait complete. 2023-11-30T17:22:18.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.100+0000 7f30c11c6700 1 Processor -- start 2023-11-30T17:22:18.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.100+0000 7f30c11c6700 1 -- start start 2023-11-30T17:22:18.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.101+0000 7f30c11c6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30bc0a5ac0 0x7f30bc0a6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:18.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.101+0000 7f30c11c6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30bc0bca60 0x7f30bc068c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:18.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.101+0000 7f30c11c6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30bc0c1ee0 0x7f30bc167c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:18.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.101+0000 7f30c11c6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc06a210 con 0x7f30bc0c1ee0 2023-11-30T17:22:18.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.101+0000 7f30c11c6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc069600 con 0x7f30bc0a5ac0 2023-11-30T17:22:18.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.101+0000 7f30c11c6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc0698e0 con 0x7f30bc0bca60 2023-11-30T17:22:18.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.101+0000 7f30c09c5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30bc0c1ee0 0x7f30bc167c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:18.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.101+0000 7f30c09c5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30bc0c1ee0 0x7f30bc167c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51910/0 (socket says 172.21.15.49:51910) 2023-11-30T17:22:18.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.101+0000 7f30c09c5700 1 -- 172.21.15.49:0/1031079010 learned_addr learned my addr 172.21.15.49:0/1031079010 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:18.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.101+0000 7f30bb7fe700 1 --2- 172.21.15.49:0/1031079010 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30bc0bca60 0x7f30bc068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:18.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.102+0000 7f30bbfff700 1 --2- 172.21.15.49:0/1031079010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30bc0a5ac0 0x7f30bc0a6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:18.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.102+0000 7f30c09c5700 1 -- 172.21.15.49:0/1031079010 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30bc0bca60 msgr2=0x7f30bc068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:18.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.102+0000 7f30c09c5700 1 --2- 172.21.15.49:0/1031079010 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30bc0bca60 0x7f30bc068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:18.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.102+0000 7f30c09c5700 1 -- 172.21.15.49:0/1031079010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30bc0a5ac0 msgr2=0x7f30bc0a6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:18.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.102+0000 7f30c09c5700 1 --2- 172.21.15.49:0/1031079010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30bc0a5ac0 0x7f30bc0a6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:18.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.102+0000 7f30c09c5700 1 -- 172.21.15.49:0/1031079010 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b4009a20 con 0x7f30bc0c1ee0 2023-11-30T17:22:18.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.102+0000 7f30bbfff700 1 --2- 172.21.15.49:0/1031079010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30bc0a5ac0 0x7f30bc0a6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:18.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.102+0000 7f30c09c5700 1 --2- 172.21.15.49:0/1031079010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30bc0c1ee0 0x7f30bc167c90 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f30bc0c4c70 tx=0x7f30b4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:18.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.102+0000 7f30a3fff700 1 -- 172.21.15.49:0/1031079010 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b401d700 con 0x7f30bc0c1ee0 2023-11-30T17:22:18.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.102+0000 7f30a3fff700 1 -- 172.21.15.49:0/1031079010 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b401d880 con 0x7f30bc0c1ee0 2023-11-30T17:22:18.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.102+0000 7f30c11c6700 1 -- 172.21.15.49:0/1031079010 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30bc069bc0 con 0x7f30bc0c1ee0 2023-11-30T17:22:18.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.102+0000 7f30a3fff700 1 -- 172.21.15.49:0/1031079010 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b401dc40 con 0x7f30bc0c1ee0 2023-11-30T17:22:18.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.102+0000 7f30c11c6700 1 -- 172.21.15.49:0/1031079010 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30bc0a7100 con 0x7f30bc0c1ee0 2023-11-30T17:22:18.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.103+0000 7f30c11c6700 1 -- 172.21.15.49:0/1031079010 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30bc060010 con 0x7f30bc0c1ee0 2023-11-30T17:22:18.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.103+0000 7f30a3fff700 1 -- 172.21.15.49:0/1031079010 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f30b401c590 con 0x7f30bc0c1ee0 2023-11-30T17:22:18.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.104+0000 7f30a3fff700 1 --2- 172.21.15.49:0/1031079010 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f30a805f270 0x7f30a8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:18.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.104+0000 7f30a3fff700 1 -- 172.21.15.49:0/1031079010 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5297+0+0 (secure 0 0 0) 0x7f30b407c020 con 0x7f30bc0c1ee0 2023-11-30T17:22:18.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.104+0000 7f30bbfff700 1 --2- 172.21.15.49:0/1031079010 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f30a805f270 0x7f30a8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:18.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.104+0000 7f30bbfff700 1 --2- 172.21.15.49:0/1031079010 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f30a805f270 0x7f30a8061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f30ac00aa10 tx=0x7f30ac008040).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:18.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.108+0000 7f30a3fff700 1 -- 172.21.15.49:0/1031079010 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f30b404d4a0 con 0x7f30bc0c1ee0 2023-11-30T17:22:18.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.281+0000 7f30c11c6700 1 -- 172.21.15.49:0/1031079010 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f30bc06c7c0 con 0x7f30bc0c1ee0 2023-11-30T17:22:18.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.282+0000 7f30a3fff700 1 -- 172.21.15.49:0/1031079010 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v79) v1 ==== 110+0+10 (secure 0 0 0) 0x7f30b4050ac0 con 0x7f30bc0c1ee0 2023-11-30T17:22:18.284 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T17:22:18.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.284+0000 7f30c11c6700 1 -- 172.21.15.49:0/1031079010 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f30a805f270 msgr2=0x7f30a8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:18.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.284+0000 7f30c11c6700 1 --2- 172.21.15.49:0/1031079010 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f30a805f270 0x7f30a8061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f30ac00aa10 tx=0x7f30ac008040).stop 2023-11-30T17:22:18.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.284+0000 7f30c11c6700 1 -- 172.21.15.49:0/1031079010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30bc0c1ee0 msgr2=0x7f30bc167c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:18.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.284+0000 7f30c11c6700 1 --2- 172.21.15.49:0/1031079010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30bc0c1ee0 0x7f30bc167c90 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f30bc0c4c70 tx=0x7f30b4009780).stop 2023-11-30T17:22:18.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.284+0000 7f30c11c6700 1 -- 172.21.15.49:0/1031079010 shutdown_connections 2023-11-30T17:22:18.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.284+0000 7f30c11c6700 1 --2- 172.21.15.49:0/1031079010 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f30a805f270 0x7f30a8061730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:18.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.284+0000 7f30c11c6700 1 --2- 172.21.15.49:0/1031079010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30bc0c1ee0 0x7f30bc167c90 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:18.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.284+0000 7f30c11c6700 1 --2- 172.21.15.49:0/1031079010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30bc0a5ac0 0x7f30bc0a6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:18.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.284+0000 7f30c11c6700 1 --2- 172.21.15.49:0/1031079010 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30bc0bca60 0x7f30bc068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:18.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.284+0000 7f30c11c6700 1 -- 172.21.15.49:0/1031079010 >> 172.21.15.49:0/1031079010 conn(0x7f30bc0c7130 msgr2=0x7f30bc0bd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:18.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.284+0000 7f30c11c6700 1 -- 172.21.15.49:0/1031079010 shutdown_connections 2023-11-30T17:22:18.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.284+0000 7f30c11c6700 1 -- 172.21.15.49:0/1031079010 wait complete. 2023-11-30T17:22:18.298 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T17:22:18.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.416+0000 7fa9ad0e2700 1 Processor -- start 2023-11-30T17:22:18.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.416+0000 7fa9ad0e2700 1 -- start start 2023-11-30T17:22:18.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.417+0000 7fa9ad0e2700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa9a80c66f0 0x7fa9a8154950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:18.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.417+0000 7fa9ad0e2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa9a8158570 0x7fa9a8158a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:18.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.417+0000 7fa9ad0e2700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a8154e40 con 0x7fa9a814e530 2023-11-30T17:22:18.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.417+0000 7fa9ad0e2700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9a80c6ba0 con 0x7fa9a8158570 2023-11-30T17:22:18.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.417+0000 7fa9ad0e2700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9a80c7bc0 con 0x7fa9a80c66f0 2023-11-30T17:22:18.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.417+0000 7fa9ac8e1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa9a8158570 0x7fa9a8158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:18.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.417+0000 7fa9a7fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa9a814e530 0x7fa9a814e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39210/0 (socket says 172.21.15.49:39210) 2023-11-30T17:22:18.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.417+0000 7fa9a7fff700 1 -- 172.21.15.49:0/2786454644 learned_addr learned my addr 172.21.15.49:0/2786454644 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:18.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.417+0000 7fa9a77fe700 1 --2- 172.21.15.49:0/2786454644 >> v2:172.21.15.115:3300/0 conn(0x7fa9a80c66f0 0x7fa9a8154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:18.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.417+0000 7fa9ac8e1700 1 -- 172.21.15.49:0/2786454644 >> v2:172.21.15.115:3300/0 conn(0x7fa9a80c66f0 msgr2=0x7fa9a8154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:18.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.417+0000 7fa9ac8e1700 1 --2- 172.21.15.49:0/2786454644 >> v2:172.21.15.115:3300/0 conn(0x7fa9a80c66f0 0x7fa9a8154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:18.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.417+0000 7fa9ac8e1700 1 -- 172.21.15.49:0/2786454644 >> v1:172.21.15.49:6789/0 conn(0x7fa9a814e530 legacy=0x7fa9a814e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:18.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.417+0000 7fa9ac8e1700 1 -- 172.21.15.49:0/2786454644 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a8155920 con 0x7fa9a8158570 2023-11-30T17:22:18.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.417+0000 7fa9a6ffd700 1 -- 172.21.15.49:0/2786454644 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3434293531 0 0) 0x7fa998001110 con 0x7fa9a814e530 2023-11-30T17:22:18.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.417+0000 7fa9ac8e1700 1 --2- 172.21.15.49:0/2786454644 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9a8158570 0x7fa9a8158a00 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7fa9a80ab0a0 tx=0x7fa9a0009780).ready entity=mon.0 client_cookie=a47de9b37aff1e4e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:18.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.417+0000 7fa9a6ffd700 1 -- 172.21.15.49:0/2786454644 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a000e070 con 0x7fa9a8158570 2023-11-30T17:22:18.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.417+0000 7fa9a6ffd700 1 -- 172.21.15.49:0/2786454644 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a000bc30 con 0x7fa9a8158570 2023-11-30T17:22:18.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.418+0000 7fa9a6ffd700 1 -- 172.21.15.49:0/2786454644 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0012410 con 0x7fa9a8158570 2023-11-30T17:22:18.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.418+0000 7fa9ad0e2700 1 -- 172.21.15.49:0/2786454644 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9a8158570 msgr2=0x7fa9a8158a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:18.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.418+0000 7fa9ad0e2700 1 --2- 172.21.15.49:0/2786454644 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9a8158570 0x7fa9a8158a00 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7fa9a80ab0a0 tx=0x7fa9a0009780).stop 2023-11-30T17:22:18.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.418+0000 7fa9ad0e2700 1 -- 172.21.15.49:0/2786454644 shutdown_connections 2023-11-30T17:22:18.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.418+0000 7fa9ad0e2700 1 --2- 172.21.15.49:0/2786454644 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9a8158570 0x7fa9a8158a00 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:18.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.418+0000 7fa9ad0e2700 1 --2- 172.21.15.49:0/2786454644 >> v2:172.21.15.115:3300/0 conn(0x7fa9a80c66f0 0x7fa9a8154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:18.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.418+0000 7fa9ad0e2700 1 -- 172.21.15.49:0/2786454644 >> 172.21.15.49:0/2786454644 conn(0x7fa9a8064990 msgr2=0x7fa9a8064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:18.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.418+0000 7fa9ad0e2700 1 -- 172.21.15.49:0/2786454644 shutdown_connections 2023-11-30T17:22:18.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.418+0000 7fa9ad0e2700 1 -- 172.21.15.49:0/2786454644 wait complete. 2023-11-30T17:22:18.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.419+0000 7fa9ad0e2700 1 Processor -- start 2023-11-30T17:22:18.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.419+0000 7fa9ad0e2700 1 -- start start 2023-11-30T17:22:18.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.420+0000 7fa9ad0e2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9a80c66f0 0x7fa9a80c2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:18.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.420+0000 7fa9ad0e2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9a814e530 0x7fa9a814d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:18.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.420+0000 7fa9ad0e2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9a8158570 0x7fa9a8164400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:18.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.420+0000 7fa9ad0e2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a80c3130 con 0x7fa9a80c66f0 2023-11-30T17:22:18.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.420+0000 7fa9ad0e2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a80c3410 con 0x7fa9a8158570 2023-11-30T17:22:18.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.420+0000 7fa9ad0e2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a80c36f0 con 0x7fa9a814e530 2023-11-30T17:22:18.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.420+0000 7fa9a7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9a80c66f0 0x7fa9a80c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:18.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.420+0000 7fa9a7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9a80c66f0 0x7fa9a80c2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51924/0 (socket says 172.21.15.49:51924) 2023-11-30T17:22:18.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.420+0000 7fa9a7fff700 1 -- 172.21.15.49:0/3805833561 learned_addr learned my addr 172.21.15.49:0/3805833561 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:18.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.420+0000 7fa9a7fff700 1 -- 172.21.15.49:0/3805833561 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9a814e530 msgr2=0x7fa9a814d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:18.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.420+0000 7fa9a7fff700 1 --2- 172.21.15.49:0/3805833561 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9a814e530 0x7fa9a814d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:18.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.420+0000 7fa9ac8e1700 1 --2- 172.21.15.49:0/3805833561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9a8158570 0x7fa9a8164400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:18.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.420+0000 7fa9a7fff700 1 -- 172.21.15.49:0/3805833561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9a8158570 msgr2=0x7fa9a8164400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:18.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.420+0000 7fa9a7fff700 1 --2- 172.21.15.49:0/3805833561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9a8158570 0x7fa9a8164400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:18.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.420+0000 7fa9a7fff700 1 -- 172.21.15.49:0/3805833561 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a0009a20 con 0x7fa9a80c66f0 2023-11-30T17:22:18.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.420+0000 7fa9ac8e1700 1 --2- 172.21.15.49:0/3805833561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9a8158570 0x7fa9a8164400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:22:18.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.421+0000 7fa9a7fff700 1 --2- 172.21.15.49:0/3805833561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9a80c66f0 0x7fa9a80c2500 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fa99800c510 tx=0x7fa998007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:18.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.421+0000 7fa98ffff700 1 -- 172.21.15.49:0/3805833561 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9980072e0 con 0x7fa9a80c66f0 2023-11-30T17:22:18.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.421+0000 7fa98ffff700 1 -- 172.21.15.49:0/3805833561 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa998007440 con 0x7fa9a80c66f0 2023-11-30T17:22:18.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.421+0000 7fa9ad0e2700 1 -- 172.21.15.49:0/3805833561 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a80c39d0 con 0x7fa9a80c66f0 2023-11-30T17:22:18.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.421+0000 7fa98ffff700 1 -- 172.21.15.49:0/3805833561 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9980057a0 con 0x7fa9a80c66f0 2023-11-30T17:22:18.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.421+0000 7fa9ad0e2700 1 -- 172.21.15.49:0/3805833561 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a80c2dc0 con 0x7fa9a80c66f0 2023-11-30T17:22:18.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.422+0000 7fa9ad0e2700 1 -- 172.21.15.49:0/3805833561 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a814df60 con 0x7fa9a80c66f0 2023-11-30T17:22:18.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.422+0000 7fa98ffff700 1 -- 172.21.15.49:0/3805833561 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa998005bd0 con 0x7fa9a80c66f0 2023-11-30T17:22:18.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.423+0000 7fa98ffff700 1 --2- 172.21.15.49:0/3805833561 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa99405f270 0x7fa994061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:18.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.423+0000 7fa98ffff700 1 -- 172.21.15.49:0/3805833561 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5297+0+0 (secure 0 0 0) 0x7fa9980797b0 con 0x7fa9a80c66f0 2023-11-30T17:22:18.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.423+0000 7fa9a77fe700 1 --2- 172.21.15.49:0/3805833561 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa99405f270 0x7fa994061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:18.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.423+0000 7fa9a77fe700 1 --2- 172.21.15.49:0/3805833561 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa99405f270 0x7fa994061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa9a81678b0 tx=0x7fa99c008040).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:18.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.427+0000 7fa98ffff700 1 -- 172.21.15.49:0/3805833561 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa9a814df60 con 0x7fa9a80c66f0 2023-11-30T17:22:18.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.599+0000 7fa9ad0e2700 1 -- 172.21.15.49:0/3805833561 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa9a8154e40 con 0x7fa9a80c66f0 2023-11-30T17:22:18.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.599+0000 7fa98ffff700 1 -- 172.21.15.49:0/3805833561 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v79) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa9a8154e40 con 0x7fa9a80c66f0 2023-11-30T17:22:18.602 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T17:22:18.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.601+0000 7fa9ad0e2700 1 -- 172.21.15.49:0/3805833561 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa99405f270 msgr2=0x7fa994061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:18.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.601+0000 7fa9ad0e2700 1 --2- 172.21.15.49:0/3805833561 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa99405f270 0x7fa994061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa9a81678b0 tx=0x7fa99c008040).stop 2023-11-30T17:22:18.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.601+0000 7fa9ad0e2700 1 -- 172.21.15.49:0/3805833561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9a80c66f0 msgr2=0x7fa9a80c2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:18.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.601+0000 7fa9ad0e2700 1 --2- 172.21.15.49:0/3805833561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9a80c66f0 0x7fa9a80c2500 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fa99800c510 tx=0x7fa998007ad0).stop 2023-11-30T17:22:18.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.601+0000 7fa9ad0e2700 1 -- 172.21.15.49:0/3805833561 shutdown_connections 2023-11-30T17:22:18.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.601+0000 7fa9ad0e2700 1 --2- 172.21.15.49:0/3805833561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9a8158570 0x7fa9a8164400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:18.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.601+0000 7fa9ad0e2700 1 --2- 172.21.15.49:0/3805833561 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa99405f270 0x7fa994061730 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:18.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.601+0000 7fa9ad0e2700 1 --2- 172.21.15.49:0/3805833561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9a80c66f0 0x7fa9a80c2500 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:18.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.601+0000 7fa9ad0e2700 1 --2- 172.21.15.49:0/3805833561 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9a814e530 0x7fa9a814d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:18.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.601+0000 7fa9ad0e2700 1 -- 172.21.15.49:0/3805833561 >> 172.21.15.49:0/3805833561 conn(0x7fa9a8064990 msgr2=0x7fa9a8153e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:18.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.601+0000 7fa9ad0e2700 1 -- 172.21.15.49:0/3805833561 shutdown_connections 2023-11-30T17:22:18.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.601+0000 7fa9ad0e2700 1 -- 172.21.15.49:0/3805833561 wait complete. 2023-11-30T17:22:18.616 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-30T17:22:18.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.731+0000 7f7115eab700 1 Processor -- start 2023-11-30T17:22:18.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.731+0000 7f7115eab700 1 -- start start 2023-11-30T17:22:18.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.732+0000 7f7115eab700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7110157660 0x7f7110157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:18.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.732+0000 7f7115eab700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71100c12c0 con 0x7f71100c0180 2023-11-30T17:22:18.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.732+0000 7f7115eab700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71100c06b0 con 0x7f71100c1750 2023-11-30T17:22:18.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.732+0000 7f7115eab700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71100c0990 con 0x7f7110157660 2023-11-30T17:22:18.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.732+0000 7f710ffff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f71100c0180 0x7f71101589c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39226/0 (socket says 172.21.15.49:39226) 2023-11-30T17:22:18.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.732+0000 7f710ffff700 1 -- 172.21.15.49:0/3361291698 learned_addr learned my addr 172.21.15.49:0/3361291698 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.732+0000 7f7114ea9700 1 --2- 172.21.15.49:0/3361291698 >> v2:172.21.15.115:3300/0 conn(0x7f7110157660 0x7f7110157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.732+0000 7f710f7fe700 1 -- 172.21.15.49:0/3361291698 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524808011 0 0) 0x7f71100c12c0 con 0x7f71100c0180 2023-11-30T17:22:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.732+0000 7f710f7fe700 1 -- 172.21.15.49:0/3361291698 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70fc0033f0 con 0x7f71100c0180 2023-11-30T17:22:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.733+0000 7f710f7fe700 1 -- 172.21.15.49:0/3361291698 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1812574215 0 0) 0x7f71100c06b0 con 0x7f71100c1750 2023-11-30T17:22:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.733+0000 7f710f7fe700 1 -- 172.21.15.49:0/3361291698 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71100c12c0 con 0x7f71100c1750 2023-11-30T17:22:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.733+0000 7f7114ea9700 1 -- 172.21.15.49:0/3361291698 >> v1:172.21.15.115:6789/0 conn(0x7f71100c1750 legacy=0x7f71100648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.733+0000 7f7114ea9700 1 -- 172.21.15.49:0/3361291698 >> v1:172.21.15.49:6789/0 conn(0x7f71100c0180 legacy=0x7f71101589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.733+0000 7f7114ea9700 1 -- 172.21.15.49:0/3361291698 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71100c0c70 con 0x7f7110157660 2023-11-30T17:22:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.733+0000 7f7114ea9700 1 --2- 172.21.15.49:0/3361291698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7110157660 0x7f7110157a40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f7108009e60 tx=0x7f7108009780).ready entity=mon.1 client_cookie=213391a9fc72be7f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.733+0000 7f710f7fe700 1 -- 172.21.15.49:0/3361291698 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710800e070 con 0x7f7110157660 2023-11-30T17:22:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.733+0000 7f710f7fe700 1 -- 172.21.15.49:0/3361291698 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710800bab0 con 0x7f7110157660 2023-11-30T17:22:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.733+0000 7f710f7fe700 1 -- 172.21.15.49:0/3361291698 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710800be30 con 0x7f7110157660 2023-11-30T17:22:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.733+0000 7f7115eab700 1 -- 172.21.15.49:0/3361291698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7110157660 msgr2=0x7f7110157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.733+0000 7f7115eab700 1 --2- 172.21.15.49:0/3361291698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7110157660 0x7f7110157a40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f7108009e60 tx=0x7f7108009780).stop 2023-11-30T17:22:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.733+0000 7f7115eab700 1 -- 172.21.15.49:0/3361291698 shutdown_connections 2023-11-30T17:22:18.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.733+0000 7f7115eab700 1 --2- 172.21.15.49:0/3361291698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7110157660 0x7f7110157a40 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:18.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.733+0000 7f7115eab700 1 -- 172.21.15.49:0/3361291698 >> 172.21.15.49:0/3361291698 conn(0x7f71100cb000 msgr2=0x7f71100cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:18.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.733+0000 7f7115eab700 1 -- 172.21.15.49:0/3361291698 shutdown_connections 2023-11-30T17:22:18.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.733+0000 7f7115eab700 1 -- 172.21.15.49:0/3361291698 wait complete. 2023-11-30T17:22:18.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.734+0000 7f7115eab700 1 Processor -- start 2023-11-30T17:22:18.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.735+0000 7f7115eab700 1 -- start start 2023-11-30T17:22:18.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.735+0000 7f7115eab700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71100c0180 0x7f71100afd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:18.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.735+0000 7f7115eab700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71100c1750 0x7f71100adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:18.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.735+0000 7f7115eab700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7110157660 0x7f71100ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:18.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.735+0000 7f7115eab700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71100af880 con 0x7f71100c1750 2023-11-30T17:22:18.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.735+0000 7f7115eab700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71100aec70 con 0x7f71100c0180 2023-11-30T17:22:18.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.735+0000 7f7115eab700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71100aef50 con 0x7f7110157660 2023-11-30T17:22:18.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.736+0000 7f710ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71100c1750 0x7f71100adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:18.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.736+0000 7f710ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71100c1750 0x7f71100adfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51928/0 (socket says 172.21.15.49:51928) 2023-11-30T17:22:18.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.736+0000 7f710ffff700 1 -- 172.21.15.49:0/267792273 learned_addr learned my addr 172.21.15.49:0/267792273 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:18.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.736+0000 7f7114ea9700 1 --2- 172.21.15.49:0/267792273 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71100c0180 0x7f71100afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:18.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.736+0000 7f71156aa700 1 --2- 172.21.15.49:0/267792273 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7110157660 0x7f71100ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:18.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.736+0000 7f710ffff700 1 -- 172.21.15.49:0/267792273 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7110157660 msgr2=0x7f71100ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:18.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.736+0000 7f710ffff700 1 --2- 172.21.15.49:0/267792273 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7110157660 0x7f71100ae4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.736+0000 7f710ffff700 1 -- 172.21.15.49:0/267792273 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71100c0180 msgr2=0x7f71100afd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.736+0000 7f710ffff700 1 --2- 172.21.15.49:0/267792273 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71100c0180 0x7f71100afd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.736+0000 7f710ffff700 1 -- 172.21.15.49:0/267792273 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7108009a20 con 0x7f71100c1750 2023-11-30T17:22:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.736+0000 7f710ffff700 1 --2- 172.21.15.49:0/267792273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71100c1750 0x7f71100adfb0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f710000c560 tx=0x7f7100007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.736+0000 7f710cff9700 1 -- 172.21.15.49:0/267792273 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710000ce70 con 0x7f71100c1750 2023-11-30T17:22:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.736+0000 7f710cff9700 1 -- 172.21.15.49:0/267792273 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71000072e0 con 0x7f71100c1750 2023-11-30T17:22:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.736+0000 7f7115eab700 1 -- 172.21.15.49:0/267792273 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71100af230 con 0x7f71100c1750 2023-11-30T17:22:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.736+0000 7f710cff9700 1 -- 172.21.15.49:0/267792273 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7100007660 con 0x7f71100c1750 2023-11-30T17:22:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.736+0000 7f7115eab700 1 -- 172.21.15.49:0/267792273 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71100ae990 con 0x7f71100c1750 2023-11-30T17:22:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.737+0000 7f7115eab700 1 -- 172.21.15.49:0/267792273 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71100afa30 con 0x7f71100c1750 2023-11-30T17:22:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.738+0000 7f710cff9700 1 -- 172.21.15.49:0/267792273 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f71000059b0 con 0x7f71100c1750 2023-11-30T17:22:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.738+0000 7f710cff9700 1 --2- 172.21.15.49:0/267792273 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f70f005f270 0x7f70f0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.738+0000 7f710cff9700 1 -- 172.21.15.49:0/267792273 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5297+0+0 (secure 0 0 0) 0x7f7100079670 con 0x7f71100c1750 2023-11-30T17:22:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.738+0000 7f7114ea9700 1 --2- 172.21.15.49:0/267792273 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f70f005f270 0x7f70f0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.739+0000 7f7114ea9700 1 --2- 172.21.15.49:0/267792273 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f70f005f270 0x7f70f0061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f71080094d0 tx=0x7f7108009780).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.742+0000 7f710cff9700 1 -- 172.21.15.49:0/267792273 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f71100afa30 con 0x7f71100c1750 2023-11-30T17:22:18.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.915+0000 7f7115eab700 1 -- 172.21.15.49:0/267792273 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f711006c7c0 con 0x7f71100c1750 2023-11-30T17:22:18.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.916+0000 7f710cff9700 1 -- 172.21.15.49:0/267792273 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v79) v1 ==== 84+0+143 (secure 0 0 0) 0x7f710004e520 con 0x7f71100c1750 2023-11-30T17:22:18.918 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:18.918 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-11-30T17:22:18.919 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:18.919 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2023-11-30T17:22:18.919 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "device_health_metrics" 2023-11-30T17:22:18.919 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:18.919 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:18.919 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 2, 2023-11-30T17:22:18.919 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "rbd" 2023-11-30T17:22:18.919 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:18.919 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-11-30T17:22:18.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.917+0000 7f7115eab700 1 -- 172.21.15.49:0/267792273 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f70f005f270 msgr2=0x7f70f0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:18.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.917+0000 7f7115eab700 1 --2- 172.21.15.49:0/267792273 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f70f005f270 0x7f70f0061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f71080094d0 tx=0x7f7108009780).stop 2023-11-30T17:22:18.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.917+0000 7f7115eab700 1 -- 172.21.15.49:0/267792273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71100c1750 msgr2=0x7f71100adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:18.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.917+0000 7f7115eab700 1 --2- 172.21.15.49:0/267792273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71100c1750 0x7f71100adfb0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f710000c560 tx=0x7f7100007d20).stop 2023-11-30T17:22:18.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.917+0000 7f7115eab700 1 -- 172.21.15.49:0/267792273 shutdown_connections 2023-11-30T17:22:18.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.917+0000 7f7115eab700 1 --2- 172.21.15.49:0/267792273 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7110157660 0x7f71100ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:18.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.917+0000 7f7115eab700 1 --2- 172.21.15.49:0/267792273 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71100c0180 0x7f71100afd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:18.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.917+0000 7f7115eab700 1 --2- 172.21.15.49:0/267792273 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f70f005f270 0x7f70f0061730 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:18.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.917+0000 7f7115eab700 1 --2- 172.21.15.49:0/267792273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71100c1750 0x7f71100adfb0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:18.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.917+0000 7f7115eab700 1 -- 172.21.15.49:0/267792273 >> 172.21.15.49:0/267792273 conn(0x7f71100cb000 msgr2=0x7f7110152fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:18.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.918+0000 7f7115eab700 1 -- 172.21.15.49:0/267792273 shutdown_connections 2023-11-30T17:22:18.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:18.918+0000 7f7115eab700 1 -- 172.21.15.49:0/267792273 wait complete. 2023-11-30T17:22:18.933 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-30T17:22:18.933 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-11-30T17:22:19.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.053+0000 7fa98cbee700 1 Processor -- start 2023-11-30T17:22:19.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.053+0000 7fa98cbee700 1 -- start start 2023-11-30T17:22:19.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.054+0000 7fa98cbee700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa988154530 0x7fa988154910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:19.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.054+0000 7fa98cbee700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa9880a7ff0 0x7fa9880c8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:19.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.054+0000 7fa98cbee700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9880c6630 con 0x7fa9880aa220 2023-11-30T17:22:19.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.054+0000 7fa98cbee700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9880c6390 con 0x7fa988154530 2023-11-30T17:22:19.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.054+0000 7fa98cbee700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9880a8470 con 0x7fa9880a7ff0 2023-11-30T17:22:19.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.054+0000 7fa98659c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa988154530 0x7fa988154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:19.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.054+0000 7fa98659c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa988154530 0x7fa988154910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51944/0 (socket says 172.21.15.49:51944) 2023-11-30T17:22:19.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.054+0000 7fa98659c700 1 -- 172.21.15.49:0/2989819274 learned_addr learned my addr 172.21.15.49:0/2989819274 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:19.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.054+0000 7fa97ffff700 1 --2- 172.21.15.49:0/2989819274 >> v2:172.21.15.115:3300/0 conn(0x7fa9880a7ff0 0x7fa9880c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.055+0000 7fa98659c700 1 -- 172.21.15.49:0/2989819274 >> v2:172.21.15.115:3300/0 conn(0x7fa9880a7ff0 msgr2=0x7fa9880c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.055+0000 7fa98659c700 1 --2- 172.21.15.49:0/2989819274 >> v2:172.21.15.115:3300/0 conn(0x7fa9880a7ff0 0x7fa9880c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.055+0000 7fa98659c700 1 -- 172.21.15.49:0/2989819274 >> v1:172.21.15.115:6789/0 conn(0x7fa9880aa220 legacy=0x7fa9880c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.055+0000 7fa98659c700 1 -- 172.21.15.49:0/2989819274 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa988064230 con 0x7fa988154530 2023-11-30T17:22:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.055+0000 7fa98659c700 1 --2- 172.21.15.49:0/2989819274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa988154530 0x7fa988154910 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7fa9880adfd0 tx=0x7fa978009060).ready entity=mon.0 client_cookie=5c4b87555417863 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.055+0000 7fa985d9b700 1 -- 172.21.15.49:0/2989819274 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa978005880 con 0x7fa988154530 2023-11-30T17:22:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.055+0000 7fa985d9b700 1 -- 172.21.15.49:0/2989819274 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9780059e0 con 0x7fa988154530 2023-11-30T17:22:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.055+0000 7fa985d9b700 1 -- 172.21.15.49:0/2989819274 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa978005d60 con 0x7fa988154530 2023-11-30T17:22:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.055+0000 7fa98cbee700 1 -- 172.21.15.49:0/2989819274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa988154530 msgr2=0x7fa988154910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.055+0000 7fa98cbee700 1 --2- 172.21.15.49:0/2989819274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa988154530 0x7fa988154910 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7fa9880adfd0 tx=0x7fa978009060).stop 2023-11-30T17:22:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.055+0000 7fa98cbee700 1 -- 172.21.15.49:0/2989819274 shutdown_connections 2023-11-30T17:22:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.055+0000 7fa98cbee700 1 --2- 172.21.15.49:0/2989819274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa988154530 0x7fa988154910 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.055+0000 7fa98cbee700 1 --2- 172.21.15.49:0/2989819274 >> v2:172.21.15.115:3300/0 conn(0x7fa9880a7ff0 0x7fa9880c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.055+0000 7fa98cbee700 1 -- 172.21.15.49:0/2989819274 >> 172.21.15.49:0/2989819274 conn(0x7fa988094930 msgr2=0x7fa98806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.055+0000 7fa98cbee700 1 -- 172.21.15.49:0/2989819274 shutdown_connections 2023-11-30T17:22:19.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.056+0000 7fa98cbee700 1 -- 172.21.15.49:0/2989819274 wait complete. 2023-11-30T17:22:19.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.057+0000 7fa98cbee700 1 Processor -- start 2023-11-30T17:22:19.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.057+0000 7fa98cbee700 1 -- start start 2023-11-30T17:22:19.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.057+0000 7fa98cbee700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9880a7ff0 0x7fa9881510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:19.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.057+0000 7fa98cbee700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9880aa220 0x7fa9880ab7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:19.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.057+0000 7fa98cbee700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa988154530 0x7fa9880abc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:19.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.057+0000 7fa98cbee700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9880ab060 con 0x7fa9880aa220 2023-11-30T17:22:19.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.057+0000 7fa98cbee700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9880ab4f0 con 0x7fa9880a7ff0 2023-11-30T17:22:19.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.057+0000 7fa98cbee700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9880ac280 con 0x7fa988154530 2023-11-30T17:22:19.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.058+0000 7fa97ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9880aa220 0x7fa9880ab7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:19.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.058+0000 7fa97ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9880aa220 0x7fa9880ab7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51950/0 (socket says 172.21.15.49:51950) 2023-11-30T17:22:19.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.058+0000 7fa97ffff700 1 -- 172.21.15.49:0/3272833339 learned_addr learned my addr 172.21.15.49:0/3272833339 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:19.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.058+0000 7fa98659c700 1 --2- 172.21.15.49:0/3272833339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9880a7ff0 0x7fa9881510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:19.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.058+0000 7fa986d9d700 1 --2- 172.21.15.49:0/3272833339 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa988154530 0x7fa9880abc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:19.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.058+0000 7fa97ffff700 1 -- 172.21.15.49:0/3272833339 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa988154530 msgr2=0x7fa9880abc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:19.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.058+0000 7fa97ffff700 1 --2- 172.21.15.49:0/3272833339 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa988154530 0x7fa9880abc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:19.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.058+0000 7fa97ffff700 1 -- 172.21.15.49:0/3272833339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9880a7ff0 msgr2=0x7fa9881510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:19.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.058+0000 7fa97ffff700 1 --2- 172.21.15.49:0/3272833339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9880a7ff0 0x7fa9881510e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:19.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.058+0000 7fa97ffff700 1 -- 172.21.15.49:0/3272833339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa978009300 con 0x7fa9880aa220 2023-11-30T17:22:19.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.058+0000 7fa986d9d700 1 --2- 172.21.15.49:0/3272833339 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa988154530 0x7fa9880abc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:19.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.058+0000 7fa97ffff700 1 --2- 172.21.15.49:0/3272833339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9880aa220 0x7fa9880ab7a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7fa97000e930 tx=0x7fa970009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:19.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.058+0000 7fa97e7fc700 1 -- 172.21.15.49:0/3272833339 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97000c670 con 0x7fa9880aa220 2023-11-30T17:22:19.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.058+0000 7fa97e7fc700 1 -- 172.21.15.49:0/3272833339 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97000c7d0 con 0x7fa9880aa220 2023-11-30T17:22:19.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.058+0000 7fa98cbee700 1 -- 172.21.15.49:0/3272833339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9880aa730 con 0x7fa9880aa220 2023-11-30T17:22:19.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.058+0000 7fa97e7fc700 1 -- 172.21.15.49:0/3272833339 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97000cb50 con 0x7fa9880aa220 2023-11-30T17:22:19.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.058+0000 7fa98cbee700 1 -- 172.21.15.49:0/3272833339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9880aacf0 con 0x7fa9880aa220 2023-11-30T17:22:19.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.059+0000 7fa98cbee700 1 -- 172.21.15.49:0/3272833339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa98806c860 con 0x7fa9880aa220 2023-11-30T17:22:19.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.060+0000 7fa97e7fc700 1 -- 172.21.15.49:0/3272833339 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa97001b400 con 0x7fa9880aa220 2023-11-30T17:22:19.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.060+0000 7fa97e7fc700 1 --2- 172.21.15.49:0/3272833339 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa96805f270 0x7fa968061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:19.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.060+0000 7fa97e7fc700 1 -- 172.21.15.49:0/3272833339 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5297+0+0 (secure 0 0 0) 0x7fa97007a560 con 0x7fa9880aa220 2023-11-30T17:22:19.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.060+0000 7fa98659c700 1 --2- 172.21.15.49:0/3272833339 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa96805f270 0x7fa968061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:19.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.061+0000 7fa98659c700 1 --2- 172.21.15.49:0/3272833339 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa96805f270 0x7fa968061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fa978009fd0 tx=0x7fa978016000).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:19.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.064+0000 7fa97e7fc700 1 -- 172.21.15.49:0/3272833339 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa97004ba30 con 0x7fa9880aa220 2023-11-30T17:22:19.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.238+0000 7fa98cbee700 1 -- 172.21.15.49:0/3272833339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fa9880ab1a0 con 0x7fa9880aa220 2023-11-30T17:22:19.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.908+0000 7fa97e7fc700 1 -- 172.21.15.49:0/3272833339 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v80) v1 ==== 152+0+0 (secure 0 0 0) 0x7fa97004f050 con 0x7fa9880aa220 2023-11-30T17:22:19.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.913+0000 7fa98cbee700 1 -- 172.21.15.49:0/3272833339 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa96805f270 msgr2=0x7fa968061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:19.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.913+0000 7fa98cbee700 1 --2- 172.21.15.49:0/3272833339 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa96805f270 0x7fa968061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fa978009fd0 tx=0x7fa978016000).stop 2023-11-30T17:22:19.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.913+0000 7fa98cbee700 1 -- 172.21.15.49:0/3272833339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9880aa220 msgr2=0x7fa9880ab7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:19.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.913+0000 7fa98cbee700 1 --2- 172.21.15.49:0/3272833339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9880aa220 0x7fa9880ab7a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7fa97000e930 tx=0x7fa970009060).stop 2023-11-30T17:22:19.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.913+0000 7fa98cbee700 1 -- 172.21.15.49:0/3272833339 shutdown_connections 2023-11-30T17:22:19.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.913+0000 7fa98cbee700 1 --2- 172.21.15.49:0/3272833339 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa988154530 0x7fa9880abc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:19.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.913+0000 7fa98cbee700 1 --2- 172.21.15.49:0/3272833339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9880a7ff0 0x7fa9881510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:19.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.913+0000 7fa98cbee700 1 --2- 172.21.15.49:0/3272833339 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa96805f270 0x7fa968061730 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:19.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.913+0000 7fa98cbee700 1 --2- 172.21.15.49:0/3272833339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9880aa220 0x7fa9880ab7a0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:19.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.913+0000 7fa98cbee700 1 -- 172.21.15.49:0/3272833339 >> 172.21.15.49:0/3272833339 conn(0x7fa988094930 msgr2=0x7fa988152f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:19.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.915+0000 7fa98cbee700 1 -- 172.21.15.49:0/3272833339 shutdown_connections 2023-11-30T17:22:19.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:19.915+0000 7fa98cbee700 1 -- 172.21.15.49:0/3272833339 wait complete. 2023-11-30T17:22:19.923 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2023-11-30T17:22:19.935 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-30T17:22:20.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.063+0000 7f6a3b647700 1 Processor -- start 2023-11-30T17:22:20.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.063+0000 7f6a3b647700 1 -- start start 2023-11-30T17:22:20.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.064+0000 7f6a3b647700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6a3414edb0 0x7f6a34095e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:20.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.064+0000 7f6a3b647700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6a340bfbe0 0x7f6a34067ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:20.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.064+0000 7f6a3b647700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a34154c00 con 0x7f6a34096370 2023-11-30T17:22:20.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.064+0000 7f6a3b647700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a34096820 con 0x7f6a3414edb0 2023-11-30T17:22:20.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.064+0000 7f6a3b647700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a3414f190 con 0x7f6a340bfbe0 2023-11-30T17:22:20.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.064+0000 7f6a393e3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6a3414edb0 0x7f6a34095e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:20.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.064+0000 7f6a38be2700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6a34096370 0x7f6a340673d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39236/0 (socket says 172.21.15.49:39236) 2023-11-30T17:22:20.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.064+0000 7f6a38be2700 1 -- 172.21.15.49:0/1079757277 learned_addr learned my addr 172.21.15.49:0/1079757277 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:20.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.065+0000 7f6a39be4700 1 --2- 172.21.15.49:0/1079757277 >> v2:172.21.15.115:3300/0 conn(0x7f6a340bfbe0 0x7f6a34067ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:20.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.065+0000 7f6a393e3700 1 -- 172.21.15.49:0/1079757277 >> v2:172.21.15.115:3300/0 conn(0x7f6a340bfbe0 msgr2=0x7f6a34067ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:20.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.065+0000 7f6a393e3700 1 --2- 172.21.15.49:0/1079757277 >> v2:172.21.15.115:3300/0 conn(0x7f6a340bfbe0 0x7f6a34067ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:20.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.065+0000 7f6a393e3700 1 -- 172.21.15.49:0/1079757277 >> v1:172.21.15.49:6789/0 conn(0x7f6a34096370 legacy=0x7f6a340673d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:20.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.065+0000 7f6a33fff700 1 -- 172.21.15.49:0/1079757277 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775627865 0 0) 0x7f6a28001110 con 0x7f6a34096370 2023-11-30T17:22:20.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.065+0000 7f6a393e3700 1 -- 172.21.15.49:0/1079757277 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a34155770 con 0x7f6a3414edb0 2023-11-30T17:22:20.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.065+0000 7f6a393e3700 1 --2- 172.21.15.49:0/1079757277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a3414edb0 0x7f6a34095e80 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f6a340665f0 tx=0x7f6a2c009060).ready entity=mon.0 client_cookie=207dadf1b45780ef server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:20.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.065+0000 7f6a33fff700 1 -- 172.21.15.49:0/1079757277 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c0090d0 con 0x7f6a3414edb0 2023-11-30T17:22:20.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.065+0000 7f6a33fff700 1 -- 172.21.15.49:0/1079757277 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2c00b580 con 0x7f6a3414edb0 2023-11-30T17:22:20.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.065+0000 7f6a33fff700 1 -- 172.21.15.49:0/1079757277 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c00b900 con 0x7f6a3414edb0 2023-11-30T17:22:20.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.066+0000 7f6a3b647700 1 -- 172.21.15.49:0/1079757277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a3414edb0 msgr2=0x7f6a34095e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:20.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.066+0000 7f6a3b647700 1 --2- 172.21.15.49:0/1079757277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a3414edb0 0x7f6a34095e80 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f6a340665f0 tx=0x7f6a2c009060).stop 2023-11-30T17:22:20.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.066+0000 7f6a3b647700 1 -- 172.21.15.49:0/1079757277 shutdown_connections 2023-11-30T17:22:20.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.066+0000 7f6a3b647700 1 --2- 172.21.15.49:0/1079757277 >> v2:172.21.15.115:3300/0 conn(0x7f6a340bfbe0 0x7f6a34067ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:20.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.066+0000 7f6a3b647700 1 --2- 172.21.15.49:0/1079757277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a3414edb0 0x7f6a34095e80 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:20.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.066+0000 7f6a3b647700 1 -- 172.21.15.49:0/1079757277 >> 172.21.15.49:0/1079757277 conn(0x7f6a340631d0 msgr2=0x7f6a340c9160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:20.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.066+0000 7f6a3b647700 1 -- 172.21.15.49:0/1079757277 shutdown_connections 2023-11-30T17:22:20.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.066+0000 7f6a3b647700 1 -- 172.21.15.49:0/1079757277 wait complete. 2023-11-30T17:22:20.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.067+0000 7f6a3b647700 1 Processor -- start 2023-11-30T17:22:20.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.067+0000 7f6a3b647700 1 -- start start 2023-11-30T17:22:20.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.068+0000 7f6a3b647700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a34096370 0x7f6a3414f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:20.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.068+0000 7f6a3b647700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a340bfbe0 0x7f6a340ab730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:20.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.068+0000 7f6a3b647700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a3414edb0 0x7f6a3414dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:20.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.068+0000 7f6a3b647700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a340abc20 con 0x7f6a34096370 2023-11-30T17:22:20.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.068+0000 7f6a3b647700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a341504f0 con 0x7f6a340bfbe0 2023-11-30T17:22:20.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.068+0000 7f6a3b647700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3414f8e0 con 0x7f6a3414edb0 2023-11-30T17:22:20.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.068+0000 7f6a393e3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a34096370 0x7f6a3414f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:20.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.068+0000 7f6a393e3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a34096370 0x7f6a3414f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51968/0 (socket says 172.21.15.49:51968) 2023-11-30T17:22:20.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.068+0000 7f6a393e3700 1 -- 172.21.15.49:0/1912934384 learned_addr learned my addr 172.21.15.49:0/1912934384 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:20.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.068+0000 7f6a38be2700 1 --2- 172.21.15.49:0/1912934384 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a340bfbe0 0x7f6a340ab730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:20.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.068+0000 7f6a39be4700 1 --2- 172.21.15.49:0/1912934384 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a3414edb0 0x7f6a3414dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:20.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.068+0000 7f6a393e3700 1 -- 172.21.15.49:0/1912934384 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a3414edb0 msgr2=0x7f6a3414dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:20.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.068+0000 7f6a393e3700 1 --2- 172.21.15.49:0/1912934384 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a3414edb0 0x7f6a3414dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:20.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.068+0000 7f6a393e3700 1 -- 172.21.15.49:0/1912934384 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a340bfbe0 msgr2=0x7f6a340ab730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:20.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.068+0000 7f6a393e3700 1 --2- 172.21.15.49:0/1912934384 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a340bfbe0 0x7f6a340ab730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:20.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.068+0000 7f6a393e3700 1 -- 172.21.15.49:0/1912934384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2c0092a0 con 0x7f6a34096370 2023-11-30T17:22:20.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.068+0000 7f6a393e3700 1 --2- 172.21.15.49:0/1912934384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a34096370 0x7f6a3414f300 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f6a2c009e80 tx=0x7f6a2c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:20.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.069+0000 7f6a317fa700 1 -- 172.21.15.49:0/1912934384 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c00b900 con 0x7f6a34096370 2023-11-30T17:22:20.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.069+0000 7f6a317fa700 1 -- 172.21.15.49:0/1912934384 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2c00bcc0 con 0x7f6a34096370 2023-11-30T17:22:20.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.069+0000 7f6a3b647700 1 -- 172.21.15.49:0/1912934384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a3414fbc0 con 0x7f6a34096370 2023-11-30T17:22:20.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.069+0000 7f6a317fa700 1 -- 172.21.15.49:0/1912934384 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c01b440 con 0x7f6a34096370 2023-11-30T17:22:20.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.069+0000 7f6a3b647700 1 -- 172.21.15.49:0/1912934384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a34150180 con 0x7f6a34096370 2023-11-30T17:22:20.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.070+0000 7f6a3b647700 1 -- 172.21.15.49:0/1912934384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a3406c860 con 0x7f6a34096370 2023-11-30T17:22:20.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.070+0000 7f6a317fa700 1 -- 172.21.15.49:0/1912934384 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6a2c01b830 con 0x7f6a34096370 2023-11-30T17:22:20.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.071+0000 7f6a317fa700 1 --2- 172.21.15.49:0/1912934384 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6a2005f270 0x7f6a20061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:20.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.071+0000 7f6a317fa700 1 -- 172.21.15.49:0/1912934384 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5667+0+0 (secure 0 0 0) 0x7f6a2c07c430 con 0x7f6a34096370 2023-11-30T17:22:20.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.071+0000 7f6a38be2700 1 --2- 172.21.15.49:0/1912934384 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6a2005f270 0x7f6a20061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:20.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.072+0000 7f6a38be2700 1 --2- 172.21.15.49:0/1912934384 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6a2005f270 0x7f6a20061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f6a34064530 tx=0x7f6a28007dd0).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:20.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.075+0000 7f6a317fa700 1 -- 172.21.15.49:0/1912934384 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6a2c04d800 con 0x7f6a34096370 2023-11-30T17:22:20.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.249+0000 7f6a3b647700 1 -- 172.21.15.49:0/1912934384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6a340c53d0 con 0x7f6a34096370 2023-11-30T17:22:20.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.913+0000 7f6a317fa700 1 -- 172.21.15.49:0/1912934384 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v81) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6a2c050e20 con 0x7f6a34096370 2023-11-30T17:22:20.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.926+0000 7f6a3b647700 1 -- 172.21.15.49:0/1912934384 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6a2005f270 msgr2=0x7f6a20061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:20.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.926+0000 7f6a3b647700 1 --2- 172.21.15.49:0/1912934384 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6a2005f270 0x7f6a20061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f6a34064530 tx=0x7f6a28007dd0).stop 2023-11-30T17:22:20.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.926+0000 7f6a3b647700 1 -- 172.21.15.49:0/1912934384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a34096370 msgr2=0x7f6a3414f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:20.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.926+0000 7f6a3b647700 1 --2- 172.21.15.49:0/1912934384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a34096370 0x7f6a3414f300 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f6a2c009e80 tx=0x7f6a2c017000).stop 2023-11-30T17:22:20.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.926+0000 7f6a3b647700 1 -- 172.21.15.49:0/1912934384 shutdown_connections 2023-11-30T17:22:20.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.926+0000 7f6a3b647700 1 --2- 172.21.15.49:0/1912934384 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a3414edb0 0x7f6a3414dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:20.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.926+0000 7f6a3b647700 1 --2- 172.21.15.49:0/1912934384 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6a2005f270 0x7f6a20061730 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:20.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.926+0000 7f6a3b647700 1 --2- 172.21.15.49:0/1912934384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a34096370 0x7f6a3414f300 secure :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0x7f6a2c009e80 tx=0x7f6a2c017000).stop 2023-11-30T17:22:20.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.926+0000 7f6a3b647700 1 --2- 172.21.15.49:0/1912934384 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a340bfbe0 0x7f6a340ab730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:20.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.926+0000 7f6a3b647700 1 -- 172.21.15.49:0/1912934384 >> 172.21.15.49:0/1912934384 conn(0x7f6a340631d0 msgr2=0x7f6a340c4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:20.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.929+0000 7f6a3b647700 1 -- 172.21.15.49:0/1912934384 shutdown_connections 2023-11-30T17:22:20.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:20.930+0000 7f6a3b647700 1 -- 172.21.15.49:0/1912934384 wait complete. 2023-11-30T17:22:20.939 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2023-11-30T17:22:20.954 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-30T17:22:21.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.073+0000 7fc959fef700 1 Processor -- start 2023-11-30T17:22:21.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.073+0000 7fc959fef700 1 -- start start 2023-11-30T17:22:21.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.074+0000 7fc959fef700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc954098d10 0x7fc9540c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:21.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.074+0000 7fc959fef700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc9540c6190 0x7fc954063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:21.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.074+0000 7fc959fef700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9540c72d0 con 0x7fc954064350 2023-11-30T17:22:21.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.074+0000 7fc959fef700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc954154bc0 con 0x7fc9540c6190 2023-11-30T17:22:21.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.074+0000 7fc959fef700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9540c66c0 con 0x7fc954098d10 2023-11-30T17:22:21.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.074+0000 7fc953fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc954064350 0x7fc954158320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34020/0 (socket says 172.21.15.49:34020) 2023-11-30T17:22:21.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.074+0000 7fc953fff700 1 -- 172.21.15.49:0/1564718534 learned_addr learned my addr 172.21.15.49:0/1564718534 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:21.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.074+0000 7fc952ffd700 1 --2- 172.21.15.49:0/1564718534 >> v2:172.21.15.115:3300/0 conn(0x7fc9540c6190 0x7fc954063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:21.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.074+0000 7fc9537fe700 1 --2- 172.21.15.49:0/1564718534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc954098d10 0x7fc9540c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:21.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.074+0000 7fc9527fc700 1 -- 172.21.15.49:0/1564718534 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073223761 0 0) 0x7fc9540c72d0 con 0x7fc954064350 2023-11-30T17:22:21.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.074+0000 7fc9527fc700 1 -- 172.21.15.49:0/1564718534 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc93c0033f0 con 0x7fc954064350 2023-11-30T17:22:21.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.075+0000 7fc9527fc700 1 -- 172.21.15.49:0/1564718534 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4216404296 0 0) 0x7fc93c0033f0 con 0x7fc954064350 2023-11-30T17:22:21.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.075+0000 7fc9527fc700 1 -- 172.21.15.49:0/1564718534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc954098d10 msgr2=0x7fc9540c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:21.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.075+0000 7fc9527fc700 1 --2- 172.21.15.49:0/1564718534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc954098d10 0x7fc9540c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:21.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.075+0000 7fc9527fc700 1 -- 172.21.15.49:0/1564718534 >> v2:172.21.15.115:3300/0 conn(0x7fc9540c6190 msgr2=0x7fc954063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:21.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.075+0000 7fc9527fc700 1 --2- 172.21.15.49:0/1564718534 >> v2:172.21.15.115:3300/0 conn(0x7fc9540c6190 0x7fc954063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:21.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.075+0000 7fc9527fc700 1 -- 172.21.15.49:0/1564718534 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9540c69a0 con 0x7fc954064350 2023-11-30T17:22:21.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.075+0000 7fc9527fc700 1 -- 172.21.15.49:0/1564718534 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fc94c0017f0 con 0x7fc954064350 2023-11-30T17:22:21.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.075+0000 7fc9527fc700 1 -- 172.21.15.49:0/1564718534 >> v1:172.21.15.49:6789/0 conn(0x7fc954064350 legacy=0x7fc954158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:21.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.075+0000 7fc9527fc700 1 --2- 172.21.15.49:0/1564718534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc93c0038e0 0x7fc93c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:21.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.075+0000 7fc9527fc700 1 --2- 172.21.15.49:0/1564718534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc93c004690 0x7fc93c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:21.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.075+0000 7fc9527fc700 1 --2- 172.21.15.49:0/1564718534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc954098d10 0x7fc93c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:21.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.075+0000 7fc9527fc700 1 -- 172.21.15.49:0/1564718534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc954154bc0 con 0x7fc93c004690 2023-11-30T17:22:21.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.075+0000 7fc9527fc700 1 -- 172.21.15.49:0/1564718534 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9540c66c0 con 0x7fc93c0038e0 2023-11-30T17:22:21.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.075+0000 7fc9527fc700 1 -- 172.21.15.49:0/1564718534 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c00b8e0 con 0x7fc954098d10 2023-11-30T17:22:21.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.075+0000 7fc952ffd700 1 --2- 172.21.15.49:0/1564718534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc93c004690 0x7fc93c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:21.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.075+0000 7fc9537fe700 1 --2- 172.21.15.49:0/1564718534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc93c0038e0 0x7fc93c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:21.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.075+0000 7fc953fff700 1 --2- 172.21.15.49:0/1564718534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc954098d10 0x7fc93c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:21.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.075+0000 7fc952ffd700 1 -- 172.21.15.49:0/1564718534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc954098d10 msgr2=0x7fc93c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:21.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.075+0000 7fc952ffd700 1 --2- 172.21.15.49:0/1564718534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc954098d10 0x7fc93c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:21.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.075+0000 7fc952ffd700 1 -- 172.21.15.49:0/1564718534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc93c0038e0 msgr2=0x7fc93c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:21.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.075+0000 7fc952ffd700 1 --2- 172.21.15.49:0/1564718534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc93c0038e0 0x7fc93c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:21.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.075+0000 7fc952ffd700 1 -- 172.21.15.49:0/1564718534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93c0033f0 con 0x7fc93c004690 2023-11-30T17:22:21.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.075+0000 7fc952ffd700 1 --2- 172.21.15.49:0/1564718534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc93c004690 0x7fc93c004b10 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7fc954084960 tx=0x7fc948009060).ready entity=mon.0 client_cookie=ffe3c8bd0794d7e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:21.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.075+0000 7fc9527fc700 1 -- 172.21.15.49:0/1564718534 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc948009e90 con 0x7fc93c004690 2023-11-30T17:22:21.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.075+0000 7fc9527fc700 1 -- 172.21.15.49:0/1564718534 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc948009430 con 0x7fc93c004690 2023-11-30T17:22:21.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.075+0000 7fc9527fc700 1 -- 172.21.15.49:0/1564718534 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94800e850 con 0x7fc93c004690 2023-11-30T17:22:21.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.076+0000 7fc959fef700 1 -- 172.21.15.49:0/1564718534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc93c004690 msgr2=0x7fc93c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:21.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.076+0000 7fc959fef700 1 --2- 172.21.15.49:0/1564718534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc93c004690 0x7fc93c004b10 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7fc954084960 tx=0x7fc948009060).stop 2023-11-30T17:22:21.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.076+0000 7fc953fff700 1 -- 172.21.15.49:0/1564718534 reap_dead start 2023-11-30T17:22:21.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.076+0000 7fc959fef700 1 -- 172.21.15.49:0/1564718534 shutdown_connections 2023-11-30T17:22:21.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.076+0000 7fc959fef700 1 -- 172.21.15.49:0/1564718534 >> 172.21.15.49:0/1564718534 conn(0x7fc9540cb310 msgr2=0x7fc9540cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:21.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.076+0000 7fc959fef700 1 -- 172.21.15.49:0/1564718534 shutdown_connections 2023-11-30T17:22:21.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.076+0000 7fc959fef700 1 -- 172.21.15.49:0/1564718534 wait complete. 2023-11-30T17:22:21.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.077+0000 7fc959fef700 1 Processor -- start 2023-11-30T17:22:21.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.077+0000 7fc959fef700 1 -- start start 2023-11-30T17:22:21.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.078+0000 7fc959fef700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc93c004690 0x7fc9540c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:21.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.078+0000 7fc959fef700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9540ad2a0 0x7fc9540aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:21.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.078+0000 7fc959fef700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9540af4d0 0x7fc9540c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:21.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.078+0000 7fc959fef700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9540c7f40 con 0x7fc9540ad2a0 2023-11-30T17:22:21.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.078+0000 7fc959fef700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9540c3d90 con 0x7fc9540af4d0 2023-11-30T17:22:21.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.078+0000 7fc959fef700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc954150d50 con 0x7fc93c004690 2023-11-30T17:22:21.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.078+0000 7fc952ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9540ad2a0 0x7fc9540aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:21.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.078+0000 7fc952ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9540ad2a0 0x7fc9540aefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53646/0 (socket says 172.21.15.49:53646) 2023-11-30T17:22:21.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.078+0000 7fc952ffd700 1 -- 172.21.15.49:0/535976375 learned_addr learned my addr 172.21.15.49:0/535976375 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:21.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.078+0000 7fc9537fe700 1 --2- 172.21.15.49:0/535976375 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc93c004690 0x7fc9540c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:21.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.078+0000 7fc953fff700 1 --2- 172.21.15.49:0/535976375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9540af4d0 0x7fc9540c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:21.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.079+0000 7fc952ffd700 1 -- 172.21.15.49:0/535976375 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc93c004690 msgr2=0x7fc9540c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:21.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.079+0000 7fc952ffd700 1 --2- 172.21.15.49:0/535976375 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc93c004690 0x7fc9540c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:21.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.079+0000 7fc952ffd700 1 -- 172.21.15.49:0/535976375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9540af4d0 msgr2=0x7fc9540c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:21.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.079+0000 7fc952ffd700 1 --2- 172.21.15.49:0/535976375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9540af4d0 0x7fc9540c9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:21.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.079+0000 7fc952ffd700 1 -- 172.21.15.49:0/535976375 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9540c4cd0 con 0x7fc9540ad2a0 2023-11-30T17:22:21.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.079+0000 7fc952ffd700 1 --2- 172.21.15.49:0/535976375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9540ad2a0 0x7fc9540aefe0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7fc93c004480 tx=0x7fc94801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:21.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.079+0000 7fc93b7fe700 1 -- 172.21.15.49:0/535976375 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94801d950 con 0x7fc9540ad2a0 2023-11-30T17:22:21.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.079+0000 7fc93b7fe700 1 -- 172.21.15.49:0/535976375 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94801dab0 con 0x7fc9540ad2a0 2023-11-30T17:22:21.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.079+0000 7fc93b7fe700 1 -- 172.21.15.49:0/535976375 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94801de70 con 0x7fc9540ad2a0 2023-11-30T17:22:21.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.079+0000 7fc959fef700 1 -- 172.21.15.49:0/535976375 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9540c8190 con 0x7fc9540ad2a0 2023-11-30T17:22:21.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.079+0000 7fc959fef700 1 -- 172.21.15.49:0/535976375 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9540c3fe0 con 0x7fc9540ad2a0 2023-11-30T17:22:21.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.080+0000 7fc959fef700 1 -- 172.21.15.49:0/535976375 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9540c8630 con 0x7fc9540ad2a0 2023-11-30T17:22:21.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.080+0000 7fc93b7fe700 1 -- 172.21.15.49:0/535976375 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc94802f440 con 0x7fc9540ad2a0 2023-11-30T17:22:21.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.081+0000 7fc93b7fe700 1 --2- 172.21.15.49:0/535976375 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc94005f270 0x7fc940061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:21.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.081+0000 7fc93b7fe700 1 -- 172.21.15.49:0/535976375 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fc94807c920 con 0x7fc9540ad2a0 2023-11-30T17:22:21.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.081+0000 7fc9537fe700 1 --2- 172.21.15.49:0/535976375 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc94005f270 0x7fc940061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:21.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.081+0000 7fc9537fe700 1 --2- 172.21.15.49:0/535976375 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc94005f270 0x7fc940061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fc944006d80 tx=0x7fc944009060).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:21.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.085+0000 7fc93b7fe700 1 -- 172.21.15.49:0/535976375 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc9540c8630 con 0x7fc9540ad2a0 2023-11-30T17:22:21.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.303+0000 7fc959fef700 1 -- 172.21.15.49:0/535976375 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc9540c8630 con 0x7fc9540ad2a0 2023-11-30T17:22:21.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.316+0000 7fc93b7fe700 1 -- 172.21.15.49:0/535976375 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v28) v1 ==== 173+0+0 (secure 0 0 0) 0x7fc9540c8630 con 0x7fc9540ad2a0 2023-11-30T17:22:21.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.326+0000 7fc959fef700 1 -- 172.21.15.49:0/535976375 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc94005f270 msgr2=0x7fc940061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:21.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.326+0000 7fc959fef700 1 --2- 172.21.15.49:0/535976375 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc94005f270 0x7fc940061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fc944006d80 tx=0x7fc944009060).stop 2023-11-30T17:22:21.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.326+0000 7fc959fef700 1 -- 172.21.15.49:0/535976375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9540ad2a0 msgr2=0x7fc9540aefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:21.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.326+0000 7fc959fef700 1 --2- 172.21.15.49:0/535976375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9540ad2a0 0x7fc9540aefe0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7fc93c004480 tx=0x7fc94801a000).stop 2023-11-30T17:22:21.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.332+0000 7fc959fef700 1 -- 172.21.15.49:0/535976375 shutdown_connections 2023-11-30T17:22:21.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.332+0000 7fc959fef700 1 --2- 172.21.15.49:0/535976375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9540af4d0 0x7fc9540c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:21.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.332+0000 7fc959fef700 1 --2- 172.21.15.49:0/535976375 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc93c004690 0x7fc9540c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:21.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.332+0000 7fc959fef700 1 --2- 172.21.15.49:0/535976375 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc94005f270 0x7fc940061730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:21.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.332+0000 7fc959fef700 1 --2- 172.21.15.49:0/535976375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9540ad2a0 0x7fc9540aefe0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:21.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.332+0000 7fc959fef700 1 -- 172.21.15.49:0/535976375 >> 172.21.15.49:0/535976375 conn(0x7fc9540cb310 msgr2=0x7fc954152220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:21.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.333+0000 7fc959fef700 1 -- 172.21.15.49:0/535976375 shutdown_connections 2023-11-30T17:22:21.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.333+0000 7fc959fef700 1 -- 172.21.15.49:0/535976375 wait complete. 2023-11-30T17:22:21.339 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:22:21.340 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 9 and data pool 10 2023-11-30T17:22:21.342 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:22:21.352 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:22:21.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.507+0000 7f0ef9585700 1 Processor -- start 2023-11-30T17:22:21.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.507+0000 7f0ef9585700 1 -- start start 2023-11-30T17:22:21.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.508+0000 7f0ef9585700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ef4096590 0x7f0ef4067040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:21.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.508+0000 7f0ef9585700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0ef4067530 0x7f0ef40be7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:21.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.508+0000 7f0ef9585700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef41589e0 con 0x7f0ef4157790 2023-11-30T17:22:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.508+0000 7f0ef9585700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef40c5720 con 0x7f0ef4067530 2023-11-30T17:22:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.508+0000 7f0ef9585700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef4158e70 con 0x7f0ef4096590 2023-11-30T17:22:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.508+0000 7f0ef37fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0ef4067530 0x7f0ef40be7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.508+0000 7f0ef37fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0ef4067530 0x7f0ef40be7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53658/0 (socket says 172.21.15.49:53658) 2023-11-30T17:22:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.508+0000 7f0ef37fe700 1 -- 172.21.15.49:0/3020167596 learned_addr learned my addr 172.21.15.49:0/3020167596 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.508+0000 7f0ef27fc700 1 --2- 172.21.15.49:0/3020167596 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ef4096590 0x7f0ef4067040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.508+0000 7f0ef37fe700 1 -- 172.21.15.49:0/3020167596 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ef4096590 msgr2=0x7f0ef4067040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:21.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.508+0000 7f0ef37fe700 1 --2- 172.21.15.49:0/3020167596 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ef4096590 0x7f0ef4067040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:21.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.508+0000 7f0ef37fe700 1 -- 172.21.15.49:0/3020167596 >> v1:172.21.15.115:6789/0 conn(0x7f0ef4157790 legacy=0x7f0ef4095e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:21.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.508+0000 7f0ef1ffb700 1 -- 172.21.15.49:0/3020167596 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1608620895 0 0) 0x7f0ef41589e0 con 0x7f0ef4157790 2023-11-30T17:22:21.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.508+0000 7f0ef37fe700 1 -- 172.21.15.49:0/3020167596 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef41580b0 con 0x7f0ef4067530 2023-11-30T17:22:21.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.509+0000 7f0ef37fe700 1 --2- 172.21.15.49:0/3020167596 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ef4067530 0x7f0ef40be7b0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f0ee4009f20 tx=0x7f0ee4009840).ready entity=mon.0 client_cookie=43b3a280fe164855 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:21.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.509+0000 7f0ef1ffb700 1 -- 172.21.15.49:0/3020167596 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee400e070 con 0x7f0ef4067530 2023-11-30T17:22:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.509+0000 7f0ef1ffb700 1 -- 172.21.15.49:0/3020167596 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee400b9d0 con 0x7f0ef4067530 2023-11-30T17:22:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.509+0000 7f0ef1ffb700 1 -- 172.21.15.49:0/3020167596 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee400bd50 con 0x7f0ef4067530 2023-11-30T17:22:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.509+0000 7f0ef9585700 1 -- 172.21.15.49:0/3020167596 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ef4067530 msgr2=0x7f0ef40be7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.509+0000 7f0ef9585700 1 --2- 172.21.15.49:0/3020167596 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ef4067530 0x7f0ef40be7b0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f0ee4009f20 tx=0x7f0ee4009840).stop 2023-11-30T17:22:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.509+0000 7f0ef9585700 1 -- 172.21.15.49:0/3020167596 shutdown_connections 2023-11-30T17:22:21.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.509+0000 7f0ef9585700 1 --2- 172.21.15.49:0/3020167596 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ef4067530 0x7f0ef40be7b0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:21.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.509+0000 7f0ef9585700 1 --2- 172.21.15.49:0/3020167596 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ef4096590 0x7f0ef4067040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:21.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.509+0000 7f0ef9585700 1 -- 172.21.15.49:0/3020167596 >> 172.21.15.49:0/3020167596 conn(0x7f0ef4062700 msgr2=0x7f0ef4062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:21.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.509+0000 7f0ef9585700 1 -- 172.21.15.49:0/3020167596 shutdown_connections 2023-11-30T17:22:21.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.509+0000 7f0ef9585700 1 -- 172.21.15.49:0/3020167596 wait complete. 2023-11-30T17:22:21.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.511+0000 7f0ef9585700 1 Processor -- start 2023-11-30T17:22:21.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.511+0000 7f0ef9585700 1 -- start start 2023-11-30T17:22:21.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.511+0000 7f0ef9585700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ef4067530 0x7f0ef41569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:21.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.511+0000 7f0ef9585700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ef4096590 0x7f0ef4164390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:21.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.511+0000 7f0ef9585700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ef4157790 0x7f0ef4152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:21.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.511+0000 7f0ef9585700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef40aaa80 con 0x7f0ef4157790 2023-11-30T17:22:21.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.511+0000 7f0ef9585700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef40ad7f0 con 0x7f0ef4067530 2023-11-30T17:22:21.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.511+0000 7f0ef9585700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef40a9ed0 con 0x7f0ef4096590 2023-11-30T17:22:21.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.512+0000 7f0ef37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ef4157790 0x7f0ef4152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:21.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.512+0000 7f0ef37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ef4157790 0x7f0ef4152110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53672/0 (socket says 172.21.15.49:53672) 2023-11-30T17:22:21.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.512+0000 7f0ef37fe700 1 -- 172.21.15.49:0/267359809 learned_addr learned my addr 172.21.15.49:0/267359809 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:21.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.512+0000 7f0ef2ffd700 1 --2- 172.21.15.49:0/267359809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ef4067530 0x7f0ef41569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:21.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.512+0000 7f0ef27fc700 1 --2- 172.21.15.49:0/267359809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ef4096590 0x7f0ef4164390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:21.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.512+0000 7f0ef37fe700 1 -- 172.21.15.49:0/267359809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ef4096590 msgr2=0x7f0ef4164390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:21.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.512+0000 7f0ef37fe700 1 --2- 172.21.15.49:0/267359809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ef4096590 0x7f0ef4164390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:21.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.512+0000 7f0ef37fe700 1 -- 172.21.15.49:0/267359809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ef4067530 msgr2=0x7f0ef41569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:21.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.512+0000 7f0ef37fe700 1 --2- 172.21.15.49:0/267359809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ef4067530 0x7f0ef41569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:21.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.512+0000 7f0ef37fe700 1 -- 172.21.15.49:0/267359809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee4009ae0 con 0x7f0ef4157790 2023-11-30T17:22:21.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.512+0000 7f0ef37fe700 1 --2- 172.21.15.49:0/267359809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ef4157790 0x7f0ef4152110 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f0ef4096eb0 tx=0x7f0ee4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:21.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.512+0000 7f0eeaffd700 1 -- 172.21.15.49:0/267359809 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee400b640 con 0x7f0ef4157790 2023-11-30T17:22:21.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.512+0000 7f0eeaffd700 1 -- 172.21.15.49:0/267359809 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee40092e0 con 0x7f0ef4157790 2023-11-30T17:22:21.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.512+0000 7f0ef9585700 1 -- 172.21.15.49:0/267359809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef4156ea0 con 0x7f0ef4157790 2023-11-30T17:22:21.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.512+0000 7f0eeaffd700 1 -- 172.21.15.49:0/267359809 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee401e6a0 con 0x7f0ef4157790 2023-11-30T17:22:21.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.512+0000 7f0ef9585700 1 -- 172.21.15.49:0/267359809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef40aa3c0 con 0x7f0ef4157790 2023-11-30T17:22:21.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.513+0000 7f0ef9585700 1 -- 172.21.15.49:0/267359809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef40aabc0 con 0x7f0ef4157790 2023-11-30T17:22:21.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.514+0000 7f0eeaffd700 1 -- 172.21.15.49:0/267359809 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0ee4003040 con 0x7f0ef4157790 2023-11-30T17:22:21.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.514+0000 7f0eeaffd700 1 --2- 172.21.15.49:0/267359809 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0ed405f270 0x7f0ed4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:21.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.514+0000 7f0eeaffd700 1 -- 172.21.15.49:0/267359809 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f0ee407b970 con 0x7f0ef4157790 2023-11-30T17:22:21.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.514+0000 7f0ef2ffd700 1 --2- 172.21.15.49:0/267359809 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0ed405f270 0x7f0ed4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:21.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.515+0000 7f0ef2ffd700 1 --2- 172.21.15.49:0/267359809 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0ed405f270 0x7f0ed4061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f0eec0038c0 tx=0x7f0eec007d40).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:21.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.518+0000 7f0eeaffd700 1 -- 172.21.15.49:0/267359809 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0ef40aabc0 con 0x7f0ef4157790 2023-11-30T17:22:21.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.689+0000 7f0ef9585700 1 -- 172.21.15.49:0/267359809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ef40aabc0 con 0x7f0ef4157790 2023-11-30T17:22:21.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.690+0000 7f0eeaffd700 1 -- 172.21.15.49:0/267359809 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+16986 (secure 0 0 0) 0x7f0ef40aabc0 con 0x7f0ef4157790 2023-11-30T17:22:21.693 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:21.693 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":82,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:22:21.305368+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:22:19.274919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-30T17:22:20.286346+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:22:21.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.692+0000 7f0ef9585700 1 -- 172.21.15.49:0/267359809 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0ed405f270 msgr2=0x7f0ed4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:21.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.692+0000 7f0ef9585700 1 --2- 172.21.15.49:0/267359809 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0ed405f270 0x7f0ed4061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f0eec0038c0 tx=0x7f0eec007d40).stop 2023-11-30T17:22:21.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.692+0000 7f0ef9585700 1 -- 172.21.15.49:0/267359809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ef4157790 msgr2=0x7f0ef4152110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:21.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.692+0000 7f0ef9585700 1 --2- 172.21.15.49:0/267359809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ef4157790 0x7f0ef4152110 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f0ef4096eb0 tx=0x7f0ee4009840).stop 2023-11-30T17:22:21.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.692+0000 7f0ef9585700 1 -- 172.21.15.49:0/267359809 shutdown_connections 2023-11-30T17:22:21.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.692+0000 7f0ef9585700 1 --2- 172.21.15.49:0/267359809 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0ed405f270 0x7f0ed4061730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:21.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.692+0000 7f0ef9585700 1 --2- 172.21.15.49:0/267359809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ef4157790 0x7f0ef4152110 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:21.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.692+0000 7f0ef9585700 1 --2- 172.21.15.49:0/267359809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ef4067530 0x7f0ef41569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:21.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.692+0000 7f0ef9585700 1 --2- 172.21.15.49:0/267359809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ef4096590 0x7f0ef4164390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:21.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.692+0000 7f0ef9585700 1 -- 172.21.15.49:0/267359809 >> 172.21.15.49:0/267359809 conn(0x7f0ef4062700 msgr2=0x7f0ef4064580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:21.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.692+0000 7f0ef9585700 1 -- 172.21.15.49:0/267359809 shutdown_connections 2023-11-30T17:22:21.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.692+0000 7f0ef9585700 1 -- 172.21.15.49:0/267359809 wait complete. 2023-11-30T17:22:21.707 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:22:21.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.822+0000 7f5d116b9700 1 Processor -- start 2023-11-30T17:22:21.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.822+0000 7f5d116b9700 1 -- start start 2023-11-30T17:22:21.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.823+0000 7f5d116b9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d0c0cae90 0x7f5d0c0c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:21.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.823+0000 7f5d116b9700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5d0c0ca180 0x7f5d0c0c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:21.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.823+0000 7f5d116b9700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d0c0a9a90 con 0x7f5d0c0caab0 2023-11-30T17:22:21.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.823+0000 7f5d116b9700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d0c0c1490 con 0x7f5d0c0ca180 2023-11-30T17:22:21.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.823+0000 7f5d116b9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c154ce0 con 0x7f5d0c0cae90 2023-11-30T17:22:21.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.823+0000 7f5d0b7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5d0c0ca180 0x7f5d0c0c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:21.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.823+0000 7f5d0affd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5d0c0caab0 0x7f5d0c0aa470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34034/0 (socket says 172.21.15.49:34034) 2023-11-30T17:22:21.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.823+0000 7f5d0affd700 1 -- 172.21.15.49:0/2353696270 learned_addr learned my addr 172.21.15.49:0/2353696270 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:21.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.824+0000 7f5d09ffb700 1 -- 172.21.15.49:0/2353696270 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 691569882 0 0) 0x7f5d0c0a9a90 con 0x7f5d0c0caab0 2023-11-30T17:22:21.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.824+0000 7f5d0a7fc700 1 --2- 172.21.15.49:0/2353696270 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d0c0cae90 0x7f5d0c0c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:21.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.824+0000 7f5d09ffb700 1 -- 172.21.15.49:0/2353696270 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cf80033f0 con 0x7f5d0c0caab0 2023-11-30T17:22:21.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.824+0000 7f5d0b7fe700 1 -- 172.21.15.49:0/2353696270 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d0c0cae90 msgr2=0x7f5d0c0c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:21.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.824+0000 7f5d0b7fe700 1 --2- 172.21.15.49:0/2353696270 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d0c0cae90 0x7f5d0c0c0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:21.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.824+0000 7f5d0b7fe700 1 -- 172.21.15.49:0/2353696270 >> v1:172.21.15.49:6789/0 conn(0x7f5d0c0caab0 legacy=0x7f5d0c0aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:21.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.824+0000 7f5d0b7fe700 1 -- 172.21.15.49:0/2353696270 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d0c0aab80 con 0x7f5d0c0ca180 2023-11-30T17:22:21.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.824+0000 7f5d0b7fe700 1 --2- 172.21.15.49:0/2353696270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d0c0ca180 0x7f5d0c0c0fa0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f5cfc009760 tx=0x7f5cfc009060).ready entity=mon.0 client_cookie=e5c6a6de92d3d5a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:21.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.824+0000 7f5d09ffb700 1 -- 172.21.15.49:0/2353696270 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc00f510 con 0x7f5d0c0ca180 2023-11-30T17:22:21.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.824+0000 7f5d09ffb700 1 -- 172.21.15.49:0/2353696270 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cfc00f670 con 0x7f5d0c0ca180 2023-11-30T17:22:21.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.824+0000 7f5d09ffb700 1 -- 172.21.15.49:0/2353696270 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc00f9f0 con 0x7f5d0c0ca180 2023-11-30T17:22:21.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.824+0000 7f5d116b9700 1 -- 172.21.15.49:0/2353696270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d0c0ca180 msgr2=0x7f5d0c0c0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:21.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.824+0000 7f5d116b9700 1 --2- 172.21.15.49:0/2353696270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d0c0ca180 0x7f5d0c0c0fa0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f5cfc009760 tx=0x7f5cfc009060).stop 2023-11-30T17:22:21.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.824+0000 7f5d116b9700 1 -- 172.21.15.49:0/2353696270 shutdown_connections 2023-11-30T17:22:21.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.824+0000 7f5d116b9700 1 --2- 172.21.15.49:0/2353696270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d0c0ca180 0x7f5d0c0c0fa0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:21.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.824+0000 7f5d116b9700 1 --2- 172.21.15.49:0/2353696270 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d0c0cae90 0x7f5d0c0c0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:21.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.824+0000 7f5d116b9700 1 -- 172.21.15.49:0/2353696270 >> 172.21.15.49:0/2353696270 conn(0x7f5d0c094920 msgr2=0x7f5d0c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:21.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.825+0000 7f5d116b9700 1 -- 172.21.15.49:0/2353696270 shutdown_connections 2023-11-30T17:22:21.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.825+0000 7f5d116b9700 1 -- 172.21.15.49:0/2353696270 wait complete. 2023-11-30T17:22:21.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.826+0000 7f5d116b9700 1 Processor -- start 2023-11-30T17:22:21.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.826+0000 7f5d116b9700 1 -- start start 2023-11-30T17:22:21.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.827+0000 7f5d116b9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d0c0ca180 0x7f5d0c0c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:21.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.827+0000 7f5d116b9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d0c0caab0 0x7f5d0c0aad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:21.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.827+0000 7f5d116b9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d0c0cae90 0x7f5d0c14d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:21.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.827+0000 7f5d116b9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c0ac190 con 0x7f5d0c0caab0 2023-11-30T17:22:21.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.827+0000 7f5d116b9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c0ab580 con 0x7f5d0c0ca180 2023-11-30T17:22:21.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.827+0000 7f5d116b9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c0ab860 con 0x7f5d0c0cae90 2023-11-30T17:22:21.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.827+0000 7f5d0a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d0c0caab0 0x7f5d0c0aad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:21.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.827+0000 7f5d0a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d0c0caab0 0x7f5d0c0aad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53692/0 (socket says 172.21.15.49:53692) 2023-11-30T17:22:21.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.827+0000 7f5d0a7fc700 1 -- 172.21.15.49:0/4099473242 learned_addr learned my addr 172.21.15.49:0/4099473242 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:21.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.827+0000 7f5d0b7fe700 1 --2- 172.21.15.49:0/4099473242 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d0c0cae90 0x7f5d0c14d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:21.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.827+0000 7f5d0affd700 1 --2- 172.21.15.49:0/4099473242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d0c0ca180 0x7f5d0c0c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:21.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.827+0000 7f5d0a7fc700 1 -- 172.21.15.49:0/4099473242 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d0c0cae90 msgr2=0x7f5d0c14d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:21.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.827+0000 7f5d0a7fc700 1 --2- 172.21.15.49:0/4099473242 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d0c0cae90 0x7f5d0c14d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:21.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.827+0000 7f5d0a7fc700 1 -- 172.21.15.49:0/4099473242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d0c0ca180 msgr2=0x7f5d0c0c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:21.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.827+0000 7f5d0a7fc700 1 --2- 172.21.15.49:0/4099473242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d0c0ca180 0x7f5d0c0c72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:21.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.827+0000 7f5d0a7fc700 1 -- 172.21.15.49:0/4099473242 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cfc0092a0 con 0x7f5d0c0caab0 2023-11-30T17:22:21.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.827+0000 7f5d0affd700 1 --2- 172.21.15.49:0/4099473242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d0c0ca180 0x7f5d0c0c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:21.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.827+0000 7f5d0a7fc700 1 --2- 172.21.15.49:0/4099473242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d0c0caab0 0x7f5d0c0aad10 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f5cf400c650 tx=0x7f5cf4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:21.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.827+0000 7f5d02ffd700 1 -- 172.21.15.49:0/4099473242 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4010580 con 0x7f5d0c0caab0 2023-11-30T17:22:21.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.827+0000 7f5d02ffd700 1 -- 172.21.15.49:0/4099473242 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf40106e0 con 0x7f5d0c0caab0 2023-11-30T17:22:21.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.827+0000 7f5d02ffd700 1 -- 172.21.15.49:0/4099473242 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4010a60 con 0x7f5d0c0caab0 2023-11-30T17:22:21.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.827+0000 7f5d116b9700 1 -- 172.21.15.49:0/4099473242 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d0c0abb40 con 0x7f5d0c0caab0 2023-11-30T17:22:21.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.827+0000 7f5d116b9700 1 -- 172.21.15.49:0/4099473242 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d0c0ab200 con 0x7f5d0c0caab0 2023-11-30T17:22:21.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.828+0000 7f5d116b9700 1 -- 172.21.15.49:0/4099473242 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d0c0ac300 con 0x7f5d0c0caab0 2023-11-30T17:22:21.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.829+0000 7f5d02ffd700 1 -- 172.21.15.49:0/4099473242 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f5cf401b460 con 0x7f5d0c0caab0 2023-11-30T17:22:21.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.829+0000 7f5d02ffd700 1 --2- 172.21.15.49:0/4099473242 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5cec05f270 0x7f5cec061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:21.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.829+0000 7f5d02ffd700 1 -- 172.21.15.49:0/4099473242 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f5cf407a240 con 0x7f5d0c0caab0 2023-11-30T17:22:21.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.829+0000 7f5d0affd700 1 --2- 172.21.15.49:0/4099473242 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5cec05f270 0x7f5cec061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:21.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.830+0000 7f5d0affd700 1 --2- 172.21.15.49:0/4099473242 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5cec05f270 0x7f5cec061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f5d040016e0 tx=0x7f5d04009040).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:21.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:21.833+0000 7f5d02ffd700 1 -- 172.21.15.49:0/4099473242 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5cf404b310 con 0x7f5d0c0caab0 2023-11-30T17:22:22.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.006+0000 7f5d116b9700 1 -- 172.21.15.49:0/4099473242 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d0c06c860 con 0x7f5d0c0caab0 2023-11-30T17:22:22.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.007+0000 7f5d02ffd700 1 -- 172.21.15.49:0/4099473242 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+16986 (secure 0 0 0) 0x7f5cf404e930 con 0x7f5d0c0caab0 2023-11-30T17:22:22.010 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:22.010 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":82,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:22:21.305368+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:22:19.274919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-30T17:22:20.286346+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:22:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.009+0000 7f5d116b9700 1 -- 172.21.15.49:0/4099473242 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5cec05f270 msgr2=0x7f5cec061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.009+0000 7f5d116b9700 1 --2- 172.21.15.49:0/4099473242 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5cec05f270 0x7f5cec061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f5d040016e0 tx=0x7f5d04009040).stop 2023-11-30T17:22:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.009+0000 7f5d116b9700 1 -- 172.21.15.49:0/4099473242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d0c0caab0 msgr2=0x7f5d0c0aad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.009+0000 7f5d116b9700 1 --2- 172.21.15.49:0/4099473242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d0c0caab0 0x7f5d0c0aad10 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f5cf400c650 tx=0x7f5cf4008040).stop 2023-11-30T17:22:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.009+0000 7f5d116b9700 1 -- 172.21.15.49:0/4099473242 shutdown_connections 2023-11-30T17:22:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.009+0000 7f5d116b9700 1 --2- 172.21.15.49:0/4099473242 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d0c0cae90 0x7f5d0c14d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.009+0000 7f5d116b9700 1 --2- 172.21.15.49:0/4099473242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d0c0ca180 0x7f5d0c0c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.009+0000 7f5d116b9700 1 --2- 172.21.15.49:0/4099473242 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5cec05f270 0x7f5cec061730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.009+0000 7f5d116b9700 1 --2- 172.21.15.49:0/4099473242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d0c0caab0 0x7f5d0c0aad10 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:22.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.009+0000 7f5d116b9700 1 -- 172.21.15.49:0/4099473242 >> 172.21.15.49:0/4099473242 conn(0x7f5d0c094920 msgr2=0x7f5d0c0a7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:22.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.009+0000 7f5d116b9700 1 -- 172.21.15.49:0/4099473242 shutdown_connections 2023-11-30T17:22:22.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.009+0000 7f5d116b9700 1 -- 172.21.15.49:0/4099473242 wait complete. 2023-11-30T17:22:22.024 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-30T17:22:22.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.142+0000 7fe9e8737700 1 Processor -- start 2023-11-30T17:22:22.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.142+0000 7fe9e8737700 1 -- start start 2023-11-30T17:22:22.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.143+0000 7fe9e8737700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9e0154900 0x7fe9e00a8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:22.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.143+0000 7fe9e8737700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e00bf600 con 0x7fe9e0154520 2023-11-30T17:22:22.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.143+0000 7fe9e8737700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e00a8930 con 0x7fe9e0066a70 2023-11-30T17:22:22.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.143+0000 7fe9e8737700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e00ca060 con 0x7fe9e0154900 2023-11-30T17:22:22.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.143+0000 7fe9e64d3700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe9e0154520 0x7fe9e00bfa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34046/0 (socket says 172.21.15.49:34046) 2023-11-30T17:22:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.143+0000 7fe9e64d3700 1 -- 172.21.15.49:0/2019107472 learned_addr learned my addr 172.21.15.49:0/2019107472 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.143+0000 7fe9e5cd2700 1 --2- 172.21.15.49:0/2019107472 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9e0154900 0x7fe9e00a8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.144+0000 7fe9e54d1700 1 -- 172.21.15.49:0/2019107472 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1337270807 0 0) 0x7fe9e00bf600 con 0x7fe9e0154520 2023-11-30T17:22:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.144+0000 7fe9e54d1700 1 -- 172.21.15.49:0/2019107472 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9c80033f0 con 0x7fe9e0154520 2023-11-30T17:22:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.144+0000 7fe9e54d1700 1 -- 172.21.15.49:0/2019107472 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 571251888 0 0) 0x7fe9e00a8930 con 0x7fe9e0066a70 2023-11-30T17:22:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.144+0000 7fe9e54d1700 1 -- 172.21.15.49:0/2019107472 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9e00bf600 con 0x7fe9e0066a70 2023-11-30T17:22:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.144+0000 7fe9e54d1700 1 -- 172.21.15.49:0/2019107472 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2059380105 0 0) 0x7fe9c80033f0 con 0x7fe9e0154520 2023-11-30T17:22:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.144+0000 7fe9e54d1700 1 -- 172.21.15.49:0/2019107472 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9e0154900 msgr2=0x7fe9e00a8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.144+0000 7fe9e54d1700 1 --2- 172.21.15.49:0/2019107472 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9e0154900 0x7fe9e00a8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.144+0000 7fe9e54d1700 1 -- 172.21.15.49:0/2019107472 >> v1:172.21.15.115:6789/0 conn(0x7fe9e0066a70 legacy=0x7fe9e0095e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.144+0000 7fe9e54d1700 1 -- 172.21.15.49:0/2019107472 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e00befb0 con 0x7fe9e0154520 2023-11-30T17:22:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.144+0000 7fe9e54d1700 1 -- 172.21.15.49:0/2019107472 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fe9d8001470 con 0x7fe9e0154520 2023-11-30T17:22:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.144+0000 7fe9e54d1700 1 -- 172.21.15.49:0/2019107472 >> v1:172.21.15.49:6789/0 conn(0x7fe9e0154520 legacy=0x7fe9e00bfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.144+0000 7fe9e54d1700 1 --2- 172.21.15.49:0/2019107472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9c8003aa0 0x7fe9c8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.144+0000 7fe9e54d1700 1 --2- 172.21.15.49:0/2019107472 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9c8004690 0x7fe9c8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:22.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.144+0000 7fe9e54d1700 1 --2- 172.21.15.49:0/2019107472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9c8005000 0x7fe9c800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:22.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.144+0000 7fe9e54d1700 1 -- 172.21.15.49:0/2019107472 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e00ca060 con 0x7fe9c8003aa0 2023-11-30T17:22:22.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.144+0000 7fe9e54d1700 1 -- 172.21.15.49:0/2019107472 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c800bf00 con 0x7fe9c8005000 2023-11-30T17:22:22.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.144+0000 7fe9e54d1700 1 -- 172.21.15.49:0/2019107472 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c800c0c0 con 0x7fe9c8004690 2023-11-30T17:22:22.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.144+0000 7fe9e5cd2700 1 --2- 172.21.15.49:0/2019107472 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9e0154900 0x7fe9e00a8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:22:22.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.144+0000 7fe9e64d3700 1 --2- 172.21.15.49:0/2019107472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9c8003aa0 0x7fe9c8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:22.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.144+0000 7fe9e6cd4700 1 --2- 172.21.15.49:0/2019107472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9c8005000 0x7fe9c800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:22.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.144+0000 7fe9e5cd2700 1 --2- 172.21.15.49:0/2019107472 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9c8004690 0x7fe9c8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:22.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.144+0000 7fe9e64d3700 1 -- 172.21.15.49:0/2019107472 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9c8004690 msgr2=0x7fe9c8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:22.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.144+0000 7fe9e64d3700 1 --2- 172.21.15.49:0/2019107472 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9c8004690 0x7fe9c8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:22.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.144+0000 7fe9e64d3700 1 -- 172.21.15.49:0/2019107472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9c8005000 msgr2=0x7fe9c800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:22.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.144+0000 7fe9e64d3700 1 --2- 172.21.15.49:0/2019107472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9c8005000 0x7fe9c800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:22.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.144+0000 7fe9e64d3700 1 -- 172.21.15.49:0/2019107472 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c80033f0 con 0x7fe9c8003aa0 2023-11-30T17:22:22.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.145+0000 7fe9e64d3700 1 --2- 172.21.15.49:0/2019107472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9c8003aa0 0x7fe9c8003ea0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7fe9d800c110 tx=0x7fe9d8001e10).ready entity=mon.0 client_cookie=2b6a70d1848080e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:22.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.145+0000 7fe9e54d1700 1 -- 172.21.15.49:0/2019107472 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d800ca40 con 0x7fe9c8003aa0 2023-11-30T17:22:22.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.145+0000 7fe9e54d1700 1 -- 172.21.15.49:0/2019107472 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d800cba0 con 0x7fe9c8003aa0 2023-11-30T17:22:22.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.145+0000 7fe9e54d1700 1 -- 172.21.15.49:0/2019107472 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d80070d0 con 0x7fe9c8003aa0 2023-11-30T17:22:22.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.145+0000 7fe9e8737700 1 -- 172.21.15.49:0/2019107472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9c8003aa0 msgr2=0x7fe9c8003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:22.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.145+0000 7fe9e8737700 1 --2- 172.21.15.49:0/2019107472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9c8003aa0 0x7fe9c8003ea0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7fe9d800c110 tx=0x7fe9d8001e10).stop 2023-11-30T17:22:22.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.145+0000 7fe9e6cd4700 1 -- 172.21.15.49:0/2019107472 reap_dead start 2023-11-30T17:22:22.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.145+0000 7fe9e8737700 1 -- 172.21.15.49:0/2019107472 shutdown_connections 2023-11-30T17:22:22.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.145+0000 7fe9e8737700 1 -- 172.21.15.49:0/2019107472 >> 172.21.15.49:0/2019107472 conn(0x7fe9e00631d0 msgr2=0x7fe9e00c9160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:22.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.145+0000 7fe9e8737700 1 -- 172.21.15.49:0/2019107472 shutdown_connections 2023-11-30T17:22:22.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.145+0000 7fe9e8737700 1 -- 172.21.15.49:0/2019107472 wait complete. 2023-11-30T17:22:22.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.146+0000 7fe9e8737700 1 Processor -- start 2023-11-30T17:22:22.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.146+0000 7fe9e8737700 1 -- start start 2023-11-30T17:22:22.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.147+0000 7fe9e8737700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9c8003aa0 0x7fe9e0150250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:22.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.147+0000 7fe9e8737700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9e00c7220 0x7fe9e00c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:22.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.147+0000 7fe9e8737700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9e00c5f20 0x7fe9e00c63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:22.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.147+0000 7fe9e8737700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e00adf40 con 0x7fe9e00c5f20 2023-11-30T17:22:22.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.147+0000 7fe9e8737700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e00adab0 con 0x7fe9c8003aa0 2023-11-30T17:22:22.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.147+0000 7fe9e8737700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e00c6890 con 0x7fe9e00c7220 2023-11-30T17:22:22.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.147+0000 7fe9e6cd4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9e00c5f20 0x7fe9e00c63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:22.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.147+0000 7fe9e6cd4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9e00c5f20 0x7fe9e00c63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53712/0 (socket says 172.21.15.49:53712) 2023-11-30T17:22:22.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.147+0000 7fe9e6cd4700 1 -- 172.21.15.49:0/1417646444 learned_addr learned my addr 172.21.15.49:0/1417646444 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:22.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.148+0000 7fe9e64d3700 1 --2- 172.21.15.49:0/1417646444 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9c8003aa0 0x7fe9e0150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:22.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.148+0000 7fe9e5cd2700 1 --2- 172.21.15.49:0/1417646444 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9e00c7220 0x7fe9e00c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:22.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.148+0000 7fe9e6cd4700 1 -- 172.21.15.49:0/1417646444 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9e00c7220 msgr2=0x7fe9e00c76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:22.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.148+0000 7fe9e6cd4700 1 --2- 172.21.15.49:0/1417646444 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9e00c7220 0x7fe9e00c76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:22.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.148+0000 7fe9e6cd4700 1 -- 172.21.15.49:0/1417646444 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9c8003aa0 msgr2=0x7fe9e0150250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:22.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.148+0000 7fe9e6cd4700 1 --2- 172.21.15.49:0/1417646444 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9c8003aa0 0x7fe9e0150250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:22.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.148+0000 7fe9e6cd4700 1 -- 172.21.15.49:0/1417646444 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e00acea0 con 0x7fe9e00c5f20 2023-11-30T17:22:22.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.148+0000 7fe9e64d3700 1 --2- 172.21.15.49:0/1417646444 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9c8003aa0 0x7fe9e0150250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:22.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.148+0000 7fe9e6cd4700 1 --2- 172.21.15.49:0/1417646444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9e00c5f20 0x7fe9e00c63a0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7fe9d000eb10 tx=0x7fe9d0007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:22.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.148+0000 7fe9de7fc700 1 -- 172.21.15.49:0/1417646444 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d00040d0 con 0x7fe9e00c5f20 2023-11-30T17:22:22.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.148+0000 7fe9de7fc700 1 -- 172.21.15.49:0/1417646444 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d0001910 con 0x7fe9e00c5f20 2023-11-30T17:22:22.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.148+0000 7fe9e8737700 1 -- 172.21.15.49:0/1417646444 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e00ad180 con 0x7fe9e00c5f20 2023-11-30T17:22:22.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.148+0000 7fe9de7fc700 1 -- 172.21.15.49:0/1417646444 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0001c90 con 0x7fe9e00c5f20 2023-11-30T17:22:22.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.148+0000 7fe9e8737700 1 -- 172.21.15.49:0/1417646444 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e00ad740 con 0x7fe9e00c5f20 2023-11-30T17:22:22.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.149+0000 7fe9e8737700 1 -- 172.21.15.49:0/1417646444 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e006c860 con 0x7fe9e00c5f20 2023-11-30T17:22:22.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.149+0000 7fe9de7fc700 1 -- 172.21.15.49:0/1417646444 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe9d000c970 con 0x7fe9e00c5f20 2023-11-30T17:22:22.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.150+0000 7fe9de7fc700 1 --2- 172.21.15.49:0/1417646444 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe9cc05f2a0 0x7fe9cc061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:22.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.150+0000 7fe9de7fc700 1 -- 172.21.15.49:0/1417646444 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fe9d0079960 con 0x7fe9e00c5f20 2023-11-30T17:22:22.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.150+0000 7fe9e64d3700 1 --2- 172.21.15.49:0/1417646444 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe9cc05f2a0 0x7fe9cc061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:22.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.151+0000 7fe9e64d3700 1 --2- 172.21.15.49:0/1417646444 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe9cc05f2a0 0x7fe9cc061760 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fe9d8007e10 tx=0x7fe9d8015000).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:22.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.154+0000 7fe9de7fc700 1 -- 172.21.15.49:0/1417646444 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe9d004aa90 con 0x7fe9e00c5f20 2023-11-30T17:22:22.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:22.373+0000 7fe9e8737700 1 -- 172.21.15.49:0/1417646444 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe9e00adbf0 con 0x7fe9e00c5f20 2023-11-30T17:22:23.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.320+0000 7fe9de7fc700 1 -- 172.21.15.49:0/1417646444 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe9d001a030 con 0x7fe9e00c5f20 2023-11-30T17:22:23.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.322+0000 7fe9e8737700 1 -- 172.21.15.49:0/1417646444 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe9cc05f2a0 msgr2=0x7fe9cc061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:23.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.322+0000 7fe9e8737700 1 --2- 172.21.15.49:0/1417646444 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe9cc05f2a0 0x7fe9cc061760 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fe9d8007e10 tx=0x7fe9d8015000).stop 2023-11-30T17:22:23.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.322+0000 7fe9e8737700 1 -- 172.21.15.49:0/1417646444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9e00c5f20 msgr2=0x7fe9e00c63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:23.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.322+0000 7fe9e8737700 1 --2- 172.21.15.49:0/1417646444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9e00c5f20 0x7fe9e00c63a0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7fe9d000eb10 tx=0x7fe9d0007f10).stop 2023-11-30T17:22:23.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.322+0000 7fe9e8737700 1 -- 172.21.15.49:0/1417646444 shutdown_connections 2023-11-30T17:22:23.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.322+0000 7fe9e8737700 1 --2- 172.21.15.49:0/1417646444 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe9cc05f2a0 0x7fe9cc061760 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:23.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.322+0000 7fe9e8737700 1 --2- 172.21.15.49:0/1417646444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9e00c5f20 0x7fe9e00c63a0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:23.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.322+0000 7fe9e8737700 1 --2- 172.21.15.49:0/1417646444 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9c8003aa0 0x7fe9e0150250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:23.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.322+0000 7fe9e8737700 1 --2- 172.21.15.49:0/1417646444 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9e00c7220 0x7fe9e00c76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:23.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.322+0000 7fe9e8737700 1 -- 172.21.15.49:0/1417646444 >> 172.21.15.49:0/1417646444 conn(0x7fe9e00631d0 msgr2=0x7fe9e0063910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:23.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.323+0000 7fe9e8737700 1 -- 172.21.15.49:0/1417646444 shutdown_connections 2023-11-30T17:22:23.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.323+0000 7fe9e8737700 1 -- 172.21.15.49:0/1417646444 wait complete. 2023-11-30T17:22:23.340 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-30T17:22:23.340 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-30T17:22:23.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.467+0000 7f13b8a55700 1 Processor -- start 2023-11-30T17:22:23.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.467+0000 7f13b8a55700 1 -- start start 2023-11-30T17:22:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.468+0000 7f13b8a55700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13b40c6190 0x7f13b40c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.468+0000 7f13b8a55700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b40c72d0 con 0x7f13b4158320 2023-11-30T17:22:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.468+0000 7f13b8a55700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b4064570 con 0x7f13b4098d10 2023-11-30T17:22:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.468+0000 7f13b8a55700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b4154bc0 con 0x7f13b40c6190 2023-11-30T17:22:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.469+0000 7f13b2d9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f13b4158320 0x7f13b40a80f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34060/0 (socket says 172.21.15.49:34060) 2023-11-30T17:22:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.469+0000 7f13b2d9d700 1 -- 172.21.15.49:0/2718885360 learned_addr learned my addr 172.21.15.49:0/2718885360 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.469+0000 7f13b1d9b700 1 --2- 172.21.15.49:0/2718885360 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13b40c6190 0x7f13b40c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.469+0000 7f13b159a700 1 -- 172.21.15.49:0/2718885360 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3928638548 0 0) 0x7f13b40c72d0 con 0x7f13b4158320 2023-11-30T17:22:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.469+0000 7f13b159a700 1 -- 172.21.15.49:0/2718885360 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13a00033f0 con 0x7f13b4158320 2023-11-30T17:22:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.469+0000 7f13b159a700 1 -- 172.21.15.49:0/2718885360 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3754725896 0 0) 0x7f13b4064570 con 0x7f13b4098d10 2023-11-30T17:22:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.469+0000 7f13b159a700 1 -- 172.21.15.49:0/2718885360 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13b40c72d0 con 0x7f13b4098d10 2023-11-30T17:22:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.469+0000 7f13b159a700 1 -- 172.21.15.49:0/2718885360 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2549255191 0 0) 0x7f13a00033f0 con 0x7f13b4158320 2023-11-30T17:22:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.469+0000 7f13b1d9b700 1 -- 172.21.15.49:0/2718885360 >> v1:172.21.15.115:6789/0 conn(0x7f13b4098d10 legacy=0x7f13b4063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.469+0000 7f13b1d9b700 1 -- 172.21.15.49:0/2718885360 >> v1:172.21.15.49:6789/0 conn(0x7f13b4158320 legacy=0x7f13b40a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.469+0000 7f13b1d9b700 1 -- 172.21.15.49:0/2718885360 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b40c66c0 con 0x7f13b40c6190 2023-11-30T17:22:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.469+0000 7f13b1d9b700 1 --2- 172.21.15.49:0/2718885360 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13b40c6190 0x7f13b40c7760 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f139c009790 tx=0x7f139c009060).ready entity=mon.2 client_cookie=11960e0ede921107 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.469+0000 7f13b159a700 1 -- 172.21.15.49:0/2718885360 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a4001470 con 0x7f13b40c6190 2023-11-30T17:22:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.469+0000 7f13b159a700 1 -- 172.21.15.49:0/2718885360 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139c011400 con 0x7f13b40c6190 2023-11-30T17:22:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.470+0000 7f13b159a700 1 -- 172.21.15.49:0/2718885360 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c011780 con 0x7f13b40c6190 2023-11-30T17:22:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.470+0000 7f13b8a55700 1 -- 172.21.15.49:0/2718885360 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13b40c6190 msgr2=0x7f13b40c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.470+0000 7f13b8a55700 1 --2- 172.21.15.49:0/2718885360 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13b40c6190 0x7f13b40c7760 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f139c009790 tx=0x7f139c009060).stop 2023-11-30T17:22:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.470+0000 7f13b8a55700 1 -- 172.21.15.49:0/2718885360 shutdown_connections 2023-11-30T17:22:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.470+0000 7f13b8a55700 1 --2- 172.21.15.49:0/2718885360 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13b40c6190 0x7f13b40c7760 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.470+0000 7f13b8a55700 1 -- 172.21.15.49:0/2718885360 >> 172.21.15.49:0/2718885360 conn(0x7f13b40cb310 msgr2=0x7f13b40cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:23.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.470+0000 7f13b8a55700 1 -- 172.21.15.49:0/2718885360 shutdown_connections 2023-11-30T17:22:23.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.470+0000 7f13b8a55700 1 -- 172.21.15.49:0/2718885360 wait complete. 2023-11-30T17:22:23.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.471+0000 7f13b8a55700 1 Processor -- start 2023-11-30T17:22:23.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.471+0000 7f13b8a55700 1 -- start start 2023-11-30T17:22:23.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.472+0000 7f13b8a55700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13b4098d10 0x7f13b4154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:23.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.472+0000 7f13b8a55700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13b40c6190 0x7f13b40ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:23.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.472+0000 7f13b8a55700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13b4158320 0x7f13b40a96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:23.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.472+0000 7f13b8a55700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b41562a0 con 0x7f13b4158320 2023-11-30T17:22:23.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.472+0000 7f13b8a55700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b4155690 con 0x7f13b4098d10 2023-11-30T17:22:23.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.472+0000 7f13b8a55700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b4155970 con 0x7f13b40c6190 2023-11-30T17:22:23.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.472+0000 7f13b2d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13b4158320 0x7f13b40a96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:23.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.472+0000 7f13b2d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13b4158320 0x7f13b40a96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53718/0 (socket says 172.21.15.49:53718) 2023-11-30T17:22:23.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.472+0000 7f13b2d9d700 1 -- 172.21.15.49:0/306017203 learned_addr learned my addr 172.21.15.49:0/306017203 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:23.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.472+0000 7f13b259c700 1 --2- 172.21.15.49:0/306017203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13b4098d10 0x7f13b4154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:23.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.472+0000 7f13b1d9b700 1 --2- 172.21.15.49:0/306017203 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13b40c6190 0x7f13b40ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:23.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.472+0000 7f13b2d9d700 1 -- 172.21.15.49:0/306017203 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13b40c6190 msgr2=0x7f13b40ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:23.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.472+0000 7f13b2d9d700 1 --2- 172.21.15.49:0/306017203 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13b40c6190 0x7f13b40ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:23.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.472+0000 7f13b2d9d700 1 -- 172.21.15.49:0/306017203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13b4098d10 msgr2=0x7f13b4154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:23.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.472+0000 7f13b2d9d700 1 --2- 172.21.15.49:0/306017203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13b4098d10 0x7f13b4154d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:23.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.472+0000 7f13b2d9d700 1 -- 172.21.15.49:0/306017203 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139c0092a0 con 0x7f13b4158320 2023-11-30T17:22:23.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.472+0000 7f13b2d9d700 1 --2- 172.21.15.49:0/306017203 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13b4158320 0x7f13b40a96a0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f13a400c800 tx=0x7f13a4001a20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:23.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.473+0000 7f13aa7fc700 1 -- 172.21.15.49:0/306017203 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a4007170 con 0x7f13b4158320 2023-11-30T17:22:23.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.473+0000 7f13aa7fc700 1 -- 172.21.15.49:0/306017203 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a4007310 con 0x7f13b4158320 2023-11-30T17:22:23.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.473+0000 7f13b8a55700 1 -- 172.21.15.49:0/306017203 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13b4155c50 con 0x7f13b4158320 2023-11-30T17:22:23.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.473+0000 7f13aa7fc700 1 -- 172.21.15.49:0/306017203 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a40048c0 con 0x7f13b4158320 2023-11-30T17:22:23.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.473+0000 7f13b8a55700 1 -- 172.21.15.49:0/306017203 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b4155280 con 0x7f13b4158320 2023-11-30T17:22:23.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.474+0000 7f13b8a55700 1 -- 172.21.15.49:0/306017203 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b406c860 con 0x7f13b4158320 2023-11-30T17:22:23.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.474+0000 7f13aa7fc700 1 -- 172.21.15.49:0/306017203 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f13a4004c30 con 0x7f13b4158320 2023-11-30T17:22:23.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.475+0000 7f13aa7fc700 1 --2- 172.21.15.49:0/306017203 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f139405f270 0x7f1394061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:23.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.475+0000 7f13aa7fc700 1 -- 172.21.15.49:0/306017203 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f13a4079cc0 con 0x7f13b4158320 2023-11-30T17:22:23.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.475+0000 7f13b259c700 1 --2- 172.21.15.49:0/306017203 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f139405f270 0x7f1394061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:23.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.475+0000 7f13b259c700 1 --2- 172.21.15.49:0/306017203 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f139405f270 0x7f1394061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f13ac003f20 tx=0x7f13ac007f50).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:23.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.479+0000 7f13aa7fc700 1 -- 172.21.15.49:0/306017203 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f13a404adf0 con 0x7f13b4158320 2023-11-30T17:22:23.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:23.697+0000 7f13b8a55700 1 -- 172.21.15.49:0/306017203 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f13b40c69a0 con 0x7f13b4158320 2023-11-30T17:22:24.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.326+0000 7f13aa7fc700 1 -- 172.21.15.49:0/306017203 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7f13a404e410 con 0x7f13b4158320 2023-11-30T17:22:24.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.328+0000 7f13b8a55700 1 -- 172.21.15.49:0/306017203 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f139405f270 msgr2=0x7f1394061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:24.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.328+0000 7f13b8a55700 1 --2- 172.21.15.49:0/306017203 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f139405f270 0x7f1394061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f13ac003f20 tx=0x7f13ac007f50).stop 2023-11-30T17:22:24.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.328+0000 7f13b8a55700 1 -- 172.21.15.49:0/306017203 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13b4158320 msgr2=0x7f13b40a96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:24.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.328+0000 7f13b8a55700 1 --2- 172.21.15.49:0/306017203 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13b4158320 0x7f13b40a96a0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f13a400c800 tx=0x7f13a4001a20).stop 2023-11-30T17:22:24.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.328+0000 7f13b8a55700 1 -- 172.21.15.49:0/306017203 shutdown_connections 2023-11-30T17:22:24.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.328+0000 7f13b8a55700 1 --2- 172.21.15.49:0/306017203 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f139405f270 0x7f1394061730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:24.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.328+0000 7f13b8a55700 1 --2- 172.21.15.49:0/306017203 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13b4158320 0x7f13b40a96a0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:24.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.328+0000 7f13b8a55700 1 --2- 172.21.15.49:0/306017203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13b4098d10 0x7f13b4154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:24.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.328+0000 7f13b8a55700 1 --2- 172.21.15.49:0/306017203 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13b40c6190 0x7f13b40ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:24.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.328+0000 7f13b8a55700 1 -- 172.21.15.49:0/306017203 >> 172.21.15.49:0/306017203 conn(0x7f13b40cb310 msgr2=0x7f13b4148b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:24.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.328+0000 7f13b8a55700 1 -- 172.21.15.49:0/306017203 shutdown_connections 2023-11-30T17:22:24.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.328+0000 7f13b8a55700 1 -- 172.21.15.49:0/306017203 wait complete. 2023-11-30T17:22:24.344 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-30T17:22:24.344 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:22:24.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.461+0000 7fbb87085700 1 Processor -- start 2023-11-30T17:22:24.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.461+0000 7fbb87085700 1 -- start start 2023-11-30T17:22:24.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.462+0000 7fbb87085700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb801544d0 0x7fbb80155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:24.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.462+0000 7fbb87085700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbb80066f40 0x7fbb80095e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:24.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.462+0000 7fbb87085700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb800683d0 con 0x7fbb800673c0 2023-11-30T17:22:24.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.462+0000 7fbb87085700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb80067850 con 0x7fbb80066f40 2023-11-30T17:22:24.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.462+0000 7fbb87085700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb80067b30 con 0x7fbb801544d0 2023-11-30T17:22:24.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.463+0000 7fbb84e21700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb801544d0 0x7fbb80155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:24.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.463+0000 7fbb7ffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbb80066f40 0x7fbb80095e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:24.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.463+0000 7fbb84e21700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb801544d0 0x7fbb80155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:44698/0 (socket says 172.21.15.49:44698) 2023-11-30T17:22:24.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.463+0000 7fbb85622700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fbb800673c0 0x7fbb80063e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:60900/0 (socket says 172.21.15.49:60900) 2023-11-30T17:22:24.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.463+0000 7fbb84e21700 1 -- 172.21.15.49:0/3988449886 learned_addr learned my addr 172.21.15.49:0/3988449886 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:24.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.463+0000 7fbb84e21700 1 -- 172.21.15.49:0/3988449886 >> v2:172.21.15.115:3300/0 conn(0x7fbb80066f40 msgr2=0x7fbb80095e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:24.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.463+0000 7fbb84e21700 1 --2- 172.21.15.49:0/3988449886 >> v2:172.21.15.115:3300/0 conn(0x7fbb80066f40 0x7fbb80095e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:24.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.463+0000 7fbb84e21700 1 -- 172.21.15.49:0/3988449886 >> v1:172.21.15.115:6789/0 conn(0x7fbb800673c0 legacy=0x7fbb80063e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:24.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.463+0000 7fbb84e21700 1 -- 172.21.15.49:0/3988449886 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb80067e10 con 0x7fbb801544d0 2023-11-30T17:22:24.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.463+0000 7fbb7ffff700 1 --2- 172.21.15.49:0/3988449886 >> v2:172.21.15.115:3300/0 conn(0x7fbb80066f40 0x7fbb80095e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:22:24.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.463+0000 7fbb7f7fe700 1 -- 172.21.15.49:0/3988449886 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3426274560 0 0) 0x7fbb800683d0 con 0x7fbb800673c0 2023-11-30T17:22:24.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.463+0000 7fbb84e21700 1 --2- 172.21.15.49:0/3988449886 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb801544d0 0x7fbb80155750 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fbb78009f70 tx=0x7fbb78009840).ready entity=mon.2 client_cookie=72d768d5eceb8de7 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:24.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.464+0000 7fbb7f7fe700 1 -- 172.21.15.49:0/3988449886 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7800e070 con 0x7fbb801544d0 2023-11-30T17:22:24.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.464+0000 7fbb7f7fe700 1 -- 172.21.15.49:0/3988449886 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7800ba20 con 0x7fbb801544d0 2023-11-30T17:22:24.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.464+0000 7fbb7f7fe700 1 -- 172.21.15.49:0/3988449886 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7800bda0 con 0x7fbb801544d0 2023-11-30T17:22:24.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.464+0000 7fbb87085700 1 -- 172.21.15.49:0/3988449886 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb801544d0 msgr2=0x7fbb80155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:24.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.464+0000 7fbb87085700 1 --2- 172.21.15.49:0/3988449886 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb801544d0 0x7fbb80155750 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fbb78009f70 tx=0x7fbb78009840).stop 2023-11-30T17:22:24.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.464+0000 7fbb87085700 1 -- 172.21.15.49:0/3988449886 shutdown_connections 2023-11-30T17:22:24.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.464+0000 7fbb87085700 1 --2- 172.21.15.49:0/3988449886 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb801544d0 0x7fbb80155750 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:24.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.464+0000 7fbb87085700 1 --2- 172.21.15.49:0/3988449886 >> v2:172.21.15.115:3300/0 conn(0x7fbb80066f40 0x7fbb80095e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:24.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.464+0000 7fbb87085700 1 -- 172.21.15.49:0/3988449886 >> 172.21.15.49:0/3988449886 conn(0x7fbb800631d0 msgr2=0x7fbb800c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:24.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.464+0000 7fbb87085700 1 -- 172.21.15.49:0/3988449886 shutdown_connections 2023-11-30T17:22:24.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.464+0000 7fbb87085700 1 -- 172.21.15.49:0/3988449886 wait complete. 2023-11-30T17:22:24.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.465+0000 7fbb87085700 1 Processor -- start 2023-11-30T17:22:24.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.465+0000 7fbb87085700 1 -- start start 2023-11-30T17:22:24.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.466+0000 7fbb87085700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb80066f40 0x7fbb8014cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:24.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.466+0000 7fbb87085700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb801544d0 0x7fbb800bea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:24.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.466+0000 7fbb87085700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb800beef0 0x7fbb801556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:24.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.466+0000 7fbb87085700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800ac590 con 0x7fbb801544d0 2023-11-30T17:22:24.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.466+0000 7fbb87085700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800bf460 con 0x7fbb800beef0 2023-11-30T17:22:24.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.466+0000 7fbb87085700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800bf740 con 0x7fbb80066f40 2023-11-30T17:22:24.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.466+0000 7fbb7ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb801544d0 0x7fbb800bea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:24.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.466+0000 7fbb7ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb801544d0 0x7fbb800bea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53724/0 (socket says 172.21.15.49:53724) 2023-11-30T17:22:24.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.466+0000 7fbb7ffff700 1 -- 172.21.15.49:0/4038420940 learned_addr learned my addr 172.21.15.49:0/4038420940 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:24.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.467+0000 7fbb84e21700 1 --2- 172.21.15.49:0/4038420940 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb80066f40 0x7fbb8014cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:24.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.467+0000 7fbb85622700 1 --2- 172.21.15.49:0/4038420940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb800beef0 0x7fbb801556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:24.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.467+0000 7fbb7ffff700 1 -- 172.21.15.49:0/4038420940 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb80066f40 msgr2=0x7fbb8014cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:24.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.467+0000 7fbb7ffff700 1 --2- 172.21.15.49:0/4038420940 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb80066f40 0x7fbb8014cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:24.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.467+0000 7fbb7ffff700 1 -- 172.21.15.49:0/4038420940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb800beef0 msgr2=0x7fbb801556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:24.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.467+0000 7fbb7ffff700 1 --2- 172.21.15.49:0/4038420940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb800beef0 0x7fbb801556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:24.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.467+0000 7fbb7ffff700 1 -- 172.21.15.49:0/4038420940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb740092a0 con 0x7fbb801544d0 2023-11-30T17:22:24.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.467+0000 7fbb85622700 1 --2- 172.21.15.49:0/4038420940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb800beef0 0x7fbb801556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:22:24.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.467+0000 7fbb84e21700 1 --2- 172.21.15.49:0/4038420940 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb80066f40 0x7fbb8014cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:22:24.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.467+0000 7fbb7ffff700 1 --2- 172.21.15.49:0/4038420940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb801544d0 0x7fbb800bea00 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7fbb7400e9d0 tx=0x7fbb74009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:24.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.467+0000 7fbb7cff9700 1 -- 172.21.15.49:0/4038420940 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7400c8e0 con 0x7fbb801544d0 2023-11-30T17:22:24.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.467+0000 7fbb7cff9700 1 -- 172.21.15.49:0/4038420940 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7400ca40 con 0x7fbb801544d0 2023-11-30T17:22:24.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.467+0000 7fbb7cff9700 1 -- 172.21.15.49:0/4038420940 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7400cdc0 con 0x7fbb801544d0 2023-11-30T17:22:24.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.467+0000 7fbb87085700 1 -- 172.21.15.49:0/4038420940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb78009ae0 con 0x7fbb801544d0 2023-11-30T17:22:24.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.467+0000 7fbb87085700 1 -- 172.21.15.49:0/4038420940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb800ac1d0 con 0x7fbb801544d0 2023-11-30T17:22:24.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.468+0000 7fbb87085700 1 -- 172.21.15.49:0/4038420940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb800bfc60 con 0x7fbb801544d0 2023-11-30T17:22:24.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.468+0000 7fbb7cff9700 1 -- 172.21.15.49:0/4038420940 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fbb74012600 con 0x7fbb801544d0 2023-11-30T17:22:24.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.469+0000 7fbb7cff9700 1 --2- 172.21.15.49:0/4038420940 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbb6c05f270 0x7fbb6c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:24.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.469+0000 7fbb7cff9700 1 -- 172.21.15.49:0/4038420940 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fbb7407aac0 con 0x7fbb801544d0 2023-11-30T17:22:24.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.469+0000 7fbb84e21700 1 --2- 172.21.15.49:0/4038420940 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbb6c05f270 0x7fbb6c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:24.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.469+0000 7fbb84e21700 1 --2- 172.21.15.49:0/4038420940 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbb6c05f270 0x7fbb6c061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fbb7800b9f0 tx=0x7fbb78009840).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:24.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.473+0000 7fbb7cff9700 1 -- 172.21.15.49:0/4038420940 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbb800bfc60 con 0x7fbb801544d0 2023-11-30T17:22:24.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.687+0000 7fbb87085700 1 -- 172.21.15.49:0/4038420940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb800bfc60 con 0x7fbb801544d0 2023-11-30T17:22:24.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.688+0000 7fbb7cff9700 1 -- 172.21.15.49:0/4038420940 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4496 (secure 0 0 0) 0x7fbb800bfc60 con 0x7fbb801544d0 2023-11-30T17:22:24.690 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:24.690 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/3245104889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3245104889},{"type":"v1","addr":"172.21.15.115:6836","nonce":3245104889}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5579,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1933850814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1933850814},{"type":"v1","addr":"172.21.15.115:6837","nonce":1933850814}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6225,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1356528561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1356528561},{"type":"v1","addr":"172.21.15.49:6834","nonce":1356528561}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:22:21.305720+0000","modified":"2023-11-30T17:22:24.320718+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6228},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6228":{"gid":6228,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1786065897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1786065897},{"type":"v1","addr":"172.21.15.49:6835","nonce":1786065897}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-11-30T17:22:24.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.690+0000 7fbb87085700 1 -- 172.21.15.49:0/4038420940 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbb6c05f270 msgr2=0x7fbb6c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:24.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.690+0000 7fbb87085700 1 --2- 172.21.15.49:0/4038420940 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbb6c05f270 0x7fbb6c061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fbb7800b9f0 tx=0x7fbb78009840).stop 2023-11-30T17:22:24.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.690+0000 7fbb87085700 1 -- 172.21.15.49:0/4038420940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb801544d0 msgr2=0x7fbb800bea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:24.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.690+0000 7fbb87085700 1 --2- 172.21.15.49:0/4038420940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb801544d0 0x7fbb800bea00 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7fbb7400e9d0 tx=0x7fbb74009060).stop 2023-11-30T17:22:24.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.690+0000 7fbb87085700 1 -- 172.21.15.49:0/4038420940 shutdown_connections 2023-11-30T17:22:24.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.690+0000 7fbb87085700 1 --2- 172.21.15.49:0/4038420940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb800beef0 0x7fbb801556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:24.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.690+0000 7fbb87085700 1 --2- 172.21.15.49:0/4038420940 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb80066f40 0x7fbb8014cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:24.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.690+0000 7fbb87085700 1 --2- 172.21.15.49:0/4038420940 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbb6c05f270 0x7fbb6c061730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:24.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.690+0000 7fbb87085700 1 --2- 172.21.15.49:0/4038420940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb801544d0 0x7fbb800bea00 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:24.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.690+0000 7fbb87085700 1 -- 172.21.15.49:0/4038420940 >> 172.21.15.49:0/4038420940 conn(0x7fbb800631d0 msgr2=0x7fbb80095e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:24.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.690+0000 7fbb87085700 1 -- 172.21.15.49:0/4038420940 shutdown_connections 2023-11-30T17:22:24.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.690+0000 7fbb87085700 1 -- 172.21.15.49:0/4038420940 wait complete. 2023-11-30T17:22:24.693 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 32 2023-11-30T17:22:24.704 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:22:24.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.819+0000 7fbc1ee06700 1 Processor -- start 2023-11-30T17:22:24.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.819+0000 7fbc1ee06700 1 -- start start 2023-11-30T17:22:24.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.820+0000 7fbc1ee06700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc181548c0 0x7fbc1806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:24.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.820+0000 7fbc1ee06700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbc180c6e30 0x7fbc180c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:24.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.820+0000 7fbc1ee06700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc180c69a0 con 0x7fbc181544e0 2023-11-30T17:22:24.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.820+0000 7fbc1ee06700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc180c13a0 con 0x7fbc180c6e30 2023-11-30T17:22:24.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.820+0000 7fbc1ee06700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc180c1680 con 0x7fbc181548c0 2023-11-30T17:22:24.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.820+0000 7fbc1cba2700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbc181544e0 0x7fbc180c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34076/0 (socket says 172.21.15.49:34076) 2023-11-30T17:22:24.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.820+0000 7fbc1cba2700 1 -- 172.21.15.49:0/4124794839 learned_addr learned my addr 172.21.15.49:0/4124794839 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:24.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.821+0000 7fbc17fff700 1 --2- 172.21.15.49:0/4124794839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc181548c0 0x7fbc1806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:24.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.821+0000 7fbc1d3a3700 1 --2- 172.21.15.49:0/4124794839 >> v2:172.21.15.115:3300/0 conn(0x7fbc180c6e30 0x7fbc180c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:24.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.821+0000 7fbc177fe700 1 -- 172.21.15.49:0/4124794839 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1641730309 0 0) 0x7fbc180c69a0 con 0x7fbc181544e0 2023-11-30T17:22:24.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.821+0000 7fbc177fe700 1 -- 172.21.15.49:0/4124794839 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc040033f0 con 0x7fbc181544e0 2023-11-30T17:22:24.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.821+0000 7fbc177fe700 1 -- 172.21.15.49:0/4124794839 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1155002088 0 0) 0x7fbc040033f0 con 0x7fbc181544e0 2023-11-30T17:22:24.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.821+0000 7fbc177fe700 1 -- 172.21.15.49:0/4124794839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc181548c0 msgr2=0x7fbc1806a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:24.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.821+0000 7fbc177fe700 1 --2- 172.21.15.49:0/4124794839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc181548c0 0x7fbc1806a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:24.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.821+0000 7fbc177fe700 1 -- 172.21.15.49:0/4124794839 >> v2:172.21.15.115:3300/0 conn(0x7fbc180c6e30 msgr2=0x7fbc180c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:24.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.821+0000 7fbc177fe700 1 --2- 172.21.15.49:0/4124794839 >> v2:172.21.15.115:3300/0 conn(0x7fbc180c6e30 0x7fbc180c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:24.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.821+0000 7fbc177fe700 1 -- 172.21.15.49:0/4124794839 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc180c6630 con 0x7fbc181544e0 2023-11-30T17:22:24.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.821+0000 7fbc177fe700 1 -- 172.21.15.49:0/4124794839 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fbc10001970 con 0x7fbc181544e0 2023-11-30T17:22:24.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.821+0000 7fbc177fe700 1 -- 172.21.15.49:0/4124794839 >> v1:172.21.15.49:6789/0 conn(0x7fbc181544e0 legacy=0x7fbc180c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:24.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.821+0000 7fbc177fe700 1 --2- 172.21.15.49:0/4124794839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc181548c0 0x7fbc040038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:24.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.821+0000 7fbc177fe700 1 --2- 172.21.15.49:0/4124794839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc04003e10 0x7fbc04004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:24.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.821+0000 7fbc177fe700 1 --2- 172.21.15.49:0/4124794839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc04004b80 0x7fbc04005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:24.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.821+0000 7fbc177fe700 1 -- 172.21.15.49:0/4124794839 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc180c13a0 con 0x7fbc04004b80 2023-11-30T17:22:24.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.821+0000 7fbc177fe700 1 -- 172.21.15.49:0/4124794839 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc180c1680 con 0x7fbc04003e10 2023-11-30T17:22:24.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.821+0000 7fbc177fe700 1 -- 172.21.15.49:0/4124794839 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0400b8e0 con 0x7fbc181548c0 2023-11-30T17:22:24.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.821+0000 7fbc17fff700 1 --2- 172.21.15.49:0/4124794839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc04003e10 0x7fbc04004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:24.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.821+0000 7fbc1cba2700 1 --2- 172.21.15.49:0/4124794839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc181548c0 0x7fbc040038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:24.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.821+0000 7fbc1d3a3700 1 --2- 172.21.15.49:0/4124794839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc04004b80 0x7fbc04005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:24.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.822+0000 7fbc17fff700 1 -- 172.21.15.49:0/4124794839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc181548c0 msgr2=0x7fbc040038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:24.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.822+0000 7fbc17fff700 1 --2- 172.21.15.49:0/4124794839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc181548c0 0x7fbc040038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:24.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.822+0000 7fbc17fff700 1 -- 172.21.15.49:0/4124794839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc04004b80 msgr2=0x7fbc04005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:24.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.822+0000 7fbc17fff700 1 --2- 172.21.15.49:0/4124794839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc04004b80 0x7fbc04005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:24.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.822+0000 7fbc17fff700 1 -- 172.21.15.49:0/4124794839 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc040033f0 con 0x7fbc04003e10 2023-11-30T17:22:24.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.822+0000 7fbc17fff700 1 --2- 172.21.15.49:0/4124794839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc04003e10 0x7fbc04004690 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fbc08009a90 tx=0x7fbc08009060).ready entity=mon.1 client_cookie=74cd560f56668f09 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:24.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.822+0000 7fbc177fe700 1 -- 172.21.15.49:0/4124794839 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc08009430 con 0x7fbc04003e10 2023-11-30T17:22:24.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.822+0000 7fbc177fe700 1 -- 172.21.15.49:0/4124794839 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0800e640 con 0x7fbc04003e10 2023-11-30T17:22:24.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.822+0000 7fbc177fe700 1 -- 172.21.15.49:0/4124794839 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0800e9c0 con 0x7fbc04003e10 2023-11-30T17:22:24.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.822+0000 7fbc1ee06700 1 -- 172.21.15.49:0/4124794839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc04003e10 msgr2=0x7fbc04004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:24.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.822+0000 7fbc1ee06700 1 --2- 172.21.15.49:0/4124794839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc04003e10 0x7fbc04004690 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fbc08009a90 tx=0x7fbc08009060).stop 2023-11-30T17:22:24.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.822+0000 7fbc1d3a3700 1 -- 172.21.15.49:0/4124794839 reap_dead start 2023-11-30T17:22:24.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.822+0000 7fbc1ee06700 1 -- 172.21.15.49:0/4124794839 shutdown_connections 2023-11-30T17:22:24.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.822+0000 7fbc1ee06700 1 -- 172.21.15.49:0/4124794839 >> 172.21.15.49:0/4124794839 conn(0x7fbc18085020 msgr2=0x7fbc18094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:24.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.822+0000 7fbc1ee06700 1 -- 172.21.15.49:0/4124794839 shutdown_connections 2023-11-30T17:22:24.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.822+0000 7fbc1ee06700 1 -- 172.21.15.49:0/4124794839 wait complete. 2023-11-30T17:22:24.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.824+0000 7fbc1ee06700 1 Processor -- start 2023-11-30T17:22:24.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.824+0000 7fbc1ee06700 1 -- start start 2023-11-30T17:22:24.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.824+0000 7fbc1ee06700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc04003e10 0x7fbc18149070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:24.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.824+0000 7fbc1ee06700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc18096050 0x7fbc180a82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:24.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.824+0000 7fbc1ee06700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc180a87e0 0x7fbc180c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:24.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.824+0000 7fbc1ee06700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc18095550 con 0x7fbc180a87e0 2023-11-30T17:22:24.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.824+0000 7fbc1ee06700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc180959e0 con 0x7fbc04003e10 2023-11-30T17:22:24.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.824+0000 7fbc1ee06700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc18094940 con 0x7fbc18096050 2023-11-30T17:22:24.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.825+0000 7fbc1d3a3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc180a87e0 0x7fbc180c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:24.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.825+0000 7fbc1d3a3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc180a87e0 0x7fbc180c3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53738/0 (socket says 172.21.15.49:53738) 2023-11-30T17:22:24.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.825+0000 7fbc1d3a3700 1 -- 172.21.15.49:0/2767212907 learned_addr learned my addr 172.21.15.49:0/2767212907 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:24.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.825+0000 7fbc1cba2700 1 --2- 172.21.15.49:0/2767212907 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc04003e10 0x7fbc18149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:24.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.825+0000 7fbc17fff700 1 --2- 172.21.15.49:0/2767212907 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc18096050 0x7fbc180a82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:24.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.825+0000 7fbc1d3a3700 1 -- 172.21.15.49:0/2767212907 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc18096050 msgr2=0x7fbc180a82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:24.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.825+0000 7fbc1d3a3700 1 --2- 172.21.15.49:0/2767212907 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc18096050 0x7fbc180a82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:24.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.825+0000 7fbc1d3a3700 1 -- 172.21.15.49:0/2767212907 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc04003e10 msgr2=0x7fbc18149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:24.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.825+0000 7fbc1d3a3700 1 --2- 172.21.15.49:0/2767212907 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc04003e10 0x7fbc18149070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:24.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.825+0000 7fbc1d3a3700 1 -- 172.21.15.49:0/2767212907 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc18094c20 con 0x7fbc180a87e0 2023-11-30T17:22:24.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.825+0000 7fbc17fff700 1 --2- 172.21.15.49:0/2767212907 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc18096050 0x7fbc180a82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:24.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.825+0000 7fbc1cba2700 1 --2- 172.21.15.49:0/2767212907 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc04003e10 0x7fbc18149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:24.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.825+0000 7fbc1d3a3700 1 --2- 172.21.15.49:0/2767212907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc180a87e0 0x7fbc180c3d60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7fbc180c6020 tx=0x7fbc00009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:24.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.825+0000 7fbc14ff9700 1 -- 172.21.15.49:0/2767212907 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0000f700 con 0x7fbc180a87e0 2023-11-30T17:22:24.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.825+0000 7fbc14ff9700 1 -- 172.21.15.49:0/2767212907 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0000f860 con 0x7fbc180a87e0 2023-11-30T17:22:24.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.825+0000 7fbc1ee06700 1 -- 172.21.15.49:0/2767212907 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc18094f00 con 0x7fbc180a87e0 2023-11-30T17:22:24.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.825+0000 7fbc14ff9700 1 -- 172.21.15.49:0/2767212907 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0000fc00 con 0x7fbc180a87e0 2023-11-30T17:22:24.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.825+0000 7fbc1ee06700 1 -- 172.21.15.49:0/2767212907 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc18149560 con 0x7fbc180a87e0 2023-11-30T17:22:24.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.826+0000 7fbc1ee06700 1 -- 172.21.15.49:0/2767212907 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc180956c0 con 0x7fbc180a87e0 2023-11-30T17:22:24.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.827+0000 7fbc14ff9700 1 -- 172.21.15.49:0/2767212907 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fbc00014440 con 0x7fbc180a87e0 2023-11-30T17:22:24.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.827+0000 7fbc14ff9700 1 --2- 172.21.15.49:0/2767212907 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbbf805f2a0 0x7fbbf8061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:24.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.827+0000 7fbc14ff9700 1 -- 172.21.15.49:0/2767212907 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fbc0007ac70 con 0x7fbc180a87e0 2023-11-30T17:22:24.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.827+0000 7fbc1cba2700 1 --2- 172.21.15.49:0/2767212907 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbbf805f2a0 0x7fbbf8061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:24.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.828+0000 7fbc1cba2700 1 --2- 172.21.15.49:0/2767212907 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbbf805f2a0 0x7fbbf8061760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fbc10007fd0 tx=0x7fbc10009040).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:24.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:24.831+0000 7fbc14ff9700 1 -- 172.21.15.49:0/2767212907 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbc0004bd40 con 0x7fbc180a87e0 2023-11-30T17:22:25.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.004+0000 7fbc1ee06700 1 -- 172.21.15.49:0/2767212907 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc1806c860 con 0x7fbc180a87e0 2023-11-30T17:22:25.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.005+0000 7fbc14ff9700 1 -- 172.21.15.49:0/2767212907 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16973 (secure 0 0 0) 0x7fbc00018070 con 0x7fbc180a87e0 2023-11-30T17:22:25.008 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:25.008 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":83,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:22:22.310188+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:22:19.274919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-30T17:22:20.286346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:22:25.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.007+0000 7fbc1ee06700 1 -- 172.21.15.49:0/2767212907 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbbf805f2a0 msgr2=0x7fbbf8061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:25.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.007+0000 7fbc1ee06700 1 --2- 172.21.15.49:0/2767212907 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbbf805f2a0 0x7fbbf8061760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fbc10007fd0 tx=0x7fbc10009040).stop 2023-11-30T17:22:25.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.007+0000 7fbc1ee06700 1 -- 172.21.15.49:0/2767212907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc180a87e0 msgr2=0x7fbc180c3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:25.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.007+0000 7fbc1ee06700 1 --2- 172.21.15.49:0/2767212907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc180a87e0 0x7fbc180c3d60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7fbc180c6020 tx=0x7fbc00009060).stop 2023-11-30T17:22:25.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.007+0000 7fbc1ee06700 1 -- 172.21.15.49:0/2767212907 shutdown_connections 2023-11-30T17:22:25.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.007+0000 7fbc1ee06700 1 --2- 172.21.15.49:0/2767212907 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbbf805f2a0 0x7fbbf8061760 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:25.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.007+0000 7fbc1ee06700 1 --2- 172.21.15.49:0/2767212907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc180a87e0 0x7fbc180c3d60 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:25.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.007+0000 7fbc1ee06700 1 --2- 172.21.15.49:0/2767212907 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc04003e10 0x7fbc18149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:25.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.007+0000 7fbc1ee06700 1 --2- 172.21.15.49:0/2767212907 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc18096050 0x7fbc180a82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:25.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.007+0000 7fbc1ee06700 1 -- 172.21.15.49:0/2767212907 >> 172.21.15.49:0/2767212907 conn(0x7fbc18085020 msgr2=0x7fbc180ae240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:25.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.007+0000 7fbc1ee06700 1 -- 172.21.15.49:0/2767212907 shutdown_connections 2023-11-30T17:22:25.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.007+0000 7fbc1ee06700 1 -- 172.21.15.49:0/2767212907 wait complete. 2023-11-30T17:22:25.022 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-30T17:22:25.022 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:22:25.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.137+0000 7f3d29d6c700 1 Processor -- start 2023-11-30T17:22:25.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.137+0000 7f3d29d6c700 1 -- start start 2023-11-30T17:22:25.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.138+0000 7f3d29d6c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3d241544e0 0x7f3d241548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:25.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.138+0000 7f3d29d6c700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d240c69a0 con 0x7f3d240c6e30 2023-11-30T17:22:25.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.138+0000 7f3d29d6c700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d240c13a0 con 0x7f3d2406a610 2023-11-30T17:22:25.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.138+0000 7f3d29d6c700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d240c1680 con 0x7f3d241544e0 2023-11-30T17:22:25.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.138+0000 7f3d237fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3d241544e0 0x7f3d241548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:25.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.138+0000 7f3d23fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3d240c6e30 0x7f3d240a8000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34082/0 (socket says 172.21.15.49:34082) 2023-11-30T17:22:25.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.138+0000 7f3d237fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3d241544e0 0x7f3d241548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53754/0 (socket says 172.21.15.49:53754) 2023-11-30T17:22:25.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.138+0000 7f3d23fff700 1 -- 172.21.15.49:0/3082000483 learned_addr learned my addr 172.21.15.49:0/3082000483 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:25.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.138+0000 7f3d237fe700 1 -- 172.21.15.49:0/3082000483 >> v1:172.21.15.115:6789/0 conn(0x7f3d2406a610 legacy=0x7f3d240c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:25.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.138+0000 7f3d237fe700 1 -- 172.21.15.49:0/3082000483 >> v1:172.21.15.49:6789/0 conn(0x7f3d240c6e30 legacy=0x7f3d240a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:25.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.138+0000 7f3d227fc700 1 -- 172.21.15.49:0/3082000483 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 305585736 0 0) 0x7f3d240c69a0 con 0x7f3d240c6e30 2023-11-30T17:22:25.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.138+0000 7f3d237fe700 1 -- 172.21.15.49:0/3082000483 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d240c6630 con 0x7f3d241544e0 2023-11-30T17:22:25.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.139+0000 7f3d237fe700 1 --2- 172.21.15.49:0/3082000483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d241544e0 0x7f3d241548c0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f3d14006fd0 tx=0x7f3d14006f40).ready entity=mon.0 client_cookie=7417f65bd20009ec server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:25.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.139+0000 7f3d227fc700 1 -- 172.21.15.49:0/3082000483 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d14005880 con 0x7f3d241544e0 2023-11-30T17:22:25.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.139+0000 7f3d227fc700 1 -- 172.21.15.49:0/3082000483 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d140059e0 con 0x7f3d241544e0 2023-11-30T17:22:25.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.139+0000 7f3d227fc700 1 -- 172.21.15.49:0/3082000483 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d14005d60 con 0x7f3d241544e0 2023-11-30T17:22:25.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.139+0000 7f3d29d6c700 1 -- 172.21.15.49:0/3082000483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d241544e0 msgr2=0x7f3d241548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:25.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.139+0000 7f3d29d6c700 1 --2- 172.21.15.49:0/3082000483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d241544e0 0x7f3d241548c0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f3d14006fd0 tx=0x7f3d14006f40).stop 2023-11-30T17:22:25.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.139+0000 7f3d29d6c700 1 -- 172.21.15.49:0/3082000483 shutdown_connections 2023-11-30T17:22:25.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.139+0000 7f3d29d6c700 1 --2- 172.21.15.49:0/3082000483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d241544e0 0x7f3d241548c0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:25.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.139+0000 7f3d29d6c700 1 -- 172.21.15.49:0/3082000483 >> 172.21.15.49:0/3082000483 conn(0x7f3d24085020 msgr2=0x7f3d24094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:25.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.139+0000 7f3d29d6c700 1 -- 172.21.15.49:0/3082000483 shutdown_connections 2023-11-30T17:22:25.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.139+0000 7f3d29d6c700 1 -- 172.21.15.49:0/3082000483 wait complete. 2023-11-30T17:22:25.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.141+0000 7f3d29d6c700 1 Processor -- start 2023-11-30T17:22:25.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.141+0000 7f3d29d6c700 1 -- start start 2023-11-30T17:22:25.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.141+0000 7f3d29d6c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3d2406a610 0x7f3d240a8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:25.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.141+0000 7f3d29d6c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d240c6e30 0x7f3d24145e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:25.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.141+0000 7f3d29d6c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d241544e0 0x7f3d240a8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:25.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.141+0000 7f3d29d6c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d24098f80 con 0x7f3d241544e0 2023-11-30T17:22:25.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.141+0000 7f3d29d6c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d240a84f0 con 0x7f3d240c6e30 2023-11-30T17:22:25.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.141+0000 7f3d29d6c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d24098400 con 0x7f3d2406a610 2023-11-30T17:22:25.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.141+0000 7f3d23fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d241544e0 0x7f3d240a8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:25.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.141+0000 7f3d23fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d241544e0 0x7f3d240a8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53770/0 (socket says 172.21.15.49:53770) 2023-11-30T17:22:25.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.141+0000 7f3d23fff700 1 -- 172.21.15.49:0/1650863699 learned_addr learned my addr 172.21.15.49:0/1650863699 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:25.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.141+0000 7f3d237fe700 1 --2- 172.21.15.49:0/1650863699 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3d2406a610 0x7f3d240a8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:25.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.141+0000 7f3d22ffd700 1 --2- 172.21.15.49:0/1650863699 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d240c6e30 0x7f3d24145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:25.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.142+0000 7f3d23fff700 1 -- 172.21.15.49:0/1650863699 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3d2406a610 msgr2=0x7f3d240a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:25.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.142+0000 7f3d23fff700 1 --2- 172.21.15.49:0/1650863699 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3d2406a610 0x7f3d240a8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:25.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.142+0000 7f3d23fff700 1 -- 172.21.15.49:0/1650863699 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d240c6e30 msgr2=0x7f3d24145e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:25.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.142+0000 7f3d23fff700 1 --2- 172.21.15.49:0/1650863699 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d240c6e30 0x7f3d24145e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:25.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.142+0000 7f3d23fff700 1 -- 172.21.15.49:0/1650863699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d14009250 con 0x7f3d241544e0 2023-11-30T17:22:25.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.142+0000 7f3d23fff700 1 --2- 172.21.15.49:0/1650863699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d241544e0 0x7f3d240a8e10 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f3d1c00c730 tx=0x7f3d1c001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:25.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.142+0000 7f3d0b7fe700 1 -- 172.21.15.49:0/1650863699 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c005d30 con 0x7f3d241544e0 2023-11-30T17:22:25.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.142+0000 7f3d0b7fe700 1 -- 172.21.15.49:0/1650863699 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1c005e90 con 0x7f3d241544e0 2023-11-30T17:22:25.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.142+0000 7f3d29d6c700 1 -- 172.21.15.49:0/1650863699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d240986e0 con 0x7f3d241544e0 2023-11-30T17:22:25.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.142+0000 7f3d0b7fe700 1 -- 172.21.15.49:0/1650863699 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c007300 con 0x7f3d241544e0 2023-11-30T17:22:25.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.142+0000 7f3d29d6c700 1 -- 172.21.15.49:0/1650863699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d24098ca0 con 0x7f3d241544e0 2023-11-30T17:22:25.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.143+0000 7f3d29d6c700 1 -- 172.21.15.49:0/1650863699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d2406b970 con 0x7f3d241544e0 2023-11-30T17:22:25.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.144+0000 7f3d0b7fe700 1 -- 172.21.15.49:0/1650863699 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f3d1c0076b0 con 0x7f3d241544e0 2023-11-30T17:22:25.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.144+0000 7f3d0b7fe700 1 --2- 172.21.15.49:0/1650863699 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3d1005f270 0x7f3d10061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:25.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.144+0000 7f3d0b7fe700 1 -- 172.21.15.49:0/1650863699 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f3d1c079d20 con 0x7f3d241544e0 2023-11-30T17:22:25.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.144+0000 7f3d237fe700 1 --2- 172.21.15.49:0/1650863699 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3d1005f270 0x7f3d10061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:25.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.144+0000 7f3d237fe700 1 --2- 172.21.15.49:0/1650863699 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3d1005f270 0x7f3d10061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f3d1400a010 tx=0x7f3d14016000).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:25.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.148+0000 7f3d0b7fe700 1 -- 172.21.15.49:0/1650863699 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3d1c04ae50 con 0x7f3d241544e0 2023-11-30T17:22:25.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.316+0000 7f3d29d6c700 1 -- 172.21.15.49:0/1650863699 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d240c6250 con 0x7f3d1005f270 2023-11-30T17:22:25.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.327+0000 7f3d0b7fe700 1 -- 172.21.15.49:0/1650863699 <== mgr.5926 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353936 (secure 0 0 0) 0x7f3d240c6250 con 0x7f3d1005f270 2023-11-30T17:22:25.333 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:25.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.330+0000 7f3d29d6c700 1 -- 172.21.15.49:0/1650863699 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3d1005f270 msgr2=0x7f3d10061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:25.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.330+0000 7f3d29d6c700 1 --2- 172.21.15.49:0/1650863699 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3d1005f270 0x7f3d10061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f3d1400a010 tx=0x7f3d14016000).stop 2023-11-30T17:22:25.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.330+0000 7f3d29d6c700 1 -- 172.21.15.49:0/1650863699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d241544e0 msgr2=0x7f3d240a8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:25.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.330+0000 7f3d29d6c700 1 --2- 172.21.15.49:0/1650863699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d241544e0 0x7f3d240a8e10 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f3d1c00c730 tx=0x7f3d1c001520).stop 2023-11-30T17:22:25.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.330+0000 7f3d29d6c700 1 -- 172.21.15.49:0/1650863699 shutdown_connections 2023-11-30T17:22:25.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.330+0000 7f3d29d6c700 1 --2- 172.21.15.49:0/1650863699 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3d1005f270 0x7f3d10061730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:25.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.330+0000 7f3d29d6c700 1 --2- 172.21.15.49:0/1650863699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d241544e0 0x7f3d240a8e10 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:25.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.330+0000 7f3d29d6c700 1 --2- 172.21.15.49:0/1650863699 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3d2406a610 0x7f3d240a8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:25.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.330+0000 7f3d29d6c700 1 --2- 172.21.15.49:0/1650863699 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d240c6e30 0x7f3d24145e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:25.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.330+0000 7f3d29d6c700 1 -- 172.21.15.49:0/1650863699 >> 172.21.15.49:0/1650863699 conn(0x7f3d24085020 msgr2=0x7f3d240ca930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:25.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.330+0000 7f3d29d6c700 1 -- 172.21.15.49:0/1650863699 shutdown_connections 2023-11-30T17:22:25.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.330+0000 7f3d29d6c700 1 -- 172.21.15.49:0/1650863699 wait complete. 2023-11-30T17:22:25.338 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:22:25.345 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-30T17:22:24.231193+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1268,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":98,"acting":98,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":113,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2421232,"kb_used_data":7600,"kb_used_omap":0,"kb_used_meta":2413568,"kb_avail":752553488,"statfs":{"total":773094113280,"available":770614771712,"internally_reserved":0,"allocated":7782400,"data_stored":3853328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2471493632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-28927,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-83,"num_write_kb":-68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.010859"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3f","version":"82'3","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.329667+0000","last_change":"2023-11-30T17:22:20.929205+0000","last_active":"2023-11-30T17:22:21.329667+0000","last_peered":"2023-11-30T17:22:21.329667+0000","last_clean":"2023-11-30T17:22:21.329667+0000","last_became_active":"2023-11-30T17:22:20.928896+0000","last_became_peered":"2023-11-30T17:22:20.928896+0000","last_unstale":"2023-11-30T17:22:21.329667+0000","last_undegraded":"2023-11-30T17:22:21.329667+0000","last_fullsized":"2023-11-30T17:22:21.329667+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.333605+0000","last_change":"2023-11-30T17:22:21.332725+0000","last_active":"2023-11-30T17:22:21.333605+0000","last_peered":"2023-11-30T17:22:21.333605+0000","last_clean":"2023-11-30T17:22:21.333605+0000","last_became_active":"2023-11-30T17:22:21.332417+0000","last_became_peered":"2023-11-30T17:22:21.332417+0000","last_unstale":"2023-11-30T17:22:21.333605+0000","last_undegraded":"2023-11-30T17:22:21.333605+0000","last_fullsized":"2023-11-30T17:22:21.333605+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.333314+0000","last_change":"2023-11-30T17:22:21.331441+0000","last_active":"2023-11-30T17:22:21.333314+0000","last_peered":"2023-11-30T17:22:21.333314+0000","last_clean":"2023-11-30T17:22:21.333314+0000","last_became_active":"2023-11-30T17:22:21.330964+0000","last_became_peered":"2023-11-30T17:22:21.330964+0000","last_unstale":"2023-11-30T17:22:21.333314+0000","last_undegraded":"2023-11-30T17:22:21.333314+0000","last_fullsized":"2023-11-30T17:22:21.333314+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.333885+0000","last_change":"2023-11-30T17:22:20.926229+0000","last_active":"2023-11-30T17:22:21.333885+0000","last_peered":"2023-11-30T17:22:21.333885+0000","last_clean":"2023-11-30T17:22:21.333885+0000","last_became_active":"2023-11-30T17:22:20.925910+0000","last_became_peered":"2023-11-30T17:22:20.925910+0000","last_unstale":"2023-11-30T17:22:21.333885+0000","last_undegraded":"2023-11-30T17:22:21.333885+0000","last_fullsized":"2023-11-30T17:22:21.333885+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335733+0000","last_change":"2023-11-30T17:22:21.332864+0000","last_active":"2023-11-30T17:22:21.335733+0000","last_peered":"2023-11-30T17:22:21.335733+0000","last_clean":"2023-11-30T17:22:21.335733+0000","last_became_active":"2023-11-30T17:22:21.332589+0000","last_became_peered":"2023-11-30T17:22:21.332589+0000","last_unstale":"2023-11-30T17:22:21.335733+0000","last_undegraded":"2023-11-30T17:22:21.335733+0000","last_fullsized":"2023-11-30T17:22:21.335733+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337303+0000","last_change":"2023-11-30T17:22:20.929809+0000","last_active":"2023-11-30T17:22:21.337303+0000","last_peered":"2023-11-30T17:22:21.337303+0000","last_clean":"2023-11-30T17:22:21.337303+0000","last_became_active":"2023-11-30T17:22:20.929506+0000","last_became_peered":"2023-11-30T17:22:20.929506+0000","last_unstale":"2023-11-30T17:22:21.337303+0000","last_undegraded":"2023-11-30T17:22:21.337303+0000","last_fullsized":"2023-11-30T17:22:21.337303+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335363+0000","last_change":"2023-11-30T17:22:21.332342+0000","last_active":"2023-11-30T17:22:21.335363+0000","last_peered":"2023-11-30T17:22:21.335363+0000","last_clean":"2023-11-30T17:22:21.335363+0000","last_became_active":"2023-11-30T17:22:21.321851+0000","last_became_peered":"2023-11-30T17:22:21.321851+0000","last_unstale":"2023-11-30T17:22:21.335363+0000","last_undegraded":"2023-11-30T17:22:21.335363+0000","last_fullsized":"2023-11-30T17:22:21.335363+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.316483+0000","last_change":"2023-11-30T17:22:20.928501+0000","last_active":"2023-11-30T17:22:21.316483+0000","last_peered":"2023-11-30T17:22:21.316483+0000","last_clean":"2023-11-30T17:22:21.316483+0000","last_became_active":"2023-11-30T17:22:20.928198+0000","last_became_peered":"2023-11-30T17:22:20.928198+0000","last_unstale":"2023-11-30T17:22:21.316483+0000","last_undegraded":"2023-11-30T17:22:21.316483+0000","last_fullsized":"2023-11-30T17:22:21.316483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.316312+0000","last_change":"2023-11-30T17:22:20.932648+0000","last_active":"2023-11-30T17:22:21.316312+0000","last_peered":"2023-11-30T17:22:21.316312+0000","last_clean":"2023-11-30T17:22:21.316312+0000","last_became_active":"2023-11-30T17:22:20.932328+0000","last_became_peered":"2023-11-30T17:22:20.932328+0000","last_unstale":"2023-11-30T17:22:21.316312+0000","last_undegraded":"2023-11-30T17:22:21.316312+0000","last_fullsized":"2023-11-30T17:22:21.316312+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.336734+0000","last_change":"2023-11-30T17:22:21.334427+0000","last_active":"2023-11-30T17:22:21.336734+0000","last_peered":"2023-11-30T17:22:21.336734+0000","last_clean":"2023-11-30T17:22:21.336734+0000","last_became_active":"2023-11-30T17:22:21.334056+0000","last_became_peered":"2023-11-30T17:22:21.334056+0000","last_unstale":"2023-11-30T17:22:21.336734+0000","last_undegraded":"2023-11-30T17:22:21.336734+0000","last_fullsized":"2023-11-30T17:22:21.336734+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"82'4","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.339175+0000","last_change":"2023-11-30T17:22:20.929041+0000","last_active":"2023-11-30T17:22:21.339175+0000","last_peered":"2023-11-30T17:22:21.339175+0000","last_clean":"2023-11-30T17:22:21.339175+0000","last_became_active":"2023-11-30T17:22:20.928561+0000","last_became_peered":"2023-11-30T17:22:20.928561+0000","last_unstale":"2023-11-30T17:22:21.339175+0000","last_undegraded":"2023-11-30T17:22:21.339175+0000","last_fullsized":"2023-11-30T17:22:21.339175+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.331614+0000","last_change":"2023-11-30T17:22:20.930348+0000","last_active":"2023-11-30T17:22:21.331614+0000","last_peered":"2023-11-30T17:22:21.331614+0000","last_clean":"2023-11-30T17:22:21.331614+0000","last_became_active":"2023-11-30T17:22:20.930051+0000","last_became_peered":"2023-11-30T17:22:20.930051+0000","last_unstale":"2023-11-30T17:22:21.331614+0000","last_undegraded":"2023-11-30T17:22:21.331614+0000","last_fullsized":"2023-11-30T17:22:21.331614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337301+0000","last_change":"2023-11-30T17:22:21.336482+0000","last_active":"2023-11-30T17:22:21.337301+0000","last_peered":"2023-11-30T17:22:21.337301+0000","last_clean":"2023-11-30T17:22:21.337301+0000","last_became_active":"2023-11-30T17:22:21.336197+0000","last_became_peered":"2023-11-30T17:22:21.336197+0000","last_unstale":"2023-11-30T17:22:21.337301+0000","last_undegraded":"2023-11-30T17:22:21.337301+0000","last_fullsized":"2023-11-30T17:22:21.337301+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.333437+0000","last_change":"2023-11-30T17:22:21.330564+0000","last_active":"2023-11-30T17:22:21.333437+0000","last_peered":"2023-11-30T17:22:21.333437+0000","last_clean":"2023-11-30T17:22:21.333437+0000","last_became_active":"2023-11-30T17:22:21.329983+0000","last_became_peered":"2023-11-30T17:22:21.329983+0000","last_unstale":"2023-11-30T17:22:21.333437+0000","last_undegraded":"2023-11-30T17:22:21.333437+0000","last_fullsized":"2023-11-30T17:22:21.333437+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.323406+0000","last_change":"2023-11-30T17:22:20.931253+0000","last_active":"2023-11-30T17:22:21.323406+0000","last_peered":"2023-11-30T17:22:21.323406+0000","last_clean":"2023-11-30T17:22:21.323406+0000","last_became_active":"2023-11-30T17:22:20.930953+0000","last_became_peered":"2023-11-30T17:22:20.930953+0000","last_unstale":"2023-11-30T17:22:21.323406+0000","last_undegraded":"2023-11-30T17:22:21.323406+0000","last_fullsized":"2023-11-30T17:22:21.323406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.314552+0000","last_change":"2023-11-30T17:22:20.934622+0000","last_active":"2023-11-30T17:22:21.314552+0000","last_peered":"2023-11-30T17:22:21.314552+0000","last_clean":"2023-11-30T17:22:21.314552+0000","last_became_active":"2023-11-30T17:22:20.934343+0000","last_became_peered":"2023-11-30T17:22:20.934343+0000","last_unstale":"2023-11-30T17:22:21.314552+0000","last_undegraded":"2023-11-30T17:22:21.314552+0000","last_fullsized":"2023-11-30T17:22:21.314552+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.322388+0000","last_change":"2023-11-30T17:22:20.932327+0000","last_active":"2023-11-30T17:22:21.322388+0000","last_peered":"2023-11-30T17:22:21.322388+0000","last_clean":"2023-11-30T17:22:21.322388+0000","last_became_active":"2023-11-30T17:22:20.932056+0000","last_became_peered":"2023-11-30T17:22:20.932056+0000","last_unstale":"2023-11-30T17:22:21.322388+0000","last_undegraded":"2023-11-30T17:22:21.322388+0000","last_fullsized":"2023-11-30T17:22:21.322388+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335152+0000","last_change":"2023-11-30T17:22:21.333765+0000","last_active":"2023-11-30T17:22:21.335152+0000","last_peered":"2023-11-30T17:22:21.335152+0000","last_clean":"2023-11-30T17:22:21.335152+0000","last_became_active":"2023-11-30T17:22:21.333449+0000","last_became_peered":"2023-11-30T17:22:21.333449+0000","last_unstale":"2023-11-30T17:22:21.335152+0000","last_undegraded":"2023-11-30T17:22:21.335152+0000","last_fullsized":"2023-11-30T17:22:21.335152+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.322384+0000","last_change":"2023-11-30T17:22:20.921100+0000","last_active":"2023-11-30T17:22:21.322384+0000","last_peered":"2023-11-30T17:22:21.322384+0000","last_clean":"2023-11-30T17:22:21.322384+0000","last_became_active":"2023-11-30T17:22:20.920818+0000","last_became_peered":"2023-11-30T17:22:20.920818+0000","last_unstale":"2023-11-30T17:22:21.322384+0000","last_undegraded":"2023-11-30T17:22:21.322384+0000","last_fullsized":"2023-11-30T17:22:21.322384+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.313733+0000","last_change":"2023-11-30T17:22:20.928872+0000","last_active":"2023-11-30T17:22:21.313733+0000","last_peered":"2023-11-30T17:22:21.313733+0000","last_clean":"2023-11-30T17:22:21.313733+0000","last_became_active":"2023-11-30T17:22:20.928246+0000","last_became_peered":"2023-11-30T17:22:20.928246+0000","last_unstale":"2023-11-30T17:22:21.313733+0000","last_undegraded":"2023-11-30T17:22:21.313733+0000","last_fullsized":"2023-11-30T17:22:21.313733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.334940+0000","last_change":"2023-11-30T17:22:20.932827+0000","last_active":"2023-11-30T17:22:21.334940+0000","last_peered":"2023-11-30T17:22:21.334940+0000","last_clean":"2023-11-30T17:22:21.334940+0000","last_became_active":"2023-11-30T17:22:20.932116+0000","last_became_peered":"2023-11-30T17:22:20.932116+0000","last_unstale":"2023-11-30T17:22:21.334940+0000","last_undegraded":"2023-11-30T17:22:21.334940+0000","last_fullsized":"2023-11-30T17:22:21.334940+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337106+0000","last_change":"2023-11-30T17:22:20.932467+0000","last_active":"2023-11-30T17:22:21.337106+0000","last_peered":"2023-11-30T17:22:21.337106+0000","last_clean":"2023-11-30T17:22:21.337106+0000","last_became_active":"2023-11-30T17:22:20.932190+0000","last_became_peered":"2023-11-30T17:22:20.932190+0000","last_unstale":"2023-11-30T17:22:21.337106+0000","last_undegraded":"2023-11-30T17:22:21.337106+0000","last_fullsized":"2023-11-30T17:22:21.337106+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.334353+0000","last_change":"2023-11-30T17:22:21.331875+0000","last_active":"2023-11-30T17:22:21.334353+0000","last_peered":"2023-11-30T17:22:21.334353+0000","last_clean":"2023-11-30T17:22:21.334353+0000","last_became_active":"2023-11-30T17:22:21.328825+0000","last_became_peered":"2023-11-30T17:22:21.328825+0000","last_unstale":"2023-11-30T17:22:21.334353+0000","last_undegraded":"2023-11-30T17:22:21.334353+0000","last_fullsized":"2023-11-30T17:22:21.334353+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335533+0000","last_change":"2023-11-30T17:22:20.936705+0000","last_active":"2023-11-30T17:22:21.335533+0000","last_peered":"2023-11-30T17:22:21.335533+0000","last_clean":"2023-11-30T17:22:21.335533+0000","last_became_active":"2023-11-30T17:22:20.936118+0000","last_became_peered":"2023-11-30T17:22:20.936118+0000","last_unstale":"2023-11-30T17:22:21.335533+0000","last_undegraded":"2023-11-30T17:22:21.335533+0000","last_fullsized":"2023-11-30T17:22:21.335533+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.314520+0000","last_change":"2023-11-30T17:22:20.930005+0000","last_active":"2023-11-30T17:22:21.314520+0000","last_peered":"2023-11-30T17:22:21.314520+0000","last_clean":"2023-11-30T17:22:21.314520+0000","last_became_active":"2023-11-30T17:22:20.929725+0000","last_became_peered":"2023-11-30T17:22:20.929725+0000","last_unstale":"2023-11-30T17:22:21.314520+0000","last_undegraded":"2023-11-30T17:22:21.314520+0000","last_fullsized":"2023-11-30T17:22:21.314520+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.331499+0000","last_change":"2023-11-30T17:22:21.327241+0000","last_active":"2023-11-30T17:22:21.331499+0000","last_peered":"2023-11-30T17:22:21.331499+0000","last_clean":"2023-11-30T17:22:21.331499+0000","last_became_active":"2023-11-30T17:22:21.326987+0000","last_became_peered":"2023-11-30T17:22:21.326987+0000","last_unstale":"2023-11-30T17:22:21.331499+0000","last_undegraded":"2023-11-30T17:22:21.331499+0000","last_fullsized":"2023-11-30T17:22:21.331499+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337309+0000","last_change":"2023-11-30T17:22:21.336465+0000","last_active":"2023-11-30T17:22:21.337309+0000","last_peered":"2023-11-30T17:22:21.337309+0000","last_clean":"2023-11-30T17:22:21.337309+0000","last_became_active":"2023-11-30T17:22:21.336172+0000","last_became_peered":"2023-11-30T17:22:21.336172+0000","last_unstale":"2023-11-30T17:22:21.337309+0000","last_undegraded":"2023-11-30T17:22:21.337309+0000","last_fullsized":"2023-11-30T17:22:21.337309+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.333412+0000","last_change":"2023-11-30T17:22:21.330374+0000","last_active":"2023-11-30T17:22:21.333412+0000","last_peered":"2023-11-30T17:22:21.333412+0000","last_clean":"2023-11-30T17:22:21.333412+0000","last_became_active":"2023-11-30T17:22:21.329939+0000","last_became_peered":"2023-11-30T17:22:21.329939+0000","last_unstale":"2023-11-30T17:22:21.333412+0000","last_undegraded":"2023-11-30T17:22:21.333412+0000","last_fullsized":"2023-11-30T17:22:21.333412+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337727+0000","last_change":"2023-11-30T17:22:20.931360+0000","last_active":"2023-11-30T17:22:21.337727+0000","last_peered":"2023-11-30T17:22:21.337727+0000","last_clean":"2023-11-30T17:22:21.337727+0000","last_became_active":"2023-11-30T17:22:20.930703+0000","last_became_peered":"2023-11-30T17:22:20.930703+0000","last_unstale":"2023-11-30T17:22:21.337727+0000","last_undegraded":"2023-11-30T17:22:21.337727+0000","last_fullsized":"2023-11-30T17:22:21.337727+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.328012+0000","last_change":"2023-11-30T17:22:21.324414+0000","last_active":"2023-11-30T17:22:21.328012+0000","last_peered":"2023-11-30T17:22:21.328012+0000","last_clean":"2023-11-30T17:22:21.328012+0000","last_became_active":"2023-11-30T17:22:21.324180+0000","last_became_peered":"2023-11-30T17:22:21.324180+0000","last_unstale":"2023-11-30T17:22:21.328012+0000","last_undegraded":"2023-11-30T17:22:21.328012+0000","last_fullsized":"2023-11-30T17:22:21.328012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337931+0000","last_change":"2023-11-30T17:22:21.337197+0000","last_active":"2023-11-30T17:22:21.337931+0000","last_peered":"2023-11-30T17:22:21.337931+0000","last_clean":"2023-11-30T17:22:21.337931+0000","last_became_active":"2023-11-30T17:22:21.336585+0000","last_became_peered":"2023-11-30T17:22:21.336585+0000","last_unstale":"2023-11-30T17:22:21.337931+0000","last_undegraded":"2023-11-30T17:22:21.337931+0000","last_fullsized":"2023-11-30T17:22:21.337931+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335963+0000","last_change":"2023-11-30T17:22:21.333694+0000","last_active":"2023-11-30T17:22:21.335963+0000","last_peered":"2023-11-30T17:22:21.335963+0000","last_clean":"2023-11-30T17:22:21.335963+0000","last_became_active":"2023-11-30T17:22:21.333507+0000","last_became_peered":"2023-11-30T17:22:21.333507+0000","last_unstale":"2023-11-30T17:22:21.335963+0000","last_undegraded":"2023-11-30T17:22:21.335963+0000","last_fullsized":"2023-11-30T17:22:21.335963+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.314720+0000","last_change":"2023-11-30T17:22:20.936879+0000","last_active":"2023-11-30T17:22:21.314720+0000","last_peered":"2023-11-30T17:22:21.314720+0000","last_clean":"2023-11-30T17:22:21.314720+0000","last_became_active":"2023-11-30T17:22:20.936480+0000","last_became_peered":"2023-11-30T17:22:20.936480+0000","last_unstale":"2023-11-30T17:22:21.314720+0000","last_undegraded":"2023-11-30T17:22:21.314720+0000","last_fullsized":"2023-11-30T17:22:21.314720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.315988+0000","last_change":"2023-11-30T17:22:20.931107+0000","last_active":"2023-11-30T17:22:21.315988+0000","last_peered":"2023-11-30T17:22:21.315988+0000","last_clean":"2023-11-30T17:22:21.315988+0000","last_became_active":"2023-11-30T17:22:20.930305+0000","last_became_peered":"2023-11-30T17:22:20.930305+0000","last_unstale":"2023-11-30T17:22:21.315988+0000","last_undegraded":"2023-11-30T17:22:21.315988+0000","last_fullsized":"2023-11-30T17:22:21.315988+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.328239+0000","last_change":"2023-11-30T17:22:21.326066+0000","last_active":"2023-11-30T17:22:21.328239+0000","last_peered":"2023-11-30T17:22:21.328239+0000","last_clean":"2023-11-30T17:22:21.328239+0000","last_became_active":"2023-11-30T17:22:21.325745+0000","last_became_peered":"2023-11-30T17:22:21.325745+0000","last_unstale":"2023-11-30T17:22:21.328239+0000","last_undegraded":"2023-11-30T17:22:21.328239+0000","last_fullsized":"2023-11-30T17:22:21.328239+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.336712+0000","last_change":"2023-11-30T17:22:21.334589+0000","last_active":"2023-11-30T17:22:21.336712+0000","last_peered":"2023-11-30T17:22:21.336712+0000","last_clean":"2023-11-30T17:22:21.336712+0000","last_became_active":"2023-11-30T17:22:21.334131+0000","last_became_peered":"2023-11-30T17:22:21.334131+0000","last_unstale":"2023-11-30T17:22:21.336712+0000","last_undegraded":"2023-11-30T17:22:21.336712+0000","last_fullsized":"2023-11-30T17:22:21.336712+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.315239+0000","last_change":"2023-11-30T17:22:20.929746+0000","last_active":"2023-11-30T17:22:21.315239+0000","last_peered":"2023-11-30T17:22:21.315239+0000","last_clean":"2023-11-30T17:22:21.315239+0000","last_became_active":"2023-11-30T17:22:20.929451+0000","last_became_peered":"2023-11-30T17:22:20.929451+0000","last_unstale":"2023-11-30T17:22:21.315239+0000","last_undegraded":"2023-11-30T17:22:21.315239+0000","last_fullsized":"2023-11-30T17:22:21.315239+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.316069+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:22:21.316069+0000","last_peered":"2023-11-30T17:22:21.316069+0000","last_clean":"2023-11-30T17:22:21.316069+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:22:21.316069+0000","last_undegraded":"2023-11-30T17:22:21.316069+0000","last_fullsized":"2023-11-30T17:22:21.316069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.313395+0000","last_change":"2023-11-30T17:22:20.931616+0000","last_active":"2023-11-30T17:22:21.313395+0000","last_peered":"2023-11-30T17:22:21.313395+0000","last_clean":"2023-11-30T17:22:21.313395+0000","last_became_active":"2023-11-30T17:22:20.931340+0000","last_became_peered":"2023-11-30T17:22:20.931340+0000","last_unstale":"2023-11-30T17:22:21.313395+0000","last_undegraded":"2023-11-30T17:22:21.313395+0000","last_fullsized":"2023-11-30T17:22:21.313395+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-30T17:22:16.265099+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:22:16.265099+0000","last_peered":"2023-11-30T17:22:16.265099+0000","last_clean":"2023-11-30T17:22:16.265099+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:22:16.265099+0000","last_undegraded":"2023-11-30T17:22:16.265099+0000","last_fullsized":"2023-11-30T17:22:16.265099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.322565+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:22:21.322565+0000","last_peered":"2023-11-30T17:22:21.322565+0000","last_clean":"2023-11-30T17:22:21.322565+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:22:21.322565+0000","last_undegraded":"2023-11-30T17:22:21.322565+0000","last_fullsized":"2023-11-30T17:22:21.322565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":62,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-30T17:22:16.265097+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:22:16.265097+0000","last_peered":"2023-11-30T17:22:16.265097+0000","last_clean":"2023-11-30T17:22:16.265097+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:22:16.265097+0000","last_undegraded":"2023-11-30T17:22:16.265097+0000","last_fullsized":"2023-11-30T17:22:16.265097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":64,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-30T17:22:17.004721+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:22:17.004721+0000","last_peered":"2023-11-30T17:22:17.004721+0000","last_clean":"2023-11-30T17:22:17.004721+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:22:17.004721+0000","last_undegraded":"2023-11-30T17:22:17.004721+0000","last_fullsized":"2023-11-30T17:22:17.004721+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335131+0000","last_change":"2023-11-30T17:22:21.332384+0000","last_active":"2023-11-30T17:22:21.335131+0000","last_peered":"2023-11-30T17:22:21.335131+0000","last_clean":"2023-11-30T17:22:21.335131+0000","last_became_active":"2023-11-30T17:22:21.332098+0000","last_became_peered":"2023-11-30T17:22:21.332098+0000","last_unstale":"2023-11-30T17:22:21.335131+0000","last_undegraded":"2023-11-30T17:22:21.335131+0000","last_fullsized":"2023-11-30T17:22:21.335131+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337701+0000","last_change":"2023-11-30T17:22:20.934641+0000","last_active":"2023-11-30T17:22:21.337701+0000","last_peered":"2023-11-30T17:22:21.337701+0000","last_clean":"2023-11-30T17:22:21.337701+0000","last_became_active":"2023-11-30T17:22:20.934355+0000","last_became_peered":"2023-11-30T17:22:20.934355+0000","last_unstale":"2023-11-30T17:22:21.337701+0000","last_undegraded":"2023-11-30T17:22:21.337701+0000","last_fullsized":"2023-11-30T17:22:21.337701+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-30T17:22:17.004656+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:22:17.004656+0000","last_peered":"2023-11-30T17:22:17.004656+0000","last_clean":"2023-11-30T17:22:17.004656+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:22:17.004656+0000","last_undegraded":"2023-11-30T17:22:17.004656+0000","last_fullsized":"2023-11-30T17:22:17.004656+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":62,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-30T17:22:17.004678+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:22:17.004678+0000","last_peered":"2023-11-30T17:22:17.004678+0000","last_clean":"2023-11-30T17:22:17.004678+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:22:17.004678+0000","last_undegraded":"2023-11-30T17:22:17.004678+0000","last_fullsized":"2023-11-30T17:22:17.004678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.316533+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:22:21.316533+0000","last_peered":"2023-11-30T17:22:21.316533+0000","last_clean":"2023-11-30T17:22:21.316533+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:22:21.316533+0000","last_undegraded":"2023-11-30T17:22:21.316533+0000","last_fullsized":"2023-11-30T17:22:21.316533+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-30T17:22:16.190486+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:22:16.190486+0000","last_peered":"2023-11-30T17:22:16.190486+0000","last_clean":"2023-11-30T17:22:16.190486+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:22:16.190486+0000","last_undegraded":"2023-11-30T17:22:16.190486+0000","last_fullsized":"2023-11-30T17:22:16.190486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":1268,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":44,"acting":44,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575030,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298016,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073824,"statfs":{"total":96636764160,"available":96331595776,"internally_reserved":0,"allocated":942080,"data_stored":467079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58899999999999997,"15min":0.57299999999999995},"min":{"1min":0.48499999999999999,"5min":0.315,"15min":0.23899999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.81100000000000005},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.57899999999999996},"min":{"1min":0.41999999999999998,"5min":0.40699999999999997,"15min":0.32200000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.81899999999999995},"last":0.68600000000000005}]},{"osd":1,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54800000000000004,"15min":0.54000000000000004},"min":{"1min":0.40600000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.41499999999999998,"5min":0.29899999999999999,"15min":0.28799999999999998},"max":{"1min":0.71799999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.47799999999999998,"5min":0.33500000000000002,"15min":0.32800000000000001},"max":{"1min":0.77000000000000002,"5min":0.77200000000000002,"15min":0.78300000000000003},"last":0.627},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56100000000000005,"15min":0.55600000000000005},"min":{"1min":0.48299999999999998,"5min":0.35399999999999998,"15min":0.28699999999999998},"max":{"1min":0.73699999999999999,"5min":0.73799999999999999,"15min":0.83899999999999997},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.44800000000000001,"5min":0.36499999999999999,"15min":0.33200000000000002},"max":{"1min":0.749,"5min":0.754,"15min":0.78000000000000003},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.45800000000000002,"5min":0.40799999999999997,"15min":0.33900000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.67500000000000004}]},{"osd":4,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.45300000000000001,"15min":0.46500000000000002},"min":{"1min":0.34200000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.79900000000000004},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47099999999999997,"15min":0.48999999999999999},"min":{"1min":0.33400000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.748,"5min":0.75800000000000001,"15min":1.3180000000000001},"last":0.44500000000000001}]},{"osd":5,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.48899999999999999,"15min":0.498},"min":{"1min":0.34300000000000003,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.82899999999999996},"last":0.5},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.872},"last":0.52200000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54700000000000004,"15min":0.55400000000000005},"min":{"1min":0.42499999999999999,"5min":0.372,"15min":0.36099999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.85199999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.54900000000000004,"15min":0.55400000000000005},"min":{"1min":0.44600000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78900000000000003,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.54000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575029,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302124,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069716,"statfs":{"total":96636764160,"available":96327389184,"internally_reserved":0,"allocated":954368,"data_stored":472988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55100000000000005,"15min":0.56499999999999995},"min":{"1min":0.32500000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71299999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.623},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.58199999999999996},"min":{"1min":0.33500000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.72199999999999998,"5min":0.79600000000000004,"15min":0.89300000000000002},"last":0.48299999999999998}]},{"osd":1,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.376,"5min":0.30599999999999999,"15min":0.26400000000000001},"max":{"1min":0.74199999999999999,"5min":0.77500000000000002,"15min":0.82799999999999996},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58299999999999996,"15min":0.59299999999999997},"min":{"1min":0.44600000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.74099999999999999,"5min":0.82499999999999996,"15min":0.85199999999999998},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.45000000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.68799999999999994,"5min":0.79900000000000004,"15min":0.82599999999999996},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.46700000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72799999999999998,"5min":0.80900000000000005,"15min":0.82499999999999996},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51500000000000001,"15min":0.53200000000000003},"min":{"1min":0.34300000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69099999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.443},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.40200000000000002,"5min":0.33100000000000002,"15min":0.32200000000000001},"max":{"1min":0.73099999999999998,"5min":0.75600000000000001,"15min":0.79600000000000004},"last":0.73199999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.44700000000000001,"15min":0.45400000000000001},"min":{"1min":0.35499999999999998,"5min":0.29599999999999999,"15min":0.28999999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.84199999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46300000000000002,"15min":0.47899999999999998},"min":{"1min":0.36499999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.65500000000000003,"5min":0.76000000000000001,"15min":0.83899999999999997},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.46100000000000002,"15min":0.47099999999999997},"min":{"1min":0.35199999999999998,"5min":0.29899999999999999,"15min":0.28299999999999997},"max":{"1min":0.65200000000000002,"5min":0.69399999999999995,"15min":0.74299999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.50700000000000001},"min":{"1min":0.371,"5min":0.33500000000000002,"15min":0.31900000000000001},"max":{"1min":0.70399999999999996,"5min":0.745,"15min":0.78500000000000003},"last":0.48999999999999999}]},{"osd":7,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51700000000000002,"15min":0.53300000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73299999999999998,"5min":0.80700000000000005,"15min":0.93200000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55300000000000005,"15min":0.56299999999999994},"min":{"1min":0.39500000000000002,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.86499999999999999},"last":0.81299999999999994}]}]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302188,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069652,"statfs":{"total":96636764160,"available":96327323648,"internally_reserved":0,"allocated":1019904,"data_stored":500639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.35999999999999999,"15min":0.35099999999999998},"min":{"1min":0.29599999999999999,"5min":0.23899999999999999,"15min":0.23000000000000001},"max":{"1min":0.54900000000000004,"5min":0.57199999999999995,"15min":0.60299999999999998},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.502,"5min":0.46999999999999997,"15min":0.46100000000000002},"min":{"1min":0.39200000000000002,"5min":0.314,"15min":0.309},"max":{"1min":0.59899999999999998,"5min":0.748,"15min":0.75700000000000001},"last":0.45900000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.39100000000000001,"15min":0.379},"min":{"1min":0.28599999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.56999999999999995,"5min":0.59799999999999998,"15min":0.67300000000000004},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.50800000000000001,"15min":0.48999999999999999},"min":{"1min":0.438,"5min":0.33400000000000002,"15min":0.29499999999999998},"max":{"1min":0.64200000000000002,"5min":0.78200000000000003,"15min":0.80700000000000005},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45100000000000001,"15min":0.441},"min":{"1min":0.38200000000000001,"5min":0.29899999999999999,"15min":0.23899999999999999},"max":{"1min":0.57099999999999995,"5min":0.70299999999999996,"15min":0.749},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.437,"15min":0.42599999999999999},"min":{"1min":0.34100000000000003,"5min":0.29999999999999999,"15min":0.28599999999999998},"max":{"1min":0.55700000000000005,"5min":0.71899999999999997,"15min":0.73699999999999999},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.44400000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.873,"5min":0.88500000000000001,"15min":0.89100000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.61199999999999999,"15min":0.61499999999999999},"min":{"1min":0.48599999999999999,"5min":0.41299999999999998,"15min":0.39900000000000002},"max":{"1min":0.753,"5min":0.97599999999999998,"15min":1.111},"last":0.60199999999999998}]},{"osd":5,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59799999999999998,"15min":0.59899999999999998},"min":{"1min":0.44400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.85399999999999998,"5min":1.006,"15min":1.006},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.434,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76500000000000001,"5min":0.81399999999999995,"15min":0.91300000000000003},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.56699999999999995,"5min":0.39700000000000002,"15min":0.39600000000000002},"max":{"1min":0.85699999999999998,"5min":0.92700000000000005,"15min":1.0600000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65200000000000002,"15min":0.65800000000000003},"min":{"1min":0.51600000000000001,"5min":0.433,"15min":0.379},"max":{"1min":0.91100000000000003,"5min":0.96099999999999997,"15min":1.0780000000000001},"last":0.745}]},{"osd":7,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67000000000000004,"15min":0.66300000000000003},"min":{"1min":0.45100000000000001,"5min":0.41899999999999998,"15min":0.41699999999999998},"max":{"1min":0.88900000000000001,"5min":0.92300000000000004,"15min":0.98699999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64000000000000001,"15min":0.64700000000000002},"min":{"1min":0.52500000000000002,"5min":0.436,"15min":0.39900000000000002},"max":{"1min":0.81999999999999995,"5min":0.879,"15min":0.94199999999999995},"last":0.59499999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575030,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302172,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069668,"statfs":{"total":96636764160,"available":96327340032,"internally_reserved":0,"allocated":1003520,"data_stored":499883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.373,"15min":0.35999999999999999},"min":{"1min":0.27500000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.48599999999999999,"5min":0.59999999999999998,"15min":0.71199999999999997},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.39100000000000001,"15min":0.379},"min":{"1min":0.26500000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.26100000000000001}]},{"osd":2,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.39100000000000001,"15min":0.38},"min":{"1min":0.29499999999999998,"5min":0.247,"15min":0.23899999999999999},"max":{"1min":0.55900000000000005,"5min":0.623,"15min":0.623},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.46300000000000002,"15min":0.45300000000000001},"min":{"1min":0.38100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.63400000000000001,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.313}]},{"osd":3,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.433,"15min":0.42599999999999999},"min":{"1min":0.32500000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.58599999999999997,"5min":0.66100000000000003,"15min":0.70999999999999996},"last":0.245},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44700000000000001,"15min":0.435},"min":{"1min":0.34300000000000003,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.56200000000000006,"5min":0.65400000000000003,"15min":0.68799999999999994},"last":0.27300000000000002}]},{"osd":4,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60999999999999999,"15min":0.59999999999999998},"min":{"1min":0.44900000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76400000000000001,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.50800000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.85399999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60899999999999999,"15min":0.59499999999999997},"min":{"1min":0.47399999999999998,"5min":0.39200000000000002,"15min":0.36199999999999999},"max":{"1min":0.83499999999999996,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63700000000000001,"15min":0.623},"min":{"1min":0.51500000000000001,"5min":0.38400000000000001,"15min":0.38},"max":{"1min":0.77700000000000002,"5min":1.004,"15min":1.004},"last":0.54500000000000004}]},{"osd":6,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65100000000000002,"15min":0.63900000000000001},"min":{"1min":0.435,"5min":0.376,"15min":0.376},"max":{"1min":0.89800000000000002,"5min":1.002,"15min":1.002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63900000000000001,"15min":0.627},"min":{"1min":0.496,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.872,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66000000000000003,"15min":0.64600000000000002},"min":{"1min":0.498,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94499999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.69699999999999995,"15min":0.68200000000000005},"min":{"1min":0.56100000000000005,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.93799999999999994,"5min":1.026,"15min":1.026},"last":0.63600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575030,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306264,"kb_used_data":976,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065576,"statfs":{"total":96636764160,"available":96323149824,"internally_reserved":0,"allocated":999424,"data_stored":493775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40400000000000003,"15min":0.38800000000000001},"min":{"1min":0.31,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.57099999999999995,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":3.4729999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.42899999999999999,"15min":0.42699999999999999},"min":{"1min":0.33800000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58899999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":2.637}]},{"osd":1,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45300000000000001,"15min":0.44},"min":{"1min":0.36799999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.63800000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":6.1210000000000004},{"interface":"front","average":{"1min":0.505,"5min":0.47799999999999998,"15min":0.46700000000000003},"min":{"1min":0.33400000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.67500000000000004,"5min":1.206,"15min":1.206},"last":5.7270000000000003}]},{"osd":3,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38600000000000001,"15min":0.39700000000000002},"min":{"1min":0.27200000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.56200000000000006,"5min":0.63500000000000001,"15min":0.86199999999999999},"last":0.438},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.46000000000000002},"min":{"1min":0.40999999999999998,"5min":0.26900000000000002,"15min":0.26200000000000001},"max":{"1min":0.60099999999999998,"5min":1.226,"15min":1.226},"last":1.756}]},{"osd":4,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61899999999999999,"15min":0.60999999999999999},"min":{"1min":0.46100000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84699999999999998,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":8.7170000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.78500000000000003,"5min":1.492,"15min":1.492},"last":1.381}]},{"osd":5,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63400000000000001,"15min":0.629},"min":{"1min":0.503,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94699999999999995,"5min":0.996,"15min":0.996},"last":3.4359999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.623,"15min":0.624},"min":{"1min":0.48899999999999999,"5min":0.38900000000000001,"15min":0.38100000000000001},"max":{"1min":0.79900000000000004,"5min":1.292,"15min":1.292},"last":1.982}]},{"osd":6,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.625,"15min":0.621},"min":{"1min":0.47499999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.76600000000000001,"5min":1.359,"15min":1.359},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.53300000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.879,"5min":1.159,"15min":1.159},"last":1.861}]},{"osd":7,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.57299999999999995,"5min":0.45200000000000001,"15min":0.40300000000000002},"max":{"1min":0.88600000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":4.6849999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67600000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.41499999999999998},"max":{"1min":0.93100000000000005,"5min":1.125,"15min":1.125},"last":4.5039999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575029,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306220,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065620,"statfs":{"total":96636764160,"available":96323194880,"internally_reserved":0,"allocated":954368,"data_stored":472988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35799999999999998,"15min":0.36199999999999999},"min":{"1min":0.26800000000000002,"5min":0.219,"15min":0.217},"max":{"1min":0.47899999999999998,"5min":0.57699999999999996,"15min":0.66200000000000003},"last":0.377},{"interface":"front","average":{"1min":0.434,"5min":0.40699999999999997,"15min":0.40000000000000002},"min":{"1min":0.30199999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.57199999999999995,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.26700000000000002}]},{"osd":1,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.38,"15min":0.38600000000000001},"min":{"1min":0.30199999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.42199999999999999,"15min":0.42999999999999999},"min":{"1min":0.32300000000000001,"5min":0.26600000000000001,"15min":0.25900000000000001},"max":{"1min":0.54500000000000004,"5min":0.65900000000000003,"15min":0.84399999999999997},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.44400000000000001,"15min":0.44800000000000001},"min":{"1min":0.32800000000000001,"5min":0.28599999999999998,"15min":0.26000000000000001},"max":{"1min":0.66000000000000003,"5min":0.72999999999999998,"15min":0.94899999999999995},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.505,"15min":0.505},"min":{"1min":0.41199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.63700000000000001,"5min":1.054,"15min":1.054},"last":0.41199999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59699999999999998,"15min":0.60399999999999998},"min":{"1min":0.45000000000000001,"5min":0.35299999999999998,"15min":0.35099999999999998},"max":{"1min":0.75900000000000001,"5min":0.91500000000000004,"15min":0.97599999999999998},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.47299999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78300000000000003,"5min":0.86799999999999999,"15min":0.91400000000000003},"last":0.61699999999999999}]},{"osd":5,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.59099999999999997,"15min":0.61099999999999999},"min":{"1min":0.42599999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82299999999999995,"5min":0.85399999999999998,"15min":0.98399999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77500000000000002,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.68200000000000005}]},{"osd":6,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.626,"15min":0.64500000000000002},"min":{"1min":0.48699999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81200000000000006,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.627},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.49399999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81200000000000006,"5min":0.89500000000000002,"15min":1.0389999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65600000000000003,"15min":0.66600000000000004},"min":{"1min":0.503,"5min":0.40500000000000003,"15min":0.39100000000000001},"max":{"1min":0.83699999999999997,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64800000000000002,"15min":0.66000000000000003},"min":{"1min":0.49199999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.004},"last":0.60299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575029,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302124,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069716,"statfs":{"total":96636764160,"available":96327389184,"internally_reserved":0,"allocated":954368,"data_stored":472988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.52500000000000002,"15min":0.52800000000000002},"min":{"1min":0.30599999999999999,"5min":0.28299999999999997,"15min":0.27500000000000002},"max":{"1min":0.748,"5min":0.77700000000000002,"15min":0.80900000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.28399999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.81999999999999995,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.442}]},{"osd":1,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.25800000000000001},"max":{"1min":0.69699999999999995,"5min":0.73799999999999999,"15min":0.79600000000000004},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54500000000000004,"15min":0.54600000000000004},"min":{"1min":0.34499999999999997,"5min":0.317,"15min":0.246},"max":{"1min":0.72499999999999998,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.41199999999999998,"5min":0.376,"15min":0.27800000000000002},"max":{"1min":0.755,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.39600000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71099999999999997,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55000000000000004,"15min":0.54600000000000004},"min":{"1min":0.42599999999999999,"5min":0.34699999999999998,"15min":0.32900000000000001},"max":{"1min":0.71299999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.40999999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74299999999999999,"5min":0.78900000000000003,"15min":0.80600000000000005},"last":0.59399999999999997}]},{"osd":5,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.438,"15min":0.44700000000000001},"min":{"1min":0.32900000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.58099999999999996,"5min":1.272,"15min":1.272},"last":0.63},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46100000000000002,"15min":0.46400000000000002},"min":{"1min":0.34300000000000003,"5min":0.29899999999999999,"15min":0.29199999999999998},"max":{"1min":0.54000000000000004,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.501,"15min":0.505},"min":{"1min":0.38100000000000001,"5min":0.33900000000000002,"15min":0.314},"max":{"1min":0.63800000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54800000000000004,"15min":0.54000000000000004},"min":{"1min":0.45800000000000002,"5min":0.373,"15min":0.33800000000000002},"max":{"1min":0.61699999999999999,"5min":1.129,"15min":1.129},"last":0.75}]},{"osd":7,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34300000000000003,"5min":0.318,"15min":0.29899999999999999},"max":{"1min":0.66900000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.44900000000000001,"5min":0.38600000000000001,"15min":0.34599999999999997},"max":{"1min":0.70799999999999996,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.76700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575029,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302124,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069716,"statfs":{"total":96636764160,"available":96327389184,"internally_reserved":0,"allocated":954368,"data_stored":472988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53300000000000003,"15min":0.53600000000000003},"min":{"1min":0.40600000000000003,"5min":0.34399999999999997,"15min":0.32800000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.40899999999999997,"5min":0.31,"15min":0.31},"max":{"1min":0.70299999999999996,"5min":0.76200000000000001,"15min":0.81799999999999995},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52100000000000002,"15min":0.52800000000000002},"min":{"1min":0.35399999999999998,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.67100000000000004,"5min":0.69599999999999995,"15min":0.72399999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55000000000000004,"15min":0.54600000000000004},"min":{"1min":0.44900000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.745,"5min":0.754,"15min":0.77000000000000002},"last":0.45100000000000001}]},{"osd":2,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.40000000000000002,"5min":0.34399999999999997,"15min":0.30599999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.60099999999999998,"15min":0.59499999999999997},"min":{"1min":0.48699999999999999,"5min":0.378,"15min":0.34499999999999997},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.44800000000000001,"5min":0.36699999999999999,"15min":0.36399999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.73799999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.45600000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73299999999999998,"5min":0.79200000000000004,"15min":0.82099999999999995},"last":0.60499999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42399999999999999,"15min":0.44},"min":{"1min":0.307,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57699999999999996,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.372},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45800000000000002,"15min":0.46700000000000003},"min":{"1min":0.31900000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.77600000000000002},"last":0.39800000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47599999999999998,"15min":0.48599999999999999},"min":{"1min":0.34200000000000003,"5min":0.29599999999999999,"15min":0.28499999999999998},"max":{"1min":0.70499999999999996,"5min":0.73999999999999999,"15min":0.82099999999999995},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.67500000000000004,"5min":0.81399999999999995,"15min":0.88200000000000001},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52000000000000002,"15min":0.52600000000000002},"min":{"1min":0.33100000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.73899999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.41799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.84599999999999997},"last":0.43099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:22:25.354 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:22:25.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.500+0000 7f574ad9b700 1 Processor -- start 2023-11-30T17:22:25.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.501+0000 7f574ad9b700 1 -- start start 2023-11-30T17:22:25.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.501+0000 7f574ad9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f57441524a0 0x7f5744067a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:25.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.501+0000 7f574ad9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5744067f30 0x7f57440be8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:25.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.501+0000 7f574ad9b700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57440683e0 con 0x7f57441520c0 2023-11-30T17:22:25.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.501+0000 7f574ad9b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57440be110 con 0x7f5744067f30 2023-11-30T17:22:25.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.501+0000 7f574ad9b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5744066fc0 con 0x7f57441524a0 2023-11-30T17:22:25.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.502+0000 7f5748b37700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f57441520c0 0x7f5744066520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34092/0 (socket says 172.21.15.49:34092) 2023-11-30T17:22:25.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.502+0000 7f5748b37700 1 -- 172.21.15.49:0/3768616773 learned_addr learned my addr 172.21.15.49:0/3768616773 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:25.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.502+0000 7f57437fe700 1 -- 172.21.15.49:0/3768616773 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 99619394 0 0) 0x7f573c001290 con 0x7f57441520c0 2023-11-30T17:22:25.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.502+0000 7f5749338700 1 --2- 172.21.15.49:0/3768616773 >> v2:172.21.15.115:3300/0 conn(0x7f5744067f30 0x7f57440be8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:25.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.502+0000 7f57437fe700 1 -- 172.21.15.49:0/3768616773 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57300033f0 con 0x7f57441520c0 2023-11-30T17:22:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.502+0000 7f5743fff700 1 --2- 172.21.15.49:0/3768616773 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f57441524a0 0x7f5744067a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.502+0000 7f57437fe700 1 -- 172.21.15.49:0/3768616773 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3170551555 0 0) 0x7f57300033f0 con 0x7f57441520c0 2023-11-30T17:22:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.502+0000 7f57437fe700 1 -- 172.21.15.49:0/3768616773 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f57441524a0 msgr2=0x7f5744067a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.502+0000 7f57437fe700 1 --2- 172.21.15.49:0/3768616773 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f57441524a0 0x7f5744067a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.502+0000 7f57437fe700 1 -- 172.21.15.49:0/3768616773 >> v2:172.21.15.115:3300/0 conn(0x7f5744067f30 msgr2=0x7f57440be8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.502+0000 7f57437fe700 1 --2- 172.21.15.49:0/3768616773 >> v2:172.21.15.115:3300/0 conn(0x7f5744067f30 0x7f57440be8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.502+0000 7f57437fe700 1 -- 172.21.15.49:0/3768616773 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57440672a0 con 0x7f57441520c0 2023-11-30T17:22:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.502+0000 7f57437fe700 1 -- 172.21.15.49:0/3768616773 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f573c001780 con 0x7f57441520c0 2023-11-30T17:22:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.502+0000 7f57437fe700 1 -- 172.21.15.49:0/3768616773 >> v1:172.21.15.49:6789/0 conn(0x7f57441520c0 legacy=0x7f5744066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.502+0000 7f57437fe700 1 --2- 172.21.15.49:0/3768616773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57300038e0 0x7f5730003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.502+0000 7f57437fe700 1 --2- 172.21.15.49:0/3768616773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5730004690 0x7f5730004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.502+0000 7f57437fe700 1 --2- 172.21.15.49:0/3768616773 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5730005000 0x7f573000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.502+0000 7f57437fe700 1 -- 172.21.15.49:0/3768616773 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57440be110 con 0x7f5730004690 2023-11-30T17:22:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.502+0000 7f57437fe700 1 -- 172.21.15.49:0/3768616773 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5744066fc0 con 0x7f57300038e0 2023-11-30T17:22:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.502+0000 7f57437fe700 1 -- 172.21.15.49:0/3768616773 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573000be20 con 0x7f5730005000 2023-11-30T17:22:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.502+0000 7f5749338700 1 --2- 172.21.15.49:0/3768616773 >> v2:172.21.15.115:3300/0 conn(0x7f5744067f30 0x7f57440be8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.502+0000 7f5743fff700 1 --2- 172.21.15.49:0/3768616773 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f57441524a0 0x7f5744067a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.502+0000 7f5743fff700 1 --2- 172.21.15.49:0/3768616773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5730004690 0x7f5730004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.502+0000 7f5749338700 1 --2- 172.21.15.49:0/3768616773 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5730005000 0x7f573000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.502+0000 7f5748b37700 1 --2- 172.21.15.49:0/3768616773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57300038e0 0x7f5730003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.503+0000 7f5743fff700 1 -- 172.21.15.49:0/3768616773 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5730005000 msgr2=0x7f573000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.503+0000 7f5743fff700 1 --2- 172.21.15.49:0/3768616773 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5730005000 0x7f573000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.503+0000 7f5743fff700 1 -- 172.21.15.49:0/3768616773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57300038e0 msgr2=0x7f5730003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.503+0000 7f5743fff700 1 --2- 172.21.15.49:0/3768616773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57300038e0 0x7f5730003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.503+0000 7f5743fff700 1 -- 172.21.15.49:0/3768616773 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57300033f0 con 0x7f5730004690 2023-11-30T17:22:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.503+0000 7f5743fff700 1 --2- 172.21.15.49:0/3768616773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5730004690 0x7f5730004b10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f5744152920 tx=0x7f5734009720).ready entity=mon.0 client_cookie=1faf3c28d470c101 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.503+0000 7f57437fe700 1 -- 172.21.15.49:0/3768616773 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5734009a30 con 0x7f5730004690 2023-11-30T17:22:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.503+0000 7f57437fe700 1 -- 172.21.15.49:0/3768616773 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573400f040 con 0x7f5730004690 2023-11-30T17:22:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.503+0000 7f57437fe700 1 -- 172.21.15.49:0/3768616773 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5734007df0 con 0x7f5730004690 2023-11-30T17:22:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.503+0000 7f574ad9b700 1 -- 172.21.15.49:0/3768616773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5730004690 msgr2=0x7f5730004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:25.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.503+0000 7f574ad9b700 1 --2- 172.21.15.49:0/3768616773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5730004690 0x7f5730004b10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f5744152920 tx=0x7f5734009720).stop 2023-11-30T17:22:25.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.503+0000 7f5749338700 1 -- 172.21.15.49:0/3768616773 reap_dead start 2023-11-30T17:22:25.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.503+0000 7f574ad9b700 1 -- 172.21.15.49:0/3768616773 shutdown_connections 2023-11-30T17:22:25.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.503+0000 7f574ad9b700 1 -- 172.21.15.49:0/3768616773 >> 172.21.15.49:0/3768616773 conn(0x7f57440631d0 msgr2=0x7f57440c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:25.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.503+0000 7f574ad9b700 1 -- 172.21.15.49:0/3768616773 shutdown_connections 2023-11-30T17:22:25.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.504+0000 7f574ad9b700 1 -- 172.21.15.49:0/3768616773 wait complete. 2023-11-30T17:22:25.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.505+0000 7f574ad9b700 1 Processor -- start 2023-11-30T17:22:25.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.505+0000 7f574ad9b700 1 -- start start 2023-11-30T17:22:25.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.505+0000 7f574ad9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5730004690 0x7f5744165020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.505+0000 7f574ad9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5744063bc0 0x7f574414cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.506+0000 7f574ad9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5744095e80 0x7f57440962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.506+0000 7f574ad9b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57440651e0 con 0x7f5730004690 2023-11-30T17:22:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.506+0000 7f574ad9b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57440967d0 con 0x7f5744063bc0 2023-11-30T17:22:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.506+0000 7f574ad9b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5744064140 con 0x7f5744095e80 2023-11-30T17:22:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.506+0000 7f5748b37700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5730004690 0x7f5744165020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.506+0000 7f5748b37700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5730004690 0x7f5744165020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53782/0 (socket says 172.21.15.49:53782) 2023-11-30T17:22:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.506+0000 7f5748b37700 1 -- 172.21.15.49:0/4048661853 learned_addr learned my addr 172.21.15.49:0/4048661853 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.506+0000 7f5743fff700 1 --2- 172.21.15.49:0/4048661853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5744063bc0 0x7f574414cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.506+0000 7f5749338700 1 --2- 172.21.15.49:0/4048661853 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5744095e80 0x7f57440962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.506+0000 7f5748b37700 1 -- 172.21.15.49:0/4048661853 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5744095e80 msgr2=0x7f57440962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.506+0000 7f5748b37700 1 --2- 172.21.15.49:0/4048661853 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5744095e80 0x7f57440962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.506+0000 7f5748b37700 1 -- 172.21.15.49:0/4048661853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5744063bc0 msgr2=0x7f574414cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.506+0000 7f5748b37700 1 --2- 172.21.15.49:0/4048661853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5744063bc0 0x7f574414cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:25.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.506+0000 7f5748b37700 1 -- 172.21.15.49:0/4048661853 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5744064420 con 0x7f5730004690 2023-11-30T17:22:25.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.506+0000 7f5748b37700 1 --2- 172.21.15.49:0/4048661853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5730004690 0x7f5744165020 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f573c001020 tx=0x7f573c007930).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:25.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.506+0000 7f5740ff9700 1 -- 172.21.15.49:0/4048661853 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c000c30 con 0x7f5730004690 2023-11-30T17:22:25.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.506+0000 7f5740ff9700 1 -- 172.21.15.49:0/4048661853 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573c011590 con 0x7f5730004690 2023-11-30T17:22:25.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.506+0000 7f574ad9b700 1 -- 172.21.15.49:0/4048661853 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5744064700 con 0x7f5730004690 2023-11-30T17:22:25.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.506+0000 7f5740ff9700 1 -- 172.21.15.49:0/4048661853 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c011910 con 0x7f5730004690 2023-11-30T17:22:25.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.506+0000 7f574ad9b700 1 -- 172.21.15.49:0/4048661853 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5744064cc0 con 0x7f5730004690 2023-11-30T17:22:25.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.507+0000 7f574ad9b700 1 -- 172.21.15.49:0/4048661853 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5744064ee0 con 0x7f5730004690 2023-11-30T17:22:25.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.508+0000 7f5740ff9700 1 -- 172.21.15.49:0/4048661853 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f573c011cc0 con 0x7f5730004690 2023-11-30T17:22:25.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.508+0000 7f5740ff9700 1 --2- 172.21.15.49:0/4048661853 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f572405f270 0x7f5724061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:25.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.508+0000 7f5740ff9700 1 -- 172.21.15.49:0/4048661853 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f573c079cc0 con 0x7f5730004690 2023-11-30T17:22:25.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.508+0000 7f5743fff700 1 --2- 172.21.15.49:0/4048661853 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f572405f270 0x7f5724061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:25.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.509+0000 7f5743fff700 1 --2- 172.21.15.49:0/4048661853 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f572405f270 0x7f5724061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f5734009e00 tx=0x7f5734017000).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:25.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.512+0000 7f5740ff9700 1 -- 172.21.15.49:0/4048661853 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f573c049b00 con 0x7f5730004690 2023-11-30T17:22:25.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.679+0000 7f574ad9b700 1 -- 172.21.15.49:0/4048661853 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f57440683e0 con 0x7f572405f270 2023-11-30T17:22:25.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.689+0000 7f5740ff9700 1 -- 172.21.15.49:0/4048661853 <== mgr.5926 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353936 (secure 0 0 0) 0x7f57440683e0 con 0x7f572405f270 2023-11-30T17:22:25.695 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:25.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.692+0000 7f574ad9b700 1 -- 172.21.15.49:0/4048661853 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f572405f270 msgr2=0x7f5724061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:25.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.692+0000 7f574ad9b700 1 --2- 172.21.15.49:0/4048661853 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f572405f270 0x7f5724061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f5734009e00 tx=0x7f5734017000).stop 2023-11-30T17:22:25.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.692+0000 7f574ad9b700 1 -- 172.21.15.49:0/4048661853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5730004690 msgr2=0x7f5744165020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:25.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.692+0000 7f574ad9b700 1 --2- 172.21.15.49:0/4048661853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5730004690 0x7f5744165020 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f573c001020 tx=0x7f573c007930).stop 2023-11-30T17:22:25.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.692+0000 7f574ad9b700 1 -- 172.21.15.49:0/4048661853 shutdown_connections 2023-11-30T17:22:25.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.692+0000 7f574ad9b700 1 --2- 172.21.15.49:0/4048661853 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5744095e80 0x7f57440962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:25.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.692+0000 7f574ad9b700 1 --2- 172.21.15.49:0/4048661853 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f572405f270 0x7f5724061730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:25.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.692+0000 7f574ad9b700 1 --2- 172.21.15.49:0/4048661853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5730004690 0x7f5744165020 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:25.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.692+0000 7f574ad9b700 1 --2- 172.21.15.49:0/4048661853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5744063bc0 0x7f574414cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:25.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.692+0000 7f574ad9b700 1 -- 172.21.15.49:0/4048661853 >> 172.21.15.49:0/4048661853 conn(0x7f57440631d0 msgr2=0x7f574414dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:25.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.692+0000 7f574ad9b700 1 -- 172.21.15.49:0/4048661853 shutdown_connections 2023-11-30T17:22:25.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.692+0000 7f574ad9b700 1 -- 172.21.15.49:0/4048661853 wait complete. 2023-11-30T17:22:25.698 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:22:25.706 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-30T17:22:24.231193+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1268,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":98,"acting":98,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":113,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2421232,"kb_used_data":7600,"kb_used_omap":0,"kb_used_meta":2413568,"kb_avail":752553488,"statfs":{"total":773094113280,"available":770614771712,"internally_reserved":0,"allocated":7782400,"data_stored":3853328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2471493632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-28927,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-83,"num_write_kb":-68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.010859"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3f","version":"82'3","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.329667+0000","last_change":"2023-11-30T17:22:20.929205+0000","last_active":"2023-11-30T17:22:21.329667+0000","last_peered":"2023-11-30T17:22:21.329667+0000","last_clean":"2023-11-30T17:22:21.329667+0000","last_became_active":"2023-11-30T17:22:20.928896+0000","last_became_peered":"2023-11-30T17:22:20.928896+0000","last_unstale":"2023-11-30T17:22:21.329667+0000","last_undegraded":"2023-11-30T17:22:21.329667+0000","last_fullsized":"2023-11-30T17:22:21.329667+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.333605+0000","last_change":"2023-11-30T17:22:21.332725+0000","last_active":"2023-11-30T17:22:21.333605+0000","last_peered":"2023-11-30T17:22:21.333605+0000","last_clean":"2023-11-30T17:22:21.333605+0000","last_became_active":"2023-11-30T17:22:21.332417+0000","last_became_peered":"2023-11-30T17:22:21.332417+0000","last_unstale":"2023-11-30T17:22:21.333605+0000","last_undegraded":"2023-11-30T17:22:21.333605+0000","last_fullsized":"2023-11-30T17:22:21.333605+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.333314+0000","last_change":"2023-11-30T17:22:21.331441+0000","last_active":"2023-11-30T17:22:21.333314+0000","last_peered":"2023-11-30T17:22:21.333314+0000","last_clean":"2023-11-30T17:22:21.333314+0000","last_became_active":"2023-11-30T17:22:21.330964+0000","last_became_peered":"2023-11-30T17:22:21.330964+0000","last_unstale":"2023-11-30T17:22:21.333314+0000","last_undegraded":"2023-11-30T17:22:21.333314+0000","last_fullsized":"2023-11-30T17:22:21.333314+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.333885+0000","last_change":"2023-11-30T17:22:20.926229+0000","last_active":"2023-11-30T17:22:21.333885+0000","last_peered":"2023-11-30T17:22:21.333885+0000","last_clean":"2023-11-30T17:22:21.333885+0000","last_became_active":"2023-11-30T17:22:20.925910+0000","last_became_peered":"2023-11-30T17:22:20.925910+0000","last_unstale":"2023-11-30T17:22:21.333885+0000","last_undegraded":"2023-11-30T17:22:21.333885+0000","last_fullsized":"2023-11-30T17:22:21.333885+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335733+0000","last_change":"2023-11-30T17:22:21.332864+0000","last_active":"2023-11-30T17:22:21.335733+0000","last_peered":"2023-11-30T17:22:21.335733+0000","last_clean":"2023-11-30T17:22:21.335733+0000","last_became_active":"2023-11-30T17:22:21.332589+0000","last_became_peered":"2023-11-30T17:22:21.332589+0000","last_unstale":"2023-11-30T17:22:21.335733+0000","last_undegraded":"2023-11-30T17:22:21.335733+0000","last_fullsized":"2023-11-30T17:22:21.335733+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337303+0000","last_change":"2023-11-30T17:22:20.929809+0000","last_active":"2023-11-30T17:22:21.337303+0000","last_peered":"2023-11-30T17:22:21.337303+0000","last_clean":"2023-11-30T17:22:21.337303+0000","last_became_active":"2023-11-30T17:22:20.929506+0000","last_became_peered":"2023-11-30T17:22:20.929506+0000","last_unstale":"2023-11-30T17:22:21.337303+0000","last_undegraded":"2023-11-30T17:22:21.337303+0000","last_fullsized":"2023-11-30T17:22:21.337303+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335363+0000","last_change":"2023-11-30T17:22:21.332342+0000","last_active":"2023-11-30T17:22:21.335363+0000","last_peered":"2023-11-30T17:22:21.335363+0000","last_clean":"2023-11-30T17:22:21.335363+0000","last_became_active":"2023-11-30T17:22:21.321851+0000","last_became_peered":"2023-11-30T17:22:21.321851+0000","last_unstale":"2023-11-30T17:22:21.335363+0000","last_undegraded":"2023-11-30T17:22:21.335363+0000","last_fullsized":"2023-11-30T17:22:21.335363+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.316483+0000","last_change":"2023-11-30T17:22:20.928501+0000","last_active":"2023-11-30T17:22:21.316483+0000","last_peered":"2023-11-30T17:22:21.316483+0000","last_clean":"2023-11-30T17:22:21.316483+0000","last_became_active":"2023-11-30T17:22:20.928198+0000","last_became_peered":"2023-11-30T17:22:20.928198+0000","last_unstale":"2023-11-30T17:22:21.316483+0000","last_undegraded":"2023-11-30T17:22:21.316483+0000","last_fullsized":"2023-11-30T17:22:21.316483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.316312+0000","last_change":"2023-11-30T17:22:20.932648+0000","last_active":"2023-11-30T17:22:21.316312+0000","last_peered":"2023-11-30T17:22:21.316312+0000","last_clean":"2023-11-30T17:22:21.316312+0000","last_became_active":"2023-11-30T17:22:20.932328+0000","last_became_peered":"2023-11-30T17:22:20.932328+0000","last_unstale":"2023-11-30T17:22:21.316312+0000","last_undegraded":"2023-11-30T17:22:21.316312+0000","last_fullsized":"2023-11-30T17:22:21.316312+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.336734+0000","last_change":"2023-11-30T17:22:21.334427+0000","last_active":"2023-11-30T17:22:21.336734+0000","last_peered":"2023-11-30T17:22:21.336734+0000","last_clean":"2023-11-30T17:22:21.336734+0000","last_became_active":"2023-11-30T17:22:21.334056+0000","last_became_peered":"2023-11-30T17:22:21.334056+0000","last_unstale":"2023-11-30T17:22:21.336734+0000","last_undegraded":"2023-11-30T17:22:21.336734+0000","last_fullsized":"2023-11-30T17:22:21.336734+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"82'4","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.339175+0000","last_change":"2023-11-30T17:22:20.929041+0000","last_active":"2023-11-30T17:22:21.339175+0000","last_peered":"2023-11-30T17:22:21.339175+0000","last_clean":"2023-11-30T17:22:21.339175+0000","last_became_active":"2023-11-30T17:22:20.928561+0000","last_became_peered":"2023-11-30T17:22:20.928561+0000","last_unstale":"2023-11-30T17:22:21.339175+0000","last_undegraded":"2023-11-30T17:22:21.339175+0000","last_fullsized":"2023-11-30T17:22:21.339175+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.331614+0000","last_change":"2023-11-30T17:22:20.930348+0000","last_active":"2023-11-30T17:22:21.331614+0000","last_peered":"2023-11-30T17:22:21.331614+0000","last_clean":"2023-11-30T17:22:21.331614+0000","last_became_active":"2023-11-30T17:22:20.930051+0000","last_became_peered":"2023-11-30T17:22:20.930051+0000","last_unstale":"2023-11-30T17:22:21.331614+0000","last_undegraded":"2023-11-30T17:22:21.331614+0000","last_fullsized":"2023-11-30T17:22:21.331614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337301+0000","last_change":"2023-11-30T17:22:21.336482+0000","last_active":"2023-11-30T17:22:21.337301+0000","last_peered":"2023-11-30T17:22:21.337301+0000","last_clean":"2023-11-30T17:22:21.337301+0000","last_became_active":"2023-11-30T17:22:21.336197+0000","last_became_peered":"2023-11-30T17:22:21.336197+0000","last_unstale":"2023-11-30T17:22:21.337301+0000","last_undegraded":"2023-11-30T17:22:21.337301+0000","last_fullsized":"2023-11-30T17:22:21.337301+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.333437+0000","last_change":"2023-11-30T17:22:21.330564+0000","last_active":"2023-11-30T17:22:21.333437+0000","last_peered":"2023-11-30T17:22:21.333437+0000","last_clean":"2023-11-30T17:22:21.333437+0000","last_became_active":"2023-11-30T17:22:21.329983+0000","last_became_peered":"2023-11-30T17:22:21.329983+0000","last_unstale":"2023-11-30T17:22:21.333437+0000","last_undegraded":"2023-11-30T17:22:21.333437+0000","last_fullsized":"2023-11-30T17:22:21.333437+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.323406+0000","last_change":"2023-11-30T17:22:20.931253+0000","last_active":"2023-11-30T17:22:21.323406+0000","last_peered":"2023-11-30T17:22:21.323406+0000","last_clean":"2023-11-30T17:22:21.323406+0000","last_became_active":"2023-11-30T17:22:20.930953+0000","last_became_peered":"2023-11-30T17:22:20.930953+0000","last_unstale":"2023-11-30T17:22:21.323406+0000","last_undegraded":"2023-11-30T17:22:21.323406+0000","last_fullsized":"2023-11-30T17:22:21.323406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.314552+0000","last_change":"2023-11-30T17:22:20.934622+0000","last_active":"2023-11-30T17:22:21.314552+0000","last_peered":"2023-11-30T17:22:21.314552+0000","last_clean":"2023-11-30T17:22:21.314552+0000","last_became_active":"2023-11-30T17:22:20.934343+0000","last_became_peered":"2023-11-30T17:22:20.934343+0000","last_unstale":"2023-11-30T17:22:21.314552+0000","last_undegraded":"2023-11-30T17:22:21.314552+0000","last_fullsized":"2023-11-30T17:22:21.314552+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.322388+0000","last_change":"2023-11-30T17:22:20.932327+0000","last_active":"2023-11-30T17:22:21.322388+0000","last_peered":"2023-11-30T17:22:21.322388+0000","last_clean":"2023-11-30T17:22:21.322388+0000","last_became_active":"2023-11-30T17:22:20.932056+0000","last_became_peered":"2023-11-30T17:22:20.932056+0000","last_unstale":"2023-11-30T17:22:21.322388+0000","last_undegraded":"2023-11-30T17:22:21.322388+0000","last_fullsized":"2023-11-30T17:22:21.322388+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335152+0000","last_change":"2023-11-30T17:22:21.333765+0000","last_active":"2023-11-30T17:22:21.335152+0000","last_peered":"2023-11-30T17:22:21.335152+0000","last_clean":"2023-11-30T17:22:21.335152+0000","last_became_active":"2023-11-30T17:22:21.333449+0000","last_became_peered":"2023-11-30T17:22:21.333449+0000","last_unstale":"2023-11-30T17:22:21.335152+0000","last_undegraded":"2023-11-30T17:22:21.335152+0000","last_fullsized":"2023-11-30T17:22:21.335152+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.322384+0000","last_change":"2023-11-30T17:22:20.921100+0000","last_active":"2023-11-30T17:22:21.322384+0000","last_peered":"2023-11-30T17:22:21.322384+0000","last_clean":"2023-11-30T17:22:21.322384+0000","last_became_active":"2023-11-30T17:22:20.920818+0000","last_became_peered":"2023-11-30T17:22:20.920818+0000","last_unstale":"2023-11-30T17:22:21.322384+0000","last_undegraded":"2023-11-30T17:22:21.322384+0000","last_fullsized":"2023-11-30T17:22:21.322384+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.313733+0000","last_change":"2023-11-30T17:22:20.928872+0000","last_active":"2023-11-30T17:22:21.313733+0000","last_peered":"2023-11-30T17:22:21.313733+0000","last_clean":"2023-11-30T17:22:21.313733+0000","last_became_active":"2023-11-30T17:22:20.928246+0000","last_became_peered":"2023-11-30T17:22:20.928246+0000","last_unstale":"2023-11-30T17:22:21.313733+0000","last_undegraded":"2023-11-30T17:22:21.313733+0000","last_fullsized":"2023-11-30T17:22:21.313733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.334940+0000","last_change":"2023-11-30T17:22:20.932827+0000","last_active":"2023-11-30T17:22:21.334940+0000","last_peered":"2023-11-30T17:22:21.334940+0000","last_clean":"2023-11-30T17:22:21.334940+0000","last_became_active":"2023-11-30T17:22:20.932116+0000","last_became_peered":"2023-11-30T17:22:20.932116+0000","last_unstale":"2023-11-30T17:22:21.334940+0000","last_undegraded":"2023-11-30T17:22:21.334940+0000","last_fullsized":"2023-11-30T17:22:21.334940+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337106+0000","last_change":"2023-11-30T17:22:20.932467+0000","last_active":"2023-11-30T17:22:21.337106+0000","last_peered":"2023-11-30T17:22:21.337106+0000","last_clean":"2023-11-30T17:22:21.337106+0000","last_became_active":"2023-11-30T17:22:20.932190+0000","last_became_peered":"2023-11-30T17:22:20.932190+0000","last_unstale":"2023-11-30T17:22:21.337106+0000","last_undegraded":"2023-11-30T17:22:21.337106+0000","last_fullsized":"2023-11-30T17:22:21.337106+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.334353+0000","last_change":"2023-11-30T17:22:21.331875+0000","last_active":"2023-11-30T17:22:21.334353+0000","last_peered":"2023-11-30T17:22:21.334353+0000","last_clean":"2023-11-30T17:22:21.334353+0000","last_became_active":"2023-11-30T17:22:21.328825+0000","last_became_peered":"2023-11-30T17:22:21.328825+0000","last_unstale":"2023-11-30T17:22:21.334353+0000","last_undegraded":"2023-11-30T17:22:21.334353+0000","last_fullsized":"2023-11-30T17:22:21.334353+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335533+0000","last_change":"2023-11-30T17:22:20.936705+0000","last_active":"2023-11-30T17:22:21.335533+0000","last_peered":"2023-11-30T17:22:21.335533+0000","last_clean":"2023-11-30T17:22:21.335533+0000","last_became_active":"2023-11-30T17:22:20.936118+0000","last_became_peered":"2023-11-30T17:22:20.936118+0000","last_unstale":"2023-11-30T17:22:21.335533+0000","last_undegraded":"2023-11-30T17:22:21.335533+0000","last_fullsized":"2023-11-30T17:22:21.335533+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.314520+0000","last_change":"2023-11-30T17:22:20.930005+0000","last_active":"2023-11-30T17:22:21.314520+0000","last_peered":"2023-11-30T17:22:21.314520+0000","last_clean":"2023-11-30T17:22:21.314520+0000","last_became_active":"2023-11-30T17:22:20.929725+0000","last_became_peered":"2023-11-30T17:22:20.929725+0000","last_unstale":"2023-11-30T17:22:21.314520+0000","last_undegraded":"2023-11-30T17:22:21.314520+0000","last_fullsized":"2023-11-30T17:22:21.314520+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.331499+0000","last_change":"2023-11-30T17:22:21.327241+0000","last_active":"2023-11-30T17:22:21.331499+0000","last_peered":"2023-11-30T17:22:21.331499+0000","last_clean":"2023-11-30T17:22:21.331499+0000","last_became_active":"2023-11-30T17:22:21.326987+0000","last_became_peered":"2023-11-30T17:22:21.326987+0000","last_unstale":"2023-11-30T17:22:21.331499+0000","last_undegraded":"2023-11-30T17:22:21.331499+0000","last_fullsized":"2023-11-30T17:22:21.331499+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337309+0000","last_change":"2023-11-30T17:22:21.336465+0000","last_active":"2023-11-30T17:22:21.337309+0000","last_peered":"2023-11-30T17:22:21.337309+0000","last_clean":"2023-11-30T17:22:21.337309+0000","last_became_active":"2023-11-30T17:22:21.336172+0000","last_became_peered":"2023-11-30T17:22:21.336172+0000","last_unstale":"2023-11-30T17:22:21.337309+0000","last_undegraded":"2023-11-30T17:22:21.337309+0000","last_fullsized":"2023-11-30T17:22:21.337309+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.333412+0000","last_change":"2023-11-30T17:22:21.330374+0000","last_active":"2023-11-30T17:22:21.333412+0000","last_peered":"2023-11-30T17:22:21.333412+0000","last_clean":"2023-11-30T17:22:21.333412+0000","last_became_active":"2023-11-30T17:22:21.329939+0000","last_became_peered":"2023-11-30T17:22:21.329939+0000","last_unstale":"2023-11-30T17:22:21.333412+0000","last_undegraded":"2023-11-30T17:22:21.333412+0000","last_fullsized":"2023-11-30T17:22:21.333412+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337727+0000","last_change":"2023-11-30T17:22:20.931360+0000","last_active":"2023-11-30T17:22:21.337727+0000","last_peered":"2023-11-30T17:22:21.337727+0000","last_clean":"2023-11-30T17:22:21.337727+0000","last_became_active":"2023-11-30T17:22:20.930703+0000","last_became_peered":"2023-11-30T17:22:20.930703+0000","last_unstale":"2023-11-30T17:22:21.337727+0000","last_undegraded":"2023-11-30T17:22:21.337727+0000","last_fullsized":"2023-11-30T17:22:21.337727+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.328012+0000","last_change":"2023-11-30T17:22:21.324414+0000","last_active":"2023-11-30T17:22:21.328012+0000","last_peered":"2023-11-30T17:22:21.328012+0000","last_clean":"2023-11-30T17:22:21.328012+0000","last_became_active":"2023-11-30T17:22:21.324180+0000","last_became_peered":"2023-11-30T17:22:21.324180+0000","last_unstale":"2023-11-30T17:22:21.328012+0000","last_undegraded":"2023-11-30T17:22:21.328012+0000","last_fullsized":"2023-11-30T17:22:21.328012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337931+0000","last_change":"2023-11-30T17:22:21.337197+0000","last_active":"2023-11-30T17:22:21.337931+0000","last_peered":"2023-11-30T17:22:21.337931+0000","last_clean":"2023-11-30T17:22:21.337931+0000","last_became_active":"2023-11-30T17:22:21.336585+0000","last_became_peered":"2023-11-30T17:22:21.336585+0000","last_unstale":"2023-11-30T17:22:21.337931+0000","last_undegraded":"2023-11-30T17:22:21.337931+0000","last_fullsized":"2023-11-30T17:22:21.337931+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335963+0000","last_change":"2023-11-30T17:22:21.333694+0000","last_active":"2023-11-30T17:22:21.335963+0000","last_peered":"2023-11-30T17:22:21.335963+0000","last_clean":"2023-11-30T17:22:21.335963+0000","last_became_active":"2023-11-30T17:22:21.333507+0000","last_became_peered":"2023-11-30T17:22:21.333507+0000","last_unstale":"2023-11-30T17:22:21.335963+0000","last_undegraded":"2023-11-30T17:22:21.335963+0000","last_fullsized":"2023-11-30T17:22:21.335963+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.314720+0000","last_change":"2023-11-30T17:22:20.936879+0000","last_active":"2023-11-30T17:22:21.314720+0000","last_peered":"2023-11-30T17:22:21.314720+0000","last_clean":"2023-11-30T17:22:21.314720+0000","last_became_active":"2023-11-30T17:22:20.936480+0000","last_became_peered":"2023-11-30T17:22:20.936480+0000","last_unstale":"2023-11-30T17:22:21.314720+0000","last_undegraded":"2023-11-30T17:22:21.314720+0000","last_fullsized":"2023-11-30T17:22:21.314720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.315988+0000","last_change":"2023-11-30T17:22:20.931107+0000","last_active":"2023-11-30T17:22:21.315988+0000","last_peered":"2023-11-30T17:22:21.315988+0000","last_clean":"2023-11-30T17:22:21.315988+0000","last_became_active":"2023-11-30T17:22:20.930305+0000","last_became_peered":"2023-11-30T17:22:20.930305+0000","last_unstale":"2023-11-30T17:22:21.315988+0000","last_undegraded":"2023-11-30T17:22:21.315988+0000","last_fullsized":"2023-11-30T17:22:21.315988+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.328239+0000","last_change":"2023-11-30T17:22:21.326066+0000","last_active":"2023-11-30T17:22:21.328239+0000","last_peered":"2023-11-30T17:22:21.328239+0000","last_clean":"2023-11-30T17:22:21.328239+0000","last_became_active":"2023-11-30T17:22:21.325745+0000","last_became_peered":"2023-11-30T17:22:21.325745+0000","last_unstale":"2023-11-30T17:22:21.328239+0000","last_undegraded":"2023-11-30T17:22:21.328239+0000","last_fullsized":"2023-11-30T17:22:21.328239+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.336712+0000","last_change":"2023-11-30T17:22:21.334589+0000","last_active":"2023-11-30T17:22:21.336712+0000","last_peered":"2023-11-30T17:22:21.336712+0000","last_clean":"2023-11-30T17:22:21.336712+0000","last_became_active":"2023-11-30T17:22:21.334131+0000","last_became_peered":"2023-11-30T17:22:21.334131+0000","last_unstale":"2023-11-30T17:22:21.336712+0000","last_undegraded":"2023-11-30T17:22:21.336712+0000","last_fullsized":"2023-11-30T17:22:21.336712+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.315239+0000","last_change":"2023-11-30T17:22:20.929746+0000","last_active":"2023-11-30T17:22:21.315239+0000","last_peered":"2023-11-30T17:22:21.315239+0000","last_clean":"2023-11-30T17:22:21.315239+0000","last_became_active":"2023-11-30T17:22:20.929451+0000","last_became_peered":"2023-11-30T17:22:20.929451+0000","last_unstale":"2023-11-30T17:22:21.315239+0000","last_undegraded":"2023-11-30T17:22:21.315239+0000","last_fullsized":"2023-11-30T17:22:21.315239+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.316069+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:22:21.316069+0000","last_peered":"2023-11-30T17:22:21.316069+0000","last_clean":"2023-11-30T17:22:21.316069+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:22:21.316069+0000","last_undegraded":"2023-11-30T17:22:21.316069+0000","last_fullsized":"2023-11-30T17:22:21.316069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.313395+0000","last_change":"2023-11-30T17:22:20.931616+0000","last_active":"2023-11-30T17:22:21.313395+0000","last_peered":"2023-11-30T17:22:21.313395+0000","last_clean":"2023-11-30T17:22:21.313395+0000","last_became_active":"2023-11-30T17:22:20.931340+0000","last_became_peered":"2023-11-30T17:22:20.931340+0000","last_unstale":"2023-11-30T17:22:21.313395+0000","last_undegraded":"2023-11-30T17:22:21.313395+0000","last_fullsized":"2023-11-30T17:22:21.313395+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-30T17:22:16.265099+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:22:16.265099+0000","last_peered":"2023-11-30T17:22:16.265099+0000","last_clean":"2023-11-30T17:22:16.265099+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:22:16.265099+0000","last_undegraded":"2023-11-30T17:22:16.265099+0000","last_fullsized":"2023-11-30T17:22:16.265099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.322565+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:22:21.322565+0000","last_peered":"2023-11-30T17:22:21.322565+0000","last_clean":"2023-11-30T17:22:21.322565+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:22:21.322565+0000","last_undegraded":"2023-11-30T17:22:21.322565+0000","last_fullsized":"2023-11-30T17:22:21.322565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":62,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-30T17:22:16.265097+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:22:16.265097+0000","last_peered":"2023-11-30T17:22:16.265097+0000","last_clean":"2023-11-30T17:22:16.265097+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:22:16.265097+0000","last_undegraded":"2023-11-30T17:22:16.265097+0000","last_fullsized":"2023-11-30T17:22:16.265097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":64,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-30T17:22:17.004721+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:22:17.004721+0000","last_peered":"2023-11-30T17:22:17.004721+0000","last_clean":"2023-11-30T17:22:17.004721+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:22:17.004721+0000","last_undegraded":"2023-11-30T17:22:17.004721+0000","last_fullsized":"2023-11-30T17:22:17.004721+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335131+0000","last_change":"2023-11-30T17:22:21.332384+0000","last_active":"2023-11-30T17:22:21.335131+0000","last_peered":"2023-11-30T17:22:21.335131+0000","last_clean":"2023-11-30T17:22:21.335131+0000","last_became_active":"2023-11-30T17:22:21.332098+0000","last_became_peered":"2023-11-30T17:22:21.332098+0000","last_unstale":"2023-11-30T17:22:21.335131+0000","last_undegraded":"2023-11-30T17:22:21.335131+0000","last_fullsized":"2023-11-30T17:22:21.335131+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337701+0000","last_change":"2023-11-30T17:22:20.934641+0000","last_active":"2023-11-30T17:22:21.337701+0000","last_peered":"2023-11-30T17:22:21.337701+0000","last_clean":"2023-11-30T17:22:21.337701+0000","last_became_active":"2023-11-30T17:22:20.934355+0000","last_became_peered":"2023-11-30T17:22:20.934355+0000","last_unstale":"2023-11-30T17:22:21.337701+0000","last_undegraded":"2023-11-30T17:22:21.337701+0000","last_fullsized":"2023-11-30T17:22:21.337701+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-30T17:22:17.004656+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:22:17.004656+0000","last_peered":"2023-11-30T17:22:17.004656+0000","last_clean":"2023-11-30T17:22:17.004656+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:22:17.004656+0000","last_undegraded":"2023-11-30T17:22:17.004656+0000","last_fullsized":"2023-11-30T17:22:17.004656+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":62,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-30T17:22:17.004678+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:22:17.004678+0000","last_peered":"2023-11-30T17:22:17.004678+0000","last_clean":"2023-11-30T17:22:17.004678+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:22:17.004678+0000","last_undegraded":"2023-11-30T17:22:17.004678+0000","last_fullsized":"2023-11-30T17:22:17.004678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.316533+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:22:21.316533+0000","last_peered":"2023-11-30T17:22:21.316533+0000","last_clean":"2023-11-30T17:22:21.316533+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:22:21.316533+0000","last_undegraded":"2023-11-30T17:22:21.316533+0000","last_fullsized":"2023-11-30T17:22:21.316533+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-30T17:22:16.190486+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:22:16.190486+0000","last_peered":"2023-11-30T17:22:16.190486+0000","last_clean":"2023-11-30T17:22:16.190486+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:22:16.190486+0000","last_undegraded":"2023-11-30T17:22:16.190486+0000","last_fullsized":"2023-11-30T17:22:16.190486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":1268,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":44,"acting":44,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575030,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298016,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073824,"statfs":{"total":96636764160,"available":96331595776,"internally_reserved":0,"allocated":942080,"data_stored":467079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58899999999999997,"15min":0.57299999999999995},"min":{"1min":0.48499999999999999,"5min":0.315,"15min":0.23899999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.81100000000000005},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.57899999999999996},"min":{"1min":0.41999999999999998,"5min":0.40699999999999997,"15min":0.32200000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.81899999999999995},"last":0.68600000000000005}]},{"osd":1,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54800000000000004,"15min":0.54000000000000004},"min":{"1min":0.40600000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.41499999999999998,"5min":0.29899999999999999,"15min":0.28799999999999998},"max":{"1min":0.71799999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.47799999999999998,"5min":0.33500000000000002,"15min":0.32800000000000001},"max":{"1min":0.77000000000000002,"5min":0.77200000000000002,"15min":0.78300000000000003},"last":0.627},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56100000000000005,"15min":0.55600000000000005},"min":{"1min":0.48299999999999998,"5min":0.35399999999999998,"15min":0.28699999999999998},"max":{"1min":0.73699999999999999,"5min":0.73799999999999999,"15min":0.83899999999999997},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.44800000000000001,"5min":0.36499999999999999,"15min":0.33200000000000002},"max":{"1min":0.749,"5min":0.754,"15min":0.78000000000000003},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.45800000000000002,"5min":0.40799999999999997,"15min":0.33900000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.67500000000000004}]},{"osd":4,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.45300000000000001,"15min":0.46500000000000002},"min":{"1min":0.34200000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.79900000000000004},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47099999999999997,"15min":0.48999999999999999},"min":{"1min":0.33400000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.748,"5min":0.75800000000000001,"15min":1.3180000000000001},"last":0.44500000000000001}]},{"osd":5,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.48899999999999999,"15min":0.498},"min":{"1min":0.34300000000000003,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.82899999999999996},"last":0.5},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.872},"last":0.52200000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54700000000000004,"15min":0.55400000000000005},"min":{"1min":0.42499999999999999,"5min":0.372,"15min":0.36099999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.85199999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.54900000000000004,"15min":0.55400000000000005},"min":{"1min":0.44600000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78900000000000003,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.54000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575029,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302124,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069716,"statfs":{"total":96636764160,"available":96327389184,"internally_reserved":0,"allocated":954368,"data_stored":472988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55100000000000005,"15min":0.56499999999999995},"min":{"1min":0.32500000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71299999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.623},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.58199999999999996},"min":{"1min":0.33500000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.72199999999999998,"5min":0.79600000000000004,"15min":0.89300000000000002},"last":0.48299999999999998}]},{"osd":1,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.376,"5min":0.30599999999999999,"15min":0.26400000000000001},"max":{"1min":0.74199999999999999,"5min":0.77500000000000002,"15min":0.82799999999999996},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58299999999999996,"15min":0.59299999999999997},"min":{"1min":0.44600000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.74099999999999999,"5min":0.82499999999999996,"15min":0.85199999999999998},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.45000000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.68799999999999994,"5min":0.79900000000000004,"15min":0.82599999999999996},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.46700000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72799999999999998,"5min":0.80900000000000005,"15min":0.82499999999999996},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51500000000000001,"15min":0.53200000000000003},"min":{"1min":0.34300000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69099999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.443},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.40200000000000002,"5min":0.33100000000000002,"15min":0.32200000000000001},"max":{"1min":0.73099999999999998,"5min":0.75600000000000001,"15min":0.79600000000000004},"last":0.73199999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.44700000000000001,"15min":0.45400000000000001},"min":{"1min":0.35499999999999998,"5min":0.29599999999999999,"15min":0.28999999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.84199999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46300000000000002,"15min":0.47899999999999998},"min":{"1min":0.36499999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.65500000000000003,"5min":0.76000000000000001,"15min":0.83899999999999997},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.46100000000000002,"15min":0.47099999999999997},"min":{"1min":0.35199999999999998,"5min":0.29899999999999999,"15min":0.28299999999999997},"max":{"1min":0.65200000000000002,"5min":0.69399999999999995,"15min":0.74299999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.50700000000000001},"min":{"1min":0.371,"5min":0.33500000000000002,"15min":0.31900000000000001},"max":{"1min":0.70399999999999996,"5min":0.745,"15min":0.78500000000000003},"last":0.48999999999999999}]},{"osd":7,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51700000000000002,"15min":0.53300000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73299999999999998,"5min":0.80700000000000005,"15min":0.93200000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55300000000000005,"15min":0.56299999999999994},"min":{"1min":0.39500000000000002,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.86499999999999999},"last":0.81299999999999994}]}]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302188,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069652,"statfs":{"total":96636764160,"available":96327323648,"internally_reserved":0,"allocated":1019904,"data_stored":500639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.35999999999999999,"15min":0.35099999999999998},"min":{"1min":0.29599999999999999,"5min":0.23899999999999999,"15min":0.23000000000000001},"max":{"1min":0.54900000000000004,"5min":0.57199999999999995,"15min":0.60299999999999998},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.502,"5min":0.46999999999999997,"15min":0.46100000000000002},"min":{"1min":0.39200000000000002,"5min":0.314,"15min":0.309},"max":{"1min":0.59899999999999998,"5min":0.748,"15min":0.75700000000000001},"last":0.45900000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.39100000000000001,"15min":0.379},"min":{"1min":0.28599999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.56999999999999995,"5min":0.59799999999999998,"15min":0.67300000000000004},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.50800000000000001,"15min":0.48999999999999999},"min":{"1min":0.438,"5min":0.33400000000000002,"15min":0.29499999999999998},"max":{"1min":0.64200000000000002,"5min":0.78200000000000003,"15min":0.80700000000000005},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45100000000000001,"15min":0.441},"min":{"1min":0.38200000000000001,"5min":0.29899999999999999,"15min":0.23899999999999999},"max":{"1min":0.57099999999999995,"5min":0.70299999999999996,"15min":0.749},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.437,"15min":0.42599999999999999},"min":{"1min":0.34100000000000003,"5min":0.29999999999999999,"15min":0.28599999999999998},"max":{"1min":0.55700000000000005,"5min":0.71899999999999997,"15min":0.73699999999999999},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.44400000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.873,"5min":0.88500000000000001,"15min":0.89100000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.61199999999999999,"15min":0.61499999999999999},"min":{"1min":0.48599999999999999,"5min":0.41299999999999998,"15min":0.39900000000000002},"max":{"1min":0.753,"5min":0.97599999999999998,"15min":1.111},"last":0.60199999999999998}]},{"osd":5,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59799999999999998,"15min":0.59899999999999998},"min":{"1min":0.44400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.85399999999999998,"5min":1.006,"15min":1.006},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.434,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76500000000000001,"5min":0.81399999999999995,"15min":0.91300000000000003},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.56699999999999995,"5min":0.39700000000000002,"15min":0.39600000000000002},"max":{"1min":0.85699999999999998,"5min":0.92700000000000005,"15min":1.0600000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65200000000000002,"15min":0.65800000000000003},"min":{"1min":0.51600000000000001,"5min":0.433,"15min":0.379},"max":{"1min":0.91100000000000003,"5min":0.96099999999999997,"15min":1.0780000000000001},"last":0.745}]},{"osd":7,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67000000000000004,"15min":0.66300000000000003},"min":{"1min":0.45100000000000001,"5min":0.41899999999999998,"15min":0.41699999999999998},"max":{"1min":0.88900000000000001,"5min":0.92300000000000004,"15min":0.98699999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64000000000000001,"15min":0.64700000000000002},"min":{"1min":0.52500000000000002,"5min":0.436,"15min":0.39900000000000002},"max":{"1min":0.81999999999999995,"5min":0.879,"15min":0.94199999999999995},"last":0.59499999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575030,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302172,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069668,"statfs":{"total":96636764160,"available":96327340032,"internally_reserved":0,"allocated":1003520,"data_stored":499883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.373,"15min":0.35999999999999999},"min":{"1min":0.27500000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.48599999999999999,"5min":0.59999999999999998,"15min":0.71199999999999997},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.39100000000000001,"15min":0.379},"min":{"1min":0.26500000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.26100000000000001}]},{"osd":2,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.39100000000000001,"15min":0.38},"min":{"1min":0.29499999999999998,"5min":0.247,"15min":0.23899999999999999},"max":{"1min":0.55900000000000005,"5min":0.623,"15min":0.623},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.46300000000000002,"15min":0.45300000000000001},"min":{"1min":0.38100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.63400000000000001,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.313}]},{"osd":3,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.433,"15min":0.42599999999999999},"min":{"1min":0.32500000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.58599999999999997,"5min":0.66100000000000003,"15min":0.70999999999999996},"last":0.245},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44700000000000001,"15min":0.435},"min":{"1min":0.34300000000000003,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.56200000000000006,"5min":0.65400000000000003,"15min":0.68799999999999994},"last":0.27300000000000002}]},{"osd":4,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60999999999999999,"15min":0.59999999999999998},"min":{"1min":0.44900000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76400000000000001,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.50800000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.85399999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60899999999999999,"15min":0.59499999999999997},"min":{"1min":0.47399999999999998,"5min":0.39200000000000002,"15min":0.36199999999999999},"max":{"1min":0.83499999999999996,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63700000000000001,"15min":0.623},"min":{"1min":0.51500000000000001,"5min":0.38400000000000001,"15min":0.38},"max":{"1min":0.77700000000000002,"5min":1.004,"15min":1.004},"last":0.54500000000000004}]},{"osd":6,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65100000000000002,"15min":0.63900000000000001},"min":{"1min":0.435,"5min":0.376,"15min":0.376},"max":{"1min":0.89800000000000002,"5min":1.002,"15min":1.002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63900000000000001,"15min":0.627},"min":{"1min":0.496,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.872,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66000000000000003,"15min":0.64600000000000002},"min":{"1min":0.498,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94499999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.69699999999999995,"15min":0.68200000000000005},"min":{"1min":0.56100000000000005,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.93799999999999994,"5min":1.026,"15min":1.026},"last":0.63600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575030,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306264,"kb_used_data":976,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065576,"statfs":{"total":96636764160,"available":96323149824,"internally_reserved":0,"allocated":999424,"data_stored":493775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40400000000000003,"15min":0.38800000000000001},"min":{"1min":0.31,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.57099999999999995,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":3.4729999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.42899999999999999,"15min":0.42699999999999999},"min":{"1min":0.33800000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58899999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":2.637}]},{"osd":1,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45300000000000001,"15min":0.44},"min":{"1min":0.36799999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.63800000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":6.1210000000000004},{"interface":"front","average":{"1min":0.505,"5min":0.47799999999999998,"15min":0.46700000000000003},"min":{"1min":0.33400000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.67500000000000004,"5min":1.206,"15min":1.206},"last":5.7270000000000003}]},{"osd":3,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38600000000000001,"15min":0.39700000000000002},"min":{"1min":0.27200000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.56200000000000006,"5min":0.63500000000000001,"15min":0.86199999999999999},"last":0.438},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.46000000000000002},"min":{"1min":0.40999999999999998,"5min":0.26900000000000002,"15min":0.26200000000000001},"max":{"1min":0.60099999999999998,"5min":1.226,"15min":1.226},"last":1.756}]},{"osd":4,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61899999999999999,"15min":0.60999999999999999},"min":{"1min":0.46100000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84699999999999998,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":8.7170000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.78500000000000003,"5min":1.492,"15min":1.492},"last":1.381}]},{"osd":5,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63400000000000001,"15min":0.629},"min":{"1min":0.503,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94699999999999995,"5min":0.996,"15min":0.996},"last":3.4359999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.623,"15min":0.624},"min":{"1min":0.48899999999999999,"5min":0.38900000000000001,"15min":0.38100000000000001},"max":{"1min":0.79900000000000004,"5min":1.292,"15min":1.292},"last":1.982}]},{"osd":6,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.625,"15min":0.621},"min":{"1min":0.47499999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.76600000000000001,"5min":1.359,"15min":1.359},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.53300000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.879,"5min":1.159,"15min":1.159},"last":1.861}]},{"osd":7,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.57299999999999995,"5min":0.45200000000000001,"15min":0.40300000000000002},"max":{"1min":0.88600000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":4.6849999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67600000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.41499999999999998},"max":{"1min":0.93100000000000005,"5min":1.125,"15min":1.125},"last":4.5039999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575029,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306220,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065620,"statfs":{"total":96636764160,"available":96323194880,"internally_reserved":0,"allocated":954368,"data_stored":472988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35799999999999998,"15min":0.36199999999999999},"min":{"1min":0.26800000000000002,"5min":0.219,"15min":0.217},"max":{"1min":0.47899999999999998,"5min":0.57699999999999996,"15min":0.66200000000000003},"last":0.377},{"interface":"front","average":{"1min":0.434,"5min":0.40699999999999997,"15min":0.40000000000000002},"min":{"1min":0.30199999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.57199999999999995,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.26700000000000002}]},{"osd":1,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.38,"15min":0.38600000000000001},"min":{"1min":0.30199999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.42199999999999999,"15min":0.42999999999999999},"min":{"1min":0.32300000000000001,"5min":0.26600000000000001,"15min":0.25900000000000001},"max":{"1min":0.54500000000000004,"5min":0.65900000000000003,"15min":0.84399999999999997},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.44400000000000001,"15min":0.44800000000000001},"min":{"1min":0.32800000000000001,"5min":0.28599999999999998,"15min":0.26000000000000001},"max":{"1min":0.66000000000000003,"5min":0.72999999999999998,"15min":0.94899999999999995},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.505,"15min":0.505},"min":{"1min":0.41199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.63700000000000001,"5min":1.054,"15min":1.054},"last":0.41199999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59699999999999998,"15min":0.60399999999999998},"min":{"1min":0.45000000000000001,"5min":0.35299999999999998,"15min":0.35099999999999998},"max":{"1min":0.75900000000000001,"5min":0.91500000000000004,"15min":0.97599999999999998},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.47299999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78300000000000003,"5min":0.86799999999999999,"15min":0.91400000000000003},"last":0.61699999999999999}]},{"osd":5,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.59099999999999997,"15min":0.61099999999999999},"min":{"1min":0.42599999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82299999999999995,"5min":0.85399999999999998,"15min":0.98399999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77500000000000002,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.68200000000000005}]},{"osd":6,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.626,"15min":0.64500000000000002},"min":{"1min":0.48699999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81200000000000006,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.627},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.49399999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81200000000000006,"5min":0.89500000000000002,"15min":1.0389999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65600000000000003,"15min":0.66600000000000004},"min":{"1min":0.503,"5min":0.40500000000000003,"15min":0.39100000000000001},"max":{"1min":0.83699999999999997,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64800000000000002,"15min":0.66000000000000003},"min":{"1min":0.49199999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.004},"last":0.60299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575029,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302124,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069716,"statfs":{"total":96636764160,"available":96327389184,"internally_reserved":0,"allocated":954368,"data_stored":472988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.52500000000000002,"15min":0.52800000000000002},"min":{"1min":0.30599999999999999,"5min":0.28299999999999997,"15min":0.27500000000000002},"max":{"1min":0.748,"5min":0.77700000000000002,"15min":0.80900000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.28399999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.81999999999999995,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.442}]},{"osd":1,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.25800000000000001},"max":{"1min":0.69699999999999995,"5min":0.73799999999999999,"15min":0.79600000000000004},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54500000000000004,"15min":0.54600000000000004},"min":{"1min":0.34499999999999997,"5min":0.317,"15min":0.246},"max":{"1min":0.72499999999999998,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.41199999999999998,"5min":0.376,"15min":0.27800000000000002},"max":{"1min":0.755,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.39600000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71099999999999997,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55000000000000004,"15min":0.54600000000000004},"min":{"1min":0.42599999999999999,"5min":0.34699999999999998,"15min":0.32900000000000001},"max":{"1min":0.71299999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.40999999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74299999999999999,"5min":0.78900000000000003,"15min":0.80600000000000005},"last":0.59399999999999997}]},{"osd":5,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.438,"15min":0.44700000000000001},"min":{"1min":0.32900000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.58099999999999996,"5min":1.272,"15min":1.272},"last":0.63},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46100000000000002,"15min":0.46400000000000002},"min":{"1min":0.34300000000000003,"5min":0.29899999999999999,"15min":0.29199999999999998},"max":{"1min":0.54000000000000004,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.501,"15min":0.505},"min":{"1min":0.38100000000000001,"5min":0.33900000000000002,"15min":0.314},"max":{"1min":0.63800000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54800000000000004,"15min":0.54000000000000004},"min":{"1min":0.45800000000000002,"5min":0.373,"15min":0.33800000000000002},"max":{"1min":0.61699999999999999,"5min":1.129,"15min":1.129},"last":0.75}]},{"osd":7,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34300000000000003,"5min":0.318,"15min":0.29899999999999999},"max":{"1min":0.66900000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.44900000000000001,"5min":0.38600000000000001,"15min":0.34599999999999997},"max":{"1min":0.70799999999999996,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.76700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575029,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302124,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069716,"statfs":{"total":96636764160,"available":96327389184,"internally_reserved":0,"allocated":954368,"data_stored":472988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53300000000000003,"15min":0.53600000000000003},"min":{"1min":0.40600000000000003,"5min":0.34399999999999997,"15min":0.32800000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.40899999999999997,"5min":0.31,"15min":0.31},"max":{"1min":0.70299999999999996,"5min":0.76200000000000001,"15min":0.81799999999999995},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52100000000000002,"15min":0.52800000000000002},"min":{"1min":0.35399999999999998,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.67100000000000004,"5min":0.69599999999999995,"15min":0.72399999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55000000000000004,"15min":0.54600000000000004},"min":{"1min":0.44900000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.745,"5min":0.754,"15min":0.77000000000000002},"last":0.45100000000000001}]},{"osd":2,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.40000000000000002,"5min":0.34399999999999997,"15min":0.30599999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.60099999999999998,"15min":0.59499999999999997},"min":{"1min":0.48699999999999999,"5min":0.378,"15min":0.34499999999999997},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.44800000000000001,"5min":0.36699999999999999,"15min":0.36399999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.73799999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.45600000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73299999999999998,"5min":0.79200000000000004,"15min":0.82099999999999995},"last":0.60499999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42399999999999999,"15min":0.44},"min":{"1min":0.307,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57699999999999996,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.372},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45800000000000002,"15min":0.46700000000000003},"min":{"1min":0.31900000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.77600000000000002},"last":0.39800000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47599999999999998,"15min":0.48599999999999999},"min":{"1min":0.34200000000000003,"5min":0.29599999999999999,"15min":0.28499999999999998},"max":{"1min":0.70499999999999996,"5min":0.73999999999999999,"15min":0.82099999999999995},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.67500000000000004,"5min":0.81399999999999995,"15min":0.88200000000000001},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52000000000000002,"15min":0.52600000000000002},"min":{"1min":0.33100000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.73899999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.41799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.84599999999999997},"last":0.43099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:22:25.712 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:22:25.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.862+0000 7f0e8163b700 1 Processor -- start 2023-11-30T17:22:25.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.862+0000 7f0e8163b700 1 -- start start 2023-11-30T17:22:25.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.863+0000 7f0e8163b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0e7c1544e0 0x7f0e7c1548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:25.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.863+0000 7f0e8163b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e7c06a610 0x7f0e7c0c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:25.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.863+0000 7f0e8163b700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e7c0c69a0 con 0x7f0e7c0c6e30 2023-11-30T17:22:25.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.863+0000 7f0e8163b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e7c0c13a0 con 0x7f0e7c1544e0 2023-11-30T17:22:25.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.863+0000 7f0e8163b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c0c1680 con 0x7f0e7c06a610 2023-11-30T17:22:25.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.863+0000 7f0e7affd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0e7c1544e0 0x7f0e7c1548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:25.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.863+0000 7f0e7a7fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e7c06a610 0x7f0e7c0c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:25.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.863+0000 7f0e7b7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f0e7c0c6e30 0x7f0e7c0a8000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:60920/0 (socket says 172.21.15.49:60920) 2023-11-30T17:22:25.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.863+0000 7f0e7a7fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e7c06a610 0x7f0e7c0c0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:44790/0 (socket says 172.21.15.49:44790) 2023-11-30T17:22:25.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.863+0000 7f0e7affd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0e7c1544e0 0x7f0e7c1548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:49482/0 (socket says 172.21.15.49:49482) 2023-11-30T17:22:25.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.863+0000 7f0e7b7fe700 1 -- 172.21.15.49:0/28357499 learned_addr learned my addr 172.21.15.49:0/28357499 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:25.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.864+0000 7f0e7a7fc700 1 -- 172.21.15.49:0/28357499 >> v2:172.21.15.115:3300/0 conn(0x7f0e7c1544e0 msgr2=0x7f0e7c1548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:25.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.864+0000 7f0e7a7fc700 1 --2- 172.21.15.49:0/28357499 >> v2:172.21.15.115:3300/0 conn(0x7f0e7c1544e0 0x7f0e7c1548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:25.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.864+0000 7f0e7a7fc700 1 -- 172.21.15.49:0/28357499 >> v1:172.21.15.115:6789/0 conn(0x7f0e7c0c6e30 legacy=0x7f0e7c0a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:25.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.864+0000 7f0e7a7fc700 1 -- 172.21.15.49:0/28357499 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7c0c6630 con 0x7f0e7c06a610 2023-11-30T17:22:25.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.864+0000 7f0e7affd700 1 --2- 172.21.15.49:0/28357499 >> v2:172.21.15.115:3300/0 conn(0x7f0e7c1544e0 0x7f0e7c1548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:22:25.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.864+0000 7f0e7a7fc700 1 --2- 172.21.15.49:0/28357499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e7c06a610 0x7f0e7c0c0bc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f0e64009760 tx=0x7f0e64009060).ready entity=mon.2 client_cookie=a32ef368322348a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:25.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.864+0000 7f0e79ffb700 1 -- 172.21.15.49:0/28357499 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6400f510 con 0x7f0e7c06a610 2023-11-30T17:22:25.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.864+0000 7f0e79ffb700 1 -- 172.21.15.49:0/28357499 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6400f670 con 0x7f0e7c06a610 2023-11-30T17:22:25.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.864+0000 7f0e79ffb700 1 -- 172.21.15.49:0/28357499 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6400f9f0 con 0x7f0e7c06a610 2023-11-30T17:22:25.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.865+0000 7f0e8163b700 1 -- 172.21.15.49:0/28357499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e7c06a610 msgr2=0x7f0e7c0c0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:25.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.865+0000 7f0e8163b700 1 --2- 172.21.15.49:0/28357499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e7c06a610 0x7f0e7c0c0bc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f0e64009760 tx=0x7f0e64009060).stop 2023-11-30T17:22:25.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.865+0000 7f0e8163b700 1 -- 172.21.15.49:0/28357499 shutdown_connections 2023-11-30T17:22:25.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.865+0000 7f0e8163b700 1 --2- 172.21.15.49:0/28357499 >> v2:172.21.15.115:3300/0 conn(0x7f0e7c1544e0 0x7f0e7c1548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:25.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.865+0000 7f0e8163b700 1 --2- 172.21.15.49:0/28357499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e7c06a610 0x7f0e7c0c0bc0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:25.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.865+0000 7f0e8163b700 1 -- 172.21.15.49:0/28357499 >> 172.21.15.49:0/28357499 conn(0x7f0e7c085020 msgr2=0x7f0e7c094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:25.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.865+0000 7f0e8163b700 1 -- 172.21.15.49:0/28357499 shutdown_connections 2023-11-30T17:22:25.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.865+0000 7f0e8163b700 1 -- 172.21.15.49:0/28357499 wait complete. 2023-11-30T17:22:25.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.866+0000 7f0e8163b700 1 Processor -- start 2023-11-30T17:22:25.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.866+0000 7f0e8163b700 1 -- start start 2023-11-30T17:22:25.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.867+0000 7f0e8163b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e7c06a610 0x7f0e7c0af770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:25.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.867+0000 7f0e8163b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e7c0c6e30 0x7f0e7c098b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:25.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.867+0000 7f0e8163b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e7c1544e0 0x7f0e7c0b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:25.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.867+0000 7f0e8163b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c097e10 con 0x7f0e7c06a610 2023-11-30T17:22:25.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.867+0000 7f0e8163b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c098690 con 0x7f0e7c1544e0 2023-11-30T17:22:25.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.867+0000 7f0e8163b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c0afc60 con 0x7f0e7c0c6e30 2023-11-30T17:22:25.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.867+0000 7f0e7affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e7c06a610 0x7f0e7c0af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:25.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.867+0000 7f0e7affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e7c06a610 0x7f0e7c0af770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53790/0 (socket says 172.21.15.49:53790) 2023-11-30T17:22:25.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.867+0000 7f0e7affd700 1 -- 172.21.15.49:0/1363455419 learned_addr learned my addr 172.21.15.49:0/1363455419 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:25.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.867+0000 7f0e7a7fc700 1 --2- 172.21.15.49:0/1363455419 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e7c0c6e30 0x7f0e7c098b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:25.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.867+0000 7f0e7b7fe700 1 --2- 172.21.15.49:0/1363455419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e7c1544e0 0x7f0e7c0b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:25.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.867+0000 7f0e7affd700 1 -- 172.21.15.49:0/1363455419 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e7c0c6e30 msgr2=0x7f0e7c098b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:25.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.867+0000 7f0e7affd700 1 --2- 172.21.15.49:0/1363455419 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e7c0c6e30 0x7f0e7c098b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:25.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.867+0000 7f0e7affd700 1 -- 172.21.15.49:0/1363455419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e7c1544e0 msgr2=0x7f0e7c0b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:25.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.867+0000 7f0e7affd700 1 --2- 172.21.15.49:0/1363455419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e7c1544e0 0x7f0e7c0b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:25.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.867+0000 7f0e7affd700 1 -- 172.21.15.49:0/1363455419 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e74009a20 con 0x7f0e7c06a610 2023-11-30T17:22:25.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.867+0000 7f0e7b7fe700 1 --2- 172.21.15.49:0/1363455419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e7c1544e0 0x7f0e7c0b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:25.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.867+0000 7f0e7affd700 1 --2- 172.21.15.49:0/1363455419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e7c06a610 0x7f0e7c0af770 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f0e7400c220 tx=0x7f0e7400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:25.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.868+0000 7f0e72ffd700 1 -- 172.21.15.49:0/1363455419 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7400ce60 con 0x7f0e7c06a610 2023-11-30T17:22:25.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.868+0000 7f0e72ffd700 1 -- 172.21.15.49:0/1363455419 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7400f040 con 0x7f0e7c06a610 2023-11-30T17:22:25.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.868+0000 7f0e8163b700 1 -- 172.21.15.49:0/1363455419 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e640092a0 con 0x7f0e7c06a610 2023-11-30T17:22:25.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.868+0000 7f0e72ffd700 1 -- 172.21.15.49:0/1363455419 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e74013610 con 0x7f0e7c06a610 2023-11-30T17:22:25.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.868+0000 7f0e8163b700 1 -- 172.21.15.49:0/1363455419 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e7c0955e0 con 0x7f0e7c06a610 2023-11-30T17:22:25.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.869+0000 7f0e8163b700 1 -- 172.21.15.49:0/1363455419 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e7c098970 con 0x7f0e7c06a610 2023-11-30T17:22:25.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.869+0000 7f0e72ffd700 1 -- 172.21.15.49:0/1363455419 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0e740139c0 con 0x7f0e7c06a610 2023-11-30T17:22:25.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.869+0000 7f0e72ffd700 1 --2- 172.21.15.49:0/1363455419 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0e5c05f270 0x7f0e5c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:25.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.869+0000 7f0e72ffd700 1 -- 172.21.15.49:0/1363455419 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f0e7407aef0 con 0x7f0e7c06a610 2023-11-30T17:22:25.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.870+0000 7f0e7a7fc700 1 --2- 172.21.15.49:0/1363455419 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0e5c05f270 0x7f0e5c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:25.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.870+0000 7f0e7a7fc700 1 --2- 172.21.15.49:0/1363455419 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0e5c05f270 0x7f0e5c061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f0e7c0c3a90 tx=0x7f0e64017000).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:25.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:25.874+0000 7f0e72ffd700 1 -- 172.21.15.49:0/1363455419 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0e7404c020 con 0x7f0e7c06a610 2023-11-30T17:22:26.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.040+0000 7f0e8163b700 1 -- 172.21.15.49:0/1363455419 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0e7c0c10b0 con 0x7f0e5c05f270 2023-11-30T17:22:26.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.050+0000 7f0e72ffd700 1 -- 172.21.15.49:0/1363455419 <== mgr.5926 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353936 (secure 0 0 0) 0x7f0e7c0c10b0 con 0x7f0e5c05f270 2023-11-30T17:22:26.057 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:26.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.053+0000 7f0e8163b700 1 -- 172.21.15.49:0/1363455419 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0e5c05f270 msgr2=0x7f0e5c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:26.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.053+0000 7f0e8163b700 1 --2- 172.21.15.49:0/1363455419 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0e5c05f270 0x7f0e5c061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f0e7c0c3a90 tx=0x7f0e64017000).stop 2023-11-30T17:22:26.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.053+0000 7f0e8163b700 1 -- 172.21.15.49:0/1363455419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e7c06a610 msgr2=0x7f0e7c0af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:26.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.053+0000 7f0e8163b700 1 --2- 172.21.15.49:0/1363455419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e7c06a610 0x7f0e7c0af770 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f0e7400c220 tx=0x7f0e7400b040).stop 2023-11-30T17:22:26.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.053+0000 7f0e8163b700 1 -- 172.21.15.49:0/1363455419 shutdown_connections 2023-11-30T17:22:26.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.053+0000 7f0e8163b700 1 --2- 172.21.15.49:0/1363455419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e7c1544e0 0x7f0e7c0b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:26.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.053+0000 7f0e8163b700 1 --2- 172.21.15.49:0/1363455419 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0e5c05f270 0x7f0e5c061730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:26.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.053+0000 7f0e8163b700 1 --2- 172.21.15.49:0/1363455419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e7c06a610 0x7f0e7c0af770 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:26.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.053+0000 7f0e8163b700 1 --2- 172.21.15.49:0/1363455419 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e7c0c6e30 0x7f0e7c098b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:26.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.053+0000 7f0e8163b700 1 -- 172.21.15.49:0/1363455419 >> 172.21.15.49:0/1363455419 conn(0x7f0e7c085020 msgr2=0x7f0e7c0ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:26.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.053+0000 7f0e8163b700 1 -- 172.21.15.49:0/1363455419 shutdown_connections 2023-11-30T17:22:26.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.054+0000 7f0e8163b700 1 -- 172.21.15.49:0/1363455419 wait complete. 2023-11-30T17:22:26.061 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:22:26.069 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-30T17:22:24.231193+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1268,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":98,"acting":98,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":113,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2421232,"kb_used_data":7600,"kb_used_omap":0,"kb_used_meta":2413568,"kb_avail":752553488,"statfs":{"total":773094113280,"available":770614771712,"internally_reserved":0,"allocated":7782400,"data_stored":3853328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2471493632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-28927,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-83,"num_write_kb":-68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.010859"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3f","version":"82'3","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.329667+0000","last_change":"2023-11-30T17:22:20.929205+0000","last_active":"2023-11-30T17:22:21.329667+0000","last_peered":"2023-11-30T17:22:21.329667+0000","last_clean":"2023-11-30T17:22:21.329667+0000","last_became_active":"2023-11-30T17:22:20.928896+0000","last_became_peered":"2023-11-30T17:22:20.928896+0000","last_unstale":"2023-11-30T17:22:21.329667+0000","last_undegraded":"2023-11-30T17:22:21.329667+0000","last_fullsized":"2023-11-30T17:22:21.329667+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.333605+0000","last_change":"2023-11-30T17:22:21.332725+0000","last_active":"2023-11-30T17:22:21.333605+0000","last_peered":"2023-11-30T17:22:21.333605+0000","last_clean":"2023-11-30T17:22:21.333605+0000","last_became_active":"2023-11-30T17:22:21.332417+0000","last_became_peered":"2023-11-30T17:22:21.332417+0000","last_unstale":"2023-11-30T17:22:21.333605+0000","last_undegraded":"2023-11-30T17:22:21.333605+0000","last_fullsized":"2023-11-30T17:22:21.333605+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.333314+0000","last_change":"2023-11-30T17:22:21.331441+0000","last_active":"2023-11-30T17:22:21.333314+0000","last_peered":"2023-11-30T17:22:21.333314+0000","last_clean":"2023-11-30T17:22:21.333314+0000","last_became_active":"2023-11-30T17:22:21.330964+0000","last_became_peered":"2023-11-30T17:22:21.330964+0000","last_unstale":"2023-11-30T17:22:21.333314+0000","last_undegraded":"2023-11-30T17:22:21.333314+0000","last_fullsized":"2023-11-30T17:22:21.333314+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.333885+0000","last_change":"2023-11-30T17:22:20.926229+0000","last_active":"2023-11-30T17:22:21.333885+0000","last_peered":"2023-11-30T17:22:21.333885+0000","last_clean":"2023-11-30T17:22:21.333885+0000","last_became_active":"2023-11-30T17:22:20.925910+0000","last_became_peered":"2023-11-30T17:22:20.925910+0000","last_unstale":"2023-11-30T17:22:21.333885+0000","last_undegraded":"2023-11-30T17:22:21.333885+0000","last_fullsized":"2023-11-30T17:22:21.333885+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335733+0000","last_change":"2023-11-30T17:22:21.332864+0000","last_active":"2023-11-30T17:22:21.335733+0000","last_peered":"2023-11-30T17:22:21.335733+0000","last_clean":"2023-11-30T17:22:21.335733+0000","last_became_active":"2023-11-30T17:22:21.332589+0000","last_became_peered":"2023-11-30T17:22:21.332589+0000","last_unstale":"2023-11-30T17:22:21.335733+0000","last_undegraded":"2023-11-30T17:22:21.335733+0000","last_fullsized":"2023-11-30T17:22:21.335733+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337303+0000","last_change":"2023-11-30T17:22:20.929809+0000","last_active":"2023-11-30T17:22:21.337303+0000","last_peered":"2023-11-30T17:22:21.337303+0000","last_clean":"2023-11-30T17:22:21.337303+0000","last_became_active":"2023-11-30T17:22:20.929506+0000","last_became_peered":"2023-11-30T17:22:20.929506+0000","last_unstale":"2023-11-30T17:22:21.337303+0000","last_undegraded":"2023-11-30T17:22:21.337303+0000","last_fullsized":"2023-11-30T17:22:21.337303+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335363+0000","last_change":"2023-11-30T17:22:21.332342+0000","last_active":"2023-11-30T17:22:21.335363+0000","last_peered":"2023-11-30T17:22:21.335363+0000","last_clean":"2023-11-30T17:22:21.335363+0000","last_became_active":"2023-11-30T17:22:21.321851+0000","last_became_peered":"2023-11-30T17:22:21.321851+0000","last_unstale":"2023-11-30T17:22:21.335363+0000","last_undegraded":"2023-11-30T17:22:21.335363+0000","last_fullsized":"2023-11-30T17:22:21.335363+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.316483+0000","last_change":"2023-11-30T17:22:20.928501+0000","last_active":"2023-11-30T17:22:21.316483+0000","last_peered":"2023-11-30T17:22:21.316483+0000","last_clean":"2023-11-30T17:22:21.316483+0000","last_became_active":"2023-11-30T17:22:20.928198+0000","last_became_peered":"2023-11-30T17:22:20.928198+0000","last_unstale":"2023-11-30T17:22:21.316483+0000","last_undegraded":"2023-11-30T17:22:21.316483+0000","last_fullsized":"2023-11-30T17:22:21.316483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.316312+0000","last_change":"2023-11-30T17:22:20.932648+0000","last_active":"2023-11-30T17:22:21.316312+0000","last_peered":"2023-11-30T17:22:21.316312+0000","last_clean":"2023-11-30T17:22:21.316312+0000","last_became_active":"2023-11-30T17:22:20.932328+0000","last_became_peered":"2023-11-30T17:22:20.932328+0000","last_unstale":"2023-11-30T17:22:21.316312+0000","last_undegraded":"2023-11-30T17:22:21.316312+0000","last_fullsized":"2023-11-30T17:22:21.316312+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.336734+0000","last_change":"2023-11-30T17:22:21.334427+0000","last_active":"2023-11-30T17:22:21.336734+0000","last_peered":"2023-11-30T17:22:21.336734+0000","last_clean":"2023-11-30T17:22:21.336734+0000","last_became_active":"2023-11-30T17:22:21.334056+0000","last_became_peered":"2023-11-30T17:22:21.334056+0000","last_unstale":"2023-11-30T17:22:21.336734+0000","last_undegraded":"2023-11-30T17:22:21.336734+0000","last_fullsized":"2023-11-30T17:22:21.336734+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"82'4","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.339175+0000","last_change":"2023-11-30T17:22:20.929041+0000","last_active":"2023-11-30T17:22:21.339175+0000","last_peered":"2023-11-30T17:22:21.339175+0000","last_clean":"2023-11-30T17:22:21.339175+0000","last_became_active":"2023-11-30T17:22:20.928561+0000","last_became_peered":"2023-11-30T17:22:20.928561+0000","last_unstale":"2023-11-30T17:22:21.339175+0000","last_undegraded":"2023-11-30T17:22:21.339175+0000","last_fullsized":"2023-11-30T17:22:21.339175+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.331614+0000","last_change":"2023-11-30T17:22:20.930348+0000","last_active":"2023-11-30T17:22:21.331614+0000","last_peered":"2023-11-30T17:22:21.331614+0000","last_clean":"2023-11-30T17:22:21.331614+0000","last_became_active":"2023-11-30T17:22:20.930051+0000","last_became_peered":"2023-11-30T17:22:20.930051+0000","last_unstale":"2023-11-30T17:22:21.331614+0000","last_undegraded":"2023-11-30T17:22:21.331614+0000","last_fullsized":"2023-11-30T17:22:21.331614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337301+0000","last_change":"2023-11-30T17:22:21.336482+0000","last_active":"2023-11-30T17:22:21.337301+0000","last_peered":"2023-11-30T17:22:21.337301+0000","last_clean":"2023-11-30T17:22:21.337301+0000","last_became_active":"2023-11-30T17:22:21.336197+0000","last_became_peered":"2023-11-30T17:22:21.336197+0000","last_unstale":"2023-11-30T17:22:21.337301+0000","last_undegraded":"2023-11-30T17:22:21.337301+0000","last_fullsized":"2023-11-30T17:22:21.337301+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.333437+0000","last_change":"2023-11-30T17:22:21.330564+0000","last_active":"2023-11-30T17:22:21.333437+0000","last_peered":"2023-11-30T17:22:21.333437+0000","last_clean":"2023-11-30T17:22:21.333437+0000","last_became_active":"2023-11-30T17:22:21.329983+0000","last_became_peered":"2023-11-30T17:22:21.329983+0000","last_unstale":"2023-11-30T17:22:21.333437+0000","last_undegraded":"2023-11-30T17:22:21.333437+0000","last_fullsized":"2023-11-30T17:22:21.333437+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.323406+0000","last_change":"2023-11-30T17:22:20.931253+0000","last_active":"2023-11-30T17:22:21.323406+0000","last_peered":"2023-11-30T17:22:21.323406+0000","last_clean":"2023-11-30T17:22:21.323406+0000","last_became_active":"2023-11-30T17:22:20.930953+0000","last_became_peered":"2023-11-30T17:22:20.930953+0000","last_unstale":"2023-11-30T17:22:21.323406+0000","last_undegraded":"2023-11-30T17:22:21.323406+0000","last_fullsized":"2023-11-30T17:22:21.323406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.314552+0000","last_change":"2023-11-30T17:22:20.934622+0000","last_active":"2023-11-30T17:22:21.314552+0000","last_peered":"2023-11-30T17:22:21.314552+0000","last_clean":"2023-11-30T17:22:21.314552+0000","last_became_active":"2023-11-30T17:22:20.934343+0000","last_became_peered":"2023-11-30T17:22:20.934343+0000","last_unstale":"2023-11-30T17:22:21.314552+0000","last_undegraded":"2023-11-30T17:22:21.314552+0000","last_fullsized":"2023-11-30T17:22:21.314552+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.322388+0000","last_change":"2023-11-30T17:22:20.932327+0000","last_active":"2023-11-30T17:22:21.322388+0000","last_peered":"2023-11-30T17:22:21.322388+0000","last_clean":"2023-11-30T17:22:21.322388+0000","last_became_active":"2023-11-30T17:22:20.932056+0000","last_became_peered":"2023-11-30T17:22:20.932056+0000","last_unstale":"2023-11-30T17:22:21.322388+0000","last_undegraded":"2023-11-30T17:22:21.322388+0000","last_fullsized":"2023-11-30T17:22:21.322388+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335152+0000","last_change":"2023-11-30T17:22:21.333765+0000","last_active":"2023-11-30T17:22:21.335152+0000","last_peered":"2023-11-30T17:22:21.335152+0000","last_clean":"2023-11-30T17:22:21.335152+0000","last_became_active":"2023-11-30T17:22:21.333449+0000","last_became_peered":"2023-11-30T17:22:21.333449+0000","last_unstale":"2023-11-30T17:22:21.335152+0000","last_undegraded":"2023-11-30T17:22:21.335152+0000","last_fullsized":"2023-11-30T17:22:21.335152+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.322384+0000","last_change":"2023-11-30T17:22:20.921100+0000","last_active":"2023-11-30T17:22:21.322384+0000","last_peered":"2023-11-30T17:22:21.322384+0000","last_clean":"2023-11-30T17:22:21.322384+0000","last_became_active":"2023-11-30T17:22:20.920818+0000","last_became_peered":"2023-11-30T17:22:20.920818+0000","last_unstale":"2023-11-30T17:22:21.322384+0000","last_undegraded":"2023-11-30T17:22:21.322384+0000","last_fullsized":"2023-11-30T17:22:21.322384+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.313733+0000","last_change":"2023-11-30T17:22:20.928872+0000","last_active":"2023-11-30T17:22:21.313733+0000","last_peered":"2023-11-30T17:22:21.313733+0000","last_clean":"2023-11-30T17:22:21.313733+0000","last_became_active":"2023-11-30T17:22:20.928246+0000","last_became_peered":"2023-11-30T17:22:20.928246+0000","last_unstale":"2023-11-30T17:22:21.313733+0000","last_undegraded":"2023-11-30T17:22:21.313733+0000","last_fullsized":"2023-11-30T17:22:21.313733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.334940+0000","last_change":"2023-11-30T17:22:20.932827+0000","last_active":"2023-11-30T17:22:21.334940+0000","last_peered":"2023-11-30T17:22:21.334940+0000","last_clean":"2023-11-30T17:22:21.334940+0000","last_became_active":"2023-11-30T17:22:20.932116+0000","last_became_peered":"2023-11-30T17:22:20.932116+0000","last_unstale":"2023-11-30T17:22:21.334940+0000","last_undegraded":"2023-11-30T17:22:21.334940+0000","last_fullsized":"2023-11-30T17:22:21.334940+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337106+0000","last_change":"2023-11-30T17:22:20.932467+0000","last_active":"2023-11-30T17:22:21.337106+0000","last_peered":"2023-11-30T17:22:21.337106+0000","last_clean":"2023-11-30T17:22:21.337106+0000","last_became_active":"2023-11-30T17:22:20.932190+0000","last_became_peered":"2023-11-30T17:22:20.932190+0000","last_unstale":"2023-11-30T17:22:21.337106+0000","last_undegraded":"2023-11-30T17:22:21.337106+0000","last_fullsized":"2023-11-30T17:22:21.337106+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.334353+0000","last_change":"2023-11-30T17:22:21.331875+0000","last_active":"2023-11-30T17:22:21.334353+0000","last_peered":"2023-11-30T17:22:21.334353+0000","last_clean":"2023-11-30T17:22:21.334353+0000","last_became_active":"2023-11-30T17:22:21.328825+0000","last_became_peered":"2023-11-30T17:22:21.328825+0000","last_unstale":"2023-11-30T17:22:21.334353+0000","last_undegraded":"2023-11-30T17:22:21.334353+0000","last_fullsized":"2023-11-30T17:22:21.334353+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335533+0000","last_change":"2023-11-30T17:22:20.936705+0000","last_active":"2023-11-30T17:22:21.335533+0000","last_peered":"2023-11-30T17:22:21.335533+0000","last_clean":"2023-11-30T17:22:21.335533+0000","last_became_active":"2023-11-30T17:22:20.936118+0000","last_became_peered":"2023-11-30T17:22:20.936118+0000","last_unstale":"2023-11-30T17:22:21.335533+0000","last_undegraded":"2023-11-30T17:22:21.335533+0000","last_fullsized":"2023-11-30T17:22:21.335533+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.314520+0000","last_change":"2023-11-30T17:22:20.930005+0000","last_active":"2023-11-30T17:22:21.314520+0000","last_peered":"2023-11-30T17:22:21.314520+0000","last_clean":"2023-11-30T17:22:21.314520+0000","last_became_active":"2023-11-30T17:22:20.929725+0000","last_became_peered":"2023-11-30T17:22:20.929725+0000","last_unstale":"2023-11-30T17:22:21.314520+0000","last_undegraded":"2023-11-30T17:22:21.314520+0000","last_fullsized":"2023-11-30T17:22:21.314520+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.331499+0000","last_change":"2023-11-30T17:22:21.327241+0000","last_active":"2023-11-30T17:22:21.331499+0000","last_peered":"2023-11-30T17:22:21.331499+0000","last_clean":"2023-11-30T17:22:21.331499+0000","last_became_active":"2023-11-30T17:22:21.326987+0000","last_became_peered":"2023-11-30T17:22:21.326987+0000","last_unstale":"2023-11-30T17:22:21.331499+0000","last_undegraded":"2023-11-30T17:22:21.331499+0000","last_fullsized":"2023-11-30T17:22:21.331499+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337309+0000","last_change":"2023-11-30T17:22:21.336465+0000","last_active":"2023-11-30T17:22:21.337309+0000","last_peered":"2023-11-30T17:22:21.337309+0000","last_clean":"2023-11-30T17:22:21.337309+0000","last_became_active":"2023-11-30T17:22:21.336172+0000","last_became_peered":"2023-11-30T17:22:21.336172+0000","last_unstale":"2023-11-30T17:22:21.337309+0000","last_undegraded":"2023-11-30T17:22:21.337309+0000","last_fullsized":"2023-11-30T17:22:21.337309+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.333412+0000","last_change":"2023-11-30T17:22:21.330374+0000","last_active":"2023-11-30T17:22:21.333412+0000","last_peered":"2023-11-30T17:22:21.333412+0000","last_clean":"2023-11-30T17:22:21.333412+0000","last_became_active":"2023-11-30T17:22:21.329939+0000","last_became_peered":"2023-11-30T17:22:21.329939+0000","last_unstale":"2023-11-30T17:22:21.333412+0000","last_undegraded":"2023-11-30T17:22:21.333412+0000","last_fullsized":"2023-11-30T17:22:21.333412+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337727+0000","last_change":"2023-11-30T17:22:20.931360+0000","last_active":"2023-11-30T17:22:21.337727+0000","last_peered":"2023-11-30T17:22:21.337727+0000","last_clean":"2023-11-30T17:22:21.337727+0000","last_became_active":"2023-11-30T17:22:20.930703+0000","last_became_peered":"2023-11-30T17:22:20.930703+0000","last_unstale":"2023-11-30T17:22:21.337727+0000","last_undegraded":"2023-11-30T17:22:21.337727+0000","last_fullsized":"2023-11-30T17:22:21.337727+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.328012+0000","last_change":"2023-11-30T17:22:21.324414+0000","last_active":"2023-11-30T17:22:21.328012+0000","last_peered":"2023-11-30T17:22:21.328012+0000","last_clean":"2023-11-30T17:22:21.328012+0000","last_became_active":"2023-11-30T17:22:21.324180+0000","last_became_peered":"2023-11-30T17:22:21.324180+0000","last_unstale":"2023-11-30T17:22:21.328012+0000","last_undegraded":"2023-11-30T17:22:21.328012+0000","last_fullsized":"2023-11-30T17:22:21.328012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337931+0000","last_change":"2023-11-30T17:22:21.337197+0000","last_active":"2023-11-30T17:22:21.337931+0000","last_peered":"2023-11-30T17:22:21.337931+0000","last_clean":"2023-11-30T17:22:21.337931+0000","last_became_active":"2023-11-30T17:22:21.336585+0000","last_became_peered":"2023-11-30T17:22:21.336585+0000","last_unstale":"2023-11-30T17:22:21.337931+0000","last_undegraded":"2023-11-30T17:22:21.337931+0000","last_fullsized":"2023-11-30T17:22:21.337931+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335963+0000","last_change":"2023-11-30T17:22:21.333694+0000","last_active":"2023-11-30T17:22:21.335963+0000","last_peered":"2023-11-30T17:22:21.335963+0000","last_clean":"2023-11-30T17:22:21.335963+0000","last_became_active":"2023-11-30T17:22:21.333507+0000","last_became_peered":"2023-11-30T17:22:21.333507+0000","last_unstale":"2023-11-30T17:22:21.335963+0000","last_undegraded":"2023-11-30T17:22:21.335963+0000","last_fullsized":"2023-11-30T17:22:21.335963+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.314720+0000","last_change":"2023-11-30T17:22:20.936879+0000","last_active":"2023-11-30T17:22:21.314720+0000","last_peered":"2023-11-30T17:22:21.314720+0000","last_clean":"2023-11-30T17:22:21.314720+0000","last_became_active":"2023-11-30T17:22:20.936480+0000","last_became_peered":"2023-11-30T17:22:20.936480+0000","last_unstale":"2023-11-30T17:22:21.314720+0000","last_undegraded":"2023-11-30T17:22:21.314720+0000","last_fullsized":"2023-11-30T17:22:21.314720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.315988+0000","last_change":"2023-11-30T17:22:20.931107+0000","last_active":"2023-11-30T17:22:21.315988+0000","last_peered":"2023-11-30T17:22:21.315988+0000","last_clean":"2023-11-30T17:22:21.315988+0000","last_became_active":"2023-11-30T17:22:20.930305+0000","last_became_peered":"2023-11-30T17:22:20.930305+0000","last_unstale":"2023-11-30T17:22:21.315988+0000","last_undegraded":"2023-11-30T17:22:21.315988+0000","last_fullsized":"2023-11-30T17:22:21.315988+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.328239+0000","last_change":"2023-11-30T17:22:21.326066+0000","last_active":"2023-11-30T17:22:21.328239+0000","last_peered":"2023-11-30T17:22:21.328239+0000","last_clean":"2023-11-30T17:22:21.328239+0000","last_became_active":"2023-11-30T17:22:21.325745+0000","last_became_peered":"2023-11-30T17:22:21.325745+0000","last_unstale":"2023-11-30T17:22:21.328239+0000","last_undegraded":"2023-11-30T17:22:21.328239+0000","last_fullsized":"2023-11-30T17:22:21.328239+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.336712+0000","last_change":"2023-11-30T17:22:21.334589+0000","last_active":"2023-11-30T17:22:21.336712+0000","last_peered":"2023-11-30T17:22:21.336712+0000","last_clean":"2023-11-30T17:22:21.336712+0000","last_became_active":"2023-11-30T17:22:21.334131+0000","last_became_peered":"2023-11-30T17:22:21.334131+0000","last_unstale":"2023-11-30T17:22:21.336712+0000","last_undegraded":"2023-11-30T17:22:21.336712+0000","last_fullsized":"2023-11-30T17:22:21.336712+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.315239+0000","last_change":"2023-11-30T17:22:20.929746+0000","last_active":"2023-11-30T17:22:21.315239+0000","last_peered":"2023-11-30T17:22:21.315239+0000","last_clean":"2023-11-30T17:22:21.315239+0000","last_became_active":"2023-11-30T17:22:20.929451+0000","last_became_peered":"2023-11-30T17:22:20.929451+0000","last_unstale":"2023-11-30T17:22:21.315239+0000","last_undegraded":"2023-11-30T17:22:21.315239+0000","last_fullsized":"2023-11-30T17:22:21.315239+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.316069+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:22:21.316069+0000","last_peered":"2023-11-30T17:22:21.316069+0000","last_clean":"2023-11-30T17:22:21.316069+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:22:21.316069+0000","last_undegraded":"2023-11-30T17:22:21.316069+0000","last_fullsized":"2023-11-30T17:22:21.316069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.313395+0000","last_change":"2023-11-30T17:22:20.931616+0000","last_active":"2023-11-30T17:22:21.313395+0000","last_peered":"2023-11-30T17:22:21.313395+0000","last_clean":"2023-11-30T17:22:21.313395+0000","last_became_active":"2023-11-30T17:22:20.931340+0000","last_became_peered":"2023-11-30T17:22:20.931340+0000","last_unstale":"2023-11-30T17:22:21.313395+0000","last_undegraded":"2023-11-30T17:22:21.313395+0000","last_fullsized":"2023-11-30T17:22:21.313395+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-30T17:22:16.265099+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:22:16.265099+0000","last_peered":"2023-11-30T17:22:16.265099+0000","last_clean":"2023-11-30T17:22:16.265099+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:22:16.265099+0000","last_undegraded":"2023-11-30T17:22:16.265099+0000","last_fullsized":"2023-11-30T17:22:16.265099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.322565+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:22:21.322565+0000","last_peered":"2023-11-30T17:22:21.322565+0000","last_clean":"2023-11-30T17:22:21.322565+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:22:21.322565+0000","last_undegraded":"2023-11-30T17:22:21.322565+0000","last_fullsized":"2023-11-30T17:22:21.322565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":62,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-30T17:22:16.265097+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:22:16.265097+0000","last_peered":"2023-11-30T17:22:16.265097+0000","last_clean":"2023-11-30T17:22:16.265097+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:22:16.265097+0000","last_undegraded":"2023-11-30T17:22:16.265097+0000","last_fullsized":"2023-11-30T17:22:16.265097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":64,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-30T17:22:17.004721+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:22:17.004721+0000","last_peered":"2023-11-30T17:22:17.004721+0000","last_clean":"2023-11-30T17:22:17.004721+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:22:17.004721+0000","last_undegraded":"2023-11-30T17:22:17.004721+0000","last_fullsized":"2023-11-30T17:22:17.004721+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335131+0000","last_change":"2023-11-30T17:22:21.332384+0000","last_active":"2023-11-30T17:22:21.335131+0000","last_peered":"2023-11-30T17:22:21.335131+0000","last_clean":"2023-11-30T17:22:21.335131+0000","last_became_active":"2023-11-30T17:22:21.332098+0000","last_became_peered":"2023-11-30T17:22:21.332098+0000","last_unstale":"2023-11-30T17:22:21.335131+0000","last_undegraded":"2023-11-30T17:22:21.335131+0000","last_fullsized":"2023-11-30T17:22:21.335131+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337701+0000","last_change":"2023-11-30T17:22:20.934641+0000","last_active":"2023-11-30T17:22:21.337701+0000","last_peered":"2023-11-30T17:22:21.337701+0000","last_clean":"2023-11-30T17:22:21.337701+0000","last_became_active":"2023-11-30T17:22:20.934355+0000","last_became_peered":"2023-11-30T17:22:20.934355+0000","last_unstale":"2023-11-30T17:22:21.337701+0000","last_undegraded":"2023-11-30T17:22:21.337701+0000","last_fullsized":"2023-11-30T17:22:21.337701+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-30T17:22:17.004656+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:22:17.004656+0000","last_peered":"2023-11-30T17:22:17.004656+0000","last_clean":"2023-11-30T17:22:17.004656+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:22:17.004656+0000","last_undegraded":"2023-11-30T17:22:17.004656+0000","last_fullsized":"2023-11-30T17:22:17.004656+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":62,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-30T17:22:17.004678+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:22:17.004678+0000","last_peered":"2023-11-30T17:22:17.004678+0000","last_clean":"2023-11-30T17:22:17.004678+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:22:17.004678+0000","last_undegraded":"2023-11-30T17:22:17.004678+0000","last_fullsized":"2023-11-30T17:22:17.004678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.316533+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:22:21.316533+0000","last_peered":"2023-11-30T17:22:21.316533+0000","last_clean":"2023-11-30T17:22:21.316533+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:22:21.316533+0000","last_undegraded":"2023-11-30T17:22:21.316533+0000","last_fullsized":"2023-11-30T17:22:21.316533+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:20.908484+0000","last_change":"2023-11-30T17:22:20.908484+0000","last_active":"2023-11-30T17:22:20.908484+0000","last_peered":"2023-11-30T17:22:20.908484+0000","last_clean":"2023-11-30T17:22:20.908484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:20.908484+0000","last_undegraded":"2023-11-30T17:22:20.908484+0000","last_fullsized":"2023-11-30T17:22:20.908484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:19.906108+0000","last_change":"2023-11-30T17:22:19.906108+0000","last_active":"2023-11-30T17:22:19.906108+0000","last_peered":"2023-11-30T17:22:19.906108+0000","last_clean":"2023-11-30T17:22:19.906108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:19.906108+0000","last_undegraded":"2023-11-30T17:22:19.906108+0000","last_fullsized":"2023-11-30T17:22:19.906108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-30T17:22:16.190486+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:22:16.190486+0000","last_peered":"2023-11-30T17:22:16.190486+0000","last_clean":"2023-11-30T17:22:16.190486+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:22:16.190486+0000","last_undegraded":"2023-11-30T17:22:16.190486+0000","last_fullsized":"2023-11-30T17:22:16.190486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":1268,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":44,"acting":44,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575030,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298016,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073824,"statfs":{"total":96636764160,"available":96331595776,"internally_reserved":0,"allocated":942080,"data_stored":467079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58899999999999997,"15min":0.57299999999999995},"min":{"1min":0.48499999999999999,"5min":0.315,"15min":0.23899999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.81100000000000005},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.57899999999999996},"min":{"1min":0.41999999999999998,"5min":0.40699999999999997,"15min":0.32200000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.81899999999999995},"last":0.68600000000000005}]},{"osd":1,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54800000000000004,"15min":0.54000000000000004},"min":{"1min":0.40600000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.41499999999999998,"5min":0.29899999999999999,"15min":0.28799999999999998},"max":{"1min":0.71799999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.47799999999999998,"5min":0.33500000000000002,"15min":0.32800000000000001},"max":{"1min":0.77000000000000002,"5min":0.77200000000000002,"15min":0.78300000000000003},"last":0.627},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56100000000000005,"15min":0.55600000000000005},"min":{"1min":0.48299999999999998,"5min":0.35399999999999998,"15min":0.28699999999999998},"max":{"1min":0.73699999999999999,"5min":0.73799999999999999,"15min":0.83899999999999997},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.44800000000000001,"5min":0.36499999999999999,"15min":0.33200000000000002},"max":{"1min":0.749,"5min":0.754,"15min":0.78000000000000003},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.45800000000000002,"5min":0.40799999999999997,"15min":0.33900000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.67500000000000004}]},{"osd":4,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.45300000000000001,"15min":0.46500000000000002},"min":{"1min":0.34200000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.79900000000000004},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47099999999999997,"15min":0.48999999999999999},"min":{"1min":0.33400000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.748,"5min":0.75800000000000001,"15min":1.3180000000000001},"last":0.44500000000000001}]},{"osd":5,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.48899999999999999,"15min":0.498},"min":{"1min":0.34300000000000003,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.82899999999999996},"last":0.5},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.872},"last":0.52200000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54700000000000004,"15min":0.55400000000000005},"min":{"1min":0.42499999999999999,"5min":0.372,"15min":0.36099999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.85199999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.54900000000000004,"15min":0.55400000000000005},"min":{"1min":0.44600000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78900000000000003,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.54000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575029,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302124,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069716,"statfs":{"total":96636764160,"available":96327389184,"internally_reserved":0,"allocated":954368,"data_stored":472988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55100000000000005,"15min":0.56499999999999995},"min":{"1min":0.32500000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71299999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.623},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.58199999999999996},"min":{"1min":0.33500000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.72199999999999998,"5min":0.79600000000000004,"15min":0.89300000000000002},"last":0.48299999999999998}]},{"osd":1,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.376,"5min":0.30599999999999999,"15min":0.26400000000000001},"max":{"1min":0.74199999999999999,"5min":0.77500000000000002,"15min":0.82799999999999996},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58299999999999996,"15min":0.59299999999999997},"min":{"1min":0.44600000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.74099999999999999,"5min":0.82499999999999996,"15min":0.85199999999999998},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.45000000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.68799999999999994,"5min":0.79900000000000004,"15min":0.82599999999999996},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.46700000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72799999999999998,"5min":0.80900000000000005,"15min":0.82499999999999996},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51500000000000001,"15min":0.53200000000000003},"min":{"1min":0.34300000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69099999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.443},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.40200000000000002,"5min":0.33100000000000002,"15min":0.32200000000000001},"max":{"1min":0.73099999999999998,"5min":0.75600000000000001,"15min":0.79600000000000004},"last":0.73199999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.44700000000000001,"15min":0.45400000000000001},"min":{"1min":0.35499999999999998,"5min":0.29599999999999999,"15min":0.28999999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.84199999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46300000000000002,"15min":0.47899999999999998},"min":{"1min":0.36499999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.65500000000000003,"5min":0.76000000000000001,"15min":0.83899999999999997},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.46100000000000002,"15min":0.47099999999999997},"min":{"1min":0.35199999999999998,"5min":0.29899999999999999,"15min":0.28299999999999997},"max":{"1min":0.65200000000000002,"5min":0.69399999999999995,"15min":0.74299999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.50700000000000001},"min":{"1min":0.371,"5min":0.33500000000000002,"15min":0.31900000000000001},"max":{"1min":0.70399999999999996,"5min":0.745,"15min":0.78500000000000003},"last":0.48999999999999999}]},{"osd":7,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51700000000000002,"15min":0.53300000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73299999999999998,"5min":0.80700000000000005,"15min":0.93200000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55300000000000005,"15min":0.56299999999999994},"min":{"1min":0.39500000000000002,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.86499999999999999},"last":0.81299999999999994}]}]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302188,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069652,"statfs":{"total":96636764160,"available":96327323648,"internally_reserved":0,"allocated":1019904,"data_stored":500639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.35999999999999999,"15min":0.35099999999999998},"min":{"1min":0.29599999999999999,"5min":0.23899999999999999,"15min":0.23000000000000001},"max":{"1min":0.54900000000000004,"5min":0.57199999999999995,"15min":0.60299999999999998},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.502,"5min":0.46999999999999997,"15min":0.46100000000000002},"min":{"1min":0.39200000000000002,"5min":0.314,"15min":0.309},"max":{"1min":0.59899999999999998,"5min":0.748,"15min":0.75700000000000001},"last":0.45900000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.39100000000000001,"15min":0.379},"min":{"1min":0.28599999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.56999999999999995,"5min":0.59799999999999998,"15min":0.67300000000000004},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.50800000000000001,"15min":0.48999999999999999},"min":{"1min":0.438,"5min":0.33400000000000002,"15min":0.29499999999999998},"max":{"1min":0.64200000000000002,"5min":0.78200000000000003,"15min":0.80700000000000005},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45100000000000001,"15min":0.441},"min":{"1min":0.38200000000000001,"5min":0.29899999999999999,"15min":0.23899999999999999},"max":{"1min":0.57099999999999995,"5min":0.70299999999999996,"15min":0.749},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.437,"15min":0.42599999999999999},"min":{"1min":0.34100000000000003,"5min":0.29999999999999999,"15min":0.28599999999999998},"max":{"1min":0.55700000000000005,"5min":0.71899999999999997,"15min":0.73699999999999999},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.44400000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.873,"5min":0.88500000000000001,"15min":0.89100000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.61199999999999999,"15min":0.61499999999999999},"min":{"1min":0.48599999999999999,"5min":0.41299999999999998,"15min":0.39900000000000002},"max":{"1min":0.753,"5min":0.97599999999999998,"15min":1.111},"last":0.60199999999999998}]},{"osd":5,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59799999999999998,"15min":0.59899999999999998},"min":{"1min":0.44400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.85399999999999998,"5min":1.006,"15min":1.006},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.434,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76500000000000001,"5min":0.81399999999999995,"15min":0.91300000000000003},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.56699999999999995,"5min":0.39700000000000002,"15min":0.39600000000000002},"max":{"1min":0.85699999999999998,"5min":0.92700000000000005,"15min":1.0600000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65200000000000002,"15min":0.65800000000000003},"min":{"1min":0.51600000000000001,"5min":0.433,"15min":0.379},"max":{"1min":0.91100000000000003,"5min":0.96099999999999997,"15min":1.0780000000000001},"last":0.745}]},{"osd":7,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67000000000000004,"15min":0.66300000000000003},"min":{"1min":0.45100000000000001,"5min":0.41899999999999998,"15min":0.41699999999999998},"max":{"1min":0.88900000000000001,"5min":0.92300000000000004,"15min":0.98699999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64000000000000001,"15min":0.64700000000000002},"min":{"1min":0.52500000000000002,"5min":0.436,"15min":0.39900000000000002},"max":{"1min":0.81999999999999995,"5min":0.879,"15min":0.94199999999999995},"last":0.59499999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575030,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302172,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069668,"statfs":{"total":96636764160,"available":96327340032,"internally_reserved":0,"allocated":1003520,"data_stored":499883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.373,"15min":0.35999999999999999},"min":{"1min":0.27500000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.48599999999999999,"5min":0.59999999999999998,"15min":0.71199999999999997},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.39100000000000001,"15min":0.379},"min":{"1min":0.26500000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.26100000000000001}]},{"osd":2,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.39100000000000001,"15min":0.38},"min":{"1min":0.29499999999999998,"5min":0.247,"15min":0.23899999999999999},"max":{"1min":0.55900000000000005,"5min":0.623,"15min":0.623},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.46300000000000002,"15min":0.45300000000000001},"min":{"1min":0.38100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.63400000000000001,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.313}]},{"osd":3,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.433,"15min":0.42599999999999999},"min":{"1min":0.32500000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.58599999999999997,"5min":0.66100000000000003,"15min":0.70999999999999996},"last":0.245},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44700000000000001,"15min":0.435},"min":{"1min":0.34300000000000003,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.56200000000000006,"5min":0.65400000000000003,"15min":0.68799999999999994},"last":0.27300000000000002}]},{"osd":4,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60999999999999999,"15min":0.59999999999999998},"min":{"1min":0.44900000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76400000000000001,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.50800000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.85399999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60899999999999999,"15min":0.59499999999999997},"min":{"1min":0.47399999999999998,"5min":0.39200000000000002,"15min":0.36199999999999999},"max":{"1min":0.83499999999999996,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63700000000000001,"15min":0.623},"min":{"1min":0.51500000000000001,"5min":0.38400000000000001,"15min":0.38},"max":{"1min":0.77700000000000002,"5min":1.004,"15min":1.004},"last":0.54500000000000004}]},{"osd":6,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65100000000000002,"15min":0.63900000000000001},"min":{"1min":0.435,"5min":0.376,"15min":0.376},"max":{"1min":0.89800000000000002,"5min":1.002,"15min":1.002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63900000000000001,"15min":0.627},"min":{"1min":0.496,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.872,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66000000000000003,"15min":0.64600000000000002},"min":{"1min":0.498,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94499999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.69699999999999995,"15min":0.68200000000000005},"min":{"1min":0.56100000000000005,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.93799999999999994,"5min":1.026,"15min":1.026},"last":0.63600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575030,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306264,"kb_used_data":976,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065576,"statfs":{"total":96636764160,"available":96323149824,"internally_reserved":0,"allocated":999424,"data_stored":493775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40400000000000003,"15min":0.38800000000000001},"min":{"1min":0.31,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.57099999999999995,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":3.4729999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.42899999999999999,"15min":0.42699999999999999},"min":{"1min":0.33800000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58899999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":2.637}]},{"osd":1,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45300000000000001,"15min":0.44},"min":{"1min":0.36799999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.63800000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":6.1210000000000004},{"interface":"front","average":{"1min":0.505,"5min":0.47799999999999998,"15min":0.46700000000000003},"min":{"1min":0.33400000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.67500000000000004,"5min":1.206,"15min":1.206},"last":5.7270000000000003}]},{"osd":3,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38600000000000001,"15min":0.39700000000000002},"min":{"1min":0.27200000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.56200000000000006,"5min":0.63500000000000001,"15min":0.86199999999999999},"last":0.438},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.46000000000000002},"min":{"1min":0.40999999999999998,"5min":0.26900000000000002,"15min":0.26200000000000001},"max":{"1min":0.60099999999999998,"5min":1.226,"15min":1.226},"last":1.756}]},{"osd":4,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61899999999999999,"15min":0.60999999999999999},"min":{"1min":0.46100000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84699999999999998,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":8.7170000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.78500000000000003,"5min":1.492,"15min":1.492},"last":1.381}]},{"osd":5,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63400000000000001,"15min":0.629},"min":{"1min":0.503,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94699999999999995,"5min":0.996,"15min":0.996},"last":3.4359999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.623,"15min":0.624},"min":{"1min":0.48899999999999999,"5min":0.38900000000000001,"15min":0.38100000000000001},"max":{"1min":0.79900000000000004,"5min":1.292,"15min":1.292},"last":1.982}]},{"osd":6,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.625,"15min":0.621},"min":{"1min":0.47499999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.76600000000000001,"5min":1.359,"15min":1.359},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.53300000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.879,"5min":1.159,"15min":1.159},"last":1.861}]},{"osd":7,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.57299999999999995,"5min":0.45200000000000001,"15min":0.40300000000000002},"max":{"1min":0.88600000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":4.6849999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67600000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.41499999999999998},"max":{"1min":0.93100000000000005,"5min":1.125,"15min":1.125},"last":4.5039999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575029,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306220,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065620,"statfs":{"total":96636764160,"available":96323194880,"internally_reserved":0,"allocated":954368,"data_stored":472988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35799999999999998,"15min":0.36199999999999999},"min":{"1min":0.26800000000000002,"5min":0.219,"15min":0.217},"max":{"1min":0.47899999999999998,"5min":0.57699999999999996,"15min":0.66200000000000003},"last":0.377},{"interface":"front","average":{"1min":0.434,"5min":0.40699999999999997,"15min":0.40000000000000002},"min":{"1min":0.30199999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.57199999999999995,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.26700000000000002}]},{"osd":1,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.38,"15min":0.38600000000000001},"min":{"1min":0.30199999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.42199999999999999,"15min":0.42999999999999999},"min":{"1min":0.32300000000000001,"5min":0.26600000000000001,"15min":0.25900000000000001},"max":{"1min":0.54500000000000004,"5min":0.65900000000000003,"15min":0.84399999999999997},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.44400000000000001,"15min":0.44800000000000001},"min":{"1min":0.32800000000000001,"5min":0.28599999999999998,"15min":0.26000000000000001},"max":{"1min":0.66000000000000003,"5min":0.72999999999999998,"15min":0.94899999999999995},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.505,"15min":0.505},"min":{"1min":0.41199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.63700000000000001,"5min":1.054,"15min":1.054},"last":0.41199999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59699999999999998,"15min":0.60399999999999998},"min":{"1min":0.45000000000000001,"5min":0.35299999999999998,"15min":0.35099999999999998},"max":{"1min":0.75900000000000001,"5min":0.91500000000000004,"15min":0.97599999999999998},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.47299999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78300000000000003,"5min":0.86799999999999999,"15min":0.91400000000000003},"last":0.61699999999999999}]},{"osd":5,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.59099999999999997,"15min":0.61099999999999999},"min":{"1min":0.42599999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82299999999999995,"5min":0.85399999999999998,"15min":0.98399999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77500000000000002,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.68200000000000005}]},{"osd":6,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.626,"15min":0.64500000000000002},"min":{"1min":0.48699999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81200000000000006,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.627},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.49399999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81200000000000006,"5min":0.89500000000000002,"15min":1.0389999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65600000000000003,"15min":0.66600000000000004},"min":{"1min":0.503,"5min":0.40500000000000003,"15min":0.39100000000000001},"max":{"1min":0.83699999999999997,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64800000000000002,"15min":0.66000000000000003},"min":{"1min":0.49199999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.004},"last":0.60299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575029,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302124,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069716,"statfs":{"total":96636764160,"available":96327389184,"internally_reserved":0,"allocated":954368,"data_stored":472988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.52500000000000002,"15min":0.52800000000000002},"min":{"1min":0.30599999999999999,"5min":0.28299999999999997,"15min":0.27500000000000002},"max":{"1min":0.748,"5min":0.77700000000000002,"15min":0.80900000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.28399999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.81999999999999995,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.442}]},{"osd":1,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.25800000000000001},"max":{"1min":0.69699999999999995,"5min":0.73799999999999999,"15min":0.79600000000000004},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54500000000000004,"15min":0.54600000000000004},"min":{"1min":0.34499999999999997,"5min":0.317,"15min":0.246},"max":{"1min":0.72499999999999998,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.41199999999999998,"5min":0.376,"15min":0.27800000000000002},"max":{"1min":0.755,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.39600000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71099999999999997,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55000000000000004,"15min":0.54600000000000004},"min":{"1min":0.42599999999999999,"5min":0.34699999999999998,"15min":0.32900000000000001},"max":{"1min":0.71299999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.40999999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74299999999999999,"5min":0.78900000000000003,"15min":0.80600000000000005},"last":0.59399999999999997}]},{"osd":5,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.438,"15min":0.44700000000000001},"min":{"1min":0.32900000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.58099999999999996,"5min":1.272,"15min":1.272},"last":0.63},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46100000000000002,"15min":0.46400000000000002},"min":{"1min":0.34300000000000003,"5min":0.29899999999999999,"15min":0.29199999999999998},"max":{"1min":0.54000000000000004,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.501,"15min":0.505},"min":{"1min":0.38100000000000001,"5min":0.33900000000000002,"15min":0.314},"max":{"1min":0.63800000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54800000000000004,"15min":0.54000000000000004},"min":{"1min":0.45800000000000002,"5min":0.373,"15min":0.33800000000000002},"max":{"1min":0.61699999999999999,"5min":1.129,"15min":1.129},"last":0.75}]},{"osd":7,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34300000000000003,"5min":0.318,"15min":0.29899999999999999},"max":{"1min":0.66900000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.44900000000000001,"5min":0.38600000000000001,"15min":0.34599999999999997},"max":{"1min":0.70799999999999996,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.76700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575029,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302124,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069716,"statfs":{"total":96636764160,"available":96327389184,"internally_reserved":0,"allocated":954368,"data_stored":472988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53300000000000003,"15min":0.53600000000000003},"min":{"1min":0.40600000000000003,"5min":0.34399999999999997,"15min":0.32800000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.40899999999999997,"5min":0.31,"15min":0.31},"max":{"1min":0.70299999999999996,"5min":0.76200000000000001,"15min":0.81799999999999995},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52100000000000002,"15min":0.52800000000000002},"min":{"1min":0.35399999999999998,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.67100000000000004,"5min":0.69599999999999995,"15min":0.72399999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55000000000000004,"15min":0.54600000000000004},"min":{"1min":0.44900000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.745,"5min":0.754,"15min":0.77000000000000002},"last":0.45100000000000001}]},{"osd":2,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.40000000000000002,"5min":0.34399999999999997,"15min":0.30599999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.60099999999999998,"15min":0.59499999999999997},"min":{"1min":0.48699999999999999,"5min":0.378,"15min":0.34499999999999997},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.44800000000000001,"5min":0.36699999999999999,"15min":0.36399999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.73799999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.45600000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73299999999999998,"5min":0.79200000000000004,"15min":0.82099999999999995},"last":0.60499999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42399999999999999,"15min":0.44},"min":{"1min":0.307,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57699999999999996,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.372},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45800000000000002,"15min":0.46700000000000003},"min":{"1min":0.31900000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.77600000000000002},"last":0.39800000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47599999999999998,"15min":0.48599999999999999},"min":{"1min":0.34200000000000003,"5min":0.29599999999999999,"15min":0.28499999999999998},"max":{"1min":0.70499999999999996,"5min":0.73999999999999999,"15min":0.82099999999999995},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.67500000000000004,"5min":0.81399999999999995,"15min":0.88200000000000001},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52000000000000002,"15min":0.52600000000000002},"min":{"1min":0.33100000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.73899999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.41799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.84599999999999997},"last":0.43099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:22:26.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3c is not active+clean 2023-11-30T17:22:26.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3d is not active+clean 2023-11-30T17:22:26.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2023-11-30T17:22:26.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2023-11-30T17:22:26.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2023-11-30T17:22:26.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.38 is not active+clean 2023-11-30T17:22:26.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2023-11-30T17:22:26.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3b is not active+clean 2023-11-30T17:22:26.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2023-11-30T17:22:26.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.34 is not active+clean 2023-11-30T17:22:26.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2023-11-30T17:22:26.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.35 is not active+clean 2023-11-30T17:22:26.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.36 is not active+clean 2023-11-30T17:22:26.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.37 is not active+clean 2023-11-30T17:22:26.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2023-11-30T17:22:26.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2023-11-30T17:22:26.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.31 is not active+clean 2023-11-30T17:22:26.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2023-11-30T17:22:26.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.32 is not active+clean 2023-11-30T17:22:26.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2023-11-30T17:22:26.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.33 is not active+clean 2023-11-30T17:22:26.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2c is not active+clean 2023-11-30T17:22:26.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2023-11-30T17:22:26.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2d is not active+clean 2023-11-30T17:22:26.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2023-11-30T17:22:26.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2e is not active+clean 2023-11-30T17:22:26.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2023-11-30T17:22:26.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.28 is not active+clean 2023-11-30T17:22:26.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2023-11-30T17:22:26.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.29 is not active+clean 2023-11-30T17:22:26.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2023-11-30T17:22:26.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2a is not active+clean 2023-11-30T17:22:26.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2023-11-30T17:22:26.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2b is not active+clean 2023-11-30T17:22:26.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2023-11-30T17:22:26.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.25 is not active+clean 2023-11-30T17:22:26.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2023-11-30T17:22:26.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.26 is not active+clean 2023-11-30T17:22:26.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.27 is not active+clean 2023-11-30T17:22:26.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2023-11-30T17:22:26.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.21 is not active+clean 2023-11-30T17:22:26.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2023-11-30T17:22:26.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.22 is not active+clean 2023-11-30T17:22:26.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.23 is not active+clean 2023-11-30T17:22:26.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2023-11-30T17:22:26.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2023-11-30T17:22:26.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2023-11-30T17:22:26.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2023-11-30T17:22:26.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2023-11-30T17:22:26.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2023-11-30T17:22:26.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2023-11-30T17:22:26.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2023-11-30T17:22:26.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2023-11-30T17:22:26.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2023-11-30T17:22:26.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2023-11-30T17:22:26.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2023-11-30T17:22:26.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.16 is not active+clean 2023-11-30T17:22:26.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2023-11-30T17:22:26.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2023-11-30T17:22:26.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2023-11-30T17:22:26.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2023-11-30T17:22:26.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-11-30T17:22:26.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2023-11-30T17:22:26.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.12 is not active+clean 2023-11-30T17:22:26.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2023-11-30T17:22:26.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2023-11-30T17:22:26.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2023-11-30T17:22:26.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2023-11-30T17:22:26.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-11-30T17:22:26.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.7 is not active+clean 2023-11-30T17:22:26.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.0 is not active+clean 2023-11-30T17:22:26.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2023-11-30T17:22:26.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2023-11-30T17:22:26.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2023-11-30T17:22:26.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2023-11-30T17:22:26.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2023-11-30T17:22:26.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2023-11-30T17:22:26.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.a is not active+clean 2023-11-30T17:22:26.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-11-30T17:22:26.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2023-11-30T17:22:26.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2023-11-30T17:22:26.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2023-11-30T17:22:26.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2023-11-30T17:22:26.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2023-11-30T17:22:26.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2023-11-30T17:22:26.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2023-11-30T17:22:26.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.f is not active+clean 2023-11-30T17:22:26.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:20.908484+0000', 'last_change': '2023-11-30T17:22:20.908484+0000', 'last_active': '2023-11-30T17:22:20.908484+0000', 'last_peered': '2023-11-30T17:22:20.908484+0000', 'last_clean': '2023-11-30T17:22:20.908484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:20.908484+0000', 'last_undegraded': '2023-11-30T17:22:20.908484+0000', 'last_fullsized': '2023-11-30T17:22:20.908484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:20.908484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2023-11-30T17:22:26.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:19.906108+0000', 'last_change': '2023-11-30T17:22:19.906108+0000', 'last_active': '2023-11-30T17:22:19.906108+0000', 'last_peered': '2023-11-30T17:22:19.906108+0000', 'last_clean': '2023-11-30T17:22:19.906108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:19.906108+0000', 'last_undegraded': '2023-11-30T17:22:19.906108+0000', 'last_fullsized': '2023-11-30T17:22:19.906108+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:19.906108+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:22:26.093 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-30T17:22:26.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.226+0000 7fa863f28700 1 Processor -- start 2023-11-30T17:22:26.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.226+0000 7fa863f28700 1 -- start start 2023-11-30T17:22:26.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.227+0000 7fa863f28700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa85c06a610 0x7fa85c0a8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:26.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.227+0000 7fa863f28700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa85c0c69a0 con 0x7fa85c1544e0 2023-11-30T17:22:26.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.227+0000 7fa863f28700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa85c0c13a0 con 0x7fa85c1548c0 2023-11-30T17:22:26.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.227+0000 7fa863f28700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c0c1680 con 0x7fa85c06a610 2023-11-30T17:22:26.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.227+0000 7fa861cc4700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa85c1544e0 0x7fa85c0c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34102/0 (socket says 172.21.15.49:34102) 2023-11-30T17:22:26.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.227+0000 7fa861cc4700 1 -- 172.21.15.49:0/387891748 learned_addr learned my addr 172.21.15.49:0/387891748 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:26.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.227+0000 7fa860cc2700 1 -- 172.21.15.49:0/387891748 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111000425 0 0) 0x7fa85c0c69a0 con 0x7fa85c1544e0 2023-11-30T17:22:26.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.227+0000 7fa8624c5700 1 --2- 172.21.15.49:0/387891748 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa85c06a610 0x7fa85c0a8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:26.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.227+0000 7fa860cc2700 1 -- 172.21.15.49:0/387891748 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8440033f0 con 0x7fa85c1544e0 2023-11-30T17:22:26.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.227+0000 7fa860cc2700 1 -- 172.21.15.49:0/387891748 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4217356691 0 0) 0x7fa8440033f0 con 0x7fa85c1544e0 2023-11-30T17:22:26.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.227+0000 7fa860cc2700 1 -- 172.21.15.49:0/387891748 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa85c06a610 msgr2=0x7fa85c0a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:26.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.227+0000 7fa860cc2700 1 --2- 172.21.15.49:0/387891748 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa85c06a610 0x7fa85c0a8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:26.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.227+0000 7fa860cc2700 1 -- 172.21.15.49:0/387891748 >> v1:172.21.15.115:6789/0 conn(0x7fa85c1548c0 legacy=0x7fa85c0c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:26.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.227+0000 7fa860cc2700 1 -- 172.21.15.49:0/387891748 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa85c0c6630 con 0x7fa85c1544e0 2023-11-30T17:22:26.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.227+0000 7fa860cc2700 1 -- 172.21.15.49:0/387891748 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fa854001970 con 0x7fa85c1544e0 2023-11-30T17:22:26.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.228+0000 7fa860cc2700 1 -- 172.21.15.49:0/387891748 >> v1:172.21.15.49:6789/0 conn(0x7fa85c1544e0 legacy=0x7fa85c0c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:26.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.228+0000 7fa860cc2700 1 --2- 172.21.15.49:0/387891748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa844003910 0x7fa844003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:26.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.228+0000 7fa860cc2700 1 --2- 172.21.15.49:0/387891748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa844004690 0x7fa844004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:26.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.228+0000 7fa860cc2700 1 --2- 172.21.15.49:0/387891748 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa85c06a610 0x7fa844005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:26.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.228+0000 7fa860cc2700 1 -- 172.21.15.49:0/387891748 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c0c1680 con 0x7fa844003910 2023-11-30T17:22:26.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.228+0000 7fa860cc2700 1 -- 172.21.15.49:0/387891748 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84400b910 con 0x7fa844004690 2023-11-30T17:22:26.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.228+0000 7fa860cc2700 1 -- 172.21.15.49:0/387891748 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84400bad0 con 0x7fa85c06a610 2023-11-30T17:22:26.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.228+0000 7fa861cc4700 1 --2- 172.21.15.49:0/387891748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa844003910 0x7fa844003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:26.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.228+0000 7fa8614c3700 1 --2- 172.21.15.49:0/387891748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa844004690 0x7fa844004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:26.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.228+0000 7fa8624c5700 1 --2- 172.21.15.49:0/387891748 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa85c06a610 0x7fa844005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:26.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.228+0000 7fa861cc4700 1 -- 172.21.15.49:0/387891748 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa85c06a610 msgr2=0x7fa844005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:26.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.228+0000 7fa861cc4700 1 --2- 172.21.15.49:0/387891748 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa85c06a610 0x7fa844005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:26.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.228+0000 7fa861cc4700 1 -- 172.21.15.49:0/387891748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa844004690 msgr2=0x7fa844004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:26.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.228+0000 7fa861cc4700 1 --2- 172.21.15.49:0/387891748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa844004690 0x7fa844004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:26.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.228+0000 7fa861cc4700 1 -- 172.21.15.49:0/387891748 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8440033f0 con 0x7fa844003910 2023-11-30T17:22:26.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.228+0000 7fa861cc4700 1 --2- 172.21.15.49:0/387891748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa844003910 0x7fa844003d30 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7fa85400c5f0 tx=0x7fa854007b20).ready entity=mon.0 client_cookie=951404f5d655b592 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:26.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.228+0000 7fa860cc2700 1 -- 172.21.15.49:0/387891748 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa854007d50 con 0x7fa844003910 2023-11-30T17:22:26.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.228+0000 7fa860cc2700 1 -- 172.21.15.49:0/387891748 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85400cdf0 con 0x7fa844003910 2023-11-30T17:22:26.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.228+0000 7fa860cc2700 1 -- 172.21.15.49:0/387891748 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa854005c00 con 0x7fa844003910 2023-11-30T17:22:26.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.229+0000 7fa863f28700 1 -- 172.21.15.49:0/387891748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa844003910 msgr2=0x7fa844003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:26.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.229+0000 7fa863f28700 1 --2- 172.21.15.49:0/387891748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa844003910 0x7fa844003d30 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7fa85400c5f0 tx=0x7fa854007b20).stop 2023-11-30T17:22:26.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.229+0000 7fa8624c5700 1 -- 172.21.15.49:0/387891748 reap_dead start 2023-11-30T17:22:26.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.229+0000 7fa863f28700 1 -- 172.21.15.49:0/387891748 shutdown_connections 2023-11-30T17:22:26.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.229+0000 7fa863f28700 1 -- 172.21.15.49:0/387891748 >> 172.21.15.49:0/387891748 conn(0x7fa85c085020 msgr2=0x7fa85c094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:26.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.229+0000 7fa863f28700 1 -- 172.21.15.49:0/387891748 shutdown_connections 2023-11-30T17:22:26.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.229+0000 7fa863f28700 1 -- 172.21.15.49:0/387891748 wait complete. 2023-11-30T17:22:26.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.230+0000 7fa863f28700 1 Processor -- start 2023-11-30T17:22:26.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.230+0000 7fa863f28700 1 -- start start 2023-11-30T17:22:26.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.231+0000 7fa863f28700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa844003910 0x7fa85c14f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:26.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.231+0000 7fa863f28700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa85c152f10 0x7fa85c148e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:26.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.231+0000 7fa863f28700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa85c0c4a10 0x7fa85c0c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:26.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.231+0000 7fa863f28700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c095ac0 con 0x7fa85c152f10 2023-11-30T17:22:26.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.231+0000 7fa863f28700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c0c5360 con 0x7fa85c0c4a10 2023-11-30T17:22:26.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.231+0000 7fa863f28700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c095140 con 0x7fa844003910 2023-11-30T17:22:26.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.231+0000 7fa8614c3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa85c152f10 0x7fa85c148e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:26.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.231+0000 7fa8614c3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa85c152f10 0x7fa85c148e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53816/0 (socket says 172.21.15.49:53816) 2023-11-30T17:22:26.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.231+0000 7fa8614c3700 1 -- 172.21.15.49:0/2437734251 learned_addr learned my addr 172.21.15.49:0/2437734251 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:26.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.231+0000 7fa8624c5700 1 --2- 172.21.15.49:0/2437734251 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa85c0c4a10 0x7fa85c0c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:26.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.231+0000 7fa861cc4700 1 --2- 172.21.15.49:0/2437734251 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa844003910 0x7fa85c14f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:26.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.231+0000 7fa8614c3700 1 -- 172.21.15.49:0/2437734251 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa844003910 msgr2=0x7fa85c14f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:26.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.231+0000 7fa8614c3700 1 --2- 172.21.15.49:0/2437734251 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa844003910 0x7fa85c14f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:26.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.231+0000 7fa8614c3700 1 -- 172.21.15.49:0/2437734251 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa85c0c4a10 msgr2=0x7fa85c0c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:26.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.231+0000 7fa8614c3700 1 --2- 172.21.15.49:0/2437734251 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa85c0c4a10 0x7fa85c0c4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:26.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.231+0000 7fa8614c3700 1 -- 172.21.15.49:0/2437734251 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa85c095400 con 0x7fa85c152f10 2023-11-30T17:22:26.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.231+0000 7fa8614c3700 1 --2- 172.21.15.49:0/2437734251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa85c152f10 0x7fa85c148e00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7fa8500028c0 tx=0x7fa850007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:26.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.232+0000 7fa859ffb700 1 -- 172.21.15.49:0/2437734251 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa850011590 con 0x7fa85c152f10 2023-11-30T17:22:26.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.232+0000 7fa859ffb700 1 -- 172.21.15.49:0/2437734251 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8500116f0 con 0x7fa85c152f10 2023-11-30T17:22:26.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.232+0000 7fa863f28700 1 -- 172.21.15.49:0/2437734251 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa85c0956e0 con 0x7fa85c152f10 2023-11-30T17:22:26.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.232+0000 7fa859ffb700 1 -- 172.21.15.49:0/2437734251 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa850011a70 con 0x7fa85c152f10 2023-11-30T17:22:26.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.232+0000 7fa863f28700 1 -- 172.21.15.49:0/2437734251 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa85c153390 con 0x7fa85c152f10 2023-11-30T17:22:26.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.233+0000 7fa859ffb700 1 -- 172.21.15.49:0/2437734251 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa850014450 con 0x7fa85c152f10 2023-11-30T17:22:26.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.233+0000 7fa863f28700 1 -- 172.21.15.49:0/2437734251 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa85c095c00 con 0x7fa85c152f10 2023-11-30T17:22:26.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.233+0000 7fa859ffb700 1 --2- 172.21.15.49:0/2437734251 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa84805f240 0x7fa848061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:26.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.233+0000 7fa859ffb700 1 -- 172.21.15.49:0/2437734251 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fa850079fe0 con 0x7fa85c152f10 2023-11-30T17:22:26.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.234+0000 7fa861cc4700 1 --2- 172.21.15.49:0/2437734251 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa84805f240 0x7fa848061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:26.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.234+0000 7fa861cc4700 1 --2- 172.21.15.49:0/2437734251 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa84805f240 0x7fa848061700 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fa854001270 tx=0x7fa854015000).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:26.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.237+0000 7fa859ffb700 1 -- 172.21.15.49:0/2437734251 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa85c095c00 con 0x7fa85c152f10 2023-11-30T17:22:26.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.480+0000 7fa863f28700 1 -- 172.21.15.49:0/2437734251 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa85c095c00 con 0x7fa85c152f10 2023-11-30T17:22:26.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.480+0000 7fa859ffb700 1 -- 172.21.15.49:0/2437734251 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+2760 (secure 0 0 0) 0x7fa85c095c00 con 0x7fa85c152f10 2023-11-30T17:22:26.483 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:26.483 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":928,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":83,"num_osds":8,"num_up_osds":8,"osd_up_since":1701364027,"num_in_osds":8,"osd_in_since":1701364021,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":21,"data_bytes":2306,"bytes_used":2479628288,"bytes_avail":770614484992,"bytes_total":773094113280},"fsmap":{"epoch":32,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":6228}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2023-11-30T17:22:09.231766+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-30T17:22:26.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.482+0000 7fa863f28700 1 -- 172.21.15.49:0/2437734251 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa84805f240 msgr2=0x7fa848061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:26.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.482+0000 7fa863f28700 1 --2- 172.21.15.49:0/2437734251 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa84805f240 0x7fa848061700 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fa854001270 tx=0x7fa854015000).stop 2023-11-30T17:22:26.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.482+0000 7fa863f28700 1 -- 172.21.15.49:0/2437734251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa85c152f10 msgr2=0x7fa85c148e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:26.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.482+0000 7fa863f28700 1 --2- 172.21.15.49:0/2437734251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa85c152f10 0x7fa85c148e00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7fa8500028c0 tx=0x7fa850007bb0).stop 2023-11-30T17:22:26.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.483+0000 7fa863f28700 1 -- 172.21.15.49:0/2437734251 shutdown_connections 2023-11-30T17:22:26.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.483+0000 7fa863f28700 1 --2- 172.21.15.49:0/2437734251 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa85c0c4a10 0x7fa85c0c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:26.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.483+0000 7fa863f28700 1 --2- 172.21.15.49:0/2437734251 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa844003910 0x7fa85c14f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:26.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.483+0000 7fa863f28700 1 --2- 172.21.15.49:0/2437734251 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa84805f240 0x7fa848061700 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:26.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.483+0000 7fa863f28700 1 --2- 172.21.15.49:0/2437734251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa85c152f10 0x7fa85c148e00 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:26.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.483+0000 7fa863f28700 1 -- 172.21.15.49:0/2437734251 >> 172.21.15.49:0/2437734251 conn(0x7fa85c085020 msgr2=0x7fa85c0c9070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:26.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.483+0000 7fa863f28700 1 -- 172.21.15.49:0/2437734251 shutdown_connections 2023-11-30T17:22:26.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.483+0000 7fa863f28700 1 -- 172.21.15.49:0/2437734251 wait complete. 2023-11-30T17:22:26.497 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-30T17:22:26.497 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:22:26.580 INFO:tasks.ceph.mds.c.smithi049.stderr:2023-11-30T17:22:26.578+0000 7f083445a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-30T17:22:26.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.612+0000 7f1fbe427700 1 Processor -- start 2023-11-30T17:22:26.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.612+0000 7f1fbe427700 1 -- start start 2023-11-30T17:22:26.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.613+0000 7f1fbe427700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1fb81542d0 0x7f1fb80697f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:26.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.613+0000 7f1fbe427700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1fb8062e10 0x7f1fb80661b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:26.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.613+0000 7f1fbe427700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb8065760 con 0x7f1fb8069ce0 2023-11-30T17:22:26.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.613+0000 7f1fbe427700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb80c3250 con 0x7f1fb8062e10 2023-11-30T17:22:26.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.613+0000 7f1fbe427700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb806a340 con 0x7f1fb81542d0 2023-11-30T17:22:26.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.613+0000 7f1fbc9c4700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1fb8062e10 0x7f1fb80661b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:26.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.613+0000 7f1fbc9c4700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1fb8062e10 0x7f1fb80661b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53824/0 (socket says 172.21.15.49:53824) 2023-11-30T17:22:26.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.613+0000 7f1fbc9c4700 1 -- 172.21.15.49:0/590861416 learned_addr learned my addr 172.21.15.49:0/590861416 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:26.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.613+0000 7f1fb77fe700 1 --1- 172.21.15.49:0/590861416 >> v1:172.21.15.49:6789/0 conn(0x7f1fb8069ce0 0x7f1fb8062700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34104/0 (socket says 172.21.15.49:34104) 2023-11-30T17:22:26.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.614+0000 7f1fb7fff700 1 --2- 172.21.15.49:0/590861416 >> v2:172.21.15.115:3300/0 conn(0x7f1fb81542d0 0x7f1fb80697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:26.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.614+0000 7f1fbc9c4700 1 -- 172.21.15.49:0/590861416 >> v2:172.21.15.115:3300/0 conn(0x7f1fb81542d0 msgr2=0x7f1fb80697f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:26.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.614+0000 7f1fbc9c4700 1 --2- 172.21.15.49:0/590861416 >> v2:172.21.15.115:3300/0 conn(0x7f1fb81542d0 0x7f1fb80697f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:26.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.614+0000 7f1fbc9c4700 1 -- 172.21.15.49:0/590861416 >> v1:172.21.15.49:6789/0 conn(0x7f1fb8069ce0 legacy=0x7f1fb8062700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:26.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.614+0000 7f1fbc9c4700 1 -- 172.21.15.49:0/590861416 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb806a620 con 0x7f1fb8062e10 2023-11-30T17:22:26.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.614+0000 7f1fb6ffd700 1 -- 172.21.15.49:0/590861416 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857895113 0 0) 0x7f1fb8065760 con 0x7f1fb8069ce0 2023-11-30T17:22:26.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.614+0000 7f1fb7fff700 1 --2- 172.21.15.49:0/590861416 >> v2:172.21.15.115:3300/0 conn(0x7f1fb81542d0 0x7f1fb80697f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:26.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.614+0000 7f1fbc9c4700 1 --2- 172.21.15.49:0/590861416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fb8062e10 0x7f1fb80661b0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f1fb80961f0 tx=0x7f1fb0009840).ready entity=mon.0 client_cookie=9f735ee7a0ec962a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:26.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.614+0000 7f1fb6ffd700 1 -- 172.21.15.49:0/590861416 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb000e070 con 0x7f1fb8062e10 2023-11-30T17:22:26.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.614+0000 7f1fb6ffd700 1 -- 172.21.15.49:0/590861416 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb000ba50 con 0x7f1fb8062e10 2023-11-30T17:22:26.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.614+0000 7f1fb6ffd700 1 -- 172.21.15.49:0/590861416 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb000bdd0 con 0x7f1fb8062e10 2023-11-30T17:22:26.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.614+0000 7f1fbe427700 1 -- 172.21.15.49:0/590861416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fb8062e10 msgr2=0x7f1fb80661b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:26.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.614+0000 7f1fbe427700 1 --2- 172.21.15.49:0/590861416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fb8062e10 0x7f1fb80661b0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f1fb80961f0 tx=0x7f1fb0009840).stop 2023-11-30T17:22:26.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.615+0000 7f1fbe427700 1 -- 172.21.15.49:0/590861416 shutdown_connections 2023-11-30T17:22:26.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.615+0000 7f1fbe427700 1 --2- 172.21.15.49:0/590861416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fb8062e10 0x7f1fb80661b0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:26.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.615+0000 7f1fbe427700 1 --2- 172.21.15.49:0/590861416 >> v2:172.21.15.115:3300/0 conn(0x7f1fb81542d0 0x7f1fb80697f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:26.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.615+0000 7f1fbe427700 1 -- 172.21.15.49:0/590861416 >> 172.21.15.49:0/590861416 conn(0x7f1fb80c7fd0 msgr2=0x7f1fb80c83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:26.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.615+0000 7f1fbe427700 1 -- 172.21.15.49:0/590861416 shutdown_connections 2023-11-30T17:22:26.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.615+0000 7f1fbe427700 1 -- 172.21.15.49:0/590861416 wait complete. 2023-11-30T17:22:26.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.616+0000 7f1fbe427700 1 Processor -- start 2023-11-30T17:22:26.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.616+0000 7f1fbe427700 1 -- start start 2023-11-30T17:22:26.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.617+0000 7f1fbe427700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fb8062e10 0x7f1fb81674a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:26.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.617+0000 7f1fbe427700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fb8069ce0 0x7f1fb8167990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:26.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.617+0000 7f1fbe427700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1fb81542d0 0x7f1fb80ac340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:26.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.617+0000 7f1fbe427700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb8167e80 con 0x7f1fb8062e10 2023-11-30T17:22:26.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.617+0000 7f1fbe427700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb80a89b0 con 0x7f1fb8069ce0 2023-11-30T17:22:26.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.617+0000 7f1fbe427700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb80a7da0 con 0x7f1fb81542d0 2023-11-30T17:22:26.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.617+0000 7f1fb7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fb8062e10 0x7f1fb81674a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:26.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.617+0000 7f1fb7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fb8062e10 0x7f1fb81674a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53830/0 (socket says 172.21.15.49:53830) 2023-11-30T17:22:26.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.617+0000 7f1fb7fff700 1 -- 172.21.15.49:0/2213667055 learned_addr learned my addr 172.21.15.49:0/2213667055 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:26.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.617+0000 7f1fb77fe700 1 --2- 172.21.15.49:0/2213667055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fb8069ce0 0x7f1fb8167990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:26.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.617+0000 7f1fbc9c4700 1 --2- 172.21.15.49:0/2213667055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1fb81542d0 0x7f1fb80ac340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:26.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.617+0000 7f1fb7fff700 1 -- 172.21.15.49:0/2213667055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1fb81542d0 msgr2=0x7f1fb80ac340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:26.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.617+0000 7f1fb7fff700 1 --2- 172.21.15.49:0/2213667055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1fb81542d0 0x7f1fb80ac340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:26.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.617+0000 7f1fb7fff700 1 -- 172.21.15.49:0/2213667055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fb8069ce0 msgr2=0x7f1fb8167990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:26.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.617+0000 7f1fb7fff700 1 --2- 172.21.15.49:0/2213667055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fb8069ce0 0x7f1fb8167990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:26.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.617+0000 7f1fb7fff700 1 -- 172.21.15.49:0/2213667055 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb0009ae0 con 0x7f1fb8062e10 2023-11-30T17:22:26.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.617+0000 7f1fbc9c4700 1 --2- 172.21.15.49:0/2213667055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1fb81542d0 0x7f1fb80ac340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:26.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.617+0000 7f1fb7fff700 1 --2- 172.21.15.49:0/2213667055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fb8062e10 0x7f1fb81674a0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f1fa800d890 tx=0x7f1fa8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:26.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.617+0000 7f1f9ffff700 1 -- 172.21.15.49:0/2213667055 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8011590 con 0x7f1fb8062e10 2023-11-30T17:22:26.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.617+0000 7f1f9ffff700 1 -- 172.21.15.49:0/2213667055 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa80116f0 con 0x7f1fb8062e10 2023-11-30T17:22:26.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.617+0000 7f1fbe427700 1 -- 172.21.15.49:0/2213667055 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb80a8080 con 0x7f1fb8062e10 2023-11-30T17:22:26.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.617+0000 7f1f9ffff700 1 -- 172.21.15.49:0/2213667055 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8011a70 con 0x7f1fb8062e10 2023-11-30T17:22:26.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.617+0000 7f1fbe427700 1 -- 172.21.15.49:0/2213667055 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb80a86c0 con 0x7f1fb8062e10 2023-11-30T17:22:26.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.619+0000 7f1fbe427700 1 -- 172.21.15.49:0/2213667055 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb80a8c90 con 0x7f1fb8062e10 2023-11-30T17:22:26.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.619+0000 7f1f9ffff700 1 -- 172.21.15.49:0/2213667055 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f1fa801c460 con 0x7f1fb8062e10 2023-11-30T17:22:26.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.619+0000 7f1f9ffff700 1 --2- 172.21.15.49:0/2213667055 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1fa405f270 0x7f1fa4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:26.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.619+0000 7f1f9ffff700 1 -- 172.21.15.49:0/2213667055 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f1fa807a200 con 0x7f1fb8062e10 2023-11-30T17:22:26.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.619+0000 7f1fb77fe700 1 --2- 172.21.15.49:0/2213667055 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1fa405f270 0x7f1fa4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:26.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.620+0000 7f1fb77fe700 1 --2- 172.21.15.49:0/2213667055 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1fa405f270 0x7f1fa4061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f1fb81535b0 tx=0x7f1fac007bd0).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:26.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.623+0000 7f1f9ffff700 1 -- 172.21.15.49:0/2213667055 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1fa804b2d0 con 0x7f1fb8062e10 2023-11-30T17:22:26.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.793+0000 7f1fbe427700 1 -- 172.21.15.49:0/2213667055 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1fb806c860 con 0x7f1fa405f270 2023-11-30T17:22:26.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.803+0000 7f1f9ffff700 1 -- 172.21.15.49:0/2213667055 <== mgr.5926 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361479 (secure 0 0 0) 0x7f1fb806c860 con 0x7f1fa405f270 2023-11-30T17:22:26.810 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:26.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.807+0000 7f1fbe427700 1 -- 172.21.15.49:0/2213667055 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1fa405f270 msgr2=0x7f1fa4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:26.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.807+0000 7f1fbe427700 1 --2- 172.21.15.49:0/2213667055 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1fa405f270 0x7f1fa4061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f1fb81535b0 tx=0x7f1fac007bd0).stop 2023-11-30T17:22:26.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.807+0000 7f1fbe427700 1 -- 172.21.15.49:0/2213667055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fb8062e10 msgr2=0x7f1fb81674a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:26.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.807+0000 7f1fbe427700 1 --2- 172.21.15.49:0/2213667055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fb8062e10 0x7f1fb81674a0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f1fa800d890 tx=0x7f1fa8008040).stop 2023-11-30T17:22:26.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.807+0000 7f1fbe427700 1 -- 172.21.15.49:0/2213667055 shutdown_connections 2023-11-30T17:22:26.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.807+0000 7f1fbe427700 1 --2- 172.21.15.49:0/2213667055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1fb81542d0 0x7f1fb80ac340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:26.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.807+0000 7f1fbe427700 1 --2- 172.21.15.49:0/2213667055 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1fa405f270 0x7f1fa4061730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:26.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.807+0000 7f1fbe427700 1 --2- 172.21.15.49:0/2213667055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fb8062e10 0x7f1fb81674a0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:26.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.807+0000 7f1fbe427700 1 --2- 172.21.15.49:0/2213667055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fb8069ce0 0x7f1fb8167990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:26.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.807+0000 7f1fbe427700 1 -- 172.21.15.49:0/2213667055 >> 172.21.15.49:0/2213667055 conn(0x7f1fb80c7fd0 msgr2=0x7f1fb80a6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:26.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.807+0000 7f1fbe427700 1 -- 172.21.15.49:0/2213667055 shutdown_connections 2023-11-30T17:22:26.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:26.807+0000 7f1fbe427700 1 -- 172.21.15.49:0/2213667055 wait complete. 2023-11-30T17:22:26.814 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:22:26.821 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-30T17:22:26.231624+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":206,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2421512,"kb_used_data":7880,"kb_used_omap":0,"kb_used_meta":2413568,"kb_avail":752553208,"statfs":{"total":773094113280,"available":770614484992,"internally_reserved":0,"allocated":8069120,"data_stored":3990212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2471493632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27889,"num_objects":-11,"num_object_clones":0,"num_object_copies":-22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-56,"num_write_kb":-59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.011290"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.341505+0000","last_change":"2023-11-30T17:22:21.337968+0000","last_active":"2023-11-30T17:22:21.341505+0000","last_peered":"2023-11-30T17:22:21.341505+0000","last_clean":"2023-11-30T17:22:21.341505+0000","last_became_active":"2023-11-30T17:22:21.334598+0000","last_became_peered":"2023-11-30T17:22:21.334598+0000","last_unstale":"2023-11-30T17:22:21.341505+0000","last_undegraded":"2023-11-30T17:22:21.341505+0000","last_fullsized":"2023-11-30T17:22:21.341505+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3f","version":"82'3","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.329667+0000","last_change":"2023-11-30T17:22:20.929205+0000","last_active":"2023-11-30T17:22:21.329667+0000","last_peered":"2023-11-30T17:22:21.329667+0000","last_clean":"2023-11-30T17:22:21.329667+0000","last_became_active":"2023-11-30T17:22:20.928896+0000","last_became_peered":"2023-11-30T17:22:20.928896+0000","last_unstale":"2023-11-30T17:22:21.329667+0000","last_undegraded":"2023-11-30T17:22:21.329667+0000","last_fullsized":"2023-11-30T17:22:21.329667+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.338315+0000","last_change":"2023-11-30T17:22:21.334792+0000","last_active":"2023-11-30T17:22:21.338315+0000","last_peered":"2023-11-30T17:22:21.338315+0000","last_clean":"2023-11-30T17:22:21.338315+0000","last_became_active":"2023-11-30T17:22:21.334491+0000","last_became_peered":"2023-11-30T17:22:21.334491+0000","last_unstale":"2023-11-30T17:22:21.338315+0000","last_undegraded":"2023-11-30T17:22:21.338315+0000","last_fullsized":"2023-11-30T17:22:21.338315+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.313908+0000","last_change":"2023-11-30T17:22:20.935450+0000","last_active":"2023-11-30T17:22:21.313908+0000","last_peered":"2023-11-30T17:22:21.313908+0000","last_clean":"2023-11-30T17:22:21.313908+0000","last_became_active":"2023-11-30T17:22:20.935107+0000","last_became_peered":"2023-11-30T17:22:20.935107+0000","last_unstale":"2023-11-30T17:22:21.313908+0000","last_undegraded":"2023-11-30T17:22:21.313908+0000","last_fullsized":"2023-11-30T17:22:21.313908+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.333605+0000","last_change":"2023-11-30T17:22:21.332725+0000","last_active":"2023-11-30T17:22:21.333605+0000","last_peered":"2023-11-30T17:22:21.333605+0000","last_clean":"2023-11-30T17:22:21.333605+0000","last_became_active":"2023-11-30T17:22:21.332417+0000","last_became_peered":"2023-11-30T17:22:21.332417+0000","last_unstale":"2023-11-30T17:22:21.333605+0000","last_undegraded":"2023-11-30T17:22:21.333605+0000","last_fullsized":"2023-11-30T17:22:21.333605+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.318214+0000","last_change":"2023-11-30T17:22:20.939446+0000","last_active":"2023-11-30T17:22:21.318214+0000","last_peered":"2023-11-30T17:22:21.318214+0000","last_clean":"2023-11-30T17:22:21.318214+0000","last_became_active":"2023-11-30T17:22:20.939168+0000","last_became_peered":"2023-11-30T17:22:20.939168+0000","last_unstale":"2023-11-30T17:22:21.318214+0000","last_undegraded":"2023-11-30T17:22:21.318214+0000","last_fullsized":"2023-11-30T17:22:21.318214+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.333314+0000","last_change":"2023-11-30T17:22:21.331441+0000","last_active":"2023-11-30T17:22:21.333314+0000","last_peered":"2023-11-30T17:22:21.333314+0000","last_clean":"2023-11-30T17:22:21.333314+0000","last_became_active":"2023-11-30T17:22:21.330964+0000","last_became_peered":"2023-11-30T17:22:21.330964+0000","last_unstale":"2023-11-30T17:22:21.333314+0000","last_undegraded":"2023-11-30T17:22:21.333314+0000","last_fullsized":"2023-11-30T17:22:21.333314+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.336329+0000","last_change":"2023-11-30T17:22:20.930119+0000","last_active":"2023-11-30T17:22:21.336329+0000","last_peered":"2023-11-30T17:22:21.336329+0000","last_clean":"2023-11-30T17:22:21.336329+0000","last_became_active":"2023-11-30T17:22:20.929873+0000","last_became_peered":"2023-11-30T17:22:20.929873+0000","last_unstale":"2023-11-30T17:22:21.336329+0000","last_undegraded":"2023-11-30T17:22:21.336329+0000","last_fullsized":"2023-11-30T17:22:21.336329+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.340587+0000","last_change":"2023-11-30T17:22:21.335389+0000","last_active":"2023-11-30T17:22:21.340587+0000","last_peered":"2023-11-30T17:22:21.340587+0000","last_clean":"2023-11-30T17:22:21.340587+0000","last_became_active":"2023-11-30T17:22:21.335081+0000","last_became_peered":"2023-11-30T17:22:21.335081+0000","last_unstale":"2023-11-30T17:22:21.340587+0000","last_undegraded":"2023-11-30T17:22:21.340587+0000","last_fullsized":"2023-11-30T17:22:21.340587+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.333885+0000","last_change":"2023-11-30T17:22:20.926229+0000","last_active":"2023-11-30T17:22:21.333885+0000","last_peered":"2023-11-30T17:22:21.333885+0000","last_clean":"2023-11-30T17:22:21.333885+0000","last_became_active":"2023-11-30T17:22:20.925910+0000","last_became_peered":"2023-11-30T17:22:20.925910+0000","last_unstale":"2023-11-30T17:22:21.333885+0000","last_undegraded":"2023-11-30T17:22:21.333885+0000","last_fullsized":"2023-11-30T17:22:21.333885+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335733+0000","last_change":"2023-11-30T17:22:21.332864+0000","last_active":"2023-11-30T17:22:21.335733+0000","last_peered":"2023-11-30T17:22:21.335733+0000","last_clean":"2023-11-30T17:22:21.335733+0000","last_became_active":"2023-11-30T17:22:21.332589+0000","last_became_peered":"2023-11-30T17:22:21.332589+0000","last_unstale":"2023-11-30T17:22:21.335733+0000","last_undegraded":"2023-11-30T17:22:21.335733+0000","last_fullsized":"2023-11-30T17:22:21.335733+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337303+0000","last_change":"2023-11-30T17:22:20.929809+0000","last_active":"2023-11-30T17:22:21.337303+0000","last_peered":"2023-11-30T17:22:21.337303+0000","last_clean":"2023-11-30T17:22:21.337303+0000","last_became_active":"2023-11-30T17:22:20.929506+0000","last_became_peered":"2023-11-30T17:22:20.929506+0000","last_unstale":"2023-11-30T17:22:21.337303+0000","last_undegraded":"2023-11-30T17:22:21.337303+0000","last_fullsized":"2023-11-30T17:22:21.337303+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335363+0000","last_change":"2023-11-30T17:22:21.332342+0000","last_active":"2023-11-30T17:22:21.335363+0000","last_peered":"2023-11-30T17:22:21.335363+0000","last_clean":"2023-11-30T17:22:21.335363+0000","last_became_active":"2023-11-30T17:22:21.321851+0000","last_became_peered":"2023-11-30T17:22:21.321851+0000","last_unstale":"2023-11-30T17:22:21.335363+0000","last_undegraded":"2023-11-30T17:22:21.335363+0000","last_fullsized":"2023-11-30T17:22:21.335363+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.323693+0000","last_change":"2023-11-30T17:22:20.936245+0000","last_active":"2023-11-30T17:22:21.323693+0000","last_peered":"2023-11-30T17:22:21.323693+0000","last_clean":"2023-11-30T17:22:21.323693+0000","last_became_active":"2023-11-30T17:22:20.935915+0000","last_became_peered":"2023-11-30T17:22:20.935915+0000","last_unstale":"2023-11-30T17:22:21.323693+0000","last_undegraded":"2023-11-30T17:22:21.323693+0000","last_fullsized":"2023-11-30T17:22:21.323693+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.338752+0000","last_change":"2023-11-30T17:22:21.336891+0000","last_active":"2023-11-30T17:22:21.338752+0000","last_peered":"2023-11-30T17:22:21.338752+0000","last_clean":"2023-11-30T17:22:21.338752+0000","last_became_active":"2023-11-30T17:22:21.336551+0000","last_became_peered":"2023-11-30T17:22:21.336551+0000","last_unstale":"2023-11-30T17:22:21.338752+0000","last_undegraded":"2023-11-30T17:22:21.338752+0000","last_fullsized":"2023-11-30T17:22:21.338752+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.313130+0000","last_change":"2023-11-30T17:22:20.939775+0000","last_active":"2023-11-30T17:22:21.313130+0000","last_peered":"2023-11-30T17:22:21.313130+0000","last_clean":"2023-11-30T17:22:21.313130+0000","last_became_active":"2023-11-30T17:22:20.939511+0000","last_became_peered":"2023-11-30T17:22:20.939511+0000","last_unstale":"2023-11-30T17:22:21.313130+0000","last_undegraded":"2023-11-30T17:22:21.313130+0000","last_fullsized":"2023-11-30T17:22:21.313130+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.332191+0000","last_change":"2023-11-30T17:22:21.325167+0000","last_active":"2023-11-30T17:22:21.332191+0000","last_peered":"2023-11-30T17:22:21.332191+0000","last_clean":"2023-11-30T17:22:21.332191+0000","last_became_active":"2023-11-30T17:22:21.324836+0000","last_became_peered":"2023-11-30T17:22:21.324836+0000","last_unstale":"2023-11-30T17:22:21.332191+0000","last_undegraded":"2023-11-30T17:22:21.332191+0000","last_fullsized":"2023-11-30T17:22:21.332191+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.326148+0000","last_change":"2023-11-30T17:22:20.930175+0000","last_active":"2023-11-30T17:22:21.326148+0000","last_peered":"2023-11-30T17:22:21.326148+0000","last_clean":"2023-11-30T17:22:21.326148+0000","last_became_active":"2023-11-30T17:22:20.929892+0000","last_became_peered":"2023-11-30T17:22:20.929892+0000","last_unstale":"2023-11-30T17:22:21.326148+0000","last_undegraded":"2023-11-30T17:22:21.326148+0000","last_fullsized":"2023-11-30T17:22:21.326148+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.338516+0000","last_change":"2023-11-30T17:22:21.334046+0000","last_active":"2023-11-30T17:22:21.338516+0000","last_peered":"2023-11-30T17:22:21.338516+0000","last_clean":"2023-11-30T17:22:21.338516+0000","last_became_active":"2023-11-30T17:22:21.333677+0000","last_became_peered":"2023-11-30T17:22:21.333677+0000","last_unstale":"2023-11-30T17:22:21.338516+0000","last_undegraded":"2023-11-30T17:22:21.338516+0000","last_fullsized":"2023-11-30T17:22:21.338516+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.316483+0000","last_change":"2023-11-30T17:22:20.928501+0000","last_active":"2023-11-30T17:22:21.316483+0000","last_peered":"2023-11-30T17:22:21.316483+0000","last_clean":"2023-11-30T17:22:21.316483+0000","last_became_active":"2023-11-30T17:22:20.928198+0000","last_became_peered":"2023-11-30T17:22:20.928198+0000","last_unstale":"2023-11-30T17:22:21.316483+0000","last_undegraded":"2023-11-30T17:22:21.316483+0000","last_fullsized":"2023-11-30T17:22:21.316483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335230+0000","last_change":"2023-11-30T17:22:21.325034+0000","last_active":"2023-11-30T17:22:21.335230+0000","last_peered":"2023-11-30T17:22:21.335230+0000","last_clean":"2023-11-30T17:22:21.335230+0000","last_became_active":"2023-11-30T17:22:21.324712+0000","last_became_peered":"2023-11-30T17:22:21.324712+0000","last_unstale":"2023-11-30T17:22:21.335230+0000","last_undegraded":"2023-11-30T17:22:21.335230+0000","last_fullsized":"2023-11-30T17:22:21.335230+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.316312+0000","last_change":"2023-11-30T17:22:20.932648+0000","last_active":"2023-11-30T17:22:21.316312+0000","last_peered":"2023-11-30T17:22:21.316312+0000","last_clean":"2023-11-30T17:22:21.316312+0000","last_became_active":"2023-11-30T17:22:20.932328+0000","last_became_peered":"2023-11-30T17:22:20.932328+0000","last_unstale":"2023-11-30T17:22:21.316312+0000","last_undegraded":"2023-11-30T17:22:21.316312+0000","last_fullsized":"2023-11-30T17:22:21.316312+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.339022+0000","last_change":"2023-11-30T17:22:21.336992+0000","last_active":"2023-11-30T17:22:21.339022+0000","last_peered":"2023-11-30T17:22:21.339022+0000","last_clean":"2023-11-30T17:22:21.339022+0000","last_became_active":"2023-11-30T17:22:21.336715+0000","last_became_peered":"2023-11-30T17:22:21.336715+0000","last_unstale":"2023-11-30T17:22:21.339022+0000","last_undegraded":"2023-11-30T17:22:21.339022+0000","last_fullsized":"2023-11-30T17:22:21.339022+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.34","version":"82'4","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.342026+0000","last_change":"2023-11-30T17:22:20.932173+0000","last_active":"2023-11-30T17:22:21.342026+0000","last_peered":"2023-11-30T17:22:21.342026+0000","last_clean":"2023-11-30T17:22:21.342026+0000","last_became_active":"2023-11-30T17:22:20.931753+0000","last_became_peered":"2023-11-30T17:22:20.931753+0000","last_unstale":"2023-11-30T17:22:21.342026+0000","last_undegraded":"2023-11-30T17:22:21.342026+0000","last_fullsized":"2023-11-30T17:22:21.342026+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.336734+0000","last_change":"2023-11-30T17:22:21.334427+0000","last_active":"2023-11-30T17:22:21.336734+0000","last_peered":"2023-11-30T17:22:21.336734+0000","last_clean":"2023-11-30T17:22:21.336734+0000","last_became_active":"2023-11-30T17:22:21.334056+0000","last_became_peered":"2023-11-30T17:22:21.334056+0000","last_unstale":"2023-11-30T17:22:21.336734+0000","last_undegraded":"2023-11-30T17:22:21.336734+0000","last_fullsized":"2023-11-30T17:22:21.336734+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335765+0000","last_change":"2023-11-30T17:22:20.932294+0000","last_active":"2023-11-30T17:22:21.335765+0000","last_peered":"2023-11-30T17:22:21.335765+0000","last_clean":"2023-11-30T17:22:21.335765+0000","last_became_active":"2023-11-30T17:22:20.932018+0000","last_became_peered":"2023-11-30T17:22:20.932018+0000","last_unstale":"2023-11-30T17:22:21.335765+0000","last_undegraded":"2023-11-30T17:22:21.335765+0000","last_fullsized":"2023-11-30T17:22:21.335765+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337229+0000","last_change":"2023-11-30T17:22:21.330858+0000","last_active":"2023-11-30T17:22:21.337229+0000","last_peered":"2023-11-30T17:22:21.337229+0000","last_clean":"2023-11-30T17:22:21.337229+0000","last_became_active":"2023-11-30T17:22:21.327045+0000","last_became_peered":"2023-11-30T17:22:21.327045+0000","last_unstale":"2023-11-30T17:22:21.337229+0000","last_undegraded":"2023-11-30T17:22:21.337229+0000","last_fullsized":"2023-11-30T17:22:21.337229+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.321863+0000","last_change":"2023-11-30T17:22:20.929525+0000","last_active":"2023-11-30T17:22:21.321863+0000","last_peered":"2023-11-30T17:22:21.321863+0000","last_clean":"2023-11-30T17:22:21.321863+0000","last_became_active":"2023-11-30T17:22:20.929210+0000","last_became_peered":"2023-11-30T17:22:20.929210+0000","last_unstale":"2023-11-30T17:22:21.321863+0000","last_undegraded":"2023-11-30T17:22:21.321863+0000","last_fullsized":"2023-11-30T17:22:21.321863+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.338143+0000","last_change":"2023-11-30T17:22:21.334477+0000","last_active":"2023-11-30T17:22:21.338143+0000","last_peered":"2023-11-30T17:22:21.338143+0000","last_clean":"2023-11-30T17:22:21.338143+0000","last_became_active":"2023-11-30T17:22:21.334165+0000","last_became_peered":"2023-11-30T17:22:21.334165+0000","last_unstale":"2023-11-30T17:22:21.338143+0000","last_undegraded":"2023-11-30T17:22:21.338143+0000","last_fullsized":"2023-11-30T17:22:21.338143+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.323818+0000","last_change":"2023-11-30T17:22:20.929476+0000","last_active":"2023-11-30T17:22:21.323818+0000","last_peered":"2023-11-30T17:22:21.323818+0000","last_clean":"2023-11-30T17:22:21.323818+0000","last_became_active":"2023-11-30T17:22:20.929232+0000","last_became_peered":"2023-11-30T17:22:20.929232+0000","last_unstale":"2023-11-30T17:22:21.323818+0000","last_undegraded":"2023-11-30T17:22:21.323818+0000","last_fullsized":"2023-11-30T17:22:21.323818+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.341039+0000","last_change":"2023-11-30T17:22:21.340184+0000","last_active":"2023-11-30T17:22:21.341039+0000","last_peered":"2023-11-30T17:22:21.341039+0000","last_clean":"2023-11-30T17:22:21.341039+0000","last_became_active":"2023-11-30T17:22:21.339332+0000","last_became_peered":"2023-11-30T17:22:21.339332+0000","last_unstale":"2023-11-30T17:22:21.341039+0000","last_undegraded":"2023-11-30T17:22:21.341039+0000","last_fullsized":"2023-11-30T17:22:21.341039+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"82'4","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.339175+0000","last_change":"2023-11-30T17:22:20.929041+0000","last_active":"2023-11-30T17:22:21.339175+0000","last_peered":"2023-11-30T17:22:21.339175+0000","last_clean":"2023-11-30T17:22:21.339175+0000","last_became_active":"2023-11-30T17:22:20.928561+0000","last_became_peered":"2023-11-30T17:22:20.928561+0000","last_unstale":"2023-11-30T17:22:21.339175+0000","last_undegraded":"2023-11-30T17:22:21.339175+0000","last_fullsized":"2023-11-30T17:22:21.339175+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.330255+0000","last_change":"2023-11-30T17:22:21.329430+0000","last_active":"2023-11-30T17:22:21.330255+0000","last_peered":"2023-11-30T17:22:21.330255+0000","last_clean":"2023-11-30T17:22:21.330255+0000","last_became_active":"2023-11-30T17:22:21.329087+0000","last_became_peered":"2023-11-30T17:22:21.329087+0000","last_unstale":"2023-11-30T17:22:21.330255+0000","last_undegraded":"2023-11-30T17:22:21.330255+0000","last_fullsized":"2023-11-30T17:22:21.330255+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.313280+0000","last_change":"2023-11-30T17:22:20.935130+0000","last_active":"2023-11-30T17:22:21.313280+0000","last_peered":"2023-11-30T17:22:21.313280+0000","last_clean":"2023-11-30T17:22:21.313280+0000","last_became_active":"2023-11-30T17:22:20.934842+0000","last_became_peered":"2023-11-30T17:22:20.934842+0000","last_unstale":"2023-11-30T17:22:21.313280+0000","last_undegraded":"2023-11-30T17:22:21.313280+0000","last_fullsized":"2023-11-30T17:22:21.313280+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.332227+0000","last_change":"2023-11-30T17:22:21.325440+0000","last_active":"2023-11-30T17:22:21.332227+0000","last_peered":"2023-11-30T17:22:21.332227+0000","last_clean":"2023-11-30T17:22:21.332227+0000","last_became_active":"2023-11-30T17:22:21.325138+0000","last_became_peered":"2023-11-30T17:22:21.325138+0000","last_unstale":"2023-11-30T17:22:21.332227+0000","last_undegraded":"2023-11-30T17:22:21.332227+0000","last_fullsized":"2023-11-30T17:22:21.332227+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.317814+0000","last_change":"2023-11-30T17:22:20.939297+0000","last_active":"2023-11-30T17:22:21.317814+0000","last_peered":"2023-11-30T17:22:21.317814+0000","last_clean":"2023-11-30T17:22:21.317814+0000","last_became_active":"2023-11-30T17:22:20.938830+0000","last_became_peered":"2023-11-30T17:22:20.938830+0000","last_unstale":"2023-11-30T17:22:21.317814+0000","last_undegraded":"2023-11-30T17:22:21.317814+0000","last_fullsized":"2023-11-30T17:22:21.317814+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.338635+0000","last_change":"2023-11-30T17:22:21.335408+0000","last_active":"2023-11-30T17:22:21.338635+0000","last_peered":"2023-11-30T17:22:21.338635+0000","last_clean":"2023-11-30T17:22:21.338635+0000","last_became_active":"2023-11-30T17:22:21.335129+0000","last_became_peered":"2023-11-30T17:22:21.335129+0000","last_unstale":"2023-11-30T17:22:21.338635+0000","last_undegraded":"2023-11-30T17:22:21.338635+0000","last_fullsized":"2023-11-30T17:22:21.338635+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.331614+0000","last_change":"2023-11-30T17:22:20.930348+0000","last_active":"2023-11-30T17:22:21.331614+0000","last_peered":"2023-11-30T17:22:21.331614+0000","last_clean":"2023-11-30T17:22:21.331614+0000","last_became_active":"2023-11-30T17:22:20.930051+0000","last_became_peered":"2023-11-30T17:22:20.930051+0000","last_unstale":"2023-11-30T17:22:21.331614+0000","last_undegraded":"2023-11-30T17:22:21.331614+0000","last_fullsized":"2023-11-30T17:22:21.331614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337301+0000","last_change":"2023-11-30T17:22:21.336482+0000","last_active":"2023-11-30T17:22:21.337301+0000","last_peered":"2023-11-30T17:22:21.337301+0000","last_clean":"2023-11-30T17:22:21.337301+0000","last_became_active":"2023-11-30T17:22:21.336197+0000","last_became_peered":"2023-11-30T17:22:21.336197+0000","last_unstale":"2023-11-30T17:22:21.337301+0000","last_undegraded":"2023-11-30T17:22:21.337301+0000","last_fullsized":"2023-11-30T17:22:21.337301+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.313902+0000","last_change":"2023-11-30T17:22:20.939554+0000","last_active":"2023-11-30T17:22:21.313902+0000","last_peered":"2023-11-30T17:22:21.313902+0000","last_clean":"2023-11-30T17:22:21.313902+0000","last_became_active":"2023-11-30T17:22:20.931117+0000","last_became_peered":"2023-11-30T17:22:20.931117+0000","last_unstale":"2023-11-30T17:22:21.313902+0000","last_undegraded":"2023-11-30T17:22:21.313902+0000","last_fullsized":"2023-11-30T17:22:21.313902+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.338180+0000","last_change":"2023-11-30T17:22:21.334786+0000","last_active":"2023-11-30T17:22:21.338180+0000","last_peered":"2023-11-30T17:22:21.338180+0000","last_clean":"2023-11-30T17:22:21.338180+0000","last_became_active":"2023-11-30T17:22:21.334477+0000","last_became_peered":"2023-11-30T17:22:21.334477+0000","last_unstale":"2023-11-30T17:22:21.338180+0000","last_undegraded":"2023-11-30T17:22:21.338180+0000","last_fullsized":"2023-11-30T17:22:21.338180+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.336819+0000","last_change":"2023-11-30T17:22:20.937671+0000","last_active":"2023-11-30T17:22:21.336819+0000","last_peered":"2023-11-30T17:22:21.336819+0000","last_clean":"2023-11-30T17:22:21.336819+0000","last_became_active":"2023-11-30T17:22:20.937184+0000","last_became_peered":"2023-11-30T17:22:20.937184+0000","last_unstale":"2023-11-30T17:22:21.336819+0000","last_undegraded":"2023-11-30T17:22:21.336819+0000","last_fullsized":"2023-11-30T17:22:21.336819+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.322693+0000","last_change":"2023-11-30T17:22:21.321647+0000","last_active":"2023-11-30T17:22:21.322693+0000","last_peered":"2023-11-30T17:22:21.322693+0000","last_clean":"2023-11-30T17:22:21.322693+0000","last_became_active":"2023-11-30T17:22:21.321315+0000","last_became_peered":"2023-11-30T17:22:21.321315+0000","last_unstale":"2023-11-30T17:22:21.322693+0000","last_undegraded":"2023-11-30T17:22:21.322693+0000","last_fullsized":"2023-11-30T17:22:21.322693+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.314356+0000","last_change":"2023-11-30T17:22:20.937074+0000","last_active":"2023-11-30T17:22:21.314356+0000","last_peered":"2023-11-30T17:22:21.314356+0000","last_clean":"2023-11-30T17:22:21.314356+0000","last_became_active":"2023-11-30T17:22:20.936781+0000","last_became_peered":"2023-11-30T17:22:20.936781+0000","last_unstale":"2023-11-30T17:22:21.314356+0000","last_undegraded":"2023-11-30T17:22:21.314356+0000","last_fullsized":"2023-11-30T17:22:21.314356+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.329697+0000","last_change":"2023-11-30T17:22:21.327810+0000","last_active":"2023-11-30T17:22:21.329697+0000","last_peered":"2023-11-30T17:22:21.329697+0000","last_clean":"2023-11-30T17:22:21.329697+0000","last_became_active":"2023-11-30T17:22:21.327521+0000","last_became_peered":"2023-11-30T17:22:21.327521+0000","last_unstale":"2023-11-30T17:22:21.329697+0000","last_undegraded":"2023-11-30T17:22:21.329697+0000","last_fullsized":"2023-11-30T17:22:21.329697+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.319001+0000","last_change":"2023-11-30T17:22:20.942621+0000","last_active":"2023-11-30T17:22:21.319001+0000","last_peered":"2023-11-30T17:22:21.319001+0000","last_clean":"2023-11-30T17:22:21.319001+0000","last_became_active":"2023-11-30T17:22:20.942385+0000","last_became_peered":"2023-11-30T17:22:20.942385+0000","last_unstale":"2023-11-30T17:22:21.319001+0000","last_undegraded":"2023-11-30T17:22:21.319001+0000","last_fullsized":"2023-11-30T17:22:21.319001+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.333322+0000","last_change":"2023-11-30T17:22:21.329183+0000","last_active":"2023-11-30T17:22:21.333322+0000","last_peered":"2023-11-30T17:22:21.333322+0000","last_clean":"2023-11-30T17:22:21.333322+0000","last_became_active":"2023-11-30T17:22:21.328882+0000","last_became_peered":"2023-11-30T17:22:21.328882+0000","last_unstale":"2023-11-30T17:22:21.333322+0000","last_undegraded":"2023-11-30T17:22:21.333322+0000","last_fullsized":"2023-11-30T17:22:21.333322+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.314416+0000","last_change":"2023-11-30T17:22:20.931448+0000","last_active":"2023-11-30T17:22:21.314416+0000","last_peered":"2023-11-30T17:22:21.314416+0000","last_clean":"2023-11-30T17:22:21.314416+0000","last_became_active":"2023-11-30T17:22:20.931178+0000","last_became_peered":"2023-11-30T17:22:20.931178+0000","last_unstale":"2023-11-30T17:22:21.314416+0000","last_undegraded":"2023-11-30T17:22:21.314416+0000","last_fullsized":"2023-11-30T17:22:21.314416+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.333437+0000","last_change":"2023-11-30T17:22:21.330564+0000","last_active":"2023-11-30T17:22:21.333437+0000","last_peered":"2023-11-30T17:22:21.333437+0000","last_clean":"2023-11-30T17:22:21.333437+0000","last_became_active":"2023-11-30T17:22:21.329983+0000","last_became_peered":"2023-11-30T17:22:21.329983+0000","last_unstale":"2023-11-30T17:22:21.333437+0000","last_undegraded":"2023-11-30T17:22:21.333437+0000","last_fullsized":"2023-11-30T17:22:21.333437+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.323406+0000","last_change":"2023-11-30T17:22:20.931253+0000","last_active":"2023-11-30T17:22:21.323406+0000","last_peered":"2023-11-30T17:22:21.323406+0000","last_clean":"2023-11-30T17:22:21.323406+0000","last_became_active":"2023-11-30T17:22:20.930953+0000","last_became_peered":"2023-11-30T17:22:20.930953+0000","last_unstale":"2023-11-30T17:22:21.323406+0000","last_undegraded":"2023-11-30T17:22:21.323406+0000","last_fullsized":"2023-11-30T17:22:21.323406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.338536+0000","last_change":"2023-11-30T17:22:21.334288+0000","last_active":"2023-11-30T17:22:21.338536+0000","last_peered":"2023-11-30T17:22:21.338536+0000","last_clean":"2023-11-30T17:22:21.338536+0000","last_became_active":"2023-11-30T17:22:21.333996+0000","last_became_peered":"2023-11-30T17:22:21.333996+0000","last_unstale":"2023-11-30T17:22:21.338536+0000","last_undegraded":"2023-11-30T17:22:21.338536+0000","last_fullsized":"2023-11-30T17:22:21.338536+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.320858+0000","last_change":"2023-11-30T17:22:20.931432+0000","last_active":"2023-11-30T17:22:21.320858+0000","last_peered":"2023-11-30T17:22:21.320858+0000","last_clean":"2023-11-30T17:22:21.320858+0000","last_became_active":"2023-11-30T17:22:20.931158+0000","last_became_peered":"2023-11-30T17:22:20.931158+0000","last_unstale":"2023-11-30T17:22:21.320858+0000","last_undegraded":"2023-11-30T17:22:21.320858+0000","last_fullsized":"2023-11-30T17:22:21.320858+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.332160+0000","last_change":"2023-11-30T17:22:21.324523+0000","last_active":"2023-11-30T17:22:21.332160+0000","last_peered":"2023-11-30T17:22:21.332160+0000","last_clean":"2023-11-30T17:22:21.332160+0000","last_became_active":"2023-11-30T17:22:21.324233+0000","last_became_peered":"2023-11-30T17:22:21.324233+0000","last_unstale":"2023-11-30T17:22:21.332160+0000","last_undegraded":"2023-11-30T17:22:21.332160+0000","last_fullsized":"2023-11-30T17:22:21.332160+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.314552+0000","last_change":"2023-11-30T17:22:20.934622+0000","last_active":"2023-11-30T17:22:21.314552+0000","last_peered":"2023-11-30T17:22:21.314552+0000","last_clean":"2023-11-30T17:22:21.314552+0000","last_became_active":"2023-11-30T17:22:20.934343+0000","last_became_peered":"2023-11-30T17:22:20.934343+0000","last_unstale":"2023-11-30T17:22:21.314552+0000","last_undegraded":"2023-11-30T17:22:21.314552+0000","last_fullsized":"2023-11-30T17:22:21.314552+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.333359+0000","last_change":"2023-11-30T17:22:21.329707+0000","last_active":"2023-11-30T17:22:21.333359+0000","last_peered":"2023-11-30T17:22:21.333359+0000","last_clean":"2023-11-30T17:22:21.333359+0000","last_became_active":"2023-11-30T17:22:21.329406+0000","last_became_peered":"2023-11-30T17:22:21.329406+0000","last_unstale":"2023-11-30T17:22:21.333359+0000","last_undegraded":"2023-11-30T17:22:21.333359+0000","last_fullsized":"2023-11-30T17:22:21.333359+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.322388+0000","last_change":"2023-11-30T17:22:20.932327+0000","last_active":"2023-11-30T17:22:21.322388+0000","last_peered":"2023-11-30T17:22:21.322388+0000","last_clean":"2023-11-30T17:22:21.322388+0000","last_became_active":"2023-11-30T17:22:20.932056+0000","last_became_peered":"2023-11-30T17:22:20.932056+0000","last_unstale":"2023-11-30T17:22:21.322388+0000","last_undegraded":"2023-11-30T17:22:21.322388+0000","last_fullsized":"2023-11-30T17:22:21.322388+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335152+0000","last_change":"2023-11-30T17:22:21.333765+0000","last_active":"2023-11-30T17:22:21.335152+0000","last_peered":"2023-11-30T17:22:21.335152+0000","last_clean":"2023-11-30T17:22:21.335152+0000","last_became_active":"2023-11-30T17:22:21.333449+0000","last_became_peered":"2023-11-30T17:22:21.333449+0000","last_unstale":"2023-11-30T17:22:21.335152+0000","last_undegraded":"2023-11-30T17:22:21.335152+0000","last_fullsized":"2023-11-30T17:22:21.335152+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.313313+0000","last_change":"2023-11-30T17:22:20.939779+0000","last_active":"2023-11-30T17:22:21.313313+0000","last_peered":"2023-11-30T17:22:21.313313+0000","last_clean":"2023-11-30T17:22:21.313313+0000","last_became_active":"2023-11-30T17:22:20.939251+0000","last_became_peered":"2023-11-30T17:22:20.939251+0000","last_unstale":"2023-11-30T17:22:21.313313+0000","last_undegraded":"2023-11-30T17:22:21.313313+0000","last_fullsized":"2023-11-30T17:22:21.313313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.338480+0000","last_change":"2023-11-30T17:22:21.335658+0000","last_active":"2023-11-30T17:22:21.338480+0000","last_peered":"2023-11-30T17:22:21.338480+0000","last_clean":"2023-11-30T17:22:21.338480+0000","last_became_active":"2023-11-30T17:22:21.333449+0000","last_became_peered":"2023-11-30T17:22:21.333449+0000","last_unstale":"2023-11-30T17:22:21.338480+0000","last_undegraded":"2023-11-30T17:22:21.338480+0000","last_fullsized":"2023-11-30T17:22:21.338480+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.318781+0000","last_change":"2023-11-30T17:22:20.937434+0000","last_active":"2023-11-30T17:22:21.318781+0000","last_peered":"2023-11-30T17:22:21.318781+0000","last_clean":"2023-11-30T17:22:21.318781+0000","last_became_active":"2023-11-30T17:22:20.937082+0000","last_became_peered":"2023-11-30T17:22:20.937082+0000","last_unstale":"2023-11-30T17:22:21.318781+0000","last_undegraded":"2023-11-30T17:22:21.318781+0000","last_fullsized":"2023-11-30T17:22:21.318781+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.336188+0000","last_change":"2023-11-30T17:22:21.331775+0000","last_active":"2023-11-30T17:22:21.336188+0000","last_peered":"2023-11-30T17:22:21.336188+0000","last_clean":"2023-11-30T17:22:21.336188+0000","last_became_active":"2023-11-30T17:22:21.331455+0000","last_became_peered":"2023-11-30T17:22:21.331455+0000","last_unstale":"2023-11-30T17:22:21.336188+0000","last_undegraded":"2023-11-30T17:22:21.336188+0000","last_fullsized":"2023-11-30T17:22:21.336188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.322384+0000","last_change":"2023-11-30T17:22:20.921100+0000","last_active":"2023-11-30T17:22:21.322384+0000","last_peered":"2023-11-30T17:22:21.322384+0000","last_clean":"2023-11-30T17:22:21.322384+0000","last_became_active":"2023-11-30T17:22:20.920818+0000","last_became_peered":"2023-11-30T17:22:20.920818+0000","last_unstale":"2023-11-30T17:22:21.322384+0000","last_undegraded":"2023-11-30T17:22:21.322384+0000","last_fullsized":"2023-11-30T17:22:21.322384+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.339918+0000","last_change":"2023-11-30T17:22:21.338971+0000","last_active":"2023-11-30T17:22:21.339918+0000","last_peered":"2023-11-30T17:22:21.339918+0000","last_clean":"2023-11-30T17:22:21.339918+0000","last_became_active":"2023-11-30T17:22:21.338674+0000","last_became_peered":"2023-11-30T17:22:21.338674+0000","last_unstale":"2023-11-30T17:22:21.339918+0000","last_undegraded":"2023-11-30T17:22:21.339918+0000","last_fullsized":"2023-11-30T17:22:21.339918+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.313733+0000","last_change":"2023-11-30T17:22:20.928872+0000","last_active":"2023-11-30T17:22:21.313733+0000","last_peered":"2023-11-30T17:22:21.313733+0000","last_clean":"2023-11-30T17:22:21.313733+0000","last_became_active":"2023-11-30T17:22:20.928246+0000","last_became_peered":"2023-11-30T17:22:20.928246+0000","last_unstale":"2023-11-30T17:22:21.313733+0000","last_undegraded":"2023-11-30T17:22:21.313733+0000","last_fullsized":"2023-11-30T17:22:21.313733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.332512+0000","last_change":"2023-11-30T17:22:21.327861+0000","last_active":"2023-11-30T17:22:21.332512+0000","last_peered":"2023-11-30T17:22:21.332512+0000","last_clean":"2023-11-30T17:22:21.332512+0000","last_became_active":"2023-11-30T17:22:21.326927+0000","last_became_peered":"2023-11-30T17:22:21.326927+0000","last_unstale":"2023-11-30T17:22:21.332512+0000","last_undegraded":"2023-11-30T17:22:21.332512+0000","last_fullsized":"2023-11-30T17:22:21.332512+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.334940+0000","last_change":"2023-11-30T17:22:20.932827+0000","last_active":"2023-11-30T17:22:21.334940+0000","last_peered":"2023-11-30T17:22:21.334940+0000","last_clean":"2023-11-30T17:22:21.334940+0000","last_became_active":"2023-11-30T17:22:20.932116+0000","last_became_peered":"2023-11-30T17:22:20.932116+0000","last_unstale":"2023-11-30T17:22:21.334940+0000","last_undegraded":"2023-11-30T17:22:21.334940+0000","last_fullsized":"2023-11-30T17:22:21.334940+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337117+0000","last_change":"2023-11-30T17:22:21.332220+0000","last_active":"2023-11-30T17:22:21.337117+0000","last_peered":"2023-11-30T17:22:21.337117+0000","last_clean":"2023-11-30T17:22:21.337117+0000","last_became_active":"2023-11-30T17:22:21.331695+0000","last_became_peered":"2023-11-30T17:22:21.331695+0000","last_unstale":"2023-11-30T17:22:21.337117+0000","last_undegraded":"2023-11-30T17:22:21.337117+0000","last_fullsized":"2023-11-30T17:22:21.337117+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337106+0000","last_change":"2023-11-30T17:22:20.932467+0000","last_active":"2023-11-30T17:22:21.337106+0000","last_peered":"2023-11-30T17:22:21.337106+0000","last_clean":"2023-11-30T17:22:21.337106+0000","last_became_active":"2023-11-30T17:22:20.932190+0000","last_became_peered":"2023-11-30T17:22:20.932190+0000","last_unstale":"2023-11-30T17:22:21.337106+0000","last_undegraded":"2023-11-30T17:22:21.337106+0000","last_fullsized":"2023-11-30T17:22:21.337106+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.334353+0000","last_change":"2023-11-30T17:22:21.331875+0000","last_active":"2023-11-30T17:22:21.334353+0000","last_peered":"2023-11-30T17:22:21.334353+0000","last_clean":"2023-11-30T17:22:21.334353+0000","last_became_active":"2023-11-30T17:22:21.328825+0000","last_became_peered":"2023-11-30T17:22:21.328825+0000","last_unstale":"2023-11-30T17:22:21.334353+0000","last_undegraded":"2023-11-30T17:22:21.334353+0000","last_fullsized":"2023-11-30T17:22:21.334353+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335533+0000","last_change":"2023-11-30T17:22:20.936705+0000","last_active":"2023-11-30T17:22:21.335533+0000","last_peered":"2023-11-30T17:22:21.335533+0000","last_clean":"2023-11-30T17:22:21.335533+0000","last_became_active":"2023-11-30T17:22:20.936118+0000","last_became_peered":"2023-11-30T17:22:20.936118+0000","last_unstale":"2023-11-30T17:22:21.335533+0000","last_undegraded":"2023-11-30T17:22:21.335533+0000","last_fullsized":"2023-11-30T17:22:21.335533+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335262+0000","last_change":"2023-11-30T17:22:21.328624+0000","last_active":"2023-11-30T17:22:21.335262+0000","last_peered":"2023-11-30T17:22:21.335262+0000","last_clean":"2023-11-30T17:22:21.335262+0000","last_became_active":"2023-11-30T17:22:21.328317+0000","last_became_peered":"2023-11-30T17:22:21.328317+0000","last_unstale":"2023-11-30T17:22:21.335262+0000","last_undegraded":"2023-11-30T17:22:21.335262+0000","last_fullsized":"2023-11-30T17:22:21.335262+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.314520+0000","last_change":"2023-11-30T17:22:20.930005+0000","last_active":"2023-11-30T17:22:21.314520+0000","last_peered":"2023-11-30T17:22:21.314520+0000","last_clean":"2023-11-30T17:22:21.314520+0000","last_became_active":"2023-11-30T17:22:20.929725+0000","last_became_peered":"2023-11-30T17:22:20.929725+0000","last_unstale":"2023-11-30T17:22:21.314520+0000","last_undegraded":"2023-11-30T17:22:21.314520+0000","last_fullsized":"2023-11-30T17:22:21.314520+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.331499+0000","last_change":"2023-11-30T17:22:21.327241+0000","last_active":"2023-11-30T17:22:21.331499+0000","last_peered":"2023-11-30T17:22:21.331499+0000","last_clean":"2023-11-30T17:22:21.331499+0000","last_became_active":"2023-11-30T17:22:21.326987+0000","last_became_peered":"2023-11-30T17:22:21.326987+0000","last_unstale":"2023-11-30T17:22:21.331499+0000","last_undegraded":"2023-11-30T17:22:21.331499+0000","last_fullsized":"2023-11-30T17:22:21.331499+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.313414+0000","last_change":"2023-11-30T17:22:20.935822+0000","last_active":"2023-11-30T17:22:21.313414+0000","last_peered":"2023-11-30T17:22:21.313414+0000","last_clean":"2023-11-30T17:22:21.313414+0000","last_became_active":"2023-11-30T17:22:20.934667+0000","last_became_peered":"2023-11-30T17:22:20.934667+0000","last_unstale":"2023-11-30T17:22:21.313414+0000","last_undegraded":"2023-11-30T17:22:21.313414+0000","last_fullsized":"2023-11-30T17:22:21.313414+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337309+0000","last_change":"2023-11-30T17:22:21.336465+0000","last_active":"2023-11-30T17:22:21.337309+0000","last_peered":"2023-11-30T17:22:21.337309+0000","last_clean":"2023-11-30T17:22:21.337309+0000","last_became_active":"2023-11-30T17:22:21.336172+0000","last_became_peered":"2023-11-30T17:22:21.336172+0000","last_unstale":"2023-11-30T17:22:21.337309+0000","last_undegraded":"2023-11-30T17:22:21.337309+0000","last_fullsized":"2023-11-30T17:22:21.337309+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.314421+0000","last_change":"2023-11-30T17:22:20.936748+0000","last_active":"2023-11-30T17:22:21.314421+0000","last_peered":"2023-11-30T17:22:21.314421+0000","last_clean":"2023-11-30T17:22:21.314421+0000","last_became_active":"2023-11-30T17:22:20.936551+0000","last_became_peered":"2023-11-30T17:22:20.936551+0000","last_unstale":"2023-11-30T17:22:21.314421+0000","last_undegraded":"2023-11-30T17:22:21.314421+0000","last_fullsized":"2023-11-30T17:22:21.314421+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.329487+0000","last_change":"2023-11-30T17:22:21.320459+0000","last_active":"2023-11-30T17:22:21.329487+0000","last_peered":"2023-11-30T17:22:21.329487+0000","last_clean":"2023-11-30T17:22:21.329487+0000","last_became_active":"2023-11-30T17:22:21.320195+0000","last_became_peered":"2023-11-30T17:22:21.320195+0000","last_unstale":"2023-11-30T17:22:21.329487+0000","last_undegraded":"2023-11-30T17:22:21.329487+0000","last_fullsized":"2023-11-30T17:22:21.329487+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.313639+0000","last_change":"2023-11-30T17:22:20.935604+0000","last_active":"2023-11-30T17:22:21.313639+0000","last_peered":"2023-11-30T17:22:21.313639+0000","last_clean":"2023-11-30T17:22:21.313639+0000","last_became_active":"2023-11-30T17:22:20.935130+0000","last_became_peered":"2023-11-30T17:22:20.935130+0000","last_unstale":"2023-11-30T17:22:21.313639+0000","last_undegraded":"2023-11-30T17:22:21.313639+0000","last_fullsized":"2023-11-30T17:22:21.313639+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337620+0000","last_change":"2023-11-30T17:22:21.336216+0000","last_active":"2023-11-30T17:22:21.337620+0000","last_peered":"2023-11-30T17:22:21.337620+0000","last_clean":"2023-11-30T17:22:21.337620+0000","last_became_active":"2023-11-30T17:22:21.335911+0000","last_became_peered":"2023-11-30T17:22:21.335911+0000","last_unstale":"2023-11-30T17:22:21.337620+0000","last_undegraded":"2023-11-30T17:22:21.337620+0000","last_fullsized":"2023-11-30T17:22:21.337620+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.314463+0000","last_change":"2023-11-30T17:22:20.934475+0000","last_active":"2023-11-30T17:22:21.314463+0000","last_peered":"2023-11-30T17:22:21.314463+0000","last_clean":"2023-11-30T17:22:21.314463+0000","last_became_active":"2023-11-30T17:22:20.934163+0000","last_became_peered":"2023-11-30T17:22:20.934163+0000","last_unstale":"2023-11-30T17:22:21.314463+0000","last_undegraded":"2023-11-30T17:22:21.314463+0000","last_fullsized":"2023-11-30T17:22:21.314463+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.333412+0000","last_change":"2023-11-30T17:22:21.330374+0000","last_active":"2023-11-30T17:22:21.333412+0000","last_peered":"2023-11-30T17:22:21.333412+0000","last_clean":"2023-11-30T17:22:21.333412+0000","last_became_active":"2023-11-30T17:22:21.329939+0000","last_became_peered":"2023-11-30T17:22:21.329939+0000","last_unstale":"2023-11-30T17:22:21.333412+0000","last_undegraded":"2023-11-30T17:22:21.333412+0000","last_fullsized":"2023-11-30T17:22:21.333412+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.317876+0000","last_change":"2023-11-30T17:22:20.937900+0000","last_active":"2023-11-30T17:22:21.317876+0000","last_peered":"2023-11-30T17:22:21.317876+0000","last_clean":"2023-11-30T17:22:21.317876+0000","last_became_active":"2023-11-30T17:22:20.937608+0000","last_became_peered":"2023-11-30T17:22:20.937608+0000","last_unstale":"2023-11-30T17:22:21.317876+0000","last_undegraded":"2023-11-30T17:22:21.317876+0000","last_fullsized":"2023-11-30T17:22:21.317876+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.323213+0000","last_change":"2023-11-30T17:22:21.322290+0000","last_active":"2023-11-30T17:22:21.323213+0000","last_peered":"2023-11-30T17:22:21.323213+0000","last_clean":"2023-11-30T17:22:21.323213+0000","last_became_active":"2023-11-30T17:22:21.322013+0000","last_became_peered":"2023-11-30T17:22:21.322013+0000","last_unstale":"2023-11-30T17:22:21.323213+0000","last_undegraded":"2023-11-30T17:22:21.323213+0000","last_fullsized":"2023-11-30T17:22:21.323213+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.323126+0000","last_change":"2023-11-30T17:22:20.932736+0000","last_active":"2023-11-30T17:22:21.323126+0000","last_peered":"2023-11-30T17:22:21.323126+0000","last_clean":"2023-11-30T17:22:21.323126+0000","last_became_active":"2023-11-30T17:22:20.932229+0000","last_became_peered":"2023-11-30T17:22:20.932229+0000","last_unstale":"2023-11-30T17:22:21.323126+0000","last_undegraded":"2023-11-30T17:22:21.323126+0000","last_fullsized":"2023-11-30T17:22:21.323126+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337590+0000","last_change":"2023-11-30T17:22:21.329153+0000","last_active":"2023-11-30T17:22:21.337590+0000","last_peered":"2023-11-30T17:22:21.337590+0000","last_clean":"2023-11-30T17:22:21.337590+0000","last_became_active":"2023-11-30T17:22:21.328825+0000","last_became_peered":"2023-11-30T17:22:21.328825+0000","last_unstale":"2023-11-30T17:22:21.337590+0000","last_undegraded":"2023-11-30T17:22:21.337590+0000","last_fullsized":"2023-11-30T17:22:21.337590+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"82'3","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335296+0000","last_change":"2023-11-30T17:22:20.938912+0000","last_active":"2023-11-30T17:22:21.335296+0000","last_peered":"2023-11-30T17:22:21.335296+0000","last_clean":"2023-11-30T17:22:21.335296+0000","last_became_active":"2023-11-30T17:22:20.938502+0000","last_became_peered":"2023-11-30T17:22:20.938502+0000","last_unstale":"2023-11-30T17:22:21.335296+0000","last_undegraded":"2023-11-30T17:22:21.335296+0000","last_fullsized":"2023-11-30T17:22:21.335296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.336894+0000","last_change":"2023-11-30T17:22:21.331032+0000","last_active":"2023-11-30T17:22:21.336894+0000","last_peered":"2023-11-30T17:22:21.336894+0000","last_clean":"2023-11-30T17:22:21.336894+0000","last_became_active":"2023-11-30T17:22:21.326325+0000","last_became_peered":"2023-11-30T17:22:21.326325+0000","last_unstale":"2023-11-30T17:22:21.336894+0000","last_undegraded":"2023-11-30T17:22:21.336894+0000","last_fullsized":"2023-11-30T17:22:21.336894+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337727+0000","last_change":"2023-11-30T17:22:20.931360+0000","last_active":"2023-11-30T17:22:21.337727+0000","last_peered":"2023-11-30T17:22:21.337727+0000","last_clean":"2023-11-30T17:22:21.337727+0000","last_became_active":"2023-11-30T17:22:20.930703+0000","last_became_peered":"2023-11-30T17:22:20.930703+0000","last_unstale":"2023-11-30T17:22:21.337727+0000","last_undegraded":"2023-11-30T17:22:21.337727+0000","last_fullsized":"2023-11-30T17:22:21.337727+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.341697+0000","last_change":"2023-11-30T17:22:21.339966+0000","last_active":"2023-11-30T17:22:21.341697+0000","last_peered":"2023-11-30T17:22:21.341697+0000","last_clean":"2023-11-30T17:22:21.341697+0000","last_became_active":"2023-11-30T17:22:21.339673+0000","last_became_peered":"2023-11-30T17:22:21.339673+0000","last_unstale":"2023-11-30T17:22:21.341697+0000","last_undegraded":"2023-11-30T17:22:21.341697+0000","last_fullsized":"2023-11-30T17:22:21.341697+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337888+0000","last_change":"2023-11-30T17:22:20.939845+0000","last_active":"2023-11-30T17:22:21.337888+0000","last_peered":"2023-11-30T17:22:21.337888+0000","last_clean":"2023-11-30T17:22:21.337888+0000","last_became_active":"2023-11-30T17:22:20.939572+0000","last_became_peered":"2023-11-30T17:22:20.939572+0000","last_unstale":"2023-11-30T17:22:21.337888+0000","last_undegraded":"2023-11-30T17:22:21.337888+0000","last_fullsized":"2023-11-30T17:22:21.337888+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.334239+0000","last_change":"2023-11-30T17:22:21.329930+0000","last_active":"2023-11-30T17:22:21.334239+0000","last_peered":"2023-11-30T17:22:21.334239+0000","last_clean":"2023-11-30T17:22:21.334239+0000","last_became_active":"2023-11-30T17:22:21.329739+0000","last_became_peered":"2023-11-30T17:22:21.329739+0000","last_unstale":"2023-11-30T17:22:21.334239+0000","last_undegraded":"2023-11-30T17:22:21.334239+0000","last_fullsized":"2023-11-30T17:22:21.334239+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.317647+0000","last_change":"2023-11-30T17:22:20.933918+0000","last_active":"2023-11-30T17:22:21.317647+0000","last_peered":"2023-11-30T17:22:21.317647+0000","last_clean":"2023-11-30T17:22:21.317647+0000","last_became_active":"2023-11-30T17:22:20.933556+0000","last_became_peered":"2023-11-30T17:22:20.933556+0000","last_unstale":"2023-11-30T17:22:21.317647+0000","last_undegraded":"2023-11-30T17:22:21.317647+0000","last_fullsized":"2023-11-30T17:22:21.317647+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.332554+0000","last_change":"2023-11-30T17:22:21.325539+0000","last_active":"2023-11-30T17:22:21.332554+0000","last_peered":"2023-11-30T17:22:21.332554+0000","last_clean":"2023-11-30T17:22:21.332554+0000","last_became_active":"2023-11-30T17:22:21.325182+0000","last_became_peered":"2023-11-30T17:22:21.325182+0000","last_unstale":"2023-11-30T17:22:21.332554+0000","last_undegraded":"2023-11-30T17:22:21.332554+0000","last_fullsized":"2023-11-30T17:22:21.332554+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.319104+0000","last_change":"2023-11-30T17:22:20.942843+0000","last_active":"2023-11-30T17:22:21.319104+0000","last_peered":"2023-11-30T17:22:21.319104+0000","last_clean":"2023-11-30T17:22:21.319104+0000","last_became_active":"2023-11-30T17:22:20.942535+0000","last_became_peered":"2023-11-30T17:22:20.942535+0000","last_unstale":"2023-11-30T17:22:21.319104+0000","last_undegraded":"2023-11-30T17:22:21.319104+0000","last_fullsized":"2023-11-30T17:22:21.319104+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.328012+0000","last_change":"2023-11-30T17:22:21.324414+0000","last_active":"2023-11-30T17:22:21.328012+0000","last_peered":"2023-11-30T17:22:21.328012+0000","last_clean":"2023-11-30T17:22:21.328012+0000","last_became_active":"2023-11-30T17:22:21.324180+0000","last_became_peered":"2023-11-30T17:22:21.324180+0000","last_unstale":"2023-11-30T17:22:21.328012+0000","last_undegraded":"2023-11-30T17:22:21.328012+0000","last_fullsized":"2023-11-30T17:22:21.328012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"82'4","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.340717+0000","last_change":"2023-11-30T17:22:20.929471+0000","last_active":"2023-11-30T17:22:21.340717+0000","last_peered":"2023-11-30T17:22:21.340717+0000","last_clean":"2023-11-30T17:22:21.340717+0000","last_became_active":"2023-11-30T17:22:20.929194+0000","last_became_peered":"2023-11-30T17:22:20.929194+0000","last_unstale":"2023-11-30T17:22:21.340717+0000","last_undegraded":"2023-11-30T17:22:21.340717+0000","last_fullsized":"2023-11-30T17:22:21.340717+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337931+0000","last_change":"2023-11-30T17:22:21.337197+0000","last_active":"2023-11-30T17:22:21.337931+0000","last_peered":"2023-11-30T17:22:21.337931+0000","last_clean":"2023-11-30T17:22:21.337931+0000","last_became_active":"2023-11-30T17:22:21.336585+0000","last_became_peered":"2023-11-30T17:22:21.336585+0000","last_unstale":"2023-11-30T17:22:21.337931+0000","last_undegraded":"2023-11-30T17:22:21.337931+0000","last_fullsized":"2023-11-30T17:22:21.337931+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335893+0000","last_change":"2023-11-30T17:22:20.934027+0000","last_active":"2023-11-30T17:22:21.335893+0000","last_peered":"2023-11-30T17:22:21.335893+0000","last_clean":"2023-11-30T17:22:21.335893+0000","last_became_active":"2023-11-30T17:22:20.933415+0000","last_became_peered":"2023-11-30T17:22:20.933415+0000","last_unstale":"2023-11-30T17:22:21.335893+0000","last_undegraded":"2023-11-30T17:22:21.335893+0000","last_fullsized":"2023-11-30T17:22:21.335893+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335963+0000","last_change":"2023-11-30T17:22:21.333694+0000","last_active":"2023-11-30T17:22:21.335963+0000","last_peered":"2023-11-30T17:22:21.335963+0000","last_clean":"2023-11-30T17:22:21.335963+0000","last_became_active":"2023-11-30T17:22:21.333507+0000","last_became_peered":"2023-11-30T17:22:21.333507+0000","last_unstale":"2023-11-30T17:22:21.335963+0000","last_undegraded":"2023-11-30T17:22:21.335963+0000","last_fullsized":"2023-11-30T17:22:21.335963+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.320977+0000","last_change":"2023-11-30T17:22:20.929587+0000","last_active":"2023-11-30T17:22:21.320977+0000","last_peered":"2023-11-30T17:22:21.320977+0000","last_clean":"2023-11-30T17:22:21.320977+0000","last_became_active":"2023-11-30T17:22:20.929280+0000","last_became_peered":"2023-11-30T17:22:20.929280+0000","last_unstale":"2023-11-30T17:22:21.320977+0000","last_undegraded":"2023-11-30T17:22:21.320977+0000","last_fullsized":"2023-11-30T17:22:21.320977+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.339658+0000","last_change":"2023-11-30T17:22:21.333528+0000","last_active":"2023-11-30T17:22:21.339658+0000","last_peered":"2023-11-30T17:22:21.339658+0000","last_clean":"2023-11-30T17:22:21.339658+0000","last_became_active":"2023-11-30T17:22:21.333257+0000","last_became_peered":"2023-11-30T17:22:21.333257+0000","last_unstale":"2023-11-30T17:22:21.339658+0000","last_undegraded":"2023-11-30T17:22:21.339658+0000","last_fullsized":"2023-11-30T17:22:21.339658+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.314720+0000","last_change":"2023-11-30T17:22:20.936879+0000","last_active":"2023-11-30T17:22:21.314720+0000","last_peered":"2023-11-30T17:22:21.314720+0000","last_clean":"2023-11-30T17:22:21.314720+0000","last_became_active":"2023-11-30T17:22:20.936480+0000","last_became_peered":"2023-11-30T17:22:20.936480+0000","last_unstale":"2023-11-30T17:22:21.314720+0000","last_undegraded":"2023-11-30T17:22:21.314720+0000","last_fullsized":"2023-11-30T17:22:21.314720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.328898+0000","last_change":"2023-11-30T17:22:21.323442+0000","last_active":"2023-11-30T17:22:21.328898+0000","last_peered":"2023-11-30T17:22:21.328898+0000","last_clean":"2023-11-30T17:22:21.328898+0000","last_became_active":"2023-11-30T17:22:21.320580+0000","last_became_peered":"2023-11-30T17:22:21.320580+0000","last_unstale":"2023-11-30T17:22:21.328898+0000","last_undegraded":"2023-11-30T17:22:21.328898+0000","last_fullsized":"2023-11-30T17:22:21.328898+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.315988+0000","last_change":"2023-11-30T17:22:20.931107+0000","last_active":"2023-11-30T17:22:21.315988+0000","last_peered":"2023-11-30T17:22:21.315988+0000","last_clean":"2023-11-30T17:22:21.315988+0000","last_became_active":"2023-11-30T17:22:20.930305+0000","last_became_peered":"2023-11-30T17:22:20.930305+0000","last_unstale":"2023-11-30T17:22:21.315988+0000","last_undegraded":"2023-11-30T17:22:21.315988+0000","last_fullsized":"2023-11-30T17:22:21.315988+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.332421+0000","last_change":"2023-11-30T17:22:21.326301+0000","last_active":"2023-11-30T17:22:21.332421+0000","last_peered":"2023-11-30T17:22:21.332421+0000","last_clean":"2023-11-30T17:22:21.332421+0000","last_became_active":"2023-11-30T17:22:21.326019+0000","last_became_peered":"2023-11-30T17:22:21.326019+0000","last_unstale":"2023-11-30T17:22:21.332421+0000","last_undegraded":"2023-11-30T17:22:21.332421+0000","last_fullsized":"2023-11-30T17:22:21.332421+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.321118+0000","last_change":"2023-11-30T17:22:20.942745+0000","last_active":"2023-11-30T17:22:21.321118+0000","last_peered":"2023-11-30T17:22:21.321118+0000","last_clean":"2023-11-30T17:22:21.321118+0000","last_became_active":"2023-11-30T17:22:20.942453+0000","last_became_peered":"2023-11-30T17:22:20.942453+0000","last_unstale":"2023-11-30T17:22:21.321118+0000","last_undegraded":"2023-11-30T17:22:21.321118+0000","last_fullsized":"2023-11-30T17:22:21.321118+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.341513+0000","last_change":"2023-11-30T17:22:21.338134+0000","last_active":"2023-11-30T17:22:21.341513+0000","last_peered":"2023-11-30T17:22:21.341513+0000","last_clean":"2023-11-30T17:22:21.341513+0000","last_became_active":"2023-11-30T17:22:21.337848+0000","last_became_peered":"2023-11-30T17:22:21.337848+0000","last_unstale":"2023-11-30T17:22:21.341513+0000","last_undegraded":"2023-11-30T17:22:21.341513+0000","last_fullsized":"2023-11-30T17:22:21.341513+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.314531+0000","last_change":"2023-11-30T17:22:20.935254+0000","last_active":"2023-11-30T17:22:21.314531+0000","last_peered":"2023-11-30T17:22:21.314531+0000","last_clean":"2023-11-30T17:22:21.314531+0000","last_became_active":"2023-11-30T17:22:20.934966+0000","last_became_peered":"2023-11-30T17:22:20.934966+0000","last_unstale":"2023-11-30T17:22:21.314531+0000","last_undegraded":"2023-11-30T17:22:21.314531+0000","last_fullsized":"2023-11-30T17:22:21.314531+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.328239+0000","last_change":"2023-11-30T17:22:21.326066+0000","last_active":"2023-11-30T17:22:21.328239+0000","last_peered":"2023-11-30T17:22:21.328239+0000","last_clean":"2023-11-30T17:22:21.328239+0000","last_became_active":"2023-11-30T17:22:21.325745+0000","last_became_peered":"2023-11-30T17:22:21.325745+0000","last_unstale":"2023-11-30T17:22:21.328239+0000","last_undegraded":"2023-11-30T17:22:21.328239+0000","last_fullsized":"2023-11-30T17:22:21.328239+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.313737+0000","last_change":"2023-11-30T17:22:20.935412+0000","last_active":"2023-11-30T17:22:21.313737+0000","last_peered":"2023-11-30T17:22:21.313737+0000","last_clean":"2023-11-30T17:22:21.313737+0000","last_became_active":"2023-11-30T17:22:20.934756+0000","last_became_peered":"2023-11-30T17:22:20.934756+0000","last_unstale":"2023-11-30T17:22:21.313737+0000","last_undegraded":"2023-11-30T17:22:21.313737+0000","last_fullsized":"2023-11-30T17:22:21.313737+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.336712+0000","last_change":"2023-11-30T17:22:21.334589+0000","last_active":"2023-11-30T17:22:21.336712+0000","last_peered":"2023-11-30T17:22:21.336712+0000","last_clean":"2023-11-30T17:22:21.336712+0000","last_became_active":"2023-11-30T17:22:21.334131+0000","last_became_peered":"2023-11-30T17:22:21.334131+0000","last_unstale":"2023-11-30T17:22:21.336712+0000","last_undegraded":"2023-11-30T17:22:21.336712+0000","last_fullsized":"2023-11-30T17:22:21.336712+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.315239+0000","last_change":"2023-11-30T17:22:20.929746+0000","last_active":"2023-11-30T17:22:21.315239+0000","last_peered":"2023-11-30T17:22:21.315239+0000","last_clean":"2023-11-30T17:22:21.315239+0000","last_became_active":"2023-11-30T17:22:20.929451+0000","last_became_peered":"2023-11-30T17:22:20.929451+0000","last_unstale":"2023-11-30T17:22:21.315239+0000","last_undegraded":"2023-11-30T17:22:21.315239+0000","last_fullsized":"2023-11-30T17:22:21.315239+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.339965+0000","last_change":"2023-11-30T17:22:21.338801+0000","last_active":"2023-11-30T17:22:21.339965+0000","last_peered":"2023-11-30T17:22:21.339965+0000","last_clean":"2023-11-30T17:22:21.339965+0000","last_became_active":"2023-11-30T17:22:21.338518+0000","last_became_peered":"2023-11-30T17:22:21.338518+0000","last_unstale":"2023-11-30T17:22:21.339965+0000","last_undegraded":"2023-11-30T17:22:21.339965+0000","last_fullsized":"2023-11-30T17:22:21.339965+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.334611+0000","last_change":"2023-11-30T17:22:20.934112+0000","last_active":"2023-11-30T17:22:21.334611+0000","last_peered":"2023-11-30T17:22:21.334611+0000","last_clean":"2023-11-30T17:22:21.334611+0000","last_became_active":"2023-11-30T17:22:20.933778+0000","last_became_peered":"2023-11-30T17:22:20.933778+0000","last_unstale":"2023-11-30T17:22:21.334611+0000","last_undegraded":"2023-11-30T17:22:21.334611+0000","last_fullsized":"2023-11-30T17:22:21.334611+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.316069+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:22:21.316069+0000","last_peered":"2023-11-30T17:22:21.316069+0000","last_clean":"2023-11-30T17:22:21.316069+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:22:21.316069+0000","last_undegraded":"2023-11-30T17:22:21.316069+0000","last_fullsized":"2023-11-30T17:22:21.316069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.329466+0000","last_change":"2023-11-30T17:22:21.320422+0000","last_active":"2023-11-30T17:22:21.329466+0000","last_peered":"2023-11-30T17:22:21.329466+0000","last_clean":"2023-11-30T17:22:21.329466+0000","last_became_active":"2023-11-30T17:22:21.320108+0000","last_became_peered":"2023-11-30T17:22:21.320108+0000","last_unstale":"2023-11-30T17:22:21.329466+0000","last_undegraded":"2023-11-30T17:22:21.329466+0000","last_fullsized":"2023-11-30T17:22:21.329466+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.313395+0000","last_change":"2023-11-30T17:22:20.931616+0000","last_active":"2023-11-30T17:22:21.313395+0000","last_peered":"2023-11-30T17:22:21.313395+0000","last_clean":"2023-11-30T17:22:21.313395+0000","last_became_active":"2023-11-30T17:22:20.931340+0000","last_became_peered":"2023-11-30T17:22:20.931340+0000","last_unstale":"2023-11-30T17:22:21.313395+0000","last_undegraded":"2023-11-30T17:22:21.313395+0000","last_fullsized":"2023-11-30T17:22:21.313395+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.317913+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:22:21.317913+0000","last_peered":"2023-11-30T17:22:21.317913+0000","last_clean":"2023-11-30T17:22:21.317913+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:22:21.317913+0000","last_undegraded":"2023-11-30T17:22:21.317913+0000","last_fullsized":"2023-11-30T17:22:21.317913+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.334220+0000","last_change":"2023-11-30T17:22:21.327758+0000","last_active":"2023-11-30T17:22:21.334220+0000","last_peered":"2023-11-30T17:22:21.334220+0000","last_clean":"2023-11-30T17:22:21.334220+0000","last_became_active":"2023-11-30T17:22:21.327398+0000","last_became_peered":"2023-11-30T17:22:21.327398+0000","last_unstale":"2023-11-30T17:22:21.334220+0000","last_undegraded":"2023-11-30T17:22:21.334220+0000","last_fullsized":"2023-11-30T17:22:21.334220+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.317760+0000","last_change":"2023-11-30T17:22:20.927833+0000","last_active":"2023-11-30T17:22:21.317760+0000","last_peered":"2023-11-30T17:22:21.317760+0000","last_clean":"2023-11-30T17:22:21.317760+0000","last_became_active":"2023-11-30T17:22:20.927383+0000","last_became_peered":"2023-11-30T17:22:20.927383+0000","last_unstale":"2023-11-30T17:22:21.317760+0000","last_undegraded":"2023-11-30T17:22:21.317760+0000","last_fullsized":"2023-11-30T17:22:21.317760+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.322565+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:22:21.322565+0000","last_peered":"2023-11-30T17:22:21.322565+0000","last_clean":"2023-11-30T17:22:21.322565+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:22:21.322565+0000","last_undegraded":"2023-11-30T17:22:21.322565+0000","last_fullsized":"2023-11-30T17:22:21.322565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.332452+0000","last_change":"2023-11-30T17:22:21.326732+0000","last_active":"2023-11-30T17:22:21.332452+0000","last_peered":"2023-11-30T17:22:21.332452+0000","last_clean":"2023-11-30T17:22:21.332452+0000","last_became_active":"2023-11-30T17:22:21.326378+0000","last_became_peered":"2023-11-30T17:22:21.326378+0000","last_unstale":"2023-11-30T17:22:21.332452+0000","last_undegraded":"2023-11-30T17:22:21.332452+0000","last_fullsized":"2023-11-30T17:22:21.332452+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.313240+0000","last_change":"2023-11-30T17:22:20.931380+0000","last_active":"2023-11-30T17:22:21.313240+0000","last_peered":"2023-11-30T17:22:21.313240+0000","last_clean":"2023-11-30T17:22:21.313240+0000","last_became_active":"2023-11-30T17:22:20.931038+0000","last_became_peered":"2023-11-30T17:22:20.931038+0000","last_unstale":"2023-11-30T17:22:21.313240+0000","last_undegraded":"2023-11-30T17:22:21.313240+0000","last_fullsized":"2023-11-30T17:22:21.313240+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.321221+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:22:21.321221+0000","last_peered":"2023-11-30T17:22:21.321221+0000","last_clean":"2023-11-30T17:22:21.321221+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:22:21.321221+0000","last_undegraded":"2023-11-30T17:22:21.321221+0000","last_fullsized":"2023-11-30T17:22:21.321221+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":68,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.317713+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:22:21.317713+0000","last_peered":"2023-11-30T17:22:21.317713+0000","last_clean":"2023-11-30T17:22:21.317713+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:22:21.317713+0000","last_undegraded":"2023-11-30T17:22:21.317713+0000","last_fullsized":"2023-11-30T17:22:21.317713+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335131+0000","last_change":"2023-11-30T17:22:21.332384+0000","last_active":"2023-11-30T17:22:21.335131+0000","last_peered":"2023-11-30T17:22:21.335131+0000","last_clean":"2023-11-30T17:22:21.335131+0000","last_became_active":"2023-11-30T17:22:21.332098+0000","last_became_peered":"2023-11-30T17:22:21.332098+0000","last_unstale":"2023-11-30T17:22:21.335131+0000","last_undegraded":"2023-11-30T17:22:21.335131+0000","last_fullsized":"2023-11-30T17:22:21.335131+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337701+0000","last_change":"2023-11-30T17:22:20.934641+0000","last_active":"2023-11-30T17:22:21.337701+0000","last_peered":"2023-11-30T17:22:21.337701+0000","last_clean":"2023-11-30T17:22:21.337701+0000","last_became_active":"2023-11-30T17:22:20.934355+0000","last_became_peered":"2023-11-30T17:22:20.934355+0000","last_unstale":"2023-11-30T17:22:21.337701+0000","last_undegraded":"2023-11-30T17:22:21.337701+0000","last_fullsized":"2023-11-30T17:22:21.337701+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.319237+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:22:21.319237+0000","last_peered":"2023-11-30T17:22:21.319237+0000","last_clean":"2023-11-30T17:22:21.319237+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:22:21.319237+0000","last_undegraded":"2023-11-30T17:22:21.319237+0000","last_fullsized":"2023-11-30T17:22:21.319237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335955+0000","last_change":"2023-11-30T17:22:21.328382+0000","last_active":"2023-11-30T17:22:21.335955+0000","last_peered":"2023-11-30T17:22:21.335955+0000","last_clean":"2023-11-30T17:22:21.335955+0000","last_became_active":"2023-11-30T17:22:21.328042+0000","last_became_peered":"2023-11-30T17:22:21.328042+0000","last_unstale":"2023-11-30T17:22:21.335955+0000","last_undegraded":"2023-11-30T17:22:21.335955+0000","last_fullsized":"2023-11-30T17:22:21.335955+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.340246+0000","last_change":"2023-11-30T17:22:20.939499+0000","last_active":"2023-11-30T17:22:21.340246+0000","last_peered":"2023-11-30T17:22:21.340246+0000","last_clean":"2023-11-30T17:22:21.340246+0000","last_became_active":"2023-11-30T17:22:20.939186+0000","last_became_peered":"2023-11-30T17:22:20.939186+0000","last_unstale":"2023-11-30T17:22:21.340246+0000","last_undegraded":"2023-11-30T17:22:21.340246+0000","last_fullsized":"2023-11-30T17:22:21.340246+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.319544+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:22:21.319544+0000","last_peered":"2023-11-30T17:22:21.319544+0000","last_clean":"2023-11-30T17:22:21.319544+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:22:21.319544+0000","last_undegraded":"2023-11-30T17:22:21.319544+0000","last_fullsized":"2023-11-30T17:22:21.319544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.338546+0000","last_change":"2023-11-30T17:22:21.333492+0000","last_active":"2023-11-30T17:22:21.338546+0000","last_peered":"2023-11-30T17:22:21.338546+0000","last_clean":"2023-11-30T17:22:21.338546+0000","last_became_active":"2023-11-30T17:22:21.333152+0000","last_became_peered":"2023-11-30T17:22:21.333152+0000","last_unstale":"2023-11-30T17:22:21.338546+0000","last_undegraded":"2023-11-30T17:22:21.338546+0000","last_fullsized":"2023-11-30T17:22:21.338546+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.319467+0000","last_change":"2023-11-30T17:22:20.939112+0000","last_active":"2023-11-30T17:22:21.319467+0000","last_peered":"2023-11-30T17:22:21.319467+0000","last_clean":"2023-11-30T17:22:21.319467+0000","last_became_active":"2023-11-30T17:22:20.938852+0000","last_became_peered":"2023-11-30T17:22:20.938852+0000","last_unstale":"2023-11-30T17:22:21.319467+0000","last_undegraded":"2023-11-30T17:22:21.319467+0000","last_fullsized":"2023-11-30T17:22:21.319467+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.316533+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:22:21.316533+0000","last_peered":"2023-11-30T17:22:21.316533+0000","last_clean":"2023-11-30T17:22:21.316533+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:22:21.316533+0000","last_undegraded":"2023-11-30T17:22:21.316533+0000","last_fullsized":"2023-11-30T17:22:21.316533+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.328921+0000","last_change":"2023-11-30T17:22:21.324306+0000","last_active":"2023-11-30T17:22:21.328921+0000","last_peered":"2023-11-30T17:22:21.328921+0000","last_clean":"2023-11-30T17:22:21.328921+0000","last_became_active":"2023-11-30T17:22:21.320900+0000","last_became_peered":"2023-11-30T17:22:21.320900+0000","last_unstale":"2023-11-30T17:22:21.328921+0000","last_undegraded":"2023-11-30T17:22:21.328921+0000","last_fullsized":"2023-11-30T17:22:21.328921+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.313882+0000","last_change":"2023-11-30T17:22:20.931092+0000","last_active":"2023-11-30T17:22:21.313882+0000","last_peered":"2023-11-30T17:22:21.313882+0000","last_clean":"2023-11-30T17:22:21.313882+0000","last_became_active":"2023-11-30T17:22:20.930734+0000","last_became_peered":"2023-11-30T17:22:20.930734+0000","last_unstale":"2023-11-30T17:22:21.313882+0000","last_undegraded":"2023-11-30T17:22:21.313882+0000","last_fullsized":"2023-11-30T17:22:21.313882+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":72,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.316518+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:22:21.316518+0000","last_peered":"2023-11-30T17:22:21.316518+0000","last_clean":"2023-11-30T17:22:21.316518+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:22:21.316518+0000","last_undegraded":"2023-11-30T17:22:21.316518+0000","last_fullsized":"2023-11-30T17:22:21.316518+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575031,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298088,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073752,"statfs":{"total":96636764160,"available":96331522048,"internally_reserved":0,"allocated":1015808,"data_stored":500899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58899999999999997,"15min":0.57299999999999995},"min":{"1min":0.48499999999999999,"5min":0.315,"15min":0.23899999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.81100000000000005},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.57899999999999996},"min":{"1min":0.41999999999999998,"5min":0.40699999999999997,"15min":0.32200000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.81899999999999995},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54800000000000004,"15min":0.54000000000000004},"min":{"1min":0.40600000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.41499999999999998,"5min":0.29899999999999999,"15min":0.28799999999999998},"max":{"1min":0.71799999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.36599999999999999}]},{"osd":2,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.47799999999999998,"5min":0.33500000000000002,"15min":0.32800000000000001},"max":{"1min":0.77000000000000002,"5min":0.77200000000000002,"15min":0.78300000000000003},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56100000000000005,"15min":0.55600000000000005},"min":{"1min":0.48299999999999998,"5min":0.35399999999999998,"15min":0.28699999999999998},"max":{"1min":0.73699999999999999,"5min":0.73799999999999999,"15min":0.83899999999999997},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.44800000000000001,"5min":0.36499999999999999,"15min":0.33200000000000002},"max":{"1min":0.749,"5min":0.754,"15min":0.78000000000000003},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.45800000000000002,"5min":0.40799999999999997,"15min":0.33900000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.45300000000000001,"15min":0.46500000000000002},"min":{"1min":0.34200000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.79900000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47099999999999997,"15min":0.48999999999999999},"min":{"1min":0.33400000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.748,"5min":0.75800000000000001,"15min":1.3180000000000001},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.48899999999999999,"15min":0.498},"min":{"1min":0.34300000000000003,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.82899999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.872},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54700000000000004,"15min":0.55400000000000005},"min":{"1min":0.42499999999999999,"5min":0.372,"15min":0.36099999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.85199999999999998},"last":0.622},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.54900000000000004,"15min":0.55400000000000005},"min":{"1min":0.44600000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78900000000000003,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.66200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575030,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302176,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069664,"statfs":{"total":96636764160,"available":96327335936,"internally_reserved":0,"allocated":1007616,"data_stored":499917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55100000000000005,"15min":0.56499999999999995},"min":{"1min":0.32500000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71299999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.58199999999999996},"min":{"1min":0.33500000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.72199999999999998,"5min":0.79600000000000004,"15min":0.89300000000000002},"last":0.748}]},{"osd":1,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.376,"5min":0.30599999999999999,"15min":0.26400000000000001},"max":{"1min":0.74199999999999999,"5min":0.77500000000000002,"15min":0.82799999999999996},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58299999999999996,"15min":0.59299999999999997},"min":{"1min":0.44600000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.74099999999999999,"5min":0.82499999999999996,"15min":0.85199999999999998},"last":0.67900000000000005}]},{"osd":2,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.45000000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.68799999999999994,"5min":0.79900000000000004,"15min":0.82599999999999996},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.46700000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72799999999999998,"5min":0.80900000000000005,"15min":0.82499999999999996},"last":0.70199999999999996}]},{"osd":3,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51500000000000001,"15min":0.53200000000000003},"min":{"1min":0.34300000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69099999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.40200000000000002,"5min":0.33100000000000002,"15min":0.32200000000000001},"max":{"1min":0.73099999999999998,"5min":0.75600000000000001,"15min":0.79600000000000004},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.44700000000000001,"15min":0.45400000000000001},"min":{"1min":0.35499999999999998,"5min":0.29599999999999999,"15min":0.28999999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.84199999999999997},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46300000000000002,"15min":0.47899999999999998},"min":{"1min":0.36499999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.65500000000000003,"5min":0.76000000000000001,"15min":0.83899999999999997},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.46100000000000002,"15min":0.47099999999999997},"min":{"1min":0.35199999999999998,"5min":0.29899999999999999,"15min":0.28299999999999997},"max":{"1min":0.65200000000000002,"5min":0.69399999999999995,"15min":0.74299999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.50700000000000001},"min":{"1min":0.371,"5min":0.33500000000000002,"15min":0.31900000000000001},"max":{"1min":0.70399999999999996,"5min":0.745,"15min":0.78500000000000003},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51700000000000002,"15min":0.53300000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73299999999999998,"5min":0.80700000000000005,"15min":0.93200000000000005},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55300000000000005,"15min":0.56299999999999994},"min":{"1min":0.39500000000000002,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.86499999999999999},"last":0.60399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302188,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069652,"statfs":{"total":96636764160,"available":96327323648,"internally_reserved":0,"allocated":1019904,"data_stored":500639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.35999999999999999,"15min":0.35099999999999998},"min":{"1min":0.29599999999999999,"5min":0.23899999999999999,"15min":0.23000000000000001},"max":{"1min":0.54900000000000004,"5min":0.57199999999999995,"15min":0.60299999999999998},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.502,"5min":0.46999999999999997,"15min":0.46100000000000002},"min":{"1min":0.39200000000000002,"5min":0.314,"15min":0.309},"max":{"1min":0.59899999999999998,"5min":0.748,"15min":0.75700000000000001},"last":0.45900000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.39100000000000001,"15min":0.379},"min":{"1min":0.28599999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.56999999999999995,"5min":0.59799999999999998,"15min":0.67300000000000004},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.50800000000000001,"15min":0.48999999999999999},"min":{"1min":0.438,"5min":0.33400000000000002,"15min":0.29499999999999998},"max":{"1min":0.64200000000000002,"5min":0.78200000000000003,"15min":0.80700000000000005},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45100000000000001,"15min":0.441},"min":{"1min":0.38200000000000001,"5min":0.29899999999999999,"15min":0.23899999999999999},"max":{"1min":0.57099999999999995,"5min":0.70299999999999996,"15min":0.749},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.437,"15min":0.42599999999999999},"min":{"1min":0.34100000000000003,"5min":0.29999999999999999,"15min":0.28599999999999998},"max":{"1min":0.55700000000000005,"5min":0.71899999999999997,"15min":0.73699999999999999},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.44400000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.873,"5min":0.88500000000000001,"15min":0.89100000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.61199999999999999,"15min":0.61499999999999999},"min":{"1min":0.48599999999999999,"5min":0.41299999999999998,"15min":0.39900000000000002},"max":{"1min":0.753,"5min":0.97599999999999998,"15min":1.111},"last":0.60199999999999998}]},{"osd":5,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59799999999999998,"15min":0.59899999999999998},"min":{"1min":0.44400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.85399999999999998,"5min":1.006,"15min":1.006},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.434,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76500000000000001,"5min":0.81399999999999995,"15min":0.91300000000000003},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.56699999999999995,"5min":0.39700000000000002,"15min":0.39600000000000002},"max":{"1min":0.85699999999999998,"5min":0.92700000000000005,"15min":1.0600000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65200000000000002,"15min":0.65800000000000003},"min":{"1min":0.51600000000000001,"5min":0.433,"15min":0.379},"max":{"1min":0.91100000000000003,"5min":0.96099999999999997,"15min":1.0780000000000001},"last":0.745}]},{"osd":7,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67000000000000004,"15min":0.66300000000000003},"min":{"1min":0.45100000000000001,"5min":0.41899999999999998,"15min":0.41699999999999998},"max":{"1min":0.88900000000000001,"5min":0.92300000000000004,"15min":0.98699999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64000000000000001,"15min":0.64700000000000002},"min":{"1min":0.52500000000000002,"5min":0.436,"15min":0.39900000000000002},"max":{"1min":0.81999999999999995,"5min":0.879,"15min":0.94199999999999995},"last":0.59499999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575030,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302172,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069668,"statfs":{"total":96636764160,"available":96327340032,"internally_reserved":0,"allocated":1003520,"data_stored":499883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.373,"15min":0.35999999999999999},"min":{"1min":0.27500000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.48599999999999999,"5min":0.59999999999999998,"15min":0.71199999999999997},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.39100000000000001,"15min":0.379},"min":{"1min":0.26500000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.26100000000000001}]},{"osd":2,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.39100000000000001,"15min":0.38},"min":{"1min":0.29499999999999998,"5min":0.247,"15min":0.23899999999999999},"max":{"1min":0.55900000000000005,"5min":0.623,"15min":0.623},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.46300000000000002,"15min":0.45300000000000001},"min":{"1min":0.38100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.63400000000000001,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.313}]},{"osd":3,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.433,"15min":0.42599999999999999},"min":{"1min":0.32500000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.58599999999999997,"5min":0.66100000000000003,"15min":0.70999999999999996},"last":0.245},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44700000000000001,"15min":0.435},"min":{"1min":0.34300000000000003,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.56200000000000006,"5min":0.65400000000000003,"15min":0.68799999999999994},"last":0.27300000000000002}]},{"osd":4,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60999999999999999,"15min":0.59999999999999998},"min":{"1min":0.44900000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76400000000000001,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.50800000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.85399999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60899999999999999,"15min":0.59499999999999997},"min":{"1min":0.47399999999999998,"5min":0.39200000000000002,"15min":0.36199999999999999},"max":{"1min":0.83499999999999996,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63700000000000001,"15min":0.623},"min":{"1min":0.51500000000000001,"5min":0.38400000000000001,"15min":0.38},"max":{"1min":0.77700000000000002,"5min":1.004,"15min":1.004},"last":0.54500000000000004}]},{"osd":6,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65100000000000002,"15min":0.63900000000000001},"min":{"1min":0.435,"5min":0.376,"15min":0.376},"max":{"1min":0.89800000000000002,"5min":1.002,"15min":1.002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63900000000000001,"15min":0.627},"min":{"1min":0.496,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.872,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66000000000000003,"15min":0.64600000000000002},"min":{"1min":0.498,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94499999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.69699999999999995,"15min":0.68200000000000005},"min":{"1min":0.56100000000000005,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.93799999999999994,"5min":1.026,"15min":1.026},"last":0.63600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575030,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306264,"kb_used_data":976,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065576,"statfs":{"total":96636764160,"available":96323149824,"internally_reserved":0,"allocated":999424,"data_stored":493775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40400000000000003,"15min":0.38800000000000001},"min":{"1min":0.31,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.57099999999999995,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":3.4729999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.42899999999999999,"15min":0.42699999999999999},"min":{"1min":0.33800000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58899999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":2.637}]},{"osd":1,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45300000000000001,"15min":0.44},"min":{"1min":0.36799999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.63800000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":6.1210000000000004},{"interface":"front","average":{"1min":0.505,"5min":0.47799999999999998,"15min":0.46700000000000003},"min":{"1min":0.33400000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.67500000000000004,"5min":1.206,"15min":1.206},"last":5.7270000000000003}]},{"osd":3,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38600000000000001,"15min":0.39700000000000002},"min":{"1min":0.27200000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.56200000000000006,"5min":0.63500000000000001,"15min":0.86199999999999999},"last":0.438},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.46000000000000002},"min":{"1min":0.40999999999999998,"5min":0.26900000000000002,"15min":0.26200000000000001},"max":{"1min":0.60099999999999998,"5min":1.226,"15min":1.226},"last":1.756}]},{"osd":4,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61899999999999999,"15min":0.60999999999999999},"min":{"1min":0.46100000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84699999999999998,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":8.7170000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.78500000000000003,"5min":1.492,"15min":1.492},"last":1.381}]},{"osd":5,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63400000000000001,"15min":0.629},"min":{"1min":0.503,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94699999999999995,"5min":0.996,"15min":0.996},"last":3.4359999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.623,"15min":0.624},"min":{"1min":0.48899999999999999,"5min":0.38900000000000001,"15min":0.38100000000000001},"max":{"1min":0.79900000000000004,"5min":1.292,"15min":1.292},"last":1.982}]},{"osd":6,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.625,"15min":0.621},"min":{"1min":0.47499999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.76600000000000001,"5min":1.359,"15min":1.359},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.53300000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.879,"5min":1.159,"15min":1.159},"last":1.861}]},{"osd":7,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.57299999999999995,"5min":0.45200000000000001,"15min":0.40300000000000002},"max":{"1min":0.88600000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":4.6849999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67600000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.41499999999999998},"max":{"1min":0.93100000000000005,"5min":1.125,"15min":1.125},"last":4.5039999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575030,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306276,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065564,"statfs":{"total":96636764160,"available":96323137536,"internally_reserved":0,"allocated":1011712,"data_stored":500507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35799999999999998,"15min":0.36199999999999999},"min":{"1min":0.26800000000000002,"5min":0.219,"15min":0.217},"max":{"1min":0.47899999999999998,"5min":0.57699999999999996,"15min":0.66200000000000003},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.40699999999999997,"15min":0.40000000000000002},"min":{"1min":0.30199999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.57199999999999995,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.33100000000000002}]},{"osd":1,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.38,"15min":0.38600000000000001},"min":{"1min":0.30199999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.42199999999999999,"15min":0.42999999999999999},"min":{"1min":0.32300000000000001,"5min":0.26600000000000001,"15min":0.25900000000000001},"max":{"1min":0.54500000000000004,"5min":0.65900000000000003,"15min":0.84399999999999997},"last":0.379}]},{"osd":2,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.44400000000000001,"15min":0.44800000000000001},"min":{"1min":0.32800000000000001,"5min":0.28599999999999998,"15min":0.26000000000000001},"max":{"1min":0.66000000000000003,"5min":0.72999999999999998,"15min":0.94899999999999995},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.505,"15min":0.505},"min":{"1min":0.41199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.63700000000000001,"5min":1.054,"15min":1.054},"last":0.42799999999999999}]},{"osd":4,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59699999999999998,"15min":0.60399999999999998},"min":{"1min":0.45000000000000001,"5min":0.35299999999999998,"15min":0.35099999999999998},"max":{"1min":0.75900000000000001,"5min":0.91500000000000004,"15min":0.97599999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.47299999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78300000000000003,"5min":0.86799999999999999,"15min":0.91400000000000003},"last":0.56699999999999995}]},{"osd":5,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.59099999999999997,"15min":0.61099999999999999},"min":{"1min":0.42599999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82299999999999995,"5min":0.85399999999999998,"15min":0.98399999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77500000000000002,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.67700000000000005}]},{"osd":6,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.626,"15min":0.64500000000000002},"min":{"1min":0.48699999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81200000000000006,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.49399999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81200000000000006,"5min":0.89500000000000002,"15min":1.0389999999999999},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65600000000000003,"15min":0.66600000000000004},"min":{"1min":0.503,"5min":0.40500000000000003,"15min":0.39100000000000001},"max":{"1min":0.83699999999999997,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64800000000000002,"15min":0.66000000000000003},"min":{"1min":0.49199999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.004},"last":0.69599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575030,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302180,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069660,"statfs":{"total":96636764160,"available":96327331840,"internally_reserved":0,"allocated":1011712,"data_stored":500527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.52500000000000002,"15min":0.52800000000000002},"min":{"1min":0.30599999999999999,"5min":0.28299999999999997,"15min":0.27500000000000002},"max":{"1min":0.748,"5min":0.77700000000000002,"15min":0.80900000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.28399999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.81999999999999995,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.442}]},{"osd":1,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.25800000000000001},"max":{"1min":0.69699999999999995,"5min":0.73799999999999999,"15min":0.79600000000000004},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54500000000000004,"15min":0.54600000000000004},"min":{"1min":0.34499999999999997,"5min":0.317,"15min":0.246},"max":{"1min":0.72499999999999998,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.41199999999999998,"5min":0.376,"15min":0.27800000000000002},"max":{"1min":0.755,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.39600000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71099999999999997,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55000000000000004,"15min":0.54600000000000004},"min":{"1min":0.42599999999999999,"5min":0.34699999999999998,"15min":0.32900000000000001},"max":{"1min":0.71299999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.40999999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74299999999999999,"5min":0.78900000000000003,"15min":0.80600000000000005},"last":0.59399999999999997}]},{"osd":5,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.438,"15min":0.44700000000000001},"min":{"1min":0.32900000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.58099999999999996,"5min":1.272,"15min":1.272},"last":0.63},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46100000000000002,"15min":0.46400000000000002},"min":{"1min":0.34300000000000003,"5min":0.29899999999999999,"15min":0.29199999999999998},"max":{"1min":0.54000000000000004,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.501,"15min":0.505},"min":{"1min":0.38100000000000001,"5min":0.33900000000000002,"15min":0.314},"max":{"1min":0.63800000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54800000000000004,"15min":0.54000000000000004},"min":{"1min":0.45800000000000002,"5min":0.373,"15min":0.33800000000000002},"max":{"1min":0.61699999999999999,"5min":1.129,"15min":1.129},"last":0.75}]},{"osd":7,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34300000000000003,"5min":0.318,"15min":0.29899999999999999},"max":{"1min":0.66900000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.44900000000000001,"5min":0.38600000000000001,"15min":0.34599999999999997},"max":{"1min":0.70799999999999996,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.76700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575030,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302168,"kb_used_data":976,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069672,"statfs":{"total":96636764160,"available":96327344128,"internally_reserved":0,"allocated":999424,"data_stored":494065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53300000000000003,"15min":0.53600000000000003},"min":{"1min":0.40600000000000003,"5min":0.34399999999999997,"15min":0.32800000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.40899999999999997,"5min":0.31,"15min":0.31},"max":{"1min":0.70299999999999996,"5min":0.76200000000000001,"15min":0.81799999999999995},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52100000000000002,"15min":0.52800000000000002},"min":{"1min":0.35399999999999998,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.67100000000000004,"5min":0.69599999999999995,"15min":0.72399999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55000000000000004,"15min":0.54600000000000004},"min":{"1min":0.44900000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.745,"5min":0.754,"15min":0.77000000000000002},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.40000000000000002,"5min":0.34399999999999997,"15min":0.30599999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.622},{"interface":"front","average":{"1min":0.627,"5min":0.60099999999999998,"15min":0.59499999999999997},"min":{"1min":0.48699999999999999,"5min":0.378,"15min":0.34499999999999997},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.44800000000000001,"5min":0.36699999999999999,"15min":0.36399999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.73799999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.45600000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73299999999999998,"5min":0.79200000000000004,"15min":0.82099999999999995},"last":0.58799999999999997}]},{"osd":4,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42399999999999999,"15min":0.44},"min":{"1min":0.307,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57699999999999996,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45800000000000002,"15min":0.46700000000000003},"min":{"1min":0.31900000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.77600000000000002},"last":0.44}]},{"osd":6,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47599999999999998,"15min":0.48599999999999999},"min":{"1min":0.34200000000000003,"5min":0.29599999999999999,"15min":0.28499999999999998},"max":{"1min":0.70499999999999996,"5min":0.73999999999999999,"15min":0.82099999999999995},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.67500000000000004,"5min":0.81399999999999995,"15min":0.88200000000000001},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52000000000000002,"15min":0.52600000000000002},"min":{"1min":0.33100000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.73899999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.41799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.84599999999999997},"last":0.55200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:22:29.829 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:22:29.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.959+0000 7fe31359e700 1 Processor -- start 2023-11-30T17:22:29.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.959+0000 7fe31359e700 1 -- start start 2023-11-30T17:22:29.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.960+0000 7fe31359e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe3141388d0 0x7fe314065070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:29.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.960+0000 7fe31359e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe314065560 0x7fe3140683d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:29.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.960+0000 7fe31359e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe31413be10 con 0x7fe3140688c0 2023-11-30T17:22:29.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.960+0000 7fe31359e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe314065c30 con 0x7fe3141388d0 2023-11-30T17:22:29.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.960+0000 7fe31359e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3140c1c70 con 0x7fe314065560 2023-11-30T17:22:29.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.960+0000 7fe31259c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe3141388d0 0x7fe314065070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:29.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.960+0000 7fe31259c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe3141388d0 0x7fe314065070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53834/0 (socket says 172.21.15.49:53834) 2023-11-30T17:22:29.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.960+0000 7fe31259c700 1 -- 172.21.15.49:0/38707722 learned_addr learned my addr 172.21.15.49:0/38707722 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:29.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.960+0000 7fe311d9b700 1 --2- 172.21.15.49:0/38707722 >> v2:172.21.15.115:3300/0 conn(0x7fe314065560 0x7fe3140683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:29.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.960+0000 7fe31259c700 1 -- 172.21.15.49:0/38707722 >> v2:172.21.15.115:3300/0 conn(0x7fe314065560 msgr2=0x7fe3140683d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:29.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.960+0000 7fe31259c700 1 --2- 172.21.15.49:0/38707722 >> v2:172.21.15.115:3300/0 conn(0x7fe314065560 0x7fe3140683d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:29.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.961+0000 7fe31259c700 1 -- 172.21.15.49:0/38707722 >> v1:172.21.15.115:6789/0 conn(0x7fe3140688c0 legacy=0x7fe314155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:29.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.961+0000 7fe31259c700 1 -- 172.21.15.49:0/38707722 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3140659e0 con 0x7fe3141388d0 2023-11-30T17:22:29.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.961+0000 7fe31259c700 1 --2- 172.21.15.49:0/38707722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3141388d0 0x7fe314065070 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7fe31413bac0 tx=0x7fe30c0090f0).ready entity=mon.0 client_cookie=75ca2c0980fb5850 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:29.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.961+0000 7fe31159a700 1 -- 172.21.15.49:0/38707722 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c00b600 con 0x7fe3141388d0 2023-11-30T17:22:29.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.961+0000 7fe31159a700 1 -- 172.21.15.49:0/38707722 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30c00b760 con 0x7fe3141388d0 2023-11-30T17:22:29.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.961+0000 7fe31159a700 1 -- 172.21.15.49:0/38707722 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c00bae0 con 0x7fe3141388d0 2023-11-30T17:22:29.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.961+0000 7fe31359e700 1 -- 172.21.15.49:0/38707722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3141388d0 msgr2=0x7fe314065070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:29.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.961+0000 7fe31359e700 1 --2- 172.21.15.49:0/38707722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3141388d0 0x7fe314065070 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7fe31413bac0 tx=0x7fe30c0090f0).stop 2023-11-30T17:22:29.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.961+0000 7fe31359e700 1 -- 172.21.15.49:0/38707722 shutdown_connections 2023-11-30T17:22:29.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.961+0000 7fe31359e700 1 --2- 172.21.15.49:0/38707722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3141388d0 0x7fe314065070 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:29.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.961+0000 7fe31359e700 1 --2- 172.21.15.49:0/38707722 >> v2:172.21.15.115:3300/0 conn(0x7fe314065560 0x7fe3140683d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.961+0000 7fe31359e700 1 -- 172.21.15.49:0/38707722 >> 172.21.15.49:0/38707722 conn(0x7fe3140631d0 msgr2=0x7fe3140c6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.961+0000 7fe31359e700 1 -- 172.21.15.49:0/38707722 shutdown_connections 2023-11-30T17:22:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.962+0000 7fe31359e700 1 -- 172.21.15.49:0/38707722 wait complete. 2023-11-30T17:22:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.963+0000 7fe31359e700 1 Processor -- start 2023-11-30T17:22:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.963+0000 7fe31359e700 1 -- start start 2023-11-30T17:22:29.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.963+0000 7fe31359e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe314065560 0x7fe314151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:29.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.963+0000 7fe31359e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3140688c0 0x7fe3140abb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:29.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.963+0000 7fe31359e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe3141388d0 0x7fe3140ac050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:29.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.963+0000 7fe31359e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3140ac540 con 0x7fe314065560 2023-11-30T17:22:29.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.963+0000 7fe31359e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3140ab550 con 0x7fe3140688c0 2023-11-30T17:22:29.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.963+0000 7fe31359e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3140c4cf0 con 0x7fe3141388d0 2023-11-30T17:22:29.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.964+0000 7fe31259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe314065560 0x7fe314151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:29.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.964+0000 7fe31259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe314065560 0x7fe314151ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53850/0 (socket says 172.21.15.49:53850) 2023-11-30T17:22:29.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.964+0000 7fe31259c700 1 -- 172.21.15.49:0/2522802096 learned_addr learned my addr 172.21.15.49:0/2522802096 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:29.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.964+0000 7fe311d9b700 1 --2- 172.21.15.49:0/2522802096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3140688c0 0x7fe3140abb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:29.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.964+0000 7fe312d9d700 1 --2- 172.21.15.49:0/2522802096 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe3141388d0 0x7fe3140ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:29.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.964+0000 7fe31259c700 1 -- 172.21.15.49:0/2522802096 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe3141388d0 msgr2=0x7fe3140ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:29.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.964+0000 7fe31259c700 1 --2- 172.21.15.49:0/2522802096 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe3141388d0 0x7fe3140ac050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:29.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.964+0000 7fe31259c700 1 -- 172.21.15.49:0/2522802096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3140688c0 msgr2=0x7fe3140abb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:29.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.964+0000 7fe31259c700 1 --2- 172.21.15.49:0/2522802096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3140688c0 0x7fe3140abb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:29.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.964+0000 7fe31259c700 1 -- 172.21.15.49:0/2522802096 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30c009370 con 0x7fe314065560 2023-11-30T17:22:29.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.964+0000 7fe311d9b700 1 --2- 172.21.15.49:0/2522802096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3140688c0 0x7fe3140abb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:29.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.964+0000 7fe31259c700 1 --2- 172.21.15.49:0/2522802096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe314065560 0x7fe314151ee0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7fe314063cf0 tx=0x7fe30c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:29.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.964+0000 7fe30a7fc700 1 -- 172.21.15.49:0/2522802096 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c00b8d0 con 0x7fe314065560 2023-11-30T17:22:29.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.964+0000 7fe30a7fc700 1 -- 172.21.15.49:0/2522802096 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30c00ba30 con 0x7fe314065560 2023-11-30T17:22:29.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.964+0000 7fe31359e700 1 -- 172.21.15.49:0/2522802096 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3140ab270 con 0x7fe314065560 2023-11-30T17:22:29.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.964+0000 7fe30a7fc700 1 -- 172.21.15.49:0/2522802096 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c01b660 con 0x7fe314065560 2023-11-30T17:22:29.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.964+0000 7fe31359e700 1 -- 172.21.15.49:0/2522802096 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3140c4980 con 0x7fe314065560 2023-11-30T17:22:29.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.965+0000 7fe31359e700 1 -- 172.21.15.49:0/2522802096 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe31406c7c0 con 0x7fe314065560 2023-11-30T17:22:29.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.966+0000 7fe30a7fc700 1 -- 172.21.15.49:0/2522802096 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe30c01ba10 con 0x7fe314065560 2023-11-30T17:22:29.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.966+0000 7fe30a7fc700 1 --2- 172.21.15.49:0/2522802096 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe2f405f270 0x7fe2f4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:29.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.966+0000 7fe30a7fc700 1 -- 172.21.15.49:0/2522802096 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fe30c07bdd0 con 0x7fe314065560 2023-11-30T17:22:29.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.966+0000 7fe311d9b700 1 --2- 172.21.15.49:0/2522802096 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe2f405f270 0x7fe2f4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:29.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.967+0000 7fe311d9b700 1 --2- 172.21.15.49:0/2522802096 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe2f405f270 0x7fe2f4061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fe3140a95a0 tx=0x7fe2fc008040).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:29.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:29.970+0000 7fe30a7fc700 1 -- 172.21.15.49:0/2522802096 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe30c04cf00 con 0x7fe314065560 2023-11-30T17:22:30.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.141+0000 7fe31359e700 1 -- 172.21.15.49:0/2522802096 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe3140c4e30 con 0x7fe2f405f270 2023-11-30T17:22:30.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.152+0000 7fe30a7fc700 1 -- 172.21.15.49:0/2522802096 <== mgr.5926 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361479 (secure 0 0 0) 0x7fe2fc00f710 con 0x7fe2f405f270 2023-11-30T17:22:30.159 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.155+0000 7fe31359e700 1 -- 172.21.15.49:0/2522802096 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe2f405f270 msgr2=0x7fe2f4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.155+0000 7fe31359e700 1 --2- 172.21.15.49:0/2522802096 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe2f405f270 0x7fe2f4061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fe3140a95a0 tx=0x7fe2fc008040).stop 2023-11-30T17:22:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.155+0000 7fe31359e700 1 -- 172.21.15.49:0/2522802096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe314065560 msgr2=0x7fe314151ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.155+0000 7fe31359e700 1 --2- 172.21.15.49:0/2522802096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe314065560 0x7fe314151ee0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7fe314063cf0 tx=0x7fe30c017000).stop 2023-11-30T17:22:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.155+0000 7fe31359e700 1 -- 172.21.15.49:0/2522802096 shutdown_connections 2023-11-30T17:22:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.155+0000 7fe31359e700 1 --2- 172.21.15.49:0/2522802096 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe3141388d0 0x7fe3140ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.155+0000 7fe31359e700 1 --2- 172.21.15.49:0/2522802096 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe2f405f270 0x7fe2f4061730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.155+0000 7fe31359e700 1 --2- 172.21.15.49:0/2522802096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe314065560 0x7fe314151ee0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.155+0000 7fe31359e700 1 --2- 172.21.15.49:0/2522802096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3140688c0 0x7fe3140abb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.155+0000 7fe31359e700 1 -- 172.21.15.49:0/2522802096 >> 172.21.15.49:0/2522802096 conn(0x7fe3140631d0 msgr2=0x7fe3141359e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.155+0000 7fe31359e700 1 -- 172.21.15.49:0/2522802096 shutdown_connections 2023-11-30T17:22:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.156+0000 7fe31359e700 1 -- 172.21.15.49:0/2522802096 wait complete. 2023-11-30T17:22:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:22:30.170 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-11-30T17:22:28.232154+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":206,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2421512,"kb_used_data":7880,"kb_used_omap":0,"kb_used_meta":2413568,"kb_avail":752553208,"statfs":{"total":773094113280,"available":770614484992,"internally_reserved":0,"allocated":8069120,"data_stored":3990212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2471493632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27889,"num_objects":-11,"num_object_clones":0,"num_object_copies":-22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-56,"num_write_kb":-59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.011820"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.341505+0000","last_change":"2023-11-30T17:22:21.337968+0000","last_active":"2023-11-30T17:22:21.341505+0000","last_peered":"2023-11-30T17:22:21.341505+0000","last_clean":"2023-11-30T17:22:21.341505+0000","last_became_active":"2023-11-30T17:22:21.334598+0000","last_became_peered":"2023-11-30T17:22:21.334598+0000","last_unstale":"2023-11-30T17:22:21.341505+0000","last_undegraded":"2023-11-30T17:22:21.341505+0000","last_fullsized":"2023-11-30T17:22:21.341505+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3f","version":"82'3","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.329667+0000","last_change":"2023-11-30T17:22:20.929205+0000","last_active":"2023-11-30T17:22:21.329667+0000","last_peered":"2023-11-30T17:22:21.329667+0000","last_clean":"2023-11-30T17:22:21.329667+0000","last_became_active":"2023-11-30T17:22:20.928896+0000","last_became_peered":"2023-11-30T17:22:20.928896+0000","last_unstale":"2023-11-30T17:22:21.329667+0000","last_undegraded":"2023-11-30T17:22:21.329667+0000","last_fullsized":"2023-11-30T17:22:21.329667+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.338315+0000","last_change":"2023-11-30T17:22:21.334792+0000","last_active":"2023-11-30T17:22:21.338315+0000","last_peered":"2023-11-30T17:22:21.338315+0000","last_clean":"2023-11-30T17:22:21.338315+0000","last_became_active":"2023-11-30T17:22:21.334491+0000","last_became_peered":"2023-11-30T17:22:21.334491+0000","last_unstale":"2023-11-30T17:22:21.338315+0000","last_undegraded":"2023-11-30T17:22:21.338315+0000","last_fullsized":"2023-11-30T17:22:21.338315+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.313908+0000","last_change":"2023-11-30T17:22:20.935450+0000","last_active":"2023-11-30T17:22:21.313908+0000","last_peered":"2023-11-30T17:22:21.313908+0000","last_clean":"2023-11-30T17:22:21.313908+0000","last_became_active":"2023-11-30T17:22:20.935107+0000","last_became_peered":"2023-11-30T17:22:20.935107+0000","last_unstale":"2023-11-30T17:22:21.313908+0000","last_undegraded":"2023-11-30T17:22:21.313908+0000","last_fullsized":"2023-11-30T17:22:21.313908+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.333605+0000","last_change":"2023-11-30T17:22:21.332725+0000","last_active":"2023-11-30T17:22:21.333605+0000","last_peered":"2023-11-30T17:22:21.333605+0000","last_clean":"2023-11-30T17:22:21.333605+0000","last_became_active":"2023-11-30T17:22:21.332417+0000","last_became_peered":"2023-11-30T17:22:21.332417+0000","last_unstale":"2023-11-30T17:22:21.333605+0000","last_undegraded":"2023-11-30T17:22:21.333605+0000","last_fullsized":"2023-11-30T17:22:21.333605+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.318214+0000","last_change":"2023-11-30T17:22:20.939446+0000","last_active":"2023-11-30T17:22:21.318214+0000","last_peered":"2023-11-30T17:22:21.318214+0000","last_clean":"2023-11-30T17:22:21.318214+0000","last_became_active":"2023-11-30T17:22:20.939168+0000","last_became_peered":"2023-11-30T17:22:20.939168+0000","last_unstale":"2023-11-30T17:22:21.318214+0000","last_undegraded":"2023-11-30T17:22:21.318214+0000","last_fullsized":"2023-11-30T17:22:21.318214+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.333314+0000","last_change":"2023-11-30T17:22:21.331441+0000","last_active":"2023-11-30T17:22:21.333314+0000","last_peered":"2023-11-30T17:22:21.333314+0000","last_clean":"2023-11-30T17:22:21.333314+0000","last_became_active":"2023-11-30T17:22:21.330964+0000","last_became_peered":"2023-11-30T17:22:21.330964+0000","last_unstale":"2023-11-30T17:22:21.333314+0000","last_undegraded":"2023-11-30T17:22:21.333314+0000","last_fullsized":"2023-11-30T17:22:21.333314+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.336329+0000","last_change":"2023-11-30T17:22:20.930119+0000","last_active":"2023-11-30T17:22:21.336329+0000","last_peered":"2023-11-30T17:22:21.336329+0000","last_clean":"2023-11-30T17:22:21.336329+0000","last_became_active":"2023-11-30T17:22:20.929873+0000","last_became_peered":"2023-11-30T17:22:20.929873+0000","last_unstale":"2023-11-30T17:22:21.336329+0000","last_undegraded":"2023-11-30T17:22:21.336329+0000","last_fullsized":"2023-11-30T17:22:21.336329+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.340587+0000","last_change":"2023-11-30T17:22:21.335389+0000","last_active":"2023-11-30T17:22:21.340587+0000","last_peered":"2023-11-30T17:22:21.340587+0000","last_clean":"2023-11-30T17:22:21.340587+0000","last_became_active":"2023-11-30T17:22:21.335081+0000","last_became_peered":"2023-11-30T17:22:21.335081+0000","last_unstale":"2023-11-30T17:22:21.340587+0000","last_undegraded":"2023-11-30T17:22:21.340587+0000","last_fullsized":"2023-11-30T17:22:21.340587+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.333885+0000","last_change":"2023-11-30T17:22:20.926229+0000","last_active":"2023-11-30T17:22:21.333885+0000","last_peered":"2023-11-30T17:22:21.333885+0000","last_clean":"2023-11-30T17:22:21.333885+0000","last_became_active":"2023-11-30T17:22:20.925910+0000","last_became_peered":"2023-11-30T17:22:20.925910+0000","last_unstale":"2023-11-30T17:22:21.333885+0000","last_undegraded":"2023-11-30T17:22:21.333885+0000","last_fullsized":"2023-11-30T17:22:21.333885+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335733+0000","last_change":"2023-11-30T17:22:21.332864+0000","last_active":"2023-11-30T17:22:21.335733+0000","last_peered":"2023-11-30T17:22:21.335733+0000","last_clean":"2023-11-30T17:22:21.335733+0000","last_became_active":"2023-11-30T17:22:21.332589+0000","last_became_peered":"2023-11-30T17:22:21.332589+0000","last_unstale":"2023-11-30T17:22:21.335733+0000","last_undegraded":"2023-11-30T17:22:21.335733+0000","last_fullsized":"2023-11-30T17:22:21.335733+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337303+0000","last_change":"2023-11-30T17:22:20.929809+0000","last_active":"2023-11-30T17:22:21.337303+0000","last_peered":"2023-11-30T17:22:21.337303+0000","last_clean":"2023-11-30T17:22:21.337303+0000","last_became_active":"2023-11-30T17:22:20.929506+0000","last_became_peered":"2023-11-30T17:22:20.929506+0000","last_unstale":"2023-11-30T17:22:21.337303+0000","last_undegraded":"2023-11-30T17:22:21.337303+0000","last_fullsized":"2023-11-30T17:22:21.337303+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335363+0000","last_change":"2023-11-30T17:22:21.332342+0000","last_active":"2023-11-30T17:22:21.335363+0000","last_peered":"2023-11-30T17:22:21.335363+0000","last_clean":"2023-11-30T17:22:21.335363+0000","last_became_active":"2023-11-30T17:22:21.321851+0000","last_became_peered":"2023-11-30T17:22:21.321851+0000","last_unstale":"2023-11-30T17:22:21.335363+0000","last_undegraded":"2023-11-30T17:22:21.335363+0000","last_fullsized":"2023-11-30T17:22:21.335363+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.323693+0000","last_change":"2023-11-30T17:22:20.936245+0000","last_active":"2023-11-30T17:22:21.323693+0000","last_peered":"2023-11-30T17:22:21.323693+0000","last_clean":"2023-11-30T17:22:21.323693+0000","last_became_active":"2023-11-30T17:22:20.935915+0000","last_became_peered":"2023-11-30T17:22:20.935915+0000","last_unstale":"2023-11-30T17:22:21.323693+0000","last_undegraded":"2023-11-30T17:22:21.323693+0000","last_fullsized":"2023-11-30T17:22:21.323693+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.338752+0000","last_change":"2023-11-30T17:22:21.336891+0000","last_active":"2023-11-30T17:22:21.338752+0000","last_peered":"2023-11-30T17:22:21.338752+0000","last_clean":"2023-11-30T17:22:21.338752+0000","last_became_active":"2023-11-30T17:22:21.336551+0000","last_became_peered":"2023-11-30T17:22:21.336551+0000","last_unstale":"2023-11-30T17:22:21.338752+0000","last_undegraded":"2023-11-30T17:22:21.338752+0000","last_fullsized":"2023-11-30T17:22:21.338752+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.313130+0000","last_change":"2023-11-30T17:22:20.939775+0000","last_active":"2023-11-30T17:22:21.313130+0000","last_peered":"2023-11-30T17:22:21.313130+0000","last_clean":"2023-11-30T17:22:21.313130+0000","last_became_active":"2023-11-30T17:22:20.939511+0000","last_became_peered":"2023-11-30T17:22:20.939511+0000","last_unstale":"2023-11-30T17:22:21.313130+0000","last_undegraded":"2023-11-30T17:22:21.313130+0000","last_fullsized":"2023-11-30T17:22:21.313130+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.332191+0000","last_change":"2023-11-30T17:22:21.325167+0000","last_active":"2023-11-30T17:22:21.332191+0000","last_peered":"2023-11-30T17:22:21.332191+0000","last_clean":"2023-11-30T17:22:21.332191+0000","last_became_active":"2023-11-30T17:22:21.324836+0000","last_became_peered":"2023-11-30T17:22:21.324836+0000","last_unstale":"2023-11-30T17:22:21.332191+0000","last_undegraded":"2023-11-30T17:22:21.332191+0000","last_fullsized":"2023-11-30T17:22:21.332191+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.326148+0000","last_change":"2023-11-30T17:22:20.930175+0000","last_active":"2023-11-30T17:22:21.326148+0000","last_peered":"2023-11-30T17:22:21.326148+0000","last_clean":"2023-11-30T17:22:21.326148+0000","last_became_active":"2023-11-30T17:22:20.929892+0000","last_became_peered":"2023-11-30T17:22:20.929892+0000","last_unstale":"2023-11-30T17:22:21.326148+0000","last_undegraded":"2023-11-30T17:22:21.326148+0000","last_fullsized":"2023-11-30T17:22:21.326148+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.338516+0000","last_change":"2023-11-30T17:22:21.334046+0000","last_active":"2023-11-30T17:22:21.338516+0000","last_peered":"2023-11-30T17:22:21.338516+0000","last_clean":"2023-11-30T17:22:21.338516+0000","last_became_active":"2023-11-30T17:22:21.333677+0000","last_became_peered":"2023-11-30T17:22:21.333677+0000","last_unstale":"2023-11-30T17:22:21.338516+0000","last_undegraded":"2023-11-30T17:22:21.338516+0000","last_fullsized":"2023-11-30T17:22:21.338516+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.316483+0000","last_change":"2023-11-30T17:22:20.928501+0000","last_active":"2023-11-30T17:22:21.316483+0000","last_peered":"2023-11-30T17:22:21.316483+0000","last_clean":"2023-11-30T17:22:21.316483+0000","last_became_active":"2023-11-30T17:22:20.928198+0000","last_became_peered":"2023-11-30T17:22:20.928198+0000","last_unstale":"2023-11-30T17:22:21.316483+0000","last_undegraded":"2023-11-30T17:22:21.316483+0000","last_fullsized":"2023-11-30T17:22:21.316483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335230+0000","last_change":"2023-11-30T17:22:21.325034+0000","last_active":"2023-11-30T17:22:21.335230+0000","last_peered":"2023-11-30T17:22:21.335230+0000","last_clean":"2023-11-30T17:22:21.335230+0000","last_became_active":"2023-11-30T17:22:21.324712+0000","last_became_peered":"2023-11-30T17:22:21.324712+0000","last_unstale":"2023-11-30T17:22:21.335230+0000","last_undegraded":"2023-11-30T17:22:21.335230+0000","last_fullsized":"2023-11-30T17:22:21.335230+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.316312+0000","last_change":"2023-11-30T17:22:20.932648+0000","last_active":"2023-11-30T17:22:21.316312+0000","last_peered":"2023-11-30T17:22:21.316312+0000","last_clean":"2023-11-30T17:22:21.316312+0000","last_became_active":"2023-11-30T17:22:20.932328+0000","last_became_peered":"2023-11-30T17:22:20.932328+0000","last_unstale":"2023-11-30T17:22:21.316312+0000","last_undegraded":"2023-11-30T17:22:21.316312+0000","last_fullsized":"2023-11-30T17:22:21.316312+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.339022+0000","last_change":"2023-11-30T17:22:21.336992+0000","last_active":"2023-11-30T17:22:21.339022+0000","last_peered":"2023-11-30T17:22:21.339022+0000","last_clean":"2023-11-30T17:22:21.339022+0000","last_became_active":"2023-11-30T17:22:21.336715+0000","last_became_peered":"2023-11-30T17:22:21.336715+0000","last_unstale":"2023-11-30T17:22:21.339022+0000","last_undegraded":"2023-11-30T17:22:21.339022+0000","last_fullsized":"2023-11-30T17:22:21.339022+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.34","version":"82'4","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.342026+0000","last_change":"2023-11-30T17:22:20.932173+0000","last_active":"2023-11-30T17:22:21.342026+0000","last_peered":"2023-11-30T17:22:21.342026+0000","last_clean":"2023-11-30T17:22:21.342026+0000","last_became_active":"2023-11-30T17:22:20.931753+0000","last_became_peered":"2023-11-30T17:22:20.931753+0000","last_unstale":"2023-11-30T17:22:21.342026+0000","last_undegraded":"2023-11-30T17:22:21.342026+0000","last_fullsized":"2023-11-30T17:22:21.342026+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.336734+0000","last_change":"2023-11-30T17:22:21.334427+0000","last_active":"2023-11-30T17:22:21.336734+0000","last_peered":"2023-11-30T17:22:21.336734+0000","last_clean":"2023-11-30T17:22:21.336734+0000","last_became_active":"2023-11-30T17:22:21.334056+0000","last_became_peered":"2023-11-30T17:22:21.334056+0000","last_unstale":"2023-11-30T17:22:21.336734+0000","last_undegraded":"2023-11-30T17:22:21.336734+0000","last_fullsized":"2023-11-30T17:22:21.336734+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335765+0000","last_change":"2023-11-30T17:22:20.932294+0000","last_active":"2023-11-30T17:22:21.335765+0000","last_peered":"2023-11-30T17:22:21.335765+0000","last_clean":"2023-11-30T17:22:21.335765+0000","last_became_active":"2023-11-30T17:22:20.932018+0000","last_became_peered":"2023-11-30T17:22:20.932018+0000","last_unstale":"2023-11-30T17:22:21.335765+0000","last_undegraded":"2023-11-30T17:22:21.335765+0000","last_fullsized":"2023-11-30T17:22:21.335765+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337229+0000","last_change":"2023-11-30T17:22:21.330858+0000","last_active":"2023-11-30T17:22:21.337229+0000","last_peered":"2023-11-30T17:22:21.337229+0000","last_clean":"2023-11-30T17:22:21.337229+0000","last_became_active":"2023-11-30T17:22:21.327045+0000","last_became_peered":"2023-11-30T17:22:21.327045+0000","last_unstale":"2023-11-30T17:22:21.337229+0000","last_undegraded":"2023-11-30T17:22:21.337229+0000","last_fullsized":"2023-11-30T17:22:21.337229+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.321863+0000","last_change":"2023-11-30T17:22:20.929525+0000","last_active":"2023-11-30T17:22:21.321863+0000","last_peered":"2023-11-30T17:22:21.321863+0000","last_clean":"2023-11-30T17:22:21.321863+0000","last_became_active":"2023-11-30T17:22:20.929210+0000","last_became_peered":"2023-11-30T17:22:20.929210+0000","last_unstale":"2023-11-30T17:22:21.321863+0000","last_undegraded":"2023-11-30T17:22:21.321863+0000","last_fullsized":"2023-11-30T17:22:21.321863+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.338143+0000","last_change":"2023-11-30T17:22:21.334477+0000","last_active":"2023-11-30T17:22:21.338143+0000","last_peered":"2023-11-30T17:22:21.338143+0000","last_clean":"2023-11-30T17:22:21.338143+0000","last_became_active":"2023-11-30T17:22:21.334165+0000","last_became_peered":"2023-11-30T17:22:21.334165+0000","last_unstale":"2023-11-30T17:22:21.338143+0000","last_undegraded":"2023-11-30T17:22:21.338143+0000","last_fullsized":"2023-11-30T17:22:21.338143+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.323818+0000","last_change":"2023-11-30T17:22:20.929476+0000","last_active":"2023-11-30T17:22:21.323818+0000","last_peered":"2023-11-30T17:22:21.323818+0000","last_clean":"2023-11-30T17:22:21.323818+0000","last_became_active":"2023-11-30T17:22:20.929232+0000","last_became_peered":"2023-11-30T17:22:20.929232+0000","last_unstale":"2023-11-30T17:22:21.323818+0000","last_undegraded":"2023-11-30T17:22:21.323818+0000","last_fullsized":"2023-11-30T17:22:21.323818+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.341039+0000","last_change":"2023-11-30T17:22:21.340184+0000","last_active":"2023-11-30T17:22:21.341039+0000","last_peered":"2023-11-30T17:22:21.341039+0000","last_clean":"2023-11-30T17:22:21.341039+0000","last_became_active":"2023-11-30T17:22:21.339332+0000","last_became_peered":"2023-11-30T17:22:21.339332+0000","last_unstale":"2023-11-30T17:22:21.341039+0000","last_undegraded":"2023-11-30T17:22:21.341039+0000","last_fullsized":"2023-11-30T17:22:21.341039+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"82'4","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.339175+0000","last_change":"2023-11-30T17:22:20.929041+0000","last_active":"2023-11-30T17:22:21.339175+0000","last_peered":"2023-11-30T17:22:21.339175+0000","last_clean":"2023-11-30T17:22:21.339175+0000","last_became_active":"2023-11-30T17:22:20.928561+0000","last_became_peered":"2023-11-30T17:22:20.928561+0000","last_unstale":"2023-11-30T17:22:21.339175+0000","last_undegraded":"2023-11-30T17:22:21.339175+0000","last_fullsized":"2023-11-30T17:22:21.339175+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.330255+0000","last_change":"2023-11-30T17:22:21.329430+0000","last_active":"2023-11-30T17:22:21.330255+0000","last_peered":"2023-11-30T17:22:21.330255+0000","last_clean":"2023-11-30T17:22:21.330255+0000","last_became_active":"2023-11-30T17:22:21.329087+0000","last_became_peered":"2023-11-30T17:22:21.329087+0000","last_unstale":"2023-11-30T17:22:21.330255+0000","last_undegraded":"2023-11-30T17:22:21.330255+0000","last_fullsized":"2023-11-30T17:22:21.330255+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.313280+0000","last_change":"2023-11-30T17:22:20.935130+0000","last_active":"2023-11-30T17:22:21.313280+0000","last_peered":"2023-11-30T17:22:21.313280+0000","last_clean":"2023-11-30T17:22:21.313280+0000","last_became_active":"2023-11-30T17:22:20.934842+0000","last_became_peered":"2023-11-30T17:22:20.934842+0000","last_unstale":"2023-11-30T17:22:21.313280+0000","last_undegraded":"2023-11-30T17:22:21.313280+0000","last_fullsized":"2023-11-30T17:22:21.313280+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.332227+0000","last_change":"2023-11-30T17:22:21.325440+0000","last_active":"2023-11-30T17:22:21.332227+0000","last_peered":"2023-11-30T17:22:21.332227+0000","last_clean":"2023-11-30T17:22:21.332227+0000","last_became_active":"2023-11-30T17:22:21.325138+0000","last_became_peered":"2023-11-30T17:22:21.325138+0000","last_unstale":"2023-11-30T17:22:21.332227+0000","last_undegraded":"2023-11-30T17:22:21.332227+0000","last_fullsized":"2023-11-30T17:22:21.332227+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.317814+0000","last_change":"2023-11-30T17:22:20.939297+0000","last_active":"2023-11-30T17:22:21.317814+0000","last_peered":"2023-11-30T17:22:21.317814+0000","last_clean":"2023-11-30T17:22:21.317814+0000","last_became_active":"2023-11-30T17:22:20.938830+0000","last_became_peered":"2023-11-30T17:22:20.938830+0000","last_unstale":"2023-11-30T17:22:21.317814+0000","last_undegraded":"2023-11-30T17:22:21.317814+0000","last_fullsized":"2023-11-30T17:22:21.317814+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.338635+0000","last_change":"2023-11-30T17:22:21.335408+0000","last_active":"2023-11-30T17:22:21.338635+0000","last_peered":"2023-11-30T17:22:21.338635+0000","last_clean":"2023-11-30T17:22:21.338635+0000","last_became_active":"2023-11-30T17:22:21.335129+0000","last_became_peered":"2023-11-30T17:22:21.335129+0000","last_unstale":"2023-11-30T17:22:21.338635+0000","last_undegraded":"2023-11-30T17:22:21.338635+0000","last_fullsized":"2023-11-30T17:22:21.338635+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.331614+0000","last_change":"2023-11-30T17:22:20.930348+0000","last_active":"2023-11-30T17:22:21.331614+0000","last_peered":"2023-11-30T17:22:21.331614+0000","last_clean":"2023-11-30T17:22:21.331614+0000","last_became_active":"2023-11-30T17:22:20.930051+0000","last_became_peered":"2023-11-30T17:22:20.930051+0000","last_unstale":"2023-11-30T17:22:21.331614+0000","last_undegraded":"2023-11-30T17:22:21.331614+0000","last_fullsized":"2023-11-30T17:22:21.331614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337301+0000","last_change":"2023-11-30T17:22:21.336482+0000","last_active":"2023-11-30T17:22:21.337301+0000","last_peered":"2023-11-30T17:22:21.337301+0000","last_clean":"2023-11-30T17:22:21.337301+0000","last_became_active":"2023-11-30T17:22:21.336197+0000","last_became_peered":"2023-11-30T17:22:21.336197+0000","last_unstale":"2023-11-30T17:22:21.337301+0000","last_undegraded":"2023-11-30T17:22:21.337301+0000","last_fullsized":"2023-11-30T17:22:21.337301+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.313902+0000","last_change":"2023-11-30T17:22:20.939554+0000","last_active":"2023-11-30T17:22:21.313902+0000","last_peered":"2023-11-30T17:22:21.313902+0000","last_clean":"2023-11-30T17:22:21.313902+0000","last_became_active":"2023-11-30T17:22:20.931117+0000","last_became_peered":"2023-11-30T17:22:20.931117+0000","last_unstale":"2023-11-30T17:22:21.313902+0000","last_undegraded":"2023-11-30T17:22:21.313902+0000","last_fullsized":"2023-11-30T17:22:21.313902+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.338180+0000","last_change":"2023-11-30T17:22:21.334786+0000","last_active":"2023-11-30T17:22:21.338180+0000","last_peered":"2023-11-30T17:22:21.338180+0000","last_clean":"2023-11-30T17:22:21.338180+0000","last_became_active":"2023-11-30T17:22:21.334477+0000","last_became_peered":"2023-11-30T17:22:21.334477+0000","last_unstale":"2023-11-30T17:22:21.338180+0000","last_undegraded":"2023-11-30T17:22:21.338180+0000","last_fullsized":"2023-11-30T17:22:21.338180+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.336819+0000","last_change":"2023-11-30T17:22:20.937671+0000","last_active":"2023-11-30T17:22:21.336819+0000","last_peered":"2023-11-30T17:22:21.336819+0000","last_clean":"2023-11-30T17:22:21.336819+0000","last_became_active":"2023-11-30T17:22:20.937184+0000","last_became_peered":"2023-11-30T17:22:20.937184+0000","last_unstale":"2023-11-30T17:22:21.336819+0000","last_undegraded":"2023-11-30T17:22:21.336819+0000","last_fullsized":"2023-11-30T17:22:21.336819+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.322693+0000","last_change":"2023-11-30T17:22:21.321647+0000","last_active":"2023-11-30T17:22:21.322693+0000","last_peered":"2023-11-30T17:22:21.322693+0000","last_clean":"2023-11-30T17:22:21.322693+0000","last_became_active":"2023-11-30T17:22:21.321315+0000","last_became_peered":"2023-11-30T17:22:21.321315+0000","last_unstale":"2023-11-30T17:22:21.322693+0000","last_undegraded":"2023-11-30T17:22:21.322693+0000","last_fullsized":"2023-11-30T17:22:21.322693+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.314356+0000","last_change":"2023-11-30T17:22:20.937074+0000","last_active":"2023-11-30T17:22:21.314356+0000","last_peered":"2023-11-30T17:22:21.314356+0000","last_clean":"2023-11-30T17:22:21.314356+0000","last_became_active":"2023-11-30T17:22:20.936781+0000","last_became_peered":"2023-11-30T17:22:20.936781+0000","last_unstale":"2023-11-30T17:22:21.314356+0000","last_undegraded":"2023-11-30T17:22:21.314356+0000","last_fullsized":"2023-11-30T17:22:21.314356+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.329697+0000","last_change":"2023-11-30T17:22:21.327810+0000","last_active":"2023-11-30T17:22:21.329697+0000","last_peered":"2023-11-30T17:22:21.329697+0000","last_clean":"2023-11-30T17:22:21.329697+0000","last_became_active":"2023-11-30T17:22:21.327521+0000","last_became_peered":"2023-11-30T17:22:21.327521+0000","last_unstale":"2023-11-30T17:22:21.329697+0000","last_undegraded":"2023-11-30T17:22:21.329697+0000","last_fullsized":"2023-11-30T17:22:21.329697+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.319001+0000","last_change":"2023-11-30T17:22:20.942621+0000","last_active":"2023-11-30T17:22:21.319001+0000","last_peered":"2023-11-30T17:22:21.319001+0000","last_clean":"2023-11-30T17:22:21.319001+0000","last_became_active":"2023-11-30T17:22:20.942385+0000","last_became_peered":"2023-11-30T17:22:20.942385+0000","last_unstale":"2023-11-30T17:22:21.319001+0000","last_undegraded":"2023-11-30T17:22:21.319001+0000","last_fullsized":"2023-11-30T17:22:21.319001+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.333322+0000","last_change":"2023-11-30T17:22:21.329183+0000","last_active":"2023-11-30T17:22:21.333322+0000","last_peered":"2023-11-30T17:22:21.333322+0000","last_clean":"2023-11-30T17:22:21.333322+0000","last_became_active":"2023-11-30T17:22:21.328882+0000","last_became_peered":"2023-11-30T17:22:21.328882+0000","last_unstale":"2023-11-30T17:22:21.333322+0000","last_undegraded":"2023-11-30T17:22:21.333322+0000","last_fullsized":"2023-11-30T17:22:21.333322+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.314416+0000","last_change":"2023-11-30T17:22:20.931448+0000","last_active":"2023-11-30T17:22:21.314416+0000","last_peered":"2023-11-30T17:22:21.314416+0000","last_clean":"2023-11-30T17:22:21.314416+0000","last_became_active":"2023-11-30T17:22:20.931178+0000","last_became_peered":"2023-11-30T17:22:20.931178+0000","last_unstale":"2023-11-30T17:22:21.314416+0000","last_undegraded":"2023-11-30T17:22:21.314416+0000","last_fullsized":"2023-11-30T17:22:21.314416+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.333437+0000","last_change":"2023-11-30T17:22:21.330564+0000","last_active":"2023-11-30T17:22:21.333437+0000","last_peered":"2023-11-30T17:22:21.333437+0000","last_clean":"2023-11-30T17:22:21.333437+0000","last_became_active":"2023-11-30T17:22:21.329983+0000","last_became_peered":"2023-11-30T17:22:21.329983+0000","last_unstale":"2023-11-30T17:22:21.333437+0000","last_undegraded":"2023-11-30T17:22:21.333437+0000","last_fullsized":"2023-11-30T17:22:21.333437+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.323406+0000","last_change":"2023-11-30T17:22:20.931253+0000","last_active":"2023-11-30T17:22:21.323406+0000","last_peered":"2023-11-30T17:22:21.323406+0000","last_clean":"2023-11-30T17:22:21.323406+0000","last_became_active":"2023-11-30T17:22:20.930953+0000","last_became_peered":"2023-11-30T17:22:20.930953+0000","last_unstale":"2023-11-30T17:22:21.323406+0000","last_undegraded":"2023-11-30T17:22:21.323406+0000","last_fullsized":"2023-11-30T17:22:21.323406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.338536+0000","last_change":"2023-11-30T17:22:21.334288+0000","last_active":"2023-11-30T17:22:21.338536+0000","last_peered":"2023-11-30T17:22:21.338536+0000","last_clean":"2023-11-30T17:22:21.338536+0000","last_became_active":"2023-11-30T17:22:21.333996+0000","last_became_peered":"2023-11-30T17:22:21.333996+0000","last_unstale":"2023-11-30T17:22:21.338536+0000","last_undegraded":"2023-11-30T17:22:21.338536+0000","last_fullsized":"2023-11-30T17:22:21.338536+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.320858+0000","last_change":"2023-11-30T17:22:20.931432+0000","last_active":"2023-11-30T17:22:21.320858+0000","last_peered":"2023-11-30T17:22:21.320858+0000","last_clean":"2023-11-30T17:22:21.320858+0000","last_became_active":"2023-11-30T17:22:20.931158+0000","last_became_peered":"2023-11-30T17:22:20.931158+0000","last_unstale":"2023-11-30T17:22:21.320858+0000","last_undegraded":"2023-11-30T17:22:21.320858+0000","last_fullsized":"2023-11-30T17:22:21.320858+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.332160+0000","last_change":"2023-11-30T17:22:21.324523+0000","last_active":"2023-11-30T17:22:21.332160+0000","last_peered":"2023-11-30T17:22:21.332160+0000","last_clean":"2023-11-30T17:22:21.332160+0000","last_became_active":"2023-11-30T17:22:21.324233+0000","last_became_peered":"2023-11-30T17:22:21.324233+0000","last_unstale":"2023-11-30T17:22:21.332160+0000","last_undegraded":"2023-11-30T17:22:21.332160+0000","last_fullsized":"2023-11-30T17:22:21.332160+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.314552+0000","last_change":"2023-11-30T17:22:20.934622+0000","last_active":"2023-11-30T17:22:21.314552+0000","last_peered":"2023-11-30T17:22:21.314552+0000","last_clean":"2023-11-30T17:22:21.314552+0000","last_became_active":"2023-11-30T17:22:20.934343+0000","last_became_peered":"2023-11-30T17:22:20.934343+0000","last_unstale":"2023-11-30T17:22:21.314552+0000","last_undegraded":"2023-11-30T17:22:21.314552+0000","last_fullsized":"2023-11-30T17:22:21.314552+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.333359+0000","last_change":"2023-11-30T17:22:21.329707+0000","last_active":"2023-11-30T17:22:21.333359+0000","last_peered":"2023-11-30T17:22:21.333359+0000","last_clean":"2023-11-30T17:22:21.333359+0000","last_became_active":"2023-11-30T17:22:21.329406+0000","last_became_peered":"2023-11-30T17:22:21.329406+0000","last_unstale":"2023-11-30T17:22:21.333359+0000","last_undegraded":"2023-11-30T17:22:21.333359+0000","last_fullsized":"2023-11-30T17:22:21.333359+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.322388+0000","last_change":"2023-11-30T17:22:20.932327+0000","last_active":"2023-11-30T17:22:21.322388+0000","last_peered":"2023-11-30T17:22:21.322388+0000","last_clean":"2023-11-30T17:22:21.322388+0000","last_became_active":"2023-11-30T17:22:20.932056+0000","last_became_peered":"2023-11-30T17:22:20.932056+0000","last_unstale":"2023-11-30T17:22:21.322388+0000","last_undegraded":"2023-11-30T17:22:21.322388+0000","last_fullsized":"2023-11-30T17:22:21.322388+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335152+0000","last_change":"2023-11-30T17:22:21.333765+0000","last_active":"2023-11-30T17:22:21.335152+0000","last_peered":"2023-11-30T17:22:21.335152+0000","last_clean":"2023-11-30T17:22:21.335152+0000","last_became_active":"2023-11-30T17:22:21.333449+0000","last_became_peered":"2023-11-30T17:22:21.333449+0000","last_unstale":"2023-11-30T17:22:21.335152+0000","last_undegraded":"2023-11-30T17:22:21.335152+0000","last_fullsized":"2023-11-30T17:22:21.335152+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.313313+0000","last_change":"2023-11-30T17:22:20.939779+0000","last_active":"2023-11-30T17:22:21.313313+0000","last_peered":"2023-11-30T17:22:21.313313+0000","last_clean":"2023-11-30T17:22:21.313313+0000","last_became_active":"2023-11-30T17:22:20.939251+0000","last_became_peered":"2023-11-30T17:22:20.939251+0000","last_unstale":"2023-11-30T17:22:21.313313+0000","last_undegraded":"2023-11-30T17:22:21.313313+0000","last_fullsized":"2023-11-30T17:22:21.313313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.338480+0000","last_change":"2023-11-30T17:22:21.335658+0000","last_active":"2023-11-30T17:22:21.338480+0000","last_peered":"2023-11-30T17:22:21.338480+0000","last_clean":"2023-11-30T17:22:21.338480+0000","last_became_active":"2023-11-30T17:22:21.333449+0000","last_became_peered":"2023-11-30T17:22:21.333449+0000","last_unstale":"2023-11-30T17:22:21.338480+0000","last_undegraded":"2023-11-30T17:22:21.338480+0000","last_fullsized":"2023-11-30T17:22:21.338480+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.318781+0000","last_change":"2023-11-30T17:22:20.937434+0000","last_active":"2023-11-30T17:22:21.318781+0000","last_peered":"2023-11-30T17:22:21.318781+0000","last_clean":"2023-11-30T17:22:21.318781+0000","last_became_active":"2023-11-30T17:22:20.937082+0000","last_became_peered":"2023-11-30T17:22:20.937082+0000","last_unstale":"2023-11-30T17:22:21.318781+0000","last_undegraded":"2023-11-30T17:22:21.318781+0000","last_fullsized":"2023-11-30T17:22:21.318781+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.336188+0000","last_change":"2023-11-30T17:22:21.331775+0000","last_active":"2023-11-30T17:22:21.336188+0000","last_peered":"2023-11-30T17:22:21.336188+0000","last_clean":"2023-11-30T17:22:21.336188+0000","last_became_active":"2023-11-30T17:22:21.331455+0000","last_became_peered":"2023-11-30T17:22:21.331455+0000","last_unstale":"2023-11-30T17:22:21.336188+0000","last_undegraded":"2023-11-30T17:22:21.336188+0000","last_fullsized":"2023-11-30T17:22:21.336188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.322384+0000","last_change":"2023-11-30T17:22:20.921100+0000","last_active":"2023-11-30T17:22:21.322384+0000","last_peered":"2023-11-30T17:22:21.322384+0000","last_clean":"2023-11-30T17:22:21.322384+0000","last_became_active":"2023-11-30T17:22:20.920818+0000","last_became_peered":"2023-11-30T17:22:20.920818+0000","last_unstale":"2023-11-30T17:22:21.322384+0000","last_undegraded":"2023-11-30T17:22:21.322384+0000","last_fullsized":"2023-11-30T17:22:21.322384+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.339918+0000","last_change":"2023-11-30T17:22:21.338971+0000","last_active":"2023-11-30T17:22:21.339918+0000","last_peered":"2023-11-30T17:22:21.339918+0000","last_clean":"2023-11-30T17:22:21.339918+0000","last_became_active":"2023-11-30T17:22:21.338674+0000","last_became_peered":"2023-11-30T17:22:21.338674+0000","last_unstale":"2023-11-30T17:22:21.339918+0000","last_undegraded":"2023-11-30T17:22:21.339918+0000","last_fullsized":"2023-11-30T17:22:21.339918+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.313733+0000","last_change":"2023-11-30T17:22:20.928872+0000","last_active":"2023-11-30T17:22:21.313733+0000","last_peered":"2023-11-30T17:22:21.313733+0000","last_clean":"2023-11-30T17:22:21.313733+0000","last_became_active":"2023-11-30T17:22:20.928246+0000","last_became_peered":"2023-11-30T17:22:20.928246+0000","last_unstale":"2023-11-30T17:22:21.313733+0000","last_undegraded":"2023-11-30T17:22:21.313733+0000","last_fullsized":"2023-11-30T17:22:21.313733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.332512+0000","last_change":"2023-11-30T17:22:21.327861+0000","last_active":"2023-11-30T17:22:21.332512+0000","last_peered":"2023-11-30T17:22:21.332512+0000","last_clean":"2023-11-30T17:22:21.332512+0000","last_became_active":"2023-11-30T17:22:21.326927+0000","last_became_peered":"2023-11-30T17:22:21.326927+0000","last_unstale":"2023-11-30T17:22:21.332512+0000","last_undegraded":"2023-11-30T17:22:21.332512+0000","last_fullsized":"2023-11-30T17:22:21.332512+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.334940+0000","last_change":"2023-11-30T17:22:20.932827+0000","last_active":"2023-11-30T17:22:21.334940+0000","last_peered":"2023-11-30T17:22:21.334940+0000","last_clean":"2023-11-30T17:22:21.334940+0000","last_became_active":"2023-11-30T17:22:20.932116+0000","last_became_peered":"2023-11-30T17:22:20.932116+0000","last_unstale":"2023-11-30T17:22:21.334940+0000","last_undegraded":"2023-11-30T17:22:21.334940+0000","last_fullsized":"2023-11-30T17:22:21.334940+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337117+0000","last_change":"2023-11-30T17:22:21.332220+0000","last_active":"2023-11-30T17:22:21.337117+0000","last_peered":"2023-11-30T17:22:21.337117+0000","last_clean":"2023-11-30T17:22:21.337117+0000","last_became_active":"2023-11-30T17:22:21.331695+0000","last_became_peered":"2023-11-30T17:22:21.331695+0000","last_unstale":"2023-11-30T17:22:21.337117+0000","last_undegraded":"2023-11-30T17:22:21.337117+0000","last_fullsized":"2023-11-30T17:22:21.337117+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337106+0000","last_change":"2023-11-30T17:22:20.932467+0000","last_active":"2023-11-30T17:22:21.337106+0000","last_peered":"2023-11-30T17:22:21.337106+0000","last_clean":"2023-11-30T17:22:21.337106+0000","last_became_active":"2023-11-30T17:22:20.932190+0000","last_became_peered":"2023-11-30T17:22:20.932190+0000","last_unstale":"2023-11-30T17:22:21.337106+0000","last_undegraded":"2023-11-30T17:22:21.337106+0000","last_fullsized":"2023-11-30T17:22:21.337106+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.334353+0000","last_change":"2023-11-30T17:22:21.331875+0000","last_active":"2023-11-30T17:22:21.334353+0000","last_peered":"2023-11-30T17:22:21.334353+0000","last_clean":"2023-11-30T17:22:21.334353+0000","last_became_active":"2023-11-30T17:22:21.328825+0000","last_became_peered":"2023-11-30T17:22:21.328825+0000","last_unstale":"2023-11-30T17:22:21.334353+0000","last_undegraded":"2023-11-30T17:22:21.334353+0000","last_fullsized":"2023-11-30T17:22:21.334353+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335533+0000","last_change":"2023-11-30T17:22:20.936705+0000","last_active":"2023-11-30T17:22:21.335533+0000","last_peered":"2023-11-30T17:22:21.335533+0000","last_clean":"2023-11-30T17:22:21.335533+0000","last_became_active":"2023-11-30T17:22:20.936118+0000","last_became_peered":"2023-11-30T17:22:20.936118+0000","last_unstale":"2023-11-30T17:22:21.335533+0000","last_undegraded":"2023-11-30T17:22:21.335533+0000","last_fullsized":"2023-11-30T17:22:21.335533+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335262+0000","last_change":"2023-11-30T17:22:21.328624+0000","last_active":"2023-11-30T17:22:21.335262+0000","last_peered":"2023-11-30T17:22:21.335262+0000","last_clean":"2023-11-30T17:22:21.335262+0000","last_became_active":"2023-11-30T17:22:21.328317+0000","last_became_peered":"2023-11-30T17:22:21.328317+0000","last_unstale":"2023-11-30T17:22:21.335262+0000","last_undegraded":"2023-11-30T17:22:21.335262+0000","last_fullsized":"2023-11-30T17:22:21.335262+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.314520+0000","last_change":"2023-11-30T17:22:20.930005+0000","last_active":"2023-11-30T17:22:21.314520+0000","last_peered":"2023-11-30T17:22:21.314520+0000","last_clean":"2023-11-30T17:22:21.314520+0000","last_became_active":"2023-11-30T17:22:20.929725+0000","last_became_peered":"2023-11-30T17:22:20.929725+0000","last_unstale":"2023-11-30T17:22:21.314520+0000","last_undegraded":"2023-11-30T17:22:21.314520+0000","last_fullsized":"2023-11-30T17:22:21.314520+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.331499+0000","last_change":"2023-11-30T17:22:21.327241+0000","last_active":"2023-11-30T17:22:21.331499+0000","last_peered":"2023-11-30T17:22:21.331499+0000","last_clean":"2023-11-30T17:22:21.331499+0000","last_became_active":"2023-11-30T17:22:21.326987+0000","last_became_peered":"2023-11-30T17:22:21.326987+0000","last_unstale":"2023-11-30T17:22:21.331499+0000","last_undegraded":"2023-11-30T17:22:21.331499+0000","last_fullsized":"2023-11-30T17:22:21.331499+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.313414+0000","last_change":"2023-11-30T17:22:20.935822+0000","last_active":"2023-11-30T17:22:21.313414+0000","last_peered":"2023-11-30T17:22:21.313414+0000","last_clean":"2023-11-30T17:22:21.313414+0000","last_became_active":"2023-11-30T17:22:20.934667+0000","last_became_peered":"2023-11-30T17:22:20.934667+0000","last_unstale":"2023-11-30T17:22:21.313414+0000","last_undegraded":"2023-11-30T17:22:21.313414+0000","last_fullsized":"2023-11-30T17:22:21.313414+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337309+0000","last_change":"2023-11-30T17:22:21.336465+0000","last_active":"2023-11-30T17:22:21.337309+0000","last_peered":"2023-11-30T17:22:21.337309+0000","last_clean":"2023-11-30T17:22:21.337309+0000","last_became_active":"2023-11-30T17:22:21.336172+0000","last_became_peered":"2023-11-30T17:22:21.336172+0000","last_unstale":"2023-11-30T17:22:21.337309+0000","last_undegraded":"2023-11-30T17:22:21.337309+0000","last_fullsized":"2023-11-30T17:22:21.337309+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.314421+0000","last_change":"2023-11-30T17:22:20.936748+0000","last_active":"2023-11-30T17:22:21.314421+0000","last_peered":"2023-11-30T17:22:21.314421+0000","last_clean":"2023-11-30T17:22:21.314421+0000","last_became_active":"2023-11-30T17:22:20.936551+0000","last_became_peered":"2023-11-30T17:22:20.936551+0000","last_unstale":"2023-11-30T17:22:21.314421+0000","last_undegraded":"2023-11-30T17:22:21.314421+0000","last_fullsized":"2023-11-30T17:22:21.314421+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.329487+0000","last_change":"2023-11-30T17:22:21.320459+0000","last_active":"2023-11-30T17:22:21.329487+0000","last_peered":"2023-11-30T17:22:21.329487+0000","last_clean":"2023-11-30T17:22:21.329487+0000","last_became_active":"2023-11-30T17:22:21.320195+0000","last_became_peered":"2023-11-30T17:22:21.320195+0000","last_unstale":"2023-11-30T17:22:21.329487+0000","last_undegraded":"2023-11-30T17:22:21.329487+0000","last_fullsized":"2023-11-30T17:22:21.329487+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.313639+0000","last_change":"2023-11-30T17:22:20.935604+0000","last_active":"2023-11-30T17:22:21.313639+0000","last_peered":"2023-11-30T17:22:21.313639+0000","last_clean":"2023-11-30T17:22:21.313639+0000","last_became_active":"2023-11-30T17:22:20.935130+0000","last_became_peered":"2023-11-30T17:22:20.935130+0000","last_unstale":"2023-11-30T17:22:21.313639+0000","last_undegraded":"2023-11-30T17:22:21.313639+0000","last_fullsized":"2023-11-30T17:22:21.313639+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337620+0000","last_change":"2023-11-30T17:22:21.336216+0000","last_active":"2023-11-30T17:22:21.337620+0000","last_peered":"2023-11-30T17:22:21.337620+0000","last_clean":"2023-11-30T17:22:21.337620+0000","last_became_active":"2023-11-30T17:22:21.335911+0000","last_became_peered":"2023-11-30T17:22:21.335911+0000","last_unstale":"2023-11-30T17:22:21.337620+0000","last_undegraded":"2023-11-30T17:22:21.337620+0000","last_fullsized":"2023-11-30T17:22:21.337620+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.314463+0000","last_change":"2023-11-30T17:22:20.934475+0000","last_active":"2023-11-30T17:22:21.314463+0000","last_peered":"2023-11-30T17:22:21.314463+0000","last_clean":"2023-11-30T17:22:21.314463+0000","last_became_active":"2023-11-30T17:22:20.934163+0000","last_became_peered":"2023-11-30T17:22:20.934163+0000","last_unstale":"2023-11-30T17:22:21.314463+0000","last_undegraded":"2023-11-30T17:22:21.314463+0000","last_fullsized":"2023-11-30T17:22:21.314463+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.333412+0000","last_change":"2023-11-30T17:22:21.330374+0000","last_active":"2023-11-30T17:22:21.333412+0000","last_peered":"2023-11-30T17:22:21.333412+0000","last_clean":"2023-11-30T17:22:21.333412+0000","last_became_active":"2023-11-30T17:22:21.329939+0000","last_became_peered":"2023-11-30T17:22:21.329939+0000","last_unstale":"2023-11-30T17:22:21.333412+0000","last_undegraded":"2023-11-30T17:22:21.333412+0000","last_fullsized":"2023-11-30T17:22:21.333412+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.317876+0000","last_change":"2023-11-30T17:22:20.937900+0000","last_active":"2023-11-30T17:22:21.317876+0000","last_peered":"2023-11-30T17:22:21.317876+0000","last_clean":"2023-11-30T17:22:21.317876+0000","last_became_active":"2023-11-30T17:22:20.937608+0000","last_became_peered":"2023-11-30T17:22:20.937608+0000","last_unstale":"2023-11-30T17:22:21.317876+0000","last_undegraded":"2023-11-30T17:22:21.317876+0000","last_fullsized":"2023-11-30T17:22:21.317876+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.323213+0000","last_change":"2023-11-30T17:22:21.322290+0000","last_active":"2023-11-30T17:22:21.323213+0000","last_peered":"2023-11-30T17:22:21.323213+0000","last_clean":"2023-11-30T17:22:21.323213+0000","last_became_active":"2023-11-30T17:22:21.322013+0000","last_became_peered":"2023-11-30T17:22:21.322013+0000","last_unstale":"2023-11-30T17:22:21.323213+0000","last_undegraded":"2023-11-30T17:22:21.323213+0000","last_fullsized":"2023-11-30T17:22:21.323213+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.323126+0000","last_change":"2023-11-30T17:22:20.932736+0000","last_active":"2023-11-30T17:22:21.323126+0000","last_peered":"2023-11-30T17:22:21.323126+0000","last_clean":"2023-11-30T17:22:21.323126+0000","last_became_active":"2023-11-30T17:22:20.932229+0000","last_became_peered":"2023-11-30T17:22:20.932229+0000","last_unstale":"2023-11-30T17:22:21.323126+0000","last_undegraded":"2023-11-30T17:22:21.323126+0000","last_fullsized":"2023-11-30T17:22:21.323126+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337590+0000","last_change":"2023-11-30T17:22:21.329153+0000","last_active":"2023-11-30T17:22:21.337590+0000","last_peered":"2023-11-30T17:22:21.337590+0000","last_clean":"2023-11-30T17:22:21.337590+0000","last_became_active":"2023-11-30T17:22:21.328825+0000","last_became_peered":"2023-11-30T17:22:21.328825+0000","last_unstale":"2023-11-30T17:22:21.337590+0000","last_undegraded":"2023-11-30T17:22:21.337590+0000","last_fullsized":"2023-11-30T17:22:21.337590+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"82'3","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335296+0000","last_change":"2023-11-30T17:22:20.938912+0000","last_active":"2023-11-30T17:22:21.335296+0000","last_peered":"2023-11-30T17:22:21.335296+0000","last_clean":"2023-11-30T17:22:21.335296+0000","last_became_active":"2023-11-30T17:22:20.938502+0000","last_became_peered":"2023-11-30T17:22:20.938502+0000","last_unstale":"2023-11-30T17:22:21.335296+0000","last_undegraded":"2023-11-30T17:22:21.335296+0000","last_fullsized":"2023-11-30T17:22:21.335296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.336894+0000","last_change":"2023-11-30T17:22:21.331032+0000","last_active":"2023-11-30T17:22:21.336894+0000","last_peered":"2023-11-30T17:22:21.336894+0000","last_clean":"2023-11-30T17:22:21.336894+0000","last_became_active":"2023-11-30T17:22:21.326325+0000","last_became_peered":"2023-11-30T17:22:21.326325+0000","last_unstale":"2023-11-30T17:22:21.336894+0000","last_undegraded":"2023-11-30T17:22:21.336894+0000","last_fullsized":"2023-11-30T17:22:21.336894+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337727+0000","last_change":"2023-11-30T17:22:20.931360+0000","last_active":"2023-11-30T17:22:21.337727+0000","last_peered":"2023-11-30T17:22:21.337727+0000","last_clean":"2023-11-30T17:22:21.337727+0000","last_became_active":"2023-11-30T17:22:20.930703+0000","last_became_peered":"2023-11-30T17:22:20.930703+0000","last_unstale":"2023-11-30T17:22:21.337727+0000","last_undegraded":"2023-11-30T17:22:21.337727+0000","last_fullsized":"2023-11-30T17:22:21.337727+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.341697+0000","last_change":"2023-11-30T17:22:21.339966+0000","last_active":"2023-11-30T17:22:21.341697+0000","last_peered":"2023-11-30T17:22:21.341697+0000","last_clean":"2023-11-30T17:22:21.341697+0000","last_became_active":"2023-11-30T17:22:21.339673+0000","last_became_peered":"2023-11-30T17:22:21.339673+0000","last_unstale":"2023-11-30T17:22:21.341697+0000","last_undegraded":"2023-11-30T17:22:21.341697+0000","last_fullsized":"2023-11-30T17:22:21.341697+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337888+0000","last_change":"2023-11-30T17:22:20.939845+0000","last_active":"2023-11-30T17:22:21.337888+0000","last_peered":"2023-11-30T17:22:21.337888+0000","last_clean":"2023-11-30T17:22:21.337888+0000","last_became_active":"2023-11-30T17:22:20.939572+0000","last_became_peered":"2023-11-30T17:22:20.939572+0000","last_unstale":"2023-11-30T17:22:21.337888+0000","last_undegraded":"2023-11-30T17:22:21.337888+0000","last_fullsized":"2023-11-30T17:22:21.337888+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.334239+0000","last_change":"2023-11-30T17:22:21.329930+0000","last_active":"2023-11-30T17:22:21.334239+0000","last_peered":"2023-11-30T17:22:21.334239+0000","last_clean":"2023-11-30T17:22:21.334239+0000","last_became_active":"2023-11-30T17:22:21.329739+0000","last_became_peered":"2023-11-30T17:22:21.329739+0000","last_unstale":"2023-11-30T17:22:21.334239+0000","last_undegraded":"2023-11-30T17:22:21.334239+0000","last_fullsized":"2023-11-30T17:22:21.334239+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.317647+0000","last_change":"2023-11-30T17:22:20.933918+0000","last_active":"2023-11-30T17:22:21.317647+0000","last_peered":"2023-11-30T17:22:21.317647+0000","last_clean":"2023-11-30T17:22:21.317647+0000","last_became_active":"2023-11-30T17:22:20.933556+0000","last_became_peered":"2023-11-30T17:22:20.933556+0000","last_unstale":"2023-11-30T17:22:21.317647+0000","last_undegraded":"2023-11-30T17:22:21.317647+0000","last_fullsized":"2023-11-30T17:22:21.317647+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.332554+0000","last_change":"2023-11-30T17:22:21.325539+0000","last_active":"2023-11-30T17:22:21.332554+0000","last_peered":"2023-11-30T17:22:21.332554+0000","last_clean":"2023-11-30T17:22:21.332554+0000","last_became_active":"2023-11-30T17:22:21.325182+0000","last_became_peered":"2023-11-30T17:22:21.325182+0000","last_unstale":"2023-11-30T17:22:21.332554+0000","last_undegraded":"2023-11-30T17:22:21.332554+0000","last_fullsized":"2023-11-30T17:22:21.332554+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.319104+0000","last_change":"2023-11-30T17:22:20.942843+0000","last_active":"2023-11-30T17:22:21.319104+0000","last_peered":"2023-11-30T17:22:21.319104+0000","last_clean":"2023-11-30T17:22:21.319104+0000","last_became_active":"2023-11-30T17:22:20.942535+0000","last_became_peered":"2023-11-30T17:22:20.942535+0000","last_unstale":"2023-11-30T17:22:21.319104+0000","last_undegraded":"2023-11-30T17:22:21.319104+0000","last_fullsized":"2023-11-30T17:22:21.319104+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.328012+0000","last_change":"2023-11-30T17:22:21.324414+0000","last_active":"2023-11-30T17:22:21.328012+0000","last_peered":"2023-11-30T17:22:21.328012+0000","last_clean":"2023-11-30T17:22:21.328012+0000","last_became_active":"2023-11-30T17:22:21.324180+0000","last_became_peered":"2023-11-30T17:22:21.324180+0000","last_unstale":"2023-11-30T17:22:21.328012+0000","last_undegraded":"2023-11-30T17:22:21.328012+0000","last_fullsized":"2023-11-30T17:22:21.328012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"82'4","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.340717+0000","last_change":"2023-11-30T17:22:20.929471+0000","last_active":"2023-11-30T17:22:21.340717+0000","last_peered":"2023-11-30T17:22:21.340717+0000","last_clean":"2023-11-30T17:22:21.340717+0000","last_became_active":"2023-11-30T17:22:20.929194+0000","last_became_peered":"2023-11-30T17:22:20.929194+0000","last_unstale":"2023-11-30T17:22:21.340717+0000","last_undegraded":"2023-11-30T17:22:21.340717+0000","last_fullsized":"2023-11-30T17:22:21.340717+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337931+0000","last_change":"2023-11-30T17:22:21.337197+0000","last_active":"2023-11-30T17:22:21.337931+0000","last_peered":"2023-11-30T17:22:21.337931+0000","last_clean":"2023-11-30T17:22:21.337931+0000","last_became_active":"2023-11-30T17:22:21.336585+0000","last_became_peered":"2023-11-30T17:22:21.336585+0000","last_unstale":"2023-11-30T17:22:21.337931+0000","last_undegraded":"2023-11-30T17:22:21.337931+0000","last_fullsized":"2023-11-30T17:22:21.337931+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335893+0000","last_change":"2023-11-30T17:22:20.934027+0000","last_active":"2023-11-30T17:22:21.335893+0000","last_peered":"2023-11-30T17:22:21.335893+0000","last_clean":"2023-11-30T17:22:21.335893+0000","last_became_active":"2023-11-30T17:22:20.933415+0000","last_became_peered":"2023-11-30T17:22:20.933415+0000","last_unstale":"2023-11-30T17:22:21.335893+0000","last_undegraded":"2023-11-30T17:22:21.335893+0000","last_fullsized":"2023-11-30T17:22:21.335893+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335963+0000","last_change":"2023-11-30T17:22:21.333694+0000","last_active":"2023-11-30T17:22:21.335963+0000","last_peered":"2023-11-30T17:22:21.335963+0000","last_clean":"2023-11-30T17:22:21.335963+0000","last_became_active":"2023-11-30T17:22:21.333507+0000","last_became_peered":"2023-11-30T17:22:21.333507+0000","last_unstale":"2023-11-30T17:22:21.335963+0000","last_undegraded":"2023-11-30T17:22:21.335963+0000","last_fullsized":"2023-11-30T17:22:21.335963+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.320977+0000","last_change":"2023-11-30T17:22:20.929587+0000","last_active":"2023-11-30T17:22:21.320977+0000","last_peered":"2023-11-30T17:22:21.320977+0000","last_clean":"2023-11-30T17:22:21.320977+0000","last_became_active":"2023-11-30T17:22:20.929280+0000","last_became_peered":"2023-11-30T17:22:20.929280+0000","last_unstale":"2023-11-30T17:22:21.320977+0000","last_undegraded":"2023-11-30T17:22:21.320977+0000","last_fullsized":"2023-11-30T17:22:21.320977+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.339658+0000","last_change":"2023-11-30T17:22:21.333528+0000","last_active":"2023-11-30T17:22:21.339658+0000","last_peered":"2023-11-30T17:22:21.339658+0000","last_clean":"2023-11-30T17:22:21.339658+0000","last_became_active":"2023-11-30T17:22:21.333257+0000","last_became_peered":"2023-11-30T17:22:21.333257+0000","last_unstale":"2023-11-30T17:22:21.339658+0000","last_undegraded":"2023-11-30T17:22:21.339658+0000","last_fullsized":"2023-11-30T17:22:21.339658+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.314720+0000","last_change":"2023-11-30T17:22:20.936879+0000","last_active":"2023-11-30T17:22:21.314720+0000","last_peered":"2023-11-30T17:22:21.314720+0000","last_clean":"2023-11-30T17:22:21.314720+0000","last_became_active":"2023-11-30T17:22:20.936480+0000","last_became_peered":"2023-11-30T17:22:20.936480+0000","last_unstale":"2023-11-30T17:22:21.314720+0000","last_undegraded":"2023-11-30T17:22:21.314720+0000","last_fullsized":"2023-11-30T17:22:21.314720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.328898+0000","last_change":"2023-11-30T17:22:21.323442+0000","last_active":"2023-11-30T17:22:21.328898+0000","last_peered":"2023-11-30T17:22:21.328898+0000","last_clean":"2023-11-30T17:22:21.328898+0000","last_became_active":"2023-11-30T17:22:21.320580+0000","last_became_peered":"2023-11-30T17:22:21.320580+0000","last_unstale":"2023-11-30T17:22:21.328898+0000","last_undegraded":"2023-11-30T17:22:21.328898+0000","last_fullsized":"2023-11-30T17:22:21.328898+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.315988+0000","last_change":"2023-11-30T17:22:20.931107+0000","last_active":"2023-11-30T17:22:21.315988+0000","last_peered":"2023-11-30T17:22:21.315988+0000","last_clean":"2023-11-30T17:22:21.315988+0000","last_became_active":"2023-11-30T17:22:20.930305+0000","last_became_peered":"2023-11-30T17:22:20.930305+0000","last_unstale":"2023-11-30T17:22:21.315988+0000","last_undegraded":"2023-11-30T17:22:21.315988+0000","last_fullsized":"2023-11-30T17:22:21.315988+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.332421+0000","last_change":"2023-11-30T17:22:21.326301+0000","last_active":"2023-11-30T17:22:21.332421+0000","last_peered":"2023-11-30T17:22:21.332421+0000","last_clean":"2023-11-30T17:22:21.332421+0000","last_became_active":"2023-11-30T17:22:21.326019+0000","last_became_peered":"2023-11-30T17:22:21.326019+0000","last_unstale":"2023-11-30T17:22:21.332421+0000","last_undegraded":"2023-11-30T17:22:21.332421+0000","last_fullsized":"2023-11-30T17:22:21.332421+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.321118+0000","last_change":"2023-11-30T17:22:20.942745+0000","last_active":"2023-11-30T17:22:21.321118+0000","last_peered":"2023-11-30T17:22:21.321118+0000","last_clean":"2023-11-30T17:22:21.321118+0000","last_became_active":"2023-11-30T17:22:20.942453+0000","last_became_peered":"2023-11-30T17:22:20.942453+0000","last_unstale":"2023-11-30T17:22:21.321118+0000","last_undegraded":"2023-11-30T17:22:21.321118+0000","last_fullsized":"2023-11-30T17:22:21.321118+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.341513+0000","last_change":"2023-11-30T17:22:21.338134+0000","last_active":"2023-11-30T17:22:21.341513+0000","last_peered":"2023-11-30T17:22:21.341513+0000","last_clean":"2023-11-30T17:22:21.341513+0000","last_became_active":"2023-11-30T17:22:21.337848+0000","last_became_peered":"2023-11-30T17:22:21.337848+0000","last_unstale":"2023-11-30T17:22:21.341513+0000","last_undegraded":"2023-11-30T17:22:21.341513+0000","last_fullsized":"2023-11-30T17:22:21.341513+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.314531+0000","last_change":"2023-11-30T17:22:20.935254+0000","last_active":"2023-11-30T17:22:21.314531+0000","last_peered":"2023-11-30T17:22:21.314531+0000","last_clean":"2023-11-30T17:22:21.314531+0000","last_became_active":"2023-11-30T17:22:20.934966+0000","last_became_peered":"2023-11-30T17:22:20.934966+0000","last_unstale":"2023-11-30T17:22:21.314531+0000","last_undegraded":"2023-11-30T17:22:21.314531+0000","last_fullsized":"2023-11-30T17:22:21.314531+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.328239+0000","last_change":"2023-11-30T17:22:21.326066+0000","last_active":"2023-11-30T17:22:21.328239+0000","last_peered":"2023-11-30T17:22:21.328239+0000","last_clean":"2023-11-30T17:22:21.328239+0000","last_became_active":"2023-11-30T17:22:21.325745+0000","last_became_peered":"2023-11-30T17:22:21.325745+0000","last_unstale":"2023-11-30T17:22:21.328239+0000","last_undegraded":"2023-11-30T17:22:21.328239+0000","last_fullsized":"2023-11-30T17:22:21.328239+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.313737+0000","last_change":"2023-11-30T17:22:20.935412+0000","last_active":"2023-11-30T17:22:21.313737+0000","last_peered":"2023-11-30T17:22:21.313737+0000","last_clean":"2023-11-30T17:22:21.313737+0000","last_became_active":"2023-11-30T17:22:20.934756+0000","last_became_peered":"2023-11-30T17:22:20.934756+0000","last_unstale":"2023-11-30T17:22:21.313737+0000","last_undegraded":"2023-11-30T17:22:21.313737+0000","last_fullsized":"2023-11-30T17:22:21.313737+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.336712+0000","last_change":"2023-11-30T17:22:21.334589+0000","last_active":"2023-11-30T17:22:21.336712+0000","last_peered":"2023-11-30T17:22:21.336712+0000","last_clean":"2023-11-30T17:22:21.336712+0000","last_became_active":"2023-11-30T17:22:21.334131+0000","last_became_peered":"2023-11-30T17:22:21.334131+0000","last_unstale":"2023-11-30T17:22:21.336712+0000","last_undegraded":"2023-11-30T17:22:21.336712+0000","last_fullsized":"2023-11-30T17:22:21.336712+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.315239+0000","last_change":"2023-11-30T17:22:20.929746+0000","last_active":"2023-11-30T17:22:21.315239+0000","last_peered":"2023-11-30T17:22:21.315239+0000","last_clean":"2023-11-30T17:22:21.315239+0000","last_became_active":"2023-11-30T17:22:20.929451+0000","last_became_peered":"2023-11-30T17:22:20.929451+0000","last_unstale":"2023-11-30T17:22:21.315239+0000","last_undegraded":"2023-11-30T17:22:21.315239+0000","last_fullsized":"2023-11-30T17:22:21.315239+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.339965+0000","last_change":"2023-11-30T17:22:21.338801+0000","last_active":"2023-11-30T17:22:21.339965+0000","last_peered":"2023-11-30T17:22:21.339965+0000","last_clean":"2023-11-30T17:22:21.339965+0000","last_became_active":"2023-11-30T17:22:21.338518+0000","last_became_peered":"2023-11-30T17:22:21.338518+0000","last_unstale":"2023-11-30T17:22:21.339965+0000","last_undegraded":"2023-11-30T17:22:21.339965+0000","last_fullsized":"2023-11-30T17:22:21.339965+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.334611+0000","last_change":"2023-11-30T17:22:20.934112+0000","last_active":"2023-11-30T17:22:21.334611+0000","last_peered":"2023-11-30T17:22:21.334611+0000","last_clean":"2023-11-30T17:22:21.334611+0000","last_became_active":"2023-11-30T17:22:20.933778+0000","last_became_peered":"2023-11-30T17:22:20.933778+0000","last_unstale":"2023-11-30T17:22:21.334611+0000","last_undegraded":"2023-11-30T17:22:21.334611+0000","last_fullsized":"2023-11-30T17:22:21.334611+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.316069+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:22:21.316069+0000","last_peered":"2023-11-30T17:22:21.316069+0000","last_clean":"2023-11-30T17:22:21.316069+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:22:21.316069+0000","last_undegraded":"2023-11-30T17:22:21.316069+0000","last_fullsized":"2023-11-30T17:22:21.316069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.329466+0000","last_change":"2023-11-30T17:22:21.320422+0000","last_active":"2023-11-30T17:22:21.329466+0000","last_peered":"2023-11-30T17:22:21.329466+0000","last_clean":"2023-11-30T17:22:21.329466+0000","last_became_active":"2023-11-30T17:22:21.320108+0000","last_became_peered":"2023-11-30T17:22:21.320108+0000","last_unstale":"2023-11-30T17:22:21.329466+0000","last_undegraded":"2023-11-30T17:22:21.329466+0000","last_fullsized":"2023-11-30T17:22:21.329466+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.313395+0000","last_change":"2023-11-30T17:22:20.931616+0000","last_active":"2023-11-30T17:22:21.313395+0000","last_peered":"2023-11-30T17:22:21.313395+0000","last_clean":"2023-11-30T17:22:21.313395+0000","last_became_active":"2023-11-30T17:22:20.931340+0000","last_became_peered":"2023-11-30T17:22:20.931340+0000","last_unstale":"2023-11-30T17:22:21.313395+0000","last_undegraded":"2023-11-30T17:22:21.313395+0000","last_fullsized":"2023-11-30T17:22:21.313395+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.317913+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:22:21.317913+0000","last_peered":"2023-11-30T17:22:21.317913+0000","last_clean":"2023-11-30T17:22:21.317913+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:22:21.317913+0000","last_undegraded":"2023-11-30T17:22:21.317913+0000","last_fullsized":"2023-11-30T17:22:21.317913+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.334220+0000","last_change":"2023-11-30T17:22:21.327758+0000","last_active":"2023-11-30T17:22:21.334220+0000","last_peered":"2023-11-30T17:22:21.334220+0000","last_clean":"2023-11-30T17:22:21.334220+0000","last_became_active":"2023-11-30T17:22:21.327398+0000","last_became_peered":"2023-11-30T17:22:21.327398+0000","last_unstale":"2023-11-30T17:22:21.334220+0000","last_undegraded":"2023-11-30T17:22:21.334220+0000","last_fullsized":"2023-11-30T17:22:21.334220+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.317760+0000","last_change":"2023-11-30T17:22:20.927833+0000","last_active":"2023-11-30T17:22:21.317760+0000","last_peered":"2023-11-30T17:22:21.317760+0000","last_clean":"2023-11-30T17:22:21.317760+0000","last_became_active":"2023-11-30T17:22:20.927383+0000","last_became_peered":"2023-11-30T17:22:20.927383+0000","last_unstale":"2023-11-30T17:22:21.317760+0000","last_undegraded":"2023-11-30T17:22:21.317760+0000","last_fullsized":"2023-11-30T17:22:21.317760+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.322565+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:22:21.322565+0000","last_peered":"2023-11-30T17:22:21.322565+0000","last_clean":"2023-11-30T17:22:21.322565+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:22:21.322565+0000","last_undegraded":"2023-11-30T17:22:21.322565+0000","last_fullsized":"2023-11-30T17:22:21.322565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.332452+0000","last_change":"2023-11-30T17:22:21.326732+0000","last_active":"2023-11-30T17:22:21.332452+0000","last_peered":"2023-11-30T17:22:21.332452+0000","last_clean":"2023-11-30T17:22:21.332452+0000","last_became_active":"2023-11-30T17:22:21.326378+0000","last_became_peered":"2023-11-30T17:22:21.326378+0000","last_unstale":"2023-11-30T17:22:21.332452+0000","last_undegraded":"2023-11-30T17:22:21.332452+0000","last_fullsized":"2023-11-30T17:22:21.332452+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.313240+0000","last_change":"2023-11-30T17:22:20.931380+0000","last_active":"2023-11-30T17:22:21.313240+0000","last_peered":"2023-11-30T17:22:21.313240+0000","last_clean":"2023-11-30T17:22:21.313240+0000","last_became_active":"2023-11-30T17:22:20.931038+0000","last_became_peered":"2023-11-30T17:22:20.931038+0000","last_unstale":"2023-11-30T17:22:21.313240+0000","last_undegraded":"2023-11-30T17:22:21.313240+0000","last_fullsized":"2023-11-30T17:22:21.313240+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.321221+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:22:21.321221+0000","last_peered":"2023-11-30T17:22:21.321221+0000","last_clean":"2023-11-30T17:22:21.321221+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:22:21.321221+0000","last_undegraded":"2023-11-30T17:22:21.321221+0000","last_fullsized":"2023-11-30T17:22:21.321221+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":68,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.317713+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:22:21.317713+0000","last_peered":"2023-11-30T17:22:21.317713+0000","last_clean":"2023-11-30T17:22:21.317713+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:22:21.317713+0000","last_undegraded":"2023-11-30T17:22:21.317713+0000","last_fullsized":"2023-11-30T17:22:21.317713+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335131+0000","last_change":"2023-11-30T17:22:21.332384+0000","last_active":"2023-11-30T17:22:21.335131+0000","last_peered":"2023-11-30T17:22:21.335131+0000","last_clean":"2023-11-30T17:22:21.335131+0000","last_became_active":"2023-11-30T17:22:21.332098+0000","last_became_peered":"2023-11-30T17:22:21.332098+0000","last_unstale":"2023-11-30T17:22:21.335131+0000","last_undegraded":"2023-11-30T17:22:21.335131+0000","last_fullsized":"2023-11-30T17:22:21.335131+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.337701+0000","last_change":"2023-11-30T17:22:20.934641+0000","last_active":"2023-11-30T17:22:21.337701+0000","last_peered":"2023-11-30T17:22:21.337701+0000","last_clean":"2023-11-30T17:22:21.337701+0000","last_became_active":"2023-11-30T17:22:20.934355+0000","last_became_peered":"2023-11-30T17:22:20.934355+0000","last_unstale":"2023-11-30T17:22:21.337701+0000","last_undegraded":"2023-11-30T17:22:21.337701+0000","last_fullsized":"2023-11-30T17:22:21.337701+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.319237+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:22:21.319237+0000","last_peered":"2023-11-30T17:22:21.319237+0000","last_clean":"2023-11-30T17:22:21.319237+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:22:21.319237+0000","last_undegraded":"2023-11-30T17:22:21.319237+0000","last_fullsized":"2023-11-30T17:22:21.319237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.335955+0000","last_change":"2023-11-30T17:22:21.328382+0000","last_active":"2023-11-30T17:22:21.335955+0000","last_peered":"2023-11-30T17:22:21.335955+0000","last_clean":"2023-11-30T17:22:21.335955+0000","last_became_active":"2023-11-30T17:22:21.328042+0000","last_became_peered":"2023-11-30T17:22:21.328042+0000","last_unstale":"2023-11-30T17:22:21.335955+0000","last_undegraded":"2023-11-30T17:22:21.335955+0000","last_fullsized":"2023-11-30T17:22:21.335955+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.340246+0000","last_change":"2023-11-30T17:22:20.939499+0000","last_active":"2023-11-30T17:22:21.340246+0000","last_peered":"2023-11-30T17:22:21.340246+0000","last_clean":"2023-11-30T17:22:21.340246+0000","last_became_active":"2023-11-30T17:22:20.939186+0000","last_became_peered":"2023-11-30T17:22:20.939186+0000","last_unstale":"2023-11-30T17:22:21.340246+0000","last_undegraded":"2023-11-30T17:22:21.340246+0000","last_fullsized":"2023-11-30T17:22:21.340246+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.319544+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:22:21.319544+0000","last_peered":"2023-11-30T17:22:21.319544+0000","last_clean":"2023-11-30T17:22:21.319544+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:22:21.319544+0000","last_undegraded":"2023-11-30T17:22:21.319544+0000","last_fullsized":"2023-11-30T17:22:21.319544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.338546+0000","last_change":"2023-11-30T17:22:21.333492+0000","last_active":"2023-11-30T17:22:21.338546+0000","last_peered":"2023-11-30T17:22:21.338546+0000","last_clean":"2023-11-30T17:22:21.338546+0000","last_became_active":"2023-11-30T17:22:21.333152+0000","last_became_peered":"2023-11-30T17:22:21.333152+0000","last_unstale":"2023-11-30T17:22:21.338546+0000","last_undegraded":"2023-11-30T17:22:21.338546+0000","last_fullsized":"2023-11-30T17:22:21.338546+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.319467+0000","last_change":"2023-11-30T17:22:20.939112+0000","last_active":"2023-11-30T17:22:21.319467+0000","last_peered":"2023-11-30T17:22:21.319467+0000","last_clean":"2023-11-30T17:22:21.319467+0000","last_became_active":"2023-11-30T17:22:20.938852+0000","last_became_peered":"2023-11-30T17:22:20.938852+0000","last_unstale":"2023-11-30T17:22:21.319467+0000","last_undegraded":"2023-11-30T17:22:21.319467+0000","last_fullsized":"2023-11-30T17:22:21.319467+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.316533+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:22:21.316533+0000","last_peered":"2023-11-30T17:22:21.316533+0000","last_clean":"2023-11-30T17:22:21.316533+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:22:21.316533+0000","last_undegraded":"2023-11-30T17:22:21.316533+0000","last_fullsized":"2023-11-30T17:22:21.316533+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.328921+0000","last_change":"2023-11-30T17:22:21.324306+0000","last_active":"2023-11-30T17:22:21.328921+0000","last_peered":"2023-11-30T17:22:21.328921+0000","last_clean":"2023-11-30T17:22:21.328921+0000","last_became_active":"2023-11-30T17:22:21.320900+0000","last_became_peered":"2023-11-30T17:22:21.320900+0000","last_unstale":"2023-11-30T17:22:21.328921+0000","last_undegraded":"2023-11-30T17:22:21.328921+0000","last_fullsized":"2023-11-30T17:22:21.328921+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:20.908484+0000","last_clean_scrub_stamp":"2023-11-30T17:22:20.908484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.313882+0000","last_change":"2023-11-30T17:22:20.931092+0000","last_active":"2023-11-30T17:22:21.313882+0000","last_peered":"2023-11-30T17:22:21.313882+0000","last_clean":"2023-11-30T17:22:21.313882+0000","last_became_active":"2023-11-30T17:22:20.930734+0000","last_became_peered":"2023-11-30T17:22:20.930734+0000","last_unstale":"2023-11-30T17:22:21.313882+0000","last_undegraded":"2023-11-30T17:22:21.313882+0000","last_fullsized":"2023-11-30T17:22:21.313882+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:19.906108+0000","last_clean_scrub_stamp":"2023-11-30T17:22:19.906108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":72,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-30T17:22:21.316518+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:22:21.316518+0000","last_peered":"2023-11-30T17:22:21.316518+0000","last_clean":"2023-11-30T17:22:21.316518+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:22:21.316518+0000","last_undegraded":"2023-11-30T17:22:21.316518+0000","last_fullsized":"2023-11-30T17:22:21.316518+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575031,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298088,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073752,"statfs":{"total":96636764160,"available":96331522048,"internally_reserved":0,"allocated":1015808,"data_stored":500899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58899999999999997,"15min":0.57299999999999995},"min":{"1min":0.48499999999999999,"5min":0.315,"15min":0.23899999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.81100000000000005},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.57899999999999996},"min":{"1min":0.41999999999999998,"5min":0.40699999999999997,"15min":0.32200000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.81899999999999995},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54800000000000004,"15min":0.54000000000000004},"min":{"1min":0.40600000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.41499999999999998,"5min":0.29899999999999999,"15min":0.28799999999999998},"max":{"1min":0.71799999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.36599999999999999}]},{"osd":2,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.47799999999999998,"5min":0.33500000000000002,"15min":0.32800000000000001},"max":{"1min":0.77000000000000002,"5min":0.77200000000000002,"15min":0.78300000000000003},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56100000000000005,"15min":0.55600000000000005},"min":{"1min":0.48299999999999998,"5min":0.35399999999999998,"15min":0.28699999999999998},"max":{"1min":0.73699999999999999,"5min":0.73799999999999999,"15min":0.83899999999999997},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.44800000000000001,"5min":0.36499999999999999,"15min":0.33200000000000002},"max":{"1min":0.749,"5min":0.754,"15min":0.78000000000000003},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.45800000000000002,"5min":0.40799999999999997,"15min":0.33900000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.45300000000000001,"15min":0.46500000000000002},"min":{"1min":0.34200000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.79900000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47099999999999997,"15min":0.48999999999999999},"min":{"1min":0.33400000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.748,"5min":0.75800000000000001,"15min":1.3180000000000001},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.48899999999999999,"15min":0.498},"min":{"1min":0.34300000000000003,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.82899999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.872},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu Nov 30 17:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54700000000000004,"15min":0.55400000000000005},"min":{"1min":0.42499999999999999,"5min":0.372,"15min":0.36099999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.85199999999999998},"last":0.622},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.54900000000000004,"15min":0.55400000000000005},"min":{"1min":0.44600000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78900000000000003,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.66200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575030,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302176,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069664,"statfs":{"total":96636764160,"available":96327335936,"internally_reserved":0,"allocated":1007616,"data_stored":499917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55100000000000005,"15min":0.56499999999999995},"min":{"1min":0.32500000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71299999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.58199999999999996},"min":{"1min":0.33500000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.72199999999999998,"5min":0.79600000000000004,"15min":0.89300000000000002},"last":0.748}]},{"osd":1,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.376,"5min":0.30599999999999999,"15min":0.26400000000000001},"max":{"1min":0.74199999999999999,"5min":0.77500000000000002,"15min":0.82799999999999996},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58299999999999996,"15min":0.59299999999999997},"min":{"1min":0.44600000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.74099999999999999,"5min":0.82499999999999996,"15min":0.85199999999999998},"last":0.67900000000000005}]},{"osd":2,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.45000000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.68799999999999994,"5min":0.79900000000000004,"15min":0.82599999999999996},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.46700000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72799999999999998,"5min":0.80900000000000005,"15min":0.82499999999999996},"last":0.70199999999999996}]},{"osd":3,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51500000000000001,"15min":0.53200000000000003},"min":{"1min":0.34300000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69099999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.40200000000000002,"5min":0.33100000000000002,"15min":0.32200000000000001},"max":{"1min":0.73099999999999998,"5min":0.75600000000000001,"15min":0.79600000000000004},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.44700000000000001,"15min":0.45400000000000001},"min":{"1min":0.35499999999999998,"5min":0.29599999999999999,"15min":0.28999999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.84199999999999997},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46300000000000002,"15min":0.47899999999999998},"min":{"1min":0.36499999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.65500000000000003,"5min":0.76000000000000001,"15min":0.83899999999999997},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.46100000000000002,"15min":0.47099999999999997},"min":{"1min":0.35199999999999998,"5min":0.29899999999999999,"15min":0.28299999999999997},"max":{"1min":0.65200000000000002,"5min":0.69399999999999995,"15min":0.74299999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.50700000000000001},"min":{"1min":0.371,"5min":0.33500000000000002,"15min":0.31900000000000001},"max":{"1min":0.70399999999999996,"5min":0.745,"15min":0.78500000000000003},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Nov 30 17:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51700000000000002,"15min":0.53300000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73299999999999998,"5min":0.80700000000000005,"15min":0.93200000000000005},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55300000000000005,"15min":0.56299999999999994},"min":{"1min":0.39500000000000002,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.86499999999999999},"last":0.60399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302188,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069652,"statfs":{"total":96636764160,"available":96327323648,"internally_reserved":0,"allocated":1019904,"data_stored":500639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.35999999999999999,"15min":0.35099999999999998},"min":{"1min":0.29599999999999999,"5min":0.23899999999999999,"15min":0.23000000000000001},"max":{"1min":0.54900000000000004,"5min":0.57199999999999995,"15min":0.60299999999999998},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.502,"5min":0.46999999999999997,"15min":0.46100000000000002},"min":{"1min":0.39200000000000002,"5min":0.314,"15min":0.309},"max":{"1min":0.59899999999999998,"5min":0.748,"15min":0.75700000000000001},"last":0.45900000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.39100000000000001,"15min":0.379},"min":{"1min":0.28599999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.56999999999999995,"5min":0.59799999999999998,"15min":0.67300000000000004},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.50800000000000001,"15min":0.48999999999999999},"min":{"1min":0.438,"5min":0.33400000000000002,"15min":0.29499999999999998},"max":{"1min":0.64200000000000002,"5min":0.78200000000000003,"15min":0.80700000000000005},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45100000000000001,"15min":0.441},"min":{"1min":0.38200000000000001,"5min":0.29899999999999999,"15min":0.23899999999999999},"max":{"1min":0.57099999999999995,"5min":0.70299999999999996,"15min":0.749},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.437,"15min":0.42599999999999999},"min":{"1min":0.34100000000000003,"5min":0.29999999999999999,"15min":0.28599999999999998},"max":{"1min":0.55700000000000005,"5min":0.71899999999999997,"15min":0.73699999999999999},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.44400000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.873,"5min":0.88500000000000001,"15min":0.89100000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.61199999999999999,"15min":0.61499999999999999},"min":{"1min":0.48599999999999999,"5min":0.41299999999999998,"15min":0.39900000000000002},"max":{"1min":0.753,"5min":0.97599999999999998,"15min":1.111},"last":0.60199999999999998}]},{"osd":5,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59799999999999998,"15min":0.59899999999999998},"min":{"1min":0.44400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.85399999999999998,"5min":1.006,"15min":1.006},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.434,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76500000000000001,"5min":0.81399999999999995,"15min":0.91300000000000003},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.56699999999999995,"5min":0.39700000000000002,"15min":0.39600000000000002},"max":{"1min":0.85699999999999998,"5min":0.92700000000000005,"15min":1.0600000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65200000000000002,"15min":0.65800000000000003},"min":{"1min":0.51600000000000001,"5min":0.433,"15min":0.379},"max":{"1min":0.91100000000000003,"5min":0.96099999999999997,"15min":1.0780000000000001},"last":0.745}]},{"osd":7,"last update":"Thu Nov 30 17:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67000000000000004,"15min":0.66300000000000003},"min":{"1min":0.45100000000000001,"5min":0.41899999999999998,"15min":0.41699999999999998},"max":{"1min":0.88900000000000001,"5min":0.92300000000000004,"15min":0.98699999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64000000000000001,"15min":0.64700000000000002},"min":{"1min":0.52500000000000002,"5min":0.436,"15min":0.39900000000000002},"max":{"1min":0.81999999999999995,"5min":0.879,"15min":0.94199999999999995},"last":0.59499999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575030,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302172,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069668,"statfs":{"total":96636764160,"available":96327340032,"internally_reserved":0,"allocated":1003520,"data_stored":499883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.373,"15min":0.35999999999999999},"min":{"1min":0.27500000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.48599999999999999,"5min":0.59999999999999998,"15min":0.71199999999999997},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.39100000000000001,"15min":0.379},"min":{"1min":0.26500000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.26100000000000001}]},{"osd":2,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.39100000000000001,"15min":0.38},"min":{"1min":0.29499999999999998,"5min":0.247,"15min":0.23899999999999999},"max":{"1min":0.55900000000000005,"5min":0.623,"15min":0.623},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.46300000000000002,"15min":0.45300000000000001},"min":{"1min":0.38100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.63400000000000001,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.313}]},{"osd":3,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.433,"15min":0.42599999999999999},"min":{"1min":0.32500000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.58599999999999997,"5min":0.66100000000000003,"15min":0.70999999999999996},"last":0.245},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44700000000000001,"15min":0.435},"min":{"1min":0.34300000000000003,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.56200000000000006,"5min":0.65400000000000003,"15min":0.68799999999999994},"last":0.27300000000000002}]},{"osd":4,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60999999999999999,"15min":0.59999999999999998},"min":{"1min":0.44900000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76400000000000001,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.50800000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.85399999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60899999999999999,"15min":0.59499999999999997},"min":{"1min":0.47399999999999998,"5min":0.39200000000000002,"15min":0.36199999999999999},"max":{"1min":0.83499999999999996,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63700000000000001,"15min":0.623},"min":{"1min":0.51500000000000001,"5min":0.38400000000000001,"15min":0.38},"max":{"1min":0.77700000000000002,"5min":1.004,"15min":1.004},"last":0.54500000000000004}]},{"osd":6,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65100000000000002,"15min":0.63900000000000001},"min":{"1min":0.435,"5min":0.376,"15min":0.376},"max":{"1min":0.89800000000000002,"5min":1.002,"15min":1.002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63900000000000001,"15min":0.627},"min":{"1min":0.496,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.872,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Nov 30 17:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66000000000000003,"15min":0.64600000000000002},"min":{"1min":0.498,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94499999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.69699999999999995,"15min":0.68200000000000005},"min":{"1min":0.56100000000000005,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.93799999999999994,"5min":1.026,"15min":1.026},"last":0.63600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575030,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306264,"kb_used_data":976,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065576,"statfs":{"total":96636764160,"available":96323149824,"internally_reserved":0,"allocated":999424,"data_stored":493775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40400000000000003,"15min":0.38800000000000001},"min":{"1min":0.31,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.57099999999999995,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":3.4729999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.42899999999999999,"15min":0.42699999999999999},"min":{"1min":0.33800000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58899999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":2.637}]},{"osd":1,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45300000000000001,"15min":0.44},"min":{"1min":0.36799999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.63800000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":6.1210000000000004},{"interface":"front","average":{"1min":0.505,"5min":0.47799999999999998,"15min":0.46700000000000003},"min":{"1min":0.33400000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.67500000000000004,"5min":1.206,"15min":1.206},"last":5.7270000000000003}]},{"osd":3,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38600000000000001,"15min":0.39700000000000002},"min":{"1min":0.27200000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.56200000000000006,"5min":0.63500000000000001,"15min":0.86199999999999999},"last":0.438},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.46000000000000002},"min":{"1min":0.40999999999999998,"5min":0.26900000000000002,"15min":0.26200000000000001},"max":{"1min":0.60099999999999998,"5min":1.226,"15min":1.226},"last":1.756}]},{"osd":4,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61899999999999999,"15min":0.60999999999999999},"min":{"1min":0.46100000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84699999999999998,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":8.7170000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.78500000000000003,"5min":1.492,"15min":1.492},"last":1.381}]},{"osd":5,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63400000000000001,"15min":0.629},"min":{"1min":0.503,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94699999999999995,"5min":0.996,"15min":0.996},"last":3.4359999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.623,"15min":0.624},"min":{"1min":0.48899999999999999,"5min":0.38900000000000001,"15min":0.38100000000000001},"max":{"1min":0.79900000000000004,"5min":1.292,"15min":1.292},"last":1.982}]},{"osd":6,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.625,"15min":0.621},"min":{"1min":0.47499999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.76600000000000001,"5min":1.359,"15min":1.359},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.53300000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.879,"5min":1.159,"15min":1.159},"last":1.861}]},{"osd":7,"last update":"Thu Nov 30 17:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.57299999999999995,"5min":0.45200000000000001,"15min":0.40300000000000002},"max":{"1min":0.88600000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":4.6849999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67600000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.41499999999999998},"max":{"1min":0.93100000000000005,"5min":1.125,"15min":1.125},"last":4.5039999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575030,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306276,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065564,"statfs":{"total":96636764160,"available":96323137536,"internally_reserved":0,"allocated":1011712,"data_stored":500507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35799999999999998,"15min":0.36199999999999999},"min":{"1min":0.26800000000000002,"5min":0.219,"15min":0.217},"max":{"1min":0.47899999999999998,"5min":0.57699999999999996,"15min":0.66200000000000003},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.40699999999999997,"15min":0.40000000000000002},"min":{"1min":0.30199999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.57199999999999995,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.33100000000000002}]},{"osd":1,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.38,"15min":0.38600000000000001},"min":{"1min":0.30199999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.42199999999999999,"15min":0.42999999999999999},"min":{"1min":0.32300000000000001,"5min":0.26600000000000001,"15min":0.25900000000000001},"max":{"1min":0.54500000000000004,"5min":0.65900000000000003,"15min":0.84399999999999997},"last":0.379}]},{"osd":2,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.44400000000000001,"15min":0.44800000000000001},"min":{"1min":0.32800000000000001,"5min":0.28599999999999998,"15min":0.26000000000000001},"max":{"1min":0.66000000000000003,"5min":0.72999999999999998,"15min":0.94899999999999995},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.505,"15min":0.505},"min":{"1min":0.41199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.63700000000000001,"5min":1.054,"15min":1.054},"last":0.42799999999999999}]},{"osd":4,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59699999999999998,"15min":0.60399999999999998},"min":{"1min":0.45000000000000001,"5min":0.35299999999999998,"15min":0.35099999999999998},"max":{"1min":0.75900000000000001,"5min":0.91500000000000004,"15min":0.97599999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.47299999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78300000000000003,"5min":0.86799999999999999,"15min":0.91400000000000003},"last":0.56699999999999995}]},{"osd":5,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.59099999999999997,"15min":0.61099999999999999},"min":{"1min":0.42599999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82299999999999995,"5min":0.85399999999999998,"15min":0.98399999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77500000000000002,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.67700000000000005}]},{"osd":6,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.626,"15min":0.64500000000000002},"min":{"1min":0.48699999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81200000000000006,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.49399999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81200000000000006,"5min":0.89500000000000002,"15min":1.0389999999999999},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Nov 30 17:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65600000000000003,"15min":0.66600000000000004},"min":{"1min":0.503,"5min":0.40500000000000003,"15min":0.39100000000000001},"max":{"1min":0.83699999999999997,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64800000000000002,"15min":0.66000000000000003},"min":{"1min":0.49199999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.004},"last":0.69599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575030,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302180,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069660,"statfs":{"total":96636764160,"available":96327331840,"internally_reserved":0,"allocated":1011712,"data_stored":500527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.52500000000000002,"15min":0.52800000000000002},"min":{"1min":0.30599999999999999,"5min":0.28299999999999997,"15min":0.27500000000000002},"max":{"1min":0.748,"5min":0.77700000000000002,"15min":0.80900000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.28399999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.81999999999999995,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.442}]},{"osd":1,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.25800000000000001},"max":{"1min":0.69699999999999995,"5min":0.73799999999999999,"15min":0.79600000000000004},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54500000000000004,"15min":0.54600000000000004},"min":{"1min":0.34499999999999997,"5min":0.317,"15min":0.246},"max":{"1min":0.72499999999999998,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.41199999999999998,"5min":0.376,"15min":0.27800000000000002},"max":{"1min":0.755,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.39600000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71099999999999997,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55000000000000004,"15min":0.54600000000000004},"min":{"1min":0.42599999999999999,"5min":0.34699999999999998,"15min":0.32900000000000001},"max":{"1min":0.71299999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.40999999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74299999999999999,"5min":0.78900000000000003,"15min":0.80600000000000005},"last":0.59399999999999997}]},{"osd":5,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.438,"15min":0.44700000000000001},"min":{"1min":0.32900000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.58099999999999996,"5min":1.272,"15min":1.272},"last":0.63},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46100000000000002,"15min":0.46400000000000002},"min":{"1min":0.34300000000000003,"5min":0.29899999999999999,"15min":0.29199999999999998},"max":{"1min":0.54000000000000004,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.501,"15min":0.505},"min":{"1min":0.38100000000000001,"5min":0.33900000000000002,"15min":0.314},"max":{"1min":0.63800000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54800000000000004,"15min":0.54000000000000004},"min":{"1min":0.45800000000000002,"5min":0.373,"15min":0.33800000000000002},"max":{"1min":0.61699999999999999,"5min":1.129,"15min":1.129},"last":0.75}]},{"osd":7,"last update":"Thu Nov 30 17:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34300000000000003,"5min":0.318,"15min":0.29899999999999999},"max":{"1min":0.66900000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.44900000000000001,"5min":0.38600000000000001,"15min":0.34599999999999997},"max":{"1min":0.70799999999999996,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.76700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575030,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302168,"kb_used_data":976,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069672,"statfs":{"total":96636764160,"available":96327344128,"internally_reserved":0,"allocated":999424,"data_stored":494065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53300000000000003,"15min":0.53600000000000003},"min":{"1min":0.40600000000000003,"5min":0.34399999999999997,"15min":0.32800000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.40899999999999997,"5min":0.31,"15min":0.31},"max":{"1min":0.70299999999999996,"5min":0.76200000000000001,"15min":0.81799999999999995},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52100000000000002,"15min":0.52800000000000002},"min":{"1min":0.35399999999999998,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.67100000000000004,"5min":0.69599999999999995,"15min":0.72399999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55000000000000004,"15min":0.54600000000000004},"min":{"1min":0.44900000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.745,"5min":0.754,"15min":0.77000000000000002},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.40000000000000002,"5min":0.34399999999999997,"15min":0.30599999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.622},{"interface":"front","average":{"1min":0.627,"5min":0.60099999999999998,"15min":0.59499999999999997},"min":{"1min":0.48699999999999999,"5min":0.378,"15min":0.34499999999999997},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.44800000000000001,"5min":0.36699999999999999,"15min":0.36399999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.73799999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.45600000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73299999999999998,"5min":0.79200000000000004,"15min":0.82099999999999995},"last":0.58799999999999997}]},{"osd":4,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42399999999999999,"15min":0.44},"min":{"1min":0.307,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57699999999999996,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45800000000000002,"15min":0.46700000000000003},"min":{"1min":0.31900000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.77600000000000002},"last":0.44}]},{"osd":6,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47599999999999998,"15min":0.48599999999999999},"min":{"1min":0.34200000000000003,"5min":0.29599999999999999,"15min":0.28499999999999998},"max":{"1min":0.70499999999999996,"5min":0.73999999999999999,"15min":0.82099999999999995},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.67500000000000004,"5min":0.81399999999999995,"15min":0.88200000000000001},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Nov 30 17:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52000000000000002,"15min":0.52600000000000002},"min":{"1min":0.33100000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.73899999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.41799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.84599999999999997},"last":0.55200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:22:30.176 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-30T17:22:30.176 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-30T17:22:30.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.332+0000 7fc644248700 1 Processor -- start 2023-11-30T17:22:30.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.332+0000 7fc644248700 1 -- start start 2023-11-30T17:22:30.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.333+0000 7fc644248700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc63c098d10 0x7fc63c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:30.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.333+0000 7fc644248700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc63c158320 0x7fc63c1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:30.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.333+0000 7fc644248700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc63c158cc0 con 0x7fc63c0c6190 2023-11-30T17:22:30.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.333+0000 7fc644248700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc63c0c72d0 con 0x7fc63c158320 2023-11-30T17:22:30.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.333+0000 7fc644248700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c064570 con 0x7fc63c098d10 2023-11-30T17:22:30.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.333+0000 7fc6427e5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc63c158320 0x7fc63c1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:30.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.333+0000 7fc6417e3700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc63c0c6190 0x7fc63c063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34110/0 (socket says 172.21.15.49:34110) 2023-11-30T17:22:30.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.333+0000 7fc6417e3700 1 -- 172.21.15.49:0/3564718695 learned_addr learned my addr 172.21.15.49:0/3564718695 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:30.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.334+0000 7fc641fe4700 1 --2- 172.21.15.49:0/3564718695 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc63c098d10 0x7fc63c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:30.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.334+0000 7fc640fe2700 1 -- 172.21.15.49:0/3564718695 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1510640764 0 0) 0x7fc630001110 con 0x7fc63c0c6190 2023-11-30T17:22:30.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.334+0000 7fc640fe2700 1 -- 172.21.15.49:0/3564718695 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6240033f0 con 0x7fc63c0c6190 2023-11-30T17:22:30.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.334+0000 7fc6427e5700 1 -- 172.21.15.49:0/3564718695 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc63c098d10 msgr2=0x7fc63c0c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:30.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.334+0000 7fc6427e5700 1 --2- 172.21.15.49:0/3564718695 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc63c098d10 0x7fc63c0c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:30.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.334+0000 7fc6427e5700 1 -- 172.21.15.49:0/3564718695 >> v1:172.21.15.49:6789/0 conn(0x7fc63c0c6190 legacy=0x7fc63c063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:30.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.334+0000 7fc6427e5700 1 -- 172.21.15.49:0/3564718695 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c154bc0 con 0x7fc63c158320 2023-11-30T17:22:30.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.334+0000 7fc6427e5700 1 --2- 172.21.15.49:0/3564718695 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc63c158320 0x7fc63c1587d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7fc62c009e60 tx=0x7fc62c009780).ready entity=mon.0 client_cookie=28d2a28a961088b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:30.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.334+0000 7fc640fe2700 1 -- 172.21.15.49:0/3564718695 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c00e070 con 0x7fc63c158320 2023-11-30T17:22:30.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.334+0000 7fc640fe2700 1 -- 172.21.15.49:0/3564718695 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62c00bab0 con 0x7fc63c158320 2023-11-30T17:22:30.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.334+0000 7fc640fe2700 1 -- 172.21.15.49:0/3564718695 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c00be30 con 0x7fc63c158320 2023-11-30T17:22:30.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.335+0000 7fc644248700 1 -- 172.21.15.49:0/3564718695 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc63c158320 msgr2=0x7fc63c1587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:30.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.335+0000 7fc644248700 1 --2- 172.21.15.49:0/3564718695 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc63c158320 0x7fc63c1587d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7fc62c009e60 tx=0x7fc62c009780).stop 2023-11-30T17:22:30.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.335+0000 7fc644248700 1 -- 172.21.15.49:0/3564718695 shutdown_connections 2023-11-30T17:22:30.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.335+0000 7fc644248700 1 --2- 172.21.15.49:0/3564718695 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc63c158320 0x7fc63c1587d0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:30.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.335+0000 7fc644248700 1 --2- 172.21.15.49:0/3564718695 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc63c098d10 0x7fc63c0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:30.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.335+0000 7fc644248700 1 -- 172.21.15.49:0/3564718695 >> 172.21.15.49:0/3564718695 conn(0x7fc63c0cb310 msgr2=0x7fc63c0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:30.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.335+0000 7fc644248700 1 -- 172.21.15.49:0/3564718695 shutdown_connections 2023-11-30T17:22:30.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.335+0000 7fc644248700 1 -- 172.21.15.49:0/3564718695 wait complete. 2023-11-30T17:22:30.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.336+0000 7fc644248700 1 Processor -- start 2023-11-30T17:22:30.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.336+0000 7fc644248700 1 -- start start 2023-11-30T17:22:30.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.337+0000 7fc644248700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc63c098d10 0x7fc63c0c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:30.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.337+0000 7fc644248700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc63c0c6190 0x7fc63c0c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:30.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.337+0000 7fc644248700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc63c158320 0x7fc63c150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:30.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.337+0000 7fc644248700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c0c2dc0 con 0x7fc63c158320 2023-11-30T17:22:30.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.337+0000 7fc644248700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c0c3f70 con 0x7fc63c0c6190 2023-11-30T17:22:30.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.337+0000 7fc644248700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c154fc0 con 0x7fc63c098d10 2023-11-30T17:22:30.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.337+0000 7fc6427e5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc63c158320 0x7fc63c150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:30.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.337+0000 7fc6427e5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc63c158320 0x7fc63c150580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53862/0 (socket says 172.21.15.49:53862) 2023-11-30T17:22:30.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.337+0000 7fc6427e5700 1 -- 172.21.15.49:0/1628812319 learned_addr learned my addr 172.21.15.49:0/1628812319 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:30.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.337+0000 7fc641fe4700 1 --2- 172.21.15.49:0/1628812319 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc63c098d10 0x7fc63c0c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:30.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.337+0000 7fc6417e3700 1 --2- 172.21.15.49:0/1628812319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc63c0c6190 0x7fc63c0c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:30.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.337+0000 7fc6427e5700 1 -- 172.21.15.49:0/1628812319 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc63c098d10 msgr2=0x7fc63c0c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:30.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.337+0000 7fc6427e5700 1 --2- 172.21.15.49:0/1628812319 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc63c098d10 0x7fc63c0c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:30.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.337+0000 7fc6427e5700 1 -- 172.21.15.49:0/1628812319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc63c0c6190 msgr2=0x7fc63c0c3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:30.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.337+0000 7fc6427e5700 1 --2- 172.21.15.49:0/1628812319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc63c0c6190 0x7fc63c0c3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:30.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.337+0000 7fc6427e5700 1 -- 172.21.15.49:0/1628812319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62c009a20 con 0x7fc63c158320 2023-11-30T17:22:30.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.337+0000 7fc6417e3700 1 --2- 172.21.15.49:0/1628812319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc63c0c6190 0x7fc63c0c3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:30.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.337+0000 7fc6427e5700 1 --2- 172.21.15.49:0/1628812319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc63c158320 0x7fc63c150580 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7fc63c0c2360 tx=0x7fc63c0a8040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:30.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.337+0000 7fc639ffb700 1 -- 172.21.15.49:0/1628812319 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c01d630 con 0x7fc63c158320 2023-11-30T17:22:30.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.338+0000 7fc639ffb700 1 -- 172.21.15.49:0/1628812319 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62c01d790 con 0x7fc63c158320 2023-11-30T17:22:30.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.338+0000 7fc644248700 1 -- 172.21.15.49:0/1628812319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc63c0c5000 con 0x7fc63c158320 2023-11-30T17:22:30.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.338+0000 7fc639ffb700 1 -- 172.21.15.49:0/1628812319 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c01db50 con 0x7fc63c158320 2023-11-30T17:22:30.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.338+0000 7fc644248700 1 -- 172.21.15.49:0/1628812319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc63c0c3300 con 0x7fc63c158320 2023-11-30T17:22:30.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.339+0000 7fc644248700 1 -- 172.21.15.49:0/1628812319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc63c06c860 con 0x7fc63c158320 2023-11-30T17:22:30.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.339+0000 7fc639ffb700 1 -- 172.21.15.49:0/1628812319 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc62c003040 con 0x7fc63c158320 2023-11-30T17:22:30.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.339+0000 7fc639ffb700 1 --2- 172.21.15.49:0/1628812319 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc62805f270 0x7fc628061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:30.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.339+0000 7fc639ffb700 1 -- 172.21.15.49:0/1628812319 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fc62c07c240 con 0x7fc63c158320 2023-11-30T17:22:30.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.340+0000 7fc641fe4700 1 --2- 172.21.15.49:0/1628812319 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc62805f270 0x7fc628061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:30.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.340+0000 7fc641fe4700 1 --2- 172.21.15.49:0/1628812319 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc62805f270 0x7fc628061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fc634009c30 tx=0x7fc634009060).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:30.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.344+0000 7fc639ffb700 1 -- 172.21.15.49:0/1628812319 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc62c04d370 con 0x7fc63c158320 2023-11-30T17:22:30.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.582+0000 7fc644248700 1 -- 172.21.15.49:0/1628812319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc63c0c66c0 con 0x7fc63c158320 2023-11-30T17:22:30.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.586+0000 7fc639ffb700 1 -- 172.21.15.49:0/1628812319 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7fc62c050990 con 0x7fc63c158320 2023-11-30T17:22:30.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.588+0000 7fc644248700 1 -- 172.21.15.49:0/1628812319 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc62805f270 msgr2=0x7fc628061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:30.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.588+0000 7fc644248700 1 --2- 172.21.15.49:0/1628812319 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc62805f270 0x7fc628061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fc634009c30 tx=0x7fc634009060).stop 2023-11-30T17:22:30.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.588+0000 7fc644248700 1 -- 172.21.15.49:0/1628812319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc63c158320 msgr2=0x7fc63c150580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:30.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.588+0000 7fc644248700 1 --2- 172.21.15.49:0/1628812319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc63c158320 0x7fc63c150580 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7fc63c0c2360 tx=0x7fc63c0a8040).stop 2023-11-30T17:22:30.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.588+0000 7fc644248700 1 -- 172.21.15.49:0/1628812319 shutdown_connections 2023-11-30T17:22:30.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.588+0000 7fc644248700 1 --2- 172.21.15.49:0/1628812319 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc62805f270 0x7fc628061730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:30.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.588+0000 7fc644248700 1 --2- 172.21.15.49:0/1628812319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc63c158320 0x7fc63c150580 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:30.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.588+0000 7fc644248700 1 --2- 172.21.15.49:0/1628812319 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc63c098d10 0x7fc63c0c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:30.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.588+0000 7fc644248700 1 --2- 172.21.15.49:0/1628812319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc63c0c6190 0x7fc63c0c3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:30.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.588+0000 7fc644248700 1 -- 172.21.15.49:0/1628812319 >> 172.21.15.49:0/1628812319 conn(0x7fc63c0cb310 msgr2=0x7fc63c0ca030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:30.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.588+0000 7fc644248700 1 -- 172.21.15.49:0/1628812319 shutdown_connections 2023-11-30T17:22:30.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.588+0000 7fc644248700 1 -- 172.21.15.49:0/1628812319 wait complete. 2023-11-30T17:22:30.591 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2023-11-30T17:22:30.602 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:22:30.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.718+0000 7f4c1b7f0700 1 Processor -- start 2023-11-30T17:22:30.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.718+0000 7f4c1b7f0700 1 -- start start 2023-11-30T17:22:30.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.719+0000 7f4c1b7f0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c140cae90 0x7f4c140c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:30.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.719+0000 7f4c1b7f0700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4c140ca180 0x7f4c140c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:30.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.719+0000 7f4c1b7f0700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c140a9a90 con 0x7f4c140caab0 2023-11-30T17:22:30.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.719+0000 7f4c1b7f0700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c140c1490 con 0x7f4c140ca180 2023-11-30T17:22:30.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.719+0000 7f4c1b7f0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c14154ce0 con 0x7f4c140cae90 2023-11-30T17:22:30.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.719+0000 7f4c19d8d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4c140ca180 0x7f4c140c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:30.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.719+0000 7f4c1958c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4c140caab0 0x7f4c140aa470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43178/0 (socket says 172.21.15.49:43178) 2023-11-30T17:22:30.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.719+0000 7f4c19d8d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4c140ca180 0x7f4c140c0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44656/0 (socket says 172.21.15.49:44656) 2023-11-30T17:22:30.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.719+0000 7f4c1958c700 1 -- 172.21.15.49:0/1312544561 learned_addr learned my addr 172.21.15.49:0/1312544561 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:30.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.719+0000 7f4c18d8b700 1 --2- 172.21.15.49:0/1312544561 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c140cae90 0x7f4c140c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:30.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.719+0000 7f4c19d8d700 1 -- 172.21.15.49:0/1312544561 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c140cae90 msgr2=0x7f4c140c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:30.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.719+0000 7f4c19d8d700 1 --2- 172.21.15.49:0/1312544561 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c140cae90 0x7f4c140c0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:30.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.719+0000 7f4c19d8d700 1 -- 172.21.15.49:0/1312544561 >> v1:172.21.15.49:6789/0 conn(0x7f4c140caab0 legacy=0x7f4c140aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:30.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.719+0000 7f4c13fff700 1 -- 172.21.15.49:0/1312544561 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 58923199 0 0) 0x7f4c140a9a90 con 0x7f4c140caab0 2023-11-30T17:22:30.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.719+0000 7f4c19d8d700 1 -- 172.21.15.49:0/1312544561 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c140aab80 con 0x7f4c140ca180 2023-11-30T17:22:30.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.719+0000 7f4c19d8d700 1 --2- 172.21.15.49:0/1312544561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c140ca180 0x7f4c140c0fa0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f4c04009e60 tx=0x7f4c04009780).ready entity=mon.0 client_cookie=e2a3368608180f58 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:30.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.719+0000 7f4c13fff700 1 -- 172.21.15.49:0/1312544561 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0400e070 con 0x7f4c140ca180 2023-11-30T17:22:30.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.719+0000 7f4c13fff700 1 -- 172.21.15.49:0/1312544561 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0400bc30 con 0x7f4c140ca180 2023-11-30T17:22:30.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.719+0000 7f4c13fff700 1 -- 172.21.15.49:0/1312544561 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c04012410 con 0x7f4c140ca180 2023-11-30T17:22:30.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.720+0000 7f4c1b7f0700 1 -- 172.21.15.49:0/1312544561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c140ca180 msgr2=0x7f4c140c0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:30.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.720+0000 7f4c1b7f0700 1 --2- 172.21.15.49:0/1312544561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c140ca180 0x7f4c140c0fa0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f4c04009e60 tx=0x7f4c04009780).stop 2023-11-30T17:22:30.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.720+0000 7f4c1b7f0700 1 -- 172.21.15.49:0/1312544561 shutdown_connections 2023-11-30T17:22:30.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.720+0000 7f4c1b7f0700 1 --2- 172.21.15.49:0/1312544561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c140ca180 0x7f4c140c0fa0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:30.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.720+0000 7f4c1b7f0700 1 --2- 172.21.15.49:0/1312544561 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c140cae90 0x7f4c140c0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:30.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.720+0000 7f4c1b7f0700 1 -- 172.21.15.49:0/1312544561 >> 172.21.15.49:0/1312544561 conn(0x7f4c14094920 msgr2=0x7f4c1406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:30.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.720+0000 7f4c1b7f0700 1 -- 172.21.15.49:0/1312544561 shutdown_connections 2023-11-30T17:22:30.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.720+0000 7f4c1b7f0700 1 -- 172.21.15.49:0/1312544561 wait complete. 2023-11-30T17:22:30.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.721+0000 7f4c1b7f0700 1 Processor -- start 2023-11-30T17:22:30.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.721+0000 7f4c1b7f0700 1 -- start start 2023-11-30T17:22:30.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.722+0000 7f4c1b7f0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c140ca180 0x7f4c140ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:30.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.722+0000 7f4c1b7f0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c140caab0 0x7f4c140aad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:30.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.722+0000 7f4c1b7f0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c140cae90 0x7f4c141646a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:30.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.722+0000 7f4c1b7f0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1413fde0 con 0x7f4c140ca180 2023-11-30T17:22:30.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.722+0000 7f4c1b7f0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c140ac070 con 0x7f4c140caab0 2023-11-30T17:22:30.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.722+0000 7f4c1b7f0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c140ab200 con 0x7f4c140cae90 2023-11-30T17:22:30.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.722+0000 7f4c1958c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c140ca180 0x7f4c140ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:30.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.722+0000 7f4c1958c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c140ca180 0x7f4c140ad7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44662/0 (socket says 172.21.15.49:44662) 2023-11-30T17:22:30.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.722+0000 7f4c1958c700 1 -- 172.21.15.49:0/1380676245 learned_addr learned my addr 172.21.15.49:0/1380676245 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:30.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.722+0000 7f4c18d8b700 1 --2- 172.21.15.49:0/1380676245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c140caab0 0x7f4c140aad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:30.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.722+0000 7f4c19d8d700 1 --2- 172.21.15.49:0/1380676245 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c140cae90 0x7f4c141646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:30.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.723+0000 7f4c1958c700 1 -- 172.21.15.49:0/1380676245 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c140cae90 msgr2=0x7f4c141646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:30.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.723+0000 7f4c1958c700 1 --2- 172.21.15.49:0/1380676245 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c140cae90 0x7f4c141646a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:30.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.723+0000 7f4c1958c700 1 -- 172.21.15.49:0/1380676245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c140caab0 msgr2=0x7f4c140aad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:30.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.723+0000 7f4c1958c700 1 --2- 172.21.15.49:0/1380676245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c140caab0 0x7f4c140aad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:30.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.723+0000 7f4c1958c700 1 -- 172.21.15.49:0/1380676245 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c04009a20 con 0x7f4c140ca180 2023-11-30T17:22:30.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.723+0000 7f4c1958c700 1 --2- 172.21.15.49:0/1380676245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c140ca180 0x7f4c140ad7c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f4c0c001360 tx=0x7f4c0c007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:30.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.723+0000 7f4c117fa700 1 -- 172.21.15.49:0/1380676245 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c0072e0 con 0x7f4c140ca180 2023-11-30T17:22:30.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.723+0000 7f4c117fa700 1 -- 172.21.15.49:0/1380676245 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0c007440 con 0x7f4c140ca180 2023-11-30T17:22:30.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.723+0000 7f4c1b7f0700 1 -- 172.21.15.49:0/1380676245 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c140ab460 con 0x7f4c140ca180 2023-11-30T17:22:30.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.723+0000 7f4c117fa700 1 -- 172.21.15.49:0/1380676245 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c0058a0 con 0x7f4c140ca180 2023-11-30T17:22:30.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.723+0000 7f4c1b7f0700 1 -- 172.21.15.49:0/1380676245 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c140aba20 con 0x7f4c140ca180 2023-11-30T17:22:30.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.724+0000 7f4c1b7f0700 1 -- 172.21.15.49:0/1380676245 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1406c860 con 0x7f4c140ca180 2023-11-30T17:22:30.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.725+0000 7f4c117fa700 1 -- 172.21.15.49:0/1380676245 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4c0c005c90 con 0x7f4c140ca180 2023-11-30T17:22:30.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.725+0000 7f4c117fa700 1 --2- 172.21.15.49:0/1380676245 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4c0005f270 0x7f4c00061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:30.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.725+0000 7f4c117fa700 1 -- 172.21.15.49:0/1380676245 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f4c0c07a180 con 0x7f4c140ca180 2023-11-30T17:22:30.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.725+0000 7f4c18d8b700 1 --2- 172.21.15.49:0/1380676245 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4c0005f270 0x7f4c00061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:30.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.726+0000 7f4c18d8b700 1 --2- 172.21.15.49:0/1380676245 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4c0005f270 0x7f4c00061730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f4c14167c20 tx=0x7f4c08008040).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:30.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.729+0000 7f4c117fa700 1 -- 172.21.15.49:0/1380676245 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4c0c04b270 con 0x7f4c140ca180 2023-11-30T17:22:30.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.948+0000 7f4c1b7f0700 1 -- 172.21.15.49:0/1380676245 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c140a8e80 con 0x7f4c140ca180 2023-11-30T17:22:30.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.948+0000 7f4c117fa700 1 -- 172.21.15.49:0/1380676245 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f4c0c018070 con 0x7f4c140ca180 2023-11-30T17:22:30.951 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:30.951 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/3245104889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3245104889},{"type":"v1","addr":"172.21.15.115:6836","nonce":3245104889}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5579,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1933850814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1933850814},{"type":"v1","addr":"172.21.15.115:6837","nonce":1933850814}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6225,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1356528561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1356528561},{"type":"v1","addr":"172.21.15.49:6834","nonce":1356528561}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:22:21.305720+0000","modified":"2023-11-30T17:22:24.320718+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6228},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6228":{"gid":6228,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1786065897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1786065897},{"type":"v1","addr":"172.21.15.49:6835","nonce":1786065897}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-11-30T17:22:30.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.950+0000 7f4c1b7f0700 1 -- 172.21.15.49:0/1380676245 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4c0005f270 msgr2=0x7f4c00061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:30.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.950+0000 7f4c1b7f0700 1 --2- 172.21.15.49:0/1380676245 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4c0005f270 0x7f4c00061730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f4c14167c20 tx=0x7f4c08008040).stop 2023-11-30T17:22:30.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.950+0000 7f4c1b7f0700 1 -- 172.21.15.49:0/1380676245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c140ca180 msgr2=0x7f4c140ad7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:30.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.950+0000 7f4c1b7f0700 1 --2- 172.21.15.49:0/1380676245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c140ca180 0x7f4c140ad7c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f4c0c001360 tx=0x7f4c0c007b00).stop 2023-11-30T17:22:30.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.950+0000 7f4c1b7f0700 1 -- 172.21.15.49:0/1380676245 shutdown_connections 2023-11-30T17:22:30.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.950+0000 7f4c1b7f0700 1 --2- 172.21.15.49:0/1380676245 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c140cae90 0x7f4c141646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:30.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.950+0000 7f4c1b7f0700 1 --2- 172.21.15.49:0/1380676245 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4c0005f270 0x7f4c00061730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:30.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.950+0000 7f4c1b7f0700 1 --2- 172.21.15.49:0/1380676245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c140ca180 0x7f4c140ad7c0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:30.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.950+0000 7f4c1b7f0700 1 --2- 172.21.15.49:0/1380676245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c140caab0 0x7f4c140aad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:30.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.950+0000 7f4c1b7f0700 1 -- 172.21.15.49:0/1380676245 >> 172.21.15.49:0/1380676245 conn(0x7f4c14094920 msgr2=0x7f4c14153f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:30.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.950+0000 7f4c1b7f0700 1 -- 172.21.15.49:0/1380676245 shutdown_connections 2023-11-30T17:22:30.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:30.950+0000 7f4c1b7f0700 1 -- 172.21.15.49:0/1380676245 wait complete. 2023-11-30T17:22:30.954 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 32 2023-11-30T17:22:31.368 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-30T17:22:21.305720+0000', 'modified': '2023-11-30T17:22:24.320718+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6228}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6228': {'gid': 6228, 'name': 'c', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6835/1786065897', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6832', 'nonce': 1786065897}, {'type': 'v1', 'addr': '172.21.15.49:6835', 'nonce': 1786065897}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-11-30T17:22:31.368 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-30T17:22:31.368 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-30T17:22:31.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.489+0000 7f89eeb2d700 1 Processor -- start 2023-11-30T17:22:31.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.489+0000 7f89eeb2d700 1 -- start start 2023-11-30T17:22:31.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.490+0000 7f89eeb2d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89e80c86f0 0x7f89e80a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:31.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.490+0000 7f89eeb2d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f89e8062700 0x7f89e8062b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:31.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.490+0000 7f89eeb2d700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e80c7e30 con 0x7f89e81547f0 2023-11-30T17:22:31.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.490+0000 7f89eeb2d700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e80bcf40 con 0x7f89e8062700 2023-11-30T17:22:31.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.490+0000 7f89eeb2d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e80c6b20 con 0x7f89e80c86f0 2023-11-30T17:22:31.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.490+0000 7f89ed0ca700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f89e8062700 0x7f89e8062b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:31.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.490+0000 7f89ed0ca700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f89e8062700 0x7f89e8062b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44670/0 (socket says 172.21.15.49:44670) 2023-11-30T17:22:31.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.490+0000 7f89ed0ca700 1 -- 172.21.15.49:0/4282893652 learned_addr learned my addr 172.21.15.49:0/4282893652 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:31.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.491+0000 7f89e7fff700 1 --2- 172.21.15.49:0/4282893652 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89e80c86f0 0x7f89e80a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:31.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.491+0000 7f89ed0ca700 1 -- 172.21.15.49:0/4282893652 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89e80c86f0 msgr2=0x7f89e80a72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:31.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.491+0000 7f89ed0ca700 1 --2- 172.21.15.49:0/4282893652 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89e80c86f0 0x7f89e80a72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.491+0000 7f89ed0ca700 1 -- 172.21.15.49:0/4282893652 >> v1:172.21.15.115:6789/0 conn(0x7f89e81547f0 legacy=0x7f89e80c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:31.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.491+0000 7f89ed0ca700 1 -- 172.21.15.49:0/4282893652 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e80a77d0 con 0x7f89e8062700 2023-11-30T17:22:31.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.491+0000 7f89ed0ca700 1 --2- 172.21.15.49:0/4282893652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89e8062700 0x7f89e8062b90 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f89d8006fd0 tx=0x7f89d80090f0).ready entity=mon.0 client_cookie=1e37158aebf2bbd3 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:31.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.491+0000 7f89e77fe700 1 -- 172.21.15.49:0/4282893652 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d800b580 con 0x7f89e8062700 2023-11-30T17:22:31.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.491+0000 7f89e77fe700 1 -- 172.21.15.49:0/4282893652 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d800b6e0 con 0x7f89e8062700 2023-11-30T17:22:31.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.491+0000 7f89e77fe700 1 -- 172.21.15.49:0/4282893652 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d800ba80 con 0x7f89e8062700 2023-11-30T17:22:31.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.492+0000 7f89eeb2d700 1 -- 172.21.15.49:0/4282893652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89e8062700 msgr2=0x7f89e8062b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:31.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.492+0000 7f89eeb2d700 1 --2- 172.21.15.49:0/4282893652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89e8062700 0x7f89e8062b90 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f89d8006fd0 tx=0x7f89d80090f0).stop 2023-11-30T17:22:31.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.492+0000 7f89eeb2d700 1 -- 172.21.15.49:0/4282893652 shutdown_connections 2023-11-30T17:22:31.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.492+0000 7f89eeb2d700 1 --2- 172.21.15.49:0/4282893652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89e8062700 0x7f89e8062b90 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.492+0000 7f89eeb2d700 1 --2- 172.21.15.49:0/4282893652 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89e80c86f0 0x7f89e80a72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.492+0000 7f89eeb2d700 1 -- 172.21.15.49:0/4282893652 >> 172.21.15.49:0/4282893652 conn(0x7f89e80642d0 msgr2=0x7f89e80c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:31.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.492+0000 7f89eeb2d700 1 -- 172.21.15.49:0/4282893652 shutdown_connections 2023-11-30T17:22:31.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.492+0000 7f89eeb2d700 1 -- 172.21.15.49:0/4282893652 wait complete. 2023-11-30T17:22:31.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.493+0000 7f89eeb2d700 1 Processor -- start 2023-11-30T17:22:31.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.493+0000 7f89eeb2d700 1 -- start start 2023-11-30T17:22:31.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.494+0000 7f89eeb2d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89e8062700 0x7f89e8154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:31.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.494+0000 7f89eeb2d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89e80c86f0 0x7f89e8142d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:31.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.494+0000 7f89eeb2d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89e81547f0 0x7f89e81565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:31.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.494+0000 7f89eeb2d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e8156120 con 0x7f89e80c86f0 2023-11-30T17:22:31.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.494+0000 7f89eeb2d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e8143200 con 0x7f89e81547f0 2023-11-30T17:22:31.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.494+0000 7f89eeb2d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e8155510 con 0x7f89e8062700 2023-11-30T17:22:31.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.494+0000 7f89e7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89e80c86f0 0x7f89e8142d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:31.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.494+0000 7f89e7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89e80c86f0 0x7f89e8142d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44676/0 (socket says 172.21.15.49:44676) 2023-11-30T17:22:31.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.494+0000 7f89e7fff700 1 -- 172.21.15.49:0/246204507 learned_addr learned my addr 172.21.15.49:0/246204507 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:31.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.494+0000 7f89ed0ca700 1 --2- 172.21.15.49:0/246204507 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89e81547f0 0x7f89e81565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:31.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.494+0000 7f89ec8c9700 1 --2- 172.21.15.49:0/246204507 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89e8062700 0x7f89e8154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:31.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.494+0000 7f89e7fff700 1 -- 172.21.15.49:0/246204507 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89e8062700 msgr2=0x7f89e8154f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:31.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.494+0000 7f89e7fff700 1 --2- 172.21.15.49:0/246204507 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89e8062700 0x7f89e8154f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.494+0000 7f89e7fff700 1 -- 172.21.15.49:0/246204507 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89e81547f0 msgr2=0x7f89e81565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:31.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.494+0000 7f89e7fff700 1 --2- 172.21.15.49:0/246204507 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89e81547f0 0x7f89e81565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.494+0000 7f89e7fff700 1 -- 172.21.15.49:0/246204507 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d8009370 con 0x7f89e80c86f0 2023-11-30T17:22:31.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.494+0000 7f89e7fff700 1 --2- 172.21.15.49:0/246204507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89e80c86f0 0x7f89e8142d10 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f89d000e980 tx=0x7f89d0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:31.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.494+0000 7f89e4ff9700 1 -- 172.21.15.49:0/246204507 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d0012600 con 0x7f89e80c86f0 2023-11-30T17:22:31.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.494+0000 7f89e4ff9700 1 -- 172.21.15.49:0/246204507 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d0012760 con 0x7f89e80c86f0 2023-11-30T17:22:31.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.494+0000 7f89e4ff9700 1 -- 172.21.15.49:0/246204507 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d0012ae0 con 0x7f89e80c86f0 2023-11-30T17:22:31.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.494+0000 7f89eeb2d700 1 -- 172.21.15.49:0/246204507 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e81557f0 con 0x7f89e80c86f0 2023-11-30T17:22:31.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.494+0000 7f89eeb2d700 1 -- 172.21.15.49:0/246204507 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e8155db0 con 0x7f89e80c86f0 2023-11-30T17:22:31.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.496+0000 7f89e4ff9700 1 -- 172.21.15.49:0/246204507 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f89d001b400 con 0x7f89e80c86f0 2023-11-30T17:22:31.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.496+0000 7f89e4ff9700 1 --2- 172.21.15.49:0/246204507 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f89c805f270 0x7f89c8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:31.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.496+0000 7f89e4ff9700 1 -- 172.21.15.49:0/246204507 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f89d007a8a0 con 0x7f89e80c86f0 2023-11-30T17:22:31.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.496+0000 7f89ec8c9700 1 --2- 172.21.15.49:0/246204507 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f89c805f270 0x7f89c8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:31.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.497+0000 7f89ec8c9700 1 --2- 172.21.15.49:0/246204507 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f89c805f270 0x7f89c8061730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f89e0004290 tx=0x7f89e00014c0).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:31.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.498+0000 7f8a004c5b80 1 Processor -- start 2023-11-30T17:22:31.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.498+0000 7f8a004c5b80 1 -- start start 2023-11-30T17:22:31.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.499+0000 7f8a004c5b80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563aef64ee40 0x563aef8bad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:31.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.499+0000 7f8a004c5b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563aef8dbea0 0x563aef8927c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:31.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.499+0000 7f8a004c5b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563aef892cb0 0x563aef88d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:31.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.499+0000 7f8a004c5b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x563aef858060 con 0x563aef892cb0 2023-11-30T17:22:31.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.499+0000 7f8a004c5b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x563aef7cf1f0 con 0x563aef8dbea0 2023-11-30T17:22:31.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.499+0000 7f8a004c5b80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x563aef7e4440 con 0x563aef64ee40 2023-11-30T17:22:31.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.499+0000 7f89ed0ca700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563aef892cb0 0x563aef88d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:31.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.499+0000 7f89ed0ca700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563aef892cb0 0x563aef88d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44690/0 (socket says 172.21.15.49:44690) 2023-11-30T17:22:31.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.499+0000 7f89ed0ca700 1 -- 172.21.15.49:0/2631780422 learned_addr learned my addr 172.21.15.49:0/2631780422 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:31.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.499+0000 7f89ec8c9700 1 --2- 172.21.15.49:0/2631780422 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563aef64ee40 0x563aef8bad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:31.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.499+0000 7f89e7fff700 1 --2- 172.21.15.49:0/2631780422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563aef8dbea0 0x563aef8927c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:31.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.499+0000 7f89ed0ca700 1 -- 172.21.15.49:0/2631780422 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563aef64ee40 msgr2=0x563aef8bad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:31.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.499+0000 7f89ed0ca700 1 --2- 172.21.15.49:0/2631780422 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563aef64ee40 0x563aef8bad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.499+0000 7f89ed0ca700 1 -- 172.21.15.49:0/2631780422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563aef8dbea0 msgr2=0x563aef8927c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:31.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.499+0000 7f89ed0ca700 1 --2- 172.21.15.49:0/2631780422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563aef8dbea0 0x563aef8927c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.499+0000 7f89ed0ca700 1 -- 172.21.15.49:0/2631780422 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563aef7dd620 con 0x563aef892cb0 2023-11-30T17:22:31.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.499+0000 7f89ed0ca700 1 --2- 172.21.15.49:0/2631780422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563aef892cb0 0x563aef88d600 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7f89e80695b0 tx=0x7f89d8017000).ready entity=mon.0 client_cookie=d56cad814e36d758 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:31.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.500+0000 7f89ddffb700 1 -- 172.21.15.49:0/2631780422 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d800b580 con 0x563aef892cb0 2023-11-30T17:22:31.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.500+0000 7f89ddffb700 1 -- 172.21.15.49:0/2631780422 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d800be40 con 0x563aef892cb0 2023-11-30T17:22:31.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.500+0000 7f89ddffb700 1 -- 172.21.15.49:0/2631780422 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d800ba80 con 0x563aef892cb0 2023-11-30T17:22:31.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.500+0000 7f8a004c5b80 1 -- 172.21.15.49:0/2631780422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563aef892cb0 msgr2=0x563aef88d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:31.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.500+0000 7f8a004c5b80 1 --2- 172.21.15.49:0/2631780422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563aef892cb0 0x563aef88d600 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7f89e80695b0 tx=0x7f89d8017000).stop 2023-11-30T17:22:31.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.500+0000 7f8a004c5b80 1 -- 172.21.15.49:0/2631780422 shutdown_connections 2023-11-30T17:22:31.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.500+0000 7f8a004c5b80 1 --2- 172.21.15.49:0/2631780422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563aef892cb0 0x563aef88d600 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.500+0000 7f8a004c5b80 1 --2- 172.21.15.49:0/2631780422 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563aef64ee40 0x563aef8bad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.500+0000 7f8a004c5b80 1 --2- 172.21.15.49:0/2631780422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563aef8dbea0 0x563aef8927c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.500+0000 7f8a004c5b80 1 -- 172.21.15.49:0/2631780422 >> 172.21.15.49:0/2631780422 conn(0x563aef6fc4a0 msgr2=0x563aef8db790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:31.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.500+0000 7f8a004c5b80 1 -- 172.21.15.49:0/2631780422 shutdown_connections 2023-11-30T17:22:31.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.500+0000 7f8a004c5b80 1 -- 172.21.15.49:0/2631780422 wait complete. 2023-11-30T17:22:31.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.501+0000 7f8a004c5b80 1 -- start start 2023-11-30T17:22:31.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.501+0000 7f8a004c5b80 1 Processor -- start 2023-11-30T17:22:31.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.502+0000 7f8a004c5b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563aef64ee40 0x563aef8ba5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:31.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.502+0000 7f8a004c5b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563aef892cb0 0x563aef8c0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:31.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.502+0000 7f8a004c5b80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563aef8dbea0 0x563aef8d7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:31.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.502+0000 7f8a004c5b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x563aef7e4580 con 0x563aef892cb0 2023-11-30T17:22:31.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.502+0000 7f8a004c5b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x563aef7e4800 con 0x563aef64ee40 2023-11-30T17:22:31.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.502+0000 7f8a004c5b80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x563aef7afe10 con 0x563aef8dbea0 2023-11-30T17:22:31.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.502+0000 7f8a004c5b80 10 client.0 ll_register_callbacks cb 0x563aef852460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-30T17:22:31.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.502+0000 7f89e7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563aef892cb0 0x563aef8c0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:31.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.502+0000 7f89e7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563aef892cb0 0x563aef8c0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44704/0 (socket says 172.21.15.49:44704) 2023-11-30T17:22:31.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.502+0000 7f89e7fff700 1 -- 172.21.15.49:0/2530291039 learned_addr learned my addr 172.21.15.49:0/2530291039 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:31.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.502+0000 7f89ed0ca700 1 --2- 172.21.15.49:0/2530291039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563aef8dbea0 0x563aef8d7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:31.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.502+0000 7f89ec8c9700 1 --2- 172.21.15.49:0/2530291039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563aef64ee40 0x563aef8ba5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:31.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.502+0000 7f89e7fff700 1 -- 172.21.15.49:0/2530291039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563aef8dbea0 msgr2=0x563aef8d7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:31.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.502+0000 7f89e7fff700 1 --2- 172.21.15.49:0/2530291039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563aef8dbea0 0x563aef8d7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.502+0000 7f89e7fff700 1 -- 172.21.15.49:0/2530291039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563aef64ee40 msgr2=0x563aef8ba5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:31.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.502+0000 7f89e7fff700 1 --2- 172.21.15.49:0/2530291039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563aef64ee40 0x563aef8ba5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.502+0000 7f89e7fff700 1 -- 172.21.15.49:0/2530291039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e80a77d0 con 0x563aef892cb0 2023-11-30T17:22:31.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.502+0000 7f89ec8c9700 1 --2- 172.21.15.49:0/2530291039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563aef64ee40 0x563aef8ba5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:22:31.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.502+0000 7f89e7fff700 1 --2- 172.21.15.49:0/2530291039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563aef892cb0 0x563aef8c0940 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f89d004f330 tx=0x7f89d001d040).ready entity=mon.0 client_cookie=484e695e86972195 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:31.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.502+0000 7f89c6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-30T17:22:31.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.502+0000 7f89c6ffd700 1 -- 172.21.15.49:0/2530291039 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d0054070 con 0x563aef892cb0 2023-11-30T17:22:31.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.503+0000 7f89c6ffd700 1 -- 172.21.15.49:0/2530291039 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f89d004bd40 con 0x563aef892cb0 2023-11-30T17:22:31.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.503+0000 7f8a004c5b80 1 -- 172.21.15.49:0/2530291039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563aef886720 con 0x563aef892cb0 2023-11-30T17:22:31.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.503+0000 7f89c6ffd700 1 -- 172.21.15.49:0/2530291039 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89d0019e90 con 0x563aef892cb0 2023-11-30T17:22:31.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.503+0000 7f8a004c5b80 10 client.6408 fetch_fsmap learned FSMap version 32 2023-11-30T17:22:31.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.503+0000 7f8a004c5b80 1 -- 172.21.15.49:0/2530291039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x563aef7d89c0 con 0x563aef892cb0 2023-11-30T17:22:31.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.503+0000 7f89c6ffd700 1 -- 172.21.15.49:0/2530291039 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563aef886720 con 0x563aef892cb0 2023-11-30T17:22:31.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.503+0000 7f89c6ffd700 1 -- 172.21.15.49:0/2530291039 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 32) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f89d004b420 con 0x563aef892cb0 2023-11-30T17:22:31.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.503+0000 7f8a004c5b80 10 client.6408 fetch_fsmap finished waiting for FSMap version 32 2023-11-30T17:22:31.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.503+0000 7f8a004c5b80 10 client.6408 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-30T17:22:31.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.503+0000 7f8a004c5b80 20 client.6408 populate_metadata read hostname 'smithi049' 2023-11-30T17:22:31.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.503+0000 7f8a004c5b80 1 --2- 172.21.15.49:0/2530291039 >> [v2:172.21.15.49:6832/1786065897,v1:172.21.15.49:6835/1786065897] conn(0x563aef8d2db0 0x563aef8d3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:31.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.503+0000 7f8a004c5b80 4 client.6408 mds_command: new command op to 6228 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-30T17:22:31.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.503+0000 7f8a004c5b80 1 -- 172.21.15.49:0/2530291039 --> [v2:172.21.15.49:6832/1786065897,v1:172.21.15.49:6835/1786065897] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563aef64aca0 con 0x563aef8d2db0 2023-11-30T17:22:31.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.503+0000 7f89ec8c9700 1 --2- 172.21.15.49:0/2530291039 >> [v2:172.21.15.49:6832/1786065897,v1:172.21.15.49:6835/1786065897] conn(0x563aef8d2db0 0x563aef8d3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:31.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.503+0000 7f89ec8c9700 1 --2- 172.21.15.49:0/2530291039 >> [v2:172.21.15.49:6832/1786065897,v1:172.21.15.49:6835/1786065897] conn(0x563aef8d2db0 0x563aef8d3190 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=6604f0e984b6d0e3 server_cookie=280a5a85df512775 in_seq=0 out_seq=0 2023-11-30T17:22:31.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.503+0000 7f89c6ffd700 10 client.6408 ms_handle_connect on v2:172.21.15.49:6832/1786065897 2023-11-30T17:22:31.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.504+0000 7f89c6ffd700 1 -- 172.21.15.49:0/2530291039 <== mds.0 v2:172.21.15.49:6832/1786065897 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x563aef64aca0 con 0x563aef8d2db0 2023-11-30T17:22:31.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.504+0000 7f89c6ffd700 10 client.6408 handle_command_reply: tid=0 2023-11-30T17:22:31.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.504+0000 7f8a004c5b80 1 client.6408 shutdown 2023-11-30T17:22:31.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.504+0000 7f8a004c5b80 1 -- 172.21.15.49:0/2530291039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563aef892cb0 msgr2=0x563aef8c0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:31.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.504+0000 7f8a004c5b80 1 --2- 172.21.15.49:0/2530291039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563aef892cb0 0x563aef8c0940 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f89d004f330 tx=0x7f89d001d040).stop 2023-11-30T17:22:31.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.504+0000 7f8a004c5b80 1 -- 172.21.15.49:0/2530291039 shutdown_connections 2023-11-30T17:22:31.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.504+0000 7f8a004c5b80 1 --2- 172.21.15.49:0/2530291039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563aef8dbea0 0x563aef8d7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.504+0000 7f8a004c5b80 1 --2- 172.21.15.49:0/2530291039 >> [v2:172.21.15.49:6832/1786065897,v1:172.21.15.49:6835/1786065897] conn(0x563aef8d2db0 0x563aef8d3190 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.504+0000 7f8a004c5b80 1 --2- 172.21.15.49:0/2530291039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563aef64ee40 0x563aef8ba5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.504+0000 7f89c6ffd700 0 client.6408 ms_handle_reset on v2:172.21.15.49:6832/1786065897 2023-11-30T17:22:31.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.504+0000 7f8a004c5b80 1 --2- 172.21.15.49:0/2530291039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563aef892cb0 0x563aef8c0940 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.504+0000 7f8a004c5b80 1 -- 172.21.15.49:0/2530291039 >> 172.21.15.49:0/2530291039 conn(0x563aef6fc4a0 msgr2=0x563aef8930b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:31.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.504+0000 7f8a004c5b80 1 -- 172.21.15.49:0/2530291039 shutdown_connections 2023-11-30T17:22:31.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.504+0000 7f8a004c5b80 1 -- 172.21.15.49:0/2530291039 wait complete. 2023-11-30T17:22:31.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.504+0000 7f8a004c5b80 20 client.6408 trim_cache size 0 max 16384 2023-11-30T17:22:31.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.521+0000 7f8a004c5b80 1 Processor -- start 2023-11-30T17:22:31.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.521+0000 7f8a004c5b80 1 -- start start 2023-11-30T17:22:31.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.522+0000 7f8a004c5b80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563aef64ee40 0x563aef8c00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:31.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.522+0000 7f8a004c5b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563aef892cb0 0x563aef88f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:31.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.522+0000 7f8a004c5b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563aef8dbea0 0x563aef893ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:31.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.522+0000 7f8a004c5b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x563aef8bf6b0 con 0x563aef892cb0 2023-11-30T17:22:31.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.522+0000 7f8a004c5b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x563aef8ba380 con 0x563aef8dbea0 2023-11-30T17:22:31.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.522+0000 7f8a004c5b80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x563aef88fc40 con 0x563aef64ee40 2023-11-30T17:22:31.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.522+0000 7f89e7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563aef892cb0 0x563aef88f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:31.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.522+0000 7f89e7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563aef892cb0 0x563aef88f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44720/0 (socket says 172.21.15.49:44720) 2023-11-30T17:22:31.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.522+0000 7f89e7fff700 1 -- 172.21.15.49:0/3181632599 learned_addr learned my addr 172.21.15.49:0/3181632599 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:31.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.522+0000 7f89ed0ca700 1 --2- 172.21.15.49:0/3181632599 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563aef8dbea0 0x563aef893ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:31.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.522+0000 7f89ec8c9700 1 --2- 172.21.15.49:0/3181632599 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563aef64ee40 0x563aef8c00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:31.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.522+0000 7f89e7fff700 1 -- 172.21.15.49:0/3181632599 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563aef64ee40 msgr2=0x563aef8c00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:31.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.522+0000 7f89e7fff700 1 --2- 172.21.15.49:0/3181632599 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563aef64ee40 0x563aef8c00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.522+0000 7f89e7fff700 1 -- 172.21.15.49:0/3181632599 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563aef8dbea0 msgr2=0x563aef893ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:31.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.522+0000 7f89e7fff700 1 --2- 172.21.15.49:0/3181632599 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563aef8dbea0 0x563aef893ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.522+0000 7f89e7fff700 1 -- 172.21.15.49:0/3181632599 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563aef7d8710 con 0x563aef892cb0 2023-11-30T17:22:31.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.522+0000 7f89e7fff700 1 --2- 172.21.15.49:0/3181632599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563aef892cb0 0x563aef88f440 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f89d000f010 tx=0x7f89d0057000).ready entity=mon.0 client_cookie=5ee982f6ed85a85a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:31.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.522+0000 7f89de7fc700 1 -- 172.21.15.49:0/3181632599 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d0019e90 con 0x563aef892cb0 2023-11-30T17:22:31.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.522+0000 7f89de7fc700 1 -- 172.21.15.49:0/3181632599 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d0054d70 con 0x563aef892cb0 2023-11-30T17:22:31.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.522+0000 7f89de7fc700 1 -- 172.21.15.49:0/3181632599 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d004f3a0 con 0x563aef892cb0 2023-11-30T17:22:31.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.523+0000 7f8a004c5b80 1 -- 172.21.15.49:0/3181632599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563aef892cb0 msgr2=0x563aef88f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:31.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.523+0000 7f8a004c5b80 1 --2- 172.21.15.49:0/3181632599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563aef892cb0 0x563aef88f440 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f89d000f010 tx=0x7f89d0057000).stop 2023-11-30T17:22:31.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.523+0000 7f8a004c5b80 1 -- 172.21.15.49:0/3181632599 shutdown_connections 2023-11-30T17:22:31.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.523+0000 7f8a004c5b80 1 --2- 172.21.15.49:0/3181632599 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563aef8dbea0 0x563aef893ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.523+0000 7f8a004c5b80 1 --2- 172.21.15.49:0/3181632599 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563aef64ee40 0x563aef8c00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.523+0000 7f8a004c5b80 1 --2- 172.21.15.49:0/3181632599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563aef892cb0 0x563aef88f440 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.523+0000 7f8a004c5b80 1 -- 172.21.15.49:0/3181632599 >> 172.21.15.49:0/3181632599 conn(0x563aef6fc4a0 msgr2=0x563aef8b95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:31.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.523+0000 7f8a004c5b80 1 -- 172.21.15.49:0/3181632599 shutdown_connections 2023-11-30T17:22:31.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.523+0000 7f8a004c5b80 1 -- 172.21.15.49:0/3181632599 wait complete. 2023-11-30T17:22:31.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.523+0000 7f8a004c5b80 1 -- start start 2023-11-30T17:22:31.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.524+0000 7f8a004c5b80 1 Processor -- start 2023-11-30T17:22:31.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.524+0000 7f8a004c5b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563aef64ee40 0x563aef8da5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:31.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.524+0000 7f8a004c5b80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563aef892cb0 0x563aef8e91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:31.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.524+0000 7f8a004c5b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563aef8dbea0 0x563aef93c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:31.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.524+0000 7f8a004c5b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x563aef93d190 con 0x563aef64ee40 2023-11-30T17:22:31.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.524+0000 7f8a004c5b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x563aef933ce0 con 0x563aef8dbea0 2023-11-30T17:22:31.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.524+0000 7f8a004c5b80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x563aef8e8d40 con 0x563aef892cb0 2023-11-30T17:22:31.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.524+0000 7f8a004c5b80 10 client.0 ll_register_callbacks cb 0x563aef852460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-30T17:22:31.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.524+0000 7f89ec8c9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563aef64ee40 0x563aef8da5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:31.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.524+0000 7f89ec8c9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563aef64ee40 0x563aef8da5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44724/0 (socket says 172.21.15.49:44724) 2023-11-30T17:22:31.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.524+0000 7f89ec8c9700 1 -- 172.21.15.49:0/1159606850 learned_addr learned my addr 172.21.15.49:0/1159606850 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:31.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.524+0000 7f89e7fff700 1 --2- 172.21.15.49:0/1159606850 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563aef892cb0 0x563aef8e91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:31.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.525+0000 7f89ed0ca700 1 --2- 172.21.15.49:0/1159606850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563aef8dbea0 0x563aef93c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:31.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.525+0000 7f89ec8c9700 1 -- 172.21.15.49:0/1159606850 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563aef892cb0 msgr2=0x563aef8e91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:31.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.525+0000 7f89ec8c9700 1 --2- 172.21.15.49:0/1159606850 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563aef892cb0 0x563aef8e91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.525+0000 7f89ec8c9700 1 -- 172.21.15.49:0/1159606850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563aef8dbea0 msgr2=0x563aef93c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:31.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.525+0000 7f89ec8c9700 1 --2- 172.21.15.49:0/1159606850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563aef8dbea0 0x563aef93c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.525+0000 7f89ec8c9700 1 -- 172.21.15.49:0/1159606850 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563aef7d89c0 con 0x563aef64ee40 2023-11-30T17:22:31.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.525+0000 7f89ec8c9700 1 --2- 172.21.15.49:0/1159606850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563aef64ee40 0x563aef8da5a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x563aef8c0710 tx=0x7f89e0025040).ready entity=mon.0 client_cookie=b4e3bba952dec23c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:31.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.525+0000 7f89c6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-30T17:22:31.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.525+0000 7f89c6ffd700 1 -- 172.21.15.49:0/1159606850 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e0023c20 con 0x563aef64ee40 2023-11-30T17:22:31.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.525+0000 7f89c6ffd700 1 -- 172.21.15.49:0/1159606850 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f89e0023d80 con 0x563aef64ee40 2023-11-30T17:22:31.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.525+0000 7f8a004c5b80 1 -- 172.21.15.49:0/1159606850 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563aef681ca0 con 0x563aef64ee40 2023-11-30T17:22:31.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.525+0000 7f89c6ffd700 1 -- 172.21.15.49:0/1159606850 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89e002c610 con 0x563aef64ee40 2023-11-30T17:22:31.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.525+0000 7f8a004c5b80 10 client.6414 fetch_fsmap learned FSMap version 32 2023-11-30T17:22:31.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.525+0000 7f8a004c5b80 1 -- 172.21.15.49:0/1159606850 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x563aef64ff80 con 0x563aef64ee40 2023-11-30T17:22:31.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.525+0000 7f89c6ffd700 1 -- 172.21.15.49:0/1159606850 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563aef681ca0 con 0x563aef64ee40 2023-11-30T17:22:31.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.525+0000 7f89c6ffd700 1 -- 172.21.15.49:0/1159606850 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 32) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f89e002a030 con 0x563aef64ee40 2023-11-30T17:22:31.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.525+0000 7f8a004c5b80 10 client.6414 fetch_fsmap finished waiting for FSMap version 32 2023-11-30T17:22:31.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.525+0000 7f8a004c5b80 10 client.6414 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-30T17:22:31.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.525+0000 7f8a004c5b80 20 client.6414 populate_metadata read hostname 'smithi049' 2023-11-30T17:22:31.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.525+0000 7f8a004c5b80 1 --2- 172.21.15.49:0/1159606850 >> [v2:172.21.15.49:6832/1786065897,v1:172.21.15.49:6835/1786065897] conn(0x563aef932310 0x563aef9326f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:31.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.525+0000 7f8a004c5b80 4 client.6414 mds_command: new command op to 6228 tid=0[{"prefix": "status"}] 2023-11-30T17:22:31.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.525+0000 7f8a004c5b80 1 -- 172.21.15.49:0/1159606850 --> [v2:172.21.15.49:6832/1786065897,v1:172.21.15.49:6835/1786065897] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563aef6b0540 con 0x563aef932310 2023-11-30T17:22:31.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.526+0000 7f89e7fff700 1 --2- 172.21.15.49:0/1159606850 >> [v2:172.21.15.49:6832/1786065897,v1:172.21.15.49:6835/1786065897] conn(0x563aef932310 0x563aef9326f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:31.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.526+0000 7f89c6ffd700 10 client.6414 ms_handle_connect on v2:172.21.15.49:6832/1786065897 2023-11-30T17:22:31.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.526+0000 7f89e7fff700 1 --2- 172.21.15.49:0/1159606850 >> [v2:172.21.15.49:6832/1786065897,v1:172.21.15.49:6835/1786065897] conn(0x563aef932310 0x563aef9326f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=229486597faf4924 server_cookie=a9ffd2c18cceac00 in_seq=0 out_seq=0 2023-11-30T17:22:31.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.526+0000 7f89c6ffd700 1 -- 172.21.15.49:0/1159606850 <== mds.0 v2:172.21.15.49:6832/1786065897 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x563aef6b0540 con 0x563aef932310 2023-11-30T17:22:31.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.526+0000 7f89c6ffd700 10 client.6414 handle_command_reply: tid=0 2023-11-30T17:22:31.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.526+0000 7f8a004c5b80 1 client.6414 shutdown 2023-11-30T17:22:31.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.526+0000 7f8a004c5b80 1 -- 172.21.15.49:0/1159606850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563aef64ee40 msgr2=0x563aef8da5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:31.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.526+0000 7f8a004c5b80 1 --2- 172.21.15.49:0/1159606850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563aef64ee40 0x563aef8da5a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x563aef8c0710 tx=0x7f89e0025040).stop 2023-11-30T17:22:31.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.526+0000 7f8a004c5b80 1 -- 172.21.15.49:0/1159606850 shutdown_connections 2023-11-30T17:22:31.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.526+0000 7f8a004c5b80 1 --2- 172.21.15.49:0/1159606850 >> [v2:172.21.15.49:6832/1786065897,v1:172.21.15.49:6835/1786065897] conn(0x563aef932310 0x563aef9326f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.526+0000 7f8a004c5b80 1 --2- 172.21.15.49:0/1159606850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563aef8dbea0 0x563aef93c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.526+0000 7f8a004c5b80 1 --2- 172.21.15.49:0/1159606850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563aef64ee40 0x563aef8da5a0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.526+0000 7f89c6ffd700 0 client.6414 ms_handle_reset on v2:172.21.15.49:6832/1786065897 2023-11-30T17:22:31.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.526+0000 7f8a004c5b80 1 --2- 172.21.15.49:0/1159606850 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x563aef892cb0 0x563aef8e91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.526+0000 7f8a004c5b80 1 -- 172.21.15.49:0/1159606850 >> 172.21.15.49:0/1159606850 conn(0x563aef6fc4a0 msgr2=0x563aef88e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:31.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.526+0000 7f8a004c5b80 1 -- 172.21.15.49:0/1159606850 shutdown_connections 2023-11-30T17:22:31.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.526+0000 7f8a004c5b80 1 -- 172.21.15.49:0/1159606850 wait complete. 2023-11-30T17:22:31.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.526+0000 7f8a004c5b80 20 client.6414 trim_cache size 0 max 16384 2023-11-30T17:22:31.534 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T17:22:31.534 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "ef213ed4-8f62-4ad5-b55f-7510fd0ee359", 2023-11-30T17:22:31.534 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2023-11-30T17:22:31.534 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 6228, 2023-11-30T17:22:31.534 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-11-30T17:22:31.534 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-11-30T17:22:31.534 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-11-30T17:22:31.535 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 10.216502019, 2023-11-30T17:22:31.535 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 32, 2023-11-30T17:22:31.535 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 83, 2023-11-30T17:22:31.535 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 83, 2023-11-30T17:22:31.535 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 15.364673993 2023-11-30T17:22:31.535 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T17:22:31.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.527+0000 7f89eeb2d700 1 -- 172.21.15.49:0/246204507 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f89c805f270 msgr2=0x7f89c8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:31.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.527+0000 7f89eeb2d700 1 --2- 172.21.15.49:0/246204507 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f89c805f270 0x7f89c8061730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f89e0004290 tx=0x7f89e00014c0).stop 2023-11-30T17:22:31.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.527+0000 7f89eeb2d700 1 -- 172.21.15.49:0/246204507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89e80c86f0 msgr2=0x7f89e8142d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:31.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.527+0000 7f89eeb2d700 1 --2- 172.21.15.49:0/246204507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89e80c86f0 0x7f89e8142d10 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f89d000e980 tx=0x7f89d0009060).stop 2023-11-30T17:22:31.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.527+0000 7f89eeb2d700 1 -- 172.21.15.49:0/246204507 shutdown_connections 2023-11-30T17:22:31.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.527+0000 7f89eeb2d700 1 --2- 172.21.15.49:0/246204507 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89e81547f0 0x7f89e81565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.527+0000 7f89eeb2d700 1 --2- 172.21.15.49:0/246204507 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89e8062700 0x7f89e8154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.527+0000 7f89eeb2d700 1 --2- 172.21.15.49:0/246204507 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f89c805f270 0x7f89c8061730 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.527+0000 7f89eeb2d700 1 --2- 172.21.15.49:0/246204507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89e80c86f0 0x7f89e8142d10 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.527+0000 7f89eeb2d700 1 -- 172.21.15.49:0/246204507 >> 172.21.15.49:0/246204507 conn(0x7f89e80642d0 msgr2=0x7f89e80c7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:31.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.527+0000 7f89eeb2d700 1 -- 172.21.15.49:0/246204507 shutdown_connections 2023-11-30T17:22:31.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.527+0000 7f89eeb2d700 1 -- 172.21.15.49:0/246204507 wait complete. 2023-11-30T17:22:31.540 DEBUG:teuthology.orchestra.run.smithi049:> ceph fs ls 2023-11-30T17:22:31.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.644+0000 7f0ff24ad700 1 Processor -- start 2023-11-30T17:22:31.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.644+0000 7f0ff24ad700 1 -- start start 2023-11-30T17:22:31.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.645+0000 7f0ff24ad700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0fec152190 0x7f0fec0bf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:31.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.645+0000 7f0ff24ad700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fec0bed20 con 0x7f0fec0c3670 2023-11-30T17:22:31.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.645+0000 7f0ff24ad700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fec0be430 con 0x7f0fec0671a0 2023-11-30T17:22:31.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.645+0000 7f0ff24ad700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec0be6d0 con 0x7f0fec152190 2023-11-30T17:22:31.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.645+0000 7f0feb7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0fec0c3670 0x7f0fec066a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43182/0 (socket says 172.21.15.49:43182) 2023-11-30T17:22:31.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.645+0000 7f0feb7fe700 1 -- 172.21.15.49:0/1946180736 learned_addr learned my addr 172.21.15.49:0/1946180736 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:31.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.645+0000 7f0febfff700 1 --2- 172.21.15.49:0/1946180736 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0fec152190 0x7f0fec0bf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:31.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.645+0000 7f0feaffd700 1 -- 172.21.15.49:0/1946180736 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 935734484 0 0) 0x7f0fec0bed20 con 0x7f0fec0c3670 2023-11-30T17:22:31.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.645+0000 7f0feaffd700 1 -- 172.21.15.49:0/1946180736 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fd40033f0 con 0x7f0fec0c3670 2023-11-30T17:22:31.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.646+0000 7f0feaffd700 1 -- 172.21.15.49:0/1946180736 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3375858063 0 0) 0x7f0fec0be430 con 0x7f0fec0671a0 2023-11-30T17:22:31.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.646+0000 7f0feaffd700 1 -- 172.21.15.49:0/1946180736 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fec0bed20 con 0x7f0fec0671a0 2023-11-30T17:22:31.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.646+0000 7f0febfff700 1 -- 172.21.15.49:0/1946180736 >> v1:172.21.15.115:6789/0 conn(0x7f0fec0671a0 legacy=0x7f0fec0a8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:31.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.646+0000 7f0feaffd700 1 -- 172.21.15.49:0/1946180736 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1545557848 0 0) 0x7f0fd40033f0 con 0x7f0fec0c3670 2023-11-30T17:22:31.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.646+0000 7f0febfff700 1 -- 172.21.15.49:0/1946180736 >> v1:172.21.15.49:6789/0 conn(0x7f0fec0c3670 legacy=0x7f0fec066a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:31.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.646+0000 7f0febfff700 1 -- 172.21.15.49:0/1946180736 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fec0be9b0 con 0x7f0fec152190 2023-11-30T17:22:31.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.646+0000 7f0febfff700 1 --2- 172.21.15.49:0/1946180736 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0fec152190 0x7f0fec0bf1b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f0fe0009790 tx=0x7f0fe0009060).ready entity=mon.2 client_cookie=7bf577eff15642c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:31.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.646+0000 7f0feaffd700 1 -- 172.21.15.49:0/1946180736 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc001470 con 0x7f0fec152190 2023-11-30T17:22:31.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.646+0000 7f0feaffd700 1 -- 172.21.15.49:0/1946180736 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe0011400 con 0x7f0fec152190 2023-11-30T17:22:31.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.646+0000 7f0feaffd700 1 -- 172.21.15.49:0/1946180736 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe0011780 con 0x7f0fec152190 2023-11-30T17:22:31.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.647+0000 7f0ff24ad700 1 -- 172.21.15.49:0/1946180736 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0fec152190 msgr2=0x7f0fec0bf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:31.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.647+0000 7f0ff24ad700 1 --2- 172.21.15.49:0/1946180736 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0fec152190 0x7f0fec0bf1b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f0fe0009790 tx=0x7f0fe0009060).stop 2023-11-30T17:22:31.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.647+0000 7f0ff24ad700 1 -- 172.21.15.49:0/1946180736 shutdown_connections 2023-11-30T17:22:31.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.647+0000 7f0ff24ad700 1 --2- 172.21.15.49:0/1946180736 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0fec152190 0x7f0fec0bf1b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.647+0000 7f0ff24ad700 1 -- 172.21.15.49:0/1946180736 >> 172.21.15.49:0/1946180736 conn(0x7f0fec0c9070 msgr2=0x7f0fec0c9480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:31.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.647+0000 7f0ff24ad700 1 -- 172.21.15.49:0/1946180736 shutdown_connections 2023-11-30T17:22:31.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.647+0000 7f0ff24ad700 1 -- 172.21.15.49:0/1946180736 wait complete. 2023-11-30T17:22:31.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.648+0000 7f0ff24ad700 1 Processor -- start 2023-11-30T17:22:31.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.648+0000 7f0ff24ad700 1 -- start start 2023-11-30T17:22:31.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.649+0000 7f0ff24ad700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fec0671a0 0x7f0fec14d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:31.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.649+0000 7f0ff24ad700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0fec0c3670 0x7f0fec150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:31.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.649+0000 7f0ff24ad700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fec151270 0x7f0fec0ac000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:31.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.649+0000 7f0ff24ad700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec153ea0 con 0x7f0fec0671a0 2023-11-30T17:22:31.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.649+0000 7f0ff24ad700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec1516b0 con 0x7f0fec151270 2023-11-30T17:22:31.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.649+0000 7f0ff24ad700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec0accf0 con 0x7f0fec0c3670 2023-11-30T17:22:31.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.649+0000 7f0febfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fec0671a0 0x7f0fec14d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:31.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.649+0000 7f0febfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fec0671a0 0x7f0fec14d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44728/0 (socket says 172.21.15.49:44728) 2023-11-30T17:22:31.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.649+0000 7f0febfff700 1 -- 172.21.15.49:0/1114530442 learned_addr learned my addr 172.21.15.49:0/1114530442 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:31.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.649+0000 7f0feb7fe700 1 --2- 172.21.15.49:0/1114530442 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0fec0c3670 0x7f0fec150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:31.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.649+0000 7f0ff0a4a700 1 --2- 172.21.15.49:0/1114530442 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fec151270 0x7f0fec0ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:31.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.649+0000 7f0febfff700 1 -- 172.21.15.49:0/1114530442 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0fec0c3670 msgr2=0x7f0fec150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:31.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.649+0000 7f0febfff700 1 --2- 172.21.15.49:0/1114530442 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0fec0c3670 0x7f0fec150d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.649+0000 7f0febfff700 1 -- 172.21.15.49:0/1114530442 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fec151270 msgr2=0x7f0fec0ac000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:31.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.649+0000 7f0febfff700 1 --2- 172.21.15.49:0/1114530442 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fec151270 0x7f0fec0ac000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.649+0000 7f0febfff700 1 -- 172.21.15.49:0/1114530442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe00092a0 con 0x7f0fec0671a0 2023-11-30T17:22:31.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.649+0000 7f0febfff700 1 --2- 172.21.15.49:0/1114530442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fec0671a0 0x7f0fec14d0d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f0fec060940 tx=0x7f0fe0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:31.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.649+0000 7f0fd3fff700 1 -- 172.21.15.49:0/1114530442 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe0010670 con 0x7f0fec0671a0 2023-11-30T17:22:31.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.649+0000 7f0fd3fff700 1 -- 172.21.15.49:0/1114530442 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe00107d0 con 0x7f0fec0671a0 2023-11-30T17:22:31.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.649+0000 7f0ff24ad700 1 -- 172.21.15.49:0/1114530442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fec0acfd0 con 0x7f0fec0671a0 2023-11-30T17:22:31.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.649+0000 7f0fd3fff700 1 -- 172.21.15.49:0/1114530442 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe0010b50 con 0x7f0fec0671a0 2023-11-30T17:22:31.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.650+0000 7f0ff24ad700 1 -- 172.21.15.49:0/1114530442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fec0ad590 con 0x7f0fec0671a0 2023-11-30T17:22:31.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.650+0000 7f0ff24ad700 1 -- 172.21.15.49:0/1114530442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fec153d00 con 0x7f0fec0671a0 2023-11-30T17:22:31.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.651+0000 7f0fd3fff700 1 -- 172.21.15.49:0/1114530442 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0fe0027460 con 0x7f0fec0671a0 2023-11-30T17:22:31.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.651+0000 7f0fd3fff700 1 --2- 172.21.15.49:0/1114530442 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0fd805f240 0x7f0fd8061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:31.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.651+0000 7f0fd3fff700 1 -- 172.21.15.49:0/1114530442 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f0fe007b740 con 0x7f0fec0671a0 2023-11-30T17:22:31.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.651+0000 7f0feb7fe700 1 --2- 172.21.15.49:0/1114530442 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0fd805f240 0x7f0fd8061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:31.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.652+0000 7f0feb7fe700 1 --2- 172.21.15.49:0/1114530442 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0fd805f240 0x7f0fd8061700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f0fec151ac0 tx=0x7f0fdc000bc0).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:31.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.655+0000 7f0fd3fff700 1 -- 172.21.15.49:0/1114530442 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0fec153d00 con 0x7f0fec0671a0 2023-11-30T17:22:31.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.871+0000 7f0ff24ad700 1 -- 172.21.15.49:0/1114530442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0fec153d00 con 0x7f0fec0671a0 2023-11-30T17:22:31.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.871+0000 7f0fd3fff700 1 -- 172.21.15.49:0/1114530442 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0fec153d00 con 0x7f0fec0671a0 2023-11-30T17:22:31.873 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-30T17:22:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.873+0000 7f0ff24ad700 1 -- 172.21.15.49:0/1114530442 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0fd805f240 msgr2=0x7f0fd8061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.873+0000 7f0ff24ad700 1 --2- 172.21.15.49:0/1114530442 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0fd805f240 0x7f0fd8061700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f0fec151ac0 tx=0x7f0fdc000bc0).stop 2023-11-30T17:22:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.873+0000 7f0ff24ad700 1 -- 172.21.15.49:0/1114530442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fec0671a0 msgr2=0x7f0fec14d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.873+0000 7f0ff24ad700 1 --2- 172.21.15.49:0/1114530442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fec0671a0 0x7f0fec14d0d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f0fec060940 tx=0x7f0fe0016000).stop 2023-11-30T17:22:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.873+0000 7f0ff24ad700 1 -- 172.21.15.49:0/1114530442 shutdown_connections 2023-11-30T17:22:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.873+0000 7f0ff24ad700 1 --2- 172.21.15.49:0/1114530442 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fec151270 0x7f0fec0ac000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.873+0000 7f0ff24ad700 1 --2- 172.21.15.49:0/1114530442 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0fd805f240 0x7f0fd8061700 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.873+0000 7f0ff24ad700 1 --2- 172.21.15.49:0/1114530442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fec0671a0 0x7f0fec14d0d0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.873+0000 7f0ff24ad700 1 --2- 172.21.15.49:0/1114530442 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0fec0c3670 0x7f0fec150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.873+0000 7f0ff24ad700 1 -- 172.21.15.49:0/1114530442 >> 172.21.15.49:0/1114530442 conn(0x7f0fec0c9070 msgr2=0x7f0fec14df20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.873+0000 7f0ff24ad700 1 -- 172.21.15.49:0/1114530442 shutdown_connections 2023-11-30T17:22:31.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:31.873+0000 7f0ff24ad700 1 -- 172.21.15.49:0/1114530442 wait complete. 2023-11-30T17:22:31.886 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-30T17:22:31.886 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-30T17:22:31.886 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-11-30T17:22:31.886 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-30T17:22:31.886 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-30T17:22:31.886 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-30T17:22:31.886 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-30T17:22:31.886 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-30T17:22:31.886 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-30T17:22:31.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:22:31.887 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-11-30T17:22:31.903 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-30T17:22:31.903 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-30T17:22:31.903 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-11-30T17:22:31.903 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:22:31.903 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-11-30T17:22:31.903 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:22:31.903 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:22:31.904 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:22:31.904 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-11-30T17:22:31.904 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:22:31.904 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:22:31.904 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-11-30T17:22:31.904 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-30T17:22:31.904 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:22:31.904 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-11-30T17:22:31.904 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-30T17:22:31.904 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 41523sec preferred_lft 41523sec 2023-11-30T17:22:31.904 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2023-11-30T17:22:31.904 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:22:31.904 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:22:31.904 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:22:31.905 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-11-30T17:22:31.905 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-30T17:22:31.905 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 32:bf:40:53:4c:5d brd ff:ff:ff:ff:ff:ff 2023-11-30T17:22:31.905 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-30T17:22:31.905 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:22:31.905 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::8b6:11ff:fe93:7174/64 scope link 2023-11-30T17:22:31.905 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:22:31.905 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-30T17:22:31.905 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 3e:e9:3c:a8:7a:95 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-30T17:22:31.905 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::3ce9:3cff:fea8:7a95/64 scope link 2023-11-30T17:22:31.905 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:22:31.905 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-30T17:22:31.905 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 32:bf:40:53:4c:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-30T17:22:31.905 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::30bf:40ff:fe53:4c5d/64 scope link 2023-11-30T17:22:31.905 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:22:31.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:22:31.906 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-30T17:22:31.967 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-11-30T17:22:31.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:22:31.968 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-11-30T17:22:32.024 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-11-30T17:22:32.024 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-30T17:22:32.024 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-30T17:22:32.024 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-30T17:22:32.025 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-30T17:22:32.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:22:32.025 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-11-30T17:22:32.025 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-11-30T17:22:32.025 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-30T17:22:32.025 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-30T17:22:32.025 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-30T17:22:32.025 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-11-30T17:22:32.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:22:32.127 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-11-30T17:22:32.141 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-30T17:22:32.142 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-30T17:22:32.142 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-30T17:22:32.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:22:32.142 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-11-30T17:22:32.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:22:32.219 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-11-30T17:22:32.262 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-30T17:22:32.262 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:22:32.342 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:22:32.342 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-30T17:22:32.367 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:22:32.367 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-30T17:22:32.369 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-30T17:22:32.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:22:32.369 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-30T17:22:32.435 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-30T17:22:32.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.592+0000 7f3c78aed700 1 Processor -- start 2023-11-30T17:22:32.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.592+0000 7f3c78aed700 1 -- start start 2023-11-30T17:22:32.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.593+0000 7f3c78aed700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3c74098d10 0x7f3c740c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:32.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.593+0000 7f3c78aed700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c740c6190 0x7f3c74063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:32.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.593+0000 7f3c78aed700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c740c72d0 con 0x7f3c74064350 2023-11-30T17:22:32.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.593+0000 7f3c78aed700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c74154bc0 con 0x7f3c74098d10 2023-11-30T17:22:32.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.593+0000 7f3c78aed700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c740c66c0 con 0x7f3c740c6190 2023-11-30T17:22:32.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.593+0000 7f3c7259c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3c74098d10 0x7f3c740c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:32.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.593+0000 7f3c7259c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3c74098d10 0x7f3c740c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44736/0 (socket says 172.21.15.49:44736) 2023-11-30T17:22:32.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.593+0000 7f3c7259c700 1 -- 172.21.15.49:0/3905767593 learned_addr learned my addr 172.21.15.49:0/3905767593 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:32.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.593+0000 7f3c71d9b700 1 --2- 172.21.15.49:0/3905767593 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c740c6190 0x7f3c74063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:32.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.593+0000 7f3c7259c700 1 -- 172.21.15.49:0/3905767593 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c740c6190 msgr2=0x7f3c74063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:32.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.594+0000 7f3c7259c700 1 --2- 172.21.15.49:0/3905767593 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c740c6190 0x7f3c74063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:32.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.594+0000 7f3c7259c700 1 -- 172.21.15.49:0/3905767593 >> v1:172.21.15.115:6789/0 conn(0x7f3c74064350 legacy=0x7f3c74158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:32.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.594+0000 7f3c7259c700 1 -- 172.21.15.49:0/3905767593 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c740c69a0 con 0x7f3c74098d10 2023-11-30T17:22:32.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.594+0000 7f3c7259c700 1 --2- 172.21.15.49:0/3905767593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c74098d10 0x7f3c740c7760 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f3c6c006fd0 tx=0x7f3c6c0090f0).ready entity=mon.0 client_cookie=70cefc86070f4cb1 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:32.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.594+0000 7f3c7159a700 1 -- 172.21.15.49:0/3905767593 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c00b580 con 0x7f3c74098d10 2023-11-30T17:22:32.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.594+0000 7f3c7159a700 1 -- 172.21.15.49:0/3905767593 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6c00b6e0 con 0x7f3c74098d10 2023-11-30T17:22:32.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.594+0000 7f3c7159a700 1 -- 172.21.15.49:0/3905767593 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c00ba60 con 0x7f3c74098d10 2023-11-30T17:22:32.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.594+0000 7f3c78aed700 1 -- 172.21.15.49:0/3905767593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c74098d10 msgr2=0x7f3c740c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:32.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.594+0000 7f3c78aed700 1 --2- 172.21.15.49:0/3905767593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c74098d10 0x7f3c740c7760 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f3c6c006fd0 tx=0x7f3c6c0090f0).stop 2023-11-30T17:22:32.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.594+0000 7f3c78aed700 1 -- 172.21.15.49:0/3905767593 shutdown_connections 2023-11-30T17:22:32.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.594+0000 7f3c78aed700 1 --2- 172.21.15.49:0/3905767593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c74098d10 0x7f3c740c7760 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:32.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.594+0000 7f3c78aed700 1 --2- 172.21.15.49:0/3905767593 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c740c6190 0x7f3c74063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:32.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.594+0000 7f3c78aed700 1 -- 172.21.15.49:0/3905767593 >> 172.21.15.49:0/3905767593 conn(0x7f3c740cb310 msgr2=0x7f3c740cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:32.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.594+0000 7f3c78aed700 1 -- 172.21.15.49:0/3905767593 shutdown_connections 2023-11-30T17:22:32.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.594+0000 7f3c78aed700 1 -- 172.21.15.49:0/3905767593 wait complete. 2023-11-30T17:22:32.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.596+0000 7f3c78aed700 1 Processor -- start 2023-11-30T17:22:32.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.596+0000 7f3c78aed700 1 -- start start 2023-11-30T17:22:32.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.596+0000 7f3c78aed700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c74064350 0x7f3c740af670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:32.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.596+0000 7f3c78aed700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c74098d10 0x7f3c74156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:32.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.596+0000 7f3c78aed700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c740c6190 0x7f3c7413ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:32.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.596+0000 7f3c78aed700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c740b09d0 con 0x7f3c74098d10 2023-11-30T17:22:32.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.596+0000 7f3c78aed700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c740afb60 con 0x7f3c740c6190 2023-11-30T17:22:32.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.596+0000 7f3c78aed700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c74156e80 con 0x7f3c74064350 2023-11-30T17:22:32.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.596+0000 7f3c71d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c74098d10 0x7f3c74156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:32.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.596+0000 7f3c71d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c74098d10 0x7f3c74156990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44742/0 (socket says 172.21.15.49:44742) 2023-11-30T17:22:32.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.596+0000 7f3c71d9b700 1 -- 172.21.15.49:0/1036894933 learned_addr learned my addr 172.21.15.49:0/1036894933 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:32.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.597+0000 7f3c7259c700 1 --2- 172.21.15.49:0/1036894933 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c74064350 0x7f3c740af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:32.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.597+0000 7f3c72d9d700 1 --2- 172.21.15.49:0/1036894933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c740c6190 0x7f3c7413ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:32.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.597+0000 7f3c71d9b700 1 -- 172.21.15.49:0/1036894933 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c74064350 msgr2=0x7f3c740af670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:32.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.597+0000 7f3c71d9b700 1 --2- 172.21.15.49:0/1036894933 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c74064350 0x7f3c740af670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:32.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.597+0000 7f3c71d9b700 1 -- 172.21.15.49:0/1036894933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c740c6190 msgr2=0x7f3c7413ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:32.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.597+0000 7f3c71d9b700 1 --2- 172.21.15.49:0/1036894933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c740c6190 0x7f3c7413ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:32.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.597+0000 7f3c71d9b700 1 -- 172.21.15.49:0/1036894933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6c009370 con 0x7f3c74098d10 2023-11-30T17:22:32.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.597+0000 7f3c71d9b700 1 --2- 172.21.15.49:0/1036894933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c74098d10 0x7f3c74156990 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f3c5c00e8d0 tx=0x7f3c5c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:32.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.597+0000 7f3c6a7fc700 1 -- 172.21.15.49:0/1036894933 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c012600 con 0x7f3c74098d10 2023-11-30T17:22:32.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.597+0000 7f3c6a7fc700 1 -- 172.21.15.49:0/1036894933 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5c012760 con 0x7f3c74098d10 2023-11-30T17:22:32.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.597+0000 7f3c78aed700 1 -- 172.21.15.49:0/1036894933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c740afdc0 con 0x7f3c74098d10 2023-11-30T17:22:32.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.597+0000 7f3c6a7fc700 1 -- 172.21.15.49:0/1036894933 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c012b00 con 0x7f3c74098d10 2023-11-30T17:22:32.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.597+0000 7f3c78aed700 1 -- 172.21.15.49:0/1036894933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c740b0380 con 0x7f3c74098d10 2023-11-30T17:22:32.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.598+0000 7f3c78aed700 1 -- 172.21.15.49:0/1036894933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c740b0b40 con 0x7f3c74098d10 2023-11-30T17:22:32.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.598+0000 7f3c6a7fc700 1 -- 172.21.15.49:0/1036894933 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f3c5c01a3b0 con 0x7f3c74098d10 2023-11-30T17:22:32.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.599+0000 7f3c6a7fc700 1 --2- 172.21.15.49:0/1036894933 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3c5405f270 0x7f3c54061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:32.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.599+0000 7f3c6a7fc700 1 -- 172.21.15.49:0/1036894933 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f3c5c07a360 con 0x7f3c74098d10 2023-11-30T17:22:32.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.599+0000 7f3c7259c700 1 --2- 172.21.15.49:0/1036894933 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3c5405f270 0x7f3c54061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:32.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.599+0000 7f3c7259c700 1 --2- 172.21.15.49:0/1036894933 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3c5405f270 0x7f3c54061730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f3c6c009fd0 tx=0x7f3c6c017000).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:32.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.603+0000 7f3c6a7fc700 1 -- 172.21.15.49:0/1036894933 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3c5c04b430 con 0x7f3c74098d10 2023-11-30T17:22:32.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.801+0000 7f3c78aed700 1 -- 172.21.15.49:0/1036894933 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c7406c860 con 0x7f3c5405f270 2023-11-30T17:22:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.803+0000 7f3c6a7fc700 1 -- 172.21.15.49:0/1036894933 <== mgr.5926 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f3c7406c860 con 0x7f3c5405f270 2023-11-30T17:22:32.804 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-11-30T17:22:32.804 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:32.804 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cephfs" 2023-11-30T17:22:32.805 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:32.805 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-11-30T17:22:32.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.804+0000 7f3c78aed700 1 -- 172.21.15.49:0/1036894933 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3c5405f270 msgr2=0x7f3c54061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:32.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.804+0000 7f3c78aed700 1 --2- 172.21.15.49:0/1036894933 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3c5405f270 0x7f3c54061730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f3c6c009fd0 tx=0x7f3c6c017000).stop 2023-11-30T17:22:32.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.805+0000 7f3c78aed700 1 -- 172.21.15.49:0/1036894933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c74098d10 msgr2=0x7f3c74156990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:32.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.805+0000 7f3c78aed700 1 --2- 172.21.15.49:0/1036894933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c74098d10 0x7f3c74156990 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f3c5c00e8d0 tx=0x7f3c5c009060).stop 2023-11-30T17:22:32.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.805+0000 7f3c78aed700 1 -- 172.21.15.49:0/1036894933 shutdown_connections 2023-11-30T17:22:32.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.805+0000 7f3c78aed700 1 --2- 172.21.15.49:0/1036894933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c740c6190 0x7f3c7413ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:32.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.805+0000 7f3c78aed700 1 --2- 172.21.15.49:0/1036894933 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c74064350 0x7f3c740af670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:32.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.805+0000 7f3c78aed700 1 --2- 172.21.15.49:0/1036894933 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3c5405f270 0x7f3c54061730 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:32.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.805+0000 7f3c78aed700 1 --2- 172.21.15.49:0/1036894933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c74098d10 0x7f3c74156990 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:32.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.805+0000 7f3c78aed700 1 -- 172.21.15.49:0/1036894933 >> 172.21.15.49:0/1036894933 conn(0x7f3c740cb310 msgr2=0x7f3c740aa590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:32.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.805+0000 7f3c78aed700 1 -- 172.21.15.49:0/1036894933 shutdown_connections 2023-11-30T17:22:32.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.805+0000 7f3c78aed700 1 -- 172.21.15.49:0/1036894933 wait complete. 2023-11-30T17:22:32.818 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-11-30T17:22:32.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.938+0000 7fd9ce434700 1 Processor -- start 2023-11-30T17:22:32.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.938+0000 7fd9ce434700 1 -- start start 2023-11-30T17:22:32.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.939+0000 7fd9ce434700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd9c8098d10 0x7fd9c80c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:32.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.939+0000 7fd9ce434700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd9c8158320 0x7fd9c81587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:32.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.939+0000 7fd9ce434700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c8158cc0 con 0x7fd9c80c6190 2023-11-30T17:22:32.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.939+0000 7fd9ce434700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c80c72d0 con 0x7fd9c8098d10 2023-11-30T17:22:32.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.939+0000 7fd9ce434700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c8064570 con 0x7fd9c8158320 2023-11-30T17:22:32.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.939+0000 7fd9c7fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd9c8098d10 0x7fd9c80c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:32.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.939+0000 7fd9c7fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd9c8098d10 0x7fd9c80c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44754/0 (socket says 172.21.15.49:44754) 2023-11-30T17:22:32.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.939+0000 7fd9c7fff700 1 -- 172.21.15.49:0/1197819149 learned_addr learned my addr 172.21.15.49:0/1197819149 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:32.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.939+0000 7fd9cc9d1700 1 --2- 172.21.15.49:0/1197819149 >> v2:172.21.15.115:3300/0 conn(0x7fd9c8158320 0x7fd9c81587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:32.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.939+0000 7fd9c7fff700 1 -- 172.21.15.49:0/1197819149 >> v2:172.21.15.115:3300/0 conn(0x7fd9c8158320 msgr2=0x7fd9c81587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:32.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.939+0000 7fd9c7fff700 1 --2- 172.21.15.49:0/1197819149 >> v2:172.21.15.115:3300/0 conn(0x7fd9c8158320 0x7fd9c81587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:32.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.939+0000 7fd9c7fff700 1 -- 172.21.15.49:0/1197819149 >> v1:172.21.15.115:6789/0 conn(0x7fd9c80c6190 legacy=0x7fd9c8063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:32.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.939+0000 7fd9c7fff700 1 -- 172.21.15.49:0/1197819149 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c8154bc0 con 0x7fd9c8098d10 2023-11-30T17:22:32.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.939+0000 7fd9c7fff700 1 --2- 172.21.15.49:0/1197819149 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9c8098d10 0x7fd9c80c7760 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7fd9c80657a0 tx=0x7fd9b80090f0).ready entity=mon.0 client_cookie=5c82daa433b6c68b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:32.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.939+0000 7fd9c6ffd700 1 -- 172.21.15.49:0/1197819149 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b800b5a0 con 0x7fd9c8098d10 2023-11-30T17:22:32.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.939+0000 7fd9c6ffd700 1 -- 172.21.15.49:0/1197819149 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b800b700 con 0x7fd9c8098d10 2023-11-30T17:22:32.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.939+0000 7fd9c6ffd700 1 -- 172.21.15.49:0/1197819149 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b800ba80 con 0x7fd9c8098d10 2023-11-30T17:22:32.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.940+0000 7fd9ce434700 1 -- 172.21.15.49:0/1197819149 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9c8098d10 msgr2=0x7fd9c80c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:32.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.940+0000 7fd9ce434700 1 --2- 172.21.15.49:0/1197819149 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9c8098d10 0x7fd9c80c7760 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7fd9c80657a0 tx=0x7fd9b80090f0).stop 2023-11-30T17:22:32.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.940+0000 7fd9ce434700 1 -- 172.21.15.49:0/1197819149 shutdown_connections 2023-11-30T17:22:32.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.940+0000 7fd9ce434700 1 --2- 172.21.15.49:0/1197819149 >> v2:172.21.15.115:3300/0 conn(0x7fd9c8158320 0x7fd9c81587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:32.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.940+0000 7fd9ce434700 1 --2- 172.21.15.49:0/1197819149 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9c8098d10 0x7fd9c80c7760 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:32.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.940+0000 7fd9ce434700 1 -- 172.21.15.49:0/1197819149 >> 172.21.15.49:0/1197819149 conn(0x7fd9c80cb310 msgr2=0x7fd9c80cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:32.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.940+0000 7fd9ce434700 1 -- 172.21.15.49:0/1197819149 shutdown_connections 2023-11-30T17:22:32.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.940+0000 7fd9ce434700 1 -- 172.21.15.49:0/1197819149 wait complete. 2023-11-30T17:22:32.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.941+0000 7fd9ce434700 1 Processor -- start 2023-11-30T17:22:32.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.941+0000 7fd9ce434700 1 -- start start 2023-11-30T17:22:32.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.942+0000 7fd9ce434700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9c8098d10 0x7fd9c8146f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:32.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.942+0000 7fd9ce434700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9c80c6190 0x7fd9c80b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:32.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.942+0000 7fd9ce434700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9c8158320 0x7fd9c80c0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:32.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.942+0000 7fd9ce434700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c80c4b70 con 0x7fd9c8158320 2023-11-30T17:22:32.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.942+0000 7fd9ce434700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c80c3f60 con 0x7fd9c80c6190 2023-11-30T17:22:32.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.942+0000 7fd9ce434700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c80c4240 con 0x7fd9c8098d10 2023-11-30T17:22:32.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.942+0000 7fd9cc9d1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9c8158320 0x7fd9c80c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:32.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.942+0000 7fd9cc9d1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9c8158320 0x7fd9c80c0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44756/0 (socket says 172.21.15.49:44756) 2023-11-30T17:22:32.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.942+0000 7fd9cc9d1700 1 -- 172.21.15.49:0/3727005284 learned_addr learned my addr 172.21.15.49:0/3727005284 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:32.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.942+0000 7fd9c7fff700 1 --2- 172.21.15.49:0/3727005284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9c8098d10 0x7fd9c8146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:32.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.942+0000 7fd9cc9d1700 1 -- 172.21.15.49:0/3727005284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9c8098d10 msgr2=0x7fd9c8146f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:32.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.942+0000 7fd9c77fe700 1 --2- 172.21.15.49:0/3727005284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9c80c6190 0x7fd9c80b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:32.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.942+0000 7fd9cc9d1700 1 --2- 172.21.15.49:0/3727005284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9c8098d10 0x7fd9c8146f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:32.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.942+0000 7fd9cc9d1700 1 -- 172.21.15.49:0/3727005284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9c80c6190 msgr2=0x7fd9c80b0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:32.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.942+0000 7fd9cc9d1700 1 --2- 172.21.15.49:0/3727005284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9c80c6190 0x7fd9c80b0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:32.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.942+0000 7fd9cc9d1700 1 -- 172.21.15.49:0/3727005284 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b8009370 con 0x7fd9c8158320 2023-11-30T17:22:32.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.942+0000 7fd9c7fff700 1 --2- 172.21.15.49:0/3727005284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9c8098d10 0x7fd9c8146f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:22:32.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.942+0000 7fd9c77fe700 1 --2- 172.21.15.49:0/3727005284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9c80c6190 0x7fd9c80b0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:22:32.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.943+0000 7fd9cc9d1700 1 --2- 172.21.15.49:0/3727005284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9c8158320 0x7fd9c80c0270 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7fd9c000cdb0 tx=0x7fd9c00077d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:32.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.943+0000 7fd9affff700 1 -- 172.21.15.49:0/3727005284 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c000aa80 con 0x7fd9c8158320 2023-11-30T17:22:32.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.943+0000 7fd9affff700 1 -- 172.21.15.49:0/3727005284 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c000abe0 con 0x7fd9c8158320 2023-11-30T17:22:32.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.943+0000 7fd9ce434700 1 -- 172.21.15.49:0/3727005284 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c80c4520 con 0x7fd9c8158320 2023-11-30T17:22:32.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.943+0000 7fd9affff700 1 -- 172.21.15.49:0/3727005284 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c000f400 con 0x7fd9c8158320 2023-11-30T17:22:32.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.943+0000 7fd9ce434700 1 -- 172.21.15.49:0/3727005284 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c8147410 con 0x7fd9c8158320 2023-11-30T17:22:32.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.944+0000 7fd9ce434700 1 -- 172.21.15.49:0/3727005284 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c80c4ce0 con 0x7fd9c8158320 2023-11-30T17:22:32.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.944+0000 7fd9affff700 1 -- 172.21.15.49:0/3727005284 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fd9c000d040 con 0x7fd9c8158320 2023-11-30T17:22:32.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.945+0000 7fd9affff700 1 --2- 172.21.15.49:0/3727005284 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd9b405f270 0x7fd9b4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:32.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.945+0000 7fd9affff700 1 -- 172.21.15.49:0/3727005284 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fd9c007a530 con 0x7fd9c8158320 2023-11-30T17:22:32.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.945+0000 7fd9c7fff700 1 --2- 172.21.15.49:0/3727005284 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd9b405f270 0x7fd9b4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:32.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.945+0000 7fd9c7fff700 1 --2- 172.21.15.49:0/3727005284 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd9b405f270 0x7fd9b4061730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fd9c80657a0 tx=0x7fd9b8015000).ready entity=mgr.5926 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:32.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:32.949+0000 7fd9affff700 1 -- 172.21.15.49:0/3727005284 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd9c004b660 con 0x7fd9c8158320 2023-11-30T17:22:33.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:33.171+0000 7fd9ce434700 1 -- 172.21.15.49:0/3727005284 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fd9c806c860 con 0x7fd9c8158320 2023-11-30T17:22:33.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:33.924+0000 7fd9affff700 1 -- 172.21.15.49:0/3727005284 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 25) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fd9c0078160 con 0x7fd9c8158320 2023-11-30T17:22:33.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:33.926+0000 7fd9affff700 1 -- 172.21.15.49:0/3727005284 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v25) v1 ==== 92+0+0 (secure 0 0 0) 0x7fd9c0073a10 con 0x7fd9c8158320 2023-11-30T17:22:33.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:33.928+0000 7fd9ce434700 1 -- 172.21.15.49:0/3727005284 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd9b405f270 msgr2=0x7fd9b4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:33.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:33.928+0000 7fd9ce434700 1 --2- 172.21.15.49:0/3727005284 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd9b405f270 0x7fd9b4061730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fd9c80657a0 tx=0x7fd9b8015000).stop 2023-11-30T17:22:33.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:33.928+0000 7fd9ce434700 1 -- 172.21.15.49:0/3727005284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9c8158320 msgr2=0x7fd9c80c0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:33.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:33.928+0000 7fd9ce434700 1 --2- 172.21.15.49:0/3727005284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9c8158320 0x7fd9c80c0270 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7fd9c000cdb0 tx=0x7fd9c00077d0).stop 2023-11-30T17:22:33.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:33.928+0000 7fd9ce434700 1 -- 172.21.15.49:0/3727005284 shutdown_connections 2023-11-30T17:22:33.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:33.928+0000 7fd9ce434700 1 --2- 172.21.15.49:0/3727005284 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd9b405f270 0x7fd9b4061730 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:33.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:33.928+0000 7fd9ce434700 1 --2- 172.21.15.49:0/3727005284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9c8158320 0x7fd9c80c0270 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:33.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:33.928+0000 7fd9ce434700 1 --2- 172.21.15.49:0/3727005284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9c8098d10 0x7fd9c8146f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:33.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:33.928+0000 7fd9ce434700 1 --2- 172.21.15.49:0/3727005284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9c80c6190 0x7fd9c80b0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:33.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:33.928+0000 7fd9ce434700 1 -- 172.21.15.49:0/3727005284 >> 172.21.15.49:0/3727005284 conn(0x7fd9c80cb310 msgr2=0x7fd9c81530e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:33.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:33.929+0000 7fd9ce434700 1 -- 172.21.15.49:0/3727005284 shutdown_connections 2023-11-30T17:22:33.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:33.929+0000 7fd9ce434700 1 -- 172.21.15.49:0/3727005284 wait complete. 2023-11-30T17:22:33.946 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-11-30T17:22:34.066 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:34.064+0000 7f8cd95b5680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T17:22:34.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.074+0000 7f3035e30700 1 Processor -- start 2023-11-30T17:22:34.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.074+0000 7f3035e30700 1 -- start start 2023-11-30T17:22:34.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.074+0000 7f3035e30700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3030098d10 0x7f30300c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:34.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.074+0000 7f3035e30700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30300c6190 0x7f3030063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:34.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.074+0000 7f3035e30700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30300c72d0 con 0x7f3030064350 2023-11-30T17:22:34.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.074+0000 7f3035e30700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3030154bc0 con 0x7f3030098d10 2023-11-30T17:22:34.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.074+0000 7f3035e30700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30300c66c0 con 0x7f30300c6190 2023-11-30T17:22:34.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.075+0000 7f302f7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3030098d10 0x7f30300c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:34.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.075+0000 7f302f7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3030098d10 0x7f30300c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44776/0 (socket says 172.21.15.49:44776) 2023-11-30T17:22:34.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.075+0000 7f302f7fe700 1 -- 172.21.15.49:0/2164189290 learned_addr learned my addr 172.21.15.49:0/2164189290 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:34.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.075+0000 7f302effd700 1 --2- 172.21.15.49:0/2164189290 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30300c6190 0x7f3030063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:34.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.075+0000 7f302f7fe700 1 -- 172.21.15.49:0/2164189290 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30300c6190 msgr2=0x7f3030063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:34.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.075+0000 7f302f7fe700 1 --2- 172.21.15.49:0/2164189290 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30300c6190 0x7f3030063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:34.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.075+0000 7f302f7fe700 1 -- 172.21.15.49:0/2164189290 >> v1:172.21.15.115:6789/0 conn(0x7f3030064350 legacy=0x7f3030158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:34.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.075+0000 7f302e7fc700 1 -- 172.21.15.49:0/2164189290 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3960064145 0 0) 0x7f30300c72d0 con 0x7f3030064350 2023-11-30T17:22:34.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.075+0000 7f302f7fe700 1 -- 172.21.15.49:0/2164189290 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30300c69a0 con 0x7f3030098d10 2023-11-30T17:22:34.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.075+0000 7f302f7fe700 1 --2- 172.21.15.49:0/2164189290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3030098d10 0x7f30300c7760 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f3020006fd0 tx=0x7f30200090f0).ready entity=mon.0 client_cookie=711317c174ae9eaa server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:34.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.075+0000 7f302e7fc700 1 -- 172.21.15.49:0/2164189290 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302000b580 con 0x7f3030098d10 2023-11-30T17:22:34.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.075+0000 7f302e7fc700 1 -- 172.21.15.49:0/2164189290 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302000b6e0 con 0x7f3030098d10 2023-11-30T17:22:34.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.075+0000 7f302e7fc700 1 -- 172.21.15.49:0/2164189290 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302000ba60 con 0x7f3030098d10 2023-11-30T17:22:34.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.076+0000 7f3035e30700 1 -- 172.21.15.49:0/2164189290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3030098d10 msgr2=0x7f30300c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:34.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.076+0000 7f3035e30700 1 --2- 172.21.15.49:0/2164189290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3030098d10 0x7f30300c7760 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f3020006fd0 tx=0x7f30200090f0).stop 2023-11-30T17:22:34.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.076+0000 7f3035e30700 1 -- 172.21.15.49:0/2164189290 shutdown_connections 2023-11-30T17:22:34.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.076+0000 7f3035e30700 1 --2- 172.21.15.49:0/2164189290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3030098d10 0x7f30300c7760 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:34.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.076+0000 7f3035e30700 1 --2- 172.21.15.49:0/2164189290 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30300c6190 0x7f3030063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:34.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.076+0000 7f3035e30700 1 -- 172.21.15.49:0/2164189290 >> 172.21.15.49:0/2164189290 conn(0x7f30300cb310 msgr2=0x7f30300cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:34.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.076+0000 7f3035e30700 1 -- 172.21.15.49:0/2164189290 shutdown_connections 2023-11-30T17:22:34.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.076+0000 7f3035e30700 1 -- 172.21.15.49:0/2164189290 wait complete. 2023-11-30T17:22:34.080 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:34.076+0000 7f5e62552680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T17:22:34.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.077+0000 7f3035e30700 1 Processor -- start 2023-11-30T17:22:34.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.077+0000 7f3035e30700 1 -- start start 2023-11-30T17:22:34.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.078+0000 7f3035e30700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3030064350 0x7f30300aa690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:34.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.078+0000 7f3035e30700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3030098d10 0x7f303014add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:34.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.078+0000 7f3035e30700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30300c6190 0x7f3030150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:34.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.078+0000 7f3035e30700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30300a9960 con 0x7f30300c6190 2023-11-30T17:22:34.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.078+0000 7f3035e30700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30300aa200 con 0x7f3030064350 2023-11-30T17:22:34.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.078+0000 7f3035e30700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30300a9150 con 0x7f3030098d10 2023-11-30T17:22:34.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.078+0000 7f302ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30300c6190 0x7f3030150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:34.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.078+0000 7f302ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30300c6190 0x7f3030150e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44784/0 (socket says 172.21.15.49:44784) 2023-11-30T17:22:34.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.078+0000 7f302ffff700 1 -- 172.21.15.49:0/917856784 learned_addr learned my addr 172.21.15.49:0/917856784 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:34.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.078+0000 7f302f7fe700 1 --2- 172.21.15.49:0/917856784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3030064350 0x7f30300aa690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:34.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.078+0000 7f302effd700 1 --2- 172.21.15.49:0/917856784 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3030098d10 0x7f303014add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:34.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.078+0000 7f302ffff700 1 -- 172.21.15.49:0/917856784 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3030098d10 msgr2=0x7f303014add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:34.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.078+0000 7f302ffff700 1 --2- 172.21.15.49:0/917856784 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3030098d10 0x7f303014add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:34.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.079+0000 7f302ffff700 1 -- 172.21.15.49:0/917856784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3030064350 msgr2=0x7f30300aa690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:34.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.079+0000 7f302ffff700 1 --2- 172.21.15.49:0/917856784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3030064350 0x7f30300aa690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:34.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.079+0000 7f302ffff700 1 -- 172.21.15.49:0/917856784 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3020009370 con 0x7f30300c6190 2023-11-30T17:22:34.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.079+0000 7f302ffff700 1 --2- 172.21.15.49:0/917856784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30300c6190 0x7f3030150e40 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f3028002230 tx=0x7f3028007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:34.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.079+0000 7f30177fe700 1 -- 172.21.15.49:0/917856784 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3028010510 con 0x7f30300c6190 2023-11-30T17:22:34.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.079+0000 7f30177fe700 1 -- 172.21.15.49:0/917856784 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3028010670 con 0x7f30300c6190 2023-11-30T17:22:34.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.079+0000 7f3035e30700 1 -- 172.21.15.49:0/917856784 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30300a9bb0 con 0x7f30300c6190 2023-11-30T17:22:34.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.079+0000 7f30177fe700 1 -- 172.21.15.49:0/917856784 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3028010a10 con 0x7f30300c6190 2023-11-30T17:22:34.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.079+0000 7f3035e30700 1 -- 172.21.15.49:0/917856784 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f303014b2c0 con 0x7f30300c6190 2023-11-30T17:22:34.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.080+0000 7f3035e30700 1 -- 172.21.15.49:0/917856784 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30300aa370 con 0x7f30300c6190 2023-11-30T17:22:34.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.081+0000 7f30177fe700 1 -- 172.21.15.49:0/917856784 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 25) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f3028025430 con 0x7f30300c6190 2023-11-30T17:22:34.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.081+0000 7f30177fe700 1 --2- 172.21.15.49:0/917856784 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f301c05f2c0 0x7f301c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:34.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.081+0000 7f30177fe700 1 -- 172.21.15.49:0/917856784 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f302807ad30 con 0x7f30300c6190 2023-11-30T17:22:34.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.081+0000 7f302f7fe700 1 -- 172.21.15.49:0/917856784 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f301c05f2c0 msgr2=0x7f301c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:34.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.081+0000 7f302f7fe700 1 --2- 172.21.15.49:0/917856784 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f301c05f2c0 0x7f301c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:22:34.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.085+0000 7f30177fe700 1 -- 172.21.15.49:0/917856784 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f302804bdc0 con 0x7f30300c6190 2023-11-30T17:22:34.131 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:34.128+0000 7f8cd95b5680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T17:22:34.145 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:34.144+0000 7f5e62552680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T17:22:34.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.259+0000 7f3035e30700 1 -- 172.21.15.49:0/917856784 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f303006c860 con 0x7f30300c6190 2023-11-30T17:22:34.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.262+0000 7f30177fe700 1 -- 172.21.15.49:0/917856784 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v11)=0 v11) v1 ==== 138+0+0 (secure 0 0 0) 0x7f302804f3e0 con 0x7f30300c6190 2023-11-30T17:22:34.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.264+0000 7f3035e30700 1 -- 172.21.15.49:0/917856784 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f301c05f2c0 msgr2=0x7f301c061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:22:34.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.264+0000 7f3035e30700 1 --2- 172.21.15.49:0/917856784 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f301c05f2c0 0x7f301c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:34.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.264+0000 7f3035e30700 1 -- 172.21.15.49:0/917856784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30300c6190 msgr2=0x7f3030150e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:34.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.264+0000 7f3035e30700 1 --2- 172.21.15.49:0/917856784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30300c6190 0x7f3030150e40 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f3028002230 tx=0x7f3028007f70).stop 2023-11-30T17:22:34.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.264+0000 7f3035e30700 1 -- 172.21.15.49:0/917856784 shutdown_connections 2023-11-30T17:22:34.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.264+0000 7f3035e30700 1 --2- 172.21.15.49:0/917856784 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f301c05f2c0 0x7f301c061780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:34.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.264+0000 7f3035e30700 1 --2- 172.21.15.49:0/917856784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30300c6190 0x7f3030150e40 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:34.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.264+0000 7f3035e30700 1 --2- 172.21.15.49:0/917856784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3030064350 0x7f30300aa690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:34.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.264+0000 7f3035e30700 1 --2- 172.21.15.49:0/917856784 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3030098d10 0x7f303014add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:34.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.264+0000 7f3035e30700 1 -- 172.21.15.49:0/917856784 >> 172.21.15.49:0/917856784 conn(0x7f30300cb310 msgr2=0x7f30300c9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:34.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.264+0000 7f3035e30700 1 -- 172.21.15.49:0/917856784 shutdown_connections 2023-11-30T17:22:34.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.264+0000 7f3035e30700 1 -- 172.21.15.49:0/917856784 wait complete. 2023-11-30T17:22:34.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:22:34.278 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-11-30T17:22:34.298 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-11-30T17:22:34.404 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:34.402+0000 7f8cd95b5680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T17:22:34.438 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:34.436+0000 7f5e62552680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T17:22:34.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.459+0000 7fb816665700 1 Processor -- start 2023-11-30T17:22:34.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.459+0000 7fb816665700 1 -- start start 2023-11-30T17:22:34.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.460+0000 7fb816665700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb81013b0b0 0x7fb8100c6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:34.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.460+0000 7fb816665700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8100c6550 0x7fb8100c7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:34.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.460+0000 7fb816665700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb810156d50 con 0x7fb81013acd0 2023-11-30T17:22:34.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.460+0000 7fb816665700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8100c69a0 con 0x7fb81013b0b0 2023-11-30T17:22:34.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.460+0000 7fb816665700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb810156140 con 0x7fb8100c6550 2023-11-30T17:22:34.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.460+0000 7fb80f7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb81013b0b0 0x7fb8100c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:34.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.461+0000 7fb80f7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb81013b0b0 0x7fb8100c6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44788/0 (socket says 172.21.15.49:44788) 2023-11-30T17:22:34.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.461+0000 7fb80f7fe700 1 -- 172.21.15.49:0/3648391019 learned_addr learned my addr 172.21.15.49:0/3648391019 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:34.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.461+0000 7fb814c02700 1 --2- 172.21.15.49:0/3648391019 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8100c6550 0x7fb8100c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:34.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.461+0000 7fb80effd700 1 -- 172.21.15.49:0/3648391019 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 788978734 0 0) 0x7fb810156d50 con 0x7fb81013acd0 2023-11-30T17:22:34.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.461+0000 7fb80f7fe700 1 -- 172.21.15.49:0/3648391019 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8100c6550 msgr2=0x7fb8100c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:34.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.461+0000 7fb80f7fe700 1 --2- 172.21.15.49:0/3648391019 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8100c6550 0x7fb8100c7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:34.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.461+0000 7fb80f7fe700 1 -- 172.21.15.49:0/3648391019 >> v1:172.21.15.115:6789/0 conn(0x7fb81013acd0 legacy=0x7fb81013b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:34.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.461+0000 7fb80f7fe700 1 -- 172.21.15.49:0/3648391019 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb810156420 con 0x7fb81013b0b0 2023-11-30T17:22:34.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.461+0000 7fb80f7fe700 1 --2- 172.21.15.49:0/3648391019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb81013b0b0 0x7fb8100c6060 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7fb800006fd0 tx=0x7fb8000090f0).ready entity=mon.0 client_cookie=35663d0fc0cd90b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:34.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.461+0000 7fb80effd700 1 -- 172.21.15.49:0/3648391019 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80000b580 con 0x7fb81013b0b0 2023-11-30T17:22:34.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.461+0000 7fb80effd700 1 -- 172.21.15.49:0/3648391019 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80000b6e0 con 0x7fb81013b0b0 2023-11-30T17:22:34.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.461+0000 7fb80effd700 1 -- 172.21.15.49:0/3648391019 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80000ba80 con 0x7fb81013b0b0 2023-11-30T17:22:34.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.462+0000 7fb816665700 1 -- 172.21.15.49:0/3648391019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb81013b0b0 msgr2=0x7fb8100c6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:34.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.462+0000 7fb816665700 1 --2- 172.21.15.49:0/3648391019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb81013b0b0 0x7fb8100c6060 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7fb800006fd0 tx=0x7fb8000090f0).stop 2023-11-30T17:22:34.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.462+0000 7fb816665700 1 -- 172.21.15.49:0/3648391019 shutdown_connections 2023-11-30T17:22:34.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.462+0000 7fb816665700 1 --2- 172.21.15.49:0/3648391019 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8100c6550 0x7fb8100c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:34.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.462+0000 7fb816665700 1 --2- 172.21.15.49:0/3648391019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb81013b0b0 0x7fb8100c6060 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:34.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.462+0000 7fb816665700 1 -- 172.21.15.49:0/3648391019 >> 172.21.15.49:0/3648391019 conn(0x7fb8100628f0 msgr2=0x7fb810062d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:34.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.462+0000 7fb816665700 1 -- 172.21.15.49:0/3648391019 shutdown_connections 2023-11-30T17:22:34.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.462+0000 7fb816665700 1 -- 172.21.15.49:0/3648391019 wait complete. 2023-11-30T17:22:34.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.463+0000 7fb816665700 1 Processor -- start 2023-11-30T17:22:34.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.463+0000 7fb816665700 1 -- start start 2023-11-30T17:22:34.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.464+0000 7fb816665700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8100c6550 0x7fb8100aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:34.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.464+0000 7fb816665700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb81013acd0 0x7fb8100c0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:34.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.464+0000 7fb816665700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb81013b0b0 0x7fb8100c0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:34.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.464+0000 7fb816665700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8100c3ee0 con 0x7fb81013b0b0 2023-11-30T17:22:34.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.464+0000 7fb816665700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb810151ea0 con 0x7fb8100c6550 2023-11-30T17:22:34.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.464+0000 7fb816665700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8100c0cc0 con 0x7fb81013acd0 2023-11-30T17:22:34.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.464+0000 7fb814c02700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb81013b0b0 0x7fb8100c0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:34.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.464+0000 7fb814c02700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb81013b0b0 0x7fb8100c0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44796/0 (socket says 172.21.15.49:44796) 2023-11-30T17:22:34.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.464+0000 7fb814c02700 1 -- 172.21.15.49:0/4066797057 learned_addr learned my addr 172.21.15.49:0/4066797057 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:34.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.464+0000 7fb80f7fe700 1 --2- 172.21.15.49:0/4066797057 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb81013acd0 0x7fb8100c0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:34.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.464+0000 7fb80ffff700 1 --2- 172.21.15.49:0/4066797057 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8100c6550 0x7fb8100aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:34.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.465+0000 7fb814c02700 1 -- 172.21.15.49:0/4066797057 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb81013acd0 msgr2=0x7fb8100c0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:34.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.465+0000 7fb814c02700 1 --2- 172.21.15.49:0/4066797057 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb81013acd0 0x7fb8100c0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:34.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.465+0000 7fb814c02700 1 -- 172.21.15.49:0/4066797057 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8100c6550 msgr2=0x7fb8100aadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:34.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.465+0000 7fb814c02700 1 --2- 172.21.15.49:0/4066797057 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8100c6550 0x7fb8100aadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:34.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.465+0000 7fb814c02700 1 -- 172.21.15.49:0/4066797057 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb800009370 con 0x7fb81013b0b0 2023-11-30T17:22:34.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.465+0000 7fb80f7fe700 1 --2- 172.21.15.49:0/4066797057 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb81013acd0 0x7fb8100c0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:22:34.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.465+0000 7fb814c02700 1 --2- 172.21.15.49:0/4066797057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb81013b0b0 0x7fb8100c0640 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7fb808009e90 tx=0x7fb80800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:34.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.465+0000 7fb7f7fff700 1 -- 172.21.15.49:0/4066797057 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80800caa0 con 0x7fb81013b0b0 2023-11-30T17:22:34.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.465+0000 7fb7f7fff700 1 -- 172.21.15.49:0/4066797057 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80800f040 con 0x7fb81013b0b0 2023-11-30T17:22:34.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.465+0000 7fb816665700 1 -- 172.21.15.49:0/4066797057 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8100c0fa0 con 0x7fb81013b0b0 2023-11-30T17:22:34.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.465+0000 7fb7f7fff700 1 -- 172.21.15.49:0/4066797057 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80800ce10 con 0x7fb81013b0b0 2023-11-30T17:22:34.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.465+0000 7fb816665700 1 -- 172.21.15.49:0/4066797057 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8100c1560 con 0x7fb81013b0b0 2023-11-30T17:22:34.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.466+0000 7fb816665700 1 -- 172.21.15.49:0/4066797057 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb81006c860 con 0x7fb81013b0b0 2023-11-30T17:22:34.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.466+0000 7fb7f7fff700 1 -- 172.21.15.49:0/4066797057 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 25) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fb808013610 con 0x7fb81013b0b0 2023-11-30T17:22:34.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.467+0000 7fb7f7fff700 1 --2- 172.21.15.49:0/4066797057 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb7fc05f2c0 0x7fb7fc061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:34.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.467+0000 7fb80ffff700 1 -- 172.21.15.49:0/4066797057 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb7fc05f2c0 msgr2=0x7fb7fc061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:34.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.467+0000 7fb7f7fff700 1 -- 172.21.15.49:0/4066797057 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fb80807ac40 con 0x7fb81013b0b0 2023-11-30T17:22:34.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.467+0000 7fb80ffff700 1 --2- 172.21.15.49:0/4066797057 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb7fc05f2c0 0x7fb7fc061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:22:34.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.471+0000 7fb7f7fff700 1 -- 172.21.15.49:0/4066797057 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb808080020 con 0x7fb81013b0b0 2023-11-30T17:22:34.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.668+0000 7fb80ffff700 1 -- 172.21.15.49:0/4066797057 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb7fc05f2c0 msgr2=0x7fb7fc061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:34.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.668+0000 7fb80ffff700 1 --2- 172.21.15.49:0/4066797057 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb7fc05f2c0 0x7fb7fc061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:22:34.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:34.673+0000 7fb816665700 1 -- 172.21.15.49:0/4066797057 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb810156700 con 0x7fb7fc05f2c0 2023-11-30T17:22:35.016 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:35.014+0000 7f8cd95b5680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T17:22:35.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:35.076+0000 7fb80ffff700 1 -- 172.21.15.49:0/4066797057 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb7fc05f2c0 msgr2=0x7fb7fc061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:35.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:35.076+0000 7fb80ffff700 1 --2- 172.21.15.49:0/4066797057 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb7fc05f2c0 0x7fb7fc061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-11-30T17:22:35.088 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:35.086+0000 7f8cd95b5680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T17:22:35.105 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:35.104+0000 7f5e62552680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T17:22:35.174 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:35.172+0000 7f5e62552680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T17:22:35.275 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:35.272+0000 7f8cd95b5680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T17:22:35.367 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:35.366+0000 7f5e62552680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T17:22:35.694 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:35.692+0000 7f8cd95b5680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T17:22:35.798 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:35.795+0000 7f8cd95b5680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:22:35.805 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:35.803+0000 7f5e62552680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T17:22:35.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:35.877+0000 7fb80ffff700 1 -- 172.21.15.49:0/4066797057 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb7fc05f2c0 msgr2=0x7fb7fc061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:35.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:35.877+0000 7fb80ffff700 1 --2- 172.21.15.49:0/4066797057 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb7fc05f2c0 0x7fb7fc061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-11-30T17:22:35.913 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:35.912+0000 7f5e62552680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:22:35.949 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:35.947+0000 7f8cd95b5680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T17:22:36.024 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:36.022+0000 7f8cd95b5680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T17:22:36.072 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:36.070+0000 7f5e62552680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T17:22:36.091 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:36.089+0000 7f8cd95b5680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T17:22:36.149 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:36.148+0000 7f5e62552680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T17:22:36.219 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:36.218+0000 7f5e62552680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T17:22:36.350 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:36.348+0000 7f8cd95b5680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T17:22:36.491 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:36.490+0000 7f5e62552680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T17:22:36.532 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:36.530+0000 7f8cd95b5680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T17:22:36.683 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:36.681+0000 7f5e62552680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T17:22:37.182 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:37.180+0000 7f8cd95b5680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T17:22:37.250 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:37.248+0000 7f8cd95b5680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T17:22:37.326 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:37.324+0000 7f8cd95b5680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T17:22:37.367 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:37.366+0000 7f5e62552680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T17:22:37.438 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:37.437+0000 7f5e62552680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T17:22:37.475 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:37.473+0000 7f8cd95b5680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T17:22:37.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:37.479+0000 7fb80ffff700 1 -- 172.21.15.49:0/4066797057 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb7fc05f2c0 msgr2=0x7fb7fc061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:37.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:37.479+0000 7fb80ffff700 1 --2- 172.21.15.49:0/4066797057 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb7fc05f2c0 0x7fb7fc061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-11-30T17:22:37.516 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:37.515+0000 7f5e62552680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T17:22:37.546 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:37.544+0000 7f8cd95b5680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T17:22:37.661 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:37.659+0000 7f8cd95b5680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T17:22:37.669 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:37.668+0000 7f5e62552680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T17:22:37.742 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:37.741+0000 7f5e62552680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T17:22:37.769 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:37.767+0000 7f8cd95b5680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:22:37.862 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:37.861+0000 7f5e62552680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T17:22:37.976 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:37.975+0000 7f5e62552680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:22:38.060 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:38.057+0000 7f8cd95b5680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T17:22:38.131 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:38.129+0000 7f8cd95b5680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T17:22:38.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:38.153+0000 7fb7f7fff700 1 -- 172.21.15.49:0/4066797057 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 26) v1 ==== 75287+0+0 (secure 0 0 0) 0x7fb808078870 con 0x7fb81013b0b0 2023-11-30T17:22:38.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:38.153+0000 7fb7f7fff700 1 -- 172.21.15.49:0/4066797057 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb7fc05f2c0 msgr2=0x7fb7fc061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:22:38.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:38.153+0000 7fb7f7fff700 1 --2- 172.21.15.49:0/4066797057 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb7fc05f2c0 0x7fb7fc061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:38.215 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:38.213+0000 7f8c50540700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:22:38.216 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:38.213+0000 7f8c50540700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:22:38.216 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:38.213+0000 7f8c50540700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:22:38.216 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:38.213+0000 7f8c50540700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:22:38.216 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:38.213+0000 7f8c50540700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:22:38.216 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:38.213+0000 7f8c4dd3b700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:22:38.216 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:38.213+0000 7f8c4dd3b700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:22:38.216 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:38.213+0000 7f8c4dd3b700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:22:38.216 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:38.213+0000 7f8c4dd3b700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:22:38.216 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:38.213+0000 7f8c4dd3b700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:22:38.282 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:38.281+0000 7f5e62552680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T17:22:38.356 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:38.355+0000 7f5e62552680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T17:22:39.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.153+0000 7fb7f7fff700 1 -- 172.21.15.49:0/4066797057 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mgrmap(e 27) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fb808078bf0 con 0x7fb81013b0b0 2023-11-30T17:22:39.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.153+0000 7fb7f7fff700 1 --2- 172.21.15.49:0/4066797057 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb7fc05f2c0 0x7fb7fc061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:39.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.153+0000 7fb7f7fff700 1 -- 172.21.15.49:0/4066797057 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb810156700 con 0x7fb7fc05f2c0 2023-11-30T17:22:39.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.155+0000 7fb80ffff700 1 --2- 172.21.15.49:0/4066797057 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb7fc05f2c0 0x7fb7fc061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:39.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.156+0000 7fb80ffff700 1 --2- 172.21.15.49:0/4066797057 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb7fc05f2c0 0x7fb7fc061700 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fb8040011e0 tx=0x7fb804007bb0).ready entity=mgr.6292 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:39.160 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:39.157+0000 7f8c58d51700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-11-30T17:22:39.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.159+0000 7fb7f7fff700 1 -- 172.21.15.49:0/4066797057 <== mgr.6292 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7fb810156700 con 0x7fb7fc05f2c0 2023-11-30T17:22:39.162 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-11-30T17:22:39.165 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-11-30T17:22:39.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:22:39.166 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-11-30T17:22:39.185 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-11-30T17:22:39.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.347+0000 7f2287d20700 1 Processor -- start 2023-11-30T17:22:39.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.347+0000 7f2287d20700 1 -- start start 2023-11-30T17:22:39.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.348+0000 7f2287d20700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2280098d10 0x7f22800c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:39.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.348+0000 7f2287d20700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2280158320 0x7f22801587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:39.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.348+0000 7f2287d20700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2280158cc0 con 0x7f22800c6190 2023-11-30T17:22:39.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.348+0000 7f2287d20700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22800c72d0 con 0x7f2280158320 2023-11-30T17:22:39.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.348+0000 7f2287d20700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2280064570 con 0x7f2280098d10 2023-11-30T17:22:39.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.348+0000 7f22852bb700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f22800c6190 0x7f2280063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43196/0 (socket says 172.21.15.49:43196) 2023-11-30T17:22:39.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.348+0000 7f22852bb700 1 -- 172.21.15.49:0/2148200893 learned_addr learned my addr 172.21.15.49:0/2148200893 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:39.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.348+0000 7f2285abc700 1 --2- 172.21.15.49:0/2148200893 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2280098d10 0x7f22800c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:39.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.348+0000 7f22862bd700 1 --2- 172.21.15.49:0/2148200893 >> v2:172.21.15.115:3300/0 conn(0x7f2280158320 0x7f22801587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.348+0000 7f2284aba700 1 -- 172.21.15.49:0/2148200893 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2660651112 0 0) 0x7f2274001110 con 0x7f22800c6190 2023-11-30T17:22:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.348+0000 7f2284aba700 1 -- 172.21.15.49:0/2148200893 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22680033f0 con 0x7f22800c6190 2023-11-30T17:22:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.348+0000 7f2285abc700 1 -- 172.21.15.49:0/2148200893 >> v2:172.21.15.115:3300/0 conn(0x7f2280158320 msgr2=0x7f22801587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.348+0000 7f2285abc700 1 --2- 172.21.15.49:0/2148200893 >> v2:172.21.15.115:3300/0 conn(0x7f2280158320 0x7f22801587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.348+0000 7f2285abc700 1 -- 172.21.15.49:0/2148200893 >> v1:172.21.15.49:6789/0 conn(0x7f22800c6190 legacy=0x7f2280063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.348+0000 7f2285abc700 1 -- 172.21.15.49:0/2148200893 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2280154bc0 con 0x7f2280098d10 2023-11-30T17:22:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.348+0000 7f2285abc700 1 --2- 172.21.15.49:0/2148200893 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2280098d10 0x7f22800c7760 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f2278009e60 tx=0x7f2278009780).ready entity=mon.2 client_cookie=411ac94f06c2e737 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.349+0000 7f2284aba700 1 -- 172.21.15.49:0/2148200893 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227800e070 con 0x7f2280098d10 2023-11-30T17:22:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.349+0000 7f2284aba700 1 -- 172.21.15.49:0/2148200893 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227800bab0 con 0x7f2280098d10 2023-11-30T17:22:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.349+0000 7f2284aba700 1 -- 172.21.15.49:0/2148200893 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227800be30 con 0x7f2280098d10 2023-11-30T17:22:39.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.349+0000 7f2287d20700 1 -- 172.21.15.49:0/2148200893 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2280098d10 msgr2=0x7f22800c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:39.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.349+0000 7f2287d20700 1 --2- 172.21.15.49:0/2148200893 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2280098d10 0x7f22800c7760 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f2278009e60 tx=0x7f2278009780).stop 2023-11-30T17:22:39.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.349+0000 7f2287d20700 1 -- 172.21.15.49:0/2148200893 shutdown_connections 2023-11-30T17:22:39.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.349+0000 7f2287d20700 1 --2- 172.21.15.49:0/2148200893 >> v2:172.21.15.115:3300/0 conn(0x7f2280158320 0x7f22801587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:39.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.349+0000 7f2287d20700 1 --2- 172.21.15.49:0/2148200893 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2280098d10 0x7f22800c7760 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:39.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.349+0000 7f2287d20700 1 -- 172.21.15.49:0/2148200893 >> 172.21.15.49:0/2148200893 conn(0x7f22800cb310 msgr2=0x7f22800cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:39.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.349+0000 7f2287d20700 1 -- 172.21.15.49:0/2148200893 shutdown_connections 2023-11-30T17:22:39.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.349+0000 7f2287d20700 1 -- 172.21.15.49:0/2148200893 wait complete. 2023-11-30T17:22:39.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.350+0000 7f2287d20700 1 Processor -- start 2023-11-30T17:22:39.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.350+0000 7f2287d20700 1 -- start start 2023-11-30T17:22:39.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.351+0000 7f2287d20700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2280098d10 0x7f2280156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:39.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.351+0000 7f2287d20700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22800c6190 0x7f2280143f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:39.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.351+0000 7f2287d20700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2280158320 0x7f22800c0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:39.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.351+0000 7f2287d20700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2280157560 con 0x7f22800c6190 2023-11-30T17:22:39.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.351+0000 7f2287d20700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2280156950 con 0x7f2280098d10 2023-11-30T17:22:39.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.351+0000 7f2287d20700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2280156c30 con 0x7f2280158320 2023-11-30T17:22:39.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.351+0000 7f22852bb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22800c6190 0x7f2280143f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:39.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.351+0000 7f22852bb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22800c6190 0x7f2280143f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44806/0 (socket says 172.21.15.49:44806) 2023-11-30T17:22:39.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.351+0000 7f22852bb700 1 -- 172.21.15.49:0/3496333458 learned_addr learned my addr 172.21.15.49:0/3496333458 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:39.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.351+0000 7f2285abc700 1 --2- 172.21.15.49:0/3496333458 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2280098d10 0x7f2280156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:39.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.351+0000 7f22862bd700 1 --2- 172.21.15.49:0/3496333458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2280158320 0x7f22800c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:39.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.351+0000 7f22852bb700 1 -- 172.21.15.49:0/3496333458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2280158320 msgr2=0x7f22800c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:39.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.352+0000 7f22852bb700 1 --2- 172.21.15.49:0/3496333458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2280158320 0x7f22800c0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:39.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.352+0000 7f22852bb700 1 -- 172.21.15.49:0/3496333458 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2280098d10 msgr2=0x7f2280156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:39.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.352+0000 7f22852bb700 1 --2- 172.21.15.49:0/3496333458 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2280098d10 0x7f2280156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:39.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.352+0000 7f22852bb700 1 -- 172.21.15.49:0/3496333458 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2278009a20 con 0x7f22800c6190 2023-11-30T17:22:39.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.352+0000 7f2285abc700 1 --2- 172.21.15.49:0/3496333458 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2280098d10 0x7f2280156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:39.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.352+0000 7f22852bb700 1 --2- 172.21.15.49:0/3496333458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22800c6190 0x7f2280143f30 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7f227400c470 tx=0x7f2274007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:39.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.352+0000 7f227dffb700 1 -- 172.21.15.49:0/3496333458 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22740072e0 con 0x7f22800c6190 2023-11-30T17:22:39.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.352+0000 7f227dffb700 1 -- 172.21.15.49:0/3496333458 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2274007440 con 0x7f22800c6190 2023-11-30T17:22:39.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.352+0000 7f2287d20700 1 -- 172.21.15.49:0/3496333458 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2280156f10 con 0x7f22800c6190 2023-11-30T17:22:39.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.352+0000 7f227dffb700 1 -- 172.21.15.49:0/3496333458 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22740057a0 con 0x7f22800c6190 2023-11-30T17:22:39.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.352+0000 7f2287d20700 1 -- 172.21.15.49:0/3496333458 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2280151550 con 0x7f22800c6190 2023-11-30T17:22:39.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.353+0000 7f2287d20700 1 -- 172.21.15.49:0/3496333458 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22801576d0 con 0x7f22800c6190 2023-11-30T17:22:39.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.353+0000 7f227dffb700 1 -- 172.21.15.49:0/3496333458 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 27) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f2274005b50 con 0x7f22800c6190 2023-11-30T17:22:39.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.354+0000 7f227dffb700 1 --2- 172.21.15.49:0/3496333458 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f226c05f050 0x7f226c061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:39.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.354+0000 7f227dffb700 1 -- 172.21.15.49:0/3496333458 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6407+0+0 (secure 0 0 0) 0x7f2274079820 con 0x7f22800c6190 2023-11-30T17:22:39.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.354+0000 7f2285abc700 1 --2- 172.21.15.49:0/3496333458 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f226c05f050 0x7f226c061510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:39.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.354+0000 7f2285abc700 1 --2- 172.21.15.49:0/3496333458 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f226c05f050 0x7f226c061510 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f22780097c0 tx=0x7f22800a8040).ready entity=mgr.6292 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:39.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.358+0000 7f227dffb700 1 -- 172.21.15.49:0/3496333458 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f227404aba0 con 0x7f22800c6190 2023-11-30T17:22:39.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:39.578+0000 7f2287d20700 1 -- 172.21.15.49:0/3496333458 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f2280158cc0 con 0x7f22800c6190 2023-11-30T17:22:40.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.158+0000 7f227dffb700 1 -- 172.21.15.49:0/3496333458 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 28) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f22740776a0 con 0x7f22800c6190 2023-11-30T17:22:40.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.159+0000 7f227dffb700 1 -- 172.21.15.49:0/3496333458 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v28) v1 ==== 93+0+0 (secure 0 0 0) 0x7f227401d440 con 0x7f22800c6190 2023-11-30T17:22:40.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.162+0000 7f2287d20700 1 -- 172.21.15.49:0/3496333458 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f226c05f050 msgr2=0x7f226c061510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:40.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.162+0000 7f2287d20700 1 --2- 172.21.15.49:0/3496333458 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f226c05f050 0x7f226c061510 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f22780097c0 tx=0x7f22800a8040).stop 2023-11-30T17:22:40.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.162+0000 7f2287d20700 1 -- 172.21.15.49:0/3496333458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22800c6190 msgr2=0x7f2280143f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:40.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.162+0000 7f2287d20700 1 --2- 172.21.15.49:0/3496333458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22800c6190 0x7f2280143f30 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7f227400c470 tx=0x7f2274007ad0).stop 2023-11-30T17:22:40.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.162+0000 7f2287d20700 1 -- 172.21.15.49:0/3496333458 shutdown_connections 2023-11-30T17:22:40.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.162+0000 7f2287d20700 1 --2- 172.21.15.49:0/3496333458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2280158320 0x7f22800c0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:40.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.162+0000 7f2287d20700 1 --2- 172.21.15.49:0/3496333458 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2280098d10 0x7f2280156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:40.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.162+0000 7f2287d20700 1 --2- 172.21.15.49:0/3496333458 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f226c05f050 0x7f226c061510 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:40.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.162+0000 7f2287d20700 1 --2- 172.21.15.49:0/3496333458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22800c6190 0x7f2280143f30 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:40.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.162+0000 7f2287d20700 1 -- 172.21.15.49:0/3496333458 >> 172.21.15.49:0/3496333458 conn(0x7f22800cb310 msgr2=0x7f2280151960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:40.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.162+0000 7f2287d20700 1 -- 172.21.15.49:0/3496333458 shutdown_connections 2023-11-30T17:22:40.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.162+0000 7f2287d20700 1 -- 172.21.15.49:0/3496333458 wait complete. 2023-11-30T17:22:40.179 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-30T17:22:40.179 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T17:22:40.223 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T17:22:40.264 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-30T17:22:40.264 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-30T17:22:40.264 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:22:40.264 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-30T17:22:40.305 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-11-30T17:22:40.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:22:40.306 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-30T17:22:40.309 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:40.307+0000 7f5342644680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T17:22:40.309 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:40.308+0000 7f72e0d02680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T17:22:40.325 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:22:40.373 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:40.371+0000 7f5342644680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T17:22:40.378 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:40.377+0000 7f72e0d02680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T17:22:40.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.484+0000 7f3f01f9e700 1 Processor -- start 2023-11-30T17:22:40.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.484+0000 7f3f01f9e700 1 -- start start 2023-11-30T17:22:40.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.485+0000 7f3f01f9e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3efc1544e0 0x7f3efc1548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:40.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.485+0000 7f3f01f9e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3efc0c69a0 con 0x7f3efc06a610 2023-11-30T17:22:40.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.485+0000 7f3f01f9e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3efc0c13a0 con 0x7f3efc0c6e30 2023-11-30T17:22:40.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.485+0000 7f3f01f9e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3efc0c1680 con 0x7f3efc1544e0 2023-11-30T17:22:40.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.485+0000 7f3efb7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3efc1544e0 0x7f3efc1548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:40.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.485+0000 7f3efb7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3efc1544e0 0x7f3efc1548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44834/0 (socket says 172.21.15.49:44834) 2023-11-30T17:22:40.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.485+0000 7f3efb7fe700 1 -- 172.21.15.49:0/1376976412 learned_addr learned my addr 172.21.15.49:0/1376976412 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:40.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.485+0000 7f3efaffd700 1 --1- 172.21.15.49:0/1376976412 >> v1:172.21.15.49:6789/0 conn(0x7f3efc06a610 0x7f3efc0c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43218/0 (socket says 172.21.15.49:43218) 2023-11-30T17:22:40.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.486+0000 7f3efb7fe700 1 -- 172.21.15.49:0/1376976412 >> v1:172.21.15.115:6789/0 conn(0x7f3efc0c6e30 legacy=0x7f3efc0a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:40.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.486+0000 7f3efb7fe700 1 -- 172.21.15.49:0/1376976412 >> v1:172.21.15.49:6789/0 conn(0x7f3efc06a610 legacy=0x7f3efc0c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:40.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.486+0000 7f3efa7fc700 1 -- 172.21.15.49:0/1376976412 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360218168 0 0) 0x7f3efc0c69a0 con 0x7f3efc06a610 2023-11-30T17:22:40.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.486+0000 7f3efb7fe700 1 -- 172.21.15.49:0/1376976412 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3efc0c6630 con 0x7f3efc1544e0 2023-11-30T17:22:40.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.486+0000 7f3efb7fe700 1 --2- 172.21.15.49:0/1376976412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3efc1544e0 0x7f3efc1548c0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f3eec009810 tx=0x7f3eec009060).ready entity=mon.0 client_cookie=234382ff3d8d022e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:40.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.486+0000 7f3efa7fc700 1 -- 172.21.15.49:0/1376976412 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec005880 con 0x7f3efc1544e0 2023-11-30T17:22:40.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.486+0000 7f3efa7fc700 1 -- 172.21.15.49:0/1376976412 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eec0059e0 con 0x7f3efc1544e0 2023-11-30T17:22:40.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.486+0000 7f3efa7fc700 1 -- 172.21.15.49:0/1376976412 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec005d60 con 0x7f3efc1544e0 2023-11-30T17:22:40.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.486+0000 7f3f01f9e700 1 -- 172.21.15.49:0/1376976412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3efc1544e0 msgr2=0x7f3efc1548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:40.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.486+0000 7f3f01f9e700 1 --2- 172.21.15.49:0/1376976412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3efc1544e0 0x7f3efc1548c0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f3eec009810 tx=0x7f3eec009060).stop 2023-11-30T17:22:40.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.486+0000 7f3f01f9e700 1 -- 172.21.15.49:0/1376976412 shutdown_connections 2023-11-30T17:22:40.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.486+0000 7f3f01f9e700 1 --2- 172.21.15.49:0/1376976412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3efc1544e0 0x7f3efc1548c0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:40.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.486+0000 7f3f01f9e700 1 -- 172.21.15.49:0/1376976412 >> 172.21.15.49:0/1376976412 conn(0x7f3efc085020 msgr2=0x7f3efc094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:40.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.486+0000 7f3f01f9e700 1 -- 172.21.15.49:0/1376976412 shutdown_connections 2023-11-30T17:22:40.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.486+0000 7f3f01f9e700 1 -- 172.21.15.49:0/1376976412 wait complete. 2023-11-30T17:22:40.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.488+0000 7f3f01f9e700 1 Processor -- start 2023-11-30T17:22:40.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.488+0000 7f3f01f9e700 1 -- start start 2023-11-30T17:22:40.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.488+0000 7f3f01f9e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3efc06a610 0x7f3efc095f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:40.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.488+0000 7f3f01f9e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3efc0c6e30 0x7f3efc14ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:40.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.488+0000 7f3f01f9e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3efc1544e0 0x7f3efc151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:40.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.489+0000 7f3f01f9e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc151680 con 0x7f3efc1544e0 2023-11-30T17:22:40.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.489+0000 7f3f01f9e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc150a70 con 0x7f3efc06a610 2023-11-30T17:22:40.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.489+0000 7f3f01f9e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc150d50 con 0x7f3efc0c6e30 2023-11-30T17:22:40.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.489+0000 7f3efbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3efc1544e0 0x7f3efc151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:40.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.489+0000 7f3efbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3efc1544e0 0x7f3efc151b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44842/0 (socket says 172.21.15.49:44842) 2023-11-30T17:22:40.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.489+0000 7f3efb7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3efc06a610 0x7f3efc095f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:40.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.489+0000 7f3efbfff700 1 -- 172.21.15.49:0/3316186374 learned_addr learned my addr 172.21.15.49:0/3316186374 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:40.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.489+0000 7f3efaffd700 1 --2- 172.21.15.49:0/3316186374 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3efc0c6e30 0x7f3efc14ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:40.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.489+0000 7f3efbfff700 1 -- 172.21.15.49:0/3316186374 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3efc0c6e30 msgr2=0x7f3efc14ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:40.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.489+0000 7f3efbfff700 1 --2- 172.21.15.49:0/3316186374 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3efc0c6e30 0x7f3efc14ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:40.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.489+0000 7f3efbfff700 1 -- 172.21.15.49:0/3316186374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3efc06a610 msgr2=0x7f3efc095f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:40.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.489+0000 7f3efbfff700 1 --2- 172.21.15.49:0/3316186374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3efc06a610 0x7f3efc095f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:40.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.489+0000 7f3efbfff700 1 -- 172.21.15.49:0/3316186374 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec009300 con 0x7f3efc1544e0 2023-11-30T17:22:40.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.489+0000 7f3efbfff700 1 --2- 172.21.15.49:0/3316186374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3efc1544e0 0x7f3efc151b10 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f3ef400c7c0 tx=0x7f3ef4001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:40.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.489+0000 7f3ee37fe700 1 -- 172.21.15.49:0/3316186374 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef400e4a0 con 0x7f3efc1544e0 2023-11-30T17:22:40.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.489+0000 7f3ee37fe700 1 -- 172.21.15.49:0/3316186374 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef400e600 con 0x7f3efc1544e0 2023-11-30T17:22:40.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.489+0000 7f3f01f9e700 1 -- 172.21.15.49:0/3316186374 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3efc151030 con 0x7f3efc1544e0 2023-11-30T17:22:40.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.489+0000 7f3ee37fe700 1 -- 172.21.15.49:0/3316186374 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef400e980 con 0x7f3efc1544e0 2023-11-30T17:22:40.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.489+0000 7f3f01f9e700 1 -- 172.21.15.49:0/3316186374 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3efc1504a0 con 0x7f3efc1544e0 2023-11-30T17:22:40.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.490+0000 7f3f01f9e700 1 -- 172.21.15.49:0/3316186374 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3efc1506c0 con 0x7f3efc1544e0 2023-11-30T17:22:40.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.491+0000 7f3ee37fe700 1 -- 172.21.15.49:0/3316186374 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 28) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f3ef40123f0 con 0x7f3efc1544e0 2023-11-30T17:22:40.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.491+0000 7f3ee37fe700 1 --2- 172.21.15.49:0/3316186374 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3ee805f030 0x7f3ee80614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:40.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.491+0000 7f3ee37fe700 1 -- 172.21.15.49:0/3316186374 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6407+0+0 (secure 0 0 0) 0x7f3ef4079890 con 0x7f3efc1544e0 2023-11-30T17:22:40.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.491+0000 7f3efb7fe700 1 -- 172.21.15.49:0/3316186374 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3ee805f030 msgr2=0x7f3ee80614f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:40.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.491+0000 7f3efb7fe700 1 --2- 172.21.15.49:0/3316186374 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3ee805f030 0x7f3ee80614f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:22:40.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.499+0000 7f3ee37fe700 1 -- 172.21.15.49:0/3316186374 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3ef4047b00 con 0x7f3efc1544e0 2023-11-30T17:22:40.647 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:40.645+0000 7f5342644680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T17:22:40.675 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:40.674+0000 7f72e0d02680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T17:22:40.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.692+0000 7f3efb7fe700 1 -- 172.21.15.49:0/3316186374 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3ee805f030 msgr2=0x7f3ee80614f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:40.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.692+0000 7f3efb7fe700 1 --2- 172.21.15.49:0/3316186374 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3ee805f030 0x7f3ee80614f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:22:40.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.716+0000 7f3f01f9e700 1 -- 172.21.15.49:0/3316186374 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3efc06c860 con 0x7f3efc1544e0 2023-11-30T17:22:40.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.717+0000 7f3ee37fe700 1 -- 172.21.15.49:0/3316186374 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f3ef404abb0 con 0x7f3efc1544e0 2023-11-30T17:22:40.718 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:40.718 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/3245104889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3245104889},{"type":"v1","addr":"172.21.15.115:6836","nonce":3245104889}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5579,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1933850814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1933850814},{"type":"v1","addr":"172.21.15.115:6837","nonce":1933850814}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6225,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1356528561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1356528561},{"type":"v1","addr":"172.21.15.49:6834","nonce":1356528561}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:22:21.305720+0000","modified":"2023-11-30T17:22:24.320718+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6228},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6228":{"gid":6228,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1786065897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1786065897},{"type":"v1","addr":"172.21.15.49:6835","nonce":1786065897}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-11-30T17:22:40.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.719+0000 7f3f01f9e700 1 -- 172.21.15.49:0/3316186374 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3ee805f030 msgr2=0x7f3ee80614f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:22:40.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.719+0000 7f3f01f9e700 1 --2- 172.21.15.49:0/3316186374 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3ee805f030 0x7f3ee80614f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:40.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.719+0000 7f3f01f9e700 1 -- 172.21.15.49:0/3316186374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3efc1544e0 msgr2=0x7f3efc151b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:40.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.719+0000 7f3f01f9e700 1 --2- 172.21.15.49:0/3316186374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3efc1544e0 0x7f3efc151b10 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f3ef400c7c0 tx=0x7f3ef4001510).stop 2023-11-30T17:22:40.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.719+0000 7f3f01f9e700 1 -- 172.21.15.49:0/3316186374 shutdown_connections 2023-11-30T17:22:40.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.719+0000 7f3f01f9e700 1 --2- 172.21.15.49:0/3316186374 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3ee805f030 0x7f3ee80614f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:40.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.719+0000 7f3f01f9e700 1 --2- 172.21.15.49:0/3316186374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3efc1544e0 0x7f3efc151b10 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:40.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.719+0000 7f3f01f9e700 1 --2- 172.21.15.49:0/3316186374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3efc06a610 0x7f3efc095f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:40.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.719+0000 7f3f01f9e700 1 --2- 172.21.15.49:0/3316186374 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3efc0c6e30 0x7f3efc14ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:40.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.719+0000 7f3f01f9e700 1 -- 172.21.15.49:0/3316186374 >> 172.21.15.49:0/3316186374 conn(0x7f3efc085020 msgr2=0x7f3efc0aef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:40.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.719+0000 7f3f01f9e700 1 -- 172.21.15.49:0/3316186374 shutdown_connections 2023-11-30T17:22:40.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.719+0000 7f3f01f9e700 1 -- 172.21.15.49:0/3316186374 wait complete. 2023-11-30T17:22:40.722 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 32 2023-11-30T17:22:40.734 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:22:40.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.891+0000 7f4a827e7700 1 Processor -- start 2023-11-30T17:22:40.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.891+0000 7f4a827e7700 1 -- start start 2023-11-30T17:22:40.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.891+0000 7f4a827e7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a7c0caab0 0x7f4a7c0aa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:40.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.891+0000 7f4a827e7700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4a7c0ca180 0x7f4a7c15e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:40.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.891+0000 7f4a827e7700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a7c0a9a90 con 0x7f4a7c0cae90 2023-11-30T17:22:40.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.891+0000 7f4a827e7700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a7c154ce0 con 0x7f4a7c0ca180 2023-11-30T17:22:40.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.891+0000 7f4a827e7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c0a8e80 con 0x7f4a7c0caab0 2023-11-30T17:22:40.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.892+0000 7f4a80d84700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4a7c0ca180 0x7f4a7c15e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:40.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.892+0000 7f4a80d84700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4a7c0ca180 0x7f4a7c15e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45936/0 (socket says 172.21.15.49:45936) 2023-11-30T17:22:40.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.892+0000 7f4a80d84700 1 -- 172.21.15.49:0/3243940323 learned_addr learned my addr 172.21.15.49:0/3243940323 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:40.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.892+0000 7f4a7bfff700 1 --2- 172.21.15.49:0/3243940323 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a7c0caab0 0x7f4a7c0aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:40.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.892+0000 7f4a80d84700 1 -- 172.21.15.49:0/3243940323 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a7c0caab0 msgr2=0x7f4a7c0aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:40.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.892+0000 7f4a80d84700 1 --2- 172.21.15.49:0/3243940323 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a7c0caab0 0x7f4a7c0aa470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:40.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.892+0000 7f4a80d84700 1 -- 172.21.15.49:0/3243940323 >> v1:172.21.15.115:6789/0 conn(0x7f4a7c0cae90 legacy=0x7f4a7c0c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:40.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.892+0000 7f4a7affd700 1 -- 172.21.15.49:0/3243940323 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1806171510 0 0) 0x7f4a7c0a9a90 con 0x7f4a7c0cae90 2023-11-30T17:22:40.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.892+0000 7f4a80d84700 1 -- 172.21.15.49:0/3243940323 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7c0a9160 con 0x7f4a7c0ca180 2023-11-30T17:22:40.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.892+0000 7f4a80d84700 1 --2- 172.21.15.49:0/3243940323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a7c0ca180 0x7f4a7c15e3c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f4a74009f20 tx=0x7f4a74009840).ready entity=mon.0 client_cookie=7ce2dd64b0e0768b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:40.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.892+0000 7f4a7affd700 1 -- 172.21.15.49:0/3243940323 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7400e070 con 0x7f4a7c0ca180 2023-11-30T17:22:40.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.892+0000 7f4a7affd700 1 -- 172.21.15.49:0/3243940323 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a7400b9d0 con 0x7f4a7c0ca180 2023-11-30T17:22:40.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.892+0000 7f4a7affd700 1 -- 172.21.15.49:0/3243940323 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7400bd50 con 0x7f4a7c0ca180 2023-11-30T17:22:40.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.893+0000 7f4a827e7700 1 -- 172.21.15.49:0/3243940323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a7c0ca180 msgr2=0x7f4a7c15e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:40.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.893+0000 7f4a827e7700 1 --2- 172.21.15.49:0/3243940323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a7c0ca180 0x7f4a7c15e3c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f4a74009f20 tx=0x7f4a74009840).stop 2023-11-30T17:22:40.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.893+0000 7f4a827e7700 1 -- 172.21.15.49:0/3243940323 shutdown_connections 2023-11-30T17:22:40.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.893+0000 7f4a827e7700 1 --2- 172.21.15.49:0/3243940323 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a7c0caab0 0x7f4a7c0aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:40.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.893+0000 7f4a827e7700 1 --2- 172.21.15.49:0/3243940323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a7c0ca180 0x7f4a7c15e3c0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:40.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.893+0000 7f4a827e7700 1 -- 172.21.15.49:0/3243940323 >> 172.21.15.49:0/3243940323 conn(0x7f4a7c094920 msgr2=0x7f4a7c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:40.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.893+0000 7f4a827e7700 1 -- 172.21.15.49:0/3243940323 shutdown_connections 2023-11-30T17:22:40.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.893+0000 7f4a827e7700 1 -- 172.21.15.49:0/3243940323 wait complete. 2023-11-30T17:22:40.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.894+0000 7f4a827e7700 1 Processor -- start 2023-11-30T17:22:40.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.894+0000 7f4a827e7700 1 -- start start 2023-11-30T17:22:40.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.895+0000 7f4a827e7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a7c0ca180 0x7f4a7c1688c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:40.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.895+0000 7f4a827e7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a7c0caab0 0x7f4a7c1524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:40.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.895+0000 7f4a827e7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a7c0cae90 0x7f4a7c15a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:40.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.895+0000 7f4a827e7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c152990 con 0x7f4a7c0caab0 2023-11-30T17:22:40.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.895+0000 7f4a827e7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c0aee30 con 0x7f4a7c0ca180 2023-11-30T17:22:40.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.895+0000 7f4a827e7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c0ae220 con 0x7f4a7c0cae90 2023-11-30T17:22:40.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.895+0000 7f4a7b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a7c0caab0 0x7f4a7c1524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:40.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.895+0000 7f4a7bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a7c0ca180 0x7f4a7c1688c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:40.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.895+0000 7f4a80d84700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a7c0cae90 0x7f4a7c15a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:40.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.895+0000 7f4a7b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a7c0caab0 0x7f4a7c1524a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45950/0 (socket says 172.21.15.49:45950) 2023-11-30T17:22:40.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.895+0000 7f4a7b7fe700 1 -- 172.21.15.49:0/1353379878 learned_addr learned my addr 172.21.15.49:0/1353379878 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:40.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.896+0000 7f4a7b7fe700 1 -- 172.21.15.49:0/1353379878 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a7c0cae90 msgr2=0x7f4a7c15a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:40.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.896+0000 7f4a7b7fe700 1 --2- 172.21.15.49:0/1353379878 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a7c0cae90 0x7f4a7c15a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:40.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.896+0000 7f4a7b7fe700 1 -- 172.21.15.49:0/1353379878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a7c0ca180 msgr2=0x7f4a7c1688c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:40.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.896+0000 7f4a7b7fe700 1 --2- 172.21.15.49:0/1353379878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a7c0ca180 0x7f4a7c1688c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:40.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.896+0000 7f4a7b7fe700 1 -- 172.21.15.49:0/1353379878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a74009ae0 con 0x7f4a7c0caab0 2023-11-30T17:22:40.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.896+0000 7f4a7b7fe700 1 --2- 172.21.15.49:0/1353379878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a7c0caab0 0x7f4a7c1524a0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f4a6c00c490 tx=0x7f4a6c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:40.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.896+0000 7f4a73fff700 1 -- 172.21.15.49:0/1353379878 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c007020 con 0x7f4a7c0caab0 2023-11-30T17:22:40.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.896+0000 7f4a73fff700 1 -- 172.21.15.49:0/1353379878 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6c0071a0 con 0x7f4a7c0caab0 2023-11-30T17:22:40.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.896+0000 7f4a827e7700 1 -- 172.21.15.49:0/1353379878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a7c0ae500 con 0x7f4a7c0caab0 2023-11-30T17:22:40.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.896+0000 7f4a73fff700 1 -- 172.21.15.49:0/1353379878 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c007560 con 0x7f4a7c0caab0 2023-11-30T17:22:40.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.896+0000 7f4a827e7700 1 -- 172.21.15.49:0/1353379878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a7c0aeac0 con 0x7f4a7c0caab0 2023-11-30T17:22:40.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.897+0000 7f4a73fff700 1 -- 172.21.15.49:0/1353379878 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 28) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f4a6c006ac0 con 0x7f4a7c0caab0 2023-11-30T17:22:40.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.897+0000 7f4a827e7700 1 -- 172.21.15.49:0/1353379878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a7c0ca560 con 0x7f4a7c0caab0 2023-11-30T17:22:40.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.898+0000 7f4a73fff700 1 --2- 172.21.15.49:0/1353379878 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4a5c05f030 0x7f4a5c0614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:40.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.898+0000 7f4a7bfff700 1 -- 172.21.15.49:0/1353379878 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4a5c05f030 msgr2=0x7f4a5c0614f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:40.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.898+0000 7f4a73fff700 1 -- 172.21.15.49:0/1353379878 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6407+0+0 (secure 0 0 0) 0x7f4a6c001e40 con 0x7f4a7c0caab0 2023-11-30T17:22:40.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.898+0000 7f4a7bfff700 1 --2- 172.21.15.49:0/1353379878 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4a5c05f030 0x7f4a5c0614f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:22:40.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:40.902+0000 7f4a73fff700 1 -- 172.21.15.49:0/1353379878 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4a6c04b000 con 0x7f4a7c0caab0 2023-11-30T17:22:41.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.091+0000 7f4a827e7700 1 -- 172.21.15.49:0/1353379878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a7c06c860 con 0x7f4a7c0caab0 2023-11-30T17:22:41.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.092+0000 7f4a73fff700 1 -- 172.21.15.49:0/1353379878 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+17345 (secure 0 0 0) 0x7f4a6c04e620 con 0x7f4a7c0caab0 2023-11-30T17:22:41.094 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:41.094 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":84,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:22:38.144216+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:22:19.274919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-30T17:22:20.286346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/1814309049":"2023-12-01T17:22:38.144175+0000","172.21.15.115:6833/89956":"2023-12-01T17:22:38.144175+0000","172.21.15.115:6832/89956":"2023-12-01T17:22:38.144175+0000","172.21.15.115:0/4214471495":"2023-12-01T17:22:38.144175+0000","172.21.15.115:0/3198129794":"2023-12-01T17:22:38.144175+0000","172.21.15.115:0/939691547":"2023-12-01T17:22:38.144175+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:22:41.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.094+0000 7f4a827e7700 1 -- 172.21.15.49:0/1353379878 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4a5c05f030 msgr2=0x7f4a5c0614f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:22:41.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.094+0000 7f4a827e7700 1 --2- 172.21.15.49:0/1353379878 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4a5c05f030 0x7f4a5c0614f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:41.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.094+0000 7f4a827e7700 1 -- 172.21.15.49:0/1353379878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a7c0caab0 msgr2=0x7f4a7c1524a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:41.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.094+0000 7f4a827e7700 1 --2- 172.21.15.49:0/1353379878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a7c0caab0 0x7f4a7c1524a0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f4a6c00c490 tx=0x7f4a6c007d70).stop 2023-11-30T17:22:41.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.094+0000 7f4a827e7700 1 -- 172.21.15.49:0/1353379878 shutdown_connections 2023-11-30T17:22:41.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.094+0000 7f4a827e7700 1 --2- 172.21.15.49:0/1353379878 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a7c0cae90 0x7f4a7c15a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:41.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.094+0000 7f4a827e7700 1 --2- 172.21.15.49:0/1353379878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a7c0ca180 0x7f4a7c1688c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:41.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.094+0000 7f4a827e7700 1 --2- 172.21.15.49:0/1353379878 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4a5c05f030 0x7f4a5c0614f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:41.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.094+0000 7f4a827e7700 1 --2- 172.21.15.49:0/1353379878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a7c0caab0 0x7f4a7c1524a0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:41.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.094+0000 7f4a827e7700 1 -- 172.21.15.49:0/1353379878 >> 172.21.15.49:0/1353379878 conn(0x7f4a7c094920 msgr2=0x7f4a7c0c6600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:41.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.094+0000 7f4a827e7700 1 -- 172.21.15.49:0/1353379878 shutdown_connections 2023-11-30T17:22:41.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.094+0000 7f4a827e7700 1 -- 172.21.15.49:0/1353379878 wait complete. 2023-11-30T17:22:41.108 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-30T17:22:19.274919+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-11-30T17:22:20.286346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-30T17:22:41.109 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T17:22:41.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.233+0000 7fd743076700 1 Processor -- start 2023-11-30T17:22:41.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.233+0000 7fd743076700 1 -- start start 2023-11-30T17:22:41.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.234+0000 7fd743076700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd73c14eb00 0x7fd73c14eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:41.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.234+0000 7fd743076700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd73c0bc6c0 0x7fd73c0bcb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:41.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.234+0000 7fd743076700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd73c062770 0x7fd73c062c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:41.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.234+0000 7fd743076700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd73c137d90 con 0x7fd73c0bc6c0 2023-11-30T17:22:41.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.234+0000 7fd743076700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd73c0bd060 con 0x7fd73c14eb00 2023-11-30T17:22:41.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.234+0000 7fd743076700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c0634a0 con 0x7fd73c062770 2023-11-30T17:22:41.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.234+0000 7fd73bfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd73c0bc6c0 0x7fd73c0bcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:41.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.234+0000 7fd73bfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd73c0bc6c0 0x7fd73c0bcb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45952/0 (socket says 172.21.15.49:45952) 2023-11-30T17:22:41.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.234+0000 7fd73bfff700 1 -- 172.21.15.49:0/1107904211 learned_addr learned my addr 172.21.15.49:0/1107904211 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:41.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.235+0000 7fd741613700 1 --2- 172.21.15.49:0/1107904211 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd73c062770 0x7fd73c062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:41.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.235+0000 7fd740e12700 1 --2- 172.21.15.49:0/1107904211 >> v2:172.21.15.115:3300/0 conn(0x7fd73c14eb00 0x7fd73c14eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:41.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.235+0000 7fd73bfff700 1 -- 172.21.15.49:0/1107904211 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd73c062770 msgr2=0x7fd73c062c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:41.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.235+0000 7fd73bfff700 1 --2- 172.21.15.49:0/1107904211 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd73c062770 0x7fd73c062c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:41.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.235+0000 7fd73bfff700 1 -- 172.21.15.49:0/1107904211 >> v2:172.21.15.115:3300/0 conn(0x7fd73c14eb00 msgr2=0x7fd73c14eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:41.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.235+0000 7fd73bfff700 1 --2- 172.21.15.49:0/1107904211 >> v2:172.21.15.115:3300/0 conn(0x7fd73c14eb00 0x7fd73c14eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:41.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.235+0000 7fd73bfff700 1 -- 172.21.15.49:0/1107904211 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73c063780 con 0x7fd73c0bc6c0 2023-11-30T17:22:41.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.235+0000 7fd73bfff700 1 --2- 172.21.15.49:0/1107904211 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd73c0bc6c0 0x7fd73c0bcb70 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7fd73c064660 tx=0x7fd728009060).ready entity=mon.0 client_cookie=e0dab0a3e79e728a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:41.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.235+0000 7fd73b7fe700 1 -- 172.21.15.49:0/1107904211 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd728005880 con 0x7fd73c0bc6c0 2023-11-30T17:22:41.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.235+0000 7fd73b7fe700 1 -- 172.21.15.49:0/1107904211 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7280059e0 con 0x7fd73c0bc6c0 2023-11-30T17:22:41.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.235+0000 7fd73b7fe700 1 -- 172.21.15.49:0/1107904211 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd728005d60 con 0x7fd73c0bc6c0 2023-11-30T17:22:41.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.236+0000 7fd743076700 1 -- 172.21.15.49:0/1107904211 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd73c0bc6c0 msgr2=0x7fd73c0bcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:41.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.236+0000 7fd743076700 1 --2- 172.21.15.49:0/1107904211 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd73c0bc6c0 0x7fd73c0bcb70 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7fd73c064660 tx=0x7fd728009060).stop 2023-11-30T17:22:41.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.236+0000 7fd743076700 1 -- 172.21.15.49:0/1107904211 shutdown_connections 2023-11-30T17:22:41.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.236+0000 7fd743076700 1 --2- 172.21.15.49:0/1107904211 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd73c062770 0x7fd73c062c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:41.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.236+0000 7fd743076700 1 --2- 172.21.15.49:0/1107904211 >> v2:172.21.15.115:3300/0 conn(0x7fd73c14eb00 0x7fd73c14eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:41.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.236+0000 7fd743076700 1 --2- 172.21.15.49:0/1107904211 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd73c0bc6c0 0x7fd73c0bcb70 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:41.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.236+0000 7fd743076700 1 -- 172.21.15.49:0/1107904211 >> 172.21.15.49:0/1107904211 conn(0x7fd73c0c8230 msgr2=0x7fd73c0c4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:41.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.236+0000 7fd743076700 1 -- 172.21.15.49:0/1107904211 shutdown_connections 2023-11-30T17:22:41.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.236+0000 7fd743076700 1 -- 172.21.15.49:0/1107904211 wait complete. 2023-11-30T17:22:41.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.237+0000 7fd743076700 1 Processor -- start 2023-11-30T17:22:41.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.237+0000 7fd743076700 1 -- start start 2023-11-30T17:22:41.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.238+0000 7fd743076700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd73c062770 0x7fd73c0aa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:41.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.238+0000 7fd743076700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0bc6c0 0x7fd73c0acd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:41.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.238+0000 7fd743076700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd73c14eb00 0x7fd73c1363c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:41.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.238+0000 7fd743076700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c0aad90 con 0x7fd73c14eb00 2023-11-30T17:22:41.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.238+0000 7fd743076700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c0bff30 con 0x7fd73c0bc6c0 2023-11-30T17:22:41.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.238+0000 7fd743076700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c0ad230 con 0x7fd73c062770 2023-11-30T17:22:41.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.238+0000 7fd741613700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd73c14eb00 0x7fd73c1363c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:41.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.238+0000 7fd73bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0bc6c0 0x7fd73c0acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:41.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.238+0000 7fd73bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0bc6c0 0x7fd73c0acd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:38712/0 (socket says 172.21.15.49:38712) 2023-11-30T17:22:41.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.238+0000 7fd740e12700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd73c062770 0x7fd73c0aa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:41.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.238+0000 7fd741613700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd73c14eb00 0x7fd73c1363c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45964/0 (socket says 172.21.15.49:45964) 2023-11-30T17:22:41.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.238+0000 7fd73bfff700 1 -- 172.21.15.49:0/1054457191 learned_addr learned my addr 172.21.15.49:0/1054457191 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:41.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.238+0000 7fd741613700 1 -- 172.21.15.49:0/1054457191 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd73c062770 msgr2=0x7fd73c0aa8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:41.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.238+0000 7fd741613700 1 --2- 172.21.15.49:0/1054457191 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd73c062770 0x7fd73c0aa8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:41.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.238+0000 7fd741613700 1 -- 172.21.15.49:0/1054457191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0bc6c0 msgr2=0x7fd73c0acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:41.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.238+0000 7fd741613700 1 --2- 172.21.15.49:0/1054457191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0bc6c0 0x7fd73c0acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:41.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.238+0000 7fd741613700 1 -- 172.21.15.49:0/1054457191 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd728009300 con 0x7fd73c14eb00 2023-11-30T17:22:41.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.238+0000 7fd73bfff700 1 --2- 172.21.15.49:0/1054457191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0bc6c0 0x7fd73c0acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:22:41.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.239+0000 7fd741613700 1 --2- 172.21.15.49:0/1054457191 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd73c14eb00 0x7fd73c1363c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7fd73400ecc0 tx=0x7fd73400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:41.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.239+0000 7fd738ff9700 1 -- 172.21.15.49:0/1054457191 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73400c8c0 con 0x7fd73c14eb00 2023-11-30T17:22:41.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.239+0000 7fd738ff9700 1 -- 172.21.15.49:0/1054457191 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73400f040 con 0x7fd73c14eb00 2023-11-30T17:22:41.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.239+0000 7fd743076700 1 -- 172.21.15.49:0/1054457191 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd73c0ad760 con 0x7fd73c14eb00 2023-11-30T17:22:41.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.239+0000 7fd738ff9700 1 -- 172.21.15.49:0/1054457191 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73400cc30 con 0x7fd73c14eb00 2023-11-30T17:22:41.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.239+0000 7fd743076700 1 -- 172.21.15.49:0/1054457191 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd73c0ad480 con 0x7fd73c14eb00 2023-11-30T17:22:41.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.240+0000 7fd743076700 1 -- 172.21.15.49:0/1054457191 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd73c0c00c0 con 0x7fd73c14eb00 2023-11-30T17:22:41.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.241+0000 7fd738ff9700 1 -- 172.21.15.49:0/1054457191 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 29) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fd73401d460 con 0x7fd73c14eb00 2023-11-30T17:22:41.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.241+0000 7fd738ff9700 1 --2- 172.21.15.49:0/1054457191 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd72005f300 0x7fd7200617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:41.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.241+0000 7fd738ff9700 1 -- 172.21.15.49:0/1054457191 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6407+0+0 (secure 0 0 0) 0x7fd73407ad10 con 0x7fd73c14eb00 2023-11-30T17:22:41.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.241+0000 7fd740e12700 1 -- 172.21.15.49:0/1054457191 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd72005f300 msgr2=0x7fd7200617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:41.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.241+0000 7fd740e12700 1 --2- 172.21.15.49:0/1054457191 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd72005f300 0x7fd7200617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:22:41.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.245+0000 7fd738ff9700 1 -- 172.21.15.49:0/1054457191 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd73404bbd0 con 0x7fd73c14eb00 2023-11-30T17:22:41.263 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:41.260+0000 7f5342644680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T17:22:41.334 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:41.331+0000 7f5342644680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T17:22:41.380 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:41.379+0000 7f72e0d02680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T17:22:41.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.442+0000 7fd740e12700 1 -- 172.21.15.49:0/1054457191 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd72005f300 msgr2=0x7fd7200617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:41.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.442+0000 7fd740e12700 1 --2- 172.21.15.49:0/1054457191 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd72005f300 0x7fd7200617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:22:41.449 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:41.448+0000 7f72e0d02680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T17:22:41.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.464+0000 7fd743076700 1 -- 172.21.15.49:0/1054457191 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd73c06c860 con 0x7fd73c14eb00 2023-11-30T17:22:41.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.465+0000 7fd738ff9700 1 -- 172.21.15.49:0/1054457191 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v84) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd73404f1f0 con 0x7fd73c14eb00 2023-11-30T17:22:41.466 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T17:22:41.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.466+0000 7fd743076700 1 -- 172.21.15.49:0/1054457191 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd72005f300 msgr2=0x7fd7200617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:22:41.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.466+0000 7fd743076700 1 --2- 172.21.15.49:0/1054457191 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd72005f300 0x7fd7200617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:41.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.466+0000 7fd743076700 1 -- 172.21.15.49:0/1054457191 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd73c14eb00 msgr2=0x7fd73c1363c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:41.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.466+0000 7fd743076700 1 --2- 172.21.15.49:0/1054457191 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd73c14eb00 0x7fd73c1363c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7fd73400ecc0 tx=0x7fd73400b040).stop 2023-11-30T17:22:41.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.467+0000 7fd743076700 1 -- 172.21.15.49:0/1054457191 shutdown_connections 2023-11-30T17:22:41.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.467+0000 7fd743076700 1 --2- 172.21.15.49:0/1054457191 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd72005f300 0x7fd7200617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:41.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.467+0000 7fd743076700 1 --2- 172.21.15.49:0/1054457191 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd73c14eb00 0x7fd73c1363c0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:41.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.467+0000 7fd743076700 1 --2- 172.21.15.49:0/1054457191 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd73c062770 0x7fd73c0aa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:41.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.467+0000 7fd743076700 1 --2- 172.21.15.49:0/1054457191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0bc6c0 0x7fd73c0acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:41.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.467+0000 7fd743076700 1 -- 172.21.15.49:0/1054457191 >> 172.21.15.49:0/1054457191 conn(0x7fd73c0c8230 msgr2=0x7fd73c152bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:41.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.467+0000 7fd743076700 1 -- 172.21.15.49:0/1054457191 shutdown_connections 2023-11-30T17:22:41.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.467+0000 7fd743076700 1 -- 172.21.15.49:0/1054457191 wait complete. 2023-11-30T17:22:41.480 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T17:22:41.520 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:41.518+0000 7f5342644680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T17:22:41.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.604+0000 7fa476662700 1 Processor -- start 2023-11-30T17:22:41.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.604+0000 7fa476662700 1 -- start start 2023-11-30T17:22:41.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.605+0000 7fa476662700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa4700bcba0 0x7fa4701547f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:41.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.605+0000 7fa476662700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa470068df0 con 0x7fa470069e50 2023-11-30T17:22:41.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.605+0000 7fa476662700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa470069090 con 0x7fa470154410 2023-11-30T17:22:41.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.605+0000 7fa476662700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa470069370 con 0x7fa4700bcba0 2023-11-30T17:22:41.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.605+0000 7fa46f7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa470069e50 0x7fa4700bc490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45358/0 (socket says 172.21.15.49:45358) 2023-11-30T17:22:41.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.605+0000 7fa46f7fe700 1 -- 172.21.15.49:0/2675459827 learned_addr learned my addr 172.21.15.49:0/2675459827 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:41.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.605+0000 7fa474bff700 1 --2- 172.21.15.49:0/2675459827 >> v2:172.21.15.115:3300/0 conn(0x7fa4700bcba0 0x7fa4701547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:41.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.605+0000 7fa46effd700 1 -- 172.21.15.49:0/2675459827 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3365669669 0 0) 0x7fa470068df0 con 0x7fa470069e50 2023-11-30T17:22:41.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.605+0000 7fa46effd700 1 -- 172.21.15.49:0/2675459827 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4580033f0 con 0x7fa470069e50 2023-11-30T17:22:41.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.605+0000 7fa46effd700 1 -- 172.21.15.49:0/2675459827 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1713782933 0 0) 0x7fa470069090 con 0x7fa470154410 2023-11-30T17:22:41.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.605+0000 7fa46effd700 1 -- 172.21.15.49:0/2675459827 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa470068df0 con 0x7fa470154410 2023-11-30T17:22:41.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.605+0000 7fa474bff700 1 -- 172.21.15.49:0/2675459827 >> v1:172.21.15.115:6789/0 conn(0x7fa470154410 legacy=0x7fa470158c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:41.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.605+0000 7fa474bff700 1 -- 172.21.15.49:0/2675459827 >> v1:172.21.15.49:6789/0 conn(0x7fa470069e50 legacy=0x7fa4700bc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:41.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.605+0000 7fa474bff700 1 -- 172.21.15.49:0/2675459827 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa470069650 con 0x7fa4700bcba0 2023-11-30T17:22:41.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.606+0000 7fa474bff700 1 --2- 172.21.15.49:0/2675459827 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4700bcba0 0x7fa4701547f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7fa468009e60 tx=0x7fa468009780).ready entity=mon.1 client_cookie=a6bccc3b4f17f246 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:41.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.606+0000 7fa46effd700 1 -- 172.21.15.49:0/2675459827 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46800e070 con 0x7fa4700bcba0 2023-11-30T17:22:41.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.606+0000 7fa46effd700 1 -- 172.21.15.49:0/2675459827 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46800bab0 con 0x7fa4700bcba0 2023-11-30T17:22:41.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.606+0000 7fa46effd700 1 -- 172.21.15.49:0/2675459827 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46800be30 con 0x7fa4700bcba0 2023-11-30T17:22:41.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.606+0000 7fa476662700 1 -- 172.21.15.49:0/2675459827 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4700bcba0 msgr2=0x7fa4701547f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:41.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.606+0000 7fa476662700 1 --2- 172.21.15.49:0/2675459827 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4700bcba0 0x7fa4701547f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7fa468009e60 tx=0x7fa468009780).stop 2023-11-30T17:22:41.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.606+0000 7fa476662700 1 -- 172.21.15.49:0/2675459827 shutdown_connections 2023-11-30T17:22:41.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.606+0000 7fa476662700 1 --2- 172.21.15.49:0/2675459827 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4700bcba0 0x7fa4701547f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:41.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.606+0000 7fa476662700 1 -- 172.21.15.49:0/2675459827 >> 172.21.15.49:0/2675459827 conn(0x7fa4700c7fb0 msgr2=0x7fa4700c3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:41.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.606+0000 7fa476662700 1 -- 172.21.15.49:0/2675459827 shutdown_connections 2023-11-30T17:22:41.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.607+0000 7fa476662700 1 -- 172.21.15.49:0/2675459827 wait complete. 2023-11-30T17:22:41.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.608+0000 7fa476662700 1 Processor -- start 2023-11-30T17:22:41.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.608+0000 7fa476662700 1 -- start start 2023-11-30T17:22:41.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.609+0000 7fa476662700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa470069e50 0x7fa470144310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:41.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.609+0000 7fa476662700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa4700bcba0 0x7fa470152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:41.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.609+0000 7fa476662700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa470154410 0x7fa4701532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:41.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.609+0000 7fa476662700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa470144800 con 0x7fa470154410 2023-11-30T17:22:41.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.609+0000 7fa476662700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4701537a0 con 0x7fa470069e50 2023-11-30T17:22:41.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.609+0000 7fa476662700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4700a5690 con 0x7fa4700bcba0 2023-11-30T17:22:41.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.609+0000 7fa474bff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa470154410 0x7fa4701532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:41.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.609+0000 7fa46ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa470069e50 0x7fa470144310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:41.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.609+0000 7fa474bff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa470154410 0x7fa4701532b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45978/0 (socket says 172.21.15.49:45978) 2023-11-30T17:22:41.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.609+0000 7fa46ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa470069e50 0x7fa470144310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:38742/0 (socket says 172.21.15.49:38742) 2023-11-30T17:22:41.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.609+0000 7fa46f7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa4700bcba0 0x7fa470152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:41.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.609+0000 7fa474bff700 1 -- 172.21.15.49:0/2863426561 learned_addr learned my addr 172.21.15.49:0/2863426561 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:41.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.609+0000 7fa474bff700 1 -- 172.21.15.49:0/2863426561 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa4700bcba0 msgr2=0x7fa470152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:41.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.609+0000 7fa474bff700 1 --2- 172.21.15.49:0/2863426561 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa4700bcba0 0x7fa470152dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:41.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.609+0000 7fa474bff700 1 -- 172.21.15.49:0/2863426561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa470069e50 msgr2=0x7fa470144310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:41.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.609+0000 7fa474bff700 1 --2- 172.21.15.49:0/2863426561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa470069e50 0x7fa470144310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:41.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.609+0000 7fa474bff700 1 -- 172.21.15.49:0/2863426561 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa468009a20 con 0x7fa470154410 2023-11-30T17:22:41.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.609+0000 7fa474bff700 1 --2- 172.21.15.49:0/2863426561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa470154410 0x7fa4701532b0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7fa47005e4a0 tx=0x7fa470068f80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:41.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.609+0000 7fa457fff700 1 -- 172.21.15.49:0/2863426561 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa468013e40 con 0x7fa470154410 2023-11-30T17:22:41.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.609+0000 7fa457fff700 1 -- 172.21.15.49:0/2863426561 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46801d630 con 0x7fa470154410 2023-11-30T17:22:41.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.609+0000 7fa476662700 1 -- 172.21.15.49:0/2863426561 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4700a4a80 con 0x7fa470154410 2023-11-30T17:22:41.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.609+0000 7fa457fff700 1 -- 172.21.15.49:0/2863426561 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46801d9f0 con 0x7fa470154410 2023-11-30T17:22:41.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.610+0000 7fa476662700 1 -- 172.21.15.49:0/2863426561 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4700a5040 con 0x7fa470154410 2023-11-30T17:22:41.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.610+0000 7fa476662700 1 -- 172.21.15.49:0/2863426561 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa47006c7c0 con 0x7fa470154410 2023-11-30T17:22:41.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.611+0000 7fa457fff700 1 -- 172.21.15.49:0/2863426561 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 29) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fa468003040 con 0x7fa470154410 2023-11-30T17:22:41.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.611+0000 7fa457fff700 1 --2- 172.21.15.49:0/2863426561 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa45c05f300 0x7fa45c0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:41.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.611+0000 7fa46ffff700 1 -- 172.21.15.49:0/2863426561 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa45c05f300 msgr2=0x7fa45c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:41.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.611+0000 7fa457fff700 1 -- 172.21.15.49:0/2863426561 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6407+0+0 (secure 0 0 0) 0x7fa46807c300 con 0x7fa470154410 2023-11-30T17:22:41.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.611+0000 7fa46ffff700 1 --2- 172.21.15.49:0/2863426561 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa45c05f300 0x7fa45c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:22:41.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.616+0000 7fa457fff700 1 -- 172.21.15.49:0/2863426561 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa46804d1a0 con 0x7fa470154410 2023-11-30T17:22:41.650 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:41.649+0000 7f72e0d02680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T17:22:41.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.789+0000 7fa476662700 1 -- 172.21.15.49:0/2863426561 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa4700a57d0 con 0x7fa470154410 2023-11-30T17:22:41.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.789+0000 7fa457fff700 1 -- 172.21.15.49:0/2863426561 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v84) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa4680507c0 con 0x7fa470154410 2023-11-30T17:22:41.791 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T17:22:41.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.791+0000 7fa476662700 1 -- 172.21.15.49:0/2863426561 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa45c05f300 msgr2=0x7fa45c0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:22:41.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.791+0000 7fa476662700 1 --2- 172.21.15.49:0/2863426561 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa45c05f300 0x7fa45c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:41.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.791+0000 7fa476662700 1 -- 172.21.15.49:0/2863426561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa470154410 msgr2=0x7fa4701532b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:41.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.791+0000 7fa476662700 1 --2- 172.21.15.49:0/2863426561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa470154410 0x7fa4701532b0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7fa47005e4a0 tx=0x7fa470068f80).stop 2023-11-30T17:22:41.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.791+0000 7fa476662700 1 -- 172.21.15.49:0/2863426561 shutdown_connections 2023-11-30T17:22:41.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.791+0000 7fa476662700 1 --2- 172.21.15.49:0/2863426561 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa45c05f300 0x7fa45c0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:41.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.791+0000 7fa476662700 1 --2- 172.21.15.49:0/2863426561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa470154410 0x7fa4701532b0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:41.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.791+0000 7fa476662700 1 --2- 172.21.15.49:0/2863426561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa470069e50 0x7fa470144310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:41.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.791+0000 7fa476662700 1 --2- 172.21.15.49:0/2863426561 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa4700bcba0 0x7fa470152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:41.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.791+0000 7fa476662700 1 -- 172.21.15.49:0/2863426561 >> 172.21.15.49:0/2863426561 conn(0x7fa4700c7fb0 msgr2=0x7fa4700acce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:41.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.791+0000 7fa476662700 1 -- 172.21.15.49:0/2863426561 shutdown_connections 2023-11-30T17:22:41.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.791+0000 7fa476662700 1 -- 172.21.15.49:0/2863426561 wait complete. 2023-11-30T17:22:41.805 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-30T17:22:41.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.928+0000 7f997ae41700 1 Processor -- start 2023-11-30T17:22:41.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.928+0000 7f997ae41700 1 -- start start 2023-11-30T17:22:41.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.928+0000 7f997ae41700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9974098d10 0x7f99740c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:41.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.928+0000 7f997ae41700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99740c72d0 con 0x7f9974158320 2023-11-30T17:22:41.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.928+0000 7f997ae41700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9974064570 con 0x7f99740c6190 2023-11-30T17:22:41.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.928+0000 7f997ae41700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9974154bc0 con 0x7f9974098d10 2023-11-30T17:22:41.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.929+0000 7f99793de700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9974158320 0x7f99740a80f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45372/0 (socket says 172.21.15.49:45372) 2023-11-30T17:22:41.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.929+0000 7f99793de700 1 -- 172.21.15.49:0/179528783 learned_addr learned my addr 172.21.15.49:0/179528783 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:41.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.929+0000 7f9978bdd700 1 --2- 172.21.15.49:0/179528783 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9974098d10 0x7f99740c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:41.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.929+0000 7f99737fe700 1 -- 172.21.15.49:0/179528783 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2521182161 0 0) 0x7f99740c72d0 con 0x7f9974158320 2023-11-30T17:22:41.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.929+0000 7f99737fe700 1 -- 172.21.15.49:0/179528783 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99640033f0 con 0x7f9974158320 2023-11-30T17:22:41.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.929+0000 7f99737fe700 1 -- 172.21.15.49:0/179528783 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3100006197 0 0) 0x7f9974064570 con 0x7f99740c6190 2023-11-30T17:22:41.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.929+0000 7f9978bdd700 1 -- 172.21.15.49:0/179528783 >> v1:172.21.15.115:6789/0 conn(0x7f99740c6190 legacy=0x7f9974063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:41.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.929+0000 7f9978bdd700 1 -- 172.21.15.49:0/179528783 >> v1:172.21.15.49:6789/0 conn(0x7f9974158320 legacy=0x7f99740a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:41.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.929+0000 7f9978bdd700 1 -- 172.21.15.49:0/179528783 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99740c66c0 con 0x7f9974098d10 2023-11-30T17:22:41.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.929+0000 7f9978bdd700 1 --2- 172.21.15.49:0/179528783 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9974098d10 0x7f99740c7760 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f9968009790 tx=0x7f9968009060).ready entity=mon.2 client_cookie=957e5763dd3fd3cb server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:41.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.929+0000 7f99737fe700 1 -- 172.21.15.49:0/179528783 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996800f510 con 0x7f9974098d10 2023-11-30T17:22:41.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.929+0000 7f99737fe700 1 -- 172.21.15.49:0/179528783 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996800f670 con 0x7f9974098d10 2023-11-30T17:22:41.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.929+0000 7f99737fe700 1 -- 172.21.15.49:0/179528783 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996800f9f0 con 0x7f9974098d10 2023-11-30T17:22:41.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.930+0000 7f997ae41700 1 -- 172.21.15.49:0/179528783 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9974098d10 msgr2=0x7f99740c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:41.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.930+0000 7f997ae41700 1 --2- 172.21.15.49:0/179528783 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9974098d10 0x7f99740c7760 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f9968009790 tx=0x7f9968009060).stop 2023-11-30T17:22:41.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.930+0000 7f997ae41700 1 -- 172.21.15.49:0/179528783 shutdown_connections 2023-11-30T17:22:41.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.930+0000 7f997ae41700 1 --2- 172.21.15.49:0/179528783 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9974098d10 0x7f99740c7760 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:41.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.930+0000 7f997ae41700 1 -- 172.21.15.49:0/179528783 >> 172.21.15.49:0/179528783 conn(0x7f99740cb310 msgr2=0x7f99740cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:41.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.930+0000 7f997ae41700 1 -- 172.21.15.49:0/179528783 shutdown_connections 2023-11-30T17:22:41.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.930+0000 7f997ae41700 1 -- 172.21.15.49:0/179528783 wait complete. 2023-11-30T17:22:41.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.931+0000 7f997ae41700 1 Processor -- start 2023-11-30T17:22:41.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.931+0000 7f997ae41700 1 -- start start 2023-11-30T17:22:41.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.932+0000 7f997ae41700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9974098d10 0x7f9974163d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:41.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.932+0000 7f997ae41700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99740c6190 0x7f9974151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:41.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.932+0000 7f997ae41700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9974158320 0x7f9974151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:41.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.932+0000 7f997ae41700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9974151f20 con 0x7f9974158320 2023-11-30T17:22:41.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.932+0000 7f997ae41700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99740a9ce0 con 0x7f99740c6190 2023-11-30T17:22:41.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.932+0000 7f997ae41700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99740a9fc0 con 0x7f9974098d10 2023-11-30T17:22:41.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.932+0000 7f99793de700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9974158320 0x7f9974151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:41.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.932+0000 7f99793de700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9974158320 0x7f9974151a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45984/0 (socket says 172.21.15.49:45984) 2023-11-30T17:22:41.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.932+0000 7f99793de700 1 -- 172.21.15.49:0/3346370910 learned_addr learned my addr 172.21.15.49:0/3346370910 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:41.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.932+0000 7f9978bdd700 1 --2- 172.21.15.49:0/3346370910 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9974098d10 0x7f9974163d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:41.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.932+0000 7f9973fff700 1 --2- 172.21.15.49:0/3346370910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99740c6190 0x7f9974151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:41.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.933+0000 7f99793de700 1 -- 172.21.15.49:0/3346370910 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9974098d10 msgr2=0x7f9974163d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:41.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.933+0000 7f99793de700 1 --2- 172.21.15.49:0/3346370910 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9974098d10 0x7f9974163d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:41.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.933+0000 7f99793de700 1 -- 172.21.15.49:0/3346370910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99740c6190 msgr2=0x7f9974151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:41.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.933+0000 7f99793de700 1 --2- 172.21.15.49:0/3346370910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99740c6190 0x7f9974151540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:41.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.933+0000 7f99793de700 1 -- 172.21.15.49:0/3346370910 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99680092a0 con 0x7f9974158320 2023-11-30T17:22:41.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.933+0000 7f9978bdd700 1 --2- 172.21.15.49:0/3346370910 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9974098d10 0x7f9974163d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:22:41.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.933+0000 7f99793de700 1 --2- 172.21.15.49:0/3346370910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9974158320 0x7f9974151a30 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f996c005ad0 tx=0x7f996c001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:41.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.933+0000 7f9970ff9700 1 -- 172.21.15.49:0/3346370910 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c005d30 con 0x7f9974158320 2023-11-30T17:22:41.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.933+0000 7f9970ff9700 1 -- 172.21.15.49:0/3346370910 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996c005e90 con 0x7f9974158320 2023-11-30T17:22:41.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.933+0000 7f997ae41700 1 -- 172.21.15.49:0/3346370910 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99740aa2a0 con 0x7f9974158320 2023-11-30T17:22:41.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.933+0000 7f9970ff9700 1 -- 172.21.15.49:0/3346370910 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c007320 con 0x7f9974158320 2023-11-30T17:22:41.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.933+0000 7f997ae41700 1 -- 172.21.15.49:0/3346370910 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99740a8fb0 con 0x7f9974158320 2023-11-30T17:22:41.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.934+0000 7f997ae41700 1 -- 172.21.15.49:0/3346370910 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99740ae350 con 0x7f9974158320 2023-11-30T17:22:41.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.934+0000 7f9970ff9700 1 -- 172.21.15.49:0/3346370910 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 29) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f996c007710 con 0x7f9974158320 2023-11-30T17:22:41.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.935+0000 7f9970ff9700 1 --2- 172.21.15.49:0/3346370910 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f995805f300 0x7f99580617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:41.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.935+0000 7f9970ff9700 1 -- 172.21.15.49:0/3346370910 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6407+0+0 (secure 0 0 0) 0x7f996c07a4c0 con 0x7f9974158320 2023-11-30T17:22:41.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.935+0000 7f9978bdd700 1 -- 172.21.15.49:0/3346370910 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f995805f300 msgr2=0x7f99580617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:41.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.935+0000 7f9978bdd700 1 --2- 172.21.15.49:0/3346370910 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f995805f300 0x7f99580617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:22:41.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:41.939+0000 7f9970ff9700 1 -- 172.21.15.49:0/3346370910 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f99740ae350 con 0x7f9974158320 2023-11-30T17:22:41.940 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:41.938+0000 7f5342644680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T17:22:42.044 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:42.042+0000 7f5342644680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:22:42.099 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:42.098+0000 7f72e0d02680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T17:22:42.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.111+0000 7f997ae41700 1 -- 172.21.15.49:0/3346370910 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f99740ae350 con 0x7f9974158320 2023-11-30T17:22:42.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.111+0000 7f9970ff9700 1 -- 172.21.15.49:0/3346370910 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7f99740ae350 con 0x7f9974158320 2023-11-30T17:22:42.112 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T17:22:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.113+0000 7f997ae41700 1 -- 172.21.15.49:0/3346370910 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f995805f300 msgr2=0x7f99580617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:22:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.113+0000 7f997ae41700 1 --2- 172.21.15.49:0/3346370910 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f995805f300 0x7f99580617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.113+0000 7f997ae41700 1 -- 172.21.15.49:0/3346370910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9974158320 msgr2=0x7f9974151a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.113+0000 7f997ae41700 1 --2- 172.21.15.49:0/3346370910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9974158320 0x7f9974151a30 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f996c005ad0 tx=0x7f996c001650).stop 2023-11-30T17:22:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.113+0000 7f997ae41700 1 -- 172.21.15.49:0/3346370910 shutdown_connections 2023-11-30T17:22:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.113+0000 7f997ae41700 1 --2- 172.21.15.49:0/3346370910 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f995805f300 0x7f99580617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.113+0000 7f997ae41700 1 --2- 172.21.15.49:0/3346370910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9974158320 0x7f9974151a30 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.113+0000 7f997ae41700 1 --2- 172.21.15.49:0/3346370910 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9974098d10 0x7f9974163d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.113+0000 7f997ae41700 1 --2- 172.21.15.49:0/3346370910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99740c6190 0x7f9974151540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:42.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.113+0000 7f997ae41700 1 -- 172.21.15.49:0/3346370910 >> 172.21.15.49:0/3346370910 conn(0x7f99740cb310 msgr2=0x7f9974063cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:42.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.113+0000 7f997ae41700 1 -- 172.21.15.49:0/3346370910 shutdown_connections 2023-11-30T17:22:42.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.113+0000 7f997ae41700 1 -- 172.21.15.49:0/3346370910 wait complete. 2023-11-30T17:22:42.127 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-30T17:22:42.197 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:42.195+0000 7f5342644680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T17:22:42.214 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:42.212+0000 7f72e0d02680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:22:42.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.248+0000 7f42d9476700 1 Processor -- start 2023-11-30T17:22:42.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.248+0000 7f42d9476700 1 -- start start 2023-11-30T17:22:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.249+0000 7f42d9476700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f42d413be20 0x7f42d40c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.249+0000 7f42d9476700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f42d4062700 0x7f42d4062b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.249+0000 7f42d9476700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d40c7500 con 0x7f42d40c8780 2023-11-30T17:22:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.249+0000 7f42d9476700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d40bd650 con 0x7f42d4062700 2023-11-30T17:22:42.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.249+0000 7f42d9476700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d4063060 con 0x7f42d413be20 2023-11-30T17:22:42.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.249+0000 7f42d37fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f42d4062700 0x7f42d4062b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:42.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.250+0000 7f42d37fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f42d4062700 0x7f42d4062b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45988/0 (socket says 172.21.15.49:45988) 2023-11-30T17:22:42.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.250+0000 7f42d37fe700 1 -- 172.21.15.49:0/1347798853 learned_addr learned my addr 172.21.15.49:0/1347798853 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:42.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.250+0000 7f42d27fc700 1 --1- 172.21.15.49:0/1347798853 >> v1:172.21.15.49:6789/0 conn(0x7f42d40c8780 0x7f42d40bcf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45388/0 (socket says 172.21.15.49:45388) 2023-11-30T17:22:42.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.250+0000 7f42d2ffd700 1 --2- 172.21.15.49:0/1347798853 >> v2:172.21.15.115:3300/0 conn(0x7f42d413be20 0x7f42d40c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:42.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.250+0000 7f42d37fe700 1 -- 172.21.15.49:0/1347798853 >> v2:172.21.15.115:3300/0 conn(0x7f42d413be20 msgr2=0x7f42d40c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:42.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.250+0000 7f42d37fe700 1 --2- 172.21.15.49:0/1347798853 >> v2:172.21.15.115:3300/0 conn(0x7f42d413be20 0x7f42d40c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:42.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.250+0000 7f42d37fe700 1 -- 172.21.15.49:0/1347798853 >> v1:172.21.15.49:6789/0 conn(0x7f42d40c8780 legacy=0x7f42d40bcf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:42.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.250+0000 7f42d1ffb700 1 -- 172.21.15.49:0/1347798853 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907582515 0 0) 0x7f42d40c7500 con 0x7f42d40c8780 2023-11-30T17:22:42.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.250+0000 7f42d37fe700 1 -- 172.21.15.49:0/1347798853 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d413c200 con 0x7f42d4062700 2023-11-30T17:22:42.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.250+0000 7f42d37fe700 1 --2- 172.21.15.49:0/1347798853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42d4062700 0x7f42d4062b70 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f42d405f7f0 tx=0x7f42cc009840).ready entity=mon.0 client_cookie=825749c457fcefe5 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:42.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.250+0000 7f42d1ffb700 1 -- 172.21.15.49:0/1347798853 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc00e070 con 0x7f42d4062700 2023-11-30T17:22:42.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.250+0000 7f42d1ffb700 1 -- 172.21.15.49:0/1347798853 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42cc00ba20 con 0x7f42d4062700 2023-11-30T17:22:42.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.250+0000 7f42d1ffb700 1 -- 172.21.15.49:0/1347798853 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc00bda0 con 0x7f42d4062700 2023-11-30T17:22:42.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.251+0000 7f42d9476700 1 -- 172.21.15.49:0/1347798853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42d4062700 msgr2=0x7f42d4062b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:42.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.251+0000 7f42d9476700 1 --2- 172.21.15.49:0/1347798853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42d4062700 0x7f42d4062b70 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f42d405f7f0 tx=0x7f42cc009840).stop 2023-11-30T17:22:42.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.251+0000 7f42d9476700 1 -- 172.21.15.49:0/1347798853 shutdown_connections 2023-11-30T17:22:42.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.251+0000 7f42d9476700 1 --2- 172.21.15.49:0/1347798853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42d4062700 0x7f42d4062b70 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:42.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.251+0000 7f42d9476700 1 --2- 172.21.15.49:0/1347798853 >> v2:172.21.15.115:3300/0 conn(0x7f42d413be20 0x7f42d40c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:42.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.251+0000 7f42d9476700 1 -- 172.21.15.49:0/1347798853 >> 172.21.15.49:0/1347798853 conn(0x7f42d40642d0 msgr2=0x7f42d40c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:42.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.251+0000 7f42d9476700 1 -- 172.21.15.49:0/1347798853 shutdown_connections 2023-11-30T17:22:42.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.251+0000 7f42d9476700 1 -- 172.21.15.49:0/1347798853 wait complete. 2023-11-30T17:22:42.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.252+0000 7f42d9476700 1 Processor -- start 2023-11-30T17:22:42.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.252+0000 7f42d9476700 1 -- start start 2023-11-30T17:22:42.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.253+0000 7f42d9476700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42d4062700 0x7f42d4138f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:42.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.253+0000 7f42d9476700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42d40c8780 0x7f42d4155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:42.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.253+0000 7f42d9476700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f42d413be20 0x7f42d4155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:42.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.253+0000 7f42d9476700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d4156b80 con 0x7f42d40c8780 2023-11-30T17:22:42.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.253+0000 7f42d9476700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d40a7b40 con 0x7f42d4062700 2023-11-30T17:22:42.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.253+0000 7f42d9476700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d41562e0 con 0x7f42d413be20 2023-11-30T17:22:42.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.253+0000 7f42d27fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42d40c8780 0x7f42d4155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:42.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.253+0000 7f42d27fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42d40c8780 0x7f42d4155790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45994/0 (socket says 172.21.15.49:45994) 2023-11-30T17:22:42.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.253+0000 7f42d27fc700 1 -- 172.21.15.49:0/2713351362 learned_addr learned my addr 172.21.15.49:0/2713351362 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:42.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.253+0000 7f42d2ffd700 1 --2- 172.21.15.49:0/2713351362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42d4062700 0x7f42d4138f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:42.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.253+0000 7f42d37fe700 1 --2- 172.21.15.49:0/2713351362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f42d413be20 0x7f42d4155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:42.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.253+0000 7f42d2ffd700 1 -- 172.21.15.49:0/2713351362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f42d413be20 msgr2=0x7f42d4155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:42.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.253+0000 7f42d2ffd700 1 --2- 172.21.15.49:0/2713351362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f42d413be20 0x7f42d4155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:42.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.253+0000 7f42d2ffd700 1 -- 172.21.15.49:0/2713351362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42d40c8780 msgr2=0x7f42d4155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:42.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.253+0000 7f42d2ffd700 1 --2- 172.21.15.49:0/2713351362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42d40c8780 0x7f42d4155790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:42.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.254+0000 7f42d2ffd700 1 -- 172.21.15.49:0/2713351362 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc009ae0 con 0x7f42d4062700 2023-11-30T17:22:42.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.254+0000 7f42d27fc700 1 --2- 172.21.15.49:0/2713351362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42d40c8780 0x7f42d4155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:22:42.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.254+0000 7f42d2ffd700 1 --2- 172.21.15.49:0/2713351362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42d4062700 0x7f42d4138f50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f42c400e6d0 tx=0x7f42c4009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:42.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.254+0000 7f42baffd700 1 -- 172.21.15.49:0/2713351362 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c4012600 con 0x7f42d4062700 2023-11-30T17:22:42.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.254+0000 7f42baffd700 1 -- 172.21.15.49:0/2713351362 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c4012760 con 0x7f42d4062700 2023-11-30T17:22:42.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.254+0000 7f42d9476700 1 -- 172.21.15.49:0/2713351362 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d41565c0 con 0x7f42d4062700 2023-11-30T17:22:42.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.254+0000 7f42baffd700 1 -- 172.21.15.49:0/2713351362 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c4012ae0 con 0x7f42d4062700 2023-11-30T17:22:42.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.254+0000 7f42d9476700 1 -- 172.21.15.49:0/2713351362 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d4139440 con 0x7f42d4062700 2023-11-30T17:22:42.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.255+0000 7f42d9476700 1 -- 172.21.15.49:0/2713351362 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d406c860 con 0x7f42d4062700 2023-11-30T17:22:42.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.255+0000 7f42baffd700 1 -- 172.21.15.49:0/2713351362 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 29) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f42c401b400 con 0x7f42d4062700 2023-11-30T17:22:42.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.256+0000 7f42baffd700 1 --2- 172.21.15.49:0/2713351362 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f42c005f300 0x7f42c00617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:42.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.256+0000 7f42baffd700 1 -- 172.21.15.49:0/2713351362 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6407+0+0 (secure 0 0 0) 0x7f42c407a7b0 con 0x7f42d4062700 2023-11-30T17:22:42.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.256+0000 7f42d27fc700 1 -- 172.21.15.49:0/2713351362 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f42c005f300 msgr2=0x7f42c00617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:42.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.256+0000 7f42d27fc700 1 --2- 172.21.15.49:0/2713351362 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f42c005f300 0x7f42c00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:22:42.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.260+0000 7f42baffd700 1 -- 172.21.15.49:0/2713351362 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f42c404b700 con 0x7f42d4062700 2023-11-30T17:22:42.272 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:42.270+0000 7f5342644680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T17:22:42.340 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:42.338+0000 7f5342644680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T17:22:42.376 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:42.375+0000 7f72e0d02680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T17:22:42.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.435+0000 7f42d9476700 1 -- 172.21.15.49:0/2713351362 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f42d40c68f0 con 0x7f42d4062700 2023-11-30T17:22:42.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.436+0000 7f42baffd700 1 -- 172.21.15.49:0/2713351362 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f42c4016020 con 0x7f42d4062700 2023-11-30T17:22:42.438 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T17:22:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.438+0000 7f42d9476700 1 -- 172.21.15.49:0/2713351362 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f42c005f300 msgr2=0x7f42c00617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:22:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.438+0000 7f42d9476700 1 --2- 172.21.15.49:0/2713351362 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f42c005f300 0x7f42c00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.438+0000 7f42d9476700 1 -- 172.21.15.49:0/2713351362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42d4062700 msgr2=0x7f42d4138f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.438+0000 7f42d9476700 1 --2- 172.21.15.49:0/2713351362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42d4062700 0x7f42d4138f50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f42c400e6d0 tx=0x7f42c4009060).stop 2023-11-30T17:22:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.438+0000 7f42d9476700 1 -- 172.21.15.49:0/2713351362 shutdown_connections 2023-11-30T17:22:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.438+0000 7f42d9476700 1 --2- 172.21.15.49:0/2713351362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f42d413be20 0x7f42d4155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.438+0000 7f42d9476700 1 --2- 172.21.15.49:0/2713351362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42d4062700 0x7f42d4138f50 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.438+0000 7f42d9476700 1 --2- 172.21.15.49:0/2713351362 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f42c005f300 0x7f42c00617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.438+0000 7f42d9476700 1 --2- 172.21.15.49:0/2713351362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42d40c8780 0x7f42d4155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.438+0000 7f42d9476700 1 -- 172.21.15.49:0/2713351362 >> 172.21.15.49:0/2713351362 conn(0x7f42d40642d0 msgr2=0x7f42d413aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.438+0000 7f42d9476700 1 -- 172.21.15.49:0/2713351362 shutdown_connections 2023-11-30T17:22:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.438+0000 7f42d9476700 1 -- 172.21.15.49:0/2713351362 wait complete. 2023-11-30T17:22:42.452 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:22:42.456 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:42.455+0000 7f72e0d02680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T17:22:42.529 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:42.527+0000 7f72e0d02680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T17:22:42.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.569+0000 7fecbd9a7700 1 Processor -- start 2023-11-30T17:22:42.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.569+0000 7fecbd9a7700 1 -- start start 2023-11-30T17:22:42.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.570+0000 7fecbd9a7700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fecb8096590 0x7fecb8067040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:42.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.570+0000 7fecbd9a7700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fecb8067530 0x7fecb80be7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:42.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.570+0000 7fecbd9a7700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb81589e0 con 0x7fecb8157790 2023-11-30T17:22:42.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.570+0000 7fecbd9a7700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb80c5720 con 0x7fecb8096590 2023-11-30T17:22:42.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.570+0000 7fecbd9a7700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb8158e70 con 0x7fecb8067530 2023-11-30T17:22:42.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.570+0000 7fecb67fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fecb8096590 0x7fecb8067040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:42.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.570+0000 7fecb67fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fecb8096590 0x7fecb8067040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45998/0 (socket says 172.21.15.49:45998) 2023-11-30T17:22:42.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.570+0000 7fecb67fc700 1 -- 172.21.15.49:0/2512291340 learned_addr learned my addr 172.21.15.49:0/2512291340 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:42.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.570+0000 7fecb77fe700 1 --2- 172.21.15.49:0/2512291340 >> v2:172.21.15.115:3300/0 conn(0x7fecb8067530 0x7fecb80be7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:42.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.570+0000 7fecb67fc700 1 -- 172.21.15.49:0/2512291340 >> v2:172.21.15.115:3300/0 conn(0x7fecb8067530 msgr2=0x7fecb80be7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:42.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.570+0000 7fecb67fc700 1 --2- 172.21.15.49:0/2512291340 >> v2:172.21.15.115:3300/0 conn(0x7fecb8067530 0x7fecb80be7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:42.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.570+0000 7fecb67fc700 1 -- 172.21.15.49:0/2512291340 >> v1:172.21.15.115:6789/0 conn(0x7fecb8157790 legacy=0x7fecb8095e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:42.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.570+0000 7fecb67fc700 1 -- 172.21.15.49:0/2512291340 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb81580b0 con 0x7fecb8096590 2023-11-30T17:22:42.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.571+0000 7fecb67fc700 1 --2- 172.21.15.49:0/2512291340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecb8096590 0x7fecb8067040 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7fecb80be510 tx=0x7feca00090f0).ready entity=mon.0 client_cookie=2ec685571b9ec36d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:42.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.571+0000 7fecb5ffb700 1 -- 172.21.15.49:0/2512291340 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca000b520 con 0x7fecb8096590 2023-11-30T17:22:42.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.571+0000 7fecb5ffb700 1 -- 172.21.15.49:0/2512291340 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca000b680 con 0x7fecb8096590 2023-11-30T17:22:42.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.571+0000 7fecb5ffb700 1 -- 172.21.15.49:0/2512291340 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca000ba00 con 0x7fecb8096590 2023-11-30T17:22:42.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.571+0000 7fecbd9a7700 1 -- 172.21.15.49:0/2512291340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecb8096590 msgr2=0x7fecb8067040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:42.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.571+0000 7fecbd9a7700 1 --2- 172.21.15.49:0/2512291340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecb8096590 0x7fecb8067040 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7fecb80be510 tx=0x7feca00090f0).stop 2023-11-30T17:22:42.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.571+0000 7fecbd9a7700 1 -- 172.21.15.49:0/2512291340 shutdown_connections 2023-11-30T17:22:42.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.571+0000 7fecbd9a7700 1 --2- 172.21.15.49:0/2512291340 >> v2:172.21.15.115:3300/0 conn(0x7fecb8067530 0x7fecb80be7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:42.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.571+0000 7fecbd9a7700 1 --2- 172.21.15.49:0/2512291340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecb8096590 0x7fecb8067040 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:42.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.571+0000 7fecbd9a7700 1 -- 172.21.15.49:0/2512291340 >> 172.21.15.49:0/2512291340 conn(0x7fecb8062700 msgr2=0x7fecb8062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:42.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.571+0000 7fecbd9a7700 1 -- 172.21.15.49:0/2512291340 shutdown_connections 2023-11-30T17:22:42.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.571+0000 7fecbd9a7700 1 -- 172.21.15.49:0/2512291340 wait complete. 2023-11-30T17:22:42.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.573+0000 7fecbd9a7700 1 Processor -- start 2023-11-30T17:22:42.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.573+0000 7fecbd9a7700 1 -- start start 2023-11-30T17:22:42.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.573+0000 7fecbd9a7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecb8067530 0x7fecb81503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:42.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.574+0000 7fecbd9a7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecb8096590 0x7fecb80a93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:42.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.574+0000 7fecbd9a7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecb8157790 0x7fecb80a6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:42.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.574+0000 7fecbd9a7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb8150f00 con 0x7fecb8157790 2023-11-30T17:22:42.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.574+0000 7fecbd9a7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80bff70 con 0x7fecb8096590 2023-11-30T17:22:42.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.574+0000 7fecbd9a7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80c0250 con 0x7fecb8067530 2023-11-30T17:22:42.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.574+0000 7fecb77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecb8157790 0x7fecb80a6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:42.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.574+0000 7fecb6ffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecb8067530 0x7fecb81503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:42.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.574+0000 7fecb67fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecb8096590 0x7fecb80a93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:42.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.574+0000 7fecb67fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecb8096590 0x7fecb80a93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:38782/0 (socket says 172.21.15.49:38782) 2023-11-30T17:22:42.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.574+0000 7fecb77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecb8157790 0x7fecb80a6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46010/0 (socket says 172.21.15.49:46010) 2023-11-30T17:22:42.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.574+0000 7fecb67fc700 1 -- 172.21.15.49:0/1782448488 learned_addr learned my addr 172.21.15.49:0/1782448488 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:42.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.574+0000 7fecb6ffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecb8067530 0x7fecb81503b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:33472/0 (socket says 172.21.15.49:33472) 2023-11-30T17:22:42.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.574+0000 7fecb67fc700 1 -- 172.21.15.49:0/1782448488 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecb8067530 msgr2=0x7fecb81503b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:42.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.574+0000 7fecb67fc700 1 --2- 172.21.15.49:0/1782448488 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecb8067530 0x7fecb81503b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:42.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.574+0000 7fecb67fc700 1 -- 172.21.15.49:0/1782448488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecb8157790 msgr2=0x7fecb80a6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:42.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.574+0000 7fecb67fc700 1 --2- 172.21.15.49:0/1782448488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecb8157790 0x7fecb80a6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:42.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.574+0000 7fecb67fc700 1 -- 172.21.15.49:0/1782448488 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca0009370 con 0x7fecb8096590 2023-11-30T17:22:42.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.574+0000 7fecb67fc700 1 --2- 172.21.15.49:0/1782448488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecb8096590 0x7fecb80a93c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7feca0009130 tx=0x7feca0017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.574+0000 7fecaeffd700 1 -- 172.21.15.49:0/1782448488 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca0000bc0 con 0x7fecb8096590 2023-11-30T17:22:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.574+0000 7fecaeffd700 1 -- 172.21.15.49:0/1782448488 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca000b7f0 con 0x7fecb8096590 2023-11-30T17:22:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.574+0000 7fecbd9a7700 1 -- 172.21.15.49:0/1782448488 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb80c0530 con 0x7fecb8096590 2023-11-30T17:22:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.574+0000 7fecaeffd700 1 -- 172.21.15.49:0/1782448488 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca0000d20 con 0x7fecb8096590 2023-11-30T17:22:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.575+0000 7fecbd9a7700 1 -- 172.21.15.49:0/1782448488 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb80c0af0 con 0x7fecb8096590 2023-11-30T17:22:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.576+0000 7fecbd9a7700 1 -- 172.21.15.49:0/1782448488 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb806c7c0 con 0x7fecb8096590 2023-11-30T17:22:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.576+0000 7fecaeffd700 1 -- 172.21.15.49:0/1782448488 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 29) v1 ==== 75605+0+0 (secure 0 0 0) 0x7feca001c8c0 con 0x7fecb8096590 2023-11-30T17:22:42.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.576+0000 7fecaeffd700 1 --2- 172.21.15.49:0/1782448488 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fec9805f300 0x7fec980617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:42.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.576+0000 7fecb6ffd700 1 -- 172.21.15.49:0/1782448488 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fec9805f300 msgr2=0x7fec980617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:42.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.576+0000 7fecaeffd700 1 -- 172.21.15.49:0/1782448488 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6407+0+0 (secure 0 0 0) 0x7feca007c2e0 con 0x7fecb8096590 2023-11-30T17:22:42.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.576+0000 7fecb6ffd700 1 --2- 172.21.15.49:0/1782448488 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fec9805f300 0x7fec980617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:22:42.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.581+0000 7fecaeffd700 1 -- 172.21.15.49:0/1782448488 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7feca004d290 con 0x7fecb8096590 2023-11-30T17:22:42.601 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:42.599+0000 7f5342644680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T17:22:42.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.777+0000 7fecb6ffd700 1 -- 172.21.15.49:0/1782448488 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fec9805f300 msgr2=0x7fec980617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:42.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.777+0000 7fecb6ffd700 1 --2- 172.21.15.49:0/1782448488 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fec9805f300 0x7fec980617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:22:42.781 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:42.779+0000 7f5342644680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T17:22:42.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.797+0000 7fecbd9a7700 1 -- 172.21.15.49:0/1782448488 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fecb80c1130 con 0x7fecb8096590 2023-11-30T17:22:42.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.798+0000 7fecaeffd700 1 -- 172.21.15.49:0/1782448488 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4496 (secure 0 0 0) 0x7fecb80c1130 con 0x7fecb8096590 2023-11-30T17:22:42.800 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:42.800 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/3245104889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3245104889},{"type":"v1","addr":"172.21.15.115:6836","nonce":3245104889}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5579,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1933850814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1933850814},{"type":"v1","addr":"172.21.15.115:6837","nonce":1933850814}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6225,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1356528561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1356528561},{"type":"v1","addr":"172.21.15.49:6834","nonce":1356528561}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:22:21.305720+0000","modified":"2023-11-30T17:22:24.320718+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6228},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6228":{"gid":6228,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1786065897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1786065897},{"type":"v1","addr":"172.21.15.49:6835","nonce":1786065897}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-11-30T17:22:42.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.800+0000 7fecbd9a7700 1 -- 172.21.15.49:0/1782448488 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fec9805f300 msgr2=0x7fec980617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:22:42.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.800+0000 7fecbd9a7700 1 --2- 172.21.15.49:0/1782448488 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fec9805f300 0x7fec980617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:42.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.800+0000 7fecbd9a7700 1 -- 172.21.15.49:0/1782448488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecb8096590 msgr2=0x7fecb80a93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:42.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.800+0000 7fecbd9a7700 1 --2- 172.21.15.49:0/1782448488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecb8096590 0x7fecb80a93c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7feca0009130 tx=0x7feca0017000).stop 2023-11-30T17:22:42.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.800+0000 7fecbd9a7700 1 -- 172.21.15.49:0/1782448488 shutdown_connections 2023-11-30T17:22:42.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.800+0000 7fecbd9a7700 1 --2- 172.21.15.49:0/1782448488 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fec9805f300 0x7fec980617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:42.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.800+0000 7fecbd9a7700 1 --2- 172.21.15.49:0/1782448488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecb8157790 0x7fecb80a6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:42.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.800+0000 7fecbd9a7700 1 --2- 172.21.15.49:0/1782448488 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecb8067530 0x7fecb81503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:42.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.800+0000 7fecbd9a7700 1 --2- 172.21.15.49:0/1782448488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecb8096590 0x7fecb80a93c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:42.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.800+0000 7fecbd9a7700 1 -- 172.21.15.49:0/1782448488 >> 172.21.15.49:0/1782448488 conn(0x7fecb8062700 msgr2=0x7fecb81513c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:42.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.800+0000 7fecbd9a7700 1 -- 172.21.15.49:0/1782448488 shutdown_connections 2023-11-30T17:22:42.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.800+0000 7fecbd9a7700 1 -- 172.21.15.49:0/1782448488 wait complete. 2023-11-30T17:22:42.804 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 32 2023-11-30T17:22:42.807 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:42.806+0000 7f72e0d02680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T17:22:42.814 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:22:42.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.978+0000 7f07ae751700 1 Processor -- start 2023-11-30T17:22:42.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.978+0000 7f07ae751700 1 -- start start 2023-11-30T17:22:42.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.979+0000 7f07ae751700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f07a8151ca0 0x7f07a8152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:42.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.979+0000 7f07ae751700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f07a8096590 0x7f07a80c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:42.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.979+0000 7f07ae751700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a80c8170 con 0x7f07a80c7820 2023-11-30T17:22:42.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.979+0000 7f07ae751700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07a80c0060 con 0x7f07a8151ca0 2023-11-30T17:22:42.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.979+0000 7f07ae751700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07a80c8c40 con 0x7f07a8096590 2023-11-30T17:22:42.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.979+0000 7f07a7fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f07a8151ca0 0x7f07a8152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:42.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.979+0000 7f07a7fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f07a8151ca0 0x7f07a8152080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46022/0 (socket says 172.21.15.49:46022) 2023-11-30T17:22:42.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.979+0000 7f07a7fff700 1 -- 172.21.15.49:0/4135321312 learned_addr learned my addr 172.21.15.49:0/4135321312 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:42.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.979+0000 7f07accee700 1 --2- 172.21.15.49:0/4135321312 >> v2:172.21.15.115:3300/0 conn(0x7f07a8096590 0x7f07a80c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:42.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.979+0000 7f07a7fff700 1 -- 172.21.15.49:0/4135321312 >> v2:172.21.15.115:3300/0 conn(0x7f07a8096590 msgr2=0x7f07a80c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:42.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.979+0000 7f07a7fff700 1 --2- 172.21.15.49:0/4135321312 >> v2:172.21.15.115:3300/0 conn(0x7f07a8096590 0x7f07a80c7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:42.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.979+0000 7f07a7fff700 1 -- 172.21.15.49:0/4135321312 >> v1:172.21.15.115:6789/0 conn(0x7f07a80c7820 legacy=0x7f07a8095e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:42.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.979+0000 7f07a7fff700 1 -- 172.21.15.49:0/4135321312 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a80bebc0 con 0x7f07a8151ca0 2023-11-30T17:22:42.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.979+0000 7f07a7fff700 1 --2- 172.21.15.49:0/4135321312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07a8151ca0 0x7f07a8152080 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f07a80a8b20 tx=0x7f0798009060).ready entity=mon.0 client_cookie=1294178926da3d4f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:42.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.980+0000 7f07a6ffd700 1 -- 172.21.15.49:0/4135321312 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0798005880 con 0x7f07a8151ca0 2023-11-30T17:22:42.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.980+0000 7f07a6ffd700 1 -- 172.21.15.49:0/4135321312 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07980059e0 con 0x7f07a8151ca0 2023-11-30T17:22:42.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.980+0000 7f07a6ffd700 1 -- 172.21.15.49:0/4135321312 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0798005d60 con 0x7f07a8151ca0 2023-11-30T17:22:42.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.980+0000 7f07ae751700 1 -- 172.21.15.49:0/4135321312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07a8151ca0 msgr2=0x7f07a8152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:42.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.980+0000 7f07ae751700 1 --2- 172.21.15.49:0/4135321312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07a8151ca0 0x7f07a8152080 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f07a80a8b20 tx=0x7f0798009060).stop 2023-11-30T17:22:42.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.980+0000 7f07ae751700 1 -- 172.21.15.49:0/4135321312 shutdown_connections 2023-11-30T17:22:42.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.980+0000 7f07ae751700 1 --2- 172.21.15.49:0/4135321312 >> v2:172.21.15.115:3300/0 conn(0x7f07a8096590 0x7f07a80c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:42.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.980+0000 7f07ae751700 1 --2- 172.21.15.49:0/4135321312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07a8151ca0 0x7f07a8152080 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:42.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.980+0000 7f07ae751700 1 -- 172.21.15.49:0/4135321312 >> 172.21.15.49:0/4135321312 conn(0x7f07a8062700 msgr2=0x7f07a8062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:42.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.980+0000 7f07ae751700 1 -- 172.21.15.49:0/4135321312 shutdown_connections 2023-11-30T17:22:42.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.980+0000 7f07ae751700 1 -- 172.21.15.49:0/4135321312 wait complete. 2023-11-30T17:22:42.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.981+0000 7f07ae751700 1 Processor -- start 2023-11-30T17:22:42.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.982+0000 7f07ae751700 1 -- start start 2023-11-30T17:22:42.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.982+0000 7f07ae751700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07a8096590 0x7f07a8150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:42.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.982+0000 7f07ae751700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07a80c7820 0x7f07a814af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:42.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.982+0000 7f07ae751700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07a8151ca0 0x7f07a80ab3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:42.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.982+0000 7f07ae751700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a81506f0 con 0x7f07a80c7820 2023-11-30T17:22:42.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.982+0000 7f07ae751700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a80a9d40 con 0x7f07a8096590 2023-11-30T17:22:42.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.982+0000 7f07ae751700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a814b470 con 0x7f07a8151ca0 2023-11-30T17:22:42.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.982+0000 7f07a77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07a80c7820 0x7f07a814af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:42.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.982+0000 7f07a7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07a8096590 0x7f07a8150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:42.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.982+0000 7f07a7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07a8096590 0x7f07a8150200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:38806/0 (socket says 172.21.15.49:38806) 2023-11-30T17:22:42.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.982+0000 7f07a77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07a80c7820 0x7f07a814af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46028/0 (socket says 172.21.15.49:46028) 2023-11-30T17:22:42.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.982+0000 7f07a7fff700 1 -- 172.21.15.49:0/524119963 learned_addr learned my addr 172.21.15.49:0/524119963 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:42.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.982+0000 7f07accee700 1 --2- 172.21.15.49:0/524119963 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07a8151ca0 0x7f07a80ab3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:42.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.983+0000 7f07a7fff700 1 -- 172.21.15.49:0/524119963 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07a8151ca0 msgr2=0x7f07a80ab3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:42.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.983+0000 7f07a7fff700 1 --2- 172.21.15.49:0/524119963 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07a8151ca0 0x7f07a80ab3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:42.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.983+0000 7f07a7fff700 1 -- 172.21.15.49:0/524119963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07a80c7820 msgr2=0x7f07a814af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:42.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.983+0000 7f07a7fff700 1 --2- 172.21.15.49:0/524119963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07a80c7820 0x7f07a814af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:42.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.983+0000 7f07a7fff700 1 -- 172.21.15.49:0/524119963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0798009300 con 0x7f07a8096590 2023-11-30T17:22:42.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.983+0000 7f07a77fe700 1 --2- 172.21.15.49:0/524119963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07a80c7820 0x7f07a814af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:22:42.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.983+0000 7f07a7fff700 1 --2- 172.21.15.49:0/524119963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07a8096590 0x7f07a8150200 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f07a806c3b0 tx=0x7f0798016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:42.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.983+0000 7f078ffff700 1 -- 172.21.15.49:0/524119963 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079800b580 con 0x7f07a8096590 2023-11-30T17:22:42.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.983+0000 7f078ffff700 1 -- 172.21.15.49:0/524119963 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079800b6e0 con 0x7f07a8096590 2023-11-30T17:22:42.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.983+0000 7f07ae751700 1 -- 172.21.15.49:0/524119963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a80a9a60 con 0x7f07a8096590 2023-11-30T17:22:42.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.983+0000 7f078ffff700 1 -- 172.21.15.49:0/524119963 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079800ba80 con 0x7f07a8096590 2023-11-30T17:22:42.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.983+0000 7f07ae751700 1 -- 172.21.15.49:0/524119963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a8152b20 con 0x7f07a8096590 2023-11-30T17:22:42.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.984+0000 7f07ae751700 1 -- 172.21.15.49:0/524119963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a806c860 con 0x7f07a8096590 2023-11-30T17:22:42.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.985+0000 7f078ffff700 1 -- 172.21.15.49:0/524119963 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 29) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f0798018070 con 0x7f07a8096590 2023-11-30T17:22:42.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.985+0000 7f078ffff700 1 --2- 172.21.15.49:0/524119963 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f079405f300 0x7f07940617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:42.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.985+0000 7f078ffff700 1 -- 172.21.15.49:0/524119963 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6407+0+0 (secure 0 0 0) 0x7f079807b430 con 0x7f07a8096590 2023-11-30T17:22:42.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.985+0000 7f07a77fe700 1 -- 172.21.15.49:0/524119963 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f079405f300 msgr2=0x7f07940617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:42.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.985+0000 7f07a77fe700 1 --2- 172.21.15.49:0/524119963 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f079405f300 0x7f07940617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:22:42.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:42.989+0000 7f078ffff700 1 -- 172.21.15.49:0/524119963 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f079804c3e0 con 0x7f07a8096590 2023-11-30T17:22:43.004 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:43.003+0000 7f72e0d02680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T17:22:43.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.161+0000 7f07ae751700 1 -- 172.21.15.49:0/524119963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07a80c83a0 con 0x7f07a8096590 2023-11-30T17:22:43.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.164+0000 7f078ffff700 1 -- 172.21.15.49:0/524119963 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+17345 (secure 0 0 0) 0x7f079804fa00 con 0x7f07a8096590 2023-11-30T17:22:43.165 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:43.166 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":84,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:22:38.144216+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:22:19.274919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-30T17:22:20.286346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/1814309049":"2023-12-01T17:22:38.144175+0000","172.21.15.115:6833/89956":"2023-12-01T17:22:38.144175+0000","172.21.15.115:6832/89956":"2023-12-01T17:22:38.144175+0000","172.21.15.115:0/4214471495":"2023-12-01T17:22:38.144175+0000","172.21.15.115:0/3198129794":"2023-12-01T17:22:38.144175+0000","172.21.15.115:0/939691547":"2023-12-01T17:22:38.144175+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:22:43.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.166+0000 7f07ae751700 1 -- 172.21.15.49:0/524119963 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f079405f300 msgr2=0x7f07940617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:22:43.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.166+0000 7f07ae751700 1 --2- 172.21.15.49:0/524119963 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f079405f300 0x7f07940617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:43.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.166+0000 7f07ae751700 1 -- 172.21.15.49:0/524119963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07a8096590 msgr2=0x7f07a8150200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:43.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.166+0000 7f07ae751700 1 --2- 172.21.15.49:0/524119963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07a8096590 0x7f07a8150200 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f07a806c3b0 tx=0x7f0798016000).stop 2023-11-30T17:22:43.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.166+0000 7f07ae751700 1 -- 172.21.15.49:0/524119963 shutdown_connections 2023-11-30T17:22:43.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.166+0000 7f07ae751700 1 --2- 172.21.15.49:0/524119963 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07a8151ca0 0x7f07a80ab3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:43.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.166+0000 7f07ae751700 1 --2- 172.21.15.49:0/524119963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07a8096590 0x7f07a8150200 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:43.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.166+0000 7f07ae751700 1 --2- 172.21.15.49:0/524119963 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f079405f300 0x7f07940617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:43.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.166+0000 7f07ae751700 1 --2- 172.21.15.49:0/524119963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07a80c7820 0x7f07a814af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:43.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.166+0000 7f07ae751700 1 -- 172.21.15.49:0/524119963 >> 172.21.15.49:0/524119963 conn(0x7f07a8062700 msgr2=0x7f07a8150d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:43.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.166+0000 7f07ae751700 1 -- 172.21.15.49:0/524119963 shutdown_connections 2023-11-30T17:22:43.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.166+0000 7f07ae751700 1 -- 172.21.15.49:0/524119963 wait complete. 2023-11-30T17:22:43.180 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-30T17:22:43.180 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:22:43.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.297+0000 7f091be9c700 1 Processor -- start 2023-11-30T17:22:43.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.297+0000 7f091be9c700 1 -- start start 2023-11-30T17:22:43.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.298+0000 7f091be9c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0914065bf0 0x7f0914154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:43.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.298+0000 7f091be9c700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0914069c70 con 0x7f0914155410 2023-11-30T17:22:43.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.298+0000 7f091be9c700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0914155890 con 0x7f0914065810 2023-11-30T17:22:43.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.298+0000 7f091be9c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0914155e50 con 0x7f0914065bf0 2023-11-30T17:22:43.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.298+0000 7f091a439700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0914155410 0x7f091413a6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45396/0 (socket says 172.21.15.49:45396) 2023-11-30T17:22:43.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.299+0000 7f091a439700 1 -- 172.21.15.49:0/2510063884 learned_addr learned my addr 172.21.15.49:0/2510063884 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:43.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.299+0000 7f0919437700 1 --2- 172.21.15.49:0/2510063884 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0914065bf0 0x7f0914154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:43.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.299+0000 7f0918c36700 1 -- 172.21.15.49:0/2510063884 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 714608480 0 0) 0x7f0914069c70 con 0x7f0914155410 2023-11-30T17:22:43.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.299+0000 7f0918c36700 1 -- 172.21.15.49:0/2510063884 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09000033f0 con 0x7f0914155410 2023-11-30T17:22:43.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.299+0000 7f0918c36700 1 -- 172.21.15.49:0/2510063884 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4079791992 0 0) 0x7f0914155890 con 0x7f0914065810 2023-11-30T17:22:43.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.299+0000 7f0918c36700 1 -- 172.21.15.49:0/2510063884 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0914069c70 con 0x7f0914065810 2023-11-30T17:22:43.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.299+0000 7f0919437700 1 -- 172.21.15.49:0/2510063884 >> v1:172.21.15.115:6789/0 conn(0x7f0914065810 legacy=0x7f091406a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:43.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.299+0000 7f0919437700 1 -- 172.21.15.49:0/2510063884 >> v1:172.21.15.49:6789/0 conn(0x7f0914155410 legacy=0x7f091413a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:43.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.299+0000 7f0919437700 1 -- 172.21.15.49:0/2510063884 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0914155b70 con 0x7f0914065bf0 2023-11-30T17:22:43.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.299+0000 7f0919437700 1 --2- 172.21.15.49:0/2510063884 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0914065bf0 0x7f0914154f20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f0904009790 tx=0x7f0904009060).ready entity=mon.2 client_cookie=c495dce5835ea4fa server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:43.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.299+0000 7f0918c36700 1 -- 172.21.15.49:0/2510063884 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090400f510 con 0x7f0914065bf0 2023-11-30T17:22:43.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.299+0000 7f0918c36700 1 -- 172.21.15.49:0/2510063884 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090400f670 con 0x7f0914065bf0 2023-11-30T17:22:43.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.299+0000 7f0918c36700 1 -- 172.21.15.49:0/2510063884 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090400f9f0 con 0x7f0914065bf0 2023-11-30T17:22:43.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.300+0000 7f091be9c700 1 -- 172.21.15.49:0/2510063884 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0914065bf0 msgr2=0x7f0914154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:43.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.300+0000 7f091be9c700 1 --2- 172.21.15.49:0/2510063884 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0914065bf0 0x7f0914154f20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f0904009790 tx=0x7f0904009060).stop 2023-11-30T17:22:43.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.300+0000 7f091be9c700 1 -- 172.21.15.49:0/2510063884 shutdown_connections 2023-11-30T17:22:43.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.300+0000 7f091be9c700 1 --2- 172.21.15.49:0/2510063884 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0914065bf0 0x7f0914154f20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:43.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.300+0000 7f091be9c700 1 -- 172.21.15.49:0/2510063884 >> 172.21.15.49:0/2510063884 conn(0x7f09140c7f50 msgr2=0x7f09140c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:43.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.300+0000 7f091be9c700 1 -- 172.21.15.49:0/2510063884 shutdown_connections 2023-11-30T17:22:43.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.300+0000 7f091be9c700 1 -- 172.21.15.49:0/2510063884 wait complete. 2023-11-30T17:22:43.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.301+0000 7f091be9c700 1 Processor -- start 2023-11-30T17:22:43.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.301+0000 7f091be9c700 1 -- start start 2023-11-30T17:22:43.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.302+0000 7f091be9c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0914065810 0x7f09140c4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:43.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.302+0000 7f091be9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0914065bf0 0x7f09140a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:43.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.302+0000 7f091be9c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0914155410 0x7f0914153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:43.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.302+0000 7f091be9c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0914066050 con 0x7f0914155410 2023-11-30T17:22:43.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.302+0000 7f091be9c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09140a5b40 con 0x7f0914065bf0 2023-11-30T17:22:43.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.302+0000 7f091be9c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09140a5e20 con 0x7f0914065810 2023-11-30T17:22:43.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.302+0000 7f091a439700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0914155410 0x7f0914153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:43.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.302+0000 7f091a439700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0914155410 0x7f0914153c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46030/0 (socket says 172.21.15.49:46030) 2023-11-30T17:22:43.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.302+0000 7f091a439700 1 -- 172.21.15.49:0/571884721 learned_addr learned my addr 172.21.15.49:0/571884721 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:43.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.302+0000 7f0919c38700 1 --2- 172.21.15.49:0/571884721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0914065810 0x7f09140c4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:43.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.302+0000 7f0919437700 1 --2- 172.21.15.49:0/571884721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0914065bf0 0x7f09140a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:43.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.302+0000 7f091a439700 1 -- 172.21.15.49:0/571884721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0914065810 msgr2=0x7f09140c4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:43.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.302+0000 7f091a439700 1 --2- 172.21.15.49:0/571884721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0914065810 0x7f09140c4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:43.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.302+0000 7f091a439700 1 -- 172.21.15.49:0/571884721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0914065bf0 msgr2=0x7f09140a52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:43.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.302+0000 7f091a439700 1 --2- 172.21.15.49:0/571884721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0914065bf0 0x7f09140a52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:43.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.302+0000 7f091a439700 1 -- 172.21.15.49:0/571884721 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09040092a0 con 0x7f0914155410 2023-11-30T17:22:43.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.303+0000 7f091a439700 1 --2- 172.21.15.49:0/571884721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0914155410 0x7f0914153c10 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f090c001560 tx=0x7f090c0015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:43.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.303+0000 7f0909ffb700 1 -- 172.21.15.49:0/571884721 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c005d30 con 0x7f0914155410 2023-11-30T17:22:43.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.303+0000 7f0909ffb700 1 -- 172.21.15.49:0/571884721 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c005e90 con 0x7f0914155410 2023-11-30T17:22:43.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.303+0000 7f091be9c700 1 -- 172.21.15.49:0/571884721 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09140a6100 con 0x7f0914155410 2023-11-30T17:22:43.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.303+0000 7f0909ffb700 1 -- 172.21.15.49:0/571884721 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c0072e0 con 0x7f0914155410 2023-11-30T17:22:43.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.303+0000 7f091be9c700 1 -- 172.21.15.49:0/571884721 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09140a66c0 con 0x7f0914155410 2023-11-30T17:22:43.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.304+0000 7f091be9c700 1 -- 172.21.15.49:0/571884721 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f091406c860 con 0x7f0914155410 2023-11-30T17:22:43.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.304+0000 7f0909ffb700 1 -- 172.21.15.49:0/571884721 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 29) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f090c007650 con 0x7f0914155410 2023-11-30T17:22:43.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.305+0000 7f0909ffb700 1 --2- 172.21.15.49:0/571884721 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f08f805f300 0x7f08f80617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:43.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.305+0000 7f0909ffb700 1 -- 172.21.15.49:0/571884721 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6407+0+0 (secure 0 0 0) 0x7f090c079ed0 con 0x7f0914155410 2023-11-30T17:22:43.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.305+0000 7f0919c38700 1 -- 172.21.15.49:0/571884721 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f08f805f300 msgr2=0x7f08f80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:43.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.305+0000 7f0919c38700 1 --2- 172.21.15.49:0/571884721 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f08f805f300 0x7f08f80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:22:43.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.309+0000 7f0909ffb700 1 -- 172.21.15.49:0/571884721 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f090c04ae80 con 0x7f0914155410 2023-11-30T17:22:43.437 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:43.434+0000 7f5342644680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T17:22:43.505 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:43.502+0000 7f5342644680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T17:22:43.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.506+0000 7f0919c38700 1 -- 172.21.15.49:0/571884721 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f08f805f300 msgr2=0x7f08f80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:43.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.506+0000 7f0919c38700 1 --2- 172.21.15.49:0/571884721 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f08f805f300 0x7f08f80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:22:43.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.523+0000 7f091be9c700 1 -- 172.21.15.49:0/571884721 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0914066cd0 con 0x7f0914155410 2023-11-30T17:22:43.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.524+0000 7f0909ffb700 1 -- 172.21.15.49:0/571884721 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f090c04e4a0 con 0x7f0914155410 2023-11-30T17:22:43.526 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:43.526 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/3245104889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3245104889},{"type":"v1","addr":"172.21.15.115:6836","nonce":3245104889}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5579,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1933850814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1933850814},{"type":"v1","addr":"172.21.15.115:6837","nonce":1933850814}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6225,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1356528561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1356528561},{"type":"v1","addr":"172.21.15.49:6834","nonce":1356528561}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:22:21.305720+0000","modified":"2023-11-30T17:22:24.320718+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6228},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6228":{"gid":6228,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1786065897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1786065897},{"type":"v1","addr":"172.21.15.49:6835","nonce":1786065897}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-11-30T17:22:43.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.526+0000 7f091be9c700 1 -- 172.21.15.49:0/571884721 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f08f805f300 msgr2=0x7f08f80617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:22:43.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.526+0000 7f091be9c700 1 --2- 172.21.15.49:0/571884721 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f08f805f300 0x7f08f80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:43.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.526+0000 7f091be9c700 1 -- 172.21.15.49:0/571884721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0914155410 msgr2=0x7f0914153c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:43.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.526+0000 7f091be9c700 1 --2- 172.21.15.49:0/571884721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0914155410 0x7f0914153c10 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f090c001560 tx=0x7f090c0015b0).stop 2023-11-30T17:22:43.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.526+0000 7f091be9c700 1 -- 172.21.15.49:0/571884721 shutdown_connections 2023-11-30T17:22:43.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.526+0000 7f091be9c700 1 --2- 172.21.15.49:0/571884721 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f08f805f300 0x7f08f80617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:43.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.526+0000 7f091be9c700 1 --2- 172.21.15.49:0/571884721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0914155410 0x7f0914153c10 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:43.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.526+0000 7f091be9c700 1 --2- 172.21.15.49:0/571884721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0914065810 0x7f09140c4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:43.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.526+0000 7f091be9c700 1 --2- 172.21.15.49:0/571884721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0914065bf0 0x7f09140a52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:43.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.526+0000 7f091be9c700 1 -- 172.21.15.49:0/571884721 >> 172.21.15.49:0/571884721 conn(0x7f09140c7f50 msgr2=0x7f0914139af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:43.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.526+0000 7f091be9c700 1 -- 172.21.15.49:0/571884721 shutdown_connections 2023-11-30T17:22:43.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.526+0000 7f091be9c700 1 -- 172.21.15.49:0/571884721 wait complete. 2023-11-30T17:22:43.529 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 32 2023-11-30T17:22:43.541 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:22:43.580 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:43.577+0000 7f5342644680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T17:22:43.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.662+0000 7ff13d4a0700 1 Processor -- start 2023-11-30T17:22:43.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.663+0000 7ff13d4a0700 1 -- start start 2023-11-30T17:22:43.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.663+0000 7ff13d4a0700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff13814eb80 0x7ff13806b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:43.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.663+0000 7ff13d4a0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1380c3210 0x7ff138154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:43.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.663+0000 7ff13d4a0700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1380664a0 con 0x7ff138155190 2023-11-30T17:22:43.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.663+0000 7ff13d4a0700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff138065000 con 0x7ff13814eb80 2023-11-30T17:22:43.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.663+0000 7ff13d4a0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff138155620 con 0x7ff1380c3210 2023-11-30T17:22:43.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.664+0000 7ff1377fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff138155190 0x7ff1381516a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45408/0 (socket says 172.21.15.49:45408) 2023-11-30T17:22:43.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.664+0000 7ff1377fe700 1 -- 172.21.15.49:0/3824989596 learned_addr learned my addr 172.21.15.49:0/3824989596 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:43.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.664+0000 7ff1367fc700 1 --2- 172.21.15.49:0/3824989596 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1380c3210 0x7ff138154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:43.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.664+0000 7ff136ffd700 1 --2- 172.21.15.49:0/3824989596 >> v2:172.21.15.115:3300/0 conn(0x7ff13814eb80 0x7ff13806b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:43.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.664+0000 7ff135ffb700 1 -- 172.21.15.49:0/3824989596 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2051420387 0 0) 0x7ff1380664a0 con 0x7ff138155190 2023-11-30T17:22:43.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.664+0000 7ff135ffb700 1 -- 172.21.15.49:0/3824989596 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1240033f0 con 0x7ff138155190 2023-11-30T17:22:43.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.664+0000 7ff1367fc700 1 -- 172.21.15.49:0/3824989596 >> v2:172.21.15.115:3300/0 conn(0x7ff13814eb80 msgr2=0x7ff13806b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:43.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.664+0000 7ff1367fc700 1 --2- 172.21.15.49:0/3824989596 >> v2:172.21.15.115:3300/0 conn(0x7ff13814eb80 0x7ff13806b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:43.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.664+0000 7ff1367fc700 1 -- 172.21.15.49:0/3824989596 >> v1:172.21.15.49:6789/0 conn(0x7ff138155190 legacy=0x7ff1381516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:43.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.664+0000 7ff1367fc700 1 -- 172.21.15.49:0/3824989596 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13806bbd0 con 0x7ff1380c3210 2023-11-30T17:22:43.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.664+0000 7ff136ffd700 1 --2- 172.21.15.49:0/3824989596 >> v2:172.21.15.115:3300/0 conn(0x7ff13814eb80 0x7ff13806b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:22:43.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.664+0000 7ff1367fc700 1 --2- 172.21.15.49:0/3824989596 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1380c3210 0x7ff138154ca0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7ff120009760 tx=0x7ff120009060).ready entity=mon.2 client_cookie=914b273374cb935 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:43.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.664+0000 7ff135ffb700 1 -- 172.21.15.49:0/3824989596 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12000d4a0 con 0x7ff1380c3210 2023-11-30T17:22:43.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.664+0000 7ff135ffb700 1 -- 172.21.15.49:0/3824989596 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12000d600 con 0x7ff1380c3210 2023-11-30T17:22:43.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.664+0000 7ff135ffb700 1 -- 172.21.15.49:0/3824989596 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12000d980 con 0x7ff1380c3210 2023-11-30T17:22:43.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.665+0000 7ff13d4a0700 1 -- 172.21.15.49:0/3824989596 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1380c3210 msgr2=0x7ff138154ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:43.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.665+0000 7ff13d4a0700 1 --2- 172.21.15.49:0/3824989596 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1380c3210 0x7ff138154ca0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7ff120009760 tx=0x7ff120009060).stop 2023-11-30T17:22:43.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.665+0000 7ff13d4a0700 1 -- 172.21.15.49:0/3824989596 shutdown_connections 2023-11-30T17:22:43.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.665+0000 7ff13d4a0700 1 --2- 172.21.15.49:0/3824989596 >> v2:172.21.15.115:3300/0 conn(0x7ff13814eb80 0x7ff13806b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:43.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.665+0000 7ff13d4a0700 1 --2- 172.21.15.49:0/3824989596 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1380c3210 0x7ff138154ca0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:43.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.665+0000 7ff13d4a0700 1 -- 172.21.15.49:0/3824989596 >> 172.21.15.49:0/3824989596 conn(0x7ff1380c3f20 msgr2=0x7ff1380c4330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:43.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.665+0000 7ff13d4a0700 1 -- 172.21.15.49:0/3824989596 shutdown_connections 2023-11-30T17:22:43.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.665+0000 7ff13d4a0700 1 -- 172.21.15.49:0/3824989596 wait complete. 2023-11-30T17:22:43.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.666+0000 7ff13d4a0700 1 Processor -- start 2023-11-30T17:22:43.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.666+0000 7ff13d4a0700 1 -- start start 2023-11-30T17:22:43.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.667+0000 7ff13d4a0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1380c3210 0x7ff138148490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:43.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.667+0000 7ff13d4a0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff13814eb80 0x7ff1380a7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:43.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.667+0000 7ff13d4a0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff138155190 0x7ff1380aba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:43.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.667+0000 7ff13d4a0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13814df10 con 0x7ff1380c3210 2023-11-30T17:22:43.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.667+0000 7ff13d4a0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13814d060 con 0x7ff138155190 2023-11-30T17:22:43.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.667+0000 7ff13d4a0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13814d300 con 0x7ff13814eb80 2023-11-30T17:22:43.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.667+0000 7ff136ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1380c3210 0x7ff138148490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:43.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.667+0000 7ff136ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1380c3210 0x7ff138148490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46038/0 (socket says 172.21.15.49:46038) 2023-11-30T17:22:43.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.667+0000 7ff136ffd700 1 -- 172.21.15.49:0/119848247 learned_addr learned my addr 172.21.15.49:0/119848247 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:43.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.667+0000 7ff1367fc700 1 --2- 172.21.15.49:0/119848247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff13814eb80 0x7ff1380a7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:43.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.667+0000 7ff1377fe700 1 --2- 172.21.15.49:0/119848247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff138155190 0x7ff1380aba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:43.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.667+0000 7ff136ffd700 1 -- 172.21.15.49:0/119848247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff13814eb80 msgr2=0x7ff1380a7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:43.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.667+0000 7ff136ffd700 1 --2- 172.21.15.49:0/119848247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff13814eb80 0x7ff1380a7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:43.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.667+0000 7ff136ffd700 1 -- 172.21.15.49:0/119848247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff138155190 msgr2=0x7ff1380aba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:43.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.667+0000 7ff136ffd700 1 --2- 172.21.15.49:0/119848247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff138155190 0x7ff1380aba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:43.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.667+0000 7ff136ffd700 1 -- 172.21.15.49:0/119848247 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1280092a0 con 0x7ff1380c3210 2023-11-30T17:22:43.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.668+0000 7ff136ffd700 1 --2- 172.21.15.49:0/119848247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1380c3210 0x7ff138148490 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7ff12800ea20 tx=0x7ff128009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:43.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.668+0000 7ff12effd700 1 -- 172.21.15.49:0/119848247 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12800ee60 con 0x7ff1380c3210 2023-11-30T17:22:43.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.668+0000 7ff12effd700 1 -- 172.21.15.49:0/119848247 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12800c850 con 0x7ff1380c3210 2023-11-30T17:22:43.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.668+0000 7ff13d4a0700 1 -- 172.21.15.49:0/119848247 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1200092a0 con 0x7ff1380c3210 2023-11-30T17:22:43.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.668+0000 7ff12effd700 1 -- 172.21.15.49:0/119848247 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12800cbd0 con 0x7ff1380c3210 2023-11-30T17:22:43.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.668+0000 7ff13d4a0700 1 -- 172.21.15.49:0/119848247 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff13814d8c0 con 0x7ff1380c3210 2023-11-30T17:22:43.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.669+0000 7ff13d4a0700 1 -- 172.21.15.49:0/119848247 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff13806c7c0 con 0x7ff1380c3210 2023-11-30T17:22:43.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.669+0000 7ff12effd700 1 -- 172.21.15.49:0/119848247 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 29) v1 ==== 75605+0+0 (secure 0 0 0) 0x7ff12801b400 con 0x7ff1380c3210 2023-11-30T17:22:43.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.670+0000 7ff12effd700 1 --2- 172.21.15.49:0/119848247 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff11805f300 0x7ff1180617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:43.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.670+0000 7ff12effd700 1 -- 172.21.15.49:0/119848247 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6407+0+0 (secure 0 0 0) 0x7ff12807abc0 con 0x7ff1380c3210 2023-11-30T17:22:43.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.670+0000 7ff1367fc700 1 -- 172.21.15.49:0/119848247 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff11805f300 msgr2=0x7ff1180617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:43.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.670+0000 7ff1367fc700 1 --2- 172.21.15.49:0/119848247 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff11805f300 0x7ff1180617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:22:43.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.674+0000 7ff12effd700 1 -- 172.21.15.49:0/119848247 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff12804bb40 con 0x7ff1380c3210 2023-11-30T17:22:43.706 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:43.705+0000 7f72e0d02680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T17:22:43.727 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:43.725+0000 7f5342644680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T17:22:43.779 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:43.778+0000 7f72e0d02680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T17:22:43.798 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:43.795+0000 7f5342644680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T17:22:43.858 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:43.857+0000 7f72e0d02680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T17:22:43.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.871+0000 7ff1367fc700 1 -- 172.21.15.49:0/119848247 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff11805f300 msgr2=0x7ff1180617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:43.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.871+0000 7ff1367fc700 1 --2- 172.21.15.49:0/119848247 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff11805f300 0x7ff1180617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:22:43.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.893+0000 7ff13d4a0700 1 -- 172.21.15.49:0/119848247 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff138069ff0 con 0x7ff1380c3210 2023-11-30T17:22:43.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.894+0000 7ff12effd700 1 -- 172.21.15.49:0/119848247 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4496 (secure 0 0 0) 0x7ff12804f160 con 0x7ff1380c3210 2023-11-30T17:22:43.895 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:43.895 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/3245104889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3245104889},{"type":"v1","addr":"172.21.15.115:6836","nonce":3245104889}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5579,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1933850814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1933850814},{"type":"v1","addr":"172.21.15.115:6837","nonce":1933850814}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6225,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1356528561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1356528561},{"type":"v1","addr":"172.21.15.49:6834","nonce":1356528561}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:22:21.305720+0000","modified":"2023-11-30T17:22:24.320718+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6228},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6228":{"gid":6228,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1786065897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1786065897},{"type":"v1","addr":"172.21.15.49:6835","nonce":1786065897}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-11-30T17:22:43.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.896+0000 7ff13d4a0700 1 -- 172.21.15.49:0/119848247 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff11805f300 msgr2=0x7ff1180617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:22:43.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.896+0000 7ff13d4a0700 1 --2- 172.21.15.49:0/119848247 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff11805f300 0x7ff1180617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:43.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.896+0000 7ff13d4a0700 1 -- 172.21.15.49:0/119848247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1380c3210 msgr2=0x7ff138148490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:43.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.896+0000 7ff13d4a0700 1 --2- 172.21.15.49:0/119848247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1380c3210 0x7ff138148490 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7ff12800ea20 tx=0x7ff128009060).stop 2023-11-30T17:22:43.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.896+0000 7ff13d4a0700 1 -- 172.21.15.49:0/119848247 shutdown_connections 2023-11-30T17:22:43.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.896+0000 7ff13d4a0700 1 --2- 172.21.15.49:0/119848247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff138155190 0x7ff1380aba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:43.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.896+0000 7ff13d4a0700 1 --2- 172.21.15.49:0/119848247 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff11805f300 0x7ff1180617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:43.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.896+0000 7ff13d4a0700 1 --2- 172.21.15.49:0/119848247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1380c3210 0x7ff138148490 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:43.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.896+0000 7ff13d4a0700 1 --2- 172.21.15.49:0/119848247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff13814eb80 0x7ff1380a7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:43.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.896+0000 7ff13d4a0700 1 -- 172.21.15.49:0/119848247 >> 172.21.15.49:0/119848247 conn(0x7ff1380c3f20 msgr2=0x7ff1380bd740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:43.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.896+0000 7ff13d4a0700 1 -- 172.21.15.49:0/119848247 shutdown_connections 2023-11-30T17:22:43.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:43.896+0000 7ff13d4a0700 1 -- 172.21.15.49:0/119848247 wait complete. 2023-11-30T17:22:43.904 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 32 2023-11-30T17:22:43.910 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:22:43.913 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:43.911+0000 7f5342644680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T17:22:44.019 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:44.018+0000 7f72e0d02680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T17:22:44.020 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:44.018+0000 7f5342644680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:22:44.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.028+0000 7fee17a5f700 1 Processor -- start 2023-11-30T17:22:44.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.028+0000 7fee17a5f700 1 -- start start 2023-11-30T17:22:44.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.029+0000 7fee17a5f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee101544e0 0x7fee101548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:44.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.029+0000 7fee17a5f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fee100c6e30 0x7fee100c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:44.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.029+0000 7fee17a5f700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee100c69a0 con 0x7fee1006a610 2023-11-30T17:22:44.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.029+0000 7fee17a5f700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee100c13a0 con 0x7fee100c6e30 2023-11-30T17:22:44.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.029+0000 7fee17a5f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee100c1680 con 0x7fee101544e0 2023-11-30T17:22:44.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.029+0000 7fee15ffc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fee100c6e30 0x7fee100c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:44.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.029+0000 7fee15ffc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fee100c6e30 0x7fee100c72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46054/0 (socket says 172.21.15.49:46054) 2023-11-30T17:22:44.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.029+0000 7fee15ffc700 1 -- 172.21.15.49:0/2329395038 learned_addr learned my addr 172.21.15.49:0/2329395038 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:44.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.029+0000 7fee157fb700 1 --2- 172.21.15.49:0/2329395038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee101544e0 0x7fee101548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:44.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.029+0000 7fee14ffa700 1 --1- 172.21.15.49:0/2329395038 >> v1:172.21.15.115:6789/0 conn(0x7fee1006a610 0x7fee100c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:59514/0 (socket says 172.21.15.49:59514) 2023-11-30T17:22:44.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.030+0000 7fee15ffc700 1 -- 172.21.15.49:0/2329395038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee101544e0 msgr2=0x7fee101548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:44.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.030+0000 7fee07fff700 1 -- 172.21.15.49:0/2329395038 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3346331308 0 0) 0x7fee100c69a0 con 0x7fee1006a610 2023-11-30T17:22:44.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.030+0000 7fee15ffc700 1 --2- 172.21.15.49:0/2329395038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee101544e0 0x7fee101548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:44.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.030+0000 7fee15ffc700 1 -- 172.21.15.49:0/2329395038 >> v1:172.21.15.115:6789/0 conn(0x7fee1006a610 legacy=0x7fee100c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:44.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.030+0000 7fee15ffc700 1 -- 172.21.15.49:0/2329395038 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee100c6630 con 0x7fee100c6e30 2023-11-30T17:22:44.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.030+0000 7fee157fb700 1 --2- 172.21.15.49:0/2329395038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee101544e0 0x7fee101548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:22:44.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.030+0000 7fee15ffc700 1 --2- 172.21.15.49:0/2329395038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee100c6e30 0x7fee100c72e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7fee08009f20 tx=0x7fee08009840).ready entity=mon.0 client_cookie=a0524054eeb48790 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:44.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.030+0000 7fee07fff700 1 -- 172.21.15.49:0/2329395038 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0800e070 con 0x7fee100c6e30 2023-11-30T17:22:44.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.030+0000 7fee07fff700 1 -- 172.21.15.49:0/2329395038 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0800b9d0 con 0x7fee100c6e30 2023-11-30T17:22:44.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.030+0000 7fee07fff700 1 -- 172.21.15.49:0/2329395038 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0800bd50 con 0x7fee100c6e30 2023-11-30T17:22:44.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.030+0000 7fee17a5f700 1 -- 172.21.15.49:0/2329395038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee100c6e30 msgr2=0x7fee100c72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:44.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.030+0000 7fee17a5f700 1 --2- 172.21.15.49:0/2329395038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee100c6e30 0x7fee100c72e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7fee08009f20 tx=0x7fee08009840).stop 2023-11-30T17:22:44.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.030+0000 7fee17a5f700 1 -- 172.21.15.49:0/2329395038 shutdown_connections 2023-11-30T17:22:44.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.030+0000 7fee17a5f700 1 --2- 172.21.15.49:0/2329395038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee101544e0 0x7fee101548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:44.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.031+0000 7fee17a5f700 1 --2- 172.21.15.49:0/2329395038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee100c6e30 0x7fee100c72e0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:44.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.031+0000 7fee17a5f700 1 -- 172.21.15.49:0/2329395038 >> 172.21.15.49:0/2329395038 conn(0x7fee10085020 msgr2=0x7fee10094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:44.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.031+0000 7fee17a5f700 1 -- 172.21.15.49:0/2329395038 shutdown_connections 2023-11-30T17:22:44.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.031+0000 7fee17a5f700 1 -- 172.21.15.49:0/2329395038 wait complete. 2023-11-30T17:22:44.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.032+0000 7fee17a5f700 1 Processor -- start 2023-11-30T17:22:44.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.032+0000 7fee17a5f700 1 -- start start 2023-11-30T17:22:44.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.033+0000 7fee17a5f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee1006a610 0x7fee1014ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:44.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.033+0000 7fee17a5f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee100c6e30 0x7fee100aac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:44.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.033+0000 7fee17a5f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee101544e0 0x7fee100ab160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:44.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.033+0000 7fee17a5f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee10097540 con 0x7fee101544e0 2023-11-30T17:22:44.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.033+0000 7fee17a5f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee10097820 con 0x7fee100c6e30 2023-11-30T17:22:44.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.033+0000 7fee17a5f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee10097b00 con 0x7fee1006a610 2023-11-30T17:22:44.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.033+0000 7fee15ffc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee101544e0 0x7fee100ab160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:44.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.033+0000 7fee157fb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee1006a610 0x7fee1014ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:44.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.033+0000 7fee14ffa700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee100c6e30 0x7fee100aac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:44.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.033+0000 7fee15ffc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee101544e0 0x7fee100ab160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46068/0 (socket says 172.21.15.49:46068) 2023-11-30T17:22:44.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.033+0000 7fee157fb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee1006a610 0x7fee1014ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:33534/0 (socket says 172.21.15.49:33534) 2023-11-30T17:22:44.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.033+0000 7fee14ffa700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee100c6e30 0x7fee100aac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:38834/0 (socket says 172.21.15.49:38834) 2023-11-30T17:22:44.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.033+0000 7fee15ffc700 1 -- 172.21.15.49:0/3642757247 learned_addr learned my addr 172.21.15.49:0/3642757247 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:44.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.033+0000 7fee14ffa700 1 -- 172.21.15.49:0/3642757247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee1006a610 msgr2=0x7fee1014ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:44.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.033+0000 7fee14ffa700 1 --2- 172.21.15.49:0/3642757247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee1006a610 0x7fee1014ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:44.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.033+0000 7fee14ffa700 1 -- 172.21.15.49:0/3642757247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee101544e0 msgr2=0x7fee100ab160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:44.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.033+0000 7fee14ffa700 1 --2- 172.21.15.49:0/3642757247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee101544e0 0x7fee100ab160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:44.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.033+0000 7fee14ffa700 1 -- 172.21.15.49:0/3642757247 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee00009250 con 0x7fee100c6e30 2023-11-30T17:22:44.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.033+0000 7fee15ffc700 1 --2- 172.21.15.49:0/3642757247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee101544e0 0x7fee100ab160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:22:44.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.033+0000 7fee14ffa700 1 --2- 172.21.15.49:0/3642757247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee100c6e30 0x7fee100aac70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fee0c00c460 tx=0x7fee0c007d70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:44.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.033+0000 7fee057fa700 1 -- 172.21.15.49:0/3642757247 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c0070d0 con 0x7fee100c6e30 2023-11-30T17:22:44.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.034+0000 7fee057fa700 1 -- 172.21.15.49:0/3642757247 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0c007230 con 0x7fee100c6e30 2023-11-30T17:22:44.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.034+0000 7fee17a5f700 1 -- 172.21.15.49:0/3642757247 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee08009ae0 con 0x7fee100c6e30 2023-11-30T17:22:44.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.034+0000 7fee057fa700 1 -- 172.21.15.49:0/3642757247 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c0056e0 con 0x7fee100c6e30 2023-11-30T17:22:44.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.034+0000 7fee17a5f700 1 -- 172.21.15.49:0/3642757247 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee100980c0 con 0x7fee100c6e30 2023-11-30T17:22:44.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.034+0000 7fee17a5f700 1 -- 172.21.15.49:0/3642757247 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee1006c860 con 0x7fee100c6e30 2023-11-30T17:22:44.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.035+0000 7fee057fa700 1 -- 172.21.15.49:0/3642757247 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 29) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fee0c005a90 con 0x7fee100c6e30 2023-11-30T17:22:44.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.035+0000 7fee057fa700 1 --2- 172.21.15.49:0/3642757247 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fedf405f300 0x7fedf40617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:44.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.035+0000 7fee157fb700 1 -- 172.21.15.49:0/3642757247 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fedf405f300 msgr2=0x7fedf40617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:44.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.035+0000 7fee057fa700 1 -- 172.21.15.49:0/3642757247 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6407+0+0 (secure 0 0 0) 0x7fee0c079c80 con 0x7fee100c6e30 2023-11-30T17:22:44.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.035+0000 7fee157fb700 1 --2- 172.21.15.49:0/3642757247 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fedf405f300 0x7fedf40617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:22:44.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.039+0000 7fee057fa700 1 -- 172.21.15.49:0/3642757247 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fee0c04ab30 con 0x7fee100c6e30 2023-11-30T17:22:44.097 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:44.095+0000 7f72e0d02680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T17:22:44.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.215+0000 7fee17a5f700 1 -- 172.21.15.49:0/3642757247 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee100b0fa0 con 0x7fee100c6e30 2023-11-30T17:22:44.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.216+0000 7fee057fa700 1 -- 172.21.15.49:0/3642757247 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+17345 (secure 0 0 0) 0x7fee0c04e150 con 0x7fee100c6e30 2023-11-30T17:22:44.217 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:44.218 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":84,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:22:38.144216+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:22:19.274919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-30T17:22:20.286346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/1814309049":"2023-12-01T17:22:38.144175+0000","172.21.15.115:6833/89956":"2023-12-01T17:22:38.144175+0000","172.21.15.115:6832/89956":"2023-12-01T17:22:38.144175+0000","172.21.15.115:0/4214471495":"2023-12-01T17:22:38.144175+0000","172.21.15.115:0/3198129794":"2023-12-01T17:22:38.144175+0000","172.21.15.115:0/939691547":"2023-12-01T17:22:38.144175+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:22:44.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.218+0000 7fee17a5f700 1 -- 172.21.15.49:0/3642757247 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fedf405f300 msgr2=0x7fedf40617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:22:44.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.218+0000 7fee17a5f700 1 --2- 172.21.15.49:0/3642757247 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fedf405f300 0x7fedf40617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:44.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.218+0000 7fee17a5f700 1 -- 172.21.15.49:0/3642757247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee100c6e30 msgr2=0x7fee100aac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:44.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.218+0000 7fee17a5f700 1 --2- 172.21.15.49:0/3642757247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee100c6e30 0x7fee100aac70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fee0c00c460 tx=0x7fee0c007d70).stop 2023-11-30T17:22:44.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.218+0000 7fee17a5f700 1 -- 172.21.15.49:0/3642757247 shutdown_connections 2023-11-30T17:22:44.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.218+0000 7fee17a5f700 1 --2- 172.21.15.49:0/3642757247 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fedf405f300 0x7fedf40617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:44.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.218+0000 7fee17a5f700 1 --2- 172.21.15.49:0/3642757247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee101544e0 0x7fee100ab160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:44.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.218+0000 7fee17a5f700 1 --2- 172.21.15.49:0/3642757247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee1006a610 0x7fee1014ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:44.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.218+0000 7fee17a5f700 1 --2- 172.21.15.49:0/3642757247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee100c6e30 0x7fee100aac70 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:44.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.218+0000 7fee17a5f700 1 -- 172.21.15.49:0/3642757247 >> 172.21.15.49:0/3642757247 conn(0x7fee10085020 msgr2=0x7fee100cbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:44.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.218+0000 7fee17a5f700 1 -- 172.21.15.49:0/3642757247 shutdown_connections 2023-11-30T17:22:44.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.218+0000 7fee17a5f700 1 -- 172.21.15.49:0/3642757247 wait complete. 2023-11-30T17:22:44.221 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:44.219+0000 7f72e0d02680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T17:22:44.232 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-30T17:22:44.311 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:44.308+0000 7f5342644680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T17:22:44.337 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:44.336+0000 7f72e0d02680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:22:44.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.351+0000 7f085cb77700 1 Processor -- start 2023-11-30T17:22:44.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.351+0000 7f085cb77700 1 -- start start 2023-11-30T17:22:44.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.352+0000 7f085cb77700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0858069640 0x7f08580630d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:44.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.352+0000 7f085cb77700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f085806a7c0 con 0x7f08581544b0 2023-11-30T17:22:44.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.352+0000 7f085cb77700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08580ada70 con 0x7f08580c2af0 2023-11-30T17:22:44.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.352+0000 7f085cb77700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08580c5330 con 0x7f0858069640 2023-11-30T17:22:44.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.352+0000 7f08577fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f08581544b0 0x7f08580c23e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45412/0 (socket says 172.21.15.49:45412) 2023-11-30T17:22:44.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.352+0000 7f08577fe700 1 -- 172.21.15.49:0/2112067049 learned_addr learned my addr 172.21.15.49:0/2112067049 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:44.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.352+0000 7f0857fff700 1 --2- 172.21.15.49:0/2112067049 >> v2:172.21.15.115:3300/0 conn(0x7f0858069640 0x7f08580630d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:44.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.352+0000 7f0856ffd700 1 -- 172.21.15.49:0/2112067049 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2245123471 0 0) 0x7f085806a7c0 con 0x7f08581544b0 2023-11-30T17:22:44.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.353+0000 7f0856ffd700 1 -- 172.21.15.49:0/2112067049 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08440033f0 con 0x7f08581544b0 2023-11-30T17:22:44.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.353+0000 7f0856ffd700 1 -- 172.21.15.49:0/2112067049 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3502788409 0 0) 0x7f08580ada70 con 0x7f08580c2af0 2023-11-30T17:22:44.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.353+0000 7f0856ffd700 1 -- 172.21.15.49:0/2112067049 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f085806a7c0 con 0x7f08580c2af0 2023-11-30T17:22:44.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.353+0000 7f0857fff700 1 -- 172.21.15.49:0/2112067049 >> v1:172.21.15.115:6789/0 conn(0x7f08580c2af0 legacy=0x7f08580aaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:44.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.353+0000 7f0857fff700 1 -- 172.21.15.49:0/2112067049 >> v1:172.21.15.49:6789/0 conn(0x7f08581544b0 legacy=0x7f08580c23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:44.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.353+0000 7f0857fff700 1 -- 172.21.15.49:0/2112067049 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0858069bb0 con 0x7f0858069640 2023-11-30T17:22:44.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.353+0000 7f0857fff700 1 --2- 172.21.15.49:0/2112067049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0858069640 0x7f08580630d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f0850009e60 tx=0x7f0850009780).ready entity=mon.1 client_cookie=911e581379d9d089 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:44.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.353+0000 7f0856ffd700 1 -- 172.21.15.49:0/2112067049 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085000e070 con 0x7f0858069640 2023-11-30T17:22:44.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.353+0000 7f0856ffd700 1 -- 172.21.15.49:0/2112067049 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085000bab0 con 0x7f0858069640 2023-11-30T17:22:44.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.353+0000 7f0856ffd700 1 -- 172.21.15.49:0/2112067049 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085000be30 con 0x7f0858069640 2023-11-30T17:22:44.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.354+0000 7f085cb77700 1 -- 172.21.15.49:0/2112067049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0858069640 msgr2=0x7f08580630d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:44.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.354+0000 7f085cb77700 1 --2- 172.21.15.49:0/2112067049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0858069640 0x7f08580630d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f0850009e60 tx=0x7f0850009780).stop 2023-11-30T17:22:44.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.354+0000 7f085cb77700 1 -- 172.21.15.49:0/2112067049 shutdown_connections 2023-11-30T17:22:44.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.354+0000 7f085cb77700 1 --2- 172.21.15.49:0/2112067049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0858069640 0x7f08580630d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:44.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.354+0000 7f085cb77700 1 -- 172.21.15.49:0/2112067049 >> 172.21.15.49:0/2112067049 conn(0x7f0858063810 msgr2=0x7f0858063c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:44.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.354+0000 7f085cb77700 1 -- 172.21.15.49:0/2112067049 shutdown_connections 2023-11-30T17:22:44.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.354+0000 7f085cb77700 1 -- 172.21.15.49:0/2112067049 wait complete. 2023-11-30T17:22:44.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.355+0000 7f085cb77700 1 Processor -- start 2023-11-30T17:22:44.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.355+0000 7f085cb77700 1 -- start start 2023-11-30T17:22:44.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.355+0000 7f085cb77700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0858069640 0x7f08580bf890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:44.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.356+0000 7f085cb77700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08580c2af0 0x7f085814c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.356+0000 7f085cb77700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08581544b0 0x7f08580bda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.356+0000 7f085cb77700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0858158110 con 0x7f0858069640 2023-11-30T17:22:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.356+0000 7f085cb77700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08580c0680 con 0x7f08580c2af0 2023-11-30T17:22:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.356+0000 7f085cb77700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0858155cc0 con 0x7f08581544b0 2023-11-30T17:22:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.356+0000 7f08577fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0858069640 0x7f08580bf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.356+0000 7f08577fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0858069640 0x7f08580bf890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46074/0 (socket says 172.21.15.49:46074) 2023-11-30T17:22:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.356+0000 7f08577fe700 1 -- 172.21.15.49:0/1649097314 learned_addr learned my addr 172.21.15.49:0/1649097314 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.356+0000 7f084ffff700 1 --2- 172.21.15.49:0/1649097314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08580c2af0 0x7f085814c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.356+0000 7f0857fff700 1 --2- 172.21.15.49:0/1649097314 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08581544b0 0x7f08580bda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.356+0000 7f084ffff700 1 -- 172.21.15.49:0/1649097314 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08581544b0 msgr2=0x7f08580bda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.356+0000 7f084ffff700 1 --2- 172.21.15.49:0/1649097314 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08581544b0 0x7f08580bda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.356+0000 7f084ffff700 1 -- 172.21.15.49:0/1649097314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0858069640 msgr2=0x7f08580bf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.356+0000 7f084ffff700 1 --2- 172.21.15.49:0/1649097314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0858069640 0x7f08580bf890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.356+0000 7f084ffff700 1 -- 172.21.15.49:0/1649097314 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0850009a20 con 0x7f08580c2af0 2023-11-30T17:22:44.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.356+0000 7f084ffff700 1 --2- 172.21.15.49:0/1649097314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08580c2af0 0x7f085814c510 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f084000c420 tx=0x7f0840007bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:44.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.356+0000 7f084f7fe700 1 -- 172.21.15.49:0/1649097314 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0840012400 con 0x7f08580c2af0 2023-11-30T17:22:44.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.356+0000 7f084f7fe700 1 -- 172.21.15.49:0/1649097314 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0840012560 con 0x7f08580c2af0 2023-11-30T17:22:44.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.356+0000 7f085cb77700 1 -- 172.21.15.49:0/1649097314 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08580bfd80 con 0x7f08580c2af0 2023-11-30T17:22:44.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.356+0000 7f084f7fe700 1 -- 172.21.15.49:0/1649097314 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0840012900 con 0x7f08580c2af0 2023-11-30T17:22:44.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.356+0000 7f085cb77700 1 -- 172.21.15.49:0/1649097314 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0858167f60 con 0x7f08580c2af0 2023-11-30T17:22:44.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.358+0000 7f084f7fe700 1 -- 172.21.15.49:0/1649097314 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 29) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f084001b3b0 con 0x7f08580c2af0 2023-11-30T17:22:44.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.358+0000 7f085cb77700 1 -- 172.21.15.49:0/1649097314 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08580c07f0 con 0x7f08580c2af0 2023-11-30T17:22:44.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.358+0000 7f084f7fe700 1 --2- 172.21.15.49:0/1649097314 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f083805f300 0x7f08380617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:44.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.358+0000 7f08577fe700 1 -- 172.21.15.49:0/1649097314 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f083805f300 msgr2=0x7f08380617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:22:44.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.358+0000 7f084f7fe700 1 -- 172.21.15.49:0/1649097314 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6407+0+0 (secure 0 0 0) 0x7f0840079d60 con 0x7f08580c2af0 2023-11-30T17:22:44.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.358+0000 7f08577fe700 1 --2- 172.21.15.49:0/1649097314 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f083805f300 0x7f08380617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:22:44.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.363+0000 7f084f7fe700 1 -- 172.21.15.49:0/1649097314 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f084004acb0 con 0x7f08580c2af0 2023-11-30T17:22:44.382 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:44.380+0000 7f5342644680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T17:22:44.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.403+0000 7f084f7fe700 1 -- 172.21.15.49:0/1649097314 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mgrmap(e 30) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f0840077810 con 0x7f08580c2af0 2023-11-30T17:22:44.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.403+0000 7f084f7fe700 1 -- 172.21.15.49:0/1649097314 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f083805f300 msgr2=0x7f08380617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:22:44.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.403+0000 7f084f7fe700 1 --2- 172.21.15.49:0/1649097314 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f083805f300 0x7f08380617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:44.459 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:44.456+0000 7f52bfddc700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:22:44.459 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:44.456+0000 7f52bfddc700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:22:44.459 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:44.456+0000 7f52bfddc700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:22:44.459 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:44.456+0000 7f52bfddc700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:22:44.459 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:44.456+0000 7f52bfddc700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:22:44.460 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:44.457+0000 7f52bc5d5700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:22:44.460 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:44.457+0000 7f52bc5d5700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:22:44.460 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:44.457+0000 7f52bc5d5700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:22:44.460 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:44.457+0000 7f52bc5d5700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:22:44.460 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:22:44.457+0000 7f52bc5d5700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:22:44.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:44.603+0000 7f085cb77700 1 -- 172.21.15.49:0/1649097314 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f08580ade90 con 0x7f08580c2af0 2023-11-30T17:22:44.656 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:44.654+0000 7f72e0d02680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T17:22:44.730 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:22:44.729+0000 7f72e0d02680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T17:22:45.398 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-11-30T17:22:45.397+0000 7f3888d95700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-30T17:22:45.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.401+0000 7f084f7fe700 1 -- 172.21.15.49:0/1649097314 <== mon.1 v2:172.21.15.115:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) v1 ==== 161+0+0 (secure 0 0 0) 0x7f084006ea90 con 0x7f08580c2af0 2023-11-30T17:22:45.404 INFO:tasks.ceph.mds.c.smithi049.stderr: -2630> 2023-11-30T17:22:26.578+0000 7f083445a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-30T17:22:45.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.404+0000 7f085cb77700 1 -- 172.21.15.49:0/1649097314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08580c2af0 msgr2=0x7f085814c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:45.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.404+0000 7f085cb77700 1 --2- 172.21.15.49:0/1649097314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08580c2af0 0x7f085814c510 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f084000c420 tx=0x7f0840007bd0).stop 2023-11-30T17:22:45.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.404+0000 7f085cb77700 1 -- 172.21.15.49:0/1649097314 shutdown_connections 2023-11-30T17:22:45.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.404+0000 7f085cb77700 1 --2- 172.21.15.49:0/1649097314 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08581544b0 0x7f08580bda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:45.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.404+0000 7f085cb77700 1 --2- 172.21.15.49:0/1649097314 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f083805f300 0x7f08380617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:22:45.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.404+0000 7f085cb77700 1 --2- 172.21.15.49:0/1649097314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0858069640 0x7f08580bf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:45.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.404+0000 7f085cb77700 1 --2- 172.21.15.49:0/1649097314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08580c2af0 0x7f085814c510 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:45.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.404+0000 7f085cb77700 1 -- 172.21.15.49:0/1649097314 >> 172.21.15.49:0/1649097314 conn(0x7f0858063810 msgr2=0x7f08580c6430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:45.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.404+0000 7f085cb77700 1 -- 172.21.15.49:0/1649097314 shutdown_connections 2023-11-30T17:22:45.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.405+0000 7f085cb77700 1 -- 172.21.15.49:0/1649097314 wait complete. 2023-11-30T17:22:45.408 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-30T17:22:45.423 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-30T17:22:45.434 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-11-30T17:22:45.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.544+0000 7f388bbb3700 1 Processor -- start 2023-11-30T17:22:45.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.544+0000 7f388bbb3700 1 -- start start 2023-11-30T17:22:45.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.545+0000 7f388bbb3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3884098d10 0x7f38840c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:45.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.545+0000 7f388bbb3700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38840c72d0 con 0x7f38840c6190 2023-11-30T17:22:45.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.545+0000 7f388bbb3700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3884064570 con 0x7f3884158320 2023-11-30T17:22:45.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.545+0000 7f388bbb3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3884154bc0 con 0x7f3884098d10 2023-11-30T17:22:45.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.545+0000 7f388914e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f38840c6190 0x7f3884063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45442/0 (socket says 172.21.15.49:45442) 2023-11-30T17:22:45.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.545+0000 7f388914e700 1 -- 172.21.15.49:0/2048906316 learned_addr learned my addr 172.21.15.49:0/2048906316 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:45.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.545+0000 7f388994f700 1 --2- 172.21.15.49:0/2048906316 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3884098d10 0x7f38840c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:45.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.546+0000 7f388894d700 1 -- 172.21.15.49:0/2048906316 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 760580658 0 0) 0x7f38840c72d0 con 0x7f38840c6190 2023-11-30T17:22:45.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.546+0000 7f388894d700 1 -- 172.21.15.49:0/2048906316 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f386c0033f0 con 0x7f38840c6190 2023-11-30T17:22:45.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.546+0000 7f388894d700 1 -- 172.21.15.49:0/2048906316 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 227520232 0 0) 0x7f3884064570 con 0x7f3884158320 2023-11-30T17:22:45.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.546+0000 7f388994f700 1 -- 172.21.15.49:0/2048906316 >> v1:172.21.15.115:6789/0 conn(0x7f3884158320 legacy=0x7f38840a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:45.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.546+0000 7f388994f700 1 -- 172.21.15.49:0/2048906316 >> v1:172.21.15.49:6789/0 conn(0x7f38840c6190 legacy=0x7f3884063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:45.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.546+0000 7f388994f700 1 -- 172.21.15.49:0/2048906316 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38840c66c0 con 0x7f3884098d10 2023-11-30T17:22:45.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.546+0000 7f388994f700 1 --2- 172.21.15.49:0/2048906316 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3884098d10 0x7f38840c7760 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f3874009e90 tx=0x7f3874009780).ready entity=mon.2 client_cookie=e3a5872d0208d5a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:45.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.546+0000 7f388894d700 1 -- 172.21.15.49:0/2048906316 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387400e070 con 0x7f3884098d10 2023-11-30T17:22:45.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.546+0000 7f388894d700 1 -- 172.21.15.49:0/2048906316 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f387400bb60 con 0x7f3884098d10 2023-11-30T17:22:45.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.546+0000 7f388894d700 1 -- 172.21.15.49:0/2048906316 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387400bee0 con 0x7f3884098d10 2023-11-30T17:22:45.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.547+0000 7f388bbb3700 1 -- 172.21.15.49:0/2048906316 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3884098d10 msgr2=0x7f38840c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:45.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.547+0000 7f388bbb3700 1 --2- 172.21.15.49:0/2048906316 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3884098d10 0x7f38840c7760 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f3874009e90 tx=0x7f3874009780).stop 2023-11-30T17:22:45.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.547+0000 7f388bbb3700 1 -- 172.21.15.49:0/2048906316 shutdown_connections 2023-11-30T17:22:45.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.547+0000 7f388bbb3700 1 --2- 172.21.15.49:0/2048906316 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3884098d10 0x7f38840c7760 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:45.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.547+0000 7f388bbb3700 1 -- 172.21.15.49:0/2048906316 >> 172.21.15.49:0/2048906316 conn(0x7f38840cb310 msgr2=0x7f38840cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:45.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.547+0000 7f388bbb3700 1 -- 172.21.15.49:0/2048906316 shutdown_connections 2023-11-30T17:22:45.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.547+0000 7f388bbb3700 1 -- 172.21.15.49:0/2048906316 wait complete. 2023-11-30T17:22:45.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.548+0000 7f388bbb3700 1 Processor -- start 2023-11-30T17:22:45.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.548+0000 7f388bbb3700 1 -- start start 2023-11-30T17:22:45.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.549+0000 7f388bbb3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3884098d10 0x7f38841508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:45.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.549+0000 7f388bbb3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38840c6190 0x7f38841550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:45.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.549+0000 7f388bbb3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3884158320 0x7f38840af290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:45.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.549+0000 7f388bbb3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38840b1390 con 0x7f3884098d10 2023-11-30T17:22:45.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.549+0000 7f388bbb3700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38840c5290 con 0x7f38840c6190 2023-11-30T17:22:45.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.549+0000 7f388bbb3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38840ae510 con 0x7f3884158320 2023-11-30T17:22:45.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.549+0000 7f388994f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3884098d10 0x7f38841508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:45.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.549+0000 7f388994f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3884098d10 0x7f38841508d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46090/0 (socket says 172.21.15.49:46090) 2023-11-30T17:22:45.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.549+0000 7f388994f700 1 -- 172.21.15.49:0/1368015829 learned_addr learned my addr 172.21.15.49:0/1368015829 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:45.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.549+0000 7f388914e700 1 --2- 172.21.15.49:0/1368015829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38840c6190 0x7f38841550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:45.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.549+0000 7f388a150700 1 --2- 172.21.15.49:0/1368015829 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3884158320 0x7f38840af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:45.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.549+0000 7f388994f700 1 -- 172.21.15.49:0/1368015829 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3884158320 msgr2=0x7f38840af290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:45.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.549+0000 7f388994f700 1 --2- 172.21.15.49:0/1368015829 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3884158320 0x7f38840af290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:45.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.549+0000 7f388994f700 1 -- 172.21.15.49:0/1368015829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38840c6190 msgr2=0x7f38841550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:45.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.549+0000 7f388994f700 1 --2- 172.21.15.49:0/1368015829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38840c6190 0x7f38841550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:45.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.549+0000 7f388994f700 1 -- 172.21.15.49:0/1368015829 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3874009a20 con 0x7f3884098d10 2023-11-30T17:22:45.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.549+0000 7f388994f700 1 --2- 172.21.15.49:0/1368015829 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3884098d10 0x7f38841508d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f387400b6c0 tx=0x7f3874009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:45.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.549+0000 7f3881ffb700 1 -- 172.21.15.49:0/1368015829 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3874009440 con 0x7f3884098d10 2023-11-30T17:22:45.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.549+0000 7f3881ffb700 1 -- 172.21.15.49:0/1368015829 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f387401d420 con 0x7f3884098d10 2023-11-30T17:22:45.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.549+0000 7f388bbb3700 1 -- 172.21.15.49:0/1368015829 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38840ae7b0 con 0x7f3884098d10 2023-11-30T17:22:45.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.549+0000 7f3881ffb700 1 -- 172.21.15.49:0/1368015829 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387401d7c0 con 0x7f3884098d10 2023-11-30T17:22:45.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.550+0000 7f388bbb3700 1 -- 172.21.15.49:0/1368015829 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38840aed70 con 0x7f3884098d10 2023-11-30T17:22:45.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.551+0000 7f388bbb3700 1 -- 172.21.15.49:0/1368015829 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f388406c860 con 0x7f3884098d10 2023-11-30T17:22:45.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.551+0000 7f3881ffb700 1 -- 172.21.15.49:0/1368015829 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 31) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f3874003040 con 0x7f3884098d10 2023-11-30T17:22:45.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.551+0000 7f3881ffb700 1 --2- 172.21.15.49:0/1368015829 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f387005f060 0x7f3870061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:45.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.552+0000 7f3881ffb700 1 -- 172.21.15.49:0/1368015829 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6708+0+0 (secure 0 0 0) 0x7f387407bde0 con 0x7f3884098d10 2023-11-30T17:22:45.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.552+0000 7f388914e700 1 --2- 172.21.15.49:0/1368015829 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f387005f060 0x7f3870061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:45.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.552+0000 7f388914e700 1 --2- 172.21.15.49:0/1368015829 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f387005f060 0x7f3870061520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f3884156ca0 tx=0x7f3878009040).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:45.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.556+0000 7f3881ffb700 1 -- 172.21.15.49:0/1368015829 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3874050a60 con 0x7f3884098d10 2023-11-30T17:22:45.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:45.774+0000 7f388bbb3700 1 -- 172.21.15.49:0/1368015829 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f38840c69a0 con 0x7f3884098d10 2023-11-30T17:22:46.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.412+0000 7f3881ffb700 1 -- 172.21.15.49:0/1368015829 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3874050650 con 0x7f3884098d10 2023-11-30T17:22:46.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.415+0000 7f388bbb3700 1 -- 172.21.15.49:0/1368015829 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f387005f060 msgr2=0x7f3870061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:46.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.415+0000 7f388bbb3700 1 --2- 172.21.15.49:0/1368015829 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f387005f060 0x7f3870061520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f3884156ca0 tx=0x7f3878009040).stop 2023-11-30T17:22:46.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.415+0000 7f388bbb3700 1 -- 172.21.15.49:0/1368015829 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3884098d10 msgr2=0x7f38841508d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:46.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.415+0000 7f388bbb3700 1 --2- 172.21.15.49:0/1368015829 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3884098d10 0x7f38841508d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f387400b6c0 tx=0x7f3874009780).stop 2023-11-30T17:22:46.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.415+0000 7f388bbb3700 1 -- 172.21.15.49:0/1368015829 shutdown_connections 2023-11-30T17:22:46.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.415+0000 7f388bbb3700 1 --2- 172.21.15.49:0/1368015829 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3884158320 0x7f38840af290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:46.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.415+0000 7f388bbb3700 1 --2- 172.21.15.49:0/1368015829 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f387005f060 0x7f3870061520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:46.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.415+0000 7f388bbb3700 1 --2- 172.21.15.49:0/1368015829 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3884098d10 0x7f38841508d0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:46.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.415+0000 7f388bbb3700 1 --2- 172.21.15.49:0/1368015829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38840c6190 0x7f38841550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:46.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.415+0000 7f388bbb3700 1 -- 172.21.15.49:0/1368015829 >> 172.21.15.49:0/1368015829 conn(0x7f38840cb310 msgr2=0x7f3884063990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:46.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.415+0000 7f388bbb3700 1 -- 172.21.15.49:0/1368015829 shutdown_connections 2023-11-30T17:22:46.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.415+0000 7f388bbb3700 1 -- 172.21.15.49:0/1368015829 wait complete. 2023-11-30T17:22:46.434 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-30T17:22:46.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.603+0000 7f0036add700 1 Processor -- start 2023-11-30T17:22:46.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.603+0000 7f0036add700 1 -- start start 2023-11-30T17:22:46.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.603+0000 7f0036add700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0030154530 0x7f0030154910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:46.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.603+0000 7f0036add700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f00300aa220 0x7f00300aa690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:46.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.603+0000 7f0036add700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00300c6630 con 0x7f00300a7ff0 2023-11-30T17:22:46.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.603+0000 7f0036add700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00300c6390 con 0x7f00300aa220 2023-11-30T17:22:46.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.603+0000 7f0036add700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00300a8470 con 0x7f0030154530 2023-11-30T17:22:46.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.604+0000 7f003507a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f00300aa220 0x7f00300aa690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:46.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.604+0000 7f003507a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f00300aa220 0x7f00300aa690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46098/0 (socket says 172.21.15.49:46098) 2023-11-30T17:22:46.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.604+0000 7f003507a700 1 -- 172.21.15.49:0/3426858478 learned_addr learned my addr 172.21.15.49:0/3426858478 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:46.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.604+0000 7f0034879700 1 --2- 172.21.15.49:0/3426858478 >> v2:172.21.15.115:3300/0 conn(0x7f0030154530 0x7f0030154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:46.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.604+0000 7f003507a700 1 -- 172.21.15.49:0/3426858478 >> v2:172.21.15.115:3300/0 conn(0x7f0030154530 msgr2=0x7f0030154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:46.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.604+0000 7f003507a700 1 --2- 172.21.15.49:0/3426858478 >> v2:172.21.15.115:3300/0 conn(0x7f0030154530 0x7f0030154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:46.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.604+0000 7f003507a700 1 -- 172.21.15.49:0/3426858478 >> v1:172.21.15.115:6789/0 conn(0x7f00300a7ff0 legacy=0x7f00300c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:46.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.604+0000 7f003507a700 1 -- 172.21.15.49:0/3426858478 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00300aab80 con 0x7f00300aa220 2023-11-30T17:22:46.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.604+0000 7f0034879700 1 --2- 172.21.15.49:0/3426858478 >> v2:172.21.15.115:3300/0 conn(0x7f0030154530 0x7f0030154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.604+0000 7f003507a700 1 --2- 172.21.15.49:0/3426858478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00300aa220 0x7f00300aa690 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f00300c9080 tx=0x7f00180090f0).ready entity=mon.0 client_cookie=2eb8613f5b104e14 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.604+0000 7f002f7fe700 1 -- 172.21.15.49:0/3426858478 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001800b600 con 0x7f00300aa220 2023-11-30T17:22:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.604+0000 7f002f7fe700 1 -- 172.21.15.49:0/3426858478 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001800b760 con 0x7f00300aa220 2023-11-30T17:22:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.604+0000 7f002f7fe700 1 -- 172.21.15.49:0/3426858478 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001800bae0 con 0x7f00300aa220 2023-11-30T17:22:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.605+0000 7f0036add700 1 -- 172.21.15.49:0/3426858478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00300aa220 msgr2=0x7f00300aa690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.605+0000 7f0036add700 1 --2- 172.21.15.49:0/3426858478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00300aa220 0x7f00300aa690 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f00300c9080 tx=0x7f00180090f0).stop 2023-11-30T17:22:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.605+0000 7f0036add700 1 -- 172.21.15.49:0/3426858478 shutdown_connections 2023-11-30T17:22:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.605+0000 7f0036add700 1 --2- 172.21.15.49:0/3426858478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00300aa220 0x7f00300aa690 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.605+0000 7f0036add700 1 --2- 172.21.15.49:0/3426858478 >> v2:172.21.15.115:3300/0 conn(0x7f0030154530 0x7f0030154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.605+0000 7f0036add700 1 -- 172.21.15.49:0/3426858478 >> 172.21.15.49:0/3426858478 conn(0x7f0030094930 msgr2=0x7f003006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.605+0000 7f0036add700 1 -- 172.21.15.49:0/3426858478 shutdown_connections 2023-11-30T17:22:46.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.605+0000 7f0036add700 1 -- 172.21.15.49:0/3426858478 wait complete. 2023-11-30T17:22:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.606+0000 7f0036add700 1 Processor -- start 2023-11-30T17:22:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.606+0000 7f0036add700 1 -- start start 2023-11-30T17:22:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.607+0000 7f0036add700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00300a7ff0 0x7f0030147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.607+0000 7f0036add700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00300aa220 0x7f0030167930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.607+0000 7f0036add700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0030154530 0x7f0030167e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.607+0000 7f0036add700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00300c3d00 con 0x7f00300aa220 2023-11-30T17:22:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.607+0000 7f0036add700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00300c3fe0 con 0x7f00300a7ff0 2023-11-30T17:22:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.607+0000 7f0036add700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00300c42c0 con 0x7f0030154530 2023-11-30T17:22:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.607+0000 7f002ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00300aa220 0x7f0030167930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.607+0000 7f002ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00300aa220 0x7f0030167930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46114/0 (socket says 172.21.15.49:46114) 2023-11-30T17:22:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.607+0000 7f002ffff700 1 -- 172.21.15.49:0/255883882 learned_addr learned my addr 172.21.15.49:0/255883882 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:46.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.607+0000 7f003507a700 1 --2- 172.21.15.49:0/255883882 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0030154530 0x7f0030167e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.607+0000 7f0034879700 1 --2- 172.21.15.49:0/255883882 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00300a7ff0 0x7f0030147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.607+0000 7f002ffff700 1 -- 172.21.15.49:0/255883882 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0030154530 msgr2=0x7f0030167e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.607+0000 7f002ffff700 1 --2- 172.21.15.49:0/255883882 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0030154530 0x7f0030167e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.607+0000 7f002ffff700 1 -- 172.21.15.49:0/255883882 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00300a7ff0 msgr2=0x7f0030147ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.607+0000 7f002ffff700 1 --2- 172.21.15.49:0/255883882 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00300a7ff0 0x7f0030147ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.607+0000 7f002ffff700 1 -- 172.21.15.49:0/255883882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0018009370 con 0x7f00300aa220 2023-11-30T17:22:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.607+0000 7f002ffff700 1 --2- 172.21.15.49:0/255883882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00300aa220 0x7f0030167930 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f002000c840 tx=0x7f0020001660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.608+0000 7f002cff9700 1 -- 172.21.15.49:0/255883882 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0020006a20 con 0x7f00300aa220 2023-11-30T17:22:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.608+0000 7f002cff9700 1 -- 172.21.15.49:0/255883882 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0020006b80 con 0x7f00300aa220 2023-11-30T17:22:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.608+0000 7f0036add700 1 -- 172.21.15.49:0/255883882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00300c45a0 con 0x7f00300aa220 2023-11-30T17:22:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.608+0000 7f002cff9700 1 -- 172.21.15.49:0/255883882 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0020007020 con 0x7f00300aa220 2023-11-30T17:22:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.608+0000 7f0036add700 1 -- 172.21.15.49:0/255883882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00300c4b60 con 0x7f00300aa220 2023-11-30T17:22:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.609+0000 7f0036add700 1 -- 172.21.15.49:0/255883882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f003006c860 con 0x7f00300aa220 2023-11-30T17:22:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.609+0000 7f002cff9700 1 -- 172.21.15.49:0/255883882 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 31) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f0020007410 con 0x7f00300aa220 2023-11-30T17:22:46.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.609+0000 7f002cff9700 1 --2- 172.21.15.49:0/255883882 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f001005f030 0x7f00100614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:46.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.609+0000 7f002cff9700 1 -- 172.21.15.49:0/255883882 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6708+0+0 (secure 0 0 0) 0x7f00200799a0 con 0x7f00300aa220 2023-11-30T17:22:46.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.610+0000 7f0034879700 1 --2- 172.21.15.49:0/255883882 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f001005f030 0x7f00100614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:46.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.610+0000 7f0034879700 1 --2- 172.21.15.49:0/255883882 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f001005f030 0x7f00100614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f0028006d20 tx=0x7f0028008040).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:46.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.614+0000 7f002cff9700 1 -- 172.21.15.49:0/255883882 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0020048b00 con 0x7f00300aa220 2023-11-30T17:22:46.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:46.784+0000 7f0036add700 1 -- 172.21.15.49:0/255883882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0030064230 con 0x7f00300aa220 2023-11-30T17:22:47.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.420+0000 7f002cff9700 1 -- 172.21.15.49:0/255883882 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f00200776f0 con 0x7f00300aa220 2023-11-30T17:22:47.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.420+0000 7f002cff9700 1 -- 172.21.15.49:0/255883882 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v88) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0020074fa0 con 0x7f00300aa220 2023-11-30T17:22:47.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.425+0000 7f0036add700 1 -- 172.21.15.49:0/255883882 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f001005f030 msgr2=0x7f00100614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:47.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.425+0000 7f0036add700 1 --2- 172.21.15.49:0/255883882 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f001005f030 0x7f00100614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f0028006d20 tx=0x7f0028008040).stop 2023-11-30T17:22:47.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.425+0000 7f0036add700 1 -- 172.21.15.49:0/255883882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00300aa220 msgr2=0x7f0030167930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:47.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.425+0000 7f0036add700 1 --2- 172.21.15.49:0/255883882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00300aa220 0x7f0030167930 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f002000c840 tx=0x7f0020001660).stop 2023-11-30T17:22:47.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.426+0000 7f0036add700 1 -- 172.21.15.49:0/255883882 shutdown_connections 2023-11-30T17:22:47.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.426+0000 7f0036add700 1 --2- 172.21.15.49:0/255883882 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0030154530 0x7f0030167e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:47.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.426+0000 7f0036add700 1 --2- 172.21.15.49:0/255883882 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00300a7ff0 0x7f0030147ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:47.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.426+0000 7f0036add700 1 --2- 172.21.15.49:0/255883882 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f001005f030 0x7f00100614f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:47.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.426+0000 7f0036add700 1 --2- 172.21.15.49:0/255883882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00300aa220 0x7f0030167930 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:47.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.426+0000 7f0036add700 1 -- 172.21.15.49:0/255883882 >> 172.21.15.49:0/255883882 conn(0x7f0030094930 msgr2=0x7f003015a100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:47.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.427+0000 7f0036add700 1 -- 172.21.15.49:0/255883882 shutdown_connections 2023-11-30T17:22:47.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.427+0000 7f0036add700 1 -- 172.21.15.49:0/255883882 wait complete. 2023-11-30T17:22:47.430 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2023-11-30T17:22:47.443 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-30T17:22:47.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.569+0000 7ff0ddd94700 1 Processor -- start 2023-11-30T17:22:47.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.569+0000 7ff0ddd94700 1 -- start start 2023-11-30T17:22:47.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.570+0000 7ff0ddd94700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff0d80bcd70 0x7ff0d814ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:47.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.570+0000 7ff0ddd94700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d80634e0 con 0x7ff0d814ea80 2023-11-30T17:22:47.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.570+0000 7ff0ddd94700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d80637c0 con 0x7ff0d8062770 2023-11-30T17:22:47.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.570+0000 7ff0ddd94700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d80632f0 con 0x7ff0d80bcd70 2023-11-30T17:22:47.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.570+0000 7ff0d77fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff0d814ea80 0x7ff0d80bc660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45454/0 (socket says 172.21.15.49:45454) 2023-11-30T17:22:47.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.570+0000 7ff0d77fe700 1 -- 172.21.15.49:0/1745459716 learned_addr learned my addr 172.21.15.49:0/1745459716 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:47.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.570+0000 7ff0d67fc700 1 -- 172.21.15.49:0/1745459716 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1973871279 0 0) 0x7ff0d80634e0 con 0x7ff0d814ea80 2023-11-30T17:22:47.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.571+0000 7ff0d6ffd700 1 --2- 172.21.15.49:0/1745459716 >> v2:172.21.15.115:3300/0 conn(0x7ff0d80bcd70 0x7ff0d814ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:47.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.571+0000 7ff0d67fc700 1 -- 172.21.15.49:0/1745459716 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0c00033f0 con 0x7ff0d814ea80 2023-11-30T17:22:47.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.571+0000 7ff0d67fc700 1 -- 172.21.15.49:0/1745459716 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2835366107 0 0) 0x7ff0c00033f0 con 0x7ff0d814ea80 2023-11-30T17:22:47.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.571+0000 7ff0d67fc700 1 -- 172.21.15.49:0/1745459716 >> v2:172.21.15.115:3300/0 conn(0x7ff0d80bcd70 msgr2=0x7ff0d814ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:47.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.571+0000 7ff0d67fc700 1 --2- 172.21.15.49:0/1745459716 >> v2:172.21.15.115:3300/0 conn(0x7ff0d80bcd70 0x7ff0d814ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:47.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.571+0000 7ff0d67fc700 1 -- 172.21.15.49:0/1745459716 >> v1:172.21.15.115:6789/0 conn(0x7ff0d8062770 legacy=0x7ff0d8062be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:47.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.571+0000 7ff0d67fc700 1 -- 172.21.15.49:0/1745459716 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d8063aa0 con 0x7ff0d814ea80 2023-11-30T17:22:47.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.571+0000 7ff0d67fc700 1 -- 172.21.15.49:0/1745459716 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7ff0c8001470 con 0x7ff0d814ea80 2023-11-30T17:22:47.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.571+0000 7ff0d67fc700 1 -- 172.21.15.49:0/1745459716 >> v1:172.21.15.49:6789/0 conn(0x7ff0d814ea80 legacy=0x7ff0d80bc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:47.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.571+0000 7ff0d67fc700 1 --2- 172.21.15.49:0/1745459716 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0c00038e0 0x7ff0c0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:47.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.571+0000 7ff0d67fc700 1 --2- 172.21.15.49:0/1745459716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0c0004690 0x7ff0c0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:47.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.571+0000 7ff0d67fc700 1 --2- 172.21.15.49:0/1745459716 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0c0005050 0x7ff0c000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:47.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.571+0000 7ff0d67fc700 1 -- 172.21.15.49:0/1745459716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c000bfb0 con 0x7ff0c0004690 2023-11-30T17:22:47.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.571+0000 7ff0d67fc700 1 -- 172.21.15.49:0/1745459716 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c000c120 con 0x7ff0c0005050 2023-11-30T17:22:47.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.571+0000 7ff0d67fc700 1 -- 172.21.15.49:0/1745459716 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c000c2e0 con 0x7ff0c00038e0 2023-11-30T17:22:47.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.571+0000 7ff0d6ffd700 1 --2- 172.21.15.49:0/1745459716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0c0004690 0x7ff0c0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:47.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.571+0000 7ff0d77fe700 1 --2- 172.21.15.49:0/1745459716 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0c00038e0 0x7ff0c0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:47.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.571+0000 7ff0d7fff700 1 --2- 172.21.15.49:0/1745459716 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0c0005050 0x7ff0c000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:47.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.571+0000 7ff0d6ffd700 1 -- 172.21.15.49:0/1745459716 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0c00038e0 msgr2=0x7ff0c0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:47.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.571+0000 7ff0d6ffd700 1 --2- 172.21.15.49:0/1745459716 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0c00038e0 0x7ff0c0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:47.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.571+0000 7ff0d6ffd700 1 -- 172.21.15.49:0/1745459716 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0c0005050 msgr2=0x7ff0c000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:47.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.571+0000 7ff0d6ffd700 1 --2- 172.21.15.49:0/1745459716 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0c0005050 0x7ff0c000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:47.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.571+0000 7ff0d7fff700 1 -- 172.21.15.49:0/1745459716 reap_dead start 2023-11-30T17:22:47.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.571+0000 7ff0d6ffd700 1 -- 172.21.15.49:0/1745459716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c00033f0 con 0x7ff0c0004690 2023-11-30T17:22:47.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.571+0000 7ff0d6ffd700 1 --2- 172.21.15.49:0/1745459716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0c0004690 0x7ff0c0004b10 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7ff0cc006d80 tx=0x7ff0cc009060).ready entity=mon.0 client_cookie=ba770217cc7baf65 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:47.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.572+0000 7ff0d67fc700 1 -- 172.21.15.49:0/1745459716 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc009e90 con 0x7ff0c0004690 2023-11-30T17:22:47.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.572+0000 7ff0d67fc700 1 -- 172.21.15.49:0/1745459716 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0cc00e610 con 0x7ff0c0004690 2023-11-30T17:22:47.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.572+0000 7ff0d67fc700 1 -- 172.21.15.49:0/1745459716 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc00e9d0 con 0x7ff0c0004690 2023-11-30T17:22:47.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.572+0000 7ff0ddd94700 1 -- 172.21.15.49:0/1745459716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0c0004690 msgr2=0x7ff0c0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:47.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.572+0000 7ff0ddd94700 1 --2- 172.21.15.49:0/1745459716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0c0004690 0x7ff0c0004b10 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7ff0cc006d80 tx=0x7ff0cc009060).stop 2023-11-30T17:22:47.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.572+0000 7ff0ddd94700 1 -- 172.21.15.49:0/1745459716 shutdown_connections 2023-11-30T17:22:47.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.572+0000 7ff0ddd94700 1 --2- 172.21.15.49:0/1745459716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0c0004690 0x7ff0c0004b10 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:47.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.572+0000 7ff0ddd94700 1 -- 172.21.15.49:0/1745459716 >> 172.21.15.49:0/1745459716 conn(0x7ff0d80c8170 msgr2=0x7ff0d80c41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:47.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.572+0000 7ff0ddd94700 1 -- 172.21.15.49:0/1745459716 shutdown_connections 2023-11-30T17:22:47.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.572+0000 7ff0ddd94700 1 -- 172.21.15.49:0/1745459716 wait complete. 2023-11-30T17:22:47.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.573+0000 7ff0ddd94700 1 Processor -- start 2023-11-30T17:22:47.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.573+0000 7ff0ddd94700 1 -- start start 2023-11-30T17:22:47.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.574+0000 7ff0ddd94700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0c0004690 0x7ff0d8139ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:47.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.574+0000 7ff0ddd94700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0d813a3d0 0x7ff0d8164ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:47.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.574+0000 7ff0ddd94700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0d8165190 0x7ff0d81576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:47.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.574+0000 7ff0ddd94700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d8139a50 con 0x7ff0c0004690 2023-11-30T17:22:47.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.574+0000 7ff0ddd94700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d81655f0 con 0x7ff0d813a3d0 2023-11-30T17:22:47.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.574+0000 7ff0ddd94700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d8138e40 con 0x7ff0d8165190 2023-11-30T17:22:47.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.574+0000 7ff0d77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0c0004690 0x7ff0d8139ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:47.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.574+0000 7ff0d77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0c0004690 0x7ff0d8139ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46126/0 (socket says 172.21.15.49:46126) 2023-11-30T17:22:47.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.574+0000 7ff0d77fe700 1 -- 172.21.15.49:0/3392760223 learned_addr learned my addr 172.21.15.49:0/3392760223 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:47.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.575+0000 7ff0d7fff700 1 --2- 172.21.15.49:0/3392760223 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0d8165190 0x7ff0d81576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:47.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.575+0000 7ff0d6ffd700 1 --2- 172.21.15.49:0/3392760223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0d813a3d0 0x7ff0d8164ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:47.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.575+0000 7ff0d77fe700 1 -- 172.21.15.49:0/3392760223 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0d8165190 msgr2=0x7ff0d81576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:47.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.575+0000 7ff0d77fe700 1 --2- 172.21.15.49:0/3392760223 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0d8165190 0x7ff0d81576a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:47.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.575+0000 7ff0d77fe700 1 -- 172.21.15.49:0/3392760223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0d813a3d0 msgr2=0x7ff0d8164ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:47.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.575+0000 7ff0d77fe700 1 --2- 172.21.15.49:0/3392760223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0d813a3d0 0x7ff0d8164ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:47.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.575+0000 7ff0d77fe700 1 -- 172.21.15.49:0/3392760223 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d8139120 con 0x7ff0c0004690 2023-11-30T17:22:47.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.575+0000 7ff0d77fe700 1 --2- 172.21.15.49:0/3392760223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0c0004690 0x7ff0d8139ee0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7ff0c8001c00 tx=0x7ff0d8064060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:47.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.575+0000 7ff0bf7fe700 1 -- 172.21.15.49:0/3392760223 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c8004e20 con 0x7ff0c0004690 2023-11-30T17:22:47.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.575+0000 7ff0bf7fe700 1 -- 172.21.15.49:0/3392760223 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c800f870 con 0x7ff0c0004690 2023-11-30T17:22:47.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.575+0000 7ff0ddd94700 1 -- 172.21.15.49:0/3392760223 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d8139400 con 0x7ff0c0004690 2023-11-30T17:22:47.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.575+0000 7ff0bf7fe700 1 -- 172.21.15.49:0/3392760223 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c800fc10 con 0x7ff0c0004690 2023-11-30T17:22:47.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.575+0000 7ff0ddd94700 1 -- 172.21.15.49:0/3392760223 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d8157b90 con 0x7ff0c0004690 2023-11-30T17:22:47.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.576+0000 7ff0ddd94700 1 -- 172.21.15.49:0/3392760223 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d8139d30 con 0x7ff0c0004690 2023-11-30T17:22:47.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.577+0000 7ff0bf7fe700 1 -- 172.21.15.49:0/3392760223 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff0c801d3b0 con 0x7ff0c0004690 2023-11-30T17:22:47.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.577+0000 7ff0bf7fe700 1 --2- 172.21.15.49:0/3392760223 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff0c405f270 0x7ff0c4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:47.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.577+0000 7ff0bf7fe700 1 -- 172.21.15.49:0/3392760223 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6270+0+0 (secure 0 0 0) 0x7ff0c8079ea0 con 0x7ff0c0004690 2023-11-30T17:22:47.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.577+0000 7ff0d6ffd700 1 --2- 172.21.15.49:0/3392760223 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff0c405f270 0x7ff0c4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:47.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.578+0000 7ff0d6ffd700 1 --2- 172.21.15.49:0/3392760223 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff0c405f270 0x7ff0c4061730 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ff0d80aa450 tx=0x7ff0cc01a000).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:47.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.581+0000 7ff0bf7fe700 1 -- 172.21.15.49:0/3392760223 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff0c804af00 con 0x7ff0c0004690 2023-11-30T17:22:47.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:47.752+0000 7ff0ddd94700 1 -- 172.21.15.49:0/3392760223 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff0d806c860 con 0x7ff0c0004690 2023-11-30T17:22:48.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.419+0000 7ff0bf7fe700 1 -- 172.21.15.49:0/3392760223 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v89) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff0c8019020 con 0x7ff0c0004690 2023-11-30T17:22:48.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.424+0000 7ff0ddd94700 1 -- 172.21.15.49:0/3392760223 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff0c405f270 msgr2=0x7ff0c4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:48.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.424+0000 7ff0ddd94700 1 --2- 172.21.15.49:0/3392760223 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff0c405f270 0x7ff0c4061730 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ff0d80aa450 tx=0x7ff0cc01a000).stop 2023-11-30T17:22:48.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.424+0000 7ff0ddd94700 1 -- 172.21.15.49:0/3392760223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0c0004690 msgr2=0x7ff0d8139ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:48.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.424+0000 7ff0ddd94700 1 --2- 172.21.15.49:0/3392760223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0c0004690 0x7ff0d8139ee0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7ff0c8001c00 tx=0x7ff0d8064060).stop 2023-11-30T17:22:48.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.424+0000 7ff0ddd94700 1 -- 172.21.15.49:0/3392760223 shutdown_connections 2023-11-30T17:22:48.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.424+0000 7ff0ddd94700 1 --2- 172.21.15.49:0/3392760223 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0d8165190 0x7ff0d81576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:48.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.424+0000 7ff0ddd94700 1 --2- 172.21.15.49:0/3392760223 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff0c405f270 0x7ff0c4061730 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:48.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.424+0000 7ff0ddd94700 1 --2- 172.21.15.49:0/3392760223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0c0004690 0x7ff0d8139ee0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:48.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.424+0000 7ff0ddd94700 1 --2- 172.21.15.49:0/3392760223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0d813a3d0 0x7ff0d8164ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:48.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.424+0000 7ff0ddd94700 1 -- 172.21.15.49:0/3392760223 >> 172.21.15.49:0/3392760223 conn(0x7ff0d80c8170 msgr2=0x7ff0d8066620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:48.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.424+0000 7ff0ddd94700 1 -- 172.21.15.49:0/3392760223 shutdown_connections 2023-11-30T17:22:48.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.424+0000 7ff0ddd94700 1 -- 172.21.15.49:0/3392760223 wait complete. 2023-11-30T17:22:48.428 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2023-11-30T17:22:48.443 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-30T17:22:48.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.569+0000 7f98213df700 1 Processor -- start 2023-11-30T17:22:48.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.569+0000 7f98213df700 1 -- start start 2023-11-30T17:22:48.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.570+0000 7f98213df700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f981c098d10 0x7f981c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:48.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.570+0000 7f98213df700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f981c0c6190 0x7f981c063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:48.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.570+0000 7f98213df700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f981c0c72d0 con 0x7f981c064350 2023-11-30T17:22:48.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.570+0000 7f98213df700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f981c154bc0 con 0x7f981c098d10 2023-11-30T17:22:48.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.570+0000 7f98213df700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f981c0c66c0 con 0x7f981c0c6190 2023-11-30T17:22:48.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.570+0000 7f981affd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f981c098d10 0x7f981c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:48.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.570+0000 7f981a7fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f981c0c6190 0x7f981c063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:48.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.570+0000 7f981a7fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f981c0c6190 0x7f981c063e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:33622/0 (socket says 172.21.15.49:33622) 2023-11-30T17:22:48.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.570+0000 7f981affd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f981c098d10 0x7f981c0c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:38924/0 (socket says 172.21.15.49:38924) 2023-11-30T17:22:48.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.570+0000 7f981a7fc700 1 -- 172.21.15.49:0/3355681858 learned_addr learned my addr 172.21.15.49:0/3355681858 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:48.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.570+0000 7f981b7fe700 1 --1- 172.21.15.49:0/3355681858 >> v1:172.21.15.115:6789/0 conn(0x7f981c064350 0x7f981c158320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:59572/0 (socket says 172.21.15.49:59572) 2023-11-30T17:22:48.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.570+0000 7f9819ffb700 1 -- 172.21.15.49:0/3355681858 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2157350338 0 0) 0x7f981c0c72d0 con 0x7f981c064350 2023-11-30T17:22:48.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.571+0000 7f981a7fc700 1 -- 172.21.15.49:0/3355681858 >> v2:172.21.15.115:3300/0 conn(0x7f981c098d10 msgr2=0x7f981c0c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:48.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.571+0000 7f981a7fc700 1 --2- 172.21.15.49:0/3355681858 >> v2:172.21.15.115:3300/0 conn(0x7f981c098d10 0x7f981c0c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:48.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.571+0000 7f981a7fc700 1 -- 172.21.15.49:0/3355681858 >> v1:172.21.15.115:6789/0 conn(0x7f981c064350 legacy=0x7f981c158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:48.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.571+0000 7f981a7fc700 1 -- 172.21.15.49:0/3355681858 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981c0c69a0 con 0x7f981c0c6190 2023-11-30T17:22:48.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.571+0000 7f981affd700 1 --2- 172.21.15.49:0/3355681858 >> v2:172.21.15.115:3300/0 conn(0x7f981c098d10 0x7f981c0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:22:48.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.571+0000 7f981a7fc700 1 --2- 172.21.15.49:0/3355681858 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f981c0c6190 0x7f981c063e60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f9804006fd0 tx=0x7f98040090f0).ready entity=mon.2 client_cookie=1719c087daf798a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:48.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.571+0000 7f9819ffb700 1 -- 172.21.15.49:0/3355681858 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980400b580 con 0x7f981c0c6190 2023-11-30T17:22:48.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.571+0000 7f9819ffb700 1 -- 172.21.15.49:0/3355681858 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980400b6e0 con 0x7f981c0c6190 2023-11-30T17:22:48.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.571+0000 7f9819ffb700 1 -- 172.21.15.49:0/3355681858 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980400ba60 con 0x7f981c0c6190 2023-11-30T17:22:48.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.571+0000 7f98213df700 1 -- 172.21.15.49:0/3355681858 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f981c0c6190 msgr2=0x7f981c063e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:48.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.571+0000 7f98213df700 1 --2- 172.21.15.49:0/3355681858 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f981c0c6190 0x7f981c063e60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f9804006fd0 tx=0x7f98040090f0).stop 2023-11-30T17:22:48.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.571+0000 7f98213df700 1 -- 172.21.15.49:0/3355681858 shutdown_connections 2023-11-30T17:22:48.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.571+0000 7f98213df700 1 --2- 172.21.15.49:0/3355681858 >> v2:172.21.15.115:3300/0 conn(0x7f981c098d10 0x7f981c0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:48.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.571+0000 7f98213df700 1 --2- 172.21.15.49:0/3355681858 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f981c0c6190 0x7f981c063e60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:48.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.571+0000 7f98213df700 1 -- 172.21.15.49:0/3355681858 >> 172.21.15.49:0/3355681858 conn(0x7f981c0cb310 msgr2=0x7f981c0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:48.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.572+0000 7f98213df700 1 -- 172.21.15.49:0/3355681858 shutdown_connections 2023-11-30T17:22:48.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.572+0000 7f98213df700 1 -- 172.21.15.49:0/3355681858 wait complete. 2023-11-30T17:22:48.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.573+0000 7f98213df700 1 Processor -- start 2023-11-30T17:22:48.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.573+0000 7f98213df700 1 -- start start 2023-11-30T17:22:48.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.573+0000 7f98213df700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f981c064350 0x7f981c156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:48.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.573+0000 7f98213df700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f981c098d10 0x7f981c14af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:48.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.573+0000 7f98213df700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f981c0c6190 0x7f981c0b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:48.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.573+0000 7f98213df700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981c157550 con 0x7f981c098d10 2023-11-30T17:22:48.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.574+0000 7f98213df700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981c156940 con 0x7f981c064350 2023-11-30T17:22:48.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.574+0000 7f98213df700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f981c156c20 con 0x7f981c0c6190 2023-11-30T17:22:48.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.574+0000 7f981a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f981c098d10 0x7f981c14af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:48.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.574+0000 7f981a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f981c098d10 0x7f981c14af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46142/0 (socket says 172.21.15.49:46142) 2023-11-30T17:22:48.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.574+0000 7f981a7fc700 1 -- 172.21.15.49:0/2547901728 learned_addr learned my addr 172.21.15.49:0/2547901728 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:48.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.574+0000 7f981affd700 1 --2- 172.21.15.49:0/2547901728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f981c064350 0x7f981c156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:48.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.574+0000 7f981b7fe700 1 --2- 172.21.15.49:0/2547901728 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f981c0c6190 0x7f981c0b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:48.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.574+0000 7f981a7fc700 1 -- 172.21.15.49:0/2547901728 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f981c0c6190 msgr2=0x7f981c0b07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:48.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.574+0000 7f981a7fc700 1 --2- 172.21.15.49:0/2547901728 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f981c0c6190 0x7f981c0b07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:48.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.574+0000 7f981a7fc700 1 -- 172.21.15.49:0/2547901728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f981c064350 msgr2=0x7f981c156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:48.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.574+0000 7f981a7fc700 1 --2- 172.21.15.49:0/2547901728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f981c064350 0x7f981c156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:48.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.574+0000 7f981a7fc700 1 -- 172.21.15.49:0/2547901728 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980c009a20 con 0x7f981c098d10 2023-11-30T17:22:48.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.574+0000 7f981a7fc700 1 --2- 172.21.15.49:0/2547901728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f981c098d10 0x7f981c14af10 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f9804011000 tx=0x7f9804017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:48.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.574+0000 7f9812ffd700 1 -- 172.21.15.49:0/2547901728 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980400b850 con 0x7f981c098d10 2023-11-30T17:22:48.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.574+0000 7f9812ffd700 1 -- 172.21.15.49:0/2547901728 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980400b9b0 con 0x7f981c098d10 2023-11-30T17:22:48.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.574+0000 7f98213df700 1 -- 172.21.15.49:0/2547901728 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9804009370 con 0x7f981c098d10 2023-11-30T17:22:48.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.574+0000 7f9812ffd700 1 -- 172.21.15.49:0/2547901728 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980401c670 con 0x7f981c098d10 2023-11-30T17:22:48.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.574+0000 7f98213df700 1 -- 172.21.15.49:0/2547901728 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981c1571e0 con 0x7f981c098d10 2023-11-30T17:22:48.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.576+0000 7f98213df700 1 -- 172.21.15.49:0/2547901728 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f981c06c860 con 0x7f981c098d10 2023-11-30T17:22:48.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.576+0000 7f9812ffd700 1 -- 172.21.15.49:0/2547901728 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f980401ca20 con 0x7f981c098d10 2023-11-30T17:22:48.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.576+0000 7f9812ffd700 1 --2- 172.21.15.49:0/2547901728 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f97fc05f270 0x7f97fc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:48.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.576+0000 7f9812ffd700 1 -- 172.21.15.49:0/2547901728 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5856+0+0 (secure 0 0 0) 0x7f980407ba30 con 0x7f981c098d10 2023-11-30T17:22:48.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.576+0000 7f981affd700 1 --2- 172.21.15.49:0/2547901728 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f97fc05f270 0x7f97fc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:48.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.577+0000 7f981affd700 1 --2- 172.21.15.49:0/2547901728 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f97fc05f270 0x7f97fc061730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f980c009fd0 tx=0x7f980c00b040).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:48.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.581+0000 7f9812ffd700 1 -- 172.21.15.49:0/2547901728 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f980404cc90 con 0x7f981c098d10 2023-11-30T17:22:48.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.753+0000 7f98213df700 1 -- 172.21.15.49:0/2547901728 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f981c0c6c80 con 0x7f981c098d10 2023-11-30T17:22:48.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.756+0000 7f9812ffd700 1 -- 172.21.15.49:0/2547901728 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v12) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9804020020 con 0x7f981c098d10 2023-11-30T17:22:48.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.758+0000 7f98213df700 1 -- 172.21.15.49:0/2547901728 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f97fc05f270 msgr2=0x7f97fc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:48.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.758+0000 7f98213df700 1 --2- 172.21.15.49:0/2547901728 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f97fc05f270 0x7f97fc061730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f980c009fd0 tx=0x7f980c00b040).stop 2023-11-30T17:22:48.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.758+0000 7f98213df700 1 -- 172.21.15.49:0/2547901728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f981c098d10 msgr2=0x7f981c14af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:48.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.758+0000 7f98213df700 1 --2- 172.21.15.49:0/2547901728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f981c098d10 0x7f981c14af10 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f9804011000 tx=0x7f9804017000).stop 2023-11-30T17:22:48.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.758+0000 7f98213df700 1 -- 172.21.15.49:0/2547901728 shutdown_connections 2023-11-30T17:22:48.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.758+0000 7f98213df700 1 --2- 172.21.15.49:0/2547901728 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f981c0c6190 0x7f981c0b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:48.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.758+0000 7f98213df700 1 --2- 172.21.15.49:0/2547901728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f981c064350 0x7f981c156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:48.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.758+0000 7f98213df700 1 --2- 172.21.15.49:0/2547901728 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f97fc05f270 0x7f97fc061730 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:48.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.758+0000 7f98213df700 1 --2- 172.21.15.49:0/2547901728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f981c098d10 0x7f981c14af10 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:48.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.758+0000 7f98213df700 1 -- 172.21.15.49:0/2547901728 >> 172.21.15.49:0/2547901728 conn(0x7f981c0cb310 msgr2=0x7f981c158000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:48.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.758+0000 7f98213df700 1 -- 172.21.15.49:0/2547901728 shutdown_connections 2023-11-30T17:22:48.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.758+0000 7f98213df700 1 -- 172.21.15.49:0/2547901728 wait complete. 2023-11-30T17:22:48.773 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-11-30T17:22:48.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.890+0000 7f4d59aea700 1 Processor -- start 2023-11-30T17:22:48.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.890+0000 7f4d59aea700 1 -- start start 2023-11-30T17:22:48.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.890+0000 7f4d59aea700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4d54158a30 0x7f4d540c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:48.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.890+0000 7f4d59aea700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d540c72d0 con 0x7f4d54098d10 2023-11-30T17:22:48.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.890+0000 7f4d59aea700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d54064570 con 0x7f4d540c6190 2023-11-30T17:22:48.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.890+0000 7f4d59aea700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d54154bc0 con 0x7f4d54158a30 2023-11-30T17:22:48.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.891+0000 7f4d537fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4d54098d10 0x7f4d54063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45464/0 (socket says 172.21.15.49:45464) 2023-11-30T17:22:48.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.891+0000 7f4d537fe700 1 -- 172.21.15.49:0/3110646675 learned_addr learned my addr 172.21.15.49:0/3110646675 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:48.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.891+0000 7f4d527fc700 1 -- 172.21.15.49:0/3110646675 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2765651114 0 0) 0x7f4d540c72d0 con 0x7f4d54098d10 2023-11-30T17:22:48.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.891+0000 7f4d527fc700 1 -- 172.21.15.49:0/3110646675 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d400033f0 con 0x7f4d54098d10 2023-11-30T17:22:48.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.891+0000 7f4d53fff700 1 --2- 172.21.15.49:0/3110646675 >> v2:172.21.15.115:3300/0 conn(0x7f4d54158a30 0x7f4d540c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:48.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.891+0000 7f4d527fc700 1 -- 172.21.15.49:0/3110646675 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 790246909 0 0) 0x7f4d400033f0 con 0x7f4d54098d10 2023-11-30T17:22:48.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.891+0000 7f4d527fc700 1 -- 172.21.15.49:0/3110646675 >> v2:172.21.15.115:3300/0 conn(0x7f4d54158a30 msgr2=0x7f4d540c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:48.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.891+0000 7f4d527fc700 1 --2- 172.21.15.49:0/3110646675 >> v2:172.21.15.115:3300/0 conn(0x7f4d54158a30 0x7f4d540c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:48.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.891+0000 7f4d527fc700 1 -- 172.21.15.49:0/3110646675 >> v1:172.21.15.115:6789/0 conn(0x7f4d540c6190 legacy=0x7f4d54158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:48.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.891+0000 7f4d527fc700 1 -- 172.21.15.49:0/3110646675 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d540c66c0 con 0x7f4d54098d10 2023-11-30T17:22:48.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.891+0000 7f4d527fc700 1 -- 172.21.15.49:0/3110646675 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f4d4c001470 con 0x7f4d54098d10 2023-11-30T17:22:48.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.891+0000 7f4d527fc700 1 -- 172.21.15.49:0/3110646675 >> v1:172.21.15.49:6789/0 conn(0x7f4d54098d10 legacy=0x7f4d54063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:48.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.891+0000 7f4d527fc700 1 --2- 172.21.15.49:0/3110646675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d400038e0 0x7f4d40003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:48.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.891+0000 7f4d527fc700 1 --2- 172.21.15.49:0/3110646675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d40004690 0x7f4d40004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:48.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.891+0000 7f4d527fc700 1 --2- 172.21.15.49:0/3110646675 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d40005000 0x7f4d4000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:48.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.891+0000 7f4d527fc700 1 -- 172.21.15.49:0/3110646675 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d54154bc0 con 0x7f4d40004690 2023-11-30T17:22:48.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.891+0000 7f4d527fc700 1 -- 172.21.15.49:0/3110646675 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4000beb0 con 0x7f4d400038e0 2023-11-30T17:22:48.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.891+0000 7f4d527fc700 1 -- 172.21.15.49:0/3110646675 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4000c070 con 0x7f4d40005000 2023-11-30T17:22:48.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.891+0000 7f4d52ffd700 1 --2- 172.21.15.49:0/3110646675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d40004690 0x7f4d40004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:48.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.891+0000 7f4d537fe700 1 --2- 172.21.15.49:0/3110646675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d400038e0 0x7f4d40003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:48.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.892+0000 7f4d53fff700 1 --2- 172.21.15.49:0/3110646675 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d40005000 0x7f4d4000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:48.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.892+0000 7f4d52ffd700 1 -- 172.21.15.49:0/3110646675 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d40005000 msgr2=0x7f4d4000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:48.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.892+0000 7f4d52ffd700 1 --2- 172.21.15.49:0/3110646675 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d40005000 0x7f4d4000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:48.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.892+0000 7f4d52ffd700 1 -- 172.21.15.49:0/3110646675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d400038e0 msgr2=0x7f4d40003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:48.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.892+0000 7f4d52ffd700 1 --2- 172.21.15.49:0/3110646675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d400038e0 0x7f4d40003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:48.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.892+0000 7f4d53fff700 1 -- 172.21.15.49:0/3110646675 reap_dead start 2023-11-30T17:22:48.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.892+0000 7f4d52ffd700 1 -- 172.21.15.49:0/3110646675 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d400033f0 con 0x7f4d40004690 2023-11-30T17:22:48.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.892+0000 7f4d52ffd700 1 --2- 172.21.15.49:0/3110646675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d40004690 0x7f4d40004b10 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f4d3c001700 tx=0x7f4d3c007bb0).ready entity=mon.0 client_cookie=1f385dab5e3a37c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:48.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.892+0000 7f4d527fc700 1 -- 172.21.15.49:0/3110646675 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c007020 con 0x7f4d40004690 2023-11-30T17:22:48.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.892+0000 7f4d527fc700 1 -- 172.21.15.49:0/3110646675 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3c007180 con 0x7f4d40004690 2023-11-30T17:22:48.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.892+0000 7f4d527fc700 1 -- 172.21.15.49:0/3110646675 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c007520 con 0x7f4d40004690 2023-11-30T17:22:48.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.892+0000 7f4d59aea700 1 -- 172.21.15.49:0/3110646675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d40004690 msgr2=0x7f4d40004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:48.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.892+0000 7f4d59aea700 1 --2- 172.21.15.49:0/3110646675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d40004690 0x7f4d40004b10 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f4d3c001700 tx=0x7f4d3c007bb0).stop 2023-11-30T17:22:48.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.893+0000 7f4d59aea700 1 -- 172.21.15.49:0/3110646675 shutdown_connections 2023-11-30T17:22:48.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.893+0000 7f4d59aea700 1 --2- 172.21.15.49:0/3110646675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d40004690 0x7f4d40004b10 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:48.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.893+0000 7f4d59aea700 1 -- 172.21.15.49:0/3110646675 >> 172.21.15.49:0/3110646675 conn(0x7f4d540cb310 msgr2=0x7f4d540cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:48.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.893+0000 7f4d59aea700 1 -- 172.21.15.49:0/3110646675 shutdown_connections 2023-11-30T17:22:48.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.893+0000 7f4d59aea700 1 -- 172.21.15.49:0/3110646675 wait complete. 2023-11-30T17:22:48.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.894+0000 7f4d59aea700 1 Processor -- start 2023-11-30T17:22:48.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.894+0000 7f4d59aea700 1 -- start start 2023-11-30T17:22:48.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.895+0000 7f4d59aea700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d40004690 0x7f4d54150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:48.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.895+0000 7f4d59aea700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d540ad3d0 0x7f4d540ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:48.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.895+0000 7f4d59aea700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d540af9a0 0x7f4d540afe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:48.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.895+0000 7f4d59aea700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d54156bb0 con 0x7f4d540af9a0 2023-11-30T17:22:48.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.895+0000 7f4d59aea700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d540b13a0 con 0x7f4d540ad3d0 2023-11-30T17:22:48.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.895+0000 7f4d59aea700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d540add40 con 0x7f4d40004690 2023-11-30T17:22:48.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.895+0000 7f4d53fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d540af9a0 0x7f4d540afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:48.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.895+0000 7f4d53fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d540af9a0 0x7f4d540afe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46170/0 (socket says 172.21.15.49:46170) 2023-11-30T17:22:48.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.895+0000 7f4d53fff700 1 -- 172.21.15.49:0/2602520289 learned_addr learned my addr 172.21.15.49:0/2602520289 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:48.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.895+0000 7f4d537fe700 1 --2- 172.21.15.49:0/2602520289 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d40004690 0x7f4d54150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:48.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.895+0000 7f4d52ffd700 1 --2- 172.21.15.49:0/2602520289 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d540ad3d0 0x7f4d540ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:48.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.895+0000 7f4d53fff700 1 -- 172.21.15.49:0/2602520289 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d40004690 msgr2=0x7f4d54150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:48.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.895+0000 7f4d53fff700 1 --2- 172.21.15.49:0/2602520289 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d40004690 0x7f4d54150ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:48.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.895+0000 7f4d53fff700 1 -- 172.21.15.49:0/2602520289 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d540ad3d0 msgr2=0x7f4d540ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:48.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.895+0000 7f4d53fff700 1 --2- 172.21.15.49:0/2602520289 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d540ad3d0 0x7f4d540ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:48.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.895+0000 7f4d53fff700 1 -- 172.21.15.49:0/2602520289 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d540b0790 con 0x7f4d540af9a0 2023-11-30T17:22:48.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.895+0000 7f4d52ffd700 1 --2- 172.21.15.49:0/2602520289 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d540ad3d0 0x7f4d540ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:22:48.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.895+0000 7f4d53fff700 1 --2- 172.21.15.49:0/2602520289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d540af9a0 0x7f4d540afe00 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f4d54062cb0 tx=0x7f4d4400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:48.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.895+0000 7f4d4b7fe700 1 -- 172.21.15.49:0/2602520289 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4400e040 con 0x7f4d540af9a0 2023-11-30T17:22:48.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.895+0000 7f4d4b7fe700 1 -- 172.21.15.49:0/2602520289 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4400f040 con 0x7f4d540af9a0 2023-11-30T17:22:48.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.895+0000 7f4d59aea700 1 -- 172.21.15.49:0/2602520289 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d540b0a70 con 0x7f4d540af9a0 2023-11-30T17:22:48.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.895+0000 7f4d4b7fe700 1 -- 172.21.15.49:0/2602520289 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4400fe50 con 0x7f4d540af9a0 2023-11-30T17:22:48.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.895+0000 7f4d59aea700 1 -- 172.21.15.49:0/2602520289 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d540b1030 con 0x7f4d540af9a0 2023-11-30T17:22:48.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.896+0000 7f4d59aea700 1 -- 172.21.15.49:0/2602520289 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d540aad70 con 0x7f4d540af9a0 2023-11-30T17:22:48.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.897+0000 7f4d4b7fe700 1 -- 172.21.15.49:0/2602520289 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4d44015660 con 0x7f4d540af9a0 2023-11-30T17:22:48.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.897+0000 7f4d4b7fe700 1 --2- 172.21.15.49:0/2602520289 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4d3405f240 0x7f4d34061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:48.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.897+0000 7f4d4b7fe700 1 -- 172.21.15.49:0/2602520289 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5856+0+0 (secure 0 0 0) 0x7f4d4407aee0 con 0x7f4d540af9a0 2023-11-30T17:22:48.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.897+0000 7f4d537fe700 1 --2- 172.21.15.49:0/2602520289 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4d3405f240 0x7f4d34061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:48.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.898+0000 7f4d537fe700 1 --2- 172.21.15.49:0/2602520289 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4d3405f240 0x7f4d34061700 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f4d5406cb40 tx=0x7f4d4c009040).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:48.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:48.901+0000 7f4d4b7fe700 1 -- 172.21.15.49:0/2602520289 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4d540aad70 con 0x7f4d540af9a0 2023-11-30T17:22:49.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.073+0000 7f4d59aea700 1 -- 172.21.15.49:0/2602520289 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f4d540aad70 con 0x7f4d540af9a0 2023-11-30T17:22:49.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.077+0000 7f4d4b7fe700 1 -- 172.21.15.49:0/2602520289 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v13) v1 ==== 120+0+0 (secure 0 0 0) 0x7f4d540aad70 con 0x7f4d540af9a0 2023-11-30T17:22:49.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.079+0000 7f4d59aea700 1 -- 172.21.15.49:0/2602520289 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4d3405f240 msgr2=0x7f4d34061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:49.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.079+0000 7f4d59aea700 1 --2- 172.21.15.49:0/2602520289 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4d3405f240 0x7f4d34061700 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f4d5406cb40 tx=0x7f4d4c009040).stop 2023-11-30T17:22:49.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.079+0000 7f4d59aea700 1 -- 172.21.15.49:0/2602520289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d540af9a0 msgr2=0x7f4d540afe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:49.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.079+0000 7f4d59aea700 1 --2- 172.21.15.49:0/2602520289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d540af9a0 0x7f4d540afe00 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f4d54062cb0 tx=0x7f4d4400b040).stop 2023-11-30T17:22:49.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.079+0000 7f4d59aea700 1 -- 172.21.15.49:0/2602520289 shutdown_connections 2023-11-30T17:22:49.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.079+0000 7f4d59aea700 1 --2- 172.21.15.49:0/2602520289 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4d3405f240 0x7f4d34061700 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:49.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.079+0000 7f4d59aea700 1 --2- 172.21.15.49:0/2602520289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d540af9a0 0x7f4d540afe00 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:49.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.079+0000 7f4d59aea700 1 --2- 172.21.15.49:0/2602520289 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d40004690 0x7f4d54150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:49.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.079+0000 7f4d59aea700 1 --2- 172.21.15.49:0/2602520289 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d540ad3d0 0x7f4d540ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:49.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.079+0000 7f4d59aea700 1 -- 172.21.15.49:0/2602520289 >> 172.21.15.49:0/2602520289 conn(0x7f4d540cb310 msgr2=0x7f4d541519d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:49.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.079+0000 7f4d59aea700 1 -- 172.21.15.49:0/2602520289 shutdown_connections 2023-11-30T17:22:49.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.079+0000 7f4d59aea700 1 -- 172.21.15.49:0/2602520289 wait complete. 2023-11-30T17:22:49.094 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-11-30T17:22:49.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.210+0000 7f942a014700 1 Processor -- start 2023-11-30T17:22:49.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.210+0000 7f942a014700 1 -- start start 2023-11-30T17:22:49.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.211+0000 7f942a014700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9424064e20 0x7f9424155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:49.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.211+0000 7f942a014700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9424095e80 0x7f9424096310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:49.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.211+0000 7f942a014700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9424096800 con 0x7f94241544d0 2023-11-30T17:22:49.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.211+0000 7f942a014700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9424067650 con 0x7f9424064e20 2023-11-30T17:22:49.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.211+0000 7f942a014700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94240683d0 con 0x7f9424095e80 2023-11-30T17:22:49.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.212+0000 7f9423fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9424095e80 0x7f9424096310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:49.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.212+0000 7f9422ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9424064e20 0x7f9424155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:49.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.212+0000 7f9423fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9424095e80 0x7f9424096310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:33662/0 (socket says 172.21.15.49:33662) 2023-11-30T17:22:49.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.212+0000 7f9423fff700 1 -- 172.21.15.49:0/3444848107 learned_addr learned my addr 172.21.15.49:0/3444848107 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:49.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.212+0000 7f9422ffd700 1 -- 172.21.15.49:0/3444848107 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9424095e80 msgr2=0x7f9424096310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:49.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.212+0000 7f9422ffd700 1 --2- 172.21.15.49:0/3444848107 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9424095e80 0x7f9424096310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:49.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.212+0000 7f9422ffd700 1 -- 172.21.15.49:0/3444848107 >> v1:172.21.15.115:6789/0 conn(0x7f94241544d0 legacy=0x7f9424066f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:49.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.212+0000 7f9422ffd700 1 -- 172.21.15.49:0/3444848107 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9424067850 con 0x7f9424064e20 2023-11-30T17:22:49.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.212+0000 7f9423fff700 1 --2- 172.21.15.49:0/3444848107 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9424095e80 0x7f9424096310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:22:49.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.212+0000 7f9422ffd700 1 --2- 172.21.15.49:0/3444848107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9424064e20 0x7f9424155750 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f9418009760 tx=0x7f9418009060).ready entity=mon.1 client_cookie=69748d81a01be059 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:49.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.212+0000 7f94227fc700 1 -- 172.21.15.49:0/3444848107 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941800f510 con 0x7f9424064e20 2023-11-30T17:22:49.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.212+0000 7f94227fc700 1 -- 172.21.15.49:0/3444848107 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941800f670 con 0x7f9424064e20 2023-11-30T17:22:49.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.212+0000 7f94227fc700 1 -- 172.21.15.49:0/3444848107 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941800f9f0 con 0x7f9424064e20 2023-11-30T17:22:49.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.213+0000 7f942a014700 1 -- 172.21.15.49:0/3444848107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9424064e20 msgr2=0x7f9424155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:49.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.213+0000 7f942a014700 1 --2- 172.21.15.49:0/3444848107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9424064e20 0x7f9424155750 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f9418009760 tx=0x7f9418009060).stop 2023-11-30T17:22:49.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.213+0000 7f942a014700 1 -- 172.21.15.49:0/3444848107 shutdown_connections 2023-11-30T17:22:49.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.213+0000 7f942a014700 1 --2- 172.21.15.49:0/3444848107 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9424095e80 0x7f9424096310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:49.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.213+0000 7f942a014700 1 --2- 172.21.15.49:0/3444848107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9424064e20 0x7f9424155750 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:49.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.213+0000 7f942a014700 1 -- 172.21.15.49:0/3444848107 >> 172.21.15.49:0/3444848107 conn(0x7f94240631d0 msgr2=0x7f94240c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:49.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.213+0000 7f942a014700 1 -- 172.21.15.49:0/3444848107 shutdown_connections 2023-11-30T17:22:49.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.213+0000 7f942a014700 1 -- 172.21.15.49:0/3444848107 wait complete. 2023-11-30T17:22:49.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.214+0000 7f942a014700 1 Processor -- start 2023-11-30T17:22:49.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.214+0000 7f942a014700 1 -- start start 2023-11-30T17:22:49.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.215+0000 7f942a014700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9424064e20 0x7f9424144e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:49.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.215+0000 7f942a014700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9424095e80 0x7f9424164690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:49.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.215+0000 7f942a014700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94241544d0 0x7f94240bf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:49.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.215+0000 7f942a014700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9424145340 con 0x7f9424095e80 2023-11-30T17:22:49.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.215+0000 7f942a014700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94240af1b0 con 0x7f9424064e20 2023-11-30T17:22:49.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.215+0000 7f942a014700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94241656a0 con 0x7f94241544d0 2023-11-30T17:22:49.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.215+0000 7f9422ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9424095e80 0x7f9424164690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:49.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.215+0000 7f9422ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9424095e80 0x7f9424164690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46186/0 (socket says 172.21.15.49:46186) 2023-11-30T17:22:49.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.215+0000 7f9422ffd700 1 -- 172.21.15.49:0/159616657 learned_addr learned my addr 172.21.15.49:0/159616657 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:49.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.215+0000 7f94237fe700 1 --2- 172.21.15.49:0/159616657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9424064e20 0x7f9424144e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:49.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.215+0000 7f9423fff700 1 --2- 172.21.15.49:0/159616657 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94241544d0 0x7f94240bf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:49.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.216+0000 7f9422ffd700 1 -- 172.21.15.49:0/159616657 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94241544d0 msgr2=0x7f94240bf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:49.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.216+0000 7f9422ffd700 1 --2- 172.21.15.49:0/159616657 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94241544d0 0x7f94240bf1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:49.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.216+0000 7f9422ffd700 1 -- 172.21.15.49:0/159616657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9424064e20 msgr2=0x7f9424144e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:49.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.216+0000 7f9422ffd700 1 --2- 172.21.15.49:0/159616657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9424064e20 0x7f9424144e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:49.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.216+0000 7f9422ffd700 1 -- 172.21.15.49:0/159616657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941c009ae0 con 0x7f9424095e80 2023-11-30T17:22:49.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.216+0000 7f9423fff700 1 --2- 172.21.15.49:0/159616657 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94241544d0 0x7f94240bf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:49.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.216+0000 7f9422ffd700 1 --2- 172.21.15.49:0/159616657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9424095e80 0x7f9424164690 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f9418009e00 tx=0x7f9418017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:49.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.216+0000 7f940b7fe700 1 -- 172.21.15.49:0/159616657 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941800f7e0 con 0x7f9424095e80 2023-11-30T17:22:49.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.216+0000 7f940b7fe700 1 -- 172.21.15.49:0/159616657 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941800f940 con 0x7f9424095e80 2023-11-30T17:22:49.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.216+0000 7f942a014700 1 -- 172.21.15.49:0/159616657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94180092a0 con 0x7f9424095e80 2023-11-30T17:22:49.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.216+0000 7f940b7fe700 1 -- 172.21.15.49:0/159616657 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941801b660 con 0x7f9424095e80 2023-11-30T17:22:49.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.216+0000 7f942a014700 1 -- 172.21.15.49:0/159616657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94240a6b20 con 0x7f9424095e80 2023-11-30T17:22:49.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.217+0000 7f940b7fe700 1 -- 172.21.15.49:0/159616657 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f941801ba50 con 0x7f9424095e80 2023-11-30T17:22:49.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.217+0000 7f942a014700 1 -- 172.21.15.49:0/159616657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94240a6980 con 0x7f9424095e80 2023-11-30T17:22:49.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.218+0000 7f940b7fe700 1 --2- 172.21.15.49:0/159616657 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f941005f270 0x7f9410061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:49.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.218+0000 7f940b7fe700 1 -- 172.21.15.49:0/159616657 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5856+0+0 (secure 0 0 0) 0x7f941807bd30 con 0x7f9424095e80 2023-11-30T17:22:49.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.218+0000 7f94237fe700 1 --2- 172.21.15.49:0/159616657 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f941005f270 0x7f9410061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:49.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.218+0000 7f94237fe700 1 --2- 172.21.15.49:0/159616657 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f941005f270 0x7f9410061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f9414007fd0 tx=0x7f9414007d90).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:49.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.222+0000 7f940b7fe700 1 -- 172.21.15.49:0/159616657 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f94240a6980 con 0x7f9424095e80 2023-11-30T17:22:49.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:49.462+0000 7f942a014700 1 -- 172.21.15.49:0/159616657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7f94240a6980 con 0x7f9424095e80 2023-11-30T17:22:50.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.425+0000 7f940b7fe700 1 -- 172.21.15.49:0/159616657 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v562) v1 ==== 156+0+0 (secure 0 0 0) 0x7f94240a6980 con 0x7f9424095e80 2023-11-30T17:22:50.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.427+0000 7f942a014700 1 -- 172.21.15.49:0/159616657 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f941005f270 msgr2=0x7f9410061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:50.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.427+0000 7f942a014700 1 --2- 172.21.15.49:0/159616657 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f941005f270 0x7f9410061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f9414007fd0 tx=0x7f9414007d90).stop 2023-11-30T17:22:50.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.427+0000 7f942a014700 1 -- 172.21.15.49:0/159616657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9424095e80 msgr2=0x7f9424164690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:50.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.427+0000 7f942a014700 1 --2- 172.21.15.49:0/159616657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9424095e80 0x7f9424164690 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f9418009e00 tx=0x7f9418017000).stop 2023-11-30T17:22:50.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.427+0000 7f942a014700 1 -- 172.21.15.49:0/159616657 shutdown_connections 2023-11-30T17:22:50.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.427+0000 7f942a014700 1 --2- 172.21.15.49:0/159616657 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94241544d0 0x7f94240bf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:50.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.427+0000 7f942a014700 1 --2- 172.21.15.49:0/159616657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9424064e20 0x7f9424144e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:50.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.427+0000 7f942a014700 1 --2- 172.21.15.49:0/159616657 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f941005f270 0x7f9410061730 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:50.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.427+0000 7f942a014700 1 --2- 172.21.15.49:0/159616657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9424095e80 0x7f9424164690 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:50.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.427+0000 7f942a014700 1 -- 172.21.15.49:0/159616657 >> 172.21.15.49:0/159616657 conn(0x7f94240631d0 msgr2=0x7f94240c91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:50.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.428+0000 7f942a014700 1 -- 172.21.15.49:0/159616657 shutdown_connections 2023-11-30T17:22:50.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.428+0000 7f942a014700 1 -- 172.21.15.49:0/159616657 wait complete. 2023-11-30T17:22:50.445 INFO:tasks.cephfs_test_runner:Test listing non-existing snap schedules failure ... ok 2023-11-30T17:22:50.445 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules on a non-existing filesystem path failure 2023-11-30T17:22:50.445 INFO:tasks.cephfs_test_runner:test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-11-30T17:22:50.446 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-11-30T17:22:50.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.568+0000 7fdc178ae700 1 Processor -- start 2023-11-30T17:22:50.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.568+0000 7fdc178ae700 1 -- start start 2023-11-30T17:22:50.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.569+0000 7fdc178ae700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdc101544e0 0x7fdc101548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:50.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.569+0000 7fdc178ae700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc100c69a0 con 0x7fdc1006a610 2023-11-30T17:22:50.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.569+0000 7fdc178ae700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc100c13a0 con 0x7fdc100c6e30 2023-11-30T17:22:50.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.569+0000 7fdc178ae700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc100c1680 con 0x7fdc101544e0 2023-11-30T17:22:50.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.569+0000 7fdc14e49700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdc1006a610 0x7fdc100c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45474/0 (socket says 172.21.15.49:45474) 2023-11-30T17:22:50.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.569+0000 7fdc14e49700 1 -- 172.21.15.49:0/2681701978 learned_addr learned my addr 172.21.15.49:0/2681701978 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:50.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.569+0000 7fdc07fff700 1 -- 172.21.15.49:0/2681701978 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3500624528 0 0) 0x7fdc100c69a0 con 0x7fdc1006a610 2023-11-30T17:22:50.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.569+0000 7fdc1564a700 1 --2- 172.21.15.49:0/2681701978 >> v2:172.21.15.115:3300/0 conn(0x7fdc101544e0 0x7fdc101548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:50.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.569+0000 7fdc07fff700 1 -- 172.21.15.49:0/2681701978 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbfc0033f0 con 0x7fdc1006a610 2023-11-30T17:22:50.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.569+0000 7fdc07fff700 1 -- 172.21.15.49:0/2681701978 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4196023887 0 0) 0x7fdbfc0033f0 con 0x7fdc1006a610 2023-11-30T17:22:50.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.569+0000 7fdc07fff700 1 -- 172.21.15.49:0/2681701978 >> v2:172.21.15.115:3300/0 conn(0x7fdc101544e0 msgr2=0x7fdc101548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:50.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.569+0000 7fdc07fff700 1 --2- 172.21.15.49:0/2681701978 >> v2:172.21.15.115:3300/0 conn(0x7fdc101544e0 0x7fdc101548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:50.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.569+0000 7fdc07fff700 1 -- 172.21.15.49:0/2681701978 >> v1:172.21.15.115:6789/0 conn(0x7fdc100c6e30 legacy=0x7fdc100a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:50.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.569+0000 7fdc07fff700 1 -- 172.21.15.49:0/2681701978 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc100c6630 con 0x7fdc1006a610 2023-11-30T17:22:50.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.569+0000 7fdc07fff700 1 -- 172.21.15.49:0/2681701978 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fdc00001470 con 0x7fdc1006a610 2023-11-30T17:22:50.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.569+0000 7fdc07fff700 1 -- 172.21.15.49:0/2681701978 >> v1:172.21.15.49:6789/0 conn(0x7fdc1006a610 legacy=0x7fdc100c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:50.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.570+0000 7fdc07fff700 1 --2- 172.21.15.49:0/2681701978 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbfc0038e0 0x7fdbfc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:50.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.570+0000 7fdc07fff700 1 --2- 172.21.15.49:0/2681701978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbfc004690 0x7fdbfc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:50.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.570+0000 7fdc07fff700 1 --2- 172.21.15.49:0/2681701978 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbfc005000 0x7fdbfc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:50.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.570+0000 7fdc07fff700 1 -- 172.21.15.49:0/2681701978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc100c1680 con 0x7fdbfc004690 2023-11-30T17:22:50.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.570+0000 7fdc07fff700 1 -- 172.21.15.49:0/2681701978 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc00beb0 con 0x7fdbfc005000 2023-11-30T17:22:50.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.570+0000 7fdc07fff700 1 -- 172.21.15.49:0/2681701978 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc00c070 con 0x7fdbfc0038e0 2023-11-30T17:22:50.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.570+0000 7fdc14e49700 1 --2- 172.21.15.49:0/2681701978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbfc004690 0x7fdbfc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:50.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.570+0000 7fdc1564a700 1 --2- 172.21.15.49:0/2681701978 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbfc0038e0 0x7fdbfc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:50.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.570+0000 7fdc15e4b700 1 --2- 172.21.15.49:0/2681701978 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbfc005000 0x7fdbfc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:50.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.570+0000 7fdc14e49700 1 -- 172.21.15.49:0/2681701978 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbfc0038e0 msgr2=0x7fdbfc003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:50.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.570+0000 7fdc14e49700 1 --2- 172.21.15.49:0/2681701978 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbfc0038e0 0x7fdbfc003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:50.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.570+0000 7fdc14e49700 1 -- 172.21.15.49:0/2681701978 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbfc005000 msgr2=0x7fdbfc00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:50.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.570+0000 7fdc14e49700 1 --2- 172.21.15.49:0/2681701978 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbfc005000 0x7fdbfc00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:50.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.570+0000 7fdc14e49700 1 -- 172.21.15.49:0/2681701978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbfc0033f0 con 0x7fdbfc004690 2023-11-30T17:22:50.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.570+0000 7fdc15e4b700 1 --2- 172.21.15.49:0/2681701978 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbfc005000 0x7fdbfc00b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:50.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.570+0000 7fdc15e4b700 1 -- 172.21.15.49:0/2681701978 reap_dead start 2023-11-30T17:22:50.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.570+0000 7fdc14e49700 1 --2- 172.21.15.49:0/2681701978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbfc004690 0x7fdbfc004b10 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7fdc0000c160 tx=0x7fdc00001e50).ready entity=mon.0 client_cookie=24fdb7b506596290 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:50.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.570+0000 7fdc07fff700 1 -- 172.21.15.49:0/2681701978 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc00007a20 con 0x7fdbfc004690 2023-11-30T17:22:50.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.570+0000 7fdc07fff700 1 -- 172.21.15.49:0/2681701978 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0000ca90 con 0x7fdbfc004690 2023-11-30T17:22:50.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.570+0000 7fdc07fff700 1 -- 172.21.15.49:0/2681701978 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0000ce10 con 0x7fdbfc004690 2023-11-30T17:22:50.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.571+0000 7fdc178ae700 1 -- 172.21.15.49:0/2681701978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbfc004690 msgr2=0x7fdbfc004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:50.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.571+0000 7fdc178ae700 1 --2- 172.21.15.49:0/2681701978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbfc004690 0x7fdbfc004b10 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7fdc0000c160 tx=0x7fdc00001e50).stop 2023-11-30T17:22:50.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.571+0000 7fdc178ae700 1 -- 172.21.15.49:0/2681701978 shutdown_connections 2023-11-30T17:22:50.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.571+0000 7fdc178ae700 1 --2- 172.21.15.49:0/2681701978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbfc004690 0x7fdbfc004b10 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:50.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.571+0000 7fdc178ae700 1 -- 172.21.15.49:0/2681701978 >> 172.21.15.49:0/2681701978 conn(0x7fdc10085020 msgr2=0x7fdc10094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:50.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.571+0000 7fdc178ae700 1 -- 172.21.15.49:0/2681701978 shutdown_connections 2023-11-30T17:22:50.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.571+0000 7fdc178ae700 1 -- 172.21.15.49:0/2681701978 wait complete. 2023-11-30T17:22:50.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.572+0000 7fdc178ae700 1 Processor -- start 2023-11-30T17:22:50.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.572+0000 7fdc178ae700 1 -- start start 2023-11-30T17:22:50.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.573+0000 7fdc178ae700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbfc004690 0x7fdc10152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:50.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.573+0000 7fdc178ae700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc100a8000 0x7fdc1014f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:50.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.573+0000 7fdc178ae700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc10096990 0x7fdc10096e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:50.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.573+0000 7fdc178ae700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc10150680 con 0x7fdc100a8000 2023-11-30T17:22:50.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.573+0000 7fdc178ae700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc10097300 con 0x7fdbfc004690 2023-11-30T17:22:50.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.573+0000 7fdc178ae700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc101534a0 con 0x7fdc10096990 2023-11-30T17:22:50.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.573+0000 7fdc14e49700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc100a8000 0x7fdc1014f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:50.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.573+0000 7fdc14e49700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc100a8000 0x7fdc1014f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46210/0 (socket says 172.21.15.49:46210) 2023-11-30T17:22:50.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.573+0000 7fdc14e49700 1 -- 172.21.15.49:0/204712360 learned_addr learned my addr 172.21.15.49:0/204712360 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:50.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.573+0000 7fdc15e4b700 1 --2- 172.21.15.49:0/204712360 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc10096990 0x7fdc10096e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:50.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.573+0000 7fdc1564a700 1 --2- 172.21.15.49:0/204712360 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbfc004690 0x7fdc10152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:50.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.573+0000 7fdc14e49700 1 -- 172.21.15.49:0/204712360 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc10096990 msgr2=0x7fdc10096e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:50.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.573+0000 7fdc14e49700 1 --2- 172.21.15.49:0/204712360 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc10096990 0x7fdc10096e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:50.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.573+0000 7fdc14e49700 1 -- 172.21.15.49:0/204712360 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbfc004690 msgr2=0x7fdc10152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:50.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.573+0000 7fdc14e49700 1 --2- 172.21.15.49:0/204712360 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbfc004690 0x7fdc10152fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:50.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.573+0000 7fdc14e49700 1 -- 172.21.15.49:0/204712360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc10096670 con 0x7fdc100a8000 2023-11-30T17:22:50.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.573+0000 7fdc1564a700 1 --2- 172.21.15.49:0/204712360 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbfc004690 0x7fdc10152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:50.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.574+0000 7fdc14e49700 1 --2- 172.21.15.49:0/204712360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc100a8000 0x7fdc1014f790 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7fdc0000c750 tx=0x7fdc00015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:50.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.574+0000 7fdc057fa700 1 -- 172.21.15.49:0/204712360 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc00007430 con 0x7fdc100a8000 2023-11-30T17:22:50.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.574+0000 7fdc057fa700 1 -- 172.21.15.49:0/204712360 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc00007590 con 0x7fdc100a8000 2023-11-30T17:22:50.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.574+0000 7fdc057fa700 1 -- 172.21.15.49:0/204712360 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc000048e0 con 0x7fdc100a8000 2023-11-30T17:22:50.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.574+0000 7fdc178ae700 1 -- 172.21.15.49:0/204712360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc101500c0 con 0x7fdc100a8000 2023-11-30T17:22:50.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.574+0000 7fdc178ae700 1 -- 172.21.15.49:0/204712360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc10151410 con 0x7fdc100a8000 2023-11-30T17:22:50.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.575+0000 7fdc178ae700 1 -- 172.21.15.49:0/204712360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc100c5630 con 0x7fdc100a8000 2023-11-30T17:22:50.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.575+0000 7fdc057fa700 1 -- 172.21.15.49:0/204712360 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fdc0001c070 con 0x7fdc100a8000 2023-11-30T17:22:50.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.576+0000 7fdc057fa700 1 --2- 172.21.15.49:0/204712360 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdbf405f240 0x7fdbf4061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:50.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.576+0000 7fdc057fa700 1 -- 172.21.15.49:0/204712360 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5856+0+0 (secure 0 0 0) 0x7fdc0007a9b0 con 0x7fdc100a8000 2023-11-30T17:22:50.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.576+0000 7fdc1564a700 1 --2- 172.21.15.49:0/204712360 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdbf405f240 0x7fdbf4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:50.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.576+0000 7fdc1564a700 1 --2- 172.21.15.49:0/204712360 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdbf405f240 0x7fdbf4061700 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fdc0c006d20 tx=0x7fdc0c008040).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:50.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.580+0000 7fdc057fa700 1 -- 172.21.15.49:0/204712360 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdc0004bc10 con 0x7fdc100a8000 2023-11-30T17:22:50.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:50.821+0000 7fdc178ae700 1 -- 172.21.15.49:0/204712360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7fdc1006c860 con 0x7fdc100a8000 2023-11-30T17:22:51.413 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:22:51.416 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:22:51.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.427+0000 7fdc057fa700 1 -- 172.21.15.49:0/204712360 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v563) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdc00024030 con 0x7fdc100a8000 2023-11-30T17:22:51.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.429+0000 7fdc178ae700 1 -- 172.21.15.49:0/204712360 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdbf405f240 msgr2=0x7fdbf4061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:51.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.429+0000 7fdc178ae700 1 --2- 172.21.15.49:0/204712360 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdbf405f240 0x7fdbf4061700 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fdc0c006d20 tx=0x7fdc0c008040).stop 2023-11-30T17:22:51.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.429+0000 7fdc178ae700 1 -- 172.21.15.49:0/204712360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc100a8000 msgr2=0x7fdc1014f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:51.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.429+0000 7fdc178ae700 1 --2- 172.21.15.49:0/204712360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc100a8000 0x7fdc1014f790 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7fdc0000c750 tx=0x7fdc00015000).stop 2023-11-30T17:22:51.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.429+0000 7fdc178ae700 1 -- 172.21.15.49:0/204712360 shutdown_connections 2023-11-30T17:22:51.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.429+0000 7fdc178ae700 1 --2- 172.21.15.49:0/204712360 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc10096990 0x7fdc10096e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:51.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.429+0000 7fdc178ae700 1 --2- 172.21.15.49:0/204712360 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbfc004690 0x7fdc10152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:51.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.429+0000 7fdc178ae700 1 --2- 172.21.15.49:0/204712360 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdbf405f240 0x7fdbf4061700 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:51.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.429+0000 7fdc178ae700 1 --2- 172.21.15.49:0/204712360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc100a8000 0x7fdc1014f790 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:51.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.429+0000 7fdc178ae700 1 -- 172.21.15.49:0/204712360 >> 172.21.15.49:0/204712360 conn(0x7fdc10085020 msgr2=0x7fdc100c9070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:51.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.429+0000 7fdc178ae700 1 -- 172.21.15.49:0/204712360 shutdown_connections 2023-11-30T17:22:51.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.429+0000 7fdc178ae700 1 -- 172.21.15.49:0/204712360 wait complete. 2023-11-30T17:22:51.445 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-30T17:22:51.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.634+0000 7ff0a3fff700 1 Processor -- start 2023-11-30T17:22:51.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.634+0000 7ff0a3fff700 1 -- start start 2023-11-30T17:22:51.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.635+0000 7ff0a3fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff0a40c66f0 0x7ff0a4154950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:51.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.635+0000 7ff0a3fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff0a4158570 0x7ff0a4158a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:51.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.635+0000 7ff0a3fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a4154e40 con 0x7ff0a414e530 2023-11-30T17:22:51.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.635+0000 7ff0a3fff700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a40c6ba0 con 0x7ff0a40c66f0 2023-11-30T17:22:51.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.635+0000 7ff0a3fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a40c7bc0 con 0x7ff0a4158570 2023-11-30T17:22:51.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.635+0000 7ff0a27fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff0a40c66f0 0x7ff0a4154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:51.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.635+0000 7ff0a27fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff0a40c66f0 0x7ff0a4154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56930/0 (socket says 172.21.15.49:56930) 2023-11-30T17:22:51.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.635+0000 7ff0a27fc700 1 -- 172.21.15.49:0/1038511001 learned_addr learned my addr 172.21.15.49:0/1038511001 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:51.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.635+0000 7ff0a37fe700 1 --2- 172.21.15.49:0/1038511001 >> v2:172.21.15.115:3300/0 conn(0x7ff0a4158570 0x7ff0a4158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.635+0000 7ff0a27fc700 1 -- 172.21.15.49:0/1038511001 >> v2:172.21.15.115:3300/0 conn(0x7ff0a4158570 msgr2=0x7ff0a4158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.635+0000 7ff0a27fc700 1 --2- 172.21.15.49:0/1038511001 >> v2:172.21.15.115:3300/0 conn(0x7ff0a4158570 0x7ff0a4158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.635+0000 7ff0a27fc700 1 -- 172.21.15.49:0/1038511001 >> v1:172.21.15.115:6789/0 conn(0x7ff0a414e530 legacy=0x7ff0a414e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.635+0000 7ff0a27fc700 1 -- 172.21.15.49:0/1038511001 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a4155920 con 0x7ff0a40c66f0 2023-11-30T17:22:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.635+0000 7ff0a27fc700 1 --2- 172.21.15.49:0/1038511001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0a40c66f0 0x7ff0a4154950 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7ff0a40aac80 tx=0x7ff08c0090f0).ready entity=mon.0 client_cookie=dc55fddfb1c87540 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.636+0000 7ff0a1ffb700 1 -- 172.21.15.49:0/1038511001 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c00b600 con 0x7ff0a40c66f0 2023-11-30T17:22:51.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.636+0000 7ff0a1ffb700 1 -- 172.21.15.49:0/1038511001 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08c00b760 con 0x7ff0a40c66f0 2023-11-30T17:22:51.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.636+0000 7ff0a1ffb700 1 -- 172.21.15.49:0/1038511001 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c00bae0 con 0x7ff0a40c66f0 2023-11-30T17:22:51.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.636+0000 7ff0a3fff700 1 -- 172.21.15.49:0/1038511001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0a40c66f0 msgr2=0x7ff0a4154950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:51.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.636+0000 7ff0a3fff700 1 --2- 172.21.15.49:0/1038511001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0a40c66f0 0x7ff0a4154950 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7ff0a40aac80 tx=0x7ff08c0090f0).stop 2023-11-30T17:22:51.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.636+0000 7ff0a3fff700 1 -- 172.21.15.49:0/1038511001 shutdown_connections 2023-11-30T17:22:51.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.636+0000 7ff0a3fff700 1 --2- 172.21.15.49:0/1038511001 >> v2:172.21.15.115:3300/0 conn(0x7ff0a4158570 0x7ff0a4158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:51.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.636+0000 7ff0a3fff700 1 --2- 172.21.15.49:0/1038511001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0a40c66f0 0x7ff0a4154950 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:51.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.636+0000 7ff0a3fff700 1 -- 172.21.15.49:0/1038511001 >> 172.21.15.49:0/1038511001 conn(0x7ff0a4064990 msgr2=0x7ff0a4064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:51.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.636+0000 7ff0a3fff700 1 -- 172.21.15.49:0/1038511001 shutdown_connections 2023-11-30T17:22:51.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.636+0000 7ff0a3fff700 1 -- 172.21.15.49:0/1038511001 wait complete. 2023-11-30T17:22:51.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.637+0000 7ff0a3fff700 1 Processor -- start 2023-11-30T17:22:51.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.637+0000 7ff0a3fff700 1 -- start start 2023-11-30T17:22:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.638+0000 7ff0a3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0a40c66f0 0x7ff0a414d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.638+0000 7ff0a3fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0a414e530 0x7ff0a4153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.638+0000 7ff0a3fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a4158570 0x7ff0a40c3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.638+0000 7ff0a3fff700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a414d830 con 0x7ff0a40c66f0 2023-11-30T17:22:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.638+0000 7ff0a3fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a414d080 con 0x7ff0a4158570 2023-11-30T17:22:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.638+0000 7ff0a3fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a40c2bf0 con 0x7ff0a414e530 2023-11-30T17:22:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.638+0000 7ff0a2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0a40c66f0 0x7ff0a414d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:51.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.638+0000 7ff0a2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0a40c66f0 0x7ff0a414d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56934/0 (socket says 172.21.15.49:56934) 2023-11-30T17:22:51.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.638+0000 7ff0a2ffd700 1 -- 172.21.15.49:0/1778788810 learned_addr learned my addr 172.21.15.49:0/1778788810 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:51.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.638+0000 7ff0a37fe700 1 --2- 172.21.15.49:0/1778788810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a4158570 0x7ff0a40c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:51.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.638+0000 7ff0a27fc700 1 --2- 172.21.15.49:0/1778788810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0a414e530 0x7ff0a4153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:51.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.639+0000 7ff0a2ffd700 1 -- 172.21.15.49:0/1778788810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0a414e530 msgr2=0x7ff0a4153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:51.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.639+0000 7ff0a2ffd700 1 --2- 172.21.15.49:0/1778788810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0a414e530 0x7ff0a4153390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:51.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.639+0000 7ff0a2ffd700 1 -- 172.21.15.49:0/1778788810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a4158570 msgr2=0x7ff0a40c3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:51.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.639+0000 7ff0a2ffd700 1 --2- 172.21.15.49:0/1778788810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a4158570 0x7ff0a40c3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:51.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.639+0000 7ff0a2ffd700 1 -- 172.21.15.49:0/1778788810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08c009370 con 0x7ff0a40c66f0 2023-11-30T17:22:51.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.639+0000 7ff0a27fc700 1 --2- 172.21.15.49:0/1778788810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0a414e530 0x7ff0a4153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:51.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.639+0000 7ff0a2ffd700 1 --2- 172.21.15.49:0/1778788810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0a40c66f0 0x7ff0a414d270 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7ff09c00c4c0 tx=0x7ff09c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:51.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.639+0000 7ff09affd700 1 -- 172.21.15.49:0/1778788810 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09c007020 con 0x7ff0a40c66f0 2023-11-30T17:22:51.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.639+0000 7ff09affd700 1 -- 172.21.15.49:0/1778788810 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09c001e90 con 0x7ff0a40c66f0 2023-11-30T17:22:51.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.639+0000 7ff0a3fff700 1 -- 172.21.15.49:0/1778788810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a40c22c0 con 0x7ff0a40c66f0 2023-11-30T17:22:51.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.639+0000 7ff09affd700 1 -- 172.21.15.49:0/1778788810 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09c0073b0 con 0x7ff0a40c66f0 2023-11-30T17:22:51.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.639+0000 7ff0a3fff700 1 -- 172.21.15.49:0/1778788810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a40c2880 con 0x7ff0a40c66f0 2023-11-30T17:22:51.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.640+0000 7ff0a3fff700 1 -- 172.21.15.49:0/1778788810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a40c2ed0 con 0x7ff0a40c66f0 2023-11-30T17:22:51.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.640+0000 7ff09affd700 1 -- 172.21.15.49:0/1778788810 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff09c0068b0 con 0x7ff0a40c66f0 2023-11-30T17:22:51.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.641+0000 7ff09affd700 1 --2- 172.21.15.49:0/1778788810 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff08405f270 0x7ff084061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:51.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.641+0000 7ff09affd700 1 -- 172.21.15.49:0/1778788810 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5856+0+0 (secure 0 0 0) 0x7ff09c079aa0 con 0x7ff0a40c66f0 2023-11-30T17:22:51.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.641+0000 7ff0a27fc700 1 --2- 172.21.15.49:0/1778788810 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff08405f270 0x7ff084061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:51.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.641+0000 7ff0a27fc700 1 --2- 172.21.15.49:0/1778788810 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff08405f270 0x7ff084061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7ff08c009130 tx=0x7ff08c017000).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:51.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.645+0000 7ff09affd700 1 -- 172.21.15.49:0/1778788810 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff09c04ad00 con 0x7ff0a40c66f0 2023-11-30T17:22:51.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.822+0000 7ff0a3fff700 1 -- 172.21.15.49:0/1778788810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff0a4154e40 con 0x7ff0a40c66f0 2023-11-30T17:22:51.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.825+0000 7ff09affd700 1 -- 172.21.15.49:0/1778788810 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff0a4154e40 con 0x7ff0a40c66f0 2023-11-30T17:22:51.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.827+0000 7ff0a3fff700 1 -- 172.21.15.49:0/1778788810 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff08405f270 msgr2=0x7ff084061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:51.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.827+0000 7ff0a3fff700 1 --2- 172.21.15.49:0/1778788810 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff08405f270 0x7ff084061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7ff08c009130 tx=0x7ff08c017000).stop 2023-11-30T17:22:51.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.827+0000 7ff0a3fff700 1 -- 172.21.15.49:0/1778788810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0a40c66f0 msgr2=0x7ff0a414d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:51.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.827+0000 7ff0a3fff700 1 --2- 172.21.15.49:0/1778788810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0a40c66f0 0x7ff0a414d270 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7ff09c00c4c0 tx=0x7ff09c007e00).stop 2023-11-30T17:22:51.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.827+0000 7ff0a3fff700 1 -- 172.21.15.49:0/1778788810 shutdown_connections 2023-11-30T17:22:51.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.827+0000 7ff0a3fff700 1 --2- 172.21.15.49:0/1778788810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a4158570 0x7ff0a40c3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:51.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.827+0000 7ff0a3fff700 1 --2- 172.21.15.49:0/1778788810 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff08405f270 0x7ff084061730 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:51.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.827+0000 7ff0a3fff700 1 --2- 172.21.15.49:0/1778788810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0a40c66f0 0x7ff0a414d270 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:51.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.827+0000 7ff0a3fff700 1 --2- 172.21.15.49:0/1778788810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0a414e530 0x7ff0a4153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:51.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.827+0000 7ff0a3fff700 1 -- 172.21.15.49:0/1778788810 >> 172.21.15.49:0/1778788810 conn(0x7ff0a4064990 msgr2=0x7ff0a40c1100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:51.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.827+0000 7ff0a3fff700 1 -- 172.21.15.49:0/1778788810 shutdown_connections 2023-11-30T17:22:51.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:51.827+0000 7ff0a3fff700 1 -- 172.21.15.49:0/1778788810 wait complete. 2023-11-30T17:22:51.841 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-30T17:22:51.842 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T17:22:51.882 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T17:22:51.926 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-30T17:22:51.926 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-30T17:22:51.927 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:22:52.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.041+0000 7f3adff2a700 1 Processor -- start 2023-11-30T17:22:52.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.042+0000 7f3adff2a700 1 -- start start 2023-11-30T17:22:52.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.042+0000 7f3adff2a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ad81544d0 0x7f3ad8155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:52.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.042+0000 7f3adff2a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ad80683d0 con 0x7f3ad8066f40 2023-11-30T17:22:52.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.042+0000 7f3adff2a700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ad8067850 con 0x7f3ad80673c0 2023-11-30T17:22:52.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.042+0000 7f3adff2a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad8067b30 con 0x7f3ad81544d0 2023-11-30T17:22:52.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.043+0000 7f3add4c5700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3ad8066f40 0x7f3ad8095e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41984/0 (socket says 172.21.15.49:41984) 2023-11-30T17:22:52.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.043+0000 7f3add4c5700 1 -- 172.21.15.49:0/3287842480 learned_addr learned my addr 172.21.15.49:0/3287842480 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:52.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.043+0000 7f3addcc6700 1 --2- 172.21.15.49:0/3287842480 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ad81544d0 0x7f3ad8155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:52.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.043+0000 7f3adccc4700 1 -- 172.21.15.49:0/3287842480 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1210272564 0 0) 0x7f3ad80683d0 con 0x7f3ad8066f40 2023-11-30T17:22:52.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.043+0000 7f3adccc4700 1 -- 172.21.15.49:0/3287842480 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ac00033f0 con 0x7f3ad8066f40 2023-11-30T17:22:52.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.043+0000 7f3adccc4700 1 -- 172.21.15.49:0/3287842480 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3412765827 0 0) 0x7f3ac00033f0 con 0x7f3ad8066f40 2023-11-30T17:22:52.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.043+0000 7f3adccc4700 1 -- 172.21.15.49:0/3287842480 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ad81544d0 msgr2=0x7f3ad8155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:52.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.043+0000 7f3adccc4700 1 --2- 172.21.15.49:0/3287842480 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ad81544d0 0x7f3ad8155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:52.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.043+0000 7f3adccc4700 1 -- 172.21.15.49:0/3287842480 >> v1:172.21.15.115:6789/0 conn(0x7f3ad80673c0 legacy=0x7f3ad815e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:52.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.043+0000 7f3adccc4700 1 -- 172.21.15.49:0/3287842480 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad8067e10 con 0x7f3ad8066f40 2023-11-30T17:22:52.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.043+0000 7f3adccc4700 1 -- 172.21.15.49:0/3287842480 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f3acc001470 con 0x7f3ad8066f40 2023-11-30T17:22:52.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.043+0000 7f3adccc4700 1 -- 172.21.15.49:0/3287842480 >> v1:172.21.15.49:6789/0 conn(0x7f3ad8066f40 legacy=0x7f3ad8095e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:52.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.043+0000 7f3adccc4700 1 --2- 172.21.15.49:0/3287842480 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ad81544d0 0x7f3ac0003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:52.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.043+0000 7f3adccc4700 1 --2- 172.21.15.49:0/3287842480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ac0003e40 0x7f3ac0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:52.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.043+0000 7f3adccc4700 1 --2- 172.21.15.49:0/3287842480 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ac0004b80 0x7f3ac0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:52.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.043+0000 7f3adccc4700 1 -- 172.21.15.49:0/3287842480 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad8067b30 con 0x7f3ac0003e40 2023-11-30T17:22:52.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.043+0000 7f3adccc4700 1 -- 172.21.15.49:0/3287842480 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac000b990 con 0x7f3ac0004b80 2023-11-30T17:22:52.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.043+0000 7f3adccc4700 1 -- 172.21.15.49:0/3287842480 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac000bb50 con 0x7f3ad81544d0 2023-11-30T17:22:52.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.043+0000 7f3add4c5700 1 --2- 172.21.15.49:0/3287842480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ac0003e40 0x7f3ac0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:52.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.043+0000 7f3addcc6700 1 --2- 172.21.15.49:0/3287842480 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ad81544d0 0x7f3ac0003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:52.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.044+0000 7f3ade4c7700 1 --2- 172.21.15.49:0/3287842480 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ac0004b80 0x7f3ac0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:52.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.044+0000 7f3add4c5700 1 -- 172.21.15.49:0/3287842480 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ad81544d0 msgr2=0x7f3ac0003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:52.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.044+0000 7f3add4c5700 1 --2- 172.21.15.49:0/3287842480 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ad81544d0 0x7f3ac0003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:52.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.044+0000 7f3add4c5700 1 -- 172.21.15.49:0/3287842480 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ac0004b80 msgr2=0x7f3ac0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:52.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.044+0000 7f3add4c5700 1 --2- 172.21.15.49:0/3287842480 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ac0004b80 0x7f3ac0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:52.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.044+0000 7f3add4c5700 1 -- 172.21.15.49:0/3287842480 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac00033f0 con 0x7f3ac0003e40 2023-11-30T17:22:52.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.044+0000 7f3addcc6700 1 --2- 172.21.15.49:0/3287842480 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ad81544d0 0x7f3ac0003910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:22:52.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.044+0000 7f3add4c5700 1 --2- 172.21.15.49:0/3287842480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ac0003e40 0x7f3ac0004690 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f3acc00c160 tx=0x7f3acc001e50).ready entity=mon.0 client_cookie=62a2b1f0c4172e70 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:52.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.044+0000 7f3adccc4700 1 -- 172.21.15.49:0/3287842480 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc007a20 con 0x7f3ac0003e40 2023-11-30T17:22:52.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.044+0000 7f3adccc4700 1 -- 172.21.15.49:0/3287842480 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3acc00ca90 con 0x7f3ac0003e40 2023-11-30T17:22:52.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.044+0000 7f3adccc4700 1 -- 172.21.15.49:0/3287842480 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc00ce10 con 0x7f3ac0003e40 2023-11-30T17:22:52.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.044+0000 7f3adff2a700 1 -- 172.21.15.49:0/3287842480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ac0003e40 msgr2=0x7f3ac0004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:52.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.044+0000 7f3adff2a700 1 --2- 172.21.15.49:0/3287842480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ac0003e40 0x7f3ac0004690 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f3acc00c160 tx=0x7f3acc001e50).stop 2023-11-30T17:22:52.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.044+0000 7f3ade4c7700 1 -- 172.21.15.49:0/3287842480 reap_dead start 2023-11-30T17:22:52.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.045+0000 7f3adff2a700 1 -- 172.21.15.49:0/3287842480 shutdown_connections 2023-11-30T17:22:52.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.045+0000 7f3adff2a700 1 -- 172.21.15.49:0/3287842480 >> 172.21.15.49:0/3287842480 conn(0x7f3ad80631d0 msgr2=0x7f3ad80c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:52.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.045+0000 7f3adff2a700 1 -- 172.21.15.49:0/3287842480 shutdown_connections 2023-11-30T17:22:52.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.045+0000 7f3adff2a700 1 -- 172.21.15.49:0/3287842480 wait complete. 2023-11-30T17:22:52.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.046+0000 7f3adff2a700 1 Processor -- start 2023-11-30T17:22:52.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.046+0000 7f3adff2a700 1 -- start start 2023-11-30T17:22:52.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.047+0000 7f3adff2a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ac0003e40 0x7f3ad80ab150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:52.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.047+0000 7f3adff2a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ad80ae5b0 0x7f3ad80aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:52.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.047+0000 7f3adff2a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ad80c01b0 0x7f3ad80c05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:52.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.047+0000 7f3adff2a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad80aacc0 con 0x7f3ac0003e40 2023-11-30T17:22:52.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.047+0000 7f3adff2a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad80ab640 con 0x7f3ad80c01b0 2023-11-30T17:22:52.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.047+0000 7f3adff2a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad80c1ac0 con 0x7f3ad80ae5b0 2023-11-30T17:22:52.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.047+0000 7f3addcc6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ac0003e40 0x7f3ad80ab150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:52.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.047+0000 7f3addcc6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ac0003e40 0x7f3ad80ab150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56958/0 (socket says 172.21.15.49:56958) 2023-11-30T17:22:52.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.047+0000 7f3addcc6700 1 -- 172.21.15.49:0/343814549 learned_addr learned my addr 172.21.15.49:0/343814549 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:52.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.047+0000 7f3add4c5700 1 --2- 172.21.15.49:0/343814549 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ad80ae5b0 0x7f3ad80aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:52.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.047+0000 7f3ade4c7700 1 --2- 172.21.15.49:0/343814549 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ad80c01b0 0x7f3ad80c05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:52.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.047+0000 7f3addcc6700 1 -- 172.21.15.49:0/343814549 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ad80ae5b0 msgr2=0x7f3ad80aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:52.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.047+0000 7f3addcc6700 1 --2- 172.21.15.49:0/343814549 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ad80ae5b0 0x7f3ad80aea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:52.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.047+0000 7f3addcc6700 1 -- 172.21.15.49:0/343814549 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ad80c01b0 msgr2=0x7f3ad80c05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:52.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.047+0000 7f3addcc6700 1 --2- 172.21.15.49:0/343814549 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ad80c01b0 0x7f3ad80c05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:52.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.047+0000 7f3addcc6700 1 -- 172.21.15.49:0/343814549 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad80aa0b0 con 0x7f3ac0003e40 2023-11-30T17:22:52.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.047+0000 7f3ade4c7700 1 --2- 172.21.15.49:0/343814549 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ad80c01b0 0x7f3ad80c05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:52.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.047+0000 7f3add4c5700 1 --2- 172.21.15.49:0/343814549 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ad80ae5b0 0x7f3ad80aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:52.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.047+0000 7f3addcc6700 1 --2- 172.21.15.49:0/343814549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ac0003e40 0x7f3ad80ab150 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f3ad0011d40 tx=0x7f3ad0006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:52.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.047+0000 7f3ad5ffb700 1 -- 172.21.15.49:0/343814549 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad000fac0 con 0x7f3ac0003e40 2023-11-30T17:22:52.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.047+0000 7f3ad5ffb700 1 -- 172.21.15.49:0/343814549 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad000fc20 con 0x7f3ac0003e40 2023-11-30T17:22:52.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.047+0000 7f3adff2a700 1 -- 172.21.15.49:0/343814549 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad80aa390 con 0x7f3ac0003e40 2023-11-30T17:22:52.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.047+0000 7f3ad5ffb700 1 -- 172.21.15.49:0/343814549 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0005880 con 0x7f3ac0003e40 2023-11-30T17:22:52.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.047+0000 7f3adff2a700 1 -- 172.21.15.49:0/343814549 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad80aa950 con 0x7f3ac0003e40 2023-11-30T17:22:52.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.049+0000 7f3adff2a700 1 -- 172.21.15.49:0/343814549 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ad80aafa0 con 0x7f3ac0003e40 2023-11-30T17:22:52.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.049+0000 7f3ad5ffb700 1 -- 172.21.15.49:0/343814549 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f3ad0005ec0 con 0x7f3ac0003e40 2023-11-30T17:22:52.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.049+0000 7f3ad5ffb700 1 --2- 172.21.15.49:0/343814549 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3ac405f240 0x7f3ac4061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:52.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.049+0000 7f3ad5ffb700 1 -- 172.21.15.49:0/343814549 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5856+0+0 (secure 0 0 0) 0x7f3ad007acf0 con 0x7f3ac0003e40 2023-11-30T17:22:52.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.049+0000 7f3add4c5700 1 --2- 172.21.15.49:0/343814549 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3ac405f240 0x7f3ac4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:52.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.050+0000 7f3add4c5700 1 --2- 172.21.15.49:0/343814549 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3ac405f240 0x7f3ac4061700 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f3ad80a9b10 tx=0x7f3acc015000).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:52.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.053+0000 7f3ad5ffb700 1 -- 172.21.15.49:0/343814549 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3ad007f070 con 0x7f3ac0003e40 2023-11-30T17:22:52.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.266+0000 7f3adff2a700 1 -- 172.21.15.49:0/343814549 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ad806c860 con 0x7f3ac0003e40 2023-11-30T17:22:52.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.267+0000 7f3ad5ffb700 1 -- 172.21.15.49:0/343814549 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f3ad0021070 con 0x7f3ac0003e40 2023-11-30T17:22:52.270 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:52.270 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":34,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/3245104889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3245104889},{"type":"v1","addr":"172.21.15.115:6836","nonce":3245104889}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5579,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1933850814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1933850814},{"type":"v1","addr":"172.21.15.115:6837","nonce":1933850814}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6225,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1356528561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1356528561},{"type":"v1","addr":"172.21.15.49:6834","nonce":1356528561}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1433361424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1433361424},{"type":"v1","addr":"172.21.15.49:6835","nonce":1433361424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[]} 2023-11-30T17:22:52.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.269+0000 7f3adff2a700 1 -- 172.21.15.49:0/343814549 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3ac405f240 msgr2=0x7f3ac4061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:52.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.269+0000 7f3adff2a700 1 --2- 172.21.15.49:0/343814549 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3ac405f240 0x7f3ac4061700 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f3ad80a9b10 tx=0x7f3acc015000).stop 2023-11-30T17:22:52.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.269+0000 7f3adff2a700 1 -- 172.21.15.49:0/343814549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ac0003e40 msgr2=0x7f3ad80ab150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:52.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.269+0000 7f3adff2a700 1 --2- 172.21.15.49:0/343814549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ac0003e40 0x7f3ad80ab150 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f3ad0011d40 tx=0x7f3ad0006f40).stop 2023-11-30T17:22:52.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.269+0000 7f3adff2a700 1 -- 172.21.15.49:0/343814549 shutdown_connections 2023-11-30T17:22:52.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.269+0000 7f3adff2a700 1 --2- 172.21.15.49:0/343814549 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ad80c01b0 0x7f3ad80c05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:52.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.269+0000 7f3adff2a700 1 --2- 172.21.15.49:0/343814549 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3ac405f240 0x7f3ac4061700 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:52.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.269+0000 7f3adff2a700 1 --2- 172.21.15.49:0/343814549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ac0003e40 0x7f3ad80ab150 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:52.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.269+0000 7f3adff2a700 1 --2- 172.21.15.49:0/343814549 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ad80ae5b0 0x7f3ad80aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:52.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.269+0000 7f3adff2a700 1 -- 172.21.15.49:0/343814549 >> 172.21.15.49:0/343814549 conn(0x7f3ad80631d0 msgr2=0x7f3ad8153860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:52.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.269+0000 7f3adff2a700 1 -- 172.21.15.49:0/343814549 shutdown_connections 2023-11-30T17:22:52.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.269+0000 7f3adff2a700 1 -- 172.21.15.49:0/343814549 wait complete. 2023-11-30T17:22:52.273 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 34 2023-11-30T17:22:52.283 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-30T17:22:52.284 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-30T17:22:52.284 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-30T17:22:52.284 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T17:22:52.284 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-30T17:22:52.284 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-30T17:22:52.285 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-30T17:22:52.285 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T17:22:52.285 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-30T17:22:52.285 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-30T17:22:52.285 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-30T17:22:52.285 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T17:22:52.285 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-30T17:22:52.285 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-30T17:22:52.286 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-30T17:22:52.286 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T17:22:52.294 INFO:tasks.ceph.mds.a:Stopped 2023-11-30T17:22:52.295 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-30T17:22:52.295 INFO:tasks.ceph.mds.c:Stopped 2023-11-30T17:22:52.296 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-30T17:22:52.297 INFO:tasks.ceph.mds.b:Stopped 2023-11-30T17:22:52.297 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-30T17:22:52.297 INFO:tasks.ceph.mds.d:Stopped 2023-11-30T17:22:52.298 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-30T17:22:52.339 INFO:tasks.ceph.mds.a:Started 2023-11-30T17:22:52.339 INFO:tasks.ceph.mds.c:Started 2023-11-30T17:22:52.339 DEBUG:teuthology.parallel:result is None 2023-11-30T17:22:52.340 DEBUG:teuthology.parallel:result is None 2023-11-30T17:22:52.340 INFO:tasks.ceph.mds.b:Started 2023-11-30T17:22:52.340 INFO:tasks.ceph.mds.d:Started 2023-11-30T17:22:52.341 DEBUG:teuthology.parallel:result is None 2023-11-30T17:22:52.341 DEBUG:teuthology.parallel:result is None 2023-11-30T17:22:52.341 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-30T17:22:52.413 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-11-30T17:22:52.413 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-11-30T17:22:52.418 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-11-30T17:22:52.419 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-11-30T17:22:52.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.467+0000 7f81a97d6700 1 Processor -- start 2023-11-30T17:22:52.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.467+0000 7f81a97d6700 1 -- start start 2023-11-30T17:22:52.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.468+0000 7f81a97d6700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f81a4158820 0x7f81a40a67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:52.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.468+0000 7f81a97d6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81a415d030 0x7f81a40654e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:52.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.468+0000 7f81a97d6700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a4065050 con 0x7f81a415c4a0 2023-11-30T17:22:52.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.468+0000 7f81a97d6700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a40a6ce0 con 0x7f81a4158820 2023-11-30T17:22:52.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.468+0000 7f81a97d6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a40638b0 con 0x7f81a415d030 2023-11-30T17:22:52.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.468+0000 7f81a37fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f81a415c4a0 0x7f81a415c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42000/0 (socket says 172.21.15.49:42000) 2023-11-30T17:22:52.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.468+0000 7f81a37fe700 1 -- 172.21.15.49:0/3552679982 learned_addr learned my addr 172.21.15.49:0/3552679982 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:52.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.468+0000 7f81a8fd5700 1 --2- 172.21.15.49:0/3552679982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81a415d030 0x7f81a40654e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:52.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.468+0000 7f81a3fff700 1 --2- 172.21.15.49:0/3552679982 >> v2:172.21.15.115:3300/0 conn(0x7f81a4158820 0x7f81a40a67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:52.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.468+0000 7f81a2ffd700 1 -- 172.21.15.49:0/3552679982 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144589806 0 0) 0x7f81a4065050 con 0x7f81a415c4a0 2023-11-30T17:22:52.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.468+0000 7f81a2ffd700 1 -- 172.21.15.49:0/3552679982 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f818c0033f0 con 0x7f81a415c4a0 2023-11-30T17:22:52.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.469+0000 7f81a8fd5700 1 -- 172.21.15.49:0/3552679982 >> v2:172.21.15.115:3300/0 conn(0x7f81a4158820 msgr2=0x7f81a40a67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:52.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.469+0000 7f81a8fd5700 1 --2- 172.21.15.49:0/3552679982 >> v2:172.21.15.115:3300/0 conn(0x7f81a4158820 0x7f81a40a67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:52.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.469+0000 7f81a8fd5700 1 -- 172.21.15.49:0/3552679982 >> v1:172.21.15.49:6789/0 conn(0x7f81a415c4a0 legacy=0x7f81a415c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:52.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.469+0000 7f81a8fd5700 1 -- 172.21.15.49:0/3552679982 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a4063b90 con 0x7f81a415d030 2023-11-30T17:22:52.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.469+0000 7f81a8fd5700 1 --2- 172.21.15.49:0/3552679982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81a415d030 0x7f81a40654e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f819c009e60 tx=0x7f819c009780).ready entity=mon.2 client_cookie=9619b7a68c6baf23 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:52.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.469+0000 7f81a2ffd700 1 -- 172.21.15.49:0/3552679982 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c00e070 con 0x7f81a415d030 2023-11-30T17:22:52.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.469+0000 7f81a2ffd700 1 -- 172.21.15.49:0/3552679982 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819c00bab0 con 0x7f81a415d030 2023-11-30T17:22:52.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.469+0000 7f81a2ffd700 1 -- 172.21.15.49:0/3552679982 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c00be30 con 0x7f81a415d030 2023-11-30T17:22:52.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.469+0000 7f81a97d6700 1 -- 172.21.15.49:0/3552679982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81a415d030 msgr2=0x7f81a40654e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:52.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.469+0000 7f81a97d6700 1 --2- 172.21.15.49:0/3552679982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81a415d030 0x7f81a40654e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f819c009e60 tx=0x7f819c009780).stop 2023-11-30T17:22:52.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.469+0000 7f81a97d6700 1 -- 172.21.15.49:0/3552679982 shutdown_connections 2023-11-30T17:22:52.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.469+0000 7f81a97d6700 1 --2- 172.21.15.49:0/3552679982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81a415d030 0x7f81a40654e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:52.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.469+0000 7f81a97d6700 1 --2- 172.21.15.49:0/3552679982 >> v2:172.21.15.115:3300/0 conn(0x7f81a4158820 0x7f81a40a67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:52.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.469+0000 7f81a97d6700 1 -- 172.21.15.49:0/3552679982 >> 172.21.15.49:0/3552679982 conn(0x7f81a40c4010 msgr2=0x7f81a40c4420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:52.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.470+0000 7f81a97d6700 1 -- 172.21.15.49:0/3552679982 shutdown_connections 2023-11-30T17:22:52.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.470+0000 7f81a97d6700 1 -- 172.21.15.49:0/3552679982 wait complete. 2023-11-30T17:22:52.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.471+0000 7f81a97d6700 1 Processor -- start 2023-11-30T17:22:52.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.471+0000 7f81a97d6700 1 -- start start 2023-11-30T17:22:52.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.472+0000 7f81a97d6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81a4158820 0x7f81a4156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:52.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.472+0000 7f81a97d6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81a415c4a0 0x7f81a415b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:52.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.472+0000 7f81a97d6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81a415d030 0x7f81a415b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:52.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.472+0000 7f81a97d6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a40a9630 con 0x7f81a4158820 2023-11-30T17:22:52.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.472+0000 7f81a97d6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a415ba70 con 0x7f81a415c4a0 2023-11-30T17:22:52.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.472+0000 7f81a97d6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a40a8a20 con 0x7f81a415d030 2023-11-30T17:22:52.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.472+0000 7f81a3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81a4158820 0x7f81a4156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:52.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.472+0000 7f81a3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81a4158820 0x7f81a4156900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56984/0 (socket says 172.21.15.49:56984) 2023-11-30T17:22:52.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.472+0000 7f81a3fff700 1 -- 172.21.15.49:0/3911326574 learned_addr learned my addr 172.21.15.49:0/3911326574 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:52.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.472+0000 7f81a37fe700 1 --2- 172.21.15.49:0/3911326574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81a415c4a0 0x7f81a415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:52.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.472+0000 7f81a8fd5700 1 --2- 172.21.15.49:0/3911326574 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81a415d030 0x7f81a415b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:52.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.472+0000 7f81a3fff700 1 -- 172.21.15.49:0/3911326574 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81a415d030 msgr2=0x7f81a415b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:52.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.472+0000 7f81a3fff700 1 --2- 172.21.15.49:0/3911326574 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81a415d030 0x7f81a415b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:52.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.472+0000 7f81a3fff700 1 -- 172.21.15.49:0/3911326574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81a415c4a0 msgr2=0x7f81a415b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:52.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.472+0000 7f81a3fff700 1 --2- 172.21.15.49:0/3911326574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81a415c4a0 0x7f81a415b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:52.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.472+0000 7f81a3fff700 1 -- 172.21.15.49:0/3911326574 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c009a20 con 0x7f81a4158820 2023-11-30T17:22:52.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.472+0000 7f81a3fff700 1 --2- 172.21.15.49:0/3911326574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81a4158820 0x7f81a4156900 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f819800e930 tx=0x7f8198009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:52.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.472+0000 7f818bfff700 1 -- 172.21.15.49:0/3911326574 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8198012600 con 0x7f81a4158820 2023-11-30T17:22:52.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.472+0000 7f818bfff700 1 -- 172.21.15.49:0/3911326574 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8198012760 con 0x7f81a4158820 2023-11-30T17:22:52.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.472+0000 7f81a97d6700 1 -- 172.21.15.49:0/3911326574 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a40a8d00 con 0x7f81a4158820 2023-11-30T17:22:52.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.472+0000 7f818bfff700 1 -- 172.21.15.49:0/3911326574 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8198012ae0 con 0x7f81a4158820 2023-11-30T17:22:52.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.472+0000 7f81a97d6700 1 -- 172.21.15.49:0/3911326574 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a40a92c0 con 0x7f81a4158820 2023-11-30T17:22:52.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.473+0000 7f81a97d6700 1 -- 172.21.15.49:0/3911326574 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a4158c90 con 0x7f81a4158820 2023-11-30T17:22:52.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.474+0000 7f818bfff700 1 -- 172.21.15.49:0/3911326574 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f819801b400 con 0x7f81a4158820 2023-11-30T17:22:52.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.474+0000 7f818bfff700 1 --2- 172.21.15.49:0/3911326574 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f819005f270 0x7f8190061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:52.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.474+0000 7f818bfff700 1 -- 172.21.15.49:0/3911326574 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5856+0+0 (secure 0 0 0) 0x7f819807a6a0 con 0x7f81a4158820 2023-11-30T17:22:52.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.474+0000 7f81a37fe700 1 --2- 172.21.15.49:0/3911326574 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f819005f270 0x7f8190061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:52.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.475+0000 7f81a37fe700 1 --2- 172.21.15.49:0/3911326574 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f819005f270 0x7f8190061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f81a40a98a0 tx=0x7f8194009040).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:52.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.478+0000 7f818bfff700 1 -- 172.21.15.49:0/3911326574 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f819804b8a0 con 0x7f81a4158820 2023-11-30T17:22:52.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:52.664+0000 7f81a97d6700 1 -- 172.21.15.49:0/3911326574 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f81a406c7c0 con 0x7f81a4158820 2023-11-30T17:22:53.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.448+0000 7f818bfff700 1 -- 172.21.15.49:0/3911326574 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v94) v1 ==== 97+0+0 (secure 0 0 0) 0x7f819804eec0 con 0x7f81a4158820 2023-11-30T17:22:53.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.450+0000 7f81a97d6700 1 -- 172.21.15.49:0/3911326574 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f819005f270 msgr2=0x7f8190061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:53.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.450+0000 7f81a97d6700 1 --2- 172.21.15.49:0/3911326574 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f819005f270 0x7f8190061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f81a40a98a0 tx=0x7f8194009040).stop 2023-11-30T17:22:53.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.450+0000 7f81a97d6700 1 -- 172.21.15.49:0/3911326574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81a4158820 msgr2=0x7f81a4156900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:53.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.450+0000 7f81a97d6700 1 --2- 172.21.15.49:0/3911326574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81a4158820 0x7f81a4156900 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f819800e930 tx=0x7f8198009060).stop 2023-11-30T17:22:53.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.450+0000 7f81a97d6700 1 -- 172.21.15.49:0/3911326574 shutdown_connections 2023-11-30T17:22:53.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.450+0000 7f81a97d6700 1 --2- 172.21.15.49:0/3911326574 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81a415d030 0x7f81a415b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:53.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.450+0000 7f81a97d6700 1 --2- 172.21.15.49:0/3911326574 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f819005f270 0x7f8190061730 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:53.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.450+0000 7f81a97d6700 1 --2- 172.21.15.49:0/3911326574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81a4158820 0x7f81a4156900 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:53.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.450+0000 7f81a97d6700 1 --2- 172.21.15.49:0/3911326574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81a415c4a0 0x7f81a415b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:53.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.450+0000 7f81a97d6700 1 -- 172.21.15.49:0/3911326574 >> 172.21.15.49:0/3911326574 conn(0x7f81a40c4010 msgr2=0x7f81a40c2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:53.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.450+0000 7f81a97d6700 1 -- 172.21.15.49:0/3911326574 shutdown_connections 2023-11-30T17:22:53.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.450+0000 7f81a97d6700 1 -- 172.21.15.49:0/3911326574 wait complete. 2023-11-30T17:22:53.453 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2023-11-30T17:22:53.465 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-30T17:22:53.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.583+0000 7f262ac80700 1 Processor -- start 2023-11-30T17:22:53.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.583+0000 7f262ac80700 1 -- start start 2023-11-30T17:22:53.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.584+0000 7f262ac80700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26240caab0 0x7f26240aa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:53.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.584+0000 7f262ac80700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f26240ca180 0x7f262415e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:53.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.584+0000 7f262ac80700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26240a9a90 con 0x7f26240cae90 2023-11-30T17:22:53.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.584+0000 7f262ac80700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2624154ce0 con 0x7f26240ca180 2023-11-30T17:22:53.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.584+0000 7f262ac80700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26240a8e80 con 0x7f26240caab0 2023-11-30T17:22:53.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.584+0000 7f2623fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f26240cae90 0x7f26240c0ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42002/0 (socket says 172.21.15.49:42002) 2023-11-30T17:22:53.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.584+0000 7f2623fff700 1 -- 172.21.15.49:0/2610698958 learned_addr learned my addr 172.21.15.49:0/2610698958 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:53.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.584+0000 7f26237fe700 1 -- 172.21.15.49:0/2610698958 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144022466 0 0) 0x7f26240a9a90 con 0x7f26240cae90 2023-11-30T17:22:53.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.584+0000 7f26237fe700 1 -- 172.21.15.49:0/2610698958 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26100033f0 con 0x7f26240cae90 2023-11-30T17:22:53.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.584+0000 7f2628a1c700 1 --2- 172.21.15.49:0/2610698958 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26240caab0 0x7f26240aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:53.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.584+0000 7f262921d700 1 --2- 172.21.15.49:0/2610698958 >> v2:172.21.15.115:3300/0 conn(0x7f26240ca180 0x7f262415e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:53.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.584+0000 7f26237fe700 1 -- 172.21.15.49:0/2610698958 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 229242850 0 0) 0x7f26100033f0 con 0x7f26240cae90 2023-11-30T17:22:53.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.584+0000 7f26237fe700 1 -- 172.21.15.49:0/2610698958 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26240caab0 msgr2=0x7f26240aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:53.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.584+0000 7f26237fe700 1 --2- 172.21.15.49:0/2610698958 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26240caab0 0x7f26240aa470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:53.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.584+0000 7f26237fe700 1 -- 172.21.15.49:0/2610698958 >> v2:172.21.15.115:3300/0 conn(0x7f26240ca180 msgr2=0x7f262415e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:53.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.584+0000 7f26237fe700 1 --2- 172.21.15.49:0/2610698958 >> v2:172.21.15.115:3300/0 conn(0x7f26240ca180 0x7f262415e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:53.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.584+0000 7f26237fe700 1 -- 172.21.15.49:0/2610698958 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26240a9160 con 0x7f26240cae90 2023-11-30T17:22:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.584+0000 7f26237fe700 1 -- 172.21.15.49:0/2610698958 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f260c001470 con 0x7f26240cae90 2023-11-30T17:22:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.584+0000 7f26237fe700 1 -- 172.21.15.49:0/2610698958 >> v1:172.21.15.49:6789/0 conn(0x7f26240cae90 legacy=0x7f26240c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.584+0000 7f26237fe700 1 --2- 172.21.15.49:0/2610698958 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26100038e0 0x7f2610003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.584+0000 7f26237fe700 1 --2- 172.21.15.49:0/2610698958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2610004690 0x7f2610004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.584+0000 7f26237fe700 1 --2- 172.21.15.49:0/2610698958 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26240caab0 0x7f2610005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.584+0000 7f26237fe700 1 -- 172.21.15.49:0/2610698958 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2624154ce0 con 0x7f2610004690 2023-11-30T17:22:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.584+0000 7f26237fe700 1 -- 172.21.15.49:0/2610698958 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26240a8e80 con 0x7f26100038e0 2023-11-30T17:22:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.584+0000 7f26237fe700 1 -- 172.21.15.49:0/2610698958 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261000b8e0 con 0x7f26240caab0 2023-11-30T17:22:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.585+0000 7f2623fff700 1 --2- 172.21.15.49:0/2610698958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2610004690 0x7f2610004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.585+0000 7f2628a1c700 1 --2- 172.21.15.49:0/2610698958 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26100038e0 0x7f2610003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.585+0000 7f262921d700 1 --2- 172.21.15.49:0/2610698958 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26240caab0 0x7f2610005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.585+0000 7f2623fff700 1 -- 172.21.15.49:0/2610698958 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26240caab0 msgr2=0x7f2610005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.585+0000 7f2623fff700 1 --2- 172.21.15.49:0/2610698958 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26240caab0 0x7f2610005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:53.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.585+0000 7f2623fff700 1 -- 172.21.15.49:0/2610698958 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26100038e0 msgr2=0x7f2610003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:53.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.585+0000 7f2623fff700 1 --2- 172.21.15.49:0/2610698958 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26100038e0 0x7f2610003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:53.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.585+0000 7f2623fff700 1 -- 172.21.15.49:0/2610698958 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26100033f0 con 0x7f2610004690 2023-11-30T17:22:53.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.585+0000 7f262921d700 1 --2- 172.21.15.49:0/2610698958 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26240caab0 0x7f2610005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:53.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.585+0000 7f2623fff700 1 --2- 172.21.15.49:0/2610698958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2610004690 0x7f2610004b10 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f26240b1440 tx=0x7f260c0077c0).ready entity=mon.0 client_cookie=e9d0c9be6d9a8e8a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:53.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.585+0000 7f26237fe700 1 -- 172.21.15.49:0/2610698958 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c00cab0 con 0x7f2610004690 2023-11-30T17:22:53.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.585+0000 7f26237fe700 1 -- 172.21.15.49:0/2610698958 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260c00cc10 con 0x7f2610004690 2023-11-30T17:22:53.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.585+0000 7f26237fe700 1 -- 172.21.15.49:0/2610698958 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c0070d0 con 0x7f2610004690 2023-11-30T17:22:53.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.586+0000 7f262ac80700 1 -- 172.21.15.49:0/2610698958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2610004690 msgr2=0x7f2610004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:53.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.586+0000 7f262ac80700 1 --2- 172.21.15.49:0/2610698958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2610004690 0x7f2610004b10 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f26240b1440 tx=0x7f260c0077c0).stop 2023-11-30T17:22:53.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.586+0000 7f262921d700 1 -- 172.21.15.49:0/2610698958 reap_dead start 2023-11-30T17:22:53.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.586+0000 7f262ac80700 1 -- 172.21.15.49:0/2610698958 shutdown_connections 2023-11-30T17:22:53.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.586+0000 7f262ac80700 1 -- 172.21.15.49:0/2610698958 >> 172.21.15.49:0/2610698958 conn(0x7f2624094920 msgr2=0x7f262406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:53.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.586+0000 7f262ac80700 1 -- 172.21.15.49:0/2610698958 shutdown_connections 2023-11-30T17:22:53.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.586+0000 7f262ac80700 1 -- 172.21.15.49:0/2610698958 wait complete. 2023-11-30T17:22:53.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.587+0000 7f262ac80700 1 Processor -- start 2023-11-30T17:22:53.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.587+0000 7f262ac80700 1 -- start start 2023-11-30T17:22:53.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.588+0000 7f262ac80700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2610004690 0x7f26240c6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:53.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.588+0000 7f262ac80700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26240c51d0 0x7f26240c9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:53.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.588+0000 7f262ac80700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26240c7fb0 0x7f26241678c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:53.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.588+0000 7f262ac80700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26240c94f0 con 0x7f26240c7fb0 2023-11-30T17:22:53.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.588+0000 7f262ac80700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26240c88e0 con 0x7f26240c51d0 2023-11-30T17:22:53.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.588+0000 7f262ac80700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26240c8bc0 con 0x7f2610004690 2023-11-30T17:22:53.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.588+0000 7f262921d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26240c7fb0 0x7f26241678c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:53.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.588+0000 7f262921d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26240c7fb0 0x7f26241678c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57002/0 (socket says 172.21.15.49:57002) 2023-11-30T17:22:53.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.588+0000 7f262921d700 1 -- 172.21.15.49:0/625790124 learned_addr learned my addr 172.21.15.49:0/625790124 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:53.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.588+0000 7f2623fff700 1 --2- 172.21.15.49:0/625790124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26240c51d0 0x7f26240c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:53.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.588+0000 7f2628a1c700 1 --2- 172.21.15.49:0/625790124 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2610004690 0x7f26240c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:53.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.588+0000 7f262921d700 1 -- 172.21.15.49:0/625790124 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2610004690 msgr2=0x7f26240c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:53.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.588+0000 7f262921d700 1 --2- 172.21.15.49:0/625790124 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2610004690 0x7f26240c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:53.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.588+0000 7f262921d700 1 -- 172.21.15.49:0/625790124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26240c51d0 msgr2=0x7f26240c9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:53.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.588+0000 7f262921d700 1 --2- 172.21.15.49:0/625790124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26240c51d0 0x7f26240c9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:53.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.588+0000 7f262921d700 1 -- 172.21.15.49:0/625790124 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26240c8ea0 con 0x7f26240c7fb0 2023-11-30T17:22:53.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.588+0000 7f262921d700 1 --2- 172.21.15.49:0/625790124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26240c7fb0 0x7f26241678c0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f262405e5a0 tx=0x7f261400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:53.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.588+0000 7f2620ff9700 1 -- 172.21.15.49:0/625790124 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261400e030 con 0x7f26240c7fb0 2023-11-30T17:22:53.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.588+0000 7f2620ff9700 1 -- 172.21.15.49:0/625790124 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261400f040 con 0x7f26240c7fb0 2023-11-30T17:22:53.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.588+0000 7f262ac80700 1 -- 172.21.15.49:0/625790124 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26240c9180 con 0x7f26240c7fb0 2023-11-30T17:22:53.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.588+0000 7f2620ff9700 1 -- 172.21.15.49:0/625790124 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2614010dd0 con 0x7f26240c7fb0 2023-11-30T17:22:53.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.589+0000 7f262ac80700 1 -- 172.21.15.49:0/625790124 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26240c5650 con 0x7f26240c7fb0 2023-11-30T17:22:53.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.589+0000 7f262ac80700 1 -- 172.21.15.49:0/625790124 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f262406c860 con 0x7f26240c7fb0 2023-11-30T17:22:53.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.590+0000 7f2620ff9700 1 -- 172.21.15.49:0/625790124 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f2614015690 con 0x7f26240c7fb0 2023-11-30T17:22:53.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.590+0000 7f2620ff9700 1 --2- 172.21.15.49:0/625790124 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f260405f270 0x7f2604061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:53.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.590+0000 7f2620ff9700 1 -- 172.21.15.49:0/625790124 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5297+0+0 (secure 0 0 0) 0x7f261407a900 con 0x7f26240c7fb0 2023-11-30T17:22:53.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.590+0000 7f2628a1c700 1 --2- 172.21.15.49:0/625790124 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f260405f270 0x7f2604061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:53.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.591+0000 7f2628a1c700 1 --2- 172.21.15.49:0/625790124 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f260405f270 0x7f2604061730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f261c006d20 tx=0x7f261c006f40).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:53.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.594+0000 7f2620ff9700 1 -- 172.21.15.49:0/625790124 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f261404bd20 con 0x7f26240c7fb0 2023-11-30T17:22:53.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.834+0000 7f262ac80700 1 -- 172.21.15.49:0/625790124 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f26240a9440 con 0x7f26240c7fb0 2023-11-30T17:22:53.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.834+0000 7f2620ff9700 1 -- 172.21.15.49:0/625790124 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f261404f340 con 0x7f26240c7fb0 2023-11-30T17:22:53.837 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:53.837 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T17:22:53.837 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2023-11-30T17:22:53.837 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:53.837 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2023-11-30T17:22:53.837 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlwm1FHxAAk+s9c60UZ5jB37wbpGzlcg==", 2023-11-30T17:22:53.837 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:53.837 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:22:53.837 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:22:53.838 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:22:53.838 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:22:53.838 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:53.838 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:53.838 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:53.838 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2023-11-30T17:22:53.838 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlADm0KhAArffesGGTXzQwY4NPnJ1Bjw==", 2023-11-30T17:22:53.838 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:53.838 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:22:53.838 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:22:53.838 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:22:53.838 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:22:53.838 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:53.838 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:53.839 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:53.839 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2023-11-30T17:22:53.839 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlYnY1JhAA+Lurauug0NhWnK8aZErR3g==", 2023-11-30T17:22:53.839 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:53.839 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:22:53.839 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:22:53.839 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:22:53.839 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:22:53.839 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:53.839 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:53.839 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:53.839 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2023-11-30T17:22:53.839 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlQdKCMRAA3h4O2NqkQ2zE3DxOqBoaQQ==", 2023-11-30T17:22:53.839 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:53.839 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:22:53.840 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:22:53.840 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:22:53.840 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:22:53.840 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:53.840 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:53.840 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:53.840 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2023-11-30T17:22:53.840 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAPwWhlGdbhFxAAOspNRLMhR59LSWatFbsYDA==", 2023-11-30T17:22:53.840 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:53.840 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:22:53.840 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:22:53.840 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:22:53.840 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:53.840 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:53.841 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:53.841 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2023-11-30T17:22:53.841 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQASwWhlfwUEFxAAuj0L8ooIGi1vsb7XWLVlDA==", 2023-11-30T17:22:53.841 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:53.841 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:22:53.841 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:22:53.841 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:22:53.841 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:53.841 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:53.841 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:53.841 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2023-11-30T17:22:53.841 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAVwWhl7XYwFBAAuSHZqdfRR8V1Y+hmPT5uuw==", 2023-11-30T17:22:53.841 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:53.841 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:22:53.841 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:22:53.842 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:22:53.842 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:53.842 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:53.842 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:53.842 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2023-11-30T17:22:53.842 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAYwWhlkhRCFRAAe3cRLcrhJ3ZoluXuRUhmew==", 2023-11-30T17:22:53.842 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:53.843 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:22:53.843 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:22:53.843 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:22:53.843 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:53.843 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:53.843 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:53.843 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2023-11-30T17:22:53.843 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAewWhlrq4qFBAAOSdqozO8iH25BQFrPI1SRQ==", 2023-11-30T17:22:53.843 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:53.843 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:22:53.843 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:22:53.843 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:22:53.843 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:53.843 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:53.843 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:53.844 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2023-11-30T17:22:53.844 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAhwWhlZL9WERAA90znWBLNuY5eem3yF6O0wg==", 2023-11-30T17:22:53.844 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:53.844 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:22:53.844 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:22:53.844 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:22:53.844 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:53.844 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:53.844 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:53.844 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2023-11-30T17:22:53.844 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAkwWhlCJDiEBAAETLCBNCdaWXFgkPPaulTAA==", 2023-11-30T17:22:53.844 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:53.844 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:22:53.844 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:22:53.845 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:22:53.845 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:53.845 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:53.845 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:53.845 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2023-11-30T17:22:53.845 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAnwWhl+IiYEBAAcI3AU5xrv0cYy9lckyu0dQ==", 2023-11-30T17:22:53.845 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:53.845 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:22:53.845 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:22:53.845 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:22:53.845 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:53.845 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:53.845 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:53.845 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2023-11-30T17:22:53.845 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhleYZcNRAA5PoPChH+s6XfbrQ0hmu2NA==", 2023-11-30T17:22:53.846 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:53.846 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:22:53.846 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2023-11-30T17:22:53.846 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-30T17:22:53.846 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:53.846 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:53.846 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:53.846 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2023-11-30T17:22:53.846 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAOwWhlFhcfAhAAzaBDtyRxuqeQ9BatfgUuXw==", 2023-11-30T17:22:53.846 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:53.846 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:22:53.846 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T17:22:53.846 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T17:22:53.846 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T17:22:53.847 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:53.847 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:53.847 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:53.847 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2023-11-30T17:22:53.847 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlLZrDOhAAHG/dYWYmPouk3+Iqafr7qw==", 2023-11-30T17:22:53.847 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:53.847 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:22:53.847 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T17:22:53.847 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T17:22:53.847 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T17:22:53.847 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:53.847 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:53.847 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:53.847 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2023-11-30T17:22:53.847 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAOwWhl6lxuBxAA/YXQDo+U2ppULGzK054Gzg==", 2023-11-30T17:22:53.848 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:53.848 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:22:53.848 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T17:22:53.848 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T17:22:53.848 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T17:22:53.848 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:53.848 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:53.848 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:53.848 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2023-11-30T17:22:53.848 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhl4JkLAxAAiaLgZ5eiazaT9VanG5ihyQ==", 2023-11-30T17:22:53.848 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:53.848 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T17:22:53.848 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:22:53.848 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:22:53.848 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:22:53.848 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:53.849 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:53.849 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:53.849 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2023-11-30T17:22:53.849 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlH1s2HBAA3ea9Utfv7fZoo2hO+ElDVQ==", 2023-11-30T17:22:53.849 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:53.849 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T17:22:53.849 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-11-30T17:22:53.849 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:22:53.849 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:53.849 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:53.849 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:53.849 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2023-11-30T17:22:53.849 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlpy+fFxAA3qmboR+PlQtK6T35ryj+Lw==", 2023-11-30T17:22:53.849 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:22:53.849 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T17:22:53.850 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-11-30T17:22:53.850 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:22:53.850 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:53.850 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:53.850 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-11-30T17:22:53.850 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T17:22:53.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.836+0000 7f262ac80700 1 -- 172.21.15.49:0/625790124 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f260405f270 msgr2=0x7f2604061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:53.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.836+0000 7f262ac80700 1 --2- 172.21.15.49:0/625790124 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f260405f270 0x7f2604061730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f261c006d20 tx=0x7f261c006f40).stop 2023-11-30T17:22:53.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.836+0000 7f262ac80700 1 -- 172.21.15.49:0/625790124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26240c7fb0 msgr2=0x7f26241678c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:53.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.836+0000 7f262ac80700 1 --2- 172.21.15.49:0/625790124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26240c7fb0 0x7f26241678c0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f262405e5a0 tx=0x7f261400b040).stop 2023-11-30T17:22:53.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.836+0000 7f262ac80700 1 -- 172.21.15.49:0/625790124 shutdown_connections 2023-11-30T17:22:53.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.836+0000 7f262ac80700 1 --2- 172.21.15.49:0/625790124 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f260405f270 0x7f2604061730 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:53.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.836+0000 7f262ac80700 1 --2- 172.21.15.49:0/625790124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26240c7fb0 0x7f26241678c0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:53.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.836+0000 7f262ac80700 1 --2- 172.21.15.49:0/625790124 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2610004690 0x7f26240c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:53.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.836+0000 7f262ac80700 1 --2- 172.21.15.49:0/625790124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26240c51d0 0x7f26240c9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:53.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.836+0000 7f262ac80700 1 -- 172.21.15.49:0/625790124 >> 172.21.15.49:0/625790124 conn(0x7f2624094920 msgr2=0x7f2624064110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:53.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.836+0000 7f262ac80700 1 -- 172.21.15.49:0/625790124 shutdown_connections 2023-11-30T17:22:53.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.836+0000 7f262ac80700 1 -- 172.21.15.49:0/625790124 wait complete. 2023-11-30T17:22:53.853 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:22:53.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.969+0000 7f6ca2fd1700 1 Processor -- start 2023-11-30T17:22:53.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.969+0000 7f6ca2fd1700 1 -- start start 2023-11-30T17:22:53.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.970+0000 7f6ca2fd1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6c9c1544e0 0x7f6c9c1548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:53.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.970+0000 7f6ca2fd1700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6c9c06a610 0x7f6c9c0c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:53.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.970+0000 7f6ca2fd1700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c9c0c69a0 con 0x7f6c9c0c6e30 2023-11-30T17:22:53.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.970+0000 7f6ca2fd1700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c9c0c13a0 con 0x7f6c9c1544e0 2023-11-30T17:22:53.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.970+0000 7f6ca2fd1700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c9c0c1680 con 0x7f6c9c06a610 2023-11-30T17:22:53.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.970+0000 7f6ca0d6d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6c9c1544e0 0x7f6c9c1548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:53.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.970+0000 7f6ca156e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6c9c0c6e30 0x7f6c9c0a8000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42006/0 (socket says 172.21.15.49:42006) 2023-11-30T17:22:53.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.970+0000 7f6ca156e700 1 -- 172.21.15.49:0/496615613 learned_addr learned my addr 172.21.15.49:0/496615613 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:53.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.971+0000 7f6c9bfff700 1 --2- 172.21.15.49:0/496615613 >> v2:172.21.15.115:3300/0 conn(0x7f6c9c06a610 0x7f6c9c0c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:53.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.971+0000 7f6ca0d6d700 1 -- 172.21.15.49:0/496615613 >> v2:172.21.15.115:3300/0 conn(0x7f6c9c06a610 msgr2=0x7f6c9c0c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:53.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.971+0000 7f6ca0d6d700 1 --2- 172.21.15.49:0/496615613 >> v2:172.21.15.115:3300/0 conn(0x7f6c9c06a610 0x7f6c9c0c0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:53.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.971+0000 7f6ca0d6d700 1 -- 172.21.15.49:0/496615613 >> v1:172.21.15.49:6789/0 conn(0x7f6c9c0c6e30 legacy=0x7f6c9c0a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:53.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.971+0000 7f6ca0d6d700 1 -- 172.21.15.49:0/496615613 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9c0c6630 con 0x7f6c9c1544e0 2023-11-30T17:22:53.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.971+0000 7f6c9b7fe700 1 -- 172.21.15.49:0/496615613 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 502616819 0 0) 0x7f6c9c0c69a0 con 0x7f6c9c0c6e30 2023-11-30T17:22:53.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.971+0000 7f6ca0d6d700 1 --2- 172.21.15.49:0/496615613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c9c1544e0 0x7f6c9c1548c0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f6c9c084fb0 tx=0x7f6c94006f40).ready entity=mon.0 client_cookie=41f29c3ab61462a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:53.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.971+0000 7f6c9b7fe700 1 -- 172.21.15.49:0/496615613 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c94005880 con 0x7f6c9c1544e0 2023-11-30T17:22:53.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.971+0000 7f6c9b7fe700 1 -- 172.21.15.49:0/496615613 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c940059e0 con 0x7f6c9c1544e0 2023-11-30T17:22:53.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.971+0000 7f6c9b7fe700 1 -- 172.21.15.49:0/496615613 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c94005d60 con 0x7f6c9c1544e0 2023-11-30T17:22:53.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.971+0000 7f6ca2fd1700 1 -- 172.21.15.49:0/496615613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c9c1544e0 msgr2=0x7f6c9c1548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:53.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.971+0000 7f6ca2fd1700 1 --2- 172.21.15.49:0/496615613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c9c1544e0 0x7f6c9c1548c0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f6c9c084fb0 tx=0x7f6c94006f40).stop 2023-11-30T17:22:53.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.972+0000 7f6ca2fd1700 1 -- 172.21.15.49:0/496615613 shutdown_connections 2023-11-30T17:22:53.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.972+0000 7f6ca2fd1700 1 --2- 172.21.15.49:0/496615613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c9c1544e0 0x7f6c9c1548c0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:53.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.972+0000 7f6ca2fd1700 1 --2- 172.21.15.49:0/496615613 >> v2:172.21.15.115:3300/0 conn(0x7f6c9c06a610 0x7f6c9c0c0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:53.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.972+0000 7f6ca2fd1700 1 -- 172.21.15.49:0/496615613 >> 172.21.15.49:0/496615613 conn(0x7f6c9c085020 msgr2=0x7f6c9c094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:53.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.972+0000 7f6ca2fd1700 1 -- 172.21.15.49:0/496615613 shutdown_connections 2023-11-30T17:22:53.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.972+0000 7f6ca2fd1700 1 -- 172.21.15.49:0/496615613 wait complete. 2023-11-30T17:22:53.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.973+0000 7f6ca2fd1700 1 Processor -- start 2023-11-30T17:22:53.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.973+0000 7f6ca2fd1700 1 -- start start 2023-11-30T17:22:53.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.974+0000 7f6ca2fd1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c9c06a610 0x7f6c9c152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:53.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.974+0000 7f6ca2fd1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c9c0c6e30 0x7f6c9c14fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:53.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.974+0000 7f6ca2fd1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c9c1544e0 0x7f6c9c0950a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:53.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.974+0000 7f6ca2fd1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c0964c0 con 0x7f6c9c0c6e30 2023-11-30T17:22:53.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.974+0000 7f6ca2fd1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c150280 con 0x7f6c9c1544e0 2023-11-30T17:22:53.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.974+0000 7f6ca2fd1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c0958b0 con 0x7f6c9c06a610 2023-11-30T17:22:53.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.974+0000 7f6c9bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c9c0c6e30 0x7f6c9c14fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:53.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.974+0000 7f6c9bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c9c0c6e30 0x7f6c9c14fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57022/0 (socket says 172.21.15.49:57022) 2023-11-30T17:22:53.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.974+0000 7f6c9bfff700 1 -- 172.21.15.49:0/3724417399 learned_addr learned my addr 172.21.15.49:0/3724417399 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:53.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.974+0000 7f6ca156e700 1 --2- 172.21.15.49:0/3724417399 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c9c1544e0 0x7f6c9c0950a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:53.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.974+0000 7f6ca0d6d700 1 --2- 172.21.15.49:0/3724417399 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c9c06a610 0x7f6c9c152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:53.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.974+0000 7f6c9bfff700 1 -- 172.21.15.49:0/3724417399 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c9c06a610 msgr2=0x7f6c9c152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:53.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.974+0000 7f6c9bfff700 1 --2- 172.21.15.49:0/3724417399 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c9c06a610 0x7f6c9c152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:53.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.974+0000 7f6c9bfff700 1 -- 172.21.15.49:0/3724417399 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c9c1544e0 msgr2=0x7f6c9c0950a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:53.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.974+0000 7f6c9bfff700 1 --2- 172.21.15.49:0/3724417399 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c9c1544e0 0x7f6c9c0950a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:53.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.974+0000 7f6c9bfff700 1 -- 172.21.15.49:0/3724417399 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c94009250 con 0x7f6c9c0c6e30 2023-11-30T17:22:53.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.974+0000 7f6ca156e700 1 --2- 172.21.15.49:0/3724417399 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c9c1544e0 0x7f6c9c0950a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:53.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.974+0000 7f6ca0d6d700 1 --2- 172.21.15.49:0/3724417399 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c9c06a610 0x7f6c9c152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:53.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.974+0000 7f6c9bfff700 1 --2- 172.21.15.49:0/3724417399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c9c0c6e30 0x7f6c9c14fd90 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f6c8c009fa0 tx=0x7f6c8c009880).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:53.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.974+0000 7f6c98ff9700 1 -- 172.21.15.49:0/3724417399 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c00ed20 con 0x7f6c9c0c6e30 2023-11-30T17:22:53.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.974+0000 7f6c98ff9700 1 -- 172.21.15.49:0/3724417399 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8c00ee80 con 0x7f6c9c0c6e30 2023-11-30T17:22:53.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.974+0000 7f6ca2fd1700 1 -- 172.21.15.49:0/3724417399 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c9c095b90 con 0x7f6c9c0c6e30 2023-11-30T17:22:53.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.974+0000 7f6c98ff9700 1 -- 172.21.15.49:0/3724417399 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c014610 con 0x7f6c9c0c6e30 2023-11-30T17:22:53.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.974+0000 7f6ca2fd1700 1 -- 172.21.15.49:0/3724417399 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c9c096150 con 0x7f6c9c0c6e30 2023-11-30T17:22:53.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.975+0000 7f6ca2fd1700 1 -- 172.21.15.49:0/3724417399 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c9c096670 con 0x7f6c9c0c6e30 2023-11-30T17:22:53.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.976+0000 7f6c98ff9700 1 -- 172.21.15.49:0/3724417399 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6c8c01d3b0 con 0x7f6c9c0c6e30 2023-11-30T17:22:53.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.976+0000 7f6c98ff9700 1 --2- 172.21.15.49:0/3724417399 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6c7c05f270 0x7f6c7c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:53.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.976+0000 7f6c98ff9700 1 -- 172.21.15.49:0/3724417399 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5297+0+0 (secure 0 0 0) 0x7f6c8c07a4b0 con 0x7f6c9c0c6e30 2023-11-30T17:22:53.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.976+0000 7f6ca0d6d700 1 --2- 172.21.15.49:0/3724417399 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6c7c05f270 0x7f6c7c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:53.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.977+0000 7f6ca0d6d700 1 --2- 172.21.15.49:0/3724417399 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6c7c05f270 0x7f6c7c061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f6c94006fa0 tx=0x7f6c94016000).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:53.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:53.980+0000 7f6c98ff9700 1 -- 172.21.15.49:0/3724417399 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6c8c04b8d0 con 0x7f6c9c0c6e30 2023-11-30T17:22:54.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.152+0000 7f6ca2fd1700 1 -- 172.21.15.49:0/3724417399 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c9c0c10b0 con 0x7f6c9c0c6e30 2023-11-30T17:22:54.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.153+0000 7f6c98ff9700 1 -- 172.21.15.49:0/3724417399 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+13756 (secure 0 0 0) 0x7f6c8c04eef0 con 0x7f6c9c0c6e30 2023-11-30T17:22:54.155 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:54.155 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":94,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:22:53.446088+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:22:54.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.154+0000 7f6ca2fd1700 1 -- 172.21.15.49:0/3724417399 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6c7c05f270 msgr2=0x7f6c7c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:54.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.154+0000 7f6ca2fd1700 1 --2- 172.21.15.49:0/3724417399 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6c7c05f270 0x7f6c7c061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f6c94006fa0 tx=0x7f6c94016000).stop 2023-11-30T17:22:54.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.154+0000 7f6ca2fd1700 1 -- 172.21.15.49:0/3724417399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c9c0c6e30 msgr2=0x7f6c9c14fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:54.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.154+0000 7f6ca2fd1700 1 --2- 172.21.15.49:0/3724417399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c9c0c6e30 0x7f6c9c14fd90 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f6c8c009fa0 tx=0x7f6c8c009880).stop 2023-11-30T17:22:54.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.155+0000 7f6ca2fd1700 1 -- 172.21.15.49:0/3724417399 shutdown_connections 2023-11-30T17:22:54.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.155+0000 7f6ca2fd1700 1 --2- 172.21.15.49:0/3724417399 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c9c1544e0 0x7f6c9c0950a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:54.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.155+0000 7f6ca2fd1700 1 --2- 172.21.15.49:0/3724417399 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c9c06a610 0x7f6c9c152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:54.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.155+0000 7f6ca2fd1700 1 --2- 172.21.15.49:0/3724417399 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6c7c05f270 0x7f6c7c061730 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:54.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.155+0000 7f6ca2fd1700 1 --2- 172.21.15.49:0/3724417399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c9c0c6e30 0x7f6c9c14fd90 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:54.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.155+0000 7f6ca2fd1700 1 -- 172.21.15.49:0/3724417399 >> 172.21.15.49:0/3724417399 conn(0x7f6c9c085020 msgr2=0x7f6c9c094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:54.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.155+0000 7f6ca2fd1700 1 -- 172.21.15.49:0/3724417399 shutdown_connections 2023-11-30T17:22:54.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.155+0000 7f6ca2fd1700 1 -- 172.21.15.49:0/3724417399 wait complete. 2023-11-30T17:22:54.169 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-11-30T17:22:54.170 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T17:22:54.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.288+0000 7f3ac41d3700 1 Processor -- start 2023-11-30T17:22:54.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.288+0000 7f3ac41d3700 1 -- start start 2023-11-30T17:22:54.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.289+0000 7f3ac41d3700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3abc098d10 0x7f3abc0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:54.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.289+0000 7f3ac41d3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3abc0c6190 0x7f3abc063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:54.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.289+0000 7f3ac41d3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3abc064350 0x7f3abc158320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:54.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.289+0000 7f3ac41d3700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3abc0c72d0 con 0x7f3abc0c6190 2023-11-30T17:22:54.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.289+0000 7f3ac41d3700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3abc154bc0 con 0x7f3abc098d10 2023-11-30T17:22:54.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.289+0000 7f3ac41d3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc0c66c0 con 0x7f3abc064350 2023-11-30T17:22:54.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.289+0000 7f3ac176e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3abc0c6190 0x7f3abc063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:54.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.289+0000 7f3ac176e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3abc0c6190 0x7f3abc063e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57032/0 (socket says 172.21.15.49:57032) 2023-11-30T17:22:54.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.289+0000 7f3ac176e700 1 -- 172.21.15.49:0/850998800 learned_addr learned my addr 172.21.15.49:0/850998800 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:54.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.289+0000 7f3ac2770700 1 --2- 172.21.15.49:0/850998800 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3abc064350 0x7f3abc158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:54.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.289+0000 7f3ac1f6f700 1 --2- 172.21.15.49:0/850998800 >> v2:172.21.15.115:3300/0 conn(0x7f3abc098d10 0x7f3abc0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:54.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.289+0000 7f3ac176e700 1 -- 172.21.15.49:0/850998800 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3abc064350 msgr2=0x7f3abc158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:54.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.289+0000 7f3ac176e700 1 --2- 172.21.15.49:0/850998800 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3abc064350 0x7f3abc158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:54.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.289+0000 7f3ac176e700 1 -- 172.21.15.49:0/850998800 >> v2:172.21.15.115:3300/0 conn(0x7f3abc098d10 msgr2=0x7f3abc0c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:54.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.289+0000 7f3ac176e700 1 --2- 172.21.15.49:0/850998800 >> v2:172.21.15.115:3300/0 conn(0x7f3abc098d10 0x7f3abc0c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:54.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.289+0000 7f3ac176e700 1 -- 172.21.15.49:0/850998800 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3abc0c69a0 con 0x7f3abc0c6190 2023-11-30T17:22:54.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.289+0000 7f3ac176e700 1 --2- 172.21.15.49:0/850998800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3abc0c6190 0x7f3abc063e60 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f3abc083f80 tx=0x7f3ab00090f0).ready entity=mon.0 client_cookie=3bbeae20d839f91f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:54.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.289+0000 7f3ac0f6d700 1 -- 172.21.15.49:0/850998800 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab000b600 con 0x7f3abc0c6190 2023-11-30T17:22:54.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.289+0000 7f3ac0f6d700 1 -- 172.21.15.49:0/850998800 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab000b760 con 0x7f3abc0c6190 2023-11-30T17:22:54.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.289+0000 7f3ac0f6d700 1 -- 172.21.15.49:0/850998800 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab000bae0 con 0x7f3abc0c6190 2023-11-30T17:22:54.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.290+0000 7f3ac41d3700 1 -- 172.21.15.49:0/850998800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3abc0c6190 msgr2=0x7f3abc063e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:54.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.290+0000 7f3ac41d3700 1 --2- 172.21.15.49:0/850998800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3abc0c6190 0x7f3abc063e60 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f3abc083f80 tx=0x7f3ab00090f0).stop 2023-11-30T17:22:54.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.290+0000 7f3ac41d3700 1 -- 172.21.15.49:0/850998800 shutdown_connections 2023-11-30T17:22:54.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.290+0000 7f3ac41d3700 1 --2- 172.21.15.49:0/850998800 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3abc064350 0x7f3abc158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:54.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.290+0000 7f3ac41d3700 1 --2- 172.21.15.49:0/850998800 >> v2:172.21.15.115:3300/0 conn(0x7f3abc098d10 0x7f3abc0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:54.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.290+0000 7f3ac41d3700 1 --2- 172.21.15.49:0/850998800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3abc0c6190 0x7f3abc063e60 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:54.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.290+0000 7f3ac41d3700 1 -- 172.21.15.49:0/850998800 >> 172.21.15.49:0/850998800 conn(0x7f3abc0cb310 msgr2=0x7f3abc0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:54.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.290+0000 7f3ac41d3700 1 -- 172.21.15.49:0/850998800 shutdown_connections 2023-11-30T17:22:54.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.290+0000 7f3ac41d3700 1 -- 172.21.15.49:0/850998800 wait complete. 2023-11-30T17:22:54.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.291+0000 7f3ac41d3700 1 Processor -- start 2023-11-30T17:22:54.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.291+0000 7f3ac41d3700 1 -- start start 2023-11-30T17:22:54.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.292+0000 7f3ac41d3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3abc064350 0x7f3abc154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:54.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.292+0000 7f3ac41d3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3abc098d10 0x7f3abc14ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:54.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.292+0000 7f3ac41d3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3abc0c6190 0x7f3abc165260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:54.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.292+0000 7f3ac41d3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc157450 con 0x7f3abc064350 2023-11-30T17:22:54.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.292+0000 7f3ac41d3700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc157730 con 0x7f3abc098d10 2023-11-30T17:22:54.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.292+0000 7f3ac41d3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc157a10 con 0x7f3abc0c6190 2023-11-30T17:22:54.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.292+0000 7f3ac1f6f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3abc064350 0x7f3abc154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:54.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.292+0000 7f3ac1f6f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3abc064350 0x7f3abc154dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57048/0 (socket says 172.21.15.49:57048) 2023-11-30T17:22:54.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.292+0000 7f3ac1f6f700 1 -- 172.21.15.49:0/1467933991 learned_addr learned my addr 172.21.15.49:0/1467933991 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:54.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.292+0000 7f3ac176e700 1 --2- 172.21.15.49:0/1467933991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3abc098d10 0x7f3abc14ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:54.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.292+0000 7f3ac2770700 1 --2- 172.21.15.49:0/1467933991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3abc0c6190 0x7f3abc165260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:54.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.292+0000 7f3ac1f6f700 1 -- 172.21.15.49:0/1467933991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3abc0c6190 msgr2=0x7f3abc165260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:54.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.292+0000 7f3ac1f6f700 1 --2- 172.21.15.49:0/1467933991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3abc0c6190 0x7f3abc165260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:54.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.292+0000 7f3ac1f6f700 1 -- 172.21.15.49:0/1467933991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3abc098d10 msgr2=0x7f3abc14ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:54.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.292+0000 7f3ac1f6f700 1 --2- 172.21.15.49:0/1467933991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3abc098d10 0x7f3abc14ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:54.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.292+0000 7f3ac1f6f700 1 -- 172.21.15.49:0/1467933991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab0009370 con 0x7f3abc064350 2023-11-30T17:22:54.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.292+0000 7f3ac1f6f700 1 --2- 172.21.15.49:0/1467933991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3abc064350 0x7f3abc154dc0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f3ab400d890 tx=0x7f3ab4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:54.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.292+0000 7f3ab9ffb700 1 -- 172.21.15.49:0/1467933991 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab40125f0 con 0x7f3abc064350 2023-11-30T17:22:54.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.293+0000 7f3ab9ffb700 1 -- 172.21.15.49:0/1467933991 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab4012750 con 0x7f3abc064350 2023-11-30T17:22:54.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.293+0000 7f3ab9ffb700 1 -- 172.21.15.49:0/1467933991 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab4012ad0 con 0x7f3abc064350 2023-11-30T17:22:54.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.293+0000 7f3ac41d3700 1 -- 172.21.15.49:0/1467933991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3abc0af840 con 0x7f3abc064350 2023-11-30T17:22:54.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.293+0000 7f3ac41d3700 1 -- 172.21.15.49:0/1467933991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3abc165750 con 0x7f3abc064350 2023-11-30T17:22:54.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.294+0000 7f3ac41d3700 1 -- 172.21.15.49:0/1467933991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3abc0afe90 con 0x7f3abc064350 2023-11-30T17:22:54.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.294+0000 7f3ab9ffb700 1 -- 172.21.15.49:0/1467933991 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f3ab4013480 con 0x7f3abc064350 2023-11-30T17:22:54.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.294+0000 7f3ab9ffb700 1 --2- 172.21.15.49:0/1467933991 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3aa805f270 0x7f3aa8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:54.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.294+0000 7f3ab9ffb700 1 -- 172.21.15.49:0/1467933991 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5297+0+0 (secure 0 0 0) 0x7f3ab4079ea0 con 0x7f3abc064350 2023-11-30T17:22:54.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.294+0000 7f3ac176e700 1 --2- 172.21.15.49:0/1467933991 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3aa805f270 0x7f3aa8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:54.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.295+0000 7f3ac176e700 1 --2- 172.21.15.49:0/1467933991 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3aa805f270 0x7f3aa8061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f3abc083f80 tx=0x7f3ab0017000).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:54.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.298+0000 7f3ab9ffb700 1 -- 172.21.15.49:0/1467933991 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3ab404b2c0 con 0x7f3abc064350 2023-11-30T17:22:54.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.470+0000 7f3ac41d3700 1 -- 172.21.15.49:0/1467933991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3abc0af6a0 con 0x7f3abc064350 2023-11-30T17:22:54.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.471+0000 7f3ab9ffb700 1 -- 172.21.15.49:0/1467933991 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v94) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3abc0af6a0 con 0x7f3abc064350 2023-11-30T17:22:54.473 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T17:22:54.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.473+0000 7f3ac41d3700 1 -- 172.21.15.49:0/1467933991 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3aa805f270 msgr2=0x7f3aa8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:54.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.473+0000 7f3ac41d3700 1 --2- 172.21.15.49:0/1467933991 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3aa805f270 0x7f3aa8061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f3abc083f80 tx=0x7f3ab0017000).stop 2023-11-30T17:22:54.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.473+0000 7f3ac41d3700 1 -- 172.21.15.49:0/1467933991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3abc064350 msgr2=0x7f3abc154dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:54.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.473+0000 7f3ac41d3700 1 --2- 172.21.15.49:0/1467933991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3abc064350 0x7f3abc154dc0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f3ab400d890 tx=0x7f3ab4008040).stop 2023-11-30T17:22:54.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.473+0000 7f3ac41d3700 1 -- 172.21.15.49:0/1467933991 shutdown_connections 2023-11-30T17:22:54.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.473+0000 7f3ac41d3700 1 --2- 172.21.15.49:0/1467933991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3abc0c6190 0x7f3abc165260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:54.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.473+0000 7f3ac41d3700 1 --2- 172.21.15.49:0/1467933991 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3aa805f270 0x7f3aa8061730 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:54.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.473+0000 7f3ac41d3700 1 --2- 172.21.15.49:0/1467933991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3abc064350 0x7f3abc154dc0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:54.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.473+0000 7f3ac41d3700 1 --2- 172.21.15.49:0/1467933991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3abc098d10 0x7f3abc14ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:54.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.473+0000 7f3ac41d3700 1 -- 172.21.15.49:0/1467933991 >> 172.21.15.49:0/1467933991 conn(0x7f3abc0cb310 msgr2=0x7f3abc158820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:54.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.473+0000 7f3ac41d3700 1 -- 172.21.15.49:0/1467933991 shutdown_connections 2023-11-30T17:22:54.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.473+0000 7f3ac41d3700 1 -- 172.21.15.49:0/1467933991 wait complete. 2023-11-30T17:22:54.487 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T17:22:54.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.605+0000 7f140cb5b700 1 Processor -- start 2023-11-30T17:22:54.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.605+0000 7f140cb5b700 1 -- start start 2023-11-30T17:22:54.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.606+0000 7f140cb5b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1408096590 0x7f14080673d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:54.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.606+0000 7f140cb5b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14080bfbe0 0x7f14080678c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:54.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.606+0000 7f140cb5b700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1408154c00 con 0x7f140814edb0 2023-11-30T17:22:54.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.606+0000 7f140cb5b700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f140814f190 con 0x7f1408096590 2023-11-30T17:22:54.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.606+0000 7f140cb5b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1408155770 con 0x7f14080bfbe0 2023-11-30T17:22:54.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.606+0000 7f1405d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1408096590 0x7f14080673d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:54.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.606+0000 7f1405d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1408096590 0x7f14080673d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57050/0 (socket says 172.21.15.49:57050) 2023-11-30T17:22:54.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.606+0000 7f1405d9b700 1 -- 172.21.15.49:0/1122646190 learned_addr learned my addr 172.21.15.49:0/1122646190 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:54.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.606+0000 7f1406d9d700 1 --2- 172.21.15.49:0/1122646190 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14080bfbe0 0x7f14080678c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:54.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.607+0000 7f1405d9b700 1 -- 172.21.15.49:0/1122646190 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14080bfbe0 msgr2=0x7f14080678c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:54.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.607+0000 7f1405d9b700 1 --2- 172.21.15.49:0/1122646190 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14080bfbe0 0x7f14080678c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:54.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.607+0000 7f1405d9b700 1 -- 172.21.15.49:0/1122646190 >> v1:172.21.15.115:6789/0 conn(0x7f140814edb0 legacy=0x7f1408095e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:54.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.607+0000 7f1405d9b700 1 -- 172.21.15.49:0/1122646190 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1408155c00 con 0x7f1408096590 2023-11-30T17:22:54.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.607+0000 7f1405d9b700 1 --2- 172.21.15.49:0/1122646190 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1408096590 0x7f14080673d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7f13f0006fd0 tx=0x7f13f00090f0).ready entity=mon.0 client_cookie=4edd50b98c49999d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:54.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.607+0000 7f140559a700 1 -- 172.21.15.49:0/1122646190 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f000b600 con 0x7f1408096590 2023-11-30T17:22:54.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.607+0000 7f140559a700 1 -- 172.21.15.49:0/1122646190 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f000b760 con 0x7f1408096590 2023-11-30T17:22:54.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.607+0000 7f140559a700 1 -- 172.21.15.49:0/1122646190 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f000bae0 con 0x7f1408096590 2023-11-30T17:22:54.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.607+0000 7f140cb5b700 1 -- 172.21.15.49:0/1122646190 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1408096590 msgr2=0x7f14080673d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:54.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.607+0000 7f140cb5b700 1 --2- 172.21.15.49:0/1122646190 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1408096590 0x7f14080673d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7f13f0006fd0 tx=0x7f13f00090f0).stop 2023-11-30T17:22:54.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.607+0000 7f140cb5b700 1 -- 172.21.15.49:0/1122646190 shutdown_connections 2023-11-30T17:22:54.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.607+0000 7f140cb5b700 1 --2- 172.21.15.49:0/1122646190 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14080bfbe0 0x7f14080678c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:54.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.607+0000 7f140cb5b700 1 --2- 172.21.15.49:0/1122646190 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1408096590 0x7f14080673d0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:54.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.607+0000 7f140cb5b700 1 -- 172.21.15.49:0/1122646190 >> 172.21.15.49:0/1122646190 conn(0x7f14080631d0 msgr2=0x7f14080c9160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:54.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.607+0000 7f140cb5b700 1 -- 172.21.15.49:0/1122646190 shutdown_connections 2023-11-30T17:22:54.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.607+0000 7f140cb5b700 1 -- 172.21.15.49:0/1122646190 wait complete. 2023-11-30T17:22:54.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.609+0000 7f140cb5b700 1 Processor -- start 2023-11-30T17:22:54.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.609+0000 7f140cb5b700 1 -- start start 2023-11-30T17:22:54.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.609+0000 7f140cb5b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1408096590 0x7f14080aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:54.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.609+0000 7f140cb5b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14080bfbe0 0x7f14080c17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:54.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.609+0000 7f140cb5b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f140814edb0 0x7f14080c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:54.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.609+0000 7f140cb5b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14080c1340 con 0x7f140814edb0 2023-11-30T17:22:54.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.609+0000 7f140cb5b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14081690f0 con 0x7f1408096590 2023-11-30T17:22:54.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.609+0000 7f140cb5b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14080c0a10 con 0x7f14080bfbe0 2023-11-30T17:22:54.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.610+0000 7f1406d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f140814edb0 0x7f14080c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:54.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.610+0000 7f1406d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f140814edb0 0x7f14080c4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57052/0 (socket says 172.21.15.49:57052) 2023-11-30T17:22:54.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.610+0000 7f1406d9d700 1 -- 172.21.15.49:0/704267002 learned_addr learned my addr 172.21.15.49:0/704267002 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:54.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.610+0000 7f1405d9b700 1 --2- 172.21.15.49:0/704267002 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14080bfbe0 0x7f14080c17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:54.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.610+0000 7f140659c700 1 --2- 172.21.15.49:0/704267002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1408096590 0x7f14080aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:54.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.610+0000 7f1406d9d700 1 -- 172.21.15.49:0/704267002 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14080bfbe0 msgr2=0x7f14080c17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:54.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.610+0000 7f1406d9d700 1 --2- 172.21.15.49:0/704267002 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14080bfbe0 0x7f14080c17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:54.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.610+0000 7f1406d9d700 1 -- 172.21.15.49:0/704267002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1408096590 msgr2=0x7f14080aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:54.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.610+0000 7f1406d9d700 1 --2- 172.21.15.49:0/704267002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1408096590 0x7f14080aec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:54.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.610+0000 7f1406d9d700 1 -- 172.21.15.49:0/704267002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f0009370 con 0x7f140814edb0 2023-11-30T17:22:54.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.610+0000 7f1406d9d700 1 --2- 172.21.15.49:0/704267002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f140814edb0 0x7f14080c4cb0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f13f800d5b0 tx=0x7f13f8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:54.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.610+0000 7f13fe7fc700 1 -- 172.21.15.49:0/704267002 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f8011590 con 0x7f140814edb0 2023-11-30T17:22:54.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.610+0000 7f13fe7fc700 1 -- 172.21.15.49:0/704267002 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f80116f0 con 0x7f140814edb0 2023-11-30T17:22:54.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.610+0000 7f140cb5b700 1 -- 172.21.15.49:0/704267002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14080c0cf0 con 0x7f140814edb0 2023-11-30T17:22:54.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.610+0000 7f13fe7fc700 1 -- 172.21.15.49:0/704267002 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f8011a70 con 0x7f140814edb0 2023-11-30T17:22:54.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.610+0000 7f140cb5b700 1 -- 172.21.15.49:0/704267002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14080af150 con 0x7f140814edb0 2023-11-30T17:22:54.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.611+0000 7f140cb5b700 1 -- 172.21.15.49:0/704267002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14080c14f0 con 0x7f140814edb0 2023-11-30T17:22:54.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.612+0000 7f13fe7fc700 1 -- 172.21.15.49:0/704267002 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f13f801c460 con 0x7f140814edb0 2023-11-30T17:22:54.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.612+0000 7f13fe7fc700 1 --2- 172.21.15.49:0/704267002 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f13e805f240 0x7f13e8061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:54.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.612+0000 7f13fe7fc700 1 -- 172.21.15.49:0/704267002 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5297+0+0 (secure 0 0 0) 0x7f13f8079c80 con 0x7f140814edb0 2023-11-30T17:22:54.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.612+0000 7f140659c700 1 --2- 172.21.15.49:0/704267002 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f13e805f240 0x7f13e8061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:54.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.613+0000 7f140659c700 1 --2- 172.21.15.49:0/704267002 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f13e805f240 0x7f13e8061700 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f1400006fd0 tx=0x7f1400009250).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:54.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.616+0000 7f13fe7fc700 1 -- 172.21.15.49:0/704267002 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f14080c14f0 con 0x7f140814edb0 2023-11-30T17:22:54.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.785+0000 7f140cb5b700 1 -- 172.21.15.49:0/704267002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f14080c14f0 con 0x7f140814edb0 2023-11-30T17:22:54.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.786+0000 7f13fe7fc700 1 -- 172.21.15.49:0/704267002 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v94) v1 ==== 92+0+10 (secure 0 0 0) 0x7f14080c14f0 con 0x7f140814edb0 2023-11-30T17:22:54.788 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T17:22:54.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.787+0000 7f140cb5b700 1 -- 172.21.15.49:0/704267002 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f13e805f240 msgr2=0x7f13e8061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:54.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.787+0000 7f140cb5b700 1 --2- 172.21.15.49:0/704267002 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f13e805f240 0x7f13e8061700 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f1400006fd0 tx=0x7f1400009250).stop 2023-11-30T17:22:54.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.787+0000 7f140cb5b700 1 -- 172.21.15.49:0/704267002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f140814edb0 msgr2=0x7f14080c4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:54.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.787+0000 7f140cb5b700 1 --2- 172.21.15.49:0/704267002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f140814edb0 0x7f14080c4cb0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f13f800d5b0 tx=0x7f13f8008040).stop 2023-11-30T17:22:54.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.788+0000 7f140cb5b700 1 -- 172.21.15.49:0/704267002 shutdown_connections 2023-11-30T17:22:54.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.788+0000 7f140cb5b700 1 --2- 172.21.15.49:0/704267002 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f13e805f240 0x7f13e8061700 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:54.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.788+0000 7f140cb5b700 1 --2- 172.21.15.49:0/704267002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f140814edb0 0x7f14080c4cb0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:54.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.788+0000 7f140cb5b700 1 --2- 172.21.15.49:0/704267002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1408096590 0x7f14080aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:54.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.788+0000 7f140cb5b700 1 --2- 172.21.15.49:0/704267002 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14080bfbe0 0x7f14080c17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:54.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.788+0000 7f140cb5b700 1 -- 172.21.15.49:0/704267002 >> 172.21.15.49:0/704267002 conn(0x7f14080631d0 msgr2=0x7f14080c90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:54.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.788+0000 7f140cb5b700 1 -- 172.21.15.49:0/704267002 shutdown_connections 2023-11-30T17:22:54.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.788+0000 7f140cb5b700 1 -- 172.21.15.49:0/704267002 wait complete. 2023-11-30T17:22:54.802 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-30T17:22:54.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.917+0000 7f4b0fa50700 1 Processor -- start 2023-11-30T17:22:54.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.918+0000 7f4b0fa50700 1 -- start start 2023-11-30T17:22:54.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.918+0000 7f4b0fa50700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b081544e0 0x7f4b081548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:54.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.918+0000 7f4b0fa50700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4b080c6e30 0x7f4b080c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:54.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.918+0000 7f4b0fa50700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b080c69a0 con 0x7f4b0806a610 2023-11-30T17:22:54.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.918+0000 7f4b0fa50700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b080c13a0 con 0x7f4b080c6e30 2023-11-30T17:22:54.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.918+0000 7f4b0fa50700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b080c1680 con 0x7f4b081544e0 2023-11-30T17:22:54.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.919+0000 7f4b0cfeb700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4b0806a610 0x7f4b080c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42022/0 (socket says 172.21.15.49:42022) 2023-11-30T17:22:54.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.919+0000 7f4b0cfeb700 1 -- 172.21.15.49:0/3743186112 learned_addr learned my addr 172.21.15.49:0/3743186112 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:54.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.919+0000 7f4b0d7ec700 1 --2- 172.21.15.49:0/3743186112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b081544e0 0x7f4b081548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:54.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.919+0000 7f4b0dfed700 1 --2- 172.21.15.49:0/3743186112 >> v2:172.21.15.115:3300/0 conn(0x7f4b080c6e30 0x7f4b080c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:54.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.919+0000 7f4b07fff700 1 -- 172.21.15.49:0/3743186112 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964243090 0 0) 0x7f4b080c69a0 con 0x7f4b0806a610 2023-11-30T17:22:54.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.919+0000 7f4b07fff700 1 -- 172.21.15.49:0/3743186112 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4af00033f0 con 0x7f4b0806a610 2023-11-30T17:22:54.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.919+0000 7f4b07fff700 1 -- 172.21.15.49:0/3743186112 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1505958777 0 0) 0x7f4af00033f0 con 0x7f4b0806a610 2023-11-30T17:22:54.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.919+0000 7f4b07fff700 1 -- 172.21.15.49:0/3743186112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b081544e0 msgr2=0x7f4b081548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:54.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.919+0000 7f4b07fff700 1 --2- 172.21.15.49:0/3743186112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b081544e0 0x7f4b081548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:54.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.919+0000 7f4b07fff700 1 -- 172.21.15.49:0/3743186112 >> v2:172.21.15.115:3300/0 conn(0x7f4b080c6e30 msgr2=0x7f4b080c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:54.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.919+0000 7f4b07fff700 1 --2- 172.21.15.49:0/3743186112 >> v2:172.21.15.115:3300/0 conn(0x7f4b080c6e30 0x7f4b080c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:54.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.919+0000 7f4b07fff700 1 -- 172.21.15.49:0/3743186112 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b080c6630 con 0x7f4b0806a610 2023-11-30T17:22:54.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.919+0000 7f4b07fff700 1 -- 172.21.15.49:0/3743186112 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f4afc001470 con 0x7f4b0806a610 2023-11-30T17:22:54.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.919+0000 7f4b07fff700 1 -- 172.21.15.49:0/3743186112 >> v1:172.21.15.49:6789/0 conn(0x7f4b0806a610 legacy=0x7f4b080c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:54.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.919+0000 7f4b07fff700 1 --2- 172.21.15.49:0/3743186112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4af00038e0 0x7f4af0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:54.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.919+0000 7f4b07fff700 1 --2- 172.21.15.49:0/3743186112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4af0004690 0x7f4af0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:54.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.919+0000 7f4b07fff700 1 --2- 172.21.15.49:0/3743186112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4af0005000 0x7f4af000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:54.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.919+0000 7f4b07fff700 1 -- 172.21.15.49:0/3743186112 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b080c13a0 con 0x7f4af0004690 2023-11-30T17:22:54.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.919+0000 7f4b07fff700 1 -- 172.21.15.49:0/3743186112 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b080c1680 con 0x7f4af00038e0 2023-11-30T17:22:54.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.919+0000 7f4b07fff700 1 -- 172.21.15.49:0/3743186112 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af000bdd0 con 0x7f4af0005000 2023-11-30T17:22:54.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.919+0000 7f4b0d7ec700 1 --2- 172.21.15.49:0/3743186112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b081544e0 0x7f4b081548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:22:54.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.919+0000 7f4b0dfed700 1 --2- 172.21.15.49:0/3743186112 >> v2:172.21.15.115:3300/0 conn(0x7f4b080c6e30 0x7f4b080c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:22:54.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.919+0000 7f4b0cfeb700 1 --2- 172.21.15.49:0/3743186112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4af0004690 0x7f4af0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:54.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.920+0000 7f4b0dfed700 1 --2- 172.21.15.49:0/3743186112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4af0005000 0x7f4af000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:54.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.920+0000 7f4b0d7ec700 1 --2- 172.21.15.49:0/3743186112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4af00038e0 0x7f4af0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:54.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.920+0000 7f4b0cfeb700 1 -- 172.21.15.49:0/3743186112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4af0005000 msgr2=0x7f4af000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:54.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.920+0000 7f4b0cfeb700 1 --2- 172.21.15.49:0/3743186112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4af0005000 0x7f4af000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:54.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.920+0000 7f4b0cfeb700 1 -- 172.21.15.49:0/3743186112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4af00038e0 msgr2=0x7f4af0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:54.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.920+0000 7f4b0cfeb700 1 --2- 172.21.15.49:0/3743186112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4af00038e0 0x7f4af0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:54.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.920+0000 7f4b0cfeb700 1 -- 172.21.15.49:0/3743186112 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af00033f0 con 0x7f4af0004690 2023-11-30T17:22:54.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.920+0000 7f4b0cfeb700 1 --2- 172.21.15.49:0/3743186112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4af0004690 0x7f4af0004b10 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f4afc00c210 tx=0x7f4afc001e90).ready entity=mon.0 client_cookie=dca393cffbef9cef server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:54.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.920+0000 7f4b07fff700 1 -- 172.21.15.49:0/3743186112 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc007a60 con 0x7f4af0004690 2023-11-30T17:22:54.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.920+0000 7f4b07fff700 1 -- 172.21.15.49:0/3743186112 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4afc00caa0 con 0x7f4af0004690 2023-11-30T17:22:54.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.920+0000 7f4b07fff700 1 -- 172.21.15.49:0/3743186112 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc00ce40 con 0x7f4af0004690 2023-11-30T17:22:54.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.920+0000 7f4b0fa50700 1 -- 172.21.15.49:0/3743186112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4af0004690 msgr2=0x7f4af0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:54.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.920+0000 7f4b0fa50700 1 --2- 172.21.15.49:0/3743186112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4af0004690 0x7f4af0004b10 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f4afc00c210 tx=0x7f4afc001e90).stop 2023-11-30T17:22:54.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.921+0000 7f4b0dfed700 1 -- 172.21.15.49:0/3743186112 reap_dead start 2023-11-30T17:22:54.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.921+0000 7f4b0fa50700 1 -- 172.21.15.49:0/3743186112 shutdown_connections 2023-11-30T17:22:54.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.921+0000 7f4b0fa50700 1 -- 172.21.15.49:0/3743186112 >> 172.21.15.49:0/3743186112 conn(0x7f4b08085020 msgr2=0x7f4b08094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:54.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.921+0000 7f4b0fa50700 1 -- 172.21.15.49:0/3743186112 shutdown_connections 2023-11-30T17:22:54.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.921+0000 7f4b0fa50700 1 -- 172.21.15.49:0/3743186112 wait complete. 2023-11-30T17:22:54.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.922+0000 7f4b0fa50700 1 Processor -- start 2023-11-30T17:22:54.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.922+0000 7f4b0fa50700 1 -- start start 2023-11-30T17:22:54.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.923+0000 7f4b0fa50700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4af0004690 0x7f4b080a8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:54.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.923+0000 7f4b0fa50700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b081501e0 0x7f4b081518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:54.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.923+0000 7f4b0fa50700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b0814f930 0x7f4b08098280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:54.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.923+0000 7f4b0fa50700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b08151d90 con 0x7f4b081501e0 2023-11-30T17:22:54.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.923+0000 7f4b0fa50700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b08152bb0 con 0x7f4af0004690 2023-11-30T17:22:54.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.923+0000 7f4b0fa50700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b08150660 con 0x7f4b0814f930 2023-11-30T17:22:54.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.923+0000 7f4b0cfeb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b081501e0 0x7f4b081518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:54.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.923+0000 7f4b0cfeb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b081501e0 0x7f4b081518a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57068/0 (socket says 172.21.15.49:57068) 2023-11-30T17:22:54.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.923+0000 7f4b0cfeb700 1 -- 172.21.15.49:0/656530039 learned_addr learned my addr 172.21.15.49:0/656530039 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:54.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.923+0000 7f4b0d7ec700 1 --2- 172.21.15.49:0/656530039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4af0004690 0x7f4b080a8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:54.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.923+0000 7f4b0dfed700 1 --2- 172.21.15.49:0/656530039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b0814f930 0x7f4b08098280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:54.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.923+0000 7f4b0cfeb700 1 -- 172.21.15.49:0/656530039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b0814f930 msgr2=0x7f4b08098280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:54.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.923+0000 7f4b0cfeb700 1 --2- 172.21.15.49:0/656530039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b0814f930 0x7f4b08098280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:54.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.923+0000 7f4b0cfeb700 1 -- 172.21.15.49:0/656530039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4af0004690 msgr2=0x7f4b080a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:54.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.923+0000 7f4b0cfeb700 1 --2- 172.21.15.49:0/656530039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4af0004690 0x7f4b080a8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:54.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.923+0000 7f4b0cfeb700 1 -- 172.21.15.49:0/656530039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b08151fa0 con 0x7f4b081501e0 2023-11-30T17:22:54.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.923+0000 7f4b0dfed700 1 --2- 172.21.15.49:0/656530039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b0814f930 0x7f4b08098280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:54.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.923+0000 7f4b0cfeb700 1 --2- 172.21.15.49:0/656530039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b081501e0 0x7f4b081518a0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f4af0004500 tx=0x7f4afc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:54.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.923+0000 7f4b057fa700 1 -- 172.21.15.49:0/656530039 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc007640 con 0x7f4b081501e0 2023-11-30T17:22:54.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.923+0000 7f4b057fa700 1 -- 172.21.15.49:0/656530039 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4afc0046b0 con 0x7f4b081501e0 2023-11-30T17:22:54.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.924+0000 7f4b0fa50700 1 -- 172.21.15.49:0/656530039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b08152280 con 0x7f4b081501e0 2023-11-30T17:22:54.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.924+0000 7f4b057fa700 1 -- 172.21.15.49:0/656530039 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc004a70 con 0x7f4b081501e0 2023-11-30T17:22:54.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.924+0000 7f4b0fa50700 1 -- 172.21.15.49:0/656530039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b08152840 con 0x7f4b081501e0 2023-11-30T17:22:54.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.924+0000 7f4b0fa50700 1 -- 172.21.15.49:0/656530039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b08152d20 con 0x7f4b081501e0 2023-11-30T17:22:54.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.925+0000 7f4b057fa700 1 -- 172.21.15.49:0/656530039 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4afc021460 con 0x7f4b081501e0 2023-11-30T17:22:54.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.925+0000 7f4b057fa700 1 --2- 172.21.15.49:0/656530039 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4af405f240 0x7f4af4061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:54.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.925+0000 7f4b057fa700 1 -- 172.21.15.49:0/656530039 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5297+0+0 (secure 0 0 0) 0x7f4afc019020 con 0x7f4b081501e0 2023-11-30T17:22:54.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.925+0000 7f4b0d7ec700 1 --2- 172.21.15.49:0/656530039 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4af405f240 0x7f4af4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:54.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.926+0000 7f4b0d7ec700 1 --2- 172.21.15.49:0/656530039 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4af405f240 0x7f4af4061700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f4b08085760 tx=0x7f4b0000b040).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:54.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:54.929+0000 7f4b057fa700 1 -- 172.21.15.49:0/656530039 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4afc04c6f0 con 0x7f4b081501e0 2023-11-30T17:22:55.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.106+0000 7f4b0fa50700 1 -- 172.21.15.49:0/656530039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4b0806c860 con 0x7f4b081501e0 2023-11-30T17:22:55.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.107+0000 7f4b057fa700 1 -- 172.21.15.49:0/656530039 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v94) v1 ==== 84+0+143 (secure 0 0 0) 0x7f4afc004e60 con 0x7f4b081501e0 2023-11-30T17:22:55.109 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:55.109 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-11-30T17:22:55.109 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:55.110 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2023-11-30T17:22:55.110 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "device_health_metrics" 2023-11-30T17:22:55.110 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:22:55.110 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:22:55.110 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 2, 2023-11-30T17:22:55.110 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "rbd" 2023-11-30T17:22:55.110 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:22:55.110 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-11-30T17:22:55.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.109+0000 7f4b0fa50700 1 -- 172.21.15.49:0/656530039 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4af405f240 msgr2=0x7f4af4061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:55.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.109+0000 7f4b0fa50700 1 --2- 172.21.15.49:0/656530039 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4af405f240 0x7f4af4061700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f4b08085760 tx=0x7f4b0000b040).stop 2023-11-30T17:22:55.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.109+0000 7f4b0fa50700 1 -- 172.21.15.49:0/656530039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b081501e0 msgr2=0x7f4b081518a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:55.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.109+0000 7f4b0fa50700 1 --2- 172.21.15.49:0/656530039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b081501e0 0x7f4b081518a0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f4af0004500 tx=0x7f4afc015000).stop 2023-11-30T17:22:55.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.109+0000 7f4b0fa50700 1 -- 172.21.15.49:0/656530039 shutdown_connections 2023-11-30T17:22:55.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.109+0000 7f4b0fa50700 1 --2- 172.21.15.49:0/656530039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b0814f930 0x7f4b08098280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:55.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.109+0000 7f4b0fa50700 1 --2- 172.21.15.49:0/656530039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4af0004690 0x7f4b080a8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:55.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.109+0000 7f4b0fa50700 1 --2- 172.21.15.49:0/656530039 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4af405f240 0x7f4af4061700 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:55.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.109+0000 7f4b0fa50700 1 --2- 172.21.15.49:0/656530039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b081501e0 0x7f4b081518a0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:55.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.109+0000 7f4b0fa50700 1 -- 172.21.15.49:0/656530039 >> 172.21.15.49:0/656530039 conn(0x7f4b08085020 msgr2=0x7f4b080c9070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:55.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.109+0000 7f4b0fa50700 1 -- 172.21.15.49:0/656530039 shutdown_connections 2023-11-30T17:22:55.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.109+0000 7f4b0fa50700 1 -- 172.21.15.49:0/656530039 wait complete. 2023-11-30T17:22:55.123 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-30T17:22:55.123 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-11-30T17:22:55.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.243+0000 7f178d6c4700 1 Processor -- start 2023-11-30T17:22:55.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.244+0000 7f178d6c4700 1 -- start start 2023-11-30T17:22:55.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.244+0000 7f178d6c4700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f17880c5f30 0x7f17880c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:55.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.244+0000 7f178d6c4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1788063af0 0x7f1788063f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:55.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.244+0000 7f178d6c4700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17880c68d0 con 0x7f17881373a0 2023-11-30T17:22:55.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.244+0000 7f178d6c4700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1788158e20 con 0x7f17880c5f30 2023-11-30T17:22:55.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.244+0000 7f178d6c4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17881582a0 con 0x7f1788063af0 2023-11-30T17:22:55.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.244+0000 7f17867fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f17880c5f30 0x7f17880c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:55.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.245+0000 7f17867fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f17880c5f30 0x7f17880c63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57072/0 (socket says 172.21.15.49:57072) 2023-11-30T17:22:55.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.245+0000 7f17867fc700 1 -- 172.21.15.49:0/1581776655 learned_addr learned my addr 172.21.15.49:0/1581776655 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:55.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.245+0000 7f17877fe700 1 --2- 172.21.15.49:0/1581776655 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1788063af0 0x7f1788063f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:55.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.245+0000 7f17867fc700 1 -- 172.21.15.49:0/1581776655 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1788063af0 msgr2=0x7f1788063f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:55.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.245+0000 7f17867fc700 1 --2- 172.21.15.49:0/1581776655 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1788063af0 0x7f1788063f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:55.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.245+0000 7f17867fc700 1 -- 172.21.15.49:0/1581776655 >> v1:172.21.15.115:6789/0 conn(0x7f17881373a0 legacy=0x7f17880c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:55.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.245+0000 7f17867fc700 1 -- 172.21.15.49:0/1581776655 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1788158580 con 0x7f17880c5f30 2023-11-30T17:22:55.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.245+0000 7f17867fc700 1 --2- 172.21.15.49:0/1581776655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17880c5f30 0x7f17880c63e0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7f1770006fd0 tx=0x7f17700090f0).ready entity=mon.0 client_cookie=d393ef6fdc4cefe4 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:55.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.245+0000 7f1785ffb700 1 -- 172.21.15.49:0/1581776655 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177000b600 con 0x7f17880c5f30 2023-11-30T17:22:55.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.245+0000 7f1785ffb700 1 -- 172.21.15.49:0/1581776655 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177000b760 con 0x7f17880c5f30 2023-11-30T17:22:55.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.245+0000 7f1785ffb700 1 -- 172.21.15.49:0/1581776655 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177000bae0 con 0x7f17880c5f30 2023-11-30T17:22:55.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.246+0000 7f178d6c4700 1 -- 172.21.15.49:0/1581776655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17880c5f30 msgr2=0x7f17880c63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:55.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.246+0000 7f178d6c4700 1 --2- 172.21.15.49:0/1581776655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17880c5f30 0x7f17880c63e0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7f1770006fd0 tx=0x7f17700090f0).stop 2023-11-30T17:22:55.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.246+0000 7f178d6c4700 1 -- 172.21.15.49:0/1581776655 shutdown_connections 2023-11-30T17:22:55.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.246+0000 7f178d6c4700 1 --2- 172.21.15.49:0/1581776655 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1788063af0 0x7f1788063f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:55.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.246+0000 7f178d6c4700 1 --2- 172.21.15.49:0/1581776655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17880c5f30 0x7f17880c63e0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:55.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.246+0000 7f178d6c4700 1 -- 172.21.15.49:0/1581776655 >> 172.21.15.49:0/1581776655 conn(0x7f17880628f0 msgr2=0x7f1788062d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:55.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.246+0000 7f178d6c4700 1 -- 172.21.15.49:0/1581776655 shutdown_connections 2023-11-30T17:22:55.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.246+0000 7f178d6c4700 1 -- 172.21.15.49:0/1581776655 wait complete. 2023-11-30T17:22:55.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.247+0000 7f178d6c4700 1 Processor -- start 2023-11-30T17:22:55.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.247+0000 7f178d6c4700 1 -- start start 2023-11-30T17:22:55.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.248+0000 7f178d6c4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1788063af0 0x7f17880a7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:55.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.248+0000 7f178d6c4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17880c5f30 0x7f17881384d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:55.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.248+0000 7f178d6c4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17881373a0 0x7f17881389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:55.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.248+0000 7f178d6c4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17880a9970 con 0x7f17881373a0 2023-11-30T17:22:55.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.248+0000 7f178d6c4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17880a8b10 con 0x7f1788063af0 2023-11-30T17:22:55.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.248+0000 7f178d6c4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1788138eb0 con 0x7f17880c5f30 2023-11-30T17:22:55.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.248+0000 7f17877fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17881373a0 0x7f17881389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:55.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.248+0000 7f17877fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17881373a0 0x7f17881389c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57078/0 (socket says 172.21.15.49:57078) 2023-11-30T17:22:55.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.248+0000 7f17877fe700 1 -- 172.21.15.49:0/3238888490 learned_addr learned my addr 172.21.15.49:0/3238888490 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:55.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.248+0000 7f17867fc700 1 --2- 172.21.15.49:0/3238888490 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17880c5f30 0x7f17881384d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:55.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.248+0000 7f1786ffd700 1 --2- 172.21.15.49:0/3238888490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1788063af0 0x7f17880a7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:55.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.248+0000 7f17877fe700 1 -- 172.21.15.49:0/3238888490 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17880c5f30 msgr2=0x7f17881384d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:55.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.248+0000 7f17877fe700 1 --2- 172.21.15.49:0/3238888490 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17880c5f30 0x7f17881384d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:55.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.248+0000 7f17877fe700 1 -- 172.21.15.49:0/3238888490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1788063af0 msgr2=0x7f17880a7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:55.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.248+0000 7f17877fe700 1 --2- 172.21.15.49:0/3238888490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1788063af0 0x7f17880a7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:55.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.248+0000 7f17877fe700 1 -- 172.21.15.49:0/3238888490 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1770009370 con 0x7f17881373a0 2023-11-30T17:22:55.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.248+0000 7f17877fe700 1 --2- 172.21.15.49:0/3238888490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17881373a0 0x7f17881389c0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f177800d8c0 tx=0x7f1778008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:55.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.248+0000 7f177effd700 1 -- 172.21.15.49:0/3238888490 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1778011590 con 0x7f17881373a0 2023-11-30T17:22:55.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.249+0000 7f177effd700 1 -- 172.21.15.49:0/3238888490 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17780116f0 con 0x7f17881373a0 2023-11-30T17:22:55.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.249+0000 7f178d6c4700 1 -- 172.21.15.49:0/3238888490 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17880a8d60 con 0x7f17881373a0 2023-11-30T17:22:55.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.249+0000 7f177effd700 1 -- 172.21.15.49:0/3238888490 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1778011a70 con 0x7f17881373a0 2023-11-30T17:22:55.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.249+0000 7f178d6c4700 1 -- 172.21.15.49:0/3238888490 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17880a9320 con 0x7f17881373a0 2023-11-30T17:22:55.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.249+0000 7f178d6c4700 1 -- 172.21.15.49:0/3238888490 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f178806c860 con 0x7f17881373a0 2023-11-30T17:22:55.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.250+0000 7f177effd700 1 -- 172.21.15.49:0/3238888490 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f1778012420 con 0x7f17881373a0 2023-11-30T17:22:55.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.250+0000 7f177effd700 1 --2- 172.21.15.49:0/3238888490 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f176805f240 0x7f1768061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:55.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.250+0000 7f177effd700 1 -- 172.21.15.49:0/3238888490 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5297+0+0 (secure 0 0 0) 0x7f17780799e0 con 0x7f17881373a0 2023-11-30T17:22:55.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.251+0000 7f1786ffd700 1 --2- 172.21.15.49:0/3238888490 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f176805f240 0x7f1768061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:55.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.251+0000 7f1786ffd700 1 --2- 172.21.15.49:0/3238888490 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f176805f240 0x7f1768061700 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f1780004290 tx=0x7f17800014c0).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:55.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.254+0000 7f177effd700 1 -- 172.21.15.49:0/3238888490 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f177804ae00 con 0x7f17881373a0 2023-11-30T17:22:55.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.427+0000 7f178d6c4700 1 -- 172.21.15.49:0/3238888490 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f1788158860 con 0x7f17881373a0 2023-11-30T17:22:55.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.517+0000 7f177effd700 1 -- 172.21.15.49:0/3238888490 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v95) v1 ==== 152+0+0 (secure 0 0 0) 0x7f177804e420 con 0x7f17881373a0 2023-11-30T17:22:55.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.521+0000 7f178d6c4700 1 -- 172.21.15.49:0/3238888490 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f176805f240 msgr2=0x7f1768061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:55.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.521+0000 7f178d6c4700 1 --2- 172.21.15.49:0/3238888490 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f176805f240 0x7f1768061700 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f1780004290 tx=0x7f17800014c0).stop 2023-11-30T17:22:55.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.521+0000 7f178d6c4700 1 -- 172.21.15.49:0/3238888490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17881373a0 msgr2=0x7f17881389c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:55.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.521+0000 7f178d6c4700 1 --2- 172.21.15.49:0/3238888490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17881373a0 0x7f17881389c0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f177800d8c0 tx=0x7f1778008040).stop 2023-11-30T17:22:55.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.521+0000 7f178d6c4700 1 -- 172.21.15.49:0/3238888490 shutdown_connections 2023-11-30T17:22:55.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.521+0000 7f178d6c4700 1 --2- 172.21.15.49:0/3238888490 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f176805f240 0x7f1768061700 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:55.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.521+0000 7f178d6c4700 1 --2- 172.21.15.49:0/3238888490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17881373a0 0x7f17881389c0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:55.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.521+0000 7f178d6c4700 1 --2- 172.21.15.49:0/3238888490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1788063af0 0x7f17880a7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:55.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.521+0000 7f178d6c4700 1 --2- 172.21.15.49:0/3238888490 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17880c5f30 0x7f17881384d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:55.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.521+0000 7f178d6c4700 1 -- 172.21.15.49:0/3238888490 >> 172.21.15.49:0/3238888490 conn(0x7f17880628f0 msgr2=0x7f1788136ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:55.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.522+0000 7f178d6c4700 1 -- 172.21.15.49:0/3238888490 shutdown_connections 2023-11-30T17:22:55.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.522+0000 7f178d6c4700 1 -- 172.21.15.49:0/3238888490 wait complete. 2023-11-30T17:22:55.526 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2023-11-30T17:22:55.538 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-30T17:22:55.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.661+0000 7f0b4759e700 1 Processor -- start 2023-11-30T17:22:55.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.661+0000 7f0b4759e700 1 -- start start 2023-11-30T17:22:55.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.662+0000 7f0b4759e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0b4814e530 0x7f0b480c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:55.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.662+0000 7f0b4759e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0b48154950 0x7f0b4814e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:55.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.662+0000 7f0b4759e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b48158570 0x7f0b48158a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:55.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.662+0000 7f0b4759e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b480c7bc0 con 0x7f0b4814e530 2023-11-30T17:22:55.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.662+0000 7f0b4759e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b48155920 con 0x7f0b48154950 2023-11-30T17:22:55.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.662+0000 7f0b4759e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b48154e00 con 0x7f0b48158570 2023-11-30T17:22:55.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.662+0000 7f0b4659c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0b4814e530 0x7f0b480c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:55.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.662+0000 7f0b4659c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0b4814e530 0x7f0b480c66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57084/0 (socket says 172.21.15.49:57084) 2023-11-30T17:22:55.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.662+0000 7f0b4659c700 1 -- 172.21.15.49:0/2348153322 learned_addr learned my addr 172.21.15.49:0/2348153322 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:55.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.662+0000 7f0b46d9d700 1 --2- 172.21.15.49:0/2348153322 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b48158570 0x7f0b48158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:55.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.662+0000 7f0b45d9b700 1 --2- 172.21.15.49:0/2348153322 >> v2:172.21.15.115:3300/0 conn(0x7f0b48154950 0x7f0b4814e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:55.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.662+0000 7f0b4659c700 1 -- 172.21.15.49:0/2348153322 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b48158570 msgr2=0x7f0b48158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:55.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.662+0000 7f0b4659c700 1 --2- 172.21.15.49:0/2348153322 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b48158570 0x7f0b48158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:55.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.662+0000 7f0b4659c700 1 -- 172.21.15.49:0/2348153322 >> v2:172.21.15.115:3300/0 conn(0x7f0b48154950 msgr2=0x7f0b4814e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:55.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.662+0000 7f0b4659c700 1 --2- 172.21.15.49:0/2348153322 >> v2:172.21.15.115:3300/0 conn(0x7f0b48154950 0x7f0b4814e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:55.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.662+0000 7f0b4659c700 1 -- 172.21.15.49:0/2348153322 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b48155080 con 0x7f0b4814e530 2023-11-30T17:22:55.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.662+0000 7f0b45d9b700 1 --2- 172.21.15.49:0/2348153322 >> v2:172.21.15.115:3300/0 conn(0x7f0b48154950 0x7f0b4814e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:22:55.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.662+0000 7f0b4659c700 1 --2- 172.21.15.49:0/2348153322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b4814e530 0x7f0b480c66f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f0b48157f20 tx=0x7f0b380090f0).ready entity=mon.0 client_cookie=a25056ea87b5d2f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:55.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.662+0000 7f0b4559a700 1 -- 172.21.15.49:0/2348153322 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3800b600 con 0x7f0b4814e530 2023-11-30T17:22:55.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.663+0000 7f0b4559a700 1 -- 172.21.15.49:0/2348153322 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3800b760 con 0x7f0b4814e530 2023-11-30T17:22:55.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.663+0000 7f0b4559a700 1 -- 172.21.15.49:0/2348153322 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3800bae0 con 0x7f0b4814e530 2023-11-30T17:22:55.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.663+0000 7f0b4759e700 1 -- 172.21.15.49:0/2348153322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b4814e530 msgr2=0x7f0b480c66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:55.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.663+0000 7f0b4759e700 1 --2- 172.21.15.49:0/2348153322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b4814e530 0x7f0b480c66f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f0b48157f20 tx=0x7f0b380090f0).stop 2023-11-30T17:22:55.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.663+0000 7f0b4759e700 1 -- 172.21.15.49:0/2348153322 shutdown_connections 2023-11-30T17:22:55.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.663+0000 7f0b4759e700 1 --2- 172.21.15.49:0/2348153322 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b48158570 0x7f0b48158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:55.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.663+0000 7f0b4759e700 1 --2- 172.21.15.49:0/2348153322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b4814e530 0x7f0b480c66f0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:55.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.663+0000 7f0b4759e700 1 --2- 172.21.15.49:0/2348153322 >> v2:172.21.15.115:3300/0 conn(0x7f0b48154950 0x7f0b4814e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:55.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.663+0000 7f0b4759e700 1 -- 172.21.15.49:0/2348153322 >> 172.21.15.49:0/2348153322 conn(0x7f0b48064990 msgr2=0x7f0b48064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:55.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.663+0000 7f0b4759e700 1 -- 172.21.15.49:0/2348153322 shutdown_connections 2023-11-30T17:22:55.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.663+0000 7f0b4759e700 1 -- 172.21.15.49:0/2348153322 wait complete. 2023-11-30T17:22:55.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.664+0000 7f0b4759e700 1 Processor -- start 2023-11-30T17:22:55.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.664+0000 7f0b4759e700 1 -- start start 2023-11-30T17:22:55.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.665+0000 7f0b4759e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b4814e530 0x7f0b4814dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:55.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.665+0000 7f0b4759e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b48154950 0x7f0b481649d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:55.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.665+0000 7f0b4759e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b48158570 0x7f0b48167fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:55.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.665+0000 7f0b4759e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b480afdb0 con 0x7f0b48158570 2023-11-30T17:22:55.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.665+0000 7f0b4759e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4814e1a0 con 0x7f0b48154950 2023-11-30T17:22:55.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.665+0000 7f0b4759e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b480af1a0 con 0x7f0b4814e530 2023-11-30T17:22:55.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.665+0000 7f0b46d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b48158570 0x7f0b48167fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:55.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.665+0000 7f0b46d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b48158570 0x7f0b48167fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57092/0 (socket says 172.21.15.49:57092) 2023-11-30T17:22:55.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.665+0000 7f0b46d9d700 1 -- 172.21.15.49:0/4127328204 learned_addr learned my addr 172.21.15.49:0/4127328204 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:55.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.665+0000 7f0b4659c700 1 --2- 172.21.15.49:0/4127328204 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b4814e530 0x7f0b4814dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:55.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.665+0000 7f0b45d9b700 1 --2- 172.21.15.49:0/4127328204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b48154950 0x7f0b481649d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:55.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.666+0000 7f0b46d9d700 1 -- 172.21.15.49:0/4127328204 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b4814e530 msgr2=0x7f0b4814dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:55.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.666+0000 7f0b46d9d700 1 --2- 172.21.15.49:0/4127328204 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b4814e530 0x7f0b4814dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:55.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.666+0000 7f0b46d9d700 1 -- 172.21.15.49:0/4127328204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b48154950 msgr2=0x7f0b481649d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:55.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.666+0000 7f0b46d9d700 1 --2- 172.21.15.49:0/4127328204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b48154950 0x7f0b481649d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:55.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.666+0000 7f0b46d9d700 1 -- 172.21.15.49:0/4127328204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b38009370 con 0x7f0b48158570 2023-11-30T17:22:55.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.666+0000 7f0b46d9d700 1 --2- 172.21.15.49:0/4127328204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b48158570 0x7f0b48167fe0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f0b40009fd0 tx=0x7f0b40009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:55.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.666+0000 7f0b3e7fc700 1 -- 172.21.15.49:0/4127328204 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4000eca0 con 0x7f0b48158570 2023-11-30T17:22:55.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.666+0000 7f0b3e7fc700 1 -- 172.21.15.49:0/4127328204 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4000ee00 con 0x7f0b48158570 2023-11-30T17:22:55.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.666+0000 7f0b4759e700 1 -- 172.21.15.49:0/4127328204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b480af480 con 0x7f0b48158570 2023-11-30T17:22:55.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.666+0000 7f0b3e7fc700 1 -- 172.21.15.49:0/4127328204 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b40014610 con 0x7f0b48158570 2023-11-30T17:22:55.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.666+0000 7f0b4759e700 1 -- 172.21.15.49:0/4127328204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b480afa40 con 0x7f0b48158570 2023-11-30T17:22:55.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.667+0000 7f0b4759e700 1 -- 172.21.15.49:0/4127328204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b480aff60 con 0x7f0b48158570 2023-11-30T17:22:55.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.668+0000 7f0b3e7fc700 1 -- 172.21.15.49:0/4127328204 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0b4001d3b0 con 0x7f0b48158570 2023-11-30T17:22:55.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.668+0000 7f0b3e7fc700 1 --2- 172.21.15.49:0/4127328204 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0b2805f270 0x7f0b28061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:55.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.668+0000 7f0b3e7fc700 1 -- 172.21.15.49:0/4127328204 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5667+0+0 (secure 0 0 0) 0x7f0b4007a6c0 con 0x7f0b48158570 2023-11-30T17:22:55.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.668+0000 7f0b4659c700 1 --2- 172.21.15.49:0/4127328204 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0b2805f270 0x7f0b28061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:55.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.669+0000 7f0b4659c700 1 --2- 172.21.15.49:0/4127328204 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0b2805f270 0x7f0b28061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f0b38009130 tx=0x7f0b38017000).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:55.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.673+0000 7f0b3e7fc700 1 -- 172.21.15.49:0/4127328204 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0b480aff60 con 0x7f0b48158570 2023-11-30T17:22:55.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:55.846+0000 7f0b4759e700 1 -- 172.21.15.49:0/4127328204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0b480aff60 con 0x7f0b48158570 2023-11-30T17:22:56.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.526+0000 7f0b3e7fc700 1 -- 172.21.15.49:0/4127328204 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v96) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0b480aff60 con 0x7f0b48158570 2023-11-30T17:22:56.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.548+0000 7f0b4759e700 1 -- 172.21.15.49:0/4127328204 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0b2805f270 msgr2=0x7f0b28061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:56.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.548+0000 7f0b4759e700 1 --2- 172.21.15.49:0/4127328204 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0b2805f270 0x7f0b28061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f0b38009130 tx=0x7f0b38017000).stop 2023-11-30T17:22:56.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.548+0000 7f0b4759e700 1 -- 172.21.15.49:0/4127328204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b48158570 msgr2=0x7f0b48167fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:56.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.548+0000 7f0b4759e700 1 --2- 172.21.15.49:0/4127328204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b48158570 0x7f0b48167fe0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f0b40009fd0 tx=0x7f0b40009900).stop 2023-11-30T17:22:56.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.549+0000 7f0b4759e700 1 -- 172.21.15.49:0/4127328204 shutdown_connections 2023-11-30T17:22:56.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.549+0000 7f0b4759e700 1 --2- 172.21.15.49:0/4127328204 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0b2805f270 0x7f0b28061730 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:56.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.549+0000 7f0b4759e700 1 --2- 172.21.15.49:0/4127328204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b48158570 0x7f0b48167fe0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:56.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.549+0000 7f0b4759e700 1 --2- 172.21.15.49:0/4127328204 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b4814e530 0x7f0b4814dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:56.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.549+0000 7f0b4759e700 1 --2- 172.21.15.49:0/4127328204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b48154950 0x7f0b481649d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:56.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.549+0000 7f0b4759e700 1 -- 172.21.15.49:0/4127328204 >> 172.21.15.49:0/4127328204 conn(0x7f0b48064990 msgr2=0x7f0b48064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:56.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.549+0000 7f0b4759e700 1 -- 172.21.15.49:0/4127328204 shutdown_connections 2023-11-30T17:22:56.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.549+0000 7f0b4759e700 1 -- 172.21.15.49:0/4127328204 wait complete. 2023-11-30T17:22:56.553 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2023-11-30T17:22:56.566 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-30T17:22:56.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.685+0000 7f4c34ed5700 1 Processor -- start 2023-11-30T17:22:56.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.685+0000 7f4c34ed5700 1 -- start start 2023-11-30T17:22:56.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.686+0000 7f4c34ed5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c30098d10 0x7f4c300c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:56.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.686+0000 7f4c34ed5700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c300c72d0 con 0x7f4c30158320 2023-11-30T17:22:56.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.686+0000 7f4c34ed5700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c30064570 con 0x7f4c300c6190 2023-11-30T17:22:56.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.686+0000 7f4c34ed5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c30154bc0 con 0x7f4c30098d10 2023-11-30T17:22:56.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.686+0000 7f4c2ed9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4c30158320 0x7f4c300a80f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42034/0 (socket says 172.21.15.49:42034) 2023-11-30T17:22:56.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.686+0000 7f4c2ed9d700 1 -- 172.21.15.49:0/2022106881 learned_addr learned my addr 172.21.15.49:0/2022106881 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:56.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.687+0000 7f4c2e59c700 1 --2- 172.21.15.49:0/2022106881 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c30098d10 0x7f4c300c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:56.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.687+0000 7f4c2d59a700 1 -- 172.21.15.49:0/2022106881 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2343203072 0 0) 0x7f4c300c72d0 con 0x7f4c30158320 2023-11-30T17:22:56.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.687+0000 7f4c2d59a700 1 -- 172.21.15.49:0/2022106881 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c1c0033f0 con 0x7f4c30158320 2023-11-30T17:22:56.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.687+0000 7f4c2d59a700 1 -- 172.21.15.49:0/2022106881 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438685783 0 0) 0x7f4c30064570 con 0x7f4c300c6190 2023-11-30T17:22:56.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.687+0000 7f4c2d59a700 1 -- 172.21.15.49:0/2022106881 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c300c72d0 con 0x7f4c300c6190 2023-11-30T17:22:56.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.687+0000 7f4c2d59a700 1 -- 172.21.15.49:0/2022106881 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4078519485 0 0) 0x7f4c1c0033f0 con 0x7f4c30158320 2023-11-30T17:22:56.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.687+0000 7f4c2e59c700 1 -- 172.21.15.49:0/2022106881 >> v1:172.21.15.115:6789/0 conn(0x7f4c300c6190 legacy=0x7f4c30063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:56.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.687+0000 7f4c2e59c700 1 -- 172.21.15.49:0/2022106881 >> v1:172.21.15.49:6789/0 conn(0x7f4c30158320 legacy=0x7f4c300a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:56.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.687+0000 7f4c2e59c700 1 -- 172.21.15.49:0/2022106881 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c300c66c0 con 0x7f4c30098d10 2023-11-30T17:22:56.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.687+0000 7f4c2e59c700 1 --2- 172.21.15.49:0/2022106881 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c30098d10 0x7f4c300c7760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f4c28009790 tx=0x7f4c28009060).ready entity=mon.2 client_cookie=eebb1dadc24a23aa server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:56.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.687+0000 7f4c2d59a700 1 -- 172.21.15.49:0/2022106881 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c200017f0 con 0x7f4c30098d10 2023-11-30T17:22:56.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.687+0000 7f4c2d59a700 1 -- 172.21.15.49:0/2022106881 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c28011400 con 0x7f4c30098d10 2023-11-30T17:22:56.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.687+0000 7f4c2d59a700 1 -- 172.21.15.49:0/2022106881 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c28011780 con 0x7f4c30098d10 2023-11-30T17:22:56.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.688+0000 7f4c34ed5700 1 -- 172.21.15.49:0/2022106881 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c30098d10 msgr2=0x7f4c300c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:56.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.688+0000 7f4c34ed5700 1 --2- 172.21.15.49:0/2022106881 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c30098d10 0x7f4c300c7760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f4c28009790 tx=0x7f4c28009060).stop 2023-11-30T17:22:56.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.688+0000 7f4c34ed5700 1 -- 172.21.15.49:0/2022106881 shutdown_connections 2023-11-30T17:22:56.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.688+0000 7f4c34ed5700 1 --2- 172.21.15.49:0/2022106881 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c30098d10 0x7f4c300c7760 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:56.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.688+0000 7f4c34ed5700 1 -- 172.21.15.49:0/2022106881 >> 172.21.15.49:0/2022106881 conn(0x7f4c300cb310 msgr2=0x7f4c300cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:56.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.688+0000 7f4c34ed5700 1 -- 172.21.15.49:0/2022106881 shutdown_connections 2023-11-30T17:22:56.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.688+0000 7f4c34ed5700 1 -- 172.21.15.49:0/2022106881 wait complete. 2023-11-30T17:22:56.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.689+0000 7f4c34ed5700 1 Processor -- start 2023-11-30T17:22:56.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.689+0000 7f4c34ed5700 1 -- start start 2023-11-30T17:22:56.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.690+0000 7f4c34ed5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c30098d10 0x7f4c3014e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:56.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.690+0000 7f4c34ed5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c300c6190 0x7f4c301557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:56.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.690+0000 7f4c34ed5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c30158320 0x7f4c30153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:56.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.690+0000 7f4c34ed5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c30164190 con 0x7f4c300c6190 2023-11-30T17:22:56.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.690+0000 7f4c34ed5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c30156c30 con 0x7f4c30098d10 2023-11-30T17:22:56.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.690+0000 7f4c34ed5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c300aea10 con 0x7f4c30158320 2023-11-30T17:22:56.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.690+0000 7f4c2dd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c300c6190 0x7f4c301557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:56.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.690+0000 7f4c2dd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c300c6190 0x7f4c301557a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57098/0 (socket says 172.21.15.49:57098) 2023-11-30T17:22:56.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.690+0000 7f4c2dd9b700 1 -- 172.21.15.49:0/1663753274 learned_addr learned my addr 172.21.15.49:0/1663753274 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:56.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.690+0000 7f4c2e59c700 1 --2- 172.21.15.49:0/1663753274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c30098d10 0x7f4c3014e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:56.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.690+0000 7f4c2ed9d700 1 --2- 172.21.15.49:0/1663753274 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c30158320 0x7f4c30153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:56.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.690+0000 7f4c2dd9b700 1 -- 172.21.15.49:0/1663753274 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c30158320 msgr2=0x7f4c30153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:56.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.690+0000 7f4c2dd9b700 1 --2- 172.21.15.49:0/1663753274 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c30158320 0x7f4c30153340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:56.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.690+0000 7f4c2dd9b700 1 -- 172.21.15.49:0/1663753274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c30098d10 msgr2=0x7f4c3014e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:56.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.690+0000 7f4c2dd9b700 1 --2- 172.21.15.49:0/1663753274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c30098d10 0x7f4c3014e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:56.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.690+0000 7f4c2dd9b700 1 -- 172.21.15.49:0/1663753274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c280092a0 con 0x7f4c300c6190 2023-11-30T17:22:56.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.690+0000 7f4c2dd9b700 1 --2- 172.21.15.49:0/1663753274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c300c6190 0x7f4c301557a0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7f4c1800c490 tx=0x7f4c18007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:56.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.691+0000 7f4c267fc700 1 -- 172.21.15.49:0/1663753274 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1800f470 con 0x7f4c300c6190 2023-11-30T17:22:56.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.691+0000 7f4c267fc700 1 -- 172.21.15.49:0/1663753274 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1800f5d0 con 0x7f4c300c6190 2023-11-30T17:22:56.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.691+0000 7f4c34ed5700 1 -- 172.21.15.49:0/1663753274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c3014ec80 con 0x7f4c300c6190 2023-11-30T17:22:56.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.691+0000 7f4c267fc700 1 -- 172.21.15.49:0/1663753274 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1800f990 con 0x7f4c300c6190 2023-11-30T17:22:56.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.691+0000 7f4c34ed5700 1 -- 172.21.15.49:0/1663753274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c301575e0 con 0x7f4c300c6190 2023-11-30T17:22:56.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.692+0000 7f4c34ed5700 1 -- 172.21.15.49:0/1663753274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c300aeb80 con 0x7f4c300c6190 2023-11-30T17:22:56.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.692+0000 7f4c267fc700 1 -- 172.21.15.49:0/1663753274 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4c1800fd40 con 0x7f4c300c6190 2023-11-30T17:22:56.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.692+0000 7f4c267fc700 1 --2- 172.21.15.49:0/1663753274 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4c1005f270 0x7f4c10061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:56.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.693+0000 7f4c267fc700 1 -- 172.21.15.49:0/1663753274 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f4c180798c0 con 0x7f4c300c6190 2023-11-30T17:22:56.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.693+0000 7f4c2e59c700 1 --2- 172.21.15.49:0/1663753274 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4c1005f270 0x7f4c10061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:56.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.693+0000 7f4c2e59c700 1 --2- 172.21.15.49:0/1663753274 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4c1005f270 0x7f4c10061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f4c2800a010 tx=0x7f4c28016000).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:56.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.697+0000 7f4c267fc700 1 -- 172.21.15.49:0/1663753274 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4c1804aa50 con 0x7f4c300c6190 2023-11-30T17:22:56.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.911+0000 7f4c34ed5700 1 -- 172.21.15.49:0/1663753274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4c3006c860 con 0x7f4c300c6190 2023-11-30T17:22:56.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.916+0000 7f4c267fc700 1 -- 172.21.15.49:0/1663753274 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v36) v1 ==== 174+0+0 (secure 0 0 0) 0x7f4c18007d80 con 0x7f4c300c6190 2023-11-30T17:22:56.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.922+0000 7f4c34ed5700 1 -- 172.21.15.49:0/1663753274 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4c1005f270 msgr2=0x7f4c10061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:56.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.922+0000 7f4c34ed5700 1 --2- 172.21.15.49:0/1663753274 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4c1005f270 0x7f4c10061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f4c2800a010 tx=0x7f4c28016000).stop 2023-11-30T17:22:56.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.922+0000 7f4c34ed5700 1 -- 172.21.15.49:0/1663753274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c300c6190 msgr2=0x7f4c301557a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:56.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.922+0000 7f4c34ed5700 1 --2- 172.21.15.49:0/1663753274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c300c6190 0x7f4c301557a0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7f4c1800c490 tx=0x7f4c18007c60).stop 2023-11-30T17:22:56.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.923+0000 7f4c34ed5700 1 -- 172.21.15.49:0/1663753274 shutdown_connections 2023-11-30T17:22:56.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.923+0000 7f4c34ed5700 1 --2- 172.21.15.49:0/1663753274 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c30158320 0x7f4c30153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:56.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.923+0000 7f4c34ed5700 1 --2- 172.21.15.49:0/1663753274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c30098d10 0x7f4c3014e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:56.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.923+0000 7f4c34ed5700 1 --2- 172.21.15.49:0/1663753274 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4c1005f270 0x7f4c10061730 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:56.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.923+0000 7f4c34ed5700 1 --2- 172.21.15.49:0/1663753274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c300c6190 0x7f4c301557a0 secure :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 rx=0x7f4c1800c490 tx=0x7f4c18007c60).stop 2023-11-30T17:22:56.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.923+0000 7f4c34ed5700 1 -- 172.21.15.49:0/1663753274 >> 172.21.15.49:0/1663753274 conn(0x7f4c300cb310 msgr2=0x7f4c300c0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:56.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.937+0000 7f4c34ed5700 1 -- 172.21.15.49:0/1663753274 shutdown_connections 2023-11-30T17:22:56.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:56.937+0000 7f4c34ed5700 1 -- 172.21.15.49:0/1663753274 wait complete. 2023-11-30T17:22:56.942 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 11 and data pool 12 2023-11-30T17:22:56.954 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:22:57.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.070+0000 7f51712c0700 1 Processor -- start 2023-11-30T17:22:57.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.070+0000 7f51712c0700 1 -- start start 2023-11-30T17:22:57.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.071+0000 7f51712c0700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f516c157a40 0x7f516c0648d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:57.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.071+0000 7f51712c0700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f516c0c12c0 con 0x7f516c0c0180 2023-11-30T17:22:57.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.071+0000 7f51712c0700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f516c0c06b0 con 0x7f516c157660 2023-11-30T17:22:57.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.071+0000 7f51712c0700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f516c0c0990 con 0x7f516c157a40 2023-11-30T17:22:57.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.071+0000 7f516b7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f516c0c0180 0x7f516c0c1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42038/0 (socket says 172.21.15.49:42038) 2023-11-30T17:22:57.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.071+0000 7f516b7fe700 1 -- 172.21.15.49:0/1032673037 learned_addr learned my addr 172.21.15.49:0/1032673037 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:57.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.071+0000 7f5170abf700 1 --2- 172.21.15.49:0/1032673037 >> v2:172.21.15.115:3300/0 conn(0x7f516c157a40 0x7f516c0648d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:57.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.071+0000 7f516affd700 1 -- 172.21.15.49:0/1032673037 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 646010633 0 0) 0x7f516c0c12c0 con 0x7f516c0c0180 2023-11-30T17:22:57.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.072+0000 7f516affd700 1 -- 172.21.15.49:0/1032673037 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51580033f0 con 0x7f516c0c0180 2023-11-30T17:22:57.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.072+0000 7f516affd700 1 -- 172.21.15.49:0/1032673037 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 479515448 0 0) 0x7f516c0c06b0 con 0x7f516c157660 2023-11-30T17:22:57.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.072+0000 7f516affd700 1 -- 172.21.15.49:0/1032673037 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f516c0c12c0 con 0x7f516c157660 2023-11-30T17:22:57.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.072+0000 7f516affd700 1 -- 172.21.15.49:0/1032673037 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1881004548 0 0) 0x7f51580033f0 con 0x7f516c0c0180 2023-11-30T17:22:57.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.072+0000 7f516affd700 1 -- 172.21.15.49:0/1032673037 >> v2:172.21.15.115:3300/0 conn(0x7f516c157a40 msgr2=0x7f516c0648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:57.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.072+0000 7f516affd700 1 --2- 172.21.15.49:0/1032673037 >> v2:172.21.15.115:3300/0 conn(0x7f516c157a40 0x7f516c0648d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:57.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.072+0000 7f516affd700 1 -- 172.21.15.49:0/1032673037 >> v1:172.21.15.115:6789/0 conn(0x7f516c157660 legacy=0x7f516c1589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:57.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.072+0000 7f516affd700 1 -- 172.21.15.49:0/1032673037 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f516c0c0c70 con 0x7f516c0c0180 2023-11-30T17:22:57.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.072+0000 7f516affd700 1 -- 172.21.15.49:0/1032673037 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f5154001470 con 0x7f516c0c0180 2023-11-30T17:22:57.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.072+0000 7f516affd700 1 -- 172.21.15.49:0/1032673037 >> v1:172.21.15.49:6789/0 conn(0x7f516c0c0180 legacy=0x7f516c0c1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:57.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.072+0000 7f516affd700 1 --2- 172.21.15.49:0/1032673037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5158003a70 0x7f5158003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:57.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.072+0000 7f516affd700 1 --2- 172.21.15.49:0/1032673037 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5158004690 0x7f5158004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:57.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.072+0000 7f516affd700 1 --2- 172.21.15.49:0/1032673037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5158005000 0x7f515800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:57.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.072+0000 7f516affd700 1 -- 172.21.15.49:0/1032673037 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516c0c0990 con 0x7f5158005000 2023-11-30T17:22:57.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.072+0000 7f516affd700 1 -- 172.21.15.49:0/1032673037 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515800bf60 con 0x7f5158003a70 2023-11-30T17:22:57.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.072+0000 7f516affd700 1 -- 172.21.15.49:0/1032673037 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515800c0d0 con 0x7f5158004690 2023-11-30T17:22:57.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.072+0000 7f5170abf700 1 --2- 172.21.15.49:0/1032673037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5158005000 0x7f515800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:57.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.072+0000 7f516bfff700 1 --2- 172.21.15.49:0/1032673037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5158003a70 0x7f5158003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:57.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.072+0000 7f516b7fe700 1 --2- 172.21.15.49:0/1032673037 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5158004690 0x7f5158004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:57.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.072+0000 7f5170abf700 1 -- 172.21.15.49:0/1032673037 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5158004690 msgr2=0x7f5158004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:57.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.072+0000 7f5170abf700 1 --2- 172.21.15.49:0/1032673037 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5158004690 0x7f5158004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:57.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.072+0000 7f5170abf700 1 -- 172.21.15.49:0/1032673037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5158003a70 msgr2=0x7f5158003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:57.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.072+0000 7f5170abf700 1 --2- 172.21.15.49:0/1032673037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5158003a70 0x7f5158003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:57.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.072+0000 7f5170abf700 1 -- 172.21.15.49:0/1032673037 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51580033f0 con 0x7f5158005000 2023-11-30T17:22:57.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.072+0000 7f5170abf700 1 -- 172.21.15.49:0/1032673037 reap_dead start 2023-11-30T17:22:57.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.072+0000 7f5170abf700 1 --2- 172.21.15.49:0/1032673037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5158005000 0x7f515800b8e0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f516400e210 tx=0x7f516400b040).ready entity=mon.0 client_cookie=8ed3b9f1215c70b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:57.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.073+0000 7f516affd700 1 -- 172.21.15.49:0/1032673037 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5164009ac0 con 0x7f5158005000 2023-11-30T17:22:57.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.073+0000 7f516affd700 1 -- 172.21.15.49:0/1032673037 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516400f040 con 0x7f5158005000 2023-11-30T17:22:57.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.073+0000 7f516affd700 1 -- 172.21.15.49:0/1032673037 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516400ecd0 con 0x7f5158005000 2023-11-30T17:22:57.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.073+0000 7f51712c0700 1 -- 172.21.15.49:0/1032673037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5158005000 msgr2=0x7f515800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:57.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.073+0000 7f51712c0700 1 --2- 172.21.15.49:0/1032673037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5158005000 0x7f515800b8e0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f516400e210 tx=0x7f516400b040).stop 2023-11-30T17:22:57.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.073+0000 7f51712c0700 1 -- 172.21.15.49:0/1032673037 shutdown_connections 2023-11-30T17:22:57.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.073+0000 7f51712c0700 1 --2- 172.21.15.49:0/1032673037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5158005000 0x7f515800b8e0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:57.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.073+0000 7f51712c0700 1 -- 172.21.15.49:0/1032673037 >> 172.21.15.49:0/1032673037 conn(0x7f516c0cb000 msgr2=0x7f516c0cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:57.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.073+0000 7f51712c0700 1 -- 172.21.15.49:0/1032673037 shutdown_connections 2023-11-30T17:22:57.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.073+0000 7f51712c0700 1 -- 172.21.15.49:0/1032673037 wait complete. 2023-11-30T17:22:57.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.074+0000 7f51712c0700 1 Processor -- start 2023-11-30T17:22:57.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.074+0000 7f51712c0700 1 -- start start 2023-11-30T17:22:57.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.075+0000 7f51712c0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5158005000 0x7f516c154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:57.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.075+0000 7f51712c0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f516c0c48b0 0x7f516c156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:57.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.075+0000 7f51712c0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f516c0c4d30 0x7f516c156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:57.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.075+0000 7f51712c0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516c154fe0 con 0x7f516c0c4d30 2023-11-30T17:22:57.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.075+0000 7f51712c0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516c1552b0 con 0x7f516c0c48b0 2023-11-30T17:22:57.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.075+0000 7f51712c0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f516c155590 con 0x7f5158005000 2023-11-30T17:22:57.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.075+0000 7f5170abf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f516c0c4d30 0x7f516c156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:57.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.075+0000 7f5170abf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f516c0c4d30 0x7f516c156840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57118/0 (socket says 172.21.15.49:57118) 2023-11-30T17:22:57.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.075+0000 7f5170abf700 1 -- 172.21.15.49:0/619452940 learned_addr learned my addr 172.21.15.49:0/619452940 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:57.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.076+0000 7f516bfff700 1 --2- 172.21.15.49:0/619452940 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5158005000 0x7f516c154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:57.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.076+0000 7f5170abf700 1 -- 172.21.15.49:0/619452940 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5158005000 msgr2=0x7f516c154af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:57.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.076+0000 7f5170abf700 1 --2- 172.21.15.49:0/619452940 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5158005000 0x7f516c154af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:57.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.076+0000 7f5170abf700 1 -- 172.21.15.49:0/619452940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f516c0c48b0 msgr2=0x7f516c156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:57.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.076+0000 7f516b7fe700 1 --2- 172.21.15.49:0/619452940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f516c0c48b0 0x7f516c156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:57.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.076+0000 7f5170abf700 1 --2- 172.21.15.49:0/619452940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f516c0c48b0 0x7f516c156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:57.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.076+0000 7f5170abf700 1 -- 172.21.15.49:0/619452940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f516c155870 con 0x7f516c0c4d30 2023-11-30T17:22:57.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.076+0000 7f516b7fe700 1 --2- 172.21.15.49:0/619452940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f516c0c48b0 0x7f516c156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:22:57.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.076+0000 7f5170abf700 1 --2- 172.21.15.49:0/619452940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f516c0c4d30 0x7f516c156840 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f516400afd0 tx=0x7f5164018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:57.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.076+0000 7f5163fff700 1 -- 172.21.15.49:0/619452940 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5164009ac0 con 0x7f516c0c4d30 2023-11-30T17:22:57.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.076+0000 7f5163fff700 1 -- 172.21.15.49:0/619452940 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516401e470 con 0x7f516c0c4d30 2023-11-30T17:22:57.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.076+0000 7f51712c0700 1 -- 172.21.15.49:0/619452940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f516c155b50 con 0x7f516c0c4d30 2023-11-30T17:22:57.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.076+0000 7f5163fff700 1 -- 172.21.15.49:0/619452940 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516401e830 con 0x7f516c0c4d30 2023-11-30T17:22:57.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.076+0000 7f51712c0700 1 -- 172.21.15.49:0/619452940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f516c0ac0d0 con 0x7f516c0c4d30 2023-11-30T17:22:57.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.077+0000 7f51712c0700 1 -- 172.21.15.49:0/619452940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f516c155ff0 con 0x7f516c0c4d30 2023-11-30T17:22:57.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.077+0000 7f5163fff700 1 -- 172.21.15.49:0/619452940 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f5164003020 con 0x7f516c0c4d30 2023-11-30T17:22:57.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.078+0000 7f5163fff700 1 --2- 172.21.15.49:0/619452940 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f514c05f270 0x7f514c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:57.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.078+0000 7f5163fff700 1 -- 172.21.15.49:0/619452940 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f516407c2a0 con 0x7f516c0c4d30 2023-11-30T17:22:57.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.078+0000 7f516bfff700 1 --2- 172.21.15.49:0/619452940 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f514c05f270 0x7f514c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:57.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.078+0000 7f516bfff700 1 --2- 172.21.15.49:0/619452940 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f514c05f270 0x7f514c061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f515c007fd0 tx=0x7f515c009040).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:57.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.082+0000 7f5163fff700 1 -- 172.21.15.49:0/619452940 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f516404d3d0 con 0x7f516c0c4d30 2023-11-30T17:22:57.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.253+0000 7f51712c0700 1 -- 172.21.15.49:0/619452940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f516c06c7c0 con 0x7f516c0c4d30 2023-11-30T17:22:57.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.254+0000 7f5163fff700 1 -- 172.21.15.49:0/619452940 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+16987 (secure 0 0 0) 0x7f5164017020 con 0x7f516c0c4d30 2023-11-30T17:22:57.257 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:57.257 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":97,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:22:56.913096+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:22:55.465005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-11-30T17:22:55.883417+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:22:57.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.256+0000 7f51712c0700 1 -- 172.21.15.49:0/619452940 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f514c05f270 msgr2=0x7f514c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:57.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.256+0000 7f51712c0700 1 --2- 172.21.15.49:0/619452940 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f514c05f270 0x7f514c061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f515c007fd0 tx=0x7f515c009040).stop 2023-11-30T17:22:57.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.256+0000 7f51712c0700 1 -- 172.21.15.49:0/619452940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f516c0c4d30 msgr2=0x7f516c156840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:57.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.256+0000 7f51712c0700 1 --2- 172.21.15.49:0/619452940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f516c0c4d30 0x7f516c156840 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f516400afd0 tx=0x7f5164018000).stop 2023-11-30T17:22:57.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.256+0000 7f51712c0700 1 -- 172.21.15.49:0/619452940 shutdown_connections 2023-11-30T17:22:57.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.256+0000 7f51712c0700 1 --2- 172.21.15.49:0/619452940 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f514c05f270 0x7f514c061730 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:57.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.256+0000 7f51712c0700 1 --2- 172.21.15.49:0/619452940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f516c0c4d30 0x7f516c156840 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:57.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.256+0000 7f51712c0700 1 --2- 172.21.15.49:0/619452940 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5158005000 0x7f516c154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:57.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.256+0000 7f51712c0700 1 --2- 172.21.15.49:0/619452940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f516c0c48b0 0x7f516c156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:57.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.256+0000 7f51712c0700 1 -- 172.21.15.49:0/619452940 >> 172.21.15.49:0/619452940 conn(0x7f516c0cb000 msgr2=0x7f516c150db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:57.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.256+0000 7f51712c0700 1 -- 172.21.15.49:0/619452940 shutdown_connections 2023-11-30T17:22:57.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.256+0000 7f51712c0700 1 -- 172.21.15.49:0/619452940 wait complete. 2023-11-30T17:22:57.271 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:22:57.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.386+0000 7efed390b700 1 Processor -- start 2023-11-30T17:22:57.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.386+0000 7efed390b700 1 -- start start 2023-11-30T17:22:57.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.387+0000 7efed390b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efecc1544e0 0x7efecc1548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:57.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.387+0000 7efed390b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efecc0c6e30 0x7efecc0c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:57.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.387+0000 7efed390b700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efecc0c69a0 con 0x7efecc06a610 2023-11-30T17:22:57.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.387+0000 7efed390b700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efecc0c13a0 con 0x7efecc0c6e30 2023-11-30T17:22:57.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.387+0000 7efed390b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efecc0c1680 con 0x7efecc1544e0 2023-11-30T17:22:57.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.387+0000 7efed1ea8700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efecc0c6e30 0x7efecc0c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:57.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.387+0000 7efed0ea6700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7efecc06a610 0x7efecc0c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42042/0 (socket says 172.21.15.49:42042) 2023-11-30T17:22:57.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.387+0000 7efed0ea6700 1 -- 172.21.15.49:0/2085328941 learned_addr learned my addr 172.21.15.49:0/2085328941 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:57.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.387+0000 7efed16a7700 1 --2- 172.21.15.49:0/2085328941 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efecc1544e0 0x7efecc1548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:57.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.387+0000 7efed1ea8700 1 -- 172.21.15.49:0/2085328941 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efecc1544e0 msgr2=0x7efecc1548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:57.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.387+0000 7efed1ea8700 1 --2- 172.21.15.49:0/2085328941 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efecc1544e0 0x7efecc1548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:57.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.387+0000 7efed1ea8700 1 -- 172.21.15.49:0/2085328941 >> v1:172.21.15.49:6789/0 conn(0x7efecc06a610 legacy=0x7efecc0c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:57.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.387+0000 7efecbfff700 1 -- 172.21.15.49:0/2085328941 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 615033541 0 0) 0x7efecc0c69a0 con 0x7efecc06a610 2023-11-30T17:22:57.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.387+0000 7efed1ea8700 1 -- 172.21.15.49:0/2085328941 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efecc0c6630 con 0x7efecc0c6e30 2023-11-30T17:22:57.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.388+0000 7efed1ea8700 1 --2- 172.21.15.49:0/2085328941 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efecc0c6e30 0x7efecc0c72e0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7efebc009760 tx=0x7efebc009060).ready entity=mon.0 client_cookie=3afa31d093d0d790 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:57.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.388+0000 7efecbfff700 1 -- 172.21.15.49:0/2085328941 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc00f510 con 0x7efecc0c6e30 2023-11-30T17:22:57.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.388+0000 7efecbfff700 1 -- 172.21.15.49:0/2085328941 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efebc00f670 con 0x7efecc0c6e30 2023-11-30T17:22:57.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.388+0000 7efecbfff700 1 -- 172.21.15.49:0/2085328941 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc00f9f0 con 0x7efecc0c6e30 2023-11-30T17:22:57.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.388+0000 7efed390b700 1 -- 172.21.15.49:0/2085328941 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efecc0c6e30 msgr2=0x7efecc0c72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:57.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.388+0000 7efed390b700 1 --2- 172.21.15.49:0/2085328941 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efecc0c6e30 0x7efecc0c72e0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7efebc009760 tx=0x7efebc009060).stop 2023-11-30T17:22:57.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.388+0000 7efed390b700 1 -- 172.21.15.49:0/2085328941 shutdown_connections 2023-11-30T17:22:57.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.388+0000 7efed390b700 1 --2- 172.21.15.49:0/2085328941 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efecc0c6e30 0x7efecc0c72e0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:57.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.388+0000 7efed390b700 1 --2- 172.21.15.49:0/2085328941 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efecc1544e0 0x7efecc1548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:57.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.388+0000 7efed390b700 1 -- 172.21.15.49:0/2085328941 >> 172.21.15.49:0/2085328941 conn(0x7efecc085020 msgr2=0x7efecc094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:57.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.388+0000 7efed390b700 1 -- 172.21.15.49:0/2085328941 shutdown_connections 2023-11-30T17:22:57.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.388+0000 7efed390b700 1 -- 172.21.15.49:0/2085328941 wait complete. 2023-11-30T17:22:57.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.389+0000 7efed390b700 1 Processor -- start 2023-11-30T17:22:57.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.389+0000 7efed390b700 1 -- start start 2023-11-30T17:22:57.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.390+0000 7efed390b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efecc06a610 0x7efecc14ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:57.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.390+0000 7efed390b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efecc0c6e30 0x7efecc0aac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:57.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.390+0000 7efed390b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efecc1544e0 0x7efecc0ab160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:57.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.390+0000 7efed390b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efecc097540 con 0x7efecc0c6e30 2023-11-30T17:22:57.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.390+0000 7efed390b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efecc097820 con 0x7efecc06a610 2023-11-30T17:22:57.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.390+0000 7efed390b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efecc097b00 con 0x7efecc1544e0 2023-11-30T17:22:57.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.390+0000 7efed0ea6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efecc0c6e30 0x7efecc0aac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:57.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.390+0000 7efed0ea6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efecc0c6e30 0x7efecc0aac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57142/0 (socket says 172.21.15.49:57142) 2023-11-30T17:22:57.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.391+0000 7efed0ea6700 1 -- 172.21.15.49:0/2271383105 learned_addr learned my addr 172.21.15.49:0/2271383105 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:57.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.391+0000 7efed1ea8700 1 --2- 172.21.15.49:0/2271383105 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efecc1544e0 0x7efecc0ab160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:57.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.391+0000 7efed16a7700 1 --2- 172.21.15.49:0/2271383105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efecc06a610 0x7efecc14ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:57.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.391+0000 7efed0ea6700 1 -- 172.21.15.49:0/2271383105 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efecc1544e0 msgr2=0x7efecc0ab160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:57.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.391+0000 7efed0ea6700 1 --2- 172.21.15.49:0/2271383105 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efecc1544e0 0x7efecc0ab160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:57.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.391+0000 7efed0ea6700 1 -- 172.21.15.49:0/2271383105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efecc06a610 msgr2=0x7efecc14ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:57.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.391+0000 7efed0ea6700 1 --2- 172.21.15.49:0/2271383105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efecc06a610 0x7efecc14ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:57.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.391+0000 7efed0ea6700 1 -- 172.21.15.49:0/2271383105 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc0092a0 con 0x7efecc0c6e30 2023-11-30T17:22:57.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.391+0000 7efed1ea8700 1 --2- 172.21.15.49:0/2271383105 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efecc1544e0 0x7efecc0ab160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:57.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.391+0000 7efed0ea6700 1 --2- 172.21.15.49:0/2271383105 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efecc0c6e30 0x7efecc0aac70 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7efec000c790 tx=0x7efec0001550).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:57.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.391+0000 7efec97fa700 1 -- 172.21.15.49:0/2271383105 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec0005d30 con 0x7efecc0c6e30 2023-11-30T17:22:57.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.391+0000 7efec97fa700 1 -- 172.21.15.49:0/2271383105 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec0005e90 con 0x7efecc0c6e30 2023-11-30T17:22:57.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.391+0000 7efed390b700 1 -- 172.21.15.49:0/2271383105 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efecc097de0 con 0x7efecc0c6e30 2023-11-30T17:22:57.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.391+0000 7efec97fa700 1 -- 172.21.15.49:0/2271383105 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec0007320 con 0x7efecc0c6e30 2023-11-30T17:22:57.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.391+0000 7efed390b700 1 -- 172.21.15.49:0/2271383105 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efecc14d330 con 0x7efecc0c6e30 2023-11-30T17:22:57.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.392+0000 7efed390b700 1 -- 172.21.15.49:0/2271383105 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efecc098300 con 0x7efecc0c6e30 2023-11-30T17:22:57.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.393+0000 7efec97fa700 1 -- 172.21.15.49:0/2271383105 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7efec0007710 con 0x7efecc0c6e30 2023-11-30T17:22:57.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.393+0000 7efec97fa700 1 --2- 172.21.15.49:0/2271383105 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efeb805f270 0x7efeb8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:57.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.393+0000 7efec97fa700 1 -- 172.21.15.49:0/2271383105 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6149+0+0 (secure 0 0 0) 0x7efec007a460 con 0x7efecc0c6e30 2023-11-30T17:22:57.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.393+0000 7efed16a7700 1 --2- 172.21.15.49:0/2271383105 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efeb805f270 0x7efeb8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:57.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.394+0000 7efed16a7700 1 --2- 172.21.15.49:0/2271383105 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efeb805f270 0x7efeb8061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7efec4009200 tx=0x7efec4008040).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:57.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.397+0000 7efec97fa700 1 -- 172.21.15.49:0/2271383105 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efecc098300 con 0x7efecc0c6e30 2023-11-30T17:22:57.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.571+0000 7efed390b700 1 -- 172.21.15.49:0/2271383105 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efecc098300 con 0x7efecc0c6e30 2023-11-30T17:22:57.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.572+0000 7efec97fa700 1 -- 172.21.15.49:0/2271383105 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+16987 (secure 0 0 0) 0x7efecc098300 con 0x7efecc0c6e30 2023-11-30T17:22:57.575 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:22:57.575 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":97,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:22:56.913096+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:22:55.465005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-11-30T17:22:55.883417+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:22:57.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.574+0000 7efed390b700 1 -- 172.21.15.49:0/2271383105 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efeb805f270 msgr2=0x7efeb8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:57.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.574+0000 7efed390b700 1 --2- 172.21.15.49:0/2271383105 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efeb805f270 0x7efeb8061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7efec4009200 tx=0x7efec4008040).stop 2023-11-30T17:22:57.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.574+0000 7efed390b700 1 -- 172.21.15.49:0/2271383105 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efecc0c6e30 msgr2=0x7efecc0aac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:57.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.574+0000 7efed390b700 1 --2- 172.21.15.49:0/2271383105 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efecc0c6e30 0x7efecc0aac70 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7efec000c790 tx=0x7efec0001550).stop 2023-11-30T17:22:57.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.574+0000 7efed390b700 1 -- 172.21.15.49:0/2271383105 shutdown_connections 2023-11-30T17:22:57.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.574+0000 7efed390b700 1 --2- 172.21.15.49:0/2271383105 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efecc1544e0 0x7efecc0ab160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:57.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.574+0000 7efed390b700 1 --2- 172.21.15.49:0/2271383105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efecc06a610 0x7efecc14ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:57.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.574+0000 7efed390b700 1 --2- 172.21.15.49:0/2271383105 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efeb805f270 0x7efeb8061730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:57.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.574+0000 7efed390b700 1 --2- 172.21.15.49:0/2271383105 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efecc0c6e30 0x7efecc0aac70 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:57.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.574+0000 7efed390b700 1 -- 172.21.15.49:0/2271383105 >> 172.21.15.49:0/2271383105 conn(0x7efecc085020 msgr2=0x7efecc0cbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:57.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.574+0000 7efed390b700 1 -- 172.21.15.49:0/2271383105 shutdown_connections 2023-11-30T17:22:57.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.574+0000 7efed390b700 1 -- 172.21.15.49:0/2271383105 wait complete. 2023-11-30T17:22:57.589 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-30T17:22:57.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.707+0000 7f776de08700 1 Processor -- start 2023-11-30T17:22:57.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.707+0000 7f776de08700 1 -- start start 2023-11-30T17:22:57.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.708+0000 7f776de08700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f776814e530 0x7f77680c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:57.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.708+0000 7f776de08700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7768158570 0x7f7768158a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:57.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.708+0000 7f776de08700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77680c7bc0 con 0x7f7768154950 2023-11-30T17:22:57.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.708+0000 7f776de08700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7768155920 con 0x7f7768158570 2023-11-30T17:22:57.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.708+0000 7f776de08700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7768154dd0 con 0x7f776814e530 2023-11-30T17:22:57.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.708+0000 7f776d607700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7768158570 0x7f7768158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:57.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.708+0000 7f776d607700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7768158570 0x7f7768158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57158/0 (socket says 172.21.15.49:57158) 2023-11-30T17:22:57.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.708+0000 7f776d607700 1 -- 172.21.15.49:0/548081537 learned_addr learned my addr 172.21.15.49:0/548081537 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:57.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.708+0000 7f776ce06700 1 --2- 172.21.15.49:0/548081537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f776814e530 0x7f77680c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:57.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.708+0000 7f776d607700 1 -- 172.21.15.49:0/548081537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f776814e530 msgr2=0x7f77680c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:22:57.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.708+0000 7f776d607700 1 --2- 172.21.15.49:0/548081537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f776814e530 0x7f77680c66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:57.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.708+0000 7f776d607700 1 -- 172.21.15.49:0/548081537 >> v1:172.21.15.115:6789/0 conn(0x7f7768154950 legacy=0x7f776814e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:57.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.708+0000 7f776d607700 1 -- 172.21.15.49:0/548081537 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7768155080 con 0x7f7768158570 2023-11-30T17:22:57.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.708+0000 7f776ce06700 1 --2- 172.21.15.49:0/548081537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f776814e530 0x7f77680c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:22:57.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.708+0000 7f776d607700 1 --2- 172.21.15.49:0/548081537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7768158570 0x7f7768158a20 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7f7760009f20 tx=0x7f7760009840).ready entity=mon.0 client_cookie=cfc5612d8fcbc543 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:57.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.708+0000 7f77677fe700 1 -- 172.21.15.49:0/548081537 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776000e070 con 0x7f7768158570 2023-11-30T17:22:57.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.709+0000 7f77677fe700 1 -- 172.21.15.49:0/548081537 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776000ba80 con 0x7f7768158570 2023-11-30T17:22:57.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.709+0000 7f77677fe700 1 -- 172.21.15.49:0/548081537 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776000be00 con 0x7f7768158570 2023-11-30T17:22:57.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.709+0000 7f776de08700 1 -- 172.21.15.49:0/548081537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7768158570 msgr2=0x7f7768158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:57.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.709+0000 7f776de08700 1 --2- 172.21.15.49:0/548081537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7768158570 0x7f7768158a20 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7f7760009f20 tx=0x7f7760009840).stop 2023-11-30T17:22:57.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.709+0000 7f776de08700 1 -- 172.21.15.49:0/548081537 shutdown_connections 2023-11-30T17:22:57.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.709+0000 7f776de08700 1 --2- 172.21.15.49:0/548081537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f776814e530 0x7f77680c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:57.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.709+0000 7f776de08700 1 --2- 172.21.15.49:0/548081537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7768158570 0x7f7768158a20 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:57.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.709+0000 7f776de08700 1 -- 172.21.15.49:0/548081537 >> 172.21.15.49:0/548081537 conn(0x7f7768064990 msgr2=0x7f7768064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:57.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.709+0000 7f776de08700 1 -- 172.21.15.49:0/548081537 shutdown_connections 2023-11-30T17:22:57.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.709+0000 7f776de08700 1 -- 172.21.15.49:0/548081537 wait complete. 2023-11-30T17:22:57.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.710+0000 7f776de08700 1 Processor -- start 2023-11-30T17:22:57.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.710+0000 7f776de08700 1 -- start start 2023-11-30T17:22:57.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.711+0000 7f776de08700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f776814e530 0x7f77680c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:57.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.711+0000 7f776de08700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7768154950 0x7f77680c55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:57.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.711+0000 7f776de08700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7768158570 0x7f77680af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:57.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.711+0000 7f776de08700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77680c5bb0 con 0x7f7768154950 2023-11-30T17:22:57.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.711+0000 7f776de08700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77680c2a20 con 0x7f7768158570 2023-11-30T17:22:57.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.711+0000 7f776de08700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77680c2d00 con 0x7f776814e530 2023-11-30T17:22:57.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.711+0000 7f7767fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7768154950 0x7f77680c55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:57.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.711+0000 7f7767fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7768154950 0x7f77680c55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57166/0 (socket says 172.21.15.49:57166) 2023-11-30T17:22:57.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.711+0000 7f7767fff700 1 -- 172.21.15.49:0/3812985029 learned_addr learned my addr 172.21.15.49:0/3812985029 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:57.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.711+0000 7f776d607700 1 --2- 172.21.15.49:0/3812985029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7768158570 0x7f77680af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:57.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.711+0000 7f7767fff700 1 -- 172.21.15.49:0/3812985029 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f776814e530 msgr2=0x7f77680c50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:57.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.711+0000 7f776ce06700 1 --2- 172.21.15.49:0/3812985029 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f776814e530 0x7f77680c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:57.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.711+0000 7f7767fff700 1 --2- 172.21.15.49:0/3812985029 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f776814e530 0x7f77680c50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:57.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.711+0000 7f7767fff700 1 -- 172.21.15.49:0/3812985029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7768158570 msgr2=0x7f77680af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:57.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.711+0000 7f7767fff700 1 --2- 172.21.15.49:0/3812985029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7768158570 0x7f77680af000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:57.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.711+0000 7f7767fff700 1 -- 172.21.15.49:0/3812985029 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7760009ae0 con 0x7f7768154950 2023-11-30T17:22:57.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.712+0000 7f7767fff700 1 --2- 172.21.15.49:0/3812985029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7768154950 0x7f77680c55b0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7f775400c4c0 tx=0x7f7754007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:57.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.712+0000 7f7764ff9700 1 -- 172.21.15.49:0/3812985029 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7754007020 con 0x7f7768154950 2023-11-30T17:22:57.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.712+0000 7f7764ff9700 1 -- 172.21.15.49:0/3812985029 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7754007180 con 0x7f7768154950 2023-11-30T17:22:57.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.712+0000 7f776de08700 1 -- 172.21.15.49:0/3812985029 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77680c2fe0 con 0x7f7768154950 2023-11-30T17:22:57.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.712+0000 7f7764ff9700 1 -- 172.21.15.49:0/3812985029 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7754007520 con 0x7f7768154950 2023-11-30T17:22:57.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.712+0000 7f776de08700 1 -- 172.21.15.49:0/3812985029 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f776814e020 con 0x7f7768154950 2023-11-30T17:22:57.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.713+0000 7f776de08700 1 -- 172.21.15.49:0/3812985029 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7768062ee0 con 0x7f7768154950 2023-11-30T17:22:57.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.713+0000 7f7764ff9700 1 -- 172.21.15.49:0/3812985029 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f77540068b0 con 0x7f7768154950 2023-11-30T17:22:57.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.713+0000 7f7764ff9700 1 --2- 172.21.15.49:0/3812985029 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f774c05f2a0 0x7f774c061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:57.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.714+0000 7f7764ff9700 1 -- 172.21.15.49:0/3812985029 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f77540797c0 con 0x7f7768154950 2023-11-30T17:22:57.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.714+0000 7f776ce06700 1 --2- 172.21.15.49:0/3812985029 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f774c05f2a0 0x7f774c061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:57.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.714+0000 7f776ce06700 1 --2- 172.21.15.49:0/3812985029 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f774c05f2a0 0x7f774c061760 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f775c006d80 tx=0x7f775c008040).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:57.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.718+0000 7f7764ff9700 1 -- 172.21.15.49:0/3812985029 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7754047b00 con 0x7f7768154950 2023-11-30T17:22:57.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:57.934+0000 7f776de08700 1 -- 172.21.15.49:0/3812985029 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f77680c34e0 con 0x7f7768154950 2023-11-30T17:22:58.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:58.925+0000 7f7764ff9700 1 -- 172.21.15.49:0/3812985029 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v38) v1 ==== 118+0+0 (secure 0 0 0) 0x7f775404a8f0 con 0x7f7768154950 2023-11-30T17:22:58.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:58.927+0000 7f776de08700 1 -- 172.21.15.49:0/3812985029 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f774c05f2a0 msgr2=0x7f774c061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:58.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:58.927+0000 7f776de08700 1 --2- 172.21.15.49:0/3812985029 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f774c05f2a0 0x7f774c061760 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f775c006d80 tx=0x7f775c008040).stop 2023-11-30T17:22:58.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:58.927+0000 7f776de08700 1 -- 172.21.15.49:0/3812985029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7768154950 msgr2=0x7f77680c55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:58.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:58.927+0000 7f776de08700 1 --2- 172.21.15.49:0/3812985029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7768154950 0x7f77680c55b0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7f775400c4c0 tx=0x7f7754007dd0).stop 2023-11-30T17:22:58.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:58.927+0000 7f776de08700 1 -- 172.21.15.49:0/3812985029 shutdown_connections 2023-11-30T17:22:58.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:58.927+0000 7f776de08700 1 --2- 172.21.15.49:0/3812985029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7768158570 0x7f77680af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:58.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:58.927+0000 7f776de08700 1 --2- 172.21.15.49:0/3812985029 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f776814e530 0x7f77680c50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:58.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:58.927+0000 7f776de08700 1 --2- 172.21.15.49:0/3812985029 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f774c05f2a0 0x7f774c061760 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:58.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:58.927+0000 7f776de08700 1 --2- 172.21.15.49:0/3812985029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7768154950 0x7f77680c55b0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:58.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:58.927+0000 7f776de08700 1 -- 172.21.15.49:0/3812985029 >> 172.21.15.49:0/3812985029 conn(0x7f7768064990 msgr2=0x7f7768153c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:58.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:58.927+0000 7f776de08700 1 -- 172.21.15.49:0/3812985029 shutdown_connections 2023-11-30T17:22:58.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:58.928+0000 7f776de08700 1 -- 172.21.15.49:0/3812985029 wait complete. 2023-11-30T17:22:58.945 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-30T17:22:58.945 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-30T17:22:59.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.070+0000 7f3d8d387700 1 Processor -- start 2023-11-30T17:22:59.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.070+0000 7f3d8d387700 1 -- start start 2023-11-30T17:22:59.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.071+0000 7f3d8d387700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3d88098d10 0x7f3d880c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:59.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.071+0000 7f3d8d387700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d880c72d0 con 0x7f3d88158320 2023-11-30T17:22:59.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.071+0000 7f3d8d387700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d88064570 con 0x7f3d880c6190 2023-11-30T17:22:59.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.071+0000 7f3d8d387700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d88154bc0 con 0x7f3d88098d10 2023-11-30T17:22:59.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.071+0000 7f3d877fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3d88158320 0x7f3d880a80f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42054/0 (socket says 172.21.15.49:42054) 2023-11-30T17:22:59.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.071+0000 7f3d877fe700 1 -- 172.21.15.49:0/1852032711 learned_addr learned my addr 172.21.15.49:0/1852032711 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:22:59.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.071+0000 7f3d86ffd700 1 --2- 172.21.15.49:0/1852032711 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3d88098d10 0x7f3d880c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:59.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.071+0000 7f3d85ffb700 1 -- 172.21.15.49:0/1852032711 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2834493478 0 0) 0x7f3d880c72d0 con 0x7f3d88158320 2023-11-30T17:22:59.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.071+0000 7f3d85ffb700 1 -- 172.21.15.49:0/1852032711 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d700033f0 con 0x7f3d88158320 2023-11-30T17:22:59.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.071+0000 7f3d85ffb700 1 -- 172.21.15.49:0/1852032711 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1099439874 0 0) 0x7f3d88064570 con 0x7f3d880c6190 2023-11-30T17:22:59.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.071+0000 7f3d85ffb700 1 -- 172.21.15.49:0/1852032711 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d880c72d0 con 0x7f3d880c6190 2023-11-30T17:22:59.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.071+0000 7f3d86ffd700 1 -- 172.21.15.49:0/1852032711 >> v1:172.21.15.115:6789/0 conn(0x7f3d880c6190 legacy=0x7f3d88063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:59.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.071+0000 7f3d86ffd700 1 -- 172.21.15.49:0/1852032711 >> v1:172.21.15.49:6789/0 conn(0x7f3d88158320 legacy=0x7f3d880a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:59.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.071+0000 7f3d85ffb700 1 -- 172.21.15.49:0/1852032711 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4206500366 0 0) 0x7f3d700033f0 con 0x7f3d88158320 2023-11-30T17:22:59.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.071+0000 7f3d86ffd700 1 -- 172.21.15.49:0/1852032711 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d880c66c0 con 0x7f3d88098d10 2023-11-30T17:22:59.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.072+0000 7f3d86ffd700 1 --2- 172.21.15.49:0/1852032711 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3d88098d10 0x7f3d880c7760 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f3d78009790 tx=0x7f3d78009060).ready entity=mon.2 client_cookie=4608c89abd34263 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:59.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.072+0000 7f3d85ffb700 1 -- 172.21.15.49:0/1852032711 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d800017f0 con 0x7f3d88098d10 2023-11-30T17:22:59.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.072+0000 7f3d85ffb700 1 -- 172.21.15.49:0/1852032711 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d78011400 con 0x7f3d88098d10 2023-11-30T17:22:59.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.072+0000 7f3d85ffb700 1 -- 172.21.15.49:0/1852032711 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d78011780 con 0x7f3d88098d10 2023-11-30T17:22:59.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.072+0000 7f3d8d387700 1 -- 172.21.15.49:0/1852032711 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3d88098d10 msgr2=0x7f3d880c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:59.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.072+0000 7f3d8d387700 1 --2- 172.21.15.49:0/1852032711 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3d88098d10 0x7f3d880c7760 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f3d78009790 tx=0x7f3d78009060).stop 2023-11-30T17:22:59.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.072+0000 7f3d8d387700 1 -- 172.21.15.49:0/1852032711 shutdown_connections 2023-11-30T17:22:59.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.072+0000 7f3d8d387700 1 --2- 172.21.15.49:0/1852032711 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3d88098d10 0x7f3d880c7760 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:59.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.072+0000 7f3d8d387700 1 -- 172.21.15.49:0/1852032711 >> 172.21.15.49:0/1852032711 conn(0x7f3d880cb310 msgr2=0x7f3d880cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:59.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.072+0000 7f3d8d387700 1 -- 172.21.15.49:0/1852032711 shutdown_connections 2023-11-30T17:22:59.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.072+0000 7f3d8d387700 1 -- 172.21.15.49:0/1852032711 wait complete. 2023-11-30T17:22:59.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.074+0000 7f3d8d387700 1 Processor -- start 2023-11-30T17:22:59.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.074+0000 7f3d8d387700 1 -- start start 2023-11-30T17:22:59.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.074+0000 7f3d8d387700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d88098d10 0x7f3d8814e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:59.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.074+0000 7f3d8d387700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d880c6190 0x7f3d881557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:59.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.074+0000 7f3d8d387700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3d88158320 0x7f3d88153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:59.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.074+0000 7f3d8d387700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d88164190 con 0x7f3d88098d10 2023-11-30T17:22:59.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.074+0000 7f3d8d387700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d88156c30 con 0x7f3d880c6190 2023-11-30T17:22:59.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.074+0000 7f3d8d387700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d880aea10 con 0x7f3d88158320 2023-11-30T17:22:59.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.074+0000 7f3d86ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d88098d10 0x7f3d8814e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:59.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.075+0000 7f3d86ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d88098d10 0x7f3d8814e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57176/0 (socket says 172.21.15.49:57176) 2023-11-30T17:22:59.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.075+0000 7f3d86ffd700 1 -- 172.21.15.49:0/1803536152 learned_addr learned my addr 172.21.15.49:0/1803536152 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:22:59.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.075+0000 7f3d877fe700 1 --2- 172.21.15.49:0/1803536152 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3d88158320 0x7f3d88153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:59.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.075+0000 7f3d867fc700 1 --2- 172.21.15.49:0/1803536152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d880c6190 0x7f3d881557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:59.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.075+0000 7f3d86ffd700 1 -- 172.21.15.49:0/1803536152 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3d88158320 msgr2=0x7f3d88153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:59.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.075+0000 7f3d86ffd700 1 --2- 172.21.15.49:0/1803536152 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3d88158320 0x7f3d88153340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:59.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.075+0000 7f3d86ffd700 1 -- 172.21.15.49:0/1803536152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d880c6190 msgr2=0x7f3d881557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:59.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.075+0000 7f3d86ffd700 1 --2- 172.21.15.49:0/1803536152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d880c6190 0x7f3d881557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:59.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.075+0000 7f3d86ffd700 1 -- 172.21.15.49:0/1803536152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d780092a0 con 0x7f3d88098d10 2023-11-30T17:22:59.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.075+0000 7f3d867fc700 1 --2- 172.21.15.49:0/1803536152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d880c6190 0x7f3d881557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:22:59.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.075+0000 7f3d86ffd700 1 --2- 172.21.15.49:0/1803536152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d88098d10 0x7f3d8814e790 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7f3d78009d80 tx=0x7f3d78016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:59.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.075+0000 7f3d6effd700 1 -- 172.21.15.49:0/1803536152 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d78010950 con 0x7f3d88098d10 2023-11-30T17:22:59.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.075+0000 7f3d6effd700 1 -- 172.21.15.49:0/1803536152 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d78010ab0 con 0x7f3d88098d10 2023-11-30T17:22:59.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.075+0000 7f3d8d387700 1 -- 172.21.15.49:0/1803536152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8814ec80 con 0x7f3d88098d10 2023-11-30T17:22:59.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.075+0000 7f3d6effd700 1 -- 172.21.15.49:0/1803536152 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d78010e50 con 0x7f3d88098d10 2023-11-30T17:22:59.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.075+0000 7f3d8d387700 1 -- 172.21.15.49:0/1803536152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d88157560 con 0x7f3d88098d10 2023-11-30T17:22:59.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.076+0000 7f3d8d387700 1 -- 172.21.15.49:0/1803536152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d8806c860 con 0x7f3d88098d10 2023-11-30T17:22:59.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.076+0000 7f3d6effd700 1 -- 172.21.15.49:0/1803536152 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f3d780263b0 con 0x7f3d88098d10 2023-11-30T17:22:59.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.077+0000 7f3d6effd700 1 --2- 172.21.15.49:0/1803536152 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3d7405f270 0x7f3d74061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:22:59.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.077+0000 7f3d6effd700 1 -- 172.21.15.49:0/1803536152 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f3d7807b310 con 0x7f3d88098d10 2023-11-30T17:22:59.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.077+0000 7f3d867fc700 1 --2- 172.21.15.49:0/1803536152 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3d7405f270 0x7f3d74061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:22:59.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.078+0000 7f3d867fc700 1 --2- 172.21.15.49:0/1803536152 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3d7405f270 0x7f3d74061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f3d880c5850 tx=0x7f3d7c009040).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:22:59.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.081+0000 7f3d6effd700 1 -- 172.21.15.49:0/1803536152 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3d7804c3e0 con 0x7f3d88098d10 2023-11-30T17:22:59.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.297+0000 7f3d8d387700 1 -- 172.21.15.49:0/1803536152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3d880c69a0 con 0x7f3d88098d10 2023-11-30T17:22:59.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.926+0000 7f3d6effd700 1 -- 172.21.15.49:0/1803536152 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v39) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3d780220c0 con 0x7f3d88098d10 2023-11-30T17:22:59.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.929+0000 7f3d8d387700 1 -- 172.21.15.49:0/1803536152 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3d7405f270 msgr2=0x7f3d74061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:59.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.929+0000 7f3d8d387700 1 --2- 172.21.15.49:0/1803536152 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3d7405f270 0x7f3d74061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f3d880c5850 tx=0x7f3d7c009040).stop 2023-11-30T17:22:59.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.929+0000 7f3d8d387700 1 -- 172.21.15.49:0/1803536152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d88098d10 msgr2=0x7f3d8814e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:22:59.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.929+0000 7f3d8d387700 1 --2- 172.21.15.49:0/1803536152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d88098d10 0x7f3d8814e790 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7f3d78009d80 tx=0x7f3d78016000).stop 2023-11-30T17:22:59.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.929+0000 7f3d8d387700 1 -- 172.21.15.49:0/1803536152 shutdown_connections 2023-11-30T17:22:59.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.929+0000 7f3d8d387700 1 --2- 172.21.15.49:0/1803536152 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3d88158320 0x7f3d88153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:59.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.929+0000 7f3d8d387700 1 --2- 172.21.15.49:0/1803536152 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3d7405f270 0x7f3d74061730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:59.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.929+0000 7f3d8d387700 1 --2- 172.21.15.49:0/1803536152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d88098d10 0x7f3d8814e790 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:59.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.929+0000 7f3d8d387700 1 --2- 172.21.15.49:0/1803536152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d880c6190 0x7f3d881557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:22:59.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.929+0000 7f3d8d387700 1 -- 172.21.15.49:0/1803536152 >> 172.21.15.49:0/1803536152 conn(0x7f3d880cb310 msgr2=0x7f3d880c0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:22:59.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.929+0000 7f3d8d387700 1 -- 172.21.15.49:0/1803536152 shutdown_connections 2023-11-30T17:22:59.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:22:59.929+0000 7f3d8d387700 1 -- 172.21.15.49:0/1803536152 wait complete. 2023-11-30T17:22:59.946 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-30T17:22:59.946 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:23:00.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.069+0000 7feafa03e700 1 Processor -- start 2023-11-30T17:23:00.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.069+0000 7feafa03e700 1 -- start start 2023-11-30T17:23:00.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.070+0000 7feafa03e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feaf40caab0 0x7feaf40aa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:00.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.070+0000 7feafa03e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feaf40cae90 0x7feaf40c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:00.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.070+0000 7feafa03e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf40a9a90 con 0x7feaf40aa960 2023-11-30T17:23:00.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.070+0000 7feafa03e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf4154ce0 con 0x7feaf40cae90 2023-11-30T17:23:00.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.070+0000 7feafa03e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf40a8e80 con 0x7feaf40caab0 2023-11-30T17:23:00.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.070+0000 7feaf2ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feaf40cae90 0x7feaf40c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:00.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.070+0000 7feaf3fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7feaf40aa960 0x7feaf40c9170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42062/0 (socket says 172.21.15.49:42062) 2023-11-30T17:23:00.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.070+0000 7feaf3fff700 1 -- 172.21.15.49:0/2792826243 learned_addr learned my addr 172.21.15.49:0/2792826243 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.070+0000 7feaf37fe700 1 --2- 172.21.15.49:0/2792826243 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feaf40caab0 0x7feaf40aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.070+0000 7feaf2ffd700 1 -- 172.21.15.49:0/2792826243 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feaf40caab0 msgr2=0x7feaf40aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.070+0000 7feaf2ffd700 1 --2- 172.21.15.49:0/2792826243 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feaf40caab0 0x7feaf40aa470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.070+0000 7feaf2ffd700 1 -- 172.21.15.49:0/2792826243 >> v1:172.21.15.49:6789/0 conn(0x7feaf40aa960 legacy=0x7feaf40c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.070+0000 7feaf27fc700 1 -- 172.21.15.49:0/2792826243 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1984625524 0 0) 0x7feaf40a9a90 con 0x7feaf40aa960 2023-11-30T17:23:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.070+0000 7feaf2ffd700 1 -- 172.21.15.49:0/2792826243 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf40a9160 con 0x7feaf40cae90 2023-11-30T17:23:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.070+0000 7feaf2ffd700 1 --2- 172.21.15.49:0/2792826243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaf40cae90 0x7feaf40c0ab0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7feae8009760 tx=0x7feae8009060).ready entity=mon.0 client_cookie=b7ae99ab711e396 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.071+0000 7feaf27fc700 1 -- 172.21.15.49:0/2792826243 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae800f510 con 0x7feaf40cae90 2023-11-30T17:23:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.071+0000 7feaf27fc700 1 -- 172.21.15.49:0/2792826243 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae800f670 con 0x7feaf40cae90 2023-11-30T17:23:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.071+0000 7feaf27fc700 1 -- 172.21.15.49:0/2792826243 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae800f9f0 con 0x7feaf40cae90 2023-11-30T17:23:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.071+0000 7feafa03e700 1 -- 172.21.15.49:0/2792826243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaf40cae90 msgr2=0x7feaf40c0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.071+0000 7feafa03e700 1 --2- 172.21.15.49:0/2792826243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaf40cae90 0x7feaf40c0ab0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7feae8009760 tx=0x7feae8009060).stop 2023-11-30T17:23:00.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.071+0000 7feafa03e700 1 -- 172.21.15.49:0/2792826243 shutdown_connections 2023-11-30T17:23:00.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.071+0000 7feafa03e700 1 --2- 172.21.15.49:0/2792826243 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feaf40caab0 0x7feaf40aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:00.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.071+0000 7feafa03e700 1 --2- 172.21.15.49:0/2792826243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaf40cae90 0x7feaf40c0ab0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:00.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.071+0000 7feafa03e700 1 -- 172.21.15.49:0/2792826243 >> 172.21.15.49:0/2792826243 conn(0x7feaf4094920 msgr2=0x7feaf406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:00.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.071+0000 7feafa03e700 1 -- 172.21.15.49:0/2792826243 shutdown_connections 2023-11-30T17:23:00.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.071+0000 7feafa03e700 1 -- 172.21.15.49:0/2792826243 wait complete. 2023-11-30T17:23:00.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.072+0000 7feafa03e700 1 Processor -- start 2023-11-30T17:23:00.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.073+0000 7feafa03e700 1 -- start start 2023-11-30T17:23:00.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.073+0000 7feafa03e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaf40caab0 0x7feaf40c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:00.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.073+0000 7feafa03e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feaf40cae90 0x7feaf40ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:00.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.073+0000 7feafa03e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feaf40aecb0 0x7feaf4167f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:00.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.073+0000 7feafa03e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf40c32e0 con 0x7feaf40caab0 2023-11-30T17:23:00.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.073+0000 7feafa03e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf40c35c0 con 0x7feaf40cae90 2023-11-30T17:23:00.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.073+0000 7feafa03e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf40c38a0 con 0x7feaf40aecb0 2023-11-30T17:23:00.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.073+0000 7feaf37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaf40caab0 0x7feaf40c2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:00.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.073+0000 7feaf37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaf40caab0 0x7feaf40c2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57196/0 (socket says 172.21.15.49:57196) 2023-11-30T17:23:00.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.073+0000 7feaf37fe700 1 -- 172.21.15.49:0/4101571788 learned_addr learned my addr 172.21.15.49:0/4101571788 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:00.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.074+0000 7feaf3fff700 1 --2- 172.21.15.49:0/4101571788 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feaf40aecb0 0x7feaf4167f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:00.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.074+0000 7feaf2ffd700 1 --2- 172.21.15.49:0/4101571788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feaf40cae90 0x7feaf40ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:00.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.074+0000 7feaf37fe700 1 -- 172.21.15.49:0/4101571788 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feaf40aecb0 msgr2=0x7feaf4167f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:00.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.074+0000 7feaf37fe700 1 --2- 172.21.15.49:0/4101571788 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feaf40aecb0 0x7feaf4167f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:00.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.074+0000 7feaf37fe700 1 -- 172.21.15.49:0/4101571788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feaf40cae90 msgr2=0x7feaf40ae7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:00.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.074+0000 7feaf37fe700 1 --2- 172.21.15.49:0/4101571788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feaf40cae90 0x7feaf40ae7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:00.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.074+0000 7feaf37fe700 1 -- 172.21.15.49:0/4101571788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae80092a0 con 0x7feaf40caab0 2023-11-30T17:23:00.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.074+0000 7feaf2ffd700 1 --2- 172.21.15.49:0/4101571788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feaf40cae90 0x7feaf40ae7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:23:00.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.074+0000 7feaf37fe700 1 --2- 172.21.15.49:0/4101571788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaf40caab0 0x7feaf40c2cf0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7feae400e900 tx=0x7feae4006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:00.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.074+0000 7feadb7fe700 1 -- 172.21.15.49:0/4101571788 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae400ee40 con 0x7feaf40caab0 2023-11-30T17:23:00.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.074+0000 7feadb7fe700 1 -- 172.21.15.49:0/4101571788 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae400c850 con 0x7feaf40caab0 2023-11-30T17:23:00.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.074+0000 7feafa03e700 1 -- 172.21.15.49:0/4101571788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf40c3b80 con 0x7feaf40caab0 2023-11-30T17:23:00.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.074+0000 7feadb7fe700 1 -- 172.21.15.49:0/4101571788 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae400cbd0 con 0x7feaf40caab0 2023-11-30T17:23:00.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.074+0000 7feafa03e700 1 -- 172.21.15.49:0/4101571788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf4168400 con 0x7feaf40caab0 2023-11-30T17:23:00.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.075+0000 7feafa03e700 1 -- 172.21.15.49:0/4101571788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf406c860 con 0x7feaf40caab0 2023-11-30T17:23:00.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.076+0000 7feadb7fe700 1 -- 172.21.15.49:0/4101571788 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7feae401b400 con 0x7feaf40caab0 2023-11-30T17:23:00.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.076+0000 7feadb7fe700 1 --2- 172.21.15.49:0/4101571788 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7feae005f270 0x7feae0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:00.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.076+0000 7feadb7fe700 1 -- 172.21.15.49:0/4101571788 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6149+0+0 (secure 0 0 0) 0x7feae407a900 con 0x7feaf40caab0 2023-11-30T17:23:00.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.076+0000 7feaf2ffd700 1 --2- 172.21.15.49:0/4101571788 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7feae005f270 0x7feae0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:00.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.077+0000 7feaf2ffd700 1 --2- 172.21.15.49:0/4101571788 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7feae005f270 0x7feae0061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7feaf40c6040 tx=0x7feae8017000).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:00.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.080+0000 7feadb7fe700 1 -- 172.21.15.49:0/4101571788 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7feae404b9d0 con 0x7feaf40caab0 2023-11-30T17:23:00.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.295+0000 7feafa03e700 1 -- 172.21.15.49:0/4101571788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feaf40a9440 con 0x7feaf40caab0 2023-11-30T17:23:00.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.296+0000 7feadb7fe700 1 -- 172.21.15.49:0/4101571788 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4494 (secure 0 0 0) 0x7feae4016030 con 0x7feaf40caab0 2023-11-30T17:23:00.299 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:00.299 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5906,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3382372491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3382372491},{"type":"v1","addr":"172.21.15.115:6837","nonce":3382372491}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6675,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/962684395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":962684395},{"type":"v1","addr":"172.21.15.49:6834","nonce":962684395}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6678,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1931198509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1931198509},{"type":"v1","addr":"172.21.15.49:6835","nonce":1931198509}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:22:56.913429+0000","modified":"2023-11-30T17:22:59.924885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6687},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6687":{"gid":6687,"name":"d","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/3530976555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3530976555},{"type":"v1","addr":"172.21.15.115:6836","nonce":3530976555}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-11-30T17:23:00.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.298+0000 7feafa03e700 1 -- 172.21.15.49:0/4101571788 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7feae005f270 msgr2=0x7feae0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:00.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.298+0000 7feafa03e700 1 --2- 172.21.15.49:0/4101571788 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7feae005f270 0x7feae0061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7feaf40c6040 tx=0x7feae8017000).stop 2023-11-30T17:23:00.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.298+0000 7feafa03e700 1 -- 172.21.15.49:0/4101571788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaf40caab0 msgr2=0x7feaf40c2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:00.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.298+0000 7feafa03e700 1 --2- 172.21.15.49:0/4101571788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaf40caab0 0x7feaf40c2cf0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7feae400e900 tx=0x7feae4006f40).stop 2023-11-30T17:23:00.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.298+0000 7feafa03e700 1 -- 172.21.15.49:0/4101571788 shutdown_connections 2023-11-30T17:23:00.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.298+0000 7feafa03e700 1 --2- 172.21.15.49:0/4101571788 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feaf40aecb0 0x7feaf4167f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:00.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.298+0000 7feafa03e700 1 --2- 172.21.15.49:0/4101571788 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7feae005f270 0x7feae0061730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:00.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.298+0000 7feafa03e700 1 --2- 172.21.15.49:0/4101571788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaf40caab0 0x7feaf40c2cf0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:00.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.298+0000 7feafa03e700 1 --2- 172.21.15.49:0/4101571788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feaf40cae90 0x7feaf40ae7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:00.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.298+0000 7feafa03e700 1 -- 172.21.15.49:0/4101571788 >> 172.21.15.49:0/4101571788 conn(0x7feaf4094920 msgr2=0x7feaf40a7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:00.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.298+0000 7feafa03e700 1 -- 172.21.15.49:0/4101571788 shutdown_connections 2023-11-30T17:23:00.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.298+0000 7feafa03e700 1 -- 172.21.15.49:0/4101571788 wait complete. 2023-11-30T17:23:00.302 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 39 2023-11-30T17:23:00.313 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:23:00.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.428+0000 7efd123d6700 1 Processor -- start 2023-11-30T17:23:00.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.428+0000 7efd123d6700 1 -- start start 2023-11-30T17:23:00.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.429+0000 7efd123d6700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efd0c064e20 0x7efd0c155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:00.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.429+0000 7efd123d6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd0c095e80 0x7efd0c096310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:00.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.429+0000 7efd123d6700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd0c096800 con 0x7efd0c1544d0 2023-11-30T17:23:00.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.429+0000 7efd123d6700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd0c067650 con 0x7efd0c064e20 2023-11-30T17:23:00.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.429+0000 7efd123d6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c0683d0 con 0x7efd0c095e80 2023-11-30T17:23:00.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.429+0000 7efd0bfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7efd0c1544d0 0x7efd0c066f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42078/0 (socket says 172.21.15.49:42078) 2023-11-30T17:23:00.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.429+0000 7efd0bfff700 1 -- 172.21.15.49:0/3104868408 learned_addr learned my addr 172.21.15.49:0/3104868408 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:00.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.430+0000 7efd10973700 1 --2- 172.21.15.49:0/3104868408 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd0c095e80 0x7efd0c096310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:00.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.430+0000 7efd0b7fe700 1 --2- 172.21.15.49:0/3104868408 >> v2:172.21.15.115:3300/0 conn(0x7efd0c064e20 0x7efd0c155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:00.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.430+0000 7efd0affd700 1 -- 172.21.15.49:0/3104868408 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4284270778 0 0) 0x7efd0c096800 con 0x7efd0c1544d0 2023-11-30T17:23:00.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.430+0000 7efd0affd700 1 -- 172.21.15.49:0/3104868408 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcf40033f0 con 0x7efd0c1544d0 2023-11-30T17:23:00.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.430+0000 7efd0affd700 1 -- 172.21.15.49:0/3104868408 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 870295855 0 0) 0x7efcf40033f0 con 0x7efd0c1544d0 2023-11-30T17:23:00.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.430+0000 7efd0affd700 1 -- 172.21.15.49:0/3104868408 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd0c095e80 msgr2=0x7efd0c096310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:00.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.430+0000 7efd0affd700 1 --2- 172.21.15.49:0/3104868408 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd0c095e80 0x7efd0c096310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:00.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.430+0000 7efd0affd700 1 -- 172.21.15.49:0/3104868408 >> v2:172.21.15.115:3300/0 conn(0x7efd0c064e20 msgr2=0x7efd0c155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:00.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.430+0000 7efd0affd700 1 --2- 172.21.15.49:0/3104868408 >> v2:172.21.15.115:3300/0 conn(0x7efd0c064e20 0x7efd0c155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:00.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.430+0000 7efd0affd700 1 -- 172.21.15.49:0/3104868408 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0c067850 con 0x7efd0c1544d0 2023-11-30T17:23:00.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.430+0000 7efd0affd700 1 -- 172.21.15.49:0/3104868408 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7efcfc0015f0 con 0x7efd0c1544d0 2023-11-30T17:23:00.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.430+0000 7efd0affd700 1 -- 172.21.15.49:0/3104868408 >> v1:172.21.15.49:6789/0 conn(0x7efd0c1544d0 legacy=0x7efd0c066f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:00.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.430+0000 7efd0affd700 1 --2- 172.21.15.49:0/3104868408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcf40038e0 0x7efcf4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:00.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.430+0000 7efd0affd700 1 --2- 172.21.15.49:0/3104868408 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcf4004690 0x7efcf4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:00.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.430+0000 7efd0affd700 1 --2- 172.21.15.49:0/3104868408 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd0c095e80 0x7efcf4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:00.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.430+0000 7efd0affd700 1 -- 172.21.15.49:0/3104868408 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c067650 con 0x7efcf40038e0 2023-11-30T17:23:00.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.430+0000 7efd0affd700 1 -- 172.21.15.49:0/3104868408 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c0683d0 con 0x7efcf4004690 2023-11-30T17:23:00.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.430+0000 7efd0affd700 1 -- 172.21.15.49:0/3104868408 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf400b8e0 con 0x7efd0c095e80 2023-11-30T17:23:00.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.430+0000 7efd0bfff700 1 --2- 172.21.15.49:0/3104868408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcf40038e0 0x7efcf4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:00.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.430+0000 7efd0b7fe700 1 --2- 172.21.15.49:0/3104868408 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcf4004690 0x7efcf4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:00.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.430+0000 7efd10973700 1 --2- 172.21.15.49:0/3104868408 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd0c095e80 0x7efcf4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:00.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.430+0000 7efd0bfff700 1 -- 172.21.15.49:0/3104868408 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd0c095e80 msgr2=0x7efcf4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:00.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.430+0000 7efd0bfff700 1 --2- 172.21.15.49:0/3104868408 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd0c095e80 0x7efcf4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:00.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.430+0000 7efd0bfff700 1 -- 172.21.15.49:0/3104868408 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcf4004690 msgr2=0x7efcf4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:00.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.430+0000 7efd0bfff700 1 --2- 172.21.15.49:0/3104868408 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcf4004690 0x7efcf4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:00.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.430+0000 7efd0bfff700 1 -- 172.21.15.49:0/3104868408 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf40033f0 con 0x7efcf40038e0 2023-11-30T17:23:00.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.430+0000 7efd10973700 1 --2- 172.21.15.49:0/3104868408 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd0c095e80 0x7efcf4005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:23:00.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.431+0000 7efd0bfff700 1 --2- 172.21.15.49:0/3104868408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcf40038e0 0x7efcf4003d00 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7efcfc00c210 tx=0x7efcfc0077a0).ready entity=mon.0 client_cookie=a9919f05087a4192 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:00.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.431+0000 7efd0affd700 1 -- 172.21.15.49:0/3104868408 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc0079d0 con 0x7efcf40038e0 2023-11-30T17:23:00.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.431+0000 7efd0affd700 1 -- 172.21.15.49:0/3104868408 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcfc00cae0 con 0x7efcf40038e0 2023-11-30T17:23:00.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.431+0000 7efd0affd700 1 -- 172.21.15.49:0/3104868408 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc00cea0 con 0x7efcf40038e0 2023-11-30T17:23:00.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.431+0000 7efd123d6700 1 -- 172.21.15.49:0/3104868408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcf40038e0 msgr2=0x7efcf4003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:00.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.431+0000 7efd123d6700 1 --2- 172.21.15.49:0/3104868408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcf40038e0 0x7efcf4003d00 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7efcfc00c210 tx=0x7efcfc0077a0).stop 2023-11-30T17:23:00.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.431+0000 7efd10973700 1 -- 172.21.15.49:0/3104868408 reap_dead start 2023-11-30T17:23:00.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.431+0000 7efd123d6700 1 -- 172.21.15.49:0/3104868408 shutdown_connections 2023-11-30T17:23:00.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.431+0000 7efd123d6700 1 -- 172.21.15.49:0/3104868408 >> 172.21.15.49:0/3104868408 conn(0x7efd0c0631d0 msgr2=0x7efd0c0c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:00.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.431+0000 7efd123d6700 1 -- 172.21.15.49:0/3104868408 shutdown_connections 2023-11-30T17:23:00.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.431+0000 7efd123d6700 1 -- 172.21.15.49:0/3104868408 wait complete. 2023-11-30T17:23:00.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.432+0000 7efd123d6700 1 Processor -- start 2023-11-30T17:23:00.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.433+0000 7efd123d6700 1 -- start start 2023-11-30T17:23:00.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.433+0000 7efd123d6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcf40038e0 0x7efd0c1534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:00.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.433+0000 7efd123d6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd0c1508f0 0x7efd0c0ae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:00.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.433+0000 7efd123d6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd0c0aecc0 0x7efd0c0c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:00.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.433+0000 7efd123d6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c0a9920 con 0x7efd0c0aecc0 2023-11-30T17:23:00.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.433+0000 7efd123d6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c0a8d30 con 0x7efd0c1508f0 2023-11-30T17:23:00.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.433+0000 7efd123d6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c0a8f80 con 0x7efcf40038e0 2023-11-30T17:23:00.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.434+0000 7efd10973700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd0c0aecc0 0x7efd0c0c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:00.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.434+0000 7efd10973700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd0c0aecc0 0x7efd0c0c5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57224/0 (socket says 172.21.15.49:57224) 2023-11-30T17:23:00.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.434+0000 7efd10973700 1 -- 172.21.15.49:0/2720800217 learned_addr learned my addr 172.21.15.49:0/2720800217 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:00.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.434+0000 7efd0b7fe700 1 --2- 172.21.15.49:0/2720800217 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd0c1508f0 0x7efd0c0ae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:00.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.434+0000 7efd0bfff700 1 --2- 172.21.15.49:0/2720800217 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcf40038e0 0x7efd0c1534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:00.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.434+0000 7efd10973700 1 -- 172.21.15.49:0/2720800217 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcf40038e0 msgr2=0x7efd0c1534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:00.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.434+0000 7efd10973700 1 --2- 172.21.15.49:0/2720800217 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcf40038e0 0x7efd0c1534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:00.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.434+0000 7efd10973700 1 -- 172.21.15.49:0/2720800217 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd0c1508f0 msgr2=0x7efd0c0ae7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:00.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.434+0000 7efd10973700 1 --2- 172.21.15.49:0/2720800217 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd0c1508f0 0x7efd0c0ae7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:00.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.434+0000 7efd10973700 1 -- 172.21.15.49:0/2720800217 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0c0a9260 con 0x7efd0c0aecc0 2023-11-30T17:23:00.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.434+0000 7efd0b7fe700 1 --2- 172.21.15.49:0/2720800217 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd0c1508f0 0x7efd0c0ae7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:23:00.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.434+0000 7efd10973700 1 --2- 172.21.15.49:0/2720800217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd0c0aecc0 0x7efd0c0c5b90 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7efd0c0c6c20 tx=0x7efd0400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:00.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.434+0000 7efcf3fff700 1 -- 172.21.15.49:0/2720800217 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0400e030 con 0x7efd0c0aecc0 2023-11-30T17:23:00.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.434+0000 7efcf3fff700 1 -- 172.21.15.49:0/2720800217 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0400f040 con 0x7efd0c0aecc0 2023-11-30T17:23:00.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.434+0000 7efd123d6700 1 -- 172.21.15.49:0/2720800217 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd0c0a9540 con 0x7efd0c0aecc0 2023-11-30T17:23:00.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.434+0000 7efcf3fff700 1 -- 172.21.15.49:0/2720800217 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd04010e40 con 0x7efd0c0aecc0 2023-11-30T17:23:00.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.434+0000 7efd123d6700 1 -- 172.21.15.49:0/2720800217 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd0c0ab700 con 0x7efd0c0aecc0 2023-11-30T17:23:00.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.435+0000 7efd123d6700 1 -- 172.21.15.49:0/2720800217 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd0c0a9a60 con 0x7efd0c0aecc0 2023-11-30T17:23:00.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.436+0000 7efcf3fff700 1 -- 172.21.15.49:0/2720800217 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7efd04015690 con 0x7efd0c0aecc0 2023-11-30T17:23:00.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.436+0000 7efcf3fff700 1 --2- 172.21.15.49:0/2720800217 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efcf805f240 0x7efcf8061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:00.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.436+0000 7efcf3fff700 1 -- 172.21.15.49:0/2720800217 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6149+0+0 (secure 0 0 0) 0x7efd0407abb0 con 0x7efd0c0aecc0 2023-11-30T17:23:00.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.436+0000 7efd0bfff700 1 --2- 172.21.15.49:0/2720800217 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efcf805f240 0x7efcf8061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:00.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.437+0000 7efd0bfff700 1 --2- 172.21.15.49:0/2720800217 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efcf805f240 0x7efcf8061700 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7efcfc000ef0 tx=0x7efcfc013000).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:00.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.440+0000 7efcf3fff700 1 -- 172.21.15.49:0/2720800217 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efd0c0a9a60 con 0x7efd0c0aecc0 2023-11-30T17:23:00.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.611+0000 7efd123d6700 1 -- 172.21.15.49:0/2720800217 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd0c0a9a60 con 0x7efd0c0aecc0 2023-11-30T17:23:00.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.612+0000 7efcf3fff700 1 -- 172.21.15.49:0/2720800217 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+16974 (secure 0 0 0) 0x7efd0c0a9a60 con 0x7efd0c0aecc0 2023-11-30T17:23:00.615 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:00.615 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":98,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:22:57.914809+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:22:55.465005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-11-30T17:22:55.883417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:23:00.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.614+0000 7efd123d6700 1 -- 172.21.15.49:0/2720800217 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efcf805f240 msgr2=0x7efcf8061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:00.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.614+0000 7efd123d6700 1 --2- 172.21.15.49:0/2720800217 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efcf805f240 0x7efcf8061700 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7efcfc000ef0 tx=0x7efcfc013000).stop 2023-11-30T17:23:00.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.614+0000 7efd123d6700 1 -- 172.21.15.49:0/2720800217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd0c0aecc0 msgr2=0x7efd0c0c5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:00.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.614+0000 7efd123d6700 1 --2- 172.21.15.49:0/2720800217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd0c0aecc0 0x7efd0c0c5b90 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7efd0c0c6c20 tx=0x7efd0400b040).stop 2023-11-30T17:23:00.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.614+0000 7efd123d6700 1 -- 172.21.15.49:0/2720800217 shutdown_connections 2023-11-30T17:23:00.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.614+0000 7efd123d6700 1 --2- 172.21.15.49:0/2720800217 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efcf805f240 0x7efcf8061700 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:00.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.614+0000 7efd123d6700 1 --2- 172.21.15.49:0/2720800217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd0c0aecc0 0x7efd0c0c5b90 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:00.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.614+0000 7efd123d6700 1 --2- 172.21.15.49:0/2720800217 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcf40038e0 0x7efd0c1534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:00.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.614+0000 7efd123d6700 1 --2- 172.21.15.49:0/2720800217 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd0c1508f0 0x7efd0c0ae7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:00.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.614+0000 7efd123d6700 1 -- 172.21.15.49:0/2720800217 >> 172.21.15.49:0/2720800217 conn(0x7efd0c0631d0 msgr2=0x7efd0c0be410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:00.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.614+0000 7efd123d6700 1 -- 172.21.15.49:0/2720800217 shutdown_connections 2023-11-30T17:23:00.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.614+0000 7efd123d6700 1 -- 172.21.15.49:0/2720800217 wait complete. 2023-11-30T17:23:00.629 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-30T17:23:00.629 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:23:00.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.744+0000 7feb4eeca700 1 Processor -- start 2023-11-30T17:23:00.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.744+0000 7feb4eeca700 1 -- start start 2023-11-30T17:23:00.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.745+0000 7feb4eeca700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb48062bb0 0x7feb480668c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:00.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.745+0000 7feb4eeca700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb48065760 con 0x7feb48062700 2023-11-30T17:23:00.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.745+0000 7feb4eeca700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb48063040 con 0x7feb481542d0 2023-11-30T17:23:00.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.745+0000 7feb4eeca700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb480c3250 con 0x7feb48062bb0 2023-11-30T17:23:00.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.745+0000 7feb47fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7feb48062700 0x7feb480661b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39062/0 (socket says 172.21.15.49:39062) 2023-11-30T17:23:00.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.746+0000 7feb47fff700 1 -- 172.21.15.49:0/1002253374 learned_addr learned my addr 172.21.15.49:0/1002253374 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:00.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.746+0000 7feb4d467700 1 --2- 172.21.15.49:0/1002253374 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb48062bb0 0x7feb480668c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:00.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.746+0000 7feb477fe700 1 -- 172.21.15.49:0/1002253374 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 963980247 0 0) 0x7feb48065760 con 0x7feb48062700 2023-11-30T17:23:00.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.746+0000 7feb477fe700 1 -- 172.21.15.49:0/1002253374 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb340033f0 con 0x7feb48062700 2023-11-30T17:23:00.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.746+0000 7feb477fe700 1 -- 172.21.15.49:0/1002253374 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1280165107 0 0) 0x7feb340033f0 con 0x7feb48062700 2023-11-30T17:23:00.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.746+0000 7feb477fe700 1 -- 172.21.15.49:0/1002253374 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb48062bb0 msgr2=0x7feb480668c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:00.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.746+0000 7feb477fe700 1 --2- 172.21.15.49:0/1002253374 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb48062bb0 0x7feb480668c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:00.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.746+0000 7feb477fe700 1 -- 172.21.15.49:0/1002253374 >> v1:172.21.15.115:6789/0 conn(0x7feb481542d0 legacy=0x7feb480697f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:00.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.746+0000 7feb477fe700 1 -- 172.21.15.49:0/1002253374 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4806a340 con 0x7feb48062700 2023-11-30T17:23:00.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.746+0000 7feb477fe700 1 -- 172.21.15.49:0/1002253374 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7feb380017f0 con 0x7feb48062700 2023-11-30T17:23:00.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.746+0000 7feb477fe700 1 -- 172.21.15.49:0/1002253374 >> v1:172.21.15.49:6789/0 conn(0x7feb48062700 legacy=0x7feb480661b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:00.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.746+0000 7feb477fe700 1 --2- 172.21.15.49:0/1002253374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb34003910 0x7feb34003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:00.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.746+0000 7feb477fe700 1 --2- 172.21.15.49:0/1002253374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb34004690 0x7feb34004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:00.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.746+0000 7feb477fe700 1 --2- 172.21.15.49:0/1002253374 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb48062bb0 0x7feb34005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:00.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.746+0000 7feb477fe700 1 -- 172.21.15.49:0/1002253374 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb480c3250 con 0x7feb34004690 2023-11-30T17:23:00.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.746+0000 7feb477fe700 1 -- 172.21.15.49:0/1002253374 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3400b8e0 con 0x7feb34003910 2023-11-30T17:23:00.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.746+0000 7feb477fe700 1 -- 172.21.15.49:0/1002253374 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb3400ba70 con 0x7feb48062bb0 2023-11-30T17:23:00.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.746+0000 7feb47fff700 1 --2- 172.21.15.49:0/1002253374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb34004690 0x7feb34004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:00.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.746+0000 7feb4cc66700 1 --2- 172.21.15.49:0/1002253374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb34003910 0x7feb34003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:00.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.746+0000 7feb4d467700 1 --2- 172.21.15.49:0/1002253374 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb48062bb0 0x7feb34005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:00.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.747+0000 7feb47fff700 1 -- 172.21.15.49:0/1002253374 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb48062bb0 msgr2=0x7feb34005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:00.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.747+0000 7feb47fff700 1 --2- 172.21.15.49:0/1002253374 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb48062bb0 0x7feb34005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:00.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.747+0000 7feb47fff700 1 -- 172.21.15.49:0/1002253374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb34003910 msgr2=0x7feb34003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:00.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.747+0000 7feb47fff700 1 --2- 172.21.15.49:0/1002253374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb34003910 0x7feb34003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:00.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.747+0000 7feb47fff700 1 -- 172.21.15.49:0/1002253374 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb340033f0 con 0x7feb34004690 2023-11-30T17:23:00.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.747+0000 7feb4d467700 1 --2- 172.21.15.49:0/1002253374 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb48062bb0 0x7feb34005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:23:00.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.747+0000 7feb47fff700 1 --2- 172.21.15.49:0/1002253374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb34004690 0x7feb34004b10 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7feb3800c5f0 tx=0x7feb38001d90).ready entity=mon.0 client_cookie=5e9bbc4c0a60fb42 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:00.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.747+0000 7feb477fe700 1 -- 172.21.15.49:0/1002253374 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb38001fc0 con 0x7feb34004690 2023-11-30T17:23:00.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.747+0000 7feb477fe700 1 -- 172.21.15.49:0/1002253374 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb38005b20 con 0x7feb34004690 2023-11-30T17:23:00.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.747+0000 7feb477fe700 1 -- 172.21.15.49:0/1002253374 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb380070d0 con 0x7feb34004690 2023-11-30T17:23:00.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.747+0000 7feb4eeca700 1 -- 172.21.15.49:0/1002253374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb34004690 msgr2=0x7feb34004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:00.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.747+0000 7feb4eeca700 1 --2- 172.21.15.49:0/1002253374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb34004690 0x7feb34004b10 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7feb3800c5f0 tx=0x7feb38001d90).stop 2023-11-30T17:23:00.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.747+0000 7feb4d467700 1 -- 172.21.15.49:0/1002253374 reap_dead start 2023-11-30T17:23:00.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.747+0000 7feb4eeca700 1 -- 172.21.15.49:0/1002253374 shutdown_connections 2023-11-30T17:23:00.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.747+0000 7feb4eeca700 1 -- 172.21.15.49:0/1002253374 >> 172.21.15.49:0/1002253374 conn(0x7feb480c7fd0 msgr2=0x7feb480c83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:00.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.747+0000 7feb4eeca700 1 -- 172.21.15.49:0/1002253374 shutdown_connections 2023-11-30T17:23:00.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.747+0000 7feb4eeca700 1 -- 172.21.15.49:0/1002253374 wait complete. 2023-11-30T17:23:00.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.748+0000 7feb4eeca700 1 Processor -- start 2023-11-30T17:23:00.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.749+0000 7feb4eeca700 1 -- start start 2023-11-30T17:23:00.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.749+0000 7feb4eeca700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb34004690 0x7feb480a4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:00.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.749+0000 7feb4eeca700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb480a5490 0x7feb480c1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:00.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.749+0000 7feb4eeca700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb480c1580 0x7feb480c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:00.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.749+0000 7feb4eeca700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4814cbd0 con 0x7feb480a5490 2023-11-30T17:23:00.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.749+0000 7feb4eeca700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb480a5910 con 0x7feb34004690 2023-11-30T17:23:00.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.749+0000 7feb4eeca700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb48153320 con 0x7feb480c1580 2023-11-30T17:23:00.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.750+0000 7feb47fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb480a5490 0x7feb480c1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:00.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.750+0000 7feb47fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb480a5490 0x7feb480c1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37768/0 (socket says 172.21.15.49:37768) 2023-11-30T17:23:00.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.750+0000 7feb47fff700 1 -- 172.21.15.49:0/8277758 learned_addr learned my addr 172.21.15.49:0/8277758 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:00.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.750+0000 7feb4d467700 1 --2- 172.21.15.49:0/8277758 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb480c1580 0x7feb480c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:00.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.750+0000 7feb4cc66700 1 --2- 172.21.15.49:0/8277758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb34004690 0x7feb480a4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:00.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.750+0000 7feb47fff700 1 -- 172.21.15.49:0/8277758 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb480c1580 msgr2=0x7feb480c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:00.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.750+0000 7feb47fff700 1 --2- 172.21.15.49:0/8277758 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb480c1580 0x7feb480c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:00.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.750+0000 7feb47fff700 1 -- 172.21.15.49:0/8277758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb34004690 msgr2=0x7feb480a4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:00.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.750+0000 7feb47fff700 1 --2- 172.21.15.49:0/8277758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb34004690 0x7feb480a4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:00.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.750+0000 7feb47fff700 1 -- 172.21.15.49:0/8277758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb48153600 con 0x7feb480a5490 2023-11-30T17:23:00.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.750+0000 7feb47fff700 1 --2- 172.21.15.49:0/8277758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb480a5490 0x7feb480c1090 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7feb38005ac0 tx=0x7feb38015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:00.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.750+0000 7feb44ff9700 1 -- 172.21.15.49:0/8277758 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb38001fc0 con 0x7feb480a5490 2023-11-30T17:23:00.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.750+0000 7feb44ff9700 1 -- 172.21.15.49:0/8277758 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb380017b0 con 0x7feb480a5490 2023-11-30T17:23:00.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.750+0000 7feb44ff9700 1 -- 172.21.15.49:0/8277758 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb38007a00 con 0x7feb480a5490 2023-11-30T17:23:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.750+0000 7feb4eeca700 1 -- 172.21.15.49:0/8277758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb481538e0 con 0x7feb480a5490 2023-11-30T17:23:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.750+0000 7feb4eeca700 1 -- 172.21.15.49:0/8277758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb481676e0 con 0x7feb480a5490 2023-11-30T17:23:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.751+0000 7feb4eeca700 1 -- 172.21.15.49:0/8277758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb4806c860 con 0x7feb480a5490 2023-11-30T17:23:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.751+0000 7feb44ff9700 1 -- 172.21.15.49:0/8277758 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7feb38004c40 con 0x7feb480a5490 2023-11-30T17:23:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.752+0000 7feb44ff9700 1 --2- 172.21.15.49:0/8277758 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7feb2805f240 0x7feb28061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.752+0000 7feb44ff9700 1 -- 172.21.15.49:0/8277758 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6149+0+0 (secure 0 0 0) 0x7feb3801c040 con 0x7feb480a5490 2023-11-30T17:23:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.752+0000 7feb4cc66700 1 --2- 172.21.15.49:0/8277758 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7feb2805f240 0x7feb28061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.752+0000 7feb4cc66700 1 --2- 172.21.15.49:0/8277758 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7feb2805f240 0x7feb28061700 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7feb400010e0 tx=0x7feb40007b90).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.756+0000 7feb44ff9700 1 -- 172.21.15.49:0/8277758 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7feb3804c7b0 con 0x7feb480a5490 2023-11-30T17:23:00.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.926+0000 7feb4eeca700 1 -- 172.21.15.49:0/8277758 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feb480c7d30 con 0x7feb2805f240 2023-11-30T17:23:00.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.937+0000 7feb44ff9700 1 -- 172.21.15.49:0/8277758 <== mgr.6358 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350112 (secure 0 0 0) 0x7feb480c7d30 con 0x7feb2805f240 2023-11-30T17:23:00.944 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:00.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.940+0000 7feb4eeca700 1 -- 172.21.15.49:0/8277758 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7feb2805f240 msgr2=0x7feb28061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:00.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.940+0000 7feb4eeca700 1 --2- 172.21.15.49:0/8277758 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7feb2805f240 0x7feb28061700 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7feb400010e0 tx=0x7feb40007b90).stop 2023-11-30T17:23:00.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.940+0000 7feb4eeca700 1 -- 172.21.15.49:0/8277758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb480a5490 msgr2=0x7feb480c1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:00.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.940+0000 7feb4eeca700 1 --2- 172.21.15.49:0/8277758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb480a5490 0x7feb480c1090 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7feb38005ac0 tx=0x7feb38015000).stop 2023-11-30T17:23:00.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.940+0000 7feb4eeca700 1 -- 172.21.15.49:0/8277758 shutdown_connections 2023-11-30T17:23:00.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.940+0000 7feb4eeca700 1 --2- 172.21.15.49:0/8277758 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb480c1580 0x7feb480c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:00.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.940+0000 7feb4eeca700 1 --2- 172.21.15.49:0/8277758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb34004690 0x7feb480a4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:00.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.940+0000 7feb4eeca700 1 --2- 172.21.15.49:0/8277758 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7feb2805f240 0x7feb28061700 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:00.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.940+0000 7feb4eeca700 1 --2- 172.21.15.49:0/8277758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb480a5490 0x7feb480c1090 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:00.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.940+0000 7feb4eeca700 1 -- 172.21.15.49:0/8277758 >> 172.21.15.49:0/8277758 conn(0x7feb480c7fd0 msgr2=0x7feb480677a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:00.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.941+0000 7feb4eeca700 1 -- 172.21.15.49:0/8277758 shutdown_connections 2023-11-30T17:23:00.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:00.941+0000 7feb4eeca700 1 -- 172.21.15.49:0/8277758 wait complete. 2023-11-30T17:23:00.948 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:23:00.956 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-11-30T17:23:00.411865+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2422556,"kb_used_data":8924,"kb_used_omap":0,"kb_used_meta":2413568,"kb_avail":752552164,"statfs":{"total":773094113280,"available":770613415936,"internally_reserved":0,"allocated":9138176,"data_stored":4555168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2471493632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11233,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-64,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.008507"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-11-30T17:22:52.444920+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:22:52.444920+0000","last_peered":"2023-11-30T17:22:52.444920+0000","last_clean":"2023-11-30T17:22:52.444920+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:22:52.444920+0000","last_undegraded":"2023-11-30T17:22:52.444920+0000","last_fullsized":"2023-11-30T17:22:52.444920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":74,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-30T17:22:52.971184+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:22:52.971184+0000","last_peered":"2023-11-30T17:22:52.971184+0000","last_clean":"2023-11-30T17:22:52.971184+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:22:52.971184+0000","last_undegraded":"2023-11-30T17:22:52.971184+0000","last_fullsized":"2023-11-30T17:22:52.971184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":79,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-11-30T17:22:53.019960+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:22:53.019960+0000","last_peered":"2023-11-30T17:22:53.019960+0000","last_clean":"2023-11-30T17:22:53.019960+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:22:53.019960+0000","last_undegraded":"2023-11-30T17:22:53.019960+0000","last_fullsized":"2023-11-30T17:22:53.019960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":74,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-30T17:22:52.971182+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:22:52.971182+0000","last_peered":"2023-11-30T17:22:52.971182+0000","last_clean":"2023-11-30T17:22:52.971182+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:22:52.971182+0000","last_undegraded":"2023-11-30T17:22:52.971182+0000","last_fullsized":"2023-11-30T17:22:52.971182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":77,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-30T17:22:53.019763+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:22:53.019763+0000","last_peered":"2023-11-30T17:22:53.019763+0000","last_clean":"2023-11-30T17:22:53.019763+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:22:53.019763+0000","last_undegraded":"2023-11-30T17:22:53.019763+0000","last_fullsized":"2023-11-30T17:22:53.019763+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-30T17:22:53.019795+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:22:53.019795+0000","last_peered":"2023-11-30T17:22:53.019795+0000","last_clean":"2023-11-30T17:22:53.019795+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:22:53.019795+0000","last_undegraded":"2023-11-30T17:22:53.019795+0000","last_fullsized":"2023-11-30T17:22:53.019795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":75,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-30T17:22:53.019792+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:22:53.019792+0000","last_peered":"2023-11-30T17:22:53.019792+0000","last_clean":"2023-11-30T17:22:53.019792+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:22:53.019792+0000","last_undegraded":"2023-11-30T17:22:53.019792+0000","last_fullsized":"2023-11-30T17:22:53.019792+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-11-30T17:22:52.444927+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:22:52.444927+0000","last_peered":"2023-11-30T17:22:52.444927+0000","last_clean":"2023-11-30T17:22:52.444927+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:22:52.444927+0000","last_undegraded":"2023-11-30T17:22:52.444927+0000","last_fullsized":"2023-11-30T17:22:52.444927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":82,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-30T17:22:52.445193+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:22:52.445193+0000","last_peered":"2023-11-30T17:22:52.445193+0000","last_clean":"2023-11-30T17:22:52.445193+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:22:52.445193+0000","last_undegraded":"2023-11-30T17:22:52.445193+0000","last_fullsized":"2023-11-30T17:22:52.445193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575036,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298204,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073636,"statfs":{"total":96636764160,"available":96331403264,"internally_reserved":0,"allocated":1134592,"data_stored":565694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.371,"5min":0.315,"15min":0.23899999999999999},"max":{"1min":0.72399999999999998,"5min":0.80400000000000005,"15min":0.81100000000000005},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57499999999999996,"15min":0.58199999999999996},"min":{"1min":0.41099999999999998,"5min":0.40699999999999997,"15min":0.32200000000000001},"max":{"1min":0.74099999999999999,"5min":0.78300000000000003,"15min":0.81899999999999995},"last":0.54800000000000004}]},{"osd":1,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70899999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.32900000000000001,"5min":0.29899999999999999,"15min":0.28799999999999998},"max":{"1min":0.64000000000000001,"5min":0.76100000000000001,"15min":0.82499999999999996},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53800000000000003,"15min":0.54900000000000004},"min":{"1min":0.37,"5min":0.33500000000000002,"15min":0.32800000000000001},"max":{"1min":0.68200000000000005,"5min":0.77000000000000002,"15min":0.78300000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.38800000000000001,"5min":0.35399999999999998,"15min":0.28699999999999998},"max":{"1min":0.70499999999999996,"5min":0.73799999999999999,"15min":0.83899999999999997},"last":0.60299999999999998}]},{"osd":3,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.53400000000000003,"15min":0.54100000000000004},"min":{"1min":0.378,"5min":0.36499999999999999,"15min":0.33200000000000002},"max":{"1min":0.65700000000000003,"5min":0.754,"15min":0.78000000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56999999999999995,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.40799999999999997,"15min":0.33900000000000002},"max":{"1min":0.67500000000000004,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44600000000000001,"15min":0.45800000000000002},"min":{"1min":0.32400000000000001,"5min":0.313,"15min":0.29699999999999999},"max":{"1min":0.55000000000000004,"5min":0.77000000000000002,"15min":0.79900000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.30099999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59899999999999998,"5min":0.75800000000000001,"15min":1.3180000000000001},"last":0.34899999999999998}]},{"osd":5,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.48399999999999999,"15min":0.49099999999999999},"min":{"1min":0.317,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58699999999999997,"5min":0.80000000000000004,"15min":0.82899999999999996},"last":0.375},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.61199999999999999,"5min":0.79300000000000004,"15min":0.872},"last":0.48699999999999999}]},{"osd":6,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.69699999999999995,"5min":0.81200000000000006,"15min":0.85199999999999998},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.33700000000000002},"max":{"1min":0.67300000000000004,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.312}]}]},{"osd":6,"up_from":13,"seq":55834575035,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":1146880,"data_stored":571638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.57099999999999995},"min":{"1min":0.38100000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72899999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56499999999999995,"15min":0.58699999999999997},"min":{"1min":0.46300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.748,"5min":0.79600000000000004,"15min":0.89300000000000002},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54600000000000004,"15min":0.56399999999999995},"min":{"1min":0.32800000000000001,"5min":0.30599999999999999,"15min":0.26400000000000001},"max":{"1min":0.75800000000000001,"5min":0.76900000000000002,"15min":0.82799999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58199999999999996,"15min":0.59899999999999998},"min":{"1min":0.45100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.751,"5min":0.82499999999999996,"15min":0.85199999999999998},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56000000000000005,"15min":0.57299999999999995},"min":{"1min":0.371,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.77500000000000002,"5min":0.79900000000000004,"15min":0.82599999999999996},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.40699999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76100000000000001,"5min":0.80900000000000005,"15min":0.82499999999999996},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51100000000000001,"15min":0.53200000000000003},"min":{"1min":0.40400000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71899999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73499999999999999,"5min":0.75600000000000001,"15min":0.79600000000000004},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44600000000000001,"15min":0.45300000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.84199999999999997},"last":0.439},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46100000000000002,"15min":0.47799999999999998},"min":{"1min":0.34999999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.746,"5min":0.76000000000000001,"15min":0.83899999999999997},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.45900000000000002,"15min":0.47199999999999998},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.28299999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.496,"15min":0.50700000000000001},"min":{"1min":0.38400000000000001,"5min":0.33500000000000002,"15min":0.31900000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.34499999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.74199999999999999,"5min":0.80700000000000005,"15min":0.93200000000000005},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55100000000000005,"15min":0.56299999999999994},"min":{"1min":0.43099999999999999,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.86499999999999999},"last":0.53900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575035,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":1146880,"data_stored":571638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.378,"15min":0.35999999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23000000000000001},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.48699999999999999,"15min":0.47199999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.309},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.442}]},{"osd":2,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.38900000000000001},"min":{"1min":0.249,"5min":0.215,"15min":0.215},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.502},"min":{"1min":0.36499999999999999,"5min":0.33400000000000002,"15min":0.29499999999999998},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.46600000000000003,"15min":0.45200000000000001},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.23899999999999999},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.44800000000000001,"15min":0.435},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.39800000000000002}]},{"osd":4,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.35499999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.83499999999999996,"5min":0.88500000000000001,"15min":0.89100000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.61899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.39900000000000002},"max":{"1min":0.85099999999999998,"5min":0.97599999999999998,"15min":1.111},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.46500000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.39600000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.91300000000000003},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.64800000000000002,"15min":0.65900000000000003},"min":{"1min":0.46500000000000002,"5min":0.39700000000000002,"15min":0.39600000000000002},"max":{"1min":0.91000000000000003,"5min":0.92700000000000005,"15min":1.0600000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66100000000000003,"15min":0.66500000000000004},"min":{"1min":0.437,"5min":0.433,"15min":0.379},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.39900000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.94199999999999995},"last":0.68700000000000006}]}]},{"osd":0,"up_from":13,"seq":55834575035,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":1146880,"data_stored":571638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.375,"15min":0.36499999999999999},"min":{"1min":0.23200000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.51700000000000002,"5min":0.59999999999999998,"15min":0.71199999999999997},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38700000000000001,"15min":0.38400000000000001},"min":{"1min":0.26100000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.54400000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.31}]},{"osd":2,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.38700000000000001,"15min":0.38400000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.23899999999999999},"max":{"1min":0.55900000000000005,"5min":0.623,"15min":0.623},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.313,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.54600000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.378}]},{"osd":3,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.42499999999999999,"15min":0.42799999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.60799999999999998,"5min":0.66100000000000003,"15min":0.70999999999999996},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.438,"15min":0.439},"min":{"1min":0.27300000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.52800000000000002,"5min":0.64700000000000002,"15min":0.68799999999999994},"last":0.35199999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.42899999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78800000000000003,"5min":0.83999999999999997,"15min":0.96099999999999997},"last":0.497},{"interface":"front","average":{"1min":0.629,"5min":0.622,"15min":0.621},"min":{"1min":0.44,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.98599999999999999},"last":0.45800000000000002}]},{"osd":5,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.44400000000000001,"5min":0.39200000000000002,"15min":0.36199999999999999},"max":{"1min":0.86799999999999999,"5min":0.92400000000000004,"15min":1.0109999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.628,"15min":0.629},"min":{"1min":0.45000000000000001,"5min":0.38400000000000001,"15min":0.38},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":1.004},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.64500000000000002,"15min":0.64400000000000002},"min":{"1min":0.47799999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.88,"5min":1.002,"15min":1.002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63400000000000001,"15min":0.63200000000000001},"min":{"1min":0.46999999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89300000000000002,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66000000000000003,"15min":0.65200000000000002},"min":{"1min":0.48199999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86099999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69199999999999995,"15min":0.68799999999999994},"min":{"1min":0.54000000000000004,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92700000000000005,"5min":0.97699999999999998,"15min":1.026},"last":0.54600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575035,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306408,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065432,"statfs":{"total":96636764160,"available":96323002368,"internally_reserved":0,"allocated":1146880,"data_stored":571638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.42699999999999999,"15min":0.40200000000000002},"min":{"1min":0.27700000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":3.4729999999999999,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.44700000000000001,"15min":0.437},"min":{"1min":0.312,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":0.437}]},{"osd":1,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.51300000000000001,"15min":0.46300000000000002},"min":{"1min":0.28699999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":6.1210000000000004,"5min":6.1210000000000004,"15min":6.1210000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.52900000000000003,"15min":0.48899999999999999},"min":{"1min":0.34999999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":5.7270000000000003,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.33800000000000002}]},{"osd":3,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38600000000000001,"15min":0.40000000000000002},"min":{"1min":0.27800000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.48799999999999999,"5min":0.63500000000000001,"15min":0.86199999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47299999999999998,"15min":0.46700000000000003},"min":{"1min":0.29699999999999999,"5min":0.26900000000000002,"15min":0.26200000000000001},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.374}]},{"osd":4,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.69699999999999995,"15min":0.64200000000000002},"min":{"1min":0.432,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":8.7170000000000005,"5min":8.7170000000000005,"15min":8.7170000000000005},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.381,"5min":1.492,"15min":1.492},"last":0.77700000000000002}]},{"osd":5,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.65600000000000003,"15min":0.63900000000000001},"min":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.44400000000000001,"5min":0.38900000000000001,"15min":0.38100000000000001},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.76600000000000001}]},{"osd":6,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61399999999999999,"15min":0.623},"min":{"1min":0.40899999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95999999999999996,"5min":1.359,"15min":1.359},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":0.751}]},{"osd":7,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.70699999999999996,"15min":0.68300000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.40300000000000002},"max":{"1min":4.6849999999999996,"5min":4.6849999999999996,"15min":4.6849999999999996},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.70099999999999996,"15min":0.69099999999999995},"min":{"1min":0.45700000000000002,"5min":0.433,"15min":0.41499999999999998},"max":{"1min":4.5039999999999996,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.73899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575035,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306408,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065432,"statfs":{"total":96636764160,"available":96323002368,"internally_reserved":0,"allocated":1146880,"data_stored":571638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.34799999999999998,"15min":0.36399999999999999},"min":{"1min":0.222,"5min":0.219,"15min":0.217},"max":{"1min":0.46600000000000003,"5min":0.56599999999999995,"15min":0.66200000000000003},"last":0.251},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.39500000000000002,"15min":0.40200000000000002},"min":{"1min":0.26700000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.48699999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.373}]},{"osd":1,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.37,"15min":0.38600000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.51500000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.40999999999999998,"15min":0.42999999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.25900000000000001},"max":{"1min":0.59699999999999998,"5min":0.65900000000000003,"15min":0.84399999999999997},"last":0.32100000000000001}]},{"osd":2,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.435,"15min":0.45000000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.26000000000000001},"max":{"1min":0.61799999999999999,"5min":0.72999999999999998,"15min":0.94899999999999995},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.49399999999999999,"15min":0.50900000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67100000000000004,"5min":1.054,"15min":1.054},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58699999999999997,"15min":0.60599999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.755,"5min":0.91500000000000004,"15min":0.97599999999999998},"last":0.753},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59599999999999997,"15min":0.61299999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.70399999999999996,"5min":0.86799999999999999,"15min":0.91400000000000003},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.58099999999999996,"15min":0.60999999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80200000000000005,"5min":0.85399999999999998,"15min":0.98399999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61899999999999999,"15min":0.63800000000000001},"min":{"1min":0.372,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77300000000000002,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61799999999999999,"15min":0.64400000000000002},"min":{"1min":0.39800000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79900000000000004,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.626,"15min":0.64700000000000002},"min":{"1min":0.45000000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78900000000000003,"5min":0.89500000000000002,"15min":1.0389999999999999},"last":0.69199999999999995}]},{"osd":7,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.64000000000000001,"15min":0.66200000000000003},"min":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.39100000000000001},"max":{"1min":0.80200000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63700000000000001,"15min":0.66100000000000003},"min":{"1min":0.45800000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79000000000000004,"5min":0.98999999999999999,"15min":1.004},"last":0.68200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575035,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302288,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069552,"statfs":{"total":96636764160,"available":96327221248,"internally_reserved":0,"allocated":1122304,"data_stored":559646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.53100000000000003},"min":{"1min":0.32200000000000001,"5min":0.28299999999999997,"15min":0.27500000000000002},"max":{"1min":0.72299999999999998,"5min":0.752,"15min":0.80900000000000005},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.38900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.66500000000000004,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52100000000000002,"15min":0.54200000000000004},"min":{"1min":0.35699999999999998,"5min":0.26900000000000002,"15min":0.25800000000000001},"max":{"1min":0.67600000000000005,"5min":0.73799999999999999,"15min":0.79600000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.41899999999999998,"5min":0.317,"15min":0.246},"max":{"1min":0.67800000000000005,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56100000000000005,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.376,"15min":0.27800000000000002},"max":{"1min":0.73799999999999999,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.59399999999999997},"min":{"1min":0.373,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77300000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.54800000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32900000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55600000000000005,"15min":0.57099999999999995},"min":{"1min":0.438,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.80600000000000005},"last":0.54700000000000004}]},{"osd":5,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.44600000000000001,"15min":0.443},"min":{"1min":0.35299999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.73599999999999999,"5min":1.272,"15min":1.272},"last":0.372},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.46700000000000003,"15min":0.46000000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29199999999999998},"max":{"1min":0.83399999999999996,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.45000000000000001}]},{"osd":6,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51200000000000001,"15min":0.503},"min":{"1min":0.34699999999999998,"5min":0.34399999999999997,"15min":0.314},"max":{"1min":0.997,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55500000000000005,"15min":0.53900000000000003},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.33800000000000002},"max":{"1min":0.86499999999999999,"5min":1.129,"15min":1.129},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.29899999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.82199999999999995},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57699999999999996,"15min":0.57099999999999995},"min":{"1min":0.45400000000000001,"5min":0.38600000000000001,"15min":0.34599999999999997},"max":{"1min":0.91500000000000004,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.61899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575035,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":1146880,"data_stored":571638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68500000000000005,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52400000000000002,"15min":0.53100000000000003},"min":{"1min":0.36599999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.69299999999999995,"5min":0.70299999999999996,"15min":0.81799999999999995},"last":0.70699999999999996}]},{"osd":1,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.38400000000000001,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.72399999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53300000000000003,"15min":0.54800000000000004},"min":{"1min":0.36799999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.77000000000000002},"last":0.623}]},{"osd":2,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58199999999999996,"15min":0.58899999999999997},"min":{"1min":0.44800000000000001,"5min":0.34399999999999997,"15min":0.30599999999999999},"max":{"1min":0.72499999999999998,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.437,"5min":0.378,"15min":0.34499999999999997},"max":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.69299999999999995}]},{"osd":3,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53700000000000003,"15min":0.54800000000000004},"min":{"1min":0.40799999999999997,"5min":0.36699999999999999,"15min":0.36399999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.73799999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55400000000000005,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.82099999999999995},"last":0.61199999999999999}]},{"osd":4,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.41999999999999998,"15min":0.439},"min":{"1min":0.28299999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.66700000000000004,"5min":0.72299999999999998,"15min":0.74299999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.45800000000000002,"15min":0.46600000000000003},"min":{"1min":0.30599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.628,"5min":0.69499999999999995,"15min":0.77600000000000002},"last":0.39900000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.47399999999999998,"15min":0.48599999999999999},"min":{"1min":0.32200000000000001,"5min":0.29599999999999999,"15min":0.28499999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.82099999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54100000000000004,"15min":0.55000000000000004},"min":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.69699999999999995,"5min":0.79900000000000004,"15min":0.88200000000000001},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51700000000000002,"15min":0.52600000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.64900000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.501},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55900000000000005,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.84599999999999997},"last":0.55200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:23:01.011 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:23:01.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.126+0000 7f3fb64a8700 1 Processor -- start 2023-11-30T17:23:01.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.126+0000 7f3fb64a8700 1 -- start start 2023-11-30T17:23:01.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.127+0000 7f3fb64a8700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3fb00c0180 0x7f3fb0157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:01.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.127+0000 7f3fb64a8700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb00c12c0 con 0x7f3fb0157660 2023-11-30T17:23:01.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.127+0000 7f3fb64a8700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb00c06b0 con 0x7f3fb00c1750 2023-11-30T17:23:01.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.127+0000 7f3fb64a8700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb00c0990 con 0x7f3fb00c0180 2023-11-30T17:23:01.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.127+0000 7f3fb4ca5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3fb00c0180 0x7f3fb0157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:01.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.127+0000 7f3fb54a6700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3fb0157660 0x7f3fb01589c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39078/0 (socket says 172.21.15.49:39078) 2023-11-30T17:23:01.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.127+0000 7f3fb54a6700 1 -- 172.21.15.49:0/85610657 learned_addr learned my addr 172.21.15.49:0/85610657 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:01.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.127+0000 7f3fb4ca5700 1 -- 172.21.15.49:0/85610657 >> v1:172.21.15.115:6789/0 conn(0x7f3fb00c1750 legacy=0x7f3fb00648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:01.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.127+0000 7f3fb4ca5700 1 -- 172.21.15.49:0/85610657 >> v1:172.21.15.49:6789/0 conn(0x7f3fb0157660 legacy=0x7f3fb01589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:01.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.127+0000 7f3faffff700 1 -- 172.21.15.49:0/85610657 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221808962 0 0) 0x7f3fb00c12c0 con 0x7f3fb0157660 2023-11-30T17:23:01.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.127+0000 7f3fb4ca5700 1 -- 172.21.15.49:0/85610657 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb00c0c70 con 0x7f3fb00c0180 2023-11-30T17:23:01.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.128+0000 7f3fb4ca5700 1 --2- 172.21.15.49:0/85610657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fb00c0180 0x7f3fb0157a40 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f3fa4009760 tx=0x7f3fa4009060).ready entity=mon.0 client_cookie=8ce84b3519a43866 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:01.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.128+0000 7f3faffff700 1 -- 172.21.15.49:0/85610657 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa400b580 con 0x7f3fb00c0180 2023-11-30T17:23:01.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.128+0000 7f3faffff700 1 -- 172.21.15.49:0/85610657 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa400b6e0 con 0x7f3fb00c0180 2023-11-30T17:23:01.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.128+0000 7f3faffff700 1 -- 172.21.15.49:0/85610657 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa400ba60 con 0x7f3fb00c0180 2023-11-30T17:23:01.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.128+0000 7f3fb64a8700 1 -- 172.21.15.49:0/85610657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fb00c0180 msgr2=0x7f3fb0157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:01.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.128+0000 7f3fb64a8700 1 --2- 172.21.15.49:0/85610657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fb00c0180 0x7f3fb0157a40 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f3fa4009760 tx=0x7f3fa4009060).stop 2023-11-30T17:23:01.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.128+0000 7f3fb64a8700 1 -- 172.21.15.49:0/85610657 shutdown_connections 2023-11-30T17:23:01.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.128+0000 7f3fb64a8700 1 --2- 172.21.15.49:0/85610657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fb00c0180 0x7f3fb0157a40 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:01.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.128+0000 7f3fb64a8700 1 -- 172.21.15.49:0/85610657 >> 172.21.15.49:0/85610657 conn(0x7f3fb00cb000 msgr2=0x7f3fb00cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:01.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.128+0000 7f3fb64a8700 1 -- 172.21.15.49:0/85610657 shutdown_connections 2023-11-30T17:23:01.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.128+0000 7f3fb64a8700 1 -- 172.21.15.49:0/85610657 wait complete. 2023-11-30T17:23:01.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.129+0000 7f3fb64a8700 1 Processor -- start 2023-11-30T17:23:01.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.129+0000 7f3fb64a8700 1 -- start start 2023-11-30T17:23:01.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.130+0000 7f3fb64a8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fb00c0180 0x7f3fb00ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:01.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.130+0000 7f3fb64a8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fb00c1750 0x7f3fb00c3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:01.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.130+0000 7f3fb64a8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fb0157660 0x7f3fb0145bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:01.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.130+0000 7f3fb64a8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb00c39f0 con 0x7f3fb00c1750 2023-11-30T17:23:01.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.130+0000 7f3fb64a8700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb00c2b00 con 0x7f3fb00c0180 2023-11-30T17:23:01.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.130+0000 7f3fb64a8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb00c2de0 con 0x7f3fb0157660 2023-11-30T17:23:01.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.130+0000 7f3fb4ca5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fb00c1750 0x7f3fb00c3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:01.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.130+0000 7f3fb4ca5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fb00c1750 0x7f3fb00c3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37776/0 (socket says 172.21.15.49:37776) 2023-11-30T17:23:01.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.130+0000 7f3fb4ca5700 1 -- 172.21.15.49:0/3194036123 learned_addr learned my addr 172.21.15.49:0/3194036123 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:01.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.131+0000 7f3fb54a6700 1 --2- 172.21.15.49:0/3194036123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fb00c0180 0x7f3fb00ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:01.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.131+0000 7f3fb5ca7700 1 --2- 172.21.15.49:0/3194036123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fb0157660 0x7f3fb0145bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:01.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.131+0000 7f3fb4ca5700 1 -- 172.21.15.49:0/3194036123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fb0157660 msgr2=0x7f3fb0145bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:01.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.131+0000 7f3fb4ca5700 1 --2- 172.21.15.49:0/3194036123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fb0157660 0x7f3fb0145bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:01.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.131+0000 7f3fb4ca5700 1 -- 172.21.15.49:0/3194036123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fb00c0180 msgr2=0x7f3fb00ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:01.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.131+0000 7f3fb4ca5700 1 --2- 172.21.15.49:0/3194036123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fb00c0180 0x7f3fb00ae980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:01.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.131+0000 7f3fb4ca5700 1 -- 172.21.15.49:0/3194036123 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa40092a0 con 0x7f3fb00c1750 2023-11-30T17:23:01.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.131+0000 7f3fb5ca7700 1 --2- 172.21.15.49:0/3194036123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fb0157660 0x7f3fb0145bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:23:01.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.131+0000 7f3fb4ca5700 1 --2- 172.21.15.49:0/3194036123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fb00c1750 0x7f3fb00c3e80 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f3fa4009eb0 tx=0x7f3fa4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:01.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.131+0000 7f3fad7fa700 1 -- 172.21.15.49:0/3194036123 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa400ba60 con 0x7f3fb00c1750 2023-11-30T17:23:01.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.131+0000 7f3fad7fa700 1 -- 172.21.15.49:0/3194036123 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa4000cc0 con 0x7f3fb00c1750 2023-11-30T17:23:01.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.131+0000 7f3fb64a8700 1 -- 172.21.15.49:0/3194036123 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb00c30c0 con 0x7f3fb00c1750 2023-11-30T17:23:01.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.131+0000 7f3fad7fa700 1 -- 172.21.15.49:0/3194036123 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa401b620 con 0x7f3fb00c1750 2023-11-30T17:23:01.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.131+0000 7f3fb64a8700 1 -- 172.21.15.49:0/3194036123 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb00c3680 con 0x7f3fb00c1750 2023-11-30T17:23:01.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.132+0000 7f3fb64a8700 1 -- 172.21.15.49:0/3194036123 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb00c3b60 con 0x7f3fb00c1750 2023-11-30T17:23:01.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.132+0000 7f3fad7fa700 1 -- 172.21.15.49:0/3194036123 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f3fa401ba10 con 0x7f3fb00c1750 2023-11-30T17:23:01.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.133+0000 7f3fad7fa700 1 --2- 172.21.15.49:0/3194036123 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3f9c05f270 0x7f3f9c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:01.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.133+0000 7f3fad7fa700 1 -- 172.21.15.49:0/3194036123 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f3fa407c0d0 con 0x7f3fb00c1750 2023-11-30T17:23:01.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.133+0000 7f3fb54a6700 1 --2- 172.21.15.49:0/3194036123 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3f9c05f270 0x7f3f9c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:01.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.133+0000 7f3fb54a6700 1 --2- 172.21.15.49:0/3194036123 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3f9c05f270 0x7f3f9c061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f3fa0007fd0 tx=0x7f3fa0009040).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:01.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.137+0000 7f3fad7fa700 1 -- 172.21.15.49:0/3194036123 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3fa404d200 con 0x7f3fb00c1750 2023-11-30T17:23:01.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.306+0000 7f3fb64a8700 1 -- 172.21.15.49:0/3194036123 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3fb006c7c0 con 0x7f3f9c05f270 2023-11-30T17:23:01.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.316+0000 7f3fad7fa700 1 -- 172.21.15.49:0/3194036123 <== mgr.6358 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350112 (secure 0 0 0) 0x7f3fb006c7c0 con 0x7f3f9c05f270 2023-11-30T17:23:01.323 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:01.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.319+0000 7f3fb64a8700 1 -- 172.21.15.49:0/3194036123 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3f9c05f270 msgr2=0x7f3f9c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:01.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.319+0000 7f3fb64a8700 1 --2- 172.21.15.49:0/3194036123 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3f9c05f270 0x7f3f9c061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f3fa0007fd0 tx=0x7f3fa0009040).stop 2023-11-30T17:23:01.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.319+0000 7f3fb64a8700 1 -- 172.21.15.49:0/3194036123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fb00c1750 msgr2=0x7f3fb00c3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:01.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.319+0000 7f3fb64a8700 1 --2- 172.21.15.49:0/3194036123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fb00c1750 0x7f3fb00c3e80 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f3fa4009eb0 tx=0x7f3fa4017000).stop 2023-11-30T17:23:01.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.319+0000 7f3fb64a8700 1 -- 172.21.15.49:0/3194036123 shutdown_connections 2023-11-30T17:23:01.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.319+0000 7f3fb64a8700 1 --2- 172.21.15.49:0/3194036123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fb0157660 0x7f3fb0145bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:01.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.319+0000 7f3fb64a8700 1 --2- 172.21.15.49:0/3194036123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fb00c0180 0x7f3fb00ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:01.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.319+0000 7f3fb64a8700 1 --2- 172.21.15.49:0/3194036123 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3f9c05f270 0x7f3f9c061730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:01.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.319+0000 7f3fb64a8700 1 --2- 172.21.15.49:0/3194036123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fb00c1750 0x7f3fb00c3e80 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:01.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.319+0000 7f3fb64a8700 1 -- 172.21.15.49:0/3194036123 >> 172.21.15.49:0/3194036123 conn(0x7f3fb00cb000 msgr2=0x7f3fb00aae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:01.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.319+0000 7f3fb64a8700 1 -- 172.21.15.49:0/3194036123 shutdown_connections 2023-11-30T17:23:01.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.319+0000 7f3fb64a8700 1 -- 172.21.15.49:0/3194036123 wait complete. 2023-11-30T17:23:01.330 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:23:01.333 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-11-30T17:23:00.411865+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2422556,"kb_used_data":8924,"kb_used_omap":0,"kb_used_meta":2413568,"kb_avail":752552164,"statfs":{"total":773094113280,"available":770613415936,"internally_reserved":0,"allocated":9138176,"data_stored":4555168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2471493632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11233,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-64,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.008507"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-11-30T17:22:52.444920+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:22:52.444920+0000","last_peered":"2023-11-30T17:22:52.444920+0000","last_clean":"2023-11-30T17:22:52.444920+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:22:52.444920+0000","last_undegraded":"2023-11-30T17:22:52.444920+0000","last_fullsized":"2023-11-30T17:22:52.444920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":74,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-30T17:22:52.971184+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:22:52.971184+0000","last_peered":"2023-11-30T17:22:52.971184+0000","last_clean":"2023-11-30T17:22:52.971184+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:22:52.971184+0000","last_undegraded":"2023-11-30T17:22:52.971184+0000","last_fullsized":"2023-11-30T17:22:52.971184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":79,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-11-30T17:22:53.019960+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:22:53.019960+0000","last_peered":"2023-11-30T17:22:53.019960+0000","last_clean":"2023-11-30T17:22:53.019960+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:22:53.019960+0000","last_undegraded":"2023-11-30T17:22:53.019960+0000","last_fullsized":"2023-11-30T17:22:53.019960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":74,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-30T17:22:52.971182+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:22:52.971182+0000","last_peered":"2023-11-30T17:22:52.971182+0000","last_clean":"2023-11-30T17:22:52.971182+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:22:52.971182+0000","last_undegraded":"2023-11-30T17:22:52.971182+0000","last_fullsized":"2023-11-30T17:22:52.971182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":77,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-30T17:22:53.019763+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:22:53.019763+0000","last_peered":"2023-11-30T17:22:53.019763+0000","last_clean":"2023-11-30T17:22:53.019763+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:22:53.019763+0000","last_undegraded":"2023-11-30T17:22:53.019763+0000","last_fullsized":"2023-11-30T17:22:53.019763+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-30T17:22:53.019795+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:22:53.019795+0000","last_peered":"2023-11-30T17:22:53.019795+0000","last_clean":"2023-11-30T17:22:53.019795+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:22:53.019795+0000","last_undegraded":"2023-11-30T17:22:53.019795+0000","last_fullsized":"2023-11-30T17:22:53.019795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":75,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-30T17:22:53.019792+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:22:53.019792+0000","last_peered":"2023-11-30T17:22:53.019792+0000","last_clean":"2023-11-30T17:22:53.019792+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:22:53.019792+0000","last_undegraded":"2023-11-30T17:22:53.019792+0000","last_fullsized":"2023-11-30T17:22:53.019792+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-11-30T17:22:52.444927+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:22:52.444927+0000","last_peered":"2023-11-30T17:22:52.444927+0000","last_clean":"2023-11-30T17:22:52.444927+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:22:52.444927+0000","last_undegraded":"2023-11-30T17:22:52.444927+0000","last_fullsized":"2023-11-30T17:22:52.444927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":82,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-30T17:22:52.445193+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:22:52.445193+0000","last_peered":"2023-11-30T17:22:52.445193+0000","last_clean":"2023-11-30T17:22:52.445193+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:22:52.445193+0000","last_undegraded":"2023-11-30T17:22:52.445193+0000","last_fullsized":"2023-11-30T17:22:52.445193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575036,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298204,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073636,"statfs":{"total":96636764160,"available":96331403264,"internally_reserved":0,"allocated":1134592,"data_stored":565694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.371,"5min":0.315,"15min":0.23899999999999999},"max":{"1min":0.72399999999999998,"5min":0.80400000000000005,"15min":0.81100000000000005},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57499999999999996,"15min":0.58199999999999996},"min":{"1min":0.41099999999999998,"5min":0.40699999999999997,"15min":0.32200000000000001},"max":{"1min":0.74099999999999999,"5min":0.78300000000000003,"15min":0.81899999999999995},"last":0.54800000000000004}]},{"osd":1,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70899999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.32900000000000001,"5min":0.29899999999999999,"15min":0.28799999999999998},"max":{"1min":0.64000000000000001,"5min":0.76100000000000001,"15min":0.82499999999999996},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53800000000000003,"15min":0.54900000000000004},"min":{"1min":0.37,"5min":0.33500000000000002,"15min":0.32800000000000001},"max":{"1min":0.68200000000000005,"5min":0.77000000000000002,"15min":0.78300000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.38800000000000001,"5min":0.35399999999999998,"15min":0.28699999999999998},"max":{"1min":0.70499999999999996,"5min":0.73799999999999999,"15min":0.83899999999999997},"last":0.60299999999999998}]},{"osd":3,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.53400000000000003,"15min":0.54100000000000004},"min":{"1min":0.378,"5min":0.36499999999999999,"15min":0.33200000000000002},"max":{"1min":0.65700000000000003,"5min":0.754,"15min":0.78000000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56999999999999995,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.40799999999999997,"15min":0.33900000000000002},"max":{"1min":0.67500000000000004,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44600000000000001,"15min":0.45800000000000002},"min":{"1min":0.32400000000000001,"5min":0.313,"15min":0.29699999999999999},"max":{"1min":0.55000000000000004,"5min":0.77000000000000002,"15min":0.79900000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.30099999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59899999999999998,"5min":0.75800000000000001,"15min":1.3180000000000001},"last":0.34899999999999998}]},{"osd":5,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.48399999999999999,"15min":0.49099999999999999},"min":{"1min":0.317,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58699999999999997,"5min":0.80000000000000004,"15min":0.82899999999999996},"last":0.375},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.61199999999999999,"5min":0.79300000000000004,"15min":0.872},"last":0.48699999999999999}]},{"osd":6,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.69699999999999995,"5min":0.81200000000000006,"15min":0.85199999999999998},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.33700000000000002},"max":{"1min":0.67300000000000004,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.312}]}]},{"osd":6,"up_from":13,"seq":55834575035,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":1146880,"data_stored":571638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.57099999999999995},"min":{"1min":0.38100000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72899999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56499999999999995,"15min":0.58699999999999997},"min":{"1min":0.46300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.748,"5min":0.79600000000000004,"15min":0.89300000000000002},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54600000000000004,"15min":0.56399999999999995},"min":{"1min":0.32800000000000001,"5min":0.30599999999999999,"15min":0.26400000000000001},"max":{"1min":0.75800000000000001,"5min":0.76900000000000002,"15min":0.82799999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58199999999999996,"15min":0.59899999999999998},"min":{"1min":0.45100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.751,"5min":0.82499999999999996,"15min":0.85199999999999998},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56000000000000005,"15min":0.57299999999999995},"min":{"1min":0.371,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.77500000000000002,"5min":0.79900000000000004,"15min":0.82599999999999996},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.40699999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76100000000000001,"5min":0.80900000000000005,"15min":0.82499999999999996},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51100000000000001,"15min":0.53200000000000003},"min":{"1min":0.40400000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71899999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73499999999999999,"5min":0.75600000000000001,"15min":0.79600000000000004},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44600000000000001,"15min":0.45300000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.84199999999999997},"last":0.439},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46100000000000002,"15min":0.47799999999999998},"min":{"1min":0.34999999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.746,"5min":0.76000000000000001,"15min":0.83899999999999997},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.45900000000000002,"15min":0.47199999999999998},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.28299999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.496,"15min":0.50700000000000001},"min":{"1min":0.38400000000000001,"5min":0.33500000000000002,"15min":0.31900000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.34499999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.74199999999999999,"5min":0.80700000000000005,"15min":0.93200000000000005},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55100000000000005,"15min":0.56299999999999994},"min":{"1min":0.43099999999999999,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.86499999999999999},"last":0.53900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575035,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":1146880,"data_stored":571638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.378,"15min":0.35999999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23000000000000001},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.48699999999999999,"15min":0.47199999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.309},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.442}]},{"osd":2,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.38900000000000001},"min":{"1min":0.249,"5min":0.215,"15min":0.215},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.502},"min":{"1min":0.36499999999999999,"5min":0.33400000000000002,"15min":0.29499999999999998},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.46600000000000003,"15min":0.45200000000000001},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.23899999999999999},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.44800000000000001,"15min":0.435},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.39800000000000002}]},{"osd":4,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.35499999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.83499999999999996,"5min":0.88500000000000001,"15min":0.89100000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.61899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.39900000000000002},"max":{"1min":0.85099999999999998,"5min":0.97599999999999998,"15min":1.111},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.46500000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.39600000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.91300000000000003},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.64800000000000002,"15min":0.65900000000000003},"min":{"1min":0.46500000000000002,"5min":0.39700000000000002,"15min":0.39600000000000002},"max":{"1min":0.91000000000000003,"5min":0.92700000000000005,"15min":1.0600000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66100000000000003,"15min":0.66500000000000004},"min":{"1min":0.437,"5min":0.433,"15min":0.379},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.39900000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.94199999999999995},"last":0.68700000000000006}]}]},{"osd":0,"up_from":13,"seq":55834575035,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":1146880,"data_stored":571638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.375,"15min":0.36499999999999999},"min":{"1min":0.23200000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.51700000000000002,"5min":0.59999999999999998,"15min":0.71199999999999997},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38700000000000001,"15min":0.38400000000000001},"min":{"1min":0.26100000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.54400000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.31}]},{"osd":2,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.38700000000000001,"15min":0.38400000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.23899999999999999},"max":{"1min":0.55900000000000005,"5min":0.623,"15min":0.623},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.313,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.54600000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.378}]},{"osd":3,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.42499999999999999,"15min":0.42799999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.60799999999999998,"5min":0.66100000000000003,"15min":0.70999999999999996},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.438,"15min":0.439},"min":{"1min":0.27300000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.52800000000000002,"5min":0.64700000000000002,"15min":0.68799999999999994},"last":0.35199999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.42899999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78800000000000003,"5min":0.83999999999999997,"15min":0.96099999999999997},"last":0.497},{"interface":"front","average":{"1min":0.629,"5min":0.622,"15min":0.621},"min":{"1min":0.44,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.98599999999999999},"last":0.45800000000000002}]},{"osd":5,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.44400000000000001,"5min":0.39200000000000002,"15min":0.36199999999999999},"max":{"1min":0.86799999999999999,"5min":0.92400000000000004,"15min":1.0109999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.628,"15min":0.629},"min":{"1min":0.45000000000000001,"5min":0.38400000000000001,"15min":0.38},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":1.004},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.64500000000000002,"15min":0.64400000000000002},"min":{"1min":0.47799999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.88,"5min":1.002,"15min":1.002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63400000000000001,"15min":0.63200000000000001},"min":{"1min":0.46999999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89300000000000002,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66000000000000003,"15min":0.65200000000000002},"min":{"1min":0.48199999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86099999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69199999999999995,"15min":0.68799999999999994},"min":{"1min":0.54000000000000004,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92700000000000005,"5min":0.97699999999999998,"15min":1.026},"last":0.54600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575035,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306408,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065432,"statfs":{"total":96636764160,"available":96323002368,"internally_reserved":0,"allocated":1146880,"data_stored":571638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.42699999999999999,"15min":0.40200000000000002},"min":{"1min":0.27700000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":3.4729999999999999,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.44700000000000001,"15min":0.437},"min":{"1min":0.312,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":0.437}]},{"osd":1,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.51300000000000001,"15min":0.46300000000000002},"min":{"1min":0.28699999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":6.1210000000000004,"5min":6.1210000000000004,"15min":6.1210000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.52900000000000003,"15min":0.48899999999999999},"min":{"1min":0.34999999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":5.7270000000000003,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.33800000000000002}]},{"osd":3,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38600000000000001,"15min":0.40000000000000002},"min":{"1min":0.27800000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.48799999999999999,"5min":0.63500000000000001,"15min":0.86199999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47299999999999998,"15min":0.46700000000000003},"min":{"1min":0.29699999999999999,"5min":0.26900000000000002,"15min":0.26200000000000001},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.374}]},{"osd":4,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.69699999999999995,"15min":0.64200000000000002},"min":{"1min":0.432,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":8.7170000000000005,"5min":8.7170000000000005,"15min":8.7170000000000005},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.381,"5min":1.492,"15min":1.492},"last":0.77700000000000002}]},{"osd":5,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.65600000000000003,"15min":0.63900000000000001},"min":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.44400000000000001,"5min":0.38900000000000001,"15min":0.38100000000000001},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.76600000000000001}]},{"osd":6,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61399999999999999,"15min":0.623},"min":{"1min":0.40899999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95999999999999996,"5min":1.359,"15min":1.359},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":0.751}]},{"osd":7,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.70699999999999996,"15min":0.68300000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.40300000000000002},"max":{"1min":4.6849999999999996,"5min":4.6849999999999996,"15min":4.6849999999999996},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.70099999999999996,"15min":0.69099999999999995},"min":{"1min":0.45700000000000002,"5min":0.433,"15min":0.41499999999999998},"max":{"1min":4.5039999999999996,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.73899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575035,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306408,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065432,"statfs":{"total":96636764160,"available":96323002368,"internally_reserved":0,"allocated":1146880,"data_stored":571638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.34799999999999998,"15min":0.36399999999999999},"min":{"1min":0.222,"5min":0.219,"15min":0.217},"max":{"1min":0.46600000000000003,"5min":0.56599999999999995,"15min":0.66200000000000003},"last":0.251},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.39500000000000002,"15min":0.40200000000000002},"min":{"1min":0.26700000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.48699999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.373}]},{"osd":1,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.37,"15min":0.38600000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.51500000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.40999999999999998,"15min":0.42999999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.25900000000000001},"max":{"1min":0.59699999999999998,"5min":0.65900000000000003,"15min":0.84399999999999997},"last":0.32100000000000001}]},{"osd":2,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.435,"15min":0.45000000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.26000000000000001},"max":{"1min":0.61799999999999999,"5min":0.72999999999999998,"15min":0.94899999999999995},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.49399999999999999,"15min":0.50900000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67100000000000004,"5min":1.054,"15min":1.054},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58699999999999997,"15min":0.60599999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.755,"5min":0.91500000000000004,"15min":0.97599999999999998},"last":0.753},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59599999999999997,"15min":0.61299999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.70399999999999996,"5min":0.86799999999999999,"15min":0.91400000000000003},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.58099999999999996,"15min":0.60999999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80200000000000005,"5min":0.85399999999999998,"15min":0.98399999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61899999999999999,"15min":0.63800000000000001},"min":{"1min":0.372,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77300000000000002,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61799999999999999,"15min":0.64400000000000002},"min":{"1min":0.39800000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79900000000000004,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.626,"15min":0.64700000000000002},"min":{"1min":0.45000000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78900000000000003,"5min":0.89500000000000002,"15min":1.0389999999999999},"last":0.69199999999999995}]},{"osd":7,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.64000000000000001,"15min":0.66200000000000003},"min":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.39100000000000001},"max":{"1min":0.80200000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63700000000000001,"15min":0.66100000000000003},"min":{"1min":0.45800000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79000000000000004,"5min":0.98999999999999999,"15min":1.004},"last":0.68200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575035,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302288,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069552,"statfs":{"total":96636764160,"available":96327221248,"internally_reserved":0,"allocated":1122304,"data_stored":559646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.53100000000000003},"min":{"1min":0.32200000000000001,"5min":0.28299999999999997,"15min":0.27500000000000002},"max":{"1min":0.72299999999999998,"5min":0.752,"15min":0.80900000000000005},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.38900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.66500000000000004,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52100000000000002,"15min":0.54200000000000004},"min":{"1min":0.35699999999999998,"5min":0.26900000000000002,"15min":0.25800000000000001},"max":{"1min":0.67600000000000005,"5min":0.73799999999999999,"15min":0.79600000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.41899999999999998,"5min":0.317,"15min":0.246},"max":{"1min":0.67800000000000005,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56100000000000005,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.376,"15min":0.27800000000000002},"max":{"1min":0.73799999999999999,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.59399999999999997},"min":{"1min":0.373,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77300000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.54800000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32900000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55600000000000005,"15min":0.57099999999999995},"min":{"1min":0.438,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.80600000000000005},"last":0.54700000000000004}]},{"osd":5,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.44600000000000001,"15min":0.443},"min":{"1min":0.35299999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.73599999999999999,"5min":1.272,"15min":1.272},"last":0.372},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.46700000000000003,"15min":0.46000000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29199999999999998},"max":{"1min":0.83399999999999996,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.45000000000000001}]},{"osd":6,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51200000000000001,"15min":0.503},"min":{"1min":0.34699999999999998,"5min":0.34399999999999997,"15min":0.314},"max":{"1min":0.997,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55500000000000005,"15min":0.53900000000000003},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.33800000000000002},"max":{"1min":0.86499999999999999,"5min":1.129,"15min":1.129},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.29899999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.82199999999999995},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57699999999999996,"15min":0.57099999999999995},"min":{"1min":0.45400000000000001,"5min":0.38600000000000001,"15min":0.34599999999999997},"max":{"1min":0.91500000000000004,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.61899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575035,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":1146880,"data_stored":571638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68500000000000005,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52400000000000002,"15min":0.53100000000000003},"min":{"1min":0.36599999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.69299999999999995,"5min":0.70299999999999996,"15min":0.81799999999999995},"last":0.70699999999999996}]},{"osd":1,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.38400000000000001,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.72399999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53300000000000003,"15min":0.54800000000000004},"min":{"1min":0.36799999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.77000000000000002},"last":0.623}]},{"osd":2,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58199999999999996,"15min":0.58899999999999997},"min":{"1min":0.44800000000000001,"5min":0.34399999999999997,"15min":0.30599999999999999},"max":{"1min":0.72499999999999998,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.437,"5min":0.378,"15min":0.34499999999999997},"max":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.69299999999999995}]},{"osd":3,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53700000000000003,"15min":0.54800000000000004},"min":{"1min":0.40799999999999997,"5min":0.36699999999999999,"15min":0.36399999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.73799999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55400000000000005,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.82099999999999995},"last":0.61199999999999999}]},{"osd":4,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.41999999999999998,"15min":0.439},"min":{"1min":0.28299999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.66700000000000004,"5min":0.72299999999999998,"15min":0.74299999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.45800000000000002,"15min":0.46600000000000003},"min":{"1min":0.30599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.628,"5min":0.69499999999999995,"15min":0.77600000000000002},"last":0.39900000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.47399999999999998,"15min":0.48599999999999999},"min":{"1min":0.32200000000000001,"5min":0.29599999999999999,"15min":0.28499999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.82099999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54100000000000004,"15min":0.55000000000000004},"min":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.69699999999999995,"5min":0.79900000000000004,"15min":0.88200000000000001},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51700000000000002,"15min":0.52600000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.64900000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.501},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55900000000000005,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.84599999999999997},"last":0.55200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:23:01.339 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:23:01.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.488+0000 7f47c1450700 1 Processor -- start 2023-11-30T17:23:01.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.488+0000 7f47c1450700 1 -- start start 2023-11-30T17:23:01.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.489+0000 7f47c1450700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f47bc0c45d0 0x7f47bc0c2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:01.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.489+0000 7f47c1450700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f47bc068090 0x7f47bc0c2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:01.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.489+0000 7f47c1450700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47bc154d20 con 0x7f47bc067cb0 2023-11-30T17:23:01.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.489+0000 7f47c1450700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47bc151670 con 0x7f47bc0c45d0 2023-11-30T17:23:01.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.489+0000 7f47c1450700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47bc0a7490 con 0x7f47bc068090 2023-11-30T17:23:01.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.489+0000 7f47ba7fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f47bc0c45d0 0x7f47bc0c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:01.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.489+0000 7f47ba7fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f47bc0c45d0 0x7f47bc0c2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37780/0 (socket says 172.21.15.49:37780) 2023-11-30T17:23:01.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.489+0000 7f47ba7fc700 1 -- 172.21.15.49:0/2044694262 learned_addr learned my addr 172.21.15.49:0/2044694262 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:01.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.490+0000 7f47ba7fc700 1 -- 172.21.15.49:0/2044694262 >> v2:172.21.15.115:3300/0 conn(0x7f47bc068090 msgr2=0x7f47bc0c2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:01.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.490+0000 7f47bb7fe700 1 --2- 172.21.15.49:0/2044694262 >> v2:172.21.15.115:3300/0 conn(0x7f47bc068090 0x7f47bc0c2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:01.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.490+0000 7f47ba7fc700 1 --2- 172.21.15.49:0/2044694262 >> v2:172.21.15.115:3300/0 conn(0x7f47bc068090 0x7f47bc0c2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:01.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.490+0000 7f47ba7fc700 1 -- 172.21.15.49:0/2044694262 >> v1:172.21.15.115:6789/0 conn(0x7f47bc067cb0 legacy=0x7f47bc0c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:01.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.490+0000 7f47ba7fc700 1 -- 172.21.15.49:0/2044694262 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc1555c0 con 0x7f47bc0c45d0 2023-11-30T17:23:01.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.490+0000 7f47bb7fe700 1 --2- 172.21.15.49:0/2044694262 >> v2:172.21.15.115:3300/0 conn(0x7f47bc068090 0x7f47bc0c2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:23:01.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.490+0000 7f47ba7fc700 1 --2- 172.21.15.49:0/2044694262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47bc0c45d0 0x7f47bc0c2640 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7f47bc154c50 tx=0x7f47b00090f0).ready entity=mon.0 client_cookie=1d4202f8bc9aa6a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:01.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.490+0000 7f47b9ffb700 1 -- 172.21.15.49:0/2044694262 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b000b5a0 con 0x7f47bc0c45d0 2023-11-30T17:23:01.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.490+0000 7f47b9ffb700 1 -- 172.21.15.49:0/2044694262 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b000b700 con 0x7f47bc0c45d0 2023-11-30T17:23:01.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.490+0000 7f47b9ffb700 1 -- 172.21.15.49:0/2044694262 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b000ba80 con 0x7f47bc0c45d0 2023-11-30T17:23:01.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.491+0000 7f47c1450700 1 -- 172.21.15.49:0/2044694262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47bc0c45d0 msgr2=0x7f47bc0c2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:01.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.491+0000 7f47c1450700 1 --2- 172.21.15.49:0/2044694262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47bc0c45d0 0x7f47bc0c2640 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7f47bc154c50 tx=0x7f47b00090f0).stop 2023-11-30T17:23:01.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.491+0000 7f47c1450700 1 -- 172.21.15.49:0/2044694262 shutdown_connections 2023-11-30T17:23:01.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.491+0000 7f47c1450700 1 --2- 172.21.15.49:0/2044694262 >> v2:172.21.15.115:3300/0 conn(0x7f47bc068090 0x7f47bc0c2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:01.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.491+0000 7f47c1450700 1 --2- 172.21.15.49:0/2044694262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47bc0c45d0 0x7f47bc0c2640 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:01.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.491+0000 7f47c1450700 1 -- 172.21.15.49:0/2044694262 >> 172.21.15.49:0/2044694262 conn(0x7f47bc0c7fd0 msgr2=0x7f47bc0c83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:01.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.491+0000 7f47c1450700 1 -- 172.21.15.49:0/2044694262 shutdown_connections 2023-11-30T17:23:01.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.491+0000 7f47c1450700 1 -- 172.21.15.49:0/2044694262 wait complete. 2023-11-30T17:23:01.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.492+0000 7f47c1450700 1 Processor -- start 2023-11-30T17:23:01.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.492+0000 7f47c1450700 1 -- start start 2023-11-30T17:23:01.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.493+0000 7f47c1450700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47bc067cb0 0x7f47bc0ad6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:01.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.493+0000 7f47c1450700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47bc068090 0x7f47bc152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:01.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.493+0000 7f47c1450700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47bc0c45d0 0x7f47bc1537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:01.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.493+0000 7f47c1450700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc151d50 con 0x7f47bc067cb0 2023-11-30T17:23:01.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.493+0000 7f47c1450700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc0ac610 con 0x7f47bc068090 2023-11-30T17:23:01.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.493+0000 7f47c1450700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc0ac8f0 con 0x7f47bc0c45d0 2023-11-30T17:23:01.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.493+0000 7f47baffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47bc067cb0 0x7f47bc0ad6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:01.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.493+0000 7f47baffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47bc067cb0 0x7f47bc0ad6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37784/0 (socket says 172.21.15.49:37784) 2023-11-30T17:23:01.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.493+0000 7f47baffd700 1 -- 172.21.15.49:0/1264617640 learned_addr learned my addr 172.21.15.49:0/1264617640 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:01.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.493+0000 7f47ba7fc700 1 --2- 172.21.15.49:0/1264617640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47bc068090 0x7f47bc152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:01.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.493+0000 7f47bb7fe700 1 --2- 172.21.15.49:0/1264617640 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47bc0c45d0 0x7f47bc1537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:01.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.493+0000 7f47baffd700 1 -- 172.21.15.49:0/1264617640 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47bc0c45d0 msgr2=0x7f47bc1537c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:01.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.493+0000 7f47baffd700 1 --2- 172.21.15.49:0/1264617640 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47bc0c45d0 0x7f47bc1537c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:01.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.493+0000 7f47baffd700 1 -- 172.21.15.49:0/1264617640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47bc068090 msgr2=0x7f47bc152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:01.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.493+0000 7f47baffd700 1 --2- 172.21.15.49:0/1264617640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47bc068090 0x7f47bc152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:01.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.493+0000 7f47baffd700 1 -- 172.21.15.49:0/1264617640 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b0009370 con 0x7f47bc067cb0 2023-11-30T17:23:01.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.493+0000 7f47baffd700 1 --2- 172.21.15.49:0/1264617640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47bc067cb0 0x7f47bc0ad6b0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7f47ac00c440 tx=0x7f47ac007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:01.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.493+0000 7f47a2ffd700 1 -- 172.21.15.49:0/1264617640 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac012400 con 0x7f47bc067cb0 2023-11-30T17:23:01.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.493+0000 7f47a2ffd700 1 -- 172.21.15.49:0/1264617640 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ac012580 con 0x7f47bc067cb0 2023-11-30T17:23:01.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.493+0000 7f47c1450700 1 -- 172.21.15.49:0/1264617640 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47bc0acbd0 con 0x7f47bc067cb0 2023-11-30T17:23:01.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.493+0000 7f47a2ffd700 1 -- 172.21.15.49:0/1264617640 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac012940 con 0x7f47bc067cb0 2023-11-30T17:23:01.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.494+0000 7f47c1450700 1 -- 172.21.15.49:0/1264617640 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47bc0ad190 con 0x7f47bc067cb0 2023-11-30T17:23:01.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.494+0000 7f47c1450700 1 -- 172.21.15.49:0/1264617640 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47bc0aa660 con 0x7f47bc067cb0 2023-11-30T17:23:01.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.495+0000 7f47a2ffd700 1 -- 172.21.15.49:0/1264617640 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f47ac012d30 con 0x7f47bc067cb0 2023-11-30T17:23:01.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.495+0000 7f47a2ffd700 1 --2- 172.21.15.49:0/1264617640 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f47a805f270 0x7f47a8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:01.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.495+0000 7f47a2ffd700 1 -- 172.21.15.49:0/1264617640 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f47ac0797b0 con 0x7f47bc067cb0 2023-11-30T17:23:01.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.495+0000 7f47ba7fc700 1 --2- 172.21.15.49:0/1264617640 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f47a805f270 0x7f47a8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:01.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.496+0000 7f47ba7fc700 1 --2- 172.21.15.49:0/1264617640 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f47a805f270 0x7f47a8061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f47bc0c49d0 tx=0x7f47b0015000).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:01.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.499+0000 7f47a2ffd700 1 -- 172.21.15.49:0/1264617640 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f47ac048b00 con 0x7f47bc067cb0 2023-11-30T17:23:01.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.665+0000 7f47c1450700 1 -- 172.21.15.49:0/1264617640 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f47bc0a4f40 con 0x7f47a805f270 2023-11-30T17:23:01.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.675+0000 7f47a2ffd700 1 -- 172.21.15.49:0/1264617640 <== mgr.6358 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350112 (secure 0 0 0) 0x7f47bc0a4f40 con 0x7f47a805f270 2023-11-30T17:23:01.682 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:01.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.679+0000 7f47c1450700 1 -- 172.21.15.49:0/1264617640 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f47a805f270 msgr2=0x7f47a8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:01.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.679+0000 7f47c1450700 1 --2- 172.21.15.49:0/1264617640 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f47a805f270 0x7f47a8061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f47bc0c49d0 tx=0x7f47b0015000).stop 2023-11-30T17:23:01.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.679+0000 7f47c1450700 1 -- 172.21.15.49:0/1264617640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47bc067cb0 msgr2=0x7f47bc0ad6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:01.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.679+0000 7f47c1450700 1 --2- 172.21.15.49:0/1264617640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47bc067cb0 0x7f47bc0ad6b0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7f47ac00c440 tx=0x7f47ac007de0).stop 2023-11-30T17:23:01.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.679+0000 7f47c1450700 1 -- 172.21.15.49:0/1264617640 shutdown_connections 2023-11-30T17:23:01.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.679+0000 7f47c1450700 1 --2- 172.21.15.49:0/1264617640 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47bc0c45d0 0x7f47bc1537c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:01.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.679+0000 7f47c1450700 1 --2- 172.21.15.49:0/1264617640 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f47a805f270 0x7f47a8061730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:01.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.679+0000 7f47c1450700 1 --2- 172.21.15.49:0/1264617640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47bc067cb0 0x7f47bc0ad6b0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:01.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.679+0000 7f47c1450700 1 --2- 172.21.15.49:0/1264617640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47bc068090 0x7f47bc152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:01.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.679+0000 7f47c1450700 1 -- 172.21.15.49:0/1264617640 >> 172.21.15.49:0/1264617640 conn(0x7f47bc0c7fd0 msgr2=0x7f47bc05e920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:01.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.679+0000 7f47c1450700 1 -- 172.21.15.49:0/1264617640 shutdown_connections 2023-11-30T17:23:01.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.679+0000 7f47c1450700 1 -- 172.21.15.49:0/1264617640 wait complete. 2023-11-30T17:23:01.686 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:23:01.693 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-11-30T17:23:00.411865+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2422556,"kb_used_data":8924,"kb_used_omap":0,"kb_used_meta":2413568,"kb_avail":752552164,"statfs":{"total":773094113280,"available":770613415936,"internally_reserved":0,"allocated":9138176,"data_stored":4555168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2471493632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11233,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-64,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.008507"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-11-30T17:22:52.444920+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:22:52.444920+0000","last_peered":"2023-11-30T17:22:52.444920+0000","last_clean":"2023-11-30T17:22:52.444920+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:22:52.444920+0000","last_undegraded":"2023-11-30T17:22:52.444920+0000","last_fullsized":"2023-11-30T17:22:52.444920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":74,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-30T17:22:52.971184+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:22:52.971184+0000","last_peered":"2023-11-30T17:22:52.971184+0000","last_clean":"2023-11-30T17:22:52.971184+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:22:52.971184+0000","last_undegraded":"2023-11-30T17:22:52.971184+0000","last_fullsized":"2023-11-30T17:22:52.971184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":79,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-11-30T17:22:53.019960+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:22:53.019960+0000","last_peered":"2023-11-30T17:22:53.019960+0000","last_clean":"2023-11-30T17:22:53.019960+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:22:53.019960+0000","last_undegraded":"2023-11-30T17:22:53.019960+0000","last_fullsized":"2023-11-30T17:22:53.019960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":74,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-30T17:22:52.971182+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:22:52.971182+0000","last_peered":"2023-11-30T17:22:52.971182+0000","last_clean":"2023-11-30T17:22:52.971182+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:22:52.971182+0000","last_undegraded":"2023-11-30T17:22:52.971182+0000","last_fullsized":"2023-11-30T17:22:52.971182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":77,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-30T17:22:53.019763+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:22:53.019763+0000","last_peered":"2023-11-30T17:22:53.019763+0000","last_clean":"2023-11-30T17:22:53.019763+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:22:53.019763+0000","last_undegraded":"2023-11-30T17:22:53.019763+0000","last_fullsized":"2023-11-30T17:22:53.019763+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-30T17:22:53.019795+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:22:53.019795+0000","last_peered":"2023-11-30T17:22:53.019795+0000","last_clean":"2023-11-30T17:22:53.019795+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:22:53.019795+0000","last_undegraded":"2023-11-30T17:22:53.019795+0000","last_fullsized":"2023-11-30T17:22:53.019795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":75,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-30T17:22:53.019792+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:22:53.019792+0000","last_peered":"2023-11-30T17:22:53.019792+0000","last_clean":"2023-11-30T17:22:53.019792+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:22:53.019792+0000","last_undegraded":"2023-11-30T17:22:53.019792+0000","last_fullsized":"2023-11-30T17:22:53.019792+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-11-30T17:22:52.444927+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:22:52.444927+0000","last_peered":"2023-11-30T17:22:52.444927+0000","last_clean":"2023-11-30T17:22:52.444927+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:22:52.444927+0000","last_undegraded":"2023-11-30T17:22:52.444927+0000","last_fullsized":"2023-11-30T17:22:52.444927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:56.516935+0000","last_change":"2023-11-30T17:22:56.516935+0000","last_active":"2023-11-30T17:22:56.516935+0000","last_peered":"2023-11-30T17:22:56.516935+0000","last_clean":"2023-11-30T17:22:56.516935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:56.516935+0000","last_undegraded":"2023-11-30T17:22:56.516935+0000","last_fullsized":"2023-11-30T17:22:56.516935+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:22:55.515154+0000","last_change":"2023-11-30T17:22:55.515154+0000","last_active":"2023-11-30T17:22:55.515154+0000","last_peered":"2023-11-30T17:22:55.515154+0000","last_clean":"2023-11-30T17:22:55.515154+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:22:55.515154+0000","last_undegraded":"2023-11-30T17:22:55.515154+0000","last_fullsized":"2023-11-30T17:22:55.515154+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":82,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-30T17:22:52.445193+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:22:52.445193+0000","last_peered":"2023-11-30T17:22:52.445193+0000","last_clean":"2023-11-30T17:22:52.445193+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:22:52.445193+0000","last_undegraded":"2023-11-30T17:22:52.445193+0000","last_fullsized":"2023-11-30T17:22:52.445193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575036,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298204,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073636,"statfs":{"total":96636764160,"available":96331403264,"internally_reserved":0,"allocated":1134592,"data_stored":565694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.371,"5min":0.315,"15min":0.23899999999999999},"max":{"1min":0.72399999999999998,"5min":0.80400000000000005,"15min":0.81100000000000005},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57499999999999996,"15min":0.58199999999999996},"min":{"1min":0.41099999999999998,"5min":0.40699999999999997,"15min":0.32200000000000001},"max":{"1min":0.74099999999999999,"5min":0.78300000000000003,"15min":0.81899999999999995},"last":0.54800000000000004}]},{"osd":1,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70899999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.32900000000000001,"5min":0.29899999999999999,"15min":0.28799999999999998},"max":{"1min":0.64000000000000001,"5min":0.76100000000000001,"15min":0.82499999999999996},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53800000000000003,"15min":0.54900000000000004},"min":{"1min":0.37,"5min":0.33500000000000002,"15min":0.32800000000000001},"max":{"1min":0.68200000000000005,"5min":0.77000000000000002,"15min":0.78300000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.38800000000000001,"5min":0.35399999999999998,"15min":0.28699999999999998},"max":{"1min":0.70499999999999996,"5min":0.73799999999999999,"15min":0.83899999999999997},"last":0.60299999999999998}]},{"osd":3,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.53400000000000003,"15min":0.54100000000000004},"min":{"1min":0.378,"5min":0.36499999999999999,"15min":0.33200000000000002},"max":{"1min":0.65700000000000003,"5min":0.754,"15min":0.78000000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56999999999999995,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.40799999999999997,"15min":0.33900000000000002},"max":{"1min":0.67500000000000004,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44600000000000001,"15min":0.45800000000000002},"min":{"1min":0.32400000000000001,"5min":0.313,"15min":0.29699999999999999},"max":{"1min":0.55000000000000004,"5min":0.77000000000000002,"15min":0.79900000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.30099999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59899999999999998,"5min":0.75800000000000001,"15min":1.3180000000000001},"last":0.34899999999999998}]},{"osd":5,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.48399999999999999,"15min":0.49099999999999999},"min":{"1min":0.317,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58699999999999997,"5min":0.80000000000000004,"15min":0.82899999999999996},"last":0.375},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.61199999999999999,"5min":0.79300000000000004,"15min":0.872},"last":0.48699999999999999}]},{"osd":6,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.69699999999999995,"5min":0.81200000000000006,"15min":0.85199999999999998},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.33700000000000002},"max":{"1min":0.67300000000000004,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.312}]}]},{"osd":6,"up_from":13,"seq":55834575035,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":1146880,"data_stored":571638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.57099999999999995},"min":{"1min":0.38100000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72899999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56499999999999995,"15min":0.58699999999999997},"min":{"1min":0.46300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.748,"5min":0.79600000000000004,"15min":0.89300000000000002},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54600000000000004,"15min":0.56399999999999995},"min":{"1min":0.32800000000000001,"5min":0.30599999999999999,"15min":0.26400000000000001},"max":{"1min":0.75800000000000001,"5min":0.76900000000000002,"15min":0.82799999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58199999999999996,"15min":0.59899999999999998},"min":{"1min":0.45100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.751,"5min":0.82499999999999996,"15min":0.85199999999999998},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56000000000000005,"15min":0.57299999999999995},"min":{"1min":0.371,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.77500000000000002,"5min":0.79900000000000004,"15min":0.82599999999999996},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.40699999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76100000000000001,"5min":0.80900000000000005,"15min":0.82499999999999996},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51100000000000001,"15min":0.53200000000000003},"min":{"1min":0.40400000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71899999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73499999999999999,"5min":0.75600000000000001,"15min":0.79600000000000004},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44600000000000001,"15min":0.45300000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.84199999999999997},"last":0.439},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46100000000000002,"15min":0.47799999999999998},"min":{"1min":0.34999999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.746,"5min":0.76000000000000001,"15min":0.83899999999999997},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.45900000000000002,"15min":0.47199999999999998},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.28299999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.496,"15min":0.50700000000000001},"min":{"1min":0.38400000000000001,"5min":0.33500000000000002,"15min":0.31900000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.34499999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.74199999999999999,"5min":0.80700000000000005,"15min":0.93200000000000005},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55100000000000005,"15min":0.56299999999999994},"min":{"1min":0.43099999999999999,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.86499999999999999},"last":0.53900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575035,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":1146880,"data_stored":571638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.378,"15min":0.35999999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23000000000000001},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.48699999999999999,"15min":0.47199999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.309},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.442}]},{"osd":2,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.38900000000000001},"min":{"1min":0.249,"5min":0.215,"15min":0.215},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.502},"min":{"1min":0.36499999999999999,"5min":0.33400000000000002,"15min":0.29499999999999998},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.46600000000000003,"15min":0.45200000000000001},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.23899999999999999},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.44800000000000001,"15min":0.435},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.39800000000000002}]},{"osd":4,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.35499999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.83499999999999996,"5min":0.88500000000000001,"15min":0.89100000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.61899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.39900000000000002},"max":{"1min":0.85099999999999998,"5min":0.97599999999999998,"15min":1.111},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.46500000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.39600000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.91300000000000003},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.64800000000000002,"15min":0.65900000000000003},"min":{"1min":0.46500000000000002,"5min":0.39700000000000002,"15min":0.39600000000000002},"max":{"1min":0.91000000000000003,"5min":0.92700000000000005,"15min":1.0600000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66100000000000003,"15min":0.66500000000000004},"min":{"1min":0.437,"5min":0.433,"15min":0.379},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.39900000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.94199999999999995},"last":0.68700000000000006}]}]},{"osd":0,"up_from":13,"seq":55834575035,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":1146880,"data_stored":571638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.375,"15min":0.36499999999999999},"min":{"1min":0.23200000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.51700000000000002,"5min":0.59999999999999998,"15min":0.71199999999999997},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38700000000000001,"15min":0.38400000000000001},"min":{"1min":0.26100000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.54400000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.31}]},{"osd":2,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.38700000000000001,"15min":0.38400000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.23899999999999999},"max":{"1min":0.55900000000000005,"5min":0.623,"15min":0.623},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.313,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.54600000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.378}]},{"osd":3,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.42499999999999999,"15min":0.42799999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.60799999999999998,"5min":0.66100000000000003,"15min":0.70999999999999996},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.438,"15min":0.439},"min":{"1min":0.27300000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.52800000000000002,"5min":0.64700000000000002,"15min":0.68799999999999994},"last":0.35199999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.42899999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78800000000000003,"5min":0.83999999999999997,"15min":0.96099999999999997},"last":0.497},{"interface":"front","average":{"1min":0.629,"5min":0.622,"15min":0.621},"min":{"1min":0.44,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.98599999999999999},"last":0.45800000000000002}]},{"osd":5,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.44400000000000001,"5min":0.39200000000000002,"15min":0.36199999999999999},"max":{"1min":0.86799999999999999,"5min":0.92400000000000004,"15min":1.0109999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.628,"15min":0.629},"min":{"1min":0.45000000000000001,"5min":0.38400000000000001,"15min":0.38},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":1.004},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.64500000000000002,"15min":0.64400000000000002},"min":{"1min":0.47799999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.88,"5min":1.002,"15min":1.002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63400000000000001,"15min":0.63200000000000001},"min":{"1min":0.46999999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89300000000000002,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66000000000000003,"15min":0.65200000000000002},"min":{"1min":0.48199999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86099999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69199999999999995,"15min":0.68799999999999994},"min":{"1min":0.54000000000000004,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92700000000000005,"5min":0.97699999999999998,"15min":1.026},"last":0.54600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575035,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306408,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065432,"statfs":{"total":96636764160,"available":96323002368,"internally_reserved":0,"allocated":1146880,"data_stored":571638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.42699999999999999,"15min":0.40200000000000002},"min":{"1min":0.27700000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":3.4729999999999999,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.44700000000000001,"15min":0.437},"min":{"1min":0.312,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":0.437}]},{"osd":1,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.51300000000000001,"15min":0.46300000000000002},"min":{"1min":0.28699999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":6.1210000000000004,"5min":6.1210000000000004,"15min":6.1210000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.52900000000000003,"15min":0.48899999999999999},"min":{"1min":0.34999999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":5.7270000000000003,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.33800000000000002}]},{"osd":3,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38600000000000001,"15min":0.40000000000000002},"min":{"1min":0.27800000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.48799999999999999,"5min":0.63500000000000001,"15min":0.86199999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47299999999999998,"15min":0.46700000000000003},"min":{"1min":0.29699999999999999,"5min":0.26900000000000002,"15min":0.26200000000000001},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.374}]},{"osd":4,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.69699999999999995,"15min":0.64200000000000002},"min":{"1min":0.432,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":8.7170000000000005,"5min":8.7170000000000005,"15min":8.7170000000000005},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.381,"5min":1.492,"15min":1.492},"last":0.77700000000000002}]},{"osd":5,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.65600000000000003,"15min":0.63900000000000001},"min":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.44400000000000001,"5min":0.38900000000000001,"15min":0.38100000000000001},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.76600000000000001}]},{"osd":6,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61399999999999999,"15min":0.623},"min":{"1min":0.40899999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95999999999999996,"5min":1.359,"15min":1.359},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":0.751}]},{"osd":7,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.70699999999999996,"15min":0.68300000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.40300000000000002},"max":{"1min":4.6849999999999996,"5min":4.6849999999999996,"15min":4.6849999999999996},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.70099999999999996,"15min":0.69099999999999995},"min":{"1min":0.45700000000000002,"5min":0.433,"15min":0.41499999999999998},"max":{"1min":4.5039999999999996,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.73899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575035,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306408,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065432,"statfs":{"total":96636764160,"available":96323002368,"internally_reserved":0,"allocated":1146880,"data_stored":571638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.34799999999999998,"15min":0.36399999999999999},"min":{"1min":0.222,"5min":0.219,"15min":0.217},"max":{"1min":0.46600000000000003,"5min":0.56599999999999995,"15min":0.66200000000000003},"last":0.251},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.39500000000000002,"15min":0.40200000000000002},"min":{"1min":0.26700000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.48699999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.373}]},{"osd":1,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.37,"15min":0.38600000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.51500000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.40999999999999998,"15min":0.42999999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.25900000000000001},"max":{"1min":0.59699999999999998,"5min":0.65900000000000003,"15min":0.84399999999999997},"last":0.32100000000000001}]},{"osd":2,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.435,"15min":0.45000000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.26000000000000001},"max":{"1min":0.61799999999999999,"5min":0.72999999999999998,"15min":0.94899999999999995},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.49399999999999999,"15min":0.50900000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67100000000000004,"5min":1.054,"15min":1.054},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58699999999999997,"15min":0.60599999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.755,"5min":0.91500000000000004,"15min":0.97599999999999998},"last":0.753},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59599999999999997,"15min":0.61299999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.70399999999999996,"5min":0.86799999999999999,"15min":0.91400000000000003},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.58099999999999996,"15min":0.60999999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80200000000000005,"5min":0.85399999999999998,"15min":0.98399999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61899999999999999,"15min":0.63800000000000001},"min":{"1min":0.372,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77300000000000002,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61799999999999999,"15min":0.64400000000000002},"min":{"1min":0.39800000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79900000000000004,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.626,"15min":0.64700000000000002},"min":{"1min":0.45000000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78900000000000003,"5min":0.89500000000000002,"15min":1.0389999999999999},"last":0.69199999999999995}]},{"osd":7,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.64000000000000001,"15min":0.66200000000000003},"min":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.39100000000000001},"max":{"1min":0.80200000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63700000000000001,"15min":0.66100000000000003},"min":{"1min":0.45800000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79000000000000004,"5min":0.98999999999999999,"15min":1.004},"last":0.68200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575035,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302288,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069552,"statfs":{"total":96636764160,"available":96327221248,"internally_reserved":0,"allocated":1122304,"data_stored":559646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.53100000000000003},"min":{"1min":0.32200000000000001,"5min":0.28299999999999997,"15min":0.27500000000000002},"max":{"1min":0.72299999999999998,"5min":0.752,"15min":0.80900000000000005},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.38900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.66500000000000004,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52100000000000002,"15min":0.54200000000000004},"min":{"1min":0.35699999999999998,"5min":0.26900000000000002,"15min":0.25800000000000001},"max":{"1min":0.67600000000000005,"5min":0.73799999999999999,"15min":0.79600000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.41899999999999998,"5min":0.317,"15min":0.246},"max":{"1min":0.67800000000000005,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56100000000000005,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.376,"15min":0.27800000000000002},"max":{"1min":0.73799999999999999,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.59399999999999997},"min":{"1min":0.373,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77300000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.54800000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32900000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55600000000000005,"15min":0.57099999999999995},"min":{"1min":0.438,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.80600000000000005},"last":0.54700000000000004}]},{"osd":5,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.44600000000000001,"15min":0.443},"min":{"1min":0.35299999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.73599999999999999,"5min":1.272,"15min":1.272},"last":0.372},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.46700000000000003,"15min":0.46000000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29199999999999998},"max":{"1min":0.83399999999999996,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.45000000000000001}]},{"osd":6,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51200000000000001,"15min":0.503},"min":{"1min":0.34699999999999998,"5min":0.34399999999999997,"15min":0.314},"max":{"1min":0.997,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55500000000000005,"15min":0.53900000000000003},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.33800000000000002},"max":{"1min":0.86499999999999999,"5min":1.129,"15min":1.129},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.29899999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.82199999999999995},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57699999999999996,"15min":0.57099999999999995},"min":{"1min":0.45400000000000001,"5min":0.38600000000000001,"15min":0.34599999999999997},"max":{"1min":0.91500000000000004,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.61899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575035,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":1146880,"data_stored":571638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68500000000000005,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52400000000000002,"15min":0.53100000000000003},"min":{"1min":0.36599999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.69299999999999995,"5min":0.70299999999999996,"15min":0.81799999999999995},"last":0.70699999999999996}]},{"osd":1,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.38400000000000001,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.72399999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53300000000000003,"15min":0.54800000000000004},"min":{"1min":0.36799999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.77000000000000002},"last":0.623}]},{"osd":2,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58199999999999996,"15min":0.58899999999999997},"min":{"1min":0.44800000000000001,"5min":0.34399999999999997,"15min":0.30599999999999999},"max":{"1min":0.72499999999999998,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.437,"5min":0.378,"15min":0.34499999999999997},"max":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.69299999999999995}]},{"osd":3,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53700000000000003,"15min":0.54800000000000004},"min":{"1min":0.40799999999999997,"5min":0.36699999999999999,"15min":0.36399999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.73799999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55400000000000005,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.82099999999999995},"last":0.61199999999999999}]},{"osd":4,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.41999999999999998,"15min":0.439},"min":{"1min":0.28299999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.66700000000000004,"5min":0.72299999999999998,"15min":0.74299999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.45800000000000002,"15min":0.46600000000000003},"min":{"1min":0.30599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.628,"5min":0.69499999999999995,"15min":0.77600000000000002},"last":0.39900000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.47399999999999998,"15min":0.48599999999999999},"min":{"1min":0.32200000000000001,"5min":0.29599999999999999,"15min":0.28499999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.82099999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54100000000000004,"15min":0.55000000000000004},"min":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.69699999999999995,"5min":0.79900000000000004,"15min":0.88200000000000001},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51700000000000002,"15min":0.52600000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.64900000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.501},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55900000000000005,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.84599999999999997},"last":0.55200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:23:01.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.38 is not active+clean 2023-11-30T17:23:01.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2023-11-30T17:23:01.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.39 is not active+clean 2023-11-30T17:23:01.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2023-11-30T17:23:01.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3a is not active+clean 2023-11-30T17:23:01.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3d is not active+clean 2023-11-30T17:23:01.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3b is not active+clean 2023-11-30T17:23:01.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3c is not active+clean 2023-11-30T17:23:01.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3c is not active+clean 2023-11-30T17:23:01.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2023-11-30T17:23:01.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3d is not active+clean 2023-11-30T17:23:01.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2023-11-30T17:23:01.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3e is not active+clean 2023-11-30T17:23:01.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2023-11-30T17:23:01.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3f is not active+clean 2023-11-30T17:23:01.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2023-11-30T17:23:01.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.30 is not active+clean 2023-11-30T17:23:01.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2023-11-30T17:23:01.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.31 is not active+clean 2023-11-30T17:23:01.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2023-11-30T17:23:01.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.32 is not active+clean 2023-11-30T17:23:01.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2023-11-30T17:23:01.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.33 is not active+clean 2023-11-30T17:23:01.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.34 is not active+clean 2023-11-30T17:23:01.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.34 is not active+clean 2023-11-30T17:23:01.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.33 is not active+clean 2023-11-30T17:23:01.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.35 is not active+clean 2023-11-30T17:23:01.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2023-11-30T17:23:01.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.36 is not active+clean 2023-11-30T17:23:01.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.31 is not active+clean 2023-11-30T17:23:01.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.37 is not active+clean 2023-11-30T17:23:01.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2023-11-30T17:23:01.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.28 is not active+clean 2023-11-30T17:23:01.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2023-11-30T17:23:01.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.29 is not active+clean 2023-11-30T17:23:01.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2e is not active+clean 2023-11-30T17:23:01.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2a is not active+clean 2023-11-30T17:23:01.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2023-11-30T17:23:01.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2b is not active+clean 2023-11-30T17:23:01.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2c is not active+clean 2023-11-30T17:23:01.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2c is not active+clean 2023-11-30T17:23:01.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2023-11-30T17:23:01.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2d is not active+clean 2023-11-30T17:23:01.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2023-11-30T17:23:01.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2e is not active+clean 2023-11-30T17:23:01.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2023-11-30T17:23:01.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2f is not active+clean 2023-11-30T17:23:01.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2023-11-30T17:23:01.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.20 is not active+clean 2023-11-30T17:23:01.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2023-11-30T17:23:01.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.21 is not active+clean 2023-11-30T17:23:01.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2023-11-30T17:23:01.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.22 is not active+clean 2023-11-30T17:23:01.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.25 is not active+clean 2023-11-30T17:23:01.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.23 is not active+clean 2023-11-30T17:23:01.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2023-11-30T17:23:01.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.24 is not active+clean 2023-11-30T17:23:01.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.23 is not active+clean 2023-11-30T17:23:01.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.25 is not active+clean 2023-11-30T17:23:01.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2023-11-30T17:23:01.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.26 is not active+clean 2023-11-30T17:23:01.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2023-11-30T17:23:01.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.27 is not active+clean 2023-11-30T17:23:01.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2023-11-30T17:23:01.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.18 is not active+clean 2023-11-30T17:23:01.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2023-11-30T17:23:01.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.19 is not active+clean 2023-11-30T17:23:01.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2023-11-30T17:23:01.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1a is not active+clean 2023-11-30T17:23:01.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2023-11-30T17:23:01.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1b is not active+clean 2023-11-30T17:23:01.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2023-11-30T17:23:01.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1c is not active+clean 2023-11-30T17:23:01.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2023-11-30T17:23:01.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1d is not active+clean 2023-11-30T17:23:01.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2023-11-30T17:23:01.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1e is not active+clean 2023-11-30T17:23:01.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2023-11-30T17:23:01.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1f is not active+clean 2023-11-30T17:23:01.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2023-11-30T17:23:01.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.10 is not active+clean 2023-11-30T17:23:01.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2023-11-30T17:23:01.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.11 is not active+clean 2023-11-30T17:23:01.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2023-11-30T17:23:01.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.12 is not active+clean 2023-11-30T17:23:01.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2023-11-30T17:23:01.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.13 is not active+clean 2023-11-30T17:23:01.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2023-11-30T17:23:01.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.14 is not active+clean 2023-11-30T17:23:01.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2023-11-30T17:23:01.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.15 is not active+clean 2023-11-30T17:23:01.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2023-11-30T17:23:01.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.16 is not active+clean 2023-11-30T17:23:01.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2023-11-30T17:23:01.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.17 is not active+clean 2023-11-30T17:23:01.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2023-11-30T17:23:01.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.0 is not active+clean 2023-11-30T17:23:01.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2023-11-30T17:23:01.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1 is not active+clean 2023-11-30T17:23:01.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2023-11-30T17:23:01.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2 is not active+clean 2023-11-30T17:23:01.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2023-11-30T17:23:01.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3 is not active+clean 2023-11-30T17:23:01.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2023-11-30T17:23:01.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.4 is not active+clean 2023-11-30T17:23:01.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2023-11-30T17:23:01.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.5 is not active+clean 2023-11-30T17:23:01.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2023-11-30T17:23:01.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.6 is not active+clean 2023-11-30T17:23:01.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2023-11-30T17:23:01.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.7 is not active+clean 2023-11-30T17:23:01.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2023-11-30T17:23:01.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.a is not active+clean 2023-11-30T17:23:01.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2023-11-30T17:23:01.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.c is not active+clean 2023-11-30T17:23:01.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2023-11-30T17:23:01.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.f is not active+clean 2023-11-30T17:23:01.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2023-11-30T17:23:01.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.d is not active+clean 2023-11-30T17:23:01.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2023-11-30T17:23:01.726 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.726 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.e is not active+clean 2023-11-30T17:23:01.726 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.726 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2023-11-30T17:23:01.726 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.726 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.b is not active+clean 2023-11-30T17:23:01.726 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.726 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2023-11-30T17:23:01.726 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.726 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.8 is not active+clean 2023-11-30T17:23:01.726 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.727 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2023-11-30T17:23:01.727 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.727 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.9 is not active+clean 2023-11-30T17:23:01.727 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:56.516935+0000', 'last_change': '2023-11-30T17:22:56.516935+0000', 'last_active': '2023-11-30T17:22:56.516935+0000', 'last_peered': '2023-11-30T17:22:56.516935+0000', 'last_clean': '2023-11-30T17:22:56.516935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:56.516935+0000', 'last_undegraded': '2023-11-30T17:22:56.516935+0000', 'last_fullsized': '2023-11-30T17:22:56.516935+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:56.516935+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.727 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2023-11-30T17:23:01.727 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:22:55.515154+0000', 'last_change': '2023-11-30T17:22:55.515154+0000', 'last_active': '2023-11-30T17:22:55.515154+0000', 'last_peered': '2023-11-30T17:22:55.515154+0000', 'last_clean': '2023-11-30T17:22:55.515154+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:22:55.515154+0000', 'last_undegraded': '2023-11-30T17:22:55.515154+0000', 'last_fullsized': '2023-11-30T17:22:55.515154+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'last_clean_scrub_stamp': '2023-11-30T17:22:55.515154+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:01.728 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-30T17:23:01.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.847+0000 7f6f05eb3700 1 Processor -- start 2023-11-30T17:23:01.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.847+0000 7f6f05eb3700 1 -- start start 2023-11-30T17:23:01.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.848+0000 7f6f05eb3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f000caab0 0x7f6f000aa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:01.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.848+0000 7f6f05eb3700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6f000cae90 0x7f6f000c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:01.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.848+0000 7f6f05eb3700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f000a9a90 con 0x7f6f000aa960 2023-11-30T17:23:01.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.848+0000 7f6f05eb3700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f00154ce0 con 0x7f6f000cae90 2023-11-30T17:23:01.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.848+0000 7f6f05eb3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f000a8e80 con 0x7f6f000caab0 2023-11-30T17:23:01.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.849+0000 7f6eff7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f000caab0 0x7f6f000aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:01.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.849+0000 7f6efeffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6f000cae90 0x7f6f000c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:01.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.849+0000 7f6eff7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f000caab0 0x7f6f000aa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:60496/0 (socket says 172.21.15.49:60496) 2023-11-30T17:23:01.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.849+0000 7f6eff7fe700 1 -- 172.21.15.49:0/902947289 learned_addr learned my addr 172.21.15.49:0/902947289 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:01.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.849+0000 7f6eff7fe700 1 -- 172.21.15.49:0/902947289 >> v2:172.21.15.115:3300/0 conn(0x7f6f000cae90 msgr2=0x7f6f000c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:01.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.849+0000 7f6eff7fe700 1 --2- 172.21.15.49:0/902947289 >> v2:172.21.15.115:3300/0 conn(0x7f6f000cae90 0x7f6f000c0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:01.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.849+0000 7f6eff7fe700 1 -- 172.21.15.49:0/902947289 >> v1:172.21.15.115:6789/0 conn(0x7f6f000aa960 legacy=0x7f6f000c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:01.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.849+0000 7f6eff7fe700 1 -- 172.21.15.49:0/902947289 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f000a9160 con 0x7f6f000caab0 2023-11-30T17:23:01.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.849+0000 7f6eff7fe700 1 --2- 172.21.15.49:0/902947289 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f000caab0 0x7f6f000aa470 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f6ee8009810 tx=0x7f6ee8009060).ready entity=mon.2 client_cookie=844de8251c525cf3 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:01.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.849+0000 7f6efe7fc700 1 -- 172.21.15.49:0/902947289 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8005880 con 0x7f6f000caab0 2023-11-30T17:23:01.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.849+0000 7f6efe7fc700 1 -- 172.21.15.49:0/902947289 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee80059e0 con 0x7f6f000caab0 2023-11-30T17:23:01.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.849+0000 7f6efe7fc700 1 -- 172.21.15.49:0/902947289 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8005d60 con 0x7f6f000caab0 2023-11-30T17:23:01.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.850+0000 7f6f05eb3700 1 -- 172.21.15.49:0/902947289 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f000caab0 msgr2=0x7f6f000aa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:01.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.850+0000 7f6f05eb3700 1 --2- 172.21.15.49:0/902947289 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f000caab0 0x7f6f000aa470 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f6ee8009810 tx=0x7f6ee8009060).stop 2023-11-30T17:23:01.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.850+0000 7f6f05eb3700 1 -- 172.21.15.49:0/902947289 shutdown_connections 2023-11-30T17:23:01.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.850+0000 7f6f05eb3700 1 --2- 172.21.15.49:0/902947289 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f000caab0 0x7f6f000aa470 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:01.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.850+0000 7f6f05eb3700 1 --2- 172.21.15.49:0/902947289 >> v2:172.21.15.115:3300/0 conn(0x7f6f000cae90 0x7f6f000c0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:01.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.850+0000 7f6f05eb3700 1 -- 172.21.15.49:0/902947289 >> 172.21.15.49:0/902947289 conn(0x7f6f00094920 msgr2=0x7f6f0006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:01.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.850+0000 7f6f05eb3700 1 -- 172.21.15.49:0/902947289 shutdown_connections 2023-11-30T17:23:01.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.850+0000 7f6f05eb3700 1 -- 172.21.15.49:0/902947289 wait complete. 2023-11-30T17:23:01.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.851+0000 7f6f05eb3700 1 Processor -- start 2023-11-30T17:23:01.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.851+0000 7f6f05eb3700 1 -- start start 2023-11-30T17:23:01.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.852+0000 7f6f05eb3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f000caab0 0x7f6f00155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:01.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.852+0000 7f6f05eb3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f000cae90 0x7f6f00154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:01.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.852+0000 7f6f05eb3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f0014cc60 0x7f6f00064920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:01.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.852+0000 7f6f05eb3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f00155660 con 0x7f6f000cae90 2023-11-30T17:23:01.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.852+0000 7f6f05eb3700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f001560a0 con 0x7f6f0014cc60 2023-11-30T17:23:01.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.852+0000 7f6f05eb3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f00164c50 con 0x7f6f000caab0 2023-11-30T17:23:01.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.852+0000 7f6efeffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f000cae90 0x7f6f00154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:01.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.852+0000 7f6efeffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f000cae90 0x7f6f00154e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37790/0 (socket says 172.21.15.49:37790) 2023-11-30T17:23:01.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.852+0000 7f6efeffd700 1 -- 172.21.15.49:0/3594723475 learned_addr learned my addr 172.21.15.49:0/3594723475 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:01.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.852+0000 7f6eff7fe700 1 --2- 172.21.15.49:0/3594723475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f000caab0 0x7f6f00155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:01.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.852+0000 7f6efffff700 1 --2- 172.21.15.49:0/3594723475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f0014cc60 0x7f6f00064920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:01.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.852+0000 7f6efeffd700 1 -- 172.21.15.49:0/3594723475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f000caab0 msgr2=0x7f6f00155bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:01.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.852+0000 7f6efeffd700 1 --2- 172.21.15.49:0/3594723475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f000caab0 0x7f6f00155bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:01.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.852+0000 7f6efeffd700 1 -- 172.21.15.49:0/3594723475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f0014cc60 msgr2=0x7f6f00064920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:01.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.852+0000 7f6efeffd700 1 --2- 172.21.15.49:0/3594723475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f0014cc60 0x7f6f00064920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:01.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.852+0000 7f6efeffd700 1 -- 172.21.15.49:0/3594723475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee8009300 con 0x7f6f000cae90 2023-11-30T17:23:01.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.852+0000 7f6efffff700 1 --2- 172.21.15.49:0/3594723475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f0014cc60 0x7f6f00064920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:23:01.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.852+0000 7f6efeffd700 1 --2- 172.21.15.49:0/3594723475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f000cae90 0x7f6f00154e80 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7f6ef000e900 tx=0x7f6ef0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:01.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.853+0000 7f6ef77fe700 1 -- 172.21.15.49:0/3594723475 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef0012600 con 0x7f6f000cae90 2023-11-30T17:23:01.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.853+0000 7f6ef77fe700 1 -- 172.21.15.49:0/3594723475 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef0012760 con 0x7f6f000cae90 2023-11-30T17:23:01.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.853+0000 7f6f05eb3700 1 -- 172.21.15.49:0/3594723475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f00164ec0 con 0x7f6f000cae90 2023-11-30T17:23:01.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.853+0000 7f6ef77fe700 1 -- 172.21.15.49:0/3594723475 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef0012ae0 con 0x7f6f000cae90 2023-11-30T17:23:01.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.853+0000 7f6f05eb3700 1 -- 172.21.15.49:0/3594723475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f00165480 con 0x7f6f000cae90 2023-11-30T17:23:01.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.854+0000 7f6f05eb3700 1 -- 172.21.15.49:0/3594723475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f0006c860 con 0x7f6f000cae90 2023-11-30T17:23:01.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.854+0000 7f6ef77fe700 1 -- 172.21.15.49:0/3594723475 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6ef001b400 con 0x7f6f000cae90 2023-11-30T17:23:01.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.854+0000 7f6ef77fe700 1 --2- 172.21.15.49:0/3594723475 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6ee005f270 0x7f6ee0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:01.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.854+0000 7f6ef77fe700 1 -- 172.21.15.49:0/3594723475 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f6ef007a6e0 con 0x7f6f000cae90 2023-11-30T17:23:01.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.855+0000 7f6eff7fe700 1 --2- 172.21.15.49:0/3594723475 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6ee005f270 0x7f6ee0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:01.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.855+0000 7f6eff7fe700 1 --2- 172.21.15.49:0/3594723475 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6ee005f270 0x7f6ee0061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f6ee8005fd0 tx=0x7f6ee8016000).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:01.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:01.858+0000 7f6ef77fe700 1 -- 172.21.15.49:0/3594723475 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6ef004b7b0 con 0x7f6f000cae90 2023-11-30T17:23:02.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.100+0000 7f6f05eb3700 1 -- 172.21.15.49:0/3594723475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f6f00165ac0 con 0x7f6f000cae90 2023-11-30T17:23:02.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.100+0000 7f6ef77fe700 1 -- 172.21.15.49:0/3594723475 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3088 (secure 0 0 0) 0x7f6ef0016c20 con 0x7f6f000cae90 2023-11-30T17:23:02.103 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:02.103 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":964,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":98,"num_osds":8,"num_up_osds":8,"osd_up_since":1701364027,"num_in_osds":8,"osd_in_since":1701364021,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":128},{"state_name":"active+clean","count":9}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2480697344,"bytes_avail":770613415936,"bytes_total":773094113280,"unknown_pgs_ratio":0.9343065619468689},"fsmap":{"epoch":39,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"d","status":"up:active","gid":6687}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2023-11-30T17:22:45.413635+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-30T17:23:02.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.102+0000 7f6f05eb3700 1 -- 172.21.15.49:0/3594723475 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6ee005f270 msgr2=0x7f6ee0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:02.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.102+0000 7f6f05eb3700 1 --2- 172.21.15.49:0/3594723475 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6ee005f270 0x7f6ee0061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f6ee8005fd0 tx=0x7f6ee8016000).stop 2023-11-30T17:23:02.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.102+0000 7f6f05eb3700 1 -- 172.21.15.49:0/3594723475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f000cae90 msgr2=0x7f6f00154e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:02.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.102+0000 7f6f05eb3700 1 --2- 172.21.15.49:0/3594723475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f000cae90 0x7f6f00154e80 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7f6ef000e900 tx=0x7f6ef0009060).stop 2023-11-30T17:23:02.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.102+0000 7f6f05eb3700 1 -- 172.21.15.49:0/3594723475 shutdown_connections 2023-11-30T17:23:02.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.102+0000 7f6f05eb3700 1 --2- 172.21.15.49:0/3594723475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f0014cc60 0x7f6f00064920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:02.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.102+0000 7f6f05eb3700 1 --2- 172.21.15.49:0/3594723475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f000caab0 0x7f6f00155bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:02.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.102+0000 7f6f05eb3700 1 --2- 172.21.15.49:0/3594723475 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6ee005f270 0x7f6ee0061730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:02.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.102+0000 7f6f05eb3700 1 --2- 172.21.15.49:0/3594723475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f000cae90 0x7f6f00154e80 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:02.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.102+0000 7f6f05eb3700 1 -- 172.21.15.49:0/3594723475 >> 172.21.15.49:0/3594723475 conn(0x7f6f00094920 msgr2=0x7f6f000b0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:02.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.102+0000 7f6f05eb3700 1 -- 172.21.15.49:0/3594723475 shutdown_connections 2023-11-30T17:23:02.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.102+0000 7f6f05eb3700 1 -- 172.21.15.49:0/3594723475 wait complete. 2023-11-30T17:23:02.117 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-30T17:23:02.117 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:23:02.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.232+0000 7f9a95d5b700 1 Processor -- start 2023-11-30T17:23:02.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.232+0000 7f9a95d5b700 1 -- start start 2023-11-30T17:23:02.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.233+0000 7f9a95d5b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9a900c5ee0 0x7f9a901531f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:02.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.233+0000 7f9a95d5b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9a900c3740 0x7f9a900c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:02.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.233+0000 7f9a95d5b700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a901569f0 con 0x7f9a900c7190 2023-11-30T17:23:02.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.233+0000 7f9a95d5b700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a900c8ed0 con 0x7f9a900c3740 2023-11-30T17:23:02.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.233+0000 7f9a95d5b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a900c7620 con 0x7f9a900c5ee0 2023-11-30T17:23:02.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.233+0000 7f9a8effd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9a900c3740 0x7f9a900c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:02.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.234+0000 7f9a8ffff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9a900c7190 0x7f9a900be000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39084/0 (socket says 172.21.15.49:39084) 2023-11-30T17:23:02.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.234+0000 7f9a8ffff700 1 -- 172.21.15.49:0/3444526243 learned_addr learned my addr 172.21.15.49:0/3444526243 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:02.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.234+0000 7f9a8f7fe700 1 --2- 172.21.15.49:0/3444526243 >> v2:172.21.15.115:3300/0 conn(0x7f9a900c5ee0 0x7f9a901531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:02.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.234+0000 7f9a8effd700 1 -- 172.21.15.49:0/3444526243 >> v2:172.21.15.115:3300/0 conn(0x7f9a900c5ee0 msgr2=0x7f9a901531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:02.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.234+0000 7f9a8effd700 1 --2- 172.21.15.49:0/3444526243 >> v2:172.21.15.115:3300/0 conn(0x7f9a900c5ee0 0x7f9a901531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:02.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.234+0000 7f9a8effd700 1 -- 172.21.15.49:0/3444526243 >> v1:172.21.15.49:6789/0 conn(0x7f9a900c7190 legacy=0x7f9a900be000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:02.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.234+0000 7f9a8effd700 1 -- 172.21.15.49:0/3444526243 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a90155de0 con 0x7f9a900c3740 2023-11-30T17:23:02.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.234+0000 7f9a8e7fc700 1 -- 172.21.15.49:0/3444526243 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532610583 0 0) 0x7f9a901569f0 con 0x7f9a900c7190 2023-11-30T17:23:02.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.234+0000 7f9a8f7fe700 1 --2- 172.21.15.49:0/3444526243 >> v2:172.21.15.115:3300/0 conn(0x7f9a900c5ee0 0x7f9a901531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:23:02.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.234+0000 7f9a8effd700 1 --2- 172.21.15.49:0/3444526243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a900c3740 0x7f9a900c6ca0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7f9a90069e70 tx=0x7f9a84009060).ready entity=mon.0 client_cookie=92a06d897a6f6831 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:02.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.234+0000 7f9a8e7fc700 1 -- 172.21.15.49:0/3444526243 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8400b580 con 0x7f9a900c3740 2023-11-30T17:23:02.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.234+0000 7f9a8e7fc700 1 -- 172.21.15.49:0/3444526243 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8400b6e0 con 0x7f9a900c3740 2023-11-30T17:23:02.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.234+0000 7f9a8e7fc700 1 -- 172.21.15.49:0/3444526243 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8400ba60 con 0x7f9a900c3740 2023-11-30T17:23:02.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.235+0000 7f9a95d5b700 1 -- 172.21.15.49:0/3444526243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a900c3740 msgr2=0x7f9a900c6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:02.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.235+0000 7f9a95d5b700 1 --2- 172.21.15.49:0/3444526243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a900c3740 0x7f9a900c6ca0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7f9a90069e70 tx=0x7f9a84009060).stop 2023-11-30T17:23:02.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.235+0000 7f9a95d5b700 1 -- 172.21.15.49:0/3444526243 shutdown_connections 2023-11-30T17:23:02.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.235+0000 7f9a95d5b700 1 --2- 172.21.15.49:0/3444526243 >> v2:172.21.15.115:3300/0 conn(0x7f9a900c5ee0 0x7f9a901531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:02.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.235+0000 7f9a95d5b700 1 --2- 172.21.15.49:0/3444526243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a900c3740 0x7f9a900c6ca0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:02.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.235+0000 7f9a95d5b700 1 -- 172.21.15.49:0/3444526243 >> 172.21.15.49:0/3444526243 conn(0x7f9a90062700 msgr2=0x7f9a90062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:02.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.235+0000 7f9a95d5b700 1 -- 172.21.15.49:0/3444526243 shutdown_connections 2023-11-30T17:23:02.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.235+0000 7f9a95d5b700 1 -- 172.21.15.49:0/3444526243 wait complete. 2023-11-30T17:23:02.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.236+0000 7f9a95d5b700 1 Processor -- start 2023-11-30T17:23:02.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.236+0000 7f9a95d5b700 1 -- start start 2023-11-30T17:23:02.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.237+0000 7f9a95d5b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a900c3740 0x7f9a900a6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:02.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.237+0000 7f9a95d5b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a900c5ee0 0x7f9a900a70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:02.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.237+0000 7f9a95d5b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a900c7190 0x7f9a900ac260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:02.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.237+0000 7f9a95d5b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a90151960 con 0x7f9a900c7190 2023-11-30T17:23:02.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.237+0000 7f9a95d5b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a900a7bd0 con 0x7f9a900c3740 2023-11-30T17:23:02.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.237+0000 7f9a95d5b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a900a78f0 con 0x7f9a900c5ee0 2023-11-30T17:23:02.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.237+0000 7f9a8ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a900c7190 0x7f9a900ac260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:02.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.237+0000 7f9a8ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a900c7190 0x7f9a900ac260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37812/0 (socket says 172.21.15.49:37812) 2023-11-30T17:23:02.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.237+0000 7f9a8ffff700 1 -- 172.21.15.49:0/2924926558 learned_addr learned my addr 172.21.15.49:0/2924926558 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:02.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.237+0000 7f9a8effd700 1 --2- 172.21.15.49:0/2924926558 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a900c5ee0 0x7f9a900a70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:02.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.237+0000 7f9a8f7fe700 1 --2- 172.21.15.49:0/2924926558 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a900c3740 0x7f9a900a6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:02.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.237+0000 7f9a8ffff700 1 -- 172.21.15.49:0/2924926558 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a900c5ee0 msgr2=0x7f9a900a70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:02.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.237+0000 7f9a8ffff700 1 --2- 172.21.15.49:0/2924926558 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a900c5ee0 0x7f9a900a70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:02.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.237+0000 7f9a8ffff700 1 -- 172.21.15.49:0/2924926558 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a900c3740 msgr2=0x7f9a900a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:02.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.237+0000 7f9a8ffff700 1 --2- 172.21.15.49:0/2924926558 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a900c3740 0x7f9a900a6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:02.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.237+0000 7f9a8ffff700 1 -- 172.21.15.49:0/2924926558 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a840092a0 con 0x7f9a900c7190 2023-11-30T17:23:02.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.237+0000 7f9a8f7fe700 1 --2- 172.21.15.49:0/2924926558 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a900c3740 0x7f9a900a6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:23:02.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.237+0000 7f9a8ffff700 1 --2- 172.21.15.49:0/2924926558 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a900c7190 0x7f9a900ac260 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7f9a8800c7e0 tx=0x7f9a88007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:02.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.238+0000 7f9a777fe700 1 -- 172.21.15.49:0/2924926558 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a88005d30 con 0x7f9a900c7190 2023-11-30T17:23:02.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.238+0000 7f9a777fe700 1 -- 172.21.15.49:0/2924926558 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a88005e90 con 0x7f9a900c7190 2023-11-30T17:23:02.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.238+0000 7f9a95d5b700 1 -- 172.21.15.49:0/2924926558 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a90063b30 con 0x7f9a900c7190 2023-11-30T17:23:02.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.238+0000 7f9a777fe700 1 -- 172.21.15.49:0/2924926558 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a88007320 con 0x7f9a900c7190 2023-11-30T17:23:02.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.238+0000 7f9a95d5b700 1 -- 172.21.15.49:0/2924926558 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a900640f0 con 0x7f9a900c7190 2023-11-30T17:23:02.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.239+0000 7f9a95d5b700 1 -- 172.21.15.49:0/2924926558 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a90064310 con 0x7f9a900c7190 2023-11-30T17:23:02.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.239+0000 7f9a777fe700 1 -- 172.21.15.49:0/2924926558 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f9a880076d0 con 0x7f9a900c7190 2023-11-30T17:23:02.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.239+0000 7f9a777fe700 1 --2- 172.21.15.49:0/2924926558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a7c05f270 0x7f9a7c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:02.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.240+0000 7f9a777fe700 1 -- 172.21.15.49:0/2924926558 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f9a8807a410 con 0x7f9a900c7190 2023-11-30T17:23:02.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.240+0000 7f9a8f7fe700 1 --2- 172.21.15.49:0/2924926558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a7c05f270 0x7f9a7c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:02.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.240+0000 7f9a8f7fe700 1 --2- 172.21.15.49:0/2924926558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a7c05f270 0x7f9a7c061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f9a80008980 tx=0x7f9a80008040).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:02.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.244+0000 7f9a777fe700 1 -- 172.21.15.49:0/2924926558 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9a8804b540 con 0x7f9a900c7190 2023-11-30T17:23:02.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.412+0000 7f9a95d5b700 1 -- 172.21.15.49:0/2924926558 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9a9006c860 con 0x7f9a7c05f270 2023-11-30T17:23:02.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.423+0000 7f9a777fe700 1 -- 172.21.15.49:0/2924926558 <== mgr.6358 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361398 (secure 0 0 0) 0x7f9a9006c860 con 0x7f9a7c05f270 2023-11-30T17:23:02.429 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:02.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.427+0000 7f9a95d5b700 1 -- 172.21.15.49:0/2924926558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a7c05f270 msgr2=0x7f9a7c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:02.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.427+0000 7f9a95d5b700 1 --2- 172.21.15.49:0/2924926558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a7c05f270 0x7f9a7c061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f9a80008980 tx=0x7f9a80008040).stop 2023-11-30T17:23:02.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.427+0000 7f9a95d5b700 1 -- 172.21.15.49:0/2924926558 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a900c7190 msgr2=0x7f9a900ac260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:02.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.427+0000 7f9a95d5b700 1 --2- 172.21.15.49:0/2924926558 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a900c7190 0x7f9a900ac260 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7f9a8800c7e0 tx=0x7f9a88007f90).stop 2023-11-30T17:23:02.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.427+0000 7f9a95d5b700 1 -- 172.21.15.49:0/2924926558 shutdown_connections 2023-11-30T17:23:02.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.427+0000 7f9a95d5b700 1 --2- 172.21.15.49:0/2924926558 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a7c05f270 0x7f9a7c061730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:02.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.427+0000 7f9a95d5b700 1 --2- 172.21.15.49:0/2924926558 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a900c7190 0x7f9a900ac260 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:02.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.427+0000 7f9a95d5b700 1 --2- 172.21.15.49:0/2924926558 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a900c3740 0x7f9a900a6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:02.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.427+0000 7f9a95d5b700 1 --2- 172.21.15.49:0/2924926558 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a900c5ee0 0x7f9a900a70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:02.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.427+0000 7f9a95d5b700 1 -- 172.21.15.49:0/2924926558 >> 172.21.15.49:0/2924926558 conn(0x7f9a90062700 msgr2=0x7f9a90067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:02.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.427+0000 7f9a95d5b700 1 -- 172.21.15.49:0/2924926558 shutdown_connections 2023-11-30T17:23:02.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:02.427+0000 7f9a95d5b700 1 -- 172.21.15.49:0/2924926558 wait complete. 2023-11-30T17:23:02.433 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:23:02.441 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-30T17:23:02.412254+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2423040,"kb_used_data":9408,"kb_used_omap":0,"kb_used_meta":2413568,"kb_avail":752551680,"statfs":{"total":773094113280,"available":770612920320,"internally_reserved":0,"allocated":9633792,"data_stored":4792876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2471493632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11233,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-64,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.008507"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.939407+0000","last_change":"2023-11-30T17:22:56.933786+0000","last_active":"2023-11-30T17:22:56.939407+0000","last_peered":"2023-11-30T17:22:56.939407+0000","last_clean":"2023-11-30T17:22:56.939407+0000","last_became_active":"2023-11-30T17:22:56.933521+0000","last_became_peered":"2023-11-30T17:22:56.933521+0000","last_unstale":"2023-11-30T17:22:56.939407+0000","last_undegraded":"2023-11-30T17:22:56.939407+0000","last_fullsized":"2023-11-30T17:22:56.939407+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3f","version":"97'3","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.945989+0000","last_change":"2023-11-30T17:22:56.545704+0000","last_active":"2023-11-30T17:22:56.945989+0000","last_peered":"2023-11-30T17:22:56.945989+0000","last_clean":"2023-11-30T17:22:56.945989+0000","last_became_active":"2023-11-30T17:22:56.545354+0000","last_became_peered":"2023-11-30T17:22:56.545354+0000","last_unstale":"2023-11-30T17:22:56.945989+0000","last_undegraded":"2023-11-30T17:22:56.945989+0000","last_fullsized":"2023-11-30T17:22:56.945989+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.944110+0000","last_change":"2023-11-30T17:22:56.937152+0000","last_active":"2023-11-30T17:22:56.944110+0000","last_peered":"2023-11-30T17:22:56.944110+0000","last_clean":"2023-11-30T17:22:56.944110+0000","last_became_active":"2023-11-30T17:22:56.936870+0000","last_became_peered":"2023-11-30T17:22:56.936870+0000","last_unstale":"2023-11-30T17:22:56.944110+0000","last_undegraded":"2023-11-30T17:22:56.944110+0000","last_fullsized":"2023-11-30T17:22:56.944110+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.926460+0000","last_change":"2023-11-30T17:22:56.553484+0000","last_active":"2023-11-30T17:22:56.926460+0000","last_peered":"2023-11-30T17:22:56.926460+0000","last_clean":"2023-11-30T17:22:56.926460+0000","last_became_active":"2023-11-30T17:22:56.552768+0000","last_became_peered":"2023-11-30T17:22:56.552768+0000","last_unstale":"2023-11-30T17:22:56.926460+0000","last_undegraded":"2023-11-30T17:22:56.926460+0000","last_fullsized":"2023-11-30T17:22:56.926460+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.941142+0000","last_change":"2023-11-30T17:22:56.937380+0000","last_active":"2023-11-30T17:22:56.941142+0000","last_peered":"2023-11-30T17:22:56.941142+0000","last_clean":"2023-11-30T17:22:56.941142+0000","last_became_active":"2023-11-30T17:22:56.937115+0000","last_became_peered":"2023-11-30T17:22:56.937115+0000","last_unstale":"2023-11-30T17:22:56.941142+0000","last_undegraded":"2023-11-30T17:22:56.941142+0000","last_fullsized":"2023-11-30T17:22:56.941142+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.923292+0000","last_change":"2023-11-30T17:22:56.542976+0000","last_active":"2023-11-30T17:22:56.923292+0000","last_peered":"2023-11-30T17:22:56.923292+0000","last_clean":"2023-11-30T17:22:56.923292+0000","last_became_active":"2023-11-30T17:22:56.542676+0000","last_became_peered":"2023-11-30T17:22:56.542676+0000","last_unstale":"2023-11-30T17:22:56.923292+0000","last_undegraded":"2023-11-30T17:22:56.923292+0000","last_fullsized":"2023-11-30T17:22:56.923292+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.937505+0000","last_change":"2023-11-30T17:22:56.931181+0000","last_active":"2023-11-30T17:22:56.937505+0000","last_peered":"2023-11-30T17:22:56.937505+0000","last_clean":"2023-11-30T17:22:56.937505+0000","last_became_active":"2023-11-30T17:22:56.930890+0000","last_became_peered":"2023-11-30T17:22:56.930890+0000","last_unstale":"2023-11-30T17:22:56.937505+0000","last_undegraded":"2023-11-30T17:22:56.937505+0000","last_fullsized":"2023-11-30T17:22:56.937505+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"97'2","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.943277+0000","last_change":"2023-11-30T17:22:56.545130+0000","last_active":"2023-11-30T17:22:56.943277+0000","last_peered":"2023-11-30T17:22:56.943277+0000","last_clean":"2023-11-30T17:22:56.943277+0000","last_became_active":"2023-11-30T17:22:56.544830+0000","last_became_peered":"2023-11-30T17:22:56.544830+0000","last_unstale":"2023-11-30T17:22:56.943277+0000","last_undegraded":"2023-11-30T17:22:56.943277+0000","last_fullsized":"2023-11-30T17:22:56.943277+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.942991+0000","last_change":"2023-11-30T17:22:56.940892+0000","last_active":"2023-11-30T17:22:56.942991+0000","last_peered":"2023-11-30T17:22:56.942991+0000","last_clean":"2023-11-30T17:22:56.942991+0000","last_became_active":"2023-11-30T17:22:56.940623+0000","last_became_peered":"2023-11-30T17:22:56.940623+0000","last_unstale":"2023-11-30T17:22:56.942991+0000","last_undegraded":"2023-11-30T17:22:56.942991+0000","last_fullsized":"2023-11-30T17:22:56.942991+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3b","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.938888+0000","last_change":"2023-11-30T17:22:56.544215+0000","last_active":"2023-11-30T17:22:56.938888+0000","last_peered":"2023-11-30T17:22:56.938888+0000","last_clean":"2023-11-30T17:22:56.938888+0000","last_became_active":"2023-11-30T17:22:56.543932+0000","last_became_peered":"2023-11-30T17:22:56.543932+0000","last_unstale":"2023-11-30T17:22:56.938888+0000","last_undegraded":"2023-11-30T17:22:56.938888+0000","last_fullsized":"2023-11-30T17:22:56.938888+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.939773+0000","last_change":"2023-11-30T17:22:56.937963+0000","last_active":"2023-11-30T17:22:56.939773+0000","last_peered":"2023-11-30T17:22:56.939773+0000","last_clean":"2023-11-30T17:22:56.939773+0000","last_became_active":"2023-11-30T17:22:56.936883+0000","last_became_peered":"2023-11-30T17:22:56.936883+0000","last_unstale":"2023-11-30T17:22:56.939773+0000","last_undegraded":"2023-11-30T17:22:56.939773+0000","last_fullsized":"2023-11-30T17:22:56.939773+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3a","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.942884+0000","last_change":"2023-11-30T17:22:56.553127+0000","last_active":"2023-11-30T17:22:56.942884+0000","last_peered":"2023-11-30T17:22:56.942884+0000","last_clean":"2023-11-30T17:22:56.942884+0000","last_became_active":"2023-11-30T17:22:56.552693+0000","last_became_peered":"2023-11-30T17:22:56.552693+0000","last_unstale":"2023-11-30T17:22:56.942884+0000","last_undegraded":"2023-11-30T17:22:56.942884+0000","last_fullsized":"2023-11-30T17:22:56.942884+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.937436+0000","last_change":"2023-11-30T17:22:56.927890+0000","last_active":"2023-11-30T17:22:56.937436+0000","last_peered":"2023-11-30T17:22:56.937436+0000","last_clean":"2023-11-30T17:22:56.937436+0000","last_became_active":"2023-11-30T17:22:56.927613+0000","last_became_peered":"2023-11-30T17:22:56.927613+0000","last_unstale":"2023-11-30T17:22:56.937436+0000","last_undegraded":"2023-11-30T17:22:56.937436+0000","last_fullsized":"2023-11-30T17:22:56.937436+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.926000+0000","last_change":"2023-11-30T17:22:56.541207+0000","last_active":"2023-11-30T17:22:56.926000+0000","last_peered":"2023-11-30T17:22:56.926000+0000","last_clean":"2023-11-30T17:22:56.926000+0000","last_became_active":"2023-11-30T17:22:56.540842+0000","last_became_peered":"2023-11-30T17:22:56.540842+0000","last_unstale":"2023-11-30T17:22:56.926000+0000","last_undegraded":"2023-11-30T17:22:56.926000+0000","last_fullsized":"2023-11-30T17:22:56.926000+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.946124+0000","last_change":"2023-11-30T17:22:56.940631+0000","last_active":"2023-11-30T17:22:56.946124+0000","last_peered":"2023-11-30T17:22:56.946124+0000","last_clean":"2023-11-30T17:22:56.946124+0000","last_became_active":"2023-11-30T17:22:56.940350+0000","last_became_peered":"2023-11-30T17:22:56.940350+0000","last_unstale":"2023-11-30T17:22:56.946124+0000","last_undegraded":"2023-11-30T17:22:56.946124+0000","last_fullsized":"2023-11-30T17:22:56.946124+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.922913+0000","last_change":"2023-11-30T17:22:56.542076+0000","last_active":"2023-11-30T17:22:56.922913+0000","last_peered":"2023-11-30T17:22:56.922913+0000","last_clean":"2023-11-30T17:22:56.922913+0000","last_became_active":"2023-11-30T17:22:56.541762+0000","last_became_peered":"2023-11-30T17:22:56.541762+0000","last_unstale":"2023-11-30T17:22:56.922913+0000","last_undegraded":"2023-11-30T17:22:56.922913+0000","last_fullsized":"2023-11-30T17:22:56.922913+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.946154+0000","last_change":"2023-11-30T17:22:56.941890+0000","last_active":"2023-11-30T17:22:56.946154+0000","last_peered":"2023-11-30T17:22:56.946154+0000","last_clean":"2023-11-30T17:22:56.946154+0000","last_became_active":"2023-11-30T17:22:56.940988+0000","last_became_peered":"2023-11-30T17:22:56.940988+0000","last_unstale":"2023-11-30T17:22:56.946154+0000","last_undegraded":"2023-11-30T17:22:56.946154+0000","last_fullsized":"2023-11-30T17:22:56.946154+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.923010+0000","last_change":"2023-11-30T17:22:56.547588+0000","last_active":"2023-11-30T17:22:56.923010+0000","last_peered":"2023-11-30T17:22:56.923010+0000","last_clean":"2023-11-30T17:22:56.923010+0000","last_became_active":"2023-11-30T17:22:56.547130+0000","last_became_peered":"2023-11-30T17:22:56.547130+0000","last_unstale":"2023-11-30T17:22:56.923010+0000","last_undegraded":"2023-11-30T17:22:56.923010+0000","last_fullsized":"2023-11-30T17:22:56.923010+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.934710+0000","last_change":"2023-11-30T17:22:56.928987+0000","last_active":"2023-11-30T17:22:56.934710+0000","last_peered":"2023-11-30T17:22:56.934710+0000","last_clean":"2023-11-30T17:22:56.934710+0000","last_became_active":"2023-11-30T17:22:56.928734+0000","last_became_peered":"2023-11-30T17:22:56.928734+0000","last_unstale":"2023-11-30T17:22:56.934710+0000","last_undegraded":"2023-11-30T17:22:56.934710+0000","last_fullsized":"2023-11-30T17:22:56.934710+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.936600+0000","last_change":"2023-11-30T17:22:56.553304+0000","last_active":"2023-11-30T17:22:56.936600+0000","last_peered":"2023-11-30T17:22:56.936600+0000","last_clean":"2023-11-30T17:22:56.936600+0000","last_became_active":"2023-11-30T17:22:56.553019+0000","last_became_peered":"2023-11-30T17:22:56.553019+0000","last_unstale":"2023-11-30T17:22:56.936600+0000","last_undegraded":"2023-11-30T17:22:56.936600+0000","last_fullsized":"2023-11-30T17:22:56.936600+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.941221+0000","last_change":"2023-11-30T17:22:56.940006+0000","last_active":"2023-11-30T17:22:56.941221+0000","last_peered":"2023-11-30T17:22:56.941221+0000","last_clean":"2023-11-30T17:22:56.941221+0000","last_became_active":"2023-11-30T17:22:56.939744+0000","last_became_peered":"2023-11-30T17:22:56.939744+0000","last_unstale":"2023-11-30T17:22:56.941221+0000","last_undegraded":"2023-11-30T17:22:56.941221+0000","last_fullsized":"2023-11-30T17:22:56.941221+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.927696+0000","last_change":"2023-11-30T17:22:56.548600+0000","last_active":"2023-11-30T17:22:56.927696+0000","last_peered":"2023-11-30T17:22:56.927696+0000","last_clean":"2023-11-30T17:22:56.927696+0000","last_became_active":"2023-11-30T17:22:56.548110+0000","last_became_peered":"2023-11-30T17:22:56.548110+0000","last_unstale":"2023-11-30T17:22:56.927696+0000","last_undegraded":"2023-11-30T17:22:56.927696+0000","last_fullsized":"2023-11-30T17:22:56.927696+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.940134+0000","last_change":"2023-11-30T17:22:56.934739+0000","last_active":"2023-11-30T17:22:56.940134+0000","last_peered":"2023-11-30T17:22:56.940134+0000","last_clean":"2023-11-30T17:22:56.940134+0000","last_became_active":"2023-11-30T17:22:56.934462+0000","last_became_peered":"2023-11-30T17:22:56.934462+0000","last_unstale":"2023-11-30T17:22:56.940134+0000","last_undegraded":"2023-11-30T17:22:56.940134+0000","last_fullsized":"2023-11-30T17:22:56.940134+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.34","version":"97'4","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.944904+0000","last_change":"2023-11-30T17:22:56.544038+0000","last_active":"2023-11-30T17:22:56.944904+0000","last_peered":"2023-11-30T17:22:56.944904+0000","last_clean":"2023-11-30T17:22:56.944904+0000","last_became_active":"2023-11-30T17:22:56.543337+0000","last_became_peered":"2023-11-30T17:22:56.543337+0000","last_unstale":"2023-11-30T17:22:56.944904+0000","last_undegraded":"2023-11-30T17:22:56.944904+0000","last_fullsized":"2023-11-30T17:22:56.944904+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.942973+0000","last_change":"2023-11-30T17:22:56.940232+0000","last_active":"2023-11-30T17:22:56.942973+0000","last_peered":"2023-11-30T17:22:56.942973+0000","last_clean":"2023-11-30T17:22:56.942973+0000","last_became_active":"2023-11-30T17:22:56.939828+0000","last_became_peered":"2023-11-30T17:22:56.939828+0000","last_unstale":"2023-11-30T17:22:56.942973+0000","last_undegraded":"2023-11-30T17:22:56.942973+0000","last_fullsized":"2023-11-30T17:22:56.942973+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.33","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.937727+0000","last_change":"2023-11-30T17:22:56.546116+0000","last_active":"2023-11-30T17:22:56.937727+0000","last_peered":"2023-11-30T17:22:56.937727+0000","last_clean":"2023-11-30T17:22:56.937727+0000","last_became_active":"2023-11-30T17:22:56.545858+0000","last_became_peered":"2023-11-30T17:22:56.545858+0000","last_unstale":"2023-11-30T17:22:56.937727+0000","last_undegraded":"2023-11-30T17:22:56.937727+0000","last_fullsized":"2023-11-30T17:22:56.937727+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.938541+0000","last_change":"2023-11-30T17:22:56.930636+0000","last_active":"2023-11-30T17:22:56.938541+0000","last_peered":"2023-11-30T17:22:56.938541+0000","last_clean":"2023-11-30T17:22:56.938541+0000","last_became_active":"2023-11-30T17:22:56.930370+0000","last_became_peered":"2023-11-30T17:22:56.930370+0000","last_unstale":"2023-11-30T17:22:56.938541+0000","last_undegraded":"2023-11-30T17:22:56.938541+0000","last_fullsized":"2023-11-30T17:22:56.938541+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.923476+0000","last_change":"2023-11-30T17:22:56.541930+0000","last_active":"2023-11-30T17:22:56.923476+0000","last_peered":"2023-11-30T17:22:56.923476+0000","last_clean":"2023-11-30T17:22:56.923476+0000","last_became_active":"2023-11-30T17:22:56.541090+0000","last_became_peered":"2023-11-30T17:22:56.541090+0000","last_unstale":"2023-11-30T17:22:56.923476+0000","last_undegraded":"2023-11-30T17:22:56.923476+0000","last_fullsized":"2023-11-30T17:22:56.923476+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.940328+0000","last_change":"2023-11-30T17:22:56.938088+0000","last_active":"2023-11-30T17:22:56.940328+0000","last_peered":"2023-11-30T17:22:56.940328+0000","last_clean":"2023-11-30T17:22:56.940328+0000","last_became_active":"2023-11-30T17:22:56.937797+0000","last_became_peered":"2023-11-30T17:22:56.937797+0000","last_unstale":"2023-11-30T17:22:56.940328+0000","last_undegraded":"2023-11-30T17:22:56.940328+0000","last_fullsized":"2023-11-30T17:22:56.940328+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.916850+0000","last_change":"2023-11-30T17:22:56.544004+0000","last_active":"2023-11-30T17:22:56.916850+0000","last_peered":"2023-11-30T17:22:56.916850+0000","last_clean":"2023-11-30T17:22:56.916850+0000","last_became_active":"2023-11-30T17:22:56.543733+0000","last_became_peered":"2023-11-30T17:22:56.543733+0000","last_unstale":"2023-11-30T17:22:56.916850+0000","last_undegraded":"2023-11-30T17:22:56.916850+0000","last_fullsized":"2023-11-30T17:22:56.916850+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.942362+0000","last_change":"2023-11-30T17:22:56.939092+0000","last_active":"2023-11-30T17:22:56.942362+0000","last_peered":"2023-11-30T17:22:56.942362+0000","last_clean":"2023-11-30T17:22:56.942362+0000","last_became_active":"2023-11-30T17:22:56.938732+0000","last_became_peered":"2023-11-30T17:22:56.938732+0000","last_unstale":"2023-11-30T17:22:56.942362+0000","last_undegraded":"2023-11-30T17:22:56.942362+0000","last_fullsized":"2023-11-30T17:22:56.942362+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"97'4","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.945162+0000","last_change":"2023-11-30T17:22:56.549461+0000","last_active":"2023-11-30T17:22:56.945162+0000","last_peered":"2023-11-30T17:22:56.945162+0000","last_clean":"2023-11-30T17:22:56.945162+0000","last_became_active":"2023-11-30T17:22:56.549199+0000","last_became_peered":"2023-11-30T17:22:56.549199+0000","last_unstale":"2023-11-30T17:22:56.945162+0000","last_undegraded":"2023-11-30T17:22:56.945162+0000","last_fullsized":"2023-11-30T17:22:56.945162+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.939005+0000","last_change":"2023-11-30T17:22:56.932762+0000","last_active":"2023-11-30T17:22:56.939005+0000","last_peered":"2023-11-30T17:22:56.939005+0000","last_clean":"2023-11-30T17:22:56.939005+0000","last_became_active":"2023-11-30T17:22:56.932481+0000","last_became_peered":"2023-11-30T17:22:56.932481+0000","last_unstale":"2023-11-30T17:22:56.939005+0000","last_undegraded":"2023-11-30T17:22:56.939005+0000","last_fullsized":"2023-11-30T17:22:56.939005+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.923046+0000","last_change":"2023-11-30T17:22:56.547735+0000","last_active":"2023-11-30T17:22:56.923046+0000","last_peered":"2023-11-30T17:22:56.923046+0000","last_clean":"2023-11-30T17:22:56.923046+0000","last_became_active":"2023-11-30T17:22:56.547437+0000","last_became_peered":"2023-11-30T17:22:56.547437+0000","last_unstale":"2023-11-30T17:22:56.923046+0000","last_undegraded":"2023-11-30T17:22:56.923046+0000","last_fullsized":"2023-11-30T17:22:56.923046+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.942533+0000","last_change":"2023-11-30T17:22:56.937469+0000","last_active":"2023-11-30T17:22:56.942533+0000","last_peered":"2023-11-30T17:22:56.942533+0000","last_clean":"2023-11-30T17:22:56.942533+0000","last_became_active":"2023-11-30T17:22:56.937087+0000","last_became_peered":"2023-11-30T17:22:56.937087+0000","last_unstale":"2023-11-30T17:22:56.942533+0000","last_undegraded":"2023-11-30T17:22:56.942533+0000","last_fullsized":"2023-11-30T17:22:56.942533+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.920951+0000","last_change":"2023-11-30T17:22:56.545078+0000","last_active":"2023-11-30T17:22:56.920951+0000","last_peered":"2023-11-30T17:22:56.920951+0000","last_clean":"2023-11-30T17:22:56.920951+0000","last_became_active":"2023-11-30T17:22:56.544794+0000","last_became_peered":"2023-11-30T17:22:56.544794+0000","last_unstale":"2023-11-30T17:22:56.920951+0000","last_undegraded":"2023-11-30T17:22:56.920951+0000","last_fullsized":"2023-11-30T17:22:56.920951+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.939053+0000","last_change":"2023-11-30T17:22:56.932435+0000","last_active":"2023-11-30T17:22:56.939053+0000","last_peered":"2023-11-30T17:22:56.939053+0000","last_clean":"2023-11-30T17:22:56.939053+0000","last_became_active":"2023-11-30T17:22:56.932160+0000","last_became_peered":"2023-11-30T17:22:56.932160+0000","last_unstale":"2023-11-30T17:22:56.939053+0000","last_undegraded":"2023-11-30T17:22:56.939053+0000","last_fullsized":"2023-11-30T17:22:56.939053+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2d","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.936764+0000","last_change":"2023-11-30T17:22:56.543215+0000","last_active":"2023-11-30T17:22:56.936764+0000","last_peered":"2023-11-30T17:22:56.936764+0000","last_clean":"2023-11-30T17:22:56.936764+0000","last_became_active":"2023-11-30T17:22:56.542916+0000","last_became_peered":"2023-11-30T17:22:56.542916+0000","last_unstale":"2023-11-30T17:22:56.936764+0000","last_undegraded":"2023-11-30T17:22:56.936764+0000","last_fullsized":"2023-11-30T17:22:56.936764+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.945779+0000","last_change":"2023-11-30T17:22:56.940113+0000","last_active":"2023-11-30T17:22:56.945779+0000","last_peered":"2023-11-30T17:22:56.945779+0000","last_clean":"2023-11-30T17:22:56.945779+0000","last_became_active":"2023-11-30T17:22:56.939847+0000","last_became_peered":"2023-11-30T17:22:56.939847+0000","last_unstale":"2023-11-30T17:22:56.945779+0000","last_undegraded":"2023-11-30T17:22:56.945779+0000","last_fullsized":"2023-11-30T17:22:56.945779+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.917029+0000","last_change":"2023-11-30T17:22:56.541827+0000","last_active":"2023-11-30T17:22:56.917029+0000","last_peered":"2023-11-30T17:22:56.917029+0000","last_clean":"2023-11-30T17:22:56.917029+0000","last_became_active":"2023-11-30T17:22:56.541399+0000","last_became_peered":"2023-11-30T17:22:56.541399+0000","last_unstale":"2023-11-30T17:22:56.917029+0000","last_undegraded":"2023-11-30T17:22:56.917029+0000","last_fullsized":"2023-11-30T17:22:56.917029+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.931618+0000","last_change":"2023-11-30T17:22:56.928581+0000","last_active":"2023-11-30T17:22:56.931618+0000","last_peered":"2023-11-30T17:22:56.931618+0000","last_clean":"2023-11-30T17:22:56.931618+0000","last_became_active":"2023-11-30T17:22:56.928305+0000","last_became_peered":"2023-11-30T17:22:56.928305+0000","last_unstale":"2023-11-30T17:22:56.931618+0000","last_undegraded":"2023-11-30T17:22:56.931618+0000","last_fullsized":"2023-11-30T17:22:56.931618+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2b","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.939657+0000","last_change":"2023-11-30T17:22:56.549578+0000","last_active":"2023-11-30T17:22:56.939657+0000","last_peered":"2023-11-30T17:22:56.939657+0000","last_clean":"2023-11-30T17:22:56.939657+0000","last_became_active":"2023-11-30T17:22:56.548903+0000","last_became_peered":"2023-11-30T17:22:56.548903+0000","last_unstale":"2023-11-30T17:22:56.939657+0000","last_undegraded":"2023-11-30T17:22:56.939657+0000","last_fullsized":"2023-11-30T17:22:56.939657+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.938980+0000","last_change":"2023-11-30T17:22:56.933489+0000","last_active":"2023-11-30T17:22:56.938980+0000","last_peered":"2023-11-30T17:22:56.938980+0000","last_clean":"2023-11-30T17:22:56.938980+0000","last_became_active":"2023-11-30T17:22:56.933205+0000","last_became_peered":"2023-11-30T17:22:56.933205+0000","last_unstale":"2023-11-30T17:22:56.938980+0000","last_undegraded":"2023-11-30T17:22:56.938980+0000","last_fullsized":"2023-11-30T17:22:56.938980+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.935734+0000","last_change":"2023-11-30T17:22:56.552648+0000","last_active":"2023-11-30T17:22:56.935734+0000","last_peered":"2023-11-30T17:22:56.935734+0000","last_clean":"2023-11-30T17:22:56.935734+0000","last_became_active":"2023-11-30T17:22:56.552369+0000","last_became_peered":"2023-11-30T17:22:56.552369+0000","last_unstale":"2023-11-30T17:22:56.935734+0000","last_undegraded":"2023-11-30T17:22:56.935734+0000","last_fullsized":"2023-11-30T17:22:56.935734+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.935412+0000","last_change":"2023-11-30T17:22:56.931901+0000","last_active":"2023-11-30T17:22:56.935412+0000","last_peered":"2023-11-30T17:22:56.935412+0000","last_clean":"2023-11-30T17:22:56.935412+0000","last_became_active":"2023-11-30T17:22:56.931622+0000","last_became_peered":"2023-11-30T17:22:56.931622+0000","last_unstale":"2023-11-30T17:22:56.935412+0000","last_undegraded":"2023-11-30T17:22:56.935412+0000","last_fullsized":"2023-11-30T17:22:56.935412+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.926359+0000","last_change":"2023-11-30T17:22:56.544425+0000","last_active":"2023-11-30T17:22:56.926359+0000","last_peered":"2023-11-30T17:22:56.926359+0000","last_clean":"2023-11-30T17:22:56.926359+0000","last_became_active":"2023-11-30T17:22:56.544143+0000","last_became_peered":"2023-11-30T17:22:56.544143+0000","last_unstale":"2023-11-30T17:22:56.926359+0000","last_undegraded":"2023-11-30T17:22:56.926359+0000","last_fullsized":"2023-11-30T17:22:56.926359+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.940837+0000","last_change":"2023-11-30T17:22:56.938672+0000","last_active":"2023-11-30T17:22:56.940837+0000","last_peered":"2023-11-30T17:22:56.940837+0000","last_clean":"2023-11-30T17:22:56.940837+0000","last_became_active":"2023-11-30T17:22:56.938237+0000","last_became_peered":"2023-11-30T17:22:56.938237+0000","last_unstale":"2023-11-30T17:22:56.940837+0000","last_undegraded":"2023-11-30T17:22:56.940837+0000","last_fullsized":"2023-11-30T17:22:56.940837+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.926384+0000","last_change":"2023-11-30T17:22:56.550867+0000","last_active":"2023-11-30T17:22:56.926384+0000","last_peered":"2023-11-30T17:22:56.926384+0000","last_clean":"2023-11-30T17:22:56.926384+0000","last_became_active":"2023-11-30T17:22:56.550522+0000","last_became_peered":"2023-11-30T17:22:56.550522+0000","last_unstale":"2023-11-30T17:22:56.926384+0000","last_undegraded":"2023-11-30T17:22:56.926384+0000","last_fullsized":"2023-11-30T17:22:56.926384+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.946177+0000","last_change":"2023-11-30T17:22:56.942078+0000","last_active":"2023-11-30T17:22:56.946177+0000","last_peered":"2023-11-30T17:22:56.946177+0000","last_clean":"2023-11-30T17:22:56.946177+0000","last_became_active":"2023-11-30T17:22:56.941598+0000","last_became_peered":"2023-11-30T17:22:56.941598+0000","last_unstale":"2023-11-30T17:22:56.946177+0000","last_undegraded":"2023-11-30T17:22:56.946177+0000","last_fullsized":"2023-11-30T17:22:56.946177+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.936004+0000","last_change":"2023-11-30T17:22:56.550072+0000","last_active":"2023-11-30T17:22:56.936004+0000","last_peered":"2023-11-30T17:22:56.936004+0000","last_clean":"2023-11-30T17:22:56.936004+0000","last_became_active":"2023-11-30T17:22:56.549806+0000","last_became_peered":"2023-11-30T17:22:56.549806+0000","last_unstale":"2023-11-30T17:22:56.936004+0000","last_undegraded":"2023-11-30T17:22:56.936004+0000","last_fullsized":"2023-11-30T17:22:56.936004+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.939741+0000","last_change":"2023-11-30T17:22:56.937648+0000","last_active":"2023-11-30T17:22:56.939741+0000","last_peered":"2023-11-30T17:22:56.939741+0000","last_clean":"2023-11-30T17:22:56.939741+0000","last_became_active":"2023-11-30T17:22:56.937360+0000","last_became_peered":"2023-11-30T17:22:56.937360+0000","last_unstale":"2023-11-30T17:22:56.939741+0000","last_undegraded":"2023-11-30T17:22:56.939741+0000","last_fullsized":"2023-11-30T17:22:56.939741+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.928426+0000","last_change":"2023-11-30T17:22:56.547268+0000","last_active":"2023-11-30T17:22:56.928426+0000","last_peered":"2023-11-30T17:22:56.928426+0000","last_clean":"2023-11-30T17:22:56.928426+0000","last_became_active":"2023-11-30T17:22:56.546838+0000","last_became_peered":"2023-11-30T17:22:56.546838+0000","last_unstale":"2023-11-30T17:22:56.928426+0000","last_undegraded":"2023-11-30T17:22:56.928426+0000","last_fullsized":"2023-11-30T17:22:56.928426+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.946082+0000","last_change":"2023-11-30T17:22:56.939774+0000","last_active":"2023-11-30T17:22:56.946082+0000","last_peered":"2023-11-30T17:22:56.946082+0000","last_clean":"2023-11-30T17:22:56.946082+0000","last_became_active":"2023-11-30T17:22:56.939411+0000","last_became_peered":"2023-11-30T17:22:56.939411+0000","last_unstale":"2023-11-30T17:22:56.946082+0000","last_undegraded":"2023-11-30T17:22:56.946082+0000","last_fullsized":"2023-11-30T17:22:56.946082+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.923389+0000","last_change":"2023-11-30T17:22:56.545710+0000","last_active":"2023-11-30T17:22:56.923389+0000","last_peered":"2023-11-30T17:22:56.923389+0000","last_clean":"2023-11-30T17:22:56.923389+0000","last_became_active":"2023-11-30T17:22:56.545406+0000","last_became_peered":"2023-11-30T17:22:56.545406+0000","last_unstale":"2023-11-30T17:22:56.923389+0000","last_undegraded":"2023-11-30T17:22:56.923389+0000","last_fullsized":"2023-11-30T17:22:56.923389+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.938739+0000","last_change":"2023-11-30T17:22:56.932208+0000","last_active":"2023-11-30T17:22:56.938739+0000","last_peered":"2023-11-30T17:22:56.938739+0000","last_clean":"2023-11-30T17:22:56.938739+0000","last_became_active":"2023-11-30T17:22:56.931934+0000","last_became_peered":"2023-11-30T17:22:56.931934+0000","last_unstale":"2023-11-30T17:22:56.938739+0000","last_undegraded":"2023-11-30T17:22:56.938739+0000","last_fullsized":"2023-11-30T17:22:56.938739+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.936164+0000","last_change":"2023-11-30T17:22:56.549027+0000","last_active":"2023-11-30T17:22:56.936164+0000","last_peered":"2023-11-30T17:22:56.936164+0000","last_clean":"2023-11-30T17:22:56.936164+0000","last_became_active":"2023-11-30T17:22:56.548721+0000","last_became_peered":"2023-11-30T17:22:56.548721+0000","last_unstale":"2023-11-30T17:22:56.936164+0000","last_undegraded":"2023-11-30T17:22:56.936164+0000","last_fullsized":"2023-11-30T17:22:56.936164+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.940236+0000","last_change":"2023-11-30T17:22:56.936981+0000","last_active":"2023-11-30T17:22:56.940236+0000","last_peered":"2023-11-30T17:22:56.940236+0000","last_clean":"2023-11-30T17:22:56.940236+0000","last_became_active":"2023-11-30T17:22:56.936715+0000","last_became_peered":"2023-11-30T17:22:56.936715+0000","last_unstale":"2023-11-30T17:22:56.940236+0000","last_undegraded":"2023-11-30T17:22:56.940236+0000","last_fullsized":"2023-11-30T17:22:56.940236+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.925215+0000","last_change":"2023-11-30T17:22:56.541837+0000","last_active":"2023-11-30T17:22:56.925215+0000","last_peered":"2023-11-30T17:22:56.925215+0000","last_clean":"2023-11-30T17:22:56.925215+0000","last_became_active":"2023-11-30T17:22:56.541125+0000","last_became_peered":"2023-11-30T17:22:56.541125+0000","last_unstale":"2023-11-30T17:22:56.925215+0000","last_undegraded":"2023-11-30T17:22:56.925215+0000","last_fullsized":"2023-11-30T17:22:56.925215+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.948563+0000","last_change":"2023-11-30T17:22:56.943276+0000","last_active":"2023-11-30T17:22:56.948563+0000","last_peered":"2023-11-30T17:22:56.948563+0000","last_clean":"2023-11-30T17:22:56.948563+0000","last_became_active":"2023-11-30T17:22:56.941728+0000","last_became_peered":"2023-11-30T17:22:56.941728+0000","last_unstale":"2023-11-30T17:22:56.948563+0000","last_undegraded":"2023-11-30T17:22:56.948563+0000","last_fullsized":"2023-11-30T17:22:56.948563+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.924268+0000","last_change":"2023-11-30T17:22:56.546491+0000","last_active":"2023-11-30T17:22:56.924268+0000","last_peered":"2023-11-30T17:22:56.924268+0000","last_clean":"2023-11-30T17:22:56.924268+0000","last_became_active":"2023-11-30T17:22:56.546198+0000","last_became_peered":"2023-11-30T17:22:56.546198+0000","last_unstale":"2023-11-30T17:22:56.924268+0000","last_undegraded":"2023-11-30T17:22:56.924268+0000","last_fullsized":"2023-11-30T17:22:56.924268+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.942494+0000","last_change":"2023-11-30T17:22:56.939719+0000","last_active":"2023-11-30T17:22:56.942494+0000","last_peered":"2023-11-30T17:22:56.942494+0000","last_clean":"2023-11-30T17:22:56.942494+0000","last_became_active":"2023-11-30T17:22:56.939377+0000","last_became_peered":"2023-11-30T17:22:56.939377+0000","last_unstale":"2023-11-30T17:22:56.942494+0000","last_undegraded":"2023-11-30T17:22:56.942494+0000","last_fullsized":"2023-11-30T17:22:56.942494+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.926111+0000","last_change":"2023-11-30T17:22:56.545478+0000","last_active":"2023-11-30T17:22:56.926111+0000","last_peered":"2023-11-30T17:22:56.926111+0000","last_clean":"2023-11-30T17:22:56.926111+0000","last_became_active":"2023-11-30T17:22:56.545205+0000","last_became_peered":"2023-11-30T17:22:56.545205+0000","last_unstale":"2023-11-30T17:22:56.926111+0000","last_undegraded":"2023-11-30T17:22:56.926111+0000","last_fullsized":"2023-11-30T17:22:56.926111+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.938972+0000","last_change":"2023-11-30T17:22:56.932215+0000","last_active":"2023-11-30T17:22:56.938972+0000","last_peered":"2023-11-30T17:22:56.938972+0000","last_clean":"2023-11-30T17:22:56.938972+0000","last_became_active":"2023-11-30T17:22:56.931947+0000","last_became_peered":"2023-11-30T17:22:56.931947+0000","last_unstale":"2023-11-30T17:22:56.938972+0000","last_undegraded":"2023-11-30T17:22:56.938972+0000","last_fullsized":"2023-11-30T17:22:56.938972+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.922255+0000","last_change":"2023-11-30T17:22:56.546193+0000","last_active":"2023-11-30T17:22:56.922255+0000","last_peered":"2023-11-30T17:22:56.922255+0000","last_clean":"2023-11-30T17:22:56.922255+0000","last_became_active":"2023-11-30T17:22:56.545804+0000","last_became_peered":"2023-11-30T17:22:56.545804+0000","last_unstale":"2023-11-30T17:22:56.922255+0000","last_undegraded":"2023-11-30T17:22:56.922255+0000","last_fullsized":"2023-11-30T17:22:56.922255+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.942452+0000","last_change":"2023-11-30T17:22:56.940164+0000","last_active":"2023-11-30T17:22:56.942452+0000","last_peered":"2023-11-30T17:22:56.942452+0000","last_clean":"2023-11-30T17:22:56.942452+0000","last_became_active":"2023-11-30T17:22:56.939899+0000","last_became_peered":"2023-11-30T17:22:56.939899+0000","last_unstale":"2023-11-30T17:22:56.942452+0000","last_undegraded":"2023-11-30T17:22:56.942452+0000","last_fullsized":"2023-11-30T17:22:56.942452+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.932065+0000","last_change":"2023-11-30T17:22:56.547410+0000","last_active":"2023-11-30T17:22:56.932065+0000","last_peered":"2023-11-30T17:22:56.932065+0000","last_clean":"2023-11-30T17:22:56.932065+0000","last_became_active":"2023-11-30T17:22:56.547060+0000","last_became_peered":"2023-11-30T17:22:56.547060+0000","last_unstale":"2023-11-30T17:22:56.932065+0000","last_undegraded":"2023-11-30T17:22:56.932065+0000","last_fullsized":"2023-11-30T17:22:56.932065+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.938646+0000","last_change":"2023-11-30T17:22:56.933756+0000","last_active":"2023-11-30T17:22:56.938646+0000","last_peered":"2023-11-30T17:22:56.938646+0000","last_clean":"2023-11-30T17:22:56.938646+0000","last_became_active":"2023-11-30T17:22:56.933473+0000","last_became_peered":"2023-11-30T17:22:56.933473+0000","last_unstale":"2023-11-30T17:22:56.938646+0000","last_undegraded":"2023-11-30T17:22:56.938646+0000","last_fullsized":"2023-11-30T17:22:56.938646+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.939154+0000","last_change":"2023-11-30T17:22:56.550134+0000","last_active":"2023-11-30T17:22:56.939154+0000","last_peered":"2023-11-30T17:22:56.939154+0000","last_clean":"2023-11-30T17:22:56.939154+0000","last_became_active":"2023-11-30T17:22:56.549863+0000","last_became_peered":"2023-11-30T17:22:56.549863+0000","last_unstale":"2023-11-30T17:22:56.939154+0000","last_undegraded":"2023-11-30T17:22:56.939154+0000","last_fullsized":"2023-11-30T17:22:56.939154+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.938973+0000","last_change":"2023-11-30T17:22:56.932434+0000","last_active":"2023-11-30T17:22:56.938973+0000","last_peered":"2023-11-30T17:22:56.938973+0000","last_clean":"2023-11-30T17:22:56.938973+0000","last_became_active":"2023-11-30T17:22:56.932112+0000","last_became_peered":"2023-11-30T17:22:56.932112+0000","last_unstale":"2023-11-30T17:22:56.938973+0000","last_undegraded":"2023-11-30T17:22:56.938973+0000","last_fullsized":"2023-11-30T17:22:56.938973+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"97'2","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.940124+0000","last_change":"2023-11-30T17:22:56.544287+0000","last_active":"2023-11-30T17:22:56.940124+0000","last_peered":"2023-11-30T17:22:56.940124+0000","last_clean":"2023-11-30T17:22:56.940124+0000","last_became_active":"2023-11-30T17:22:56.544006+0000","last_became_peered":"2023-11-30T17:22:56.544006+0000","last_unstale":"2023-11-30T17:22:56.940124+0000","last_undegraded":"2023-11-30T17:22:56.940124+0000","last_fullsized":"2023-11-30T17:22:56.940124+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.942360+0000","last_change":"2023-11-30T17:22:56.937873+0000","last_active":"2023-11-30T17:22:56.942360+0000","last_peered":"2023-11-30T17:22:56.942360+0000","last_clean":"2023-11-30T17:22:56.942360+0000","last_became_active":"2023-11-30T17:22:56.937610+0000","last_became_peered":"2023-11-30T17:22:56.937610+0000","last_unstale":"2023-11-30T17:22:56.942360+0000","last_undegraded":"2023-11-30T17:22:56.942360+0000","last_fullsized":"2023-11-30T17:22:56.942360+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.932429+0000","last_change":"2023-11-30T17:22:56.544160+0000","last_active":"2023-11-30T17:22:56.932429+0000","last_peered":"2023-11-30T17:22:56.932429+0000","last_clean":"2023-11-30T17:22:56.932429+0000","last_became_active":"2023-11-30T17:22:56.543871+0000","last_became_peered":"2023-11-30T17:22:56.543871+0000","last_unstale":"2023-11-30T17:22:56.932429+0000","last_undegraded":"2023-11-30T17:22:56.932429+0000","last_fullsized":"2023-11-30T17:22:56.932429+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.936274+0000","last_change":"2023-11-30T17:22:56.927887+0000","last_active":"2023-11-30T17:22:56.936274+0000","last_peered":"2023-11-30T17:22:56.936274+0000","last_clean":"2023-11-30T17:22:56.936274+0000","last_became_active":"2023-11-30T17:22:56.927603+0000","last_became_peered":"2023-11-30T17:22:56.927603+0000","last_unstale":"2023-11-30T17:22:56.936274+0000","last_undegraded":"2023-11-30T17:22:56.936274+0000","last_fullsized":"2023-11-30T17:22:56.936274+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.935829+0000","last_change":"2023-11-30T17:22:56.551036+0000","last_active":"2023-11-30T17:22:56.935829+0000","last_peered":"2023-11-30T17:22:56.935829+0000","last_clean":"2023-11-30T17:22:56.935829+0000","last_became_active":"2023-11-30T17:22:56.549232+0000","last_became_peered":"2023-11-30T17:22:56.549232+0000","last_unstale":"2023-11-30T17:22:56.935829+0000","last_undegraded":"2023-11-30T17:22:56.935829+0000","last_fullsized":"2023-11-30T17:22:56.935829+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.938520+0000","last_change":"2023-11-30T17:22:56.930449+0000","last_active":"2023-11-30T17:22:56.938520+0000","last_peered":"2023-11-30T17:22:56.938520+0000","last_clean":"2023-11-30T17:22:56.938520+0000","last_became_active":"2023-11-30T17:22:56.930025+0000","last_became_peered":"2023-11-30T17:22:56.930025+0000","last_unstale":"2023-11-30T17:22:56.938520+0000","last_undegraded":"2023-11-30T17:22:56.938520+0000","last_fullsized":"2023-11-30T17:22:56.938520+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.924374+0000","last_change":"2023-11-30T17:22:56.542262+0000","last_active":"2023-11-30T17:22:56.924374+0000","last_peered":"2023-11-30T17:22:56.924374+0000","last_clean":"2023-11-30T17:22:56.924374+0000","last_became_active":"2023-11-30T17:22:56.541925+0000","last_became_peered":"2023-11-30T17:22:56.541925+0000","last_unstale":"2023-11-30T17:22:56.924374+0000","last_undegraded":"2023-11-30T17:22:56.924374+0000","last_fullsized":"2023-11-30T17:22:56.924374+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.945702+0000","last_change":"2023-11-30T17:22:56.939993+0000","last_active":"2023-11-30T17:22:56.945702+0000","last_peered":"2023-11-30T17:22:56.945702+0000","last_clean":"2023-11-30T17:22:56.945702+0000","last_became_active":"2023-11-30T17:22:56.939685+0000","last_became_peered":"2023-11-30T17:22:56.939685+0000","last_unstale":"2023-11-30T17:22:56.945702+0000","last_undegraded":"2023-11-30T17:22:56.945702+0000","last_fullsized":"2023-11-30T17:22:56.945702+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.916984+0000","last_change":"2023-11-30T17:22:56.539980+0000","last_active":"2023-11-30T17:22:56.916984+0000","last_peered":"2023-11-30T17:22:56.916984+0000","last_clean":"2023-11-30T17:22:56.916984+0000","last_became_active":"2023-11-30T17:22:56.539695+0000","last_became_peered":"2023-11-30T17:22:56.539695+0000","last_unstale":"2023-11-30T17:22:56.916984+0000","last_undegraded":"2023-11-30T17:22:56.916984+0000","last_fullsized":"2023-11-30T17:22:56.916984+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.943791+0000","last_change":"2023-11-30T17:22:56.935570+0000","last_active":"2023-11-30T17:22:56.943791+0000","last_peered":"2023-11-30T17:22:56.943791+0000","last_clean":"2023-11-30T17:22:56.943791+0000","last_became_active":"2023-11-30T17:22:56.933951+0000","last_became_peered":"2023-11-30T17:22:56.933951+0000","last_unstale":"2023-11-30T17:22:56.943791+0000","last_undegraded":"2023-11-30T17:22:56.943791+0000","last_fullsized":"2023-11-30T17:22:56.943791+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.921433+0000","last_change":"2023-11-30T17:22:56.551002+0000","last_active":"2023-11-30T17:22:56.921433+0000","last_peered":"2023-11-30T17:22:56.921433+0000","last_clean":"2023-11-30T17:22:56.921433+0000","last_became_active":"2023-11-30T17:22:56.550724+0000","last_became_peered":"2023-11-30T17:22:56.550724+0000","last_unstale":"2023-11-30T17:22:56.921433+0000","last_undegraded":"2023-11-30T17:22:56.921433+0000","last_fullsized":"2023-11-30T17:22:56.921433+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.939033+0000","last_change":"2023-11-30T17:22:56.935206+0000","last_active":"2023-11-30T17:22:56.939033+0000","last_peered":"2023-11-30T17:22:56.939033+0000","last_clean":"2023-11-30T17:22:56.939033+0000","last_became_active":"2023-11-30T17:22:56.934913+0000","last_became_peered":"2023-11-30T17:22:56.934913+0000","last_unstale":"2023-11-30T17:22:56.939033+0000","last_undegraded":"2023-11-30T17:22:56.939033+0000","last_fullsized":"2023-11-30T17:22:56.939033+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.929218+0000","last_change":"2023-11-30T17:22:56.549584+0000","last_active":"2023-11-30T17:22:56.929218+0000","last_peered":"2023-11-30T17:22:56.929218+0000","last_clean":"2023-11-30T17:22:56.929218+0000","last_became_active":"2023-11-30T17:22:56.549285+0000","last_became_peered":"2023-11-30T17:22:56.549285+0000","last_unstale":"2023-11-30T17:22:56.929218+0000","last_undegraded":"2023-11-30T17:22:56.929218+0000","last_fullsized":"2023-11-30T17:22:56.929218+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.941733+0000","last_change":"2023-11-30T17:22:56.939107+0000","last_active":"2023-11-30T17:22:56.941733+0000","last_peered":"2023-11-30T17:22:56.941733+0000","last_clean":"2023-11-30T17:22:56.941733+0000","last_became_active":"2023-11-30T17:22:56.938800+0000","last_became_peered":"2023-11-30T17:22:56.938800+0000","last_unstale":"2023-11-30T17:22:56.941733+0000","last_undegraded":"2023-11-30T17:22:56.941733+0000","last_fullsized":"2023-11-30T17:22:56.941733+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.928540+0000","last_change":"2023-11-30T17:22:56.547097+0000","last_active":"2023-11-30T17:22:56.928540+0000","last_peered":"2023-11-30T17:22:56.928540+0000","last_clean":"2023-11-30T17:22:56.928540+0000","last_became_active":"2023-11-30T17:22:56.546457+0000","last_became_peered":"2023-11-30T17:22:56.546457+0000","last_unstale":"2023-11-30T17:22:56.928540+0000","last_undegraded":"2023-11-30T17:22:56.928540+0000","last_fullsized":"2023-11-30T17:22:56.928540+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.940802+0000","last_change":"2023-11-30T17:22:56.936273+0000","last_active":"2023-11-30T17:22:56.940802+0000","last_peered":"2023-11-30T17:22:56.940802+0000","last_clean":"2023-11-30T17:22:56.940802+0000","last_became_active":"2023-11-30T17:22:56.935988+0000","last_became_peered":"2023-11-30T17:22:56.935988+0000","last_unstale":"2023-11-30T17:22:56.940802+0000","last_undegraded":"2023-11-30T17:22:56.940802+0000","last_fullsized":"2023-11-30T17:22:56.940802+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"97'3","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.932882+0000","last_change":"2023-11-30T17:22:56.539472+0000","last_active":"2023-11-30T17:22:56.932882+0000","last_peered":"2023-11-30T17:22:56.932882+0000","last_clean":"2023-11-30T17:22:56.932882+0000","last_became_active":"2023-11-30T17:22:56.539173+0000","last_became_peered":"2023-11-30T17:22:56.539173+0000","last_unstale":"2023-11-30T17:22:56.932882+0000","last_undegraded":"2023-11-30T17:22:56.932882+0000","last_fullsized":"2023-11-30T17:22:56.932882+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.941467+0000","last_change":"2023-11-30T17:22:56.939754+0000","last_active":"2023-11-30T17:22:56.941467+0000","last_peered":"2023-11-30T17:22:56.941467+0000","last_clean":"2023-11-30T17:22:56.941467+0000","last_became_active":"2023-11-30T17:22:56.939390+0000","last_became_peered":"2023-11-30T17:22:56.939390+0000","last_unstale":"2023-11-30T17:22:56.941467+0000","last_undegraded":"2023-11-30T17:22:56.941467+0000","last_fullsized":"2023-11-30T17:22:56.941467+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"97'2","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.943913+0000","last_change":"2023-11-30T17:22:56.553262+0000","last_active":"2023-11-30T17:22:56.943913+0000","last_peered":"2023-11-30T17:22:56.943913+0000","last_clean":"2023-11-30T17:22:56.943913+0000","last_became_active":"2023-11-30T17:22:56.553001+0000","last_became_peered":"2023-11-30T17:22:56.553001+0000","last_unstale":"2023-11-30T17:22:56.943913+0000","last_undegraded":"2023-11-30T17:22:56.943913+0000","last_fullsized":"2023-11-30T17:22:56.943913+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.939800+0000","last_change":"2023-11-30T17:22:56.934355+0000","last_active":"2023-11-30T17:22:56.939800+0000","last_peered":"2023-11-30T17:22:56.939800+0000","last_clean":"2023-11-30T17:22:56.939800+0000","last_became_active":"2023-11-30T17:22:56.934047+0000","last_became_peered":"2023-11-30T17:22:56.934047+0000","last_unstale":"2023-11-30T17:22:56.939800+0000","last_undegraded":"2023-11-30T17:22:56.939800+0000","last_fullsized":"2023-11-30T17:22:56.939800+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.938529+0000","last_change":"2023-11-30T17:22:56.550176+0000","last_active":"2023-11-30T17:22:56.938529+0000","last_peered":"2023-11-30T17:22:56.938529+0000","last_clean":"2023-11-30T17:22:56.938529+0000","last_became_active":"2023-11-30T17:22:56.549885+0000","last_became_peered":"2023-11-30T17:22:56.549885+0000","last_unstale":"2023-11-30T17:22:56.938529+0000","last_undegraded":"2023-11-30T17:22:56.938529+0000","last_fullsized":"2023-11-30T17:22:56.938529+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.943942+0000","last_change":"2023-11-30T17:22:56.937527+0000","last_active":"2023-11-30T17:22:56.943942+0000","last_peered":"2023-11-30T17:22:56.943942+0000","last_clean":"2023-11-30T17:22:56.943942+0000","last_became_active":"2023-11-30T17:22:56.933979+0000","last_became_peered":"2023-11-30T17:22:56.933979+0000","last_unstale":"2023-11-30T17:22:56.943942+0000","last_undegraded":"2023-11-30T17:22:56.943942+0000","last_fullsized":"2023-11-30T17:22:56.943942+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.926109+0000","last_change":"2023-11-30T17:22:56.550388+0000","last_active":"2023-11-30T17:22:56.926109+0000","last_peered":"2023-11-30T17:22:56.926109+0000","last_clean":"2023-11-30T17:22:56.926109+0000","last_became_active":"2023-11-30T17:22:56.550092+0000","last_became_peered":"2023-11-30T17:22:56.550092+0000","last_unstale":"2023-11-30T17:22:56.926109+0000","last_undegraded":"2023-11-30T17:22:56.926109+0000","last_fullsized":"2023-11-30T17:22:56.926109+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.948649+0000","last_change":"2023-11-30T17:22:56.943752+0000","last_active":"2023-11-30T17:22:56.948649+0000","last_peered":"2023-11-30T17:22:56.948649+0000","last_clean":"2023-11-30T17:22:56.948649+0000","last_became_active":"2023-11-30T17:22:56.943266+0000","last_became_peered":"2023-11-30T17:22:56.943266+0000","last_unstale":"2023-11-30T17:22:56.948649+0000","last_undegraded":"2023-11-30T17:22:56.948649+0000","last_fullsized":"2023-11-30T17:22:56.948649+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.921104+0000","last_change":"2023-11-30T17:22:56.541693+0000","last_active":"2023-11-30T17:22:56.921104+0000","last_peered":"2023-11-30T17:22:56.921104+0000","last_clean":"2023-11-30T17:22:56.921104+0000","last_became_active":"2023-11-30T17:22:56.540930+0000","last_became_peered":"2023-11-30T17:22:56.540930+0000","last_unstale":"2023-11-30T17:22:56.921104+0000","last_undegraded":"2023-11-30T17:22:56.921104+0000","last_fullsized":"2023-11-30T17:22:56.921104+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.943840+0000","last_change":"2023-11-30T17:22:56.936484+0000","last_active":"2023-11-30T17:22:56.943840+0000","last_peered":"2023-11-30T17:22:56.943840+0000","last_clean":"2023-11-30T17:22:56.943840+0000","last_became_active":"2023-11-30T17:22:56.936173+0000","last_became_peered":"2023-11-30T17:22:56.936173+0000","last_unstale":"2023-11-30T17:22:56.943840+0000","last_undegraded":"2023-11-30T17:22:56.943840+0000","last_fullsized":"2023-11-30T17:22:56.943840+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"97'4","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.944051+0000","last_change":"2023-11-30T17:22:56.545914+0000","last_active":"2023-11-30T17:22:56.944051+0000","last_peered":"2023-11-30T17:22:56.944051+0000","last_clean":"2023-11-30T17:22:56.944051+0000","last_became_active":"2023-11-30T17:22:56.545711+0000","last_became_peered":"2023-11-30T17:22:56.545711+0000","last_unstale":"2023-11-30T17:22:56.944051+0000","last_undegraded":"2023-11-30T17:22:56.944051+0000","last_fullsized":"2023-11-30T17:22:56.944051+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.942397+0000","last_change":"2023-11-30T17:22:56.938837+0000","last_active":"2023-11-30T17:22:56.942397+0000","last_peered":"2023-11-30T17:22:56.942397+0000","last_clean":"2023-11-30T17:22:56.942397+0000","last_became_active":"2023-11-30T17:22:56.938505+0000","last_became_peered":"2023-11-30T17:22:56.938505+0000","last_unstale":"2023-11-30T17:22:56.942397+0000","last_undegraded":"2023-11-30T17:22:56.942397+0000","last_fullsized":"2023-11-30T17:22:56.942397+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"97'2","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.937965+0000","last_change":"2023-11-30T17:22:56.541508+0000","last_active":"2023-11-30T17:22:56.937965+0000","last_peered":"2023-11-30T17:22:56.937965+0000","last_clean":"2023-11-30T17:22:56.937965+0000","last_became_active":"2023-11-30T17:22:56.541214+0000","last_became_peered":"2023-11-30T17:22:56.541214+0000","last_unstale":"2023-11-30T17:22:56.937965+0000","last_undegraded":"2023-11-30T17:22:56.937965+0000","last_fullsized":"2023-11-30T17:22:56.937965+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.943867+0000","last_change":"2023-11-30T17:22:56.936689+0000","last_active":"2023-11-30T17:22:56.943867+0000","last_peered":"2023-11-30T17:22:56.943867+0000","last_clean":"2023-11-30T17:22:56.943867+0000","last_became_active":"2023-11-30T17:22:56.933343+0000","last_became_peered":"2023-11-30T17:22:56.933343+0000","last_unstale":"2023-11-30T17:22:56.943867+0000","last_undegraded":"2023-11-30T17:22:56.943867+0000","last_fullsized":"2023-11-30T17:22:56.943867+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.918156+0000","last_change":"2023-11-30T17:22:56.543028+0000","last_active":"2023-11-30T17:22:56.918156+0000","last_peered":"2023-11-30T17:22:56.918156+0000","last_clean":"2023-11-30T17:22:56.918156+0000","last_became_active":"2023-11-30T17:22:56.542754+0000","last_became_peered":"2023-11-30T17:22:56.542754+0000","last_unstale":"2023-11-30T17:22:56.918156+0000","last_undegraded":"2023-11-30T17:22:56.918156+0000","last_fullsized":"2023-11-30T17:22:56.918156+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.938951+0000","last_change":"2023-11-30T17:22:56.932295+0000","last_active":"2023-11-30T17:22:56.938951+0000","last_peered":"2023-11-30T17:22:56.938951+0000","last_clean":"2023-11-30T17:22:56.938951+0000","last_became_active":"2023-11-30T17:22:56.932038+0000","last_became_peered":"2023-11-30T17:22:56.932038+0000","last_unstale":"2023-11-30T17:22:56.938951+0000","last_undegraded":"2023-11-30T17:22:56.938951+0000","last_fullsized":"2023-11-30T17:22:56.938951+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.927867+0000","last_change":"2023-11-30T17:22:56.551480+0000","last_active":"2023-11-30T17:22:56.927867+0000","last_peered":"2023-11-30T17:22:56.927867+0000","last_clean":"2023-11-30T17:22:56.927867+0000","last_became_active":"2023-11-30T17:22:56.551080+0000","last_became_peered":"2023-11-30T17:22:56.551080+0000","last_unstale":"2023-11-30T17:22:56.927867+0000","last_undegraded":"2023-11-30T17:22:56.927867+0000","last_fullsized":"2023-11-30T17:22:56.927867+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.938724+0000","last_change":"2023-11-30T17:22:56.931453+0000","last_active":"2023-11-30T17:22:56.938724+0000","last_peered":"2023-11-30T17:22:56.938724+0000","last_clean":"2023-11-30T17:22:56.938724+0000","last_became_active":"2023-11-30T17:22:56.931155+0000","last_became_peered":"2023-11-30T17:22:56.931155+0000","last_unstale":"2023-11-30T17:22:56.938724+0000","last_undegraded":"2023-11-30T17:22:56.938724+0000","last_fullsized":"2023-11-30T17:22:56.938724+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.927102+0000","last_change":"2023-11-30T17:22:56.548612+0000","last_active":"2023-11-30T17:22:56.927102+0000","last_peered":"2023-11-30T17:22:56.927102+0000","last_clean":"2023-11-30T17:22:56.927102+0000","last_became_active":"2023-11-30T17:22:56.548331+0000","last_became_peered":"2023-11-30T17:22:56.548331+0000","last_unstale":"2023-11-30T17:22:56.927102+0000","last_undegraded":"2023-11-30T17:22:56.927102+0000","last_fullsized":"2023-11-30T17:22:56.927102+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.948670+0000","last_change":"2023-11-30T17:22:56.944413+0000","last_active":"2023-11-30T17:22:56.948670+0000","last_peered":"2023-11-30T17:22:56.948670+0000","last_clean":"2023-11-30T17:22:56.948670+0000","last_became_active":"2023-11-30T17:22:56.944178+0000","last_became_peered":"2023-11-30T17:22:56.944178+0000","last_unstale":"2023-11-30T17:22:56.948670+0000","last_undegraded":"2023-11-30T17:22:56.948670+0000","last_fullsized":"2023-11-30T17:22:56.948670+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.925002+0000","last_change":"2023-11-30T17:22:56.545293+0000","last_active":"2023-11-30T17:22:56.925002+0000","last_peered":"2023-11-30T17:22:56.925002+0000","last_clean":"2023-11-30T17:22:56.925002+0000","last_became_active":"2023-11-30T17:22:56.544981+0000","last_became_peered":"2023-11-30T17:22:56.544981+0000","last_unstale":"2023-11-30T17:22:56.925002+0000","last_undegraded":"2023-11-30T17:22:56.925002+0000","last_fullsized":"2023-11-30T17:22:56.925002+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.943781+0000","last_change":"2023-11-30T17:22:56.934172+0000","last_active":"2023-11-30T17:22:56.943781+0000","last_peered":"2023-11-30T17:22:56.943781+0000","last_clean":"2023-11-30T17:22:56.943781+0000","last_became_active":"2023-11-30T17:22:56.932105+0000","last_became_peered":"2023-11-30T17:22:56.932105+0000","last_unstale":"2023-11-30T17:22:56.943781+0000","last_undegraded":"2023-11-30T17:22:56.943781+0000","last_fullsized":"2023-11-30T17:22:56.943781+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.923605+0000","last_change":"2023-11-30T17:22:56.542108+0000","last_active":"2023-11-30T17:22:56.923605+0000","last_peered":"2023-11-30T17:22:56.923605+0000","last_clean":"2023-11-30T17:22:56.923605+0000","last_became_active":"2023-11-30T17:22:56.541636+0000","last_became_peered":"2023-11-30T17:22:56.541636+0000","last_unstale":"2023-11-30T17:22:56.923605+0000","last_undegraded":"2023-11-30T17:22:56.923605+0000","last_fullsized":"2023-11-30T17:22:56.923605+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.941443+0000","last_change":"2023-11-30T17:22:56.939680+0000","last_active":"2023-11-30T17:22:56.941443+0000","last_peered":"2023-11-30T17:22:56.941443+0000","last_clean":"2023-11-30T17:22:56.941443+0000","last_became_active":"2023-11-30T17:22:56.939353+0000","last_became_peered":"2023-11-30T17:22:56.939353+0000","last_unstale":"2023-11-30T17:22:56.941443+0000","last_undegraded":"2023-11-30T17:22:56.941443+0000","last_fullsized":"2023-11-30T17:22:56.941443+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.925629+0000","last_change":"2023-11-30T17:22:56.546385+0000","last_active":"2023-11-30T17:22:56.925629+0000","last_peered":"2023-11-30T17:22:56.925629+0000","last_clean":"2023-11-30T17:22:56.925629+0000","last_became_active":"2023-11-30T17:22:56.546108+0000","last_became_peered":"2023-11-30T17:22:56.546108+0000","last_unstale":"2023-11-30T17:22:56.925629+0000","last_undegraded":"2023-11-30T17:22:56.925629+0000","last_fullsized":"2023-11-30T17:22:56.925629+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.942329+0000","last_change":"2023-11-30T17:22:56.941621+0000","last_active":"2023-11-30T17:22:56.942329+0000","last_peered":"2023-11-30T17:22:56.942329+0000","last_clean":"2023-11-30T17:22:56.942329+0000","last_became_active":"2023-11-30T17:22:56.941378+0000","last_became_peered":"2023-11-30T17:22:56.941378+0000","last_unstale":"2023-11-30T17:22:56.942329+0000","last_undegraded":"2023-11-30T17:22:56.942329+0000","last_fullsized":"2023-11-30T17:22:56.942329+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.921449+0000","last_change":"2023-11-30T17:22:56.544099+0000","last_active":"2023-11-30T17:22:56.921449+0000","last_peered":"2023-11-30T17:22:56.921449+0000","last_clean":"2023-11-30T17:22:56.921449+0000","last_became_active":"2023-11-30T17:22:56.543804+0000","last_became_peered":"2023-11-30T17:22:56.543804+0000","last_unstale":"2023-11-30T17:22:56.921449+0000","last_undegraded":"2023-11-30T17:22:56.921449+0000","last_fullsized":"2023-11-30T17:22:56.921449+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.940197+0000","last_change":"2023-11-30T17:22:56.936328+0000","last_active":"2023-11-30T17:22:56.940197+0000","last_peered":"2023-11-30T17:22:56.940197+0000","last_clean":"2023-11-30T17:22:56.940197+0000","last_became_active":"2023-11-30T17:22:56.936040+0000","last_became_peered":"2023-11-30T17:22:56.936040+0000","last_unstale":"2023-11-30T17:22:56.940197+0000","last_undegraded":"2023-11-30T17:22:56.940197+0000","last_fullsized":"2023-11-30T17:22:56.940197+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.922930+0000","last_change":"2023-11-30T17:22:56.550916+0000","last_active":"2023-11-30T17:22:56.922930+0000","last_peered":"2023-11-30T17:22:56.922930+0000","last_clean":"2023-11-30T17:22:56.922930+0000","last_became_active":"2023-11-30T17:22:56.550619+0000","last_became_peered":"2023-11-30T17:22:56.550619+0000","last_unstale":"2023-11-30T17:22:56.922930+0000","last_undegraded":"2023-11-30T17:22:56.922930+0000","last_fullsized":"2023-11-30T17:22:56.922930+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":77,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.923865+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:22:56.923865+0000","last_peered":"2023-11-30T17:22:56.923865+0000","last_clean":"2023-11-30T17:22:56.923865+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:22:56.923865+0000","last_undegraded":"2023-11-30T17:22:56.923865+0000","last_fullsized":"2023-11-30T17:22:56.923865+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.938700+0000","last_change":"2023-11-30T17:22:56.936389+0000","last_active":"2023-11-30T17:22:56.938700+0000","last_peered":"2023-11-30T17:22:56.938700+0000","last_clean":"2023-11-30T17:22:56.938700+0000","last_became_active":"2023-11-30T17:22:56.936082+0000","last_became_peered":"2023-11-30T17:22:56.936082+0000","last_unstale":"2023-11-30T17:22:56.938700+0000","last_undegraded":"2023-11-30T17:22:56.938700+0000","last_fullsized":"2023-11-30T17:22:56.938700+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.936344+0000","last_change":"2023-11-30T17:22:56.541398+0000","last_active":"2023-11-30T17:22:56.936344+0000","last_peered":"2023-11-30T17:22:56.936344+0000","last_clean":"2023-11-30T17:22:56.936344+0000","last_became_active":"2023-11-30T17:22:56.540729+0000","last_became_peered":"2023-11-30T17:22:56.540729+0000","last_unstale":"2023-11-30T17:22:56.936344+0000","last_undegraded":"2023-11-30T17:22:56.936344+0000","last_fullsized":"2023-11-30T17:22:56.936344+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":78,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.924466+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:22:56.924466+0000","last_peered":"2023-11-30T17:22:56.924466+0000","last_clean":"2023-11-30T17:22:56.924466+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:22:56.924466+0000","last_undegraded":"2023-11-30T17:22:56.924466+0000","last_fullsized":"2023-11-30T17:22:56.924466+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.943818+0000","last_change":"2023-11-30T17:22:56.935818+0000","last_active":"2023-11-30T17:22:56.943818+0000","last_peered":"2023-11-30T17:22:56.943818+0000","last_clean":"2023-11-30T17:22:56.943818+0000","last_became_active":"2023-11-30T17:22:56.934276+0000","last_became_peered":"2023-11-30T17:22:56.934276+0000","last_unstale":"2023-11-30T17:22:56.943818+0000","last_undegraded":"2023-11-30T17:22:56.943818+0000","last_fullsized":"2023-11-30T17:22:56.943818+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.924401+0000","last_change":"2023-11-30T17:22:56.546134+0000","last_active":"2023-11-30T17:22:56.924401+0000","last_peered":"2023-11-30T17:22:56.924401+0000","last_clean":"2023-11-30T17:22:56.924401+0000","last_became_active":"2023-11-30T17:22:56.545678+0000","last_became_peered":"2023-11-30T17:22:56.545678+0000","last_unstale":"2023-11-30T17:22:56.924401+0000","last_undegraded":"2023-11-30T17:22:56.924401+0000","last_fullsized":"2023-11-30T17:22:56.924401+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":83,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.921181+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:22:56.921181+0000","last_peered":"2023-11-30T17:22:56.921181+0000","last_clean":"2023-11-30T17:22:56.921181+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:22:56.921181+0000","last_undegraded":"2023-11-30T17:22:56.921181+0000","last_fullsized":"2023-11-30T17:22:56.921181+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.948592+0000","last_change":"2023-11-30T17:22:56.943583+0000","last_active":"2023-11-30T17:22:56.948592+0000","last_peered":"2023-11-30T17:22:56.948592+0000","last_clean":"2023-11-30T17:22:56.948592+0000","last_became_active":"2023-11-30T17:22:56.942014+0000","last_became_peered":"2023-11-30T17:22:56.942014+0000","last_unstale":"2023-11-30T17:22:56.948592+0000","last_undegraded":"2023-11-30T17:22:56.948592+0000","last_fullsized":"2023-11-30T17:22:56.948592+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.921778+0000","last_change":"2023-11-30T17:22:56.549062+0000","last_active":"2023-11-30T17:22:56.921778+0000","last_peered":"2023-11-30T17:22:56.921778+0000","last_clean":"2023-11-30T17:22:56.921778+0000","last_became_active":"2023-11-30T17:22:56.548775+0000","last_became_peered":"2023-11-30T17:22:56.548775+0000","last_unstale":"2023-11-30T17:22:56.921778+0000","last_undegraded":"2023-11-30T17:22:56.921778+0000","last_fullsized":"2023-11-30T17:22:56.921778+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":78,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.926835+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:22:56.926835+0000","last_peered":"2023-11-30T17:22:56.926835+0000","last_clean":"2023-11-30T17:22:56.926835+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:22:56.926835+0000","last_undegraded":"2023-11-30T17:22:56.926835+0000","last_fullsized":"2023-11-30T17:22:56.926835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":81,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.926465+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:22:56.926465+0000","last_peered":"2023-11-30T17:22:56.926465+0000","last_clean":"2023-11-30T17:22:56.926465+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:22:56.926465+0000","last_undegraded":"2023-11-30T17:22:56.926465+0000","last_fullsized":"2023-11-30T17:22:56.926465+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.938562+0000","last_change":"2023-11-30T17:22:56.931013+0000","last_active":"2023-11-30T17:22:56.938562+0000","last_peered":"2023-11-30T17:22:56.938562+0000","last_clean":"2023-11-30T17:22:56.938562+0000","last_became_active":"2023-11-30T17:22:56.930742+0000","last_became_peered":"2023-11-30T17:22:56.930742+0000","last_unstale":"2023-11-30T17:22:56.938562+0000","last_undegraded":"2023-11-30T17:22:56.938562+0000","last_fullsized":"2023-11-30T17:22:56.938562+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.921458+0000","last_change":"2023-11-30T17:22:56.549222+0000","last_active":"2023-11-30T17:22:56.921458+0000","last_peered":"2023-11-30T17:22:56.921458+0000","last_clean":"2023-11-30T17:22:56.921458+0000","last_became_active":"2023-11-30T17:22:56.548758+0000","last_became_peered":"2023-11-30T17:22:56.548758+0000","last_unstale":"2023-11-30T17:22:56.921458+0000","last_undegraded":"2023-11-30T17:22:56.921458+0000","last_fullsized":"2023-11-30T17:22:56.921458+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":79,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.926618+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:22:56.926618+0000","last_peered":"2023-11-30T17:22:56.926618+0000","last_clean":"2023-11-30T17:22:56.926618+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:22:56.926618+0000","last_undegraded":"2023-11-30T17:22:56.926618+0000","last_fullsized":"2023-11-30T17:22:56.926618+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.938010+0000","last_change":"2023-11-30T17:22:56.933147+0000","last_active":"2023-11-30T17:22:56.938010+0000","last_peered":"2023-11-30T17:22:56.938010+0000","last_clean":"2023-11-30T17:22:56.938010+0000","last_became_active":"2023-11-30T17:22:56.932818+0000","last_became_peered":"2023-11-30T17:22:56.932818+0000","last_unstale":"2023-11-30T17:22:56.938010+0000","last_undegraded":"2023-11-30T17:22:56.938010+0000","last_fullsized":"2023-11-30T17:22:56.938010+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.923785+0000","last_change":"2023-11-30T17:22:56.543635+0000","last_active":"2023-11-30T17:22:56.923785+0000","last_peered":"2023-11-30T17:22:56.923785+0000","last_clean":"2023-11-30T17:22:56.923785+0000","last_became_active":"2023-11-30T17:22:56.543307+0000","last_became_peered":"2023-11-30T17:22:56.543307+0000","last_unstale":"2023-11-30T17:22:56.923785+0000","last_undegraded":"2023-11-30T17:22:56.923785+0000","last_fullsized":"2023-11-30T17:22:56.923785+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":79,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.927958+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:22:56.927958+0000","last_peered":"2023-11-30T17:22:56.927958+0000","last_clean":"2023-11-30T17:22:56.927958+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:22:56.927958+0000","last_undegraded":"2023-11-30T17:22:56.927958+0000","last_fullsized":"2023-11-30T17:22:56.927958+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.934996+0000","last_change":"2023-11-30T17:22:56.930682+0000","last_active":"2023-11-30T17:22:56.934996+0000","last_peered":"2023-11-30T17:22:56.934996+0000","last_clean":"2023-11-30T17:22:56.934996+0000","last_became_active":"2023-11-30T17:22:56.930412+0000","last_became_peered":"2023-11-30T17:22:56.930412+0000","last_unstale":"2023-11-30T17:22:56.934996+0000","last_undegraded":"2023-11-30T17:22:56.934996+0000","last_fullsized":"2023-11-30T17:22:56.934996+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.945897+0000","last_change":"2023-11-30T17:22:56.547016+0000","last_active":"2023-11-30T17:22:56.945897+0000","last_peered":"2023-11-30T17:22:56.945897+0000","last_clean":"2023-11-30T17:22:56.945897+0000","last_became_active":"2023-11-30T17:22:56.546737+0000","last_became_peered":"2023-11-30T17:22:56.546737+0000","last_unstale":"2023-11-30T17:22:56.945897+0000","last_undegraded":"2023-11-30T17:22:56.945897+0000","last_fullsized":"2023-11-30T17:22:56.945897+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":77,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.921026+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:22:56.921026+0000","last_peered":"2023-11-30T17:22:56.921026+0000","last_clean":"2023-11-30T17:22:56.921026+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:22:56.921026+0000","last_undegraded":"2023-11-30T17:22:56.921026+0000","last_fullsized":"2023-11-30T17:22:56.921026+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.940808+0000","last_change":"2023-11-30T17:22:56.938662+0000","last_active":"2023-11-30T17:22:56.940808+0000","last_peered":"2023-11-30T17:22:56.940808+0000","last_clean":"2023-11-30T17:22:56.940808+0000","last_became_active":"2023-11-30T17:22:56.938370+0000","last_became_peered":"2023-11-30T17:22:56.938370+0000","last_unstale":"2023-11-30T17:22:56.940808+0000","last_undegraded":"2023-11-30T17:22:56.940808+0000","last_fullsized":"2023-11-30T17:22:56.940808+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"97'2","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.943715+0000","last_change":"2023-11-30T17:22:56.554941+0000","last_active":"2023-11-30T17:22:56.943715+0000","last_peered":"2023-11-30T17:22:56.943715+0000","last_clean":"2023-11-30T17:22:56.943715+0000","last_became_active":"2023-11-30T17:22:56.554543+0000","last_became_peered":"2023-11-30T17:22:56.554543+0000","last_unstale":"2023-11-30T17:22:56.943715+0000","last_undegraded":"2023-11-30T17:22:56.943715+0000","last_fullsized":"2023-11-30T17:22:56.943715+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":86,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.937689+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:22:56.937689+0000","last_peered":"2023-11-30T17:22:56.937689+0000","last_clean":"2023-11-30T17:22:56.937689+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:22:56.937689+0000","last_undegraded":"2023-11-30T17:22:56.937689+0000","last_fullsized":"2023-11-30T17:22:56.937689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575037,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298272,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073568,"statfs":{"total":96636764160,"available":96331333632,"internally_reserved":0,"allocated":1204224,"data_stored":599109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.371,"5min":0.315,"15min":0.23899999999999999},"max":{"1min":0.72399999999999998,"5min":0.80400000000000005,"15min":0.81100000000000005},"last":0.621},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57499999999999996,"15min":0.58199999999999996},"min":{"1min":0.41099999999999998,"5min":0.40699999999999997,"15min":0.32200000000000001},"max":{"1min":0.74099999999999999,"5min":0.78300000000000003,"15min":0.81899999999999995},"last":0.42799999999999999}]},{"osd":1,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70899999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.32900000000000001,"5min":0.29899999999999999,"15min":0.28799999999999998},"max":{"1min":0.64000000000000001,"5min":0.76100000000000001,"15min":0.82499999999999996},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53800000000000003,"15min":0.54900000000000004},"min":{"1min":0.37,"5min":0.33500000000000002,"15min":0.32800000000000001},"max":{"1min":0.68200000000000005,"5min":0.77000000000000002,"15min":0.78300000000000003},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.38800000000000001,"5min":0.35399999999999998,"15min":0.28699999999999998},"max":{"1min":0.70499999999999996,"5min":0.73799999999999999,"15min":0.83899999999999997},"last":0.55800000000000005}]},{"osd":3,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.53400000000000003,"15min":0.54100000000000004},"min":{"1min":0.378,"5min":0.36499999999999999,"15min":0.33200000000000002},"max":{"1min":0.65700000000000003,"5min":0.754,"15min":0.78000000000000003},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56999999999999995,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.40799999999999997,"15min":0.33900000000000002},"max":{"1min":0.67500000000000004,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44600000000000001,"15min":0.45800000000000002},"min":{"1min":0.32400000000000001,"5min":0.313,"15min":0.29699999999999999},"max":{"1min":0.55000000000000004,"5min":0.77000000000000002,"15min":0.79900000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.30099999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59899999999999998,"5min":0.75800000000000001,"15min":1.3180000000000001},"last":0.40799999999999997}]},{"osd":5,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.48399999999999999,"15min":0.49099999999999999},"min":{"1min":0.317,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58699999999999997,"5min":0.80000000000000004,"15min":0.82899999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.61199999999999999,"5min":0.79300000000000004,"15min":0.872},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.69699999999999995,"5min":0.81200000000000006,"15min":0.85199999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.33700000000000002},"max":{"1min":0.67300000000000004,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.47499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575036,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302372,"kb_used_data":1180,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069468,"statfs":{"total":96636764160,"available":96327135232,"internally_reserved":0,"allocated":1208320,"data_stored":599247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.57099999999999995},"min":{"1min":0.38100000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72899999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56499999999999995,"15min":0.58699999999999997},"min":{"1min":0.46300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.748,"5min":0.79600000000000004,"15min":0.89300000000000002},"last":0.61199999999999999}]},{"osd":1,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54600000000000004,"15min":0.56399999999999995},"min":{"1min":0.32800000000000001,"5min":0.30599999999999999,"15min":0.26400000000000001},"max":{"1min":0.75800000000000001,"5min":0.76900000000000002,"15min":0.82799999999999996},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58199999999999996,"15min":0.59899999999999998},"min":{"1min":0.45100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.751,"5min":0.82499999999999996,"15min":0.85199999999999998},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56000000000000005,"15min":0.57299999999999995},"min":{"1min":0.371,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.77500000000000002,"5min":0.79900000000000004,"15min":0.82599999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.40699999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76100000000000001,"5min":0.80900000000000005,"15min":0.82499999999999996},"last":0.47499999999999998}]},{"osd":3,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51100000000000001,"15min":0.53200000000000003},"min":{"1min":0.40400000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71899999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73499999999999999,"5min":0.75600000000000001,"15min":0.79600000000000004},"last":0.498}]},{"osd":4,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44600000000000001,"15min":0.45300000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.84199999999999997},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46100000000000002,"15min":0.47799999999999998},"min":{"1min":0.34999999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.746,"5min":0.76000000000000001,"15min":0.83899999999999997},"last":0.32500000000000001}]},{"osd":5,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.45900000000000002,"15min":0.47199999999999998},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.28299999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.38},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.496,"15min":0.50700000000000001},"min":{"1min":0.38400000000000001,"5min":0.33500000000000002,"15min":0.31900000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.39300000000000002}]},{"osd":7,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.34499999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.74199999999999999,"5min":0.80700000000000005,"15min":0.93200000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55100000000000005,"15min":0.56299999999999994},"min":{"1min":0.43099999999999999,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.86499999999999999},"last":0.42099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575036,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302376,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069464,"statfs":{"total":96636764160,"available":96327131136,"internally_reserved":0,"allocated":1212416,"data_stored":599607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.378,"15min":0.35999999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23000000000000001},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.48699999999999999,"15min":0.47199999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.309},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.38900000000000001},"min":{"1min":0.249,"5min":0.215,"15min":0.215},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.502},"min":{"1min":0.36499999999999999,"5min":0.33400000000000002,"15min":0.29499999999999998},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.39600000000000002}]},{"osd":3,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.46600000000000003,"15min":0.45200000000000001},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.23899999999999999},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.44800000000000001,"15min":0.435},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.307}]},{"osd":4,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.35499999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.83499999999999996,"5min":0.88500000000000001,"15min":0.89100000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.61899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.39900000000000002},"max":{"1min":0.85099999999999998,"5min":0.97599999999999998,"15min":1.111},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.46500000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.39600000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.91300000000000003},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.64800000000000002,"15min":0.65900000000000003},"min":{"1min":0.46500000000000002,"5min":0.39700000000000002,"15min":0.39600000000000002},"max":{"1min":0.91000000000000003,"5min":0.92700000000000005,"15min":1.0600000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66100000000000003,"15min":0.66500000000000004},"min":{"1min":0.437,"5min":0.433,"15min":0.379},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.629},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.39900000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.94199999999999995},"last":0.52500000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575036,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302360,"kb_used_data":1168,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069480,"statfs":{"total":96636764160,"available":96327147520,"internally_reserved":0,"allocated":1196032,"data_stored":598533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.375,"15min":0.36499999999999999},"min":{"1min":0.23200000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.51700000000000002,"5min":0.59999999999999998,"15min":0.71199999999999997},"last":0.498},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38700000000000001,"15min":0.38400000000000001},"min":{"1min":0.26100000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.54400000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.38700000000000001,"15min":0.38400000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.23899999999999999},"max":{"1min":0.55900000000000005,"5min":0.623,"15min":0.623},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.313,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.54600000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.57099999999999995}]},{"osd":3,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.42499999999999999,"15min":0.42799999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.60799999999999998,"5min":0.66100000000000003,"15min":0.70999999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.438,"15min":0.439},"min":{"1min":0.27300000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.52800000000000002,"5min":0.64700000000000002,"15min":0.68799999999999994},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.42899999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78800000000000003,"5min":0.83999999999999997,"15min":0.96099999999999997},"last":0.624},{"interface":"front","average":{"1min":0.629,"5min":0.622,"15min":0.621},"min":{"1min":0.44,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.98599999999999999},"last":0.76400000000000001}]},{"osd":5,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.44400000000000001,"5min":0.39200000000000002,"15min":0.36199999999999999},"max":{"1min":0.86799999999999999,"5min":0.92400000000000004,"15min":1.0109999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.628,"15min":0.629},"min":{"1min":0.45000000000000001,"5min":0.38400000000000001,"15min":0.38},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":1.004},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.64500000000000002,"15min":0.64400000000000002},"min":{"1min":0.47799999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.88,"5min":1.002,"15min":1.002},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63400000000000001,"15min":0.63200000000000001},"min":{"1min":0.46999999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89300000000000002,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66000000000000003,"15min":0.65200000000000002},"min":{"1min":0.48199999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86099999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69199999999999995,"15min":0.68799999999999994},"min":{"1min":0.54000000000000004,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92700000000000005,"5min":0.97699999999999998,"15min":1.026},"last":0.73099999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575036,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306468,"kb_used_data":1180,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065372,"statfs":{"total":96636764160,"available":96322940928,"internally_reserved":0,"allocated":1208320,"data_stored":600069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.42699999999999999,"15min":0.40200000000000002},"min":{"1min":0.27700000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":3.4729999999999999,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.44700000000000001,"15min":0.437},"min":{"1min":0.312,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":0.34100000000000003}]},{"osd":1,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.51300000000000001,"15min":0.46300000000000002},"min":{"1min":0.28699999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":6.1210000000000004,"5min":6.1210000000000004,"15min":6.1210000000000004},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.52900000000000003,"15min":0.48899999999999999},"min":{"1min":0.34999999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":5.7270000000000003,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.376}]},{"osd":3,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38600000000000001,"15min":0.40000000000000002},"min":{"1min":0.27800000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.48799999999999999,"5min":0.63500000000000001,"15min":0.86199999999999999},"last":0.317},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47299999999999998,"15min":0.46700000000000003},"min":{"1min":0.29699999999999999,"5min":0.26900000000000002,"15min":0.26200000000000001},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.69699999999999995,"15min":0.64200000000000002},"min":{"1min":0.432,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":8.7170000000000005,"5min":8.7170000000000005,"15min":8.7170000000000005},"last":0.504},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.381,"5min":1.492,"15min":1.492},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.65600000000000003,"15min":0.63900000000000001},"min":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.44400000000000001,"5min":0.38900000000000001,"15min":0.38100000000000001},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61399999999999999,"15min":0.623},"min":{"1min":0.40899999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95999999999999996,"5min":1.359,"15min":1.359},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.70699999999999996,"15min":0.68300000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.40300000000000002},"max":{"1min":4.6849999999999996,"5min":4.6849999999999996,"15min":4.6849999999999996},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.70099999999999996,"15min":0.69099999999999995},"min":{"1min":0.45700000000000002,"5min":0.433,"15min":0.41499999999999998},"max":{"1min":4.5039999999999996,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.56499999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575036,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306456,"kb_used_data":1168,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065384,"statfs":{"total":96636764160,"available":96322953216,"internally_reserved":0,"allocated":1196032,"data_stored":598533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.34799999999999998,"15min":0.36399999999999999},"min":{"1min":0.222,"5min":0.219,"15min":0.217},"max":{"1min":0.46600000000000003,"5min":0.56599999999999995,"15min":0.66200000000000003},"last":0.254},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.39500000000000002,"15min":0.40200000000000002},"min":{"1min":0.26700000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.48699999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.37,"15min":0.38600000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.51500000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.40999999999999998,"15min":0.42999999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.25900000000000001},"max":{"1min":0.59699999999999998,"5min":0.65900000000000003,"15min":0.84399999999999997},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.435,"15min":0.45000000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.26000000000000001},"max":{"1min":0.61799999999999999,"5min":0.72999999999999998,"15min":0.94899999999999995},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.49399999999999999,"15min":0.50900000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67100000000000004,"5min":1.054,"15min":1.054},"last":0.35999999999999999}]},{"osd":4,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58699999999999997,"15min":0.60599999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.755,"5min":0.91500000000000004,"15min":0.97599999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59599999999999997,"15min":0.61299999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.70399999999999996,"5min":0.86799999999999999,"15min":0.91400000000000003},"last":0.63500000000000001}]},{"osd":5,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.58099999999999996,"15min":0.60999999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80200000000000005,"5min":0.85399999999999998,"15min":0.98399999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61899999999999999,"15min":0.63800000000000001},"min":{"1min":0.372,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77300000000000002,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.65900000000000003}]},{"osd":6,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61799999999999999,"15min":0.64400000000000002},"min":{"1min":0.39800000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79900000000000004,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.496},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.626,"15min":0.64700000000000002},"min":{"1min":0.45000000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78900000000000003,"5min":0.89500000000000002,"15min":1.0389999999999999},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.64000000000000001,"15min":0.66200000000000003},"min":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.39100000000000001},"max":{"1min":0.80200000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63700000000000001,"15min":0.66100000000000003},"min":{"1min":0.45800000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79000000000000004,"5min":0.98999999999999999,"15min":1.004},"last":0.58199999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575036,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302372,"kb_used_data":1180,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069468,"statfs":{"total":96636764160,"available":96327135232,"internally_reserved":0,"allocated":1208320,"data_stored":599211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.53100000000000003},"min":{"1min":0.32200000000000001,"5min":0.28299999999999997,"15min":0.27500000000000002},"max":{"1min":0.72299999999999998,"5min":0.752,"15min":0.80900000000000005},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.38900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.66500000000000004,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52100000000000002,"15min":0.54200000000000004},"min":{"1min":0.35699999999999998,"5min":0.26900000000000002,"15min":0.25800000000000001},"max":{"1min":0.67600000000000005,"5min":0.73799999999999999,"15min":0.79600000000000004},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.41899999999999998,"5min":0.317,"15min":0.246},"max":{"1min":0.67800000000000005,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56100000000000005,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.376,"15min":0.27800000000000002},"max":{"1min":0.73799999999999999,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.624},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.59399999999999997},"min":{"1min":0.373,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77300000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.64700000000000002}]},{"osd":3,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.54800000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32900000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55600000000000005,"15min":0.57099999999999995},"min":{"1min":0.438,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.80600000000000005},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.44600000000000001,"15min":0.443},"min":{"1min":0.35299999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.73599999999999999,"5min":1.272,"15min":1.272},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.46700000000000003,"15min":0.46000000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29199999999999998},"max":{"1min":0.83399999999999996,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.67600000000000005}]},{"osd":6,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51200000000000001,"15min":0.503},"min":{"1min":0.34699999999999998,"5min":0.34399999999999997,"15min":0.314},"max":{"1min":0.997,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55500000000000005,"15min":0.53900000000000003},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.33800000000000002},"max":{"1min":0.86499999999999999,"5min":1.129,"15min":1.129},"last":0.70299999999999996}]},{"osd":7,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.29899999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.82199999999999995},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57699999999999996,"15min":0.57099999999999995},"min":{"1min":0.45400000000000001,"5min":0.38600000000000001,"15min":0.34599999999999997},"max":{"1min":0.91500000000000004,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.71299999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575036,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302364,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069476,"statfs":{"total":96636764160,"available":96327143424,"internally_reserved":0,"allocated":1200128,"data_stored":598567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68500000000000005,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52400000000000002,"15min":0.53100000000000003},"min":{"1min":0.36599999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.69299999999999995,"5min":0.70299999999999996,"15min":0.81799999999999995},"last":0.443}]},{"osd":1,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.38400000000000001,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.72399999999999998},"last":0.623},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53300000000000003,"15min":0.54800000000000004},"min":{"1min":0.36799999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.77000000000000002},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58199999999999996,"15min":0.58899999999999997},"min":{"1min":0.44800000000000001,"5min":0.34399999999999997,"15min":0.30599999999999999},"max":{"1min":0.72499999999999998,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.437,"5min":0.378,"15min":0.34499999999999997},"max":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53700000000000003,"15min":0.54800000000000004},"min":{"1min":0.40799999999999997,"5min":0.36699999999999999,"15min":0.36399999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.73799999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55400000000000005,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.82099999999999995},"last":0.52200000000000002}]},{"osd":4,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.41999999999999998,"15min":0.439},"min":{"1min":0.28299999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.66700000000000004,"5min":0.72299999999999998,"15min":0.74299999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.45800000000000002,"15min":0.46600000000000003},"min":{"1min":0.30599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.628,"5min":0.69499999999999995,"15min":0.77600000000000002},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.47399999999999998,"15min":0.48599999999999999},"min":{"1min":0.32200000000000001,"5min":0.29599999999999999,"15min":0.28499999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.82099999999999995},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54100000000000004,"15min":0.55000000000000004},"min":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.69699999999999995,"5min":0.79900000000000004,"15min":0.88200000000000001},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51700000000000002,"15min":0.52600000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.64900000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55900000000000005,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.84599999999999997},"last":0.61499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:23:02.835 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-11-30T17:23:02.834+0000 7f8c60132700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-30T17:23:05.449 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:23:05.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.583+0000 7f4f65e82700 1 Processor -- start 2023-11-30T17:23:05.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.583+0000 7f4f65e82700 1 -- start start 2023-11-30T17:23:05.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.584+0000 7f4f65e82700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f601544e0 0x7f4f601548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:05.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.584+0000 7f4f65e82700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4f6006a610 0x7f4f600c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:05.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.584+0000 7f4f65e82700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f600c69a0 con 0x7f4f600c6e30 2023-11-30T17:23:05.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.584+0000 7f4f65e82700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f600c13a0 con 0x7f4f6006a610 2023-11-30T17:23:05.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.584+0000 7f4f65e82700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f600c1680 con 0x7f4f601544e0 2023-11-30T17:23:05.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.584+0000 7f4f5effd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4f6006a610 0x7f4f600c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:05.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.584+0000 7f4f5f7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f601544e0 0x7f4f601548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:05.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.584+0000 7f4f5ffff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f4f600c6e30 0x7f4f600a8000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:48654/0 (socket says 172.21.15.49:48654) 2023-11-30T17:23:05.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.584+0000 7f4f5effd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4f6006a610 0x7f4f600c0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:54504/0 (socket says 172.21.15.49:54504) 2023-11-30T17:23:05.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.584+0000 7f4f5ffff700 1 -- 172.21.15.49:0/1680498370 learned_addr learned my addr 172.21.15.49:0/1680498370 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:05.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.584+0000 7f4f5e7fc700 1 -- 172.21.15.49:0/1680498370 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2049498170 0 0) 0x7f4f600c69a0 con 0x7f4f600c6e30 2023-11-30T17:23:05.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.584+0000 7f4f5e7fc700 1 -- 172.21.15.49:0/1680498370 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f4c0033f0 con 0x7f4f600c6e30 2023-11-30T17:23:05.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.584+0000 7f4f5f7fe700 1 -- 172.21.15.49:0/1680498370 >> v2:172.21.15.115:3300/0 conn(0x7f4f6006a610 msgr2=0x7f4f600c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:05.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.584+0000 7f4f5f7fe700 1 --2- 172.21.15.49:0/1680498370 >> v2:172.21.15.115:3300/0 conn(0x7f4f6006a610 0x7f4f600c0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:05.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.584+0000 7f4f5f7fe700 1 -- 172.21.15.49:0/1680498370 >> v1:172.21.15.115:6789/0 conn(0x7f4f600c6e30 legacy=0x7f4f600a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:05.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.584+0000 7f4f5f7fe700 1 -- 172.21.15.49:0/1680498370 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f600c6630 con 0x7f4f601544e0 2023-11-30T17:23:05.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.584+0000 7f4f5effd700 1 --2- 172.21.15.49:0/1680498370 >> v2:172.21.15.115:3300/0 conn(0x7f4f6006a610 0x7f4f600c0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:23:05.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.584+0000 7f4f5f7fe700 1 --2- 172.21.15.49:0/1680498370 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f601544e0 0x7f4f601548c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f4f50009eb0 tx=0x7f4f50009780).ready entity=mon.2 client_cookie=f05220017e21cd94 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:05.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.585+0000 7f4f5e7fc700 1 -- 172.21.15.49:0/1680498370 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5000e070 con 0x7f4f601544e0 2023-11-30T17:23:05.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.585+0000 7f4f5e7fc700 1 -- 172.21.15.49:0/1680498370 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5000bb80 con 0x7f4f601544e0 2023-11-30T17:23:05.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.585+0000 7f4f5e7fc700 1 -- 172.21.15.49:0/1680498370 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f50012410 con 0x7f4f601544e0 2023-11-30T17:23:05.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.585+0000 7f4f65e82700 1 -- 172.21.15.49:0/1680498370 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f601544e0 msgr2=0x7f4f601548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:05.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.585+0000 7f4f65e82700 1 --2- 172.21.15.49:0/1680498370 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f601544e0 0x7f4f601548c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f4f50009eb0 tx=0x7f4f50009780).stop 2023-11-30T17:23:05.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.585+0000 7f4f65e82700 1 -- 172.21.15.49:0/1680498370 shutdown_connections 2023-11-30T17:23:05.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.585+0000 7f4f65e82700 1 --2- 172.21.15.49:0/1680498370 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f601544e0 0x7f4f601548c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:05.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.585+0000 7f4f65e82700 1 --2- 172.21.15.49:0/1680498370 >> v2:172.21.15.115:3300/0 conn(0x7f4f6006a610 0x7f4f600c0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:05.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.585+0000 7f4f65e82700 1 -- 172.21.15.49:0/1680498370 >> 172.21.15.49:0/1680498370 conn(0x7f4f60085020 msgr2=0x7f4f60094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:05.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.585+0000 7f4f65e82700 1 -- 172.21.15.49:0/1680498370 shutdown_connections 2023-11-30T17:23:05.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.585+0000 7f4f65e82700 1 -- 172.21.15.49:0/1680498370 wait complete. 2023-11-30T17:23:05.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.587+0000 7f4f65e82700 1 Processor -- start 2023-11-30T17:23:05.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.587+0000 7f4f65e82700 1 -- start start 2023-11-30T17:23:05.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.587+0000 7f4f65e82700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f6006a610 0x7f4f600c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:05.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.587+0000 7f4f65e82700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f600c6e30 0x7f4f60151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:05.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.587+0000 7f4f65e82700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f601544e0 0x7f4f600ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:05.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.587+0000 7f4f65e82700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f60095ce0 con 0x7f4f600c6e30 2023-11-30T17:23:05.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.587+0000 7f4f65e82700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f600c4770 con 0x7f4f6006a610 2023-11-30T17:23:05.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.587+0000 7f4f65e82700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f600c4a50 con 0x7f4f601544e0 2023-11-30T17:23:05.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.588+0000 7f4f5effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f600c6e30 0x7f4f60151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:05.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.588+0000 7f4f5effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f600c6e30 0x7f4f60151020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37824/0 (socket says 172.21.15.49:37824) 2023-11-30T17:23:05.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.588+0000 7f4f5effd700 1 -- 172.21.15.49:0/3342499970 learned_addr learned my addr 172.21.15.49:0/3342499970 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:05.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.588+0000 7f4f5f7fe700 1 --2- 172.21.15.49:0/3342499970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f6006a610 0x7f4f600c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:05.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.588+0000 7f4f5ffff700 1 --2- 172.21.15.49:0/3342499970 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f601544e0 0x7f4f600ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:05.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.588+0000 7f4f5effd700 1 -- 172.21.15.49:0/3342499970 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f601544e0 msgr2=0x7f4f600ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:05.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.588+0000 7f4f5effd700 1 --2- 172.21.15.49:0/3342499970 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f601544e0 0x7f4f600ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:05.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.588+0000 7f4f5effd700 1 -- 172.21.15.49:0/3342499970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f6006a610 msgr2=0x7f4f600c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:05.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.588+0000 7f4f5effd700 1 --2- 172.21.15.49:0/3342499970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f6006a610 0x7f4f600c41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:05.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.588+0000 7f4f5effd700 1 -- 172.21.15.49:0/3342499970 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f480092a0 con 0x7f4f600c6e30 2023-11-30T17:23:05.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.588+0000 7f4f5effd700 1 --2- 172.21.15.49:0/3342499970 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f600c6e30 0x7f4f60151020 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7f4f4800e930 tx=0x7f4f48009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:05.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.588+0000 7f4f577fe700 1 -- 172.21.15.49:0/3342499970 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f48012600 con 0x7f4f600c6e30 2023-11-30T17:23:05.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.588+0000 7f4f577fe700 1 -- 172.21.15.49:0/3342499970 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f48012760 con 0x7f4f600c6e30 2023-11-30T17:23:05.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.588+0000 7f4f65e82700 1 -- 172.21.15.49:0/3342499970 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f50009a20 con 0x7f4f600c6e30 2023-11-30T17:23:05.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.588+0000 7f4f577fe700 1 -- 172.21.15.49:0/3342499970 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f48012ae0 con 0x7f4f600c6e30 2023-11-30T17:23:05.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.588+0000 7f4f65e82700 1 -- 172.21.15.49:0/3342499970 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f600c5010 con 0x7f4f600c6e30 2023-11-30T17:23:05.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.589+0000 7f4f65e82700 1 -- 172.21.15.49:0/3342499970 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f60095e50 con 0x7f4f600c6e30 2023-11-30T17:23:05.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.590+0000 7f4f577fe700 1 -- 172.21.15.49:0/3342499970 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4f4801b400 con 0x7f4f600c6e30 2023-11-30T17:23:05.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.590+0000 7f4f577fe700 1 --2- 172.21.15.49:0/3342499970 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4f4005f270 0x7f4f40061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:05.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.590+0000 7f4f577fe700 1 -- 172.21.15.49:0/3342499970 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f4f4807a810 con 0x7f4f600c6e30 2023-11-30T17:23:05.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.590+0000 7f4f5f7fe700 1 --2- 172.21.15.49:0/3342499970 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4f4005f270 0x7f4f40061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:05.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.591+0000 7f4f5f7fe700 1 --2- 172.21.15.49:0/3342499970 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4f4005f270 0x7f4f40061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f4f500070b0 tx=0x7f4f50009780).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:05.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.594+0000 7f4f577fe700 1 -- 172.21.15.49:0/3342499970 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4f4804b8e0 con 0x7f4f600c6e30 2023-11-30T17:23:05.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.764+0000 7f4f65e82700 1 -- 172.21.15.49:0/3342499970 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4f600c10b0 con 0x7f4f4005f270 2023-11-30T17:23:05.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.775+0000 7f4f577fe700 1 -- 172.21.15.49:0/3342499970 <== mgr.6358 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361398 (secure 0 0 0) 0x7f4f600c10b0 con 0x7f4f4005f270 2023-11-30T17:23:05.780 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:05.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.778+0000 7f4f65e82700 1 -- 172.21.15.49:0/3342499970 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4f4005f270 msgr2=0x7f4f40061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:05.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.778+0000 7f4f65e82700 1 --2- 172.21.15.49:0/3342499970 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4f4005f270 0x7f4f40061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f4f500070b0 tx=0x7f4f50009780).stop 2023-11-30T17:23:05.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.778+0000 7f4f65e82700 1 -- 172.21.15.49:0/3342499970 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f600c6e30 msgr2=0x7f4f60151020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:05.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.778+0000 7f4f65e82700 1 --2- 172.21.15.49:0/3342499970 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f600c6e30 0x7f4f60151020 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7f4f4800e930 tx=0x7f4f48009060).stop 2023-11-30T17:23:05.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.778+0000 7f4f65e82700 1 -- 172.21.15.49:0/3342499970 shutdown_connections 2023-11-30T17:23:05.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.778+0000 7f4f65e82700 1 --2- 172.21.15.49:0/3342499970 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f601544e0 0x7f4f600ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:05.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.778+0000 7f4f65e82700 1 --2- 172.21.15.49:0/3342499970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f6006a610 0x7f4f600c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:05.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.778+0000 7f4f65e82700 1 --2- 172.21.15.49:0/3342499970 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4f4005f270 0x7f4f40061730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:05.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.778+0000 7f4f65e82700 1 --2- 172.21.15.49:0/3342499970 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f600c6e30 0x7f4f60151020 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:05.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.778+0000 7f4f65e82700 1 -- 172.21.15.49:0/3342499970 >> 172.21.15.49:0/3342499970 conn(0x7f4f60085020 msgr2=0x7f4f60064630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:05.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.778+0000 7f4f65e82700 1 -- 172.21.15.49:0/3342499970 shutdown_connections 2023-11-30T17:23:05.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.778+0000 7f4f65e82700 1 -- 172.21.15.49:0/3342499970 wait complete. 2023-11-30T17:23:05.784 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:23:05.791 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-30T17:23:04.412868+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2423040,"kb_used_data":9408,"kb_used_omap":0,"kb_used_meta":2413568,"kb_avail":752551680,"statfs":{"total":773094113280,"available":770612920320,"internally_reserved":0,"allocated":9633792,"data_stored":4792876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2471493632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11233,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-64,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.009121"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.939407+0000","last_change":"2023-11-30T17:22:56.933786+0000","last_active":"2023-11-30T17:22:56.939407+0000","last_peered":"2023-11-30T17:22:56.939407+0000","last_clean":"2023-11-30T17:22:56.939407+0000","last_became_active":"2023-11-30T17:22:56.933521+0000","last_became_peered":"2023-11-30T17:22:56.933521+0000","last_unstale":"2023-11-30T17:22:56.939407+0000","last_undegraded":"2023-11-30T17:22:56.939407+0000","last_fullsized":"2023-11-30T17:22:56.939407+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3f","version":"97'3","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.945989+0000","last_change":"2023-11-30T17:22:56.545704+0000","last_active":"2023-11-30T17:22:56.945989+0000","last_peered":"2023-11-30T17:22:56.945989+0000","last_clean":"2023-11-30T17:22:56.945989+0000","last_became_active":"2023-11-30T17:22:56.545354+0000","last_became_peered":"2023-11-30T17:22:56.545354+0000","last_unstale":"2023-11-30T17:22:56.945989+0000","last_undegraded":"2023-11-30T17:22:56.945989+0000","last_fullsized":"2023-11-30T17:22:56.945989+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.944110+0000","last_change":"2023-11-30T17:22:56.937152+0000","last_active":"2023-11-30T17:22:56.944110+0000","last_peered":"2023-11-30T17:22:56.944110+0000","last_clean":"2023-11-30T17:22:56.944110+0000","last_became_active":"2023-11-30T17:22:56.936870+0000","last_became_peered":"2023-11-30T17:22:56.936870+0000","last_unstale":"2023-11-30T17:22:56.944110+0000","last_undegraded":"2023-11-30T17:22:56.944110+0000","last_fullsized":"2023-11-30T17:22:56.944110+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.926460+0000","last_change":"2023-11-30T17:22:56.553484+0000","last_active":"2023-11-30T17:22:56.926460+0000","last_peered":"2023-11-30T17:22:56.926460+0000","last_clean":"2023-11-30T17:22:56.926460+0000","last_became_active":"2023-11-30T17:22:56.552768+0000","last_became_peered":"2023-11-30T17:22:56.552768+0000","last_unstale":"2023-11-30T17:22:56.926460+0000","last_undegraded":"2023-11-30T17:22:56.926460+0000","last_fullsized":"2023-11-30T17:22:56.926460+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.941142+0000","last_change":"2023-11-30T17:22:56.937380+0000","last_active":"2023-11-30T17:22:56.941142+0000","last_peered":"2023-11-30T17:22:56.941142+0000","last_clean":"2023-11-30T17:22:56.941142+0000","last_became_active":"2023-11-30T17:22:56.937115+0000","last_became_peered":"2023-11-30T17:22:56.937115+0000","last_unstale":"2023-11-30T17:22:56.941142+0000","last_undegraded":"2023-11-30T17:22:56.941142+0000","last_fullsized":"2023-11-30T17:22:56.941142+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.923292+0000","last_change":"2023-11-30T17:22:56.542976+0000","last_active":"2023-11-30T17:22:56.923292+0000","last_peered":"2023-11-30T17:22:56.923292+0000","last_clean":"2023-11-30T17:22:56.923292+0000","last_became_active":"2023-11-30T17:22:56.542676+0000","last_became_peered":"2023-11-30T17:22:56.542676+0000","last_unstale":"2023-11-30T17:22:56.923292+0000","last_undegraded":"2023-11-30T17:22:56.923292+0000","last_fullsized":"2023-11-30T17:22:56.923292+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.937505+0000","last_change":"2023-11-30T17:22:56.931181+0000","last_active":"2023-11-30T17:22:56.937505+0000","last_peered":"2023-11-30T17:22:56.937505+0000","last_clean":"2023-11-30T17:22:56.937505+0000","last_became_active":"2023-11-30T17:22:56.930890+0000","last_became_peered":"2023-11-30T17:22:56.930890+0000","last_unstale":"2023-11-30T17:22:56.937505+0000","last_undegraded":"2023-11-30T17:22:56.937505+0000","last_fullsized":"2023-11-30T17:22:56.937505+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"97'2","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.943277+0000","last_change":"2023-11-30T17:22:56.545130+0000","last_active":"2023-11-30T17:22:56.943277+0000","last_peered":"2023-11-30T17:22:56.943277+0000","last_clean":"2023-11-30T17:22:56.943277+0000","last_became_active":"2023-11-30T17:22:56.544830+0000","last_became_peered":"2023-11-30T17:22:56.544830+0000","last_unstale":"2023-11-30T17:22:56.943277+0000","last_undegraded":"2023-11-30T17:22:56.943277+0000","last_fullsized":"2023-11-30T17:22:56.943277+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.942991+0000","last_change":"2023-11-30T17:22:56.940892+0000","last_active":"2023-11-30T17:22:56.942991+0000","last_peered":"2023-11-30T17:22:56.942991+0000","last_clean":"2023-11-30T17:22:56.942991+0000","last_became_active":"2023-11-30T17:22:56.940623+0000","last_became_peered":"2023-11-30T17:22:56.940623+0000","last_unstale":"2023-11-30T17:22:56.942991+0000","last_undegraded":"2023-11-30T17:22:56.942991+0000","last_fullsized":"2023-11-30T17:22:56.942991+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3b","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.938888+0000","last_change":"2023-11-30T17:22:56.544215+0000","last_active":"2023-11-30T17:22:56.938888+0000","last_peered":"2023-11-30T17:22:56.938888+0000","last_clean":"2023-11-30T17:22:56.938888+0000","last_became_active":"2023-11-30T17:22:56.543932+0000","last_became_peered":"2023-11-30T17:22:56.543932+0000","last_unstale":"2023-11-30T17:22:56.938888+0000","last_undegraded":"2023-11-30T17:22:56.938888+0000","last_fullsized":"2023-11-30T17:22:56.938888+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.939773+0000","last_change":"2023-11-30T17:22:56.937963+0000","last_active":"2023-11-30T17:22:56.939773+0000","last_peered":"2023-11-30T17:22:56.939773+0000","last_clean":"2023-11-30T17:22:56.939773+0000","last_became_active":"2023-11-30T17:22:56.936883+0000","last_became_peered":"2023-11-30T17:22:56.936883+0000","last_unstale":"2023-11-30T17:22:56.939773+0000","last_undegraded":"2023-11-30T17:22:56.939773+0000","last_fullsized":"2023-11-30T17:22:56.939773+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3a","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.942884+0000","last_change":"2023-11-30T17:22:56.553127+0000","last_active":"2023-11-30T17:22:56.942884+0000","last_peered":"2023-11-30T17:22:56.942884+0000","last_clean":"2023-11-30T17:22:56.942884+0000","last_became_active":"2023-11-30T17:22:56.552693+0000","last_became_peered":"2023-11-30T17:22:56.552693+0000","last_unstale":"2023-11-30T17:22:56.942884+0000","last_undegraded":"2023-11-30T17:22:56.942884+0000","last_fullsized":"2023-11-30T17:22:56.942884+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.937436+0000","last_change":"2023-11-30T17:22:56.927890+0000","last_active":"2023-11-30T17:22:56.937436+0000","last_peered":"2023-11-30T17:22:56.937436+0000","last_clean":"2023-11-30T17:22:56.937436+0000","last_became_active":"2023-11-30T17:22:56.927613+0000","last_became_peered":"2023-11-30T17:22:56.927613+0000","last_unstale":"2023-11-30T17:22:56.937436+0000","last_undegraded":"2023-11-30T17:22:56.937436+0000","last_fullsized":"2023-11-30T17:22:56.937436+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.926000+0000","last_change":"2023-11-30T17:22:56.541207+0000","last_active":"2023-11-30T17:22:56.926000+0000","last_peered":"2023-11-30T17:22:56.926000+0000","last_clean":"2023-11-30T17:22:56.926000+0000","last_became_active":"2023-11-30T17:22:56.540842+0000","last_became_peered":"2023-11-30T17:22:56.540842+0000","last_unstale":"2023-11-30T17:22:56.926000+0000","last_undegraded":"2023-11-30T17:22:56.926000+0000","last_fullsized":"2023-11-30T17:22:56.926000+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.946124+0000","last_change":"2023-11-30T17:22:56.940631+0000","last_active":"2023-11-30T17:22:56.946124+0000","last_peered":"2023-11-30T17:22:56.946124+0000","last_clean":"2023-11-30T17:22:56.946124+0000","last_became_active":"2023-11-30T17:22:56.940350+0000","last_became_peered":"2023-11-30T17:22:56.940350+0000","last_unstale":"2023-11-30T17:22:56.946124+0000","last_undegraded":"2023-11-30T17:22:56.946124+0000","last_fullsized":"2023-11-30T17:22:56.946124+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.922913+0000","last_change":"2023-11-30T17:22:56.542076+0000","last_active":"2023-11-30T17:22:56.922913+0000","last_peered":"2023-11-30T17:22:56.922913+0000","last_clean":"2023-11-30T17:22:56.922913+0000","last_became_active":"2023-11-30T17:22:56.541762+0000","last_became_peered":"2023-11-30T17:22:56.541762+0000","last_unstale":"2023-11-30T17:22:56.922913+0000","last_undegraded":"2023-11-30T17:22:56.922913+0000","last_fullsized":"2023-11-30T17:22:56.922913+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.946154+0000","last_change":"2023-11-30T17:22:56.941890+0000","last_active":"2023-11-30T17:22:56.946154+0000","last_peered":"2023-11-30T17:22:56.946154+0000","last_clean":"2023-11-30T17:22:56.946154+0000","last_became_active":"2023-11-30T17:22:56.940988+0000","last_became_peered":"2023-11-30T17:22:56.940988+0000","last_unstale":"2023-11-30T17:22:56.946154+0000","last_undegraded":"2023-11-30T17:22:56.946154+0000","last_fullsized":"2023-11-30T17:22:56.946154+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.923010+0000","last_change":"2023-11-30T17:22:56.547588+0000","last_active":"2023-11-30T17:22:56.923010+0000","last_peered":"2023-11-30T17:22:56.923010+0000","last_clean":"2023-11-30T17:22:56.923010+0000","last_became_active":"2023-11-30T17:22:56.547130+0000","last_became_peered":"2023-11-30T17:22:56.547130+0000","last_unstale":"2023-11-30T17:22:56.923010+0000","last_undegraded":"2023-11-30T17:22:56.923010+0000","last_fullsized":"2023-11-30T17:22:56.923010+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.934710+0000","last_change":"2023-11-30T17:22:56.928987+0000","last_active":"2023-11-30T17:22:56.934710+0000","last_peered":"2023-11-30T17:22:56.934710+0000","last_clean":"2023-11-30T17:22:56.934710+0000","last_became_active":"2023-11-30T17:22:56.928734+0000","last_became_peered":"2023-11-30T17:22:56.928734+0000","last_unstale":"2023-11-30T17:22:56.934710+0000","last_undegraded":"2023-11-30T17:22:56.934710+0000","last_fullsized":"2023-11-30T17:22:56.934710+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.936600+0000","last_change":"2023-11-30T17:22:56.553304+0000","last_active":"2023-11-30T17:22:56.936600+0000","last_peered":"2023-11-30T17:22:56.936600+0000","last_clean":"2023-11-30T17:22:56.936600+0000","last_became_active":"2023-11-30T17:22:56.553019+0000","last_became_peered":"2023-11-30T17:22:56.553019+0000","last_unstale":"2023-11-30T17:22:56.936600+0000","last_undegraded":"2023-11-30T17:22:56.936600+0000","last_fullsized":"2023-11-30T17:22:56.936600+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.941221+0000","last_change":"2023-11-30T17:22:56.940006+0000","last_active":"2023-11-30T17:22:56.941221+0000","last_peered":"2023-11-30T17:22:56.941221+0000","last_clean":"2023-11-30T17:22:56.941221+0000","last_became_active":"2023-11-30T17:22:56.939744+0000","last_became_peered":"2023-11-30T17:22:56.939744+0000","last_unstale":"2023-11-30T17:22:56.941221+0000","last_undegraded":"2023-11-30T17:22:56.941221+0000","last_fullsized":"2023-11-30T17:22:56.941221+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.927696+0000","last_change":"2023-11-30T17:22:56.548600+0000","last_active":"2023-11-30T17:22:56.927696+0000","last_peered":"2023-11-30T17:22:56.927696+0000","last_clean":"2023-11-30T17:22:56.927696+0000","last_became_active":"2023-11-30T17:22:56.548110+0000","last_became_peered":"2023-11-30T17:22:56.548110+0000","last_unstale":"2023-11-30T17:22:56.927696+0000","last_undegraded":"2023-11-30T17:22:56.927696+0000","last_fullsized":"2023-11-30T17:22:56.927696+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.940134+0000","last_change":"2023-11-30T17:22:56.934739+0000","last_active":"2023-11-30T17:22:56.940134+0000","last_peered":"2023-11-30T17:22:56.940134+0000","last_clean":"2023-11-30T17:22:56.940134+0000","last_became_active":"2023-11-30T17:22:56.934462+0000","last_became_peered":"2023-11-30T17:22:56.934462+0000","last_unstale":"2023-11-30T17:22:56.940134+0000","last_undegraded":"2023-11-30T17:22:56.940134+0000","last_fullsized":"2023-11-30T17:22:56.940134+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.34","version":"97'4","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.944904+0000","last_change":"2023-11-30T17:22:56.544038+0000","last_active":"2023-11-30T17:22:56.944904+0000","last_peered":"2023-11-30T17:22:56.944904+0000","last_clean":"2023-11-30T17:22:56.944904+0000","last_became_active":"2023-11-30T17:22:56.543337+0000","last_became_peered":"2023-11-30T17:22:56.543337+0000","last_unstale":"2023-11-30T17:22:56.944904+0000","last_undegraded":"2023-11-30T17:22:56.944904+0000","last_fullsized":"2023-11-30T17:22:56.944904+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.942973+0000","last_change":"2023-11-30T17:22:56.940232+0000","last_active":"2023-11-30T17:22:56.942973+0000","last_peered":"2023-11-30T17:22:56.942973+0000","last_clean":"2023-11-30T17:22:56.942973+0000","last_became_active":"2023-11-30T17:22:56.939828+0000","last_became_peered":"2023-11-30T17:22:56.939828+0000","last_unstale":"2023-11-30T17:22:56.942973+0000","last_undegraded":"2023-11-30T17:22:56.942973+0000","last_fullsized":"2023-11-30T17:22:56.942973+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.33","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.937727+0000","last_change":"2023-11-30T17:22:56.546116+0000","last_active":"2023-11-30T17:22:56.937727+0000","last_peered":"2023-11-30T17:22:56.937727+0000","last_clean":"2023-11-30T17:22:56.937727+0000","last_became_active":"2023-11-30T17:22:56.545858+0000","last_became_peered":"2023-11-30T17:22:56.545858+0000","last_unstale":"2023-11-30T17:22:56.937727+0000","last_undegraded":"2023-11-30T17:22:56.937727+0000","last_fullsized":"2023-11-30T17:22:56.937727+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.938541+0000","last_change":"2023-11-30T17:22:56.930636+0000","last_active":"2023-11-30T17:22:56.938541+0000","last_peered":"2023-11-30T17:22:56.938541+0000","last_clean":"2023-11-30T17:22:56.938541+0000","last_became_active":"2023-11-30T17:22:56.930370+0000","last_became_peered":"2023-11-30T17:22:56.930370+0000","last_unstale":"2023-11-30T17:22:56.938541+0000","last_undegraded":"2023-11-30T17:22:56.938541+0000","last_fullsized":"2023-11-30T17:22:56.938541+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.923476+0000","last_change":"2023-11-30T17:22:56.541930+0000","last_active":"2023-11-30T17:22:56.923476+0000","last_peered":"2023-11-30T17:22:56.923476+0000","last_clean":"2023-11-30T17:22:56.923476+0000","last_became_active":"2023-11-30T17:22:56.541090+0000","last_became_peered":"2023-11-30T17:22:56.541090+0000","last_unstale":"2023-11-30T17:22:56.923476+0000","last_undegraded":"2023-11-30T17:22:56.923476+0000","last_fullsized":"2023-11-30T17:22:56.923476+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.940328+0000","last_change":"2023-11-30T17:22:56.938088+0000","last_active":"2023-11-30T17:22:56.940328+0000","last_peered":"2023-11-30T17:22:56.940328+0000","last_clean":"2023-11-30T17:22:56.940328+0000","last_became_active":"2023-11-30T17:22:56.937797+0000","last_became_peered":"2023-11-30T17:22:56.937797+0000","last_unstale":"2023-11-30T17:22:56.940328+0000","last_undegraded":"2023-11-30T17:22:56.940328+0000","last_fullsized":"2023-11-30T17:22:56.940328+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.916850+0000","last_change":"2023-11-30T17:22:56.544004+0000","last_active":"2023-11-30T17:22:56.916850+0000","last_peered":"2023-11-30T17:22:56.916850+0000","last_clean":"2023-11-30T17:22:56.916850+0000","last_became_active":"2023-11-30T17:22:56.543733+0000","last_became_peered":"2023-11-30T17:22:56.543733+0000","last_unstale":"2023-11-30T17:22:56.916850+0000","last_undegraded":"2023-11-30T17:22:56.916850+0000","last_fullsized":"2023-11-30T17:22:56.916850+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.942362+0000","last_change":"2023-11-30T17:22:56.939092+0000","last_active":"2023-11-30T17:22:56.942362+0000","last_peered":"2023-11-30T17:22:56.942362+0000","last_clean":"2023-11-30T17:22:56.942362+0000","last_became_active":"2023-11-30T17:22:56.938732+0000","last_became_peered":"2023-11-30T17:22:56.938732+0000","last_unstale":"2023-11-30T17:22:56.942362+0000","last_undegraded":"2023-11-30T17:22:56.942362+0000","last_fullsized":"2023-11-30T17:22:56.942362+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"97'4","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.945162+0000","last_change":"2023-11-30T17:22:56.549461+0000","last_active":"2023-11-30T17:22:56.945162+0000","last_peered":"2023-11-30T17:22:56.945162+0000","last_clean":"2023-11-30T17:22:56.945162+0000","last_became_active":"2023-11-30T17:22:56.549199+0000","last_became_peered":"2023-11-30T17:22:56.549199+0000","last_unstale":"2023-11-30T17:22:56.945162+0000","last_undegraded":"2023-11-30T17:22:56.945162+0000","last_fullsized":"2023-11-30T17:22:56.945162+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.939005+0000","last_change":"2023-11-30T17:22:56.932762+0000","last_active":"2023-11-30T17:22:56.939005+0000","last_peered":"2023-11-30T17:22:56.939005+0000","last_clean":"2023-11-30T17:22:56.939005+0000","last_became_active":"2023-11-30T17:22:56.932481+0000","last_became_peered":"2023-11-30T17:22:56.932481+0000","last_unstale":"2023-11-30T17:22:56.939005+0000","last_undegraded":"2023-11-30T17:22:56.939005+0000","last_fullsized":"2023-11-30T17:22:56.939005+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.923046+0000","last_change":"2023-11-30T17:22:56.547735+0000","last_active":"2023-11-30T17:22:56.923046+0000","last_peered":"2023-11-30T17:22:56.923046+0000","last_clean":"2023-11-30T17:22:56.923046+0000","last_became_active":"2023-11-30T17:22:56.547437+0000","last_became_peered":"2023-11-30T17:22:56.547437+0000","last_unstale":"2023-11-30T17:22:56.923046+0000","last_undegraded":"2023-11-30T17:22:56.923046+0000","last_fullsized":"2023-11-30T17:22:56.923046+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.942533+0000","last_change":"2023-11-30T17:22:56.937469+0000","last_active":"2023-11-30T17:22:56.942533+0000","last_peered":"2023-11-30T17:22:56.942533+0000","last_clean":"2023-11-30T17:22:56.942533+0000","last_became_active":"2023-11-30T17:22:56.937087+0000","last_became_peered":"2023-11-30T17:22:56.937087+0000","last_unstale":"2023-11-30T17:22:56.942533+0000","last_undegraded":"2023-11-30T17:22:56.942533+0000","last_fullsized":"2023-11-30T17:22:56.942533+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.920951+0000","last_change":"2023-11-30T17:22:56.545078+0000","last_active":"2023-11-30T17:22:56.920951+0000","last_peered":"2023-11-30T17:22:56.920951+0000","last_clean":"2023-11-30T17:22:56.920951+0000","last_became_active":"2023-11-30T17:22:56.544794+0000","last_became_peered":"2023-11-30T17:22:56.544794+0000","last_unstale":"2023-11-30T17:22:56.920951+0000","last_undegraded":"2023-11-30T17:22:56.920951+0000","last_fullsized":"2023-11-30T17:22:56.920951+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.939053+0000","last_change":"2023-11-30T17:22:56.932435+0000","last_active":"2023-11-30T17:22:56.939053+0000","last_peered":"2023-11-30T17:22:56.939053+0000","last_clean":"2023-11-30T17:22:56.939053+0000","last_became_active":"2023-11-30T17:22:56.932160+0000","last_became_peered":"2023-11-30T17:22:56.932160+0000","last_unstale":"2023-11-30T17:22:56.939053+0000","last_undegraded":"2023-11-30T17:22:56.939053+0000","last_fullsized":"2023-11-30T17:22:56.939053+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2d","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.936764+0000","last_change":"2023-11-30T17:22:56.543215+0000","last_active":"2023-11-30T17:22:56.936764+0000","last_peered":"2023-11-30T17:22:56.936764+0000","last_clean":"2023-11-30T17:22:56.936764+0000","last_became_active":"2023-11-30T17:22:56.542916+0000","last_became_peered":"2023-11-30T17:22:56.542916+0000","last_unstale":"2023-11-30T17:22:56.936764+0000","last_undegraded":"2023-11-30T17:22:56.936764+0000","last_fullsized":"2023-11-30T17:22:56.936764+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.945779+0000","last_change":"2023-11-30T17:22:56.940113+0000","last_active":"2023-11-30T17:22:56.945779+0000","last_peered":"2023-11-30T17:22:56.945779+0000","last_clean":"2023-11-30T17:22:56.945779+0000","last_became_active":"2023-11-30T17:22:56.939847+0000","last_became_peered":"2023-11-30T17:22:56.939847+0000","last_unstale":"2023-11-30T17:22:56.945779+0000","last_undegraded":"2023-11-30T17:22:56.945779+0000","last_fullsized":"2023-11-30T17:22:56.945779+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.917029+0000","last_change":"2023-11-30T17:22:56.541827+0000","last_active":"2023-11-30T17:22:56.917029+0000","last_peered":"2023-11-30T17:22:56.917029+0000","last_clean":"2023-11-30T17:22:56.917029+0000","last_became_active":"2023-11-30T17:22:56.541399+0000","last_became_peered":"2023-11-30T17:22:56.541399+0000","last_unstale":"2023-11-30T17:22:56.917029+0000","last_undegraded":"2023-11-30T17:22:56.917029+0000","last_fullsized":"2023-11-30T17:22:56.917029+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.931618+0000","last_change":"2023-11-30T17:22:56.928581+0000","last_active":"2023-11-30T17:22:56.931618+0000","last_peered":"2023-11-30T17:22:56.931618+0000","last_clean":"2023-11-30T17:22:56.931618+0000","last_became_active":"2023-11-30T17:22:56.928305+0000","last_became_peered":"2023-11-30T17:22:56.928305+0000","last_unstale":"2023-11-30T17:22:56.931618+0000","last_undegraded":"2023-11-30T17:22:56.931618+0000","last_fullsized":"2023-11-30T17:22:56.931618+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2b","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.939657+0000","last_change":"2023-11-30T17:22:56.549578+0000","last_active":"2023-11-30T17:22:56.939657+0000","last_peered":"2023-11-30T17:22:56.939657+0000","last_clean":"2023-11-30T17:22:56.939657+0000","last_became_active":"2023-11-30T17:22:56.548903+0000","last_became_peered":"2023-11-30T17:22:56.548903+0000","last_unstale":"2023-11-30T17:22:56.939657+0000","last_undegraded":"2023-11-30T17:22:56.939657+0000","last_fullsized":"2023-11-30T17:22:56.939657+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.938980+0000","last_change":"2023-11-30T17:22:56.933489+0000","last_active":"2023-11-30T17:22:56.938980+0000","last_peered":"2023-11-30T17:22:56.938980+0000","last_clean":"2023-11-30T17:22:56.938980+0000","last_became_active":"2023-11-30T17:22:56.933205+0000","last_became_peered":"2023-11-30T17:22:56.933205+0000","last_unstale":"2023-11-30T17:22:56.938980+0000","last_undegraded":"2023-11-30T17:22:56.938980+0000","last_fullsized":"2023-11-30T17:22:56.938980+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.935734+0000","last_change":"2023-11-30T17:22:56.552648+0000","last_active":"2023-11-30T17:22:56.935734+0000","last_peered":"2023-11-30T17:22:56.935734+0000","last_clean":"2023-11-30T17:22:56.935734+0000","last_became_active":"2023-11-30T17:22:56.552369+0000","last_became_peered":"2023-11-30T17:22:56.552369+0000","last_unstale":"2023-11-30T17:22:56.935734+0000","last_undegraded":"2023-11-30T17:22:56.935734+0000","last_fullsized":"2023-11-30T17:22:56.935734+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.935412+0000","last_change":"2023-11-30T17:22:56.931901+0000","last_active":"2023-11-30T17:22:56.935412+0000","last_peered":"2023-11-30T17:22:56.935412+0000","last_clean":"2023-11-30T17:22:56.935412+0000","last_became_active":"2023-11-30T17:22:56.931622+0000","last_became_peered":"2023-11-30T17:22:56.931622+0000","last_unstale":"2023-11-30T17:22:56.935412+0000","last_undegraded":"2023-11-30T17:22:56.935412+0000","last_fullsized":"2023-11-30T17:22:56.935412+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.926359+0000","last_change":"2023-11-30T17:22:56.544425+0000","last_active":"2023-11-30T17:22:56.926359+0000","last_peered":"2023-11-30T17:22:56.926359+0000","last_clean":"2023-11-30T17:22:56.926359+0000","last_became_active":"2023-11-30T17:22:56.544143+0000","last_became_peered":"2023-11-30T17:22:56.544143+0000","last_unstale":"2023-11-30T17:22:56.926359+0000","last_undegraded":"2023-11-30T17:22:56.926359+0000","last_fullsized":"2023-11-30T17:22:56.926359+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.940837+0000","last_change":"2023-11-30T17:22:56.938672+0000","last_active":"2023-11-30T17:22:56.940837+0000","last_peered":"2023-11-30T17:22:56.940837+0000","last_clean":"2023-11-30T17:22:56.940837+0000","last_became_active":"2023-11-30T17:22:56.938237+0000","last_became_peered":"2023-11-30T17:22:56.938237+0000","last_unstale":"2023-11-30T17:22:56.940837+0000","last_undegraded":"2023-11-30T17:22:56.940837+0000","last_fullsized":"2023-11-30T17:22:56.940837+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.926384+0000","last_change":"2023-11-30T17:22:56.550867+0000","last_active":"2023-11-30T17:22:56.926384+0000","last_peered":"2023-11-30T17:22:56.926384+0000","last_clean":"2023-11-30T17:22:56.926384+0000","last_became_active":"2023-11-30T17:22:56.550522+0000","last_became_peered":"2023-11-30T17:22:56.550522+0000","last_unstale":"2023-11-30T17:22:56.926384+0000","last_undegraded":"2023-11-30T17:22:56.926384+0000","last_fullsized":"2023-11-30T17:22:56.926384+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.946177+0000","last_change":"2023-11-30T17:22:56.942078+0000","last_active":"2023-11-30T17:22:56.946177+0000","last_peered":"2023-11-30T17:22:56.946177+0000","last_clean":"2023-11-30T17:22:56.946177+0000","last_became_active":"2023-11-30T17:22:56.941598+0000","last_became_peered":"2023-11-30T17:22:56.941598+0000","last_unstale":"2023-11-30T17:22:56.946177+0000","last_undegraded":"2023-11-30T17:22:56.946177+0000","last_fullsized":"2023-11-30T17:22:56.946177+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.936004+0000","last_change":"2023-11-30T17:22:56.550072+0000","last_active":"2023-11-30T17:22:56.936004+0000","last_peered":"2023-11-30T17:22:56.936004+0000","last_clean":"2023-11-30T17:22:56.936004+0000","last_became_active":"2023-11-30T17:22:56.549806+0000","last_became_peered":"2023-11-30T17:22:56.549806+0000","last_unstale":"2023-11-30T17:22:56.936004+0000","last_undegraded":"2023-11-30T17:22:56.936004+0000","last_fullsized":"2023-11-30T17:22:56.936004+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.939741+0000","last_change":"2023-11-30T17:22:56.937648+0000","last_active":"2023-11-30T17:22:56.939741+0000","last_peered":"2023-11-30T17:22:56.939741+0000","last_clean":"2023-11-30T17:22:56.939741+0000","last_became_active":"2023-11-30T17:22:56.937360+0000","last_became_peered":"2023-11-30T17:22:56.937360+0000","last_unstale":"2023-11-30T17:22:56.939741+0000","last_undegraded":"2023-11-30T17:22:56.939741+0000","last_fullsized":"2023-11-30T17:22:56.939741+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.928426+0000","last_change":"2023-11-30T17:22:56.547268+0000","last_active":"2023-11-30T17:22:56.928426+0000","last_peered":"2023-11-30T17:22:56.928426+0000","last_clean":"2023-11-30T17:22:56.928426+0000","last_became_active":"2023-11-30T17:22:56.546838+0000","last_became_peered":"2023-11-30T17:22:56.546838+0000","last_unstale":"2023-11-30T17:22:56.928426+0000","last_undegraded":"2023-11-30T17:22:56.928426+0000","last_fullsized":"2023-11-30T17:22:56.928426+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.946082+0000","last_change":"2023-11-30T17:22:56.939774+0000","last_active":"2023-11-30T17:22:56.946082+0000","last_peered":"2023-11-30T17:22:56.946082+0000","last_clean":"2023-11-30T17:22:56.946082+0000","last_became_active":"2023-11-30T17:22:56.939411+0000","last_became_peered":"2023-11-30T17:22:56.939411+0000","last_unstale":"2023-11-30T17:22:56.946082+0000","last_undegraded":"2023-11-30T17:22:56.946082+0000","last_fullsized":"2023-11-30T17:22:56.946082+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.923389+0000","last_change":"2023-11-30T17:22:56.545710+0000","last_active":"2023-11-30T17:22:56.923389+0000","last_peered":"2023-11-30T17:22:56.923389+0000","last_clean":"2023-11-30T17:22:56.923389+0000","last_became_active":"2023-11-30T17:22:56.545406+0000","last_became_peered":"2023-11-30T17:22:56.545406+0000","last_unstale":"2023-11-30T17:22:56.923389+0000","last_undegraded":"2023-11-30T17:22:56.923389+0000","last_fullsized":"2023-11-30T17:22:56.923389+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.938739+0000","last_change":"2023-11-30T17:22:56.932208+0000","last_active":"2023-11-30T17:22:56.938739+0000","last_peered":"2023-11-30T17:22:56.938739+0000","last_clean":"2023-11-30T17:22:56.938739+0000","last_became_active":"2023-11-30T17:22:56.931934+0000","last_became_peered":"2023-11-30T17:22:56.931934+0000","last_unstale":"2023-11-30T17:22:56.938739+0000","last_undegraded":"2023-11-30T17:22:56.938739+0000","last_fullsized":"2023-11-30T17:22:56.938739+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.936164+0000","last_change":"2023-11-30T17:22:56.549027+0000","last_active":"2023-11-30T17:22:56.936164+0000","last_peered":"2023-11-30T17:22:56.936164+0000","last_clean":"2023-11-30T17:22:56.936164+0000","last_became_active":"2023-11-30T17:22:56.548721+0000","last_became_peered":"2023-11-30T17:22:56.548721+0000","last_unstale":"2023-11-30T17:22:56.936164+0000","last_undegraded":"2023-11-30T17:22:56.936164+0000","last_fullsized":"2023-11-30T17:22:56.936164+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.940236+0000","last_change":"2023-11-30T17:22:56.936981+0000","last_active":"2023-11-30T17:22:56.940236+0000","last_peered":"2023-11-30T17:22:56.940236+0000","last_clean":"2023-11-30T17:22:56.940236+0000","last_became_active":"2023-11-30T17:22:56.936715+0000","last_became_peered":"2023-11-30T17:22:56.936715+0000","last_unstale":"2023-11-30T17:22:56.940236+0000","last_undegraded":"2023-11-30T17:22:56.940236+0000","last_fullsized":"2023-11-30T17:22:56.940236+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.925215+0000","last_change":"2023-11-30T17:22:56.541837+0000","last_active":"2023-11-30T17:22:56.925215+0000","last_peered":"2023-11-30T17:22:56.925215+0000","last_clean":"2023-11-30T17:22:56.925215+0000","last_became_active":"2023-11-30T17:22:56.541125+0000","last_became_peered":"2023-11-30T17:22:56.541125+0000","last_unstale":"2023-11-30T17:22:56.925215+0000","last_undegraded":"2023-11-30T17:22:56.925215+0000","last_fullsized":"2023-11-30T17:22:56.925215+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.948563+0000","last_change":"2023-11-30T17:22:56.943276+0000","last_active":"2023-11-30T17:22:56.948563+0000","last_peered":"2023-11-30T17:22:56.948563+0000","last_clean":"2023-11-30T17:22:56.948563+0000","last_became_active":"2023-11-30T17:22:56.941728+0000","last_became_peered":"2023-11-30T17:22:56.941728+0000","last_unstale":"2023-11-30T17:22:56.948563+0000","last_undegraded":"2023-11-30T17:22:56.948563+0000","last_fullsized":"2023-11-30T17:22:56.948563+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.924268+0000","last_change":"2023-11-30T17:22:56.546491+0000","last_active":"2023-11-30T17:22:56.924268+0000","last_peered":"2023-11-30T17:22:56.924268+0000","last_clean":"2023-11-30T17:22:56.924268+0000","last_became_active":"2023-11-30T17:22:56.546198+0000","last_became_peered":"2023-11-30T17:22:56.546198+0000","last_unstale":"2023-11-30T17:22:56.924268+0000","last_undegraded":"2023-11-30T17:22:56.924268+0000","last_fullsized":"2023-11-30T17:22:56.924268+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.942494+0000","last_change":"2023-11-30T17:22:56.939719+0000","last_active":"2023-11-30T17:22:56.942494+0000","last_peered":"2023-11-30T17:22:56.942494+0000","last_clean":"2023-11-30T17:22:56.942494+0000","last_became_active":"2023-11-30T17:22:56.939377+0000","last_became_peered":"2023-11-30T17:22:56.939377+0000","last_unstale":"2023-11-30T17:22:56.942494+0000","last_undegraded":"2023-11-30T17:22:56.942494+0000","last_fullsized":"2023-11-30T17:22:56.942494+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.926111+0000","last_change":"2023-11-30T17:22:56.545478+0000","last_active":"2023-11-30T17:22:56.926111+0000","last_peered":"2023-11-30T17:22:56.926111+0000","last_clean":"2023-11-30T17:22:56.926111+0000","last_became_active":"2023-11-30T17:22:56.545205+0000","last_became_peered":"2023-11-30T17:22:56.545205+0000","last_unstale":"2023-11-30T17:22:56.926111+0000","last_undegraded":"2023-11-30T17:22:56.926111+0000","last_fullsized":"2023-11-30T17:22:56.926111+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.938972+0000","last_change":"2023-11-30T17:22:56.932215+0000","last_active":"2023-11-30T17:22:56.938972+0000","last_peered":"2023-11-30T17:22:56.938972+0000","last_clean":"2023-11-30T17:22:56.938972+0000","last_became_active":"2023-11-30T17:22:56.931947+0000","last_became_peered":"2023-11-30T17:22:56.931947+0000","last_unstale":"2023-11-30T17:22:56.938972+0000","last_undegraded":"2023-11-30T17:22:56.938972+0000","last_fullsized":"2023-11-30T17:22:56.938972+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.922255+0000","last_change":"2023-11-30T17:22:56.546193+0000","last_active":"2023-11-30T17:22:56.922255+0000","last_peered":"2023-11-30T17:22:56.922255+0000","last_clean":"2023-11-30T17:22:56.922255+0000","last_became_active":"2023-11-30T17:22:56.545804+0000","last_became_peered":"2023-11-30T17:22:56.545804+0000","last_unstale":"2023-11-30T17:22:56.922255+0000","last_undegraded":"2023-11-30T17:22:56.922255+0000","last_fullsized":"2023-11-30T17:22:56.922255+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.942452+0000","last_change":"2023-11-30T17:22:56.940164+0000","last_active":"2023-11-30T17:22:56.942452+0000","last_peered":"2023-11-30T17:22:56.942452+0000","last_clean":"2023-11-30T17:22:56.942452+0000","last_became_active":"2023-11-30T17:22:56.939899+0000","last_became_peered":"2023-11-30T17:22:56.939899+0000","last_unstale":"2023-11-30T17:22:56.942452+0000","last_undegraded":"2023-11-30T17:22:56.942452+0000","last_fullsized":"2023-11-30T17:22:56.942452+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.932065+0000","last_change":"2023-11-30T17:22:56.547410+0000","last_active":"2023-11-30T17:22:56.932065+0000","last_peered":"2023-11-30T17:22:56.932065+0000","last_clean":"2023-11-30T17:22:56.932065+0000","last_became_active":"2023-11-30T17:22:56.547060+0000","last_became_peered":"2023-11-30T17:22:56.547060+0000","last_unstale":"2023-11-30T17:22:56.932065+0000","last_undegraded":"2023-11-30T17:22:56.932065+0000","last_fullsized":"2023-11-30T17:22:56.932065+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.938646+0000","last_change":"2023-11-30T17:22:56.933756+0000","last_active":"2023-11-30T17:22:56.938646+0000","last_peered":"2023-11-30T17:22:56.938646+0000","last_clean":"2023-11-30T17:22:56.938646+0000","last_became_active":"2023-11-30T17:22:56.933473+0000","last_became_peered":"2023-11-30T17:22:56.933473+0000","last_unstale":"2023-11-30T17:22:56.938646+0000","last_undegraded":"2023-11-30T17:22:56.938646+0000","last_fullsized":"2023-11-30T17:22:56.938646+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.939154+0000","last_change":"2023-11-30T17:22:56.550134+0000","last_active":"2023-11-30T17:22:56.939154+0000","last_peered":"2023-11-30T17:22:56.939154+0000","last_clean":"2023-11-30T17:22:56.939154+0000","last_became_active":"2023-11-30T17:22:56.549863+0000","last_became_peered":"2023-11-30T17:22:56.549863+0000","last_unstale":"2023-11-30T17:22:56.939154+0000","last_undegraded":"2023-11-30T17:22:56.939154+0000","last_fullsized":"2023-11-30T17:22:56.939154+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.938973+0000","last_change":"2023-11-30T17:22:56.932434+0000","last_active":"2023-11-30T17:22:56.938973+0000","last_peered":"2023-11-30T17:22:56.938973+0000","last_clean":"2023-11-30T17:22:56.938973+0000","last_became_active":"2023-11-30T17:22:56.932112+0000","last_became_peered":"2023-11-30T17:22:56.932112+0000","last_unstale":"2023-11-30T17:22:56.938973+0000","last_undegraded":"2023-11-30T17:22:56.938973+0000","last_fullsized":"2023-11-30T17:22:56.938973+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"97'2","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.940124+0000","last_change":"2023-11-30T17:22:56.544287+0000","last_active":"2023-11-30T17:22:56.940124+0000","last_peered":"2023-11-30T17:22:56.940124+0000","last_clean":"2023-11-30T17:22:56.940124+0000","last_became_active":"2023-11-30T17:22:56.544006+0000","last_became_peered":"2023-11-30T17:22:56.544006+0000","last_unstale":"2023-11-30T17:22:56.940124+0000","last_undegraded":"2023-11-30T17:22:56.940124+0000","last_fullsized":"2023-11-30T17:22:56.940124+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.942360+0000","last_change":"2023-11-30T17:22:56.937873+0000","last_active":"2023-11-30T17:22:56.942360+0000","last_peered":"2023-11-30T17:22:56.942360+0000","last_clean":"2023-11-30T17:22:56.942360+0000","last_became_active":"2023-11-30T17:22:56.937610+0000","last_became_peered":"2023-11-30T17:22:56.937610+0000","last_unstale":"2023-11-30T17:22:56.942360+0000","last_undegraded":"2023-11-30T17:22:56.942360+0000","last_fullsized":"2023-11-30T17:22:56.942360+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.932429+0000","last_change":"2023-11-30T17:22:56.544160+0000","last_active":"2023-11-30T17:22:56.932429+0000","last_peered":"2023-11-30T17:22:56.932429+0000","last_clean":"2023-11-30T17:22:56.932429+0000","last_became_active":"2023-11-30T17:22:56.543871+0000","last_became_peered":"2023-11-30T17:22:56.543871+0000","last_unstale":"2023-11-30T17:22:56.932429+0000","last_undegraded":"2023-11-30T17:22:56.932429+0000","last_fullsized":"2023-11-30T17:22:56.932429+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.936274+0000","last_change":"2023-11-30T17:22:56.927887+0000","last_active":"2023-11-30T17:22:56.936274+0000","last_peered":"2023-11-30T17:22:56.936274+0000","last_clean":"2023-11-30T17:22:56.936274+0000","last_became_active":"2023-11-30T17:22:56.927603+0000","last_became_peered":"2023-11-30T17:22:56.927603+0000","last_unstale":"2023-11-30T17:22:56.936274+0000","last_undegraded":"2023-11-30T17:22:56.936274+0000","last_fullsized":"2023-11-30T17:22:56.936274+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.935829+0000","last_change":"2023-11-30T17:22:56.551036+0000","last_active":"2023-11-30T17:22:56.935829+0000","last_peered":"2023-11-30T17:22:56.935829+0000","last_clean":"2023-11-30T17:22:56.935829+0000","last_became_active":"2023-11-30T17:22:56.549232+0000","last_became_peered":"2023-11-30T17:22:56.549232+0000","last_unstale":"2023-11-30T17:22:56.935829+0000","last_undegraded":"2023-11-30T17:22:56.935829+0000","last_fullsized":"2023-11-30T17:22:56.935829+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.938520+0000","last_change":"2023-11-30T17:22:56.930449+0000","last_active":"2023-11-30T17:22:56.938520+0000","last_peered":"2023-11-30T17:22:56.938520+0000","last_clean":"2023-11-30T17:22:56.938520+0000","last_became_active":"2023-11-30T17:22:56.930025+0000","last_became_peered":"2023-11-30T17:22:56.930025+0000","last_unstale":"2023-11-30T17:22:56.938520+0000","last_undegraded":"2023-11-30T17:22:56.938520+0000","last_fullsized":"2023-11-30T17:22:56.938520+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.924374+0000","last_change":"2023-11-30T17:22:56.542262+0000","last_active":"2023-11-30T17:22:56.924374+0000","last_peered":"2023-11-30T17:22:56.924374+0000","last_clean":"2023-11-30T17:22:56.924374+0000","last_became_active":"2023-11-30T17:22:56.541925+0000","last_became_peered":"2023-11-30T17:22:56.541925+0000","last_unstale":"2023-11-30T17:22:56.924374+0000","last_undegraded":"2023-11-30T17:22:56.924374+0000","last_fullsized":"2023-11-30T17:22:56.924374+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.945702+0000","last_change":"2023-11-30T17:22:56.939993+0000","last_active":"2023-11-30T17:22:56.945702+0000","last_peered":"2023-11-30T17:22:56.945702+0000","last_clean":"2023-11-30T17:22:56.945702+0000","last_became_active":"2023-11-30T17:22:56.939685+0000","last_became_peered":"2023-11-30T17:22:56.939685+0000","last_unstale":"2023-11-30T17:22:56.945702+0000","last_undegraded":"2023-11-30T17:22:56.945702+0000","last_fullsized":"2023-11-30T17:22:56.945702+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.916984+0000","last_change":"2023-11-30T17:22:56.539980+0000","last_active":"2023-11-30T17:22:56.916984+0000","last_peered":"2023-11-30T17:22:56.916984+0000","last_clean":"2023-11-30T17:22:56.916984+0000","last_became_active":"2023-11-30T17:22:56.539695+0000","last_became_peered":"2023-11-30T17:22:56.539695+0000","last_unstale":"2023-11-30T17:22:56.916984+0000","last_undegraded":"2023-11-30T17:22:56.916984+0000","last_fullsized":"2023-11-30T17:22:56.916984+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.943791+0000","last_change":"2023-11-30T17:22:56.935570+0000","last_active":"2023-11-30T17:22:56.943791+0000","last_peered":"2023-11-30T17:22:56.943791+0000","last_clean":"2023-11-30T17:22:56.943791+0000","last_became_active":"2023-11-30T17:22:56.933951+0000","last_became_peered":"2023-11-30T17:22:56.933951+0000","last_unstale":"2023-11-30T17:22:56.943791+0000","last_undegraded":"2023-11-30T17:22:56.943791+0000","last_fullsized":"2023-11-30T17:22:56.943791+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.921433+0000","last_change":"2023-11-30T17:22:56.551002+0000","last_active":"2023-11-30T17:22:56.921433+0000","last_peered":"2023-11-30T17:22:56.921433+0000","last_clean":"2023-11-30T17:22:56.921433+0000","last_became_active":"2023-11-30T17:22:56.550724+0000","last_became_peered":"2023-11-30T17:22:56.550724+0000","last_unstale":"2023-11-30T17:22:56.921433+0000","last_undegraded":"2023-11-30T17:22:56.921433+0000","last_fullsized":"2023-11-30T17:22:56.921433+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.939033+0000","last_change":"2023-11-30T17:22:56.935206+0000","last_active":"2023-11-30T17:22:56.939033+0000","last_peered":"2023-11-30T17:22:56.939033+0000","last_clean":"2023-11-30T17:22:56.939033+0000","last_became_active":"2023-11-30T17:22:56.934913+0000","last_became_peered":"2023-11-30T17:22:56.934913+0000","last_unstale":"2023-11-30T17:22:56.939033+0000","last_undegraded":"2023-11-30T17:22:56.939033+0000","last_fullsized":"2023-11-30T17:22:56.939033+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.929218+0000","last_change":"2023-11-30T17:22:56.549584+0000","last_active":"2023-11-30T17:22:56.929218+0000","last_peered":"2023-11-30T17:22:56.929218+0000","last_clean":"2023-11-30T17:22:56.929218+0000","last_became_active":"2023-11-30T17:22:56.549285+0000","last_became_peered":"2023-11-30T17:22:56.549285+0000","last_unstale":"2023-11-30T17:22:56.929218+0000","last_undegraded":"2023-11-30T17:22:56.929218+0000","last_fullsized":"2023-11-30T17:22:56.929218+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.941733+0000","last_change":"2023-11-30T17:22:56.939107+0000","last_active":"2023-11-30T17:22:56.941733+0000","last_peered":"2023-11-30T17:22:56.941733+0000","last_clean":"2023-11-30T17:22:56.941733+0000","last_became_active":"2023-11-30T17:22:56.938800+0000","last_became_peered":"2023-11-30T17:22:56.938800+0000","last_unstale":"2023-11-30T17:22:56.941733+0000","last_undegraded":"2023-11-30T17:22:56.941733+0000","last_fullsized":"2023-11-30T17:22:56.941733+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.928540+0000","last_change":"2023-11-30T17:22:56.547097+0000","last_active":"2023-11-30T17:22:56.928540+0000","last_peered":"2023-11-30T17:22:56.928540+0000","last_clean":"2023-11-30T17:22:56.928540+0000","last_became_active":"2023-11-30T17:22:56.546457+0000","last_became_peered":"2023-11-30T17:22:56.546457+0000","last_unstale":"2023-11-30T17:22:56.928540+0000","last_undegraded":"2023-11-30T17:22:56.928540+0000","last_fullsized":"2023-11-30T17:22:56.928540+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.940802+0000","last_change":"2023-11-30T17:22:56.936273+0000","last_active":"2023-11-30T17:22:56.940802+0000","last_peered":"2023-11-30T17:22:56.940802+0000","last_clean":"2023-11-30T17:22:56.940802+0000","last_became_active":"2023-11-30T17:22:56.935988+0000","last_became_peered":"2023-11-30T17:22:56.935988+0000","last_unstale":"2023-11-30T17:22:56.940802+0000","last_undegraded":"2023-11-30T17:22:56.940802+0000","last_fullsized":"2023-11-30T17:22:56.940802+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"97'3","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.932882+0000","last_change":"2023-11-30T17:22:56.539472+0000","last_active":"2023-11-30T17:22:56.932882+0000","last_peered":"2023-11-30T17:22:56.932882+0000","last_clean":"2023-11-30T17:22:56.932882+0000","last_became_active":"2023-11-30T17:22:56.539173+0000","last_became_peered":"2023-11-30T17:22:56.539173+0000","last_unstale":"2023-11-30T17:22:56.932882+0000","last_undegraded":"2023-11-30T17:22:56.932882+0000","last_fullsized":"2023-11-30T17:22:56.932882+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.941467+0000","last_change":"2023-11-30T17:22:56.939754+0000","last_active":"2023-11-30T17:22:56.941467+0000","last_peered":"2023-11-30T17:22:56.941467+0000","last_clean":"2023-11-30T17:22:56.941467+0000","last_became_active":"2023-11-30T17:22:56.939390+0000","last_became_peered":"2023-11-30T17:22:56.939390+0000","last_unstale":"2023-11-30T17:22:56.941467+0000","last_undegraded":"2023-11-30T17:22:56.941467+0000","last_fullsized":"2023-11-30T17:22:56.941467+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"97'2","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.943913+0000","last_change":"2023-11-30T17:22:56.553262+0000","last_active":"2023-11-30T17:22:56.943913+0000","last_peered":"2023-11-30T17:22:56.943913+0000","last_clean":"2023-11-30T17:22:56.943913+0000","last_became_active":"2023-11-30T17:22:56.553001+0000","last_became_peered":"2023-11-30T17:22:56.553001+0000","last_unstale":"2023-11-30T17:22:56.943913+0000","last_undegraded":"2023-11-30T17:22:56.943913+0000","last_fullsized":"2023-11-30T17:22:56.943913+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.939800+0000","last_change":"2023-11-30T17:22:56.934355+0000","last_active":"2023-11-30T17:22:56.939800+0000","last_peered":"2023-11-30T17:22:56.939800+0000","last_clean":"2023-11-30T17:22:56.939800+0000","last_became_active":"2023-11-30T17:22:56.934047+0000","last_became_peered":"2023-11-30T17:22:56.934047+0000","last_unstale":"2023-11-30T17:22:56.939800+0000","last_undegraded":"2023-11-30T17:22:56.939800+0000","last_fullsized":"2023-11-30T17:22:56.939800+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.938529+0000","last_change":"2023-11-30T17:22:56.550176+0000","last_active":"2023-11-30T17:22:56.938529+0000","last_peered":"2023-11-30T17:22:56.938529+0000","last_clean":"2023-11-30T17:22:56.938529+0000","last_became_active":"2023-11-30T17:22:56.549885+0000","last_became_peered":"2023-11-30T17:22:56.549885+0000","last_unstale":"2023-11-30T17:22:56.938529+0000","last_undegraded":"2023-11-30T17:22:56.938529+0000","last_fullsized":"2023-11-30T17:22:56.938529+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.943942+0000","last_change":"2023-11-30T17:22:56.937527+0000","last_active":"2023-11-30T17:22:56.943942+0000","last_peered":"2023-11-30T17:22:56.943942+0000","last_clean":"2023-11-30T17:22:56.943942+0000","last_became_active":"2023-11-30T17:22:56.933979+0000","last_became_peered":"2023-11-30T17:22:56.933979+0000","last_unstale":"2023-11-30T17:22:56.943942+0000","last_undegraded":"2023-11-30T17:22:56.943942+0000","last_fullsized":"2023-11-30T17:22:56.943942+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.926109+0000","last_change":"2023-11-30T17:22:56.550388+0000","last_active":"2023-11-30T17:22:56.926109+0000","last_peered":"2023-11-30T17:22:56.926109+0000","last_clean":"2023-11-30T17:22:56.926109+0000","last_became_active":"2023-11-30T17:22:56.550092+0000","last_became_peered":"2023-11-30T17:22:56.550092+0000","last_unstale":"2023-11-30T17:22:56.926109+0000","last_undegraded":"2023-11-30T17:22:56.926109+0000","last_fullsized":"2023-11-30T17:22:56.926109+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.948649+0000","last_change":"2023-11-30T17:22:56.943752+0000","last_active":"2023-11-30T17:22:56.948649+0000","last_peered":"2023-11-30T17:22:56.948649+0000","last_clean":"2023-11-30T17:22:56.948649+0000","last_became_active":"2023-11-30T17:22:56.943266+0000","last_became_peered":"2023-11-30T17:22:56.943266+0000","last_unstale":"2023-11-30T17:22:56.948649+0000","last_undegraded":"2023-11-30T17:22:56.948649+0000","last_fullsized":"2023-11-30T17:22:56.948649+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.921104+0000","last_change":"2023-11-30T17:22:56.541693+0000","last_active":"2023-11-30T17:22:56.921104+0000","last_peered":"2023-11-30T17:22:56.921104+0000","last_clean":"2023-11-30T17:22:56.921104+0000","last_became_active":"2023-11-30T17:22:56.540930+0000","last_became_peered":"2023-11-30T17:22:56.540930+0000","last_unstale":"2023-11-30T17:22:56.921104+0000","last_undegraded":"2023-11-30T17:22:56.921104+0000","last_fullsized":"2023-11-30T17:22:56.921104+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.943840+0000","last_change":"2023-11-30T17:22:56.936484+0000","last_active":"2023-11-30T17:22:56.943840+0000","last_peered":"2023-11-30T17:22:56.943840+0000","last_clean":"2023-11-30T17:22:56.943840+0000","last_became_active":"2023-11-30T17:22:56.936173+0000","last_became_peered":"2023-11-30T17:22:56.936173+0000","last_unstale":"2023-11-30T17:22:56.943840+0000","last_undegraded":"2023-11-30T17:22:56.943840+0000","last_fullsized":"2023-11-30T17:22:56.943840+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"97'4","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.944051+0000","last_change":"2023-11-30T17:22:56.545914+0000","last_active":"2023-11-30T17:22:56.944051+0000","last_peered":"2023-11-30T17:22:56.944051+0000","last_clean":"2023-11-30T17:22:56.944051+0000","last_became_active":"2023-11-30T17:22:56.545711+0000","last_became_peered":"2023-11-30T17:22:56.545711+0000","last_unstale":"2023-11-30T17:22:56.944051+0000","last_undegraded":"2023-11-30T17:22:56.944051+0000","last_fullsized":"2023-11-30T17:22:56.944051+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.942397+0000","last_change":"2023-11-30T17:22:56.938837+0000","last_active":"2023-11-30T17:22:56.942397+0000","last_peered":"2023-11-30T17:22:56.942397+0000","last_clean":"2023-11-30T17:22:56.942397+0000","last_became_active":"2023-11-30T17:22:56.938505+0000","last_became_peered":"2023-11-30T17:22:56.938505+0000","last_unstale":"2023-11-30T17:22:56.942397+0000","last_undegraded":"2023-11-30T17:22:56.942397+0000","last_fullsized":"2023-11-30T17:22:56.942397+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"97'2","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.937965+0000","last_change":"2023-11-30T17:22:56.541508+0000","last_active":"2023-11-30T17:22:56.937965+0000","last_peered":"2023-11-30T17:22:56.937965+0000","last_clean":"2023-11-30T17:22:56.937965+0000","last_became_active":"2023-11-30T17:22:56.541214+0000","last_became_peered":"2023-11-30T17:22:56.541214+0000","last_unstale":"2023-11-30T17:22:56.937965+0000","last_undegraded":"2023-11-30T17:22:56.937965+0000","last_fullsized":"2023-11-30T17:22:56.937965+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.943867+0000","last_change":"2023-11-30T17:22:56.936689+0000","last_active":"2023-11-30T17:22:56.943867+0000","last_peered":"2023-11-30T17:22:56.943867+0000","last_clean":"2023-11-30T17:22:56.943867+0000","last_became_active":"2023-11-30T17:22:56.933343+0000","last_became_peered":"2023-11-30T17:22:56.933343+0000","last_unstale":"2023-11-30T17:22:56.943867+0000","last_undegraded":"2023-11-30T17:22:56.943867+0000","last_fullsized":"2023-11-30T17:22:56.943867+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.918156+0000","last_change":"2023-11-30T17:22:56.543028+0000","last_active":"2023-11-30T17:22:56.918156+0000","last_peered":"2023-11-30T17:22:56.918156+0000","last_clean":"2023-11-30T17:22:56.918156+0000","last_became_active":"2023-11-30T17:22:56.542754+0000","last_became_peered":"2023-11-30T17:22:56.542754+0000","last_unstale":"2023-11-30T17:22:56.918156+0000","last_undegraded":"2023-11-30T17:22:56.918156+0000","last_fullsized":"2023-11-30T17:22:56.918156+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.938951+0000","last_change":"2023-11-30T17:22:56.932295+0000","last_active":"2023-11-30T17:22:56.938951+0000","last_peered":"2023-11-30T17:22:56.938951+0000","last_clean":"2023-11-30T17:22:56.938951+0000","last_became_active":"2023-11-30T17:22:56.932038+0000","last_became_peered":"2023-11-30T17:22:56.932038+0000","last_unstale":"2023-11-30T17:22:56.938951+0000","last_undegraded":"2023-11-30T17:22:56.938951+0000","last_fullsized":"2023-11-30T17:22:56.938951+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.927867+0000","last_change":"2023-11-30T17:22:56.551480+0000","last_active":"2023-11-30T17:22:56.927867+0000","last_peered":"2023-11-30T17:22:56.927867+0000","last_clean":"2023-11-30T17:22:56.927867+0000","last_became_active":"2023-11-30T17:22:56.551080+0000","last_became_peered":"2023-11-30T17:22:56.551080+0000","last_unstale":"2023-11-30T17:22:56.927867+0000","last_undegraded":"2023-11-30T17:22:56.927867+0000","last_fullsized":"2023-11-30T17:22:56.927867+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.938724+0000","last_change":"2023-11-30T17:22:56.931453+0000","last_active":"2023-11-30T17:22:56.938724+0000","last_peered":"2023-11-30T17:22:56.938724+0000","last_clean":"2023-11-30T17:22:56.938724+0000","last_became_active":"2023-11-30T17:22:56.931155+0000","last_became_peered":"2023-11-30T17:22:56.931155+0000","last_unstale":"2023-11-30T17:22:56.938724+0000","last_undegraded":"2023-11-30T17:22:56.938724+0000","last_fullsized":"2023-11-30T17:22:56.938724+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.927102+0000","last_change":"2023-11-30T17:22:56.548612+0000","last_active":"2023-11-30T17:22:56.927102+0000","last_peered":"2023-11-30T17:22:56.927102+0000","last_clean":"2023-11-30T17:22:56.927102+0000","last_became_active":"2023-11-30T17:22:56.548331+0000","last_became_peered":"2023-11-30T17:22:56.548331+0000","last_unstale":"2023-11-30T17:22:56.927102+0000","last_undegraded":"2023-11-30T17:22:56.927102+0000","last_fullsized":"2023-11-30T17:22:56.927102+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.948670+0000","last_change":"2023-11-30T17:22:56.944413+0000","last_active":"2023-11-30T17:22:56.948670+0000","last_peered":"2023-11-30T17:22:56.948670+0000","last_clean":"2023-11-30T17:22:56.948670+0000","last_became_active":"2023-11-30T17:22:56.944178+0000","last_became_peered":"2023-11-30T17:22:56.944178+0000","last_unstale":"2023-11-30T17:22:56.948670+0000","last_undegraded":"2023-11-30T17:22:56.948670+0000","last_fullsized":"2023-11-30T17:22:56.948670+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.925002+0000","last_change":"2023-11-30T17:22:56.545293+0000","last_active":"2023-11-30T17:22:56.925002+0000","last_peered":"2023-11-30T17:22:56.925002+0000","last_clean":"2023-11-30T17:22:56.925002+0000","last_became_active":"2023-11-30T17:22:56.544981+0000","last_became_peered":"2023-11-30T17:22:56.544981+0000","last_unstale":"2023-11-30T17:22:56.925002+0000","last_undegraded":"2023-11-30T17:22:56.925002+0000","last_fullsized":"2023-11-30T17:22:56.925002+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.943781+0000","last_change":"2023-11-30T17:22:56.934172+0000","last_active":"2023-11-30T17:22:56.943781+0000","last_peered":"2023-11-30T17:22:56.943781+0000","last_clean":"2023-11-30T17:22:56.943781+0000","last_became_active":"2023-11-30T17:22:56.932105+0000","last_became_peered":"2023-11-30T17:22:56.932105+0000","last_unstale":"2023-11-30T17:22:56.943781+0000","last_undegraded":"2023-11-30T17:22:56.943781+0000","last_fullsized":"2023-11-30T17:22:56.943781+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.923605+0000","last_change":"2023-11-30T17:22:56.542108+0000","last_active":"2023-11-30T17:22:56.923605+0000","last_peered":"2023-11-30T17:22:56.923605+0000","last_clean":"2023-11-30T17:22:56.923605+0000","last_became_active":"2023-11-30T17:22:56.541636+0000","last_became_peered":"2023-11-30T17:22:56.541636+0000","last_unstale":"2023-11-30T17:22:56.923605+0000","last_undegraded":"2023-11-30T17:22:56.923605+0000","last_fullsized":"2023-11-30T17:22:56.923605+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.941443+0000","last_change":"2023-11-30T17:22:56.939680+0000","last_active":"2023-11-30T17:22:56.941443+0000","last_peered":"2023-11-30T17:22:56.941443+0000","last_clean":"2023-11-30T17:22:56.941443+0000","last_became_active":"2023-11-30T17:22:56.939353+0000","last_became_peered":"2023-11-30T17:22:56.939353+0000","last_unstale":"2023-11-30T17:22:56.941443+0000","last_undegraded":"2023-11-30T17:22:56.941443+0000","last_fullsized":"2023-11-30T17:22:56.941443+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.925629+0000","last_change":"2023-11-30T17:22:56.546385+0000","last_active":"2023-11-30T17:22:56.925629+0000","last_peered":"2023-11-30T17:22:56.925629+0000","last_clean":"2023-11-30T17:22:56.925629+0000","last_became_active":"2023-11-30T17:22:56.546108+0000","last_became_peered":"2023-11-30T17:22:56.546108+0000","last_unstale":"2023-11-30T17:22:56.925629+0000","last_undegraded":"2023-11-30T17:22:56.925629+0000","last_fullsized":"2023-11-30T17:22:56.925629+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.942329+0000","last_change":"2023-11-30T17:22:56.941621+0000","last_active":"2023-11-30T17:22:56.942329+0000","last_peered":"2023-11-30T17:22:56.942329+0000","last_clean":"2023-11-30T17:22:56.942329+0000","last_became_active":"2023-11-30T17:22:56.941378+0000","last_became_peered":"2023-11-30T17:22:56.941378+0000","last_unstale":"2023-11-30T17:22:56.942329+0000","last_undegraded":"2023-11-30T17:22:56.942329+0000","last_fullsized":"2023-11-30T17:22:56.942329+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.921449+0000","last_change":"2023-11-30T17:22:56.544099+0000","last_active":"2023-11-30T17:22:56.921449+0000","last_peered":"2023-11-30T17:22:56.921449+0000","last_clean":"2023-11-30T17:22:56.921449+0000","last_became_active":"2023-11-30T17:22:56.543804+0000","last_became_peered":"2023-11-30T17:22:56.543804+0000","last_unstale":"2023-11-30T17:22:56.921449+0000","last_undegraded":"2023-11-30T17:22:56.921449+0000","last_fullsized":"2023-11-30T17:22:56.921449+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.940197+0000","last_change":"2023-11-30T17:22:56.936328+0000","last_active":"2023-11-30T17:22:56.940197+0000","last_peered":"2023-11-30T17:22:56.940197+0000","last_clean":"2023-11-30T17:22:56.940197+0000","last_became_active":"2023-11-30T17:22:56.936040+0000","last_became_peered":"2023-11-30T17:22:56.936040+0000","last_unstale":"2023-11-30T17:22:56.940197+0000","last_undegraded":"2023-11-30T17:22:56.940197+0000","last_fullsized":"2023-11-30T17:22:56.940197+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.922930+0000","last_change":"2023-11-30T17:22:56.550916+0000","last_active":"2023-11-30T17:22:56.922930+0000","last_peered":"2023-11-30T17:22:56.922930+0000","last_clean":"2023-11-30T17:22:56.922930+0000","last_became_active":"2023-11-30T17:22:56.550619+0000","last_became_peered":"2023-11-30T17:22:56.550619+0000","last_unstale":"2023-11-30T17:22:56.922930+0000","last_undegraded":"2023-11-30T17:22:56.922930+0000","last_fullsized":"2023-11-30T17:22:56.922930+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":77,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.923865+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:22:56.923865+0000","last_peered":"2023-11-30T17:22:56.923865+0000","last_clean":"2023-11-30T17:22:56.923865+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:22:56.923865+0000","last_undegraded":"2023-11-30T17:22:56.923865+0000","last_fullsized":"2023-11-30T17:22:56.923865+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.938700+0000","last_change":"2023-11-30T17:22:56.936389+0000","last_active":"2023-11-30T17:22:56.938700+0000","last_peered":"2023-11-30T17:22:56.938700+0000","last_clean":"2023-11-30T17:22:56.938700+0000","last_became_active":"2023-11-30T17:22:56.936082+0000","last_became_peered":"2023-11-30T17:22:56.936082+0000","last_unstale":"2023-11-30T17:22:56.938700+0000","last_undegraded":"2023-11-30T17:22:56.938700+0000","last_fullsized":"2023-11-30T17:22:56.938700+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.936344+0000","last_change":"2023-11-30T17:22:56.541398+0000","last_active":"2023-11-30T17:22:56.936344+0000","last_peered":"2023-11-30T17:22:56.936344+0000","last_clean":"2023-11-30T17:22:56.936344+0000","last_became_active":"2023-11-30T17:22:56.540729+0000","last_became_peered":"2023-11-30T17:22:56.540729+0000","last_unstale":"2023-11-30T17:22:56.936344+0000","last_undegraded":"2023-11-30T17:22:56.936344+0000","last_fullsized":"2023-11-30T17:22:56.936344+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":78,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.924466+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:22:56.924466+0000","last_peered":"2023-11-30T17:22:56.924466+0000","last_clean":"2023-11-30T17:22:56.924466+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:22:56.924466+0000","last_undegraded":"2023-11-30T17:22:56.924466+0000","last_fullsized":"2023-11-30T17:22:56.924466+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.943818+0000","last_change":"2023-11-30T17:22:56.935818+0000","last_active":"2023-11-30T17:22:56.943818+0000","last_peered":"2023-11-30T17:22:56.943818+0000","last_clean":"2023-11-30T17:22:56.943818+0000","last_became_active":"2023-11-30T17:22:56.934276+0000","last_became_peered":"2023-11-30T17:22:56.934276+0000","last_unstale":"2023-11-30T17:22:56.943818+0000","last_undegraded":"2023-11-30T17:22:56.943818+0000","last_fullsized":"2023-11-30T17:22:56.943818+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.924401+0000","last_change":"2023-11-30T17:22:56.546134+0000","last_active":"2023-11-30T17:22:56.924401+0000","last_peered":"2023-11-30T17:22:56.924401+0000","last_clean":"2023-11-30T17:22:56.924401+0000","last_became_active":"2023-11-30T17:22:56.545678+0000","last_became_peered":"2023-11-30T17:22:56.545678+0000","last_unstale":"2023-11-30T17:22:56.924401+0000","last_undegraded":"2023-11-30T17:22:56.924401+0000","last_fullsized":"2023-11-30T17:22:56.924401+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":83,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.921181+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:22:56.921181+0000","last_peered":"2023-11-30T17:22:56.921181+0000","last_clean":"2023-11-30T17:22:56.921181+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:22:56.921181+0000","last_undegraded":"2023-11-30T17:22:56.921181+0000","last_fullsized":"2023-11-30T17:22:56.921181+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.948592+0000","last_change":"2023-11-30T17:22:56.943583+0000","last_active":"2023-11-30T17:22:56.948592+0000","last_peered":"2023-11-30T17:22:56.948592+0000","last_clean":"2023-11-30T17:22:56.948592+0000","last_became_active":"2023-11-30T17:22:56.942014+0000","last_became_peered":"2023-11-30T17:22:56.942014+0000","last_unstale":"2023-11-30T17:22:56.948592+0000","last_undegraded":"2023-11-30T17:22:56.948592+0000","last_fullsized":"2023-11-30T17:22:56.948592+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.921778+0000","last_change":"2023-11-30T17:22:56.549062+0000","last_active":"2023-11-30T17:22:56.921778+0000","last_peered":"2023-11-30T17:22:56.921778+0000","last_clean":"2023-11-30T17:22:56.921778+0000","last_became_active":"2023-11-30T17:22:56.548775+0000","last_became_peered":"2023-11-30T17:22:56.548775+0000","last_unstale":"2023-11-30T17:22:56.921778+0000","last_undegraded":"2023-11-30T17:22:56.921778+0000","last_fullsized":"2023-11-30T17:22:56.921778+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":78,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.926835+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:22:56.926835+0000","last_peered":"2023-11-30T17:22:56.926835+0000","last_clean":"2023-11-30T17:22:56.926835+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:22:56.926835+0000","last_undegraded":"2023-11-30T17:22:56.926835+0000","last_fullsized":"2023-11-30T17:22:56.926835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":81,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.926465+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:22:56.926465+0000","last_peered":"2023-11-30T17:22:56.926465+0000","last_clean":"2023-11-30T17:22:56.926465+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:22:56.926465+0000","last_undegraded":"2023-11-30T17:22:56.926465+0000","last_fullsized":"2023-11-30T17:22:56.926465+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.938562+0000","last_change":"2023-11-30T17:22:56.931013+0000","last_active":"2023-11-30T17:22:56.938562+0000","last_peered":"2023-11-30T17:22:56.938562+0000","last_clean":"2023-11-30T17:22:56.938562+0000","last_became_active":"2023-11-30T17:22:56.930742+0000","last_became_peered":"2023-11-30T17:22:56.930742+0000","last_unstale":"2023-11-30T17:22:56.938562+0000","last_undegraded":"2023-11-30T17:22:56.938562+0000","last_fullsized":"2023-11-30T17:22:56.938562+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.921458+0000","last_change":"2023-11-30T17:22:56.549222+0000","last_active":"2023-11-30T17:22:56.921458+0000","last_peered":"2023-11-30T17:22:56.921458+0000","last_clean":"2023-11-30T17:22:56.921458+0000","last_became_active":"2023-11-30T17:22:56.548758+0000","last_became_peered":"2023-11-30T17:22:56.548758+0000","last_unstale":"2023-11-30T17:22:56.921458+0000","last_undegraded":"2023-11-30T17:22:56.921458+0000","last_fullsized":"2023-11-30T17:22:56.921458+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":79,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.926618+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:22:56.926618+0000","last_peered":"2023-11-30T17:22:56.926618+0000","last_clean":"2023-11-30T17:22:56.926618+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:22:56.926618+0000","last_undegraded":"2023-11-30T17:22:56.926618+0000","last_fullsized":"2023-11-30T17:22:56.926618+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.938010+0000","last_change":"2023-11-30T17:22:56.933147+0000","last_active":"2023-11-30T17:22:56.938010+0000","last_peered":"2023-11-30T17:22:56.938010+0000","last_clean":"2023-11-30T17:22:56.938010+0000","last_became_active":"2023-11-30T17:22:56.932818+0000","last_became_peered":"2023-11-30T17:22:56.932818+0000","last_unstale":"2023-11-30T17:22:56.938010+0000","last_undegraded":"2023-11-30T17:22:56.938010+0000","last_fullsized":"2023-11-30T17:22:56.938010+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.923785+0000","last_change":"2023-11-30T17:22:56.543635+0000","last_active":"2023-11-30T17:22:56.923785+0000","last_peered":"2023-11-30T17:22:56.923785+0000","last_clean":"2023-11-30T17:22:56.923785+0000","last_became_active":"2023-11-30T17:22:56.543307+0000","last_became_peered":"2023-11-30T17:22:56.543307+0000","last_unstale":"2023-11-30T17:22:56.923785+0000","last_undegraded":"2023-11-30T17:22:56.923785+0000","last_fullsized":"2023-11-30T17:22:56.923785+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":79,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.927958+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:22:56.927958+0000","last_peered":"2023-11-30T17:22:56.927958+0000","last_clean":"2023-11-30T17:22:56.927958+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:22:56.927958+0000","last_undegraded":"2023-11-30T17:22:56.927958+0000","last_fullsized":"2023-11-30T17:22:56.927958+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.934996+0000","last_change":"2023-11-30T17:22:56.930682+0000","last_active":"2023-11-30T17:22:56.934996+0000","last_peered":"2023-11-30T17:22:56.934996+0000","last_clean":"2023-11-30T17:22:56.934996+0000","last_became_active":"2023-11-30T17:22:56.930412+0000","last_became_peered":"2023-11-30T17:22:56.930412+0000","last_unstale":"2023-11-30T17:22:56.934996+0000","last_undegraded":"2023-11-30T17:22:56.934996+0000","last_fullsized":"2023-11-30T17:22:56.934996+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.945897+0000","last_change":"2023-11-30T17:22:56.547016+0000","last_active":"2023-11-30T17:22:56.945897+0000","last_peered":"2023-11-30T17:22:56.945897+0000","last_clean":"2023-11-30T17:22:56.945897+0000","last_became_active":"2023-11-30T17:22:56.546737+0000","last_became_peered":"2023-11-30T17:22:56.546737+0000","last_unstale":"2023-11-30T17:22:56.945897+0000","last_undegraded":"2023-11-30T17:22:56.945897+0000","last_fullsized":"2023-11-30T17:22:56.945897+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":77,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.921026+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:22:56.921026+0000","last_peered":"2023-11-30T17:22:56.921026+0000","last_clean":"2023-11-30T17:22:56.921026+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:22:56.921026+0000","last_undegraded":"2023-11-30T17:22:56.921026+0000","last_fullsized":"2023-11-30T17:22:56.921026+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.940808+0000","last_change":"2023-11-30T17:22:56.938662+0000","last_active":"2023-11-30T17:22:56.940808+0000","last_peered":"2023-11-30T17:22:56.940808+0000","last_clean":"2023-11-30T17:22:56.940808+0000","last_became_active":"2023-11-30T17:22:56.938370+0000","last_became_peered":"2023-11-30T17:22:56.938370+0000","last_unstale":"2023-11-30T17:22:56.940808+0000","last_undegraded":"2023-11-30T17:22:56.940808+0000","last_fullsized":"2023-11-30T17:22:56.940808+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:56.516935+0000","last_clean_scrub_stamp":"2023-11-30T17:22:56.516935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"97'2","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.943715+0000","last_change":"2023-11-30T17:22:56.554941+0000","last_active":"2023-11-30T17:22:56.943715+0000","last_peered":"2023-11-30T17:22:56.943715+0000","last_clean":"2023-11-30T17:22:56.943715+0000","last_became_active":"2023-11-30T17:22:56.554543+0000","last_became_peered":"2023-11-30T17:22:56.554543+0000","last_unstale":"2023-11-30T17:22:56.943715+0000","last_undegraded":"2023-11-30T17:22:56.943715+0000","last_fullsized":"2023-11-30T17:22:56.943715+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:22:55.515154+0000","last_clean_scrub_stamp":"2023-11-30T17:22:55.515154+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":86,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-11-30T17:22:56.937689+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:22:56.937689+0000","last_peered":"2023-11-30T17:22:56.937689+0000","last_clean":"2023-11-30T17:22:56.937689+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:22:56.937689+0000","last_undegraded":"2023-11-30T17:22:56.937689+0000","last_fullsized":"2023-11-30T17:22:56.937689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575037,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298272,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073568,"statfs":{"total":96636764160,"available":96331333632,"internally_reserved":0,"allocated":1204224,"data_stored":599109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.371,"5min":0.315,"15min":0.23899999999999999},"max":{"1min":0.72399999999999998,"5min":0.80400000000000005,"15min":0.81100000000000005},"last":0.621},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57499999999999996,"15min":0.58199999999999996},"min":{"1min":0.41099999999999998,"5min":0.40699999999999997,"15min":0.32200000000000001},"max":{"1min":0.74099999999999999,"5min":0.78300000000000003,"15min":0.81899999999999995},"last":0.42799999999999999}]},{"osd":1,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70899999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.32900000000000001,"5min":0.29899999999999999,"15min":0.28799999999999998},"max":{"1min":0.64000000000000001,"5min":0.76100000000000001,"15min":0.82499999999999996},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53800000000000003,"15min":0.54900000000000004},"min":{"1min":0.37,"5min":0.33500000000000002,"15min":0.32800000000000001},"max":{"1min":0.68200000000000005,"5min":0.77000000000000002,"15min":0.78300000000000003},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.38800000000000001,"5min":0.35399999999999998,"15min":0.28699999999999998},"max":{"1min":0.70499999999999996,"5min":0.73799999999999999,"15min":0.83899999999999997},"last":0.55800000000000005}]},{"osd":3,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.53400000000000003,"15min":0.54100000000000004},"min":{"1min":0.378,"5min":0.36499999999999999,"15min":0.33200000000000002},"max":{"1min":0.65700000000000003,"5min":0.754,"15min":0.78000000000000003},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56999999999999995,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.40799999999999997,"15min":0.33900000000000002},"max":{"1min":0.67500000000000004,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44600000000000001,"15min":0.45800000000000002},"min":{"1min":0.32400000000000001,"5min":0.313,"15min":0.29699999999999999},"max":{"1min":0.55000000000000004,"5min":0.77000000000000002,"15min":0.79900000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.30099999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59899999999999998,"5min":0.75800000000000001,"15min":1.3180000000000001},"last":0.40799999999999997}]},{"osd":5,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.48399999999999999,"15min":0.49099999999999999},"min":{"1min":0.317,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58699999999999997,"5min":0.80000000000000004,"15min":0.82899999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.61199999999999999,"5min":0.79300000000000004,"15min":0.872},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.69699999999999995,"5min":0.81200000000000006,"15min":0.85199999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.33700000000000002},"max":{"1min":0.67300000000000004,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.47499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575036,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302372,"kb_used_data":1180,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069468,"statfs":{"total":96636764160,"available":96327135232,"internally_reserved":0,"allocated":1208320,"data_stored":599247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.57099999999999995},"min":{"1min":0.38100000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72899999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56499999999999995,"15min":0.58699999999999997},"min":{"1min":0.46300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.748,"5min":0.79600000000000004,"15min":0.89300000000000002},"last":0.61199999999999999}]},{"osd":1,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54600000000000004,"15min":0.56399999999999995},"min":{"1min":0.32800000000000001,"5min":0.30599999999999999,"15min":0.26400000000000001},"max":{"1min":0.75800000000000001,"5min":0.76900000000000002,"15min":0.82799999999999996},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58199999999999996,"15min":0.59899999999999998},"min":{"1min":0.45100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.751,"5min":0.82499999999999996,"15min":0.85199999999999998},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56000000000000005,"15min":0.57299999999999995},"min":{"1min":0.371,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.77500000000000002,"5min":0.79900000000000004,"15min":0.82599999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.40699999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76100000000000001,"5min":0.80900000000000005,"15min":0.82499999999999996},"last":0.47499999999999998}]},{"osd":3,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51100000000000001,"15min":0.53200000000000003},"min":{"1min":0.40400000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71899999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73499999999999999,"5min":0.75600000000000001,"15min":0.79600000000000004},"last":0.498}]},{"osd":4,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44600000000000001,"15min":0.45300000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.84199999999999997},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46100000000000002,"15min":0.47799999999999998},"min":{"1min":0.34999999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.746,"5min":0.76000000000000001,"15min":0.83899999999999997},"last":0.32500000000000001}]},{"osd":5,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.45900000000000002,"15min":0.47199999999999998},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.28299999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.38},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.496,"15min":0.50700000000000001},"min":{"1min":0.38400000000000001,"5min":0.33500000000000002,"15min":0.31900000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.39300000000000002}]},{"osd":7,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.34499999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.74199999999999999,"5min":0.80700000000000005,"15min":0.93200000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55100000000000005,"15min":0.56299999999999994},"min":{"1min":0.43099999999999999,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.86499999999999999},"last":0.42099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575036,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302376,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069464,"statfs":{"total":96636764160,"available":96327131136,"internally_reserved":0,"allocated":1212416,"data_stored":599607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.378,"15min":0.35999999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23000000000000001},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.48699999999999999,"15min":0.47199999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.309},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.38900000000000001},"min":{"1min":0.249,"5min":0.215,"15min":0.215},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.502},"min":{"1min":0.36499999999999999,"5min":0.33400000000000002,"15min":0.29499999999999998},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.39600000000000002}]},{"osd":3,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.46600000000000003,"15min":0.45200000000000001},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.23899999999999999},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.44800000000000001,"15min":0.435},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.307}]},{"osd":4,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.35499999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.83499999999999996,"5min":0.88500000000000001,"15min":0.89100000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.61899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.39900000000000002},"max":{"1min":0.85099999999999998,"5min":0.97599999999999998,"15min":1.111},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.46500000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.39600000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.91300000000000003},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.64800000000000002,"15min":0.65900000000000003},"min":{"1min":0.46500000000000002,"5min":0.39700000000000002,"15min":0.39600000000000002},"max":{"1min":0.91000000000000003,"5min":0.92700000000000005,"15min":1.0600000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66100000000000003,"15min":0.66500000000000004},"min":{"1min":0.437,"5min":0.433,"15min":0.379},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.629},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.39900000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.94199999999999995},"last":0.52500000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575036,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302360,"kb_used_data":1168,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069480,"statfs":{"total":96636764160,"available":96327147520,"internally_reserved":0,"allocated":1196032,"data_stored":598533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.375,"15min":0.36499999999999999},"min":{"1min":0.23200000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.51700000000000002,"5min":0.59999999999999998,"15min":0.71199999999999997},"last":0.498},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38700000000000001,"15min":0.38400000000000001},"min":{"1min":0.26100000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.54400000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.38700000000000001,"15min":0.38400000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.23899999999999999},"max":{"1min":0.55900000000000005,"5min":0.623,"15min":0.623},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.313,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.54600000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.57099999999999995}]},{"osd":3,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.42499999999999999,"15min":0.42799999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.60799999999999998,"5min":0.66100000000000003,"15min":0.70999999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.438,"15min":0.439},"min":{"1min":0.27300000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.52800000000000002,"5min":0.64700000000000002,"15min":0.68799999999999994},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.42899999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78800000000000003,"5min":0.83999999999999997,"15min":0.96099999999999997},"last":0.624},{"interface":"front","average":{"1min":0.629,"5min":0.622,"15min":0.621},"min":{"1min":0.44,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.98599999999999999},"last":0.76400000000000001}]},{"osd":5,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.44400000000000001,"5min":0.39200000000000002,"15min":0.36199999999999999},"max":{"1min":0.86799999999999999,"5min":0.92400000000000004,"15min":1.0109999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.628,"15min":0.629},"min":{"1min":0.45000000000000001,"5min":0.38400000000000001,"15min":0.38},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":1.004},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.64500000000000002,"15min":0.64400000000000002},"min":{"1min":0.47799999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.88,"5min":1.002,"15min":1.002},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63400000000000001,"15min":0.63200000000000001},"min":{"1min":0.46999999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89300000000000002,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Nov 30 17:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66000000000000003,"15min":0.65200000000000002},"min":{"1min":0.48199999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86099999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69199999999999995,"15min":0.68799999999999994},"min":{"1min":0.54000000000000004,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92700000000000005,"5min":0.97699999999999998,"15min":1.026},"last":0.73099999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575036,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306468,"kb_used_data":1180,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065372,"statfs":{"total":96636764160,"available":96322940928,"internally_reserved":0,"allocated":1208320,"data_stored":600069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.42699999999999999,"15min":0.40200000000000002},"min":{"1min":0.27700000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":3.4729999999999999,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.44700000000000001,"15min":0.437},"min":{"1min":0.312,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":0.34100000000000003}]},{"osd":1,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.51300000000000001,"15min":0.46300000000000002},"min":{"1min":0.28699999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":6.1210000000000004,"5min":6.1210000000000004,"15min":6.1210000000000004},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.52900000000000003,"15min":0.48899999999999999},"min":{"1min":0.34999999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":5.7270000000000003,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.376}]},{"osd":3,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38600000000000001,"15min":0.40000000000000002},"min":{"1min":0.27800000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.48799999999999999,"5min":0.63500000000000001,"15min":0.86199999999999999},"last":0.317},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47299999999999998,"15min":0.46700000000000003},"min":{"1min":0.29699999999999999,"5min":0.26900000000000002,"15min":0.26200000000000001},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.69699999999999995,"15min":0.64200000000000002},"min":{"1min":0.432,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":8.7170000000000005,"5min":8.7170000000000005,"15min":8.7170000000000005},"last":0.504},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.381,"5min":1.492,"15min":1.492},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.65600000000000003,"15min":0.63900000000000001},"min":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.44400000000000001,"5min":0.38900000000000001,"15min":0.38100000000000001},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61399999999999999,"15min":0.623},"min":{"1min":0.40899999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95999999999999996,"5min":1.359,"15min":1.359},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.70699999999999996,"15min":0.68300000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.40300000000000002},"max":{"1min":4.6849999999999996,"5min":4.6849999999999996,"15min":4.6849999999999996},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.70099999999999996,"15min":0.69099999999999995},"min":{"1min":0.45700000000000002,"5min":0.433,"15min":0.41499999999999998},"max":{"1min":4.5039999999999996,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.56499999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575036,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306456,"kb_used_data":1168,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065384,"statfs":{"total":96636764160,"available":96322953216,"internally_reserved":0,"allocated":1196032,"data_stored":598533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.34799999999999998,"15min":0.36399999999999999},"min":{"1min":0.222,"5min":0.219,"15min":0.217},"max":{"1min":0.46600000000000003,"5min":0.56599999999999995,"15min":0.66200000000000003},"last":0.254},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.39500000000000002,"15min":0.40200000000000002},"min":{"1min":0.26700000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.48699999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.37,"15min":0.38600000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.51500000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.40999999999999998,"15min":0.42999999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.25900000000000001},"max":{"1min":0.59699999999999998,"5min":0.65900000000000003,"15min":0.84399999999999997},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.435,"15min":0.45000000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.26000000000000001},"max":{"1min":0.61799999999999999,"5min":0.72999999999999998,"15min":0.94899999999999995},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.49399999999999999,"15min":0.50900000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67100000000000004,"5min":1.054,"15min":1.054},"last":0.35999999999999999}]},{"osd":4,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58699999999999997,"15min":0.60599999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.755,"5min":0.91500000000000004,"15min":0.97599999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59599999999999997,"15min":0.61299999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.70399999999999996,"5min":0.86799999999999999,"15min":0.91400000000000003},"last":0.63500000000000001}]},{"osd":5,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.58099999999999996,"15min":0.60999999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80200000000000005,"5min":0.85399999999999998,"15min":0.98399999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61899999999999999,"15min":0.63800000000000001},"min":{"1min":0.372,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77300000000000002,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.65900000000000003}]},{"osd":6,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61799999999999999,"15min":0.64400000000000002},"min":{"1min":0.39800000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79900000000000004,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.496},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.626,"15min":0.64700000000000002},"min":{"1min":0.45000000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78900000000000003,"5min":0.89500000000000002,"15min":1.0389999999999999},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.64000000000000001,"15min":0.66200000000000003},"min":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.39100000000000001},"max":{"1min":0.80200000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63700000000000001,"15min":0.66100000000000003},"min":{"1min":0.45800000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79000000000000004,"5min":0.98999999999999999,"15min":1.004},"last":0.58199999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575036,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302372,"kb_used_data":1180,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069468,"statfs":{"total":96636764160,"available":96327135232,"internally_reserved":0,"allocated":1208320,"data_stored":599211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.53100000000000003},"min":{"1min":0.32200000000000001,"5min":0.28299999999999997,"15min":0.27500000000000002},"max":{"1min":0.72299999999999998,"5min":0.752,"15min":0.80900000000000005},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.38900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.66500000000000004,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52100000000000002,"15min":0.54200000000000004},"min":{"1min":0.35699999999999998,"5min":0.26900000000000002,"15min":0.25800000000000001},"max":{"1min":0.67600000000000005,"5min":0.73799999999999999,"15min":0.79600000000000004},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.41899999999999998,"5min":0.317,"15min":0.246},"max":{"1min":0.67800000000000005,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56100000000000005,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.376,"15min":0.27800000000000002},"max":{"1min":0.73799999999999999,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.624},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.59399999999999997},"min":{"1min":0.373,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77300000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.64700000000000002}]},{"osd":3,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.54800000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32900000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55600000000000005,"15min":0.57099999999999995},"min":{"1min":0.438,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.80600000000000005},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.44600000000000001,"15min":0.443},"min":{"1min":0.35299999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.73599999999999999,"5min":1.272,"15min":1.272},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.46700000000000003,"15min":0.46000000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29199999999999998},"max":{"1min":0.83399999999999996,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.67600000000000005}]},{"osd":6,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51200000000000001,"15min":0.503},"min":{"1min":0.34699999999999998,"5min":0.34399999999999997,"15min":0.314},"max":{"1min":0.997,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55500000000000005,"15min":0.53900000000000003},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.33800000000000002},"max":{"1min":0.86499999999999999,"5min":1.129,"15min":1.129},"last":0.70299999999999996}]},{"osd":7,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.29899999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.82199999999999995},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57699999999999996,"15min":0.57099999999999995},"min":{"1min":0.45400000000000001,"5min":0.38600000000000001,"15min":0.34599999999999997},"max":{"1min":0.91500000000000004,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.71299999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575036,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302364,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069476,"statfs":{"total":96636764160,"available":96327143424,"internally_reserved":0,"allocated":1200128,"data_stored":598567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68500000000000005,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52400000000000002,"15min":0.53100000000000003},"min":{"1min":0.36599999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.69299999999999995,"5min":0.70299999999999996,"15min":0.81799999999999995},"last":0.443}]},{"osd":1,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.38400000000000001,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.72399999999999998},"last":0.623},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53300000000000003,"15min":0.54800000000000004},"min":{"1min":0.36799999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.77000000000000002},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58199999999999996,"15min":0.58899999999999997},"min":{"1min":0.44800000000000001,"5min":0.34399999999999997,"15min":0.30599999999999999},"max":{"1min":0.72499999999999998,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.437,"5min":0.378,"15min":0.34499999999999997},"max":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53700000000000003,"15min":0.54800000000000004},"min":{"1min":0.40799999999999997,"5min":0.36699999999999999,"15min":0.36399999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.73799999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55400000000000005,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.82099999999999995},"last":0.52200000000000002}]},{"osd":4,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.41999999999999998,"15min":0.439},"min":{"1min":0.28299999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.66700000000000004,"5min":0.72299999999999998,"15min":0.74299999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.45800000000000002,"15min":0.46600000000000003},"min":{"1min":0.30599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.628,"5min":0.69499999999999995,"15min":0.77600000000000002},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.47399999999999998,"15min":0.48599999999999999},"min":{"1min":0.32200000000000001,"5min":0.29599999999999999,"15min":0.28499999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.82099999999999995},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54100000000000004,"15min":0.55000000000000004},"min":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.69699999999999995,"5min":0.79900000000000004,"15min":0.88200000000000001},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51700000000000002,"15min":0.52600000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.64900000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55900000000000005,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.84599999999999997},"last":0.61499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:23:05.797 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-30T17:23:05.798 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-30T17:23:05.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.954+0000 7fd0fe3a9700 1 Processor -- start 2023-11-30T17:23:05.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.954+0000 7fd0fe3a9700 1 -- start start 2023-11-30T17:23:05.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.955+0000 7fd0fe3a9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0f8098d10 0x7fd0f80c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:05.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.955+0000 7fd0fe3a9700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd0f80c6190 0x7fd0f8063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:05.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.955+0000 7fd0fe3a9700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0f80c72d0 con 0x7fd0f8064350 2023-11-30T17:23:05.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.955+0000 7fd0fe3a9700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0f8154bc0 con 0x7fd0f80c6190 2023-11-30T17:23:05.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.955+0000 7fd0fe3a9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f80c66c0 con 0x7fd0f8098d10 2023-11-30T17:23:05.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.955+0000 7fd0fc946700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd0f8064350 0x7fd0f8158320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39090/0 (socket says 172.21.15.49:39090) 2023-11-30T17:23:05.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.955+0000 7fd0fc946700 1 -- 172.21.15.49:0/1936615095 learned_addr learned my addr 172.21.15.49:0/1936615095 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:05.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.955+0000 7fd0f7fff700 1 --2- 172.21.15.49:0/1936615095 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0f8098d10 0x7fd0f80c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:05.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.955+0000 7fd0f77fe700 1 --2- 172.21.15.49:0/1936615095 >> v2:172.21.15.115:3300/0 conn(0x7fd0f80c6190 0x7fd0f8063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:05.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.956+0000 7fd0f6ffd700 1 -- 172.21.15.49:0/1936615095 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369968396 0 0) 0x7fd0f80c72d0 con 0x7fd0f8064350 2023-11-30T17:23:05.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.956+0000 7fd0f6ffd700 1 -- 172.21.15.49:0/1936615095 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0e00033f0 con 0x7fd0f8064350 2023-11-30T17:23:05.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.956+0000 7fd0f7fff700 1 -- 172.21.15.49:0/1936615095 >> v2:172.21.15.115:3300/0 conn(0x7fd0f80c6190 msgr2=0x7fd0f8063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:05.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.956+0000 7fd0f7fff700 1 --2- 172.21.15.49:0/1936615095 >> v2:172.21.15.115:3300/0 conn(0x7fd0f80c6190 0x7fd0f8063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:05.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.956+0000 7fd0f7fff700 1 -- 172.21.15.49:0/1936615095 >> v1:172.21.15.49:6789/0 conn(0x7fd0f8064350 legacy=0x7fd0f8158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:05.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.956+0000 7fd0f6ffd700 1 -- 172.21.15.49:0/1936615095 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3448071975 0 0) 0x7fd0e00033f0 con 0x7fd0f8064350 2023-11-30T17:23:05.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.956+0000 7fd0f7fff700 1 -- 172.21.15.49:0/1936615095 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f80c69a0 con 0x7fd0f8098d10 2023-11-30T17:23:05.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.956+0000 7fd0f7fff700 1 --2- 172.21.15.49:0/1936615095 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0f8098d10 0x7fd0f80c7760 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fd0e8009760 tx=0x7fd0e8009060).ready entity=mon.2 client_cookie=1cc3d07c844a58a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:05.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.956+0000 7fd0f6ffd700 1 -- 172.21.15.49:0/1936615095 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f00017f0 con 0x7fd0f8098d10 2023-11-30T17:23:05.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.956+0000 7fd0f6ffd700 1 -- 172.21.15.49:0/1936615095 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e8011400 con 0x7fd0f8098d10 2023-11-30T17:23:05.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.956+0000 7fd0f6ffd700 1 -- 172.21.15.49:0/1936615095 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e8011780 con 0x7fd0f8098d10 2023-11-30T17:23:05.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.957+0000 7fd0fe3a9700 1 -- 172.21.15.49:0/1936615095 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0f8098d10 msgr2=0x7fd0f80c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:05.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.957+0000 7fd0fe3a9700 1 --2- 172.21.15.49:0/1936615095 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0f8098d10 0x7fd0f80c7760 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fd0e8009760 tx=0x7fd0e8009060).stop 2023-11-30T17:23:05.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.957+0000 7fd0fe3a9700 1 -- 172.21.15.49:0/1936615095 shutdown_connections 2023-11-30T17:23:05.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.957+0000 7fd0fe3a9700 1 --2- 172.21.15.49:0/1936615095 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0f8098d10 0x7fd0f80c7760 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:05.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.957+0000 7fd0fe3a9700 1 --2- 172.21.15.49:0/1936615095 >> v2:172.21.15.115:3300/0 conn(0x7fd0f80c6190 0x7fd0f8063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:05.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.957+0000 7fd0fe3a9700 1 -- 172.21.15.49:0/1936615095 >> 172.21.15.49:0/1936615095 conn(0x7fd0f80cb310 msgr2=0x7fd0f80cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:05.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.957+0000 7fd0fe3a9700 1 -- 172.21.15.49:0/1936615095 shutdown_connections 2023-11-30T17:23:05.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.957+0000 7fd0fe3a9700 1 -- 172.21.15.49:0/1936615095 wait complete. 2023-11-30T17:23:05.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.958+0000 7fd0fe3a9700 1 Processor -- start 2023-11-30T17:23:05.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.958+0000 7fd0fe3a9700 1 -- start start 2023-11-30T17:23:05.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.959+0000 7fd0fe3a9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0f8064350 0x7fd0f80ad330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:05.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.959+0000 7fd0fe3a9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0f8098d10 0x7fd0f80aad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:05.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.959+0000 7fd0fe3a9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0f80c6190 0x7fd0f80a8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:05.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.959+0000 7fd0fe3a9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f80a89c0 con 0x7fd0f80c6190 2023-11-30T17:23:05.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.959+0000 7fd0fe3a9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f80a8390 con 0x7fd0f8064350 2023-11-30T17:23:05.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.959+0000 7fd0fe3a9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f80ad910 con 0x7fd0f8098d10 2023-11-30T17:23:05.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.959+0000 7fd0fc946700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0f80c6190 0x7fd0f80a8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:05.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.959+0000 7fd0f77fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0f8098d10 0x7fd0f80aad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:05.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.959+0000 7fd0f7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0f8064350 0x7fd0f80ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:05.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.959+0000 7fd0fc946700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0f80c6190 0x7fd0f80a8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37838/0 (socket says 172.21.15.49:37838) 2023-11-30T17:23:05.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.959+0000 7fd0fc946700 1 -- 172.21.15.49:0/3298540525 learned_addr learned my addr 172.21.15.49:0/3298540525 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:05.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.959+0000 7fd0fc946700 1 -- 172.21.15.49:0/3298540525 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0f8098d10 msgr2=0x7fd0f80aad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:05.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.959+0000 7fd0fc946700 1 --2- 172.21.15.49:0/3298540525 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0f8098d10 0x7fd0f80aad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:05.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.959+0000 7fd0fc946700 1 -- 172.21.15.49:0/3298540525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0f8064350 msgr2=0x7fd0f80ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:05.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.959+0000 7fd0fc946700 1 --2- 172.21.15.49:0/3298540525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0f8064350 0x7fd0f80ad330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:05.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.959+0000 7fd0fc946700 1 -- 172.21.15.49:0/3298540525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e80092a0 con 0x7fd0f80c6190 2023-11-30T17:23:05.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.959+0000 7fd0f77fe700 1 --2- 172.21.15.49:0/3298540525 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0f8098d10 0x7fd0f80aad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:23:05.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.959+0000 7fd0fc946700 1 --2- 172.21.15.49:0/3298540525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0f80c6190 0x7fd0f80a8e50 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7fd0f000cb40 tx=0x7fd0f0001e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:05.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.959+0000 7fd0dffff700 1 -- 172.21.15.49:0/3298540525 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0004c40 con 0x7fd0f80c6190 2023-11-30T17:23:05.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.959+0000 7fd0dffff700 1 -- 172.21.15.49:0/3298540525 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f0004da0 con 0x7fd0f80c6190 2023-11-30T17:23:05.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.959+0000 7fd0fe3a9700 1 -- 172.21.15.49:0/3298540525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0f80adbf0 con 0x7fd0f80c6190 2023-11-30T17:23:05.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.959+0000 7fd0dffff700 1 -- 172.21.15.49:0/3298540525 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0007380 con 0x7fd0f80c6190 2023-11-30T17:23:05.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.960+0000 7fd0fe3a9700 1 -- 172.21.15.49:0/3298540525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0f8156f00 con 0x7fd0f80c6190 2023-11-30T17:23:05.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.960+0000 7fd0fe3a9700 1 -- 172.21.15.49:0/3298540525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0f80a8b70 con 0x7fd0f80c6190 2023-11-30T17:23:05.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.961+0000 7fd0dffff700 1 -- 172.21.15.49:0/3298540525 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fd0f0007770 con 0x7fd0f80c6190 2023-11-30T17:23:05.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.961+0000 7fd0dffff700 1 --2- 172.21.15.49:0/3298540525 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd0e405f270 0x7fd0e4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:05.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.961+0000 7fd0dffff700 1 -- 172.21.15.49:0/3298540525 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fd0f007a170 con 0x7fd0f80c6190 2023-11-30T17:23:05.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.961+0000 7fd0f7fff700 1 --2- 172.21.15.49:0/3298540525 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd0e405f270 0x7fd0e4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:05.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.962+0000 7fd0f7fff700 1 --2- 172.21.15.49:0/3298540525 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd0e405f270 0x7fd0e4061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fd0e8009760 tx=0x7fd0e8016000).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:05.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:05.965+0000 7fd0dffff700 1 -- 172.21.15.49:0/3298540525 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd0f004b2a0 con 0x7fd0f80c6190 2023-11-30T17:23:06.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.206+0000 7fd0fe3a9700 1 -- 172.21.15.49:0/3298540525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd0f806c860 con 0x7fd0f80c6190 2023-11-30T17:23:06.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.209+0000 7fd0dffff700 1 -- 172.21.15.49:0/3298540525 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7fd0f004e8c0 con 0x7fd0f80c6190 2023-11-30T17:23:06.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.211+0000 7fd0fe3a9700 1 -- 172.21.15.49:0/3298540525 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd0e405f270 msgr2=0x7fd0e4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:06.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.211+0000 7fd0fe3a9700 1 --2- 172.21.15.49:0/3298540525 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd0e405f270 0x7fd0e4061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fd0e8009760 tx=0x7fd0e8016000).stop 2023-11-30T17:23:06.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.211+0000 7fd0fe3a9700 1 -- 172.21.15.49:0/3298540525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0f80c6190 msgr2=0x7fd0f80a8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:06.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.211+0000 7fd0fe3a9700 1 --2- 172.21.15.49:0/3298540525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0f80c6190 0x7fd0f80a8e50 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7fd0f000cb40 tx=0x7fd0f0001e20).stop 2023-11-30T17:23:06.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.211+0000 7fd0fe3a9700 1 -- 172.21.15.49:0/3298540525 shutdown_connections 2023-11-30T17:23:06.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.211+0000 7fd0fe3a9700 1 --2- 172.21.15.49:0/3298540525 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd0e405f270 0x7fd0e4061730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:06.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.211+0000 7fd0fe3a9700 1 --2- 172.21.15.49:0/3298540525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0f80c6190 0x7fd0f80a8e50 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:06.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.211+0000 7fd0fe3a9700 1 --2- 172.21.15.49:0/3298540525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0f8064350 0x7fd0f80ad330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:06.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.211+0000 7fd0fe3a9700 1 --2- 172.21.15.49:0/3298540525 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0f8098d10 0x7fd0f80aad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:06.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.211+0000 7fd0fe3a9700 1 -- 172.21.15.49:0/3298540525 >> 172.21.15.49:0/3298540525 conn(0x7fd0f80cb310 msgr2=0x7fd0f81516d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:06.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.212+0000 7fd0fe3a9700 1 -- 172.21.15.49:0/3298540525 shutdown_connections 2023-11-30T17:23:06.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.212+0000 7fd0fe3a9700 1 -- 172.21.15.49:0/3298540525 wait complete. 2023-11-30T17:23:06.215 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2023-11-30T17:23:06.225 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:23:06.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.341+0000 7f05bc282700 1 Processor -- start 2023-11-30T17:23:06.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.341+0000 7f05bc282700 1 -- start start 2023-11-30T17:23:06.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.342+0000 7f05bc282700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f05b41520c0 0x7f05b4066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:06.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.342+0000 7f05bc282700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05b41524a0 0x7f05b4066a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:06.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.342+0000 7f05bc282700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f05b4067a40 0x7f05b4067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:06.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.342+0000 7f05bc282700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b40683e0 con 0x7f05b4067a40 2023-11-30T17:23:06.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.342+0000 7f05bc282700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b40be110 con 0x7f05b41520c0 2023-11-30T17:23:06.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.342+0000 7f05bc282700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b4066fc0 con 0x7f05b41524a0 2023-11-30T17:23:06.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.343+0000 7f05ba81f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f05b4067a40 0x7f05b4067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:06.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.343+0000 7f05ba81f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f05b4067a40 0x7f05b4067ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37846/0 (socket says 172.21.15.49:37846) 2023-11-30T17:23:06.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.343+0000 7f05ba81f700 1 -- 172.21.15.49:0/2094671937 learned_addr learned my addr 172.21.15.49:0/2094671937 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:06.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.343+0000 7f05b981d700 1 --2- 172.21.15.49:0/2094671937 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05b41524a0 0x7f05b4066a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:06.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.343+0000 7f05ba01e700 1 --2- 172.21.15.49:0/2094671937 >> v2:172.21.15.115:3300/0 conn(0x7f05b41520c0 0x7f05b4066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:06.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.343+0000 7f05ba81f700 1 -- 172.21.15.49:0/2094671937 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05b41524a0 msgr2=0x7f05b4066a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:06.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.343+0000 7f05ba81f700 1 --2- 172.21.15.49:0/2094671937 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05b41524a0 0x7f05b4066a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:06.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.343+0000 7f05ba81f700 1 -- 172.21.15.49:0/2094671937 >> v2:172.21.15.115:3300/0 conn(0x7f05b41520c0 msgr2=0x7f05b4066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:06.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.343+0000 7f05ba81f700 1 --2- 172.21.15.49:0/2094671937 >> v2:172.21.15.115:3300/0 conn(0x7f05b41520c0 0x7f05b4066520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:06.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.343+0000 7f05ba81f700 1 -- 172.21.15.49:0/2094671937 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b40672a0 con 0x7f05b4067a40 2023-11-30T17:23:06.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.343+0000 7f05ba81f700 1 --2- 172.21.15.49:0/2094671937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05b4067a40 0x7f05b4067ef0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f05b40c5b10 tx=0x7f05a4009840).ready entity=mon.0 client_cookie=8040a7eaa89fd862 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:06.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.343+0000 7f05b901c700 1 -- 172.21.15.49:0/2094671937 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a400e070 con 0x7f05b4067a40 2023-11-30T17:23:06.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.343+0000 7f05b901c700 1 -- 172.21.15.49:0/2094671937 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a400b970 con 0x7f05b4067a40 2023-11-30T17:23:06.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.343+0000 7f05b901c700 1 -- 172.21.15.49:0/2094671937 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a400bcf0 con 0x7f05b4067a40 2023-11-30T17:23:06.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.344+0000 7f05bc282700 1 -- 172.21.15.49:0/2094671937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05b4067a40 msgr2=0x7f05b4067ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:06.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.344+0000 7f05bc282700 1 --2- 172.21.15.49:0/2094671937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05b4067a40 0x7f05b4067ef0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f05b40c5b10 tx=0x7f05a4009840).stop 2023-11-30T17:23:06.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.344+0000 7f05bc282700 1 -- 172.21.15.49:0/2094671937 shutdown_connections 2023-11-30T17:23:06.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.344+0000 7f05bc282700 1 --2- 172.21.15.49:0/2094671937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05b4067a40 0x7f05b4067ef0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:06.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.344+0000 7f05bc282700 1 --2- 172.21.15.49:0/2094671937 >> v2:172.21.15.115:3300/0 conn(0x7f05b41520c0 0x7f05b4066520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:06.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.344+0000 7f05bc282700 1 --2- 172.21.15.49:0/2094671937 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05b41524a0 0x7f05b4066a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:06.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.344+0000 7f05bc282700 1 -- 172.21.15.49:0/2094671937 >> 172.21.15.49:0/2094671937 conn(0x7f05b40631d0 msgr2=0x7f05b40c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:06.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.344+0000 7f05bc282700 1 -- 172.21.15.49:0/2094671937 shutdown_connections 2023-11-30T17:23:06.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.344+0000 7f05bc282700 1 -- 172.21.15.49:0/2094671937 wait complete. 2023-11-30T17:23:06.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.345+0000 7f05bc282700 1 Processor -- start 2023-11-30T17:23:06.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.345+0000 7f05bc282700 1 -- start start 2023-11-30T17:23:06.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.346+0000 7f05bc282700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05b4067a40 0x7f05b4161fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:06.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.346+0000 7f05bc282700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05b41520c0 0x7f05b40c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:06.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.346+0000 7f05bc282700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05b41524a0 0x7f05b414ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:06.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.346+0000 7f05bc282700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b40c6fc0 con 0x7f05b4067a40 2023-11-30T17:23:06.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.346+0000 7f05bc282700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b40c6cc0 con 0x7f05b41520c0 2023-11-30T17:23:06.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.346+0000 7f05bc282700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b4162890 con 0x7f05b41524a0 2023-11-30T17:23:06.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.346+0000 7f05ba01e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05b4067a40 0x7f05b4161fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:06.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.346+0000 7f05ba01e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05b4067a40 0x7f05b4161fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37852/0 (socket says 172.21.15.49:37852) 2023-11-30T17:23:06.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.346+0000 7f05ba01e700 1 -- 172.21.15.49:0/630772040 learned_addr learned my addr 172.21.15.49:0/630772040 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:06.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.346+0000 7f05ba81f700 1 --2- 172.21.15.49:0/630772040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05b41524a0 0x7f05b414ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:06.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.346+0000 7f05b981d700 1 --2- 172.21.15.49:0/630772040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05b41520c0 0x7f05b40c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:06.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.346+0000 7f05ba01e700 1 -- 172.21.15.49:0/630772040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05b41524a0 msgr2=0x7f05b414ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:06.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.346+0000 7f05ba01e700 1 --2- 172.21.15.49:0/630772040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05b41524a0 0x7f05b414ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:06.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.346+0000 7f05ba01e700 1 -- 172.21.15.49:0/630772040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05b41520c0 msgr2=0x7f05b40c7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:06.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.346+0000 7f05ba01e700 1 --2- 172.21.15.49:0/630772040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05b41520c0 0x7f05b40c7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:06.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.346+0000 7f05ba01e700 1 -- 172.21.15.49:0/630772040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a4009ae0 con 0x7f05b4067a40 2023-11-30T17:23:06.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.346+0000 7f05ba01e700 1 --2- 172.21.15.49:0/630772040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05b4067a40 0x7f05b4161fb0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f05ac00e900 tx=0x7f05ac006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:06.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.346+0000 7f05b27fc700 1 -- 172.21.15.49:0/630772040 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac009450 con 0x7f05b4067a40 2023-11-30T17:23:06.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.347+0000 7f05b27fc700 1 -- 172.21.15.49:0/630772040 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ac012600 con 0x7f05b4067a40 2023-11-30T17:23:06.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.347+0000 7f05b27fc700 1 -- 172.21.15.49:0/630772040 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac012980 con 0x7f05b4067a40 2023-11-30T17:23:06.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.347+0000 7f05bc282700 1 -- 172.21.15.49:0/630772040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b4162b70 con 0x7f05b4067a40 2023-11-30T17:23:06.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.347+0000 7f05bc282700 1 -- 172.21.15.49:0/630772040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b41624a0 con 0x7f05b4067a40 2023-11-30T17:23:06.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.348+0000 7f05bc282700 1 -- 172.21.15.49:0/630772040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b406c860 con 0x7f05b4067a40 2023-11-30T17:23:06.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.348+0000 7f05b27fc700 1 -- 172.21.15.49:0/630772040 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f05ac012cf0 con 0x7f05b4067a40 2023-11-30T17:23:06.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.348+0000 7f05b27fc700 1 --2- 172.21.15.49:0/630772040 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f05a005f270 0x7f05a0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:06.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.348+0000 7f05b27fc700 1 -- 172.21.15.49:0/630772040 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f05ac07a7c0 con 0x7f05b4067a40 2023-11-30T17:23:06.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.349+0000 7f05b981d700 1 --2- 172.21.15.49:0/630772040 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f05a005f270 0x7f05a0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:06.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.349+0000 7f05b981d700 1 --2- 172.21.15.49:0/630772040 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f05a005f270 0x7f05a0061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f05b4155de0 tx=0x7f05a8009060).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:06.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.353+0000 7f05b27fc700 1 -- 172.21.15.49:0/630772040 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f05ac04f320 con 0x7f05b4067a40 2023-11-30T17:23:06.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.566+0000 7f05bc282700 1 -- 172.21.15.49:0/630772040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05b40be380 con 0x7f05b4067a40 2023-11-30T17:23:06.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.567+0000 7f05b27fc700 1 -- 172.21.15.49:0/630772040 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f05ac016020 con 0x7f05b4067a40 2023-11-30T17:23:06.568 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:06.569 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5906,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3382372491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3382372491},{"type":"v1","addr":"172.21.15.115:6837","nonce":3382372491}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6675,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/962684395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":962684395},{"type":"v1","addr":"172.21.15.49:6834","nonce":962684395}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6678,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1931198509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1931198509},{"type":"v1","addr":"172.21.15.49:6835","nonce":1931198509}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:22:56.913429+0000","modified":"2023-11-30T17:22:59.924885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6687},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6687":{"gid":6687,"name":"d","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/3530976555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3530976555},{"type":"v1","addr":"172.21.15.115:6836","nonce":3530976555}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-11-30T17:23:06.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.568+0000 7f05bc282700 1 -- 172.21.15.49:0/630772040 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f05a005f270 msgr2=0x7f05a0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:06.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.568+0000 7f05bc282700 1 --2- 172.21.15.49:0/630772040 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f05a005f270 0x7f05a0061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f05b4155de0 tx=0x7f05a8009060).stop 2023-11-30T17:23:06.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.568+0000 7f05bc282700 1 -- 172.21.15.49:0/630772040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05b4067a40 msgr2=0x7f05b4161fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:06.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.568+0000 7f05bc282700 1 --2- 172.21.15.49:0/630772040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05b4067a40 0x7f05b4161fb0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f05ac00e900 tx=0x7f05ac006f40).stop 2023-11-30T17:23:06.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.569+0000 7f05bc282700 1 -- 172.21.15.49:0/630772040 shutdown_connections 2023-11-30T17:23:06.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.569+0000 7f05bc282700 1 --2- 172.21.15.49:0/630772040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05b41524a0 0x7f05b414ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:06.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.569+0000 7f05bc282700 1 --2- 172.21.15.49:0/630772040 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f05a005f270 0x7f05a0061730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:06.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.569+0000 7f05bc282700 1 --2- 172.21.15.49:0/630772040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05b4067a40 0x7f05b4161fb0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:06.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.569+0000 7f05bc282700 1 --2- 172.21.15.49:0/630772040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05b41520c0 0x7f05b40c7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:06.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.569+0000 7f05bc282700 1 -- 172.21.15.49:0/630772040 >> 172.21.15.49:0/630772040 conn(0x7f05b40631d0 msgr2=0x7f05b41504a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:06.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.569+0000 7f05bc282700 1 -- 172.21.15.49:0/630772040 shutdown_connections 2023-11-30T17:23:06.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:06.569+0000 7f05bc282700 1 -- 172.21.15.49:0/630772040 wait complete. 2023-11-30T17:23:06.571 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 39 2023-11-30T17:23:06.986 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-30T17:22:56.913429+0000', 'modified': '2023-11-30T17:22:59.924885+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6687}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6687': {'gid': 6687, 'name': 'd', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.115:6836/3530976555', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6834', 'nonce': 3530976555}, {'type': 'v1', 'addr': '172.21.15.115:6836', 'nonce': 3530976555}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-11-30T17:23:06.986 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-30T17:23:06.986 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-30T17:23:07.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.105+0000 7f8c7f3e7700 1 Processor -- start 2023-11-30T17:23:07.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.105+0000 7f8c7f3e7700 1 -- start start 2023-11-30T17:23:07.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.106+0000 7f8c7f3e7700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8c780c6190 0x7f8c780c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:07.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.106+0000 7f8c7f3e7700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c780c72d0 con 0x7f8c78098d10 2023-11-30T17:23:07.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.106+0000 7f8c7f3e7700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c78064570 con 0x7f8c78158320 2023-11-30T17:23:07.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.106+0000 7f8c7f3e7700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c78154bc0 con 0x7f8c780c6190 2023-11-30T17:23:07.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.106+0000 7f8c7c982700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8c780c6190 0x7f8c780c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:07.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.106+0000 7f8c7d183700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8c78098d10 0x7f8c78063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39098/0 (socket says 172.21.15.49:39098) 2023-11-30T17:23:07.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.106+0000 7f8c7d183700 1 -- 172.21.15.49:0/1958570910 learned_addr learned my addr 172.21.15.49:0/1958570910 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:07.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.106+0000 7f8c7c982700 1 -- 172.21.15.49:0/1958570910 >> v1:172.21.15.115:6789/0 conn(0x7f8c78158320 legacy=0x7f8c780a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:07.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.106+0000 7f8c7c982700 1 -- 172.21.15.49:0/1958570910 >> v1:172.21.15.49:6789/0 conn(0x7f8c78098d10 legacy=0x7f8c78063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:07.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.106+0000 7f8c77fff700 1 -- 172.21.15.49:0/1958570910 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2763209202 0 0) 0x7f8c780c72d0 con 0x7f8c78098d10 2023-11-30T17:23:07.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.106+0000 7f8c7c982700 1 -- 172.21.15.49:0/1958570910 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c780c66c0 con 0x7f8c780c6190 2023-11-30T17:23:07.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.106+0000 7f8c7c982700 1 --2- 172.21.15.49:0/1958570910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c780c6190 0x7f8c780c7760 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f8c6c009760 tx=0x7f8c6c009060).ready entity=mon.0 client_cookie=1ecd739c098e6bf server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:07.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.106+0000 7f8c77fff700 1 -- 172.21.15.49:0/1958570910 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c00b580 con 0x7f8c780c6190 2023-11-30T17:23:07.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.106+0000 7f8c77fff700 1 -- 172.21.15.49:0/1958570910 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6c00b6e0 con 0x7f8c780c6190 2023-11-30T17:23:07.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.106+0000 7f8c77fff700 1 -- 172.21.15.49:0/1958570910 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c00ba60 con 0x7f8c780c6190 2023-11-30T17:23:07.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.107+0000 7f8c7f3e7700 1 -- 172.21.15.49:0/1958570910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c780c6190 msgr2=0x7f8c780c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:07.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.107+0000 7f8c7f3e7700 1 --2- 172.21.15.49:0/1958570910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c780c6190 0x7f8c780c7760 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f8c6c009760 tx=0x7f8c6c009060).stop 2023-11-30T17:23:07.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.107+0000 7f8c7f3e7700 1 -- 172.21.15.49:0/1958570910 shutdown_connections 2023-11-30T17:23:07.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.107+0000 7f8c7f3e7700 1 --2- 172.21.15.49:0/1958570910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c780c6190 0x7f8c780c7760 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.107+0000 7f8c7f3e7700 1 -- 172.21.15.49:0/1958570910 >> 172.21.15.49:0/1958570910 conn(0x7f8c780cb310 msgr2=0x7f8c780cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:07.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.107+0000 7f8c7f3e7700 1 -- 172.21.15.49:0/1958570910 shutdown_connections 2023-11-30T17:23:07.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.107+0000 7f8c7f3e7700 1 -- 172.21.15.49:0/1958570910 wait complete. 2023-11-30T17:23:07.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.108+0000 7f8c7f3e7700 1 Processor -- start 2023-11-30T17:23:07.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.108+0000 7f8c7f3e7700 1 -- start start 2023-11-30T17:23:07.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.109+0000 7f8c7f3e7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c78098d10 0x7f8c7814e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:07.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.109+0000 7f8c7f3e7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c780c6190 0x7f8c78155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:07.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.109+0000 7f8c7f3e7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c78158320 0x7f8c780aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:07.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.109+0000 7f8c7f3e7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c780afe00 con 0x7f8c78158320 2023-11-30T17:23:07.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.109+0000 7f8c7f3e7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c780af280 con 0x7f8c78098d10 2023-11-30T17:23:07.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.109+0000 7f8c7f3e7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c780af560 con 0x7f8c780c6190 2023-11-30T17:23:07.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.109+0000 7f8c7d984700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c78158320 0x7f8c780aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:07.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.109+0000 7f8c7d984700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c78158320 0x7f8c780aeaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37870/0 (socket says 172.21.15.49:37870) 2023-11-30T17:23:07.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.109+0000 7f8c7d984700 1 -- 172.21.15.49:0/2583706663 learned_addr learned my addr 172.21.15.49:0/2583706663 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:07.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.109+0000 7f8c7d183700 1 --2- 172.21.15.49:0/2583706663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c78098d10 0x7f8c7814e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:07.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.109+0000 7f8c7c982700 1 --2- 172.21.15.49:0/2583706663 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c780c6190 0x7f8c78155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:07.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.109+0000 7f8c7d984700 1 -- 172.21.15.49:0/2583706663 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c780c6190 msgr2=0x7f8c78155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:07.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.109+0000 7f8c7d984700 1 --2- 172.21.15.49:0/2583706663 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c780c6190 0x7f8c78155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.109+0000 7f8c7d984700 1 -- 172.21.15.49:0/2583706663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c78098d10 msgr2=0x7f8c7814e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:07.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.109+0000 7f8c7d984700 1 --2- 172.21.15.49:0/2583706663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c78098d10 0x7f8c7814e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.109+0000 7f8c7d984700 1 -- 172.21.15.49:0/2583706663 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6c0092a0 con 0x7f8c78158320 2023-11-30T17:23:07.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.109+0000 7f8c7d984700 1 --2- 172.21.15.49:0/2583706663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c78158320 0x7f8c780aeaa0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7f8c6800c7c0 tx=0x7f8c68001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:07.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.110+0000 7f8c757fa700 1 -- 172.21.15.49:0/2583706663 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6800e4a0 con 0x7f8c78158320 2023-11-30T17:23:07.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.110+0000 7f8c757fa700 1 -- 172.21.15.49:0/2583706663 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6800e600 con 0x7f8c78158320 2023-11-30T17:23:07.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.110+0000 7f8c7f3e7700 1 -- 172.21.15.49:0/2583706663 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c780af840 con 0x7f8c78158320 2023-11-30T17:23:07.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.110+0000 7f8c757fa700 1 -- 172.21.15.49:0/2583706663 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6800e980 con 0x7f8c78158320 2023-11-30T17:23:07.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.110+0000 7f8c7f3e7700 1 -- 172.21.15.49:0/2583706663 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c780aef90 con 0x7f8c78158320 2023-11-30T17:23:07.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.111+0000 7f8c757fa700 1 -- 172.21.15.49:0/2583706663 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8c680123f0 con 0x7f8c78158320 2023-11-30T17:23:07.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.111+0000 7f8c757fa700 1 --2- 172.21.15.49:0/2583706663 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8c6405f240 0x7f8c64061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:07.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.111+0000 7f8c757fa700 1 -- 172.21.15.49:0/2583706663 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f8c68079b80 con 0x7f8c78158320 2023-11-30T17:23:07.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.112+0000 7f8c7d183700 1 --2- 172.21.15.49:0/2583706663 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8c6405f240 0x7f8c64061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:07.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.112+0000 7f8c7d183700 1 --2- 172.21.15.49:0/2583706663 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8c6405f240 0x7f8c64061700 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f8c700011e0 tx=0x7f8c70007b90).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:07.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.113+0000 7f8c90d7fb80 1 Processor -- start 2023-11-30T17:23:07.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.113+0000 7f8c90d7fb80 1 -- start start 2023-11-30T17:23:07.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.114+0000 7f8c90d7fb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55772d0e7e40 0x55772d353d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:07.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.114+0000 7f8c90d7fb80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55772d374ea0 0x55772d32b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:07.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.114+0000 7f8c90d7fb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55772d32bcb0 0x55772d326600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:07.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.114+0000 7f8c90d7fb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55772d2f1060 con 0x55772d0e7e40 2023-11-30T17:23:07.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.114+0000 7f8c90d7fb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55772d2681f0 con 0x55772d32bcb0 2023-11-30T17:23:07.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.114+0000 7f8c90d7fb80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55772d27d440 con 0x55772d374ea0 2023-11-30T17:23:07.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.114+0000 7f8c7d183700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55772d0e7e40 0x55772d353d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:07.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.114+0000 7f8c7d183700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55772d0e7e40 0x55772d353d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37872/0 (socket says 172.21.15.49:37872) 2023-11-30T17:23:07.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.114+0000 7f8c7d183700 1 -- 172.21.15.49:0/47668646 learned_addr learned my addr 172.21.15.49:0/47668646 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:07.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.114+0000 7f8c7c982700 1 --2- 172.21.15.49:0/47668646 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55772d374ea0 0x55772d32b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:07.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.114+0000 7f8c7d984700 1 --2- 172.21.15.49:0/47668646 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55772d32bcb0 0x55772d326600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:07.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.115+0000 7f8c7d183700 1 -- 172.21.15.49:0/47668646 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55772d374ea0 msgr2=0x55772d32b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:07.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.115+0000 7f8c7d183700 1 --2- 172.21.15.49:0/47668646 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55772d374ea0 0x55772d32b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.115+0000 7f8c7d183700 1 -- 172.21.15.49:0/47668646 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55772d32bcb0 msgr2=0x55772d326600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:07.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.115+0000 7f8c7d183700 1 --2- 172.21.15.49:0/47668646 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55772d32bcb0 0x55772d326600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.115+0000 7f8c7d183700 1 -- 172.21.15.49:0/47668646 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55772d276620 con 0x55772d0e7e40 2023-11-30T17:23:07.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.115+0000 7f8c7d183700 1 --2- 172.21.15.49:0/47668646 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55772d0e7e40 0x55772d353d90 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7f8c700016e0 tx=0x7f8c70013000).ready entity=mon.0 client_cookie=1bbfc4ab2712fa31 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:07.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.115+0000 7f8c5e7fc700 1 -- 172.21.15.49:0/47668646 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c70001d20 con 0x55772d0e7e40 2023-11-30T17:23:07.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.115+0000 7f8c5e7fc700 1 -- 172.21.15.49:0/47668646 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c70013600 con 0x55772d0e7e40 2023-11-30T17:23:07.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.115+0000 7f8c5e7fc700 1 -- 172.21.15.49:0/47668646 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c70013980 con 0x55772d0e7e40 2023-11-30T17:23:07.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.115+0000 7f8c90d7fb80 1 -- 172.21.15.49:0/47668646 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55772d0e7e40 msgr2=0x55772d353d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:07.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.115+0000 7f8c90d7fb80 1 --2- 172.21.15.49:0/47668646 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55772d0e7e40 0x55772d353d90 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7f8c700016e0 tx=0x7f8c70013000).stop 2023-11-30T17:23:07.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.116+0000 7f8c90d7fb80 1 -- 172.21.15.49:0/47668646 shutdown_connections 2023-11-30T17:23:07.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.116+0000 7f8c90d7fb80 1 --2- 172.21.15.49:0/47668646 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55772d32bcb0 0x55772d326600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.116+0000 7f8c90d7fb80 1 --2- 172.21.15.49:0/47668646 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55772d0e7e40 0x55772d353d90 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.116+0000 7f8c90d7fb80 1 --2- 172.21.15.49:0/47668646 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55772d374ea0 0x55772d32b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.116+0000 7f8c90d7fb80 1 -- 172.21.15.49:0/47668646 >> 172.21.15.49:0/47668646 conn(0x55772d1954a0 msgr2=0x55772d374790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:07.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.116+0000 7f8c90d7fb80 1 -- 172.21.15.49:0/47668646 shutdown_connections 2023-11-30T17:23:07.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.116+0000 7f8c90d7fb80 1 -- 172.21.15.49:0/47668646 wait complete. 2023-11-30T17:23:07.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.116+0000 7f8c90d7fb80 1 -- start start 2023-11-30T17:23:07.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.116+0000 7f8c90d7fb80 1 Processor -- start 2023-11-30T17:23:07.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.117+0000 7f8c90d7fb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55772d0e7e40 0x55772d350410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:07.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.117+0000 7f8c90d7fb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55772d32bcb0 0x55772d352fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:07.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.117+0000 7f8c90d7fb80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55772d374ea0 0x55772d3534b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:07.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.117+0000 7f8c90d7fb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55772d27d580 con 0x55772d32bcb0 2023-11-30T17:23:07.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.117+0000 7f8c90d7fb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55772d27d800 con 0x55772d0e7e40 2023-11-30T17:23:07.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.117+0000 7f8c90d7fb80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55772d248e10 con 0x55772d374ea0 2023-11-30T17:23:07.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.117+0000 7f8c90d7fb80 10 client.0 ll_register_callbacks cb 0x55772d2eb460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-30T17:23:07.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.117+0000 7f8c7c982700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55772d32bcb0 0x55772d352fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:07.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.117+0000 7f8c7c982700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55772d32bcb0 0x55772d352fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37886/0 (socket says 172.21.15.49:37886) 2023-11-30T17:23:07.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.117+0000 7f8c7c982700 1 -- 172.21.15.49:0/184252067 learned_addr learned my addr 172.21.15.49:0/184252067 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:07.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.117+0000 7f8c7d183700 1 --2- 172.21.15.49:0/184252067 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55772d0e7e40 0x55772d350410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:07.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.117+0000 7f8c7d984700 1 --2- 172.21.15.49:0/184252067 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55772d374ea0 0x55772d3534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:07.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.118+0000 7f8c7c982700 1 -- 172.21.15.49:0/184252067 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55772d374ea0 msgr2=0x55772d3534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:07.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.118+0000 7f8c7c982700 1 --2- 172.21.15.49:0/184252067 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55772d374ea0 0x55772d3534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.118+0000 7f8c7c982700 1 -- 172.21.15.49:0/184252067 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55772d0e7e40 msgr2=0x55772d350410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:07.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.118+0000 7f8c7c982700 1 --2- 172.21.15.49:0/184252067 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55772d0e7e40 0x55772d350410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.118+0000 7f8c7c982700 1 -- 172.21.15.49:0/184252067 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c700013b0 con 0x55772d32bcb0 2023-11-30T17:23:07.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.118+0000 7f8c7d984700 1 --2- 172.21.15.49:0/184252067 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55772d374ea0 0x55772d3534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:23:07.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.118+0000 7f8c7c982700 1 --2- 172.21.15.49:0/184252067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55772d32bcb0 0x55772d352fc0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7f8c6c009eb0 tx=0x7f8c6c017000).ready entity=mon.0 client_cookie=9b2d0b8fe7f27257 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:07.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.118+0000 7f8c577fe700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-30T17:23:07.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.118+0000 7f8c577fe700 1 -- 172.21.15.49:0/184252067 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c022070 con 0x55772d32bcb0 2023-11-30T17:23:07.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.118+0000 7f8c577fe700 1 -- 172.21.15.49:0/184252067 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f8c6c01b7f0 con 0x55772d32bcb0 2023-11-30T17:23:07.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.118+0000 7f8c90d7fb80 1 -- 172.21.15.49:0/184252067 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55772d31f720 con 0x55772d32bcb0 2023-11-30T17:23:07.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.118+0000 7f8c577fe700 1 -- 172.21.15.49:0/184252067 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c6c01bbc0 con 0x55772d32bcb0 2023-11-30T17:23:07.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.118+0000 7f8c90d7fb80 10 client.6852 fetch_fsmap learned FSMap version 39 2023-11-30T17:23:07.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.118+0000 7f8c90d7fb80 1 -- 172.21.15.49:0/184252067 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x55772d2719c0 con 0x55772d32bcb0 2023-11-30T17:23:07.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.118+0000 7f8c577fe700 1 -- 172.21.15.49:0/184252067 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55772d31f720 con 0x55772d32bcb0 2023-11-30T17:23:07.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.118+0000 7f8c577fe700 1 -- 172.21.15.49:0/184252067 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 39) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8c6c009840 con 0x55772d32bcb0 2023-11-30T17:23:07.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.119+0000 7f8c90d7fb80 10 client.6852 fetch_fsmap finished waiting for FSMap version 39 2023-11-30T17:23:07.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.119+0000 7f8c90d7fb80 10 client.6852 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-30T17:23:07.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.119+0000 7f8c90d7fb80 20 client.6852 populate_metadata read hostname 'smithi049' 2023-11-30T17:23:07.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.119+0000 7f8c90d7fb80 1 --2- 172.21.15.49:0/184252067 >> [v2:172.21.15.115:6834/3530976555,v1:172.21.15.115:6836/3530976555] conn(0x55772d3703f0 0x55772d3707d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:07.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.119+0000 7f8c90d7fb80 4 client.6852 mds_command: new command op to 6687 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-30T17:23:07.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.119+0000 7f8c90d7fb80 1 -- 172.21.15.49:0/184252067 --> [v2:172.21.15.115:6834/3530976555,v1:172.21.15.115:6836/3530976555] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55772d0e3ca0 con 0x55772d3703f0 2023-11-30T17:23:07.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.119+0000 7f8c7d183700 1 --2- 172.21.15.49:0/184252067 >> [v2:172.21.15.115:6834/3530976555,v1:172.21.15.115:6836/3530976555] conn(0x55772d3703f0 0x55772d3707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:07.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.119+0000 7f8c577fe700 10 client.6852 ms_handle_connect on v2:172.21.15.115:6834/3530976555 2023-11-30T17:23:07.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.119+0000 7f8c7d183700 1 --2- 172.21.15.49:0/184252067 >> [v2:172.21.15.115:6834/3530976555,v1:172.21.15.115:6836/3530976555] conn(0x55772d3703f0 0x55772d3707d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=cee1ae05494c82ca server_cookie=120c5fc40c954ed2 in_seq=0 out_seq=0 2023-11-30T17:23:07.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.120+0000 7f8c577fe700 1 -- 172.21.15.49:0/184252067 <== mds.0 v2:172.21.15.115:6834/3530976555 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55772d0e3ca0 con 0x55772d3703f0 2023-11-30T17:23:07.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.120+0000 7f8c577fe700 10 client.6852 handle_command_reply: tid=0 2023-11-30T17:23:07.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.120+0000 7f8c90d7fb80 1 client.6852 shutdown 2023-11-30T17:23:07.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.120+0000 7f8c90d7fb80 1 -- 172.21.15.49:0/184252067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55772d32bcb0 msgr2=0x55772d352fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:07.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.120+0000 7f8c90d7fb80 1 --2- 172.21.15.49:0/184252067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55772d32bcb0 0x55772d352fc0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7f8c6c009eb0 tx=0x7f8c6c017000).stop 2023-11-30T17:23:07.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.120+0000 7f8c90d7fb80 1 -- 172.21.15.49:0/184252067 shutdown_connections 2023-11-30T17:23:07.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.120+0000 7f8c90d7fb80 1 --2- 172.21.15.49:0/184252067 >> [v2:172.21.15.115:6834/3530976555,v1:172.21.15.115:6836/3530976555] conn(0x55772d3703f0 0x55772d3707d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.120+0000 7f8c90d7fb80 1 --2- 172.21.15.49:0/184252067 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55772d374ea0 0x55772d3534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.120+0000 7f8c90d7fb80 1 --2- 172.21.15.49:0/184252067 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55772d0e7e40 0x55772d350410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.120+0000 7f8c90d7fb80 1 --2- 172.21.15.49:0/184252067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55772d32bcb0 0x55772d352fc0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.120+0000 7f8c577fe700 0 client.6852 ms_handle_reset on v2:172.21.15.115:6834/3530976555 2023-11-30T17:23:07.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.120+0000 7f8c90d7fb80 1 -- 172.21.15.49:0/184252067 >> 172.21.15.49:0/184252067 conn(0x55772d1954a0 msgr2=0x55772d32caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:07.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.120+0000 7f8c90d7fb80 1 -- 172.21.15.49:0/184252067 shutdown_connections 2023-11-30T17:23:07.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.120+0000 7f8c90d7fb80 1 -- 172.21.15.49:0/184252067 wait complete. 2023-11-30T17:23:07.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.120+0000 7f8c90d7fb80 20 client.6852 trim_cache size 0 max 16384 2023-11-30T17:23:07.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.137+0000 7f8c90d7fb80 1 Processor -- start 2023-11-30T17:23:07.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.137+0000 7f8c90d7fb80 1 -- start start 2023-11-30T17:23:07.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.137+0000 7f8c90d7fb80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55772d0e7e40 0x55772d34f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:07.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.137+0000 7f8c90d7fb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55772d32bcb0 0x55772d36ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:07.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.138+0000 7f8c90d7fb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55772d374ea0 0x55772d36b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:07.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.138+0000 7f8c90d7fb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55772d32a4f0 con 0x55772d374ea0 2023-11-30T17:23:07.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.138+0000 7f8c90d7fb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55772d36c490 con 0x55772d32bcb0 2023-11-30T17:23:07.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.138+0000 7f8c90d7fb80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55772d36b940 con 0x55772d0e7e40 2023-11-30T17:23:07.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.138+0000 7f8c7d984700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55772d374ea0 0x55772d36b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:07.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.138+0000 7f8c7d984700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55772d374ea0 0x55772d36b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37900/0 (socket says 172.21.15.49:37900) 2023-11-30T17:23:07.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.138+0000 7f8c7d984700 1 -- 172.21.15.49:0/3495602287 learned_addr learned my addr 172.21.15.49:0/3495602287 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:07.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.138+0000 7f8c7d183700 1 --2- 172.21.15.49:0/3495602287 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55772d0e7e40 0x55772d34f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:07.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.138+0000 7f8c7c982700 1 --2- 172.21.15.49:0/3495602287 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55772d32bcb0 0x55772d36ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:07.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.138+0000 7f8c7d984700 1 -- 172.21.15.49:0/3495602287 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55772d0e7e40 msgr2=0x55772d34f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:07.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.138+0000 7f8c7d984700 1 --2- 172.21.15.49:0/3495602287 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55772d0e7e40 0x55772d34f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.138+0000 7f8c7d984700 1 -- 172.21.15.49:0/3495602287 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55772d32bcb0 msgr2=0x55772d36ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:07.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.138+0000 7f8c7d984700 1 --2- 172.21.15.49:0/3495602287 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55772d32bcb0 0x55772d36ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.138+0000 7f8c7d984700 1 -- 172.21.15.49:0/3495602287 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55772d271710 con 0x55772d374ea0 2023-11-30T17:23:07.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.138+0000 7f8c7d984700 1 --2- 172.21.15.49:0/3495602287 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55772d374ea0 0x55772d36b1f0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7f8c6800cdb0 tx=0x7f8c68050040).ready entity=mon.0 client_cookie=d6cf53bbafcad52d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:07.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.138+0000 7f8c5effd700 1 -- 172.21.15.49:0/3495602287 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68053070 con 0x55772d374ea0 2023-11-30T17:23:07.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.138+0000 7f8c5effd700 1 -- 172.21.15.49:0/3495602287 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6804ca50 con 0x55772d374ea0 2023-11-30T17:23:07.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.138+0000 7f8c5effd700 1 -- 172.21.15.49:0/3495602287 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6800ed70 con 0x55772d374ea0 2023-11-30T17:23:07.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.139+0000 7f8c90d7fb80 1 -- 172.21.15.49:0/3495602287 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55772d374ea0 msgr2=0x55772d36b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:07.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.139+0000 7f8c90d7fb80 1 --2- 172.21.15.49:0/3495602287 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55772d374ea0 0x55772d36b1f0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7f8c6800cdb0 tx=0x7f8c68050040).stop 2023-11-30T17:23:07.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.139+0000 7f8c90d7fb80 1 -- 172.21.15.49:0/3495602287 shutdown_connections 2023-11-30T17:23:07.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.139+0000 7f8c90d7fb80 1 --2- 172.21.15.49:0/3495602287 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55772d374ea0 0x55772d36b1f0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.139+0000 7f8c90d7fb80 1 --2- 172.21.15.49:0/3495602287 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55772d0e7e40 0x55772d34f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.139+0000 7f8c90d7fb80 1 --2- 172.21.15.49:0/3495602287 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55772d32bcb0 0x55772d36ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.139+0000 7f8c90d7fb80 1 -- 172.21.15.49:0/3495602287 >> 172.21.15.49:0/3495602287 conn(0x55772d1954a0 msgr2=0x55772d32c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:07.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.139+0000 7f8c90d7fb80 1 -- 172.21.15.49:0/3495602287 shutdown_connections 2023-11-30T17:23:07.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.139+0000 7f8c90d7fb80 1 -- 172.21.15.49:0/3495602287 wait complete. 2023-11-30T17:23:07.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.139+0000 7f8c90d7fb80 1 -- start start 2023-11-30T17:23:07.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.140+0000 7f8c90d7fb80 1 Processor -- start 2023-11-30T17:23:07.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.140+0000 7f8c90d7fb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55772d0e7e40 0x55772d36ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:07.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.140+0000 7f8c90d7fb80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55772d32bcb0 0x55772d36b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:07.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.140+0000 7f8c90d7fb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55772d374ea0 0x55772d3544b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:07.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.140+0000 7f8c90d7fb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55772d36b6e0 con 0x55772d374ea0 2023-11-30T17:23:07.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.140+0000 7f8c90d7fb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55772d355580 con 0x55772d0e7e40 2023-11-30T17:23:07.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.140+0000 7f8c90d7fb80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55772d352080 con 0x55772d32bcb0 2023-11-30T17:23:07.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.140+0000 7f8c90d7fb80 10 client.0 ll_register_callbacks cb 0x55772d2eb460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-30T17:23:07.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.140+0000 7f8c7d984700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55772d374ea0 0x55772d3544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:07.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.140+0000 7f8c7c982700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55772d32bcb0 0x55772d36b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:07.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.141+0000 7f8c7d984700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55772d374ea0 0x55772d3544b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37914/0 (socket says 172.21.15.49:37914) 2023-11-30T17:23:07.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.141+0000 7f8c7d984700 1 -- 172.21.15.49:0/1767635381 learned_addr learned my addr 172.21.15.49:0/1767635381 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:07.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.141+0000 7f8c7d183700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55772d0e7e40 0x55772d36ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:07.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.141+0000 7f8c7c982700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55772d32bcb0 0x55772d36b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:60624/0 (socket says 172.21.15.49:60624) 2023-11-30T17:23:07.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.141+0000 7f8c7d984700 1 -- 172.21.15.49:0/1767635381 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55772d32bcb0 msgr2=0x55772d36b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:07.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.141+0000 7f8c7d984700 1 --2- 172.21.15.49:0/1767635381 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55772d32bcb0 0x55772d36b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.141+0000 7f8c7d984700 1 -- 172.21.15.49:0/1767635381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55772d0e7e40 msgr2=0x55772d36ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:07.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.141+0000 7f8c7d984700 1 --2- 172.21.15.49:0/1767635381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55772d0e7e40 0x55772d36ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.141+0000 7f8c7d984700 1 -- 172.21.15.49:0/1767635381 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c780aef90 con 0x55772d374ea0 2023-11-30T17:23:07.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.141+0000 7f8c7c982700 1 --2- 172.21.15.49:0/1767635381 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55772d32bcb0 0x55772d36b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:23:07.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.141+0000 7f8c7d984700 1 --2- 172.21.15.49:0/1767635381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55772d374ea0 0x55772d3544b0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7f8c68077fc0 tx=0x7f8c6805f000).ready entity=mon.0 client_cookie=20daa3fa611cf943 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:07.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.141+0000 7f8c577fe700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-30T17:23:07.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.141+0000 7f8c577fe700 1 -- 172.21.15.49:0/1767635381 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6800ed70 con 0x55772d374ea0 2023-11-30T17:23:07.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.141+0000 7f8c577fe700 1 -- 172.21.15.49:0/1767635381 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f8c6801cc70 con 0x55772d374ea0 2023-11-30T17:23:07.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.141+0000 7f8c90d7fb80 1 -- 172.21.15.49:0/1767635381 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8c70013600 con 0x55772d374ea0 2023-11-30T17:23:07.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.141+0000 7f8c577fe700 1 -- 172.21.15.49:0/1767635381 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c6801ce30 con 0x55772d374ea0 2023-11-30T17:23:07.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.141+0000 7f8c90d7fb80 10 client.6858 fetch_fsmap learned FSMap version 39 2023-11-30T17:23:07.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.141+0000 7f8c90d7fb80 1 -- 172.21.15.49:0/1767635381 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x55772d0e8f80 con 0x55772d374ea0 2023-11-30T17:23:07.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.141+0000 7f8c577fe700 1 -- 172.21.15.49:0/1767635381 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c70013600 con 0x55772d374ea0 2023-11-30T17:23:07.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.141+0000 7f8c577fe700 1 -- 172.21.15.49:0/1767635381 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 39) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8c6804a700 con 0x55772d374ea0 2023-11-30T17:23:07.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.141+0000 7f8c90d7fb80 10 client.6858 fetch_fsmap finished waiting for FSMap version 39 2023-11-30T17:23:07.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.141+0000 7f8c90d7fb80 10 client.6858 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-30T17:23:07.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.141+0000 7f8c90d7fb80 20 client.6858 populate_metadata read hostname 'smithi049' 2023-11-30T17:23:07.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.141+0000 7f8c90d7fb80 1 --2- 172.21.15.49:0/1767635381 >> [v2:172.21.15.115:6834/3530976555,v1:172.21.15.115:6836/3530976555] conn(0x55772d359510 0x55772d3549a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:07.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.141+0000 7f8c90d7fb80 4 client.6858 mds_command: new command op to 6687 tid=0[{"prefix": "status"}] 2023-11-30T17:23:07.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.141+0000 7f8c90d7fb80 1 -- 172.21.15.49:0/1767635381 --> [v2:172.21.15.115:6834/3530976555,v1:172.21.15.115:6836/3530976555] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55772d11aca0 con 0x55772d359510 2023-11-30T17:23:07.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.142+0000 7f8c7d183700 1 --2- 172.21.15.49:0/1767635381 >> [v2:172.21.15.115:6834/3530976555,v1:172.21.15.115:6836/3530976555] conn(0x55772d359510 0x55772d3549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:07.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.142+0000 7f8c577fe700 10 client.6858 ms_handle_connect on v2:172.21.15.115:6834/3530976555 2023-11-30T17:23:07.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.142+0000 7f8c7d183700 1 --2- 172.21.15.49:0/1767635381 >> [v2:172.21.15.115:6834/3530976555,v1:172.21.15.115:6836/3530976555] conn(0x55772d359510 0x55772d3549a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9c137c43163ae1a7 server_cookie=8fefe16f5bb597eb in_seq=0 out_seq=0 2023-11-30T17:23:07.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.142+0000 7f8c577fe700 1 -- 172.21.15.49:0/1767635381 <== mds.0 v2:172.21.15.115:6834/3530976555 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x55772d11aca0 con 0x55772d359510 2023-11-30T17:23:07.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.142+0000 7f8c577fe700 10 client.6858 handle_command_reply: tid=0 2023-11-30T17:23:07.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.142+0000 7f8c90d7fb80 1 client.6858 shutdown 2023-11-30T17:23:07.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.142+0000 7f8c90d7fb80 1 -- 172.21.15.49:0/1767635381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55772d374ea0 msgr2=0x55772d3544b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:07.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.142+0000 7f8c90d7fb80 1 --2- 172.21.15.49:0/1767635381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55772d374ea0 0x55772d3544b0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7f8c68077fc0 tx=0x7f8c6805f000).stop 2023-11-30T17:23:07.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.142+0000 7f8c90d7fb80 1 -- 172.21.15.49:0/1767635381 shutdown_connections 2023-11-30T17:23:07.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.142+0000 7f8c90d7fb80 1 --2- 172.21.15.49:0/1767635381 >> [v2:172.21.15.115:6834/3530976555,v1:172.21.15.115:6836/3530976555] conn(0x55772d359510 0x55772d3549a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.142+0000 7f8c90d7fb80 1 --2- 172.21.15.49:0/1767635381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55772d374ea0 0x55772d3544b0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.142+0000 7f8c90d7fb80 1 --2- 172.21.15.49:0/1767635381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55772d0e7e40 0x55772d36ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.142+0000 7f8c90d7fb80 1 --2- 172.21.15.49:0/1767635381 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55772d32bcb0 0x55772d36b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.142+0000 7f8c577fe700 0 client.6858 ms_handle_reset on v2:172.21.15.115:6834/3530976555 2023-11-30T17:23:07.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.142+0000 7f8c90d7fb80 1 -- 172.21.15.49:0/1767635381 >> 172.21.15.49:0/1767635381 conn(0x55772d1954a0 msgr2=0x55772d32c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:07.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.142+0000 7f8c90d7fb80 1 -- 172.21.15.49:0/1767635381 shutdown_connections 2023-11-30T17:23:07.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.142+0000 7f8c90d7fb80 1 -- 172.21.15.49:0/1767635381 wait complete. 2023-11-30T17:23:07.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.143+0000 7f8c90d7fb80 20 client.6858 trim_cache size 0 max 16384 2023-11-30T17:23:07.151 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T17:23:07.151 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "ef213ed4-8f62-4ad5-b55f-7510fd0ee359", 2023-11-30T17:23:07.151 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2023-11-30T17:23:07.151 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 6687, 2023-11-30T17:23:07.151 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-11-30T17:23:07.151 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-11-30T17:23:07.151 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-11-30T17:23:07.151 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 10.227619505, 2023-11-30T17:23:07.151 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 39, 2023-11-30T17:23:07.151 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 98, 2023-11-30T17:23:07.152 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 98, 2023-11-30T17:23:07.152 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 14.723492916 2023-11-30T17:23:07.152 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T17:23:07.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.143+0000 7f8c7f3e7700 1 -- 172.21.15.49:0/2583706663 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8c6405f240 msgr2=0x7f8c64061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:07.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.143+0000 7f8c7f3e7700 1 --2- 172.21.15.49:0/2583706663 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8c6405f240 0x7f8c64061700 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f8c700011e0 tx=0x7f8c70007b90).stop 2023-11-30T17:23:07.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.143+0000 7f8c7f3e7700 1 -- 172.21.15.49:0/2583706663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c78158320 msgr2=0x7f8c780aeaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:07.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.143+0000 7f8c7f3e7700 1 --2- 172.21.15.49:0/2583706663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c78158320 0x7f8c780aeaa0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7f8c6800c7c0 tx=0x7f8c68001510).stop 2023-11-30T17:23:07.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.143+0000 7f8c7f3e7700 1 -- 172.21.15.49:0/2583706663 shutdown_connections 2023-11-30T17:23:07.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.143+0000 7f8c7f3e7700 1 --2- 172.21.15.49:0/2583706663 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8c6405f240 0x7f8c64061700 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.143+0000 7f8c7f3e7700 1 --2- 172.21.15.49:0/2583706663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c78158320 0x7f8c780aeaa0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.143+0000 7f8c7f3e7700 1 --2- 172.21.15.49:0/2583706663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c78098d10 0x7f8c7814e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.143+0000 7f8c7f3e7700 1 --2- 172.21.15.49:0/2583706663 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c780c6190 0x7f8c78155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.143+0000 7f8c7f3e7700 1 -- 172.21.15.49:0/2583706663 >> 172.21.15.49:0/2583706663 conn(0x7f8c780cb310 msgr2=0x7f8c78063990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:07.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.143+0000 7f8c7f3e7700 1 -- 172.21.15.49:0/2583706663 shutdown_connections 2023-11-30T17:23:07.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.143+0000 7f8c7f3e7700 1 -- 172.21.15.49:0/2583706663 wait complete. 2023-11-30T17:23:07.156 DEBUG:teuthology.orchestra.run.smithi049:> ceph fs ls 2023-11-30T17:23:07.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.260+0000 7fc65f489700 1 Processor -- start 2023-11-30T17:23:07.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.260+0000 7fc65f489700 1 -- start start 2023-11-30T17:23:07.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.261+0000 7fc65f489700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc6580ca740 0x7fc6580cab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:07.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.261+0000 7fc65f489700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc6580c1040 0x7fc6580aa540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:07.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.261+0000 7fc65f489700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6580a9700 con 0x7fc6580aa0d0 2023-11-30T17:23:07.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.261+0000 7fc65f489700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc658154ae0 con 0x7fc6580ca740 2023-11-30T17:23:07.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.261+0000 7fc65f489700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6580a9b90 con 0x7fc6580c1040 2023-11-30T17:23:07.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.261+0000 7fc65e487700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc6580ca740 0x7fc6580cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:07.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.261+0000 7fc65dc86700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc6580aa0d0 0x7fc6580c0930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39112/0 (socket says 172.21.15.49:39112) 2023-11-30T17:23:07.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.261+0000 7fc65dc86700 1 -- 172.21.15.49:0/3903143974 learned_addr learned my addr 172.21.15.49:0/3903143974 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:07.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.261+0000 7fc65ec88700 1 --2- 172.21.15.49:0/3903143974 >> v2:172.21.15.115:3300/0 conn(0x7fc6580c1040 0x7fc6580aa540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:07.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.261+0000 7fc65e487700 1 -- 172.21.15.49:0/3903143974 >> v2:172.21.15.115:3300/0 conn(0x7fc6580c1040 msgr2=0x7fc6580aa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:07.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.261+0000 7fc65e487700 1 --2- 172.21.15.49:0/3903143974 >> v2:172.21.15.115:3300/0 conn(0x7fc6580c1040 0x7fc6580aa540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.261+0000 7fc65e487700 1 -- 172.21.15.49:0/3903143974 >> v1:172.21.15.49:6789/0 conn(0x7fc6580aa0d0 legacy=0x7fc6580c0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:07.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.261+0000 7fc65d485700 1 -- 172.21.15.49:0/3903143974 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1772288331 0 0) 0x7fc6580a9700 con 0x7fc6580aa0d0 2023-11-30T17:23:07.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.261+0000 7fc65e487700 1 -- 172.21.15.49:0/3903143974 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6580a8af0 con 0x7fc6580ca740 2023-11-30T17:23:07.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.261+0000 7fc65e487700 1 --2- 172.21.15.49:0/3903143974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6580ca740 0x7fc6580cab20 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7fc6580990a0 tx=0x7fc654009060).ready entity=mon.0 client_cookie=b1c8eaa8b42ad1c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:07.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.262+0000 7fc65d485700 1 -- 172.21.15.49:0/3903143974 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65400b610 con 0x7fc6580ca740 2023-11-30T17:23:07.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.262+0000 7fc65d485700 1 -- 172.21.15.49:0/3903143974 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65400b770 con 0x7fc6580ca740 2023-11-30T17:23:07.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.262+0000 7fc65d485700 1 -- 172.21.15.49:0/3903143974 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65400baf0 con 0x7fc6580ca740 2023-11-30T17:23:07.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.262+0000 7fc65f489700 1 -- 172.21.15.49:0/3903143974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6580ca740 msgr2=0x7fc6580cab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:07.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.262+0000 7fc65f489700 1 --2- 172.21.15.49:0/3903143974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6580ca740 0x7fc6580cab20 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7fc6580990a0 tx=0x7fc654009060).stop 2023-11-30T17:23:07.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.262+0000 7fc65f489700 1 -- 172.21.15.49:0/3903143974 shutdown_connections 2023-11-30T17:23:07.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.262+0000 7fc65f489700 1 --2- 172.21.15.49:0/3903143974 >> v2:172.21.15.115:3300/0 conn(0x7fc6580c1040 0x7fc6580aa540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.262+0000 7fc65f489700 1 --2- 172.21.15.49:0/3903143974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6580ca740 0x7fc6580cab20 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.262+0000 7fc65f489700 1 -- 172.21.15.49:0/3903143974 >> 172.21.15.49:0/3903143974 conn(0x7fc6580946d0 msgr2=0x7fc65806a690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:07.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.262+0000 7fc65f489700 1 -- 172.21.15.49:0/3903143974 shutdown_connections 2023-11-30T17:23:07.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.262+0000 7fc65f489700 1 -- 172.21.15.49:0/3903143974 wait complete. 2023-11-30T17:23:07.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.263+0000 7fc65f489700 1 Processor -- start 2023-11-30T17:23:07.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.263+0000 7fc65f489700 1 -- start start 2023-11-30T17:23:07.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.264+0000 7fc65f489700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6580aa0d0 0x7fc6580aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:07.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.264+0000 7fc65f489700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6580c1040 0x7fc6580c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:07.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.264+0000 7fc65f489700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6580ca740 0x7fc658152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:07.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.264+0000 7fc65f489700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6581678e0 con 0x7fc6580ca740 2023-11-30T17:23:07.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.264+0000 7fc65f489700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6580c5060 con 0x7fc6580c1040 2023-11-30T17:23:07.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.264+0000 7fc65f489700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc658152e10 con 0x7fc6580aa0d0 2023-11-30T17:23:07.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.264+0000 7fc65ec88700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6580ca740 0x7fc658152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:07.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.264+0000 7fc65ec88700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6580ca740 0x7fc658152920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37942/0 (socket says 172.21.15.49:37942) 2023-11-30T17:23:07.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.264+0000 7fc65ec88700 1 -- 172.21.15.49:0/1581007216 learned_addr learned my addr 172.21.15.49:0/1581007216 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:07.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.264+0000 7fc65e487700 1 --2- 172.21.15.49:0/1581007216 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6580aa0d0 0x7fc6580aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:07.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.264+0000 7fc65dc86700 1 --2- 172.21.15.49:0/1581007216 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6580c1040 0x7fc6580c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:07.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.265+0000 7fc65ec88700 1 -- 172.21.15.49:0/1581007216 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6580aa0d0 msgr2=0x7fc6580aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:07.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.265+0000 7fc65ec88700 1 --2- 172.21.15.49:0/1581007216 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6580aa0d0 0x7fc6580aea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.265+0000 7fc65ec88700 1 -- 172.21.15.49:0/1581007216 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6580c1040 msgr2=0x7fc6580c4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:07.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.265+0000 7fc65ec88700 1 --2- 172.21.15.49:0/1581007216 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6580c1040 0x7fc6580c4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.265+0000 7fc65ec88700 1 -- 172.21.15.49:0/1581007216 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6540092a0 con 0x7fc6580ca740 2023-11-30T17:23:07.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.265+0000 7fc65dc86700 1 --2- 172.21.15.49:0/1581007216 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6580c1040 0x7fc6580c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:23:07.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.265+0000 7fc65ec88700 1 --2- 172.21.15.49:0/1581007216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6580ca740 0x7fc658152920 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7fc650007f60 tx=0x7fc6500098e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:07.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.265+0000 7fc64e7fc700 1 -- 172.21.15.49:0/1581007216 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65000ec40 con 0x7fc6580ca740 2023-11-30T17:23:07.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.265+0000 7fc64e7fc700 1 -- 172.21.15.49:0/1581007216 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65000eda0 con 0x7fc6580ca740 2023-11-30T17:23:07.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.265+0000 7fc65f489700 1 -- 172.21.15.49:0/1581007216 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6580af0f0 con 0x7fc6580ca740 2023-11-30T17:23:07.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.265+0000 7fc64e7fc700 1 -- 172.21.15.49:0/1581007216 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc650014610 con 0x7fc6580ca740 2023-11-30T17:23:07.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.265+0000 7fc65f489700 1 -- 172.21.15.49:0/1581007216 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6580af6b0 con 0x7fc6580ca740 2023-11-30T17:23:07.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.266+0000 7fc65f489700 1 -- 172.21.15.49:0/1581007216 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6580a8dd0 con 0x7fc6580ca740 2023-11-30T17:23:07.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.266+0000 7fc64e7fc700 1 -- 172.21.15.49:0/1581007216 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc650014a00 con 0x7fc6580ca740 2023-11-30T17:23:07.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.267+0000 7fc64e7fc700 1 --2- 172.21.15.49:0/1581007216 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc63c05f240 0x7fc63c061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:07.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.267+0000 7fc64e7fc700 1 -- 172.21.15.49:0/1581007216 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fc65007a400 con 0x7fc6580ca740 2023-11-30T17:23:07.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.267+0000 7fc65e487700 1 --2- 172.21.15.49:0/1581007216 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc63c05f240 0x7fc63c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:07.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.267+0000 7fc65e487700 1 --2- 172.21.15.49:0/1581007216 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc63c05f240 0x7fc63c061700 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fc654009fd0 tx=0x7fc654017000).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:07.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.271+0000 7fc64e7fc700 1 -- 172.21.15.49:0/1581007216 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc650049b00 con 0x7fc6580ca740 2023-11-30T17:23:07.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.486+0000 7fc65f489700 1 -- 172.21.15.49:0/1581007216 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc658046d80 con 0x7fc6580ca740 2023-11-30T17:23:07.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.486+0000 7fc64e7fc700 1 -- 172.21.15.49:0/1581007216 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v39) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc650019020 con 0x7fc6580ca740 2023-11-30T17:23:07.488 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-30T17:23:07.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.488+0000 7fc65f489700 1 -- 172.21.15.49:0/1581007216 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc63c05f240 msgr2=0x7fc63c061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:07.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.488+0000 7fc65f489700 1 --2- 172.21.15.49:0/1581007216 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc63c05f240 0x7fc63c061700 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fc654009fd0 tx=0x7fc654017000).stop 2023-11-30T17:23:07.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.488+0000 7fc65f489700 1 -- 172.21.15.49:0/1581007216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6580ca740 msgr2=0x7fc658152920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:07.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.488+0000 7fc65f489700 1 --2- 172.21.15.49:0/1581007216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6580ca740 0x7fc658152920 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7fc650007f60 tx=0x7fc6500098e0).stop 2023-11-30T17:23:07.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.488+0000 7fc65f489700 1 -- 172.21.15.49:0/1581007216 shutdown_connections 2023-11-30T17:23:07.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.488+0000 7fc65f489700 1 --2- 172.21.15.49:0/1581007216 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc63c05f240 0x7fc63c061700 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.488+0000 7fc65f489700 1 --2- 172.21.15.49:0/1581007216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6580ca740 0x7fc658152920 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.488+0000 7fc65f489700 1 --2- 172.21.15.49:0/1581007216 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6580aa0d0 0x7fc6580aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.488+0000 7fc65f489700 1 --2- 172.21.15.49:0/1581007216 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6580c1040 0x7fc6580c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:07.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.488+0000 7fc65f489700 1 -- 172.21.15.49:0/1581007216 >> 172.21.15.49:0/1581007216 conn(0x7fc6580946d0 msgr2=0x7fc6580cab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:07.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.488+0000 7fc65f489700 1 -- 172.21.15.49:0/1581007216 shutdown_connections 2023-11-30T17:23:07.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:07.488+0000 7fc65f489700 1 -- 172.21.15.49:0/1581007216 wait complete. 2023-11-30T17:23:07.500 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-30T17:23:07.500 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-30T17:23:07.500 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-11-30T17:23:07.500 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-30T17:23:07.500 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-30T17:23:07.500 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-30T17:23:07.500 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-30T17:23:07.500 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-30T17:23:07.500 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-30T17:23:07.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:23:07.501 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-11-30T17:23:07.516 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-30T17:23:07.517 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-30T17:23:07.517 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-11-30T17:23:07.517 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:23:07.517 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-11-30T17:23:07.517 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:23:07.517 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:23:07.517 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:23:07.517 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-11-30T17:23:07.517 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:23:07.517 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:23:07.517 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-11-30T17:23:07.517 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-30T17:23:07.517 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:23:07.517 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-11-30T17:23:07.518 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-30T17:23:07.518 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 41488sec preferred_lft 41488sec 2023-11-30T17:23:07.518 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2023-11-30T17:23:07.518 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:23:07.518 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:23:07.518 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:23:07.518 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-11-30T17:23:07.518 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-30T17:23:07.518 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 32:bf:40:53:4c:5d brd ff:ff:ff:ff:ff:ff 2023-11-30T17:23:07.518 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-30T17:23:07.518 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:23:07.518 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::8b6:11ff:fe93:7174/64 scope link 2023-11-30T17:23:07.518 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:23:07.518 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-30T17:23:07.519 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 3e:e9:3c:a8:7a:95 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-30T17:23:07.519 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::3ce9:3cff:fea8:7a95/64 scope link 2023-11-30T17:23:07.519 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:23:07.519 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-30T17:23:07.519 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 32:bf:40:53:4c:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-30T17:23:07.519 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::30bf:40ff:fe53:4c5d/64 scope link 2023-11-30T17:23:07.519 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:23:07.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:23:07.519 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-30T17:23:07.581 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-11-30T17:23:07.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:23:07.583 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-11-30T17:23:07.639 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-11-30T17:23:07.639 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-30T17:23:07.640 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-30T17:23:07.640 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-30T17:23:07.640 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-30T17:23:07.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:23:07.640 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-11-30T17:23:07.640 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-11-30T17:23:07.640 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-30T17:23:07.641 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-30T17:23:07.641 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-30T17:23:07.641 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-11-30T17:23:07.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:23:07.743 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-11-30T17:23:07.757 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-30T17:23:07.758 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-30T17:23:07.758 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-30T17:23:07.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:23:07.758 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-11-30T17:23:07.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:23:07.824 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-11-30T17:23:07.879 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-30T17:23:07.879 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:23:07.960 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:23:07.960 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-30T17:23:07.985 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:23:07.985 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-30T17:23:07.987 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-30T17:23:07.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:23:07.987 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-30T17:23:08.053 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-30T17:23:08.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.211+0000 7fb1509d1700 1 Processor -- start 2023-11-30T17:23:08.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.211+0000 7fb1509d1700 1 -- start start 2023-11-30T17:23:08.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.212+0000 7fb1509d1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb14c098d10 0x7fb14c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:08.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.212+0000 7fb1509d1700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb14c0c72d0 con 0x7fb14c0c6190 2023-11-30T17:23:08.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.212+0000 7fb1509d1700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb14c064570 con 0x7fb14c158320 2023-11-30T17:23:08.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.212+0000 7fb1509d1700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb14c154bc0 con 0x7fb14c098d10 2023-11-30T17:23:08.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.212+0000 7fb14a59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb14c098d10 0x7fb14c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:08.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.212+0000 7fb149d9b700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb14c0c6190 0x7fb14c063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39128/0 (socket says 172.21.15.49:39128) 2023-11-30T17:23:08.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.212+0000 7fb149d9b700 1 -- 172.21.15.49:0/2609823826 learned_addr learned my addr 172.21.15.49:0/2609823826 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:08.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.212+0000 7fb14a59c700 1 -- 172.21.15.49:0/2609823826 >> v1:172.21.15.115:6789/0 conn(0x7fb14c158320 legacy=0x7fb14c0a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:08.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.212+0000 7fb14a59c700 1 -- 172.21.15.49:0/2609823826 >> v1:172.21.15.49:6789/0 conn(0x7fb14c0c6190 legacy=0x7fb14c063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:08.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.212+0000 7fb14959a700 1 -- 172.21.15.49:0/2609823826 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907156455 0 0) 0x7fb14c0c72d0 con 0x7fb14c0c6190 2023-11-30T17:23:08.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.212+0000 7fb14a59c700 1 -- 172.21.15.49:0/2609823826 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14c0c66c0 con 0x7fb14c098d10 2023-11-30T17:23:08.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.212+0000 7fb14a59c700 1 --2- 172.21.15.49:0/2609823826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb14c098d10 0x7fb14c0c7760 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7fb13c009760 tx=0x7fb13c009060).ready entity=mon.0 client_cookie=e71af368985c94e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:08.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.212+0000 7fb14959a700 1 -- 172.21.15.49:0/2609823826 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c00b580 con 0x7fb14c098d10 2023-11-30T17:23:08.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.212+0000 7fb14959a700 1 -- 172.21.15.49:0/2609823826 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13c00b6e0 con 0x7fb14c098d10 2023-11-30T17:23:08.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.212+0000 7fb14959a700 1 -- 172.21.15.49:0/2609823826 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c00ba60 con 0x7fb14c098d10 2023-11-30T17:23:08.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.213+0000 7fb1509d1700 1 -- 172.21.15.49:0/2609823826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb14c098d10 msgr2=0x7fb14c0c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:08.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.213+0000 7fb1509d1700 1 --2- 172.21.15.49:0/2609823826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb14c098d10 0x7fb14c0c7760 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7fb13c009760 tx=0x7fb13c009060).stop 2023-11-30T17:23:08.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.213+0000 7fb1509d1700 1 -- 172.21.15.49:0/2609823826 shutdown_connections 2023-11-30T17:23:08.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.213+0000 7fb1509d1700 1 --2- 172.21.15.49:0/2609823826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb14c098d10 0x7fb14c0c7760 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:08.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.213+0000 7fb1509d1700 1 -- 172.21.15.49:0/2609823826 >> 172.21.15.49:0/2609823826 conn(0x7fb14c0cb310 msgr2=0x7fb14c0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:08.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.213+0000 7fb1509d1700 1 -- 172.21.15.49:0/2609823826 shutdown_connections 2023-11-30T17:23:08.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.213+0000 7fb1509d1700 1 -- 172.21.15.49:0/2609823826 wait complete. 2023-11-30T17:23:08.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.214+0000 7fb1509d1700 1 Processor -- start 2023-11-30T17:23:08.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.214+0000 7fb1509d1700 1 -- start start 2023-11-30T17:23:08.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.215+0000 7fb1509d1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb14c098d10 0x7fb14c14ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:08.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.215+0000 7fb1509d1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb14c0c6190 0x7fb14c0b0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:08.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.215+0000 7fb1509d1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb14c158320 0x7fb14c0b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:08.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.215+0000 7fb1509d1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c0b1030 con 0x7fb14c098d10 2023-11-30T17:23:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.215+0000 7fb1509d1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c0b1310 con 0x7fb14c0c6190 2023-11-30T17:23:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.215+0000 7fb1509d1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c0af010 con 0x7fb14c158320 2023-11-30T17:23:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.215+0000 7fb14a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb14c098d10 0x7fb14c14ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.215+0000 7fb14a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb14c098d10 0x7fb14c14ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37958/0 (socket says 172.21.15.49:37958) 2023-11-30T17:23:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.215+0000 7fb14a59c700 1 -- 172.21.15.49:0/3495603201 learned_addr learned my addr 172.21.15.49:0/3495603201 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.215+0000 7fb14ad9d700 1 --2- 172.21.15.49:0/3495603201 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb14c158320 0x7fb14c0b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.215+0000 7fb149d9b700 1 --2- 172.21.15.49:0/3495603201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb14c0c6190 0x7fb14c0b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.215+0000 7fb14a59c700 1 -- 172.21.15.49:0/3495603201 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb14c158320 msgr2=0x7fb14c0b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.215+0000 7fb14a59c700 1 --2- 172.21.15.49:0/3495603201 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb14c158320 0x7fb14c0b0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.215+0000 7fb14a59c700 1 -- 172.21.15.49:0/3495603201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb14c0c6190 msgr2=0x7fb14c0b0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.215+0000 7fb14a59c700 1 --2- 172.21.15.49:0/3495603201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb14c0c6190 0x7fb14c0b0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:08.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.215+0000 7fb14a59c700 1 -- 172.21.15.49:0/3495603201 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13c0092a0 con 0x7fb14c098d10 2023-11-30T17:23:08.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.215+0000 7fb14ad9d700 1 --2- 172.21.15.49:0/3495603201 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb14c158320 0x7fb14c0b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:23:08.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.215+0000 7fb14a59c700 1 --2- 172.21.15.49:0/3495603201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb14c098d10 0x7fb14c14ab40 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7fb14c0c2360 tx=0x7fb13c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:08.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.216+0000 7fb1427fc700 1 -- 172.21.15.49:0/3495603201 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c00ba60 con 0x7fb14c098d10 2023-11-30T17:23:08.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.216+0000 7fb1427fc700 1 -- 172.21.15.49:0/3495603201 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13c000c90 con 0x7fb14c098d10 2023-11-30T17:23:08.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.216+0000 7fb1427fc700 1 -- 172.21.15.49:0/3495603201 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c01b620 con 0x7fb14c098d10 2023-11-30T17:23:08.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.216+0000 7fb1509d1700 1 -- 172.21.15.49:0/3495603201 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb14c0af2f0 con 0x7fb14c098d10 2023-11-30T17:23:08.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.216+0000 7fb1509d1700 1 -- 172.21.15.49:0/3495603201 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb14c0afaf0 con 0x7fb14c098d10 2023-11-30T17:23:08.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.217+0000 7fb1509d1700 1 -- 172.21.15.49:0/3495603201 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb14c0af810 con 0x7fb14c098d10 2023-11-30T17:23:08.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.217+0000 7fb1427fc700 1 -- 172.21.15.49:0/3495603201 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb13c01ba10 con 0x7fb14c098d10 2023-11-30T17:23:08.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.217+0000 7fb1427fc700 1 --2- 172.21.15.49:0/3495603201 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb12c05f240 0x7fb12c061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:08.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.218+0000 7fb1427fc700 1 -- 172.21.15.49:0/3495603201 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fb13c07c0f0 con 0x7fb14c098d10 2023-11-30T17:23:08.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.218+0000 7fb149d9b700 1 --2- 172.21.15.49:0/3495603201 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb12c05f240 0x7fb12c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:08.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.218+0000 7fb149d9b700 1 --2- 172.21.15.49:0/3495603201 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb12c05f240 0x7fb12c061700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb134007fd0 tx=0x7fb134009040).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:08.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.222+0000 7fb1427fc700 1 -- 172.21.15.49:0/3495603201 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb13c04d1c0 con 0x7fb14c098d10 2023-11-30T17:23:08.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.422+0000 7fb1509d1700 1 -- 172.21.15.49:0/3495603201 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb14c06c860 con 0x7fb12c05f240 2023-11-30T17:23:08.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.423+0000 7fb1427fc700 1 -- 172.21.15.49:0/3495603201 <== mgr.6358 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fb14c06c860 con 0x7fb12c05f240 2023-11-30T17:23:08.425 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-11-30T17:23:08.425 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:23:08.425 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cephfs" 2023-11-30T17:23:08.425 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:23:08.425 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-11-30T17:23:08.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.425+0000 7fb1509d1700 1 -- 172.21.15.49:0/3495603201 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb12c05f240 msgr2=0x7fb12c061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:08.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.425+0000 7fb1509d1700 1 --2- 172.21.15.49:0/3495603201 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb12c05f240 0x7fb12c061700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb134007fd0 tx=0x7fb134009040).stop 2023-11-30T17:23:08.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.425+0000 7fb1509d1700 1 -- 172.21.15.49:0/3495603201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb14c098d10 msgr2=0x7fb14c14ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:08.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.425+0000 7fb1509d1700 1 --2- 172.21.15.49:0/3495603201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb14c098d10 0x7fb14c14ab40 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7fb14c0c2360 tx=0x7fb13c017000).stop 2023-11-30T17:23:08.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.425+0000 7fb1509d1700 1 -- 172.21.15.49:0/3495603201 shutdown_connections 2023-11-30T17:23:08.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.425+0000 7fb1509d1700 1 --2- 172.21.15.49:0/3495603201 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb14c158320 0x7fb14c0b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:08.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.425+0000 7fb1509d1700 1 --2- 172.21.15.49:0/3495603201 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb12c05f240 0x7fb12c061700 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:08.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.425+0000 7fb1509d1700 1 --2- 172.21.15.49:0/3495603201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb14c098d10 0x7fb14c14ab40 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:08.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.425+0000 7fb1509d1700 1 --2- 172.21.15.49:0/3495603201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb14c0c6190 0x7fb14c0b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:08.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.425+0000 7fb1509d1700 1 -- 172.21.15.49:0/3495603201 >> 172.21.15.49:0/3495603201 conn(0x7fb14c0cb310 msgr2=0x7fb14c14c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:08.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.425+0000 7fb1509d1700 1 -- 172.21.15.49:0/3495603201 shutdown_connections 2023-11-30T17:23:08.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.425+0000 7fb1509d1700 1 -- 172.21.15.49:0/3495603201 wait complete. 2023-11-30T17:23:08.439 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-11-30T17:23:08.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.557+0000 7fe1e31c0700 1 Processor -- start 2023-11-30T17:23:08.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.557+0000 7fe1e31c0700 1 -- start start 2023-11-30T17:23:08.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.558+0000 7fe1e31c0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1dc098d10 0x7fe1dc0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:08.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.558+0000 7fe1e31c0700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe1dc158320 0x7fe1dc1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:08.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.558+0000 7fe1e31c0700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1dc158cc0 con 0x7fe1dc0c6190 2023-11-30T17:23:08.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.558+0000 7fe1e31c0700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1dc0c72d0 con 0x7fe1dc158320 2023-11-30T17:23:08.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.558+0000 7fe1e31c0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1dc064570 con 0x7fe1dc098d10 2023-11-30T17:23:08.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.558+0000 7fe1e175d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe1dc158320 0x7fe1dc1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:08.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.558+0000 7fe1dbfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe1dc0c6190 0x7fe1dc063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39130/0 (socket says 172.21.15.49:39130) 2023-11-30T17:23:08.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.558+0000 7fe1e175d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe1dc158320 0x7fe1dc1587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37970/0 (socket says 172.21.15.49:37970) 2023-11-30T17:23:08.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.558+0000 7fe1dbfff700 1 -- 172.21.15.49:0/3078957472 learned_addr learned my addr 172.21.15.49:0/3078957472 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:08.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.558+0000 7fe1e0f5c700 1 --2- 172.21.15.49:0/3078957472 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1dc098d10 0x7fe1dc0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:08.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.559+0000 7fe1e175d700 1 -- 172.21.15.49:0/3078957472 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1dc098d10 msgr2=0x7fe1dc0c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:08.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.559+0000 7fe1e175d700 1 --2- 172.21.15.49:0/3078957472 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1dc098d10 0x7fe1dc0c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:08.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.559+0000 7fe1e175d700 1 -- 172.21.15.49:0/3078957472 >> v1:172.21.15.49:6789/0 conn(0x7fe1dc0c6190 legacy=0x7fe1dc063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:08.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.559+0000 7fe1e175d700 1 -- 172.21.15.49:0/3078957472 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1dc154bc0 con 0x7fe1dc158320 2023-11-30T17:23:08.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.559+0000 7fe1db7fe700 1 -- 172.21.15.49:0/3078957472 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 782337462 0 0) 0x7fe1cc001490 con 0x7fe1dc0c6190 2023-11-30T17:23:08.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.559+0000 7fe1e0f5c700 1 --2- 172.21.15.49:0/3078957472 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1dc098d10 0x7fe1dc0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:23:08.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.559+0000 7fe1e175d700 1 --2- 172.21.15.49:0/3078957472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1dc158320 0x7fe1dc1587d0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7fe1c4009760 tx=0x7fe1c4009060).ready entity=mon.0 client_cookie=ddc835248f14bfae server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:08.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.559+0000 7fe1db7fe700 1 -- 172.21.15.49:0/3078957472 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c400b580 con 0x7fe1dc158320 2023-11-30T17:23:08.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.559+0000 7fe1db7fe700 1 -- 172.21.15.49:0/3078957472 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c400b6e0 con 0x7fe1dc158320 2023-11-30T17:23:08.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.559+0000 7fe1db7fe700 1 -- 172.21.15.49:0/3078957472 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c400ba60 con 0x7fe1dc158320 2023-11-30T17:23:08.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.559+0000 7fe1e31c0700 1 -- 172.21.15.49:0/3078957472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1dc158320 msgr2=0x7fe1dc1587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:08.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.559+0000 7fe1e31c0700 1 --2- 172.21.15.49:0/3078957472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1dc158320 0x7fe1dc1587d0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7fe1c4009760 tx=0x7fe1c4009060).stop 2023-11-30T17:23:08.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.559+0000 7fe1e31c0700 1 -- 172.21.15.49:0/3078957472 shutdown_connections 2023-11-30T17:23:08.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.559+0000 7fe1e31c0700 1 --2- 172.21.15.49:0/3078957472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1dc158320 0x7fe1dc1587d0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:08.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.559+0000 7fe1e31c0700 1 --2- 172.21.15.49:0/3078957472 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1dc098d10 0x7fe1dc0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:08.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.559+0000 7fe1e31c0700 1 -- 172.21.15.49:0/3078957472 >> 172.21.15.49:0/3078957472 conn(0x7fe1dc0cb310 msgr2=0x7fe1dc0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:08.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.559+0000 7fe1e31c0700 1 -- 172.21.15.49:0/3078957472 shutdown_connections 2023-11-30T17:23:08.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.559+0000 7fe1e31c0700 1 -- 172.21.15.49:0/3078957472 wait complete. 2023-11-30T17:23:08.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.560+0000 7fe1e31c0700 1 Processor -- start 2023-11-30T17:23:08.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.561+0000 7fe1e31c0700 1 -- start start 2023-11-30T17:23:08.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.561+0000 7fe1e31c0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1dc098d10 0x7fe1dc14beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:08.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.561+0000 7fe1e31c0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1dc0c6190 0x7fe1dc151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:08.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.561+0000 7fe1e31c0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1dc158320 0x7fe1dc151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:08.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.561+0000 7fe1e31c0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1dc151c00 con 0x7fe1dc098d10 2023-11-30T17:23:08.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.561+0000 7fe1e31c0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1dc168d60 con 0x7fe1dc158320 2023-11-30T17:23:08.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.561+0000 7fe1e31c0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1dc0ae400 con 0x7fe1dc0c6190 2023-11-30T17:23:08.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.562+0000 7fe1e0f5c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1dc098d10 0x7fe1dc14beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:08.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.562+0000 7fe1e0f5c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1dc098d10 0x7fe1dc14beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37976/0 (socket says 172.21.15.49:37976) 2023-11-30T17:23:08.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.562+0000 7fe1e0f5c700 1 -- 172.21.15.49:0/1302570716 learned_addr learned my addr 172.21.15.49:0/1302570716 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:08.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.562+0000 7fe1dbfff700 1 --2- 172.21.15.49:0/1302570716 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1dc0c6190 0x7fe1dc151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:08.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.562+0000 7fe1e175d700 1 --2- 172.21.15.49:0/1302570716 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1dc158320 0x7fe1dc151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:08.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.562+0000 7fe1e0f5c700 1 -- 172.21.15.49:0/1302570716 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1dc0c6190 msgr2=0x7fe1dc151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:08.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.562+0000 7fe1e0f5c700 1 --2- 172.21.15.49:0/1302570716 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1dc0c6190 0x7fe1dc151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:08.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.562+0000 7fe1e0f5c700 1 -- 172.21.15.49:0/1302570716 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1dc158320 msgr2=0x7fe1dc151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:08.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.562+0000 7fe1e0f5c700 1 --2- 172.21.15.49:0/1302570716 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1dc158320 0x7fe1dc151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:08.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.562+0000 7fe1e0f5c700 1 -- 172.21.15.49:0/1302570716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c40092a0 con 0x7fe1dc098d10 2023-11-30T17:23:08.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.562+0000 7fe1e175d700 1 --2- 172.21.15.49:0/1302570716 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1dc158320 0x7fe1dc151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:23:08.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.562+0000 7fe1e0f5c700 1 --2- 172.21.15.49:0/1302570716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1dc098d10 0x7fe1dc14beb0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7fe1d400d860 tx=0x7fe1d4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:08.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.562+0000 7fe1d8ff9700 1 -- 172.21.15.49:0/1302570716 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4011590 con 0x7fe1dc098d10 2023-11-30T17:23:08.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.562+0000 7fe1d8ff9700 1 -- 172.21.15.49:0/1302570716 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d40116f0 con 0x7fe1dc098d10 2023-11-30T17:23:08.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.562+0000 7fe1e31c0700 1 -- 172.21.15.49:0/1302570716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1dc168170 con 0x7fe1dc098d10 2023-11-30T17:23:08.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.562+0000 7fe1d8ff9700 1 -- 172.21.15.49:0/1302570716 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4011a70 con 0x7fe1dc098d10 2023-11-30T17:23:08.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.562+0000 7fe1e31c0700 1 -- 172.21.15.49:0/1302570716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1dc168710 con 0x7fe1dc098d10 2023-11-30T17:23:08.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.563+0000 7fe1e31c0700 1 -- 172.21.15.49:0/1302570716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1dc06c860 con 0x7fe1dc098d10 2023-11-30T17:23:08.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.564+0000 7fe1d8ff9700 1 -- 172.21.15.49:0/1302570716 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe1d4012420 con 0x7fe1dc098d10 2023-11-30T17:23:08.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.564+0000 7fe1d8ff9700 1 --2- 172.21.15.49:0/1302570716 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe1bc05f240 0x7fe1bc061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:08.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.564+0000 7fe1d8ff9700 1 -- 172.21.15.49:0/1302570716 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fe1d4079f30 con 0x7fe1dc098d10 2023-11-30T17:23:08.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.564+0000 7fe1dbfff700 1 --2- 172.21.15.49:0/1302570716 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe1bc05f240 0x7fe1bc061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:08.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.565+0000 7fe1dbfff700 1 --2- 172.21.15.49:0/1302570716 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe1bc05f240 0x7fe1bc061700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fe1dc156710 tx=0x7fe1cc009040).ready entity=mgr.6358 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:08.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.568+0000 7fe1d8ff9700 1 -- 172.21.15.49:0/1302570716 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe1d404b000 con 0x7fe1dc098d10 2023-11-30T17:23:08.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.785+0000 7fe1e31c0700 1 -- 172.21.15.49:0/1302570716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fe1dc0c66c0 con 0x7fe1dc098d10 2023-11-30T17:23:08.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.958+0000 7fe1d8ff9700 1 -- 172.21.15.49:0/1302570716 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 33) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fe1d4077b60 con 0x7fe1dc098d10 2023-11-30T17:23:08.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.959+0000 7fe1d8ff9700 1 -- 172.21.15.49:0/1302570716 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v33) v1 ==== 92+0+0 (secure 0 0 0) 0x7fe1d40728c0 con 0x7fe1dc098d10 2023-11-30T17:23:08.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.961+0000 7fe1e31c0700 1 -- 172.21.15.49:0/1302570716 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe1bc05f240 msgr2=0x7fe1bc061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:08.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.961+0000 7fe1e31c0700 1 --2- 172.21.15.49:0/1302570716 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe1bc05f240 0x7fe1bc061700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fe1dc156710 tx=0x7fe1cc009040).stop 2023-11-30T17:23:08.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.961+0000 7fe1e31c0700 1 -- 172.21.15.49:0/1302570716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1dc098d10 msgr2=0x7fe1dc14beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:08.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.961+0000 7fe1e31c0700 1 --2- 172.21.15.49:0/1302570716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1dc098d10 0x7fe1dc14beb0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7fe1d400d860 tx=0x7fe1d4008040).stop 2023-11-30T17:23:08.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.961+0000 7fe1e31c0700 1 -- 172.21.15.49:0/1302570716 shutdown_connections 2023-11-30T17:23:08.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.961+0000 7fe1e31c0700 1 --2- 172.21.15.49:0/1302570716 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1dc158320 0x7fe1dc151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:08.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.961+0000 7fe1e31c0700 1 --2- 172.21.15.49:0/1302570716 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe1bc05f240 0x7fe1bc061700 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:08.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.961+0000 7fe1e31c0700 1 --2- 172.21.15.49:0/1302570716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1dc098d10 0x7fe1dc14beb0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:08.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.961+0000 7fe1e31c0700 1 --2- 172.21.15.49:0/1302570716 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1dc0c6190 0x7fe1dc151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:08.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.961+0000 7fe1e31c0700 1 -- 172.21.15.49:0/1302570716 >> 172.21.15.49:0/1302570716 conn(0x7fe1dc0cb310 msgr2=0x7fe1dc152120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:08.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.962+0000 7fe1e31c0700 1 -- 172.21.15.49:0/1302570716 shutdown_connections 2023-11-30T17:23:08.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:08.962+0000 7fe1e31c0700 1 -- 172.21.15.49:0/1302570716 wait complete. 2023-11-30T17:23:08.976 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-11-30T17:23:09.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.097+0000 7fe68f59e700 1 Processor -- start 2023-11-30T17:23:09.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.097+0000 7fe68f59e700 1 -- start start 2023-11-30T17:23:09.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.098+0000 7fe68f59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe690152090 0x7fe690066770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:09.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.098+0000 7fe68f59e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe690152470 0x7fe6900aa5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:09.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.098+0000 7fe68f59e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe690066d50 con 0x7fe6900aaae0 2023-11-30T17:23:09.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.098+0000 7fe68f59e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6900bc600 con 0x7fe690152470 2023-11-30T17:23:09.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.098+0000 7fe68f59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6900bc8e0 con 0x7fe690152090 2023-11-30T17:23:09.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.098+0000 7fe68dd9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe690152470 0x7fe6900aa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:09.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.098+0000 7fe68ed9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe6900aaae0 0x7fe6900637d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39148/0 (socket says 172.21.15.49:39148) 2023-11-30T17:23:09.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.098+0000 7fe68ed9d700 1 -- 172.21.15.49:0/3704805074 learned_addr learned my addr 172.21.15.49:0/3704805074 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:09.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.098+0000 7fe68e59c700 1 --2- 172.21.15.49:0/3704805074 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe690152090 0x7fe690066770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:09.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.099+0000 7fe68dd9b700 1 -- 172.21.15.49:0/3704805074 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe690152090 msgr2=0x7fe690066770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:09.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.099+0000 7fe68dd9b700 1 --2- 172.21.15.49:0/3704805074 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe690152090 0x7fe690066770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:09.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.099+0000 7fe68dd9b700 1 -- 172.21.15.49:0/3704805074 >> v1:172.21.15.49:6789/0 conn(0x7fe6900aaae0 legacy=0x7fe6900637d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:09.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.099+0000 7fe68d59a700 1 -- 172.21.15.49:0/3704805074 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2720879816 0 0) 0x7fe690066d50 con 0x7fe6900aaae0 2023-11-30T17:23:09.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.099+0000 7fe68dd9b700 1 -- 172.21.15.49:0/3704805074 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6900632b0 con 0x7fe690152470 2023-11-30T17:23:09.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.099+0000 7fe68dd9b700 1 --2- 172.21.15.49:0/3704805074 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe690152470 0x7fe6900aa5f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7fe680009760 tx=0x7fe680009060).ready entity=mon.0 client_cookie=ba687fc0db977d30 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:09.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.099+0000 7fe68d59a700 1 -- 172.21.15.49:0/3704805074 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6800090d0 con 0x7fe690152470 2023-11-30T17:23:09.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.099+0000 7fe68d59a700 1 -- 172.21.15.49:0/3704805074 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68000f510 con 0x7fe690152470 2023-11-30T17:23:09.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.099+0000 7fe68d59a700 1 -- 172.21.15.49:0/3704805074 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68000f890 con 0x7fe690152470 2023-11-30T17:23:09.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.100+0000 7fe68f59e700 1 -- 172.21.15.49:0/3704805074 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe690152470 msgr2=0x7fe6900aa5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:09.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.100+0000 7fe68f59e700 1 --2- 172.21.15.49:0/3704805074 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe690152470 0x7fe6900aa5f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7fe680009760 tx=0x7fe680009060).stop 2023-11-30T17:23:09.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.100+0000 7fe68f59e700 1 -- 172.21.15.49:0/3704805074 shutdown_connections 2023-11-30T17:23:09.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.100+0000 7fe68f59e700 1 --2- 172.21.15.49:0/3704805074 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe690152090 0x7fe690066770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:09.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.100+0000 7fe68f59e700 1 --2- 172.21.15.49:0/3704805074 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe690152470 0x7fe6900aa5f0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:09.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.100+0000 7fe68f59e700 1 -- 172.21.15.49:0/3704805074 >> 172.21.15.49:0/3704805074 conn(0x7fe6900c4010 msgr2=0x7fe6900c4420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:09.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.100+0000 7fe68f59e700 1 -- 172.21.15.49:0/3704805074 shutdown_connections 2023-11-30T17:23:09.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.100+0000 7fe68f59e700 1 -- 172.21.15.49:0/3704805074 wait complete. 2023-11-30T17:23:09.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.101+0000 7fe68f59e700 1 Processor -- start 2023-11-30T17:23:09.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.101+0000 7fe68f59e700 1 -- start start 2023-11-30T17:23:09.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.102+0000 7fe68f59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6900aaae0 0x7fe690168400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:09.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.102+0000 7fe68f59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe690152090 0x7fe69014ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:09.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.102+0000 7fe68f59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe690152470 0x7fe69014c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:09.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.102+0000 7fe68f59e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6901688f0 con 0x7fe690152470 2023-11-30T17:23:09.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.102+0000 7fe68f59e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69014b200 con 0x7fe690152090 2023-11-30T17:23:09.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.102+0000 7fe68f59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69014b480 con 0x7fe6900aaae0 2023-11-30T17:23:09.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.102+0000 7fe68ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe690152470 0x7fe69014c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:09.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.102+0000 7fe68e59c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6900aaae0 0x7fe690168400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:09.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.102+0000 7fe68ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe690152470 0x7fe69014c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38010/0 (socket says 172.21.15.49:38010) 2023-11-30T17:23:09.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.102+0000 7fe68e59c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6900aaae0 0x7fe690168400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:60708/0 (socket says 172.21.15.49:60708) 2023-11-30T17:23:09.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.102+0000 7fe68ed9d700 1 -- 172.21.15.49:0/2358695708 learned_addr learned my addr 172.21.15.49:0/2358695708 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:09.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.102+0000 7fe68dd9b700 1 --2- 172.21.15.49:0/2358695708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe690152090 0x7fe69014ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:09.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.102+0000 7fe68ed9d700 1 -- 172.21.15.49:0/2358695708 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6900aaae0 msgr2=0x7fe690168400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:09.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.102+0000 7fe68ed9d700 1 --2- 172.21.15.49:0/2358695708 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6900aaae0 0x7fe690168400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:09.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.102+0000 7fe68ed9d700 1 -- 172.21.15.49:0/2358695708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe690152090 msgr2=0x7fe69014ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:09.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.102+0000 7fe68ed9d700 1 --2- 172.21.15.49:0/2358695708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe690152090 0x7fe69014ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:09.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.102+0000 7fe68ed9d700 1 -- 172.21.15.49:0/2358695708 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6800092a0 con 0x7fe690152470 2023-11-30T17:23:09.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.102+0000 7fe68e59c700 1 --2- 172.21.15.49:0/2358695708 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6900aaae0 0x7fe690168400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:23:09.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.102+0000 7fe68ed9d700 1 --2- 172.21.15.49:0/2358695708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe690152470 0x7fe69014c520 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7fe68800c730 tx=0x7fe688001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:09.107 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:09.102+0000 7f6ae85fd680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T17:23:09.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.102+0000 7fe67e7fc700 1 -- 172.21.15.49:0/2358695708 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe688005d30 con 0x7fe690152470 2023-11-30T17:23:09.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.102+0000 7fe67e7fc700 1 -- 172.21.15.49:0/2358695708 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe688005e90 con 0x7fe690152470 2023-11-30T17:23:09.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.102+0000 7fe68f59e700 1 -- 172.21.15.49:0/2358695708 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe69014b760 con 0x7fe690152470 2023-11-30T17:23:09.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.102+0000 7fe67e7fc700 1 -- 172.21.15.49:0/2358695708 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe688007300 con 0x7fe690152470 2023-11-30T17:23:09.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.103+0000 7fe68f59e700 1 -- 172.21.15.49:0/2358695708 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe69014bd20 con 0x7fe690152470 2023-11-30T17:23:09.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.104+0000 7fe68f59e700 1 -- 172.21.15.49:0/2358695708 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe69006c7c0 con 0x7fe690152470 2023-11-30T17:23:09.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.104+0000 7fe67e7fc700 1 -- 172.21.15.49:0/2358695708 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 33) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fe6880076b0 con 0x7fe690152470 2023-11-30T17:23:09.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.105+0000 7fe67e7fc700 1 --2- 172.21.15.49:0/2358695708 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe67005f2c0 0x7fe670061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:09.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.105+0000 7fe67e7fc700 1 -- 172.21.15.49:0/2358695708 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fe688079eb0 con 0x7fe690152470 2023-11-30T17:23:09.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.105+0000 7fe68e59c700 1 -- 172.21.15.49:0/2358695708 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe67005f2c0 msgr2=0x7fe670061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:23:09.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.105+0000 7fe68e59c700 1 --2- 172.21.15.49:0/2358695708 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe67005f2c0 0x7fe670061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:23:09.109 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:09.104+0000 7fe7bf1b9680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T17:23:09.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.109+0000 7fe67e7fc700 1 -- 172.21.15.49:0/2358695708 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe68804afe0 con 0x7fe690152470 2023-11-30T17:23:09.168 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:09.167+0000 7fe7bf1b9680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T17:23:09.172 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:09.171+0000 7f6ae85fd680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T17:23:09.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.285+0000 7fe68f59e700 1 -- 172.21.15.49:0/2358695708 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fe6900be280 con 0x7fe690152470 2023-11-30T17:23:09.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.289+0000 7fe67e7fc700 1 -- 172.21.15.49:0/2358695708 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v15)=0 v15) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe688018030 con 0x7fe690152470 2023-11-30T17:23:09.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.291+0000 7fe68f59e700 1 -- 172.21.15.49:0/2358695708 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe67005f2c0 msgr2=0x7fe670061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:23:09.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.291+0000 7fe68f59e700 1 --2- 172.21.15.49:0/2358695708 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe67005f2c0 0x7fe670061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:09.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.291+0000 7fe68f59e700 1 -- 172.21.15.49:0/2358695708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe690152470 msgr2=0x7fe69014c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:09.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.291+0000 7fe68f59e700 1 --2- 172.21.15.49:0/2358695708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe690152470 0x7fe69014c520 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7fe68800c730 tx=0x7fe688001520).stop 2023-11-30T17:23:09.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.291+0000 7fe68f59e700 1 -- 172.21.15.49:0/2358695708 shutdown_connections 2023-11-30T17:23:09.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.291+0000 7fe68f59e700 1 --2- 172.21.15.49:0/2358695708 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe67005f2c0 0x7fe670061780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:09.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.291+0000 7fe68f59e700 1 --2- 172.21.15.49:0/2358695708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe690152470 0x7fe69014c520 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:09.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.291+0000 7fe68f59e700 1 --2- 172.21.15.49:0/2358695708 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6900aaae0 0x7fe690168400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:09.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.291+0000 7fe68f59e700 1 --2- 172.21.15.49:0/2358695708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe690152090 0x7fe69014ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:09.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.291+0000 7fe68f59e700 1 -- 172.21.15.49:0/2358695708 >> 172.21.15.49:0/2358695708 conn(0x7fe6900c4010 msgr2=0x7fe69014fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:09.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.291+0000 7fe68f59e700 1 -- 172.21.15.49:0/2358695708 shutdown_connections 2023-11-30T17:23:09.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.291+0000 7fe68f59e700 1 -- 172.21.15.49:0/2358695708 wait complete. 2023-11-30T17:23:09.304 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-11-30T17:23:09.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.426+0000 7fb37aa9a700 1 Processor -- start 2023-11-30T17:23:09.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.426+0000 7fb37aa9a700 1 -- start start 2023-11-30T17:23:09.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.426+0000 7fb37aa9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb3740c5f30 0x7fb3740c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:09.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.426+0000 7fb37aa9a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb374063af0 0x7fb374063f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:09.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.426+0000 7fb37aa9a700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3740c68d0 con 0x7fb3741373a0 2023-11-30T17:23:09.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.427+0000 7fb37aa9a700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb374158e20 con 0x7fb374063af0 2023-11-30T17:23:09.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.427+0000 7fb37aa9a700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3741582a0 con 0x7fb3740c5f30 2023-11-30T17:23:09.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.427+0000 7fb379037700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb374063af0 0x7fb374063f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:09.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.427+0000 7fb379037700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb374063af0 0x7fb374063f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38020/0 (socket says 172.21.15.49:38020) 2023-11-30T17:23:09.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.427+0000 7fb379037700 1 -- 172.21.15.49:0/3852793381 learned_addr learned my addr 172.21.15.49:0/3852793381 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:09.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.427+0000 7fb373fff700 1 --2- 172.21.15.49:0/3852793381 >> v2:172.21.15.115:3300/0 conn(0x7fb3740c5f30 0x7fb3740c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:09.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.427+0000 7fb379037700 1 -- 172.21.15.49:0/3852793381 >> v2:172.21.15.115:3300/0 conn(0x7fb3740c5f30 msgr2=0x7fb3740c63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:09.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.427+0000 7fb379037700 1 --2- 172.21.15.49:0/3852793381 >> v2:172.21.15.115:3300/0 conn(0x7fb3740c5f30 0x7fb3740c63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:09.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.427+0000 7fb379037700 1 -- 172.21.15.49:0/3852793381 >> v1:172.21.15.115:6789/0 conn(0x7fb3741373a0 legacy=0x7fb3740c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:09.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.427+0000 7fb3737fe700 1 -- 172.21.15.49:0/3852793381 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2296522696 0 0) 0x7fb368001110 con 0x7fb3741373a0 2023-11-30T17:23:09.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.427+0000 7fb379037700 1 -- 172.21.15.49:0/3852793381 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb374158580 con 0x7fb374063af0 2023-11-30T17:23:09.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.427+0000 7fb379037700 1 --2- 172.21.15.49:0/3852793381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb374063af0 0x7fb374063f40 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7fb374069110 tx=0x7fb36c009840).ready entity=mon.0 client_cookie=4ec5e12f076f7bfc server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:09.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.427+0000 7fb3737fe700 1 -- 172.21.15.49:0/3852793381 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36c00e070 con 0x7fb374063af0 2023-11-30T17:23:09.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.427+0000 7fb3737fe700 1 -- 172.21.15.49:0/3852793381 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36c00ba20 con 0x7fb374063af0 2023-11-30T17:23:09.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.427+0000 7fb3737fe700 1 -- 172.21.15.49:0/3852793381 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36c00bda0 con 0x7fb374063af0 2023-11-30T17:23:09.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.428+0000 7fb37aa9a700 1 -- 172.21.15.49:0/3852793381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb374063af0 msgr2=0x7fb374063f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:09.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.428+0000 7fb37aa9a700 1 --2- 172.21.15.49:0/3852793381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb374063af0 0x7fb374063f40 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7fb374069110 tx=0x7fb36c009840).stop 2023-11-30T17:23:09.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.428+0000 7fb37aa9a700 1 -- 172.21.15.49:0/3852793381 shutdown_connections 2023-11-30T17:23:09.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.428+0000 7fb37aa9a700 1 --2- 172.21.15.49:0/3852793381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb374063af0 0x7fb374063f40 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:09.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.428+0000 7fb37aa9a700 1 --2- 172.21.15.49:0/3852793381 >> v2:172.21.15.115:3300/0 conn(0x7fb3740c5f30 0x7fb3740c63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:09.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.428+0000 7fb37aa9a700 1 -- 172.21.15.49:0/3852793381 >> 172.21.15.49:0/3852793381 conn(0x7fb3740628f0 msgr2=0x7fb374062d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:09.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.428+0000 7fb37aa9a700 1 -- 172.21.15.49:0/3852793381 shutdown_connections 2023-11-30T17:23:09.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.428+0000 7fb37aa9a700 1 -- 172.21.15.49:0/3852793381 wait complete. 2023-11-30T17:23:09.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.429+0000 7fb37aa9a700 1 Processor -- start 2023-11-30T17:23:09.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.429+0000 7fb37aa9a700 1 -- start start 2023-11-30T17:23:09.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.430+0000 7fb37aa9a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb374063af0 0x7fb37414ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:09.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.430+0000 7fb37aa9a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3740c5f30 0x7fb374152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:09.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.430+0000 7fb37aa9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3741373a0 0x7fb374153350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:09.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.430+0000 7fb37aa9a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb374153840 con 0x7fb374063af0 2023-11-30T17:23:09.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.430+0000 7fb37aa9a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb374151630 con 0x7fb3741373a0 2023-11-30T17:23:09.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.430+0000 7fb37aa9a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb374155420 con 0x7fb3740c5f30 2023-11-30T17:23:09.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.430+0000 7fb378836700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb374063af0 0x7fb37414ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:09.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.430+0000 7fb378836700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb374063af0 0x7fb37414ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38034/0 (socket says 172.21.15.49:38034) 2023-11-30T17:23:09.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.430+0000 7fb378836700 1 -- 172.21.15.49:0/3628684447 learned_addr learned my addr 172.21.15.49:0/3628684447 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:09.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.430+0000 7fb379037700 1 --2- 172.21.15.49:0/3628684447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3741373a0 0x7fb374153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:09.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.430+0000 7fb373fff700 1 --2- 172.21.15.49:0/3628684447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3740c5f30 0x7fb374152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:09.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.431+0000 7fb378836700 1 -- 172.21.15.49:0/3628684447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3740c5f30 msgr2=0x7fb374152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:09.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.431+0000 7fb378836700 1 --2- 172.21.15.49:0/3628684447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3740c5f30 0x7fb374152e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:09.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.431+0000 7fb378836700 1 -- 172.21.15.49:0/3628684447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3741373a0 msgr2=0x7fb374153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:09.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.431+0000 7fb378836700 1 --2- 172.21.15.49:0/3628684447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3741373a0 0x7fb374153350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:09.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.431+0000 7fb378836700 1 -- 172.21.15.49:0/3628684447 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36c009ae0 con 0x7fb374063af0 2023-11-30T17:23:09.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.431+0000 7fb378836700 1 --2- 172.21.15.49:0/3628684447 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb374063af0 0x7fb37414ddf0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7fb36800c470 tx=0x7fb368007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:09.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.431+0000 7fb370ff9700 1 -- 172.21.15.49:0/3628684447 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb368007020 con 0x7fb374063af0 2023-11-30T17:23:09.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.431+0000 7fb370ff9700 1 -- 172.21.15.49:0/3628684447 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3680071a0 con 0x7fb374063af0 2023-11-30T17:23:09.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.431+0000 7fb37aa9a700 1 -- 172.21.15.49:0/3628684447 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb374154e50 con 0x7fb374063af0 2023-11-30T17:23:09.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.431+0000 7fb370ff9700 1 -- 172.21.15.49:0/3628684447 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb368007560 con 0x7fb374063af0 2023-11-30T17:23:09.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.431+0000 7fb37aa9a700 1 -- 172.21.15.49:0/3628684447 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb374151070 con 0x7fb374063af0 2023-11-30T17:23:09.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.432+0000 7fb37aa9a700 1 -- 172.21.15.49:0/3628684447 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb37406c860 con 0x7fb374063af0 2023-11-30T17:23:09.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.432+0000 7fb370ff9700 1 -- 172.21.15.49:0/3628684447 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 33) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fb3680068b0 con 0x7fb374063af0 2023-11-30T17:23:09.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.433+0000 7fb370ff9700 1 --2- 172.21.15.49:0/3628684447 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb35805f2c0 0x7fb358061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:09.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.433+0000 7fb373fff700 1 -- 172.21.15.49:0/3628684447 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb35805f2c0 msgr2=0x7fb358061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:23:09.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.433+0000 7fb370ff9700 1 -- 172.21.15.49:0/3628684447 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fb368079540 con 0x7fb374063af0 2023-11-30T17:23:09.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.433+0000 7fb373fff700 1 --2- 172.21.15.49:0/3628684447 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb35805f2c0 0x7fb358061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:23:09.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.440+0000 7fb370ff9700 1 -- 172.21.15.49:0/3628684447 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb368047b00 con 0x7fb374063af0 2023-11-30T17:23:09.443 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:09.442+0000 7fe7bf1b9680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T17:23:09.468 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:09.467+0000 7f6ae85fd680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T17:23:09.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.634+0000 7fb373fff700 1 -- 172.21.15.49:0/3628684447 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb35805f2c0 msgr2=0x7fb358061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:23:09.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.634+0000 7fb373fff700 1 --2- 172.21.15.49:0/3628684447 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb35805f2c0 0x7fb358061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:23:09.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:09.640+0000 7fb37aa9a700 1 -- 172.21.15.49:0/3628684447 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb374155560 con 0x7fb35805f2c0 2023-11-30T17:23:10.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:10.035+0000 7fb373fff700 1 -- 172.21.15.49:0/3628684447 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb35805f2c0 msgr2=0x7fb358061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:23:10.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:10.035+0000 7fb373fff700 1 --2- 172.21.15.49:0/3628684447 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb35805f2c0 0x7fb358061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-11-30T17:23:10.053 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:10.051+0000 7fe7bf1b9680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T17:23:10.124 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:10.122+0000 7fe7bf1b9680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T17:23:10.134 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:10.132+0000 7f6ae85fd680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T17:23:10.202 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:10.201+0000 7f6ae85fd680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T17:23:10.309 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:10.308+0000 7fe7bf1b9680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T17:23:10.397 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:10.395+0000 7f6ae85fd680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T17:23:10.730 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:10.729+0000 7fe7bf1b9680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T17:23:10.836 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:10.834+0000 7f6ae85fd680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T17:23:10.836 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:10.832+0000 7fe7bf1b9680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:23:10.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:10.836+0000 7fb373fff700 1 -- 172.21.15.49:0/3628684447 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb35805f2c0 msgr2=0x7fb358061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:23:10.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:10.836+0000 7fb373fff700 1 --2- 172.21.15.49:0/3628684447 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb35805f2c0 0x7fb358061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-11-30T17:23:10.944 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:10.943+0000 7f6ae85fd680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:23:10.985 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:10.983+0000 7fe7bf1b9680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T17:23:11.060 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:11.058+0000 7fe7bf1b9680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T17:23:11.104 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:11.102+0000 7f6ae85fd680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T17:23:11.127 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:11.125+0000 7fe7bf1b9680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T17:23:11.182 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:11.180+0000 7f6ae85fd680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T17:23:11.252 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:11.251+0000 7f6ae85fd680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T17:23:11.382 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:11.381+0000 7fe7bf1b9680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T17:23:11.527 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:11.526+0000 7f6ae85fd680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T17:23:11.565 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:11.564+0000 7fe7bf1b9680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T17:23:11.719 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:11.718+0000 7f6ae85fd680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T17:23:12.210 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:12.209+0000 7fe7bf1b9680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T17:23:12.279 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:12.277+0000 7fe7bf1b9680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T17:23:12.355 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:12.354+0000 7fe7bf1b9680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T17:23:12.405 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:12.403+0000 7f6ae85fd680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T17:23:12.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:12.437+0000 7fb373fff700 1 -- 172.21.15.49:0/3628684447 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb35805f2c0 msgr2=0x7fb358061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:23:12.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:12.438+0000 7fb373fff700 1 --2- 172.21.15.49:0/3628684447 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb35805f2c0 0x7fb358061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-11-30T17:23:12.477 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:12.476+0000 7f6ae85fd680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T17:23:12.502 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:12.501+0000 7fe7bf1b9680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T17:23:12.557 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:12.556+0000 7f6ae85fd680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T17:23:12.574 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:12.572+0000 7fe7bf1b9680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T17:23:12.689 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:12.687+0000 7fe7bf1b9680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T17:23:12.711 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:12.709+0000 7f6ae85fd680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T17:23:12.784 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:12.783+0000 7f6ae85fd680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T17:23:12.797 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:12.795+0000 7fe7bf1b9680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:23:12.905 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:12.904+0000 7f6ae85fd680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T17:23:13.021 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:13.020+0000 7f6ae85fd680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:23:13.087 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:13.086+0000 7fe7bf1b9680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T17:23:13.158 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:13.157+0000 7fe7bf1b9680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T17:23:13.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:13.177+0000 7fb370ff9700 1 -- 172.21.15.49:0/3628684447 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 34) v1 ==== 75287+0+0 (secure 0 0 0) 0x7fb368077170 con 0x7fb374063af0 2023-11-30T17:23:13.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:13.178+0000 7fb370ff9700 1 -- 172.21.15.49:0/3628684447 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb35805f2c0 msgr2=0x7fb358061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:23:13.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:13.178+0000 7fb370ff9700 1 --2- 172.21.15.49:0/3628684447 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb35805f2c0 0x7fb358061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:13.245 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:13.243+0000 7fe736144700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:23:13.245 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:13.243+0000 7fe736144700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:23:13.245 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:13.243+0000 7fe736144700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:23:13.245 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:13.243+0000 7fe736144700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:23:13.245 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:13.243+0000 7fe736144700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:23:13.246 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:13.243+0000 7fe73393f700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:23:13.246 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:13.243+0000 7fe73393f700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:23:13.246 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:13.243+0000 7fe73393f700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:23:13.246 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:13.243+0000 7fe73393f700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:23:13.246 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:13.243+0000 7fe73393f700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:23:13.328 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:13.327+0000 7f6ae85fd680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T17:23:13.402 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:13.401+0000 7f6ae85fd680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T17:23:14.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.182+0000 7fb370ff9700 1 -- 172.21.15.49:0/3628684447 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mgrmap(e 35) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fb3680774f0 con 0x7fb374063af0 2023-11-30T17:23:14.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.182+0000 7fb370ff9700 1 --2- 172.21.15.49:0/3628684447 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb35805f2c0 0x7fb358061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:14.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.182+0000 7fb370ff9700 1 -- 172.21.15.49:0/3628684447 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb358030b80 con 0x7fb35805f2c0 2023-11-30T17:23:14.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.183+0000 7fb373fff700 1 --2- 172.21.15.49:0/3628684447 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb35805f2c0 0x7fb358061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:14.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.184+0000 7fb373fff700 1 --2- 172.21.15.49:0/3628684447 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb35805f2c0 0x7fb358061700 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fb360009640 tx=0x7fb360009060).ready entity=mgr.6053 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:14.188 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:14.187+0000 7fe73e154700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-11-30T17:23:14.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.187+0000 7fb370ff9700 1 -- 172.21.15.49:0/3628684447 <== mgr.6053 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7fb360009b20 con 0x7fb35805f2c0 2023-11-30T17:23:14.190 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-11-30T17:23:14.194 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-11-30T17:23:14.195 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-11-30T17:23:14.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.320+0000 7f2965f6a700 1 Processor -- start 2023-11-30T17:23:14.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.320+0000 7f2965f6a700 1 -- start start 2023-11-30T17:23:14.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.321+0000 7f2965f6a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2960155ae0 0x7f29600bd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:14.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.321+0000 7f2965f6a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f29600bdc30 0x7f29600c2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:14.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.321+0000 7f2965f6a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2960155650 con 0x7f29600c6b30 2023-11-30T17:23:14.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.321+0000 7f2965f6a700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f296014bff0 con 0x7f29600bdc30 2023-11-30T17:23:14.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.321+0000 7f2965f6a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29600be0c0 con 0x7f2960155ae0 2023-11-30T17:23:14.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.321+0000 7f295f7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f29600c6b30 0x7f29601524b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49166/0 (socket says 172.21.15.49:49166) 2023-11-30T17:23:14.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.321+0000 7f295ffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f29600bdc30 0x7f29600c2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:14.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.321+0000 7f295f7fe700 1 -- 172.21.15.49:0/2331389313 learned_addr learned my addr 172.21.15.49:0/2331389313 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:14.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.321+0000 7f295effd700 1 --2- 172.21.15.49:0/2331389313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2960155ae0 0x7f29600bd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:14.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.321+0000 7f295ffff700 1 -- 172.21.15.49:0/2331389313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2960155ae0 msgr2=0x7f29600bd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:14.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.322+0000 7f295ffff700 1 --2- 172.21.15.49:0/2331389313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2960155ae0 0x7f29600bd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:14.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.322+0000 7f295ffff700 1 -- 172.21.15.49:0/2331389313 >> v1:172.21.15.49:6789/0 conn(0x7f29600c6b30 legacy=0x7f29601524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:14.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.322+0000 7f295ffff700 1 -- 172.21.15.49:0/2331389313 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2960155f60 con 0x7f29600bdc30 2023-11-30T17:23:14.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.322+0000 7f295e7fc700 1 -- 172.21.15.49:0/2331389313 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3405814729 0 0) 0x7f2960155650 con 0x7f29600c6b30 2023-11-30T17:23:14.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.322+0000 7f295effd700 1 --2- 172.21.15.49:0/2331389313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2960155ae0 0x7f29600bd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:23:14.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.322+0000 7f295ffff700 1 --2- 172.21.15.49:0/2331389313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29600bdc30 0x7f29600c2ce0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f2958009e60 tx=0x7f2958009780).ready entity=mon.0 client_cookie=e854043c2677adca server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:14.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.322+0000 7f295e7fc700 1 -- 172.21.15.49:0/2331389313 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295800e070 con 0x7f29600bdc30 2023-11-30T17:23:14.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.322+0000 7f295e7fc700 1 -- 172.21.15.49:0/2331389313 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295800bc30 con 0x7f29600bdc30 2023-11-30T17:23:14.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.322+0000 7f295e7fc700 1 -- 172.21.15.49:0/2331389313 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2958012410 con 0x7f29600bdc30 2023-11-30T17:23:14.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.322+0000 7f2965f6a700 1 -- 172.21.15.49:0/2331389313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29600bdc30 msgr2=0x7f29600c2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:14.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.322+0000 7f2965f6a700 1 --2- 172.21.15.49:0/2331389313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29600bdc30 0x7f29600c2ce0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f2958009e60 tx=0x7f2958009780).stop 2023-11-30T17:23:14.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.322+0000 7f2965f6a700 1 -- 172.21.15.49:0/2331389313 shutdown_connections 2023-11-30T17:23:14.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.322+0000 7f2965f6a700 1 --2- 172.21.15.49:0/2331389313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29600bdc30 0x7f29600c2ce0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:14.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.322+0000 7f2965f6a700 1 --2- 172.21.15.49:0/2331389313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2960155ae0 0x7f29600bd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:14.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.322+0000 7f2965f6a700 1 -- 172.21.15.49:0/2331389313 >> 172.21.15.49:0/2331389313 conn(0x7f29600c8230 msgr2=0x7f29600c4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:14.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.322+0000 7f2965f6a700 1 -- 172.21.15.49:0/2331389313 shutdown_connections 2023-11-30T17:23:14.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.322+0000 7f2965f6a700 1 -- 172.21.15.49:0/2331389313 wait complete. 2023-11-30T17:23:14.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.324+0000 7f2965f6a700 1 Processor -- start 2023-11-30T17:23:14.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.324+0000 7f2965f6a700 1 -- start start 2023-11-30T17:23:14.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.324+0000 7f2965f6a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29600bdc30 0x7f29600c1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:14.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.324+0000 7f2965f6a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29600c6b30 0x7f29600a7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:14.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.324+0000 7f2965f6a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2960155ae0 0x7f29600a8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:14.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.324+0000 7f2965f6a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29600a76f0 con 0x7f29600bdc30 2023-11-30T17:23:14.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.324+0000 7f2965f6a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29600a7970 con 0x7f2960155ae0 2023-11-30T17:23:14.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.324+0000 7f2965f6a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29600a7c50 con 0x7f29600c6b30 2023-11-30T17:23:14.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.324+0000 7f295f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29600bdc30 0x7f29600c1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:14.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.325+0000 7f295f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29600bdc30 0x7f29600c1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36184/0 (socket says 172.21.15.49:36184) 2023-11-30T17:23:14.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.325+0000 7f295f7fe700 1 -- 172.21.15.49:0/2463866309 learned_addr learned my addr 172.21.15.49:0/2463866309 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:14.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.325+0000 7f295effd700 1 --2- 172.21.15.49:0/2463866309 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29600c6b30 0x7f29600a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:14.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.325+0000 7f295ffff700 1 --2- 172.21.15.49:0/2463866309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2960155ae0 0x7f29600a8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:14.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.325+0000 7f295f7fe700 1 -- 172.21.15.49:0/2463866309 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29600c6b30 msgr2=0x7f29600a7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:14.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.325+0000 7f295f7fe700 1 --2- 172.21.15.49:0/2463866309 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29600c6b30 0x7f29600a7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:14.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.325+0000 7f295f7fe700 1 -- 172.21.15.49:0/2463866309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2960155ae0 msgr2=0x7f29600a8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:14.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.325+0000 7f295f7fe700 1 --2- 172.21.15.49:0/2463866309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2960155ae0 0x7f29600a8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:14.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.325+0000 7f295f7fe700 1 -- 172.21.15.49:0/2463866309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2958009a20 con 0x7f29600bdc30 2023-11-30T17:23:14.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.325+0000 7f295f7fe700 1 --2- 172.21.15.49:0/2463866309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29600bdc30 0x7f29600c1260 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7f2950001360 tx=0x7f2950007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:14.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.325+0000 7f29477fe700 1 -- 172.21.15.49:0/2463866309 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295000ce10 con 0x7f29600bdc30 2023-11-30T17:23:14.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.325+0000 7f29477fe700 1 -- 172.21.15.49:0/2463866309 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29500072e0 con 0x7f29600bdc30 2023-11-30T17:23:14.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.325+0000 7f2965f6a700 1 -- 172.21.15.49:0/2463866309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29600a7f30 con 0x7f29600bdc30 2023-11-30T17:23:14.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.325+0000 7f29477fe700 1 -- 172.21.15.49:0/2463866309 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2950005670 con 0x7f29600bdc30 2023-11-30T17:23:14.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.325+0000 7f2965f6a700 1 -- 172.21.15.49:0/2463866309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29600a84f0 con 0x7f29600bdc30 2023-11-30T17:23:14.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.326+0000 7f2965f6a700 1 -- 172.21.15.49:0/2463866309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f296006c860 con 0x7f29600bdc30 2023-11-30T17:23:14.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.327+0000 7f29477fe700 1 -- 172.21.15.49:0/2463866309 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 35) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f2950005a60 con 0x7f29600bdc30 2023-11-30T17:23:14.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.327+0000 7f29477fe700 1 --2- 172.21.15.49:0/2463866309 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f294c05f080 0x7f294c061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:14.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.327+0000 7f29477fe700 1 -- 172.21.15.49:0/2463866309 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6407+0+0 (secure 0 0 0) 0x7f29500797e0 con 0x7f29600bdc30 2023-11-30T17:23:14.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.327+0000 7f295effd700 1 --2- 172.21.15.49:0/2463866309 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f294c05f080 0x7f294c061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:14.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.328+0000 7f295effd700 1 --2- 172.21.15.49:0/2463866309 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f294c05f080 0x7f294c061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f295400ab20 tx=0x7f2954008040).ready entity=mgr.6053 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:14.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.331+0000 7f29477fe700 1 -- 172.21.15.49:0/2463866309 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f295004ab60 con 0x7f29600bdc30 2023-11-30T17:23:14.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:14.551+0000 7f2965f6a700 1 -- 172.21.15.49:0/2463866309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f2960063b60 con 0x7f29600bdc30 2023-11-30T17:23:15.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.188+0000 7f29477fe700 1 -- 172.21.15.49:0/2463866309 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 36) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f2950005d10 con 0x7f29600bdc30 2023-11-30T17:23:15.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.189+0000 7f29477fe700 1 -- 172.21.15.49:0/2463866309 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v36) v1 ==== 93+0+0 (secure 0 0 0) 0x7f29500766a0 con 0x7f29600bdc30 2023-11-30T17:23:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.192+0000 7f2965f6a700 1 -- 172.21.15.49:0/2463866309 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f294c05f080 msgr2=0x7f294c061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:15.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.192+0000 7f2965f6a700 1 --2- 172.21.15.49:0/2463866309 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f294c05f080 0x7f294c061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f295400ab20 tx=0x7f2954008040).stop 2023-11-30T17:23:15.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.192+0000 7f2965f6a700 1 -- 172.21.15.49:0/2463866309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29600bdc30 msgr2=0x7f29600c1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:15.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.192+0000 7f2965f6a700 1 --2- 172.21.15.49:0/2463866309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29600bdc30 0x7f29600c1260 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7f2950001360 tx=0x7f2950007b00).stop 2023-11-30T17:23:15.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.192+0000 7f2965f6a700 1 -- 172.21.15.49:0/2463866309 shutdown_connections 2023-11-30T17:23:15.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.192+0000 7f2965f6a700 1 --2- 172.21.15.49:0/2463866309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2960155ae0 0x7f29600a8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:15.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.192+0000 7f2965f6a700 1 --2- 172.21.15.49:0/2463866309 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f294c05f080 0x7f294c061540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:15.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.192+0000 7f2965f6a700 1 --2- 172.21.15.49:0/2463866309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29600bdc30 0x7f29600c1260 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:15.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.192+0000 7f2965f6a700 1 --2- 172.21.15.49:0/2463866309 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29600c6b30 0x7f29600a7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:15.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.192+0000 7f2965f6a700 1 -- 172.21.15.49:0/2463866309 >> 172.21.15.49:0/2463866309 conn(0x7f29600c8230 msgr2=0x7f2960064dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:15.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.192+0000 7f2965f6a700 1 -- 172.21.15.49:0/2463866309 shutdown_connections 2023-11-30T17:23:15.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.192+0000 7f2965f6a700 1 -- 172.21.15.49:0/2463866309 wait complete. 2023-11-30T17:23:15.209 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-30T17:23:15.209 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T17:23:15.250 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T17:23:15.291 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-30T17:23:15.291 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-30T17:23:15.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:23:15.291 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-30T17:23:15.337 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-11-30T17:23:15.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:23:15.337 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-30T17:23:15.340 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:15.339+0000 7f5ae1afb680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T17:23:15.341 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:15.339+0000 7fdefd014680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T17:23:15.352 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:23:15.403 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:15.401+0000 7f5ae1afb680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T17:23:15.407 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:15.406+0000 7fdefd014680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T17:23:15.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.511+0000 7f32c5a88700 1 Processor -- start 2023-11-30T17:23:15.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.512+0000 7f32c5a88700 1 -- start start 2023-11-30T17:23:15.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.512+0000 7f32c5a88700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f32c01548c0 0x7f32c006a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:15.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.512+0000 7f32c5a88700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f32c00c6e30 0x7f32c00c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:15.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.512+0000 7f32c5a88700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c00c69a0 con 0x7f32c01544e0 2023-11-30T17:23:15.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.512+0000 7f32c5a88700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32c00c13a0 con 0x7f32c00c6e30 2023-11-30T17:23:15.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.512+0000 7f32c5a88700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32c00c1680 con 0x7f32c01548c0 2023-11-30T17:23:15.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.513+0000 7f32bffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f32c00c6e30 0x7f32c00c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:15.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.513+0000 7f32bffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f32c00c6e30 0x7f32c00c72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36204/0 (socket says 172.21.15.49:36204) 2023-11-30T17:23:15.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.513+0000 7f32bffff700 1 -- 172.21.15.49:0/4000986858 learned_addr learned my addr 172.21.15.49:0/4000986858 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:15.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.513+0000 7f32b6ffd700 1 --2- 172.21.15.49:0/4000986858 >> v2:172.21.15.115:3300/0 conn(0x7f32c01548c0 0x7f32c006a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:15.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.513+0000 7f32bffff700 1 -- 172.21.15.49:0/4000986858 >> v2:172.21.15.115:3300/0 conn(0x7f32c01548c0 msgr2=0x7f32c006a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:15.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.513+0000 7f32bffff700 1 --2- 172.21.15.49:0/4000986858 >> v2:172.21.15.115:3300/0 conn(0x7f32c01548c0 0x7f32c006a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:15.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.513+0000 7f32bffff700 1 -- 172.21.15.49:0/4000986858 >> v1:172.21.15.115:6789/0 conn(0x7f32c01544e0 legacy=0x7f32c00c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:15.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.513+0000 7f32bffff700 1 -- 172.21.15.49:0/4000986858 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c00c6630 con 0x7f32c00c6e30 2023-11-30T17:23:15.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.513+0000 7f32bffff700 1 --2- 172.21.15.49:0/4000986858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32c00c6e30 0x7f32c00c72a0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7f32c00c12d0 tx=0x7f32b8009840).ready entity=mon.0 client_cookie=2af05abae7e89a66 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:15.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.513+0000 7f32beffd700 1 -- 172.21.15.49:0/4000986858 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b800e070 con 0x7f32c00c6e30 2023-11-30T17:23:15.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.513+0000 7f32beffd700 1 -- 172.21.15.49:0/4000986858 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b800ba50 con 0x7f32c00c6e30 2023-11-30T17:23:15.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.513+0000 7f32beffd700 1 -- 172.21.15.49:0/4000986858 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b800bdd0 con 0x7f32c00c6e30 2023-11-30T17:23:15.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.514+0000 7f32c5a88700 1 -- 172.21.15.49:0/4000986858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32c00c6e30 msgr2=0x7f32c00c72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:15.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.514+0000 7f32c5a88700 1 --2- 172.21.15.49:0/4000986858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32c00c6e30 0x7f32c00c72a0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7f32c00c12d0 tx=0x7f32b8009840).stop 2023-11-30T17:23:15.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.514+0000 7f32c5a88700 1 -- 172.21.15.49:0/4000986858 shutdown_connections 2023-11-30T17:23:15.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.514+0000 7f32c5a88700 1 --2- 172.21.15.49:0/4000986858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32c00c6e30 0x7f32c00c72a0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:15.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.514+0000 7f32c5a88700 1 --2- 172.21.15.49:0/4000986858 >> v2:172.21.15.115:3300/0 conn(0x7f32c01548c0 0x7f32c006a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:15.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.514+0000 7f32c5a88700 1 -- 172.21.15.49:0/4000986858 >> 172.21.15.49:0/4000986858 conn(0x7f32c0085020 msgr2=0x7f32c0094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:15.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.514+0000 7f32c5a88700 1 -- 172.21.15.49:0/4000986858 shutdown_connections 2023-11-30T17:23:15.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.514+0000 7f32c5a88700 1 -- 172.21.15.49:0/4000986858 wait complete. 2023-11-30T17:23:15.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.515+0000 7f32c5a88700 1 Processor -- start 2023-11-30T17:23:15.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.515+0000 7f32c5a88700 1 -- start start 2023-11-30T17:23:15.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.516+0000 7f32c5a88700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32c00c6e30 0x7f32c00c4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:15.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.516+0000 7f32c5a88700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32c01544e0 0x7f32c01511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:15.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.516+0000 7f32c5a88700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32c01548c0 0x7f32c00c3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:15.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.516+0000 7f32c5a88700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c00c5330 con 0x7f32c01544e0 2023-11-30T17:23:15.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.516+0000 7f32c5a88700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c00c49b0 con 0x7f32c00c6e30 2023-11-30T17:23:15.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.516+0000 7f32c5a88700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c00c3da0 con 0x7f32c01548c0 2023-11-30T17:23:15.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.516+0000 7f32b6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32c01544e0 0x7f32c01511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:15.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.516+0000 7f32b6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32c01544e0 0x7f32c01511f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36216/0 (socket says 172.21.15.49:36216) 2023-11-30T17:23:15.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.516+0000 7f32bf7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32c00c6e30 0x7f32c00c4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:15.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.516+0000 7f32b6ffd700 1 -- 172.21.15.49:0/4111920872 learned_addr learned my addr 172.21.15.49:0/4111920872 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:15.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.516+0000 7f32bffff700 1 --2- 172.21.15.49:0/4111920872 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32c01548c0 0x7f32c00c3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:15.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.516+0000 7f32b6ffd700 1 -- 172.21.15.49:0/4111920872 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32c01548c0 msgr2=0x7f32c00c3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:15.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.516+0000 7f32b6ffd700 1 --2- 172.21.15.49:0/4111920872 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32c01548c0 0x7f32c00c3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:15.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.516+0000 7f32b6ffd700 1 -- 172.21.15.49:0/4111920872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32c00c6e30 msgr2=0x7f32c00c4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:15.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.516+0000 7f32b6ffd700 1 --2- 172.21.15.49:0/4111920872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32c00c6e30 0x7f32c00c4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:15.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.516+0000 7f32b6ffd700 1 -- 172.21.15.49:0/4111920872 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b8009ae0 con 0x7f32c01544e0 2023-11-30T17:23:15.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.516+0000 7f32bf7fe700 1 --2- 172.21.15.49:0/4111920872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32c00c6e30 0x7f32c00c4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:23:15.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.516+0000 7f32b6ffd700 1 --2- 172.21.15.49:0/4111920872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32c01544e0 0x7f32c01511f0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7f32a800d890 tx=0x7f32a8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:15.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.516+0000 7f32b7fff700 1 -- 172.21.15.49:0/4111920872 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a8011590 con 0x7f32c01544e0 2023-11-30T17:23:15.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.517+0000 7f32b7fff700 1 -- 172.21.15.49:0/4111920872 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a80116f0 con 0x7f32c01544e0 2023-11-30T17:23:15.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.517+0000 7f32c5a88700 1 -- 172.21.15.49:0/4111920872 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c00c4080 con 0x7f32c01544e0 2023-11-30T17:23:15.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.517+0000 7f32b7fff700 1 -- 172.21.15.49:0/4111920872 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a8011a70 con 0x7f32c01544e0 2023-11-30T17:23:15.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.517+0000 7f32c5a88700 1 -- 172.21.15.49:0/4111920872 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c00c4640 con 0x7f32c01544e0 2023-11-30T17:23:15.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.518+0000 7f32c5a88700 1 -- 172.21.15.49:0/4111920872 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c006c860 con 0x7f32c01544e0 2023-11-30T17:23:15.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.518+0000 7f32b7fff700 1 -- 172.21.15.49:0/4111920872 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 36) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f32a801c460 con 0x7f32c01544e0 2023-11-30T17:23:15.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.518+0000 7f32b7fff700 1 --2- 172.21.15.49:0/4111920872 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f32a005f030 0x7f32a00614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:15.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.518+0000 7f32b7fff700 1 -- 172.21.15.49:0/4111920872 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6407+0+0 (secure 0 0 0) 0x7f32a8079d90 con 0x7f32c01544e0 2023-11-30T17:23:15.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.518+0000 7f32bf7fe700 1 -- 172.21.15.49:0/4111920872 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f32a005f030 msgr2=0x7f32a00614f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:23:15.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.518+0000 7f32bf7fe700 1 --2- 172.21.15.49:0/4111920872 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f32a005f030 0x7f32a00614f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:23:15.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.523+0000 7f32b7fff700 1 -- 172.21.15.49:0/4111920872 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f32a804b0b0 con 0x7f32c01544e0 2023-11-30T17:23:15.679 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:15.676+0000 7f5ae1afb680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T17:23:15.700 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:15.699+0000 7fdefd014680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T17:23:15.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.719+0000 7f32bf7fe700 1 -- 172.21.15.49:0/4111920872 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f32a005f030 msgr2=0x7f32a00614f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:23:15.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.719+0000 7f32bf7fe700 1 --2- 172.21.15.49:0/4111920872 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f32a005f030 0x7f32a00614f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:23:15.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.737+0000 7f32c5a88700 1 -- 172.21.15.49:0/4111920872 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32c00c5890 con 0x7f32c01544e0 2023-11-30T17:23:15.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.738+0000 7f32b7fff700 1 -- 172.21.15.49:0/4111920872 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f32a8011e60 con 0x7f32c01544e0 2023-11-30T17:23:15.739 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:15.740 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5906,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3382372491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3382372491},{"type":"v1","addr":"172.21.15.115:6837","nonce":3382372491}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6675,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/962684395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":962684395},{"type":"v1","addr":"172.21.15.49:6834","nonce":962684395}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6678,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1931198509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1931198509},{"type":"v1","addr":"172.21.15.49:6835","nonce":1931198509}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:22:56.913429+0000","modified":"2023-11-30T17:22:59.924885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6687},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6687":{"gid":6687,"name":"d","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/3530976555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3530976555},{"type":"v1","addr":"172.21.15.115:6836","nonce":3530976555}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-11-30T17:23:15.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.740+0000 7f32c5a88700 1 -- 172.21.15.49:0/4111920872 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f32a005f030 msgr2=0x7f32a00614f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:23:15.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.740+0000 7f32c5a88700 1 --2- 172.21.15.49:0/4111920872 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f32a005f030 0x7f32a00614f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:15.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.740+0000 7f32c5a88700 1 -- 172.21.15.49:0/4111920872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32c01544e0 msgr2=0x7f32c01511f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:15.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.740+0000 7f32c5a88700 1 --2- 172.21.15.49:0/4111920872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32c01544e0 0x7f32c01511f0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7f32a800d890 tx=0x7f32a8008040).stop 2023-11-30T17:23:15.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.740+0000 7f32c5a88700 1 -- 172.21.15.49:0/4111920872 shutdown_connections 2023-11-30T17:23:15.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.740+0000 7f32c5a88700 1 --2- 172.21.15.49:0/4111920872 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32c01548c0 0x7f32c00c3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:15.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.740+0000 7f32c5a88700 1 --2- 172.21.15.49:0/4111920872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32c00c6e30 0x7f32c00c4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:15.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.740+0000 7f32c5a88700 1 --2- 172.21.15.49:0/4111920872 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f32a005f030 0x7f32a00614f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:15.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.740+0000 7f32c5a88700 1 --2- 172.21.15.49:0/4111920872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32c01544e0 0x7f32c01511f0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:15.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.740+0000 7f32c5a88700 1 -- 172.21.15.49:0/4111920872 >> 172.21.15.49:0/4111920872 conn(0x7f32c0085020 msgr2=0x7f32c00ae240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:15.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.740+0000 7f32c5a88700 1 -- 172.21.15.49:0/4111920872 shutdown_connections 2023-11-30T17:23:15.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.740+0000 7f32c5a88700 1 -- 172.21.15.49:0/4111920872 wait complete. 2023-11-30T17:23:15.743 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 39 2023-11-30T17:23:15.754 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:23:15.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.912+0000 7ff687e55700 1 Processor -- start 2023-11-30T17:23:15.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.913+0000 7ff687e55700 1 -- start start 2023-11-30T17:23:15.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.913+0000 7ff687e55700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff680067cb0 0x7ff6800c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:15.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.913+0000 7ff687e55700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6800c2d50 0x7ff6800c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:15.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.913+0000 7ff687e55700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff680154d20 con 0x7ff680068090 2023-11-30T17:23:15.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.913+0000 7ff687e55700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff680151670 con 0x7ff680067cb0 2023-11-30T17:23:15.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.913+0000 7ff687e55700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800c48a0 con 0x7ff6800c2d50 2023-11-30T17:23:15.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.914+0000 7ff685bf1700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff680067cb0 0x7ff6800c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:15.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.914+0000 7ff6863f2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6800c2d50 0x7ff6800c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:15.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.914+0000 7ff6853f0700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ff680068090 0x7ff6800c2640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:35044/0 (socket says 172.21.15.49:35044) 2023-11-30T17:23:15.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.914+0000 7ff6853f0700 1 -- 172.21.15.49:0/422556065 learned_addr learned my addr 172.21.15.49:0/422556065 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:15.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.914+0000 7ff684bef700 1 -- 172.21.15.49:0/422556065 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3694927729 0 0) 0x7ff680154d20 con 0x7ff680068090 2023-11-30T17:23:15.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.914+0000 7ff684bef700 1 -- 172.21.15.49:0/422556065 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff66c0033f0 con 0x7ff680068090 2023-11-30T17:23:15.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.914+0000 7ff685bf1700 1 -- 172.21.15.49:0/422556065 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6800c2d50 msgr2=0x7ff6800c43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:15.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.914+0000 7ff685bf1700 1 --2- 172.21.15.49:0/422556065 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6800c2d50 0x7ff6800c43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:15.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.914+0000 7ff685bf1700 1 -- 172.21.15.49:0/422556065 >> v1:172.21.15.115:6789/0 conn(0x7ff680068090 legacy=0x7ff6800c2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:15.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.914+0000 7ff685bf1700 1 -- 172.21.15.49:0/422556065 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6800a7490 con 0x7ff680067cb0 2023-11-30T17:23:15.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.914+0000 7ff6863f2700 1 --2- 172.21.15.49:0/422556065 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6800c2d50 0x7ff6800c43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:23:15.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.914+0000 7ff685bf1700 1 --2- 172.21.15.49:0/422556065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff680067cb0 0x7ff6800c3ec0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7ff674009760 tx=0x7ff674009060).ready entity=mon.1 client_cookie=b86c79a9d19ff381 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:15.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.914+0000 7ff684bef700 1 -- 172.21.15.49:0/422556065 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67400d4a0 con 0x7ff680067cb0 2023-11-30T17:23:15.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.914+0000 7ff684bef700 1 -- 172.21.15.49:0/422556065 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67400d600 con 0x7ff680067cb0 2023-11-30T17:23:15.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.914+0000 7ff684bef700 1 -- 172.21.15.49:0/422556065 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67400d980 con 0x7ff680067cb0 2023-11-30T17:23:15.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.915+0000 7ff687e55700 1 -- 172.21.15.49:0/422556065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff680067cb0 msgr2=0x7ff6800c3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:15.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.915+0000 7ff687e55700 1 --2- 172.21.15.49:0/422556065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff680067cb0 0x7ff6800c3ec0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7ff674009760 tx=0x7ff674009060).stop 2023-11-30T17:23:15.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.915+0000 7ff687e55700 1 -- 172.21.15.49:0/422556065 shutdown_connections 2023-11-30T17:23:15.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.915+0000 7ff687e55700 1 --2- 172.21.15.49:0/422556065 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6800c2d50 0x7ff6800c43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:15.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.915+0000 7ff687e55700 1 --2- 172.21.15.49:0/422556065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff680067cb0 0x7ff6800c3ec0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:15.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.915+0000 7ff687e55700 1 -- 172.21.15.49:0/422556065 >> 172.21.15.49:0/422556065 conn(0x7ff6800c7fd0 msgr2=0x7ff6800c83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:15.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.915+0000 7ff687e55700 1 -- 172.21.15.49:0/422556065 shutdown_connections 2023-11-30T17:23:15.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.915+0000 7ff687e55700 1 -- 172.21.15.49:0/422556065 wait complete. 2023-11-30T17:23:15.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.916+0000 7ff687e55700 1 Processor -- start 2023-11-30T17:23:15.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.916+0000 7ff687e55700 1 -- start start 2023-11-30T17:23:15.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.917+0000 7ff687e55700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff680067cb0 0x7ff680168ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:15.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.917+0000 7ff687e55700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff680068090 0x7ff6800a7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:15.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.917+0000 7ff687e55700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6800c2d50 0x7ff680150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:15.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.917+0000 7ff687e55700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800a9090 con 0x7ff680067cb0 2023-11-30T17:23:15.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.917+0000 7ff687e55700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800ac640 con 0x7ff680068090 2023-11-30T17:23:15.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.917+0000 7ff687e55700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800a87f0 con 0x7ff6800c2d50 2023-11-30T17:23:15.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.917+0000 7ff685bf1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff680067cb0 0x7ff680168ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:15.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.917+0000 7ff685bf1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff680067cb0 0x7ff680168ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36228/0 (socket says 172.21.15.49:36228) 2023-11-30T17:23:15.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.917+0000 7ff685bf1700 1 -- 172.21.15.49:0/3998107301 learned_addr learned my addr 172.21.15.49:0/3998107301 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:15.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.917+0000 7ff6853f0700 1 --2- 172.21.15.49:0/3998107301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff680068090 0x7ff6800a7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:15.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.917+0000 7ff6863f2700 1 --2- 172.21.15.49:0/3998107301 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6800c2d50 0x7ff680150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:15.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.918+0000 7ff685bf1700 1 -- 172.21.15.49:0/3998107301 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6800c2d50 msgr2=0x7ff680150130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:15.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.918+0000 7ff685bf1700 1 --2- 172.21.15.49:0/3998107301 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6800c2d50 0x7ff680150130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:15.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.918+0000 7ff685bf1700 1 -- 172.21.15.49:0/3998107301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff680068090 msgr2=0x7ff6800a7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:15.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.918+0000 7ff685bf1700 1 --2- 172.21.15.49:0/3998107301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff680068090 0x7ff6800a7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:15.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.918+0000 7ff685bf1700 1 -- 172.21.15.49:0/3998107301 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff678009a20 con 0x7ff680067cb0 2023-11-30T17:23:15.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.918+0000 7ff6853f0700 1 --2- 172.21.15.49:0/3998107301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff680068090 0x7ff6800a7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:23:15.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.918+0000 7ff685bf1700 1 --2- 172.21.15.49:0/3998107301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff680067cb0 0x7ff680168ae0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7ff674011fb0 tx=0x7ff674016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:15.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.918+0000 7ff671ffb700 1 -- 172.21.15.49:0/3998107301 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67400dd30 con 0x7ff680067cb0 2023-11-30T17:23:15.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.918+0000 7ff671ffb700 1 -- 172.21.15.49:0/3998107301 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67400de90 con 0x7ff680067cb0 2023-11-30T17:23:15.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.918+0000 7ff671ffb700 1 -- 172.21.15.49:0/3998107301 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67400d980 con 0x7ff680067cb0 2023-11-30T17:23:15.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.918+0000 7ff687e55700 1 -- 172.21.15.49:0/3998107301 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6740092a0 con 0x7ff680067cb0 2023-11-30T17:23:15.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.918+0000 7ff687e55700 1 -- 172.21.15.49:0/3998107301 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6800a8db0 con 0x7ff680067cb0 2023-11-30T17:23:15.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.919+0000 7ff687e55700 1 -- 172.21.15.49:0/3998107301 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff68006c860 con 0x7ff680067cb0 2023-11-30T17:23:15.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.920+0000 7ff671ffb700 1 -- 172.21.15.49:0/3998107301 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 36) v1 ==== 75340+0+0 (secure 0 0 0) 0x7ff67401d640 con 0x7ff680067cb0 2023-11-30T17:23:15.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.920+0000 7ff671ffb700 1 --2- 172.21.15.49:0/3998107301 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff66405f030 0x7ff6640614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:15.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.920+0000 7ff6853f0700 1 -- 172.21.15.49:0/3998107301 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff66405f030 msgr2=0x7ff6640614f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:23:15.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.920+0000 7ff671ffb700 1 -- 172.21.15.49:0/3998107301 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6407+0+0 (secure 0 0 0) 0x7ff67407b6d0 con 0x7ff680067cb0 2023-11-30T17:23:15.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.920+0000 7ff6853f0700 1 --2- 172.21.15.49:0/3998107301 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff66405f030 0x7ff6640614f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:23:15.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:15.924+0000 7ff671ffb700 1 -- 172.21.15.49:0/3998107301 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff67404ca50 con 0x7ff680067cb0 2023-11-30T17:23:16.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.100+0000 7ff687e55700 1 -- 172.21.15.49:0/3998107301 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6800a7490 con 0x7ff680067cb0 2023-11-30T17:23:16.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.101+0000 7ff671ffb700 1 -- 172.21.15.49:0/3998107301 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+17346 (secure 0 0 0) 0x7ff6800a7490 con 0x7ff680067cb0 2023-11-30T17:23:16.103 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:16.103 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":99,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:23:13.171019+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:22:55.465005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-11-30T17:22:55.883417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/2546935477":"2023-12-01T17:23:13.170987+0000","172.21.15.115:0/257548442":"2023-12-01T17:23:13.170987+0000","172.21.15.115:0/2514101390":"2023-12-01T17:23:13.170987+0000","172.21.15.115:6833/89956":"2023-12-01T17:23:13.170987+0000","172.21.15.115:6832/89956":"2023-12-01T17:23:13.170987+0000","172.21.15.115:0/1043747680":"2023-12-01T17:23:13.170987+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:23:16.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.103+0000 7ff687e55700 1 -- 172.21.15.49:0/3998107301 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff66405f030 msgr2=0x7ff6640614f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:23:16.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.103+0000 7ff687e55700 1 --2- 172.21.15.49:0/3998107301 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff66405f030 0x7ff6640614f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:16.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.103+0000 7ff687e55700 1 -- 172.21.15.49:0/3998107301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff680067cb0 msgr2=0x7ff680168ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:16.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.103+0000 7ff687e55700 1 --2- 172.21.15.49:0/3998107301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff680067cb0 0x7ff680168ae0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7ff674011fb0 tx=0x7ff674016000).stop 2023-11-30T17:23:16.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.103+0000 7ff687e55700 1 -- 172.21.15.49:0/3998107301 shutdown_connections 2023-11-30T17:23:16.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.103+0000 7ff687e55700 1 --2- 172.21.15.49:0/3998107301 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6800c2d50 0x7ff680150130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:16.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.103+0000 7ff687e55700 1 --2- 172.21.15.49:0/3998107301 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff66405f030 0x7ff6640614f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:16.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.103+0000 7ff687e55700 1 --2- 172.21.15.49:0/3998107301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff680067cb0 0x7ff680168ae0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:16.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.103+0000 7ff687e55700 1 --2- 172.21.15.49:0/3998107301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff680068090 0x7ff6800a7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:16.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.103+0000 7ff687e55700 1 -- 172.21.15.49:0/3998107301 >> 172.21.15.49:0/3998107301 conn(0x7ff6800c7fd0 msgr2=0x7ff680150b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:16.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.103+0000 7ff687e55700 1 -- 172.21.15.49:0/3998107301 shutdown_connections 2023-11-30T17:23:16.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.103+0000 7ff687e55700 1 -- 172.21.15.49:0/3998107301 wait complete. 2023-11-30T17:23:16.117 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-30T17:22:55.465005+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-11-30T17:22:55.883417+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-30T17:23:16.118 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T17:23:16.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.241+0000 7ff4942ab700 1 Processor -- start 2023-11-30T17:23:16.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.241+0000 7ff4942ab700 1 -- start start 2023-11-30T17:23:16.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.242+0000 7ff4942ab700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff48c0a8280 0x7ff48c0a8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:16.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.242+0000 7ff4942ab700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff48c158160 0x7ff48c155500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:16.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.242+0000 7ff4942ab700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff48c14e600 0x7ff48c14ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:16.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.242+0000 7ff4942ab700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff48c159180 con 0x7ff48c14e600 2023-11-30T17:23:16.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.242+0000 7ff4942ab700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff48c067770 con 0x7ff48c0a8280 2023-11-30T17:23:16.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.242+0000 7ff4942ab700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c0be8d0 con 0x7ff48c158160 2023-11-30T17:23:16.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.243+0000 7ff492848700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff48c14e600 0x7ff48c14ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:16.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.243+0000 7ff492848700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff48c14e600 0x7ff48c14ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36240/0 (socket says 172.21.15.49:36240) 2023-11-30T17:23:16.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.243+0000 7ff491846700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff48c158160 0x7ff48c155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:16.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.243+0000 7ff492848700 1 -- 172.21.15.49:0/3971261508 learned_addr learned my addr 172.21.15.49:0/3971261508 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:16.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.243+0000 7ff492047700 1 --2- 172.21.15.49:0/3971261508 >> v2:172.21.15.115:3300/0 conn(0x7ff48c0a8280 0x7ff48c0a8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:16.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.243+0000 7ff492848700 1 -- 172.21.15.49:0/3971261508 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff48c158160 msgr2=0x7ff48c155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:16.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.243+0000 7ff492848700 1 --2- 172.21.15.49:0/3971261508 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff48c158160 0x7ff48c155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:16.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.243+0000 7ff492848700 1 -- 172.21.15.49:0/3971261508 >> v2:172.21.15.115:3300/0 conn(0x7ff48c0a8280 msgr2=0x7ff48c0a8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:16.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.243+0000 7ff492848700 1 --2- 172.21.15.49:0/3971261508 >> v2:172.21.15.115:3300/0 conn(0x7ff48c0a8280 0x7ff48c0a8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:16.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.243+0000 7ff492848700 1 -- 172.21.15.49:0/3971261508 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48c158600 con 0x7ff48c14e600 2023-11-30T17:23:16.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.243+0000 7ff492047700 1 --2- 172.21.15.49:0/3971261508 >> v2:172.21.15.115:3300/0 conn(0x7ff48c0a8280 0x7ff48c0a8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:23:16.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.243+0000 7ff492848700 1 --2- 172.21.15.49:0/3971261508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c14e600 0x7ff48c14ea90 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7ff48c0c9050 tx=0x7ff484009840).ready entity=mon.0 client_cookie=cb9007b98b99896a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:16.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.243+0000 7ff491045700 1 -- 172.21.15.49:0/3971261508 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48400e070 con 0x7ff48c14e600 2023-11-30T17:23:16.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.243+0000 7ff491045700 1 -- 172.21.15.49:0/3971261508 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48400b970 con 0x7ff48c14e600 2023-11-30T17:23:16.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.243+0000 7ff491045700 1 -- 172.21.15.49:0/3971261508 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48400bcf0 con 0x7ff48c14e600 2023-11-30T17:23:16.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.244+0000 7ff4942ab700 1 -- 172.21.15.49:0/3971261508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c14e600 msgr2=0x7ff48c14ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:16.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.244+0000 7ff4942ab700 1 --2- 172.21.15.49:0/3971261508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c14e600 0x7ff48c14ea90 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7ff48c0c9050 tx=0x7ff484009840).stop 2023-11-30T17:23:16.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.244+0000 7ff4942ab700 1 -- 172.21.15.49:0/3971261508 shutdown_connections 2023-11-30T17:23:16.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.244+0000 7ff4942ab700 1 --2- 172.21.15.49:0/3971261508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c14e600 0x7ff48c14ea90 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:16.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.244+0000 7ff4942ab700 1 --2- 172.21.15.49:0/3971261508 >> v2:172.21.15.115:3300/0 conn(0x7ff48c0a8280 0x7ff48c0a8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:16.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.244+0000 7ff4942ab700 1 --2- 172.21.15.49:0/3971261508 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff48c158160 0x7ff48c155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:16.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.244+0000 7ff4942ab700 1 -- 172.21.15.49:0/3971261508 >> 172.21.15.49:0/3971261508 conn(0x7ff48c062700 msgr2=0x7ff48c062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:16.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.244+0000 7ff4942ab700 1 -- 172.21.15.49:0/3971261508 shutdown_connections 2023-11-30T17:23:16.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.244+0000 7ff4942ab700 1 -- 172.21.15.49:0/3971261508 wait complete. 2023-11-30T17:23:16.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.245+0000 7ff4942ab700 1 Processor -- start 2023-11-30T17:23:16.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.245+0000 7ff4942ab700 1 -- start start 2023-11-30T17:23:16.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.246+0000 7ff4942ab700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c0a8280 0x7ff48c157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:16.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.246+0000 7ff4942ab700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff48c14e600 0x7ff48c14cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:16.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.246+0000 7ff4942ab700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff48c158160 0x7ff48c0ae680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:16.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.246+0000 7ff4942ab700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c0a9ca0 con 0x7ff48c0a8280 2023-11-30T17:23:16.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.246+0000 7ff4942ab700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c0a9090 con 0x7ff48c158160 2023-11-30T17:23:16.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.246+0000 7ff4942ab700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c0a9370 con 0x7ff48c14e600 2023-11-30T17:23:16.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.246+0000 7ff492047700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c0a8280 0x7ff48c157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:16.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.246+0000 7ff492047700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c0a8280 0x7ff48c157490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36248/0 (socket says 172.21.15.49:36248) 2023-11-30T17:23:16.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.246+0000 7ff492047700 1 -- 172.21.15.49:0/3579719094 learned_addr learned my addr 172.21.15.49:0/3579719094 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:16.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.246+0000 7ff491846700 1 --2- 172.21.15.49:0/3579719094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff48c14e600 0x7ff48c14cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:16.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.246+0000 7ff492848700 1 --2- 172.21.15.49:0/3579719094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff48c158160 0x7ff48c0ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:16.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.246+0000 7ff492047700 1 -- 172.21.15.49:0/3579719094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff48c14e600 msgr2=0x7ff48c14cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:16.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.246+0000 7ff492047700 1 --2- 172.21.15.49:0/3579719094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff48c14e600 0x7ff48c14cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:16.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.246+0000 7ff492047700 1 -- 172.21.15.49:0/3579719094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff48c158160 msgr2=0x7ff48c0ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:16.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.246+0000 7ff492047700 1 --2- 172.21.15.49:0/3579719094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff48c158160 0x7ff48c0ae680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:16.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.246+0000 7ff492047700 1 -- 172.21.15.49:0/3579719094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c0092a0 con 0x7ff48c0a8280 2023-11-30T17:23:16.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.247+0000 7ff492047700 1 --2- 172.21.15.49:0/3579719094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c0a8280 0x7ff48c157490 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7ff47c00ea20 tx=0x7ff47c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:16.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.247+0000 7ff4827fc700 1 -- 172.21.15.49:0/3579719094 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c00ee60 con 0x7ff48c0a8280 2023-11-30T17:23:16.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.247+0000 7ff4827fc700 1 -- 172.21.15.49:0/3579719094 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47c00c850 con 0x7ff48c0a8280 2023-11-30T17:23:16.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.247+0000 7ff4942ab700 1 -- 172.21.15.49:0/3579719094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff484009ae0 con 0x7ff48c0a8280 2023-11-30T17:23:16.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.247+0000 7ff4827fc700 1 -- 172.21.15.49:0/3579719094 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c00cbd0 con 0x7ff48c0a8280 2023-11-30T17:23:16.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.247+0000 7ff4942ab700 1 -- 172.21.15.49:0/3579719094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff48c0a9930 con 0x7ff48c0a8280 2023-11-30T17:23:16.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.248+0000 7ff4942ab700 1 -- 172.21.15.49:0/3579719094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff48c0a9f80 con 0x7ff48c0a8280 2023-11-30T17:23:16.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.248+0000 7ff4827fc700 1 -- 172.21.15.49:0/3579719094 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 37) v1 ==== 75605+0+0 (secure 0 0 0) 0x7ff47c01b400 con 0x7ff48c0a8280 2023-11-30T17:23:16.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.248+0000 7ff4827fc700 1 --2- 172.21.15.49:0/3579719094 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff47005f2d0 0x7ff470061790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:16.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.249+0000 7ff491846700 1 -- 172.21.15.49:0/3579719094 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff47005f2d0 msgr2=0x7ff470061790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:23:16.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.249+0000 7ff4827fc700 1 -- 172.21.15.49:0/3579719094 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6407+0+0 (secure 0 0 0) 0x7ff47c07ab30 con 0x7ff48c0a8280 2023-11-30T17:23:16.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.249+0000 7ff491846700 1 --2- 172.21.15.49:0/3579719094 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff47005f2d0 0x7ff470061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:23:16.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.253+0000 7ff4827fc700 1 -- 172.21.15.49:0/3579719094 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff47c04bb00 con 0x7ff48c0a8280 2023-11-30T17:23:16.291 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:16.289+0000 7f5ae1afb680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T17:23:16.363 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:16.361+0000 7f5ae1afb680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T17:23:16.371 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:16.370+0000 7fdefd014680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T17:23:16.442 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:16.441+0000 7fdefd014680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T17:23:16.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.450+0000 7ff491846700 1 -- 172.21.15.49:0/3579719094 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff47005f2d0 msgr2=0x7ff470061790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:23:16.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.450+0000 7ff491846700 1 --2- 172.21.15.49:0/3579719094 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff47005f2d0 0x7ff470061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:23:16.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.473+0000 7ff4942ab700 1 -- 172.21.15.49:0/3579719094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff48c14e440 con 0x7ff48c0a8280 2023-11-30T17:23:16.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.473+0000 7ff4827fc700 1 -- 172.21.15.49:0/3579719094 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v99) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff47c04f120 con 0x7ff48c0a8280 2023-11-30T17:23:16.475 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T17:23:16.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.475+0000 7ff4942ab700 1 -- 172.21.15.49:0/3579719094 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff47005f2d0 msgr2=0x7ff470061790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:23:16.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.475+0000 7ff4942ab700 1 --2- 172.21.15.49:0/3579719094 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff47005f2d0 0x7ff470061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:16.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.475+0000 7ff4942ab700 1 -- 172.21.15.49:0/3579719094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c0a8280 msgr2=0x7ff48c157490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:16.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.475+0000 7ff4942ab700 1 --2- 172.21.15.49:0/3579719094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c0a8280 0x7ff48c157490 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7ff47c00ea20 tx=0x7ff47c009060).stop 2023-11-30T17:23:16.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.475+0000 7ff4942ab700 1 -- 172.21.15.49:0/3579719094 shutdown_connections 2023-11-30T17:23:16.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.475+0000 7ff4942ab700 1 --2- 172.21.15.49:0/3579719094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff48c158160 0x7ff48c0ae680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:16.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.475+0000 7ff4942ab700 1 --2- 172.21.15.49:0/3579719094 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff47005f2d0 0x7ff470061790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:16.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.475+0000 7ff4942ab700 1 --2- 172.21.15.49:0/3579719094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c0a8280 0x7ff48c157490 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:16.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.475+0000 7ff4942ab700 1 --2- 172.21.15.49:0/3579719094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff48c14e600 0x7ff48c14cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:16.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.475+0000 7ff4942ab700 1 -- 172.21.15.49:0/3579719094 >> 172.21.15.49:0/3579719094 conn(0x7ff48c062700 msgr2=0x7ff48c0c7040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:16.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.475+0000 7ff4942ab700 1 -- 172.21.15.49:0/3579719094 shutdown_connections 2023-11-30T17:23:16.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.475+0000 7ff4942ab700 1 -- 172.21.15.49:0/3579719094 wait complete. 2023-11-30T17:23:16.489 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T17:23:16.548 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:16.547+0000 7f5ae1afb680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T17:23:16.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.611+0000 7f2d0dac4700 1 Processor -- start 2023-11-30T17:23:16.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.611+0000 7f2d0dac4700 1 -- start start 2023-11-30T17:23:16.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.612+0000 7f2d0dac4700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2d08098d10 0x7f2d080c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:16.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.612+0000 7f2d0dac4700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2d080c6190 0x7f2d08063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:16.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.612+0000 7f2d0dac4700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d080c72d0 con 0x7f2d08064350 2023-11-30T17:23:16.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.612+0000 7f2d0dac4700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d08154bc0 con 0x7f2d08098d10 2023-11-30T17:23:16.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.612+0000 7f2d0dac4700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d080c66c0 con 0x7f2d080c6190 2023-11-30T17:23:16.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.613+0000 7f2d077fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2d08098d10 0x7f2d080c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:16.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.613+0000 7f2d077fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2d08098d10 0x7f2d080c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36260/0 (socket says 172.21.15.49:36260) 2023-11-30T17:23:16.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.613+0000 7f2d077fe700 1 -- 172.21.15.49:0/836681903 learned_addr learned my addr 172.21.15.49:0/836681903 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:16.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.613+0000 7f2d06ffd700 1 --2- 172.21.15.49:0/836681903 >> v2:172.21.15.115:3300/0 conn(0x7f2d080c6190 0x7f2d08063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:16.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.613+0000 7f2d067fc700 1 -- 172.21.15.49:0/836681903 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3483951634 0 0) 0x7f2d080c72d0 con 0x7f2d08064350 2023-11-30T17:23:16.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.613+0000 7f2d067fc700 1 -- 172.21.15.49:0/836681903 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cf40033f0 con 0x7f2d08064350 2023-11-30T17:23:16.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.613+0000 7f2d077fe700 1 -- 172.21.15.49:0/836681903 >> v2:172.21.15.115:3300/0 conn(0x7f2d080c6190 msgr2=0x7f2d08063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:16.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.613+0000 7f2d077fe700 1 --2- 172.21.15.49:0/836681903 >> v2:172.21.15.115:3300/0 conn(0x7f2d080c6190 0x7f2d08063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:16.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.613+0000 7f2d077fe700 1 -- 172.21.15.49:0/836681903 >> v1:172.21.15.115:6789/0 conn(0x7f2d08064350 legacy=0x7f2d08158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:16.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.613+0000 7f2d077fe700 1 -- 172.21.15.49:0/836681903 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d080c69a0 con 0x7f2d08098d10 2023-11-30T17:23:16.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.613+0000 7f2d06ffd700 1 --2- 172.21.15.49:0/836681903 >> v2:172.21.15.115:3300/0 conn(0x7f2d080c6190 0x7f2d08063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:23:16.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.613+0000 7f2d077fe700 1 --2- 172.21.15.49:0/836681903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d08098d10 0x7f2d080c7760 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7f2d080c5b40 tx=0x7f2cf80090f0).ready entity=mon.0 client_cookie=81bac6fc13d2c975 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:16.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.613+0000 7f2d067fc700 1 -- 172.21.15.49:0/836681903 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf800f510 con 0x7f2d08098d10 2023-11-30T17:23:16.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.613+0000 7f2d067fc700 1 -- 172.21.15.49:0/836681903 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf800f670 con 0x7f2d08098d10 2023-11-30T17:23:16.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.613+0000 7f2d067fc700 1 -- 172.21.15.49:0/836681903 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf800f9f0 con 0x7f2d08098d10 2023-11-30T17:23:16.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.614+0000 7f2d0dac4700 1 -- 172.21.15.49:0/836681903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d08098d10 msgr2=0x7f2d080c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:16.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.614+0000 7f2d0dac4700 1 --2- 172.21.15.49:0/836681903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d08098d10 0x7f2d080c7760 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7f2d080c5b40 tx=0x7f2cf80090f0).stop 2023-11-30T17:23:16.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.614+0000 7f2d0dac4700 1 -- 172.21.15.49:0/836681903 shutdown_connections 2023-11-30T17:23:16.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.614+0000 7f2d0dac4700 1 --2- 172.21.15.49:0/836681903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d08098d10 0x7f2d080c7760 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:16.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.614+0000 7f2d0dac4700 1 --2- 172.21.15.49:0/836681903 >> v2:172.21.15.115:3300/0 conn(0x7f2d080c6190 0x7f2d08063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:16.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.614+0000 7f2d0dac4700 1 -- 172.21.15.49:0/836681903 >> 172.21.15.49:0/836681903 conn(0x7f2d080cb310 msgr2=0x7f2d080cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:16.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.614+0000 7f2d0dac4700 1 -- 172.21.15.49:0/836681903 shutdown_connections 2023-11-30T17:23:16.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.614+0000 7f2d0dac4700 1 -- 172.21.15.49:0/836681903 wait complete. 2023-11-30T17:23:16.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.615+0000 7f2d0dac4700 1 Processor -- start 2023-11-30T17:23:16.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.615+0000 7f2d0dac4700 1 -- start start 2023-11-30T17:23:16.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.616+0000 7f2d0dac4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d08064350 0x7f2d08150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:16.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.616+0000 7f2d0dac4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d08098d10 0x7f2d080aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:16.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.616+0000 7f2d0dac4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d080c6190 0x7f2d080a9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:16.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.616+0000 7f2d0dac4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d08157420 con 0x7f2d080c6190 2023-11-30T17:23:16.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.616+0000 7f2d0dac4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d080a94c0 con 0x7f2d08098d10 2023-11-30T17:23:16.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.616+0000 7f2d0dac4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d080a91c0 con 0x7f2d08064350 2023-11-30T17:23:16.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.616+0000 7f2d07fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d080c6190 0x7f2d080a9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:16.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.616+0000 7f2d077fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d08064350 0x7f2d08150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:16.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.616+0000 7f2d06ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d08098d10 0x7f2d080aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:16.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.616+0000 7f2d077fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d08064350 0x7f2d08150a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:46292/0 (socket says 172.21.15.49:46292) 2023-11-30T17:23:16.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.616+0000 7f2d077fe700 1 -- 172.21.15.49:0/838013300 learned_addr learned my addr 172.21.15.49:0/838013300 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:16.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.617+0000 7f2d077fe700 1 -- 172.21.15.49:0/838013300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d08098d10 msgr2=0x7f2d080aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:16.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.617+0000 7f2d077fe700 1 --2- 172.21.15.49:0/838013300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d08098d10 0x7f2d080aebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:16.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.617+0000 7f2d077fe700 1 -- 172.21.15.49:0/838013300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d080c6190 msgr2=0x7f2d080a9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:16.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.617+0000 7f2d077fe700 1 --2- 172.21.15.49:0/838013300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d080c6190 0x7f2d080a9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:16.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.617+0000 7f2d077fe700 1 -- 172.21.15.49:0/838013300 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf00092a0 con 0x7f2d08064350 2023-11-30T17:23:16.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.617+0000 7f2d07fff700 1 --2- 172.21.15.49:0/838013300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d080c6190 0x7f2d080a9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:23:16.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.617+0000 7f2d077fe700 1 --2- 172.21.15.49:0/838013300 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d08064350 0x7f2d08150a80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f2cf8006fd0 tx=0x7f2cf8017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:16.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.617+0000 7f2cff7fe700 1 -- 172.21.15.49:0/838013300 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf800f7e0 con 0x7f2d08064350 2023-11-30T17:23:16.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.617+0000 7f2cff7fe700 1 -- 172.21.15.49:0/838013300 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf800f940 con 0x7f2d08064350 2023-11-30T17:23:16.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.617+0000 7f2d0dac4700 1 -- 172.21.15.49:0/838013300 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf8009370 con 0x7f2d08064350 2023-11-30T17:23:16.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.617+0000 7f2cff7fe700 1 -- 172.21.15.49:0/838013300 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf801c670 con 0x7f2d08064350 2023-11-30T17:23:16.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.617+0000 7f2d0dac4700 1 -- 172.21.15.49:0/838013300 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d08157600 con 0x7f2d08064350 2023-11-30T17:23:16.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.618+0000 7f2d0dac4700 1 -- 172.21.15.49:0/838013300 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d080a97a0 con 0x7f2d08064350 2023-11-30T17:23:16.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.618+0000 7f2cff7fe700 1 -- 172.21.15.49:0/838013300 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 37) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f2cf801ca20 con 0x7f2d08064350 2023-11-30T17:23:16.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.619+0000 7f2cff7fe700 1 --2- 172.21.15.49:0/838013300 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2ce805f300 0x7f2ce80617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:16.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.619+0000 7f2d06ffd700 1 -- 172.21.15.49:0/838013300 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2ce805f300 msgr2=0x7f2ce80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:23:16.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.619+0000 7f2cff7fe700 1 -- 172.21.15.49:0/838013300 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6407+0+0 (secure 0 0 0) 0x7f2cf807c060 con 0x7f2d08064350 2023-11-30T17:23:16.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.619+0000 7f2d06ffd700 1 --2- 172.21.15.49:0/838013300 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2ce805f300 0x7f2ce80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:23:16.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.623+0000 7f2cff7fe700 1 -- 172.21.15.49:0/838013300 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2cf804d010 con 0x7f2d08064350 2023-11-30T17:23:16.642 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:16.640+0000 7fdefd014680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T17:23:16.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.797+0000 7f2d0dac4700 1 -- 172.21.15.49:0/838013300 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2d0806c860 con 0x7f2d08064350 2023-11-30T17:23:16.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.797+0000 7f2cff7fe700 1 -- 172.21.15.49:0/838013300 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v99) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2cf802a0a0 con 0x7f2d08064350 2023-11-30T17:23:16.799 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T17:23:16.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.799+0000 7f2d0dac4700 1 -- 172.21.15.49:0/838013300 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2ce805f300 msgr2=0x7f2ce80617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:23:16.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.799+0000 7f2d0dac4700 1 --2- 172.21.15.49:0/838013300 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2ce805f300 0x7f2ce80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:16.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.799+0000 7f2d0dac4700 1 -- 172.21.15.49:0/838013300 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d08064350 msgr2=0x7f2d08150a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:16.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.799+0000 7f2d0dac4700 1 --2- 172.21.15.49:0/838013300 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d08064350 0x7f2d08150a80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f2cf8006fd0 tx=0x7f2cf8017000).stop 2023-11-30T17:23:16.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.799+0000 7f2d0dac4700 1 -- 172.21.15.49:0/838013300 shutdown_connections 2023-11-30T17:23:16.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.799+0000 7f2d0dac4700 1 --2- 172.21.15.49:0/838013300 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2ce805f300 0x7f2ce80617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:16.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.799+0000 7f2d0dac4700 1 --2- 172.21.15.49:0/838013300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d080c6190 0x7f2d080a9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:16.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.799+0000 7f2d0dac4700 1 --2- 172.21.15.49:0/838013300 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d08064350 0x7f2d08150a80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:16.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.799+0000 7f2d0dac4700 1 --2- 172.21.15.49:0/838013300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d08098d10 0x7f2d080aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:16.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.799+0000 7f2d0dac4700 1 -- 172.21.15.49:0/838013300 >> 172.21.15.49:0/838013300 conn(0x7f2d080cb310 msgr2=0x7f2d081523f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:16.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.799+0000 7f2d0dac4700 1 -- 172.21.15.49:0/838013300 shutdown_connections 2023-11-30T17:23:16.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.799+0000 7f2d0dac4700 1 -- 172.21.15.49:0/838013300 wait complete. 2023-11-30T17:23:16.813 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-30T17:23:16.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.936+0000 7f7d8359e700 1 Processor -- start 2023-11-30T17:23:16.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.936+0000 7f7d8359e700 1 -- start start 2023-11-30T17:23:16.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.937+0000 7f7d8359e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7d840c66f0 0x7f7d84154950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:16.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.937+0000 7f7d8359e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7d84158570 0x7f7d84158a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:16.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.937+0000 7f7d8359e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d84154e40 con 0x7f7d8414e530 2023-11-30T17:23:16.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.937+0000 7f7d8359e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d840c6ba0 con 0x7f7d840c66f0 2023-11-30T17:23:16.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.937+0000 7f7d8359e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d840c7bc0 con 0x7f7d84158570 2023-11-30T17:23:16.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.937+0000 7f7d81d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7d840c66f0 0x7f7d84154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:16.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.937+0000 7f7d8259c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7d8414e530 0x7f7d8414e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49174/0 (socket says 172.21.15.49:49174) 2023-11-30T17:23:16.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.937+0000 7f7d8259c700 1 -- 172.21.15.49:0/3759885005 learned_addr learned my addr 172.21.15.49:0/3759885005 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:16.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.937+0000 7f7d82d9d700 1 --2- 172.21.15.49:0/3759885005 >> v2:172.21.15.115:3300/0 conn(0x7f7d84158570 0x7f7d84158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:16.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.938+0000 7f7d81d9b700 1 -- 172.21.15.49:0/3759885005 >> v2:172.21.15.115:3300/0 conn(0x7f7d84158570 msgr2=0x7f7d84158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:16.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.938+0000 7f7d81d9b700 1 --2- 172.21.15.49:0/3759885005 >> v2:172.21.15.115:3300/0 conn(0x7f7d84158570 0x7f7d84158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:16.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.938+0000 7f7d8159a700 1 -- 172.21.15.49:0/3759885005 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2661954450 0 0) 0x7f7d74001110 con 0x7f7d8414e530 2023-11-30T17:23:16.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.938+0000 7f7d81d9b700 1 -- 172.21.15.49:0/3759885005 >> v1:172.21.15.49:6789/0 conn(0x7f7d8414e530 legacy=0x7f7d8414e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:16.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.938+0000 7f7d81d9b700 1 -- 172.21.15.49:0/3759885005 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d84155920 con 0x7f7d840c66f0 2023-11-30T17:23:16.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.938+0000 7f7d81d9b700 1 --2- 172.21.15.49:0/3759885005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d840c66f0 0x7f7d84154950 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7f7d840aac80 tx=0x7f7d78009060).ready entity=mon.0 client_cookie=f74952c6809150ab server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:16.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.938+0000 7f7d8159a700 1 -- 172.21.15.49:0/3759885005 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7800f510 con 0x7f7d840c66f0 2023-11-30T17:23:16.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.938+0000 7f7d8159a700 1 -- 172.21.15.49:0/3759885005 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7800f670 con 0x7f7d840c66f0 2023-11-30T17:23:16.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.938+0000 7f7d8159a700 1 -- 172.21.15.49:0/3759885005 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7800f9f0 con 0x7f7d840c66f0 2023-11-30T17:23:16.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.939+0000 7f7d8359e700 1 -- 172.21.15.49:0/3759885005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d840c66f0 msgr2=0x7f7d84154950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:16.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.939+0000 7f7d8359e700 1 --2- 172.21.15.49:0/3759885005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d840c66f0 0x7f7d84154950 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7f7d840aac80 tx=0x7f7d78009060).stop 2023-11-30T17:23:16.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.939+0000 7f7d8359e700 1 -- 172.21.15.49:0/3759885005 shutdown_connections 2023-11-30T17:23:16.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.939+0000 7f7d8359e700 1 --2- 172.21.15.49:0/3759885005 >> v2:172.21.15.115:3300/0 conn(0x7f7d84158570 0x7f7d84158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:16.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.939+0000 7f7d8359e700 1 --2- 172.21.15.49:0/3759885005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d840c66f0 0x7f7d84154950 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:16.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.939+0000 7f7d8359e700 1 -- 172.21.15.49:0/3759885005 >> 172.21.15.49:0/3759885005 conn(0x7f7d84064990 msgr2=0x7f7d84064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:16.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.939+0000 7f7d8359e700 1 -- 172.21.15.49:0/3759885005 shutdown_connections 2023-11-30T17:23:16.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.939+0000 7f7d8359e700 1 -- 172.21.15.49:0/3759885005 wait complete. 2023-11-30T17:23:16.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.940+0000 7f7d8359e700 1 Processor -- start 2023-11-30T17:23:16.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.940+0000 7f7d8359e700 1 -- start start 2023-11-30T17:23:16.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.941+0000 7f7d8359e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d840c66f0 0x7f7d8413eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:16.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.941+0000 7f7d8359e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7d8414e530 0x7f7d840afef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:16.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.941+0000 7f7d8359e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d84158570 0x7f7d84156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:16.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.941+0000 7f7d8359e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d840c4410 con 0x7f7d840c66f0 2023-11-30T17:23:16.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.941+0000 7f7d8359e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d840b09e0 con 0x7f7d84158570 2023-11-30T17:23:16.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.941+0000 7f7d8359e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8413f010 con 0x7f7d8414e530 2023-11-30T17:23:16.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.941+0000 7f7d8259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d840c66f0 0x7f7d8413eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:16.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.941+0000 7f7d8259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d840c66f0 0x7f7d8413eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36282/0 (socket says 172.21.15.49:36282) 2023-11-30T17:23:16.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.941+0000 7f7d8259c700 1 -- 172.21.15.49:0/2664706055 learned_addr learned my addr 172.21.15.49:0/2664706055 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:16.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.941+0000 7f7d82d9d700 1 --2- 172.21.15.49:0/2664706055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d84158570 0x7f7d84156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:16.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.941+0000 7f7d81d9b700 1 --2- 172.21.15.49:0/2664706055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7d8414e530 0x7f7d840afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:16.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.941+0000 7f7d82d9d700 1 -- 172.21.15.49:0/2664706055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7d8414e530 msgr2=0x7f7d840afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:16.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.941+0000 7f7d82d9d700 1 --2- 172.21.15.49:0/2664706055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7d8414e530 0x7f7d840afef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:16.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.941+0000 7f7d82d9d700 1 -- 172.21.15.49:0/2664706055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d840c66f0 msgr2=0x7f7d8413eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:16.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.941+0000 7f7d82d9d700 1 --2- 172.21.15.49:0/2664706055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d840c66f0 0x7f7d8413eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:16.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.941+0000 7f7d82d9d700 1 -- 172.21.15.49:0/2664706055 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d780092a0 con 0x7f7d84158570 2023-11-30T17:23:16.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.941+0000 7f7d8259c700 1 --2- 172.21.15.49:0/2664706055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d840c66f0 0x7f7d8413eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:23:16.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.941+0000 7f7d82d9d700 1 --2- 172.21.15.49:0/2664706055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d84158570 0x7f7d84156a80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f7d7c009e50 tx=0x7f7d7c00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:16.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.942+0000 7f7d727fc700 1 -- 172.21.15.49:0/2664706055 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c009bb0 con 0x7f7d84158570 2023-11-30T17:23:16.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.942+0000 7f7d727fc700 1 -- 172.21.15.49:0/2664706055 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7c00f040 con 0x7f7d84158570 2023-11-30T17:23:16.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.942+0000 7f7d8359e700 1 -- 172.21.15.49:0/2664706055 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d84168bf0 con 0x7f7d84158570 2023-11-30T17:23:16.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.942+0000 7f7d727fc700 1 -- 172.21.15.49:0/2664706055 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c00ccd0 con 0x7f7d84158570 2023-11-30T17:23:16.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.942+0000 7f7d8359e700 1 -- 172.21.15.49:0/2664706055 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d84168070 con 0x7f7d84158570 2023-11-30T17:23:16.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.943+0000 7f7d8359e700 1 -- 172.21.15.49:0/2664706055 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d84062ee0 con 0x7f7d84158570 2023-11-30T17:23:16.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.943+0000 7f7d727fc700 1 -- 172.21.15.49:0/2664706055 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 37) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f7d7c013610 con 0x7f7d84158570 2023-11-30T17:23:16.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.944+0000 7f7d727fc700 1 --2- 172.21.15.49:0/2664706055 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7d6405f300 0x7f7d640617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:16.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.944+0000 7f7d8259c700 1 -- 172.21.15.49:0/2664706055 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7d6405f300 msgr2=0x7f7d640617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:23:16.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.944+0000 7f7d727fc700 1 -- 172.21.15.49:0/2664706055 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6407+0+0 (secure 0 0 0) 0x7f7d7c07ae00 con 0x7f7d84158570 2023-11-30T17:23:16.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.944+0000 7f7d8259c700 1 --2- 172.21.15.49:0/2664706055 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7d6405f300 0x7f7d640617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:23:16.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:16.948+0000 7f7d727fc700 1 -- 172.21.15.49:0/2664706055 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7d7c04f6d0 con 0x7f7d84158570 2023-11-30T17:23:16.972 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:16.970+0000 7f5ae1afb680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T17:23:17.076 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:17.075+0000 7f5ae1afb680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:23:17.088 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:17.087+0000 7fdefd014680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T17:23:17.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.121+0000 7f7d8359e700 1 -- 172.21.15.49:0/2664706055 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7d8406c7c0 con 0x7f7d84158570 2023-11-30T17:23:17.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.121+0000 7f7d727fc700 1 -- 172.21.15.49:0/2664706055 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v99) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7d7c04f2c0 con 0x7f7d84158570 2023-11-30T17:23:17.123 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T17:23:17.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.124+0000 7f7d8359e700 1 -- 172.21.15.49:0/2664706055 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7d6405f300 msgr2=0x7f7d640617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:23:17.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.124+0000 7f7d8359e700 1 --2- 172.21.15.49:0/2664706055 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7d6405f300 0x7f7d640617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:17.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.124+0000 7f7d8359e700 1 -- 172.21.15.49:0/2664706055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d84158570 msgr2=0x7f7d84156a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:17.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.124+0000 7f7d8359e700 1 --2- 172.21.15.49:0/2664706055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d84158570 0x7f7d84156a80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f7d7c009e50 tx=0x7f7d7c00b040).stop 2023-11-30T17:23:17.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.124+0000 7f7d8359e700 1 -- 172.21.15.49:0/2664706055 shutdown_connections 2023-11-30T17:23:17.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.124+0000 7f7d8359e700 1 --2- 172.21.15.49:0/2664706055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d84158570 0x7f7d84156a80 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:17.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.124+0000 7f7d8359e700 1 --2- 172.21.15.49:0/2664706055 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7d6405f300 0x7f7d640617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:17.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.124+0000 7f7d8359e700 1 --2- 172.21.15.49:0/2664706055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d840c66f0 0x7f7d8413eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:17.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.124+0000 7f7d8359e700 1 --2- 172.21.15.49:0/2664706055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7d8414e530 0x7f7d840afef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:17.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.124+0000 7f7d8359e700 1 -- 172.21.15.49:0/2664706055 >> 172.21.15.49:0/2664706055 conn(0x7f7d84064990 msgr2=0x7f7d8414dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:17.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.124+0000 7f7d8359e700 1 -- 172.21.15.49:0/2664706055 shutdown_connections 2023-11-30T17:23:17.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.124+0000 7f7d8359e700 1 -- 172.21.15.49:0/2664706055 wait complete. 2023-11-30T17:23:17.137 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-30T17:23:17.200 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:17.199+0000 7fdefd014680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:23:17.230 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:17.228+0000 7f5ae1afb680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T17:23:17.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.259+0000 7fcf44aa5700 1 Processor -- start 2023-11-30T17:23:17.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.259+0000 7fcf44aa5700 1 -- start start 2023-11-30T17:23:17.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.260+0000 7fcf44aa5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf40098d10 0x7fcf400c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:17.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.260+0000 7fcf44aa5700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcf400c6190 0x7fcf40063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:17.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.260+0000 7fcf44aa5700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf400c72d0 con 0x7fcf40064350 2023-11-30T17:23:17.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.260+0000 7fcf44aa5700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf40154bc0 con 0x7fcf400c6190 2023-11-30T17:23:17.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.260+0000 7fcf44aa5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf400c66c0 con 0x7fcf40098d10 2023-11-30T17:23:17.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.261+0000 7fcf3dd9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcf400c6190 0x7fcf40063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:17.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.261+0000 7fcf3e59c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf40098d10 0x7fcf400c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:17.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.261+0000 7fcf3ed9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fcf40064350 0x7fcf40158320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:35060/0 (socket says 172.21.15.49:35060) 2023-11-30T17:23:17.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.261+0000 7fcf3ed9d700 1 -- 172.21.15.49:0/1259094451 learned_addr learned my addr 172.21.15.49:0/1259094451 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:17.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.261+0000 7fcf3e59c700 1 -- 172.21.15.49:0/1259094451 >> v2:172.21.15.115:3300/0 conn(0x7fcf400c6190 msgr2=0x7fcf40063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:17.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.261+0000 7fcf3e59c700 1 --2- 172.21.15.49:0/1259094451 >> v2:172.21.15.115:3300/0 conn(0x7fcf400c6190 0x7fcf40063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:17.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.261+0000 7fcf3e59c700 1 -- 172.21.15.49:0/1259094451 >> v1:172.21.15.115:6789/0 conn(0x7fcf40064350 legacy=0x7fcf40158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:17.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.261+0000 7fcf3e59c700 1 -- 172.21.15.49:0/1259094451 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf400c69a0 con 0x7fcf40098d10 2023-11-30T17:23:17.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.261+0000 7fcf3d59a700 1 -- 172.21.15.49:0/1259094451 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3957477036 0 0) 0x7fcf400c72d0 con 0x7fcf40064350 2023-11-30T17:23:17.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.261+0000 7fcf3dd9b700 1 --2- 172.21.15.49:0/1259094451 >> v2:172.21.15.115:3300/0 conn(0x7fcf400c6190 0x7fcf40063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:23:17.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.261+0000 7fcf3e59c700 1 --2- 172.21.15.49:0/1259094451 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf40098d10 0x7fcf400c7760 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fcf30009760 tx=0x7fcf30009060).ready entity=mon.2 client_cookie=98c5d05662cce4c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.261+0000 7fcf3d59a700 1 -- 172.21.15.49:0/1259094451 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3000f510 con 0x7fcf40098d10 2023-11-30T17:23:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.262+0000 7fcf3d59a700 1 -- 172.21.15.49:0/1259094451 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3000f670 con 0x7fcf40098d10 2023-11-30T17:23:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.262+0000 7fcf3d59a700 1 -- 172.21.15.49:0/1259094451 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3000f9f0 con 0x7fcf40098d10 2023-11-30T17:23:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.262+0000 7fcf44aa5700 1 -- 172.21.15.49:0/1259094451 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf40098d10 msgr2=0x7fcf400c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.262+0000 7fcf44aa5700 1 --2- 172.21.15.49:0/1259094451 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf40098d10 0x7fcf400c7760 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fcf30009760 tx=0x7fcf30009060).stop 2023-11-30T17:23:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.262+0000 7fcf44aa5700 1 -- 172.21.15.49:0/1259094451 shutdown_connections 2023-11-30T17:23:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.262+0000 7fcf44aa5700 1 --2- 172.21.15.49:0/1259094451 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf40098d10 0x7fcf400c7760 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.262+0000 7fcf44aa5700 1 --2- 172.21.15.49:0/1259094451 >> v2:172.21.15.115:3300/0 conn(0x7fcf400c6190 0x7fcf40063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.262+0000 7fcf44aa5700 1 -- 172.21.15.49:0/1259094451 >> 172.21.15.49:0/1259094451 conn(0x7fcf400cb310 msgr2=0x7fcf400cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.262+0000 7fcf44aa5700 1 -- 172.21.15.49:0/1259094451 shutdown_connections 2023-11-30T17:23:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.262+0000 7fcf44aa5700 1 -- 172.21.15.49:0/1259094451 wait complete. 2023-11-30T17:23:17.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.263+0000 7fcf44aa5700 1 Processor -- start 2023-11-30T17:23:17.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.263+0000 7fcf44aa5700 1 -- start start 2023-11-30T17:23:17.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.264+0000 7fcf44aa5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf40064350 0x7fcf401574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:17.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.264+0000 7fcf44aa5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf40098d10 0x7fcf400a86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.264+0000 7fcf44aa5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf400c6190 0x7fcf4014fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.264+0000 7fcf44aa5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf401555b0 con 0x7fcf40064350 2023-11-30T17:23:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.264+0000 7fcf44aa5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf40155e50 con 0x7fcf40098d10 2023-11-30T17:23:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.264+0000 7fcf44aa5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf40150c50 con 0x7fcf400c6190 2023-11-30T17:23:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.264+0000 7fcf3e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf40064350 0x7fcf401574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.264+0000 7fcf3e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf40064350 0x7fcf401574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36294/0 (socket says 172.21.15.49:36294) 2023-11-30T17:23:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.264+0000 7fcf3e59c700 1 -- 172.21.15.49:0/2169334150 learned_addr learned my addr 172.21.15.49:0/2169334150 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.264+0000 7fcf3dd9b700 1 --2- 172.21.15.49:0/2169334150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf40098d10 0x7fcf400a86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.264+0000 7fcf3ed9d700 1 --2- 172.21.15.49:0/2169334150 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf400c6190 0x7fcf4014fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.265+0000 7fcf3dd9b700 1 -- 172.21.15.49:0/2169334150 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf400c6190 msgr2=0x7fcf4014fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.265+0000 7fcf3dd9b700 1 --2- 172.21.15.49:0/2169334150 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf400c6190 0x7fcf4014fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.265+0000 7fcf3dd9b700 1 -- 172.21.15.49:0/2169334150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf40064350 msgr2=0x7fcf401574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.265+0000 7fcf3dd9b700 1 --2- 172.21.15.49:0/2169334150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf40064350 0x7fcf401574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.265+0000 7fcf3dd9b700 1 -- 172.21.15.49:0/2169334150 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf340092a0 con 0x7fcf40098d10 2023-11-30T17:23:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.265+0000 7fcf3e59c700 1 --2- 172.21.15.49:0/2169334150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf40064350 0x7fcf401574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:23:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.265+0000 7fcf3dd9b700 1 --2- 172.21.15.49:0/2169334150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf40098d10 0x7fcf400a86a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fcf3400e850 tx=0x7fcf34009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.265+0000 7fcf2e7fc700 1 -- 172.21.15.49:0/2169334150 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf340094e0 con 0x7fcf40098d10 2023-11-30T17:23:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.265+0000 7fcf2e7fc700 1 -- 172.21.15.49:0/2169334150 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf34012600 con 0x7fcf40098d10 2023-11-30T17:23:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.265+0000 7fcf44aa5700 1 -- 172.21.15.49:0/2169334150 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf300092a0 con 0x7fcf40098d10 2023-11-30T17:23:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.265+0000 7fcf2e7fc700 1 -- 172.21.15.49:0/2169334150 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf340129a0 con 0x7fcf40098d10 2023-11-30T17:23:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.265+0000 7fcf44aa5700 1 -- 172.21.15.49:0/2169334150 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf40155800 con 0x7fcf40098d10 2023-11-30T17:23:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.266+0000 7fcf44aa5700 1 -- 172.21.15.49:0/2169334150 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf4006c860 con 0x7fcf40098d10 2023-11-30T17:23:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.266+0000 7fcf2e7fc700 1 -- 172.21.15.49:0/2169334150 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 37) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fcf34012d10 con 0x7fcf40098d10 2023-11-30T17:23:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.266+0000 7fcf2e7fc700 1 --2- 172.21.15.49:0/2169334150 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcf2005f300 0x7fcf200617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.267+0000 7fcf3e59c700 1 -- 172.21.15.49:0/2169334150 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcf2005f300 msgr2=0x7fcf200617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:23:17.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.267+0000 7fcf2e7fc700 1 -- 172.21.15.49:0/2169334150 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6407+0+0 (secure 0 0 0) 0x7fcf3407a930 con 0x7fcf40098d10 2023-11-30T17:23:17.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.267+0000 7fcf3e59c700 1 --2- 172.21.15.49:0/2169334150 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcf2005f300 0x7fcf200617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:23:17.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.271+0000 7fcf2e7fc700 1 -- 172.21.15.49:0/2169334150 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcf3404b8e0 con 0x7fcf40098d10 2023-11-30T17:23:17.306 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:17.304+0000 7f5ae1afb680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T17:23:17.362 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:17.361+0000 7fdefd014680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T17:23:17.373 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:17.371+0000 7f5ae1afb680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T17:23:17.440 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:17.439+0000 7fdefd014680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T17:23:17.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.446+0000 7fcf44aa5700 1 -- 172.21.15.49:0/2169334150 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcf400c6c80 con 0x7fcf40098d10 2023-11-30T17:23:17.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.446+0000 7fcf2e7fc700 1 -- 172.21.15.49:0/2169334150 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v99) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcf3404ef00 con 0x7fcf40098d10 2023-11-30T17:23:17.448 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T17:23:17.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.448+0000 7fcf44aa5700 1 -- 172.21.15.49:0/2169334150 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcf2005f300 msgr2=0x7fcf200617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:23:17.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.448+0000 7fcf44aa5700 1 --2- 172.21.15.49:0/2169334150 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcf2005f300 0x7fcf200617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:17.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.448+0000 7fcf44aa5700 1 -- 172.21.15.49:0/2169334150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf40098d10 msgr2=0x7fcf400a86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:17.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.448+0000 7fcf44aa5700 1 --2- 172.21.15.49:0/2169334150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf40098d10 0x7fcf400a86a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fcf3400e850 tx=0x7fcf34009060).stop 2023-11-30T17:23:17.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.448+0000 7fcf44aa5700 1 -- 172.21.15.49:0/2169334150 shutdown_connections 2023-11-30T17:23:17.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.448+0000 7fcf44aa5700 1 --2- 172.21.15.49:0/2169334150 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcf400c6190 0x7fcf4014fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:17.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.448+0000 7fcf44aa5700 1 --2- 172.21.15.49:0/2169334150 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcf2005f300 0x7fcf200617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:17.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.448+0000 7fcf44aa5700 1 --2- 172.21.15.49:0/2169334150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf40064350 0x7fcf401574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:17.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.448+0000 7fcf44aa5700 1 --2- 172.21.15.49:0/2169334150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf40098d10 0x7fcf400a86a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:17.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.448+0000 7fcf44aa5700 1 -- 172.21.15.49:0/2169334150 >> 172.21.15.49:0/2169334150 conn(0x7fcf400cb310 msgr2=0x7fcf40153a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:17.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.448+0000 7fcf44aa5700 1 -- 172.21.15.49:0/2169334150 shutdown_connections 2023-11-30T17:23:17.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.448+0000 7fcf44aa5700 1 -- 172.21.15.49:0/2169334150 wait complete. 2023-11-30T17:23:17.462 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:23:17.514 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:17.512+0000 7fdefd014680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T17:23:17.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.580+0000 7fa8c94d7700 1 Processor -- start 2023-11-30T17:23:17.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.580+0000 7fa8c94d7700 1 -- start start 2023-11-30T17:23:17.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.581+0000 7fa8c94d7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8c406b8e0 0x7fa8c41544a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:17.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.581+0000 7fa8c94d7700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa8c4064950 0x7fa8c40c5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:17.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.581+0000 7fa8c94d7700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c4157fe0 con 0x7fa8c40c51a0 2023-11-30T17:23:17.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.581+0000 7fa8c94d7700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c41582c0 con 0x7fa8c4064950 2023-11-30T17:23:17.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.581+0000 7fa8c94d7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c40628a0 con 0x7fa8c406b8e0 2023-11-30T17:23:17.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.581+0000 7fa8c37fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa8c4064950 0x7fa8c40c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:17.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.581+0000 7fa8c2ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa8c40c51a0 0x7fa8c4153d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49182/0 (socket says 172.21.15.49:49182) 2023-11-30T17:23:17.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.581+0000 7fa8c2ffd700 1 -- 172.21.15.49:0/1061906641 learned_addr learned my addr 172.21.15.49:0/1061906641 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:17.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.581+0000 7fa8c27fc700 1 --2- 172.21.15.49:0/1061906641 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8c406b8e0 0x7fa8c41544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:17.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.581+0000 7fa8c37fe700 1 -- 172.21.15.49:0/1061906641 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8c406b8e0 msgr2=0x7fa8c41544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:17.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.581+0000 7fa8c37fe700 1 --2- 172.21.15.49:0/1061906641 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8c406b8e0 0x7fa8c41544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:17.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.581+0000 7fa8c37fe700 1 -- 172.21.15.49:0/1061906641 >> v1:172.21.15.49:6789/0 conn(0x7fa8c40c51a0 legacy=0x7fa8c4153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:17.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.581+0000 7fa8c37fe700 1 -- 172.21.15.49:0/1061906641 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c4062b80 con 0x7fa8c4064950 2023-11-30T17:23:17.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.581+0000 7fa8c1ffb700 1 -- 172.21.15.49:0/1061906641 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2718569176 0 0) 0x7fa8c4157fe0 con 0x7fa8c40c51a0 2023-11-30T17:23:17.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.582+0000 7fa8c37fe700 1 --2- 172.21.15.49:0/1061906641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8c4064950 0x7fa8c40c5580 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7fa8bc009e90 tx=0x7fa8bc009780).ready entity=mon.0 client_cookie=fc705eabf8f136cb server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:17.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.582+0000 7fa8c1ffb700 1 -- 172.21.15.49:0/1061906641 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc00e070 con 0x7fa8c4064950 2023-11-30T17:23:17.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.582+0000 7fa8c1ffb700 1 -- 172.21.15.49:0/1061906641 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc00bb20 con 0x7fa8c4064950 2023-11-30T17:23:17.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.582+0000 7fa8c1ffb700 1 -- 172.21.15.49:0/1061906641 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc00bea0 con 0x7fa8c4064950 2023-11-30T17:23:17.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.582+0000 7fa8c94d7700 1 -- 172.21.15.49:0/1061906641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8c4064950 msgr2=0x7fa8c40c5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:17.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.582+0000 7fa8c94d7700 1 --2- 172.21.15.49:0/1061906641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8c4064950 0x7fa8c40c5580 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7fa8bc009e90 tx=0x7fa8bc009780).stop 2023-11-30T17:23:17.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.582+0000 7fa8c94d7700 1 -- 172.21.15.49:0/1061906641 shutdown_connections 2023-11-30T17:23:17.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.582+0000 7fa8c94d7700 1 --2- 172.21.15.49:0/1061906641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8c4064950 0x7fa8c40c5580 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:17.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.582+0000 7fa8c94d7700 1 --2- 172.21.15.49:0/1061906641 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8c406b8e0 0x7fa8c41544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:17.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.582+0000 7fa8c94d7700 1 -- 172.21.15.49:0/1061906641 >> 172.21.15.49:0/1061906641 conn(0x7fa8c40c3f20 msgr2=0x7fa8c40c4330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:17.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.582+0000 7fa8c94d7700 1 -- 172.21.15.49:0/1061906641 shutdown_connections 2023-11-30T17:23:17.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.582+0000 7fa8c94d7700 1 -- 172.21.15.49:0/1061906641 wait complete. 2023-11-30T17:23:17.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.584+0000 7fa8c94d7700 1 Processor -- start 2023-11-30T17:23:17.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.584+0000 7fa8c94d7700 1 -- start start 2023-11-30T17:23:17.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.584+0000 7fa8c94d7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8c4064950 0x7fa8c41480a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:17.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.584+0000 7fa8c94d7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8c406b8e0 0x7fa8c4155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:17.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.584+0000 7fa8c94d7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8c40c51a0 0x7fa8c4155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:17.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.584+0000 7fa8c94d7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c414ef40 con 0x7fa8c40c51a0 2023-11-30T17:23:17.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.584+0000 7fa8c94d7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c4156300 con 0x7fa8c406b8e0 2023-11-30T17:23:17.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.584+0000 7fa8c94d7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c4157110 con 0x7fa8c4064950 2023-11-30T17:23:17.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.584+0000 7fa8c37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8c40c51a0 0x7fa8c4155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:17.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.584+0000 7fa8c37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8c40c51a0 0x7fa8c4155e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36314/0 (socket says 172.21.15.49:36314) 2023-11-30T17:23:17.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.584+0000 7fa8c37fe700 1 -- 172.21.15.49:0/2259468028 learned_addr learned my addr 172.21.15.49:0/2259468028 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:17.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.584+0000 7fa8c2ffd700 1 --2- 172.21.15.49:0/2259468028 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8c4064950 0x7fa8c41480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:17.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.585+0000 7fa8c27fc700 1 --2- 172.21.15.49:0/2259468028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8c406b8e0 0x7fa8c4155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:17.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.585+0000 7fa8c37fe700 1 -- 172.21.15.49:0/2259468028 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8c4064950 msgr2=0x7fa8c41480a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:17.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.585+0000 7fa8c37fe700 1 --2- 172.21.15.49:0/2259468028 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8c4064950 0x7fa8c41480a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:17.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.585+0000 7fa8c37fe700 1 -- 172.21.15.49:0/2259468028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8c406b8e0 msgr2=0x7fa8c4155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:17.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.585+0000 7fa8c37fe700 1 --2- 172.21.15.49:0/2259468028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8c406b8e0 0x7fa8c4155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:17.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.585+0000 7fa8c37fe700 1 -- 172.21.15.49:0/2259468028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8bc009a20 con 0x7fa8c40c51a0 2023-11-30T17:23:17.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.585+0000 7fa8c37fe700 1 --2- 172.21.15.49:0/2259468028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8c40c51a0 0x7fa8c4155e10 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7fa8bc00b6c0 tx=0x7fa8bc009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:17.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.585+0000 7fa8aaffd700 1 -- 172.21.15.49:0/2259468028 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc009440 con 0x7fa8c40c51a0 2023-11-30T17:23:17.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.585+0000 7fa8aaffd700 1 -- 172.21.15.49:0/2259468028 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc01d630 con 0x7fa8c40c51a0 2023-11-30T17:23:17.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.585+0000 7fa8aaffd700 1 -- 172.21.15.49:0/2259468028 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc01d9f0 con 0x7fa8c40c51a0 2023-11-30T17:23:17.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.585+0000 7fa8c94d7700 1 -- 172.21.15.49:0/2259468028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c4156500 con 0x7fa8c40c51a0 2023-11-30T17:23:17.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.585+0000 7fa8c94d7700 1 -- 172.21.15.49:0/2259468028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c4156ac0 con 0x7fa8c40c51a0 2023-11-30T17:23:17.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.586+0000 7fa8aaffd700 1 -- 172.21.15.49:0/2259468028 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 37) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fa8bc003040 con 0x7fa8c40c51a0 2023-11-30T17:23:17.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.587+0000 7fa8c94d7700 1 -- 172.21.15.49:0/2259468028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c40c58b0 con 0x7fa8c40c51a0 2023-11-30T17:23:17.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.587+0000 7fa8aaffd700 1 --2- 172.21.15.49:0/2259468028 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa8b005f300 0x7fa8b00617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:17.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.587+0000 7fa8c2ffd700 1 -- 172.21.15.49:0/2259468028 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa8b005f300 msgr2=0x7fa8b00617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:23:17.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.587+0000 7fa8aaffd700 1 -- 172.21.15.49:0/2259468028 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6407+0+0 (secure 0 0 0) 0x7fa8bc07c480 con 0x7fa8c40c51a0 2023-11-30T17:23:17.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.587+0000 7fa8c2ffd700 1 --2- 172.21.15.49:0/2259468028 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa8b005f300 0x7fa8b00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:23:17.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.591+0000 7fa8aaffd700 1 -- 172.21.15.49:0/2259468028 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa8bc04d2e0 con 0x7fa8c40c51a0 2023-11-30T17:23:17.632 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:17.630+0000 7f5ae1afb680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T17:23:17.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.788+0000 7fa8c2ffd700 1 -- 172.21.15.49:0/2259468028 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa8b005f300 msgr2=0x7fa8b00617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:23:17.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.788+0000 7fa8c2ffd700 1 --2- 172.21.15.49:0/2259468028 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa8b005f300 0x7fa8b00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:23:17.806 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:17.805+0000 7fdefd014680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T17:23:17.812 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:17.810+0000 7f5ae1afb680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T17:23:17.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.826+0000 7fa8c94d7700 1 -- 172.21.15.49:0/2259468028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8c4062e60 con 0x7fa8c40c51a0 2023-11-30T17:23:17.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.826+0000 7fa8aaffd700 1 -- 172.21.15.49:0/2259468028 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fa8bc050900 con 0x7fa8c40c51a0 2023-11-30T17:23:17.828 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:17.828 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5906,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3382372491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3382372491},{"type":"v1","addr":"172.21.15.115:6837","nonce":3382372491}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6675,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/962684395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":962684395},{"type":"v1","addr":"172.21.15.49:6834","nonce":962684395}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6678,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1931198509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1931198509},{"type":"v1","addr":"172.21.15.49:6835","nonce":1931198509}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:22:56.913429+0000","modified":"2023-11-30T17:22:59.924885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6687},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6687":{"gid":6687,"name":"d","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/3530976555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3530976555},{"type":"v1","addr":"172.21.15.115:6836","nonce":3530976555}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-11-30T17:23:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.828+0000 7fa8c94d7700 1 -- 172.21.15.49:0/2259468028 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa8b005f300 msgr2=0x7fa8b00617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:23:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.828+0000 7fa8c94d7700 1 --2- 172.21.15.49:0/2259468028 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa8b005f300 0x7fa8b00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.828+0000 7fa8c94d7700 1 -- 172.21.15.49:0/2259468028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8c40c51a0 msgr2=0x7fa8c4155e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.828+0000 7fa8c94d7700 1 --2- 172.21.15.49:0/2259468028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8c40c51a0 0x7fa8c4155e10 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7fa8bc00b6c0 tx=0x7fa8bc009780).stop 2023-11-30T17:23:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.828+0000 7fa8c94d7700 1 -- 172.21.15.49:0/2259468028 shutdown_connections 2023-11-30T17:23:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.828+0000 7fa8c94d7700 1 --2- 172.21.15.49:0/2259468028 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa8b005f300 0x7fa8b00617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.828+0000 7fa8c94d7700 1 --2- 172.21.15.49:0/2259468028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8c40c51a0 0x7fa8c4155e10 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.828+0000 7fa8c94d7700 1 --2- 172.21.15.49:0/2259468028 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8c4064950 0x7fa8c41480a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.828+0000 7fa8c94d7700 1 --2- 172.21.15.49:0/2259468028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8c406b8e0 0x7fa8c4155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:17.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.828+0000 7fa8c94d7700 1 -- 172.21.15.49:0/2259468028 >> 172.21.15.49:0/2259468028 conn(0x7fa8c40c3f20 msgr2=0x7fa8c4065f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:17.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.828+0000 7fa8c94d7700 1 -- 172.21.15.49:0/2259468028 shutdown_connections 2023-11-30T17:23:17.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.828+0000 7fa8c94d7700 1 -- 172.21.15.49:0/2259468028 wait complete. 2023-11-30T17:23:17.831 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 39 2023-11-30T17:23:17.842 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:23:17.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.964+0000 7f9a2e97c700 1 Processor -- start 2023-11-30T17:23:17.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.964+0000 7f9a2e97c700 1 -- start start 2023-11-30T17:23:17.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.965+0000 7f9a2e97c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a281544d0 0x7f9a28155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:17.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.965+0000 7f9a2e97c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9a28066f40 0x7f9a28095e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:17.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.965+0000 7f9a2e97c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9a280673c0 0x7f9a28096370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:17.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.965+0000 7f9a2e97c700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a28096860 con 0x7f9a28066f40 2023-11-30T17:23:17.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.965+0000 7f9a2e97c700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a280683d0 con 0x7f9a280673c0 2023-11-30T17:23:17.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.965+0000 7f9a2e97c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a28067850 con 0x7f9a281544d0 2023-11-30T17:23:17.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.965+0000 7f9a277fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9a28066f40 0x7f9a28095e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:17.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.965+0000 7f9a277fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9a28066f40 0x7f9a28095e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36320/0 (socket says 172.21.15.49:36320) 2023-11-30T17:23:17.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.965+0000 7f9a277fe700 1 -- 172.21.15.49:0/278783627 learned_addr learned my addr 172.21.15.49:0/278783627 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:17.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.965+0000 7f9a27fff700 1 --2- 172.21.15.49:0/278783627 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a281544d0 0x7f9a28155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:17.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.965+0000 7f9a2cf19700 1 --2- 172.21.15.49:0/278783627 >> v2:172.21.15.115:3300/0 conn(0x7f9a280673c0 0x7f9a28096370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:17.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.965+0000 7f9a277fe700 1 -- 172.21.15.49:0/278783627 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a281544d0 msgr2=0x7f9a28155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:17.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.965+0000 7f9a277fe700 1 --2- 172.21.15.49:0/278783627 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a281544d0 0x7f9a28155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:17.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.965+0000 7f9a277fe700 1 -- 172.21.15.49:0/278783627 >> v2:172.21.15.115:3300/0 conn(0x7f9a280673c0 msgr2=0x7f9a28096370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:17.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.965+0000 7f9a277fe700 1 --2- 172.21.15.49:0/278783627 >> v2:172.21.15.115:3300/0 conn(0x7f9a280673c0 0x7f9a28096370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:17.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.965+0000 7f9a277fe700 1 -- 172.21.15.49:0/278783627 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a28067b30 con 0x7f9a28066f40 2023-11-30T17:23:17.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.965+0000 7f9a277fe700 1 --2- 172.21.15.49:0/278783627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a28066f40 0x7f9a28095e80 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f9a280c3680 tx=0x7f9a180090f0).ready entity=mon.0 client_cookie=6a028e3a7386c165 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:17.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.966+0000 7f9a26ffd700 1 -- 172.21.15.49:0/278783627 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1800f510 con 0x7f9a28066f40 2023-11-30T17:23:17.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.966+0000 7f9a26ffd700 1 -- 172.21.15.49:0/278783627 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1800f670 con 0x7f9a28066f40 2023-11-30T17:23:17.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.966+0000 7f9a26ffd700 1 -- 172.21.15.49:0/278783627 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1800f9f0 con 0x7f9a28066f40 2023-11-30T17:23:17.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.966+0000 7f9a2e97c700 1 -- 172.21.15.49:0/278783627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a28066f40 msgr2=0x7f9a28095e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:17.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.966+0000 7f9a2e97c700 1 --2- 172.21.15.49:0/278783627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a28066f40 0x7f9a28095e80 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f9a280c3680 tx=0x7f9a180090f0).stop 2023-11-30T17:23:17.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.966+0000 7f9a2e97c700 1 -- 172.21.15.49:0/278783627 shutdown_connections 2023-11-30T17:23:17.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.966+0000 7f9a2e97c700 1 --2- 172.21.15.49:0/278783627 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a281544d0 0x7f9a28155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:17.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.966+0000 7f9a2e97c700 1 --2- 172.21.15.49:0/278783627 >> v2:172.21.15.115:3300/0 conn(0x7f9a280673c0 0x7f9a28096370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:17.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.966+0000 7f9a2e97c700 1 --2- 172.21.15.49:0/278783627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a28066f40 0x7f9a28095e80 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:17.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.966+0000 7f9a2e97c700 1 -- 172.21.15.49:0/278783627 >> 172.21.15.49:0/278783627 conn(0x7f9a280631d0 msgr2=0x7f9a280c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:17.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.966+0000 7f9a2e97c700 1 -- 172.21.15.49:0/278783627 shutdown_connections 2023-11-30T17:23:17.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.966+0000 7f9a2e97c700 1 -- 172.21.15.49:0/278783627 wait complete. 2023-11-30T17:23:17.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.967+0000 7f9a2e97c700 1 Processor -- start 2023-11-30T17:23:17.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.968+0000 7f9a2e97c700 1 -- start start 2023-11-30T17:23:17.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.968+0000 7f9a2e97c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a28066f40 0x7f9a280a5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:17.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.968+0000 7f9a2e97c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a281544d0 0x7f9a280bfb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:17.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.968+0000 7f9a2e97c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a280ac0c0 0x7f9a280a7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:17.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.968+0000 7f9a2e97c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a280bf6b0 con 0x7f9a280ac0c0 2023-11-30T17:23:17.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.968+0000 7f9a2e97c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a280ac520 con 0x7f9a28066f40 2023-11-30T17:23:17.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.968+0000 7f9a2e97c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a280a6480 con 0x7f9a281544d0 2023-11-30T17:23:17.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.969+0000 7f9a2cf19700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a280ac0c0 0x7f9a280a7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:17.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.969+0000 7f9a2cf19700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a280ac0c0 0x7f9a280a7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36324/0 (socket says 172.21.15.49:36324) 2023-11-30T17:23:17.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.969+0000 7f9a2cf19700 1 -- 172.21.15.49:0/3797616603 learned_addr learned my addr 172.21.15.49:0/3797616603 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:17.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.969+0000 7f9a277fe700 1 --2- 172.21.15.49:0/3797616603 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a281544d0 0x7f9a280bfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:17.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.969+0000 7f9a27fff700 1 --2- 172.21.15.49:0/3797616603 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a28066f40 0x7f9a280a5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:17.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.969+0000 7f9a277fe700 1 -- 172.21.15.49:0/3797616603 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a28066f40 msgr2=0x7f9a280a5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:17.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.969+0000 7f9a277fe700 1 --2- 172.21.15.49:0/3797616603 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a28066f40 0x7f9a280a5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:17.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.969+0000 7f9a277fe700 1 -- 172.21.15.49:0/3797616603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a280ac0c0 msgr2=0x7f9a280a7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:17.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.969+0000 7f9a277fe700 1 --2- 172.21.15.49:0/3797616603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a280ac0c0 0x7f9a280a7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:17.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.969+0000 7f9a277fe700 1 -- 172.21.15.49:0/3797616603 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a18009370 con 0x7f9a281544d0 2023-11-30T17:23:17.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.969+0000 7f9a2cf19700 1 --2- 172.21.15.49:0/3797616603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a280ac0c0 0x7f9a280a7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:23:17.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.969+0000 7f9a27fff700 1 --2- 172.21.15.49:0/3797616603 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a28066f40 0x7f9a280a5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:23:17.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.969+0000 7f9a277fe700 1 --2- 172.21.15.49:0/3797616603 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a281544d0 0x7f9a280bfb00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f9a18014000 tx=0x7f9a18017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:17.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.969+0000 7f9a0ffff700 1 -- 172.21.15.49:0/3797616603 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a18011b40 con 0x7f9a281544d0 2023-11-30T17:23:17.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.969+0000 7f9a0ffff700 1 -- 172.21.15.49:0/3797616603 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a18011cc0 con 0x7f9a281544d0 2023-11-30T17:23:17.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.969+0000 7f9a2e97c700 1 -- 172.21.15.49:0/3797616603 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a280a6760 con 0x7f9a281544d0 2023-11-30T17:23:17.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.969+0000 7f9a0ffff700 1 -- 172.21.15.49:0/3797616603 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1801c670 con 0x7f9a281544d0 2023-11-30T17:23:17.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.969+0000 7f9a2e97c700 1 -- 172.21.15.49:0/3797616603 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a280a6d20 con 0x7f9a281544d0 2023-11-30T17:23:17.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.971+0000 7f9a2e97c700 1 -- 172.21.15.49:0/3797616603 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a28156b00 con 0x7f9a281544d0 2023-11-30T17:23:17.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.971+0000 7f9a0ffff700 1 -- 172.21.15.49:0/3797616603 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 37) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f9a1801ca20 con 0x7f9a281544d0 2023-11-30T17:23:17.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.971+0000 7f9a0ffff700 1 --2- 172.21.15.49:0/3797616603 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a1405f300 0x7f9a140617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:17.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.971+0000 7f9a0ffff700 1 -- 172.21.15.49:0/3797616603 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6407+0+0 (secure 0 0 0) 0x7f9a1807bb00 con 0x7f9a281544d0 2023-11-30T17:23:17.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.971+0000 7f9a27fff700 1 -- 172.21.15.49:0/3797616603 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a1405f300 msgr2=0x7f9a140617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:23:17.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.971+0000 7f9a27fff700 1 --2- 172.21.15.49:0/3797616603 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a1405f300 0x7f9a140617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:23:17.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:17.975+0000 7f9a0ffff700 1 -- 172.21.15.49:0/3797616603 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9a28156b00 con 0x7f9a281544d0 2023-11-30T17:23:18.002 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:18.000+0000 7fdefd014680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T17:23:18.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.148+0000 7f9a2e97c700 1 -- 172.21.15.49:0/3797616603 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a28156b00 con 0x7f9a281544d0 2023-11-30T17:23:18.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.149+0000 7f9a0ffff700 1 -- 172.21.15.49:0/3797616603 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+17346 (secure 0 0 0) 0x7f9a28156b00 con 0x7f9a281544d0 2023-11-30T17:23:18.150 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:18.151 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":99,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:23:13.171019+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:22:55.465005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-11-30T17:22:55.883417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/2546935477":"2023-12-01T17:23:13.170987+0000","172.21.15.115:0/257548442":"2023-12-01T17:23:13.170987+0000","172.21.15.115:0/2514101390":"2023-12-01T17:23:13.170987+0000","172.21.15.115:6833/89956":"2023-12-01T17:23:13.170987+0000","172.21.15.115:6832/89956":"2023-12-01T17:23:13.170987+0000","172.21.15.115:0/1043747680":"2023-12-01T17:23:13.170987+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:23:18.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.151+0000 7f9a2e97c700 1 -- 172.21.15.49:0/3797616603 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a1405f300 msgr2=0x7f9a140617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:23:18.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.151+0000 7f9a2e97c700 1 --2- 172.21.15.49:0/3797616603 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a1405f300 0x7f9a140617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:18.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.151+0000 7f9a2e97c700 1 -- 172.21.15.49:0/3797616603 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a281544d0 msgr2=0x7f9a280bfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:18.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.151+0000 7f9a2e97c700 1 --2- 172.21.15.49:0/3797616603 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a281544d0 0x7f9a280bfb00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f9a18014000 tx=0x7f9a18017000).stop 2023-11-30T17:23:18.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.151+0000 7f9a2e97c700 1 -- 172.21.15.49:0/3797616603 shutdown_connections 2023-11-30T17:23:18.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.151+0000 7f9a2e97c700 1 --2- 172.21.15.49:0/3797616603 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a1405f300 0x7f9a140617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:18.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.151+0000 7f9a2e97c700 1 --2- 172.21.15.49:0/3797616603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a280ac0c0 0x7f9a280a7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:18.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.151+0000 7f9a2e97c700 1 --2- 172.21.15.49:0/3797616603 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a28066f40 0x7f9a280a5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:18.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.151+0000 7f9a2e97c700 1 --2- 172.21.15.49:0/3797616603 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a281544d0 0x7f9a280bfb00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:18.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.151+0000 7f9a2e97c700 1 -- 172.21.15.49:0/3797616603 >> 172.21.15.49:0/3797616603 conn(0x7f9a280631d0 msgr2=0x7f9a280c8640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:18.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.151+0000 7f9a2e97c700 1 -- 172.21.15.49:0/3797616603 shutdown_connections 2023-11-30T17:23:18.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.151+0000 7f9a2e97c700 1 -- 172.21.15.49:0/3797616603 wait complete. 2023-11-30T17:23:18.165 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-30T17:23:18.165 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:23:18.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.284+0000 7f25d9d80700 1 Processor -- start 2023-11-30T17:23:18.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.284+0000 7f25d9d80700 1 -- start start 2023-11-30T17:23:18.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.285+0000 7f25d9d80700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f25d414e980 0x7f25d4152220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:18.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.285+0000 7f25d9d80700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25d414ed60 0x7f25d40c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:18.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.285+0000 7f25d9d80700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25d406bbc0 con 0x7f25d4155470 2023-11-30T17:23:18.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.285+0000 7f25d9d80700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d40c1df0 con 0x7f25d414e980 2023-11-30T17:23:18.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.285+0000 7f25d9d80700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d4154fe0 con 0x7f25d414ed60 2023-11-30T17:23:18.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.285+0000 7f25d957f700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f25d4155470 0x7f25d40c61c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49192/0 (socket says 172.21.15.49:49192) 2023-11-30T17:23:18.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.285+0000 7f25d957f700 1 -- 172.21.15.49:0/1866378021 learned_addr learned my addr 172.21.15.49:0/1866378021 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:18.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.285+0000 7f25d3fff700 1 --2- 172.21.15.49:0/1866378021 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25d414ed60 0x7f25d40c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:18.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.285+0000 7f25d8d7e700 1 --2- 172.21.15.49:0/1866378021 >> v2:172.21.15.115:3300/0 conn(0x7f25d414e980 0x7f25d4152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:18.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.286+0000 7f25d37fe700 1 -- 172.21.15.49:0/1866378021 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2813263494 0 0) 0x7f25d406bbc0 con 0x7f25d4155470 2023-11-30T17:23:18.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.286+0000 7f25d37fe700 1 -- 172.21.15.49:0/1866378021 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25c40033f0 con 0x7f25d4155470 2023-11-30T17:23:18.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.286+0000 7f25d3fff700 1 -- 172.21.15.49:0/1866378021 >> v2:172.21.15.115:3300/0 conn(0x7f25d414e980 msgr2=0x7f25d4152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:18.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.286+0000 7f25d3fff700 1 --2- 172.21.15.49:0/1866378021 >> v2:172.21.15.115:3300/0 conn(0x7f25d414e980 0x7f25d4152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:18.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.286+0000 7f25d3fff700 1 -- 172.21.15.49:0/1866378021 >> v1:172.21.15.49:6789/0 conn(0x7f25d4155470 legacy=0x7f25d40c61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:18.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.286+0000 7f25d3fff700 1 -- 172.21.15.49:0/1866378021 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d406b640 con 0x7f25d414ed60 2023-11-30T17:23:18.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.286+0000 7f25d8d7e700 1 --2- 172.21.15.49:0/1866378021 >> v2:172.21.15.115:3300/0 conn(0x7f25d414e980 0x7f25d4152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:23:18.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.286+0000 7f25d3fff700 1 --2- 172.21.15.49:0/1866378021 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25d414ed60 0x7f25d40c45f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f25c0009760 tx=0x7f25c0009060).ready entity=mon.2 client_cookie=dc02c22c822c5887 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:18.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.286+0000 7f25d37fe700 1 -- 172.21.15.49:0/1866378021 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c00090d0 con 0x7f25d414ed60 2023-11-30T17:23:18.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.286+0000 7f25d37fe700 1 -- 172.21.15.49:0/1866378021 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c000d4a0 con 0x7f25d414ed60 2023-11-30T17:23:18.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.286+0000 7f25d37fe700 1 -- 172.21.15.49:0/1866378021 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c000d820 con 0x7f25d414ed60 2023-11-30T17:23:18.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.287+0000 7f25d9d80700 1 -- 172.21.15.49:0/1866378021 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25d414ed60 msgr2=0x7f25d40c45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:18.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.287+0000 7f25d9d80700 1 --2- 172.21.15.49:0/1866378021 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25d414ed60 0x7f25d40c45f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f25c0009760 tx=0x7f25c0009060).stop 2023-11-30T17:23:18.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.287+0000 7f25d9d80700 1 -- 172.21.15.49:0/1866378021 shutdown_connections 2023-11-30T17:23:18.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.287+0000 7f25d9d80700 1 --2- 172.21.15.49:0/1866378021 >> v2:172.21.15.115:3300/0 conn(0x7f25d414e980 0x7f25d4152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:18.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.287+0000 7f25d9d80700 1 --2- 172.21.15.49:0/1866378021 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25d414ed60 0x7f25d40c45f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:18.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.287+0000 7f25d9d80700 1 -- 172.21.15.49:0/1866378021 >> 172.21.15.49:0/1866378021 conn(0x7f25d40c7eb0 msgr2=0x7f25d40c3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:18.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.287+0000 7f25d9d80700 1 -- 172.21.15.49:0/1866378021 shutdown_connections 2023-11-30T17:23:18.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.287+0000 7f25d9d80700 1 -- 172.21.15.49:0/1866378021 wait complete. 2023-11-30T17:23:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.288+0000 7f25d9d80700 1 Processor -- start 2023-11-30T17:23:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.288+0000 7f25d9d80700 1 -- start start 2023-11-30T17:23:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.289+0000 7f25d9d80700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25d414e980 0x7f25d4132bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.289+0000 7f25d9d80700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25d414ed60 0x7f25d40c06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.289+0000 7f25d9d80700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25d4155470 0x7f25d40c0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.289+0000 7f25d9d80700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d40aa930 con 0x7f25d4155470 2023-11-30T17:23:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.289+0000 7f25d9d80700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d40aab80 con 0x7f25d414e980 2023-11-30T17:23:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.289+0000 7f25d9d80700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d40aae60 con 0x7f25d414ed60 2023-11-30T17:23:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.289+0000 7f25d957f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25d4155470 0x7f25d40c0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.289+0000 7f25d8d7e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25d414e980 0x7f25d4132bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.289+0000 7f25d8d7e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25d414e980 0x7f25d4132bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:42474/0 (socket says 172.21.15.49:42474) 2023-11-30T17:23:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.289+0000 7f25d8d7e700 1 -- 172.21.15.49:0/2908813726 learned_addr learned my addr 172.21.15.49:0/2908813726 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.289+0000 7f25d3fff700 1 --2- 172.21.15.49:0/2908813726 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25d414ed60 0x7f25d40c06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.289+0000 7f25d957f700 1 -- 172.21.15.49:0/2908813726 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25d414ed60 msgr2=0x7f25d40c06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.289+0000 7f25d957f700 1 --2- 172.21.15.49:0/2908813726 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25d414ed60 0x7f25d40c06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.289+0000 7f25d957f700 1 -- 172.21.15.49:0/2908813726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25d414e980 msgr2=0x7f25d4132bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.289+0000 7f25d957f700 1 --2- 172.21.15.49:0/2908813726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25d414e980 0x7f25d4132bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.289+0000 7f25d957f700 1 -- 172.21.15.49:0/2908813726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c80092a0 con 0x7f25d4155470 2023-11-30T17:23:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.289+0000 7f25d8d7e700 1 --2- 172.21.15.49:0/2908813726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25d414e980 0x7f25d4132bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:23:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.290+0000 7f25d957f700 1 --2- 172.21.15.49:0/2908813726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25d4155470 0x7f25d40c0bd0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f25cc0015b0 tx=0x7f25cc007f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.290+0000 7f25d0ff9700 1 -- 172.21.15.49:0/2908813726 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc005d80 con 0x7f25d4155470 2023-11-30T17:23:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.290+0000 7f25d0ff9700 1 -- 172.21.15.49:0/2908813726 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25cc0070d0 con 0x7f25d4155470 2023-11-30T17:23:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.290+0000 7f25d9d80700 1 -- 172.21.15.49:0/2908813726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c00092a0 con 0x7f25d4155470 2023-11-30T17:23:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.290+0000 7f25d0ff9700 1 -- 172.21.15.49:0/2908813726 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc007490 con 0x7f25d4155470 2023-11-30T17:23:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.290+0000 7f25d9d80700 1 -- 172.21.15.49:0/2908813726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d40ab420 con 0x7f25d4155470 2023-11-30T17:23:18.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.291+0000 7f25d9d80700 1 -- 172.21.15.49:0/2908813726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d406c7c0 con 0x7f25d4155470 2023-11-30T17:23:18.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.292+0000 7f25d0ff9700 1 -- 172.21.15.49:0/2908813726 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 37) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f25cc007880 con 0x7f25d4155470 2023-11-30T17:23:18.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.292+0000 7f25d0ff9700 1 --2- 172.21.15.49:0/2908813726 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f25b805f300 0x7f25b80617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:18.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.292+0000 7f25d0ff9700 1 -- 172.21.15.49:0/2908813726 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6407+0+0 (secure 0 0 0) 0x7f25cc079ed0 con 0x7f25d4155470 2023-11-30T17:23:18.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.292+0000 7f25d8d7e700 1 -- 172.21.15.49:0/2908813726 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f25b805f300 msgr2=0x7f25b80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:23:18.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.292+0000 7f25d8d7e700 1 --2- 172.21.15.49:0/2908813726 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f25b805f300 0x7f25b80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:23:18.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.296+0000 7f25d0ff9700 1 -- 172.21.15.49:0/2908813726 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f25cc04af00 con 0x7f25d4155470 2023-11-30T17:23:18.470 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:18.468+0000 7f5ae1afb680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T17:23:18.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.493+0000 7f25d8d7e700 1 -- 172.21.15.49:0/2908813726 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f25b805f300 msgr2=0x7f25b80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:23:18.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.493+0000 7f25d8d7e700 1 --2- 172.21.15.49:0/2908813726 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f25b805f300 0x7f25b80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:23:18.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.512+0000 7f25d9d80700 1 -- 172.21.15.49:0/2908813726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25d406b8e0 con 0x7f25d4155470 2023-11-30T17:23:18.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.513+0000 7f25d0ff9700 1 -- 172.21.15.49:0/2908813726 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f25cc04e520 con 0x7f25d4155470 2023-11-30T17:23:18.514 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:18.514 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5906,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3382372491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3382372491},{"type":"v1","addr":"172.21.15.115:6837","nonce":3382372491}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6675,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/962684395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":962684395},{"type":"v1","addr":"172.21.15.49:6834","nonce":962684395}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6678,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1931198509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1931198509},{"type":"v1","addr":"172.21.15.49:6835","nonce":1931198509}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:22:56.913429+0000","modified":"2023-11-30T17:22:59.924885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6687},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6687":{"gid":6687,"name":"d","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/3530976555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3530976555},{"type":"v1","addr":"172.21.15.115:6836","nonce":3530976555}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-11-30T17:23:18.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.514+0000 7f25d9d80700 1 -- 172.21.15.49:0/2908813726 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f25b805f300 msgr2=0x7f25b80617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:23:18.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.514+0000 7f25d9d80700 1 --2- 172.21.15.49:0/2908813726 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f25b805f300 0x7f25b80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:18.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.514+0000 7f25d9d80700 1 -- 172.21.15.49:0/2908813726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25d4155470 msgr2=0x7f25d40c0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:18.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.514+0000 7f25d9d80700 1 --2- 172.21.15.49:0/2908813726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25d4155470 0x7f25d40c0bd0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f25cc0015b0 tx=0x7f25cc007f20).stop 2023-11-30T17:23:18.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.514+0000 7f25d9d80700 1 -- 172.21.15.49:0/2908813726 shutdown_connections 2023-11-30T17:23:18.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.514+0000 7f25d9d80700 1 --2- 172.21.15.49:0/2908813726 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f25b805f300 0x7f25b80617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:18.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.514+0000 7f25d9d80700 1 --2- 172.21.15.49:0/2908813726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25d4155470 0x7f25d40c0bd0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:18.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.514+0000 7f25d9d80700 1 --2- 172.21.15.49:0/2908813726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25d414e980 0x7f25d4132bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:18.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.514+0000 7f25d9d80700 1 --2- 172.21.15.49:0/2908813726 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25d414ed60 0x7f25d40c06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:18.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.514+0000 7f25d9d80700 1 -- 172.21.15.49:0/2908813726 >> 172.21.15.49:0/2908813726 conn(0x7f25d40c7eb0 msgr2=0x7f25d40bcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:18.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.515+0000 7f25d9d80700 1 -- 172.21.15.49:0/2908813726 shutdown_connections 2023-11-30T17:23:18.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.515+0000 7f25d9d80700 1 -- 172.21.15.49:0/2908813726 wait complete. 2023-11-30T17:23:18.517 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 39 2023-11-30T17:23:18.529 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:23:18.539 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:18.537+0000 7f5ae1afb680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T17:23:18.614 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:18.612+0000 7f5ae1afb680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T17:23:18.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.651+0000 7f24fd34b700 1 Processor -- start 2023-11-30T17:23:18.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.651+0000 7f24fd34b700 1 -- start start 2023-11-30T17:23:18.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.652+0000 7f24fd34b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f81548c0 0x7f24f806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:18.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.652+0000 7f24fd34b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f24f80c6e30 0x7f24f80c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:18.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.652+0000 7f24fd34b700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24f80c69a0 con 0x7f24f81544e0 2023-11-30T17:23:18.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.652+0000 7f24fd34b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24f80c13a0 con 0x7f24f80c6e30 2023-11-30T17:23:18.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.652+0000 7f24fd34b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f80c1680 con 0x7f24f81548c0 2023-11-30T17:23:18.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.652+0000 7f24f6ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f24f81544e0 0x7f24f80c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49198/0 (socket says 172.21.15.49:49198) 2023-11-30T17:23:18.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.652+0000 7f24f6ffd700 1 -- 172.21.15.49:0/598091458 learned_addr learned my addr 172.21.15.49:0/598091458 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:18.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.652+0000 7f24f67fc700 1 --2- 172.21.15.49:0/598091458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f81548c0 0x7f24f806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:18.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.652+0000 7f24f77fe700 1 --2- 172.21.15.49:0/598091458 >> v2:172.21.15.115:3300/0 conn(0x7f24f80c6e30 0x7f24f80c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:18.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.652+0000 7f24f5ffb700 1 -- 172.21.15.49:0/598091458 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1653833438 0 0) 0x7f24f80c69a0 con 0x7f24f81544e0 2023-11-30T17:23:18.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.652+0000 7f24f5ffb700 1 -- 172.21.15.49:0/598091458 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24e40033f0 con 0x7f24f81544e0 2023-11-30T17:23:18.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.652+0000 7f24f67fc700 1 -- 172.21.15.49:0/598091458 >> v2:172.21.15.115:3300/0 conn(0x7f24f80c6e30 msgr2=0x7f24f80c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:18.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.652+0000 7f24f67fc700 1 --2- 172.21.15.49:0/598091458 >> v2:172.21.15.115:3300/0 conn(0x7f24f80c6e30 0x7f24f80c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:18.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.652+0000 7f24f67fc700 1 -- 172.21.15.49:0/598091458 >> v1:172.21.15.49:6789/0 conn(0x7f24f81544e0 legacy=0x7f24f80c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:18.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.652+0000 7f24f67fc700 1 -- 172.21.15.49:0/598091458 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f80c6630 con 0x7f24f81548c0 2023-11-30T17:23:18.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.653+0000 7f24f77fe700 1 --2- 172.21.15.49:0/598091458 >> v2:172.21.15.115:3300/0 conn(0x7f24f80c6e30 0x7f24f80c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:23:18.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.653+0000 7f24f67fc700 1 --2- 172.21.15.49:0/598091458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f81548c0 0x7f24f806a610 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f24e8009760 tx=0x7f24e8009060).ready entity=mon.2 client_cookie=5fbf52209456095a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:18.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.653+0000 7f24f5ffb700 1 -- 172.21.15.49:0/598091458 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e800d4a0 con 0x7f24f81548c0 2023-11-30T17:23:18.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.653+0000 7f24f5ffb700 1 -- 172.21.15.49:0/598091458 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e800d600 con 0x7f24f81548c0 2023-11-30T17:23:18.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.653+0000 7f24f5ffb700 1 -- 172.21.15.49:0/598091458 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e800d980 con 0x7f24f81548c0 2023-11-30T17:23:18.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.653+0000 7f24fd34b700 1 -- 172.21.15.49:0/598091458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f81548c0 msgr2=0x7f24f806a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:18.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.653+0000 7f24fd34b700 1 --2- 172.21.15.49:0/598091458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f81548c0 0x7f24f806a610 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f24e8009760 tx=0x7f24e8009060).stop 2023-11-30T17:23:18.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.653+0000 7f24fd34b700 1 -- 172.21.15.49:0/598091458 shutdown_connections 2023-11-30T17:23:18.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.653+0000 7f24fd34b700 1 --2- 172.21.15.49:0/598091458 >> v2:172.21.15.115:3300/0 conn(0x7f24f80c6e30 0x7f24f80c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:18.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.653+0000 7f24fd34b700 1 --2- 172.21.15.49:0/598091458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f81548c0 0x7f24f806a610 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:18.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.653+0000 7f24fd34b700 1 -- 172.21.15.49:0/598091458 >> 172.21.15.49:0/598091458 conn(0x7f24f8085020 msgr2=0x7f24f8094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:18.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.653+0000 7f24fd34b700 1 -- 172.21.15.49:0/598091458 shutdown_connections 2023-11-30T17:23:18.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.653+0000 7f24fd34b700 1 -- 172.21.15.49:0/598091458 wait complete. 2023-11-30T17:23:18.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.655+0000 7f24fd34b700 1 Processor -- start 2023-11-30T17:23:18.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.655+0000 7f24fd34b700 1 -- start start 2023-11-30T17:23:18.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.655+0000 7f24fd34b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f80c6e30 0x7f24f80c4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:18.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.655+0000 7f24fd34b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24f81544e0 0x7f24f8094940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:18.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.655+0000 7f24fd34b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24f81548c0 0x7f24f80989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:18.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.655+0000 7f24fd34b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f80c4be0 con 0x7f24f81548c0 2023-11-30T17:23:18.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.655+0000 7f24fd34b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f80c2de0 con 0x7f24f81544e0 2023-11-30T17:23:18.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.655+0000 7f24fd34b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f80c4930 con 0x7f24f80c6e30 2023-11-30T17:23:18.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.656+0000 7f24f77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24f81548c0 0x7f24f80989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:18.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.656+0000 7f24f77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24f81548c0 0x7f24f80989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36336/0 (socket says 172.21.15.49:36336) 2023-11-30T17:23:18.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.656+0000 7f24f77fe700 1 -- 172.21.15.49:0/289137743 learned_addr learned my addr 172.21.15.49:0/289137743 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:18.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.656+0000 7f24f67fc700 1 --2- 172.21.15.49:0/289137743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24f81544e0 0x7f24f8094940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:18.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.656+0000 7f24f6ffd700 1 --2- 172.21.15.49:0/289137743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f80c6e30 0x7f24f80c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:18.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.656+0000 7f24f77fe700 1 -- 172.21.15.49:0/289137743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f80c6e30 msgr2=0x7f24f80c4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:18.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.656+0000 7f24f77fe700 1 --2- 172.21.15.49:0/289137743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f80c6e30 0x7f24f80c4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:18.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.656+0000 7f24f77fe700 1 -- 172.21.15.49:0/289137743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24f81544e0 msgr2=0x7f24f8094940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:18.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.656+0000 7f24f77fe700 1 --2- 172.21.15.49:0/289137743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24f81544e0 0x7f24f8094940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:18.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.656+0000 7f24f77fe700 1 -- 172.21.15.49:0/289137743 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f0009a20 con 0x7f24f81548c0 2023-11-30T17:23:18.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.656+0000 7f24f67fc700 1 --2- 172.21.15.49:0/289137743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24f81544e0 0x7f24f8094940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:23:18.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.656+0000 7f24f77fe700 1 --2- 172.21.15.49:0/289137743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24f81548c0 0x7f24f80989d0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f24f0009f20 tx=0x7f24f000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:18.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.656+0000 7f24eeffd700 1 -- 172.21.15.49:0/289137743 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f000cb70 con 0x7f24f81548c0 2023-11-30T17:23:18.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.656+0000 7f24eeffd700 1 -- 172.21.15.49:0/289137743 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f000f040 con 0x7f24f81548c0 2023-11-30T17:23:18.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.656+0000 7f24eeffd700 1 -- 172.21.15.49:0/289137743 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f0013400 con 0x7f24f81548c0 2023-11-30T17:23:18.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.656+0000 7f24fd34b700 1 -- 172.21.15.49:0/289137743 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e80092a0 con 0x7f24f81548c0 2023-11-30T17:23:18.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.656+0000 7f24fd34b700 1 -- 172.21.15.49:0/289137743 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f80c2790 con 0x7f24f81548c0 2023-11-30T17:23:18.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.657+0000 7f24fd34b700 1 -- 172.21.15.49:0/289137743 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f806c860 con 0x7f24f81548c0 2023-11-30T17:23:18.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.658+0000 7f24eeffd700 1 -- 172.21.15.49:0/289137743 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 37) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f24f00137f0 con 0x7f24f81548c0 2023-11-30T17:23:18.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.658+0000 7f24eeffd700 1 --2- 172.21.15.49:0/289137743 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f24d805f300 0x7f24d80617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:18.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.658+0000 7f24f6ffd700 1 -- 172.21.15.49:0/289137743 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f24d805f300 msgr2=0x7f24d80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:23:18.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.658+0000 7f24eeffd700 1 -- 172.21.15.49:0/289137743 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6407+0+0 (secure 0 0 0) 0x7f24f007aef0 con 0x7f24f81548c0 2023-11-30T17:23:18.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.658+0000 7f24f6ffd700 1 --2- 172.21.15.49:0/289137743 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f24d805f300 0x7f24d80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:23:18.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.662+0000 7f24eeffd700 1 -- 172.21.15.49:0/289137743 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f24f004bd90 con 0x7f24f81548c0 2023-11-30T17:23:18.701 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:18.700+0000 7fdefd014680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T17:23:18.764 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:18.762+0000 7f5ae1afb680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T17:23:18.774 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:18.772+0000 7fdefd014680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T17:23:18.835 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:18.833+0000 7f5ae1afb680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T17:23:18.853 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:18.852+0000 7fdefd014680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T17:23:18.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.859+0000 7f24f6ffd700 1 -- 172.21.15.49:0/289137743 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f24d805f300 msgr2=0x7f24d80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:23:18.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.859+0000 7f24f6ffd700 1 --2- 172.21.15.49:0/289137743 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f24d805f300 0x7f24d80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:23:18.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.882+0000 7f24fd34b700 1 -- 172.21.15.49:0/289137743 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24f80c5890 con 0x7f24f81548c0 2023-11-30T17:23:18.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.882+0000 7f24eeffd700 1 -- 172.21.15.49:0/289137743 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f24f004f3b0 con 0x7f24f81548c0 2023-11-30T17:23:18.884 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:18.884 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5906,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3382372491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3382372491},{"type":"v1","addr":"172.21.15.115:6837","nonce":3382372491}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6675,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/962684395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":962684395},{"type":"v1","addr":"172.21.15.49:6834","nonce":962684395}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6678,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1931198509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1931198509},{"type":"v1","addr":"172.21.15.49:6835","nonce":1931198509}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:22:56.913429+0000","modified":"2023-11-30T17:22:59.924885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6687},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6687":{"gid":6687,"name":"d","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/3530976555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3530976555},{"type":"v1","addr":"172.21.15.115:6836","nonce":3530976555}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-11-30T17:23:18.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.884+0000 7f24fd34b700 1 -- 172.21.15.49:0/289137743 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f24d805f300 msgr2=0x7f24d80617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:23:18.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.884+0000 7f24fd34b700 1 --2- 172.21.15.49:0/289137743 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f24d805f300 0x7f24d80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:18.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.884+0000 7f24fd34b700 1 -- 172.21.15.49:0/289137743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24f81548c0 msgr2=0x7f24f80989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:18.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.884+0000 7f24fd34b700 1 --2- 172.21.15.49:0/289137743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24f81548c0 0x7f24f80989d0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f24f0009f20 tx=0x7f24f000b040).stop 2023-11-30T17:23:18.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.884+0000 7f24fd34b700 1 -- 172.21.15.49:0/289137743 shutdown_connections 2023-11-30T17:23:18.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.884+0000 7f24fd34b700 1 --2- 172.21.15.49:0/289137743 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f24d805f300 0x7f24d80617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:18.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.884+0000 7f24fd34b700 1 --2- 172.21.15.49:0/289137743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24f81548c0 0x7f24f80989d0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:18.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.884+0000 7f24fd34b700 1 --2- 172.21.15.49:0/289137743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f80c6e30 0x7f24f80c4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:18.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.884+0000 7f24fd34b700 1 --2- 172.21.15.49:0/289137743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24f81544e0 0x7f24f8094940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:18.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.884+0000 7f24fd34b700 1 -- 172.21.15.49:0/289137743 >> 172.21.15.49:0/289137743 conn(0x7f24f8085020 msgr2=0x7f24f8063fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:18.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.884+0000 7f24fd34b700 1 -- 172.21.15.49:0/289137743 shutdown_connections 2023-11-30T17:23:18.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:18.884+0000 7f24fd34b700 1 -- 172.21.15.49:0/289137743 wait complete. 2023-11-30T17:23:18.887 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 39 2023-11-30T17:23:18.898 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:23:18.952 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:18.950+0000 7f5ae1afb680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T17:23:19.013 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:19.011+0000 7fdefd014680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T17:23:19.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.016+0000 7f0c46056700 1 Processor -- start 2023-11-30T17:23:19.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.016+0000 7f0c46056700 1 -- start start 2023-11-30T17:23:19.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.017+0000 7f0c46056700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0c400aceb0 0x7f0c400c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:19.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.017+0000 7f0c46056700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0c400c7740 0x7f0c400c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:19.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.017+0000 7f0c46056700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c400c37e0 con 0x7f0c40155a70 2023-11-30T17:23:19.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.017+0000 7f0c46056700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c400ad290 con 0x7f0c400aceb0 2023-11-30T17:23:19.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.017+0000 7f0c46056700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c40154d40 con 0x7f0c400c7740 2023-11-30T17:23:19.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.017+0000 7f0c3f7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0c400aceb0 0x7f0c400c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:19.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.017+0000 7f0c3ffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0c400c7740 0x7f0c400c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:19.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.017+0000 7f0c3effd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f0c40155a70 0x7f0c400c2be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:35076/0 (socket says 172.21.15.49:35076) 2023-11-30T17:23:19.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.017+0000 7f0c3f7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0c400aceb0 0x7f0c400c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36342/0 (socket says 172.21.15.49:36342) 2023-11-30T17:23:19.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.017+0000 7f0c3effd700 1 -- 172.21.15.49:0/1349542979 learned_addr learned my addr 172.21.15.49:0/1349542979 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:19.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.017+0000 7f0c3e7fc700 1 -- 172.21.15.49:0/1349542979 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1805695459 0 0) 0x7f0c400c37e0 con 0x7f0c40155a70 2023-11-30T17:23:19.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.017+0000 7f0c3e7fc700 1 -- 172.21.15.49:0/1349542979 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c280033f0 con 0x7f0c40155a70 2023-11-30T17:23:19.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.017+0000 7f0c3f7fe700 1 -- 172.21.15.49:0/1349542979 >> v2:172.21.15.115:3300/0 conn(0x7f0c400c7740 msgr2=0x7f0c400c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:19.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.017+0000 7f0c3f7fe700 1 --2- 172.21.15.49:0/1349542979 >> v2:172.21.15.115:3300/0 conn(0x7f0c400c7740 0x7f0c400c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:19.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.017+0000 7f0c3f7fe700 1 -- 172.21.15.49:0/1349542979 >> v1:172.21.15.115:6789/0 conn(0x7f0c40155a70 legacy=0x7f0c400c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:19.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.017+0000 7f0c3f7fe700 1 -- 172.21.15.49:0/1349542979 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c401555e0 con 0x7f0c400aceb0 2023-11-30T17:23:19.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.017+0000 7f0c3ffff700 1 --2- 172.21.15.49:0/1349542979 >> v2:172.21.15.115:3300/0 conn(0x7f0c400c7740 0x7f0c400c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:23:19.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.017+0000 7f0c3f7fe700 1 --2- 172.21.15.49:0/1349542979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c400aceb0 0x7f0c400c7250 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7f0c400c8220 tx=0x7f0c34009060).ready entity=mon.0 client_cookie=d52bae40f8cf0cf0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:19.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.018+0000 7f0c3e7fc700 1 -- 172.21.15.49:0/1349542979 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3400d4a0 con 0x7f0c400aceb0 2023-11-30T17:23:19.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.018+0000 7f0c3e7fc700 1 -- 172.21.15.49:0/1349542979 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3400d600 con 0x7f0c400aceb0 2023-11-30T17:23:19.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.018+0000 7f0c3e7fc700 1 -- 172.21.15.49:0/1349542979 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3400d980 con 0x7f0c400aceb0 2023-11-30T17:23:19.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.018+0000 7f0c46056700 1 -- 172.21.15.49:0/1349542979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c400aceb0 msgr2=0x7f0c400c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:19.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.018+0000 7f0c46056700 1 --2- 172.21.15.49:0/1349542979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c400aceb0 0x7f0c400c7250 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7f0c400c8220 tx=0x7f0c34009060).stop 2023-11-30T17:23:19.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.018+0000 7f0c46056700 1 -- 172.21.15.49:0/1349542979 shutdown_connections 2023-11-30T17:23:19.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.018+0000 7f0c46056700 1 --2- 172.21.15.49:0/1349542979 >> v2:172.21.15.115:3300/0 conn(0x7f0c400c7740 0x7f0c400c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:19.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.018+0000 7f0c46056700 1 --2- 172.21.15.49:0/1349542979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c400aceb0 0x7f0c400c7250 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:19.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.018+0000 7f0c46056700 1 -- 172.21.15.49:0/1349542979 >> 172.21.15.49:0/1349542979 conn(0x7f0c4006b510 msgr2=0x7f0c4006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:19.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.018+0000 7f0c46056700 1 -- 172.21.15.49:0/1349542979 shutdown_connections 2023-11-30T17:23:19.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.018+0000 7f0c46056700 1 -- 172.21.15.49:0/1349542979 wait complete. 2023-11-30T17:23:19.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.020+0000 7f0c46056700 1 Processor -- start 2023-11-30T17:23:19.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.020+0000 7f0c46056700 1 -- start start 2023-11-30T17:23:19.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.020+0000 7f0c46056700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c400aceb0 0x7f0c40147730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:19.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.020+0000 7f0c46056700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c400c7740 0x7f0c400abb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:19.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.020+0000 7f0c46056700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c40155a70 0x7f0c400ac050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:19.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.020+0000 7f0c46056700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c400ac540 con 0x7f0c400aceb0 2023-11-30T17:23:19.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.020+0000 7f0c46056700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c400c0380 con 0x7f0c40155a70 2023-11-30T17:23:19.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.020+0000 7f0c46056700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c400c05f0 con 0x7f0c400c7740 2023-11-30T17:23:19.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.021+0000 7f0c3f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c400aceb0 0x7f0c40147730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:19.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.021+0000 7f0c3f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c400aceb0 0x7f0c40147730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36356/0 (socket says 172.21.15.49:36356) 2023-11-30T17:23:19.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.021+0000 7f0c3f7fe700 1 -- 172.21.15.49:0/3930710036 learned_addr learned my addr 172.21.15.49:0/3930710036 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:19.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.021+0000 7f0c3ffff700 1 --2- 172.21.15.49:0/3930710036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c40155a70 0x7f0c400ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:19.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.021+0000 7f0c3effd700 1 --2- 172.21.15.49:0/3930710036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c400c7740 0x7f0c400abb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:19.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.021+0000 7f0c3f7fe700 1 -- 172.21.15.49:0/3930710036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c400c7740 msgr2=0x7f0c400abb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:19.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.021+0000 7f0c3f7fe700 1 --2- 172.21.15.49:0/3930710036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c400c7740 0x7f0c400abb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:19.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.021+0000 7f0c3f7fe700 1 -- 172.21.15.49:0/3930710036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c40155a70 msgr2=0x7f0c400ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:19.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.021+0000 7f0c3f7fe700 1 --2- 172.21.15.49:0/3930710036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c40155a70 0x7f0c400ac050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:19.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.021+0000 7f0c3f7fe700 1 -- 172.21.15.49:0/3930710036 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c38009a20 con 0x7f0c400aceb0 2023-11-30T17:23:19.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.021+0000 7f0c3f7fe700 1 --2- 172.21.15.49:0/3930710036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c400aceb0 0x7f0c40147730 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7f0c400641b0 tx=0x7f0c34016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:19.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.021+0000 7f0c277fe700 1 -- 172.21.15.49:0/3930710036 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3400dd30 con 0x7f0c400aceb0 2023-11-30T17:23:19.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.021+0000 7f0c277fe700 1 -- 172.21.15.49:0/3930710036 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3400de90 con 0x7f0c400aceb0 2023-11-30T17:23:19.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.021+0000 7f0c277fe700 1 -- 172.21.15.49:0/3930710036 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3400d9c0 con 0x7f0c400aceb0 2023-11-30T17:23:19.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.021+0000 7f0c46056700 1 -- 172.21.15.49:0/3930710036 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c340092a0 con 0x7f0c400aceb0 2023-11-30T17:23:19.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.021+0000 7f0c46056700 1 -- 172.21.15.49:0/3930710036 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c400c0bb0 con 0x7f0c400aceb0 2023-11-30T17:23:19.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.022+0000 7f0c46056700 1 -- 172.21.15.49:0/3930710036 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c4006c860 con 0x7f0c400aceb0 2023-11-30T17:23:19.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.023+0000 7f0c277fe700 1 -- 172.21.15.49:0/3930710036 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 37) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f0c340263b0 con 0x7f0c400aceb0 2023-11-30T17:23:19.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.023+0000 7f0c277fe700 1 --2- 172.21.15.49:0/3930710036 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0c2c05f300 0x7f0c2c0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:19.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.023+0000 7f0c277fe700 1 -- 172.21.15.49:0/3930710036 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6407+0+0 (secure 0 0 0) 0x7f0c3407b510 con 0x7f0c400aceb0 2023-11-30T17:23:19.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.023+0000 7f0c3effd700 1 -- 172.21.15.49:0/3930710036 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0c2c05f300 msgr2=0x7f0c2c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:23:19.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.023+0000 7f0c3effd700 1 --2- 172.21.15.49:0/3930710036 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0c2c05f300 0x7f0c2c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:23:19.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.031+0000 7f0c277fe700 1 -- 172.21.15.49:0/3930710036 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0c3404c4e0 con 0x7f0c400aceb0 2023-11-30T17:23:19.064 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:19.061+0000 7f5ae1afb680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:23:19.092 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:19.091+0000 7fdefd014680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T17:23:19.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.207+0000 7f0c46056700 1 -- 172.21.15.49:0/3930710036 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c40065db0 con 0x7f0c400aceb0 2023-11-30T17:23:19.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.209+0000 7f0c277fe700 1 -- 172.21.15.49:0/3930710036 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+17346 (secure 0 0 0) 0x7f0c34022090 con 0x7f0c400aceb0 2023-11-30T17:23:19.211 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:19.211 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":99,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:23:13.171019+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:22:55.465005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-11-30T17:22:55.883417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/2546935477":"2023-12-01T17:23:13.170987+0000","172.21.15.115:0/257548442":"2023-12-01T17:23:13.170987+0000","172.21.15.115:0/2514101390":"2023-12-01T17:23:13.170987+0000","172.21.15.115:6833/89956":"2023-12-01T17:23:13.170987+0000","172.21.15.115:6832/89956":"2023-12-01T17:23:13.170987+0000","172.21.15.115:0/1043747680":"2023-12-01T17:23:13.170987+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:23:19.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.211+0000 7f0c46056700 1 -- 172.21.15.49:0/3930710036 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0c2c05f300 msgr2=0x7f0c2c0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:23:19.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.211+0000 7f0c46056700 1 --2- 172.21.15.49:0/3930710036 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0c2c05f300 0x7f0c2c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:19.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.211+0000 7f0c46056700 1 -- 172.21.15.49:0/3930710036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c400aceb0 msgr2=0x7f0c40147730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:19.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.211+0000 7f0c46056700 1 --2- 172.21.15.49:0/3930710036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c400aceb0 0x7f0c40147730 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7f0c400641b0 tx=0x7f0c34016000).stop 2023-11-30T17:23:19.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.211+0000 7f0c46056700 1 -- 172.21.15.49:0/3930710036 shutdown_connections 2023-11-30T17:23:19.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.211+0000 7f0c46056700 1 --2- 172.21.15.49:0/3930710036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c40155a70 0x7f0c400ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:19.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.211+0000 7f0c46056700 1 --2- 172.21.15.49:0/3930710036 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0c2c05f300 0x7f0c2c0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:19.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.211+0000 7f0c46056700 1 --2- 172.21.15.49:0/3930710036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c400aceb0 0x7f0c40147730 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:19.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.211+0000 7f0c46056700 1 --2- 172.21.15.49:0/3930710036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c400c7740 0x7f0c400abb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:19.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.211+0000 7f0c46056700 1 -- 172.21.15.49:0/3930710036 >> 172.21.15.49:0/3930710036 conn(0x7f0c4006b510 msgr2=0x7f0c400bcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:19.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.211+0000 7f0c46056700 1 -- 172.21.15.49:0/3930710036 shutdown_connections 2023-11-30T17:23:19.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.211+0000 7f0c46056700 1 -- 172.21.15.49:0/3930710036 wait complete. 2023-11-30T17:23:19.216 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:19.214+0000 7fdefd014680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T17:23:19.225 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-30T17:23:19.333 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:19.331+0000 7fdefd014680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:23:19.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.344+0000 7f4df4f25700 1 Processor -- start 2023-11-30T17:23:19.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.344+0000 7f4df4f25700 1 -- start start 2023-11-30T17:23:19.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.345+0000 7f4df4f25700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4df0158160 0x7f4df00a8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:19.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.345+0000 7f4df4f25700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df0067770 con 0x7f4df00a8280 2023-11-30T17:23:19.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.345+0000 7f4df4f25700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df00be8d0 con 0x7f4df014e600 2023-11-30T17:23:19.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.345+0000 7f4df4f25700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4df0159180 con 0x7f4df0158160 2023-11-30T17:23:19.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.345+0000 7f4dedd9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4df0158160 0x7f4df00a8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:19.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.345+0000 7f4dee59c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4df00a8280 0x7f4df0155500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49206/0 (socket says 172.21.15.49:49206) 2023-11-30T17:23:19.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.345+0000 7f4dee59c700 1 -- 172.21.15.49:0/3238256775 learned_addr learned my addr 172.21.15.49:0/3238256775 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:19.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.346+0000 7f4dedd9b700 1 -- 172.21.15.49:0/3238256775 >> v1:172.21.15.115:6789/0 conn(0x7f4df014e600 legacy=0x7f4df014ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:19.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.346+0000 7f4dedd9b700 1 -- 172.21.15.49:0/3238256775 >> v1:172.21.15.49:6789/0 conn(0x7f4df00a8280 legacy=0x7f4df0155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:19.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.346+0000 7f4dedd9b700 1 -- 172.21.15.49:0/3238256775 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df0158600 con 0x7f4df0158160 2023-11-30T17:23:19.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.346+0000 7f4dedd9b700 1 --2- 172.21.15.49:0/3238256775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4df0158160 0x7f4df00a8660 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f4de0009760 tx=0x7f4de0009060).ready entity=mon.0 client_cookie=ad8651b5e4a993a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:19.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.346+0000 7f4ded59a700 1 -- 172.21.15.49:0/3238256775 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de000b580 con 0x7f4df0158160 2023-11-30T17:23:19.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.346+0000 7f4ded59a700 1 -- 172.21.15.49:0/3238256775 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de000b6e0 con 0x7f4df0158160 2023-11-30T17:23:19.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.346+0000 7f4ded59a700 1 -- 172.21.15.49:0/3238256775 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de000ba60 con 0x7f4df0158160 2023-11-30T17:23:19.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.347+0000 7f4df4f25700 1 -- 172.21.15.49:0/3238256775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4df0158160 msgr2=0x7f4df00a8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:19.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.347+0000 7f4df4f25700 1 --2- 172.21.15.49:0/3238256775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4df0158160 0x7f4df00a8660 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f4de0009760 tx=0x7f4de0009060).stop 2023-11-30T17:23:19.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.347+0000 7f4df4f25700 1 -- 172.21.15.49:0/3238256775 shutdown_connections 2023-11-30T17:23:19.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.347+0000 7f4df4f25700 1 --2- 172.21.15.49:0/3238256775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4df0158160 0x7f4df00a8660 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:19.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.347+0000 7f4df4f25700 1 -- 172.21.15.49:0/3238256775 >> 172.21.15.49:0/3238256775 conn(0x7f4df0062700 msgr2=0x7f4df0062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:19.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.347+0000 7f4df4f25700 1 -- 172.21.15.49:0/3238256775 shutdown_connections 2023-11-30T17:23:19.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.347+0000 7f4df4f25700 1 -- 172.21.15.49:0/3238256775 wait complete. 2023-11-30T17:23:19.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.348+0000 7f4df4f25700 1 Processor -- start 2023-11-30T17:23:19.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.348+0000 7f4df4f25700 1 -- start start 2023-11-30T17:23:19.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.349+0000 7f4df4f25700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4df00a8280 0x7f4df01685f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:19.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.349+0000 7f4df4f25700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4df014e600 0x7f4df014c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:19.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.349+0000 7f4df4f25700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4df0158160 0x7f4df014c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:19.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.349+0000 7f4df4f25700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df00c2280 con 0x7f4df014e600 2023-11-30T17:23:19.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.349+0000 7f4df4f25700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df01571d0 con 0x7f4df00a8280 2023-11-30T17:23:19.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.349+0000 7f4df4f25700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df0168ae0 con 0x7f4df0158160 2023-11-30T17:23:19.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.349+0000 7f4dedd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4df014e600 0x7f4df014c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:19.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.349+0000 7f4dee59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4df00a8280 0x7f4df01685f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:19.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.349+0000 7f4dedd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4df014e600 0x7f4df014c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36370/0 (socket says 172.21.15.49:36370) 2023-11-30T17:23:19.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.349+0000 7f4dedd9b700 1 -- 172.21.15.49:0/402762356 learned_addr learned my addr 172.21.15.49:0/402762356 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:19.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.349+0000 7f4deed9d700 1 --2- 172.21.15.49:0/402762356 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4df0158160 0x7f4df014c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:19.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.349+0000 7f4dedd9b700 1 -- 172.21.15.49:0/402762356 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4df0158160 msgr2=0x7f4df014c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:19.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.349+0000 7f4dedd9b700 1 --2- 172.21.15.49:0/402762356 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4df0158160 0x7f4df014c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:19.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.349+0000 7f4dedd9b700 1 -- 172.21.15.49:0/402762356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4df00a8280 msgr2=0x7f4df01685f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:19.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.349+0000 7f4dedd9b700 1 --2- 172.21.15.49:0/402762356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4df00a8280 0x7f4df01685f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:19.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.349+0000 7f4dedd9b700 1 -- 172.21.15.49:0/402762356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de00092a0 con 0x7f4df014e600 2023-11-30T17:23:19.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.349+0000 7f4dee59c700 1 --2- 172.21.15.49:0/402762356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4df00a8280 0x7f4df01685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:23:19.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.349+0000 7f4dedd9b700 1 --2- 172.21.15.49:0/402762356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4df014e600 0x7f4df014c3b0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7f4de0009eb0 tx=0x7f4de0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:19.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.350+0000 7f4de67fc700 1 -- 172.21.15.49:0/402762356 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de000ba60 con 0x7f4df014e600 2023-11-30T17:23:19.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.350+0000 7f4de67fc700 1 -- 172.21.15.49:0/402762356 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de0000c90 con 0x7f4df014e600 2023-11-30T17:23:19.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.350+0000 7f4df4f25700 1 -- 172.21.15.49:0/402762356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df0156ba0 con 0x7f4df014e600 2023-11-30T17:23:19.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.350+0000 7f4de67fc700 1 -- 172.21.15.49:0/402762356 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de001c630 con 0x7f4df014e600 2023-11-30T17:23:19.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.350+0000 7f4df4f25700 1 -- 172.21.15.49:0/402762356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df0156df0 con 0x7f4df014e600 2023-11-30T17:23:19.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.351+0000 7f4df4f25700 1 -- 172.21.15.49:0/402762356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df006c860 con 0x7f4df014e600 2023-11-30T17:23:19.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.351+0000 7f4de67fc700 1 -- 172.21.15.49:0/402762356 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 37) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f4de001ca20 con 0x7f4df014e600 2023-11-30T17:23:19.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.351+0000 7f4de67fc700 1 --2- 172.21.15.49:0/402762356 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4dd005f300 0x7f4dd00617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:19.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.351+0000 7f4de67fc700 1 -- 172.21.15.49:0/402762356 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6407+0+0 (secure 0 0 0) 0x7f4de007c310 con 0x7f4df014e600 2023-11-30T17:23:19.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.352+0000 7f4dee59c700 1 -- 172.21.15.49:0/402762356 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4dd005f300 msgr2=0x7f4dd00617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:23:19.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.352+0000 7f4dee59c700 1 --2- 172.21.15.49:0/402762356 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4dd005f300 0x7f4dd00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:23:19.355 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:19.352+0000 7f5ae1afb680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T17:23:19.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.356+0000 7f4de67fc700 1 -- 172.21.15.49:0/402762356 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4de004d2c0 con 0x7f4df014e600 2023-11-30T17:23:19.426 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:19.423+0000 7f5ae1afb680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T17:23:19.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.449+0000 7f4de67fc700 1 -- 172.21.15.49:0/402762356 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 38) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f4de0079dc0 con 0x7f4df014e600 2023-11-30T17:23:19.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.449+0000 7f4de67fc700 1 -- 172.21.15.49:0/402762356 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4dd005f300 msgr2=0x7f4dd00617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:23:19.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.449+0000 7f4de67fc700 1 --2- 172.21.15.49:0/402762356 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4dd005f300 0x7f4dd00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:19.503 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:19.500+0000 7f5a5c28d700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:23:19.503 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:19.500+0000 7f5a5c28d700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:23:19.503 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:19.500+0000 7f5a5c28d700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:23:19.503 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:19.500+0000 7f5a5c28d700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:23:19.503 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:19.500+0000 7f5a5c28d700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:23:19.503 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:19.500+0000 7f5a5f293700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:23:19.503 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:19.500+0000 7f5a5f293700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:23:19.504 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:19.500+0000 7f5a5f293700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:23:19.504 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:19.500+0000 7f5a5f293700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:23:19.504 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:19.500+0000 7f5a5f293700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:23:19.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:19.580+0000 7f4df4f25700 1 -- 172.21.15.49:0/402762356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4df00688f0 con 0x7f4df014e600 2023-11-30T17:23:19.646 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:19.645+0000 7fdefd014680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T17:23:19.721 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:19.719+0000 7fdefd014680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T17:23:20.443 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-11-30T17:23:20.441+0000 7f3888d95700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-30T17:23:20.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.447+0000 7f4de67fc700 1 -- 172.21.15.49:0/402762356 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mgrmap(e 39) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f4de007a140 con 0x7f4df014e600 2023-11-30T17:23:20.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.447+0000 7f4de67fc700 1 --2- 172.21.15.49:0/402762356 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4dd005f300 0x7f4dd0061740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:20.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.448+0000 7f4dee59c700 1 --2- 172.21.15.49:0/402762356 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4dd005f300 0x7f4dd0061740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:20.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.449+0000 7f4dee59c700 1 --2- 172.21.15.49:0/402762356 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4dd005f300 0x7f4dd0061740 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f4dd8000c00 tx=0x7f4dd8007d90).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:20.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.455+0000 7f4de67fc700 1 -- 172.21.15.49:0/402762356 <== mon.0 v2:172.21.15.49:3300/0 9 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v40) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4de004e2d0 con 0x7f4df014e600 2023-11-30T17:23:20.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.457+0000 7f4df4f25700 1 -- 172.21.15.49:0/402762356 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4dd005f300 msgr2=0x7f4dd0061740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:20.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.457+0000 7f4df4f25700 1 --2- 172.21.15.49:0/402762356 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4dd005f300 0x7f4dd0061740 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f4dd8000c00 tx=0x7f4dd8007d90).stop 2023-11-30T17:23:20.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.457+0000 7f4df4f25700 1 -- 172.21.15.49:0/402762356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4df014e600 msgr2=0x7f4df014c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:20.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.457+0000 7f4df4f25700 1 --2- 172.21.15.49:0/402762356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4df014e600 0x7f4df014c3b0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7f4de0009eb0 tx=0x7f4de0017000).stop 2023-11-30T17:23:20.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.457+0000 7f4df4f25700 1 -- 172.21.15.49:0/402762356 shutdown_connections 2023-11-30T17:23:20.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.457+0000 7f4df4f25700 1 --2- 172.21.15.49:0/402762356 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4df0158160 0x7f4df014c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:20.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.457+0000 7f4df4f25700 1 --2- 172.21.15.49:0/402762356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4df00a8280 0x7f4df01685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:20.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.457+0000 7f4df4f25700 1 --2- 172.21.15.49:0/402762356 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4dd005f300 0x7f4dd0061740 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:20.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.457+0000 7f4df4f25700 1 --2- 172.21.15.49:0/402762356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4df014e600 0x7f4df014c3b0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:20.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.457+0000 7f4df4f25700 1 -- 172.21.15.49:0/402762356 >> 172.21.15.49:0/402762356 conn(0x7f4df0062700 msgr2=0x7f4df0062ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:20.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.457+0000 7f4df4f25700 1 -- 172.21.15.49:0/402762356 shutdown_connections 2023-11-30T17:23:20.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.457+0000 7f4df4f25700 1 -- 172.21.15.49:0/402762356 wait complete. 2023-11-30T17:23:20.461 INFO:tasks.ceph.mds.d.smithi115.stderr: -1394> 2023-11-30T17:23:02.834+0000 7f8c60132700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-30T17:23:20.461 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-30T17:23:20.472 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-30T17:23:20.480 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-11-30T17:23:20.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.594+0000 7fd4111cc700 1 Processor -- start 2023-11-30T17:23:20.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.594+0000 7fd4111cc700 1 -- start start 2023-11-30T17:23:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.595+0000 7fd4111cc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd40c0c66f0 0x7fd40c154950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.595+0000 7fd4111cc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd40c158570 0x7fd40c158a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.595+0000 7fd4111cc700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40c154e40 con 0x7fd40c14e530 2023-11-30T17:23:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.595+0000 7fd4111cc700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40c0c6ba0 con 0x7fd40c0c66f0 2023-11-30T17:23:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.595+0000 7fd4111cc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c0c7bc0 con 0x7fd40c158570 2023-11-30T17:23:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.595+0000 7fd40b7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd40c0c66f0 0x7fd40c154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.595+0000 7fd40b7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd40c0c66f0 0x7fd40c154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58528/0 (socket says 172.21.15.49:58528) 2023-11-30T17:23:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.595+0000 7fd40b7fe700 1 -- 172.21.15.49:0/1472974382 learned_addr learned my addr 172.21.15.49:0/1472974382 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.595+0000 7fd4109cb700 1 --2- 172.21.15.49:0/1472974382 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd40c158570 0x7fd40c158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.595+0000 7fd40b7fe700 1 -- 172.21.15.49:0/1472974382 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd40c158570 msgr2=0x7fd40c158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.595+0000 7fd40b7fe700 1 --2- 172.21.15.49:0/1472974382 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd40c158570 0x7fd40c158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:20.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.595+0000 7fd40b7fe700 1 -- 172.21.15.49:0/1472974382 >> v1:172.21.15.115:6789/0 conn(0x7fd40c14e530 legacy=0x7fd40c14e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:20.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.595+0000 7fd40b7fe700 1 -- 172.21.15.49:0/1472974382 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40c155920 con 0x7fd40c0c66f0 2023-11-30T17:23:20.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.595+0000 7fd40b7fe700 1 --2- 172.21.15.49:0/1472974382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd40c0c66f0 0x7fd40c154950 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7fd400006fd0 tx=0x7fd4000090f0).ready entity=mon.0 client_cookie=c3f5c460e88b7ee3 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:20.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.596+0000 7fd40affd700 1 -- 172.21.15.49:0/1472974382 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40000b580 con 0x7fd40c0c66f0 2023-11-30T17:23:20.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.596+0000 7fd40affd700 1 -- 172.21.15.49:0/1472974382 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40000b6e0 con 0x7fd40c0c66f0 2023-11-30T17:23:20.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.596+0000 7fd40affd700 1 -- 172.21.15.49:0/1472974382 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40000ba60 con 0x7fd40c0c66f0 2023-11-30T17:23:20.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.596+0000 7fd4111cc700 1 -- 172.21.15.49:0/1472974382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd40c0c66f0 msgr2=0x7fd40c154950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:20.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.596+0000 7fd4111cc700 1 --2- 172.21.15.49:0/1472974382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd40c0c66f0 0x7fd40c154950 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7fd400006fd0 tx=0x7fd4000090f0).stop 2023-11-30T17:23:20.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.596+0000 7fd4111cc700 1 -- 172.21.15.49:0/1472974382 shutdown_connections 2023-11-30T17:23:20.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.596+0000 7fd4111cc700 1 --2- 172.21.15.49:0/1472974382 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd40c158570 0x7fd40c158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:20.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.596+0000 7fd4111cc700 1 --2- 172.21.15.49:0/1472974382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd40c0c66f0 0x7fd40c154950 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:20.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.596+0000 7fd4111cc700 1 -- 172.21.15.49:0/1472974382 >> 172.21.15.49:0/1472974382 conn(0x7fd40c064990 msgr2=0x7fd40c064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:20.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.596+0000 7fd4111cc700 1 -- 172.21.15.49:0/1472974382 shutdown_connections 2023-11-30T17:23:20.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.596+0000 7fd4111cc700 1 -- 172.21.15.49:0/1472974382 wait complete. 2023-11-30T17:23:20.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.597+0000 7fd4111cc700 1 Processor -- start 2023-11-30T17:23:20.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.597+0000 7fd4111cc700 1 -- start start 2023-11-30T17:23:20.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.598+0000 7fd4111cc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd40c0c66f0 0x7fd40c0af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:20.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.598+0000 7fd4111cc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd40c14e530 0x7fd40c14e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:20.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.598+0000 7fd4111cc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd40c158570 0x7fd40c14ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:20.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.598+0000 7fd4111cc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c0c3130 con 0x7fd40c0c66f0 2023-11-30T17:23:20.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.598+0000 7fd4111cc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c14f2f0 con 0x7fd40c158570 2023-11-30T17:23:20.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.598+0000 7fd4111cc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c0c2e50 con 0x7fd40c14e530 2023-11-30T17:23:20.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.598+0000 7fd40bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd40c0c66f0 0x7fd40c0af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:20.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.598+0000 7fd40bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd40c0c66f0 0x7fd40c0af7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58542/0 (socket says 172.21.15.49:58542) 2023-11-30T17:23:20.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.598+0000 7fd40bfff700 1 -- 172.21.15.49:0/454198726 learned_addr learned my addr 172.21.15.49:0/454198726 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:20.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.599+0000 7fd40b7fe700 1 --2- 172.21.15.49:0/454198726 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd40c14e530 0x7fd40c14e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:20.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.599+0000 7fd4109cb700 1 --2- 172.21.15.49:0/454198726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd40c158570 0x7fd40c14ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:20.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.599+0000 7fd40bfff700 1 -- 172.21.15.49:0/454198726 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd40c14e530 msgr2=0x7fd40c14e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:20.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.599+0000 7fd40bfff700 1 --2- 172.21.15.49:0/454198726 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd40c14e530 0x7fd40c14e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:20.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.599+0000 7fd40bfff700 1 -- 172.21.15.49:0/454198726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd40c158570 msgr2=0x7fd40c14ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:20.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.599+0000 7fd40bfff700 1 --2- 172.21.15.49:0/454198726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd40c158570 0x7fd40c14ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:20.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.599+0000 7fd40bfff700 1 -- 172.21.15.49:0/454198726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd400009370 con 0x7fd40c0c66f0 2023-11-30T17:23:20.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.599+0000 7fd40bfff700 1 --2- 172.21.15.49:0/454198726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd40c0c66f0 0x7fd40c0af7a0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7fd3fc00c4c0 tx=0x7fd3fc007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:20.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.599+0000 7fd3f3fff700 1 -- 172.21.15.49:0/454198726 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc007020 con 0x7fd40c0c66f0 2023-11-30T17:23:20.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.599+0000 7fd3f3fff700 1 -- 172.21.15.49:0/454198726 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3fc001e90 con 0x7fd40c0c66f0 2023-11-30T17:23:20.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.599+0000 7fd4111cc700 1 -- 172.21.15.49:0/454198726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd40c0c3460 con 0x7fd40c0c66f0 2023-11-30T17:23:20.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.599+0000 7fd3f3fff700 1 -- 172.21.15.49:0/454198726 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc0073b0 con 0x7fd40c0c66f0 2023-11-30T17:23:20.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.599+0000 7fd4111cc700 1 -- 172.21.15.49:0/454198726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd40c0c3a20 con 0x7fd40c0c66f0 2023-11-30T17:23:20.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.600+0000 7fd4111cc700 1 -- 172.21.15.49:0/454198726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd40c154bf0 con 0x7fd40c0c66f0 2023-11-30T17:23:20.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.600+0000 7fd3f3fff700 1 -- 172.21.15.49:0/454198726 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fd3fc0068b0 con 0x7fd40c0c66f0 2023-11-30T17:23:20.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.601+0000 7fd3f3fff700 1 --2- 172.21.15.49:0/454198726 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd3f805f030 0x7fd3f80614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:20.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.601+0000 7fd3f3fff700 1 -- 172.21.15.49:0/454198726 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6708+0+0 (secure 0 0 0) 0x7fd3fc079a20 con 0x7fd40c0c66f0 2023-11-30T17:23:20.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.601+0000 7fd40b7fe700 1 --2- 172.21.15.49:0/454198726 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd3f805f030 0x7fd3f80614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:20.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.601+0000 7fd40b7fe700 1 --2- 172.21.15.49:0/454198726 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd3f805f030 0x7fd3f80614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fd400009fd0 tx=0x7fd400017000).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:20.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.605+0000 7fd3f3fff700 1 -- 172.21.15.49:0/454198726 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd3fc04ac70 con 0x7fd40c0c66f0 2023-11-30T17:23:20.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:20.821+0000 7fd4111cc700 1 -- 172.21.15.49:0/454198726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd40c154e40 con 0x7fd40c0c66f0 2023-11-30T17:23:21.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.459+0000 7fd3f3fff700 1 -- 172.21.15.49:0/454198726 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v41) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd40c154e40 con 0x7fd40c0c66f0 2023-11-30T17:23:21.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.461+0000 7fd4111cc700 1 -- 172.21.15.49:0/454198726 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd3f805f030 msgr2=0x7fd3f80614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:21.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.461+0000 7fd4111cc700 1 --2- 172.21.15.49:0/454198726 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd3f805f030 0x7fd3f80614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fd400009fd0 tx=0x7fd400017000).stop 2023-11-30T17:23:21.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.461+0000 7fd4111cc700 1 -- 172.21.15.49:0/454198726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd40c0c66f0 msgr2=0x7fd40c0af7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:21.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.461+0000 7fd4111cc700 1 --2- 172.21.15.49:0/454198726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd40c0c66f0 0x7fd40c0af7a0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7fd3fc00c4c0 tx=0x7fd3fc007e00).stop 2023-11-30T17:23:21.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.461+0000 7fd4111cc700 1 -- 172.21.15.49:0/454198726 shutdown_connections 2023-11-30T17:23:21.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.461+0000 7fd4111cc700 1 --2- 172.21.15.49:0/454198726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd40c158570 0x7fd40c14ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:21.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.461+0000 7fd4111cc700 1 --2- 172.21.15.49:0/454198726 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd3f805f030 0x7fd3f80614f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:21.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.461+0000 7fd4111cc700 1 --2- 172.21.15.49:0/454198726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd40c0c66f0 0x7fd40c0af7a0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:21.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.461+0000 7fd4111cc700 1 --2- 172.21.15.49:0/454198726 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd40c14e530 0x7fd40c14e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:21.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.461+0000 7fd4111cc700 1 -- 172.21.15.49:0/454198726 >> 172.21.15.49:0/454198726 conn(0x7fd40c064990 msgr2=0x7fd40c064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:21.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.461+0000 7fd4111cc700 1 -- 172.21.15.49:0/454198726 shutdown_connections 2023-11-30T17:23:21.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.461+0000 7fd4111cc700 1 -- 172.21.15.49:0/454198726 wait complete. 2023-11-30T17:23:21.477 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-30T17:23:21.494 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:23:21.522 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:23:21.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.601+0000 7fef28c18700 1 Processor -- start 2023-11-30T17:23:21.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.601+0000 7fef28c18700 1 -- start start 2023-11-30T17:23:21.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.602+0000 7fef28c18700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fef24158040 0x7fef24154550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:21.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.602+0000 7fef28c18700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fef24064880 0x7fef24064d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:21.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.602+0000 7fef28c18700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef24065200 con 0x7fef24154170 2023-11-30T17:23:21.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.602+0000 7fef28c18700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef240aa840 con 0x7fef24064880 2023-11-30T17:23:21.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.602+0000 7fef28c18700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef241584d0 con 0x7fef24158040 2023-11-30T17:23:21.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.602+0000 7fef23fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fef24064880 0x7fef24064d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:21.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.602+0000 7fef237fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fef24154170 0x7fef240aa130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48464/0 (socket says 172.21.15.49:48464) 2023-11-30T17:23:21.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.602+0000 7fef237fe700 1 -- 172.21.15.49:0/1771422844 learned_addr learned my addr 172.21.15.49:0/1771422844 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:21.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.602+0000 7fef22ffd700 1 --2- 172.21.15.49:0/1771422844 >> v2:172.21.15.115:3300/0 conn(0x7fef24158040 0x7fef24154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:21.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.602+0000 7fef23fff700 1 -- 172.21.15.49:0/1771422844 >> v2:172.21.15.115:3300/0 conn(0x7fef24158040 msgr2=0x7fef24154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:21.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.602+0000 7fef23fff700 1 --2- 172.21.15.49:0/1771422844 >> v2:172.21.15.115:3300/0 conn(0x7fef24158040 0x7fef24154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.602+0000 7fef23fff700 1 -- 172.21.15.49:0/1771422844 >> v1:172.21.15.49:6789/0 conn(0x7fef24154170 legacy=0x7fef240aa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.602+0000 7fef227fc700 1 -- 172.21.15.49:0/1771422844 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4267893060 0 0) 0x7fef24065200 con 0x7fef24154170 2023-11-30T17:23:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.602+0000 7fef23fff700 1 -- 172.21.15.49:0/1771422844 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef241587b0 con 0x7fef24064880 2023-11-30T17:23:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.602+0000 7fef23fff700 1 --2- 172.21.15.49:0/1771422844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef24064880 0x7fef24064d10 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7fef240aa9e0 tx=0x7fef1c009780).ready entity=mon.0 client_cookie=932096deb4a21bec server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.603+0000 7fef227fc700 1 -- 172.21.15.49:0/1771422844 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c00e070 con 0x7fef24064880 2023-11-30T17:23:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.603+0000 7fef227fc700 1 -- 172.21.15.49:0/1771422844 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1c00bc00 con 0x7fef24064880 2023-11-30T17:23:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.603+0000 7fef227fc700 1 -- 172.21.15.49:0/1771422844 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c012410 con 0x7fef24064880 2023-11-30T17:23:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.603+0000 7fef28c18700 1 -- 172.21.15.49:0/1771422844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef24064880 msgr2=0x7fef24064d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.603+0000 7fef28c18700 1 --2- 172.21.15.49:0/1771422844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef24064880 0x7fef24064d10 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7fef240aa9e0 tx=0x7fef1c009780).stop 2023-11-30T17:23:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.603+0000 7fef28c18700 1 -- 172.21.15.49:0/1771422844 shutdown_connections 2023-11-30T17:23:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.603+0000 7fef28c18700 1 --2- 172.21.15.49:0/1771422844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef24064880 0x7fef24064d10 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.603+0000 7fef28c18700 1 --2- 172.21.15.49:0/1771422844 >> v2:172.21.15.115:3300/0 conn(0x7fef24158040 0x7fef24154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.603+0000 7fef28c18700 1 -- 172.21.15.49:0/1771422844 >> 172.21.15.49:0/1771422844 conn(0x7fef240cb010 msgr2=0x7fef240cb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.603+0000 7fef28c18700 1 -- 172.21.15.49:0/1771422844 shutdown_connections 2023-11-30T17:23:21.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.603+0000 7fef28c18700 1 -- 172.21.15.49:0/1771422844 wait complete. 2023-11-30T17:23:21.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.604+0000 7fef28c18700 1 Processor -- start 2023-11-30T17:23:21.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.604+0000 7fef28c18700 1 -- start start 2023-11-30T17:23:21.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.605+0000 7fef28c18700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef24064880 0x7fef2414ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:21.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.605+0000 7fef28c18700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef24154170 0x7fef240ae990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:21.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.605+0000 7fef28c18700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef241579a0 0x7fef24150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:21.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.605+0000 7fef28c18700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef24164ef0 con 0x7fef24154170 2023-11-30T17:23:21.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.605+0000 7fef28c18700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef240aee80 con 0x7fef241579a0 2023-11-30T17:23:21.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.605+0000 7fef28c18700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef24165a10 con 0x7fef24064880 2023-11-30T17:23:21.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.605+0000 7fef22ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef24154170 0x7fef240ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:21.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.605+0000 7fef22ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef24154170 0x7fef240ae990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58562/0 (socket says 172.21.15.49:58562) 2023-11-30T17:23:21.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.605+0000 7fef22ffd700 1 -- 172.21.15.49:0/966759028 learned_addr learned my addr 172.21.15.49:0/966759028 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:21.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.606+0000 7fef23fff700 1 --2- 172.21.15.49:0/966759028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef241579a0 0x7fef24150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:21.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.606+0000 7fef237fe700 1 --2- 172.21.15.49:0/966759028 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef24064880 0x7fef2414ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:21.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.606+0000 7fef22ffd700 1 -- 172.21.15.49:0/966759028 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef24064880 msgr2=0x7fef2414ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:21.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.606+0000 7fef22ffd700 1 --2- 172.21.15.49:0/966759028 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef24064880 0x7fef2414ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:21.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.606+0000 7fef22ffd700 1 -- 172.21.15.49:0/966759028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef241579a0 msgr2=0x7fef24150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:21.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.606+0000 7fef22ffd700 1 --2- 172.21.15.49:0/966759028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef241579a0 0x7fef24150bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:21.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.606+0000 7fef22ffd700 1 -- 172.21.15.49:0/966759028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1c009a20 con 0x7fef24154170 2023-11-30T17:23:21.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.606+0000 7fef23fff700 1 --2- 172.21.15.49:0/966759028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef241579a0 0x7fef24150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:23:21.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.606+0000 7fef22ffd700 1 --2- 172.21.15.49:0/966759028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef24154170 0x7fef240ae990 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7fef1800d890 tx=0x7fef18008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:21.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.606+0000 7fef0b7fe700 1 -- 172.21.15.49:0/966759028 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef18011590 con 0x7fef24154170 2023-11-30T17:23:21.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.606+0000 7fef0b7fe700 1 -- 172.21.15.49:0/966759028 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef180116f0 con 0x7fef24154170 2023-11-30T17:23:21.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.606+0000 7fef28c18700 1 -- 172.21.15.49:0/966759028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef24157e20 con 0x7fef24154170 2023-11-30T17:23:21.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.606+0000 7fef0b7fe700 1 -- 172.21.15.49:0/966759028 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef18011a70 con 0x7fef24154170 2023-11-30T17:23:21.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.606+0000 7fef28c18700 1 -- 172.21.15.49:0/966759028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef241653c0 con 0x7fef24154170 2023-11-30T17:23:21.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.607+0000 7fef28c18700 1 -- 172.21.15.49:0/966759028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef24165bc0 con 0x7fef24154170 2023-11-30T17:23:21.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.607+0000 7fef0b7fe700 1 -- 172.21.15.49:0/966759028 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fef1801c460 con 0x7fef24154170 2023-11-30T17:23:21.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.608+0000 7fef0b7fe700 1 --2- 172.21.15.49:0/966759028 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fef1005f030 0x7fef100614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:21.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.608+0000 7fef0b7fe700 1 -- 172.21.15.49:0/966759028 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6708+0+0 (secure 0 0 0) 0x7fef18079fa0 con 0x7fef24154170 2023-11-30T17:23:21.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.608+0000 7fef237fe700 1 --2- 172.21.15.49:0/966759028 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fef1005f030 0x7fef100614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:21.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.608+0000 7fef237fe700 1 --2- 172.21.15.49:0/966759028 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fef1005f030 0x7fef100614f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fef14007fd0 tx=0x7fef14009040).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:21.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.612+0000 7fef0b7fe700 1 -- 172.21.15.49:0/966759028 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fef24165bc0 con 0x7fef24154170 2023-11-30T17:23:21.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:21.787+0000 7fef28c18700 1 -- 172.21.15.49:0/966759028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fef24165bc0 con 0x7fef24154170 2023-11-30T17:23:22.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.202+0000 7fef0b7fe700 1 -- 172.21.15.49:0/966759028 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fef18077cf0 con 0x7fef24154170 2023-11-30T17:23:22.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.464+0000 7fef0b7fe700 1 -- 172.21.15.49:0/966759028 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v103) v1 ==== 181+0+0 (secure 0 0 0) 0x7fef18072510 con 0x7fef24154170 2023-11-30T17:23:22.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.467+0000 7fef28c18700 1 -- 172.21.15.49:0/966759028 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fef1005f030 msgr2=0x7fef100614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:22.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.467+0000 7fef28c18700 1 --2- 172.21.15.49:0/966759028 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fef1005f030 0x7fef100614f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fef14007fd0 tx=0x7fef14009040).stop 2023-11-30T17:23:22.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.467+0000 7fef28c18700 1 -- 172.21.15.49:0/966759028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef24154170 msgr2=0x7fef240ae990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:22.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.467+0000 7fef28c18700 1 --2- 172.21.15.49:0/966759028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef24154170 0x7fef240ae990 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7fef1800d890 tx=0x7fef18008040).stop 2023-11-30T17:23:22.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.468+0000 7fef28c18700 1 -- 172.21.15.49:0/966759028 shutdown_connections 2023-11-30T17:23:22.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.468+0000 7fef28c18700 1 --2- 172.21.15.49:0/966759028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef241579a0 0x7fef24150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:22.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.468+0000 7fef28c18700 1 --2- 172.21.15.49:0/966759028 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef24064880 0x7fef2414ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:22.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.468+0000 7fef28c18700 1 --2- 172.21.15.49:0/966759028 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fef1005f030 0x7fef100614f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:22.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.468+0000 7fef28c18700 1 --2- 172.21.15.49:0/966759028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef24154170 0x7fef240ae990 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:22.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.468+0000 7fef28c18700 1 -- 172.21.15.49:0/966759028 >> 172.21.15.49:0/966759028 conn(0x7fef240cb010 msgr2=0x7fef240c9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:22.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.468+0000 7fef28c18700 1 -- 172.21.15.49:0/966759028 shutdown_connections 2023-11-30T17:23:22.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.468+0000 7fef28c18700 1 -- 172.21.15.49:0/966759028 wait complete. 2023-11-30T17:23:22.471 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2023-11-30T17:23:22.487 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-30T17:23:22.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.654+0000 7f3957b63700 1 Processor -- start 2023-11-30T17:23:22.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.654+0000 7f3957b63700 1 -- start start 2023-11-30T17:23:22.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.655+0000 7f3957b63700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3950154530 0x7f3950154910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:22.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.655+0000 7f3957b63700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f39500aa220 0x7f39500aa690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:22.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.655+0000 7f3957b63700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39500c6630 con 0x7f39500a7ff0 2023-11-30T17:23:22.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.655+0000 7f3957b63700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39500c6390 con 0x7f39500aa220 2023-11-30T17:23:22.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.655+0000 7f3957b63700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39500a8470 con 0x7f3950154530 2023-11-30T17:23:22.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.655+0000 7f3956100700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f39500aa220 0x7f39500aa690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:22.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.655+0000 7f3956100700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f39500aa220 0x7f39500aa690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58570/0 (socket says 172.21.15.49:58570) 2023-11-30T17:23:22.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.655+0000 7f3956100700 1 -- 172.21.15.49:0/2608606967 learned_addr learned my addr 172.21.15.49:0/2608606967 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:22.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.656+0000 7f39558ff700 1 --2- 172.21.15.49:0/2608606967 >> v2:172.21.15.115:3300/0 conn(0x7f3950154530 0x7f3950154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:22.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.656+0000 7f3956100700 1 -- 172.21.15.49:0/2608606967 >> v2:172.21.15.115:3300/0 conn(0x7f3950154530 msgr2=0x7f3950154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:22.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.656+0000 7f3956100700 1 --2- 172.21.15.49:0/2608606967 >> v2:172.21.15.115:3300/0 conn(0x7f3950154530 0x7f3950154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:22.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.656+0000 7f3956100700 1 -- 172.21.15.49:0/2608606967 >> v1:172.21.15.115:6789/0 conn(0x7f39500a7ff0 legacy=0x7f39500c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:22.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.656+0000 7f3956100700 1 -- 172.21.15.49:0/2608606967 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39500aab80 con 0x7f39500aa220 2023-11-30T17:23:22.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.656+0000 7f39558ff700 1 --2- 172.21.15.49:0/2608606967 >> v2:172.21.15.115:3300/0 conn(0x7f3950154530 0x7f3950154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:23:22.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.656+0000 7f3956100700 1 --2- 172.21.15.49:0/2608606967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39500aa220 0x7f39500aa690 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f39500c9080 tx=0x7f3940009840).ready entity=mon.0 client_cookie=e965f412a361c664 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:22.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.656+0000 7f39548fd700 1 -- 172.21.15.49:0/2608606967 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394000e070 con 0x7f39500aa220 2023-11-30T17:23:22.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.656+0000 7f39548fd700 1 -- 172.21.15.49:0/2608606967 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394000ba10 con 0x7f39500aa220 2023-11-30T17:23:22.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.656+0000 7f39548fd700 1 -- 172.21.15.49:0/2608606967 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394000bd90 con 0x7f39500aa220 2023-11-30T17:23:22.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.656+0000 7f3957b63700 1 -- 172.21.15.49:0/2608606967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39500aa220 msgr2=0x7f39500aa690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:22.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.656+0000 7f3957b63700 1 --2- 172.21.15.49:0/2608606967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39500aa220 0x7f39500aa690 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f39500c9080 tx=0x7f3940009840).stop 2023-11-30T17:23:22.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.657+0000 7f3957b63700 1 -- 172.21.15.49:0/2608606967 shutdown_connections 2023-11-30T17:23:22.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.657+0000 7f3957b63700 1 --2- 172.21.15.49:0/2608606967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39500aa220 0x7f39500aa690 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:22.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.657+0000 7f3957b63700 1 --2- 172.21.15.49:0/2608606967 >> v2:172.21.15.115:3300/0 conn(0x7f3950154530 0x7f3950154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:22.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.657+0000 7f3957b63700 1 -- 172.21.15.49:0/2608606967 >> 172.21.15.49:0/2608606967 conn(0x7f3950094930 msgr2=0x7f395006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:22.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.657+0000 7f3957b63700 1 -- 172.21.15.49:0/2608606967 shutdown_connections 2023-11-30T17:23:22.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.657+0000 7f3957b63700 1 -- 172.21.15.49:0/2608606967 wait complete. 2023-11-30T17:23:22.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.658+0000 7f3957b63700 1 Processor -- start 2023-11-30T17:23:22.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.658+0000 7f3957b63700 1 -- start start 2023-11-30T17:23:22.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.658+0000 7f3957b63700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39500a7ff0 0x7f3950148bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:22.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.658+0000 7f3957b63700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39500aa220 0x7f39500b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:22.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.658+0000 7f3957b63700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3950154530 0x7f39500aec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:22.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.659+0000 7f3957b63700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39500ae880 con 0x7f39500aa220 2023-11-30T17:23:22.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.659+0000 7f3957b63700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39501490b0 con 0x7f3950154530 2023-11-30T17:23:22.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.659+0000 7f3957b63700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3950149580 con 0x7f39500a7ff0 2023-11-30T17:23:22.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.659+0000 7f39550fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39500aa220 0x7f39500b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:22.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.659+0000 7f39550fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39500aa220 0x7f39500b0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58584/0 (socket says 172.21.15.49:58584) 2023-11-30T17:23:22.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.659+0000 7f39550fe700 1 -- 172.21.15.49:0/3250060699 learned_addr learned my addr 172.21.15.49:0/3250060699 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:22.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.659+0000 7f3956100700 1 --2- 172.21.15.49:0/3250060699 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3950154530 0x7f39500aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:22.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.659+0000 7f39558ff700 1 --2- 172.21.15.49:0/3250060699 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39500a7ff0 0x7f3950148bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:22.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.659+0000 7f39550fe700 1 -- 172.21.15.49:0/3250060699 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39500a7ff0 msgr2=0x7f3950148bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:22.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.659+0000 7f39550fe700 1 --2- 172.21.15.49:0/3250060699 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39500a7ff0 0x7f3950148bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:22.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.659+0000 7f39550fe700 1 -- 172.21.15.49:0/3250060699 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3950154530 msgr2=0x7f39500aec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:22.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.659+0000 7f39550fe700 1 --2- 172.21.15.49:0/3250060699 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3950154530 0x7f39500aec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:22.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.659+0000 7f39550fe700 1 -- 172.21.15.49:0/3250060699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3940009ae0 con 0x7f39500aa220 2023-11-30T17:23:22.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.659+0000 7f39550fe700 1 --2- 172.21.15.49:0/3250060699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39500aa220 0x7f39500b0ab0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7f394400c440 tx=0x7f3944007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:22.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.659+0000 7f394dffb700 1 -- 172.21.15.49:0/3250060699 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3944012400 con 0x7f39500aa220 2023-11-30T17:23:22.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.659+0000 7f394dffb700 1 -- 172.21.15.49:0/3250060699 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39440125a0 con 0x7f39500aa220 2023-11-30T17:23:22.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.659+0000 7f3957b63700 1 -- 172.21.15.49:0/3250060699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3950152be0 con 0x7f39500aa220 2023-11-30T17:23:22.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.659+0000 7f394dffb700 1 -- 172.21.15.49:0/3250060699 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3944012960 con 0x7f39500aa220 2023-11-30T17:23:22.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.660+0000 7f3957b63700 1 -- 172.21.15.49:0/3250060699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39500ae230 con 0x7f39500aa220 2023-11-30T17:23:22.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.660+0000 7f3957b63700 1 -- 172.21.15.49:0/3250060699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f395005f7b0 con 0x7f39500aa220 2023-11-30T17:23:22.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.661+0000 7f394dffb700 1 -- 172.21.15.49:0/3250060699 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f3944012d50 con 0x7f39500aa220 2023-11-30T17:23:22.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.661+0000 7f394dffb700 1 --2- 172.21.15.49:0/3250060699 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f393c05f270 0x7f393c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:22.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.661+0000 7f394dffb700 1 -- 172.21.15.49:0/3250060699 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6270+0+0 (secure 0 0 0) 0x7f3944079790 con 0x7f39500aa220 2023-11-30T17:23:22.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.662+0000 7f39558ff700 1 --2- 172.21.15.49:0/3250060699 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f393c05f270 0x7f393c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:22.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.662+0000 7f39558ff700 1 --2- 172.21.15.49:0/3250060699 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f393c05f270 0x7f393c061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f394800ab20 tx=0x7f3948008040).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:22.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.666+0000 7f394dffb700 1 -- 172.21.15.49:0/3250060699 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3944048b00 con 0x7f39500aa220 2023-11-30T17:23:22.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:22.838+0000 7f3957b63700 1 -- 172.21.15.49:0/3250060699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f395006c860 con 0x7f39500aa220 2023-11-30T17:23:23.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.465+0000 7f394dffb700 1 -- 172.21.15.49:0/3250060699 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v104) v1 ==== 169+0+0 (secure 0 0 0) 0x7f395005f7b0 con 0x7f39500aa220 2023-11-30T17:23:23.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.470+0000 7f3957b63700 1 -- 172.21.15.49:0/3250060699 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f393c05f270 msgr2=0x7f393c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:23.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.470+0000 7f3957b63700 1 --2- 172.21.15.49:0/3250060699 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f393c05f270 0x7f393c061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f394800ab20 tx=0x7f3948008040).stop 2023-11-30T17:23:23.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.470+0000 7f3957b63700 1 -- 172.21.15.49:0/3250060699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39500aa220 msgr2=0x7f39500b0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:23.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.470+0000 7f3957b63700 1 --2- 172.21.15.49:0/3250060699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39500aa220 0x7f39500b0ab0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7f394400c440 tx=0x7f3944007de0).stop 2023-11-30T17:23:23.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.471+0000 7f3957b63700 1 -- 172.21.15.49:0/3250060699 shutdown_connections 2023-11-30T17:23:23.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.471+0000 7f3957b63700 1 --2- 172.21.15.49:0/3250060699 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3950154530 0x7f39500aec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:23.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.471+0000 7f3957b63700 1 --2- 172.21.15.49:0/3250060699 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39500a7ff0 0x7f3950148bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:23.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.471+0000 7f3957b63700 1 --2- 172.21.15.49:0/3250060699 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f393c05f270 0x7f393c061730 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:23.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.471+0000 7f3957b63700 1 --2- 172.21.15.49:0/3250060699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39500aa220 0x7f39500b0ab0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:23.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.471+0000 7f3957b63700 1 -- 172.21.15.49:0/3250060699 >> 172.21.15.49:0/3250060699 conn(0x7f3950094930 msgr2=0x7f39500c08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:23.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.471+0000 7f3957b63700 1 -- 172.21.15.49:0/3250060699 shutdown_connections 2023-11-30T17:23:23.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.471+0000 7f3957b63700 1 -- 172.21.15.49:0/3250060699 wait complete. 2023-11-30T17:23:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2023-11-30T17:23:23.489 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-30T17:23:23.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.608+0000 7f07957f7700 1 Processor -- start 2023-11-30T17:23:23.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.608+0000 7f07957f7700 1 -- start start 2023-11-30T17:23:23.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.609+0000 7f07957f7700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0790098d10 0x7f07900c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:23.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.609+0000 7f07957f7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07900c6190 0x7f0790063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:23.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.609+0000 7f07957f7700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0790064350 0x7f0790158320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:23.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.609+0000 7f07957f7700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07900c72d0 con 0x7f0790098d10 2023-11-30T17:23:23.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.609+0000 7f07957f7700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0790154bc0 con 0x7f0790064350 2023-11-30T17:23:23.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.609+0000 7f07957f7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07900c66c0 con 0x7f07900c6190 2023-11-30T17:23:23.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.609+0000 7f078effd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0790098d10 0x7f07900c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:23.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.609+0000 7f078effd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0790098d10 0x7f07900c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58594/0 (socket says 172.21.15.49:58594) 2023-11-30T17:23:23.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.609+0000 7f078effd700 1 -- 172.21.15.49:0/2262217797 learned_addr learned my addr 172.21.15.49:0/2262217797 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:23.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.609+0000 7f078f7fe700 1 --2- 172.21.15.49:0/2262217797 >> v2:172.21.15.115:3300/0 conn(0x7f0790064350 0x7f0790158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:23.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.610+0000 7f078e7fc700 1 --2- 172.21.15.49:0/2262217797 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07900c6190 0x7f0790063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:23.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.610+0000 7f078effd700 1 -- 172.21.15.49:0/2262217797 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07900c6190 msgr2=0x7f0790063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:23.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.610+0000 7f078effd700 1 --2- 172.21.15.49:0/2262217797 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07900c6190 0x7f0790063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:23.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.610+0000 7f078effd700 1 -- 172.21.15.49:0/2262217797 >> v2:172.21.15.115:3300/0 conn(0x7f0790064350 msgr2=0x7f0790158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:23.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.610+0000 7f078effd700 1 --2- 172.21.15.49:0/2262217797 >> v2:172.21.15.115:3300/0 conn(0x7f0790064350 0x7f0790158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:23.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.610+0000 7f078effd700 1 -- 172.21.15.49:0/2262217797 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07900c69a0 con 0x7f0790098d10 2023-11-30T17:23:23.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.610+0000 7f078e7fc700 1 --2- 172.21.15.49:0/2262217797 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07900c6190 0x7f0790063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:23:23.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.610+0000 7f078effd700 1 --2- 172.21.15.49:0/2262217797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0790098d10 0x7f07900c7760 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f0790084b10 tx=0x7f0780009840).ready entity=mon.0 client_cookie=3e7f4722b2323c86 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:23.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.610+0000 7f078dffb700 1 -- 172.21.15.49:0/2262217797 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078000e070 con 0x7f0790098d10 2023-11-30T17:23:23.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.610+0000 7f078dffb700 1 -- 172.21.15.49:0/2262217797 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078000ba20 con 0x7f0790098d10 2023-11-30T17:23:23.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.610+0000 7f078dffb700 1 -- 172.21.15.49:0/2262217797 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078000bda0 con 0x7f0790098d10 2023-11-30T17:23:23.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.610+0000 7f07957f7700 1 -- 172.21.15.49:0/2262217797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0790098d10 msgr2=0x7f07900c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:23.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.610+0000 7f07957f7700 1 --2- 172.21.15.49:0/2262217797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0790098d10 0x7f07900c7760 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f0790084b10 tx=0x7f0780009840).stop 2023-11-30T17:23:23.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.610+0000 7f07957f7700 1 -- 172.21.15.49:0/2262217797 shutdown_connections 2023-11-30T17:23:23.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.610+0000 7f07957f7700 1 --2- 172.21.15.49:0/2262217797 >> v2:172.21.15.115:3300/0 conn(0x7f0790064350 0x7f0790158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:23.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.610+0000 7f07957f7700 1 --2- 172.21.15.49:0/2262217797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0790098d10 0x7f07900c7760 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:23.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.610+0000 7f07957f7700 1 --2- 172.21.15.49:0/2262217797 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07900c6190 0x7f0790063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:23.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.610+0000 7f07957f7700 1 -- 172.21.15.49:0/2262217797 >> 172.21.15.49:0/2262217797 conn(0x7f07900cb310 msgr2=0x7f07900cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:23.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.611+0000 7f07957f7700 1 -- 172.21.15.49:0/2262217797 shutdown_connections 2023-11-30T17:23:23.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.611+0000 7f07957f7700 1 -- 172.21.15.49:0/2262217797 wait complete. 2023-11-30T17:23:23.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.612+0000 7f07957f7700 1 Processor -- start 2023-11-30T17:23:23.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.612+0000 7f07957f7700 1 -- start start 2023-11-30T17:23:23.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.612+0000 7f07957f7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0790064350 0x7f079013ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:23.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.612+0000 7f07957f7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0790098d10 0x7f07900a9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:23.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.613+0000 7f07957f7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07900c6190 0x7f07900aad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:23.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.613+0000 7f07957f7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0790155440 con 0x7f0790064350 2023-11-30T17:23:23.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.613+0000 7f07957f7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079014fdc0 con 0x7f0790098d10 2023-11-30T17:23:23.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.613+0000 7f07957f7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0790155690 con 0x7f07900c6190 2023-11-30T17:23:23.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.613+0000 7f078effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0790064350 0x7f079013ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:23.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.613+0000 7f078effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0790064350 0x7f079013ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58604/0 (socket says 172.21.15.49:58604) 2023-11-30T17:23:23.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.613+0000 7f078effd700 1 -- 172.21.15.49:0/2337076438 learned_addr learned my addr 172.21.15.49:0/2337076438 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:23.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.613+0000 7f078e7fc700 1 --2- 172.21.15.49:0/2337076438 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0790098d10 0x7f07900a9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:23.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.613+0000 7f078f7fe700 1 --2- 172.21.15.49:0/2337076438 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07900c6190 0x7f07900aad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:23.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.613+0000 7f078effd700 1 -- 172.21.15.49:0/2337076438 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07900c6190 msgr2=0x7f07900aad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:23.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.613+0000 7f078effd700 1 --2- 172.21.15.49:0/2337076438 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07900c6190 0x7f07900aad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:23.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.613+0000 7f078effd700 1 -- 172.21.15.49:0/2337076438 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0790098d10 msgr2=0x7f07900a9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:23.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.613+0000 7f078effd700 1 --2- 172.21.15.49:0/2337076438 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0790098d10 0x7f07900a9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:23.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.613+0000 7f078effd700 1 -- 172.21.15.49:0/2337076438 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0780009ae0 con 0x7f0790064350 2023-11-30T17:23:23.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.613+0000 7f078f7fe700 1 --2- 172.21.15.49:0/2337076438 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07900c6190 0x7f07900aad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:23:23.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.613+0000 7f078effd700 1 --2- 172.21.15.49:0/2337076438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0790064350 0x7f079013ce30 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7f078000b6c0 tx=0x7f0780009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:23.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.613+0000 7f0786ffd700 1 -- 172.21.15.49:0/2337076438 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07800032f0 con 0x7f0790064350 2023-11-30T17:23:23.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.613+0000 7f0786ffd700 1 -- 172.21.15.49:0/2337076438 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078000bb90 con 0x7f0790064350 2023-11-30T17:23:23.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.613+0000 7f07957f7700 1 -- 172.21.15.49:0/2337076438 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0790155970 con 0x7f0790064350 2023-11-30T17:23:23.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.613+0000 7f0786ffd700 1 -- 172.21.15.49:0/2337076438 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078001e470 con 0x7f0790064350 2023-11-30T17:23:23.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.613+0000 7f07957f7700 1 -- 172.21.15.49:0/2337076438 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0790155f30 con 0x7f0790064350 2023-11-30T17:23:23.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.614+0000 7f07957f7700 1 -- 172.21.15.49:0/2337076438 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f079006c860 con 0x7f0790064350 2023-11-30T17:23:23.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.615+0000 7f0786ffd700 1 -- 172.21.15.49:0/2337076438 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0780003040 con 0x7f0790064350 2023-11-30T17:23:23.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.615+0000 7f0786ffd700 1 --2- 172.21.15.49:0/2337076438 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f077005f270 0x7f0770061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:23.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.615+0000 7f0786ffd700 1 -- 172.21.15.49:0/2337076438 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5856+0+0 (secure 0 0 0) 0x7f078007b690 con 0x7f0790064350 2023-11-30T17:23:23.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.615+0000 7f078e7fc700 1 --2- 172.21.15.49:0/2337076438 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f077005f270 0x7f0770061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:23.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.616+0000 7f078e7fc700 1 --2- 172.21.15.49:0/2337076438 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f077005f270 0x7f0770061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f07900ab960 tx=0x7f0778008040).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:23.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.619+0000 7f0786ffd700 1 -- 172.21.15.49:0/2337076438 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f078004c8f0 con 0x7f0790064350 2023-11-30T17:23:23.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.796+0000 7f07957f7700 1 -- 172.21.15.49:0/2337076438 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f07900c6c80 con 0x7f0790064350 2023-11-30T17:23:23.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.800+0000 7f0786ffd700 1 -- 172.21.15.49:0/2337076438 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v16) v1 ==== 104+0+0 (secure 0 0 0) 0x7f07800230a0 con 0x7f0790064350 2023-11-30T17:23:23.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.802+0000 7f07957f7700 1 -- 172.21.15.49:0/2337076438 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f077005f270 msgr2=0x7f0770061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:23.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.802+0000 7f07957f7700 1 --2- 172.21.15.49:0/2337076438 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f077005f270 0x7f0770061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f07900ab960 tx=0x7f0778008040).stop 2023-11-30T17:23:23.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.802+0000 7f07957f7700 1 -- 172.21.15.49:0/2337076438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0790064350 msgr2=0x7f079013ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:23.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.802+0000 7f07957f7700 1 --2- 172.21.15.49:0/2337076438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0790064350 0x7f079013ce30 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7f078000b6c0 tx=0x7f0780009840).stop 2023-11-30T17:23:23.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.802+0000 7f07957f7700 1 -- 172.21.15.49:0/2337076438 shutdown_connections 2023-11-30T17:23:23.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.802+0000 7f07957f7700 1 --2- 172.21.15.49:0/2337076438 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07900c6190 0x7f07900aad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:23.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.802+0000 7f07957f7700 1 --2- 172.21.15.49:0/2337076438 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f077005f270 0x7f0770061730 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:23.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.802+0000 7f07957f7700 1 --2- 172.21.15.49:0/2337076438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0790064350 0x7f079013ce30 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:23.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.802+0000 7f07957f7700 1 --2- 172.21.15.49:0/2337076438 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0790098d10 0x7f07900a9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:23.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.802+0000 7f07957f7700 1 -- 172.21.15.49:0/2337076438 >> 172.21.15.49:0/2337076438 conn(0x7f07900cb310 msgr2=0x7f0790063990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:23.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.802+0000 7f07957f7700 1 -- 172.21.15.49:0/2337076438 shutdown_connections 2023-11-30T17:23:23.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.802+0000 7f07957f7700 1 -- 172.21.15.49:0/2337076438 wait complete. 2023-11-30T17:23:23.816 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-11-30T17:23:23.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.934+0000 7f8b1b746700 1 Processor -- start 2023-11-30T17:23:23.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.934+0000 7f8b1b746700 1 -- start start 2023-11-30T17:23:23.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.935+0000 7f8b1b746700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b140a8280 0x7f8b140a8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:23.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.935+0000 7f8b1b746700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b14067770 con 0x7f8b14158160 2023-11-30T17:23:23.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.935+0000 7f8b1b746700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b140be8d0 con 0x7f8b1414e600 2023-11-30T17:23:23.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.935+0000 7f8b1b746700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b14159180 con 0x7f8b140a8280 2023-11-30T17:23:23.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.935+0000 7f8b18ce1700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8b14158160 0x7f8b14155500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48478/0 (socket says 172.21.15.49:48478) 2023-11-30T17:23:23.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.935+0000 7f8b18ce1700 1 -- 172.21.15.49:0/543842990 learned_addr learned my addr 172.21.15.49:0/543842990 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:23.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.935+0000 7f8b194e2700 1 --2- 172.21.15.49:0/543842990 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b140a8280 0x7f8b140a8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:23.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.935+0000 7f8b13fff700 1 -- 172.21.15.49:0/543842990 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3824302335 0 0) 0x7f8b14067770 con 0x7f8b14158160 2023-11-30T17:23:23.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.935+0000 7f8b13fff700 1 -- 172.21.15.49:0/543842990 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8afc0033f0 con 0x7f8b14158160 2023-11-30T17:23:23.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.935+0000 7f8b13fff700 1 -- 172.21.15.49:0/543842990 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928359554 0 0) 0x7f8b140be8d0 con 0x7f8b1414e600 2023-11-30T17:23:23.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.935+0000 7f8b13fff700 1 -- 172.21.15.49:0/543842990 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b14067770 con 0x7f8b1414e600 2023-11-30T17:23:23.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.935+0000 7f8b13fff700 1 -- 172.21.15.49:0/543842990 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3032056238 0 0) 0x7f8afc0033f0 con 0x7f8b14158160 2023-11-30T17:23:23.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.935+0000 7f8b13fff700 1 -- 172.21.15.49:0/543842990 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b140a8280 msgr2=0x7f8b140a8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:23.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.935+0000 7f8b13fff700 1 --2- 172.21.15.49:0/543842990 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b140a8280 0x7f8b140a8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:23.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.935+0000 7f8b13fff700 1 -- 172.21.15.49:0/543842990 >> v1:172.21.15.115:6789/0 conn(0x7f8b1414e600 legacy=0x7f8b1414eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:23.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.935+0000 7f8b13fff700 1 -- 172.21.15.49:0/543842990 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b14158600 con 0x7f8b14158160 2023-11-30T17:23:23.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.935+0000 7f8b13fff700 1 -- 172.21.15.49:0/543842990 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f8b08001470 con 0x7f8b14158160 2023-11-30T17:23:23.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.936+0000 7f8b13fff700 1 -- 172.21.15.49:0/543842990 >> v1:172.21.15.49:6789/0 conn(0x7f8b14158160 legacy=0x7f8b14155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:23.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.936+0000 7f8b13fff700 1 --2- 172.21.15.49:0/543842990 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b140a8280 0x7f8afc003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:23.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.936+0000 7f8b13fff700 1 --2- 172.21.15.49:0/543842990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8afc003fb0 0x7f8afc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:23.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.936+0000 7f8b13fff700 1 --2- 172.21.15.49:0/543842990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8afc004b80 0x7f8afc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:23.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.936+0000 7f8b13fff700 1 -- 172.21.15.49:0/543842990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b14159180 con 0x7f8afc003fb0 2023-11-30T17:23:23.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.936+0000 7f8b13fff700 1 -- 172.21.15.49:0/543842990 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc00b990 con 0x7f8afc004b80 2023-11-30T17:23:23.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.936+0000 7f8b13fff700 1 -- 172.21.15.49:0/543842990 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc00bb50 con 0x7f8b140a8280 2023-11-30T17:23:23.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.936+0000 7f8b18ce1700 1 --2- 172.21.15.49:0/543842990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8afc003fb0 0x7f8afc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:23.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.936+0000 7f8b194e2700 1 --2- 172.21.15.49:0/543842990 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b140a8280 0x7f8afc003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:23.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.936+0000 7f8b19ce3700 1 --2- 172.21.15.49:0/543842990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8afc004b80 0x7f8afc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:23.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.936+0000 7f8b18ce1700 1 -- 172.21.15.49:0/543842990 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b140a8280 msgr2=0x7f8afc003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:23.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.936+0000 7f8b18ce1700 1 --2- 172.21.15.49:0/543842990 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b140a8280 0x7f8afc003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:23.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.936+0000 7f8b18ce1700 1 -- 172.21.15.49:0/543842990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8afc004b80 msgr2=0x7f8afc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:23.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.936+0000 7f8b18ce1700 1 --2- 172.21.15.49:0/543842990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8afc004b80 0x7f8afc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:23.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.936+0000 7f8b18ce1700 1 -- 172.21.15.49:0/543842990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8afc0033f0 con 0x7f8afc003fb0 2023-11-30T17:23:23.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.936+0000 7f8b18ce1700 1 --2- 172.21.15.49:0/543842990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8afc003fb0 0x7f8afc004690 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f8b0800c0e0 tx=0x7f8b140bea60).ready entity=mon.0 client_cookie=bccd1740863188ff server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:23.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.936+0000 7f8b13fff700 1 -- 172.21.15.49:0/543842990 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0800c9b0 con 0x7f8afc003fb0 2023-11-30T17:23:23.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.936+0000 7f8b13fff700 1 -- 172.21.15.49:0/543842990 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0800cb10 con 0x7f8afc003fb0 2023-11-30T17:23:23.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.936+0000 7f8b13fff700 1 -- 172.21.15.49:0/543842990 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b080070d0 con 0x7f8afc003fb0 2023-11-30T17:23:23.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.937+0000 7f8b1b746700 1 -- 172.21.15.49:0/543842990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8afc003fb0 msgr2=0x7f8afc004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:23.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.937+0000 7f8b1b746700 1 --2- 172.21.15.49:0/543842990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8afc003fb0 0x7f8afc004690 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f8b0800c0e0 tx=0x7f8b140bea60).stop 2023-11-30T17:23:23.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.937+0000 7f8b19ce3700 1 -- 172.21.15.49:0/543842990 reap_dead start 2023-11-30T17:23:23.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.937+0000 7f8b1b746700 1 -- 172.21.15.49:0/543842990 shutdown_connections 2023-11-30T17:23:23.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.937+0000 7f8b1b746700 1 -- 172.21.15.49:0/543842990 >> 172.21.15.49:0/543842990 conn(0x7f8b14062700 msgr2=0x7f8b14062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:23.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.937+0000 7f8b1b746700 1 -- 172.21.15.49:0/543842990 shutdown_connections 2023-11-30T17:23:23.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.937+0000 7f8b1b746700 1 -- 172.21.15.49:0/543842990 wait complete. 2023-11-30T17:23:23.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.938+0000 7f8b1b746700 1 Processor -- start 2023-11-30T17:23:23.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.938+0000 7f8b1b746700 1 -- start start 2023-11-30T17:23:23.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.939+0000 7f8b1b746700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8afc003fb0 0x7f8b140c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:23.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.939+0000 7f8b1b746700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b140ac7d0 0x7f8b1414cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:23.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.939+0000 7f8b1b746700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b14064cf0 0x7f8b14065150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:23.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.939+0000 7f8b1b746700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b140c24e0 con 0x7f8b14064cf0 2023-11-30T17:23:23.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.939+0000 7f8b1b746700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b140c2190 con 0x7f8afc003fb0 2023-11-30T17:23:23.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.939+0000 7f8b1b746700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b14065640 con 0x7f8b140ac7d0 2023-11-30T17:23:23.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.939+0000 7f8b19ce3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b14064cf0 0x7f8b14065150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:23.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.939+0000 7f8b19ce3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b14064cf0 0x7f8b14065150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58610/0 (socket says 172.21.15.49:58610) 2023-11-30T17:23:23.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.939+0000 7f8b19ce3700 1 -- 172.21.15.49:0/1845957719 learned_addr learned my addr 172.21.15.49:0/1845957719 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:23.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.939+0000 7f8b18ce1700 1 --2- 172.21.15.49:0/1845957719 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b140ac7d0 0x7f8b1414cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:23.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.939+0000 7f8b194e2700 1 --2- 172.21.15.49:0/1845957719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8afc003fb0 0x7f8b140c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:23.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.939+0000 7f8b19ce3700 1 -- 172.21.15.49:0/1845957719 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b140ac7d0 msgr2=0x7f8b1414cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:23.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.939+0000 7f8b19ce3700 1 --2- 172.21.15.49:0/1845957719 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b140ac7d0 0x7f8b1414cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:23.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.939+0000 7f8b19ce3700 1 -- 172.21.15.49:0/1845957719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8afc003fb0 msgr2=0x7f8b140c57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:23.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.939+0000 7f8b19ce3700 1 --2- 172.21.15.49:0/1845957719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8afc003fb0 0x7f8b140c57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:23.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.939+0000 7f8b19ce3700 1 -- 172.21.15.49:0/1845957719 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b140c1580 con 0x7f8b14064cf0 2023-11-30T17:23:23.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.939+0000 7f8b194e2700 1 --2- 172.21.15.49:0/1845957719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8afc003fb0 0x7f8b140c57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:23:23.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.940+0000 7f8b19ce3700 1 --2- 172.21.15.49:0/1845957719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b14064cf0 0x7f8b14065150 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7f8b14154b90 tx=0x7f8b04007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:23.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.940+0000 7f8b117fa700 1 -- 172.21.15.49:0/1845957719 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0400eea0 con 0x7f8b14064cf0 2023-11-30T17:23:23.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.940+0000 7f8b117fa700 1 -- 172.21.15.49:0/1845957719 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b040040d0 con 0x7f8b14064cf0 2023-11-30T17:23:23.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.940+0000 7f8b1b746700 1 -- 172.21.15.49:0/1845957719 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b140c1860 con 0x7f8b14064cf0 2023-11-30T17:23:23.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.940+0000 7f8b117fa700 1 -- 172.21.15.49:0/1845957719 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0400ca00 con 0x7f8b14064cf0 2023-11-30T17:23:23.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.940+0000 7f8b1b746700 1 -- 172.21.15.49:0/1845957719 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b140c1e20 con 0x7f8b14064cf0 2023-11-30T17:23:23.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.941+0000 7f8b1b746700 1 -- 172.21.15.49:0/1845957719 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b140c2320 con 0x7f8b14064cf0 2023-11-30T17:23:23.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.941+0000 7f8b117fa700 1 -- 172.21.15.49:0/1845957719 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8b04014430 con 0x7f8b14064cf0 2023-11-30T17:23:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.942+0000 7f8b117fa700 1 --2- 172.21.15.49:0/1845957719 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8b0005f270 0x7f8b00061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.942+0000 7f8b117fa700 1 -- 172.21.15.49:0/1845957719 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5856+0+0 (secure 0 0 0) 0x7f8b04079bc0 con 0x7f8b14064cf0 2023-11-30T17:23:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.942+0000 7f8b194e2700 1 --2- 172.21.15.49:0/1845957719 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8b0005f270 0x7f8b00061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.942+0000 7f8b194e2700 1 --2- 172.21.15.49:0/1845957719 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8b0005f270 0x7f8b00061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f8b0c006c40 tx=0x7f8b0c008040).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:23.946+0000 7f8b117fa700 1 -- 172.21.15.49:0/1845957719 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8b04049b00 con 0x7f8b14064cf0 2023-11-30T17:23:24.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.121+0000 7f8b1b746700 1 -- 172.21.15.49:0/1845957719 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f8b1406c860 con 0x7f8b14064cf0 2023-11-30T17:23:24.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.124+0000 7f8b117fa700 1 -- 172.21.15.49:0/1845957719 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v17) v1 ==== 120+0+0 (secure 0 0 0) 0x7f8b0404adc0 con 0x7f8b14064cf0 2023-11-30T17:23:24.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.126+0000 7f8b1b746700 1 -- 172.21.15.49:0/1845957719 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8b0005f270 msgr2=0x7f8b00061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:24.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.126+0000 7f8b1b746700 1 --2- 172.21.15.49:0/1845957719 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8b0005f270 0x7f8b00061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f8b0c006c40 tx=0x7f8b0c008040).stop 2023-11-30T17:23:24.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.126+0000 7f8b1b746700 1 -- 172.21.15.49:0/1845957719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b14064cf0 msgr2=0x7f8b14065150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:24.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.126+0000 7f8b1b746700 1 --2- 172.21.15.49:0/1845957719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b14064cf0 0x7f8b14065150 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7f8b14154b90 tx=0x7f8b04007f30).stop 2023-11-30T17:23:24.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.126+0000 7f8b1b746700 1 -- 172.21.15.49:0/1845957719 shutdown_connections 2023-11-30T17:23:24.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.126+0000 7f8b1b746700 1 --2- 172.21.15.49:0/1845957719 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8b0005f270 0x7f8b00061730 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:24.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.126+0000 7f8b1b746700 1 --2- 172.21.15.49:0/1845957719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b14064cf0 0x7f8b14065150 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:24.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.126+0000 7f8b1b746700 1 --2- 172.21.15.49:0/1845957719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8afc003fb0 0x7f8b140c57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:24.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.126+0000 7f8b1b746700 1 --2- 172.21.15.49:0/1845957719 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b140ac7d0 0x7f8b1414cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:24.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.126+0000 7f8b1b746700 1 -- 172.21.15.49:0/1845957719 >> 172.21.15.49:0/1845957719 conn(0x7f8b14062700 msgr2=0x7f8b140c7250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:24.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.126+0000 7f8b1b746700 1 -- 172.21.15.49:0/1845957719 shutdown_connections 2023-11-30T17:23:24.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.126+0000 7f8b1b746700 1 -- 172.21.15.49:0/1845957719 wait complete. 2023-11-30T17:23:24.140 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-11-30T17:23:24.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.256+0000 7f14f979f700 1 Processor -- start 2023-11-30T17:23:24.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.256+0000 7f14f979f700 1 -- start start 2023-11-30T17:23:24.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.257+0000 7f14f979f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14f40c0180 0x7f14f4157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:24.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.257+0000 7f14f979f700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f14f40c1750 0x7f14f40c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:24.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.257+0000 7f14f979f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14f40c12c0 con 0x7f14f4157660 2023-11-30T17:23:24.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.257+0000 7f14f979f700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14f40c06b0 con 0x7f14f40c1750 2023-11-30T17:23:24.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.257+0000 7f14f979f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14f40c0990 con 0x7f14f40c0180 2023-11-30T17:23:24.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.257+0000 7f14f3fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f14f4157660 0x7f14f41589c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48494/0 (socket says 172.21.15.49:48494) 2023-11-30T17:23:24.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.257+0000 7f14f3fff700 1 -- 172.21.15.49:0/4239914466 learned_addr learned my addr 172.21.15.49:0/4239914466 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:24.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.257+0000 7f14f37fe700 1 --2- 172.21.15.49:0/4239914466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14f40c0180 0x7f14f4157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:24.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.257+0000 7f14f8f9e700 1 --2- 172.21.15.49:0/4239914466 >> v2:172.21.15.115:3300/0 conn(0x7f14f40c1750 0x7f14f40c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:24.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.257+0000 7f14f2ffd700 1 -- 172.21.15.49:0/4239914466 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 925224372 0 0) 0x7f14f40c12c0 con 0x7f14f4157660 2023-11-30T17:23:24.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.257+0000 7f14f2ffd700 1 -- 172.21.15.49:0/4239914466 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14dc0033f0 con 0x7f14f4157660 2023-11-30T17:23:24.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.258+0000 7f14f2ffd700 1 -- 172.21.15.49:0/4239914466 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4079896011 0 0) 0x7f14dc0033f0 con 0x7f14f4157660 2023-11-30T17:23:24.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.258+0000 7f14f8f9e700 1 -- 172.21.15.49:0/4239914466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14f40c0180 msgr2=0x7f14f4157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:24.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.258+0000 7f14f8f9e700 1 --2- 172.21.15.49:0/4239914466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14f40c0180 0x7f14f4157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:24.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.258+0000 7f14f8f9e700 1 -- 172.21.15.49:0/4239914466 >> v1:172.21.15.49:6789/0 conn(0x7f14f4157660 legacy=0x7f14f41589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:24.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.258+0000 7f14f8f9e700 1 -- 172.21.15.49:0/4239914466 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f40c0c70 con 0x7f14f40c1750 2023-11-30T17:23:24.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.258+0000 7f14f37fe700 1 --2- 172.21.15.49:0/4239914466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14f40c0180 0x7f14f4157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:23:24.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.258+0000 7f14f8f9e700 1 --2- 172.21.15.49:0/4239914466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14f40c1750 0x7f14f40c1ba0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f14ec009e60 tx=0x7f14ec009780).ready entity=mon.1 client_cookie=48855719321e4936 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:24.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.258+0000 7f14f2ffd700 1 -- 172.21.15.49:0/4239914466 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec00e070 con 0x7f14f40c1750 2023-11-30T17:23:24.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.258+0000 7f14f2ffd700 1 -- 172.21.15.49:0/4239914466 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ec00b7a0 con 0x7f14f40c1750 2023-11-30T17:23:24.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.258+0000 7f14f2ffd700 1 -- 172.21.15.49:0/4239914466 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e8001470 con 0x7f14f40c1750 2023-11-30T17:23:24.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.258+0000 7f14f979f700 1 -- 172.21.15.49:0/4239914466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14f40c1750 msgr2=0x7f14f40c1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:24.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.258+0000 7f14f979f700 1 --2- 172.21.15.49:0/4239914466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14f40c1750 0x7f14f40c1ba0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f14ec009e60 tx=0x7f14ec009780).stop 2023-11-30T17:23:24.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.259+0000 7f14f979f700 1 -- 172.21.15.49:0/4239914466 shutdown_connections 2023-11-30T17:23:24.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.259+0000 7f14f979f700 1 --2- 172.21.15.49:0/4239914466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14f40c1750 0x7f14f40c1ba0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:24.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.259+0000 7f14f979f700 1 --2- 172.21.15.49:0/4239914466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14f40c0180 0x7f14f4157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:24.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.259+0000 7f14f979f700 1 -- 172.21.15.49:0/4239914466 >> 172.21.15.49:0/4239914466 conn(0x7f14f40cb000 msgr2=0x7f14f40cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:24.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.259+0000 7f14f979f700 1 -- 172.21.15.49:0/4239914466 shutdown_connections 2023-11-30T17:23:24.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.259+0000 7f14f979f700 1 -- 172.21.15.49:0/4239914466 wait complete. 2023-11-30T17:23:24.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.260+0000 7f14f979f700 1 Processor -- start 2023-11-30T17:23:24.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.260+0000 7f14f979f700 1 -- start start 2023-11-30T17:23:24.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.260+0000 7f14f979f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14f40c0180 0x7f14f4151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:24.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.261+0000 7f14f979f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14f40c1750 0x7f14f40adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:24.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.261+0000 7f14f979f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14f4157660 0x7f14f40ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:24.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.261+0000 7f14f979f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f40ae990 con 0x7f14f4157660 2023-11-30T17:23:24.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.261+0000 7f14f979f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f40c2b40 con 0x7f14f40c1750 2023-11-30T17:23:24.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.261+0000 7f14f979f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14f40c3100 con 0x7f14f40c0180 2023-11-30T17:23:24.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.261+0000 7f14f8f9e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14f4157660 0x7f14f40ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:24.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.261+0000 7f14f8f9e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14f4157660 0x7f14f40ae4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58626/0 (socket says 172.21.15.49:58626) 2023-11-30T17:23:24.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.261+0000 7f14f8f9e700 1 -- 172.21.15.49:0/1401393686 learned_addr learned my addr 172.21.15.49:0/1401393686 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:24.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.261+0000 7f14f3fff700 1 --2- 172.21.15.49:0/1401393686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14f40c0180 0x7f14f4151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:24.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.261+0000 7f14f37fe700 1 --2- 172.21.15.49:0/1401393686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14f40c1750 0x7f14f40adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:24.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.261+0000 7f14f8f9e700 1 -- 172.21.15.49:0/1401393686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14f40c0180 msgr2=0x7f14f4151530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:24.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.261+0000 7f14f8f9e700 1 --2- 172.21.15.49:0/1401393686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14f40c0180 0x7f14f4151530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:24.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.261+0000 7f14f8f9e700 1 -- 172.21.15.49:0/1401393686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14f40c1750 msgr2=0x7f14f40adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:24.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.261+0000 7f14f8f9e700 1 --2- 172.21.15.49:0/1401393686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14f40c1750 0x7f14f40adfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:24.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.261+0000 7f14f8f9e700 1 -- 172.21.15.49:0/1401393686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e40092a0 con 0x7f14f4157660 2023-11-30T17:23:24.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.261+0000 7f14f8f9e700 1 --2- 172.21.15.49:0/1401393686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14f4157660 0x7f14f40ae4a0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f14f4084570 tx=0x7f14ec009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:24.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.261+0000 7f14dbfff700 1 -- 172.21.15.49:0/1401393686 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec007040 con 0x7f14f4157660 2023-11-30T17:23:24.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.261+0000 7f14dbfff700 1 -- 172.21.15.49:0/1401393686 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ec01d420 con 0x7f14f4157660 2023-11-30T17:23:24.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.261+0000 7f14f979f700 1 -- 172.21.15.49:0/1401393686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14ec009a20 con 0x7f14f4157660 2023-11-30T17:23:24.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.261+0000 7f14dbfff700 1 -- 172.21.15.49:0/1401393686 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec01d7e0 con 0x7f14f4157660 2023-11-30T17:23:24.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.261+0000 7f14f979f700 1 -- 172.21.15.49:0/1401393686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f40b0e10 con 0x7f14f4157660 2023-11-30T17:23:24.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.262+0000 7f14f979f700 1 -- 172.21.15.49:0/1401393686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14f40c32b0 con 0x7f14f4157660 2023-11-30T17:23:24.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.263+0000 7f14dbfff700 1 -- 172.21.15.49:0/1401393686 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f14ec01db90 con 0x7f14f4157660 2023-11-30T17:23:24.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.263+0000 7f14dbfff700 1 --2- 172.21.15.49:0/1401393686 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f14e005f270 0x7f14e0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:24.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.263+0000 7f14dbfff700 1 -- 172.21.15.49:0/1401393686 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5856+0+0 (secure 0 0 0) 0x7f14ec07bd60 con 0x7f14f4157660 2023-11-30T17:23:24.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.263+0000 7f14f3fff700 1 --2- 172.21.15.49:0/1401393686 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f14e005f270 0x7f14e0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:24.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.264+0000 7f14f3fff700 1 --2- 172.21.15.49:0/1401393686 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f14e005f270 0x7f14e0061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f14e80011e0 tx=0x7f14e8009040).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:24.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.267+0000 7f14dbfff700 1 -- 172.21.15.49:0/1401393686 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f14f40c32b0 con 0x7f14f4157660 2023-11-30T17:23:24.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:24.508+0000 7f14f979f700 1 -- 172.21.15.49:0/1401393686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7f14f40c3270 con 0x7f14f4157660 2023-11-30T17:23:25.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.471+0000 7f14dbfff700 1 -- 172.21.15.49:0/1401393686 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v592) v1 ==== 166+0+0 (secure 0 0 0) 0x7f14ec050ad0 con 0x7f14f4157660 2023-11-30T17:23:25.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.473+0000 7f14f979f700 1 -- 172.21.15.49:0/1401393686 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f14e005f270 msgr2=0x7f14e0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:25.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.473+0000 7f14f979f700 1 --2- 172.21.15.49:0/1401393686 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f14e005f270 0x7f14e0061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f14e80011e0 tx=0x7f14e8009040).stop 2023-11-30T17:23:25.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.473+0000 7f14f979f700 1 -- 172.21.15.49:0/1401393686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14f4157660 msgr2=0x7f14f40ae4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:25.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.473+0000 7f14f979f700 1 --2- 172.21.15.49:0/1401393686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14f4157660 0x7f14f40ae4a0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f14f4084570 tx=0x7f14ec009780).stop 2023-11-30T17:23:25.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.473+0000 7f14f979f700 1 -- 172.21.15.49:0/1401393686 shutdown_connections 2023-11-30T17:23:25.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.473+0000 7f14f979f700 1 --2- 172.21.15.49:0/1401393686 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f14e005f270 0x7f14e0061730 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:25.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.473+0000 7f14f979f700 1 --2- 172.21.15.49:0/1401393686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14f4157660 0x7f14f40ae4a0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:25.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.473+0000 7f14f979f700 1 --2- 172.21.15.49:0/1401393686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14f40c0180 0x7f14f4151530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:25.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.473+0000 7f14f979f700 1 --2- 172.21.15.49:0/1401393686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14f40c1750 0x7f14f40adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:25.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.473+0000 7f14f979f700 1 -- 172.21.15.49:0/1401393686 >> 172.21.15.49:0/1401393686 conn(0x7f14f40cb000 msgr2=0x7f14f40aa090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:25.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.474+0000 7f14f979f700 1 -- 172.21.15.49:0/1401393686 shutdown_connections 2023-11-30T17:23:25.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.474+0000 7f14f979f700 1 -- 172.21.15.49:0/1401393686 wait complete. 2023-11-30T17:23:25.490 INFO:tasks.cephfs_test_runner:Test listing snap schedules on a non-existing filesystem path failure ... ok 2023-11-30T17:23:25.490 INFO:tasks.cephfs_test_runner:Starting test: test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that a non-existent path leads to schedule deactivation after a few retries. 2023-11-30T17:23:25.490 INFO:tasks.cephfs_test_runner:test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-11-30T17:23:25.490 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-11-30T17:23:25.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.610+0000 7fae989a2700 1 Processor -- start 2023-11-30T17:23:25.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.610+0000 7fae989a2700 1 -- start start 2023-11-30T17:23:25.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.611+0000 7fae989a2700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fae94157660 0x7fae94157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:25.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.611+0000 7fae989a2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae940c0180 0x7fae941589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:25.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.611+0000 7fae989a2700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae940c12c0 con 0x7fae940c1750 2023-11-30T17:23:25.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.611+0000 7fae989a2700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae940c06b0 con 0x7fae94157660 2023-11-30T17:23:25.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.611+0000 7fae989a2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae940c0990 con 0x7fae940c0180 2023-11-30T17:23:25.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.611+0000 7fae937fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fae94157660 0x7fae94157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:25.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.611+0000 7fae937fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fae94157660 0x7fae94157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:59978/0 (socket says 172.21.15.49:59978) 2023-11-30T17:23:25.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.611+0000 7fae93fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fae940c1750 0x7fae940648d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:50832/0 (socket says 172.21.15.49:50832) 2023-11-30T17:23:25.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.611+0000 7fae937fe700 1 -- 172.21.15.49:0/2511301774 learned_addr learned my addr 172.21.15.49:0/2511301774 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:25.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.611+0000 7fae92ffd700 1 --2- 172.21.15.49:0/2511301774 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae940c0180 0x7fae941589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:25.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.612+0000 7fae937fe700 1 -- 172.21.15.49:0/2511301774 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae940c0180 msgr2=0x7fae941589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:25.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.612+0000 7fae937fe700 1 --2- 172.21.15.49:0/2511301774 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae940c0180 0x7fae941589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:25.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.612+0000 7fae937fe700 1 -- 172.21.15.49:0/2511301774 >> v1:172.21.15.115:6789/0 conn(0x7fae940c1750 legacy=0x7fae940648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:25.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.612+0000 7fae937fe700 1 -- 172.21.15.49:0/2511301774 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae940c0c70 con 0x7fae94157660 2023-11-30T17:23:25.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.612+0000 7fae92ffd700 1 --2- 172.21.15.49:0/2511301774 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae940c0180 0x7fae941589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:23:25.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.612+0000 7fae927fc700 1 -- 172.21.15.49:0/2511301774 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1207641460 0 0) 0x7fae940c12c0 con 0x7fae940c1750 2023-11-30T17:23:25.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.612+0000 7fae937fe700 1 --2- 172.21.15.49:0/2511301774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae94157660 0x7fae94157a40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7fae84006fd0 tx=0x7fae840090f0).ready entity=mon.1 client_cookie=ea55796079d539e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:25.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.612+0000 7fae927fc700 1 -- 172.21.15.49:0/2511301774 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8400b580 con 0x7fae94157660 2023-11-30T17:23:25.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.612+0000 7fae927fc700 1 -- 172.21.15.49:0/2511301774 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8400b6e0 con 0x7fae94157660 2023-11-30T17:23:25.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.612+0000 7fae927fc700 1 -- 172.21.15.49:0/2511301774 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8400ba60 con 0x7fae94157660 2023-11-30T17:23:25.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.612+0000 7fae989a2700 1 -- 172.21.15.49:0/2511301774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae94157660 msgr2=0x7fae94157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:25.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.612+0000 7fae989a2700 1 --2- 172.21.15.49:0/2511301774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae94157660 0x7fae94157a40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7fae84006fd0 tx=0x7fae840090f0).stop 2023-11-30T17:23:25.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.612+0000 7fae989a2700 1 -- 172.21.15.49:0/2511301774 shutdown_connections 2023-11-30T17:23:25.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.612+0000 7fae989a2700 1 --2- 172.21.15.49:0/2511301774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae94157660 0x7fae94157a40 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:25.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.612+0000 7fae989a2700 1 --2- 172.21.15.49:0/2511301774 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae940c0180 0x7fae941589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:25.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.612+0000 7fae989a2700 1 -- 172.21.15.49:0/2511301774 >> 172.21.15.49:0/2511301774 conn(0x7fae940cb000 msgr2=0x7fae940cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:25.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.613+0000 7fae989a2700 1 -- 172.21.15.49:0/2511301774 shutdown_connections 2023-11-30T17:23:25.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.613+0000 7fae989a2700 1 -- 172.21.15.49:0/2511301774 wait complete. 2023-11-30T17:23:25.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.614+0000 7fae989a2700 1 Processor -- start 2023-11-30T17:23:25.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.614+0000 7fae989a2700 1 -- start start 2023-11-30T17:23:25.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.614+0000 7fae989a2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae940c0180 0x7fae94144d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:25.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.614+0000 7fae989a2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae940c1750 0x7fae940c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:25.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.614+0000 7fae989a2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae94157660 0x7fae940a9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:25.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.615+0000 7fae989a2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae94154740 con 0x7fae94157660 2023-11-30T17:23:25.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.615+0000 7fae989a2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae94145200 con 0x7fae940c1750 2023-11-30T17:23:25.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.615+0000 7fae989a2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae940c2d40 con 0x7fae940c0180 2023-11-30T17:23:25.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.615+0000 7fae93fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae94157660 0x7fae940a9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:25.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.615+0000 7fae93fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae94157660 0x7fae940a9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58628/0 (socket says 172.21.15.49:58628) 2023-11-30T17:23:25.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.615+0000 7fae93fff700 1 -- 172.21.15.49:0/1204776723 learned_addr learned my addr 172.21.15.49:0/1204776723 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:25.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.615+0000 7fae92ffd700 1 --2- 172.21.15.49:0/1204776723 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae940c1750 0x7fae940c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:25.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.615+0000 7fae937fe700 1 --2- 172.21.15.49:0/1204776723 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae940c0180 0x7fae94144d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:25.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.615+0000 7fae93fff700 1 -- 172.21.15.49:0/1204776723 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae940c0180 msgr2=0x7fae94144d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:25.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.615+0000 7fae93fff700 1 --2- 172.21.15.49:0/1204776723 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae940c0180 0x7fae94144d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:25.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.615+0000 7fae93fff700 1 -- 172.21.15.49:0/1204776723 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae940c1750 msgr2=0x7fae940c1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:25.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.615+0000 7fae93fff700 1 --2- 172.21.15.49:0/1204776723 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae940c1750 0x7fae940c1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:25.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.615+0000 7fae93fff700 1 -- 172.21.15.49:0/1204776723 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae880092a0 con 0x7fae94157660 2023-11-30T17:23:25.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.615+0000 7fae937fe700 1 --2- 172.21.15.49:0/1204776723 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae940c0180 0x7fae94144d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:23:25.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.615+0000 7fae93fff700 1 --2- 172.21.15.49:0/1204776723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae94157660 0x7fae940a9e70 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7fae8c00c810 tx=0x7fae8c007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:25.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.615+0000 7fae7b7fe700 1 -- 172.21.15.49:0/1204776723 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8c005c70 con 0x7fae94157660 2023-11-30T17:23:25.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.615+0000 7fae989a2700 1 -- 172.21.15.49:0/1204776723 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae84009370 con 0x7fae94157660 2023-11-30T17:23:25.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.615+0000 7fae7b7fe700 1 -- 172.21.15.49:0/1204776723 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8c005dd0 con 0x7fae94157660 2023-11-30T17:23:25.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.615+0000 7fae7b7fe700 1 -- 172.21.15.49:0/1204776723 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8c007360 con 0x7fae94157660 2023-11-30T17:23:25.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.615+0000 7fae989a2700 1 -- 172.21.15.49:0/1204776723 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae940c2780 con 0x7fae94157660 2023-11-30T17:23:25.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.616+0000 7fae989a2700 1 -- 172.21.15.49:0/1204776723 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae94154510 con 0x7fae94157660 2023-11-30T17:23:25.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.617+0000 7fae7b7fe700 1 -- 172.21.15.49:0/1204776723 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fae8c0077d0 con 0x7fae94157660 2023-11-30T17:23:25.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.617+0000 7fae7b7fe700 1 --2- 172.21.15.49:0/1204776723 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fae8005f270 0x7fae80061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:25.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.617+0000 7fae7b7fe700 1 -- 172.21.15.49:0/1204776723 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5856+0+0 (secure 0 0 0) 0x7fae8c07a340 con 0x7fae94157660 2023-11-30T17:23:25.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.617+0000 7fae937fe700 1 --2- 172.21.15.49:0/1204776723 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fae8005f270 0x7fae80061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:25.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.618+0000 7fae937fe700 1 --2- 172.21.15.49:0/1204776723 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fae8005f270 0x7fae80061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fae84009130 tx=0x7fae84017000).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:25.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.621+0000 7fae7b7fe700 1 -- 172.21.15.49:0/1204776723 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fae94154510 con 0x7fae94157660 2023-11-30T17:23:25.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:25.862+0000 7fae989a2700 1 -- 172.21.15.49:0/1204776723 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7fae94154510 con 0x7fae94157660 2023-11-30T17:23:26.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.474+0000 7fae7b7fe700 1 -- 172.21.15.49:0/1204776723 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v593) v1 ==== 186+0+0 (secure 0 0 0) 0x7fae94154510 con 0x7fae94157660 2023-11-30T17:23:26.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.476+0000 7fae989a2700 1 -- 172.21.15.49:0/1204776723 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fae8005f270 msgr2=0x7fae80061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:26.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.476+0000 7fae989a2700 1 --2- 172.21.15.49:0/1204776723 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fae8005f270 0x7fae80061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fae84009130 tx=0x7fae84017000).stop 2023-11-30T17:23:26.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.476+0000 7fae989a2700 1 -- 172.21.15.49:0/1204776723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae94157660 msgr2=0x7fae940a9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:26.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.476+0000 7fae989a2700 1 --2- 172.21.15.49:0/1204776723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae94157660 0x7fae940a9e70 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7fae8c00c810 tx=0x7fae8c007f10).stop 2023-11-30T17:23:26.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.477+0000 7fae989a2700 1 -- 172.21.15.49:0/1204776723 shutdown_connections 2023-11-30T17:23:26.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.477+0000 7fae989a2700 1 --2- 172.21.15.49:0/1204776723 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fae8005f270 0x7fae80061730 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:26.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.477+0000 7fae989a2700 1 --2- 172.21.15.49:0/1204776723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae94157660 0x7fae940a9e70 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:26.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.477+0000 7fae989a2700 1 --2- 172.21.15.49:0/1204776723 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae940c0180 0x7fae94144d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:26.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.477+0000 7fae989a2700 1 --2- 172.21.15.49:0/1204776723 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae940c1750 0x7fae940c1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:26.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.477+0000 7fae989a2700 1 -- 172.21.15.49:0/1204776723 >> 172.21.15.49:0/1204776723 conn(0x7fae940cb000 msgr2=0x7fae9415a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:26.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.477+0000 7fae989a2700 1 -- 172.21.15.49:0/1204776723 shutdown_connections 2023-11-30T17:23:26.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.477+0000 7fae989a2700 1 -- 172.21.15.49:0/1204776723 wait complete. 2023-11-30T17:23:26.494 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-30T17:23:26.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.620+0000 7f491056a700 1 Processor -- start 2023-11-30T17:23:26.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.621+0000 7f491056a700 1 -- start start 2023-11-30T17:23:26.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.622+0000 7f491056a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4908155830 0x7f4908155c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:26.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.622+0000 7f491056a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f49080c3090 0x7f49080c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:26.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.622+0000 7f491056a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49081529c0 con 0x7f4908155030 2023-11-30T17:23:26.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.622+0000 7f491056a700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49081554b0 con 0x7f49080c3090 2023-11-30T17:23:26.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.622+0000 7f491056a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4908151db0 con 0x7f4908155830 2023-11-30T17:23:26.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.622+0000 7f490eb07700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f49080c3090 0x7f49080c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:26.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.622+0000 7f490db05700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4908155030 0x7f49080c2980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48500/0 (socket says 172.21.15.49:48500) 2023-11-30T17:23:26.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.622+0000 7f490db05700 1 -- 172.21.15.49:0/4056575313 learned_addr learned my addr 172.21.15.49:0/4056575313 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:26.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.622+0000 7f490e306700 1 --2- 172.21.15.49:0/4056575313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4908155830 0x7f4908155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:26.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.622+0000 7f490eb07700 1 -- 172.21.15.49:0/4056575313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4908155830 msgr2=0x7f4908155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:26.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.622+0000 7f490eb07700 1 --2- 172.21.15.49:0/4056575313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4908155830 0x7f4908155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:26.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.622+0000 7f490eb07700 1 -- 172.21.15.49:0/4056575313 >> v1:172.21.15.49:6789/0 conn(0x7f4908155030 legacy=0x7f49080c2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:26.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.622+0000 7f490eb07700 1 -- 172.21.15.49:0/4056575313 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4908152090 con 0x7f49080c3090 2023-11-30T17:23:26.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.622+0000 7f490d304700 1 -- 172.21.15.49:0/4056575313 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3836692248 0 0) 0x7f49081529c0 con 0x7f4908155030 2023-11-30T17:23:26.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.622+0000 7f490eb07700 1 --2- 172.21.15.49:0/4056575313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49080c3090 0x7f49080c5ec0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f48f8009760 tx=0x7f48f8009060).ready entity=mon.0 client_cookie=dbaa5f1c2dee858d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:26.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.622+0000 7f490d304700 1 -- 172.21.15.49:0/4056575313 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f80090d0 con 0x7f49080c3090 2023-11-30T17:23:26.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.622+0000 7f490d304700 1 -- 172.21.15.49:0/4056575313 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f800f510 con 0x7f49080c3090 2023-11-30T17:23:26.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.622+0000 7f490d304700 1 -- 172.21.15.49:0/4056575313 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f800f890 con 0x7f49080c3090 2023-11-30T17:23:26.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.623+0000 7f491056a700 1 -- 172.21.15.49:0/4056575313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49080c3090 msgr2=0x7f49080c5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:26.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.623+0000 7f491056a700 1 --2- 172.21.15.49:0/4056575313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49080c3090 0x7f49080c5ec0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f48f8009760 tx=0x7f48f8009060).stop 2023-11-30T17:23:26.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.623+0000 7f491056a700 1 -- 172.21.15.49:0/4056575313 shutdown_connections 2023-11-30T17:23:26.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.623+0000 7f491056a700 1 --2- 172.21.15.49:0/4056575313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49080c3090 0x7f49080c5ec0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:26.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.623+0000 7f491056a700 1 --2- 172.21.15.49:0/4056575313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4908155830 0x7f4908155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:26.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.623+0000 7f491056a700 1 -- 172.21.15.49:0/4056575313 >> 172.21.15.49:0/4056575313 conn(0x7f4908062700 msgr2=0x7f4908062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:26.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.623+0000 7f491056a700 1 -- 172.21.15.49:0/4056575313 shutdown_connections 2023-11-30T17:23:26.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.623+0000 7f491056a700 1 -- 172.21.15.49:0/4056575313 wait complete. 2023-11-30T17:23:26.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.624+0000 7f491056a700 1 Processor -- start 2023-11-30T17:23:26.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.624+0000 7f491056a700 1 -- start start 2023-11-30T17:23:26.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.625+0000 7f491056a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49080c3090 0x7f4908165490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:26.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.625+0000 7f491056a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4908155030 0x7f49081618f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:26.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.625+0000 7f491056a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4908155830 0x7f49080653d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:26.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.625+0000 7f491056a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4908161de0 con 0x7f4908155830 2023-11-30T17:23:26.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.625+0000 7f491056a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49080abf60 con 0x7f49080c3090 2023-11-30T17:23:26.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.625+0000 7f491056a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4908165a70 con 0x7f4908155030 2023-11-30T17:23:26.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.625+0000 7f490eb07700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4908155830 0x7f49080653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:26.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.625+0000 7f490eb07700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4908155830 0x7f49080653d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58654/0 (socket says 172.21.15.49:58654) 2023-11-30T17:23:26.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.625+0000 7f490eb07700 1 -- 172.21.15.49:0/784607791 learned_addr learned my addr 172.21.15.49:0/784607791 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:26.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.625+0000 7f490e306700 1 --2- 172.21.15.49:0/784607791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49080c3090 0x7f4908165490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:26.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.625+0000 7f490db05700 1 --2- 172.21.15.49:0/784607791 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4908155030 0x7f49081618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:26.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.625+0000 7f490eb07700 1 -- 172.21.15.49:0/784607791 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4908155030 msgr2=0x7f49081618f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:26.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.625+0000 7f490eb07700 1 --2- 172.21.15.49:0/784607791 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4908155030 0x7f49081618f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:26.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.625+0000 7f490eb07700 1 -- 172.21.15.49:0/784607791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49080c3090 msgr2=0x7f4908165490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:26.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.625+0000 7f490eb07700 1 --2- 172.21.15.49:0/784607791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49080c3090 0x7f4908165490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:26.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.625+0000 7f490eb07700 1 -- 172.21.15.49:0/784607791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f80092a0 con 0x7f4908155830 2023-11-30T17:23:26.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.625+0000 7f490e306700 1 --2- 172.21.15.49:0/784607791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49080c3090 0x7f4908165490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:23:26.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.625+0000 7f490db05700 1 --2- 172.21.15.49:0/784607791 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4908155030 0x7f49081618f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:23:26.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.625+0000 7f490eb07700 1 --2- 172.21.15.49:0/784607791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4908155830 0x7f49080653d0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7f48f8011000 tx=0x7f48f8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:26.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.626+0000 7f49067fc700 1 -- 172.21.15.49:0/784607791 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f800fe60 con 0x7f4908155830 2023-11-30T17:23:26.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.626+0000 7f49067fc700 1 -- 172.21.15.49:0/784607791 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f801b410 con 0x7f4908155830 2023-11-30T17:23:26.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.626+0000 7f491056a700 1 -- 172.21.15.49:0/784607791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4908165d50 con 0x7f4908155830 2023-11-30T17:23:26.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.626+0000 7f49067fc700 1 -- 172.21.15.49:0/784607791 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f801b7d0 con 0x7f4908155830 2023-11-30T17:23:26.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.626+0000 7f491056a700 1 -- 172.21.15.49:0/784607791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4908166310 con 0x7f4908155830 2023-11-30T17:23:26.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.627+0000 7f491056a700 1 -- 172.21.15.49:0/784607791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49080abd30 con 0x7f4908155830 2023-11-30T17:23:26.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.627+0000 7f49067fc700 1 -- 172.21.15.49:0/784607791 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f48f801bb80 con 0x7f4908155830 2023-11-30T17:23:26.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.627+0000 7f49067fc700 1 --2- 172.21.15.49:0/784607791 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f48f405f270 0x7f48f4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:26.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.627+0000 7f49067fc700 1 -- 172.21.15.49:0/784607791 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5856+0+0 (secure 0 0 0) 0x7f48f807bf00 con 0x7f4908155830 2023-11-30T17:23:26.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.628+0000 7f490e306700 1 --2- 172.21.15.49:0/784607791 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f48f405f270 0x7f48f4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:26.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.628+0000 7f490e306700 1 --2- 172.21.15.49:0/784607791 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f48f405f270 0x7f48f4061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f4900007620 tx=0x7f490000b040).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:26.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.632+0000 7f49067fc700 1 -- 172.21.15.49:0/784607791 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f49080abd30 con 0x7f4908155830 2023-11-30T17:23:26.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.806+0000 7f491056a700 1 -- 172.21.15.49:0/784607791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f49080abd30 con 0x7f4908155830 2023-11-30T17:23:26.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.810+0000 7f49067fc700 1 -- 172.21.15.49:0/784607791 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f49080abd30 con 0x7f4908155830 2023-11-30T17:23:26.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.812+0000 7f491056a700 1 -- 172.21.15.49:0/784607791 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f48f405f270 msgr2=0x7f48f4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:26.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.812+0000 7f491056a700 1 --2- 172.21.15.49:0/784607791 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f48f405f270 0x7f48f4061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f4900007620 tx=0x7f490000b040).stop 2023-11-30T17:23:26.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.812+0000 7f491056a700 1 -- 172.21.15.49:0/784607791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4908155830 msgr2=0x7f49080653d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:26.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.812+0000 7f491056a700 1 --2- 172.21.15.49:0/784607791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4908155830 0x7f49080653d0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7f48f8011000 tx=0x7f48f8017000).stop 2023-11-30T17:23:26.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.812+0000 7f491056a700 1 -- 172.21.15.49:0/784607791 shutdown_connections 2023-11-30T17:23:26.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.812+0000 7f491056a700 1 --2- 172.21.15.49:0/784607791 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f48f405f270 0x7f48f4061730 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:26.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.812+0000 7f491056a700 1 --2- 172.21.15.49:0/784607791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4908155830 0x7f49080653d0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:26.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.812+0000 7f491056a700 1 --2- 172.21.15.49:0/784607791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49080c3090 0x7f4908165490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:26.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.812+0000 7f491056a700 1 --2- 172.21.15.49:0/784607791 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4908155030 0x7f49081618f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:26.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.812+0000 7f491056a700 1 -- 172.21.15.49:0/784607791 >> 172.21.15.49:0/784607791 conn(0x7f4908062700 msgr2=0x7f4908069730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:26.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.812+0000 7f491056a700 1 -- 172.21.15.49:0/784607791 shutdown_connections 2023-11-30T17:23:26.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:26.812+0000 7f491056a700 1 -- 172.21.15.49:0/784607791 wait complete. 2023-11-30T17:23:26.827 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-30T17:23:26.827 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T17:23:26.872 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T17:23:26.915 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-30T17:23:26.915 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-30T17:23:26.915 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:23:27.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.030+0000 7f095e474700 1 Processor -- start 2023-11-30T17:23:27.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.030+0000 7f095e474700 1 -- start start 2023-11-30T17:23:27.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.031+0000 7f095e474700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0958157660 0x7f0958157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:27.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.031+0000 7f095e474700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09580c12c0 con 0x7f09580c0180 2023-11-30T17:23:27.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.031+0000 7f095e474700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09580c06b0 con 0x7f09580c1750 2023-11-30T17:23:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.031+0000 7f095e474700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09580c0990 con 0x7f0958157660 2023-11-30T17:23:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.031+0000 7f095cc71700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f09580c0180 0x7f09581589c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48508/0 (socket says 172.21.15.49:48508) 2023-11-30T17:23:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.031+0000 7f095cc71700 1 -- 172.21.15.49:0/2349516372 learned_addr learned my addr 172.21.15.49:0/2349516372 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.031+0000 7f095d472700 1 --2- 172.21.15.49:0/2349516372 >> v2:172.21.15.115:3300/0 conn(0x7f0958157660 0x7f0958157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.031+0000 7f0957fff700 1 -- 172.21.15.49:0/2349516372 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 157355564 0 0) 0x7f09580c12c0 con 0x7f09580c0180 2023-11-30T17:23:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.031+0000 7f0957fff700 1 -- 172.21.15.49:0/2349516372 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09400033f0 con 0x7f09580c0180 2023-11-30T17:23:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.031+0000 7f0957fff700 1 -- 172.21.15.49:0/2349516372 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1321424107 0 0) 0x7f09400033f0 con 0x7f09580c0180 2023-11-30T17:23:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.031+0000 7f0957fff700 1 -- 172.21.15.49:0/2349516372 >> v2:172.21.15.115:3300/0 conn(0x7f0958157660 msgr2=0x7f0958157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.031+0000 7f0957fff700 1 --2- 172.21.15.49:0/2349516372 >> v2:172.21.15.115:3300/0 conn(0x7f0958157660 0x7f0958157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.032+0000 7f0957fff700 1 -- 172.21.15.49:0/2349516372 >> v1:172.21.15.115:6789/0 conn(0x7f09580c1750 legacy=0x7f09580648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.032+0000 7f0957fff700 1 -- 172.21.15.49:0/2349516372 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09580c0c70 con 0x7f09580c0180 2023-11-30T17:23:27.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.032+0000 7f0957fff700 1 -- 172.21.15.49:0/2349516372 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f094c001470 con 0x7f09580c0180 2023-11-30T17:23:27.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.032+0000 7f0957fff700 1 -- 172.21.15.49:0/2349516372 >> v1:172.21.15.49:6789/0 conn(0x7f09580c0180 legacy=0x7f09581589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:27.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.032+0000 7f0957fff700 1 --2- 172.21.15.49:0/2349516372 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09400038e0 0x7f0940003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:27.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.032+0000 7f0957fff700 1 --2- 172.21.15.49:0/2349516372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0940004690 0x7f0940004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:27.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.032+0000 7f0957fff700 1 --2- 172.21.15.49:0/2349516372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0940005000 0x7f094000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:27.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.032+0000 7f0957fff700 1 -- 172.21.15.49:0/2349516372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09580c0990 con 0x7f0940004690 2023-11-30T17:23:27.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.032+0000 7f0957fff700 1 -- 172.21.15.49:0/2349516372 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094000bf60 con 0x7f0940005000 2023-11-30T17:23:27.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.032+0000 7f0957fff700 1 -- 172.21.15.49:0/2349516372 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094000c0f0 con 0x7f09400038e0 2023-11-30T17:23:27.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.032+0000 7f095cc71700 1 --2- 172.21.15.49:0/2349516372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0940004690 0x7f0940004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:27.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.032+0000 7f095d472700 1 --2- 172.21.15.49:0/2349516372 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09400038e0 0x7f0940003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:27.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.032+0000 7f095dc73700 1 --2- 172.21.15.49:0/2349516372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0940005000 0x7f094000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:27.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.032+0000 7f095cc71700 1 -- 172.21.15.49:0/2349516372 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09400038e0 msgr2=0x7f0940003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:27.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.032+0000 7f095cc71700 1 --2- 172.21.15.49:0/2349516372 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09400038e0 0x7f0940003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:27.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.032+0000 7f095cc71700 1 -- 172.21.15.49:0/2349516372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0940005000 msgr2=0x7f094000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:27.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.032+0000 7f095cc71700 1 --2- 172.21.15.49:0/2349516372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0940005000 0x7f094000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:27.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.032+0000 7f095dc73700 1 -- 172.21.15.49:0/2349516372 reap_dead start 2023-11-30T17:23:27.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.032+0000 7f095cc71700 1 -- 172.21.15.49:0/2349516372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09400033f0 con 0x7f0940004690 2023-11-30T17:23:27.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.032+0000 7f095cc71700 1 --2- 172.21.15.49:0/2349516372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0940004690 0x7f0940004b10 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f094c00c190 tx=0x7f094c001e50).ready entity=mon.0 client_cookie=dc6f98a753634985 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:27.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.032+0000 7f0957fff700 1 -- 172.21.15.49:0/2349516372 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c007a20 con 0x7f0940004690 2023-11-30T17:23:27.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.032+0000 7f0957fff700 1 -- 172.21.15.49:0/2349516372 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094c00cac0 con 0x7f0940004690 2023-11-30T17:23:27.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.032+0000 7f0957fff700 1 -- 172.21.15.49:0/2349516372 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c00ce40 con 0x7f0940004690 2023-11-30T17:23:27.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.033+0000 7f095e474700 1 -- 172.21.15.49:0/2349516372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0940004690 msgr2=0x7f0940004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:27.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.033+0000 7f095e474700 1 --2- 172.21.15.49:0/2349516372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0940004690 0x7f0940004b10 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f094c00c190 tx=0x7f094c001e50).stop 2023-11-30T17:23:27.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.033+0000 7f095e474700 1 -- 172.21.15.49:0/2349516372 shutdown_connections 2023-11-30T17:23:27.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.033+0000 7f095e474700 1 --2- 172.21.15.49:0/2349516372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0940004690 0x7f0940004b10 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:27.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.033+0000 7f095e474700 1 -- 172.21.15.49:0/2349516372 >> 172.21.15.49:0/2349516372 conn(0x7f09580cb000 msgr2=0x7f09580cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:27.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.033+0000 7f095e474700 1 -- 172.21.15.49:0/2349516372 shutdown_connections 2023-11-30T17:23:27.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.033+0000 7f095e474700 1 -- 172.21.15.49:0/2349516372 wait complete. 2023-11-30T17:23:27.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.034+0000 7f095e474700 1 Processor -- start 2023-11-30T17:23:27.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.034+0000 7f095e474700 1 -- start start 2023-11-30T17:23:27.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.035+0000 7f095e474700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0940004690 0x7f09580adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:27.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.035+0000 7f095e474700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09581520e0 0x7f09580ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:27.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.035+0000 7f095e474700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0958154f40 0x7f0958155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:27.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.035+0000 7f095e474700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09580af660 con 0x7f0940004690 2023-11-30T17:23:27.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.035+0000 7f095e474700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09580aea50 con 0x7f09581520e0 2023-11-30T17:23:27.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.035+0000 7f095e474700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09580aed30 con 0x7f0958154f40 2023-11-30T17:23:27.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.035+0000 7f095d472700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0940004690 0x7f09580adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:27.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.035+0000 7f095d472700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0940004690 0x7f09580adfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58658/0 (socket says 172.21.15.49:58658) 2023-11-30T17:23:27.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.035+0000 7f095d472700 1 -- 172.21.15.49:0/3771743430 learned_addr learned my addr 172.21.15.49:0/3771743430 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:27.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.035+0000 7f095d472700 1 -- 172.21.15.49:0/3771743430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0958154f40 msgr2=0x7f0958155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:27.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.035+0000 7f095d472700 1 --2- 172.21.15.49:0/3771743430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0958154f40 0x7f0958155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:27.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.035+0000 7f095d472700 1 -- 172.21.15.49:0/3771743430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09581520e0 msgr2=0x7f09580ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:27.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.035+0000 7f095d472700 1 --2- 172.21.15.49:0/3771743430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09581520e0 0x7f09580ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:27.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.035+0000 7f095d472700 1 -- 172.21.15.49:0/3771743430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09580af010 con 0x7f0940004690 2023-11-30T17:23:27.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.036+0000 7f095d472700 1 --2- 172.21.15.49:0/3771743430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0940004690 0x7f09580adfb0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7f0948011f80 tx=0x7f094800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:27.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.036+0000 7f09557fa700 1 -- 172.21.15.49:0/3771743430 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094800e040 con 0x7f0940004690 2023-11-30T17:23:27.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.036+0000 7f09557fa700 1 -- 172.21.15.49:0/3771743430 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094800f040 con 0x7f0940004690 2023-11-30T17:23:27.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.036+0000 7f09557fa700 1 -- 172.21.15.49:0/3771743430 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0948015450 con 0x7f0940004690 2023-11-30T17:23:27.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.036+0000 7f095e474700 1 -- 172.21.15.49:0/3771743430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09580af2f0 con 0x7f0940004690 2023-11-30T17:23:27.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.036+0000 7f095e474700 1 -- 172.21.15.49:0/3771743430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0958155870 con 0x7f0940004690 2023-11-30T17:23:27.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.037+0000 7f095e474700 1 -- 172.21.15.49:0/3771743430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f095806c7c0 con 0x7f0940004690 2023-11-30T17:23:27.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.037+0000 7f09557fa700 1 -- 172.21.15.49:0/3771743430 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0948015880 con 0x7f0940004690 2023-11-30T17:23:27.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.037+0000 7f09557fa700 1 --2- 172.21.15.49:0/3771743430 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f094405f270 0x7f0944061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:27.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.037+0000 7f09557fa700 1 -- 172.21.15.49:0/3771743430 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5856+0+0 (secure 0 0 0) 0x7f094807b3d0 con 0x7f0940004690 2023-11-30T17:23:27.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.038+0000 7f095cc71700 1 --2- 172.21.15.49:0/3771743430 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f094405f270 0x7f0944061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:27.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.038+0000 7f095cc71700 1 --2- 172.21.15.49:0/3771743430 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f094405f270 0x7f0944061730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f09580c60a0 tx=0x7f094c015000).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:27.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.042+0000 7f09557fa700 1 -- 172.21.15.49:0/3771743430 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f094804c630 con 0x7f0940004690 2023-11-30T17:23:27.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.256+0000 7f095e474700 1 -- 172.21.15.49:0/3771743430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09580c0f50 con 0x7f0940004690 2023-11-30T17:23:27.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.257+0000 7f09557fa700 1 -- 172.21.15.49:0/3771743430 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f094804fc50 con 0x7f0940004690 2023-11-30T17:23:27.259 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:27.260 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":41,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5906,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3382372491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3382372491},{"type":"v1","addr":"172.21.15.115:6837","nonce":3382372491}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6675,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/962684395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":962684395},{"type":"v1","addr":"172.21.15.49:6834","nonce":962684395}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6678,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1931198509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1931198509},{"type":"v1","addr":"172.21.15.49:6835","nonce":1931198509}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6883,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/3414046986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3414046986},{"type":"v1","addr":"172.21.15.115:6836","nonce":3414046986}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[]} 2023-11-30T17:23:27.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.258+0000 7f095e474700 1 -- 172.21.15.49:0/3771743430 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f094405f270 msgr2=0x7f0944061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:27.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.258+0000 7f095e474700 1 --2- 172.21.15.49:0/3771743430 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f094405f270 0x7f0944061730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f09580c60a0 tx=0x7f094c015000).stop 2023-11-30T17:23:27.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.258+0000 7f095e474700 1 -- 172.21.15.49:0/3771743430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0940004690 msgr2=0x7f09580adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:27.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.258+0000 7f095e474700 1 --2- 172.21.15.49:0/3771743430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0940004690 0x7f09580adfb0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7f0948011f80 tx=0x7f094800b040).stop 2023-11-30T17:23:27.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.258+0000 7f095e474700 1 -- 172.21.15.49:0/3771743430 shutdown_connections 2023-11-30T17:23:27.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.258+0000 7f095e474700 1 --2- 172.21.15.49:0/3771743430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0958154f40 0x7f0958155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:27.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.258+0000 7f095e474700 1 --2- 172.21.15.49:0/3771743430 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f094405f270 0x7f0944061730 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:27.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.258+0000 7f095e474700 1 --2- 172.21.15.49:0/3771743430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0940004690 0x7f09580adfb0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:27.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.258+0000 7f095e474700 1 --2- 172.21.15.49:0/3771743430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09581520e0 0x7f09580ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:27.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.258+0000 7f095e474700 1 -- 172.21.15.49:0/3771743430 >> 172.21.15.49:0/3771743430 conn(0x7f09580cb000 msgr2=0x7f09580aae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:27.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.259+0000 7f095e474700 1 -- 172.21.15.49:0/3771743430 shutdown_connections 2023-11-30T17:23:27.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.259+0000 7f095e474700 1 -- 172.21.15.49:0/3771743430 wait complete. 2023-11-30T17:23:27.262 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 41 2023-11-30T17:23:27.273 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-30T17:23:27.273 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-30T17:23:27.273 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-30T17:23:27.274 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T17:23:27.274 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-30T17:23:27.274 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-30T17:23:27.274 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-30T17:23:27.274 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T17:23:27.274 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-30T17:23:27.274 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-30T17:23:27.275 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-30T17:23:27.275 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T17:23:27.275 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-30T17:23:27.275 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-30T17:23:27.275 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-30T17:23:27.275 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T17:23:27.284 INFO:tasks.ceph.mds.a:Stopped 2023-11-30T17:23:27.284 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-30T17:23:27.285 INFO:tasks.ceph.mds.c:Stopped 2023-11-30T17:23:27.285 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-30T17:23:27.286 INFO:tasks.ceph.mds.b:Stopped 2023-11-30T17:23:27.287 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-30T17:23:27.287 INFO:tasks.ceph.mds.d:Stopped 2023-11-30T17:23:27.287 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-30T17:23:27.327 INFO:tasks.ceph.mds.a:Started 2023-11-30T17:23:27.327 DEBUG:teuthology.parallel:result is None 2023-11-30T17:23:27.328 INFO:tasks.ceph.mds.c:Started 2023-11-30T17:23:27.329 DEBUG:teuthology.parallel:result is None 2023-11-30T17:23:27.330 INFO:tasks.ceph.mds.b:Started 2023-11-30T17:23:27.330 DEBUG:teuthology.parallel:result is None 2023-11-30T17:23:27.331 INFO:tasks.ceph.mds.d:Started 2023-11-30T17:23:27.331 DEBUG:teuthology.parallel:result is None 2023-11-30T17:23:27.331 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-30T17:23:27.401 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-11-30T17:23:27.401 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-11-30T17:23:27.402 INFO:tasks.ceph.mds.c.smithi049.stderr:2023-11-30T17:23:27.399+0000 7f80d040b700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-11-30T17:23:27.413 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-11-30T17:23:27.414 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-11-30T17:23:27.414 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-11-30T17:23:27.412+0000 7f4ebd89e700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-11-30T17:23:27.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.457+0000 7f0edf2e2700 1 Processor -- start 2023-11-30T17:23:27.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.457+0000 7f0edf2e2700 1 -- start start 2023-11-30T17:23:27.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.458+0000 7f0edf2e2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ed81547f0 0x7f0ed80a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:27.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.458+0000 7f0edf2e2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0ed80c86f0 0x7f0ed80c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:27.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.458+0000 7f0edf2e2700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed80c7e30 con 0x7f0ed8062700 2023-11-30T17:23:27.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.458+0000 7f0edf2e2700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed80bcf40 con 0x7f0ed80c86f0 2023-11-30T17:23:27.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.458+0000 7f0edf2e2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed80c6b20 con 0x7f0ed81547f0 2023-11-30T17:23:27.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.458+0000 7f0edc87d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0ed80c86f0 0x7f0ed80c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:27.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.458+0000 7f0edd87f700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0ed8062700 0x7f0ed80a4db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48532/0 (socket says 172.21.15.49:48532) 2023-11-30T17:23:27.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.458+0000 7f0edd87f700 1 -- 172.21.15.49:0/3485241295 learned_addr learned my addr 172.21.15.49:0/3485241295 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:27.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.458+0000 7f0edd07e700 1 --2- 172.21.15.49:0/3485241295 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ed81547f0 0x7f0ed80a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:27.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.458+0000 7f0edc87d700 1 -- 172.21.15.49:0/3485241295 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ed81547f0 msgr2=0x7f0ed80a72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:27.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.458+0000 7f0edc87d700 1 --2- 172.21.15.49:0/3485241295 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ed81547f0 0x7f0ed80a72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:27.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.458+0000 7f0edc87d700 1 -- 172.21.15.49:0/3485241295 >> v1:172.21.15.49:6789/0 conn(0x7f0ed8062700 legacy=0x7f0ed80a4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:27.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.458+0000 7f0ecffff700 1 -- 172.21.15.49:0/3485241295 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 35768610 0 0) 0x7f0ed80c7e30 con 0x7f0ed8062700 2023-11-30T17:23:27.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.458+0000 7f0edc87d700 1 -- 172.21.15.49:0/3485241295 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed80a77d0 con 0x7f0ed80c86f0 2023-11-30T17:23:27.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.458+0000 7f0edc87d700 1 --2- 172.21.15.49:0/3485241295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed80c86f0 0x7f0ed80c6fb0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f0ec8009760 tx=0x7f0ec8009060).ready entity=mon.0 client_cookie=c179f36154ce53fc server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:27.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.459+0000 7f0ecffff700 1 -- 172.21.15.49:0/3485241295 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec80090d0 con 0x7f0ed80c86f0 2023-11-30T17:23:27.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.459+0000 7f0ecffff700 1 -- 172.21.15.49:0/3485241295 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec800b580 con 0x7f0ed80c86f0 2023-11-30T17:23:27.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.459+0000 7f0ecffff700 1 -- 172.21.15.49:0/3485241295 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec800b900 con 0x7f0ed80c86f0 2023-11-30T17:23:27.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.459+0000 7f0edf2e2700 1 -- 172.21.15.49:0/3485241295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed80c86f0 msgr2=0x7f0ed80c6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:27.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.459+0000 7f0edf2e2700 1 --2- 172.21.15.49:0/3485241295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed80c86f0 0x7f0ed80c6fb0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f0ec8009760 tx=0x7f0ec8009060).stop 2023-11-30T17:23:27.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.459+0000 7f0edf2e2700 1 -- 172.21.15.49:0/3485241295 shutdown_connections 2023-11-30T17:23:27.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.459+0000 7f0edf2e2700 1 --2- 172.21.15.49:0/3485241295 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ed81547f0 0x7f0ed80a72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:27.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.459+0000 7f0edf2e2700 1 --2- 172.21.15.49:0/3485241295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed80c86f0 0x7f0ed80c6fb0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:27.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.459+0000 7f0edf2e2700 1 -- 172.21.15.49:0/3485241295 >> 172.21.15.49:0/3485241295 conn(0x7f0ed80642d0 msgr2=0x7f0ed80c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:27.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.459+0000 7f0edf2e2700 1 -- 172.21.15.49:0/3485241295 shutdown_connections 2023-11-30T17:23:27.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.459+0000 7f0edf2e2700 1 -- 172.21.15.49:0/3485241295 wait complete. 2023-11-30T17:23:27.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.460+0000 7f0edf2e2700 1 Processor -- start 2023-11-30T17:23:27.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.460+0000 7f0edf2e2700 1 -- start start 2023-11-30T17:23:27.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.461+0000 7f0edf2e2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ed8062700 0x7f0ed80c1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:27.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.461+0000 7f0edf2e2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed80c86f0 0x7f0ed80c3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:27.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.461+0000 7f0edf2e2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ed81547f0 0x7f0ed8167c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:27.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.461+0000 7f0edf2e2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed80c15c0 con 0x7f0ed80c86f0 2023-11-30T17:23:27.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.461+0000 7f0edf2e2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed80c1f40 con 0x7f0ed81547f0 2023-11-30T17:23:27.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.461+0000 7f0edf2e2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed81686f0 con 0x7f0ed8062700 2023-11-30T17:23:27.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.461+0000 7f0edc87d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed80c86f0 0x7f0ed80c3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:27.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.461+0000 7f0edc87d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed80c86f0 0x7f0ed80c3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58670/0 (socket says 172.21.15.49:58670) 2023-11-30T17:23:27.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.461+0000 7f0edc87d700 1 -- 172.21.15.49:0/171490802 learned_addr learned my addr 172.21.15.49:0/171490802 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:27.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.462+0000 7f0edd07e700 1 --2- 172.21.15.49:0/171490802 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ed8062700 0x7f0ed80c1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:27.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.462+0000 7f0edd87f700 1 --2- 172.21.15.49:0/171490802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ed81547f0 0x7f0ed8167c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:27.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.462+0000 7f0edc87d700 1 -- 172.21.15.49:0/171490802 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ed8062700 msgr2=0x7f0ed80c1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:27.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.462+0000 7f0edc87d700 1 --2- 172.21.15.49:0/171490802 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ed8062700 0x7f0ed80c1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:27.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.462+0000 7f0edc87d700 1 -- 172.21.15.49:0/171490802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ed81547f0 msgr2=0x7f0ed8167c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:27.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.462+0000 7f0edc87d700 1 --2- 172.21.15.49:0/171490802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ed81547f0 0x7f0ed8167c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:27.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.462+0000 7f0edc87d700 1 -- 172.21.15.49:0/171490802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec80092a0 con 0x7f0ed80c86f0 2023-11-30T17:23:27.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.462+0000 7f0edc87d700 1 --2- 172.21.15.49:0/171490802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed80c86f0 0x7f0ed80c3820 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7f0ed80695b0 tx=0x7f0ec8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:27.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.462+0000 7f0ecd7fa700 1 -- 172.21.15.49:0/171490802 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec800b900 con 0x7f0ed80c86f0 2023-11-30T17:23:27.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.462+0000 7f0ecd7fa700 1 -- 172.21.15.49:0/171490802 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec8000c90 con 0x7f0ed80c86f0 2023-11-30T17:23:27.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.462+0000 7f0edf2e2700 1 -- 172.21.15.49:0/171490802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed81689d0 con 0x7f0ed80c86f0 2023-11-30T17:23:27.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.462+0000 7f0ecd7fa700 1 -- 172.21.15.49:0/171490802 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec800bed0 con 0x7f0ed80c86f0 2023-11-30T17:23:27.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.462+0000 7f0edf2e2700 1 -- 172.21.15.49:0/171490802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed80c0f20 con 0x7f0ed80c86f0 2023-11-30T17:23:27.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.463+0000 7f0edf2e2700 1 -- 172.21.15.49:0/171490802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed806c860 con 0x7f0ed80c86f0 2023-11-30T17:23:27.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.463+0000 7f0ecd7fa700 1 -- 172.21.15.49:0/171490802 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0ec801b620 con 0x7f0ed80c86f0 2023-11-30T17:23:27.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.464+0000 7f0ecd7fa700 1 --2- 172.21.15.49:0/171490802 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0ebc05f270 0x7f0ebc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:27.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.464+0000 7f0ecd7fa700 1 -- 172.21.15.49:0/171490802 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5856+0+0 (secure 0 0 0) 0x7f0ec807bcb0 con 0x7f0ed80c86f0 2023-11-30T17:23:27.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.464+0000 7f0edd07e700 1 --2- 172.21.15.49:0/171490802 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0ebc05f270 0x7f0ebc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:27.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.464+0000 7f0edd07e700 1 --2- 172.21.15.49:0/171490802 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0ebc05f270 0x7f0ebc061730 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f0ed400bb10 tx=0x7f0ed4008040).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:27.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.468+0000 7f0ecd7fa700 1 -- 172.21.15.49:0/171490802 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0ec804cf10 con 0x7f0ed80c86f0 2023-11-30T17:23:27.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:27.658+0000 7f0edf2e2700 1 -- 172.21.15.49:0/171490802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f0ed8065290 con 0x7f0ed80c86f0 2023-11-30T17:23:28.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.479+0000 7f0ecd7fa700 1 -- 172.21.15.49:0/171490802 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v109) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0ec8050530 con 0x7f0ed80c86f0 2023-11-30T17:23:28.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.481+0000 7f0edf2e2700 1 -- 172.21.15.49:0/171490802 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0ebc05f270 msgr2=0x7f0ebc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:28.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.481+0000 7f0edf2e2700 1 --2- 172.21.15.49:0/171490802 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0ebc05f270 0x7f0ebc061730 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f0ed400bb10 tx=0x7f0ed4008040).stop 2023-11-30T17:23:28.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.481+0000 7f0edf2e2700 1 -- 172.21.15.49:0/171490802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed80c86f0 msgr2=0x7f0ed80c3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:28.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.481+0000 7f0edf2e2700 1 --2- 172.21.15.49:0/171490802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed80c86f0 0x7f0ed80c3820 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7f0ed80695b0 tx=0x7f0ec8017000).stop 2023-11-30T17:23:28.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.481+0000 7f0edf2e2700 1 -- 172.21.15.49:0/171490802 shutdown_connections 2023-11-30T17:23:28.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.481+0000 7f0edf2e2700 1 --2- 172.21.15.49:0/171490802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ed81547f0 0x7f0ed8167c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:28.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.481+0000 7f0edf2e2700 1 --2- 172.21.15.49:0/171490802 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ed8062700 0x7f0ed80c1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:28.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.481+0000 7f0edf2e2700 1 --2- 172.21.15.49:0/171490802 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0ebc05f270 0x7f0ebc061730 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:28.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.481+0000 7f0edf2e2700 1 --2- 172.21.15.49:0/171490802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed80c86f0 0x7f0ed80c3820 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:28.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.481+0000 7f0edf2e2700 1 -- 172.21.15.49:0/171490802 >> 172.21.15.49:0/171490802 conn(0x7f0ed80642d0 msgr2=0x7f0ed8066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:28.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.481+0000 7f0edf2e2700 1 -- 172.21.15.49:0/171490802 shutdown_connections 2023-11-30T17:23:28.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.481+0000 7f0edf2e2700 1 -- 172.21.15.49:0/171490802 wait complete. 2023-11-30T17:23:28.485 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2023-11-30T17:23:28.497 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-30T17:23:28.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.616+0000 7f86d933b700 1 Processor -- start 2023-11-30T17:23:28.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.616+0000 7f86d933b700 1 -- start start 2023-11-30T17:23:28.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.617+0000 7f86d933b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f86d41544e0 0x7f86d40c6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:28.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.617+0000 7f86d933b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86d4158ce0 0x7f86d40c1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:28.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.617+0000 7f86d933b700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d40c0fa0 con 0x7f86d40c1920 2023-11-30T17:23:28.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.617+0000 7f86d933b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86d40c6930 con 0x7f86d41544e0 2023-11-30T17:23:28.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.617+0000 7f86d933b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d40c06b0 con 0x7f86d4158ce0 2023-11-30T17:23:28.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.617+0000 7f86d37fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f86d40c1920 0x7f86d40aaf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48544/0 (socket says 172.21.15.49:48544) 2023-11-30T17:23:28.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.617+0000 7f86d37fe700 1 -- 172.21.15.49:0/3542388149 learned_addr learned my addr 172.21.15.49:0/3542388149 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:28.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.617+0000 7f86d2ffd700 1 --2- 172.21.15.49:0/3542388149 >> v2:172.21.15.115:3300/0 conn(0x7f86d41544e0 0x7f86d40c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:28.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.617+0000 7f86d27fc700 1 --2- 172.21.15.49:0/3542388149 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86d4158ce0 0x7f86d40c1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:28.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.617+0000 7f86d1ffb700 1 -- 172.21.15.49:0/3542388149 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2871982731 0 0) 0x7f86d40c0fa0 con 0x7f86d40c1920 2023-11-30T17:23:28.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.617+0000 7f86d1ffb700 1 -- 172.21.15.49:0/3542388149 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86c00033f0 con 0x7f86d40c1920 2023-11-30T17:23:28.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.617+0000 7f86d2ffd700 1 -- 172.21.15.49:0/3542388149 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86d4158ce0 msgr2=0x7f86d40c1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:28.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.617+0000 7f86d2ffd700 1 --2- 172.21.15.49:0/3542388149 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86d4158ce0 0x7f86d40c1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:28.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.617+0000 7f86d2ffd700 1 -- 172.21.15.49:0/3542388149 >> v1:172.21.15.49:6789/0 conn(0x7f86d40c1920 legacy=0x7f86d40aaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:28.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.617+0000 7f86d2ffd700 1 -- 172.21.15.49:0/3542388149 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d41548c0 con 0x7f86d41544e0 2023-11-30T17:23:28.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.617+0000 7f86d27fc700 1 --2- 172.21.15.49:0/3542388149 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86d4158ce0 0x7f86d40c1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:23:28.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.618+0000 7f86d2ffd700 1 --2- 172.21.15.49:0/3542388149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86d41544e0 0x7f86d40c6090 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f86c4009760 tx=0x7f86c4009060).ready entity=mon.1 client_cookie=d78061effd3d8cea server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:28.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.618+0000 7f86d1ffb700 1 -- 172.21.15.49:0/3542388149 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c400d4a0 con 0x7f86d41544e0 2023-11-30T17:23:28.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.618+0000 7f86d1ffb700 1 -- 172.21.15.49:0/3542388149 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c400d600 con 0x7f86d41544e0 2023-11-30T17:23:28.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.618+0000 7f86d1ffb700 1 -- 172.21.15.49:0/3542388149 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c400d980 con 0x7f86d41544e0 2023-11-30T17:23:28.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.618+0000 7f86d933b700 1 -- 172.21.15.49:0/3542388149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86d41544e0 msgr2=0x7f86d40c6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:28.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.618+0000 7f86d933b700 1 --2- 172.21.15.49:0/3542388149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86d41544e0 0x7f86d40c6090 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f86c4009760 tx=0x7f86c4009060).stop 2023-11-30T17:23:28.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.618+0000 7f86d933b700 1 -- 172.21.15.49:0/3542388149 shutdown_connections 2023-11-30T17:23:28.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.618+0000 7f86d933b700 1 --2- 172.21.15.49:0/3542388149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86d41544e0 0x7f86d40c6090 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:28.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.618+0000 7f86d933b700 1 --2- 172.21.15.49:0/3542388149 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86d4158ce0 0x7f86d40c1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:28.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.618+0000 7f86d933b700 1 -- 172.21.15.49:0/3542388149 >> 172.21.15.49:0/3542388149 conn(0x7f86d40cb080 msgr2=0x7f86d40cb490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:28.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.618+0000 7f86d933b700 1 -- 172.21.15.49:0/3542388149 shutdown_connections 2023-11-30T17:23:28.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.618+0000 7f86d933b700 1 -- 172.21.15.49:0/3542388149 wait complete. 2023-11-30T17:23:28.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.620+0000 7f86d933b700 1 Processor -- start 2023-11-30T17:23:28.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.620+0000 7f86d933b700 1 -- start start 2023-11-30T17:23:28.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.620+0000 7f86d933b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86d40c1920 0x7f86d4156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:28.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.620+0000 7f86d933b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86d41544e0 0x7f86d40c2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:28.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.620+0000 7f86d933b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86d4158ce0 0x7f86d4153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:28.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.620+0000 7f86d933b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d40c3410 con 0x7f86d4158ce0 2023-11-30T17:23:28.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.620+0000 7f86d933b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d40c36f0 con 0x7f86d40c1920 2023-11-30T17:23:28.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.620+0000 7f86d933b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d40c39d0 con 0x7f86d41544e0 2023-11-30T17:23:28.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.620+0000 7f86d37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86d4158ce0 0x7f86d4153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:28.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.620+0000 7f86d37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86d4158ce0 0x7f86d4153690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58672/0 (socket says 172.21.15.49:58672) 2023-11-30T17:23:28.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.620+0000 7f86d37fe700 1 -- 172.21.15.49:0/2906305219 learned_addr learned my addr 172.21.15.49:0/2906305219 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:28.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.621+0000 7f86d27fc700 1 --2- 172.21.15.49:0/2906305219 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86d41544e0 0x7f86d40c2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:28.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.621+0000 7f86d2ffd700 1 --2- 172.21.15.49:0/2906305219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86d40c1920 0x7f86d4156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:28.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.621+0000 7f86d37fe700 1 -- 172.21.15.49:0/2906305219 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86d41544e0 msgr2=0x7f86d40c2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:28.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.621+0000 7f86d37fe700 1 --2- 172.21.15.49:0/2906305219 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86d41544e0 0x7f86d40c2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:28.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.621+0000 7f86d37fe700 1 -- 172.21.15.49:0/2906305219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86d40c1920 msgr2=0x7f86d4156900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:28.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.621+0000 7f86d37fe700 1 --2- 172.21.15.49:0/2906305219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86d40c1920 0x7f86d4156900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:28.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.621+0000 7f86d37fe700 1 -- 172.21.15.49:0/2906305219 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86bc0092a0 con 0x7f86d4158ce0 2023-11-30T17:23:28.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.621+0000 7f86d27fc700 1 --2- 172.21.15.49:0/2906305219 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86d41544e0 0x7f86d40c2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:23:28.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.621+0000 7f86d2ffd700 1 --2- 172.21.15.49:0/2906305219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86d40c1920 0x7f86d4156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:23:28.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.621+0000 7f86d37fe700 1 --2- 172.21.15.49:0/2906305219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86d4158ce0 0x7f86d4153690 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7f86cc005ad0 tx=0x7f86cc001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:28.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.621+0000 7f86caffd700 1 -- 172.21.15.49:0/2906305219 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc005d30 con 0x7f86d4158ce0 2023-11-30T17:23:28.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.621+0000 7f86caffd700 1 -- 172.21.15.49:0/2906305219 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86cc005e90 con 0x7f86d4158ce0 2023-11-30T17:23:28.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.621+0000 7f86d933b700 1 -- 172.21.15.49:0/2906305219 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c40092a0 con 0x7f86d4158ce0 2023-11-30T17:23:28.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.621+0000 7f86caffd700 1 -- 172.21.15.49:0/2906305219 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc007320 con 0x7f86d4158ce0 2023-11-30T17:23:28.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.621+0000 7f86d933b700 1 -- 172.21.15.49:0/2906305219 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d40c3f90 con 0x7f86d4158ce0 2023-11-30T17:23:28.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.622+0000 7f86d933b700 1 -- 172.21.15.49:0/2906305219 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d406c7c0 con 0x7f86d4158ce0 2023-11-30T17:23:28.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.622+0000 7f86caffd700 1 -- 172.21.15.49:0/2906305219 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f86cc007710 con 0x7f86d4158ce0 2023-11-30T17:23:28.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.623+0000 7f86caffd700 1 --2- 172.21.15.49:0/2906305219 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f86b405f240 0x7f86b4061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:28.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.623+0000 7f86caffd700 1 -- 172.21.15.49:0/2906305219 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5297+0+0 (secure 0 0 0) 0x7f86cc07a120 con 0x7f86d4158ce0 2023-11-30T17:23:28.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.623+0000 7f86d2ffd700 1 --2- 172.21.15.49:0/2906305219 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f86b405f240 0x7f86b4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:28.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.624+0000 7f86d2ffd700 1 --2- 172.21.15.49:0/2906305219 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f86b405f240 0x7f86b4061700 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f86c400d260 tx=0x7f86c4016000).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:28.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.627+0000 7f86caffd700 1 -- 172.21.15.49:0/2906305219 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f86cc04b540 con 0x7f86d4158ce0 2023-11-30T17:23:28.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.865+0000 7f86d933b700 1 -- 172.21.15.49:0/2906305219 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f86d40aa940 con 0x7f86d4158ce0 2023-11-30T17:23:28.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.866+0000 7f86caffd700 1 -- 172.21.15.49:0/2906305219 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f86cc04eb60 con 0x7f86d4158ce0 2023-11-30T17:23:28.868 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:28.868 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T17:23:28.868 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2023-11-30T17:23:28.868 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:23:28.869 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2023-11-30T17:23:28.869 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlwm1FHxAAk+s9c60UZ5jB37wbpGzlcg==", 2023-11-30T17:23:28.869 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:23:28.869 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:23:28.869 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:23:28.869 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:23:28.869 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:23:28.869 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:23:28.869 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:23:28.869 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:23:28.869 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2023-11-30T17:23:28.869 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlADm0KhAArffesGGTXzQwY4NPnJ1Bjw==", 2023-11-30T17:23:28.869 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:23:28.869 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:23:28.870 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:23:28.870 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:23:28.870 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:23:28.870 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:23:28.870 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:23:28.870 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:23:28.870 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2023-11-30T17:23:28.870 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlYnY1JhAA+Lurauug0NhWnK8aZErR3g==", 2023-11-30T17:23:28.870 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:23:28.870 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:23:28.870 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:23:28.870 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:23:28.870 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:23:28.870 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:23:28.871 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:23:28.871 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:23:28.871 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2023-11-30T17:23:28.871 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlQdKCMRAA3h4O2NqkQ2zE3DxOqBoaQQ==", 2023-11-30T17:23:28.871 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:23:28.871 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:23:28.871 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:23:28.871 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:23:28.871 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:23:28.871 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:23:28.871 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:23:28.871 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:23:28.871 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2023-11-30T17:23:28.871 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAPwWhlGdbhFxAAOspNRLMhR59LSWatFbsYDA==", 2023-11-30T17:23:28.871 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:23:28.872 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:23:28.872 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:23:28.872 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:23:28.872 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:23:28.872 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:23:28.872 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:23:28.872 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2023-11-30T17:23:28.872 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQASwWhlfwUEFxAAuj0L8ooIGi1vsb7XWLVlDA==", 2023-11-30T17:23:28.872 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:23:28.872 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:23:28.872 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:23:28.872 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:23:28.872 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:23:28.872 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:23:28.873 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:23:28.873 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2023-11-30T17:23:28.873 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAVwWhl7XYwFBAAuSHZqdfRR8V1Y+hmPT5uuw==", 2023-11-30T17:23:28.873 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:23:28.873 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:23:28.873 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:23:28.873 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:23:28.873 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:23:28.873 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:23:28.873 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:23:28.873 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2023-11-30T17:23:28.873 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAYwWhlkhRCFRAAe3cRLcrhJ3ZoluXuRUhmew==", 2023-11-30T17:23:28.873 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:23:28.873 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:23:28.873 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:23:28.874 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:23:28.874 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:23:28.874 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:23:28.874 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:23:28.874 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2023-11-30T17:23:28.874 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAewWhlrq4qFBAAOSdqozO8iH25BQFrPI1SRQ==", 2023-11-30T17:23:28.874 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:23:28.874 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:23:28.874 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:23:28.874 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:23:28.874 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:23:28.874 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:23:28.874 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:23:28.874 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2023-11-30T17:23:28.874 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAhwWhlZL9WERAA90znWBLNuY5eem3yF6O0wg==", 2023-11-30T17:23:28.875 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:23:28.875 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:23:28.875 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:23:28.875 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:23:28.875 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:23:28.875 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:23:28.875 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:23:28.875 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2023-11-30T17:23:28.875 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAkwWhlCJDiEBAAETLCBNCdaWXFgkPPaulTAA==", 2023-11-30T17:23:28.875 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:23:28.875 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:23:28.875 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:23:28.875 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:23:28.875 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:23:28.876 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:23:28.876 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:23:28.876 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2023-11-30T17:23:28.876 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAnwWhl+IiYEBAAcI3AU5xrv0cYy9lckyu0dQ==", 2023-11-30T17:23:28.876 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:23:28.876 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:23:28.876 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:23:28.876 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:23:28.876 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:23:28.877 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:23:28.877 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:23:28.877 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2023-11-30T17:23:28.877 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhleYZcNRAA5PoPChH+s6XfbrQ0hmu2NA==", 2023-11-30T17:23:28.877 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:23:28.877 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:23:28.877 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2023-11-30T17:23:28.877 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-30T17:23:28.877 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:23:28.877 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:23:28.877 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:23:28.877 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2023-11-30T17:23:28.877 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAOwWhlFhcfAhAAzaBDtyRxuqeQ9BatfgUuXw==", 2023-11-30T17:23:28.877 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:23:28.877 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:23:28.878 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T17:23:28.878 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T17:23:28.878 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T17:23:28.878 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:23:28.878 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:23:28.878 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:23:28.878 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2023-11-30T17:23:28.878 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlLZrDOhAAHG/dYWYmPouk3+Iqafr7qw==", 2023-11-30T17:23:28.878 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:23:28.878 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:23:28.878 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T17:23:28.878 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T17:23:28.878 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T17:23:28.878 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:23:28.879 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:23:28.879 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:23:28.879 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2023-11-30T17:23:28.879 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAOwWhl6lxuBxAA/YXQDo+U2ppULGzK054Gzg==", 2023-11-30T17:23:28.879 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:23:28.879 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:23:28.879 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T17:23:28.879 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T17:23:28.879 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T17:23:28.879 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:23:28.879 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:23:28.879 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:23:28.879 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2023-11-30T17:23:28.879 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhl4JkLAxAAiaLgZ5eiazaT9VanG5ihyQ==", 2023-11-30T17:23:28.879 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:23:28.879 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T17:23:28.880 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:23:28.880 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:23:28.880 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:23:28.880 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:23:28.880 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:23:28.880 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:23:28.880 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2023-11-30T17:23:28.880 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlH1s2HBAA3ea9Utfv7fZoo2hO+ElDVQ==", 2023-11-30T17:23:28.880 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:23:28.880 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T17:23:28.880 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-11-30T17:23:28.880 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:23:28.880 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:23:28.880 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:23:28.880 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:23:28.881 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2023-11-30T17:23:28.881 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlpy+fFxAA3qmboR+PlQtK6T35ryj+Lw==", 2023-11-30T17:23:28.881 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:23:28.881 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T17:23:28.881 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-11-30T17:23:28.881 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:23:28.881 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:23:28.881 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:23:28.881 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-11-30T17:23:28.881 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T17:23:28.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.867+0000 7f86d933b700 1 -- 172.21.15.49:0/2906305219 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f86b405f240 msgr2=0x7f86b4061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:28.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.867+0000 7f86d933b700 1 --2- 172.21.15.49:0/2906305219 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f86b405f240 0x7f86b4061700 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f86c400d260 tx=0x7f86c4016000).stop 2023-11-30T17:23:28.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.867+0000 7f86d933b700 1 -- 172.21.15.49:0/2906305219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86d4158ce0 msgr2=0x7f86d4153690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:28.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.868+0000 7f86d933b700 1 --2- 172.21.15.49:0/2906305219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86d4158ce0 0x7f86d4153690 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7f86cc005ad0 tx=0x7f86cc001650).stop 2023-11-30T17:23:28.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.868+0000 7f86d933b700 1 -- 172.21.15.49:0/2906305219 shutdown_connections 2023-11-30T17:23:28.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.868+0000 7f86d933b700 1 --2- 172.21.15.49:0/2906305219 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f86b405f240 0x7f86b4061700 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:28.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.868+0000 7f86d933b700 1 --2- 172.21.15.49:0/2906305219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86d4158ce0 0x7f86d4153690 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:28.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.868+0000 7f86d933b700 1 --2- 172.21.15.49:0/2906305219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86d40c1920 0x7f86d4156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:28.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.868+0000 7f86d933b700 1 --2- 172.21.15.49:0/2906305219 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86d41544e0 0x7f86d40c2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:28.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.868+0000 7f86d933b700 1 -- 172.21.15.49:0/2906305219 >> 172.21.15.49:0/2906305219 conn(0x7f86d40cb080 msgr2=0x7f86d4063e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:28.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.868+0000 7f86d933b700 1 -- 172.21.15.49:0/2906305219 shutdown_connections 2023-11-30T17:23:28.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:28.868+0000 7f86d933b700 1 -- 172.21.15.49:0/2906305219 wait complete. 2023-11-30T17:23:28.884 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:23:29.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.000+0000 7f2ea9d8b700 1 Processor -- start 2023-11-30T17:23:29.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.000+0000 7f2ea9d8b700 1 -- start start 2023-11-30T17:23:29.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.000+0000 7f2ea9d8b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ea41548c0 0x7f2ea406a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:29.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.001+0000 7f2ea9d8b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2ea40c6e30 0x7f2ea40c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:29.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.001+0000 7f2ea9d8b700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ea40c69a0 con 0x7f2ea41544e0 2023-11-30T17:23:29.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.001+0000 7f2ea9d8b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ea40c13a0 con 0x7f2ea40c6e30 2023-11-30T17:23:29.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.001+0000 7f2ea9d8b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea40c1680 con 0x7f2ea41548c0 2023-11-30T17:23:29.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.001+0000 7f2ea37fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2ea41544e0 0x7f2ea40c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48556/0 (socket says 172.21.15.49:48556) 2023-11-30T17:23:29.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.001+0000 7f2ea37fe700 1 -- 172.21.15.49:0/2322216194 learned_addr learned my addr 172.21.15.49:0/2322216194 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:29.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.001+0000 7f2ea3fff700 1 --2- 172.21.15.49:0/2322216194 >> v2:172.21.15.115:3300/0 conn(0x7f2ea40c6e30 0x7f2ea40c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:29.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.001+0000 7f2ea2ffd700 1 --2- 172.21.15.49:0/2322216194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ea41548c0 0x7f2ea406a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:29.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.001+0000 7f2ea27fc700 1 -- 172.21.15.49:0/2322216194 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1050492027 0 0) 0x7f2ea40c69a0 con 0x7f2ea41544e0 2023-11-30T17:23:29.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.001+0000 7f2ea27fc700 1 -- 172.21.15.49:0/2322216194 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e900033f0 con 0x7f2ea41544e0 2023-11-30T17:23:29.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.001+0000 7f2ea27fc700 1 -- 172.21.15.49:0/2322216194 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 182750534 0 0) 0x7f2e900033f0 con 0x7f2ea41544e0 2023-11-30T17:23:29.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.001+0000 7f2ea27fc700 1 -- 172.21.15.49:0/2322216194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ea41548c0 msgr2=0x7f2ea406a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:29.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.001+0000 7f2ea27fc700 1 --2- 172.21.15.49:0/2322216194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ea41548c0 0x7f2ea406a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:29.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.001+0000 7f2ea27fc700 1 -- 172.21.15.49:0/2322216194 >> v2:172.21.15.115:3300/0 conn(0x7f2ea40c6e30 msgr2=0x7f2ea40c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:29.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.001+0000 7f2ea27fc700 1 --2- 172.21.15.49:0/2322216194 >> v2:172.21.15.115:3300/0 conn(0x7f2ea40c6e30 0x7f2ea40c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:29.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.001+0000 7f2ea27fc700 1 -- 172.21.15.49:0/2322216194 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea40c6630 con 0x7f2ea41544e0 2023-11-30T17:23:29.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.001+0000 7f2ea27fc700 1 -- 172.21.15.49:0/2322216194 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f2e940015f0 con 0x7f2ea41544e0 2023-11-30T17:23:29.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.001+0000 7f2ea3fff700 1 --2- 172.21.15.49:0/2322216194 >> v2:172.21.15.115:3300/0 conn(0x7f2ea40c6e30 0x7f2ea40c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:23:29.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.001+0000 7f2ea27fc700 1 -- 172.21.15.49:0/2322216194 >> v1:172.21.15.49:6789/0 conn(0x7f2ea41544e0 legacy=0x7f2ea40c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:29.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.001+0000 7f2ea27fc700 1 --2- 172.21.15.49:0/2322216194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e900038e0 0x7f2e90003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:29.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.001+0000 7f2ea27fc700 1 --2- 172.21.15.49:0/2322216194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e90004690 0x7f2e90004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:29.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.001+0000 7f2ea27fc700 1 --2- 172.21.15.49:0/2322216194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ea41548c0 0x7f2e90005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:29.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.001+0000 7f2ea27fc700 1 -- 172.21.15.49:0/2322216194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea40c13a0 con 0x7f2e900038e0 2023-11-30T17:23:29.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.001+0000 7f2ea27fc700 1 -- 172.21.15.49:0/2322216194 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea40c1680 con 0x7f2e90004690 2023-11-30T17:23:29.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.001+0000 7f2ea27fc700 1 -- 172.21.15.49:0/2322216194 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9000b8e0 con 0x7f2ea41548c0 2023-11-30T17:23:29.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.001+0000 7f2ea37fe700 1 --2- 172.21.15.49:0/2322216194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e900038e0 0x7f2e90003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:29.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.002+0000 7f2ea2ffd700 1 --2- 172.21.15.49:0/2322216194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e90004690 0x7f2e90004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:29.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.002+0000 7f2ea3fff700 1 --2- 172.21.15.49:0/2322216194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ea41548c0 0x7f2e90005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:29.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.002+0000 7f2ea37fe700 1 -- 172.21.15.49:0/2322216194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ea41548c0 msgr2=0x7f2e90005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:29.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.002+0000 7f2ea37fe700 1 --2- 172.21.15.49:0/2322216194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ea41548c0 0x7f2e90005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:29.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.002+0000 7f2ea37fe700 1 -- 172.21.15.49:0/2322216194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e90004690 msgr2=0x7f2e90004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:29.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.002+0000 7f2ea37fe700 1 --2- 172.21.15.49:0/2322216194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e90004690 0x7f2e90004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:29.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.002+0000 7f2ea37fe700 1 -- 172.21.15.49:0/2322216194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e900033f0 con 0x7f2e900038e0 2023-11-30T17:23:29.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.002+0000 7f2ea37fe700 1 --2- 172.21.15.49:0/2322216194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e900038e0 0x7f2e90003d00 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f2e9400c210 tx=0x7f2e940077a0).ready entity=mon.0 client_cookie=9823e1f4d702176c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:29.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.002+0000 7f2ea27fc700 1 -- 172.21.15.49:0/2322216194 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e940079d0 con 0x7f2e900038e0 2023-11-30T17:23:29.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.002+0000 7f2ea27fc700 1 -- 172.21.15.49:0/2322216194 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9400cae0 con 0x7f2e900038e0 2023-11-30T17:23:29.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.002+0000 7f2ea27fc700 1 -- 172.21.15.49:0/2322216194 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9400ce60 con 0x7f2e900038e0 2023-11-30T17:23:29.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.003+0000 7f2ea9d8b700 1 -- 172.21.15.49:0/2322216194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e900038e0 msgr2=0x7f2e90003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:29.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.003+0000 7f2ea9d8b700 1 --2- 172.21.15.49:0/2322216194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e900038e0 0x7f2e90003d00 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f2e9400c210 tx=0x7f2e940077a0).stop 2023-11-30T17:23:29.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.003+0000 7f2ea3fff700 1 -- 172.21.15.49:0/2322216194 reap_dead start 2023-11-30T17:23:29.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.003+0000 7f2ea9d8b700 1 -- 172.21.15.49:0/2322216194 shutdown_connections 2023-11-30T17:23:29.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.003+0000 7f2ea9d8b700 1 -- 172.21.15.49:0/2322216194 >> 172.21.15.49:0/2322216194 conn(0x7f2ea4085020 msgr2=0x7f2ea4094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:29.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.003+0000 7f2ea9d8b700 1 -- 172.21.15.49:0/2322216194 shutdown_connections 2023-11-30T17:23:29.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.003+0000 7f2ea9d8b700 1 -- 172.21.15.49:0/2322216194 wait complete. 2023-11-30T17:23:29.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.004+0000 7f2ea9d8b700 1 Processor -- start 2023-11-30T17:23:29.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.004+0000 7f2ea9d8b700 1 -- start start 2023-11-30T17:23:29.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.005+0000 7f2ea9d8b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e900038e0 0x7f2ea4152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:29.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.005+0000 7f2ea9d8b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ea4152b40 0x7f2ea40978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:29.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.005+0000 7f2ea9d8b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ea4097dd0 0x7f2ea4098230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:29.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.005+0000 7f2ea9d8b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea41506b0 con 0x7f2ea4152b40 2023-11-30T17:23:29.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.005+0000 7f2ea9d8b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea4153310 con 0x7f2e900038e0 2023-11-30T17:23:29.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.005+0000 7f2ea9d8b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea41535f0 con 0x7f2ea4097dd0 2023-11-30T17:23:29.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.005+0000 7f2ea2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ea4152b40 0x7f2ea40978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:29.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.005+0000 7f2ea2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ea4152b40 0x7f2ea40978e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58684/0 (socket says 172.21.15.49:58684) 2023-11-30T17:23:29.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.005+0000 7f2ea2ffd700 1 -- 172.21.15.49:0/4070381911 learned_addr learned my addr 172.21.15.49:0/4070381911 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:29.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.005+0000 7f2ea37fe700 1 --2- 172.21.15.49:0/4070381911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e900038e0 0x7f2ea4152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:29.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.005+0000 7f2ea3fff700 1 --2- 172.21.15.49:0/4070381911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ea4097dd0 0x7f2ea4098230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:29.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.005+0000 7f2ea2ffd700 1 -- 172.21.15.49:0/4070381911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ea4097dd0 msgr2=0x7f2ea4098230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:29.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.005+0000 7f2ea2ffd700 1 --2- 172.21.15.49:0/4070381911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ea4097dd0 0x7f2ea4098230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:29.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.005+0000 7f2ea2ffd700 1 -- 172.21.15.49:0/4070381911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e900038e0 msgr2=0x7f2ea4152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:29.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.005+0000 7f2ea2ffd700 1 --2- 172.21.15.49:0/4070381911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e900038e0 0x7f2ea4152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:29.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.005+0000 7f2ea2ffd700 1 -- 172.21.15.49:0/4070381911 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea41538d0 con 0x7f2ea4152b40 2023-11-30T17:23:29.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.005+0000 7f2ea2ffd700 1 --2- 172.21.15.49:0/4070381911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ea4152b40 0x7f2ea40978e0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f2e8c011970 tx=0x7f2e8c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:29.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.005+0000 7f2e9b7fe700 1 -- 172.21.15.49:0/4070381911 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c00f700 con 0x7f2ea4152b40 2023-11-30T17:23:29.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.005+0000 7f2e9b7fe700 1 -- 172.21.15.49:0/4070381911 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c00f860 con 0x7f2ea4152b40 2023-11-30T17:23:29.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.005+0000 7f2e9b7fe700 1 -- 172.21.15.49:0/4070381911 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c00fbe0 con 0x7f2ea4152b40 2023-11-30T17:23:29.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.005+0000 7f2ea9d8b700 1 -- 172.21.15.49:0/4070381911 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea4153bb0 con 0x7f2ea4152b40 2023-11-30T17:23:29.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.005+0000 7f2ea9d8b700 1 -- 172.21.15.49:0/4070381911 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea4098720 con 0x7f2ea4152b40 2023-11-30T17:23:29.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.006+0000 7f2ea9d8b700 1 -- 172.21.15.49:0/4070381911 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ea4150920 con 0x7f2ea4152b40 2023-11-30T17:23:29.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.007+0000 7f2e9b7fe700 1 -- 172.21.15.49:0/4070381911 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f2e8c014440 con 0x7f2ea4152b40 2023-11-30T17:23:29.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.007+0000 7f2e9b7fe700 1 --2- 172.21.15.49:0/4070381911 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2e8405f270 0x7f2e84061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:29.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.007+0000 7f2e9b7fe700 1 -- 172.21.15.49:0/4070381911 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5297+0+0 (secure 0 0 0) 0x7f2e8c07abc0 con 0x7f2ea4152b40 2023-11-30T17:23:29.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.007+0000 7f2ea37fe700 1 --2- 172.21.15.49:0/4070381911 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2e8405f270 0x7f2e84061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:29.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.008+0000 7f2ea37fe700 1 --2- 172.21.15.49:0/4070381911 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2e8405f270 0x7f2e84061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f2e94000ef0 tx=0x7f2e94013000).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:29.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.012+0000 7f2e9b7fe700 1 -- 172.21.15.49:0/4070381911 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2e8c04bf20 con 0x7f2ea4152b40 2023-11-30T17:23:29.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.184+0000 7f2ea9d8b700 1 -- 172.21.15.49:0/4070381911 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ea40c6250 con 0x7f2ea4152b40 2023-11-30T17:23:29.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.185+0000 7f2e9b7fe700 1 -- 172.21.15.49:0/4070381911 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+13758 (secure 0 0 0) 0x7f2e8c04f540 con 0x7f2ea4152b40 2023-11-30T17:23:29.187 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:29.187 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":109,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:23:28.474572+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:23:29.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.186+0000 7f2ea9d8b700 1 -- 172.21.15.49:0/4070381911 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2e8405f270 msgr2=0x7f2e84061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:29.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.186+0000 7f2ea9d8b700 1 --2- 172.21.15.49:0/4070381911 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2e8405f270 0x7f2e84061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f2e94000ef0 tx=0x7f2e94013000).stop 2023-11-30T17:23:29.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.186+0000 7f2ea9d8b700 1 -- 172.21.15.49:0/4070381911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ea4152b40 msgr2=0x7f2ea40978e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:29.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.186+0000 7f2ea9d8b700 1 --2- 172.21.15.49:0/4070381911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ea4152b40 0x7f2ea40978e0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f2e8c011970 tx=0x7f2e8c009060).stop 2023-11-30T17:23:29.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.186+0000 7f2ea9d8b700 1 -- 172.21.15.49:0/4070381911 shutdown_connections 2023-11-30T17:23:29.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.186+0000 7f2ea9d8b700 1 --2- 172.21.15.49:0/4070381911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ea4097dd0 0x7f2ea4098230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:29.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.186+0000 7f2ea9d8b700 1 --2- 172.21.15.49:0/4070381911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e900038e0 0x7f2ea4152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:29.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.186+0000 7f2ea9d8b700 1 --2- 172.21.15.49:0/4070381911 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2e8405f270 0x7f2e84061730 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:29.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.186+0000 7f2ea9d8b700 1 --2- 172.21.15.49:0/4070381911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ea4152b40 0x7f2ea40978e0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:29.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.186+0000 7f2ea9d8b700 1 -- 172.21.15.49:0/4070381911 >> 172.21.15.49:0/4070381911 conn(0x7f2ea4085020 msgr2=0x7f2ea40b0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:29.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.186+0000 7f2ea9d8b700 1 -- 172.21.15.49:0/4070381911 shutdown_connections 2023-11-30T17:23:29.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.186+0000 7f2ea9d8b700 1 -- 172.21.15.49:0/4070381911 wait complete. 2023-11-30T17:23:29.202 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-11-30T17:23:29.202 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T17:23:29.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.322+0000 7fdff4999700 1 Processor -- start 2023-11-30T17:23:29.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.322+0000 7fdff4999700 1 -- start start 2023-11-30T17:23:29.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.323+0000 7fdff4999700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdff00c66f0 0x7fdff0154950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.323+0000 7fdff4999700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff0154e40 con 0x7fdff014e530 2023-11-30T17:23:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.323+0000 7fdff4999700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff00c7bc0 con 0x7fdff0158570 2023-11-30T17:23:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.323+0000 7fdff4999700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff00c6ba0 con 0x7fdff00c66f0 2023-11-30T17:23:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.323+0000 7fdfeeffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdff00c66f0 0x7fdff0154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.323+0000 7fdfef7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdff014e530 0x7fdff014e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48558/0 (socket says 172.21.15.49:48558) 2023-11-30T17:23:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.323+0000 7fdfef7fe700 1 -- 172.21.15.49:0/1514228061 learned_addr learned my addr 172.21.15.49:0/1514228061 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.323+0000 7fdfeeffd700 1 -- 172.21.15.49:0/1514228061 >> v1:172.21.15.115:6789/0 conn(0x7fdff0158570 legacy=0x7fdff00aa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.323+0000 7fdfeeffd700 1 -- 172.21.15.49:0/1514228061 >> v1:172.21.15.49:6789/0 conn(0x7fdff014e530 legacy=0x7fdff014e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.323+0000 7fdfee7fc700 1 -- 172.21.15.49:0/1514228061 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2210755745 0 0) 0x7fdfe0001110 con 0x7fdff014e530 2023-11-30T17:23:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.323+0000 7fdfeeffd700 1 -- 172.21.15.49:0/1514228061 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff0155920 con 0x7fdff00c66f0 2023-11-30T17:23:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.323+0000 7fdfeeffd700 1 --2- 172.21.15.49:0/1514228061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdff00c66f0 0x7fdff0154950 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7fdfe4009760 tx=0x7fdfe4009060).ready entity=mon.0 client_cookie=279c6d6fff389e4e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:29.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.324+0000 7fdfee7fc700 1 -- 172.21.15.49:0/1514228061 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe400b580 con 0x7fdff00c66f0 2023-11-30T17:23:29.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.324+0000 7fdfee7fc700 1 -- 172.21.15.49:0/1514228061 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe400b6e0 con 0x7fdff00c66f0 2023-11-30T17:23:29.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.324+0000 7fdfee7fc700 1 -- 172.21.15.49:0/1514228061 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe400ba60 con 0x7fdff00c66f0 2023-11-30T17:23:29.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.324+0000 7fdff4999700 1 -- 172.21.15.49:0/1514228061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdff00c66f0 msgr2=0x7fdff0154950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:29.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.324+0000 7fdff4999700 1 --2- 172.21.15.49:0/1514228061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdff00c66f0 0x7fdff0154950 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7fdfe4009760 tx=0x7fdfe4009060).stop 2023-11-30T17:23:29.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.324+0000 7fdff4999700 1 -- 172.21.15.49:0/1514228061 shutdown_connections 2023-11-30T17:23:29.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.324+0000 7fdff4999700 1 --2- 172.21.15.49:0/1514228061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdff00c66f0 0x7fdff0154950 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:29.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.324+0000 7fdff4999700 1 -- 172.21.15.49:0/1514228061 >> 172.21.15.49:0/1514228061 conn(0x7fdff0064990 msgr2=0x7fdff0064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:29.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.324+0000 7fdff4999700 1 -- 172.21.15.49:0/1514228061 shutdown_connections 2023-11-30T17:23:29.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.324+0000 7fdff4999700 1 -- 172.21.15.49:0/1514228061 wait complete. 2023-11-30T17:23:29.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.325+0000 7fdff4999700 1 Processor -- start 2023-11-30T17:23:29.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.325+0000 7fdff4999700 1 -- start start 2023-11-30T17:23:29.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.326+0000 7fdff4999700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdff00c66f0 0x7fdff013fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:29.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.326+0000 7fdff4999700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdff014e530 0x7fdff0164d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:29.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.326+0000 7fdff4999700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdff0158570 0x7fdff00c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:29.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.326+0000 7fdff4999700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff0165250 con 0x7fdff00c66f0 2023-11-30T17:23:29.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.326+0000 7fdff4999700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff00c4440 con 0x7fdff0158570 2023-11-30T17:23:29.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.326+0000 7fdff4999700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff00c3ac0 con 0x7fdff014e530 2023-11-30T17:23:29.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.326+0000 7fdfef7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdff00c66f0 0x7fdff013fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:29.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.326+0000 7fdfef7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdff00c66f0 0x7fdff013fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58696/0 (socket says 172.21.15.49:58696) 2023-11-30T17:23:29.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.326+0000 7fdfef7fe700 1 -- 172.21.15.49:0/3381396827 learned_addr learned my addr 172.21.15.49:0/3381396827 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:29.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.327+0000 7fdfeffff700 1 --2- 172.21.15.49:0/3381396827 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdff0158570 0x7fdff00c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:29.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.327+0000 7fdfeeffd700 1 --2- 172.21.15.49:0/3381396827 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdff014e530 0x7fdff0164d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:29.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.327+0000 7fdfef7fe700 1 -- 172.21.15.49:0/3381396827 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdff014e530 msgr2=0x7fdff0164d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:29.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.327+0000 7fdfef7fe700 1 --2- 172.21.15.49:0/3381396827 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdff014e530 0x7fdff0164d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:29.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.327+0000 7fdfef7fe700 1 -- 172.21.15.49:0/3381396827 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdff0158570 msgr2=0x7fdff00c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:29.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.327+0000 7fdfef7fe700 1 --2- 172.21.15.49:0/3381396827 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdff0158570 0x7fdff00c3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:29.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.327+0000 7fdfef7fe700 1 -- 172.21.15.49:0/3381396827 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe40092a0 con 0x7fdff00c66f0 2023-11-30T17:23:29.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.327+0000 7fdfef7fe700 1 --2- 172.21.15.49:0/3381396827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdff00c66f0 0x7fdff013fc60 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7fdfe000c4f0 tx=0x7fdfe0007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:29.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.327+0000 7fdfd77fe700 1 -- 172.21.15.49:0/3381396827 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe00072e0 con 0x7fdff00c66f0 2023-11-30T17:23:29.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.327+0000 7fdfd77fe700 1 -- 172.21.15.49:0/3381396827 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe0007440 con 0x7fdff00c66f0 2023-11-30T17:23:29.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.327+0000 7fdff4999700 1 -- 172.21.15.49:0/3381396827 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff00c2eb0 con 0x7fdff00c66f0 2023-11-30T17:23:29.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.327+0000 7fdfd77fe700 1 -- 172.21.15.49:0/3381396827 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe00057a0 con 0x7fdff00c66f0 2023-11-30T17:23:29.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.327+0000 7fdff4999700 1 -- 172.21.15.49:0/3381396827 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff00c3470 con 0x7fdff00c66f0 2023-11-30T17:23:29.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.328+0000 7fdff4999700 1 -- 172.21.15.49:0/3381396827 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff0062ee0 con 0x7fdff00c66f0 2023-11-30T17:23:29.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.328+0000 7fdfd77fe700 1 -- 172.21.15.49:0/3381396827 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fdfe0005b90 con 0x7fdff00c66f0 2023-11-30T17:23:29.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.329+0000 7fdfd77fe700 1 --2- 172.21.15.49:0/3381396827 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdfdc05f270 0x7fdfdc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:29.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.329+0000 7fdfd77fe700 1 -- 172.21.15.49:0/3381396827 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5297+0+0 (secure 0 0 0) 0x7fdfe0079540 con 0x7fdff00c66f0 2023-11-30T17:23:29.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.329+0000 7fdfeeffd700 1 --2- 172.21.15.49:0/3381396827 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdfdc05f270 0x7fdfdc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:29.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.329+0000 7fdfeeffd700 1 --2- 172.21.15.49:0/3381396827 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdfdc05f270 0x7fdfdc061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fdff0065940 tx=0x7fdfe4017000).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:29.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.333+0000 7fdfd77fe700 1 -- 172.21.15.49:0/3381396827 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdfe004a960 con 0x7fdff00c66f0 2023-11-30T17:23:29.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.508+0000 7fdff4999700 1 -- 172.21.15.49:0/3381396827 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fdff0154e40 con 0x7fdff00c66f0 2023-11-30T17:23:29.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.508+0000 7fdfd77fe700 1 -- 172.21.15.49:0/3381396827 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v109) v1 ==== 110+0+10 (secure 0 0 0) 0x7fdff0154e40 con 0x7fdff00c66f0 2023-11-30T17:23:29.511 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T17:23:29.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.510+0000 7fdff4999700 1 -- 172.21.15.49:0/3381396827 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdfdc05f270 msgr2=0x7fdfdc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:29.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.510+0000 7fdff4999700 1 --2- 172.21.15.49:0/3381396827 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdfdc05f270 0x7fdfdc061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fdff0065940 tx=0x7fdfe4017000).stop 2023-11-30T17:23:29.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.510+0000 7fdff4999700 1 -- 172.21.15.49:0/3381396827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdff00c66f0 msgr2=0x7fdff013fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:29.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.510+0000 7fdff4999700 1 --2- 172.21.15.49:0/3381396827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdff00c66f0 0x7fdff013fc60 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7fdfe000c4f0 tx=0x7fdfe0007a90).stop 2023-11-30T17:23:29.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.510+0000 7fdff4999700 1 -- 172.21.15.49:0/3381396827 shutdown_connections 2023-11-30T17:23:29.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.510+0000 7fdff4999700 1 --2- 172.21.15.49:0/3381396827 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdff0158570 0x7fdff00c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:29.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.510+0000 7fdff4999700 1 --2- 172.21.15.49:0/3381396827 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdfdc05f270 0x7fdfdc061730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:29.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.510+0000 7fdff4999700 1 --2- 172.21.15.49:0/3381396827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdff00c66f0 0x7fdff013fc60 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:29.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.510+0000 7fdff4999700 1 --2- 172.21.15.49:0/3381396827 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdff014e530 0x7fdff0164d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:29.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.510+0000 7fdff4999700 1 -- 172.21.15.49:0/3381396827 >> 172.21.15.49:0/3381396827 conn(0x7fdff0064990 msgr2=0x7fdff01560e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:29.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.510+0000 7fdff4999700 1 -- 172.21.15.49:0/3381396827 shutdown_connections 2023-11-30T17:23:29.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.510+0000 7fdff4999700 1 -- 172.21.15.49:0/3381396827 wait complete. 2023-11-30T17:23:29.524 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T17:23:29.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.642+0000 7f492359e700 1 Processor -- start 2023-11-30T17:23:29.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.642+0000 7f492359e700 1 -- start start 2023-11-30T17:23:29.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.643+0000 7f492359e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f492413db60 0x7f492415f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.643+0000 7f492359e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49241586a0 con 0x7f4924066a30 2023-11-30T17:23:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.643+0000 7f492359e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4924157de0 con 0x7f4924066e10 2023-11-30T17:23:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.643+0000 7f492359e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4924064820 con 0x7f492413db60 2023-11-30T17:23:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.643+0000 7f492259c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4924066a30 0x7f49240c6a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48570/0 (socket says 172.21.15.49:48570) 2023-11-30T17:23:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.643+0000 7f4922d9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f492413db60 0x7f492415f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.643+0000 7f492259c700 1 -- 172.21.15.49:0/1825822994 learned_addr learned my addr 172.21.15.49:0/1825822994 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.643+0000 7f4922d9d700 1 -- 172.21.15.49:0/1825822994 >> v1:172.21.15.115:6789/0 conn(0x7f4924066e10 legacy=0x7f492413d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.643+0000 7f4922d9d700 1 -- 172.21.15.49:0/1825822994 >> v1:172.21.15.49:6789/0 conn(0x7f4924066a30 legacy=0x7f49240c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.643+0000 7f492159a700 1 -- 172.21.15.49:0/1825822994 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3537981183 0 0) 0x7f49241586a0 con 0x7f4924066a30 2023-11-30T17:23:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.643+0000 7f4922d9d700 1 -- 172.21.15.49:0/1825822994 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49240c7140 con 0x7f492413db60 2023-11-30T17:23:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.643+0000 7f4922d9d700 1 --2- 172.21.15.49:0/1825822994 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f492413db60 0x7f492415f0e0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f491c009760 tx=0x7f491c009060).ready entity=mon.0 client_cookie=5a0c4abed1cebb2d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.643+0000 7f492159a700 1 -- 172.21.15.49:0/1825822994 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c00b580 con 0x7f492413db60 2023-11-30T17:23:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.643+0000 7f492159a700 1 -- 172.21.15.49:0/1825822994 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491c00b6e0 con 0x7f492413db60 2023-11-30T17:23:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.643+0000 7f492159a700 1 -- 172.21.15.49:0/1825822994 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c00ba60 con 0x7f492413db60 2023-11-30T17:23:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.644+0000 7f492359e700 1 -- 172.21.15.49:0/1825822994 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f492413db60 msgr2=0x7f492415f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.644+0000 7f492359e700 1 --2- 172.21.15.49:0/1825822994 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f492413db60 0x7f492415f0e0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f491c009760 tx=0x7f491c009060).stop 2023-11-30T17:23:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.644+0000 7f492359e700 1 -- 172.21.15.49:0/1825822994 shutdown_connections 2023-11-30T17:23:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.644+0000 7f492359e700 1 --2- 172.21.15.49:0/1825822994 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f492413db60 0x7f492415f0e0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.644+0000 7f492359e700 1 -- 172.21.15.49:0/1825822994 >> 172.21.15.49:0/1825822994 conn(0x7f49240c8ed0 msgr2=0x7f49240c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.644+0000 7f492359e700 1 -- 172.21.15.49:0/1825822994 shutdown_connections 2023-11-30T17:23:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.644+0000 7f492359e700 1 -- 172.21.15.49:0/1825822994 wait complete. 2023-11-30T17:23:29.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.645+0000 7f492359e700 1 Processor -- start 2023-11-30T17:23:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.645+0000 7f492359e700 1 -- start start 2023-11-30T17:23:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.646+0000 7f492359e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4924066a30 0x7f49240ae580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.646+0000 7f492359e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4924066e10 0x7f4924153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.646+0000 7f492359e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f492413db60 0x7f49240c2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.646+0000 7f492359e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49240ae0f0 con 0x7f4924066e10 2023-11-30T17:23:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.646+0000 7f492359e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492413aea0 con 0x7f492413db60 2023-11-30T17:23:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.646+0000 7f492359e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49240ad4e0 con 0x7f4924066a30 2023-11-30T17:23:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.646+0000 7f4921d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4924066e10 0x7f4924153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.646+0000 7f4921d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4924066e10 0x7f4924153b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58718/0 (socket says 172.21.15.49:58718) 2023-11-30T17:23:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.646+0000 7f4921d9b700 1 -- 172.21.15.49:0/4025337002 learned_addr learned my addr 172.21.15.49:0/4025337002 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.646+0000 7f492259c700 1 --2- 172.21.15.49:0/4025337002 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4924066a30 0x7f49240ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.646+0000 7f4922d9d700 1 --2- 172.21.15.49:0/4025337002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f492413db60 0x7f49240c2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.646+0000 7f4921d9b700 1 -- 172.21.15.49:0/4025337002 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4924066a30 msgr2=0x7f49240ae580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.646+0000 7f4921d9b700 1 --2- 172.21.15.49:0/4025337002 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4924066a30 0x7f49240ae580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.646+0000 7f4921d9b700 1 -- 172.21.15.49:0/4025337002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f492413db60 msgr2=0x7f49240c2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:29.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.646+0000 7f4921d9b700 1 --2- 172.21.15.49:0/4025337002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f492413db60 0x7f49240c2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:29.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.646+0000 7f4921d9b700 1 -- 172.21.15.49:0/4025337002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c0092a0 con 0x7f4924066e10 2023-11-30T17:23:29.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.646+0000 7f4921d9b700 1 --2- 172.21.15.49:0/4025337002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4924066e10 0x7f4924153b50 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f490c00c4c0 tx=0x7f490c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:29.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.647+0000 7f491a7fc700 1 -- 172.21.15.49:0/4025337002 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490c007020 con 0x7f4924066e10 2023-11-30T17:23:29.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.647+0000 7f491a7fc700 1 -- 172.21.15.49:0/4025337002 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490c001e90 con 0x7f4924066e10 2023-11-30T17:23:29.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.647+0000 7f492359e700 1 -- 172.21.15.49:0/4025337002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49240ad7c0 con 0x7f4924066e10 2023-11-30T17:23:29.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.647+0000 7f491a7fc700 1 -- 172.21.15.49:0/4025337002 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490c0073b0 con 0x7f4924066e10 2023-11-30T17:23:29.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.647+0000 7f492359e700 1 -- 172.21.15.49:0/4025337002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49240add80 con 0x7f4924066e10 2023-11-30T17:23:29.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.648+0000 7f492359e700 1 -- 172.21.15.49:0/4025337002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49240ae260 con 0x7f4924066e10 2023-11-30T17:23:29.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.648+0000 7f491a7fc700 1 -- 172.21.15.49:0/4025337002 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f490c0068b0 con 0x7f4924066e10 2023-11-30T17:23:29.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.648+0000 7f491a7fc700 1 --2- 172.21.15.49:0/4025337002 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f490405f270 0x7f4904061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:29.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.648+0000 7f491a7fc700 1 -- 172.21.15.49:0/4025337002 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5297+0+0 (secure 0 0 0) 0x7f490c079a30 con 0x7f4924066e10 2023-11-30T17:23:29.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.649+0000 7f492259c700 1 --2- 172.21.15.49:0/4025337002 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f490405f270 0x7f4904061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:29.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.649+0000 7f492259c700 1 --2- 172.21.15.49:0/4025337002 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f490405f270 0x7f4904061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f4914007fd0 tx=0x7f4914009040).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:29.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.652+0000 7f491a7fc700 1 -- 172.21.15.49:0/4025337002 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f490c07be60 con 0x7f4924066e10 2023-11-30T17:23:29.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.824+0000 7f492359e700 1 -- 172.21.15.49:0/4025337002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f49240674f0 con 0x7f4924066e10 2023-11-30T17:23:29.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.824+0000 7f491a7fc700 1 -- 172.21.15.49:0/4025337002 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v109) v1 ==== 92+0+10 (secure 0 0 0) 0x7f490c04aeb0 con 0x7f4924066e10 2023-11-30T17:23:29.827 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T17:23:29.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.826+0000 7f492359e700 1 -- 172.21.15.49:0/4025337002 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f490405f270 msgr2=0x7f4904061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:29.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.826+0000 7f492359e700 1 --2- 172.21.15.49:0/4025337002 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f490405f270 0x7f4904061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f4914007fd0 tx=0x7f4914009040).stop 2023-11-30T17:23:29.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.826+0000 7f492359e700 1 -- 172.21.15.49:0/4025337002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4924066e10 msgr2=0x7f4924153b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:29.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.826+0000 7f492359e700 1 --2- 172.21.15.49:0/4025337002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4924066e10 0x7f4924153b50 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f490c00c4c0 tx=0x7f490c007e00).stop 2023-11-30T17:23:29.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.826+0000 7f492359e700 1 -- 172.21.15.49:0/4025337002 shutdown_connections 2023-11-30T17:23:29.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.826+0000 7f492359e700 1 --2- 172.21.15.49:0/4025337002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f492413db60 0x7f49240c2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:29.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.826+0000 7f492359e700 1 --2- 172.21.15.49:0/4025337002 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4924066a30 0x7f49240ae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:29.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.826+0000 7f492359e700 1 --2- 172.21.15.49:0/4025337002 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f490405f270 0x7f4904061730 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:29.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.826+0000 7f492359e700 1 --2- 172.21.15.49:0/4025337002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4924066e10 0x7f4924153b50 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:29.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.826+0000 7f492359e700 1 -- 172.21.15.49:0/4025337002 >> 172.21.15.49:0/4025337002 conn(0x7f49240c8ed0 msgr2=0x7f492413bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:29.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.826+0000 7f492359e700 1 -- 172.21.15.49:0/4025337002 shutdown_connections 2023-11-30T17:23:29.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.826+0000 7f492359e700 1 -- 172.21.15.49:0/4025337002 wait complete. 2023-11-30T17:23:29.840 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-30T17:23:29.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.955+0000 7f84341b4700 1 Processor -- start 2023-11-30T17:23:29.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.955+0000 7f84341b4700 1 -- start start 2023-11-30T17:23:29.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.956+0000 7f84341b4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f842c1544e0 0x7f842c1548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:29.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.956+0000 7f84341b4700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f842c06a610 0x7f842c0c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:29.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.956+0000 7f84341b4700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f842c0c69a0 con 0x7f842c0c6e30 2023-11-30T17:23:29.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.956+0000 7f84341b4700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f842c0c13a0 con 0x7f842c06a610 2023-11-30T17:23:29.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.956+0000 7f84341b4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842c0c1680 con 0x7f842c1544e0 2023-11-30T17:23:29.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.956+0000 7f8431f50700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f842c1544e0 0x7f842c1548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:29.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.956+0000 7f843174f700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f842c06a610 0x7f842c0c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:29.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.956+0000 7f8432751700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f842c0c6e30 0x7f842c0a8000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:50894/0 (socket says 172.21.15.49:50894) 2023-11-30T17:23:29.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.956+0000 7f8432751700 1 -- 172.21.15.49:0/2217625011 learned_addr learned my addr 172.21.15.49:0/2217625011 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:29.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.957+0000 7f8430f4e700 1 -- 172.21.15.49:0/2217625011 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3357668221 0 0) 0x7f842c0c69a0 con 0x7f842c0c6e30 2023-11-30T17:23:29.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.957+0000 7f8430f4e700 1 -- 172.21.15.49:0/2217625011 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84180033f0 con 0x7f842c0c6e30 2023-11-30T17:23:29.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.957+0000 7f843174f700 1 -- 172.21.15.49:0/2217625011 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f842c1544e0 msgr2=0x7f842c1548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:29.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.957+0000 7f843174f700 1 --2- 172.21.15.49:0/2217625011 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f842c1544e0 0x7f842c1548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:29.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.957+0000 7f843174f700 1 -- 172.21.15.49:0/2217625011 >> v1:172.21.15.115:6789/0 conn(0x7f842c0c6e30 legacy=0x7f842c0a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:29.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.957+0000 7f843174f700 1 -- 172.21.15.49:0/2217625011 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842c0c6630 con 0x7f842c06a610 2023-11-30T17:23:29.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.957+0000 7f8431f50700 1 --2- 172.21.15.49:0/2217625011 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f842c1544e0 0x7f842c1548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:23:29.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.957+0000 7f843174f700 1 --2- 172.21.15.49:0/2217625011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f842c06a610 0x7f842c0c0bc0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f841c009760 tx=0x7f841c009060).ready entity=mon.1 client_cookie=949fa2cfa677a279 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:29.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.957+0000 7f8430f4e700 1 -- 172.21.15.49:0/2217625011 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c00d4a0 con 0x7f842c06a610 2023-11-30T17:23:29.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.957+0000 7f8430f4e700 1 -- 172.21.15.49:0/2217625011 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841c00d600 con 0x7f842c06a610 2023-11-30T17:23:29.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.957+0000 7f8430f4e700 1 -- 172.21.15.49:0/2217625011 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c00d980 con 0x7f842c06a610 2023-11-30T17:23:29.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.958+0000 7f84341b4700 1 -- 172.21.15.49:0/2217625011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f842c06a610 msgr2=0x7f842c0c0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:29.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.958+0000 7f84341b4700 1 --2- 172.21.15.49:0/2217625011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f842c06a610 0x7f842c0c0bc0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f841c009760 tx=0x7f841c009060).stop 2023-11-30T17:23:29.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.958+0000 7f84341b4700 1 -- 172.21.15.49:0/2217625011 shutdown_connections 2023-11-30T17:23:29.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.958+0000 7f84341b4700 1 --2- 172.21.15.49:0/2217625011 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f842c1544e0 0x7f842c1548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:29.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.958+0000 7f84341b4700 1 --2- 172.21.15.49:0/2217625011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f842c06a610 0x7f842c0c0bc0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:29.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.958+0000 7f84341b4700 1 -- 172.21.15.49:0/2217625011 >> 172.21.15.49:0/2217625011 conn(0x7f842c085020 msgr2=0x7f842c094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:29.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.958+0000 7f84341b4700 1 -- 172.21.15.49:0/2217625011 shutdown_connections 2023-11-30T17:23:29.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.958+0000 7f84341b4700 1 -- 172.21.15.49:0/2217625011 wait complete. 2023-11-30T17:23:29.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.959+0000 7f84341b4700 1 Processor -- start 2023-11-30T17:23:29.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.959+0000 7f84341b4700 1 -- start start 2023-11-30T17:23:29.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.960+0000 7f84341b4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f842c06a610 0x7f842c152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:29.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.960+0000 7f84341b4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f842c0c6e30 0x7f842c153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:29.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.960+0000 7f84341b4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f842c1544e0 0x7f842c164360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:29.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.960+0000 7f84341b4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c153a70 con 0x7f842c0c6e30 2023-11-30T17:23:29.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.960+0000 7f84341b4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c150960 con 0x7f842c06a610 2023-11-30T17:23:29.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.960+0000 7f84341b4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842c164850 con 0x7f842c1544e0 2023-11-30T17:23:29.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.960+0000 7f843174f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f842c0c6e30 0x7f842c153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:29.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.960+0000 7f843174f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f842c0c6e30 0x7f842c153580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58730/0 (socket says 172.21.15.49:58730) 2023-11-30T17:23:29.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.960+0000 7f843174f700 1 -- 172.21.15.49:0/1358842966 learned_addr learned my addr 172.21.15.49:0/1358842966 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:29.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.960+0000 7f8432751700 1 --2- 172.21.15.49:0/1358842966 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f842c1544e0 0x7f842c164360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:29.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.960+0000 7f8431f50700 1 --2- 172.21.15.49:0/1358842966 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f842c06a610 0x7f842c152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:29.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.960+0000 7f843174f700 1 -- 172.21.15.49:0/1358842966 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f842c1544e0 msgr2=0x7f842c164360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.960+0000 7f843174f700 1 --2- 172.21.15.49:0/1358842966 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f842c1544e0 0x7f842c164360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.960+0000 7f843174f700 1 -- 172.21.15.49:0/1358842966 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f842c06a610 msgr2=0x7f842c152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.960+0000 7f843174f700 1 --2- 172.21.15.49:0/1358842966 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f842c06a610 0x7f842c152e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.960+0000 7f843174f700 1 -- 172.21.15.49:0/1358842966 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8428009250 con 0x7f842c0c6e30 2023-11-30T17:23:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.960+0000 7f843174f700 1 --2- 172.21.15.49:0/1358842966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f842c0c6e30 0x7f842c153580 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7f842c05fb30 tx=0x7f841c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.960+0000 7f8421ffb700 1 -- 172.21.15.49:0/1358842966 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c00dd30 con 0x7f842c0c6e30 2023-11-30T17:23:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.960+0000 7f8421ffb700 1 -- 172.21.15.49:0/1358842966 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841c00de90 con 0x7f842c0c6e30 2023-11-30T17:23:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.960+0000 7f84341b4700 1 -- 172.21.15.49:0/1358842966 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f841c0092a0 con 0x7f842c0c6e30 2023-11-30T17:23:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.961+0000 7f8421ffb700 1 -- 172.21.15.49:0/1358842966 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c00d980 con 0x7f842c0c6e30 2023-11-30T17:23:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.961+0000 7f84341b4700 1 -- 172.21.15.49:0/1358842966 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f842c096050 con 0x7f842c0c6e30 2023-11-30T17:23:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.962+0000 7f84341b4700 1 -- 172.21.15.49:0/1358842966 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f842c06c860 con 0x7f842c0c6e30 2023-11-30T17:23:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.962+0000 7f8421ffb700 1 -- 172.21.15.49:0/1358842966 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f841c01d640 con 0x7f842c0c6e30 2023-11-30T17:23:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.962+0000 7f8421ffb700 1 --2- 172.21.15.49:0/1358842966 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f841005f270 0x7f8410061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.962+0000 7f8421ffb700 1 -- 172.21.15.49:0/1358842966 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5297+0+0 (secure 0 0 0) 0x7f841c07b750 con 0x7f842c0c6e30 2023-11-30T17:23:29.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.963+0000 7f8431f50700 1 --2- 172.21.15.49:0/1358842966 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f841005f270 0x7f8410061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:29.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.963+0000 7f8431f50700 1 --2- 172.21.15.49:0/1358842966 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f841005f270 0x7f8410061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f8428006fd0 tx=0x7f8428006f40).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:29.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:29.967+0000 7f8421ffb700 1 -- 172.21.15.49:0/1358842966 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f841c04cb10 con 0x7f842c0c6e30 2023-11-30T17:23:30.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.142+0000 7f84341b4700 1 -- 172.21.15.49:0/1358842966 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f842c0990e0 con 0x7f842c0c6e30 2023-11-30T17:23:30.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.143+0000 7f8421ffb700 1 -- 172.21.15.49:0/1358842966 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v109) v1 ==== 84+0+143 (secure 0 0 0) 0x7f841c050130 con 0x7f842c0c6e30 2023-11-30T17:23:30.145 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:30.145 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-11-30T17:23:30.145 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:23:30.145 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2023-11-30T17:23:30.146 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "device_health_metrics" 2023-11-30T17:23:30.146 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:23:30.146 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:23:30.146 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 2, 2023-11-30T17:23:30.146 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "rbd" 2023-11-30T17:23:30.146 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:23:30.146 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-11-30T17:23:30.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.144+0000 7f84341b4700 1 -- 172.21.15.49:0/1358842966 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f841005f270 msgr2=0x7f8410061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:30.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.144+0000 7f84341b4700 1 --2- 172.21.15.49:0/1358842966 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f841005f270 0x7f8410061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f8428006fd0 tx=0x7f8428006f40).stop 2023-11-30T17:23:30.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.145+0000 7f84341b4700 1 -- 172.21.15.49:0/1358842966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f842c0c6e30 msgr2=0x7f842c153580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:30.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.145+0000 7f84341b4700 1 --2- 172.21.15.49:0/1358842966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f842c0c6e30 0x7f842c153580 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7f842c05fb30 tx=0x7f841c016000).stop 2023-11-30T17:23:30.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.145+0000 7f84341b4700 1 -- 172.21.15.49:0/1358842966 shutdown_connections 2023-11-30T17:23:30.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.145+0000 7f84341b4700 1 --2- 172.21.15.49:0/1358842966 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f842c1544e0 0x7f842c164360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:30.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.145+0000 7f84341b4700 1 --2- 172.21.15.49:0/1358842966 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f842c06a610 0x7f842c152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:30.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.145+0000 7f84341b4700 1 --2- 172.21.15.49:0/1358842966 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f841005f270 0x7f8410061730 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:30.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.145+0000 7f84341b4700 1 --2- 172.21.15.49:0/1358842966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f842c0c6e30 0x7f842c153580 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:30.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.145+0000 7f84341b4700 1 -- 172.21.15.49:0/1358842966 >> 172.21.15.49:0/1358842966 conn(0x7f842c085020 msgr2=0x7f842c0b0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:30.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.145+0000 7f84341b4700 1 -- 172.21.15.49:0/1358842966 shutdown_connections 2023-11-30T17:23:30.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.145+0000 7f84341b4700 1 -- 172.21.15.49:0/1358842966 wait complete. 2023-11-30T17:23:30.159 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-30T17:23:30.159 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-11-30T17:23:30.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.279+0000 7f535d12b700 1 Processor -- start 2023-11-30T17:23:30.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.279+0000 7f535d12b700 1 -- start start 2023-11-30T17:23:30.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.280+0000 7f535d12b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f53581373a0 0x7f53580c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:30.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.280+0000 7f535d12b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5358064b00 0x7f53580c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:30.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.280+0000 7f535d12b700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53580c68d0 con 0x7f53580c5f30 2023-11-30T17:23:30.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.280+0000 7f535d12b700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5358158e20 con 0x7f53581373a0 2023-11-30T17:23:30.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.280+0000 7f535d12b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53581582a0 con 0x7f5358064b00 2023-11-30T17:23:30.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.280+0000 7f5356d9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f53581373a0 0x7f53580c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:30.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.280+0000 7f5356d9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f53581373a0 0x7f53580c72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58742/0 (socket says 172.21.15.49:58742) 2023-11-30T17:23:30.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.280+0000 7f5356d9d700 1 -- 172.21.15.49:0/393488852 learned_addr learned my addr 172.21.15.49:0/393488852 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:30.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.280+0000 7f535759e700 1 --2- 172.21.15.49:0/393488852 >> v2:172.21.15.115:3300/0 conn(0x7f5358064b00 0x7f53580c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:30.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.280+0000 7f5356d9d700 1 -- 172.21.15.49:0/393488852 >> v2:172.21.15.115:3300/0 conn(0x7f5358064b00 msgr2=0x7f53580c63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:30.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.280+0000 7f5356d9d700 1 --2- 172.21.15.49:0/393488852 >> v2:172.21.15.115:3300/0 conn(0x7f5358064b00 0x7f53580c63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:30.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.280+0000 7f5356d9d700 1 -- 172.21.15.49:0/393488852 >> v1:172.21.15.115:6789/0 conn(0x7f53580c5f30 legacy=0x7f53580669a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:30.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.280+0000 7f5356d9d700 1 -- 172.21.15.49:0/393488852 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5358158580 con 0x7f53581373a0 2023-11-30T17:23:30.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.280+0000 7f535759e700 1 --2- 172.21.15.49:0/393488852 >> v2:172.21.15.115:3300/0 conn(0x7f5358064b00 0x7f53580c63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:23:30.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.281+0000 7f5356d9d700 1 --2- 172.21.15.49:0/393488852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53581373a0 0x7f53580c72e0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7f53580c5b00 tx=0x7f5350009840).ready entity=mon.0 client_cookie=45999861b7638d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:30.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.281+0000 7f5355d9b700 1 -- 172.21.15.49:0/393488852 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535000e070 con 0x7f53581373a0 2023-11-30T17:23:30.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.281+0000 7f5355d9b700 1 -- 172.21.15.49:0/393488852 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535000ba50 con 0x7f53581373a0 2023-11-30T17:23:30.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.281+0000 7f5355d9b700 1 -- 172.21.15.49:0/393488852 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535000bdd0 con 0x7f53581373a0 2023-11-30T17:23:30.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.281+0000 7f535d12b700 1 -- 172.21.15.49:0/393488852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53581373a0 msgr2=0x7f53580c72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:30.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.281+0000 7f535d12b700 1 --2- 172.21.15.49:0/393488852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53581373a0 0x7f53580c72e0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7f53580c5b00 tx=0x7f5350009840).stop 2023-11-30T17:23:30.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.281+0000 7f535d12b700 1 -- 172.21.15.49:0/393488852 shutdown_connections 2023-11-30T17:23:30.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.281+0000 7f535d12b700 1 --2- 172.21.15.49:0/393488852 >> v2:172.21.15.115:3300/0 conn(0x7f5358064b00 0x7f53580c63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:30.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.281+0000 7f535d12b700 1 --2- 172.21.15.49:0/393488852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53581373a0 0x7f53580c72e0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:30.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.281+0000 7f535d12b700 1 -- 172.21.15.49:0/393488852 >> 172.21.15.49:0/393488852 conn(0x7f53580628f0 msgr2=0x7f5358062d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:30.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.281+0000 7f535d12b700 1 -- 172.21.15.49:0/393488852 shutdown_connections 2023-11-30T17:23:30.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.281+0000 7f535d12b700 1 -- 172.21.15.49:0/393488852 wait complete. 2023-11-30T17:23:30.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.283+0000 7f535d12b700 1 Processor -- start 2023-11-30T17:23:30.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.283+0000 7f535d12b700 1 -- start start 2023-11-30T17:23:30.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.283+0000 7f535d12b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5358064b00 0x7f53580ac040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:30.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.283+0000 7f535d12b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53580c5f30 0x7f53581355b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:30.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.283+0000 7f535d12b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53581373a0 0x7f53580ae280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:30.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.283+0000 7f535d12b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53580ad2e0 con 0x7f5358064b00 2023-11-30T17:23:30.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.283+0000 7f535d12b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53580ac6d0 con 0x7f53581373a0 2023-11-30T17:23:30.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.283+0000 7f535d12b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53580ac9b0 con 0x7f53580c5f30 2023-11-30T17:23:30.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.283+0000 7f5356d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5358064b00 0x7f53580ac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:30.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.283+0000 7f5356d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5358064b00 0x7f53580ac040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58750/0 (socket says 172.21.15.49:58750) 2023-11-30T17:23:30.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.283+0000 7f5356d9d700 1 -- 172.21.15.49:0/610751008 learned_addr learned my addr 172.21.15.49:0/610751008 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:30.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.284+0000 7f535759e700 1 --2- 172.21.15.49:0/610751008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53581373a0 0x7f53580ae280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:30.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.284+0000 7f535659c700 1 --2- 172.21.15.49:0/610751008 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53580c5f30 0x7f53581355b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:30.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.284+0000 7f5356d9d700 1 -- 172.21.15.49:0/610751008 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53580c5f30 msgr2=0x7f53581355b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:30.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.284+0000 7f5356d9d700 1 --2- 172.21.15.49:0/610751008 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53580c5f30 0x7f53581355b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:30.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.284+0000 7f5356d9d700 1 -- 172.21.15.49:0/610751008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53581373a0 msgr2=0x7f53580ae280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:30.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.284+0000 7f5356d9d700 1 --2- 172.21.15.49:0/610751008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53581373a0 0x7f53580ae280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:30.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.284+0000 7f5356d9d700 1 -- 172.21.15.49:0/610751008 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5350009ae0 con 0x7f5358064b00 2023-11-30T17:23:30.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.284+0000 7f535659c700 1 --2- 172.21.15.49:0/610751008 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53580c5f30 0x7f53581355b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:23:30.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.284+0000 7f5356d9d700 1 --2- 172.21.15.49:0/610751008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5358064b00 0x7f53580ac040 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f5350009fd0 tx=0x7f5350009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:30.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.284+0000 7f534effd700 1 -- 172.21.15.49:0/610751008 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53500032d0 con 0x7f5358064b00 2023-11-30T17:23:30.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.284+0000 7f534effd700 1 -- 172.21.15.49:0/610751008 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535000bbc0 con 0x7f5358064b00 2023-11-30T17:23:30.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.284+0000 7f535d12b700 1 -- 172.21.15.49:0/610751008 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53580acc90 con 0x7f5358064b00 2023-11-30T17:23:30.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.284+0000 7f534effd700 1 -- 172.21.15.49:0/610751008 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535001c400 con 0x7f5358064b00 2023-11-30T17:23:30.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.284+0000 7f535d12b700 1 -- 172.21.15.49:0/610751008 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5358135aa0 con 0x7f5358064b00 2023-11-30T17:23:30.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.285+0000 7f535d12b700 1 -- 172.21.15.49:0/610751008 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5358135c90 con 0x7f5358064b00 2023-11-30T17:23:30.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.285+0000 7f534effd700 1 -- 172.21.15.49:0/610751008 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f535001c830 con 0x7f5358064b00 2023-11-30T17:23:30.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.286+0000 7f534effd700 1 --2- 172.21.15.49:0/610751008 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f533805f270 0x7f5338061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:30.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.286+0000 7f534effd700 1 -- 172.21.15.49:0/610751008 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5297+0+0 (secure 0 0 0) 0x7f535007b830 con 0x7f5358064b00 2023-11-30T17:23:30.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.286+0000 7f535659c700 1 --2- 172.21.15.49:0/610751008 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f533805f270 0x7f5338061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:30.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.286+0000 7f535659c700 1 --2- 172.21.15.49:0/610751008 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f533805f270 0x7f5338061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f5340001730 tx=0x7f5340009040).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:30.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.290+0000 7f534effd700 1 -- 172.21.15.49:0/610751008 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5358135c90 con 0x7f5358064b00 2023-11-30T17:23:30.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.463+0000 7f535d12b700 1 -- 172.21.15.49:0/610751008 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f5358135c90 con 0x7f5358064b00 2023-11-30T17:23:30.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.552+0000 7f534effd700 1 -- 172.21.15.49:0/610751008 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v110) v1 ==== 152+0+0 (secure 0 0 0) 0x7f5358135c90 con 0x7f5358064b00 2023-11-30T17:23:30.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.556+0000 7f535d12b700 1 -- 172.21.15.49:0/610751008 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f533805f270 msgr2=0x7f5338061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:30.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.556+0000 7f535d12b700 1 --2- 172.21.15.49:0/610751008 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f533805f270 0x7f5338061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f5340001730 tx=0x7f5340009040).stop 2023-11-30T17:23:30.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.556+0000 7f535d12b700 1 -- 172.21.15.49:0/610751008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5358064b00 msgr2=0x7f53580ac040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:30.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.556+0000 7f535d12b700 1 --2- 172.21.15.49:0/610751008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5358064b00 0x7f53580ac040 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f5350009fd0 tx=0x7f5350009840).stop 2023-11-30T17:23:30.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.560+0000 7f535d12b700 1 -- 172.21.15.49:0/610751008 shutdown_connections 2023-11-30T17:23:30.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.560+0000 7f535d12b700 1 --2- 172.21.15.49:0/610751008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53581373a0 0x7f53580ae280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:30.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.560+0000 7f535d12b700 1 --2- 172.21.15.49:0/610751008 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f533805f270 0x7f5338061730 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:30.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.560+0000 7f535d12b700 1 --2- 172.21.15.49:0/610751008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5358064b00 0x7f53580ac040 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:30.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.560+0000 7f535d12b700 1 --2- 172.21.15.49:0/610751008 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53580c5f30 0x7f53581355b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:30.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.560+0000 7f535d12b700 1 -- 172.21.15.49:0/610751008 >> 172.21.15.49:0/610751008 conn(0x7f53580628f0 msgr2=0x7f5358150fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:30.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.560+0000 7f535d12b700 1 -- 172.21.15.49:0/610751008 shutdown_connections 2023-11-30T17:23:30.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.560+0000 7f535d12b700 1 -- 172.21.15.49:0/610751008 wait complete. 2023-11-30T17:23:30.565 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2023-11-30T17:23:30.576 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-30T17:23:30.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.698+0000 7f4d1abdb700 1 Processor -- start 2023-11-30T17:23:30.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.698+0000 7f4d1abdb700 1 -- start start 2023-11-30T17:23:30.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.699+0000 7f4d1abdb700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4d14098d10 0x7f4d140c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:30.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.699+0000 7f4d1abdb700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4d140c6190 0x7f4d14063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:30.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.699+0000 7f4d1abdb700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d140c72d0 con 0x7f4d14064350 2023-11-30T17:23:30.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.699+0000 7f4d1abdb700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d14154bc0 con 0x7f4d14098d10 2023-11-30T17:23:30.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.699+0000 7f4d1abdb700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d140c66c0 con 0x7f4d140c6190 2023-11-30T17:23:30.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.699+0000 7f4d18977700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4d14098d10 0x7f4d140c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:30.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.699+0000 7f4d18977700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4d14098d10 0x7f4d140c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35244/0 (socket says 172.21.15.49:35244) 2023-11-30T17:23:30.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.699+0000 7f4d19178700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4d14064350 0x7f4d14158320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48024/0 (socket says 172.21.15.49:48024) 2023-11-30T17:23:30.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.699+0000 7f4d18977700 1 -- 172.21.15.49:0/3212086764 learned_addr learned my addr 172.21.15.49:0/3212086764 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:30.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.700+0000 7f4d13fff700 1 --2- 172.21.15.49:0/3212086764 >> v2:172.21.15.115:3300/0 conn(0x7f4d140c6190 0x7f4d14063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:30.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.700+0000 7f4d18977700 1 -- 172.21.15.49:0/3212086764 >> v2:172.21.15.115:3300/0 conn(0x7f4d140c6190 msgr2=0x7f4d14063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:30.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.700+0000 7f4d18977700 1 --2- 172.21.15.49:0/3212086764 >> v2:172.21.15.115:3300/0 conn(0x7f4d140c6190 0x7f4d14063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:30.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.700+0000 7f4d18977700 1 -- 172.21.15.49:0/3212086764 >> v1:172.21.15.49:6789/0 conn(0x7f4d14064350 legacy=0x7f4d14158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:30.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.700+0000 7f4d18977700 1 -- 172.21.15.49:0/3212086764 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d140c69a0 con 0x7f4d14098d10 2023-11-30T17:23:30.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.700+0000 7f4d137fe700 1 -- 172.21.15.49:0/3212086764 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3659962584 0 0) 0x7f4d140c72d0 con 0x7f4d14064350 2023-11-30T17:23:30.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.700+0000 7f4d18977700 1 --2- 172.21.15.49:0/3212086764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d14098d10 0x7f4d140c7760 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7f4d140c5b40 tx=0x7f4d0c0090f0).ready entity=mon.0 client_cookie=982b8a8d447edd09 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:30.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.700+0000 7f4d137fe700 1 -- 172.21.15.49:0/3212086764 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c00b520 con 0x7f4d14098d10 2023-11-30T17:23:30.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.700+0000 7f4d137fe700 1 -- 172.21.15.49:0/3212086764 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0c00b680 con 0x7f4d14098d10 2023-11-30T17:23:30.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.700+0000 7f4d137fe700 1 -- 172.21.15.49:0/3212086764 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c00ba00 con 0x7f4d14098d10 2023-11-30T17:23:30.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.700+0000 7f4d1abdb700 1 -- 172.21.15.49:0/3212086764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d14098d10 msgr2=0x7f4d140c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:30.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.701+0000 7f4d1abdb700 1 --2- 172.21.15.49:0/3212086764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d14098d10 0x7f4d140c7760 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7f4d140c5b40 tx=0x7f4d0c0090f0).stop 2023-11-30T17:23:30.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.701+0000 7f4d1abdb700 1 -- 172.21.15.49:0/3212086764 shutdown_connections 2023-11-30T17:23:30.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.701+0000 7f4d1abdb700 1 --2- 172.21.15.49:0/3212086764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d14098d10 0x7f4d140c7760 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:30.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.701+0000 7f4d1abdb700 1 --2- 172.21.15.49:0/3212086764 >> v2:172.21.15.115:3300/0 conn(0x7f4d140c6190 0x7f4d14063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:30.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.701+0000 7f4d1abdb700 1 -- 172.21.15.49:0/3212086764 >> 172.21.15.49:0/3212086764 conn(0x7f4d140cb310 msgr2=0x7f4d140cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:30.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.701+0000 7f4d1abdb700 1 -- 172.21.15.49:0/3212086764 shutdown_connections 2023-11-30T17:23:30.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.701+0000 7f4d1abdb700 1 -- 172.21.15.49:0/3212086764 wait complete. 2023-11-30T17:23:30.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.702+0000 7f4d1abdb700 1 Processor -- start 2023-11-30T17:23:30.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.702+0000 7f4d1abdb700 1 -- start start 2023-11-30T17:23:30.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.703+0000 7f4d1abdb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d14064350 0x7f4d140b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:30.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.703+0000 7f4d1abdb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d14098d10 0x7f4d140aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:30.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.703+0000 7f4d1abdb700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d140c6190 0x7f4d1414c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:30.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.703+0000 7f4d1abdb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d141557c0 con 0x7f4d14098d10 2023-11-30T17:23:30.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.703+0000 7f4d1abdb700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d14154e90 con 0x7f4d140c6190 2023-11-30T17:23:30.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.703+0000 7f4d1abdb700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d14155170 con 0x7f4d14064350 2023-11-30T17:23:30.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.703+0000 7f4d13fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d14098d10 0x7f4d140aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:30.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.703+0000 7f4d13fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d14098d10 0x7f4d140aee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35254/0 (socket says 172.21.15.49:35254) 2023-11-30T17:23:30.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.703+0000 7f4d13fff700 1 -- 172.21.15.49:0/3983804871 learned_addr learned my addr 172.21.15.49:0/3983804871 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:30.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.703+0000 7f4d19178700 1 --2- 172.21.15.49:0/3983804871 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d140c6190 0x7f4d1414c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:30.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.703+0000 7f4d18977700 1 --2- 172.21.15.49:0/3983804871 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d14064350 0x7f4d140b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:30.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.703+0000 7f4d13fff700 1 -- 172.21.15.49:0/3983804871 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d14064350 msgr2=0x7f4d140b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:30.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.703+0000 7f4d13fff700 1 --2- 172.21.15.49:0/3983804871 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d14064350 0x7f4d140b0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:30.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.703+0000 7f4d13fff700 1 -- 172.21.15.49:0/3983804871 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d140c6190 msgr2=0x7f4d1414c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:30.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.703+0000 7f4d13fff700 1 --2- 172.21.15.49:0/3983804871 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d140c6190 0x7f4d1414c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:30.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.703+0000 7f4d13fff700 1 -- 172.21.15.49:0/3983804871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c009370 con 0x7f4d14098d10 2023-11-30T17:23:30.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.703+0000 7f4d18977700 1 --2- 172.21.15.49:0/3983804871 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d14064350 0x7f4d140b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:23:30.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.703+0000 7f4d13fff700 1 --2- 172.21.15.49:0/3983804871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d14098d10 0x7f4d140aee90 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f4d04009e10 tx=0x7f4d0400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:30.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.703+0000 7f4d10ff9700 1 -- 172.21.15.49:0/3983804871 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0400cb50 con 0x7f4d14098d10 2023-11-30T17:23:30.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.703+0000 7f4d10ff9700 1 -- 172.21.15.49:0/3983804871 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0400f040 con 0x7f4d14098d10 2023-11-30T17:23:30.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.703+0000 7f4d1abdb700 1 -- 172.21.15.49:0/3983804871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d14155450 con 0x7f4d14098d10 2023-11-30T17:23:30.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.703+0000 7f4d10ff9700 1 -- 172.21.15.49:0/3983804871 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d04013400 con 0x7f4d14098d10 2023-11-30T17:23:30.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.703+0000 7f4d1abdb700 1 -- 172.21.15.49:0/3983804871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d140af380 con 0x7f4d14098d10 2023-11-30T17:23:30.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.705+0000 7f4d1abdb700 1 -- 172.21.15.49:0/3983804871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d1406c860 con 0x7f4d14098d10 2023-11-30T17:23:30.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.705+0000 7f4d10ff9700 1 -- 172.21.15.49:0/3983804871 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4d04013770 con 0x7f4d14098d10 2023-11-30T17:23:30.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.705+0000 7f4d10ff9700 1 --2- 172.21.15.49:0/3983804871 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4cf405f240 0x7f4cf4061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:30.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.706+0000 7f4d10ff9700 1 -- 172.21.15.49:0/3983804871 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5667+0+0 (secure 0 0 0) 0x7f4d0407a980 con 0x7f4d14098d10 2023-11-30T17:23:30.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.706+0000 7f4d18977700 1 --2- 172.21.15.49:0/3983804871 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4cf405f240 0x7f4cf4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:30.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.706+0000 7f4d18977700 1 --2- 172.21.15.49:0/3983804871 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4cf405f240 0x7f4cf4061700 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4d0c009130 tx=0x7f4d0c017000).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:30.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.710+0000 7f4d10ff9700 1 -- 172.21.15.49:0/3983804871 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4d0404bc90 con 0x7f4d14098d10 2023-11-30T17:23:30.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:30.882+0000 7f4d1abdb700 1 -- 172.21.15.49:0/3983804871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4d140c6c80 con 0x7f4d14098d10 2023-11-30T17:23:31.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.560+0000 7f4d10ff9700 1 -- 172.21.15.49:0/3983804871 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v111) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4d0404f2b0 con 0x7f4d14098d10 2023-11-30T17:23:31.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.565+0000 7f4d1abdb700 1 -- 172.21.15.49:0/3983804871 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4cf405f240 msgr2=0x7f4cf4061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:31.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.565+0000 7f4d1abdb700 1 --2- 172.21.15.49:0/3983804871 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4cf405f240 0x7f4cf4061700 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4d0c009130 tx=0x7f4d0c017000).stop 2023-11-30T17:23:31.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.565+0000 7f4d1abdb700 1 -- 172.21.15.49:0/3983804871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d14098d10 msgr2=0x7f4d140aee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:31.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.565+0000 7f4d1abdb700 1 --2- 172.21.15.49:0/3983804871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d14098d10 0x7f4d140aee90 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f4d04009e10 tx=0x7f4d0400b040).stop 2023-11-30T17:23:31.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.567+0000 7f4d1abdb700 1 -- 172.21.15.49:0/3983804871 shutdown_connections 2023-11-30T17:23:31.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.567+0000 7f4d1abdb700 1 --2- 172.21.15.49:0/3983804871 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d140c6190 0x7f4d1414c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:31.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.567+0000 7f4d1abdb700 1 --2- 172.21.15.49:0/3983804871 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d14064350 0x7f4d140b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:31.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.567+0000 7f4d1abdb700 1 --2- 172.21.15.49:0/3983804871 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4cf405f240 0x7f4cf4061700 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:31.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.567+0000 7f4d1abdb700 1 --2- 172.21.15.49:0/3983804871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d14098d10 0x7f4d140aee90 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:31.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.567+0000 7f4d1abdb700 1 -- 172.21.15.49:0/3983804871 >> 172.21.15.49:0/3983804871 conn(0x7f4d140cb310 msgr2=0x7f4d14152d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:31.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.568+0000 7f4d1abdb700 1 -- 172.21.15.49:0/3983804871 shutdown_connections 2023-11-30T17:23:31.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.570+0000 7f4d1abdb700 1 -- 172.21.15.49:0/3983804871 wait complete. 2023-11-30T17:23:31.583 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2023-11-30T17:23:31.596 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-30T17:23:31.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.715+0000 7efc3d321700 1 Processor -- start 2023-11-30T17:23:31.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.715+0000 7efc3d321700 1 -- start start 2023-11-30T17:23:31.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.716+0000 7efc3d321700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efc38098d10 0x7efc380c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:31.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.716+0000 7efc3d321700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc380c6190 0x7efc38063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:31.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.716+0000 7efc3d321700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc380c72d0 con 0x7efc38064350 2023-11-30T17:23:31.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.716+0000 7efc3d321700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc38154bc0 con 0x7efc38098d10 2023-11-30T17:23:31.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.716+0000 7efc3d321700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc380c66c0 con 0x7efc380c6190 2023-11-30T17:23:31.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.716+0000 7efc377fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7efc38064350 0x7efc38158320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48026/0 (socket says 172.21.15.49:48026) 2023-11-30T17:23:31.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.716+0000 7efc377fe700 1 -- 172.21.15.49:0/835081404 learned_addr learned my addr 172.21.15.49:0/835081404 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:31.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.716+0000 7efc367fc700 1 --2- 172.21.15.49:0/835081404 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc380c6190 0x7efc38063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:31.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.716+0000 7efc35ffb700 1 -- 172.21.15.49:0/835081404 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195555308 0 0) 0x7efc380c72d0 con 0x7efc38064350 2023-11-30T17:23:31.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.716+0000 7efc36ffd700 1 --2- 172.21.15.49:0/835081404 >> v2:172.21.15.115:3300/0 conn(0x7efc38098d10 0x7efc380c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:31.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.716+0000 7efc35ffb700 1 -- 172.21.15.49:0/835081404 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc200033f0 con 0x7efc38064350 2023-11-30T17:23:31.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.716+0000 7efc35ffb700 1 -- 172.21.15.49:0/835081404 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4001490799 0 0) 0x7efc200033f0 con 0x7efc38064350 2023-11-30T17:23:31.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.716+0000 7efc35ffb700 1 -- 172.21.15.49:0/835081404 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc380c6190 msgr2=0x7efc38063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:31.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.716+0000 7efc35ffb700 1 --2- 172.21.15.49:0/835081404 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc380c6190 0x7efc38063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:31.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.716+0000 7efc35ffb700 1 -- 172.21.15.49:0/835081404 >> v2:172.21.15.115:3300/0 conn(0x7efc38098d10 msgr2=0x7efc380c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:31.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.716+0000 7efc35ffb700 1 --2- 172.21.15.49:0/835081404 >> v2:172.21.15.115:3300/0 conn(0x7efc38098d10 0x7efc380c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:31.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.716+0000 7efc35ffb700 1 -- 172.21.15.49:0/835081404 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc380c69a0 con 0x7efc38064350 2023-11-30T17:23:31.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.716+0000 7efc35ffb700 1 -- 172.21.15.49:0/835081404 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7efc300017f0 con 0x7efc38064350 2023-11-30T17:23:31.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.716+0000 7efc35ffb700 1 -- 172.21.15.49:0/835081404 >> v1:172.21.15.49:6789/0 conn(0x7efc38064350 legacy=0x7efc38158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:31.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.716+0000 7efc35ffb700 1 --2- 172.21.15.49:0/835081404 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc380c6190 0x7efc200038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:31.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.717+0000 7efc35ffb700 1 --2- 172.21.15.49:0/835081404 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc20003e10 0x7efc20004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:31.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.717+0000 7efc35ffb700 1 --2- 172.21.15.49:0/835081404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc20004b80 0x7efc20005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:31.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.717+0000 7efc35ffb700 1 -- 172.21.15.49:0/835081404 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc38154bc0 con 0x7efc20004b80 2023-11-30T17:23:31.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.717+0000 7efc35ffb700 1 -- 172.21.15.49:0/835081404 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc380c66c0 con 0x7efc20003e10 2023-11-30T17:23:31.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.717+0000 7efc35ffb700 1 -- 172.21.15.49:0/835081404 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2000b8e0 con 0x7efc380c6190 2023-11-30T17:23:31.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.717+0000 7efc377fe700 1 --2- 172.21.15.49:0/835081404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc20004b80 0x7efc20005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:31.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.717+0000 7efc36ffd700 1 --2- 172.21.15.49:0/835081404 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc380c6190 0x7efc200038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:31.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.717+0000 7efc367fc700 1 --2- 172.21.15.49:0/835081404 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc20003e10 0x7efc20004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:31.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.717+0000 7efc377fe700 1 -- 172.21.15.49:0/835081404 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc380c6190 msgr2=0x7efc200038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:31.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.717+0000 7efc377fe700 1 --2- 172.21.15.49:0/835081404 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc380c6190 0x7efc200038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:31.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.717+0000 7efc377fe700 1 -- 172.21.15.49:0/835081404 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc20003e10 msgr2=0x7efc20004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:31.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.717+0000 7efc377fe700 1 --2- 172.21.15.49:0/835081404 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc20003e10 0x7efc20004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:31.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.717+0000 7efc377fe700 1 -- 172.21.15.49:0/835081404 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc200033f0 con 0x7efc20004b80 2023-11-30T17:23:31.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.717+0000 7efc377fe700 1 --2- 172.21.15.49:0/835081404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc20004b80 0x7efc20005000 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7efc3000c560 tx=0x7efc30002210).ready entity=mon.0 client_cookie=e0c9b9f3b47b1399 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:31.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.717+0000 7efc35ffb700 1 -- 172.21.15.49:0/835081404 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc30007de0 con 0x7efc20004b80 2023-11-30T17:23:31.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.717+0000 7efc35ffb700 1 -- 172.21.15.49:0/835081404 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3000ce50 con 0x7efc20004b80 2023-11-30T17:23:31.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.717+0000 7efc35ffb700 1 -- 172.21.15.49:0/835081404 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc30005d50 con 0x7efc20004b80 2023-11-30T17:23:31.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.718+0000 7efc3d321700 1 -- 172.21.15.49:0/835081404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc20004b80 msgr2=0x7efc20005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:31.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.718+0000 7efc3d321700 1 --2- 172.21.15.49:0/835081404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc20004b80 0x7efc20005000 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7efc3000c560 tx=0x7efc30002210).stop 2023-11-30T17:23:31.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.718+0000 7efc377fe700 1 -- 172.21.15.49:0/835081404 reap_dead start 2023-11-30T17:23:31.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.718+0000 7efc3d321700 1 -- 172.21.15.49:0/835081404 shutdown_connections 2023-11-30T17:23:31.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.718+0000 7efc3d321700 1 -- 172.21.15.49:0/835081404 >> 172.21.15.49:0/835081404 conn(0x7efc380cb310 msgr2=0x7efc380cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:31.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.718+0000 7efc3d321700 1 -- 172.21.15.49:0/835081404 shutdown_connections 2023-11-30T17:23:31.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.718+0000 7efc3d321700 1 -- 172.21.15.49:0/835081404 wait complete. 2023-11-30T17:23:31.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.719+0000 7efc3d321700 1 Processor -- start 2023-11-30T17:23:31.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.719+0000 7efc3d321700 1 -- start start 2023-11-30T17:23:31.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.720+0000 7efc3d321700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc3814f7a0 0x7efc380c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:31.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.720+0000 7efc3d321700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc3814fb80 0x7efc380c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:31.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.720+0000 7efc3d321700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc380b0b60 0x7efc380ca380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:31.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.720+0000 7efc3d321700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc380b02d0 con 0x7efc3814fb80 2023-11-30T17:23:31.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.720+0000 7efc3d321700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc380afe40 con 0x7efc3814f7a0 2023-11-30T17:23:31.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.720+0000 7efc3d321700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc380af230 con 0x7efc380b0b60 2023-11-30T17:23:31.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.720+0000 7efc367fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc3814fb80 0x7efc380c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:31.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.720+0000 7efc367fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc3814fb80 0x7efc380c9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35266/0 (socket says 172.21.15.49:35266) 2023-11-30T17:23:31.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.720+0000 7efc367fc700 1 -- 172.21.15.49:0/916443324 learned_addr learned my addr 172.21.15.49:0/916443324 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:31.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.720+0000 7efc36ffd700 1 --2- 172.21.15.49:0/916443324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc3814f7a0 0x7efc380c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:31.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.720+0000 7efc377fe700 1 --2- 172.21.15.49:0/916443324 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc380b0b60 0x7efc380ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:31.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.720+0000 7efc367fc700 1 -- 172.21.15.49:0/916443324 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc380b0b60 msgr2=0x7efc380ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:31.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.720+0000 7efc367fc700 1 --2- 172.21.15.49:0/916443324 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc380b0b60 0x7efc380ca380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:31.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.720+0000 7efc367fc700 1 -- 172.21.15.49:0/916443324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc3814f7a0 msgr2=0x7efc380c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:31.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.720+0000 7efc367fc700 1 --2- 172.21.15.49:0/916443324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc3814f7a0 0x7efc380c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:31.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.720+0000 7efc367fc700 1 -- 172.21.15.49:0/916443324 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc380af510 con 0x7efc3814fb80 2023-11-30T17:23:31.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.720+0000 7efc377fe700 1 --2- 172.21.15.49:0/916443324 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc380b0b60 0x7efc380ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:23:31.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.720+0000 7efc367fc700 1 --2- 172.21.15.49:0/916443324 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc3814fb80 0x7efc380c9e90 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7efc2c0119f0 tx=0x7efc2c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:31.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.720+0000 7efc1effd700 1 -- 172.21.15.49:0/916443324 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2c011e80 con 0x7efc3814fb80 2023-11-30T17:23:31.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.721+0000 7efc1effd700 1 -- 172.21.15.49:0/916443324 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2c00f940 con 0x7efc3814fb80 2023-11-30T17:23:31.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.721+0000 7efc3d321700 1 -- 172.21.15.49:0/916443324 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc380af7f0 con 0x7efc3814fb80 2023-11-30T17:23:31.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.721+0000 7efc1effd700 1 -- 172.21.15.49:0/916443324 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2c00fcc0 con 0x7efc3814fb80 2023-11-30T17:23:31.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.721+0000 7efc3d321700 1 -- 172.21.15.49:0/916443324 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc380ca870 con 0x7efc3814fb80 2023-11-30T17:23:31.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.722+0000 7efc3d321700 1 -- 172.21.15.49:0/916443324 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc380affd0 con 0x7efc3814fb80 2023-11-30T17:23:31.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.722+0000 7efc1effd700 1 -- 172.21.15.49:0/916443324 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7efc2c014650 con 0x7efc3814fb80 2023-11-30T17:23:31.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.723+0000 7efc1effd700 1 --2- 172.21.15.49:0/916443324 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc2405f270 0x7efc24061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:31.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.723+0000 7efc1effd700 1 -- 172.21.15.49:0/916443324 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6049+0+0 (secure 0 0 0) 0x7efc2c07ac70 con 0x7efc3814fb80 2023-11-30T17:23:31.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.723+0000 7efc36ffd700 1 --2- 172.21.15.49:0/916443324 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc2405f270 0x7efc24061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:31.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.723+0000 7efc36ffd700 1 --2- 172.21.15.49:0/916443324 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc2405f270 0x7efc24061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7efc28006d80 tx=0x7efc28009060).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:31.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.727+0000 7efc1effd700 1 -- 172.21.15.49:0/916443324 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efc2c04be00 con 0x7efc3814fb80 2023-11-30T17:23:31.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.941+0000 7efc3d321700 1 -- 172.21.15.49:0/916443324 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7efc3806c860 con 0x7efc3814fb80 2023-11-30T17:23:31.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.952+0000 7efc1effd700 1 -- 172.21.15.49:0/916443324 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v43) v1 ==== 174+0+0 (secure 0 0 0) 0x7efc2c022070 con 0x7efc3814fb80 2023-11-30T17:23:31.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.956+0000 7efc3d321700 1 -- 172.21.15.49:0/916443324 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc2405f270 msgr2=0x7efc24061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:31.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.956+0000 7efc3d321700 1 --2- 172.21.15.49:0/916443324 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc2405f270 0x7efc24061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7efc28006d80 tx=0x7efc28009060).stop 2023-11-30T17:23:31.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.956+0000 7efc3d321700 1 -- 172.21.15.49:0/916443324 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc3814fb80 msgr2=0x7efc380c9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:31.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.956+0000 7efc3d321700 1 --2- 172.21.15.49:0/916443324 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc3814fb80 0x7efc380c9e90 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7efc2c0119f0 tx=0x7efc2c009060).stop 2023-11-30T17:23:31.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.957+0000 7efc3d321700 1 -- 172.21.15.49:0/916443324 shutdown_connections 2023-11-30T17:23:31.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.957+0000 7efc3d321700 1 --2- 172.21.15.49:0/916443324 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc380b0b60 0x7efc380ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:31.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.957+0000 7efc3d321700 1 --2- 172.21.15.49:0/916443324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc3814f7a0 0x7efc380c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:31.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.957+0000 7efc3d321700 1 --2- 172.21.15.49:0/916443324 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efc2405f270 0x7efc24061730 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0x7efc28006d80 tx=0x7efc28009060).stop 2023-11-30T17:23:31.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.957+0000 7efc3d321700 1 --2- 172.21.15.49:0/916443324 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc3814fb80 0x7efc380c9e90 secure :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 rx=0x7efc2c0119f0 tx=0x7efc2c009060).stop 2023-11-30T17:23:31.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.957+0000 7efc3d321700 1 -- 172.21.15.49:0/916443324 >> 172.21.15.49:0/916443324 conn(0x7efc380cb310 msgr2=0x7efc380c0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:31.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.960+0000 7efc3d321700 1 -- 172.21.15.49:0/916443324 shutdown_connections 2023-11-30T17:23:31.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:31.960+0000 7efc3d321700 1 -- 172.21.15.49:0/916443324 wait complete. 2023-11-30T17:23:31.977 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 13 and data pool 14 2023-11-30T17:23:31.988 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:23:32.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.103+0000 7f8912864700 1 Processor -- start 2023-11-30T17:23:32.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.103+0000 7f8912864700 1 -- start start 2023-11-30T17:23:32.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.103+0000 7f8912864700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f890c1544d0 0x7f890c155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:32.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.103+0000 7f8912864700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f890c0673c0 0x7f890c15e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:32.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.103+0000 7f8912864700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f890c0683d0 con 0x7f890c066f40 2023-11-30T17:23:32.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.103+0000 7f8912864700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f890c067850 con 0x7f890c1544d0 2023-11-30T17:23:32.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.103+0000 7f8912864700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f890c067b30 con 0x7f890c0673c0 2023-11-30T17:23:32.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.104+0000 7f890b7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f890c066f40 0x7f890c095e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48030/0 (socket says 172.21.15.49:48030) 2023-11-30T17:23:32.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.104+0000 7f890b7fe700 1 -- 172.21.15.49:0/1598829186 learned_addr learned my addr 172.21.15.49:0/1598829186 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:32.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.104+0000 7f890bfff700 1 --2- 172.21.15.49:0/1598829186 >> v2:172.21.15.115:3300/0 conn(0x7f890c1544d0 0x7f890c155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:32.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.104+0000 7f8910e01700 1 --2- 172.21.15.49:0/1598829186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f890c0673c0 0x7f890c15e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:32.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.104+0000 7f890affd700 1 -- 172.21.15.49:0/1598829186 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916855217 0 0) 0x7f890c0683d0 con 0x7f890c066f40 2023-11-30T17:23:32.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.104+0000 7f890affd700 1 -- 172.21.15.49:0/1598829186 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88f40033f0 con 0x7f890c066f40 2023-11-30T17:23:32.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.104+0000 7f890affd700 1 -- 172.21.15.49:0/1598829186 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1128572510 0 0) 0x7f88f40033f0 con 0x7f890c066f40 2023-11-30T17:23:32.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.104+0000 7f890affd700 1 -- 172.21.15.49:0/1598829186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f890c0673c0 msgr2=0x7f890c15e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:32.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.104+0000 7f890affd700 1 --2- 172.21.15.49:0/1598829186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f890c0673c0 0x7f890c15e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:32.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.104+0000 7f890affd700 1 -- 172.21.15.49:0/1598829186 >> v2:172.21.15.115:3300/0 conn(0x7f890c1544d0 msgr2=0x7f890c155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:32.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.104+0000 7f890affd700 1 --2- 172.21.15.49:0/1598829186 >> v2:172.21.15.115:3300/0 conn(0x7f890c1544d0 0x7f890c155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:32.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.104+0000 7f890affd700 1 -- 172.21.15.49:0/1598829186 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f890c067e10 con 0x7f890c066f40 2023-11-30T17:23:32.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.104+0000 7f890affd700 1 -- 172.21.15.49:0/1598829186 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f8900001470 con 0x7f890c066f40 2023-11-30T17:23:32.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.104+0000 7f890affd700 1 -- 172.21.15.49:0/1598829186 >> v1:172.21.15.49:6789/0 conn(0x7f890c066f40 legacy=0x7f890c095e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:32.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.104+0000 7f890affd700 1 --2- 172.21.15.49:0/1598829186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88f40038e0 0x7f88f4003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:32.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.104+0000 7f890affd700 1 --2- 172.21.15.49:0/1598829186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88f40041f0 0x7f88f40046d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:32.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.104+0000 7f890affd700 1 --2- 172.21.15.49:0/1598829186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88f4004cf0 0x7f88f4005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:32.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.104+0000 7f890affd700 1 -- 172.21.15.49:0/1598829186 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890c067850 con 0x7f88f40041f0 2023-11-30T17:23:32.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.104+0000 7f890affd700 1 -- 172.21.15.49:0/1598829186 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890c067b30 con 0x7f88f4004cf0 2023-11-30T17:23:32.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.104+0000 7f890affd700 1 -- 172.21.15.49:0/1598829186 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f400bc20 con 0x7f88f40038e0 2023-11-30T17:23:32.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.104+0000 7f890b7fe700 1 --2- 172.21.15.49:0/1598829186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88f40041f0 0x7f88f40046d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:32.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.104+0000 7f8910e01700 1 --2- 172.21.15.49:0/1598829186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88f4004cf0 0x7f88f4005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:32.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.105+0000 7f890bfff700 1 --2- 172.21.15.49:0/1598829186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88f40038e0 0x7f88f4003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:32.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.105+0000 7f890b7fe700 1 -- 172.21.15.49:0/1598829186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88f40038e0 msgr2=0x7f88f4003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:32.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.105+0000 7f890b7fe700 1 --2- 172.21.15.49:0/1598829186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88f40038e0 0x7f88f4003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:32.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.105+0000 7f890b7fe700 1 -- 172.21.15.49:0/1598829186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88f4004cf0 msgr2=0x7f88f4005170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:32.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.105+0000 7f890b7fe700 1 --2- 172.21.15.49:0/1598829186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88f4004cf0 0x7f88f4005170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:32.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.105+0000 7f890b7fe700 1 -- 172.21.15.49:0/1598829186 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f40033f0 con 0x7f88f40041f0 2023-11-30T17:23:32.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.105+0000 7f890b7fe700 1 --2- 172.21.15.49:0/1598829186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88f40041f0 0x7f88f40046d0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f890000c210 tx=0x7f8900001e90).ready entity=mon.0 client_cookie=160e2fe6229ce2c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:32.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.105+0000 7f890affd700 1 -- 172.21.15.49:0/1598829186 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8900007a60 con 0x7f88f40041f0 2023-11-30T17:23:32.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.105+0000 7f890affd700 1 -- 172.21.15.49:0/1598829186 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890000cae0 con 0x7f88f40041f0 2023-11-30T17:23:32.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.105+0000 7f890affd700 1 -- 172.21.15.49:0/1598829186 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890000ce60 con 0x7f88f40041f0 2023-11-30T17:23:32.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.106+0000 7f8912864700 1 -- 172.21.15.49:0/1598829186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88f40041f0 msgr2=0x7f88f40046d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:32.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.106+0000 7f8912864700 1 --2- 172.21.15.49:0/1598829186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88f40041f0 0x7f88f40046d0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f890000c210 tx=0x7f8900001e90).stop 2023-11-30T17:23:32.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.106+0000 7f8910e01700 1 -- 172.21.15.49:0/1598829186 reap_dead start 2023-11-30T17:23:32.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.106+0000 7f8912864700 1 -- 172.21.15.49:0/1598829186 shutdown_connections 2023-11-30T17:23:32.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.106+0000 7f8912864700 1 -- 172.21.15.49:0/1598829186 >> 172.21.15.49:0/1598829186 conn(0x7f890c0631d0 msgr2=0x7f890c0c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:32.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.106+0000 7f8912864700 1 -- 172.21.15.49:0/1598829186 shutdown_connections 2023-11-30T17:23:32.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.106+0000 7f8912864700 1 -- 172.21.15.49:0/1598829186 wait complete. 2023-11-30T17:23:32.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.107+0000 7f8912864700 1 Processor -- start 2023-11-30T17:23:32.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.107+0000 7f8912864700 1 -- start start 2023-11-30T17:23:32.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.108+0000 7f8912864700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88f40041f0 0x7f890c0bf040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:32.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.108+0000 7f8912864700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f890c14ea20 0x7f890c0bf530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:32.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.108+0000 7f8912864700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f890c1517a0 0x7f890c151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:32.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.108+0000 7f8912864700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890c0bfa20 con 0x7f890c1517a0 2023-11-30T17:23:32.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.108+0000 7f8912864700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890c0ac330 con 0x7f890c14ea20 2023-11-30T17:23:32.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.108+0000 7f8912864700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f890c0acb90 con 0x7f88f40041f0 2023-11-30T17:23:32.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.108+0000 7f8910e01700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f890c1517a0 0x7f890c151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:32.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.108+0000 7f8910e01700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f890c1517a0 0x7f890c151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35280/0 (socket says 172.21.15.49:35280) 2023-11-30T17:23:32.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.108+0000 7f890bfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88f40041f0 0x7f890c0bf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:32.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.108+0000 7f8910e01700 1 -- 172.21.15.49:0/3626500260 learned_addr learned my addr 172.21.15.49:0/3626500260 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:32.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.108+0000 7f890b7fe700 1 --2- 172.21.15.49:0/3626500260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f890c14ea20 0x7f890c0bf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:32.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.108+0000 7f8910e01700 1 -- 172.21.15.49:0/3626500260 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88f40041f0 msgr2=0x7f890c0bf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:32.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.108+0000 7f8910e01700 1 --2- 172.21.15.49:0/3626500260 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88f40041f0 0x7f890c0bf040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:32.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.108+0000 7f8910e01700 1 -- 172.21.15.49:0/3626500260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f890c14ea20 msgr2=0x7f890c0bf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:32.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.108+0000 7f8910e01700 1 --2- 172.21.15.49:0/3626500260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f890c14ea20 0x7f890c0bf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:32.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.108+0000 7f8910e01700 1 -- 172.21.15.49:0/3626500260 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f890c152510 con 0x7f890c1517a0 2023-11-30T17:23:32.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.108+0000 7f8910e01700 1 --2- 172.21.15.49:0/3626500260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f890c1517a0 0x7f890c151c20 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7f890c0c6f10 tx=0x7f890400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:32.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.108+0000 7f88f3fff700 1 -- 172.21.15.49:0/3626500260 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890400e040 con 0x7f890c1517a0 2023-11-30T17:23:32.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.108+0000 7f88f3fff700 1 -- 172.21.15.49:0/3626500260 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890400f040 con 0x7f890c1517a0 2023-11-30T17:23:32.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.108+0000 7f8912864700 1 -- 172.21.15.49:0/3626500260 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f890c0ac540 con 0x7f890c1517a0 2023-11-30T17:23:32.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.109+0000 7f88f3fff700 1 -- 172.21.15.49:0/3626500260 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890400fdc0 con 0x7f890c1517a0 2023-11-30T17:23:32.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.109+0000 7f8912864700 1 -- 172.21.15.49:0/3626500260 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f890c1527f0 con 0x7f890c1517a0 2023-11-30T17:23:32.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.110+0000 7f8912864700 1 -- 172.21.15.49:0/3626500260 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f890c06c860 con 0x7f890c1517a0 2023-11-30T17:23:32.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.110+0000 7f88f3fff700 1 -- 172.21.15.49:0/3626500260 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8904015660 con 0x7f890c1517a0 2023-11-30T17:23:32.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.110+0000 7f88f3fff700 1 --2- 172.21.15.49:0/3626500260 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f88f805f270 0x7f88f8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:32.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.110+0000 7f88f3fff700 1 -- 172.21.15.49:0/3626500260 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f890407adf0 con 0x7f890c1517a0 2023-11-30T17:23:32.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.111+0000 7f890bfff700 1 --2- 172.21.15.49:0/3626500260 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f88f805f270 0x7f88f8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:32.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.111+0000 7f890bfff700 1 --2- 172.21.15.49:0/3626500260 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f88f805f270 0x7f88f8061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f88fc006d20 tx=0x7f88fc006f40).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:32.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.114+0000 7f88f3fff700 1 -- 172.21.15.49:0/3626500260 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f890404bf20 con 0x7f890c1517a0 2023-11-30T17:23:32.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.288+0000 7f8912864700 1 -- 172.21.15.49:0/3626500260 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f890c0accd0 con 0x7f890c1517a0 2023-11-30T17:23:32.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.289+0000 7f88f3fff700 1 -- 172.21.15.49:0/3626500260 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16999 (secure 0 0 0) 0x7f890404f540 con 0x7f890c1517a0 2023-11-30T17:23:32.292 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:32.292 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":112,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:23:31.943039+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:23:30.500365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-30T17:23:30.919592+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:23:32.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.291+0000 7f8912864700 1 -- 172.21.15.49:0/3626500260 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f88f805f270 msgr2=0x7f88f8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:32.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.291+0000 7f8912864700 1 --2- 172.21.15.49:0/3626500260 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f88f805f270 0x7f88f8061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f88fc006d20 tx=0x7f88fc006f40).stop 2023-11-30T17:23:32.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.291+0000 7f8912864700 1 -- 172.21.15.49:0/3626500260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f890c1517a0 msgr2=0x7f890c151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:32.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.291+0000 7f8912864700 1 --2- 172.21.15.49:0/3626500260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f890c1517a0 0x7f890c151c20 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7f890c0c6f10 tx=0x7f890400b040).stop 2023-11-30T17:23:32.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.291+0000 7f8912864700 1 -- 172.21.15.49:0/3626500260 shutdown_connections 2023-11-30T17:23:32.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.291+0000 7f8912864700 1 --2- 172.21.15.49:0/3626500260 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f88f805f270 0x7f88f8061730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:32.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.291+0000 7f8912864700 1 --2- 172.21.15.49:0/3626500260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f890c1517a0 0x7f890c151c20 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:32.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.291+0000 7f8912864700 1 --2- 172.21.15.49:0/3626500260 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88f40041f0 0x7f890c0bf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:32.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.291+0000 7f8912864700 1 --2- 172.21.15.49:0/3626500260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f890c14ea20 0x7f890c0bf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:32.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.291+0000 7f8912864700 1 -- 172.21.15.49:0/3626500260 >> 172.21.15.49:0/3626500260 conn(0x7f890c0631d0 msgr2=0x7f890c0c7840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:32.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.292+0000 7f8912864700 1 -- 172.21.15.49:0/3626500260 shutdown_connections 2023-11-30T17:23:32.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.292+0000 7f8912864700 1 -- 172.21.15.49:0/3626500260 wait complete. 2023-11-30T17:23:32.306 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:23:32.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.421+0000 7fcea0bd5700 1 Processor -- start 2023-11-30T17:23:32.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.421+0000 7fcea0bd5700 1 -- start start 2023-11-30T17:23:32.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.422+0000 7fcea0bd5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fce9c156a80 0x7fce9c0a3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:32.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.422+0000 7fcea0bd5700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce9c0bbed0 con 0x7fce9c0686e0 2023-11-30T17:23:32.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.422+0000 7fcea0bd5700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce9c0bc1b0 con 0x7fce9c152230 2023-11-30T17:23:32.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.422+0000 7fcea0bd5700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce9c0a4290 con 0x7fce9c156a80 2023-11-30T17:23:32.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.423+0000 7fce99d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fce9c156a80 0x7fce9c0a3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:32.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.423+0000 7fce9ad9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fce9c0686e0 0x7fce9c0bcc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48044/0 (socket says 172.21.15.49:48044) 2023-11-30T17:23:32.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.423+0000 7fce9ad9d700 1 -- 172.21.15.49:0/448368820 learned_addr learned my addr 172.21.15.49:0/448368820 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:32.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.423+0000 7fce99d9b700 1 -- 172.21.15.49:0/448368820 >> v1:172.21.15.115:6789/0 conn(0x7fce9c152230 legacy=0x7fce9c066250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:32.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.423+0000 7fce99d9b700 1 -- 172.21.15.49:0/448368820 >> v1:172.21.15.49:6789/0 conn(0x7fce9c0686e0 legacy=0x7fce9c0bcc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:32.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.423+0000 7fce9959a700 1 -- 172.21.15.49:0/448368820 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3536681757 0 0) 0x7fce9c0bbed0 con 0x7fce9c0686e0 2023-11-30T17:23:32.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.423+0000 7fce99d9b700 1 -- 172.21.15.49:0/448368820 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9c0bc490 con 0x7fce9c156a80 2023-11-30T17:23:32.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.423+0000 7fce99d9b700 1 --2- 172.21.15.49:0/448368820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce9c156a80 0x7fce9c0a3da0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7fce84009760 tx=0x7fce84009060).ready entity=mon.0 client_cookie=ba22845577b4cd55 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:32.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.423+0000 7fce9959a700 1 -- 172.21.15.49:0/448368820 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8400b580 con 0x7fce9c156a80 2023-11-30T17:23:32.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.423+0000 7fce9959a700 1 -- 172.21.15.49:0/448368820 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8400b6e0 con 0x7fce9c156a80 2023-11-30T17:23:32.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.423+0000 7fce9959a700 1 -- 172.21.15.49:0/448368820 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8400ba60 con 0x7fce9c156a80 2023-11-30T17:23:32.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.424+0000 7fcea0bd5700 1 -- 172.21.15.49:0/448368820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce9c156a80 msgr2=0x7fce9c0a3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:32.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.424+0000 7fcea0bd5700 1 --2- 172.21.15.49:0/448368820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce9c156a80 0x7fce9c0a3da0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7fce84009760 tx=0x7fce84009060).stop 2023-11-30T17:23:32.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.424+0000 7fcea0bd5700 1 -- 172.21.15.49:0/448368820 shutdown_connections 2023-11-30T17:23:32.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.424+0000 7fcea0bd5700 1 --2- 172.21.15.49:0/448368820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce9c156a80 0x7fce9c0a3da0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:32.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.424+0000 7fcea0bd5700 1 -- 172.21.15.49:0/448368820 >> 172.21.15.49:0/448368820 conn(0x7fce9c0631d0 msgr2=0x7fce9c0c6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:32.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.424+0000 7fcea0bd5700 1 -- 172.21.15.49:0/448368820 shutdown_connections 2023-11-30T17:23:32.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.424+0000 7fcea0bd5700 1 -- 172.21.15.49:0/448368820 wait complete. 2023-11-30T17:23:32.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.425+0000 7fcea0bd5700 1 Processor -- start 2023-11-30T17:23:32.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.425+0000 7fcea0bd5700 1 -- start start 2023-11-30T17:23:32.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.426+0000 7fcea0bd5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce9c0686e0 0x7fce9c148510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:32.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.426+0000 7fcea0bd5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce9c152230 0x7fce9c166560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:32.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.426+0000 7fcea0bd5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce9c156a80 0x7fce9c14a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:32.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.426+0000 7fcea0bd5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c0c0ba0 con 0x7fce9c0686e0 2023-11-30T17:23:32.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.426+0000 7fcea0bd5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c166a50 con 0x7fce9c156a80 2023-11-30T17:23:32.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.426+0000 7fcea0bd5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c14fb40 con 0x7fce9c152230 2023-11-30T17:23:32.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.426+0000 7fce9a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce9c0686e0 0x7fce9c148510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:32.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.426+0000 7fce9a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce9c0686e0 0x7fce9c148510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35296/0 (socket says 172.21.15.49:35296) 2023-11-30T17:23:32.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.426+0000 7fce9a59c700 1 -- 172.21.15.49:0/3412342613 learned_addr learned my addr 172.21.15.49:0/3412342613 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:32.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.426+0000 7fce9ad9d700 1 --2- 172.21.15.49:0/3412342613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce9c156a80 0x7fce9c14a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:32.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.426+0000 7fce99d9b700 1 --2- 172.21.15.49:0/3412342613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce9c152230 0x7fce9c166560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:32.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.426+0000 7fce9a59c700 1 -- 172.21.15.49:0/3412342613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce9c152230 msgr2=0x7fce9c166560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:32.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.426+0000 7fce9a59c700 1 --2- 172.21.15.49:0/3412342613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce9c152230 0x7fce9c166560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:32.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.426+0000 7fce9a59c700 1 -- 172.21.15.49:0/3412342613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce9c156a80 msgr2=0x7fce9c14a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:32.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.426+0000 7fce9a59c700 1 --2- 172.21.15.49:0/3412342613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce9c156a80 0x7fce9c14a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:32.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.426+0000 7fce9a59c700 1 -- 172.21.15.49:0/3412342613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce840092a0 con 0x7fce9c0686e0 2023-11-30T17:23:32.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.426+0000 7fce9a59c700 1 --2- 172.21.15.49:0/3412342613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce9c0686e0 0x7fce9c148510 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7fce9400c4c0 tx=0x7fce94007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:32.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.426+0000 7fce927fc700 1 -- 172.21.15.49:0/3412342613 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce94007020 con 0x7fce9c0686e0 2023-11-30T17:23:32.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.426+0000 7fce927fc700 1 -- 172.21.15.49:0/3412342613 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce94001e90 con 0x7fce9c0686e0 2023-11-30T17:23:32.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.426+0000 7fce927fc700 1 -- 172.21.15.49:0/3412342613 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce940073d0 con 0x7fce9c0686e0 2023-11-30T17:23:32.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.426+0000 7fcea0bd5700 1 -- 172.21.15.49:0/3412342613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce9c14fe20 con 0x7fce9c0686e0 2023-11-30T17:23:32.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.426+0000 7fcea0bd5700 1 -- 172.21.15.49:0/3412342613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce9c0c04e0 con 0x7fce9c0686e0 2023-11-30T17:23:32.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.428+0000 7fcea0bd5700 1 -- 172.21.15.49:0/3412342613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce9c06c860 con 0x7fce9c0686e0 2023-11-30T17:23:32.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.428+0000 7fce927fc700 1 -- 172.21.15.49:0/3412342613 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fce940068b0 con 0x7fce9c0686e0 2023-11-30T17:23:32.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.428+0000 7fce927fc700 1 --2- 172.21.15.49:0/3412342613 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fce7c05f270 0x7fce7c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:32.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.428+0000 7fce927fc700 1 -- 172.21.15.49:0/3412342613 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fce94079d40 con 0x7fce9c0686e0 2023-11-30T17:23:32.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.428+0000 7fce99d9b700 1 --2- 172.21.15.49:0/3412342613 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fce7c05f270 0x7fce7c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:32.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.429+0000 7fce99d9b700 1 --2- 172.21.15.49:0/3412342613 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fce7c05f270 0x7fce7c061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fce9c1501b0 tx=0x7fce84017000).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:32.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.432+0000 7fce927fc700 1 -- 172.21.15.49:0/3412342613 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fce9407d030 con 0x7fce9c0686e0 2023-11-30T17:23:32.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.607+0000 7fcea0bd5700 1 -- 172.21.15.49:0/3412342613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce9c0bc770 con 0x7fce9c0686e0 2023-11-30T17:23:32.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.608+0000 7fce927fc700 1 -- 172.21.15.49:0/3412342613 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16999 (secure 0 0 0) 0x7fce9404ae70 con 0x7fce9c0686e0 2023-11-30T17:23:32.611 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:32.611 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":112,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:23:31.943039+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:23:30.500365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-30T17:23:30.919592+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:23:32.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.610+0000 7fcea0bd5700 1 -- 172.21.15.49:0/3412342613 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fce7c05f270 msgr2=0x7fce7c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:32.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.610+0000 7fcea0bd5700 1 --2- 172.21.15.49:0/3412342613 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fce7c05f270 0x7fce7c061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fce9c1501b0 tx=0x7fce84017000).stop 2023-11-30T17:23:32.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.610+0000 7fcea0bd5700 1 -- 172.21.15.49:0/3412342613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce9c0686e0 msgr2=0x7fce9c148510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:32.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.610+0000 7fcea0bd5700 1 --2- 172.21.15.49:0/3412342613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce9c0686e0 0x7fce9c148510 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7fce9400c4c0 tx=0x7fce94007e00).stop 2023-11-30T17:23:32.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.610+0000 7fcea0bd5700 1 -- 172.21.15.49:0/3412342613 shutdown_connections 2023-11-30T17:23:32.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.610+0000 7fcea0bd5700 1 --2- 172.21.15.49:0/3412342613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce9c156a80 0x7fce9c14a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:32.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.610+0000 7fcea0bd5700 1 --2- 172.21.15.49:0/3412342613 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fce7c05f270 0x7fce7c061730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:32.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.610+0000 7fcea0bd5700 1 --2- 172.21.15.49:0/3412342613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce9c0686e0 0x7fce9c148510 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:32.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.610+0000 7fcea0bd5700 1 --2- 172.21.15.49:0/3412342613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce9c152230 0x7fce9c166560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:32.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.610+0000 7fcea0bd5700 1 -- 172.21.15.49:0/3412342613 >> 172.21.15.49:0/3412342613 conn(0x7fce9c0631d0 msgr2=0x7fce9c0a52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:32.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.610+0000 7fcea0bd5700 1 -- 172.21.15.49:0/3412342613 shutdown_connections 2023-11-30T17:23:32.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.610+0000 7fcea0bd5700 1 -- 172.21.15.49:0/3412342613 wait complete. 2023-11-30T17:23:32.625 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-30T17:23:32.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.743+0000 7f634dd00700 1 Processor -- start 2023-11-30T17:23:32.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.743+0000 7f634dd00700 1 -- start start 2023-11-30T17:23:32.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.744+0000 7f634dd00700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63481547f0 0x7f63480a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:32.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.744+0000 7f634dd00700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f63480c86f0 0x7f63480c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:32.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.744+0000 7f634dd00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63480c7e30 con 0x7f6348062700 2023-11-30T17:23:32.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.744+0000 7f634dd00700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63480bcf40 con 0x7f63480c86f0 2023-11-30T17:23:32.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.744+0000 7f634dd00700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63480c6b20 con 0x7f63481547f0 2023-11-30T17:23:32.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.744+0000 7f6347fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6348062700 0x7f63480a4db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48056/0 (socket says 172.21.15.49:48056) 2023-11-30T17:23:32.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.744+0000 7f6347fff700 1 -- 172.21.15.49:0/488488778 learned_addr learned my addr 172.21.15.49:0/488488778 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:32.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.745+0000 7f6346ffd700 1 --2- 172.21.15.49:0/488488778 >> v2:172.21.15.115:3300/0 conn(0x7f63480c86f0 0x7f63480c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:32.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.745+0000 7f63477fe700 1 --2- 172.21.15.49:0/488488778 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63481547f0 0x7f63480a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:32.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.745+0000 7f63467fc700 1 -- 172.21.15.49:0/488488778 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1974366933 0 0) 0x7f63480c7e30 con 0x7f6348062700 2023-11-30T17:23:32.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.745+0000 7f63467fc700 1 -- 172.21.15.49:0/488488778 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63300033f0 con 0x7f6348062700 2023-11-30T17:23:32.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.745+0000 7f63467fc700 1 -- 172.21.15.49:0/488488778 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3433850881 0 0) 0x7f63300033f0 con 0x7f6348062700 2023-11-30T17:23:32.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.745+0000 7f6346ffd700 1 -- 172.21.15.49:0/488488778 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63481547f0 msgr2=0x7f63480a72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:32.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.745+0000 7f6346ffd700 1 --2- 172.21.15.49:0/488488778 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63481547f0 0x7f63480a72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:32.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.745+0000 7f6346ffd700 1 -- 172.21.15.49:0/488488778 >> v1:172.21.15.49:6789/0 conn(0x7f6348062700 legacy=0x7f63480a4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:32.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.745+0000 7f6346ffd700 1 -- 172.21.15.49:0/488488778 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63480a77d0 con 0x7f63480c86f0 2023-11-30T17:23:32.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.745+0000 7f63477fe700 1 --2- 172.21.15.49:0/488488778 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63481547f0 0x7f63480a72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:23:32.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.745+0000 7f6346ffd700 1 --2- 172.21.15.49:0/488488778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63480c86f0 0x7f63480c6fb0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f633c009760 tx=0x7f633c009060).ready entity=mon.1 client_cookie=7f80feae5d9eb4f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:32.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.745+0000 7f63467fc700 1 -- 172.21.15.49:0/488488778 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63400017f0 con 0x7f63480c86f0 2023-11-30T17:23:32.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.745+0000 7f63467fc700 1 -- 172.21.15.49:0/488488778 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c0090d0 con 0x7f63480c86f0 2023-11-30T17:23:32.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.745+0000 7f63467fc700 1 -- 172.21.15.49:0/488488778 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c011610 con 0x7f63480c86f0 2023-11-30T17:23:32.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.746+0000 7f634dd00700 1 -- 172.21.15.49:0/488488778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63480c86f0 msgr2=0x7f63480c6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:32.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.746+0000 7f634dd00700 1 --2- 172.21.15.49:0/488488778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63480c86f0 0x7f63480c6fb0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f633c009760 tx=0x7f633c009060).stop 2023-11-30T17:23:32.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.746+0000 7f634dd00700 1 -- 172.21.15.49:0/488488778 shutdown_connections 2023-11-30T17:23:32.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.746+0000 7f634dd00700 1 --2- 172.21.15.49:0/488488778 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63481547f0 0x7f63480a72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:32.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.746+0000 7f634dd00700 1 --2- 172.21.15.49:0/488488778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63480c86f0 0x7f63480c6fb0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:32.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.746+0000 7f634dd00700 1 -- 172.21.15.49:0/488488778 >> 172.21.15.49:0/488488778 conn(0x7f63480642d0 msgr2=0x7f63480c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:32.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.746+0000 7f634dd00700 1 -- 172.21.15.49:0/488488778 shutdown_connections 2023-11-30T17:23:32.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.746+0000 7f634dd00700 1 -- 172.21.15.49:0/488488778 wait complete. 2023-11-30T17:23:32.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.747+0000 7f634dd00700 1 Processor -- start 2023-11-30T17:23:32.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.747+0000 7f634dd00700 1 -- start start 2023-11-30T17:23:32.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.748+0000 7f634dd00700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6348062700 0x7f63481516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:32.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.748+0000 7f634dd00700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63480c86f0 0x7f6348069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:32.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.748+0000 7f634dd00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63481547f0 0x7f634806a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:32.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.748+0000 7f634dd00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634806a6b0 con 0x7f63481547f0 2023-11-30T17:23:32.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.748+0000 7f634dd00700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63480a9430 con 0x7f63480c86f0 2023-11-30T17:23:32.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.748+0000 7f634dd00700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6348151bc0 con 0x7f6348062700 2023-11-30T17:23:32.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.748+0000 7f6347fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63481547f0 0x7f634806a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:32.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.748+0000 7f6347fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63481547f0 0x7f634806a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35308/0 (socket says 172.21.15.49:35308) 2023-11-30T17:23:32.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.748+0000 7f6347fff700 1 -- 172.21.15.49:0/1479401836 learned_addr learned my addr 172.21.15.49:0/1479401836 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:32.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.748+0000 7f6346ffd700 1 --2- 172.21.15.49:0/1479401836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63480c86f0 0x7f6348069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:32.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.748+0000 7f63477fe700 1 --2- 172.21.15.49:0/1479401836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6348062700 0x7f63481516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:32.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.748+0000 7f6347fff700 1 -- 172.21.15.49:0/1479401836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6348062700 msgr2=0x7f63481516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:32.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.748+0000 7f6347fff700 1 --2- 172.21.15.49:0/1479401836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6348062700 0x7f63481516d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:32.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.748+0000 7f6347fff700 1 -- 172.21.15.49:0/1479401836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63480c86f0 msgr2=0x7f6348069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:32.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.748+0000 7f6347fff700 1 --2- 172.21.15.49:0/1479401836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63480c86f0 0x7f6348069cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:32.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.748+0000 7f6347fff700 1 -- 172.21.15.49:0/1479401836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63380092a0 con 0x7f63481547f0 2023-11-30T17:23:32.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.749+0000 7f6347fff700 1 --2- 172.21.15.49:0/1479401836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63481547f0 0x7f634806a1c0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f634000cb40 tx=0x7f6340001e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:32.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.749+0000 7f632f7fe700 1 -- 172.21.15.49:0/1479401836 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6340004c40 con 0x7f63481547f0 2023-11-30T17:23:32.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.749+0000 7f632f7fe700 1 -- 172.21.15.49:0/1479401836 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6340004da0 con 0x7f63481547f0 2023-11-30T17:23:32.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.749+0000 7f632f7fe700 1 -- 172.21.15.49:0/1479401836 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6340007380 con 0x7f63481547f0 2023-11-30T17:23:32.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.749+0000 7f634dd00700 1 -- 172.21.15.49:0/1479401836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f633c0092a0 con 0x7f63481547f0 2023-11-30T17:23:32.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.749+0000 7f634dd00700 1 -- 172.21.15.49:0/1479401836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63480a8820 con 0x7f63481547f0 2023-11-30T17:23:32.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.750+0000 7f634dd00700 1 -- 172.21.15.49:0/1479401836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63480a95c0 con 0x7f63481547f0 2023-11-30T17:23:32.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.750+0000 7f632f7fe700 1 -- 172.21.15.49:0/1479401836 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6340007770 con 0x7f63481547f0 2023-11-30T17:23:32.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.751+0000 7f632f7fe700 1 --2- 172.21.15.49:0/1479401836 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f633405f270 0x7f6334061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:32.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.751+0000 7f632f7fe700 1 -- 172.21.15.49:0/1479401836 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f634007a170 con 0x7f63481547f0 2023-11-30T17:23:32.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.751+0000 7f63477fe700 1 --2- 172.21.15.49:0/1479401836 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f633405f270 0x7f6334061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:32.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.751+0000 7f63477fe700 1 --2- 172.21.15.49:0/1479401836 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f633405f270 0x7f6334061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f6338009d20 tx=0x7f6338009060).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:32.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.755+0000 7f632f7fe700 1 -- 172.21.15.49:0/1479401836 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f634004b2a0 con 0x7f63481547f0 2023-11-30T17:23:32.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:32.978+0000 7f634dd00700 1 -- 172.21.15.49:0/1479401836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f634806c860 con 0x7f63481547f0 2023-11-30T17:23:33.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:33.949+0000 7f632f7fe700 1 -- 172.21.15.49:0/1479401836 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v45) v1 ==== 118+0+0 (secure 0 0 0) 0x7f634004e8c0 con 0x7f63481547f0 2023-11-30T17:23:33.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:33.952+0000 7f634dd00700 1 -- 172.21.15.49:0/1479401836 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f633405f270 msgr2=0x7f6334061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:33.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:33.952+0000 7f634dd00700 1 --2- 172.21.15.49:0/1479401836 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f633405f270 0x7f6334061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f6338009d20 tx=0x7f6338009060).stop 2023-11-30T17:23:33.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:33.952+0000 7f634dd00700 1 -- 172.21.15.49:0/1479401836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63481547f0 msgr2=0x7f634806a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:33.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:33.952+0000 7f634dd00700 1 --2- 172.21.15.49:0/1479401836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63481547f0 0x7f634806a1c0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f634000cb40 tx=0x7f6340001e20).stop 2023-11-30T17:23:33.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:33.952+0000 7f634dd00700 1 -- 172.21.15.49:0/1479401836 shutdown_connections 2023-11-30T17:23:33.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:33.952+0000 7f634dd00700 1 --2- 172.21.15.49:0/1479401836 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f633405f270 0x7f6334061730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:33.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:33.952+0000 7f634dd00700 1 --2- 172.21.15.49:0/1479401836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63481547f0 0x7f634806a1c0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:33.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:33.952+0000 7f634dd00700 1 --2- 172.21.15.49:0/1479401836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6348062700 0x7f63481516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:33.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:33.952+0000 7f634dd00700 1 --2- 172.21.15.49:0/1479401836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63480c86f0 0x7f6348069cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:33.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:33.952+0000 7f634dd00700 1 -- 172.21.15.49:0/1479401836 >> 172.21.15.49:0/1479401836 conn(0x7f63480642d0 msgr2=0x7f63481533f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:33.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:33.952+0000 7f634dd00700 1 -- 172.21.15.49:0/1479401836 shutdown_connections 2023-11-30T17:23:33.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:33.952+0000 7f634dd00700 1 -- 172.21.15.49:0/1479401836 wait complete. 2023-11-30T17:23:33.969 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-30T17:23:33.969 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-30T17:23:34.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.095+0000 7fdd5dd9f700 1 Processor -- start 2023-11-30T17:23:34.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.095+0000 7fdd5dd9f700 1 -- start start 2023-11-30T17:23:34.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.096+0000 7fdd5dd9f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdd580c66f0 0x7fdd58154950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:34.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.096+0000 7fdd5dd9f700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdd58158570 0x7fdd58158a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:34.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.096+0000 7fdd5dd9f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd58154e40 con 0x7fdd5814e530 2023-11-30T17:23:34.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.096+0000 7fdd5dd9f700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd580c6ba0 con 0x7fdd580c66f0 2023-11-30T17:23:34.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.096+0000 7fdd5dd9f700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd580c7bc0 con 0x7fdd58158570 2023-11-30T17:23:34.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.096+0000 7fdd57fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdd580c66f0 0x7fdd58154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:34.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.096+0000 7fdd5cd9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdd5814e530 0x7fdd5814e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48062/0 (socket says 172.21.15.49:48062) 2023-11-30T17:23:34.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.096+0000 7fdd5cd9d700 1 -- 172.21.15.49:0/4149297727 learned_addr learned my addr 172.21.15.49:0/4149297727 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:34.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.096+0000 7fdd5d59e700 1 --2- 172.21.15.49:0/4149297727 >> v2:172.21.15.115:3300/0 conn(0x7fdd58158570 0x7fdd58158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:34.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.096+0000 7fdd57fff700 1 -- 172.21.15.49:0/4149297727 >> v2:172.21.15.115:3300/0 conn(0x7fdd58158570 msgr2=0x7fdd58158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:34.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.096+0000 7fdd57fff700 1 --2- 172.21.15.49:0/4149297727 >> v2:172.21.15.115:3300/0 conn(0x7fdd58158570 0x7fdd58158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:34.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.096+0000 7fdd57fff700 1 -- 172.21.15.49:0/4149297727 >> v1:172.21.15.49:6789/0 conn(0x7fdd5814e530 legacy=0x7fdd5814e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:34.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.096+0000 7fdd577fe700 1 -- 172.21.15.49:0/4149297727 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 841692395 0 0) 0x7fdd4c001110 con 0x7fdd5814e530 2023-11-30T17:23:34.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.096+0000 7fdd57fff700 1 -- 172.21.15.49:0/4149297727 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd58155920 con 0x7fdd580c66f0 2023-11-30T17:23:34.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.096+0000 7fdd57fff700 1 --2- 172.21.15.49:0/4149297727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd580c66f0 0x7fdd58154950 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7fdd580aac80 tx=0x7fdd44009060).ready entity=mon.0 client_cookie=c6d75e722f98ff67 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:34.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.096+0000 7fdd577fe700 1 -- 172.21.15.49:0/4149297727 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4400b580 con 0x7fdd580c66f0 2023-11-30T17:23:34.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.097+0000 7fdd577fe700 1 -- 172.21.15.49:0/4149297727 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4400b6e0 con 0x7fdd580c66f0 2023-11-30T17:23:34.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.097+0000 7fdd577fe700 1 -- 172.21.15.49:0/4149297727 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4400ba60 con 0x7fdd580c66f0 2023-11-30T17:23:34.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.097+0000 7fdd5dd9f700 1 -- 172.21.15.49:0/4149297727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd580c66f0 msgr2=0x7fdd58154950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:34.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.097+0000 7fdd5dd9f700 1 --2- 172.21.15.49:0/4149297727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd580c66f0 0x7fdd58154950 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7fdd580aac80 tx=0x7fdd44009060).stop 2023-11-30T17:23:34.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.097+0000 7fdd5dd9f700 1 -- 172.21.15.49:0/4149297727 shutdown_connections 2023-11-30T17:23:34.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.097+0000 7fdd5dd9f700 1 --2- 172.21.15.49:0/4149297727 >> v2:172.21.15.115:3300/0 conn(0x7fdd58158570 0x7fdd58158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:34.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.097+0000 7fdd5dd9f700 1 --2- 172.21.15.49:0/4149297727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd580c66f0 0x7fdd58154950 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:34.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.097+0000 7fdd5dd9f700 1 -- 172.21.15.49:0/4149297727 >> 172.21.15.49:0/4149297727 conn(0x7fdd58064990 msgr2=0x7fdd58064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:34.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.097+0000 7fdd5dd9f700 1 -- 172.21.15.49:0/4149297727 shutdown_connections 2023-11-30T17:23:34.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.097+0000 7fdd5dd9f700 1 -- 172.21.15.49:0/4149297727 wait complete. 2023-11-30T17:23:34.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.098+0000 7fdd5dd9f700 1 Processor -- start 2023-11-30T17:23:34.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.098+0000 7fdd5dd9f700 1 -- start start 2023-11-30T17:23:34.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.099+0000 7fdd5dd9f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd580c66f0 0x7fdd580c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:34.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.099+0000 7fdd5dd9f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd5814e530 0x7fdd580c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:34.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.099+0000 7fdd5dd9f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd58158570 0x7fdd5813edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:34.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.099+0000 7fdd5dd9f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5813c9e0 con 0x7fdd58158570 2023-11-30T17:23:34.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.099+0000 7fdd5dd9f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd580c5490 con 0x7fdd5814e530 2023-11-30T17:23:34.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.099+0000 7fdd5dd9f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd580b02f0 con 0x7fdd580c66f0 2023-11-30T17:23:34.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.099+0000 7fdd5d59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd58158570 0x7fdd5813edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:34.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.099+0000 7fdd5d59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd58158570 0x7fdd5813edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35330/0 (socket says 172.21.15.49:35330) 2023-11-30T17:23:34.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.099+0000 7fdd5d59e700 1 -- 172.21.15.49:0/3859118992 learned_addr learned my addr 172.21.15.49:0/3859118992 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:34.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.099+0000 7fdd57fff700 1 --2- 172.21.15.49:0/3859118992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd5814e530 0x7fdd580c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:34.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.099+0000 7fdd5cd9d700 1 --2- 172.21.15.49:0/3859118992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd580c66f0 0x7fdd580c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:34.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.100+0000 7fdd5d59e700 1 -- 172.21.15.49:0/3859118992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd580c66f0 msgr2=0x7fdd580c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:34.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.100+0000 7fdd5d59e700 1 --2- 172.21.15.49:0/3859118992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd580c66f0 0x7fdd580c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:34.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.100+0000 7fdd5d59e700 1 -- 172.21.15.49:0/3859118992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd5814e530 msgr2=0x7fdd580c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:34.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.100+0000 7fdd5d59e700 1 --2- 172.21.15.49:0/3859118992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd5814e530 0x7fdd580c4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:34.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.100+0000 7fdd5d59e700 1 -- 172.21.15.49:0/3859118992 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd440092a0 con 0x7fdd58158570 2023-11-30T17:23:34.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.100+0000 7fdd5cd9d700 1 --2- 172.21.15.49:0/3859118992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd580c66f0 0x7fdd580c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:23:34.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.100+0000 7fdd5d59e700 1 --2- 172.21.15.49:0/3859118992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd58158570 0x7fdd5813edd0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7fdd50009fa0 tx=0x7fdd50009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:34.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.100+0000 7fdd54ff9700 1 -- 172.21.15.49:0/3859118992 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5000ec70 con 0x7fdd58158570 2023-11-30T17:23:34.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.100+0000 7fdd54ff9700 1 -- 172.21.15.49:0/3859118992 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5000edd0 con 0x7fdd58158570 2023-11-30T17:23:34.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.100+0000 7fdd5dd9f700 1 -- 172.21.15.49:0/3859118992 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd580c36a0 con 0x7fdd58158570 2023-11-30T17:23:34.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.100+0000 7fdd54ff9700 1 -- 172.21.15.49:0/3859118992 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd50014610 con 0x7fdd58158570 2023-11-30T17:23:34.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.100+0000 7fdd5dd9f700 1 -- 172.21.15.49:0/3859118992 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd580c3ce0 con 0x7fdd58158570 2023-11-30T17:23:34.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.101+0000 7fdd5dd9f700 1 -- 172.21.15.49:0/3859118992 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd58062ee0 con 0x7fdd58158570 2023-11-30T17:23:34.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.101+0000 7fdd54ff9700 1 -- 172.21.15.49:0/3859118992 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fdd5001d3b0 con 0x7fdd58158570 2023-11-30T17:23:34.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.102+0000 7fdd54ff9700 1 --2- 172.21.15.49:0/3859118992 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdd3c05f270 0x7fdd3c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:34.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.102+0000 7fdd54ff9700 1 -- 172.21.15.49:0/3859118992 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fdd5007a8f0 con 0x7fdd58158570 2023-11-30T17:23:34.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.102+0000 7fdd5cd9d700 1 --2- 172.21.15.49:0/3859118992 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdd3c05f270 0x7fdd3c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:34.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.102+0000 7fdd5cd9d700 1 --2- 172.21.15.49:0/3859118992 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdd3c05f270 0x7fdd3c061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fdd4c007fd0 tx=0x7fdd4c009040).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:34.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.106+0000 7fdd54ff9700 1 -- 172.21.15.49:0/3859118992 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdd5004b9c0 con 0x7fdd58158570 2023-11-30T17:23:34.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.321+0000 7fdd5dd9f700 1 -- 172.21.15.49:0/3859118992 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdd5806c7c0 con 0x7fdd58158570 2023-11-30T17:23:34.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.951+0000 7fdd54ff9700 1 -- 172.21.15.49:0/3859118992 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v46) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdd5004efe0 con 0x7fdd58158570 2023-11-30T17:23:34.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.954+0000 7fdd5dd9f700 1 -- 172.21.15.49:0/3859118992 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdd3c05f270 msgr2=0x7fdd3c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:34.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.954+0000 7fdd5dd9f700 1 --2- 172.21.15.49:0/3859118992 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdd3c05f270 0x7fdd3c061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fdd4c007fd0 tx=0x7fdd4c009040).stop 2023-11-30T17:23:34.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.954+0000 7fdd5dd9f700 1 -- 172.21.15.49:0/3859118992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd58158570 msgr2=0x7fdd5813edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:34.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.954+0000 7fdd5dd9f700 1 --2- 172.21.15.49:0/3859118992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd58158570 0x7fdd5813edd0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7fdd50009fa0 tx=0x7fdd50009900).stop 2023-11-30T17:23:34.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.954+0000 7fdd5dd9f700 1 -- 172.21.15.49:0/3859118992 shutdown_connections 2023-11-30T17:23:34.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.954+0000 7fdd5dd9f700 1 --2- 172.21.15.49:0/3859118992 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdd3c05f270 0x7fdd3c061730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:34.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.954+0000 7fdd5dd9f700 1 --2- 172.21.15.49:0/3859118992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd58158570 0x7fdd5813edd0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:34.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.954+0000 7fdd5dd9f700 1 --2- 172.21.15.49:0/3859118992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd580c66f0 0x7fdd580c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:34.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.954+0000 7fdd5dd9f700 1 --2- 172.21.15.49:0/3859118992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd5814e530 0x7fdd580c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:34.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.954+0000 7fdd5dd9f700 1 -- 172.21.15.49:0/3859118992 >> 172.21.15.49:0/3859118992 conn(0x7fdd58064990 msgr2=0x7fdd58064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:34.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.954+0000 7fdd5dd9f700 1 -- 172.21.15.49:0/3859118992 shutdown_connections 2023-11-30T17:23:34.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:34.954+0000 7fdd5dd9f700 1 -- 172.21.15.49:0/3859118992 wait complete. 2023-11-30T17:23:34.970 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-30T17:23:34.971 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:23:35.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.090+0000 7f0f8c2e8700 1 Processor -- start 2023-11-30T17:23:35.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.090+0000 7f0f8c2e8700 1 -- start start 2023-11-30T17:23:35.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.091+0000 7f0f8c2e8700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0f84064e20 0x7f0f84155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:35.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.091+0000 7f0f8c2e8700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0f84095e80 0x7f0f840962f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:35.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.091+0000 7f0f8c2e8700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f840967e0 con 0x7f0f841544d0 2023-11-30T17:23:35.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.091+0000 7f0f8c2e8700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f84067650 con 0x7f0f84095e80 2023-11-30T17:23:35.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.091+0000 7f0f8c2e8700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f840683d0 con 0x7f0f84064e20 2023-11-30T17:23:35.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.092+0000 7f0f8a885700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0f84095e80 0x7f0f840962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:35.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.092+0000 7f0f8a084700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0f841544d0 0x7f0f84066f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48064/0 (socket says 172.21.15.49:48064) 2023-11-30T17:23:35.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.092+0000 7f0f8a084700 1 -- 172.21.15.49:0/307908237 learned_addr learned my addr 172.21.15.49:0/307908237 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:35.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.092+0000 7f0f89883700 1 --2- 172.21.15.49:0/307908237 >> v2:172.21.15.115:3300/0 conn(0x7f0f84064e20 0x7f0f84155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:35.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.092+0000 7f0f8a885700 1 -- 172.21.15.49:0/307908237 >> v2:172.21.15.115:3300/0 conn(0x7f0f84064e20 msgr2=0x7f0f84155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:35.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.092+0000 7f0f8a885700 1 --2- 172.21.15.49:0/307908237 >> v2:172.21.15.115:3300/0 conn(0x7f0f84064e20 0x7f0f84155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:35.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.092+0000 7f0f8a885700 1 -- 172.21.15.49:0/307908237 >> v1:172.21.15.49:6789/0 conn(0x7f0f841544d0 legacy=0x7f0f84066f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:35.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.092+0000 7f0f89082700 1 -- 172.21.15.49:0/307908237 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 465575405 0 0) 0x7f0f840967e0 con 0x7f0f841544d0 2023-11-30T17:23:35.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.092+0000 7f0f8a885700 1 -- 172.21.15.49:0/307908237 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f84067850 con 0x7f0f84095e80 2023-11-30T17:23:35.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.092+0000 7f0f8a885700 1 --2- 172.21.15.49:0/307908237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f84095e80 0x7f0f840962f0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f0f8406a7d0 tx=0x7f0f74009780).ready entity=mon.0 client_cookie=994419aea6d66258 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:35.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.092+0000 7f0f89082700 1 -- 172.21.15.49:0/307908237 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7400e070 con 0x7f0f84095e80 2023-11-30T17:23:35.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.092+0000 7f0f89082700 1 -- 172.21.15.49:0/307908237 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7400bc30 con 0x7f0f84095e80 2023-11-30T17:23:35.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.092+0000 7f0f89082700 1 -- 172.21.15.49:0/307908237 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f74012410 con 0x7f0f84095e80 2023-11-30T17:23:35.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.093+0000 7f0f8c2e8700 1 -- 172.21.15.49:0/307908237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f84095e80 msgr2=0x7f0f840962f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:35.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.093+0000 7f0f8c2e8700 1 --2- 172.21.15.49:0/307908237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f84095e80 0x7f0f840962f0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f0f8406a7d0 tx=0x7f0f74009780).stop 2023-11-30T17:23:35.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.093+0000 7f0f8c2e8700 1 -- 172.21.15.49:0/307908237 shutdown_connections 2023-11-30T17:23:35.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.093+0000 7f0f8c2e8700 1 --2- 172.21.15.49:0/307908237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f84095e80 0x7f0f840962f0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:35.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.093+0000 7f0f8c2e8700 1 --2- 172.21.15.49:0/307908237 >> v2:172.21.15.115:3300/0 conn(0x7f0f84064e20 0x7f0f84155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:35.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.093+0000 7f0f8c2e8700 1 -- 172.21.15.49:0/307908237 >> 172.21.15.49:0/307908237 conn(0x7f0f840631d0 msgr2=0x7f0f840c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:35.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.093+0000 7f0f8c2e8700 1 -- 172.21.15.49:0/307908237 shutdown_connections 2023-11-30T17:23:35.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.093+0000 7f0f8c2e8700 1 -- 172.21.15.49:0/307908237 wait complete. 2023-11-30T17:23:35.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.094+0000 7f0f8c2e8700 1 Processor -- start 2023-11-30T17:23:35.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.094+0000 7f0f8c2e8700 1 -- start start 2023-11-30T17:23:35.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.095+0000 7f0f8c2e8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f84064e20 0x7f0f840c2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:35.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.095+0000 7f0f8c2e8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f84095e80 0x7f0f840a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:35.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.095+0000 7f0f8c2e8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f841544d0 0x7f0f840a6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:35.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.095+0000 7f0f8c2e8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f841554a0 con 0x7f0f84064e20 2023-11-30T17:23:35.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.095+0000 7f0f8c2e8700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f841556f0 con 0x7f0f84095e80 2023-11-30T17:23:35.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.095+0000 7f0f8c2e8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f841559d0 con 0x7f0f841544d0 2023-11-30T17:23:35.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.095+0000 7f0f8a084700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f84064e20 0x7f0f840c2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:35.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.095+0000 7f0f8a084700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f84064e20 0x7f0f840c2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35346/0 (socket says 172.21.15.49:35346) 2023-11-30T17:23:35.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.095+0000 7f0f8a084700 1 -- 172.21.15.49:0/157992107 learned_addr learned my addr 172.21.15.49:0/157992107 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:35.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.095+0000 7f0f8a084700 1 -- 172.21.15.49:0/157992107 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f841544d0 msgr2=0x7f0f840a6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:35.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.095+0000 7f0f8a084700 1 --2- 172.21.15.49:0/157992107 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f841544d0 0x7f0f840a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:35.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.095+0000 7f0f89883700 1 --2- 172.21.15.49:0/157992107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f84095e80 0x7f0f840a5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:35.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.095+0000 7f0f8a084700 1 -- 172.21.15.49:0/157992107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f84095e80 msgr2=0x7f0f840a5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:35.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.095+0000 7f0f8a084700 1 --2- 172.21.15.49:0/157992107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f84095e80 0x7f0f840a5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:35.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.095+0000 7f0f8a084700 1 -- 172.21.15.49:0/157992107 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f74009a20 con 0x7f0f84064e20 2023-11-30T17:23:35.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.095+0000 7f0f89883700 1 --2- 172.21.15.49:0/157992107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f84095e80 0x7f0f840a5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:23:35.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.095+0000 7f0f8a084700 1 --2- 172.21.15.49:0/157992107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f84064e20 0x7f0f840c2770 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f0f7c00c490 tx=0x7f0f7c007d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:35.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.095+0000 7f0f827fc700 1 -- 172.21.15.49:0/157992107 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c0072e0 con 0x7f0f84064e20 2023-11-30T17:23:35.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.095+0000 7f0f827fc700 1 -- 172.21.15.49:0/157992107 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7c007440 con 0x7f0f84064e20 2023-11-30T17:23:35.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.095+0000 7f0f8c2e8700 1 -- 172.21.15.49:0/157992107 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f84155cb0 con 0x7f0f84064e20 2023-11-30T17:23:35.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.095+0000 7f0f827fc700 1 -- 172.21.15.49:0/157992107 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c005880 con 0x7f0f84064e20 2023-11-30T17:23:35.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.095+0000 7f0f8c2e8700 1 -- 172.21.15.49:0/157992107 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f84156270 con 0x7f0f84064e20 2023-11-30T17:23:35.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.096+0000 7f0f8c2e8700 1 -- 172.21.15.49:0/157992107 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f84156460 con 0x7f0f84064e20 2023-11-30T17:23:35.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.097+0000 7f0f827fc700 1 -- 172.21.15.49:0/157992107 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0f7c005c70 con 0x7f0f84064e20 2023-11-30T17:23:35.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.097+0000 7f0f827fc700 1 --2- 172.21.15.49:0/157992107 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0f7005f2a0 0x7f0f70061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:35.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.097+0000 7f0f827fc700 1 -- 172.21.15.49:0/157992107 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f0f7c079a30 con 0x7f0f84064e20 2023-11-30T17:23:35.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.097+0000 7f0f89883700 1 --2- 172.21.15.49:0/157992107 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0f7005f2a0 0x7f0f70061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:35.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.098+0000 7f0f89883700 1 --2- 172.21.15.49:0/157992107 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0f7005f2a0 0x7f0f70061760 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0f84154d00 tx=0x7f0f78008040).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:35.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.101+0000 7f0f827fc700 1 -- 172.21.15.49:0/157992107 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0f7c07be60 con 0x7f0f84064e20 2023-11-30T17:23:35.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.317+0000 7f0f8c2e8700 1 -- 172.21.15.49:0/157992107 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f8406c860 con 0x7f0f84064e20 2023-11-30T17:23:35.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.317+0000 7f0f827fc700 1 -- 172.21.15.49:0/157992107 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f0f7c04ab60 con 0x7f0f84064e20 2023-11-30T17:23:35.320 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:35.320 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1725128963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1725128963},{"type":"v1","addr":"172.21.15.115:6836","nonce":1725128963}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6955,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3975305695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3975305695},{"type":"v1","addr":"172.21.15.115:6837","nonce":3975305695}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/2909602857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2909602857},{"type":"v1","addr":"172.21.15.49:6834","nonce":2909602857}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:23:31.943367+0000","modified":"2023-11-30T17:23:34.949501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7137},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7137":{"gid":7137,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1751656884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1751656884},{"type":"v1","addr":"172.21.15.49:6835","nonce":1751656884}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-11-30T17:23:35.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.319+0000 7f0f8c2e8700 1 -- 172.21.15.49:0/157992107 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0f7005f2a0 msgr2=0x7f0f70061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:35.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.319+0000 7f0f8c2e8700 1 --2- 172.21.15.49:0/157992107 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0f7005f2a0 0x7f0f70061760 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0f84154d00 tx=0x7f0f78008040).stop 2023-11-30T17:23:35.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.319+0000 7f0f8c2e8700 1 -- 172.21.15.49:0/157992107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f84064e20 msgr2=0x7f0f840c2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:35.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.319+0000 7f0f8c2e8700 1 --2- 172.21.15.49:0/157992107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f84064e20 0x7f0f840c2770 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f0f7c00c490 tx=0x7f0f7c007d00).stop 2023-11-30T17:23:35.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.319+0000 7f0f8c2e8700 1 -- 172.21.15.49:0/157992107 shutdown_connections 2023-11-30T17:23:35.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.319+0000 7f0f8c2e8700 1 --2- 172.21.15.49:0/157992107 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f841544d0 0x7f0f840a6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:35.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.319+0000 7f0f8c2e8700 1 --2- 172.21.15.49:0/157992107 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0f7005f2a0 0x7f0f70061760 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:35.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.319+0000 7f0f8c2e8700 1 --2- 172.21.15.49:0/157992107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f84064e20 0x7f0f840c2770 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:35.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.319+0000 7f0f8c2e8700 1 --2- 172.21.15.49:0/157992107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f84095e80 0x7f0f840a5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:35.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.319+0000 7f0f8c2e8700 1 -- 172.21.15.49:0/157992107 >> 172.21.15.49:0/157992107 conn(0x7f0f840631d0 msgr2=0x7f0f84096260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:35.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.319+0000 7f0f8c2e8700 1 -- 172.21.15.49:0/157992107 shutdown_connections 2023-11-30T17:23:35.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.320+0000 7f0f8c2e8700 1 -- 172.21.15.49:0/157992107 wait complete. 2023-11-30T17:23:35.323 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 46 2023-11-30T17:23:35.334 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:23:35.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.449+0000 7f9324ec3700 1 Processor -- start 2023-11-30T17:23:35.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.449+0000 7f9324ec3700 1 -- start start 2023-11-30T17:23:35.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.450+0000 7f9324ec3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f93201520c0 0x7f9320066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:35.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.450+0000 7f9324ec3700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f93201524a0 0x7f9320066a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:35.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.450+0000 7f9324ec3700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93200be110 con 0x7f9320067a40 2023-11-30T17:23:35.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.450+0000 7f9324ec3700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9320066fc0 con 0x7f93201520c0 2023-11-30T17:23:35.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.450+0000 7f9324ec3700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93200672a0 con 0x7f93201524a0 2023-11-30T17:23:35.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.450+0000 7f931e59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f93201520c0 0x7f9320066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:35.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.450+0000 7f931ed9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9320067a40 0x7f9320155eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48066/0 (socket says 172.21.15.49:48066) 2023-11-30T17:23:35.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.451+0000 7f931ed9d700 1 -- 172.21.15.49:0/2885388133 learned_addr learned my addr 172.21.15.49:0/2885388133 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:35.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.451+0000 7f931dd9b700 1 --2- 172.21.15.49:0/2885388133 >> v2:172.21.15.115:3300/0 conn(0x7f93201524a0 0x7f9320066a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:35.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.451+0000 7f931e59c700 1 -- 172.21.15.49:0/2885388133 >> v2:172.21.15.115:3300/0 conn(0x7f93201524a0 msgr2=0x7f9320066a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:35.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.451+0000 7f931e59c700 1 --2- 172.21.15.49:0/2885388133 >> v2:172.21.15.115:3300/0 conn(0x7f93201524a0 0x7f9320066a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:35.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.451+0000 7f931e59c700 1 -- 172.21.15.49:0/2885388133 >> v1:172.21.15.49:6789/0 conn(0x7f9320067a40 legacy=0x7f9320155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:35.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.451+0000 7f931e59c700 1 -- 172.21.15.49:0/2885388133 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93200be380 con 0x7f93201520c0 2023-11-30T17:23:35.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.451+0000 7f931d59a700 1 -- 172.21.15.49:0/2885388133 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3544068993 0 0) 0x7f93200be110 con 0x7f9320067a40 2023-11-30T17:23:35.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.451+0000 7f931e59c700 1 --2- 172.21.15.49:0/2885388133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93201520c0 0x7f9320066520 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7f932006c7c0 tx=0x7f9310006f40).ready entity=mon.0 client_cookie=d92823f5500474b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:35.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.451+0000 7f931d59a700 1 -- 172.21.15.49:0/2885388133 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310005880 con 0x7f93201520c0 2023-11-30T17:23:35.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.451+0000 7f931d59a700 1 -- 172.21.15.49:0/2885388133 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93100059e0 con 0x7f93201520c0 2023-11-30T17:23:35.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.451+0000 7f931d59a700 1 -- 172.21.15.49:0/2885388133 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310005d60 con 0x7f93201520c0 2023-11-30T17:23:35.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.452+0000 7f9324ec3700 1 -- 172.21.15.49:0/2885388133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93201520c0 msgr2=0x7f9320066520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:35.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.452+0000 7f9324ec3700 1 --2- 172.21.15.49:0/2885388133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93201520c0 0x7f9320066520 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7f932006c7c0 tx=0x7f9310006f40).stop 2023-11-30T17:23:35.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.452+0000 7f9324ec3700 1 -- 172.21.15.49:0/2885388133 shutdown_connections 2023-11-30T17:23:35.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.452+0000 7f9324ec3700 1 --2- 172.21.15.49:0/2885388133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93201520c0 0x7f9320066520 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:35.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.452+0000 7f9324ec3700 1 --2- 172.21.15.49:0/2885388133 >> v2:172.21.15.115:3300/0 conn(0x7f93201524a0 0x7f9320066a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:35.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.452+0000 7f9324ec3700 1 -- 172.21.15.49:0/2885388133 >> 172.21.15.49:0/2885388133 conn(0x7f93200631d0 msgr2=0x7f93200c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:35.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.452+0000 7f9324ec3700 1 -- 172.21.15.49:0/2885388133 shutdown_connections 2023-11-30T17:23:35.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.452+0000 7f9324ec3700 1 -- 172.21.15.49:0/2885388133 wait complete. 2023-11-30T17:23:35.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.453+0000 7f9324ec3700 1 Processor -- start 2023-11-30T17:23:35.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.453+0000 7f9324ec3700 1 -- start start 2023-11-30T17:23:35.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.454+0000 7f9324ec3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9320067a40 0x7f93201512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:35.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.454+0000 7f9324ec3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93201520c0 0x7f9320091d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:35.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.454+0000 7f9324ec3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93201524a0 0x7f9320092270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:35.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.454+0000 7f9324ec3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9320092760 con 0x7f93201524a0 2023-11-30T17:23:35.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.454+0000 7f9324ec3700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93200ad540 con 0x7f9320067a40 2023-11-30T17:23:35.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.454+0000 7f9324ec3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93200ab740 con 0x7f93201520c0 2023-11-30T17:23:35.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.454+0000 7f931ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93201524a0 0x7f9320092270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:35.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.454+0000 7f931ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93201524a0 0x7f9320092270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35364/0 (socket says 172.21.15.49:35364) 2023-11-30T17:23:35.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.454+0000 7f931ed9d700 1 -- 172.21.15.49:0/4041489040 learned_addr learned my addr 172.21.15.49:0/4041489040 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:35.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.454+0000 7f931e59c700 1 --2- 172.21.15.49:0/4041489040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9320067a40 0x7f93201512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:35.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.454+0000 7f931dd9b700 1 --2- 172.21.15.49:0/4041489040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93201520c0 0x7f9320091d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:35.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.454+0000 7f931ed9d700 1 -- 172.21.15.49:0/4041489040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93201520c0 msgr2=0x7f9320091d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:35.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.454+0000 7f931ed9d700 1 --2- 172.21.15.49:0/4041489040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93201520c0 0x7f9320091d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:35.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.454+0000 7f931ed9d700 1 -- 172.21.15.49:0/4041489040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9320067a40 msgr2=0x7f93201512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:35.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.454+0000 7f931ed9d700 1 --2- 172.21.15.49:0/4041489040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9320067a40 0x7f93201512b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:35.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.454+0000 7f931ed9d700 1 -- 172.21.15.49:0/4041489040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9310009250 con 0x7f93201524a0 2023-11-30T17:23:35.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.454+0000 7f931dd9b700 1 --2- 172.21.15.49:0/4041489040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93201520c0 0x7f9320091d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:23:35.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.454+0000 7f931ed9d700 1 --2- 172.21.15.49:0/4041489040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93201524a0 0x7f9320092270 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f931800c7e0 tx=0x7f9318007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:35.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.454+0000 7f930e7fc700 1 -- 172.21.15.49:0/4041489040 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9318005d30 con 0x7f93201524a0 2023-11-30T17:23:35.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.454+0000 7f930e7fc700 1 -- 172.21.15.49:0/4041489040 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9318005e90 con 0x7f93201524a0 2023-11-30T17:23:35.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.454+0000 7f9324ec3700 1 -- 172.21.15.49:0/4041489040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93200acf30 con 0x7f93201524a0 2023-11-30T17:23:35.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.455+0000 7f930e7fc700 1 -- 172.21.15.49:0/4041489040 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9318007340 con 0x7f93201524a0 2023-11-30T17:23:35.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.455+0000 7f9324ec3700 1 -- 172.21.15.49:0/4041489040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93200ad1d0 con 0x7f93201524a0 2023-11-30T17:23:35.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.456+0000 7f9324ec3700 1 -- 172.21.15.49:0/4041489040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93200ad6d0 con 0x7f93201524a0 2023-11-30T17:23:35.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.456+0000 7f930e7fc700 1 -- 172.21.15.49:0/4041489040 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f9318007730 con 0x7f93201524a0 2023-11-30T17:23:35.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.456+0000 7f930e7fc700 1 --2- 172.21.15.49:0/4041489040 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f930005f270 0x7f9300061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:35.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.457+0000 7f930e7fc700 1 -- 172.21.15.49:0/4041489040 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f931807a3c0 con 0x7f93201524a0 2023-11-30T17:23:35.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.457+0000 7f931e59c700 1 --2- 172.21.15.49:0/4041489040 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f930005f270 0x7f9300061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:35.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.457+0000 7f931e59c700 1 --2- 172.21.15.49:0/4041489040 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f930005f270 0x7f9300061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f9310009fd0 tx=0x7f9310016000).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:35.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.461+0000 7f930e7fc700 1 -- 172.21.15.49:0/4041489040 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f931804b4f0 con 0x7f93201524a0 2023-11-30T17:23:35.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.633+0000 7f9324ec3700 1 -- 172.21.15.49:0/4041489040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f932006c860 con 0x7f93201524a0 2023-11-30T17:23:35.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.634+0000 7f930e7fc700 1 -- 172.21.15.49:0/4041489040 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+16986 (secure 0 0 0) 0x7f9318001650 con 0x7f93201524a0 2023-11-30T17:23:35.636 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:35.637 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":113,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:23:32.944697+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:23:30.500365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-30T17:23:30.919592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:23:35.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.635+0000 7f9324ec3700 1 -- 172.21.15.49:0/4041489040 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f930005f270 msgr2=0x7f9300061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:35.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.635+0000 7f9324ec3700 1 --2- 172.21.15.49:0/4041489040 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f930005f270 0x7f9300061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f9310009fd0 tx=0x7f9310016000).stop 2023-11-30T17:23:35.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.636+0000 7f9324ec3700 1 -- 172.21.15.49:0/4041489040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93201524a0 msgr2=0x7f9320092270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:35.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.636+0000 7f9324ec3700 1 --2- 172.21.15.49:0/4041489040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93201524a0 0x7f9320092270 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f931800c7e0 tx=0x7f9318007f90).stop 2023-11-30T17:23:35.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.636+0000 7f9324ec3700 1 -- 172.21.15.49:0/4041489040 shutdown_connections 2023-11-30T17:23:35.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.636+0000 7f9324ec3700 1 --2- 172.21.15.49:0/4041489040 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f930005f270 0x7f9300061730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:35.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.636+0000 7f9324ec3700 1 --2- 172.21.15.49:0/4041489040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93201524a0 0x7f9320092270 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:35.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.636+0000 7f9324ec3700 1 --2- 172.21.15.49:0/4041489040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9320067a40 0x7f93201512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:35.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.636+0000 7f9324ec3700 1 --2- 172.21.15.49:0/4041489040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93201520c0 0x7f9320091d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:35.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.636+0000 7f9324ec3700 1 -- 172.21.15.49:0/4041489040 >> 172.21.15.49:0/4041489040 conn(0x7f93200631d0 msgr2=0x7f93200a6100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:35.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.636+0000 7f9324ec3700 1 -- 172.21.15.49:0/4041489040 shutdown_connections 2023-11-30T17:23:35.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.636+0000 7f9324ec3700 1 -- 172.21.15.49:0/4041489040 wait complete. 2023-11-30T17:23:35.651 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-30T17:23:35.651 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:23:35.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.766+0000 7fade093b700 1 Processor -- start 2023-11-30T17:23:35.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.766+0000 7fade093b700 1 -- start start 2023-11-30T17:23:35.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.767+0000 7fade093b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7faddc151ca0 0x7faddc152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:35.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.767+0000 7fade093b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faddc096590 0x7faddc0c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:35.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.767+0000 7fade093b700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faddc0c8170 con 0x7faddc0c7820 2023-11-30T17:23:35.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.767+0000 7fade093b700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faddc0c0060 con 0x7faddc096590 2023-11-30T17:23:35.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.767+0000 7fade093b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faddc0c8c40 con 0x7faddc151ca0 2023-11-30T17:23:35.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.767+0000 7faddad9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faddc096590 0x7faddc0c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:35.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.767+0000 7faddad9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faddc096590 0x7faddc0c7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35366/0 (socket says 172.21.15.49:35366) 2023-11-30T17:23:35.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.767+0000 7faddad9d700 1 -- 172.21.15.49:0/657352073 learned_addr learned my addr 172.21.15.49:0/657352073 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:35.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.767+0000 7fadda59c700 1 --2- 172.21.15.49:0/657352073 >> v2:172.21.15.115:3300/0 conn(0x7faddc151ca0 0x7faddc152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:35.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.768+0000 7faddad9d700 1 -- 172.21.15.49:0/657352073 >> v2:172.21.15.115:3300/0 conn(0x7faddc151ca0 msgr2=0x7faddc152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:35.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.768+0000 7faddad9d700 1 --2- 172.21.15.49:0/657352073 >> v2:172.21.15.115:3300/0 conn(0x7faddc151ca0 0x7faddc152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:35.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.768+0000 7faddad9d700 1 -- 172.21.15.49:0/657352073 >> v1:172.21.15.115:6789/0 conn(0x7faddc0c7820 legacy=0x7faddc095e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:35.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.768+0000 7faddad9d700 1 -- 172.21.15.49:0/657352073 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faddc0bebc0 con 0x7faddc096590 2023-11-30T17:23:35.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.768+0000 7faddad9d700 1 --2- 172.21.15.49:0/657352073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faddc096590 0x7faddc0c7c80 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7faddc06a820 tx=0x7fadcc009840).ready entity=mon.0 client_cookie=f8a248b36a20af8f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:35.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.768+0000 7fadd959a700 1 -- 172.21.15.49:0/657352073 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc00e070 con 0x7faddc096590 2023-11-30T17:23:35.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.768+0000 7fadd959a700 1 -- 172.21.15.49:0/657352073 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadcc00ba20 con 0x7faddc096590 2023-11-30T17:23:35.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.768+0000 7fadd959a700 1 -- 172.21.15.49:0/657352073 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc00bda0 con 0x7faddc096590 2023-11-30T17:23:35.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.768+0000 7fade093b700 1 -- 172.21.15.49:0/657352073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faddc096590 msgr2=0x7faddc0c7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:35.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.768+0000 7fade093b700 1 --2- 172.21.15.49:0/657352073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faddc096590 0x7faddc0c7c80 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7faddc06a820 tx=0x7fadcc009840).stop 2023-11-30T17:23:35.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.768+0000 7fade093b700 1 -- 172.21.15.49:0/657352073 shutdown_connections 2023-11-30T17:23:35.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.769+0000 7fade093b700 1 --2- 172.21.15.49:0/657352073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faddc096590 0x7faddc0c7c80 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:35.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.769+0000 7fade093b700 1 --2- 172.21.15.49:0/657352073 >> v2:172.21.15.115:3300/0 conn(0x7faddc151ca0 0x7faddc152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:35.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.769+0000 7fade093b700 1 -- 172.21.15.49:0/657352073 >> 172.21.15.49:0/657352073 conn(0x7faddc062700 msgr2=0x7faddc062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:35.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.769+0000 7fade093b700 1 -- 172.21.15.49:0/657352073 shutdown_connections 2023-11-30T17:23:35.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.769+0000 7fade093b700 1 -- 172.21.15.49:0/657352073 wait complete. 2023-11-30T17:23:35.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.770+0000 7fade093b700 1 Processor -- start 2023-11-30T17:23:35.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.770+0000 7fade093b700 1 -- start start 2023-11-30T17:23:35.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.770+0000 7fade093b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faddc096590 0x7faddc0ab160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:35.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.770+0000 7fade093b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faddc0c7820 0x7faddc0c1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:35.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.771+0000 7fade093b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faddc151ca0 0x7faddc0c2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:35.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.771+0000 7fade093b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc0a8ef0 con 0x7faddc151ca0 2023-11-30T17:23:35.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.771+0000 7fade093b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc0a8930 con 0x7faddc0c7820 2023-11-30T17:23:35.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.771+0000 7fade093b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faddc0c2830 con 0x7faddc096590 2023-11-30T17:23:35.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.771+0000 7faddad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faddc151ca0 0x7faddc0c2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:35.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.771+0000 7faddad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faddc151ca0 0x7faddc0c2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35374/0 (socket says 172.21.15.49:35374) 2023-11-30T17:23:35.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.771+0000 7faddad9d700 1 -- 172.21.15.49:0/3014052063 learned_addr learned my addr 172.21.15.49:0/3014052063 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:35.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.771+0000 7fadda59c700 1 --2- 172.21.15.49:0/3014052063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faddc096590 0x7faddc0ab160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:35.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.771+0000 7fadd9d9b700 1 --2- 172.21.15.49:0/3014052063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faddc0c7820 0x7faddc0c1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:35.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.771+0000 7faddad9d700 1 -- 172.21.15.49:0/3014052063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faddc096590 msgr2=0x7faddc0ab160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:35.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.771+0000 7faddad9d700 1 --2- 172.21.15.49:0/3014052063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faddc096590 0x7faddc0ab160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:35.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.771+0000 7faddad9d700 1 -- 172.21.15.49:0/3014052063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faddc0c7820 msgr2=0x7faddc0c1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:35.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.771+0000 7faddad9d700 1 --2- 172.21.15.49:0/3014052063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faddc0c7820 0x7faddc0c1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:35.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.771+0000 7faddad9d700 1 -- 172.21.15.49:0/3014052063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadcc009ae0 con 0x7faddc151ca0 2023-11-30T17:23:35.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.771+0000 7faddad9d700 1 --2- 172.21.15.49:0/3014052063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faddc151ca0 0x7faddc0c2190 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7faddc06c3b0 tx=0x7fadcc009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:35.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.771+0000 7fadd27fc700 1 -- 172.21.15.49:0/3014052063 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc007170 con 0x7faddc151ca0 2023-11-30T17:23:35.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.771+0000 7fadd27fc700 1 -- 172.21.15.49:0/3014052063 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadcc009500 con 0x7faddc151ca0 2023-11-30T17:23:35.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.771+0000 7fade093b700 1 -- 172.21.15.49:0/3014052063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faddc0c2b10 con 0x7faddc151ca0 2023-11-30T17:23:35.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.771+0000 7fadd27fc700 1 -- 172.21.15.49:0/3014052063 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc01e6c0 con 0x7faddc151ca0 2023-11-30T17:23:35.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.771+0000 7fade093b700 1 -- 172.21.15.49:0/3014052063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faddc0ab650 con 0x7faddc151ca0 2023-11-30T17:23:35.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.772+0000 7fade093b700 1 -- 172.21.15.49:0/3014052063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faddc06c860 con 0x7faddc151ca0 2023-11-30T17:23:35.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.773+0000 7fadd27fc700 1 -- 172.21.15.49:0/3014052063 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fadcc003040 con 0x7faddc151ca0 2023-11-30T17:23:35.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.773+0000 7fadd27fc700 1 --2- 172.21.15.49:0/3014052063 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fadbc05f270 0x7fadbc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:35.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.773+0000 7fadd27fc700 1 -- 172.21.15.49:0/3014052063 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fadcc07b820 con 0x7faddc151ca0 2023-11-30T17:23:35.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.773+0000 7fadda59c700 1 --2- 172.21.15.49:0/3014052063 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fadbc05f270 0x7fadbc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:35.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.774+0000 7fadda59c700 1 --2- 172.21.15.49:0/3014052063 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fadbc05f270 0x7fadbc061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fadd4006fd0 tx=0x7fadd4006f40).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:35.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.777+0000 7fadd27fc700 1 -- 172.21.15.49:0/3014052063 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fadcc04ca00 con 0x7faddc151ca0 2023-11-30T17:23:35.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.945+0000 7fade093b700 1 -- 172.21.15.49:0/3014052063 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faddc0c83a0 con 0x7fadbc05f270 2023-11-30T17:23:35.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.956+0000 7fadd27fc700 1 -- 172.21.15.49:0/3014052063 <== mgr.6107 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+357189 (secure 0 0 0) 0x7faddc0c83a0 con 0x7fadbc05f270 2023-11-30T17:23:35.964 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:35.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.959+0000 7fade093b700 1 -- 172.21.15.49:0/3014052063 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fadbc05f270 msgr2=0x7fadbc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:35.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.959+0000 7fade093b700 1 --2- 172.21.15.49:0/3014052063 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fadbc05f270 0x7fadbc061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fadd4006fd0 tx=0x7fadd4006f40).stop 2023-11-30T17:23:35.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.959+0000 7fade093b700 1 -- 172.21.15.49:0/3014052063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faddc151ca0 msgr2=0x7faddc0c2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:35.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.959+0000 7fade093b700 1 --2- 172.21.15.49:0/3014052063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faddc151ca0 0x7faddc0c2190 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7faddc06c3b0 tx=0x7fadcc009840).stop 2023-11-30T17:23:35.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.960+0000 7fade093b700 1 -- 172.21.15.49:0/3014052063 shutdown_connections 2023-11-30T17:23:35.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.960+0000 7fade093b700 1 --2- 172.21.15.49:0/3014052063 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fadbc05f270 0x7fadbc061730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:35.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.960+0000 7fade093b700 1 --2- 172.21.15.49:0/3014052063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faddc151ca0 0x7faddc0c2190 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:35.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.960+0000 7fade093b700 1 --2- 172.21.15.49:0/3014052063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faddc096590 0x7faddc0ab160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:35.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.960+0000 7fade093b700 1 --2- 172.21.15.49:0/3014052063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faddc0c7820 0x7faddc0c1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:35.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.960+0000 7fade093b700 1 -- 172.21.15.49:0/3014052063 >> 172.21.15.49:0/3014052063 conn(0x7faddc062700 msgr2=0x7faddc14c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:35.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.960+0000 7fade093b700 1 -- 172.21.15.49:0/3014052063 shutdown_connections 2023-11-30T17:23:35.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:35.960+0000 7fade093b700 1 -- 172.21.15.49:0/3014052063 wait complete. 2023-11-30T17:23:35.971 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:23:35.974 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-30T17:23:35.455404+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":748,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":170,"acting":170,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2432564,"kb_used_data":10740,"kb_used_omap":0,"kb_used_meta":2421760,"kb_avail":752542156,"statfs":{"total":773094113280,"available":770603167744,"internally_reserved":0,"allocated":10997760,"data_stored":5498635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2479882240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5548,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.011446"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977592+0000","last_change":"2023-11-30T17:23:31.973969+0000","last_active":"2023-11-30T17:23:31.977592+0000","last_peered":"2023-11-30T17:23:31.977592+0000","last_clean":"2023-11-30T17:23:31.977592+0000","last_became_active":"2023-11-30T17:23:31.973692+0000","last_became_peered":"2023-11-30T17:23:31.973692+0000","last_unstale":"2023-11-30T17:23:31.977592+0000","last_undegraded":"2023-11-30T17:23:31.977592+0000","last_fullsized":"2023-11-30T17:23:31.977592+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.973913+0000","last_change":"2023-11-30T17:23:31.969054+0000","last_active":"2023-11-30T17:23:31.973913+0000","last_peered":"2023-11-30T17:23:31.973913+0000","last_clean":"2023-11-30T17:23:31.973913+0000","last_became_active":"2023-11-30T17:23:31.968764+0000","last_became_peered":"2023-11-30T17:23:31.968764+0000","last_unstale":"2023-11-30T17:23:31.973913+0000","last_undegraded":"2023-11-30T17:23:31.973913+0000","last_fullsized":"2023-11-30T17:23:31.973913+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969654+0000","last_change":"2023-11-30T17:23:31.571935+0000","last_active":"2023-11-30T17:23:31.969654+0000","last_peered":"2023-11-30T17:23:31.969654+0000","last_clean":"2023-11-30T17:23:31.969654+0000","last_became_active":"2023-11-30T17:23:31.571639+0000","last_became_peered":"2023-11-30T17:23:31.571639+0000","last_unstale":"2023-11-30T17:23:31.969654+0000","last_undegraded":"2023-11-30T17:23:31.969654+0000","last_fullsized":"2023-11-30T17:23:31.969654+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.952182+0000","last_change":"2023-11-30T17:23:31.576188+0000","last_active":"2023-11-30T17:23:31.952182+0000","last_peered":"2023-11-30T17:23:31.952182+0000","last_clean":"2023-11-30T17:23:31.952182+0000","last_became_active":"2023-11-30T17:23:31.575896+0000","last_became_peered":"2023-11-30T17:23:31.575896+0000","last_unstale":"2023-11-30T17:23:31.952182+0000","last_undegraded":"2023-11-30T17:23:31.952182+0000","last_fullsized":"2023-11-30T17:23:31.952182+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966946+0000","last_change":"2023-11-30T17:23:31.965487+0000","last_active":"2023-11-30T17:23:31.966946+0000","last_peered":"2023-11-30T17:23:31.966946+0000","last_clean":"2023-11-30T17:23:31.966946+0000","last_became_active":"2023-11-30T17:23:31.965068+0000","last_became_peered":"2023-11-30T17:23:31.965068+0000","last_unstale":"2023-11-30T17:23:31.966946+0000","last_undegraded":"2023-11-30T17:23:31.966946+0000","last_fullsized":"2023-11-30T17:23:31.966946+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3c","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.975114+0000","last_change":"2023-11-30T17:23:31.578786+0000","last_active":"2023-11-30T17:23:31.975114+0000","last_peered":"2023-11-30T17:23:31.975114+0000","last_clean":"2023-11-30T17:23:31.975114+0000","last_became_active":"2023-11-30T17:23:31.578524+0000","last_became_peered":"2023-11-30T17:23:31.578524+0000","last_unstale":"2023-11-30T17:23:31.975114+0000","last_undegraded":"2023-11-30T17:23:31.975114+0000","last_fullsized":"2023-11-30T17:23:31.975114+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977330+0000","last_change":"2023-11-30T17:23:31.972469+0000","last_active":"2023-11-30T17:23:31.977330+0000","last_peered":"2023-11-30T17:23:31.977330+0000","last_clean":"2023-11-30T17:23:31.977330+0000","last_became_active":"2023-11-30T17:23:31.971919+0000","last_became_peered":"2023-11-30T17:23:31.971919+0000","last_unstale":"2023-11-30T17:23:31.977330+0000","last_undegraded":"2023-11-30T17:23:31.977330+0000","last_fullsized":"2023-11-30T17:23:31.977330+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.961374+0000","last_change":"2023-11-30T17:23:31.957683+0000","last_active":"2023-11-30T17:23:31.961374+0000","last_peered":"2023-11-30T17:23:31.961374+0000","last_clean":"2023-11-30T17:23:31.961374+0000","last_became_active":"2023-11-30T17:23:31.957381+0000","last_became_peered":"2023-11-30T17:23:31.957381+0000","last_unstale":"2023-11-30T17:23:31.961374+0000","last_undegraded":"2023-11-30T17:23:31.961374+0000","last_fullsized":"2023-11-30T17:23:31.961374+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976055+0000","last_change":"2023-11-30T17:23:31.973265+0000","last_active":"2023-11-30T17:23:31.976055+0000","last_peered":"2023-11-30T17:23:31.976055+0000","last_clean":"2023-11-30T17:23:31.976055+0000","last_became_active":"2023-11-30T17:23:31.972961+0000","last_became_peered":"2023-11-30T17:23:31.972961+0000","last_unstale":"2023-11-30T17:23:31.976055+0000","last_undegraded":"2023-11-30T17:23:31.976055+0000","last_fullsized":"2023-11-30T17:23:31.976055+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.953739+0000","last_change":"2023-11-30T17:23:31.575243+0000","last_active":"2023-11-30T17:23:31.953739+0000","last_peered":"2023-11-30T17:23:31.953739+0000","last_clean":"2023-11-30T17:23:31.953739+0000","last_became_active":"2023-11-30T17:23:31.574933+0000","last_became_peered":"2023-11-30T17:23:31.574933+0000","last_unstale":"2023-11-30T17:23:31.953739+0000","last_undegraded":"2023-11-30T17:23:31.953739+0000","last_fullsized":"2023-11-30T17:23:31.953739+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966866+0000","last_change":"2023-11-30T17:23:31.960188+0000","last_active":"2023-11-30T17:23:31.966866+0000","last_peered":"2023-11-30T17:23:31.966866+0000","last_clean":"2023-11-30T17:23:31.966866+0000","last_became_active":"2023-11-30T17:23:31.959891+0000","last_became_peered":"2023-11-30T17:23:31.959891+0000","last_unstale":"2023-11-30T17:23:31.966866+0000","last_undegraded":"2023-11-30T17:23:31.966866+0000","last_fullsized":"2023-11-30T17:23:31.966866+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.975777+0000","last_change":"2023-11-30T17:23:31.970303+0000","last_active":"2023-11-30T17:23:31.975777+0000","last_peered":"2023-11-30T17:23:31.975777+0000","last_clean":"2023-11-30T17:23:31.975777+0000","last_became_active":"2023-11-30T17:23:31.970018+0000","last_became_peered":"2023-11-30T17:23:31.970018+0000","last_unstale":"2023-11-30T17:23:31.975777+0000","last_undegraded":"2023-11-30T17:23:31.975777+0000","last_fullsized":"2023-11-30T17:23:31.975777+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969753+0000","last_change":"2023-11-30T17:23:31.578961+0000","last_active":"2023-11-30T17:23:31.969753+0000","last_peered":"2023-11-30T17:23:31.969753+0000","last_clean":"2023-11-30T17:23:31.969753+0000","last_became_active":"2023-11-30T17:23:31.578654+0000","last_became_peered":"2023-11-30T17:23:31.578654+0000","last_unstale":"2023-11-30T17:23:31.969753+0000","last_undegraded":"2023-11-30T17:23:31.969753+0000","last_fullsized":"2023-11-30T17:23:31.969753+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968400+0000","last_change":"2023-11-30T17:23:31.951742+0000","last_active":"2023-11-30T17:23:31.968400+0000","last_peered":"2023-11-30T17:23:31.968400+0000","last_clean":"2023-11-30T17:23:31.968400+0000","last_became_active":"2023-11-30T17:23:31.951124+0000","last_became_peered":"2023-11-30T17:23:31.951124+0000","last_unstale":"2023-11-30T17:23:31.968400+0000","last_undegraded":"2023-11-30T17:23:31.968400+0000","last_fullsized":"2023-11-30T17:23:31.968400+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.965240+0000","last_change":"2023-11-30T17:23:31.581506+0000","last_active":"2023-11-30T17:23:31.965240+0000","last_peered":"2023-11-30T17:23:31.965240+0000","last_clean":"2023-11-30T17:23:31.965240+0000","last_became_active":"2023-11-30T17:23:31.581285+0000","last_became_peered":"2023-11-30T17:23:31.581285+0000","last_unstale":"2023-11-30T17:23:31.965240+0000","last_undegraded":"2023-11-30T17:23:31.965240+0000","last_fullsized":"2023-11-30T17:23:31.965240+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.974647+0000","last_change":"2023-11-30T17:23:31.962794+0000","last_active":"2023-11-30T17:23:31.974647+0000","last_peered":"2023-11-30T17:23:31.974647+0000","last_clean":"2023-11-30T17:23:31.974647+0000","last_became_active":"2023-11-30T17:23:31.961702+0000","last_became_peered":"2023-11-30T17:23:31.961702+0000","last_unstale":"2023-11-30T17:23:31.974647+0000","last_undegraded":"2023-11-30T17:23:31.974647+0000","last_fullsized":"2023-11-30T17:23:31.974647+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.960078+0000","last_change":"2023-11-30T17:23:31.580372+0000","last_active":"2023-11-30T17:23:31.960078+0000","last_peered":"2023-11-30T17:23:31.960078+0000","last_clean":"2023-11-30T17:23:31.960078+0000","last_became_active":"2023-11-30T17:23:31.579716+0000","last_became_peered":"2023-11-30T17:23:31.579716+0000","last_unstale":"2023-11-30T17:23:31.960078+0000","last_undegraded":"2023-11-30T17:23:31.960078+0000","last_fullsized":"2023-11-30T17:23:31.960078+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.950162+0000","last_change":"2023-11-30T17:23:31.582624+0000","last_active":"2023-11-30T17:23:31.950162+0000","last_peered":"2023-11-30T17:23:31.950162+0000","last_clean":"2023-11-30T17:23:31.950162+0000","last_became_active":"2023-11-30T17:23:31.582166+0000","last_became_peered":"2023-11-30T17:23:31.582166+0000","last_unstale":"2023-11-30T17:23:31.950162+0000","last_undegraded":"2023-11-30T17:23:31.950162+0000","last_fullsized":"2023-11-30T17:23:31.950162+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.974718+0000","last_change":"2023-11-30T17:23:31.963277+0000","last_active":"2023-11-30T17:23:31.974718+0000","last_peered":"2023-11-30T17:23:31.974718+0000","last_clean":"2023-11-30T17:23:31.974718+0000","last_became_active":"2023-11-30T17:23:31.962955+0000","last_became_peered":"2023-11-30T17:23:31.962955+0000","last_unstale":"2023-11-30T17:23:31.974718+0000","last_undegraded":"2023-11-30T17:23:31.974718+0000","last_fullsized":"2023-11-30T17:23:31.974718+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976863+0000","last_change":"2023-11-30T17:23:31.968097+0000","last_active":"2023-11-30T17:23:31.976863+0000","last_peered":"2023-11-30T17:23:31.976863+0000","last_clean":"2023-11-30T17:23:31.976863+0000","last_became_active":"2023-11-30T17:23:31.967788+0000","last_became_peered":"2023-11-30T17:23:31.967788+0000","last_unstale":"2023-11-30T17:23:31.976863+0000","last_undegraded":"2023-11-30T17:23:31.976863+0000","last_fullsized":"2023-11-30T17:23:31.976863+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.959018+0000","last_change":"2023-11-30T17:23:31.569565+0000","last_active":"2023-11-30T17:23:31.959018+0000","last_peered":"2023-11-30T17:23:31.959018+0000","last_clean":"2023-11-30T17:23:31.959018+0000","last_became_active":"2023-11-30T17:23:31.569226+0000","last_became_peered":"2023-11-30T17:23:31.569226+0000","last_unstale":"2023-11-30T17:23:31.959018+0000","last_undegraded":"2023-11-30T17:23:31.959018+0000","last_fullsized":"2023-11-30T17:23:31.959018+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.974805+0000","last_change":"2023-11-30T17:23:31.973956+0000","last_active":"2023-11-30T17:23:31.974805+0000","last_peered":"2023-11-30T17:23:31.974805+0000","last_clean":"2023-11-30T17:23:31.974805+0000","last_became_active":"2023-11-30T17:23:31.973675+0000","last_became_peered":"2023-11-30T17:23:31.973675+0000","last_unstale":"2023-11-30T17:23:31.974805+0000","last_undegraded":"2023-11-30T17:23:31.974805+0000","last_fullsized":"2023-11-30T17:23:31.974805+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.970067+0000","last_change":"2023-11-30T17:23:31.576721+0000","last_active":"2023-11-30T17:23:31.970067+0000","last_peered":"2023-11-30T17:23:31.970067+0000","last_clean":"2023-11-30T17:23:31.970067+0000","last_became_active":"2023-11-30T17:23:31.575699+0000","last_became_peered":"2023-11-30T17:23:31.575699+0000","last_unstale":"2023-11-30T17:23:31.970067+0000","last_undegraded":"2023-11-30T17:23:31.970067+0000","last_fullsized":"2023-11-30T17:23:31.970067+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968737+0000","last_change":"2023-11-30T17:23:31.964844+0000","last_active":"2023-11-30T17:23:31.968737+0000","last_peered":"2023-11-30T17:23:31.968737+0000","last_clean":"2023-11-30T17:23:31.968737+0000","last_became_active":"2023-11-30T17:23:31.961956+0000","last_became_peered":"2023-11-30T17:23:31.961956+0000","last_unstale":"2023-11-30T17:23:31.968737+0000","last_undegraded":"2023-11-30T17:23:31.968737+0000","last_fullsized":"2023-11-30T17:23:31.968737+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.957082+0000","last_change":"2023-11-30T17:23:31.575492+0000","last_active":"2023-11-30T17:23:31.957082+0000","last_peered":"2023-11-30T17:23:31.957082+0000","last_clean":"2023-11-30T17:23:31.957082+0000","last_became_active":"2023-11-30T17:23:31.573839+0000","last_became_peered":"2023-11-30T17:23:31.573839+0000","last_unstale":"2023-11-30T17:23:31.957082+0000","last_undegraded":"2023-11-30T17:23:31.957082+0000","last_fullsized":"2023-11-30T17:23:31.957082+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.967040+0000","last_change":"2023-11-30T17:23:31.965248+0000","last_active":"2023-11-30T17:23:31.967040+0000","last_peered":"2023-11-30T17:23:31.967040+0000","last_clean":"2023-11-30T17:23:31.967040+0000","last_became_active":"2023-11-30T17:23:31.964971+0000","last_became_peered":"2023-11-30T17:23:31.964971+0000","last_unstale":"2023-11-30T17:23:31.967040+0000","last_undegraded":"2023-11-30T17:23:31.967040+0000","last_fullsized":"2023-11-30T17:23:31.967040+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2b","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969966+0000","last_change":"2023-11-30T17:23:31.573926+0000","last_active":"2023-11-30T17:23:31.969966+0000","last_peered":"2023-11-30T17:23:31.969966+0000","last_clean":"2023-11-30T17:23:31.969966+0000","last_became_active":"2023-11-30T17:23:31.573565+0000","last_became_peered":"2023-11-30T17:23:31.573565+0000","last_unstale":"2023-11-30T17:23:31.969966+0000","last_undegraded":"2023-11-30T17:23:31.969966+0000","last_fullsized":"2023-11-30T17:23:31.969966+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.971378+0000","last_change":"2023-11-30T17:23:31.579162+0000","last_active":"2023-11-30T17:23:31.971378+0000","last_peered":"2023-11-30T17:23:31.971378+0000","last_clean":"2023-11-30T17:23:31.971378+0000","last_became_active":"2023-11-30T17:23:31.578839+0000","last_became_peered":"2023-11-30T17:23:31.578839+0000","last_unstale":"2023-11-30T17:23:31.971378+0000","last_undegraded":"2023-11-30T17:23:31.971378+0000","last_fullsized":"2023-11-30T17:23:31.971378+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.953484+0000","last_change":"2023-11-30T17:23:31.575050+0000","last_active":"2023-11-30T17:23:31.953484+0000","last_peered":"2023-11-30T17:23:31.953484+0000","last_clean":"2023-11-30T17:23:31.953484+0000","last_became_active":"2023-11-30T17:23:31.574230+0000","last_became_peered":"2023-11-30T17:23:31.574230+0000","last_unstale":"2023-11-30T17:23:31.953484+0000","last_undegraded":"2023-11-30T17:23:31.953484+0000","last_fullsized":"2023-11-30T17:23:31.953484+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976986+0000","last_change":"2023-11-30T17:23:31.970460+0000","last_active":"2023-11-30T17:23:31.976986+0000","last_peered":"2023-11-30T17:23:31.976986+0000","last_clean":"2023-11-30T17:23:31.976986+0000","last_became_active":"2023-11-30T17:23:31.970168+0000","last_became_peered":"2023-11-30T17:23:31.970168+0000","last_unstale":"2023-11-30T17:23:31.976986+0000","last_undegraded":"2023-11-30T17:23:31.976986+0000","last_fullsized":"2023-11-30T17:23:31.976986+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969686+0000","last_change":"2023-11-30T17:23:31.576651+0000","last_active":"2023-11-30T17:23:31.969686+0000","last_peered":"2023-11-30T17:23:31.969686+0000","last_clean":"2023-11-30T17:23:31.969686+0000","last_became_active":"2023-11-30T17:23:31.576386+0000","last_became_peered":"2023-11-30T17:23:31.576386+0000","last_unstale":"2023-11-30T17:23:31.969686+0000","last_undegraded":"2023-11-30T17:23:31.969686+0000","last_fullsized":"2023-11-30T17:23:31.969686+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968312+0000","last_change":"2023-11-30T17:23:31.966907+0000","last_active":"2023-11-30T17:23:31.968312+0000","last_peered":"2023-11-30T17:23:31.968312+0000","last_clean":"2023-11-30T17:23:31.968312+0000","last_became_active":"2023-11-30T17:23:31.966449+0000","last_became_peered":"2023-11-30T17:23:31.966449+0000","last_unstale":"2023-11-30T17:23:31.968312+0000","last_undegraded":"2023-11-30T17:23:31.968312+0000","last_fullsized":"2023-11-30T17:23:31.968312+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.951943+0000","last_change":"2023-11-30T17:23:31.586699+0000","last_active":"2023-11-30T17:23:31.951943+0000","last_peered":"2023-11-30T17:23:31.951943+0000","last_clean":"2023-11-30T17:23:31.951943+0000","last_became_active":"2023-11-30T17:23:31.586428+0000","last_became_peered":"2023-11-30T17:23:31.586428+0000","last_unstale":"2023-11-30T17:23:31.951943+0000","last_undegraded":"2023-11-30T17:23:31.951943+0000","last_fullsized":"2023-11-30T17:23:31.951943+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968422+0000","last_change":"2023-11-30T17:23:31.951947+0000","last_active":"2023-11-30T17:23:31.968422+0000","last_peered":"2023-11-30T17:23:31.968422+0000","last_clean":"2023-11-30T17:23:31.968422+0000","last_became_active":"2023-11-30T17:23:31.951475+0000","last_became_peered":"2023-11-30T17:23:31.951475+0000","last_unstale":"2023-11-30T17:23:31.968422+0000","last_undegraded":"2023-11-30T17:23:31.968422+0000","last_fullsized":"2023-11-30T17:23:31.968422+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969411+0000","last_change":"2023-11-30T17:23:31.575097+0000","last_active":"2023-11-30T17:23:31.969411+0000","last_peered":"2023-11-30T17:23:31.969411+0000","last_clean":"2023-11-30T17:23:31.969411+0000","last_became_active":"2023-11-30T17:23:31.574793+0000","last_became_peered":"2023-11-30T17:23:31.574793+0000","last_unstale":"2023-11-30T17:23:31.969411+0000","last_undegraded":"2023-11-30T17:23:31.969411+0000","last_fullsized":"2023-11-30T17:23:31.969411+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.971442+0000","last_change":"2023-11-30T17:23:31.585126+0000","last_active":"2023-11-30T17:23:31.971442+0000","last_peered":"2023-11-30T17:23:31.971442+0000","last_clean":"2023-11-30T17:23:31.971442+0000","last_became_active":"2023-11-30T17:23:31.584635+0000","last_became_peered":"2023-11-30T17:23:31.584635+0000","last_unstale":"2023-11-30T17:23:31.971442+0000","last_undegraded":"2023-11-30T17:23:31.971442+0000","last_fullsized":"2023-11-30T17:23:31.971442+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.963851+0000","last_change":"2023-11-30T17:23:31.962840+0000","last_active":"2023-11-30T17:23:31.963851+0000","last_peered":"2023-11-30T17:23:31.963851+0000","last_clean":"2023-11-30T17:23:31.963851+0000","last_became_active":"2023-11-30T17:23:31.962549+0000","last_became_peered":"2023-11-30T17:23:31.962549+0000","last_unstale":"2023-11-30T17:23:31.963851+0000","last_undegraded":"2023-11-30T17:23:31.963851+0000","last_fullsized":"2023-11-30T17:23:31.963851+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.975897+0000","last_change":"2023-11-30T17:23:31.967042+0000","last_active":"2023-11-30T17:23:31.975897+0000","last_peered":"2023-11-30T17:23:31.975897+0000","last_clean":"2023-11-30T17:23:31.975897+0000","last_became_active":"2023-11-30T17:23:31.966757+0000","last_became_peered":"2023-11-30T17:23:31.966757+0000","last_unstale":"2023-11-30T17:23:31.975897+0000","last_undegraded":"2023-11-30T17:23:31.975897+0000","last_fullsized":"2023-11-30T17:23:31.975897+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.970001+0000","last_change":"2023-11-30T17:23:31.963695+0000","last_active":"2023-11-30T17:23:31.970001+0000","last_peered":"2023-11-30T17:23:31.970001+0000","last_clean":"2023-11-30T17:23:31.970001+0000","last_became_active":"2023-11-30T17:23:31.962928+0000","last_became_peered":"2023-11-30T17:23:31.962928+0000","last_unstale":"2023-11-30T17:23:31.970001+0000","last_undegraded":"2023-11-30T17:23:31.970001+0000","last_fullsized":"2023-11-30T17:23:31.970001+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.972863+0000","last_change":"2023-11-30T17:23:31.971045+0000","last_active":"2023-11-30T17:23:31.972863+0000","last_peered":"2023-11-30T17:23:31.972863+0000","last_clean":"2023-11-30T17:23:31.972863+0000","last_became_active":"2023-11-30T17:23:31.970765+0000","last_became_peered":"2023-11-30T17:23:31.970765+0000","last_unstale":"2023-11-30T17:23:31.972863+0000","last_undegraded":"2023-11-30T17:23:31.972863+0000","last_fullsized":"2023-11-30T17:23:31.972863+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.963145+0000","last_change":"2023-11-30T17:23:31.584175+0000","last_active":"2023-11-30T17:23:31.963145+0000","last_peered":"2023-11-30T17:23:31.963145+0000","last_clean":"2023-11-30T17:23:31.963145+0000","last_became_active":"2023-11-30T17:23:31.583873+0000","last_became_peered":"2023-11-30T17:23:31.583873+0000","last_unstale":"2023-11-30T17:23:31.963145+0000","last_undegraded":"2023-11-30T17:23:31.963145+0000","last_fullsized":"2023-11-30T17:23:31.963145+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.965756+0000","last_change":"2023-11-30T17:23:31.951314+0000","last_active":"2023-11-30T17:23:31.965756+0000","last_peered":"2023-11-30T17:23:31.965756+0000","last_clean":"2023-11-30T17:23:31.965756+0000","last_became_active":"2023-11-30T17:23:31.951068+0000","last_became_peered":"2023-11-30T17:23:31.951068+0000","last_unstale":"2023-11-30T17:23:31.965756+0000","last_undegraded":"2023-11-30T17:23:31.965756+0000","last_fullsized":"2023-11-30T17:23:31.965756+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977304+0000","last_change":"2023-11-30T17:23:31.972316+0000","last_active":"2023-11-30T17:23:31.977304+0000","last_peered":"2023-11-30T17:23:31.977304+0000","last_clean":"2023-11-30T17:23:31.977304+0000","last_became_active":"2023-11-30T17:23:31.971591+0000","last_became_peered":"2023-11-30T17:23:31.971591+0000","last_unstale":"2023-11-30T17:23:31.977304+0000","last_undegraded":"2023-11-30T17:23:31.977304+0000","last_fullsized":"2023-11-30T17:23:31.977304+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.971522+0000","last_change":"2023-11-30T17:23:31.584951+0000","last_active":"2023-11-30T17:23:31.971522+0000","last_peered":"2023-11-30T17:23:31.971522+0000","last_clean":"2023-11-30T17:23:31.971522+0000","last_became_active":"2023-11-30T17:23:31.584271+0000","last_became_peered":"2023-11-30T17:23:31.584271+0000","last_unstale":"2023-11-30T17:23:31.971522+0000","last_undegraded":"2023-11-30T17:23:31.971522+0000","last_fullsized":"2023-11-30T17:23:31.971522+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968644+0000","last_change":"2023-11-30T17:23:31.964012+0000","last_active":"2023-11-30T17:23:31.968644+0000","last_peered":"2023-11-30T17:23:31.968644+0000","last_clean":"2023-11-30T17:23:31.968644+0000","last_became_active":"2023-11-30T17:23:31.963750+0000","last_became_peered":"2023-11-30T17:23:31.963750+0000","last_unstale":"2023-11-30T17:23:31.968644+0000","last_undegraded":"2023-11-30T17:23:31.968644+0000","last_fullsized":"2023-11-30T17:23:31.968644+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.949896+0000","last_change":"2023-11-30T17:23:31.582453+0000","last_active":"2023-11-30T17:23:31.949896+0000","last_peered":"2023-11-30T17:23:31.949896+0000","last_clean":"2023-11-30T17:23:31.949896+0000","last_became_active":"2023-11-30T17:23:31.581818+0000","last_became_peered":"2023-11-30T17:23:31.581818+0000","last_unstale":"2023-11-30T17:23:31.949896+0000","last_undegraded":"2023-11-30T17:23:31.949896+0000","last_fullsized":"2023-11-30T17:23:31.949896+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977686+0000","last_change":"2023-11-30T17:23:31.973318+0000","last_active":"2023-11-30T17:23:31.977686+0000","last_peered":"2023-11-30T17:23:31.977686+0000","last_clean":"2023-11-30T17:23:31.977686+0000","last_became_active":"2023-11-30T17:23:31.973044+0000","last_became_peered":"2023-11-30T17:23:31.973044+0000","last_unstale":"2023-11-30T17:23:31.977686+0000","last_undegraded":"2023-11-30T17:23:31.977686+0000","last_fullsized":"2023-11-30T17:23:31.977686+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.951309+0000","last_change":"2023-11-30T17:23:31.583511+0000","last_active":"2023-11-30T17:23:31.951309+0000","last_peered":"2023-11-30T17:23:31.951309+0000","last_clean":"2023-11-30T17:23:31.951309+0000","last_became_active":"2023-11-30T17:23:31.583179+0000","last_became_peered":"2023-11-30T17:23:31.583179+0000","last_unstale":"2023-11-30T17:23:31.951309+0000","last_undegraded":"2023-11-30T17:23:31.951309+0000","last_fullsized":"2023-11-30T17:23:31.951309+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969624+0000","last_change":"2023-11-30T17:23:31.968565+0000","last_active":"2023-11-30T17:23:31.969624+0000","last_peered":"2023-11-30T17:23:31.969624+0000","last_clean":"2023-11-30T17:23:31.969624+0000","last_became_active":"2023-11-30T17:23:31.968258+0000","last_became_peered":"2023-11-30T17:23:31.968258+0000","last_unstale":"2023-11-30T17:23:31.969624+0000","last_undegraded":"2023-11-30T17:23:31.969624+0000","last_fullsized":"2023-11-30T17:23:31.969624+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.953697+0000","last_change":"2023-11-30T17:23:31.586544+0000","last_active":"2023-11-30T17:23:31.953697+0000","last_peered":"2023-11-30T17:23:31.953697+0000","last_clean":"2023-11-30T17:23:31.953697+0000","last_became_active":"2023-11-30T17:23:31.586249+0000","last_became_peered":"2023-11-30T17:23:31.586249+0000","last_unstale":"2023-11-30T17:23:31.953697+0000","last_undegraded":"2023-11-30T17:23:31.953697+0000","last_fullsized":"2023-11-30T17:23:31.953697+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.967257+0000","last_change":"2023-11-30T17:23:31.966064+0000","last_active":"2023-11-30T17:23:31.967257+0000","last_peered":"2023-11-30T17:23:31.967257+0000","last_clean":"2023-11-30T17:23:31.967257+0000","last_became_active":"2023-11-30T17:23:31.965286+0000","last_became_peered":"2023-11-30T17:23:31.965286+0000","last_unstale":"2023-11-30T17:23:31.967257+0000","last_undegraded":"2023-11-30T17:23:31.967257+0000","last_fullsized":"2023-11-30T17:23:31.967257+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976819+0000","last_change":"2023-11-30T17:23:31.967924+0000","last_active":"2023-11-30T17:23:31.976819+0000","last_peered":"2023-11-30T17:23:31.976819+0000","last_clean":"2023-11-30T17:23:31.976819+0000","last_became_active":"2023-11-30T17:23:31.967731+0000","last_became_peered":"2023-11-30T17:23:31.967731+0000","last_unstale":"2023-11-30T17:23:31.976819+0000","last_undegraded":"2023-11-30T17:23:31.976819+0000","last_fullsized":"2023-11-30T17:23:31.976819+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.973710+0000","last_change":"2023-11-30T17:23:31.574509+0000","last_active":"2023-11-30T17:23:31.973710+0000","last_peered":"2023-11-30T17:23:31.973710+0000","last_clean":"2023-11-30T17:23:31.973710+0000","last_became_active":"2023-11-30T17:23:31.574222+0000","last_became_peered":"2023-11-30T17:23:31.574222+0000","last_unstale":"2023-11-30T17:23:31.973710+0000","last_undegraded":"2023-11-30T17:23:31.973710+0000","last_fullsized":"2023-11-30T17:23:31.973710+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977348+0000","last_change":"2023-11-30T17:23:31.972653+0000","last_active":"2023-11-30T17:23:31.977348+0000","last_peered":"2023-11-30T17:23:31.977348+0000","last_clean":"2023-11-30T17:23:31.977348+0000","last_became_active":"2023-11-30T17:23:31.972117+0000","last_became_peered":"2023-11-30T17:23:31.972117+0000","last_unstale":"2023-11-30T17:23:31.977348+0000","last_undegraded":"2023-11-30T17:23:31.977348+0000","last_fullsized":"2023-11-30T17:23:31.977348+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968511+0000","last_change":"2023-11-30T17:23:31.583818+0000","last_active":"2023-11-30T17:23:31.968511+0000","last_peered":"2023-11-30T17:23:31.968511+0000","last_clean":"2023-11-30T17:23:31.968511+0000","last_became_active":"2023-11-30T17:23:31.583114+0000","last_became_peered":"2023-11-30T17:23:31.583114+0000","last_unstale":"2023-11-30T17:23:31.968511+0000","last_undegraded":"2023-11-30T17:23:31.968511+0000","last_fullsized":"2023-11-30T17:23:31.968511+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.947455+0000","last_change":"2023-11-30T17:23:31.583430+0000","last_active":"2023-11-30T17:23:31.947455+0000","last_peered":"2023-11-30T17:23:31.947455+0000","last_clean":"2023-11-30T17:23:31.947455+0000","last_became_active":"2023-11-30T17:23:31.583105+0000","last_became_peered":"2023-11-30T17:23:31.583105+0000","last_unstale":"2023-11-30T17:23:31.947455+0000","last_undegraded":"2023-11-30T17:23:31.947455+0000","last_fullsized":"2023-11-30T17:23:31.947455+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.967351+0000","last_change":"2023-11-30T17:23:31.964226+0000","last_active":"2023-11-30T17:23:31.967351+0000","last_peered":"2023-11-30T17:23:31.967351+0000","last_clean":"2023-11-30T17:23:31.967351+0000","last_became_active":"2023-11-30T17:23:31.963944+0000","last_became_peered":"2023-11-30T17:23:31.963944+0000","last_unstale":"2023-11-30T17:23:31.967351+0000","last_undegraded":"2023-11-30T17:23:31.967351+0000","last_fullsized":"2023-11-30T17:23:31.967351+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.964360+0000","last_change":"2023-11-30T17:23:31.571471+0000","last_active":"2023-11-30T17:23:31.964360+0000","last_peered":"2023-11-30T17:23:31.964360+0000","last_clean":"2023-11-30T17:23:31.964360+0000","last_became_active":"2023-11-30T17:23:31.571178+0000","last_became_peered":"2023-11-30T17:23:31.571178+0000","last_unstale":"2023-11-30T17:23:31.964360+0000","last_undegraded":"2023-11-30T17:23:31.964360+0000","last_fullsized":"2023-11-30T17:23:31.964360+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966913+0000","last_change":"2023-11-30T17:23:31.965542+0000","last_active":"2023-11-30T17:23:31.966913+0000","last_peered":"2023-11-30T17:23:31.966913+0000","last_clean":"2023-11-30T17:23:31.966913+0000","last_became_active":"2023-11-30T17:23:31.965254+0000","last_became_peered":"2023-11-30T17:23:31.965254+0000","last_unstale":"2023-11-30T17:23:31.966913+0000","last_undegraded":"2023-11-30T17:23:31.966913+0000","last_fullsized":"2023-11-30T17:23:31.966913+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"112'4","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977162+0000","last_change":"2023-11-30T17:23:31.584353+0000","last_active":"2023-11-30T17:23:31.977162+0000","last_peered":"2023-11-30T17:23:31.977162+0000","last_clean":"2023-11-30T17:23:31.977162+0000","last_became_active":"2023-11-30T17:23:31.584077+0000","last_became_peered":"2023-11-30T17:23:31.584077+0000","last_unstale":"2023-11-30T17:23:31.977162+0000","last_undegraded":"2023-11-30T17:23:31.977162+0000","last_fullsized":"2023-11-30T17:23:31.977162+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.965305+0000","last_change":"2023-11-30T17:23:31.576611+0000","last_active":"2023-11-30T17:23:31.965305+0000","last_peered":"2023-11-30T17:23:31.965305+0000","last_clean":"2023-11-30T17:23:31.965305+0000","last_became_active":"2023-11-30T17:23:31.576303+0000","last_became_peered":"2023-11-30T17:23:31.576303+0000","last_unstale":"2023-11-30T17:23:31.965305+0000","last_undegraded":"2023-11-30T17:23:31.965305+0000","last_fullsized":"2023-11-30T17:23:31.965305+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976552+0000","last_change":"2023-11-30T17:23:31.973173+0000","last_active":"2023-11-30T17:23:31.976552+0000","last_peered":"2023-11-30T17:23:31.976552+0000","last_clean":"2023-11-30T17:23:31.976552+0000","last_became_active":"2023-11-30T17:23:31.970112+0000","last_became_peered":"2023-11-30T17:23:31.970112+0000","last_unstale":"2023-11-30T17:23:31.976552+0000","last_undegraded":"2023-11-30T17:23:31.976552+0000","last_fullsized":"2023-11-30T17:23:31.976552+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968363+0000","last_change":"2023-11-30T17:23:31.962690+0000","last_active":"2023-11-30T17:23:31.968363+0000","last_peered":"2023-11-30T17:23:31.968363+0000","last_clean":"2023-11-30T17:23:31.968363+0000","last_became_active":"2023-11-30T17:23:31.962398+0000","last_became_peered":"2023-11-30T17:23:31.962398+0000","last_unstale":"2023-11-30T17:23:31.968363+0000","last_undegraded":"2023-11-30T17:23:31.968363+0000","last_fullsized":"2023-11-30T17:23:31.968363+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.975890+0000","last_change":"2023-11-30T17:23:31.969835+0000","last_active":"2023-11-30T17:23:31.975890+0000","last_peered":"2023-11-30T17:23:31.975890+0000","last_clean":"2023-11-30T17:23:31.975890+0000","last_became_active":"2023-11-30T17:23:31.969554+0000","last_became_peered":"2023-11-30T17:23:31.969554+0000","last_unstale":"2023-11-30T17:23:31.975890+0000","last_undegraded":"2023-11-30T17:23:31.975890+0000","last_fullsized":"2023-11-30T17:23:31.975890+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.947769+0000","last_change":"2023-11-30T17:23:31.588106+0000","last_active":"2023-11-30T17:23:31.947769+0000","last_peered":"2023-11-30T17:23:31.947769+0000","last_clean":"2023-11-30T17:23:31.947769+0000","last_became_active":"2023-11-30T17:23:31.587639+0000","last_became_peered":"2023-11-30T17:23:31.587639+0000","last_unstale":"2023-11-30T17:23:31.947769+0000","last_undegraded":"2023-11-30T17:23:31.947769+0000","last_fullsized":"2023-11-30T17:23:31.947769+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966848+0000","last_change":"2023-11-30T17:23:31.964658+0000","last_active":"2023-11-30T17:23:31.966848+0000","last_peered":"2023-11-30T17:23:31.966848+0000","last_clean":"2023-11-30T17:23:31.966848+0000","last_became_active":"2023-11-30T17:23:31.964344+0000","last_became_peered":"2023-11-30T17:23:31.964344+0000","last_unstale":"2023-11-30T17:23:31.966848+0000","last_undegraded":"2023-11-30T17:23:31.966848+0000","last_fullsized":"2023-11-30T17:23:31.966848+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966407+0000","last_change":"2023-11-30T17:23:31.951476+0000","last_active":"2023-11-30T17:23:31.966407+0000","last_peered":"2023-11-30T17:23:31.966407+0000","last_clean":"2023-11-30T17:23:31.966407+0000","last_became_active":"2023-11-30T17:23:31.951287+0000","last_became_peered":"2023-11-30T17:23:31.951287+0000","last_unstale":"2023-11-30T17:23:31.966407+0000","last_undegraded":"2023-11-30T17:23:31.966407+0000","last_fullsized":"2023-11-30T17:23:31.966407+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.951316+0000","last_change":"2023-11-30T17:23:31.579504+0000","last_active":"2023-11-30T17:23:31.951316+0000","last_peered":"2023-11-30T17:23:31.951316+0000","last_clean":"2023-11-30T17:23:31.951316+0000","last_became_active":"2023-11-30T17:23:31.579215+0000","last_became_peered":"2023-11-30T17:23:31.579215+0000","last_unstale":"2023-11-30T17:23:31.951316+0000","last_undegraded":"2023-11-30T17:23:31.951316+0000","last_fullsized":"2023-11-30T17:23:31.951316+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976068+0000","last_change":"2023-11-30T17:23:31.973279+0000","last_active":"2023-11-30T17:23:31.976068+0000","last_peered":"2023-11-30T17:23:31.976068+0000","last_clean":"2023-11-30T17:23:31.976068+0000","last_became_active":"2023-11-30T17:23:31.972992+0000","last_became_peered":"2023-11-30T17:23:31.972992+0000","last_unstale":"2023-11-30T17:23:31.976068+0000","last_undegraded":"2023-11-30T17:23:31.976068+0000","last_fullsized":"2023-11-30T17:23:31.976068+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":91,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969790+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:23:31.969790+0000","last_peered":"2023-11-30T17:23:31.969790+0000","last_clean":"2023-11-30T17:23:31.969790+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:23:31.969790+0000","last_undegraded":"2023-11-30T17:23:31.969790+0000","last_fullsized":"2023-11-30T17:23:31.969790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":86,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-30T17:23:28.089672+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:23:28.089672+0000","last_peered":"2023-11-30T17:23:28.089672+0000","last_clean":"2023-11-30T17:23:28.089672+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:23:28.089672+0000","last_undegraded":"2023-11-30T17:23:28.089672+0000","last_fullsized":"2023-11-30T17:23:28.089672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966869+0000","last_change":"2023-11-30T17:23:31.572852+0000","last_active":"2023-11-30T17:23:31.966869+0000","last_peered":"2023-11-30T17:23:31.966869+0000","last_clean":"2023-11-30T17:23:31.966869+0000","last_became_active":"2023-11-30T17:23:31.572533+0000","last_became_peered":"2023-11-30T17:23:31.572533+0000","last_unstale":"2023-11-30T17:23:31.966869+0000","last_undegraded":"2023-11-30T17:23:31.966869+0000","last_fullsized":"2023-11-30T17:23:31.966869+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":95,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.953812+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:23:31.953812+0000","last_peered":"2023-11-30T17:23:31.953812+0000","last_clean":"2023-11-30T17:23:31.953812+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:23:31.953812+0000","last_undegraded":"2023-11-30T17:23:31.953812+0000","last_fullsized":"2023-11-30T17:23:31.953812+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.963094+0000","last_change":"2023-11-30T17:23:31.958158+0000","last_active":"2023-11-30T17:23:31.963094+0000","last_peered":"2023-11-30T17:23:31.963094+0000","last_clean":"2023-11-30T17:23:31.963094+0000","last_became_active":"2023-11-30T17:23:31.957892+0000","last_became_peered":"2023-11-30T17:23:31.957892+0000","last_unstale":"2023-11-30T17:23:31.963094+0000","last_undegraded":"2023-11-30T17:23:31.963094+0000","last_fullsized":"2023-11-30T17:23:31.963094+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969704+0000","last_change":"2023-11-30T17:23:31.576516+0000","last_active":"2023-11-30T17:23:31.969704+0000","last_peered":"2023-11-30T17:23:31.969704+0000","last_clean":"2023-11-30T17:23:31.969704+0000","last_became_active":"2023-11-30T17:23:31.576131+0000","last_became_peered":"2023-11-30T17:23:31.576131+0000","last_unstale":"2023-11-30T17:23:31.969704+0000","last_undegraded":"2023-11-30T17:23:31.969704+0000","last_fullsized":"2023-11-30T17:23:31.969704+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":86,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-30T17:23:28.089708+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:23:28.089708+0000","last_peered":"2023-11-30T17:23:28.089708+0000","last_clean":"2023-11-30T17:23:28.089708+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:23:28.089708+0000","last_undegraded":"2023-11-30T17:23:28.089708+0000","last_fullsized":"2023-11-30T17:23:28.089708+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":92,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.951439+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:23:31.951439+0000","last_peered":"2023-11-30T17:23:31.951439+0000","last_clean":"2023-11-30T17:23:31.951439+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:23:31.951439+0000","last_undegraded":"2023-11-30T17:23:31.951439+0000","last_fullsized":"2023-11-30T17:23:31.951439+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976031+0000","last_change":"2023-11-30T17:23:31.972941+0000","last_active":"2023-11-30T17:23:31.976031+0000","last_peered":"2023-11-30T17:23:31.976031+0000","last_clean":"2023-11-30T17:23:31.976031+0000","last_became_active":"2023-11-30T17:23:31.967587+0000","last_became_peered":"2023-11-30T17:23:31.967587+0000","last_unstale":"2023-11-30T17:23:31.976031+0000","last_undegraded":"2023-11-30T17:23:31.976031+0000","last_fullsized":"2023-11-30T17:23:31.976031+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":90,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.951488+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:23:31.951488+0000","last_peered":"2023-11-30T17:23:31.951488+0000","last_clean":"2023-11-30T17:23:31.951488+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:23:31.951488+0000","last_undegraded":"2023-11-30T17:23:31.951488+0000","last_fullsized":"2023-11-30T17:23:31.951488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.959971+0000","last_change":"2023-11-30T17:23:31.580697+0000","last_active":"2023-11-30T17:23:31.959971+0000","last_peered":"2023-11-30T17:23:31.959971+0000","last_clean":"2023-11-30T17:23:31.959971+0000","last_became_active":"2023-11-30T17:23:31.580098+0000","last_became_peered":"2023-11-30T17:23:31.580098+0000","last_unstale":"2023-11-30T17:23:31.959971+0000","last_undegraded":"2023-11-30T17:23:31.959971+0000","last_fullsized":"2023-11-30T17:23:31.959971+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":90,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.952310+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:23:31.952310+0000","last_peered":"2023-11-30T17:23:31.952310+0000","last_clean":"2023-11-30T17:23:31.952310+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:23:31.952310+0000","last_undegraded":"2023-11-30T17:23:31.952310+0000","last_fullsized":"2023-11-30T17:23:31.952310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":91,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969567+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:23:31.969567+0000","last_peered":"2023-11-30T17:23:31.969567+0000","last_clean":"2023-11-30T17:23:31.969567+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:23:31.969567+0000","last_undegraded":"2023-11-30T17:23:31.969567+0000","last_fullsized":"2023-11-30T17:23:31.969567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968512+0000","last_change":"2023-11-30T17:23:31.963009+0000","last_active":"2023-11-30T17:23:31.968512+0000","last_peered":"2023-11-30T17:23:31.968512+0000","last_clean":"2023-11-30T17:23:31.968512+0000","last_became_active":"2023-11-30T17:23:31.962748+0000","last_became_peered":"2023-11-30T17:23:31.962748+0000","last_unstale":"2023-11-30T17:23:31.968512+0000","last_undegraded":"2023-11-30T17:23:31.968512+0000","last_fullsized":"2023-11-30T17:23:31.968512+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.953593+0000","last_change":"2023-11-30T17:23:31.575232+0000","last_active":"2023-11-30T17:23:31.953593+0000","last_peered":"2023-11-30T17:23:31.953593+0000","last_clean":"2023-11-30T17:23:31.953593+0000","last_became_active":"2023-11-30T17:23:31.574785+0000","last_became_peered":"2023-11-30T17:23:31.574785+0000","last_unstale":"2023-11-30T17:23:31.953593+0000","last_undegraded":"2023-11-30T17:23:31.953593+0000","last_fullsized":"2023-11-30T17:23:31.953593+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-30T17:23:27.439439+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:23:27.439439+0000","last_peered":"2023-11-30T17:23:27.439439+0000","last_clean":"2023-11-30T17:23:27.439439+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:23:27.439439+0000","last_undegraded":"2023-11-30T17:23:27.439439+0000","last_fullsized":"2023-11-30T17:23:27.439439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":82,"acting":82,"num_store_stats":5},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":748,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":70,"acting":70,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575043,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302556,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069284,"statfs":{"total":96636764160,"available":96326946816,"internally_reserved":0,"allocated":1396736,"data_stored":697239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.371,"5min":0.315,"15min":0.23899999999999999},"max":{"1min":0.72399999999999998,"5min":0.80400000000000005,"15min":0.81100000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57499999999999996,"15min":0.58199999999999996},"min":{"1min":0.41099999999999998,"5min":0.40699999999999997,"15min":0.32200000000000001},"max":{"1min":0.74099999999999999,"5min":0.78300000000000003,"15min":0.81899999999999995},"last":0.503}]},{"osd":1,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70899999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.442},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.32900000000000001,"5min":0.29899999999999999,"15min":0.28799999999999998},"max":{"1min":0.64000000000000001,"5min":0.76100000000000001,"15min":0.82499999999999996},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53800000000000003,"15min":0.54900000000000004},"min":{"1min":0.37,"5min":0.33500000000000002,"15min":0.32800000000000001},"max":{"1min":0.68200000000000005,"5min":0.77000000000000002,"15min":0.78300000000000003},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.38800000000000001,"5min":0.35399999999999998,"15min":0.28699999999999998},"max":{"1min":0.70499999999999996,"5min":0.73799999999999999,"15min":0.83899999999999997},"last":0.53700000000000003}]},{"osd":3,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.53400000000000003,"15min":0.54100000000000004},"min":{"1min":0.378,"5min":0.36499999999999999,"15min":0.33200000000000002},"max":{"1min":0.65700000000000003,"5min":0.754,"15min":0.78000000000000003},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56999999999999995,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.40799999999999997,"15min":0.33900000000000002},"max":{"1min":0.67500000000000004,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.54800000000000004}]},{"osd":4,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44600000000000001,"15min":0.45800000000000002},"min":{"1min":0.32400000000000001,"5min":0.313,"15min":0.29699999999999999},"max":{"1min":0.55000000000000004,"5min":0.77000000000000002,"15min":0.79900000000000004},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.30099999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59899999999999998,"5min":0.75800000000000001,"15min":1.3180000000000001},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.48399999999999999,"15min":0.49099999999999999},"min":{"1min":0.317,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58699999999999997,"5min":0.80000000000000004,"15min":0.82899999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.61199999999999999,"5min":0.79300000000000004,"15min":0.872},"last":0.45800000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.69699999999999995,"5min":0.81200000000000006,"15min":0.85199999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.33700000000000002},"max":{"1min":0.67300000000000004,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.47499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575041,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302500,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069340,"statfs":{"total":96636764160,"available":96327004160,"internally_reserved":0,"allocated":1339392,"data_stored":670288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.57099999999999995},"min":{"1min":0.38100000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72899999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.498},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56499999999999995,"15min":0.58699999999999997},"min":{"1min":0.46300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.748,"5min":0.79600000000000004,"15min":0.89300000000000002},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54600000000000004,"15min":0.56399999999999995},"min":{"1min":0.32800000000000001,"5min":0.30599999999999999,"15min":0.26400000000000001},"max":{"1min":0.75800000000000001,"5min":0.76900000000000002,"15min":0.82799999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58199999999999996,"15min":0.59899999999999998},"min":{"1min":0.45100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.751,"5min":0.82499999999999996,"15min":0.85199999999999998},"last":0.54600000000000004}]},{"osd":2,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56000000000000005,"15min":0.57299999999999995},"min":{"1min":0.371,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.77500000000000002,"5min":0.79900000000000004,"15min":0.82599999999999996},"last":0.376},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.40699999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76100000000000001,"5min":0.80900000000000005,"15min":0.82499999999999996},"last":0.53400000000000003}]},{"osd":3,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51100000000000001,"15min":0.53200000000000003},"min":{"1min":0.40400000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71899999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73499999999999999,"5min":0.75600000000000001,"15min":0.79600000000000004},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44600000000000001,"15min":0.45300000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.84199999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46100000000000002,"15min":0.47799999999999998},"min":{"1min":0.34999999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.746,"5min":0.76000000000000001,"15min":0.83899999999999997},"last":0.46700000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.45900000000000002,"15min":0.47199999999999998},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.28299999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.496,"15min":0.50700000000000001},"min":{"1min":0.38400000000000001,"5min":0.33500000000000002,"15min":0.31900000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.42099999999999999}]},{"osd":7,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.34499999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.74199999999999999,"5min":0.80700000000000005,"15min":0.93200000000000005},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55100000000000005,"15min":0.56299999999999994},"min":{"1min":0.43099999999999999,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.86499999999999999},"last":0.48699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575042,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306644,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065196,"statfs":{"total":96636764160,"available":96322760704,"internally_reserved":0,"allocated":1388544,"data_stored":697183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.378,"15min":0.35999999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23000000000000001},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.48699999999999999,"15min":0.47199999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.309},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.375}]},{"osd":2,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.38900000000000001},"min":{"1min":0.249,"5min":0.215,"15min":0.215},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.502},"min":{"1min":0.36499999999999999,"5min":0.33400000000000002,"15min":0.29499999999999998},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.46600000000000003,"15min":0.45200000000000001},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.23899999999999999},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.436},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.44800000000000001,"15min":0.435},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.40100000000000002}]},{"osd":4,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.35499999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.83499999999999996,"5min":0.88500000000000001,"15min":0.89100000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.61899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.39900000000000002},"max":{"1min":0.85099999999999998,"5min":0.97599999999999998,"15min":1.111},"last":0.623}]},{"osd":5,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.46500000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.39600000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.91300000000000003},"last":0.64100000000000001}]},{"osd":6,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.64800000000000002,"15min":0.65900000000000003},"min":{"1min":0.46500000000000002,"5min":0.39700000000000002,"15min":0.39600000000000002},"max":{"1min":0.91000000000000003,"5min":0.92700000000000005,"15min":1.0600000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66100000000000003,"15min":0.66500000000000004},"min":{"1min":0.437,"5min":0.433,"15min":0.379},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.39900000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.94199999999999995},"last":0.54600000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575042,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302568,"kb_used_data":1376,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069272,"statfs":{"total":96636764160,"available":96326934528,"internally_reserved":0,"allocated":1409024,"data_stored":698021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.35999999999999999,"15min":0.36499999999999999},"min":{"1min":0.24299999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.498,"5min":0.54700000000000004,"15min":0.71199999999999997},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.374,"15min":0.38400000000000001},"min":{"1min":0.26900000000000002,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.55600000000000005,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.377,"15min":0.38600000000000001},"min":{"1min":0.26700000000000002,"5min":0.24399999999999999,"15min":0.23899999999999999},"max":{"1min":0.47499999999999998,"5min":0.58899999999999997,"15min":0.623},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.438,"15min":0.45700000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.57099999999999995,"5min":0.63400000000000001,"15min":0.70499999999999996},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.41099999999999998,"15min":0.42799999999999999},"min":{"1min":0.29199999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.53900000000000003,"5min":0.629,"15min":0.70999999999999996},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.42199999999999999,"15min":0.44},"min":{"1min":0.29699999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54600000000000004,"5min":0.64700000000000002,"15min":0.68799999999999994},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.58499999999999996,"15min":0.60199999999999998},"min":{"1min":0.34999999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.624,"5min":0.82599999999999996,"15min":0.96099999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.60699999999999998,"15min":0.61899999999999999},"min":{"1min":0.379,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76400000000000001,"5min":0.86899999999999999,"15min":0.98599999999999999},"last":0.503}]},{"osd":5,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.59399999999999997,"15min":0.60099999999999998},"min":{"1min":0.41199999999999998,"5min":0.39200000000000002,"15min":0.36199999999999999},"max":{"1min":0.72099999999999997,"5min":0.86799999999999999,"15min":1.0109999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.61199999999999999,"15min":0.626},"min":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.38},"max":{"1min":0.69199999999999995,"5min":0.90100000000000002,"15min":1.004},"last":0.54300000000000004}]},{"osd":6,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.625,"15min":0.64100000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.78700000000000003,"5min":0.89800000000000002,"15min":1.002},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.438,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.752,"5min":0.89300000000000002,"15min":0.96799999999999997},"last":0.53400000000000003}]},{"osd":7,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.63800000000000001,"15min":0.64900000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.68799999999999994,"5min":0.94499999999999995,"15min":1.0129999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.66900000000000004,"15min":0.68500000000000005},"min":{"1min":0.436,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.73299999999999998,"5min":0.93799999999999994,"15min":1.026},"last":0.46700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575042,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306644,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065196,"statfs":{"total":96636764160,"available":96322760704,"internally_reserved":0,"allocated":1388544,"data_stored":697183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.42699999999999999,"15min":0.40200000000000002},"min":{"1min":0.27700000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":3.4729999999999999,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.44700000000000001,"15min":0.437},"min":{"1min":0.312,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":0.38700000000000001}]},{"osd":1,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.51300000000000001,"15min":0.46300000000000002},"min":{"1min":0.28699999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":6.1210000000000004,"5min":6.1210000000000004,"15min":6.1210000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.52900000000000003,"15min":0.48899999999999999},"min":{"1min":0.34999999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":5.7270000000000003,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.441}]},{"osd":3,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38600000000000001,"15min":0.40000000000000002},"min":{"1min":0.27800000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.48799999999999999,"5min":0.63500000000000001,"15min":0.86199999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47299999999999998,"15min":0.46700000000000003},"min":{"1min":0.29699999999999999,"5min":0.26900000000000002,"15min":0.26200000000000001},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.69699999999999995,"15min":0.64200000000000002},"min":{"1min":0.432,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":8.7170000000000005,"5min":8.7170000000000005,"15min":8.7170000000000005},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.381,"5min":1.492,"15min":1.492},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.65600000000000003,"15min":0.63900000000000001},"min":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.44400000000000001,"5min":0.38900000000000001,"15min":0.38100000000000001},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.70599999999999996}]},{"osd":6,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61399999999999999,"15min":0.623},"min":{"1min":0.40899999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95999999999999996,"5min":1.359,"15min":1.359},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":0.82399999999999995}]},{"osd":7,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.70699999999999996,"15min":0.68300000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.40300000000000002},"max":{"1min":4.6849999999999996,"5min":4.6849999999999996,"15min":4.6849999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.70099999999999996,"15min":0.69099999999999995},"min":{"1min":0.45700000000000002,"5min":0.433,"15min":0.41499999999999998},"max":{"1min":4.5039999999999996,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.80200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575042,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306652,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065188,"statfs":{"total":96636764160,"available":96322752512,"internally_reserved":0,"allocated":1396736,"data_stored":698145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.34799999999999998,"15min":0.36399999999999999},"min":{"1min":0.222,"5min":0.219,"15min":0.217},"max":{"1min":0.46600000000000003,"5min":0.56599999999999995,"15min":0.66200000000000003},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.39500000000000002,"15min":0.40200000000000002},"min":{"1min":0.26700000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.48699999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.37,"15min":0.38600000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.51500000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.40999999999999998,"15min":0.42999999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.25900000000000001},"max":{"1min":0.59699999999999998,"5min":0.65900000000000003,"15min":0.84399999999999997},"last":0.34000000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.435,"15min":0.45000000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.26000000000000001},"max":{"1min":0.61799999999999999,"5min":0.72999999999999998,"15min":0.94899999999999995},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.49399999999999999,"15min":0.50900000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67100000000000004,"5min":1.054,"15min":1.054},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58699999999999997,"15min":0.60599999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.755,"5min":0.91500000000000004,"15min":0.97599999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59599999999999997,"15min":0.61299999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.70399999999999996,"5min":0.86799999999999999,"15min":0.91400000000000003},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.58099999999999996,"15min":0.60999999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80200000000000005,"5min":0.85399999999999998,"15min":0.98399999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61899999999999999,"15min":0.63800000000000001},"min":{"1min":0.372,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77300000000000002,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61799999999999999,"15min":0.64400000000000002},"min":{"1min":0.39800000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79900000000000004,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.626,"15min":0.64700000000000002},"min":{"1min":0.45000000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78900000000000003,"5min":0.89500000000000002,"15min":1.0389999999999999},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.64000000000000001,"15min":0.66200000000000003},"min":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.39100000000000001},"max":{"1min":0.80200000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63700000000000001,"15min":0.66100000000000003},"min":{"1min":0.45800000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79000000000000004,"5min":0.98999999999999999,"15min":1.004},"last":0.67500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575041,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302500,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069340,"statfs":{"total":96636764160,"available":96327004160,"internally_reserved":0,"allocated":1339392,"data_stored":670288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.53100000000000003},"min":{"1min":0.32200000000000001,"5min":0.28299999999999997,"15min":0.27500000000000002},"max":{"1min":0.72299999999999998,"5min":0.752,"15min":0.80900000000000005},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.38900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.66500000000000004,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52100000000000002,"15min":0.54200000000000004},"min":{"1min":0.35699999999999998,"5min":0.26900000000000002,"15min":0.25800000000000001},"max":{"1min":0.67600000000000005,"5min":0.73799999999999999,"15min":0.79600000000000004},"last":0.373},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.41899999999999998,"5min":0.317,"15min":0.246},"max":{"1min":0.67800000000000005,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56100000000000005,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.376,"15min":0.27800000000000002},"max":{"1min":0.73799999999999999,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.59399999999999997},"min":{"1min":0.373,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77300000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.54800000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32900000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55600000000000005,"15min":0.57099999999999995},"min":{"1min":0.438,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.80600000000000005},"last":0.46700000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.44600000000000001,"15min":0.443},"min":{"1min":0.35299999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.73599999999999999,"5min":1.272,"15min":1.272},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.46700000000000003,"15min":0.46000000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29199999999999998},"max":{"1min":0.83399999999999996,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.39100000000000001}]},{"osd":6,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51200000000000001,"15min":0.503},"min":{"1min":0.34699999999999998,"5min":0.34399999999999997,"15min":0.314},"max":{"1min":0.997,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55500000000000005,"15min":0.53900000000000003},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.33800000000000002},"max":{"1min":0.86499999999999999,"5min":1.129,"15min":1.129},"last":0.54100000000000004}]},{"osd":7,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.29899999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.82199999999999995},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57699999999999996,"15min":0.57099999999999995},"min":{"1min":0.45400000000000001,"5min":0.38600000000000001,"15min":0.34599999999999997},"max":{"1min":0.91500000000000004,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.59699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575041,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302500,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069340,"statfs":{"total":96636764160,"available":96327004160,"internally_reserved":0,"allocated":1339392,"data_stored":670288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68500000000000005,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.502},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52400000000000002,"15min":0.53100000000000003},"min":{"1min":0.36599999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.69299999999999995,"5min":0.70299999999999996,"15min":0.81799999999999995},"last":0.38100000000000001}]},{"osd":1,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.38400000000000001,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.72399999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53300000000000003,"15min":0.54800000000000004},"min":{"1min":0.36799999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.77000000000000002},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58199999999999996,"15min":0.58899999999999997},"min":{"1min":0.44800000000000001,"5min":0.34399999999999997,"15min":0.30599999999999999},"max":{"1min":0.72499999999999998,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.437,"5min":0.378,"15min":0.34499999999999997},"max":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53700000000000003,"15min":0.54800000000000004},"min":{"1min":0.40799999999999997,"5min":0.36699999999999999,"15min":0.36399999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.73799999999999999},"last":0.433},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55400000000000005,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.82099999999999995},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.41999999999999998,"15min":0.439},"min":{"1min":0.28299999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.66700000000000004,"5min":0.72299999999999998,"15min":0.74299999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.45800000000000002,"15min":0.46600000000000003},"min":{"1min":0.30599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.628,"5min":0.69499999999999995,"15min":0.77600000000000002},"last":0.48799999999999999}]},{"osd":6,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.47399999999999998,"15min":0.48599999999999999},"min":{"1min":0.32200000000000001,"5min":0.29599999999999999,"15min":0.28499999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.82099999999999995},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54100000000000004,"15min":0.55000000000000004},"min":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.69699999999999995,"5min":0.79900000000000004,"15min":0.88200000000000001},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51700000000000002,"15min":0.52600000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.64900000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55900000000000005,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.84599999999999997},"last":0.58099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:23:35.981 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:23:36.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.130+0000 7f08182e1700 1 Processor -- start 2023-11-30T17:23:36.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.130+0000 7f08182e1700 1 -- start start 2023-11-30T17:23:36.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.131+0000 7f08182e1700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f08100caab0 0x7f08100aa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:36.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.131+0000 7f08182e1700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08100a9a90 con 0x7f08100ca180 2023-11-30T17:23:36.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.131+0000 7f08182e1700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0810154ce0 con 0x7f08100cae90 2023-11-30T17:23:36.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.131+0000 7f08182e1700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08100a8e80 con 0x7f08100caab0 2023-11-30T17:23:36.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.131+0000 7f081687e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f08100ca180 0x7f081015e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48072/0 (socket says 172.21.15.49:48072) 2023-11-30T17:23:36.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.131+0000 7f081687e700 1 -- 172.21.15.49:0/255737906 learned_addr learned my addr 172.21.15.49:0/255737906 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:36.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.131+0000 7f081607d700 1 --2- 172.21.15.49:0/255737906 >> v2:172.21.15.115:3300/0 conn(0x7f08100caab0 0x7f08100aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:36.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.131+0000 7f081507b700 1 -- 172.21.15.49:0/255737906 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 62444104 0 0) 0x7f08100a9a90 con 0x7f08100ca180 2023-11-30T17:23:36.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.131+0000 7f081507b700 1 -- 172.21.15.49:0/255737906 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07f80033f0 con 0x7f08100ca180 2023-11-30T17:23:36.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.131+0000 7f081507b700 1 -- 172.21.15.49:0/255737906 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636857643 0 0) 0x7f0810154ce0 con 0x7f08100cae90 2023-11-30T17:23:36.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.132+0000 7f081507b700 1 -- 172.21.15.49:0/255737906 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08100a9a90 con 0x7f08100cae90 2023-11-30T17:23:36.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.132+0000 7f081507b700 1 -- 172.21.15.49:0/255737906 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2133617623 0 0) 0x7f07f80033f0 con 0x7f08100ca180 2023-11-30T17:23:36.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.132+0000 7f081607d700 1 -- 172.21.15.49:0/255737906 >> v1:172.21.15.115:6789/0 conn(0x7f08100cae90 legacy=0x7f08100c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:36.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.132+0000 7f081607d700 1 -- 172.21.15.49:0/255737906 >> v1:172.21.15.49:6789/0 conn(0x7f08100ca180 legacy=0x7f081015e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:36.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.132+0000 7f081607d700 1 -- 172.21.15.49:0/255737906 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08100a9160 con 0x7f08100caab0 2023-11-30T17:23:36.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.132+0000 7f081607d700 1 --2- 172.21.15.49:0/255737906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08100caab0 0x7f08100aa470 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f0808006fd0 tx=0x7f0808006f40).ready entity=mon.1 client_cookie=3df37926ff60bd1e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:36.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.132+0000 7f081507b700 1 -- 172.21.15.49:0/255737906 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08000017f0 con 0x7f08100caab0 2023-11-30T17:23:36.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.132+0000 7f081507b700 1 -- 172.21.15.49:0/255737906 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0808005880 con 0x7f08100caab0 2023-11-30T17:23:36.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.132+0000 7f081507b700 1 -- 172.21.15.49:0/255737906 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0808005c00 con 0x7f08100caab0 2023-11-30T17:23:36.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.132+0000 7f08182e1700 1 -- 172.21.15.49:0/255737906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08100caab0 msgr2=0x7f08100aa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:36.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.132+0000 7f08182e1700 1 --2- 172.21.15.49:0/255737906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08100caab0 0x7f08100aa470 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f0808006fd0 tx=0x7f0808006f40).stop 2023-11-30T17:23:36.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.132+0000 7f08182e1700 1 -- 172.21.15.49:0/255737906 shutdown_connections 2023-11-30T17:23:36.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.133+0000 7f08182e1700 1 --2- 172.21.15.49:0/255737906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08100caab0 0x7f08100aa470 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:36.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.133+0000 7f08182e1700 1 -- 172.21.15.49:0/255737906 >> 172.21.15.49:0/255737906 conn(0x7f0810094920 msgr2=0x7f081006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:36.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.133+0000 7f08182e1700 1 -- 172.21.15.49:0/255737906 shutdown_connections 2023-11-30T17:23:36.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.133+0000 7f08182e1700 1 -- 172.21.15.49:0/255737906 wait complete. 2023-11-30T17:23:36.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.134+0000 7f08182e1700 1 Processor -- start 2023-11-30T17:23:36.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.134+0000 7f08182e1700 1 -- start start 2023-11-30T17:23:36.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.134+0000 7f08182e1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08100ca180 0x7f08100c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:36.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.134+0000 7f08182e1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08100caab0 0x7f08100c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:36.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.134+0000 7f08182e1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08100cae90 0x7f0810163920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:36.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.134+0000 7f08182e1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08100c67a0 con 0x7f08100cae90 2023-11-30T17:23:36.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.134+0000 7f08182e1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08100c8170 con 0x7f08100caab0 2023-11-30T17:23:36.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.134+0000 7f08182e1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08100c8f70 con 0x7f08100ca180 2023-11-30T17:23:36.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.135+0000 7f081687e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08100cae90 0x7f0810163920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:36.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.135+0000 7f081687e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08100cae90 0x7f0810163920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35376/0 (socket says 172.21.15.49:35376) 2023-11-30T17:23:36.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.135+0000 7f081687e700 1 -- 172.21.15.49:0/3278205289 learned_addr learned my addr 172.21.15.49:0/3278205289 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:36.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.135+0000 7f081607d700 1 --2- 172.21.15.49:0/3278205289 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08100ca180 0x7f08100c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:36.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.135+0000 7f081587c700 1 --2- 172.21.15.49:0/3278205289 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08100caab0 0x7f08100c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:36.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.135+0000 7f081687e700 1 -- 172.21.15.49:0/3278205289 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08100ca180 msgr2=0x7f08100c62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:36.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.135+0000 7f081687e700 1 --2- 172.21.15.49:0/3278205289 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08100ca180 0x7f08100c62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:36.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.135+0000 7f081687e700 1 -- 172.21.15.49:0/3278205289 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08100caab0 msgr2=0x7f08100c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:36.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.135+0000 7f081687e700 1 --2- 172.21.15.49:0/3278205289 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08100caab0 0x7f08100c7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:36.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.135+0000 7f081687e700 1 -- 172.21.15.49:0/3278205289 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0808009250 con 0x7f08100cae90 2023-11-30T17:23:36.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.135+0000 7f081607d700 1 --2- 172.21.15.49:0/3278205289 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08100ca180 0x7f08100c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:23:36.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.135+0000 7f081587c700 1 --2- 172.21.15.49:0/3278205289 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08100caab0 0x7f08100c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:23:36.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.135+0000 7f081687e700 1 --2- 172.21.15.49:0/3278205289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08100cae90 0x7f0810163920 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7f080000cb90 tx=0x7f0800007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:36.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.135+0000 7f080e7fc700 1 -- 172.21.15.49:0/3278205289 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0800004c40 con 0x7f08100cae90 2023-11-30T17:23:36.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.135+0000 7f080e7fc700 1 -- 172.21.15.49:0/3278205289 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0800004da0 con 0x7f08100cae90 2023-11-30T17:23:36.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.135+0000 7f08182e1700 1 -- 172.21.15.49:0/3278205289 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08100c8360 con 0x7f08100cae90 2023-11-30T17:23:36.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.135+0000 7f080e7fc700 1 -- 172.21.15.49:0/3278205289 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0800007380 con 0x7f08100cae90 2023-11-30T17:23:36.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.135+0000 7f08182e1700 1 -- 172.21.15.49:0/3278205289 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08100c8920 con 0x7f08100cae90 2023-11-30T17:23:36.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.136+0000 7f08182e1700 1 -- 172.21.15.49:0/3278205289 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f081006c860 con 0x7f08100cae90 2023-11-30T17:23:36.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.136+0000 7f080e7fc700 1 -- 172.21.15.49:0/3278205289 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0800007770 con 0x7f08100cae90 2023-11-30T17:23:36.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.137+0000 7f080e7fc700 1 --2- 172.21.15.49:0/3278205289 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f07fc05f270 0x7f07fc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:36.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.137+0000 7f080e7fc700 1 -- 172.21.15.49:0/3278205289 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f080007a350 con 0x7f08100cae90 2023-11-30T17:23:36.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.137+0000 7f081607d700 1 --2- 172.21.15.49:0/3278205289 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f07fc05f270 0x7f07fc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:36.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.137+0000 7f081607d700 1 --2- 172.21.15.49:0/3278205289 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f07fc05f270 0x7f07fc061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f0808006fa0 tx=0x7f0808015000).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:36.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.141+0000 7f080e7fc700 1 -- 172.21.15.49:0/3278205289 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f080004b480 con 0x7f08100cae90 2023-11-30T17:23:36.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.309+0000 7f08182e1700 1 -- 172.21.15.49:0/3278205289 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f08100c9720 con 0x7f07fc05f270 2023-11-30T17:23:36.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.319+0000 7f080e7fc700 1 -- 172.21.15.49:0/3278205289 <== mgr.6107 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+357189 (secure 0 0 0) 0x7f08100c9720 con 0x7f07fc05f270 2023-11-30T17:23:36.325 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:36.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.322+0000 7f08182e1700 1 -- 172.21.15.49:0/3278205289 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f07fc05f270 msgr2=0x7f07fc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:36.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.322+0000 7f08182e1700 1 --2- 172.21.15.49:0/3278205289 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f07fc05f270 0x7f07fc061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f0808006fa0 tx=0x7f0808015000).stop 2023-11-30T17:23:36.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.322+0000 7f08182e1700 1 -- 172.21.15.49:0/3278205289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08100cae90 msgr2=0x7f0810163920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:36.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.322+0000 7f08182e1700 1 --2- 172.21.15.49:0/3278205289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08100cae90 0x7f0810163920 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7f080000cb90 tx=0x7f0800007bd0).stop 2023-11-30T17:23:36.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.322+0000 7f08182e1700 1 -- 172.21.15.49:0/3278205289 shutdown_connections 2023-11-30T17:23:36.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.322+0000 7f08182e1700 1 --2- 172.21.15.49:0/3278205289 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f07fc05f270 0x7f07fc061730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:36.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.322+0000 7f08182e1700 1 --2- 172.21.15.49:0/3278205289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08100cae90 0x7f0810163920 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:36.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.322+0000 7f08182e1700 1 --2- 172.21.15.49:0/3278205289 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08100ca180 0x7f08100c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:36.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.322+0000 7f08182e1700 1 --2- 172.21.15.49:0/3278205289 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08100caab0 0x7f08100c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:36.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.322+0000 7f08182e1700 1 -- 172.21.15.49:0/3278205289 >> 172.21.15.49:0/3278205289 conn(0x7f0810094920 msgr2=0x7f08100aece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:36.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.322+0000 7f08182e1700 1 -- 172.21.15.49:0/3278205289 shutdown_connections 2023-11-30T17:23:36.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.323+0000 7f08182e1700 1 -- 172.21.15.49:0/3278205289 wait complete. 2023-11-30T17:23:36.329 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:23:36.337 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-30T17:23:35.455404+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":748,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":170,"acting":170,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2432564,"kb_used_data":10740,"kb_used_omap":0,"kb_used_meta":2421760,"kb_avail":752542156,"statfs":{"total":773094113280,"available":770603167744,"internally_reserved":0,"allocated":10997760,"data_stored":5498635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2479882240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5548,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.011446"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977592+0000","last_change":"2023-11-30T17:23:31.973969+0000","last_active":"2023-11-30T17:23:31.977592+0000","last_peered":"2023-11-30T17:23:31.977592+0000","last_clean":"2023-11-30T17:23:31.977592+0000","last_became_active":"2023-11-30T17:23:31.973692+0000","last_became_peered":"2023-11-30T17:23:31.973692+0000","last_unstale":"2023-11-30T17:23:31.977592+0000","last_undegraded":"2023-11-30T17:23:31.977592+0000","last_fullsized":"2023-11-30T17:23:31.977592+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.973913+0000","last_change":"2023-11-30T17:23:31.969054+0000","last_active":"2023-11-30T17:23:31.973913+0000","last_peered":"2023-11-30T17:23:31.973913+0000","last_clean":"2023-11-30T17:23:31.973913+0000","last_became_active":"2023-11-30T17:23:31.968764+0000","last_became_peered":"2023-11-30T17:23:31.968764+0000","last_unstale":"2023-11-30T17:23:31.973913+0000","last_undegraded":"2023-11-30T17:23:31.973913+0000","last_fullsized":"2023-11-30T17:23:31.973913+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969654+0000","last_change":"2023-11-30T17:23:31.571935+0000","last_active":"2023-11-30T17:23:31.969654+0000","last_peered":"2023-11-30T17:23:31.969654+0000","last_clean":"2023-11-30T17:23:31.969654+0000","last_became_active":"2023-11-30T17:23:31.571639+0000","last_became_peered":"2023-11-30T17:23:31.571639+0000","last_unstale":"2023-11-30T17:23:31.969654+0000","last_undegraded":"2023-11-30T17:23:31.969654+0000","last_fullsized":"2023-11-30T17:23:31.969654+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.952182+0000","last_change":"2023-11-30T17:23:31.576188+0000","last_active":"2023-11-30T17:23:31.952182+0000","last_peered":"2023-11-30T17:23:31.952182+0000","last_clean":"2023-11-30T17:23:31.952182+0000","last_became_active":"2023-11-30T17:23:31.575896+0000","last_became_peered":"2023-11-30T17:23:31.575896+0000","last_unstale":"2023-11-30T17:23:31.952182+0000","last_undegraded":"2023-11-30T17:23:31.952182+0000","last_fullsized":"2023-11-30T17:23:31.952182+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966946+0000","last_change":"2023-11-30T17:23:31.965487+0000","last_active":"2023-11-30T17:23:31.966946+0000","last_peered":"2023-11-30T17:23:31.966946+0000","last_clean":"2023-11-30T17:23:31.966946+0000","last_became_active":"2023-11-30T17:23:31.965068+0000","last_became_peered":"2023-11-30T17:23:31.965068+0000","last_unstale":"2023-11-30T17:23:31.966946+0000","last_undegraded":"2023-11-30T17:23:31.966946+0000","last_fullsized":"2023-11-30T17:23:31.966946+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3c","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.975114+0000","last_change":"2023-11-30T17:23:31.578786+0000","last_active":"2023-11-30T17:23:31.975114+0000","last_peered":"2023-11-30T17:23:31.975114+0000","last_clean":"2023-11-30T17:23:31.975114+0000","last_became_active":"2023-11-30T17:23:31.578524+0000","last_became_peered":"2023-11-30T17:23:31.578524+0000","last_unstale":"2023-11-30T17:23:31.975114+0000","last_undegraded":"2023-11-30T17:23:31.975114+0000","last_fullsized":"2023-11-30T17:23:31.975114+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977330+0000","last_change":"2023-11-30T17:23:31.972469+0000","last_active":"2023-11-30T17:23:31.977330+0000","last_peered":"2023-11-30T17:23:31.977330+0000","last_clean":"2023-11-30T17:23:31.977330+0000","last_became_active":"2023-11-30T17:23:31.971919+0000","last_became_peered":"2023-11-30T17:23:31.971919+0000","last_unstale":"2023-11-30T17:23:31.977330+0000","last_undegraded":"2023-11-30T17:23:31.977330+0000","last_fullsized":"2023-11-30T17:23:31.977330+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.961374+0000","last_change":"2023-11-30T17:23:31.957683+0000","last_active":"2023-11-30T17:23:31.961374+0000","last_peered":"2023-11-30T17:23:31.961374+0000","last_clean":"2023-11-30T17:23:31.961374+0000","last_became_active":"2023-11-30T17:23:31.957381+0000","last_became_peered":"2023-11-30T17:23:31.957381+0000","last_unstale":"2023-11-30T17:23:31.961374+0000","last_undegraded":"2023-11-30T17:23:31.961374+0000","last_fullsized":"2023-11-30T17:23:31.961374+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976055+0000","last_change":"2023-11-30T17:23:31.973265+0000","last_active":"2023-11-30T17:23:31.976055+0000","last_peered":"2023-11-30T17:23:31.976055+0000","last_clean":"2023-11-30T17:23:31.976055+0000","last_became_active":"2023-11-30T17:23:31.972961+0000","last_became_peered":"2023-11-30T17:23:31.972961+0000","last_unstale":"2023-11-30T17:23:31.976055+0000","last_undegraded":"2023-11-30T17:23:31.976055+0000","last_fullsized":"2023-11-30T17:23:31.976055+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.953739+0000","last_change":"2023-11-30T17:23:31.575243+0000","last_active":"2023-11-30T17:23:31.953739+0000","last_peered":"2023-11-30T17:23:31.953739+0000","last_clean":"2023-11-30T17:23:31.953739+0000","last_became_active":"2023-11-30T17:23:31.574933+0000","last_became_peered":"2023-11-30T17:23:31.574933+0000","last_unstale":"2023-11-30T17:23:31.953739+0000","last_undegraded":"2023-11-30T17:23:31.953739+0000","last_fullsized":"2023-11-30T17:23:31.953739+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966866+0000","last_change":"2023-11-30T17:23:31.960188+0000","last_active":"2023-11-30T17:23:31.966866+0000","last_peered":"2023-11-30T17:23:31.966866+0000","last_clean":"2023-11-30T17:23:31.966866+0000","last_became_active":"2023-11-30T17:23:31.959891+0000","last_became_peered":"2023-11-30T17:23:31.959891+0000","last_unstale":"2023-11-30T17:23:31.966866+0000","last_undegraded":"2023-11-30T17:23:31.966866+0000","last_fullsized":"2023-11-30T17:23:31.966866+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.975777+0000","last_change":"2023-11-30T17:23:31.970303+0000","last_active":"2023-11-30T17:23:31.975777+0000","last_peered":"2023-11-30T17:23:31.975777+0000","last_clean":"2023-11-30T17:23:31.975777+0000","last_became_active":"2023-11-30T17:23:31.970018+0000","last_became_peered":"2023-11-30T17:23:31.970018+0000","last_unstale":"2023-11-30T17:23:31.975777+0000","last_undegraded":"2023-11-30T17:23:31.975777+0000","last_fullsized":"2023-11-30T17:23:31.975777+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969753+0000","last_change":"2023-11-30T17:23:31.578961+0000","last_active":"2023-11-30T17:23:31.969753+0000","last_peered":"2023-11-30T17:23:31.969753+0000","last_clean":"2023-11-30T17:23:31.969753+0000","last_became_active":"2023-11-30T17:23:31.578654+0000","last_became_peered":"2023-11-30T17:23:31.578654+0000","last_unstale":"2023-11-30T17:23:31.969753+0000","last_undegraded":"2023-11-30T17:23:31.969753+0000","last_fullsized":"2023-11-30T17:23:31.969753+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968400+0000","last_change":"2023-11-30T17:23:31.951742+0000","last_active":"2023-11-30T17:23:31.968400+0000","last_peered":"2023-11-30T17:23:31.968400+0000","last_clean":"2023-11-30T17:23:31.968400+0000","last_became_active":"2023-11-30T17:23:31.951124+0000","last_became_peered":"2023-11-30T17:23:31.951124+0000","last_unstale":"2023-11-30T17:23:31.968400+0000","last_undegraded":"2023-11-30T17:23:31.968400+0000","last_fullsized":"2023-11-30T17:23:31.968400+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.965240+0000","last_change":"2023-11-30T17:23:31.581506+0000","last_active":"2023-11-30T17:23:31.965240+0000","last_peered":"2023-11-30T17:23:31.965240+0000","last_clean":"2023-11-30T17:23:31.965240+0000","last_became_active":"2023-11-30T17:23:31.581285+0000","last_became_peered":"2023-11-30T17:23:31.581285+0000","last_unstale":"2023-11-30T17:23:31.965240+0000","last_undegraded":"2023-11-30T17:23:31.965240+0000","last_fullsized":"2023-11-30T17:23:31.965240+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.974647+0000","last_change":"2023-11-30T17:23:31.962794+0000","last_active":"2023-11-30T17:23:31.974647+0000","last_peered":"2023-11-30T17:23:31.974647+0000","last_clean":"2023-11-30T17:23:31.974647+0000","last_became_active":"2023-11-30T17:23:31.961702+0000","last_became_peered":"2023-11-30T17:23:31.961702+0000","last_unstale":"2023-11-30T17:23:31.974647+0000","last_undegraded":"2023-11-30T17:23:31.974647+0000","last_fullsized":"2023-11-30T17:23:31.974647+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.960078+0000","last_change":"2023-11-30T17:23:31.580372+0000","last_active":"2023-11-30T17:23:31.960078+0000","last_peered":"2023-11-30T17:23:31.960078+0000","last_clean":"2023-11-30T17:23:31.960078+0000","last_became_active":"2023-11-30T17:23:31.579716+0000","last_became_peered":"2023-11-30T17:23:31.579716+0000","last_unstale":"2023-11-30T17:23:31.960078+0000","last_undegraded":"2023-11-30T17:23:31.960078+0000","last_fullsized":"2023-11-30T17:23:31.960078+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.950162+0000","last_change":"2023-11-30T17:23:31.582624+0000","last_active":"2023-11-30T17:23:31.950162+0000","last_peered":"2023-11-30T17:23:31.950162+0000","last_clean":"2023-11-30T17:23:31.950162+0000","last_became_active":"2023-11-30T17:23:31.582166+0000","last_became_peered":"2023-11-30T17:23:31.582166+0000","last_unstale":"2023-11-30T17:23:31.950162+0000","last_undegraded":"2023-11-30T17:23:31.950162+0000","last_fullsized":"2023-11-30T17:23:31.950162+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.974718+0000","last_change":"2023-11-30T17:23:31.963277+0000","last_active":"2023-11-30T17:23:31.974718+0000","last_peered":"2023-11-30T17:23:31.974718+0000","last_clean":"2023-11-30T17:23:31.974718+0000","last_became_active":"2023-11-30T17:23:31.962955+0000","last_became_peered":"2023-11-30T17:23:31.962955+0000","last_unstale":"2023-11-30T17:23:31.974718+0000","last_undegraded":"2023-11-30T17:23:31.974718+0000","last_fullsized":"2023-11-30T17:23:31.974718+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976863+0000","last_change":"2023-11-30T17:23:31.968097+0000","last_active":"2023-11-30T17:23:31.976863+0000","last_peered":"2023-11-30T17:23:31.976863+0000","last_clean":"2023-11-30T17:23:31.976863+0000","last_became_active":"2023-11-30T17:23:31.967788+0000","last_became_peered":"2023-11-30T17:23:31.967788+0000","last_unstale":"2023-11-30T17:23:31.976863+0000","last_undegraded":"2023-11-30T17:23:31.976863+0000","last_fullsized":"2023-11-30T17:23:31.976863+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.959018+0000","last_change":"2023-11-30T17:23:31.569565+0000","last_active":"2023-11-30T17:23:31.959018+0000","last_peered":"2023-11-30T17:23:31.959018+0000","last_clean":"2023-11-30T17:23:31.959018+0000","last_became_active":"2023-11-30T17:23:31.569226+0000","last_became_peered":"2023-11-30T17:23:31.569226+0000","last_unstale":"2023-11-30T17:23:31.959018+0000","last_undegraded":"2023-11-30T17:23:31.959018+0000","last_fullsized":"2023-11-30T17:23:31.959018+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.974805+0000","last_change":"2023-11-30T17:23:31.973956+0000","last_active":"2023-11-30T17:23:31.974805+0000","last_peered":"2023-11-30T17:23:31.974805+0000","last_clean":"2023-11-30T17:23:31.974805+0000","last_became_active":"2023-11-30T17:23:31.973675+0000","last_became_peered":"2023-11-30T17:23:31.973675+0000","last_unstale":"2023-11-30T17:23:31.974805+0000","last_undegraded":"2023-11-30T17:23:31.974805+0000","last_fullsized":"2023-11-30T17:23:31.974805+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.970067+0000","last_change":"2023-11-30T17:23:31.576721+0000","last_active":"2023-11-30T17:23:31.970067+0000","last_peered":"2023-11-30T17:23:31.970067+0000","last_clean":"2023-11-30T17:23:31.970067+0000","last_became_active":"2023-11-30T17:23:31.575699+0000","last_became_peered":"2023-11-30T17:23:31.575699+0000","last_unstale":"2023-11-30T17:23:31.970067+0000","last_undegraded":"2023-11-30T17:23:31.970067+0000","last_fullsized":"2023-11-30T17:23:31.970067+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968737+0000","last_change":"2023-11-30T17:23:31.964844+0000","last_active":"2023-11-30T17:23:31.968737+0000","last_peered":"2023-11-30T17:23:31.968737+0000","last_clean":"2023-11-30T17:23:31.968737+0000","last_became_active":"2023-11-30T17:23:31.961956+0000","last_became_peered":"2023-11-30T17:23:31.961956+0000","last_unstale":"2023-11-30T17:23:31.968737+0000","last_undegraded":"2023-11-30T17:23:31.968737+0000","last_fullsized":"2023-11-30T17:23:31.968737+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.957082+0000","last_change":"2023-11-30T17:23:31.575492+0000","last_active":"2023-11-30T17:23:31.957082+0000","last_peered":"2023-11-30T17:23:31.957082+0000","last_clean":"2023-11-30T17:23:31.957082+0000","last_became_active":"2023-11-30T17:23:31.573839+0000","last_became_peered":"2023-11-30T17:23:31.573839+0000","last_unstale":"2023-11-30T17:23:31.957082+0000","last_undegraded":"2023-11-30T17:23:31.957082+0000","last_fullsized":"2023-11-30T17:23:31.957082+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.967040+0000","last_change":"2023-11-30T17:23:31.965248+0000","last_active":"2023-11-30T17:23:31.967040+0000","last_peered":"2023-11-30T17:23:31.967040+0000","last_clean":"2023-11-30T17:23:31.967040+0000","last_became_active":"2023-11-30T17:23:31.964971+0000","last_became_peered":"2023-11-30T17:23:31.964971+0000","last_unstale":"2023-11-30T17:23:31.967040+0000","last_undegraded":"2023-11-30T17:23:31.967040+0000","last_fullsized":"2023-11-30T17:23:31.967040+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2b","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969966+0000","last_change":"2023-11-30T17:23:31.573926+0000","last_active":"2023-11-30T17:23:31.969966+0000","last_peered":"2023-11-30T17:23:31.969966+0000","last_clean":"2023-11-30T17:23:31.969966+0000","last_became_active":"2023-11-30T17:23:31.573565+0000","last_became_peered":"2023-11-30T17:23:31.573565+0000","last_unstale":"2023-11-30T17:23:31.969966+0000","last_undegraded":"2023-11-30T17:23:31.969966+0000","last_fullsized":"2023-11-30T17:23:31.969966+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.971378+0000","last_change":"2023-11-30T17:23:31.579162+0000","last_active":"2023-11-30T17:23:31.971378+0000","last_peered":"2023-11-30T17:23:31.971378+0000","last_clean":"2023-11-30T17:23:31.971378+0000","last_became_active":"2023-11-30T17:23:31.578839+0000","last_became_peered":"2023-11-30T17:23:31.578839+0000","last_unstale":"2023-11-30T17:23:31.971378+0000","last_undegraded":"2023-11-30T17:23:31.971378+0000","last_fullsized":"2023-11-30T17:23:31.971378+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.953484+0000","last_change":"2023-11-30T17:23:31.575050+0000","last_active":"2023-11-30T17:23:31.953484+0000","last_peered":"2023-11-30T17:23:31.953484+0000","last_clean":"2023-11-30T17:23:31.953484+0000","last_became_active":"2023-11-30T17:23:31.574230+0000","last_became_peered":"2023-11-30T17:23:31.574230+0000","last_unstale":"2023-11-30T17:23:31.953484+0000","last_undegraded":"2023-11-30T17:23:31.953484+0000","last_fullsized":"2023-11-30T17:23:31.953484+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976986+0000","last_change":"2023-11-30T17:23:31.970460+0000","last_active":"2023-11-30T17:23:31.976986+0000","last_peered":"2023-11-30T17:23:31.976986+0000","last_clean":"2023-11-30T17:23:31.976986+0000","last_became_active":"2023-11-30T17:23:31.970168+0000","last_became_peered":"2023-11-30T17:23:31.970168+0000","last_unstale":"2023-11-30T17:23:31.976986+0000","last_undegraded":"2023-11-30T17:23:31.976986+0000","last_fullsized":"2023-11-30T17:23:31.976986+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969686+0000","last_change":"2023-11-30T17:23:31.576651+0000","last_active":"2023-11-30T17:23:31.969686+0000","last_peered":"2023-11-30T17:23:31.969686+0000","last_clean":"2023-11-30T17:23:31.969686+0000","last_became_active":"2023-11-30T17:23:31.576386+0000","last_became_peered":"2023-11-30T17:23:31.576386+0000","last_unstale":"2023-11-30T17:23:31.969686+0000","last_undegraded":"2023-11-30T17:23:31.969686+0000","last_fullsized":"2023-11-30T17:23:31.969686+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968312+0000","last_change":"2023-11-30T17:23:31.966907+0000","last_active":"2023-11-30T17:23:31.968312+0000","last_peered":"2023-11-30T17:23:31.968312+0000","last_clean":"2023-11-30T17:23:31.968312+0000","last_became_active":"2023-11-30T17:23:31.966449+0000","last_became_peered":"2023-11-30T17:23:31.966449+0000","last_unstale":"2023-11-30T17:23:31.968312+0000","last_undegraded":"2023-11-30T17:23:31.968312+0000","last_fullsized":"2023-11-30T17:23:31.968312+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.951943+0000","last_change":"2023-11-30T17:23:31.586699+0000","last_active":"2023-11-30T17:23:31.951943+0000","last_peered":"2023-11-30T17:23:31.951943+0000","last_clean":"2023-11-30T17:23:31.951943+0000","last_became_active":"2023-11-30T17:23:31.586428+0000","last_became_peered":"2023-11-30T17:23:31.586428+0000","last_unstale":"2023-11-30T17:23:31.951943+0000","last_undegraded":"2023-11-30T17:23:31.951943+0000","last_fullsized":"2023-11-30T17:23:31.951943+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968422+0000","last_change":"2023-11-30T17:23:31.951947+0000","last_active":"2023-11-30T17:23:31.968422+0000","last_peered":"2023-11-30T17:23:31.968422+0000","last_clean":"2023-11-30T17:23:31.968422+0000","last_became_active":"2023-11-30T17:23:31.951475+0000","last_became_peered":"2023-11-30T17:23:31.951475+0000","last_unstale":"2023-11-30T17:23:31.968422+0000","last_undegraded":"2023-11-30T17:23:31.968422+0000","last_fullsized":"2023-11-30T17:23:31.968422+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969411+0000","last_change":"2023-11-30T17:23:31.575097+0000","last_active":"2023-11-30T17:23:31.969411+0000","last_peered":"2023-11-30T17:23:31.969411+0000","last_clean":"2023-11-30T17:23:31.969411+0000","last_became_active":"2023-11-30T17:23:31.574793+0000","last_became_peered":"2023-11-30T17:23:31.574793+0000","last_unstale":"2023-11-30T17:23:31.969411+0000","last_undegraded":"2023-11-30T17:23:31.969411+0000","last_fullsized":"2023-11-30T17:23:31.969411+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.971442+0000","last_change":"2023-11-30T17:23:31.585126+0000","last_active":"2023-11-30T17:23:31.971442+0000","last_peered":"2023-11-30T17:23:31.971442+0000","last_clean":"2023-11-30T17:23:31.971442+0000","last_became_active":"2023-11-30T17:23:31.584635+0000","last_became_peered":"2023-11-30T17:23:31.584635+0000","last_unstale":"2023-11-30T17:23:31.971442+0000","last_undegraded":"2023-11-30T17:23:31.971442+0000","last_fullsized":"2023-11-30T17:23:31.971442+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.963851+0000","last_change":"2023-11-30T17:23:31.962840+0000","last_active":"2023-11-30T17:23:31.963851+0000","last_peered":"2023-11-30T17:23:31.963851+0000","last_clean":"2023-11-30T17:23:31.963851+0000","last_became_active":"2023-11-30T17:23:31.962549+0000","last_became_peered":"2023-11-30T17:23:31.962549+0000","last_unstale":"2023-11-30T17:23:31.963851+0000","last_undegraded":"2023-11-30T17:23:31.963851+0000","last_fullsized":"2023-11-30T17:23:31.963851+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.975897+0000","last_change":"2023-11-30T17:23:31.967042+0000","last_active":"2023-11-30T17:23:31.975897+0000","last_peered":"2023-11-30T17:23:31.975897+0000","last_clean":"2023-11-30T17:23:31.975897+0000","last_became_active":"2023-11-30T17:23:31.966757+0000","last_became_peered":"2023-11-30T17:23:31.966757+0000","last_unstale":"2023-11-30T17:23:31.975897+0000","last_undegraded":"2023-11-30T17:23:31.975897+0000","last_fullsized":"2023-11-30T17:23:31.975897+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.970001+0000","last_change":"2023-11-30T17:23:31.963695+0000","last_active":"2023-11-30T17:23:31.970001+0000","last_peered":"2023-11-30T17:23:31.970001+0000","last_clean":"2023-11-30T17:23:31.970001+0000","last_became_active":"2023-11-30T17:23:31.962928+0000","last_became_peered":"2023-11-30T17:23:31.962928+0000","last_unstale":"2023-11-30T17:23:31.970001+0000","last_undegraded":"2023-11-30T17:23:31.970001+0000","last_fullsized":"2023-11-30T17:23:31.970001+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.972863+0000","last_change":"2023-11-30T17:23:31.971045+0000","last_active":"2023-11-30T17:23:31.972863+0000","last_peered":"2023-11-30T17:23:31.972863+0000","last_clean":"2023-11-30T17:23:31.972863+0000","last_became_active":"2023-11-30T17:23:31.970765+0000","last_became_peered":"2023-11-30T17:23:31.970765+0000","last_unstale":"2023-11-30T17:23:31.972863+0000","last_undegraded":"2023-11-30T17:23:31.972863+0000","last_fullsized":"2023-11-30T17:23:31.972863+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.963145+0000","last_change":"2023-11-30T17:23:31.584175+0000","last_active":"2023-11-30T17:23:31.963145+0000","last_peered":"2023-11-30T17:23:31.963145+0000","last_clean":"2023-11-30T17:23:31.963145+0000","last_became_active":"2023-11-30T17:23:31.583873+0000","last_became_peered":"2023-11-30T17:23:31.583873+0000","last_unstale":"2023-11-30T17:23:31.963145+0000","last_undegraded":"2023-11-30T17:23:31.963145+0000","last_fullsized":"2023-11-30T17:23:31.963145+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.965756+0000","last_change":"2023-11-30T17:23:31.951314+0000","last_active":"2023-11-30T17:23:31.965756+0000","last_peered":"2023-11-30T17:23:31.965756+0000","last_clean":"2023-11-30T17:23:31.965756+0000","last_became_active":"2023-11-30T17:23:31.951068+0000","last_became_peered":"2023-11-30T17:23:31.951068+0000","last_unstale":"2023-11-30T17:23:31.965756+0000","last_undegraded":"2023-11-30T17:23:31.965756+0000","last_fullsized":"2023-11-30T17:23:31.965756+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977304+0000","last_change":"2023-11-30T17:23:31.972316+0000","last_active":"2023-11-30T17:23:31.977304+0000","last_peered":"2023-11-30T17:23:31.977304+0000","last_clean":"2023-11-30T17:23:31.977304+0000","last_became_active":"2023-11-30T17:23:31.971591+0000","last_became_peered":"2023-11-30T17:23:31.971591+0000","last_unstale":"2023-11-30T17:23:31.977304+0000","last_undegraded":"2023-11-30T17:23:31.977304+0000","last_fullsized":"2023-11-30T17:23:31.977304+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.971522+0000","last_change":"2023-11-30T17:23:31.584951+0000","last_active":"2023-11-30T17:23:31.971522+0000","last_peered":"2023-11-30T17:23:31.971522+0000","last_clean":"2023-11-30T17:23:31.971522+0000","last_became_active":"2023-11-30T17:23:31.584271+0000","last_became_peered":"2023-11-30T17:23:31.584271+0000","last_unstale":"2023-11-30T17:23:31.971522+0000","last_undegraded":"2023-11-30T17:23:31.971522+0000","last_fullsized":"2023-11-30T17:23:31.971522+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968644+0000","last_change":"2023-11-30T17:23:31.964012+0000","last_active":"2023-11-30T17:23:31.968644+0000","last_peered":"2023-11-30T17:23:31.968644+0000","last_clean":"2023-11-30T17:23:31.968644+0000","last_became_active":"2023-11-30T17:23:31.963750+0000","last_became_peered":"2023-11-30T17:23:31.963750+0000","last_unstale":"2023-11-30T17:23:31.968644+0000","last_undegraded":"2023-11-30T17:23:31.968644+0000","last_fullsized":"2023-11-30T17:23:31.968644+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.949896+0000","last_change":"2023-11-30T17:23:31.582453+0000","last_active":"2023-11-30T17:23:31.949896+0000","last_peered":"2023-11-30T17:23:31.949896+0000","last_clean":"2023-11-30T17:23:31.949896+0000","last_became_active":"2023-11-30T17:23:31.581818+0000","last_became_peered":"2023-11-30T17:23:31.581818+0000","last_unstale":"2023-11-30T17:23:31.949896+0000","last_undegraded":"2023-11-30T17:23:31.949896+0000","last_fullsized":"2023-11-30T17:23:31.949896+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977686+0000","last_change":"2023-11-30T17:23:31.973318+0000","last_active":"2023-11-30T17:23:31.977686+0000","last_peered":"2023-11-30T17:23:31.977686+0000","last_clean":"2023-11-30T17:23:31.977686+0000","last_became_active":"2023-11-30T17:23:31.973044+0000","last_became_peered":"2023-11-30T17:23:31.973044+0000","last_unstale":"2023-11-30T17:23:31.977686+0000","last_undegraded":"2023-11-30T17:23:31.977686+0000","last_fullsized":"2023-11-30T17:23:31.977686+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.951309+0000","last_change":"2023-11-30T17:23:31.583511+0000","last_active":"2023-11-30T17:23:31.951309+0000","last_peered":"2023-11-30T17:23:31.951309+0000","last_clean":"2023-11-30T17:23:31.951309+0000","last_became_active":"2023-11-30T17:23:31.583179+0000","last_became_peered":"2023-11-30T17:23:31.583179+0000","last_unstale":"2023-11-30T17:23:31.951309+0000","last_undegraded":"2023-11-30T17:23:31.951309+0000","last_fullsized":"2023-11-30T17:23:31.951309+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969624+0000","last_change":"2023-11-30T17:23:31.968565+0000","last_active":"2023-11-30T17:23:31.969624+0000","last_peered":"2023-11-30T17:23:31.969624+0000","last_clean":"2023-11-30T17:23:31.969624+0000","last_became_active":"2023-11-30T17:23:31.968258+0000","last_became_peered":"2023-11-30T17:23:31.968258+0000","last_unstale":"2023-11-30T17:23:31.969624+0000","last_undegraded":"2023-11-30T17:23:31.969624+0000","last_fullsized":"2023-11-30T17:23:31.969624+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.953697+0000","last_change":"2023-11-30T17:23:31.586544+0000","last_active":"2023-11-30T17:23:31.953697+0000","last_peered":"2023-11-30T17:23:31.953697+0000","last_clean":"2023-11-30T17:23:31.953697+0000","last_became_active":"2023-11-30T17:23:31.586249+0000","last_became_peered":"2023-11-30T17:23:31.586249+0000","last_unstale":"2023-11-30T17:23:31.953697+0000","last_undegraded":"2023-11-30T17:23:31.953697+0000","last_fullsized":"2023-11-30T17:23:31.953697+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.967257+0000","last_change":"2023-11-30T17:23:31.966064+0000","last_active":"2023-11-30T17:23:31.967257+0000","last_peered":"2023-11-30T17:23:31.967257+0000","last_clean":"2023-11-30T17:23:31.967257+0000","last_became_active":"2023-11-30T17:23:31.965286+0000","last_became_peered":"2023-11-30T17:23:31.965286+0000","last_unstale":"2023-11-30T17:23:31.967257+0000","last_undegraded":"2023-11-30T17:23:31.967257+0000","last_fullsized":"2023-11-30T17:23:31.967257+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976819+0000","last_change":"2023-11-30T17:23:31.967924+0000","last_active":"2023-11-30T17:23:31.976819+0000","last_peered":"2023-11-30T17:23:31.976819+0000","last_clean":"2023-11-30T17:23:31.976819+0000","last_became_active":"2023-11-30T17:23:31.967731+0000","last_became_peered":"2023-11-30T17:23:31.967731+0000","last_unstale":"2023-11-30T17:23:31.976819+0000","last_undegraded":"2023-11-30T17:23:31.976819+0000","last_fullsized":"2023-11-30T17:23:31.976819+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.973710+0000","last_change":"2023-11-30T17:23:31.574509+0000","last_active":"2023-11-30T17:23:31.973710+0000","last_peered":"2023-11-30T17:23:31.973710+0000","last_clean":"2023-11-30T17:23:31.973710+0000","last_became_active":"2023-11-30T17:23:31.574222+0000","last_became_peered":"2023-11-30T17:23:31.574222+0000","last_unstale":"2023-11-30T17:23:31.973710+0000","last_undegraded":"2023-11-30T17:23:31.973710+0000","last_fullsized":"2023-11-30T17:23:31.973710+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977348+0000","last_change":"2023-11-30T17:23:31.972653+0000","last_active":"2023-11-30T17:23:31.977348+0000","last_peered":"2023-11-30T17:23:31.977348+0000","last_clean":"2023-11-30T17:23:31.977348+0000","last_became_active":"2023-11-30T17:23:31.972117+0000","last_became_peered":"2023-11-30T17:23:31.972117+0000","last_unstale":"2023-11-30T17:23:31.977348+0000","last_undegraded":"2023-11-30T17:23:31.977348+0000","last_fullsized":"2023-11-30T17:23:31.977348+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968511+0000","last_change":"2023-11-30T17:23:31.583818+0000","last_active":"2023-11-30T17:23:31.968511+0000","last_peered":"2023-11-30T17:23:31.968511+0000","last_clean":"2023-11-30T17:23:31.968511+0000","last_became_active":"2023-11-30T17:23:31.583114+0000","last_became_peered":"2023-11-30T17:23:31.583114+0000","last_unstale":"2023-11-30T17:23:31.968511+0000","last_undegraded":"2023-11-30T17:23:31.968511+0000","last_fullsized":"2023-11-30T17:23:31.968511+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.947455+0000","last_change":"2023-11-30T17:23:31.583430+0000","last_active":"2023-11-30T17:23:31.947455+0000","last_peered":"2023-11-30T17:23:31.947455+0000","last_clean":"2023-11-30T17:23:31.947455+0000","last_became_active":"2023-11-30T17:23:31.583105+0000","last_became_peered":"2023-11-30T17:23:31.583105+0000","last_unstale":"2023-11-30T17:23:31.947455+0000","last_undegraded":"2023-11-30T17:23:31.947455+0000","last_fullsized":"2023-11-30T17:23:31.947455+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.967351+0000","last_change":"2023-11-30T17:23:31.964226+0000","last_active":"2023-11-30T17:23:31.967351+0000","last_peered":"2023-11-30T17:23:31.967351+0000","last_clean":"2023-11-30T17:23:31.967351+0000","last_became_active":"2023-11-30T17:23:31.963944+0000","last_became_peered":"2023-11-30T17:23:31.963944+0000","last_unstale":"2023-11-30T17:23:31.967351+0000","last_undegraded":"2023-11-30T17:23:31.967351+0000","last_fullsized":"2023-11-30T17:23:31.967351+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.964360+0000","last_change":"2023-11-30T17:23:31.571471+0000","last_active":"2023-11-30T17:23:31.964360+0000","last_peered":"2023-11-30T17:23:31.964360+0000","last_clean":"2023-11-30T17:23:31.964360+0000","last_became_active":"2023-11-30T17:23:31.571178+0000","last_became_peered":"2023-11-30T17:23:31.571178+0000","last_unstale":"2023-11-30T17:23:31.964360+0000","last_undegraded":"2023-11-30T17:23:31.964360+0000","last_fullsized":"2023-11-30T17:23:31.964360+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966913+0000","last_change":"2023-11-30T17:23:31.965542+0000","last_active":"2023-11-30T17:23:31.966913+0000","last_peered":"2023-11-30T17:23:31.966913+0000","last_clean":"2023-11-30T17:23:31.966913+0000","last_became_active":"2023-11-30T17:23:31.965254+0000","last_became_peered":"2023-11-30T17:23:31.965254+0000","last_unstale":"2023-11-30T17:23:31.966913+0000","last_undegraded":"2023-11-30T17:23:31.966913+0000","last_fullsized":"2023-11-30T17:23:31.966913+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"112'4","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977162+0000","last_change":"2023-11-30T17:23:31.584353+0000","last_active":"2023-11-30T17:23:31.977162+0000","last_peered":"2023-11-30T17:23:31.977162+0000","last_clean":"2023-11-30T17:23:31.977162+0000","last_became_active":"2023-11-30T17:23:31.584077+0000","last_became_peered":"2023-11-30T17:23:31.584077+0000","last_unstale":"2023-11-30T17:23:31.977162+0000","last_undegraded":"2023-11-30T17:23:31.977162+0000","last_fullsized":"2023-11-30T17:23:31.977162+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.965305+0000","last_change":"2023-11-30T17:23:31.576611+0000","last_active":"2023-11-30T17:23:31.965305+0000","last_peered":"2023-11-30T17:23:31.965305+0000","last_clean":"2023-11-30T17:23:31.965305+0000","last_became_active":"2023-11-30T17:23:31.576303+0000","last_became_peered":"2023-11-30T17:23:31.576303+0000","last_unstale":"2023-11-30T17:23:31.965305+0000","last_undegraded":"2023-11-30T17:23:31.965305+0000","last_fullsized":"2023-11-30T17:23:31.965305+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976552+0000","last_change":"2023-11-30T17:23:31.973173+0000","last_active":"2023-11-30T17:23:31.976552+0000","last_peered":"2023-11-30T17:23:31.976552+0000","last_clean":"2023-11-30T17:23:31.976552+0000","last_became_active":"2023-11-30T17:23:31.970112+0000","last_became_peered":"2023-11-30T17:23:31.970112+0000","last_unstale":"2023-11-30T17:23:31.976552+0000","last_undegraded":"2023-11-30T17:23:31.976552+0000","last_fullsized":"2023-11-30T17:23:31.976552+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968363+0000","last_change":"2023-11-30T17:23:31.962690+0000","last_active":"2023-11-30T17:23:31.968363+0000","last_peered":"2023-11-30T17:23:31.968363+0000","last_clean":"2023-11-30T17:23:31.968363+0000","last_became_active":"2023-11-30T17:23:31.962398+0000","last_became_peered":"2023-11-30T17:23:31.962398+0000","last_unstale":"2023-11-30T17:23:31.968363+0000","last_undegraded":"2023-11-30T17:23:31.968363+0000","last_fullsized":"2023-11-30T17:23:31.968363+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.975890+0000","last_change":"2023-11-30T17:23:31.969835+0000","last_active":"2023-11-30T17:23:31.975890+0000","last_peered":"2023-11-30T17:23:31.975890+0000","last_clean":"2023-11-30T17:23:31.975890+0000","last_became_active":"2023-11-30T17:23:31.969554+0000","last_became_peered":"2023-11-30T17:23:31.969554+0000","last_unstale":"2023-11-30T17:23:31.975890+0000","last_undegraded":"2023-11-30T17:23:31.975890+0000","last_fullsized":"2023-11-30T17:23:31.975890+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.947769+0000","last_change":"2023-11-30T17:23:31.588106+0000","last_active":"2023-11-30T17:23:31.947769+0000","last_peered":"2023-11-30T17:23:31.947769+0000","last_clean":"2023-11-30T17:23:31.947769+0000","last_became_active":"2023-11-30T17:23:31.587639+0000","last_became_peered":"2023-11-30T17:23:31.587639+0000","last_unstale":"2023-11-30T17:23:31.947769+0000","last_undegraded":"2023-11-30T17:23:31.947769+0000","last_fullsized":"2023-11-30T17:23:31.947769+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966848+0000","last_change":"2023-11-30T17:23:31.964658+0000","last_active":"2023-11-30T17:23:31.966848+0000","last_peered":"2023-11-30T17:23:31.966848+0000","last_clean":"2023-11-30T17:23:31.966848+0000","last_became_active":"2023-11-30T17:23:31.964344+0000","last_became_peered":"2023-11-30T17:23:31.964344+0000","last_unstale":"2023-11-30T17:23:31.966848+0000","last_undegraded":"2023-11-30T17:23:31.966848+0000","last_fullsized":"2023-11-30T17:23:31.966848+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966407+0000","last_change":"2023-11-30T17:23:31.951476+0000","last_active":"2023-11-30T17:23:31.966407+0000","last_peered":"2023-11-30T17:23:31.966407+0000","last_clean":"2023-11-30T17:23:31.966407+0000","last_became_active":"2023-11-30T17:23:31.951287+0000","last_became_peered":"2023-11-30T17:23:31.951287+0000","last_unstale":"2023-11-30T17:23:31.966407+0000","last_undegraded":"2023-11-30T17:23:31.966407+0000","last_fullsized":"2023-11-30T17:23:31.966407+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.951316+0000","last_change":"2023-11-30T17:23:31.579504+0000","last_active":"2023-11-30T17:23:31.951316+0000","last_peered":"2023-11-30T17:23:31.951316+0000","last_clean":"2023-11-30T17:23:31.951316+0000","last_became_active":"2023-11-30T17:23:31.579215+0000","last_became_peered":"2023-11-30T17:23:31.579215+0000","last_unstale":"2023-11-30T17:23:31.951316+0000","last_undegraded":"2023-11-30T17:23:31.951316+0000","last_fullsized":"2023-11-30T17:23:31.951316+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976068+0000","last_change":"2023-11-30T17:23:31.973279+0000","last_active":"2023-11-30T17:23:31.976068+0000","last_peered":"2023-11-30T17:23:31.976068+0000","last_clean":"2023-11-30T17:23:31.976068+0000","last_became_active":"2023-11-30T17:23:31.972992+0000","last_became_peered":"2023-11-30T17:23:31.972992+0000","last_unstale":"2023-11-30T17:23:31.976068+0000","last_undegraded":"2023-11-30T17:23:31.976068+0000","last_fullsized":"2023-11-30T17:23:31.976068+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":91,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969790+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:23:31.969790+0000","last_peered":"2023-11-30T17:23:31.969790+0000","last_clean":"2023-11-30T17:23:31.969790+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:23:31.969790+0000","last_undegraded":"2023-11-30T17:23:31.969790+0000","last_fullsized":"2023-11-30T17:23:31.969790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":86,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-30T17:23:28.089672+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:23:28.089672+0000","last_peered":"2023-11-30T17:23:28.089672+0000","last_clean":"2023-11-30T17:23:28.089672+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:23:28.089672+0000","last_undegraded":"2023-11-30T17:23:28.089672+0000","last_fullsized":"2023-11-30T17:23:28.089672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966869+0000","last_change":"2023-11-30T17:23:31.572852+0000","last_active":"2023-11-30T17:23:31.966869+0000","last_peered":"2023-11-30T17:23:31.966869+0000","last_clean":"2023-11-30T17:23:31.966869+0000","last_became_active":"2023-11-30T17:23:31.572533+0000","last_became_peered":"2023-11-30T17:23:31.572533+0000","last_unstale":"2023-11-30T17:23:31.966869+0000","last_undegraded":"2023-11-30T17:23:31.966869+0000","last_fullsized":"2023-11-30T17:23:31.966869+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":95,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.953812+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:23:31.953812+0000","last_peered":"2023-11-30T17:23:31.953812+0000","last_clean":"2023-11-30T17:23:31.953812+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:23:31.953812+0000","last_undegraded":"2023-11-30T17:23:31.953812+0000","last_fullsized":"2023-11-30T17:23:31.953812+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.963094+0000","last_change":"2023-11-30T17:23:31.958158+0000","last_active":"2023-11-30T17:23:31.963094+0000","last_peered":"2023-11-30T17:23:31.963094+0000","last_clean":"2023-11-30T17:23:31.963094+0000","last_became_active":"2023-11-30T17:23:31.957892+0000","last_became_peered":"2023-11-30T17:23:31.957892+0000","last_unstale":"2023-11-30T17:23:31.963094+0000","last_undegraded":"2023-11-30T17:23:31.963094+0000","last_fullsized":"2023-11-30T17:23:31.963094+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969704+0000","last_change":"2023-11-30T17:23:31.576516+0000","last_active":"2023-11-30T17:23:31.969704+0000","last_peered":"2023-11-30T17:23:31.969704+0000","last_clean":"2023-11-30T17:23:31.969704+0000","last_became_active":"2023-11-30T17:23:31.576131+0000","last_became_peered":"2023-11-30T17:23:31.576131+0000","last_unstale":"2023-11-30T17:23:31.969704+0000","last_undegraded":"2023-11-30T17:23:31.969704+0000","last_fullsized":"2023-11-30T17:23:31.969704+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":86,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-30T17:23:28.089708+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:23:28.089708+0000","last_peered":"2023-11-30T17:23:28.089708+0000","last_clean":"2023-11-30T17:23:28.089708+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:23:28.089708+0000","last_undegraded":"2023-11-30T17:23:28.089708+0000","last_fullsized":"2023-11-30T17:23:28.089708+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":92,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.951439+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:23:31.951439+0000","last_peered":"2023-11-30T17:23:31.951439+0000","last_clean":"2023-11-30T17:23:31.951439+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:23:31.951439+0000","last_undegraded":"2023-11-30T17:23:31.951439+0000","last_fullsized":"2023-11-30T17:23:31.951439+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976031+0000","last_change":"2023-11-30T17:23:31.972941+0000","last_active":"2023-11-30T17:23:31.976031+0000","last_peered":"2023-11-30T17:23:31.976031+0000","last_clean":"2023-11-30T17:23:31.976031+0000","last_became_active":"2023-11-30T17:23:31.967587+0000","last_became_peered":"2023-11-30T17:23:31.967587+0000","last_unstale":"2023-11-30T17:23:31.976031+0000","last_undegraded":"2023-11-30T17:23:31.976031+0000","last_fullsized":"2023-11-30T17:23:31.976031+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":90,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.951488+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:23:31.951488+0000","last_peered":"2023-11-30T17:23:31.951488+0000","last_clean":"2023-11-30T17:23:31.951488+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:23:31.951488+0000","last_undegraded":"2023-11-30T17:23:31.951488+0000","last_fullsized":"2023-11-30T17:23:31.951488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.959971+0000","last_change":"2023-11-30T17:23:31.580697+0000","last_active":"2023-11-30T17:23:31.959971+0000","last_peered":"2023-11-30T17:23:31.959971+0000","last_clean":"2023-11-30T17:23:31.959971+0000","last_became_active":"2023-11-30T17:23:31.580098+0000","last_became_peered":"2023-11-30T17:23:31.580098+0000","last_unstale":"2023-11-30T17:23:31.959971+0000","last_undegraded":"2023-11-30T17:23:31.959971+0000","last_fullsized":"2023-11-30T17:23:31.959971+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":90,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.952310+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:23:31.952310+0000","last_peered":"2023-11-30T17:23:31.952310+0000","last_clean":"2023-11-30T17:23:31.952310+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:23:31.952310+0000","last_undegraded":"2023-11-30T17:23:31.952310+0000","last_fullsized":"2023-11-30T17:23:31.952310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":91,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969567+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:23:31.969567+0000","last_peered":"2023-11-30T17:23:31.969567+0000","last_clean":"2023-11-30T17:23:31.969567+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:23:31.969567+0000","last_undegraded":"2023-11-30T17:23:31.969567+0000","last_fullsized":"2023-11-30T17:23:31.969567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968512+0000","last_change":"2023-11-30T17:23:31.963009+0000","last_active":"2023-11-30T17:23:31.968512+0000","last_peered":"2023-11-30T17:23:31.968512+0000","last_clean":"2023-11-30T17:23:31.968512+0000","last_became_active":"2023-11-30T17:23:31.962748+0000","last_became_peered":"2023-11-30T17:23:31.962748+0000","last_unstale":"2023-11-30T17:23:31.968512+0000","last_undegraded":"2023-11-30T17:23:31.968512+0000","last_fullsized":"2023-11-30T17:23:31.968512+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.953593+0000","last_change":"2023-11-30T17:23:31.575232+0000","last_active":"2023-11-30T17:23:31.953593+0000","last_peered":"2023-11-30T17:23:31.953593+0000","last_clean":"2023-11-30T17:23:31.953593+0000","last_became_active":"2023-11-30T17:23:31.574785+0000","last_became_peered":"2023-11-30T17:23:31.574785+0000","last_unstale":"2023-11-30T17:23:31.953593+0000","last_undegraded":"2023-11-30T17:23:31.953593+0000","last_fullsized":"2023-11-30T17:23:31.953593+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-30T17:23:27.439439+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:23:27.439439+0000","last_peered":"2023-11-30T17:23:27.439439+0000","last_clean":"2023-11-30T17:23:27.439439+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:23:27.439439+0000","last_undegraded":"2023-11-30T17:23:27.439439+0000","last_fullsized":"2023-11-30T17:23:27.439439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":82,"acting":82,"num_store_stats":5},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":748,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":70,"acting":70,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575043,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302556,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069284,"statfs":{"total":96636764160,"available":96326946816,"internally_reserved":0,"allocated":1396736,"data_stored":697239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.371,"5min":0.315,"15min":0.23899999999999999},"max":{"1min":0.72399999999999998,"5min":0.80400000000000005,"15min":0.81100000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57499999999999996,"15min":0.58199999999999996},"min":{"1min":0.41099999999999998,"5min":0.40699999999999997,"15min":0.32200000000000001},"max":{"1min":0.74099999999999999,"5min":0.78300000000000003,"15min":0.81899999999999995},"last":0.503}]},{"osd":1,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70899999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.442},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.32900000000000001,"5min":0.29899999999999999,"15min":0.28799999999999998},"max":{"1min":0.64000000000000001,"5min":0.76100000000000001,"15min":0.82499999999999996},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53800000000000003,"15min":0.54900000000000004},"min":{"1min":0.37,"5min":0.33500000000000002,"15min":0.32800000000000001},"max":{"1min":0.68200000000000005,"5min":0.77000000000000002,"15min":0.78300000000000003},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.38800000000000001,"5min":0.35399999999999998,"15min":0.28699999999999998},"max":{"1min":0.70499999999999996,"5min":0.73799999999999999,"15min":0.83899999999999997},"last":0.53700000000000003}]},{"osd":3,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.53400000000000003,"15min":0.54100000000000004},"min":{"1min":0.378,"5min":0.36499999999999999,"15min":0.33200000000000002},"max":{"1min":0.65700000000000003,"5min":0.754,"15min":0.78000000000000003},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56999999999999995,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.40799999999999997,"15min":0.33900000000000002},"max":{"1min":0.67500000000000004,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.54800000000000004}]},{"osd":4,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44600000000000001,"15min":0.45800000000000002},"min":{"1min":0.32400000000000001,"5min":0.313,"15min":0.29699999999999999},"max":{"1min":0.55000000000000004,"5min":0.77000000000000002,"15min":0.79900000000000004},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.30099999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59899999999999998,"5min":0.75800000000000001,"15min":1.3180000000000001},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.48399999999999999,"15min":0.49099999999999999},"min":{"1min":0.317,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58699999999999997,"5min":0.80000000000000004,"15min":0.82899999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.61199999999999999,"5min":0.79300000000000004,"15min":0.872},"last":0.45800000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.69699999999999995,"5min":0.81200000000000006,"15min":0.85199999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.33700000000000002},"max":{"1min":0.67300000000000004,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.47499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575041,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302500,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069340,"statfs":{"total":96636764160,"available":96327004160,"internally_reserved":0,"allocated":1339392,"data_stored":670288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.57099999999999995},"min":{"1min":0.38100000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72899999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.498},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56499999999999995,"15min":0.58699999999999997},"min":{"1min":0.46300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.748,"5min":0.79600000000000004,"15min":0.89300000000000002},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54600000000000004,"15min":0.56399999999999995},"min":{"1min":0.32800000000000001,"5min":0.30599999999999999,"15min":0.26400000000000001},"max":{"1min":0.75800000000000001,"5min":0.76900000000000002,"15min":0.82799999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58199999999999996,"15min":0.59899999999999998},"min":{"1min":0.45100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.751,"5min":0.82499999999999996,"15min":0.85199999999999998},"last":0.54600000000000004}]},{"osd":2,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56000000000000005,"15min":0.57299999999999995},"min":{"1min":0.371,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.77500000000000002,"5min":0.79900000000000004,"15min":0.82599999999999996},"last":0.376},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.40699999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76100000000000001,"5min":0.80900000000000005,"15min":0.82499999999999996},"last":0.53400000000000003}]},{"osd":3,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51100000000000001,"15min":0.53200000000000003},"min":{"1min":0.40400000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71899999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73499999999999999,"5min":0.75600000000000001,"15min":0.79600000000000004},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44600000000000001,"15min":0.45300000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.84199999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46100000000000002,"15min":0.47799999999999998},"min":{"1min":0.34999999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.746,"5min":0.76000000000000001,"15min":0.83899999999999997},"last":0.46700000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.45900000000000002,"15min":0.47199999999999998},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.28299999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.496,"15min":0.50700000000000001},"min":{"1min":0.38400000000000001,"5min":0.33500000000000002,"15min":0.31900000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.42099999999999999}]},{"osd":7,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.34499999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.74199999999999999,"5min":0.80700000000000005,"15min":0.93200000000000005},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55100000000000005,"15min":0.56299999999999994},"min":{"1min":0.43099999999999999,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.86499999999999999},"last":0.48699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575042,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306644,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065196,"statfs":{"total":96636764160,"available":96322760704,"internally_reserved":0,"allocated":1388544,"data_stored":697183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.378,"15min":0.35999999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23000000000000001},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.48699999999999999,"15min":0.47199999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.309},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.375}]},{"osd":2,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.38900000000000001},"min":{"1min":0.249,"5min":0.215,"15min":0.215},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.502},"min":{"1min":0.36499999999999999,"5min":0.33400000000000002,"15min":0.29499999999999998},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.46600000000000003,"15min":0.45200000000000001},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.23899999999999999},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.436},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.44800000000000001,"15min":0.435},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.40100000000000002}]},{"osd":4,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.35499999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.83499999999999996,"5min":0.88500000000000001,"15min":0.89100000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.61899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.39900000000000002},"max":{"1min":0.85099999999999998,"5min":0.97599999999999998,"15min":1.111},"last":0.623}]},{"osd":5,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.46500000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.39600000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.91300000000000003},"last":0.64100000000000001}]},{"osd":6,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.64800000000000002,"15min":0.65900000000000003},"min":{"1min":0.46500000000000002,"5min":0.39700000000000002,"15min":0.39600000000000002},"max":{"1min":0.91000000000000003,"5min":0.92700000000000005,"15min":1.0600000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66100000000000003,"15min":0.66500000000000004},"min":{"1min":0.437,"5min":0.433,"15min":0.379},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.39900000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.94199999999999995},"last":0.54600000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575042,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302568,"kb_used_data":1376,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069272,"statfs":{"total":96636764160,"available":96326934528,"internally_reserved":0,"allocated":1409024,"data_stored":698021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.35999999999999999,"15min":0.36499999999999999},"min":{"1min":0.24299999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.498,"5min":0.54700000000000004,"15min":0.71199999999999997},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.374,"15min":0.38400000000000001},"min":{"1min":0.26900000000000002,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.55600000000000005,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.377,"15min":0.38600000000000001},"min":{"1min":0.26700000000000002,"5min":0.24399999999999999,"15min":0.23899999999999999},"max":{"1min":0.47499999999999998,"5min":0.58899999999999997,"15min":0.623},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.438,"15min":0.45700000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.57099999999999995,"5min":0.63400000000000001,"15min":0.70499999999999996},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.41099999999999998,"15min":0.42799999999999999},"min":{"1min":0.29199999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.53900000000000003,"5min":0.629,"15min":0.70999999999999996},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.42199999999999999,"15min":0.44},"min":{"1min":0.29699999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54600000000000004,"5min":0.64700000000000002,"15min":0.68799999999999994},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.58499999999999996,"15min":0.60199999999999998},"min":{"1min":0.34999999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.624,"5min":0.82599999999999996,"15min":0.96099999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.60699999999999998,"15min":0.61899999999999999},"min":{"1min":0.379,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76400000000000001,"5min":0.86899999999999999,"15min":0.98599999999999999},"last":0.503}]},{"osd":5,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.59399999999999997,"15min":0.60099999999999998},"min":{"1min":0.41199999999999998,"5min":0.39200000000000002,"15min":0.36199999999999999},"max":{"1min":0.72099999999999997,"5min":0.86799999999999999,"15min":1.0109999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.61199999999999999,"15min":0.626},"min":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.38},"max":{"1min":0.69199999999999995,"5min":0.90100000000000002,"15min":1.004},"last":0.54300000000000004}]},{"osd":6,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.625,"15min":0.64100000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.78700000000000003,"5min":0.89800000000000002,"15min":1.002},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.438,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.752,"5min":0.89300000000000002,"15min":0.96799999999999997},"last":0.53400000000000003}]},{"osd":7,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.63800000000000001,"15min":0.64900000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.68799999999999994,"5min":0.94499999999999995,"15min":1.0129999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.66900000000000004,"15min":0.68500000000000005},"min":{"1min":0.436,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.73299999999999998,"5min":0.93799999999999994,"15min":1.026},"last":0.46700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575042,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306644,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065196,"statfs":{"total":96636764160,"available":96322760704,"internally_reserved":0,"allocated":1388544,"data_stored":697183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.42699999999999999,"15min":0.40200000000000002},"min":{"1min":0.27700000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":3.4729999999999999,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.44700000000000001,"15min":0.437},"min":{"1min":0.312,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":0.38700000000000001}]},{"osd":1,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.51300000000000001,"15min":0.46300000000000002},"min":{"1min":0.28699999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":6.1210000000000004,"5min":6.1210000000000004,"15min":6.1210000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.52900000000000003,"15min":0.48899999999999999},"min":{"1min":0.34999999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":5.7270000000000003,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.441}]},{"osd":3,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38600000000000001,"15min":0.40000000000000002},"min":{"1min":0.27800000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.48799999999999999,"5min":0.63500000000000001,"15min":0.86199999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47299999999999998,"15min":0.46700000000000003},"min":{"1min":0.29699999999999999,"5min":0.26900000000000002,"15min":0.26200000000000001},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.69699999999999995,"15min":0.64200000000000002},"min":{"1min":0.432,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":8.7170000000000005,"5min":8.7170000000000005,"15min":8.7170000000000005},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.381,"5min":1.492,"15min":1.492},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.65600000000000003,"15min":0.63900000000000001},"min":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.44400000000000001,"5min":0.38900000000000001,"15min":0.38100000000000001},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.70599999999999996}]},{"osd":6,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61399999999999999,"15min":0.623},"min":{"1min":0.40899999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95999999999999996,"5min":1.359,"15min":1.359},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":0.82399999999999995}]},{"osd":7,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.70699999999999996,"15min":0.68300000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.40300000000000002},"max":{"1min":4.6849999999999996,"5min":4.6849999999999996,"15min":4.6849999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.70099999999999996,"15min":0.69099999999999995},"min":{"1min":0.45700000000000002,"5min":0.433,"15min":0.41499999999999998},"max":{"1min":4.5039999999999996,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.80200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575042,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306652,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065188,"statfs":{"total":96636764160,"available":96322752512,"internally_reserved":0,"allocated":1396736,"data_stored":698145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.34799999999999998,"15min":0.36399999999999999},"min":{"1min":0.222,"5min":0.219,"15min":0.217},"max":{"1min":0.46600000000000003,"5min":0.56599999999999995,"15min":0.66200000000000003},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.39500000000000002,"15min":0.40200000000000002},"min":{"1min":0.26700000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.48699999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.37,"15min":0.38600000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.51500000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.40999999999999998,"15min":0.42999999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.25900000000000001},"max":{"1min":0.59699999999999998,"5min":0.65900000000000003,"15min":0.84399999999999997},"last":0.34000000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.435,"15min":0.45000000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.26000000000000001},"max":{"1min":0.61799999999999999,"5min":0.72999999999999998,"15min":0.94899999999999995},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.49399999999999999,"15min":0.50900000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67100000000000004,"5min":1.054,"15min":1.054},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58699999999999997,"15min":0.60599999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.755,"5min":0.91500000000000004,"15min":0.97599999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59599999999999997,"15min":0.61299999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.70399999999999996,"5min":0.86799999999999999,"15min":0.91400000000000003},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.58099999999999996,"15min":0.60999999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80200000000000005,"5min":0.85399999999999998,"15min":0.98399999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61899999999999999,"15min":0.63800000000000001},"min":{"1min":0.372,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77300000000000002,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61799999999999999,"15min":0.64400000000000002},"min":{"1min":0.39800000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79900000000000004,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.626,"15min":0.64700000000000002},"min":{"1min":0.45000000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78900000000000003,"5min":0.89500000000000002,"15min":1.0389999999999999},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.64000000000000001,"15min":0.66200000000000003},"min":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.39100000000000001},"max":{"1min":0.80200000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63700000000000001,"15min":0.66100000000000003},"min":{"1min":0.45800000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79000000000000004,"5min":0.98999999999999999,"15min":1.004},"last":0.67500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575041,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302500,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069340,"statfs":{"total":96636764160,"available":96327004160,"internally_reserved":0,"allocated":1339392,"data_stored":670288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.53100000000000003},"min":{"1min":0.32200000000000001,"5min":0.28299999999999997,"15min":0.27500000000000002},"max":{"1min":0.72299999999999998,"5min":0.752,"15min":0.80900000000000005},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.38900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.66500000000000004,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52100000000000002,"15min":0.54200000000000004},"min":{"1min":0.35699999999999998,"5min":0.26900000000000002,"15min":0.25800000000000001},"max":{"1min":0.67600000000000005,"5min":0.73799999999999999,"15min":0.79600000000000004},"last":0.373},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.41899999999999998,"5min":0.317,"15min":0.246},"max":{"1min":0.67800000000000005,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56100000000000005,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.376,"15min":0.27800000000000002},"max":{"1min":0.73799999999999999,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.59399999999999997},"min":{"1min":0.373,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77300000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.54800000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32900000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55600000000000005,"15min":0.57099999999999995},"min":{"1min":0.438,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.80600000000000005},"last":0.46700000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.44600000000000001,"15min":0.443},"min":{"1min":0.35299999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.73599999999999999,"5min":1.272,"15min":1.272},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.46700000000000003,"15min":0.46000000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29199999999999998},"max":{"1min":0.83399999999999996,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.39100000000000001}]},{"osd":6,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51200000000000001,"15min":0.503},"min":{"1min":0.34699999999999998,"5min":0.34399999999999997,"15min":0.314},"max":{"1min":0.997,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55500000000000005,"15min":0.53900000000000003},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.33800000000000002},"max":{"1min":0.86499999999999999,"5min":1.129,"15min":1.129},"last":0.54100000000000004}]},{"osd":7,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.29899999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.82199999999999995},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57699999999999996,"15min":0.57099999999999995},"min":{"1min":0.45400000000000001,"5min":0.38600000000000001,"15min":0.34599999999999997},"max":{"1min":0.91500000000000004,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.59699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575041,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302500,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069340,"statfs":{"total":96636764160,"available":96327004160,"internally_reserved":0,"allocated":1339392,"data_stored":670288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68500000000000005,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.502},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52400000000000002,"15min":0.53100000000000003},"min":{"1min":0.36599999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.69299999999999995,"5min":0.70299999999999996,"15min":0.81799999999999995},"last":0.38100000000000001}]},{"osd":1,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.38400000000000001,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.72399999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53300000000000003,"15min":0.54800000000000004},"min":{"1min":0.36799999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.77000000000000002},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58199999999999996,"15min":0.58899999999999997},"min":{"1min":0.44800000000000001,"5min":0.34399999999999997,"15min":0.30599999999999999},"max":{"1min":0.72499999999999998,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.437,"5min":0.378,"15min":0.34499999999999997},"max":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53700000000000003,"15min":0.54800000000000004},"min":{"1min":0.40799999999999997,"5min":0.36699999999999999,"15min":0.36399999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.73799999999999999},"last":0.433},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55400000000000005,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.82099999999999995},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.41999999999999998,"15min":0.439},"min":{"1min":0.28299999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.66700000000000004,"5min":0.72299999999999998,"15min":0.74299999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.45800000000000002,"15min":0.46600000000000003},"min":{"1min":0.30599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.628,"5min":0.69499999999999995,"15min":0.77600000000000002},"last":0.48799999999999999}]},{"osd":6,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.47399999999999998,"15min":0.48599999999999999},"min":{"1min":0.32200000000000001,"5min":0.29599999999999999,"15min":0.28499999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.82099999999999995},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54100000000000004,"15min":0.55000000000000004},"min":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.69699999999999995,"5min":0.79900000000000004,"15min":0.88200000000000001},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51700000000000002,"15min":0.52600000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.64900000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55900000000000005,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.84599999999999997},"last":0.58099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:23:36.344 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:23:36.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.492+0000 7f69d732b700 1 Processor -- start 2023-11-30T17:23:36.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.492+0000 7f69d732b700 1 -- start start 2023-11-30T17:23:36.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.493+0000 7f69d732b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f69d01548c0 0x7f69d006a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:36.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.493+0000 7f69d732b700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69d00c69a0 con 0x7f69d00c6e30 2023-11-30T17:23:36.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.493+0000 7f69d732b700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69d00c13a0 con 0x7f69d01544e0 2023-11-30T17:23:36.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.493+0000 7f69d732b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69d00c1680 con 0x7f69d01548c0 2023-11-30T17:23:36.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.493+0000 7f69d58c8700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f69d00c6e30 0x7f69d00a8000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48080/0 (socket says 172.21.15.49:48080) 2023-11-30T17:23:36.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.493+0000 7f69d58c8700 1 -- 172.21.15.49:0/1662910109 learned_addr learned my addr 172.21.15.49:0/1662910109 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:36.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.493+0000 7f69d48c6700 1 --2- 172.21.15.49:0/1662910109 >> v2:172.21.15.115:3300/0 conn(0x7f69d01548c0 0x7f69d006a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:36.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.494+0000 7f69cffff700 1 -- 172.21.15.49:0/1662910109 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1663154629 0 0) 0x7f69d00c69a0 con 0x7f69d00c6e30 2023-11-30T17:23:36.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.494+0000 7f69cffff700 1 -- 172.21.15.49:0/1662910109 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69b80033f0 con 0x7f69d00c6e30 2023-11-30T17:23:36.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.494+0000 7f69cffff700 1 -- 172.21.15.49:0/1662910109 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2405628654 0 0) 0x7f69d00c13a0 con 0x7f69d01544e0 2023-11-30T17:23:36.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.494+0000 7f69cffff700 1 -- 172.21.15.49:0/1662910109 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69d00c69a0 con 0x7f69d01544e0 2023-11-30T17:23:36.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.494+0000 7f69cffff700 1 -- 172.21.15.49:0/1662910109 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2952281702 0 0) 0x7f69b80033f0 con 0x7f69d00c6e30 2023-11-30T17:23:36.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.494+0000 7f69d48c6700 1 -- 172.21.15.49:0/1662910109 >> v1:172.21.15.115:6789/0 conn(0x7f69d01544e0 legacy=0x7f69d00c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:36.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.494+0000 7f69d48c6700 1 -- 172.21.15.49:0/1662910109 >> v1:172.21.15.49:6789/0 conn(0x7f69d00c6e30 legacy=0x7f69d00a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:36.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.494+0000 7f69d48c6700 1 -- 172.21.15.49:0/1662910109 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d00c6630 con 0x7f69d01548c0 2023-11-30T17:23:36.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.494+0000 7f69d48c6700 1 --2- 172.21.15.49:0/1662910109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69d01548c0 0x7f69d006a610 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f69c4009760 tx=0x7f69c4009060).ready entity=mon.1 client_cookie=adcd738b5f86884b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:36.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.494+0000 7f69cffff700 1 -- 172.21.15.49:0/1662910109 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c00017f0 con 0x7f69d01548c0 2023-11-30T17:23:36.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.494+0000 7f69cffff700 1 -- 172.21.15.49:0/1662910109 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c4011400 con 0x7f69d01548c0 2023-11-30T17:23:36.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.494+0000 7f69cffff700 1 -- 172.21.15.49:0/1662910109 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c4011780 con 0x7f69d01548c0 2023-11-30T17:23:36.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.495+0000 7f69d732b700 1 -- 172.21.15.49:0/1662910109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69d01548c0 msgr2=0x7f69d006a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:36.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.495+0000 7f69d732b700 1 --2- 172.21.15.49:0/1662910109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69d01548c0 0x7f69d006a610 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f69c4009760 tx=0x7f69c4009060).stop 2023-11-30T17:23:36.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.495+0000 7f69d732b700 1 -- 172.21.15.49:0/1662910109 shutdown_connections 2023-11-30T17:23:36.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.495+0000 7f69d732b700 1 --2- 172.21.15.49:0/1662910109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69d01548c0 0x7f69d006a610 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:36.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.495+0000 7f69d732b700 1 -- 172.21.15.49:0/1662910109 >> 172.21.15.49:0/1662910109 conn(0x7f69d0085020 msgr2=0x7f69d0094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:36.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.495+0000 7f69d732b700 1 -- 172.21.15.49:0/1662910109 shutdown_connections 2023-11-30T17:23:36.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.495+0000 7f69d732b700 1 -- 172.21.15.49:0/1662910109 wait complete. 2023-11-30T17:23:36.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.496+0000 7f69d732b700 1 Processor -- start 2023-11-30T17:23:36.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.496+0000 7f69d732b700 1 -- start start 2023-11-30T17:23:36.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.497+0000 7f69d732b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69d00c6e30 0x7f69d0142000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:36.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.497+0000 7f69d732b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69d01544e0 0x7f69d00959b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:36.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.497+0000 7f69d732b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69d01548c0 0x7f69d0064770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:36.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.497+0000 7f69d732b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d0168000 con 0x7f69d00c6e30 2023-11-30T17:23:36.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.497+0000 7f69d732b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d01682c0 con 0x7f69d01544e0 2023-11-30T17:23:36.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.497+0000 7f69d732b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d01685a0 con 0x7f69d01548c0 2023-11-30T17:23:36.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.497+0000 7f69d50c7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69d00c6e30 0x7f69d0142000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:36.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.497+0000 7f69d50c7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69d00c6e30 0x7f69d0142000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35380/0 (socket says 172.21.15.49:35380) 2023-11-30T17:23:36.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.497+0000 7f69d50c7700 1 -- 172.21.15.49:0/244487394 learned_addr learned my addr 172.21.15.49:0/244487394 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:36.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.497+0000 7f69d48c6700 1 --2- 172.21.15.49:0/244487394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69d01544e0 0x7f69d00959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:36.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.497+0000 7f69d58c8700 1 --2- 172.21.15.49:0/244487394 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69d01548c0 0x7f69d0064770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:36.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.497+0000 7f69d50c7700 1 -- 172.21.15.49:0/244487394 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69d01548c0 msgr2=0x7f69d0064770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:36.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.497+0000 7f69d50c7700 1 --2- 172.21.15.49:0/244487394 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69d01548c0 0x7f69d0064770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:36.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.497+0000 7f69d50c7700 1 -- 172.21.15.49:0/244487394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69d01544e0 msgr2=0x7f69d00959b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:36.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.497+0000 7f69d50c7700 1 --2- 172.21.15.49:0/244487394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69d01544e0 0x7f69d00959b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:36.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.497+0000 7f69d50c7700 1 -- 172.21.15.49:0/244487394 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c40092a0 con 0x7f69d00c6e30 2023-11-30T17:23:36.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.497+0000 7f69d58c8700 1 --2- 172.21.15.49:0/244487394 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69d01548c0 0x7f69d0064770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:23:36.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.497+0000 7f69d50c7700 1 --2- 172.21.15.49:0/244487394 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69d00c6e30 0x7f69d0142000 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f69c800c4c0 tx=0x7f69c8007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:36.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.498+0000 7f69cd7fa700 1 -- 172.21.15.49:0/244487394 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c800f470 con 0x7f69d00c6e30 2023-11-30T17:23:36.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.498+0000 7f69cd7fa700 1 -- 172.21.15.49:0/244487394 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c800f5d0 con 0x7f69d00c6e30 2023-11-30T17:23:36.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.498+0000 7f69d732b700 1 -- 172.21.15.49:0/244487394 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d0168880 con 0x7f69d00c6e30 2023-11-30T17:23:36.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.498+0000 7f69cd7fa700 1 -- 172.21.15.49:0/244487394 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c800f970 con 0x7f69d00c6e30 2023-11-30T17:23:36.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.498+0000 7f69d732b700 1 -- 172.21.15.49:0/244487394 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d01424f0 con 0x7f69d00c6e30 2023-11-30T17:23:36.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.499+0000 7f69d732b700 1 -- 172.21.15.49:0/244487394 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d006c860 con 0x7f69d00c6e30 2023-11-30T17:23:36.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.499+0000 7f69cd7fa700 1 -- 172.21.15.49:0/244487394 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f69c800fd20 con 0x7f69d00c6e30 2023-11-30T17:23:36.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.499+0000 7f69cd7fa700 1 --2- 172.21.15.49:0/244487394 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f69bc05f270 0x7f69bc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:36.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.499+0000 7f69cd7fa700 1 -- 172.21.15.49:0/244487394 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f69c8079990 con 0x7f69d00c6e30 2023-11-30T17:23:36.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.500+0000 7f69d48c6700 1 --2- 172.21.15.49:0/244487394 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f69bc05f270 0x7f69bc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:36.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.500+0000 7f69d48c6700 1 --2- 172.21.15.49:0/244487394 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f69bc05f270 0x7f69bc061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f69d01625b0 tx=0x7f69c4016000).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:36.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.504+0000 7f69cd7fa700 1 -- 172.21.15.49:0/244487394 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f69c804aa60 con 0x7f69d00c6e30 2023-11-30T17:23:36.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.672+0000 7f69d732b700 1 -- 172.21.15.49:0/244487394 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f69d00c5890 con 0x7f69bc05f270 2023-11-30T17:23:36.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.682+0000 7f69cd7fa700 1 -- 172.21.15.49:0/244487394 <== mgr.6107 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+357189 (secure 0 0 0) 0x7f69d00c5890 con 0x7f69bc05f270 2023-11-30T17:23:36.689 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:36.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.686+0000 7f69d732b700 1 -- 172.21.15.49:0/244487394 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f69bc05f270 msgr2=0x7f69bc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:36.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.686+0000 7f69d732b700 1 --2- 172.21.15.49:0/244487394 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f69bc05f270 0x7f69bc061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f69d01625b0 tx=0x7f69c4016000).stop 2023-11-30T17:23:36.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.686+0000 7f69d732b700 1 -- 172.21.15.49:0/244487394 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69d00c6e30 msgr2=0x7f69d0142000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:36.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.686+0000 7f69d732b700 1 --2- 172.21.15.49:0/244487394 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69d00c6e30 0x7f69d0142000 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f69c800c4c0 tx=0x7f69c8007c80).stop 2023-11-30T17:23:36.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.686+0000 7f69d732b700 1 -- 172.21.15.49:0/244487394 shutdown_connections 2023-11-30T17:23:36.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.686+0000 7f69d732b700 1 --2- 172.21.15.49:0/244487394 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69d01548c0 0x7f69d0064770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:36.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.686+0000 7f69d732b700 1 --2- 172.21.15.49:0/244487394 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f69bc05f270 0x7f69bc061730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:36.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.686+0000 7f69d732b700 1 --2- 172.21.15.49:0/244487394 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69d00c6e30 0x7f69d0142000 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:36.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.686+0000 7f69d732b700 1 --2- 172.21.15.49:0/244487394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69d01544e0 0x7f69d00959b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:36.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.686+0000 7f69d732b700 1 -- 172.21.15.49:0/244487394 >> 172.21.15.49:0/244487394 conn(0x7f69d0085020 msgr2=0x7f69d00c4340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:36.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.686+0000 7f69d732b700 1 -- 172.21.15.49:0/244487394 shutdown_connections 2023-11-30T17:23:36.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.686+0000 7f69d732b700 1 -- 172.21.15.49:0/244487394 wait complete. 2023-11-30T17:23:36.693 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:23:36.700 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-30T17:23:35.455404+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":748,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":170,"acting":170,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2432564,"kb_used_data":10740,"kb_used_omap":0,"kb_used_meta":2421760,"kb_avail":752542156,"statfs":{"total":773094113280,"available":770603167744,"internally_reserved":0,"allocated":10997760,"data_stored":5498635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2479882240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5548,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.011446"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977592+0000","last_change":"2023-11-30T17:23:31.973969+0000","last_active":"2023-11-30T17:23:31.977592+0000","last_peered":"2023-11-30T17:23:31.977592+0000","last_clean":"2023-11-30T17:23:31.977592+0000","last_became_active":"2023-11-30T17:23:31.973692+0000","last_became_peered":"2023-11-30T17:23:31.973692+0000","last_unstale":"2023-11-30T17:23:31.977592+0000","last_undegraded":"2023-11-30T17:23:31.977592+0000","last_fullsized":"2023-11-30T17:23:31.977592+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.973913+0000","last_change":"2023-11-30T17:23:31.969054+0000","last_active":"2023-11-30T17:23:31.973913+0000","last_peered":"2023-11-30T17:23:31.973913+0000","last_clean":"2023-11-30T17:23:31.973913+0000","last_became_active":"2023-11-30T17:23:31.968764+0000","last_became_peered":"2023-11-30T17:23:31.968764+0000","last_unstale":"2023-11-30T17:23:31.973913+0000","last_undegraded":"2023-11-30T17:23:31.973913+0000","last_fullsized":"2023-11-30T17:23:31.973913+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969654+0000","last_change":"2023-11-30T17:23:31.571935+0000","last_active":"2023-11-30T17:23:31.969654+0000","last_peered":"2023-11-30T17:23:31.969654+0000","last_clean":"2023-11-30T17:23:31.969654+0000","last_became_active":"2023-11-30T17:23:31.571639+0000","last_became_peered":"2023-11-30T17:23:31.571639+0000","last_unstale":"2023-11-30T17:23:31.969654+0000","last_undegraded":"2023-11-30T17:23:31.969654+0000","last_fullsized":"2023-11-30T17:23:31.969654+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.952182+0000","last_change":"2023-11-30T17:23:31.576188+0000","last_active":"2023-11-30T17:23:31.952182+0000","last_peered":"2023-11-30T17:23:31.952182+0000","last_clean":"2023-11-30T17:23:31.952182+0000","last_became_active":"2023-11-30T17:23:31.575896+0000","last_became_peered":"2023-11-30T17:23:31.575896+0000","last_unstale":"2023-11-30T17:23:31.952182+0000","last_undegraded":"2023-11-30T17:23:31.952182+0000","last_fullsized":"2023-11-30T17:23:31.952182+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966946+0000","last_change":"2023-11-30T17:23:31.965487+0000","last_active":"2023-11-30T17:23:31.966946+0000","last_peered":"2023-11-30T17:23:31.966946+0000","last_clean":"2023-11-30T17:23:31.966946+0000","last_became_active":"2023-11-30T17:23:31.965068+0000","last_became_peered":"2023-11-30T17:23:31.965068+0000","last_unstale":"2023-11-30T17:23:31.966946+0000","last_undegraded":"2023-11-30T17:23:31.966946+0000","last_fullsized":"2023-11-30T17:23:31.966946+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3c","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.975114+0000","last_change":"2023-11-30T17:23:31.578786+0000","last_active":"2023-11-30T17:23:31.975114+0000","last_peered":"2023-11-30T17:23:31.975114+0000","last_clean":"2023-11-30T17:23:31.975114+0000","last_became_active":"2023-11-30T17:23:31.578524+0000","last_became_peered":"2023-11-30T17:23:31.578524+0000","last_unstale":"2023-11-30T17:23:31.975114+0000","last_undegraded":"2023-11-30T17:23:31.975114+0000","last_fullsized":"2023-11-30T17:23:31.975114+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977330+0000","last_change":"2023-11-30T17:23:31.972469+0000","last_active":"2023-11-30T17:23:31.977330+0000","last_peered":"2023-11-30T17:23:31.977330+0000","last_clean":"2023-11-30T17:23:31.977330+0000","last_became_active":"2023-11-30T17:23:31.971919+0000","last_became_peered":"2023-11-30T17:23:31.971919+0000","last_unstale":"2023-11-30T17:23:31.977330+0000","last_undegraded":"2023-11-30T17:23:31.977330+0000","last_fullsized":"2023-11-30T17:23:31.977330+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.961374+0000","last_change":"2023-11-30T17:23:31.957683+0000","last_active":"2023-11-30T17:23:31.961374+0000","last_peered":"2023-11-30T17:23:31.961374+0000","last_clean":"2023-11-30T17:23:31.961374+0000","last_became_active":"2023-11-30T17:23:31.957381+0000","last_became_peered":"2023-11-30T17:23:31.957381+0000","last_unstale":"2023-11-30T17:23:31.961374+0000","last_undegraded":"2023-11-30T17:23:31.961374+0000","last_fullsized":"2023-11-30T17:23:31.961374+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976055+0000","last_change":"2023-11-30T17:23:31.973265+0000","last_active":"2023-11-30T17:23:31.976055+0000","last_peered":"2023-11-30T17:23:31.976055+0000","last_clean":"2023-11-30T17:23:31.976055+0000","last_became_active":"2023-11-30T17:23:31.972961+0000","last_became_peered":"2023-11-30T17:23:31.972961+0000","last_unstale":"2023-11-30T17:23:31.976055+0000","last_undegraded":"2023-11-30T17:23:31.976055+0000","last_fullsized":"2023-11-30T17:23:31.976055+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.953739+0000","last_change":"2023-11-30T17:23:31.575243+0000","last_active":"2023-11-30T17:23:31.953739+0000","last_peered":"2023-11-30T17:23:31.953739+0000","last_clean":"2023-11-30T17:23:31.953739+0000","last_became_active":"2023-11-30T17:23:31.574933+0000","last_became_peered":"2023-11-30T17:23:31.574933+0000","last_unstale":"2023-11-30T17:23:31.953739+0000","last_undegraded":"2023-11-30T17:23:31.953739+0000","last_fullsized":"2023-11-30T17:23:31.953739+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966866+0000","last_change":"2023-11-30T17:23:31.960188+0000","last_active":"2023-11-30T17:23:31.966866+0000","last_peered":"2023-11-30T17:23:31.966866+0000","last_clean":"2023-11-30T17:23:31.966866+0000","last_became_active":"2023-11-30T17:23:31.959891+0000","last_became_peered":"2023-11-30T17:23:31.959891+0000","last_unstale":"2023-11-30T17:23:31.966866+0000","last_undegraded":"2023-11-30T17:23:31.966866+0000","last_fullsized":"2023-11-30T17:23:31.966866+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.975777+0000","last_change":"2023-11-30T17:23:31.970303+0000","last_active":"2023-11-30T17:23:31.975777+0000","last_peered":"2023-11-30T17:23:31.975777+0000","last_clean":"2023-11-30T17:23:31.975777+0000","last_became_active":"2023-11-30T17:23:31.970018+0000","last_became_peered":"2023-11-30T17:23:31.970018+0000","last_unstale":"2023-11-30T17:23:31.975777+0000","last_undegraded":"2023-11-30T17:23:31.975777+0000","last_fullsized":"2023-11-30T17:23:31.975777+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969753+0000","last_change":"2023-11-30T17:23:31.578961+0000","last_active":"2023-11-30T17:23:31.969753+0000","last_peered":"2023-11-30T17:23:31.969753+0000","last_clean":"2023-11-30T17:23:31.969753+0000","last_became_active":"2023-11-30T17:23:31.578654+0000","last_became_peered":"2023-11-30T17:23:31.578654+0000","last_unstale":"2023-11-30T17:23:31.969753+0000","last_undegraded":"2023-11-30T17:23:31.969753+0000","last_fullsized":"2023-11-30T17:23:31.969753+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968400+0000","last_change":"2023-11-30T17:23:31.951742+0000","last_active":"2023-11-30T17:23:31.968400+0000","last_peered":"2023-11-30T17:23:31.968400+0000","last_clean":"2023-11-30T17:23:31.968400+0000","last_became_active":"2023-11-30T17:23:31.951124+0000","last_became_peered":"2023-11-30T17:23:31.951124+0000","last_unstale":"2023-11-30T17:23:31.968400+0000","last_undegraded":"2023-11-30T17:23:31.968400+0000","last_fullsized":"2023-11-30T17:23:31.968400+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.965240+0000","last_change":"2023-11-30T17:23:31.581506+0000","last_active":"2023-11-30T17:23:31.965240+0000","last_peered":"2023-11-30T17:23:31.965240+0000","last_clean":"2023-11-30T17:23:31.965240+0000","last_became_active":"2023-11-30T17:23:31.581285+0000","last_became_peered":"2023-11-30T17:23:31.581285+0000","last_unstale":"2023-11-30T17:23:31.965240+0000","last_undegraded":"2023-11-30T17:23:31.965240+0000","last_fullsized":"2023-11-30T17:23:31.965240+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.974647+0000","last_change":"2023-11-30T17:23:31.962794+0000","last_active":"2023-11-30T17:23:31.974647+0000","last_peered":"2023-11-30T17:23:31.974647+0000","last_clean":"2023-11-30T17:23:31.974647+0000","last_became_active":"2023-11-30T17:23:31.961702+0000","last_became_peered":"2023-11-30T17:23:31.961702+0000","last_unstale":"2023-11-30T17:23:31.974647+0000","last_undegraded":"2023-11-30T17:23:31.974647+0000","last_fullsized":"2023-11-30T17:23:31.974647+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.960078+0000","last_change":"2023-11-30T17:23:31.580372+0000","last_active":"2023-11-30T17:23:31.960078+0000","last_peered":"2023-11-30T17:23:31.960078+0000","last_clean":"2023-11-30T17:23:31.960078+0000","last_became_active":"2023-11-30T17:23:31.579716+0000","last_became_peered":"2023-11-30T17:23:31.579716+0000","last_unstale":"2023-11-30T17:23:31.960078+0000","last_undegraded":"2023-11-30T17:23:31.960078+0000","last_fullsized":"2023-11-30T17:23:31.960078+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.950162+0000","last_change":"2023-11-30T17:23:31.582624+0000","last_active":"2023-11-30T17:23:31.950162+0000","last_peered":"2023-11-30T17:23:31.950162+0000","last_clean":"2023-11-30T17:23:31.950162+0000","last_became_active":"2023-11-30T17:23:31.582166+0000","last_became_peered":"2023-11-30T17:23:31.582166+0000","last_unstale":"2023-11-30T17:23:31.950162+0000","last_undegraded":"2023-11-30T17:23:31.950162+0000","last_fullsized":"2023-11-30T17:23:31.950162+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.974718+0000","last_change":"2023-11-30T17:23:31.963277+0000","last_active":"2023-11-30T17:23:31.974718+0000","last_peered":"2023-11-30T17:23:31.974718+0000","last_clean":"2023-11-30T17:23:31.974718+0000","last_became_active":"2023-11-30T17:23:31.962955+0000","last_became_peered":"2023-11-30T17:23:31.962955+0000","last_unstale":"2023-11-30T17:23:31.974718+0000","last_undegraded":"2023-11-30T17:23:31.974718+0000","last_fullsized":"2023-11-30T17:23:31.974718+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976863+0000","last_change":"2023-11-30T17:23:31.968097+0000","last_active":"2023-11-30T17:23:31.976863+0000","last_peered":"2023-11-30T17:23:31.976863+0000","last_clean":"2023-11-30T17:23:31.976863+0000","last_became_active":"2023-11-30T17:23:31.967788+0000","last_became_peered":"2023-11-30T17:23:31.967788+0000","last_unstale":"2023-11-30T17:23:31.976863+0000","last_undegraded":"2023-11-30T17:23:31.976863+0000","last_fullsized":"2023-11-30T17:23:31.976863+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.959018+0000","last_change":"2023-11-30T17:23:31.569565+0000","last_active":"2023-11-30T17:23:31.959018+0000","last_peered":"2023-11-30T17:23:31.959018+0000","last_clean":"2023-11-30T17:23:31.959018+0000","last_became_active":"2023-11-30T17:23:31.569226+0000","last_became_peered":"2023-11-30T17:23:31.569226+0000","last_unstale":"2023-11-30T17:23:31.959018+0000","last_undegraded":"2023-11-30T17:23:31.959018+0000","last_fullsized":"2023-11-30T17:23:31.959018+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.974805+0000","last_change":"2023-11-30T17:23:31.973956+0000","last_active":"2023-11-30T17:23:31.974805+0000","last_peered":"2023-11-30T17:23:31.974805+0000","last_clean":"2023-11-30T17:23:31.974805+0000","last_became_active":"2023-11-30T17:23:31.973675+0000","last_became_peered":"2023-11-30T17:23:31.973675+0000","last_unstale":"2023-11-30T17:23:31.974805+0000","last_undegraded":"2023-11-30T17:23:31.974805+0000","last_fullsized":"2023-11-30T17:23:31.974805+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.970067+0000","last_change":"2023-11-30T17:23:31.576721+0000","last_active":"2023-11-30T17:23:31.970067+0000","last_peered":"2023-11-30T17:23:31.970067+0000","last_clean":"2023-11-30T17:23:31.970067+0000","last_became_active":"2023-11-30T17:23:31.575699+0000","last_became_peered":"2023-11-30T17:23:31.575699+0000","last_unstale":"2023-11-30T17:23:31.970067+0000","last_undegraded":"2023-11-30T17:23:31.970067+0000","last_fullsized":"2023-11-30T17:23:31.970067+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968737+0000","last_change":"2023-11-30T17:23:31.964844+0000","last_active":"2023-11-30T17:23:31.968737+0000","last_peered":"2023-11-30T17:23:31.968737+0000","last_clean":"2023-11-30T17:23:31.968737+0000","last_became_active":"2023-11-30T17:23:31.961956+0000","last_became_peered":"2023-11-30T17:23:31.961956+0000","last_unstale":"2023-11-30T17:23:31.968737+0000","last_undegraded":"2023-11-30T17:23:31.968737+0000","last_fullsized":"2023-11-30T17:23:31.968737+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.957082+0000","last_change":"2023-11-30T17:23:31.575492+0000","last_active":"2023-11-30T17:23:31.957082+0000","last_peered":"2023-11-30T17:23:31.957082+0000","last_clean":"2023-11-30T17:23:31.957082+0000","last_became_active":"2023-11-30T17:23:31.573839+0000","last_became_peered":"2023-11-30T17:23:31.573839+0000","last_unstale":"2023-11-30T17:23:31.957082+0000","last_undegraded":"2023-11-30T17:23:31.957082+0000","last_fullsized":"2023-11-30T17:23:31.957082+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.967040+0000","last_change":"2023-11-30T17:23:31.965248+0000","last_active":"2023-11-30T17:23:31.967040+0000","last_peered":"2023-11-30T17:23:31.967040+0000","last_clean":"2023-11-30T17:23:31.967040+0000","last_became_active":"2023-11-30T17:23:31.964971+0000","last_became_peered":"2023-11-30T17:23:31.964971+0000","last_unstale":"2023-11-30T17:23:31.967040+0000","last_undegraded":"2023-11-30T17:23:31.967040+0000","last_fullsized":"2023-11-30T17:23:31.967040+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2b","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969966+0000","last_change":"2023-11-30T17:23:31.573926+0000","last_active":"2023-11-30T17:23:31.969966+0000","last_peered":"2023-11-30T17:23:31.969966+0000","last_clean":"2023-11-30T17:23:31.969966+0000","last_became_active":"2023-11-30T17:23:31.573565+0000","last_became_peered":"2023-11-30T17:23:31.573565+0000","last_unstale":"2023-11-30T17:23:31.969966+0000","last_undegraded":"2023-11-30T17:23:31.969966+0000","last_fullsized":"2023-11-30T17:23:31.969966+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.971378+0000","last_change":"2023-11-30T17:23:31.579162+0000","last_active":"2023-11-30T17:23:31.971378+0000","last_peered":"2023-11-30T17:23:31.971378+0000","last_clean":"2023-11-30T17:23:31.971378+0000","last_became_active":"2023-11-30T17:23:31.578839+0000","last_became_peered":"2023-11-30T17:23:31.578839+0000","last_unstale":"2023-11-30T17:23:31.971378+0000","last_undegraded":"2023-11-30T17:23:31.971378+0000","last_fullsized":"2023-11-30T17:23:31.971378+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.953484+0000","last_change":"2023-11-30T17:23:31.575050+0000","last_active":"2023-11-30T17:23:31.953484+0000","last_peered":"2023-11-30T17:23:31.953484+0000","last_clean":"2023-11-30T17:23:31.953484+0000","last_became_active":"2023-11-30T17:23:31.574230+0000","last_became_peered":"2023-11-30T17:23:31.574230+0000","last_unstale":"2023-11-30T17:23:31.953484+0000","last_undegraded":"2023-11-30T17:23:31.953484+0000","last_fullsized":"2023-11-30T17:23:31.953484+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976986+0000","last_change":"2023-11-30T17:23:31.970460+0000","last_active":"2023-11-30T17:23:31.976986+0000","last_peered":"2023-11-30T17:23:31.976986+0000","last_clean":"2023-11-30T17:23:31.976986+0000","last_became_active":"2023-11-30T17:23:31.970168+0000","last_became_peered":"2023-11-30T17:23:31.970168+0000","last_unstale":"2023-11-30T17:23:31.976986+0000","last_undegraded":"2023-11-30T17:23:31.976986+0000","last_fullsized":"2023-11-30T17:23:31.976986+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969686+0000","last_change":"2023-11-30T17:23:31.576651+0000","last_active":"2023-11-30T17:23:31.969686+0000","last_peered":"2023-11-30T17:23:31.969686+0000","last_clean":"2023-11-30T17:23:31.969686+0000","last_became_active":"2023-11-30T17:23:31.576386+0000","last_became_peered":"2023-11-30T17:23:31.576386+0000","last_unstale":"2023-11-30T17:23:31.969686+0000","last_undegraded":"2023-11-30T17:23:31.969686+0000","last_fullsized":"2023-11-30T17:23:31.969686+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968312+0000","last_change":"2023-11-30T17:23:31.966907+0000","last_active":"2023-11-30T17:23:31.968312+0000","last_peered":"2023-11-30T17:23:31.968312+0000","last_clean":"2023-11-30T17:23:31.968312+0000","last_became_active":"2023-11-30T17:23:31.966449+0000","last_became_peered":"2023-11-30T17:23:31.966449+0000","last_unstale":"2023-11-30T17:23:31.968312+0000","last_undegraded":"2023-11-30T17:23:31.968312+0000","last_fullsized":"2023-11-30T17:23:31.968312+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.951943+0000","last_change":"2023-11-30T17:23:31.586699+0000","last_active":"2023-11-30T17:23:31.951943+0000","last_peered":"2023-11-30T17:23:31.951943+0000","last_clean":"2023-11-30T17:23:31.951943+0000","last_became_active":"2023-11-30T17:23:31.586428+0000","last_became_peered":"2023-11-30T17:23:31.586428+0000","last_unstale":"2023-11-30T17:23:31.951943+0000","last_undegraded":"2023-11-30T17:23:31.951943+0000","last_fullsized":"2023-11-30T17:23:31.951943+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968422+0000","last_change":"2023-11-30T17:23:31.951947+0000","last_active":"2023-11-30T17:23:31.968422+0000","last_peered":"2023-11-30T17:23:31.968422+0000","last_clean":"2023-11-30T17:23:31.968422+0000","last_became_active":"2023-11-30T17:23:31.951475+0000","last_became_peered":"2023-11-30T17:23:31.951475+0000","last_unstale":"2023-11-30T17:23:31.968422+0000","last_undegraded":"2023-11-30T17:23:31.968422+0000","last_fullsized":"2023-11-30T17:23:31.968422+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969411+0000","last_change":"2023-11-30T17:23:31.575097+0000","last_active":"2023-11-30T17:23:31.969411+0000","last_peered":"2023-11-30T17:23:31.969411+0000","last_clean":"2023-11-30T17:23:31.969411+0000","last_became_active":"2023-11-30T17:23:31.574793+0000","last_became_peered":"2023-11-30T17:23:31.574793+0000","last_unstale":"2023-11-30T17:23:31.969411+0000","last_undegraded":"2023-11-30T17:23:31.969411+0000","last_fullsized":"2023-11-30T17:23:31.969411+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.971442+0000","last_change":"2023-11-30T17:23:31.585126+0000","last_active":"2023-11-30T17:23:31.971442+0000","last_peered":"2023-11-30T17:23:31.971442+0000","last_clean":"2023-11-30T17:23:31.971442+0000","last_became_active":"2023-11-30T17:23:31.584635+0000","last_became_peered":"2023-11-30T17:23:31.584635+0000","last_unstale":"2023-11-30T17:23:31.971442+0000","last_undegraded":"2023-11-30T17:23:31.971442+0000","last_fullsized":"2023-11-30T17:23:31.971442+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.963851+0000","last_change":"2023-11-30T17:23:31.962840+0000","last_active":"2023-11-30T17:23:31.963851+0000","last_peered":"2023-11-30T17:23:31.963851+0000","last_clean":"2023-11-30T17:23:31.963851+0000","last_became_active":"2023-11-30T17:23:31.962549+0000","last_became_peered":"2023-11-30T17:23:31.962549+0000","last_unstale":"2023-11-30T17:23:31.963851+0000","last_undegraded":"2023-11-30T17:23:31.963851+0000","last_fullsized":"2023-11-30T17:23:31.963851+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.975897+0000","last_change":"2023-11-30T17:23:31.967042+0000","last_active":"2023-11-30T17:23:31.975897+0000","last_peered":"2023-11-30T17:23:31.975897+0000","last_clean":"2023-11-30T17:23:31.975897+0000","last_became_active":"2023-11-30T17:23:31.966757+0000","last_became_peered":"2023-11-30T17:23:31.966757+0000","last_unstale":"2023-11-30T17:23:31.975897+0000","last_undegraded":"2023-11-30T17:23:31.975897+0000","last_fullsized":"2023-11-30T17:23:31.975897+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.970001+0000","last_change":"2023-11-30T17:23:31.963695+0000","last_active":"2023-11-30T17:23:31.970001+0000","last_peered":"2023-11-30T17:23:31.970001+0000","last_clean":"2023-11-30T17:23:31.970001+0000","last_became_active":"2023-11-30T17:23:31.962928+0000","last_became_peered":"2023-11-30T17:23:31.962928+0000","last_unstale":"2023-11-30T17:23:31.970001+0000","last_undegraded":"2023-11-30T17:23:31.970001+0000","last_fullsized":"2023-11-30T17:23:31.970001+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.972863+0000","last_change":"2023-11-30T17:23:31.971045+0000","last_active":"2023-11-30T17:23:31.972863+0000","last_peered":"2023-11-30T17:23:31.972863+0000","last_clean":"2023-11-30T17:23:31.972863+0000","last_became_active":"2023-11-30T17:23:31.970765+0000","last_became_peered":"2023-11-30T17:23:31.970765+0000","last_unstale":"2023-11-30T17:23:31.972863+0000","last_undegraded":"2023-11-30T17:23:31.972863+0000","last_fullsized":"2023-11-30T17:23:31.972863+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.963145+0000","last_change":"2023-11-30T17:23:31.584175+0000","last_active":"2023-11-30T17:23:31.963145+0000","last_peered":"2023-11-30T17:23:31.963145+0000","last_clean":"2023-11-30T17:23:31.963145+0000","last_became_active":"2023-11-30T17:23:31.583873+0000","last_became_peered":"2023-11-30T17:23:31.583873+0000","last_unstale":"2023-11-30T17:23:31.963145+0000","last_undegraded":"2023-11-30T17:23:31.963145+0000","last_fullsized":"2023-11-30T17:23:31.963145+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.965756+0000","last_change":"2023-11-30T17:23:31.951314+0000","last_active":"2023-11-30T17:23:31.965756+0000","last_peered":"2023-11-30T17:23:31.965756+0000","last_clean":"2023-11-30T17:23:31.965756+0000","last_became_active":"2023-11-30T17:23:31.951068+0000","last_became_peered":"2023-11-30T17:23:31.951068+0000","last_unstale":"2023-11-30T17:23:31.965756+0000","last_undegraded":"2023-11-30T17:23:31.965756+0000","last_fullsized":"2023-11-30T17:23:31.965756+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977304+0000","last_change":"2023-11-30T17:23:31.972316+0000","last_active":"2023-11-30T17:23:31.977304+0000","last_peered":"2023-11-30T17:23:31.977304+0000","last_clean":"2023-11-30T17:23:31.977304+0000","last_became_active":"2023-11-30T17:23:31.971591+0000","last_became_peered":"2023-11-30T17:23:31.971591+0000","last_unstale":"2023-11-30T17:23:31.977304+0000","last_undegraded":"2023-11-30T17:23:31.977304+0000","last_fullsized":"2023-11-30T17:23:31.977304+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.971522+0000","last_change":"2023-11-30T17:23:31.584951+0000","last_active":"2023-11-30T17:23:31.971522+0000","last_peered":"2023-11-30T17:23:31.971522+0000","last_clean":"2023-11-30T17:23:31.971522+0000","last_became_active":"2023-11-30T17:23:31.584271+0000","last_became_peered":"2023-11-30T17:23:31.584271+0000","last_unstale":"2023-11-30T17:23:31.971522+0000","last_undegraded":"2023-11-30T17:23:31.971522+0000","last_fullsized":"2023-11-30T17:23:31.971522+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968644+0000","last_change":"2023-11-30T17:23:31.964012+0000","last_active":"2023-11-30T17:23:31.968644+0000","last_peered":"2023-11-30T17:23:31.968644+0000","last_clean":"2023-11-30T17:23:31.968644+0000","last_became_active":"2023-11-30T17:23:31.963750+0000","last_became_peered":"2023-11-30T17:23:31.963750+0000","last_unstale":"2023-11-30T17:23:31.968644+0000","last_undegraded":"2023-11-30T17:23:31.968644+0000","last_fullsized":"2023-11-30T17:23:31.968644+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.949896+0000","last_change":"2023-11-30T17:23:31.582453+0000","last_active":"2023-11-30T17:23:31.949896+0000","last_peered":"2023-11-30T17:23:31.949896+0000","last_clean":"2023-11-30T17:23:31.949896+0000","last_became_active":"2023-11-30T17:23:31.581818+0000","last_became_peered":"2023-11-30T17:23:31.581818+0000","last_unstale":"2023-11-30T17:23:31.949896+0000","last_undegraded":"2023-11-30T17:23:31.949896+0000","last_fullsized":"2023-11-30T17:23:31.949896+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977686+0000","last_change":"2023-11-30T17:23:31.973318+0000","last_active":"2023-11-30T17:23:31.977686+0000","last_peered":"2023-11-30T17:23:31.977686+0000","last_clean":"2023-11-30T17:23:31.977686+0000","last_became_active":"2023-11-30T17:23:31.973044+0000","last_became_peered":"2023-11-30T17:23:31.973044+0000","last_unstale":"2023-11-30T17:23:31.977686+0000","last_undegraded":"2023-11-30T17:23:31.977686+0000","last_fullsized":"2023-11-30T17:23:31.977686+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.951309+0000","last_change":"2023-11-30T17:23:31.583511+0000","last_active":"2023-11-30T17:23:31.951309+0000","last_peered":"2023-11-30T17:23:31.951309+0000","last_clean":"2023-11-30T17:23:31.951309+0000","last_became_active":"2023-11-30T17:23:31.583179+0000","last_became_peered":"2023-11-30T17:23:31.583179+0000","last_unstale":"2023-11-30T17:23:31.951309+0000","last_undegraded":"2023-11-30T17:23:31.951309+0000","last_fullsized":"2023-11-30T17:23:31.951309+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969624+0000","last_change":"2023-11-30T17:23:31.968565+0000","last_active":"2023-11-30T17:23:31.969624+0000","last_peered":"2023-11-30T17:23:31.969624+0000","last_clean":"2023-11-30T17:23:31.969624+0000","last_became_active":"2023-11-30T17:23:31.968258+0000","last_became_peered":"2023-11-30T17:23:31.968258+0000","last_unstale":"2023-11-30T17:23:31.969624+0000","last_undegraded":"2023-11-30T17:23:31.969624+0000","last_fullsized":"2023-11-30T17:23:31.969624+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.953697+0000","last_change":"2023-11-30T17:23:31.586544+0000","last_active":"2023-11-30T17:23:31.953697+0000","last_peered":"2023-11-30T17:23:31.953697+0000","last_clean":"2023-11-30T17:23:31.953697+0000","last_became_active":"2023-11-30T17:23:31.586249+0000","last_became_peered":"2023-11-30T17:23:31.586249+0000","last_unstale":"2023-11-30T17:23:31.953697+0000","last_undegraded":"2023-11-30T17:23:31.953697+0000","last_fullsized":"2023-11-30T17:23:31.953697+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.967257+0000","last_change":"2023-11-30T17:23:31.966064+0000","last_active":"2023-11-30T17:23:31.967257+0000","last_peered":"2023-11-30T17:23:31.967257+0000","last_clean":"2023-11-30T17:23:31.967257+0000","last_became_active":"2023-11-30T17:23:31.965286+0000","last_became_peered":"2023-11-30T17:23:31.965286+0000","last_unstale":"2023-11-30T17:23:31.967257+0000","last_undegraded":"2023-11-30T17:23:31.967257+0000","last_fullsized":"2023-11-30T17:23:31.967257+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976819+0000","last_change":"2023-11-30T17:23:31.967924+0000","last_active":"2023-11-30T17:23:31.976819+0000","last_peered":"2023-11-30T17:23:31.976819+0000","last_clean":"2023-11-30T17:23:31.976819+0000","last_became_active":"2023-11-30T17:23:31.967731+0000","last_became_peered":"2023-11-30T17:23:31.967731+0000","last_unstale":"2023-11-30T17:23:31.976819+0000","last_undegraded":"2023-11-30T17:23:31.976819+0000","last_fullsized":"2023-11-30T17:23:31.976819+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.973710+0000","last_change":"2023-11-30T17:23:31.574509+0000","last_active":"2023-11-30T17:23:31.973710+0000","last_peered":"2023-11-30T17:23:31.973710+0000","last_clean":"2023-11-30T17:23:31.973710+0000","last_became_active":"2023-11-30T17:23:31.574222+0000","last_became_peered":"2023-11-30T17:23:31.574222+0000","last_unstale":"2023-11-30T17:23:31.973710+0000","last_undegraded":"2023-11-30T17:23:31.973710+0000","last_fullsized":"2023-11-30T17:23:31.973710+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977348+0000","last_change":"2023-11-30T17:23:31.972653+0000","last_active":"2023-11-30T17:23:31.977348+0000","last_peered":"2023-11-30T17:23:31.977348+0000","last_clean":"2023-11-30T17:23:31.977348+0000","last_became_active":"2023-11-30T17:23:31.972117+0000","last_became_peered":"2023-11-30T17:23:31.972117+0000","last_unstale":"2023-11-30T17:23:31.977348+0000","last_undegraded":"2023-11-30T17:23:31.977348+0000","last_fullsized":"2023-11-30T17:23:31.977348+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968511+0000","last_change":"2023-11-30T17:23:31.583818+0000","last_active":"2023-11-30T17:23:31.968511+0000","last_peered":"2023-11-30T17:23:31.968511+0000","last_clean":"2023-11-30T17:23:31.968511+0000","last_became_active":"2023-11-30T17:23:31.583114+0000","last_became_peered":"2023-11-30T17:23:31.583114+0000","last_unstale":"2023-11-30T17:23:31.968511+0000","last_undegraded":"2023-11-30T17:23:31.968511+0000","last_fullsized":"2023-11-30T17:23:31.968511+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.947455+0000","last_change":"2023-11-30T17:23:31.583430+0000","last_active":"2023-11-30T17:23:31.947455+0000","last_peered":"2023-11-30T17:23:31.947455+0000","last_clean":"2023-11-30T17:23:31.947455+0000","last_became_active":"2023-11-30T17:23:31.583105+0000","last_became_peered":"2023-11-30T17:23:31.583105+0000","last_unstale":"2023-11-30T17:23:31.947455+0000","last_undegraded":"2023-11-30T17:23:31.947455+0000","last_fullsized":"2023-11-30T17:23:31.947455+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.967351+0000","last_change":"2023-11-30T17:23:31.964226+0000","last_active":"2023-11-30T17:23:31.967351+0000","last_peered":"2023-11-30T17:23:31.967351+0000","last_clean":"2023-11-30T17:23:31.967351+0000","last_became_active":"2023-11-30T17:23:31.963944+0000","last_became_peered":"2023-11-30T17:23:31.963944+0000","last_unstale":"2023-11-30T17:23:31.967351+0000","last_undegraded":"2023-11-30T17:23:31.967351+0000","last_fullsized":"2023-11-30T17:23:31.967351+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.964360+0000","last_change":"2023-11-30T17:23:31.571471+0000","last_active":"2023-11-30T17:23:31.964360+0000","last_peered":"2023-11-30T17:23:31.964360+0000","last_clean":"2023-11-30T17:23:31.964360+0000","last_became_active":"2023-11-30T17:23:31.571178+0000","last_became_peered":"2023-11-30T17:23:31.571178+0000","last_unstale":"2023-11-30T17:23:31.964360+0000","last_undegraded":"2023-11-30T17:23:31.964360+0000","last_fullsized":"2023-11-30T17:23:31.964360+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966913+0000","last_change":"2023-11-30T17:23:31.965542+0000","last_active":"2023-11-30T17:23:31.966913+0000","last_peered":"2023-11-30T17:23:31.966913+0000","last_clean":"2023-11-30T17:23:31.966913+0000","last_became_active":"2023-11-30T17:23:31.965254+0000","last_became_peered":"2023-11-30T17:23:31.965254+0000","last_unstale":"2023-11-30T17:23:31.966913+0000","last_undegraded":"2023-11-30T17:23:31.966913+0000","last_fullsized":"2023-11-30T17:23:31.966913+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"112'4","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977162+0000","last_change":"2023-11-30T17:23:31.584353+0000","last_active":"2023-11-30T17:23:31.977162+0000","last_peered":"2023-11-30T17:23:31.977162+0000","last_clean":"2023-11-30T17:23:31.977162+0000","last_became_active":"2023-11-30T17:23:31.584077+0000","last_became_peered":"2023-11-30T17:23:31.584077+0000","last_unstale":"2023-11-30T17:23:31.977162+0000","last_undegraded":"2023-11-30T17:23:31.977162+0000","last_fullsized":"2023-11-30T17:23:31.977162+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.965305+0000","last_change":"2023-11-30T17:23:31.576611+0000","last_active":"2023-11-30T17:23:31.965305+0000","last_peered":"2023-11-30T17:23:31.965305+0000","last_clean":"2023-11-30T17:23:31.965305+0000","last_became_active":"2023-11-30T17:23:31.576303+0000","last_became_peered":"2023-11-30T17:23:31.576303+0000","last_unstale":"2023-11-30T17:23:31.965305+0000","last_undegraded":"2023-11-30T17:23:31.965305+0000","last_fullsized":"2023-11-30T17:23:31.965305+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976552+0000","last_change":"2023-11-30T17:23:31.973173+0000","last_active":"2023-11-30T17:23:31.976552+0000","last_peered":"2023-11-30T17:23:31.976552+0000","last_clean":"2023-11-30T17:23:31.976552+0000","last_became_active":"2023-11-30T17:23:31.970112+0000","last_became_peered":"2023-11-30T17:23:31.970112+0000","last_unstale":"2023-11-30T17:23:31.976552+0000","last_undegraded":"2023-11-30T17:23:31.976552+0000","last_fullsized":"2023-11-30T17:23:31.976552+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968363+0000","last_change":"2023-11-30T17:23:31.962690+0000","last_active":"2023-11-30T17:23:31.968363+0000","last_peered":"2023-11-30T17:23:31.968363+0000","last_clean":"2023-11-30T17:23:31.968363+0000","last_became_active":"2023-11-30T17:23:31.962398+0000","last_became_peered":"2023-11-30T17:23:31.962398+0000","last_unstale":"2023-11-30T17:23:31.968363+0000","last_undegraded":"2023-11-30T17:23:31.968363+0000","last_fullsized":"2023-11-30T17:23:31.968363+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.975890+0000","last_change":"2023-11-30T17:23:31.969835+0000","last_active":"2023-11-30T17:23:31.975890+0000","last_peered":"2023-11-30T17:23:31.975890+0000","last_clean":"2023-11-30T17:23:31.975890+0000","last_became_active":"2023-11-30T17:23:31.969554+0000","last_became_peered":"2023-11-30T17:23:31.969554+0000","last_unstale":"2023-11-30T17:23:31.975890+0000","last_undegraded":"2023-11-30T17:23:31.975890+0000","last_fullsized":"2023-11-30T17:23:31.975890+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.947769+0000","last_change":"2023-11-30T17:23:31.588106+0000","last_active":"2023-11-30T17:23:31.947769+0000","last_peered":"2023-11-30T17:23:31.947769+0000","last_clean":"2023-11-30T17:23:31.947769+0000","last_became_active":"2023-11-30T17:23:31.587639+0000","last_became_peered":"2023-11-30T17:23:31.587639+0000","last_unstale":"2023-11-30T17:23:31.947769+0000","last_undegraded":"2023-11-30T17:23:31.947769+0000","last_fullsized":"2023-11-30T17:23:31.947769+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966848+0000","last_change":"2023-11-30T17:23:31.964658+0000","last_active":"2023-11-30T17:23:31.966848+0000","last_peered":"2023-11-30T17:23:31.966848+0000","last_clean":"2023-11-30T17:23:31.966848+0000","last_became_active":"2023-11-30T17:23:31.964344+0000","last_became_peered":"2023-11-30T17:23:31.964344+0000","last_unstale":"2023-11-30T17:23:31.966848+0000","last_undegraded":"2023-11-30T17:23:31.966848+0000","last_fullsized":"2023-11-30T17:23:31.966848+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966407+0000","last_change":"2023-11-30T17:23:31.951476+0000","last_active":"2023-11-30T17:23:31.966407+0000","last_peered":"2023-11-30T17:23:31.966407+0000","last_clean":"2023-11-30T17:23:31.966407+0000","last_became_active":"2023-11-30T17:23:31.951287+0000","last_became_peered":"2023-11-30T17:23:31.951287+0000","last_unstale":"2023-11-30T17:23:31.966407+0000","last_undegraded":"2023-11-30T17:23:31.966407+0000","last_fullsized":"2023-11-30T17:23:31.966407+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.951316+0000","last_change":"2023-11-30T17:23:31.579504+0000","last_active":"2023-11-30T17:23:31.951316+0000","last_peered":"2023-11-30T17:23:31.951316+0000","last_clean":"2023-11-30T17:23:31.951316+0000","last_became_active":"2023-11-30T17:23:31.579215+0000","last_became_peered":"2023-11-30T17:23:31.579215+0000","last_unstale":"2023-11-30T17:23:31.951316+0000","last_undegraded":"2023-11-30T17:23:31.951316+0000","last_fullsized":"2023-11-30T17:23:31.951316+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976068+0000","last_change":"2023-11-30T17:23:31.973279+0000","last_active":"2023-11-30T17:23:31.976068+0000","last_peered":"2023-11-30T17:23:31.976068+0000","last_clean":"2023-11-30T17:23:31.976068+0000","last_became_active":"2023-11-30T17:23:31.972992+0000","last_became_peered":"2023-11-30T17:23:31.972992+0000","last_unstale":"2023-11-30T17:23:31.976068+0000","last_undegraded":"2023-11-30T17:23:31.976068+0000","last_fullsized":"2023-11-30T17:23:31.976068+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":91,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969790+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:23:31.969790+0000","last_peered":"2023-11-30T17:23:31.969790+0000","last_clean":"2023-11-30T17:23:31.969790+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:23:31.969790+0000","last_undegraded":"2023-11-30T17:23:31.969790+0000","last_fullsized":"2023-11-30T17:23:31.969790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":86,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-30T17:23:28.089672+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:23:28.089672+0000","last_peered":"2023-11-30T17:23:28.089672+0000","last_clean":"2023-11-30T17:23:28.089672+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:23:28.089672+0000","last_undegraded":"2023-11-30T17:23:28.089672+0000","last_fullsized":"2023-11-30T17:23:28.089672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966869+0000","last_change":"2023-11-30T17:23:31.572852+0000","last_active":"2023-11-30T17:23:31.966869+0000","last_peered":"2023-11-30T17:23:31.966869+0000","last_clean":"2023-11-30T17:23:31.966869+0000","last_became_active":"2023-11-30T17:23:31.572533+0000","last_became_peered":"2023-11-30T17:23:31.572533+0000","last_unstale":"2023-11-30T17:23:31.966869+0000","last_undegraded":"2023-11-30T17:23:31.966869+0000","last_fullsized":"2023-11-30T17:23:31.966869+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":95,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.953812+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:23:31.953812+0000","last_peered":"2023-11-30T17:23:31.953812+0000","last_clean":"2023-11-30T17:23:31.953812+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:23:31.953812+0000","last_undegraded":"2023-11-30T17:23:31.953812+0000","last_fullsized":"2023-11-30T17:23:31.953812+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.963094+0000","last_change":"2023-11-30T17:23:31.958158+0000","last_active":"2023-11-30T17:23:31.963094+0000","last_peered":"2023-11-30T17:23:31.963094+0000","last_clean":"2023-11-30T17:23:31.963094+0000","last_became_active":"2023-11-30T17:23:31.957892+0000","last_became_peered":"2023-11-30T17:23:31.957892+0000","last_unstale":"2023-11-30T17:23:31.963094+0000","last_undegraded":"2023-11-30T17:23:31.963094+0000","last_fullsized":"2023-11-30T17:23:31.963094+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969704+0000","last_change":"2023-11-30T17:23:31.576516+0000","last_active":"2023-11-30T17:23:31.969704+0000","last_peered":"2023-11-30T17:23:31.969704+0000","last_clean":"2023-11-30T17:23:31.969704+0000","last_became_active":"2023-11-30T17:23:31.576131+0000","last_became_peered":"2023-11-30T17:23:31.576131+0000","last_unstale":"2023-11-30T17:23:31.969704+0000","last_undegraded":"2023-11-30T17:23:31.969704+0000","last_fullsized":"2023-11-30T17:23:31.969704+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":86,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-30T17:23:28.089708+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:23:28.089708+0000","last_peered":"2023-11-30T17:23:28.089708+0000","last_clean":"2023-11-30T17:23:28.089708+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:23:28.089708+0000","last_undegraded":"2023-11-30T17:23:28.089708+0000","last_fullsized":"2023-11-30T17:23:28.089708+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":92,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.951439+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:23:31.951439+0000","last_peered":"2023-11-30T17:23:31.951439+0000","last_clean":"2023-11-30T17:23:31.951439+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:23:31.951439+0000","last_undegraded":"2023-11-30T17:23:31.951439+0000","last_fullsized":"2023-11-30T17:23:31.951439+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976031+0000","last_change":"2023-11-30T17:23:31.972941+0000","last_active":"2023-11-30T17:23:31.976031+0000","last_peered":"2023-11-30T17:23:31.976031+0000","last_clean":"2023-11-30T17:23:31.976031+0000","last_became_active":"2023-11-30T17:23:31.967587+0000","last_became_peered":"2023-11-30T17:23:31.967587+0000","last_unstale":"2023-11-30T17:23:31.976031+0000","last_undegraded":"2023-11-30T17:23:31.976031+0000","last_fullsized":"2023-11-30T17:23:31.976031+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":90,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.951488+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:23:31.951488+0000","last_peered":"2023-11-30T17:23:31.951488+0000","last_clean":"2023-11-30T17:23:31.951488+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:23:31.951488+0000","last_undegraded":"2023-11-30T17:23:31.951488+0000","last_fullsized":"2023-11-30T17:23:31.951488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.959971+0000","last_change":"2023-11-30T17:23:31.580697+0000","last_active":"2023-11-30T17:23:31.959971+0000","last_peered":"2023-11-30T17:23:31.959971+0000","last_clean":"2023-11-30T17:23:31.959971+0000","last_became_active":"2023-11-30T17:23:31.580098+0000","last_became_peered":"2023-11-30T17:23:31.580098+0000","last_unstale":"2023-11-30T17:23:31.959971+0000","last_undegraded":"2023-11-30T17:23:31.959971+0000","last_fullsized":"2023-11-30T17:23:31.959971+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":90,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.952310+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:23:31.952310+0000","last_peered":"2023-11-30T17:23:31.952310+0000","last_clean":"2023-11-30T17:23:31.952310+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:23:31.952310+0000","last_undegraded":"2023-11-30T17:23:31.952310+0000","last_fullsized":"2023-11-30T17:23:31.952310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":91,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969567+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:23:31.969567+0000","last_peered":"2023-11-30T17:23:31.969567+0000","last_clean":"2023-11-30T17:23:31.969567+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:23:31.969567+0000","last_undegraded":"2023-11-30T17:23:31.969567+0000","last_fullsized":"2023-11-30T17:23:31.969567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968512+0000","last_change":"2023-11-30T17:23:31.963009+0000","last_active":"2023-11-30T17:23:31.968512+0000","last_peered":"2023-11-30T17:23:31.968512+0000","last_clean":"2023-11-30T17:23:31.968512+0000","last_became_active":"2023-11-30T17:23:31.962748+0000","last_became_peered":"2023-11-30T17:23:31.962748+0000","last_unstale":"2023-11-30T17:23:31.968512+0000","last_undegraded":"2023-11-30T17:23:31.968512+0000","last_fullsized":"2023-11-30T17:23:31.968512+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.953593+0000","last_change":"2023-11-30T17:23:31.575232+0000","last_active":"2023-11-30T17:23:31.953593+0000","last_peered":"2023-11-30T17:23:31.953593+0000","last_clean":"2023-11-30T17:23:31.953593+0000","last_became_active":"2023-11-30T17:23:31.574785+0000","last_became_peered":"2023-11-30T17:23:31.574785+0000","last_unstale":"2023-11-30T17:23:31.953593+0000","last_undegraded":"2023-11-30T17:23:31.953593+0000","last_fullsized":"2023-11-30T17:23:31.953593+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-30T17:23:27.439439+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:23:27.439439+0000","last_peered":"2023-11-30T17:23:27.439439+0000","last_clean":"2023-11-30T17:23:27.439439+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:23:27.439439+0000","last_undegraded":"2023-11-30T17:23:27.439439+0000","last_fullsized":"2023-11-30T17:23:27.439439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":82,"acting":82,"num_store_stats":5},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":748,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":70,"acting":70,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575043,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302556,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069284,"statfs":{"total":96636764160,"available":96326946816,"internally_reserved":0,"allocated":1396736,"data_stored":697239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.371,"5min":0.315,"15min":0.23899999999999999},"max":{"1min":0.72399999999999998,"5min":0.80400000000000005,"15min":0.81100000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57499999999999996,"15min":0.58199999999999996},"min":{"1min":0.41099999999999998,"5min":0.40699999999999997,"15min":0.32200000000000001},"max":{"1min":0.74099999999999999,"5min":0.78300000000000003,"15min":0.81899999999999995},"last":0.503}]},{"osd":1,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70899999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.442},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.32900000000000001,"5min":0.29899999999999999,"15min":0.28799999999999998},"max":{"1min":0.64000000000000001,"5min":0.76100000000000001,"15min":0.82499999999999996},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53800000000000003,"15min":0.54900000000000004},"min":{"1min":0.37,"5min":0.33500000000000002,"15min":0.32800000000000001},"max":{"1min":0.68200000000000005,"5min":0.77000000000000002,"15min":0.78300000000000003},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.38800000000000001,"5min":0.35399999999999998,"15min":0.28699999999999998},"max":{"1min":0.70499999999999996,"5min":0.73799999999999999,"15min":0.83899999999999997},"last":0.53700000000000003}]},{"osd":3,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.53400000000000003,"15min":0.54100000000000004},"min":{"1min":0.378,"5min":0.36499999999999999,"15min":0.33200000000000002},"max":{"1min":0.65700000000000003,"5min":0.754,"15min":0.78000000000000003},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56999999999999995,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.40799999999999997,"15min":0.33900000000000002},"max":{"1min":0.67500000000000004,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.54800000000000004}]},{"osd":4,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44600000000000001,"15min":0.45800000000000002},"min":{"1min":0.32400000000000001,"5min":0.313,"15min":0.29699999999999999},"max":{"1min":0.55000000000000004,"5min":0.77000000000000002,"15min":0.79900000000000004},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.30099999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59899999999999998,"5min":0.75800000000000001,"15min":1.3180000000000001},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.48399999999999999,"15min":0.49099999999999999},"min":{"1min":0.317,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58699999999999997,"5min":0.80000000000000004,"15min":0.82899999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.61199999999999999,"5min":0.79300000000000004,"15min":0.872},"last":0.45800000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.69699999999999995,"5min":0.81200000000000006,"15min":0.85199999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.33700000000000002},"max":{"1min":0.67300000000000004,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.47499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575041,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302500,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069340,"statfs":{"total":96636764160,"available":96327004160,"internally_reserved":0,"allocated":1339392,"data_stored":670288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.57099999999999995},"min":{"1min":0.38100000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72899999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.498},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56499999999999995,"15min":0.58699999999999997},"min":{"1min":0.46300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.748,"5min":0.79600000000000004,"15min":0.89300000000000002},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54600000000000004,"15min":0.56399999999999995},"min":{"1min":0.32800000000000001,"5min":0.30599999999999999,"15min":0.26400000000000001},"max":{"1min":0.75800000000000001,"5min":0.76900000000000002,"15min":0.82799999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58199999999999996,"15min":0.59899999999999998},"min":{"1min":0.45100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.751,"5min":0.82499999999999996,"15min":0.85199999999999998},"last":0.54600000000000004}]},{"osd":2,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56000000000000005,"15min":0.57299999999999995},"min":{"1min":0.371,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.77500000000000002,"5min":0.79900000000000004,"15min":0.82599999999999996},"last":0.376},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.40699999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76100000000000001,"5min":0.80900000000000005,"15min":0.82499999999999996},"last":0.53400000000000003}]},{"osd":3,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51100000000000001,"15min":0.53200000000000003},"min":{"1min":0.40400000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71899999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73499999999999999,"5min":0.75600000000000001,"15min":0.79600000000000004},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44600000000000001,"15min":0.45300000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.84199999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46100000000000002,"15min":0.47799999999999998},"min":{"1min":0.34999999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.746,"5min":0.76000000000000001,"15min":0.83899999999999997},"last":0.46700000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.45900000000000002,"15min":0.47199999999999998},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.28299999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.496,"15min":0.50700000000000001},"min":{"1min":0.38400000000000001,"5min":0.33500000000000002,"15min":0.31900000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.42099999999999999}]},{"osd":7,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.34499999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.74199999999999999,"5min":0.80700000000000005,"15min":0.93200000000000005},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55100000000000005,"15min":0.56299999999999994},"min":{"1min":0.43099999999999999,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.86499999999999999},"last":0.48699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575042,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306644,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065196,"statfs":{"total":96636764160,"available":96322760704,"internally_reserved":0,"allocated":1388544,"data_stored":697183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.378,"15min":0.35999999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23000000000000001},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.48699999999999999,"15min":0.47199999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.309},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.375}]},{"osd":2,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.38900000000000001},"min":{"1min":0.249,"5min":0.215,"15min":0.215},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.502},"min":{"1min":0.36499999999999999,"5min":0.33400000000000002,"15min":0.29499999999999998},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.46600000000000003,"15min":0.45200000000000001},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.23899999999999999},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.436},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.44800000000000001,"15min":0.435},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.40100000000000002}]},{"osd":4,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.35499999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.83499999999999996,"5min":0.88500000000000001,"15min":0.89100000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.61899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.39900000000000002},"max":{"1min":0.85099999999999998,"5min":0.97599999999999998,"15min":1.111},"last":0.623}]},{"osd":5,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.46500000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.39600000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.91300000000000003},"last":0.64100000000000001}]},{"osd":6,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.64800000000000002,"15min":0.65900000000000003},"min":{"1min":0.46500000000000002,"5min":0.39700000000000002,"15min":0.39600000000000002},"max":{"1min":0.91000000000000003,"5min":0.92700000000000005,"15min":1.0600000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66100000000000003,"15min":0.66500000000000004},"min":{"1min":0.437,"5min":0.433,"15min":0.379},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.39900000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.94199999999999995},"last":0.54600000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575042,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302568,"kb_used_data":1376,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069272,"statfs":{"total":96636764160,"available":96326934528,"internally_reserved":0,"allocated":1409024,"data_stored":698021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.35999999999999999,"15min":0.36499999999999999},"min":{"1min":0.24299999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.498,"5min":0.54700000000000004,"15min":0.71199999999999997},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.374,"15min":0.38400000000000001},"min":{"1min":0.26900000000000002,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.55600000000000005,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.377,"15min":0.38600000000000001},"min":{"1min":0.26700000000000002,"5min":0.24399999999999999,"15min":0.23899999999999999},"max":{"1min":0.47499999999999998,"5min":0.58899999999999997,"15min":0.623},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.438,"15min":0.45700000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.57099999999999995,"5min":0.63400000000000001,"15min":0.70499999999999996},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.41099999999999998,"15min":0.42799999999999999},"min":{"1min":0.29199999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.53900000000000003,"5min":0.629,"15min":0.70999999999999996},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.42199999999999999,"15min":0.44},"min":{"1min":0.29699999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54600000000000004,"5min":0.64700000000000002,"15min":0.68799999999999994},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.58499999999999996,"15min":0.60199999999999998},"min":{"1min":0.34999999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.624,"5min":0.82599999999999996,"15min":0.96099999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.60699999999999998,"15min":0.61899999999999999},"min":{"1min":0.379,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76400000000000001,"5min":0.86899999999999999,"15min":0.98599999999999999},"last":0.503}]},{"osd":5,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.59399999999999997,"15min":0.60099999999999998},"min":{"1min":0.41199999999999998,"5min":0.39200000000000002,"15min":0.36199999999999999},"max":{"1min":0.72099999999999997,"5min":0.86799999999999999,"15min":1.0109999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.61199999999999999,"15min":0.626},"min":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.38},"max":{"1min":0.69199999999999995,"5min":0.90100000000000002,"15min":1.004},"last":0.54300000000000004}]},{"osd":6,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.625,"15min":0.64100000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.78700000000000003,"5min":0.89800000000000002,"15min":1.002},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.438,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.752,"5min":0.89300000000000002,"15min":0.96799999999999997},"last":0.53400000000000003}]},{"osd":7,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.63800000000000001,"15min":0.64900000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.68799999999999994,"5min":0.94499999999999995,"15min":1.0129999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.66900000000000004,"15min":0.68500000000000005},"min":{"1min":0.436,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.73299999999999998,"5min":0.93799999999999994,"15min":1.026},"last":0.46700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575042,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306644,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065196,"statfs":{"total":96636764160,"available":96322760704,"internally_reserved":0,"allocated":1388544,"data_stored":697183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.42699999999999999,"15min":0.40200000000000002},"min":{"1min":0.27700000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":3.4729999999999999,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.44700000000000001,"15min":0.437},"min":{"1min":0.312,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":0.38700000000000001}]},{"osd":1,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.51300000000000001,"15min":0.46300000000000002},"min":{"1min":0.28699999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":6.1210000000000004,"5min":6.1210000000000004,"15min":6.1210000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.52900000000000003,"15min":0.48899999999999999},"min":{"1min":0.34999999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":5.7270000000000003,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.441}]},{"osd":3,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38600000000000001,"15min":0.40000000000000002},"min":{"1min":0.27800000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.48799999999999999,"5min":0.63500000000000001,"15min":0.86199999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47299999999999998,"15min":0.46700000000000003},"min":{"1min":0.29699999999999999,"5min":0.26900000000000002,"15min":0.26200000000000001},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.69699999999999995,"15min":0.64200000000000002},"min":{"1min":0.432,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":8.7170000000000005,"5min":8.7170000000000005,"15min":8.7170000000000005},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.381,"5min":1.492,"15min":1.492},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.65600000000000003,"15min":0.63900000000000001},"min":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.44400000000000001,"5min":0.38900000000000001,"15min":0.38100000000000001},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.70599999999999996}]},{"osd":6,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61399999999999999,"15min":0.623},"min":{"1min":0.40899999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95999999999999996,"5min":1.359,"15min":1.359},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":0.82399999999999995}]},{"osd":7,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.70699999999999996,"15min":0.68300000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.40300000000000002},"max":{"1min":4.6849999999999996,"5min":4.6849999999999996,"15min":4.6849999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.70099999999999996,"15min":0.69099999999999995},"min":{"1min":0.45700000000000002,"5min":0.433,"15min":0.41499999999999998},"max":{"1min":4.5039999999999996,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.80200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575042,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306652,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065188,"statfs":{"total":96636764160,"available":96322752512,"internally_reserved":0,"allocated":1396736,"data_stored":698145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.34799999999999998,"15min":0.36399999999999999},"min":{"1min":0.222,"5min":0.219,"15min":0.217},"max":{"1min":0.46600000000000003,"5min":0.56599999999999995,"15min":0.66200000000000003},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.39500000000000002,"15min":0.40200000000000002},"min":{"1min":0.26700000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.48699999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.37,"15min":0.38600000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.51500000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.40999999999999998,"15min":0.42999999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.25900000000000001},"max":{"1min":0.59699999999999998,"5min":0.65900000000000003,"15min":0.84399999999999997},"last":0.34000000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.435,"15min":0.45000000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.26000000000000001},"max":{"1min":0.61799999999999999,"5min":0.72999999999999998,"15min":0.94899999999999995},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.49399999999999999,"15min":0.50900000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67100000000000004,"5min":1.054,"15min":1.054},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58699999999999997,"15min":0.60599999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.755,"5min":0.91500000000000004,"15min":0.97599999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59599999999999997,"15min":0.61299999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.70399999999999996,"5min":0.86799999999999999,"15min":0.91400000000000003},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.58099999999999996,"15min":0.60999999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80200000000000005,"5min":0.85399999999999998,"15min":0.98399999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61899999999999999,"15min":0.63800000000000001},"min":{"1min":0.372,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77300000000000002,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61799999999999999,"15min":0.64400000000000002},"min":{"1min":0.39800000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79900000000000004,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.626,"15min":0.64700000000000002},"min":{"1min":0.45000000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78900000000000003,"5min":0.89500000000000002,"15min":1.0389999999999999},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.64000000000000001,"15min":0.66200000000000003},"min":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.39100000000000001},"max":{"1min":0.80200000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63700000000000001,"15min":0.66100000000000003},"min":{"1min":0.45800000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79000000000000004,"5min":0.98999999999999999,"15min":1.004},"last":0.67500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575041,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302500,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069340,"statfs":{"total":96636764160,"available":96327004160,"internally_reserved":0,"allocated":1339392,"data_stored":670288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.53100000000000003},"min":{"1min":0.32200000000000001,"5min":0.28299999999999997,"15min":0.27500000000000002},"max":{"1min":0.72299999999999998,"5min":0.752,"15min":0.80900000000000005},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.38900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.66500000000000004,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52100000000000002,"15min":0.54200000000000004},"min":{"1min":0.35699999999999998,"5min":0.26900000000000002,"15min":0.25800000000000001},"max":{"1min":0.67600000000000005,"5min":0.73799999999999999,"15min":0.79600000000000004},"last":0.373},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.41899999999999998,"5min":0.317,"15min":0.246},"max":{"1min":0.67800000000000005,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56100000000000005,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.376,"15min":0.27800000000000002},"max":{"1min":0.73799999999999999,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.59399999999999997},"min":{"1min":0.373,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77300000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.54800000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32900000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55600000000000005,"15min":0.57099999999999995},"min":{"1min":0.438,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.80600000000000005},"last":0.46700000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.44600000000000001,"15min":0.443},"min":{"1min":0.35299999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.73599999999999999,"5min":1.272,"15min":1.272},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.46700000000000003,"15min":0.46000000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29199999999999998},"max":{"1min":0.83399999999999996,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.39100000000000001}]},{"osd":6,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51200000000000001,"15min":0.503},"min":{"1min":0.34699999999999998,"5min":0.34399999999999997,"15min":0.314},"max":{"1min":0.997,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55500000000000005,"15min":0.53900000000000003},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.33800000000000002},"max":{"1min":0.86499999999999999,"5min":1.129,"15min":1.129},"last":0.54100000000000004}]},{"osd":7,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.29899999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.82199999999999995},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57699999999999996,"15min":0.57099999999999995},"min":{"1min":0.45400000000000001,"5min":0.38600000000000001,"15min":0.34599999999999997},"max":{"1min":0.91500000000000004,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.59699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575041,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302500,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069340,"statfs":{"total":96636764160,"available":96327004160,"internally_reserved":0,"allocated":1339392,"data_stored":670288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68500000000000005,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.502},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52400000000000002,"15min":0.53100000000000003},"min":{"1min":0.36599999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.69299999999999995,"5min":0.70299999999999996,"15min":0.81799999999999995},"last":0.38100000000000001}]},{"osd":1,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.38400000000000001,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.72399999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53300000000000003,"15min":0.54800000000000004},"min":{"1min":0.36799999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.77000000000000002},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58199999999999996,"15min":0.58899999999999997},"min":{"1min":0.44800000000000001,"5min":0.34399999999999997,"15min":0.30599999999999999},"max":{"1min":0.72499999999999998,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.437,"5min":0.378,"15min":0.34499999999999997},"max":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53700000000000003,"15min":0.54800000000000004},"min":{"1min":0.40799999999999997,"5min":0.36699999999999999,"15min":0.36399999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.73799999999999999},"last":0.433},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55400000000000005,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.82099999999999995},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.41999999999999998,"15min":0.439},"min":{"1min":0.28299999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.66700000000000004,"5min":0.72299999999999998,"15min":0.74299999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.45800000000000002,"15min":0.46600000000000003},"min":{"1min":0.30599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.628,"5min":0.69499999999999995,"15min":0.77600000000000002},"last":0.48799999999999999}]},{"osd":6,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.47399999999999998,"15min":0.48599999999999999},"min":{"1min":0.32200000000000001,"5min":0.29599999999999999,"15min":0.28499999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.82099999999999995},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54100000000000004,"15min":0.55000000000000004},"min":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.69699999999999995,"5min":0.79900000000000004,"15min":0.88200000000000001},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51700000000000002,"15min":0.52600000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.64900000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55900000000000005,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.84599999999999997},"last":0.58099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:23:36.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3f is not active+clean 2023-11-30T17:23:36.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:30.550477+0000', 'last_change': '2023-11-30T17:23:30.550477+0000', 'last_active': '2023-11-30T17:23:30.550477+0000', 'last_peered': '2023-11-30T17:23:30.550477+0000', 'last_clean': '2023-11-30T17:23:30.550477+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:30.550477+0000', 'last_undegraded': '2023-11-30T17:23:30.550477+0000', 'last_fullsized': '2023-11-30T17:23:30.550477+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3e is not active+clean 2023-11-30T17:23:36.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:31.552500+0000', 'last_change': '2023-11-30T17:23:31.552500+0000', 'last_active': '2023-11-30T17:23:31.552500+0000', 'last_peered': '2023-11-30T17:23:31.552500+0000', 'last_clean': '2023-11-30T17:23:31.552500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:31.552500+0000', 'last_undegraded': '2023-11-30T17:23:31.552500+0000', 'last_fullsized': '2023-11-30T17:23:31.552500+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3b is not active+clean 2023-11-30T17:23:36.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:30.550477+0000', 'last_change': '2023-11-30T17:23:30.550477+0000', 'last_active': '2023-11-30T17:23:30.550477+0000', 'last_peered': '2023-11-30T17:23:30.550477+0000', 'last_clean': '2023-11-30T17:23:30.550477+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:30.550477+0000', 'last_undegraded': '2023-11-30T17:23:30.550477+0000', 'last_fullsized': '2023-11-30T17:23:30.550477+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3a is not active+clean 2023-11-30T17:23:36.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:30.550477+0000', 'last_change': '2023-11-30T17:23:30.550477+0000', 'last_active': '2023-11-30T17:23:30.550477+0000', 'last_peered': '2023-11-30T17:23:30.550477+0000', 'last_clean': '2023-11-30T17:23:30.550477+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:30.550477+0000', 'last_undegraded': '2023-11-30T17:23:30.550477+0000', 'last_fullsized': '2023-11-30T17:23:30.550477+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3b is not active+clean 2023-11-30T17:23:36.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:31.552500+0000', 'last_change': '2023-11-30T17:23:31.552500+0000', 'last_active': '2023-11-30T17:23:31.552500+0000', 'last_peered': '2023-11-30T17:23:31.552500+0000', 'last_clean': '2023-11-30T17:23:31.552500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:31.552500+0000', 'last_undegraded': '2023-11-30T17:23:31.552500+0000', 'last_fullsized': '2023-11-30T17:23:31.552500+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.38 is not active+clean 2023-11-30T17:23:36.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:30.550477+0000', 'last_change': '2023-11-30T17:23:30.550477+0000', 'last_active': '2023-11-30T17:23:30.550477+0000', 'last_peered': '2023-11-30T17:23:30.550477+0000', 'last_clean': '2023-11-30T17:23:30.550477+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:30.550477+0000', 'last_undegraded': '2023-11-30T17:23:30.550477+0000', 'last_fullsized': '2023-11-30T17:23:30.550477+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.37 is not active+clean 2023-11-30T17:23:36.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:30.550477+0000', 'last_change': '2023-11-30T17:23:30.550477+0000', 'last_active': '2023-11-30T17:23:30.550477+0000', 'last_peered': '2023-11-30T17:23:30.550477+0000', 'last_clean': '2023-11-30T17:23:30.550477+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:30.550477+0000', 'last_undegraded': '2023-11-30T17:23:30.550477+0000', 'last_fullsized': '2023-11-30T17:23:30.550477+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.35 is not active+clean 2023-11-30T17:23:36.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:31.552500+0000', 'last_change': '2023-11-30T17:23:31.552500+0000', 'last_active': '2023-11-30T17:23:31.552500+0000', 'last_peered': '2023-11-30T17:23:31.552500+0000', 'last_clean': '2023-11-30T17:23:31.552500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:31.552500+0000', 'last_undegraded': '2023-11-30T17:23:31.552500+0000', 'last_fullsized': '2023-11-30T17:23:31.552500+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.36 is not active+clean 2023-11-30T17:23:36.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:30.550477+0000', 'last_change': '2023-11-30T17:23:30.550477+0000', 'last_active': '2023-11-30T17:23:30.550477+0000', 'last_peered': '2023-11-30T17:23:30.550477+0000', 'last_clean': '2023-11-30T17:23:30.550477+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:30.550477+0000', 'last_undegraded': '2023-11-30T17:23:30.550477+0000', 'last_fullsized': '2023-11-30T17:23:30.550477+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.37 is not active+clean 2023-11-30T17:23:36.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:31.552500+0000', 'last_change': '2023-11-30T17:23:31.552500+0000', 'last_active': '2023-11-30T17:23:31.552500+0000', 'last_peered': '2023-11-30T17:23:31.552500+0000', 'last_clean': '2023-11-30T17:23:31.552500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:31.552500+0000', 'last_undegraded': '2023-11-30T17:23:31.552500+0000', 'last_fullsized': '2023-11-30T17:23:31.552500+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.34 is not active+clean 2023-11-30T17:23:36.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:30.550477+0000', 'last_change': '2023-11-30T17:23:30.550477+0000', 'last_active': '2023-11-30T17:23:30.550477+0000', 'last_peered': '2023-11-30T17:23:30.550477+0000', 'last_clean': '2023-11-30T17:23:30.550477+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:30.550477+0000', 'last_undegraded': '2023-11-30T17:23:30.550477+0000', 'last_fullsized': '2023-11-30T17:23:30.550477+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.32 is not active+clean 2023-11-30T17:23:36.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:31.552500+0000', 'last_change': '2023-11-30T17:23:31.552500+0000', 'last_active': '2023-11-30T17:23:31.552500+0000', 'last_peered': '2023-11-30T17:23:31.552500+0000', 'last_clean': '2023-11-30T17:23:31.552500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:31.552500+0000', 'last_undegraded': '2023-11-30T17:23:31.552500+0000', 'last_fullsized': '2023-11-30T17:23:31.552500+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.30 is not active+clean 2023-11-30T17:23:36.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:30.550477+0000', 'last_change': '2023-11-30T17:23:30.550477+0000', 'last_active': '2023-11-30T17:23:30.550477+0000', 'last_peered': '2023-11-30T17:23:30.550477+0000', 'last_clean': '2023-11-30T17:23:30.550477+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:30.550477+0000', 'last_undegraded': '2023-11-30T17:23:30.550477+0000', 'last_fullsized': '2023-11-30T17:23:30.550477+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2f is not active+clean 2023-11-30T17:23:36.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:30.550477+0000', 'last_change': '2023-11-30T17:23:30.550477+0000', 'last_active': '2023-11-30T17:23:30.550477+0000', 'last_peered': '2023-11-30T17:23:30.550477+0000', 'last_clean': '2023-11-30T17:23:30.550477+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:30.550477+0000', 'last_undegraded': '2023-11-30T17:23:30.550477+0000', 'last_fullsized': '2023-11-30T17:23:30.550477+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2d is not active+clean 2023-11-30T17:23:36.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:31.552500+0000', 'last_change': '2023-11-30T17:23:31.552500+0000', 'last_active': '2023-11-30T17:23:31.552500+0000', 'last_peered': '2023-11-30T17:23:31.552500+0000', 'last_clean': '2023-11-30T17:23:31.552500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:31.552500+0000', 'last_undegraded': '2023-11-30T17:23:31.552500+0000', 'last_fullsized': '2023-11-30T17:23:31.552500+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.29 is not active+clean 2023-11-30T17:23:36.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:31.552500+0000', 'last_change': '2023-11-30T17:23:31.552500+0000', 'last_active': '2023-11-30T17:23:31.552500+0000', 'last_peered': '2023-11-30T17:23:31.552500+0000', 'last_clean': '2023-11-30T17:23:31.552500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:31.552500+0000', 'last_undegraded': '2023-11-30T17:23:31.552500+0000', 'last_fullsized': '2023-11-30T17:23:31.552500+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2a is not active+clean 2023-11-30T17:23:36.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:31.552500+0000', 'last_change': '2023-11-30T17:23:31.552500+0000', 'last_active': '2023-11-30T17:23:31.552500+0000', 'last_peered': '2023-11-30T17:23:31.552500+0000', 'last_clean': '2023-11-30T17:23:31.552500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:31.552500+0000', 'last_undegraded': '2023-11-30T17:23:31.552500+0000', 'last_fullsized': '2023-11-30T17:23:31.552500+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.29 is not active+clean 2023-11-30T17:23:36.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:30.550477+0000', 'last_change': '2023-11-30T17:23:30.550477+0000', 'last_active': '2023-11-30T17:23:30.550477+0000', 'last_peered': '2023-11-30T17:23:30.550477+0000', 'last_clean': '2023-11-30T17:23:30.550477+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:30.550477+0000', 'last_undegraded': '2023-11-30T17:23:30.550477+0000', 'last_fullsized': '2023-11-30T17:23:30.550477+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2b is not active+clean 2023-11-30T17:23:36.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:31.552500+0000', 'last_change': '2023-11-30T17:23:31.552500+0000', 'last_active': '2023-11-30T17:23:31.552500+0000', 'last_peered': '2023-11-30T17:23:31.552500+0000', 'last_clean': '2023-11-30T17:23:31.552500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:31.552500+0000', 'last_undegraded': '2023-11-30T17:23:31.552500+0000', 'last_fullsized': '2023-11-30T17:23:31.552500+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.26 is not active+clean 2023-11-30T17:23:36.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:31.552500+0000', 'last_change': '2023-11-30T17:23:31.552500+0000', 'last_active': '2023-11-30T17:23:31.552500+0000', 'last_peered': '2023-11-30T17:23:31.552500+0000', 'last_clean': '2023-11-30T17:23:31.552500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:31.552500+0000', 'last_undegraded': '2023-11-30T17:23:31.552500+0000', 'last_fullsized': '2023-11-30T17:23:31.552500+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.25 is not active+clean 2023-11-30T17:23:36.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:30.550477+0000', 'last_change': '2023-11-30T17:23:30.550477+0000', 'last_active': '2023-11-30T17:23:30.550477+0000', 'last_peered': '2023-11-30T17:23:30.550477+0000', 'last_clean': '2023-11-30T17:23:30.550477+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:30.550477+0000', 'last_undegraded': '2023-11-30T17:23:30.550477+0000', 'last_fullsized': '2023-11-30T17:23:30.550477+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.27 is not active+clean 2023-11-30T17:23:36.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:31.552500+0000', 'last_change': '2023-11-30T17:23:31.552500+0000', 'last_active': '2023-11-30T17:23:31.552500+0000', 'last_peered': '2023-11-30T17:23:31.552500+0000', 'last_clean': '2023-11-30T17:23:31.552500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:31.552500+0000', 'last_undegraded': '2023-11-30T17:23:31.552500+0000', 'last_fullsized': '2023-11-30T17:23:31.552500+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.24 is not active+clean 2023-11-30T17:23:36.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:30.550477+0000', 'last_change': '2023-11-30T17:23:30.550477+0000', 'last_active': '2023-11-30T17:23:30.550477+0000', 'last_peered': '2023-11-30T17:23:30.550477+0000', 'last_clean': '2023-11-30T17:23:30.550477+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:30.550477+0000', 'last_undegraded': '2023-11-30T17:23:30.550477+0000', 'last_fullsized': '2023-11-30T17:23:30.550477+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.21 is not active+clean 2023-11-30T17:23:36.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:31.552500+0000', 'last_change': '2023-11-30T17:23:31.552500+0000', 'last_active': '2023-11-30T17:23:31.552500+0000', 'last_peered': '2023-11-30T17:23:31.552500+0000', 'last_clean': '2023-11-30T17:23:31.552500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:31.552500+0000', 'last_undegraded': '2023-11-30T17:23:31.552500+0000', 'last_fullsized': '2023-11-30T17:23:31.552500+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.22 is not active+clean 2023-11-30T17:23:36.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:31.552500+0000', 'last_change': '2023-11-30T17:23:31.552500+0000', 'last_active': '2023-11-30T17:23:31.552500+0000', 'last_peered': '2023-11-30T17:23:31.552500+0000', 'last_clean': '2023-11-30T17:23:31.552500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:31.552500+0000', 'last_undegraded': '2023-11-30T17:23:31.552500+0000', 'last_fullsized': '2023-11-30T17:23:31.552500+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.21 is not active+clean 2023-11-30T17:23:36.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:30.550477+0000', 'last_change': '2023-11-30T17:23:30.550477+0000', 'last_active': '2023-11-30T17:23:30.550477+0000', 'last_peered': '2023-11-30T17:23:30.550477+0000', 'last_clean': '2023-11-30T17:23:30.550477+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:30.550477+0000', 'last_undegraded': '2023-11-30T17:23:30.550477+0000', 'last_fullsized': '2023-11-30T17:23:30.550477+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.20 is not active+clean 2023-11-30T17:23:36.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:30.550477+0000', 'last_change': '2023-11-30T17:23:30.550477+0000', 'last_active': '2023-11-30T17:23:30.550477+0000', 'last_peered': '2023-11-30T17:23:30.550477+0000', 'last_clean': '2023-11-30T17:23:30.550477+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:30.550477+0000', 'last_undegraded': '2023-11-30T17:23:30.550477+0000', 'last_fullsized': '2023-11-30T17:23:30.550477+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1f is not active+clean 2023-11-30T17:23:36.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:30.550477+0000', 'last_change': '2023-11-30T17:23:30.550477+0000', 'last_active': '2023-11-30T17:23:30.550477+0000', 'last_peered': '2023-11-30T17:23:30.550477+0000', 'last_clean': '2023-11-30T17:23:30.550477+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:30.550477+0000', 'last_undegraded': '2023-11-30T17:23:30.550477+0000', 'last_fullsized': '2023-11-30T17:23:30.550477+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1e is not active+clean 2023-11-30T17:23:36.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:30.550477+0000', 'last_change': '2023-11-30T17:23:30.550477+0000', 'last_active': '2023-11-30T17:23:30.550477+0000', 'last_peered': '2023-11-30T17:23:30.550477+0000', 'last_clean': '2023-11-30T17:23:30.550477+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:30.550477+0000', 'last_undegraded': '2023-11-30T17:23:30.550477+0000', 'last_fullsized': '2023-11-30T17:23:30.550477+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1c is not active+clean 2023-11-30T17:23:36.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:30.550477+0000', 'last_change': '2023-11-30T17:23:30.550477+0000', 'last_active': '2023-11-30T17:23:30.550477+0000', 'last_peered': '2023-11-30T17:23:30.550477+0000', 'last_clean': '2023-11-30T17:23:30.550477+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:30.550477+0000', 'last_undegraded': '2023-11-30T17:23:30.550477+0000', 'last_fullsized': '2023-11-30T17:23:30.550477+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1b is not active+clean 2023-11-30T17:23:36.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:30.550477+0000', 'last_change': '2023-11-30T17:23:30.550477+0000', 'last_active': '2023-11-30T17:23:30.550477+0000', 'last_peered': '2023-11-30T17:23:30.550477+0000', 'last_clean': '2023-11-30T17:23:30.550477+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:30.550477+0000', 'last_undegraded': '2023-11-30T17:23:30.550477+0000', 'last_fullsized': '2023-11-30T17:23:30.550477+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.19 is not active+clean 2023-11-30T17:23:36.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:31.552500+0000', 'last_change': '2023-11-30T17:23:31.552500+0000', 'last_active': '2023-11-30T17:23:31.552500+0000', 'last_peered': '2023-11-30T17:23:31.552500+0000', 'last_clean': '2023-11-30T17:23:31.552500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:31.552500+0000', 'last_undegraded': '2023-11-30T17:23:31.552500+0000', 'last_fullsized': '2023-11-30T17:23:31.552500+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.14 is not active+clean 2023-11-30T17:23:36.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:31.552500+0000', 'last_change': '2023-11-30T17:23:31.552500+0000', 'last_active': '2023-11-30T17:23:31.552500+0000', 'last_peered': '2023-11-30T17:23:31.552500+0000', 'last_clean': '2023-11-30T17:23:31.552500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:31.552500+0000', 'last_undegraded': '2023-11-30T17:23:31.552500+0000', 'last_fullsized': '2023-11-30T17:23:31.552500+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.17 is not active+clean 2023-11-30T17:23:36.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:30.550477+0000', 'last_change': '2023-11-30T17:23:30.550477+0000', 'last_active': '2023-11-30T17:23:30.550477+0000', 'last_peered': '2023-11-30T17:23:30.550477+0000', 'last_clean': '2023-11-30T17:23:30.550477+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:30.550477+0000', 'last_undegraded': '2023-11-30T17:23:30.550477+0000', 'last_fullsized': '2023-11-30T17:23:30.550477+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.15 is not active+clean 2023-11-30T17:23:36.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:30.550477+0000', 'last_change': '2023-11-30T17:23:30.550477+0000', 'last_active': '2023-11-30T17:23:30.550477+0000', 'last_peered': '2023-11-30T17:23:30.550477+0000', 'last_clean': '2023-11-30T17:23:30.550477+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:30.550477+0000', 'last_undegraded': '2023-11-30T17:23:30.550477+0000', 'last_fullsized': '2023-11-30T17:23:30.550477+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.11 is not active+clean 2023-11-30T17:23:36.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:31.552500+0000', 'last_change': '2023-11-30T17:23:31.552500+0000', 'last_active': '2023-11-30T17:23:31.552500+0000', 'last_peered': '2023-11-30T17:23:31.552500+0000', 'last_clean': '2023-11-30T17:23:31.552500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:31.552500+0000', 'last_undegraded': '2023-11-30T17:23:31.552500+0000', 'last_fullsized': '2023-11-30T17:23:31.552500+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.4 is not active+clean 2023-11-30T17:23:36.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:31.552500+0000', 'last_change': '2023-11-30T17:23:31.552500+0000', 'last_active': '2023-11-30T17:23:31.552500+0000', 'last_peered': '2023-11-30T17:23:31.552500+0000', 'last_clean': '2023-11-30T17:23:31.552500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:31.552500+0000', 'last_undegraded': '2023-11-30T17:23:31.552500+0000', 'last_fullsized': '2023-11-30T17:23:31.552500+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.6 is not active+clean 2023-11-30T17:23:36.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:30.550477+0000', 'last_change': '2023-11-30T17:23:30.550477+0000', 'last_active': '2023-11-30T17:23:30.550477+0000', 'last_peered': '2023-11-30T17:23:30.550477+0000', 'last_clean': '2023-11-30T17:23:30.550477+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:30.550477+0000', 'last_undegraded': '2023-11-30T17:23:30.550477+0000', 'last_fullsized': '2023-11-30T17:23:30.550477+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.5 is not active+clean 2023-11-30T17:23:36.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:30.550477+0000', 'last_change': '2023-11-30T17:23:30.550477+0000', 'last_active': '2023-11-30T17:23:30.550477+0000', 'last_peered': '2023-11-30T17:23:30.550477+0000', 'last_clean': '2023-11-30T17:23:30.550477+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:30.550477+0000', 'last_undegraded': '2023-11-30T17:23:30.550477+0000', 'last_fullsized': '2023-11-30T17:23:30.550477+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.7 is not active+clean 2023-11-30T17:23:36.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:31.552500+0000', 'last_change': '2023-11-30T17:23:31.552500+0000', 'last_active': '2023-11-30T17:23:31.552500+0000', 'last_peered': '2023-11-30T17:23:31.552500+0000', 'last_clean': '2023-11-30T17:23:31.552500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:31.552500+0000', 'last_undegraded': '2023-11-30T17:23:31.552500+0000', 'last_fullsized': '2023-11-30T17:23:31.552500+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.4 is not active+clean 2023-11-30T17:23:36.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:30.550477+0000', 'last_change': '2023-11-30T17:23:30.550477+0000', 'last_active': '2023-11-30T17:23:30.550477+0000', 'last_peered': '2023-11-30T17:23:30.550477+0000', 'last_clean': '2023-11-30T17:23:30.550477+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:30.550477+0000', 'last_undegraded': '2023-11-30T17:23:30.550477+0000', 'last_fullsized': '2023-11-30T17:23:30.550477+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2 is not active+clean 2023-11-30T17:23:36.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:30.550477+0000', 'last_change': '2023-11-30T17:23:30.550477+0000', 'last_active': '2023-11-30T17:23:30.550477+0000', 'last_peered': '2023-11-30T17:23:30.550477+0000', 'last_clean': '2023-11-30T17:23:30.550477+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:30.550477+0000', 'last_undegraded': '2023-11-30T17:23:30.550477+0000', 'last_fullsized': '2023-11-30T17:23:30.550477+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2 is not active+clean 2023-11-30T17:23:36.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:31.552500+0000', 'last_change': '2023-11-30T17:23:31.552500+0000', 'last_active': '2023-11-30T17:23:31.552500+0000', 'last_peered': '2023-11-30T17:23:31.552500+0000', 'last_clean': '2023-11-30T17:23:31.552500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:31.552500+0000', 'last_undegraded': '2023-11-30T17:23:31.552500+0000', 'last_fullsized': '2023-11-30T17:23:31.552500+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1 is not active+clean 2023-11-30T17:23:36.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:30.550477+0000', 'last_change': '2023-11-30T17:23:30.550477+0000', 'last_active': '2023-11-30T17:23:30.550477+0000', 'last_peered': '2023-11-30T17:23:30.550477+0000', 'last_clean': '2023-11-30T17:23:30.550477+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:30.550477+0000', 'last_undegraded': '2023-11-30T17:23:30.550477+0000', 'last_fullsized': '2023-11-30T17:23:30.550477+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.b is not active+clean 2023-11-30T17:23:36.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:30.550477+0000', 'last_change': '2023-11-30T17:23:30.550477+0000', 'last_active': '2023-11-30T17:23:30.550477+0000', 'last_peered': '2023-11-30T17:23:30.550477+0000', 'last_clean': '2023-11-30T17:23:30.550477+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:30.550477+0000', 'last_undegraded': '2023-11-30T17:23:30.550477+0000', 'last_fullsized': '2023-11-30T17:23:30.550477+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.e is not active+clean 2023-11-30T17:23:36.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:31.552500+0000', 'last_change': '2023-11-30T17:23:31.552500+0000', 'last_active': '2023-11-30T17:23:31.552500+0000', 'last_peered': '2023-11-30T17:23:31.552500+0000', 'last_clean': '2023-11-30T17:23:31.552500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:31.552500+0000', 'last_undegraded': '2023-11-30T17:23:31.552500+0000', 'last_fullsized': '2023-11-30T17:23:31.552500+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.d is not active+clean 2023-11-30T17:23:36.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:30.550477+0000', 'last_change': '2023-11-30T17:23:30.550477+0000', 'last_active': '2023-11-30T17:23:30.550477+0000', 'last_peered': '2023-11-30T17:23:30.550477+0000', 'last_clean': '2023-11-30T17:23:30.550477+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:30.550477+0000', 'last_undegraded': '2023-11-30T17:23:30.550477+0000', 'last_fullsized': '2023-11-30T17:23:30.550477+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.d is not active+clean 2023-11-30T17:23:36.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:31.552500+0000', 'last_change': '2023-11-30T17:23:31.552500+0000', 'last_active': '2023-11-30T17:23:31.552500+0000', 'last_peered': '2023-11-30T17:23:31.552500+0000', 'last_clean': '2023-11-30T17:23:31.552500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:31.552500+0000', 'last_undegraded': '2023-11-30T17:23:31.552500+0000', 'last_fullsized': '2023-11-30T17:23:31.552500+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.f is not active+clean 2023-11-30T17:23:36.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:30.550477+0000', 'last_change': '2023-11-30T17:23:30.550477+0000', 'last_active': '2023-11-30T17:23:30.550477+0000', 'last_peered': '2023-11-30T17:23:30.550477+0000', 'last_clean': '2023-11-30T17:23:30.550477+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:30.550477+0000', 'last_undegraded': '2023-11-30T17:23:30.550477+0000', 'last_fullsized': '2023-11-30T17:23:30.550477+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.9 is not active+clean 2023-11-30T17:23:36.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:31.552500+0000', 'last_change': '2023-11-30T17:23:31.552500+0000', 'last_active': '2023-11-30T17:23:31.552500+0000', 'last_peered': '2023-11-30T17:23:31.552500+0000', 'last_clean': '2023-11-30T17:23:31.552500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:31.552500+0000', 'last_undegraded': '2023-11-30T17:23:31.552500+0000', 'last_fullsized': '2023-11-30T17:23:31.552500+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.a is not active+clean 2023-11-30T17:23:36.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:31.552500+0000', 'last_change': '2023-11-30T17:23:31.552500+0000', 'last_active': '2023-11-30T17:23:31.552500+0000', 'last_peered': '2023-11-30T17:23:31.552500+0000', 'last_clean': '2023-11-30T17:23:31.552500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:31.552500+0000', 'last_undegraded': '2023-11-30T17:23:31.552500+0000', 'last_fullsized': '2023-11-30T17:23:31.552500+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:31.552500+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.9 is not active+clean 2023-11-30T17:23:36.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T17:23:30.550477+0000', 'last_change': '2023-11-30T17:23:30.550477+0000', 'last_active': '2023-11-30T17:23:30.550477+0000', 'last_peered': '2023-11-30T17:23:30.550477+0000', 'last_clean': '2023-11-30T17:23:30.550477+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T17:23:30.550477+0000', 'last_undegraded': '2023-11-30T17:23:30.550477+0000', 'last_fullsized': '2023-11-30T17:23:30.550477+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'last_clean_scrub_stamp': '2023-11-30T17:23:30.550477+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T17:23:36.716 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-30T17:23:36.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.854+0000 7fce8c186700 1 Processor -- start 2023-11-30T17:23:36.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.855+0000 7fce8c186700 1 -- start start 2023-11-30T17:23:36.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.855+0000 7fce8c186700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fce840caab0 0x7fce840aa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:36.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.855+0000 7fce8c186700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce840a9a90 con 0x7fce840cae90 2023-11-30T17:23:36.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.855+0000 7fce8c186700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce84154ce0 con 0x7fce840ca180 2023-11-30T17:23:36.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.855+0000 7fce8c186700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce840a8e80 con 0x7fce840caab0 2023-11-30T17:23:36.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.856+0000 7fce89721700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fce840cae90 0x7fce840c0ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48094/0 (socket says 172.21.15.49:48094) 2023-11-30T17:23:36.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.856+0000 7fce89721700 1 -- 172.21.15.49:0/1635391268 learned_addr learned my addr 172.21.15.49:0/1635391268 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:36.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.856+0000 7fce89f22700 1 --2- 172.21.15.49:0/1635391268 >> v2:172.21.15.115:3300/0 conn(0x7fce840caab0 0x7fce840aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.856+0000 7fce88f20700 1 -- 172.21.15.49:0/1635391268 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4070142844 0 0) 0x7fce840a9a90 con 0x7fce840cae90 2023-11-30T17:23:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.856+0000 7fce88f20700 1 -- 172.21.15.49:0/1635391268 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce6c0033f0 con 0x7fce840cae90 2023-11-30T17:23:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.856+0000 7fce88f20700 1 -- 172.21.15.49:0/1635391268 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1129434875 0 0) 0x7fce6c0033f0 con 0x7fce840cae90 2023-11-30T17:23:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.856+0000 7fce88f20700 1 -- 172.21.15.49:0/1635391268 >> v2:172.21.15.115:3300/0 conn(0x7fce840caab0 msgr2=0x7fce840aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.856+0000 7fce88f20700 1 --2- 172.21.15.49:0/1635391268 >> v2:172.21.15.115:3300/0 conn(0x7fce840caab0 0x7fce840aa470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.856+0000 7fce88f20700 1 -- 172.21.15.49:0/1635391268 >> v1:172.21.15.115:6789/0 conn(0x7fce840ca180 legacy=0x7fce8415e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:36.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.856+0000 7fce88f20700 1 -- 172.21.15.49:0/1635391268 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce840a9160 con 0x7fce840cae90 2023-11-30T17:23:36.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.856+0000 7fce88f20700 1 -- 172.21.15.49:0/1635391268 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fce78001470 con 0x7fce840cae90 2023-11-30T17:23:36.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.856+0000 7fce88f20700 1 -- 172.21.15.49:0/1635391268 >> v1:172.21.15.49:6789/0 conn(0x7fce840cae90 legacy=0x7fce840c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:36.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.856+0000 7fce88f20700 1 --2- 172.21.15.49:0/1635391268 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce6c0038e0 0x7fce6c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:36.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.856+0000 7fce88f20700 1 --2- 172.21.15.49:0/1635391268 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce6c004690 0x7fce6c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:36.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.856+0000 7fce88f20700 1 --2- 172.21.15.49:0/1635391268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce6c005000 0x7fce6c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:36.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.856+0000 7fce88f20700 1 -- 172.21.15.49:0/1635391268 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce840a8e80 con 0x7fce6c005000 2023-11-30T17:23:36.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.856+0000 7fce88f20700 1 -- 172.21.15.49:0/1635391268 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c00bf60 con 0x7fce6c0038e0 2023-11-30T17:23:36.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.856+0000 7fce88f20700 1 -- 172.21.15.49:0/1635391268 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c00c0f0 con 0x7fce6c004690 2023-11-30T17:23:36.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.856+0000 7fce8a723700 1 --2- 172.21.15.49:0/1635391268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce6c005000 0x7fce6c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:36.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.856+0000 7fce89f22700 1 --2- 172.21.15.49:0/1635391268 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce6c0038e0 0x7fce6c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:36.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.856+0000 7fce89721700 1 --2- 172.21.15.49:0/1635391268 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce6c004690 0x7fce6c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:36.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.857+0000 7fce89f22700 1 -- 172.21.15.49:0/1635391268 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce6c004690 msgr2=0x7fce6c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:36.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.857+0000 7fce89f22700 1 --2- 172.21.15.49:0/1635391268 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce6c004690 0x7fce6c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:36.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.857+0000 7fce89f22700 1 -- 172.21.15.49:0/1635391268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce6c005000 msgr2=0x7fce6c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:36.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.857+0000 7fce89f22700 1 --2- 172.21.15.49:0/1635391268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce6c005000 0x7fce6c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:36.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.857+0000 7fce89f22700 1 -- 172.21.15.49:0/1635391268 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6c0033f0 con 0x7fce6c0038e0 2023-11-30T17:23:36.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.857+0000 7fce8a723700 1 --2- 172.21.15.49:0/1635391268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce6c005000 0x7fce6c00b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:23:36.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.857+0000 7fce8a723700 1 -- 172.21.15.49:0/1635391268 reap_dead start 2023-11-30T17:23:36.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.857+0000 7fce89f22700 1 --2- 172.21.15.49:0/1635391268 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce6c0038e0 0x7fce6c003d00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fce7c00e210 tx=0x7fce7c00b040).ready entity=mon.1 client_cookie=bea10bc3839541bd server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:36.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.857+0000 7fce88f20700 1 -- 172.21.15.49:0/1635391268 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7c009b10 con 0x7fce6c0038e0 2023-11-30T17:23:36.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.857+0000 7fce88f20700 1 -- 172.21.15.49:0/1635391268 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7c00f040 con 0x7fce6c0038e0 2023-11-30T17:23:36.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.857+0000 7fce88f20700 1 -- 172.21.15.49:0/1635391268 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7c00ece0 con 0x7fce6c0038e0 2023-11-30T17:23:36.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.857+0000 7fce8c186700 1 -- 172.21.15.49:0/1635391268 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce6c0038e0 msgr2=0x7fce6c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:36.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.857+0000 7fce8c186700 1 --2- 172.21.15.49:0/1635391268 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce6c0038e0 0x7fce6c003d00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fce7c00e210 tx=0x7fce7c00b040).stop 2023-11-30T17:23:36.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.857+0000 7fce8c186700 1 -- 172.21.15.49:0/1635391268 shutdown_connections 2023-11-30T17:23:36.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.857+0000 7fce8c186700 1 --2- 172.21.15.49:0/1635391268 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce6c0038e0 0x7fce6c003d00 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:36.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.857+0000 7fce8c186700 1 -- 172.21.15.49:0/1635391268 >> 172.21.15.49:0/1635391268 conn(0x7fce84094920 msgr2=0x7fce8406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:36.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.858+0000 7fce8c186700 1 -- 172.21.15.49:0/1635391268 shutdown_connections 2023-11-30T17:23:36.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.858+0000 7fce8c186700 1 -- 172.21.15.49:0/1635391268 wait complete. 2023-11-30T17:23:36.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.859+0000 7fce8c186700 1 Processor -- start 2023-11-30T17:23:36.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.859+0000 7fce8c186700 1 -- start start 2023-11-30T17:23:36.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.859+0000 7fce8c186700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce6c0038e0 0x7fce84163cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:36.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.859+0000 7fce8c186700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce840c4ef0 0x7fce840c5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:36.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.859+0000 7fce8c186700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce840afb40 0x7fce840affc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:36.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.859+0000 7fce8c186700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce840c5860 con 0x7fce840afb40 2023-11-30T17:23:36.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.859+0000 7fce8c186700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce840ab970 con 0x7fce6c0038e0 2023-11-30T17:23:36.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.859+0000 7fce8c186700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce840b04b0 con 0x7fce840c4ef0 2023-11-30T17:23:36.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.860+0000 7fce8a723700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce840afb40 0x7fce840affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:36.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.860+0000 7fce8a723700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce840afb40 0x7fce840affc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35392/0 (socket says 172.21.15.49:35392) 2023-11-30T17:23:36.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.860+0000 7fce8a723700 1 -- 172.21.15.49:0/3137201509 learned_addr learned my addr 172.21.15.49:0/3137201509 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:36.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.860+0000 7fce8a723700 1 -- 172.21.15.49:0/3137201509 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce840c4ef0 msgr2=0x7fce840c5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:36.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.860+0000 7fce89721700 1 --2- 172.21.15.49:0/3137201509 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce840c4ef0 0x7fce840c5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:36.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.860+0000 7fce89f22700 1 --2- 172.21.15.49:0/3137201509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce6c0038e0 0x7fce84163cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:36.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.860+0000 7fce8a723700 1 --2- 172.21.15.49:0/3137201509 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce840c4ef0 0x7fce840c5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:36.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.860+0000 7fce8a723700 1 -- 172.21.15.49:0/3137201509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce6c0038e0 msgr2=0x7fce84163cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:36.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.860+0000 7fce8a723700 1 --2- 172.21.15.49:0/3137201509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce6c0038e0 0x7fce84163cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:36.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.860+0000 7fce8a723700 1 -- 172.21.15.49:0/3137201509 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce841641c0 con 0x7fce840afb40 2023-11-30T17:23:36.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.860+0000 7fce8a723700 1 --2- 172.21.15.49:0/3137201509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce840afb40 0x7fce840affc0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7fce840c1c40 tx=0x7fce74009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:36.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.860+0000 7fce81ffb700 1 -- 172.21.15.49:0/3137201509 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce740114c0 con 0x7fce840afb40 2023-11-30T17:23:36.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.860+0000 7fce81ffb700 1 -- 172.21.15.49:0/3137201509 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce74011620 con 0x7fce840afb40 2023-11-30T17:23:36.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.860+0000 7fce8c186700 1 -- 172.21.15.49:0/3137201509 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce840aad60 con 0x7fce840afb40 2023-11-30T17:23:36.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.860+0000 7fce81ffb700 1 -- 172.21.15.49:0/3137201509 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce740119a0 con 0x7fce840afb40 2023-11-30T17:23:36.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.860+0000 7fce8c186700 1 -- 172.21.15.49:0/3137201509 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce840ab320 con 0x7fce840afb40 2023-11-30T17:23:36.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.861+0000 7fce8c186700 1 -- 172.21.15.49:0/3137201509 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce840abb00 con 0x7fce840afb40 2023-11-30T17:23:36.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.861+0000 7fce81ffb700 1 -- 172.21.15.49:0/3137201509 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fce740133f0 con 0x7fce840afb40 2023-11-30T17:23:36.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.862+0000 7fce81ffb700 1 --2- 172.21.15.49:0/3137201509 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fce7005f270 0x7fce70061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:36.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.862+0000 7fce81ffb700 1 -- 172.21.15.49:0/3137201509 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fce740799c0 con 0x7fce840afb40 2023-11-30T17:23:36.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.862+0000 7fce89f22700 1 --2- 172.21.15.49:0/3137201509 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fce7005f270 0x7fce70061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:36.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.862+0000 7fce89f22700 1 --2- 172.21.15.49:0/3137201509 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fce7005f270 0x7fce70061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fce7c00e210 tx=0x7fce7c01a000).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:36.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:36.866+0000 7fce81ffb700 1 -- 172.21.15.49:0/3137201509 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fce74049b00 con 0x7fce840afb40 2023-11-30T17:23:37.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.106+0000 7fce8c186700 1 -- 172.21.15.49:0/3137201509 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fce8406c860 con 0x7fce840afb40 2023-11-30T17:23:37.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.106+0000 7fce81ffb700 1 -- 172.21.15.49:0/3137201509 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3094 (secure 0 0 0) 0x7fce7404ab40 con 0x7fce840afb40 2023-11-30T17:23:37.109 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:37.109 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":999,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":113,"num_osds":8,"num_up_osds":8,"osd_up_since":1701364027,"num_in_osds":8,"osd_in_since":1701364021,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":85},{"state_name":"unknown","count":52}],"num_pgs":137,"num_pools":4,"num_objects":11,"data_bytes":748,"bytes_used":2490945536,"bytes_avail":770603167744,"bytes_total":773094113280,"unknown_pgs_ratio":0.37956205010414124},"fsmap":{"epoch":46,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":7137}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2023-11-30T17:23:20.456053+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-30T17:23:37.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.108+0000 7fce8c186700 1 -- 172.21.15.49:0/3137201509 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fce7005f270 msgr2=0x7fce70061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:37.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.108+0000 7fce8c186700 1 --2- 172.21.15.49:0/3137201509 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fce7005f270 0x7fce70061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fce7c00e210 tx=0x7fce7c01a000).stop 2023-11-30T17:23:37.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.108+0000 7fce8c186700 1 -- 172.21.15.49:0/3137201509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce840afb40 msgr2=0x7fce840affc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:37.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.108+0000 7fce8c186700 1 --2- 172.21.15.49:0/3137201509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce840afb40 0x7fce840affc0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7fce840c1c40 tx=0x7fce74009040).stop 2023-11-30T17:23:37.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.108+0000 7fce8c186700 1 -- 172.21.15.49:0/3137201509 shutdown_connections 2023-11-30T17:23:37.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.108+0000 7fce8c186700 1 --2- 172.21.15.49:0/3137201509 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fce7005f270 0x7fce70061730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:37.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.108+0000 7fce8c186700 1 --2- 172.21.15.49:0/3137201509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce840afb40 0x7fce840affc0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:37.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.108+0000 7fce8c186700 1 --2- 172.21.15.49:0/3137201509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce6c0038e0 0x7fce84163cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:37.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.108+0000 7fce8c186700 1 --2- 172.21.15.49:0/3137201509 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce840c4ef0 0x7fce840c5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:37.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.108+0000 7fce8c186700 1 -- 172.21.15.49:0/3137201509 >> 172.21.15.49:0/3137201509 conn(0x7fce84094920 msgr2=0x7fce84063b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:37.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.108+0000 7fce8c186700 1 -- 172.21.15.49:0/3137201509 shutdown_connections 2023-11-30T17:23:37.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.109+0000 7fce8c186700 1 -- 172.21.15.49:0/3137201509 wait complete. 2023-11-30T17:23:37.123 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-30T17:23:37.123 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:23:37.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.238+0000 7f757abf3700 1 Processor -- start 2023-11-30T17:23:37.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.238+0000 7f757abf3700 1 -- start start 2023-11-30T17:23:37.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.239+0000 7f757abf3700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f75741510c0 0x7f75740a9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:37.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.239+0000 7f757abf3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f75740a9c80 0x7f7574069070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:37.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.239+0000 7f757abf3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7574063e50 0x7f7574069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:37.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.239+0000 7f757abf3700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7574069a50 con 0x7f75740a9c80 2023-11-30T17:23:37.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.239+0000 7f757abf3700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75740ac4d0 con 0x7f75741510c0 2023-11-30T17:23:37.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.239+0000 7f757abf3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75740ad4a0 con 0x7f7574063e50 2023-11-30T17:23:37.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.239+0000 7f7573fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f75740a9c80 0x7f7574069070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:37.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.239+0000 7f7573fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f75740a9c80 0x7f7574069070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35398/0 (socket says 172.21.15.49:35398) 2023-11-30T17:23:37.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.239+0000 7f7573fff700 1 -- 172.21.15.49:0/311759013 learned_addr learned my addr 172.21.15.49:0/311759013 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:37.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.239+0000 7f757898f700 1 --2- 172.21.15.49:0/311759013 >> v2:172.21.15.115:3300/0 conn(0x7f75741510c0 0x7f75740a9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:37.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.239+0000 7f7579190700 1 --2- 172.21.15.49:0/311759013 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7574063e50 0x7f7574069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:37.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.240+0000 7f7573fff700 1 -- 172.21.15.49:0/311759013 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7574063e50 msgr2=0x7f7574069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:37.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.240+0000 7f7573fff700 1 --2- 172.21.15.49:0/311759013 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7574063e50 0x7f7574069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:37.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.240+0000 7f7573fff700 1 -- 172.21.15.49:0/311759013 >> v2:172.21.15.115:3300/0 conn(0x7f75741510c0 msgr2=0x7f75740a9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:37.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.240+0000 7f7573fff700 1 --2- 172.21.15.49:0/311759013 >> v2:172.21.15.115:3300/0 conn(0x7f75741510c0 0x7f75740a9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:37.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.240+0000 7f7573fff700 1 -- 172.21.15.49:0/311759013 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75740ac6e0 con 0x7f75740a9c80 2023-11-30T17:23:37.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.240+0000 7f7579190700 1 --2- 172.21.15.49:0/311759013 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7574063e50 0x7f7574069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:23:37.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.240+0000 7f757898f700 1 --2- 172.21.15.49:0/311759013 >> v2:172.21.15.115:3300/0 conn(0x7f75741510c0 0x7f75740a9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:23:37.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.240+0000 7f7573fff700 1 --2- 172.21.15.49:0/311759013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75740a9c80 0x7f7574069070 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7f757406ba70 tx=0x7f7564009840).ready entity=mon.0 client_cookie=a0e785ab7c55d6aa server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:37.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.240+0000 7f75737fe700 1 -- 172.21.15.49:0/311759013 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756400e070 con 0x7f75740a9c80 2023-11-30T17:23:37.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.240+0000 7f75737fe700 1 -- 172.21.15.49:0/311759013 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756400ba50 con 0x7f75740a9c80 2023-11-30T17:23:37.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.240+0000 7f75737fe700 1 -- 172.21.15.49:0/311759013 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756400bdd0 con 0x7f75740a9c80 2023-11-30T17:23:37.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.240+0000 7f757abf3700 1 -- 172.21.15.49:0/311759013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75740a9c80 msgr2=0x7f7574069070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:37.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.240+0000 7f757abf3700 1 --2- 172.21.15.49:0/311759013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75740a9c80 0x7f7574069070 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7f757406ba70 tx=0x7f7564009840).stop 2023-11-30T17:23:37.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.240+0000 7f757abf3700 1 -- 172.21.15.49:0/311759013 shutdown_connections 2023-11-30T17:23:37.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.240+0000 7f757abf3700 1 --2- 172.21.15.49:0/311759013 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7574063e50 0x7f7574069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:37.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.240+0000 7f757abf3700 1 --2- 172.21.15.49:0/311759013 >> v2:172.21.15.115:3300/0 conn(0x7f75741510c0 0x7f75740a9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:37.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.240+0000 7f757abf3700 1 --2- 172.21.15.49:0/311759013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75740a9c80 0x7f7574069070 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:37.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.240+0000 7f757abf3700 1 -- 172.21.15.49:0/311759013 >> 172.21.15.49:0/311759013 conn(0x7f75740c7760 msgr2=0x7f75740c7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:37.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.241+0000 7f757abf3700 1 -- 172.21.15.49:0/311759013 shutdown_connections 2023-11-30T17:23:37.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.241+0000 7f757abf3700 1 -- 172.21.15.49:0/311759013 wait complete. 2023-11-30T17:23:37.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.242+0000 7f757abf3700 1 Processor -- start 2023-11-30T17:23:37.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.242+0000 7f757abf3700 1 -- start start 2023-11-30T17:23:37.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.243+0000 7f757abf3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7574063e50 0x7f75741415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:37.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.243+0000 7f757abf3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75740a9c80 0x7f7574140020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:37.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.243+0000 7f757abf3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75741510c0 0x7f7574147960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:37.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.243+0000 7f757abf3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757414d400 con 0x7f75740a9c80 2023-11-30T17:23:37.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.243+0000 7f757abf3700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7574141b80 con 0x7f7574063e50 2023-11-30T17:23:37.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.243+0000 7f757abf3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7574141e60 con 0x7f75741510c0 2023-11-30T17:23:37.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.243+0000 7f7573fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75740a9c80 0x7f7574140020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:37.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.243+0000 7f7573fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75740a9c80 0x7f7574140020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35402/0 (socket says 172.21.15.49:35402) 2023-11-30T17:23:37.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.243+0000 7f7573fff700 1 -- 172.21.15.49:0/4051434156 learned_addr learned my addr 172.21.15.49:0/4051434156 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:37.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.243+0000 7f757898f700 1 --2- 172.21.15.49:0/4051434156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7574063e50 0x7f75741415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:37.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.243+0000 7f7579190700 1 --2- 172.21.15.49:0/4051434156 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75741510c0 0x7f7574147960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:37.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.243+0000 7f7573fff700 1 -- 172.21.15.49:0/4051434156 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75741510c0 msgr2=0x7f7574147960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:37.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.243+0000 7f7573fff700 1 --2- 172.21.15.49:0/4051434156 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75741510c0 0x7f7574147960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:37.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.243+0000 7f7573fff700 1 -- 172.21.15.49:0/4051434156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7574063e50 msgr2=0x7f75741415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:37.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.243+0000 7f7573fff700 1 --2- 172.21.15.49:0/4051434156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7574063e50 0x7f75741415a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:37.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.243+0000 7f7573fff700 1 -- 172.21.15.49:0/4051434156 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7564009ae0 con 0x7f75740a9c80 2023-11-30T17:23:37.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.243+0000 7f7573fff700 1 --2- 172.21.15.49:0/4051434156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75740a9c80 0x7f7574140020 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f7564009fd0 tx=0x7f7564009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:37.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.243+0000 7f7570ff9700 1 -- 172.21.15.49:0/4051434156 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75640032f0 con 0x7f75740a9c80 2023-11-30T17:23:37.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.243+0000 7f7570ff9700 1 -- 172.21.15.49:0/4051434156 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756400bbc0 con 0x7f75740a9c80 2023-11-30T17:23:37.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.243+0000 7f757abf3700 1 -- 172.21.15.49:0/4051434156 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7574142140 con 0x7f75740a9c80 2023-11-30T17:23:37.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.243+0000 7f7570ff9700 1 -- 172.21.15.49:0/4051434156 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756401e470 con 0x7f75740a9c80 2023-11-30T17:23:37.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.243+0000 7f757abf3700 1 -- 172.21.15.49:0/4051434156 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7574140510 con 0x7f75740a9c80 2023-11-30T17:23:37.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.244+0000 7f757abf3700 1 -- 172.21.15.49:0/4051434156 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f757414d540 con 0x7f75740a9c80 2023-11-30T17:23:37.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.245+0000 7f7570ff9700 1 -- 172.21.15.49:0/4051434156 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f7564003040 con 0x7f75740a9c80 2023-11-30T17:23:37.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.245+0000 7f7570ff9700 1 --2- 172.21.15.49:0/4051434156 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f755405f270 0x7f7554061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:37.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.245+0000 7f7570ff9700 1 -- 172.21.15.49:0/4051434156 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f756407b6e0 con 0x7f75740a9c80 2023-11-30T17:23:37.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.245+0000 7f757898f700 1 --2- 172.21.15.49:0/4051434156 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f755405f270 0x7f7554061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:37.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.246+0000 7f757898f700 1 --2- 172.21.15.49:0/4051434156 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f755405f270 0x7f7554061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f755c00bb10 tx=0x7f755c008040).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:37.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.249+0000 7f7570ff9700 1 -- 172.21.15.49:0/4051434156 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f756404c810 con 0x7f75740a9c80 2023-11-30T17:23:37.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.419+0000 7f757abf3700 1 -- 172.21.15.49:0/4051434156 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f757406c860 con 0x7f755405f270 2023-11-30T17:23:37.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.429+0000 7f7570ff9700 1 -- 172.21.15.49:0/4051434156 <== mgr.6107 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+357189 (secure 0 0 0) 0x7f757406c860 con 0x7f755405f270 2023-11-30T17:23:37.439 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:37.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.432+0000 7f757abf3700 1 -- 172.21.15.49:0/4051434156 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f755405f270 msgr2=0x7f7554061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:37.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.432+0000 7f757abf3700 1 --2- 172.21.15.49:0/4051434156 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f755405f270 0x7f7554061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f755c00bb10 tx=0x7f755c008040).stop 2023-11-30T17:23:37.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.432+0000 7f757abf3700 1 -- 172.21.15.49:0/4051434156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75740a9c80 msgr2=0x7f7574140020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:37.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.432+0000 7f757abf3700 1 --2- 172.21.15.49:0/4051434156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75740a9c80 0x7f7574140020 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f7564009fd0 tx=0x7f7564009840).stop 2023-11-30T17:23:37.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.432+0000 7f757abf3700 1 -- 172.21.15.49:0/4051434156 shutdown_connections 2023-11-30T17:23:37.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.432+0000 7f757abf3700 1 --2- 172.21.15.49:0/4051434156 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75741510c0 0x7f7574147960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:37.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.432+0000 7f757abf3700 1 --2- 172.21.15.49:0/4051434156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7574063e50 0x7f75741415a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:37.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.432+0000 7f757abf3700 1 --2- 172.21.15.49:0/4051434156 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f755405f270 0x7f7554061730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:37.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.432+0000 7f757abf3700 1 --2- 172.21.15.49:0/4051434156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75740a9c80 0x7f7574140020 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:37.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.432+0000 7f757abf3700 1 -- 172.21.15.49:0/4051434156 >> 172.21.15.49:0/4051434156 conn(0x7f75740c7760 msgr2=0x7f757414b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:37.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.432+0000 7f757abf3700 1 -- 172.21.15.49:0/4051434156 shutdown_connections 2023-11-30T17:23:37.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:37.432+0000 7f757abf3700 1 -- 172.21.15.49:0/4051434156 wait complete. 2023-11-30T17:23:37.444 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:23:37.447 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-30T17:23:35.455404+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":748,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":170,"acting":170,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2432564,"kb_used_data":10740,"kb_used_omap":0,"kb_used_meta":2421760,"kb_avail":752542156,"statfs":{"total":773094113280,"available":770603167744,"internally_reserved":0,"allocated":10997760,"data_stored":5498635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2479882240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5548,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.011446"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977592+0000","last_change":"2023-11-30T17:23:31.973969+0000","last_active":"2023-11-30T17:23:31.977592+0000","last_peered":"2023-11-30T17:23:31.977592+0000","last_clean":"2023-11-30T17:23:31.977592+0000","last_became_active":"2023-11-30T17:23:31.973692+0000","last_became_peered":"2023-11-30T17:23:31.973692+0000","last_unstale":"2023-11-30T17:23:31.977592+0000","last_undegraded":"2023-11-30T17:23:31.977592+0000","last_fullsized":"2023-11-30T17:23:31.977592+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.973913+0000","last_change":"2023-11-30T17:23:31.969054+0000","last_active":"2023-11-30T17:23:31.973913+0000","last_peered":"2023-11-30T17:23:31.973913+0000","last_clean":"2023-11-30T17:23:31.973913+0000","last_became_active":"2023-11-30T17:23:31.968764+0000","last_became_peered":"2023-11-30T17:23:31.968764+0000","last_unstale":"2023-11-30T17:23:31.973913+0000","last_undegraded":"2023-11-30T17:23:31.973913+0000","last_fullsized":"2023-11-30T17:23:31.973913+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969654+0000","last_change":"2023-11-30T17:23:31.571935+0000","last_active":"2023-11-30T17:23:31.969654+0000","last_peered":"2023-11-30T17:23:31.969654+0000","last_clean":"2023-11-30T17:23:31.969654+0000","last_became_active":"2023-11-30T17:23:31.571639+0000","last_became_peered":"2023-11-30T17:23:31.571639+0000","last_unstale":"2023-11-30T17:23:31.969654+0000","last_undegraded":"2023-11-30T17:23:31.969654+0000","last_fullsized":"2023-11-30T17:23:31.969654+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.952182+0000","last_change":"2023-11-30T17:23:31.576188+0000","last_active":"2023-11-30T17:23:31.952182+0000","last_peered":"2023-11-30T17:23:31.952182+0000","last_clean":"2023-11-30T17:23:31.952182+0000","last_became_active":"2023-11-30T17:23:31.575896+0000","last_became_peered":"2023-11-30T17:23:31.575896+0000","last_unstale":"2023-11-30T17:23:31.952182+0000","last_undegraded":"2023-11-30T17:23:31.952182+0000","last_fullsized":"2023-11-30T17:23:31.952182+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966946+0000","last_change":"2023-11-30T17:23:31.965487+0000","last_active":"2023-11-30T17:23:31.966946+0000","last_peered":"2023-11-30T17:23:31.966946+0000","last_clean":"2023-11-30T17:23:31.966946+0000","last_became_active":"2023-11-30T17:23:31.965068+0000","last_became_peered":"2023-11-30T17:23:31.965068+0000","last_unstale":"2023-11-30T17:23:31.966946+0000","last_undegraded":"2023-11-30T17:23:31.966946+0000","last_fullsized":"2023-11-30T17:23:31.966946+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3c","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.975114+0000","last_change":"2023-11-30T17:23:31.578786+0000","last_active":"2023-11-30T17:23:31.975114+0000","last_peered":"2023-11-30T17:23:31.975114+0000","last_clean":"2023-11-30T17:23:31.975114+0000","last_became_active":"2023-11-30T17:23:31.578524+0000","last_became_peered":"2023-11-30T17:23:31.578524+0000","last_unstale":"2023-11-30T17:23:31.975114+0000","last_undegraded":"2023-11-30T17:23:31.975114+0000","last_fullsized":"2023-11-30T17:23:31.975114+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977330+0000","last_change":"2023-11-30T17:23:31.972469+0000","last_active":"2023-11-30T17:23:31.977330+0000","last_peered":"2023-11-30T17:23:31.977330+0000","last_clean":"2023-11-30T17:23:31.977330+0000","last_became_active":"2023-11-30T17:23:31.971919+0000","last_became_peered":"2023-11-30T17:23:31.971919+0000","last_unstale":"2023-11-30T17:23:31.977330+0000","last_undegraded":"2023-11-30T17:23:31.977330+0000","last_fullsized":"2023-11-30T17:23:31.977330+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.961374+0000","last_change":"2023-11-30T17:23:31.957683+0000","last_active":"2023-11-30T17:23:31.961374+0000","last_peered":"2023-11-30T17:23:31.961374+0000","last_clean":"2023-11-30T17:23:31.961374+0000","last_became_active":"2023-11-30T17:23:31.957381+0000","last_became_peered":"2023-11-30T17:23:31.957381+0000","last_unstale":"2023-11-30T17:23:31.961374+0000","last_undegraded":"2023-11-30T17:23:31.961374+0000","last_fullsized":"2023-11-30T17:23:31.961374+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976055+0000","last_change":"2023-11-30T17:23:31.973265+0000","last_active":"2023-11-30T17:23:31.976055+0000","last_peered":"2023-11-30T17:23:31.976055+0000","last_clean":"2023-11-30T17:23:31.976055+0000","last_became_active":"2023-11-30T17:23:31.972961+0000","last_became_peered":"2023-11-30T17:23:31.972961+0000","last_unstale":"2023-11-30T17:23:31.976055+0000","last_undegraded":"2023-11-30T17:23:31.976055+0000","last_fullsized":"2023-11-30T17:23:31.976055+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.953739+0000","last_change":"2023-11-30T17:23:31.575243+0000","last_active":"2023-11-30T17:23:31.953739+0000","last_peered":"2023-11-30T17:23:31.953739+0000","last_clean":"2023-11-30T17:23:31.953739+0000","last_became_active":"2023-11-30T17:23:31.574933+0000","last_became_peered":"2023-11-30T17:23:31.574933+0000","last_unstale":"2023-11-30T17:23:31.953739+0000","last_undegraded":"2023-11-30T17:23:31.953739+0000","last_fullsized":"2023-11-30T17:23:31.953739+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966866+0000","last_change":"2023-11-30T17:23:31.960188+0000","last_active":"2023-11-30T17:23:31.966866+0000","last_peered":"2023-11-30T17:23:31.966866+0000","last_clean":"2023-11-30T17:23:31.966866+0000","last_became_active":"2023-11-30T17:23:31.959891+0000","last_became_peered":"2023-11-30T17:23:31.959891+0000","last_unstale":"2023-11-30T17:23:31.966866+0000","last_undegraded":"2023-11-30T17:23:31.966866+0000","last_fullsized":"2023-11-30T17:23:31.966866+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.975777+0000","last_change":"2023-11-30T17:23:31.970303+0000","last_active":"2023-11-30T17:23:31.975777+0000","last_peered":"2023-11-30T17:23:31.975777+0000","last_clean":"2023-11-30T17:23:31.975777+0000","last_became_active":"2023-11-30T17:23:31.970018+0000","last_became_peered":"2023-11-30T17:23:31.970018+0000","last_unstale":"2023-11-30T17:23:31.975777+0000","last_undegraded":"2023-11-30T17:23:31.975777+0000","last_fullsized":"2023-11-30T17:23:31.975777+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969753+0000","last_change":"2023-11-30T17:23:31.578961+0000","last_active":"2023-11-30T17:23:31.969753+0000","last_peered":"2023-11-30T17:23:31.969753+0000","last_clean":"2023-11-30T17:23:31.969753+0000","last_became_active":"2023-11-30T17:23:31.578654+0000","last_became_peered":"2023-11-30T17:23:31.578654+0000","last_unstale":"2023-11-30T17:23:31.969753+0000","last_undegraded":"2023-11-30T17:23:31.969753+0000","last_fullsized":"2023-11-30T17:23:31.969753+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968400+0000","last_change":"2023-11-30T17:23:31.951742+0000","last_active":"2023-11-30T17:23:31.968400+0000","last_peered":"2023-11-30T17:23:31.968400+0000","last_clean":"2023-11-30T17:23:31.968400+0000","last_became_active":"2023-11-30T17:23:31.951124+0000","last_became_peered":"2023-11-30T17:23:31.951124+0000","last_unstale":"2023-11-30T17:23:31.968400+0000","last_undegraded":"2023-11-30T17:23:31.968400+0000","last_fullsized":"2023-11-30T17:23:31.968400+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.965240+0000","last_change":"2023-11-30T17:23:31.581506+0000","last_active":"2023-11-30T17:23:31.965240+0000","last_peered":"2023-11-30T17:23:31.965240+0000","last_clean":"2023-11-30T17:23:31.965240+0000","last_became_active":"2023-11-30T17:23:31.581285+0000","last_became_peered":"2023-11-30T17:23:31.581285+0000","last_unstale":"2023-11-30T17:23:31.965240+0000","last_undegraded":"2023-11-30T17:23:31.965240+0000","last_fullsized":"2023-11-30T17:23:31.965240+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.974647+0000","last_change":"2023-11-30T17:23:31.962794+0000","last_active":"2023-11-30T17:23:31.974647+0000","last_peered":"2023-11-30T17:23:31.974647+0000","last_clean":"2023-11-30T17:23:31.974647+0000","last_became_active":"2023-11-30T17:23:31.961702+0000","last_became_peered":"2023-11-30T17:23:31.961702+0000","last_unstale":"2023-11-30T17:23:31.974647+0000","last_undegraded":"2023-11-30T17:23:31.974647+0000","last_fullsized":"2023-11-30T17:23:31.974647+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.960078+0000","last_change":"2023-11-30T17:23:31.580372+0000","last_active":"2023-11-30T17:23:31.960078+0000","last_peered":"2023-11-30T17:23:31.960078+0000","last_clean":"2023-11-30T17:23:31.960078+0000","last_became_active":"2023-11-30T17:23:31.579716+0000","last_became_peered":"2023-11-30T17:23:31.579716+0000","last_unstale":"2023-11-30T17:23:31.960078+0000","last_undegraded":"2023-11-30T17:23:31.960078+0000","last_fullsized":"2023-11-30T17:23:31.960078+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.950162+0000","last_change":"2023-11-30T17:23:31.582624+0000","last_active":"2023-11-30T17:23:31.950162+0000","last_peered":"2023-11-30T17:23:31.950162+0000","last_clean":"2023-11-30T17:23:31.950162+0000","last_became_active":"2023-11-30T17:23:31.582166+0000","last_became_peered":"2023-11-30T17:23:31.582166+0000","last_unstale":"2023-11-30T17:23:31.950162+0000","last_undegraded":"2023-11-30T17:23:31.950162+0000","last_fullsized":"2023-11-30T17:23:31.950162+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.974718+0000","last_change":"2023-11-30T17:23:31.963277+0000","last_active":"2023-11-30T17:23:31.974718+0000","last_peered":"2023-11-30T17:23:31.974718+0000","last_clean":"2023-11-30T17:23:31.974718+0000","last_became_active":"2023-11-30T17:23:31.962955+0000","last_became_peered":"2023-11-30T17:23:31.962955+0000","last_unstale":"2023-11-30T17:23:31.974718+0000","last_undegraded":"2023-11-30T17:23:31.974718+0000","last_fullsized":"2023-11-30T17:23:31.974718+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976863+0000","last_change":"2023-11-30T17:23:31.968097+0000","last_active":"2023-11-30T17:23:31.976863+0000","last_peered":"2023-11-30T17:23:31.976863+0000","last_clean":"2023-11-30T17:23:31.976863+0000","last_became_active":"2023-11-30T17:23:31.967788+0000","last_became_peered":"2023-11-30T17:23:31.967788+0000","last_unstale":"2023-11-30T17:23:31.976863+0000","last_undegraded":"2023-11-30T17:23:31.976863+0000","last_fullsized":"2023-11-30T17:23:31.976863+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.959018+0000","last_change":"2023-11-30T17:23:31.569565+0000","last_active":"2023-11-30T17:23:31.959018+0000","last_peered":"2023-11-30T17:23:31.959018+0000","last_clean":"2023-11-30T17:23:31.959018+0000","last_became_active":"2023-11-30T17:23:31.569226+0000","last_became_peered":"2023-11-30T17:23:31.569226+0000","last_unstale":"2023-11-30T17:23:31.959018+0000","last_undegraded":"2023-11-30T17:23:31.959018+0000","last_fullsized":"2023-11-30T17:23:31.959018+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.974805+0000","last_change":"2023-11-30T17:23:31.973956+0000","last_active":"2023-11-30T17:23:31.974805+0000","last_peered":"2023-11-30T17:23:31.974805+0000","last_clean":"2023-11-30T17:23:31.974805+0000","last_became_active":"2023-11-30T17:23:31.973675+0000","last_became_peered":"2023-11-30T17:23:31.973675+0000","last_unstale":"2023-11-30T17:23:31.974805+0000","last_undegraded":"2023-11-30T17:23:31.974805+0000","last_fullsized":"2023-11-30T17:23:31.974805+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.970067+0000","last_change":"2023-11-30T17:23:31.576721+0000","last_active":"2023-11-30T17:23:31.970067+0000","last_peered":"2023-11-30T17:23:31.970067+0000","last_clean":"2023-11-30T17:23:31.970067+0000","last_became_active":"2023-11-30T17:23:31.575699+0000","last_became_peered":"2023-11-30T17:23:31.575699+0000","last_unstale":"2023-11-30T17:23:31.970067+0000","last_undegraded":"2023-11-30T17:23:31.970067+0000","last_fullsized":"2023-11-30T17:23:31.970067+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968737+0000","last_change":"2023-11-30T17:23:31.964844+0000","last_active":"2023-11-30T17:23:31.968737+0000","last_peered":"2023-11-30T17:23:31.968737+0000","last_clean":"2023-11-30T17:23:31.968737+0000","last_became_active":"2023-11-30T17:23:31.961956+0000","last_became_peered":"2023-11-30T17:23:31.961956+0000","last_unstale":"2023-11-30T17:23:31.968737+0000","last_undegraded":"2023-11-30T17:23:31.968737+0000","last_fullsized":"2023-11-30T17:23:31.968737+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.957082+0000","last_change":"2023-11-30T17:23:31.575492+0000","last_active":"2023-11-30T17:23:31.957082+0000","last_peered":"2023-11-30T17:23:31.957082+0000","last_clean":"2023-11-30T17:23:31.957082+0000","last_became_active":"2023-11-30T17:23:31.573839+0000","last_became_peered":"2023-11-30T17:23:31.573839+0000","last_unstale":"2023-11-30T17:23:31.957082+0000","last_undegraded":"2023-11-30T17:23:31.957082+0000","last_fullsized":"2023-11-30T17:23:31.957082+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.967040+0000","last_change":"2023-11-30T17:23:31.965248+0000","last_active":"2023-11-30T17:23:31.967040+0000","last_peered":"2023-11-30T17:23:31.967040+0000","last_clean":"2023-11-30T17:23:31.967040+0000","last_became_active":"2023-11-30T17:23:31.964971+0000","last_became_peered":"2023-11-30T17:23:31.964971+0000","last_unstale":"2023-11-30T17:23:31.967040+0000","last_undegraded":"2023-11-30T17:23:31.967040+0000","last_fullsized":"2023-11-30T17:23:31.967040+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2b","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969966+0000","last_change":"2023-11-30T17:23:31.573926+0000","last_active":"2023-11-30T17:23:31.969966+0000","last_peered":"2023-11-30T17:23:31.969966+0000","last_clean":"2023-11-30T17:23:31.969966+0000","last_became_active":"2023-11-30T17:23:31.573565+0000","last_became_peered":"2023-11-30T17:23:31.573565+0000","last_unstale":"2023-11-30T17:23:31.969966+0000","last_undegraded":"2023-11-30T17:23:31.969966+0000","last_fullsized":"2023-11-30T17:23:31.969966+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.971378+0000","last_change":"2023-11-30T17:23:31.579162+0000","last_active":"2023-11-30T17:23:31.971378+0000","last_peered":"2023-11-30T17:23:31.971378+0000","last_clean":"2023-11-30T17:23:31.971378+0000","last_became_active":"2023-11-30T17:23:31.578839+0000","last_became_peered":"2023-11-30T17:23:31.578839+0000","last_unstale":"2023-11-30T17:23:31.971378+0000","last_undegraded":"2023-11-30T17:23:31.971378+0000","last_fullsized":"2023-11-30T17:23:31.971378+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.953484+0000","last_change":"2023-11-30T17:23:31.575050+0000","last_active":"2023-11-30T17:23:31.953484+0000","last_peered":"2023-11-30T17:23:31.953484+0000","last_clean":"2023-11-30T17:23:31.953484+0000","last_became_active":"2023-11-30T17:23:31.574230+0000","last_became_peered":"2023-11-30T17:23:31.574230+0000","last_unstale":"2023-11-30T17:23:31.953484+0000","last_undegraded":"2023-11-30T17:23:31.953484+0000","last_fullsized":"2023-11-30T17:23:31.953484+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976986+0000","last_change":"2023-11-30T17:23:31.970460+0000","last_active":"2023-11-30T17:23:31.976986+0000","last_peered":"2023-11-30T17:23:31.976986+0000","last_clean":"2023-11-30T17:23:31.976986+0000","last_became_active":"2023-11-30T17:23:31.970168+0000","last_became_peered":"2023-11-30T17:23:31.970168+0000","last_unstale":"2023-11-30T17:23:31.976986+0000","last_undegraded":"2023-11-30T17:23:31.976986+0000","last_fullsized":"2023-11-30T17:23:31.976986+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969686+0000","last_change":"2023-11-30T17:23:31.576651+0000","last_active":"2023-11-30T17:23:31.969686+0000","last_peered":"2023-11-30T17:23:31.969686+0000","last_clean":"2023-11-30T17:23:31.969686+0000","last_became_active":"2023-11-30T17:23:31.576386+0000","last_became_peered":"2023-11-30T17:23:31.576386+0000","last_unstale":"2023-11-30T17:23:31.969686+0000","last_undegraded":"2023-11-30T17:23:31.969686+0000","last_fullsized":"2023-11-30T17:23:31.969686+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968312+0000","last_change":"2023-11-30T17:23:31.966907+0000","last_active":"2023-11-30T17:23:31.968312+0000","last_peered":"2023-11-30T17:23:31.968312+0000","last_clean":"2023-11-30T17:23:31.968312+0000","last_became_active":"2023-11-30T17:23:31.966449+0000","last_became_peered":"2023-11-30T17:23:31.966449+0000","last_unstale":"2023-11-30T17:23:31.968312+0000","last_undegraded":"2023-11-30T17:23:31.968312+0000","last_fullsized":"2023-11-30T17:23:31.968312+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.951943+0000","last_change":"2023-11-30T17:23:31.586699+0000","last_active":"2023-11-30T17:23:31.951943+0000","last_peered":"2023-11-30T17:23:31.951943+0000","last_clean":"2023-11-30T17:23:31.951943+0000","last_became_active":"2023-11-30T17:23:31.586428+0000","last_became_peered":"2023-11-30T17:23:31.586428+0000","last_unstale":"2023-11-30T17:23:31.951943+0000","last_undegraded":"2023-11-30T17:23:31.951943+0000","last_fullsized":"2023-11-30T17:23:31.951943+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968422+0000","last_change":"2023-11-30T17:23:31.951947+0000","last_active":"2023-11-30T17:23:31.968422+0000","last_peered":"2023-11-30T17:23:31.968422+0000","last_clean":"2023-11-30T17:23:31.968422+0000","last_became_active":"2023-11-30T17:23:31.951475+0000","last_became_peered":"2023-11-30T17:23:31.951475+0000","last_unstale":"2023-11-30T17:23:31.968422+0000","last_undegraded":"2023-11-30T17:23:31.968422+0000","last_fullsized":"2023-11-30T17:23:31.968422+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969411+0000","last_change":"2023-11-30T17:23:31.575097+0000","last_active":"2023-11-30T17:23:31.969411+0000","last_peered":"2023-11-30T17:23:31.969411+0000","last_clean":"2023-11-30T17:23:31.969411+0000","last_became_active":"2023-11-30T17:23:31.574793+0000","last_became_peered":"2023-11-30T17:23:31.574793+0000","last_unstale":"2023-11-30T17:23:31.969411+0000","last_undegraded":"2023-11-30T17:23:31.969411+0000","last_fullsized":"2023-11-30T17:23:31.969411+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.971442+0000","last_change":"2023-11-30T17:23:31.585126+0000","last_active":"2023-11-30T17:23:31.971442+0000","last_peered":"2023-11-30T17:23:31.971442+0000","last_clean":"2023-11-30T17:23:31.971442+0000","last_became_active":"2023-11-30T17:23:31.584635+0000","last_became_peered":"2023-11-30T17:23:31.584635+0000","last_unstale":"2023-11-30T17:23:31.971442+0000","last_undegraded":"2023-11-30T17:23:31.971442+0000","last_fullsized":"2023-11-30T17:23:31.971442+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.963851+0000","last_change":"2023-11-30T17:23:31.962840+0000","last_active":"2023-11-30T17:23:31.963851+0000","last_peered":"2023-11-30T17:23:31.963851+0000","last_clean":"2023-11-30T17:23:31.963851+0000","last_became_active":"2023-11-30T17:23:31.962549+0000","last_became_peered":"2023-11-30T17:23:31.962549+0000","last_unstale":"2023-11-30T17:23:31.963851+0000","last_undegraded":"2023-11-30T17:23:31.963851+0000","last_fullsized":"2023-11-30T17:23:31.963851+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.975897+0000","last_change":"2023-11-30T17:23:31.967042+0000","last_active":"2023-11-30T17:23:31.975897+0000","last_peered":"2023-11-30T17:23:31.975897+0000","last_clean":"2023-11-30T17:23:31.975897+0000","last_became_active":"2023-11-30T17:23:31.966757+0000","last_became_peered":"2023-11-30T17:23:31.966757+0000","last_unstale":"2023-11-30T17:23:31.975897+0000","last_undegraded":"2023-11-30T17:23:31.975897+0000","last_fullsized":"2023-11-30T17:23:31.975897+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.970001+0000","last_change":"2023-11-30T17:23:31.963695+0000","last_active":"2023-11-30T17:23:31.970001+0000","last_peered":"2023-11-30T17:23:31.970001+0000","last_clean":"2023-11-30T17:23:31.970001+0000","last_became_active":"2023-11-30T17:23:31.962928+0000","last_became_peered":"2023-11-30T17:23:31.962928+0000","last_unstale":"2023-11-30T17:23:31.970001+0000","last_undegraded":"2023-11-30T17:23:31.970001+0000","last_fullsized":"2023-11-30T17:23:31.970001+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.972863+0000","last_change":"2023-11-30T17:23:31.971045+0000","last_active":"2023-11-30T17:23:31.972863+0000","last_peered":"2023-11-30T17:23:31.972863+0000","last_clean":"2023-11-30T17:23:31.972863+0000","last_became_active":"2023-11-30T17:23:31.970765+0000","last_became_peered":"2023-11-30T17:23:31.970765+0000","last_unstale":"2023-11-30T17:23:31.972863+0000","last_undegraded":"2023-11-30T17:23:31.972863+0000","last_fullsized":"2023-11-30T17:23:31.972863+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.963145+0000","last_change":"2023-11-30T17:23:31.584175+0000","last_active":"2023-11-30T17:23:31.963145+0000","last_peered":"2023-11-30T17:23:31.963145+0000","last_clean":"2023-11-30T17:23:31.963145+0000","last_became_active":"2023-11-30T17:23:31.583873+0000","last_became_peered":"2023-11-30T17:23:31.583873+0000","last_unstale":"2023-11-30T17:23:31.963145+0000","last_undegraded":"2023-11-30T17:23:31.963145+0000","last_fullsized":"2023-11-30T17:23:31.963145+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.965756+0000","last_change":"2023-11-30T17:23:31.951314+0000","last_active":"2023-11-30T17:23:31.965756+0000","last_peered":"2023-11-30T17:23:31.965756+0000","last_clean":"2023-11-30T17:23:31.965756+0000","last_became_active":"2023-11-30T17:23:31.951068+0000","last_became_peered":"2023-11-30T17:23:31.951068+0000","last_unstale":"2023-11-30T17:23:31.965756+0000","last_undegraded":"2023-11-30T17:23:31.965756+0000","last_fullsized":"2023-11-30T17:23:31.965756+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977304+0000","last_change":"2023-11-30T17:23:31.972316+0000","last_active":"2023-11-30T17:23:31.977304+0000","last_peered":"2023-11-30T17:23:31.977304+0000","last_clean":"2023-11-30T17:23:31.977304+0000","last_became_active":"2023-11-30T17:23:31.971591+0000","last_became_peered":"2023-11-30T17:23:31.971591+0000","last_unstale":"2023-11-30T17:23:31.977304+0000","last_undegraded":"2023-11-30T17:23:31.977304+0000","last_fullsized":"2023-11-30T17:23:31.977304+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.971522+0000","last_change":"2023-11-30T17:23:31.584951+0000","last_active":"2023-11-30T17:23:31.971522+0000","last_peered":"2023-11-30T17:23:31.971522+0000","last_clean":"2023-11-30T17:23:31.971522+0000","last_became_active":"2023-11-30T17:23:31.584271+0000","last_became_peered":"2023-11-30T17:23:31.584271+0000","last_unstale":"2023-11-30T17:23:31.971522+0000","last_undegraded":"2023-11-30T17:23:31.971522+0000","last_fullsized":"2023-11-30T17:23:31.971522+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968644+0000","last_change":"2023-11-30T17:23:31.964012+0000","last_active":"2023-11-30T17:23:31.968644+0000","last_peered":"2023-11-30T17:23:31.968644+0000","last_clean":"2023-11-30T17:23:31.968644+0000","last_became_active":"2023-11-30T17:23:31.963750+0000","last_became_peered":"2023-11-30T17:23:31.963750+0000","last_unstale":"2023-11-30T17:23:31.968644+0000","last_undegraded":"2023-11-30T17:23:31.968644+0000","last_fullsized":"2023-11-30T17:23:31.968644+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.949896+0000","last_change":"2023-11-30T17:23:31.582453+0000","last_active":"2023-11-30T17:23:31.949896+0000","last_peered":"2023-11-30T17:23:31.949896+0000","last_clean":"2023-11-30T17:23:31.949896+0000","last_became_active":"2023-11-30T17:23:31.581818+0000","last_became_peered":"2023-11-30T17:23:31.581818+0000","last_unstale":"2023-11-30T17:23:31.949896+0000","last_undegraded":"2023-11-30T17:23:31.949896+0000","last_fullsized":"2023-11-30T17:23:31.949896+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977686+0000","last_change":"2023-11-30T17:23:31.973318+0000","last_active":"2023-11-30T17:23:31.977686+0000","last_peered":"2023-11-30T17:23:31.977686+0000","last_clean":"2023-11-30T17:23:31.977686+0000","last_became_active":"2023-11-30T17:23:31.973044+0000","last_became_peered":"2023-11-30T17:23:31.973044+0000","last_unstale":"2023-11-30T17:23:31.977686+0000","last_undegraded":"2023-11-30T17:23:31.977686+0000","last_fullsized":"2023-11-30T17:23:31.977686+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.951309+0000","last_change":"2023-11-30T17:23:31.583511+0000","last_active":"2023-11-30T17:23:31.951309+0000","last_peered":"2023-11-30T17:23:31.951309+0000","last_clean":"2023-11-30T17:23:31.951309+0000","last_became_active":"2023-11-30T17:23:31.583179+0000","last_became_peered":"2023-11-30T17:23:31.583179+0000","last_unstale":"2023-11-30T17:23:31.951309+0000","last_undegraded":"2023-11-30T17:23:31.951309+0000","last_fullsized":"2023-11-30T17:23:31.951309+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969624+0000","last_change":"2023-11-30T17:23:31.968565+0000","last_active":"2023-11-30T17:23:31.969624+0000","last_peered":"2023-11-30T17:23:31.969624+0000","last_clean":"2023-11-30T17:23:31.969624+0000","last_became_active":"2023-11-30T17:23:31.968258+0000","last_became_peered":"2023-11-30T17:23:31.968258+0000","last_unstale":"2023-11-30T17:23:31.969624+0000","last_undegraded":"2023-11-30T17:23:31.969624+0000","last_fullsized":"2023-11-30T17:23:31.969624+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.953697+0000","last_change":"2023-11-30T17:23:31.586544+0000","last_active":"2023-11-30T17:23:31.953697+0000","last_peered":"2023-11-30T17:23:31.953697+0000","last_clean":"2023-11-30T17:23:31.953697+0000","last_became_active":"2023-11-30T17:23:31.586249+0000","last_became_peered":"2023-11-30T17:23:31.586249+0000","last_unstale":"2023-11-30T17:23:31.953697+0000","last_undegraded":"2023-11-30T17:23:31.953697+0000","last_fullsized":"2023-11-30T17:23:31.953697+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.967257+0000","last_change":"2023-11-30T17:23:31.966064+0000","last_active":"2023-11-30T17:23:31.967257+0000","last_peered":"2023-11-30T17:23:31.967257+0000","last_clean":"2023-11-30T17:23:31.967257+0000","last_became_active":"2023-11-30T17:23:31.965286+0000","last_became_peered":"2023-11-30T17:23:31.965286+0000","last_unstale":"2023-11-30T17:23:31.967257+0000","last_undegraded":"2023-11-30T17:23:31.967257+0000","last_fullsized":"2023-11-30T17:23:31.967257+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976819+0000","last_change":"2023-11-30T17:23:31.967924+0000","last_active":"2023-11-30T17:23:31.976819+0000","last_peered":"2023-11-30T17:23:31.976819+0000","last_clean":"2023-11-30T17:23:31.976819+0000","last_became_active":"2023-11-30T17:23:31.967731+0000","last_became_peered":"2023-11-30T17:23:31.967731+0000","last_unstale":"2023-11-30T17:23:31.976819+0000","last_undegraded":"2023-11-30T17:23:31.976819+0000","last_fullsized":"2023-11-30T17:23:31.976819+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.973710+0000","last_change":"2023-11-30T17:23:31.574509+0000","last_active":"2023-11-30T17:23:31.973710+0000","last_peered":"2023-11-30T17:23:31.973710+0000","last_clean":"2023-11-30T17:23:31.973710+0000","last_became_active":"2023-11-30T17:23:31.574222+0000","last_became_peered":"2023-11-30T17:23:31.574222+0000","last_unstale":"2023-11-30T17:23:31.973710+0000","last_undegraded":"2023-11-30T17:23:31.973710+0000","last_fullsized":"2023-11-30T17:23:31.973710+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977348+0000","last_change":"2023-11-30T17:23:31.972653+0000","last_active":"2023-11-30T17:23:31.977348+0000","last_peered":"2023-11-30T17:23:31.977348+0000","last_clean":"2023-11-30T17:23:31.977348+0000","last_became_active":"2023-11-30T17:23:31.972117+0000","last_became_peered":"2023-11-30T17:23:31.972117+0000","last_unstale":"2023-11-30T17:23:31.977348+0000","last_undegraded":"2023-11-30T17:23:31.977348+0000","last_fullsized":"2023-11-30T17:23:31.977348+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968511+0000","last_change":"2023-11-30T17:23:31.583818+0000","last_active":"2023-11-30T17:23:31.968511+0000","last_peered":"2023-11-30T17:23:31.968511+0000","last_clean":"2023-11-30T17:23:31.968511+0000","last_became_active":"2023-11-30T17:23:31.583114+0000","last_became_peered":"2023-11-30T17:23:31.583114+0000","last_unstale":"2023-11-30T17:23:31.968511+0000","last_undegraded":"2023-11-30T17:23:31.968511+0000","last_fullsized":"2023-11-30T17:23:31.968511+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.947455+0000","last_change":"2023-11-30T17:23:31.583430+0000","last_active":"2023-11-30T17:23:31.947455+0000","last_peered":"2023-11-30T17:23:31.947455+0000","last_clean":"2023-11-30T17:23:31.947455+0000","last_became_active":"2023-11-30T17:23:31.583105+0000","last_became_peered":"2023-11-30T17:23:31.583105+0000","last_unstale":"2023-11-30T17:23:31.947455+0000","last_undegraded":"2023-11-30T17:23:31.947455+0000","last_fullsized":"2023-11-30T17:23:31.947455+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.967351+0000","last_change":"2023-11-30T17:23:31.964226+0000","last_active":"2023-11-30T17:23:31.967351+0000","last_peered":"2023-11-30T17:23:31.967351+0000","last_clean":"2023-11-30T17:23:31.967351+0000","last_became_active":"2023-11-30T17:23:31.963944+0000","last_became_peered":"2023-11-30T17:23:31.963944+0000","last_unstale":"2023-11-30T17:23:31.967351+0000","last_undegraded":"2023-11-30T17:23:31.967351+0000","last_fullsized":"2023-11-30T17:23:31.967351+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.964360+0000","last_change":"2023-11-30T17:23:31.571471+0000","last_active":"2023-11-30T17:23:31.964360+0000","last_peered":"2023-11-30T17:23:31.964360+0000","last_clean":"2023-11-30T17:23:31.964360+0000","last_became_active":"2023-11-30T17:23:31.571178+0000","last_became_peered":"2023-11-30T17:23:31.571178+0000","last_unstale":"2023-11-30T17:23:31.964360+0000","last_undegraded":"2023-11-30T17:23:31.964360+0000","last_fullsized":"2023-11-30T17:23:31.964360+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966913+0000","last_change":"2023-11-30T17:23:31.965542+0000","last_active":"2023-11-30T17:23:31.966913+0000","last_peered":"2023-11-30T17:23:31.966913+0000","last_clean":"2023-11-30T17:23:31.966913+0000","last_became_active":"2023-11-30T17:23:31.965254+0000","last_became_peered":"2023-11-30T17:23:31.965254+0000","last_unstale":"2023-11-30T17:23:31.966913+0000","last_undegraded":"2023-11-30T17:23:31.966913+0000","last_fullsized":"2023-11-30T17:23:31.966913+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"112'4","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977162+0000","last_change":"2023-11-30T17:23:31.584353+0000","last_active":"2023-11-30T17:23:31.977162+0000","last_peered":"2023-11-30T17:23:31.977162+0000","last_clean":"2023-11-30T17:23:31.977162+0000","last_became_active":"2023-11-30T17:23:31.584077+0000","last_became_peered":"2023-11-30T17:23:31.584077+0000","last_unstale":"2023-11-30T17:23:31.977162+0000","last_undegraded":"2023-11-30T17:23:31.977162+0000","last_fullsized":"2023-11-30T17:23:31.977162+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.965305+0000","last_change":"2023-11-30T17:23:31.576611+0000","last_active":"2023-11-30T17:23:31.965305+0000","last_peered":"2023-11-30T17:23:31.965305+0000","last_clean":"2023-11-30T17:23:31.965305+0000","last_became_active":"2023-11-30T17:23:31.576303+0000","last_became_peered":"2023-11-30T17:23:31.576303+0000","last_unstale":"2023-11-30T17:23:31.965305+0000","last_undegraded":"2023-11-30T17:23:31.965305+0000","last_fullsized":"2023-11-30T17:23:31.965305+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976552+0000","last_change":"2023-11-30T17:23:31.973173+0000","last_active":"2023-11-30T17:23:31.976552+0000","last_peered":"2023-11-30T17:23:31.976552+0000","last_clean":"2023-11-30T17:23:31.976552+0000","last_became_active":"2023-11-30T17:23:31.970112+0000","last_became_peered":"2023-11-30T17:23:31.970112+0000","last_unstale":"2023-11-30T17:23:31.976552+0000","last_undegraded":"2023-11-30T17:23:31.976552+0000","last_fullsized":"2023-11-30T17:23:31.976552+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968363+0000","last_change":"2023-11-30T17:23:31.962690+0000","last_active":"2023-11-30T17:23:31.968363+0000","last_peered":"2023-11-30T17:23:31.968363+0000","last_clean":"2023-11-30T17:23:31.968363+0000","last_became_active":"2023-11-30T17:23:31.962398+0000","last_became_peered":"2023-11-30T17:23:31.962398+0000","last_unstale":"2023-11-30T17:23:31.968363+0000","last_undegraded":"2023-11-30T17:23:31.968363+0000","last_fullsized":"2023-11-30T17:23:31.968363+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.975890+0000","last_change":"2023-11-30T17:23:31.969835+0000","last_active":"2023-11-30T17:23:31.975890+0000","last_peered":"2023-11-30T17:23:31.975890+0000","last_clean":"2023-11-30T17:23:31.975890+0000","last_became_active":"2023-11-30T17:23:31.969554+0000","last_became_peered":"2023-11-30T17:23:31.969554+0000","last_unstale":"2023-11-30T17:23:31.975890+0000","last_undegraded":"2023-11-30T17:23:31.975890+0000","last_fullsized":"2023-11-30T17:23:31.975890+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.947769+0000","last_change":"2023-11-30T17:23:31.588106+0000","last_active":"2023-11-30T17:23:31.947769+0000","last_peered":"2023-11-30T17:23:31.947769+0000","last_clean":"2023-11-30T17:23:31.947769+0000","last_became_active":"2023-11-30T17:23:31.587639+0000","last_became_peered":"2023-11-30T17:23:31.587639+0000","last_unstale":"2023-11-30T17:23:31.947769+0000","last_undegraded":"2023-11-30T17:23:31.947769+0000","last_fullsized":"2023-11-30T17:23:31.947769+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966848+0000","last_change":"2023-11-30T17:23:31.964658+0000","last_active":"2023-11-30T17:23:31.966848+0000","last_peered":"2023-11-30T17:23:31.966848+0000","last_clean":"2023-11-30T17:23:31.966848+0000","last_became_active":"2023-11-30T17:23:31.964344+0000","last_became_peered":"2023-11-30T17:23:31.964344+0000","last_unstale":"2023-11-30T17:23:31.966848+0000","last_undegraded":"2023-11-30T17:23:31.966848+0000","last_fullsized":"2023-11-30T17:23:31.966848+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966407+0000","last_change":"2023-11-30T17:23:31.951476+0000","last_active":"2023-11-30T17:23:31.966407+0000","last_peered":"2023-11-30T17:23:31.966407+0000","last_clean":"2023-11-30T17:23:31.966407+0000","last_became_active":"2023-11-30T17:23:31.951287+0000","last_became_peered":"2023-11-30T17:23:31.951287+0000","last_unstale":"2023-11-30T17:23:31.966407+0000","last_undegraded":"2023-11-30T17:23:31.966407+0000","last_fullsized":"2023-11-30T17:23:31.966407+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.951316+0000","last_change":"2023-11-30T17:23:31.579504+0000","last_active":"2023-11-30T17:23:31.951316+0000","last_peered":"2023-11-30T17:23:31.951316+0000","last_clean":"2023-11-30T17:23:31.951316+0000","last_became_active":"2023-11-30T17:23:31.579215+0000","last_became_peered":"2023-11-30T17:23:31.579215+0000","last_unstale":"2023-11-30T17:23:31.951316+0000","last_undegraded":"2023-11-30T17:23:31.951316+0000","last_fullsized":"2023-11-30T17:23:31.951316+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976068+0000","last_change":"2023-11-30T17:23:31.973279+0000","last_active":"2023-11-30T17:23:31.976068+0000","last_peered":"2023-11-30T17:23:31.976068+0000","last_clean":"2023-11-30T17:23:31.976068+0000","last_became_active":"2023-11-30T17:23:31.972992+0000","last_became_peered":"2023-11-30T17:23:31.972992+0000","last_unstale":"2023-11-30T17:23:31.976068+0000","last_undegraded":"2023-11-30T17:23:31.976068+0000","last_fullsized":"2023-11-30T17:23:31.976068+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":91,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969790+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:23:31.969790+0000","last_peered":"2023-11-30T17:23:31.969790+0000","last_clean":"2023-11-30T17:23:31.969790+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:23:31.969790+0000","last_undegraded":"2023-11-30T17:23:31.969790+0000","last_fullsized":"2023-11-30T17:23:31.969790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":86,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-30T17:23:28.089672+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:23:28.089672+0000","last_peered":"2023-11-30T17:23:28.089672+0000","last_clean":"2023-11-30T17:23:28.089672+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:23:28.089672+0000","last_undegraded":"2023-11-30T17:23:28.089672+0000","last_fullsized":"2023-11-30T17:23:28.089672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966869+0000","last_change":"2023-11-30T17:23:31.572852+0000","last_active":"2023-11-30T17:23:31.966869+0000","last_peered":"2023-11-30T17:23:31.966869+0000","last_clean":"2023-11-30T17:23:31.966869+0000","last_became_active":"2023-11-30T17:23:31.572533+0000","last_became_peered":"2023-11-30T17:23:31.572533+0000","last_unstale":"2023-11-30T17:23:31.966869+0000","last_undegraded":"2023-11-30T17:23:31.966869+0000","last_fullsized":"2023-11-30T17:23:31.966869+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":95,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.953812+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:23:31.953812+0000","last_peered":"2023-11-30T17:23:31.953812+0000","last_clean":"2023-11-30T17:23:31.953812+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:23:31.953812+0000","last_undegraded":"2023-11-30T17:23:31.953812+0000","last_fullsized":"2023-11-30T17:23:31.953812+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.963094+0000","last_change":"2023-11-30T17:23:31.958158+0000","last_active":"2023-11-30T17:23:31.963094+0000","last_peered":"2023-11-30T17:23:31.963094+0000","last_clean":"2023-11-30T17:23:31.963094+0000","last_became_active":"2023-11-30T17:23:31.957892+0000","last_became_peered":"2023-11-30T17:23:31.957892+0000","last_unstale":"2023-11-30T17:23:31.963094+0000","last_undegraded":"2023-11-30T17:23:31.963094+0000","last_fullsized":"2023-11-30T17:23:31.963094+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969704+0000","last_change":"2023-11-30T17:23:31.576516+0000","last_active":"2023-11-30T17:23:31.969704+0000","last_peered":"2023-11-30T17:23:31.969704+0000","last_clean":"2023-11-30T17:23:31.969704+0000","last_became_active":"2023-11-30T17:23:31.576131+0000","last_became_peered":"2023-11-30T17:23:31.576131+0000","last_unstale":"2023-11-30T17:23:31.969704+0000","last_undegraded":"2023-11-30T17:23:31.969704+0000","last_fullsized":"2023-11-30T17:23:31.969704+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":86,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-30T17:23:28.089708+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:23:28.089708+0000","last_peered":"2023-11-30T17:23:28.089708+0000","last_clean":"2023-11-30T17:23:28.089708+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:23:28.089708+0000","last_undegraded":"2023-11-30T17:23:28.089708+0000","last_fullsized":"2023-11-30T17:23:28.089708+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":92,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.951439+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:23:31.951439+0000","last_peered":"2023-11-30T17:23:31.951439+0000","last_clean":"2023-11-30T17:23:31.951439+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:23:31.951439+0000","last_undegraded":"2023-11-30T17:23:31.951439+0000","last_fullsized":"2023-11-30T17:23:31.951439+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976031+0000","last_change":"2023-11-30T17:23:31.972941+0000","last_active":"2023-11-30T17:23:31.976031+0000","last_peered":"2023-11-30T17:23:31.976031+0000","last_clean":"2023-11-30T17:23:31.976031+0000","last_became_active":"2023-11-30T17:23:31.967587+0000","last_became_peered":"2023-11-30T17:23:31.967587+0000","last_unstale":"2023-11-30T17:23:31.976031+0000","last_undegraded":"2023-11-30T17:23:31.976031+0000","last_fullsized":"2023-11-30T17:23:31.976031+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":90,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.951488+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:23:31.951488+0000","last_peered":"2023-11-30T17:23:31.951488+0000","last_clean":"2023-11-30T17:23:31.951488+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:23:31.951488+0000","last_undegraded":"2023-11-30T17:23:31.951488+0000","last_fullsized":"2023-11-30T17:23:31.951488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.959971+0000","last_change":"2023-11-30T17:23:31.580697+0000","last_active":"2023-11-30T17:23:31.959971+0000","last_peered":"2023-11-30T17:23:31.959971+0000","last_clean":"2023-11-30T17:23:31.959971+0000","last_became_active":"2023-11-30T17:23:31.580098+0000","last_became_peered":"2023-11-30T17:23:31.580098+0000","last_unstale":"2023-11-30T17:23:31.959971+0000","last_undegraded":"2023-11-30T17:23:31.959971+0000","last_fullsized":"2023-11-30T17:23:31.959971+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":90,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.952310+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:23:31.952310+0000","last_peered":"2023-11-30T17:23:31.952310+0000","last_clean":"2023-11-30T17:23:31.952310+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:23:31.952310+0000","last_undegraded":"2023-11-30T17:23:31.952310+0000","last_fullsized":"2023-11-30T17:23:31.952310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:31.552500+0000","last_change":"2023-11-30T17:23:31.552500+0000","last_active":"2023-11-30T17:23:31.552500+0000","last_peered":"2023-11-30T17:23:31.552500+0000","last_clean":"2023-11-30T17:23:31.552500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:31.552500+0000","last_undegraded":"2023-11-30T17:23:31.552500+0000","last_fullsized":"2023-11-30T17:23:31.552500+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T17:23:30.550477+0000","last_change":"2023-11-30T17:23:30.550477+0000","last_active":"2023-11-30T17:23:30.550477+0000","last_peered":"2023-11-30T17:23:30.550477+0000","last_clean":"2023-11-30T17:23:30.550477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T17:23:30.550477+0000","last_undegraded":"2023-11-30T17:23:30.550477+0000","last_fullsized":"2023-11-30T17:23:30.550477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":91,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969567+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:23:31.969567+0000","last_peered":"2023-11-30T17:23:31.969567+0000","last_clean":"2023-11-30T17:23:31.969567+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:23:31.969567+0000","last_undegraded":"2023-11-30T17:23:31.969567+0000","last_fullsized":"2023-11-30T17:23:31.969567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968512+0000","last_change":"2023-11-30T17:23:31.963009+0000","last_active":"2023-11-30T17:23:31.968512+0000","last_peered":"2023-11-30T17:23:31.968512+0000","last_clean":"2023-11-30T17:23:31.968512+0000","last_became_active":"2023-11-30T17:23:31.962748+0000","last_became_peered":"2023-11-30T17:23:31.962748+0000","last_unstale":"2023-11-30T17:23:31.968512+0000","last_undegraded":"2023-11-30T17:23:31.968512+0000","last_fullsized":"2023-11-30T17:23:31.968512+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.953593+0000","last_change":"2023-11-30T17:23:31.575232+0000","last_active":"2023-11-30T17:23:31.953593+0000","last_peered":"2023-11-30T17:23:31.953593+0000","last_clean":"2023-11-30T17:23:31.953593+0000","last_became_active":"2023-11-30T17:23:31.574785+0000","last_became_peered":"2023-11-30T17:23:31.574785+0000","last_unstale":"2023-11-30T17:23:31.953593+0000","last_undegraded":"2023-11-30T17:23:31.953593+0000","last_fullsized":"2023-11-30T17:23:31.953593+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-30T17:23:27.439439+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:23:27.439439+0000","last_peered":"2023-11-30T17:23:27.439439+0000","last_clean":"2023-11-30T17:23:27.439439+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:23:27.439439+0000","last_undegraded":"2023-11-30T17:23:27.439439+0000","last_fullsized":"2023-11-30T17:23:27.439439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":82,"acting":82,"num_store_stats":5},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":748,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":70,"acting":70,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575043,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302556,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069284,"statfs":{"total":96636764160,"available":96326946816,"internally_reserved":0,"allocated":1396736,"data_stored":697239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.371,"5min":0.315,"15min":0.23899999999999999},"max":{"1min":0.72399999999999998,"5min":0.80400000000000005,"15min":0.81100000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57499999999999996,"15min":0.58199999999999996},"min":{"1min":0.41099999999999998,"5min":0.40699999999999997,"15min":0.32200000000000001},"max":{"1min":0.74099999999999999,"5min":0.78300000000000003,"15min":0.81899999999999995},"last":0.503}]},{"osd":1,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70899999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.442},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.32900000000000001,"5min":0.29899999999999999,"15min":0.28799999999999998},"max":{"1min":0.64000000000000001,"5min":0.76100000000000001,"15min":0.82499999999999996},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53800000000000003,"15min":0.54900000000000004},"min":{"1min":0.37,"5min":0.33500000000000002,"15min":0.32800000000000001},"max":{"1min":0.68200000000000005,"5min":0.77000000000000002,"15min":0.78300000000000003},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.38800000000000001,"5min":0.35399999999999998,"15min":0.28699999999999998},"max":{"1min":0.70499999999999996,"5min":0.73799999999999999,"15min":0.83899999999999997},"last":0.53700000000000003}]},{"osd":3,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.53400000000000003,"15min":0.54100000000000004},"min":{"1min":0.378,"5min":0.36499999999999999,"15min":0.33200000000000002},"max":{"1min":0.65700000000000003,"5min":0.754,"15min":0.78000000000000003},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56999999999999995,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.40799999999999997,"15min":0.33900000000000002},"max":{"1min":0.67500000000000004,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.54800000000000004}]},{"osd":4,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44600000000000001,"15min":0.45800000000000002},"min":{"1min":0.32400000000000001,"5min":0.313,"15min":0.29699999999999999},"max":{"1min":0.55000000000000004,"5min":0.77000000000000002,"15min":0.79900000000000004},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.30099999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59899999999999998,"5min":0.75800000000000001,"15min":1.3180000000000001},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.48399999999999999,"15min":0.49099999999999999},"min":{"1min":0.317,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58699999999999997,"5min":0.80000000000000004,"15min":0.82899999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.61199999999999999,"5min":0.79300000000000004,"15min":0.872},"last":0.45800000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.69699999999999995,"5min":0.81200000000000006,"15min":0.85199999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.33700000000000002},"max":{"1min":0.67300000000000004,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.47499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575041,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302500,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069340,"statfs":{"total":96636764160,"available":96327004160,"internally_reserved":0,"allocated":1339392,"data_stored":670288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.57099999999999995},"min":{"1min":0.38100000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72899999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.498},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56499999999999995,"15min":0.58699999999999997},"min":{"1min":0.46300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.748,"5min":0.79600000000000004,"15min":0.89300000000000002},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54600000000000004,"15min":0.56399999999999995},"min":{"1min":0.32800000000000001,"5min":0.30599999999999999,"15min":0.26400000000000001},"max":{"1min":0.75800000000000001,"5min":0.76900000000000002,"15min":0.82799999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58199999999999996,"15min":0.59899999999999998},"min":{"1min":0.45100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.751,"5min":0.82499999999999996,"15min":0.85199999999999998},"last":0.54600000000000004}]},{"osd":2,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56000000000000005,"15min":0.57299999999999995},"min":{"1min":0.371,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.77500000000000002,"5min":0.79900000000000004,"15min":0.82599999999999996},"last":0.376},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.40699999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76100000000000001,"5min":0.80900000000000005,"15min":0.82499999999999996},"last":0.53400000000000003}]},{"osd":3,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51100000000000001,"15min":0.53200000000000003},"min":{"1min":0.40400000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71899999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73499999999999999,"5min":0.75600000000000001,"15min":0.79600000000000004},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44600000000000001,"15min":0.45300000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.84199999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46100000000000002,"15min":0.47799999999999998},"min":{"1min":0.34999999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.746,"5min":0.76000000000000001,"15min":0.83899999999999997},"last":0.46700000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.45900000000000002,"15min":0.47199999999999998},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.28299999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.496,"15min":0.50700000000000001},"min":{"1min":0.38400000000000001,"5min":0.33500000000000002,"15min":0.31900000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.42099999999999999}]},{"osd":7,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.34499999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.74199999999999999,"5min":0.80700000000000005,"15min":0.93200000000000005},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55100000000000005,"15min":0.56299999999999994},"min":{"1min":0.43099999999999999,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.86499999999999999},"last":0.48699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575042,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306644,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065196,"statfs":{"total":96636764160,"available":96322760704,"internally_reserved":0,"allocated":1388544,"data_stored":697183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.378,"15min":0.35999999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23000000000000001},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.48699999999999999,"15min":0.47199999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.309},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.375}]},{"osd":2,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.38900000000000001},"min":{"1min":0.249,"5min":0.215,"15min":0.215},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.502},"min":{"1min":0.36499999999999999,"5min":0.33400000000000002,"15min":0.29499999999999998},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.46600000000000003,"15min":0.45200000000000001},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.23899999999999999},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.436},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.44800000000000001,"15min":0.435},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.40100000000000002}]},{"osd":4,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.35499999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.83499999999999996,"5min":0.88500000000000001,"15min":0.89100000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.61899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.39900000000000002},"max":{"1min":0.85099999999999998,"5min":0.97599999999999998,"15min":1.111},"last":0.623}]},{"osd":5,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.46500000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.39600000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.91300000000000003},"last":0.64100000000000001}]},{"osd":6,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.64800000000000002,"15min":0.65900000000000003},"min":{"1min":0.46500000000000002,"5min":0.39700000000000002,"15min":0.39600000000000002},"max":{"1min":0.91000000000000003,"5min":0.92700000000000005,"15min":1.0600000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66100000000000003,"15min":0.66500000000000004},"min":{"1min":0.437,"5min":0.433,"15min":0.379},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.39900000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.94199999999999995},"last":0.54600000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575042,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302568,"kb_used_data":1376,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069272,"statfs":{"total":96636764160,"available":96326934528,"internally_reserved":0,"allocated":1409024,"data_stored":698021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.35999999999999999,"15min":0.36499999999999999},"min":{"1min":0.24299999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.498,"5min":0.54700000000000004,"15min":0.71199999999999997},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.374,"15min":0.38400000000000001},"min":{"1min":0.26900000000000002,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.55600000000000005,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.377,"15min":0.38600000000000001},"min":{"1min":0.26700000000000002,"5min":0.24399999999999999,"15min":0.23899999999999999},"max":{"1min":0.47499999999999998,"5min":0.58899999999999997,"15min":0.623},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.438,"15min":0.45700000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.57099999999999995,"5min":0.63400000000000001,"15min":0.70499999999999996},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.41099999999999998,"15min":0.42799999999999999},"min":{"1min":0.29199999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.53900000000000003,"5min":0.629,"15min":0.70999999999999996},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.42199999999999999,"15min":0.44},"min":{"1min":0.29699999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54600000000000004,"5min":0.64700000000000002,"15min":0.68799999999999994},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.58499999999999996,"15min":0.60199999999999998},"min":{"1min":0.34999999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.624,"5min":0.82599999999999996,"15min":0.96099999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.60699999999999998,"15min":0.61899999999999999},"min":{"1min":0.379,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76400000000000001,"5min":0.86899999999999999,"15min":0.98599999999999999},"last":0.503}]},{"osd":5,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.59399999999999997,"15min":0.60099999999999998},"min":{"1min":0.41199999999999998,"5min":0.39200000000000002,"15min":0.36199999999999999},"max":{"1min":0.72099999999999997,"5min":0.86799999999999999,"15min":1.0109999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.61199999999999999,"15min":0.626},"min":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.38},"max":{"1min":0.69199999999999995,"5min":0.90100000000000002,"15min":1.004},"last":0.54300000000000004}]},{"osd":6,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.625,"15min":0.64100000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.78700000000000003,"5min":0.89800000000000002,"15min":1.002},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.438,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.752,"5min":0.89300000000000002,"15min":0.96799999999999997},"last":0.53400000000000003}]},{"osd":7,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.63800000000000001,"15min":0.64900000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.68799999999999994,"5min":0.94499999999999995,"15min":1.0129999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.66900000000000004,"15min":0.68500000000000005},"min":{"1min":0.436,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.73299999999999998,"5min":0.93799999999999994,"15min":1.026},"last":0.46700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575042,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306644,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065196,"statfs":{"total":96636764160,"available":96322760704,"internally_reserved":0,"allocated":1388544,"data_stored":697183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.42699999999999999,"15min":0.40200000000000002},"min":{"1min":0.27700000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":3.4729999999999999,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.44700000000000001,"15min":0.437},"min":{"1min":0.312,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":0.38700000000000001}]},{"osd":1,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.51300000000000001,"15min":0.46300000000000002},"min":{"1min":0.28699999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":6.1210000000000004,"5min":6.1210000000000004,"15min":6.1210000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.52900000000000003,"15min":0.48899999999999999},"min":{"1min":0.34999999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":5.7270000000000003,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.441}]},{"osd":3,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38600000000000001,"15min":0.40000000000000002},"min":{"1min":0.27800000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.48799999999999999,"5min":0.63500000000000001,"15min":0.86199999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47299999999999998,"15min":0.46700000000000003},"min":{"1min":0.29699999999999999,"5min":0.26900000000000002,"15min":0.26200000000000001},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.69699999999999995,"15min":0.64200000000000002},"min":{"1min":0.432,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":8.7170000000000005,"5min":8.7170000000000005,"15min":8.7170000000000005},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.381,"5min":1.492,"15min":1.492},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.65600000000000003,"15min":0.63900000000000001},"min":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.44400000000000001,"5min":0.38900000000000001,"15min":0.38100000000000001},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.70599999999999996}]},{"osd":6,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61399999999999999,"15min":0.623},"min":{"1min":0.40899999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95999999999999996,"5min":1.359,"15min":1.359},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":0.82399999999999995}]},{"osd":7,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.70699999999999996,"15min":0.68300000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.40300000000000002},"max":{"1min":4.6849999999999996,"5min":4.6849999999999996,"15min":4.6849999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.70099999999999996,"15min":0.69099999999999995},"min":{"1min":0.45700000000000002,"5min":0.433,"15min":0.41499999999999998},"max":{"1min":4.5039999999999996,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.80200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575042,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306652,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065188,"statfs":{"total":96636764160,"available":96322752512,"internally_reserved":0,"allocated":1396736,"data_stored":698145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.34799999999999998,"15min":0.36399999999999999},"min":{"1min":0.222,"5min":0.219,"15min":0.217},"max":{"1min":0.46600000000000003,"5min":0.56599999999999995,"15min":0.66200000000000003},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.39500000000000002,"15min":0.40200000000000002},"min":{"1min":0.26700000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.48699999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.37,"15min":0.38600000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.51500000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.40999999999999998,"15min":0.42999999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.25900000000000001},"max":{"1min":0.59699999999999998,"5min":0.65900000000000003,"15min":0.84399999999999997},"last":0.34000000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.435,"15min":0.45000000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.26000000000000001},"max":{"1min":0.61799999999999999,"5min":0.72999999999999998,"15min":0.94899999999999995},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.49399999999999999,"15min":0.50900000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67100000000000004,"5min":1.054,"15min":1.054},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58699999999999997,"15min":0.60599999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.755,"5min":0.91500000000000004,"15min":0.97599999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59599999999999997,"15min":0.61299999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.70399999999999996,"5min":0.86799999999999999,"15min":0.91400000000000003},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.58099999999999996,"15min":0.60999999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80200000000000005,"5min":0.85399999999999998,"15min":0.98399999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61899999999999999,"15min":0.63800000000000001},"min":{"1min":0.372,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77300000000000002,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61799999999999999,"15min":0.64400000000000002},"min":{"1min":0.39800000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79900000000000004,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.626,"15min":0.64700000000000002},"min":{"1min":0.45000000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78900000000000003,"5min":0.89500000000000002,"15min":1.0389999999999999},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.64000000000000001,"15min":0.66200000000000003},"min":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.39100000000000001},"max":{"1min":0.80200000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63700000000000001,"15min":0.66100000000000003},"min":{"1min":0.45800000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79000000000000004,"5min":0.98999999999999999,"15min":1.004},"last":0.67500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575041,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302500,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069340,"statfs":{"total":96636764160,"available":96327004160,"internally_reserved":0,"allocated":1339392,"data_stored":670288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.53100000000000003},"min":{"1min":0.32200000000000001,"5min":0.28299999999999997,"15min":0.27500000000000002},"max":{"1min":0.72299999999999998,"5min":0.752,"15min":0.80900000000000005},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.38900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.66500000000000004,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52100000000000002,"15min":0.54200000000000004},"min":{"1min":0.35699999999999998,"5min":0.26900000000000002,"15min":0.25800000000000001},"max":{"1min":0.67600000000000005,"5min":0.73799999999999999,"15min":0.79600000000000004},"last":0.373},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.41899999999999998,"5min":0.317,"15min":0.246},"max":{"1min":0.67800000000000005,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56100000000000005,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.376,"15min":0.27800000000000002},"max":{"1min":0.73799999999999999,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.59399999999999997},"min":{"1min":0.373,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77300000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.54800000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32900000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55600000000000005,"15min":0.57099999999999995},"min":{"1min":0.438,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.80600000000000005},"last":0.46700000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.44600000000000001,"15min":0.443},"min":{"1min":0.35299999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.73599999999999999,"5min":1.272,"15min":1.272},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.46700000000000003,"15min":0.46000000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29199999999999998},"max":{"1min":0.83399999999999996,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.39100000000000001}]},{"osd":6,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51200000000000001,"15min":0.503},"min":{"1min":0.34699999999999998,"5min":0.34399999999999997,"15min":0.314},"max":{"1min":0.997,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55500000000000005,"15min":0.53900000000000003},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.33800000000000002},"max":{"1min":0.86499999999999999,"5min":1.129,"15min":1.129},"last":0.54100000000000004}]},{"osd":7,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.29899999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.82199999999999995},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57699999999999996,"15min":0.57099999999999995},"min":{"1min":0.45400000000000001,"5min":0.38600000000000001,"15min":0.34599999999999997},"max":{"1min":0.91500000000000004,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.59699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575041,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302500,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069340,"statfs":{"total":96636764160,"available":96327004160,"internally_reserved":0,"allocated":1339392,"data_stored":670288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68500000000000005,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.502},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52400000000000002,"15min":0.53100000000000003},"min":{"1min":0.36599999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.69299999999999995,"5min":0.70299999999999996,"15min":0.81799999999999995},"last":0.38100000000000001}]},{"osd":1,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.38400000000000001,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.72399999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53300000000000003,"15min":0.54800000000000004},"min":{"1min":0.36799999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.77000000000000002},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58199999999999996,"15min":0.58899999999999997},"min":{"1min":0.44800000000000001,"5min":0.34399999999999997,"15min":0.30599999999999999},"max":{"1min":0.72499999999999998,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.437,"5min":0.378,"15min":0.34499999999999997},"max":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53700000000000003,"15min":0.54800000000000004},"min":{"1min":0.40799999999999997,"5min":0.36699999999999999,"15min":0.36399999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.73799999999999999},"last":0.433},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55400000000000005,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.82099999999999995},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.41999999999999998,"15min":0.439},"min":{"1min":0.28299999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.66700000000000004,"5min":0.72299999999999998,"15min":0.74299999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.45800000000000002,"15min":0.46600000000000003},"min":{"1min":0.30599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.628,"5min":0.69499999999999995,"15min":0.77600000000000002},"last":0.48799999999999999}]},{"osd":6,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.47399999999999998,"15min":0.48599999999999999},"min":{"1min":0.32200000000000001,"5min":0.29599999999999999,"15min":0.28499999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.82099999999999995},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54100000000000004,"15min":0.55000000000000004},"min":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.69699999999999995,"5min":0.79900000000000004,"15min":0.88200000000000001},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51700000000000002,"15min":0.52600000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.64900000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55900000000000005,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.84599999999999997},"last":0.58099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:23:37.817 INFO:tasks.ceph.mds.c.smithi049.stderr:2023-11-30T17:23:37.815+0000 7f80ca3ff700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-30T17:23:40.457 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:23:40.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.586+0000 7fb01ff75700 1 Processor -- start 2023-11-30T17:23:40.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.587+0000 7fb01ff75700 1 -- start start 2023-11-30T17:23:40.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.587+0000 7fb01ff75700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb0181548c0 0x7fb01806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:40.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.587+0000 7fb01ff75700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0180c69a0 con 0x7fb0180c6e30 2023-11-30T17:23:40.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.587+0000 7fb01ff75700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0180c13a0 con 0x7fb0181544e0 2023-11-30T17:23:40.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.587+0000 7fb01ff75700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0180c1680 con 0x7fb0181548c0 2023-11-30T17:23:40.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.588+0000 7fb01d510700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb0181548c0 0x7fb01806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:40.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.588+0000 7fb01e512700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb0180c6e30 0x7fb0180a8000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38438/0 (socket says 172.21.15.49:38438) 2023-11-30T17:23:40.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.588+0000 7fb01e512700 1 -- 172.21.15.49:0/4068721772 learned_addr learned my addr 172.21.15.49:0/4068721772 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:40.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.588+0000 7fb01d510700 1 -- 172.21.15.49:0/4068721772 >> v1:172.21.15.115:6789/0 conn(0x7fb0181544e0 legacy=0x7fb0180c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:40.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.588+0000 7fb01d510700 1 -- 172.21.15.49:0/4068721772 >> v1:172.21.15.49:6789/0 conn(0x7fb0180c6e30 legacy=0x7fb0180a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:40.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.588+0000 7fb01cd0f700 1 -- 172.21.15.49:0/4068721772 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4093719042 0 0) 0x7fb0180c69a0 con 0x7fb0180c6e30 2023-11-30T17:23:40.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.588+0000 7fb01d510700 1 -- 172.21.15.49:0/4068721772 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0180c6630 con 0x7fb0181548c0 2023-11-30T17:23:40.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.588+0000 7fb01d510700 1 --2- 172.21.15.49:0/4068721772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0181548c0 0x7fb01806a610 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7fb00c009760 tx=0x7fb00c009060).ready entity=mon.0 client_cookie=533ee0a2bd21b41b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:40.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.588+0000 7fb01cd0f700 1 -- 172.21.15.49:0/4068721772 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c00b580 con 0x7fb0181548c0 2023-11-30T17:23:40.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.588+0000 7fb01cd0f700 1 -- 172.21.15.49:0/4068721772 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00c00b6e0 con 0x7fb0181548c0 2023-11-30T17:23:40.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.588+0000 7fb01cd0f700 1 -- 172.21.15.49:0/4068721772 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c00ba60 con 0x7fb0181548c0 2023-11-30T17:23:40.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.589+0000 7fb01ff75700 1 -- 172.21.15.49:0/4068721772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0181548c0 msgr2=0x7fb01806a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:40.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.589+0000 7fb01ff75700 1 --2- 172.21.15.49:0/4068721772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0181548c0 0x7fb01806a610 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7fb00c009760 tx=0x7fb00c009060).stop 2023-11-30T17:23:40.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.589+0000 7fb01ff75700 1 -- 172.21.15.49:0/4068721772 shutdown_connections 2023-11-30T17:23:40.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.589+0000 7fb01ff75700 1 --2- 172.21.15.49:0/4068721772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0181548c0 0x7fb01806a610 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:40.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.589+0000 7fb01ff75700 1 -- 172.21.15.49:0/4068721772 >> 172.21.15.49:0/4068721772 conn(0x7fb018085020 msgr2=0x7fb018094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:40.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.589+0000 7fb01ff75700 1 -- 172.21.15.49:0/4068721772 shutdown_connections 2023-11-30T17:23:40.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.589+0000 7fb01ff75700 1 -- 172.21.15.49:0/4068721772 wait complete. 2023-11-30T17:23:40.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.590+0000 7fb01ff75700 1 Processor -- start 2023-11-30T17:23:40.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.590+0000 7fb01ff75700 1 -- start start 2023-11-30T17:23:40.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.591+0000 7fb01ff75700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0180c6e30 0x7fb018152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:40.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.591+0000 7fb01ff75700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0181544e0 0x7fb0180c4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:40.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.591+0000 7fb01ff75700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0181548c0 0x7fb0180c4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:40.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.591+0000 7fb01ff75700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0180c4e60 con 0x7fb0181548c0 2023-11-30T17:23:40.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.591+0000 7fb01ff75700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb018097d50 con 0x7fb0181544e0 2023-11-30T17:23:40.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.591+0000 7fb01ff75700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb018098030 con 0x7fb0180c6e30 2023-11-30T17:23:40.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.591+0000 7fb01e512700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0181548c0 0x7fb0180c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:40.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.591+0000 7fb01e512700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0181548c0 0x7fb0180c4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54552/0 (socket says 172.21.15.49:54552) 2023-11-30T17:23:40.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.591+0000 7fb01e512700 1 -- 172.21.15.49:0/2501322963 learned_addr learned my addr 172.21.15.49:0/2501322963 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:40.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.591+0000 7fb01dd11700 1 --2- 172.21.15.49:0/2501322963 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0180c6e30 0x7fb018152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:40.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.591+0000 7fb01d510700 1 --2- 172.21.15.49:0/2501322963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0181544e0 0x7fb0180c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:40.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.591+0000 7fb01e512700 1 -- 172.21.15.49:0/2501322963 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0180c6e30 msgr2=0x7fb018152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:40.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.591+0000 7fb01e512700 1 --2- 172.21.15.49:0/2501322963 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0180c6e30 0x7fb018152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:40.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.591+0000 7fb01e512700 1 -- 172.21.15.49:0/2501322963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0181544e0 msgr2=0x7fb0180c4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:40.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.591+0000 7fb01e512700 1 --2- 172.21.15.49:0/2501322963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0181544e0 0x7fb0180c4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:40.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.591+0000 7fb01e512700 1 -- 172.21.15.49:0/2501322963 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00c0092a0 con 0x7fb0181548c0 2023-11-30T17:23:40.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.591+0000 7fb01dd11700 1 --2- 172.21.15.49:0/2501322963 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0180c6e30 0x7fb018152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:23:40.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.591+0000 7fb01e512700 1 --2- 172.21.15.49:0/2501322963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0181548c0 0x7fb0180c4970 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7fb01000c490 tx=0x7fb010007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:40.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.592+0000 7fb015ffb700 1 -- 172.21.15.49:0/2501322963 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01000ce90 con 0x7fb0181548c0 2023-11-30T17:23:40.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.592+0000 7fb015ffb700 1 -- 172.21.15.49:0/2501322963 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0100072e0 con 0x7fb0181548c0 2023-11-30T17:23:40.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.592+0000 7fb015ffb700 1 -- 172.21.15.49:0/2501322963 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0100057a0 con 0x7fb0181548c0 2023-11-30T17:23:40.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.592+0000 7fb01ff75700 1 -- 172.21.15.49:0/2501322963 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb018098310 con 0x7fb0181548c0 2023-11-30T17:23:40.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.592+0000 7fb01ff75700 1 -- 172.21.15.49:0/2501322963 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0180988d0 con 0x7fb0181548c0 2023-11-30T17:23:40.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.593+0000 7fb01ff75700 1 -- 172.21.15.49:0/2501322963 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01806a900 con 0x7fb0181548c0 2023-11-30T17:23:40.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.593+0000 7fb015ffb700 1 -- 172.21.15.49:0/2501322963 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb010005b50 con 0x7fb0181548c0 2023-11-30T17:23:40.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.593+0000 7fb015ffb700 1 --2- 172.21.15.49:0/2501322963 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb00405f270 0x7fb004061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:40.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.593+0000 7fb015ffb700 1 -- 172.21.15.49:0/2501322963 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fb010079a20 con 0x7fb0181548c0 2023-11-30T17:23:40.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.594+0000 7fb01dd11700 1 --2- 172.21.15.49:0/2501322963 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb00405f270 0x7fb004061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:40.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.594+0000 7fb01dd11700 1 --2- 172.21.15.49:0/2501322963 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb00405f270 0x7fb004061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fb008007fd0 tx=0x7fb008009040).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:40.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.598+0000 7fb015ffb700 1 -- 172.21.15.49:0/2501322963 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb01004ab50 con 0x7fb0181548c0 2023-11-30T17:23:40.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.766+0000 7fb01ff75700 1 -- 172.21.15.49:0/2501322963 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb0180c6250 con 0x7fb00405f270 2023-11-30T17:23:40.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.776+0000 7fb015ffb700 1 -- 172.21.15.49:0/2501322963 <== mgr.6107 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361873 (secure 0 0 0) 0x7fb0180c6250 con 0x7fb00405f270 2023-11-30T17:23:40.782 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:40.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.780+0000 7fb01ff75700 1 -- 172.21.15.49:0/2501322963 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb00405f270 msgr2=0x7fb004061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:40.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.780+0000 7fb01ff75700 1 --2- 172.21.15.49:0/2501322963 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb00405f270 0x7fb004061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fb008007fd0 tx=0x7fb008009040).stop 2023-11-30T17:23:40.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.780+0000 7fb01ff75700 1 -- 172.21.15.49:0/2501322963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0181548c0 msgr2=0x7fb0180c4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:40.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.780+0000 7fb01ff75700 1 --2- 172.21.15.49:0/2501322963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0181548c0 0x7fb0180c4970 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7fb01000c490 tx=0x7fb010007dd0).stop 2023-11-30T17:23:40.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.780+0000 7fb01ff75700 1 -- 172.21.15.49:0/2501322963 shutdown_connections 2023-11-30T17:23:40.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.780+0000 7fb01ff75700 1 --2- 172.21.15.49:0/2501322963 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb00405f270 0x7fb004061730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:40.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.780+0000 7fb01ff75700 1 --2- 172.21.15.49:0/2501322963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0181548c0 0x7fb0180c4970 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:40.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.780+0000 7fb01ff75700 1 --2- 172.21.15.49:0/2501322963 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0180c6e30 0x7fb018152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:40.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.780+0000 7fb01ff75700 1 --2- 172.21.15.49:0/2501322963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0181544e0 0x7fb0180c4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:40.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.780+0000 7fb01ff75700 1 -- 172.21.15.49:0/2501322963 >> 172.21.15.49:0/2501322963 conn(0x7fb018085020 msgr2=0x7fb0180ca560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:40.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.780+0000 7fb01ff75700 1 -- 172.21.15.49:0/2501322963 shutdown_connections 2023-11-30T17:23:40.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.780+0000 7fb01ff75700 1 -- 172.21.15.49:0/2501322963 wait complete. 2023-11-30T17:23:40.785 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:23:40.793 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-11-30T17:23:39.456392+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":229,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2432736,"kb_used_data":10912,"kb_used_omap":0,"kb_used_meta":2421760,"kb_avail":752541984,"statfs":{"total":773094113280,"available":770602991616,"internally_reserved":0,"allocated":11173888,"data_stored":5582076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2479882240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3990,"num_objects":-12,"num_object_clones":0,"num_object_copies":-24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-35,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.012434"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977592+0000","last_change":"2023-11-30T17:23:31.973969+0000","last_active":"2023-11-30T17:23:31.977592+0000","last_peered":"2023-11-30T17:23:31.977592+0000","last_clean":"2023-11-30T17:23:31.977592+0000","last_became_active":"2023-11-30T17:23:31.973692+0000","last_became_peered":"2023-11-30T17:23:31.973692+0000","last_unstale":"2023-11-30T17:23:31.977592+0000","last_undegraded":"2023-11-30T17:23:31.977592+0000","last_fullsized":"2023-11-30T17:23:31.977592+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"112'3","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.971973+0000","last_change":"2023-11-30T17:23:31.576052+0000","last_active":"2023-11-30T17:23:31.971973+0000","last_peered":"2023-11-30T17:23:31.971973+0000","last_clean":"2023-11-30T17:23:31.971973+0000","last_became_active":"2023-11-30T17:23:31.575817+0000","last_became_peered":"2023-11-30T17:23:31.575817+0000","last_unstale":"2023-11-30T17:23:31.971973+0000","last_undegraded":"2023-11-30T17:23:31.971973+0000","last_fullsized":"2023-11-30T17:23:31.971973+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.973913+0000","last_change":"2023-11-30T17:23:31.969054+0000","last_active":"2023-11-30T17:23:31.973913+0000","last_peered":"2023-11-30T17:23:31.973913+0000","last_clean":"2023-11-30T17:23:31.973913+0000","last_became_active":"2023-11-30T17:23:31.968764+0000","last_became_peered":"2023-11-30T17:23:31.968764+0000","last_unstale":"2023-11-30T17:23:31.973913+0000","last_undegraded":"2023-11-30T17:23:31.973913+0000","last_fullsized":"2023-11-30T17:23:31.973913+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969654+0000","last_change":"2023-11-30T17:23:31.571935+0000","last_active":"2023-11-30T17:23:31.969654+0000","last_peered":"2023-11-30T17:23:31.969654+0000","last_clean":"2023-11-30T17:23:31.969654+0000","last_became_active":"2023-11-30T17:23:31.571639+0000","last_became_peered":"2023-11-30T17:23:31.571639+0000","last_unstale":"2023-11-30T17:23:31.969654+0000","last_undegraded":"2023-11-30T17:23:31.969654+0000","last_fullsized":"2023-11-30T17:23:31.969654+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.974874+0000","last_change":"2023-11-30T17:23:31.970204+0000","last_active":"2023-11-30T17:23:31.974874+0000","last_peered":"2023-11-30T17:23:31.974874+0000","last_clean":"2023-11-30T17:23:31.974874+0000","last_became_active":"2023-11-30T17:23:31.969842+0000","last_became_peered":"2023-11-30T17:23:31.969842+0000","last_unstale":"2023-11-30T17:23:31.974874+0000","last_undegraded":"2023-11-30T17:23:31.974874+0000","last_fullsized":"2023-11-30T17:23:31.974874+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.952182+0000","last_change":"2023-11-30T17:23:31.576188+0000","last_active":"2023-11-30T17:23:31.952182+0000","last_peered":"2023-11-30T17:23:31.952182+0000","last_clean":"2023-11-30T17:23:31.952182+0000","last_became_active":"2023-11-30T17:23:31.575896+0000","last_became_peered":"2023-11-30T17:23:31.575896+0000","last_unstale":"2023-11-30T17:23:31.952182+0000","last_undegraded":"2023-11-30T17:23:31.952182+0000","last_fullsized":"2023-11-30T17:23:31.952182+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966946+0000","last_change":"2023-11-30T17:23:31.965487+0000","last_active":"2023-11-30T17:23:31.966946+0000","last_peered":"2023-11-30T17:23:31.966946+0000","last_clean":"2023-11-30T17:23:31.966946+0000","last_became_active":"2023-11-30T17:23:31.965068+0000","last_became_peered":"2023-11-30T17:23:31.965068+0000","last_unstale":"2023-11-30T17:23:31.966946+0000","last_undegraded":"2023-11-30T17:23:31.966946+0000","last_fullsized":"2023-11-30T17:23:31.966946+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3c","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.975114+0000","last_change":"2023-11-30T17:23:31.578786+0000","last_active":"2023-11-30T17:23:31.975114+0000","last_peered":"2023-11-30T17:23:31.975114+0000","last_clean":"2023-11-30T17:23:31.975114+0000","last_became_active":"2023-11-30T17:23:31.578524+0000","last_became_peered":"2023-11-30T17:23:31.578524+0000","last_unstale":"2023-11-30T17:23:31.975114+0000","last_undegraded":"2023-11-30T17:23:31.975114+0000","last_fullsized":"2023-11-30T17:23:31.975114+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977330+0000","last_change":"2023-11-30T17:23:31.972469+0000","last_active":"2023-11-30T17:23:31.977330+0000","last_peered":"2023-11-30T17:23:31.977330+0000","last_clean":"2023-11-30T17:23:31.977330+0000","last_became_active":"2023-11-30T17:23:31.971919+0000","last_became_peered":"2023-11-30T17:23:31.971919+0000","last_unstale":"2023-11-30T17:23:31.977330+0000","last_undegraded":"2023-11-30T17:23:31.977330+0000","last_fullsized":"2023-11-30T17:23:31.977330+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3b","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966480+0000","last_change":"2023-11-30T17:23:31.584812+0000","last_active":"2023-11-30T17:23:31.966480+0000","last_peered":"2023-11-30T17:23:31.966480+0000","last_clean":"2023-11-30T17:23:31.966480+0000","last_became_active":"2023-11-30T17:23:31.584447+0000","last_became_peered":"2023-11-30T17:23:31.584447+0000","last_unstale":"2023-11-30T17:23:31.966480+0000","last_undegraded":"2023-11-30T17:23:31.966480+0000","last_fullsized":"2023-11-30T17:23:31.966480+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.961374+0000","last_change":"2023-11-30T17:23:31.957683+0000","last_active":"2023-11-30T17:23:31.961374+0000","last_peered":"2023-11-30T17:23:31.961374+0000","last_clean":"2023-11-30T17:23:31.961374+0000","last_became_active":"2023-11-30T17:23:31.957381+0000","last_became_peered":"2023-11-30T17:23:31.957381+0000","last_unstale":"2023-11-30T17:23:31.961374+0000","last_undegraded":"2023-11-30T17:23:31.961374+0000","last_fullsized":"2023-11-30T17:23:31.961374+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3a","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969051+0000","last_change":"2023-11-30T17:23:31.580184+0000","last_active":"2023-11-30T17:23:31.969051+0000","last_peered":"2023-11-30T17:23:31.969051+0000","last_clean":"2023-11-30T17:23:31.969051+0000","last_became_active":"2023-11-30T17:23:31.579899+0000","last_became_peered":"2023-11-30T17:23:31.579899+0000","last_unstale":"2023-11-30T17:23:31.969051+0000","last_undegraded":"2023-11-30T17:23:31.969051+0000","last_fullsized":"2023-11-30T17:23:31.969051+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976055+0000","last_change":"2023-11-30T17:23:31.973265+0000","last_active":"2023-11-30T17:23:31.976055+0000","last_peered":"2023-11-30T17:23:31.976055+0000","last_clean":"2023-11-30T17:23:31.976055+0000","last_became_active":"2023-11-30T17:23:31.972961+0000","last_became_peered":"2023-11-30T17:23:31.972961+0000","last_unstale":"2023-11-30T17:23:31.976055+0000","last_undegraded":"2023-11-30T17:23:31.976055+0000","last_fullsized":"2023-11-30T17:23:31.976055+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.953739+0000","last_change":"2023-11-30T17:23:31.575243+0000","last_active":"2023-11-30T17:23:31.953739+0000","last_peered":"2023-11-30T17:23:31.953739+0000","last_clean":"2023-11-30T17:23:31.953739+0000","last_became_active":"2023-11-30T17:23:31.574933+0000","last_became_peered":"2023-11-30T17:23:31.574933+0000","last_unstale":"2023-11-30T17:23:31.953739+0000","last_undegraded":"2023-11-30T17:23:31.953739+0000","last_fullsized":"2023-11-30T17:23:31.953739+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.970100+0000","last_change":"2023-11-30T17:23:31.965514+0000","last_active":"2023-11-30T17:23:31.970100+0000","last_peered":"2023-11-30T17:23:31.970100+0000","last_clean":"2023-11-30T17:23:31.970100+0000","last_became_active":"2023-11-30T17:23:31.964815+0000","last_became_peered":"2023-11-30T17:23:31.964815+0000","last_unstale":"2023-11-30T17:23:31.970100+0000","last_undegraded":"2023-11-30T17:23:31.970100+0000","last_fullsized":"2023-11-30T17:23:31.970100+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.963822+0000","last_change":"2023-11-30T17:23:31.571152+0000","last_active":"2023-11-30T17:23:31.963822+0000","last_peered":"2023-11-30T17:23:31.963822+0000","last_clean":"2023-11-30T17:23:31.963822+0000","last_became_active":"2023-11-30T17:23:31.570866+0000","last_became_peered":"2023-11-30T17:23:31.570866+0000","last_unstale":"2023-11-30T17:23:31.963822+0000","last_undegraded":"2023-11-30T17:23:31.963822+0000","last_fullsized":"2023-11-30T17:23:31.963822+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966866+0000","last_change":"2023-11-30T17:23:31.960188+0000","last_active":"2023-11-30T17:23:31.966866+0000","last_peered":"2023-11-30T17:23:31.966866+0000","last_clean":"2023-11-30T17:23:31.966866+0000","last_became_active":"2023-11-30T17:23:31.959891+0000","last_became_peered":"2023-11-30T17:23:31.959891+0000","last_unstale":"2023-11-30T17:23:31.966866+0000","last_undegraded":"2023-11-30T17:23:31.966866+0000","last_fullsized":"2023-11-30T17:23:31.966866+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.965676+0000","last_change":"2023-11-30T17:23:31.579256+0000","last_active":"2023-11-30T17:23:31.965676+0000","last_peered":"2023-11-30T17:23:31.965676+0000","last_clean":"2023-11-30T17:23:31.965676+0000","last_became_active":"2023-11-30T17:23:31.578967+0000","last_became_peered":"2023-11-30T17:23:31.578967+0000","last_unstale":"2023-11-30T17:23:31.965676+0000","last_undegraded":"2023-11-30T17:23:31.965676+0000","last_fullsized":"2023-11-30T17:23:31.965676+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.974915+0000","last_change":"2023-11-30T17:23:31.971145+0000","last_active":"2023-11-30T17:23:31.974915+0000","last_peered":"2023-11-30T17:23:31.974915+0000","last_clean":"2023-11-30T17:23:31.974915+0000","last_became_active":"2023-11-30T17:23:31.970832+0000","last_became_peered":"2023-11-30T17:23:31.970832+0000","last_unstale":"2023-11-30T17:23:31.974915+0000","last_undegraded":"2023-11-30T17:23:31.974915+0000","last_fullsized":"2023-11-30T17:23:31.974915+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.949309+0000","last_change":"2023-11-30T17:23:31.575398+0000","last_active":"2023-11-30T17:23:31.949309+0000","last_peered":"2023-11-30T17:23:31.949309+0000","last_clean":"2023-11-30T17:23:31.949309+0000","last_became_active":"2023-11-30T17:23:31.575126+0000","last_became_peered":"2023-11-30T17:23:31.575126+0000","last_unstale":"2023-11-30T17:23:31.949309+0000","last_undegraded":"2023-11-30T17:23:31.949309+0000","last_fullsized":"2023-11-30T17:23:31.949309+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.975777+0000","last_change":"2023-11-30T17:23:31.970303+0000","last_active":"2023-11-30T17:23:31.975777+0000","last_peered":"2023-11-30T17:23:31.975777+0000","last_clean":"2023-11-30T17:23:31.975777+0000","last_became_active":"2023-11-30T17:23:31.970018+0000","last_became_peered":"2023-11-30T17:23:31.970018+0000","last_unstale":"2023-11-30T17:23:31.975777+0000","last_undegraded":"2023-11-30T17:23:31.975777+0000","last_fullsized":"2023-11-30T17:23:31.975777+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969753+0000","last_change":"2023-11-30T17:23:31.578961+0000","last_active":"2023-11-30T17:23:31.969753+0000","last_peered":"2023-11-30T17:23:31.969753+0000","last_clean":"2023-11-30T17:23:31.969753+0000","last_became_active":"2023-11-30T17:23:31.578654+0000","last_became_peered":"2023-11-30T17:23:31.578654+0000","last_unstale":"2023-11-30T17:23:31.969753+0000","last_undegraded":"2023-11-30T17:23:31.969753+0000","last_fullsized":"2023-11-30T17:23:31.969753+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969327+0000","last_change":"2023-11-30T17:23:31.967277+0000","last_active":"2023-11-30T17:23:31.969327+0000","last_peered":"2023-11-30T17:23:31.969327+0000","last_clean":"2023-11-30T17:23:31.969327+0000","last_became_active":"2023-11-30T17:23:31.966923+0000","last_became_peered":"2023-11-30T17:23:31.966923+0000","last_unstale":"2023-11-30T17:23:31.969327+0000","last_undegraded":"2023-11-30T17:23:31.969327+0000","last_fullsized":"2023-11-30T17:23:31.969327+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.34","version":"112'4","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.978151+0000","last_change":"2023-11-30T17:23:31.574223+0000","last_active":"2023-11-30T17:23:31.978151+0000","last_peered":"2023-11-30T17:23:31.978151+0000","last_clean":"2023-11-30T17:23:31.978151+0000","last_became_active":"2023-11-30T17:23:31.573996+0000","last_became_peered":"2023-11-30T17:23:31.573996+0000","last_unstale":"2023-11-30T17:23:31.978151+0000","last_undegraded":"2023-11-30T17:23:31.978151+0000","last_fullsized":"2023-11-30T17:23:31.978151+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968400+0000","last_change":"2023-11-30T17:23:31.951742+0000","last_active":"2023-11-30T17:23:31.968400+0000","last_peered":"2023-11-30T17:23:31.968400+0000","last_clean":"2023-11-30T17:23:31.968400+0000","last_became_active":"2023-11-30T17:23:31.951124+0000","last_became_peered":"2023-11-30T17:23:31.951124+0000","last_unstale":"2023-11-30T17:23:31.968400+0000","last_undegraded":"2023-11-30T17:23:31.968400+0000","last_fullsized":"2023-11-30T17:23:31.968400+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.965240+0000","last_change":"2023-11-30T17:23:31.581506+0000","last_active":"2023-11-30T17:23:31.965240+0000","last_peered":"2023-11-30T17:23:31.965240+0000","last_clean":"2023-11-30T17:23:31.965240+0000","last_became_active":"2023-11-30T17:23:31.581285+0000","last_became_peered":"2023-11-30T17:23:31.581285+0000","last_unstale":"2023-11-30T17:23:31.965240+0000","last_undegraded":"2023-11-30T17:23:31.965240+0000","last_fullsized":"2023-11-30T17:23:31.965240+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.974647+0000","last_change":"2023-11-30T17:23:31.962794+0000","last_active":"2023-11-30T17:23:31.974647+0000","last_peered":"2023-11-30T17:23:31.974647+0000","last_clean":"2023-11-30T17:23:31.974647+0000","last_became_active":"2023-11-30T17:23:31.961702+0000","last_became_peered":"2023-11-30T17:23:31.961702+0000","last_unstale":"2023-11-30T17:23:31.974647+0000","last_undegraded":"2023-11-30T17:23:31.974647+0000","last_fullsized":"2023-11-30T17:23:31.974647+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.960078+0000","last_change":"2023-11-30T17:23:31.580372+0000","last_active":"2023-11-30T17:23:31.960078+0000","last_peered":"2023-11-30T17:23:31.960078+0000","last_clean":"2023-11-30T17:23:31.960078+0000","last_became_active":"2023-11-30T17:23:31.579716+0000","last_became_peered":"2023-11-30T17:23:31.579716+0000","last_unstale":"2023-11-30T17:23:31.960078+0000","last_undegraded":"2023-11-30T17:23:31.960078+0000","last_fullsized":"2023-11-30T17:23:31.960078+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.978098+0000","last_change":"2023-11-30T17:23:31.973389+0000","last_active":"2023-11-30T17:23:31.978098+0000","last_peered":"2023-11-30T17:23:31.978098+0000","last_clean":"2023-11-30T17:23:31.978098+0000","last_became_active":"2023-11-30T17:23:31.973041+0000","last_became_peered":"2023-11-30T17:23:31.973041+0000","last_unstale":"2023-11-30T17:23:31.978098+0000","last_undegraded":"2023-11-30T17:23:31.978098+0000","last_fullsized":"2023-11-30T17:23:31.978098+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.950162+0000","last_change":"2023-11-30T17:23:31.582624+0000","last_active":"2023-11-30T17:23:31.950162+0000","last_peered":"2023-11-30T17:23:31.950162+0000","last_clean":"2023-11-30T17:23:31.950162+0000","last_became_active":"2023-11-30T17:23:31.582166+0000","last_became_peered":"2023-11-30T17:23:31.582166+0000","last_unstale":"2023-11-30T17:23:31.950162+0000","last_undegraded":"2023-11-30T17:23:31.950162+0000","last_fullsized":"2023-11-30T17:23:31.950162+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.974718+0000","last_change":"2023-11-30T17:23:31.963277+0000","last_active":"2023-11-30T17:23:31.974718+0000","last_peered":"2023-11-30T17:23:31.974718+0000","last_clean":"2023-11-30T17:23:31.974718+0000","last_became_active":"2023-11-30T17:23:31.962955+0000","last_became_peered":"2023-11-30T17:23:31.962955+0000","last_unstale":"2023-11-30T17:23:31.974718+0000","last_undegraded":"2023-11-30T17:23:31.974718+0000","last_fullsized":"2023-11-30T17:23:31.974718+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.30","version":"112'4","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.973143+0000","last_change":"2023-11-30T17:23:31.577987+0000","last_active":"2023-11-30T17:23:31.973143+0000","last_peered":"2023-11-30T17:23:31.973143+0000","last_clean":"2023-11-30T17:23:31.973143+0000","last_became_active":"2023-11-30T17:23:31.577686+0000","last_became_peered":"2023-11-30T17:23:31.577686+0000","last_unstale":"2023-11-30T17:23:31.973143+0000","last_undegraded":"2023-11-30T17:23:31.973143+0000","last_fullsized":"2023-11-30T17:23:31.973143+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976863+0000","last_change":"2023-11-30T17:23:31.968097+0000","last_active":"2023-11-30T17:23:31.976863+0000","last_peered":"2023-11-30T17:23:31.976863+0000","last_clean":"2023-11-30T17:23:31.976863+0000","last_became_active":"2023-11-30T17:23:31.967788+0000","last_became_peered":"2023-11-30T17:23:31.967788+0000","last_unstale":"2023-11-30T17:23:31.976863+0000","last_undegraded":"2023-11-30T17:23:31.976863+0000","last_fullsized":"2023-11-30T17:23:31.976863+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.961043+0000","last_change":"2023-11-30T17:23:31.586269+0000","last_active":"2023-11-30T17:23:31.961043+0000","last_peered":"2023-11-30T17:23:31.961043+0000","last_clean":"2023-11-30T17:23:31.961043+0000","last_became_active":"2023-11-30T17:23:31.585935+0000","last_became_peered":"2023-11-30T17:23:31.585935+0000","last_unstale":"2023-11-30T17:23:31.961043+0000","last_undegraded":"2023-11-30T17:23:31.961043+0000","last_fullsized":"2023-11-30T17:23:31.961043+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.972142+0000","last_change":"2023-11-30T17:23:31.967793+0000","last_active":"2023-11-30T17:23:31.972142+0000","last_peered":"2023-11-30T17:23:31.972142+0000","last_clean":"2023-11-30T17:23:31.972142+0000","last_became_active":"2023-11-30T17:23:31.967419+0000","last_became_peered":"2023-11-30T17:23:31.967419+0000","last_unstale":"2023-11-30T17:23:31.972142+0000","last_undegraded":"2023-11-30T17:23:31.972142+0000","last_fullsized":"2023-11-30T17:23:31.972142+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.959018+0000","last_change":"2023-11-30T17:23:31.569565+0000","last_active":"2023-11-30T17:23:31.959018+0000","last_peered":"2023-11-30T17:23:31.959018+0000","last_clean":"2023-11-30T17:23:31.959018+0000","last_became_active":"2023-11-30T17:23:31.569226+0000","last_became_peered":"2023-11-30T17:23:31.569226+0000","last_unstale":"2023-11-30T17:23:31.959018+0000","last_undegraded":"2023-11-30T17:23:31.959018+0000","last_fullsized":"2023-11-30T17:23:31.959018+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.974805+0000","last_change":"2023-11-30T17:23:31.973956+0000","last_active":"2023-11-30T17:23:31.974805+0000","last_peered":"2023-11-30T17:23:31.974805+0000","last_clean":"2023-11-30T17:23:31.974805+0000","last_became_active":"2023-11-30T17:23:31.973675+0000","last_became_peered":"2023-11-30T17:23:31.973675+0000","last_unstale":"2023-11-30T17:23:31.974805+0000","last_undegraded":"2023-11-30T17:23:31.974805+0000","last_fullsized":"2023-11-30T17:23:31.974805+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.970067+0000","last_change":"2023-11-30T17:23:31.576721+0000","last_active":"2023-11-30T17:23:31.970067+0000","last_peered":"2023-11-30T17:23:31.970067+0000","last_clean":"2023-11-30T17:23:31.970067+0000","last_became_active":"2023-11-30T17:23:31.575699+0000","last_became_peered":"2023-11-30T17:23:31.575699+0000","last_unstale":"2023-11-30T17:23:31.970067+0000","last_undegraded":"2023-11-30T17:23:31.970067+0000","last_fullsized":"2023-11-30T17:23:31.970067+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968737+0000","last_change":"2023-11-30T17:23:31.964844+0000","last_active":"2023-11-30T17:23:31.968737+0000","last_peered":"2023-11-30T17:23:31.968737+0000","last_clean":"2023-11-30T17:23:31.968737+0000","last_became_active":"2023-11-30T17:23:31.961956+0000","last_became_peered":"2023-11-30T17:23:31.961956+0000","last_unstale":"2023-11-30T17:23:31.968737+0000","last_undegraded":"2023-11-30T17:23:31.968737+0000","last_fullsized":"2023-11-30T17:23:31.968737+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.957082+0000","last_change":"2023-11-30T17:23:31.575492+0000","last_active":"2023-11-30T17:23:31.957082+0000","last_peered":"2023-11-30T17:23:31.957082+0000","last_clean":"2023-11-30T17:23:31.957082+0000","last_became_active":"2023-11-30T17:23:31.573839+0000","last_became_peered":"2023-11-30T17:23:31.573839+0000","last_unstale":"2023-11-30T17:23:31.957082+0000","last_undegraded":"2023-11-30T17:23:31.957082+0000","last_fullsized":"2023-11-30T17:23:31.957082+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.967040+0000","last_change":"2023-11-30T17:23:31.965248+0000","last_active":"2023-11-30T17:23:31.967040+0000","last_peered":"2023-11-30T17:23:31.967040+0000","last_clean":"2023-11-30T17:23:31.967040+0000","last_became_active":"2023-11-30T17:23:31.964971+0000","last_became_peered":"2023-11-30T17:23:31.964971+0000","last_unstale":"2023-11-30T17:23:31.967040+0000","last_undegraded":"2023-11-30T17:23:31.967040+0000","last_fullsized":"2023-11-30T17:23:31.967040+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2b","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969966+0000","last_change":"2023-11-30T17:23:31.573926+0000","last_active":"2023-11-30T17:23:31.969966+0000","last_peered":"2023-11-30T17:23:31.969966+0000","last_clean":"2023-11-30T17:23:31.969966+0000","last_became_active":"2023-11-30T17:23:31.573565+0000","last_became_peered":"2023-11-30T17:23:31.573565+0000","last_unstale":"2023-11-30T17:23:31.969966+0000","last_undegraded":"2023-11-30T17:23:31.969966+0000","last_fullsized":"2023-11-30T17:23:31.969966+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977406+0000","last_change":"2023-11-30T17:23:31.964737+0000","last_active":"2023-11-30T17:23:31.977406+0000","last_peered":"2023-11-30T17:23:31.977406+0000","last_clean":"2023-11-30T17:23:31.977406+0000","last_became_active":"2023-11-30T17:23:31.964451+0000","last_became_peered":"2023-11-30T17:23:31.964451+0000","last_unstale":"2023-11-30T17:23:31.977406+0000","last_undegraded":"2023-11-30T17:23:31.977406+0000","last_fullsized":"2023-11-30T17:23:31.977406+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.971378+0000","last_change":"2023-11-30T17:23:31.579162+0000","last_active":"2023-11-30T17:23:31.971378+0000","last_peered":"2023-11-30T17:23:31.971378+0000","last_clean":"2023-11-30T17:23:31.971378+0000","last_became_active":"2023-11-30T17:23:31.578839+0000","last_became_peered":"2023-11-30T17:23:31.578839+0000","last_unstale":"2023-11-30T17:23:31.971378+0000","last_undegraded":"2023-11-30T17:23:31.971378+0000","last_fullsized":"2023-11-30T17:23:31.971378+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968353+0000","last_change":"2023-11-30T17:23:31.965680+0000","last_active":"2023-11-30T17:23:31.968353+0000","last_peered":"2023-11-30T17:23:31.968353+0000","last_clean":"2023-11-30T17:23:31.968353+0000","last_became_active":"2023-11-30T17:23:31.965390+0000","last_became_peered":"2023-11-30T17:23:31.965390+0000","last_unstale":"2023-11-30T17:23:31.968353+0000","last_undegraded":"2023-11-30T17:23:31.968353+0000","last_fullsized":"2023-11-30T17:23:31.968353+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.948853+0000","last_change":"2023-11-30T17:23:31.577343+0000","last_active":"2023-11-30T17:23:31.948853+0000","last_peered":"2023-11-30T17:23:31.948853+0000","last_clean":"2023-11-30T17:23:31.948853+0000","last_became_active":"2023-11-30T17:23:31.576994+0000","last_became_peered":"2023-11-30T17:23:31.576994+0000","last_unstale":"2023-11-30T17:23:31.948853+0000","last_undegraded":"2023-11-30T17:23:31.948853+0000","last_fullsized":"2023-11-30T17:23:31.948853+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.967787+0000","last_change":"2023-11-30T17:23:31.962909+0000","last_active":"2023-11-30T17:23:31.967787+0000","last_peered":"2023-11-30T17:23:31.967787+0000","last_clean":"2023-11-30T17:23:31.967787+0000","last_became_active":"2023-11-30T17:23:31.962632+0000","last_became_peered":"2023-11-30T17:23:31.962632+0000","last_unstale":"2023-11-30T17:23:31.967787+0000","last_undegraded":"2023-11-30T17:23:31.967787+0000","last_fullsized":"2023-11-30T17:23:31.967787+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.953484+0000","last_change":"2023-11-30T17:23:31.575050+0000","last_active":"2023-11-30T17:23:31.953484+0000","last_peered":"2023-11-30T17:23:31.953484+0000","last_clean":"2023-11-30T17:23:31.953484+0000","last_became_active":"2023-11-30T17:23:31.574230+0000","last_became_peered":"2023-11-30T17:23:31.574230+0000","last_unstale":"2023-11-30T17:23:31.953484+0000","last_undegraded":"2023-11-30T17:23:31.953484+0000","last_fullsized":"2023-11-30T17:23:31.953484+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976986+0000","last_change":"2023-11-30T17:23:31.970460+0000","last_active":"2023-11-30T17:23:31.976986+0000","last_peered":"2023-11-30T17:23:31.976986+0000","last_clean":"2023-11-30T17:23:31.976986+0000","last_became_active":"2023-11-30T17:23:31.970168+0000","last_became_peered":"2023-11-30T17:23:31.970168+0000","last_unstale":"2023-11-30T17:23:31.976986+0000","last_undegraded":"2023-11-30T17:23:31.976986+0000","last_fullsized":"2023-11-30T17:23:31.976986+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969686+0000","last_change":"2023-11-30T17:23:31.576651+0000","last_active":"2023-11-30T17:23:31.969686+0000","last_peered":"2023-11-30T17:23:31.969686+0000","last_clean":"2023-11-30T17:23:31.969686+0000","last_became_active":"2023-11-30T17:23:31.576386+0000","last_became_peered":"2023-11-30T17:23:31.576386+0000","last_unstale":"2023-11-30T17:23:31.969686+0000","last_undegraded":"2023-11-30T17:23:31.969686+0000","last_fullsized":"2023-11-30T17:23:31.969686+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968312+0000","last_change":"2023-11-30T17:23:31.966907+0000","last_active":"2023-11-30T17:23:31.968312+0000","last_peered":"2023-11-30T17:23:31.968312+0000","last_clean":"2023-11-30T17:23:31.968312+0000","last_became_active":"2023-11-30T17:23:31.966449+0000","last_became_peered":"2023-11-30T17:23:31.966449+0000","last_unstale":"2023-11-30T17:23:31.968312+0000","last_undegraded":"2023-11-30T17:23:31.968312+0000","last_fullsized":"2023-11-30T17:23:31.968312+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.951943+0000","last_change":"2023-11-30T17:23:31.586699+0000","last_active":"2023-11-30T17:23:31.951943+0000","last_peered":"2023-11-30T17:23:31.951943+0000","last_clean":"2023-11-30T17:23:31.951943+0000","last_became_active":"2023-11-30T17:23:31.586428+0000","last_became_peered":"2023-11-30T17:23:31.586428+0000","last_unstale":"2023-11-30T17:23:31.951943+0000","last_undegraded":"2023-11-30T17:23:31.951943+0000","last_fullsized":"2023-11-30T17:23:31.951943+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.974822+0000","last_change":"2023-11-30T17:23:31.970720+0000","last_active":"2023-11-30T17:23:31.974822+0000","last_peered":"2023-11-30T17:23:31.974822+0000","last_clean":"2023-11-30T17:23:31.974822+0000","last_became_active":"2023-11-30T17:23:31.970412+0000","last_became_peered":"2023-11-30T17:23:31.970412+0000","last_unstale":"2023-11-30T17:23:31.974822+0000","last_undegraded":"2023-11-30T17:23:31.974822+0000","last_fullsized":"2023-11-30T17:23:31.974822+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.961927+0000","last_change":"2023-11-30T17:23:31.582753+0000","last_active":"2023-11-30T17:23:31.961927+0000","last_peered":"2023-11-30T17:23:31.961927+0000","last_clean":"2023-11-30T17:23:31.961927+0000","last_became_active":"2023-11-30T17:23:31.582403+0000","last_became_peered":"2023-11-30T17:23:31.582403+0000","last_unstale":"2023-11-30T17:23:31.961927+0000","last_undegraded":"2023-11-30T17:23:31.961927+0000","last_fullsized":"2023-11-30T17:23:31.961927+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.980312+0000","last_change":"2023-11-30T17:23:31.978698+0000","last_active":"2023-11-30T17:23:31.980312+0000","last_peered":"2023-11-30T17:23:31.980312+0000","last_clean":"2023-11-30T17:23:31.980312+0000","last_became_active":"2023-11-30T17:23:31.978415+0000","last_became_peered":"2023-11-30T17:23:31.978415+0000","last_unstale":"2023-11-30T17:23:31.980312+0000","last_undegraded":"2023-11-30T17:23:31.980312+0000","last_fullsized":"2023-11-30T17:23:31.980312+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.949370+0000","last_change":"2023-11-30T17:23:31.580479+0000","last_active":"2023-11-30T17:23:31.949370+0000","last_peered":"2023-11-30T17:23:31.949370+0000","last_clean":"2023-11-30T17:23:31.949370+0000","last_became_active":"2023-11-30T17:23:31.580206+0000","last_became_peered":"2023-11-30T17:23:31.580206+0000","last_unstale":"2023-11-30T17:23:31.949370+0000","last_undegraded":"2023-11-30T17:23:31.949370+0000","last_fullsized":"2023-11-30T17:23:31.949370+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968422+0000","last_change":"2023-11-30T17:23:31.951947+0000","last_active":"2023-11-30T17:23:31.968422+0000","last_peered":"2023-11-30T17:23:31.968422+0000","last_clean":"2023-11-30T17:23:31.968422+0000","last_became_active":"2023-11-30T17:23:31.951475+0000","last_became_peered":"2023-11-30T17:23:31.951475+0000","last_unstale":"2023-11-30T17:23:31.968422+0000","last_undegraded":"2023-11-30T17:23:31.968422+0000","last_fullsized":"2023-11-30T17:23:31.968422+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969411+0000","last_change":"2023-11-30T17:23:31.575097+0000","last_active":"2023-11-30T17:23:31.969411+0000","last_peered":"2023-11-30T17:23:31.969411+0000","last_clean":"2023-11-30T17:23:31.969411+0000","last_became_active":"2023-11-30T17:23:31.574793+0000","last_became_peered":"2023-11-30T17:23:31.574793+0000","last_unstale":"2023-11-30T17:23:31.969411+0000","last_undegraded":"2023-11-30T17:23:31.969411+0000","last_fullsized":"2023-11-30T17:23:31.969411+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.980032+0000","last_change":"2023-11-30T17:23:31.977907+0000","last_active":"2023-11-30T17:23:31.980032+0000","last_peered":"2023-11-30T17:23:31.980032+0000","last_clean":"2023-11-30T17:23:31.980032+0000","last_became_active":"2023-11-30T17:23:31.977283+0000","last_became_peered":"2023-11-30T17:23:31.977283+0000","last_unstale":"2023-11-30T17:23:31.980032+0000","last_undegraded":"2023-11-30T17:23:31.980032+0000","last_fullsized":"2023-11-30T17:23:31.980032+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.971442+0000","last_change":"2023-11-30T17:23:31.585126+0000","last_active":"2023-11-30T17:23:31.971442+0000","last_peered":"2023-11-30T17:23:31.971442+0000","last_clean":"2023-11-30T17:23:31.971442+0000","last_became_active":"2023-11-30T17:23:31.584635+0000","last_became_peered":"2023-11-30T17:23:31.584635+0000","last_unstale":"2023-11-30T17:23:31.971442+0000","last_undegraded":"2023-11-30T17:23:31.971442+0000","last_fullsized":"2023-11-30T17:23:31.971442+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969283+0000","last_change":"2023-11-30T17:23:31.966488+0000","last_active":"2023-11-30T17:23:31.969283+0000","last_peered":"2023-11-30T17:23:31.969283+0000","last_clean":"2023-11-30T17:23:31.969283+0000","last_became_active":"2023-11-30T17:23:31.966188+0000","last_became_peered":"2023-11-30T17:23:31.966188+0000","last_unstale":"2023-11-30T17:23:31.969283+0000","last_undegraded":"2023-11-30T17:23:31.969283+0000","last_fullsized":"2023-11-30T17:23:31.969283+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.956894+0000","last_change":"2023-11-30T17:23:31.586111+0000","last_active":"2023-11-30T17:23:31.956894+0000","last_peered":"2023-11-30T17:23:31.956894+0000","last_clean":"2023-11-30T17:23:31.956894+0000","last_became_active":"2023-11-30T17:23:31.585736+0000","last_became_peered":"2023-11-30T17:23:31.585736+0000","last_unstale":"2023-11-30T17:23:31.956894+0000","last_undegraded":"2023-11-30T17:23:31.956894+0000","last_fullsized":"2023-11-30T17:23:31.956894+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.963851+0000","last_change":"2023-11-30T17:23:31.962840+0000","last_active":"2023-11-30T17:23:31.963851+0000","last_peered":"2023-11-30T17:23:31.963851+0000","last_clean":"2023-11-30T17:23:31.963851+0000","last_became_active":"2023-11-30T17:23:31.962549+0000","last_became_peered":"2023-11-30T17:23:31.962549+0000","last_unstale":"2023-11-30T17:23:31.963851+0000","last_undegraded":"2023-11-30T17:23:31.963851+0000","last_fullsized":"2023-11-30T17:23:31.963851+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.948807+0000","last_change":"2023-11-30T17:23:31.580324+0000","last_active":"2023-11-30T17:23:31.948807+0000","last_peered":"2023-11-30T17:23:31.948807+0000","last_clean":"2023-11-30T17:23:31.948807+0000","last_became_active":"2023-11-30T17:23:31.579803+0000","last_became_peered":"2023-11-30T17:23:31.579803+0000","last_unstale":"2023-11-30T17:23:31.948807+0000","last_undegraded":"2023-11-30T17:23:31.948807+0000","last_fullsized":"2023-11-30T17:23:31.948807+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.975897+0000","last_change":"2023-11-30T17:23:31.967042+0000","last_active":"2023-11-30T17:23:31.975897+0000","last_peered":"2023-11-30T17:23:31.975897+0000","last_clean":"2023-11-30T17:23:31.975897+0000","last_became_active":"2023-11-30T17:23:31.966757+0000","last_became_peered":"2023-11-30T17:23:31.966757+0000","last_unstale":"2023-11-30T17:23:31.975897+0000","last_undegraded":"2023-11-30T17:23:31.975897+0000","last_fullsized":"2023-11-30T17:23:31.975897+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.973122+0000","last_change":"2023-11-30T17:23:31.578249+0000","last_active":"2023-11-30T17:23:31.973122+0000","last_peered":"2023-11-30T17:23:31.973122+0000","last_clean":"2023-11-30T17:23:31.973122+0000","last_became_active":"2023-11-30T17:23:31.577992+0000","last_became_peered":"2023-11-30T17:23:31.577992+0000","last_unstale":"2023-11-30T17:23:31.973122+0000","last_undegraded":"2023-11-30T17:23:31.973122+0000","last_fullsized":"2023-11-30T17:23:31.973122+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.970001+0000","last_change":"2023-11-30T17:23:31.963695+0000","last_active":"2023-11-30T17:23:31.970001+0000","last_peered":"2023-11-30T17:23:31.970001+0000","last_clean":"2023-11-30T17:23:31.970001+0000","last_became_active":"2023-11-30T17:23:31.962928+0000","last_became_peered":"2023-11-30T17:23:31.962928+0000","last_unstale":"2023-11-30T17:23:31.970001+0000","last_undegraded":"2023-11-30T17:23:31.970001+0000","last_fullsized":"2023-11-30T17:23:31.970001+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.973033+0000","last_change":"2023-11-30T17:23:31.576277+0000","last_active":"2023-11-30T17:23:31.973033+0000","last_peered":"2023-11-30T17:23:31.973033+0000","last_clean":"2023-11-30T17:23:31.973033+0000","last_became_active":"2023-11-30T17:23:31.575979+0000","last_became_peered":"2023-11-30T17:23:31.575979+0000","last_unstale":"2023-11-30T17:23:31.973033+0000","last_undegraded":"2023-11-30T17:23:31.973033+0000","last_fullsized":"2023-11-30T17:23:31.973033+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.972863+0000","last_change":"2023-11-30T17:23:31.971045+0000","last_active":"2023-11-30T17:23:31.972863+0000","last_peered":"2023-11-30T17:23:31.972863+0000","last_clean":"2023-11-30T17:23:31.972863+0000","last_became_active":"2023-11-30T17:23:31.970765+0000","last_became_peered":"2023-11-30T17:23:31.970765+0000","last_unstale":"2023-11-30T17:23:31.972863+0000","last_undegraded":"2023-11-30T17:23:31.972863+0000","last_fullsized":"2023-11-30T17:23:31.972863+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.963145+0000","last_change":"2023-11-30T17:23:31.584175+0000","last_active":"2023-11-30T17:23:31.963145+0000","last_peered":"2023-11-30T17:23:31.963145+0000","last_clean":"2023-11-30T17:23:31.963145+0000","last_became_active":"2023-11-30T17:23:31.583873+0000","last_became_peered":"2023-11-30T17:23:31.583873+0000","last_unstale":"2023-11-30T17:23:31.963145+0000","last_undegraded":"2023-11-30T17:23:31.963145+0000","last_fullsized":"2023-11-30T17:23:31.963145+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.965756+0000","last_change":"2023-11-30T17:23:31.951314+0000","last_active":"2023-11-30T17:23:31.965756+0000","last_peered":"2023-11-30T17:23:31.965756+0000","last_clean":"2023-11-30T17:23:31.965756+0000","last_became_active":"2023-11-30T17:23:31.951068+0000","last_became_peered":"2023-11-30T17:23:31.951068+0000","last_unstale":"2023-11-30T17:23:31.965756+0000","last_undegraded":"2023-11-30T17:23:31.965756+0000","last_fullsized":"2023-11-30T17:23:31.965756+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.949224+0000","last_change":"2023-11-30T17:23:31.578810+0000","last_active":"2023-11-30T17:23:31.949224+0000","last_peered":"2023-11-30T17:23:31.949224+0000","last_clean":"2023-11-30T17:23:31.949224+0000","last_became_active":"2023-11-30T17:23:31.578522+0000","last_became_peered":"2023-11-30T17:23:31.578522+0000","last_unstale":"2023-11-30T17:23:31.949224+0000","last_undegraded":"2023-11-30T17:23:31.949224+0000","last_fullsized":"2023-11-30T17:23:31.949224+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977304+0000","last_change":"2023-11-30T17:23:31.972316+0000","last_active":"2023-11-30T17:23:31.977304+0000","last_peered":"2023-11-30T17:23:31.977304+0000","last_clean":"2023-11-30T17:23:31.977304+0000","last_became_active":"2023-11-30T17:23:31.971591+0000","last_became_peered":"2023-11-30T17:23:31.971591+0000","last_unstale":"2023-11-30T17:23:31.977304+0000","last_undegraded":"2023-11-30T17:23:31.977304+0000","last_fullsized":"2023-11-30T17:23:31.977304+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.958012+0000","last_change":"2023-11-30T17:23:31.586223+0000","last_active":"2023-11-30T17:23:31.958012+0000","last_peered":"2023-11-30T17:23:31.958012+0000","last_clean":"2023-11-30T17:23:31.958012+0000","last_became_active":"2023-11-30T17:23:31.585839+0000","last_became_peered":"2023-11-30T17:23:31.585839+0000","last_unstale":"2023-11-30T17:23:31.958012+0000","last_undegraded":"2023-11-30T17:23:31.958012+0000","last_fullsized":"2023-11-30T17:23:31.958012+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.960471+0000","last_change":"2023-11-30T17:23:31.951213+0000","last_active":"2023-11-30T17:23:31.960471+0000","last_peered":"2023-11-30T17:23:31.960471+0000","last_clean":"2023-11-30T17:23:31.960471+0000","last_became_active":"2023-11-30T17:23:31.950924+0000","last_became_peered":"2023-11-30T17:23:31.950924+0000","last_unstale":"2023-11-30T17:23:31.960471+0000","last_undegraded":"2023-11-30T17:23:31.960471+0000","last_fullsized":"2023-11-30T17:23:31.960471+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.971522+0000","last_change":"2023-11-30T17:23:31.584951+0000","last_active":"2023-11-30T17:23:31.971522+0000","last_peered":"2023-11-30T17:23:31.971522+0000","last_clean":"2023-11-30T17:23:31.971522+0000","last_became_active":"2023-11-30T17:23:31.584271+0000","last_became_peered":"2023-11-30T17:23:31.584271+0000","last_unstale":"2023-11-30T17:23:31.971522+0000","last_undegraded":"2023-11-30T17:23:31.971522+0000","last_fullsized":"2023-11-30T17:23:31.971522+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968644+0000","last_change":"2023-11-30T17:23:31.964012+0000","last_active":"2023-11-30T17:23:31.968644+0000","last_peered":"2023-11-30T17:23:31.968644+0000","last_clean":"2023-11-30T17:23:31.968644+0000","last_became_active":"2023-11-30T17:23:31.963750+0000","last_became_peered":"2023-11-30T17:23:31.963750+0000","last_unstale":"2023-11-30T17:23:31.968644+0000","last_undegraded":"2023-11-30T17:23:31.968644+0000","last_fullsized":"2023-11-30T17:23:31.968644+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.949896+0000","last_change":"2023-11-30T17:23:31.582453+0000","last_active":"2023-11-30T17:23:31.949896+0000","last_peered":"2023-11-30T17:23:31.949896+0000","last_clean":"2023-11-30T17:23:31.949896+0000","last_became_active":"2023-11-30T17:23:31.581818+0000","last_became_peered":"2023-11-30T17:23:31.581818+0000","last_unstale":"2023-11-30T17:23:31.949896+0000","last_undegraded":"2023-11-30T17:23:31.949896+0000","last_fullsized":"2023-11-30T17:23:31.949896+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977686+0000","last_change":"2023-11-30T17:23:31.973318+0000","last_active":"2023-11-30T17:23:31.977686+0000","last_peered":"2023-11-30T17:23:31.977686+0000","last_clean":"2023-11-30T17:23:31.977686+0000","last_became_active":"2023-11-30T17:23:31.973044+0000","last_became_peered":"2023-11-30T17:23:31.973044+0000","last_unstale":"2023-11-30T17:23:31.977686+0000","last_undegraded":"2023-11-30T17:23:31.977686+0000","last_fullsized":"2023-11-30T17:23:31.977686+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.951309+0000","last_change":"2023-11-30T17:23:31.583511+0000","last_active":"2023-11-30T17:23:31.951309+0000","last_peered":"2023-11-30T17:23:31.951309+0000","last_clean":"2023-11-30T17:23:31.951309+0000","last_became_active":"2023-11-30T17:23:31.583179+0000","last_became_peered":"2023-11-30T17:23:31.583179+0000","last_unstale":"2023-11-30T17:23:31.951309+0000","last_undegraded":"2023-11-30T17:23:31.951309+0000","last_fullsized":"2023-11-30T17:23:31.951309+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.967869+0000","last_change":"2023-11-30T17:23:31.962363+0000","last_active":"2023-11-30T17:23:31.967869+0000","last_peered":"2023-11-30T17:23:31.967869+0000","last_clean":"2023-11-30T17:23:31.967869+0000","last_became_active":"2023-11-30T17:23:31.961998+0000","last_became_peered":"2023-11-30T17:23:31.961998+0000","last_unstale":"2023-11-30T17:23:31.967869+0000","last_undegraded":"2023-11-30T17:23:31.967869+0000","last_fullsized":"2023-11-30T17:23:31.967869+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.965778+0000","last_change":"2023-11-30T17:23:31.570120+0000","last_active":"2023-11-30T17:23:31.965778+0000","last_peered":"2023-11-30T17:23:31.965778+0000","last_clean":"2023-11-30T17:23:31.965778+0000","last_became_active":"2023-11-30T17:23:31.569838+0000","last_became_peered":"2023-11-30T17:23:31.569838+0000","last_unstale":"2023-11-30T17:23:31.965778+0000","last_undegraded":"2023-11-30T17:23:31.965778+0000","last_fullsized":"2023-11-30T17:23:31.965778+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969624+0000","last_change":"2023-11-30T17:23:31.968565+0000","last_active":"2023-11-30T17:23:31.969624+0000","last_peered":"2023-11-30T17:23:31.969624+0000","last_clean":"2023-11-30T17:23:31.969624+0000","last_became_active":"2023-11-30T17:23:31.968258+0000","last_became_peered":"2023-11-30T17:23:31.968258+0000","last_unstale":"2023-11-30T17:23:31.969624+0000","last_undegraded":"2023-11-30T17:23:31.969624+0000","last_fullsized":"2023-11-30T17:23:31.969624+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.953697+0000","last_change":"2023-11-30T17:23:31.586544+0000","last_active":"2023-11-30T17:23:31.953697+0000","last_peered":"2023-11-30T17:23:31.953697+0000","last_clean":"2023-11-30T17:23:31.953697+0000","last_became_active":"2023-11-30T17:23:31.586249+0000","last_became_peered":"2023-11-30T17:23:31.586249+0000","last_unstale":"2023-11-30T17:23:31.953697+0000","last_undegraded":"2023-11-30T17:23:31.953697+0000","last_fullsized":"2023-11-30T17:23:31.953697+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.967257+0000","last_change":"2023-11-30T17:23:31.966064+0000","last_active":"2023-11-30T17:23:31.967257+0000","last_peered":"2023-11-30T17:23:31.967257+0000","last_clean":"2023-11-30T17:23:31.967257+0000","last_became_active":"2023-11-30T17:23:31.965286+0000","last_became_peered":"2023-11-30T17:23:31.965286+0000","last_unstale":"2023-11-30T17:23:31.967257+0000","last_undegraded":"2023-11-30T17:23:31.967257+0000","last_fullsized":"2023-11-30T17:23:31.967257+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"112'3","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976929+0000","last_change":"2023-11-30T17:23:31.586245+0000","last_active":"2023-11-30T17:23:31.976929+0000","last_peered":"2023-11-30T17:23:31.976929+0000","last_clean":"2023-11-30T17:23:31.976929+0000","last_became_active":"2023-11-30T17:23:31.585680+0000","last_became_peered":"2023-11-30T17:23:31.585680+0000","last_unstale":"2023-11-30T17:23:31.976929+0000","last_undegraded":"2023-11-30T17:23:31.976929+0000","last_fullsized":"2023-11-30T17:23:31.976929+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976819+0000","last_change":"2023-11-30T17:23:31.967924+0000","last_active":"2023-11-30T17:23:31.976819+0000","last_peered":"2023-11-30T17:23:31.976819+0000","last_clean":"2023-11-30T17:23:31.976819+0000","last_became_active":"2023-11-30T17:23:31.967731+0000","last_became_peered":"2023-11-30T17:23:31.967731+0000","last_unstale":"2023-11-30T17:23:31.976819+0000","last_undegraded":"2023-11-30T17:23:31.976819+0000","last_fullsized":"2023-11-30T17:23:31.976819+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.973710+0000","last_change":"2023-11-30T17:23:31.574509+0000","last_active":"2023-11-30T17:23:31.973710+0000","last_peered":"2023-11-30T17:23:31.973710+0000","last_clean":"2023-11-30T17:23:31.973710+0000","last_became_active":"2023-11-30T17:23:31.574222+0000","last_became_peered":"2023-11-30T17:23:31.574222+0000","last_unstale":"2023-11-30T17:23:31.973710+0000","last_undegraded":"2023-11-30T17:23:31.973710+0000","last_fullsized":"2023-11-30T17:23:31.973710+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977348+0000","last_change":"2023-11-30T17:23:31.972653+0000","last_active":"2023-11-30T17:23:31.977348+0000","last_peered":"2023-11-30T17:23:31.977348+0000","last_clean":"2023-11-30T17:23:31.977348+0000","last_became_active":"2023-11-30T17:23:31.972117+0000","last_became_peered":"2023-11-30T17:23:31.972117+0000","last_unstale":"2023-11-30T17:23:31.977348+0000","last_undegraded":"2023-11-30T17:23:31.977348+0000","last_fullsized":"2023-11-30T17:23:31.977348+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968511+0000","last_change":"2023-11-30T17:23:31.583818+0000","last_active":"2023-11-30T17:23:31.968511+0000","last_peered":"2023-11-30T17:23:31.968511+0000","last_clean":"2023-11-30T17:23:31.968511+0000","last_became_active":"2023-11-30T17:23:31.583114+0000","last_became_peered":"2023-11-30T17:23:31.583114+0000","last_unstale":"2023-11-30T17:23:31.968511+0000","last_undegraded":"2023-11-30T17:23:31.968511+0000","last_fullsized":"2023-11-30T17:23:31.968511+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.967916+0000","last_change":"2023-11-30T17:23:31.965100+0000","last_active":"2023-11-30T17:23:31.967916+0000","last_peered":"2023-11-30T17:23:31.967916+0000","last_clean":"2023-11-30T17:23:31.967916+0000","last_became_active":"2023-11-30T17:23:31.964710+0000","last_became_peered":"2023-11-30T17:23:31.964710+0000","last_unstale":"2023-11-30T17:23:31.967916+0000","last_undegraded":"2023-11-30T17:23:31.967916+0000","last_fullsized":"2023-11-30T17:23:31.967916+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.947455+0000","last_change":"2023-11-30T17:23:31.583430+0000","last_active":"2023-11-30T17:23:31.947455+0000","last_peered":"2023-11-30T17:23:31.947455+0000","last_clean":"2023-11-30T17:23:31.947455+0000","last_became_active":"2023-11-30T17:23:31.583105+0000","last_became_peered":"2023-11-30T17:23:31.583105+0000","last_unstale":"2023-11-30T17:23:31.947455+0000","last_undegraded":"2023-11-30T17:23:31.947455+0000","last_fullsized":"2023-11-30T17:23:31.947455+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.967351+0000","last_change":"2023-11-30T17:23:31.964226+0000","last_active":"2023-11-30T17:23:31.967351+0000","last_peered":"2023-11-30T17:23:31.967351+0000","last_clean":"2023-11-30T17:23:31.967351+0000","last_became_active":"2023-11-30T17:23:31.963944+0000","last_became_peered":"2023-11-30T17:23:31.963944+0000","last_unstale":"2023-11-30T17:23:31.967351+0000","last_undegraded":"2023-11-30T17:23:31.967351+0000","last_fullsized":"2023-11-30T17:23:31.967351+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.964360+0000","last_change":"2023-11-30T17:23:31.571471+0000","last_active":"2023-11-30T17:23:31.964360+0000","last_peered":"2023-11-30T17:23:31.964360+0000","last_clean":"2023-11-30T17:23:31.964360+0000","last_became_active":"2023-11-30T17:23:31.571178+0000","last_became_peered":"2023-11-30T17:23:31.571178+0000","last_unstale":"2023-11-30T17:23:31.964360+0000","last_undegraded":"2023-11-30T17:23:31.964360+0000","last_fullsized":"2023-11-30T17:23:31.964360+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966913+0000","last_change":"2023-11-30T17:23:31.965542+0000","last_active":"2023-11-30T17:23:31.966913+0000","last_peered":"2023-11-30T17:23:31.966913+0000","last_clean":"2023-11-30T17:23:31.966913+0000","last_became_active":"2023-11-30T17:23:31.965254+0000","last_became_peered":"2023-11-30T17:23:31.965254+0000","last_unstale":"2023-11-30T17:23:31.966913+0000","last_undegraded":"2023-11-30T17:23:31.966913+0000","last_fullsized":"2023-11-30T17:23:31.966913+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"112'4","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.977162+0000","last_change":"2023-11-30T17:23:31.584353+0000","last_active":"2023-11-30T17:23:31.977162+0000","last_peered":"2023-11-30T17:23:31.977162+0000","last_clean":"2023-11-30T17:23:31.977162+0000","last_became_active":"2023-11-30T17:23:31.584077+0000","last_became_peered":"2023-11-30T17:23:31.584077+0000","last_unstale":"2023-11-30T17:23:31.977162+0000","last_undegraded":"2023-11-30T17:23:31.977162+0000","last_fullsized":"2023-11-30T17:23:31.977162+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.972875+0000","last_change":"2023-11-30T17:23:31.960985+0000","last_active":"2023-11-30T17:23:31.972875+0000","last_peered":"2023-11-30T17:23:31.972875+0000","last_clean":"2023-11-30T17:23:31.972875+0000","last_became_active":"2023-11-30T17:23:31.960095+0000","last_became_peered":"2023-11-30T17:23:31.960095+0000","last_unstale":"2023-11-30T17:23:31.972875+0000","last_undegraded":"2023-11-30T17:23:31.972875+0000","last_fullsized":"2023-11-30T17:23:31.972875+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.965305+0000","last_change":"2023-11-30T17:23:31.576611+0000","last_active":"2023-11-30T17:23:31.965305+0000","last_peered":"2023-11-30T17:23:31.965305+0000","last_clean":"2023-11-30T17:23:31.965305+0000","last_became_active":"2023-11-30T17:23:31.576303+0000","last_became_peered":"2023-11-30T17:23:31.576303+0000","last_unstale":"2023-11-30T17:23:31.965305+0000","last_undegraded":"2023-11-30T17:23:31.965305+0000","last_fullsized":"2023-11-30T17:23:31.965305+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976552+0000","last_change":"2023-11-30T17:23:31.973173+0000","last_active":"2023-11-30T17:23:31.976552+0000","last_peered":"2023-11-30T17:23:31.976552+0000","last_clean":"2023-11-30T17:23:31.976552+0000","last_became_active":"2023-11-30T17:23:31.970112+0000","last_became_peered":"2023-11-30T17:23:31.970112+0000","last_unstale":"2023-11-30T17:23:31.976552+0000","last_undegraded":"2023-11-30T17:23:31.976552+0000","last_fullsized":"2023-11-30T17:23:31.976552+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.961156+0000","last_change":"2023-11-30T17:23:31.580071+0000","last_active":"2023-11-30T17:23:31.961156+0000","last_peered":"2023-11-30T17:23:31.961156+0000","last_clean":"2023-11-30T17:23:31.961156+0000","last_became_active":"2023-11-30T17:23:31.579806+0000","last_became_peered":"2023-11-30T17:23:31.579806+0000","last_unstale":"2023-11-30T17:23:31.961156+0000","last_undegraded":"2023-11-30T17:23:31.961156+0000","last_fullsized":"2023-11-30T17:23:31.961156+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968363+0000","last_change":"2023-11-30T17:23:31.962690+0000","last_active":"2023-11-30T17:23:31.968363+0000","last_peered":"2023-11-30T17:23:31.968363+0000","last_clean":"2023-11-30T17:23:31.968363+0000","last_became_active":"2023-11-30T17:23:31.962398+0000","last_became_peered":"2023-11-30T17:23:31.962398+0000","last_unstale":"2023-11-30T17:23:31.968363+0000","last_undegraded":"2023-11-30T17:23:31.968363+0000","last_fullsized":"2023-11-30T17:23:31.968363+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.961518+0000","last_change":"2023-11-30T17:23:31.586228+0000","last_active":"2023-11-30T17:23:31.961518+0000","last_peered":"2023-11-30T17:23:31.961518+0000","last_clean":"2023-11-30T17:23:31.961518+0000","last_became_active":"2023-11-30T17:23:31.585704+0000","last_became_peered":"2023-11-30T17:23:31.585704+0000","last_unstale":"2023-11-30T17:23:31.961518+0000","last_undegraded":"2023-11-30T17:23:31.961518+0000","last_fullsized":"2023-11-30T17:23:31.961518+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.974858+0000","last_change":"2023-11-30T17:23:31.970918+0000","last_active":"2023-11-30T17:23:31.974858+0000","last_peered":"2023-11-30T17:23:31.974858+0000","last_clean":"2023-11-30T17:23:31.974858+0000","last_became_active":"2023-11-30T17:23:31.970353+0000","last_became_peered":"2023-11-30T17:23:31.970353+0000","last_unstale":"2023-11-30T17:23:31.974858+0000","last_undegraded":"2023-11-30T17:23:31.974858+0000","last_fullsized":"2023-11-30T17:23:31.974858+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.949127+0000","last_change":"2023-11-30T17:23:31.584004+0000","last_active":"2023-11-30T17:23:31.949127+0000","last_peered":"2023-11-30T17:23:31.949127+0000","last_clean":"2023-11-30T17:23:31.949127+0000","last_became_active":"2023-11-30T17:23:31.583671+0000","last_became_peered":"2023-11-30T17:23:31.583671+0000","last_unstale":"2023-11-30T17:23:31.949127+0000","last_undegraded":"2023-11-30T17:23:31.949127+0000","last_fullsized":"2023-11-30T17:23:31.949127+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.975890+0000","last_change":"2023-11-30T17:23:31.969835+0000","last_active":"2023-11-30T17:23:31.975890+0000","last_peered":"2023-11-30T17:23:31.975890+0000","last_clean":"2023-11-30T17:23:31.975890+0000","last_became_active":"2023-11-30T17:23:31.969554+0000","last_became_peered":"2023-11-30T17:23:31.969554+0000","last_unstale":"2023-11-30T17:23:31.975890+0000","last_undegraded":"2023-11-30T17:23:31.975890+0000","last_fullsized":"2023-11-30T17:23:31.975890+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.947769+0000","last_change":"2023-11-30T17:23:31.588106+0000","last_active":"2023-11-30T17:23:31.947769+0000","last_peered":"2023-11-30T17:23:31.947769+0000","last_clean":"2023-11-30T17:23:31.947769+0000","last_became_active":"2023-11-30T17:23:31.587639+0000","last_became_peered":"2023-11-30T17:23:31.587639+0000","last_unstale":"2023-11-30T17:23:31.947769+0000","last_undegraded":"2023-11-30T17:23:31.947769+0000","last_fullsized":"2023-11-30T17:23:31.947769+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966848+0000","last_change":"2023-11-30T17:23:31.964658+0000","last_active":"2023-11-30T17:23:31.966848+0000","last_peered":"2023-11-30T17:23:31.966848+0000","last_clean":"2023-11-30T17:23:31.966848+0000","last_became_active":"2023-11-30T17:23:31.964344+0000","last_became_peered":"2023-11-30T17:23:31.964344+0000","last_unstale":"2023-11-30T17:23:31.966848+0000","last_undegraded":"2023-11-30T17:23:31.966848+0000","last_fullsized":"2023-11-30T17:23:31.966848+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.965626+0000","last_change":"2023-11-30T17:23:31.575427+0000","last_active":"2023-11-30T17:23:31.965626+0000","last_peered":"2023-11-30T17:23:31.965626+0000","last_clean":"2023-11-30T17:23:31.965626+0000","last_became_active":"2023-11-30T17:23:31.574977+0000","last_became_peered":"2023-11-30T17:23:31.574977+0000","last_unstale":"2023-11-30T17:23:31.965626+0000","last_undegraded":"2023-11-30T17:23:31.965626+0000","last_fullsized":"2023-11-30T17:23:31.965626+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.972646+0000","last_change":"2023-11-30T17:23:31.962910+0000","last_active":"2023-11-30T17:23:31.972646+0000","last_peered":"2023-11-30T17:23:31.972646+0000","last_clean":"2023-11-30T17:23:31.972646+0000","last_became_active":"2023-11-30T17:23:31.962717+0000","last_became_peered":"2023-11-30T17:23:31.962717+0000","last_unstale":"2023-11-30T17:23:31.972646+0000","last_undegraded":"2023-11-30T17:23:31.972646+0000","last_fullsized":"2023-11-30T17:23:31.972646+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.949513+0000","last_change":"2023-11-30T17:23:31.583385+0000","last_active":"2023-11-30T17:23:31.949513+0000","last_peered":"2023-11-30T17:23:31.949513+0000","last_clean":"2023-11-30T17:23:31.949513+0000","last_became_active":"2023-11-30T17:23:31.583081+0000","last_became_peered":"2023-11-30T17:23:31.583081+0000","last_unstale":"2023-11-30T17:23:31.949513+0000","last_undegraded":"2023-11-30T17:23:31.949513+0000","last_fullsized":"2023-11-30T17:23:31.949513+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966407+0000","last_change":"2023-11-30T17:23:31.951476+0000","last_active":"2023-11-30T17:23:31.966407+0000","last_peered":"2023-11-30T17:23:31.966407+0000","last_clean":"2023-11-30T17:23:31.966407+0000","last_became_active":"2023-11-30T17:23:31.951287+0000","last_became_peered":"2023-11-30T17:23:31.951287+0000","last_unstale":"2023-11-30T17:23:31.966407+0000","last_undegraded":"2023-11-30T17:23:31.966407+0000","last_fullsized":"2023-11-30T17:23:31.966407+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.951316+0000","last_change":"2023-11-30T17:23:31.579504+0000","last_active":"2023-11-30T17:23:31.951316+0000","last_peered":"2023-11-30T17:23:31.951316+0000","last_clean":"2023-11-30T17:23:31.951316+0000","last_became_active":"2023-11-30T17:23:31.579215+0000","last_became_peered":"2023-11-30T17:23:31.579215+0000","last_unstale":"2023-11-30T17:23:31.951316+0000","last_undegraded":"2023-11-30T17:23:31.951316+0000","last_fullsized":"2023-11-30T17:23:31.951316+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976068+0000","last_change":"2023-11-30T17:23:31.973279+0000","last_active":"2023-11-30T17:23:31.976068+0000","last_peered":"2023-11-30T17:23:31.976068+0000","last_clean":"2023-11-30T17:23:31.976068+0000","last_became_active":"2023-11-30T17:23:31.972992+0000","last_became_peered":"2023-11-30T17:23:31.972992+0000","last_unstale":"2023-11-30T17:23:31.976068+0000","last_undegraded":"2023-11-30T17:23:31.976068+0000","last_fullsized":"2023-11-30T17:23:31.976068+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969632+0000","last_change":"2023-11-30T17:23:31.575132+0000","last_active":"2023-11-30T17:23:31.969632+0000","last_peered":"2023-11-30T17:23:31.969632+0000","last_clean":"2023-11-30T17:23:31.969632+0000","last_became_active":"2023-11-30T17:23:31.573356+0000","last_became_peered":"2023-11-30T17:23:31.573356+0000","last_unstale":"2023-11-30T17:23:31.969632+0000","last_undegraded":"2023-11-30T17:23:31.969632+0000","last_fullsized":"2023-11-30T17:23:31.969632+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":91,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969790+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:23:31.969790+0000","last_peered":"2023-11-30T17:23:31.969790+0000","last_clean":"2023-11-30T17:23:31.969790+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:23:31.969790+0000","last_undegraded":"2023-11-30T17:23:31.969790+0000","last_fullsized":"2023-11-30T17:23:31.969790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.972177+0000","last_change":"2023-11-30T17:23:31.968153+0000","last_active":"2023-11-30T17:23:31.972177+0000","last_peered":"2023-11-30T17:23:31.972177+0000","last_clean":"2023-11-30T17:23:31.972177+0000","last_became_active":"2023-11-30T17:23:31.967872+0000","last_became_peered":"2023-11-30T17:23:31.967872+0000","last_unstale":"2023-11-30T17:23:31.972177+0000","last_undegraded":"2023-11-30T17:23:31.972177+0000","last_fullsized":"2023-11-30T17:23:31.972177+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.961632+0000","last_change":"2023-11-30T17:23:31.586771+0000","last_active":"2023-11-30T17:23:31.961632+0000","last_peered":"2023-11-30T17:23:31.961632+0000","last_clean":"2023-11-30T17:23:31.961632+0000","last_became_active":"2023-11-30T17:23:31.586511+0000","last_became_peered":"2023-11-30T17:23:31.586511+0000","last_unstale":"2023-11-30T17:23:31.961632+0000","last_undegraded":"2023-11-30T17:23:31.961632+0000","last_fullsized":"2023-11-30T17:23:31.961632+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":90,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.965724+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:23:31.965724+0000","last_peered":"2023-11-30T17:23:31.965724+0000","last_clean":"2023-11-30T17:23:31.965724+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:23:31.965724+0000","last_undegraded":"2023-11-30T17:23:31.965724+0000","last_fullsized":"2023-11-30T17:23:31.965724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.978032+0000","last_change":"2023-11-30T17:23:31.972743+0000","last_active":"2023-11-30T17:23:31.978032+0000","last_peered":"2023-11-30T17:23:31.978032+0000","last_clean":"2023-11-30T17:23:31.978032+0000","last_became_active":"2023-11-30T17:23:31.972375+0000","last_became_peered":"2023-11-30T17:23:31.972375+0000","last_unstale":"2023-11-30T17:23:31.978032+0000","last_undegraded":"2023-11-30T17:23:31.978032+0000","last_fullsized":"2023-11-30T17:23:31.978032+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.966869+0000","last_change":"2023-11-30T17:23:31.572852+0000","last_active":"2023-11-30T17:23:31.966869+0000","last_peered":"2023-11-30T17:23:31.966869+0000","last_clean":"2023-11-30T17:23:31.966869+0000","last_became_active":"2023-11-30T17:23:31.572533+0000","last_became_peered":"2023-11-30T17:23:31.572533+0000","last_unstale":"2023-11-30T17:23:31.966869+0000","last_undegraded":"2023-11-30T17:23:31.966869+0000","last_fullsized":"2023-11-30T17:23:31.966869+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":95,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.953812+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:23:31.953812+0000","last_peered":"2023-11-30T17:23:31.953812+0000","last_clean":"2023-11-30T17:23:31.953812+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:23:31.953812+0000","last_undegraded":"2023-11-30T17:23:31.953812+0000","last_fullsized":"2023-11-30T17:23:31.953812+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.963094+0000","last_change":"2023-11-30T17:23:31.958158+0000","last_active":"2023-11-30T17:23:31.963094+0000","last_peered":"2023-11-30T17:23:31.963094+0000","last_clean":"2023-11-30T17:23:31.963094+0000","last_became_active":"2023-11-30T17:23:31.957892+0000","last_became_peered":"2023-11-30T17:23:31.957892+0000","last_unstale":"2023-11-30T17:23:31.963094+0000","last_undegraded":"2023-11-30T17:23:31.963094+0000","last_fullsized":"2023-11-30T17:23:31.963094+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969704+0000","last_change":"2023-11-30T17:23:31.576516+0000","last_active":"2023-11-30T17:23:31.969704+0000","last_peered":"2023-11-30T17:23:31.969704+0000","last_clean":"2023-11-30T17:23:31.969704+0000","last_became_active":"2023-11-30T17:23:31.576131+0000","last_became_peered":"2023-11-30T17:23:31.576131+0000","last_unstale":"2023-11-30T17:23:31.969704+0000","last_undegraded":"2023-11-30T17:23:31.969704+0000","last_fullsized":"2023-11-30T17:23:31.969704+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":90,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.965943+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:23:31.965943+0000","last_peered":"2023-11-30T17:23:31.965943+0000","last_clean":"2023-11-30T17:23:31.965943+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:23:31.965943+0000","last_undegraded":"2023-11-30T17:23:31.965943+0000","last_fullsized":"2023-11-30T17:23:31.965943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":92,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.951439+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:23:31.951439+0000","last_peered":"2023-11-30T17:23:31.951439+0000","last_clean":"2023-11-30T17:23:31.951439+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:23:31.951439+0000","last_undegraded":"2023-11-30T17:23:31.951439+0000","last_fullsized":"2023-11-30T17:23:31.951439+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.976031+0000","last_change":"2023-11-30T17:23:31.972941+0000","last_active":"2023-11-30T17:23:31.976031+0000","last_peered":"2023-11-30T17:23:31.976031+0000","last_clean":"2023-11-30T17:23:31.976031+0000","last_became_active":"2023-11-30T17:23:31.967587+0000","last_became_peered":"2023-11-30T17:23:31.967587+0000","last_unstale":"2023-11-30T17:23:31.976031+0000","last_undegraded":"2023-11-30T17:23:31.976031+0000","last_fullsized":"2023-11-30T17:23:31.976031+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.964088+0000","last_change":"2023-11-30T17:23:31.573885+0000","last_active":"2023-11-30T17:23:31.964088+0000","last_peered":"2023-11-30T17:23:31.964088+0000","last_clean":"2023-11-30T17:23:31.964088+0000","last_became_active":"2023-11-30T17:23:31.573151+0000","last_became_peered":"2023-11-30T17:23:31.573151+0000","last_unstale":"2023-11-30T17:23:31.964088+0000","last_undegraded":"2023-11-30T17:23:31.964088+0000","last_fullsized":"2023-11-30T17:23:31.964088+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":90,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.951488+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:23:31.951488+0000","last_peered":"2023-11-30T17:23:31.951488+0000","last_clean":"2023-11-30T17:23:31.951488+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:23:31.951488+0000","last_undegraded":"2023-11-30T17:23:31.951488+0000","last_fullsized":"2023-11-30T17:23:31.951488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.974882+0000","last_change":"2023-11-30T17:23:31.970437+0000","last_active":"2023-11-30T17:23:31.974882+0000","last_peered":"2023-11-30T17:23:31.974882+0000","last_clean":"2023-11-30T17:23:31.974882+0000","last_became_active":"2023-11-30T17:23:31.969998+0000","last_became_peered":"2023-11-30T17:23:31.969998+0000","last_unstale":"2023-11-30T17:23:31.974882+0000","last_undegraded":"2023-11-30T17:23:31.974882+0000","last_fullsized":"2023-11-30T17:23:31.974882+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.959971+0000","last_change":"2023-11-30T17:23:31.580697+0000","last_active":"2023-11-30T17:23:31.959971+0000","last_peered":"2023-11-30T17:23:31.959971+0000","last_clean":"2023-11-30T17:23:31.959971+0000","last_became_active":"2023-11-30T17:23:31.580098+0000","last_became_peered":"2023-11-30T17:23:31.580098+0000","last_unstale":"2023-11-30T17:23:31.959971+0000","last_undegraded":"2023-11-30T17:23:31.959971+0000","last_fullsized":"2023-11-30T17:23:31.959971+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":90,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.952310+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:23:31.952310+0000","last_peered":"2023-11-30T17:23:31.952310+0000","last_clean":"2023-11-30T17:23:31.952310+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:23:31.952310+0000","last_undegraded":"2023-11-30T17:23:31.952310+0000","last_fullsized":"2023-11-30T17:23:31.952310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.980029+0000","last_change":"2023-11-30T17:23:31.977849+0000","last_active":"2023-11-30T17:23:31.980029+0000","last_peered":"2023-11-30T17:23:31.980029+0000","last_clean":"2023-11-30T17:23:31.980029+0000","last_became_active":"2023-11-30T17:23:31.977484+0000","last_became_peered":"2023-11-30T17:23:31.977484+0000","last_unstale":"2023-11-30T17:23:31.980029+0000","last_undegraded":"2023-11-30T17:23:31.980029+0000","last_fullsized":"2023-11-30T17:23:31.980029+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.970067+0000","last_change":"2023-11-30T17:23:31.581582+0000","last_active":"2023-11-30T17:23:31.970067+0000","last_peered":"2023-11-30T17:23:31.970067+0000","last_clean":"2023-11-30T17:23:31.970067+0000","last_became_active":"2023-11-30T17:23:31.581305+0000","last_became_peered":"2023-11-30T17:23:31.581305+0000","last_unstale":"2023-11-30T17:23:31.970067+0000","last_undegraded":"2023-11-30T17:23:31.970067+0000","last_fullsized":"2023-11-30T17:23:31.970067+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":91,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.969567+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:23:31.969567+0000","last_peered":"2023-11-30T17:23:31.969567+0000","last_clean":"2023-11-30T17:23:31.969567+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:23:31.969567+0000","last_undegraded":"2023-11-30T17:23:31.969567+0000","last_fullsized":"2023-11-30T17:23:31.969567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.968512+0000","last_change":"2023-11-30T17:23:31.963009+0000","last_active":"2023-11-30T17:23:31.968512+0000","last_peered":"2023-11-30T17:23:31.968512+0000","last_clean":"2023-11-30T17:23:31.968512+0000","last_became_active":"2023-11-30T17:23:31.962748+0000","last_became_peered":"2023-11-30T17:23:31.962748+0000","last_unstale":"2023-11-30T17:23:31.968512+0000","last_undegraded":"2023-11-30T17:23:31.968512+0000","last_fullsized":"2023-11-30T17:23:31.968512+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:31.552500+0000","last_clean_scrub_stamp":"2023-11-30T17:23:31.552500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.953593+0000","last_change":"2023-11-30T17:23:31.575232+0000","last_active":"2023-11-30T17:23:31.953593+0000","last_peered":"2023-11-30T17:23:31.953593+0000","last_clean":"2023-11-30T17:23:31.953593+0000","last_became_active":"2023-11-30T17:23:31.574785+0000","last_became_peered":"2023-11-30T17:23:31.574785+0000","last_unstale":"2023-11-30T17:23:31.953593+0000","last_undegraded":"2023-11-30T17:23:31.953593+0000","last_fullsized":"2023-11-30T17:23:31.953593+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:23:30.550477+0000","last_clean_scrub_stamp":"2023-11-30T17:23:30.550477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":101,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-11-30T17:23:31.949217+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:23:31.949217+0000","last_peered":"2023-11-30T17:23:31.949217+0000","last_clean":"2023-11-30T17:23:31.949217+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:23:31.949217+0000","last_undegraded":"2023-11-30T17:23:31.949217+0000","last_fullsized":"2023-11-30T17:23:31.949217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575043,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302556,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069284,"statfs":{"total":96636764160,"available":96326946816,"internally_reserved":0,"allocated":1396736,"data_stored":697239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.371,"5min":0.315,"15min":0.23899999999999999},"max":{"1min":0.72399999999999998,"5min":0.80400000000000005,"15min":0.81100000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57499999999999996,"15min":0.58199999999999996},"min":{"1min":0.41099999999999998,"5min":0.40699999999999997,"15min":0.32200000000000001},"max":{"1min":0.74099999999999999,"5min":0.78300000000000003,"15min":0.81899999999999995},"last":0.503}]},{"osd":1,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70899999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.442},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.32900000000000001,"5min":0.29899999999999999,"15min":0.28799999999999998},"max":{"1min":0.64000000000000001,"5min":0.76100000000000001,"15min":0.82499999999999996},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53800000000000003,"15min":0.54900000000000004},"min":{"1min":0.37,"5min":0.33500000000000002,"15min":0.32800000000000001},"max":{"1min":0.68200000000000005,"5min":0.77000000000000002,"15min":0.78300000000000003},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.38800000000000001,"5min":0.35399999999999998,"15min":0.28699999999999998},"max":{"1min":0.70499999999999996,"5min":0.73799999999999999,"15min":0.83899999999999997},"last":0.53700000000000003}]},{"osd":3,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.53400000000000003,"15min":0.54100000000000004},"min":{"1min":0.378,"5min":0.36499999999999999,"15min":0.33200000000000002},"max":{"1min":0.65700000000000003,"5min":0.754,"15min":0.78000000000000003},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56999999999999995,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.40799999999999997,"15min":0.33900000000000002},"max":{"1min":0.67500000000000004,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.54800000000000004}]},{"osd":4,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44600000000000001,"15min":0.45800000000000002},"min":{"1min":0.32400000000000001,"5min":0.313,"15min":0.29699999999999999},"max":{"1min":0.55000000000000004,"5min":0.77000000000000002,"15min":0.79900000000000004},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.30099999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59899999999999998,"5min":0.75800000000000001,"15min":1.3180000000000001},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.48399999999999999,"15min":0.49099999999999999},"min":{"1min":0.317,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58699999999999997,"5min":0.80000000000000004,"15min":0.82899999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.61199999999999999,"5min":0.79300000000000004,"15min":0.872},"last":0.45800000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.69699999999999995,"5min":0.81200000000000006,"15min":0.85199999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.33700000000000002},"max":{"1min":0.67300000000000004,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.47499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575042,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302568,"kb_used_data":1376,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069272,"statfs":{"total":96636764160,"available":96326934528,"internally_reserved":0,"allocated":1409024,"data_stored":699295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.57099999999999995},"min":{"1min":0.38100000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72899999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.498},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56499999999999995,"15min":0.58699999999999997},"min":{"1min":0.46300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.748,"5min":0.79600000000000004,"15min":0.89300000000000002},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54600000000000004,"15min":0.56399999999999995},"min":{"1min":0.32800000000000001,"5min":0.30599999999999999,"15min":0.26400000000000001},"max":{"1min":0.75800000000000001,"5min":0.76900000000000002,"15min":0.82799999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58199999999999996,"15min":0.59899999999999998},"min":{"1min":0.45100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.751,"5min":0.82499999999999996,"15min":0.85199999999999998},"last":0.54600000000000004}]},{"osd":2,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56000000000000005,"15min":0.57299999999999995},"min":{"1min":0.371,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.77500000000000002,"5min":0.79900000000000004,"15min":0.82599999999999996},"last":0.376},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.40699999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76100000000000001,"5min":0.80900000000000005,"15min":0.82499999999999996},"last":0.53400000000000003}]},{"osd":3,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51100000000000001,"15min":0.53200000000000003},"min":{"1min":0.40400000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71899999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73499999999999999,"5min":0.75600000000000001,"15min":0.79600000000000004},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44600000000000001,"15min":0.45300000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.84199999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46100000000000002,"15min":0.47799999999999998},"min":{"1min":0.34999999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.746,"5min":0.76000000000000001,"15min":0.83899999999999997},"last":0.46700000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.45900000000000002,"15min":0.47199999999999998},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.28299999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.496,"15min":0.50700000000000001},"min":{"1min":0.38400000000000001,"5min":0.33500000000000002,"15min":0.31900000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.42099999999999999}]},{"osd":7,"last update":"Thu Nov 30 17:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.34499999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.74199999999999999,"5min":0.80700000000000005,"15min":0.93200000000000005},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55100000000000005,"15min":0.56299999999999994},"min":{"1min":0.43099999999999999,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.86499999999999999},"last":0.48699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575042,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306644,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065196,"statfs":{"total":96636764160,"available":96322760704,"internally_reserved":0,"allocated":1388544,"data_stored":697183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.378,"15min":0.35999999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23000000000000001},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.48699999999999999,"15min":0.47199999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.309},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.375}]},{"osd":2,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.38900000000000001},"min":{"1min":0.249,"5min":0.215,"15min":0.215},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.502},"min":{"1min":0.36499999999999999,"5min":0.33400000000000002,"15min":0.29499999999999998},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.46600000000000003,"15min":0.45200000000000001},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.23899999999999999},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.436},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.44800000000000001,"15min":0.435},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.40100000000000002}]},{"osd":4,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.35499999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.83499999999999996,"5min":0.88500000000000001,"15min":0.89100000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.61899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.39900000000000002},"max":{"1min":0.85099999999999998,"5min":0.97599999999999998,"15min":1.111},"last":0.623}]},{"osd":5,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.46500000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.39600000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.91300000000000003},"last":0.64100000000000001}]},{"osd":6,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.64800000000000002,"15min":0.65900000000000003},"min":{"1min":0.46500000000000002,"5min":0.39700000000000002,"15min":0.39600000000000002},"max":{"1min":0.91000000000000003,"5min":0.92700000000000005,"15min":1.0600000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66100000000000003,"15min":0.66500000000000004},"min":{"1min":0.437,"5min":0.433,"15min":0.379},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Nov 30 17:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.39900000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.94199999999999995},"last":0.54600000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575042,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302568,"kb_used_data":1376,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069272,"statfs":{"total":96636764160,"available":96326934528,"internally_reserved":0,"allocated":1409024,"data_stored":698021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.35999999999999999,"15min":0.36499999999999999},"min":{"1min":0.24299999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.498,"5min":0.54700000000000004,"15min":0.71199999999999997},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.374,"15min":0.38400000000000001},"min":{"1min":0.26900000000000002,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.55600000000000005,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.377,"15min":0.38600000000000001},"min":{"1min":0.26700000000000002,"5min":0.24399999999999999,"15min":0.23899999999999999},"max":{"1min":0.47499999999999998,"5min":0.58899999999999997,"15min":0.623},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.438,"15min":0.45700000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.57099999999999995,"5min":0.63400000000000001,"15min":0.70499999999999996},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.41099999999999998,"15min":0.42799999999999999},"min":{"1min":0.29199999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.53900000000000003,"5min":0.629,"15min":0.70999999999999996},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.42199999999999999,"15min":0.44},"min":{"1min":0.29699999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54600000000000004,"5min":0.64700000000000002,"15min":0.68799999999999994},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.58499999999999996,"15min":0.60199999999999998},"min":{"1min":0.34999999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.624,"5min":0.82599999999999996,"15min":0.96099999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.60699999999999998,"15min":0.61899999999999999},"min":{"1min":0.379,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76400000000000001,"5min":0.86899999999999999,"15min":0.98599999999999999},"last":0.503}]},{"osd":5,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.59399999999999997,"15min":0.60099999999999998},"min":{"1min":0.41199999999999998,"5min":0.39200000000000002,"15min":0.36199999999999999},"max":{"1min":0.72099999999999997,"5min":0.86799999999999999,"15min":1.0109999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.61199999999999999,"15min":0.626},"min":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.38},"max":{"1min":0.69199999999999995,"5min":0.90100000000000002,"15min":1.004},"last":0.54300000000000004}]},{"osd":6,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.625,"15min":0.64100000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.78700000000000003,"5min":0.89800000000000002,"15min":1.002},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.438,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.752,"5min":0.89300000000000002,"15min":0.96799999999999997},"last":0.53400000000000003}]},{"osd":7,"last update":"Thu Nov 30 17:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.63800000000000001,"15min":0.64900000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.68799999999999994,"5min":0.94499999999999995,"15min":1.0129999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.66900000000000004,"15min":0.68500000000000005},"min":{"1min":0.436,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.73299999999999998,"5min":0.93799999999999994,"15min":1.026},"last":0.46700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575042,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306644,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065196,"statfs":{"total":96636764160,"available":96322760704,"internally_reserved":0,"allocated":1388544,"data_stored":697183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.42699999999999999,"15min":0.40200000000000002},"min":{"1min":0.27700000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":3.4729999999999999,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.44700000000000001,"15min":0.437},"min":{"1min":0.312,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":0.38700000000000001}]},{"osd":1,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.51300000000000001,"15min":0.46300000000000002},"min":{"1min":0.28699999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":6.1210000000000004,"5min":6.1210000000000004,"15min":6.1210000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.52900000000000003,"15min":0.48899999999999999},"min":{"1min":0.34999999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":5.7270000000000003,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.441}]},{"osd":3,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38600000000000001,"15min":0.40000000000000002},"min":{"1min":0.27800000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.48799999999999999,"5min":0.63500000000000001,"15min":0.86199999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47299999999999998,"15min":0.46700000000000003},"min":{"1min":0.29699999999999999,"5min":0.26900000000000002,"15min":0.26200000000000001},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.69699999999999995,"15min":0.64200000000000002},"min":{"1min":0.432,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":8.7170000000000005,"5min":8.7170000000000005,"15min":8.7170000000000005},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.381,"5min":1.492,"15min":1.492},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.65600000000000003,"15min":0.63900000000000001},"min":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.44400000000000001,"5min":0.38900000000000001,"15min":0.38100000000000001},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.70599999999999996}]},{"osd":6,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61399999999999999,"15min":0.623},"min":{"1min":0.40899999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95999999999999996,"5min":1.359,"15min":1.359},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":0.82399999999999995}]},{"osd":7,"last update":"Thu Nov 30 17:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.70699999999999996,"15min":0.68300000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.40300000000000002},"max":{"1min":4.6849999999999996,"5min":4.6849999999999996,"15min":4.6849999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.70099999999999996,"15min":0.69099999999999995},"min":{"1min":0.45700000000000002,"5min":0.433,"15min":0.41499999999999998},"max":{"1min":4.5039999999999996,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.80200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575042,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306652,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065188,"statfs":{"total":96636764160,"available":96322752512,"internally_reserved":0,"allocated":1396736,"data_stored":698145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.34799999999999998,"15min":0.36399999999999999},"min":{"1min":0.222,"5min":0.219,"15min":0.217},"max":{"1min":0.46600000000000003,"5min":0.56599999999999995,"15min":0.66200000000000003},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.39500000000000002,"15min":0.40200000000000002},"min":{"1min":0.26700000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.48699999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.37,"15min":0.38600000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.51500000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.40999999999999998,"15min":0.42999999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.25900000000000001},"max":{"1min":0.59699999999999998,"5min":0.65900000000000003,"15min":0.84399999999999997},"last":0.34000000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.435,"15min":0.45000000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.26000000000000001},"max":{"1min":0.61799999999999999,"5min":0.72999999999999998,"15min":0.94899999999999995},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.49399999999999999,"15min":0.50900000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67100000000000004,"5min":1.054,"15min":1.054},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58699999999999997,"15min":0.60599999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.755,"5min":0.91500000000000004,"15min":0.97599999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59599999999999997,"15min":0.61299999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.70399999999999996,"5min":0.86799999999999999,"15min":0.91400000000000003},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.58099999999999996,"15min":0.60999999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80200000000000005,"5min":0.85399999999999998,"15min":0.98399999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61899999999999999,"15min":0.63800000000000001},"min":{"1min":0.372,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77300000000000002,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61799999999999999,"15min":0.64400000000000002},"min":{"1min":0.39800000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79900000000000004,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.626,"15min":0.64700000000000002},"min":{"1min":0.45000000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78900000000000003,"5min":0.89500000000000002,"15min":1.0389999999999999},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.64000000000000001,"15min":0.66200000000000003},"min":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.39100000000000001},"max":{"1min":0.80200000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63700000000000001,"15min":0.66100000000000003},"min":{"1min":0.45800000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79000000000000004,"5min":0.98999999999999999,"15min":1.004},"last":0.67500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575042,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302556,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069284,"statfs":{"total":96636764160,"available":96326946816,"internally_reserved":0,"allocated":1396736,"data_stored":697827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.53100000000000003},"min":{"1min":0.32200000000000001,"5min":0.28299999999999997,"15min":0.27500000000000002},"max":{"1min":0.72299999999999998,"5min":0.752,"15min":0.80900000000000005},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.38900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.66500000000000004,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52100000000000002,"15min":0.54200000000000004},"min":{"1min":0.35699999999999998,"5min":0.26900000000000002,"15min":0.25800000000000001},"max":{"1min":0.67600000000000005,"5min":0.73799999999999999,"15min":0.79600000000000004},"last":0.37},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.41899999999999998,"5min":0.317,"15min":0.246},"max":{"1min":0.67800000000000005,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56100000000000005,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.376,"15min":0.27800000000000002},"max":{"1min":0.73799999999999999,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.59399999999999997},"min":{"1min":0.373,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77300000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.54800000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32900000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55600000000000005,"15min":0.57099999999999995},"min":{"1min":0.438,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.80600000000000005},"last":0.47099999999999997}]},{"osd":5,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.44600000000000001,"15min":0.443},"min":{"1min":0.35299999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.73599999999999999,"5min":1.272,"15min":1.272},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.46700000000000003,"15min":0.46000000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29199999999999998},"max":{"1min":0.83399999999999996,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.46000000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51200000000000001,"15min":0.503},"min":{"1min":0.34699999999999998,"5min":0.34399999999999997,"15min":0.314},"max":{"1min":0.997,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55500000000000005,"15min":0.53900000000000003},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.33800000000000002},"max":{"1min":0.86499999999999999,"5min":1.129,"15min":1.129},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Nov 30 17:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.29899999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.82199999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57699999999999996,"15min":0.57099999999999995},"min":{"1min":0.45400000000000001,"5min":0.38600000000000001,"15min":0.34599999999999997},"max":{"1min":0.91500000000000004,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.56599999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575042,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302548,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069292,"statfs":{"total":96636764160,"available":96326955008,"internally_reserved":0,"allocated":1388544,"data_stored":697183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68500000000000005,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52400000000000002,"15min":0.53100000000000003},"min":{"1min":0.36599999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.69299999999999995,"5min":0.70299999999999996,"15min":0.81799999999999995},"last":0.504}]},{"osd":1,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.38400000000000001,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.72399999999999998},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53300000000000003,"15min":0.54800000000000004},"min":{"1min":0.36799999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.77000000000000002},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58199999999999996,"15min":0.58899999999999997},"min":{"1min":0.44800000000000001,"5min":0.34399999999999997,"15min":0.30599999999999999},"max":{"1min":0.72499999999999998,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.437,"5min":0.378,"15min":0.34499999999999997},"max":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53700000000000003,"15min":0.54800000000000004},"min":{"1min":0.40799999999999997,"5min":0.36699999999999999,"15min":0.36399999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.73799999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55400000000000005,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.82099999999999995},"last":1.0740000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.41999999999999998,"15min":0.439},"min":{"1min":0.28299999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.66700000000000004,"5min":0.72299999999999998,"15min":0.74299999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.45800000000000002,"15min":0.46600000000000003},"min":{"1min":0.30599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.628,"5min":0.69499999999999995,"15min":0.77600000000000002},"last":0.40799999999999997}]},{"osd":6,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.47399999999999998,"15min":0.48599999999999999},"min":{"1min":0.32200000000000001,"5min":0.29599999999999999,"15min":0.28499999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.82099999999999995},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54100000000000004,"15min":0.55000000000000004},"min":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.69699999999999995,"5min":0.79900000000000004,"15min":0.88200000000000001},"last":0.63}]},{"osd":7,"last update":"Thu Nov 30 17:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51700000000000002,"15min":0.52600000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.64900000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55900000000000005,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.84599999999999997},"last":0.73099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:23:40.799 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-30T17:23:40.799 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-30T17:23:40.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.957+0000 7f4bad074700 1 Processor -- start 2023-11-30T17:23:40.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.957+0000 7f4bad074700 1 -- start start 2023-11-30T17:23:40.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.958+0000 7f4bad074700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4ba80c66f0 0x7f4ba8154950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:40.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.958+0000 7f4bad074700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ba8158570 0x7f4ba8158a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:40.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.958+0000 7f4bad074700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba8154e40 con 0x7f4ba814e530 2023-11-30T17:23:40.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.958+0000 7f4bad074700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ba80c6ba0 con 0x7f4ba80c66f0 2023-11-30T17:23:40.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.958+0000 7f4bad074700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba80c7bc0 con 0x7f4ba8158570 2023-11-30T17:23:40.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.958+0000 7f4ba77fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4ba80c66f0 0x7f4ba8154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:40.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.958+0000 7f4ba77fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4ba80c66f0 0x7f4ba8154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54564/0 (socket says 172.21.15.49:54564) 2023-11-30T17:23:40.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.958+0000 7f4ba77fe700 1 -- 172.21.15.49:0/4243926706 learned_addr learned my addr 172.21.15.49:0/4243926706 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:40.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.958+0000 7f4bac873700 1 --2- 172.21.15.49:0/4243926706 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ba8158570 0x7f4ba8158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:40.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.958+0000 7f4ba77fe700 1 -- 172.21.15.49:0/4243926706 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ba8158570 msgr2=0x7f4ba8158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:40.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.958+0000 7f4ba77fe700 1 --2- 172.21.15.49:0/4243926706 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ba8158570 0x7f4ba8158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:40.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.958+0000 7f4ba77fe700 1 -- 172.21.15.49:0/4243926706 >> v1:172.21.15.115:6789/0 conn(0x7f4ba814e530 legacy=0x7f4ba814e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:40.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.958+0000 7f4ba77fe700 1 -- 172.21.15.49:0/4243926706 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba8155920 con 0x7f4ba80c66f0 2023-11-30T17:23:40.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.958+0000 7f4ba77fe700 1 --2- 172.21.15.49:0/4243926706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ba80c66f0 0x7f4ba8154950 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7f4b98006fd0 tx=0x7f4b980090f0).ready entity=mon.0 client_cookie=b0c87029ab82bc server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:40.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.958+0000 7f4ba6ffd700 1 -- 172.21.15.49:0/4243926706 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9800b600 con 0x7f4ba80c66f0 2023-11-30T17:23:40.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.958+0000 7f4ba6ffd700 1 -- 172.21.15.49:0/4243926706 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9800b760 con 0x7f4ba80c66f0 2023-11-30T17:23:40.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.958+0000 7f4ba6ffd700 1 -- 172.21.15.49:0/4243926706 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9800bae0 con 0x7f4ba80c66f0 2023-11-30T17:23:40.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.959+0000 7f4bad074700 1 -- 172.21.15.49:0/4243926706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ba80c66f0 msgr2=0x7f4ba8154950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:40.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.959+0000 7f4bad074700 1 --2- 172.21.15.49:0/4243926706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ba80c66f0 0x7f4ba8154950 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7f4b98006fd0 tx=0x7f4b980090f0).stop 2023-11-30T17:23:40.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.959+0000 7f4bad074700 1 -- 172.21.15.49:0/4243926706 shutdown_connections 2023-11-30T17:23:40.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.959+0000 7f4bad074700 1 --2- 172.21.15.49:0/4243926706 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ba8158570 0x7f4ba8158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:40.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.959+0000 7f4bad074700 1 --2- 172.21.15.49:0/4243926706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ba80c66f0 0x7f4ba8154950 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:40.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.959+0000 7f4bad074700 1 -- 172.21.15.49:0/4243926706 >> 172.21.15.49:0/4243926706 conn(0x7f4ba8064990 msgr2=0x7f4ba8064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:40.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.959+0000 7f4bad074700 1 -- 172.21.15.49:0/4243926706 shutdown_connections 2023-11-30T17:23:40.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.959+0000 7f4bad074700 1 -- 172.21.15.49:0/4243926706 wait complete. 2023-11-30T17:23:40.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.960+0000 7f4bad074700 1 Processor -- start 2023-11-30T17:23:40.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.960+0000 7f4bad074700 1 -- start start 2023-11-30T17:23:40.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.961+0000 7f4bad074700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ba80c66f0 0x7f4ba80af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:40.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.961+0000 7f4bad074700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ba814e530 0x7f4ba814e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:40.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.961+0000 7f4bad074700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ba8158570 0x7f4ba814ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:40.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.961+0000 7f4bad074700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba80c3130 con 0x7f4ba8158570 2023-11-30T17:23:40.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.961+0000 7f4bad074700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba814f2f0 con 0x7f4ba80c66f0 2023-11-30T17:23:40.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.961+0000 7f4bad074700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba80c2e50 con 0x7f4ba814e530 2023-11-30T17:23:40.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.961+0000 7f4bac873700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ba8158570 0x7f4ba814ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:40.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.961+0000 7f4bac873700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ba8158570 0x7f4ba814ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54580/0 (socket says 172.21.15.49:54580) 2023-11-30T17:23:40.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.961+0000 7f4bac873700 1 -- 172.21.15.49:0/1557261136 learned_addr learned my addr 172.21.15.49:0/1557261136 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:40.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.961+0000 7f4ba7fff700 1 --2- 172.21.15.49:0/1557261136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ba80c66f0 0x7f4ba80af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:40.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.961+0000 7f4ba77fe700 1 --2- 172.21.15.49:0/1557261136 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ba814e530 0x7f4ba814e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:40.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.961+0000 7f4bac873700 1 -- 172.21.15.49:0/1557261136 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ba814e530 msgr2=0x7f4ba814e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:40.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.961+0000 7f4bac873700 1 --2- 172.21.15.49:0/1557261136 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ba814e530 0x7f4ba814e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:40.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.961+0000 7f4bac873700 1 -- 172.21.15.49:0/1557261136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ba80c66f0 msgr2=0x7f4ba80af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:40.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.961+0000 7f4bac873700 1 --2- 172.21.15.49:0/1557261136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ba80c66f0 0x7f4ba80af7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:40.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.961+0000 7f4bac873700 1 -- 172.21.15.49:0/1557261136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b98009370 con 0x7f4ba8158570 2023-11-30T17:23:40.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.962+0000 7f4bac873700 1 --2- 172.21.15.49:0/1557261136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ba8158570 0x7f4ba814ee00 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f4ba0007f20 tx=0x7f4ba0009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:40.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.962+0000 7f4b8ffff700 1 -- 172.21.15.49:0/1557261136 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba000eb90 con 0x7f4ba8158570 2023-11-30T17:23:40.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.962+0000 7f4b8ffff700 1 -- 172.21.15.49:0/1557261136 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba000ecf0 con 0x7f4ba8158570 2023-11-30T17:23:40.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.962+0000 7f4bad074700 1 -- 172.21.15.49:0/1557261136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ba80c3460 con 0x7f4ba8158570 2023-11-30T17:23:40.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.962+0000 7f4b8ffff700 1 -- 172.21.15.49:0/1557261136 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0014610 con 0x7f4ba8158570 2023-11-30T17:23:40.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.962+0000 7f4bad074700 1 -- 172.21.15.49:0/1557261136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba80c3a20 con 0x7f4ba8158570 2023-11-30T17:23:40.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.963+0000 7f4bad074700 1 -- 172.21.15.49:0/1557261136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ba8154bf0 con 0x7f4ba8158570 2023-11-30T17:23:40.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.963+0000 7f4b8ffff700 1 -- 172.21.15.49:0/1557261136 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4ba0014980 con 0x7f4ba8158570 2023-11-30T17:23:40.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.964+0000 7f4b8ffff700 1 --2- 172.21.15.49:0/1557261136 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4b9405f270 0x7f4b94061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:40.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.964+0000 7f4b8ffff700 1 -- 172.21.15.49:0/1557261136 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f4ba007a770 con 0x7f4ba8158570 2023-11-30T17:23:40.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.964+0000 7f4ba7fff700 1 --2- 172.21.15.49:0/1557261136 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4b9405f270 0x7f4b94061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:40.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.964+0000 7f4ba7fff700 1 --2- 172.21.15.49:0/1557261136 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4b9405f270 0x7f4b94061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f4b9c003900 tx=0x7f4b9c007d40).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:40.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:40.968+0000 7f4b8ffff700 1 -- 172.21.15.49:0/1557261136 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4ba004b8a0 con 0x7f4ba8158570 2023-11-30T17:23:41.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.209+0000 7f4bad074700 1 -- 172.21.15.49:0/1557261136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4ba8062ee0 con 0x7f4ba8158570 2023-11-30T17:23:41.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.212+0000 7f4b8ffff700 1 -- 172.21.15.49:0/1557261136 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4ba000ee60 con 0x7f4ba8158570 2023-11-30T17:23:41.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.214+0000 7f4bad074700 1 -- 172.21.15.49:0/1557261136 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4b9405f270 msgr2=0x7f4b94061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:41.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.214+0000 7f4bad074700 1 --2- 172.21.15.49:0/1557261136 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4b9405f270 0x7f4b94061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f4b9c003900 tx=0x7f4b9c007d40).stop 2023-11-30T17:23:41.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.214+0000 7f4bad074700 1 -- 172.21.15.49:0/1557261136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ba8158570 msgr2=0x7f4ba814ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:41.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.214+0000 7f4bad074700 1 --2- 172.21.15.49:0/1557261136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ba8158570 0x7f4ba814ee00 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f4ba0007f20 tx=0x7f4ba0009860).stop 2023-11-30T17:23:41.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.214+0000 7f4bad074700 1 -- 172.21.15.49:0/1557261136 shutdown_connections 2023-11-30T17:23:41.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.214+0000 7f4bad074700 1 --2- 172.21.15.49:0/1557261136 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4b9405f270 0x7f4b94061730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:41.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.214+0000 7f4bad074700 1 --2- 172.21.15.49:0/1557261136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ba8158570 0x7f4ba814ee00 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:41.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.214+0000 7f4bad074700 1 --2- 172.21.15.49:0/1557261136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ba80c66f0 0x7f4ba80af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:41.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.214+0000 7f4bad074700 1 --2- 172.21.15.49:0/1557261136 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ba814e530 0x7f4ba814e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:41.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.214+0000 7f4bad074700 1 -- 172.21.15.49:0/1557261136 >> 172.21.15.49:0/1557261136 conn(0x7f4ba8064990 msgr2=0x7f4ba8064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:41.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.214+0000 7f4bad074700 1 -- 172.21.15.49:0/1557261136 shutdown_connections 2023-11-30T17:23:41.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.215+0000 7f4bad074700 1 -- 172.21.15.49:0/1557261136 wait complete. 2023-11-30T17:23:41.217 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2023-11-30T17:23:41.228 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:23:41.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.344+0000 7f0bd99d0700 1 Processor -- start 2023-11-30T17:23:41.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.344+0000 7f0bd99d0700 1 -- start start 2023-11-30T17:23:41.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.345+0000 7f0bd99d0700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0bd41544d0 0x7f0bd4155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:41.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.345+0000 7f0bd99d0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0bd4066f40 0x7f0bd4095e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:41.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.345+0000 7f0bd99d0700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0bd40673c0 0x7f0bd4096370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:41.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.345+0000 7f0bd99d0700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd4096860 con 0x7f0bd41544d0 2023-11-30T17:23:41.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.345+0000 7f0bd99d0700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd40683d0 con 0x7f0bd40673c0 2023-11-30T17:23:41.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.345+0000 7f0bd99d0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd4067850 con 0x7f0bd4066f40 2023-11-30T17:23:41.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.345+0000 7f0bd2ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0bd41544d0 0x7f0bd4155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:41.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.345+0000 7f0bd2ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0bd41544d0 0x7f0bd4155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54590/0 (socket says 172.21.15.49:54590) 2023-11-30T17:23:41.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.345+0000 7f0bd2ffd700 1 -- 172.21.15.49:0/4164349660 learned_addr learned my addr 172.21.15.49:0/4164349660 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:41.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.345+0000 7f0bd27fc700 1 --2- 172.21.15.49:0/4164349660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0bd4066f40 0x7f0bd4095e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:41.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.345+0000 7f0bd37fe700 1 --2- 172.21.15.49:0/4164349660 >> v2:172.21.15.115:3300/0 conn(0x7f0bd40673c0 0x7f0bd4096370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:41.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.345+0000 7f0bd2ffd700 1 -- 172.21.15.49:0/4164349660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0bd4066f40 msgr2=0x7f0bd4095e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:41.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.345+0000 7f0bd2ffd700 1 --2- 172.21.15.49:0/4164349660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0bd4066f40 0x7f0bd4095e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:41.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.346+0000 7f0bd2ffd700 1 -- 172.21.15.49:0/4164349660 >> v2:172.21.15.115:3300/0 conn(0x7f0bd40673c0 msgr2=0x7f0bd4096370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:41.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.346+0000 7f0bd2ffd700 1 --2- 172.21.15.49:0/4164349660 >> v2:172.21.15.115:3300/0 conn(0x7f0bd40673c0 0x7f0bd4096370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:41.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.346+0000 7f0bd2ffd700 1 -- 172.21.15.49:0/4164349660 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd4067b30 con 0x7f0bd41544d0 2023-11-30T17:23:41.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.346+0000 7f0bd2ffd700 1 --2- 172.21.15.49:0/4164349660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bd41544d0 0x7f0bd4155750 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7f0bd4097000 tx=0x7f0bcc009840).ready entity=mon.0 client_cookie=e833bab3978192b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:41.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.346+0000 7f0bd1ffb700 1 -- 172.21.15.49:0/4164349660 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc00e070 con 0x7f0bd41544d0 2023-11-30T17:23:41.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.346+0000 7f0bd1ffb700 1 -- 172.21.15.49:0/4164349660 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bcc00b970 con 0x7f0bd41544d0 2023-11-30T17:23:41.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.346+0000 7f0bd1ffb700 1 -- 172.21.15.49:0/4164349660 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc00bcf0 con 0x7f0bd41544d0 2023-11-30T17:23:41.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.346+0000 7f0bd99d0700 1 -- 172.21.15.49:0/4164349660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bd41544d0 msgr2=0x7f0bd4155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:41.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.346+0000 7f0bd99d0700 1 --2- 172.21.15.49:0/4164349660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bd41544d0 0x7f0bd4155750 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7f0bd4097000 tx=0x7f0bcc009840).stop 2023-11-30T17:23:41.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.346+0000 7f0bd99d0700 1 -- 172.21.15.49:0/4164349660 shutdown_connections 2023-11-30T17:23:41.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.346+0000 7f0bd99d0700 1 --2- 172.21.15.49:0/4164349660 >> v2:172.21.15.115:3300/0 conn(0x7f0bd40673c0 0x7f0bd4096370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:41.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.346+0000 7f0bd99d0700 1 --2- 172.21.15.49:0/4164349660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bd41544d0 0x7f0bd4155750 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:41.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.346+0000 7f0bd99d0700 1 --2- 172.21.15.49:0/4164349660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0bd4066f40 0x7f0bd4095e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:41.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.346+0000 7f0bd99d0700 1 -- 172.21.15.49:0/4164349660 >> 172.21.15.49:0/4164349660 conn(0x7f0bd40631d0 msgr2=0x7f0bd40c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:41.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.346+0000 7f0bd99d0700 1 -- 172.21.15.49:0/4164349660 shutdown_connections 2023-11-30T17:23:41.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.346+0000 7f0bd99d0700 1 -- 172.21.15.49:0/4164349660 wait complete. 2023-11-30T17:23:41.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.348+0000 7f0bd99d0700 1 Processor -- start 2023-11-30T17:23:41.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.348+0000 7f0bd99d0700 1 -- start start 2023-11-30T17:23:41.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.348+0000 7f0bd99d0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bd4066f40 0x7f0bd40ac610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:41.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.348+0000 7f0bd99d0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0bd41544d0 0x7f0bd4155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:41.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.348+0000 7f0bd99d0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bd414eef0 0x7f0bd414f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:41.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.348+0000 7f0bd99d0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd40acb00 con 0x7f0bd4066f40 2023-11-30T17:23:41.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.348+0000 7f0bd99d0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd40a98f0 con 0x7f0bd414eef0 2023-11-30T17:23:41.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.348+0000 7f0bd99d0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd40a8a00 con 0x7f0bd41544d0 2023-11-30T17:23:41.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.348+0000 7f0bd2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bd4066f40 0x7f0bd40ac610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:41.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.348+0000 7f0bd2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bd4066f40 0x7f0bd40ac610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54600/0 (socket says 172.21.15.49:54600) 2023-11-30T17:23:41.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.348+0000 7f0bd2ffd700 1 -- 172.21.15.49:0/4262749920 learned_addr learned my addr 172.21.15.49:0/4262749920 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:41.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.349+0000 7f0bd37fe700 1 --2- 172.21.15.49:0/4262749920 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bd414eef0 0x7f0bd414f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:41.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.349+0000 7f0bd27fc700 1 --2- 172.21.15.49:0/4262749920 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0bd41544d0 0x7f0bd4155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:41.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.349+0000 7f0bd2ffd700 1 -- 172.21.15.49:0/4262749920 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0bd41544d0 msgr2=0x7f0bd4155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:41.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.349+0000 7f0bd2ffd700 1 --2- 172.21.15.49:0/4262749920 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0bd41544d0 0x7f0bd4155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:41.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.349+0000 7f0bd2ffd700 1 -- 172.21.15.49:0/4262749920 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bd414eef0 msgr2=0x7f0bd414f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:41.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.349+0000 7f0bd2ffd700 1 --2- 172.21.15.49:0/4262749920 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bd414eef0 0x7f0bd414f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:41.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.349+0000 7f0bd2ffd700 1 -- 172.21.15.49:0/4262749920 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc009ae0 con 0x7f0bd4066f40 2023-11-30T17:23:41.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.349+0000 7f0bd2ffd700 1 --2- 172.21.15.49:0/4262749920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bd4066f40 0x7f0bd40ac610 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7f0bcc00b610 tx=0x7f0bcc009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:41.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.349+0000 7f0bcaffd700 1 -- 172.21.15.49:0/4262749920 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc0092e0 con 0x7f0bd4066f40 2023-11-30T17:23:41.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.349+0000 7f0bcaffd700 1 -- 172.21.15.49:0/4262749920 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bcc00bae0 con 0x7f0bd4066f40 2023-11-30T17:23:41.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.349+0000 7f0bd99d0700 1 -- 172.21.15.49:0/4262749920 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bd40a8ce0 con 0x7f0bd4066f40 2023-11-30T17:23:41.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.349+0000 7f0bcaffd700 1 -- 172.21.15.49:0/4262749920 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc01d460 con 0x7f0bd4066f40 2023-11-30T17:23:41.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.349+0000 7f0bd99d0700 1 -- 172.21.15.49:0/4262749920 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd40a92a0 con 0x7f0bd4066f40 2023-11-30T17:23:41.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.350+0000 7f0bd99d0700 1 -- 172.21.15.49:0/4262749920 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bd406c860 con 0x7f0bd4066f40 2023-11-30T17:23:41.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.350+0000 7f0bcaffd700 1 -- 172.21.15.49:0/4262749920 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0bcc003040 con 0x7f0bd4066f40 2023-11-30T17:23:41.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.351+0000 7f0bcaffd700 1 --2- 172.21.15.49:0/4262749920 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0bb405f270 0x7f0bb4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:41.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.351+0000 7f0bcaffd700 1 -- 172.21.15.49:0/4262749920 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f0bcc07b4c0 con 0x7f0bd4066f40 2023-11-30T17:23:41.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.351+0000 7f0bd27fc700 1 --2- 172.21.15.49:0/4262749920 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0bb405f270 0x7f0bb4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:41.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.351+0000 7f0bd27fc700 1 --2- 172.21.15.49:0/4262749920 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0bb405f270 0x7f0bb4061730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f0bd40af040 tx=0x7f0bbc008040).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:41.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.355+0000 7f0bcaffd700 1 -- 172.21.15.49:0/4262749920 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0bcc04c5f0 con 0x7f0bd4066f40 2023-11-30T17:23:41.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.570+0000 7f0bd99d0700 1 -- 172.21.15.49:0/4262749920 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0bd4067e10 con 0x7f0bd4066f40 2023-11-30T17:23:41.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.571+0000 7f0bcaffd700 1 -- 172.21.15.49:0/4262749920 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f0bcc022020 con 0x7f0bd4066f40 2023-11-30T17:23:41.572 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:41.572 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1725128963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1725128963},{"type":"v1","addr":"172.21.15.115:6836","nonce":1725128963}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6955,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3975305695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3975305695},{"type":"v1","addr":"172.21.15.115:6837","nonce":3975305695}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/2909602857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2909602857},{"type":"v1","addr":"172.21.15.49:6834","nonce":2909602857}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:23:31.943367+0000","modified":"2023-11-30T17:23:34.949501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7137},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7137":{"gid":7137,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1751656884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1751656884},{"type":"v1","addr":"172.21.15.49:6835","nonce":1751656884}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-11-30T17:23:41.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.572+0000 7f0bd99d0700 1 -- 172.21.15.49:0/4262749920 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0bb405f270 msgr2=0x7f0bb4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:41.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.572+0000 7f0bd99d0700 1 --2- 172.21.15.49:0/4262749920 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0bb405f270 0x7f0bb4061730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f0bd40af040 tx=0x7f0bbc008040).stop 2023-11-30T17:23:41.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.572+0000 7f0bd99d0700 1 -- 172.21.15.49:0/4262749920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bd4066f40 msgr2=0x7f0bd40ac610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:41.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.572+0000 7f0bd99d0700 1 --2- 172.21.15.49:0/4262749920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bd4066f40 0x7f0bd40ac610 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7f0bcc00b610 tx=0x7f0bcc009840).stop 2023-11-30T17:23:41.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.572+0000 7f0bd99d0700 1 -- 172.21.15.49:0/4262749920 shutdown_connections 2023-11-30T17:23:41.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.572+0000 7f0bd99d0700 1 --2- 172.21.15.49:0/4262749920 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bd414eef0 0x7f0bd414f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:41.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.572+0000 7f0bd99d0700 1 --2- 172.21.15.49:0/4262749920 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0bb405f270 0x7f0bb4061730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:41.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.572+0000 7f0bd99d0700 1 --2- 172.21.15.49:0/4262749920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bd4066f40 0x7f0bd40ac610 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:41.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.572+0000 7f0bd99d0700 1 --2- 172.21.15.49:0/4262749920 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0bd41544d0 0x7f0bd4155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:41.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.572+0000 7f0bd99d0700 1 -- 172.21.15.49:0/4262749920 >> 172.21.15.49:0/4262749920 conn(0x7f0bd40631d0 msgr2=0x7f0bd40be070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:41.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.573+0000 7f0bd99d0700 1 -- 172.21.15.49:0/4262749920 shutdown_connections 2023-11-30T17:23:41.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:41.573+0000 7f0bd99d0700 1 -- 172.21.15.49:0/4262749920 wait complete. 2023-11-30T17:23:41.575 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 46 2023-11-30T17:23:41.988 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-30T17:23:31.943367+0000', 'modified': '2023-11-30T17:23:34.949501+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7137}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7137': {'gid': 7137, 'name': 'c', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6835/1751656884', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6833', 'nonce': 1751656884}, {'type': 'v1', 'addr': '172.21.15.49:6835', 'nonce': 1751656884}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-11-30T17:23:41.989 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-30T17:23:41.989 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-30T17:23:42.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.108+0000 7f980ae84700 1 Processor -- start 2023-11-30T17:23:42.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.109+0000 7f980ae84700 1 -- start start 2023-11-30T17:23:42.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.109+0000 7f980ae84700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f98040c6190 0x7f98040c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:42.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.109+0000 7f980ae84700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98040c72d0 con 0x7f9804158320 2023-11-30T17:23:42.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.109+0000 7f980ae84700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9804064570 con 0x7f9804098d10 2023-11-30T17:23:42.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.109+0000 7f980ae84700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9804154bc0 con 0x7f98040c6190 2023-11-30T17:23:42.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.110+0000 7f9809421700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9804158320 0x7f98040a80f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38454/0 (socket says 172.21.15.49:38454) 2023-11-30T17:23:42.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.110+0000 7f9809421700 1 -- 172.21.15.49:0/2885895593 learned_addr learned my addr 172.21.15.49:0/2885895593 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:42.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.110+0000 7f9803fff700 1 --2- 172.21.15.49:0/2885895593 >> v2:172.21.15.115:3300/0 conn(0x7f98040c6190 0x7f98040c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:42.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.110+0000 7f98037fe700 1 -- 172.21.15.49:0/2885895593 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 899870506 0 0) 0x7f98040c72d0 con 0x7f9804158320 2023-11-30T17:23:42.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.110+0000 7f98037fe700 1 -- 172.21.15.49:0/2885895593 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97f00033f0 con 0x7f9804158320 2023-11-30T17:23:42.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.110+0000 7f98037fe700 1 -- 172.21.15.49:0/2885895593 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3143704765 0 0) 0x7f97f00033f0 con 0x7f9804158320 2023-11-30T17:23:42.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.110+0000 7f98037fe700 1 -- 172.21.15.49:0/2885895593 >> v2:172.21.15.115:3300/0 conn(0x7f98040c6190 msgr2=0x7f98040c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:42.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.110+0000 7f98037fe700 1 --2- 172.21.15.49:0/2885895593 >> v2:172.21.15.115:3300/0 conn(0x7f98040c6190 0x7f98040c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.110+0000 7f98037fe700 1 -- 172.21.15.49:0/2885895593 >> v1:172.21.15.115:6789/0 conn(0x7f9804098d10 legacy=0x7f9804063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:42.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.110+0000 7f98037fe700 1 -- 172.21.15.49:0/2885895593 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98040c66c0 con 0x7f9804158320 2023-11-30T17:23:42.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.110+0000 7f98037fe700 1 -- 172.21.15.49:0/2885895593 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f97ec001470 con 0x7f9804158320 2023-11-30T17:23:42.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.110+0000 7f98037fe700 1 -- 172.21.15.49:0/2885895593 >> v1:172.21.15.49:6789/0 conn(0x7f9804158320 legacy=0x7f98040a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:42.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.110+0000 7f98037fe700 1 --2- 172.21.15.49:0/2885895593 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97f00038e0 0x7f97f0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:42.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.110+0000 7f98037fe700 1 --2- 172.21.15.49:0/2885895593 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97f0004690 0x7f97f0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.110+0000 7f98037fe700 1 --2- 172.21.15.49:0/2885895593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97f0005000 0x7f97f000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.110+0000 7f98037fe700 1 -- 172.21.15.49:0/2885895593 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9804154bc0 con 0x7f97f0005000 2023-11-30T17:23:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.110+0000 7f98037fe700 1 -- 172.21.15.49:0/2885895593 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f000beb0 con 0x7f97f0004690 2023-11-30T17:23:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.110+0000 7f98037fe700 1 -- 172.21.15.49:0/2885895593 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f000c070 con 0x7f97f00038e0 2023-11-30T17:23:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.110+0000 7f9809421700 1 --2- 172.21.15.49:0/2885895593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97f0005000 0x7f97f000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.110+0000 7f9803fff700 1 --2- 172.21.15.49:0/2885895593 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97f0004690 0x7f97f0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.110+0000 7f9808c20700 1 --2- 172.21.15.49:0/2885895593 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97f00038e0 0x7f97f0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.111+0000 7f9809421700 1 -- 172.21.15.49:0/2885895593 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97f00038e0 msgr2=0x7f97f0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.111+0000 7f9809421700 1 --2- 172.21.15.49:0/2885895593 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97f00038e0 0x7f97f0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.111+0000 7f9809421700 1 -- 172.21.15.49:0/2885895593 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97f0004690 msgr2=0x7f97f0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.111+0000 7f9809421700 1 --2- 172.21.15.49:0/2885895593 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97f0004690 0x7f97f0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.111+0000 7f9809421700 1 -- 172.21.15.49:0/2885895593 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f00033f0 con 0x7f97f0005000 2023-11-30T17:23:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.111+0000 7f9803fff700 1 --2- 172.21.15.49:0/2885895593 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97f0004690 0x7f97f0004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:23:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.111+0000 7f9809421700 1 -- 172.21.15.49:0/2885895593 reap_dead start 2023-11-30T17:23:42.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.111+0000 7f9809421700 1 --2- 172.21.15.49:0/2885895593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97f0005000 0x7f97f000b8e0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f97ec00c190 tx=0x7f97ec001e50).ready entity=mon.0 client_cookie=53154644671cb91f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:42.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.111+0000 7f98037fe700 1 -- 172.21.15.49:0/2885895593 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec007a20 con 0x7f97f0005000 2023-11-30T17:23:42.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.111+0000 7f98037fe700 1 -- 172.21.15.49:0/2885895593 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ec00cac0 con 0x7f97f0005000 2023-11-30T17:23:42.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.111+0000 7f98037fe700 1 -- 172.21.15.49:0/2885895593 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec00ce40 con 0x7f97f0005000 2023-11-30T17:23:42.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.111+0000 7f980ae84700 1 -- 172.21.15.49:0/2885895593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97f0005000 msgr2=0x7f97f000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:42.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.111+0000 7f980ae84700 1 --2- 172.21.15.49:0/2885895593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97f0005000 0x7f97f000b8e0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f97ec00c190 tx=0x7f97ec001e50).stop 2023-11-30T17:23:42.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.111+0000 7f980ae84700 1 -- 172.21.15.49:0/2885895593 shutdown_connections 2023-11-30T17:23:42.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.111+0000 7f980ae84700 1 --2- 172.21.15.49:0/2885895593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97f0005000 0x7f97f000b8e0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.111+0000 7f980ae84700 1 -- 172.21.15.49:0/2885895593 >> 172.21.15.49:0/2885895593 conn(0x7f98040cb310 msgr2=0x7f98040cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:42.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.111+0000 7f980ae84700 1 -- 172.21.15.49:0/2885895593 shutdown_connections 2023-11-30T17:23:42.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.111+0000 7f980ae84700 1 -- 172.21.15.49:0/2885895593 wait complete. 2023-11-30T17:23:42.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.113+0000 7f980ae84700 1 Processor -- start 2023-11-30T17:23:42.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.113+0000 7f980ae84700 1 -- start start 2023-11-30T17:23:42.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.114+0000 7f980ae84700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97f0005000 0x7f980414f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:42.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.114+0000 7f980ae84700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98040afb00 0x7f98040aff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:42.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.114+0000 7f980ae84700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98040ae2c0 0x7f98040ae740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:42.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.114+0000 7f980ae84700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98041658f0 con 0x7f97f0005000 2023-11-30T17:23:42.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.114+0000 7f980ae84700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98040ab180 con 0x7f98040ae2c0 2023-11-30T17:23:42.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.114+0000 7f980ae84700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98040b0470 con 0x7f98040afb00 2023-11-30T17:23:42.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.114+0000 7f9808c20700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97f0005000 0x7f980414f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:42.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.114+0000 7f9808c20700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97f0005000 0x7f980414f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54630/0 (socket says 172.21.15.49:54630) 2023-11-30T17:23:42.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.114+0000 7f9808c20700 1 -- 172.21.15.49:0/3847253396 learned_addr learned my addr 172.21.15.49:0/3847253396 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:42.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.114+0000 7f9803fff700 1 --2- 172.21.15.49:0/3847253396 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98040afb00 0x7f98040aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:42.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.114+0000 7f9809421700 1 --2- 172.21.15.49:0/3847253396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98040ae2c0 0x7f98040ae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.114+0000 7f9808c20700 1 -- 172.21.15.49:0/3847253396 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98040afb00 msgr2=0x7f98040aff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.114+0000 7f9808c20700 1 --2- 172.21.15.49:0/3847253396 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98040afb00 0x7f98040aff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.114+0000 7f9808c20700 1 -- 172.21.15.49:0/3847253396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98040ae2c0 msgr2=0x7f98040ae740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.114+0000 7f9808c20700 1 --2- 172.21.15.49:0/3847253396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98040ae2c0 0x7f98040ae740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.114+0000 7f9808c20700 1 -- 172.21.15.49:0/3847253396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980414f740 con 0x7f97f0005000 2023-11-30T17:23:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.114+0000 7f9808c20700 1 --2- 172.21.15.49:0/3847253396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97f0005000 0x7f980414f250 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f97fc0028f0 tx=0x7f97fc007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.114+0000 7f9800ff9700 1 -- 172.21.15.49:0/3847253396 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc011590 con 0x7f97f0005000 2023-11-30T17:23:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.114+0000 7f9800ff9700 1 -- 172.21.15.49:0/3847253396 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97fc0116f0 con 0x7f97f0005000 2023-11-30T17:23:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.114+0000 7f9800ff9700 1 -- 172.21.15.49:0/3847253396 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc011a70 con 0x7f97f0005000 2023-11-30T17:23:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.114+0000 7f980ae84700 1 -- 172.21.15.49:0/3847253396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98040aeff0 con 0x7f97f0005000 2023-11-30T17:23:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.114+0000 7f980ae84700 1 -- 172.21.15.49:0/3847253396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98040af5b0 con 0x7f97f0005000 2023-11-30T17:23:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.116+0000 7f9800ff9700 1 -- 172.21.15.49:0/3847253396 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f97fc0133f0 con 0x7f97f0005000 2023-11-30T17:23:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.116+0000 7f9800ff9700 1 --2- 172.21.15.49:0/3847253396 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f97e405f240 0x7f97e4061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.116+0000 7f9800ff9700 1 -- 172.21.15.49:0/3847253396 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f97fc079cb0 con 0x7f97f0005000 2023-11-30T17:23:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.116+0000 7f9803fff700 1 --2- 172.21.15.49:0/3847253396 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f97e405f240 0x7f97e4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.117+0000 7f9803fff700 1 --2- 172.21.15.49:0/3847253396 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f97e405f240 0x7f97e4061700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f98040b15a0 tx=0x7f97f400b040).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:42.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.118+0000 7f981c81cb80 1 Processor -- start 2023-11-30T17:23:42.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.118+0000 7f981c81cb80 1 -- start start 2023-11-30T17:23:42.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.119+0000 7f981c81cb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d1f22b8e40 0x55d1f2524d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:42.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.119+0000 7f981c81cb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d1f2545ea0 0x55d1f24fc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:42.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.119+0000 7f981c81cb80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55d1f24fccb0 0x55d1f24f7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:42.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.119+0000 7f981c81cb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1f24c2060 con 0x55d1f22b8e40 2023-11-30T17:23:42.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.119+0000 7f981c81cb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1f24391f0 con 0x55d1f2545ea0 2023-11-30T17:23:42.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.119+0000 7f981c81cb80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1f244e440 con 0x55d1f24fccb0 2023-11-30T17:23:42.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.119+0000 7f9808c20700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d1f22b8e40 0x55d1f2524d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:42.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.119+0000 7f9808c20700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d1f22b8e40 0x55d1f2524d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54636/0 (socket says 172.21.15.49:54636) 2023-11-30T17:23:42.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.119+0000 7f9808c20700 1 -- 172.21.15.49:0/1390402229 learned_addr learned my addr 172.21.15.49:0/1390402229 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:42.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.119+0000 7f9809421700 1 --2- 172.21.15.49:0/1390402229 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55d1f24fccb0 0x55d1f24f7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:42.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.119+0000 7f9803fff700 1 --2- 172.21.15.49:0/1390402229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d1f2545ea0 0x55d1f24fc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:42.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.119+0000 7f9808c20700 1 -- 172.21.15.49:0/1390402229 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55d1f24fccb0 msgr2=0x55d1f24f7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:42.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.119+0000 7f9808c20700 1 --2- 172.21.15.49:0/1390402229 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55d1f24fccb0 0x55d1f24f7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.119+0000 7f9808c20700 1 -- 172.21.15.49:0/1390402229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d1f2545ea0 msgr2=0x55d1f24fc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:42.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.119+0000 7f9808c20700 1 --2- 172.21.15.49:0/1390402229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d1f2545ea0 0x55d1f24fc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.119+0000 7f9808c20700 1 -- 172.21.15.49:0/1390402229 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1f2447620 con 0x55d1f22b8e40 2023-11-30T17:23:42.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.119+0000 7f9803fff700 1 --2- 172.21.15.49:0/1390402229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d1f2545ea0 0x55d1f24fc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:23:42.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.119+0000 7f9808c20700 1 --2- 172.21.15.49:0/1390402229 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d1f22b8e40 0x55d1f2524d90 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7f97fc078010 tx=0x7f97fc012000).ready entity=mon.0 client_cookie=2af26bfc77561bd7 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:42.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.120+0000 7f97f9ffb700 1 -- 172.21.15.49:0/1390402229 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc04cc30 con 0x55d1f22b8e40 2023-11-30T17:23:42.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.120+0000 7f97f9ffb700 1 -- 172.21.15.49:0/1390402229 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97fc04ce90 con 0x55d1f22b8e40 2023-11-30T17:23:42.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.120+0000 7f97f9ffb700 1 -- 172.21.15.49:0/1390402229 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc04b200 con 0x55d1f22b8e40 2023-11-30T17:23:42.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.120+0000 7f981c81cb80 1 -- 172.21.15.49:0/1390402229 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d1f22b8e40 msgr2=0x55d1f2524d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:42.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.120+0000 7f981c81cb80 1 --2- 172.21.15.49:0/1390402229 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d1f22b8e40 0x55d1f2524d90 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7f97fc078010 tx=0x7f97fc012000).stop 2023-11-30T17:23:42.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.120+0000 7f981c81cb80 1 -- 172.21.15.49:0/1390402229 shutdown_connections 2023-11-30T17:23:42.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.120+0000 7f981c81cb80 1 --2- 172.21.15.49:0/1390402229 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55d1f24fccb0 0x55d1f24f7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.120+0000 7f981c81cb80 1 --2- 172.21.15.49:0/1390402229 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d1f22b8e40 0x55d1f2524d90 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.120+0000 7f981c81cb80 1 --2- 172.21.15.49:0/1390402229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d1f2545ea0 0x55d1f24fc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.120+0000 7f981c81cb80 1 -- 172.21.15.49:0/1390402229 >> 172.21.15.49:0/1390402229 conn(0x55d1f23664a0 msgr2=0x55d1f2545790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:42.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.120+0000 7f981c81cb80 1 -- 172.21.15.49:0/1390402229 shutdown_connections 2023-11-30T17:23:42.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.120+0000 7f981c81cb80 1 -- 172.21.15.49:0/1390402229 wait complete. 2023-11-30T17:23:42.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.121+0000 7f981c81cb80 1 -- start start 2023-11-30T17:23:42.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.121+0000 7f981c81cb80 1 Processor -- start 2023-11-30T17:23:42.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.122+0000 7f981c81cb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d1f22b8e40 0x55d1f2522420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:42.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.122+0000 7f981c81cb80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55d1f24fccb0 0x55d1f25298b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:42.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.122+0000 7f981c81cb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d1f2545ea0 0x55d1f2542130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:42.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.122+0000 7f981c81cb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1f244e580 con 0x55d1f22b8e40 2023-11-30T17:23:42.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.122+0000 7f981c81cb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1f244e800 con 0x55d1f2545ea0 2023-11-30T17:23:42.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.122+0000 7f981c81cb80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1f2419e10 con 0x55d1f24fccb0 2023-11-30T17:23:42.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.122+0000 7f981c81cb80 10 client.0 ll_register_callbacks cb 0x55d1f24bc460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-30T17:23:42.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.122+0000 7f9808c20700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d1f22b8e40 0x55d1f2522420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:42.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.122+0000 7f9808c20700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d1f22b8e40 0x55d1f2522420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54642/0 (socket says 172.21.15.49:54642) 2023-11-30T17:23:42.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.122+0000 7f9808c20700 1 -- 172.21.15.49:0/4059082420 learned_addr learned my addr 172.21.15.49:0/4059082420 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:42.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.122+0000 7f9803fff700 1 --2- 172.21.15.49:0/4059082420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55d1f24fccb0 0x55d1f25298b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:42.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.122+0000 7f9809421700 1 --2- 172.21.15.49:0/4059082420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d1f2545ea0 0x55d1f2542130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:42.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.122+0000 7f9808c20700 1 -- 172.21.15.49:0/4059082420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55d1f24fccb0 msgr2=0x55d1f25298b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:42.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.122+0000 7f9808c20700 1 --2- 172.21.15.49:0/4059082420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55d1f24fccb0 0x55d1f25298b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.122+0000 7f9808c20700 1 -- 172.21.15.49:0/4059082420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d1f2545ea0 msgr2=0x55d1f2542130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:42.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.122+0000 7f9808c20700 1 --2- 172.21.15.49:0/4059082420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d1f2545ea0 0x55d1f2542130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.122+0000 7f9808c20700 1 -- 172.21.15.49:0/4059082420 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98040af5b0 con 0x55d1f22b8e40 2023-11-30T17:23:42.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.122+0000 7f9808c20700 1 --2- 172.21.15.49:0/4059082420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d1f22b8e40 0x55d1f2522420 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7f97fc04e7a0 tx=0x7f97fc059000).ready entity=mon.0 client_cookie=23e48a2852c6a6d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:42.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.122+0000 7f97e2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-30T17:23:42.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.122+0000 7f97e2ffd700 1 -- 172.21.15.49:0/4059082420 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc04ccb0 con 0x55d1f22b8e40 2023-11-30T17:23:42.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.122+0000 7f97e2ffd700 1 -- 172.21.15.49:0/4059082420 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f97fc060ce0 con 0x55d1f22b8e40 2023-11-30T17:23:42.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.122+0000 7f981c81cb80 1 -- 172.21.15.49:0/4059082420 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d1f24f0720 con 0x55d1f22b8e40 2023-11-30T17:23:42.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.123+0000 7f97e2ffd700 1 -- 172.21.15.49:0/4059082420 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97fc060ea0 con 0x55d1f22b8e40 2023-11-30T17:23:42.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.123+0000 7f981c81cb80 10 client.7317 fetch_fsmap learned FSMap version 46 2023-11-30T17:23:42.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.123+0000 7f981c81cb80 1 -- 172.21.15.49:0/4059082420 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x55d1f24429c0 con 0x55d1f22b8e40 2023-11-30T17:23:42.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.123+0000 7f97e2ffd700 1 -- 172.21.15.49:0/4059082420 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d1f24f0720 con 0x55d1f22b8e40 2023-11-30T17:23:42.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.123+0000 7f97e2ffd700 1 -- 172.21.15.49:0/4059082420 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 46) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f97fc05d040 con 0x55d1f22b8e40 2023-11-30T17:23:42.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.123+0000 7f981c81cb80 10 client.7317 fetch_fsmap finished waiting for FSMap version 46 2023-11-30T17:23:42.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.123+0000 7f981c81cb80 10 client.7317 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-30T17:23:42.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.123+0000 7f981c81cb80 20 client.7317 populate_metadata read hostname 'smithi049' 2023-11-30T17:23:42.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.123+0000 7f981c81cb80 1 --2- 172.21.15.49:0/4059082420 >> [v2:172.21.15.49:6833/1751656884,v1:172.21.15.49:6835/1751656884] conn(0x55d1f2551770 0x55d1f2551b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:42.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.123+0000 7f981c81cb80 4 client.7317 mds_command: new command op to 7137 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-30T17:23:42.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.123+0000 7f981c81cb80 1 -- 172.21.15.49:0/4059082420 --> [v2:172.21.15.49:6833/1751656884,v1:172.21.15.49:6835/1751656884] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d1f22b4ca0 con 0x55d1f2551770 2023-11-30T17:23:42.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.123+0000 7f9803fff700 1 --2- 172.21.15.49:0/4059082420 >> [v2:172.21.15.49:6833/1751656884,v1:172.21.15.49:6835/1751656884] conn(0x55d1f2551770 0x55d1f2551b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:42.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.123+0000 7f9803fff700 1 --2- 172.21.15.49:0/4059082420 >> [v2:172.21.15.49:6833/1751656884,v1:172.21.15.49:6835/1751656884] conn(0x55d1f2551770 0x55d1f2551b50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=56a2e56d667eb99e server_cookie=70f05d04a515ece4 in_seq=0 out_seq=0 2023-11-30T17:23:42.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.123+0000 7f97e2ffd700 10 client.7317 ms_handle_connect on v2:172.21.15.49:6833/1751656884 2023-11-30T17:23:42.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.124+0000 7f97e2ffd700 1 -- 172.21.15.49:0/4059082420 <== mds.0 v2:172.21.15.49:6833/1751656884 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55d1f22b4ca0 con 0x55d1f2551770 2023-11-30T17:23:42.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.124+0000 7f97e2ffd700 10 client.7317 handle_command_reply: tid=0 2023-11-30T17:23:42.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.124+0000 7f981c81cb80 1 client.7317 shutdown 2023-11-30T17:23:42.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.124+0000 7f981c81cb80 1 -- 172.21.15.49:0/4059082420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d1f22b8e40 msgr2=0x55d1f2522420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:42.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.124+0000 7f981c81cb80 1 --2- 172.21.15.49:0/4059082420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d1f22b8e40 0x55d1f2522420 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7f97fc04e7a0 tx=0x7f97fc059000).stop 2023-11-30T17:23:42.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.124+0000 7f981c81cb80 1 -- 172.21.15.49:0/4059082420 shutdown_connections 2023-11-30T17:23:42.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.124+0000 7f981c81cb80 1 --2- 172.21.15.49:0/4059082420 >> [v2:172.21.15.49:6833/1751656884,v1:172.21.15.49:6835/1751656884] conn(0x55d1f2551770 0x55d1f2551b50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.124+0000 7f981c81cb80 1 --2- 172.21.15.49:0/4059082420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d1f2545ea0 0x55d1f2542130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.124+0000 7f981c81cb80 1 --2- 172.21.15.49:0/4059082420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d1f22b8e40 0x55d1f2522420 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.124+0000 7f97e2ffd700 0 client.7317 ms_handle_reset on v2:172.21.15.49:6833/1751656884 2023-11-30T17:23:42.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.124+0000 7f981c81cb80 1 --2- 172.21.15.49:0/4059082420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55d1f24fccb0 0x55d1f25298b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.124+0000 7f981c81cb80 1 -- 172.21.15.49:0/4059082420 >> 172.21.15.49:0/4059082420 conn(0x55d1f23664a0 msgr2=0x55d1f24fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:42.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.124+0000 7f981c81cb80 1 -- 172.21.15.49:0/4059082420 shutdown_connections 2023-11-30T17:23:42.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.124+0000 7f981c81cb80 1 -- 172.21.15.49:0/4059082420 wait complete. 2023-11-30T17:23:42.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.124+0000 7f981c81cb80 20 client.7317 trim_cache size 0 max 16384 2023-11-30T17:23:42.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.141+0000 7f981c81cb80 1 Processor -- start 2023-11-30T17:23:42.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.141+0000 7f981c81cb80 1 -- start start 2023-11-30T17:23:42.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.142+0000 7f981c81cb80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55d1f22b8e40 0x55d1f253d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:42.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.142+0000 7f981c81cb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d1f24fccb0 0x55d1f253d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:42.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.142+0000 7f981c81cb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d1f2545ea0 0x55d1f24f7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:42.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.142+0000 7f981c81cb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1f253c2c0 con 0x55d1f2545ea0 2023-11-30T17:23:42.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.142+0000 7f981c81cb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1f253dbf0 con 0x55d1f24fccb0 2023-11-30T17:23:42.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.142+0000 7f981c81cb80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1f253ced0 con 0x55d1f22b8e40 2023-11-30T17:23:42.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.142+0000 7f9809421700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d1f2545ea0 0x55d1f24f7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:42.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.142+0000 7f9809421700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d1f2545ea0 0x55d1f24f7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54644/0 (socket says 172.21.15.49:54644) 2023-11-30T17:23:42.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.142+0000 7f9809421700 1 -- 172.21.15.49:0/958240174 learned_addr learned my addr 172.21.15.49:0/958240174 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:42.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.142+0000 7f9809421700 1 -- 172.21.15.49:0/958240174 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55d1f22b8e40 msgr2=0x55d1f253d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:42.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.142+0000 7f9809421700 1 --2- 172.21.15.49:0/958240174 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55d1f22b8e40 0x55d1f253d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:42.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.142+0000 7f9803fff700 1 --2- 172.21.15.49:0/958240174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d1f24fccb0 0x55d1f253d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:42.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.142+0000 7f9809421700 1 -- 172.21.15.49:0/958240174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d1f24fccb0 msgr2=0x55d1f253d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:42.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.142+0000 7f9809421700 1 --2- 172.21.15.49:0/958240174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d1f24fccb0 0x55d1f253d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.142+0000 7f9809421700 1 -- 172.21.15.49:0/958240174 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1f2442710 con 0x55d1f2545ea0 2023-11-30T17:23:42.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.142+0000 7f9809421700 1 --2- 172.21.15.49:0/958240174 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d1f2545ea0 0x55d1f24f7680 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7f97ec006000 tx=0x7f97ec015000).ready entity=mon.0 client_cookie=ce83ac9513638664 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:42.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.142+0000 7f97fa7fc700 1 -- 172.21.15.49:0/958240174 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec001370 con 0x55d1f2545ea0 2023-11-30T17:23:42.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.143+0000 7f97fa7fc700 1 -- 172.21.15.49:0/958240174 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ec00cc30 con 0x55d1f2545ea0 2023-11-30T17:23:42.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.143+0000 7f97fa7fc700 1 -- 172.21.15.49:0/958240174 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec0072e0 con 0x55d1f2545ea0 2023-11-30T17:23:42.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.143+0000 7f981c81cb80 1 -- 172.21.15.49:0/958240174 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d1f2545ea0 msgr2=0x55d1f24f7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:42.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.143+0000 7f981c81cb80 1 --2- 172.21.15.49:0/958240174 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d1f2545ea0 0x55d1f24f7680 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7f97ec006000 tx=0x7f97ec015000).stop 2023-11-30T17:23:42.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.143+0000 7f981c81cb80 1 -- 172.21.15.49:0/958240174 shutdown_connections 2023-11-30T17:23:42.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.143+0000 7f981c81cb80 1 --2- 172.21.15.49:0/958240174 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d1f2545ea0 0x55d1f24f7680 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.143+0000 7f981c81cb80 1 --2- 172.21.15.49:0/958240174 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55d1f22b8e40 0x55d1f253d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:42.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.143+0000 7f981c81cb80 1 --2- 172.21.15.49:0/958240174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d1f24fccb0 0x55d1f253d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.143+0000 7f981c81cb80 1 -- 172.21.15.49:0/958240174 >> 172.21.15.49:0/958240174 conn(0x55d1f23664a0 msgr2=0x55d1f253e690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:42.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.143+0000 7f981c81cb80 1 -- 172.21.15.49:0/958240174 shutdown_connections 2023-11-30T17:23:42.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.143+0000 7f981c81cb80 1 -- 172.21.15.49:0/958240174 wait complete. 2023-11-30T17:23:42.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.144+0000 7f981c81cb80 1 -- start start 2023-11-30T17:23:42.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.144+0000 7f981c81cb80 1 Processor -- start 2023-11-30T17:23:42.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.145+0000 7f981c81cb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d1f22b8e40 0x55d1f25a73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:42.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.145+0000 7f981c81cb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d1f24fccb0 0x55d1f24f6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:42.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.145+0000 7f981c81cb80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55d1f2545ea0 0x55d1f24f6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:42.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.145+0000 7f981c81cb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1f25a78b0 con 0x55d1f22b8e40 2023-11-30T17:23:42.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.145+0000 7f981c81cb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1f25402c0 con 0x55d1f24fccb0 2023-11-30T17:23:42.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.145+0000 7f981c81cb80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1f24f7350 con 0x55d1f2545ea0 2023-11-30T17:23:42.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.145+0000 7f981c81cb80 10 client.0 ll_register_callbacks cb 0x55d1f24bc460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-30T17:23:42.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.145+0000 7f9808c20700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d1f22b8e40 0x55d1f25a73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:42.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.145+0000 7f9808c20700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d1f22b8e40 0x55d1f25a73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54652/0 (socket says 172.21.15.49:54652) 2023-11-30T17:23:42.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.145+0000 7f9808c20700 1 -- 172.21.15.49:0/1368952310 learned_addr learned my addr 172.21.15.49:0/1368952310 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:42.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.145+0000 7f9803fff700 1 --2- 172.21.15.49:0/1368952310 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d1f24fccb0 0x55d1f24f6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:42.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.145+0000 7f9809421700 1 --2- 172.21.15.49:0/1368952310 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55d1f2545ea0 0x55d1f24f6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:42.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.145+0000 7f9808c20700 1 -- 172.21.15.49:0/1368952310 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55d1f2545ea0 msgr2=0x55d1f24f6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:42.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.145+0000 7f9808c20700 1 --2- 172.21.15.49:0/1368952310 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55d1f2545ea0 0x55d1f24f6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.145+0000 7f9808c20700 1 -- 172.21.15.49:0/1368952310 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d1f24fccb0 msgr2=0x55d1f24f6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:42.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.145+0000 7f9808c20700 1 --2- 172.21.15.49:0/1368952310 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d1f24fccb0 0x55d1f24f6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.145+0000 7f9808c20700 1 -- 172.21.15.49:0/1368952310 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f00033f0 con 0x55d1f22b8e40 2023-11-30T17:23:42.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.145+0000 7f9808c20700 1 --2- 172.21.15.49:0/1368952310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d1f22b8e40 0x55d1f25a73c0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7f97fc078000 tx=0x7f97fc05e000).ready entity=mon.0 client_cookie=92d34bf810f63fd6 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:42.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.145+0000 7f97e2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-30T17:23:42.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.145+0000 7f97e2ffd700 1 -- 172.21.15.49:0/1368952310 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc04ab40 con 0x55d1f22b8e40 2023-11-30T17:23:42.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.145+0000 7f97e2ffd700 1 -- 172.21.15.49:0/1368952310 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f97fc060ce0 con 0x55d1f22b8e40 2023-11-30T17:23:42.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.145+0000 7f981c81cb80 1 -- 172.21.15.49:0/1368952310 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f97fc04ce90 con 0x55d1f22b8e40 2023-11-30T17:23:42.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.146+0000 7f97e2ffd700 1 -- 172.21.15.49:0/1368952310 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97fc060ea0 con 0x55d1f22b8e40 2023-11-30T17:23:42.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.146+0000 7f981c81cb80 10 client.7323 fetch_fsmap learned FSMap version 46 2023-11-30T17:23:42.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.146+0000 7f981c81cb80 1 -- 172.21.15.49:0/1368952310 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x55d1f22b9f80 con 0x55d1f22b8e40 2023-11-30T17:23:42.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.146+0000 7f97e2ffd700 1 -- 172.21.15.49:0/1368952310 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97fc04ce90 con 0x55d1f22b8e40 2023-11-30T17:23:42.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.146+0000 7f97e2ffd700 1 -- 172.21.15.49:0/1368952310 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 46) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f97fc05d070 con 0x55d1f22b8e40 2023-11-30T17:23:42.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.146+0000 7f981c81cb80 10 client.7323 fetch_fsmap finished waiting for FSMap version 46 2023-11-30T17:23:42.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.146+0000 7f981c81cb80 10 client.7323 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-30T17:23:42.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.146+0000 7f981c81cb80 20 client.7323 populate_metadata read hostname 'smithi049' 2023-11-30T17:23:42.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.146+0000 7f981c81cb80 1 --2- 172.21.15.49:0/1368952310 >> [v2:172.21.15.49:6833/1751656884,v1:172.21.15.49:6835/1751656884] conn(0x55d1f2552060 0x55d1f253d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:42.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.146+0000 7f981c81cb80 4 client.7323 mds_command: new command op to 7137 tid=0[{"prefix": "status"}] 2023-11-30T17:23:42.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.146+0000 7f981c81cb80 1 -- 172.21.15.49:0/1368952310 --> [v2:172.21.15.49:6833/1751656884,v1:172.21.15.49:6835/1751656884] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d1f22ebca0 con 0x55d1f2552060 2023-11-30T17:23:42.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.146+0000 7f9803fff700 1 --2- 172.21.15.49:0/1368952310 >> [v2:172.21.15.49:6833/1751656884,v1:172.21.15.49:6835/1751656884] conn(0x55d1f2552060 0x55d1f253d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:42.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.146+0000 7f97e2ffd700 10 client.7323 ms_handle_connect on v2:172.21.15.49:6833/1751656884 2023-11-30T17:23:42.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.146+0000 7f9803fff700 1 --2- 172.21.15.49:0/1368952310 >> [v2:172.21.15.49:6833/1751656884,v1:172.21.15.49:6835/1751656884] conn(0x55d1f2552060 0x55d1f253d040 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=cc3977fd7106c9c0 server_cookie=2f96e4daf8baec6b in_seq=0 out_seq=0 2023-11-30T17:23:42.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.146+0000 7f97e2ffd700 1 -- 172.21.15.49:0/1368952310 <== mds.0 v2:172.21.15.49:6833/1751656884 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55d1f22ebca0 con 0x55d1f2552060 2023-11-30T17:23:42.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.146+0000 7f97e2ffd700 10 client.7323 handle_command_reply: tid=0 2023-11-30T17:23:42.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.147+0000 7f981c81cb80 1 client.7323 shutdown 2023-11-30T17:23:42.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.147+0000 7f981c81cb80 1 -- 172.21.15.49:0/1368952310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d1f22b8e40 msgr2=0x55d1f25a73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:42.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.147+0000 7f981c81cb80 1 --2- 172.21.15.49:0/1368952310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d1f22b8e40 0x55d1f25a73c0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7f97fc078000 tx=0x7f97fc05e000).stop 2023-11-30T17:23:42.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.147+0000 7f981c81cb80 1 -- 172.21.15.49:0/1368952310 shutdown_connections 2023-11-30T17:23:42.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.147+0000 7f981c81cb80 1 --2- 172.21.15.49:0/1368952310 >> [v2:172.21.15.49:6833/1751656884,v1:172.21.15.49:6835/1751656884] conn(0x55d1f2552060 0x55d1f253d040 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.147+0000 7f981c81cb80 1 --2- 172.21.15.49:0/1368952310 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55d1f2545ea0 0x55d1f24f6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.147+0000 7f981c81cb80 1 --2- 172.21.15.49:0/1368952310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d1f22b8e40 0x55d1f25a73c0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.147+0000 7f981c81cb80 1 --2- 172.21.15.49:0/1368952310 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d1f24fccb0 0x55d1f24f6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.147+0000 7f97e2ffd700 0 client.7323 ms_handle_reset on v2:172.21.15.49:6833/1751656884 2023-11-30T17:23:42.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.147+0000 7f981c81cb80 1 -- 172.21.15.49:0/1368952310 >> 172.21.15.49:0/1368952310 conn(0x55d1f23664a0 msgr2=0x55d1f24f7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:42.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.147+0000 7f981c81cb80 1 -- 172.21.15.49:0/1368952310 shutdown_connections 2023-11-30T17:23:42.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.147+0000 7f981c81cb80 1 -- 172.21.15.49:0/1368952310 wait complete. 2023-11-30T17:23:42.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.147+0000 7f981c81cb80 20 client.7323 trim_cache size 0 max 16384 2023-11-30T17:23:42.155 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T17:23:42.155 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "ef213ed4-8f62-4ad5-b55f-7510fd0ee359", 2023-11-30T17:23:42.155 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2023-11-30T17:23:42.155 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 7137, 2023-11-30T17:23:42.155 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-11-30T17:23:42.155 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-11-30T17:23:42.155 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-11-30T17:23:42.155 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 10.202122230000001, 2023-11-30T17:23:42.156 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 46, 2023-11-30T17:23:42.156 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 113, 2023-11-30T17:23:42.156 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 113, 2023-11-30T17:23:42.156 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 14.744837252 2023-11-30T17:23:42.156 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T17:23:42.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.147+0000 7f980ae84700 1 -- 172.21.15.49:0/3847253396 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f97e405f240 msgr2=0x7f97e4061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:42.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.147+0000 7f980ae84700 1 --2- 172.21.15.49:0/3847253396 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f97e405f240 0x7f97e4061700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f98040b15a0 tx=0x7f97f400b040).stop 2023-11-30T17:23:42.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.147+0000 7f980ae84700 1 -- 172.21.15.49:0/3847253396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97f0005000 msgr2=0x7f980414f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:42.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.147+0000 7f980ae84700 1 --2- 172.21.15.49:0/3847253396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97f0005000 0x7f980414f250 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f97fc0028f0 tx=0x7f97fc007bb0).stop 2023-11-30T17:23:42.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.147+0000 7f980ae84700 1 -- 172.21.15.49:0/3847253396 shutdown_connections 2023-11-30T17:23:42.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.147+0000 7f980ae84700 1 --2- 172.21.15.49:0/3847253396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98040ae2c0 0x7f98040ae740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.147+0000 7f980ae84700 1 --2- 172.21.15.49:0/3847253396 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f97e405f240 0x7f97e4061700 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.147+0000 7f980ae84700 1 --2- 172.21.15.49:0/3847253396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97f0005000 0x7f980414f250 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.147+0000 7f980ae84700 1 --2- 172.21.15.49:0/3847253396 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98040afb00 0x7f98040aff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.147+0000 7f980ae84700 1 -- 172.21.15.49:0/3847253396 >> 172.21.15.49:0/3847253396 conn(0x7f98040cb310 msgr2=0x7f98041529c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:42.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.147+0000 7f980ae84700 1 -- 172.21.15.49:0/3847253396 shutdown_connections 2023-11-30T17:23:42.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.148+0000 7f980ae84700 1 -- 172.21.15.49:0/3847253396 wait complete. 2023-11-30T17:23:42.162 DEBUG:teuthology.orchestra.run.smithi049:> ceph fs ls 2023-11-30T17:23:42.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.267+0000 7fb008531700 1 Processor -- start 2023-11-30T17:23:42.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.267+0000 7fb008531700 1 -- start start 2023-11-30T17:23:42.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.268+0000 7fb008531700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb000154700 0x7fb0000c7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:42.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.268+0000 7fb008531700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb0000c7c50 0x7fb0000c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:42.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.268+0000 7fb008531700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0000c85f0 con 0x7fb0000c7700 2023-11-30T17:23:42.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.268+0000 7fb008531700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0000c6d80 con 0x7fb0000c7c50 2023-11-30T17:23:42.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.268+0000 7fb008531700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb000154ae0 con 0x7fb000154700 2023-11-30T17:23:42.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.268+0000 7fb005acc700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb0000c7700 0x7fb0000aa1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38468/0 (socket says 172.21.15.49:38468) 2023-11-30T17:23:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.268+0000 7fb005acc700 1 -- 172.21.15.49:0/80355364 learned_addr learned my addr 172.21.15.49:0/80355364 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.268+0000 7fb006ace700 1 --2- 172.21.15.49:0/80355364 >> v2:172.21.15.115:3300/0 conn(0x7fb0000c7c50 0x7fb0000c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.268+0000 7fb0062cd700 1 --2- 172.21.15.49:0/80355364 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb000154700 0x7fb0000c7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.269+0000 7fb0052cb700 1 -- 172.21.15.49:0/80355364 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2220751722 0 0) 0x7faff4001110 con 0x7fb0000c7700 2023-11-30T17:23:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.269+0000 7fb0052cb700 1 -- 172.21.15.49:0/80355364 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafe80033f0 con 0x7fb0000c7700 2023-11-30T17:23:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.269+0000 7fb006ace700 1 -- 172.21.15.49:0/80355364 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb000154700 msgr2=0x7fb0000c7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.269+0000 7fb006ace700 1 --2- 172.21.15.49:0/80355364 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb000154700 0x7fb0000c7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.269+0000 7fb006ace700 1 -- 172.21.15.49:0/80355364 >> v1:172.21.15.49:6789/0 conn(0x7fb0000c7700 legacy=0x7fb0000aa1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.269+0000 7fb0052cb700 1 -- 172.21.15.49:0/80355364 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 694588442 0 0) 0x7fafe80033f0 con 0x7fb0000c7700 2023-11-30T17:23:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.269+0000 7fb006ace700 1 -- 172.21.15.49:0/80355364 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb000064c30 con 0x7fb0000c7c50 2023-11-30T17:23:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.269+0000 7fb006ace700 1 --2- 172.21.15.49:0/80355364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0000c7c50 0x7fb0000c8100 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7faff8009e60 tx=0x7faff8009780).ready entity=mon.1 client_cookie=a609d454068113c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.269+0000 7fb0052cb700 1 -- 172.21.15.49:0/80355364 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff800e070 con 0x7fb0000c7c50 2023-11-30T17:23:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.269+0000 7fb0052cb700 1 -- 172.21.15.49:0/80355364 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff800b7a0 con 0x7fb0000c7c50 2023-11-30T17:23:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.269+0000 7fb0052cb700 1 -- 172.21.15.49:0/80355364 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff4001600 con 0x7fb0000c7c50 2023-11-30T17:23:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.270+0000 7fb008531700 1 -- 172.21.15.49:0/80355364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0000c7c50 msgr2=0x7fb0000c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:42.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.270+0000 7fb008531700 1 --2- 172.21.15.49:0/80355364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0000c7c50 0x7fb0000c8100 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7faff8009e60 tx=0x7faff8009780).stop 2023-11-30T17:23:42.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.270+0000 7fb008531700 1 -- 172.21.15.49:0/80355364 shutdown_connections 2023-11-30T17:23:42.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.270+0000 7fb008531700 1 --2- 172.21.15.49:0/80355364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0000c7c50 0x7fb0000c8100 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.270+0000 7fb008531700 1 --2- 172.21.15.49:0/80355364 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb000154700 0x7fb0000c7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.270+0000 7fb008531700 1 -- 172.21.15.49:0/80355364 >> 172.21.15.49:0/80355364 conn(0x7fb0000948b0 msgr2=0x7fb00006a690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:42.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.270+0000 7fb008531700 1 -- 172.21.15.49:0/80355364 shutdown_connections 2023-11-30T17:23:42.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.270+0000 7fb008531700 1 -- 172.21.15.49:0/80355364 wait complete. 2023-11-30T17:23:42.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.271+0000 7fb008531700 1 Processor -- start 2023-11-30T17:23:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.271+0000 7fb008531700 1 -- start start 2023-11-30T17:23:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.272+0000 7fb008531700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0000c7700 0x7fb00014cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.272+0000 7fb008531700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0000c7c50 0x7fb000158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.272+0000 7fb008531700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb000154700 0x7fb000159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.272+0000 7fb008531700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb000159570 con 0x7fb0000c7700 2023-11-30T17:23:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.272+0000 7fb008531700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0000c8fb0 con 0x7fb000154700 2023-11-30T17:23:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.272+0000 7fb008531700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0000c9850 con 0x7fb0000c7c50 2023-11-30T17:23:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.272+0000 7fb0062cd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0000c7700 0x7fb00014cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.272+0000 7fb0062cd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0000c7700 0x7fb00014cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54660/0 (socket says 172.21.15.49:54660) 2023-11-30T17:23:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.272+0000 7fb0062cd700 1 -- 172.21.15.49:0/320546204 learned_addr learned my addr 172.21.15.49:0/320546204 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:42.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.272+0000 7fb006ace700 1 --2- 172.21.15.49:0/320546204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb000154700 0x7fb000159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:42.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.272+0000 7fb005acc700 1 --2- 172.21.15.49:0/320546204 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0000c7c50 0x7fb000158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:42.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.272+0000 7fb0062cd700 1 -- 172.21.15.49:0/320546204 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0000c7c50 msgr2=0x7fb000158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:42.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.272+0000 7fb0062cd700 1 --2- 172.21.15.49:0/320546204 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0000c7c50 0x7fb000158b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.272+0000 7fb0062cd700 1 -- 172.21.15.49:0/320546204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb000154700 msgr2=0x7fb000159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:42.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.272+0000 7fb0062cd700 1 --2- 172.21.15.49:0/320546204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb000154700 0x7fb000159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.272+0000 7fb0062cd700 1 -- 172.21.15.49:0/320546204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff8009a20 con 0x7fb0000c7700 2023-11-30T17:23:42.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.272+0000 7fb006ace700 1 --2- 172.21.15.49:0/320546204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb000154700 0x7fb000159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:23:42.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.272+0000 7fb0062cd700 1 --2- 172.21.15.49:0/320546204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0000c7700 0x7fb00014cfe0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7faff000e930 tx=0x7faff0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:42.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.272+0000 7faffe7fc700 1 -- 172.21.15.49:0/320546204 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff000eed0 con 0x7fb0000c7700 2023-11-30T17:23:42.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.272+0000 7faffe7fc700 1 -- 172.21.15.49:0/320546204 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff000c850 con 0x7fb0000c7700 2023-11-30T17:23:42.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.272+0000 7fb008531700 1 -- 172.21.15.49:0/320546204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb000168c30 con 0x7fb0000c7700 2023-11-30T17:23:42.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.272+0000 7faffe7fc700 1 -- 172.21.15.49:0/320546204 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff000cbd0 con 0x7fb0000c7700 2023-11-30T17:23:42.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.272+0000 7fb008531700 1 -- 172.21.15.49:0/320546204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0000c94e0 con 0x7fb0000c7700 2023-11-30T17:23:42.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.273+0000 7fb008531700 1 -- 172.21.15.49:0/320546204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb00006b9c0 con 0x7fb0000c7700 2023-11-30T17:23:42.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.274+0000 7faffe7fc700 1 -- 172.21.15.49:0/320546204 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7faff001b400 con 0x7fb0000c7700 2023-11-30T17:23:42.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.274+0000 7faffe7fc700 1 --2- 172.21.15.49:0/320546204 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fafec05f270 0x7fafec061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:42.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.274+0000 7faffe7fc700 1 -- 172.21.15.49:0/320546204 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6149+0+0 (secure 0 0 0) 0x7faff007a9a0 con 0x7fb0000c7700 2023-11-30T17:23:42.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.274+0000 7fb005acc700 1 --2- 172.21.15.49:0/320546204 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fafec05f270 0x7fafec061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:42.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.275+0000 7fb005acc700 1 --2- 172.21.15.49:0/320546204 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fafec05f270 0x7fafec061730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fb0000ad6f0 tx=0x7faff4009040).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:42.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.278+0000 7faffe7fc700 1 -- 172.21.15.49:0/320546204 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7faff004ba70 con 0x7fb0000c7700 2023-11-30T17:23:42.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.495+0000 7fb008531700 1 -- 172.21.15.49:0/320546204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb0000cae60 con 0x7fb0000c7700 2023-11-30T17:23:42.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.495+0000 7faffe7fc700 1 -- 172.21.15.49:0/320546204 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v46) v1 ==== 53+0+73 (secure 0 0 0) 0x7faff004f090 con 0x7fb0000c7700 2023-11-30T17:23:42.496 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-30T17:23:42.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.497+0000 7fb008531700 1 -- 172.21.15.49:0/320546204 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fafec05f270 msgr2=0x7fafec061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:42.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.497+0000 7fb008531700 1 --2- 172.21.15.49:0/320546204 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fafec05f270 0x7fafec061730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fb0000ad6f0 tx=0x7faff4009040).stop 2023-11-30T17:23:42.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.497+0000 7fb008531700 1 -- 172.21.15.49:0/320546204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0000c7700 msgr2=0x7fb00014cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:42.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.497+0000 7fb008531700 1 --2- 172.21.15.49:0/320546204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0000c7700 0x7fb00014cfe0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7faff000e930 tx=0x7faff0009060).stop 2023-11-30T17:23:42.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.497+0000 7fb008531700 1 -- 172.21.15.49:0/320546204 shutdown_connections 2023-11-30T17:23:42.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.497+0000 7fb008531700 1 --2- 172.21.15.49:0/320546204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb000154700 0x7fb000159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.497+0000 7fb008531700 1 --2- 172.21.15.49:0/320546204 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fafec05f270 0x7fafec061730 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.497+0000 7fb008531700 1 --2- 172.21.15.49:0/320546204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0000c7700 0x7fb00014cfe0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.497+0000 7fb008531700 1 --2- 172.21.15.49:0/320546204 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0000c7c50 0x7fb000158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:42.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.497+0000 7fb008531700 1 -- 172.21.15.49:0/320546204 >> 172.21.15.49:0/320546204 conn(0x7fb0000948b0 msgr2=0x7fb0000ae1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:42.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.497+0000 7fb008531700 1 -- 172.21.15.49:0/320546204 shutdown_connections 2023-11-30T17:23:42.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:42.497+0000 7fb008531700 1 -- 172.21.15.49:0/320546204 wait complete. 2023-11-30T17:23:42.509 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-30T17:23:42.509 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-30T17:23:42.509 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-11-30T17:23:42.509 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-30T17:23:42.509 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-30T17:23:42.510 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-30T17:23:42.510 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-30T17:23:42.510 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-30T17:23:42.510 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-30T17:23:42.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:23:42.510 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-11-30T17:23:42.525 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-30T17:23:42.526 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-30T17:23:42.526 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-11-30T17:23:42.526 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:23:42.526 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-11-30T17:23:42.526 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:23:42.526 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:23:42.526 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:23:42.526 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-11-30T17:23:42.526 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:23:42.526 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:23:42.526 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-11-30T17:23:42.526 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-30T17:23:42.526 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:23:42.527 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-11-30T17:23:42.527 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-30T17:23:42.527 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 41452sec preferred_lft 41452sec 2023-11-30T17:23:42.527 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2023-11-30T17:23:42.527 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:23:42.527 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:23:42.527 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:23:42.527 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-11-30T17:23:42.528 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-30T17:23:42.528 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 32:bf:40:53:4c:5d brd ff:ff:ff:ff:ff:ff 2023-11-30T17:23:42.528 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-30T17:23:42.528 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:23:42.528 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::8b6:11ff:fe93:7174/64 scope link 2023-11-30T17:23:42.528 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:23:42.528 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-30T17:23:42.528 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 3e:e9:3c:a8:7a:95 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-30T17:23:42.528 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::3ce9:3cff:fea8:7a95/64 scope link 2023-11-30T17:23:42.528 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:23:42.529 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-30T17:23:42.529 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 32:bf:40:53:4c:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-30T17:23:42.529 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::30bf:40ff:fe53:4c5d/64 scope link 2023-11-30T17:23:42.529 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:23:42.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:23:42.529 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-30T17:23:42.591 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-11-30T17:23:42.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:23:42.592 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-11-30T17:23:42.648 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-11-30T17:23:42.648 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-30T17:23:42.648 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-30T17:23:42.649 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-30T17:23:42.649 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-30T17:23:42.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:23:42.649 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-11-30T17:23:42.649 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-11-30T17:23:42.649 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-30T17:23:42.649 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-30T17:23:42.649 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-30T17:23:42.649 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-11-30T17:23:42.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:23:42.751 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-11-30T17:23:42.766 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-30T17:23:42.766 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-30T17:23:42.766 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-30T17:23:42.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:23:42.766 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-11-30T17:23:42.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:23:42.831 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-11-30T17:23:42.886 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-30T17:23:42.886 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:23:42.968 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:23:42.968 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-30T17:23:42.993 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:23:42.993 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-30T17:23:42.995 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-30T17:23:42.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:23:42.996 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-30T17:23:43.062 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-30T17:23:43.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.221+0000 7fa07908b700 1 Processor -- start 2023-11-30T17:23:43.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.221+0000 7fa07908b700 1 -- start start 2023-11-30T17:23:43.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.221+0000 7fa07908b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa0740c6190 0x7fa0740c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:43.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.221+0000 7fa07908b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa074158320 0x7fa0741587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:43.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.222+0000 7fa07908b700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa074158cc0 con 0x7fa074098d10 2023-11-30T17:23:43.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.222+0000 7fa07908b700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0740c72d0 con 0x7fa074158320 2023-11-30T17:23:43.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.222+0000 7fa07908b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa074064570 con 0x7fa0740c6190 2023-11-30T17:23:43.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.222+0000 7fa07359e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa074158320 0x7fa0741587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:43.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.222+0000 7fa07359e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa074158320 0x7fa0741587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54672/0 (socket says 172.21.15.49:54672) 2023-11-30T17:23:43.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.222+0000 7fa072d9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa074098d10 0x7fa074063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38484/0 (socket says 172.21.15.49:38484) 2023-11-30T17:23:43.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.222+0000 7fa07359e700 1 -- 172.21.15.49:0/411504886 learned_addr learned my addr 172.21.15.49:0/411504886 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:43.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.222+0000 7fa07359e700 1 -- 172.21.15.49:0/411504886 >> v2:172.21.15.115:3300/0 conn(0x7fa0740c6190 msgr2=0x7fa0740c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:43.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.222+0000 7fa07359e700 1 --2- 172.21.15.49:0/411504886 >> v2:172.21.15.115:3300/0 conn(0x7fa0740c6190 0x7fa0740c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:43.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.222+0000 7fa07359e700 1 -- 172.21.15.49:0/411504886 >> v1:172.21.15.49:6789/0 conn(0x7fa074098d10 legacy=0x7fa074063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:43.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.222+0000 7fa07359e700 1 -- 172.21.15.49:0/411504886 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa074154bc0 con 0x7fa074158320 2023-11-30T17:23:43.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.222+0000 7fa071d9b700 1 -- 172.21.15.49:0/411504886 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 627084310 0 0) 0x7fa064001110 con 0x7fa074098d10 2023-11-30T17:23:43.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.222+0000 7fa07359e700 1 --2- 172.21.15.49:0/411504886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa074158320 0x7fa0741587d0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7fa0740c5b40 tx=0x7fa06c009840).ready entity=mon.0 client_cookie=b3c587ff8bb3d3f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:43.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.222+0000 7fa071d9b700 1 -- 172.21.15.49:0/411504886 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c00e070 con 0x7fa074158320 2023-11-30T17:23:43.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.222+0000 7fa071d9b700 1 -- 172.21.15.49:0/411504886 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06c00ba50 con 0x7fa074158320 2023-11-30T17:23:43.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.222+0000 7fa071d9b700 1 -- 172.21.15.49:0/411504886 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c00bdd0 con 0x7fa074158320 2023-11-30T17:23:43.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.223+0000 7fa07908b700 1 -- 172.21.15.49:0/411504886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa074158320 msgr2=0x7fa0741587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:43.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.223+0000 7fa07908b700 1 --2- 172.21.15.49:0/411504886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa074158320 0x7fa0741587d0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7fa0740c5b40 tx=0x7fa06c009840).stop 2023-11-30T17:23:43.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.223+0000 7fa07908b700 1 -- 172.21.15.49:0/411504886 shutdown_connections 2023-11-30T17:23:43.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.223+0000 7fa07908b700 1 --2- 172.21.15.49:0/411504886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa074158320 0x7fa0741587d0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:43.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.223+0000 7fa07908b700 1 --2- 172.21.15.49:0/411504886 >> v2:172.21.15.115:3300/0 conn(0x7fa0740c6190 0x7fa0740c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:43.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.223+0000 7fa07908b700 1 -- 172.21.15.49:0/411504886 >> 172.21.15.49:0/411504886 conn(0x7fa0740cb310 msgr2=0x7fa0740cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:43.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.223+0000 7fa07908b700 1 -- 172.21.15.49:0/411504886 shutdown_connections 2023-11-30T17:23:43.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.223+0000 7fa07908b700 1 -- 172.21.15.49:0/411504886 wait complete. 2023-11-30T17:23:43.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.224+0000 7fa07908b700 1 Processor -- start 2023-11-30T17:23:43.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.224+0000 7fa07908b700 1 -- start start 2023-11-30T17:23:43.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.225+0000 7fa07908b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa074098d10 0x7fa074148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:43.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.225+0000 7fa07908b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0740c6190 0x7fa0740ae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:43.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.225+0000 7fa07908b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa074158320 0x7fa074164750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:43.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.225+0000 7fa07908b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa074148660 con 0x7fa074158320 2023-11-30T17:23:43.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.225+0000 7fa07908b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa074155380 con 0x7fa074098d10 2023-11-30T17:23:43.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.225+0000 7fa07908b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0740c4b70 con 0x7fa0740c6190 2023-11-30T17:23:43.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.225+0000 7fa07359e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa074158320 0x7fa074164750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:43.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.225+0000 7fa07359e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa074158320 0x7fa074164750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54678/0 (socket says 172.21.15.49:54678) 2023-11-30T17:23:43.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.225+0000 7fa07359e700 1 -- 172.21.15.49:0/3038275320 learned_addr learned my addr 172.21.15.49:0/3038275320 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:43.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.225+0000 7fa07259c700 1 --2- 172.21.15.49:0/3038275320 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0740c6190 0x7fa0740ae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:43.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.225+0000 7fa072d9d700 1 --2- 172.21.15.49:0/3038275320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa074098d10 0x7fa074148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:43.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.225+0000 7fa07359e700 1 -- 172.21.15.49:0/3038275320 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0740c6190 msgr2=0x7fa0740ae5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:43.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.225+0000 7fa07359e700 1 --2- 172.21.15.49:0/3038275320 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0740c6190 0x7fa0740ae5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:43.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.225+0000 7fa07359e700 1 -- 172.21.15.49:0/3038275320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa074098d10 msgr2=0x7fa074148170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:43.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.225+0000 7fa07359e700 1 --2- 172.21.15.49:0/3038275320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa074098d10 0x7fa074148170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:43.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.225+0000 7fa07359e700 1 -- 172.21.15.49:0/3038275320 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06c009ae0 con 0x7fa074158320 2023-11-30T17:23:43.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.225+0000 7fa07359e700 1 --2- 172.21.15.49:0/3038275320 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa074158320 0x7fa074164750 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7fa06c009fd0 tx=0x7fa0740a8040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:43.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.225+0000 7fa05affd700 1 -- 172.21.15.49:0/3038275320 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c00bdd0 con 0x7fa074158320 2023-11-30T17:23:43.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.226+0000 7fa05affd700 1 -- 172.21.15.49:0/3038275320 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06c0092e0 con 0x7fa074158320 2023-11-30T17:23:43.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.226+0000 7fa07908b700 1 -- 172.21.15.49:0/3038275320 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0740c4e50 con 0x7fa074158320 2023-11-30T17:23:43.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.226+0000 7fa05affd700 1 -- 172.21.15.49:0/3038275320 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c01d6a0 con 0x7fa074158320 2023-11-30T17:23:43.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.226+0000 7fa07908b700 1 -- 172.21.15.49:0/3038275320 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0740c5410 con 0x7fa074158320 2023-11-30T17:23:43.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.227+0000 7fa07908b700 1 -- 172.21.15.49:0/3038275320 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa07406c860 con 0x7fa074158320 2023-11-30T17:23:43.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.227+0000 7fa05affd700 1 -- 172.21.15.49:0/3038275320 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa06c01da50 con 0x7fa074158320 2023-11-30T17:23:43.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.227+0000 7fa05affd700 1 --2- 172.21.15.49:0/3038275320 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa06005f240 0x7fa060061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:43.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.227+0000 7fa05affd700 1 -- 172.21.15.49:0/3038275320 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fa06c07c370 con 0x7fa074158320 2023-11-30T17:23:43.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.228+0000 7fa072d9d700 1 --2- 172.21.15.49:0/3038275320 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa06005f240 0x7fa060061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:43.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.228+0000 7fa072d9d700 1 --2- 172.21.15.49:0/3038275320 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa06005f240 0x7fa060061700 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fa064007d50 tx=0x7fa064007180).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:43.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.232+0000 7fa05affd700 1 -- 172.21.15.49:0/3038275320 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa06c04d4a0 con 0x7fa074158320 2023-11-30T17:23:43.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.431+0000 7fa07908b700 1 -- 172.21.15.49:0/3038275320 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0740c66c0 con 0x7fa06005f240 2023-11-30T17:23:43.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.433+0000 7fa05affd700 1 -- 172.21.15.49:0/3038275320 <== mgr.6107 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fa0740c66c0 con 0x7fa06005f240 2023-11-30T17:23:43.435 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-11-30T17:23:43.435 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:23:43.435 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cephfs" 2023-11-30T17:23:43.435 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:23:43.435 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-11-30T17:23:43.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.435+0000 7fa07908b700 1 -- 172.21.15.49:0/3038275320 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa06005f240 msgr2=0x7fa060061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:43.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.435+0000 7fa07908b700 1 --2- 172.21.15.49:0/3038275320 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa06005f240 0x7fa060061700 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fa064007d50 tx=0x7fa064007180).stop 2023-11-30T17:23:43.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.435+0000 7fa07908b700 1 -- 172.21.15.49:0/3038275320 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa074158320 msgr2=0x7fa074164750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:43.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.435+0000 7fa07908b700 1 --2- 172.21.15.49:0/3038275320 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa074158320 0x7fa074164750 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7fa06c009fd0 tx=0x7fa0740a8040).stop 2023-11-30T17:23:43.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.435+0000 7fa07908b700 1 -- 172.21.15.49:0/3038275320 shutdown_connections 2023-11-30T17:23:43.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.435+0000 7fa07908b700 1 --2- 172.21.15.49:0/3038275320 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa06005f240 0x7fa060061700 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:43.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.435+0000 7fa07908b700 1 --2- 172.21.15.49:0/3038275320 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa074158320 0x7fa074164750 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:43.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.435+0000 7fa07908b700 1 --2- 172.21.15.49:0/3038275320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa074098d10 0x7fa074148170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:43.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.435+0000 7fa07908b700 1 --2- 172.21.15.49:0/3038275320 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0740c6190 0x7fa0740ae5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:43.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.435+0000 7fa07908b700 1 -- 172.21.15.49:0/3038275320 >> 172.21.15.49:0/3038275320 conn(0x7fa0740cb310 msgr2=0x7fa0740ca6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:43.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.435+0000 7fa07908b700 1 -- 172.21.15.49:0/3038275320 shutdown_connections 2023-11-30T17:23:43.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.435+0000 7fa07908b700 1 -- 172.21.15.49:0/3038275320 wait complete. 2023-11-30T17:23:43.449 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-11-30T17:23:43.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.567+0000 7f1af9309700 1 Processor -- start 2023-11-30T17:23:43.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.567+0000 7f1af9309700 1 -- start start 2023-11-30T17:23:43.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.568+0000 7f1af9309700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1af40bcb70 0x7f1af415b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:43.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.568+0000 7f1af9309700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1af4152040 con 0x7f1af4150640 2023-11-30T17:23:43.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.568+0000 7f1af9309700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1af4069020 con 0x7f1af40bd680 2023-11-30T17:23:43.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.568+0000 7f1af9309700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af40c2950 con 0x7f1af40bcb70 2023-11-30T17:23:43.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.568+0000 7f1af2ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1af4150640 0x7f1af4150a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38492/0 (socket says 172.21.15.49:38492) 2023-11-30T17:23:43.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.568+0000 7f1af2ffd700 1 -- 172.21.15.49:0/1520267599 learned_addr learned my addr 172.21.15.49:0/1520267599 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:43.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.568+0000 7f1af37fe700 1 --2- 172.21.15.49:0/1520267599 >> v2:172.21.15.115:3300/0 conn(0x7f1af40bcb70 0x7f1af415b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:43.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.568+0000 7f1af1ffb700 1 -- 172.21.15.49:0/1520267599 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4110756646 0 0) 0x7f1af4152040 con 0x7f1af4150640 2023-11-30T17:23:43.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.568+0000 7f1af1ffb700 1 -- 172.21.15.49:0/1520267599 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ae0004500 con 0x7f1af4150640 2023-11-30T17:23:43.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.569+0000 7f1af1ffb700 1 -- 172.21.15.49:0/1520267599 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3051634871 0 0) 0x7f1ae0004500 con 0x7f1af4150640 2023-11-30T17:23:43.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.569+0000 7f1af1ffb700 1 -- 172.21.15.49:0/1520267599 >> v2:172.21.15.115:3300/0 conn(0x7f1af40bcb70 msgr2=0x7f1af415b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:43.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.569+0000 7f1af1ffb700 1 --2- 172.21.15.49:0/1520267599 >> v2:172.21.15.115:3300/0 conn(0x7f1af40bcb70 0x7f1af415b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:43.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.569+0000 7f1af1ffb700 1 -- 172.21.15.49:0/1520267599 >> v1:172.21.15.115:6789/0 conn(0x7f1af40bd680 legacy=0x7f1af40bc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:43.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.569+0000 7f1af1ffb700 1 -- 172.21.15.49:0/1520267599 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af4068cf0 con 0x7f1af4150640 2023-11-30T17:23:43.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.569+0000 7f1af1ffb700 1 -- 172.21.15.49:0/1520267599 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f1aec001470 con 0x7f1af4150640 2023-11-30T17:23:43.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.569+0000 7f1af1ffb700 1 -- 172.21.15.49:0/1520267599 >> v1:172.21.15.49:6789/0 conn(0x7f1af4150640 legacy=0x7f1af4150a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:43.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.569+0000 7f1af1ffb700 1 --2- 172.21.15.49:0/1520267599 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ae00049f0 0x7f1ae0004e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:43.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.569+0000 7f1af1ffb700 1 --2- 172.21.15.49:0/1520267599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ae00057a0 0x7f1ae0005c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:43.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.569+0000 7f1af1ffb700 1 --2- 172.21.15.49:0/1520267599 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ae0006110 0x7f1ae000c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:43.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.569+0000 7f1af1ffb700 1 -- 172.21.15.49:0/1520267599 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af40c2950 con 0x7f1ae00057a0 2023-11-30T17:23:43.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.569+0000 7f1af1ffb700 1 -- 172.21.15.49:0/1520267599 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae000d070 con 0x7f1ae00049f0 2023-11-30T17:23:43.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.569+0000 7f1af1ffb700 1 -- 172.21.15.49:0/1520267599 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae0003440 con 0x7f1ae0006110 2023-11-30T17:23:43.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.569+0000 7f1af27fc700 1 --2- 172.21.15.49:0/1520267599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ae00057a0 0x7f1ae0005c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:43.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.569+0000 7f1af2ffd700 1 --2- 172.21.15.49:0/1520267599 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ae00049f0 0x7f1ae0004e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:43.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.569+0000 7f1af37fe700 1 --2- 172.21.15.49:0/1520267599 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ae0006110 0x7f1ae000c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:43.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.569+0000 7f1af27fc700 1 -- 172.21.15.49:0/1520267599 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ae0006110 msgr2=0x7f1ae000c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:43.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.569+0000 7f1af27fc700 1 --2- 172.21.15.49:0/1520267599 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ae0006110 0x7f1ae000c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:43.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.569+0000 7f1af27fc700 1 -- 172.21.15.49:0/1520267599 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ae00049f0 msgr2=0x7f1ae0004e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:43.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.569+0000 7f1af27fc700 1 --2- 172.21.15.49:0/1520267599 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ae00049f0 0x7f1ae0004e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:43.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.569+0000 7f1af27fc700 1 -- 172.21.15.49:0/1520267599 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae0004500 con 0x7f1ae00057a0 2023-11-30T17:23:43.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.569+0000 7f1af37fe700 1 -- 172.21.15.49:0/1520267599 reap_dead start 2023-11-30T17:23:43.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.569+0000 7f1af27fc700 1 --2- 172.21.15.49:0/1520267599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ae00057a0 0x7f1ae0005c20 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f1adc001730 tx=0x7f1adc007bb0).ready entity=mon.0 client_cookie=cf2278ac03ba4aad server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:43.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.569+0000 7f1af1ffb700 1 -- 172.21.15.49:0/1520267599 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc007020 con 0x7f1ae00057a0 2023-11-30T17:23:43.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.569+0000 7f1af1ffb700 1 -- 172.21.15.49:0/1520267599 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1adc007180 con 0x7f1ae00057a0 2023-11-30T17:23:43.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.569+0000 7f1af1ffb700 1 -- 172.21.15.49:0/1520267599 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc007520 con 0x7f1ae00057a0 2023-11-30T17:23:43.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.570+0000 7f1af9309700 1 -- 172.21.15.49:0/1520267599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ae00057a0 msgr2=0x7f1ae0005c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:43.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.570+0000 7f1af9309700 1 --2- 172.21.15.49:0/1520267599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ae00057a0 0x7f1ae0005c20 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f1adc001730 tx=0x7f1adc007bb0).stop 2023-11-30T17:23:43.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.570+0000 7f1af9309700 1 -- 172.21.15.49:0/1520267599 shutdown_connections 2023-11-30T17:23:43.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.570+0000 7f1af9309700 1 --2- 172.21.15.49:0/1520267599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ae00057a0 0x7f1ae0005c20 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:43.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.570+0000 7f1af9309700 1 -- 172.21.15.49:0/1520267599 >> 172.21.15.49:0/1520267599 conn(0x7f1af40c6c70 msgr2=0x7f1af40c7080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:43.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.570+0000 7f1af9309700 1 -- 172.21.15.49:0/1520267599 shutdown_connections 2023-11-30T17:23:43.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.570+0000 7f1af9309700 1 -- 172.21.15.49:0/1520267599 wait complete. 2023-11-30T17:23:43.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.571+0000 7f1af9309700 1 Processor -- start 2023-11-30T17:23:43.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.571+0000 7f1af9309700 1 -- start start 2023-11-30T17:23:43.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.572+0000 7f1af9309700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ae00057a0 0x7f1af40bdd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:43.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.572+0000 7f1af9309700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1af4163760 0x7f1af4147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:43.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.572+0000 7f1af9309700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1af415f960 0x7f1af40a8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:43.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.572+0000 7f1af9309700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af40a9c20 con 0x7f1ae00057a0 2023-11-30T17:23:43.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.572+0000 7f1af9309700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af4163c60 con 0x7f1af415f960 2023-11-30T17:23:43.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.572+0000 7f1af9309700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af4163f40 con 0x7f1af4163760 2023-11-30T17:23:43.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.572+0000 7f1af2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ae00057a0 0x7f1af40bdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:43.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.572+0000 7f1af2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ae00057a0 0x7f1af40bdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54696/0 (socket says 172.21.15.49:54696) 2023-11-30T17:23:43.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.572+0000 7f1af2ffd700 1 -- 172.21.15.49:0/926494551 learned_addr learned my addr 172.21.15.49:0/926494551 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:43.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.572+0000 7f1af27fc700 1 --2- 172.21.15.49:0/926494551 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1af4163760 0x7f1af4147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:43.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.572+0000 7f1af37fe700 1 --2- 172.21.15.49:0/926494551 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1af415f960 0x7f1af40a8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:43.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.572+0000 7f1af2ffd700 1 -- 172.21.15.49:0/926494551 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1af4163760 msgr2=0x7f1af4147690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:43.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.572+0000 7f1af2ffd700 1 --2- 172.21.15.49:0/926494551 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1af4163760 0x7f1af4147690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:43.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.572+0000 7f1af2ffd700 1 -- 172.21.15.49:0/926494551 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1af415f960 msgr2=0x7f1af40a8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:43.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.572+0000 7f1af2ffd700 1 --2- 172.21.15.49:0/926494551 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1af415f960 0x7f1af40a8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:43.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.572+0000 7f1af2ffd700 1 -- 172.21.15.49:0/926494551 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af4164220 con 0x7f1ae00057a0 2023-11-30T17:23:43.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.573+0000 7f1af37fe700 1 --2- 172.21.15.49:0/926494551 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1af415f960 0x7f1af40a8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:23:43.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.573+0000 7f1af2ffd700 1 --2- 172.21.15.49:0/926494551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ae00057a0 0x7f1af40bdd10 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7f1aec000df0 tx=0x7f1aec001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:43.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.573+0000 7f1aeaffd700 1 -- 172.21.15.49:0/926494551 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec011590 con 0x7f1ae00057a0 2023-11-30T17:23:43.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.573+0000 7f1aeaffd700 1 -- 172.21.15.49:0/926494551 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aec0116f0 con 0x7f1ae00057a0 2023-11-30T17:23:43.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.573+0000 7f1af9309700 1 -- 172.21.15.49:0/926494551 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af4164500 con 0x7f1ae00057a0 2023-11-30T17:23:43.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.573+0000 7f1aeaffd700 1 -- 172.21.15.49:0/926494551 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec011a70 con 0x7f1ae00057a0 2023-11-30T17:23:43.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.573+0000 7f1af9309700 1 -- 172.21.15.49:0/926494551 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af4147b80 con 0x7f1ae00057a0 2023-11-30T17:23:43.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.574+0000 7f1af9309700 1 -- 172.21.15.49:0/926494551 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af406c7c0 con 0x7f1ae00057a0 2023-11-30T17:23:43.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.574+0000 7f1aeaffd700 1 -- 172.21.15.49:0/926494551 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f1aec01d3b0 con 0x7f1ae00057a0 2023-11-30T17:23:43.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.574+0000 7f1aeaffd700 1 --2- 172.21.15.49:0/926494551 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1ad405f240 0x7f1ad4061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:43.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.574+0000 7f1aeaffd700 1 -- 172.21.15.49:0/926494551 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f1aec079ca0 con 0x7f1ae00057a0 2023-11-30T17:23:43.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.575+0000 7f1af27fc700 1 --2- 172.21.15.49:0/926494551 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1ad405f240 0x7f1ad4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:43.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.575+0000 7f1af27fc700 1 --2- 172.21.15.49:0/926494551 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1ad405f240 0x7f1ad4061700 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f1adc000fd0 tx=0x7f1adc015000).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:43.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.579+0000 7f1aeaffd700 1 -- 172.21.15.49:0/926494551 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1aec04ae20 con 0x7f1ae00057a0 2023-11-30T17:23:43.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:43.801+0000 7f1af9309700 1 -- 172.21.15.49:0/926494551 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f1af4151440 con 0x7f1ae00057a0 2023-11-30T17:23:44.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.222+0000 7f1aeaffd700 1 -- 172.21.15.49:0/926494551 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 41) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f1aec0778d0 con 0x7f1ae00057a0 2023-11-30T17:23:44.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.224+0000 7f1aeaffd700 1 -- 172.21.15.49:0/926494551 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v41) v1 ==== 92+0+0 (secure 0 0 0) 0x7f1aec071760 con 0x7f1ae00057a0 2023-11-30T17:23:44.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.226+0000 7f1af9309700 1 -- 172.21.15.49:0/926494551 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1ad405f240 msgr2=0x7f1ad4061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:44.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.226+0000 7f1af9309700 1 --2- 172.21.15.49:0/926494551 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1ad405f240 0x7f1ad4061700 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f1adc000fd0 tx=0x7f1adc015000).stop 2023-11-30T17:23:44.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.226+0000 7f1af9309700 1 -- 172.21.15.49:0/926494551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ae00057a0 msgr2=0x7f1af40bdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:44.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.226+0000 7f1af9309700 1 --2- 172.21.15.49:0/926494551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ae00057a0 0x7f1af40bdd10 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7f1aec000df0 tx=0x7f1aec001e50).stop 2023-11-30T17:23:44.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.226+0000 7f1af9309700 1 -- 172.21.15.49:0/926494551 shutdown_connections 2023-11-30T17:23:44.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.226+0000 7f1af9309700 1 --2- 172.21.15.49:0/926494551 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1af415f960 0x7f1af40a8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:44.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.226+0000 7f1af9309700 1 --2- 172.21.15.49:0/926494551 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1ad405f240 0x7f1ad4061700 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:44.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.226+0000 7f1af9309700 1 --2- 172.21.15.49:0/926494551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ae00057a0 0x7f1af40bdd10 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:44.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.226+0000 7f1af9309700 1 --2- 172.21.15.49:0/926494551 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1af4163760 0x7f1af4147690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:44.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.226+0000 7f1af9309700 1 -- 172.21.15.49:0/926494551 >> 172.21.15.49:0/926494551 conn(0x7f1af40c6c70 msgr2=0x7f1af4069dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:44.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.226+0000 7f1af9309700 1 -- 172.21.15.49:0/926494551 shutdown_connections 2023-11-30T17:23:44.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.226+0000 7f1af9309700 1 -- 172.21.15.49:0/926494551 wait complete. 2023-11-30T17:23:44.244 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-11-30T17:23:44.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.365+0000 7f0b26d57700 1 Processor -- start 2023-11-30T17:23:44.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.365+0000 7f0b26d57700 1 -- start start 2023-11-30T17:23:44.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.366+0000 7f0b26d57700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0b200c66f0 0x7f0b20154950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:44.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.366+0000 7f0b26d57700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b20154e40 con 0x7f0b2014e530 2023-11-30T17:23:44.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.366+0000 7f0b26d57700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b200c7bc0 con 0x7f0b20158570 2023-11-30T17:23:44.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.366+0000 7f0b26d57700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b200c6ba0 con 0x7f0b200c66f0 2023-11-30T17:23:44.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.366+0000 7f0b25554700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0b200c66f0 0x7f0b20154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:44.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.366+0000 7f0b25d55700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0b2014e530 0x7f0b2014e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38514/0 (socket says 172.21.15.49:38514) 2023-11-30T17:23:44.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.366+0000 7f0b25d55700 1 -- 172.21.15.49:0/1731728029 learned_addr learned my addr 172.21.15.49:0/1731728029 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:44.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.366+0000 7f0b25554700 1 -- 172.21.15.49:0/1731728029 >> v1:172.21.15.115:6789/0 conn(0x7f0b20158570 legacy=0x7f0b200aa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:44.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.366+0000 7f0b25554700 1 -- 172.21.15.49:0/1731728029 >> v1:172.21.15.49:6789/0 conn(0x7f0b2014e530 legacy=0x7f0b2014e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:44.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.366+0000 7f0b24d53700 1 -- 172.21.15.49:0/1731728029 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955492513 0 0) 0x7f0b14001110 con 0x7f0b2014e530 2023-11-30T17:23:44.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.367+0000 7f0b25554700 1 -- 172.21.15.49:0/1731728029 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b20155920 con 0x7f0b200c66f0 2023-11-30T17:23:44.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.367+0000 7f0b25554700 1 --2- 172.21.15.49:0/1731728029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b200c66f0 0x7f0b20154950 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7f0b1c009760 tx=0x7f0b1c009060).ready entity=mon.0 client_cookie=79f651c74d0e7f84 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:44.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.367+0000 7f0b24d53700 1 -- 172.21.15.49:0/1731728029 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c00b580 con 0x7f0b200c66f0 2023-11-30T17:23:44.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.367+0000 7f0b24d53700 1 -- 172.21.15.49:0/1731728029 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1c00b6e0 con 0x7f0b200c66f0 2023-11-30T17:23:44.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.367+0000 7f0b24d53700 1 -- 172.21.15.49:0/1731728029 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c00ba60 con 0x7f0b200c66f0 2023-11-30T17:23:44.370 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:44.367+0000 7f9b5aee7680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T17:23:44.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.368+0000 7f0b26d57700 1 -- 172.21.15.49:0/1731728029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b200c66f0 msgr2=0x7f0b20154950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:44.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.368+0000 7f0b26d57700 1 --2- 172.21.15.49:0/1731728029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b200c66f0 0x7f0b20154950 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7f0b1c009760 tx=0x7f0b1c009060).stop 2023-11-30T17:23:44.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.368+0000 7f0b26d57700 1 -- 172.21.15.49:0/1731728029 shutdown_connections 2023-11-30T17:23:44.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.368+0000 7f0b26d57700 1 --2- 172.21.15.49:0/1731728029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b200c66f0 0x7f0b20154950 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:44.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.368+0000 7f0b26d57700 1 -- 172.21.15.49:0/1731728029 >> 172.21.15.49:0/1731728029 conn(0x7f0b20064990 msgr2=0x7f0b20064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:44.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.368+0000 7f0b26d57700 1 -- 172.21.15.49:0/1731728029 shutdown_connections 2023-11-30T17:23:44.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.368+0000 7f0b26d57700 1 -- 172.21.15.49:0/1731728029 wait complete. 2023-11-30T17:23:44.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.370+0000 7f0b26d57700 1 Processor -- start 2023-11-30T17:23:44.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.370+0000 7f0b26d57700 1 -- start start 2023-11-30T17:23:44.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.371+0000 7f0b26d57700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b200c66f0 0x7f0b20140430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:44.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.371+0000 7f0b26d57700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b2014e530 0x7f0b200c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:44.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.371+0000 7f0b26d57700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b20158570 0x7f0b200c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:44.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.371+0000 7f0b26d57700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b200c5450 con 0x7f0b2014e530 2023-11-30T17:23:44.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.371+0000 7f0b26d57700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b20143410 con 0x7f0b200c66f0 2023-11-30T17:23:44.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.371+0000 7f0b26d57700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b200b09e0 con 0x7f0b20158570 2023-11-30T17:23:44.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.371+0000 7f0b25554700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b2014e530 0x7f0b200c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:44.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.371+0000 7f0b25554700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b2014e530 0x7f0b200c4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54738/0 (socket says 172.21.15.49:54738) 2023-11-30T17:23:44.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.371+0000 7f0b25554700 1 -- 172.21.15.49:0/3759517213 learned_addr learned my addr 172.21.15.49:0/3759517213 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:44.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.371+0000 7f0b25d55700 1 --2- 172.21.15.49:0/3759517213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b200c66f0 0x7f0b20140430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:44.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.371+0000 7f0b26556700 1 --2- 172.21.15.49:0/3759517213 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b20158570 0x7f0b200c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:44.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.372+0000 7f0b25554700 1 -- 172.21.15.49:0/3759517213 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b20158570 msgr2=0x7f0b200c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:44.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.372+0000 7f0b25554700 1 --2- 172.21.15.49:0/3759517213 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b20158570 0x7f0b200c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:44.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.372+0000 7f0b25554700 1 -- 172.21.15.49:0/3759517213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b200c66f0 msgr2=0x7f0b20140430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:44.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.372+0000 7f0b25554700 1 --2- 172.21.15.49:0/3759517213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b200c66f0 0x7f0b20140430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:44.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.372+0000 7f0b25554700 1 -- 172.21.15.49:0/3759517213 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b1c0092a0 con 0x7f0b2014e530 2023-11-30T17:23:44.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.372+0000 7f0b25554700 1 --2- 172.21.15.49:0/3759517213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b2014e530 0x7f0b200c4a70 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7f0b20064480 tx=0x7f0b1c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:44.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.372+0000 7f0b11ffb700 1 -- 172.21.15.49:0/3759517213 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c00b850 con 0x7f0b2014e530 2023-11-30T17:23:44.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.372+0000 7f0b11ffb700 1 -- 172.21.15.49:0/3759517213 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1c00b9d0 con 0x7f0b2014e530 2023-11-30T17:23:44.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.372+0000 7f0b26d57700 1 -- 172.21.15.49:0/3759517213 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b200c3350 con 0x7f0b2014e530 2023-11-30T17:23:44.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.372+0000 7f0b11ffb700 1 -- 172.21.15.49:0/3759517213 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c01b660 con 0x7f0b2014e530 2023-11-30T17:23:44.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.372+0000 7f0b26d57700 1 -- 172.21.15.49:0/3759517213 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b200c2d00 con 0x7f0b2014e530 2023-11-30T17:23:44.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.373+0000 7f0b11ffb700 1 -- 172.21.15.49:0/3759517213 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 41) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f0b1c01ba90 con 0x7f0b2014e530 2023-11-30T17:23:44.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.373+0000 7f0b26d57700 1 -- 172.21.15.49:0/3759517213 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b20062ee0 con 0x7f0b2014e530 2023-11-30T17:23:44.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.374+0000 7f0b11ffb700 1 --2- 172.21.15.49:0/3759517213 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0b0405f290 0x7f0b04061750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:44.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.374+0000 7f0b11ffb700 1 -- 172.21.15.49:0/3759517213 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f0b1c07be90 con 0x7f0b2014e530 2023-11-30T17:23:44.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.374+0000 7f0b25d55700 1 -- 172.21.15.49:0/3759517213 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0b0405f290 msgr2=0x7f0b04061750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:23:44.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.374+0000 7f0b25d55700 1 --2- 172.21.15.49:0/3759517213 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0b0405f290 0x7f0b04061750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:23:44.378 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:44.375+0000 7f61e1841680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T17:23:44.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.378+0000 7f0b11ffb700 1 -- 172.21.15.49:0/3759517213 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0b1c04cfc0 con 0x7f0b2014e530 2023-11-30T17:23:44.432 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:44.430+0000 7f9b5aee7680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T17:23:44.452 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:44.451+0000 7f61e1841680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T17:23:44.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.564+0000 7f0b26d57700 1 -- 172.21.15.49:0/3759517213 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f0b200c34e0 con 0x7f0b2014e530 2023-11-30T17:23:44.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.571+0000 7f0b11ffb700 1 -- 172.21.15.49:0/3759517213 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v19)=0 v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0b1c006b30 con 0x7f0b2014e530 2023-11-30T17:23:44.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.574+0000 7f0b26d57700 1 -- 172.21.15.49:0/3759517213 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0b0405f290 msgr2=0x7f0b04061750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:23:44.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.574+0000 7f0b26d57700 1 --2- 172.21.15.49:0/3759517213 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0b0405f290 0x7f0b04061750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:44.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.574+0000 7f0b26d57700 1 -- 172.21.15.49:0/3759517213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b2014e530 msgr2=0x7f0b200c4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:44.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.574+0000 7f0b26d57700 1 --2- 172.21.15.49:0/3759517213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b2014e530 0x7f0b200c4a70 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7f0b20064480 tx=0x7f0b1c017000).stop 2023-11-30T17:23:44.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.574+0000 7f0b26d57700 1 -- 172.21.15.49:0/3759517213 shutdown_connections 2023-11-30T17:23:44.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.574+0000 7f0b26d57700 1 --2- 172.21.15.49:0/3759517213 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b20158570 0x7f0b200c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:44.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.574+0000 7f0b26d57700 1 --2- 172.21.15.49:0/3759517213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b200c66f0 0x7f0b20140430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:44.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.574+0000 7f0b26d57700 1 --2- 172.21.15.49:0/3759517213 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0b0405f290 0x7f0b04061750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:44.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.574+0000 7f0b26d57700 1 --2- 172.21.15.49:0/3759517213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b2014e530 0x7f0b200c4a70 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:44.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.574+0000 7f0b26d57700 1 -- 172.21.15.49:0/3759517213 >> 172.21.15.49:0/3759517213 conn(0x7f0b20064990 msgr2=0x7f0b201560e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:44.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.574+0000 7f0b26d57700 1 -- 172.21.15.49:0/3759517213 shutdown_connections 2023-11-30T17:23:44.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.574+0000 7f0b26d57700 1 -- 172.21.15.49:0/3759517213 wait complete. 2023-11-30T17:23:44.592 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /bad-path 1M 2023-11-30T17:23:44.705 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:44.703+0000 7f9b5aee7680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T17:23:44.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.714+0000 7f34a1eb3700 1 Processor -- start 2023-11-30T17:23:44.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.714+0000 7f34a1eb3700 1 -- start start 2023-11-30T17:23:44.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.715+0000 7f34a1eb3700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f349c0c6770 0x7f349c15d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:44.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.715+0000 7f34a1eb3700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f349c156d50 con 0x7f349c13b0b0 2023-11-30T17:23:44.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.715+0000 7f34a1eb3700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f349c156140 con 0x7f349c13acd0 2023-11-30T17:23:44.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.715+0000 7f34a1eb3700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f349c156420 con 0x7f349c0c6770 2023-11-30T17:23:44.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.715+0000 7f3492ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f349c13b0b0 0x7f349c0c6060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38524/0 (socket says 172.21.15.49:38524) 2023-11-30T17:23:44.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.715+0000 7f3492ffd700 1 -- 172.21.15.49:0/1997476377 learned_addr learned my addr 172.21.15.49:0/1997476377 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:44.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.716+0000 7f349bfff700 1 --2- 172.21.15.49:0/1997476377 >> v2:172.21.15.115:3300/0 conn(0x7f349c0c6770 0x7f349c15d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:44.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.716+0000 7f349affd700 1 -- 172.21.15.49:0/1997476377 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3347141891 0 0) 0x7f349c156d50 con 0x7f349c13b0b0 2023-11-30T17:23:44.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.716+0000 7f349affd700 1 -- 172.21.15.49:0/1997476377 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34880033f0 con 0x7f349c13b0b0 2023-11-30T17:23:44.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.716+0000 7f349affd700 1 -- 172.21.15.49:0/1997476377 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3335976879 0 0) 0x7f349c156140 con 0x7f349c13acd0 2023-11-30T17:23:44.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.716+0000 7f349affd700 1 -- 172.21.15.49:0/1997476377 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f349c156d50 con 0x7f349c13acd0 2023-11-30T17:23:44.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.716+0000 7f349bfff700 1 -- 172.21.15.49:0/1997476377 >> v1:172.21.15.115:6789/0 conn(0x7f349c13acd0 legacy=0x7f349c13b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:44.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.716+0000 7f349bfff700 1 -- 172.21.15.49:0/1997476377 >> v1:172.21.15.49:6789/0 conn(0x7f349c13b0b0 legacy=0x7f349c0c6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:44.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.716+0000 7f349bfff700 1 -- 172.21.15.49:0/1997476377 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c156700 con 0x7f349c0c6770 2023-11-30T17:23:44.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.716+0000 7f349bfff700 1 --2- 172.21.15.49:0/1997476377 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f349c0c6770 0x7f349c15d170 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f3494009e60 tx=0x7f3494009780).ready entity=mon.1 client_cookie=f2198f2e8fabf969 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:44.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.716+0000 7f349affd700 1 -- 172.21.15.49:0/1997476377 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349400e070 con 0x7f349c0c6770 2023-11-30T17:23:44.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.716+0000 7f349affd700 1 -- 172.21.15.49:0/1997476377 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349400bab0 con 0x7f349c0c6770 2023-11-30T17:23:44.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.716+0000 7f349affd700 1 -- 172.21.15.49:0/1997476377 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349400be30 con 0x7f349c0c6770 2023-11-30T17:23:44.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.717+0000 7f34a1eb3700 1 -- 172.21.15.49:0/1997476377 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f349c0c6770 msgr2=0x7f349c15d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:44.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.717+0000 7f34a1eb3700 1 --2- 172.21.15.49:0/1997476377 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f349c0c6770 0x7f349c15d170 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f3494009e60 tx=0x7f3494009780).stop 2023-11-30T17:23:44.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.717+0000 7f34a1eb3700 1 -- 172.21.15.49:0/1997476377 shutdown_connections 2023-11-30T17:23:44.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.717+0000 7f34a1eb3700 1 --2- 172.21.15.49:0/1997476377 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f349c0c6770 0x7f349c15d170 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:44.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.717+0000 7f34a1eb3700 1 -- 172.21.15.49:0/1997476377 >> 172.21.15.49:0/1997476377 conn(0x7f349c0628f0 msgr2=0x7f349c062d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:44.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.717+0000 7f34a1eb3700 1 -- 172.21.15.49:0/1997476377 shutdown_connections 2023-11-30T17:23:44.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.717+0000 7f34a1eb3700 1 -- 172.21.15.49:0/1997476377 wait complete. 2023-11-30T17:23:44.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.718+0000 7f34a1eb3700 1 Processor -- start 2023-11-30T17:23:44.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.718+0000 7f34a1eb3700 1 -- start start 2023-11-30T17:23:44.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.719+0000 7f34a1eb3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f349c0c6770 0x7f349c1570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:44.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.719+0000 7f34a1eb3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f349c13acd0 0x7f349c1396b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:44.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.719+0000 7f34a1eb3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f349c13b0b0 0x7f349c139ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:44.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.719+0000 7f34a1eb3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349c13a090 con 0x7f349c0c6770 2023-11-30T17:23:44.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.719+0000 7f34a1eb3700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349c0c3fd0 con 0x7f349c13acd0 2023-11-30T17:23:44.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.719+0000 7f34a1eb3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349c162330 con 0x7f349c13b0b0 2023-11-30T17:23:44.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.719+0000 7f349b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f349c0c6770 0x7f349c1570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:44.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.719+0000 7f349b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f349c0c6770 0x7f349c1570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54754/0 (socket says 172.21.15.49:54754) 2023-11-30T17:23:44.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.719+0000 7f349b7fe700 1 -- 172.21.15.49:0/1807275315 learned_addr learned my addr 172.21.15.49:0/1807275315 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:44.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.719+0000 7f3492ffd700 1 --2- 172.21.15.49:0/1807275315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f349c13acd0 0x7f349c1396b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:44.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.719+0000 7f349bfff700 1 --2- 172.21.15.49:0/1807275315 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f349c13b0b0 0x7f349c139ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:44.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.719+0000 7f349b7fe700 1 -- 172.21.15.49:0/1807275315 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f349c13b0b0 msgr2=0x7f349c139ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:44.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.719+0000 7f349b7fe700 1 --2- 172.21.15.49:0/1807275315 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f349c13b0b0 0x7f349c139ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:44.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.719+0000 7f349b7fe700 1 -- 172.21.15.49:0/1807275315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f349c13acd0 msgr2=0x7f349c1396b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:44.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.719+0000 7f349b7fe700 1 --2- 172.21.15.49:0/1807275315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f349c13acd0 0x7f349c1396b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:44.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.719+0000 7f349b7fe700 1 -- 172.21.15.49:0/1807275315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3494009a20 con 0x7f349c0c6770 2023-11-30T17:23:44.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.720+0000 7f349b7fe700 1 --2- 172.21.15.49:0/1807275315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f349c0c6770 0x7f349c1570f0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7f348c00c490 tx=0x7f348c007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:44.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.720+0000 7f3493fff700 1 -- 172.21.15.49:0/1807275315 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c00ce40 con 0x7f349c0c6770 2023-11-30T17:23:44.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.720+0000 7f3493fff700 1 -- 172.21.15.49:0/1807275315 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348c00f470 con 0x7f349c0c6770 2023-11-30T17:23:44.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.720+0000 7f34a1eb3700 1 -- 172.21.15.49:0/1807275315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349c0c3730 con 0x7f349c0c6770 2023-11-30T17:23:44.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.720+0000 7f3493fff700 1 -- 172.21.15.49:0/1807275315 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c00f810 con 0x7f349c0c6770 2023-11-30T17:23:44.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.720+0000 7f34a1eb3700 1 -- 172.21.15.49:0/1807275315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f349c0c3cf0 con 0x7f349c0c6770 2023-11-30T17:23:44.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.721+0000 7f34a1eb3700 1 -- 172.21.15.49:0/1807275315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f349c06c860 con 0x7f349c0c6770 2023-11-30T17:23:44.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.721+0000 7f3493fff700 1 -- 172.21.15.49:0/1807275315 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 41) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f348c00fb80 con 0x7f349c0c6770 2023-11-30T17:23:44.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.722+0000 7f3493fff700 1 --2- 172.21.15.49:0/1807275315 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f347c05f2c0 0x7f347c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:44.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.722+0000 7f3492ffd700 1 -- 172.21.15.49:0/1807275315 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f347c05f2c0 msgr2=0x7f347c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:23:44.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.722+0000 7f3493fff700 1 -- 172.21.15.49:0/1807275315 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f348c0799a0 con 0x7f349c0c6770 2023-11-30T17:23:44.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.722+0000 7f3492ffd700 1 --2- 172.21.15.49:0/1807275315 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f347c05f2c0 0x7f347c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:23:44.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.726+0000 7f3493fff700 1 -- 172.21.15.49:0/1807275315 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f348c04aad0 con 0x7f349c0c6770 2023-11-30T17:23:44.754 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:44.753+0000 7f61e1841680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T17:23:44.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.923+0000 7f3492ffd700 1 -- 172.21.15.49:0/1807275315 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f347c05f2c0 msgr2=0x7f347c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:23:44.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.923+0000 7f3492ffd700 1 --2- 172.21.15.49:0/1807275315 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f347c05f2c0 0x7f347c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:23:44.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:44.925+0000 7f34a1eb3700 1 -- 172.21.15.49:0/1807275315 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f349c162470 con 0x7f347c05f2c0 2023-11-30T17:23:45.317 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:45.316+0000 7f9b5aee7680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T17:23:45.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:45.324+0000 7f3492ffd700 1 -- 172.21.15.49:0/1807275315 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f347c05f2c0 msgr2=0x7f347c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:23:45.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:45.324+0000 7f3492ffd700 1 --2- 172.21.15.49:0/1807275315 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f347c05f2c0 0x7f347c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-11-30T17:23:45.389 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:45.388+0000 7f9b5aee7680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T17:23:45.418 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:45.417+0000 7f61e1841680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T17:23:45.487 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:45.486+0000 7f61e1841680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T17:23:45.575 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:45.573+0000 7f9b5aee7680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T17:23:45.683 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:45.682+0000 7f61e1841680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T17:23:45.993 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:45.992+0000 7f9b5aee7680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T17:23:46.096 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:46.095+0000 7f9b5aee7680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:23:46.123 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:46.121+0000 7f61e1841680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T17:23:46.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:46.125+0000 7f3492ffd700 1 -- 172.21.15.49:0/1807275315 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f347c05f2c0 msgr2=0x7f347c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:23:46.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:46.125+0000 7f3492ffd700 1 --2- 172.21.15.49:0/1807275315 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f347c05f2c0 0x7f347c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-11-30T17:23:46.232 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:46.230+0000 7f61e1841680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:23:46.247 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:46.246+0000 7f9b5aee7680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T17:23:46.322 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:46.320+0000 7f9b5aee7680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T17:23:46.389 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:46.387+0000 7f9b5aee7680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T17:23:46.391 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:46.390+0000 7f61e1841680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T17:23:46.470 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:46.468+0000 7f61e1841680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T17:23:46.540 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:46.539+0000 7f61e1841680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T17:23:46.646 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:46.644+0000 7f9b5aee7680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T17:23:46.813 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:46.812+0000 7f61e1841680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T17:23:46.830 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:46.828+0000 7f9b5aee7680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T17:23:47.004 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:47.002+0000 7f61e1841680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T17:23:47.474 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:47.473+0000 7f9b5aee7680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T17:23:47.543 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:47.541+0000 7f9b5aee7680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T17:23:47.621 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:47.620+0000 7f9b5aee7680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T17:23:47.692 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:47.690+0000 7f61e1841680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T17:23:47.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:47.726+0000 7f3492ffd700 1 -- 172.21.15.49:0/1807275315 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f347c05f2c0 msgr2=0x7f347c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:23:47.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:47.727+0000 7f3492ffd700 1 --2- 172.21.15.49:0/1807275315 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f347c05f2c0 0x7f347c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-11-30T17:23:47.763 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:47.762+0000 7f61e1841680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T17:23:47.767 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:47.766+0000 7f9b5aee7680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T17:23:47.840 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:47.838+0000 7f9b5aee7680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T17:23:47.842 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:47.840+0000 7f61e1841680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T17:23:47.956 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:47.955+0000 7f9b5aee7680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T17:23:47.999 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:47.998+0000 7f61e1841680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T17:23:48.067 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:48.066+0000 7f9b5aee7680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:23:48.073 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:48.071+0000 7f61e1841680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T17:23:48.194 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:48.192+0000 7f61e1841680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T17:23:48.307 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:48.306+0000 7f61e1841680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:23:48.354 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:48.353+0000 7f9b5aee7680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T17:23:48.425 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:48.424+0000 7f9b5aee7680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T17:23:48.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:48.445+0000 7f3493fff700 1 -- 172.21.15.49:0/1807275315 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 42) v1 ==== 75287+0+0 (secure 0 0 0) 0x7f348c0775d0 con 0x7f349c0c6770 2023-11-30T17:23:48.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:48.445+0000 7f3493fff700 1 -- 172.21.15.49:0/1807275315 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f347c05f2c0 msgr2=0x7f347c061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:23:48.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:48.445+0000 7f3493fff700 1 --2- 172.21.15.49:0/1807275315 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f347c05f2c0 0x7f347c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:23:48.510 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:48.508+0000 7f9acf66d700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:23:48.510 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:48.508+0000 7f9acf66d700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:23:48.510 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:48.508+0000 7f9ad2673700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:23:48.510 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:48.508+0000 7f9ad2673700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:23:48.510 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:48.508+0000 7f9ad2673700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:23:48.510 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:48.508+0000 7f9ad2673700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:23:48.511 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:48.508+0000 7f9ad2673700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:23:48.511 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:48.508+0000 7f9acf66d700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:23:48.511 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:48.508+0000 7f9acf66d700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:23:48.511 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:23:48.508+0000 7f9acf66d700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:23:48.617 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:48.615+0000 7f61e1841680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T17:23:48.692 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:23:48.691+0000 7f61e1841680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T17:23:49.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.447+0000 7f3493fff700 1 -- 172.21.15.49:0/1807275315 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mgrmap(e 43) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f348c077950 con 0x7f349c0c6770 2023-11-30T17:23:49.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.447+0000 7f3493fff700 1 --2- 172.21.15.49:0/1807275315 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f347c05f2c0 0x7f347c061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:49.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.447+0000 7f3493fff700 1 -- 172.21.15.49:0/1807275315 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f347c030b80 con 0x7f347c05f2c0 2023-11-30T17:23:49.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.448+0000 7f3492ffd700 1 --2- 172.21.15.49:0/1807275315 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f347c05f2c0 0x7f347c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:49.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.449+0000 7f3492ffd700 1 --2- 172.21.15.49:0/1807275315 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f347c05f2c0 0x7f347c061700 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f3484007fd0 tx=0x7f3484009040).ready entity=mgr.6362 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:49.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.460+0000 7f3493fff700 1 -- 172.21.15.49:0/1807275315 <== mgr.6362 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f3484001670 con 0x7f347c05f2c0 2023-11-30T17:23:49.462 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule set for path /bad-path 2023-11-30T17:23:49.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.462+0000 7f34a1eb3700 1 -- 172.21.15.49:0/1807275315 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f347c05f2c0 msgr2=0x7f347c061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:49.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.462+0000 7f34a1eb3700 1 --2- 172.21.15.49:0/1807275315 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f347c05f2c0 0x7f347c061700 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f3484007fd0 tx=0x7f3484009040).stop 2023-11-30T17:23:49.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.462+0000 7f34a1eb3700 1 -- 172.21.15.49:0/1807275315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f349c0c6770 msgr2=0x7f349c1570f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:49.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.462+0000 7f34a1eb3700 1 --2- 172.21.15.49:0/1807275315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f349c0c6770 0x7f349c1570f0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7f348c00c490 tx=0x7f348c007c90).stop 2023-11-30T17:23:49.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.462+0000 7f34a1eb3700 1 -- 172.21.15.49:0/1807275315 shutdown_connections 2023-11-30T17:23:49.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.462+0000 7f34a1eb3700 1 --2- 172.21.15.49:0/1807275315 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f349c13b0b0 0x7f349c139ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:49.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.462+0000 7f34a1eb3700 1 --2- 172.21.15.49:0/1807275315 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f347c05f2c0 0x7f347c061700 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:49.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.462+0000 7f34a1eb3700 1 --2- 172.21.15.49:0/1807275315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f349c0c6770 0x7f349c1570f0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:49.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.462+0000 7f34a1eb3700 1 --2- 172.21.15.49:0/1807275315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f349c13acd0 0x7f349c1396b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:49.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.462+0000 7f34a1eb3700 1 -- 172.21.15.49:0/1807275315 >> 172.21.15.49:0/1807275315 conn(0x7f349c0628f0 msgr2=0x7f349c0ae750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:49.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.462+0000 7f34a1eb3700 1 -- 172.21.15.49:0/1807275315 shutdown_connections 2023-11-30T17:23:49.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.462+0000 7f34a1eb3700 1 -- 172.21.15.49:0/1807275315 wait complete. 2023-11-30T17:23:49.478 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /bad-path 2023-11-30T17:23:49.479 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-11-30T17:23:49.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.604+0000 7f66c9c1f700 1 Processor -- start 2023-11-30T17:23:49.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.604+0000 7f66c9c1f700 1 -- start start 2023-11-30T17:23:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.605+0000 7f66c9c1f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f66c40c6530 0x7f66c40640b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.605+0000 7f66c9c1f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f66c40bef90 0x7f66c40c35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.605+0000 7f66c9c1f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c41559b0 con 0x7f66c40c57e0 2023-11-30T17:23:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.605+0000 7f66c9c1f700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c4065680 con 0x7f66c40c6530 2023-11-30T17:23:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.605+0000 7f66c9c1f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c40c6910 con 0x7f66c40bef90 2023-11-30T17:23:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.605+0000 7f66c8c1d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f66c40c6530 0x7f66c40640b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.605+0000 7f66c3fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f66c40c57e0 0x7f66c40be880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38532/0 (socket says 172.21.15.49:38532) 2023-11-30T17:23:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.605+0000 7f66c8c1d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f66c40c6530 0x7f66c40640b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54760/0 (socket says 172.21.15.49:54760) 2023-11-30T17:23:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.605+0000 7f66c3fff700 1 -- 172.21.15.49:0/74209562 learned_addr learned my addr 172.21.15.49:0/74209562 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:23:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.605+0000 7f66c941e700 1 --2- 172.21.15.49:0/74209562 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f66c40bef90 0x7f66c40c35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.605+0000 7f66c8c1d700 1 -- 172.21.15.49:0/74209562 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f66c40bef90 msgr2=0x7f66c40c35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:23:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.605+0000 7f66c8c1d700 1 --2- 172.21.15.49:0/74209562 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f66c40bef90 0x7f66c40c35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.605+0000 7f66c37fe700 1 -- 172.21.15.49:0/74209562 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1145840554 0 0) 0x7f66c41559b0 con 0x7f66c40c57e0 2023-11-30T17:23:49.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.605+0000 7f66c8c1d700 1 -- 172.21.15.49:0/74209562 >> v1:172.21.15.49:6789/0 conn(0x7f66c40c57e0 legacy=0x7f66c40be880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:49.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.605+0000 7f66c8c1d700 1 -- 172.21.15.49:0/74209562 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c4064a00 con 0x7f66c40c6530 2023-11-30T17:23:49.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.605+0000 7f66c8c1d700 1 --2- 172.21.15.49:0/74209562 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66c40c6530 0x7f66c40640b0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f66b4009760 tx=0x7f66b4009060).ready entity=mon.0 client_cookie=ba85985147928893 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:49.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.605+0000 7f66c37fe700 1 -- 172.21.15.49:0/74209562 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b400b580 con 0x7f66c40c6530 2023-11-30T17:23:49.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.606+0000 7f66c37fe700 1 -- 172.21.15.49:0/74209562 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b400b6e0 con 0x7f66c40c6530 2023-11-30T17:23:49.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.606+0000 7f66c37fe700 1 -- 172.21.15.49:0/74209562 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b400ba60 con 0x7f66c40c6530 2023-11-30T17:23:49.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.606+0000 7f66c9c1f700 1 -- 172.21.15.49:0/74209562 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66c40c6530 msgr2=0x7f66c40640b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:49.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.606+0000 7f66c9c1f700 1 --2- 172.21.15.49:0/74209562 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66c40c6530 0x7f66c40640b0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f66b4009760 tx=0x7f66b4009060).stop 2023-11-30T17:23:49.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.606+0000 7f66c9c1f700 1 -- 172.21.15.49:0/74209562 shutdown_connections 2023-11-30T17:23:49.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.606+0000 7f66c9c1f700 1 --2- 172.21.15.49:0/74209562 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f66c40bef90 0x7f66c40c35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:49.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.606+0000 7f66c9c1f700 1 --2- 172.21.15.49:0/74209562 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66c40c6530 0x7f66c40640b0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:49.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.606+0000 7f66c9c1f700 1 -- 172.21.15.49:0/74209562 >> 172.21.15.49:0/74209562 conn(0x7f66c4092520 msgr2=0x7f66c4062ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:49.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.606+0000 7f66c9c1f700 1 -- 172.21.15.49:0/74209562 shutdown_connections 2023-11-30T17:23:49.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.606+0000 7f66c9c1f700 1 -- 172.21.15.49:0/74209562 wait complete. 2023-11-30T17:23:49.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.607+0000 7f66c9c1f700 1 Processor -- start 2023-11-30T17:23:49.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.607+0000 7f66c9c1f700 1 -- start start 2023-11-30T17:23:49.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.608+0000 7f66c9c1f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66c40bef90 0x7f66c4164860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:49.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.608+0000 7f66c9c1f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66c40c57e0 0x7f66c40c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:49.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.608+0000 7f66c9c1f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f66c40c6530 0x7f66c40c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:49.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.608+0000 7f66c9c1f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c40c0ff0 con 0x7f66c40c57e0 2023-11-30T17:23:49.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.608+0000 7f66c9c1f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c40c9ad0 con 0x7f66c40bef90 2023-11-30T17:23:49.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.608+0000 7f66c9c1f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c40c03e0 con 0x7f66c40c6530 2023-11-30T17:23:49.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.608+0000 7f66c3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66c40c57e0 0x7f66c40c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:49.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.608+0000 7f66c3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66c40c57e0 0x7f66c40c6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54772/0 (socket says 172.21.15.49:54772) 2023-11-30T17:23:49.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.608+0000 7f66c3fff700 1 -- 172.21.15.49:0/2538525621 learned_addr learned my addr 172.21.15.49:0/2538525621 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:23:49.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.608+0000 7f66c8c1d700 1 --2- 172.21.15.49:0/2538525621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66c40bef90 0x7f66c4164860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:49.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.608+0000 7f66c941e700 1 --2- 172.21.15.49:0/2538525621 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f66c40c6530 0x7f66c40c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:49.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.609+0000 7f66c3fff700 1 -- 172.21.15.49:0/2538525621 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f66c40c6530 msgr2=0x7f66c40c71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:49.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.609+0000 7f66c3fff700 1 --2- 172.21.15.49:0/2538525621 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f66c40c6530 0x7f66c40c71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:49.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.609+0000 7f66c3fff700 1 -- 172.21.15.49:0/2538525621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66c40bef90 msgr2=0x7f66c4164860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:49.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.609+0000 7f66c3fff700 1 --2- 172.21.15.49:0/2538525621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66c40bef90 0x7f66c4164860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:49.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.609+0000 7f66c3fff700 1 -- 172.21.15.49:0/2538525621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b40092a0 con 0x7f66c40c57e0 2023-11-30T17:23:49.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.609+0000 7f66c941e700 1 --2- 172.21.15.49:0/2538525621 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f66c40c6530 0x7f66c40c71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:23:49.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.609+0000 7f66c3fff700 1 --2- 172.21.15.49:0/2538525621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66c40c57e0 0x7f66c40c6cd0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7f66b800c4e0 tx=0x7f66b8007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:49.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.609+0000 7f66c0ff9700 1 -- 172.21.15.49:0/2538525621 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b80072e0 con 0x7f66c40c57e0 2023-11-30T17:23:49.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.609+0000 7f66c0ff9700 1 -- 172.21.15.49:0/2538525621 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b8007440 con 0x7f66c40c57e0 2023-11-30T17:23:49.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.609+0000 7f66c0ff9700 1 -- 172.21.15.49:0/2538525621 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b80057a0 con 0x7f66c40c57e0 2023-11-30T17:23:49.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.609+0000 7f66c9c1f700 1 -- 172.21.15.49:0/2538525621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c40c06c0 con 0x7f66c40c57e0 2023-11-30T17:23:49.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.609+0000 7f66c9c1f700 1 -- 172.21.15.49:0/2538525621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c40c0c80 con 0x7f66c40c57e0 2023-11-30T17:23:49.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.610+0000 7f66c9c1f700 1 -- 172.21.15.49:0/2538525621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c40c1160 con 0x7f66c40c57e0 2023-11-30T17:23:49.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.610+0000 7f66c0ff9700 1 -- 172.21.15.49:0/2538525621 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 43) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f66b8005bd0 con 0x7f66c40c57e0 2023-11-30T17:23:49.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.611+0000 7f66c0ff9700 1 --2- 172.21.15.49:0/2538525621 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f66b005f080 0x7f66b0061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:23:49.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.611+0000 7f66c0ff9700 1 -- 172.21.15.49:0/2538525621 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6407+0+0 (secure 0 0 0) 0x7f66b80798f0 con 0x7f66c40c57e0 2023-11-30T17:23:49.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.611+0000 7f66c8c1d700 1 --2- 172.21.15.49:0/2538525621 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f66b005f080 0x7f66b0061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:23:49.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.611+0000 7f66c8c1d700 1 --2- 172.21.15.49:0/2538525621 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f66b005f080 0x7f66b0061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f66b400b340 tx=0x7f66b4017000).ready entity=mgr.6362 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:23:49.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.615+0000 7f66c0ff9700 1 -- 172.21.15.49:0/2538525621 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f66b804ac70 con 0x7f66c40c57e0 2023-11-30T17:23:49.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.810+0000 7f66c9c1f700 1 -- 172.21.15.49:0/2538525621 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f66c406c7c0 con 0x7f66b005f080 2023-11-30T17:23:49.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.812+0000 7f66c0ff9700 1 -- 172.21.15.49:0/2538525621 <== mgr.6362 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+287 (secure 0 0 0) 0x7f66c406c7c0 con 0x7f66b005f080 2023-11-30T17:23:49.814 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:23:49.814 INFO:teuthology.orchestra.run.smithi049.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-11-30T00:00:00", "created": "2023-11-30T17:23:49", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-11-30T17:23:49.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.814+0000 7f66c9c1f700 1 -- 172.21.15.49:0/2538525621 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f66b005f080 msgr2=0x7f66b0061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:49.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.814+0000 7f66c9c1f700 1 --2- 172.21.15.49:0/2538525621 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f66b005f080 0x7f66b0061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f66b400b340 tx=0x7f66b4017000).stop 2023-11-30T17:23:49.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.814+0000 7f66c9c1f700 1 -- 172.21.15.49:0/2538525621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66c40c57e0 msgr2=0x7f66c40c6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:23:49.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.814+0000 7f66c9c1f700 1 --2- 172.21.15.49:0/2538525621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66c40c57e0 0x7f66c40c6cd0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7f66b800c4e0 tx=0x7f66b8007c70).stop 2023-11-30T17:23:49.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.814+0000 7f66c9c1f700 1 -- 172.21.15.49:0/2538525621 shutdown_connections 2023-11-30T17:23:49.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.814+0000 7f66c9c1f700 1 --2- 172.21.15.49:0/2538525621 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f66c40c6530 0x7f66c40c71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:49.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.814+0000 7f66c9c1f700 1 --2- 172.21.15.49:0/2538525621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66c40bef90 0x7f66c4164860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:49.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.814+0000 7f66c9c1f700 1 --2- 172.21.15.49:0/2538525621 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f66b005f080 0x7f66b0061540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:49.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.814+0000 7f66c9c1f700 1 --2- 172.21.15.49:0/2538525621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66c40c57e0 0x7f66c40c6cd0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:23:49.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.814+0000 7f66c9c1f700 1 -- 172.21.15.49:0/2538525621 >> 172.21.15.49:0/2538525621 conn(0x7f66c4092520 msgr2=0x7f66c40ac150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:23:49.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.814+0000 7f66c9c1f700 1 -- 172.21.15.49:0/2538525621 shutdown_connections 2023-11-30T17:23:49.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:23:49.814+0000 7f66c9c1f700 1 -- 172.21.15.49:0/2538525621 wait complete. 2023-11-30T17:23:49.828 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-11-30T00:00:00", "created": "2023-11-30T17:23:49", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-11-30T17:23:51.613 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:23:51.616 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:24:00.462 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:00.460+0000 7f9ac1e52700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:24:00.462 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:00.460+0000 7f9ac1e52700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:24:00.462 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:00.460+0000 7f9ac1e52700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:24:00.462 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:00.460+0000 7f9ac1e52700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:24:00.463 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:00.460+0000 7f9ac1e52700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:24:21.732 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:24:21.735 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:24:49.829 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-11-30T17:24:49.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.965+0000 7ffaa5457700 1 Processor -- start 2023-11-30T17:24:49.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.965+0000 7ffaa5457700 1 -- start start 2023-11-30T17:24:49.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.966+0000 7ffaa5457700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffaa00c6530 0x7ffaa00640b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:49.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.966+0000 7ffaa5457700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffaa00c57e0 0x7ffaa00be880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:49.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.966+0000 7ffaa5457700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ffaa00bed70 0x7ffaa01549a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:49.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.966+0000 7ffaa5457700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa0065680 con 0x7ffaa00c6530 2023-11-30T17:24:49.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.966+0000 7ffaa5457700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa00c6910 con 0x7ffaa00bed70 2023-11-30T17:24:49.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.966+0000 7ffaa5457700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa00bf1f0 con 0x7ffaa00c57e0 2023-11-30T17:24:49.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.966+0000 7ffa9ffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffaa00c6530 0x7ffaa00640b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:49.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.966+0000 7ffa9ffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffaa00c6530 0x7ffaa00640b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56472/0 (socket says 172.21.15.49:56472) 2023-11-30T17:24:49.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.966+0000 7ffa9ffff700 1 -- 172.21.15.49:0/3167238399 learned_addr learned my addr 172.21.15.49:0/3167238399 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:49.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.966+0000 7ffa9f7fe700 1 --2- 172.21.15.49:0/3167238399 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffaa00c57e0 0x7ffaa00be880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:49.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.966+0000 7ffaa4c56700 1 --2- 172.21.15.49:0/3167238399 >> v2:172.21.15.115:3300/0 conn(0x7ffaa00bed70 0x7ffaa01549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:49.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.967+0000 7ffa9ffff700 1 -- 172.21.15.49:0/3167238399 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffaa00c57e0 msgr2=0x7ffaa00be880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:24:49.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.967+0000 7ffa9ffff700 1 --2- 172.21.15.49:0/3167238399 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffaa00c57e0 0x7ffaa00be880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:49.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.967+0000 7ffa9ffff700 1 -- 172.21.15.49:0/3167238399 >> v2:172.21.15.115:3300/0 conn(0x7ffaa00bed70 msgr2=0x7ffaa01549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:24:49.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.967+0000 7ffa9ffff700 1 --2- 172.21.15.49:0/3167238399 >> v2:172.21.15.115:3300/0 conn(0x7ffaa00bed70 0x7ffaa01549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:49.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.967+0000 7ffa9ffff700 1 -- 172.21.15.49:0/3167238399 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa0064a00 con 0x7ffaa00c6530 2023-11-30T17:24:49.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.967+0000 7ffa9f7fe700 1 --2- 172.21.15.49:0/3167238399 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffaa00c57e0 0x7ffaa00be880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:24:49.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.967+0000 7ffaa4c56700 1 --2- 172.21.15.49:0/3167238399 >> v2:172.21.15.115:3300/0 conn(0x7ffaa00bed70 0x7ffaa01549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:24:49.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.967+0000 7ffa9ffff700 1 --2- 172.21.15.49:0/3167238399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffaa00c6530 0x7ffaa00640b0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7ffaa00c8e70 tx=0x7ffa900090f0).ready entity=mon.0 client_cookie=cb30dbe4bca8199 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:49.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.967+0000 7ffa9effd700 1 -- 172.21.15.49:0/3167238399 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9000b600 con 0x7ffaa00c6530 2023-11-30T17:24:49.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.967+0000 7ffa9effd700 1 -- 172.21.15.49:0/3167238399 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9000b760 con 0x7ffaa00c6530 2023-11-30T17:24:49.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.967+0000 7ffa9effd700 1 -- 172.21.15.49:0/3167238399 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9000bae0 con 0x7ffaa00c6530 2023-11-30T17:24:49.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.967+0000 7ffaa5457700 1 -- 172.21.15.49:0/3167238399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffaa00c6530 msgr2=0x7ffaa00640b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:49.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.967+0000 7ffaa5457700 1 --2- 172.21.15.49:0/3167238399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffaa00c6530 0x7ffaa00640b0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7ffaa00c8e70 tx=0x7ffa900090f0).stop 2023-11-30T17:24:49.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.967+0000 7ffaa5457700 1 -- 172.21.15.49:0/3167238399 shutdown_connections 2023-11-30T17:24:49.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.967+0000 7ffaa5457700 1 --2- 172.21.15.49:0/3167238399 >> v2:172.21.15.115:3300/0 conn(0x7ffaa00bed70 0x7ffaa01549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:49.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.967+0000 7ffaa5457700 1 --2- 172.21.15.49:0/3167238399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffaa00c6530 0x7ffaa00640b0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:49.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.967+0000 7ffaa5457700 1 --2- 172.21.15.49:0/3167238399 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffaa00c57e0 0x7ffaa00be880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:49.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.967+0000 7ffaa5457700 1 -- 172.21.15.49:0/3167238399 >> 172.21.15.49:0/3167238399 conn(0x7ffaa0092520 msgr2=0x7ffaa0062ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:49.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.967+0000 7ffaa5457700 1 -- 172.21.15.49:0/3167238399 shutdown_connections 2023-11-30T17:24:49.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.967+0000 7ffaa5457700 1 -- 172.21.15.49:0/3167238399 wait complete. 2023-11-30T17:24:49.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.969+0000 7ffaa5457700 1 Processor -- start 2023-11-30T17:24:49.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.969+0000 7ffaa5457700 1 -- start start 2023-11-30T17:24:49.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.969+0000 7ffaa5457700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffaa00bed70 0x7ffaa01586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:49.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.970+0000 7ffaa5457700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaa00c57e0 0x7ffaa0156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:49.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.970+0000 7ffaa5457700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffaa00c6530 0x7ffaa00c2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:49.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.970+0000 7ffaa5457700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa0158b90 con 0x7ffaa00c6530 2023-11-30T17:24:49.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.970+0000 7ffaa5457700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa0157600 con 0x7ffaa00c57e0 2023-11-30T17:24:49.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.970+0000 7ffaa5457700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa01578e0 con 0x7ffaa00bed70 2023-11-30T17:24:49.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.970+0000 7ffaa4c56700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffaa00c6530 0x7ffaa00c2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:49.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.970+0000 7ffaa4c56700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffaa00c6530 0x7ffaa00c2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56488/0 (socket says 172.21.15.49:56488) 2023-11-30T17:24:49.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.970+0000 7ffaa4c56700 1 -- 172.21.15.49:0/3862966280 learned_addr learned my addr 172.21.15.49:0/3862966280 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:49.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.970+0000 7ffa9f7fe700 1 --2- 172.21.15.49:0/3862966280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaa00c57e0 0x7ffaa0156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:49.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.970+0000 7ffa9ffff700 1 --2- 172.21.15.49:0/3862966280 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffaa00bed70 0x7ffaa01586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.970+0000 7ffaa4c56700 1 -- 172.21.15.49:0/3862966280 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffaa00bed70 msgr2=0x7ffaa01586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.970+0000 7ffaa4c56700 1 --2- 172.21.15.49:0/3862966280 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffaa00bed70 0x7ffaa01586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.970+0000 7ffaa4c56700 1 -- 172.21.15.49:0/3862966280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaa00c57e0 msgr2=0x7ffaa0156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.970+0000 7ffaa4c56700 1 --2- 172.21.15.49:0/3862966280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaa00c57e0 0x7ffaa0156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.970+0000 7ffaa4c56700 1 -- 172.21.15.49:0/3862966280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa90009370 con 0x7ffaa00c6530 2023-11-30T17:24:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.970+0000 7ffaa4c56700 1 --2- 172.21.15.49:0/3862966280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffaa00c6530 0x7ffaa00c2100 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7ffa9800cef0 tx=0x7ffa98007860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.970+0000 7ffa97fff700 1 -- 172.21.15.49:0/3862966280 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9800ad20 con 0x7ffaa00c6530 2023-11-30T17:24:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.970+0000 7ffa97fff700 1 -- 172.21.15.49:0/3862966280 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9800ae80 con 0x7ffaa00c6530 2023-11-30T17:24:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.970+0000 7ffaa5457700 1 -- 172.21.15.49:0/3862966280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa0157bc0 con 0x7ffaa00c6530 2023-11-30T17:24:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.970+0000 7ffa97fff700 1 -- 172.21.15.49:0/3862966280 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa98016610 con 0x7ffaa00c6530 2023-11-30T17:24:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.971+0000 7ffaa5457700 1 -- 172.21.15.49:0/3862966280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa0157f50 con 0x7ffaa00c6530 2023-11-30T17:24:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.971+0000 7ffaa5457700 1 -- 172.21.15.49:0/3862966280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa006c7c0 con 0x7ffaa00c6530 2023-11-30T17:24:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.972+0000 7ffa97fff700 1 -- 172.21.15.49:0/3862966280 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 45) v1 ==== 75679+0+0 (secure 0 0 0) 0x7ffa980203f0 con 0x7ffaa00c6530 2023-11-30T17:24:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.972+0000 7ffa97fff700 1 --2- 172.21.15.49:0/3862966280 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ffa8005f3e0 0x7ffa800618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.972+0000 7ffa97fff700 1 -- 172.21.15.49:0/3862966280 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6581+0+0 (secure 0 0 0) 0x7ffa9807b270 con 0x7ffaa00c6530 2023-11-30T17:24:49.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.973+0000 7ffa9ffff700 1 --2- 172.21.15.49:0/3862966280 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ffa8005f3e0 0x7ffa800618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:49.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.973+0000 7ffa9ffff700 1 --2- 172.21.15.49:0/3862966280 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ffa8005f3e0 0x7ffa800618a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ffa90009130 tx=0x7ffa90017000).ready entity=mgr.6362 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:49.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:49.976+0000 7ffa97fff700 1 -- 172.21.15.49:0/3862966280 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ffa9804bf00 con 0x7ffaa00c6530 2023-11-30T17:24:50.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.178+0000 7ffaa5457700 1 -- 172.21.15.49:0/3862966280 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffaa0064ce0 con 0x7ffa8005f3e0 2023-11-30T17:24:50.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.180+0000 7ffa97fff700 1 -- 172.21.15.49:0/3862966280 <== mgr.6362 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+288 (secure 0 0 0) 0x7ffaa0064ce0 con 0x7ffa8005f3e0 2023-11-30T17:24:50.182 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:24:50.182 INFO:teuthology.orchestra.run.smithi049.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-11-30T00:00:00", "created": "2023-11-30T17:23:49", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-11-30T17:24:50.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.182+0000 7ffaa5457700 1 -- 172.21.15.49:0/3862966280 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ffa8005f3e0 msgr2=0x7ffa800618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:50.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.182+0000 7ffaa5457700 1 --2- 172.21.15.49:0/3862966280 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ffa8005f3e0 0x7ffa800618a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ffa90009130 tx=0x7ffa90017000).stop 2023-11-30T17:24:50.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.182+0000 7ffaa5457700 1 -- 172.21.15.49:0/3862966280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffaa00c6530 msgr2=0x7ffaa00c2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:50.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.182+0000 7ffaa5457700 1 --2- 172.21.15.49:0/3862966280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffaa00c6530 0x7ffaa00c2100 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7ffa9800cef0 tx=0x7ffa98007860).stop 2023-11-30T17:24:50.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.182+0000 7ffaa5457700 1 -- 172.21.15.49:0/3862966280 shutdown_connections 2023-11-30T17:24:50.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.182+0000 7ffaa5457700 1 --2- 172.21.15.49:0/3862966280 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ffa8005f3e0 0x7ffa800618a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:50.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.182+0000 7ffaa5457700 1 --2- 172.21.15.49:0/3862966280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffaa00c6530 0x7ffaa00c2100 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:50.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.182+0000 7ffaa5457700 1 --2- 172.21.15.49:0/3862966280 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffaa00bed70 0x7ffaa01586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:50.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.182+0000 7ffaa5457700 1 --2- 172.21.15.49:0/3862966280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaa00c57e0 0x7ffaa0156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:50.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.182+0000 7ffaa5457700 1 -- 172.21.15.49:0/3862966280 >> 172.21.15.49:0/3862966280 conn(0x7ffaa0092520 msgr2=0x7ffaa00667c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:50.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.183+0000 7ffaa5457700 1 -- 172.21.15.49:0/3862966280 shutdown_connections 2023-11-30T17:24:50.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.183+0000 7ffaa5457700 1 -- 172.21.15.49:0/3862966280 wait complete. 2023-11-30T17:24:50.196 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-11-30T00:00:00", "created": "2023-11-30T17:23:49", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-11-30T17:24:50.196 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /bad-path 2023-11-30T17:24:50.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.316+0000 7faf29334700 1 Processor -- start 2023-11-30T17:24:50.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.316+0000 7faf29334700 1 -- start start 2023-11-30T17:24:50.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.317+0000 7faf29334700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faf24154610 0x7faf241582e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:50.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.317+0000 7faf29334700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7faf240ab3b0 0x7faf240c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:50.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.317+0000 7faf29334700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf24159210 con 0x7faf240aa1c0 2023-11-30T17:24:50.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.317+0000 7faf29334700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf240c0c70 con 0x7faf24154610 2023-11-30T17:24:50.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.317+0000 7faf29334700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf240c2110 con 0x7faf240ab3b0 2023-11-30T17:24:50.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.317+0000 7faf22ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faf24154610 0x7faf241582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:50.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.317+0000 7faf22ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faf24154610 0x7faf241582e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56494/0 (socket says 172.21.15.49:56494) 2023-11-30T17:24:50.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.317+0000 7faf22ffd700 1 -- 172.21.15.49:0/2409162889 learned_addr learned my addr 172.21.15.49:0/2409162889 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:50.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.318+0000 7faf227fc700 1 --2- 172.21.15.49:0/2409162889 >> v2:172.21.15.115:3300/0 conn(0x7faf240ab3b0 0x7faf240c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:50.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.318+0000 7faf22ffd700 1 -- 172.21.15.49:0/2409162889 >> v2:172.21.15.115:3300/0 conn(0x7faf240ab3b0 msgr2=0x7faf240c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:24:50.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.318+0000 7faf22ffd700 1 --2- 172.21.15.49:0/2409162889 >> v2:172.21.15.115:3300/0 conn(0x7faf240ab3b0 0x7faf240c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:50.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.318+0000 7faf22ffd700 1 -- 172.21.15.49:0/2409162889 >> v1:172.21.15.115:6789/0 conn(0x7faf240aa1c0 legacy=0x7faf24063550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:24:50.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.318+0000 7faf22ffd700 1 -- 172.21.15.49:0/2409162889 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf24158970 con 0x7faf24154610 2023-11-30T17:24:50.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.318+0000 7faf227fc700 1 --2- 172.21.15.49:0/2409162889 >> v2:172.21.15.115:3300/0 conn(0x7faf240ab3b0 0x7faf240c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:24:50.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.318+0000 7faf22ffd700 1 --2- 172.21.15.49:0/2409162889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf24154610 0x7faf241582e0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7faf240c5770 tx=0x7faf1c0090f0).ready entity=mon.0 client_cookie=36b38b19b0153eed server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:50.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.318+0000 7faf21ffb700 1 -- 172.21.15.49:0/2409162889 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c00b5a0 con 0x7faf24154610 2023-11-30T17:24:50.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.318+0000 7faf21ffb700 1 -- 172.21.15.49:0/2409162889 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1c00b700 con 0x7faf24154610 2023-11-30T17:24:50.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.318+0000 7faf21ffb700 1 -- 172.21.15.49:0/2409162889 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c00ba80 con 0x7faf24154610 2023-11-30T17:24:50.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.319+0000 7faf29334700 1 -- 172.21.15.49:0/2409162889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf24154610 msgr2=0x7faf241582e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:50.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.319+0000 7faf29334700 1 --2- 172.21.15.49:0/2409162889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf24154610 0x7faf241582e0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7faf240c5770 tx=0x7faf1c0090f0).stop 2023-11-30T17:24:50.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.319+0000 7faf29334700 1 -- 172.21.15.49:0/2409162889 shutdown_connections 2023-11-30T17:24:50.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.319+0000 7faf29334700 1 --2- 172.21.15.49:0/2409162889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf24154610 0x7faf241582e0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:50.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.319+0000 7faf29334700 1 --2- 172.21.15.49:0/2409162889 >> v2:172.21.15.115:3300/0 conn(0x7faf240ab3b0 0x7faf240c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:50.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.319+0000 7faf29334700 1 -- 172.21.15.49:0/2409162889 >> 172.21.15.49:0/2409162889 conn(0x7faf240655a0 msgr2=0x7faf24069e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:50.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.319+0000 7faf29334700 1 -- 172.21.15.49:0/2409162889 shutdown_connections 2023-11-30T17:24:50.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.319+0000 7faf29334700 1 -- 172.21.15.49:0/2409162889 wait complete. 2023-11-30T17:24:50.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.320+0000 7faf29334700 1 Processor -- start 2023-11-30T17:24:50.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.320+0000 7faf29334700 1 -- start start 2023-11-30T17:24:50.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.321+0000 7faf29334700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf240aa1c0 0x7faf240c2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:50.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.321+0000 7faf29334700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf24154610 0x7faf24168d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:50.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.321+0000 7faf29334700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf240ae1f0 0x7faf24144b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:50.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.321+0000 7faf29334700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf240af300 con 0x7faf24154610 2023-11-30T17:24:50.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.321+0000 7faf29334700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf24156c50 con 0x7faf240ae1f0 2023-11-30T17:24:50.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.321+0000 7faf29334700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf240ae680 con 0x7faf240aa1c0 2023-11-30T17:24:50.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.321+0000 7faf227fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf24154610 0x7faf24168d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:50.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.321+0000 7faf227fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf24154610 0x7faf24168d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56504/0 (socket says 172.21.15.49:56504) 2023-11-30T17:24:50.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.321+0000 7faf227fc700 1 -- 172.21.15.49:0/3498427478 learned_addr learned my addr 172.21.15.49:0/3498427478 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:50.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.321+0000 7faf22ffd700 1 --2- 172.21.15.49:0/3498427478 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf240aa1c0 0x7faf240c2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:50.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.321+0000 7faf237fe700 1 --2- 172.21.15.49:0/3498427478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf240ae1f0 0x7faf24144b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:50.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.321+0000 7faf227fc700 1 -- 172.21.15.49:0/3498427478 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf240aa1c0 msgr2=0x7faf240c2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:50.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.321+0000 7faf227fc700 1 --2- 172.21.15.49:0/3498427478 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf240aa1c0 0x7faf240c2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:50.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.321+0000 7faf227fc700 1 -- 172.21.15.49:0/3498427478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf240ae1f0 msgr2=0x7faf24144b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:50.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.321+0000 7faf227fc700 1 --2- 172.21.15.49:0/3498427478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf240ae1f0 0x7faf24144b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:50.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.321+0000 7faf227fc700 1 -- 172.21.15.49:0/3498427478 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1c009370 con 0x7faf24154610 2023-11-30T17:24:50.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.321+0000 7faf237fe700 1 --2- 172.21.15.49:0/3498427478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf240ae1f0 0x7faf24144b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:24:50.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.321+0000 7faf227fc700 1 --2- 172.21.15.49:0/3498427478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf24154610 0x7faf24168d70 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7faf0c00c8b0 tx=0x7faf0c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:50.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.321+0000 7faf1affd700 1 -- 172.21.15.49:0/3498427478 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c010580 con 0x7faf24154610 2023-11-30T17:24:50.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.322+0000 7faf1affd700 1 -- 172.21.15.49:0/3498427478 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0c0106e0 con 0x7faf24154610 2023-11-30T17:24:50.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.322+0000 7faf29334700 1 -- 172.21.15.49:0/3498427478 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf240ae960 con 0x7faf24154610 2023-11-30T17:24:50.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.322+0000 7faf1affd700 1 -- 172.21.15.49:0/3498427478 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c010a60 con 0x7faf24154610 2023-11-30T17:24:50.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.322+0000 7faf29334700 1 -- 172.21.15.49:0/3498427478 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf240aef20 con 0x7faf24154610 2023-11-30T17:24:50.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.323+0000 7faf29334700 1 -- 172.21.15.49:0/3498427478 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf240af440 con 0x7faf24154610 2023-11-30T17:24:50.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.323+0000 7faf1affd700 1 -- 172.21.15.49:0/3498427478 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 45) v1 ==== 75679+0+0 (secure 0 0 0) 0x7faf0c01b460 con 0x7faf24154610 2023-11-30T17:24:50.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.323+0000 7faf1affd700 1 --2- 172.21.15.49:0/3498427478 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faf0405f3e0 0x7faf040618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:50.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.323+0000 7faf1affd700 1 -- 172.21.15.49:0/3498427478 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6581+0+0 (secure 0 0 0) 0x7faf0c07a950 con 0x7faf24154610 2023-11-30T17:24:50.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.323+0000 7faf22ffd700 1 --2- 172.21.15.49:0/3498427478 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faf0405f3e0 0x7faf040618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:50.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.324+0000 7faf22ffd700 1 --2- 172.21.15.49:0/3498427478 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faf0405f3e0 0x7faf040618a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7faf1c009130 tx=0x7faf1c015000).ready entity=mgr.6362 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:50.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.327+0000 7faf1affd700 1 -- 172.21.15.49:0/3498427478 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7faf240af440 con 0x7faf24154610 2023-11-30T17:24:50.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.531+0000 7faf29334700 1 -- 172.21.15.49:0/3498427478 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""]}) v1 -- 0x7faf240af440 con 0x7faf0405f3e0 2023-11-30T17:24:50.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.535+0000 7faf1affd700 1 -- 172.21.15.49:0/3498427478 <== mgr.6362 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+36 (secure 0 0 0) 0x7faf240af440 con 0x7faf0405f3e0 2023-11-30T17:24:50.537 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule removed for path /bad-path 2023-11-30T17:24:50.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.537+0000 7faf29334700 1 -- 172.21.15.49:0/3498427478 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faf0405f3e0 msgr2=0x7faf040618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:50.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.537+0000 7faf29334700 1 --2- 172.21.15.49:0/3498427478 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faf0405f3e0 0x7faf040618a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7faf1c009130 tx=0x7faf1c015000).stop 2023-11-30T17:24:50.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.537+0000 7faf29334700 1 -- 172.21.15.49:0/3498427478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf24154610 msgr2=0x7faf24168d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:50.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.537+0000 7faf29334700 1 --2- 172.21.15.49:0/3498427478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf24154610 0x7faf24168d70 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7faf0c00c8b0 tx=0x7faf0c008040).stop 2023-11-30T17:24:50.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.537+0000 7faf29334700 1 -- 172.21.15.49:0/3498427478 shutdown_connections 2023-11-30T17:24:50.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.537+0000 7faf29334700 1 --2- 172.21.15.49:0/3498427478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf240ae1f0 0x7faf24144b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:50.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.537+0000 7faf29334700 1 --2- 172.21.15.49:0/3498427478 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf240aa1c0 0x7faf240c2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:50.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.537+0000 7faf29334700 1 --2- 172.21.15.49:0/3498427478 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faf0405f3e0 0x7faf040618a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:50.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.537+0000 7faf29334700 1 --2- 172.21.15.49:0/3498427478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf24154610 0x7faf24168d70 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:50.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.537+0000 7faf29334700 1 -- 172.21.15.49:0/3498427478 >> 172.21.15.49:0/3498427478 conn(0x7faf240655a0 msgr2=0x7faf240ad8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:50.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.537+0000 7faf29334700 1 -- 172.21.15.49:0/3498427478 shutdown_connections 2023-11-30T17:24:50.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.537+0000 7faf29334700 1 -- 172.21.15.49:0/3498427478 wait complete. 2023-11-30T17:24:50.550 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /bad-path 2023-11-30T17:24:50.551 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-11-30T17:24:50.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.669+0000 7fcc8a258700 1 Processor -- start 2023-11-30T17:24:50.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.669+0000 7fcc8a258700 1 -- start start 2023-11-30T17:24:50.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.670+0000 7fcc8a258700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcc84066e10 0x7fcc8413d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:50.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.670+0000 7fcc8a258700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcc8413d940 0x7fcc84063810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:50.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.670+0000 7fcc8a258700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc841586a0 con 0x7fcc84066a30 2023-11-30T17:24:50.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.670+0000 7fcc8a258700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc84157de0 con 0x7fcc84066e10 2023-11-30T17:24:50.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.670+0000 7fcc8a258700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc840c7140 con 0x7fcc8413d940 2023-11-30T17:24:50.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.670+0000 7fcc88a55700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcc84066e10 0x7fcc8413d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:50.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.670+0000 7fcc88a55700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcc84066e10 0x7fcc8413d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45100/0 (socket says 172.21.15.49:45100) 2023-11-30T17:24:50.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.670+0000 7fcc88a55700 1 -- 172.21.15.49:0/1014407598 learned_addr learned my addr 172.21.15.49:0/1014407598 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:50.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.670+0000 7fcc89a57700 1 --2- 172.21.15.49:0/1014407598 >> v2:172.21.15.115:3300/0 conn(0x7fcc8413d940 0x7fcc84063810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:50.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.670+0000 7fcc88a55700 1 -- 172.21.15.49:0/1014407598 >> v2:172.21.15.115:3300/0 conn(0x7fcc8413d940 msgr2=0x7fcc84063810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:24:50.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.670+0000 7fcc88a55700 1 --2- 172.21.15.49:0/1014407598 >> v2:172.21.15.115:3300/0 conn(0x7fcc8413d940 0x7fcc84063810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:50.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.670+0000 7fcc88a55700 1 -- 172.21.15.49:0/1014407598 >> v1:172.21.15.115:6789/0 conn(0x7fcc84066a30 legacy=0x7fcc840c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:50.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.670+0000 7fcc88a55700 1 -- 172.21.15.49:0/1014407598 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc84158050 con 0x7fcc84066e10 2023-11-30T17:24:50.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.670+0000 7fcc89a57700 1 --2- 172.21.15.49:0/1014407598 >> v2:172.21.15.115:3300/0 conn(0x7fcc8413d940 0x7fcc84063810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:24:50.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.671+0000 7fcc88a55700 1 --2- 172.21.15.49:0/1014407598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc84066e10 0x7fcc8413d450 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7fcc84158610 tx=0x7fcc780090f0).ready entity=mon.0 client_cookie=37f27c9b41dc5423 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:50.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.671+0000 7fcc83fff700 1 -- 172.21.15.49:0/1014407598 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7800b600 con 0x7fcc84066e10 2023-11-30T17:24:50.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.671+0000 7fcc83fff700 1 -- 172.21.15.49:0/1014407598 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7800b760 con 0x7fcc84066e10 2023-11-30T17:24:50.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.671+0000 7fcc83fff700 1 -- 172.21.15.49:0/1014407598 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7800bae0 con 0x7fcc84066e10 2023-11-30T17:24:50.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.671+0000 7fcc8a258700 1 -- 172.21.15.49:0/1014407598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc84066e10 msgr2=0x7fcc8413d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:50.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.671+0000 7fcc8a258700 1 --2- 172.21.15.49:0/1014407598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc84066e10 0x7fcc8413d450 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7fcc84158610 tx=0x7fcc780090f0).stop 2023-11-30T17:24:50.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.671+0000 7fcc8a258700 1 -- 172.21.15.49:0/1014407598 shutdown_connections 2023-11-30T17:24:50.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.671+0000 7fcc8a258700 1 --2- 172.21.15.49:0/1014407598 >> v2:172.21.15.115:3300/0 conn(0x7fcc8413d940 0x7fcc84063810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:50.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.671+0000 7fcc8a258700 1 --2- 172.21.15.49:0/1014407598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc84066e10 0x7fcc8413d450 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:50.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.671+0000 7fcc8a258700 1 -- 172.21.15.49:0/1014407598 >> 172.21.15.49:0/1014407598 conn(0x7fcc840c8ed0 msgr2=0x7fcc840c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:50.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.671+0000 7fcc8a258700 1 -- 172.21.15.49:0/1014407598 shutdown_connections 2023-11-30T17:24:50.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.671+0000 7fcc8a258700 1 -- 172.21.15.49:0/1014407598 wait complete. 2023-11-30T17:24:50.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.672+0000 7fcc8a258700 1 Processor -- start 2023-11-30T17:24:50.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.673+0000 7fcc8a258700 1 -- start start 2023-11-30T17:24:50.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.673+0000 7fcc8a258700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc84066a30 0x7fcc84168690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:50.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.673+0000 7fcc8a258700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc84066e10 0x7fcc84163e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:50.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.673+0000 7fcc8a258700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc8413d940 0x7fcc84157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:50.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.673+0000 7fcc8a258700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc840c3ce0 con 0x7fcc8413d940 2023-11-30T17:24:50.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.673+0000 7fcc8a258700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc841544e0 con 0x7fcc84066e10 2023-11-30T17:24:50.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.673+0000 7fcc8a258700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc84168b80 con 0x7fcc84066a30 2023-11-30T17:24:50.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.674+0000 7fcc89a57700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc8413d940 0x7fcc84157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:50.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.674+0000 7fcc89a57700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc8413d940 0x7fcc84157200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45110/0 (socket says 172.21.15.49:45110) 2023-11-30T17:24:50.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.674+0000 7fcc89a57700 1 -- 172.21.15.49:0/741752092 learned_addr learned my addr 172.21.15.49:0/741752092 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:50.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.674+0000 7fcc88a55700 1 --2- 172.21.15.49:0/741752092 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc84066e10 0x7fcc84163e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:50.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.674+0000 7fcc89256700 1 --2- 172.21.15.49:0/741752092 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc84066a30 0x7fcc84168690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:50.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.674+0000 7fcc89a57700 1 -- 172.21.15.49:0/741752092 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc84066a30 msgr2=0x7fcc84168690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:50.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.674+0000 7fcc89a57700 1 --2- 172.21.15.49:0/741752092 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc84066a30 0x7fcc84168690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:50.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.674+0000 7fcc89a57700 1 -- 172.21.15.49:0/741752092 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc84066e10 msgr2=0x7fcc84163e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:50.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.674+0000 7fcc89a57700 1 --2- 172.21.15.49:0/741752092 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc84066e10 0x7fcc84163e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:50.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.674+0000 7fcc89a57700 1 -- 172.21.15.49:0/741752092 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc78009370 con 0x7fcc8413d940 2023-11-30T17:24:50.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.674+0000 7fcc88a55700 1 --2- 172.21.15.49:0/741752092 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc84066e10 0x7fcc84163e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:24:50.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.674+0000 7fcc89a57700 1 --2- 172.21.15.49:0/741752092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc8413d940 0x7fcc84157200 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7fcc7400d680 tx=0x7fcc74008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:50.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.674+0000 7fcc817fa700 1 -- 172.21.15.49:0/741752092 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc74011590 con 0x7fcc8413d940 2023-11-30T17:24:50.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.674+0000 7fcc817fa700 1 -- 172.21.15.49:0/741752092 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc740116f0 con 0x7fcc8413d940 2023-11-30T17:24:50.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.674+0000 7fcc8a258700 1 -- 172.21.15.49:0/741752092 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc840c17b0 con 0x7fcc8413d940 2023-11-30T17:24:50.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.674+0000 7fcc817fa700 1 -- 172.21.15.49:0/741752092 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc74011a70 con 0x7fcc8413d940 2023-11-30T17:24:50.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.674+0000 7fcc8a258700 1 -- 172.21.15.49:0/741752092 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc840c1d70 con 0x7fcc8413d940 2023-11-30T17:24:50.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.675+0000 7fcc8a258700 1 -- 172.21.15.49:0/741752092 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc8406c7c0 con 0x7fcc8413d940 2023-11-30T17:24:50.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.675+0000 7fcc817fa700 1 -- 172.21.15.49:0/741752092 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 45) v1 ==== 75679+0+0 (secure 0 0 0) 0x7fcc74012420 con 0x7fcc8413d940 2023-11-30T17:24:50.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.676+0000 7fcc817fa700 1 --2- 172.21.15.49:0/741752092 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcc7005f3e0 0x7fcc700618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:50.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.676+0000 7fcc817fa700 1 -- 172.21.15.49:0/741752092 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6581+0+0 (secure 0 0 0) 0x7fcc7407a270 con 0x7fcc8413d940 2023-11-30T17:24:50.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.676+0000 7fcc89256700 1 --2- 172.21.15.49:0/741752092 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcc7005f3e0 0x7fcc700618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:50.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.676+0000 7fcc89256700 1 --2- 172.21.15.49:0/741752092 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcc7005f3e0 0x7fcc700618a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fcc7c003e70 tx=0x7fcc7c009040).ready entity=mgr.6362 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:50.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.680+0000 7fcc817fa700 1 -- 172.21.15.49:0/741752092 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcc7404b010 con 0x7fcc8413d940 2023-11-30T17:24:50.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:50.898+0000 7fcc8a258700 1 -- 172.21.15.49:0/741752092 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fcc840674f0 con 0x7fcc8413d940 2023-11-30T17:24:51.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.038+0000 7fcc817fa700 1 -- 172.21.15.49:0/741752092 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 46) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fcc74077b70 con 0x7fcc8413d940 2023-11-30T17:24:51.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.039+0000 7fcc817fa700 1 -- 172.21.15.49:0/741752092 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v46) v1 ==== 93+0+0 (secure 0 0 0) 0x7fcc74072480 con 0x7fcc8413d940 2023-11-30T17:24:51.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.041+0000 7fcc8a258700 1 -- 172.21.15.49:0/741752092 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcc7005f3e0 msgr2=0x7fcc700618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:51.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.041+0000 7fcc8a258700 1 --2- 172.21.15.49:0/741752092 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcc7005f3e0 0x7fcc700618a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fcc7c003e70 tx=0x7fcc7c009040).stop 2023-11-30T17:24:51.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.042+0000 7fcc8a258700 1 -- 172.21.15.49:0/741752092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc8413d940 msgr2=0x7fcc84157200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:51.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.042+0000 7fcc8a258700 1 --2- 172.21.15.49:0/741752092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc8413d940 0x7fcc84157200 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7fcc7400d680 tx=0x7fcc74008040).stop 2023-11-30T17:24:51.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.042+0000 7fcc8a258700 1 -- 172.21.15.49:0/741752092 shutdown_connections 2023-11-30T17:24:51.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.042+0000 7fcc8a258700 1 --2- 172.21.15.49:0/741752092 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcc7005f3e0 0x7fcc700618a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:51.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.042+0000 7fcc8a258700 1 --2- 172.21.15.49:0/741752092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc8413d940 0x7fcc84157200 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:51.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.042+0000 7fcc8a258700 1 --2- 172.21.15.49:0/741752092 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc84066a30 0x7fcc84168690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:51.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.042+0000 7fcc8a258700 1 --2- 172.21.15.49:0/741752092 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc84066e10 0x7fcc84163e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:51.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.042+0000 7fcc8a258700 1 -- 172.21.15.49:0/741752092 >> 172.21.15.49:0/741752092 conn(0x7fcc840c8ed0 msgr2=0x7fcc8413bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:51.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.042+0000 7fcc8a258700 1 -- 172.21.15.49:0/741752092 shutdown_connections 2023-11-30T17:24:51.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.042+0000 7fcc8a258700 1 -- 172.21.15.49:0/741752092 wait complete. 2023-11-30T17:24:51.056 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-30T17:24:51.056 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T17:24:51.096 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T17:24:51.138 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-30T17:24:51.139 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-30T17:24:51.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:24:51.139 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-30T17:24:51.185 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-11-30T17:24:51.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:24:51.185 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-30T17:24:51.186 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:24:51.185+0000 7fd306e37680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T17:24:51.191 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:51.190+0000 7f32a4990680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T17:24:51.201 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:24:51.252 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:24:51.251+0000 7fd306e37680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T17:24:51.254 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:51.252+0000 7f32a4990680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T17:24:51.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.360+0000 7fd50eda0700 1 Processor -- start 2023-11-30T17:24:51.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.361+0000 7fd50eda0700 1 -- start start 2023-11-30T17:24:51.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.361+0000 7fd50eda0700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd508157680 0x7fd50806b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:51.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.361+0000 7fd50eda0700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd508157a60 0x7fd5080c1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:51.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.361+0000 7fd50eda0700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd508062f60 con 0x7fd5080c45f0 2023-11-30T17:24:51.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.361+0000 7fd50eda0700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd508062700 con 0x7fd508157a60 2023-11-30T17:24:51.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.361+0000 7fd50eda0700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5080c1f30 con 0x7fd508157680 2023-11-30T17:24:51.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.362+0000 7fd50d59d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd508157a60 0x7fd5080c1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:51.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.362+0000 7fd50d59d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd508157a60 0x7fd5080c1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45122/0 (socket says 172.21.15.49:45122) 2023-11-30T17:24:51.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.362+0000 7fd50d59d700 1 -- 172.21.15.49:0/3687019513 learned_addr learned my addr 172.21.15.49:0/3687019513 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:51.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.362+0000 7fd50dd9e700 1 --2- 172.21.15.49:0/3687019513 >> v2:172.21.15.115:3300/0 conn(0x7fd508157680 0x7fd50806b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:51.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.362+0000 7fd50d59d700 1 -- 172.21.15.49:0/3687019513 >> v2:172.21.15.115:3300/0 conn(0x7fd508157680 msgr2=0x7fd50806b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:24:51.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.362+0000 7fd50d59d700 1 --2- 172.21.15.49:0/3687019513 >> v2:172.21.15.115:3300/0 conn(0x7fd508157680 0x7fd50806b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:51.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.362+0000 7fd50d59d700 1 -- 172.21.15.49:0/3687019513 >> v1:172.21.15.115:6789/0 conn(0x7fd5080c45f0 legacy=0x7fd508068c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:51.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.362+0000 7fd50d59d700 1 -- 172.21.15.49:0/3687019513 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd508069f80 con 0x7fd508157a60 2023-11-30T17:24:51.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.362+0000 7fd50d59d700 1 --2- 172.21.15.49:0/3687019513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd508157a60 0x7fd5080c1a40 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7fd50806c470 tx=0x7fd4fc0090f0).ready entity=mon.0 client_cookie=94528a451c9faaa1 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:51.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.362+0000 7fd50cd9c700 1 -- 172.21.15.49:0/3687019513 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc00b520 con 0x7fd508157a60 2023-11-30T17:24:51.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.362+0000 7fd50cd9c700 1 -- 172.21.15.49:0/3687019513 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4fc00b680 con 0x7fd508157a60 2023-11-30T17:24:51.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.362+0000 7fd50cd9c700 1 -- 172.21.15.49:0/3687019513 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc00ba00 con 0x7fd508157a60 2023-11-30T17:24:51.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.363+0000 7fd50eda0700 1 -- 172.21.15.49:0/3687019513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd508157a60 msgr2=0x7fd5080c1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:51.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.363+0000 7fd50eda0700 1 --2- 172.21.15.49:0/3687019513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd508157a60 0x7fd5080c1a40 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7fd50806c470 tx=0x7fd4fc0090f0).stop 2023-11-30T17:24:51.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.363+0000 7fd50eda0700 1 -- 172.21.15.49:0/3687019513 shutdown_connections 2023-11-30T17:24:51.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.363+0000 7fd50eda0700 1 --2- 172.21.15.49:0/3687019513 >> v2:172.21.15.115:3300/0 conn(0x7fd508157680 0x7fd50806b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:51.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.363+0000 7fd50eda0700 1 --2- 172.21.15.49:0/3687019513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd508157a60 0x7fd5080c1a40 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:51.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.363+0000 7fd50eda0700 1 -- 172.21.15.49:0/3687019513 >> 172.21.15.49:0/3687019513 conn(0x7fd5080c7eb0 msgr2=0x7fd5080c3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:51.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.363+0000 7fd50eda0700 1 -- 172.21.15.49:0/3687019513 shutdown_connections 2023-11-30T17:24:51.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.363+0000 7fd50eda0700 1 -- 172.21.15.49:0/3687019513 wait complete. 2023-11-30T17:24:51.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.364+0000 7fd50eda0700 1 Processor -- start 2023-11-30T17:24:51.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.364+0000 7fd50eda0700 1 -- start start 2023-11-30T17:24:51.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.365+0000 7fd50eda0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5080c45f0 0x7fd508149400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:51.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.365+0000 7fd50eda0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd508157680 0x7fd5080bd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:51.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.365+0000 7fd50eda0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd508157a60 0x7fd5080bdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:51.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.365+0000 7fd50eda0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5080bf4f0 con 0x7fd5080c45f0 2023-11-30T17:24:51.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.365+0000 7fd50eda0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5080be130 con 0x7fd508157a60 2023-11-30T17:24:51.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.365+0000 7fd50eda0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5080be4e0 con 0x7fd508157680 2023-11-30T17:24:51.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.365+0000 7fd50dd9e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5080c45f0 0x7fd508149400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:51.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.365+0000 7fd50dd9e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5080c45f0 0x7fd508149400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45124/0 (socket says 172.21.15.49:45124) 2023-11-30T17:24:51.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.365+0000 7fd50dd9e700 1 -- 172.21.15.49:0/3705825928 learned_addr learned my addr 172.21.15.49:0/3705825928 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:51.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.365+0000 7fd50e59f700 1 --2- 172.21.15.49:0/3705825928 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd508157a60 0x7fd5080bdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:51.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.365+0000 7fd50d59d700 1 --2- 172.21.15.49:0/3705825928 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd508157680 0x7fd5080bd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:51.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.365+0000 7fd50dd9e700 1 -- 172.21.15.49:0/3705825928 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd508157680 msgr2=0x7fd5080bd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:51.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.365+0000 7fd50dd9e700 1 --2- 172.21.15.49:0/3705825928 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd508157680 0x7fd5080bd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:51.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.365+0000 7fd50dd9e700 1 -- 172.21.15.49:0/3705825928 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd508157a60 msgr2=0x7fd5080bdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:51.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.365+0000 7fd50dd9e700 1 --2- 172.21.15.49:0/3705825928 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd508157a60 0x7fd5080bdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:51.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.365+0000 7fd50dd9e700 1 -- 172.21.15.49:0/3705825928 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4fc009370 con 0x7fd5080c45f0 2023-11-30T17:24:51.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.365+0000 7fd50e59f700 1 --2- 172.21.15.49:0/3705825928 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd508157a60 0x7fd5080bdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:24:51.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.366+0000 7fd50dd9e700 1 --2- 172.21.15.49:0/3705825928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5080c45f0 0x7fd508149400 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7fd50400e980 tx=0x7fd504009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:51.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.366+0000 7fd4f9ffb700 1 -- 172.21.15.49:0/3705825928 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd504012600 con 0x7fd5080c45f0 2023-11-30T17:24:51.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.366+0000 7fd4f9ffb700 1 -- 172.21.15.49:0/3705825928 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd504012760 con 0x7fd5080c45f0 2023-11-30T17:24:51.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.366+0000 7fd50eda0700 1 -- 172.21.15.49:0/3705825928 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5080bf060 con 0x7fd5080c45f0 2023-11-30T17:24:51.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.366+0000 7fd4f9ffb700 1 -- 172.21.15.49:0/3705825928 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd504012ae0 con 0x7fd5080c45f0 2023-11-30T17:24:51.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.366+0000 7fd50eda0700 1 -- 172.21.15.49:0/3705825928 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5080bea10 con 0x7fd5080c45f0 2023-11-30T17:24:51.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.367+0000 7fd50eda0700 1 -- 172.21.15.49:0/3705825928 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd508068760 con 0x7fd5080c45f0 2023-11-30T17:24:51.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.367+0000 7fd4f9ffb700 1 -- 172.21.15.49:0/3705825928 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 46) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fd50401b400 con 0x7fd5080c45f0 2023-11-30T17:24:51.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.368+0000 7fd4f9ffb700 1 --2- 172.21.15.49:0/3705825928 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd4ec05f390 0x7fd4ec061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:51.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.368+0000 7fd4f9ffb700 1 -- 172.21.15.49:0/3705825928 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6581+0+0 (secure 0 0 0) 0x7fd50407abd0 con 0x7fd5080c45f0 2023-11-30T17:24:51.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.368+0000 7fd50d59d700 1 -- 172.21.15.49:0/3705825928 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd4ec05f390 msgr2=0x7fd4ec061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:24:51.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.368+0000 7fd50d59d700 1 --2- 172.21.15.49:0/3705825928 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd4ec05f390 0x7fd4ec061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:24:51.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.372+0000 7fd4f9ffb700 1 -- 172.21.15.49:0/3705825928 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd50404b970 con 0x7fd5080c45f0 2023-11-30T17:24:51.530 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:51.527+0000 7f32a4990680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T17:24:51.546 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:24:51.543+0000 7fd306e37680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T17:24:51.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.569+0000 7fd50d59d700 1 -- 172.21.15.49:0/3705825928 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd4ec05f390 msgr2=0x7fd4ec061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:24:51.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.569+0000 7fd50d59d700 1 --2- 172.21.15.49:0/3705825928 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd4ec05f390 0x7fd4ec061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:24:51.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.593+0000 7fd50eda0700 1 -- 172.21.15.49:0/3705825928 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd50806c7c0 con 0x7fd5080c45f0 2023-11-30T17:24:51.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.594+0000 7fd4f9ffb700 1 -- 172.21.15.49:0/3705825928 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4497 (secure 0 0 0) 0x7fd504016070 con 0x7fd5080c45f0 2023-11-30T17:24:51.596 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:24:51.596 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1725128963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1725128963},{"type":"v1","addr":"172.21.15.115:6836","nonce":1725128963}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6955,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3975305695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3975305695},{"type":"v1","addr":"172.21.15.115:6837","nonce":3975305695}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/2909602857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2909602857},{"type":"v1","addr":"172.21.15.49:6834","nonce":2909602857}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:23:31.943367+0000","modified":"2023-11-30T17:23:34.949501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7137},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7137":{"gid":7137,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1751656884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1751656884},{"type":"v1","addr":"172.21.15.49:6835","nonce":1751656884}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-11-30T17:24:51.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.596+0000 7fd50eda0700 1 -- 172.21.15.49:0/3705825928 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd4ec05f390 msgr2=0x7fd4ec061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:24:51.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.596+0000 7fd50eda0700 1 --2- 172.21.15.49:0/3705825928 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd4ec05f390 0x7fd4ec061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:24:51.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.596+0000 7fd50eda0700 1 -- 172.21.15.49:0/3705825928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5080c45f0 msgr2=0x7fd508149400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:51.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.596+0000 7fd50eda0700 1 --2- 172.21.15.49:0/3705825928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5080c45f0 0x7fd508149400 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7fd50400e980 tx=0x7fd504009060).stop 2023-11-30T17:24:51.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.596+0000 7fd50eda0700 1 -- 172.21.15.49:0/3705825928 shutdown_connections 2023-11-30T17:24:51.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.596+0000 7fd50eda0700 1 --2- 172.21.15.49:0/3705825928 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd508157a60 0x7fd5080bdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:51.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.596+0000 7fd50eda0700 1 --2- 172.21.15.49:0/3705825928 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd4ec05f390 0x7fd4ec061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:24:51.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.596+0000 7fd50eda0700 1 --2- 172.21.15.49:0/3705825928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5080c45f0 0x7fd508149400 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:51.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.596+0000 7fd50eda0700 1 --2- 172.21.15.49:0/3705825928 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd508157680 0x7fd5080bd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:51.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.596+0000 7fd50eda0700 1 -- 172.21.15.49:0/3705825928 >> 172.21.15.49:0/3705825928 conn(0x7fd5080c7eb0 msgr2=0x7fd508152240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:51.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.596+0000 7fd50eda0700 1 -- 172.21.15.49:0/3705825928 shutdown_connections 2023-11-30T17:24:51.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.596+0000 7fd50eda0700 1 -- 172.21.15.49:0/3705825928 wait complete. 2023-11-30T17:24:51.600 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 46 2023-11-30T17:24:51.611 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:24:51.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.769+0000 7fd9ad98e700 1 Processor -- start 2023-11-30T17:24:51.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.769+0000 7fd9ad98e700 1 -- start start 2023-11-30T17:24:51.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.770+0000 7fd9ad98e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd9a80caab0 0x7fd9a80aa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:51.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.770+0000 7fd9ad98e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a80a9a90 con 0x7fd9a80cae90 2023-11-30T17:24:51.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.770+0000 7fd9ad98e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a8154ce0 con 0x7fd9a80ca180 2023-11-30T17:24:51.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.770+0000 7fd9ad98e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9a80a8e80 con 0x7fd9a80caab0 2023-11-30T17:24:51.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.770+0000 7fd9a6ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd9a80caab0 0x7fd9a80aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:51.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.770+0000 7fd9a6ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd9a80caab0 0x7fd9a80aa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45126/0 (socket says 172.21.15.49:45126) 2023-11-30T17:24:51.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.770+0000 7fd9a6ffd700 1 -- 172.21.15.49:0/3037823873 learned_addr learned my addr 172.21.15.49:0/3037823873 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:51.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.770+0000 7fd9a67fc700 1 --1- 172.21.15.49:0/3037823873 >> v1:172.21.15.49:6789/0 conn(0x7fd9a80cae90 0x7fd9a80c0ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33300/0 (socket says 172.21.15.49:33300) 2023-11-30T17:24:51.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.770+0000 7fd9a6ffd700 1 -- 172.21.15.49:0/3037823873 >> v1:172.21.15.115:6789/0 conn(0x7fd9a80ca180 legacy=0x7fd9a815e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:51.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.770+0000 7fd9a6ffd700 1 -- 172.21.15.49:0/3037823873 >> v1:172.21.15.49:6789/0 conn(0x7fd9a80cae90 legacy=0x7fd9a80c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:51.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.770+0000 7fd9a5ffb700 1 -- 172.21.15.49:0/3037823873 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 818603 0 0) 0x7fd9a80a9a90 con 0x7fd9a80cae90 2023-11-30T17:24:51.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.770+0000 7fd9a6ffd700 1 -- 172.21.15.49:0/3037823873 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a80a9160 con 0x7fd9a80caab0 2023-11-30T17:24:51.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.770+0000 7fd9a6ffd700 1 --2- 172.21.15.49:0/3037823873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9a80caab0 0x7fd9a80aa470 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7fd998009810 tx=0x7fd998009060).ready entity=mon.0 client_cookie=e75c69a82acb4204 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:51.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.770+0000 7fd9a5ffb700 1 -- 172.21.15.49:0/3037823873 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd998005880 con 0x7fd9a80caab0 2023-11-30T17:24:51.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.771+0000 7fd9a5ffb700 1 -- 172.21.15.49:0/3037823873 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9980059e0 con 0x7fd9a80caab0 2023-11-30T17:24:51.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.771+0000 7fd9a5ffb700 1 -- 172.21.15.49:0/3037823873 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd998005d60 con 0x7fd9a80caab0 2023-11-30T17:24:51.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.771+0000 7fd9ad98e700 1 -- 172.21.15.49:0/3037823873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9a80caab0 msgr2=0x7fd9a80aa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:51.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.771+0000 7fd9ad98e700 1 --2- 172.21.15.49:0/3037823873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9a80caab0 0x7fd9a80aa470 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7fd998009810 tx=0x7fd998009060).stop 2023-11-30T17:24:51.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.771+0000 7fd9ad98e700 1 -- 172.21.15.49:0/3037823873 shutdown_connections 2023-11-30T17:24:51.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.771+0000 7fd9ad98e700 1 --2- 172.21.15.49:0/3037823873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9a80caab0 0x7fd9a80aa470 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:51.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.771+0000 7fd9ad98e700 1 -- 172.21.15.49:0/3037823873 >> 172.21.15.49:0/3037823873 conn(0x7fd9a8094920 msgr2=0x7fd9a806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:51.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.771+0000 7fd9ad98e700 1 -- 172.21.15.49:0/3037823873 shutdown_connections 2023-11-30T17:24:51.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.771+0000 7fd9ad98e700 1 -- 172.21.15.49:0/3037823873 wait complete. 2023-11-30T17:24:51.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.772+0000 7fd9ad98e700 1 Processor -- start 2023-11-30T17:24:51.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.772+0000 7fd9ad98e700 1 -- start start 2023-11-30T17:24:51.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.773+0000 7fd9ad98e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9a80ca180 0x7fd9a81511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:51.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.773+0000 7fd9ad98e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a80caab0 0x7fd9a80aa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:51.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.773+0000 7fd9ad98e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9a80cae90 0x7fd9a8168380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:51.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.773+0000 7fd9ad98e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a81516e0 con 0x7fd9a80ca180 2023-11-30T17:24:51.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.773+0000 7fd9ad98e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a8167ef0 con 0x7fd9a80caab0 2023-11-30T17:24:51.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.773+0000 7fd9ad98e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a80c2a00 con 0x7fd9a80cae90 2023-11-30T17:24:51.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.773+0000 7fd9a6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9a80ca180 0x7fd9a81511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:51.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.773+0000 7fd9a6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9a80ca180 0x7fd9a81511f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45142/0 (socket says 172.21.15.49:45142) 2023-11-30T17:24:51.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.773+0000 7fd9a6ffd700 1 -- 172.21.15.49:0/2186718510 learned_addr learned my addr 172.21.15.49:0/2186718510 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:51.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.773+0000 7fd9a67fc700 1 --2- 172.21.15.49:0/2186718510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a80caab0 0x7fd9a80aa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:51.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.773+0000 7fd9a77fe700 1 --2- 172.21.15.49:0/2186718510 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9a80cae90 0x7fd9a8168380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:51.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.774+0000 7fd9a6ffd700 1 -- 172.21.15.49:0/2186718510 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9a80cae90 msgr2=0x7fd9a8168380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:51.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.774+0000 7fd9a6ffd700 1 --2- 172.21.15.49:0/2186718510 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9a80cae90 0x7fd9a8168380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:51.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.774+0000 7fd9a6ffd700 1 -- 172.21.15.49:0/2186718510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a80caab0 msgr2=0x7fd9a80aa8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:51.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.774+0000 7fd9a6ffd700 1 --2- 172.21.15.49:0/2186718510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a80caab0 0x7fd9a80aa8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:51.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.774+0000 7fd9a6ffd700 1 -- 172.21.15.49:0/2186718510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd998009300 con 0x7fd9a80ca180 2023-11-30T17:24:51.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.774+0000 7fd9a6ffd700 1 --2- 172.21.15.49:0/2186718510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9a80ca180 0x7fd9a81511f0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7fd998009fd0 tx=0x7fd998016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:51.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.774+0000 7fd98effd700 1 -- 172.21.15.49:0/2186718510 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd998006770 con 0x7fd9a80ca180 2023-11-30T17:24:51.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.774+0000 7fd98effd700 1 -- 172.21.15.49:0/2186718510 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99800b850 con 0x7fd9a80ca180 2023-11-30T17:24:51.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.774+0000 7fd9ad98e700 1 -- 172.21.15.49:0/2186718510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a80c2ce0 con 0x7fd9a80ca180 2023-11-30T17:24:51.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.774+0000 7fd98effd700 1 -- 172.21.15.49:0/2186718510 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99800bbd0 con 0x7fd9a80ca180 2023-11-30T17:24:51.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.774+0000 7fd9ad98e700 1 -- 172.21.15.49:0/2186718510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a8167b80 con 0x7fd9a80ca180 2023-11-30T17:24:51.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.775+0000 7fd9ad98e700 1 -- 172.21.15.49:0/2186718510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a80cc170 con 0x7fd9a80ca180 2023-11-30T17:24:51.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.775+0000 7fd98effd700 1 -- 172.21.15.49:0/2186718510 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 46) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fd998018030 con 0x7fd9a80ca180 2023-11-30T17:24:51.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.776+0000 7fd98effd700 1 --2- 172.21.15.49:0/2186718510 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd99405f390 0x7fd994061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:51.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.776+0000 7fd9a67fc700 1 -- 172.21.15.49:0/2186718510 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd99405f390 msgr2=0x7fd994061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:24:51.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.776+0000 7fd98effd700 1 -- 172.21.15.49:0/2186718510 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6581+0+0 (secure 0 0 0) 0x7fd99807b690 con 0x7fd9a80ca180 2023-11-30T17:24:51.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.776+0000 7fd9a67fc700 1 --2- 172.21.15.49:0/2186718510 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd99405f390 0x7fd994061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:24:51.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.781+0000 7fd98effd700 1 -- 172.21.15.49:0/2186718510 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd99804c550 con 0x7fd9a80ca180 2023-11-30T17:24:51.885 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:24:51.888 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:24:51.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.957+0000 7fd9ad98e700 1 -- 172.21.15.49:0/2186718510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9a806c860 con 0x7fd9a80ca180 2023-11-30T17:24:51.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.958+0000 7fd98effd700 1 -- 172.21.15.49:0/2186718510 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+17646 (secure 0 0 0) 0x7fd998028090 con 0x7fd9a80ca180 2023-11-30T17:24:51.960 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:24:51.960 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":116,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:24:50.023892+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:23:30.500365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-30T17:23:30.919592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.23","mappings":[{"from":1,"to":5}]},{"pgid":"13.24","mappings":[{"from":6,"to":3}]},{"pgid":"14.2","mappings":[{"from":1,"to":7}]},{"pgid":"14.10","mappings":[{"from":1,"to":5}]},{"pgid":"14.31","mappings":[{"from":1,"to":7}]},{"pgid":"14.33","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/77045411":"2023-12-01T17:23:48.438312+0000","172.21.15.115:0/2457916531":"2023-12-01T17:23:48.438312+0000","172.21.15.115:6833/89956":"2023-12-01T17:23:48.438312+0000","172.21.15.115:6832/89956":"2023-12-01T17:23:48.438312+0000","172.21.15.115:0/2333450332":"2023-12-01T17:23:48.438312+0000","172.21.15.115:0/3126496541":"2023-12-01T17:23:48.438312+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:24:51.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.960+0000 7fd9ad98e700 1 -- 172.21.15.49:0/2186718510 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd99405f390 msgr2=0x7fd994061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:24:51.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.960+0000 7fd9ad98e700 1 --2- 172.21.15.49:0/2186718510 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd99405f390 0x7fd994061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:24:51.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.960+0000 7fd9ad98e700 1 -- 172.21.15.49:0/2186718510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9a80ca180 msgr2=0x7fd9a81511f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:51.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.960+0000 7fd9ad98e700 1 --2- 172.21.15.49:0/2186718510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9a80ca180 0x7fd9a81511f0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7fd998009fd0 tx=0x7fd998016000).stop 2023-11-30T17:24:51.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.960+0000 7fd9ad98e700 1 -- 172.21.15.49:0/2186718510 shutdown_connections 2023-11-30T17:24:51.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.960+0000 7fd9ad98e700 1 --2- 172.21.15.49:0/2186718510 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9a80cae90 0x7fd9a8168380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:51.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.960+0000 7fd9ad98e700 1 --2- 172.21.15.49:0/2186718510 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd99405f390 0x7fd994061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:24:51.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.960+0000 7fd9ad98e700 1 --2- 172.21.15.49:0/2186718510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9a80ca180 0x7fd9a81511f0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:51.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.960+0000 7fd9ad98e700 1 --2- 172.21.15.49:0/2186718510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a80caab0 0x7fd9a80aa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:51.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.960+0000 7fd9ad98e700 1 -- 172.21.15.49:0/2186718510 >> 172.21.15.49:0/2186718510 conn(0x7fd9a8094920 msgr2=0x7fd9a8153f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:51.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.960+0000 7fd9ad98e700 1 -- 172.21.15.49:0/2186718510 shutdown_connections 2023-11-30T17:24:51.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:51.960+0000 7fd9ad98e700 1 -- 172.21.15.49:0/2186718510 wait complete. 2023-11-30T17:24:51.977 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-30T17:23:30.500365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-11-30T17:23:30.919592+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-30T17:24:51.977 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T17:24:52.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.138+0000 7f86b2fbf700 1 Processor -- start 2023-11-30T17:24:52.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.138+0000 7f86b2fbf700 1 -- start start 2023-11-30T17:24:52.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.139+0000 7f86b2fbf700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f86ac098d10 0x7f86ac0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:52.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.139+0000 7f86b2fbf700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86ac0c72d0 con 0x7f86ac0c6190 2023-11-30T17:24:52.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.139+0000 7f86b2fbf700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86ac064570 con 0x7f86ac158320 2023-11-30T17:24:52.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.139+0000 7f86b2fbf700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86ac154bc0 con 0x7f86ac098d10 2023-11-30T17:24:52.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.139+0000 7f86b0d5b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f86ac098d10 0x7f86ac0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:52.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.139+0000 7f86abfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f86ac0c6190 0x7f86ac063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33308/0 (socket says 172.21.15.49:33308) 2023-11-30T17:24:52.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.139+0000 7f86b0d5b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f86ac098d10 0x7f86ac0c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45144/0 (socket says 172.21.15.49:45144) 2023-11-30T17:24:52.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.139+0000 7f86abfff700 1 -- 172.21.15.49:0/3014275239 learned_addr learned my addr 172.21.15.49:0/3014275239 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:24:52.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.139+0000 7f86b0d5b700 1 -- 172.21.15.49:0/3014275239 >> v1:172.21.15.115:6789/0 conn(0x7f86ac158320 legacy=0x7f86ac0a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:24:52.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.139+0000 7f86b0d5b700 1 -- 172.21.15.49:0/3014275239 >> v1:172.21.15.49:6789/0 conn(0x7f86ac0c6190 legacy=0x7f86ac063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:52.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.139+0000 7f86ab7fe700 1 -- 172.21.15.49:0/3014275239 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1984247858 0 0) 0x7f86ac0c72d0 con 0x7f86ac0c6190 2023-11-30T17:24:52.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.139+0000 7f86b0d5b700 1 -- 172.21.15.49:0/3014275239 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ac0c66c0 con 0x7f86ac098d10 2023-11-30T17:24:52.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.139+0000 7f86b0d5b700 1 --2- 172.21.15.49:0/3014275239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86ac098d10 0x7f86ac0c7760 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7f86a0009760 tx=0x7f86a0009060).ready entity=mon.0 client_cookie=af546051dbb08ebd server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:52.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.140+0000 7f86ab7fe700 1 -- 172.21.15.49:0/3014275239 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a000b520 con 0x7f86ac098d10 2023-11-30T17:24:52.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.140+0000 7f86ab7fe700 1 -- 172.21.15.49:0/3014275239 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a000b680 con 0x7f86ac098d10 2023-11-30T17:24:52.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.140+0000 7f86ab7fe700 1 -- 172.21.15.49:0/3014275239 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a000ba00 con 0x7f86ac098d10 2023-11-30T17:24:52.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.140+0000 7f86b2fbf700 1 -- 172.21.15.49:0/3014275239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86ac098d10 msgr2=0x7f86ac0c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:52.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.140+0000 7f86b2fbf700 1 --2- 172.21.15.49:0/3014275239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86ac098d10 0x7f86ac0c7760 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7f86a0009760 tx=0x7f86a0009060).stop 2023-11-30T17:24:52.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.140+0000 7f86b2fbf700 1 -- 172.21.15.49:0/3014275239 shutdown_connections 2023-11-30T17:24:52.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.140+0000 7f86b2fbf700 1 --2- 172.21.15.49:0/3014275239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86ac098d10 0x7f86ac0c7760 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:52.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.140+0000 7f86b2fbf700 1 -- 172.21.15.49:0/3014275239 >> 172.21.15.49:0/3014275239 conn(0x7f86ac0cb310 msgr2=0x7f86ac0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:52.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.140+0000 7f86b2fbf700 1 -- 172.21.15.49:0/3014275239 shutdown_connections 2023-11-30T17:24:52.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.140+0000 7f86b2fbf700 1 -- 172.21.15.49:0/3014275239 wait complete. 2023-11-30T17:24:52.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.141+0000 7f86b2fbf700 1 Processor -- start 2023-11-30T17:24:52.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.142+0000 7f86b2fbf700 1 -- start start 2023-11-30T17:24:52.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.142+0000 7f86b2fbf700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86ac098d10 0x7f86ac0c3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:52.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.142+0000 7f86b2fbf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86ac0c6190 0x7f86ac14b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:52.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.142+0000 7f86b2fbf700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86ac158320 0x7f86ac0c4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:52.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.142+0000 7f86b2fbf700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac14c570 con 0x7f86ac0c6190 2023-11-30T17:24:52.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.142+0000 7f86b2fbf700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac0c3700 con 0x7f86ac098d10 2023-11-30T17:24:52.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.142+0000 7f86b2fbf700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac0ae830 con 0x7f86ac158320 2023-11-30T17:24:52.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.142+0000 7f86abfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86ac0c6190 0x7f86ac14b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:52.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.142+0000 7f86abfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86ac0c6190 0x7f86ac14b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45152/0 (socket says 172.21.15.49:45152) 2023-11-30T17:24:52.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.142+0000 7f86abfff700 1 -- 172.21.15.49:0/3945887911 learned_addr learned my addr 172.21.15.49:0/3945887911 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:52.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.142+0000 7f86b0d5b700 1 --2- 172.21.15.49:0/3945887911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86ac098d10 0x7f86ac0c3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:52.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.143+0000 7f86b155c700 1 --2- 172.21.15.49:0/3945887911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86ac158320 0x7f86ac0c4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:52.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.143+0000 7f86abfff700 1 -- 172.21.15.49:0/3945887911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86ac158320 msgr2=0x7f86ac0c4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:52.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.143+0000 7f86abfff700 1 --2- 172.21.15.49:0/3945887911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86ac158320 0x7f86ac0c4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:52.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.143+0000 7f86abfff700 1 -- 172.21.15.49:0/3945887911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86ac098d10 msgr2=0x7f86ac0c3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:52.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.143+0000 7f86abfff700 1 --2- 172.21.15.49:0/3945887911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86ac098d10 0x7f86ac0c3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:52.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.143+0000 7f86abfff700 1 -- 172.21.15.49:0/3945887911 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a00092a0 con 0x7f86ac0c6190 2023-11-30T17:24:52.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.143+0000 7f86abfff700 1 --2- 172.21.15.49:0/3945887911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86ac0c6190 0x7f86ac14b830 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7f869800c4a0 tx=0x7f8698007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:52.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.143+0000 7f86a8ff9700 1 -- 172.21.15.49:0/3945887911 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869800ce50 con 0x7f86ac0c6190 2023-11-30T17:24:52.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.143+0000 7f86a8ff9700 1 -- 172.21.15.49:0/3945887911 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86980072e0 con 0x7f86ac0c6190 2023-11-30T17:24:52.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.143+0000 7f86b2fbf700 1 -- 172.21.15.49:0/3945887911 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86ac0aeb10 con 0x7f86ac0c6190 2023-11-30T17:24:52.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.143+0000 7f86a8ff9700 1 -- 172.21.15.49:0/3945887911 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8698007660 con 0x7f86ac0c6190 2023-11-30T17:24:52.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.143+0000 7f86b2fbf700 1 -- 172.21.15.49:0/3945887911 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86ac0af3f0 con 0x7f86ac0c6190 2023-11-30T17:24:52.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.144+0000 7f86b2fbf700 1 -- 172.21.15.49:0/3945887911 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86ac0aed00 con 0x7f86ac0c6190 2023-11-30T17:24:52.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.145+0000 7f86a8ff9700 1 -- 172.21.15.49:0/3945887911 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 46) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f86980059b0 con 0x7f86ac0c6190 2023-11-30T17:24:52.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.145+0000 7f86a8ff9700 1 --2- 172.21.15.49:0/3945887911 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f869005f390 0x7f8690061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:52.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.145+0000 7f86b0d5b700 1 -- 172.21.15.49:0/3945887911 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f869005f390 msgr2=0x7f8690061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:24:52.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.145+0000 7f86a8ff9700 1 -- 172.21.15.49:0/3945887911 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6581+0+0 (secure 0 0 0) 0x7f8698079de0 con 0x7f86ac0c6190 2023-11-30T17:24:52.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.145+0000 7f86b0d5b700 1 --2- 172.21.15.49:0/3945887911 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f869005f390 0x7f8690061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:24:52.153 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:52.146+0000 7f32a4990680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T17:24:52.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.155+0000 7f86a8ff9700 1 -- 172.21.15.49:0/3945887911 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f869804abe0 con 0x7f86ac0c6190 2023-11-30T17:24:52.220 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:52.218+0000 7f32a4990680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T17:24:52.224 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:24:52.218+0000 7fd306e37680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T17:24:52.291 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:24:52.289+0000 7fd306e37680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T17:24:52.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.346+0000 7f86b0d5b700 1 -- 172.21.15.49:0/3945887911 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f869005f390 msgr2=0x7f8690061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:24:52.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.346+0000 7f86b0d5b700 1 --2- 172.21.15.49:0/3945887911 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f869005f390 0x7f8690061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:24:52.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.368+0000 7f86b2fbf700 1 -- 172.21.15.49:0/3945887911 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f86ac0aef00 con 0x7f86ac0c6190 2023-11-30T17:24:52.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.369+0000 7f86a8ff9700 1 -- 172.21.15.49:0/3945887911 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v116) v1 ==== 110+0+10 (secure 0 0 0) 0x7f869804e200 con 0x7f86ac0c6190 2023-11-30T17:24:52.370 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T17:24:52.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.370+0000 7f86b2fbf700 1 -- 172.21.15.49:0/3945887911 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f869005f390 msgr2=0x7f8690061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:24:52.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.370+0000 7f86b2fbf700 1 --2- 172.21.15.49:0/3945887911 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f869005f390 0x7f8690061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:24:52.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.370+0000 7f86b2fbf700 1 -- 172.21.15.49:0/3945887911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86ac0c6190 msgr2=0x7f86ac14b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:52.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.370+0000 7f86b2fbf700 1 --2- 172.21.15.49:0/3945887911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86ac0c6190 0x7f86ac14b830 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7f869800c4a0 tx=0x7f8698007c30).stop 2023-11-30T17:24:52.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.371+0000 7f86b2fbf700 1 -- 172.21.15.49:0/3945887911 shutdown_connections 2023-11-30T17:24:52.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.371+0000 7f86b2fbf700 1 --2- 172.21.15.49:0/3945887911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86ac158320 0x7f86ac0c4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:52.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.371+0000 7f86b2fbf700 1 --2- 172.21.15.49:0/3945887911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86ac098d10 0x7f86ac0c3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:52.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.371+0000 7f86b2fbf700 1 --2- 172.21.15.49:0/3945887911 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f869005f390 0x7f8690061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:24:52.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.371+0000 7f86b2fbf700 1 --2- 172.21.15.49:0/3945887911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86ac0c6190 0x7f86ac14b830 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:52.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.371+0000 7f86b2fbf700 1 -- 172.21.15.49:0/3945887911 >> 172.21.15.49:0/3945887911 conn(0x7f86ac0cb310 msgr2=0x7f86ac0c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:52.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.371+0000 7f86b2fbf700 1 -- 172.21.15.49:0/3945887911 shutdown_connections 2023-11-30T17:24:52.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.371+0000 7f86b2fbf700 1 -- 172.21.15.49:0/3945887911 wait complete. 2023-11-30T17:24:52.385 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T17:24:52.405 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:52.403+0000 7f32a4990680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T17:24:52.489 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:24:52.487+0000 7fd306e37680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T17:24:52.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.507+0000 7fad2b511700 1 Processor -- start 2023-11-30T17:24:52.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.507+0000 7fad2b511700 1 -- start start 2023-11-30T17:24:52.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.508+0000 7fad2b511700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad24098d10 0x7fad240c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:52.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.508+0000 7fad2b511700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fad240c6190 0x7fad24063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:52.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.508+0000 7fad2b511700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fad24064350 0x7fad24158320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:52.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.508+0000 7fad2b511700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad240c72d0 con 0x7fad24064350 2023-11-30T17:24:52.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.508+0000 7fad2b511700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad24154bc0 con 0x7fad240c6190 2023-11-30T17:24:52.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.508+0000 7fad2b511700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad240c66c0 con 0x7fad24098d10 2023-11-30T17:24:52.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.508+0000 7fad29aae700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fad24064350 0x7fad24158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:52.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.508+0000 7fad29aae700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fad24064350 0x7fad24158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45158/0 (socket says 172.21.15.49:45158) 2023-11-30T17:24:52.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.508+0000 7fad29aae700 1 -- 172.21.15.49:0/2875090014 learned_addr learned my addr 172.21.15.49:0/2875090014 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:52.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.508+0000 7fad28aac700 1 --2- 172.21.15.49:0/2875090014 >> v2:172.21.15.115:3300/0 conn(0x7fad240c6190 0x7fad24063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:52.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.508+0000 7fad292ad700 1 --2- 172.21.15.49:0/2875090014 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad24098d10 0x7fad240c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:52.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.509+0000 7fad29aae700 1 -- 172.21.15.49:0/2875090014 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad24098d10 msgr2=0x7fad240c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:24:52.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.509+0000 7fad29aae700 1 --2- 172.21.15.49:0/2875090014 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad24098d10 0x7fad240c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:52.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.509+0000 7fad29aae700 1 -- 172.21.15.49:0/2875090014 >> v2:172.21.15.115:3300/0 conn(0x7fad240c6190 msgr2=0x7fad24063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:24:52.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.509+0000 7fad29aae700 1 --2- 172.21.15.49:0/2875090014 >> v2:172.21.15.115:3300/0 conn(0x7fad240c6190 0x7fad24063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:52.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.509+0000 7fad29aae700 1 -- 172.21.15.49:0/2875090014 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad240c69a0 con 0x7fad24064350 2023-11-30T17:24:52.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.509+0000 7fad29aae700 1 --2- 172.21.15.49:0/2875090014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad24064350 0x7fad24158320 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7fad240c8e20 tx=0x7fad1c009840).ready entity=mon.0 client_cookie=eac81e6b456d4ee4 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:52.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.509+0000 7fad17fff700 1 -- 172.21.15.49:0/2875090014 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c00e070 con 0x7fad24064350 2023-11-30T17:24:52.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.509+0000 7fad17fff700 1 -- 172.21.15.49:0/2875090014 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1c00b970 con 0x7fad24064350 2023-11-30T17:24:52.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.509+0000 7fad17fff700 1 -- 172.21.15.49:0/2875090014 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c00bcf0 con 0x7fad24064350 2023-11-30T17:24:52.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.510+0000 7fad2b511700 1 -- 172.21.15.49:0/2875090014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad24064350 msgr2=0x7fad24158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:52.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.510+0000 7fad2b511700 1 --2- 172.21.15.49:0/2875090014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad24064350 0x7fad24158320 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7fad240c8e20 tx=0x7fad1c009840).stop 2023-11-30T17:24:52.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.510+0000 7fad2b511700 1 -- 172.21.15.49:0/2875090014 shutdown_connections 2023-11-30T17:24:52.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.510+0000 7fad2b511700 1 --2- 172.21.15.49:0/2875090014 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad24098d10 0x7fad240c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:52.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.510+0000 7fad2b511700 1 --2- 172.21.15.49:0/2875090014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad24064350 0x7fad24158320 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:52.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.510+0000 7fad2b511700 1 --2- 172.21.15.49:0/2875090014 >> v2:172.21.15.115:3300/0 conn(0x7fad240c6190 0x7fad24063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:52.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.510+0000 7fad2b511700 1 -- 172.21.15.49:0/2875090014 >> 172.21.15.49:0/2875090014 conn(0x7fad240cb310 msgr2=0x7fad240cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:52.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.510+0000 7fad2b511700 1 -- 172.21.15.49:0/2875090014 shutdown_connections 2023-11-30T17:24:52.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.510+0000 7fad2b511700 1 -- 172.21.15.49:0/2875090014 wait complete. 2023-11-30T17:24:52.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.511+0000 7fad2b511700 1 Processor -- start 2023-11-30T17:24:52.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.511+0000 7fad2b511700 1 -- start start 2023-11-30T17:24:52.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.512+0000 7fad2b511700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad24064350 0x7fad2414e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:52.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.512+0000 7fad2b511700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad24098d10 0x7fad2415a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:52.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.512+0000 7fad2b511700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad240c6190 0x7fad241556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:52.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.512+0000 7fad2b511700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad240aaa30 con 0x7fad24098d10 2023-11-30T17:24:52.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.512+0000 7fad2b511700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad240a9e20 con 0x7fad24064350 2023-11-30T17:24:52.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.512+0000 7fad2b511700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad240aa100 con 0x7fad240c6190 2023-11-30T17:24:52.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.512+0000 7fad28aac700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad24098d10 0x7fad2415a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:52.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.512+0000 7fad28aac700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad24098d10 0x7fad2415a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45174/0 (socket says 172.21.15.49:45174) 2023-11-30T17:24:52.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.512+0000 7fad28aac700 1 -- 172.21.15.49:0/2365188298 learned_addr learned my addr 172.21.15.49:0/2365188298 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:52.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.512+0000 7fad292ad700 1 --2- 172.21.15.49:0/2365188298 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad24064350 0x7fad2414e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:52.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.512+0000 7fad29aae700 1 --2- 172.21.15.49:0/2365188298 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad240c6190 0x7fad241556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:52.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.512+0000 7fad28aac700 1 -- 172.21.15.49:0/2365188298 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad240c6190 msgr2=0x7fad241556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:52.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.512+0000 7fad28aac700 1 --2- 172.21.15.49:0/2365188298 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad240c6190 0x7fad241556a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:52.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.512+0000 7fad28aac700 1 -- 172.21.15.49:0/2365188298 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad24064350 msgr2=0x7fad2414e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:52.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.512+0000 7fad28aac700 1 --2- 172.21.15.49:0/2365188298 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad24064350 0x7fad2414e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:52.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.512+0000 7fad28aac700 1 -- 172.21.15.49:0/2365188298 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1c009ae0 con 0x7fad24098d10 2023-11-30T17:24:52.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.513+0000 7fad28aac700 1 --2- 172.21.15.49:0/2365188298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad24098d10 0x7fad2415a7c0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7fad1800e8d0 tx=0x7fad18009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:52.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.513+0000 7fad157fa700 1 -- 172.21.15.49:0/2365188298 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad18012600 con 0x7fad24098d10 2023-11-30T17:24:52.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.513+0000 7fad157fa700 1 -- 172.21.15.49:0/2365188298 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad18012760 con 0x7fad24098d10 2023-11-30T17:24:52.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.513+0000 7fad2b511700 1 -- 172.21.15.49:0/2365188298 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad240aa3e0 con 0x7fad24098d10 2023-11-30T17:24:52.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.513+0000 7fad157fa700 1 -- 172.21.15.49:0/2365188298 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad18012ae0 con 0x7fad24098d10 2023-11-30T17:24:52.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.513+0000 7fad2b511700 1 -- 172.21.15.49:0/2365188298 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad2414e630 con 0x7fad24098d10 2023-11-30T17:24:52.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.514+0000 7fad2b511700 1 -- 172.21.15.49:0/2365188298 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad240aad20 con 0x7fad24098d10 2023-11-30T17:24:52.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.514+0000 7fad157fa700 1 -- 172.21.15.49:0/2365188298 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 46) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fad1801b400 con 0x7fad24098d10 2023-11-30T17:24:52.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.515+0000 7fad157fa700 1 --2- 172.21.15.49:0/2365188298 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fad0805f390 0x7fad08061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:52.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.515+0000 7fad157fa700 1 -- 172.21.15.49:0/2365188298 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6581+0+0 (secure 0 0 0) 0x7fad1807aa80 con 0x7fad24098d10 2023-11-30T17:24:52.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.515+0000 7fad292ad700 1 -- 172.21.15.49:0/2365188298 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fad0805f390 msgr2=0x7fad08061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:24:52.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.515+0000 7fad292ad700 1 --2- 172.21.15.49:0/2365188298 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fad0805f390 0x7fad08061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:24:52.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.519+0000 7fad157fa700 1 -- 172.21.15.49:0/2365188298 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fad240aad20 con 0x7fad24098d10 2023-11-30T17:24:52.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.691+0000 7fad2b511700 1 -- 172.21.15.49:0/2365188298 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fad240aad20 con 0x7fad24098d10 2023-11-30T17:24:52.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.691+0000 7fad157fa700 1 -- 172.21.15.49:0/2365188298 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v116) v1 ==== 92+0+10 (secure 0 0 0) 0x7fad240aad20 con 0x7fad24098d10 2023-11-30T17:24:52.693 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T17:24:52.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.693+0000 7fad2b511700 1 -- 172.21.15.49:0/2365188298 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fad0805f390 msgr2=0x7fad08061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:24:52.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.693+0000 7fad2b511700 1 --2- 172.21.15.49:0/2365188298 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fad0805f390 0x7fad08061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:24:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.693+0000 7fad2b511700 1 -- 172.21.15.49:0/2365188298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad24098d10 msgr2=0x7fad2415a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.693+0000 7fad2b511700 1 --2- 172.21.15.49:0/2365188298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad24098d10 0x7fad2415a7c0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7fad1800e8d0 tx=0x7fad18009060).stop 2023-11-30T17:24:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.694+0000 7fad2b511700 1 -- 172.21.15.49:0/2365188298 shutdown_connections 2023-11-30T17:24:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.694+0000 7fad2b511700 1 --2- 172.21.15.49:0/2365188298 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad240c6190 0x7fad241556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.694+0000 7fad2b511700 1 --2- 172.21.15.49:0/2365188298 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad24064350 0x7fad2414e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.694+0000 7fad2b511700 1 --2- 172.21.15.49:0/2365188298 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fad0805f390 0x7fad08061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:24:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.694+0000 7fad2b511700 1 --2- 172.21.15.49:0/2365188298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad24098d10 0x7fad2415a7c0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.694+0000 7fad2b511700 1 -- 172.21.15.49:0/2365188298 >> 172.21.15.49:0/2365188298 conn(0x7fad240cb310 msgr2=0x7fad24152990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.694+0000 7fad2b511700 1 -- 172.21.15.49:0/2365188298 shutdown_connections 2023-11-30T17:24:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.694+0000 7fad2b511700 1 -- 172.21.15.49:0/2365188298 wait complete. 2023-11-30T17:24:52.709 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-30T17:24:52.823 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:52.822+0000 7f32a4990680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T17:24:52.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.830+0000 7f2df0e68700 1 Processor -- start 2023-11-30T17:24:52.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.830+0000 7f2df0e68700 1 -- start start 2023-11-30T17:24:52.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.831+0000 7f2df0e68700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2dec1547f0 0x7f2dec0a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:52.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.831+0000 7f2df0e68700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2dec0c86f0 0x7f2dec0c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:52.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.831+0000 7f2df0e68700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dec0c7e30 con 0x7f2dec062700 2023-11-30T17:24:52.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.831+0000 7f2df0e68700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dec0bcf40 con 0x7f2dec1547f0 2023-11-30T17:24:52.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.831+0000 7f2df0e68700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dec0c6b20 con 0x7f2dec0c86f0 2023-11-30T17:24:52.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.831+0000 7f2dea59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2dec1547f0 0x7f2dec0a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:52.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.832+0000 7f2dea59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2dec1547f0 0x7f2dec0a72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45184/0 (socket says 172.21.15.49:45184) 2023-11-30T17:24:52.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.832+0000 7f2dea59c700 1 -- 172.21.15.49:0/683431007 learned_addr learned my addr 172.21.15.49:0/683431007 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:52.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.832+0000 7f2de9d9b700 1 --2- 172.21.15.49:0/683431007 >> v2:172.21.15.115:3300/0 conn(0x7f2dec0c86f0 0x7f2dec0c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:52.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.832+0000 7f2dea59c700 1 -- 172.21.15.49:0/683431007 >> v2:172.21.15.115:3300/0 conn(0x7f2dec0c86f0 msgr2=0x7f2dec0c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:24:52.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.832+0000 7f2dea59c700 1 --2- 172.21.15.49:0/683431007 >> v2:172.21.15.115:3300/0 conn(0x7f2dec0c86f0 0x7f2dec0c6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:52.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.832+0000 7f2dea59c700 1 -- 172.21.15.49:0/683431007 >> v1:172.21.15.115:6789/0 conn(0x7f2dec062700 legacy=0x7f2dec0a4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:52.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.832+0000 7f2dea59c700 1 -- 172.21.15.49:0/683431007 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dec0a77d0 con 0x7f2dec1547f0 2023-11-30T17:24:52.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.832+0000 7f2de9d9b700 1 --2- 172.21.15.49:0/683431007 >> v2:172.21.15.115:3300/0 conn(0x7f2dec0c86f0 0x7f2dec0c6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:24:52.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.832+0000 7f2dea59c700 1 --2- 172.21.15.49:0/683431007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dec1547f0 0x7f2dec0a72e0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f2dec064d00 tx=0x7f2de00090f0).ready entity=mon.0 client_cookie=ab381a5133b1cb3b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:52.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.832+0000 7f2de959a700 1 -- 172.21.15.49:0/683431007 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de000b600 con 0x7f2dec1547f0 2023-11-30T17:24:52.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.832+0000 7f2de959a700 1 -- 172.21.15.49:0/683431007 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de000b760 con 0x7f2dec1547f0 2023-11-30T17:24:52.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.832+0000 7f2de959a700 1 -- 172.21.15.49:0/683431007 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de000bb00 con 0x7f2dec1547f0 2023-11-30T17:24:52.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.833+0000 7f2df0e68700 1 -- 172.21.15.49:0/683431007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dec1547f0 msgr2=0x7f2dec0a72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:52.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.833+0000 7f2df0e68700 1 --2- 172.21.15.49:0/683431007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dec1547f0 0x7f2dec0a72e0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f2dec064d00 tx=0x7f2de00090f0).stop 2023-11-30T17:24:52.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.833+0000 7f2df0e68700 1 -- 172.21.15.49:0/683431007 shutdown_connections 2023-11-30T17:24:52.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.833+0000 7f2df0e68700 1 --2- 172.21.15.49:0/683431007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dec1547f0 0x7f2dec0a72e0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:52.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.833+0000 7f2df0e68700 1 --2- 172.21.15.49:0/683431007 >> v2:172.21.15.115:3300/0 conn(0x7f2dec0c86f0 0x7f2dec0c6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:52.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.833+0000 7f2df0e68700 1 -- 172.21.15.49:0/683431007 >> 172.21.15.49:0/683431007 conn(0x7f2dec0642d0 msgr2=0x7f2dec0c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:52.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.833+0000 7f2df0e68700 1 -- 172.21.15.49:0/683431007 shutdown_connections 2023-11-30T17:24:52.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.833+0000 7f2df0e68700 1 -- 172.21.15.49:0/683431007 wait complete. 2023-11-30T17:24:52.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.834+0000 7f2df0e68700 1 Processor -- start 2023-11-30T17:24:52.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.834+0000 7f2df0e68700 1 -- start start 2023-11-30T17:24:52.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.835+0000 7f2df0e68700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dec062700 0x7f2dec149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:52.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.835+0000 7f2df0e68700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2dec0c86f0 0x7f2dec0ac910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:52.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.835+0000 7f2df0e68700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dec1547f0 0x7f2dec0ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:52.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.835+0000 7f2df0e68700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec0aaf90 con 0x7f2dec1547f0 2023-11-30T17:24:52.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.835+0000 7f2df0e68700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec0ad2f0 con 0x7f2dec062700 2023-11-30T17:24:52.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.835+0000 7f2df0e68700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec0abaa0 con 0x7f2dec0c86f0 2023-11-30T17:24:52.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.835+0000 7f2dead9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dec1547f0 0x7f2dec0ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:52.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.835+0000 7f2dea59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dec062700 0x7f2dec149cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:52.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.835+0000 7f2dea59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dec062700 0x7f2dec149cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:44818/0 (socket says 172.21.15.49:44818) 2023-11-30T17:24:52.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.835+0000 7f2dead9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dec1547f0 0x7f2dec0ace00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45192/0 (socket says 172.21.15.49:45192) 2023-11-30T17:24:52.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.835+0000 7f2dea59c700 1 -- 172.21.15.49:0/3573061679 learned_addr learned my addr 172.21.15.49:0/3573061679 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:52.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.835+0000 7f2de9d9b700 1 --2- 172.21.15.49:0/3573061679 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2dec0c86f0 0x7f2dec0ac910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:52.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.835+0000 7f2dead9d700 1 -- 172.21.15.49:0/3573061679 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2dec0c86f0 msgr2=0x7f2dec0ac910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:52.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.835+0000 7f2dead9d700 1 --2- 172.21.15.49:0/3573061679 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2dec0c86f0 0x7f2dec0ac910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:52.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.835+0000 7f2dead9d700 1 -- 172.21.15.49:0/3573061679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dec062700 msgr2=0x7f2dec149cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:52.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.835+0000 7f2dead9d700 1 --2- 172.21.15.49:0/3573061679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dec062700 0x7f2dec149cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:52.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.835+0000 7f2dead9d700 1 -- 172.21.15.49:0/3573061679 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de0009370 con 0x7f2dec1547f0 2023-11-30T17:24:52.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.835+0000 7f2dead9d700 1 --2- 172.21.15.49:0/3573061679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dec1547f0 0x7f2dec0ace00 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7f2de400c7c0 tx=0x7f2de4001460).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:52.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.836+0000 7f2dda7fc700 1 -- 172.21.15.49:0/3573061679 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de400f470 con 0x7f2dec1547f0 2023-11-30T17:24:52.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.836+0000 7f2dda7fc700 1 -- 172.21.15.49:0/3573061679 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de400f5d0 con 0x7f2dec1547f0 2023-11-30T17:24:52.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.836+0000 7f2df0e68700 1 -- 172.21.15.49:0/3573061679 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dec0ab170 con 0x7f2dec1547f0 2023-11-30T17:24:52.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.836+0000 7f2dda7fc700 1 -- 172.21.15.49:0/3573061679 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de400f950 con 0x7f2dec1547f0 2023-11-30T17:24:52.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.836+0000 7f2df0e68700 1 -- 172.21.15.49:0/3573061679 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dec0ab730 con 0x7f2dec1547f0 2023-11-30T17:24:52.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.837+0000 7f2df0e68700 1 -- 172.21.15.49:0/3573061679 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dec0abc50 con 0x7f2dec1547f0 2023-11-30T17:24:52.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.837+0000 7f2dda7fc700 1 -- 172.21.15.49:0/3573061679 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 46) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f2de400fd40 con 0x7f2dec1547f0 2023-11-30T17:24:52.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.837+0000 7f2dda7fc700 1 --2- 172.21.15.49:0/3573061679 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2dcc05f360 0x7f2dcc061820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:52.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.837+0000 7f2dea59c700 1 -- 172.21.15.49:0/3573061679 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2dcc05f360 msgr2=0x7f2dcc061820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:24:52.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.837+0000 7f2dda7fc700 1 -- 172.21.15.49:0/3573061679 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6581+0+0 (secure 0 0 0) 0x7f2de4079eb0 con 0x7f2dec1547f0 2023-11-30T17:24:52.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.837+0000 7f2dea59c700 1 --2- 172.21.15.49:0/3573061679 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2dcc05f360 0x7f2dcc061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:24:52.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:52.841+0000 7f2dda7fc700 1 -- 172.21.15.49:0/3573061679 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2de4047b00 con 0x7f2dec1547f0 2023-11-30T17:24:52.927 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:52.926+0000 7f32a4990680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:24:52.937 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:24:52.936+0000 7fd306e37680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T17:24:53.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.015+0000 7f2df0e68700 1 -- 172.21.15.49:0/3573061679 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2dec06c860 con 0x7f2dec1547f0 2023-11-30T17:24:53.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.015+0000 7f2dda7fc700 1 -- 172.21.15.49:0/3573061679 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v116) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2dec0abc50 con 0x7f2dec1547f0 2023-11-30T17:24:53.017 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T17:24:53.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.017+0000 7f2df0e68700 1 -- 172.21.15.49:0/3573061679 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2dcc05f360 msgr2=0x7f2dcc061820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:24:53.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.017+0000 7f2df0e68700 1 --2- 172.21.15.49:0/3573061679 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2dcc05f360 0x7f2dcc061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:24:53.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.017+0000 7f2df0e68700 1 -- 172.21.15.49:0/3573061679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dec1547f0 msgr2=0x7f2dec0ace00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:53.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.017+0000 7f2df0e68700 1 --2- 172.21.15.49:0/3573061679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dec1547f0 0x7f2dec0ace00 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7f2de400c7c0 tx=0x7f2de4001460).stop 2023-11-30T17:24:53.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.017+0000 7f2df0e68700 1 -- 172.21.15.49:0/3573061679 shutdown_connections 2023-11-30T17:24:53.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.018+0000 7f2df0e68700 1 --2- 172.21.15.49:0/3573061679 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2dcc05f360 0x7f2dcc061820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:24:53.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.018+0000 7f2df0e68700 1 --2- 172.21.15.49:0/3573061679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dec1547f0 0x7f2dec0ace00 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:53.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.018+0000 7f2df0e68700 1 --2- 172.21.15.49:0/3573061679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dec062700 0x7f2dec149cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:53.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.018+0000 7f2df0e68700 1 --2- 172.21.15.49:0/3573061679 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2dec0c86f0 0x7f2dec0ac910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:53.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.018+0000 7f2df0e68700 1 -- 172.21.15.49:0/3573061679 >> 172.21.15.49:0/3573061679 conn(0x7f2dec0642d0 msgr2=0x7f2dec153b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:53.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.018+0000 7f2df0e68700 1 -- 172.21.15.49:0/3573061679 shutdown_connections 2023-11-30T17:24:53.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.018+0000 7f2df0e68700 1 -- 172.21.15.49:0/3573061679 wait complete. 2023-11-30T17:24:53.031 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-30T17:24:53.049 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:24:53.047+0000 7fd306e37680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:24:53.081 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:53.080+0000 7f32a4990680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T17:24:53.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.154+0000 7f3ef364c700 1 Processor -- start 2023-11-30T17:24:53.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.154+0000 7f3ef364c700 1 -- start start 2023-11-30T17:24:53.156 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:53.155+0000 7f32a4990680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T17:24:53.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.155+0000 7f3ef364c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3eec098d10 0x7f3eec0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:53.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.155+0000 7f3ef364c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3eec0c6190 0x7f3eec063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:53.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.155+0000 7f3ef364c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3eec064350 0x7f3eec158320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:53.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.155+0000 7f3ef364c700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eec0c72d0 con 0x7f3eec064350 2023-11-30T17:24:53.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.155+0000 7f3ef364c700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eec154bc0 con 0x7f3eec098d10 2023-11-30T17:24:53.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.155+0000 7f3ef364c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec0c66c0 con 0x7f3eec0c6190 2023-11-30T17:24:53.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.155+0000 7f3ef1be9700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3eec064350 0x7f3eec158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:53.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.155+0000 7f3ef0be7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3eec0c6190 0x7f3eec063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:53.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.155+0000 7f3ef13e8700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3eec098d10 0x7f3eec0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:53.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.155+0000 7f3ef1be9700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3eec064350 0x7f3eec158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45198/0 (socket says 172.21.15.49:45198) 2023-11-30T17:24:53.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.155+0000 7f3ef0be7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3eec0c6190 0x7f3eec063e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:45472/0 (socket says 172.21.15.49:45472) 2023-11-30T17:24:53.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.155+0000 7f3ef13e8700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3eec098d10 0x7f3eec0c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:44832/0 (socket says 172.21.15.49:44832) 2023-11-30T17:24:53.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.155+0000 7f3ef1be9700 1 -- 172.21.15.49:0/2053720236 learned_addr learned my addr 172.21.15.49:0/2053720236 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:53.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.156+0000 7f3ef1be9700 1 -- 172.21.15.49:0/2053720236 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3eec0c6190 msgr2=0x7f3eec063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:24:53.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.156+0000 7f3ef1be9700 1 --2- 172.21.15.49:0/2053720236 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3eec0c6190 0x7f3eec063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:53.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.156+0000 7f3ef1be9700 1 -- 172.21.15.49:0/2053720236 >> v2:172.21.15.115:3300/0 conn(0x7f3eec098d10 msgr2=0x7f3eec0c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:24:53.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.156+0000 7f3ef1be9700 1 --2- 172.21.15.49:0/2053720236 >> v2:172.21.15.115:3300/0 conn(0x7f3eec098d10 0x7f3eec0c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:53.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.156+0000 7f3ef1be9700 1 -- 172.21.15.49:0/2053720236 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec0c69a0 con 0x7f3eec064350 2023-11-30T17:24:53.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.156+0000 7f3ef1be9700 1 --2- 172.21.15.49:0/2053720236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eec064350 0x7f3eec158320 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7f3eec083f80 tx=0x7f3ee4009840).ready entity=mon.0 client_cookie=66d08d22f08366d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:53.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.156+0000 7f3ee3fff700 1 -- 172.21.15.49:0/2053720236 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee400e070 con 0x7f3eec064350 2023-11-30T17:24:53.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.156+0000 7f3ee3fff700 1 -- 172.21.15.49:0/2053720236 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee400b970 con 0x7f3eec064350 2023-11-30T17:24:53.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.156+0000 7f3ee3fff700 1 -- 172.21.15.49:0/2053720236 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee400bcf0 con 0x7f3eec064350 2023-11-30T17:24:53.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.157+0000 7f3ef364c700 1 -- 172.21.15.49:0/2053720236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eec064350 msgr2=0x7f3eec158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:53.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.157+0000 7f3ef364c700 1 --2- 172.21.15.49:0/2053720236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eec064350 0x7f3eec158320 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7f3eec083f80 tx=0x7f3ee4009840).stop 2023-11-30T17:24:53.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.157+0000 7f3ef364c700 1 -- 172.21.15.49:0/2053720236 shutdown_connections 2023-11-30T17:24:53.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.157+0000 7f3ef364c700 1 --2- 172.21.15.49:0/2053720236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eec064350 0x7f3eec158320 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:53.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.157+0000 7f3ef364c700 1 --2- 172.21.15.49:0/2053720236 >> v2:172.21.15.115:3300/0 conn(0x7f3eec098d10 0x7f3eec0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:53.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.157+0000 7f3ef364c700 1 --2- 172.21.15.49:0/2053720236 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3eec0c6190 0x7f3eec063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:53.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.157+0000 7f3ef364c700 1 -- 172.21.15.49:0/2053720236 >> 172.21.15.49:0/2053720236 conn(0x7f3eec0cb310 msgr2=0x7f3eec0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:53.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.157+0000 7f3ef364c700 1 -- 172.21.15.49:0/2053720236 shutdown_connections 2023-11-30T17:24:53.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.157+0000 7f3ef364c700 1 -- 172.21.15.49:0/2053720236 wait complete. 2023-11-30T17:24:53.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.158+0000 7f3ef364c700 1 Processor -- start 2023-11-30T17:24:53.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.158+0000 7f3ef364c700 1 -- start start 2023-11-30T17:24:53.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.159+0000 7f3ef364c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3eec064350 0x7f3eec1504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:53.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.159+0000 7f3ef364c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3eec098d10 0x7f3eec0a84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:53.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.159+0000 7f3ef364c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eec0c6190 0x7f3eec0a89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:53.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.159+0000 7f3ef364c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec168e50 con 0x7f3eec0c6190 2023-11-30T17:24:53.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.159+0000 7f3ef364c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec156080 con 0x7f3eec064350 2023-11-30T17:24:53.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.159+0000 7f3ef364c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec168b70 con 0x7f3eec098d10 2023-11-30T17:24:53.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.159+0000 7f3ef1be9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eec0c6190 0x7f3eec0a89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:53.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.159+0000 7f3ef13e8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3eec064350 0x7f3eec1504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:53.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.159+0000 7f3ef1be9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eec0c6190 0x7f3eec0a89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45200/0 (socket says 172.21.15.49:45200) 2023-11-30T17:24:53.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.159+0000 7f3ef0be7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3eec098d10 0x7f3eec0a84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:53.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.159+0000 7f3ef1be9700 1 -- 172.21.15.49:0/664820432 learned_addr learned my addr 172.21.15.49:0/664820432 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:53.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.159+0000 7f3ef1be9700 1 -- 172.21.15.49:0/664820432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3eec098d10 msgr2=0x7f3eec0a84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:53.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.159+0000 7f3ef1be9700 1 --2- 172.21.15.49:0/664820432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3eec098d10 0x7f3eec0a84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:53.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.159+0000 7f3ef1be9700 1 -- 172.21.15.49:0/664820432 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3eec064350 msgr2=0x7f3eec1504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:53.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.159+0000 7f3ef1be9700 1 --2- 172.21.15.49:0/664820432 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3eec064350 0x7f3eec1504b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:53.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.159+0000 7f3ef1be9700 1 -- 172.21.15.49:0/664820432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee4009ae0 con 0x7f3eec0c6190 2023-11-30T17:24:53.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.159+0000 7f3ef0be7700 1 --2- 172.21.15.49:0/664820432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3eec098d10 0x7f3eec0a84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:24:53.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.159+0000 7f3ef13e8700 1 --2- 172.21.15.49:0/664820432 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3eec064350 0x7f3eec1504b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:24:53.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.160+0000 7f3ef1be9700 1 --2- 172.21.15.49:0/664820432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eec0c6190 0x7f3eec0a89d0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7f3ee400b610 tx=0x7f3ee4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:53.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.160+0000 7f3ee17fa700 1 -- 172.21.15.49:0/664820432 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee400bee0 con 0x7f3eec0c6190 2023-11-30T17:24:53.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.160+0000 7f3ee17fa700 1 -- 172.21.15.49:0/664820432 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee4013e60 con 0x7f3eec0c6190 2023-11-30T17:24:53.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.160+0000 7f3ee17fa700 1 -- 172.21.15.49:0/664820432 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee401e6c0 con 0x7f3eec0c6190 2023-11-30T17:24:53.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.160+0000 7f3ef364c700 1 -- 172.21.15.49:0/664820432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eec155a30 con 0x7f3eec0c6190 2023-11-30T17:24:53.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.160+0000 7f3ef364c700 1 -- 172.21.15.49:0/664820432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eec1509a0 con 0x7f3eec0c6190 2023-11-30T17:24:53.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.161+0000 7f3ef364c700 1 -- 172.21.15.49:0/664820432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eec151d40 con 0x7f3eec0c6190 2023-11-30T17:24:53.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.161+0000 7f3ee17fa700 1 -- 172.21.15.49:0/664820432 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 46) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f3ee4003040 con 0x7f3eec0c6190 2023-11-30T17:24:53.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.162+0000 7f3ee17fa700 1 --2- 172.21.15.49:0/664820432 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3ed005f390 0x7f3ed0061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:53.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.162+0000 7f3ef13e8700 1 -- 172.21.15.49:0/664820432 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3ed005f390 msgr2=0x7f3ed0061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:24:53.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.162+0000 7f3ee17fa700 1 -- 172.21.15.49:0/664820432 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6581+0+0 (secure 0 0 0) 0x7f3ee407bca0 con 0x7f3eec0c6190 2023-11-30T17:24:53.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.162+0000 7f3ef13e8700 1 --2- 172.21.15.49:0/664820432 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3ed005f390 0x7f3ed0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:24:53.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.166+0000 7f3ee17fa700 1 -- 172.21.15.49:0/664820432 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3ee404ca40 con 0x7f3eec0c6190 2023-11-30T17:24:53.212 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:24:53.211+0000 7fd306e37680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T17:24:53.225 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:53.223+0000 7f32a4990680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T17:24:53.291 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:24:53.290+0000 7fd306e37680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T17:24:53.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.338+0000 7f3ef364c700 1 -- 172.21.15.49:0/664820432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3eec155890 con 0x7f3eec0c6190 2023-11-30T17:24:53.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.339+0000 7f3ee17fa700 1 -- 172.21.15.49:0/664820432 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v116) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3eec155890 con 0x7f3eec0c6190 2023-11-30T17:24:53.340 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T17:24:53.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.340+0000 7f3ef364c700 1 -- 172.21.15.49:0/664820432 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3ed005f390 msgr2=0x7f3ed0061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:24:53.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.341+0000 7f3ef364c700 1 --2- 172.21.15.49:0/664820432 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3ed005f390 0x7f3ed0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:24:53.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.341+0000 7f3ef364c700 1 -- 172.21.15.49:0/664820432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eec0c6190 msgr2=0x7f3eec0a89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:53.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.341+0000 7f3ef364c700 1 --2- 172.21.15.49:0/664820432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eec0c6190 0x7f3eec0a89d0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7f3ee400b610 tx=0x7f3ee4009840).stop 2023-11-30T17:24:53.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.341+0000 7f3ef364c700 1 -- 172.21.15.49:0/664820432 shutdown_connections 2023-11-30T17:24:53.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.341+0000 7f3ef364c700 1 --2- 172.21.15.49:0/664820432 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3ed005f390 0x7f3ed0061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:24:53.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.341+0000 7f3ef364c700 1 --2- 172.21.15.49:0/664820432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eec0c6190 0x7f3eec0a89d0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:53.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.341+0000 7f3ef364c700 1 --2- 172.21.15.49:0/664820432 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3eec064350 0x7f3eec1504b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:53.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.341+0000 7f3ef364c700 1 --2- 172.21.15.49:0/664820432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3eec098d10 0x7f3eec0a84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:53.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.341+0000 7f3ef364c700 1 -- 172.21.15.49:0/664820432 >> 172.21.15.49:0/664820432 conn(0x7f3eec0cb310 msgr2=0x7f3eec0c0480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:53.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.341+0000 7f3ef364c700 1 -- 172.21.15.49:0/664820432 shutdown_connections 2023-11-30T17:24:53.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.341+0000 7f3ef364c700 1 -- 172.21.15.49:0/664820432 wait complete. 2023-11-30T17:24:53.355 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:24:53.364 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:24:53.362+0000 7fd306e37680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T17:24:53.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.481+0000 7fcdd63e1700 1 Processor -- start 2023-11-30T17:24:53.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.481+0000 7fcdd63e1700 1 -- start start 2023-11-30T17:24:53.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.482+0000 7fcdd63e1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcdd01544d0 0x7fcdd0155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:53.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.482+0000 7fcdd63e1700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd00683d0 con 0x7fcdd0066f40 2023-11-30T17:24:53.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.482+0000 7fcdd63e1700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd0067850 con 0x7fcdd00673c0 2023-11-30T17:24:53.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.482+0000 7fcdd63e1700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd0067b30 con 0x7fcdd01544d0 2023-11-30T17:24:53.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.482+0000 7fcdcffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcdd01544d0 0x7fcdd0155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:53.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.482+0000 7fcdcf7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcdd0066f40 0x7fcdd0095e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33310/0 (socket says 172.21.15.49:33310) 2023-11-30T17:24:53.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.482+0000 7fcdcf7fe700 1 -- 172.21.15.49:0/3397152679 learned_addr learned my addr 172.21.15.49:0/3397152679 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:24:53.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.482+0000 7fcdcffff700 1 -- 172.21.15.49:0/3397152679 >> v1:172.21.15.115:6789/0 conn(0x7fcdd00673c0 legacy=0x7fcdd015e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:53.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.482+0000 7fcdcffff700 1 -- 172.21.15.49:0/3397152679 >> v1:172.21.15.49:6789/0 conn(0x7fcdd0066f40 legacy=0x7fcdd0095e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:53.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.482+0000 7fcdcffff700 1 -- 172.21.15.49:0/3397152679 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd0067e10 con 0x7fcdd01544d0 2023-11-30T17:24:53.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.482+0000 7fcdcffff700 1 --2- 172.21.15.49:0/3397152679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdd01544d0 0x7fcdd0155750 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7fcdc0006fd0 tx=0x7fcdc0006f40).ready entity=mon.0 client_cookie=9f1bacb7a76483f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:53.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.482+0000 7fcdceffd700 1 -- 172.21.15.49:0/3397152679 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0005880 con 0x7fcdd01544d0 2023-11-30T17:24:53.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.483+0000 7fcdceffd700 1 -- 172.21.15.49:0/3397152679 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc00059e0 con 0x7fcdd01544d0 2023-11-30T17:24:53.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.483+0000 7fcdceffd700 1 -- 172.21.15.49:0/3397152679 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0005d60 con 0x7fcdd01544d0 2023-11-30T17:24:53.485 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:53.482+0000 7f32a4990680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T17:24:53.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.483+0000 7fcdd63e1700 1 -- 172.21.15.49:0/3397152679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdd01544d0 msgr2=0x7fcdd0155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:53.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.483+0000 7fcdd63e1700 1 --2- 172.21.15.49:0/3397152679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdd01544d0 0x7fcdd0155750 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7fcdc0006fd0 tx=0x7fcdc0006f40).stop 2023-11-30T17:24:53.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.483+0000 7fcdd63e1700 1 -- 172.21.15.49:0/3397152679 shutdown_connections 2023-11-30T17:24:53.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.483+0000 7fcdd63e1700 1 --2- 172.21.15.49:0/3397152679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdd01544d0 0x7fcdd0155750 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:53.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.483+0000 7fcdd63e1700 1 -- 172.21.15.49:0/3397152679 >> 172.21.15.49:0/3397152679 conn(0x7fcdd00631d0 msgr2=0x7fcdd00c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:53.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.483+0000 7fcdd63e1700 1 -- 172.21.15.49:0/3397152679 shutdown_connections 2023-11-30T17:24:53.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.483+0000 7fcdd63e1700 1 -- 172.21.15.49:0/3397152679 wait complete. 2023-11-30T17:24:53.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.484+0000 7fcdd63e1700 1 Processor -- start 2023-11-30T17:24:53.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.484+0000 7fcdd63e1700 1 -- start start 2023-11-30T17:24:53.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.485+0000 7fcdd63e1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcdd0066f40 0x7fcdd0157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:53.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.485+0000 7fcdd63e1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdd01544d0 0x7fcdd00c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:53.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.485+0000 7fcdd63e1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdd0155810 0x7fcdd0155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:53.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.485+0000 7fcdd63e1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd0159190 con 0x7fcdd0155810 2023-11-30T17:24:53.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.485+0000 7fcdd63e1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd0158580 con 0x7fcdd01544d0 2023-11-30T17:24:53.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.485+0000 7fcdd63e1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd0158860 con 0x7fcdd0066f40 2023-11-30T17:24:53.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.485+0000 7fcdd497e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdd0155810 0x7fcdd0155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:53.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.485+0000 7fcdd497e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdd0155810 0x7fcdd0155c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45208/0 (socket says 172.21.15.49:45208) 2023-11-30T17:24:53.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.485+0000 7fcdd497e700 1 -- 172.21.15.49:0/584712628 learned_addr learned my addr 172.21.15.49:0/584712628 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:53.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.485+0000 7fcdcffff700 1 --2- 172.21.15.49:0/584712628 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcdd0066f40 0x7fcdd0157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:53.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.485+0000 7fcdcf7fe700 1 --2- 172.21.15.49:0/584712628 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdd01544d0 0x7fcdd00c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:53.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.486+0000 7fcdd497e700 1 -- 172.21.15.49:0/584712628 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcdd0066f40 msgr2=0x7fcdd0157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:53.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.486+0000 7fcdd497e700 1 --2- 172.21.15.49:0/584712628 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcdd0066f40 0x7fcdd0157fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:53.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.486+0000 7fcdd497e700 1 -- 172.21.15.49:0/584712628 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdd01544d0 msgr2=0x7fcdd00c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:53.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.486+0000 7fcdd497e700 1 --2- 172.21.15.49:0/584712628 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdd01544d0 0x7fcdd00c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:53.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.486+0000 7fcdd497e700 1 -- 172.21.15.49:0/584712628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc0009250 con 0x7fcdd0155810 2023-11-30T17:24:53.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.486+0000 7fcdcf7fe700 1 --2- 172.21.15.49:0/584712628 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdd01544d0 0x7fcdd00c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:24:53.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.486+0000 7fcdcffff700 1 --2- 172.21.15.49:0/584712628 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcdd0066f40 0x7fcdd0157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:24:53.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.486+0000 7fcdd497e700 1 --2- 172.21.15.49:0/584712628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdd0155810 0x7fcdd0155c70 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7fcdc800c7c0 tx=0x7fcdc8001560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:53.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.486+0000 7fcdb7fff700 1 -- 172.21.15.49:0/584712628 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc800e4a0 con 0x7fcdd0155810 2023-11-30T17:24:53.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.486+0000 7fcdb7fff700 1 -- 172.21.15.49:0/584712628 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc800e600 con 0x7fcdd0155810 2023-11-30T17:24:53.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.486+0000 7fcdd63e1700 1 -- 172.21.15.49:0/584712628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd0158b40 con 0x7fcdd0155810 2023-11-30T17:24:53.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.486+0000 7fcdb7fff700 1 -- 172.21.15.49:0/584712628 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc800e980 con 0x7fcdd0155810 2023-11-30T17:24:53.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.486+0000 7fcdd63e1700 1 -- 172.21.15.49:0/584712628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd00c8500 con 0x7fcdd0155810 2023-11-30T17:24:53.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.487+0000 7fcdd63e1700 1 -- 172.21.15.49:0/584712628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd006c860 con 0x7fcdd0155810 2023-11-30T17:24:53.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.487+0000 7fcdb7fff700 1 -- 172.21.15.49:0/584712628 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 46) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fcdc801b3b0 con 0x7fcdd0155810 2023-11-30T17:24:53.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.488+0000 7fcdb7fff700 1 --2- 172.21.15.49:0/584712628 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcdbc05f390 0x7fcdbc061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:53.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.488+0000 7fcdcffff700 1 -- 172.21.15.49:0/584712628 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcdbc05f390 msgr2=0x7fcdbc061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:24:53.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.488+0000 7fcdb7fff700 1 -- 172.21.15.49:0/584712628 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6581+0+0 (secure 0 0 0) 0x7fcdc8079f00 con 0x7fcdd0155810 2023-11-30T17:24:53.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.488+0000 7fcdcffff700 1 --2- 172.21.15.49:0/584712628 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcdbc05f390 0x7fcdbc061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:24:53.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.492+0000 7fcdb7fff700 1 -- 172.21.15.49:0/584712628 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcdc8048b00 con 0x7fcdd0155810 2023-11-30T17:24:53.643 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:24:53.641+0000 7fd306e37680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T17:24:53.667 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:53.666+0000 7f32a4990680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T17:24:53.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.689+0000 7fcdcffff700 1 -- 172.21.15.49:0/584712628 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcdbc05f390 msgr2=0x7fcdbc061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:24:53.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.689+0000 7fcdcffff700 1 --2- 172.21.15.49:0/584712628 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcdbc05f390 0x7fcdbc061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:24:53.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.707+0000 7fcdd63e1700 1 -- 172.21.15.49:0/584712628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcdd01592d0 con 0x7fcdd0155810 2023-11-30T17:24:53.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.708+0000 7fcdb7fff700 1 -- 172.21.15.49:0/584712628 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4497 (secure 0 0 0) 0x7fcdc804ad50 con 0x7fcdd0155810 2023-11-30T17:24:53.709 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:24:53.710 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1725128963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1725128963},{"type":"v1","addr":"172.21.15.115:6836","nonce":1725128963}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6955,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3975305695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3975305695},{"type":"v1","addr":"172.21.15.115:6837","nonce":3975305695}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/2909602857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2909602857},{"type":"v1","addr":"172.21.15.49:6834","nonce":2909602857}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:23:31.943367+0000","modified":"2023-11-30T17:23:34.949501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7137},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7137":{"gid":7137,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1751656884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1751656884},{"type":"v1","addr":"172.21.15.49:6835","nonce":1751656884}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-11-30T17:24:53.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.710+0000 7fcdd63e1700 1 -- 172.21.15.49:0/584712628 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcdbc05f390 msgr2=0x7fcdbc061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:24:53.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.710+0000 7fcdd63e1700 1 --2- 172.21.15.49:0/584712628 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcdbc05f390 0x7fcdbc061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:24:53.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.710+0000 7fcdd63e1700 1 -- 172.21.15.49:0/584712628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdd0155810 msgr2=0x7fcdd0155c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:53.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.710+0000 7fcdd63e1700 1 --2- 172.21.15.49:0/584712628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdd0155810 0x7fcdd0155c70 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7fcdc800c7c0 tx=0x7fcdc8001560).stop 2023-11-30T17:24:53.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.710+0000 7fcdd63e1700 1 -- 172.21.15.49:0/584712628 shutdown_connections 2023-11-30T17:24:53.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.710+0000 7fcdd63e1700 1 --2- 172.21.15.49:0/584712628 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcdbc05f390 0x7fcdbc061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:24:53.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.710+0000 7fcdd63e1700 1 --2- 172.21.15.49:0/584712628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdd0155810 0x7fcdd0155c70 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:53.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.710+0000 7fcdd63e1700 1 --2- 172.21.15.49:0/584712628 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcdd0066f40 0x7fcdd0157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:53.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.710+0000 7fcdd63e1700 1 --2- 172.21.15.49:0/584712628 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdd01544d0 0x7fcdd00c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:53.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.710+0000 7fcdd63e1700 1 -- 172.21.15.49:0/584712628 >> 172.21.15.49:0/584712628 conn(0x7fcdd00631d0 msgr2=0x7fcdd014f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:53.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.710+0000 7fcdd63e1700 1 -- 172.21.15.49:0/584712628 shutdown_connections 2023-11-30T17:24:53.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.710+0000 7fcdd63e1700 1 -- 172.21.15.49:0/584712628 wait complete. 2023-11-30T17:24:53.713 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 46 2023-11-30T17:24:53.725 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:24:53.836 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:24:53.835+0000 7fd306e37680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T17:24:53.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.846+0000 7f9a74c9d700 1 Processor -- start 2023-11-30T17:24:53.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.846+0000 7f9a74c9d700 1 -- start start 2023-11-30T17:24:53.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.847+0000 7f9a74c9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a700c1c60 0x7f9a700c2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:53.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.847+0000 7f9a74c9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9a70065a40 0x7f9a701501d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:53.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.847+0000 7f9a74c9d700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a700698f0 con 0x7f9a701506c0 2023-11-30T17:24:53.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.847+0000 7f9a74c9d700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a70069d80 con 0x7f9a70065a40 2023-11-30T17:24:53.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.847+0000 7f9a74c9d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a70068ce0 con 0x7f9a700c1c60 2023-11-30T17:24:53.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.847+0000 7f9a6effd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9a70065a40 0x7f9a701501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:53.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.847+0000 7f9a6effd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9a70065a40 0x7f9a701501d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45214/0 (socket says 172.21.15.49:45214) 2023-11-30T17:24:53.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.847+0000 7f9a6effd700 1 -- 172.21.15.49:0/1546822056 learned_addr learned my addr 172.21.15.49:0/1546822056 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:53.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.847+0000 7f9a6f7fe700 1 --2- 172.21.15.49:0/1546822056 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a700c1c60 0x7f9a700c2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:53.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.847+0000 7f9a6effd700 1 -- 172.21.15.49:0/1546822056 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a700c1c60 msgr2=0x7f9a700c2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:24:53.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.847+0000 7f9a6effd700 1 --2- 172.21.15.49:0/1546822056 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a700c1c60 0x7f9a700c2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:53.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.847+0000 7f9a6effd700 1 -- 172.21.15.49:0/1546822056 >> v1:172.21.15.115:6789/0 conn(0x7f9a701506c0 legacy=0x7f9a701542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:53.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.847+0000 7f9a6effd700 1 -- 172.21.15.49:0/1546822056 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a70068fc0 con 0x7f9a70065a40 2023-11-30T17:24:53.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.847+0000 7f9a6effd700 1 --2- 172.21.15.49:0/1546822056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a70065a40 0x7f9a701501d0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7f9a58006fd0 tx=0x7f9a580090f0).ready entity=mon.0 client_cookie=299af186506210b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:53.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.848+0000 7f9a6e7fc700 1 -- 172.21.15.49:0/1546822056 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5800b580 con 0x7f9a70065a40 2023-11-30T17:24:53.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.848+0000 7f9a6e7fc700 1 -- 172.21.15.49:0/1546822056 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5800b6e0 con 0x7f9a70065a40 2023-11-30T17:24:53.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.848+0000 7f9a6e7fc700 1 -- 172.21.15.49:0/1546822056 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5800ba60 con 0x7f9a70065a40 2023-11-30T17:24:53.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.848+0000 7f9a74c9d700 1 -- 172.21.15.49:0/1546822056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a70065a40 msgr2=0x7f9a701501d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:53.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.848+0000 7f9a74c9d700 1 --2- 172.21.15.49:0/1546822056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a70065a40 0x7f9a701501d0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7f9a58006fd0 tx=0x7f9a580090f0).stop 2023-11-30T17:24:53.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.848+0000 7f9a74c9d700 1 -- 172.21.15.49:0/1546822056 shutdown_connections 2023-11-30T17:24:53.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.848+0000 7f9a74c9d700 1 --2- 172.21.15.49:0/1546822056 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a700c1c60 0x7f9a700c2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:53.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.848+0000 7f9a74c9d700 1 --2- 172.21.15.49:0/1546822056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a70065a40 0x7f9a701501d0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:53.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.848+0000 7f9a74c9d700 1 -- 172.21.15.49:0/1546822056 >> 172.21.15.49:0/1546822056 conn(0x7f9a700631d0 msgr2=0x7f9a700c6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:53.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.848+0000 7f9a74c9d700 1 -- 172.21.15.49:0/1546822056 shutdown_connections 2023-11-30T17:24:53.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.848+0000 7f9a74c9d700 1 -- 172.21.15.49:0/1546822056 wait complete. 2023-11-30T17:24:53.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.849+0000 7f9a74c9d700 1 Processor -- start 2023-11-30T17:24:53.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.850+0000 7f9a74c9d700 1 -- start start 2023-11-30T17:24:53.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.850+0000 7f9a74c9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a70065a40 0x7f9a70159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:53.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.850+0000 7f9a74c9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a700c1c60 0x7f9a70153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:53.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.850+0000 7f9a74c9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a701506c0 0x7f9a700c00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:53.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.850+0000 7f9a74c9d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7015a180 con 0x7f9a700c1c60 2023-11-30T17:24:53.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.850+0000 7f9a74c9d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7015a460 con 0x7f9a70065a40 2023-11-30T17:24:53.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.850+0000 7f9a74c9d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7015a740 con 0x7f9a701506c0 2023-11-30T17:24:53.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.850+0000 7f9a6effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a700c1c60 0x7f9a70153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:53.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.850+0000 7f9a6effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a700c1c60 0x7f9a70153f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45224/0 (socket says 172.21.15.49:45224) 2023-11-30T17:24:53.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.850+0000 7f9a6effd700 1 -- 172.21.15.49:0/3630547005 learned_addr learned my addr 172.21.15.49:0/3630547005 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:53.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.850+0000 7f9a6f7fe700 1 --2- 172.21.15.49:0/3630547005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a70065a40 0x7f9a70159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:53.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.851+0000 7f9a6ffff700 1 --2- 172.21.15.49:0/3630547005 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a701506c0 0x7f9a700c00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:53.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.851+0000 7f9a6effd700 1 -- 172.21.15.49:0/3630547005 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a701506c0 msgr2=0x7f9a700c00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:53.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.851+0000 7f9a6effd700 1 --2- 172.21.15.49:0/3630547005 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a701506c0 0x7f9a700c00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:53.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.851+0000 7f9a6effd700 1 -- 172.21.15.49:0/3630547005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a70065a40 msgr2=0x7f9a70159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:53.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.851+0000 7f9a6effd700 1 --2- 172.21.15.49:0/3630547005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a70065a40 0x7f9a70159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:53.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.851+0000 7f9a6effd700 1 -- 172.21.15.49:0/3630547005 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a58009370 con 0x7f9a700c1c60 2023-11-30T17:24:53.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.851+0000 7f9a6f7fe700 1 --2- 172.21.15.49:0/3630547005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a70065a40 0x7f9a70159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:24:53.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.851+0000 7f9a6effd700 1 --2- 172.21.15.49:0/3630547005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a700c1c60 0x7f9a70153f80 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7f9a58009130 tx=0x7f9a58017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:53.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.851+0000 7f9a677fe700 1 -- 172.21.15.49:0/3630547005 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a58000bc0 con 0x7f9a700c1c60 2023-11-30T17:24:53.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.851+0000 7f9a677fe700 1 -- 172.21.15.49:0/3630547005 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5800b850 con 0x7f9a700c1c60 2023-11-30T17:24:53.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.851+0000 7f9a74c9d700 1 -- 172.21.15.49:0/3630547005 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a7015aa20 con 0x7f9a700c1c60 2023-11-30T17:24:53.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.851+0000 7f9a677fe700 1 -- 172.21.15.49:0/3630547005 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a58000d20 con 0x7f9a700c1c60 2023-11-30T17:24:53.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.851+0000 7f9a74c9d700 1 -- 172.21.15.49:0/3630547005 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a70159d00 con 0x7f9a700c1c60 2023-11-30T17:24:53.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.852+0000 7f9a74c9d700 1 -- 172.21.15.49:0/3630547005 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a700ab0c0 con 0x7f9a700c1c60 2023-11-30T17:24:53.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.853+0000 7f9a677fe700 1 -- 172.21.15.49:0/3630547005 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 46) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f9a5801c900 con 0x7f9a700c1c60 2023-11-30T17:24:53.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.853+0000 7f9a677fe700 1 --2- 172.21.15.49:0/3630547005 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a5005f390 0x7f9a50061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:53.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.853+0000 7f9a677fe700 1 -- 172.21.15.49:0/3630547005 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6581+0+0 (secure 0 0 0) 0x7f9a5807c3b0 con 0x7f9a700c1c60 2023-11-30T17:24:53.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.853+0000 7f9a6f7fe700 1 -- 172.21.15.49:0/3630547005 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a5005f390 msgr2=0x7f9a50061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:24:53.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.853+0000 7f9a6f7fe700 1 --2- 172.21.15.49:0/3630547005 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a5005f390 0x7f9a50061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:24:53.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:53.858+0000 7f9a677fe700 1 -- 172.21.15.49:0/3630547005 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9a5804d090 con 0x7f9a700c1c60 2023-11-30T17:24:54.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.032+0000 7f9a74c9d700 1 -- 172.21.15.49:0/3630547005 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a7006c7c0 con 0x7f9a700c1c60 2023-11-30T17:24:54.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.033+0000 7f9a677fe700 1 -- 172.21.15.49:0/3630547005 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+17646 (secure 0 0 0) 0x7f9a5802a090 con 0x7f9a700c1c60 2023-11-30T17:24:54.035 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:24:54.035 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":116,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:24:50.023892+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:23:30.500365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-30T17:23:30.919592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.23","mappings":[{"from":1,"to":5}]},{"pgid":"13.24","mappings":[{"from":6,"to":3}]},{"pgid":"14.2","mappings":[{"from":1,"to":7}]},{"pgid":"14.10","mappings":[{"from":1,"to":5}]},{"pgid":"14.31","mappings":[{"from":1,"to":7}]},{"pgid":"14.33","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/77045411":"2023-12-01T17:23:48.438312+0000","172.21.15.115:0/2457916531":"2023-12-01T17:23:48.438312+0000","172.21.15.115:6833/89956":"2023-12-01T17:23:48.438312+0000","172.21.15.115:6832/89956":"2023-12-01T17:23:48.438312+0000","172.21.15.115:0/2333450332":"2023-12-01T17:23:48.438312+0000","172.21.15.115:0/3126496541":"2023-12-01T17:23:48.438312+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:24:54.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.035+0000 7f9a74c9d700 1 -- 172.21.15.49:0/3630547005 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a5005f390 msgr2=0x7f9a50061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:24:54.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.035+0000 7f9a74c9d700 1 --2- 172.21.15.49:0/3630547005 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a5005f390 0x7f9a50061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:24:54.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.035+0000 7f9a74c9d700 1 -- 172.21.15.49:0/3630547005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a700c1c60 msgr2=0x7f9a70153f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:54.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.035+0000 7f9a74c9d700 1 --2- 172.21.15.49:0/3630547005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a700c1c60 0x7f9a70153f80 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7f9a58009130 tx=0x7f9a58017000).stop 2023-11-30T17:24:54.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.035+0000 7f9a74c9d700 1 -- 172.21.15.49:0/3630547005 shutdown_connections 2023-11-30T17:24:54.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.035+0000 7f9a74c9d700 1 --2- 172.21.15.49:0/3630547005 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a701506c0 0x7f9a700c00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:54.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.035+0000 7f9a74c9d700 1 --2- 172.21.15.49:0/3630547005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a70065a40 0x7f9a70159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:54.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.035+0000 7f9a74c9d700 1 --2- 172.21.15.49:0/3630547005 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a5005f390 0x7f9a50061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:24:54.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.035+0000 7f9a74c9d700 1 --2- 172.21.15.49:0/3630547005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a700c1c60 0x7f9a70153f80 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:54.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.035+0000 7f9a74c9d700 1 -- 172.21.15.49:0/3630547005 >> 172.21.15.49:0/3630547005 conn(0x7f9a700631d0 msgr2=0x7f9a700646b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:54.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.035+0000 7f9a74c9d700 1 -- 172.21.15.49:0/3630547005 shutdown_connections 2023-11-30T17:24:54.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.035+0000 7f9a74c9d700 1 -- 172.21.15.49:0/3630547005 wait complete. 2023-11-30T17:24:54.050 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-30T17:24:54.050 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:24:54.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.168+0000 7f0e4bcc4700 1 Processor -- start 2023-11-30T17:24:54.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.168+0000 7f0e4bcc4700 1 -- start start 2023-11-30T17:24:54.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.169+0000 7f0e4bcc4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e4406b510 0x7f0e441546f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:54.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.169+0000 7f0e4bcc4700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e44063380 con 0x7f0e440c0d10 2023-11-30T17:24:54.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.169+0000 7f0e4bcc4700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e44062770 con 0x7f0e440c10f0 2023-11-30T17:24:54.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.169+0000 7f0e4bcc4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e440c19e0 con 0x7f0e4406b510 2023-11-30T17:24:54.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.169+0000 7f0e49a60700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0e440c0d10 0x7f0e44153fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33320/0 (socket says 172.21.15.49:33320) 2023-11-30T17:24:54.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.170+0000 7f0e49a60700 1 -- 172.21.15.49:0/3008766628 learned_addr learned my addr 172.21.15.49:0/3008766628 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:24:54.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.170+0000 7f0e4925f700 1 --2- 172.21.15.49:0/3008766628 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e4406b510 0x7f0e441546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:54.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.170+0000 7f0e48a5e700 1 -- 172.21.15.49:0/3008766628 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 56172969 0 0) 0x7f0e44063380 con 0x7f0e440c0d10 2023-11-30T17:24:54.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.170+0000 7f0e48a5e700 1 -- 172.21.15.49:0/3008766628 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e300033f0 con 0x7f0e440c0d10 2023-11-30T17:24:54.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.170+0000 7f0e48a5e700 1 -- 172.21.15.49:0/3008766628 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3855106153 0 0) 0x7f0e44062770 con 0x7f0e440c10f0 2023-11-30T17:24:54.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.170+0000 7f0e48a5e700 1 -- 172.21.15.49:0/3008766628 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e44063380 con 0x7f0e440c10f0 2023-11-30T17:24:54.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.170+0000 7f0e4925f700 1 -- 172.21.15.49:0/3008766628 >> v1:172.21.15.115:6789/0 conn(0x7f0e440c10f0 legacy=0x7f0e440c2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:54.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.170+0000 7f0e4925f700 1 -- 172.21.15.49:0/3008766628 >> v1:172.21.15.49:6789/0 conn(0x7f0e440c0d10 legacy=0x7f0e44153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:54.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.170+0000 7f0e4925f700 1 -- 172.21.15.49:0/3008766628 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e44062a50 con 0x7f0e4406b510 2023-11-30T17:24:54.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.170+0000 7f0e4925f700 1 --2- 172.21.15.49:0/3008766628 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e4406b510 0x7f0e441546f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f0e40009790 tx=0x7f0e40009060).ready entity=mon.2 client_cookie=cd275a7af0b07b7b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:54.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.170+0000 7f0e48a5e700 1 -- 172.21.15.49:0/3008766628 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4000f510 con 0x7f0e4406b510 2023-11-30T17:24:54.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.170+0000 7f0e48a5e700 1 -- 172.21.15.49:0/3008766628 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4000f670 con 0x7f0e4406b510 2023-11-30T17:24:54.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.170+0000 7f0e48a5e700 1 -- 172.21.15.49:0/3008766628 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4000f9f0 con 0x7f0e4406b510 2023-11-30T17:24:54.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.171+0000 7f0e4bcc4700 1 -- 172.21.15.49:0/3008766628 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e4406b510 msgr2=0x7f0e441546f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:54.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.171+0000 7f0e4bcc4700 1 --2- 172.21.15.49:0/3008766628 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e4406b510 0x7f0e441546f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f0e40009790 tx=0x7f0e40009060).stop 2023-11-30T17:24:54.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.171+0000 7f0e4bcc4700 1 -- 172.21.15.49:0/3008766628 shutdown_connections 2023-11-30T17:24:54.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.171+0000 7f0e4bcc4700 1 --2- 172.21.15.49:0/3008766628 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e4406b510 0x7f0e441546f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:54.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.171+0000 7f0e4bcc4700 1 -- 172.21.15.49:0/3008766628 >> 172.21.15.49:0/3008766628 conn(0x7f0e440c7760 msgr2=0x7f0e440c7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:54.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.171+0000 7f0e4bcc4700 1 -- 172.21.15.49:0/3008766628 shutdown_connections 2023-11-30T17:24:54.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.171+0000 7f0e4bcc4700 1 -- 172.21.15.49:0/3008766628 wait complete. 2023-11-30T17:24:54.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.172+0000 7f0e4bcc4700 1 Processor -- start 2023-11-30T17:24:54.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.172+0000 7f0e4bcc4700 1 -- start start 2023-11-30T17:24:54.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.173+0000 7f0e4bcc4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e4406b510 0x7f0e4414b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:54.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.173+0000 7f0e4bcc4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e440c0d10 0x7f0e4414e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:54.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.173+0000 7f0e4bcc4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e440c10f0 0x7f0e4414ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:54.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.173+0000 7f0e4bcc4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e44149890 con 0x7f0e4406b510 2023-11-30T17:24:54.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.173+0000 7f0e4bcc4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e44148af0 con 0x7f0e440c10f0 2023-11-30T17:24:54.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.173+0000 7f0e4bcc4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e44149cb0 con 0x7f0e440c0d10 2023-11-30T17:24:54.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.173+0000 7f0e49a60700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e4406b510 0x7f0e4414b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:54.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.173+0000 7f0e49a60700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e4406b510 0x7f0e4414b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45238/0 (socket says 172.21.15.49:45238) 2023-11-30T17:24:54.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.173+0000 7f0e49a60700 1 -- 172.21.15.49:0/2871577325 learned_addr learned my addr 172.21.15.49:0/2871577325 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:54.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.173+0000 7f0e4925f700 1 --2- 172.21.15.49:0/2871577325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e440c0d10 0x7f0e4414e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:54.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.173+0000 7f0e4a261700 1 --2- 172.21.15.49:0/2871577325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e440c10f0 0x7f0e4414ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:54.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.173+0000 7f0e49a60700 1 -- 172.21.15.49:0/2871577325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e440c0d10 msgr2=0x7f0e4414e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:54.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.173+0000 7f0e49a60700 1 --2- 172.21.15.49:0/2871577325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e440c0d10 0x7f0e4414e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:54.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.173+0000 7f0e49a60700 1 -- 172.21.15.49:0/2871577325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e440c10f0 msgr2=0x7f0e4414ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:54.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.173+0000 7f0e49a60700 1 --2- 172.21.15.49:0/2871577325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e440c10f0 0x7f0e4414ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:54.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.173+0000 7f0e49a60700 1 -- 172.21.15.49:0/2871577325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e400092a0 con 0x7f0e4406b510 2023-11-30T17:24:54.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.174+0000 7f0e49a60700 1 --2- 172.21.15.49:0/2871577325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e4406b510 0x7f0e4414b9d0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7f0e3400c560 tx=0x7f0e34007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:54.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.174+0000 7f0e39ffb700 1 -- 172.21.15.49:0/2871577325 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3400ce70 con 0x7f0e4406b510 2023-11-30T17:24:54.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.174+0000 7f0e39ffb700 1 -- 172.21.15.49:0/2871577325 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e340072e0 con 0x7f0e4406b510 2023-11-30T17:24:54.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.174+0000 7f0e39ffb700 1 -- 172.21.15.49:0/2871577325 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e34007660 con 0x7f0e4406b510 2023-11-30T17:24:54.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.174+0000 7f0e4bcc4700 1 -- 172.21.15.49:0/2871577325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e44148ca0 con 0x7f0e4406b510 2023-11-30T17:24:54.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.174+0000 7f0e4bcc4700 1 -- 172.21.15.49:0/2871577325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e441494b0 con 0x7f0e4406b510 2023-11-30T17:24:54.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.175+0000 7f0e4bcc4700 1 -- 172.21.15.49:0/2871577325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e4406c860 con 0x7f0e4406b510 2023-11-30T17:24:54.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.175+0000 7f0e39ffb700 1 -- 172.21.15.49:0/2871577325 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 46) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f0e340059b0 con 0x7f0e4406b510 2023-11-30T17:24:54.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.176+0000 7f0e39ffb700 1 --2- 172.21.15.49:0/2871577325 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0e2805f390 0x7f0e28061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:54.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.176+0000 7f0e4925f700 1 -- 172.21.15.49:0/2871577325 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0e2805f390 msgr2=0x7f0e28061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:24:54.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.176+0000 7f0e39ffb700 1 -- 172.21.15.49:0/2871577325 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6581+0+0 (secure 0 0 0) 0x7f0e34079e10 con 0x7f0e4406b510 2023-11-30T17:24:54.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.176+0000 7f0e4925f700 1 --2- 172.21.15.49:0/2871577325 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0e2805f390 0x7f0e28061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:24:54.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.180+0000 7f0e39ffb700 1 -- 172.21.15.49:0/2871577325 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0e3404e640 con 0x7f0e4406b510 2023-11-30T17:24:54.314 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:54.313+0000 7f32a4990680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T17:24:54.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.377+0000 7f0e4925f700 1 -- 172.21.15.49:0/2871577325 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0e2805f390 msgr2=0x7f0e28061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:24:54.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.377+0000 7f0e4925f700 1 --2- 172.21.15.49:0/2871577325 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0e2805f390 0x7f0e28061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:24:54.383 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:54.381+0000 7f32a4990680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T17:24:54.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.396+0000 7f0e4bcc4700 1 -- 172.21.15.49:0/2871577325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e44062d30 con 0x7f0e4406b510 2023-11-30T17:24:54.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.397+0000 7f0e39ffb700 1 -- 172.21.15.49:0/2871577325 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f0e34007e60 con 0x7f0e4406b510 2023-11-30T17:24:54.398 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:24:54.398 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1725128963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1725128963},{"type":"v1","addr":"172.21.15.115:6836","nonce":1725128963}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6955,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3975305695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3975305695},{"type":"v1","addr":"172.21.15.115:6837","nonce":3975305695}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/2909602857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2909602857},{"type":"v1","addr":"172.21.15.49:6834","nonce":2909602857}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:23:31.943367+0000","modified":"2023-11-30T17:23:34.949501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7137},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7137":{"gid":7137,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1751656884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1751656884},{"type":"v1","addr":"172.21.15.49:6835","nonce":1751656884}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-11-30T17:24:54.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.399+0000 7f0e4bcc4700 1 -- 172.21.15.49:0/2871577325 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0e2805f390 msgr2=0x7f0e28061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:24:54.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.399+0000 7f0e4bcc4700 1 --2- 172.21.15.49:0/2871577325 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0e2805f390 0x7f0e28061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:24:54.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.399+0000 7f0e4bcc4700 1 -- 172.21.15.49:0/2871577325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e4406b510 msgr2=0x7f0e4414b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:54.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.399+0000 7f0e4bcc4700 1 --2- 172.21.15.49:0/2871577325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e4406b510 0x7f0e4414b9d0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7f0e3400c560 tx=0x7f0e34007d20).stop 2023-11-30T17:24:54.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.399+0000 7f0e4bcc4700 1 -- 172.21.15.49:0/2871577325 shutdown_connections 2023-11-30T17:24:54.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.399+0000 7f0e4bcc4700 1 --2- 172.21.15.49:0/2871577325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e440c10f0 0x7f0e4414ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:54.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.399+0000 7f0e4bcc4700 1 --2- 172.21.15.49:0/2871577325 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0e2805f390 0x7f0e28061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:24:54.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.399+0000 7f0e4bcc4700 1 --2- 172.21.15.49:0/2871577325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e4406b510 0x7f0e4414b9d0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:54.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.399+0000 7f0e4bcc4700 1 --2- 172.21.15.49:0/2871577325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e440c0d10 0x7f0e4414e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:54.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.399+0000 7f0e4bcc4700 1 -- 172.21.15.49:0/2871577325 >> 172.21.15.49:0/2871577325 conn(0x7f0e440c7760 msgr2=0x7f0e441531f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:54.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.399+0000 7f0e4bcc4700 1 -- 172.21.15.49:0/2871577325 shutdown_connections 2023-11-30T17:24:54.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.399+0000 7f0e4bcc4700 1 -- 172.21.15.49:0/2871577325 wait complete. 2023-11-30T17:24:54.401 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 46 2023-11-30T17:24:54.414 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:24:54.458 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:54.457+0000 7f32a4990680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T17:24:54.535 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:24:54.533+0000 7fd306e37680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T17:24:54.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.533+0000 7ff481e43700 1 Processor -- start 2023-11-30T17:24:54.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.534+0000 7ff481e43700 1 -- start start 2023-11-30T17:24:54.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.534+0000 7ff481e43700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff47c0ca180 0x7ff47c15f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:54.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.534+0000 7ff481e43700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff47c0a9a90 con 0x7ff47c0cae90 2023-11-30T17:24:54.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.534+0000 7ff481e43700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff47c154ce0 con 0x7ff47c0caab0 2023-11-30T17:24:54.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.534+0000 7ff481e43700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff47c0aab80 con 0x7ff47c0ca180 2023-11-30T17:24:54.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.535+0000 7ff47bfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff47c0ca180 0x7ff47c15f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:54.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.535+0000 7ff47affd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff47c0cae90 0x7ff47c0c0ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33328/0 (socket says 172.21.15.49:33328) 2023-11-30T17:24:54.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.535+0000 7ff47affd700 1 -- 172.21.15.49:0/920681294 learned_addr learned my addr 172.21.15.49:0/920681294 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:24:54.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.535+0000 7ff47bfff700 1 -- 172.21.15.49:0/920681294 >> v1:172.21.15.115:6789/0 conn(0x7ff47c0caab0 legacy=0x7ff47c0aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:54.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.535+0000 7ff47bfff700 1 -- 172.21.15.49:0/920681294 >> v1:172.21.15.49:6789/0 conn(0x7ff47c0cae90 legacy=0x7ff47c0c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:54.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.535+0000 7ff47bfff700 1 -- 172.21.15.49:0/920681294 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c0a8e80 con 0x7ff47c0ca180 2023-11-30T17:24:54.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.535+0000 7ff47a7fc700 1 -- 172.21.15.49:0/920681294 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2682001882 0 0) 0x7ff47c0a9a90 con 0x7ff47c0cae90 2023-11-30T17:24:54.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.535+0000 7ff47bfff700 1 --2- 172.21.15.49:0/920681294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff47c0ca180 0x7ff47c15f3d0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7ff474009e60 tx=0x7ff474009780).ready entity=mon.0 client_cookie=cd6cdb139595b157 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:54.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.535+0000 7ff47a7fc700 1 -- 172.21.15.49:0/920681294 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47400e070 con 0x7ff47c0ca180 2023-11-30T17:24:54.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.535+0000 7ff47a7fc700 1 -- 172.21.15.49:0/920681294 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47400bc30 con 0x7ff47c0ca180 2023-11-30T17:24:54.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.535+0000 7ff47a7fc700 1 -- 172.21.15.49:0/920681294 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff474012410 con 0x7ff47c0ca180 2023-11-30T17:24:54.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.536+0000 7ff481e43700 1 -- 172.21.15.49:0/920681294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff47c0ca180 msgr2=0x7ff47c15f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:54.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.536+0000 7ff481e43700 1 --2- 172.21.15.49:0/920681294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff47c0ca180 0x7ff47c15f3d0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7ff474009e60 tx=0x7ff474009780).stop 2023-11-30T17:24:54.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.536+0000 7ff481e43700 1 -- 172.21.15.49:0/920681294 shutdown_connections 2023-11-30T17:24:54.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.536+0000 7ff481e43700 1 --2- 172.21.15.49:0/920681294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff47c0ca180 0x7ff47c15f3d0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:54.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.536+0000 7ff481e43700 1 -- 172.21.15.49:0/920681294 >> 172.21.15.49:0/920681294 conn(0x7ff47c094920 msgr2=0x7ff47c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:54.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.536+0000 7ff481e43700 1 -- 172.21.15.49:0/920681294 shutdown_connections 2023-11-30T17:24:54.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.536+0000 7ff481e43700 1 -- 172.21.15.49:0/920681294 wait complete. 2023-11-30T17:24:54.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.537+0000 7ff481e43700 1 Processor -- start 2023-11-30T17:24:54.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.537+0000 7ff481e43700 1 -- start start 2023-11-30T17:24:54.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.538+0000 7ff481e43700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff47c0ca180 0x7ff47c1646d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:54.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.538+0000 7ff481e43700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff47c0caab0 0x7ff47c1658a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:54.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.538+0000 7ff481e43700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff47c0cae90 0x7ff47c167300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:54.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.538+0000 7ff481e43700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c165730 con 0x7ff47c0cae90 2023-11-30T17:24:54.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.538+0000 7ff481e43700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c0c6510 con 0x7ff47c0ca180 2023-11-30T17:24:54.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.538+0000 7ff481e43700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c164bc0 con 0x7ff47c0caab0 2023-11-30T17:24:54.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.538+0000 7ff47bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff47c0cae90 0x7ff47c167300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:54.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.538+0000 7ff47bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff47c0cae90 0x7ff47c167300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45248/0 (socket says 172.21.15.49:45248) 2023-11-30T17:24:54.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.538+0000 7ff47bfff700 1 -- 172.21.15.49:0/4228268446 learned_addr learned my addr 172.21.15.49:0/4228268446 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:54.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.538+0000 7ff47b7fe700 1 --2- 172.21.15.49:0/4228268446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff47c0ca180 0x7ff47c1646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:54.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.538+0000 7ff47affd700 1 --2- 172.21.15.49:0/4228268446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff47c0caab0 0x7ff47c1658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:54.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.539+0000 7ff47bfff700 1 -- 172.21.15.49:0/4228268446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff47c0caab0 msgr2=0x7ff47c1658a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:54.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.539+0000 7ff47bfff700 1 --2- 172.21.15.49:0/4228268446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff47c0caab0 0x7ff47c1658a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:54.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.539+0000 7ff47bfff700 1 -- 172.21.15.49:0/4228268446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff47c0ca180 msgr2=0x7ff47c1646d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:54.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.539+0000 7ff47bfff700 1 --2- 172.21.15.49:0/4228268446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff47c0ca180 0x7ff47c1646d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:54.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.539+0000 7ff47bfff700 1 -- 172.21.15.49:0/4228268446 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff474009a20 con 0x7ff47c0cae90 2023-11-30T17:24:54.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.539+0000 7ff47bfff700 1 --2- 172.21.15.49:0/4228268446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff47c0cae90 0x7ff47c167300 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7ff47400b6c0 tx=0x7ff474009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:54.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.539+0000 7ff4637fe700 1 -- 172.21.15.49:0/4228268446 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47400b6f0 con 0x7ff47c0cae90 2023-11-30T17:24:54.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.539+0000 7ff4637fe700 1 -- 172.21.15.49:0/4228268446 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff474013e00 con 0x7ff47c0cae90 2023-11-30T17:24:54.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.539+0000 7ff481e43700 1 -- 172.21.15.49:0/4228268446 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47c164e90 con 0x7ff47c0cae90 2023-11-30T17:24:54.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.539+0000 7ff4637fe700 1 -- 172.21.15.49:0/4228268446 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4740069c0 con 0x7ff47c0cae90 2023-11-30T17:24:54.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.539+0000 7ff481e43700 1 -- 172.21.15.49:0/4228268446 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff47c165450 con 0x7ff47c0cae90 2023-11-30T17:24:54.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.540+0000 7ff4637fe700 1 -- 172.21.15.49:0/4228268446 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 46) v1 ==== 75662+0+0 (secure 0 0 0) 0x7ff47401d630 con 0x7ff47c0cae90 2023-11-30T17:24:54.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.540+0000 7ff481e43700 1 -- 172.21.15.49:0/4228268446 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff47c0c62e0 con 0x7ff47c0cae90 2023-11-30T17:24:54.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.541+0000 7ff4637fe700 1 --2- 172.21.15.49:0/4228268446 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff46805f390 0x7ff468061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:54.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.541+0000 7ff4637fe700 1 -- 172.21.15.49:0/4228268446 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6581+0+0 (secure 0 0 0) 0x7ff47407cd10 con 0x7ff47c0cae90 2023-11-30T17:24:54.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.541+0000 7ff47b7fe700 1 -- 172.21.15.49:0/4228268446 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff46805f390 msgr2=0x7ff468061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:24:54.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.541+0000 7ff47b7fe700 1 --2- 172.21.15.49:0/4228268446 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff46805f390 0x7ff468061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:24:54.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.545+0000 7ff4637fe700 1 -- 172.21.15.49:0/4228268446 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff47c0c62e0 con 0x7ff47c0cae90 2023-11-30T17:24:54.606 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:54.604+0000 7f32a4990680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T17:24:54.609 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:24:54.608+0000 7fd306e37680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T17:24:54.676 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:54.674+0000 7f32a4990680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T17:24:54.690 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:24:54.688+0000 7fd306e37680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T17:24:54.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.742+0000 7ff47b7fe700 1 -- 172.21.15.49:0/4228268446 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff46805f390 msgr2=0x7ff468061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:24:54.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.742+0000 7ff47b7fe700 1 --2- 172.21.15.49:0/4228268446 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff46805f390 0x7ff468061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:24:54.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.761+0000 7ff481e43700 1 -- 172.21.15.49:0/4228268446 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff47c0c62e0 con 0x7ff47c0cae90 2023-11-30T17:24:54.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.761+0000 7ff4637fe700 1 -- 172.21.15.49:0/4228268446 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4497 (secure 0 0 0) 0x7ff47c0c62e0 con 0x7ff47c0cae90 2023-11-30T17:24:54.763 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:24:54.763 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1725128963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1725128963},{"type":"v1","addr":"172.21.15.115:6836","nonce":1725128963}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6955,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3975305695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3975305695},{"type":"v1","addr":"172.21.15.115:6837","nonce":3975305695}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/2909602857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2909602857},{"type":"v1","addr":"172.21.15.49:6834","nonce":2909602857}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:23:31.943367+0000","modified":"2023-11-30T17:23:34.949501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7137},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7137":{"gid":7137,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1751656884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1751656884},{"type":"v1","addr":"172.21.15.49:6835","nonce":1751656884}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-11-30T17:24:54.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.763+0000 7ff481e43700 1 -- 172.21.15.49:0/4228268446 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff46805f390 msgr2=0x7ff468061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:24:54.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.763+0000 7ff481e43700 1 --2- 172.21.15.49:0/4228268446 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff46805f390 0x7ff468061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:24:54.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.763+0000 7ff481e43700 1 -- 172.21.15.49:0/4228268446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff47c0cae90 msgr2=0x7ff47c167300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:54.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.763+0000 7ff481e43700 1 --2- 172.21.15.49:0/4228268446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff47c0cae90 0x7ff47c167300 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7ff47400b6c0 tx=0x7ff474009780).stop 2023-11-30T17:24:54.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.763+0000 7ff481e43700 1 -- 172.21.15.49:0/4228268446 shutdown_connections 2023-11-30T17:24:54.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.763+0000 7ff481e43700 1 --2- 172.21.15.49:0/4228268446 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff46805f390 0x7ff468061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:24:54.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.763+0000 7ff481e43700 1 --2- 172.21.15.49:0/4228268446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff47c0cae90 0x7ff47c167300 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:54.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.763+0000 7ff481e43700 1 --2- 172.21.15.49:0/4228268446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff47c0ca180 0x7ff47c1646d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:54.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.763+0000 7ff481e43700 1 --2- 172.21.15.49:0/4228268446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff47c0caab0 0x7ff47c1658a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:54.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.763+0000 7ff481e43700 1 -- 172.21.15.49:0/4228268446 >> 172.21.15.49:0/4228268446 conn(0x7ff47c094920 msgr2=0x7ff47c0aeb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:54.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.763+0000 7ff481e43700 1 -- 172.21.15.49:0/4228268446 shutdown_connections 2023-11-30T17:24:54.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.763+0000 7ff481e43700 1 -- 172.21.15.49:0/4228268446 wait complete. 2023-11-30T17:24:54.766 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 46 2023-11-30T17:24:54.778 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:24:54.791 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:54.790+0000 7f32a4990680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T17:24:54.847 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:24:54.846+0000 7fd306e37680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T17:24:54.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.895+0000 7fe09f59e700 1 Processor -- start 2023-11-30T17:24:54.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.895+0000 7fe09f59e700 1 -- start start 2023-11-30T17:24:54.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.896+0000 7fe09f59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a00c2cb0 0x7fe0a00a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:54.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.896+0000 7fe09f59e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe0a0062700 0x7fe0a0062b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:54.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.896+0000 7fe09f59e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a00a6720 con 0x7fe0a0154230 2023-11-30T17:24:54.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.896+0000 7fe09f59e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a0063080 con 0x7fe0a0062700 2023-11-30T17:24:54.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.896+0000 7fe09f59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a00c2540 con 0x7fe0a00c2cb0 2023-11-30T17:24:54.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.896+0000 7fe09ed9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe0a0062700 0x7fe0a0062b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:54.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.896+0000 7fe09e59c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe0a0154230 0x7fe0a00a6010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33334/0 (socket says 172.21.15.49:33334) 2023-11-30T17:24:54.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.896+0000 7fe09e59c700 1 -- 172.21.15.49:0/3253139209 learned_addr learned my addr 172.21.15.49:0/3253139209 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:24:54.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.896+0000 7fe09dd9b700 1 --2- 172.21.15.49:0/3253139209 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a00c2cb0 0x7fe0a00a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:54.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.897+0000 7fe09ed9d700 1 -- 172.21.15.49:0/3253139209 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a00c2cb0 msgr2=0x7fe0a00a48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:24:54.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.897+0000 7fe09ed9d700 1 --2- 172.21.15.49:0/3253139209 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a00c2cb0 0x7fe0a00a48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:54.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.897+0000 7fe09ed9d700 1 -- 172.21.15.49:0/3253139209 >> v1:172.21.15.49:6789/0 conn(0x7fe0a0154230 legacy=0x7fe0a00a6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:54.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.897+0000 7fe09ed9d700 1 -- 172.21.15.49:0/3253139209 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a00a4f70 con 0x7fe0a0062700 2023-11-30T17:24:54.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.897+0000 7fe09d59a700 1 -- 172.21.15.49:0/3253139209 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4290834379 0 0) 0x7fe0a00a6720 con 0x7fe0a0154230 2023-11-30T17:24:54.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.897+0000 7fe09ed9d700 1 --2- 172.21.15.49:0/3253139209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0a0062700 0x7fe0a0062b90 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7fe098009e60 tx=0x7fe098009780).ready entity=mon.0 client_cookie=2af25c67ef589d6a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:54.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.897+0000 7fe09d59a700 1 -- 172.21.15.49:0/3253139209 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09800e070 con 0x7fe0a0062700 2023-11-30T17:24:54.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.897+0000 7fe09d59a700 1 -- 172.21.15.49:0/3253139209 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09800bb60 con 0x7fe0a0062700 2023-11-30T17:24:54.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.897+0000 7fe09d59a700 1 -- 172.21.15.49:0/3253139209 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe098012410 con 0x7fe0a0062700 2023-11-30T17:24:54.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.897+0000 7fe09f59e700 1 -- 172.21.15.49:0/3253139209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0a0062700 msgr2=0x7fe0a0062b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:54.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.897+0000 7fe09f59e700 1 --2- 172.21.15.49:0/3253139209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0a0062700 0x7fe0a0062b90 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7fe098009e60 tx=0x7fe098009780).stop 2023-11-30T17:24:54.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.898+0000 7fe09f59e700 1 -- 172.21.15.49:0/3253139209 shutdown_connections 2023-11-30T17:24:54.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.898+0000 7fe09f59e700 1 --2- 172.21.15.49:0/3253139209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0a0062700 0x7fe0a0062b90 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:54.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.898+0000 7fe09f59e700 1 --2- 172.21.15.49:0/3253139209 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a00c2cb0 0x7fe0a00a48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:54.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.898+0000 7fe09f59e700 1 -- 172.21.15.49:0/3253139209 >> 172.21.15.49:0/3253139209 conn(0x7fe0a00c7ca0 msgr2=0x7fe0a00c80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:54.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.898+0000 7fe09f59e700 1 -- 172.21.15.49:0/3253139209 shutdown_connections 2023-11-30T17:24:54.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.898+0000 7fe09f59e700 1 -- 172.21.15.49:0/3253139209 wait complete. 2023-11-30T17:24:54.902 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:54.898+0000 7f32a4990680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:24:54.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.899+0000 7fe09f59e700 1 Processor -- start 2023-11-30T17:24:54.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.899+0000 7fe09f59e700 1 -- start start 2023-11-30T17:24:54.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.900+0000 7fe09f59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0a0062700 0x7fe0a014ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:54.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.900+0000 7fe09f59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a00c2cb0 0x7fe0a00672b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:54.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.900+0000 7fe09f59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0a0154230 0x7fe0a00677a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:54.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.900+0000 7fe09f59e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a00bed40 con 0x7fe0a0062700 2023-11-30T17:24:54.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.900+0000 7fe09f59e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a00bf8c0 con 0x7fe0a0154230 2023-11-30T17:24:54.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.900+0000 7fe09f59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a00bef90 con 0x7fe0a00c2cb0 2023-11-30T17:24:54.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.900+0000 7fe09e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0a0062700 0x7fe0a014ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:54.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.900+0000 7fe09e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0a0062700 0x7fe0a014ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45278/0 (socket says 172.21.15.49:45278) 2023-11-30T17:24:54.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.900+0000 7fe09e59c700 1 -- 172.21.15.49:0/1921835882 learned_addr learned my addr 172.21.15.49:0/1921835882 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:54.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.900+0000 7fe09dd9b700 1 --2- 172.21.15.49:0/1921835882 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a00c2cb0 0x7fe0a00672b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:54.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.900+0000 7fe09ed9d700 1 --2- 172.21.15.49:0/1921835882 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0a0154230 0x7fe0a00677a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:54.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.900+0000 7fe09dd9b700 1 -- 172.21.15.49:0/1921835882 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0a0154230 msgr2=0x7fe0a00677a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:54.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.900+0000 7fe09dd9b700 1 --2- 172.21.15.49:0/1921835882 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0a0154230 0x7fe0a00677a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:54.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.900+0000 7fe09dd9b700 1 -- 172.21.15.49:0/1921835882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0a0062700 msgr2=0x7fe0a014ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:54.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.900+0000 7fe09dd9b700 1 --2- 172.21.15.49:0/1921835882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0a0062700 0x7fe0a014ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:54.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.900+0000 7fe09dd9b700 1 -- 172.21.15.49:0/1921835882 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe098009a20 con 0x7fe0a00c2cb0 2023-11-30T17:24:54.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.900+0000 7fe09e59c700 1 --2- 172.21.15.49:0/1921835882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0a0062700 0x7fe0a014ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:24:54.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.900+0000 7fe09dd9b700 1 --2- 172.21.15.49:0/1921835882 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a00c2cb0 0x7fe0a00672b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fe09000e900 tx=0x7fe090009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:54.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.900+0000 7fe08e7fc700 1 -- 172.21.15.49:0/1921835882 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe090012600 con 0x7fe0a00c2cb0 2023-11-30T17:24:54.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.900+0000 7fe08e7fc700 1 -- 172.21.15.49:0/1921835882 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe090012760 con 0x7fe0a00c2cb0 2023-11-30T17:24:54.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.900+0000 7fe09f59e700 1 -- 172.21.15.49:0/1921835882 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a00bf270 con 0x7fe0a00c2cb0 2023-11-30T17:24:54.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.900+0000 7fe08e7fc700 1 -- 172.21.15.49:0/1921835882 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe090012ae0 con 0x7fe0a00c2cb0 2023-11-30T17:24:54.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.900+0000 7fe09f59e700 1 -- 172.21.15.49:0/1921835882 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a014cf70 con 0x7fe0a00c2cb0 2023-11-30T17:24:54.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.902+0000 7fe09f59e700 1 -- 172.21.15.49:0/1921835882 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a006c7c0 con 0x7fe0a00c2cb0 2023-11-30T17:24:54.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.902+0000 7fe08e7fc700 1 -- 172.21.15.49:0/1921835882 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 46) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fe09001b400 con 0x7fe0a00c2cb0 2023-11-30T17:24:54.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.902+0000 7fe08e7fc700 1 --2- 172.21.15.49:0/1921835882 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe08005f390 0x7fe080061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:54.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.902+0000 7fe09e59c700 1 -- 172.21.15.49:0/1921835882 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe08005f390 msgr2=0x7fe080061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:24:54.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.902+0000 7fe08e7fc700 1 -- 172.21.15.49:0/1921835882 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6581+0+0 (secure 0 0 0) 0x7fe09007abf0 con 0x7fe0a00c2cb0 2023-11-30T17:24:54.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.902+0000 7fe09e59c700 1 --2- 172.21.15.49:0/1921835882 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe08005f390 0x7fe080061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:24:54.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:54.911+0000 7fe08e7fc700 1 -- 172.21.15.49:0/1921835882 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe090081080 con 0x7fe0a00c2cb0 2023-11-30T17:24:54.924 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:24:54.923+0000 7fd306e37680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T17:24:55.046 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:24:55.044+0000 7fd306e37680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T17:24:55.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.084+0000 7fe09f59e700 1 -- 172.21.15.49:0/1921835882 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0a00bfa00 con 0x7fe0a00c2cb0 2023-11-30T17:24:55.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.085+0000 7fe08e7fc700 1 -- 172.21.15.49:0/1921835882 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+17646 (secure 0 0 0) 0x7fe09004b9f0 con 0x7fe0a00c2cb0 2023-11-30T17:24:55.087 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:24:55.087 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":116,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:24:50.023892+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:23:30.500365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-30T17:23:30.919592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.23","mappings":[{"from":1,"to":5}]},{"pgid":"13.24","mappings":[{"from":6,"to":3}]},{"pgid":"14.2","mappings":[{"from":1,"to":7}]},{"pgid":"14.10","mappings":[{"from":1,"to":5}]},{"pgid":"14.31","mappings":[{"from":1,"to":7}]},{"pgid":"14.33","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/77045411":"2023-12-01T17:23:48.438312+0000","172.21.15.115:0/2457916531":"2023-12-01T17:23:48.438312+0000","172.21.15.115:6833/89956":"2023-12-01T17:23:48.438312+0000","172.21.15.115:6832/89956":"2023-12-01T17:23:48.438312+0000","172.21.15.115:0/2333450332":"2023-12-01T17:23:48.438312+0000","172.21.15.115:0/3126496541":"2023-12-01T17:23:48.438312+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:24:55.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.087+0000 7fe09f59e700 1 -- 172.21.15.49:0/1921835882 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe08005f390 msgr2=0x7fe080061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:24:55.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.087+0000 7fe09f59e700 1 --2- 172.21.15.49:0/1921835882 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe08005f390 0x7fe080061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:24:55.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.087+0000 7fe09f59e700 1 -- 172.21.15.49:0/1921835882 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a00c2cb0 msgr2=0x7fe0a00672b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:55.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.087+0000 7fe09f59e700 1 --2- 172.21.15.49:0/1921835882 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a00c2cb0 0x7fe0a00672b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fe09000e900 tx=0x7fe090009060).stop 2023-11-30T17:24:55.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.087+0000 7fe09f59e700 1 -- 172.21.15.49:0/1921835882 shutdown_connections 2023-11-30T17:24:55.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.088+0000 7fe09f59e700 1 --2- 172.21.15.49:0/1921835882 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0a0154230 0x7fe0a00677a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:55.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.088+0000 7fe09f59e700 1 --2- 172.21.15.49:0/1921835882 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe08005f390 0x7fe080061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:24:55.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.088+0000 7fe09f59e700 1 --2- 172.21.15.49:0/1921835882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0a0062700 0x7fe0a014ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:55.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.088+0000 7fe09f59e700 1 --2- 172.21.15.49:0/1921835882 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a00c2cb0 0x7fe0a00672b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:55.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.088+0000 7fe09f59e700 1 -- 172.21.15.49:0/1921835882 >> 172.21.15.49:0/1921835882 conn(0x7fe0a00c7ca0 msgr2=0x7fe0a014e850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:55.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.088+0000 7fe09f59e700 1 -- 172.21.15.49:0/1921835882 shutdown_connections 2023-11-30T17:24:55.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.088+0000 7fe09f59e700 1 -- 172.21.15.49:0/1921835882 wait complete. 2023-11-30T17:24:55.102 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-30T17:24:55.163 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:24:55.161+0000 7fd306e37680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:24:55.194 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:55.193+0000 7f32a4990680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T17:24:55.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.221+0000 7f095882f700 1 Processor -- start 2023-11-30T17:24:55.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.221+0000 7f095882f700 1 -- start start 2023-11-30T17:24:55.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.222+0000 7f095882f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f09541547f0 0x7f09540a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:55.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.222+0000 7f095882f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09540c86f0 0x7f09540c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:55.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.222+0000 7f095882f700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0954062700 0x7f0954062b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:55.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.222+0000 7f095882f700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09540c7e30 con 0x7f09541547f0 2023-11-30T17:24:55.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.222+0000 7f095882f700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09540bcf40 con 0x7f0954062700 2023-11-30T17:24:55.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.222+0000 7f095882f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09540c6b20 con 0x7f09540c86f0 2023-11-30T17:24:55.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.222+0000 7f095259c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f09541547f0 0x7f09540a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:55.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.222+0000 7f095259c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f09541547f0 0x7f09540a72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45284/0 (socket says 172.21.15.49:45284) 2023-11-30T17:24:55.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.222+0000 7f095259c700 1 -- 172.21.15.49:0/417605566 learned_addr learned my addr 172.21.15.49:0/417605566 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:55.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.222+0000 7f0951d9b700 1 --2- 172.21.15.49:0/417605566 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09540c86f0 0x7f09540c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:55.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.222+0000 7f0952d9d700 1 --2- 172.21.15.49:0/417605566 >> v2:172.21.15.115:3300/0 conn(0x7f0954062700 0x7f0954062b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:55.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.222+0000 7f095259c700 1 -- 172.21.15.49:0/417605566 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09540c86f0 msgr2=0x7f09540c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:24:55.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.222+0000 7f095259c700 1 --2- 172.21.15.49:0/417605566 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09540c86f0 0x7f09540c6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:55.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.222+0000 7f095259c700 1 -- 172.21.15.49:0/417605566 >> v2:172.21.15.115:3300/0 conn(0x7f0954062700 msgr2=0x7f0954062b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:24:55.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.222+0000 7f095259c700 1 --2- 172.21.15.49:0/417605566 >> v2:172.21.15.115:3300/0 conn(0x7f0954062700 0x7f0954062b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:55.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.222+0000 7f095259c700 1 -- 172.21.15.49:0/417605566 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09540a77d0 con 0x7f09541547f0 2023-11-30T17:24:55.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.222+0000 7f095259c700 1 --2- 172.21.15.49:0/417605566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09541547f0 0x7f09540a72e0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f095406aac0 tx=0x7f09440090f0).ready entity=mon.0 client_cookie=c07f898be8437ac4 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:55.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.223+0000 7f095159a700 1 -- 172.21.15.49:0/417605566 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094400f510 con 0x7f09541547f0 2023-11-30T17:24:55.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.223+0000 7f095159a700 1 -- 172.21.15.49:0/417605566 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094400f670 con 0x7f09541547f0 2023-11-30T17:24:55.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.223+0000 7f095159a700 1 -- 172.21.15.49:0/417605566 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094400fa10 con 0x7f09541547f0 2023-11-30T17:24:55.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.223+0000 7f095882f700 1 -- 172.21.15.49:0/417605566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09541547f0 msgr2=0x7f09540a72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:55.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.223+0000 7f095882f700 1 --2- 172.21.15.49:0/417605566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09541547f0 0x7f09540a72e0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f095406aac0 tx=0x7f09440090f0).stop 2023-11-30T17:24:55.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.223+0000 7f095882f700 1 -- 172.21.15.49:0/417605566 shutdown_connections 2023-11-30T17:24:55.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.223+0000 7f095882f700 1 --2- 172.21.15.49:0/417605566 >> v2:172.21.15.115:3300/0 conn(0x7f0954062700 0x7f0954062b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:55.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.223+0000 7f095882f700 1 --2- 172.21.15.49:0/417605566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09541547f0 0x7f09540a72e0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:55.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.223+0000 7f095882f700 1 --2- 172.21.15.49:0/417605566 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09540c86f0 0x7f09540c6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:55.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.223+0000 7f095882f700 1 -- 172.21.15.49:0/417605566 >> 172.21.15.49:0/417605566 conn(0x7f09540642d0 msgr2=0x7f09540c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:55.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.223+0000 7f095882f700 1 -- 172.21.15.49:0/417605566 shutdown_connections 2023-11-30T17:24:55.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.223+0000 7f095882f700 1 -- 172.21.15.49:0/417605566 wait complete. 2023-11-30T17:24:55.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.224+0000 7f095882f700 1 Processor -- start 2023-11-30T17:24:55.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.225+0000 7f095882f700 1 -- start start 2023-11-30T17:24:55.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.225+0000 7f095882f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0954062700 0x7f09541681d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:55.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.225+0000 7f095882f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09540c86f0 0x7f09540aa320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:55.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.225+0000 7f095882f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09541547f0 0x7f0954159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:55.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.225+0000 7f095882f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09540a7b60 con 0x7f09541547f0 2023-11-30T17:24:55.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.225+0000 7f095882f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09540a7e00 con 0x7f0954062700 2023-11-30T17:24:55.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.225+0000 7f095882f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09540a80e0 con 0x7f09540c86f0 2023-11-30T17:24:55.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.225+0000 7f0952d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09541547f0 0x7f0954159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:55.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.225+0000 7f0952d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09541547f0 0x7f0954159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45294/0 (socket says 172.21.15.49:45294) 2023-11-30T17:24:55.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.225+0000 7f0952d9d700 1 -- 172.21.15.49:0/960829963 learned_addr learned my addr 172.21.15.49:0/960829963 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:55.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.225+0000 7f095259c700 1 --2- 172.21.15.49:0/960829963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0954062700 0x7f09541681d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:55.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.226+0000 7f0951d9b700 1 --2- 172.21.15.49:0/960829963 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09540c86f0 0x7f09540aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:55.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.226+0000 7f0952d9d700 1 -- 172.21.15.49:0/960829963 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09540c86f0 msgr2=0x7f09540aa320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:55.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.226+0000 7f0952d9d700 1 --2- 172.21.15.49:0/960829963 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09540c86f0 0x7f09540aa320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:55.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.226+0000 7f0952d9d700 1 -- 172.21.15.49:0/960829963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0954062700 msgr2=0x7f09541681d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:55.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.226+0000 7f0952d9d700 1 --2- 172.21.15.49:0/960829963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0954062700 0x7f09541681d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:55.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.226+0000 7f0952d9d700 1 -- 172.21.15.49:0/960829963 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0944009370 con 0x7f09541547f0 2023-11-30T17:24:55.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.226+0000 7f095259c700 1 --2- 172.21.15.49:0/960829963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0954062700 0x7f09541681d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:24:55.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.226+0000 7f0952d9d700 1 --2- 172.21.15.49:0/960829963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09541547f0 0x7f0954159630 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7f094c009df0 tx=0x7f094c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:55.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.226+0000 7f09427fc700 1 -- 172.21.15.49:0/960829963 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c009b50 con 0x7f09541547f0 2023-11-30T17:24:55.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.226+0000 7f09427fc700 1 -- 172.21.15.49:0/960829963 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094c00f040 con 0x7f09541547f0 2023-11-30T17:24:55.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.226+0000 7f095882f700 1 -- 172.21.15.49:0/960829963 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09540a83c0 con 0x7f09541547f0 2023-11-30T17:24:55.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.226+0000 7f09427fc700 1 -- 172.21.15.49:0/960829963 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c00ccb0 con 0x7f09541547f0 2023-11-30T17:24:55.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.226+0000 7f095882f700 1 -- 172.21.15.49:0/960829963 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0954157b60 con 0x7f09541547f0 2023-11-30T17:24:55.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.227+0000 7f095882f700 1 -- 172.21.15.49:0/960829963 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09540a88e0 con 0x7f09541547f0 2023-11-30T17:24:55.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.228+0000 7f09427fc700 1 -- 172.21.15.49:0/960829963 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 46) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f094c013610 con 0x7f09541547f0 2023-11-30T17:24:55.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.228+0000 7f09427fc700 1 --2- 172.21.15.49:0/960829963 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f093405f360 0x7f0934061820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:55.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.228+0000 7f09427fc700 1 -- 172.21.15.49:0/960829963 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6581+0+0 (secure 0 0 0) 0x7f094c07afb0 con 0x7f09541547f0 2023-11-30T17:24:55.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.228+0000 7f095259c700 1 -- 172.21.15.49:0/960829963 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f093405f360 msgr2=0x7f0934061820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:24:55.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.228+0000 7f095259c700 1 --2- 172.21.15.49:0/960829963 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f093405f360 0x7f0934061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:24:55.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.235+0000 7f09427fc700 1 -- 172.21.15.49:0/960829963 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f09540a88e0 con 0x7f09541547f0 2023-11-30T17:24:55.266 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:55.264+0000 7f32a4990680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T17:24:55.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.291+0000 7f09427fc700 1 -- 172.21.15.49:0/960829963 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 47) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f094c0786e0 con 0x7f09541547f0 2023-11-30T17:24:55.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.291+0000 7f09427fc700 1 -- 172.21.15.49:0/960829963 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f093405f360 msgr2=0x7f0934061820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:24:55.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.291+0000 7f09427fc700 1 --2- 172.21.15.49:0/960829963 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f093405f360 0x7f0934061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:24:55.349 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:55.347+0000 7f3221126700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:24:55.349 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:55.347+0000 7f3221126700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:24:55.349 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:55.347+0000 7f3221126700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:24:55.349 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:55.347+0000 7f3221126700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:24:55.349 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:55.347+0000 7f3221126700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:24:55.349 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:55.347+0000 7f321e120700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:24:55.349 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:55.347+0000 7f321e120700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:24:55.349 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:55.347+0000 7f321e120700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:24:55.349 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:55.347+0000 7f321e120700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:24:55.349 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:24:55.347+0000 7f321e120700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:24:55.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:55.462+0000 7f095882f700 1 -- 172.21.15.49:0/960829963 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f09540a88e0 con 0x7f09541547f0 2023-11-30T17:24:55.482 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:24:55.481+0000 7fd306e37680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T17:24:55.559 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:24:55.557+0000 7fd306e37680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T17:24:56.282 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-11-30T17:24:56.281+0000 7f3888d95700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-30T17:24:56.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.287+0000 7f09427fc700 1 -- 172.21.15.49:0/960829963 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v47) v1 ==== 161+0+0 (secure 0 0 0) 0x7f09540a88e0 con 0x7f09541547f0 2023-11-30T17:24:56.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.289+0000 7f095882f700 1 -- 172.21.15.49:0/960829963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09541547f0 msgr2=0x7f0954159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:56.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.289+0000 7f095882f700 1 --2- 172.21.15.49:0/960829963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09541547f0 0x7f0954159630 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7f094c009df0 tx=0x7f094c00b040).stop 2023-11-30T17:24:56.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.289+0000 7f095882f700 1 -- 172.21.15.49:0/960829963 shutdown_connections 2023-11-30T17:24:56.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.289+0000 7f095882f700 1 --2- 172.21.15.49:0/960829963 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f093405f360 0x7f0934061820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:24:56.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.289+0000 7f095882f700 1 --2- 172.21.15.49:0/960829963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09541547f0 0x7f0954159630 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:56.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.289+0000 7f095882f700 1 --2- 172.21.15.49:0/960829963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0954062700 0x7f09541681d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:56.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.289+0000 7f095882f700 1 --2- 172.21.15.49:0/960829963 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f09540c86f0 0x7f09540aa320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:56.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.289+0000 7f095882f700 1 -- 172.21.15.49:0/960829963 >> 172.21.15.49:0/960829963 conn(0x7f09540642d0 msgr2=0x7f0954065540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:56.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.289+0000 7f095882f700 1 -- 172.21.15.49:0/960829963 shutdown_connections 2023-11-30T17:24:56.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.289+0000 7f095882f700 1 -- 172.21.15.49:0/960829963 wait complete. 2023-11-30T17:24:56.292 INFO:tasks.ceph.mds.c.smithi049.stderr: -7307> 2023-11-30T17:23:27.399+0000 7f80d040b700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-11-30T17:24:56.292 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-30T17:24:56.293 INFO:tasks.ceph.mds.c.smithi049.stderr: -6088> 2023-11-30T17:23:37.815+0000 7f80ca3ff700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-30T17:24:56.308 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-30T17:24:56.322 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-11-30T17:24:56.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.430+0000 7f319c215700 1 Processor -- start 2023-11-30T17:24:56.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.431+0000 7f319c215700 1 -- start start 2023-11-30T17:24:56.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.431+0000 7f319c215700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3194158160 0x7f31940a8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:56.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.431+0000 7f319c215700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3194067770 con 0x7f31940a8280 2023-11-30T17:24:56.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.432+0000 7f319c215700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31940be8d0 con 0x7f319414e600 2023-11-30T17:24:56.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.432+0000 7f319c215700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3194159180 con 0x7f3194158160 2023-11-30T17:24:56.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.432+0000 7f3199fb1700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f31940a8280 0x7f3194155500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33348/0 (socket says 172.21.15.49:33348) 2023-11-30T17:24:56.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.432+0000 7f3199fb1700 1 -- 172.21.15.49:0/3120654728 learned_addr learned my addr 172.21.15.49:0/3120654728 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:24:56.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.432+0000 7f31997b0700 1 --2- 172.21.15.49:0/3120654728 >> v2:172.21.15.49:3300/0 conn(0x7f3194158160 0x7f31940a8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:56.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.432+0000 7f31997b0700 1 -- 172.21.15.49:0/3120654728 >> v1:172.21.15.115:6789/0 conn(0x7f319414e600 legacy=0x7f319414ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:56.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.432+0000 7f31997b0700 1 -- 172.21.15.49:0/3120654728 >> v1:172.21.15.49:6789/0 conn(0x7f31940a8280 legacy=0x7f3194155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:56.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.432+0000 7f3198faf700 1 -- 172.21.15.49:0/3120654728 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1741360933 0 0) 0x7f3194067770 con 0x7f31940a8280 2023-11-30T17:24:56.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.432+0000 7f31997b0700 1 -- 172.21.15.49:0/3120654728 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3194158600 con 0x7f3194158160 2023-11-30T17:24:56.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.432+0000 7f31997b0700 1 --2- 172.21.15.49:0/3120654728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3194158160 0x7f31940a8660 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7f3188009760 tx=0x7f3188009060).ready entity=mon.0 client_cookie=da6c956cb3dd690c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:56.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.432+0000 7f3198faf700 1 -- 172.21.15.49:0/3120654728 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318800b580 con 0x7f3194158160 2023-11-30T17:24:56.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.432+0000 7f3198faf700 1 -- 172.21.15.49:0/3120654728 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318800b6e0 con 0x7f3194158160 2023-11-30T17:24:56.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.432+0000 7f3198faf700 1 -- 172.21.15.49:0/3120654728 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318800ba60 con 0x7f3194158160 2023-11-30T17:24:56.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.433+0000 7f319c215700 1 -- 172.21.15.49:0/3120654728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3194158160 msgr2=0x7f31940a8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:56.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.433+0000 7f319c215700 1 --2- 172.21.15.49:0/3120654728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3194158160 0x7f31940a8660 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7f3188009760 tx=0x7f3188009060).stop 2023-11-30T17:24:56.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.433+0000 7f319c215700 1 -- 172.21.15.49:0/3120654728 shutdown_connections 2023-11-30T17:24:56.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.433+0000 7f319c215700 1 --2- 172.21.15.49:0/3120654728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3194158160 0x7f31940a8660 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:56.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.433+0000 7f319c215700 1 -- 172.21.15.49:0/3120654728 >> 172.21.15.49:0/3120654728 conn(0x7f3194062700 msgr2=0x7f3194062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:56.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.433+0000 7f319c215700 1 -- 172.21.15.49:0/3120654728 shutdown_connections 2023-11-30T17:24:56.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.433+0000 7f319c215700 1 -- 172.21.15.49:0/3120654728 wait complete. 2023-11-30T17:24:56.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.434+0000 7f319c215700 1 Processor -- start 2023-11-30T17:24:56.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.434+0000 7f319c215700 1 -- start start 2023-11-30T17:24:56.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.435+0000 7f319c215700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31940a8280 0x7f319414ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:56.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.435+0000 7f319c215700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f319414e600 0x7f31940ae300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:56.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.435+0000 7f319c215700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3194158160 0x7f3194166180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:56.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.435+0000 7f319c215700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319414d360 con 0x7f31940a8280 2023-11-30T17:24:56.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.435+0000 7f319c215700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31940ae7f0 con 0x7f319414e600 2023-11-30T17:24:56.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.435+0000 7f319c215700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3194166670 con 0x7f3194158160 2023-11-30T17:24:56.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.435+0000 7f3199fb1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31940a8280 0x7f319414ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:56.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.435+0000 7f3199fb1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31940a8280 0x7f319414ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45326/0 (socket says 172.21.15.49:45326) 2023-11-30T17:24:56.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.435+0000 7f3199fb1700 1 -- 172.21.15.49:0/2625761362 learned_addr learned my addr 172.21.15.49:0/2625761362 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:56.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.435+0000 7f31997b0700 1 --2- 172.21.15.49:0/2625761362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f319414e600 0x7f31940ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:56.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.435+0000 7f319a7b2700 1 --2- 172.21.15.49:0/2625761362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3194158160 0x7f3194166180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:56.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.435+0000 7f3199fb1700 1 -- 172.21.15.49:0/2625761362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3194158160 msgr2=0x7f3194166180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:56.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.435+0000 7f3199fb1700 1 --2- 172.21.15.49:0/2625761362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3194158160 0x7f3194166180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:56.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.435+0000 7f3199fb1700 1 -- 172.21.15.49:0/2625761362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f319414e600 msgr2=0x7f31940ae300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:56.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.435+0000 7f3199fb1700 1 --2- 172.21.15.49:0/2625761362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f319414e600 0x7f31940ae300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:56.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.435+0000 7f3199fb1700 1 -- 172.21.15.49:0/2625761362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31880092a0 con 0x7f31940a8280 2023-11-30T17:24:56.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.435+0000 7f3199fb1700 1 --2- 172.21.15.49:0/2625761362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31940a8280 0x7f319414ce70 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7f318c00c490 tx=0x7f318c007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:56.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.436+0000 7f3191ffb700 1 -- 172.21.15.49:0/2625761362 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c0070d0 con 0x7f31940a8280 2023-11-30T17:24:56.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.436+0000 7f319c215700 1 -- 172.21.15.49:0/2625761362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31940ada20 con 0x7f31940a8280 2023-11-30T17:24:56.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.436+0000 7f3191ffb700 1 -- 172.21.15.49:0/2625761362 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318c007230 con 0x7f31940a8280 2023-11-30T17:24:56.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.436+0000 7f3191ffb700 1 -- 172.21.15.49:0/2625761362 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c0075f0 con 0x7f31940a8280 2023-11-30T17:24:56.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.436+0000 7f319c215700 1 -- 172.21.15.49:0/2625761362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3194165790 con 0x7f31940a8280 2023-11-30T17:24:56.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.437+0000 7f319c215700 1 -- 172.21.15.49:0/2625761362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31940bfcc0 con 0x7f31940a8280 2023-11-30T17:24:56.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.437+0000 7f3191ffb700 1 -- 172.21.15.49:0/2625761362 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 48) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f318c005bc0 con 0x7f31940a8280 2023-11-30T17:24:56.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.438+0000 7f3191ffb700 1 --2- 172.21.15.49:0/2625761362 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f318005f030 0x7f31800614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:56.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.438+0000 7f3191ffb700 1 -- 172.21.15.49:0/2625761362 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6925+0+0 (secure 0 0 0) 0x7f318c079b70 con 0x7f31940a8280 2023-11-30T17:24:56.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.438+0000 7f31997b0700 1 --2- 172.21.15.49:0/2625761362 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f318005f030 0x7f31800614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:56.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.438+0000 7f31997b0700 1 --2- 172.21.15.49:0/2625761362 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f318005f030 0x7f31800614f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f3188006e00 tx=0x7f3188017000).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:56.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.442+0000 7f3191ffb700 1 -- 172.21.15.49:0/2625761362 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f318c04acf0 con 0x7f31940a8280 2023-11-30T17:24:56.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:56.662+0000 7f319c215700 1 -- 172.21.15.49:0/2625761362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3194066d40 con 0x7f31940a8280 2023-11-30T17:24:57.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.295+0000 7f3191ffb700 1 -- 172.21.15.49:0/2625761362 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v48) v1 ==== 104+0+0 (secure 0 0 0) 0x7f318c04e310 con 0x7f31940a8280 2023-11-30T17:24:57.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.297+0000 7f319c215700 1 -- 172.21.15.49:0/2625761362 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f318005f030 msgr2=0x7f31800614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:57.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.297+0000 7f319c215700 1 --2- 172.21.15.49:0/2625761362 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f318005f030 0x7f31800614f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f3188006e00 tx=0x7f3188017000).stop 2023-11-30T17:24:57.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.297+0000 7f319c215700 1 -- 172.21.15.49:0/2625761362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31940a8280 msgr2=0x7f319414ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:57.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.297+0000 7f319c215700 1 --2- 172.21.15.49:0/2625761362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31940a8280 0x7f319414ce70 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7f318c00c490 tx=0x7f318c007e40).stop 2023-11-30T17:24:57.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.298+0000 7f319c215700 1 -- 172.21.15.49:0/2625761362 shutdown_connections 2023-11-30T17:24:57.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.298+0000 7f319c215700 1 --2- 172.21.15.49:0/2625761362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3194158160 0x7f3194166180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:57.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.298+0000 7f319c215700 1 --2- 172.21.15.49:0/2625761362 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f318005f030 0x7f31800614f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:57.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.298+0000 7f319c215700 1 --2- 172.21.15.49:0/2625761362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31940a8280 0x7f319414ce70 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:57.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.298+0000 7f319c215700 1 --2- 172.21.15.49:0/2625761362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f319414e600 0x7f31940ae300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:57.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.298+0000 7f319c215700 1 -- 172.21.15.49:0/2625761362 >> 172.21.15.49:0/2625761362 conn(0x7f3194062700 msgr2=0x7f319414db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:57.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.298+0000 7f319c215700 1 -- 172.21.15.49:0/2625761362 shutdown_connections 2023-11-30T17:24:57.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.298+0000 7f319c215700 1 -- 172.21.15.49:0/2625761362 wait complete. 2023-11-30T17:24:57.313 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-30T17:24:57.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.478+0000 7fb3aac1c700 1 Processor -- start 2023-11-30T17:24:57.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.478+0000 7fb3aac1c700 1 -- start start 2023-11-30T17:24:57.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.479+0000 7fb3aac1c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb3a4154910 0x7fb3a40a7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:57.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.479+0000 7fb3aac1c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb3a40aa220 0x7fb3a40aa690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:57.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.479+0000 7fb3aac1c700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3a40c6630 con 0x7fb3a4154530 2023-11-30T17:24:57.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.479+0000 7fb3aac1c700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a40c6390 con 0x7fb3a40aa220 2023-11-30T17:24:57.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.479+0000 7fb3aac1c700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a40a84e0 con 0x7fb3a4154910 2023-11-30T17:24:57.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.479+0000 7fb3a91b9700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb3a40aa220 0x7fb3a40aa690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:57.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.479+0000 7fb3a89b8700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb3a4154530 0x7fb3a40c8580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33356/0 (socket says 172.21.15.49:33356) 2023-11-30T17:24:57.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.479+0000 7fb3a89b8700 1 -- 172.21.15.49:0/708872538 learned_addr learned my addr 172.21.15.49:0/708872538 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:24:57.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.479+0000 7fb3a91b9700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb3a40aa220 0x7fb3a40aa690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45340/0 (socket says 172.21.15.49:45340) 2023-11-30T17:24:57.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.480+0000 7fb3a3fff700 1 --2- 172.21.15.49:0/708872538 >> v2:172.21.15.115:3300/0 conn(0x7fb3a4154910 0x7fb3a40a7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:57.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.480+0000 7fb3a91b9700 1 -- 172.21.15.49:0/708872538 >> v2:172.21.15.115:3300/0 conn(0x7fb3a4154910 msgr2=0x7fb3a40a7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:24:57.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.480+0000 7fb3a91b9700 1 --2- 172.21.15.49:0/708872538 >> v2:172.21.15.115:3300/0 conn(0x7fb3a4154910 0x7fb3a40a7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:57.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.480+0000 7fb3a91b9700 1 -- 172.21.15.49:0/708872538 >> v1:172.21.15.49:6789/0 conn(0x7fb3a4154530 legacy=0x7fb3a40c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:57.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.480+0000 7fb3a37fe700 1 -- 172.21.15.49:0/708872538 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1290536818 0 0) 0x7fb3a40c6630 con 0x7fb3a4154530 2023-11-30T17:24:57.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.480+0000 7fb3a91b9700 1 -- 172.21.15.49:0/708872538 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a40aab80 con 0x7fb3a40aa220 2023-11-30T17:24:57.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.480+0000 7fb3a91b9700 1 --2- 172.21.15.49:0/708872538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3a40aa220 0x7fb3a40aa690 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7fb3a40adfd0 tx=0x7fb39c009060).ready entity=mon.0 client_cookie=69f0f324ec142e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:57.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.480+0000 7fb3a37fe700 1 -- 172.21.15.49:0/708872538 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c00b580 con 0x7fb3a40aa220 2023-11-30T17:24:57.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.480+0000 7fb3a37fe700 1 -- 172.21.15.49:0/708872538 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39c00b6e0 con 0x7fb3a40aa220 2023-11-30T17:24:57.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.480+0000 7fb3a37fe700 1 -- 172.21.15.49:0/708872538 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c00ba60 con 0x7fb3a40aa220 2023-11-30T17:24:57.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.481+0000 7fb3aac1c700 1 -- 172.21.15.49:0/708872538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3a40aa220 msgr2=0x7fb3a40aa690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:57.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.481+0000 7fb3aac1c700 1 --2- 172.21.15.49:0/708872538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3a40aa220 0x7fb3a40aa690 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7fb3a40adfd0 tx=0x7fb39c009060).stop 2023-11-30T17:24:57.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.481+0000 7fb3aac1c700 1 -- 172.21.15.49:0/708872538 shutdown_connections 2023-11-30T17:24:57.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.481+0000 7fb3aac1c700 1 --2- 172.21.15.49:0/708872538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3a40aa220 0x7fb3a40aa690 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:57.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.481+0000 7fb3aac1c700 1 --2- 172.21.15.49:0/708872538 >> v2:172.21.15.115:3300/0 conn(0x7fb3a4154910 0x7fb3a40a7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:57.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.481+0000 7fb3aac1c700 1 -- 172.21.15.49:0/708872538 >> 172.21.15.49:0/708872538 conn(0x7fb3a4094930 msgr2=0x7fb3a406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:57.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.481+0000 7fb3aac1c700 1 -- 172.21.15.49:0/708872538 shutdown_connections 2023-11-30T17:24:57.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.481+0000 7fb3aac1c700 1 -- 172.21.15.49:0/708872538 wait complete. 2023-11-30T17:24:57.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.482+0000 7fb3aac1c700 1 Processor -- start 2023-11-30T17:24:57.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.482+0000 7fb3aac1c700 1 -- start start 2023-11-30T17:24:57.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.483+0000 7fb3aac1c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3a40aa220 0x7fb3a40ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:57.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.483+0000 7fb3aac1c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3a4154530 0x7fb3a40ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:57.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.483+0000 7fb3aac1c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3a4154910 0x7fb3a40acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:57.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.483+0000 7fb3aac1c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a40af090 con 0x7fb3a4154910 2023-11-30T17:24:57.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.483+0000 7fb3aac1c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a413b930 con 0x7fb3a4154530 2023-11-30T17:24:57.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.483+0000 7fb3aac1c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a40adde0 con 0x7fb3a40aa220 2023-11-30T17:24:57.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.483+0000 7fb3a91b9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3a4154910 0x7fb3a40acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:57.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.483+0000 7fb3a91b9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3a4154910 0x7fb3a40acdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45356/0 (socket says 172.21.15.49:45356) 2023-11-30T17:24:57.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.483+0000 7fb3a91b9700 1 -- 172.21.15.49:0/437839637 learned_addr learned my addr 172.21.15.49:0/437839637 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:57.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.483+0000 7fb3a89b8700 1 --2- 172.21.15.49:0/437839637 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3a40aa220 0x7fb3a40ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:57.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.483+0000 7fb3a3fff700 1 --2- 172.21.15.49:0/437839637 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3a4154530 0x7fb3a40ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:57.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.483+0000 7fb3a91b9700 1 -- 172.21.15.49:0/437839637 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3a40aa220 msgr2=0x7fb3a40ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:57.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.483+0000 7fb3a91b9700 1 --2- 172.21.15.49:0/437839637 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3a40aa220 0x7fb3a40ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:57.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.483+0000 7fb3a91b9700 1 -- 172.21.15.49:0/437839637 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3a4154530 msgr2=0x7fb3a40ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:57.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.483+0000 7fb3a91b9700 1 --2- 172.21.15.49:0/437839637 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3a4154530 0x7fb3a40ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:57.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.483+0000 7fb3a91b9700 1 -- 172.21.15.49:0/437839637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39c0092a0 con 0x7fb3a4154910 2023-11-30T17:24:57.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.483+0000 7fb3a91b9700 1 --2- 172.21.15.49:0/437839637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3a4154910 0x7fb3a40acdb0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7fb39c009fd0 tx=0x7fb39c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:57.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.483+0000 7fb3a0ff9700 1 -- 172.21.15.49:0/437839637 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c00ba60 con 0x7fb3a4154910 2023-11-30T17:24:57.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.483+0000 7fb3a0ff9700 1 -- 172.21.15.49:0/437839637 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39c01b410 con 0x7fb3a4154910 2023-11-30T17:24:57.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.483+0000 7fb3a0ff9700 1 -- 172.21.15.49:0/437839637 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c01b7d0 con 0x7fb3a4154910 2023-11-30T17:24:57.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.483+0000 7fb3aac1c700 1 -- 172.21.15.49:0/437839637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a40ae6f0 con 0x7fb3a4154910 2023-11-30T17:24:57.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.484+0000 7fb3aac1c700 1 -- 172.21.15.49:0/437839637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a40aecb0 con 0x7fb3a4154910 2023-11-30T17:24:57.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.485+0000 7fb3aac1c700 1 -- 172.21.15.49:0/437839637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a406c860 con 0x7fb3a4154910 2023-11-30T17:24:57.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.485+0000 7fb3a0ff9700 1 -- 172.21.15.49:0/437839637 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 48) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fb39c01bbc0 con 0x7fb3a4154910 2023-11-30T17:24:57.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.485+0000 7fb3a0ff9700 1 --2- 172.21.15.49:0/437839637 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb38405f030 0x7fb3840614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:57.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.485+0000 7fb3a0ff9700 1 -- 172.21.15.49:0/437839637 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6925+0+0 (secure 0 0 0) 0x7fb39c07bfc0 con 0x7fb3a4154910 2023-11-30T17:24:57.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.486+0000 7fb3a89b8700 1 --2- 172.21.15.49:0/437839637 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb38405f030 0x7fb3840614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:57.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.486+0000 7fb3a89b8700 1 --2- 172.21.15.49:0/437839637 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb38405f030 0x7fb3840614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fb38c001360 tx=0x7fb38c009040).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:57.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.490+0000 7fb3a0ff9700 1 -- 172.21.15.49:0/437839637 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb39c04d140 con 0x7fb3a4154910 2023-11-30T17:24:57.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:57.662+0000 7fb3aac1c700 1 -- 172.21.15.49:0/437839637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb3a4064230 con 0x7fb3a4154910 2023-11-30T17:24:58.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.048+0000 7fb3a0ff9700 1 -- 172.21.15.49:0/437839637 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb39c079c40 con 0x7fb3a4154910 2023-11-30T17:24:58.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.302+0000 7fb3a0ff9700 1 -- 172.21.15.49:0/437839637 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v120) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb39c042fd0 con 0x7fb3a4154910 2023-11-30T17:24:58.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.305+0000 7fb3aac1c700 1 -- 172.21.15.49:0/437839637 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb38405f030 msgr2=0x7fb3840614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:58.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.305+0000 7fb3aac1c700 1 --2- 172.21.15.49:0/437839637 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb38405f030 0x7fb3840614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fb38c001360 tx=0x7fb38c009040).stop 2023-11-30T17:24:58.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.305+0000 7fb3aac1c700 1 -- 172.21.15.49:0/437839637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3a4154910 msgr2=0x7fb3a40acdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:58.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.305+0000 7fb3aac1c700 1 --2- 172.21.15.49:0/437839637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3a4154910 0x7fb3a40acdb0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7fb39c009fd0 tx=0x7fb39c017000).stop 2023-11-30T17:24:58.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.306+0000 7fb3aac1c700 1 -- 172.21.15.49:0/437839637 shutdown_connections 2023-11-30T17:24:58.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.307+0000 7fb3aac1c700 1 --2- 172.21.15.49:0/437839637 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb38405f030 0x7fb3840614f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:58.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.307+0000 7fb3aac1c700 1 --2- 172.21.15.49:0/437839637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3a4154910 0x7fb3a40acdb0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:58.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.307+0000 7fb3aac1c700 1 --2- 172.21.15.49:0/437839637 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3a40aa220 0x7fb3a40ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:58.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.307+0000 7fb3aac1c700 1 --2- 172.21.15.49:0/437839637 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3a4154530 0x7fb3a40ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:58.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.307+0000 7fb3aac1c700 1 -- 172.21.15.49:0/437839637 >> 172.21.15.49:0/437839637 conn(0x7fb3a4094930 msgr2=0x7fb3a40a8650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:58.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.308+0000 7fb3aac1c700 1 -- 172.21.15.49:0/437839637 shutdown_connections 2023-11-30T17:24:58.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.309+0000 7fb3aac1c700 1 -- 172.21.15.49:0/437839637 wait complete. 2023-11-30T17:24:58.312 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2023-11-30T17:24:58.325 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-30T17:24:58.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.449+0000 7f2cd1401700 1 Processor -- start 2023-11-30T17:24:58.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.449+0000 7f2cd1401700 1 -- start start 2023-11-30T17:24:58.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.450+0000 7f2cd1401700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2ccc154420 0x7f2ccc1580b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:58.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.450+0000 7f2cd1401700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ccc0aa6b0 0x7f2ccc0c0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:58.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.450+0000 7f2cd1401700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ccc0c0a00 con 0x7f2ccc064d70 2023-11-30T17:24:58.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.450+0000 7f2cd1401700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ccc158fc0 con 0x7f2ccc154420 2023-11-30T17:24:58.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.450+0000 7f2cd1401700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc158720 con 0x7f2ccc0aa6b0 2023-11-30T17:24:58.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.450+0000 7f2ccaffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2ccc154420 0x7f2ccc1580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:58.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.450+0000 7f2ccaffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2ccc154420 0x7f2ccc1580b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45360/0 (socket says 172.21.15.49:45360) 2023-11-30T17:24:58.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.450+0000 7f2ccaffd700 1 -- 172.21.15.49:0/2268043277 learned_addr learned my addr 172.21.15.49:0/2268043277 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:58.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.450+0000 7f2ccb7fe700 1 --2- 172.21.15.49:0/2268043277 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ccc0aa6b0 0x7f2ccc0c0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:58.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.450+0000 7f2ccaffd700 1 -- 172.21.15.49:0/2268043277 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ccc0aa6b0 msgr2=0x7f2ccc0c0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:24:58.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.450+0000 7f2ccaffd700 1 --2- 172.21.15.49:0/2268043277 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ccc0aa6b0 0x7f2ccc0c0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:58.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.451+0000 7f2ccaffd700 1 -- 172.21.15.49:0/2268043277 >> v1:172.21.15.115:6789/0 conn(0x7f2ccc064d70 legacy=0x7f2ccc0a9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:58.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.451+0000 7f2ccaffd700 1 -- 172.21.15.49:0/2268043277 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ccc158a00 con 0x7f2ccc154420 2023-11-30T17:24:58.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.451+0000 7f2ccb7fe700 1 --2- 172.21.15.49:0/2268043277 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ccc0aa6b0 0x7f2ccc0c0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:24:58.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.451+0000 7f2ccaffd700 1 --2- 172.21.15.49:0/2268043277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ccc154420 0x7f2ccc1580b0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f2cbc006fd0 tx=0x7f2cbc0090f0).ready entity=mon.0 client_cookie=a772e0bcb03824f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:58.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.451+0000 7f2cc9ffb700 1 -- 172.21.15.49:0/2268043277 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc00b600 con 0x7f2ccc154420 2023-11-30T17:24:58.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.451+0000 7f2cc9ffb700 1 -- 172.21.15.49:0/2268043277 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cbc00b760 con 0x7f2ccc154420 2023-11-30T17:24:58.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.451+0000 7f2cc9ffb700 1 -- 172.21.15.49:0/2268043277 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc00bae0 con 0x7f2ccc154420 2023-11-30T17:24:58.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.451+0000 7f2cd1401700 1 -- 172.21.15.49:0/2268043277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ccc154420 msgr2=0x7f2ccc1580b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:58.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.451+0000 7f2cd1401700 1 --2- 172.21.15.49:0/2268043277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ccc154420 0x7f2ccc1580b0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f2cbc006fd0 tx=0x7f2cbc0090f0).stop 2023-11-30T17:24:58.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.451+0000 7f2cd1401700 1 -- 172.21.15.49:0/2268043277 shutdown_connections 2023-11-30T17:24:58.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.451+0000 7f2cd1401700 1 --2- 172.21.15.49:0/2268043277 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ccc0aa6b0 0x7f2ccc0c0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:58.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.451+0000 7f2cd1401700 1 --2- 172.21.15.49:0/2268043277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ccc154420 0x7f2ccc1580b0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:58.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.451+0000 7f2cd1401700 1 -- 172.21.15.49:0/2268043277 >> 172.21.15.49:0/2268043277 conn(0x7f2ccc0c7af0 msgr2=0x7f2ccc0c7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:58.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.451+0000 7f2cd1401700 1 -- 172.21.15.49:0/2268043277 shutdown_connections 2023-11-30T17:24:58.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.451+0000 7f2cd1401700 1 -- 172.21.15.49:0/2268043277 wait complete. 2023-11-30T17:24:58.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.453+0000 7f2cd1401700 1 Processor -- start 2023-11-30T17:24:58.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.453+0000 7f2cd1401700 1 -- start start 2023-11-30T17:24:58.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.453+0000 7f2cd1401700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ccc064d70 0x7f2ccc152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:58.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.453+0000 7f2cd1401700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ccc0aa6b0 0x7f2ccc0c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:58.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.453+0000 7f2cd1401700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ccc154420 0x7f2ccc0c4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:58.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.453+0000 7f2cd1401700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc0c4630 con 0x7f2ccc0aa6b0 2023-11-30T17:24:58.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.453+0000 7f2cd1401700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc0c35b0 con 0x7f2ccc154420 2023-11-30T17:24:58.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.453+0000 7f2cd1401700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc0c2c80 con 0x7f2ccc064d70 2023-11-30T17:24:58.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.453+0000 7f2cca7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ccc0aa6b0 0x7f2ccc0c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:58.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.454+0000 7f2cca7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ccc0aa6b0 0x7f2ccc0c3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45372/0 (socket says 172.21.15.49:45372) 2023-11-30T17:24:58.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.454+0000 7f2cca7fc700 1 -- 172.21.15.49:0/3349627718 learned_addr learned my addr 172.21.15.49:0/3349627718 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:58.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.454+0000 7f2ccaffd700 1 --2- 172.21.15.49:0/3349627718 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ccc064d70 0x7f2ccc152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:58.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.454+0000 7f2ccb7fe700 1 --2- 172.21.15.49:0/3349627718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ccc154420 0x7f2ccc0c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:58.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.454+0000 7f2cca7fc700 1 -- 172.21.15.49:0/3349627718 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ccc064d70 msgr2=0x7f2ccc152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:58.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.454+0000 7f2cca7fc700 1 --2- 172.21.15.49:0/3349627718 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ccc064d70 0x7f2ccc152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:58.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.454+0000 7f2cca7fc700 1 -- 172.21.15.49:0/3349627718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ccc154420 msgr2=0x7f2ccc0c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:58.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.454+0000 7f2cca7fc700 1 --2- 172.21.15.49:0/3349627718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ccc154420 0x7f2ccc0c4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:58.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.454+0000 7f2cca7fc700 1 -- 172.21.15.49:0/3349627718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cbc009370 con 0x7f2ccc0aa6b0 2023-11-30T17:24:58.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.454+0000 7f2cca7fc700 1 --2- 172.21.15.49:0/3349627718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ccc0aa6b0 0x7f2ccc0c3c50 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7f2cb400c440 tx=0x7f2cb4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:58.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.454+0000 7f2cc2ffd700 1 -- 172.21.15.49:0/3349627718 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4007020 con 0x7f2ccc0aa6b0 2023-11-30T17:24:58.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.454+0000 7f2cc2ffd700 1 -- 172.21.15.49:0/3349627718 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb4007180 con 0x7f2ccc0aa6b0 2023-11-30T17:24:58.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.454+0000 7f2cc2ffd700 1 -- 172.21.15.49:0/3349627718 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4007520 con 0x7f2ccc0aa6b0 2023-11-30T17:24:58.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.454+0000 7f2cd1401700 1 -- 172.21.15.49:0/3349627718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ccc0c2f60 con 0x7f2ccc0aa6b0 2023-11-30T17:24:58.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.454+0000 7f2cd1401700 1 -- 172.21.15.49:0/3349627718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ccc0b04d0 con 0x7f2ccc0aa6b0 2023-11-30T17:24:58.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.455+0000 7f2cd1401700 1 -- 172.21.15.49:0/3349627718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ccc06c7c0 con 0x7f2ccc0aa6b0 2023-11-30T17:24:58.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.456+0000 7f2cc2ffd700 1 -- 172.21.15.49:0/3349627718 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f2cb40068b0 con 0x7f2ccc0aa6b0 2023-11-30T17:24:58.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.456+0000 7f2cc2ffd700 1 --2- 172.21.15.49:0/3349627718 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2cac05f270 0x7f2cac061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:58.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.456+0000 7f2cc2ffd700 1 -- 172.21.15.49:0/3349627718 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f2cb40796f0 con 0x7f2ccc0aa6b0 2023-11-30T17:24:58.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.456+0000 7f2ccaffd700 1 --2- 172.21.15.49:0/3349627718 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2cac05f270 0x7f2cac061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:58.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.457+0000 7f2ccaffd700 1 --2- 172.21.15.49:0/3349627718 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2cac05f270 0x7f2cac061730 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f2ccc0ac510 tx=0x7f2cbc017000).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:58.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.460+0000 7f2cc2ffd700 1 -- 172.21.15.49:0/3349627718 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2cb4047b00 con 0x7f2ccc0aa6b0 2023-11-30T17:24:58.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:58.633+0000 7f2cd1401700 1 -- 172.21.15.49:0/3349627718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2ccc158ce0 con 0x7f2ccc0aa6b0 2023-11-30T17:24:59.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.304+0000 7f2cc2ffd700 1 -- 172.21.15.49:0/3349627718 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v121) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2cb404e140 con 0x7f2ccc0aa6b0 2023-11-30T17:24:59.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.308+0000 7f2cd1401700 1 -- 172.21.15.49:0/3349627718 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2cac05f270 msgr2=0x7f2cac061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:59.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.308+0000 7f2cd1401700 1 --2- 172.21.15.49:0/3349627718 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2cac05f270 0x7f2cac061730 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f2ccc0ac510 tx=0x7f2cbc017000).stop 2023-11-30T17:24:59.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.308+0000 7f2cd1401700 1 -- 172.21.15.49:0/3349627718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ccc0aa6b0 msgr2=0x7f2ccc0c3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:59.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.308+0000 7f2cd1401700 1 --2- 172.21.15.49:0/3349627718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ccc0aa6b0 0x7f2ccc0c3c50 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7f2cb400c440 tx=0x7f2cb4007e00).stop 2023-11-30T17:24:59.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.308+0000 7f2cd1401700 1 -- 172.21.15.49:0/3349627718 shutdown_connections 2023-11-30T17:24:59.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.308+0000 7f2cd1401700 1 --2- 172.21.15.49:0/3349627718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ccc154420 0x7f2ccc0c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:59.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.308+0000 7f2cd1401700 1 --2- 172.21.15.49:0/3349627718 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ccc064d70 0x7f2ccc152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:59.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.308+0000 7f2cd1401700 1 --2- 172.21.15.49:0/3349627718 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2cac05f270 0x7f2cac061730 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:59.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.308+0000 7f2cd1401700 1 --2- 172.21.15.49:0/3349627718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ccc0aa6b0 0x7f2ccc0c3c50 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:59.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.308+0000 7f2cd1401700 1 -- 172.21.15.49:0/3349627718 >> 172.21.15.49:0/3349627718 conn(0x7f2ccc0c7af0 msgr2=0x7f2ccc0ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:59.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.308+0000 7f2cd1401700 1 -- 172.21.15.49:0/3349627718 shutdown_connections 2023-11-30T17:24:59.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.309+0000 7f2cd1401700 1 -- 172.21.15.49:0/3349627718 wait complete. 2023-11-30T17:24:59.315 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2023-11-30T17:24:59.328 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-30T17:24:59.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.450+0000 7f98f6f81700 1 Processor -- start 2023-11-30T17:24:59.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.450+0000 7f98f6f81700 1 -- start start 2023-11-30T17:24:59.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.451+0000 7f98f6f81700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98f014e530 0x7f98f00c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:59.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.451+0000 7f98f6f81700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98f00c7bc0 con 0x7f98f0154950 2023-11-30T17:24:59.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.451+0000 7f98f6f81700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98f0155920 con 0x7f98f0158570 2023-11-30T17:24:59.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.451+0000 7f98f6f81700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f0154dd0 con 0x7f98f014e530 2023-11-30T17:24:59.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.451+0000 7f98f577e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f98f0154950 0x7f98f014e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33366/0 (socket says 172.21.15.49:33366) 2023-11-30T17:24:59.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.451+0000 7f98f577e700 1 -- 172.21.15.49:0/1264982600 learned_addr learned my addr 172.21.15.49:0/1264982600 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:24:59.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.452+0000 7f98f5f7f700 1 --2- 172.21.15.49:0/1264982600 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98f014e530 0x7f98f00c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:59.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.452+0000 7f98f4f7d700 1 -- 172.21.15.49:0/1264982600 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557066639 0 0) 0x7f98f00c7bc0 con 0x7f98f0154950 2023-11-30T17:24:59.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.452+0000 7f98f4f7d700 1 -- 172.21.15.49:0/1264982600 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98d80033f0 con 0x7f98f0154950 2023-11-30T17:24:59.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.452+0000 7f98f4f7d700 1 -- 172.21.15.49:0/1264982600 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1849948536 0 0) 0x7f98d80033f0 con 0x7f98f0154950 2023-11-30T17:24:59.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.452+0000 7f98f4f7d700 1 -- 172.21.15.49:0/1264982600 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98f014e530 msgr2=0x7f98f00c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:24:59.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.452+0000 7f98f4f7d700 1 --2- 172.21.15.49:0/1264982600 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98f014e530 0x7f98f00c66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:59.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.452+0000 7f98f4f7d700 1 -- 172.21.15.49:0/1264982600 >> v1:172.21.15.115:6789/0 conn(0x7f98f0158570 legacy=0x7f98f00aa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:59.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.452+0000 7f98f4f7d700 1 -- 172.21.15.49:0/1264982600 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f0155080 con 0x7f98f0154950 2023-11-30T17:24:59.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.452+0000 7f98f4f7d700 1 -- 172.21.15.49:0/1264982600 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f98e4001470 con 0x7f98f0154950 2023-11-30T17:24:59.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.452+0000 7f98f4f7d700 1 -- 172.21.15.49:0/1264982600 >> v1:172.21.15.49:6789/0 conn(0x7f98f0154950 legacy=0x7f98f014e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:59.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.452+0000 7f98f4f7d700 1 --2- 172.21.15.49:0/1264982600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98d8003910 0x7f98d8003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:59.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.452+0000 7f98f4f7d700 1 --2- 172.21.15.49:0/1264982600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98d8004690 0x7f98d8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:59.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.452+0000 7f98f4f7d700 1 --2- 172.21.15.49:0/1264982600 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98f014e530 0x7f98d80050b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:59.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.452+0000 7f98f4f7d700 1 -- 172.21.15.49:0/1264982600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f0154dd0 con 0x7f98d8003910 2023-11-30T17:24:59.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.452+0000 7f98f4f7d700 1 -- 172.21.15.49:0/1264982600 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d800b9c0 con 0x7f98d8004690 2023-11-30T17:24:59.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.452+0000 7f98f4f7d700 1 -- 172.21.15.49:0/1264982600 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d800bb80 con 0x7f98f014e530 2023-11-30T17:24:59.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.452+0000 7f98f5f7f700 1 --2- 172.21.15.49:0/1264982600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98d8003910 0x7f98d8003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:59.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.452+0000 7f98f577e700 1 --2- 172.21.15.49:0/1264982600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98d8004690 0x7f98d8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:59.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.452+0000 7f98f6780700 1 --2- 172.21.15.49:0/1264982600 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98f014e530 0x7f98d80050b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:59.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.453+0000 7f98f5f7f700 1 -- 172.21.15.49:0/1264982600 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98f014e530 msgr2=0x7f98d80050b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:24:59.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.453+0000 7f98f5f7f700 1 --2- 172.21.15.49:0/1264982600 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98f014e530 0x7f98d80050b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:59.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.453+0000 7f98f5f7f700 1 -- 172.21.15.49:0/1264982600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98d8004690 msgr2=0x7f98d8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:24:59.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.453+0000 7f98f5f7f700 1 --2- 172.21.15.49:0/1264982600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98d8004690 0x7f98d8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:59.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.453+0000 7f98f5f7f700 1 -- 172.21.15.49:0/1264982600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d80033f0 con 0x7f98d8003910 2023-11-30T17:24:59.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.453+0000 7f98f5f7f700 1 --2- 172.21.15.49:0/1264982600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98d8003910 0x7f98d8003d30 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7f98e8009a80 tx=0x7f98e8009060).ready entity=mon.0 client_cookie=f69b61b5cbee2fb4 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:59.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.453+0000 7f98f4f7d700 1 -- 172.21.15.49:0/1264982600 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e8009430 con 0x7f98d8003910 2023-11-30T17:24:59.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.453+0000 7f98f4f7d700 1 -- 172.21.15.49:0/1264982600 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e800e640 con 0x7f98d8003910 2023-11-30T17:24:59.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.453+0000 7f98f4f7d700 1 -- 172.21.15.49:0/1264982600 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e800e9c0 con 0x7f98d8003910 2023-11-30T17:24:59.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.453+0000 7f98f6f81700 1 -- 172.21.15.49:0/1264982600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98d8003910 msgr2=0x7f98d8003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:59.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.453+0000 7f98f6f81700 1 --2- 172.21.15.49:0/1264982600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98d8003910 0x7f98d8003d30 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7f98e8009a80 tx=0x7f98e8009060).stop 2023-11-30T17:24:59.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.453+0000 7f98f6780700 1 -- 172.21.15.49:0/1264982600 reap_dead start 2023-11-30T17:24:59.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.453+0000 7f98f6f81700 1 -- 172.21.15.49:0/1264982600 shutdown_connections 2023-11-30T17:24:59.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.453+0000 7f98f6f81700 1 -- 172.21.15.49:0/1264982600 >> 172.21.15.49:0/1264982600 conn(0x7f98f0064990 msgr2=0x7f98f0064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:59.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.453+0000 7f98f6f81700 1 -- 172.21.15.49:0/1264982600 shutdown_connections 2023-11-30T17:24:59.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.453+0000 7f98f6f81700 1 -- 172.21.15.49:0/1264982600 wait complete. 2023-11-30T17:24:59.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.455+0000 7f98f6f81700 1 Processor -- start 2023-11-30T17:24:59.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.455+0000 7f98f6f81700 1 -- start start 2023-11-30T17:24:59.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.455+0000 7f98f6f81700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98d8003910 0x7f98f0155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:59.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.455+0000 7f98f6f81700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98f0156420 0x7f98f014d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:59.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.455+0000 7f98f6f81700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98f00c5120 0x7f98f014dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:59.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.455+0000 7f98f6f81700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f01655f0 con 0x7f98f0156420 2023-11-30T17:24:59.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.455+0000 7f98f6f81700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f014e0c0 con 0x7f98d8003910 2023-11-30T17:24:59.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.455+0000 7f98f6f81700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f00c4360 con 0x7f98f00c5120 2023-11-30T17:24:59.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.456+0000 7f98f577e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98f0156420 0x7f98f014d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:59.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.456+0000 7f98f577e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98f0156420 0x7f98f014d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45392/0 (socket says 172.21.15.49:45392) 2023-11-30T17:24:59.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.456+0000 7f98f577e700 1 -- 172.21.15.49:0/1621078686 learned_addr learned my addr 172.21.15.49:0/1621078686 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:59.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.456+0000 7f98f5f7f700 1 --2- 172.21.15.49:0/1621078686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98d8003910 0x7f98f0155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:59.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.456+0000 7f98f6780700 1 --2- 172.21.15.49:0/1621078686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98f00c5120 0x7f98f014dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:59.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.456+0000 7f98f577e700 1 -- 172.21.15.49:0/1621078686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98f00c5120 msgr2=0x7f98f014dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:59.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.456+0000 7f98f577e700 1 --2- 172.21.15.49:0/1621078686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98f00c5120 0x7f98f014dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:59.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.456+0000 7f98f577e700 1 -- 172.21.15.49:0/1621078686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98d8003910 msgr2=0x7f98f0155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:59.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.456+0000 7f98f577e700 1 --2- 172.21.15.49:0/1621078686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98d8003910 0x7f98f0155f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:59.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.456+0000 7f98f577e700 1 -- 172.21.15.49:0/1621078686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f00c4640 con 0x7f98f0156420 2023-11-30T17:24:59.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.456+0000 7f98f577e700 1 --2- 172.21.15.49:0/1621078686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98f0156420 0x7f98f014d6e0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f98e40049e0 tx=0x7f98e4001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:59.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.456+0000 7f98edffb700 1 -- 172.21.15.49:0/1621078686 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4011590 con 0x7f98f0156420 2023-11-30T17:24:59.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.456+0000 7f98edffb700 1 -- 172.21.15.49:0/1621078686 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e40116f0 con 0x7f98f0156420 2023-11-30T17:24:59.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.456+0000 7f98f6f81700 1 -- 172.21.15.49:0/1621078686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f00c4920 con 0x7f98f0156420 2023-11-30T17:24:59.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.456+0000 7f98edffb700 1 -- 172.21.15.49:0/1621078686 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4011a70 con 0x7f98f0156420 2023-11-30T17:24:59.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.456+0000 7f98f6f81700 1 -- 172.21.15.49:0/1621078686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f0164880 con 0x7f98f0156420 2023-11-30T17:24:59.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.457+0000 7f98f6f81700 1 -- 172.21.15.49:0/1621078686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f00c4e40 con 0x7f98f0156420 2023-11-30T17:24:59.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.458+0000 7f98edffb700 1 -- 172.21.15.49:0/1621078686 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f98e401d3b0 con 0x7f98f0156420 2023-11-30T17:24:59.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.458+0000 7f98edffb700 1 --2- 172.21.15.49:0/1621078686 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f98dc05f270 0x7f98dc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:59.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.458+0000 7f98edffb700 1 -- 172.21.15.49:0/1621078686 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5899+0+0 (secure 0 0 0) 0x7f98e4079aa0 con 0x7f98f0156420 2023-11-30T17:24:59.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.458+0000 7f98f5f7f700 1 --2- 172.21.15.49:0/1621078686 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f98dc05f270 0x7f98dc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:59.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.459+0000 7f98f5f7f700 1 --2- 172.21.15.49:0/1621078686 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f98dc05f270 0x7f98dc061730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f98e8006d50 tx=0x7f98e801a000).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:59.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.462+0000 7f98edffb700 1 -- 172.21.15.49:0/1621078686 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f98f00c4e40 con 0x7f98f0156420 2023-11-30T17:24:59.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.640+0000 7f98f6f81700 1 -- 172.21.15.49:0/1621078686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f98f00c4e40 con 0x7f98f0156420 2023-11-30T17:24:59.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.643+0000 7f98edffb700 1 -- 172.21.15.49:0/1621078686 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7f98f00c4e40 con 0x7f98f0156420 2023-11-30T17:24:59.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.645+0000 7f98f6f81700 1 -- 172.21.15.49:0/1621078686 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f98dc05f270 msgr2=0x7f98dc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:59.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.645+0000 7f98f6f81700 1 --2- 172.21.15.49:0/1621078686 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f98dc05f270 0x7f98dc061730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f98e8006d50 tx=0x7f98e801a000).stop 2023-11-30T17:24:59.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.645+0000 7f98f6f81700 1 -- 172.21.15.49:0/1621078686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98f0156420 msgr2=0x7f98f014d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:59.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.645+0000 7f98f6f81700 1 --2- 172.21.15.49:0/1621078686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98f0156420 0x7f98f014d6e0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f98e40049e0 tx=0x7f98e4001e50).stop 2023-11-30T17:24:59.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.645+0000 7f98f6f81700 1 -- 172.21.15.49:0/1621078686 shutdown_connections 2023-11-30T17:24:59.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.645+0000 7f98f6f81700 1 --2- 172.21.15.49:0/1621078686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98f00c5120 0x7f98f014dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:59.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.645+0000 7f98f6f81700 1 --2- 172.21.15.49:0/1621078686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98d8003910 0x7f98f0155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:59.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.645+0000 7f98f6f81700 1 --2- 172.21.15.49:0/1621078686 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f98dc05f270 0x7f98dc061730 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:59.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.645+0000 7f98f6f81700 1 --2- 172.21.15.49:0/1621078686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98f0156420 0x7f98f014d6e0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:59.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.645+0000 7f98f6f81700 1 -- 172.21.15.49:0/1621078686 >> 172.21.15.49:0/1621078686 conn(0x7f98f0064990 msgr2=0x7f98f00c9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:59.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.645+0000 7f98f6f81700 1 -- 172.21.15.49:0/1621078686 shutdown_connections 2023-11-30T17:24:59.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.645+0000 7f98f6f81700 1 -- 172.21.15.49:0/1621078686 wait complete. 2023-11-30T17:24:59.658 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-11-30T17:24:59.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.776+0000 7f11d325d700 1 Processor -- start 2023-11-30T17:24:59.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.776+0000 7f11d325d700 1 -- start start 2023-11-30T17:24:59.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.777+0000 7f11d325d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f11cc098d10 0x7f11cc0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:59.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.777+0000 7f11d325d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11cc158320 0x7f11cc1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:59.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.777+0000 7f11d325d700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11cc158cc0 con 0x7f11cc0c6190 2023-11-30T17:24:59.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.777+0000 7f11d325d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11cc0c72d0 con 0x7f11cc098d10 2023-11-30T17:24:59.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.777+0000 7f11d325d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc064570 con 0x7f11cc158320 2023-11-30T17:24:59.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.777+0000 7f11cbfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f11cc0c6190 0x7f11cc063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33376/0 (socket says 172.21.15.49:33376) 2023-11-30T17:24:59.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.777+0000 7f11cbfff700 1 -- 172.21.15.49:0/2471836186 learned_addr learned my addr 172.21.15.49:0/2471836186 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:24:59.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.777+0000 7f11d0ff9700 1 --2- 172.21.15.49:0/2471836186 >> v2:172.21.15.115:3300/0 conn(0x7f11cc098d10 0x7f11cc0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:59.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.777+0000 7f11d17fa700 1 --2- 172.21.15.49:0/2471836186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11cc158320 0x7f11cc1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:59.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.777+0000 7f11cb7fe700 1 -- 172.21.15.49:0/2471836186 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1617284232 0 0) 0x7f11c0001110 con 0x7f11cc0c6190 2023-11-30T17:24:59.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.777+0000 7f11cb7fe700 1 -- 172.21.15.49:0/2471836186 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11b40033f0 con 0x7f11cc0c6190 2023-11-30T17:24:59.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.777+0000 7f11cb7fe700 1 -- 172.21.15.49:0/2471836186 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2756513519 0 0) 0x7f11b40033f0 con 0x7f11cc0c6190 2023-11-30T17:24:59.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.777+0000 7f11cb7fe700 1 -- 172.21.15.49:0/2471836186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11cc158320 msgr2=0x7f11cc1587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:24:59.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.778+0000 7f11cb7fe700 1 --2- 172.21.15.49:0/2471836186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11cc158320 0x7f11cc1587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:59.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.778+0000 7f11cb7fe700 1 -- 172.21.15.49:0/2471836186 >> v2:172.21.15.115:3300/0 conn(0x7f11cc098d10 msgr2=0x7f11cc0c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:24:59.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.778+0000 7f11cb7fe700 1 --2- 172.21.15.49:0/2471836186 >> v2:172.21.15.115:3300/0 conn(0x7f11cc098d10 0x7f11cc0c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:59.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.778+0000 7f11cb7fe700 1 -- 172.21.15.49:0/2471836186 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11cc154bc0 con 0x7f11cc0c6190 2023-11-30T17:24:59.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.778+0000 7f11cb7fe700 1 -- 172.21.15.49:0/2471836186 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f11c0001600 con 0x7f11cc0c6190 2023-11-30T17:24:59.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.778+0000 7f11cb7fe700 1 -- 172.21.15.49:0/2471836186 >> v1:172.21.15.49:6789/0 conn(0x7f11cc0c6190 legacy=0x7f11cc063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:59.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.778+0000 7f11cb7fe700 1 --2- 172.21.15.49:0/2471836186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11b40038e0 0x7f11b4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:59.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.778+0000 7f11cb7fe700 1 --2- 172.21.15.49:0/2471836186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11b4004690 0x7f11b4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:59.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.778+0000 7f11cb7fe700 1 --2- 172.21.15.49:0/2471836186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11cc158320 0x7f11b4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:59.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.778+0000 7f11cb7fe700 1 -- 172.21.15.49:0/2471836186 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc0c72d0 con 0x7f11b4004690 2023-11-30T17:24:59.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.778+0000 7f11cb7fe700 1 -- 172.21.15.49:0/2471836186 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc064570 con 0x7f11b40038e0 2023-11-30T17:24:59.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.778+0000 7f11cb7fe700 1 -- 172.21.15.49:0/2471836186 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b400b8e0 con 0x7f11cc158320 2023-11-30T17:24:59.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.778+0000 7f11cbfff700 1 --2- 172.21.15.49:0/2471836186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11b4004690 0x7f11b4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:59.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.778+0000 7f11d0ff9700 1 --2- 172.21.15.49:0/2471836186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11b40038e0 0x7f11b4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:59.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.778+0000 7f11d17fa700 1 --2- 172.21.15.49:0/2471836186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11cc158320 0x7f11b4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:59.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.778+0000 7f11cbfff700 1 -- 172.21.15.49:0/2471836186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11cc158320 msgr2=0x7f11b4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:24:59.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.778+0000 7f11cbfff700 1 --2- 172.21.15.49:0/2471836186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11cc158320 0x7f11b4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:59.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.778+0000 7f11cbfff700 1 -- 172.21.15.49:0/2471836186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11b40038e0 msgr2=0x7f11b4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:24:59.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.778+0000 7f11cbfff700 1 --2- 172.21.15.49:0/2471836186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11b40038e0 0x7f11b4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:59.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.778+0000 7f11cbfff700 1 -- 172.21.15.49:0/2471836186 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b40033f0 con 0x7f11b4004690 2023-11-30T17:24:59.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.778+0000 7f11cbfff700 1 --2- 172.21.15.49:0/2471836186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11b4004690 0x7f11b4004b10 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f11c000c390 tx=0x7f11cc0a8040).ready entity=mon.0 client_cookie=bf75f2fa33713d7e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:59.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.778+0000 7f11cb7fe700 1 -- 172.21.15.49:0/2471836186 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c0007be0 con 0x7f11b4004690 2023-11-30T17:24:59.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.778+0000 7f11cb7fe700 1 -- 172.21.15.49:0/2471836186 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c000cc60 con 0x7f11b4004690 2023-11-30T17:24:59.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.778+0000 7f11cb7fe700 1 -- 172.21.15.49:0/2471836186 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c00070d0 con 0x7f11b4004690 2023-11-30T17:24:59.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.779+0000 7f11d325d700 1 -- 172.21.15.49:0/2471836186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11b4004690 msgr2=0x7f11b4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:59.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.779+0000 7f11d325d700 1 --2- 172.21.15.49:0/2471836186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11b4004690 0x7f11b4004b10 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f11c000c390 tx=0x7f11cc0a8040).stop 2023-11-30T17:24:59.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.779+0000 7f11d17fa700 1 -- 172.21.15.49:0/2471836186 reap_dead start 2023-11-30T17:24:59.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.779+0000 7f11d325d700 1 -- 172.21.15.49:0/2471836186 shutdown_connections 2023-11-30T17:24:59.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.779+0000 7f11d325d700 1 -- 172.21.15.49:0/2471836186 >> 172.21.15.49:0/2471836186 conn(0x7f11cc0cb310 msgr2=0x7f11cc0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:59.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.779+0000 7f11d325d700 1 -- 172.21.15.49:0/2471836186 shutdown_connections 2023-11-30T17:24:59.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.779+0000 7f11d325d700 1 -- 172.21.15.49:0/2471836186 wait complete. 2023-11-30T17:24:59.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.780+0000 7f11d325d700 1 Processor -- start 2023-11-30T17:24:59.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.780+0000 7f11d325d700 1 -- start start 2023-11-30T17:24:59.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.781+0000 7f11d325d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11b4004690 0x7f11cc0c2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:59.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.781+0000 7f11d325d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11cc152f20 0x7f11cc0ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:59.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.781+0000 7f11d325d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11cc1533a0 0x7f11cc0ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:59.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.781+0000 7f11d325d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc0cabc0 con 0x7f11cc152f20 2023-11-30T17:24:59.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.781+0000 7f11d325d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc0c8600 con 0x7f11b4004690 2023-11-30T17:24:59.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.781+0000 7f11d325d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc0c7d10 con 0x7f11cc1533a0 2023-11-30T17:24:59.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.781+0000 7f11cbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11cc152f20 0x7f11cc0ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:59.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.781+0000 7f11cbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11cc152f20 0x7f11cc0ca1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45410/0 (socket says 172.21.15.49:45410) 2023-11-30T17:24:59.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.781+0000 7f11cbfff700 1 -- 172.21.15.49:0/482456769 learned_addr learned my addr 172.21.15.49:0/482456769 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:24:59.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.781+0000 7f11d0ff9700 1 --2- 172.21.15.49:0/482456769 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11b4004690 0x7f11cc0c2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:59.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.781+0000 7f11cbfff700 1 -- 172.21.15.49:0/482456769 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11cc1533a0 msgr2=0x7f11cc0ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:59.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.781+0000 7f11cbfff700 1 --2- 172.21.15.49:0/482456769 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11cc1533a0 0x7f11cc0ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:24:59.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.781+0000 7f11cbfff700 1 -- 172.21.15.49:0/482456769 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11b4004690 msgr2=0x7f11cc0c2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:59.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.781+0000 7f11cbfff700 1 --2- 172.21.15.49:0/482456769 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11b4004690 0x7f11cc0c2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:59.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.781+0000 7f11cbfff700 1 -- 172.21.15.49:0/482456769 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11cc0b09e0 con 0x7f11cc152f20 2023-11-30T17:24:59.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.782+0000 7f11cbfff700 1 --2- 172.21.15.49:0/482456769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11cc152f20 0x7f11cc0ca1e0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f11c000cc30 tx=0x7f11c0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:59.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.782+0000 7f11c8ff9700 1 -- 172.21.15.49:0/482456769 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c0001920 con 0x7f11cc152f20 2023-11-30T17:24:59.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.782+0000 7f11c8ff9700 1 -- 172.21.15.49:0/482456769 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c00046b0 con 0x7f11cc152f20 2023-11-30T17:24:59.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.782+0000 7f11d325d700 1 -- 172.21.15.49:0/482456769 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11cc0c7fb0 con 0x7f11cc152f20 2023-11-30T17:24:59.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.782+0000 7f11c8ff9700 1 -- 172.21.15.49:0/482456769 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c0004a30 con 0x7f11cc152f20 2023-11-30T17:24:59.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.782+0000 7f11d325d700 1 -- 172.21.15.49:0/482456769 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11cc0c3320 con 0x7f11cc152f20 2023-11-30T17:24:59.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.783+0000 7f11d325d700 1 -- 172.21.15.49:0/482456769 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11cc0c8450 con 0x7f11cc152f20 2023-11-30T17:24:59.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.783+0000 7f11c8ff9700 1 -- 172.21.15.49:0/482456769 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f11c0020480 con 0x7f11cc152f20 2023-11-30T17:24:59.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.783+0000 7f11c8ff9700 1 --2- 172.21.15.49:0/482456769 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f11b805f270 0x7f11b8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:24:59.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.784+0000 7f11c8ff9700 1 -- 172.21.15.49:0/482456769 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5899+0+0 (secure 0 0 0) 0x7f11c007b0d0 con 0x7f11cc152f20 2023-11-30T17:24:59.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.784+0000 7f11d0ff9700 1 --2- 172.21.15.49:0/482456769 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f11b805f270 0x7f11b8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:24:59.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.784+0000 7f11d0ff9700 1 --2- 172.21.15.49:0/482456769 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f11b805f270 0x7f11b8061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f11c4009fd0 tx=0x7f11c400b040).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:24:59.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.788+0000 7f11c8ff9700 1 -- 172.21.15.49:0/482456769 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f11c004c2a0 con 0x7f11cc152f20 2023-11-30T17:24:59.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.960+0000 7f11d325d700 1 -- 172.21.15.49:0/482456769 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f11cc158cc0 con 0x7f11cc152f20 2023-11-30T17:24:59.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.964+0000 7f11c8ff9700 1 -- 172.21.15.49:0/482456769 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v21) v1 ==== 120+0+0 (secure 0 0 0) 0x7f11cc158cc0 con 0x7f11cc152f20 2023-11-30T17:24:59.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.966+0000 7f11d325d700 1 -- 172.21.15.49:0/482456769 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f11b805f270 msgr2=0x7f11b8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:59.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.966+0000 7f11d325d700 1 --2- 172.21.15.49:0/482456769 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f11b805f270 0x7f11b8061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f11c4009fd0 tx=0x7f11c400b040).stop 2023-11-30T17:24:59.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.966+0000 7f11d325d700 1 -- 172.21.15.49:0/482456769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11cc152f20 msgr2=0x7f11cc0ca1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:24:59.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.966+0000 7f11d325d700 1 --2- 172.21.15.49:0/482456769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11cc152f20 0x7f11cc0ca1e0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f11c000cc30 tx=0x7f11c0015000).stop 2023-11-30T17:24:59.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.966+0000 7f11d325d700 1 -- 172.21.15.49:0/482456769 shutdown_connections 2023-11-30T17:24:59.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.966+0000 7f11d325d700 1 --2- 172.21.15.49:0/482456769 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11cc1533a0 0x7f11cc0ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:24:59.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.966+0000 7f11d325d700 1 --2- 172.21.15.49:0/482456769 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11b4004690 0x7f11cc0c2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:59.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.966+0000 7f11d325d700 1 --2- 172.21.15.49:0/482456769 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f11b805f270 0x7f11b8061730 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:59.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.966+0000 7f11d325d700 1 --2- 172.21.15.49:0/482456769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11cc152f20 0x7f11cc0ca1e0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:24:59.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.966+0000 7f11d325d700 1 -- 172.21.15.49:0/482456769 >> 172.21.15.49:0/482456769 conn(0x7f11cc0cb310 msgr2=0x7f11cc153ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:24:59.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.966+0000 7f11d325d700 1 -- 172.21.15.49:0/482456769 shutdown_connections 2023-11-30T17:24:59.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:24:59.966+0000 7f11d325d700 1 -- 172.21.15.49:0/482456769 wait complete. 2023-11-30T17:24:59.980 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-11-30T17:25:00.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.099+0000 7fe2d4346700 1 Processor -- start 2023-11-30T17:25:00.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.099+0000 7fe2d4346700 1 -- start start 2023-11-30T17:25:00.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.100+0000 7fe2d4346700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe2cc1544e0 0x7fe2cc1548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:00.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.100+0000 7fe2d4346700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe2cc06a610 0x7fe2cc0c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:00.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.100+0000 7fe2d4346700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2cc0c69a0 con 0x7fe2cc0c6e30 2023-11-30T17:25:00.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.100+0000 7fe2d4346700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2cc0c13a0 con 0x7fe2cc06a610 2023-11-30T17:25:00.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.100+0000 7fe2d4346700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2cc0c1680 con 0x7fe2cc1544e0 2023-11-30T17:25:00.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.100+0000 7fe2d18e1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe2cc06a610 0x7fe2cc0c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:00.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.100+0000 7fe2d28e3700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe2cc0c6e30 0x7fe2cc0a8000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33392/0 (socket says 172.21.15.49:33392) 2023-11-30T17:25:00.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.100+0000 7fe2d28e3700 1 -- 172.21.15.49:0/3776472113 learned_addr learned my addr 172.21.15.49:0/3776472113 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:25:00.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.100+0000 7fe2d20e2700 1 --2- 172.21.15.49:0/3776472113 >> v2:172.21.15.115:3300/0 conn(0x7fe2cc1544e0 0x7fe2cc1548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:00.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.100+0000 7fe2d18e1700 1 -- 172.21.15.49:0/3776472113 >> v2:172.21.15.115:3300/0 conn(0x7fe2cc1544e0 msgr2=0x7fe2cc1548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:00.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.100+0000 7fe2d18e1700 1 --2- 172.21.15.49:0/3776472113 >> v2:172.21.15.115:3300/0 conn(0x7fe2cc1544e0 0x7fe2cc1548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:00.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.100+0000 7fe2d18e1700 1 -- 172.21.15.49:0/3776472113 >> v1:172.21.15.49:6789/0 conn(0x7fe2cc0c6e30 legacy=0x7fe2cc0a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:00.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.100+0000 7fe2d18e1700 1 -- 172.21.15.49:0/3776472113 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2cc0c6630 con 0x7fe2cc06a610 2023-11-30T17:25:00.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.100+0000 7fe2d10e0700 1 -- 172.21.15.49:0/3776472113 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 974208536 0 0) 0x7fe2cc0c69a0 con 0x7fe2cc0c6e30 2023-11-30T17:25:00.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.100+0000 7fe2d18e1700 1 --2- 172.21.15.49:0/3776472113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2cc06a610 0x7fe2cc0c0bc0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7fe2cc085760 tx=0x7fe2c0009060).ready entity=mon.0 client_cookie=a9430024b67372dc server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:00.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.101+0000 7fe2d10e0700 1 -- 172.21.15.49:0/3776472113 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c000b580 con 0x7fe2cc06a610 2023-11-30T17:25:00.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.101+0000 7fe2d10e0700 1 -- 172.21.15.49:0/3776472113 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c000b6e0 con 0x7fe2cc06a610 2023-11-30T17:25:00.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.101+0000 7fe2d10e0700 1 -- 172.21.15.49:0/3776472113 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c000ba60 con 0x7fe2cc06a610 2023-11-30T17:25:00.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.101+0000 7fe2d4346700 1 -- 172.21.15.49:0/3776472113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2cc06a610 msgr2=0x7fe2cc0c0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:00.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.101+0000 7fe2d4346700 1 --2- 172.21.15.49:0/3776472113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2cc06a610 0x7fe2cc0c0bc0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7fe2cc085760 tx=0x7fe2c0009060).stop 2023-11-30T17:25:00.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.101+0000 7fe2d4346700 1 -- 172.21.15.49:0/3776472113 shutdown_connections 2023-11-30T17:25:00.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.101+0000 7fe2d4346700 1 --2- 172.21.15.49:0/3776472113 >> v2:172.21.15.115:3300/0 conn(0x7fe2cc1544e0 0x7fe2cc1548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:00.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.101+0000 7fe2d4346700 1 --2- 172.21.15.49:0/3776472113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2cc06a610 0x7fe2cc0c0bc0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:00.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.101+0000 7fe2d4346700 1 -- 172.21.15.49:0/3776472113 >> 172.21.15.49:0/3776472113 conn(0x7fe2cc085020 msgr2=0x7fe2cc094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:00.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.101+0000 7fe2d4346700 1 -- 172.21.15.49:0/3776472113 shutdown_connections 2023-11-30T17:25:00.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.101+0000 7fe2d4346700 1 -- 172.21.15.49:0/3776472113 wait complete. 2023-11-30T17:25:00.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.102+0000 7fe2d4346700 1 Processor -- start 2023-11-30T17:25:00.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.102+0000 7fe2d4346700 1 -- start start 2023-11-30T17:25:00.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.103+0000 7fe2d4346700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2cc06a610 0x7fe2cc165430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:00.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.103+0000 7fe2d4346700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2cc0c6e30 0x7fe2cc14f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:00.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.103+0000 7fe2d4346700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2cc1544e0 0x7fe2cc0ae6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:00.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.103+0000 7fe2d4346700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc095650 con 0x7fe2cc1544e0 2023-11-30T17:25:00.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.103+0000 7fe2d4346700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc165920 con 0x7fe2cc0c6e30 2023-11-30T17:25:00.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.103+0000 7fe2d4346700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc150e20 con 0x7fe2cc06a610 2023-11-30T17:25:00.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.103+0000 7fe2d28e3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2cc1544e0 0x7fe2cc0ae6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:00.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.103+0000 7fe2d28e3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2cc1544e0 0x7fe2cc0ae6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45438/0 (socket says 172.21.15.49:45438) 2023-11-30T17:25:00.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.103+0000 7fe2d28e3700 1 -- 172.21.15.49:0/794232013 learned_addr learned my addr 172.21.15.49:0/794232013 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:00.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.103+0000 7fe2d20e2700 1 --2- 172.21.15.49:0/794232013 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2cc06a610 0x7fe2cc165430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:00.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.103+0000 7fe2d18e1700 1 --2- 172.21.15.49:0/794232013 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2cc0c6e30 0x7fe2cc14f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:00.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.104+0000 7fe2d28e3700 1 -- 172.21.15.49:0/794232013 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2cc06a610 msgr2=0x7fe2cc165430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:00.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.104+0000 7fe2d28e3700 1 --2- 172.21.15.49:0/794232013 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2cc06a610 0x7fe2cc165430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:00.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.104+0000 7fe2d28e3700 1 -- 172.21.15.49:0/794232013 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2cc0c6e30 msgr2=0x7fe2cc14f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:00.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.104+0000 7fe2d28e3700 1 --2- 172.21.15.49:0/794232013 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2cc0c6e30 0x7fe2cc14f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:00.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.104+0000 7fe2d28e3700 1 -- 172.21.15.49:0/794232013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c00092a0 con 0x7fe2cc1544e0 2023-11-30T17:25:00.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.104+0000 7fe2d28e3700 1 --2- 172.21.15.49:0/794232013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2cc1544e0 0x7fe2cc0ae6d0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7fe2bc00c490 tx=0x7fe2bc007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:00.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.104+0000 7fe2ca7fc700 1 -- 172.21.15.49:0/794232013 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc00ce00 con 0x7fe2cc1544e0 2023-11-30T17:25:00.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.104+0000 7fe2ca7fc700 1 -- 172.21.15.49:0/794232013 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2bc0072e0 con 0x7fe2cc1544e0 2023-11-30T17:25:00.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.104+0000 7fe2ca7fc700 1 -- 172.21.15.49:0/794232013 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc007660 con 0x7fe2cc1544e0 2023-11-30T17:25:00.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.104+0000 7fe2d4346700 1 -- 172.21.15.49:0/794232013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2cc151100 con 0x7fe2cc1544e0 2023-11-30T17:25:00.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.104+0000 7fe2d4346700 1 -- 172.21.15.49:0/794232013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2cc1516c0 con 0x7fe2cc1544e0 2023-11-30T17:25:00.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.105+0000 7fe2d4346700 1 -- 172.21.15.49:0/794232013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2cc097520 con 0x7fe2cc1544e0 2023-11-30T17:25:00.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.105+0000 7fe2ca7fc700 1 -- 172.21.15.49:0/794232013 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe2bc0059b0 con 0x7fe2cc1544e0 2023-11-30T17:25:00.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.106+0000 7fe2ca7fc700 1 --2- 172.21.15.49:0/794232013 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe2b805f270 0x7fe2b8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:00.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.106+0000 7fe2ca7fc700 1 -- 172.21.15.49:0/794232013 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5899+0+0 (secure 0 0 0) 0x7fe2bc079940 con 0x7fe2cc1544e0 2023-11-30T17:25:00.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.106+0000 7fe2d20e2700 1 --2- 172.21.15.49:0/794232013 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe2b805f270 0x7fe2b8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:00.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.106+0000 7fe2d20e2700 1 --2- 172.21.15.49:0/794232013 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe2b805f270 0x7fe2b8061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fe2c4009fd0 tx=0x7fe2c40098a0).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:00.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.110+0000 7fe2ca7fc700 1 -- 172.21.15.49:0/794232013 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe2cc097520 con 0x7fe2cc1544e0 2023-11-30T17:25:00.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:00.351+0000 7fe2d4346700 1 -- 172.21.15.49:0/794232013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7fe2cc097520 con 0x7fe2cc1544e0 2023-11-30T17:25:01.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.307+0000 7fe2ca7fc700 1 -- 172.21.15.49:0/794232013 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v655) v1 ==== 183+0+0 (secure 0 0 0) 0x7fe2cc097520 con 0x7fe2cc1544e0 2023-11-30T17:25:01.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.311+0000 7fe2d4346700 1 -- 172.21.15.49:0/794232013 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe2b805f270 msgr2=0x7fe2b8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:01.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.311+0000 7fe2d4346700 1 --2- 172.21.15.49:0/794232013 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe2b805f270 0x7fe2b8061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fe2c4009fd0 tx=0x7fe2c40098a0).stop 2023-11-30T17:25:01.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.311+0000 7fe2d4346700 1 -- 172.21.15.49:0/794232013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2cc1544e0 msgr2=0x7fe2cc0ae6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:01.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.311+0000 7fe2d4346700 1 --2- 172.21.15.49:0/794232013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2cc1544e0 0x7fe2cc0ae6d0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7fe2bc00c490 tx=0x7fe2bc007c10).stop 2023-11-30T17:25:01.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.311+0000 7fe2d4346700 1 -- 172.21.15.49:0/794232013 shutdown_connections 2023-11-30T17:25:01.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.311+0000 7fe2d4346700 1 --2- 172.21.15.49:0/794232013 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe2b805f270 0x7fe2b8061730 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:01.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.311+0000 7fe2d4346700 1 --2- 172.21.15.49:0/794232013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2cc1544e0 0x7fe2cc0ae6d0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:01.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.311+0000 7fe2d4346700 1 --2- 172.21.15.49:0/794232013 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2cc06a610 0x7fe2cc165430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:01.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.311+0000 7fe2d4346700 1 --2- 172.21.15.49:0/794232013 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2cc0c6e30 0x7fe2cc14f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:01.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.311+0000 7fe2d4346700 1 -- 172.21.15.49:0/794232013 >> 172.21.15.49:0/794232013 conn(0x7fe2cc085020 msgr2=0x7fe2cc14fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:01.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.311+0000 7fe2d4346700 1 -- 172.21.15.49:0/794232013 shutdown_connections 2023-11-30T17:25:01.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.311+0000 7fe2d4346700 1 -- 172.21.15.49:0/794232013 wait complete. 2023-11-30T17:25:01.327 INFO:tasks.cephfs_test_runner:Test that a non-existent path leads to schedule deactivation after a few retries. ... ok 2023-11-30T17:25:01.328 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test existence of a scheduled snapshot 2023-11-30T17:25:01.328 INFO:tasks.cephfs_test_runner:test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-11-30T17:25:01.328 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-11-30T17:25:01.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.451+0000 7ff41be84700 1 Processor -- start 2023-11-30T17:25:01.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.451+0000 7ff41be84700 1 -- start start 2023-11-30T17:25:01.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.452+0000 7ff41be84700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff4141548c0 0x7ff41406a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:01.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.452+0000 7ff41be84700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4140c6e30 0x7ff4140c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:01.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.452+0000 7ff41be84700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4140c69a0 con 0x7ff4141544e0 2023-11-30T17:25:01.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.452+0000 7ff41be84700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4140c13a0 con 0x7ff4141548c0 2023-11-30T17:25:01.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.452+0000 7ff41be84700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4140c1680 con 0x7ff4140c6e30 2023-11-30T17:25:01.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.452+0000 7ff419c20700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff4141544e0 0x7ff4140c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41648/0 (socket says 172.21.15.49:41648) 2023-11-30T17:25:01.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.452+0000 7ff419c20700 1 -- 172.21.15.49:0/2712462755 learned_addr learned my addr 172.21.15.49:0/2712462755 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:25:01.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.453+0000 7ff41941f700 1 --2- 172.21.15.49:0/2712462755 >> v2:172.21.15.115:3300/0 conn(0x7ff4141548c0 0x7ff41406a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:01.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.453+0000 7ff41a421700 1 --2- 172.21.15.49:0/2712462755 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4140c6e30 0x7ff4140c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:01.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.453+0000 7ff418c1e700 1 -- 172.21.15.49:0/2712462755 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3946085669 0 0) 0x7ff4140c69a0 con 0x7ff4141544e0 2023-11-30T17:25:01.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.453+0000 7ff418c1e700 1 -- 172.21.15.49:0/2712462755 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3fc0033f0 con 0x7ff4141544e0 2023-11-30T17:25:01.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.453+0000 7ff418c1e700 1 -- 172.21.15.49:0/2712462755 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2132968671 0 0) 0x7ff3fc0033f0 con 0x7ff4141544e0 2023-11-30T17:25:01.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.453+0000 7ff418c1e700 1 -- 172.21.15.49:0/2712462755 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4140c6e30 msgr2=0x7ff4140c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:01.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.453+0000 7ff418c1e700 1 --2- 172.21.15.49:0/2712462755 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4140c6e30 0x7ff4140c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:01.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.453+0000 7ff418c1e700 1 -- 172.21.15.49:0/2712462755 >> v2:172.21.15.115:3300/0 conn(0x7ff4141548c0 msgr2=0x7ff41406a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:01.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.453+0000 7ff418c1e700 1 --2- 172.21.15.49:0/2712462755 >> v2:172.21.15.115:3300/0 conn(0x7ff4141548c0 0x7ff41406a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:01.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.453+0000 7ff418c1e700 1 -- 172.21.15.49:0/2712462755 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4140c6630 con 0x7ff4141544e0 2023-11-30T17:25:01.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.453+0000 7ff418c1e700 1 -- 172.21.15.49:0/2712462755 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7ff404001970 con 0x7ff4141544e0 2023-11-30T17:25:01.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.453+0000 7ff418c1e700 1 -- 172.21.15.49:0/2712462755 >> v1:172.21.15.49:6789/0 conn(0x7ff4141544e0 legacy=0x7ff4140c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:01.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.453+0000 7ff418c1e700 1 --2- 172.21.15.49:0/2712462755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3fc0038e0 0x7ff3fc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:01.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.453+0000 7ff418c1e700 1 --2- 172.21.15.49:0/2712462755 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4140c6e30 0x7ff3fc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:01.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.453+0000 7ff418c1e700 1 --2- 172.21.15.49:0/2712462755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3fc004b80 0x7ff3fc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:01.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.453+0000 7ff418c1e700 1 -- 172.21.15.49:0/2712462755 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4140c13a0 con 0x7ff3fc0038e0 2023-11-30T17:25:01.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.453+0000 7ff418c1e700 1 -- 172.21.15.49:0/2712462755 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4140c1680 con 0x7ff3fc004b80 2023-11-30T17:25:01.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.453+0000 7ff418c1e700 1 -- 172.21.15.49:0/2712462755 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc00b8e0 con 0x7ff4140c6e30 2023-11-30T17:25:01.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.453+0000 7ff419c20700 1 --2- 172.21.15.49:0/2712462755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3fc0038e0 0x7ff3fc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:01.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.453+0000 7ff41a421700 1 --2- 172.21.15.49:0/2712462755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3fc004b80 0x7ff3fc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:01.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.453+0000 7ff41941f700 1 --2- 172.21.15.49:0/2712462755 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4140c6e30 0x7ff3fc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:01.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.453+0000 7ff419c20700 1 -- 172.21.15.49:0/2712462755 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4140c6e30 msgr2=0x7ff3fc004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:01.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.453+0000 7ff419c20700 1 --2- 172.21.15.49:0/2712462755 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4140c6e30 0x7ff3fc004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:01.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.453+0000 7ff419c20700 1 -- 172.21.15.49:0/2712462755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3fc004b80 msgr2=0x7ff3fc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:01.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.453+0000 7ff419c20700 1 --2- 172.21.15.49:0/2712462755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3fc004b80 0x7ff3fc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:01.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.453+0000 7ff419c20700 1 -- 172.21.15.49:0/2712462755 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3fc0033f0 con 0x7ff3fc0038e0 2023-11-30T17:25:01.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.454+0000 7ff419c20700 1 --2- 172.21.15.49:0/2712462755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3fc0038e0 0x7ff3fc003d00 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7ff40400c5f0 tx=0x7ff404007b20).ready entity=mon.0 client_cookie=ec4e795bf6cced1f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:01.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.454+0000 7ff418c1e700 1 -- 172.21.15.49:0/2712462755 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff404007d50 con 0x7ff3fc0038e0 2023-11-30T17:25:01.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.454+0000 7ff418c1e700 1 -- 172.21.15.49:0/2712462755 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4040059f0 con 0x7ff3fc0038e0 2023-11-30T17:25:01.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.454+0000 7ff418c1e700 1 -- 172.21.15.49:0/2712462755 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff404005d70 con 0x7ff3fc0038e0 2023-11-30T17:25:01.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.454+0000 7ff41be84700 1 -- 172.21.15.49:0/2712462755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3fc0038e0 msgr2=0x7ff3fc003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:01.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.454+0000 7ff41be84700 1 --2- 172.21.15.49:0/2712462755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3fc0038e0 0x7ff3fc003d00 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7ff40400c5f0 tx=0x7ff404007b20).stop 2023-11-30T17:25:01.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.454+0000 7ff41a421700 1 -- 172.21.15.49:0/2712462755 reap_dead start 2023-11-30T17:25:01.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.454+0000 7ff41be84700 1 -- 172.21.15.49:0/2712462755 shutdown_connections 2023-11-30T17:25:01.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.454+0000 7ff41be84700 1 -- 172.21.15.49:0/2712462755 >> 172.21.15.49:0/2712462755 conn(0x7ff414085020 msgr2=0x7ff414094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:01.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.454+0000 7ff41be84700 1 -- 172.21.15.49:0/2712462755 shutdown_connections 2023-11-30T17:25:01.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.454+0000 7ff41be84700 1 -- 172.21.15.49:0/2712462755 wait complete. 2023-11-30T17:25:01.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.455+0000 7ff41be84700 1 Processor -- start 2023-11-30T17:25:01.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.455+0000 7ff41be84700 1 -- start start 2023-11-30T17:25:01.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.456+0000 7ff41be84700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3fc0038e0 0x7ff4141538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:01.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.456+0000 7ff41be84700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4140ca3f0 0x7ff414150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:01.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.456+0000 7ff41be84700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4141518a0 0x7ff414095fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:01.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.456+0000 7ff41be84700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff414094940 con 0x7ff4140ca3f0 2023-11-30T17:25:01.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.456+0000 7ff41be84700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff414094c20 con 0x7ff4141518a0 2023-11-30T17:25:01.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.456+0000 7ff41be84700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4141506f0 con 0x7ff3fc0038e0 2023-11-30T17:25:01.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.456+0000 7ff41941f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4140ca3f0 0x7ff414150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:01.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.456+0000 7ff41941f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4140ca3f0 0x7ff414150200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60658/0 (socket says 172.21.15.49:60658) 2023-11-30T17:25:01.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.456+0000 7ff41941f700 1 -- 172.21.15.49:0/4008361142 learned_addr learned my addr 172.21.15.49:0/4008361142 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:01.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.456+0000 7ff41a421700 1 --2- 172.21.15.49:0/4008361142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4141518a0 0x7ff414095fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:01.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.456+0000 7ff419c20700 1 --2- 172.21.15.49:0/4008361142 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3fc0038e0 0x7ff4141538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:01.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.457+0000 7ff41941f700 1 -- 172.21.15.49:0/4008361142 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3fc0038e0 msgr2=0x7ff4141538e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:01.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.457+0000 7ff41941f700 1 --2- 172.21.15.49:0/4008361142 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3fc0038e0 0x7ff4141538e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:01.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.457+0000 7ff41941f700 1 -- 172.21.15.49:0/4008361142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4141518a0 msgr2=0x7ff414095fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:01.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.457+0000 7ff41941f700 1 --2- 172.21.15.49:0/4008361142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4141518a0 0x7ff414095fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:01.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.457+0000 7ff41941f700 1 -- 172.21.15.49:0/4008361142 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4140ca870 con 0x7ff4140ca3f0 2023-11-30T17:25:01.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.457+0000 7ff41941f700 1 --2- 172.21.15.49:0/4008361142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4140ca3f0 0x7ff414150200 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7ff408011a20 tx=0x7ff408009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:01.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.457+0000 7ff411ffb700 1 -- 172.21.15.49:0/4008361142 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40800f8e0 con 0x7ff4140ca3f0 2023-11-30T17:25:01.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.457+0000 7ff411ffb700 1 -- 172.21.15.49:0/4008361142 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40800fa40 con 0x7ff4140ca3f0 2023-11-30T17:25:01.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.457+0000 7ff41be84700 1 -- 172.21.15.49:0/4008361142 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff414098d30 con 0x7ff4140ca3f0 2023-11-30T17:25:01.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.457+0000 7ff411ffb700 1 -- 172.21.15.49:0/4008361142 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40800fdc0 con 0x7ff4140ca3f0 2023-11-30T17:25:01.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.457+0000 7ff41be84700 1 -- 172.21.15.49:0/4008361142 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff414151d20 con 0x7ff4140ca3f0 2023-11-30T17:25:01.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.458+0000 7ff41be84700 1 -- 172.21.15.49:0/4008361142 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff414151fa0 con 0x7ff4140ca3f0 2023-11-30T17:25:01.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.458+0000 7ff411ffb700 1 -- 172.21.15.49:0/4008361142 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff408014650 con 0x7ff4140ca3f0 2023-11-30T17:25:01.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.459+0000 7ff411ffb700 1 --2- 172.21.15.49:0/4008361142 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff40005f270 0x7ff400061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:01.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.459+0000 7ff411ffb700 1 -- 172.21.15.49:0/4008361142 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5899+0+0 (secure 0 0 0) 0x7ff40807ae90 con 0x7ff4140ca3f0 2023-11-30T17:25:01.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.459+0000 7ff419c20700 1 --2- 172.21.15.49:0/4008361142 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff40005f270 0x7ff400061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:01.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.459+0000 7ff419c20700 1 --2- 172.21.15.49:0/4008361142 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff40005f270 0x7ff400061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7ff404001270 tx=0x7ff404015000).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:01.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.463+0000 7ff411ffb700 1 -- 172.21.15.49:0/4008361142 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff40804c0c0 con 0x7ff4140ca3f0 2023-11-30T17:25:01.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:01.704+0000 7ff41be84700 1 -- 172.21.15.49:0/4008361142 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7ff41406c860 con 0x7ff4140ca3f0 2023-11-30T17:25:02.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.308+0000 7ff411ffb700 1 -- 172.21.15.49:0/4008361142 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v656) v1 ==== 151+0+0 (secure 0 0 0) 0x7ff40804f6e0 con 0x7ff4140ca3f0 2023-11-30T17:25:02.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.310+0000 7ff41be84700 1 -- 172.21.15.49:0/4008361142 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff40005f270 msgr2=0x7ff400061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:02.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.310+0000 7ff41be84700 1 --2- 172.21.15.49:0/4008361142 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff40005f270 0x7ff400061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7ff404001270 tx=0x7ff404015000).stop 2023-11-30T17:25:02.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.310+0000 7ff41be84700 1 -- 172.21.15.49:0/4008361142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4140ca3f0 msgr2=0x7ff414150200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:02.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.310+0000 7ff41be84700 1 --2- 172.21.15.49:0/4008361142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4140ca3f0 0x7ff414150200 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7ff408011a20 tx=0x7ff408009060).stop 2023-11-30T17:25:02.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.310+0000 7ff41be84700 1 -- 172.21.15.49:0/4008361142 shutdown_connections 2023-11-30T17:25:02.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.310+0000 7ff41be84700 1 --2- 172.21.15.49:0/4008361142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4141518a0 0x7ff414095fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:02.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.310+0000 7ff41be84700 1 --2- 172.21.15.49:0/4008361142 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3fc0038e0 0x7ff4141538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:02.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.310+0000 7ff41be84700 1 --2- 172.21.15.49:0/4008361142 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff40005f270 0x7ff400061730 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:02.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.310+0000 7ff41be84700 1 --2- 172.21.15.49:0/4008361142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4140ca3f0 0x7ff414150200 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:02.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.310+0000 7ff41be84700 1 -- 172.21.15.49:0/4008361142 >> 172.21.15.49:0/4008361142 conn(0x7ff414085020 msgr2=0x7ff4140ae3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:02.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.310+0000 7ff41be84700 1 -- 172.21.15.49:0/4008361142 shutdown_connections 2023-11-30T17:25:02.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.311+0000 7ff41be84700 1 -- 172.21.15.49:0/4008361142 wait complete. 2023-11-30T17:25:02.325 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-30T17:25:02.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.445+0000 7efe80c5e700 1 Processor -- start 2023-11-30T17:25:02.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.445+0000 7efe80c5e700 1 -- start start 2023-11-30T17:25:02.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.446+0000 7efe80c5e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efe7c0c6190 0x7efe7c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:02.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.446+0000 7efe80c5e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe7c158320 0x7efe7c1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:02.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.446+0000 7efe80c5e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe7c158cc0 con 0x7efe7c098d10 2023-11-30T17:25:02.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.446+0000 7efe80c5e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe7c0c72d0 con 0x7efe7c0c6190 2023-11-30T17:25:02.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.446+0000 7efe80c5e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c064570 con 0x7efe7c158320 2023-11-30T17:25:02.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.446+0000 7efe7a59c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7efe7c098d10 0x7efe7c063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41664/0 (socket says 172.21.15.49:41664) 2023-11-30T17:25:02.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.446+0000 7efe7a59c700 1 -- 172.21.15.49:0/1963342667 learned_addr learned my addr 172.21.15.49:0/1963342667 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:25:02.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.446+0000 7efe79d9b700 1 --2- 172.21.15.49:0/1963342667 >> v2:172.21.15.115:3300/0 conn(0x7efe7c0c6190 0x7efe7c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:02.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.446+0000 7efe7ad9d700 1 --2- 172.21.15.49:0/1963342667 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe7c158320 0x7efe7c1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:02.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.446+0000 7efe7959a700 1 -- 172.21.15.49:0/1963342667 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1023745858 0 0) 0x7efe74001110 con 0x7efe7c098d10 2023-11-30T17:25:02.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.447+0000 7efe7959a700 1 -- 172.21.15.49:0/1963342667 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe680033f0 con 0x7efe7c098d10 2023-11-30T17:25:02.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.447+0000 7efe7959a700 1 -- 172.21.15.49:0/1963342667 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2510287267 0 0) 0x7efe680033f0 con 0x7efe7c098d10 2023-11-30T17:25:02.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.447+0000 7efe79d9b700 1 -- 172.21.15.49:0/1963342667 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe7c158320 msgr2=0x7efe7c1587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:02.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.447+0000 7efe79d9b700 1 --2- 172.21.15.49:0/1963342667 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe7c158320 0x7efe7c1587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:02.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.447+0000 7efe79d9b700 1 -- 172.21.15.49:0/1963342667 >> v1:172.21.15.49:6789/0 conn(0x7efe7c098d10 legacy=0x7efe7c063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:02.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.447+0000 7efe79d9b700 1 -- 172.21.15.49:0/1963342667 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe7c154bc0 con 0x7efe7c0c6190 2023-11-30T17:25:02.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.447+0000 7efe79d9b700 1 --2- 172.21.15.49:0/1963342667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe7c0c6190 0x7efe7c0c7760 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7efe64009760 tx=0x7efe64009060).ready entity=mon.1 client_cookie=79ac86a9f4c9b031 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:02.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.447+0000 7efe7959a700 1 -- 172.21.15.49:0/1963342667 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe74001600 con 0x7efe7c0c6190 2023-11-30T17:25:02.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.447+0000 7efe7959a700 1 -- 172.21.15.49:0/1963342667 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe64011400 con 0x7efe7c0c6190 2023-11-30T17:25:02.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.447+0000 7efe7959a700 1 -- 172.21.15.49:0/1963342667 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe64011780 con 0x7efe7c0c6190 2023-11-30T17:25:02.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.447+0000 7efe80c5e700 1 -- 172.21.15.49:0/1963342667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe7c0c6190 msgr2=0x7efe7c0c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:02.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.448+0000 7efe80c5e700 1 --2- 172.21.15.49:0/1963342667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe7c0c6190 0x7efe7c0c7760 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7efe64009760 tx=0x7efe64009060).stop 2023-11-30T17:25:02.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.448+0000 7efe80c5e700 1 -- 172.21.15.49:0/1963342667 shutdown_connections 2023-11-30T17:25:02.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.448+0000 7efe80c5e700 1 --2- 172.21.15.49:0/1963342667 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe7c158320 0x7efe7c1587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:02.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.448+0000 7efe80c5e700 1 --2- 172.21.15.49:0/1963342667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe7c0c6190 0x7efe7c0c7760 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:02.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.448+0000 7efe80c5e700 1 -- 172.21.15.49:0/1963342667 >> 172.21.15.49:0/1963342667 conn(0x7efe7c0cb310 msgr2=0x7efe7c0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:02.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.448+0000 7efe80c5e700 1 -- 172.21.15.49:0/1963342667 shutdown_connections 2023-11-30T17:25:02.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.448+0000 7efe80c5e700 1 -- 172.21.15.49:0/1963342667 wait complete. 2023-11-30T17:25:02.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.449+0000 7efe80c5e700 1 Processor -- start 2023-11-30T17:25:02.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.449+0000 7efe80c5e700 1 -- start start 2023-11-30T17:25:02.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.450+0000 7efe80c5e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe7c098d10 0x7efe7c0ac110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:02.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.450+0000 7efe80c5e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe7c0c6190 0x7efe7c0af360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:02.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.450+0000 7efe80c5e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe7c158320 0x7efe7c168820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:02.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.450+0000 7efe80c5e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c0ad470 con 0x7efe7c158320 2023-11-30T17:25:02.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.450+0000 7efe80c5e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c0ac600 con 0x7efe7c0c6190 2023-11-30T17:25:02.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.450+0000 7efe80c5e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c0ac860 con 0x7efe7c098d10 2023-11-30T17:25:02.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.450+0000 7efe7ad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe7c158320 0x7efe7c168820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:02.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.450+0000 7efe7ad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe7c158320 0x7efe7c168820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60662/0 (socket says 172.21.15.49:60662) 2023-11-30T17:25:02.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.450+0000 7efe7ad9d700 1 -- 172.21.15.49:0/1006042632 learned_addr learned my addr 172.21.15.49:0/1006042632 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:02.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.450+0000 7efe7a59c700 1 --2- 172.21.15.49:0/1006042632 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe7c098d10 0x7efe7c0ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:02.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.450+0000 7efe79d9b700 1 --2- 172.21.15.49:0/1006042632 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe7c0c6190 0x7efe7c0af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:02.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.450+0000 7efe7ad9d700 1 -- 172.21.15.49:0/1006042632 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe7c098d10 msgr2=0x7efe7c0ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:02.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.450+0000 7efe7ad9d700 1 --2- 172.21.15.49:0/1006042632 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe7c098d10 0x7efe7c0ac110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:02.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.450+0000 7efe7ad9d700 1 -- 172.21.15.49:0/1006042632 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe7c0c6190 msgr2=0x7efe7c0af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:02.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.450+0000 7efe7ad9d700 1 --2- 172.21.15.49:0/1006042632 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe7c0c6190 0x7efe7c0af360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:02.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.450+0000 7efe7ad9d700 1 -- 172.21.15.49:0/1006042632 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe640092a0 con 0x7efe7c158320 2023-11-30T17:25:02.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.450+0000 7efe7ad9d700 1 --2- 172.21.15.49:0/1006042632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe7c158320 0x7efe7c168820 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7efe6c009e90 tx=0x7efe6c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:02.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.450+0000 7efe727fc700 1 -- 172.21.15.49:0/1006042632 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c00caa0 con 0x7efe7c158320 2023-11-30T17:25:02.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.450+0000 7efe727fc700 1 -- 172.21.15.49:0/1006042632 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6c00f040 con 0x7efe7c158320 2023-11-30T17:25:02.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.450+0000 7efe80c5e700 1 -- 172.21.15.49:0/1006042632 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe7c0acb40 con 0x7efe7c158320 2023-11-30T17:25:02.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.450+0000 7efe727fc700 1 -- 172.21.15.49:0/1006042632 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c00ce10 con 0x7efe7c158320 2023-11-30T17:25:02.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.450+0000 7efe80c5e700 1 -- 172.21.15.49:0/1006042632 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe7c0ad100 con 0x7efe7c158320 2023-11-30T17:25:02.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.452+0000 7efe80c5e700 1 -- 172.21.15.49:0/1006042632 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe7c0ca750 con 0x7efe7c158320 2023-11-30T17:25:02.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.452+0000 7efe727fc700 1 -- 172.21.15.49:0/1006042632 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7efe6c013610 con 0x7efe7c158320 2023-11-30T17:25:02.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.452+0000 7efe727fc700 1 --2- 172.21.15.49:0/1006042632 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efe5c05f270 0x7efe5c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:02.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.452+0000 7efe727fc700 1 -- 172.21.15.49:0/1006042632 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5899+0+0 (secure 0 0 0) 0x7efe6c07aae0 con 0x7efe7c158320 2023-11-30T17:25:02.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.452+0000 7efe7a59c700 1 --2- 172.21.15.49:0/1006042632 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efe5c05f270 0x7efe5c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:02.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.453+0000 7efe7a59c700 1 --2- 172.21.15.49:0/1006042632 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efe5c05f270 0x7efe5c061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7efe740017b0 tx=0x7efe74001dd0).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:02.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.456+0000 7efe727fc700 1 -- 172.21.15.49:0/1006042632 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efe6c04bd10 con 0x7efe7c158320 2023-11-30T17:25:02.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.628+0000 7efe80c5e700 1 -- 172.21.15.49:0/1006042632 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7efe7c06c860 con 0x7efe7c158320 2023-11-30T17:25:02.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.631+0000 7efe727fc700 1 -- 172.21.15.49:0/1006042632 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7efe6c04f330 con 0x7efe7c158320 2023-11-30T17:25:02.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.633+0000 7efe80c5e700 1 -- 172.21.15.49:0/1006042632 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efe5c05f270 msgr2=0x7efe5c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:02.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.633+0000 7efe80c5e700 1 --2- 172.21.15.49:0/1006042632 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efe5c05f270 0x7efe5c061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7efe740017b0 tx=0x7efe74001dd0).stop 2023-11-30T17:25:02.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.633+0000 7efe80c5e700 1 -- 172.21.15.49:0/1006042632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe7c158320 msgr2=0x7efe7c168820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:02.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.633+0000 7efe80c5e700 1 --2- 172.21.15.49:0/1006042632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe7c158320 0x7efe7c168820 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7efe6c009e90 tx=0x7efe6c00b040).stop 2023-11-30T17:25:02.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.633+0000 7efe80c5e700 1 -- 172.21.15.49:0/1006042632 shutdown_connections 2023-11-30T17:25:02.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.633+0000 7efe80c5e700 1 --2- 172.21.15.49:0/1006042632 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efe5c05f270 0x7efe5c061730 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:02.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.633+0000 7efe80c5e700 1 --2- 172.21.15.49:0/1006042632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe7c158320 0x7efe7c168820 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:02.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.633+0000 7efe80c5e700 1 --2- 172.21.15.49:0/1006042632 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe7c098d10 0x7efe7c0ac110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:02.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.633+0000 7efe80c5e700 1 --2- 172.21.15.49:0/1006042632 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe7c0c6190 0x7efe7c0af360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:02.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.633+0000 7efe80c5e700 1 -- 172.21.15.49:0/1006042632 >> 172.21.15.49:0/1006042632 conn(0x7efe7c0cb310 msgr2=0x7efe7c0c0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:02.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.633+0000 7efe80c5e700 1 -- 172.21.15.49:0/1006042632 shutdown_connections 2023-11-30T17:25:02.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.633+0000 7efe80c5e700 1 -- 172.21.15.49:0/1006042632 wait complete. 2023-11-30T17:25:02.646 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-30T17:25:02.647 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T17:25:02.688 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T17:25:02.730 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-30T17:25:02.730 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-30T17:25:02.730 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:25:02.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.846+0000 7fb3bd1ab700 1 Processor -- start 2023-11-30T17:25:02.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.846+0000 7fb3bd1ab700 1 -- start start 2023-11-30T17:25:02.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.847+0000 7fb3bd1ab700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3b81544d0 0x7fb3b8155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:02.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.847+0000 7fb3bd1ab700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3b80683d0 con 0x7fb3b80673c0 2023-11-30T17:25:02.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.847+0000 7fb3bd1ab700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3b8067850 con 0x7fb3b8066f40 2023-11-30T17:25:02.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.847+0000 7fb3bd1ab700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b8067b30 con 0x7fb3b81544d0 2023-11-30T17:25:02.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.847+0000 7fb3b759e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb3b80673c0 0x7fb3b815e0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41676/0 (socket says 172.21.15.49:41676) 2023-11-30T17:25:02.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.847+0000 7fb3b759e700 1 -- 172.21.15.49:0/2754115050 learned_addr learned my addr 172.21.15.49:0/2754115050 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:25:02.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.847+0000 7fb3b5d9b700 1 -- 172.21.15.49:0/2754115050 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 840989599 0 0) 0x7fb3b80683d0 con 0x7fb3b80673c0 2023-11-30T17:25:02.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.847+0000 7fb3b5d9b700 1 -- 172.21.15.49:0/2754115050 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3a40033f0 con 0x7fb3b80673c0 2023-11-30T17:25:02.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.847+0000 7fb3b6d9d700 1 --2- 172.21.15.49:0/2754115050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3b81544d0 0x7fb3b8155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:02.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.848+0000 7fb3b5d9b700 1 -- 172.21.15.49:0/2754115050 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3254845583 0 0) 0x7fb3a40033f0 con 0x7fb3b80673c0 2023-11-30T17:25:02.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.848+0000 7fb3b5d9b700 1 -- 172.21.15.49:0/2754115050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3b81544d0 msgr2=0x7fb3b8155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:02.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.848+0000 7fb3b5d9b700 1 --2- 172.21.15.49:0/2754115050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3b81544d0 0x7fb3b8155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:02.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.848+0000 7fb3b5d9b700 1 -- 172.21.15.49:0/2754115050 >> v1:172.21.15.115:6789/0 conn(0x7fb3b8066f40 legacy=0x7fb3b8095e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:02.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.848+0000 7fb3b5d9b700 1 -- 172.21.15.49:0/2754115050 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b8067e10 con 0x7fb3b80673c0 2023-11-30T17:25:02.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.848+0000 7fb3b5d9b700 1 -- 172.21.15.49:0/2754115050 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fb3a80017f0 con 0x7fb3b80673c0 2023-11-30T17:25:02.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.848+0000 7fb3b5d9b700 1 -- 172.21.15.49:0/2754115050 >> v1:172.21.15.49:6789/0 conn(0x7fb3b80673c0 legacy=0x7fb3b815e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:02.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.848+0000 7fb3b5d9b700 1 --2- 172.21.15.49:0/2754115050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3a4003910 0x7fb3a4003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:02.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.848+0000 7fb3b5d9b700 1 --2- 172.21.15.49:0/2754115050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3a4004690 0x7fb3a4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:02.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.848+0000 7fb3b5d9b700 1 --2- 172.21.15.49:0/2754115050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3b81544d0 0x7fb3a4005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:02.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.848+0000 7fb3b5d9b700 1 -- 172.21.15.49:0/2754115050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b8067b30 con 0x7fb3a4003910 2023-11-30T17:25:02.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.848+0000 7fb3b5d9b700 1 -- 172.21.15.49:0/2754115050 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a400b9c0 con 0x7fb3a4004690 2023-11-30T17:25:02.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.848+0000 7fb3b5d9b700 1 -- 172.21.15.49:0/2754115050 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a400bb80 con 0x7fb3b81544d0 2023-11-30T17:25:02.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.848+0000 7fb3b6d9d700 1 --2- 172.21.15.49:0/2754115050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3a4003910 0x7fb3a4003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:02.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.848+0000 7fb3b659c700 1 --2- 172.21.15.49:0/2754115050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3a4004690 0x7fb3a4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:02.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.848+0000 7fb3b759e700 1 --2- 172.21.15.49:0/2754115050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3b81544d0 0x7fb3a4005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:02.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.848+0000 7fb3b6d9d700 1 -- 172.21.15.49:0/2754115050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3b81544d0 msgr2=0x7fb3a4005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:02.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.848+0000 7fb3b6d9d700 1 --2- 172.21.15.49:0/2754115050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3b81544d0 0x7fb3a4005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:02.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.848+0000 7fb3b6d9d700 1 -- 172.21.15.49:0/2754115050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3a4004690 msgr2=0x7fb3a4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:02.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.848+0000 7fb3b6d9d700 1 --2- 172.21.15.49:0/2754115050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3a4004690 0x7fb3a4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:02.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.848+0000 7fb3b6d9d700 1 -- 172.21.15.49:0/2754115050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a40033f0 con 0x7fb3a4003910 2023-11-30T17:25:02.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.848+0000 7fb3b6d9d700 1 --2- 172.21.15.49:0/2754115050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3a4003910 0x7fb3a4003d30 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7fb3b000b9d0 tx=0x7fb3b0008040).ready entity=mon.0 client_cookie=20bdae1a86ec880b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:02.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.848+0000 7fb3b5d9b700 1 -- 172.21.15.49:0/2754115050 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0013480 con 0x7fb3a4003910 2023-11-30T17:25:02.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.848+0000 7fb3b5d9b700 1 -- 172.21.15.49:0/2754115050 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b00135e0 con 0x7fb3a4003910 2023-11-30T17:25:02.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.849+0000 7fb3b5d9b700 1 -- 172.21.15.49:0/2754115050 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0013960 con 0x7fb3a4003910 2023-11-30T17:25:02.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.849+0000 7fb3bd1ab700 1 -- 172.21.15.49:0/2754115050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3a4003910 msgr2=0x7fb3a4003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:02.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.849+0000 7fb3bd1ab700 1 --2- 172.21.15.49:0/2754115050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3a4003910 0x7fb3a4003d30 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7fb3b000b9d0 tx=0x7fb3b0008040).stop 2023-11-30T17:25:02.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.849+0000 7fb3b759e700 1 -- 172.21.15.49:0/2754115050 reap_dead start 2023-11-30T17:25:02.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.849+0000 7fb3bd1ab700 1 -- 172.21.15.49:0/2754115050 shutdown_connections 2023-11-30T17:25:02.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.849+0000 7fb3bd1ab700 1 -- 172.21.15.49:0/2754115050 >> 172.21.15.49:0/2754115050 conn(0x7fb3b80631d0 msgr2=0x7fb3b80c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:02.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.849+0000 7fb3bd1ab700 1 -- 172.21.15.49:0/2754115050 shutdown_connections 2023-11-30T17:25:02.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.849+0000 7fb3bd1ab700 1 -- 172.21.15.49:0/2754115050 wait complete. 2023-11-30T17:25:02.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.850+0000 7fb3bd1ab700 1 Processor -- start 2023-11-30T17:25:02.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.850+0000 7fb3bd1ab700 1 -- start start 2023-11-30T17:25:02.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.851+0000 7fb3bd1ab700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3a4003910 0x7fb3b8157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:02.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.851+0000 7fb3bd1ab700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3b80a8a00 0x7fb3b80aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:02.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.851+0000 7fb3bd1ab700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3b8165aa0 0x7fb3b8165f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:02.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.851+0000 7fb3bd1ab700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b8164b70 con 0x7fb3b8165aa0 2023-11-30T17:25:02.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.851+0000 7fb3bd1ab700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b80a9960 con 0x7fb3b80a8a00 2023-11-30T17:25:02.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.851+0000 7fb3bd1ab700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b80a8e80 con 0x7fb3a4003910 2023-11-30T17:25:02.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.851+0000 7fb3b759e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3b8165aa0 0x7fb3b8165f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:02.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.851+0000 7fb3b759e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3b8165aa0 0x7fb3b8165f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60678/0 (socket says 172.21.15.49:60678) 2023-11-30T17:25:02.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.851+0000 7fb3b759e700 1 -- 172.21.15.49:0/2090048926 learned_addr learned my addr 172.21.15.49:0/2090048926 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:02.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.851+0000 7fb3b659c700 1 --2- 172.21.15.49:0/2090048926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3b80a8a00 0x7fb3b80aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:02.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.851+0000 7fb3b6d9d700 1 --2- 172.21.15.49:0/2090048926 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3a4003910 0x7fb3b8157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:02.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.851+0000 7fb3b759e700 1 -- 172.21.15.49:0/2090048926 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3a4003910 msgr2=0x7fb3b8157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:02.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.851+0000 7fb3b759e700 1 --2- 172.21.15.49:0/2090048926 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3a4003910 0x7fb3b8157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:02.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.851+0000 7fb3b759e700 1 -- 172.21.15.49:0/2090048926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3b80a8a00 msgr2=0x7fb3b80aa9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:02.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.851+0000 7fb3b759e700 1 --2- 172.21.15.49:0/2090048926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3b80a8a00 0x7fb3b80aa9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:02.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.852+0000 7fb3b759e700 1 -- 172.21.15.49:0/2090048926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b8164870 con 0x7fb3b8165aa0 2023-11-30T17:25:02.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.852+0000 7fb3b759e700 1 --2- 172.21.15.49:0/2090048926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3b8165aa0 0x7fb3b8165f20 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7fb3b80c9040 tx=0x7fb3a8007d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:02.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.852+0000 7fb3aeffd700 1 -- 172.21.15.49:0/2090048926 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a80017d0 con 0x7fb3b8165aa0 2023-11-30T17:25:02.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.852+0000 7fb3aeffd700 1 -- 172.21.15.49:0/2090048926 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a800f910 con 0x7fb3b8165aa0 2023-11-30T17:25:02.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.852+0000 7fb3bd1ab700 1 -- 172.21.15.49:0/2090048926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3b80aaed0 con 0x7fb3b8165aa0 2023-11-30T17:25:02.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.852+0000 7fb3aeffd700 1 -- 172.21.15.49:0/2090048926 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a800fc90 con 0x7fb3b8165aa0 2023-11-30T17:25:02.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.852+0000 7fb3bd1ab700 1 -- 172.21.15.49:0/2090048926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3b80a93a0 con 0x7fb3b8165aa0 2023-11-30T17:25:02.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.853+0000 7fb3bd1ab700 1 -- 172.21.15.49:0/2090048926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3b8164ce0 con 0x7fb3b8165aa0 2023-11-30T17:25:02.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.853+0000 7fb3aeffd700 1 -- 172.21.15.49:0/2090048926 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb3a8020440 con 0x7fb3b8165aa0 2023-11-30T17:25:02.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.853+0000 7fb3aeffd700 1 --2- 172.21.15.49:0/2090048926 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb39805f270 0x7fb398061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:02.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.853+0000 7fb3aeffd700 1 -- 172.21.15.49:0/2090048926 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5899+0+0 (secure 0 0 0) 0x7fb3a807a0e0 con 0x7fb3b8165aa0 2023-11-30T17:25:02.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.854+0000 7fb3b6d9d700 1 --2- 172.21.15.49:0/2090048926 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb39805f270 0x7fb398061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:02.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.854+0000 7fb3b6d9d700 1 --2- 172.21.15.49:0/2090048926 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb39805f270 0x7fb398061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fb3b000b9d0 tx=0x7fb3b0008040).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:02.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:02.857+0000 7fb3aeffd700 1 -- 172.21.15.49:0/2090048926 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb3b8164ce0 con 0x7fb3b8165aa0 2023-11-30T17:25:03.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.073+0000 7fb3bd1ab700 1 -- 172.21.15.49:0/2090048926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3b8164cb0 con 0x7fb3b8165aa0 2023-11-30T17:25:03.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.073+0000 7fb3aeffd700 1 -- 172.21.15.49:0/2090048926 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fb3a801b070 con 0x7fb3b8165aa0 2023-11-30T17:25:03.076 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:25:03.076 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":48,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1725128963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1725128963},{"type":"v1","addr":"172.21.15.115:6836","nonce":1725128963}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6955,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3975305695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3975305695},{"type":"v1","addr":"172.21.15.115:6837","nonce":3975305695}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/2909602857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2909602857},{"type":"v1","addr":"172.21.15.49:6834","nonce":2909602857}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7560,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2694042942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2694042942},{"type":"v1","addr":"172.21.15.49:6835","nonce":2694042942}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48}],"filesystems":[]} 2023-11-30T17:25:03.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.075+0000 7fb3bd1ab700 1 -- 172.21.15.49:0/2090048926 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb39805f270 msgr2=0x7fb398061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:03.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.075+0000 7fb3bd1ab700 1 --2- 172.21.15.49:0/2090048926 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb39805f270 0x7fb398061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fb3b000b9d0 tx=0x7fb3b0008040).stop 2023-11-30T17:25:03.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.075+0000 7fb3bd1ab700 1 -- 172.21.15.49:0/2090048926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3b8165aa0 msgr2=0x7fb3b8165f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:03.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.075+0000 7fb3bd1ab700 1 --2- 172.21.15.49:0/2090048926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3b8165aa0 0x7fb3b8165f20 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7fb3b80c9040 tx=0x7fb3a8007d80).stop 2023-11-30T17:25:03.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.075+0000 7fb3bd1ab700 1 -- 172.21.15.49:0/2090048926 shutdown_connections 2023-11-30T17:25:03.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.075+0000 7fb3bd1ab700 1 --2- 172.21.15.49:0/2090048926 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb39805f270 0x7fb398061730 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:03.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.075+0000 7fb3bd1ab700 1 --2- 172.21.15.49:0/2090048926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3b8165aa0 0x7fb3b8165f20 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:03.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.075+0000 7fb3bd1ab700 1 --2- 172.21.15.49:0/2090048926 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3a4003910 0x7fb3b8157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:03.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.075+0000 7fb3bd1ab700 1 --2- 172.21.15.49:0/2090048926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3b80a8a00 0x7fb3b80aa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:03.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.075+0000 7fb3bd1ab700 1 -- 172.21.15.49:0/2090048926 >> 172.21.15.49:0/2090048926 conn(0x7fb3b80631d0 msgr2=0x7fb3b80a7e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:03.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.075+0000 7fb3bd1ab700 1 -- 172.21.15.49:0/2090048926 shutdown_connections 2023-11-30T17:25:03.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.075+0000 7fb3bd1ab700 1 -- 172.21.15.49:0/2090048926 wait complete. 2023-11-30T17:25:03.080 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 48 2023-11-30T17:25:03.091 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-30T17:25:03.091 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-30T17:25:03.091 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-30T17:25:03.091 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T17:25:03.092 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-30T17:25:03.092 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-30T17:25:03.092 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-30T17:25:03.093 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T17:25:03.093 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-30T17:25:03.093 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-30T17:25:03.093 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-30T17:25:03.094 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T17:25:03.094 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-30T17:25:03.094 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-30T17:25:03.094 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-30T17:25:03.094 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T17:25:03.100 INFO:tasks.ceph.mds.a:Stopped 2023-11-30T17:25:03.100 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-30T17:25:03.101 INFO:tasks.ceph.mds.c:Stopped 2023-11-30T17:25:03.101 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-30T17:25:03.104 INFO:tasks.ceph.mds.b:Stopped 2023-11-30T17:25:03.104 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-30T17:25:03.105 INFO:tasks.ceph.mds.d:Stopped 2023-11-30T17:25:03.105 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-30T17:25:03.143 INFO:tasks.ceph.mds.a:Started 2023-11-30T17:25:03.144 DEBUG:teuthology.parallel:result is None 2023-11-30T17:25:03.144 INFO:tasks.ceph.mds.c:Started 2023-11-30T17:25:03.145 DEBUG:teuthology.parallel:result is None 2023-11-30T17:25:03.147 INFO:tasks.ceph.mds.b:Started 2023-11-30T17:25:03.147 DEBUG:teuthology.parallel:result is None 2023-11-30T17:25:03.147 INFO:tasks.ceph.mds.d:Started 2023-11-30T17:25:03.147 DEBUG:teuthology.parallel:result is None 2023-11-30T17:25:03.148 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-30T17:25:03.218 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-11-30T17:25:03.218 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-11-30T17:25:03.219 INFO:tasks.ceph.mds.a.smithi049.stderr:2023-11-30T17:25:03.216+0000 7fad5c64f700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-11-30T17:25:03.229 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-11-30T17:25:03.232 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-11-30T17:25:03.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.274+0000 7f5ddddc8700 1 Processor -- start 2023-11-30T17:25:03.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.275+0000 7f5ddddc8700 1 -- start start 2023-11-30T17:25:03.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.275+0000 7f5ddddc8700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5dd80a8280 0x7f5dd80a8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:03.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.275+0000 7f5ddddc8700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5dd814e600 0x7f5dd814ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:03.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.275+0000 7f5ddddc8700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd8067770 con 0x7f5dd8158160 2023-11-30T17:25:03.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.275+0000 7f5ddddc8700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd8159180 con 0x7f5dd814e600 2023-11-30T17:25:03.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.275+0000 7f5ddddc8700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd80be8d0 con 0x7f5dd80a8280 2023-11-30T17:25:03.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.275+0000 7f5dd7fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5dd814e600 0x7f5dd814ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:03.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.276+0000 7f5dd7fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5dd814e600 0x7f5dd814ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60738/0 (socket says 172.21.15.49:60738) 2023-11-30T17:25:03.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.276+0000 7f5dd7fff700 1 -- 172.21.15.49:0/3193332818 learned_addr learned my addr 172.21.15.49:0/3193332818 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:03.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.276+0000 7f5dd77fe700 1 --2- 172.21.15.49:0/3193332818 >> v2:172.21.15.115:3300/0 conn(0x7f5dd80a8280 0x7f5dd80a8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:03.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.276+0000 7f5dd7fff700 1 -- 172.21.15.49:0/3193332818 >> v2:172.21.15.115:3300/0 conn(0x7f5dd80a8280 msgr2=0x7f5dd80a8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:03.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.276+0000 7f5dd7fff700 1 --2- 172.21.15.49:0/3193332818 >> v2:172.21.15.115:3300/0 conn(0x7f5dd80a8280 0x7f5dd80a8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:03.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.276+0000 7f5dd7fff700 1 -- 172.21.15.49:0/3193332818 >> v1:172.21.15.115:6789/0 conn(0x7f5dd8158160 legacy=0x7f5dd8155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:03.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.276+0000 7f5dd7fff700 1 -- 172.21.15.49:0/3193332818 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd8158600 con 0x7f5dd814e600 2023-11-30T17:25:03.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.276+0000 7f5dd7fff700 1 --2- 172.21.15.49:0/3193332818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5dd814e600 0x7f5dd814ea90 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7f5dd80c9050 tx=0x7f5dd0009840).ready entity=mon.0 client_cookie=b333b162c0b9b4a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:03.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.276+0000 7f5dd67fc700 1 -- 172.21.15.49:0/3193332818 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd000e070 con 0x7f5dd814e600 2023-11-30T17:25:03.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.276+0000 7f5dd67fc700 1 -- 172.21.15.49:0/3193332818 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd000ba50 con 0x7f5dd814e600 2023-11-30T17:25:03.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.276+0000 7f5dd67fc700 1 -- 172.21.15.49:0/3193332818 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd000bdd0 con 0x7f5dd814e600 2023-11-30T17:25:03.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.277+0000 7f5ddddc8700 1 -- 172.21.15.49:0/3193332818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5dd814e600 msgr2=0x7f5dd814ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:03.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.277+0000 7f5ddddc8700 1 --2- 172.21.15.49:0/3193332818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5dd814e600 0x7f5dd814ea90 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7f5dd80c9050 tx=0x7f5dd0009840).stop 2023-11-30T17:25:03.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.277+0000 7f5ddddc8700 1 -- 172.21.15.49:0/3193332818 shutdown_connections 2023-11-30T17:25:03.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.277+0000 7f5ddddc8700 1 --2- 172.21.15.49:0/3193332818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5dd814e600 0x7f5dd814ea90 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:03.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.277+0000 7f5ddddc8700 1 --2- 172.21.15.49:0/3193332818 >> v2:172.21.15.115:3300/0 conn(0x7f5dd80a8280 0x7f5dd80a8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:03.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.277+0000 7f5ddddc8700 1 -- 172.21.15.49:0/3193332818 >> 172.21.15.49:0/3193332818 conn(0x7f5dd8062700 msgr2=0x7f5dd8062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:03.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.277+0000 7f5ddddc8700 1 -- 172.21.15.49:0/3193332818 shutdown_connections 2023-11-30T17:25:03.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.277+0000 7f5ddddc8700 1 -- 172.21.15.49:0/3193332818 wait complete. 2023-11-30T17:25:03.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.278+0000 7f5ddddc8700 1 Processor -- start 2023-11-30T17:25:03.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.278+0000 7f5ddddc8700 1 -- start start 2023-11-30T17:25:03.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.279+0000 7f5ddddc8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5dd80a8280 0x7f5dd814ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:03.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.279+0000 7f5ddddc8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5dd814e600 0x7f5dd814d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:03.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.279+0000 7f5ddddc8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5dd8158160 0x7f5dd814dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:03.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.279+0000 7f5ddddc8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd814e210 con 0x7f5dd80a8280 2023-11-30T17:25:03.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.279+0000 7f5ddddc8700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd80aba80 con 0x7f5dd814e600 2023-11-30T17:25:03.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.279+0000 7f5ddddc8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd81649d0 con 0x7f5dd8158160 2023-11-30T17:25:03.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.279+0000 7f5dd77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5dd80a8280 0x7f5dd814ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:03.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.279+0000 7f5dd77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5dd80a8280 0x7f5dd814ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60742/0 (socket says 172.21.15.49:60742) 2023-11-30T17:25:03.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.279+0000 7f5dd77fe700 1 -- 172.21.15.49:0/2115648617 learned_addr learned my addr 172.21.15.49:0/2115648617 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:03.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.279+0000 7f5dd7fff700 1 --2- 172.21.15.49:0/2115648617 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5dd8158160 0x7f5dd814dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:03.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.279+0000 7f5dd6ffd700 1 --2- 172.21.15.49:0/2115648617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5dd814e600 0x7f5dd814d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:03.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.279+0000 7f5dd77fe700 1 -- 172.21.15.49:0/2115648617 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5dd8158160 msgr2=0x7f5dd814dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:03.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.279+0000 7f5dd77fe700 1 --2- 172.21.15.49:0/2115648617 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5dd8158160 0x7f5dd814dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:03.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.279+0000 7f5dd77fe700 1 -- 172.21.15.49:0/2115648617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5dd814e600 msgr2=0x7f5dd814d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:03.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.279+0000 7f5dd77fe700 1 --2- 172.21.15.49:0/2115648617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5dd814e600 0x7f5dd814d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:03.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.279+0000 7f5dd77fe700 1 -- 172.21.15.49:0/2115648617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd0009ae0 con 0x7f5dd80a8280 2023-11-30T17:25:03.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.279+0000 7f5dd77fe700 1 --2- 172.21.15.49:0/2115648617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5dd80a8280 0x7f5dd814ac60 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7f5dc800d890 tx=0x7f5dc8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:03.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.280+0000 7f5dbf7fe700 1 -- 172.21.15.49:0/2115648617 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8011590 con 0x7f5dd80a8280 2023-11-30T17:25:03.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.280+0000 7f5dbf7fe700 1 -- 172.21.15.49:0/2115648617 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc80116f0 con 0x7f5dd80a8280 2023-11-30T17:25:03.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.280+0000 7f5dbf7fe700 1 -- 172.21.15.49:0/2115648617 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8011a70 con 0x7f5dd80a8280 2023-11-30T17:25:03.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.280+0000 7f5ddddc8700 1 -- 172.21.15.49:0/2115648617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd8164cb0 con 0x7f5dd80a8280 2023-11-30T17:25:03.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.280+0000 7f5ddddc8700 1 -- 172.21.15.49:0/2115648617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd8165270 con 0x7f5dd80a8280 2023-11-30T17:25:03.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.281+0000 7f5ddddc8700 1 -- 172.21.15.49:0/2115648617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd80c8e90 con 0x7f5dd80a8280 2023-11-30T17:25:03.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.281+0000 7f5dbf7fe700 1 -- 172.21.15.49:0/2115648617 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f5dc8012420 con 0x7f5dd80a8280 2023-11-30T17:25:03.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.281+0000 7f5dbf7fe700 1 --2- 172.21.15.49:0/2115648617 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5dc405f270 0x7f5dc4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:03.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.281+0000 7f5dbf7fe700 1 -- 172.21.15.49:0/2115648617 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5899+0+0 (secure 0 0 0) 0x7f5dc8079be0 con 0x7f5dd80a8280 2023-11-30T17:25:03.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.282+0000 7f5dd6ffd700 1 --2- 172.21.15.49:0/2115648617 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5dc405f270 0x7f5dc4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:03.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.282+0000 7f5dd6ffd700 1 --2- 172.21.15.49:0/2115648617 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5dc405f270 0x7f5dc4061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f5dcc003920 tx=0x7f5dcc000bc0).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:03.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.286+0000 7f5dbf7fe700 1 -- 172.21.15.49:0/2115648617 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5dc804adb0 con 0x7f5dd80a8280 2023-11-30T17:25:03.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:03.472+0000 7f5ddddc8700 1 -- 172.21.15.49:0/2115648617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5dd81658c0 con 0x7f5dd80a8280 2023-11-30T17:25:04.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.317+0000 7f5dbf7fe700 1 -- 172.21.15.49:0/2115648617 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v126) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5dc8011e60 con 0x7f5dd80a8280 2023-11-30T17:25:04.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.319+0000 7f5ddddc8700 1 -- 172.21.15.49:0/2115648617 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5dc405f270 msgr2=0x7f5dc4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:04.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.319+0000 7f5ddddc8700 1 --2- 172.21.15.49:0/2115648617 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5dc405f270 0x7f5dc4061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f5dcc003920 tx=0x7f5dcc000bc0).stop 2023-11-30T17:25:04.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.319+0000 7f5ddddc8700 1 -- 172.21.15.49:0/2115648617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5dd80a8280 msgr2=0x7f5dd814ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:04.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.319+0000 7f5ddddc8700 1 --2- 172.21.15.49:0/2115648617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5dd80a8280 0x7f5dd814ac60 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7f5dc800d890 tx=0x7f5dc8008040).stop 2023-11-30T17:25:04.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.320+0000 7f5ddddc8700 1 -- 172.21.15.49:0/2115648617 shutdown_connections 2023-11-30T17:25:04.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.320+0000 7f5ddddc8700 1 --2- 172.21.15.49:0/2115648617 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5dd8158160 0x7f5dd814dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:04.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.320+0000 7f5ddddc8700 1 --2- 172.21.15.49:0/2115648617 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5dc405f270 0x7f5dc4061730 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:04.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.320+0000 7f5ddddc8700 1 --2- 172.21.15.49:0/2115648617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5dd80a8280 0x7f5dd814ac60 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:04.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.320+0000 7f5ddddc8700 1 --2- 172.21.15.49:0/2115648617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5dd814e600 0x7f5dd814d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:04.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.320+0000 7f5ddddc8700 1 -- 172.21.15.49:0/2115648617 >> 172.21.15.49:0/2115648617 conn(0x7f5dd8062700 msgr2=0x7f5dd80c8610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:04.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.320+0000 7f5ddddc8700 1 -- 172.21.15.49:0/2115648617 shutdown_connections 2023-11-30T17:25:04.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.320+0000 7f5ddddc8700 1 -- 172.21.15.49:0/2115648617 wait complete. 2023-11-30T17:25:04.323 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2023-11-30T17:25:04.337 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-30T17:25:04.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.458+0000 7ff6fd2b3700 1 Processor -- start 2023-11-30T17:25:04.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.458+0000 7ff6fd2b3700 1 -- start start 2023-11-30T17:25:04.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.459+0000 7ff6fd2b3700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff6f8157660 0x7ff6f8157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:04.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.459+0000 7ff6fd2b3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6f80c0180 0x7ff6f81589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:04.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.459+0000 7ff6fd2b3700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f80c12c0 con 0x7ff6f80c1750 2023-11-30T17:25:04.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.459+0000 7ff6fd2b3700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f80c06b0 con 0x7ff6f8157660 2023-11-30T17:25:04.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.459+0000 7ff6fd2b3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f80c0990 con 0x7ff6f80c0180 2023-11-30T17:25:04.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.459+0000 7ff6fcab2700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff6f80c1750 0x7ff6f80648d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41690/0 (socket says 172.21.15.49:41690) 2023-11-30T17:25:04.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.459+0000 7ff6fcab2700 1 -- 172.21.15.49:0/210597715 learned_addr learned my addr 172.21.15.49:0/210597715 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:25:04.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.459+0000 7ff6f77fe700 1 --2- 172.21.15.49:0/210597715 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6f80c0180 0x7ff6f81589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:04.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.459+0000 7ff6f7fff700 1 --2- 172.21.15.49:0/210597715 >> v2:172.21.15.115:3300/0 conn(0x7ff6f8157660 0x7ff6f8157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:04.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.460+0000 7ff6f6ffd700 1 -- 172.21.15.49:0/210597715 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2593438553 0 0) 0x7ff6f80c12c0 con 0x7ff6f80c1750 2023-11-30T17:25:04.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.460+0000 7ff6f6ffd700 1 -- 172.21.15.49:0/210597715 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6e00033f0 con 0x7ff6f80c1750 2023-11-30T17:25:04.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.460+0000 7ff6f77fe700 1 -- 172.21.15.49:0/210597715 >> v2:172.21.15.115:3300/0 conn(0x7ff6f8157660 msgr2=0x7ff6f8157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:04.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.460+0000 7ff6f77fe700 1 --2- 172.21.15.49:0/210597715 >> v2:172.21.15.115:3300/0 conn(0x7ff6f8157660 0x7ff6f8157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:04.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.460+0000 7ff6f77fe700 1 -- 172.21.15.49:0/210597715 >> v1:172.21.15.49:6789/0 conn(0x7ff6f80c1750 legacy=0x7ff6f80648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:04.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.460+0000 7ff6f77fe700 1 -- 172.21.15.49:0/210597715 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f80c0c70 con 0x7ff6f80c0180 2023-11-30T17:25:04.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.460+0000 7ff6f7fff700 1 --2- 172.21.15.49:0/210597715 >> v2:172.21.15.115:3300/0 conn(0x7ff6f8157660 0x7ff6f8157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:25:04.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.460+0000 7ff6f77fe700 1 --2- 172.21.15.49:0/210597715 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6f80c0180 0x7ff6f81589c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7ff6ec009760 tx=0x7ff6ec009060).ready entity=mon.2 client_cookie=207e0924e31cf6ad server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:04.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.460+0000 7ff6f6ffd700 1 -- 172.21.15.49:0/210597715 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec00d4a0 con 0x7ff6f80c0180 2023-11-30T17:25:04.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.460+0000 7ff6f6ffd700 1 -- 172.21.15.49:0/210597715 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ec00d600 con 0x7ff6f80c0180 2023-11-30T17:25:04.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.460+0000 7ff6f6ffd700 1 -- 172.21.15.49:0/210597715 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec00d980 con 0x7ff6f80c0180 2023-11-30T17:25:04.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.461+0000 7ff6fd2b3700 1 -- 172.21.15.49:0/210597715 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6f80c0180 msgr2=0x7ff6f81589c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:04.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.461+0000 7ff6fd2b3700 1 --2- 172.21.15.49:0/210597715 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6f80c0180 0x7ff6f81589c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7ff6ec009760 tx=0x7ff6ec009060).stop 2023-11-30T17:25:04.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.461+0000 7ff6fd2b3700 1 -- 172.21.15.49:0/210597715 shutdown_connections 2023-11-30T17:25:04.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.461+0000 7ff6fd2b3700 1 --2- 172.21.15.49:0/210597715 >> v2:172.21.15.115:3300/0 conn(0x7ff6f8157660 0x7ff6f8157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:04.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.461+0000 7ff6fd2b3700 1 --2- 172.21.15.49:0/210597715 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6f80c0180 0x7ff6f81589c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:04.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.461+0000 7ff6fd2b3700 1 -- 172.21.15.49:0/210597715 >> 172.21.15.49:0/210597715 conn(0x7ff6f80cb000 msgr2=0x7ff6f80cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:04.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.461+0000 7ff6fd2b3700 1 -- 172.21.15.49:0/210597715 shutdown_connections 2023-11-30T17:25:04.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.461+0000 7ff6fd2b3700 1 -- 172.21.15.49:0/210597715 wait complete. 2023-11-30T17:25:04.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.462+0000 7ff6fd2b3700 1 Processor -- start 2023-11-30T17:25:04.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.462+0000 7ff6fd2b3700 1 -- start start 2023-11-30T17:25:04.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.463+0000 7ff6fd2b3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6f80c0180 0x7ff6f8145d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:04.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.463+0000 7ff6fd2b3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6f80c1750 0x7ff6f80ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:04.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.463+0000 7ff6fd2b3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6f8157660 0x7ff6f80ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:04.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.463+0000 7ff6fd2b3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f80caad0 con 0x7ff6f8157660 2023-11-30T17:25:04.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.463+0000 7ff6fd2b3700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f80c2d30 con 0x7ff6f80c1750 2023-11-30T17:25:04.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.463+0000 7ff6fd2b3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f80c2fd0 con 0x7ff6f80c0180 2023-11-30T17:25:04.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.463+0000 7ff6fcab2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6f8157660 0x7ff6f80ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:04.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.463+0000 7ff6f7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6f80c0180 0x7ff6f8145d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:04.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.463+0000 7ff6fcab2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6f8157660 0x7ff6f80ca5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60750/0 (socket says 172.21.15.49:60750) 2023-11-30T17:25:04.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.463+0000 7ff6fcab2700 1 -- 172.21.15.49:0/1016282891 learned_addr learned my addr 172.21.15.49:0/1016282891 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:04.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.463+0000 7ff6f77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6f80c1750 0x7ff6f80ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:04.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.463+0000 7ff6fcab2700 1 -- 172.21.15.49:0/1016282891 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6f80c0180 msgr2=0x7ff6f8145d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:04.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.463+0000 7ff6fcab2700 1 --2- 172.21.15.49:0/1016282891 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6f80c0180 0x7ff6f8145d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:04.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.463+0000 7ff6fcab2700 1 -- 172.21.15.49:0/1016282891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6f80c1750 msgr2=0x7ff6f80ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:04.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.463+0000 7ff6fcab2700 1 --2- 172.21.15.49:0/1016282891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6f80c1750 0x7ff6f80ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:04.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.463+0000 7ff6fcab2700 1 -- 172.21.15.49:0/1016282891 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e80092a0 con 0x7ff6f8157660 2023-11-30T17:25:04.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.463+0000 7ff6fcab2700 1 --2- 172.21.15.49:0/1016282891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6f8157660 0x7ff6f80ca5e0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7ff6f0002250 tx=0x7ff6f0007f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:04.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.463+0000 7ff6dffff700 1 -- 172.21.15.49:0/1016282891 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0005d30 con 0x7ff6f8157660 2023-11-30T17:25:04.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.463+0000 7ff6dffff700 1 -- 172.21.15.49:0/1016282891 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f0005e90 con 0x7ff6f8157660 2023-11-30T17:25:04.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.463+0000 7ff6fd2b3700 1 -- 172.21.15.49:0/1016282891 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6ec0092a0 con 0x7ff6f8157660 2023-11-30T17:25:04.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.463+0000 7ff6dffff700 1 -- 172.21.15.49:0/1016282891 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0007320 con 0x7ff6f8157660 2023-11-30T17:25:04.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.463+0000 7ff6fd2b3700 1 -- 172.21.15.49:0/1016282891 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f81563a0 con 0x7ff6f8157660 2023-11-30T17:25:04.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.465+0000 7ff6fd2b3700 1 -- 172.21.15.49:0/1016282891 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f806c7c0 con 0x7ff6f8157660 2023-11-30T17:25:04.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.465+0000 7ff6dffff700 1 -- 172.21.15.49:0/1016282891 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff6f0007690 con 0x7ff6f8157660 2023-11-30T17:25:04.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.465+0000 7ff6dffff700 1 --2- 172.21.15.49:0/1016282891 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff6e405f270 0x7ff6e4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:04.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.465+0000 7ff6dffff700 1 -- 172.21.15.49:0/1016282891 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5297+0+0 (secure 0 0 0) 0x7ff6f00798c0 con 0x7ff6f8157660 2023-11-30T17:25:04.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.465+0000 7ff6f7fff700 1 --2- 172.21.15.49:0/1016282891 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff6e405f270 0x7ff6e4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:04.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.466+0000 7ff6f7fff700 1 --2- 172.21.15.49:0/1016282891 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff6e405f270 0x7ff6e4061730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7ff6e8009dc0 tx=0x7ff6e8009060).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:04.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.469+0000 7ff6dffff700 1 -- 172.21.15.49:0/1016282891 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff6f004ad40 con 0x7ff6f8157660 2023-11-30T17:25:04.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.708+0000 7ff6fd2b3700 1 -- 172.21.15.49:0/1016282891 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff6f80c0f50 con 0x7ff6f8157660 2023-11-30T17:25:04.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.709+0000 7ff6dffff700 1 -- 172.21.15.49:0/1016282891 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ff6f00016e0 con 0x7ff6f8157660 2023-11-30T17:25:04.711 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:25:04.712 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T17:25:04.712 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2023-11-30T17:25:04.712 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:25:04.712 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2023-11-30T17:25:04.712 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlwm1FHxAAk+s9c60UZ5jB37wbpGzlcg==", 2023-11-30T17:25:04.712 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:25:04.712 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:25:04.712 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:25:04.712 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:25:04.712 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:25:04.712 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:25:04.712 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:25:04.712 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:25:04.712 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2023-11-30T17:25:04.713 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlADm0KhAArffesGGTXzQwY4NPnJ1Bjw==", 2023-11-30T17:25:04.713 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:25:04.713 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:25:04.713 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:25:04.713 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:25:04.713 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:25:04.713 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:25:04.713 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:25:04.713 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:25:04.713 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2023-11-30T17:25:04.713 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlYnY1JhAA+Lurauug0NhWnK8aZErR3g==", 2023-11-30T17:25:04.713 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:25:04.713 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:25:04.713 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:25:04.713 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:25:04.713 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:25:04.714 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:25:04.714 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:25:04.714 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:25:04.714 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2023-11-30T17:25:04.714 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlQdKCMRAA3h4O2NqkQ2zE3DxOqBoaQQ==", 2023-11-30T17:25:04.714 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:25:04.714 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:25:04.714 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:25:04.714 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:25:04.714 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:25:04.714 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:25:04.714 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:25:04.714 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:25:04.714 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2023-11-30T17:25:04.715 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAPwWhlGdbhFxAAOspNRLMhR59LSWatFbsYDA==", 2023-11-30T17:25:04.715 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:25:04.715 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:25:04.715 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:25:04.715 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:25:04.715 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:25:04.715 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:25:04.715 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:25:04.715 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2023-11-30T17:25:04.715 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQASwWhlfwUEFxAAuj0L8ooIGi1vsb7XWLVlDA==", 2023-11-30T17:25:04.715 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:25:04.715 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:25:04.715 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:25:04.715 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:25:04.715 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:25:04.716 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:25:04.716 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:25:04.716 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2023-11-30T17:25:04.716 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAVwWhl7XYwFBAAuSHZqdfRR8V1Y+hmPT5uuw==", 2023-11-30T17:25:04.716 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:25:04.716 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:25:04.716 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:25:04.716 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:25:04.716 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:25:04.716 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:25:04.716 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:25:04.716 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2023-11-30T17:25:04.716 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAYwWhlkhRCFRAAe3cRLcrhJ3ZoluXuRUhmew==", 2023-11-30T17:25:04.716 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:25:04.716 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:25:04.717 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:25:04.717 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:25:04.717 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:25:04.717 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:25:04.717 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:25:04.717 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2023-11-30T17:25:04.717 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAewWhlrq4qFBAAOSdqozO8iH25BQFrPI1SRQ==", 2023-11-30T17:25:04.717 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:25:04.717 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:25:04.717 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:25:04.717 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:25:04.717 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:25:04.717 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:25:04.717 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:25:04.717 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2023-11-30T17:25:04.718 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAhwWhlZL9WERAA90znWBLNuY5eem3yF6O0wg==", 2023-11-30T17:25:04.718 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:25:04.718 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:25:04.718 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:25:04.718 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:25:04.718 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:25:04.718 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:25:04.718 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:25:04.718 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2023-11-30T17:25:04.718 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAkwWhlCJDiEBAAETLCBNCdaWXFgkPPaulTAA==", 2023-11-30T17:25:04.718 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:25:04.718 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:25:04.718 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:25:04.718 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:25:04.718 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:25:04.719 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:25:04.719 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:25:04.719 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2023-11-30T17:25:04.719 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAnwWhl+IiYEBAAcI3AU5xrv0cYy9lckyu0dQ==", 2023-11-30T17:25:04.719 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:25:04.719 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:25:04.719 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:25:04.719 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:25:04.719 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:25:04.719 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:25:04.719 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:25:04.719 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2023-11-30T17:25:04.719 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhleYZcNRAA5PoPChH+s6XfbrQ0hmu2NA==", 2023-11-30T17:25:04.719 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:25:04.719 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:25:04.720 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2023-11-30T17:25:04.720 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-30T17:25:04.720 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:25:04.720 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:25:04.720 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:25:04.720 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2023-11-30T17:25:04.720 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAOwWhlFhcfAhAAzaBDtyRxuqeQ9BatfgUuXw==", 2023-11-30T17:25:04.720 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:25:04.720 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:25:04.720 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T17:25:04.720 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T17:25:04.720 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T17:25:04.720 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:25:04.720 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:25:04.720 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:25:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2023-11-30T17:25:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlLZrDOhAAHG/dYWYmPouk3+Iqafr7qw==", 2023-11-30T17:25:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:25:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:25:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T17:25:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T17:25:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T17:25:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:25:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:25:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:25:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2023-11-30T17:25:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAOwWhl6lxuBxAA/YXQDo+U2ppULGzK054Gzg==", 2023-11-30T17:25:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:25:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:25:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T17:25:04.722 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T17:25:04.722 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T17:25:04.722 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:25:04.722 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:25:04.722 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:25:04.722 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2023-11-30T17:25:04.722 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhl4JkLAxAAiaLgZ5eiazaT9VanG5ihyQ==", 2023-11-30T17:25:04.722 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:25:04.722 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T17:25:04.722 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:25:04.722 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:25:04.722 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:25:04.722 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:25:04.722 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:25:04.723 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:25:04.723 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2023-11-30T17:25:04.723 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlH1s2HBAA3ea9Utfv7fZoo2hO+ElDVQ==", 2023-11-30T17:25:04.723 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:25:04.723 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T17:25:04.723 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-11-30T17:25:04.723 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:25:04.723 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:25:04.723 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:25:04.723 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:25:04.723 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2023-11-30T17:25:04.723 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlpy+fFxAA3qmboR+PlQtK6T35ryj+Lw==", 2023-11-30T17:25:04.723 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:25:04.723 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T17:25:04.723 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-11-30T17:25:04.724 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:25:04.724 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:25:04.724 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:25:04.724 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-11-30T17:25:04.724 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T17:25:04.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.711+0000 7ff6fd2b3700 1 -- 172.21.15.49:0/1016282891 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff6e405f270 msgr2=0x7ff6e4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:04.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.711+0000 7ff6fd2b3700 1 --2- 172.21.15.49:0/1016282891 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff6e405f270 0x7ff6e4061730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7ff6e8009dc0 tx=0x7ff6e8009060).stop 2023-11-30T17:25:04.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.711+0000 7ff6fd2b3700 1 -- 172.21.15.49:0/1016282891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6f8157660 msgr2=0x7ff6f80ca5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:04.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.711+0000 7ff6fd2b3700 1 --2- 172.21.15.49:0/1016282891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6f8157660 0x7ff6f80ca5e0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7ff6f0002250 tx=0x7ff6f0007f50).stop 2023-11-30T17:25:04.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.711+0000 7ff6fd2b3700 1 -- 172.21.15.49:0/1016282891 shutdown_connections 2023-11-30T17:25:04.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.711+0000 7ff6fd2b3700 1 --2- 172.21.15.49:0/1016282891 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff6e405f270 0x7ff6e4061730 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:04.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.711+0000 7ff6fd2b3700 1 --2- 172.21.15.49:0/1016282891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6f8157660 0x7ff6f80ca5e0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:04.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.711+0000 7ff6fd2b3700 1 --2- 172.21.15.49:0/1016282891 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff6f80c0180 0x7ff6f8145d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:04.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.711+0000 7ff6fd2b3700 1 --2- 172.21.15.49:0/1016282891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6f80c1750 0x7ff6f80ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:04.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.711+0000 7ff6fd2b3700 1 -- 172.21.15.49:0/1016282891 >> 172.21.15.49:0/1016282891 conn(0x7ff6f80cb000 msgr2=0x7ff6f80648d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:04.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.711+0000 7ff6fd2b3700 1 -- 172.21.15.49:0/1016282891 shutdown_connections 2023-11-30T17:25:04.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.711+0000 7ff6fd2b3700 1 -- 172.21.15.49:0/1016282891 wait complete. 2023-11-30T17:25:04.727 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:25:04.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.841+0000 7f8423e15700 1 Processor -- start 2023-11-30T17:25:04.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.841+0000 7f8423e15700 1 -- start start 2023-11-30T17:25:04.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.842+0000 7f8423e15700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f841c1524a0 0x7f841c067a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:04.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.842+0000 7f8423e15700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f841c0683e0 con 0x7f841c067f30 2023-11-30T17:25:04.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.842+0000 7f8423e15700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f841c0be110 con 0x7f841c1520c0 2023-11-30T17:25:04.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.842+0000 7f8423e15700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f841c066fc0 con 0x7f841c1524a0 2023-11-30T17:25:04.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.842+0000 7f84213b0700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f841c1524a0 0x7f841c067a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:04.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.842+0000 7f84223b2700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f841c067f30 0x7f841c0be8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41700/0 (socket says 172.21.15.49:41700) 2023-11-30T17:25:04.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.842+0000 7f84223b2700 1 -- 172.21.15.49:0/1953588123 learned_addr learned my addr 172.21.15.49:0/1953588123 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:25:04.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.843+0000 7f84213b0700 1 -- 172.21.15.49:0/1953588123 >> v1:172.21.15.115:6789/0 conn(0x7f841c1520c0 legacy=0x7f841c066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:04.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.843+0000 7f84213b0700 1 -- 172.21.15.49:0/1953588123 >> v1:172.21.15.49:6789/0 conn(0x7f841c067f30 legacy=0x7f841c0be8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:04.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.843+0000 7f84213b0700 1 -- 172.21.15.49:0/1953588123 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f841c0672a0 con 0x7f841c1524a0 2023-11-30T17:25:04.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.843+0000 7f8420baf700 1 -- 172.21.15.49:0/1953588123 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2616055296 0 0) 0x7f840c001490 con 0x7f841c067f30 2023-11-30T17:25:04.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.843+0000 7f84213b0700 1 --2- 172.21.15.49:0/1953588123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f841c1524a0 0x7f841c067a40 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7f8410009760 tx=0x7f8410009060).ready entity=mon.0 client_cookie=a3e6abbe6a92943b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:04.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.843+0000 7f8420baf700 1 -- 172.21.15.49:0/1953588123 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841000b520 con 0x7f841c1524a0 2023-11-30T17:25:04.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.843+0000 7f8420baf700 1 -- 172.21.15.49:0/1953588123 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841000b680 con 0x7f841c1524a0 2023-11-30T17:25:04.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.843+0000 7f8420baf700 1 -- 172.21.15.49:0/1953588123 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841000ba00 con 0x7f841c1524a0 2023-11-30T17:25:04.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.843+0000 7f8423e15700 1 -- 172.21.15.49:0/1953588123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f841c1524a0 msgr2=0x7f841c067a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:04.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.843+0000 7f8423e15700 1 --2- 172.21.15.49:0/1953588123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f841c1524a0 0x7f841c067a40 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7f8410009760 tx=0x7f8410009060).stop 2023-11-30T17:25:04.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.844+0000 7f8423e15700 1 -- 172.21.15.49:0/1953588123 shutdown_connections 2023-11-30T17:25:04.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.844+0000 7f8423e15700 1 --2- 172.21.15.49:0/1953588123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f841c1524a0 0x7f841c067a40 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:04.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.844+0000 7f8423e15700 1 -- 172.21.15.49:0/1953588123 >> 172.21.15.49:0/1953588123 conn(0x7f841c0631d0 msgr2=0x7f841c0c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:04.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.844+0000 7f8423e15700 1 -- 172.21.15.49:0/1953588123 shutdown_connections 2023-11-30T17:25:04.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.844+0000 7f8423e15700 1 -- 172.21.15.49:0/1953588123 wait complete. 2023-11-30T17:25:04.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.845+0000 7f8423e15700 1 Processor -- start 2023-11-30T17:25:04.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.845+0000 7f8423e15700 1 -- start start 2023-11-30T17:25:04.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.845+0000 7f8423e15700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f841c067f30 0x7f841c1411b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:04.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.845+0000 7f8423e15700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f841c1520c0 0x7f841c095e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:04.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.845+0000 7f8423e15700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f841c1524a0 0x7f841c096370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:04.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.845+0000 7f8423e15700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841c096860 con 0x7f841c067f30 2023-11-30T17:25:04.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.845+0000 7f8423e15700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841c063810 con 0x7f841c1524a0 2023-11-30T17:25:04.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.845+0000 7f8423e15700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841c063a60 con 0x7f841c1520c0 2023-11-30T17:25:04.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.846+0000 7f8421bb1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f841c067f30 0x7f841c1411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:04.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.846+0000 7f8421bb1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f841c067f30 0x7f841c1411b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60772/0 (socket says 172.21.15.49:60772) 2023-11-30T17:25:04.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.846+0000 7f8421bb1700 1 -- 172.21.15.49:0/2588674765 learned_addr learned my addr 172.21.15.49:0/2588674765 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:04.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.846+0000 7f84213b0700 1 --2- 172.21.15.49:0/2588674765 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f841c1520c0 0x7f841c095e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:04.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.846+0000 7f84223b2700 1 --2- 172.21.15.49:0/2588674765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f841c1524a0 0x7f841c096370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:04.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.846+0000 7f8421bb1700 1 -- 172.21.15.49:0/2588674765 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f841c1520c0 msgr2=0x7f841c095e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:04.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.846+0000 7f8421bb1700 1 --2- 172.21.15.49:0/2588674765 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f841c1520c0 0x7f841c095e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:04.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.846+0000 7f8421bb1700 1 -- 172.21.15.49:0/2588674765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f841c1524a0 msgr2=0x7f841c096370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:04.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.846+0000 7f8421bb1700 1 --2- 172.21.15.49:0/2588674765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f841c1524a0 0x7f841c096370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:04.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.846+0000 7f8421bb1700 1 -- 172.21.15.49:0/2588674765 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84100092a0 con 0x7f841c067f30 2023-11-30T17:25:04.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.846+0000 7f84213b0700 1 --2- 172.21.15.49:0/2588674765 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f841c1520c0 0x7f841c095e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:25:04.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.846+0000 7f84223b2700 1 --2- 172.21.15.49:0/2588674765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f841c1524a0 0x7f841c096370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:25:04.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.846+0000 7f8421bb1700 1 --2- 172.21.15.49:0/2588674765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f841c067f30 0x7f841c1411b0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7f8414002f30 tx=0x7f8414007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:04.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.846+0000 7f8419ffb700 1 -- 172.21.15.49:0/2588674765 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841400f470 con 0x7f841c067f30 2023-11-30T17:25:04.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.846+0000 7f8419ffb700 1 -- 172.21.15.49:0/2588674765 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841400f5d0 con 0x7f841c067f30 2023-11-30T17:25:04.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.846+0000 7f8423e15700 1 -- 172.21.15.49:0/2588674765 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f841c063d40 con 0x7f841c067f30 2023-11-30T17:25:04.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.846+0000 7f8419ffb700 1 -- 172.21.15.49:0/2588674765 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841400f990 con 0x7f841c067f30 2023-11-30T17:25:04.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.846+0000 7f8423e15700 1 -- 172.21.15.49:0/2588674765 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f841c064300 con 0x7f841c067f30 2023-11-30T17:25:04.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.847+0000 7f8423e15700 1 -- 172.21.15.49:0/2588674765 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f841c06c860 con 0x7f841c067f30 2023-11-30T17:25:04.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.848+0000 7f8419ffb700 1 -- 172.21.15.49:0/2588674765 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8414012400 con 0x7f841c067f30 2023-11-30T17:25:04.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.848+0000 7f8419ffb700 1 --2- 172.21.15.49:0/2588674765 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f840805f270 0x7f8408061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:04.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.848+0000 7f8419ffb700 1 -- 172.21.15.49:0/2588674765 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5297+0+0 (secure 0 0 0) 0x7f8414079300 con 0x7f841c067f30 2023-11-30T17:25:04.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.848+0000 7f84213b0700 1 --2- 172.21.15.49:0/2588674765 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f840805f270 0x7f8408061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:04.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.849+0000 7f84213b0700 1 --2- 172.21.15.49:0/2588674765 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f840805f270 0x7f8408061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f8410009760 tx=0x7f8410017000).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:04.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:04.852+0000 7f8419ffb700 1 -- 172.21.15.49:0/2588674765 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8414047b00 con 0x7f841c067f30 2023-11-30T17:25:05.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.025+0000 7f8423e15700 1 -- 172.21.15.49:0/2588674765 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f841c0be380 con 0x7f841c067f30 2023-11-30T17:25:05.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.026+0000 7f8419ffb700 1 -- 172.21.15.49:0/2588674765 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+13766 (secure 0 0 0) 0x7f841404a7d0 con 0x7f841c067f30 2023-11-30T17:25:05.028 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:25:05.029 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":126,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:25:04.311116+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:25:05.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.028+0000 7f8423e15700 1 -- 172.21.15.49:0/2588674765 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f840805f270 msgr2=0x7f8408061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:05.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.028+0000 7f8423e15700 1 --2- 172.21.15.49:0/2588674765 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f840805f270 0x7f8408061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f8410009760 tx=0x7f8410017000).stop 2023-11-30T17:25:05.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.028+0000 7f8423e15700 1 -- 172.21.15.49:0/2588674765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f841c067f30 msgr2=0x7f841c1411b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:05.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.028+0000 7f8423e15700 1 --2- 172.21.15.49:0/2588674765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f841c067f30 0x7f841c1411b0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7f8414002f30 tx=0x7f8414007e30).stop 2023-11-30T17:25:05.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.028+0000 7f8423e15700 1 -- 172.21.15.49:0/2588674765 shutdown_connections 2023-11-30T17:25:05.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.028+0000 7f8423e15700 1 --2- 172.21.15.49:0/2588674765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f841c1524a0 0x7f841c096370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.028+0000 7f8423e15700 1 --2- 172.21.15.49:0/2588674765 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f840805f270 0x7f8408061730 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.028+0000 7f8423e15700 1 --2- 172.21.15.49:0/2588674765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f841c067f30 0x7f841c1411b0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.028+0000 7f8423e15700 1 --2- 172.21.15.49:0/2588674765 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f841c1520c0 0x7f841c095e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.028+0000 7f8423e15700 1 -- 172.21.15.49:0/2588674765 >> 172.21.15.49:0/2588674765 conn(0x7f841c0631d0 msgr2=0x7f841c0be8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:05.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.028+0000 7f8423e15700 1 -- 172.21.15.49:0/2588674765 shutdown_connections 2023-11-30T17:25:05.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.028+0000 7f8423e15700 1 -- 172.21.15.49:0/2588674765 wait complete. 2023-11-30T17:25:05.043 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '119', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-11-30T17:25:05.043 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T17:25:05.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.161+0000 7f78fdab7700 1 Processor -- start 2023-11-30T17:25:05.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.161+0000 7f78fdab7700 1 -- start start 2023-11-30T17:25:05.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.162+0000 7f78fdab7700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f78f80c3090 0x7f78f8155c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:05.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.162+0000 7f78fdab7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78f8155030 0x7f78f80c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:05.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.162+0000 7f78fdab7700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78f81529c0 con 0x7f78f8155830 2023-11-30T17:25:05.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.162+0000 7f78fdab7700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f81554c0 con 0x7f78f80c3090 2023-11-30T17:25:05.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.162+0000 7f78fdab7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f8151db0 con 0x7f78f8155030 2023-11-30T17:25:05.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.162+0000 7f78f6ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f78f80c3090 0x7f78f8155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:05.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.162+0000 7f78f6ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f78f80c3090 0x7f78f8155c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60788/0 (socket says 172.21.15.49:60788) 2023-11-30T17:25:05.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.163+0000 7f78f6ffd700 1 -- 172.21.15.49:0/860267056 learned_addr learned my addr 172.21.15.49:0/860267056 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:05.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.163+0000 7f78f7fff700 1 --2- 172.21.15.49:0/860267056 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78f8155030 0x7f78f80c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:05.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.163+0000 7f78f6ffd700 1 -- 172.21.15.49:0/860267056 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78f8155030 msgr2=0x7f78f80c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:05.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.163+0000 7f78f6ffd700 1 --2- 172.21.15.49:0/860267056 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78f8155030 0x7f78f80c5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.163+0000 7f78f6ffd700 1 -- 172.21.15.49:0/860267056 >> v1:172.21.15.115:6789/0 conn(0x7f78f8155830 legacy=0x7f78f80c2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:05.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.163+0000 7f78f6ffd700 1 -- 172.21.15.49:0/860267056 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f8152090 con 0x7f78f80c3090 2023-11-30T17:25:05.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.163+0000 7f78f7fff700 1 --2- 172.21.15.49:0/860267056 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78f8155030 0x7f78f80c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:25:05.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.163+0000 7f78f6ffd700 1 --2- 172.21.15.49:0/860267056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78f80c3090 0x7f78f8155c10 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f78ec006fd0 tx=0x7f78ec0090f0).ready entity=mon.0 client_cookie=c2479018476f46b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:05.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.163+0000 7f78f67fc700 1 -- 172.21.15.49:0/860267056 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec00b600 con 0x7f78f80c3090 2023-11-30T17:25:05.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.163+0000 7f78f67fc700 1 -- 172.21.15.49:0/860267056 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec00b760 con 0x7f78f80c3090 2023-11-30T17:25:05.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.163+0000 7f78f67fc700 1 -- 172.21.15.49:0/860267056 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec00bb00 con 0x7f78f80c3090 2023-11-30T17:25:05.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.164+0000 7f78fdab7700 1 -- 172.21.15.49:0/860267056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78f80c3090 msgr2=0x7f78f8155c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:05.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.164+0000 7f78fdab7700 1 --2- 172.21.15.49:0/860267056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78f80c3090 0x7f78f8155c10 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f78ec006fd0 tx=0x7f78ec0090f0).stop 2023-11-30T17:25:05.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.164+0000 7f78fdab7700 1 -- 172.21.15.49:0/860267056 shutdown_connections 2023-11-30T17:25:05.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.164+0000 7f78fdab7700 1 --2- 172.21.15.49:0/860267056 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78f8155030 0x7f78f80c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.164+0000 7f78fdab7700 1 --2- 172.21.15.49:0/860267056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78f80c3090 0x7f78f8155c10 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.164+0000 7f78fdab7700 1 -- 172.21.15.49:0/860267056 >> 172.21.15.49:0/860267056 conn(0x7f78f8062700 msgr2=0x7f78f8062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:05.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.164+0000 7f78fdab7700 1 -- 172.21.15.49:0/860267056 shutdown_connections 2023-11-30T17:25:05.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.164+0000 7f78fdab7700 1 -- 172.21.15.49:0/860267056 wait complete. 2023-11-30T17:25:05.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.165+0000 7f78fdab7700 1 Processor -- start 2023-11-30T17:25:05.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.165+0000 7f78fdab7700 1 -- start start 2023-11-30T17:25:05.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.166+0000 7f78fdab7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78f80c3090 0x7f78f814ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:05.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.166+0000 7f78fdab7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78f8155030 0x7f78f80a4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:05.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.166+0000 7f78fdab7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78f8155830 0x7f78f80c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:05.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.166+0000 7f78fdab7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f80a5cb0 con 0x7f78f8155030 2023-11-30T17:25:05.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.166+0000 7f78fdab7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f80a5030 con 0x7f78f80c3090 2023-11-30T17:25:05.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.166+0000 7f78fdab7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f80a5310 con 0x7f78f8155830 2023-11-30T17:25:05.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.166+0000 7f78f6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78f8155030 0x7f78f80a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:05.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.166+0000 7f78f6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78f8155030 0x7f78f80a4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60802/0 (socket says 172.21.15.49:60802) 2023-11-30T17:25:05.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.166+0000 7f78f6ffd700 1 -- 172.21.15.49:0/2720963518 learned_addr learned my addr 172.21.15.49:0/2720963518 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:05.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.166+0000 7f78f77fe700 1 --2- 172.21.15.49:0/2720963518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78f80c3090 0x7f78f814ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:05.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.166+0000 7f78f7fff700 1 --2- 172.21.15.49:0/2720963518 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78f8155830 0x7f78f80c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:05.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.166+0000 7f78f6ffd700 1 -- 172.21.15.49:0/2720963518 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78f8155830 msgr2=0x7f78f80c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:05.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.166+0000 7f78f6ffd700 1 --2- 172.21.15.49:0/2720963518 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78f8155830 0x7f78f80c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.166+0000 7f78f6ffd700 1 -- 172.21.15.49:0/2720963518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78f80c3090 msgr2=0x7f78f814ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:05.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.166+0000 7f78f6ffd700 1 --2- 172.21.15.49:0/2720963518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78f80c3090 0x7f78f814ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.166+0000 7f78f6ffd700 1 -- 172.21.15.49:0/2720963518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec009370 con 0x7f78f8155030 2023-11-30T17:25:05.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.166+0000 7f78f6ffd700 1 --2- 172.21.15.49:0/2720963518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78f8155030 0x7f78f80a4650 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7f78ec009f50 tx=0x7f78ec017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:05.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.166+0000 7f78df7fe700 1 -- 172.21.15.49:0/2720963518 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec00bec0 con 0x7f78f8155030 2023-11-30T17:25:05.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.166+0000 7f78df7fe700 1 -- 172.21.15.49:0/2720963518 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec00b8d0 con 0x7f78f8155030 2023-11-30T17:25:05.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.166+0000 7f78fdab7700 1 -- 172.21.15.49:0/2720963518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78f80a55f0 con 0x7f78f8155030 2023-11-30T17:25:05.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.166+0000 7f78df7fe700 1 -- 172.21.15.49:0/2720963518 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec024470 con 0x7f78f8155030 2023-11-30T17:25:05.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.167+0000 7f78fdab7700 1 -- 172.21.15.49:0/2720963518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f814b370 con 0x7f78f8155030 2023-11-30T17:25:05.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.168+0000 7f78fdab7700 1 -- 172.21.15.49:0/2720963518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78f806c860 con 0x7f78f8155030 2023-11-30T17:25:05.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.168+0000 7f78df7fe700 1 -- 172.21.15.49:0/2720963518 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f78ec021070 con 0x7f78f8155030 2023-11-30T17:25:05.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.168+0000 7f78df7fe700 1 --2- 172.21.15.49:0/2720963518 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f78e405f270 0x7f78e4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:05.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.168+0000 7f78df7fe700 1 -- 172.21.15.49:0/2720963518 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5297+0+0 (secure 0 0 0) 0x7f78ec07bb40 con 0x7f78f8155030 2023-11-30T17:25:05.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.169+0000 7f78f77fe700 1 --2- 172.21.15.49:0/2720963518 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f78e405f270 0x7f78e4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:05.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.169+0000 7f78f77fe700 1 --2- 172.21.15.49:0/2720963518 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f78e405f270 0x7f78e4061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f78e800b9b0 tx=0x7f78e8008040).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:05.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.173+0000 7f78df7fe700 1 -- 172.21.15.49:0/2720963518 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f78ec04d070 con 0x7f78f8155030 2023-11-30T17:25:05.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.345+0000 7f78fdab7700 1 -- 172.21.15.49:0/2720963518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f78f8152370 con 0x7f78f8155030 2023-11-30T17:25:05.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.345+0000 7f78df7fe700 1 -- 172.21.15.49:0/2720963518 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v126) v1 ==== 110+0+10 (secure 0 0 0) 0x7f78ec029020 con 0x7f78f8155030 2023-11-30T17:25:05.348 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T17:25:05.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.347+0000 7f78fdab7700 1 -- 172.21.15.49:0/2720963518 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f78e405f270 msgr2=0x7f78e4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:05.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.347+0000 7f78fdab7700 1 --2- 172.21.15.49:0/2720963518 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f78e405f270 0x7f78e4061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f78e800b9b0 tx=0x7f78e8008040).stop 2023-11-30T17:25:05.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.347+0000 7f78fdab7700 1 -- 172.21.15.49:0/2720963518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78f8155030 msgr2=0x7f78f80a4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:05.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.347+0000 7f78fdab7700 1 --2- 172.21.15.49:0/2720963518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78f8155030 0x7f78f80a4650 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7f78ec009f50 tx=0x7f78ec017000).stop 2023-11-30T17:25:05.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.347+0000 7f78fdab7700 1 -- 172.21.15.49:0/2720963518 shutdown_connections 2023-11-30T17:25:05.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.347+0000 7f78fdab7700 1 --2- 172.21.15.49:0/2720963518 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f78f8155830 0x7f78f80c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.347+0000 7f78fdab7700 1 --2- 172.21.15.49:0/2720963518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78f80c3090 0x7f78f814ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.347+0000 7f78fdab7700 1 --2- 172.21.15.49:0/2720963518 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f78e405f270 0x7f78e4061730 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.347+0000 7f78fdab7700 1 --2- 172.21.15.49:0/2720963518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78f8155030 0x7f78f80a4650 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.347+0000 7f78fdab7700 1 -- 172.21.15.49:0/2720963518 >> 172.21.15.49:0/2720963518 conn(0x7f78f8062700 msgr2=0x7f78f814ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:05.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.348+0000 7f78fdab7700 1 -- 172.21.15.49:0/2720963518 shutdown_connections 2023-11-30T17:25:05.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.348+0000 7f78fdab7700 1 -- 172.21.15.49:0/2720963518 wait complete. 2023-11-30T17:25:05.362 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T17:25:05.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.481+0000 7fcfb3671700 1 Processor -- start 2023-11-30T17:25:05.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.481+0000 7fcfb3671700 1 -- start start 2023-11-30T17:25:05.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.482+0000 7fcfb3671700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcfac1547f0 0x7fcfac0a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:05.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.482+0000 7fcfb3671700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfac062700 0x7fcfac062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:05.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.482+0000 7fcfb3671700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfac0630a0 con 0x7fcfac0c86f0 2023-11-30T17:25:05.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.482+0000 7fcfb3671700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfac0c7e30 con 0x7fcfac1547f0 2023-11-30T17:25:05.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.482+0000 7fcfb3671700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac0bcf40 con 0x7fcfac062700 2023-11-30T17:25:05.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.482+0000 7fcfb140d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcfac1547f0 0x7fcfac0a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:05.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.482+0000 7fcfb0c0c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcfac0c86f0 0x7fcfac0c6fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41706/0 (socket says 172.21.15.49:41706) 2023-11-30T17:25:05.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.482+0000 7fcfb0c0c700 1 -- 172.21.15.49:0/2077615640 learned_addr learned my addr 172.21.15.49:0/2077615640 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:25:05.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.483+0000 7fcfb1c0e700 1 --2- 172.21.15.49:0/2077615640 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfac062700 0x7fcfac062bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:05.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.483+0000 7fcfb140d700 1 -- 172.21.15.49:0/2077615640 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfac062700 msgr2=0x7fcfac062bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:05.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.483+0000 7fcfb140d700 1 --2- 172.21.15.49:0/2077615640 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfac062700 0x7fcfac062bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.483+0000 7fcfb140d700 1 -- 172.21.15.49:0/2077615640 >> v1:172.21.15.49:6789/0 conn(0x7fcfac0c86f0 legacy=0x7fcfac0c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:05.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.483+0000 7fcfa3fff700 1 -- 172.21.15.49:0/2077615640 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844165517 0 0) 0x7fcf9c001110 con 0x7fcfac0c86f0 2023-11-30T17:25:05.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.483+0000 7fcfb140d700 1 -- 172.21.15.49:0/2077615640 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfac0c6b20 con 0x7fcfac1547f0 2023-11-30T17:25:05.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.483+0000 7fcfb140d700 1 --2- 172.21.15.49:0/2077615640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfac1547f0 0x7fcfac0a72e0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7fcfa8009760 tx=0x7fcfa8009060).ready entity=mon.0 client_cookie=99fec209e0f19e65 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:05.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.483+0000 7fcfa3fff700 1 -- 172.21.15.49:0/2077615640 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa80090d0 con 0x7fcfac1547f0 2023-11-30T17:25:05.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.483+0000 7fcfa3fff700 1 -- 172.21.15.49:0/2077615640 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa800b580 con 0x7fcfac1547f0 2023-11-30T17:25:05.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.483+0000 7fcfa3fff700 1 -- 172.21.15.49:0/2077615640 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa800b900 con 0x7fcfac1547f0 2023-11-30T17:25:05.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.483+0000 7fcfb3671700 1 -- 172.21.15.49:0/2077615640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfac1547f0 msgr2=0x7fcfac0a72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:05.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.483+0000 7fcfb3671700 1 --2- 172.21.15.49:0/2077615640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfac1547f0 0x7fcfac0a72e0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7fcfa8009760 tx=0x7fcfa8009060).stop 2023-11-30T17:25:05.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.483+0000 7fcfb3671700 1 -- 172.21.15.49:0/2077615640 shutdown_connections 2023-11-30T17:25:05.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.483+0000 7fcfb3671700 1 --2- 172.21.15.49:0/2077615640 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfac062700 0x7fcfac062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.483+0000 7fcfb3671700 1 --2- 172.21.15.49:0/2077615640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfac1547f0 0x7fcfac0a72e0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.483+0000 7fcfb3671700 1 -- 172.21.15.49:0/2077615640 >> 172.21.15.49:0/2077615640 conn(0x7fcfac0642d0 msgr2=0x7fcfac0c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:05.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.484+0000 7fcfb3671700 1 -- 172.21.15.49:0/2077615640 shutdown_connections 2023-11-30T17:25:05.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.484+0000 7fcfb3671700 1 -- 172.21.15.49:0/2077615640 wait complete. 2023-11-30T17:25:05.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.485+0000 7fcfb3671700 1 Processor -- start 2023-11-30T17:25:05.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.485+0000 7fcfb3671700 1 -- start start 2023-11-30T17:25:05.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.486+0000 7fcfb3671700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfac062700 0x7fcfac13d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:05.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.486+0000 7fcfb3671700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfac0c86f0 0x7fcfac0a7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:05.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.486+0000 7fcfb3671700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfac1547f0 0x7fcfac14a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:05.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.486+0000 7fcfb3671700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac13da30 con 0x7fcfac1547f0 2023-11-30T17:25:05.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.486+0000 7fcfb3671700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac14b3f0 con 0x7fcfac062700 2023-11-30T17:25:05.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.486+0000 7fcfb3671700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac14b6d0 con 0x7fcfac0c86f0 2023-11-30T17:25:05.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.486+0000 7fcfb1c0e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfac1547f0 0x7fcfac14a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:05.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.486+0000 7fcfb1c0e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfac1547f0 0x7fcfac14a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60822/0 (socket says 172.21.15.49:60822) 2023-11-30T17:25:05.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.486+0000 7fcfb1c0e700 1 -- 172.21.15.49:0/1702576999 learned_addr learned my addr 172.21.15.49:0/1702576999 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:05.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.486+0000 7fcfb140d700 1 --2- 172.21.15.49:0/1702576999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfac062700 0x7fcfac13d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:05.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.486+0000 7fcfb0c0c700 1 --2- 172.21.15.49:0/1702576999 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfac0c86f0 0x7fcfac0a7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:05.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.486+0000 7fcfb1c0e700 1 -- 172.21.15.49:0/1702576999 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfac0c86f0 msgr2=0x7fcfac0a7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:05.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.486+0000 7fcfb1c0e700 1 --2- 172.21.15.49:0/1702576999 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfac0c86f0 0x7fcfac0a7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.486+0000 7fcfb1c0e700 1 -- 172.21.15.49:0/1702576999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfac062700 msgr2=0x7fcfac13d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:05.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.486+0000 7fcfb1c0e700 1 --2- 172.21.15.49:0/1702576999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfac062700 0x7fcfac13d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.486+0000 7fcfb1c0e700 1 -- 172.21.15.49:0/1702576999 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa80092a0 con 0x7fcfac1547f0 2023-11-30T17:25:05.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.486+0000 7fcfb1c0e700 1 --2- 172.21.15.49:0/1702576999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfac1547f0 0x7fcfac14a940 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7fcfa4007f20 tx=0x7fcfa4009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:05.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.486+0000 7fcfa17fa700 1 -- 172.21.15.49:0/1702576999 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa400eb90 con 0x7fcfac1547f0 2023-11-30T17:25:05.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.486+0000 7fcfa17fa700 1 -- 172.21.15.49:0/1702576999 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa400ecf0 con 0x7fcfac1547f0 2023-11-30T17:25:05.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.486+0000 7fcfb3671700 1 -- 172.21.15.49:0/1702576999 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfac14b9b0 con 0x7fcfac1547f0 2023-11-30T17:25:05.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.486+0000 7fcfa17fa700 1 -- 172.21.15.49:0/1702576999 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4014610 con 0x7fcfac1547f0 2023-11-30T17:25:05.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.486+0000 7fcfb3671700 1 -- 172.21.15.49:0/1702576999 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfac14bf70 con 0x7fcfac1547f0 2023-11-30T17:25:05.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.487+0000 7fcfb3671700 1 -- 172.21.15.49:0/1702576999 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfac14c190 con 0x7fcfac1547f0 2023-11-30T17:25:05.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.488+0000 7fcfa17fa700 1 -- 172.21.15.49:0/1702576999 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fcfa4014980 con 0x7fcfac1547f0 2023-11-30T17:25:05.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.488+0000 7fcfa17fa700 1 --2- 172.21.15.49:0/1702576999 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcf9005f270 0x7fcf90061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:05.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.488+0000 7fcfa17fa700 1 -- 172.21.15.49:0/1702576999 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5297+0+0 (secure 0 0 0) 0x7fcfa407a490 con 0x7fcfac1547f0 2023-11-30T17:25:05.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.489+0000 7fcfb140d700 1 --2- 172.21.15.49:0/1702576999 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcf9005f270 0x7fcf90061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:05.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.489+0000 7fcfb140d700 1 --2- 172.21.15.49:0/1702576999 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcf9005f270 0x7fcf90061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fcfa800b340 tx=0x7fcfa8017000).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:05.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.493+0000 7fcfa17fa700 1 -- 172.21.15.49:0/1702576999 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcfa404b910 con 0x7fcfac1547f0 2023-11-30T17:25:05.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.665+0000 7fcfb3671700 1 -- 172.21.15.49:0/1702576999 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcfac06c860 con 0x7fcfac1547f0 2023-11-30T17:25:05.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.665+0000 7fcfa17fa700 1 -- 172.21.15.49:0/1702576999 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v126) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcfa400ee60 con 0x7fcfac1547f0 2023-11-30T17:25:05.668 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T17:25:05.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.667+0000 7fcfb3671700 1 -- 172.21.15.49:0/1702576999 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcf9005f270 msgr2=0x7fcf90061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:05.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.667+0000 7fcfb3671700 1 --2- 172.21.15.49:0/1702576999 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcf9005f270 0x7fcf90061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fcfa800b340 tx=0x7fcfa8017000).stop 2023-11-30T17:25:05.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.667+0000 7fcfb3671700 1 -- 172.21.15.49:0/1702576999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfac1547f0 msgr2=0x7fcfac14a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:05.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.667+0000 7fcfb3671700 1 --2- 172.21.15.49:0/1702576999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfac1547f0 0x7fcfac14a940 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7fcfa4007f20 tx=0x7fcfa4009860).stop 2023-11-30T17:25:05.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.667+0000 7fcfb3671700 1 -- 172.21.15.49:0/1702576999 shutdown_connections 2023-11-30T17:25:05.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.667+0000 7fcfb3671700 1 --2- 172.21.15.49:0/1702576999 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcf9005f270 0x7fcf90061730 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.667+0000 7fcfb3671700 1 --2- 172.21.15.49:0/1702576999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfac1547f0 0x7fcfac14a940 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.667+0000 7fcfb3671700 1 --2- 172.21.15.49:0/1702576999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfac062700 0x7fcfac13d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.667+0000 7fcfb3671700 1 --2- 172.21.15.49:0/1702576999 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfac0c86f0 0x7fcfac0a7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.667+0000 7fcfb3671700 1 -- 172.21.15.49:0/1702576999 >> 172.21.15.49:0/1702576999 conn(0x7fcfac0642d0 msgr2=0x7fcfac0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:05.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.667+0000 7fcfb3671700 1 -- 172.21.15.49:0/1702576999 shutdown_connections 2023-11-30T17:25:05.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.667+0000 7fcfb3671700 1 -- 172.21.15.49:0/1702576999 wait complete. 2023-11-30T17:25:05.682 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-30T17:25:05.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.796+0000 7f6dc8ccf700 1 Processor -- start 2023-11-30T17:25:05.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.797+0000 7f6dc8ccf700 1 -- start start 2023-11-30T17:25:05.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.797+0000 7f6dc8ccf700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6dc41544e0 0x7f6dc41548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:05.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.798+0000 7f6dc8ccf700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dc40c6e30 0x7f6dc40c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:05.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.798+0000 7f6dc8ccf700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dc40c69a0 con 0x7f6dc406a610 2023-11-30T17:25:05.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.798+0000 7f6dc8ccf700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dc40c13a0 con 0x7f6dc41544e0 2023-11-30T17:25:05.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.798+0000 7f6dc8ccf700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc40c1680 con 0x7f6dc40c6e30 2023-11-30T17:25:05.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.798+0000 7f6dc259c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6dc41544e0 0x7f6dc41548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:05.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.798+0000 7f6dc1d9b700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6dc406a610 0x7f6dc40c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41712/0 (socket says 172.21.15.49:41712) 2023-11-30T17:25:05.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.798+0000 7f6dc1d9b700 1 -- 172.21.15.49:0/1381821475 learned_addr learned my addr 172.21.15.49:0/1381821475 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:25:05.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.798+0000 7f6dc259c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6dc41544e0 0x7f6dc41548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60828/0 (socket says 172.21.15.49:60828) 2023-11-30T17:25:05.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.798+0000 7f6dc2d9d700 1 --2- 172.21.15.49:0/1381821475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dc40c6e30 0x7f6dc40c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:05.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.798+0000 7f6dc259c700 1 -- 172.21.15.49:0/1381821475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dc40c6e30 msgr2=0x7f6dc40c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:05.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.798+0000 7f6dc259c700 1 --2- 172.21.15.49:0/1381821475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dc40c6e30 0x7f6dc40c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.798+0000 7f6dc259c700 1 -- 172.21.15.49:0/1381821475 >> v1:172.21.15.49:6789/0 conn(0x7f6dc406a610 legacy=0x7f6dc40c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:05.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.798+0000 7f6dc159a700 1 -- 172.21.15.49:0/1381821475 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1949183642 0 0) 0x7f6dc40c69a0 con 0x7f6dc406a610 2023-11-30T17:25:05.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.798+0000 7f6dc259c700 1 -- 172.21.15.49:0/1381821475 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc40c6630 con 0x7f6dc41544e0 2023-11-30T17:25:05.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.798+0000 7f6dc2d9d700 1 --2- 172.21.15.49:0/1381821475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dc40c6e30 0x7f6dc40c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:25:05.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.798+0000 7f6dc259c700 1 --2- 172.21.15.49:0/1381821475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dc41544e0 0x7f6dc41548c0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7f6dbc009eb0 tx=0x7f6dbc009780).ready entity=mon.0 client_cookie=d1f812c2a3525b96 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:05.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.798+0000 7f6dc159a700 1 -- 172.21.15.49:0/1381821475 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc00e070 con 0x7f6dc41544e0 2023-11-30T17:25:05.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.798+0000 7f6dc159a700 1 -- 172.21.15.49:0/1381821475 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc00bc30 con 0x7f6dc41544e0 2023-11-30T17:25:05.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.798+0000 7f6dc159a700 1 -- 172.21.15.49:0/1381821475 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc012410 con 0x7f6dc41544e0 2023-11-30T17:25:05.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.799+0000 7f6dc8ccf700 1 -- 172.21.15.49:0/1381821475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dc41544e0 msgr2=0x7f6dc41548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:05.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.799+0000 7f6dc8ccf700 1 --2- 172.21.15.49:0/1381821475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dc41544e0 0x7f6dc41548c0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7f6dbc009eb0 tx=0x7f6dbc009780).stop 2023-11-30T17:25:05.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.799+0000 7f6dc8ccf700 1 -- 172.21.15.49:0/1381821475 shutdown_connections 2023-11-30T17:25:05.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.799+0000 7f6dc8ccf700 1 --2- 172.21.15.49:0/1381821475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dc40c6e30 0x7f6dc40c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.799+0000 7f6dc8ccf700 1 --2- 172.21.15.49:0/1381821475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dc41544e0 0x7f6dc41548c0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.799+0000 7f6dc8ccf700 1 -- 172.21.15.49:0/1381821475 >> 172.21.15.49:0/1381821475 conn(0x7f6dc4085020 msgr2=0x7f6dc4094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:05.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.799+0000 7f6dc8ccf700 1 -- 172.21.15.49:0/1381821475 shutdown_connections 2023-11-30T17:25:05.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.799+0000 7f6dc8ccf700 1 -- 172.21.15.49:0/1381821475 wait complete. 2023-11-30T17:25:05.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.800+0000 7f6dc8ccf700 1 Processor -- start 2023-11-30T17:25:05.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.800+0000 7f6dc8ccf700 1 -- start start 2023-11-30T17:25:05.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.801+0000 7f6dc8ccf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dc406a610 0x7f6dc41533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:05.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.801+0000 7f6dc8ccf700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dc40c6e30 0x7f6dc4140e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:05.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.801+0000 7f6dc8ccf700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dc41544e0 0x7f6dc40c3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:05.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.801+0000 7f6dc8ccf700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc4153940 con 0x7f6dc406a610 2023-11-30T17:25:05.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.801+0000 7f6dc8ccf700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc41520e0 con 0x7f6dc40c6e30 2023-11-30T17:25:05.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.801+0000 7f6dc8ccf700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc41523c0 con 0x7f6dc41544e0 2023-11-30T17:25:05.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.801+0000 7f6dc259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dc406a610 0x7f6dc41533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:05.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.801+0000 7f6dc259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dc406a610 0x7f6dc41533a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60842/0 (socket says 172.21.15.49:60842) 2023-11-30T17:25:05.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.801+0000 7f6dc259c700 1 -- 172.21.15.49:0/595578463 learned_addr learned my addr 172.21.15.49:0/595578463 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:05.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.801+0000 7f6dc2d9d700 1 --2- 172.21.15.49:0/595578463 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dc41544e0 0x7f6dc40c3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:05.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.801+0000 7f6dc1d9b700 1 --2- 172.21.15.49:0/595578463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dc40c6e30 0x7f6dc4140e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:05.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.801+0000 7f6dc259c700 1 -- 172.21.15.49:0/595578463 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dc41544e0 msgr2=0x7f6dc40c3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:05.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.801+0000 7f6dc259c700 1 --2- 172.21.15.49:0/595578463 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dc41544e0 0x7f6dc40c3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.801+0000 7f6dc259c700 1 -- 172.21.15.49:0/595578463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dc40c6e30 msgr2=0x7f6dc4140e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:05.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.801+0000 7f6dc259c700 1 --2- 172.21.15.49:0/595578463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dc40c6e30 0x7f6dc4140e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.801+0000 7f6dc259c700 1 -- 172.21.15.49:0/595578463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc009a20 con 0x7f6dc406a610 2023-11-30T17:25:05.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.801+0000 7f6dc259c700 1 --2- 172.21.15.49:0/595578463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dc406a610 0x7f6dc41533a0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f6dc405fb30 tx=0x7f6dbc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:05.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.801+0000 7f6dba7fc700 1 -- 172.21.15.49:0/595578463 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc013e80 con 0x7f6dc406a610 2023-11-30T17:25:05.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.801+0000 7f6dba7fc700 1 -- 172.21.15.49:0/595578463 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc01d630 con 0x7f6dc406a610 2023-11-30T17:25:05.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.802+0000 7f6dba7fc700 1 -- 172.21.15.49:0/595578463 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc01d9d0 con 0x7f6dc406a610 2023-11-30T17:25:05.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.802+0000 7f6dc8ccf700 1 -- 172.21.15.49:0/595578463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dc41526a0 con 0x7f6dc406a610 2023-11-30T17:25:05.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.802+0000 7f6dc8ccf700 1 -- 172.21.15.49:0/595578463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dc4141370 con 0x7f6dc406a610 2023-11-30T17:25:05.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.802+0000 7f6dc8ccf700 1 -- 172.21.15.49:0/595578463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dc4141590 con 0x7f6dc406a610 2023-11-30T17:25:05.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.803+0000 7f6dba7fc700 1 -- 172.21.15.49:0/595578463 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6dbc003040 con 0x7f6dc406a610 2023-11-30T17:25:05.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.803+0000 7f6dba7fc700 1 --2- 172.21.15.49:0/595578463 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6da405f270 0x7f6da4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:05.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.803+0000 7f6dba7fc700 1 -- 172.21.15.49:0/595578463 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5297+0+0 (secure 0 0 0) 0x7f6dbc07bf00 con 0x7f6dc406a610 2023-11-30T17:25:05.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.803+0000 7f6dc1d9b700 1 --2- 172.21.15.49:0/595578463 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6da405f270 0x7f6da4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:05.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.804+0000 7f6dc1d9b700 1 --2- 172.21.15.49:0/595578463 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6da405f270 0x7f6da4061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f6dc4153d30 tx=0x7f6dac009040).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:05.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.808+0000 7f6dba7fc700 1 -- 172.21.15.49:0/595578463 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6dbc04d380 con 0x7f6dc406a610 2023-11-30T17:25:05.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.984+0000 7f6dc8ccf700 1 -- 172.21.15.49:0/595578463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6dc40c6250 con 0x7f6dc406a610 2023-11-30T17:25:05.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.984+0000 7f6dba7fc700 1 -- 172.21.15.49:0/595578463 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v126) v1 ==== 84+0+143 (secure 0 0 0) 0x7f6dbc0509a0 con 0x7f6dc406a610 2023-11-30T17:25:05.987 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:25:05.987 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-11-30T17:25:05.987 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:25:05.987 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2023-11-30T17:25:05.987 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "device_health_metrics" 2023-11-30T17:25:05.987 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:25:05.987 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:25:05.987 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 2, 2023-11-30T17:25:05.987 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "rbd" 2023-11-30T17:25:05.987 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:25:05.988 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-11-30T17:25:05.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.986+0000 7f6dc8ccf700 1 -- 172.21.15.49:0/595578463 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6da405f270 msgr2=0x7f6da4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:05.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.986+0000 7f6dc8ccf700 1 --2- 172.21.15.49:0/595578463 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6da405f270 0x7f6da4061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f6dc4153d30 tx=0x7f6dac009040).stop 2023-11-30T17:25:05.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.986+0000 7f6dc8ccf700 1 -- 172.21.15.49:0/595578463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dc406a610 msgr2=0x7f6dc41533a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:05.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.986+0000 7f6dc8ccf700 1 --2- 172.21.15.49:0/595578463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dc406a610 0x7f6dc41533a0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f6dc405fb30 tx=0x7f6dbc017000).stop 2023-11-30T17:25:05.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.986+0000 7f6dc8ccf700 1 -- 172.21.15.49:0/595578463 shutdown_connections 2023-11-30T17:25:05.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.986+0000 7f6dc8ccf700 1 --2- 172.21.15.49:0/595578463 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dc41544e0 0x7f6dc40c3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.986+0000 7f6dc8ccf700 1 --2- 172.21.15.49:0/595578463 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6da405f270 0x7f6da4061730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.986+0000 7f6dc8ccf700 1 --2- 172.21.15.49:0/595578463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dc406a610 0x7f6dc41533a0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.986+0000 7f6dc8ccf700 1 --2- 172.21.15.49:0/595578463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dc40c6e30 0x7f6dc4140e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:05.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.986+0000 7f6dc8ccf700 1 -- 172.21.15.49:0/595578463 >> 172.21.15.49:0/595578463 conn(0x7f6dc4085020 msgr2=0x7f6dc40ae240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:05.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.986+0000 7f6dc8ccf700 1 -- 172.21.15.49:0/595578463 shutdown_connections 2023-11-30T17:25:05.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:05.986+0000 7f6dc8ccf700 1 -- 172.21.15.49:0/595578463 wait complete. 2023-11-30T17:25:06.001 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-30T17:25:06.001 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-11-30T17:25:06.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.122+0000 7f6722eee700 1 Processor -- start 2023-11-30T17:25:06.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.122+0000 7f6722eee700 1 -- start start 2023-11-30T17:25:06.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.123+0000 7f6722eee700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f671c154910 0x7f671c0a7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:06.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.123+0000 7f6722eee700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f671c0c6630 con 0x7f671c154530 2023-11-30T17:25:06.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.123+0000 7f6722eee700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f671c064230 con 0x7f671c0aa220 2023-11-30T17:25:06.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.123+0000 7f6722eee700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671c0c6390 con 0x7f671c154910 2023-11-30T17:25:06.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.123+0000 7f6720c8a700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f671c154530 0x7f671c0c8580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41714/0 (socket says 172.21.15.49:41714) 2023-11-30T17:25:06.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.123+0000 7f6720c8a700 1 -- 172.21.15.49:0/2321307871 learned_addr learned my addr 172.21.15.49:0/2321307871 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:25:06.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.123+0000 7f671bfff700 1 --2- 172.21.15.49:0/2321307871 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f671c154910 0x7f671c0a7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:06.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.123+0000 7f671b7fe700 1 -- 172.21.15.49:0/2321307871 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504834873 0 0) 0x7f671c0c6630 con 0x7f671c154530 2023-11-30T17:25:06.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.123+0000 7f671b7fe700 1 -- 172.21.15.49:0/2321307871 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f670c0033f0 con 0x7f671c154530 2023-11-30T17:25:06.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.123+0000 7f671b7fe700 1 -- 172.21.15.49:0/2321307871 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4224803638 0 0) 0x7f671c064230 con 0x7f671c0aa220 2023-11-30T17:25:06.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.123+0000 7f671b7fe700 1 -- 172.21.15.49:0/2321307871 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f671c0c6630 con 0x7f671c0aa220 2023-11-30T17:25:06.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.124+0000 7f671bfff700 1 -- 172.21.15.49:0/2321307871 >> v1:172.21.15.115:6789/0 conn(0x7f671c0aa220 legacy=0x7f671c0c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:06.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.124+0000 7f671bfff700 1 -- 172.21.15.49:0/2321307871 >> v1:172.21.15.49:6789/0 conn(0x7f671c154530 legacy=0x7f671c0c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:06.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.124+0000 7f671bfff700 1 -- 172.21.15.49:0/2321307871 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671c064510 con 0x7f671c154910 2023-11-30T17:25:06.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.124+0000 7f671bfff700 1 --2- 172.21.15.49:0/2321307871 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f671c154910 0x7f671c0a7ff0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f6708009790 tx=0x7f6708009060).ready entity=mon.2 client_cookie=1b701f874e8bd177 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:06.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.124+0000 7f671b7fe700 1 -- 172.21.15.49:0/2321307871 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670800f510 con 0x7f671c154910 2023-11-30T17:25:06.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.124+0000 7f671b7fe700 1 -- 172.21.15.49:0/2321307871 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670800f670 con 0x7f671c154910 2023-11-30T17:25:06.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.124+0000 7f671b7fe700 1 -- 172.21.15.49:0/2321307871 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670800f9f0 con 0x7f671c154910 2023-11-30T17:25:06.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.124+0000 7f6722eee700 1 -- 172.21.15.49:0/2321307871 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f671c154910 msgr2=0x7f671c0a7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:06.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.124+0000 7f6722eee700 1 --2- 172.21.15.49:0/2321307871 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f671c154910 0x7f671c0a7ff0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f6708009790 tx=0x7f6708009060).stop 2023-11-30T17:25:06.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.124+0000 7f6722eee700 1 -- 172.21.15.49:0/2321307871 shutdown_connections 2023-11-30T17:25:06.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.124+0000 7f6722eee700 1 --2- 172.21.15.49:0/2321307871 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f671c154910 0x7f671c0a7ff0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:06.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.124+0000 7f6722eee700 1 -- 172.21.15.49:0/2321307871 >> 172.21.15.49:0/2321307871 conn(0x7f671c094930 msgr2=0x7f671c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:06.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.124+0000 7f6722eee700 1 -- 172.21.15.49:0/2321307871 shutdown_connections 2023-11-30T17:25:06.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.125+0000 7f6722eee700 1 -- 172.21.15.49:0/2321307871 wait complete. 2023-11-30T17:25:06.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.126+0000 7f6722eee700 1 Processor -- start 2023-11-30T17:25:06.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.126+0000 7f6722eee700 1 -- start start 2023-11-30T17:25:06.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.127+0000 7f6722eee700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f671c0aa220 0x7f671c0ac430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:06.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.127+0000 7f6722eee700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f671c154530 0x7f671c0af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:06.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.127+0000 7f6722eee700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f671c154910 0x7f671c14a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:06.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.127+0000 7f6722eee700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671c0c3420 con 0x7f671c0aa220 2023-11-30T17:25:06.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.127+0000 7f6722eee700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671c0ac920 con 0x7f671c154530 2023-11-30T17:25:06.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.127+0000 7f6722eee700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671c0acb30 con 0x7f671c154910 2023-11-30T17:25:06.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.127+0000 7f6720c8a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f671c0aa220 0x7f671c0ac430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:06.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.127+0000 7f6720c8a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f671c0aa220 0x7f671c0ac430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60858/0 (socket says 172.21.15.49:60858) 2023-11-30T17:25:06.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.127+0000 7f6720c8a700 1 -- 172.21.15.49:0/3155003699 learned_addr learned my addr 172.21.15.49:0/3155003699 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:06.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.127+0000 7f671bfff700 1 --2- 172.21.15.49:0/3155003699 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f671c154530 0x7f671c0af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:06.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.127+0000 7f672148b700 1 --2- 172.21.15.49:0/3155003699 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f671c154910 0x7f671c14a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:06.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.127+0000 7f6720c8a700 1 -- 172.21.15.49:0/3155003699 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f671c154910 msgr2=0x7f671c14a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:06.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.127+0000 7f6720c8a700 1 --2- 172.21.15.49:0/3155003699 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f671c154910 0x7f671c14a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:06.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.127+0000 7f6720c8a700 1 -- 172.21.15.49:0/3155003699 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f671c154530 msgr2=0x7f671c0af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:06.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.127+0000 7f6720c8a700 1 --2- 172.21.15.49:0/3155003699 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f671c154530 0x7f671c0af8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:06.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.127+0000 7f6720c8a700 1 -- 172.21.15.49:0/3155003699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67080092a0 con 0x7f671c0aa220 2023-11-30T17:25:06.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.127+0000 7f672148b700 1 --2- 172.21.15.49:0/3155003699 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f671c154910 0x7f671c14a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:25:06.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.127+0000 7f6720c8a700 1 --2- 172.21.15.49:0/3155003699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f671c0aa220 0x7f671c0ac430 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7f671000c790 tx=0x7f6710007b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:06.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.127+0000 7f6718ff9700 1 -- 172.21.15.49:0/3155003699 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67100072e0 con 0x7f671c0aa220 2023-11-30T17:25:06.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.127+0000 7f6718ff9700 1 -- 172.21.15.49:0/3155003699 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6710007440 con 0x7f671c0aa220 2023-11-30T17:25:06.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.127+0000 7f6722eee700 1 -- 172.21.15.49:0/3155003699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f671c0ace10 con 0x7f671c0aa220 2023-11-30T17:25:06.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.127+0000 7f6718ff9700 1 -- 172.21.15.49:0/3155003699 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6710005880 con 0x7f671c0aa220 2023-11-30T17:25:06.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.127+0000 7f6722eee700 1 -- 172.21.15.49:0/3155003699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f671c0ad3d0 con 0x7f671c0aa220 2023-11-30T17:25:06.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.128+0000 7f6722eee700 1 -- 172.21.15.49:0/3155003699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f671c06c860 con 0x7f671c0aa220 2023-11-30T17:25:06.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.129+0000 7f6718ff9700 1 -- 172.21.15.49:0/3155003699 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6710005c30 con 0x7f671c0aa220 2023-11-30T17:25:06.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.129+0000 7f6718ff9700 1 --2- 172.21.15.49:0/3155003699 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f670005f240 0x7f6700061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:06.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.129+0000 7f6718ff9700 1 -- 172.21.15.49:0/3155003699 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5297+0+0 (secure 0 0 0) 0x7f67100798f0 con 0x7f671c0aa220 2023-11-30T17:25:06.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.129+0000 7f671bfff700 1 --2- 172.21.15.49:0/3155003699 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f670005f240 0x7f6700061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:06.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.130+0000 7f671bfff700 1 --2- 172.21.15.49:0/3155003699 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f670005f240 0x7f6700061700 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f6708009fd0 tx=0x7f6708017000).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:06.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.133+0000 7f6718ff9700 1 -- 172.21.15.49:0/3155003699 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f671004ad70 con 0x7f671c0aa220 2023-11-30T17:25:06.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.306+0000 7f6722eee700 1 -- 172.21.15.49:0/3155003699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f671c063050 con 0x7f671c0aa220 2023-11-30T17:25:06.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.395+0000 7f6718ff9700 1 -- 172.21.15.49:0/3155003699 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v127) v1 ==== 152+0+0 (secure 0 0 0) 0x7f6710018070 con 0x7f671c0aa220 2023-11-30T17:25:06.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.398+0000 7f6722eee700 1 -- 172.21.15.49:0/3155003699 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f670005f240 msgr2=0x7f6700061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:06.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.398+0000 7f6722eee700 1 --2- 172.21.15.49:0/3155003699 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f670005f240 0x7f6700061700 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f6708009fd0 tx=0x7f6708017000).stop 2023-11-30T17:25:06.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.398+0000 7f6722eee700 1 -- 172.21.15.49:0/3155003699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f671c0aa220 msgr2=0x7f671c0ac430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:06.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.398+0000 7f6722eee700 1 --2- 172.21.15.49:0/3155003699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f671c0aa220 0x7f671c0ac430 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7f671000c790 tx=0x7f6710007b60).stop 2023-11-30T17:25:06.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.399+0000 7f6722eee700 1 -- 172.21.15.49:0/3155003699 shutdown_connections 2023-11-30T17:25:06.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.399+0000 7f6722eee700 1 --2- 172.21.15.49:0/3155003699 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f671c154910 0x7f671c14a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:06.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.399+0000 7f6722eee700 1 --2- 172.21.15.49:0/3155003699 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f670005f240 0x7f6700061700 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:06.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.399+0000 7f6722eee700 1 --2- 172.21.15.49:0/3155003699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f671c0aa220 0x7f671c0ac430 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:06.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.399+0000 7f6722eee700 1 --2- 172.21.15.49:0/3155003699 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f671c154530 0x7f671c0af8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:06.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.399+0000 7f6722eee700 1 -- 172.21.15.49:0/3155003699 >> 172.21.15.49:0/3155003699 conn(0x7f671c094930 msgr2=0x7f671c1533b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:06.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.400+0000 7f6722eee700 1 -- 172.21.15.49:0/3155003699 shutdown_connections 2023-11-30T17:25:06.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.401+0000 7f6722eee700 1 -- 172.21.15.49:0/3155003699 wait complete. 2023-11-30T17:25:06.408 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2023-11-30T17:25:06.418 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-30T17:25:06.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.541+0000 7f5412067700 1 Processor -- start 2023-11-30T17:25:06.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.541+0000 7f5412067700 1 -- start start 2023-11-30T17:25:06.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.542+0000 7f5412067700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f540c0c66f0 0x7f540c154950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:06.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.542+0000 7f5412067700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f540c158570 0x7f540c158a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:06.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.542+0000 7f5412067700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f540c154e40 con 0x7f540c14e530 2023-11-30T17:25:06.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.542+0000 7f5412067700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540c0c6ba0 con 0x7f540c158570 2023-11-30T17:25:06.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.542+0000 7f5412067700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540c0c7bc0 con 0x7f540c0c66f0 2023-11-30T17:25:06.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.542+0000 7f5411866700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f540c158570 0x7f540c158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:06.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.542+0000 7f5411065700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f540c14e530 0x7f540c14e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41726/0 (socket says 172.21.15.49:41726) 2023-11-30T17:25:06.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.542+0000 7f5411065700 1 -- 172.21.15.49:0/491272756 learned_addr learned my addr 172.21.15.49:0/491272756 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:25:06.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.542+0000 7f5410864700 1 --2- 172.21.15.49:0/491272756 >> v2:172.21.15.115:3300/0 conn(0x7f540c0c66f0 0x7f540c154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:06.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.542+0000 7f5411866700 1 -- 172.21.15.49:0/491272756 >> v2:172.21.15.115:3300/0 conn(0x7f540c0c66f0 msgr2=0x7f540c154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:06.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.542+0000 7f5411866700 1 --2- 172.21.15.49:0/491272756 >> v2:172.21.15.115:3300/0 conn(0x7f540c0c66f0 0x7f540c154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:06.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.542+0000 7f5411866700 1 -- 172.21.15.49:0/491272756 >> v1:172.21.15.49:6789/0 conn(0x7f540c14e530 legacy=0x7f540c14e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:06.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.542+0000 7f5411866700 1 -- 172.21.15.49:0/491272756 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c155920 con 0x7f540c158570 2023-11-30T17:25:06.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.542+0000 7f540bfff700 1 -- 172.21.15.49:0/491272756 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1694523591 0 0) 0x7f5404001490 con 0x7f540c14e530 2023-11-30T17:25:06.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.542+0000 7f5411866700 1 --2- 172.21.15.49:0/491272756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f540c158570 0x7f540c158a00 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 rx=0x7f540c0ab0a0 tx=0x7f53fc009060).ready entity=mon.0 client_cookie=d23d7cfbbcbe7cfd server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:06.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.543+0000 7f540bfff700 1 -- 172.21.15.49:0/491272756 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc00b580 con 0x7f540c158570 2023-11-30T17:25:06.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.543+0000 7f540bfff700 1 -- 172.21.15.49:0/491272756 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53fc00b6e0 con 0x7f540c158570 2023-11-30T17:25:06.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.543+0000 7f540bfff700 1 -- 172.21.15.49:0/491272756 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc00ba60 con 0x7f540c158570 2023-11-30T17:25:06.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.543+0000 7f5412067700 1 -- 172.21.15.49:0/491272756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f540c158570 msgr2=0x7f540c158a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:06.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.543+0000 7f5412067700 1 --2- 172.21.15.49:0/491272756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f540c158570 0x7f540c158a00 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 rx=0x7f540c0ab0a0 tx=0x7f53fc009060).stop 2023-11-30T17:25:06.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.543+0000 7f5412067700 1 -- 172.21.15.49:0/491272756 shutdown_connections 2023-11-30T17:25:06.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.543+0000 7f5412067700 1 --2- 172.21.15.49:0/491272756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f540c158570 0x7f540c158a00 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:06.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.543+0000 7f5412067700 1 --2- 172.21.15.49:0/491272756 >> v2:172.21.15.115:3300/0 conn(0x7f540c0c66f0 0x7f540c154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:06.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.543+0000 7f5412067700 1 -- 172.21.15.49:0/491272756 >> 172.21.15.49:0/491272756 conn(0x7f540c064990 msgr2=0x7f540c064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:06.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.543+0000 7f5412067700 1 -- 172.21.15.49:0/491272756 shutdown_connections 2023-11-30T17:25:06.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.543+0000 7f5412067700 1 -- 172.21.15.49:0/491272756 wait complete. 2023-11-30T17:25:06.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.544+0000 7f5412067700 1 Processor -- start 2023-11-30T17:25:06.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.544+0000 7f5412067700 1 -- start start 2023-11-30T17:25:06.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.545+0000 7f5412067700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f540c0c66f0 0x7f540c0c2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:06.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.545+0000 7f5412067700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f540c14e530 0x7f540c140d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:06.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.545+0000 7f5412067700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f540c158570 0x7f540c155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:06.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.545+0000 7f5412067700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c142060 con 0x7f540c0c66f0 2023-11-30T17:25:06.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.545+0000 7f5412067700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c1411f0 con 0x7f540c158570 2023-11-30T17:25:06.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.545+0000 7f5412067700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540c1562a0 con 0x7f540c14e530 2023-11-30T17:25:06.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.545+0000 7f5411065700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f540c0c66f0 0x7f540c0c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:06.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.545+0000 7f5411065700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f540c0c66f0 0x7f540c0c2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60884/0 (socket says 172.21.15.49:60884) 2023-11-30T17:25:06.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.545+0000 7f5411065700 1 -- 172.21.15.49:0/3375439076 learned_addr learned my addr 172.21.15.49:0/3375439076 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:06.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.546+0000 7f5410864700 1 --2- 172.21.15.49:0/3375439076 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f540c14e530 0x7f540c140d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:06.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.546+0000 7f5411065700 1 -- 172.21.15.49:0/3375439076 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f540c14e530 msgr2=0x7f540c140d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:06.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.546+0000 7f5411065700 1 --2- 172.21.15.49:0/3375439076 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f540c14e530 0x7f540c140d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:06.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.546+0000 7f5411065700 1 -- 172.21.15.49:0/3375439076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f540c158570 msgr2=0x7f540c155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:06.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.546+0000 7f5411065700 1 --2- 172.21.15.49:0/3375439076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f540c158570 0x7f540c155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:25:06.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.546+0000 7f5411065700 1 -- 172.21.15.49:0/3375439076 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53fc0092a0 con 0x7f540c0c66f0 2023-11-30T17:25:06.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.546+0000 7f5411065700 1 --2- 172.21.15.49:0/3375439076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f540c0c66f0 0x7f540c0c2120 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7f5404007fd0 tx=0x7f5404007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:06.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.546+0000 7f54097fa700 1 -- 172.21.15.49:0/3375439076 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5404005d30 con 0x7f540c0c66f0 2023-11-30T17:25:06.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.546+0000 7f5412067700 1 -- 172.21.15.49:0/3375439076 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f540c1413e0 con 0x7f540c0c66f0 2023-11-30T17:25:06.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.546+0000 7f54097fa700 1 -- 172.21.15.49:0/3375439076 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5404005e90 con 0x7f540c0c66f0 2023-11-30T17:25:06.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.546+0000 7f54097fa700 1 -- 172.21.15.49:0/3375439076 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5404007320 con 0x7f540c0c66f0 2023-11-30T17:25:06.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.546+0000 7f5412067700 1 -- 172.21.15.49:0/3375439076 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540c1419a0 con 0x7f540c0c66f0 2023-11-30T17:25:06.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.547+0000 7f5412067700 1 -- 172.21.15.49:0/3375439076 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f540c062ee0 con 0x7f540c0c66f0 2023-11-30T17:25:06.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.547+0000 7f54097fa700 1 -- 172.21.15.49:0/3375439076 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f54040076d0 con 0x7f540c0c66f0 2023-11-30T17:25:06.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.548+0000 7f54097fa700 1 --2- 172.21.15.49:0/3375439076 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f53f805f270 0x7f53f8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:06.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.548+0000 7f54097fa700 1 -- 172.21.15.49:0/3375439076 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5667+0+0 (secure 0 0 0) 0x7f540407a1d0 con 0x7f540c0c66f0 2023-11-30T17:25:06.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.548+0000 7f5410864700 1 --2- 172.21.15.49:0/3375439076 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f53f805f270 0x7f53f8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:06.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.549+0000 7f5410864700 1 --2- 172.21.15.49:0/3375439076 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f53f805f270 0x7f53f8061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f5400006fd0 tx=0x7f5400008040).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:06.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.552+0000 7f54097fa700 1 -- 172.21.15.49:0/3375439076 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f540404b530 con 0x7f540c0c66f0 2023-11-30T17:25:06.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:06.727+0000 7f5412067700 1 -- 172.21.15.49:0/3375439076 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f540c154e40 con 0x7f540c0c66f0 2023-11-30T17:25:07.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.402+0000 7f54097fa700 1 -- 172.21.15.49:0/3375439076 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v128) v1 ==== 170+0+0 (secure 0 0 0) 0x7f540c154e40 con 0x7f540c0c66f0 2023-11-30T17:25:07.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.406+0000 7f5412067700 1 -- 172.21.15.49:0/3375439076 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f53f805f270 msgr2=0x7f53f8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:07.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.406+0000 7f5412067700 1 --2- 172.21.15.49:0/3375439076 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f53f805f270 0x7f53f8061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f5400006fd0 tx=0x7f5400008040).stop 2023-11-30T17:25:07.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.406+0000 7f5412067700 1 -- 172.21.15.49:0/3375439076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f540c0c66f0 msgr2=0x7f540c0c2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:07.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.406+0000 7f5412067700 1 --2- 172.21.15.49:0/3375439076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f540c0c66f0 0x7f540c0c2120 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7f5404007fd0 tx=0x7f5404007e50).stop 2023-11-30T17:25:07.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.407+0000 7f5412067700 1 -- 172.21.15.49:0/3375439076 shutdown_connections 2023-11-30T17:25:07.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.407+0000 7f5412067700 1 --2- 172.21.15.49:0/3375439076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f540c158570 0x7f540c155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:25:07.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.407+0000 7f5412067700 1 --2- 172.21.15.49:0/3375439076 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f53f805f270 0x7f53f8061730 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:07.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.407+0000 7f5412067700 1 --2- 172.21.15.49:0/3375439076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f540c0c66f0 0x7f540c0c2120 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:07.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.407+0000 7f5412067700 1 --2- 172.21.15.49:0/3375439076 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f540c14e530 0x7f540c140d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:07.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.407+0000 7f5412067700 1 -- 172.21.15.49:0/3375439076 >> 172.21.15.49:0/3375439076 conn(0x7f540c064990 msgr2=0x7f540c153c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:07.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.410+0000 7f5412067700 1 -- 172.21.15.49:0/3375439076 shutdown_connections 2023-11-30T17:25:07.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.410+0000 7f5412067700 1 -- 172.21.15.49:0/3375439076 wait complete. 2023-11-30T17:25:07.416 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2023-11-30T17:25:07.438 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-30T17:25:07.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.557+0000 7f9afc8a2700 1 Processor -- start 2023-11-30T17:25:07.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.557+0000 7f9afc8a2700 1 -- start start 2023-11-30T17:25:07.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.558+0000 7f9afc8a2700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9af80c6190 0x7f9af80c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:07.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.558+0000 7f9afc8a2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9af8158320 0x7f9af81587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:07.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.558+0000 7f9afc8a2700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af8158cc0 con 0x7f9af8098d10 2023-11-30T17:25:07.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.558+0000 7f9afc8a2700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af80c72d0 con 0x7f9af8158320 2023-11-30T17:25:07.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.558+0000 7f9afc8a2700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af8064570 con 0x7f9af80c6190 2023-11-30T17:25:07.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.558+0000 7f9af6d9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9af8158320 0x7f9af81587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:07.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.559+0000 7f9af6d9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9af8158320 0x7f9af81587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60898/0 (socket says 172.21.15.49:60898) 2023-11-30T17:25:07.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.559+0000 7f9af6d9d700 1 -- 172.21.15.49:0/309665310 learned_addr learned my addr 172.21.15.49:0/309665310 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:07.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.559+0000 7f9af5d9b700 1 --2- 172.21.15.49:0/309665310 >> v2:172.21.15.115:3300/0 conn(0x7f9af80c6190 0x7f9af80c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:07.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.559+0000 7f9af6d9d700 1 -- 172.21.15.49:0/309665310 >> v2:172.21.15.115:3300/0 conn(0x7f9af80c6190 msgr2=0x7f9af80c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:07.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.559+0000 7f9af6d9d700 1 --2- 172.21.15.49:0/309665310 >> v2:172.21.15.115:3300/0 conn(0x7f9af80c6190 0x7f9af80c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:07.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.559+0000 7f9af6d9d700 1 -- 172.21.15.49:0/309665310 >> v1:172.21.15.115:6789/0 conn(0x7f9af8098d10 legacy=0x7f9af8063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:07.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.559+0000 7f9af6d9d700 1 -- 172.21.15.49:0/309665310 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af8154bc0 con 0x7f9af8158320 2023-11-30T17:25:07.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.559+0000 7f9af6d9d700 1 --2- 172.21.15.49:0/309665310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9af8158320 0x7f9af81587d0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7f9af80c5b40 tx=0x7f9ae8009840).ready entity=mon.0 client_cookie=f144e628ffb54c78 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:07.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.559+0000 7f9af559a700 1 -- 172.21.15.49:0/309665310 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae800e070 con 0x7f9af8158320 2023-11-30T17:25:07.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.559+0000 7f9af559a700 1 -- 172.21.15.49:0/309665310 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae800ba20 con 0x7f9af8158320 2023-11-30T17:25:07.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.559+0000 7f9af559a700 1 -- 172.21.15.49:0/309665310 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae800bda0 con 0x7f9af8158320 2023-11-30T17:25:07.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.560+0000 7f9afc8a2700 1 -- 172.21.15.49:0/309665310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9af8158320 msgr2=0x7f9af81587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:07.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.560+0000 7f9afc8a2700 1 --2- 172.21.15.49:0/309665310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9af8158320 0x7f9af81587d0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7f9af80c5b40 tx=0x7f9ae8009840).stop 2023-11-30T17:25:07.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.560+0000 7f9afc8a2700 1 -- 172.21.15.49:0/309665310 shutdown_connections 2023-11-30T17:25:07.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.560+0000 7f9afc8a2700 1 --2- 172.21.15.49:0/309665310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9af8158320 0x7f9af81587d0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:07.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.560+0000 7f9afc8a2700 1 --2- 172.21.15.49:0/309665310 >> v2:172.21.15.115:3300/0 conn(0x7f9af80c6190 0x7f9af80c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:07.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.560+0000 7f9afc8a2700 1 -- 172.21.15.49:0/309665310 >> 172.21.15.49:0/309665310 conn(0x7f9af80cb310 msgr2=0x7f9af80cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:07.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.560+0000 7f9afc8a2700 1 -- 172.21.15.49:0/309665310 shutdown_connections 2023-11-30T17:25:07.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.560+0000 7f9afc8a2700 1 -- 172.21.15.49:0/309665310 wait complete. 2023-11-30T17:25:07.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.561+0000 7f9afc8a2700 1 Processor -- start 2023-11-30T17:25:07.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.561+0000 7f9afc8a2700 1 -- start start 2023-11-30T17:25:07.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.562+0000 7f9afc8a2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9af8098d10 0x7f9af8157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:07.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.562+0000 7f9afc8a2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9af80c6190 0x7f9af8148730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:07.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.562+0000 7f9afc8a2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9af8158320 0x7f9af8148c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:07.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.562+0000 7f9afc8a2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af8156450 con 0x7f9af80c6190 2023-11-30T17:25:07.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.562+0000 7f9afc8a2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af81566a0 con 0x7f9af8158320 2023-11-30T17:25:07.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.562+0000 7f9afc8a2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af8156980 con 0x7f9af8098d10 2023-11-30T17:25:07.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.562+0000 7f9af5d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9af80c6190 0x7f9af8148730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:07.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.562+0000 7f9af5d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9af80c6190 0x7f9af8148730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60904/0 (socket says 172.21.15.49:60904) 2023-11-30T17:25:07.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.562+0000 7f9af5d9b700 1 -- 172.21.15.49:0/1625001608 learned_addr learned my addr 172.21.15.49:0/1625001608 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:07.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.562+0000 7f9af659c700 1 --2- 172.21.15.49:0/1625001608 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9af8098d10 0x7f9af8157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:07.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.562+0000 7f9af6d9d700 1 --2- 172.21.15.49:0/1625001608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9af8158320 0x7f9af8148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:07.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.562+0000 7f9af5d9b700 1 -- 172.21.15.49:0/1625001608 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9af8098d10 msgr2=0x7f9af8157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:07.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.562+0000 7f9af5d9b700 1 --2- 172.21.15.49:0/1625001608 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9af8098d10 0x7f9af8157460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:07.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.562+0000 7f9af5d9b700 1 -- 172.21.15.49:0/1625001608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9af8158320 msgr2=0x7f9af8148c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:07.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.562+0000 7f9af5d9b700 1 --2- 172.21.15.49:0/1625001608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9af8158320 0x7f9af8148c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:07.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.562+0000 7f9af5d9b700 1 -- 172.21.15.49:0/1625001608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae8009ae0 con 0x7f9af80c6190 2023-11-30T17:25:07.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.562+0000 7f9af6d9d700 1 --2- 172.21.15.49:0/1625001608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9af8158320 0x7f9af8148c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:25:07.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.562+0000 7f9af5d9b700 1 --2- 172.21.15.49:0/1625001608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9af80c6190 0x7f9af8148730 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7f9ae000e950 tx=0x7f9ae0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:07.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.562+0000 7f9aee7fc700 1 -- 172.21.15.49:0/1625001608 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae000c670 con 0x7f9af80c6190 2023-11-30T17:25:07.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.562+0000 7f9aee7fc700 1 -- 172.21.15.49:0/1625001608 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae000c7d0 con 0x7f9af80c6190 2023-11-30T17:25:07.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.562+0000 7f9afc8a2700 1 -- 172.21.15.49:0/1625001608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af8156c60 con 0x7f9af80c6190 2023-11-30T17:25:07.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.562+0000 7f9aee7fc700 1 -- 172.21.15.49:0/1625001608 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae000cb70 con 0x7f9af80c6190 2023-11-30T17:25:07.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.563+0000 7f9afc8a2700 1 -- 172.21.15.49:0/1625001608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af8157950 con 0x7f9af80c6190 2023-11-30T17:25:07.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.563+0000 7f9afc8a2700 1 -- 172.21.15.49:0/1625001608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af8157180 con 0x7f9af80c6190 2023-11-30T17:25:07.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.564+0000 7f9aee7fc700 1 -- 172.21.15.49:0/1625001608 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f9ae00123f0 con 0x7f9af80c6190 2023-11-30T17:25:07.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.564+0000 7f9aee7fc700 1 --2- 172.21.15.49:0/1625001608 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9ad805f240 0x7f9ad8061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:07.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.564+0000 7f9aee7fc700 1 -- 172.21.15.49:0/1625001608 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f9ae007a460 con 0x7f9af80c6190 2023-11-30T17:25:07.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.565+0000 7f9af659c700 1 --2- 172.21.15.49:0/1625001608 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9ad805f240 0x7f9ad8061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:07.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.565+0000 7f9af659c700 1 --2- 172.21.15.49:0/1625001608 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9ad805f240 0x7f9ad8061700 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f9af0003900 tx=0x7f9af0007d40).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:07.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.569+0000 7f9aee7fc700 1 -- 172.21.15.49:0/1625001608 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9af8157180 con 0x7f9af80c6190 2023-11-30T17:25:07.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.784+0000 7f9afc8a2700 1 -- 172.21.15.49:0/1625001608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9af8157180 con 0x7f9af80c6190 2023-11-30T17:25:07.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.791+0000 7f9aee7fc700 1 -- 172.21.15.49:0/1625001608 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v50) v1 ==== 174+0+0 (secure 0 0 0) 0x7f9af8157180 con 0x7f9af80c6190 2023-11-30T17:25:07.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.805+0000 7f9afc8a2700 1 -- 172.21.15.49:0/1625001608 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9ad805f240 msgr2=0x7f9ad8061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:07.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.805+0000 7f9afc8a2700 1 --2- 172.21.15.49:0/1625001608 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9ad805f240 0x7f9ad8061700 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f9af0003900 tx=0x7f9af0007d40).stop 2023-11-30T17:25:07.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.805+0000 7f9afc8a2700 1 -- 172.21.15.49:0/1625001608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9af80c6190 msgr2=0x7f9af8148730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:07.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.805+0000 7f9afc8a2700 1 --2- 172.21.15.49:0/1625001608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9af80c6190 0x7f9af8148730 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7f9ae000e950 tx=0x7f9ae0009060).stop 2023-11-30T17:25:07.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.806+0000 7f9afc8a2700 1 -- 172.21.15.49:0/1625001608 shutdown_connections 2023-11-30T17:25:07.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.806+0000 7f9afc8a2700 1 --2- 172.21.15.49:0/1625001608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9af8158320 0x7f9af8148c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:07.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.806+0000 7f9afc8a2700 1 --2- 172.21.15.49:0/1625001608 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9af8098d10 0x7f9af8157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:07.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.806+0000 7f9afc8a2700 1 --2- 172.21.15.49:0/1625001608 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9ad805f240 0x7f9ad8061700 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:07.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.806+0000 7f9afc8a2700 1 --2- 172.21.15.49:0/1625001608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9af80c6190 0x7f9af8148730 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:07.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.806+0000 7f9afc8a2700 1 -- 172.21.15.49:0/1625001608 >> 172.21.15.49:0/1625001608 conn(0x7f9af80cb310 msgr2=0x7f9af80ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:07.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.809+0000 7f9afc8a2700 1 -- 172.21.15.49:0/1625001608 shutdown_connections 2023-11-30T17:25:07.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.809+0000 7f9afc8a2700 1 -- 172.21.15.49:0/1625001608 wait complete. 2023-11-30T17:25:07.814 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 15 and data pool 16 2023-11-30T17:25:07.827 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:25:07.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.942+0000 7f697dfc1700 1 Processor -- start 2023-11-30T17:25:07.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.942+0000 7f697dfc1700 1 -- start start 2023-11-30T17:25:07.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.943+0000 7f697dfc1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6978066e00 0x7f69780671e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:07.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.943+0000 7f697dfc1700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6978155e40 0x7f69780a5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:07.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.943+0000 7f697dfc1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69780a5e70 0x7f6978067980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:07.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.943+0000 7f697dfc1700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69780bd590 con 0x7f6978066e00 2023-11-30T17:25:07.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.943+0000 7f697dfc1700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6978156370 con 0x7f6978155e40 2023-11-30T17:25:07.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.943+0000 7f697dfc1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6978156650 con 0x7f69780a5e70 2023-11-30T17:25:07.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.943+0000 7f69777fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6978066e00 0x7f69780671e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:07.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.943+0000 7f69777fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6978066e00 0x7f69780671e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60910/0 (socket says 172.21.15.49:60910) 2023-11-30T17:25:07.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.943+0000 7f69777fe700 1 -- 172.21.15.49:0/2797870824 learned_addr learned my addr 172.21.15.49:0/2797870824 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:07.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.943+0000 7f6976ffd700 1 --2- 172.21.15.49:0/2797870824 >> v2:172.21.15.115:3300/0 conn(0x7f6978155e40 0x7f69780a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:07.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.943+0000 7f6977fff700 1 --2- 172.21.15.49:0/2797870824 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69780a5e70 0x7f6978067980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:07.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.944+0000 7f69777fe700 1 -- 172.21.15.49:0/2797870824 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69780a5e70 msgr2=0x7f6978067980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:07.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.944+0000 7f69777fe700 1 --2- 172.21.15.49:0/2797870824 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69780a5e70 0x7f6978067980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:07.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.944+0000 7f69777fe700 1 -- 172.21.15.49:0/2797870824 >> v2:172.21.15.115:3300/0 conn(0x7f6978155e40 msgr2=0x7f69780a5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:07.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.944+0000 7f69777fe700 1 --2- 172.21.15.49:0/2797870824 >> v2:172.21.15.115:3300/0 conn(0x7f6978155e40 0x7f69780a5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:07.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.944+0000 7f69777fe700 1 -- 172.21.15.49:0/2797870824 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6978156930 con 0x7f6978066e00 2023-11-30T17:25:07.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.944+0000 7f69777fe700 1 --2- 172.21.15.49:0/2797870824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6978066e00 0x7f69780671e0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f6978063510 tx=0x7f69680090f0).ready entity=mon.0 client_cookie=2fe61f709a9fb1f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:07.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.944+0000 7f69767fc700 1 -- 172.21.15.49:0/2797870824 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696800f510 con 0x7f6978066e00 2023-11-30T17:25:07.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.944+0000 7f69767fc700 1 -- 172.21.15.49:0/2797870824 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696800f670 con 0x7f6978066e00 2023-11-30T17:25:07.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.944+0000 7f69767fc700 1 -- 172.21.15.49:0/2797870824 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696800fa10 con 0x7f6978066e00 2023-11-30T17:25:07.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.944+0000 7f697dfc1700 1 -- 172.21.15.49:0/2797870824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6978066e00 msgr2=0x7f69780671e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:07.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.944+0000 7f697dfc1700 1 --2- 172.21.15.49:0/2797870824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6978066e00 0x7f69780671e0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f6978063510 tx=0x7f69680090f0).stop 2023-11-30T17:25:07.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.944+0000 7f697dfc1700 1 -- 172.21.15.49:0/2797870824 shutdown_connections 2023-11-30T17:25:07.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.944+0000 7f697dfc1700 1 --2- 172.21.15.49:0/2797870824 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69780a5e70 0x7f6978067980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:07.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.944+0000 7f697dfc1700 1 --2- 172.21.15.49:0/2797870824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6978066e00 0x7f69780671e0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:07.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.944+0000 7f697dfc1700 1 --2- 172.21.15.49:0/2797870824 >> v2:172.21.15.115:3300/0 conn(0x7f6978155e40 0x7f69780a5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:07.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.944+0000 7f697dfc1700 1 -- 172.21.15.49:0/2797870824 >> 172.21.15.49:0/2797870824 conn(0x7f69780c7fd0 msgr2=0x7f69780c83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:07.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.945+0000 7f697dfc1700 1 -- 172.21.15.49:0/2797870824 shutdown_connections 2023-11-30T17:25:07.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.945+0000 7f697dfc1700 1 -- 172.21.15.49:0/2797870824 wait complete. 2023-11-30T17:25:07.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.946+0000 7f697dfc1700 1 Processor -- start 2023-11-30T17:25:07.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.946+0000 7f697dfc1700 1 -- start start 2023-11-30T17:25:07.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.946+0000 7f697dfc1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6978066e00 0x7f69780c1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:07.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.947+0000 7f697dfc1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6978155e40 0x7f6978154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:07.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.947+0000 7f697dfc1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69780c1d50 0x7f6978154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:07.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.947+0000 7f697dfc1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69780ab470 con 0x7f69780c1d50 2023-11-30T17:25:07.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.947+0000 7f697dfc1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6978155480 con 0x7f6978066e00 2023-11-30T17:25:07.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.947+0000 7f697dfc1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6978155760 con 0x7f6978155e40 2023-11-30T17:25:07.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.947+0000 7f6977fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69780c1d50 0x7f6978154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:07.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.947+0000 7f6977fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69780c1d50 0x7f6978154e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60926/0 (socket says 172.21.15.49:60926) 2023-11-30T17:25:07.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.947+0000 7f6977fff700 1 -- 172.21.15.49:0/299285891 learned_addr learned my addr 172.21.15.49:0/299285891 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:07.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.947+0000 7f69777fe700 1 --2- 172.21.15.49:0/299285891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6978066e00 0x7f69780c1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:07.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.947+0000 7f6976ffd700 1 --2- 172.21.15.49:0/299285891 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6978155e40 0x7f6978154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:07.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.947+0000 7f6977fff700 1 -- 172.21.15.49:0/299285891 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6978155e40 msgr2=0x7f6978154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:07.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.947+0000 7f6977fff700 1 --2- 172.21.15.49:0/299285891 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6978155e40 0x7f6978154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:07.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.947+0000 7f6977fff700 1 -- 172.21.15.49:0/299285891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6978066e00 msgr2=0x7f69780c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:07.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.947+0000 7f6977fff700 1 --2- 172.21.15.49:0/299285891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6978066e00 0x7f69780c1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:07.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.947+0000 7f6977fff700 1 -- 172.21.15.49:0/299285891 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6968009370 con 0x7f69780c1d50 2023-11-30T17:25:07.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.947+0000 7f69777fe700 1 --2- 172.21.15.49:0/299285891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6978066e00 0x7f69780c1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:25:07.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.947+0000 7f6976ffd700 1 --2- 172.21.15.49:0/299285891 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6978155e40 0x7f6978154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:25:07.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.947+0000 7f6977fff700 1 --2- 172.21.15.49:0/299285891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69780c1d50 0x7f6978154e70 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7f6970009e90 tx=0x7f697000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:07.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.947+0000 7f695f7fe700 1 -- 172.21.15.49:0/299285891 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697000cc20 con 0x7f69780c1d50 2023-11-30T17:25:07.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.947+0000 7f695f7fe700 1 -- 172.21.15.49:0/299285891 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697000f040 con 0x7f69780c1d50 2023-11-30T17:25:07.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.947+0000 7f697dfc1700 1 -- 172.21.15.49:0/299285891 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69780ab100 con 0x7f69780c1d50 2023-11-30T17:25:07.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.947+0000 7f695f7fe700 1 -- 172.21.15.49:0/299285891 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6970013400 con 0x7f69780c1d50 2023-11-30T17:25:07.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.947+0000 7f697dfc1700 1 -- 172.21.15.49:0/299285891 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69780c4f50 con 0x7f69780c1d50 2023-11-30T17:25:07.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.948+0000 7f697dfc1700 1 -- 172.21.15.49:0/299285891 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69780aaf60 con 0x7f69780c1d50 2023-11-30T17:25:07.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.949+0000 7f695f7fe700 1 -- 172.21.15.49:0/299285891 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f69700137b0 con 0x7f69780c1d50 2023-11-30T17:25:07.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.949+0000 7f695f7fe700 1 --2- 172.21.15.49:0/299285891 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f696405f270 0x7f6964061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:07.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.949+0000 7f695f7fe700 1 -- 172.21.15.49:0/299285891 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f697007ac70 con 0x7f69780c1d50 2023-11-30T17:25:07.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.949+0000 7f69777fe700 1 --2- 172.21.15.49:0/299285891 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f696405f270 0x7f6964061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:07.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.950+0000 7f69777fe700 1 --2- 172.21.15.49:0/299285891 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f696405f270 0x7f6964061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f6978063510 tx=0x7f6968017000).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:07.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:07.954+0000 7f695f7fe700 1 -- 172.21.15.49:0/299285891 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f69780aaf60 con 0x7f69780c1d50 2023-11-30T17:25:08.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.127+0000 7f697dfc1700 1 -- 172.21.15.49:0/299285891 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f697806c860 con 0x7f69780c1d50 2023-11-30T17:25:08.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.128+0000 7f695f7fe700 1 -- 172.21.15.49:0/299285891 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+16999 (secure 0 0 0) 0x7f697004f7d0 con 0x7f69780c1d50 2023-11-30T17:25:08.131 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:25:08.131 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":129,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:25:07.786296+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:25:06.343377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-11-30T17:25:06.764214+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:25:08.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.130+0000 7f697dfc1700 1 -- 172.21.15.49:0/299285891 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f696405f270 msgr2=0x7f6964061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:08.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.130+0000 7f697dfc1700 1 --2- 172.21.15.49:0/299285891 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f696405f270 0x7f6964061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f6978063510 tx=0x7f6968017000).stop 2023-11-30T17:25:08.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.130+0000 7f697dfc1700 1 -- 172.21.15.49:0/299285891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69780c1d50 msgr2=0x7f6978154e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:08.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.130+0000 7f697dfc1700 1 --2- 172.21.15.49:0/299285891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69780c1d50 0x7f6978154e70 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7f6970009e90 tx=0x7f697000b040).stop 2023-11-30T17:25:08.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.130+0000 7f697dfc1700 1 -- 172.21.15.49:0/299285891 shutdown_connections 2023-11-30T17:25:08.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.130+0000 7f697dfc1700 1 --2- 172.21.15.49:0/299285891 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f696405f270 0x7f6964061730 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:08.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.130+0000 7f697dfc1700 1 --2- 172.21.15.49:0/299285891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69780c1d50 0x7f6978154e70 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:08.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.130+0000 7f697dfc1700 1 --2- 172.21.15.49:0/299285891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6978066e00 0x7f69780c1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:08.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.130+0000 7f697dfc1700 1 --2- 172.21.15.49:0/299285891 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6978155e40 0x7f6978154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:08.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.130+0000 7f697dfc1700 1 -- 172.21.15.49:0/299285891 >> 172.21.15.49:0/299285891 conn(0x7f69780c7fd0 msgr2=0x7f69780c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:08.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.130+0000 7f697dfc1700 1 -- 172.21.15.49:0/299285891 shutdown_connections 2023-11-30T17:25:08.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.130+0000 7f697dfc1700 1 -- 172.21.15.49:0/299285891 wait complete. 2023-11-30T17:25:08.145 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:25:08.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.261+0000 7fcad9a07700 1 Processor -- start 2023-11-30T17:25:08.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.261+0000 7fcad9a07700 1 -- start start 2023-11-30T17:25:08.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.262+0000 7fcad9a07700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcad41543a0 0x7fcad40694d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:08.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.262+0000 7fcad9a07700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcad40c5f70 0x7fcad40bd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:08.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.262+0000 7fcad9a07700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad406a400 con 0x7fcad40a6e70 2023-11-30T17:25:08.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.262+0000 7fcad9a07700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad40bcd90 con 0x7fcad41543a0 2023-11-30T17:25:08.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.262+0000 7fcad9a07700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad4069b60 con 0x7fcad40c5f70 2023-11-30T17:25:08.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.262+0000 7fcad2ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcad41543a0 0x7fcad40694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:08.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.262+0000 7fcad2ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcad41543a0 0x7fcad40694d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60940/0 (socket says 172.21.15.49:60940) 2023-11-30T17:25:08.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.262+0000 7fcad2ffd700 1 -- 172.21.15.49:0/860914039 learned_addr learned my addr 172.21.15.49:0/860914039 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:08.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.262+0000 7fcad27fc700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcad40a6e70 0x7fcad40c5860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41734/0 (socket says 172.21.15.49:41734) 2023-11-30T17:25:08.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.262+0000 7fcad2ffd700 1 -- 172.21.15.49:0/860914039 >> v2:172.21.15.115:3300/0 conn(0x7fcad40c5f70 msgr2=0x7fcad40bd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:08.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.262+0000 7fcad37fe700 1 --2- 172.21.15.49:0/860914039 >> v2:172.21.15.115:3300/0 conn(0x7fcad40c5f70 0x7fcad40bd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:08.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.262+0000 7fcad2ffd700 1 --2- 172.21.15.49:0/860914039 >> v2:172.21.15.115:3300/0 conn(0x7fcad40c5f70 0x7fcad40bd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:08.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.262+0000 7fcad2ffd700 1 -- 172.21.15.49:0/860914039 >> v1:172.21.15.49:6789/0 conn(0x7fcad40a6e70 legacy=0x7fcad40c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:08.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.262+0000 7fcad1ffb700 1 -- 172.21.15.49:0/860914039 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1339509819 0 0) 0x7fcad406a400 con 0x7fcad40a6e70 2023-11-30T17:25:08.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.262+0000 7fcad2ffd700 1 -- 172.21.15.49:0/860914039 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad4069e40 con 0x7fcad41543a0 2023-11-30T17:25:08.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.262+0000 7fcad2ffd700 1 --2- 172.21.15.49:0/860914039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcad41543a0 0x7fcad40694d0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7fcad40bed00 tx=0x7fcacc0090f0).ready entity=mon.0 client_cookie=75e8a11d9fb26c37 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:08.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.263+0000 7fcad1ffb700 1 -- 172.21.15.49:0/860914039 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc00b600 con 0x7fcad41543a0 2023-11-30T17:25:08.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.263+0000 7fcad1ffb700 1 -- 172.21.15.49:0/860914039 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcacc00b760 con 0x7fcad41543a0 2023-11-30T17:25:08.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.263+0000 7fcad1ffb700 1 -- 172.21.15.49:0/860914039 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc00bae0 con 0x7fcad41543a0 2023-11-30T17:25:08.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.263+0000 7fcad9a07700 1 -- 172.21.15.49:0/860914039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcad41543a0 msgr2=0x7fcad40694d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:08.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.263+0000 7fcad9a07700 1 --2- 172.21.15.49:0/860914039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcad41543a0 0x7fcad40694d0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7fcad40bed00 tx=0x7fcacc0090f0).stop 2023-11-30T17:25:08.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.263+0000 7fcad9a07700 1 -- 172.21.15.49:0/860914039 shutdown_connections 2023-11-30T17:25:08.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.263+0000 7fcad9a07700 1 --2- 172.21.15.49:0/860914039 >> v2:172.21.15.115:3300/0 conn(0x7fcad40c5f70 0x7fcad40bd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:08.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.263+0000 7fcad9a07700 1 --2- 172.21.15.49:0/860914039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcad41543a0 0x7fcad40694d0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:08.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.263+0000 7fcad9a07700 1 -- 172.21.15.49:0/860914039 >> 172.21.15.49:0/860914039 conn(0x7fcad40c7d00 msgr2=0x7fcad40c8110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:08.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.263+0000 7fcad9a07700 1 -- 172.21.15.49:0/860914039 shutdown_connections 2023-11-30T17:25:08.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.263+0000 7fcad9a07700 1 -- 172.21.15.49:0/860914039 wait complete. 2023-11-30T17:25:08.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.264+0000 7fcad9a07700 1 Processor -- start 2023-11-30T17:25:08.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.265+0000 7fcad9a07700 1 -- start start 2023-11-30T17:25:08.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.265+0000 7fcad9a07700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcad40a6e70 0x7fcad40a80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:08.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.265+0000 7fcad9a07700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcad40c5f70 0x7fcad414d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:08.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.265+0000 7fcad9a07700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcad41543a0 0x7fcad414daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:08.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.265+0000 7fcad9a07700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad414df90 con 0x7fcad40c5f70 2023-11-30T17:25:08.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.265+0000 7fcad9a07700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad40aa130 con 0x7fcad41543a0 2023-11-30T17:25:08.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.265+0000 7fcad9a07700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad40a9520 con 0x7fcad40a6e70 2023-11-30T17:25:08.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.265+0000 7fcad27fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcad40c5f70 0x7fcad414d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:08.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.265+0000 7fcad27fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcad40c5f70 0x7fcad414d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60944/0 (socket says 172.21.15.49:60944) 2023-11-30T17:25:08.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.265+0000 7fcad27fc700 1 -- 172.21.15.49:0/2239386913 learned_addr learned my addr 172.21.15.49:0/2239386913 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:08.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.266+0000 7fcad2ffd700 1 --2- 172.21.15.49:0/2239386913 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcad40a6e70 0x7fcad40a80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:08.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.266+0000 7fcad37fe700 1 --2- 172.21.15.49:0/2239386913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcad41543a0 0x7fcad414daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:08.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.266+0000 7fcad27fc700 1 -- 172.21.15.49:0/2239386913 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcad40a6e70 msgr2=0x7fcad40a80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:08.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.266+0000 7fcad27fc700 1 --2- 172.21.15.49:0/2239386913 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcad40a6e70 0x7fcad40a80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:08.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.266+0000 7fcad27fc700 1 -- 172.21.15.49:0/2239386913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcad41543a0 msgr2=0x7fcad414daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:08.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.266+0000 7fcad27fc700 1 --2- 172.21.15.49:0/2239386913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcad41543a0 0x7fcad414daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:08.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.266+0000 7fcad27fc700 1 -- 172.21.15.49:0/2239386913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcacc009370 con 0x7fcad40c5f70 2023-11-30T17:25:08.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.266+0000 7fcad27fc700 1 --2- 172.21.15.49:0/2239386913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcad40c5f70 0x7fcad414d5b0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7fcabc00c560 tx=0x7fcabc007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:08.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.266+0000 7fcacaffd700 1 -- 172.21.15.49:0/2239386913 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc0072e0 con 0x7fcad40c5f70 2023-11-30T17:25:08.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.266+0000 7fcacaffd700 1 -- 172.21.15.49:0/2239386913 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcabc007440 con 0x7fcad40c5f70 2023-11-30T17:25:08.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.266+0000 7fcad9a07700 1 -- 172.21.15.49:0/2239386913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad40a9800 con 0x7fcad40c5f70 2023-11-30T17:25:08.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.266+0000 7fcacaffd700 1 -- 172.21.15.49:0/2239386913 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc0058f0 con 0x7fcad40c5f70 2023-11-30T17:25:08.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.266+0000 7fcad9a07700 1 -- 172.21.15.49:0/2239386913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad40a9dc0 con 0x7fcad40c5f70 2023-11-30T17:25:08.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.267+0000 7fcad9a07700 1 -- 172.21.15.49:0/2239386913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad40aa2e0 con 0x7fcad40c5f70 2023-11-30T17:25:08.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.267+0000 7fcacaffd700 1 -- 172.21.15.49:0/2239386913 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fcabc005ce0 con 0x7fcad40c5f70 2023-11-30T17:25:08.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.268+0000 7fcacaffd700 1 --2- 172.21.15.49:0/2239386913 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcab405f270 0x7fcab4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:08.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.268+0000 7fcacaffd700 1 -- 172.21.15.49:0/2239386913 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fcabc079d50 con 0x7fcad40c5f70 2023-11-30T17:25:08.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.268+0000 7fcad2ffd700 1 --2- 172.21.15.49:0/2239386913 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcab405f270 0x7fcab4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:08.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.268+0000 7fcad2ffd700 1 --2- 172.21.15.49:0/2239386913 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcab405f270 0x7fcab4061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fcacc009130 tx=0x7fcacc017000).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:08.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.272+0000 7fcacaffd700 1 -- 172.21.15.49:0/2239386913 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcabc04ae80 con 0x7fcad40c5f70 2023-11-30T17:25:08.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.446+0000 7fcad9a07700 1 -- 172.21.15.49:0/2239386913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcad406a120 con 0x7fcad40c5f70 2023-11-30T17:25:08.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.447+0000 7fcacaffd700 1 -- 172.21.15.49:0/2239386913 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+16999 (secure 0 0 0) 0x7fcabc018030 con 0x7fcad40c5f70 2023-11-30T17:25:08.449 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:25:08.449 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":129,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:25:07.786296+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:25:06.343377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-11-30T17:25:06.764214+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:25:08.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.449+0000 7fcad9a07700 1 -- 172.21.15.49:0/2239386913 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcab405f270 msgr2=0x7fcab4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:08.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.449+0000 7fcad9a07700 1 --2- 172.21.15.49:0/2239386913 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcab405f270 0x7fcab4061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fcacc009130 tx=0x7fcacc017000).stop 2023-11-30T17:25:08.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.449+0000 7fcad9a07700 1 -- 172.21.15.49:0/2239386913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcad40c5f70 msgr2=0x7fcad414d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:08.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.449+0000 7fcad9a07700 1 --2- 172.21.15.49:0/2239386913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcad40c5f70 0x7fcad414d5b0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7fcabc00c560 tx=0x7fcabc007c90).stop 2023-11-30T17:25:08.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.449+0000 7fcad9a07700 1 -- 172.21.15.49:0/2239386913 shutdown_connections 2023-11-30T17:25:08.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.449+0000 7fcad9a07700 1 --2- 172.21.15.49:0/2239386913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcad41543a0 0x7fcad414daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:08.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.449+0000 7fcad9a07700 1 --2- 172.21.15.49:0/2239386913 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcad40a6e70 0x7fcad40a80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:08.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.449+0000 7fcad9a07700 1 --2- 172.21.15.49:0/2239386913 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcab405f270 0x7fcab4061730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:08.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.449+0000 7fcad9a07700 1 --2- 172.21.15.49:0/2239386913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcad40c5f70 0x7fcad414d5b0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:08.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.449+0000 7fcad9a07700 1 -- 172.21.15.49:0/2239386913 >> 172.21.15.49:0/2239386913 conn(0x7fcad40c7d00 msgr2=0x7fcad40c37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:08.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.449+0000 7fcad9a07700 1 -- 172.21.15.49:0/2239386913 shutdown_connections 2023-11-30T17:25:08.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.449+0000 7fcad9a07700 1 -- 172.21.15.49:0/2239386913 wait complete. 2023-11-30T17:25:08.464 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-30T17:25:08.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.582+0000 7fb3d88fa700 1 Processor -- start 2023-11-30T17:25:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.582+0000 7fb3d88fa700 1 -- start start 2023-11-30T17:25:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.582+0000 7fb3d88fa700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb3d414e530 0x7fb3d40c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.582+0000 7fb3d88fa700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb3d4158570 0x7fb3d4158a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.583+0000 7fb3d88fa700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d40c7bc0 con 0x7fb3d4154950 2023-11-30T17:25:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.583+0000 7fb3d88fa700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d4155920 con 0x7fb3d4158570 2023-11-30T17:25:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.583+0000 7fb3d88fa700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d4154e00 con 0x7fb3d414e530 2023-11-30T17:25:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.583+0000 7fb3d359e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb3d4158570 0x7fb3d4158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.583+0000 7fb3d359e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb3d4158570 0x7fb3d4158a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60952/0 (socket says 172.21.15.49:60952) 2023-11-30T17:25:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.583+0000 7fb3d359e700 1 -- 172.21.15.49:0/1930569017 learned_addr learned my addr 172.21.15.49:0/1930569017 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.583+0000 7fb3d2d9d700 1 --2- 172.21.15.49:0/1930569017 >> v2:172.21.15.115:3300/0 conn(0x7fb3d414e530 0x7fb3d40c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.583+0000 7fb3d359e700 1 -- 172.21.15.49:0/1930569017 >> v2:172.21.15.115:3300/0 conn(0x7fb3d414e530 msgr2=0x7fb3d40c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.583+0000 7fb3d359e700 1 --2- 172.21.15.49:0/1930569017 >> v2:172.21.15.115:3300/0 conn(0x7fb3d414e530 0x7fb3d40c66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.583+0000 7fb3d359e700 1 -- 172.21.15.49:0/1930569017 >> v1:172.21.15.115:6789/0 conn(0x7fb3d4154950 legacy=0x7fb3d414e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.583+0000 7fb3d359e700 1 -- 172.21.15.49:0/1930569017 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d4155080 con 0x7fb3d4158570 2023-11-30T17:25:08.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.583+0000 7fb3d359e700 1 --2- 172.21.15.49:0/1930569017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3d4158570 0x7fb3d4158a00 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7fb3d4064450 tx=0x7fb3cc0090f0).ready entity=mon.0 client_cookie=588f81330899d32e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:08.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.583+0000 7fb3d1d9b700 1 -- 172.21.15.49:0/1930569017 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc00b5a0 con 0x7fb3d4158570 2023-11-30T17:25:08.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.583+0000 7fb3d1d9b700 1 -- 172.21.15.49:0/1930569017 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3cc00b700 con 0x7fb3d4158570 2023-11-30T17:25:08.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.583+0000 7fb3d1d9b700 1 -- 172.21.15.49:0/1930569017 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc00ba80 con 0x7fb3d4158570 2023-11-30T17:25:08.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.584+0000 7fb3d88fa700 1 -- 172.21.15.49:0/1930569017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3d4158570 msgr2=0x7fb3d4158a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:08.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.584+0000 7fb3d88fa700 1 --2- 172.21.15.49:0/1930569017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3d4158570 0x7fb3d4158a00 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7fb3d4064450 tx=0x7fb3cc0090f0).stop 2023-11-30T17:25:08.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.584+0000 7fb3d88fa700 1 -- 172.21.15.49:0/1930569017 shutdown_connections 2023-11-30T17:25:08.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.584+0000 7fb3d88fa700 1 --2- 172.21.15.49:0/1930569017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3d4158570 0x7fb3d4158a00 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:08.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.584+0000 7fb3d88fa700 1 --2- 172.21.15.49:0/1930569017 >> v2:172.21.15.115:3300/0 conn(0x7fb3d414e530 0x7fb3d40c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:08.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.584+0000 7fb3d88fa700 1 -- 172.21.15.49:0/1930569017 >> 172.21.15.49:0/1930569017 conn(0x7fb3d4064990 msgr2=0x7fb3d4064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:08.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.584+0000 7fb3d88fa700 1 -- 172.21.15.49:0/1930569017 shutdown_connections 2023-11-30T17:25:08.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.584+0000 7fb3d88fa700 1 -- 172.21.15.49:0/1930569017 wait complete. 2023-11-30T17:25:08.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.585+0000 7fb3d88fa700 1 Processor -- start 2023-11-30T17:25:08.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.585+0000 7fb3d88fa700 1 -- start start 2023-11-30T17:25:08.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.586+0000 7fb3d88fa700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3d414e530 0x7fb3d414dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:08.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.586+0000 7fb3d88fa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3d4154950 0x7fb3d40afea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:08.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.586+0000 7fb3d88fa700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3d4158570 0x7fb3d40aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:08.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.586+0000 7fb3d88fa700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d40ae820 con 0x7fb3d4154950 2023-11-30T17:25:08.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.586+0000 7fb3d88fa700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d414e1a0 con 0x7fb3d4158570 2023-11-30T17:25:08.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.586+0000 7fb3d88fa700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d40b0780 con 0x7fb3d414e530 2023-11-30T17:25:08.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.586+0000 7fb3d259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3d4154950 0x7fb3d40afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:08.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.586+0000 7fb3d259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3d4154950 0x7fb3d40afea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60960/0 (socket says 172.21.15.49:60960) 2023-11-30T17:25:08.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.586+0000 7fb3d259c700 1 -- 172.21.15.49:0/1714497344 learned_addr learned my addr 172.21.15.49:0/1714497344 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:08.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.586+0000 7fb3d359e700 1 --2- 172.21.15.49:0/1714497344 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3d4158570 0x7fb3d40aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:08.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.586+0000 7fb3d2d9d700 1 --2- 172.21.15.49:0/1714497344 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3d414e530 0x7fb3d414dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:08.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.586+0000 7fb3d259c700 1 -- 172.21.15.49:0/1714497344 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3d414e530 msgr2=0x7fb3d414dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:08.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.586+0000 7fb3d259c700 1 --2- 172.21.15.49:0/1714497344 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3d414e530 0x7fb3d414dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:08.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.586+0000 7fb3d259c700 1 -- 172.21.15.49:0/1714497344 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3d4158570 msgr2=0x7fb3d40aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:08.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.586+0000 7fb3d259c700 1 --2- 172.21.15.49:0/1714497344 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3d4158570 0x7fb3d40aecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:08.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.586+0000 7fb3d259c700 1 -- 172.21.15.49:0/1714497344 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3cc009370 con 0x7fb3d4154950 2023-11-30T17:25:08.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.587+0000 7fb3d259c700 1 --2- 172.21.15.49:0/1714497344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3d4154950 0x7fb3d40afea0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7fb3bc00c470 tx=0x7fb3bc007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:08.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.587+0000 7fb3caffd700 1 -- 172.21.15.49:0/1714497344 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc012400 con 0x7fb3d4154950 2023-11-30T17:25:08.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.587+0000 7fb3caffd700 1 -- 172.21.15.49:0/1714497344 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3bc012580 con 0x7fb3d4154950 2023-11-30T17:25:08.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.587+0000 7fb3d88fa700 1 -- 172.21.15.49:0/1714497344 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d40b0a60 con 0x7fb3d4154950 2023-11-30T17:25:08.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.587+0000 7fb3caffd700 1 -- 172.21.15.49:0/1714497344 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc012940 con 0x7fb3d4154950 2023-11-30T17:25:08.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.587+0000 7fb3d88fa700 1 -- 172.21.15.49:0/1714497344 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d40ae4b0 con 0x7fb3d4154950 2023-11-30T17:25:08.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.588+0000 7fb3d88fa700 1 -- 172.21.15.49:0/1714497344 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d40ae030 con 0x7fb3d4154950 2023-11-30T17:25:08.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.588+0000 7fb3caffd700 1 -- 172.21.15.49:0/1714497344 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb3bc01b3b0 con 0x7fb3d4154950 2023-11-30T17:25:08.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.589+0000 7fb3caffd700 1 --2- 172.21.15.49:0/1714497344 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb3b405f270 0x7fb3b4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:08.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.589+0000 7fb3caffd700 1 -- 172.21.15.49:0/1714497344 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fb3bc079970 con 0x7fb3d4154950 2023-11-30T17:25:08.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.589+0000 7fb3d2d9d700 1 --2- 172.21.15.49:0/1714497344 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb3b405f270 0x7fb3b4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:08.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.589+0000 7fb3d2d9d700 1 --2- 172.21.15.49:0/1714497344 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb3b405f270 0x7fb3b4061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fb3c4007640 tx=0x7fb3c4009850).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:08.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.593+0000 7fb3caffd700 1 -- 172.21.15.49:0/1714497344 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb3bc048b00 con 0x7fb3d4154950 2023-11-30T17:25:08.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:08.809+0000 7fb3d88fa700 1 -- 172.21.15.49:0/1714497344 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb3d40ae9d0 con 0x7fb3d4154950 2023-11-30T17:25:08.947 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-11-30T17:25:08.945+0000 7f73b0072700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-30T17:25:09.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.793+0000 7fb3caffd700 1 -- 172.21.15.49:0/1714497344 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v52) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb3d40ae9d0 con 0x7fb3d4154950 2023-11-30T17:25:09.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.796+0000 7fb3d88fa700 1 -- 172.21.15.49:0/1714497344 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb3b405f270 msgr2=0x7fb3b4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:09.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.796+0000 7fb3d88fa700 1 --2- 172.21.15.49:0/1714497344 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb3b405f270 0x7fb3b4061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fb3c4007640 tx=0x7fb3c4009850).stop 2023-11-30T17:25:09.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.796+0000 7fb3d88fa700 1 -- 172.21.15.49:0/1714497344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3d4154950 msgr2=0x7fb3d40afea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:09.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.796+0000 7fb3d88fa700 1 --2- 172.21.15.49:0/1714497344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3d4154950 0x7fb3d40afea0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7fb3bc00c470 tx=0x7fb3bc007de0).stop 2023-11-30T17:25:09.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.796+0000 7fb3d88fa700 1 -- 172.21.15.49:0/1714497344 shutdown_connections 2023-11-30T17:25:09.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.796+0000 7fb3d88fa700 1 --2- 172.21.15.49:0/1714497344 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3d4158570 0x7fb3d40aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:09.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.796+0000 7fb3d88fa700 1 --2- 172.21.15.49:0/1714497344 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3d414e530 0x7fb3d414dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:09.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.796+0000 7fb3d88fa700 1 --2- 172.21.15.49:0/1714497344 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb3b405f270 0x7fb3b4061730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:09.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.796+0000 7fb3d88fa700 1 --2- 172.21.15.49:0/1714497344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3d4154950 0x7fb3d40afea0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:09.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.796+0000 7fb3d88fa700 1 -- 172.21.15.49:0/1714497344 >> 172.21.15.49:0/1714497344 conn(0x7fb3d4064990 msgr2=0x7fb3d40c0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:09.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.796+0000 7fb3d88fa700 1 -- 172.21.15.49:0/1714497344 shutdown_connections 2023-11-30T17:25:09.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.796+0000 7fb3d88fa700 1 -- 172.21.15.49:0/1714497344 wait complete. 2023-11-30T17:25:09.813 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-30T17:25:09.814 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-30T17:25:09.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.938+0000 7f0d10827700 1 Processor -- start 2023-11-30T17:25:09.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.938+0000 7f0d10827700 1 -- start start 2023-11-30T17:25:09.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.939+0000 7f0d10827700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0d0c0c6190 0x7f0d0c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:09.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.939+0000 7f0d10827700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d0c158320 0x7f0d0c1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:09.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.939+0000 7f0d10827700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d0c158cc0 con 0x7f0d0c098d10 2023-11-30T17:25:09.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.939+0000 7f0d10827700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d0c0c72d0 con 0x7f0d0c0c6190 2023-11-30T17:25:09.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.939+0000 7f0d10827700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c064570 con 0x7f0d0c158320 2023-11-30T17:25:09.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.940+0000 7f0d09d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0d0c0c6190 0x7f0d0c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:09.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.940+0000 7f0d0ad9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d0c158320 0x7f0d0c1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:09.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.940+0000 7f0d0ad9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d0c158320 0x7f0d0c1587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:34906/0 (socket says 172.21.15.49:34906) 2023-11-30T17:25:09.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.940+0000 7f0d09d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0d0c0c6190 0x7f0d0c0c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:51190/0 (socket says 172.21.15.49:51190) 2023-11-30T17:25:09.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.940+0000 7f0d0ad9d700 1 -- 172.21.15.49:0/2328490542 learned_addr learned my addr 172.21.15.49:0/2328490542 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:09.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.940+0000 7f0d0a59c700 1 --1- 172.21.15.49:0/2328490542 >> v1:172.21.15.115:6789/0 conn(0x7f0d0c098d10 0x7f0d0c063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:49124/0 (socket says 172.21.15.49:49124) 2023-11-30T17:25:09.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.940+0000 7f0d09d9b700 1 -- 172.21.15.49:0/2328490542 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d0c158320 msgr2=0x7f0d0c1587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:09.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.940+0000 7f0d09d9b700 1 --2- 172.21.15.49:0/2328490542 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d0c158320 0x7f0d0c1587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:09.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.940+0000 7f0d09d9b700 1 -- 172.21.15.49:0/2328490542 >> v1:172.21.15.115:6789/0 conn(0x7f0d0c098d10 legacy=0x7f0d0c063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:09.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.940+0000 7f0d09d9b700 1 -- 172.21.15.49:0/2328490542 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0c154bc0 con 0x7f0d0c0c6190 2023-11-30T17:25:09.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.940+0000 7f0d0ad9d700 1 --2- 172.21.15.49:0/2328490542 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d0c158320 0x7f0d0c1587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:25:09.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.940+0000 7f0d09d9b700 1 --2- 172.21.15.49:0/2328490542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d0c0c6190 0x7f0d0c0c7760 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f0cf4009760 tx=0x7f0cf4009060).ready entity=mon.1 client_cookie=d5f2da361de0218e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:09.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.940+0000 7f0d0959a700 1 -- 172.21.15.49:0/2328490542 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf400f510 con 0x7f0d0c0c6190 2023-11-30T17:25:09.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.940+0000 7f0d0959a700 1 -- 172.21.15.49:0/2328490542 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf400f670 con 0x7f0d0c0c6190 2023-11-30T17:25:09.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.940+0000 7f0d0959a700 1 -- 172.21.15.49:0/2328490542 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf400f9f0 con 0x7f0d0c0c6190 2023-11-30T17:25:09.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.941+0000 7f0d10827700 1 -- 172.21.15.49:0/2328490542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d0c0c6190 msgr2=0x7f0d0c0c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:09.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.941+0000 7f0d10827700 1 --2- 172.21.15.49:0/2328490542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d0c0c6190 0x7f0d0c0c7760 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f0cf4009760 tx=0x7f0cf4009060).stop 2023-11-30T17:25:09.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.941+0000 7f0d10827700 1 -- 172.21.15.49:0/2328490542 shutdown_connections 2023-11-30T17:25:09.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.941+0000 7f0d10827700 1 --2- 172.21.15.49:0/2328490542 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d0c158320 0x7f0d0c1587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:09.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.941+0000 7f0d10827700 1 --2- 172.21.15.49:0/2328490542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d0c0c6190 0x7f0d0c0c7760 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:09.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.941+0000 7f0d10827700 1 -- 172.21.15.49:0/2328490542 >> 172.21.15.49:0/2328490542 conn(0x7f0d0c0cb310 msgr2=0x7f0d0c0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:09.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.941+0000 7f0d10827700 1 -- 172.21.15.49:0/2328490542 shutdown_connections 2023-11-30T17:25:09.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.941+0000 7f0d10827700 1 -- 172.21.15.49:0/2328490542 wait complete. 2023-11-30T17:25:09.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.942+0000 7f0d10827700 1 Processor -- start 2023-11-30T17:25:09.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.942+0000 7f0d10827700 1 -- start start 2023-11-30T17:25:09.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.943+0000 7f0d10827700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d0c098d10 0x7f0d0c147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:09.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.943+0000 7f0d10827700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d0c0c6190 0x7f0d0c165530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:09.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.943+0000 7f0d10827700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d0c158320 0x7f0d0c0a96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:09.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.943+0000 7f0d10827700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c0ad490 con 0x7f0d0c158320 2023-11-30T17:25:09.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.943+0000 7f0d10827700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c0aaef0 con 0x7f0d0c098d10 2023-11-30T17:25:09.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.943+0000 7f0d10827700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c1560c0 con 0x7f0d0c0c6190 2023-11-30T17:25:09.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.943+0000 7f0d0ad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d0c158320 0x7f0d0c0a96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:09.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.943+0000 7f0d0ad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d0c158320 0x7f0d0c0a96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60972/0 (socket says 172.21.15.49:60972) 2023-11-30T17:25:09.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.943+0000 7f0d0ad9d700 1 -- 172.21.15.49:0/1942053238 learned_addr learned my addr 172.21.15.49:0/1942053238 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:09.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.943+0000 7f0d09d9b700 1 --2- 172.21.15.49:0/1942053238 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d0c0c6190 0x7f0d0c165530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:09.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.943+0000 7f0d0a59c700 1 --2- 172.21.15.49:0/1942053238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d0c098d10 0x7f0d0c147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:09.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.943+0000 7f0d0ad9d700 1 -- 172.21.15.49:0/1942053238 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d0c0c6190 msgr2=0x7f0d0c165530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:09.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.943+0000 7f0d0ad9d700 1 --2- 172.21.15.49:0/1942053238 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d0c0c6190 0x7f0d0c165530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:09.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.943+0000 7f0d0ad9d700 1 -- 172.21.15.49:0/1942053238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d0c098d10 msgr2=0x7f0d0c147b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:09.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.943+0000 7f0d0ad9d700 1 --2- 172.21.15.49:0/1942053238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d0c098d10 0x7f0d0c147b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:09.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.943+0000 7f0d0ad9d700 1 -- 172.21.15.49:0/1942053238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cfc009370 con 0x7f0d0c158320 2023-11-30T17:25:09.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.944+0000 7f0d0ad9d700 1 --2- 172.21.15.49:0/1942053238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d0c158320 0x7f0d0c0a96d0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7f0cfc00e8b0 tx=0x7f0cfc0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:09.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.944+0000 7f0d027fc700 1 -- 172.21.15.49:0/1942053238 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc00c6a0 con 0x7f0d0c158320 2023-11-30T17:25:09.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.944+0000 7f0d027fc700 1 -- 172.21.15.49:0/1942053238 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cfc00c800 con 0x7f0d0c158320 2023-11-30T17:25:09.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.944+0000 7f0d10827700 1 -- 172.21.15.49:0/1942053238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf40092a0 con 0x7f0d0c158320 2023-11-30T17:25:09.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.944+0000 7f0d027fc700 1 -- 172.21.15.49:0/1942053238 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc00cba0 con 0x7f0d0c158320 2023-11-30T17:25:09.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.944+0000 7f0d10827700 1 -- 172.21.15.49:0/1942053238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d0c155260 con 0x7f0d0c158320 2023-11-30T17:25:09.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.945+0000 7f0d10827700 1 -- 172.21.15.49:0/1942053238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d0c0ab060 con 0x7f0d0c158320 2023-11-30T17:25:09.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.945+0000 7f0d027fc700 1 -- 172.21.15.49:0/1942053238 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0cfc01b400 con 0x7f0d0c158320 2023-11-30T17:25:09.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.945+0000 7f0d027fc700 1 --2- 172.21.15.49:0/1942053238 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0cec05f270 0x7f0cec061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:09.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.946+0000 7f0d027fc700 1 -- 172.21.15.49:0/1942053238 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f0cfc07a980 con 0x7f0d0c158320 2023-11-30T17:25:09.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.946+0000 7f0d0a59c700 1 --2- 172.21.15.49:0/1942053238 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0cec05f270 0x7f0cec061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:09.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.946+0000 7f0d0a59c700 1 --2- 172.21.15.49:0/1942053238 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0cec05f270 0x7f0cec061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f0d04007460 tx=0x7f0d04007f70).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:09.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:09.950+0000 7f0d027fc700 1 -- 172.21.15.49:0/1942053238 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0d0c0ab060 con 0x7f0d0c158320 2023-11-30T17:25:10.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.171+0000 7f0d10827700 1 -- 172.21.15.49:0/1942053238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0d0c0ab060 con 0x7f0d0c158320 2023-11-30T17:25:10.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.795+0000 7f0d027fc700 1 -- 172.21.15.49:0/1942053238 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v53) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0d0c0ab060 con 0x7f0d0c158320 2023-11-30T17:25:10.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.797+0000 7f0d10827700 1 -- 172.21.15.49:0/1942053238 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0cec05f270 msgr2=0x7f0cec061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:10.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.797+0000 7f0d10827700 1 --2- 172.21.15.49:0/1942053238 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0cec05f270 0x7f0cec061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f0d04007460 tx=0x7f0d04007f70).stop 2023-11-30T17:25:10.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.797+0000 7f0d10827700 1 -- 172.21.15.49:0/1942053238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d0c158320 msgr2=0x7f0d0c0a96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:10.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.797+0000 7f0d10827700 1 --2- 172.21.15.49:0/1942053238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d0c158320 0x7f0d0c0a96d0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7f0cfc00e8b0 tx=0x7f0cfc0090f0).stop 2023-11-30T17:25:10.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.797+0000 7f0d10827700 1 -- 172.21.15.49:0/1942053238 shutdown_connections 2023-11-30T17:25:10.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.797+0000 7f0d10827700 1 --2- 172.21.15.49:0/1942053238 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0cec05f270 0x7f0cec061730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:10.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.797+0000 7f0d10827700 1 --2- 172.21.15.49:0/1942053238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d0c158320 0x7f0d0c0a96d0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:10.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.797+0000 7f0d10827700 1 --2- 172.21.15.49:0/1942053238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d0c098d10 0x7f0d0c147b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:10.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.797+0000 7f0d10827700 1 --2- 172.21.15.49:0/1942053238 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d0c0c6190 0x7f0d0c165530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:10.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.797+0000 7f0d10827700 1 -- 172.21.15.49:0/1942053238 >> 172.21.15.49:0/1942053238 conn(0x7f0d0c0cb310 msgr2=0x7f0d0c152ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:10.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.797+0000 7f0d10827700 1 -- 172.21.15.49:0/1942053238 shutdown_connections 2023-11-30T17:25:10.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.797+0000 7f0d10827700 1 -- 172.21.15.49:0/1942053238 wait complete. 2023-11-30T17:25:10.813 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-30T17:25:10.813 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:25:10.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.931+0000 7fef4f1b7700 1 Processor -- start 2023-11-30T17:25:10.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.931+0000 7fef4f1b7700 1 -- start start 2023-11-30T17:25:10.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.932+0000 7fef4f1b7700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fef481544e0 0x7fef481548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:10.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.932+0000 7fef4f1b7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef480c6e30 0x7fef480c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:10.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.932+0000 7fef4f1b7700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef480c69a0 con 0x7fef4806a610 2023-11-30T17:25:10.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.932+0000 7fef4f1b7700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef480c13a0 con 0x7fef481544e0 2023-11-30T17:25:10.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.932+0000 7fef4f1b7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef480c1680 con 0x7fef480c6e30 2023-11-30T17:25:10.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.932+0000 7fef4cf53700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fef481544e0 0x7fef481548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:10.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.932+0000 7fef4cf53700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fef481544e0 0x7fef481548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59658/0 (socket says 172.21.15.49:59658) 2023-11-30T17:25:10.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.932+0000 7fef4cf53700 1 -- 172.21.15.49:0/908966520 learned_addr learned my addr 172.21.15.49:0/908966520 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:10.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.933+0000 7fef4cf53700 1 -- 172.21.15.49:0/908966520 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef480c6e30 msgr2=0x7fef480c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:10.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.933+0000 7fef4cf53700 1 --2- 172.21.15.49:0/908966520 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef480c6e30 0x7fef480c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-30T17:25:10.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.933+0000 7fef4cf53700 1 -- 172.21.15.49:0/908966520 >> v1:172.21.15.115:6789/0 conn(0x7fef4806a610 legacy=0x7fef480c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:10.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.933+0000 7fef4cf53700 1 -- 172.21.15.49:0/908966520 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef480c6630 con 0x7fef481544e0 2023-11-30T17:25:10.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.933+0000 7fef4cf53700 1 --2- 172.21.15.49:0/908966520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef481544e0 0x7fef481548c0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7fef40009810 tx=0x7fef40009060).ready entity=mon.0 client_cookie=7e173ecb57dc12e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:10.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.933+0000 7fef477fe700 1 -- 172.21.15.49:0/908966520 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef40005880 con 0x7fef481544e0 2023-11-30T17:25:10.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.933+0000 7fef477fe700 1 -- 172.21.15.49:0/908966520 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef400059e0 con 0x7fef481544e0 2023-11-30T17:25:10.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.933+0000 7fef477fe700 1 -- 172.21.15.49:0/908966520 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef40005d60 con 0x7fef481544e0 2023-11-30T17:25:10.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.933+0000 7fef4f1b7700 1 -- 172.21.15.49:0/908966520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef481544e0 msgr2=0x7fef481548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:10.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.933+0000 7fef4f1b7700 1 --2- 172.21.15.49:0/908966520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef481544e0 0x7fef481548c0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7fef40009810 tx=0x7fef40009060).stop 2023-11-30T17:25:10.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.933+0000 7fef4f1b7700 1 -- 172.21.15.49:0/908966520 shutdown_connections 2023-11-30T17:25:10.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.933+0000 7fef4f1b7700 1 --2- 172.21.15.49:0/908966520 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef480c6e30 0x7fef480c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-30T17:25:10.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.933+0000 7fef4f1b7700 1 --2- 172.21.15.49:0/908966520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef481544e0 0x7fef481548c0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:10.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.933+0000 7fef4f1b7700 1 -- 172.21.15.49:0/908966520 >> 172.21.15.49:0/908966520 conn(0x7fef48085020 msgr2=0x7fef48094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:10.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.934+0000 7fef4f1b7700 1 -- 172.21.15.49:0/908966520 shutdown_connections 2023-11-30T17:25:10.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.934+0000 7fef4f1b7700 1 -- 172.21.15.49:0/908966520 wait complete. 2023-11-30T17:25:10.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.935+0000 7fef4f1b7700 1 Processor -- start 2023-11-30T17:25:10.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.935+0000 7fef4f1b7700 1 -- start start 2023-11-30T17:25:10.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.936+0000 7fef4f1b7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef4806a610 0x7fef48096b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:10.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.936+0000 7fef4f1b7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef480c6e30 0x7fef48097050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:10.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.936+0000 7fef4f1b7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef481544e0 0x7fef48065a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:10.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.936+0000 7fef4f1b7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef48098470 con 0x7fef4806a610 2023-11-30T17:25:10.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.936+0000 7fef4f1b7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef48097860 con 0x7fef480c6e30 2023-11-30T17:25:10.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.936+0000 7fef4f1b7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef48097b40 con 0x7fef481544e0 2023-11-30T17:25:10.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.936+0000 7fef4cf53700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef4806a610 0x7fef48096b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:10.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.936+0000 7fef4cf53700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef4806a610 0x7fef48096b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59664/0 (socket says 172.21.15.49:59664) 2023-11-30T17:25:10.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.936+0000 7fef4cf53700 1 -- 172.21.15.49:0/3972831758 learned_addr learned my addr 172.21.15.49:0/3972831758 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:10.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.936+0000 7fef4cf53700 1 -- 172.21.15.49:0/3972831758 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef481544e0 msgr2=0x7fef48065a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:10.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.936+0000 7fef47fff700 1 --2- 172.21.15.49:0/3972831758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef480c6e30 0x7fef48097050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:10.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.936+0000 7fef4cf53700 1 --2- 172.21.15.49:0/3972831758 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef481544e0 0x7fef48065a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:25:10.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.936+0000 7fef4cf53700 1 -- 172.21.15.49:0/3972831758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef480c6e30 msgr2=0x7fef48097050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:10.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.936+0000 7fef4cf53700 1 --2- 172.21.15.49:0/3972831758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef480c6e30 0x7fef48097050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:10.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.936+0000 7fef4cf53700 1 -- 172.21.15.49:0/3972831758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef40009300 con 0x7fef4806a610 2023-11-30T17:25:10.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.936+0000 7fef4cf53700 1 --2- 172.21.15.49:0/3972831758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef4806a610 0x7fef48096b60 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7fef40009f60 tx=0x7fef40016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:10.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.936+0000 7fef44ff9700 1 -- 172.21.15.49:0/3972831758 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4000b810 con 0x7fef4806a610 2023-11-30T17:25:10.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.936+0000 7fef44ff9700 1 -- 172.21.15.49:0/3972831758 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4000b970 con 0x7fef4806a610 2023-11-30T17:25:10.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.936+0000 7fef4f1b7700 1 -- 172.21.15.49:0/3972831758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef48097e20 con 0x7fef4806a610 2023-11-30T17:25:10.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.936+0000 7fef44ff9700 1 -- 172.21.15.49:0/3972831758 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4000bd30 con 0x7fef4806a610 2023-11-30T17:25:10.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.936+0000 7fef4f1b7700 1 -- 172.21.15.49:0/3972831758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef48097540 con 0x7fef4806a610 2023-11-30T17:25:10.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.937+0000 7fef4f1b7700 1 -- 172.21.15.49:0/3972831758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef4806c860 con 0x7fef4806a610 2023-11-30T17:25:10.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.938+0000 7fef44ff9700 1 -- 172.21.15.49:0/3972831758 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fef40011650 con 0x7fef4806a610 2023-11-30T17:25:10.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.938+0000 7fef44ff9700 1 --2- 172.21.15.49:0/3972831758 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fef2805f270 0x7fef28061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:10.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.938+0000 7fef44ff9700 1 -- 172.21.15.49:0/3972831758 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fef4007b9e0 con 0x7fef4806a610 2023-11-30T17:25:10.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.938+0000 7fef47fff700 1 --2- 172.21.15.49:0/3972831758 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fef2805f270 0x7fef28061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:10.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.939+0000 7fef47fff700 1 --2- 172.21.15.49:0/3972831758 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fef2805f270 0x7fef28061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fef48098870 tx=0x7fef38008040).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:10.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:10.942+0000 7fef44ff9700 1 -- 172.21.15.49:0/3972831758 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fef4004cb10 con 0x7fef4806a610 2023-11-30T17:25:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.156+0000 7fef4f1b7700 1 -- 172.21.15.49:0/3972831758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef480c6250 con 0x7fef4806a610 2023-11-30T17:25:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.157+0000 7fef44ff9700 1 -- 172.21.15.49:0/3972831758 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fef40050130 con 0x7fef4806a610 2023-11-30T17:25:11.159 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:25:11.159 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":53,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/744782933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":744782933},{"type":"v1","addr":"172.21.15.115:6837","nonce":744782933}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7638,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/2409585815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2409585815},{"type":"v1","addr":"172.21.15.49:6834","nonce":2409585815}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7641,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3249829086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3249829086},{"type":"v1","addr":"172.21.15.49:6835","nonce":3249829086}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:25:07.786736+0000","modified":"2023-11-30T17:25:10.793530+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7650},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7650":{"gid":7650,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6835/3436956463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3436956463},{"type":"v1","addr":"172.21.15.115:6835","nonce":3436956463}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-11-30T17:25:11.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.159+0000 7fef4f1b7700 1 -- 172.21.15.49:0/3972831758 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fef2805f270 msgr2=0x7fef28061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:11.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.159+0000 7fef4f1b7700 1 --2- 172.21.15.49:0/3972831758 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fef2805f270 0x7fef28061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fef48098870 tx=0x7fef38008040).stop 2023-11-30T17:25:11.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.159+0000 7fef4f1b7700 1 -- 172.21.15.49:0/3972831758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef4806a610 msgr2=0x7fef48096b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.159+0000 7fef4f1b7700 1 --2- 172.21.15.49:0/3972831758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef4806a610 0x7fef48096b60 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7fef40009f60 tx=0x7fef40016000).stop 2023-11-30T17:25:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.159+0000 7fef4f1b7700 1 -- 172.21.15.49:0/3972831758 shutdown_connections 2023-11-30T17:25:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.159+0000 7fef4f1b7700 1 --2- 172.21.15.49:0/3972831758 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef481544e0 0x7fef48065a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:25:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.159+0000 7fef4f1b7700 1 --2- 172.21.15.49:0/3972831758 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fef2805f270 0x7fef28061730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.159+0000 7fef4f1b7700 1 --2- 172.21.15.49:0/3972831758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef4806a610 0x7fef48096b60 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.159+0000 7fef4f1b7700 1 --2- 172.21.15.49:0/3972831758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef480c6e30 0x7fef48097050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.159+0000 7fef4f1b7700 1 -- 172.21.15.49:0/3972831758 >> 172.21.15.49:0/3972831758 conn(0x7fef48085020 msgr2=0x7fef480637a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.159+0000 7fef4f1b7700 1 -- 172.21.15.49:0/3972831758 shutdown_connections 2023-11-30T17:25:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.159+0000 7fef4f1b7700 1 -- 172.21.15.49:0/3972831758 wait complete. 2023-11-30T17:25:11.163 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 53 2023-11-30T17:25:11.173 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:25:11.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.288+0000 7f2095c86700 1 Processor -- start 2023-11-30T17:25:11.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.288+0000 7f2095c86700 1 -- start start 2023-11-30T17:25:11.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.289+0000 7f2095c86700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f20900cae90 0x7f20900c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:11.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.289+0000 7f2095c86700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20900ca180 0x7f20900c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:11.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.289+0000 7f2095c86700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20900a9a90 con 0x7f20900caab0 2023-11-30T17:25:11.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.289+0000 7f2095c86700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20900c1490 con 0x7f20900cae90 2023-11-30T17:25:11.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.289+0000 7f2095c86700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2090154ce0 con 0x7f20900ca180 2023-11-30T17:25:11.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.289+0000 7f208f7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f20900caab0 0x7f20900aa470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46288/0 (socket says 172.21.15.49:46288) 2023-11-30T17:25:11.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.289+0000 7f208f7fe700 1 -- 172.21.15.49:0/916110985 learned_addr learned my addr 172.21.15.49:0/916110985 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:25:11.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.290+0000 7f208ffff700 1 --2- 172.21.15.49:0/916110985 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20900ca180 0x7f20900c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:11.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.290+0000 7f208effd700 1 --2- 172.21.15.49:0/916110985 >> v2:172.21.15.115:3300/0 conn(0x7f20900cae90 0x7f20900c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:11.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.290+0000 7f208e7fc700 1 -- 172.21.15.49:0/916110985 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2527318987 0 0) 0x7f20900a9a90 con 0x7f20900caab0 2023-11-30T17:25:11.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.290+0000 7f208e7fc700 1 -- 172.21.15.49:0/916110985 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20780033f0 con 0x7f20900caab0 2023-11-30T17:25:11.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.290+0000 7f208e7fc700 1 -- 172.21.15.49:0/916110985 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3781219881 0 0) 0x7f20780033f0 con 0x7f20900caab0 2023-11-30T17:25:11.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.290+0000 7f208e7fc700 1 -- 172.21.15.49:0/916110985 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20900ca180 msgr2=0x7f20900c0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:11.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.290+0000 7f208e7fc700 1 --2- 172.21.15.49:0/916110985 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20900ca180 0x7f20900c0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:11.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.290+0000 7f208e7fc700 1 -- 172.21.15.49:0/916110985 >> v2:172.21.15.115:3300/0 conn(0x7f20900cae90 msgr2=0x7f20900c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:11.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.290+0000 7f208e7fc700 1 --2- 172.21.15.49:0/916110985 >> v2:172.21.15.115:3300/0 conn(0x7f20900cae90 0x7f20900c0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:11.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.290+0000 7f208e7fc700 1 -- 172.21.15.49:0/916110985 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20900aab80 con 0x7f20900caab0 2023-11-30T17:25:11.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.290+0000 7f208e7fc700 1 -- 172.21.15.49:0/916110985 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f20800015f0 con 0x7f20900caab0 2023-11-30T17:25:11.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.290+0000 7f208e7fc700 1 -- 172.21.15.49:0/916110985 >> v1:172.21.15.49:6789/0 conn(0x7f20900caab0 legacy=0x7f20900aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:11.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.290+0000 7f208e7fc700 1 --2- 172.21.15.49:0/916110985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20780038e0 0x7f2078003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:11.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.290+0000 7f208e7fc700 1 --2- 172.21.15.49:0/916110985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2078004690 0x7f2078004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:11.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.290+0000 7f208e7fc700 1 --2- 172.21.15.49:0/916110985 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20900ca180 0x7f2078005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:11.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.290+0000 7f208e7fc700 1 -- 172.21.15.49:0/916110985 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20900c1490 con 0x7f20780038e0 2023-11-30T17:25:11.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.290+0000 7f208e7fc700 1 -- 172.21.15.49:0/916110985 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2090154ce0 con 0x7f2078004690 2023-11-30T17:25:11.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.290+0000 7f208e7fc700 1 -- 172.21.15.49:0/916110985 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f207800b8e0 con 0x7f20900ca180 2023-11-30T17:25:11.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.290+0000 7f208f7fe700 1 --2- 172.21.15.49:0/916110985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20780038e0 0x7f2078003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:11.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.290+0000 7f208effd700 1 --2- 172.21.15.49:0/916110985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2078004690 0x7f2078004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:11.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.290+0000 7f208ffff700 1 --2- 172.21.15.49:0/916110985 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20900ca180 0x7f2078005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:11.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.291+0000 7f208f7fe700 1 -- 172.21.15.49:0/916110985 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20900ca180 msgr2=0x7f2078005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:11.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.291+0000 7f208f7fe700 1 --2- 172.21.15.49:0/916110985 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20900ca180 0x7f2078005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:11.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.291+0000 7f208f7fe700 1 -- 172.21.15.49:0/916110985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2078004690 msgr2=0x7f2078004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:11.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.291+0000 7f208f7fe700 1 --2- 172.21.15.49:0/916110985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2078004690 0x7f2078004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:11.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.291+0000 7f208f7fe700 1 -- 172.21.15.49:0/916110985 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20780033f0 con 0x7f20780038e0 2023-11-30T17:25:11.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.291+0000 7f208f7fe700 1 --2- 172.21.15.49:0/916110985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20780038e0 0x7f2078003d00 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f208000c210 tx=0x7f20800077a0).ready entity=mon.0 client_cookie=bb9270c7a80dbf68 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:11.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.291+0000 7f208e7fc700 1 -- 172.21.15.49:0/916110985 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20800079d0 con 0x7f20780038e0 2023-11-30T17:25:11.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.291+0000 7f208e7fc700 1 -- 172.21.15.49:0/916110985 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208000cae0 con 0x7f20780038e0 2023-11-30T17:25:11.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.291+0000 7f208e7fc700 1 -- 172.21.15.49:0/916110985 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208000ce80 con 0x7f20780038e0 2023-11-30T17:25:11.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.291+0000 7f2095c86700 1 -- 172.21.15.49:0/916110985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20780038e0 msgr2=0x7f2078003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:11.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.291+0000 7f2095c86700 1 --2- 172.21.15.49:0/916110985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20780038e0 0x7f2078003d00 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f208000c210 tx=0x7f20800077a0).stop 2023-11-30T17:25:11.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.291+0000 7f208ffff700 1 -- 172.21.15.49:0/916110985 reap_dead start 2023-11-30T17:25:11.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.291+0000 7f2095c86700 1 -- 172.21.15.49:0/916110985 shutdown_connections 2023-11-30T17:25:11.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.291+0000 7f2095c86700 1 -- 172.21.15.49:0/916110985 >> 172.21.15.49:0/916110985 conn(0x7f2090094920 msgr2=0x7f209006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:11.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.291+0000 7f2095c86700 1 -- 172.21.15.49:0/916110985 shutdown_connections 2023-11-30T17:25:11.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.291+0000 7f2095c86700 1 -- 172.21.15.49:0/916110985 wait complete. 2023-11-30T17:25:11.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.293+0000 7f2095c86700 1 Processor -- start 2023-11-30T17:25:11.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.293+0000 7f2095c86700 1 -- start start 2023-11-30T17:25:11.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.293+0000 7f2095c86700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20780038e0 0x7f20900c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:11.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.293+0000 7f2095c86700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20901540e0 0x7f2090146830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:11.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.293+0000 7f2095c86700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20901649a0 0x7f2090164e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:11.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.293+0000 7f2095c86700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20900c2310 con 0x7f20901540e0 2023-11-30T17:25:11.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.293+0000 7f2095c86700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2090146d20 con 0x7f20901649a0 2023-11-30T17:25:11.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.293+0000 7f2095c86700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20900c9070 con 0x7f20780038e0 2023-11-30T17:25:11.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.294+0000 7f208effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20901540e0 0x7f2090146830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:11.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.294+0000 7f208effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20901540e0 0x7f2090146830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59680/0 (socket says 172.21.15.49:59680) 2023-11-30T17:25:11.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.294+0000 7f208effd700 1 -- 172.21.15.49:0/92533963 learned_addr learned my addr 172.21.15.49:0/92533963 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:11.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.294+0000 7f208f7fe700 1 --2- 172.21.15.49:0/92533963 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20780038e0 0x7f20900c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:11.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.294+0000 7f208ffff700 1 --2- 172.21.15.49:0/92533963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20901649a0 0x7f2090164e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:11.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.294+0000 7f208effd700 1 -- 172.21.15.49:0/92533963 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20780038e0 msgr2=0x7f20900c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:11.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.294+0000 7f208effd700 1 --2- 172.21.15.49:0/92533963 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20780038e0 0x7f20900c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:11.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.294+0000 7f208effd700 1 -- 172.21.15.49:0/92533963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20901649a0 msgr2=0x7f2090164e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:11.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.294+0000 7f208effd700 1 --2- 172.21.15.49:0/92533963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20901649a0 0x7f2090164e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:11.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.294+0000 7f208effd700 1 -- 172.21.15.49:0/92533963 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20900c2560 con 0x7f20901540e0 2023-11-30T17:25:11.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.294+0000 7f208effd700 1 --2- 172.21.15.49:0/92533963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20901540e0 0x7f2090146830 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f20840119f0 tx=0x7f2084009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:11.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.294+0000 7f20777fe700 1 -- 172.21.15.49:0/92533963 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208400f8c0 con 0x7f20901540e0 2023-11-30T17:25:11.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.294+0000 7f20777fe700 1 -- 172.21.15.49:0/92533963 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208400fa20 con 0x7f20901540e0 2023-11-30T17:25:11.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.294+0000 7f2095c86700 1 -- 172.21.15.49:0/92533963 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20900c2840 con 0x7f20901540e0 2023-11-30T17:25:11.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.294+0000 7f20777fe700 1 -- 172.21.15.49:0/92533963 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208400fda0 con 0x7f20901540e0 2023-11-30T17:25:11.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.294+0000 7f2095c86700 1 -- 172.21.15.49:0/92533963 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2090154560 con 0x7f20901540e0 2023-11-30T17:25:11.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.295+0000 7f2095c86700 1 -- 172.21.15.49:0/92533963 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20900c2e90 con 0x7f20901540e0 2023-11-30T17:25:11.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.296+0000 7f20777fe700 1 -- 172.21.15.49:0/92533963 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f2084014650 con 0x7f20901540e0 2023-11-30T17:25:11.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.296+0000 7f20777fe700 1 --2- 172.21.15.49:0/92533963 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f207c05f240 0x7f207c061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:11.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.296+0000 7f20777fe700 1 -- 172.21.15.49:0/92533963 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f208407af10 con 0x7f20901540e0 2023-11-30T17:25:11.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.296+0000 7f208f7fe700 1 --2- 172.21.15.49:0/92533963 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f207c05f240 0x7f207c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:11.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.297+0000 7f208f7fe700 1 --2- 172.21.15.49:0/92533963 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f207c05f240 0x7f207c061700 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f2080000ef0 tx=0x7f2080013000).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:11.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.300+0000 7f20777fe700 1 -- 172.21.15.49:0/92533963 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f208404c040 con 0x7f20901540e0 2023-11-30T17:25:11.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.472+0000 7f2095c86700 1 -- 172.21.15.49:0/92533963 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f209006c860 con 0x7f20901540e0 2023-11-30T17:25:11.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.473+0000 7f20777fe700 1 -- 172.21.15.49:0/92533963 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+16986 (secure 0 0 0) 0x7f208404f660 con 0x7f20901540e0 2023-11-30T17:25:11.476 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:25:11.476 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":130,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:25:08.788323+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:25:06.343377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-11-30T17:25:06.764214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:25:11.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.475+0000 7f2095c86700 1 -- 172.21.15.49:0/92533963 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f207c05f240 msgr2=0x7f207c061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:11.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.475+0000 7f2095c86700 1 --2- 172.21.15.49:0/92533963 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f207c05f240 0x7f207c061700 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f2080000ef0 tx=0x7f2080013000).stop 2023-11-30T17:25:11.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.475+0000 7f2095c86700 1 -- 172.21.15.49:0/92533963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20901540e0 msgr2=0x7f2090146830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:11.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.475+0000 7f2095c86700 1 --2- 172.21.15.49:0/92533963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20901540e0 0x7f2090146830 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f20840119f0 tx=0x7f2084009060).stop 2023-11-30T17:25:11.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.475+0000 7f2095c86700 1 -- 172.21.15.49:0/92533963 shutdown_connections 2023-11-30T17:25:11.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.475+0000 7f2095c86700 1 --2- 172.21.15.49:0/92533963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20901649a0 0x7f2090164e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:11.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.475+0000 7f2095c86700 1 --2- 172.21.15.49:0/92533963 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20780038e0 0x7f20900c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:11.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.475+0000 7f2095c86700 1 --2- 172.21.15.49:0/92533963 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f207c05f240 0x7f207c061700 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:11.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.475+0000 7f2095c86700 1 --2- 172.21.15.49:0/92533963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20901540e0 0x7f2090146830 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:11.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.475+0000 7f2095c86700 1 -- 172.21.15.49:0/92533963 >> 172.21.15.49:0/92533963 conn(0x7f2090094920 msgr2=0x7f20900ab7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:11.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.475+0000 7f2095c86700 1 -- 172.21.15.49:0/92533963 shutdown_connections 2023-11-30T17:25:11.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.476+0000 7f2095c86700 1 -- 172.21.15.49:0/92533963 wait complete. 2023-11-30T17:25:11.490 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-30T17:25:11.491 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:25:11.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.606+0000 7fe9917f1700 1 Processor -- start 2023-11-30T17:25:11.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.606+0000 7fe9917f1700 1 -- start start 2023-11-30T17:25:11.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.607+0000 7fe9917f1700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe98c1544e0 0x7fe98c1548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:11.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.607+0000 7fe9917f1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe98c06a610 0x7fe98c0c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:11.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.607+0000 7fe9917f1700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe98c0c69a0 con 0x7fe98c0c6e30 2023-11-30T17:25:11.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.607+0000 7fe9917f1700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe98c0c13a0 con 0x7fe98c1544e0 2023-11-30T17:25:11.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.607+0000 7fe9917f1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c0c1680 con 0x7fe98c06a610 2023-11-30T17:25:11.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.607+0000 7fe98a7fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe98c06a610 0x7fe98c0c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:11.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.607+0000 7fe98affd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe98c1544e0 0x7fe98c1548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:11.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.607+0000 7fe98a7fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe98c06a610 0x7fe98c0c0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:49966/0 (socket says 172.21.15.49:49966) 2023-11-30T17:25:11.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.607+0000 7fe98a7fc700 1 -- 172.21.15.49:0/2131418242 learned_addr learned my addr 172.21.15.49:0/2131418242 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:11.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.607+0000 7fe98affd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe98c1544e0 0x7fe98c1548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:45550/0 (socket says 172.21.15.49:45550) 2023-11-30T17:25:11.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.608+0000 7fe98a7fc700 1 -- 172.21.15.49:0/2131418242 >> v2:172.21.15.115:3300/0 conn(0x7fe98c1544e0 msgr2=0x7fe98c1548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:11.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.608+0000 7fe98a7fc700 1 --2- 172.21.15.49:0/2131418242 >> v2:172.21.15.115:3300/0 conn(0x7fe98c1544e0 0x7fe98c1548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:11.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.608+0000 7fe98a7fc700 1 -- 172.21.15.49:0/2131418242 >> v1:172.21.15.115:6789/0 conn(0x7fe98c0c6e30 legacy=0x7fe98c0a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:11.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.608+0000 7fe98a7fc700 1 -- 172.21.15.49:0/2131418242 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98c0c6630 con 0x7fe98c06a610 2023-11-30T17:25:11.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.608+0000 7fe98a7fc700 1 --2- 172.21.15.49:0/2131418242 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe98c06a610 0x7fe98c0c0bc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fe974006fd0 tx=0x7fe9740090f0).ready entity=mon.2 client_cookie=8234f452bc572873 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:11.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.608+0000 7fe989ffb700 1 -- 172.21.15.49:0/2131418242 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97400b580 con 0x7fe98c06a610 2023-11-30T17:25:11.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.608+0000 7fe989ffb700 1 -- 172.21.15.49:0/2131418242 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97400b6e0 con 0x7fe98c06a610 2023-11-30T17:25:11.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.608+0000 7fe989ffb700 1 -- 172.21.15.49:0/2131418242 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97400ba60 con 0x7fe98c06a610 2023-11-30T17:25:11.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.608+0000 7fe9917f1700 1 -- 172.21.15.49:0/2131418242 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe98c06a610 msgr2=0x7fe98c0c0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:11.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.608+0000 7fe9917f1700 1 --2- 172.21.15.49:0/2131418242 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe98c06a610 0x7fe98c0c0bc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fe974006fd0 tx=0x7fe9740090f0).stop 2023-11-30T17:25:11.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.609+0000 7fe9917f1700 1 -- 172.21.15.49:0/2131418242 shutdown_connections 2023-11-30T17:25:11.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.609+0000 7fe9917f1700 1 --2- 172.21.15.49:0/2131418242 >> v2:172.21.15.115:3300/0 conn(0x7fe98c1544e0 0x7fe98c1548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:11.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.609+0000 7fe9917f1700 1 --2- 172.21.15.49:0/2131418242 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe98c06a610 0x7fe98c0c0bc0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:11.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.609+0000 7fe9917f1700 1 -- 172.21.15.49:0/2131418242 >> 172.21.15.49:0/2131418242 conn(0x7fe98c085020 msgr2=0x7fe98c094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:11.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.609+0000 7fe9917f1700 1 -- 172.21.15.49:0/2131418242 shutdown_connections 2023-11-30T17:25:11.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.609+0000 7fe9917f1700 1 -- 172.21.15.49:0/2131418242 wait complete. 2023-11-30T17:25:11.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.610+0000 7fe9917f1700 1 Processor -- start 2023-11-30T17:25:11.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.610+0000 7fe9917f1700 1 -- start start 2023-11-30T17:25:11.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.611+0000 7fe9917f1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe98c06a610 0x7fe98c167ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:11.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.611+0000 7fe9917f1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe98c0c6e30 0x7fe98c0980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:11.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.611+0000 7fe9917f1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe98c1544e0 0x7fe98c0955f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:11.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.611+0000 7fe9917f1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c1681d0 con 0x7fe98c0c6e30 2023-11-30T17:25:11.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.611+0000 7fe9917f1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c165ad0 con 0x7fe98c1544e0 2023-11-30T17:25:11.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.611+0000 7fe9917f1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c1651a0 con 0x7fe98c06a610 2023-11-30T17:25:11.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.611+0000 7fe98a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe98c0c6e30 0x7fe98c0980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:11.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.611+0000 7fe98a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe98c0c6e30 0x7fe98c0980b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59690/0 (socket says 172.21.15.49:59690) 2023-11-30T17:25:11.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.611+0000 7fe98a7fc700 1 -- 172.21.15.49:0/1933394122 learned_addr learned my addr 172.21.15.49:0/1933394122 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:11.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.611+0000 7fe98b7fe700 1 --2- 172.21.15.49:0/1933394122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe98c1544e0 0x7fe98c0955f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:11.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.611+0000 7fe98affd700 1 --2- 172.21.15.49:0/1933394122 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe98c06a610 0x7fe98c167ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:11.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.611+0000 7fe98a7fc700 1 -- 172.21.15.49:0/1933394122 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe98c06a610 msgr2=0x7fe98c167ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:11.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.611+0000 7fe98a7fc700 1 --2- 172.21.15.49:0/1933394122 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe98c06a610 0x7fe98c167ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:11.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.611+0000 7fe98a7fc700 1 -- 172.21.15.49:0/1933394122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe98c1544e0 msgr2=0x7fe98c0955f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:11.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.611+0000 7fe98a7fc700 1 --2- 172.21.15.49:0/1933394122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe98c1544e0 0x7fe98c0955f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:11.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.611+0000 7fe98a7fc700 1 -- 172.21.15.49:0/1933394122 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe974009370 con 0x7fe98c0c6e30 2023-11-30T17:25:11.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.611+0000 7fe98a7fc700 1 --2- 172.21.15.49:0/1933394122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe98c0c6e30 0x7fe98c0980b0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7fe98c0c17c0 tx=0x7fe974017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:11.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.611+0000 7fe982ffd700 1 -- 172.21.15.49:0/1933394122 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe974000bc0 con 0x7fe98c0c6e30 2023-11-30T17:25:11.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.611+0000 7fe982ffd700 1 -- 172.21.15.49:0/1933394122 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97400b850 con 0x7fe98c0c6e30 2023-11-30T17:25:11.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.611+0000 7fe9917f1700 1 -- 172.21.15.49:0/1933394122 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe98c165480 con 0x7fe98c0c6e30 2023-11-30T17:25:11.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.611+0000 7fe982ffd700 1 -- 172.21.15.49:0/1933394122 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe974000d20 con 0x7fe98c0c6e30 2023-11-30T17:25:11.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.611+0000 7fe9917f1700 1 -- 172.21.15.49:0/1933394122 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe98c164e00 con 0x7fe98c0c6e30 2023-11-30T17:25:11.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.612+0000 7fe9917f1700 1 -- 172.21.15.49:0/1933394122 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe98c165c40 con 0x7fe98c0c6e30 2023-11-30T17:25:11.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.613+0000 7fe982ffd700 1 -- 172.21.15.49:0/1933394122 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe97401ba80 con 0x7fe98c0c6e30 2023-11-30T17:25:11.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.613+0000 7fe982ffd700 1 --2- 172.21.15.49:0/1933394122 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe96c05f270 0x7fe96c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:11.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.613+0000 7fe982ffd700 1 -- 172.21.15.49:0/1933394122 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fe97407be30 con 0x7fe98c0c6e30 2023-11-30T17:25:11.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.613+0000 7fe98affd700 1 --2- 172.21.15.49:0/1933394122 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe96c05f270 0x7fe96c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:11.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.614+0000 7fe98affd700 1 --2- 172.21.15.49:0/1933394122 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe96c05f270 0x7fe96c061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fe98400f5b0 tx=0x7fe98400b040).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:11.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.617+0000 7fe982ffd700 1 -- 172.21.15.49:0/1933394122 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe97404cf00 con 0x7fe98c0c6e30 2023-11-30T17:25:11.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.784+0000 7fe9917f1700 1 -- 172.21.15.49:0/1933394122 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe98c0c10b0 con 0x7fe96c05f270 2023-11-30T17:25:11.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.795+0000 7fe982ffd700 1 -- 172.21.15.49:0/1933394122 <== mgr.6428 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361864 (secure 0 0 0) 0x7fe98c0c10b0 con 0x7fe96c05f270 2023-11-30T17:25:11.802 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:25:11.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.798+0000 7fe9917f1700 1 -- 172.21.15.49:0/1933394122 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe96c05f270 msgr2=0x7fe96c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:11.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.798+0000 7fe9917f1700 1 --2- 172.21.15.49:0/1933394122 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe96c05f270 0x7fe96c061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fe98400f5b0 tx=0x7fe98400b040).stop 2023-11-30T17:25:11.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.798+0000 7fe9917f1700 1 -- 172.21.15.49:0/1933394122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe98c0c6e30 msgr2=0x7fe98c0980b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:11.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.798+0000 7fe9917f1700 1 --2- 172.21.15.49:0/1933394122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe98c0c6e30 0x7fe98c0980b0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7fe98c0c17c0 tx=0x7fe974017000).stop 2023-11-30T17:25:11.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.798+0000 7fe9917f1700 1 -- 172.21.15.49:0/1933394122 shutdown_connections 2023-11-30T17:25:11.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.798+0000 7fe9917f1700 1 --2- 172.21.15.49:0/1933394122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe98c1544e0 0x7fe98c0955f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:11.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.798+0000 7fe9917f1700 1 --2- 172.21.15.49:0/1933394122 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe98c06a610 0x7fe98c167ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:11.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.798+0000 7fe9917f1700 1 --2- 172.21.15.49:0/1933394122 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe96c05f270 0x7fe96c061730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:11.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.798+0000 7fe9917f1700 1 --2- 172.21.15.49:0/1933394122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe98c0c6e30 0x7fe98c0980b0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:11.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.798+0000 7fe9917f1700 1 -- 172.21.15.49:0/1933394122 >> 172.21.15.49:0/1933394122 conn(0x7fe98c085020 msgr2=0x7fe98c0c95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:11.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.798+0000 7fe9917f1700 1 -- 172.21.15.49:0/1933394122 shutdown_connections 2023-11-30T17:25:11.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.798+0000 7fe9917f1700 1 -- 172.21.15.49:0/1933394122 wait complete. 2023-11-30T17:25:11.807 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:25:11.814 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-30T17:25:11.300325+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":223,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2434432,"kb_used_data":12608,"kb_used_omap":0,"kb_used_meta":2421760,"kb_avail":752540288,"statfs":{"total":773094113280,"available":770601254912,"internally_reserved":0,"allocated":12910592,"data_stored":6494060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2479882240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6812,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-61,"num_write_kb":-29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.002398"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.815575+0000","last_change":"2023-11-30T17:25:07.814893+0000","last_active":"2023-11-30T17:25:07.815575+0000","last_peered":"2023-11-30T17:25:07.815575+0000","last_clean":"2023-11-30T17:25:07.815575+0000","last_became_active":"2023-11-30T17:25:07.814694+0000","last_became_peered":"2023-11-30T17:25:07.814694+0000","last_unstale":"2023-11-30T17:25:07.815575+0000","last_undegraded":"2023-11-30T17:25:07.815575+0000","last_fullsized":"2023-11-30T17:25:07.815575+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3f","version":"129'3","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.815794+0000","last_change":"2023-11-30T17:25:07.428000+0000","last_active":"2023-11-30T17:25:07.815794+0000","last_peered":"2023-11-30T17:25:07.815794+0000","last_clean":"2023-11-30T17:25:07.815794+0000","last_became_active":"2023-11-30T17:25:07.427300+0000","last_became_peered":"2023-11-30T17:25:07.427300+0000","last_unstale":"2023-11-30T17:25:07.815794+0000","last_undegraded":"2023-11-30T17:25:07.815794+0000","last_fullsized":"2023-11-30T17:25:07.815794+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.809737+0000","last_change":"2023-11-30T17:25:07.806193+0000","last_active":"2023-11-30T17:25:07.809737+0000","last_peered":"2023-11-30T17:25:07.809737+0000","last_clean":"2023-11-30T17:25:07.809737+0000","last_became_active":"2023-11-30T17:25:07.804328+0000","last_became_peered":"2023-11-30T17:25:07.804328+0000","last_unstale":"2023-11-30T17:25:07.809737+0000","last_undegraded":"2023-11-30T17:25:07.809737+0000","last_fullsized":"2023-11-30T17:25:07.809737+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.793523+0000","last_change":"2023-11-30T17:25:07.431978+0000","last_active":"2023-11-30T17:25:07.793523+0000","last_peered":"2023-11-30T17:25:07.793523+0000","last_clean":"2023-11-30T17:25:07.793523+0000","last_became_active":"2023-11-30T17:25:07.431698+0000","last_became_peered":"2023-11-30T17:25:07.431698+0000","last_unstale":"2023-11-30T17:25:07.793523+0000","last_undegraded":"2023-11-30T17:25:07.793523+0000","last_fullsized":"2023-11-30T17:25:07.793523+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.819829+0000","last_change":"2023-11-30T17:25:07.812003+0000","last_active":"2023-11-30T17:25:07.819829+0000","last_peered":"2023-11-30T17:25:07.819829+0000","last_clean":"2023-11-30T17:25:07.819829+0000","last_became_active":"2023-11-30T17:25:07.811696+0000","last_became_peered":"2023-11-30T17:25:07.811696+0000","last_unstale":"2023-11-30T17:25:07.819829+0000","last_undegraded":"2023-11-30T17:25:07.819829+0000","last_fullsized":"2023-11-30T17:25:07.819829+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.794288+0000","last_change":"2023-11-30T17:25:07.423616+0000","last_active":"2023-11-30T17:25:07.794288+0000","last_peered":"2023-11-30T17:25:07.794288+0000","last_clean":"2023-11-30T17:25:07.794288+0000","last_became_active":"2023-11-30T17:25:07.423233+0000","last_became_peered":"2023-11-30T17:25:07.423233+0000","last_unstale":"2023-11-30T17:25:07.794288+0000","last_undegraded":"2023-11-30T17:25:07.794288+0000","last_fullsized":"2023-11-30T17:25:07.794288+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.805038+0000","last_change":"2023-11-30T17:25:07.802388+0000","last_active":"2023-11-30T17:25:07.805038+0000","last_peered":"2023-11-30T17:25:07.805038+0000","last_clean":"2023-11-30T17:25:07.805038+0000","last_became_active":"2023-11-30T17:25:07.802064+0000","last_became_peered":"2023-11-30T17:25:07.802064+0000","last_unstale":"2023-11-30T17:25:07.805038+0000","last_undegraded":"2023-11-30T17:25:07.805038+0000","last_fullsized":"2023-11-30T17:25:07.805038+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3c","version":"129'2","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.813645+0000","last_change":"2023-11-30T17:25:07.428517+0000","last_active":"2023-11-30T17:25:07.813645+0000","last_peered":"2023-11-30T17:25:07.813645+0000","last_clean":"2023-11-30T17:25:07.813645+0000","last_became_active":"2023-11-30T17:25:07.428217+0000","last_became_peered":"2023-11-30T17:25:07.428217+0000","last_unstale":"2023-11-30T17:25:07.813645+0000","last_undegraded":"2023-11-30T17:25:07.813645+0000","last_fullsized":"2023-11-30T17:25:07.813645+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.817328+0000","last_change":"2023-11-30T17:25:07.809062+0000","last_active":"2023-11-30T17:25:07.817328+0000","last_peered":"2023-11-30T17:25:07.817328+0000","last_clean":"2023-11-30T17:25:07.817328+0000","last_became_active":"2023-11-30T17:25:07.808788+0000","last_became_peered":"2023-11-30T17:25:07.808788+0000","last_unstale":"2023-11-30T17:25:07.817328+0000","last_undegraded":"2023-11-30T17:25:07.817328+0000","last_fullsized":"2023-11-30T17:25:07.817328+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.811110+0000","last_change":"2023-11-30T17:25:07.415843+0000","last_active":"2023-11-30T17:25:07.811110+0000","last_peered":"2023-11-30T17:25:07.811110+0000","last_clean":"2023-11-30T17:25:07.811110+0000","last_became_active":"2023-11-30T17:25:07.415507+0000","last_became_peered":"2023-11-30T17:25:07.415507+0000","last_unstale":"2023-11-30T17:25:07.811110+0000","last_undegraded":"2023-11-30T17:25:07.811110+0000","last_fullsized":"2023-11-30T17:25:07.811110+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.807866+0000","last_change":"2023-11-30T17:25:07.803190+0000","last_active":"2023-11-30T17:25:07.807866+0000","last_peered":"2023-11-30T17:25:07.807866+0000","last_clean":"2023-11-30T17:25:07.807866+0000","last_became_active":"2023-11-30T17:25:07.802966+0000","last_became_peered":"2023-11-30T17:25:07.802966+0000","last_unstale":"2023-11-30T17:25:07.807866+0000","last_undegraded":"2023-11-30T17:25:07.807866+0000","last_fullsized":"2023-11-30T17:25:07.807866+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3a","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.809538+0000","last_change":"2023-11-30T17:25:07.424422+0000","last_active":"2023-11-30T17:25:07.809538+0000","last_peered":"2023-11-30T17:25:07.809538+0000","last_clean":"2023-11-30T17:25:07.809538+0000","last_became_active":"2023-11-30T17:25:07.424026+0000","last_became_peered":"2023-11-30T17:25:07.424026+0000","last_unstale":"2023-11-30T17:25:07.809538+0000","last_undegraded":"2023-11-30T17:25:07.809538+0000","last_fullsized":"2023-11-30T17:25:07.809538+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.819704+0000","last_change":"2023-11-30T17:25:07.810895+0000","last_active":"2023-11-30T17:25:07.819704+0000","last_peered":"2023-11-30T17:25:07.819704+0000","last_clean":"2023-11-30T17:25:07.819704+0000","last_became_active":"2023-11-30T17:25:07.810586+0000","last_became_peered":"2023-11-30T17:25:07.810586+0000","last_unstale":"2023-11-30T17:25:07.819704+0000","last_undegraded":"2023-11-30T17:25:07.819704+0000","last_fullsized":"2023-11-30T17:25:07.819704+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.802374+0000","last_change":"2023-11-30T17:25:07.424353+0000","last_active":"2023-11-30T17:25:07.802374+0000","last_peered":"2023-11-30T17:25:07.802374+0000","last_clean":"2023-11-30T17:25:07.802374+0000","last_became_active":"2023-11-30T17:25:07.424062+0000","last_became_peered":"2023-11-30T17:25:07.424062+0000","last_unstale":"2023-11-30T17:25:07.802374+0000","last_undegraded":"2023-11-30T17:25:07.802374+0000","last_fullsized":"2023-11-30T17:25:07.802374+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.819905+0000","last_change":"2023-11-30T17:25:07.815786+0000","last_active":"2023-11-30T17:25:07.819905+0000","last_peered":"2023-11-30T17:25:07.819905+0000","last_clean":"2023-11-30T17:25:07.819905+0000","last_became_active":"2023-11-30T17:25:07.812404+0000","last_became_peered":"2023-11-30T17:25:07.812404+0000","last_unstale":"2023-11-30T17:25:07.819905+0000","last_undegraded":"2023-11-30T17:25:07.819905+0000","last_fullsized":"2023-11-30T17:25:07.819905+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.795344+0000","last_change":"2023-11-30T17:25:07.425636+0000","last_active":"2023-11-30T17:25:07.795344+0000","last_peered":"2023-11-30T17:25:07.795344+0000","last_clean":"2023-11-30T17:25:07.795344+0000","last_became_active":"2023-11-30T17:25:07.425277+0000","last_became_peered":"2023-11-30T17:25:07.425277+0000","last_unstale":"2023-11-30T17:25:07.795344+0000","last_undegraded":"2023-11-30T17:25:07.795344+0000","last_fullsized":"2023-11-30T17:25:07.795344+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.807639+0000","last_change":"2023-11-30T17:25:07.801922+0000","last_active":"2023-11-30T17:25:07.807639+0000","last_peered":"2023-11-30T17:25:07.807639+0000","last_clean":"2023-11-30T17:25:07.807639+0000","last_became_active":"2023-11-30T17:25:07.801658+0000","last_became_peered":"2023-11-30T17:25:07.801658+0000","last_unstale":"2023-11-30T17:25:07.807639+0000","last_undegraded":"2023-11-30T17:25:07.807639+0000","last_fullsized":"2023-11-30T17:25:07.807639+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.798812+0000","last_change":"2023-11-30T17:25:07.426440+0000","last_active":"2023-11-30T17:25:07.798812+0000","last_peered":"2023-11-30T17:25:07.798812+0000","last_clean":"2023-11-30T17:25:07.798812+0000","last_became_active":"2023-11-30T17:25:07.426095+0000","last_became_peered":"2023-11-30T17:25:07.426095+0000","last_unstale":"2023-11-30T17:25:07.798812+0000","last_undegraded":"2023-11-30T17:25:07.798812+0000","last_fullsized":"2023-11-30T17:25:07.798812+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.812570+0000","last_change":"2023-11-30T17:25:07.807013+0000","last_active":"2023-11-30T17:25:07.812570+0000","last_peered":"2023-11-30T17:25:07.812570+0000","last_clean":"2023-11-30T17:25:07.812570+0000","last_became_active":"2023-11-30T17:25:07.806754+0000","last_became_peered":"2023-11-30T17:25:07.806754+0000","last_unstale":"2023-11-30T17:25:07.812570+0000","last_undegraded":"2023-11-30T17:25:07.812570+0000","last_fullsized":"2023-11-30T17:25:07.812570+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.794400+0000","last_change":"2023-11-30T17:25:07.419865+0000","last_active":"2023-11-30T17:25:07.794400+0000","last_peered":"2023-11-30T17:25:07.794400+0000","last_clean":"2023-11-30T17:25:07.794400+0000","last_became_active":"2023-11-30T17:25:07.419584+0000","last_became_peered":"2023-11-30T17:25:07.419584+0000","last_unstale":"2023-11-30T17:25:07.794400+0000","last_undegraded":"2023-11-30T17:25:07.794400+0000","last_fullsized":"2023-11-30T17:25:07.794400+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.809225+0000","last_change":"2023-11-30T17:25:07.807151+0000","last_active":"2023-11-30T17:25:07.809225+0000","last_peered":"2023-11-30T17:25:07.809225+0000","last_clean":"2023-11-30T17:25:07.809225+0000","last_became_active":"2023-11-30T17:25:07.806108+0000","last_became_peered":"2023-11-30T17:25:07.806108+0000","last_unstale":"2023-11-30T17:25:07.809225+0000","last_undegraded":"2023-11-30T17:25:07.809225+0000","last_fullsized":"2023-11-30T17:25:07.809225+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.804298+0000","last_change":"2023-11-30T17:25:07.428275+0000","last_active":"2023-11-30T17:25:07.804298+0000","last_peered":"2023-11-30T17:25:07.804298+0000","last_clean":"2023-11-30T17:25:07.804298+0000","last_became_active":"2023-11-30T17:25:07.427835+0000","last_became_peered":"2023-11-30T17:25:07.427835+0000","last_unstale":"2023-11-30T17:25:07.804298+0000","last_undegraded":"2023-11-30T17:25:07.804298+0000","last_fullsized":"2023-11-30T17:25:07.804298+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.813089+0000","last_change":"2023-11-30T17:25:07.808434+0000","last_active":"2023-11-30T17:25:07.813089+0000","last_peered":"2023-11-30T17:25:07.813089+0000","last_clean":"2023-11-30T17:25:07.813089+0000","last_became_active":"2023-11-30T17:25:07.808167+0000","last_became_peered":"2023-11-30T17:25:07.808167+0000","last_unstale":"2023-11-30T17:25:07.813089+0000","last_undegraded":"2023-11-30T17:25:07.813089+0000","last_fullsized":"2023-11-30T17:25:07.813089+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"129'4","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.820012+0000","last_change":"2023-11-30T17:25:07.428729+0000","last_active":"2023-11-30T17:25:07.820012+0000","last_peered":"2023-11-30T17:25:07.820012+0000","last_clean":"2023-11-30T17:25:07.820012+0000","last_became_active":"2023-11-30T17:25:07.427195+0000","last_became_peered":"2023-11-30T17:25:07.427195+0000","last_unstale":"2023-11-30T17:25:07.820012+0000","last_undegraded":"2023-11-30T17:25:07.820012+0000","last_fullsized":"2023-11-30T17:25:07.820012+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.819747+0000","last_change":"2023-11-30T17:25:07.811286+0000","last_active":"2023-11-30T17:25:07.819747+0000","last_peered":"2023-11-30T17:25:07.819747+0000","last_clean":"2023-11-30T17:25:07.819747+0000","last_became_active":"2023-11-30T17:25:07.811006+0000","last_became_peered":"2023-11-30T17:25:07.811006+0000","last_unstale":"2023-11-30T17:25:07.819747+0000","last_undegraded":"2023-11-30T17:25:07.819747+0000","last_fullsized":"2023-11-30T17:25:07.819747+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.813587+0000","last_change":"2023-11-30T17:25:07.427219+0000","last_active":"2023-11-30T17:25:07.813587+0000","last_peered":"2023-11-30T17:25:07.813587+0000","last_clean":"2023-11-30T17:25:07.813587+0000","last_became_active":"2023-11-30T17:25:07.426932+0000","last_became_peered":"2023-11-30T17:25:07.426932+0000","last_unstale":"2023-11-30T17:25:07.813587+0000","last_undegraded":"2023-11-30T17:25:07.813587+0000","last_fullsized":"2023-11-30T17:25:07.813587+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.815366+0000","last_change":"2023-11-30T17:25:07.814004+0000","last_active":"2023-11-30T17:25:07.815366+0000","last_peered":"2023-11-30T17:25:07.815366+0000","last_clean":"2023-11-30T17:25:07.815366+0000","last_became_active":"2023-11-30T17:25:07.813651+0000","last_became_peered":"2023-11-30T17:25:07.813651+0000","last_unstale":"2023-11-30T17:25:07.815366+0000","last_undegraded":"2023-11-30T17:25:07.815366+0000","last_fullsized":"2023-11-30T17:25:07.815366+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.790553+0000","last_change":"2023-11-30T17:25:07.423987+0000","last_active":"2023-11-30T17:25:07.790553+0000","last_peered":"2023-11-30T17:25:07.790553+0000","last_clean":"2023-11-30T17:25:07.790553+0000","last_became_active":"2023-11-30T17:25:07.423686+0000","last_became_peered":"2023-11-30T17:25:07.423686+0000","last_unstale":"2023-11-30T17:25:07.790553+0000","last_undegraded":"2023-11-30T17:25:07.790553+0000","last_fullsized":"2023-11-30T17:25:07.790553+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.817356+0000","last_change":"2023-11-30T17:25:07.810664+0000","last_active":"2023-11-30T17:25:07.817356+0000","last_peered":"2023-11-30T17:25:07.817356+0000","last_clean":"2023-11-30T17:25:07.817356+0000","last_became_active":"2023-11-30T17:25:07.809654+0000","last_became_peered":"2023-11-30T17:25:07.809654+0000","last_unstale":"2023-11-30T17:25:07.817356+0000","last_undegraded":"2023-11-30T17:25:07.817356+0000","last_fullsized":"2023-11-30T17:25:07.817356+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.803070+0000","last_change":"2023-11-30T17:25:07.420140+0000","last_active":"2023-11-30T17:25:07.803070+0000","last_peered":"2023-11-30T17:25:07.803070+0000","last_clean":"2023-11-30T17:25:07.803070+0000","last_became_active":"2023-11-30T17:25:07.419808+0000","last_became_peered":"2023-11-30T17:25:07.419808+0000","last_unstale":"2023-11-30T17:25:07.803070+0000","last_undegraded":"2023-11-30T17:25:07.803070+0000","last_fullsized":"2023-11-30T17:25:07.803070+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.815436+0000","last_change":"2023-11-30T17:25:07.814366+0000","last_active":"2023-11-30T17:25:07.815436+0000","last_peered":"2023-11-30T17:25:07.815436+0000","last_clean":"2023-11-30T17:25:07.815436+0000","last_became_active":"2023-11-30T17:25:07.814079+0000","last_became_peered":"2023-11-30T17:25:07.814079+0000","last_unstale":"2023-11-30T17:25:07.815436+0000","last_undegraded":"2023-11-30T17:25:07.815436+0000","last_fullsized":"2023-11-30T17:25:07.815436+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.30","version":"129'4","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.815218+0000","last_change":"2023-11-30T17:25:07.426844+0000","last_active":"2023-11-30T17:25:07.815218+0000","last_peered":"2023-11-30T17:25:07.815218+0000","last_clean":"2023-11-30T17:25:07.815218+0000","last_became_active":"2023-11-30T17:25:07.426534+0000","last_became_peered":"2023-11-30T17:25:07.426534+0000","last_unstale":"2023-11-30T17:25:07.815218+0000","last_undegraded":"2023-11-30T17:25:07.815218+0000","last_fullsized":"2023-11-30T17:25:07.815218+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.817503+0000","last_change":"2023-11-30T17:25:07.814014+0000","last_active":"2023-11-30T17:25:07.817503+0000","last_peered":"2023-11-30T17:25:07.817503+0000","last_clean":"2023-11-30T17:25:07.817503+0000","last_became_active":"2023-11-30T17:25:07.813717+0000","last_became_peered":"2023-11-30T17:25:07.813717+0000","last_unstale":"2023-11-30T17:25:07.817503+0000","last_undegraded":"2023-11-30T17:25:07.817503+0000","last_fullsized":"2023-11-30T17:25:07.817503+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.797435+0000","last_change":"2023-11-30T17:25:07.424608+0000","last_active":"2023-11-30T17:25:07.797435+0000","last_peered":"2023-11-30T17:25:07.797435+0000","last_clean":"2023-11-30T17:25:07.797435+0000","last_became_active":"2023-11-30T17:25:07.424276+0000","last_became_peered":"2023-11-30T17:25:07.424276+0000","last_unstale":"2023-11-30T17:25:07.797435+0000","last_undegraded":"2023-11-30T17:25:07.797435+0000","last_fullsized":"2023-11-30T17:25:07.797435+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.811855+0000","last_change":"2023-11-30T17:25:07.808767+0000","last_active":"2023-11-30T17:25:07.811855+0000","last_peered":"2023-11-30T17:25:07.811855+0000","last_clean":"2023-11-30T17:25:07.811855+0000","last_became_active":"2023-11-30T17:25:07.808444+0000","last_became_peered":"2023-11-30T17:25:07.808444+0000","last_unstale":"2023-11-30T17:25:07.811855+0000","last_undegraded":"2023-11-30T17:25:07.811855+0000","last_fullsized":"2023-11-30T17:25:07.811855+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.802381+0000","last_change":"2023-11-30T17:25:07.429043+0000","last_active":"2023-11-30T17:25:07.802381+0000","last_peered":"2023-11-30T17:25:07.802381+0000","last_clean":"2023-11-30T17:25:07.802381+0000","last_became_active":"2023-11-30T17:25:07.428702+0000","last_became_peered":"2023-11-30T17:25:07.428702+0000","last_unstale":"2023-11-30T17:25:07.802381+0000","last_undegraded":"2023-11-30T17:25:07.802381+0000","last_fullsized":"2023-11-30T17:25:07.802381+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.817587+0000","last_change":"2023-11-30T17:25:07.813243+0000","last_active":"2023-11-30T17:25:07.817587+0000","last_peered":"2023-11-30T17:25:07.817587+0000","last_clean":"2023-11-30T17:25:07.817587+0000","last_became_active":"2023-11-30T17:25:07.812920+0000","last_became_peered":"2023-11-30T17:25:07.812920+0000","last_unstale":"2023-11-30T17:25:07.817587+0000","last_undegraded":"2023-11-30T17:25:07.817587+0000","last_fullsized":"2023-11-30T17:25:07.817587+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2d","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.804948+0000","last_change":"2023-11-30T17:25:07.422405+0000","last_active":"2023-11-30T17:25:07.804948+0000","last_peered":"2023-11-30T17:25:07.804948+0000","last_clean":"2023-11-30T17:25:07.804948+0000","last_became_active":"2023-11-30T17:25:07.422131+0000","last_became_peered":"2023-11-30T17:25:07.422131+0000","last_unstale":"2023-11-30T17:25:07.804948+0000","last_undegraded":"2023-11-30T17:25:07.804948+0000","last_fullsized":"2023-11-30T17:25:07.804948+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.812136+0000","last_change":"2023-11-30T17:25:07.806310+0000","last_active":"2023-11-30T17:25:07.812136+0000","last_peered":"2023-11-30T17:25:07.812136+0000","last_clean":"2023-11-30T17:25:07.812136+0000","last_became_active":"2023-11-30T17:25:07.806044+0000","last_became_peered":"2023-11-30T17:25:07.806044+0000","last_unstale":"2023-11-30T17:25:07.812136+0000","last_undegraded":"2023-11-30T17:25:07.812136+0000","last_fullsized":"2023-11-30T17:25:07.812136+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.798288+0000","last_change":"2023-11-30T17:25:07.428513+0000","last_active":"2023-11-30T17:25:07.798288+0000","last_peered":"2023-11-30T17:25:07.798288+0000","last_clean":"2023-11-30T17:25:07.798288+0000","last_became_active":"2023-11-30T17:25:07.426890+0000","last_became_peered":"2023-11-30T17:25:07.426890+0000","last_unstale":"2023-11-30T17:25:07.798288+0000","last_undegraded":"2023-11-30T17:25:07.798288+0000","last_fullsized":"2023-11-30T17:25:07.798288+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.819936+0000","last_change":"2023-11-30T17:25:07.816162+0000","last_active":"2023-11-30T17:25:07.819936+0000","last_peered":"2023-11-30T17:25:07.819936+0000","last_clean":"2023-11-30T17:25:07.819936+0000","last_became_active":"2023-11-30T17:25:07.815865+0000","last_became_peered":"2023-11-30T17:25:07.815865+0000","last_unstale":"2023-11-30T17:25:07.819936+0000","last_undegraded":"2023-11-30T17:25:07.819936+0000","last_fullsized":"2023-11-30T17:25:07.819936+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.808109+0000","last_change":"2023-11-30T17:25:07.424740+0000","last_active":"2023-11-30T17:25:07.808109+0000","last_peered":"2023-11-30T17:25:07.808109+0000","last_clean":"2023-11-30T17:25:07.808109+0000","last_became_active":"2023-11-30T17:25:07.424471+0000","last_became_peered":"2023-11-30T17:25:07.424471+0000","last_unstale":"2023-11-30T17:25:07.808109+0000","last_undegraded":"2023-11-30T17:25:07.808109+0000","last_fullsized":"2023-11-30T17:25:07.808109+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.815470+0000","last_change":"2023-11-30T17:25:07.809992+0000","last_active":"2023-11-30T17:25:07.815470+0000","last_peered":"2023-11-30T17:25:07.815470+0000","last_clean":"2023-11-30T17:25:07.815470+0000","last_became_active":"2023-11-30T17:25:07.809716+0000","last_became_peered":"2023-11-30T17:25:07.809716+0000","last_unstale":"2023-11-30T17:25:07.815470+0000","last_undegraded":"2023-11-30T17:25:07.815470+0000","last_fullsized":"2023-11-30T17:25:07.815470+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.796420+0000","last_change":"2023-11-30T17:25:07.430852+0000","last_active":"2023-11-30T17:25:07.796420+0000","last_peered":"2023-11-30T17:25:07.796420+0000","last_clean":"2023-11-30T17:25:07.796420+0000","last_became_active":"2023-11-30T17:25:07.430581+0000","last_became_peered":"2023-11-30T17:25:07.430581+0000","last_unstale":"2023-11-30T17:25:07.796420+0000","last_undegraded":"2023-11-30T17:25:07.796420+0000","last_fullsized":"2023-11-30T17:25:07.796420+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.812271+0000","last_change":"2023-11-30T17:25:07.810172+0000","last_active":"2023-11-30T17:25:07.812271+0000","last_peered":"2023-11-30T17:25:07.812271+0000","last_clean":"2023-11-30T17:25:07.812271+0000","last_became_active":"2023-11-30T17:25:07.809900+0000","last_became_peered":"2023-11-30T17:25:07.809900+0000","last_unstale":"2023-11-30T17:25:07.812271+0000","last_undegraded":"2023-11-30T17:25:07.812271+0000","last_fullsized":"2023-11-30T17:25:07.812271+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.797315+0000","last_change":"2023-11-30T17:25:07.431327+0000","last_active":"2023-11-30T17:25:07.797315+0000","last_peered":"2023-11-30T17:25:07.797315+0000","last_clean":"2023-11-30T17:25:07.797315+0000","last_became_active":"2023-11-30T17:25:07.430473+0000","last_became_peered":"2023-11-30T17:25:07.430473+0000","last_unstale":"2023-11-30T17:25:07.797315+0000","last_undegraded":"2023-11-30T17:25:07.797315+0000","last_fullsized":"2023-11-30T17:25:07.797315+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.817404+0000","last_change":"2023-11-30T17:25:07.811794+0000","last_active":"2023-11-30T17:25:07.817404+0000","last_peered":"2023-11-30T17:25:07.817404+0000","last_clean":"2023-11-30T17:25:07.817404+0000","last_became_active":"2023-11-30T17:25:07.811522+0000","last_became_peered":"2023-11-30T17:25:07.811522+0000","last_unstale":"2023-11-30T17:25:07.817404+0000","last_undegraded":"2023-11-30T17:25:07.817404+0000","last_fullsized":"2023-11-30T17:25:07.817404+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.803234+0000","last_change":"2023-11-30T17:25:07.429292+0000","last_active":"2023-11-30T17:25:07.803234+0000","last_peered":"2023-11-30T17:25:07.803234+0000","last_clean":"2023-11-30T17:25:07.803234+0000","last_became_active":"2023-11-30T17:25:07.427594+0000","last_became_peered":"2023-11-30T17:25:07.427594+0000","last_unstale":"2023-11-30T17:25:07.803234+0000","last_undegraded":"2023-11-30T17:25:07.803234+0000","last_fullsized":"2023-11-30T17:25:07.803234+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.812856+0000","last_change":"2023-11-30T17:25:07.809404+0000","last_active":"2023-11-30T17:25:07.812856+0000","last_peered":"2023-11-30T17:25:07.812856+0000","last_clean":"2023-11-30T17:25:07.812856+0000","last_became_active":"2023-11-30T17:25:07.804986+0000","last_became_peered":"2023-11-30T17:25:07.804986+0000","last_unstale":"2023-11-30T17:25:07.812856+0000","last_undegraded":"2023-11-30T17:25:07.812856+0000","last_fullsized":"2023-11-30T17:25:07.812856+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.796930+0000","last_change":"2023-11-30T17:25:07.425500+0000","last_active":"2023-11-30T17:25:07.796930+0000","last_peered":"2023-11-30T17:25:07.796930+0000","last_clean":"2023-11-30T17:25:07.796930+0000","last_became_active":"2023-11-30T17:25:07.425171+0000","last_became_peered":"2023-11-30T17:25:07.425171+0000","last_unstale":"2023-11-30T17:25:07.796930+0000","last_undegraded":"2023-11-30T17:25:07.796930+0000","last_fullsized":"2023-11-30T17:25:07.796930+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.819874+0000","last_change":"2023-11-30T17:25:07.809866+0000","last_active":"2023-11-30T17:25:07.819874+0000","last_peered":"2023-11-30T17:25:07.819874+0000","last_clean":"2023-11-30T17:25:07.819874+0000","last_became_active":"2023-11-30T17:25:07.809541+0000","last_became_peered":"2023-11-30T17:25:07.809541+0000","last_unstale":"2023-11-30T17:25:07.819874+0000","last_undegraded":"2023-11-30T17:25:07.819874+0000","last_fullsized":"2023-11-30T17:25:07.819874+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:08.235333+0000","last_change":"2023-11-30T17:25:07.418369+0000","last_active":"2023-11-30T17:25:08.235333+0000","last_peered":"2023-11-30T17:25:08.235333+0000","last_clean":"2023-11-30T17:25:08.235333+0000","last_became_active":"2023-11-30T17:25:07.418069+0000","last_became_peered":"2023-11-30T17:25:07.418069+0000","last_unstale":"2023-11-30T17:25:08.235333+0000","last_undegraded":"2023-11-30T17:25:08.235333+0000","last_fullsized":"2023-11-30T17:25:08.235333+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.809343+0000","last_change":"2023-11-30T17:25:07.807042+0000","last_active":"2023-11-30T17:25:07.809343+0000","last_peered":"2023-11-30T17:25:07.809343+0000","last_clean":"2023-11-30T17:25:07.809343+0000","last_became_active":"2023-11-30T17:25:07.806773+0000","last_became_peered":"2023-11-30T17:25:07.806773+0000","last_unstale":"2023-11-30T17:25:07.809343+0000","last_undegraded":"2023-11-30T17:25:07.809343+0000","last_fullsized":"2023-11-30T17:25:07.809343+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.803938+0000","last_change":"2023-11-30T17:25:07.433224+0000","last_active":"2023-11-30T17:25:07.803938+0000","last_peered":"2023-11-30T17:25:07.803938+0000","last_clean":"2023-11-30T17:25:07.803938+0000","last_became_active":"2023-11-30T17:25:07.432882+0000","last_became_peered":"2023-11-30T17:25:07.432882+0000","last_unstale":"2023-11-30T17:25:07.803938+0000","last_undegraded":"2023-11-30T17:25:07.803938+0000","last_fullsized":"2023-11-30T17:25:07.803938+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.813828+0000","last_change":"2023-11-30T17:25:07.811579+0000","last_active":"2023-11-30T17:25:07.813828+0000","last_peered":"2023-11-30T17:25:07.813828+0000","last_clean":"2023-11-30T17:25:07.813828+0000","last_became_active":"2023-11-30T17:25:07.811296+0000","last_became_peered":"2023-11-30T17:25:07.811296+0000","last_unstale":"2023-11-30T17:25:07.813828+0000","last_undegraded":"2023-11-30T17:25:07.813828+0000","last_fullsized":"2023-11-30T17:25:07.813828+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.794244+0000","last_change":"2023-11-30T17:25:07.421521+0000","last_active":"2023-11-30T17:25:07.794244+0000","last_peered":"2023-11-30T17:25:07.794244+0000","last_clean":"2023-11-30T17:25:07.794244+0000","last_became_active":"2023-11-30T17:25:07.421237+0000","last_became_peered":"2023-11-30T17:25:07.421237+0000","last_unstale":"2023-11-30T17:25:07.794244+0000","last_undegraded":"2023-11-30T17:25:07.794244+0000","last_fullsized":"2023-11-30T17:25:07.794244+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.817319+0000","last_change":"2023-11-30T17:25:07.816861+0000","last_active":"2023-11-30T17:25:07.817319+0000","last_peered":"2023-11-30T17:25:07.817319+0000","last_clean":"2023-11-30T17:25:07.817319+0000","last_became_active":"2023-11-30T17:25:07.816601+0000","last_became_peered":"2023-11-30T17:25:07.816601+0000","last_unstale":"2023-11-30T17:25:07.817319+0000","last_undegraded":"2023-11-30T17:25:07.817319+0000","last_fullsized":"2023-11-30T17:25:07.817319+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.793602+0000","last_change":"2023-11-30T17:25:07.418471+0000","last_active":"2023-11-30T17:25:07.793602+0000","last_peered":"2023-11-30T17:25:07.793602+0000","last_clean":"2023-11-30T17:25:07.793602+0000","last_became_active":"2023-11-30T17:25:07.418093+0000","last_became_peered":"2023-11-30T17:25:07.418093+0000","last_unstale":"2023-11-30T17:25:07.793602+0000","last_undegraded":"2023-11-30T17:25:07.793602+0000","last_fullsized":"2023-11-30T17:25:07.793602+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.811533+0000","last_change":"2023-11-30T17:25:07.807243+0000","last_active":"2023-11-30T17:25:07.811533+0000","last_peered":"2023-11-30T17:25:07.811533+0000","last_clean":"2023-11-30T17:25:07.811533+0000","last_became_active":"2023-11-30T17:25:07.806665+0000","last_became_peered":"2023-11-30T17:25:07.806665+0000","last_unstale":"2023-11-30T17:25:07.811533+0000","last_undegraded":"2023-11-30T17:25:07.811533+0000","last_fullsized":"2023-11-30T17:25:07.811533+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.790608+0000","last_change":"2023-11-30T17:25:07.422503+0000","last_active":"2023-11-30T17:25:07.790608+0000","last_peered":"2023-11-30T17:25:07.790608+0000","last_clean":"2023-11-30T17:25:07.790608+0000","last_became_active":"2023-11-30T17:25:07.422216+0000","last_became_peered":"2023-11-30T17:25:07.422216+0000","last_unstale":"2023-11-30T17:25:07.790608+0000","last_undegraded":"2023-11-30T17:25:07.790608+0000","last_fullsized":"2023-11-30T17:25:07.790608+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.809509+0000","last_change":"2023-11-30T17:25:07.806861+0000","last_active":"2023-11-30T17:25:07.809509+0000","last_peered":"2023-11-30T17:25:07.809509+0000","last_clean":"2023-11-30T17:25:07.809509+0000","last_became_active":"2023-11-30T17:25:07.806540+0000","last_became_peered":"2023-11-30T17:25:07.806540+0000","last_unstale":"2023-11-30T17:25:07.809509+0000","last_undegraded":"2023-11-30T17:25:07.809509+0000","last_fullsized":"2023-11-30T17:25:07.809509+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.803164+0000","last_change":"2023-11-30T17:25:07.425991+0000","last_active":"2023-11-30T17:25:07.803164+0000","last_peered":"2023-11-30T17:25:07.803164+0000","last_clean":"2023-11-30T17:25:07.803164+0000","last_became_active":"2023-11-30T17:25:07.425506+0000","last_became_peered":"2023-11-30T17:25:07.425506+0000","last_unstale":"2023-11-30T17:25:07.803164+0000","last_undegraded":"2023-11-30T17:25:07.803164+0000","last_fullsized":"2023-11-30T17:25:07.803164+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.813440+0000","last_change":"2023-11-30T17:25:07.811551+0000","last_active":"2023-11-30T17:25:07.813440+0000","last_peered":"2023-11-30T17:25:07.813440+0000","last_clean":"2023-11-30T17:25:07.813440+0000","last_became_active":"2023-11-30T17:25:07.810954+0000","last_became_peered":"2023-11-30T17:25:07.810954+0000","last_unstale":"2023-11-30T17:25:07.813440+0000","last_undegraded":"2023-11-30T17:25:07.813440+0000","last_fullsized":"2023-11-30T17:25:07.813440+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.797858+0000","last_change":"2023-11-30T17:25:07.420367+0000","last_active":"2023-11-30T17:25:07.797858+0000","last_peered":"2023-11-30T17:25:07.797858+0000","last_clean":"2023-11-30T17:25:07.797858+0000","last_became_active":"2023-11-30T17:25:07.419985+0000","last_became_peered":"2023-11-30T17:25:07.419985+0000","last_unstale":"2023-11-30T17:25:07.797858+0000","last_undegraded":"2023-11-30T17:25:07.797858+0000","last_fullsized":"2023-11-30T17:25:07.797858+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.814743+0000","last_change":"2023-11-30T17:25:07.810337+0000","last_active":"2023-11-30T17:25:07.814743+0000","last_peered":"2023-11-30T17:25:07.814743+0000","last_clean":"2023-11-30T17:25:07.814743+0000","last_became_active":"2023-11-30T17:25:07.809676+0000","last_became_peered":"2023-11-30T17:25:07.809676+0000","last_unstale":"2023-11-30T17:25:07.814743+0000","last_undegraded":"2023-11-30T17:25:07.814743+0000","last_fullsized":"2023-11-30T17:25:07.814743+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.813012+0000","last_change":"2023-11-30T17:25:07.425674+0000","last_active":"2023-11-30T17:25:07.813012+0000","last_peered":"2023-11-30T17:25:07.813012+0000","last_clean":"2023-11-30T17:25:07.813012+0000","last_became_active":"2023-11-30T17:25:07.425267+0000","last_became_peered":"2023-11-30T17:25:07.425267+0000","last_unstale":"2023-11-30T17:25:07.813012+0000","last_undegraded":"2023-11-30T17:25:07.813012+0000","last_fullsized":"2023-11-30T17:25:07.813012+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.812642+0000","last_change":"2023-11-30T17:25:07.804540+0000","last_active":"2023-11-30T17:25:07.812642+0000","last_peered":"2023-11-30T17:25:07.812642+0000","last_clean":"2023-11-30T17:25:07.812642+0000","last_became_active":"2023-11-30T17:25:07.804108+0000","last_became_peered":"2023-11-30T17:25:07.804108+0000","last_unstale":"2023-11-30T17:25:07.812642+0000","last_undegraded":"2023-11-30T17:25:07.812642+0000","last_fullsized":"2023-11-30T17:25:07.812642+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.802113+0000","last_change":"2023-11-30T17:25:07.419127+0000","last_active":"2023-11-30T17:25:07.802113+0000","last_peered":"2023-11-30T17:25:07.802113+0000","last_clean":"2023-11-30T17:25:07.802113+0000","last_became_active":"2023-11-30T17:25:07.418859+0000","last_became_peered":"2023-11-30T17:25:07.418859+0000","last_unstale":"2023-11-30T17:25:07.802113+0000","last_undegraded":"2023-11-30T17:25:07.802113+0000","last_fullsized":"2023-11-30T17:25:07.802113+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.819685+0000","last_change":"2023-11-30T17:25:07.810887+0000","last_active":"2023-11-30T17:25:07.819685+0000","last_peered":"2023-11-30T17:25:07.819685+0000","last_clean":"2023-11-30T17:25:07.819685+0000","last_became_active":"2023-11-30T17:25:07.810564+0000","last_became_peered":"2023-11-30T17:25:07.810564+0000","last_unstale":"2023-11-30T17:25:07.819685+0000","last_undegraded":"2023-11-30T17:25:07.819685+0000","last_fullsized":"2023-11-30T17:25:07.819685+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"129'2","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.810549+0000","last_change":"2023-11-30T17:25:07.424535+0000","last_active":"2023-11-30T17:25:07.810549+0000","last_peered":"2023-11-30T17:25:07.810549+0000","last_clean":"2023-11-30T17:25:07.810549+0000","last_became_active":"2023-11-30T17:25:07.424230+0000","last_became_peered":"2023-11-30T17:25:07.424230+0000","last_unstale":"2023-11-30T17:25:07.810549+0000","last_undegraded":"2023-11-30T17:25:07.810549+0000","last_fullsized":"2023-11-30T17:25:07.810549+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.816249+0000","last_change":"2023-11-30T17:25:07.812017+0000","last_active":"2023-11-30T17:25:07.816249+0000","last_peered":"2023-11-30T17:25:07.816249+0000","last_clean":"2023-11-30T17:25:07.816249+0000","last_became_active":"2023-11-30T17:25:07.811590+0000","last_became_peered":"2023-11-30T17:25:07.811590+0000","last_unstale":"2023-11-30T17:25:07.816249+0000","last_undegraded":"2023-11-30T17:25:07.816249+0000","last_fullsized":"2023-11-30T17:25:07.816249+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.798798+0000","last_change":"2023-11-30T17:25:07.426464+0000","last_active":"2023-11-30T17:25:07.798798+0000","last_peered":"2023-11-30T17:25:07.798798+0000","last_clean":"2023-11-30T17:25:07.798798+0000","last_became_active":"2023-11-30T17:25:07.426175+0000","last_became_peered":"2023-11-30T17:25:07.426175+0000","last_unstale":"2023-11-30T17:25:07.798798+0000","last_undegraded":"2023-11-30T17:25:07.798798+0000","last_fullsized":"2023-11-30T17:25:07.798798+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.814123+0000","last_change":"2023-11-30T17:25:07.808918+0000","last_active":"2023-11-30T17:25:07.814123+0000","last_peered":"2023-11-30T17:25:07.814123+0000","last_clean":"2023-11-30T17:25:07.814123+0000","last_became_active":"2023-11-30T17:25:07.808674+0000","last_became_peered":"2023-11-30T17:25:07.808674+0000","last_unstale":"2023-11-30T17:25:07.814123+0000","last_undegraded":"2023-11-30T17:25:07.814123+0000","last_fullsized":"2023-11-30T17:25:07.814123+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.803997+0000","last_change":"2023-11-30T17:25:07.425564+0000","last_active":"2023-11-30T17:25:07.803997+0000","last_peered":"2023-11-30T17:25:07.803997+0000","last_clean":"2023-11-30T17:25:07.803997+0000","last_became_active":"2023-11-30T17:25:07.425282+0000","last_became_peered":"2023-11-30T17:25:07.425282+0000","last_unstale":"2023-11-30T17:25:07.803997+0000","last_undegraded":"2023-11-30T17:25:07.803997+0000","last_fullsized":"2023-11-30T17:25:07.803997+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.815345+0000","last_change":"2023-11-30T17:25:07.813710+0000","last_active":"2023-11-30T17:25:07.815345+0000","last_peered":"2023-11-30T17:25:07.815345+0000","last_clean":"2023-11-30T17:25:07.815345+0000","last_became_active":"2023-11-30T17:25:07.813415+0000","last_became_peered":"2023-11-30T17:25:07.813415+0000","last_unstale":"2023-11-30T17:25:07.815345+0000","last_undegraded":"2023-11-30T17:25:07.815345+0000","last_fullsized":"2023-11-30T17:25:07.815345+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.794193+0000","last_change":"2023-11-30T17:25:07.428472+0000","last_active":"2023-11-30T17:25:07.794193+0000","last_peered":"2023-11-30T17:25:07.794193+0000","last_clean":"2023-11-30T17:25:07.794193+0000","last_became_active":"2023-11-30T17:25:07.428162+0000","last_became_peered":"2023-11-30T17:25:07.428162+0000","last_unstale":"2023-11-30T17:25:07.794193+0000","last_undegraded":"2023-11-30T17:25:07.794193+0000","last_fullsized":"2023-11-30T17:25:07.794193+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.819901+0000","last_change":"2023-11-30T17:25:07.813693+0000","last_active":"2023-11-30T17:25:07.819901+0000","last_peered":"2023-11-30T17:25:07.819901+0000","last_clean":"2023-11-30T17:25:07.819901+0000","last_became_active":"2023-11-30T17:25:07.809722+0000","last_became_peered":"2023-11-30T17:25:07.809722+0000","last_unstale":"2023-11-30T17:25:07.819901+0000","last_undegraded":"2023-11-30T17:25:07.819901+0000","last_fullsized":"2023-11-30T17:25:07.819901+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.797417+0000","last_change":"2023-11-30T17:25:07.423418+0000","last_active":"2023-11-30T17:25:07.797417+0000","last_peered":"2023-11-30T17:25:07.797417+0000","last_clean":"2023-11-30T17:25:07.797417+0000","last_became_active":"2023-11-30T17:25:07.423071+0000","last_became_peered":"2023-11-30T17:25:07.423071+0000","last_unstale":"2023-11-30T17:25:07.797417+0000","last_undegraded":"2023-11-30T17:25:07.797417+0000","last_fullsized":"2023-11-30T17:25:07.797417+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.812224+0000","last_change":"2023-11-30T17:25:07.808370+0000","last_active":"2023-11-30T17:25:07.812224+0000","last_peered":"2023-11-30T17:25:07.812224+0000","last_clean":"2023-11-30T17:25:07.812224+0000","last_became_active":"2023-11-30T17:25:07.808106+0000","last_became_peered":"2023-11-30T17:25:07.808106+0000","last_unstale":"2023-11-30T17:25:07.812224+0000","last_undegraded":"2023-11-30T17:25:07.812224+0000","last_fullsized":"2023-11-30T17:25:07.812224+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.804542+0000","last_change":"2023-11-30T17:25:07.423707+0000","last_active":"2023-11-30T17:25:07.804542+0000","last_peered":"2023-11-30T17:25:07.804542+0000","last_clean":"2023-11-30T17:25:07.804542+0000","last_became_active":"2023-11-30T17:25:07.423230+0000","last_became_peered":"2023-11-30T17:25:07.423230+0000","last_unstale":"2023-11-30T17:25:07.804542+0000","last_undegraded":"2023-11-30T17:25:07.804542+0000","last_fullsized":"2023-11-30T17:25:07.804542+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.814762+0000","last_change":"2023-11-30T17:25:07.810514+0000","last_active":"2023-11-30T17:25:07.814762+0000","last_peered":"2023-11-30T17:25:07.814762+0000","last_clean":"2023-11-30T17:25:07.814762+0000","last_became_active":"2023-11-30T17:25:07.810061+0000","last_became_peered":"2023-11-30T17:25:07.810061+0000","last_unstale":"2023-11-30T17:25:07.814762+0000","last_undegraded":"2023-11-30T17:25:07.814762+0000","last_fullsized":"2023-11-30T17:25:07.814762+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.798708+0000","last_change":"2023-11-30T17:25:07.426716+0000","last_active":"2023-11-30T17:25:07.798708+0000","last_peered":"2023-11-30T17:25:07.798708+0000","last_clean":"2023-11-30T17:25:07.798708+0000","last_became_active":"2023-11-30T17:25:07.426410+0000","last_became_peered":"2023-11-30T17:25:07.426410+0000","last_unstale":"2023-11-30T17:25:07.798708+0000","last_undegraded":"2023-11-30T17:25:07.798708+0000","last_fullsized":"2023-11-30T17:25:07.798708+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.807932+0000","last_change":"2023-11-30T17:25:07.801737+0000","last_active":"2023-11-30T17:25:07.807932+0000","last_peered":"2023-11-30T17:25:07.807932+0000","last_clean":"2023-11-30T17:25:07.807932+0000","last_became_active":"2023-11-30T17:25:07.801427+0000","last_became_peered":"2023-11-30T17:25:07.801427+0000","last_unstale":"2023-11-30T17:25:07.807932+0000","last_undegraded":"2023-11-30T17:25:07.807932+0000","last_fullsized":"2023-11-30T17:25:07.807932+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.795048+0000","last_change":"2023-11-30T17:25:07.427160+0000","last_active":"2023-11-30T17:25:07.795048+0000","last_peered":"2023-11-30T17:25:07.795048+0000","last_clean":"2023-11-30T17:25:07.795048+0000","last_became_active":"2023-11-30T17:25:07.426881+0000","last_became_peered":"2023-11-30T17:25:07.426881+0000","last_unstale":"2023-11-30T17:25:07.795048+0000","last_undegraded":"2023-11-30T17:25:07.795048+0000","last_fullsized":"2023-11-30T17:25:07.795048+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.812819+0000","last_change":"2023-11-30T17:25:07.807055+0000","last_active":"2023-11-30T17:25:07.812819+0000","last_peered":"2023-11-30T17:25:07.812819+0000","last_clean":"2023-11-30T17:25:07.812819+0000","last_became_active":"2023-11-30T17:25:07.804212+0000","last_became_peered":"2023-11-30T17:25:07.804212+0000","last_unstale":"2023-11-30T17:25:07.812819+0000","last_undegraded":"2023-11-30T17:25:07.812819+0000","last_fullsized":"2023-11-30T17:25:07.812819+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"129'3","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.812370+0000","last_change":"2023-11-30T17:25:07.430904+0000","last_active":"2023-11-30T17:25:07.812370+0000","last_peered":"2023-11-30T17:25:07.812370+0000","last_clean":"2023-11-30T17:25:07.812370+0000","last_became_active":"2023-11-30T17:25:07.430566+0000","last_became_peered":"2023-11-30T17:25:07.430566+0000","last_unstale":"2023-11-30T17:25:07.812370+0000","last_undegraded":"2023-11-30T17:25:07.812370+0000","last_fullsized":"2023-11-30T17:25:07.812370+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.809569+0000","last_change":"2023-11-30T17:25:07.801887+0000","last_active":"2023-11-30T17:25:07.809569+0000","last_peered":"2023-11-30T17:25:07.809569+0000","last_clean":"2023-11-30T17:25:07.809569+0000","last_became_active":"2023-11-30T17:25:07.801607+0000","last_became_peered":"2023-11-30T17:25:07.801607+0000","last_unstale":"2023-11-30T17:25:07.809569+0000","last_undegraded":"2023-11-30T17:25:07.809569+0000","last_fullsized":"2023-11-30T17:25:07.809569+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"129'2","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.814085+0000","last_change":"2023-11-30T17:25:07.421517+0000","last_active":"2023-11-30T17:25:07.814085+0000","last_peered":"2023-11-30T17:25:07.814085+0000","last_clean":"2023-11-30T17:25:07.814085+0000","last_became_active":"2023-11-30T17:25:07.421223+0000","last_became_peered":"2023-11-30T17:25:07.421223+0000","last_unstale":"2023-11-30T17:25:07.814085+0000","last_undegraded":"2023-11-30T17:25:07.814085+0000","last_fullsized":"2023-11-30T17:25:07.814085+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.815029+0000","last_change":"2023-11-30T17:25:07.809370+0000","last_active":"2023-11-30T17:25:07.815029+0000","last_peered":"2023-11-30T17:25:07.815029+0000","last_clean":"2023-11-30T17:25:07.815029+0000","last_became_active":"2023-11-30T17:25:07.809079+0000","last_became_peered":"2023-11-30T17:25:07.809079+0000","last_unstale":"2023-11-30T17:25:07.815029+0000","last_undegraded":"2023-11-30T17:25:07.815029+0000","last_fullsized":"2023-11-30T17:25:07.815029+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.809517+0000","last_change":"2023-11-30T17:25:07.429966+0000","last_active":"2023-11-30T17:25:07.809517+0000","last_peered":"2023-11-30T17:25:07.809517+0000","last_clean":"2023-11-30T17:25:07.809517+0000","last_became_active":"2023-11-30T17:25:07.429699+0000","last_became_peered":"2023-11-30T17:25:07.429699+0000","last_unstale":"2023-11-30T17:25:07.809517+0000","last_undegraded":"2023-11-30T17:25:07.809517+0000","last_fullsized":"2023-11-30T17:25:07.809517+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.810776+0000","last_change":"2023-11-30T17:25:07.802322+0000","last_active":"2023-11-30T17:25:07.810776+0000","last_peered":"2023-11-30T17:25:07.810776+0000","last_clean":"2023-11-30T17:25:07.810776+0000","last_became_active":"2023-11-30T17:25:07.802007+0000","last_became_peered":"2023-11-30T17:25:07.802007+0000","last_unstale":"2023-11-30T17:25:07.810776+0000","last_undegraded":"2023-11-30T17:25:07.810776+0000","last_fullsized":"2023-11-30T17:25:07.810776+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.804785+0000","last_change":"2023-11-30T17:25:07.420645+0000","last_active":"2023-11-30T17:25:07.804785+0000","last_peered":"2023-11-30T17:25:07.804785+0000","last_clean":"2023-11-30T17:25:07.804785+0000","last_became_active":"2023-11-30T17:25:07.420437+0000","last_became_peered":"2023-11-30T17:25:07.420437+0000","last_unstale":"2023-11-30T17:25:07.804785+0000","last_undegraded":"2023-11-30T17:25:07.804785+0000","last_fullsized":"2023-11-30T17:25:07.804785+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.814150+0000","last_change":"2023-11-30T17:25:07.812167+0000","last_active":"2023-11-30T17:25:07.814150+0000","last_peered":"2023-11-30T17:25:07.814150+0000","last_clean":"2023-11-30T17:25:07.814150+0000","last_became_active":"2023-11-30T17:25:07.811868+0000","last_became_peered":"2023-11-30T17:25:07.811868+0000","last_unstale":"2023-11-30T17:25:07.814150+0000","last_undegraded":"2023-11-30T17:25:07.814150+0000","last_fullsized":"2023-11-30T17:25:07.814150+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.790140+0000","last_change":"2023-11-30T17:25:07.426475+0000","last_active":"2023-11-30T17:25:07.790140+0000","last_peered":"2023-11-30T17:25:07.790140+0000","last_clean":"2023-11-30T17:25:07.790140+0000","last_became_active":"2023-11-30T17:25:07.426171+0000","last_became_peered":"2023-11-30T17:25:07.426171+0000","last_unstale":"2023-11-30T17:25:07.790140+0000","last_undegraded":"2023-11-30T17:25:07.790140+0000","last_fullsized":"2023-11-30T17:25:07.790140+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.812676+0000","last_change":"2023-11-30T17:25:07.809197+0000","last_active":"2023-11-30T17:25:07.812676+0000","last_peered":"2023-11-30T17:25:07.812676+0000","last_clean":"2023-11-30T17:25:07.812676+0000","last_became_active":"2023-11-30T17:25:07.808899+0000","last_became_peered":"2023-11-30T17:25:07.808899+0000","last_unstale":"2023-11-30T17:25:07.812676+0000","last_undegraded":"2023-11-30T17:25:07.812676+0000","last_fullsized":"2023-11-30T17:25:07.812676+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"129'4","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.812236+0000","last_change":"2023-11-30T17:25:07.421862+0000","last_active":"2023-11-30T17:25:07.812236+0000","last_peered":"2023-11-30T17:25:07.812236+0000","last_clean":"2023-11-30T17:25:07.812236+0000","last_became_active":"2023-11-30T17:25:07.421553+0000","last_became_peered":"2023-11-30T17:25:07.421553+0000","last_unstale":"2023-11-30T17:25:07.812236+0000","last_undegraded":"2023-11-30T17:25:07.812236+0000","last_fullsized":"2023-11-30T17:25:07.812236+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.811583+0000","last_change":"2023-11-30T17:25:07.806188+0000","last_active":"2023-11-30T17:25:07.811583+0000","last_peered":"2023-11-30T17:25:07.811583+0000","last_clean":"2023-11-30T17:25:07.811583+0000","last_became_active":"2023-11-30T17:25:07.805902+0000","last_became_peered":"2023-11-30T17:25:07.805902+0000","last_unstale":"2023-11-30T17:25:07.811583+0000","last_undegraded":"2023-11-30T17:25:07.811583+0000","last_fullsized":"2023-11-30T17:25:07.811583+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"129'2","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.809407+0000","last_change":"2023-11-30T17:25:07.428181+0000","last_active":"2023-11-30T17:25:07.809407+0000","last_peered":"2023-11-30T17:25:07.809407+0000","last_clean":"2023-11-30T17:25:07.809407+0000","last_became_active":"2023-11-30T17:25:07.427723+0000","last_became_peered":"2023-11-30T17:25:07.427723+0000","last_unstale":"2023-11-30T17:25:07.809407+0000","last_undegraded":"2023-11-30T17:25:07.809407+0000","last_fullsized":"2023-11-30T17:25:07.809407+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.817149+0000","last_change":"2023-11-30T17:25:07.805965+0000","last_active":"2023-11-30T17:25:07.817149+0000","last_peered":"2023-11-30T17:25:07.817149+0000","last_clean":"2023-11-30T17:25:07.817149+0000","last_became_active":"2023-11-30T17:25:07.805647+0000","last_became_peered":"2023-11-30T17:25:07.805647+0000","last_unstale":"2023-11-30T17:25:07.817149+0000","last_undegraded":"2023-11-30T17:25:07.817149+0000","last_fullsized":"2023-11-30T17:25:07.817149+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.793716+0000","last_change":"2023-11-30T17:25:07.434140+0000","last_active":"2023-11-30T17:25:07.793716+0000","last_peered":"2023-11-30T17:25:07.793716+0000","last_clean":"2023-11-30T17:25:07.793716+0000","last_became_active":"2023-11-30T17:25:07.431450+0000","last_became_peered":"2023-11-30T17:25:07.431450+0000","last_unstale":"2023-11-30T17:25:07.793716+0000","last_undegraded":"2023-11-30T17:25:07.793716+0000","last_fullsized":"2023-11-30T17:25:07.793716+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.813736+0000","last_change":"2023-11-30T17:25:07.811061+0000","last_active":"2023-11-30T17:25:07.813736+0000","last_peered":"2023-11-30T17:25:07.813736+0000","last_clean":"2023-11-30T17:25:07.813736+0000","last_became_active":"2023-11-30T17:25:07.810811+0000","last_became_peered":"2023-11-30T17:25:07.810811+0000","last_unstale":"2023-11-30T17:25:07.813736+0000","last_undegraded":"2023-11-30T17:25:07.813736+0000","last_fullsized":"2023-11-30T17:25:07.813736+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.793972+0000","last_change":"2023-11-30T17:25:07.415883+0000","last_active":"2023-11-30T17:25:07.793972+0000","last_peered":"2023-11-30T17:25:07.793972+0000","last_clean":"2023-11-30T17:25:07.793972+0000","last_became_active":"2023-11-30T17:25:07.415594+0000","last_became_peered":"2023-11-30T17:25:07.415594+0000","last_unstale":"2023-11-30T17:25:07.793972+0000","last_undegraded":"2023-11-30T17:25:07.793972+0000","last_fullsized":"2023-11-30T17:25:07.793972+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.816227+0000","last_change":"2023-11-30T17:25:07.811851+0000","last_active":"2023-11-30T17:25:07.816227+0000","last_peered":"2023-11-30T17:25:07.816227+0000","last_clean":"2023-11-30T17:25:07.816227+0000","last_became_active":"2023-11-30T17:25:07.811233+0000","last_became_peered":"2023-11-30T17:25:07.811233+0000","last_unstale":"2023-11-30T17:25:07.816227+0000","last_undegraded":"2023-11-30T17:25:07.816227+0000","last_fullsized":"2023-11-30T17:25:07.816227+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.798892+0000","last_change":"2023-11-30T17:25:07.422369+0000","last_active":"2023-11-30T17:25:07.798892+0000","last_peered":"2023-11-30T17:25:07.798892+0000","last_clean":"2023-11-30T17:25:07.798892+0000","last_became_active":"2023-11-30T17:25:07.422092+0000","last_became_peered":"2023-11-30T17:25:07.422092+0000","last_unstale":"2023-11-30T17:25:07.798892+0000","last_undegraded":"2023-11-30T17:25:07.798892+0000","last_fullsized":"2023-11-30T17:25:07.798892+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.812987+0000","last_change":"2023-11-30T17:25:07.806980+0000","last_active":"2023-11-30T17:25:07.812987+0000","last_peered":"2023-11-30T17:25:07.812987+0000","last_clean":"2023-11-30T17:25:07.812987+0000","last_became_active":"2023-11-30T17:25:07.806637+0000","last_became_peered":"2023-11-30T17:25:07.806637+0000","last_unstale":"2023-11-30T17:25:07.812987+0000","last_undegraded":"2023-11-30T17:25:07.812987+0000","last_fullsized":"2023-11-30T17:25:07.812987+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.799555+0000","last_change":"2023-11-30T17:25:07.426189+0000","last_active":"2023-11-30T17:25:07.799555+0000","last_peered":"2023-11-30T17:25:07.799555+0000","last_clean":"2023-11-30T17:25:07.799555+0000","last_became_active":"2023-11-30T17:25:07.425839+0000","last_became_peered":"2023-11-30T17:25:07.425839+0000","last_unstale":"2023-11-30T17:25:07.799555+0000","last_undegraded":"2023-11-30T17:25:07.799555+0000","last_fullsized":"2023-11-30T17:25:07.799555+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.812678+0000","last_change":"2023-11-30T17:25:07.804793+0000","last_active":"2023-11-30T17:25:07.812678+0000","last_peered":"2023-11-30T17:25:07.812678+0000","last_clean":"2023-11-30T17:25:07.812678+0000","last_became_active":"2023-11-30T17:25:07.804166+0000","last_became_peered":"2023-11-30T17:25:07.804166+0000","last_unstale":"2023-11-30T17:25:07.812678+0000","last_undegraded":"2023-11-30T17:25:07.812678+0000","last_fullsized":"2023-11-30T17:25:07.812678+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.790720+0000","last_change":"2023-11-30T17:25:07.433060+0000","last_active":"2023-11-30T17:25:07.790720+0000","last_peered":"2023-11-30T17:25:07.790720+0000","last_clean":"2023-11-30T17:25:07.790720+0000","last_became_active":"2023-11-30T17:25:07.432640+0000","last_became_peered":"2023-11-30T17:25:07.432640+0000","last_unstale":"2023-11-30T17:25:07.790720+0000","last_undegraded":"2023-11-30T17:25:07.790720+0000","last_fullsized":"2023-11-30T17:25:07.790720+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.820001+0000","last_change":"2023-11-30T17:25:07.816104+0000","last_active":"2023-11-30T17:25:07.820001+0000","last_peered":"2023-11-30T17:25:07.820001+0000","last_clean":"2023-11-30T17:25:07.820001+0000","last_became_active":"2023-11-30T17:25:07.815858+0000","last_became_peered":"2023-11-30T17:25:07.815858+0000","last_unstale":"2023-11-30T17:25:07.820001+0000","last_undegraded":"2023-11-30T17:25:07.820001+0000","last_fullsized":"2023-11-30T17:25:07.820001+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.793572+0000","last_change":"2023-11-30T17:25:07.423189+0000","last_active":"2023-11-30T17:25:07.793572+0000","last_peered":"2023-11-30T17:25:07.793572+0000","last_clean":"2023-11-30T17:25:07.793572+0000","last_became_active":"2023-11-30T17:25:07.422646+0000","last_became_peered":"2023-11-30T17:25:07.422646+0000","last_unstale":"2023-11-30T17:25:07.793572+0000","last_undegraded":"2023-11-30T17:25:07.793572+0000","last_fullsized":"2023-11-30T17:25:07.793572+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.817512+0000","last_change":"2023-11-30T17:25:07.812520+0000","last_active":"2023-11-30T17:25:07.817512+0000","last_peered":"2023-11-30T17:25:07.817512+0000","last_clean":"2023-11-30T17:25:07.817512+0000","last_became_active":"2023-11-30T17:25:07.807507+0000","last_became_peered":"2023-11-30T17:25:07.807507+0000","last_unstale":"2023-11-30T17:25:07.817512+0000","last_undegraded":"2023-11-30T17:25:07.817512+0000","last_fullsized":"2023-11-30T17:25:07.817512+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.790556+0000","last_change":"2023-11-30T17:25:07.422994+0000","last_active":"2023-11-30T17:25:07.790556+0000","last_peered":"2023-11-30T17:25:07.790556+0000","last_clean":"2023-11-30T17:25:07.790556+0000","last_became_active":"2023-11-30T17:25:07.422768+0000","last_became_peered":"2023-11-30T17:25:07.422768+0000","last_unstale":"2023-11-30T17:25:07.790556+0000","last_undegraded":"2023-11-30T17:25:07.790556+0000","last_fullsized":"2023-11-30T17:25:07.790556+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.814354+0000","last_change":"2023-11-30T17:25:07.813139+0000","last_active":"2023-11-30T17:25:07.814354+0000","last_peered":"2023-11-30T17:25:07.814354+0000","last_clean":"2023-11-30T17:25:07.814354+0000","last_became_active":"2023-11-30T17:25:07.812802+0000","last_became_peered":"2023-11-30T17:25:07.812802+0000","last_unstale":"2023-11-30T17:25:07.814354+0000","last_undegraded":"2023-11-30T17:25:07.814354+0000","last_fullsized":"2023-11-30T17:25:07.814354+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.793405+0000","last_change":"2023-11-30T17:25:07.423036+0000","last_active":"2023-11-30T17:25:07.793405+0000","last_peered":"2023-11-30T17:25:07.793405+0000","last_clean":"2023-11-30T17:25:07.793405+0000","last_became_active":"2023-11-30T17:25:07.422313+0000","last_became_peered":"2023-11-30T17:25:07.422313+0000","last_unstale":"2023-11-30T17:25:07.793405+0000","last_undegraded":"2023-11-30T17:25:07.793405+0000","last_fullsized":"2023-11-30T17:25:07.793405+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":107,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.798976+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:25:07.798976+0000","last_peered":"2023-11-30T17:25:07.798976+0000","last_clean":"2023-11-30T17:25:07.798976+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:25:07.798976+0000","last_undegraded":"2023-11-30T17:25:07.798976+0000","last_fullsized":"2023-11-30T17:25:07.798976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.805956+0000","last_change":"2023-11-30T17:25:07.801780+0000","last_active":"2023-11-30T17:25:07.805956+0000","last_peered":"2023-11-30T17:25:07.805956+0000","last_clean":"2023-11-30T17:25:07.805956+0000","last_became_active":"2023-11-30T17:25:07.801513+0000","last_became_peered":"2023-11-30T17:25:07.801513+0000","last_unstale":"2023-11-30T17:25:07.805956+0000","last_undegraded":"2023-11-30T17:25:07.805956+0000","last_fullsized":"2023-11-30T17:25:07.805956+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.813349+0000","last_change":"2023-11-30T17:25:07.429308+0000","last_active":"2023-11-30T17:25:07.813349+0000","last_peered":"2023-11-30T17:25:07.813349+0000","last_clean":"2023-11-30T17:25:07.813349+0000","last_became_active":"2023-11-30T17:25:07.429027+0000","last_became_peered":"2023-11-30T17:25:07.429027+0000","last_unstale":"2023-11-30T17:25:07.813349+0000","last_undegraded":"2023-11-30T17:25:07.813349+0000","last_fullsized":"2023-11-30T17:25:07.813349+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":104,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.794285+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:25:07.794285+0000","last_peered":"2023-11-30T17:25:07.794285+0000","last_clean":"2023-11-30T17:25:07.794285+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:25:07.794285+0000","last_undegraded":"2023-11-30T17:25:07.794285+0000","last_fullsized":"2023-11-30T17:25:07.794285+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.809638+0000","last_change":"2023-11-30T17:25:07.805695+0000","last_active":"2023-11-30T17:25:07.809638+0000","last_peered":"2023-11-30T17:25:07.809638+0000","last_clean":"2023-11-30T17:25:07.809638+0000","last_became_active":"2023-11-30T17:25:07.805388+0000","last_became_peered":"2023-11-30T17:25:07.805388+0000","last_unstale":"2023-11-30T17:25:07.809638+0000","last_undegraded":"2023-11-30T17:25:07.809638+0000","last_fullsized":"2023-11-30T17:25:07.809638+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.794845+0000","last_change":"2023-11-30T17:25:07.425073+0000","last_active":"2023-11-30T17:25:07.794845+0000","last_peered":"2023-11-30T17:25:07.794845+0000","last_clean":"2023-11-30T17:25:07.794845+0000","last_became_active":"2023-11-30T17:25:07.424780+0000","last_became_peered":"2023-11-30T17:25:07.424780+0000","last_unstale":"2023-11-30T17:25:07.794845+0000","last_undegraded":"2023-11-30T17:25:07.794845+0000","last_fullsized":"2023-11-30T17:25:07.794845+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":110,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.790593+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:25:07.790593+0000","last_peered":"2023-11-30T17:25:07.790593+0000","last_clean":"2023-11-30T17:25:07.790593+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:25:07.790593+0000","last_undegraded":"2023-11-30T17:25:07.790593+0000","last_fullsized":"2023-11-30T17:25:07.790593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.816194+0000","last_change":"2023-11-30T17:25:07.812012+0000","last_active":"2023-11-30T17:25:07.816194+0000","last_peered":"2023-11-30T17:25:07.816194+0000","last_clean":"2023-11-30T17:25:07.816194+0000","last_became_active":"2023-11-30T17:25:07.811151+0000","last_became_peered":"2023-11-30T17:25:07.811151+0000","last_unstale":"2023-11-30T17:25:07.816194+0000","last_undegraded":"2023-11-30T17:25:07.816194+0000","last_fullsized":"2023-11-30T17:25:07.816194+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"129'2","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.807859+0000","last_change":"2023-11-30T17:25:07.425188+0000","last_active":"2023-11-30T17:25:07.807859+0000","last_peered":"2023-11-30T17:25:07.807859+0000","last_clean":"2023-11-30T17:25:07.807859+0000","last_became_active":"2023-11-30T17:25:07.424918+0000","last_became_peered":"2023-11-30T17:25:07.424918+0000","last_unstale":"2023-11-30T17:25:07.807859+0000","last_undegraded":"2023-11-30T17:25:07.807859+0000","last_fullsized":"2023-11-30T17:25:07.807859+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":104,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.796648+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:25:07.796648+0000","last_peered":"2023-11-30T17:25:07.796648+0000","last_clean":"2023-11-30T17:25:07.796648+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:25:07.796648+0000","last_undegraded":"2023-11-30T17:25:07.796648+0000","last_fullsized":"2023-11-30T17:25:07.796648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":106,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.803320+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:25:07.803320+0000","last_peered":"2023-11-30T17:25:07.803320+0000","last_clean":"2023-11-30T17:25:07.803320+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:25:07.803320+0000","last_undegraded":"2023-11-30T17:25:07.803320+0000","last_fullsized":"2023-11-30T17:25:07.803320+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.809320+0000","last_change":"2023-11-30T17:25:07.803155+0000","last_active":"2023-11-30T17:25:07.809320+0000","last_peered":"2023-11-30T17:25:07.809320+0000","last_clean":"2023-11-30T17:25:07.809320+0000","last_became_active":"2023-11-30T17:25:07.802884+0000","last_became_peered":"2023-11-30T17:25:07.802884+0000","last_unstale":"2023-11-30T17:25:07.809320+0000","last_undegraded":"2023-11-30T17:25:07.809320+0000","last_fullsized":"2023-11-30T17:25:07.809320+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.804201+0000","last_change":"2023-11-30T17:25:07.428103+0000","last_active":"2023-11-30T17:25:07.804201+0000","last_peered":"2023-11-30T17:25:07.804201+0000","last_clean":"2023-11-30T17:25:07.804201+0000","last_became_active":"2023-11-30T17:25:07.427437+0000","last_became_peered":"2023-11-30T17:25:07.427437+0000","last_unstale":"2023-11-30T17:25:07.804201+0000","last_undegraded":"2023-11-30T17:25:07.804201+0000","last_fullsized":"2023-11-30T17:25:07.804201+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":104,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.803402+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:25:07.803402+0000","last_peered":"2023-11-30T17:25:07.803402+0000","last_clean":"2023-11-30T17:25:07.803402+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:25:07.803402+0000","last_undegraded":"2023-11-30T17:25:07.803402+0000","last_fullsized":"2023-11-30T17:25:07.803402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.812730+0000","last_change":"2023-11-30T17:25:07.807301+0000","last_active":"2023-11-30T17:25:07.812730+0000","last_peered":"2023-11-30T17:25:07.812730+0000","last_clean":"2023-11-30T17:25:07.812730+0000","last_became_active":"2023-11-30T17:25:07.807025+0000","last_became_peered":"2023-11-30T17:25:07.807025+0000","last_unstale":"2023-11-30T17:25:07.812730+0000","last_undegraded":"2023-11-30T17:25:07.812730+0000","last_fullsized":"2023-11-30T17:25:07.812730+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.790445+0000","last_change":"2023-11-30T17:25:07.426633+0000","last_active":"2023-11-30T17:25:07.790445+0000","last_peered":"2023-11-30T17:25:07.790445+0000","last_clean":"2023-11-30T17:25:07.790445+0000","last_became_active":"2023-11-30T17:25:07.426300+0000","last_became_peered":"2023-11-30T17:25:07.426300+0000","last_unstale":"2023-11-30T17:25:07.790445+0000","last_undegraded":"2023-11-30T17:25:07.790445+0000","last_fullsized":"2023-11-30T17:25:07.790445+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":104,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.804349+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:25:07.804349+0000","last_peered":"2023-11-30T17:25:07.804349+0000","last_clean":"2023-11-30T17:25:07.804349+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:25:07.804349+0000","last_undegraded":"2023-11-30T17:25:07.804349+0000","last_fullsized":"2023-11-30T17:25:07.804349+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.812594+0000","last_change":"2023-11-30T17:25:07.808255+0000","last_active":"2023-11-30T17:25:07.812594+0000","last_peered":"2023-11-30T17:25:07.812594+0000","last_clean":"2023-11-30T17:25:07.812594+0000","last_became_active":"2023-11-30T17:25:07.807981+0000","last_became_peered":"2023-11-30T17:25:07.807981+0000","last_unstale":"2023-11-30T17:25:07.812594+0000","last_undegraded":"2023-11-30T17:25:07.812594+0000","last_fullsized":"2023-11-30T17:25:07.812594+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.805149+0000","last_change":"2023-11-30T17:25:07.419740+0000","last_active":"2023-11-30T17:25:07.805149+0000","last_peered":"2023-11-30T17:25:07.805149+0000","last_clean":"2023-11-30T17:25:07.805149+0000","last_became_active":"2023-11-30T17:25:07.419448+0000","last_became_peered":"2023-11-30T17:25:07.419448+0000","last_unstale":"2023-11-30T17:25:07.805149+0000","last_undegraded":"2023-11-30T17:25:07.805149+0000","last_fullsized":"2023-11-30T17:25:07.805149+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":107,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.797332+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:25:07.797332+0000","last_peered":"2023-11-30T17:25:07.797332+0000","last_clean":"2023-11-30T17:25:07.797332+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:25:07.797332+0000","last_undegraded":"2023-11-30T17:25:07.797332+0000","last_fullsized":"2023-11-30T17:25:07.797332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.807849+0000","last_change":"2023-11-30T17:25:07.804132+0000","last_active":"2023-11-30T17:25:07.807849+0000","last_peered":"2023-11-30T17:25:07.807849+0000","last_clean":"2023-11-30T17:25:07.807849+0000","last_became_active":"2023-11-30T17:25:07.803746+0000","last_became_peered":"2023-11-30T17:25:07.803746+0000","last_unstale":"2023-11-30T17:25:07.807849+0000","last_undegraded":"2023-11-30T17:25:07.807849+0000","last_fullsized":"2023-11-30T17:25:07.807849+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.790668+0000","last_change":"2023-11-30T17:25:07.426346+0000","last_active":"2023-11-30T17:25:07.790668+0000","last_peered":"2023-11-30T17:25:07.790668+0000","last_clean":"2023-11-30T17:25:07.790668+0000","last_became_active":"2023-11-30T17:25:07.426056+0000","last_became_peered":"2023-11-30T17:25:07.426056+0000","last_unstale":"2023-11-30T17:25:07.790668+0000","last_undegraded":"2023-11-30T17:25:07.790668+0000","last_fullsized":"2023-11-30T17:25:07.790668+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":118,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.797119+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:25:07.797119+0000","last_peered":"2023-11-30T17:25:07.797119+0000","last_clean":"2023-11-30T17:25:07.797119+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:25:07.797119+0000","last_undegraded":"2023-11-30T17:25:07.797119+0000","last_fullsized":"2023-11-30T17:25:07.797119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575061,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302764,"kb_used_data":1572,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069076,"statfs":{"total":96636764160,"available":96326733824,"internally_reserved":0,"allocated":1609728,"data_stored":811271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56899999999999995,"15min":0.58399999999999996},"min":{"1min":0.443,"5min":0.315,"15min":0.315},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57299999999999995,"15min":0.58799999999999997},"min":{"1min":0.48599999999999999,"5min":0.41099999999999998,"15min":0.36699999999999999},"max":{"1min":0.75,"5min":0.78300000000000003,"15min":0.81899999999999995},"last":0.57599999999999996}]},{"osd":1,"last update":"Thu Nov 30 17:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53600000000000003,"15min":0.54700000000000004},"min":{"1min":0.44900000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69799999999999995,"5min":1.181,"15min":1.181},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53000000000000003,"15min":0.54900000000000004},"min":{"1min":0.46200000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.72999999999999998,"5min":0.76600000000000001,"15min":0.82499999999999996},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.54900000000000004,"15min":0.55500000000000005},"min":{"1min":0.46500000000000002,"5min":0.34200000000000003,"15min":0.33500000000000002},"max":{"1min":0.75800000000000001,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54500000000000004,"15min":0.55800000000000005},"min":{"1min":0.42999999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72099999999999997,"5min":0.73699999999999999,"15min":0.83899999999999997},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Nov 30 17:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.52800000000000002,"15min":0.54400000000000004},"min":{"1min":0.41099999999999998,"5min":0.36499999999999999,"15min":0.36299999999999999},"max":{"1min":0.74399999999999999,"5min":0.749,"15min":0.78000000000000003},"last":0.376},{"interface":"front","average":{"1min":0.621,"5min":0.58099999999999996,"15min":0.58599999999999997},"min":{"1min":0.46800000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78000000000000003,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46100000000000002,"15min":0.45400000000000001},"min":{"1min":0.308,"5min":0.29899999999999999,"15min":0.29699999999999999},"max":{"1min":0.66900000000000004,"5min":0.77000000000000002,"15min":0.77500000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.48499999999999999,"15min":0.47599999999999998},"min":{"1min":0.37,"5min":0.30099999999999999,"15min":0.29399999999999998},"max":{"1min":0.70199999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Nov 30 17:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.497,"15min":0.48399999999999999},"min":{"1min":0.37,"5min":0.313,"15min":0.29499999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.622},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53000000000000003,"15min":0.51900000000000002},"min":{"1min":0.33900000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.81299999999999994},"last":0.72599999999999998}]},{"osd":6,"last update":"Thu Nov 30 17:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56299999999999994,"15min":0.54700000000000004},"min":{"1min":0.37,"5min":0.307,"15min":0.307},"max":{"1min":0.75800000000000001,"5min":0.81200000000000006,"15min":0.85199999999999998},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55500000000000005,"15min":0.54300000000000004},"min":{"1min":0.34799999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77200000000000002,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.59699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575060,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302772,"kb_used_data":1580,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069068,"statfs":{"total":96636764160,"available":96326725632,"internally_reserved":0,"allocated":1617920,"data_stored":811847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55100000000000005,"15min":0.57499999999999996},"min":{"1min":0.51700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.80200000000000005,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56299999999999994,"15min":0.58899999999999997},"min":{"1min":0.49299999999999999,"5min":0.33500000000000002,"15min":0.308},"max":{"1min":0.71899999999999997,"5min":0.83599999999999997,"15min":0.89300000000000002},"last":0.75600000000000001}]},{"osd":1,"last update":"Thu Nov 30 17:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53200000000000003,"15min":0.56599999999999995},"min":{"1min":0.46200000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70799999999999996,"5min":0.78400000000000003,"15min":0.82799999999999996},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.57999999999999996,"15min":0.60199999999999998},"min":{"1min":0.49399999999999999,"5min":0.35899999999999999,"15min":0.313},"max":{"1min":0.78000000000000003,"5min":0.80000000000000004,"15min":0.85199999999999998},"last":0.78800000000000003}]},{"osd":2,"last update":"Thu Nov 30 17:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54600000000000004,"15min":0.57299999999999995},"min":{"1min":0.45800000000000002,"5min":0.34200000000000003,"15min":0.26500000000000001},"max":{"1min":0.748,"5min":0.78800000000000003,"15min":0.80100000000000005},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56299999999999994,"15min":0.58299999999999996},"min":{"1min":0.47899999999999998,"5min":0.34399999999999997,"15min":0.34300000000000003},"max":{"1min":0.76000000000000001,"5min":0.82299999999999995,"15min":0.82499999999999996},"last":0.76600000000000001}]},{"osd":3,"last update":"Thu Nov 30 17:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.502,"15min":0.53000000000000003},"min":{"1min":0.39300000000000002,"5min":0.32700000000000001,"15min":0.28299999999999997},"max":{"1min":0.625,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51700000000000002,"15min":0.53900000000000003},"min":{"1min":0.39200000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.69199999999999995,"5min":0.752,"15min":0.79600000000000004},"last":0.72899999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69399999999999995,"5min":0.80800000000000005,"15min":0.84199999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.434,"5min":0.46600000000000003,"15min":0.47499999999999998},"min":{"1min":0.32300000000000001,"5min":0.312,"15min":0.23100000000000001},"max":{"1min":0.54400000000000004,"5min":0.746,"15min":0.83899999999999997},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Nov 30 17:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46400000000000002,"15min":0.46800000000000003},"min":{"1min":0.35399999999999998,"5min":0.312,"15min":0.29899999999999999},"max":{"1min":0.58499999999999996,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.629},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.5,"15min":0.503},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69199999999999995,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Nov 30 17:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52500000000000002,"15min":0.52800000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.754,"5min":0.80000000000000004,"15min":0.93200000000000005},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54900000000000004,"15min":0.55800000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.34300000000000003},"max":{"1min":0.69499999999999995,"5min":0.81299999999999994,"15min":0.83499999999999996},"last":0.77700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575060,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306872,"kb_used_data":1584,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064968,"statfs":{"total":96636764160,"available":96322527232,"internally_reserved":0,"allocated":1622016,"data_stored":812731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:24:52 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.36399999999999999,"15min":0.35999999999999999},"min":{"1min":0.26200000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.39900000000000002,"5min":1.78,"15min":1.78},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.35099999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.63500000000000001,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.34699999999999998}]},{"osd":2,"last update":"Thu Nov 30 17:24:52 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39200000000000002},"min":{"1min":0.27800000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.53900000000000003,"5min":1.665,"15min":1.665},"last":0.253},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.49399999999999999,"15min":0.50600000000000001},"min":{"1min":0.40100000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.60499999999999998,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Nov 30 17:24:52 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.44700000000000001,"15min":0.45200000000000001},"min":{"1min":0.34200000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64900000000000002,"5min":1.865,"15min":1.865},"last":0.307},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42699999999999999,"15min":0.436},"min":{"1min":0.33900000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.47399999999999998,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.29499999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:24:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57599999999999996,"15min":0.59199999999999997},"min":{"1min":0.38600000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80400000000000005,"5min":0.873,"15min":0.89100000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.47899999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.755,"5min":0.85099999999999998,"15min":1.111},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Nov 30 17:24:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60799999999999998,"15min":0.60999999999999999},"min":{"1min":0.47199999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.74099999999999999,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60199999999999998,"15min":0.61199999999999999},"min":{"1min":0.45900000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75,"5min":0.874,"15min":0.91300000000000003},"last":0.60699999999999998}]},{"osd":6,"last update":"Thu Nov 30 17:24:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64600000000000002,"15min":0.66000000000000003},"min":{"1min":0.54900000000000004,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79000000000000004,"5min":0.91000000000000003,"15min":1.0600000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.65400000000000003,"15min":0.66500000000000004},"min":{"1min":0.433,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78300000000000003,"5min":1.635,"15min":1.635},"last":0.50700000000000001}]},{"osd":7,"last update":"Thu Nov 30 17:24:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.66300000000000003,"15min":0.67400000000000004},"min":{"1min":0.48699999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79100000000000004,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.63500000000000001,"15min":0.65300000000000002},"min":{"1min":0.48499999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77100000000000002,"5min":0.90200000000000002,"15min":0.94199999999999995},"last":0.64000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575060,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302772,"kb_used_data":1580,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069068,"statfs":{"total":96636764160,"available":96326725632,"internally_reserved":0,"allocated":1617920,"data_stored":811915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 17:24:30 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.35999999999999999,"15min":0.36599999999999999},"min":{"1min":0.25900000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.71199999999999997},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.371,"15min":0.38500000000000001},"min":{"1min":0.28699999999999998,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.502,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.247}]},{"osd":2,"last update":"Thu Nov 30 17:24:30 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.375,"15min":0.38700000000000001},"min":{"1min":0.26800000000000002,"5min":0.24399999999999999,"15min":0.23899999999999999},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.623},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.436,"15min":0.45700000000000002},"min":{"1min":0.35299999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.70499999999999996},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Nov 30 17:24:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.40899999999999997,"15min":0.42899999999999999},"min":{"1min":0.26700000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.70999999999999996},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.42199999999999999,"15min":0.441},"min":{"1min":0.308,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61599999999999999,"5min":0.63700000000000001,"15min":0.68799999999999994},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:24:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57899999999999996,"15min":0.60199999999999998},"min":{"1min":0.441,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76000000000000001,"5min":0.78800000000000003,"15min":0.96099999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59399999999999997,"15min":0.61899999999999999},"min":{"1min":0.45700000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80300000000000005,"5min":0.86899999999999999,"15min":0.98599999999999999},"last":0.75600000000000001}]},{"osd":5,"last update":"Thu Nov 30 17:24:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58699999999999997,"15min":0.60299999999999998},"min":{"1min":0.42699999999999999,"5min":0.39500000000000002,"15min":0.39200000000000002},"max":{"1min":0.72699999999999998,"5min":0.86799999999999999,"15min":1.0109999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60199999999999998,"15min":0.626},"min":{"1min":0.46999999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.872,"5min":0.90100000000000002,"15min":1.004},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Nov 30 17:24:30 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61399999999999999,"15min":0.64100000000000001},"min":{"1min":0.46000000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.84799999999999998,"5min":0.89800000000000002,"15min":1.002},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.435,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.96799999999999997},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Nov 30 17:24:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.627,"15min":0.64900000000000002},"min":{"1min":0.496,"5min":0.439,"15min":0.439},"max":{"1min":0.92700000000000005,"5min":0.94499999999999995,"15min":1.0129999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65900000000000003,"15min":0.68500000000000005},"min":{"1min":0.46700000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.026},"last":0.79700000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575060,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306864,"kb_used_data":1576,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064976,"statfs":{"total":96636764160,"available":96322535424,"internally_reserved":0,"allocated":1613824,"data_stored":811285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.40999999999999998,"15min":0.40200000000000002},"min":{"1min":0.23799999999999999,"5min":0.221,"15min":0.19900000000000001},"max":{"1min":0.58999999999999997,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42699999999999999,"15min":0.438},"min":{"1min":0.309,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.57499999999999996,"5min":2.637,"15min":2.637},"last":0.27900000000000003}]},{"osd":1,"last update":"Thu Nov 30 17:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.47999999999999998,"15min":0.46100000000000002},"min":{"1min":0.28999999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53300000000000003,"5min":6.1210000000000004,"15min":6.1210000000000004},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.499,"15min":0.48999999999999999},"min":{"1min":0.34699999999999998,"5min":0.30399999999999999,"15min":0.26700000000000002},"max":{"1min":0.58699999999999997,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.32800000000000001}]},{"osd":3,"last update":"Thu Nov 30 17:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.373,"15min":0.40000000000000002},"min":{"1min":0.29699999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.501,"5min":0.56200000000000006,"15min":0.86199999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.443,"15min":0.46600000000000003},"min":{"1min":0.32800000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.60899999999999999,"5min":1.756,"15min":1.756},"last":0.379}]},{"osd":4,"last update":"Thu Nov 30 17:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.67700000000000005,"15min":0.64500000000000002},"min":{"1min":0.40999999999999998,"5min":0.40300000000000002,"15min":0.33500000000000002},"max":{"1min":0.77200000000000002,"5min":8.7170000000000005,"15min":8.7170000000000005},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58099999999999996,"15min":0.60699999999999998},"min":{"1min":0.40999999999999998,"5min":0.377,"15min":0.371},"max":{"1min":0.77400000000000002,"5min":1.381,"15min":1.492},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Nov 30 17:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.626,"15min":0.63700000000000001},"min":{"1min":0.45100000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.85999999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61499999999999999,"15min":0.63600000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38900000000000001},"max":{"1min":0.82099999999999995,"5min":1.982,"15min":1.982},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Nov 30 17:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59599999999999997,"15min":0.623},"min":{"1min":0.44600000000000001,"5min":0.40899999999999997,"15min":0.39600000000000002},"max":{"1min":0.77900000000000003,"5min":0.95999999999999996,"15min":1.359},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64000000000000001,"15min":0.66300000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.39600000000000002},"max":{"1min":0.82199999999999995,"5min":1.861,"15min":1.861},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Nov 30 17:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67500000000000004,"15min":0.68200000000000005},"min":{"1min":0.46800000000000003,"5min":0.438,"15min":0.438},"max":{"1min":0.84799999999999998,"5min":4.6849999999999996,"15min":4.6849999999999996},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68500000000000005,"15min":0.69299999999999995},"min":{"1min":0.45600000000000002,"5min":0.433,"15min":0.41499999999999998},"max":{"1min":0.84099999999999997,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.61099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575060,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306856,"kb_used_data":1568,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064984,"statfs":{"total":96636764160,"available":96322543616,"internally_reserved":0,"allocated":1605632,"data_stored":811181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.33900000000000002,"15min":0.36399999999999999},"min":{"1min":0.27500000000000002,"5min":0.222,"15min":0.219},"max":{"1min":0.51100000000000001,"5min":0.54100000000000004,"15min":0.66200000000000003},"last":0.313},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.38100000000000001,"15min":0.40500000000000003},"min":{"1min":0.27200000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.56499999999999995,"5min":0.57199999999999995,"15min":0.67600000000000005},"last":0.42399999999999999}]},{"osd":1,"last update":"Thu Nov 30 17:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.35999999999999999,"15min":0.38700000000000001},"min":{"1min":0.28100000000000003,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.53700000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.39800000000000002,"15min":0.42899999999999999},"min":{"1min":0.32000000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57999999999999996,"5min":0.59699999999999998,"15min":0.73399999999999999},"last":0.376}]},{"osd":2,"last update":"Thu Nov 30 17:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.41799999999999998,"15min":0.45000000000000001},"min":{"1min":0.32200000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59199999999999997,"5min":0.66000000000000003,"15min":0.94899999999999995},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.47799999999999998,"15min":0.51100000000000001},"min":{"1min":0.39000000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68600000000000005,"5min":1.054,"15min":1.054},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Nov 30 17:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.57799999999999996,"15min":0.60799999999999998},"min":{"1min":0.41699999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.97599999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.58499999999999996,"15min":0.61299999999999999},"min":{"1min":0.42799999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.91400000000000003},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Nov 30 17:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57399999999999995,"15min":0.60999999999999999},"min":{"1min":0.47299999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.98399999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.61499999999999999,"15min":0.64100000000000001},"min":{"1min":0.47099999999999997,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.92800000000000005,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.45600000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.61299999999999999,"15min":0.64100000000000001},"min":{"1min":0.437,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86599999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61699999999999999,"15min":0.64700000000000002},"min":{"1min":0.48999999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.0389999999999999},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Nov 30 17:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.61899999999999999,"15min":0.65800000000000003},"min":{"1min":0.40699999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.0660000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.625,"15min":0.66000000000000003},"min":{"1min":0.44600000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.89100000000000001,"5min":0.98999999999999999,"15min":1.004},"last":0.66000000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575060,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302768,"kb_used_data":1576,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069072,"statfs":{"total":96636764160,"available":96326729728,"internally_reserved":0,"allocated":1613824,"data_stored":812095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.35399999999999998,"5min":0.28299999999999997,"15min":0.27500000000000002},"max":{"1min":0.71499999999999997,"5min":0.748,"15min":0.80900000000000005},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.52200000000000002,"15min":0.54200000000000004},"min":{"1min":0.38700000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.71099999999999997,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Nov 30 17:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.52100000000000002,"15min":0.54200000000000004},"min":{"1min":0.40300000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.79600000000000004},"last":0.376},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54400000000000004,"15min":0.54700000000000004},"min":{"1min":0.34399999999999997,"5min":0.317,"15min":0.30399999999999999},"max":{"1min":0.77800000000000002,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu Nov 30 17:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55800000000000005,"15min":0.57599999999999996},"min":{"1min":0.39200000000000002,"5min":0.36899999999999999,"15min":0.34499999999999997},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.84099999999999997},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57499999999999996,"15min":0.59399999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78600000000000003,"5min":0.79500000000000004,"15min":0.81399999999999995},"last":0.45700000000000002}]},{"osd":3,"last update":"Thu Nov 30 17:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53500000000000003,"15min":0.54800000000000004},"min":{"1min":0.41199999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77000000000000002,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.44},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.55100000000000005,"15min":0.56899999999999995},"min":{"1min":0.376,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76100000000000001,"5min":0.76500000000000001,"15min":0.79200000000000004},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Nov 30 17:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.44400000000000001,"15min":0.437},"min":{"1min":0.27700000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.54700000000000004,"5min":1.272,"15min":1.272},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.45600000000000002,"15min":0.45100000000000001},"min":{"1min":0.29499999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.51600000000000001,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.51800000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.503,"15min":0.49399999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.314},"max":{"1min":0.59899999999999998,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.374,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.629,"5min":1.129,"15min":1.129},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Nov 30 17:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.50900000000000001,"15min":0.50600000000000001},"min":{"1min":0.307,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.73099999999999998,"5min":0.81999999999999995,"15min":0.82199999999999995},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.38200000000000001,"5min":0.34999999999999998,"15min":0.34599999999999997},"max":{"1min":0.75,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.56499999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575060,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302764,"kb_used_data":1572,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069076,"statfs":{"total":96636764160,"available":96326733824,"internally_reserved":0,"allocated":1609728,"data_stored":811735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52700000000000002,"15min":0.54000000000000004},"min":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.496},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.51600000000000001,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.311,"15min":0.31},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.38100000000000001}]},{"osd":1,"last update":"Thu Nov 30 17:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.53200000000000003},"min":{"1min":0.33700000000000002,"5min":0.33100000000000002,"15min":0.32300000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.51300000000000001,"15min":0.54800000000000004},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.39500000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56000000000000005,"15min":0.58799999999999997},"min":{"1min":0.42699999999999999,"5min":0.34399999999999997,"15min":0.30599999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56899999999999995,"15min":0.59599999999999997},"min":{"1min":0.40000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.45700000000000002}]},{"osd":3,"last update":"Thu Nov 30 17:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52100000000000002,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55000000000000004,"15min":0.56899999999999995},"min":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.99299999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Nov 30 17:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.434,"15min":0.434},"min":{"1min":0.29499999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46000000000000002,"15min":0.46400000000000002},"min":{"1min":0.307,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.439}]},{"osd":6,"last update":"Thu Nov 30 17:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48499999999999999,"15min":0.48299999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.371,"5min":0.34499999999999997,"15min":0.33500000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.56299999999999994}]},{"osd":7,"last update":"Thu Nov 30 17:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.35099999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.56699999999999995,"15min":0.57299999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.34899999999999998},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.54400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:25:11.822 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:25:11.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.970+0000 7fef70862700 1 Processor -- start 2023-11-30T17:25:11.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.970+0000 7fef70862700 1 -- start start 2023-11-30T17:25:11.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.971+0000 7fef70862700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fef6c157660 0x7fef6c157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:11.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.971+0000 7fef70862700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef6c0c0180 0x7fef6c1589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:11.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.971+0000 7fef70862700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef6c0c12c0 con 0x7fef6c0c1750 2023-11-30T17:25:11.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.971+0000 7fef70862700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef6c0c06b0 con 0x7fef6c157660 2023-11-30T17:25:11.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.971+0000 7fef70862700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c0c0990 con 0x7fef6c0c0180 2023-11-30T17:25:11.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.971+0000 7fef6ad9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fef6c157660 0x7fef6c157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:11.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.971+0000 7fef6ad9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fef6c157660 0x7fef6c157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59692/0 (socket says 172.21.15.49:59692) 2023-11-30T17:25:11.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.971+0000 7fef6ad9d700 1 -- 172.21.15.49:0/3731831897 learned_addr learned my addr 172.21.15.49:0/3731831897 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:11.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.971+0000 7fef6a59c700 1 --2- 172.21.15.49:0/3731831897 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef6c0c0180 0x7fef6c1589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:11.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.971+0000 7fef6ad9d700 1 -- 172.21.15.49:0/3731831897 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef6c0c0180 msgr2=0x7fef6c1589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:11.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.971+0000 7fef6ad9d700 1 --2- 172.21.15.49:0/3731831897 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef6c0c0180 0x7fef6c1589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:11.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.971+0000 7fef6ad9d700 1 -- 172.21.15.49:0/3731831897 >> v1:172.21.15.115:6789/0 conn(0x7fef6c0c1750 legacy=0x7fef6c0648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:11.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.971+0000 7fef6ad9d700 1 -- 172.21.15.49:0/3731831897 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c0c0c70 con 0x7fef6c157660 2023-11-30T17:25:11.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.971+0000 7fef6ad9d700 1 --2- 172.21.15.49:0/3731831897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef6c157660 0x7fef6c157a40 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7fef5c009f20 tx=0x7fef5c009840).ready entity=mon.0 client_cookie=aa3a75f49f44f1fa server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:11.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.972+0000 7fef69d9b700 1 -- 172.21.15.49:0/3731831897 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c00e070 con 0x7fef6c157660 2023-11-30T17:25:11.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.972+0000 7fef69d9b700 1 -- 172.21.15.49:0/3731831897 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5c00ba80 con 0x7fef6c157660 2023-11-30T17:25:11.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.972+0000 7fef69d9b700 1 -- 172.21.15.49:0/3731831897 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c00be00 con 0x7fef6c157660 2023-11-30T17:25:11.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.972+0000 7fef70862700 1 -- 172.21.15.49:0/3731831897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef6c157660 msgr2=0x7fef6c157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:11.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.972+0000 7fef70862700 1 --2- 172.21.15.49:0/3731831897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef6c157660 0x7fef6c157a40 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7fef5c009f20 tx=0x7fef5c009840).stop 2023-11-30T17:25:11.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.972+0000 7fef70862700 1 -- 172.21.15.49:0/3731831897 shutdown_connections 2023-11-30T17:25:11.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.972+0000 7fef70862700 1 --2- 172.21.15.49:0/3731831897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef6c157660 0x7fef6c157a40 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:11.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.972+0000 7fef70862700 1 --2- 172.21.15.49:0/3731831897 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef6c0c0180 0x7fef6c1589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:11.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.972+0000 7fef70862700 1 -- 172.21.15.49:0/3731831897 >> 172.21.15.49:0/3731831897 conn(0x7fef6c0cb000 msgr2=0x7fef6c0cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:11.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.972+0000 7fef70862700 1 -- 172.21.15.49:0/3731831897 shutdown_connections 2023-11-30T17:25:11.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.972+0000 7fef70862700 1 -- 172.21.15.49:0/3731831897 wait complete. 2023-11-30T17:25:11.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.973+0000 7fef70862700 1 Processor -- start 2023-11-30T17:25:11.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.973+0000 7fef70862700 1 -- start start 2023-11-30T17:25:11.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.974+0000 7fef70862700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef6c0c0180 0x7fef6c0c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:11.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.974+0000 7fef70862700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef6c0c1750 0x7fef6c0c1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:11.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.974+0000 7fef70862700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef6c157660 0x7fef6c0c2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:11.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.974+0000 7fef70862700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c139470 con 0x7fef6c0c1750 2023-11-30T17:25:11.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.974+0000 7fef70862700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c1598d0 con 0x7fef6c157660 2023-11-30T17:25:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.974+0000 7fef70862700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c0aea60 con 0x7fef6c0c0180 2023-11-30T17:25:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.974+0000 7fef6a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef6c0c1750 0x7fef6c0c1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.974+0000 7fef6a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef6c0c1750 0x7fef6c0c1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59704/0 (socket says 172.21.15.49:59704) 2023-11-30T17:25:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.974+0000 7fef6a59c700 1 -- 172.21.15.49:0/3577006560 learned_addr learned my addr 172.21.15.49:0/3577006560 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.974+0000 7fef6ad9d700 1 --2- 172.21.15.49:0/3577006560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef6c0c0180 0x7fef6c0c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.974+0000 7fef6b59e700 1 --2- 172.21.15.49:0/3577006560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef6c157660 0x7fef6c0c2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.975+0000 7fef6a59c700 1 -- 172.21.15.49:0/3577006560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef6c0c0180 msgr2=0x7fef6c0c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.975+0000 7fef6a59c700 1 --2- 172.21.15.49:0/3577006560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef6c0c0180 0x7fef6c0c49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.975+0000 7fef6a59c700 1 -- 172.21.15.49:0/3577006560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef6c157660 msgr2=0x7fef6c0c2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.975+0000 7fef6a59c700 1 --2- 172.21.15.49:0/3577006560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef6c157660 0x7fef6c0c2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.975+0000 7fef6a59c700 1 -- 172.21.15.49:0/3577006560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5c009ae0 con 0x7fef6c0c1750 2023-11-30T17:25:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.975+0000 7fef6ad9d700 1 --2- 172.21.15.49:0/3577006560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef6c0c0180 0x7fef6c0c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:25:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.975+0000 7fef6b59e700 1 --2- 172.21.15.49:0/3577006560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef6c157660 0x7fef6c0c2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:25:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.975+0000 7fef6a59c700 1 --2- 172.21.15.49:0/3577006560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef6c0c1750 0x7fef6c0c1c80 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7fef5400d860 tx=0x7fef54008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.975+0000 7fef62ffd700 1 -- 172.21.15.49:0/3577006560 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef540125f0 con 0x7fef6c0c1750 2023-11-30T17:25:11.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.975+0000 7fef62ffd700 1 -- 172.21.15.49:0/3577006560 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef54012750 con 0x7fef6c0c1750 2023-11-30T17:25:11.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.975+0000 7fef70862700 1 -- 172.21.15.49:0/3577006560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef6c0c4ec0 con 0x7fef6c0c1750 2023-11-30T17:25:11.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.975+0000 7fef62ffd700 1 -- 172.21.15.49:0/3577006560 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54012ad0 con 0x7fef6c0c1750 2023-11-30T17:25:11.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.975+0000 7fef70862700 1 -- 172.21.15.49:0/3577006560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef6c1595f0 con 0x7fef6c0c1750 2023-11-30T17:25:11.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.976+0000 7fef70862700 1 -- 172.21.15.49:0/3577006560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6c06c7c0 con 0x7fef6c0c1750 2023-11-30T17:25:11.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.977+0000 7fef62ffd700 1 -- 172.21.15.49:0/3577006560 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fef54013480 con 0x7fef6c0c1750 2023-11-30T17:25:11.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.977+0000 7fef62ffd700 1 --2- 172.21.15.49:0/3577006560 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fef4c05f240 0x7fef4c061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:11.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.977+0000 7fef62ffd700 1 -- 172.21.15.49:0/3577006560 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fef5407a5e0 con 0x7fef6c0c1750 2023-11-30T17:25:11.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.977+0000 7fef6ad9d700 1 --2- 172.21.15.49:0/3577006560 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fef4c05f240 0x7fef4c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:11.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.978+0000 7fef6ad9d700 1 --2- 172.21.15.49:0/3577006560 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fef4c05f240 0x7fef4c061700 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fef5c00c010 tx=0x7fef5c009840).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:11.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:11.981+0000 7fef62ffd700 1 -- 172.21.15.49:0/3577006560 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fef5404b6b0 con 0x7fef6c0c1750 2023-11-30T17:25:12.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.149+0000 7fef70862700 1 -- 172.21.15.49:0/3577006560 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fef6c0c0f50 con 0x7fef4c05f240 2023-11-30T17:25:12.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.160+0000 7fef62ffd700 1 -- 172.21.15.49:0/3577006560 <== mgr.6428 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361864 (secure 0 0 0) 0x7fef6c0c0f50 con 0x7fef4c05f240 2023-11-30T17:25:12.167 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:25:12.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.163+0000 7fef70862700 1 -- 172.21.15.49:0/3577006560 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fef4c05f240 msgr2=0x7fef4c061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:12.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.163+0000 7fef70862700 1 --2- 172.21.15.49:0/3577006560 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fef4c05f240 0x7fef4c061700 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fef5c00c010 tx=0x7fef5c009840).stop 2023-11-30T17:25:12.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.163+0000 7fef70862700 1 -- 172.21.15.49:0/3577006560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef6c0c1750 msgr2=0x7fef6c0c1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:12.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.163+0000 7fef70862700 1 --2- 172.21.15.49:0/3577006560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef6c0c1750 0x7fef6c0c1c80 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7fef5400d860 tx=0x7fef54008040).stop 2023-11-30T17:25:12.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.163+0000 7fef70862700 1 -- 172.21.15.49:0/3577006560 shutdown_connections 2023-11-30T17:25:12.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.163+0000 7fef70862700 1 --2- 172.21.15.49:0/3577006560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef6c157660 0x7fef6c0c2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:12.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.163+0000 7fef70862700 1 --2- 172.21.15.49:0/3577006560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef6c0c0180 0x7fef6c0c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:12.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.163+0000 7fef70862700 1 --2- 172.21.15.49:0/3577006560 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fef4c05f240 0x7fef4c061700 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:12.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.163+0000 7fef70862700 1 --2- 172.21.15.49:0/3577006560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef6c0c1750 0x7fef6c0c1c80 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:12.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.163+0000 7fef70862700 1 -- 172.21.15.49:0/3577006560 >> 172.21.15.49:0/3577006560 conn(0x7fef6c0cb000 msgr2=0x7fef6c0aae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:12.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.163+0000 7fef70862700 1 -- 172.21.15.49:0/3577006560 shutdown_connections 2023-11-30T17:25:12.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.163+0000 7fef70862700 1 -- 172.21.15.49:0/3577006560 wait complete. 2023-11-30T17:25:12.171 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:25:12.177 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-30T17:25:11.300325+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":223,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2434432,"kb_used_data":12608,"kb_used_omap":0,"kb_used_meta":2421760,"kb_avail":752540288,"statfs":{"total":773094113280,"available":770601254912,"internally_reserved":0,"allocated":12910592,"data_stored":6494060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2479882240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6812,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-61,"num_write_kb":-29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.002398"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.815575+0000","last_change":"2023-11-30T17:25:07.814893+0000","last_active":"2023-11-30T17:25:07.815575+0000","last_peered":"2023-11-30T17:25:07.815575+0000","last_clean":"2023-11-30T17:25:07.815575+0000","last_became_active":"2023-11-30T17:25:07.814694+0000","last_became_peered":"2023-11-30T17:25:07.814694+0000","last_unstale":"2023-11-30T17:25:07.815575+0000","last_undegraded":"2023-11-30T17:25:07.815575+0000","last_fullsized":"2023-11-30T17:25:07.815575+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3f","version":"129'3","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.815794+0000","last_change":"2023-11-30T17:25:07.428000+0000","last_active":"2023-11-30T17:25:07.815794+0000","last_peered":"2023-11-30T17:25:07.815794+0000","last_clean":"2023-11-30T17:25:07.815794+0000","last_became_active":"2023-11-30T17:25:07.427300+0000","last_became_peered":"2023-11-30T17:25:07.427300+0000","last_unstale":"2023-11-30T17:25:07.815794+0000","last_undegraded":"2023-11-30T17:25:07.815794+0000","last_fullsized":"2023-11-30T17:25:07.815794+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.809737+0000","last_change":"2023-11-30T17:25:07.806193+0000","last_active":"2023-11-30T17:25:07.809737+0000","last_peered":"2023-11-30T17:25:07.809737+0000","last_clean":"2023-11-30T17:25:07.809737+0000","last_became_active":"2023-11-30T17:25:07.804328+0000","last_became_peered":"2023-11-30T17:25:07.804328+0000","last_unstale":"2023-11-30T17:25:07.809737+0000","last_undegraded":"2023-11-30T17:25:07.809737+0000","last_fullsized":"2023-11-30T17:25:07.809737+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.793523+0000","last_change":"2023-11-30T17:25:07.431978+0000","last_active":"2023-11-30T17:25:07.793523+0000","last_peered":"2023-11-30T17:25:07.793523+0000","last_clean":"2023-11-30T17:25:07.793523+0000","last_became_active":"2023-11-30T17:25:07.431698+0000","last_became_peered":"2023-11-30T17:25:07.431698+0000","last_unstale":"2023-11-30T17:25:07.793523+0000","last_undegraded":"2023-11-30T17:25:07.793523+0000","last_fullsized":"2023-11-30T17:25:07.793523+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.819829+0000","last_change":"2023-11-30T17:25:07.812003+0000","last_active":"2023-11-30T17:25:07.819829+0000","last_peered":"2023-11-30T17:25:07.819829+0000","last_clean":"2023-11-30T17:25:07.819829+0000","last_became_active":"2023-11-30T17:25:07.811696+0000","last_became_peered":"2023-11-30T17:25:07.811696+0000","last_unstale":"2023-11-30T17:25:07.819829+0000","last_undegraded":"2023-11-30T17:25:07.819829+0000","last_fullsized":"2023-11-30T17:25:07.819829+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.794288+0000","last_change":"2023-11-30T17:25:07.423616+0000","last_active":"2023-11-30T17:25:07.794288+0000","last_peered":"2023-11-30T17:25:07.794288+0000","last_clean":"2023-11-30T17:25:07.794288+0000","last_became_active":"2023-11-30T17:25:07.423233+0000","last_became_peered":"2023-11-30T17:25:07.423233+0000","last_unstale":"2023-11-30T17:25:07.794288+0000","last_undegraded":"2023-11-30T17:25:07.794288+0000","last_fullsized":"2023-11-30T17:25:07.794288+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.805038+0000","last_change":"2023-11-30T17:25:07.802388+0000","last_active":"2023-11-30T17:25:07.805038+0000","last_peered":"2023-11-30T17:25:07.805038+0000","last_clean":"2023-11-30T17:25:07.805038+0000","last_became_active":"2023-11-30T17:25:07.802064+0000","last_became_peered":"2023-11-30T17:25:07.802064+0000","last_unstale":"2023-11-30T17:25:07.805038+0000","last_undegraded":"2023-11-30T17:25:07.805038+0000","last_fullsized":"2023-11-30T17:25:07.805038+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3c","version":"129'2","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.813645+0000","last_change":"2023-11-30T17:25:07.428517+0000","last_active":"2023-11-30T17:25:07.813645+0000","last_peered":"2023-11-30T17:25:07.813645+0000","last_clean":"2023-11-30T17:25:07.813645+0000","last_became_active":"2023-11-30T17:25:07.428217+0000","last_became_peered":"2023-11-30T17:25:07.428217+0000","last_unstale":"2023-11-30T17:25:07.813645+0000","last_undegraded":"2023-11-30T17:25:07.813645+0000","last_fullsized":"2023-11-30T17:25:07.813645+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.817328+0000","last_change":"2023-11-30T17:25:07.809062+0000","last_active":"2023-11-30T17:25:07.817328+0000","last_peered":"2023-11-30T17:25:07.817328+0000","last_clean":"2023-11-30T17:25:07.817328+0000","last_became_active":"2023-11-30T17:25:07.808788+0000","last_became_peered":"2023-11-30T17:25:07.808788+0000","last_unstale":"2023-11-30T17:25:07.817328+0000","last_undegraded":"2023-11-30T17:25:07.817328+0000","last_fullsized":"2023-11-30T17:25:07.817328+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.811110+0000","last_change":"2023-11-30T17:25:07.415843+0000","last_active":"2023-11-30T17:25:07.811110+0000","last_peered":"2023-11-30T17:25:07.811110+0000","last_clean":"2023-11-30T17:25:07.811110+0000","last_became_active":"2023-11-30T17:25:07.415507+0000","last_became_peered":"2023-11-30T17:25:07.415507+0000","last_unstale":"2023-11-30T17:25:07.811110+0000","last_undegraded":"2023-11-30T17:25:07.811110+0000","last_fullsized":"2023-11-30T17:25:07.811110+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.807866+0000","last_change":"2023-11-30T17:25:07.803190+0000","last_active":"2023-11-30T17:25:07.807866+0000","last_peered":"2023-11-30T17:25:07.807866+0000","last_clean":"2023-11-30T17:25:07.807866+0000","last_became_active":"2023-11-30T17:25:07.802966+0000","last_became_peered":"2023-11-30T17:25:07.802966+0000","last_unstale":"2023-11-30T17:25:07.807866+0000","last_undegraded":"2023-11-30T17:25:07.807866+0000","last_fullsized":"2023-11-30T17:25:07.807866+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3a","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.809538+0000","last_change":"2023-11-30T17:25:07.424422+0000","last_active":"2023-11-30T17:25:07.809538+0000","last_peered":"2023-11-30T17:25:07.809538+0000","last_clean":"2023-11-30T17:25:07.809538+0000","last_became_active":"2023-11-30T17:25:07.424026+0000","last_became_peered":"2023-11-30T17:25:07.424026+0000","last_unstale":"2023-11-30T17:25:07.809538+0000","last_undegraded":"2023-11-30T17:25:07.809538+0000","last_fullsized":"2023-11-30T17:25:07.809538+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.819704+0000","last_change":"2023-11-30T17:25:07.810895+0000","last_active":"2023-11-30T17:25:07.819704+0000","last_peered":"2023-11-30T17:25:07.819704+0000","last_clean":"2023-11-30T17:25:07.819704+0000","last_became_active":"2023-11-30T17:25:07.810586+0000","last_became_peered":"2023-11-30T17:25:07.810586+0000","last_unstale":"2023-11-30T17:25:07.819704+0000","last_undegraded":"2023-11-30T17:25:07.819704+0000","last_fullsized":"2023-11-30T17:25:07.819704+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.802374+0000","last_change":"2023-11-30T17:25:07.424353+0000","last_active":"2023-11-30T17:25:07.802374+0000","last_peered":"2023-11-30T17:25:07.802374+0000","last_clean":"2023-11-30T17:25:07.802374+0000","last_became_active":"2023-11-30T17:25:07.424062+0000","last_became_peered":"2023-11-30T17:25:07.424062+0000","last_unstale":"2023-11-30T17:25:07.802374+0000","last_undegraded":"2023-11-30T17:25:07.802374+0000","last_fullsized":"2023-11-30T17:25:07.802374+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.819905+0000","last_change":"2023-11-30T17:25:07.815786+0000","last_active":"2023-11-30T17:25:07.819905+0000","last_peered":"2023-11-30T17:25:07.819905+0000","last_clean":"2023-11-30T17:25:07.819905+0000","last_became_active":"2023-11-30T17:25:07.812404+0000","last_became_peered":"2023-11-30T17:25:07.812404+0000","last_unstale":"2023-11-30T17:25:07.819905+0000","last_undegraded":"2023-11-30T17:25:07.819905+0000","last_fullsized":"2023-11-30T17:25:07.819905+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.795344+0000","last_change":"2023-11-30T17:25:07.425636+0000","last_active":"2023-11-30T17:25:07.795344+0000","last_peered":"2023-11-30T17:25:07.795344+0000","last_clean":"2023-11-30T17:25:07.795344+0000","last_became_active":"2023-11-30T17:25:07.425277+0000","last_became_peered":"2023-11-30T17:25:07.425277+0000","last_unstale":"2023-11-30T17:25:07.795344+0000","last_undegraded":"2023-11-30T17:25:07.795344+0000","last_fullsized":"2023-11-30T17:25:07.795344+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.807639+0000","last_change":"2023-11-30T17:25:07.801922+0000","last_active":"2023-11-30T17:25:07.807639+0000","last_peered":"2023-11-30T17:25:07.807639+0000","last_clean":"2023-11-30T17:25:07.807639+0000","last_became_active":"2023-11-30T17:25:07.801658+0000","last_became_peered":"2023-11-30T17:25:07.801658+0000","last_unstale":"2023-11-30T17:25:07.807639+0000","last_undegraded":"2023-11-30T17:25:07.807639+0000","last_fullsized":"2023-11-30T17:25:07.807639+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.798812+0000","last_change":"2023-11-30T17:25:07.426440+0000","last_active":"2023-11-30T17:25:07.798812+0000","last_peered":"2023-11-30T17:25:07.798812+0000","last_clean":"2023-11-30T17:25:07.798812+0000","last_became_active":"2023-11-30T17:25:07.426095+0000","last_became_peered":"2023-11-30T17:25:07.426095+0000","last_unstale":"2023-11-30T17:25:07.798812+0000","last_undegraded":"2023-11-30T17:25:07.798812+0000","last_fullsized":"2023-11-30T17:25:07.798812+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.812570+0000","last_change":"2023-11-30T17:25:07.807013+0000","last_active":"2023-11-30T17:25:07.812570+0000","last_peered":"2023-11-30T17:25:07.812570+0000","last_clean":"2023-11-30T17:25:07.812570+0000","last_became_active":"2023-11-30T17:25:07.806754+0000","last_became_peered":"2023-11-30T17:25:07.806754+0000","last_unstale":"2023-11-30T17:25:07.812570+0000","last_undegraded":"2023-11-30T17:25:07.812570+0000","last_fullsized":"2023-11-30T17:25:07.812570+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.794400+0000","last_change":"2023-11-30T17:25:07.419865+0000","last_active":"2023-11-30T17:25:07.794400+0000","last_peered":"2023-11-30T17:25:07.794400+0000","last_clean":"2023-11-30T17:25:07.794400+0000","last_became_active":"2023-11-30T17:25:07.419584+0000","last_became_peered":"2023-11-30T17:25:07.419584+0000","last_unstale":"2023-11-30T17:25:07.794400+0000","last_undegraded":"2023-11-30T17:25:07.794400+0000","last_fullsized":"2023-11-30T17:25:07.794400+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.809225+0000","last_change":"2023-11-30T17:25:07.807151+0000","last_active":"2023-11-30T17:25:07.809225+0000","last_peered":"2023-11-30T17:25:07.809225+0000","last_clean":"2023-11-30T17:25:07.809225+0000","last_became_active":"2023-11-30T17:25:07.806108+0000","last_became_peered":"2023-11-30T17:25:07.806108+0000","last_unstale":"2023-11-30T17:25:07.809225+0000","last_undegraded":"2023-11-30T17:25:07.809225+0000","last_fullsized":"2023-11-30T17:25:07.809225+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.804298+0000","last_change":"2023-11-30T17:25:07.428275+0000","last_active":"2023-11-30T17:25:07.804298+0000","last_peered":"2023-11-30T17:25:07.804298+0000","last_clean":"2023-11-30T17:25:07.804298+0000","last_became_active":"2023-11-30T17:25:07.427835+0000","last_became_peered":"2023-11-30T17:25:07.427835+0000","last_unstale":"2023-11-30T17:25:07.804298+0000","last_undegraded":"2023-11-30T17:25:07.804298+0000","last_fullsized":"2023-11-30T17:25:07.804298+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.813089+0000","last_change":"2023-11-30T17:25:07.808434+0000","last_active":"2023-11-30T17:25:07.813089+0000","last_peered":"2023-11-30T17:25:07.813089+0000","last_clean":"2023-11-30T17:25:07.813089+0000","last_became_active":"2023-11-30T17:25:07.808167+0000","last_became_peered":"2023-11-30T17:25:07.808167+0000","last_unstale":"2023-11-30T17:25:07.813089+0000","last_undegraded":"2023-11-30T17:25:07.813089+0000","last_fullsized":"2023-11-30T17:25:07.813089+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"129'4","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.820012+0000","last_change":"2023-11-30T17:25:07.428729+0000","last_active":"2023-11-30T17:25:07.820012+0000","last_peered":"2023-11-30T17:25:07.820012+0000","last_clean":"2023-11-30T17:25:07.820012+0000","last_became_active":"2023-11-30T17:25:07.427195+0000","last_became_peered":"2023-11-30T17:25:07.427195+0000","last_unstale":"2023-11-30T17:25:07.820012+0000","last_undegraded":"2023-11-30T17:25:07.820012+0000","last_fullsized":"2023-11-30T17:25:07.820012+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.819747+0000","last_change":"2023-11-30T17:25:07.811286+0000","last_active":"2023-11-30T17:25:07.819747+0000","last_peered":"2023-11-30T17:25:07.819747+0000","last_clean":"2023-11-30T17:25:07.819747+0000","last_became_active":"2023-11-30T17:25:07.811006+0000","last_became_peered":"2023-11-30T17:25:07.811006+0000","last_unstale":"2023-11-30T17:25:07.819747+0000","last_undegraded":"2023-11-30T17:25:07.819747+0000","last_fullsized":"2023-11-30T17:25:07.819747+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.813587+0000","last_change":"2023-11-30T17:25:07.427219+0000","last_active":"2023-11-30T17:25:07.813587+0000","last_peered":"2023-11-30T17:25:07.813587+0000","last_clean":"2023-11-30T17:25:07.813587+0000","last_became_active":"2023-11-30T17:25:07.426932+0000","last_became_peered":"2023-11-30T17:25:07.426932+0000","last_unstale":"2023-11-30T17:25:07.813587+0000","last_undegraded":"2023-11-30T17:25:07.813587+0000","last_fullsized":"2023-11-30T17:25:07.813587+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.815366+0000","last_change":"2023-11-30T17:25:07.814004+0000","last_active":"2023-11-30T17:25:07.815366+0000","last_peered":"2023-11-30T17:25:07.815366+0000","last_clean":"2023-11-30T17:25:07.815366+0000","last_became_active":"2023-11-30T17:25:07.813651+0000","last_became_peered":"2023-11-30T17:25:07.813651+0000","last_unstale":"2023-11-30T17:25:07.815366+0000","last_undegraded":"2023-11-30T17:25:07.815366+0000","last_fullsized":"2023-11-30T17:25:07.815366+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.790553+0000","last_change":"2023-11-30T17:25:07.423987+0000","last_active":"2023-11-30T17:25:07.790553+0000","last_peered":"2023-11-30T17:25:07.790553+0000","last_clean":"2023-11-30T17:25:07.790553+0000","last_became_active":"2023-11-30T17:25:07.423686+0000","last_became_peered":"2023-11-30T17:25:07.423686+0000","last_unstale":"2023-11-30T17:25:07.790553+0000","last_undegraded":"2023-11-30T17:25:07.790553+0000","last_fullsized":"2023-11-30T17:25:07.790553+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.817356+0000","last_change":"2023-11-30T17:25:07.810664+0000","last_active":"2023-11-30T17:25:07.817356+0000","last_peered":"2023-11-30T17:25:07.817356+0000","last_clean":"2023-11-30T17:25:07.817356+0000","last_became_active":"2023-11-30T17:25:07.809654+0000","last_became_peered":"2023-11-30T17:25:07.809654+0000","last_unstale":"2023-11-30T17:25:07.817356+0000","last_undegraded":"2023-11-30T17:25:07.817356+0000","last_fullsized":"2023-11-30T17:25:07.817356+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.803070+0000","last_change":"2023-11-30T17:25:07.420140+0000","last_active":"2023-11-30T17:25:07.803070+0000","last_peered":"2023-11-30T17:25:07.803070+0000","last_clean":"2023-11-30T17:25:07.803070+0000","last_became_active":"2023-11-30T17:25:07.419808+0000","last_became_peered":"2023-11-30T17:25:07.419808+0000","last_unstale":"2023-11-30T17:25:07.803070+0000","last_undegraded":"2023-11-30T17:25:07.803070+0000","last_fullsized":"2023-11-30T17:25:07.803070+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.815436+0000","last_change":"2023-11-30T17:25:07.814366+0000","last_active":"2023-11-30T17:25:07.815436+0000","last_peered":"2023-11-30T17:25:07.815436+0000","last_clean":"2023-11-30T17:25:07.815436+0000","last_became_active":"2023-11-30T17:25:07.814079+0000","last_became_peered":"2023-11-30T17:25:07.814079+0000","last_unstale":"2023-11-30T17:25:07.815436+0000","last_undegraded":"2023-11-30T17:25:07.815436+0000","last_fullsized":"2023-11-30T17:25:07.815436+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.30","version":"129'4","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.815218+0000","last_change":"2023-11-30T17:25:07.426844+0000","last_active":"2023-11-30T17:25:07.815218+0000","last_peered":"2023-11-30T17:25:07.815218+0000","last_clean":"2023-11-30T17:25:07.815218+0000","last_became_active":"2023-11-30T17:25:07.426534+0000","last_became_peered":"2023-11-30T17:25:07.426534+0000","last_unstale":"2023-11-30T17:25:07.815218+0000","last_undegraded":"2023-11-30T17:25:07.815218+0000","last_fullsized":"2023-11-30T17:25:07.815218+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.817503+0000","last_change":"2023-11-30T17:25:07.814014+0000","last_active":"2023-11-30T17:25:07.817503+0000","last_peered":"2023-11-30T17:25:07.817503+0000","last_clean":"2023-11-30T17:25:07.817503+0000","last_became_active":"2023-11-30T17:25:07.813717+0000","last_became_peered":"2023-11-30T17:25:07.813717+0000","last_unstale":"2023-11-30T17:25:07.817503+0000","last_undegraded":"2023-11-30T17:25:07.817503+0000","last_fullsized":"2023-11-30T17:25:07.817503+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.797435+0000","last_change":"2023-11-30T17:25:07.424608+0000","last_active":"2023-11-30T17:25:07.797435+0000","last_peered":"2023-11-30T17:25:07.797435+0000","last_clean":"2023-11-30T17:25:07.797435+0000","last_became_active":"2023-11-30T17:25:07.424276+0000","last_became_peered":"2023-11-30T17:25:07.424276+0000","last_unstale":"2023-11-30T17:25:07.797435+0000","last_undegraded":"2023-11-30T17:25:07.797435+0000","last_fullsized":"2023-11-30T17:25:07.797435+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.811855+0000","last_change":"2023-11-30T17:25:07.808767+0000","last_active":"2023-11-30T17:25:07.811855+0000","last_peered":"2023-11-30T17:25:07.811855+0000","last_clean":"2023-11-30T17:25:07.811855+0000","last_became_active":"2023-11-30T17:25:07.808444+0000","last_became_peered":"2023-11-30T17:25:07.808444+0000","last_unstale":"2023-11-30T17:25:07.811855+0000","last_undegraded":"2023-11-30T17:25:07.811855+0000","last_fullsized":"2023-11-30T17:25:07.811855+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.802381+0000","last_change":"2023-11-30T17:25:07.429043+0000","last_active":"2023-11-30T17:25:07.802381+0000","last_peered":"2023-11-30T17:25:07.802381+0000","last_clean":"2023-11-30T17:25:07.802381+0000","last_became_active":"2023-11-30T17:25:07.428702+0000","last_became_peered":"2023-11-30T17:25:07.428702+0000","last_unstale":"2023-11-30T17:25:07.802381+0000","last_undegraded":"2023-11-30T17:25:07.802381+0000","last_fullsized":"2023-11-30T17:25:07.802381+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.817587+0000","last_change":"2023-11-30T17:25:07.813243+0000","last_active":"2023-11-30T17:25:07.817587+0000","last_peered":"2023-11-30T17:25:07.817587+0000","last_clean":"2023-11-30T17:25:07.817587+0000","last_became_active":"2023-11-30T17:25:07.812920+0000","last_became_peered":"2023-11-30T17:25:07.812920+0000","last_unstale":"2023-11-30T17:25:07.817587+0000","last_undegraded":"2023-11-30T17:25:07.817587+0000","last_fullsized":"2023-11-30T17:25:07.817587+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2d","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.804948+0000","last_change":"2023-11-30T17:25:07.422405+0000","last_active":"2023-11-30T17:25:07.804948+0000","last_peered":"2023-11-30T17:25:07.804948+0000","last_clean":"2023-11-30T17:25:07.804948+0000","last_became_active":"2023-11-30T17:25:07.422131+0000","last_became_peered":"2023-11-30T17:25:07.422131+0000","last_unstale":"2023-11-30T17:25:07.804948+0000","last_undegraded":"2023-11-30T17:25:07.804948+0000","last_fullsized":"2023-11-30T17:25:07.804948+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.812136+0000","last_change":"2023-11-30T17:25:07.806310+0000","last_active":"2023-11-30T17:25:07.812136+0000","last_peered":"2023-11-30T17:25:07.812136+0000","last_clean":"2023-11-30T17:25:07.812136+0000","last_became_active":"2023-11-30T17:25:07.806044+0000","last_became_peered":"2023-11-30T17:25:07.806044+0000","last_unstale":"2023-11-30T17:25:07.812136+0000","last_undegraded":"2023-11-30T17:25:07.812136+0000","last_fullsized":"2023-11-30T17:25:07.812136+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.798288+0000","last_change":"2023-11-30T17:25:07.428513+0000","last_active":"2023-11-30T17:25:07.798288+0000","last_peered":"2023-11-30T17:25:07.798288+0000","last_clean":"2023-11-30T17:25:07.798288+0000","last_became_active":"2023-11-30T17:25:07.426890+0000","last_became_peered":"2023-11-30T17:25:07.426890+0000","last_unstale":"2023-11-30T17:25:07.798288+0000","last_undegraded":"2023-11-30T17:25:07.798288+0000","last_fullsized":"2023-11-30T17:25:07.798288+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.819936+0000","last_change":"2023-11-30T17:25:07.816162+0000","last_active":"2023-11-30T17:25:07.819936+0000","last_peered":"2023-11-30T17:25:07.819936+0000","last_clean":"2023-11-30T17:25:07.819936+0000","last_became_active":"2023-11-30T17:25:07.815865+0000","last_became_peered":"2023-11-30T17:25:07.815865+0000","last_unstale":"2023-11-30T17:25:07.819936+0000","last_undegraded":"2023-11-30T17:25:07.819936+0000","last_fullsized":"2023-11-30T17:25:07.819936+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.808109+0000","last_change":"2023-11-30T17:25:07.424740+0000","last_active":"2023-11-30T17:25:07.808109+0000","last_peered":"2023-11-30T17:25:07.808109+0000","last_clean":"2023-11-30T17:25:07.808109+0000","last_became_active":"2023-11-30T17:25:07.424471+0000","last_became_peered":"2023-11-30T17:25:07.424471+0000","last_unstale":"2023-11-30T17:25:07.808109+0000","last_undegraded":"2023-11-30T17:25:07.808109+0000","last_fullsized":"2023-11-30T17:25:07.808109+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.815470+0000","last_change":"2023-11-30T17:25:07.809992+0000","last_active":"2023-11-30T17:25:07.815470+0000","last_peered":"2023-11-30T17:25:07.815470+0000","last_clean":"2023-11-30T17:25:07.815470+0000","last_became_active":"2023-11-30T17:25:07.809716+0000","last_became_peered":"2023-11-30T17:25:07.809716+0000","last_unstale":"2023-11-30T17:25:07.815470+0000","last_undegraded":"2023-11-30T17:25:07.815470+0000","last_fullsized":"2023-11-30T17:25:07.815470+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.796420+0000","last_change":"2023-11-30T17:25:07.430852+0000","last_active":"2023-11-30T17:25:07.796420+0000","last_peered":"2023-11-30T17:25:07.796420+0000","last_clean":"2023-11-30T17:25:07.796420+0000","last_became_active":"2023-11-30T17:25:07.430581+0000","last_became_peered":"2023-11-30T17:25:07.430581+0000","last_unstale":"2023-11-30T17:25:07.796420+0000","last_undegraded":"2023-11-30T17:25:07.796420+0000","last_fullsized":"2023-11-30T17:25:07.796420+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.812271+0000","last_change":"2023-11-30T17:25:07.810172+0000","last_active":"2023-11-30T17:25:07.812271+0000","last_peered":"2023-11-30T17:25:07.812271+0000","last_clean":"2023-11-30T17:25:07.812271+0000","last_became_active":"2023-11-30T17:25:07.809900+0000","last_became_peered":"2023-11-30T17:25:07.809900+0000","last_unstale":"2023-11-30T17:25:07.812271+0000","last_undegraded":"2023-11-30T17:25:07.812271+0000","last_fullsized":"2023-11-30T17:25:07.812271+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.797315+0000","last_change":"2023-11-30T17:25:07.431327+0000","last_active":"2023-11-30T17:25:07.797315+0000","last_peered":"2023-11-30T17:25:07.797315+0000","last_clean":"2023-11-30T17:25:07.797315+0000","last_became_active":"2023-11-30T17:25:07.430473+0000","last_became_peered":"2023-11-30T17:25:07.430473+0000","last_unstale":"2023-11-30T17:25:07.797315+0000","last_undegraded":"2023-11-30T17:25:07.797315+0000","last_fullsized":"2023-11-30T17:25:07.797315+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.817404+0000","last_change":"2023-11-30T17:25:07.811794+0000","last_active":"2023-11-30T17:25:07.817404+0000","last_peered":"2023-11-30T17:25:07.817404+0000","last_clean":"2023-11-30T17:25:07.817404+0000","last_became_active":"2023-11-30T17:25:07.811522+0000","last_became_peered":"2023-11-30T17:25:07.811522+0000","last_unstale":"2023-11-30T17:25:07.817404+0000","last_undegraded":"2023-11-30T17:25:07.817404+0000","last_fullsized":"2023-11-30T17:25:07.817404+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.803234+0000","last_change":"2023-11-30T17:25:07.429292+0000","last_active":"2023-11-30T17:25:07.803234+0000","last_peered":"2023-11-30T17:25:07.803234+0000","last_clean":"2023-11-30T17:25:07.803234+0000","last_became_active":"2023-11-30T17:25:07.427594+0000","last_became_peered":"2023-11-30T17:25:07.427594+0000","last_unstale":"2023-11-30T17:25:07.803234+0000","last_undegraded":"2023-11-30T17:25:07.803234+0000","last_fullsized":"2023-11-30T17:25:07.803234+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.812856+0000","last_change":"2023-11-30T17:25:07.809404+0000","last_active":"2023-11-30T17:25:07.812856+0000","last_peered":"2023-11-30T17:25:07.812856+0000","last_clean":"2023-11-30T17:25:07.812856+0000","last_became_active":"2023-11-30T17:25:07.804986+0000","last_became_peered":"2023-11-30T17:25:07.804986+0000","last_unstale":"2023-11-30T17:25:07.812856+0000","last_undegraded":"2023-11-30T17:25:07.812856+0000","last_fullsized":"2023-11-30T17:25:07.812856+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.796930+0000","last_change":"2023-11-30T17:25:07.425500+0000","last_active":"2023-11-30T17:25:07.796930+0000","last_peered":"2023-11-30T17:25:07.796930+0000","last_clean":"2023-11-30T17:25:07.796930+0000","last_became_active":"2023-11-30T17:25:07.425171+0000","last_became_peered":"2023-11-30T17:25:07.425171+0000","last_unstale":"2023-11-30T17:25:07.796930+0000","last_undegraded":"2023-11-30T17:25:07.796930+0000","last_fullsized":"2023-11-30T17:25:07.796930+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.819874+0000","last_change":"2023-11-30T17:25:07.809866+0000","last_active":"2023-11-30T17:25:07.819874+0000","last_peered":"2023-11-30T17:25:07.819874+0000","last_clean":"2023-11-30T17:25:07.819874+0000","last_became_active":"2023-11-30T17:25:07.809541+0000","last_became_peered":"2023-11-30T17:25:07.809541+0000","last_unstale":"2023-11-30T17:25:07.819874+0000","last_undegraded":"2023-11-30T17:25:07.819874+0000","last_fullsized":"2023-11-30T17:25:07.819874+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:08.235333+0000","last_change":"2023-11-30T17:25:07.418369+0000","last_active":"2023-11-30T17:25:08.235333+0000","last_peered":"2023-11-30T17:25:08.235333+0000","last_clean":"2023-11-30T17:25:08.235333+0000","last_became_active":"2023-11-30T17:25:07.418069+0000","last_became_peered":"2023-11-30T17:25:07.418069+0000","last_unstale":"2023-11-30T17:25:08.235333+0000","last_undegraded":"2023-11-30T17:25:08.235333+0000","last_fullsized":"2023-11-30T17:25:08.235333+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.809343+0000","last_change":"2023-11-30T17:25:07.807042+0000","last_active":"2023-11-30T17:25:07.809343+0000","last_peered":"2023-11-30T17:25:07.809343+0000","last_clean":"2023-11-30T17:25:07.809343+0000","last_became_active":"2023-11-30T17:25:07.806773+0000","last_became_peered":"2023-11-30T17:25:07.806773+0000","last_unstale":"2023-11-30T17:25:07.809343+0000","last_undegraded":"2023-11-30T17:25:07.809343+0000","last_fullsized":"2023-11-30T17:25:07.809343+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.803938+0000","last_change":"2023-11-30T17:25:07.433224+0000","last_active":"2023-11-30T17:25:07.803938+0000","last_peered":"2023-11-30T17:25:07.803938+0000","last_clean":"2023-11-30T17:25:07.803938+0000","last_became_active":"2023-11-30T17:25:07.432882+0000","last_became_peered":"2023-11-30T17:25:07.432882+0000","last_unstale":"2023-11-30T17:25:07.803938+0000","last_undegraded":"2023-11-30T17:25:07.803938+0000","last_fullsized":"2023-11-30T17:25:07.803938+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.813828+0000","last_change":"2023-11-30T17:25:07.811579+0000","last_active":"2023-11-30T17:25:07.813828+0000","last_peered":"2023-11-30T17:25:07.813828+0000","last_clean":"2023-11-30T17:25:07.813828+0000","last_became_active":"2023-11-30T17:25:07.811296+0000","last_became_peered":"2023-11-30T17:25:07.811296+0000","last_unstale":"2023-11-30T17:25:07.813828+0000","last_undegraded":"2023-11-30T17:25:07.813828+0000","last_fullsized":"2023-11-30T17:25:07.813828+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.794244+0000","last_change":"2023-11-30T17:25:07.421521+0000","last_active":"2023-11-30T17:25:07.794244+0000","last_peered":"2023-11-30T17:25:07.794244+0000","last_clean":"2023-11-30T17:25:07.794244+0000","last_became_active":"2023-11-30T17:25:07.421237+0000","last_became_peered":"2023-11-30T17:25:07.421237+0000","last_unstale":"2023-11-30T17:25:07.794244+0000","last_undegraded":"2023-11-30T17:25:07.794244+0000","last_fullsized":"2023-11-30T17:25:07.794244+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.817319+0000","last_change":"2023-11-30T17:25:07.816861+0000","last_active":"2023-11-30T17:25:07.817319+0000","last_peered":"2023-11-30T17:25:07.817319+0000","last_clean":"2023-11-30T17:25:07.817319+0000","last_became_active":"2023-11-30T17:25:07.816601+0000","last_became_peered":"2023-11-30T17:25:07.816601+0000","last_unstale":"2023-11-30T17:25:07.817319+0000","last_undegraded":"2023-11-30T17:25:07.817319+0000","last_fullsized":"2023-11-30T17:25:07.817319+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.793602+0000","last_change":"2023-11-30T17:25:07.418471+0000","last_active":"2023-11-30T17:25:07.793602+0000","last_peered":"2023-11-30T17:25:07.793602+0000","last_clean":"2023-11-30T17:25:07.793602+0000","last_became_active":"2023-11-30T17:25:07.418093+0000","last_became_peered":"2023-11-30T17:25:07.418093+0000","last_unstale":"2023-11-30T17:25:07.793602+0000","last_undegraded":"2023-11-30T17:25:07.793602+0000","last_fullsized":"2023-11-30T17:25:07.793602+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.811533+0000","last_change":"2023-11-30T17:25:07.807243+0000","last_active":"2023-11-30T17:25:07.811533+0000","last_peered":"2023-11-30T17:25:07.811533+0000","last_clean":"2023-11-30T17:25:07.811533+0000","last_became_active":"2023-11-30T17:25:07.806665+0000","last_became_peered":"2023-11-30T17:25:07.806665+0000","last_unstale":"2023-11-30T17:25:07.811533+0000","last_undegraded":"2023-11-30T17:25:07.811533+0000","last_fullsized":"2023-11-30T17:25:07.811533+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.790608+0000","last_change":"2023-11-30T17:25:07.422503+0000","last_active":"2023-11-30T17:25:07.790608+0000","last_peered":"2023-11-30T17:25:07.790608+0000","last_clean":"2023-11-30T17:25:07.790608+0000","last_became_active":"2023-11-30T17:25:07.422216+0000","last_became_peered":"2023-11-30T17:25:07.422216+0000","last_unstale":"2023-11-30T17:25:07.790608+0000","last_undegraded":"2023-11-30T17:25:07.790608+0000","last_fullsized":"2023-11-30T17:25:07.790608+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.809509+0000","last_change":"2023-11-30T17:25:07.806861+0000","last_active":"2023-11-30T17:25:07.809509+0000","last_peered":"2023-11-30T17:25:07.809509+0000","last_clean":"2023-11-30T17:25:07.809509+0000","last_became_active":"2023-11-30T17:25:07.806540+0000","last_became_peered":"2023-11-30T17:25:07.806540+0000","last_unstale":"2023-11-30T17:25:07.809509+0000","last_undegraded":"2023-11-30T17:25:07.809509+0000","last_fullsized":"2023-11-30T17:25:07.809509+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.803164+0000","last_change":"2023-11-30T17:25:07.425991+0000","last_active":"2023-11-30T17:25:07.803164+0000","last_peered":"2023-11-30T17:25:07.803164+0000","last_clean":"2023-11-30T17:25:07.803164+0000","last_became_active":"2023-11-30T17:25:07.425506+0000","last_became_peered":"2023-11-30T17:25:07.425506+0000","last_unstale":"2023-11-30T17:25:07.803164+0000","last_undegraded":"2023-11-30T17:25:07.803164+0000","last_fullsized":"2023-11-30T17:25:07.803164+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.813440+0000","last_change":"2023-11-30T17:25:07.811551+0000","last_active":"2023-11-30T17:25:07.813440+0000","last_peered":"2023-11-30T17:25:07.813440+0000","last_clean":"2023-11-30T17:25:07.813440+0000","last_became_active":"2023-11-30T17:25:07.810954+0000","last_became_peered":"2023-11-30T17:25:07.810954+0000","last_unstale":"2023-11-30T17:25:07.813440+0000","last_undegraded":"2023-11-30T17:25:07.813440+0000","last_fullsized":"2023-11-30T17:25:07.813440+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.797858+0000","last_change":"2023-11-30T17:25:07.420367+0000","last_active":"2023-11-30T17:25:07.797858+0000","last_peered":"2023-11-30T17:25:07.797858+0000","last_clean":"2023-11-30T17:25:07.797858+0000","last_became_active":"2023-11-30T17:25:07.419985+0000","last_became_peered":"2023-11-30T17:25:07.419985+0000","last_unstale":"2023-11-30T17:25:07.797858+0000","last_undegraded":"2023-11-30T17:25:07.797858+0000","last_fullsized":"2023-11-30T17:25:07.797858+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.814743+0000","last_change":"2023-11-30T17:25:07.810337+0000","last_active":"2023-11-30T17:25:07.814743+0000","last_peered":"2023-11-30T17:25:07.814743+0000","last_clean":"2023-11-30T17:25:07.814743+0000","last_became_active":"2023-11-30T17:25:07.809676+0000","last_became_peered":"2023-11-30T17:25:07.809676+0000","last_unstale":"2023-11-30T17:25:07.814743+0000","last_undegraded":"2023-11-30T17:25:07.814743+0000","last_fullsized":"2023-11-30T17:25:07.814743+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.813012+0000","last_change":"2023-11-30T17:25:07.425674+0000","last_active":"2023-11-30T17:25:07.813012+0000","last_peered":"2023-11-30T17:25:07.813012+0000","last_clean":"2023-11-30T17:25:07.813012+0000","last_became_active":"2023-11-30T17:25:07.425267+0000","last_became_peered":"2023-11-30T17:25:07.425267+0000","last_unstale":"2023-11-30T17:25:07.813012+0000","last_undegraded":"2023-11-30T17:25:07.813012+0000","last_fullsized":"2023-11-30T17:25:07.813012+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.812642+0000","last_change":"2023-11-30T17:25:07.804540+0000","last_active":"2023-11-30T17:25:07.812642+0000","last_peered":"2023-11-30T17:25:07.812642+0000","last_clean":"2023-11-30T17:25:07.812642+0000","last_became_active":"2023-11-30T17:25:07.804108+0000","last_became_peered":"2023-11-30T17:25:07.804108+0000","last_unstale":"2023-11-30T17:25:07.812642+0000","last_undegraded":"2023-11-30T17:25:07.812642+0000","last_fullsized":"2023-11-30T17:25:07.812642+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.802113+0000","last_change":"2023-11-30T17:25:07.419127+0000","last_active":"2023-11-30T17:25:07.802113+0000","last_peered":"2023-11-30T17:25:07.802113+0000","last_clean":"2023-11-30T17:25:07.802113+0000","last_became_active":"2023-11-30T17:25:07.418859+0000","last_became_peered":"2023-11-30T17:25:07.418859+0000","last_unstale":"2023-11-30T17:25:07.802113+0000","last_undegraded":"2023-11-30T17:25:07.802113+0000","last_fullsized":"2023-11-30T17:25:07.802113+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.819685+0000","last_change":"2023-11-30T17:25:07.810887+0000","last_active":"2023-11-30T17:25:07.819685+0000","last_peered":"2023-11-30T17:25:07.819685+0000","last_clean":"2023-11-30T17:25:07.819685+0000","last_became_active":"2023-11-30T17:25:07.810564+0000","last_became_peered":"2023-11-30T17:25:07.810564+0000","last_unstale":"2023-11-30T17:25:07.819685+0000","last_undegraded":"2023-11-30T17:25:07.819685+0000","last_fullsized":"2023-11-30T17:25:07.819685+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"129'2","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.810549+0000","last_change":"2023-11-30T17:25:07.424535+0000","last_active":"2023-11-30T17:25:07.810549+0000","last_peered":"2023-11-30T17:25:07.810549+0000","last_clean":"2023-11-30T17:25:07.810549+0000","last_became_active":"2023-11-30T17:25:07.424230+0000","last_became_peered":"2023-11-30T17:25:07.424230+0000","last_unstale":"2023-11-30T17:25:07.810549+0000","last_undegraded":"2023-11-30T17:25:07.810549+0000","last_fullsized":"2023-11-30T17:25:07.810549+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.816249+0000","last_change":"2023-11-30T17:25:07.812017+0000","last_active":"2023-11-30T17:25:07.816249+0000","last_peered":"2023-11-30T17:25:07.816249+0000","last_clean":"2023-11-30T17:25:07.816249+0000","last_became_active":"2023-11-30T17:25:07.811590+0000","last_became_peered":"2023-11-30T17:25:07.811590+0000","last_unstale":"2023-11-30T17:25:07.816249+0000","last_undegraded":"2023-11-30T17:25:07.816249+0000","last_fullsized":"2023-11-30T17:25:07.816249+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.798798+0000","last_change":"2023-11-30T17:25:07.426464+0000","last_active":"2023-11-30T17:25:07.798798+0000","last_peered":"2023-11-30T17:25:07.798798+0000","last_clean":"2023-11-30T17:25:07.798798+0000","last_became_active":"2023-11-30T17:25:07.426175+0000","last_became_peered":"2023-11-30T17:25:07.426175+0000","last_unstale":"2023-11-30T17:25:07.798798+0000","last_undegraded":"2023-11-30T17:25:07.798798+0000","last_fullsized":"2023-11-30T17:25:07.798798+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.814123+0000","last_change":"2023-11-30T17:25:07.808918+0000","last_active":"2023-11-30T17:25:07.814123+0000","last_peered":"2023-11-30T17:25:07.814123+0000","last_clean":"2023-11-30T17:25:07.814123+0000","last_became_active":"2023-11-30T17:25:07.808674+0000","last_became_peered":"2023-11-30T17:25:07.808674+0000","last_unstale":"2023-11-30T17:25:07.814123+0000","last_undegraded":"2023-11-30T17:25:07.814123+0000","last_fullsized":"2023-11-30T17:25:07.814123+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.803997+0000","last_change":"2023-11-30T17:25:07.425564+0000","last_active":"2023-11-30T17:25:07.803997+0000","last_peered":"2023-11-30T17:25:07.803997+0000","last_clean":"2023-11-30T17:25:07.803997+0000","last_became_active":"2023-11-30T17:25:07.425282+0000","last_became_peered":"2023-11-30T17:25:07.425282+0000","last_unstale":"2023-11-30T17:25:07.803997+0000","last_undegraded":"2023-11-30T17:25:07.803997+0000","last_fullsized":"2023-11-30T17:25:07.803997+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.815345+0000","last_change":"2023-11-30T17:25:07.813710+0000","last_active":"2023-11-30T17:25:07.815345+0000","last_peered":"2023-11-30T17:25:07.815345+0000","last_clean":"2023-11-30T17:25:07.815345+0000","last_became_active":"2023-11-30T17:25:07.813415+0000","last_became_peered":"2023-11-30T17:25:07.813415+0000","last_unstale":"2023-11-30T17:25:07.815345+0000","last_undegraded":"2023-11-30T17:25:07.815345+0000","last_fullsized":"2023-11-30T17:25:07.815345+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.794193+0000","last_change":"2023-11-30T17:25:07.428472+0000","last_active":"2023-11-30T17:25:07.794193+0000","last_peered":"2023-11-30T17:25:07.794193+0000","last_clean":"2023-11-30T17:25:07.794193+0000","last_became_active":"2023-11-30T17:25:07.428162+0000","last_became_peered":"2023-11-30T17:25:07.428162+0000","last_unstale":"2023-11-30T17:25:07.794193+0000","last_undegraded":"2023-11-30T17:25:07.794193+0000","last_fullsized":"2023-11-30T17:25:07.794193+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.819901+0000","last_change":"2023-11-30T17:25:07.813693+0000","last_active":"2023-11-30T17:25:07.819901+0000","last_peered":"2023-11-30T17:25:07.819901+0000","last_clean":"2023-11-30T17:25:07.819901+0000","last_became_active":"2023-11-30T17:25:07.809722+0000","last_became_peered":"2023-11-30T17:25:07.809722+0000","last_unstale":"2023-11-30T17:25:07.819901+0000","last_undegraded":"2023-11-30T17:25:07.819901+0000","last_fullsized":"2023-11-30T17:25:07.819901+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.797417+0000","last_change":"2023-11-30T17:25:07.423418+0000","last_active":"2023-11-30T17:25:07.797417+0000","last_peered":"2023-11-30T17:25:07.797417+0000","last_clean":"2023-11-30T17:25:07.797417+0000","last_became_active":"2023-11-30T17:25:07.423071+0000","last_became_peered":"2023-11-30T17:25:07.423071+0000","last_unstale":"2023-11-30T17:25:07.797417+0000","last_undegraded":"2023-11-30T17:25:07.797417+0000","last_fullsized":"2023-11-30T17:25:07.797417+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.812224+0000","last_change":"2023-11-30T17:25:07.808370+0000","last_active":"2023-11-30T17:25:07.812224+0000","last_peered":"2023-11-30T17:25:07.812224+0000","last_clean":"2023-11-30T17:25:07.812224+0000","last_became_active":"2023-11-30T17:25:07.808106+0000","last_became_peered":"2023-11-30T17:25:07.808106+0000","last_unstale":"2023-11-30T17:25:07.812224+0000","last_undegraded":"2023-11-30T17:25:07.812224+0000","last_fullsized":"2023-11-30T17:25:07.812224+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.804542+0000","last_change":"2023-11-30T17:25:07.423707+0000","last_active":"2023-11-30T17:25:07.804542+0000","last_peered":"2023-11-30T17:25:07.804542+0000","last_clean":"2023-11-30T17:25:07.804542+0000","last_became_active":"2023-11-30T17:25:07.423230+0000","last_became_peered":"2023-11-30T17:25:07.423230+0000","last_unstale":"2023-11-30T17:25:07.804542+0000","last_undegraded":"2023-11-30T17:25:07.804542+0000","last_fullsized":"2023-11-30T17:25:07.804542+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.814762+0000","last_change":"2023-11-30T17:25:07.810514+0000","last_active":"2023-11-30T17:25:07.814762+0000","last_peered":"2023-11-30T17:25:07.814762+0000","last_clean":"2023-11-30T17:25:07.814762+0000","last_became_active":"2023-11-30T17:25:07.810061+0000","last_became_peered":"2023-11-30T17:25:07.810061+0000","last_unstale":"2023-11-30T17:25:07.814762+0000","last_undegraded":"2023-11-30T17:25:07.814762+0000","last_fullsized":"2023-11-30T17:25:07.814762+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.798708+0000","last_change":"2023-11-30T17:25:07.426716+0000","last_active":"2023-11-30T17:25:07.798708+0000","last_peered":"2023-11-30T17:25:07.798708+0000","last_clean":"2023-11-30T17:25:07.798708+0000","last_became_active":"2023-11-30T17:25:07.426410+0000","last_became_peered":"2023-11-30T17:25:07.426410+0000","last_unstale":"2023-11-30T17:25:07.798708+0000","last_undegraded":"2023-11-30T17:25:07.798708+0000","last_fullsized":"2023-11-30T17:25:07.798708+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.807932+0000","last_change":"2023-11-30T17:25:07.801737+0000","last_active":"2023-11-30T17:25:07.807932+0000","last_peered":"2023-11-30T17:25:07.807932+0000","last_clean":"2023-11-30T17:25:07.807932+0000","last_became_active":"2023-11-30T17:25:07.801427+0000","last_became_peered":"2023-11-30T17:25:07.801427+0000","last_unstale":"2023-11-30T17:25:07.807932+0000","last_undegraded":"2023-11-30T17:25:07.807932+0000","last_fullsized":"2023-11-30T17:25:07.807932+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.795048+0000","last_change":"2023-11-30T17:25:07.427160+0000","last_active":"2023-11-30T17:25:07.795048+0000","last_peered":"2023-11-30T17:25:07.795048+0000","last_clean":"2023-11-30T17:25:07.795048+0000","last_became_active":"2023-11-30T17:25:07.426881+0000","last_became_peered":"2023-11-30T17:25:07.426881+0000","last_unstale":"2023-11-30T17:25:07.795048+0000","last_undegraded":"2023-11-30T17:25:07.795048+0000","last_fullsized":"2023-11-30T17:25:07.795048+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.812819+0000","last_change":"2023-11-30T17:25:07.807055+0000","last_active":"2023-11-30T17:25:07.812819+0000","last_peered":"2023-11-30T17:25:07.812819+0000","last_clean":"2023-11-30T17:25:07.812819+0000","last_became_active":"2023-11-30T17:25:07.804212+0000","last_became_peered":"2023-11-30T17:25:07.804212+0000","last_unstale":"2023-11-30T17:25:07.812819+0000","last_undegraded":"2023-11-30T17:25:07.812819+0000","last_fullsized":"2023-11-30T17:25:07.812819+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"129'3","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.812370+0000","last_change":"2023-11-30T17:25:07.430904+0000","last_active":"2023-11-30T17:25:07.812370+0000","last_peered":"2023-11-30T17:25:07.812370+0000","last_clean":"2023-11-30T17:25:07.812370+0000","last_became_active":"2023-11-30T17:25:07.430566+0000","last_became_peered":"2023-11-30T17:25:07.430566+0000","last_unstale":"2023-11-30T17:25:07.812370+0000","last_undegraded":"2023-11-30T17:25:07.812370+0000","last_fullsized":"2023-11-30T17:25:07.812370+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.809569+0000","last_change":"2023-11-30T17:25:07.801887+0000","last_active":"2023-11-30T17:25:07.809569+0000","last_peered":"2023-11-30T17:25:07.809569+0000","last_clean":"2023-11-30T17:25:07.809569+0000","last_became_active":"2023-11-30T17:25:07.801607+0000","last_became_peered":"2023-11-30T17:25:07.801607+0000","last_unstale":"2023-11-30T17:25:07.809569+0000","last_undegraded":"2023-11-30T17:25:07.809569+0000","last_fullsized":"2023-11-30T17:25:07.809569+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"129'2","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.814085+0000","last_change":"2023-11-30T17:25:07.421517+0000","last_active":"2023-11-30T17:25:07.814085+0000","last_peered":"2023-11-30T17:25:07.814085+0000","last_clean":"2023-11-30T17:25:07.814085+0000","last_became_active":"2023-11-30T17:25:07.421223+0000","last_became_peered":"2023-11-30T17:25:07.421223+0000","last_unstale":"2023-11-30T17:25:07.814085+0000","last_undegraded":"2023-11-30T17:25:07.814085+0000","last_fullsized":"2023-11-30T17:25:07.814085+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.815029+0000","last_change":"2023-11-30T17:25:07.809370+0000","last_active":"2023-11-30T17:25:07.815029+0000","last_peered":"2023-11-30T17:25:07.815029+0000","last_clean":"2023-11-30T17:25:07.815029+0000","last_became_active":"2023-11-30T17:25:07.809079+0000","last_became_peered":"2023-11-30T17:25:07.809079+0000","last_unstale":"2023-11-30T17:25:07.815029+0000","last_undegraded":"2023-11-30T17:25:07.815029+0000","last_fullsized":"2023-11-30T17:25:07.815029+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.809517+0000","last_change":"2023-11-30T17:25:07.429966+0000","last_active":"2023-11-30T17:25:07.809517+0000","last_peered":"2023-11-30T17:25:07.809517+0000","last_clean":"2023-11-30T17:25:07.809517+0000","last_became_active":"2023-11-30T17:25:07.429699+0000","last_became_peered":"2023-11-30T17:25:07.429699+0000","last_unstale":"2023-11-30T17:25:07.809517+0000","last_undegraded":"2023-11-30T17:25:07.809517+0000","last_fullsized":"2023-11-30T17:25:07.809517+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.810776+0000","last_change":"2023-11-30T17:25:07.802322+0000","last_active":"2023-11-30T17:25:07.810776+0000","last_peered":"2023-11-30T17:25:07.810776+0000","last_clean":"2023-11-30T17:25:07.810776+0000","last_became_active":"2023-11-30T17:25:07.802007+0000","last_became_peered":"2023-11-30T17:25:07.802007+0000","last_unstale":"2023-11-30T17:25:07.810776+0000","last_undegraded":"2023-11-30T17:25:07.810776+0000","last_fullsized":"2023-11-30T17:25:07.810776+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.804785+0000","last_change":"2023-11-30T17:25:07.420645+0000","last_active":"2023-11-30T17:25:07.804785+0000","last_peered":"2023-11-30T17:25:07.804785+0000","last_clean":"2023-11-30T17:25:07.804785+0000","last_became_active":"2023-11-30T17:25:07.420437+0000","last_became_peered":"2023-11-30T17:25:07.420437+0000","last_unstale":"2023-11-30T17:25:07.804785+0000","last_undegraded":"2023-11-30T17:25:07.804785+0000","last_fullsized":"2023-11-30T17:25:07.804785+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.814150+0000","last_change":"2023-11-30T17:25:07.812167+0000","last_active":"2023-11-30T17:25:07.814150+0000","last_peered":"2023-11-30T17:25:07.814150+0000","last_clean":"2023-11-30T17:25:07.814150+0000","last_became_active":"2023-11-30T17:25:07.811868+0000","last_became_peered":"2023-11-30T17:25:07.811868+0000","last_unstale":"2023-11-30T17:25:07.814150+0000","last_undegraded":"2023-11-30T17:25:07.814150+0000","last_fullsized":"2023-11-30T17:25:07.814150+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.790140+0000","last_change":"2023-11-30T17:25:07.426475+0000","last_active":"2023-11-30T17:25:07.790140+0000","last_peered":"2023-11-30T17:25:07.790140+0000","last_clean":"2023-11-30T17:25:07.790140+0000","last_became_active":"2023-11-30T17:25:07.426171+0000","last_became_peered":"2023-11-30T17:25:07.426171+0000","last_unstale":"2023-11-30T17:25:07.790140+0000","last_undegraded":"2023-11-30T17:25:07.790140+0000","last_fullsized":"2023-11-30T17:25:07.790140+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.812676+0000","last_change":"2023-11-30T17:25:07.809197+0000","last_active":"2023-11-30T17:25:07.812676+0000","last_peered":"2023-11-30T17:25:07.812676+0000","last_clean":"2023-11-30T17:25:07.812676+0000","last_became_active":"2023-11-30T17:25:07.808899+0000","last_became_peered":"2023-11-30T17:25:07.808899+0000","last_unstale":"2023-11-30T17:25:07.812676+0000","last_undegraded":"2023-11-30T17:25:07.812676+0000","last_fullsized":"2023-11-30T17:25:07.812676+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"129'4","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.812236+0000","last_change":"2023-11-30T17:25:07.421862+0000","last_active":"2023-11-30T17:25:07.812236+0000","last_peered":"2023-11-30T17:25:07.812236+0000","last_clean":"2023-11-30T17:25:07.812236+0000","last_became_active":"2023-11-30T17:25:07.421553+0000","last_became_peered":"2023-11-30T17:25:07.421553+0000","last_unstale":"2023-11-30T17:25:07.812236+0000","last_undegraded":"2023-11-30T17:25:07.812236+0000","last_fullsized":"2023-11-30T17:25:07.812236+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.811583+0000","last_change":"2023-11-30T17:25:07.806188+0000","last_active":"2023-11-30T17:25:07.811583+0000","last_peered":"2023-11-30T17:25:07.811583+0000","last_clean":"2023-11-30T17:25:07.811583+0000","last_became_active":"2023-11-30T17:25:07.805902+0000","last_became_peered":"2023-11-30T17:25:07.805902+0000","last_unstale":"2023-11-30T17:25:07.811583+0000","last_undegraded":"2023-11-30T17:25:07.811583+0000","last_fullsized":"2023-11-30T17:25:07.811583+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"129'2","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.809407+0000","last_change":"2023-11-30T17:25:07.428181+0000","last_active":"2023-11-30T17:25:07.809407+0000","last_peered":"2023-11-30T17:25:07.809407+0000","last_clean":"2023-11-30T17:25:07.809407+0000","last_became_active":"2023-11-30T17:25:07.427723+0000","last_became_peered":"2023-11-30T17:25:07.427723+0000","last_unstale":"2023-11-30T17:25:07.809407+0000","last_undegraded":"2023-11-30T17:25:07.809407+0000","last_fullsized":"2023-11-30T17:25:07.809407+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.817149+0000","last_change":"2023-11-30T17:25:07.805965+0000","last_active":"2023-11-30T17:25:07.817149+0000","last_peered":"2023-11-30T17:25:07.817149+0000","last_clean":"2023-11-30T17:25:07.817149+0000","last_became_active":"2023-11-30T17:25:07.805647+0000","last_became_peered":"2023-11-30T17:25:07.805647+0000","last_unstale":"2023-11-30T17:25:07.817149+0000","last_undegraded":"2023-11-30T17:25:07.817149+0000","last_fullsized":"2023-11-30T17:25:07.817149+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.793716+0000","last_change":"2023-11-30T17:25:07.434140+0000","last_active":"2023-11-30T17:25:07.793716+0000","last_peered":"2023-11-30T17:25:07.793716+0000","last_clean":"2023-11-30T17:25:07.793716+0000","last_became_active":"2023-11-30T17:25:07.431450+0000","last_became_peered":"2023-11-30T17:25:07.431450+0000","last_unstale":"2023-11-30T17:25:07.793716+0000","last_undegraded":"2023-11-30T17:25:07.793716+0000","last_fullsized":"2023-11-30T17:25:07.793716+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.813736+0000","last_change":"2023-11-30T17:25:07.811061+0000","last_active":"2023-11-30T17:25:07.813736+0000","last_peered":"2023-11-30T17:25:07.813736+0000","last_clean":"2023-11-30T17:25:07.813736+0000","last_became_active":"2023-11-30T17:25:07.810811+0000","last_became_peered":"2023-11-30T17:25:07.810811+0000","last_unstale":"2023-11-30T17:25:07.813736+0000","last_undegraded":"2023-11-30T17:25:07.813736+0000","last_fullsized":"2023-11-30T17:25:07.813736+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.793972+0000","last_change":"2023-11-30T17:25:07.415883+0000","last_active":"2023-11-30T17:25:07.793972+0000","last_peered":"2023-11-30T17:25:07.793972+0000","last_clean":"2023-11-30T17:25:07.793972+0000","last_became_active":"2023-11-30T17:25:07.415594+0000","last_became_peered":"2023-11-30T17:25:07.415594+0000","last_unstale":"2023-11-30T17:25:07.793972+0000","last_undegraded":"2023-11-30T17:25:07.793972+0000","last_fullsized":"2023-11-30T17:25:07.793972+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.816227+0000","last_change":"2023-11-30T17:25:07.811851+0000","last_active":"2023-11-30T17:25:07.816227+0000","last_peered":"2023-11-30T17:25:07.816227+0000","last_clean":"2023-11-30T17:25:07.816227+0000","last_became_active":"2023-11-30T17:25:07.811233+0000","last_became_peered":"2023-11-30T17:25:07.811233+0000","last_unstale":"2023-11-30T17:25:07.816227+0000","last_undegraded":"2023-11-30T17:25:07.816227+0000","last_fullsized":"2023-11-30T17:25:07.816227+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.798892+0000","last_change":"2023-11-30T17:25:07.422369+0000","last_active":"2023-11-30T17:25:07.798892+0000","last_peered":"2023-11-30T17:25:07.798892+0000","last_clean":"2023-11-30T17:25:07.798892+0000","last_became_active":"2023-11-30T17:25:07.422092+0000","last_became_peered":"2023-11-30T17:25:07.422092+0000","last_unstale":"2023-11-30T17:25:07.798892+0000","last_undegraded":"2023-11-30T17:25:07.798892+0000","last_fullsized":"2023-11-30T17:25:07.798892+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.812987+0000","last_change":"2023-11-30T17:25:07.806980+0000","last_active":"2023-11-30T17:25:07.812987+0000","last_peered":"2023-11-30T17:25:07.812987+0000","last_clean":"2023-11-30T17:25:07.812987+0000","last_became_active":"2023-11-30T17:25:07.806637+0000","last_became_peered":"2023-11-30T17:25:07.806637+0000","last_unstale":"2023-11-30T17:25:07.812987+0000","last_undegraded":"2023-11-30T17:25:07.812987+0000","last_fullsized":"2023-11-30T17:25:07.812987+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.799555+0000","last_change":"2023-11-30T17:25:07.426189+0000","last_active":"2023-11-30T17:25:07.799555+0000","last_peered":"2023-11-30T17:25:07.799555+0000","last_clean":"2023-11-30T17:25:07.799555+0000","last_became_active":"2023-11-30T17:25:07.425839+0000","last_became_peered":"2023-11-30T17:25:07.425839+0000","last_unstale":"2023-11-30T17:25:07.799555+0000","last_undegraded":"2023-11-30T17:25:07.799555+0000","last_fullsized":"2023-11-30T17:25:07.799555+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.812678+0000","last_change":"2023-11-30T17:25:07.804793+0000","last_active":"2023-11-30T17:25:07.812678+0000","last_peered":"2023-11-30T17:25:07.812678+0000","last_clean":"2023-11-30T17:25:07.812678+0000","last_became_active":"2023-11-30T17:25:07.804166+0000","last_became_peered":"2023-11-30T17:25:07.804166+0000","last_unstale":"2023-11-30T17:25:07.812678+0000","last_undegraded":"2023-11-30T17:25:07.812678+0000","last_fullsized":"2023-11-30T17:25:07.812678+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.790720+0000","last_change":"2023-11-30T17:25:07.433060+0000","last_active":"2023-11-30T17:25:07.790720+0000","last_peered":"2023-11-30T17:25:07.790720+0000","last_clean":"2023-11-30T17:25:07.790720+0000","last_became_active":"2023-11-30T17:25:07.432640+0000","last_became_peered":"2023-11-30T17:25:07.432640+0000","last_unstale":"2023-11-30T17:25:07.790720+0000","last_undegraded":"2023-11-30T17:25:07.790720+0000","last_fullsized":"2023-11-30T17:25:07.790720+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.820001+0000","last_change":"2023-11-30T17:25:07.816104+0000","last_active":"2023-11-30T17:25:07.820001+0000","last_peered":"2023-11-30T17:25:07.820001+0000","last_clean":"2023-11-30T17:25:07.820001+0000","last_became_active":"2023-11-30T17:25:07.815858+0000","last_became_peered":"2023-11-30T17:25:07.815858+0000","last_unstale":"2023-11-30T17:25:07.820001+0000","last_undegraded":"2023-11-30T17:25:07.820001+0000","last_fullsized":"2023-11-30T17:25:07.820001+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.793572+0000","last_change":"2023-11-30T17:25:07.423189+0000","last_active":"2023-11-30T17:25:07.793572+0000","last_peered":"2023-11-30T17:25:07.793572+0000","last_clean":"2023-11-30T17:25:07.793572+0000","last_became_active":"2023-11-30T17:25:07.422646+0000","last_became_peered":"2023-11-30T17:25:07.422646+0000","last_unstale":"2023-11-30T17:25:07.793572+0000","last_undegraded":"2023-11-30T17:25:07.793572+0000","last_fullsized":"2023-11-30T17:25:07.793572+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.817512+0000","last_change":"2023-11-30T17:25:07.812520+0000","last_active":"2023-11-30T17:25:07.817512+0000","last_peered":"2023-11-30T17:25:07.817512+0000","last_clean":"2023-11-30T17:25:07.817512+0000","last_became_active":"2023-11-30T17:25:07.807507+0000","last_became_peered":"2023-11-30T17:25:07.807507+0000","last_unstale":"2023-11-30T17:25:07.817512+0000","last_undegraded":"2023-11-30T17:25:07.817512+0000","last_fullsized":"2023-11-30T17:25:07.817512+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.790556+0000","last_change":"2023-11-30T17:25:07.422994+0000","last_active":"2023-11-30T17:25:07.790556+0000","last_peered":"2023-11-30T17:25:07.790556+0000","last_clean":"2023-11-30T17:25:07.790556+0000","last_became_active":"2023-11-30T17:25:07.422768+0000","last_became_peered":"2023-11-30T17:25:07.422768+0000","last_unstale":"2023-11-30T17:25:07.790556+0000","last_undegraded":"2023-11-30T17:25:07.790556+0000","last_fullsized":"2023-11-30T17:25:07.790556+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.814354+0000","last_change":"2023-11-30T17:25:07.813139+0000","last_active":"2023-11-30T17:25:07.814354+0000","last_peered":"2023-11-30T17:25:07.814354+0000","last_clean":"2023-11-30T17:25:07.814354+0000","last_became_active":"2023-11-30T17:25:07.812802+0000","last_became_peered":"2023-11-30T17:25:07.812802+0000","last_unstale":"2023-11-30T17:25:07.814354+0000","last_undegraded":"2023-11-30T17:25:07.814354+0000","last_fullsized":"2023-11-30T17:25:07.814354+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.793405+0000","last_change":"2023-11-30T17:25:07.423036+0000","last_active":"2023-11-30T17:25:07.793405+0000","last_peered":"2023-11-30T17:25:07.793405+0000","last_clean":"2023-11-30T17:25:07.793405+0000","last_became_active":"2023-11-30T17:25:07.422313+0000","last_became_peered":"2023-11-30T17:25:07.422313+0000","last_unstale":"2023-11-30T17:25:07.793405+0000","last_undegraded":"2023-11-30T17:25:07.793405+0000","last_fullsized":"2023-11-30T17:25:07.793405+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":107,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.798976+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:25:07.798976+0000","last_peered":"2023-11-30T17:25:07.798976+0000","last_clean":"2023-11-30T17:25:07.798976+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:25:07.798976+0000","last_undegraded":"2023-11-30T17:25:07.798976+0000","last_fullsized":"2023-11-30T17:25:07.798976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.805956+0000","last_change":"2023-11-30T17:25:07.801780+0000","last_active":"2023-11-30T17:25:07.805956+0000","last_peered":"2023-11-30T17:25:07.805956+0000","last_clean":"2023-11-30T17:25:07.805956+0000","last_became_active":"2023-11-30T17:25:07.801513+0000","last_became_peered":"2023-11-30T17:25:07.801513+0000","last_unstale":"2023-11-30T17:25:07.805956+0000","last_undegraded":"2023-11-30T17:25:07.805956+0000","last_fullsized":"2023-11-30T17:25:07.805956+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.813349+0000","last_change":"2023-11-30T17:25:07.429308+0000","last_active":"2023-11-30T17:25:07.813349+0000","last_peered":"2023-11-30T17:25:07.813349+0000","last_clean":"2023-11-30T17:25:07.813349+0000","last_became_active":"2023-11-30T17:25:07.429027+0000","last_became_peered":"2023-11-30T17:25:07.429027+0000","last_unstale":"2023-11-30T17:25:07.813349+0000","last_undegraded":"2023-11-30T17:25:07.813349+0000","last_fullsized":"2023-11-30T17:25:07.813349+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":104,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.794285+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:25:07.794285+0000","last_peered":"2023-11-30T17:25:07.794285+0000","last_clean":"2023-11-30T17:25:07.794285+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:25:07.794285+0000","last_undegraded":"2023-11-30T17:25:07.794285+0000","last_fullsized":"2023-11-30T17:25:07.794285+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.809638+0000","last_change":"2023-11-30T17:25:07.805695+0000","last_active":"2023-11-30T17:25:07.809638+0000","last_peered":"2023-11-30T17:25:07.809638+0000","last_clean":"2023-11-30T17:25:07.809638+0000","last_became_active":"2023-11-30T17:25:07.805388+0000","last_became_peered":"2023-11-30T17:25:07.805388+0000","last_unstale":"2023-11-30T17:25:07.809638+0000","last_undegraded":"2023-11-30T17:25:07.809638+0000","last_fullsized":"2023-11-30T17:25:07.809638+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.794845+0000","last_change":"2023-11-30T17:25:07.425073+0000","last_active":"2023-11-30T17:25:07.794845+0000","last_peered":"2023-11-30T17:25:07.794845+0000","last_clean":"2023-11-30T17:25:07.794845+0000","last_became_active":"2023-11-30T17:25:07.424780+0000","last_became_peered":"2023-11-30T17:25:07.424780+0000","last_unstale":"2023-11-30T17:25:07.794845+0000","last_undegraded":"2023-11-30T17:25:07.794845+0000","last_fullsized":"2023-11-30T17:25:07.794845+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":110,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.790593+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:25:07.790593+0000","last_peered":"2023-11-30T17:25:07.790593+0000","last_clean":"2023-11-30T17:25:07.790593+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:25:07.790593+0000","last_undegraded":"2023-11-30T17:25:07.790593+0000","last_fullsized":"2023-11-30T17:25:07.790593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.816194+0000","last_change":"2023-11-30T17:25:07.812012+0000","last_active":"2023-11-30T17:25:07.816194+0000","last_peered":"2023-11-30T17:25:07.816194+0000","last_clean":"2023-11-30T17:25:07.816194+0000","last_became_active":"2023-11-30T17:25:07.811151+0000","last_became_peered":"2023-11-30T17:25:07.811151+0000","last_unstale":"2023-11-30T17:25:07.816194+0000","last_undegraded":"2023-11-30T17:25:07.816194+0000","last_fullsized":"2023-11-30T17:25:07.816194+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"129'2","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.807859+0000","last_change":"2023-11-30T17:25:07.425188+0000","last_active":"2023-11-30T17:25:07.807859+0000","last_peered":"2023-11-30T17:25:07.807859+0000","last_clean":"2023-11-30T17:25:07.807859+0000","last_became_active":"2023-11-30T17:25:07.424918+0000","last_became_peered":"2023-11-30T17:25:07.424918+0000","last_unstale":"2023-11-30T17:25:07.807859+0000","last_undegraded":"2023-11-30T17:25:07.807859+0000","last_fullsized":"2023-11-30T17:25:07.807859+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":104,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.796648+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:25:07.796648+0000","last_peered":"2023-11-30T17:25:07.796648+0000","last_clean":"2023-11-30T17:25:07.796648+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:25:07.796648+0000","last_undegraded":"2023-11-30T17:25:07.796648+0000","last_fullsized":"2023-11-30T17:25:07.796648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":106,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.803320+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:25:07.803320+0000","last_peered":"2023-11-30T17:25:07.803320+0000","last_clean":"2023-11-30T17:25:07.803320+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:25:07.803320+0000","last_undegraded":"2023-11-30T17:25:07.803320+0000","last_fullsized":"2023-11-30T17:25:07.803320+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.809320+0000","last_change":"2023-11-30T17:25:07.803155+0000","last_active":"2023-11-30T17:25:07.809320+0000","last_peered":"2023-11-30T17:25:07.809320+0000","last_clean":"2023-11-30T17:25:07.809320+0000","last_became_active":"2023-11-30T17:25:07.802884+0000","last_became_peered":"2023-11-30T17:25:07.802884+0000","last_unstale":"2023-11-30T17:25:07.809320+0000","last_undegraded":"2023-11-30T17:25:07.809320+0000","last_fullsized":"2023-11-30T17:25:07.809320+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.804201+0000","last_change":"2023-11-30T17:25:07.428103+0000","last_active":"2023-11-30T17:25:07.804201+0000","last_peered":"2023-11-30T17:25:07.804201+0000","last_clean":"2023-11-30T17:25:07.804201+0000","last_became_active":"2023-11-30T17:25:07.427437+0000","last_became_peered":"2023-11-30T17:25:07.427437+0000","last_unstale":"2023-11-30T17:25:07.804201+0000","last_undegraded":"2023-11-30T17:25:07.804201+0000","last_fullsized":"2023-11-30T17:25:07.804201+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":104,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.803402+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:25:07.803402+0000","last_peered":"2023-11-30T17:25:07.803402+0000","last_clean":"2023-11-30T17:25:07.803402+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:25:07.803402+0000","last_undegraded":"2023-11-30T17:25:07.803402+0000","last_fullsized":"2023-11-30T17:25:07.803402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.812730+0000","last_change":"2023-11-30T17:25:07.807301+0000","last_active":"2023-11-30T17:25:07.812730+0000","last_peered":"2023-11-30T17:25:07.812730+0000","last_clean":"2023-11-30T17:25:07.812730+0000","last_became_active":"2023-11-30T17:25:07.807025+0000","last_became_peered":"2023-11-30T17:25:07.807025+0000","last_unstale":"2023-11-30T17:25:07.812730+0000","last_undegraded":"2023-11-30T17:25:07.812730+0000","last_fullsized":"2023-11-30T17:25:07.812730+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.790445+0000","last_change":"2023-11-30T17:25:07.426633+0000","last_active":"2023-11-30T17:25:07.790445+0000","last_peered":"2023-11-30T17:25:07.790445+0000","last_clean":"2023-11-30T17:25:07.790445+0000","last_became_active":"2023-11-30T17:25:07.426300+0000","last_became_peered":"2023-11-30T17:25:07.426300+0000","last_unstale":"2023-11-30T17:25:07.790445+0000","last_undegraded":"2023-11-30T17:25:07.790445+0000","last_fullsized":"2023-11-30T17:25:07.790445+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":104,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.804349+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:25:07.804349+0000","last_peered":"2023-11-30T17:25:07.804349+0000","last_clean":"2023-11-30T17:25:07.804349+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:25:07.804349+0000","last_undegraded":"2023-11-30T17:25:07.804349+0000","last_fullsized":"2023-11-30T17:25:07.804349+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.812594+0000","last_change":"2023-11-30T17:25:07.808255+0000","last_active":"2023-11-30T17:25:07.812594+0000","last_peered":"2023-11-30T17:25:07.812594+0000","last_clean":"2023-11-30T17:25:07.812594+0000","last_became_active":"2023-11-30T17:25:07.807981+0000","last_became_peered":"2023-11-30T17:25:07.807981+0000","last_unstale":"2023-11-30T17:25:07.812594+0000","last_undegraded":"2023-11-30T17:25:07.812594+0000","last_fullsized":"2023-11-30T17:25:07.812594+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.805149+0000","last_change":"2023-11-30T17:25:07.419740+0000","last_active":"2023-11-30T17:25:07.805149+0000","last_peered":"2023-11-30T17:25:07.805149+0000","last_clean":"2023-11-30T17:25:07.805149+0000","last_became_active":"2023-11-30T17:25:07.419448+0000","last_became_peered":"2023-11-30T17:25:07.419448+0000","last_unstale":"2023-11-30T17:25:07.805149+0000","last_undegraded":"2023-11-30T17:25:07.805149+0000","last_fullsized":"2023-11-30T17:25:07.805149+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":107,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.797332+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:25:07.797332+0000","last_peered":"2023-11-30T17:25:07.797332+0000","last_clean":"2023-11-30T17:25:07.797332+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:25:07.797332+0000","last_undegraded":"2023-11-30T17:25:07.797332+0000","last_fullsized":"2023-11-30T17:25:07.797332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.807849+0000","last_change":"2023-11-30T17:25:07.804132+0000","last_active":"2023-11-30T17:25:07.807849+0000","last_peered":"2023-11-30T17:25:07.807849+0000","last_clean":"2023-11-30T17:25:07.807849+0000","last_became_active":"2023-11-30T17:25:07.803746+0000","last_became_peered":"2023-11-30T17:25:07.803746+0000","last_unstale":"2023-11-30T17:25:07.807849+0000","last_undegraded":"2023-11-30T17:25:07.807849+0000","last_fullsized":"2023-11-30T17:25:07.807849+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:07.395313+0000","last_clean_scrub_stamp":"2023-11-30T17:25:07.395313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.790668+0000","last_change":"2023-11-30T17:25:07.426346+0000","last_active":"2023-11-30T17:25:07.790668+0000","last_peered":"2023-11-30T17:25:07.790668+0000","last_clean":"2023-11-30T17:25:07.790668+0000","last_became_active":"2023-11-30T17:25:07.426056+0000","last_became_peered":"2023-11-30T17:25:07.426056+0000","last_unstale":"2023-11-30T17:25:07.790668+0000","last_undegraded":"2023-11-30T17:25:07.790668+0000","last_fullsized":"2023-11-30T17:25:07.790668+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:25:06.393516+0000","last_clean_scrub_stamp":"2023-11-30T17:25:06.393516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":118,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-11-30T17:25:07.797119+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:25:07.797119+0000","last_peered":"2023-11-30T17:25:07.797119+0000","last_clean":"2023-11-30T17:25:07.797119+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:25:07.797119+0000","last_undegraded":"2023-11-30T17:25:07.797119+0000","last_fullsized":"2023-11-30T17:25:07.797119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575061,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302764,"kb_used_data":1572,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069076,"statfs":{"total":96636764160,"available":96326733824,"internally_reserved":0,"allocated":1609728,"data_stored":811271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56899999999999995,"15min":0.58399999999999996},"min":{"1min":0.443,"5min":0.315,"15min":0.315},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57299999999999995,"15min":0.58799999999999997},"min":{"1min":0.48599999999999999,"5min":0.41099999999999998,"15min":0.36699999999999999},"max":{"1min":0.75,"5min":0.78300000000000003,"15min":0.81899999999999995},"last":0.57599999999999996}]},{"osd":1,"last update":"Thu Nov 30 17:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53600000000000003,"15min":0.54700000000000004},"min":{"1min":0.44900000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69799999999999995,"5min":1.181,"15min":1.181},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53000000000000003,"15min":0.54900000000000004},"min":{"1min":0.46200000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.72999999999999998,"5min":0.76600000000000001,"15min":0.82499999999999996},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.54900000000000004,"15min":0.55500000000000005},"min":{"1min":0.46500000000000002,"5min":0.34200000000000003,"15min":0.33500000000000002},"max":{"1min":0.75800000000000001,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54500000000000004,"15min":0.55800000000000005},"min":{"1min":0.42999999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72099999999999997,"5min":0.73699999999999999,"15min":0.83899999999999997},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Nov 30 17:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.52800000000000002,"15min":0.54400000000000004},"min":{"1min":0.41099999999999998,"5min":0.36499999999999999,"15min":0.36299999999999999},"max":{"1min":0.74399999999999999,"5min":0.749,"15min":0.78000000000000003},"last":0.376},{"interface":"front","average":{"1min":0.621,"5min":0.58099999999999996,"15min":0.58599999999999997},"min":{"1min":0.46800000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78000000000000003,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46100000000000002,"15min":0.45400000000000001},"min":{"1min":0.308,"5min":0.29899999999999999,"15min":0.29699999999999999},"max":{"1min":0.66900000000000004,"5min":0.77000000000000002,"15min":0.77500000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.48499999999999999,"15min":0.47599999999999998},"min":{"1min":0.37,"5min":0.30099999999999999,"15min":0.29399999999999998},"max":{"1min":0.70199999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Nov 30 17:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.497,"15min":0.48399999999999999},"min":{"1min":0.37,"5min":0.313,"15min":0.29499999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.622},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53000000000000003,"15min":0.51900000000000002},"min":{"1min":0.33900000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.81299999999999994},"last":0.72599999999999998}]},{"osd":6,"last update":"Thu Nov 30 17:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56299999999999994,"15min":0.54700000000000004},"min":{"1min":0.37,"5min":0.307,"15min":0.307},"max":{"1min":0.75800000000000001,"5min":0.81200000000000006,"15min":0.85199999999999998},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55500000000000005,"15min":0.54300000000000004},"min":{"1min":0.34799999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77200000000000002,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.59699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575060,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302772,"kb_used_data":1580,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069068,"statfs":{"total":96636764160,"available":96326725632,"internally_reserved":0,"allocated":1617920,"data_stored":811847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55100000000000005,"15min":0.57499999999999996},"min":{"1min":0.51700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.80200000000000005,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56299999999999994,"15min":0.58899999999999997},"min":{"1min":0.49299999999999999,"5min":0.33500000000000002,"15min":0.308},"max":{"1min":0.71899999999999997,"5min":0.83599999999999997,"15min":0.89300000000000002},"last":0.75600000000000001}]},{"osd":1,"last update":"Thu Nov 30 17:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53200000000000003,"15min":0.56599999999999995},"min":{"1min":0.46200000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70799999999999996,"5min":0.78400000000000003,"15min":0.82799999999999996},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.57999999999999996,"15min":0.60199999999999998},"min":{"1min":0.49399999999999999,"5min":0.35899999999999999,"15min":0.313},"max":{"1min":0.78000000000000003,"5min":0.80000000000000004,"15min":0.85199999999999998},"last":0.78800000000000003}]},{"osd":2,"last update":"Thu Nov 30 17:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54600000000000004,"15min":0.57299999999999995},"min":{"1min":0.45800000000000002,"5min":0.34200000000000003,"15min":0.26500000000000001},"max":{"1min":0.748,"5min":0.78800000000000003,"15min":0.80100000000000005},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56299999999999994,"15min":0.58299999999999996},"min":{"1min":0.47899999999999998,"5min":0.34399999999999997,"15min":0.34300000000000003},"max":{"1min":0.76000000000000001,"5min":0.82299999999999995,"15min":0.82499999999999996},"last":0.76600000000000001}]},{"osd":3,"last update":"Thu Nov 30 17:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.502,"15min":0.53000000000000003},"min":{"1min":0.39300000000000002,"5min":0.32700000000000001,"15min":0.28299999999999997},"max":{"1min":0.625,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51700000000000002,"15min":0.53900000000000003},"min":{"1min":0.39200000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.69199999999999995,"5min":0.752,"15min":0.79600000000000004},"last":0.72899999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69399999999999995,"5min":0.80800000000000005,"15min":0.84199999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.434,"5min":0.46600000000000003,"15min":0.47499999999999998},"min":{"1min":0.32300000000000001,"5min":0.312,"15min":0.23100000000000001},"max":{"1min":0.54400000000000004,"5min":0.746,"15min":0.83899999999999997},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Nov 30 17:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46400000000000002,"15min":0.46800000000000003},"min":{"1min":0.35399999999999998,"5min":0.312,"15min":0.29899999999999999},"max":{"1min":0.58499999999999996,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.629},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.5,"15min":0.503},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69199999999999995,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Nov 30 17:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52500000000000002,"15min":0.52800000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.754,"5min":0.80000000000000004,"15min":0.93200000000000005},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54900000000000004,"15min":0.55800000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.34300000000000003},"max":{"1min":0.69499999999999995,"5min":0.81299999999999994,"15min":0.83499999999999996},"last":0.77700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575060,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306872,"kb_used_data":1584,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064968,"statfs":{"total":96636764160,"available":96322527232,"internally_reserved":0,"allocated":1622016,"data_stored":812731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:24:52 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.36399999999999999,"15min":0.35999999999999999},"min":{"1min":0.26200000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.39900000000000002,"5min":1.78,"15min":1.78},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.35099999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.63500000000000001,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.34699999999999998}]},{"osd":2,"last update":"Thu Nov 30 17:24:52 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39200000000000002},"min":{"1min":0.27800000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.53900000000000003,"5min":1.665,"15min":1.665},"last":0.253},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.49399999999999999,"15min":0.50600000000000001},"min":{"1min":0.40100000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.60499999999999998,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Nov 30 17:24:52 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.44700000000000001,"15min":0.45200000000000001},"min":{"1min":0.34200000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64900000000000002,"5min":1.865,"15min":1.865},"last":0.307},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42699999999999999,"15min":0.436},"min":{"1min":0.33900000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.47399999999999998,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.29499999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:24:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57599999999999996,"15min":0.59199999999999997},"min":{"1min":0.38600000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80400000000000005,"5min":0.873,"15min":0.89100000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.47899999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.755,"5min":0.85099999999999998,"15min":1.111},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Nov 30 17:24:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60799999999999998,"15min":0.60999999999999999},"min":{"1min":0.47199999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.74099999999999999,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60199999999999998,"15min":0.61199999999999999},"min":{"1min":0.45900000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75,"5min":0.874,"15min":0.91300000000000003},"last":0.60699999999999998}]},{"osd":6,"last update":"Thu Nov 30 17:24:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64600000000000002,"15min":0.66000000000000003},"min":{"1min":0.54900000000000004,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79000000000000004,"5min":0.91000000000000003,"15min":1.0600000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.65400000000000003,"15min":0.66500000000000004},"min":{"1min":0.433,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78300000000000003,"5min":1.635,"15min":1.635},"last":0.50700000000000001}]},{"osd":7,"last update":"Thu Nov 30 17:24:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.66300000000000003,"15min":0.67400000000000004},"min":{"1min":0.48699999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79100000000000004,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.63500000000000001,"15min":0.65300000000000002},"min":{"1min":0.48499999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77100000000000002,"5min":0.90200000000000002,"15min":0.94199999999999995},"last":0.64000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575060,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302772,"kb_used_data":1580,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069068,"statfs":{"total":96636764160,"available":96326725632,"internally_reserved":0,"allocated":1617920,"data_stored":811915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 17:24:30 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.35999999999999999,"15min":0.36599999999999999},"min":{"1min":0.25900000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.71199999999999997},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.371,"15min":0.38500000000000001},"min":{"1min":0.28699999999999998,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.502,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.247}]},{"osd":2,"last update":"Thu Nov 30 17:24:30 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.375,"15min":0.38700000000000001},"min":{"1min":0.26800000000000002,"5min":0.24399999999999999,"15min":0.23899999999999999},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.623},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.436,"15min":0.45700000000000002},"min":{"1min":0.35299999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.70499999999999996},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Nov 30 17:24:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.40899999999999997,"15min":0.42899999999999999},"min":{"1min":0.26700000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.70999999999999996},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.42199999999999999,"15min":0.441},"min":{"1min":0.308,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61599999999999999,"5min":0.63700000000000001,"15min":0.68799999999999994},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:24:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57899999999999996,"15min":0.60199999999999998},"min":{"1min":0.441,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76000000000000001,"5min":0.78800000000000003,"15min":0.96099999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59399999999999997,"15min":0.61899999999999999},"min":{"1min":0.45700000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80300000000000005,"5min":0.86899999999999999,"15min":0.98599999999999999},"last":0.75600000000000001}]},{"osd":5,"last update":"Thu Nov 30 17:24:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58699999999999997,"15min":0.60299999999999998},"min":{"1min":0.42699999999999999,"5min":0.39500000000000002,"15min":0.39200000000000002},"max":{"1min":0.72699999999999998,"5min":0.86799999999999999,"15min":1.0109999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60199999999999998,"15min":0.626},"min":{"1min":0.46999999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.872,"5min":0.90100000000000002,"15min":1.004},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Nov 30 17:24:30 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61399999999999999,"15min":0.64100000000000001},"min":{"1min":0.46000000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.84799999999999998,"5min":0.89800000000000002,"15min":1.002},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.435,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.96799999999999997},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Nov 30 17:24:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.627,"15min":0.64900000000000002},"min":{"1min":0.496,"5min":0.439,"15min":0.439},"max":{"1min":0.92700000000000005,"5min":0.94499999999999995,"15min":1.0129999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65900000000000003,"15min":0.68500000000000005},"min":{"1min":0.46700000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.026},"last":0.79700000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575060,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306864,"kb_used_data":1576,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064976,"statfs":{"total":96636764160,"available":96322535424,"internally_reserved":0,"allocated":1613824,"data_stored":811285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.40999999999999998,"15min":0.40200000000000002},"min":{"1min":0.23799999999999999,"5min":0.221,"15min":0.19900000000000001},"max":{"1min":0.58999999999999997,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42699999999999999,"15min":0.438},"min":{"1min":0.309,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.57499999999999996,"5min":2.637,"15min":2.637},"last":0.27900000000000003}]},{"osd":1,"last update":"Thu Nov 30 17:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.47999999999999998,"15min":0.46100000000000002},"min":{"1min":0.28999999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53300000000000003,"5min":6.1210000000000004,"15min":6.1210000000000004},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.499,"15min":0.48999999999999999},"min":{"1min":0.34699999999999998,"5min":0.30399999999999999,"15min":0.26700000000000002},"max":{"1min":0.58699999999999997,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.32800000000000001}]},{"osd":3,"last update":"Thu Nov 30 17:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.373,"15min":0.40000000000000002},"min":{"1min":0.29699999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.501,"5min":0.56200000000000006,"15min":0.86199999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.443,"15min":0.46600000000000003},"min":{"1min":0.32800000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.60899999999999999,"5min":1.756,"15min":1.756},"last":0.379}]},{"osd":4,"last update":"Thu Nov 30 17:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.67700000000000005,"15min":0.64500000000000002},"min":{"1min":0.40999999999999998,"5min":0.40300000000000002,"15min":0.33500000000000002},"max":{"1min":0.77200000000000002,"5min":8.7170000000000005,"15min":8.7170000000000005},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58099999999999996,"15min":0.60699999999999998},"min":{"1min":0.40999999999999998,"5min":0.377,"15min":0.371},"max":{"1min":0.77400000000000002,"5min":1.381,"15min":1.492},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Nov 30 17:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.626,"15min":0.63700000000000001},"min":{"1min":0.45100000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.85999999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61499999999999999,"15min":0.63600000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38900000000000001},"max":{"1min":0.82099999999999995,"5min":1.982,"15min":1.982},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Nov 30 17:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59599999999999997,"15min":0.623},"min":{"1min":0.44600000000000001,"5min":0.40899999999999997,"15min":0.39600000000000002},"max":{"1min":0.77900000000000003,"5min":0.95999999999999996,"15min":1.359},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64000000000000001,"15min":0.66300000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.39600000000000002},"max":{"1min":0.82199999999999995,"5min":1.861,"15min":1.861},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Nov 30 17:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67500000000000004,"15min":0.68200000000000005},"min":{"1min":0.46800000000000003,"5min":0.438,"15min":0.438},"max":{"1min":0.84799999999999998,"5min":4.6849999999999996,"15min":4.6849999999999996},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68500000000000005,"15min":0.69299999999999995},"min":{"1min":0.45600000000000002,"5min":0.433,"15min":0.41499999999999998},"max":{"1min":0.84099999999999997,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.61099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575060,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306856,"kb_used_data":1568,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064984,"statfs":{"total":96636764160,"available":96322543616,"internally_reserved":0,"allocated":1605632,"data_stored":811181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.33900000000000002,"15min":0.36399999999999999},"min":{"1min":0.27500000000000002,"5min":0.222,"15min":0.219},"max":{"1min":0.51100000000000001,"5min":0.54100000000000004,"15min":0.66200000000000003},"last":0.313},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.38100000000000001,"15min":0.40500000000000003},"min":{"1min":0.27200000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.56499999999999995,"5min":0.57199999999999995,"15min":0.67600000000000005},"last":0.42399999999999999}]},{"osd":1,"last update":"Thu Nov 30 17:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.35999999999999999,"15min":0.38700000000000001},"min":{"1min":0.28100000000000003,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.53700000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.39800000000000002,"15min":0.42899999999999999},"min":{"1min":0.32000000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57999999999999996,"5min":0.59699999999999998,"15min":0.73399999999999999},"last":0.376}]},{"osd":2,"last update":"Thu Nov 30 17:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.41799999999999998,"15min":0.45000000000000001},"min":{"1min":0.32200000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59199999999999997,"5min":0.66000000000000003,"15min":0.94899999999999995},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.47799999999999998,"15min":0.51100000000000001},"min":{"1min":0.39000000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68600000000000005,"5min":1.054,"15min":1.054},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Nov 30 17:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.57799999999999996,"15min":0.60799999999999998},"min":{"1min":0.41699999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.97599999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.58499999999999996,"15min":0.61299999999999999},"min":{"1min":0.42799999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.91400000000000003},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Nov 30 17:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57399999999999995,"15min":0.60999999999999999},"min":{"1min":0.47299999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.98399999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.61499999999999999,"15min":0.64100000000000001},"min":{"1min":0.47099999999999997,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.92800000000000005,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.45600000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.61299999999999999,"15min":0.64100000000000001},"min":{"1min":0.437,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86599999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61699999999999999,"15min":0.64700000000000002},"min":{"1min":0.48999999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.0389999999999999},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Nov 30 17:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.61899999999999999,"15min":0.65800000000000003},"min":{"1min":0.40699999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.0660000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.625,"15min":0.66000000000000003},"min":{"1min":0.44600000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.89100000000000001,"5min":0.98999999999999999,"15min":1.004},"last":0.66000000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575060,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302768,"kb_used_data":1576,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069072,"statfs":{"total":96636764160,"available":96326729728,"internally_reserved":0,"allocated":1613824,"data_stored":812095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.35399999999999998,"5min":0.28299999999999997,"15min":0.27500000000000002},"max":{"1min":0.71499999999999997,"5min":0.748,"15min":0.80900000000000005},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.52200000000000002,"15min":0.54200000000000004},"min":{"1min":0.38700000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.71099999999999997,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Nov 30 17:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.52100000000000002,"15min":0.54200000000000004},"min":{"1min":0.40300000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.79600000000000004},"last":0.376},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54400000000000004,"15min":0.54700000000000004},"min":{"1min":0.34399999999999997,"5min":0.317,"15min":0.30399999999999999},"max":{"1min":0.77800000000000002,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu Nov 30 17:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55800000000000005,"15min":0.57599999999999996},"min":{"1min":0.39200000000000002,"5min":0.36899999999999999,"15min":0.34499999999999997},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.84099999999999997},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57499999999999996,"15min":0.59399999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78600000000000003,"5min":0.79500000000000004,"15min":0.81399999999999995},"last":0.45700000000000002}]},{"osd":3,"last update":"Thu Nov 30 17:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53500000000000003,"15min":0.54800000000000004},"min":{"1min":0.41199999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77000000000000002,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.44},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.55100000000000005,"15min":0.56899999999999995},"min":{"1min":0.376,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76100000000000001,"5min":0.76500000000000001,"15min":0.79200000000000004},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Nov 30 17:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.44400000000000001,"15min":0.437},"min":{"1min":0.27700000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.54700000000000004,"5min":1.272,"15min":1.272},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.45600000000000002,"15min":0.45100000000000001},"min":{"1min":0.29499999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.51600000000000001,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.51800000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.503,"15min":0.49399999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.314},"max":{"1min":0.59899999999999998,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.374,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.629,"5min":1.129,"15min":1.129},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Nov 30 17:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.50900000000000001,"15min":0.50600000000000001},"min":{"1min":0.307,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.73099999999999998,"5min":0.81999999999999995,"15min":0.82199999999999995},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.38200000000000001,"5min":0.34999999999999998,"15min":0.34599999999999997},"max":{"1min":0.75,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.56499999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575060,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302764,"kb_used_data":1572,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069076,"statfs":{"total":96636764160,"available":96326733824,"internally_reserved":0,"allocated":1609728,"data_stored":811735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52700000000000002,"15min":0.54000000000000004},"min":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.496},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.51600000000000001,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.311,"15min":0.31},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.38100000000000001}]},{"osd":1,"last update":"Thu Nov 30 17:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.53200000000000003},"min":{"1min":0.33700000000000002,"5min":0.33100000000000002,"15min":0.32300000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.51300000000000001,"15min":0.54800000000000004},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.39500000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56000000000000005,"15min":0.58799999999999997},"min":{"1min":0.42699999999999999,"5min":0.34399999999999997,"15min":0.30599999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56899999999999995,"15min":0.59599999999999997},"min":{"1min":0.40000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.45700000000000002}]},{"osd":3,"last update":"Thu Nov 30 17:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52100000000000002,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55000000000000004,"15min":0.56899999999999995},"min":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.99299999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Nov 30 17:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.434,"15min":0.434},"min":{"1min":0.29499999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46000000000000002,"15min":0.46400000000000002},"min":{"1min":0.307,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.439}]},{"osd":6,"last update":"Thu Nov 30 17:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48499999999999999,"15min":0.48299999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.371,"5min":0.34499999999999997,"15min":0.33500000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.56299999999999994}]},{"osd":7,"last update":"Thu Nov 30 17:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.35099999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.56699999999999995,"15min":0.57299999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.34899999999999998},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.54400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:25:12.183 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-30T17:25:12.183 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-30T17:25:12.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.340+0000 7f14094ca700 1 Processor -- start 2023-11-30T17:25:12.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.340+0000 7f14094ca700 1 -- start start 2023-11-30T17:25:12.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.341+0000 7f14094ca700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14040a8280 0x7f14040a8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:12.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.341+0000 7f14094ca700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1404158160 0x7f1404155500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:12.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.341+0000 7f14094ca700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1404067770 con 0x7f140414e600 2023-11-30T17:25:12.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.341+0000 7f14094ca700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1404159180 con 0x7f1404158160 2023-11-30T17:25:12.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.341+0000 7f14094ca700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14040be8d0 con 0x7f14040a8280 2023-11-30T17:25:12.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.341+0000 7f14037fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f140414e600 0x7f140414eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46302/0 (socket says 172.21.15.49:46302) 2023-11-30T17:25:12.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.341+0000 7f14037fe700 1 -- 172.21.15.49:0/4081963719 learned_addr learned my addr 172.21.15.49:0/4081963719 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:25:12.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.341+0000 7f1402ffd700 1 --2- 172.21.15.49:0/4081963719 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14040a8280 0x7f14040a8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:12.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.341+0000 7f14027fc700 1 --2- 172.21.15.49:0/4081963719 >> v2:172.21.15.115:3300/0 conn(0x7f1404158160 0x7f1404155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:12.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.341+0000 7f1401ffb700 1 -- 172.21.15.49:0/4081963719 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930323962 0 0) 0x7f1404067770 con 0x7f140414e600 2023-11-30T17:25:12.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.341+0000 7f1401ffb700 1 -- 172.21.15.49:0/4081963719 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13f00033f0 con 0x7f140414e600 2023-11-30T17:25:12.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.342+0000 7f1401ffb700 1 -- 172.21.15.49:0/4081963719 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2513135461 0 0) 0x7f13f00033f0 con 0x7f140414e600 2023-11-30T17:25:12.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.342+0000 7f1401ffb700 1 -- 172.21.15.49:0/4081963719 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14040a8280 msgr2=0x7f14040a8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:12.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.342+0000 7f1401ffb700 1 --2- 172.21.15.49:0/4081963719 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14040a8280 0x7f14040a8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:12.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.342+0000 7f1401ffb700 1 -- 172.21.15.49:0/4081963719 >> v2:172.21.15.115:3300/0 conn(0x7f1404158160 msgr2=0x7f1404155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:12.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.342+0000 7f1401ffb700 1 --2- 172.21.15.49:0/4081963719 >> v2:172.21.15.115:3300/0 conn(0x7f1404158160 0x7f1404155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:12.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.342+0000 7f1401ffb700 1 -- 172.21.15.49:0/4081963719 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1404158600 con 0x7f140414e600 2023-11-30T17:25:12.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.342+0000 7f1401ffb700 1 -- 172.21.15.49:0/4081963719 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f13fc0017f0 con 0x7f140414e600 2023-11-30T17:25:12.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.342+0000 7f1401ffb700 1 -- 172.21.15.49:0/4081963719 >> v1:172.21.15.49:6789/0 conn(0x7f140414e600 legacy=0x7f140414eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:12.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.342+0000 7f1401ffb700 1 --2- 172.21.15.49:0/4081963719 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14040a8280 0x7f13f00038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:12.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.342+0000 7f1401ffb700 1 --2- 172.21.15.49:0/4081963719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13f0003e10 0x7f13f0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:12.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.342+0000 7f1401ffb700 1 --2- 172.21.15.49:0/4081963719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13f0004b80 0x7f13f0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:12.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.342+0000 7f1401ffb700 1 -- 172.21.15.49:0/4081963719 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1404159180 con 0x7f13f0004b80 2023-11-30T17:25:12.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.342+0000 7f1401ffb700 1 -- 172.21.15.49:0/4081963719 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14040be8d0 con 0x7f13f0003e10 2023-11-30T17:25:12.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.342+0000 7f1401ffb700 1 -- 172.21.15.49:0/4081963719 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f000b8e0 con 0x7f14040a8280 2023-11-30T17:25:12.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.342+0000 7f14037fe700 1 --2- 172.21.15.49:0/4081963719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13f0004b80 0x7f13f0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:12.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.342+0000 7f1402ffd700 1 --2- 172.21.15.49:0/4081963719 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14040a8280 0x7f13f00038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:12.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.342+0000 7f14027fc700 1 --2- 172.21.15.49:0/4081963719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13f0003e10 0x7f13f0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:12.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.342+0000 7f14037fe700 1 -- 172.21.15.49:0/4081963719 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14040a8280 msgr2=0x7f13f00038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:12.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.342+0000 7f14037fe700 1 --2- 172.21.15.49:0/4081963719 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14040a8280 0x7f13f00038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:12.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.342+0000 7f14037fe700 1 -- 172.21.15.49:0/4081963719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13f0003e10 msgr2=0x7f13f0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:12.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.342+0000 7f14037fe700 1 --2- 172.21.15.49:0/4081963719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13f0003e10 0x7f13f0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:12.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.342+0000 7f14037fe700 1 -- 172.21.15.49:0/4081963719 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f00033f0 con 0x7f13f0004b80 2023-11-30T17:25:12.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.342+0000 7f14037fe700 1 --2- 172.21.15.49:0/4081963719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13f0004b80 0x7f13f0005000 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7f13fc00c560 tx=0x7f13fc002210).ready entity=mon.0 client_cookie=8652c36cadef5830 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:12.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.343+0000 7f1401ffb700 1 -- 172.21.15.49:0/4081963719 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc007de0 con 0x7f13f0004b80 2023-11-30T17:25:12.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.343+0000 7f1401ffb700 1 -- 172.21.15.49:0/4081963719 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13fc00ce50 con 0x7f13f0004b80 2023-11-30T17:25:12.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.343+0000 7f1401ffb700 1 -- 172.21.15.49:0/4081963719 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc005d50 con 0x7f13f0004b80 2023-11-30T17:25:12.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.343+0000 7f14094ca700 1 -- 172.21.15.49:0/4081963719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13f0004b80 msgr2=0x7f13f0005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:12.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.343+0000 7f14094ca700 1 --2- 172.21.15.49:0/4081963719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13f0004b80 0x7f13f0005000 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7f13fc00c560 tx=0x7f13fc002210).stop 2023-11-30T17:25:12.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.343+0000 7f14037fe700 1 -- 172.21.15.49:0/4081963719 reap_dead start 2023-11-30T17:25:12.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.343+0000 7f14094ca700 1 -- 172.21.15.49:0/4081963719 shutdown_connections 2023-11-30T17:25:12.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.343+0000 7f14094ca700 1 -- 172.21.15.49:0/4081963719 >> 172.21.15.49:0/4081963719 conn(0x7f1404062700 msgr2=0x7f1404062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:12.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.343+0000 7f14094ca700 1 -- 172.21.15.49:0/4081963719 shutdown_connections 2023-11-30T17:25:12.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.343+0000 7f14094ca700 1 -- 172.21.15.49:0/4081963719 wait complete. 2023-11-30T17:25:12.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.344+0000 7f14094ca700 1 Processor -- start 2023-11-30T17:25:12.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.345+0000 7f14094ca700 1 -- start start 2023-11-30T17:25:12.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.345+0000 7f14094ca700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1404142990 0x7f1404142d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:12.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.345+0000 7f14094ca700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1404155b90 0x7f1404156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:12.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.345+0000 7f14094ca700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14040ac9e0 0x7f14040ace60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:12.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.345+0000 7f14094ca700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140414e340 con 0x7f14040ac9e0 2023-11-30T17:25:12.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.345+0000 7f14094ca700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1404156d30 con 0x7f1404142990 2023-11-30T17:25:12.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.345+0000 7f14094ca700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1404156500 con 0x7f1404155b90 2023-11-30T17:25:12.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.345+0000 7f14037fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14040ac9e0 0x7f14040ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:12.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.345+0000 7f14037fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14040ac9e0 0x7f14040ace60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59730/0 (socket says 172.21.15.49:59730) 2023-11-30T17:25:12.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.345+0000 7f14037fe700 1 -- 172.21.15.49:0/131017520 learned_addr learned my addr 172.21.15.49:0/131017520 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:12.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.345+0000 7f14027fc700 1 --2- 172.21.15.49:0/131017520 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1404155b90 0x7f1404156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:12.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.346+0000 7f1402ffd700 1 --2- 172.21.15.49:0/131017520 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1404142990 0x7f1404142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:12.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.346+0000 7f14037fe700 1 -- 172.21.15.49:0/131017520 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1404155b90 msgr2=0x7f1404156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:12.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.346+0000 7f14037fe700 1 --2- 172.21.15.49:0/131017520 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1404155b90 0x7f1404156010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:12.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.346+0000 7f14037fe700 1 -- 172.21.15.49:0/131017520 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1404142990 msgr2=0x7f1404142d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:12.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.346+0000 7f14037fe700 1 --2- 172.21.15.49:0/131017520 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1404142990 0x7f1404142d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:12.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.346+0000 7f14037fe700 1 -- 172.21.15.49:0/131017520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1404156770 con 0x7f14040ac9e0 2023-11-30T17:25:12.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.346+0000 7f14027fc700 1 --2- 172.21.15.49:0/131017520 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1404155b90 0x7f1404156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:25:12.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.346+0000 7f1402ffd700 1 --2- 172.21.15.49:0/131017520 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1404142990 0x7f1404142d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:25:12.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.346+0000 7f14037fe700 1 --2- 172.21.15.49:0/131017520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14040ac9e0 0x7f14040ace60 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7f13fc00a000 tx=0x7f13fc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:12.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.346+0000 7f13faffd700 1 -- 172.21.15.49:0/131017520 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc018030 con 0x7f14040ac9e0 2023-11-30T17:25:12.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.346+0000 7f13faffd700 1 -- 172.21.15.49:0/131017520 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13fc0017b0 con 0x7f14040ac9e0 2023-11-30T17:25:12.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.346+0000 7f14094ca700 1 -- 172.21.15.49:0/131017520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1404156a50 con 0x7f14040ac9e0 2023-11-30T17:25:12.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.346+0000 7f13faffd700 1 -- 172.21.15.49:0/131017520 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc007de0 con 0x7f14040ac9e0 2023-11-30T17:25:12.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.346+0000 7f14094ca700 1 -- 172.21.15.49:0/131017520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14040ac4c0 con 0x7f14040ac9e0 2023-11-30T17:25:12.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.347+0000 7f14094ca700 1 -- 172.21.15.49:0/131017520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14040ac680 con 0x7f14040ac9e0 2023-11-30T17:25:12.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.347+0000 7f13faffd700 1 -- 172.21.15.49:0/131017520 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f13fc0060d0 con 0x7f14040ac9e0 2023-11-30T17:25:12.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.348+0000 7f13faffd700 1 --2- 172.21.15.49:0/131017520 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f13e405f270 0x7f13e4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:12.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.348+0000 7f13faffd700 1 -- 172.21.15.49:0/131017520 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f13fc07ae80 con 0x7f14040ac9e0 2023-11-30T17:25:12.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.348+0000 7f1402ffd700 1 --2- 172.21.15.49:0/131017520 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f13e405f270 0x7f13e4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:12.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.348+0000 7f1402ffd700 1 --2- 172.21.15.49:0/131017520 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f13e405f270 0x7f13e4061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f13f4006d80 tx=0x7f13f4008040).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:12.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.352+0000 7f13faffd700 1 -- 172.21.15.49:0/131017520 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f13fc04bfb0 con 0x7f14040ac9e0 2023-11-30T17:25:12.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.594+0000 7f14094ca700 1 -- 172.21.15.49:0/131017520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f140406c860 con 0x7f14040ac9e0 2023-11-30T17:25:12.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.598+0000 7f13faffd700 1 -- 172.21.15.49:0/131017520 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+0 (secure 0 0 0) 0x7f13fc0240e0 con 0x7f14040ac9e0 2023-11-30T17:25:12.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.600+0000 7f14094ca700 1 -- 172.21.15.49:0/131017520 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f13e405f270 msgr2=0x7f13e4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:12.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.600+0000 7f14094ca700 1 --2- 172.21.15.49:0/131017520 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f13e405f270 0x7f13e4061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f13f4006d80 tx=0x7f13f4008040).stop 2023-11-30T17:25:12.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.600+0000 7f14094ca700 1 -- 172.21.15.49:0/131017520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14040ac9e0 msgr2=0x7f14040ace60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:12.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.600+0000 7f14094ca700 1 --2- 172.21.15.49:0/131017520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14040ac9e0 0x7f14040ace60 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7f13fc00a000 tx=0x7f13fc015000).stop 2023-11-30T17:25:12.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.600+0000 7f14094ca700 1 -- 172.21.15.49:0/131017520 shutdown_connections 2023-11-30T17:25:12.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.600+0000 7f14094ca700 1 --2- 172.21.15.49:0/131017520 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f13e405f270 0x7f13e4061730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:12.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.600+0000 7f14094ca700 1 --2- 172.21.15.49:0/131017520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14040ac9e0 0x7f14040ace60 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:12.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.600+0000 7f14094ca700 1 --2- 172.21.15.49:0/131017520 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1404142990 0x7f1404142d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:12.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.600+0000 7f14094ca700 1 --2- 172.21.15.49:0/131017520 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1404155b90 0x7f1404156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:12.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.600+0000 7f14094ca700 1 -- 172.21.15.49:0/131017520 >> 172.21.15.49:0/131017520 conn(0x7f1404062700 msgr2=0x7f1404157680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:12.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.600+0000 7f14094ca700 1 -- 172.21.15.49:0/131017520 shutdown_connections 2023-11-30T17:25:12.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.600+0000 7f14094ca700 1 -- 172.21.15.49:0/131017520 wait complete. 2023-11-30T17:25:12.604 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2023-11-30T17:25:12.614 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:25:12.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.730+0000 7f79fd77c700 1 Processor -- start 2023-11-30T17:25:12.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.730+0000 7f79fd77c700 1 -- start start 2023-11-30T17:25:12.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.731+0000 7f79fd77c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f79f81548c0 0x7f79f806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:12.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.731+0000 7f79fd77c700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f80c69a0 con 0x7f79f81544e0 2023-11-30T17:25:12.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.731+0000 7f79fd77c700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f80c13a0 con 0x7f79f80c6e30 2023-11-30T17:25:12.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.731+0000 7f79fd77c700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f80c1680 con 0x7f79f81548c0 2023-11-30T17:25:12.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.731+0000 7f79f6ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f79f81544e0 0x7f79f80c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46318/0 (socket says 172.21.15.49:46318) 2023-11-30T17:25:12.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.731+0000 7f79f6ffd700 1 -- 172.21.15.49:0/3691195566 learned_addr learned my addr 172.21.15.49:0/3691195566 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:25:12.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.731+0000 7f79f67fc700 1 --2- 172.21.15.49:0/3691195566 >> v2:172.21.15.115:3300/0 conn(0x7f79f81548c0 0x7f79f806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:12.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.731+0000 7f79f5ffb700 1 -- 172.21.15.49:0/3691195566 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 628987647 0 0) 0x7f79f80c69a0 con 0x7f79f81544e0 2023-11-30T17:25:12.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.731+0000 7f79f5ffb700 1 -- 172.21.15.49:0/3691195566 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79e00033f0 con 0x7f79f81544e0 2023-11-30T17:25:12.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.731+0000 7f79f5ffb700 1 -- 172.21.15.49:0/3691195566 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962621647 0 0) 0x7f79f80c13a0 con 0x7f79f80c6e30 2023-11-30T17:25:12.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.731+0000 7f79f5ffb700 1 -- 172.21.15.49:0/3691195566 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79f80c69a0 con 0x7f79f80c6e30 2023-11-30T17:25:12.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.731+0000 7f79f5ffb700 1 -- 172.21.15.49:0/3691195566 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2539355477 0 0) 0x7f79e00033f0 con 0x7f79f81544e0 2023-11-30T17:25:12.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.731+0000 7f79f5ffb700 1 -- 172.21.15.49:0/3691195566 >> v2:172.21.15.115:3300/0 conn(0x7f79f81548c0 msgr2=0x7f79f806a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:12.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.731+0000 7f79f5ffb700 1 --2- 172.21.15.49:0/3691195566 >> v2:172.21.15.115:3300/0 conn(0x7f79f81548c0 0x7f79f806a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:12.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.731+0000 7f79f5ffb700 1 -- 172.21.15.49:0/3691195566 >> v1:172.21.15.115:6789/0 conn(0x7f79f80c6e30 legacy=0x7f79f80a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:12.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.731+0000 7f79f5ffb700 1 -- 172.21.15.49:0/3691195566 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f80c6630 con 0x7f79f81544e0 2023-11-30T17:25:12.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.731+0000 7f79f5ffb700 1 -- 172.21.15.49:0/3691195566 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f79e80015f0 con 0x7f79f81544e0 2023-11-30T17:25:12.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.731+0000 7f79f5ffb700 1 -- 172.21.15.49:0/3691195566 >> v1:172.21.15.49:6789/0 conn(0x7f79f81544e0 legacy=0x7f79f80c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:12.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.731+0000 7f79f5ffb700 1 --2- 172.21.15.49:0/3691195566 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79e0003ac0 0x7f79e0003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:12.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.731+0000 7f79f5ffb700 1 --2- 172.21.15.49:0/3691195566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79e0004690 0x7f79e0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:12.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.732+0000 7f79f5ffb700 1 --2- 172.21.15.49:0/3691195566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79e0005000 0x7f79e000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:12.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.732+0000 7f79f5ffb700 1 -- 172.21.15.49:0/3691195566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f80c1680 con 0x7f79e0004690 2023-11-30T17:25:12.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.732+0000 7f79f5ffb700 1 -- 172.21.15.49:0/3691195566 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e000beb0 con 0x7f79e0005000 2023-11-30T17:25:12.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.732+0000 7f79f5ffb700 1 -- 172.21.15.49:0/3691195566 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e000c070 con 0x7f79e0003ac0 2023-11-30T17:25:12.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.732+0000 7f79f67fc700 1 --2- 172.21.15.49:0/3691195566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79e0004690 0x7f79e0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:12.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.732+0000 7f79f6ffd700 1 --2- 172.21.15.49:0/3691195566 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79e0003ac0 0x7f79e0003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:12.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.732+0000 7f79f77fe700 1 --2- 172.21.15.49:0/3691195566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79e0005000 0x7f79e000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:12.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.732+0000 7f79f67fc700 1 -- 172.21.15.49:0/3691195566 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79e0003ac0 msgr2=0x7f79e0003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:12.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.732+0000 7f79f67fc700 1 --2- 172.21.15.49:0/3691195566 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79e0003ac0 0x7f79e0003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:12.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.732+0000 7f79f67fc700 1 -- 172.21.15.49:0/3691195566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79e0005000 msgr2=0x7f79e000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:12.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.732+0000 7f79f67fc700 1 --2- 172.21.15.49:0/3691195566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79e0005000 0x7f79e000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:12.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.732+0000 7f79f67fc700 1 -- 172.21.15.49:0/3691195566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e00033f0 con 0x7f79e0004690 2023-11-30T17:25:12.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.732+0000 7f79f6ffd700 1 --2- 172.21.15.49:0/3691195566 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79e0003ac0 0x7f79e0003ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:25:12.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.732+0000 7f79f77fe700 1 --2- 172.21.15.49:0/3691195566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79e0005000 0x7f79e000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:25:12.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.732+0000 7f79f77fe700 1 -- 172.21.15.49:0/3691195566 reap_dead start 2023-11-30T17:25:12.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.732+0000 7f79f67fc700 1 --2- 172.21.15.49:0/3691195566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79e0004690 0x7f79e0004b10 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7f79ec009a80 tx=0x7f79ec009060).ready entity=mon.0 client_cookie=6942f88cb28d7254 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:12.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.732+0000 7f79f5ffb700 1 -- 172.21.15.49:0/3691195566 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ec009430 con 0x7f79e0004690 2023-11-30T17:25:12.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.732+0000 7f79f5ffb700 1 -- 172.21.15.49:0/3691195566 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ec00e640 con 0x7f79e0004690 2023-11-30T17:25:12.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.732+0000 7f79f5ffb700 1 -- 172.21.15.49:0/3691195566 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ec00e9c0 con 0x7f79e0004690 2023-11-30T17:25:12.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.733+0000 7f79fd77c700 1 -- 172.21.15.49:0/3691195566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79e0004690 msgr2=0x7f79e0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:12.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.733+0000 7f79fd77c700 1 --2- 172.21.15.49:0/3691195566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79e0004690 0x7f79e0004b10 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7f79ec009a80 tx=0x7f79ec009060).stop 2023-11-30T17:25:12.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.733+0000 7f79fd77c700 1 -- 172.21.15.49:0/3691195566 shutdown_connections 2023-11-30T17:25:12.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.733+0000 7f79fd77c700 1 --2- 172.21.15.49:0/3691195566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79e0004690 0x7f79e0004b10 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:12.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.733+0000 7f79fd77c700 1 -- 172.21.15.49:0/3691195566 >> 172.21.15.49:0/3691195566 conn(0x7f79f8085020 msgr2=0x7f79f8094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:12.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.733+0000 7f79fd77c700 1 -- 172.21.15.49:0/3691195566 shutdown_connections 2023-11-30T17:25:12.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.733+0000 7f79fd77c700 1 -- 172.21.15.49:0/3691195566 wait complete. 2023-11-30T17:25:12.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.734+0000 7f79fd77c700 1 Processor -- start 2023-11-30T17:25:12.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.734+0000 7f79fd77c700 1 -- start start 2023-11-30T17:25:12.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.735+0000 7f79fd77c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79e0004690 0x7f79f814f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:12.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.735+0000 7f79fd77c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79f8098700 0x7f79f8098b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:12.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.735+0000 7f79fd77c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79f8096270 0x7f79f80966d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:12.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.735+0000 7f79fd77c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f8150510 con 0x7f79e0004690 2023-11-30T17:25:12.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.735+0000 7f79fd77c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f8095de0 con 0x7f79f8098700 2023-11-30T17:25:12.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.735+0000 7f79fd77c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f80951d0 con 0x7f79f8096270 2023-11-30T17:25:12.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.735+0000 7f79f6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79e0004690 0x7f79f814f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:12.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.735+0000 7f79f6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79e0004690 0x7f79f814f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59742/0 (socket says 172.21.15.49:59742) 2023-11-30T17:25:12.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.735+0000 7f79f6ffd700 1 -- 172.21.15.49:0/4101450568 learned_addr learned my addr 172.21.15.49:0/4101450568 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:12.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.735+0000 7f79f67fc700 1 --2- 172.21.15.49:0/4101450568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79f8098700 0x7f79f8098b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:12.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.735+0000 7f79f77fe700 1 --2- 172.21.15.49:0/4101450568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79f8096270 0x7f79f80966d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:12.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.735+0000 7f79f6ffd700 1 -- 172.21.15.49:0/4101450568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79f8096270 msgr2=0x7f79f80966d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:12.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.735+0000 7f79f6ffd700 1 --2- 172.21.15.49:0/4101450568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79f8096270 0x7f79f80966d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:12.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.735+0000 7f79f6ffd700 1 -- 172.21.15.49:0/4101450568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79f8098700 msgr2=0x7f79f8098b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:12.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.735+0000 7f79f6ffd700 1 --2- 172.21.15.49:0/4101450568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79f8098700 0x7f79f8098b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:12.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.735+0000 7f79f6ffd700 1 -- 172.21.15.49:0/4101450568 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f80954b0 con 0x7f79e0004690 2023-11-30T17:25:12.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.735+0000 7f79f6ffd700 1 --2- 172.21.15.49:0/4101450568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79e0004690 0x7f79f814f4e0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7f79e8001580 tx=0x7f79e8009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:12.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.735+0000 7f79deffd700 1 -- 172.21.15.49:0/4101450568 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e800ee90 con 0x7f79e0004690 2023-11-30T17:25:12.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.735+0000 7f79deffd700 1 -- 172.21.15.49:0/4101450568 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e8000f70 con 0x7f79e0004690 2023-11-30T17:25:12.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.735+0000 7f79fd77c700 1 -- 172.21.15.49:0/4101450568 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f8095790 con 0x7f79e0004690 2023-11-30T17:25:12.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.735+0000 7f79deffd700 1 -- 172.21.15.49:0/4101450568 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e80072e0 con 0x7f79e0004690 2023-11-30T17:25:12.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.736+0000 7f79fd77c700 1 -- 172.21.15.49:0/4101450568 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f8099070 con 0x7f79e0004690 2023-11-30T17:25:12.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.737+0000 7f79fd77c700 1 -- 172.21.15.49:0/4101450568 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f806c860 con 0x7f79e0004690 2023-11-30T17:25:12.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.737+0000 7f79deffd700 1 -- 172.21.15.49:0/4101450568 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f79e8005880 con 0x7f79e0004690 2023-11-30T17:25:12.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.737+0000 7f79deffd700 1 --2- 172.21.15.49:0/4101450568 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f79e405f270 0x7f79e4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:12.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.737+0000 7f79deffd700 1 -- 172.21.15.49:0/4101450568 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f79e807a260 con 0x7f79e0004690 2023-11-30T17:25:12.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.737+0000 7f79f67fc700 1 --2- 172.21.15.49:0/4101450568 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f79e405f270 0x7f79e4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:12.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.738+0000 7f79f67fc700 1 --2- 172.21.15.49:0/4101450568 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f79e405f270 0x7f79e4061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f79f8150810 tx=0x7f79ec01a000).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:12.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.741+0000 7f79deffd700 1 -- 172.21.15.49:0/4101450568 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f79e804b390 con 0x7f79e0004690 2023-11-30T17:25:12.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.958+0000 7f79fd77c700 1 -- 172.21.15.49:0/4101450568 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79f80c5890 con 0x7f79e0004690 2023-11-30T17:25:12.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.959+0000 7f79deffd700 1 -- 172.21.15.49:0/4101450568 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f79e804e9b0 con 0x7f79e0004690 2023-11-30T17:25:12.961 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:25:12.961 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":53,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/744782933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":744782933},{"type":"v1","addr":"172.21.15.115:6837","nonce":744782933}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7638,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/2409585815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2409585815},{"type":"v1","addr":"172.21.15.49:6834","nonce":2409585815}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7641,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3249829086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3249829086},{"type":"v1","addr":"172.21.15.49:6835","nonce":3249829086}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:25:07.786736+0000","modified":"2023-11-30T17:25:10.793530+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7650},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7650":{"gid":7650,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6835/3436956463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3436956463},{"type":"v1","addr":"172.21.15.115:6835","nonce":3436956463}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-11-30T17:25:12.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.961+0000 7f79fd77c700 1 -- 172.21.15.49:0/4101450568 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f79e405f270 msgr2=0x7f79e4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:12.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.961+0000 7f79fd77c700 1 --2- 172.21.15.49:0/4101450568 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f79e405f270 0x7f79e4061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f79f8150810 tx=0x7f79ec01a000).stop 2023-11-30T17:25:12.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.961+0000 7f79fd77c700 1 -- 172.21.15.49:0/4101450568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79e0004690 msgr2=0x7f79f814f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:12.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.961+0000 7f79fd77c700 1 --2- 172.21.15.49:0/4101450568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79e0004690 0x7f79f814f4e0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7f79e8001580 tx=0x7f79e8009040).stop 2023-11-30T17:25:12.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.961+0000 7f79fd77c700 1 -- 172.21.15.49:0/4101450568 shutdown_connections 2023-11-30T17:25:12.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.961+0000 7f79fd77c700 1 --2- 172.21.15.49:0/4101450568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79f8096270 0x7f79f80966d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:12.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.961+0000 7f79fd77c700 1 --2- 172.21.15.49:0/4101450568 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f79e405f270 0x7f79e4061730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:12.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.961+0000 7f79fd77c700 1 --2- 172.21.15.49:0/4101450568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79e0004690 0x7f79f814f4e0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:12.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.961+0000 7f79fd77c700 1 --2- 172.21.15.49:0/4101450568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79f8098700 0x7f79f8098b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:12.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.961+0000 7f79fd77c700 1 -- 172.21.15.49:0/4101450568 >> 172.21.15.49:0/4101450568 conn(0x7f79f8085020 msgr2=0x7f79f80c0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:12.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.961+0000 7f79fd77c700 1 -- 172.21.15.49:0/4101450568 shutdown_connections 2023-11-30T17:25:12.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:12.961+0000 7f79fd77c700 1 -- 172.21.15.49:0/4101450568 wait complete. 2023-11-30T17:25:12.965 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 53 2023-11-30T17:25:13.380 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 53, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-30T17:25:07.786736+0000', 'modified': '2023-11-30T17:25:10.793530+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7650}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7650': {'gid': 7650, 'name': 'b', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.115:6835/3436956463', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6834', 'nonce': 3436956463}, {'type': 'v1', 'addr': '172.21.15.115:6835', 'nonce': 3436956463}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-11-30T17:25:13.381 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-30T17:25:13.381 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-30T17:25:13.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.500+0000 7fb2994a2700 1 Processor -- start 2023-11-30T17:25:13.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.501+0000 7fb2994a2700 1 -- start start 2023-11-30T17:25:13.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.501+0000 7fb2994a2700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb2940a8280 0x7fb2940a8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:13.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.501+0000 7fb2994a2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb29414e600 0x7fb29414ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:13.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.501+0000 7fb2994a2700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb294067770 con 0x7fb294158160 2023-11-30T17:25:13.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.501+0000 7fb2994a2700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb294159180 con 0x7fb29414e600 2023-11-30T17:25:13.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.501+0000 7fb2994a2700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2940be8d0 con 0x7fb2940a8280 2023-11-30T17:25:13.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.502+0000 7fb2937fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb29414e600 0x7fb29414ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:13.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.502+0000 7fb2937fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb29414e600 0x7fb29414ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59744/0 (socket says 172.21.15.49:59744) 2023-11-30T17:25:13.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.502+0000 7fb2937fe700 1 -- 172.21.15.49:0/1386620541 learned_addr learned my addr 172.21.15.49:0/1386620541 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:13.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.502+0000 7fb292ffd700 1 --2- 172.21.15.49:0/1386620541 >> v2:172.21.15.115:3300/0 conn(0x7fb2940a8280 0x7fb2940a8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:13.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.502+0000 7fb2937fe700 1 -- 172.21.15.49:0/1386620541 >> v2:172.21.15.115:3300/0 conn(0x7fb2940a8280 msgr2=0x7fb2940a8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:13.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.502+0000 7fb2937fe700 1 --2- 172.21.15.49:0/1386620541 >> v2:172.21.15.115:3300/0 conn(0x7fb2940a8280 0x7fb2940a8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.502+0000 7fb2937fe700 1 -- 172.21.15.49:0/1386620541 >> v1:172.21.15.115:6789/0 conn(0x7fb294158160 legacy=0x7fb294155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:13.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.502+0000 7fb2937fe700 1 -- 172.21.15.49:0/1386620541 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb294158600 con 0x7fb29414e600 2023-11-30T17:25:13.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.502+0000 7fb2937fe700 1 --2- 172.21.15.49:0/1386620541 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb29414e600 0x7fb29414ea90 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7fb2940c9050 tx=0x7fb284009840).ready entity=mon.0 client_cookie=db69e1f19b3d9782 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:13.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.502+0000 7fb291ffb700 1 -- 172.21.15.49:0/1386620541 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28400e070 con 0x7fb29414e600 2023-11-30T17:25:13.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.502+0000 7fb291ffb700 1 -- 172.21.15.49:0/1386620541 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28400ba50 con 0x7fb29414e600 2023-11-30T17:25:13.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.502+0000 7fb291ffb700 1 -- 172.21.15.49:0/1386620541 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28400bdd0 con 0x7fb29414e600 2023-11-30T17:25:13.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.503+0000 7fb2994a2700 1 -- 172.21.15.49:0/1386620541 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb29414e600 msgr2=0x7fb29414ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:13.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.503+0000 7fb2994a2700 1 --2- 172.21.15.49:0/1386620541 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb29414e600 0x7fb29414ea90 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7fb2940c9050 tx=0x7fb284009840).stop 2023-11-30T17:25:13.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.503+0000 7fb2994a2700 1 -- 172.21.15.49:0/1386620541 shutdown_connections 2023-11-30T17:25:13.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.503+0000 7fb2994a2700 1 --2- 172.21.15.49:0/1386620541 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb29414e600 0x7fb29414ea90 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.503+0000 7fb2994a2700 1 --2- 172.21.15.49:0/1386620541 >> v2:172.21.15.115:3300/0 conn(0x7fb2940a8280 0x7fb2940a8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.503+0000 7fb2994a2700 1 -- 172.21.15.49:0/1386620541 >> 172.21.15.49:0/1386620541 conn(0x7fb294062700 msgr2=0x7fb294062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:13.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.503+0000 7fb2994a2700 1 -- 172.21.15.49:0/1386620541 shutdown_connections 2023-11-30T17:25:13.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.503+0000 7fb2994a2700 1 -- 172.21.15.49:0/1386620541 wait complete. 2023-11-30T17:25:13.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.504+0000 7fb2994a2700 1 Processor -- start 2023-11-30T17:25:13.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.504+0000 7fb2994a2700 1 -- start start 2023-11-30T17:25:13.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.505+0000 7fb2994a2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2940a8280 0x7fb2940aa580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:13.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.505+0000 7fb2994a2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb29414e600 0x7fb29414b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:13.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.505+0000 7fb2994a2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb294158160 0x7fb294167e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:13.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.505+0000 7fb2994a2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb294157c10 con 0x7fb29414e600 2023-11-30T17:25:13.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.505+0000 7fb2994a2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2940ab0f0 con 0x7fb294158160 2023-11-30T17:25:13.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.505+0000 7fb2994a2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2940c4350 con 0x7fb2940a8280 2023-11-30T17:25:13.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.505+0000 7fb2927fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb29414e600 0x7fb29414b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:13.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.505+0000 7fb2927fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb29414e600 0x7fb29414b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59748/0 (socket says 172.21.15.49:59748) 2023-11-30T17:25:13.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.505+0000 7fb2927fc700 1 -- 172.21.15.49:0/2433841224 learned_addr learned my addr 172.21.15.49:0/2433841224 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:13.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.505+0000 7fb292ffd700 1 --2- 172.21.15.49:0/2433841224 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2940a8280 0x7fb2940aa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:13.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.505+0000 7fb2937fe700 1 --2- 172.21.15.49:0/2433841224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb294158160 0x7fb294167e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:13.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.505+0000 7fb2927fc700 1 -- 172.21.15.49:0/2433841224 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2940a8280 msgr2=0x7fb2940aa580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:13.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.505+0000 7fb2927fc700 1 --2- 172.21.15.49:0/2433841224 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2940a8280 0x7fb2940aa580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.505+0000 7fb2927fc700 1 -- 172.21.15.49:0/2433841224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb294158160 msgr2=0x7fb294167e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:13.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.505+0000 7fb2927fc700 1 --2- 172.21.15.49:0/2433841224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb294158160 0x7fb294167e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.505+0000 7fb2927fc700 1 -- 172.21.15.49:0/2433841224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb284009ae0 con 0x7fb29414e600 2023-11-30T17:25:13.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.505+0000 7fb2927fc700 1 --2- 172.21.15.49:0/2433841224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb29414e600 0x7fb29414b3a0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7fb27c00c4c0 tx=0x7fb27c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:13.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.505+0000 7fb28affd700 1 -- 172.21.15.49:0/2433841224 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27c00ce70 con 0x7fb29414e600 2023-11-30T17:25:13.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.506+0000 7fb28affd700 1 -- 172.21.15.49:0/2433841224 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27c001e90 con 0x7fb29414e600 2023-11-30T17:25:13.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.506+0000 7fb2994a2700 1 -- 172.21.15.49:0/2433841224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb29414b890 con 0x7fb29414e600 2023-11-30T17:25:13.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.506+0000 7fb28affd700 1 -- 172.21.15.49:0/2433841224 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27c007270 con 0x7fb29414e600 2023-11-30T17:25:13.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.506+0000 7fb2994a2700 1 -- 172.21.15.49:0/2433841224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2940aae10 con 0x7fb29414e600 2023-11-30T17:25:13.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.507+0000 7fb28affd700 1 -- 172.21.15.49:0/2433841224 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb27c0066a0 con 0x7fb29414e600 2023-11-30T17:25:13.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.507+0000 7fb28affd700 1 --2- 172.21.15.49:0/2433841224 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb27405f270 0x7fb274061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:13.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.507+0000 7fb28affd700 1 -- 172.21.15.49:0/2433841224 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fb27c079b70 con 0x7fb29414e600 2023-11-30T17:25:13.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.508+0000 7fb292ffd700 1 --2- 172.21.15.49:0/2433841224 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb27405f270 0x7fb274061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:13.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.508+0000 7fb292ffd700 1 --2- 172.21.15.49:0/2433841224 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb27405f270 0x7fb274061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fb28c00bb10 tx=0x7fb28c008040).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:13.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.509+0000 7fb2aae3ab80 1 Processor -- start 2023-11-30T17:25:13.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.510+0000 7fb2aae3ab80 1 -- start start 2023-11-30T17:25:13.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.510+0000 7fb2aae3ab80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55cb602dde40 0x55cb60549d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:13.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.510+0000 7fb2aae3ab80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cb6056aea0 0x55cb605217c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:13.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.510+0000 7fb2aae3ab80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb60521cb0 0x55cb6051c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:13.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.510+0000 7fb2aae3ab80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb604e7060 con 0x55cb60521cb0 2023-11-30T17:25:13.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.510+0000 7fb2aae3ab80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb6045e1f0 con 0x55cb6056aea0 2023-11-30T17:25:13.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.510+0000 7fb2aae3ab80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb60473440 con 0x55cb602dde40 2023-11-30T17:25:13.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.510+0000 7fb2937fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb60521cb0 0x55cb6051c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:13.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.511+0000 7fb2937fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb60521cb0 0x55cb6051c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59752/0 (socket says 172.21.15.49:59752) 2023-11-30T17:25:13.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.511+0000 7fb2937fe700 1 -- 172.21.15.49:0/1960812919 learned_addr learned my addr 172.21.15.49:0/1960812919 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:13.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.511+0000 7fb2927fc700 1 --2- 172.21.15.49:0/1960812919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cb6056aea0 0x55cb605217c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:13.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.511+0000 7fb292ffd700 1 --2- 172.21.15.49:0/1960812919 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55cb602dde40 0x55cb60549d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:13.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.511+0000 7fb2937fe700 1 -- 172.21.15.49:0/1960812919 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55cb602dde40 msgr2=0x55cb60549d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:13.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.511+0000 7fb2937fe700 1 --2- 172.21.15.49:0/1960812919 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55cb602dde40 0x55cb60549d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.511+0000 7fb2937fe700 1 -- 172.21.15.49:0/1960812919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cb6056aea0 msgr2=0x55cb605217c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:13.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.511+0000 7fb2937fe700 1 --2- 172.21.15.49:0/1960812919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cb6056aea0 0x55cb605217c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.511+0000 7fb2937fe700 1 -- 172.21.15.49:0/1960812919 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb6046c620 con 0x55cb60521cb0 2023-11-30T17:25:13.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.511+0000 7fb2937fe700 1 --2- 172.21.15.49:0/1960812919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb60521cb0 0x55cb6051c600 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7fb284009fd0 tx=0x7fb284009840).ready entity=mon.0 client_cookie=2b6816ed4fd29754 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:13.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.511+0000 7fb273fff700 1 -- 172.21.15.49:0/1960812919 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb284023070 con 0x55cb60521cb0 2023-11-30T17:25:13.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.511+0000 7fb273fff700 1 -- 172.21.15.49:0/1960812919 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28400bbc0 con 0x55cb60521cb0 2023-11-30T17:25:13.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.511+0000 7fb273fff700 1 -- 172.21.15.49:0/1960812919 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28400bd30 con 0x55cb60521cb0 2023-11-30T17:25:13.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.512+0000 7fb2aae3ab80 1 -- 172.21.15.49:0/1960812919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb60521cb0 msgr2=0x55cb6051c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:13.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.512+0000 7fb2aae3ab80 1 --2- 172.21.15.49:0/1960812919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb60521cb0 0x55cb6051c600 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7fb284009fd0 tx=0x7fb284009840).stop 2023-11-30T17:25:13.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.512+0000 7fb2aae3ab80 1 -- 172.21.15.49:0/1960812919 shutdown_connections 2023-11-30T17:25:13.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.512+0000 7fb2aae3ab80 1 --2- 172.21.15.49:0/1960812919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb60521cb0 0x55cb6051c600 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.512+0000 7fb2aae3ab80 1 --2- 172.21.15.49:0/1960812919 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55cb602dde40 0x55cb60549d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.512+0000 7fb2aae3ab80 1 --2- 172.21.15.49:0/1960812919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cb6056aea0 0x55cb605217c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.512+0000 7fb2aae3ab80 1 -- 172.21.15.49:0/1960812919 >> 172.21.15.49:0/1960812919 conn(0x55cb6038b4a0 msgr2=0x55cb6056a790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:13.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.512+0000 7fb2aae3ab80 1 -- 172.21.15.49:0/1960812919 shutdown_connections 2023-11-30T17:25:13.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.512+0000 7fb2aae3ab80 1 -- 172.21.15.49:0/1960812919 wait complete. 2023-11-30T17:25:13.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.513+0000 7fb2aae3ab80 1 -- start start 2023-11-30T17:25:13.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.513+0000 7fb2aae3ab80 1 Processor -- start 2023-11-30T17:25:13.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.514+0000 7fb2aae3ab80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cb602dde40 0x55cb6054fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:13.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.514+0000 7fb2aae3ab80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55cb60521cb0 0x55cb605692f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:13.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.514+0000 7fb2aae3ab80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb6056aea0 0x55cb605697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:13.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.514+0000 7fb2aae3ab80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb60473580 con 0x55cb6056aea0 2023-11-30T17:25:13.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.514+0000 7fb2aae3ab80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb60473800 con 0x55cb602dde40 2023-11-30T17:25:13.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.514+0000 7fb2aae3ab80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb6043ee10 con 0x55cb60521cb0 2023-11-30T17:25:13.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.514+0000 7fb2aae3ab80 10 client.0 ll_register_callbacks cb 0x55cb604e1460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-30T17:25:13.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.514+0000 7fb2937fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb6056aea0 0x55cb605697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:13.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.514+0000 7fb2937fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb6056aea0 0x55cb605697e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59754/0 (socket says 172.21.15.49:59754) 2023-11-30T17:25:13.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.514+0000 7fb2937fe700 1 -- 172.21.15.49:0/1818283169 learned_addr learned my addr 172.21.15.49:0/1818283169 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:13.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.514+0000 7fb2927fc700 1 --2- 172.21.15.49:0/1818283169 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55cb60521cb0 0x55cb605692f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:13.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.514+0000 7fb292ffd700 1 --2- 172.21.15.49:0/1818283169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cb602dde40 0x55cb6054fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:13.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.514+0000 7fb2937fe700 1 -- 172.21.15.49:0/1818283169 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55cb60521cb0 msgr2=0x55cb605692f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:13.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.514+0000 7fb2937fe700 1 --2- 172.21.15.49:0/1818283169 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55cb60521cb0 0x55cb605692f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.514+0000 7fb2937fe700 1 -- 172.21.15.49:0/1818283169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cb602dde40 msgr2=0x55cb6054fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:13.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.514+0000 7fb2937fe700 1 --2- 172.21.15.49:0/1818283169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cb602dde40 0x55cb6054fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.514+0000 7fb2937fe700 1 -- 172.21.15.49:0/1818283169 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb294158600 con 0x55cb6056aea0 2023-11-30T17:25:13.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.514+0000 7fb2937fe700 1 --2- 172.21.15.49:0/1818283169 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb6056aea0 0x55cb605697e0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7fb284009880 tx=0x7fb28401f000).ready entity=mon.0 client_cookie=a7edae012ac188bb server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:13.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.514+0000 7fb2717fa700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-30T17:25:13.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.514+0000 7fb2717fa700 1 -- 172.21.15.49:0/1818283169 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb284023070 con 0x55cb6056aea0 2023-11-30T17:25:13.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.514+0000 7fb2717fa700 1 -- 172.21.15.49:0/1818283169 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(130..130 src has 1..130) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fb284013a50 con 0x55cb6056aea0 2023-11-30T17:25:13.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.514+0000 7fb2aae3ab80 1 -- 172.21.15.49:0/1818283169 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cb60515720 con 0x55cb6056aea0 2023-11-30T17:25:13.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.515+0000 7fb2717fa700 1 -- 172.21.15.49:0/1818283169 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb284013e20 con 0x55cb6056aea0 2023-11-30T17:25:13.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.515+0000 7fb2aae3ab80 10 client.7788 fetch_fsmap learned FSMap version 53 2023-11-30T17:25:13.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.515+0000 7fb2aae3ab80 1 -- 172.21.15.49:0/1818283169 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) v3 -- 0x55cb604679c0 con 0x55cb6056aea0 2023-11-30T17:25:13.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.515+0000 7fb2717fa700 1 -- 172.21.15.49:0/1818283169 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cb60515720 con 0x55cb6056aea0 2023-11-30T17:25:13.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.515+0000 7fb2717fa700 1 -- 172.21.15.49:0/1818283169 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 53) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb28401f460 con 0x55cb6056aea0 2023-11-30T17:25:13.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.515+0000 7fb2aae3ab80 10 client.7788 fetch_fsmap finished waiting for FSMap version 53 2023-11-30T17:25:13.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.515+0000 7fb2aae3ab80 10 client.7788 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-30T17:25:13.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.515+0000 7fb2aae3ab80 20 client.7788 populate_metadata read hostname 'smithi049' 2023-11-30T17:25:13.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.515+0000 7fb2aae3ab80 1 --2- 172.21.15.49:0/1818283169 >> [v2:172.21.15.115:6834/3436956463,v1:172.21.15.115:6835/3436956463] conn(0x55cb6054b770 0x55cb6054bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:13.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.515+0000 7fb2aae3ab80 4 client.7788 mds_command: new command op to 7650 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-30T17:25:13.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.515+0000 7fb2aae3ab80 1 -- 172.21.15.49:0/1818283169 --> [v2:172.21.15.115:6834/3436956463,v1:172.21.15.115:6835/3436956463] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cb602d9ca0 con 0x55cb6054b770 2023-11-30T17:25:13.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.515+0000 7fb292ffd700 1 --2- 172.21.15.49:0/1818283169 >> [v2:172.21.15.115:6834/3436956463,v1:172.21.15.115:6835/3436956463] conn(0x55cb6054b770 0x55cb6054bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:13.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.515+0000 7fb2717fa700 10 client.7788 ms_handle_connect on v2:172.21.15.115:6834/3436956463 2023-11-30T17:25:13.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.515+0000 7fb292ffd700 1 --2- 172.21.15.49:0/1818283169 >> [v2:172.21.15.115:6834/3436956463,v1:172.21.15.115:6835/3436956463] conn(0x55cb6054b770 0x55cb6054bb50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f04f2387f612a5f2 server_cookie=fd7a19a0c06ca1ae in_seq=0 out_seq=0 2023-11-30T17:25:13.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.516+0000 7fb2717fa700 1 -- 172.21.15.49:0/1818283169 <== mds.0 v2:172.21.15.115:6834/3436956463 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55cb602d9ca0 con 0x55cb6054b770 2023-11-30T17:25:13.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.516+0000 7fb2717fa700 10 client.7788 handle_command_reply: tid=0 2023-11-30T17:25:13.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.516+0000 7fb2aae3ab80 1 client.7788 shutdown 2023-11-30T17:25:13.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.516+0000 7fb2aae3ab80 1 -- 172.21.15.49:0/1818283169 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb6056aea0 msgr2=0x55cb605697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:13.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.516+0000 7fb2aae3ab80 1 --2- 172.21.15.49:0/1818283169 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb6056aea0 0x55cb605697e0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7fb284009880 tx=0x7fb28401f000).stop 2023-11-30T17:25:13.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.516+0000 7fb2aae3ab80 1 -- 172.21.15.49:0/1818283169 shutdown_connections 2023-11-30T17:25:13.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.516+0000 7fb2aae3ab80 1 --2- 172.21.15.49:0/1818283169 >> [v2:172.21.15.115:6834/3436956463,v1:172.21.15.115:6835/3436956463] conn(0x55cb6054b770 0x55cb6054bb50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.516+0000 7fb2aae3ab80 1 --2- 172.21.15.49:0/1818283169 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb6056aea0 0x55cb605697e0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.516+0000 7fb2aae3ab80 1 --2- 172.21.15.49:0/1818283169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cb602dde40 0x55cb6054fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.516+0000 7fb2717fa700 0 client.7788 ms_handle_reset on v2:172.21.15.115:6834/3436956463 2023-11-30T17:25:13.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.516+0000 7fb2aae3ab80 1 --2- 172.21.15.49:0/1818283169 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55cb60521cb0 0x55cb605692f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.516+0000 7fb2aae3ab80 1 -- 172.21.15.49:0/1818283169 >> 172.21.15.49:0/1818283169 conn(0x55cb6038b4a0 msgr2=0x55cb60522ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:13.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.517+0000 7fb2aae3ab80 1 -- 172.21.15.49:0/1818283169 shutdown_connections 2023-11-30T17:25:13.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.517+0000 7fb2aae3ab80 1 -- 172.21.15.49:0/1818283169 wait complete. 2023-11-30T17:25:13.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.517+0000 7fb2aae3ab80 20 client.7788 trim_cache size 0 max 16384 2023-11-30T17:25:13.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.533+0000 7fb2aae3ab80 1 Processor -- start 2023-11-30T17:25:13.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.533+0000 7fb2aae3ab80 1 -- start start 2023-11-30T17:25:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.534+0000 7fb2aae3ab80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb602dde40 0x55cb60564000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.534+0000 7fb2aae3ab80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55cb60521cb0 0x55cb605644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.534+0000 7fb2aae3ab80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cb6054b770 0x55cb60566f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.534+0000 7fb2aae3ab80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb6051eba0 con 0x55cb602dde40 2023-11-30T17:25:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.534+0000 7fb2aae3ab80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb60521470 con 0x55cb6054b770 2023-11-30T17:25:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.534+0000 7fb2aae3ab80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb605206a0 con 0x55cb60521cb0 2023-11-30T17:25:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.534+0000 7fb292ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb602dde40 0x55cb60564000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.534+0000 7fb292ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb602dde40 0x55cb60564000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59770/0 (socket says 172.21.15.49:59770) 2023-11-30T17:25:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.534+0000 7fb292ffd700 1 -- 172.21.15.49:0/2620830112 learned_addr learned my addr 172.21.15.49:0/2620830112 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.534+0000 7fb2927fc700 1 --2- 172.21.15.49:0/2620830112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55cb60521cb0 0x55cb605644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.534+0000 7fb292ffd700 1 -- 172.21.15.49:0/2620830112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55cb60521cb0 msgr2=0x55cb605644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.534+0000 7fb292ffd700 1 --2- 172.21.15.49:0/2620830112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55cb60521cb0 0x55cb605644f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.534+0000 7fb292ffd700 1 -- 172.21.15.49:0/2620830112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cb6054b770 msgr2=0x55cb60566f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.534+0000 7fb292ffd700 1 --2- 172.21.15.49:0/2620830112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cb6054b770 0x55cb60566f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-30T17:25:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.534+0000 7fb292ffd700 1 -- 172.21.15.49:0/2620830112 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb60467710 con 0x55cb602dde40 2023-11-30T17:25:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.534+0000 7fb292ffd700 1 --2- 172.21.15.49:0/2620830112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb602dde40 0x55cb60564000 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7fb28c010e20 tx=0x7fb28c028280).ready entity=mon.0 client_cookie=721f68140f580f16 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:13.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.535+0000 7fb288ff9700 1 -- 172.21.15.49:0/2620830112 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c027070 con 0x55cb602dde40 2023-11-30T17:25:13.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.535+0000 7fb288ff9700 1 -- 172.21.15.49:0/2620830112 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28c014b10 con 0x55cb602dde40 2023-11-30T17:25:13.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.535+0000 7fb288ff9700 1 -- 172.21.15.49:0/2620830112 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c014e90 con 0x55cb602dde40 2023-11-30T17:25:13.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.535+0000 7fb2aae3ab80 1 -- 172.21.15.49:0/2620830112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb602dde40 msgr2=0x55cb60564000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:13.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.535+0000 7fb2aae3ab80 1 --2- 172.21.15.49:0/2620830112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb602dde40 0x55cb60564000 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7fb28c010e20 tx=0x7fb28c028280).stop 2023-11-30T17:25:13.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.535+0000 7fb2aae3ab80 1 -- 172.21.15.49:0/2620830112 shutdown_connections 2023-11-30T17:25:13.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.535+0000 7fb2aae3ab80 1 --2- 172.21.15.49:0/2620830112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cb6054b770 0x55cb60566f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-30T17:25:13.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.535+0000 7fb2aae3ab80 1 --2- 172.21.15.49:0/2620830112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb602dde40 0x55cb60564000 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.535+0000 7fb2aae3ab80 1 --2- 172.21.15.49:0/2620830112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55cb60521cb0 0x55cb605644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.535+0000 7fb2aae3ab80 1 -- 172.21.15.49:0/2620830112 >> 172.21.15.49:0/2620830112 conn(0x55cb6038b4a0 msgr2=0x55cb6051f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:13.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.535+0000 7fb2aae3ab80 1 -- 172.21.15.49:0/2620830112 shutdown_connections 2023-11-30T17:25:13.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.535+0000 7fb2aae3ab80 1 -- 172.21.15.49:0/2620830112 wait complete. 2023-11-30T17:25:13.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.536+0000 7fb2aae3ab80 1 -- start start 2023-11-30T17:25:13.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.536+0000 7fb2aae3ab80 1 Processor -- start 2023-11-30T17:25:13.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.537+0000 7fb2aae3ab80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cb602dde40 0x55cb6054acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:13.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.537+0000 7fb2aae3ab80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55cb60521cb0 0x55cb605cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:13.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.537+0000 7fb2aae3ab80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb6054b770 0x55cb60564000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:13.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.537+0000 7fb2aae3ab80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb605850e0 con 0x55cb6054b770 2023-11-30T17:25:13.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.537+0000 7fb2aae3ab80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb605636f0 con 0x55cb602dde40 2023-11-30T17:25:13.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.537+0000 7fb2aae3ab80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb605cc0a0 con 0x55cb60521cb0 2023-11-30T17:25:13.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.537+0000 7fb2aae3ab80 10 client.0 ll_register_callbacks cb 0x7fb27c007e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-30T17:25:13.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.537+0000 7fb2937fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb6054b770 0x55cb60564000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:13.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.537+0000 7fb2937fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb6054b770 0x55cb60564000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59780/0 (socket says 172.21.15.49:59780) 2023-11-30T17:25:13.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.537+0000 7fb2937fe700 1 -- 172.21.15.49:0/4047032752 learned_addr learned my addr 172.21.15.49:0/4047032752 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:13.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.537+0000 7fb292ffd700 1 --2- 172.21.15.49:0/4047032752 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cb602dde40 0x55cb6054acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:13.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.537+0000 7fb2927fc700 1 --2- 172.21.15.49:0/4047032752 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55cb60521cb0 0x55cb605cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:13.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.537+0000 7fb2937fe700 1 -- 172.21.15.49:0/4047032752 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55cb60521cb0 msgr2=0x55cb605cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:13.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.537+0000 7fb2937fe700 1 --2- 172.21.15.49:0/4047032752 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55cb60521cb0 0x55cb605cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.537+0000 7fb2937fe700 1 -- 172.21.15.49:0/4047032752 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cb602dde40 msgr2=0x55cb6054acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:13.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.537+0000 7fb2937fe700 1 --2- 172.21.15.49:0/4047032752 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cb602dde40 0x55cb6054acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.537+0000 7fb2937fe700 1 -- 172.21.15.49:0/4047032752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb28c00e040 con 0x55cb6054b770 2023-11-30T17:25:13.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.537+0000 7fb292ffd700 1 --2- 172.21.15.49:0/4047032752 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cb602dde40 0x55cb6054acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:25:13.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.537+0000 7fb2937fe700 1 --2- 172.21.15.49:0/4047032752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb6054b770 0x55cb60564000 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x55cb6051dec0 tx=0x7fb28402a000).ready entity=mon.0 client_cookie=dcc3321db315499c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:13.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.537+0000 7fb2717fa700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-30T17:25:13.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.537+0000 7fb2717fa700 1 -- 172.21.15.49:0/4047032752 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb284023030 con 0x55cb6054b770 2023-11-30T17:25:13.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.537+0000 7fb2aae3ab80 1 -- 172.21.15.49:0/4047032752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb28400bbc0 con 0x55cb6054b770 2023-11-30T17:25:13.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.537+0000 7fb2717fa700 1 -- 172.21.15.49:0/4047032752 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(130..130 src has 1..130) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fb284013a50 con 0x55cb6054b770 2023-11-30T17:25:13.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.538+0000 7fb2717fa700 1 -- 172.21.15.49:0/4047032752 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2840092e0 con 0x55cb6054b770 2023-11-30T17:25:13.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.538+0000 7fb2aae3ab80 10 client.7794 fetch_fsmap learned FSMap version 53 2023-11-30T17:25:13.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.538+0000 7fb2aae3ab80 1 -- 172.21.15.49:0/4047032752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) v3 -- 0x55cb602def80 con 0x55cb6054b770 2023-11-30T17:25:13.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.538+0000 7fb2717fa700 1 -- 172.21.15.49:0/4047032752 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28400bbc0 con 0x55cb6054b770 2023-11-30T17:25:13.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.538+0000 7fb2717fa700 1 -- 172.21.15.49:0/4047032752 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 53) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb28401f460 con 0x55cb6054b770 2023-11-30T17:25:13.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.538+0000 7fb2aae3ab80 10 client.7794 fetch_fsmap finished waiting for FSMap version 53 2023-11-30T17:25:13.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.538+0000 7fb2aae3ab80 10 client.7794 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-30T17:25:13.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.538+0000 7fb2aae3ab80 20 client.7794 populate_metadata read hostname 'smithi049' 2023-11-30T17:25:13.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.538+0000 7fb2aae3ab80 1 --2- 172.21.15.49:0/4047032752 >> [v2:172.21.15.115:6834/3436956463,v1:172.21.15.115:6835/3436956463] conn(0x55cb6056aea0 0x55cb6054fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:13.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.538+0000 7fb2aae3ab80 4 client.7794 mds_command: new command op to 7650 tid=0[{"prefix": "status"}] 2023-11-30T17:25:13.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.538+0000 7fb2aae3ab80 1 -- 172.21.15.49:0/4047032752 --> [v2:172.21.15.115:6834/3436956463,v1:172.21.15.115:6835/3436956463] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cb60310ca0 con 0x55cb6056aea0 2023-11-30T17:25:13.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.538+0000 7fb292ffd700 1 --2- 172.21.15.49:0/4047032752 >> [v2:172.21.15.115:6834/3436956463,v1:172.21.15.115:6835/3436956463] conn(0x55cb6056aea0 0x55cb6054fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:13.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.538+0000 7fb2717fa700 10 client.7794 ms_handle_connect on v2:172.21.15.115:6834/3436956463 2023-11-30T17:25:13.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.538+0000 7fb292ffd700 1 --2- 172.21.15.49:0/4047032752 >> [v2:172.21.15.115:6834/3436956463,v1:172.21.15.115:6835/3436956463] conn(0x55cb6056aea0 0x55cb6054fb50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=26b075e07b549f61 server_cookie=2b486a3a114b1276 in_seq=0 out_seq=0 2023-11-30T17:25:13.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.539+0000 7fb2717fa700 1 -- 172.21.15.49:0/4047032752 <== mds.0 v2:172.21.15.115:6834/3436956463 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55cb60310ca0 con 0x55cb6056aea0 2023-11-30T17:25:13.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.539+0000 7fb2717fa700 10 client.7794 handle_command_reply: tid=0 2023-11-30T17:25:13.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.539+0000 7fb2aae3ab80 1 client.7794 shutdown 2023-11-30T17:25:13.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.539+0000 7fb2aae3ab80 1 -- 172.21.15.49:0/4047032752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb6054b770 msgr2=0x55cb60564000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:13.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.539+0000 7fb2aae3ab80 1 --2- 172.21.15.49:0/4047032752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb6054b770 0x55cb60564000 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x55cb6051dec0 tx=0x7fb28402a000).stop 2023-11-30T17:25:13.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.539+0000 7fb2aae3ab80 1 -- 172.21.15.49:0/4047032752 shutdown_connections 2023-11-30T17:25:13.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.539+0000 7fb2aae3ab80 1 --2- 172.21.15.49:0/4047032752 >> [v2:172.21.15.115:6834/3436956463,v1:172.21.15.115:6835/3436956463] conn(0x55cb6056aea0 0x55cb6054fb50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.539+0000 7fb2aae3ab80 1 --2- 172.21.15.49:0/4047032752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb6054b770 0x55cb60564000 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.539+0000 7fb2aae3ab80 1 --2- 172.21.15.49:0/4047032752 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cb602dde40 0x55cb6054acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.539+0000 7fb2aae3ab80 1 --2- 172.21.15.49:0/4047032752 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55cb60521cb0 0x55cb605cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.539+0000 7fb2717fa700 0 client.7794 ms_handle_reset on v2:172.21.15.115:6834/3436956463 2023-11-30T17:25:13.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.539+0000 7fb2aae3ab80 1 -- 172.21.15.49:0/4047032752 >> 172.21.15.49:0/4047032752 conn(0x55cb6038b4a0 msgr2=0x55cb6056a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:13.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.539+0000 7fb2aae3ab80 1 -- 172.21.15.49:0/4047032752 shutdown_connections 2023-11-30T17:25:13.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.539+0000 7fb2aae3ab80 1 -- 172.21.15.49:0/4047032752 wait complete. 2023-11-30T17:25:13.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.539+0000 7fb2aae3ab80 20 client.7794 trim_cache size 0 max 16384 2023-11-30T17:25:13.549 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T17:25:13.549 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "ef213ed4-8f62-4ad5-b55f-7510fd0ee359", 2023-11-30T17:25:13.549 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2023-11-30T17:25:13.549 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 7650, 2023-11-30T17:25:13.549 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-11-30T17:25:13.549 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-11-30T17:25:13.549 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-11-30T17:25:13.549 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 5.751520814, 2023-11-30T17:25:13.549 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 53, 2023-11-30T17:25:13.550 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 130, 2023-11-30T17:25:13.550 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 130, 2023-11-30T17:25:13.550 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 10.309874391999999 2023-11-30T17:25:13.550 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T17:25:13.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.539+0000 7fb2994a2700 1 -- 172.21.15.49:0/2433841224 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb27405f270 msgr2=0x7fb274061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:13.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.539+0000 7fb2994a2700 1 --2- 172.21.15.49:0/2433841224 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb27405f270 0x7fb274061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fb28c00bb10 tx=0x7fb28c008040).stop 2023-11-30T17:25:13.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.539+0000 7fb2994a2700 1 -- 172.21.15.49:0/2433841224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb29414e600 msgr2=0x7fb29414b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:13.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.539+0000 7fb2994a2700 1 --2- 172.21.15.49:0/2433841224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb29414e600 0x7fb29414b3a0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7fb27c00c4c0 tx=0x7fb27c007e00).stop 2023-11-30T17:25:13.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.539+0000 7fb2994a2700 1 -- 172.21.15.49:0/2433841224 shutdown_connections 2023-11-30T17:25:13.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.539+0000 7fb2994a2700 1 --2- 172.21.15.49:0/2433841224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb294158160 0x7fb294167e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.539+0000 7fb2994a2700 1 --2- 172.21.15.49:0/2433841224 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2940a8280 0x7fb2940aa580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.539+0000 7fb2994a2700 1 --2- 172.21.15.49:0/2433841224 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb27405f270 0x7fb274061730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.539+0000 7fb2994a2700 1 --2- 172.21.15.49:0/2433841224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb29414e600 0x7fb29414b3a0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.539+0000 7fb2994a2700 1 -- 172.21.15.49:0/2433841224 >> 172.21.15.49:0/2433841224 conn(0x7fb294062700 msgr2=0x7fb2940c99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:13.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.540+0000 7fb2994a2700 1 -- 172.21.15.49:0/2433841224 shutdown_connections 2023-11-30T17:25:13.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.540+0000 7fb2994a2700 1 -- 172.21.15.49:0/2433841224 wait complete. 2023-11-30T17:25:13.554 DEBUG:teuthology.orchestra.run.smithi049:> ceph fs ls 2023-11-30T17:25:13.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.656+0000 7fdc59d7c700 1 Processor -- start 2023-11-30T17:25:13.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.656+0000 7fdc59d7c700 1 -- start start 2023-11-30T17:25:13.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.656+0000 7fdc59d7c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdc54154700 0x7fdc540c7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:13.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.656+0000 7fdc59d7c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc540c7c50 0x7fdc540c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:13.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.656+0000 7fdc59d7c700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc540c6d80 con 0x7fdc540c7700 2023-11-30T17:25:13.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.656+0000 7fdc59d7c700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc540c85d0 con 0x7fdc54154700 2023-11-30T17:25:13.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.656+0000 7fdc59d7c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc54154ae0 con 0x7fdc540c7c50 2023-11-30T17:25:13.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.657+0000 7fdc52ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdc540c7700 0x7fdc540aa1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46320/0 (socket says 172.21.15.49:46320) 2023-11-30T17:25:13.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.657+0000 7fdc52ffd700 1 -- 172.21.15.49:0/1614577488 learned_addr learned my addr 172.21.15.49:0/1614577488 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:25:13.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.657+0000 7fdc537fe700 1 --2- 172.21.15.49:0/1614577488 >> v2:172.21.15.115:3300/0 conn(0x7fdc54154700 0x7fdc540c7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:13.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.657+0000 7fdc53fff700 1 --2- 172.21.15.49:0/1614577488 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc540c7c50 0x7fdc540c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:13.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.657+0000 7fdc527fc700 1 -- 172.21.15.49:0/1614577488 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1011533397 0 0) 0x7fdc540c6d80 con 0x7fdc540c7700 2023-11-30T17:25:13.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.657+0000 7fdc527fc700 1 -- 172.21.15.49:0/1614577488 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc3c0033f0 con 0x7fdc540c7700 2023-11-30T17:25:13.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.657+0000 7fdc527fc700 1 -- 172.21.15.49:0/1614577488 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 76256459 0 0) 0x7fdc3c0033f0 con 0x7fdc540c7700 2023-11-30T17:25:13.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.657+0000 7fdc537fe700 1 -- 172.21.15.49:0/1614577488 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc540c7c50 msgr2=0x7fdc540c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:13.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.657+0000 7fdc537fe700 1 --2- 172.21.15.49:0/1614577488 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc540c7c50 0x7fdc540c80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.657+0000 7fdc537fe700 1 -- 172.21.15.49:0/1614577488 >> v1:172.21.15.49:6789/0 conn(0x7fdc540c7700 legacy=0x7fdc540aa1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:13.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.657+0000 7fdc537fe700 1 -- 172.21.15.49:0/1614577488 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc54064c30 con 0x7fdc54154700 2023-11-30T17:25:13.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.657+0000 7fdc537fe700 1 --2- 172.21.15.49:0/1614577488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc54154700 0x7fdc540c7210 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7fdc44009760 tx=0x7fdc44009060).ready entity=mon.1 client_cookie=f5863bb1a95ce3ca server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:13.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.657+0000 7fdc527fc700 1 -- 172.21.15.49:0/1614577488 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc48001470 con 0x7fdc54154700 2023-11-30T17:25:13.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.657+0000 7fdc527fc700 1 -- 172.21.15.49:0/1614577488 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc44011400 con 0x7fdc54154700 2023-11-30T17:25:13.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.657+0000 7fdc527fc700 1 -- 172.21.15.49:0/1614577488 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc44011780 con 0x7fdc54154700 2023-11-30T17:25:13.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.658+0000 7fdc59d7c700 1 -- 172.21.15.49:0/1614577488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc54154700 msgr2=0x7fdc540c7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:13.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.658+0000 7fdc59d7c700 1 --2- 172.21.15.49:0/1614577488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc54154700 0x7fdc540c7210 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7fdc44009760 tx=0x7fdc44009060).stop 2023-11-30T17:25:13.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.658+0000 7fdc59d7c700 1 -- 172.21.15.49:0/1614577488 shutdown_connections 2023-11-30T17:25:13.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.658+0000 7fdc59d7c700 1 --2- 172.21.15.49:0/1614577488 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc540c7c50 0x7fdc540c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.658+0000 7fdc59d7c700 1 --2- 172.21.15.49:0/1614577488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc54154700 0x7fdc540c7210 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.658+0000 7fdc59d7c700 1 -- 172.21.15.49:0/1614577488 >> 172.21.15.49:0/1614577488 conn(0x7fdc540948b0 msgr2=0x7fdc5406a690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:13.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.658+0000 7fdc59d7c700 1 -- 172.21.15.49:0/1614577488 shutdown_connections 2023-11-30T17:25:13.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.658+0000 7fdc59d7c700 1 -- 172.21.15.49:0/1614577488 wait complete. 2023-11-30T17:25:13.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.659+0000 7fdc59d7c700 1 Processor -- start 2023-11-30T17:25:13.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.659+0000 7fdc59d7c700 1 -- start start 2023-11-30T17:25:13.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.660+0000 7fdc59d7c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc540c7700 0x7fdc541688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.660+0000 7fdc59d7c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc540c7c50 0x7fdc540c22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.660+0000 7fdc59d7c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc54154700 0x7fdc540c2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.660+0000 7fdc59d7c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc540c27d0 con 0x7fdc540c7c50 2023-11-30T17:25:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.660+0000 7fdc59d7c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc540c3970 con 0x7fdc540c7700 2023-11-30T17:25:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.660+0000 7fdc59d7c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc540c3470 con 0x7fdc54154700 2023-11-30T17:25:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.660+0000 7fdc52ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc540c7c50 0x7fdc540c22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.660+0000 7fdc52ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc540c7c50 0x7fdc540c22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59786/0 (socket says 172.21.15.49:59786) 2023-11-30T17:25:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.660+0000 7fdc52ffd700 1 -- 172.21.15.49:0/1540666730 learned_addr learned my addr 172.21.15.49:0/1540666730 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.660+0000 7fdc537fe700 1 --2- 172.21.15.49:0/1540666730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc540c7700 0x7fdc541688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.660+0000 7fdc53fff700 1 --2- 172.21.15.49:0/1540666730 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc54154700 0x7fdc540c2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.660+0000 7fdc52ffd700 1 -- 172.21.15.49:0/1540666730 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc54154700 msgr2=0x7fdc540c2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.660+0000 7fdc52ffd700 1 --2- 172.21.15.49:0/1540666730 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc54154700 0x7fdc540c2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.660+0000 7fdc52ffd700 1 -- 172.21.15.49:0/1540666730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc540c7700 msgr2=0x7fdc541688d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.660+0000 7fdc52ffd700 1 --2- 172.21.15.49:0/1540666730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc540c7700 0x7fdc541688d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.660+0000 7fdc52ffd700 1 -- 172.21.15.49:0/1540666730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc440092a0 con 0x7fdc540c7c50 2023-11-30T17:25:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.660+0000 7fdc537fe700 1 --2- 172.21.15.49:0/1540666730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc540c7700 0x7fdc541688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:25:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.661+0000 7fdc52ffd700 1 --2- 172.21.15.49:0/1540666730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc540c7c50 0x7fdc540c22e0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7fdc4800c870 tx=0x7fdc48001b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.661+0000 7fdc3b7fe700 1 -- 172.21.15.49:0/1540666730 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc48007170 con 0x7fdc540c7c50 2023-11-30T17:25:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.661+0000 7fdc3b7fe700 1 -- 172.21.15.49:0/1540666730 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc480072d0 con 0x7fdc540c7c50 2023-11-30T17:25:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.661+0000 7fdc59d7c700 1 -- 172.21.15.49:0/1540666730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc54168440 con 0x7fdc540c7c50 2023-11-30T17:25:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.661+0000 7fdc3b7fe700 1 -- 172.21.15.49:0/1540666730 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc480048c0 con 0x7fdc540c7c50 2023-11-30T17:25:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.661+0000 7fdc59d7c700 1 -- 172.21.15.49:0/1540666730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc540c3690 con 0x7fdc540c7c50 2023-11-30T17:25:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.662+0000 7fdc59d7c700 1 -- 172.21.15.49:0/1540666730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc54167c90 con 0x7fdc540c7c50 2023-11-30T17:25:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.662+0000 7fdc3b7fe700 1 -- 172.21.15.49:0/1540666730 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fdc48004c30 con 0x7fdc540c7c50 2023-11-30T17:25:13.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.662+0000 7fdc3b7fe700 1 --2- 172.21.15.49:0/1540666730 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdc4005f270 0x7fdc40061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:13.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.663+0000 7fdc3b7fe700 1 -- 172.21.15.49:0/1540666730 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fdc4807a2a0 con 0x7fdc540c7c50 2023-11-30T17:25:13.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.663+0000 7fdc537fe700 1 --2- 172.21.15.49:0/1540666730 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdc4005f270 0x7fdc40061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:13.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.663+0000 7fdc537fe700 1 --2- 172.21.15.49:0/1540666730 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdc4005f270 0x7fdc40061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fdc44009760 tx=0x7fdc44016000).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:13.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.667+0000 7fdc3b7fe700 1 -- 172.21.15.49:0/1540666730 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdc54167c90 con 0x7fdc540c7c50 2023-11-30T17:25:13.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.881+0000 7fdc59d7c700 1 -- 172.21.15.49:0/1540666730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdc54167c90 con 0x7fdc540c7c50 2023-11-30T17:25:13.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.882+0000 7fdc3b7fe700 1 -- 172.21.15.49:0/1540666730 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdc54167c90 con 0x7fdc540c7c50 2023-11-30T17:25:13.884 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-30T17:25:13.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.883+0000 7fdc59d7c700 1 -- 172.21.15.49:0/1540666730 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdc4005f270 msgr2=0x7fdc40061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:13.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.883+0000 7fdc59d7c700 1 --2- 172.21.15.49:0/1540666730 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdc4005f270 0x7fdc40061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fdc44009760 tx=0x7fdc44016000).stop 2023-11-30T17:25:13.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.883+0000 7fdc59d7c700 1 -- 172.21.15.49:0/1540666730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc540c7c50 msgr2=0x7fdc540c22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:13.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.883+0000 7fdc59d7c700 1 --2- 172.21.15.49:0/1540666730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc540c7c50 0x7fdc540c22e0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7fdc4800c870 tx=0x7fdc48001b50).stop 2023-11-30T17:25:13.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.883+0000 7fdc59d7c700 1 -- 172.21.15.49:0/1540666730 shutdown_connections 2023-11-30T17:25:13.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.883+0000 7fdc59d7c700 1 --2- 172.21.15.49:0/1540666730 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc54154700 0x7fdc540c2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.883+0000 7fdc59d7c700 1 --2- 172.21.15.49:0/1540666730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc540c7700 0x7fdc541688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.883+0000 7fdc59d7c700 1 --2- 172.21.15.49:0/1540666730 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdc4005f270 0x7fdc40061730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.883+0000 7fdc59d7c700 1 --2- 172.21.15.49:0/1540666730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc540c7c50 0x7fdc540c22e0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:13.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.883+0000 7fdc59d7c700 1 -- 172.21.15.49:0/1540666730 >> 172.21.15.49:0/1540666730 conn(0x7fdc540948b0 msgr2=0x7fdc54159810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:13.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.883+0000 7fdc59d7c700 1 -- 172.21.15.49:0/1540666730 shutdown_connections 2023-11-30T17:25:13.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:13.883+0000 7fdc59d7c700 1 -- 172.21.15.49:0/1540666730 wait complete. 2023-11-30T17:25:13.897 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-30T17:25:13.897 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-30T17:25:13.897 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-11-30T17:25:13.897 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-30T17:25:13.897 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-30T17:25:13.897 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-30T17:25:13.897 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-30T17:25:13.897 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-30T17:25:13.897 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-30T17:25:13.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:25:13.898 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-11-30T17:25:13.913 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-30T17:25:13.913 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-30T17:25:13.913 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-11-30T17:25:13.913 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:25:13.913 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-11-30T17:25:13.913 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:25:13.913 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:25:13.913 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:25:13.914 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-11-30T17:25:13.914 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:25:13.914 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:25:13.914 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-11-30T17:25:13.914 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-30T17:25:13.914 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:25:13.914 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-11-30T17:25:13.914 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-30T17:25:13.914 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 41361sec preferred_lft 41361sec 2023-11-30T17:25:13.914 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2023-11-30T17:25:13.914 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:25:13.914 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:25:13.914 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:25:13.915 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-11-30T17:25:13.915 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-30T17:25:13.915 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 32:bf:40:53:4c:5d brd ff:ff:ff:ff:ff:ff 2023-11-30T17:25:13.915 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-30T17:25:13.915 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:25:13.915 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::8b6:11ff:fe93:7174/64 scope link 2023-11-30T17:25:13.915 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:25:13.915 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-30T17:25:13.915 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 3e:e9:3c:a8:7a:95 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-30T17:25:13.915 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::3ce9:3cff:fea8:7a95/64 scope link 2023-11-30T17:25:13.915 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:25:13.915 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-30T17:25:13.915 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 32:bf:40:53:4c:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-30T17:25:13.915 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::30bf:40ff:fe53:4c5d/64 scope link 2023-11-30T17:25:13.915 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:25:13.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:25:13.916 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-30T17:25:13.977 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-11-30T17:25:13.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:25:13.979 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-11-30T17:25:14.035 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-11-30T17:25:14.035 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-30T17:25:14.036 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-30T17:25:14.036 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-30T17:25:14.036 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-30T17:25:14.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:25:14.036 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-11-30T17:25:14.036 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-11-30T17:25:14.036 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-30T17:25:14.036 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-30T17:25:14.036 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-30T17:25:14.036 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-11-30T17:25:14.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:25:14.139 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-11-30T17:25:14.154 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-30T17:25:14.154 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-30T17:25:14.154 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-30T17:25:14.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:25:14.155 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-11-30T17:25:14.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:25:14.220 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-11-30T17:25:14.276 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-30T17:25:14.276 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:25:14.356 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:25:14.357 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-30T17:25:14.382 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:25:14.382 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-30T17:25:14.385 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-30T17:25:14.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:25:14.385 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-30T17:25:14.451 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-30T17:25:14.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.607+0000 7fb132ba1700 1 Processor -- start 2023-11-30T17:25:14.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.607+0000 7fb132ba1700 1 -- start start 2023-11-30T17:25:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.608+0000 7fb132ba1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb12c0c20c0 0x7fb12c0c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.608+0000 7fb132ba1700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb12c1554d0 con 0x7fb12c0bd680 2023-11-30T17:25:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.608+0000 7fb132ba1700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb12c1548c0 con 0x7fb12c0bdb30 2023-11-30T17:25:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.608+0000 7fb132ba1700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb12c154ba0 con 0x7fb12c0c20c0 2023-11-30T17:25:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.608+0000 7fb13093d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb12c0c20c0 0x7fb12c0c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.608+0000 7fb12bfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb12c0bd680 0x7fb12c069f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46324/0 (socket says 172.21.15.49:46324) 2023-11-30T17:25:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.608+0000 7fb12bfff700 1 -- 172.21.15.49:0/4067829037 learned_addr learned my addr 172.21.15.49:0/4067829037 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:25:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.609+0000 7fb13093d700 1 -- 172.21.15.49:0/4067829037 >> v1:172.21.15.115:6789/0 conn(0x7fb12c0bdb30 legacy=0x7fb12c150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.609+0000 7fb13093d700 1 -- 172.21.15.49:0/4067829037 >> v1:172.21.15.49:6789/0 conn(0x7fb12c0bd680 legacy=0x7fb12c069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.609+0000 7fb13093d700 1 -- 172.21.15.49:0/4067829037 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12c154e80 con 0x7fb12c0c20c0 2023-11-30T17:25:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.609+0000 7fb12b7fe700 1 -- 172.21.15.49:0/4067829037 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3950855847 0 0) 0x7fb12c1554d0 con 0x7fb12c0bd680 2023-11-30T17:25:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.609+0000 7fb13093d700 1 --2- 172.21.15.49:0/4067829037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb12c0c20c0 0x7fb12c0c24a0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7fb124009760 tx=0x7fb124009060).ready entity=mon.0 client_cookie=931ceb2252b101eb server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:14.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.609+0000 7fb12b7fe700 1 -- 172.21.15.49:0/4067829037 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb124009120 con 0x7fb12c0c20c0 2023-11-30T17:25:14.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.609+0000 7fb12b7fe700 1 -- 172.21.15.49:0/4067829037 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12400b580 con 0x7fb12c0c20c0 2023-11-30T17:25:14.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.609+0000 7fb12b7fe700 1 -- 172.21.15.49:0/4067829037 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12400b900 con 0x7fb12c0c20c0 2023-11-30T17:25:14.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.609+0000 7fb132ba1700 1 -- 172.21.15.49:0/4067829037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb12c0c20c0 msgr2=0x7fb12c0c24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:14.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.609+0000 7fb132ba1700 1 --2- 172.21.15.49:0/4067829037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb12c0c20c0 0x7fb12c0c24a0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7fb124009760 tx=0x7fb124009060).stop 2023-11-30T17:25:14.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.609+0000 7fb132ba1700 1 -- 172.21.15.49:0/4067829037 shutdown_connections 2023-11-30T17:25:14.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.609+0000 7fb132ba1700 1 --2- 172.21.15.49:0/4067829037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb12c0c20c0 0x7fb12c0c24a0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:14.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.609+0000 7fb132ba1700 1 -- 172.21.15.49:0/4067829037 >> 172.21.15.49:0/4067829037 conn(0x7fb12c062700 msgr2=0x7fb12c062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:14.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.609+0000 7fb132ba1700 1 -- 172.21.15.49:0/4067829037 shutdown_connections 2023-11-30T17:25:14.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.609+0000 7fb132ba1700 1 -- 172.21.15.49:0/4067829037 wait complete. 2023-11-30T17:25:14.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.611+0000 7fb132ba1700 1 Processor -- start 2023-11-30T17:25:14.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.611+0000 7fb132ba1700 1 -- start start 2023-11-30T17:25:14.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.611+0000 7fb132ba1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb12c0bd680 0x7fb12c0bdf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:14.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.611+0000 7fb132ba1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb12c0bdb30 0x7fb12c146e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:14.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.611+0000 7fb132ba1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb12c0c20c0 0x7fb12c149970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:14.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.611+0000 7fb132ba1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c14c420 con 0x7fb12c0bdb30 2023-11-30T17:25:14.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.611+0000 7fb132ba1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c0be440 con 0x7fb12c0c20c0 2023-11-30T17:25:14.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.611+0000 7fb132ba1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c0bf260 con 0x7fb12c0bd680 2023-11-30T17:25:14.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.612+0000 7fb12bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb12c0bdb30 0x7fb12c146e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:14.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.612+0000 7fb12bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb12c0bdb30 0x7fb12c146e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59800/0 (socket says 172.21.15.49:59800) 2023-11-30T17:25:14.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.612+0000 7fb12bfff700 1 -- 172.21.15.49:0/245404669 learned_addr learned my addr 172.21.15.49:0/245404669 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:14.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.612+0000 7fb13113e700 1 --2- 172.21.15.49:0/245404669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb12c0c20c0 0x7fb12c149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:14.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.612+0000 7fb13093d700 1 --2- 172.21.15.49:0/245404669 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb12c0bd680 0x7fb12c0bdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:14.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.612+0000 7fb12bfff700 1 -- 172.21.15.49:0/245404669 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb12c0bd680 msgr2=0x7fb12c0bdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:14.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.612+0000 7fb12bfff700 1 --2- 172.21.15.49:0/245404669 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb12c0bd680 0x7fb12c0bdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:14.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.612+0000 7fb12bfff700 1 -- 172.21.15.49:0/245404669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb12c0c20c0 msgr2=0x7fb12c149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:14.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.612+0000 7fb12bfff700 1 --2- 172.21.15.49:0/245404669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb12c0c20c0 0x7fb12c149970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:14.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.612+0000 7fb12bfff700 1 -- 172.21.15.49:0/245404669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1240092a0 con 0x7fb12c0bdb30 2023-11-30T17:25:14.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.612+0000 7fb12bfff700 1 --2- 172.21.15.49:0/245404669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb12c0bdb30 0x7fb12c146e80 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7fb11c00c810 tx=0x7fb11c007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:14.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.612+0000 7fb128ff9700 1 -- 172.21.15.49:0/245404669 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c005d30 con 0x7fb12c0bdb30 2023-11-30T17:25:14.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.612+0000 7fb128ff9700 1 -- 172.21.15.49:0/245404669 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11c005e90 con 0x7fb12c0bdb30 2023-11-30T17:25:14.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.612+0000 7fb132ba1700 1 -- 172.21.15.49:0/245404669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb12c0be650 con 0x7fb12c0bdb30 2023-11-30T17:25:14.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.612+0000 7fb128ff9700 1 -- 172.21.15.49:0/245404669 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c007340 con 0x7fb12c0bdb30 2023-11-30T17:25:14.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.612+0000 7fb132ba1700 1 -- 172.21.15.49:0/245404669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb12c0be9e0 con 0x7fb12c0bdb30 2023-11-30T17:25:14.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.613+0000 7fb132ba1700 1 -- 172.21.15.49:0/245404669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb12c0bf010 con 0x7fb12c0bdb30 2023-11-30T17:25:14.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.614+0000 7fb128ff9700 1 -- 172.21.15.49:0/245404669 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb11c007730 con 0x7fb12c0bdb30 2023-11-30T17:25:14.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.614+0000 7fb128ff9700 1 --2- 172.21.15.49:0/245404669 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb10c05f270 0x7fb10c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:14.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.614+0000 7fb128ff9700 1 -- 172.21.15.49:0/245404669 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fb11c07a3f0 con 0x7fb12c0bdb30 2023-11-30T17:25:14.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.614+0000 7fb13093d700 1 --2- 172.21.15.49:0/245404669 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb10c05f270 0x7fb10c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:14.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.615+0000 7fb13093d700 1 --2- 172.21.15.49:0/245404669 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb10c05f270 0x7fb10c061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fb12400b340 tx=0x7fb124017000).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:14.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.618+0000 7fb128ff9700 1 -- 172.21.15.49:0/245404669 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb11c04b520 con 0x7fb12c0bdb30 2023-11-30T17:25:14.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.817+0000 7fb132ba1700 1 -- 172.21.15.49:0/245404669 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb12c06c860 con 0x7fb10c05f270 2023-11-30T17:25:14.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.819+0000 7fb128ff9700 1 -- 172.21.15.49:0/245404669 <== mgr.6428 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fb12c06c860 con 0x7fb10c05f270 2023-11-30T17:25:14.821 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-11-30T17:25:14.821 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:25:14.821 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cephfs" 2023-11-30T17:25:14.821 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:25:14.821 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-11-30T17:25:14.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.820+0000 7fb132ba1700 1 -- 172.21.15.49:0/245404669 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb10c05f270 msgr2=0x7fb10c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:14.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.820+0000 7fb132ba1700 1 --2- 172.21.15.49:0/245404669 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb10c05f270 0x7fb10c061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fb12400b340 tx=0x7fb124017000).stop 2023-11-30T17:25:14.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.820+0000 7fb132ba1700 1 -- 172.21.15.49:0/245404669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb12c0bdb30 msgr2=0x7fb12c146e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:14.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.820+0000 7fb132ba1700 1 --2- 172.21.15.49:0/245404669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb12c0bdb30 0x7fb12c146e80 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7fb11c00c810 tx=0x7fb11c007f90).stop 2023-11-30T17:25:14.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.820+0000 7fb132ba1700 1 -- 172.21.15.49:0/245404669 shutdown_connections 2023-11-30T17:25:14.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.820+0000 7fb132ba1700 1 --2- 172.21.15.49:0/245404669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb12c0c20c0 0x7fb12c149970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:14.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.820+0000 7fb132ba1700 1 --2- 172.21.15.49:0/245404669 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb12c0bd680 0x7fb12c0bdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:14.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.820+0000 7fb132ba1700 1 --2- 172.21.15.49:0/245404669 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb10c05f270 0x7fb10c061730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:14.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.820+0000 7fb132ba1700 1 --2- 172.21.15.49:0/245404669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb12c0bdb30 0x7fb12c146e80 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:14.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.820+0000 7fb132ba1700 1 -- 172.21.15.49:0/245404669 >> 172.21.15.49:0/245404669 conn(0x7fb12c062700 msgr2=0x7fb12c069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:14.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.820+0000 7fb132ba1700 1 -- 172.21.15.49:0/245404669 shutdown_connections 2023-11-30T17:25:14.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.820+0000 7fb132ba1700 1 -- 172.21.15.49:0/245404669 wait complete. 2023-11-30T17:25:14.835 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-11-30T17:25:14.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.953+0000 7faf1305a700 1 Processor -- start 2023-11-30T17:25:14.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.953+0000 7faf1305a700 1 -- start start 2023-11-30T17:25:14.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.954+0000 7faf1305a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faf0c154950 0x7faf0c0ca540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:14.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.954+0000 7faf1305a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf0c0c7bc0 con 0x7faf0c0c66f0 2023-11-30T17:25:14.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.954+0000 7faf1305a700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf0c155920 con 0x7faf0c14e530 2023-11-30T17:25:14.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.954+0000 7faf1305a700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf0c0c6ba0 con 0x7faf0c154950 2023-11-30T17:25:14.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.954+0000 7faf12859700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faf0c154950 0x7faf0c0ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:14.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.954+0000 7faf11857700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7faf0c0c66f0 0x7faf0c158570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46338/0 (socket says 172.21.15.49:46338) 2023-11-30T17:25:14.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.954+0000 7faf11857700 1 -- 172.21.15.49:0/3194912014 learned_addr learned my addr 172.21.15.49:0/3194912014 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:25:14.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.954+0000 7faf12859700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faf0c154950 0x7faf0c0ca540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59812/0 (socket says 172.21.15.49:59812) 2023-11-30T17:25:14.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.954+0000 7faf12859700 1 -- 172.21.15.49:0/3194912014 >> v1:172.21.15.115:6789/0 conn(0x7faf0c14e530 legacy=0x7faf0c14e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:14.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.954+0000 7faf12859700 1 -- 172.21.15.49:0/3194912014 >> v1:172.21.15.49:6789/0 conn(0x7faf0c0c66f0 legacy=0x7faf0c158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:14.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.954+0000 7faf12859700 1 -- 172.21.15.49:0/3194912014 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0c154de0 con 0x7faf0c154950 2023-11-30T17:25:14.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.954+0000 7faf11056700 1 -- 172.21.15.49:0/3194912014 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4124813572 0 0) 0x7faf0c0c7bc0 con 0x7faf0c0c66f0 2023-11-30T17:25:14.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.954+0000 7faf12859700 1 --2- 172.21.15.49:0/3194912014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf0c154950 0x7faf0c0ca540 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7faf04009e60 tx=0x7faf04009780).ready entity=mon.0 client_cookie=8b58c5e334eeb718 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:14.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.954+0000 7faf11056700 1 -- 172.21.15.49:0/3194912014 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0400e070 con 0x7faf0c154950 2023-11-30T17:25:14.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.955+0000 7faf11056700 1 -- 172.21.15.49:0/3194912014 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0400bc30 con 0x7faf0c154950 2023-11-30T17:25:14.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.955+0000 7faf11056700 1 -- 172.21.15.49:0/3194912014 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf04012410 con 0x7faf0c154950 2023-11-30T17:25:14.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.955+0000 7faf1305a700 1 -- 172.21.15.49:0/3194912014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf0c154950 msgr2=0x7faf0c0ca540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:14.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.955+0000 7faf1305a700 1 --2- 172.21.15.49:0/3194912014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf0c154950 0x7faf0c0ca540 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7faf04009e60 tx=0x7faf04009780).stop 2023-11-30T17:25:14.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.955+0000 7faf1305a700 1 -- 172.21.15.49:0/3194912014 shutdown_connections 2023-11-30T17:25:14.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.955+0000 7faf1305a700 1 --2- 172.21.15.49:0/3194912014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf0c154950 0x7faf0c0ca540 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:14.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.955+0000 7faf1305a700 1 -- 172.21.15.49:0/3194912014 >> 172.21.15.49:0/3194912014 conn(0x7faf0c064990 msgr2=0x7faf0c064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:14.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.955+0000 7faf1305a700 1 -- 172.21.15.49:0/3194912014 shutdown_connections 2023-11-30T17:25:14.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.955+0000 7faf1305a700 1 -- 172.21.15.49:0/3194912014 wait complete. 2023-11-30T17:25:14.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.956+0000 7faf1305a700 1 Processor -- start 2023-11-30T17:25:14.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.956+0000 7faf1305a700 1 -- start start 2023-11-30T17:25:14.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.957+0000 7faf1305a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf0c0c66f0 0x7faf0c14dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:14.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.957+0000 7faf1305a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf0c14e530 0x7faf0c0b0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:14.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.957+0000 7faf1305a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf0c154950 0x7faf0c0b0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:14.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.957+0000 7faf1305a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c0afcb0 con 0x7faf0c14e530 2023-11-30T17:25:14.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.957+0000 7faf1305a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c0af0a0 con 0x7faf0c154950 2023-11-30T17:25:14.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.957+0000 7faf1305a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c0af380 con 0x7faf0c0c66f0 2023-11-30T17:25:14.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.957+0000 7faf11857700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf0c14e530 0x7faf0c0b0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:14.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.957+0000 7faf11857700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf0c14e530 0x7faf0c0b0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59814/0 (socket says 172.21.15.49:59814) 2023-11-30T17:25:14.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.957+0000 7faf11857700 1 -- 172.21.15.49:0/932040672 learned_addr learned my addr 172.21.15.49:0/932040672 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:14.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.957+0000 7faf12859700 1 --2- 172.21.15.49:0/932040672 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf0c154950 0x7faf0c0b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:14.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.957+0000 7faf12058700 1 --2- 172.21.15.49:0/932040672 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf0c0c66f0 0x7faf0c14dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:14.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.957+0000 7faf11857700 1 -- 172.21.15.49:0/932040672 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf0c0c66f0 msgr2=0x7faf0c14dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:14.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.957+0000 7faf11857700 1 --2- 172.21.15.49:0/932040672 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf0c0c66f0 0x7faf0c14dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:14.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.957+0000 7faf11857700 1 -- 172.21.15.49:0/932040672 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf0c154950 msgr2=0x7faf0c0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:14.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.957+0000 7faf11857700 1 --2- 172.21.15.49:0/932040672 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf0c154950 0x7faf0c0b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:14.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.957+0000 7faf11857700 1 -- 172.21.15.49:0/932040672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf04009a20 con 0x7faf0c14e530 2023-11-30T17:25:14.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.957+0000 7faf12058700 1 --2- 172.21.15.49:0/932040672 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf0c0c66f0 0x7faf0c14dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:25:14.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.958+0000 7faf11857700 1 --2- 172.21.15.49:0/932040672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf0c14e530 0x7faf0c0b0140 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7faefc00c4c0 tx=0x7faefc007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:14.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.958+0000 7faf027fc700 1 -- 172.21.15.49:0/932040672 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc0072e0 con 0x7faf0c14e530 2023-11-30T17:25:14.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.958+0000 7faf027fc700 1 -- 172.21.15.49:0/932040672 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc007440 con 0x7faf0c14e530 2023-11-30T17:25:14.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.958+0000 7faf1305a700 1 -- 172.21.15.49:0/932040672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf0c0af660 con 0x7faf0c14e530 2023-11-30T17:25:14.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.958+0000 7faf027fc700 1 -- 172.21.15.49:0/932040672 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc0057a0 con 0x7faf0c14e530 2023-11-30T17:25:14.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.958+0000 7faf1305a700 1 -- 172.21.15.49:0/932040672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0c14e1a0 con 0x7faf0c14e530 2023-11-30T17:25:14.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.959+0000 7faf1305a700 1 -- 172.21.15.49:0/932040672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf0c062ee0 con 0x7faf0c14e530 2023-11-30T17:25:14.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.959+0000 7faf027fc700 1 -- 172.21.15.49:0/932040672 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 49) v1 ==== 75548+0+0 (secure 0 0 0) 0x7faefc005b90 con 0x7faf0c14e530 2023-11-30T17:25:14.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.960+0000 7faf027fc700 1 --2- 172.21.15.49:0/932040672 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faef005f270 0x7faef0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:14.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.960+0000 7faf027fc700 1 -- 172.21.15.49:0/932040672 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6149+0+0 (secure 0 0 0) 0x7faefc079ba0 con 0x7faf0c14e530 2023-11-30T17:25:14.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.960+0000 7faf12058700 1 --2- 172.21.15.49:0/932040672 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faef005f270 0x7faef0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:14.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.960+0000 7faf12058700 1 --2- 172.21.15.49:0/932040672 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faef005f270 0x7faef0061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7faf0c159ac0 tx=0x7faf08009040).ready entity=mgr.6428 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:14.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:14.964+0000 7faf027fc700 1 -- 172.21.15.49:0/932040672 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7faefc04acd0 con 0x7faf0c14e530 2023-11-30T17:25:15.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:15.183+0000 7faf1305a700 1 -- 172.21.15.49:0/932040672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7faf0c06c7c0 con 0x7faf0c14e530 2023-11-30T17:25:15.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:15.960+0000 7faf027fc700 1 -- 172.21.15.49:0/932040672 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 50) v1 ==== 75565+0+0 (secure 0 0 0) 0x7faefc0777d0 con 0x7faf0c14e530 2023-11-30T17:25:15.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:15.962+0000 7faf027fc700 1 -- 172.21.15.49:0/932040672 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v50) v1 ==== 92+0+0 (secure 0 0 0) 0x7faefc076e60 con 0x7faf0c14e530 2023-11-30T17:25:15.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:15.964+0000 7faf1305a700 1 -- 172.21.15.49:0/932040672 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faef005f270 msgr2=0x7faef0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:15.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:15.964+0000 7faf1305a700 1 --2- 172.21.15.49:0/932040672 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faef005f270 0x7faef0061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7faf0c159ac0 tx=0x7faf08009040).stop 2023-11-30T17:25:15.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:15.964+0000 7faf1305a700 1 -- 172.21.15.49:0/932040672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf0c14e530 msgr2=0x7faf0c0b0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:15.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:15.964+0000 7faf1305a700 1 --2- 172.21.15.49:0/932040672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf0c14e530 0x7faf0c0b0140 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7faefc00c4c0 tx=0x7faefc007c10).stop 2023-11-30T17:25:15.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:15.964+0000 7faf1305a700 1 -- 172.21.15.49:0/932040672 shutdown_connections 2023-11-30T17:25:15.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:15.964+0000 7faf1305a700 1 --2- 172.21.15.49:0/932040672 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf0c154950 0x7faf0c0b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:15.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:15.964+0000 7faf1305a700 1 --2- 172.21.15.49:0/932040672 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf0c0c66f0 0x7faf0c14dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:15.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:15.964+0000 7faf1305a700 1 --2- 172.21.15.49:0/932040672 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faef005f270 0x7faef0061730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:15.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:15.964+0000 7faf1305a700 1 --2- 172.21.15.49:0/932040672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf0c14e530 0x7faf0c0b0140 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:15.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:15.964+0000 7faf1305a700 1 -- 172.21.15.49:0/932040672 >> 172.21.15.49:0/932040672 conn(0x7faf0c064990 msgr2=0x7faf0c0c0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:15.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:15.964+0000 7faf1305a700 1 -- 172.21.15.49:0/932040672 shutdown_connections 2023-11-30T17:25:15.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:15.964+0000 7faf1305a700 1 -- 172.21.15.49:0/932040672 wait complete. 2023-11-30T17:25:15.981 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-11-30T17:25:16.105 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:16.102+0000 7f703a76f680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T17:25:16.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.105+0000 7f6a92644700 1 Processor -- start 2023-11-30T17:25:16.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.105+0000 7f6a92644700 1 -- start start 2023-11-30T17:25:16.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.106+0000 7f6a92644700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6a8c0c6190 0x7f6a8c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:16.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.106+0000 7f6a92644700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6a8c158320 0x7f6a8c1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:16.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.106+0000 7f6a92644700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a8c158cc0 con 0x7f6a8c098d10 2023-11-30T17:25:16.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.106+0000 7f6a92644700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a8c0c72d0 con 0x7f6a8c158320 2023-11-30T17:25:16.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.106+0000 7f6a92644700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a8c064570 con 0x7f6a8c0c6190 2023-11-30T17:25:16.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.106+0000 7f6a90be1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6a8c158320 0x7f6a8c1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:16.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.106+0000 7f6a90be1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6a8c158320 0x7f6a8c1587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59838/0 (socket says 172.21.15.49:59838) 2023-11-30T17:25:16.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.106+0000 7f6a90be1700 1 -- 172.21.15.49:0/4234552717 learned_addr learned my addr 172.21.15.49:0/4234552717 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:16.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.106+0000 7f6a8b7fe700 1 --2- 172.21.15.49:0/4234552717 >> v2:172.21.15.115:3300/0 conn(0x7f6a8c0c6190 0x7f6a8c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:16.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.106+0000 7f6a8b7fe700 1 -- 172.21.15.49:0/4234552717 >> v2:172.21.15.49:3300/0 conn(0x7f6a8c158320 msgr2=0x7f6a8c1587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:16.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.106+0000 7f6a8b7fe700 1 --2- 172.21.15.49:0/4234552717 >> v2:172.21.15.49:3300/0 conn(0x7f6a8c158320 0x7f6a8c1587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:16.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.106+0000 7f6a8b7fe700 1 -- 172.21.15.49:0/4234552717 >> v1:172.21.15.115:6789/0 conn(0x7f6a8c098d10 legacy=0x7f6a8c063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:16.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.106+0000 7f6a8affd700 1 -- 172.21.15.49:0/4234552717 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3681340278 0 0) 0x7f6a7c001110 con 0x7f6a8c098d10 2023-11-30T17:25:16.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.106+0000 7f6a8b7fe700 1 -- 172.21.15.49:0/4234552717 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8c154bc0 con 0x7f6a8c0c6190 2023-11-30T17:25:16.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.106+0000 7f6a90be1700 1 --2- 172.21.15.49:0/4234552717 >> v2:172.21.15.49:3300/0 conn(0x7f6a8c158320 0x7f6a8c1587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:25:16.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.106+0000 7f6a8b7fe700 1 --2- 172.21.15.49:0/4234552717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a8c0c6190 0x7f6a8c0c7760 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f6a8c0c5b40 tx=0x7f6a80009060).ready entity=mon.1 client_cookie=80c76910c46a1fe8 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:16.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.107+0000 7f6a8affd700 1 -- 172.21.15.49:0/4234552717 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8000f510 con 0x7f6a8c0c6190 2023-11-30T17:25:16.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.107+0000 7f6a8affd700 1 -- 172.21.15.49:0/4234552717 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8000f670 con 0x7f6a8c0c6190 2023-11-30T17:25:16.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.107+0000 7f6a8affd700 1 -- 172.21.15.49:0/4234552717 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8000f9f0 con 0x7f6a8c0c6190 2023-11-30T17:25:16.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.107+0000 7f6a92644700 1 -- 172.21.15.49:0/4234552717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a8c0c6190 msgr2=0x7f6a8c0c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:16.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.107+0000 7f6a92644700 1 --2- 172.21.15.49:0/4234552717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a8c0c6190 0x7f6a8c0c7760 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f6a8c0c5b40 tx=0x7f6a80009060).stop 2023-11-30T17:25:16.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.107+0000 7f6a92644700 1 -- 172.21.15.49:0/4234552717 shutdown_connections 2023-11-30T17:25:16.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.107+0000 7f6a92644700 1 --2- 172.21.15.49:0/4234552717 >> v2:172.21.15.49:3300/0 conn(0x7f6a8c158320 0x7f6a8c1587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:16.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.107+0000 7f6a92644700 1 --2- 172.21.15.49:0/4234552717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a8c0c6190 0x7f6a8c0c7760 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:16.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.107+0000 7f6a92644700 1 -- 172.21.15.49:0/4234552717 >> 172.21.15.49:0/4234552717 conn(0x7f6a8c0cb310 msgr2=0x7f6a8c0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:16.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.107+0000 7f6a92644700 1 -- 172.21.15.49:0/4234552717 shutdown_connections 2023-11-30T17:25:16.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.107+0000 7f6a92644700 1 -- 172.21.15.49:0/4234552717 wait complete. 2023-11-30T17:25:16.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.108+0000 7f6a92644700 1 Processor -- start 2023-11-30T17:25:16.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.109+0000 7f6a92644700 1 -- start start 2023-11-30T17:25:16.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.109+0000 7f6a92644700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a8c098d10 0x7f6a8c152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:16.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.109+0000 7f6a92644700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a8c0c6190 0x7f6a8c153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:16.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.109+0000 7f6a92644700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a8c158320 0x7f6a8c154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:16.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.109+0000 7f6a92644700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c154520 con 0x7f6a8c098d10 2023-11-30T17:25:16.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.109+0000 7f6a92644700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c0abd50 con 0x7f6a8c158320 2023-11-30T17:25:16.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.109+0000 7f6a92644700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c152850 con 0x7f6a8c0c6190 2023-11-30T17:25:16.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.109+0000 7f6a8bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a8c098d10 0x7f6a8c152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:16.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.109+0000 7f6a8bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a8c098d10 0x7f6a8c152360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59852/0 (socket says 172.21.15.49:59852) 2023-11-30T17:25:16.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.109+0000 7f6a8bfff700 1 -- 172.21.15.49:0/1699520936 learned_addr learned my addr 172.21.15.49:0/1699520936 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:16.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.110+0000 7f6a90be1700 1 --2- 172.21.15.49:0/1699520936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a8c158320 0x7f6a8c154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:16.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.110+0000 7f6a8b7fe700 1 --2- 172.21.15.49:0/1699520936 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a8c0c6190 0x7f6a8c153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:16.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.110+0000 7f6a8bfff700 1 -- 172.21.15.49:0/1699520936 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a8c0c6190 msgr2=0x7f6a8c153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:16.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.110+0000 7f6a8bfff700 1 --2- 172.21.15.49:0/1699520936 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a8c0c6190 0x7f6a8c153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:16.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.110+0000 7f6a8bfff700 1 -- 172.21.15.49:0/1699520936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a8c158320 msgr2=0x7f6a8c154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:16.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.110+0000 7f6a8bfff700 1 --2- 172.21.15.49:0/1699520936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a8c158320 0x7f6a8c154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:16.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.110+0000 7f6a8bfff700 1 -- 172.21.15.49:0/1699520936 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a84009ae0 con 0x7f6a8c098d10 2023-11-30T17:25:16.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.110+0000 7f6a90be1700 1 --2- 172.21.15.49:0/1699520936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a8c158320 0x7f6a8c154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:25:16.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.110+0000 7f6a8bfff700 1 --2- 172.21.15.49:0/1699520936 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a8c098d10 0x7f6a8c152360 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f6a7c00c4e0 tx=0x7f6a7c007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:16.115 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:25:16.110+0000 7fadb98a5680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T17:25:16.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.110+0000 7f6a73fff700 1 -- 172.21.15.49:0/1699520936 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c012400 con 0x7f6a8c098d10 2023-11-30T17:25:16.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.110+0000 7f6a73fff700 1 -- 172.21.15.49:0/1699520936 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7c012580 con 0x7f6a8c098d10 2023-11-30T17:25:16.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.110+0000 7f6a73fff700 1 -- 172.21.15.49:0/1699520936 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c012940 con 0x7f6a8c098d10 2023-11-30T17:25:16.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.110+0000 7f6a92644700 1 -- 172.21.15.49:0/1699520936 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a800092a0 con 0x7f6a8c098d10 2023-11-30T17:25:16.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.110+0000 7f6a92644700 1 -- 172.21.15.49:0/1699520936 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8c0ab420 con 0x7f6a8c098d10 2023-11-30T17:25:16.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.111+0000 7f6a92644700 1 -- 172.21.15.49:0/1699520936 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a8c06c860 con 0x7f6a8c098d10 2023-11-30T17:25:16.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.112+0000 7f6a73fff700 1 -- 172.21.15.49:0/1699520936 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 50) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f6a7c012cb0 con 0x7f6a8c098d10 2023-11-30T17:25:16.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.112+0000 7f6a73fff700 1 --2- 172.21.15.49:0/1699520936 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6a7805f290 0x7f6a78061750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:16.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.112+0000 7f6a73fff700 1 -- 172.21.15.49:0/1699520936 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f6a7c079730 con 0x7f6a8c098d10 2023-11-30T17:25:16.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.112+0000 7f6a8b7fe700 1 -- 172.21.15.49:0/1699520936 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6a7805f290 msgr2=0x7f6a78061750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:25:16.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.112+0000 7f6a8b7fe700 1 --2- 172.21.15.49:0/1699520936 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6a7805f290 0x7f6a78061750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:25:16.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.116+0000 7f6a73fff700 1 -- 172.21.15.49:0/1699520936 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6a7c04a860 con 0x7f6a8c098d10 2023-11-30T17:25:16.168 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:16.166+0000 7f703a76f680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T17:25:16.180 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:25:16.178+0000 7fadb98a5680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T17:25:16.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.291+0000 7f6a92644700 1 -- 172.21.15.49:0/1699520936 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f6a8c158cc0 con 0x7f6a8c098d10 2023-11-30T17:25:16.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.296+0000 7f6a73fff700 1 -- 172.21.15.49:0/1699520936 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6a8c158cc0 con 0x7f6a8c098d10 2023-11-30T17:25:16.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.298+0000 7f6a92644700 1 -- 172.21.15.49:0/1699520936 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6a7805f290 msgr2=0x7f6a78061750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:25:16.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.298+0000 7f6a92644700 1 --2- 172.21.15.49:0/1699520936 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6a7805f290 0x7f6a78061750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:25:16.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.298+0000 7f6a92644700 1 -- 172.21.15.49:0/1699520936 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a8c098d10 msgr2=0x7f6a8c152360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:16.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.298+0000 7f6a92644700 1 --2- 172.21.15.49:0/1699520936 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a8c098d10 0x7f6a8c152360 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f6a7c00c4e0 tx=0x7f6a7c007ae0).stop 2023-11-30T17:25:16.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.298+0000 7f6a92644700 1 -- 172.21.15.49:0/1699520936 shutdown_connections 2023-11-30T17:25:16.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.298+0000 7f6a92644700 1 --2- 172.21.15.49:0/1699520936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a8c158320 0x7f6a8c154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:16.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.298+0000 7f6a92644700 1 --2- 172.21.15.49:0/1699520936 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6a7805f290 0x7f6a78061750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:25:16.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.298+0000 7f6a92644700 1 --2- 172.21.15.49:0/1699520936 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a8c098d10 0x7f6a8c152360 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:16.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.298+0000 7f6a92644700 1 --2- 172.21.15.49:0/1699520936 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a8c0c6190 0x7f6a8c153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:16.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.298+0000 7f6a92644700 1 -- 172.21.15.49:0/1699520936 >> 172.21.15.49:0/1699520936 conn(0x7f6a8c0cb310 msgr2=0x7f6a8c0caaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:16.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.298+0000 7f6a92644700 1 -- 172.21.15.49:0/1699520936 shutdown_connections 2023-11-30T17:25:16.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.298+0000 7f6a92644700 1 -- 172.21.15.49:0/1699520936 wait complete. 2023-11-30T17:25:16.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:16.314 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-11-30T17:25:16.338 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-11-30T17:25:16.441 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:16.439+0000 7f703a76f680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T17:25:16.475 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:25:16.473+0000 7fadb98a5680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T17:25:16.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.501+0000 7fb53ebc0700 1 Processor -- start 2023-11-30T17:25:16.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.501+0000 7fb53ebc0700 1 -- start start 2023-11-30T17:25:16.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.502+0000 7fb53ebc0700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb5380c1e80 0x7fb53815f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:16.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.502+0000 7fb53ebc0700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5380c6ad0 con 0x7fb5381547e0 2023-11-30T17:25:16.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.502+0000 7fb53ebc0700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5380bc470 con 0x7fb538154400 2023-11-30T17:25:16.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.502+0000 7fb53ebc0700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5380c6230 con 0x7fb5380c1e80 2023-11-30T17:25:16.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.502+0000 7fb53d3bd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb5381547e0 0x7fb5380c1770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46362/0 (socket says 172.21.15.49:46362) 2023-11-30T17:25:16.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.502+0000 7fb53d3bd700 1 -- 172.21.15.49:0/1112585929 learned_addr learned my addr 172.21.15.49:0/1112585929 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:25:16.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.502+0000 7fb53e3bf700 1 --2- 172.21.15.49:0/1112585929 >> v2:172.21.15.115:3300/0 conn(0x7fb5380c1e80 0x7fb53815f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:16.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.502+0000 7fb53cbbc700 1 -- 172.21.15.49:0/1112585929 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2081113149 0 0) 0x7fb528001110 con 0x7fb5381547e0 2023-11-30T17:25:16.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.502+0000 7fb53cbbc700 1 -- 172.21.15.49:0/1112585929 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5240033f0 con 0x7fb5381547e0 2023-11-30T17:25:16.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.502+0000 7fb53cbbc700 1 -- 172.21.15.49:0/1112585929 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2800454383 0 0) 0x7fb5380bc470 con 0x7fb538154400 2023-11-30T17:25:16.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.502+0000 7fb53cbbc700 1 -- 172.21.15.49:0/1112585929 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb528001110 con 0x7fb538154400 2023-11-30T17:25:16.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.502+0000 7fb53e3bf700 1 -- 172.21.15.49:0/1112585929 >> v1:172.21.15.115:6789/0 conn(0x7fb538154400 legacy=0x7fb5380c59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:16.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.502+0000 7fb53e3bf700 1 -- 172.21.15.49:0/1112585929 >> v1:172.21.15.49:6789/0 conn(0x7fb5381547e0 legacy=0x7fb5380c1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:16.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.503+0000 7fb53e3bf700 1 -- 172.21.15.49:0/1112585929 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5380c6510 con 0x7fb5380c1e80 2023-11-30T17:25:16.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.503+0000 7fb53e3bf700 1 --2- 172.21.15.49:0/1112585929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5380c1e80 0x7fb53815f120 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fb530009e60 tx=0x7fb530009780).ready entity=mon.1 client_cookie=c867029ba41fb180 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:16.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.503+0000 7fb53cbbc700 1 -- 172.21.15.49:0/1112585929 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53000e070 con 0x7fb5380c1e80 2023-11-30T17:25:16.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.503+0000 7fb53cbbc700 1 -- 172.21.15.49:0/1112585929 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53000bab0 con 0x7fb5380c1e80 2023-11-30T17:25:16.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.503+0000 7fb53cbbc700 1 -- 172.21.15.49:0/1112585929 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53000be30 con 0x7fb5380c1e80 2023-11-30T17:25:16.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.503+0000 7fb53ebc0700 1 -- 172.21.15.49:0/1112585929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5380c1e80 msgr2=0x7fb53815f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:16.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.503+0000 7fb53ebc0700 1 --2- 172.21.15.49:0/1112585929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5380c1e80 0x7fb53815f120 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fb530009e60 tx=0x7fb530009780).stop 2023-11-30T17:25:16.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.503+0000 7fb53ebc0700 1 -- 172.21.15.49:0/1112585929 shutdown_connections 2023-11-30T17:25:16.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.503+0000 7fb53ebc0700 1 --2- 172.21.15.49:0/1112585929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5380c1e80 0x7fb53815f120 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:16.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.503+0000 7fb53ebc0700 1 -- 172.21.15.49:0/1112585929 >> 172.21.15.49:0/1112585929 conn(0x7fb5380c70d0 msgr2=0x7fb5380c74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:16.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.504+0000 7fb53ebc0700 1 -- 172.21.15.49:0/1112585929 shutdown_connections 2023-11-30T17:25:16.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.504+0000 7fb53ebc0700 1 -- 172.21.15.49:0/1112585929 wait complete. 2023-11-30T17:25:16.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.505+0000 7fb53ebc0700 1 Processor -- start 2023-11-30T17:25:16.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.505+0000 7fb53ebc0700 1 -- start start 2023-11-30T17:25:16.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.505+0000 7fb53ebc0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5380c1e80 0x7fb5381669e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:16.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.505+0000 7fb53ebc0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb538154400 0x7fb538159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:16.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.505+0000 7fb53ebc0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5381547e0 0x7fb5380aa340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:16.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.505+0000 7fb53ebc0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb538167910 con 0x7fb5381547e0 2023-11-30T17:25:16.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.505+0000 7fb53ebc0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53815a0d0 con 0x7fb5380c1e80 2023-11-30T17:25:16.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.505+0000 7fb53ebc0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5380aa830 con 0x7fb538154400 2023-11-30T17:25:16.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.506+0000 7fb53e3bf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5381547e0 0x7fb5380aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:16.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.506+0000 7fb53e3bf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5381547e0 0x7fb5380aa340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59854/0 (socket says 172.21.15.49:59854) 2023-11-30T17:25:16.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.506+0000 7fb53e3bf700 1 -- 172.21.15.49:0/3952432312 learned_addr learned my addr 172.21.15.49:0/3952432312 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:16.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.506+0000 7fb53dbbe700 1 --2- 172.21.15.49:0/3952432312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5380c1e80 0x7fb5381669e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:16.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.506+0000 7fb53d3bd700 1 --2- 172.21.15.49:0/3952432312 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb538154400 0x7fb538159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:16.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.506+0000 7fb53e3bf700 1 -- 172.21.15.49:0/3952432312 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb538154400 msgr2=0x7fb538159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:16.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.506+0000 7fb53e3bf700 1 --2- 172.21.15.49:0/3952432312 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb538154400 0x7fb538159be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:16.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.506+0000 7fb53e3bf700 1 -- 172.21.15.49:0/3952432312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5380c1e80 msgr2=0x7fb5381669e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:16.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.506+0000 7fb53e3bf700 1 --2- 172.21.15.49:0/3952432312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5380c1e80 0x7fb5381669e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:16.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.506+0000 7fb53e3bf700 1 -- 172.21.15.49:0/3952432312 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb530009a20 con 0x7fb5381547e0 2023-11-30T17:25:16.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.506+0000 7fb53e3bf700 1 --2- 172.21.15.49:0/3952432312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5381547e0 0x7fb5380aa340 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7fb53000b610 tx=0x7fb530009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:16.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.506+0000 7fb52dffb700 1 -- 172.21.15.49:0/3952432312 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb530012e60 con 0x7fb5381547e0 2023-11-30T17:25:16.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.506+0000 7fb52dffb700 1 -- 172.21.15.49:0/3952432312 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53001d630 con 0x7fb5381547e0 2023-11-30T17:25:16.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.506+0000 7fb53ebc0700 1 -- 172.21.15.49:0/3952432312 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb538167070 con 0x7fb5381547e0 2023-11-30T17:25:16.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.506+0000 7fb52dffb700 1 -- 172.21.15.49:0/3952432312 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53001d9b0 con 0x7fb5381547e0 2023-11-30T17:25:16.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.506+0000 7fb53ebc0700 1 -- 172.21.15.49:0/3952432312 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb538167630 con 0x7fb5381547e0 2023-11-30T17:25:16.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.508+0000 7fb53ebc0700 1 -- 172.21.15.49:0/3952432312 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb53806c7c0 con 0x7fb5381547e0 2023-11-30T17:25:16.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.508+0000 7fb52dffb700 1 -- 172.21.15.49:0/3952432312 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 50) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fb530026410 con 0x7fb5381547e0 2023-11-30T17:25:16.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.508+0000 7fb52dffb700 1 --2- 172.21.15.49:0/3952432312 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb51c05f2c0 0x7fb51c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:16.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.508+0000 7fb52dffb700 1 -- 172.21.15.49:0/3952432312 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fb53007c110 con 0x7fb5381547e0 2023-11-30T17:25:16.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.508+0000 7fb53dbbe700 1 -- 172.21.15.49:0/3952432312 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb51c05f2c0 msgr2=0x7fb51c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:25:16.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.508+0000 7fb53dbbe700 1 --2- 172.21.15.49:0/3952432312 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb51c05f2c0 0x7fb51c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:25:16.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.516+0000 7fb52dffb700 1 -- 172.21.15.49:0/3952432312 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb53004d2a0 con 0x7fb5381547e0 2023-11-30T17:25:16.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.709+0000 7fb53dbbe700 1 -- 172.21.15.49:0/3952432312 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb51c05f2c0 msgr2=0x7fb51c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:25:16.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.709+0000 7fb53dbbe700 1 --2- 172.21.15.49:0/3952432312 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb51c05f2c0 0x7fb51c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:25:16.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:16.718+0000 7fb53ebc0700 1 -- 172.21.15.49:0/3952432312 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5380c67f0 con 0x7fb51c05f2c0 2023-11-30T17:25:17.051 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:17.046+0000 7f703a76f680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T17:25:17.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:17.110+0000 7fb53dbbe700 1 -- 172.21.15.49:0/3952432312 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb51c05f2c0 msgr2=0x7fb51c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:25:17.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:17.110+0000 7fb53dbbe700 1 --2- 172.21.15.49:0/3952432312 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb51c05f2c0 0x7fb51c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-11-30T17:25:17.120 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:17.118+0000 7f703a76f680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T17:25:17.147 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:25:17.145+0000 7fadb98a5680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T17:25:17.217 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:25:17.214+0000 7fadb98a5680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T17:25:17.307 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:17.304+0000 7f703a76f680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T17:25:17.412 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:25:17.410+0000 7fadb98a5680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T17:25:17.724 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:17.722+0000 7f703a76f680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T17:25:17.827 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:17.825+0000 7f703a76f680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:25:17.854 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:25:17.852+0000 7fadb98a5680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T17:25:17.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:17.911+0000 7fb53dbbe700 1 -- 172.21.15.49:0/3952432312 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb51c05f2c0 msgr2=0x7fb51c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:25:17.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:17.911+0000 7fb53dbbe700 1 --2- 172.21.15.49:0/3952432312 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb51c05f2c0 0x7fb51c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-11-30T17:25:17.963 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:25:17.961+0000 7fadb98a5680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:25:17.980 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:17.978+0000 7f703a76f680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T17:25:18.055 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:18.053+0000 7f703a76f680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T17:25:18.122 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:18.119+0000 7f703a76f680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T17:25:18.123 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:25:18.121+0000 7fadb98a5680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T17:25:18.202 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:25:18.199+0000 7fadb98a5680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T17:25:18.273 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:25:18.270+0000 7fadb98a5680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T17:25:18.378 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:18.376+0000 7f703a76f680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T17:25:18.547 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:25:18.544+0000 7fadb98a5680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T17:25:18.560 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:18.557+0000 7f703a76f680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T17:25:18.737 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:25:18.735+0000 7fadb98a5680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T17:25:19.204 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:19.202+0000 7f703a76f680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T17:25:19.273 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:19.270+0000 7f703a76f680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T17:25:19.348 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:19.346+0000 7f703a76f680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T17:25:19.426 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:25:19.423+0000 7fadb98a5680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T17:25:19.496 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:19.494+0000 7f703a76f680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T17:25:19.498 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:25:19.495+0000 7fadb98a5680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T17:25:19.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:19.513+0000 7fb53dbbe700 1 -- 172.21.15.49:0/3952432312 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb51c05f2c0 msgr2=0x7fb51c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:25:19.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:19.513+0000 7fb53dbbe700 1 --2- 172.21.15.49:0/3952432312 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb51c05f2c0 0x7fb51c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-11-30T17:25:19.567 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:19.565+0000 7f703a76f680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T17:25:19.577 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:25:19.574+0000 7fadb98a5680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T17:25:19.684 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:19.681+0000 7f703a76f680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T17:25:19.731 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:25:19.729+0000 7fadb98a5680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T17:25:19.792 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:19.789+0000 7f703a76f680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:25:19.806 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:25:19.803+0000 7fadb98a5680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T17:25:19.929 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:25:19.926+0000 7fadb98a5680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T17:25:20.042 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:25:20.040+0000 7fadb98a5680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:25:20.079 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:20.077+0000 7f703a76f680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T17:25:20.150 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:20.148+0000 7f703a76f680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T17:25:20.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:20.170+0000 7fb52dffb700 1 -- 172.21.15.49:0/3952432312 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 51) v1 ==== 75287+0+0 (secure 0 0 0) 0x7fb530003050 con 0x7fb5381547e0 2023-11-30T17:25:20.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:20.171+0000 7fb52dffb700 1 -- 172.21.15.49:0/3952432312 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb51c05f2c0 msgr2=0x7fb51c061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:25:20.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:20.171+0000 7fb52dffb700 1 --2- 172.21.15.49:0/3952432312 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb51c05f2c0 0x7fb51c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:25:20.243 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:20.240+0000 7f6fae6f4700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:25:20.243 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:20.240+0000 7f6fae6f4700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:25:20.243 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:20.240+0000 7f6fae6f4700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:25:20.243 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:20.240+0000 7f6fae6f4700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:25:20.243 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:20.240+0000 7f6fae6f4700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:25:20.244 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:20.240+0000 7f6fb1efb700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:25:20.244 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:20.240+0000 7f6fb1efb700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:25:20.244 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:20.240+0000 7f6fb1efb700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:25:20.244 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:20.240+0000 7f6fb1efb700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:25:20.244 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:25:20.240+0000 7f6fb1efb700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:25:20.352 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:25:20.349+0000 7fadb98a5680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T17:25:20.427 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:25:20.425+0000 7fadb98a5680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T17:25:21.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.174+0000 7fb52dffb700 1 -- 172.21.15.49:0/3952432312 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mgrmap(e 52) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fb53007a180 con 0x7fb5381547e0 2023-11-30T17:25:21.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.174+0000 7fb52dffb700 1 --2- 172.21.15.49:0/3952432312 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb51c05f2c0 0x7fb51c061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:21.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.174+0000 7fb52dffb700 1 -- 172.21.15.49:0/3952432312 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5380c67f0 con 0x7fb51c05f2c0 2023-11-30T17:25:21.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.177+0000 7fb53dbbe700 1 --2- 172.21.15.49:0/3952432312 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb51c05f2c0 0x7fb51c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:21.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.178+0000 7fb53dbbe700 1 --2- 172.21.15.49:0/3952432312 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb51c05f2c0 0x7fb51c061700 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fb534007e90 tx=0x7fb534009040).ready entity=mgr.7549 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:21.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.193+0000 7fb52dffb700 1 -- 172.21.15.49:0/3952432312 <== mgr.7549 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb5380c67f0 con 0x7fb51c05f2c0 2023-11-30T17:25:21.195 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule set for path snap_test_dir1 2023-11-30T17:25:21.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.195+0000 7fb53ebc0700 1 -- 172.21.15.49:0/3952432312 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb51c05f2c0 msgr2=0x7fb51c061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:21.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.195+0000 7fb53ebc0700 1 --2- 172.21.15.49:0/3952432312 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb51c05f2c0 0x7fb51c061700 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fb534007e90 tx=0x7fb534009040).stop 2023-11-30T17:25:21.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.195+0000 7fb53ebc0700 1 -- 172.21.15.49:0/3952432312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5381547e0 msgr2=0x7fb5380aa340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:21.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.195+0000 7fb53ebc0700 1 --2- 172.21.15.49:0/3952432312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5381547e0 0x7fb5380aa340 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7fb53000b610 tx=0x7fb530009780).stop 2023-11-30T17:25:21.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.195+0000 7fb53ebc0700 1 -- 172.21.15.49:0/3952432312 shutdown_connections 2023-11-30T17:25:21.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.195+0000 7fb53ebc0700 1 --2- 172.21.15.49:0/3952432312 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb51c05f2c0 0x7fb51c061700 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:21.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.195+0000 7fb53ebc0700 1 --2- 172.21.15.49:0/3952432312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5381547e0 0x7fb5380aa340 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:21.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.195+0000 7fb53ebc0700 1 --2- 172.21.15.49:0/3952432312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5380c1e80 0x7fb5381669e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:21.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.195+0000 7fb53ebc0700 1 --2- 172.21.15.49:0/3952432312 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb538154400 0x7fb538159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:21.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.195+0000 7fb53ebc0700 1 -- 172.21.15.49:0/3952432312 >> 172.21.15.49:0/3952432312 conn(0x7fb5380c70d0 msgr2=0x7fb5380bd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:21.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.195+0000 7fb53ebc0700 1 -- 172.21.15.49:0/3952432312 shutdown_connections 2023-11-30T17:25:21.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.195+0000 7fb53ebc0700 1 -- 172.21.15.49:0/3952432312 wait complete. 2023-11-30T17:25:21.212 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-11-30T17:25:21.212 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-11-30-17_26_00 in ~39s... 2023-11-30T17:25:21.212 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2023-11-30T17:25:21.212 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-11-30T17:25:21.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.337+0000 7f5bd12ec700 1 Processor -- start 2023-11-30T17:25:21.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.337+0000 7f5bd12ec700 1 -- start start 2023-11-30T17:25:21.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.337+0000 7f5bd12ec700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5bcc0ab3b0 0x7f5bcc1582e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:21.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.337+0000 7f5bd12ec700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5bcc0aa1c0 0x7f5bcc0aa600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:21.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.337+0000 7f5bd12ec700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bcc159210 con 0x7f5bcc154610 2023-11-30T17:25:21.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.337+0000 7f5bd12ec700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bcc0c0c70 con 0x7f5bcc0aa1c0 2023-11-30T17:25:21.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.337+0000 7f5bd12ec700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bcc0c2110 con 0x7f5bcc0ab3b0 2023-11-30T17:25:21.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.338+0000 7f5bcb7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5bcc0aa1c0 0x7f5bcc0aa600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:21.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.338+0000 7f5bcb7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5bcc0aa1c0 0x7f5bcc0aa600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33328/0 (socket says 172.21.15.49:33328) 2023-11-30T17:25:21.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.338+0000 7f5bcb7fe700 1 -- 172.21.15.49:0/3782907367 learned_addr learned my addr 172.21.15.49:0/3782907367 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:21.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.338+0000 7f5bca7fc700 1 --2- 172.21.15.49:0/3782907367 >> v2:172.21.15.115:3300/0 conn(0x7f5bcc0ab3b0 0x7f5bcc1582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:21.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.338+0000 7f5bcb7fe700 1 -- 172.21.15.49:0/3782907367 >> v2:172.21.15.115:3300/0 conn(0x7f5bcc0ab3b0 msgr2=0x7f5bcc1582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:25:21.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.338+0000 7f5bcb7fe700 1 --2- 172.21.15.49:0/3782907367 >> v2:172.21.15.115:3300/0 conn(0x7f5bcc0ab3b0 0x7f5bcc1582e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:21.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.338+0000 7f5bcb7fe700 1 -- 172.21.15.49:0/3782907367 >> v1:172.21.15.49:6789/0 conn(0x7f5bcc154610 legacy=0x7f5bcc0c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:21.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.338+0000 7f5bcb7fe700 1 -- 172.21.15.49:0/3782907367 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bcc0aaaf0 con 0x7f5bcc0aa1c0 2023-11-30T17:25:21.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.338+0000 7f5bcb7fe700 1 --2- 172.21.15.49:0/3782907367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bcc0aa1c0 0x7f5bcc0aa600 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f5bcc0c5770 tx=0x7f5bbc0090f0).ready entity=mon.0 client_cookie=ac8b7f26c26632ce server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:21.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.338+0000 7f5bc9ffb700 1 -- 172.21.15.49:0/3782907367 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc00b600 con 0x7f5bcc0aa1c0 2023-11-30T17:25:21.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.338+0000 7f5bc9ffb700 1 -- 172.21.15.49:0/3782907367 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bbc00b760 con 0x7f5bcc0aa1c0 2023-11-30T17:25:21.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.338+0000 7f5bc9ffb700 1 -- 172.21.15.49:0/3782907367 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc00bae0 con 0x7f5bcc0aa1c0 2023-11-30T17:25:21.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.339+0000 7f5bd12ec700 1 -- 172.21.15.49:0/3782907367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bcc0aa1c0 msgr2=0x7f5bcc0aa600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:21.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.339+0000 7f5bd12ec700 1 --2- 172.21.15.49:0/3782907367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bcc0aa1c0 0x7f5bcc0aa600 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f5bcc0c5770 tx=0x7f5bbc0090f0).stop 2023-11-30T17:25:21.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.339+0000 7f5bd12ec700 1 -- 172.21.15.49:0/3782907367 shutdown_connections 2023-11-30T17:25:21.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.339+0000 7f5bd12ec700 1 --2- 172.21.15.49:0/3782907367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bcc0aa1c0 0x7f5bcc0aa600 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:21.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.339+0000 7f5bd12ec700 1 --2- 172.21.15.49:0/3782907367 >> v2:172.21.15.115:3300/0 conn(0x7f5bcc0ab3b0 0x7f5bcc1582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:21.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.339+0000 7f5bd12ec700 1 -- 172.21.15.49:0/3782907367 >> 172.21.15.49:0/3782907367 conn(0x7f5bcc0655a0 msgr2=0x7f5bcc069e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:21.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.339+0000 7f5bd12ec700 1 -- 172.21.15.49:0/3782907367 shutdown_connections 2023-11-30T17:25:21.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.339+0000 7f5bd12ec700 1 -- 172.21.15.49:0/3782907367 wait complete. 2023-11-30T17:25:21.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.340+0000 7f5bd12ec700 1 Processor -- start 2023-11-30T17:25:21.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.340+0000 7f5bd12ec700 1 -- start start 2023-11-30T17:25:21.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.341+0000 7f5bd12ec700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5bcc0aa1c0 0x7f5bcc0acd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:21.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.341+0000 7f5bd12ec700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bcc154610 0x7f5bcc0ad230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:21.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.341+0000 7f5bd12ec700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bcc0c2300 0x7f5bcc0abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:21.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.341+0000 7f5bd12ec700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc156410 con 0x7f5bcc154610 2023-11-30T17:25:21.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.341+0000 7f5bd12ec700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc0ad720 con 0x7f5bcc0aa1c0 2023-11-30T17:25:21.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.341+0000 7f5bd12ec700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc155800 con 0x7f5bcc0c2300 2023-11-30T17:25:21.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.341+0000 7f5bca7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bcc154610 0x7f5bcc0ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:21.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.341+0000 7f5bca7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bcc154610 0x7f5bcc0ad230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33344/0 (socket says 172.21.15.49:33344) 2023-11-30T17:25:21.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.341+0000 7f5bca7fc700 1 -- 172.21.15.49:0/2834563710 learned_addr learned my addr 172.21.15.49:0/2834563710 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:25:21.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.341+0000 7f5bcaffd700 1 --2- 172.21.15.49:0/2834563710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5bcc0aa1c0 0x7f5bcc0acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:21.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.341+0000 7f5bcb7fe700 1 --2- 172.21.15.49:0/2834563710 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bcc0c2300 0x7f5bcc0abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:21.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.341+0000 7f5bca7fc700 1 -- 172.21.15.49:0/2834563710 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bcc0c2300 msgr2=0x7f5bcc0abcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:21.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.341+0000 7f5bca7fc700 1 --2- 172.21.15.49:0/2834563710 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bcc0c2300 0x7f5bcc0abcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:21.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.341+0000 7f5bca7fc700 1 -- 172.21.15.49:0/2834563710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5bcc0aa1c0 msgr2=0x7f5bcc0acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:21.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.341+0000 7f5bca7fc700 1 --2- 172.21.15.49:0/2834563710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5bcc0aa1c0 0x7f5bcc0acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:21.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.341+0000 7f5bca7fc700 1 -- 172.21.15.49:0/2834563710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bbc009370 con 0x7f5bcc154610 2023-11-30T17:25:21.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.341+0000 7f5bca7fc700 1 --2- 172.21.15.49:0/2834563710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bcc154610 0x7f5bcc0ad230 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f5bb400c8b0 tx=0x7f5bb4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:21.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.342+0000 7f5bc2ffd700 1 -- 172.21.15.49:0/2834563710 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4010580 con 0x7f5bcc154610 2023-11-30T17:25:21.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.342+0000 7f5bc2ffd700 1 -- 172.21.15.49:0/2834563710 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb40106e0 con 0x7f5bcc154610 2023-11-30T17:25:21.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.342+0000 7f5bc2ffd700 1 -- 172.21.15.49:0/2834563710 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4010a60 con 0x7f5bcc154610 2023-11-30T17:25:21.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.342+0000 7f5bd12ec700 1 -- 172.21.15.49:0/2834563710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bcc155ae0 con 0x7f5bcc154610 2023-11-30T17:25:21.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.342+0000 7f5bd12ec700 1 -- 172.21.15.49:0/2834563710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bcc1560a0 con 0x7f5bcc154610 2023-11-30T17:25:21.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.343+0000 7f5bd12ec700 1 -- 172.21.15.49:0/2834563710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bcc1565a0 con 0x7f5bcc154610 2023-11-30T17:25:21.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.343+0000 7f5bc2ffd700 1 -- 172.21.15.49:0/2834563710 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 52) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f5bb401b460 con 0x7f5bcc154610 2023-11-30T17:25:21.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.343+0000 7f5bc2ffd700 1 --2- 172.21.15.49:0/2834563710 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5bac05f080 0x7f5bac061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:25:21.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.343+0000 7f5bc2ffd700 1 -- 172.21.15.49:0/2834563710 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6407+0+0 (secure 0 0 0) 0x7f5bb4079fd0 con 0x7f5bcc154610 2023-11-30T17:25:21.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.344+0000 7f5bcaffd700 1 --2- 172.21.15.49:0/2834563710 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5bac05f080 0x7f5bac061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:25:21.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.344+0000 7f5bcaffd700 1 --2- 172.21.15.49:0/2834563710 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5bac05f080 0x7f5bac061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f5bc4004290 tx=0x7f5bc40014c0).ready entity=mgr.7549 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:25:21.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.348+0000 7f5bc2ffd700 1 -- 172.21.15.49:0/2834563710 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5bb404b2f0 con 0x7f5bcc154610 2023-11-30T17:25:21.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.546+0000 7f5bd12ec700 1 -- 172.21.15.49:0/2834563710 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5bcc06c860 con 0x7f5bac05f080 2023-11-30T17:25:21.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.550+0000 7f5bc2ffd700 1 -- 172.21.15.49:0/2834563710 <== mgr.7549 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+66 (secure 0 0 0) 0x7f5bcc06c860 con 0x7f5bac05f080 2023-11-30T17:25:21.551 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:25:21.552 INFO:teuthology.orchestra.run.smithi049.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-11-30T17:25:21.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.551+0000 7f5bd12ec700 1 -- 172.21.15.49:0/2834563710 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5bac05f080 msgr2=0x7f5bac061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:21.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.551+0000 7f5bd12ec700 1 --2- 172.21.15.49:0/2834563710 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5bac05f080 0x7f5bac061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f5bc4004290 tx=0x7f5bc40014c0).stop 2023-11-30T17:25:21.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.551+0000 7f5bd12ec700 1 -- 172.21.15.49:0/2834563710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bcc154610 msgr2=0x7f5bcc0ad230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:25:21.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.551+0000 7f5bd12ec700 1 --2- 172.21.15.49:0/2834563710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bcc154610 0x7f5bcc0ad230 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f5bb400c8b0 tx=0x7f5bb4008040).stop 2023-11-30T17:25:21.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.551+0000 7f5bd12ec700 1 -- 172.21.15.49:0/2834563710 shutdown_connections 2023-11-30T17:25:21.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.551+0000 7f5bd12ec700 1 --2- 172.21.15.49:0/2834563710 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bcc0c2300 0x7f5bcc0abcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:21.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.551+0000 7f5bd12ec700 1 --2- 172.21.15.49:0/2834563710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5bcc0aa1c0 0x7f5bcc0acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:21.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.551+0000 7f5bd12ec700 1 --2- 172.21.15.49:0/2834563710 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5bac05f080 0x7f5bac061540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:21.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.551+0000 7f5bd12ec700 1 --2- 172.21.15.49:0/2834563710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bcc154610 0x7f5bcc0ad230 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:25:21.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.551+0000 7f5bd12ec700 1 -- 172.21.15.49:0/2834563710 >> 172.21.15.49:0/2834563710 conn(0x7f5bcc0655a0 msgr2=0x7f5bcc0ca270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:25:21.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.551+0000 7f5bd12ec700 1 -- 172.21.15.49:0/2834563710 shutdown_connections 2023-11-30T17:25:21.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:25:21.551+0000 7f5bd12ec700 1 -- 172.21.15.49:0/2834563710 wait complete. 2023-11-30T17:25:21.566 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-11-30T17:25:21.566 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{}]} 2023-11-30T17:25:21.566 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:21.566 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:21.947 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:25:21.949 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:25:22.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:22.583 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:23.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:23.603 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:24.624 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:24.624 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:25.644 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:25.644 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:26.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:26.664 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:27.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:27.685 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:28.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:28.706 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:29.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:29.729 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:30.749 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:30.749 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:31.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:31.770 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:32.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:32.792 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:33.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:33.812 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:34.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:34.833 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:35.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:35.854 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:36.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:36.874 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:37.895 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:37.895 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:38.915 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:38.915 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:39.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:39.937 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:40.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:40.958 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:41.978 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:41.978 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:42.999 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:42.999 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:44.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:44.021 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:45.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:45.041 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:46.062 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:46.062 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:47.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:47.083 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:48.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:48.104 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:49.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:49.125 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:50.146 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:50.146 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:51.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:51.167 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:52.092 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:25:52.095 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:25:52.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:52.188 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:53.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:53.208 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:54.229 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:54.230 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:55.250 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:55.250 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:56.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:56.271 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:57.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:57.292 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:58.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:58.313 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:25:59.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:25:59.335 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:26:00.200 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:00.197+0000 7f6fa16da700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:26:00.200 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:00.197+0000 7f6fa16da700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:26:00.200 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:00.197+0000 7f6fa16da700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:26:00.200 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:00.197+0000 7f6fa16da700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:26:00.200 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:00.197+0000 7f6fa16da700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:26:00.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:26:00.356 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:26:00.376 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_26_00_UTC 2023-11-30T17:26:00.376 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-11-30-17_26_00_UTC'] 2023-11-30T17:26:00.376 DEBUG:tasks.cephfs.test_snap_schedules:exec=1701365121.2125967, now = 1701365160.3765082, timo = 39 2023-11-30T17:26:01.377 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-11-30T17:26:01.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.511+0000 7f7bd1b11700 1 Processor -- start 2023-11-30T17:26:01.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.511+0000 7f7bd1b11700 1 -- start start 2023-11-30T17:26:01.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.512+0000 7f7bd1b11700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7bcc154910 0x7f7bcc0a7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:01.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.512+0000 7f7bd1b11700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bcc0aa220 0x7f7bcc0aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:01.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.512+0000 7f7bd1b11700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bcc0c6630 con 0x7f7bcc154530 2023-11-30T17:26:01.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.512+0000 7f7bd1b11700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bcc0c6390 con 0x7f7bcc154910 2023-11-30T17:26:01.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.512+0000 7f7bd1b11700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc0a84e0 con 0x7f7bcc0aa220 2023-11-30T17:26:01.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.512+0000 7f7bcb7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7bcc154530 0x7f7bcc0c8580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55836/0 (socket says 172.21.15.49:55836) 2023-11-30T17:26:01.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.512+0000 7f7bcb7fe700 1 -- 172.21.15.49:0/2903228063 learned_addr learned my addr 172.21.15.49:0/2903228063 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:01.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.513+0000 7f7bc2ffd700 1 --2- 172.21.15.49:0/2903228063 >> v2:172.21.15.115:3300/0 conn(0x7f7bcc154910 0x7f7bcc0a7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:01.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.513+0000 7f7bcbfff700 1 --2- 172.21.15.49:0/2903228063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bcc0aa220 0x7f7bcc0aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:01.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.513+0000 7f7bcaffd700 1 -- 172.21.15.49:0/2903228063 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672282593 0 0) 0x7f7bcc0c6630 con 0x7f7bcc154530 2023-11-30T17:26:01.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.513+0000 7f7bcaffd700 1 -- 172.21.15.49:0/2903228063 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bb80033f0 con 0x7f7bcc154530 2023-11-30T17:26:01.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.513+0000 7f7bcaffd700 1 -- 172.21.15.49:0/2903228063 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 833153283 0 0) 0x7f7bb80033f0 con 0x7f7bcc154530 2023-11-30T17:26:01.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.513+0000 7f7bcaffd700 1 -- 172.21.15.49:0/2903228063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bcc0aa220 msgr2=0x7f7bcc0aa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:01.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.513+0000 7f7bcaffd700 1 --2- 172.21.15.49:0/2903228063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bcc0aa220 0x7f7bcc0aa6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:01.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.513+0000 7f7bcaffd700 1 -- 172.21.15.49:0/2903228063 >> v2:172.21.15.115:3300/0 conn(0x7f7bcc154910 msgr2=0x7f7bcc0a7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:01.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.513+0000 7f7bcaffd700 1 --2- 172.21.15.49:0/2903228063 >> v2:172.21.15.115:3300/0 conn(0x7f7bcc154910 0x7f7bcc0a7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:01.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.513+0000 7f7bcaffd700 1 -- 172.21.15.49:0/2903228063 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bcc0aaba0 con 0x7f7bcc154530 2023-11-30T17:26:01.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.513+0000 7f7bcaffd700 1 -- 172.21.15.49:0/2903228063 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f7bbc0015f0 con 0x7f7bcc154530 2023-11-30T17:26:01.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.513+0000 7f7bcaffd700 1 -- 172.21.15.49:0/2903228063 >> v1:172.21.15.49:6789/0 conn(0x7f7bcc154530 legacy=0x7f7bcc0c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:01.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.513+0000 7f7bcaffd700 1 --2- 172.21.15.49:0/2903228063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bcc0aa220 0x7f7bb80038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:01.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.513+0000 7f7bcaffd700 1 --2- 172.21.15.49:0/2903228063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bb8003e10 0x7f7bb8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:01.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.513+0000 7f7bcaffd700 1 --2- 172.21.15.49:0/2903228063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bb8004b80 0x7f7bb8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:01.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.513+0000 7f7bcaffd700 1 -- 172.21.15.49:0/2903228063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc0c6390 con 0x7f7bb8003e10 2023-11-30T17:26:01.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.513+0000 7f7bcaffd700 1 -- 172.21.15.49:0/2903228063 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc0a84e0 con 0x7f7bb8004b80 2023-11-30T17:26:01.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.513+0000 7f7bcaffd700 1 -- 172.21.15.49:0/2903228063 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb800b8e0 con 0x7f7bcc0aa220 2023-11-30T17:26:01.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.513+0000 7f7bc2ffd700 1 --2- 172.21.15.49:0/2903228063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bb8003e10 0x7f7bb8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:01.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.513+0000 7f7bcb7fe700 1 --2- 172.21.15.49:0/2903228063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bcc0aa220 0x7f7bb80038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:01.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.513+0000 7f7bcbfff700 1 --2- 172.21.15.49:0/2903228063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bb8004b80 0x7f7bb8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:01.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.514+0000 7f7bc2ffd700 1 -- 172.21.15.49:0/2903228063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bcc0aa220 msgr2=0x7f7bb80038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:01.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.514+0000 7f7bc2ffd700 1 --2- 172.21.15.49:0/2903228063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bcc0aa220 0x7f7bb80038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:01.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.514+0000 7f7bc2ffd700 1 -- 172.21.15.49:0/2903228063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bb8004b80 msgr2=0x7f7bb8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:01.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.514+0000 7f7bc2ffd700 1 --2- 172.21.15.49:0/2903228063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bb8004b80 0x7f7bb8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:01.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.514+0000 7f7bc2ffd700 1 -- 172.21.15.49:0/2903228063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb80033f0 con 0x7f7bb8003e10 2023-11-30T17:26:01.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.514+0000 7f7bc2ffd700 1 --2- 172.21.15.49:0/2903228063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bb8003e10 0x7f7bb8004690 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f7bb4009ab0 tx=0x7f7bb4009060).ready entity=mon.0 client_cookie=b35b01b9ea3372ee server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:01.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.514+0000 7f7bcaffd700 1 -- 172.21.15.49:0/2903228063 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb4009430 con 0x7f7bb8003e10 2023-11-30T17:26:01.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.514+0000 7f7bcaffd700 1 -- 172.21.15.49:0/2903228063 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb400e640 con 0x7f7bb8003e10 2023-11-30T17:26:01.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.514+0000 7f7bcaffd700 1 -- 172.21.15.49:0/2903228063 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb400e9c0 con 0x7f7bb8003e10 2023-11-30T17:26:01.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.514+0000 7f7bd1b11700 1 -- 172.21.15.49:0/2903228063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bb8003e10 msgr2=0x7f7bb8004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:01.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.514+0000 7f7bd1b11700 1 --2- 172.21.15.49:0/2903228063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bb8003e10 0x7f7bb8004690 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f7bb4009ab0 tx=0x7f7bb4009060).stop 2023-11-30T17:26:01.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.514+0000 7f7bcbfff700 1 -- 172.21.15.49:0/2903228063 reap_dead start 2023-11-30T17:26:01.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.514+0000 7f7bd1b11700 1 -- 172.21.15.49:0/2903228063 shutdown_connections 2023-11-30T17:26:01.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.514+0000 7f7bd1b11700 1 -- 172.21.15.49:0/2903228063 >> 172.21.15.49:0/2903228063 conn(0x7f7bcc094930 msgr2=0x7f7bcc06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:01.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.514+0000 7f7bd1b11700 1 -- 172.21.15.49:0/2903228063 shutdown_connections 2023-11-30T17:26:01.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.514+0000 7f7bd1b11700 1 -- 172.21.15.49:0/2903228063 wait complete. 2023-11-30T17:26:01.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.515+0000 7f7bd1b11700 1 Processor -- start 2023-11-30T17:26:01.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.516+0000 7f7bd1b11700 1 -- start start 2023-11-30T17:26:01.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.516+0000 7f7bd1b11700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bb8003e10 0x7f7bcc150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:01.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.516+0000 7f7bd1b11700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bcc0c3c00 0x7f7bcc165060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:01.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.516+0000 7f7bd1b11700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bcc165550 0x7f7bcc0c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:01.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.516+0000 7f7bd1b11700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc164880 con 0x7f7bcc165550 2023-11-30T17:26:01.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.516+0000 7f7bd1b11700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc0ac3c0 con 0x7f7bb8003e10 2023-11-30T17:26:01.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.516+0000 7f7bd1b11700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc0ac6a0 con 0x7f7bcc0c3c00 2023-11-30T17:26:01.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.517+0000 7f7bcbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bcc165550 0x7f7bcc0c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:01.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.517+0000 7f7bcbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bcc165550 0x7f7bcc0c6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50136/0 (socket says 172.21.15.49:50136) 2023-11-30T17:26:01.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.517+0000 7f7bcbfff700 1 -- 172.21.15.49:0/2990852036 learned_addr learned my addr 172.21.15.49:0/2990852036 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:01.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.517+0000 7f7bcb7fe700 1 --2- 172.21.15.49:0/2990852036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bb8003e10 0x7f7bcc150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:01.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.517+0000 7f7bc2ffd700 1 --2- 172.21.15.49:0/2990852036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bcc0c3c00 0x7f7bcc165060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:01.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.517+0000 7f7bcbfff700 1 -- 172.21.15.49:0/2990852036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bcc0c3c00 msgr2=0x7f7bcc165060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:01.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.517+0000 7f7bcbfff700 1 --2- 172.21.15.49:0/2990852036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bcc0c3c00 0x7f7bcc165060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:01.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.517+0000 7f7bcbfff700 1 -- 172.21.15.49:0/2990852036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bb8003e10 msgr2=0x7f7bcc150b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:01.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.517+0000 7f7bcbfff700 1 --2- 172.21.15.49:0/2990852036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bb8003e10 0x7f7bcc150b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:01.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.517+0000 7f7bcbfff700 1 -- 172.21.15.49:0/2990852036 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bcc0ac980 con 0x7f7bcc165550 2023-11-30T17:26:01.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.517+0000 7f7bcbfff700 1 --2- 172.21.15.49:0/2990852036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bcc165550 0x7f7bcc0c6f20 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7f7bcc062a80 tx=0x7f7bc400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:01.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.517+0000 7f7bc3fff700 1 -- 172.21.15.49:0/2990852036 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc400e040 con 0x7f7bcc165550 2023-11-30T17:26:01.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.517+0000 7f7bc3fff700 1 -- 172.21.15.49:0/2990852036 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc400f040 con 0x7f7bcc165550 2023-11-30T17:26:01.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.517+0000 7f7bd1b11700 1 -- 172.21.15.49:0/2990852036 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bcc164b40 con 0x7f7bcc165550 2023-11-30T17:26:01.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.517+0000 7f7bc3fff700 1 -- 172.21.15.49:0/2990852036 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc400fd70 con 0x7f7bcc165550 2023-11-30T17:26:01.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.517+0000 7f7bd1b11700 1 -- 172.21.15.49:0/2990852036 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bcc0c4080 con 0x7f7bcc165550 2023-11-30T17:26:01.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.518+0000 7f7bd1b11700 1 -- 172.21.15.49:0/2990852036 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bcc0c4360 con 0x7f7bcc165550 2023-11-30T17:26:01.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.519+0000 7f7bc3fff700 1 -- 172.21.15.49:0/2990852036 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 54) v1 ==== 75679+0+0 (secure 0 0 0) 0x7f7bc4015660 con 0x7f7bcc165550 2023-11-30T17:26:01.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.519+0000 7f7bc3fff700 1 --2- 172.21.15.49:0/2990852036 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7bac05f3e0 0x7f7bac0618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:01.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.519+0000 7f7bc3fff700 1 -- 172.21.15.49:0/2990852036 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6407+0+0 (secure 0 0 0) 0x7f7bc407b180 con 0x7f7bcc165550 2023-11-30T17:26:01.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.519+0000 7f7bcb7fe700 1 --2- 172.21.15.49:0/2990852036 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7bac05f3e0 0x7f7bac0618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:01.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.520+0000 7f7bcb7fe700 1 --2- 172.21.15.49:0/2990852036 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7bac05f3e0 0x7f7bac0618a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f7bbc000ef0 tx=0x7f7bbc009040).ready entity=mgr.7549 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:01.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.523+0000 7f7bc3fff700 1 -- 172.21.15.49:0/2990852036 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7bc404bf20 con 0x7f7bcc165550 2023-11-30T17:26:01.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.721+0000 7f7bd1b11700 1 -- 172.21.15.49:0/2990852036 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f7bcc1649c0 con 0x7f7bac05f3e0 2023-11-30T17:26:01.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.725+0000 7f7bc3fff700 1 -- 172.21.15.49:0/2990852036 <== mgr.7549 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f7bbc012780 con 0x7f7bac05f3e0 2023-11-30T17:26:01.727 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule removed for path snap_test_dir1 2023-11-30T17:26:01.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.728+0000 7f7bd1b11700 1 -- 172.21.15.49:0/2990852036 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7bac05f3e0 msgr2=0x7f7bac0618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:01.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.728+0000 7f7bd1b11700 1 --2- 172.21.15.49:0/2990852036 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7bac05f3e0 0x7f7bac0618a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f7bbc000ef0 tx=0x7f7bbc009040).stop 2023-11-30T17:26:01.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.728+0000 7f7bd1b11700 1 -- 172.21.15.49:0/2990852036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bcc165550 msgr2=0x7f7bcc0c6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:01.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.728+0000 7f7bd1b11700 1 --2- 172.21.15.49:0/2990852036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bcc165550 0x7f7bcc0c6f20 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7f7bcc062a80 tx=0x7f7bc400b040).stop 2023-11-30T17:26:01.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.728+0000 7f7bd1b11700 1 -- 172.21.15.49:0/2990852036 shutdown_connections 2023-11-30T17:26:01.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.728+0000 7f7bd1b11700 1 --2- 172.21.15.49:0/2990852036 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7bac05f3e0 0x7f7bac0618a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:01.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.728+0000 7f7bd1b11700 1 --2- 172.21.15.49:0/2990852036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bcc165550 0x7f7bcc0c6f20 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:01.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.728+0000 7f7bd1b11700 1 --2- 172.21.15.49:0/2990852036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bb8003e10 0x7f7bcc150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:01.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.728+0000 7f7bd1b11700 1 --2- 172.21.15.49:0/2990852036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7bcc0c3c00 0x7f7bcc165060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:01.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.728+0000 7f7bd1b11700 1 -- 172.21.15.49:0/2990852036 >> 172.21.15.49:0/2990852036 conn(0x7f7bcc094930 msgr2=0x7f7bcc1532b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:01.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.728+0000 7f7bd1b11700 1 -- 172.21.15.49:0/2990852036 shutdown_connections 2023-11-30T17:26:01.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:01.728+0000 7f7bd1b11700 1 -- 172.21.15.49:0/2990852036 wait complete. 2023-11-30T17:26:01.741 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-11-30T17:26:01.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:26:01.741 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T17:26:01.757 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_26_00_UTC 2023-11-30T17:26:01.758 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_26_00_UTC 2023-11-30T17:26:01.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:26:01.758 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_26_00_UTC) 2023-11-30T17:26:01.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:26:01.819 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-11-30T17:26:01.878 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-11-30T17:26:02.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.039+0000 7f9d29d57700 1 Processor -- start 2023-11-30T17:26:02.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.039+0000 7f9d29d57700 1 -- start start 2023-11-30T17:26:02.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.039+0000 7f9d29d57700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d240c6190 0x7f9d240c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:02.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.040+0000 7f9d29d57700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d240c72d0 con 0x7f9d24158320 2023-11-30T17:26:02.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.040+0000 7f9d29d57700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d24064570 con 0x7f9d24098d10 2023-11-30T17:26:02.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.040+0000 7f9d29d57700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d24154bc0 con 0x7f9d240c6190 2023-11-30T17:26:02.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.040+0000 7f9d23fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9d24158320 0x7f9d240a80f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55846/0 (socket says 172.21.15.49:55846) 2023-11-30T17:26:02.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.040+0000 7f9d23fff700 1 -- 172.21.15.49:0/2314002137 learned_addr learned my addr 172.21.15.49:0/2314002137 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:02.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.040+0000 7f9d22ffd700 1 --2- 172.21.15.49:0/2314002137 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d240c6190 0x7f9d240c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:02.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.040+0000 7f9d227fc700 1 -- 172.21.15.49:0/2314002137 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4191454585 0 0) 0x7f9d240c72d0 con 0x7f9d24158320 2023-11-30T17:26:02.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.040+0000 7f9d227fc700 1 -- 172.21.15.49:0/2314002137 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d0c0033f0 con 0x7f9d24158320 2023-11-30T17:26:02.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.040+0000 7f9d227fc700 1 -- 172.21.15.49:0/2314002137 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 551213148 0 0) 0x7f9d24064570 con 0x7f9d24098d10 2023-11-30T17:26:02.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.040+0000 7f9d227fc700 1 -- 172.21.15.49:0/2314002137 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d240c72d0 con 0x7f9d24098d10 2023-11-30T17:26:02.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.040+0000 7f9d227fc700 1 -- 172.21.15.49:0/2314002137 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 123570239 0 0) 0x7f9d0c0033f0 con 0x7f9d24158320 2023-11-30T17:26:02.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.040+0000 7f9d227fc700 1 -- 172.21.15.49:0/2314002137 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d240c6190 msgr2=0x7f9d240c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:02.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.040+0000 7f9d227fc700 1 --2- 172.21.15.49:0/2314002137 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d240c6190 0x7f9d240c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:02.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.040+0000 7f9d227fc700 1 -- 172.21.15.49:0/2314002137 >> v1:172.21.15.115:6789/0 conn(0x7f9d24098d10 legacy=0x7f9d24063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:02.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.040+0000 7f9d227fc700 1 -- 172.21.15.49:0/2314002137 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d240c66c0 con 0x7f9d24158320 2023-11-30T17:26:02.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.040+0000 7f9d227fc700 1 -- 172.21.15.49:0/2314002137 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f9d1c0017f0 con 0x7f9d24158320 2023-11-30T17:26:02.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.040+0000 7f9d227fc700 1 -- 172.21.15.49:0/2314002137 >> v1:172.21.15.49:6789/0 conn(0x7f9d24158320 legacy=0x7f9d240a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:02.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.040+0000 7f9d227fc700 1 --2- 172.21.15.49:0/2314002137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d0c003aa0 0x7f9d0c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:02.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.040+0000 7f9d227fc700 1 --2- 172.21.15.49:0/2314002137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d0c004690 0x7f9d0c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:02.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.040+0000 7f9d227fc700 1 --2- 172.21.15.49:0/2314002137 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d240c6190 0x7f9d0c005020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:02.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.040+0000 7f9d227fc700 1 -- 172.21.15.49:0/2314002137 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d24154bc0 con 0x7f9d0c004690 2023-11-30T17:26:02.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.040+0000 7f9d227fc700 1 -- 172.21.15.49:0/2314002137 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c00b990 con 0x7f9d0c003aa0 2023-11-30T17:26:02.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.040+0000 7f9d227fc700 1 -- 172.21.15.49:0/2314002137 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c00bb20 con 0x7f9d240c6190 2023-11-30T17:26:02.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.040+0000 7f9d22ffd700 1 --2- 172.21.15.49:0/2314002137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d0c004690 0x7f9d0c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:02.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.041+0000 7f9d237fe700 1 --2- 172.21.15.49:0/2314002137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d0c003aa0 0x7f9d0c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:02.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.041+0000 7f9d23fff700 1 --2- 172.21.15.49:0/2314002137 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d240c6190 0x7f9d0c005020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:02.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.041+0000 7f9d22ffd700 1 -- 172.21.15.49:0/2314002137 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d240c6190 msgr2=0x7f9d0c005020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:02.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.041+0000 7f9d22ffd700 1 --2- 172.21.15.49:0/2314002137 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d240c6190 0x7f9d0c005020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:02.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.041+0000 7f9d22ffd700 1 -- 172.21.15.49:0/2314002137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d0c003aa0 msgr2=0x7f9d0c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:02.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.041+0000 7f9d22ffd700 1 --2- 172.21.15.49:0/2314002137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d0c003aa0 0x7f9d0c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:02.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.041+0000 7f9d22ffd700 1 -- 172.21.15.49:0/2314002137 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0c0033f0 con 0x7f9d0c004690 2023-11-30T17:26:02.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.041+0000 7f9d22ffd700 1 --2- 172.21.15.49:0/2314002137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d0c004690 0x7f9d0c004b10 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7f9d18009a80 tx=0x7f9d18009060).ready entity=mon.0 client_cookie=2f5d87470d432368 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:02.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.041+0000 7f9d227fc700 1 -- 172.21.15.49:0/2314002137 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d18009430 con 0x7f9d0c004690 2023-11-30T17:26:02.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.041+0000 7f9d227fc700 1 -- 172.21.15.49:0/2314002137 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1800e640 con 0x7f9d0c004690 2023-11-30T17:26:02.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.041+0000 7f9d227fc700 1 -- 172.21.15.49:0/2314002137 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1800e9c0 con 0x7f9d0c004690 2023-11-30T17:26:02.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.042+0000 7f9d29d57700 1 -- 172.21.15.49:0/2314002137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d0c004690 msgr2=0x7f9d0c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:02.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.042+0000 7f9d29d57700 1 --2- 172.21.15.49:0/2314002137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d0c004690 0x7f9d0c004b10 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7f9d18009a80 tx=0x7f9d18009060).stop 2023-11-30T17:26:02.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.042+0000 7f9d23fff700 1 -- 172.21.15.49:0/2314002137 reap_dead start 2023-11-30T17:26:02.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.042+0000 7f9d29d57700 1 -- 172.21.15.49:0/2314002137 shutdown_connections 2023-11-30T17:26:02.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.042+0000 7f9d29d57700 1 -- 172.21.15.49:0/2314002137 >> 172.21.15.49:0/2314002137 conn(0x7f9d240cb310 msgr2=0x7f9d240cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:02.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.042+0000 7f9d29d57700 1 -- 172.21.15.49:0/2314002137 shutdown_connections 2023-11-30T17:26:02.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.042+0000 7f9d29d57700 1 -- 172.21.15.49:0/2314002137 wait complete. 2023-11-30T17:26:02.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.043+0000 7f9d29d57700 1 Processor -- start 2023-11-30T17:26:02.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.043+0000 7f9d29d57700 1 -- start start 2023-11-30T17:26:02.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.044+0000 7f9d29d57700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d0c004690 0x7f9d24157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:02.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.044+0000 7f9d29d57700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d24157780 0x7f9d240aad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:02.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.044+0000 7f9d29d57700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d240ab260 0x7f9d2414bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:02.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.044+0000 7f9d29d57700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2414c810 con 0x7f9d24157780 2023-11-30T17:26:02.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.044+0000 7f9d29d57700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d240ac090 con 0x7f9d240ab260 2023-11-30T17:26:02.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.044+0000 7f9d29d57700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d240ac650 con 0x7f9d0c004690 2023-11-30T17:26:02.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.044+0000 7f9d22ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d24157780 0x7f9d240aad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:02.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.044+0000 7f9d22ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d24157780 0x7f9d240aad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50148/0 (socket says 172.21.15.49:50148) 2023-11-30T17:26:02.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.044+0000 7f9d22ffd700 1 -- 172.21.15.49:0/1523437588 learned_addr learned my addr 172.21.15.49:0/1523437588 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:02.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.044+0000 7f9d23fff700 1 --2- 172.21.15.49:0/1523437588 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d240ab260 0x7f9d2414bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:02.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.044+0000 7f9d237fe700 1 --2- 172.21.15.49:0/1523437588 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d0c004690 0x7f9d24157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:02.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.044+0000 7f9d22ffd700 1 -- 172.21.15.49:0/1523437588 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d0c004690 msgr2=0x7f9d24157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:02.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.044+0000 7f9d22ffd700 1 --2- 172.21.15.49:0/1523437588 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d0c004690 0x7f9d24157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:02.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.044+0000 7f9d22ffd700 1 -- 172.21.15.49:0/1523437588 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d240ab260 msgr2=0x7f9d2414bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:02.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.044+0000 7f9d22ffd700 1 --2- 172.21.15.49:0/1523437588 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d240ab260 0x7f9d2414bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:02.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.044+0000 7f9d22ffd700 1 -- 172.21.15.49:0/1523437588 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d240ca500 con 0x7f9d24157780 2023-11-30T17:26:02.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.044+0000 7f9d23fff700 1 --2- 172.21.15.49:0/1523437588 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d240ab260 0x7f9d2414bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:26:02.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.044+0000 7f9d237fe700 1 --2- 172.21.15.49:0/1523437588 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d0c004690 0x7f9d24157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:26:02.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.044+0000 7f9d22ffd700 1 --2- 172.21.15.49:0/1523437588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d24157780 0x7f9d240aad70 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7f9d1800e4b0 tx=0x7f9d1801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:02.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.044+0000 7f9d0b7fe700 1 -- 172.21.15.49:0/1523437588 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1800ed30 con 0x7f9d24157780 2023-11-30T17:26:02.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.045+0000 7f9d0b7fe700 1 -- 172.21.15.49:0/1523437588 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1800ee90 con 0x7f9d24157780 2023-11-30T17:26:02.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.045+0000 7f9d29d57700 1 -- 172.21.15.49:0/1523437588 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d240ab6a0 con 0x7f9d24157780 2023-11-30T17:26:02.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.045+0000 7f9d0b7fe700 1 -- 172.21.15.49:0/1523437588 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d18026440 con 0x7f9d24157780 2023-11-30T17:26:02.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.045+0000 7f9d29d57700 1 -- 172.21.15.49:0/1523437588 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d240abc30 con 0x7f9d24157780 2023-11-30T17:26:02.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.046+0000 7f9d29d57700 1 -- 172.21.15.49:0/1523437588 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d2406c860 con 0x7f9d24157780 2023-11-30T17:26:02.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.046+0000 7f9d0b7fe700 1 -- 172.21.15.49:0/1523437588 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 54) v1 ==== 75679+0+0 (secure 0 0 0) 0x7f9d1802f440 con 0x7f9d24157780 2023-11-30T17:26:02.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.046+0000 7f9d0b7fe700 1 --2- 172.21.15.49:0/1523437588 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9d1005f3e0 0x7f9d100618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:02.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.046+0000 7f9d0b7fe700 1 -- 172.21.15.49:0/1523437588 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6407+0+0 (secure 0 0 0) 0x7f9d1807c3b0 con 0x7f9d24157780 2023-11-30T17:26:02.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.047+0000 7f9d237fe700 1 --2- 172.21.15.49:0/1523437588 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9d1005f3e0 0x7f9d100618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:02.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.047+0000 7f9d237fe700 1 --2- 172.21.15.49:0/1523437588 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9d1005f3e0 0x7f9d100618a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f9d14000c00 tx=0x7f9d14009040).ready entity=mgr.7549 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:02.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.051+0000 7f9d0b7fe700 1 -- 172.21.15.49:0/1523437588 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9d1804d200 con 0x7f9d24157780 2023-11-30T17:26:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:02.271+0000 7f9d29d57700 1 -- 172.21.15.49:0/1523437588 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f9d240c69a0 con 0x7f9d24157780 2023-11-30T17:26:03.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.012+0000 7f9d0b7fe700 1 -- 172.21.15.49:0/1523437588 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 55) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f9d1807c0c0 con 0x7f9d24157780 2023-11-30T17:26:03.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.013+0000 7f9d0b7fe700 1 -- 172.21.15.49:0/1523437588 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v55) v1 ==== 93+0+0 (secure 0 0 0) 0x7f9d18043350 con 0x7f9d24157780 2023-11-30T17:26:03.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.015+0000 7f9d29d57700 1 -- 172.21.15.49:0/1523437588 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9d1005f3e0 msgr2=0x7f9d100618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:03.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.015+0000 7f9d29d57700 1 --2- 172.21.15.49:0/1523437588 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9d1005f3e0 0x7f9d100618a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f9d14000c00 tx=0x7f9d14009040).stop 2023-11-30T17:26:03.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.015+0000 7f9d29d57700 1 -- 172.21.15.49:0/1523437588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d24157780 msgr2=0x7f9d240aad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:03.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.015+0000 7f9d29d57700 1 --2- 172.21.15.49:0/1523437588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d24157780 0x7f9d240aad70 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7f9d1800e4b0 tx=0x7f9d1801a000).stop 2023-11-30T17:26:03.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.016+0000 7f9d29d57700 1 -- 172.21.15.49:0/1523437588 shutdown_connections 2023-11-30T17:26:03.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.016+0000 7f9d29d57700 1 --2- 172.21.15.49:0/1523437588 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d240ab260 0x7f9d2414bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:03.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.016+0000 7f9d29d57700 1 --2- 172.21.15.49:0/1523437588 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d0c004690 0x7f9d24157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:03.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.016+0000 7f9d29d57700 1 --2- 172.21.15.49:0/1523437588 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9d1005f3e0 0x7f9d100618a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:03.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.016+0000 7f9d29d57700 1 --2- 172.21.15.49:0/1523437588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d24157780 0x7f9d240aad70 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:03.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.016+0000 7f9d29d57700 1 -- 172.21.15.49:0/1523437588 >> 172.21.15.49:0/1523437588 conn(0x7f9d240cb310 msgr2=0x7f9d240aa070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:03.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.016+0000 7f9d29d57700 1 -- 172.21.15.49:0/1523437588 shutdown_connections 2023-11-30T17:26:03.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.016+0000 7f9d29d57700 1 -- 172.21.15.49:0/1523437588 wait complete. 2023-11-30T17:26:03.030 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-30T17:26:03.031 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T17:26:03.074 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T17:26:03.109 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-30T17:26:03.109 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-30T17:26:03.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:26:03.109 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-30T17:26:03.161 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-11-30T17:26:03.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:26:03.161 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-30T17:26:03.164 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:03.162+0000 7f3d853e9680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T17:26:03.170 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:03.169+0000 7f21503b3680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T17:26:03.178 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:26:03.227 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:03.225+0000 7f3d853e9680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T17:26:03.242 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:03.240+0000 7f21503b3680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T17:26:03.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.341+0000 7f24d38a5700 1 Processor -- start 2023-11-30T17:26:03.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.342+0000 7f24d38a5700 1 -- start start 2023-11-30T17:26:03.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.342+0000 7f24d38a5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24cc1544d0 0x7f24cc155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:03.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.342+0000 7f24d38a5700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f24cc066f40 0x7f24cc095e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:03.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.342+0000 7f24d38a5700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24cc0683d0 con 0x7f24cc0673c0 2023-11-30T17:26:03.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.342+0000 7f24d38a5700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24cc067850 con 0x7f24cc066f40 2023-11-30T17:26:03.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.342+0000 7f24d38a5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc067b30 con 0x7f24cc1544d0 2023-11-30T17:26:03.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.343+0000 7f24d0e40700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f24cc066f40 0x7f24cc095e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:03.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.343+0000 7f24d1641700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24cc1544d0 0x7f24cc155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:03.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.343+0000 7f24d1e42700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f24cc0673c0 0x7f24cc063e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:47826/0 (socket says 172.21.15.49:47826) 2023-11-30T17:26:03.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.343+0000 7f24d1e42700 1 -- 172.21.15.49:0/1312490017 learned_addr learned my addr 172.21.15.49:0/1312490017 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:03.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.343+0000 7f24c3fff700 1 -- 172.21.15.49:0/1312490017 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1078911786 0 0) 0x7f24cc0683d0 con 0x7f24cc0673c0 2023-11-30T17:26:03.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.343+0000 7f24c3fff700 1 -- 172.21.15.49:0/1312490017 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24b80033f0 con 0x7f24cc0673c0 2023-11-30T17:26:03.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.343+0000 7f24d1641700 1 -- 172.21.15.49:0/1312490017 >> v2:172.21.15.115:3300/0 conn(0x7f24cc066f40 msgr2=0x7f24cc095e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:03.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.343+0000 7f24d1641700 1 --2- 172.21.15.49:0/1312490017 >> v2:172.21.15.115:3300/0 conn(0x7f24cc066f40 0x7f24cc095e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:03.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.343+0000 7f24d1641700 1 -- 172.21.15.49:0/1312490017 >> v1:172.21.15.115:6789/0 conn(0x7f24cc0673c0 legacy=0x7f24cc063e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:03.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.343+0000 7f24d1641700 1 -- 172.21.15.49:0/1312490017 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24cc067e10 con 0x7f24cc1544d0 2023-11-30T17:26:03.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.343+0000 7f24d0e40700 1 --2- 172.21.15.49:0/1312490017 >> v2:172.21.15.115:3300/0 conn(0x7f24cc066f40 0x7f24cc095e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:26:03.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.343+0000 7f24d1641700 1 --2- 172.21.15.49:0/1312490017 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24cc1544d0 0x7f24cc155750 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f24c8006fd0 tx=0x7f24c8006f40).ready entity=mon.2 client_cookie=95763b3d347ffd22 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:03.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.343+0000 7f24c3fff700 1 -- 172.21.15.49:0/1312490017 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c8005880 con 0x7f24cc1544d0 2023-11-30T17:26:03.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.343+0000 7f24c3fff700 1 -- 172.21.15.49:0/1312490017 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c80059e0 con 0x7f24cc1544d0 2023-11-30T17:26:03.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.343+0000 7f24c3fff700 1 -- 172.21.15.49:0/1312490017 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c8005d60 con 0x7f24cc1544d0 2023-11-30T17:26:03.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.344+0000 7f24d38a5700 1 -- 172.21.15.49:0/1312490017 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24cc1544d0 msgr2=0x7f24cc155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:03.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.344+0000 7f24d38a5700 1 --2- 172.21.15.49:0/1312490017 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24cc1544d0 0x7f24cc155750 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f24c8006fd0 tx=0x7f24c8006f40).stop 2023-11-30T17:26:03.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.344+0000 7f24d38a5700 1 -- 172.21.15.49:0/1312490017 shutdown_connections 2023-11-30T17:26:03.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.344+0000 7f24d38a5700 1 --2- 172.21.15.49:0/1312490017 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24cc1544d0 0x7f24cc155750 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:03.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.344+0000 7f24d38a5700 1 --2- 172.21.15.49:0/1312490017 >> v2:172.21.15.115:3300/0 conn(0x7f24cc066f40 0x7f24cc095e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:03.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.344+0000 7f24d38a5700 1 -- 172.21.15.49:0/1312490017 >> 172.21.15.49:0/1312490017 conn(0x7f24cc0631d0 msgr2=0x7f24cc0c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:03.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.344+0000 7f24d38a5700 1 -- 172.21.15.49:0/1312490017 shutdown_connections 2023-11-30T17:26:03.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.344+0000 7f24d38a5700 1 -- 172.21.15.49:0/1312490017 wait complete. 2023-11-30T17:26:03.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.345+0000 7f24d38a5700 1 Processor -- start 2023-11-30T17:26:03.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.345+0000 7f24d38a5700 1 -- start start 2023-11-30T17:26:03.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.346+0000 7f24d38a5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24cc066f40 0x7f24cc163920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:03.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.346+0000 7f24d38a5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24cc1544d0 0x7f24cc0ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:03.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.346+0000 7f24d38a5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24cc158e70 0x7f24cc1592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:03.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.346+0000 7f24d38a5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc0a5e60 con 0x7f24cc066f40 2023-11-30T17:26:03.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.346+0000 7f24d38a5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc0a6700 con 0x7f24cc1544d0 2023-11-30T17:26:03.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.346+0000 7f24d38a5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc1597c0 con 0x7f24cc158e70 2023-11-30T17:26:03.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.346+0000 7f24d1641700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24cc066f40 0x7f24cc163920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:03.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.346+0000 7f24d1641700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24cc066f40 0x7f24cc163920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50172/0 (socket says 172.21.15.49:50172) 2023-11-30T17:26:03.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.346+0000 7f24d1641700 1 -- 172.21.15.49:0/2899490447 learned_addr learned my addr 172.21.15.49:0/2899490447 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:03.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.346+0000 7f24d0e40700 1 --2- 172.21.15.49:0/2899490447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24cc1544d0 0x7f24cc0ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:03.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.346+0000 7f24d1e42700 1 --2- 172.21.15.49:0/2899490447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24cc158e70 0x7f24cc1592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:03.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.347+0000 7f24d0e40700 1 -- 172.21.15.49:0/2899490447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24cc158e70 msgr2=0x7f24cc1592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:03.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.347+0000 7f24d0e40700 1 --2- 172.21.15.49:0/2899490447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24cc158e70 0x7f24cc1592d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:03.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.347+0000 7f24d0e40700 1 -- 172.21.15.49:0/2899490447 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24cc066f40 msgr2=0x7f24cc163920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:03.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.347+0000 7f24d0e40700 1 --2- 172.21.15.49:0/2899490447 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24cc066f40 0x7f24cc163920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:03.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.347+0000 7f24d0e40700 1 -- 172.21.15.49:0/2899490447 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24bc0092a0 con 0x7f24cc1544d0 2023-11-30T17:26:03.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.347+0000 7f24d1641700 1 --2- 172.21.15.49:0/2899490447 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24cc066f40 0x7f24cc163920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:26:03.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.347+0000 7f24d0e40700 1 --2- 172.21.15.49:0/2899490447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24cc1544d0 0x7f24cc0ae0d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f24bc00e950 tx=0x7f24bc009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:03.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.347+0000 7f24c17fa700 1 -- 172.21.15.49:0/2899490447 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc009580 con 0x7f24cc1544d0 2023-11-30T17:26:03.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.347+0000 7f24c17fa700 1 -- 172.21.15.49:0/2899490447 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24bc012600 con 0x7f24cc1544d0 2023-11-30T17:26:03.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.347+0000 7f24c17fa700 1 -- 172.21.15.49:0/2899490447 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc0129a0 con 0x7f24cc1544d0 2023-11-30T17:26:03.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.347+0000 7f24d38a5700 1 -- 172.21.15.49:0/2899490447 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c8009250 con 0x7f24cc1544d0 2023-11-30T17:26:03.353 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.347+0000 7f24d38a5700 1 -- 172.21.15.49:0/2899490447 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24cc0a60b0 con 0x7f24cc1544d0 2023-11-30T17:26:03.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.348+0000 7f24d38a5700 1 -- 172.21.15.49:0/2899490447 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24cc06c860 con 0x7f24cc1544d0 2023-11-30T17:26:03.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.348+0000 7f24c17fa700 1 -- 172.21.15.49:0/2899490447 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 55) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f24bc012d10 con 0x7f24cc1544d0 2023-11-30T17:26:03.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.349+0000 7f24c17fa700 1 --2- 172.21.15.49:0/2899490447 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f24b005f390 0x7f24b0061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:03.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.349+0000 7f24d1641700 1 -- 172.21.15.49:0/2899490447 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f24b005f390 msgr2=0x7f24b0061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:26:03.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.349+0000 7f24c17fa700 1 -- 172.21.15.49:0/2899490447 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6407+0+0 (secure 0 0 0) 0x7f24bc07aa40 con 0x7f24cc1544d0 2023-11-30T17:26:03.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.349+0000 7f24d1641700 1 --2- 172.21.15.49:0/2899490447 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f24b005f390 0x7f24b0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:26:03.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.353+0000 7f24c17fa700 1 -- 172.21.15.49:0/2899490447 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f24bc04b8f0 con 0x7f24cc1544d0 2023-11-30T17:26:03.504 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:03.501+0000 7f3d853e9680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T17:26:03.542 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:03.541+0000 7f21503b3680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T17:26:03.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.550+0000 7f24d1641700 1 -- 172.21.15.49:0/2899490447 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f24b005f390 msgr2=0x7f24b0061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:26:03.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.550+0000 7f24d1641700 1 --2- 172.21.15.49:0/2899490447 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f24b005f390 0x7f24b0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:26:03.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.576+0000 7f24d38a5700 1 -- 172.21.15.49:0/2899490447 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24cc0a6840 con 0x7f24cc1544d0 2023-11-30T17:26:03.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.577+0000 7f24c17fa700 1 -- 172.21.15.49:0/2899490447 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f24bc04ef10 con 0x7f24cc1544d0 2023-11-30T17:26:03.578 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:26:03.578 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":53,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/744782933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":744782933},{"type":"v1","addr":"172.21.15.115:6837","nonce":744782933}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7638,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/2409585815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2409585815},{"type":"v1","addr":"172.21.15.49:6834","nonce":2409585815}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7641,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3249829086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3249829086},{"type":"v1","addr":"172.21.15.49:6835","nonce":3249829086}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:25:07.786736+0000","modified":"2023-11-30T17:25:10.793530+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7650},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7650":{"gid":7650,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6835/3436956463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3436956463},{"type":"v1","addr":"172.21.15.115:6835","nonce":3436956463}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-11-30T17:26:03.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.579+0000 7f24d38a5700 1 -- 172.21.15.49:0/2899490447 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f24b005f390 msgr2=0x7f24b0061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:26:03.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.579+0000 7f24d38a5700 1 --2- 172.21.15.49:0/2899490447 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f24b005f390 0x7f24b0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:03.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.579+0000 7f24d38a5700 1 -- 172.21.15.49:0/2899490447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24cc1544d0 msgr2=0x7f24cc0ae0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:03.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.579+0000 7f24d38a5700 1 --2- 172.21.15.49:0/2899490447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24cc1544d0 0x7f24cc0ae0d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f24bc00e950 tx=0x7f24bc009060).stop 2023-11-30T17:26:03.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.579+0000 7f24d38a5700 1 -- 172.21.15.49:0/2899490447 shutdown_connections 2023-11-30T17:26:03.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.579+0000 7f24d38a5700 1 --2- 172.21.15.49:0/2899490447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24cc158e70 0x7f24cc1592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:03.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.579+0000 7f24d38a5700 1 --2- 172.21.15.49:0/2899490447 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f24b005f390 0x7f24b0061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:03.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.579+0000 7f24d38a5700 1 --2- 172.21.15.49:0/2899490447 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24cc066f40 0x7f24cc163920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:03.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.579+0000 7f24d38a5700 1 --2- 172.21.15.49:0/2899490447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24cc1544d0 0x7f24cc0ae0d0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:03.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.579+0000 7f24d38a5700 1 -- 172.21.15.49:0/2899490447 >> 172.21.15.49:0/2899490447 conn(0x7f24cc0631d0 msgr2=0x7f24cc14f650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:03.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.579+0000 7f24d38a5700 1 -- 172.21.15.49:0/2899490447 shutdown_connections 2023-11-30T17:26:03.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.579+0000 7f24d38a5700 1 -- 172.21.15.49:0/2899490447 wait complete. 2023-11-30T17:26:03.581 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 53 2023-11-30T17:26:03.593 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:26:03.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.752+0000 7f0780b87700 1 Processor -- start 2023-11-30T17:26:03.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.752+0000 7f0780b87700 1 -- start start 2023-11-30T17:26:03.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.753+0000 7f0780b87700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f077c154230 0x7f077c0a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:03.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.753+0000 7f0780b87700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f077c062700 0x7f077c062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:03.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.753+0000 7f0780b87700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c0630a0 con 0x7f077c0c2cb0 2023-11-30T17:26:03.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.753+0000 7f0780b87700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077c0a6720 con 0x7f077c062700 2023-11-30T17:26:03.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.753+0000 7f0780b87700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077c0c2540 con 0x7f077c154230 2023-11-30T17:26:03.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.753+0000 7f0773fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f077c0c2cb0 0x7f077c0a6010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55848/0 (socket says 172.21.15.49:55848) 2023-11-30T17:26:03.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.753+0000 7f0773fff700 1 -- 172.21.15.49:0/3078670030 learned_addr learned my addr 172.21.15.49:0/3078670030 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:03.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.753+0000 7f077bfff700 1 --2- 172.21.15.49:0/3078670030 >> v2:172.21.15.115:3300/0 conn(0x7f077c062700 0x7f077c062bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:03.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.753+0000 7f077b7fe700 1 --2- 172.21.15.49:0/3078670030 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f077c154230 0x7f077c0a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:03.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.754+0000 7f077affd700 1 -- 172.21.15.49:0/3078670030 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101787517 0 0) 0x7f0764001110 con 0x7f077c0c2cb0 2023-11-30T17:26:03.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.754+0000 7f077affd700 1 -- 172.21.15.49:0/3078670030 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07680033f0 con 0x7f077c0c2cb0 2023-11-30T17:26:03.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.754+0000 7f077bfff700 1 -- 172.21.15.49:0/3078670030 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f077c154230 msgr2=0x7f077c0a48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:03.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.754+0000 7f077bfff700 1 --2- 172.21.15.49:0/3078670030 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f077c154230 0x7f077c0a48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:03.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.754+0000 7f077bfff700 1 -- 172.21.15.49:0/3078670030 >> v1:172.21.15.49:6789/0 conn(0x7f077c0c2cb0 legacy=0x7f077c0a6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:03.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.754+0000 7f077bfff700 1 -- 172.21.15.49:0/3078670030 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c0a4f70 con 0x7f077c062700 2023-11-30T17:26:03.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.754+0000 7f077b7fe700 1 --2- 172.21.15.49:0/3078670030 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f077c154230 0x7f077c0a48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:26:03.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.754+0000 7f077bfff700 1 --2- 172.21.15.49:0/3078670030 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f077c062700 0x7f077c062bb0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f0774009e60 tx=0x7f0774009780).ready entity=mon.1 client_cookie=8789757884daf4e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:03.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.754+0000 7f077affd700 1 -- 172.21.15.49:0/3078670030 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077400e070 con 0x7f077c062700 2023-11-30T17:26:03.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.754+0000 7f077affd700 1 -- 172.21.15.49:0/3078670030 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077400bab0 con 0x7f077c062700 2023-11-30T17:26:03.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.754+0000 7f077affd700 1 -- 172.21.15.49:0/3078670030 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077400be30 con 0x7f077c062700 2023-11-30T17:26:03.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.755+0000 7f0780b87700 1 -- 172.21.15.49:0/3078670030 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f077c062700 msgr2=0x7f077c062bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:03.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.755+0000 7f0780b87700 1 --2- 172.21.15.49:0/3078670030 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f077c062700 0x7f077c062bb0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f0774009e60 tx=0x7f0774009780).stop 2023-11-30T17:26:03.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.755+0000 7f0780b87700 1 -- 172.21.15.49:0/3078670030 shutdown_connections 2023-11-30T17:26:03.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.755+0000 7f0780b87700 1 --2- 172.21.15.49:0/3078670030 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f077c062700 0x7f077c062bb0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:03.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.755+0000 7f0780b87700 1 --2- 172.21.15.49:0/3078670030 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f077c154230 0x7f077c0a48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:03.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.755+0000 7f0780b87700 1 -- 172.21.15.49:0/3078670030 >> 172.21.15.49:0/3078670030 conn(0x7f077c0c7ca0 msgr2=0x7f077c0c80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:03.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.755+0000 7f0780b87700 1 -- 172.21.15.49:0/3078670030 shutdown_connections 2023-11-30T17:26:03.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.755+0000 7f0780b87700 1 -- 172.21.15.49:0/3078670030 wait complete. 2023-11-30T17:26:03.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.756+0000 7f0780b87700 1 Processor -- start 2023-11-30T17:26:03.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.756+0000 7f0780b87700 1 -- start start 2023-11-30T17:26:03.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.757+0000 7f0780b87700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f077c062700 0x7f077c15a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:03.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.757+0000 7f0780b87700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f077c0c2cb0 0x7f077c0ac670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:03.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.757+0000 7f0780b87700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f077c154230 0x7f077c14e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:03.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.757+0000 7f0780b87700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c159610 con 0x7f077c154230 2023-11-30T17:26:03.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.757+0000 7f0780b87700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c1598f0 con 0x7f077c062700 2023-11-30T17:26:03.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.757+0000 7f0780b87700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077c159bd0 con 0x7f077c0c2cb0 2023-11-30T17:26:03.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.757+0000 7f077bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f077c154230 0x7f077c14e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:03.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.757+0000 7f077bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f077c154230 0x7f077c14e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50188/0 (socket says 172.21.15.49:50188) 2023-11-30T17:26:03.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.757+0000 7f077bfff700 1 -- 172.21.15.49:0/1467862293 learned_addr learned my addr 172.21.15.49:0/1467862293 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:03.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.757+0000 7f077b7fe700 1 --2- 172.21.15.49:0/1467862293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f077c062700 0x7f077c15a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:03.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.757+0000 7f0773fff700 1 --2- 172.21.15.49:0/1467862293 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f077c0c2cb0 0x7f077c0ac670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:03.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.757+0000 7f077bfff700 1 -- 172.21.15.49:0/1467862293 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f077c0c2cb0 msgr2=0x7f077c0ac670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:03.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.757+0000 7f077bfff700 1 --2- 172.21.15.49:0/1467862293 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f077c0c2cb0 0x7f077c0ac670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:03.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.757+0000 7f077bfff700 1 -- 172.21.15.49:0/1467862293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f077c062700 msgr2=0x7f077c15a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:03.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.757+0000 7f077bfff700 1 --2- 172.21.15.49:0/1467862293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f077c062700 0x7f077c15a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:03.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.757+0000 7f077bfff700 1 -- 172.21.15.49:0/1467862293 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076c0092a0 con 0x7f077c154230 2023-11-30T17:26:03.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.757+0000 7f077b7fe700 1 --2- 172.21.15.49:0/1467862293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f077c062700 0x7f077c15a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:26:03.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.758+0000 7f077bfff700 1 --2- 172.21.15.49:0/1467862293 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f077c154230 0x7f077c14e7e0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7f077400b610 tx=0x7f0774009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:03.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.758+0000 7f07737fe700 1 -- 172.21.15.49:0/1467862293 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0774013e70 con 0x7f077c154230 2023-11-30T17:26:03.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.758+0000 7f07737fe700 1 -- 172.21.15.49:0/1467862293 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077401d630 con 0x7f077c154230 2023-11-30T17:26:03.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.758+0000 7f0780b87700 1 -- 172.21.15.49:0/1467862293 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0774009a20 con 0x7f077c154230 2023-11-30T17:26:03.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.758+0000 7f07737fe700 1 -- 172.21.15.49:0/1467862293 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077401d9f0 con 0x7f077c154230 2023-11-30T17:26:03.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.758+0000 7f0780b87700 1 -- 172.21.15.49:0/1467862293 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f077c15a190 con 0x7f077c154230 2023-11-30T17:26:03.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.759+0000 7f0780b87700 1 -- 172.21.15.49:0/1467862293 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f077c0c89c0 con 0x7f077c154230 2023-11-30T17:26:03.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.760+0000 7f07737fe700 1 -- 172.21.15.49:0/1467862293 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 55) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f0774003040 con 0x7f077c154230 2023-11-30T17:26:03.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.760+0000 7f07737fe700 1 --2- 172.21.15.49:0/1467862293 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f075c05f390 0x7f075c061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:03.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.760+0000 7f07737fe700 1 -- 172.21.15.49:0/1467862293 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6407+0+0 (secure 0 0 0) 0x7f077407c4d0 con 0x7f077c154230 2023-11-30T17:26:03.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.760+0000 7f077b7fe700 1 -- 172.21.15.49:0/1467862293 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f075c05f390 msgr2=0x7f075c061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:26:03.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.760+0000 7f077b7fe700 1 --2- 172.21.15.49:0/1467862293 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f075c05f390 0x7f075c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:26:03.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.768+0000 7f07737fe700 1 -- 172.21.15.49:0/1467862293 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f077404d270 con 0x7f077c154230 2023-11-30T17:26:03.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.947+0000 7f0780b87700 1 -- 172.21.15.49:0/1467862293 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f077c06c7c0 con 0x7f077c154230 2023-11-30T17:26:03.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.948+0000 7f07737fe700 1 -- 172.21.15.49:0/1467862293 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+17358 (secure 0 0 0) 0x7f0774050890 con 0x7f077c154230 2023-11-30T17:26:03.950 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:26:03.950 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":131,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:25:20.162921+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:25:06.343377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-11-30T17:25:06.764214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/2241073917":"2023-12-01T17:25:20.162884+0000","172.21.15.115:0/1091016185":"2023-12-01T17:25:20.162884+0000","172.21.15.115:0/129391862":"2023-12-01T17:25:20.162884+0000","172.21.15.115:0/1234588325":"2023-12-01T17:25:20.162884+0000","172.21.15.115:6833/89956":"2023-12-01T17:25:20.162884+0000","172.21.15.115:6832/89956":"2023-12-01T17:25:20.162884+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:26:03.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.950+0000 7f0780b87700 1 -- 172.21.15.49:0/1467862293 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f075c05f390 msgr2=0x7f075c061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:26:03.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.950+0000 7f0780b87700 1 --2- 172.21.15.49:0/1467862293 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f075c05f390 0x7f075c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:03.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.950+0000 7f0780b87700 1 -- 172.21.15.49:0/1467862293 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f077c154230 msgr2=0x7f077c14e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:03.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.950+0000 7f0780b87700 1 --2- 172.21.15.49:0/1467862293 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f077c154230 0x7f077c14e7e0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7f077400b610 tx=0x7f0774009780).stop 2023-11-30T17:26:03.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.950+0000 7f0780b87700 1 -- 172.21.15.49:0/1467862293 shutdown_connections 2023-11-30T17:26:03.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.950+0000 7f0780b87700 1 --2- 172.21.15.49:0/1467862293 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f075c05f390 0x7f075c061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:03.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.950+0000 7f0780b87700 1 --2- 172.21.15.49:0/1467862293 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f077c154230 0x7f077c14e7e0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:03.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.950+0000 7f0780b87700 1 --2- 172.21.15.49:0/1467862293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f077c062700 0x7f077c15a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:03.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.950+0000 7f0780b87700 1 --2- 172.21.15.49:0/1467862293 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f077c0c2cb0 0x7f077c0ac670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:03.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.950+0000 7f0780b87700 1 -- 172.21.15.49:0/1467862293 >> 172.21.15.49:0/1467862293 conn(0x7f077c0c7ca0 msgr2=0x7f077c153290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:03.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.950+0000 7f0780b87700 1 -- 172.21.15.49:0/1467862293 shutdown_connections 2023-11-30T17:26:03.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:03.950+0000 7f0780b87700 1 -- 172.21.15.49:0/1467862293 wait complete. 2023-11-30T17:26:03.970 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '119', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-30T17:25:06.343377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '129', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-11-30T17:25:06.764214+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '130', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-30T17:26:03.971 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T17:26:04.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.096+0000 7f79d58e1700 1 Processor -- start 2023-11-30T17:26:04.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.097+0000 7f79d58e1700 1 -- start start 2023-11-30T17:26:04.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.097+0000 7f79d58e1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79d00c6950 0x7f79d00bc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:04.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.097+0000 7f79d58e1700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f79d00bcbb0 0x7f79d015c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:04.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.097+0000 7f79d58e1700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d0064090 con 0x7f79d0152510 2023-11-30T17:26:04.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.097+0000 7f79d58e1700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d0063480 con 0x7f79d00bcbb0 2023-11-30T17:26:04.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.098+0000 7f79d58e1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d0063760 con 0x7f79d00c6950 2023-11-30T17:26:04.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.098+0000 7f79ceffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f79d0152510 0x7f79d00a67e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:47832/0 (socket says 172.21.15.49:47832) 2023-11-30T17:26:04.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.098+0000 7f79ceffd700 1 -- 172.21.15.49:0/3115461015 learned_addr learned my addr 172.21.15.49:0/3115461015 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:04.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.098+0000 7f79ce7fc700 1 --2- 172.21.15.49:0/3115461015 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79d00c6950 0x7f79d00bc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:04.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.098+0000 7f79cf7fe700 1 --2- 172.21.15.49:0/3115461015 >> v2:172.21.15.115:3300/0 conn(0x7f79d00bcbb0 0x7f79d015c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:04.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.098+0000 7f79ce7fc700 1 -- 172.21.15.49:0/3115461015 >> v2:172.21.15.115:3300/0 conn(0x7f79d00bcbb0 msgr2=0x7f79d015c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:04.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.098+0000 7f79ce7fc700 1 --2- 172.21.15.49:0/3115461015 >> v2:172.21.15.115:3300/0 conn(0x7f79d00bcbb0 0x7f79d015c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:04.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.098+0000 7f79ce7fc700 1 -- 172.21.15.49:0/3115461015 >> v1:172.21.15.115:6789/0 conn(0x7f79d0152510 legacy=0x7f79d00a67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:04.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.098+0000 7f79cdffb700 1 -- 172.21.15.49:0/3115461015 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1037117421 0 0) 0x7f79d0064090 con 0x7f79d0152510 2023-11-30T17:26:04.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.098+0000 7f79ce7fc700 1 -- 172.21.15.49:0/3115461015 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d0063a40 con 0x7f79d00c6950 2023-11-30T17:26:04.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.098+0000 7f79ce7fc700 1 --2- 172.21.15.49:0/3115461015 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79d00c6950 0x7f79d00bc6c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f79c4006fd0 tx=0x7f79c4006f40).ready entity=mon.2 client_cookie=9b1708a81e1924d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:04.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.099+0000 7f79cdffb700 1 -- 172.21.15.49:0/3115461015 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c4005880 con 0x7f79d00c6950 2023-11-30T17:26:04.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.099+0000 7f79cdffb700 1 -- 172.21.15.49:0/3115461015 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c40059e0 con 0x7f79d00c6950 2023-11-30T17:26:04.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.099+0000 7f79cdffb700 1 -- 172.21.15.49:0/3115461015 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c4005d60 con 0x7f79d00c6950 2023-11-30T17:26:04.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.099+0000 7f79d58e1700 1 -- 172.21.15.49:0/3115461015 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79d00c6950 msgr2=0x7f79d00bc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:04.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.099+0000 7f79d58e1700 1 --2- 172.21.15.49:0/3115461015 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79d00c6950 0x7f79d00bc6c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f79c4006fd0 tx=0x7f79c4006f40).stop 2023-11-30T17:26:04.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.099+0000 7f79d58e1700 1 -- 172.21.15.49:0/3115461015 shutdown_connections 2023-11-30T17:26:04.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.099+0000 7f79d58e1700 1 --2- 172.21.15.49:0/3115461015 >> v2:172.21.15.115:3300/0 conn(0x7f79d00bcbb0 0x7f79d015c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:04.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.099+0000 7f79d58e1700 1 --2- 172.21.15.49:0/3115461015 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79d00c6950 0x7f79d00bc6c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:04.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.099+0000 7f79d58e1700 1 -- 172.21.15.49:0/3115461015 >> 172.21.15.49:0/3115461015 conn(0x7f79d00c8230 msgr2=0x7f79d00c4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:04.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.099+0000 7f79d58e1700 1 -- 172.21.15.49:0/3115461015 shutdown_connections 2023-11-30T17:26:04.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.099+0000 7f79d58e1700 1 -- 172.21.15.49:0/3115461015 wait complete. 2023-11-30T17:26:04.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.101+0000 7f79d58e1700 1 Processor -- start 2023-11-30T17:26:04.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.101+0000 7f79d58e1700 1 -- start start 2023-11-30T17:26:04.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.101+0000 7f79d58e1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79d00bcbb0 0x7f79d00c2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:04.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.101+0000 7f79d58e1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79d00c6950 0x7f79d0150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:04.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.101+0000 7f79d58e1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79d0152510 0x7f79d00aa710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:04.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.101+0000 7f79d58e1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d00c3b60 con 0x7f79d00bcbb0 2023-11-30T17:26:04.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.101+0000 7f79d58e1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d00c2ee0 con 0x7f79d00c6950 2023-11-30T17:26:04.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.101+0000 7f79d58e1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d00c31c0 con 0x7f79d0152510 2023-11-30T17:26:04.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.102+0000 7f79ceffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79d00bcbb0 0x7f79d00c2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:04.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.102+0000 7f79ceffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79d00bcbb0 0x7f79d00c2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50198/0 (socket says 172.21.15.49:50198) 2023-11-30T17:26:04.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.102+0000 7f79ceffd700 1 -- 172.21.15.49:0/3775972643 learned_addr learned my addr 172.21.15.49:0/3775972643 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:04.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.102+0000 7f79ce7fc700 1 --2- 172.21.15.49:0/3775972643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79d00c6950 0x7f79d0150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:04.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.102+0000 7f79cf7fe700 1 --2- 172.21.15.49:0/3775972643 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79d0152510 0x7f79d00aa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:04.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.102+0000 7f79ce7fc700 1 -- 172.21.15.49:0/3775972643 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79d0152510 msgr2=0x7f79d00aa710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:04.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.102+0000 7f79ce7fc700 1 --2- 172.21.15.49:0/3775972643 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79d0152510 0x7f79d00aa710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:04.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.102+0000 7f79ce7fc700 1 -- 172.21.15.49:0/3775972643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79d00bcbb0 msgr2=0x7f79d00c2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:04.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.102+0000 7f79ce7fc700 1 --2- 172.21.15.49:0/3775972643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79d00bcbb0 0x7f79d00c2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:04.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.102+0000 7f79ce7fc700 1 -- 172.21.15.49:0/3775972643 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c4009250 con 0x7f79d00c6950 2023-11-30T17:26:04.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.102+0000 7f79ceffd700 1 --2- 172.21.15.49:0/3775972643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79d00bcbb0 0x7f79d00c2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:26:04.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.102+0000 7f79cf7fe700 1 --2- 172.21.15.49:0/3775972643 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79d0152510 0x7f79d00aa710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:26:04.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.102+0000 7f79ce7fc700 1 --2- 172.21.15.49:0/3775972643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79d00c6950 0x7f79d0150860 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f79c4013000 tx=0x7f79c4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:04.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.102+0000 7f79b6ffd700 1 -- 172.21.15.49:0/3775972643 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c400f510 con 0x7f79d00c6950 2023-11-30T17:26:04.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.102+0000 7f79b6ffd700 1 -- 172.21.15.49:0/3775972643 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c400f6b0 con 0x7f79d00c6950 2023-11-30T17:26:04.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.102+0000 7f79d58e1700 1 -- 172.21.15.49:0/3775972643 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d00c34a0 con 0x7f79d00c6950 2023-11-30T17:26:04.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.103+0000 7f79b6ffd700 1 -- 172.21.15.49:0/3775972643 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c400fa70 con 0x7f79d00c6950 2023-11-30T17:26:04.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.103+0000 7f79d58e1700 1 -- 172.21.15.49:0/3775972643 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d00c2b80 con 0x7f79d00c6950 2023-11-30T17:26:04.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.104+0000 7f79d58e1700 1 -- 172.21.15.49:0/3775972643 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d00c3300 con 0x7f79d00c6950 2023-11-30T17:26:04.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.104+0000 7f79b6ffd700 1 -- 172.21.15.49:0/3775972643 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 55) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f79c4026670 con 0x7f79d00c6950 2023-11-30T17:26:04.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.104+0000 7f79b6ffd700 1 --2- 172.21.15.49:0/3775972643 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f79bc05f360 0x7f79bc061820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:04.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.105+0000 7f79b6ffd700 1 -- 172.21.15.49:0/3775972643 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f79c407bbd0 con 0x7f79d00c6950 2023-11-30T17:26:04.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.105+0000 7f79ceffd700 1 -- 172.21.15.49:0/3775972643 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f79bc05f360 msgr2=0x7f79bc061820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:26:04.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.105+0000 7f79ceffd700 1 --2- 172.21.15.49:0/3775972643 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f79bc05f360 0x7f79bc061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:26:04.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.112+0000 7f79b6ffd700 1 -- 172.21.15.49:0/3775972643 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f79d00c3300 con 0x7f79d00c6950 2023-11-30T17:26:04.119 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:04.116+0000 7f3d853e9680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T17:26:04.191 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:04.188+0000 7f3d853e9680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T17:26:04.232 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:04.231+0000 7f21503b3680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T17:26:04.303 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:04.301+0000 7f21503b3680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T17:26:04.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.306+0000 7f79ceffd700 1 -- 172.21.15.49:0/3775972643 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f79bc05f360 msgr2=0x7f79bc061820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:26:04.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.306+0000 7f79ceffd700 1 --2- 172.21.15.49:0/3775972643 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f79bc05f360 0x7f79bc061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:26:04.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.341+0000 7f79d58e1700 1 -- 172.21.15.49:0/3775972643 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f79d00c3300 con 0x7f79d00c6950 2023-11-30T17:26:04.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.341+0000 7f79b6ffd700 1 -- 172.21.15.49:0/3775972643 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v132) v1 ==== 110+0+10 (secure 0 0 0) 0x7f79d00c3300 con 0x7f79d00c6950 2023-11-30T17:26:04.343 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T17:26:04.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.343+0000 7f79d58e1700 1 -- 172.21.15.49:0/3775972643 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f79bc05f360 msgr2=0x7f79bc061820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:26:04.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.343+0000 7f79d58e1700 1 --2- 172.21.15.49:0/3775972643 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f79bc05f360 0x7f79bc061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:04.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.343+0000 7f79d58e1700 1 -- 172.21.15.49:0/3775972643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79d00c6950 msgr2=0x7f79d0150860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:04.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.343+0000 7f79d58e1700 1 --2- 172.21.15.49:0/3775972643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79d00c6950 0x7f79d0150860 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f79c4013000 tx=0x7f79c4016000).stop 2023-11-30T17:26:04.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.343+0000 7f79d58e1700 1 -- 172.21.15.49:0/3775972643 shutdown_connections 2023-11-30T17:26:04.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.343+0000 7f79d58e1700 1 --2- 172.21.15.49:0/3775972643 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79d0152510 0x7f79d00aa710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:04.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.343+0000 7f79d58e1700 1 --2- 172.21.15.49:0/3775972643 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f79bc05f360 0x7f79bc061820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:04.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.343+0000 7f79d58e1700 1 --2- 172.21.15.49:0/3775972643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79d00bcbb0 0x7f79d00c2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:04.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.343+0000 7f79d58e1700 1 --2- 172.21.15.49:0/3775972643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79d00c6950 0x7f79d0150860 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:04.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.343+0000 7f79d58e1700 1 -- 172.21.15.49:0/3775972643 >> 172.21.15.49:0/3775972643 conn(0x7f79d00c8230 msgr2=0x7f79d0151740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:04.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.343+0000 7f79d58e1700 1 -- 172.21.15.49:0/3775972643 shutdown_connections 2023-11-30T17:26:04.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.343+0000 7f79d58e1700 1 -- 172.21.15.49:0/3775972643 wait complete. 2023-11-30T17:26:04.358 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T17:26:04.381 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:04.379+0000 7f3d853e9680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T17:26:04.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.480+0000 7f8bef4af700 1 Processor -- start 2023-11-30T17:26:04.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.480+0000 7f8bef4af700 1 -- start start 2023-11-30T17:26:04.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.481+0000 7f8bef4af700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8be81516b0 0x7f8be8069c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:04.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.481+0000 7f8bef4af700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8be80c3af0 0x7f8be80c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:04.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.481+0000 7f8bef4af700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8be80c2c50 0x7f8be80c3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:04.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.481+0000 7f8bef4af700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be80c4460 con 0x7f8be80c3af0 2023-11-30T17:26:04.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.481+0000 7f8bef4af700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be81561c0 con 0x7f8be80c2c50 2023-11-30T17:26:04.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.481+0000 7f8bef4af700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be80c35f0 con 0x7f8be81516b0 2023-11-30T17:26:04.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.481+0000 7f8beca4a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8be80c3af0 0x7f8be80c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:04.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.482+0000 7f8beca4a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8be80c3af0 0x7f8be80c3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50202/0 (socket says 172.21.15.49:50202) 2023-11-30T17:26:04.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.482+0000 7f8beca4a700 1 -- 172.21.15.49:0/3273059582 learned_addr learned my addr 172.21.15.49:0/3273059582 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:04.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.482+0000 7f8bed24b700 1 --2- 172.21.15.49:0/3273059582 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8be81516b0 0x7f8be8069c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:04.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.482+0000 7f8beda4c700 1 --2- 172.21.15.49:0/3273059582 >> v2:172.21.15.115:3300/0 conn(0x7f8be80c2c50 0x7f8be80c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:04.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.482+0000 7f8beca4a700 1 -- 172.21.15.49:0/3273059582 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8be81516b0 msgr2=0x7f8be8069c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:04.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.482+0000 7f8beca4a700 1 --2- 172.21.15.49:0/3273059582 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8be81516b0 0x7f8be8069c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:04.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.482+0000 7f8beca4a700 1 -- 172.21.15.49:0/3273059582 >> v2:172.21.15.115:3300/0 conn(0x7f8be80c2c50 msgr2=0x7f8be80c3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:04.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.482+0000 7f8beca4a700 1 --2- 172.21.15.49:0/3273059582 >> v2:172.21.15.115:3300/0 conn(0x7f8be80c2c50 0x7f8be80c3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:04.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.482+0000 7f8beca4a700 1 -- 172.21.15.49:0/3273059582 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be81555b0 con 0x7f8be80c3af0 2023-11-30T17:26:04.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.482+0000 7f8beca4a700 1 --2- 172.21.15.49:0/3273059582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8be80c3af0 0x7f8be80c3f70 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7f8be80aad30 tx=0x7f8be40090f0).ready entity=mon.0 client_cookie=e7f9cda6627565b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:04.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.482+0000 7f8bdbfff700 1 -- 172.21.15.49:0/3273059582 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be400f510 con 0x7f8be80c3af0 2023-11-30T17:26:04.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.482+0000 7f8bdbfff700 1 -- 172.21.15.49:0/3273059582 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be400f670 con 0x7f8be80c3af0 2023-11-30T17:26:04.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.482+0000 7f8bdbfff700 1 -- 172.21.15.49:0/3273059582 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be400f9f0 con 0x7f8be80c3af0 2023-11-30T17:26:04.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.483+0000 7f8bef4af700 1 -- 172.21.15.49:0/3273059582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8be80c3af0 msgr2=0x7f8be80c3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:04.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.483+0000 7f8bef4af700 1 --2- 172.21.15.49:0/3273059582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8be80c3af0 0x7f8be80c3f70 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7f8be80aad30 tx=0x7f8be40090f0).stop 2023-11-30T17:26:04.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.483+0000 7f8bef4af700 1 -- 172.21.15.49:0/3273059582 shutdown_connections 2023-11-30T17:26:04.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.483+0000 7f8bef4af700 1 --2- 172.21.15.49:0/3273059582 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8be81516b0 0x7f8be8069c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:04.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.483+0000 7f8bef4af700 1 --2- 172.21.15.49:0/3273059582 >> v2:172.21.15.115:3300/0 conn(0x7f8be80c2c50 0x7f8be80c3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:04.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.483+0000 7f8bef4af700 1 --2- 172.21.15.49:0/3273059582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8be80c3af0 0x7f8be80c3f70 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:04.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.483+0000 7f8bef4af700 1 -- 172.21.15.49:0/3273059582 >> 172.21.15.49:0/3273059582 conn(0x7f8be8063810 msgr2=0x7f8be8063c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:04.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.483+0000 7f8bef4af700 1 -- 172.21.15.49:0/3273059582 shutdown_connections 2023-11-30T17:26:04.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.483+0000 7f8bef4af700 1 -- 172.21.15.49:0/3273059582 wait complete. 2023-11-30T17:26:04.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.484+0000 7f8bef4af700 1 Processor -- start 2023-11-30T17:26:04.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.484+0000 7f8bef4af700 1 -- start start 2023-11-30T17:26:04.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.485+0000 7f8bef4af700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8be80c2c50 0x7f8be8153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:04.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.485+0000 7f8bef4af700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8be80c3af0 0x7f8be81547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:04.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.485+0000 7f8bef4af700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8be81516b0 0x7f8be80c0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:04.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.485+0000 7f8bef4af700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be8154cd0 con 0x7f8be80c3af0 2023-11-30T17:26:04.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.485+0000 7f8bef4af700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be81689a0 con 0x7f8be81516b0 2023-11-30T17:26:04.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.485+0000 7f8bef4af700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be80c0d60 con 0x7f8be80c2c50 2023-11-30T17:26:04.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.485+0000 7f8beca4a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8be80c3af0 0x7f8be81547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:04.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.485+0000 7f8beca4a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8be80c3af0 0x7f8be81547e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50206/0 (socket says 172.21.15.49:50206) 2023-11-30T17:26:04.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.485+0000 7f8beca4a700 1 -- 172.21.15.49:0/4243015801 learned_addr learned my addr 172.21.15.49:0/4243015801 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:04.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.485+0000 7f8bed24b700 1 --2- 172.21.15.49:0/4243015801 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8be80c2c50 0x7f8be8153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:04.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.485+0000 7f8beda4c700 1 --2- 172.21.15.49:0/4243015801 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8be81516b0 0x7f8be80c0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:04.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.486+0000 7f8beca4a700 1 -- 172.21.15.49:0/4243015801 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8be80c2c50 msgr2=0x7f8be8153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:04.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.486+0000 7f8beca4a700 1 --2- 172.21.15.49:0/4243015801 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8be80c2c50 0x7f8be8153c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:04.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.486+0000 7f8beca4a700 1 -- 172.21.15.49:0/4243015801 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8be81516b0 msgr2=0x7f8be80c0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:04.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.486+0000 7f8beca4a700 1 --2- 172.21.15.49:0/4243015801 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8be81516b0 0x7f8be80c0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:04.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.486+0000 7f8beca4a700 1 -- 172.21.15.49:0/4243015801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be4009370 con 0x7f8be80c3af0 2023-11-30T17:26:04.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.486+0000 7f8beca4a700 1 --2- 172.21.15.49:0/4243015801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8be80c3af0 0x7f8be81547e0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7f8be4008000 tx=0x7f8be4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:04.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.486+0000 7f8bd97fa700 1 -- 172.21.15.49:0/4243015801 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be400fe80 con 0x7f8be80c3af0 2023-11-30T17:26:04.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.486+0000 7f8bd97fa700 1 -- 172.21.15.49:0/4243015801 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be4006a40 con 0x7f8be80c3af0 2023-11-30T17:26:04.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.486+0000 7f8bef4af700 1 -- 172.21.15.49:0/4243015801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be80c1040 con 0x7f8be80c3af0 2023-11-30T17:26:04.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.486+0000 7f8bd97fa700 1 -- 172.21.15.49:0/4243015801 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be401b410 con 0x7f8be80c3af0 2023-11-30T17:26:04.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.486+0000 7f8bef4af700 1 -- 172.21.15.49:0/4243015801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be8168630 con 0x7f8be80c3af0 2023-11-30T17:26:04.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.487+0000 7f8bef4af700 1 -- 172.21.15.49:0/4243015801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be81681b0 con 0x7f8be80c3af0 2023-11-30T17:26:04.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.487+0000 7f8bd97fa700 1 -- 172.21.15.49:0/4243015801 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 55) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f8be401b780 con 0x7f8be80c3af0 2023-11-30T17:26:04.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.488+0000 7f8bd97fa700 1 --2- 172.21.15.49:0/4243015801 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8bcc05f390 0x7f8bcc061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:04.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.488+0000 7f8bed24b700 1 -- 172.21.15.49:0/4243015801 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8bcc05f390 msgr2=0x7f8bcc061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:26:04.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.488+0000 7f8bd97fa700 1 -- 172.21.15.49:0/4243015801 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f8be407b930 con 0x7f8be80c3af0 2023-11-30T17:26:04.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.488+0000 7f8bed24b700 1 --2- 172.21.15.49:0/4243015801 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8bcc05f390 0x7f8bcc061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:26:04.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.492+0000 7f8bd97fa700 1 -- 172.21.15.49:0/4243015801 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8be81681b0 con 0x7f8be80c3af0 2023-11-30T17:26:04.509 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:04.507+0000 7f21503b3680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T17:26:04.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.665+0000 7f8bef4af700 1 -- 172.21.15.49:0/4243015801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8be81681b0 con 0x7f8be80c3af0 2023-11-30T17:26:04.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.666+0000 7f8bd97fa700 1 -- 172.21.15.49:0/4243015801 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v132) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8be81681b0 con 0x7f8be80c3af0 2023-11-30T17:26:04.668 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T17:26:04.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.668+0000 7f8bef4af700 1 -- 172.21.15.49:0/4243015801 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8bcc05f390 msgr2=0x7f8bcc061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:26:04.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.668+0000 7f8bef4af700 1 --2- 172.21.15.49:0/4243015801 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8bcc05f390 0x7f8bcc061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:04.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.668+0000 7f8bef4af700 1 -- 172.21.15.49:0/4243015801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8be80c3af0 msgr2=0x7f8be81547e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:04.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.668+0000 7f8bef4af700 1 --2- 172.21.15.49:0/4243015801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8be80c3af0 0x7f8be81547e0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7f8be4008000 tx=0x7f8be4017000).stop 2023-11-30T17:26:04.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.668+0000 7f8bef4af700 1 -- 172.21.15.49:0/4243015801 shutdown_connections 2023-11-30T17:26:04.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.668+0000 7f8bef4af700 1 --2- 172.21.15.49:0/4243015801 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8be81516b0 0x7f8be80c0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:04.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.668+0000 7f8bef4af700 1 --2- 172.21.15.49:0/4243015801 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8be80c2c50 0x7f8be8153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:04.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.668+0000 7f8bef4af700 1 --2- 172.21.15.49:0/4243015801 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8bcc05f390 0x7f8bcc061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:04.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.668+0000 7f8bef4af700 1 --2- 172.21.15.49:0/4243015801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8be80c3af0 0x7f8be81547e0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:04.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.668+0000 7f8bef4af700 1 -- 172.21.15.49:0/4243015801 >> 172.21.15.49:0/4243015801 conn(0x7f8be8063810 msgr2=0x7f8be806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:04.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.668+0000 7f8bef4af700 1 -- 172.21.15.49:0/4243015801 shutdown_connections 2023-11-30T17:26:04.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.668+0000 7f8bef4af700 1 -- 172.21.15.49:0/4243015801 wait complete. 2023-11-30T17:26:04.682 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-30T17:26:04.800 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:04.797+0000 7f3d853e9680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T17:26:04.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.805+0000 7fcb8f7ca700 1 Processor -- start 2023-11-30T17:26:04.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.805+0000 7fcb8f7ca700 1 -- start start 2023-11-30T17:26:04.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.806+0000 7fcb8f7ca700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcb880c20c0 0x7fcb880c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:04.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.806+0000 7fcb8f7ca700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcb880bdb30 0x7fcb8806a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:04.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.806+0000 7fcb8f7ca700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb881554d0 con 0x7fcb880bd680 2023-11-30T17:26:04.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.806+0000 7fcb8f7ca700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb8806ab10 con 0x7fcb880c20c0 2023-11-30T17:26:04.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.806+0000 7fcb8f7ca700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb881548c0 con 0x7fcb880bdb30 2023-11-30T17:26:04.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.806+0000 7fcb8d566700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcb880c20c0 0x7fcb880c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:04.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.806+0000 7fcb8d566700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcb880c20c0 0x7fcb880c24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50220/0 (socket says 172.21.15.49:50220) 2023-11-30T17:26:04.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.806+0000 7fcb8d566700 1 -- 172.21.15.49:0/4251426167 learned_addr learned my addr 172.21.15.49:0/4251426167 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:04.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.806+0000 7fcb8dd67700 1 --2- 172.21.15.49:0/4251426167 >> v2:172.21.15.115:3300/0 conn(0x7fcb880bdb30 0x7fcb8806a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:04.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.806+0000 7fcb8d566700 1 -- 172.21.15.49:0/4251426167 >> v2:172.21.15.115:3300/0 conn(0x7fcb880bdb30 msgr2=0x7fcb8806a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:04.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.806+0000 7fcb8d566700 1 --2- 172.21.15.49:0/4251426167 >> v2:172.21.15.115:3300/0 conn(0x7fcb880bdb30 0x7fcb8806a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:04.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.806+0000 7fcb8d566700 1 -- 172.21.15.49:0/4251426167 >> v1:172.21.15.115:6789/0 conn(0x7fcb880bd680 legacy=0x7fcb88069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:04.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.806+0000 7fcb7ffff700 1 -- 172.21.15.49:0/4251426167 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2835712507 0 0) 0x7fcb881554d0 con 0x7fcb880bd680 2023-11-30T17:26:04.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.806+0000 7fcb8d566700 1 -- 172.21.15.49:0/4251426167 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb88154ba0 con 0x7fcb880c20c0 2023-11-30T17:26:04.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.806+0000 7fcb8d566700 1 --2- 172.21.15.49:0/4251426167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb880c20c0 0x7fcb880c24a0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7fcb88155440 tx=0x7fcb8400b370).ready entity=mon.0 client_cookie=bbc129551dff80ff server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:04.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.807+0000 7fcb7ffff700 1 -- 172.21.15.49:0/4251426167 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8400db70 con 0x7fcb880c20c0 2023-11-30T17:26:04.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.807+0000 7fcb7ffff700 1 -- 172.21.15.49:0/4251426167 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8400dcd0 con 0x7fcb880c20c0 2023-11-30T17:26:04.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.807+0000 7fcb7ffff700 1 -- 172.21.15.49:0/4251426167 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb84015600 con 0x7fcb880c20c0 2023-11-30T17:26:04.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.807+0000 7fcb8f7ca700 1 -- 172.21.15.49:0/4251426167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb880c20c0 msgr2=0x7fcb880c24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:04.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.807+0000 7fcb8f7ca700 1 --2- 172.21.15.49:0/4251426167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb880c20c0 0x7fcb880c24a0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7fcb88155440 tx=0x7fcb8400b370).stop 2023-11-30T17:26:04.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.807+0000 7fcb8f7ca700 1 -- 172.21.15.49:0/4251426167 shutdown_connections 2023-11-30T17:26:04.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.807+0000 7fcb8f7ca700 1 --2- 172.21.15.49:0/4251426167 >> v2:172.21.15.115:3300/0 conn(0x7fcb880bdb30 0x7fcb8806a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:04.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.807+0000 7fcb8f7ca700 1 --2- 172.21.15.49:0/4251426167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb880c20c0 0x7fcb880c24a0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:04.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.807+0000 7fcb8f7ca700 1 -- 172.21.15.49:0/4251426167 >> 172.21.15.49:0/4251426167 conn(0x7fcb88062700 msgr2=0x7fcb88062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:04.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.807+0000 7fcb8f7ca700 1 -- 172.21.15.49:0/4251426167 shutdown_connections 2023-11-30T17:26:04.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.807+0000 7fcb8f7ca700 1 -- 172.21.15.49:0/4251426167 wait complete. 2023-11-30T17:26:04.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.809+0000 7fcb8f7ca700 1 Processor -- start 2023-11-30T17:26:04.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.809+0000 7fcb8f7ca700 1 -- start start 2023-11-30T17:26:04.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.809+0000 7fcb8f7ca700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb880bd680 0x7fcb88160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:04.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.809+0000 7fcb8f7ca700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb880bdb30 0x7fcb8814edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:04.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.809+0000 7fcb8f7ca700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb880c20c0 0x7fcb880a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:04.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.810+0000 7fcb8f7ca700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb881614e0 con 0x7fcb880c20c0 2023-11-30T17:26:04.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.810+0000 7fcb8f7ca700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8814e030 con 0x7fcb880bdb30 2023-11-30T17:26:04.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.810+0000 7fcb8f7ca700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8814e310 con 0x7fcb880bd680 2023-11-30T17:26:04.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.810+0000 7fcb8dd67700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb880c20c0 0x7fcb880a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:04.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.810+0000 7fcb8dd67700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb880c20c0 0x7fcb880a5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50228/0 (socket says 172.21.15.49:50228) 2023-11-30T17:26:04.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.810+0000 7fcb8dd67700 1 -- 172.21.15.49:0/891619943 learned_addr learned my addr 172.21.15.49:0/891619943 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:04.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.810+0000 7fcb8cd65700 1 --2- 172.21.15.49:0/891619943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb880bdb30 0x7fcb8814edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:04.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.810+0000 7fcb8d566700 1 --2- 172.21.15.49:0/891619943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb880bd680 0x7fcb88160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:04.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.810+0000 7fcb8dd67700 1 -- 172.21.15.49:0/891619943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb880bd680 msgr2=0x7fcb88160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:04.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.810+0000 7fcb8dd67700 1 --2- 172.21.15.49:0/891619943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb880bd680 0x7fcb88160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:04.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.810+0000 7fcb8dd67700 1 -- 172.21.15.49:0/891619943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb880bdb30 msgr2=0x7fcb8814edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:04.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.810+0000 7fcb8dd67700 1 --2- 172.21.15.49:0/891619943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb880bdb30 0x7fcb8814edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:04.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.810+0000 7fcb8dd67700 1 -- 172.21.15.49:0/891619943 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8400b6a0 con 0x7fcb880c20c0 2023-11-30T17:26:04.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.810+0000 7fcb8cd65700 1 --2- 172.21.15.49:0/891619943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb880bdb30 0x7fcb8814edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:26:04.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.810+0000 7fcb8dd67700 1 --2- 172.21.15.49:0/891619943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb880c20c0 0x7fcb880a5040 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7fcb80009e90 tx=0x7fcb8000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:04.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.810+0000 7fcb7d7fa700 1 -- 172.21.15.49:0/891619943 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8000caa0 con 0x7fcb880c20c0 2023-11-30T17:26:04.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.810+0000 7fcb7d7fa700 1 -- 172.21.15.49:0/891619943 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8000f040 con 0x7fcb880c20c0 2023-11-30T17:26:04.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.810+0000 7fcb7d7fa700 1 -- 172.21.15.49:0/891619943 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8000ce10 con 0x7fcb880c20c0 2023-11-30T17:26:04.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.810+0000 7fcb8f7ca700 1 -- 172.21.15.49:0/891619943 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb8814e5f0 con 0x7fcb880c20c0 2023-11-30T17:26:04.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.811+0000 7fcb8f7ca700 1 -- 172.21.15.49:0/891619943 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb880c0bc0 con 0x7fcb880c20c0 2023-11-30T17:26:04.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.812+0000 7fcb8f7ca700 1 -- 172.21.15.49:0/891619943 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb880c0de0 con 0x7fcb880c20c0 2023-11-30T17:26:04.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.812+0000 7fcb7d7fa700 1 -- 172.21.15.49:0/891619943 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 55) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fcb80013610 con 0x7fcb880c20c0 2023-11-30T17:26:04.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.812+0000 7fcb7d7fa700 1 --2- 172.21.15.49:0/891619943 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcb6c05f390 0x7fcb6c061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:04.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.812+0000 7fcb7d7fa700 1 -- 172.21.15.49:0/891619943 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6463+0+0 (secure 0 0 0) 0x7fcb8007b050 con 0x7fcb880c20c0 2023-11-30T17:26:04.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.812+0000 7fcb8d566700 1 -- 172.21.15.49:0/891619943 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcb6c05f390 msgr2=0x7fcb6c061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:26:04.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.812+0000 7fcb8d566700 1 --2- 172.21.15.49:0/891619943 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcb6c05f390 0x7fcb6c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:26:04.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.817+0000 7fcb7d7fa700 1 -- 172.21.15.49:0/891619943 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcb880c0de0 con 0x7fcb880c20c0 2023-11-30T17:26:04.903 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:04.901+0000 7f3d853e9680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:26:04.956 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:04.953+0000 7f21503b3680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T17:26:04.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.991+0000 7fcb8f7ca700 1 -- 172.21.15.49:0/891619943 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcb880c0de0 con 0x7fcb880c20c0 2023-11-30T17:26:04.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.991+0000 7fcb7d7fa700 1 -- 172.21.15.49:0/891619943 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v132) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcb880c0de0 con 0x7fcb880c20c0 2023-11-30T17:26:04.993 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T17:26:04.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.993+0000 7fcb8f7ca700 1 -- 172.21.15.49:0/891619943 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcb6c05f390 msgr2=0x7fcb6c061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:26:04.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.993+0000 7fcb8f7ca700 1 --2- 172.21.15.49:0/891619943 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcb6c05f390 0x7fcb6c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:04.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.993+0000 7fcb8f7ca700 1 -- 172.21.15.49:0/891619943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb880c20c0 msgr2=0x7fcb880a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:04.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.993+0000 7fcb8f7ca700 1 --2- 172.21.15.49:0/891619943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb880c20c0 0x7fcb880a5040 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7fcb80009e90 tx=0x7fcb8000b040).stop 2023-11-30T17:26:04.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.993+0000 7fcb8f7ca700 1 -- 172.21.15.49:0/891619943 shutdown_connections 2023-11-30T17:26:04.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.993+0000 7fcb8f7ca700 1 --2- 172.21.15.49:0/891619943 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcb6c05f390 0x7fcb6c061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:04.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.993+0000 7fcb8f7ca700 1 --2- 172.21.15.49:0/891619943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb880c20c0 0x7fcb880a5040 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:04.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.993+0000 7fcb8f7ca700 1 --2- 172.21.15.49:0/891619943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb880bd680 0x7fcb88160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:04.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.993+0000 7fcb8f7ca700 1 --2- 172.21.15.49:0/891619943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb880bdb30 0x7fcb8814edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:04.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.993+0000 7fcb8f7ca700 1 -- 172.21.15.49:0/891619943 >> 172.21.15.49:0/891619943 conn(0x7fcb88062700 msgr2=0x7fcb88069050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:04.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.993+0000 7fcb8f7ca700 1 -- 172.21.15.49:0/891619943 shutdown_connections 2023-11-30T17:26:04.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:04.993+0000 7fcb8f7ca700 1 -- 172.21.15.49:0/891619943 wait complete. 2023-11-30T17:26:05.007 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-30T17:26:05.057 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:05.055+0000 7f3d853e9680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T17:26:05.066 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:05.064+0000 7f21503b3680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:26:05.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.128+0000 7f9fb985a700 1 Processor -- start 2023-11-30T17:26:05.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.128+0000 7f9fb985a700 1 -- start start 2023-11-30T17:26:05.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.129+0000 7f9fb985a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fb414e530 0x7f9fb40c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:05.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.129+0000 7f9fb985a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb40c7bc0 con 0x7f9fb4158570 2023-11-30T17:26:05.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.129+0000 7f9fb985a700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb4155920 con 0x7f9fb4154950 2023-11-30T17:26:05.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.129+0000 7f9fb985a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb4154dd0 con 0x7f9fb414e530 2023-11-30T17:26:05.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.129+0000 7f9fb9059700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9fb4158570 0x7f9fb40aa030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55854/0 (socket says 172.21.15.49:55854) 2023-11-30T17:26:05.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.129+0000 7f9fb9059700 1 -- 172.21.15.49:0/3670593721 learned_addr learned my addr 172.21.15.49:0/3670593721 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:05.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.129+0000 7f9fb8858700 1 --2- 172.21.15.49:0/3670593721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fb414e530 0x7f9fb40c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:05.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.129+0000 7f9fb37fe700 1 -- 172.21.15.49:0/3670593721 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984639948 0 0) 0x7f9fb40c7bc0 con 0x7f9fb4158570 2023-11-30T17:26:05.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.129+0000 7f9fb37fe700 1 -- 172.21.15.49:0/3670593721 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fa40033f0 con 0x7f9fb4158570 2023-11-30T17:26:05.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.130+0000 7f9fb37fe700 1 -- 172.21.15.49:0/3670593721 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 811597285 0 0) 0x7f9fb4155920 con 0x7f9fb4154950 2023-11-30T17:26:05.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.130+0000 7f9fb37fe700 1 -- 172.21.15.49:0/3670593721 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fb40c7bc0 con 0x7f9fb4154950 2023-11-30T17:26:05.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.130+0000 7f9fb8858700 1 -- 172.21.15.49:0/3670593721 >> v1:172.21.15.115:6789/0 conn(0x7f9fb4154950 legacy=0x7f9fb414e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:05.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.130+0000 7f9fb8858700 1 -- 172.21.15.49:0/3670593721 >> v1:172.21.15.49:6789/0 conn(0x7f9fb4158570 legacy=0x7f9fb40aa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:05.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.130+0000 7f9fb8858700 1 -- 172.21.15.49:0/3670593721 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb4155080 con 0x7f9fb414e530 2023-11-30T17:26:05.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.130+0000 7f9fb8858700 1 --2- 172.21.15.49:0/3670593721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fb414e530 0x7f9fb40c66f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f9fa8009790 tx=0x7f9fa8009060).ready entity=mon.2 client_cookie=3e294dcc9ac12752 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:05.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.130+0000 7f9fb37fe700 1 -- 172.21.15.49:0/3670593721 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa80090d0 con 0x7f9fb414e530 2023-11-30T17:26:05.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.130+0000 7f9fb37fe700 1 -- 172.21.15.49:0/3670593721 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa800f510 con 0x7f9fb414e530 2023-11-30T17:26:05.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.130+0000 7f9fb37fe700 1 -- 172.21.15.49:0/3670593721 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa800f890 con 0x7f9fb414e530 2023-11-30T17:26:05.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.131+0000 7f9fb985a700 1 -- 172.21.15.49:0/3670593721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fb414e530 msgr2=0x7f9fb40c66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:05.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.131+0000 7f9fb985a700 1 --2- 172.21.15.49:0/3670593721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fb414e530 0x7f9fb40c66f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f9fa8009790 tx=0x7f9fa8009060).stop 2023-11-30T17:26:05.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.131+0000 7f9fb985a700 1 -- 172.21.15.49:0/3670593721 shutdown_connections 2023-11-30T17:26:05.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.131+0000 7f9fb985a700 1 --2- 172.21.15.49:0/3670593721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fb414e530 0x7f9fb40c66f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:05.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.131+0000 7f9fb985a700 1 -- 172.21.15.49:0/3670593721 >> 172.21.15.49:0/3670593721 conn(0x7f9fb4064990 msgr2=0x7f9fb4064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:05.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.131+0000 7f9fb985a700 1 -- 172.21.15.49:0/3670593721 shutdown_connections 2023-11-30T17:26:05.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.131+0000 7f9fb985a700 1 -- 172.21.15.49:0/3670593721 wait complete. 2023-11-30T17:26:05.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.132+0000 7f9fb985a700 1 Processor -- start 2023-11-30T17:26:05.135 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:05.129+0000 7f3d853e9680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T17:26:05.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.132+0000 7f9fb985a700 1 -- start start 2023-11-30T17:26:05.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.133+0000 7f9fb985a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fb414e530 0x7f9fb40b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:05.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.133+0000 7f9fb985a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fb4154950 0x7f9fb41496a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:05.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.133+0000 7f9fb985a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fb4158570 0x7f9fb40c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:05.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.133+0000 7f9fb985a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb4153a00 con 0x7f9fb414e530 2023-11-30T17:26:05.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.133+0000 7f9fb985a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb40ae360 con 0x7f9fb4158570 2023-11-30T17:26:05.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.133+0000 7f9fb985a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb40ae030 con 0x7f9fb4154950 2023-11-30T17:26:05.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.133+0000 7f9fb8858700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fb414e530 0x7f9fb40b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:05.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.133+0000 7f9fb8858700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fb414e530 0x7f9fb40b0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50238/0 (socket says 172.21.15.49:50238) 2023-11-30T17:26:05.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.133+0000 7f9fb8858700 1 -- 172.21.15.49:0/3537373036 learned_addr learned my addr 172.21.15.49:0/3537373036 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:05.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.133+0000 7f9fb3fff700 1 --2- 172.21.15.49:0/3537373036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fb4154950 0x7f9fb41496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:05.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.133+0000 7f9fb9059700 1 --2- 172.21.15.49:0/3537373036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fb4158570 0x7f9fb40c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:05.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.133+0000 7f9fb8858700 1 -- 172.21.15.49:0/3537373036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fb4154950 msgr2=0x7f9fb41496a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:05.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.133+0000 7f9fb8858700 1 --2- 172.21.15.49:0/3537373036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fb4154950 0x7f9fb41496a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:05.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.133+0000 7f9fb8858700 1 -- 172.21.15.49:0/3537373036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fb4158570 msgr2=0x7f9fb40c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:05.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.133+0000 7f9fb8858700 1 --2- 172.21.15.49:0/3537373036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fb4158570 0x7f9fb40c42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:05.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.133+0000 7f9fb8858700 1 -- 172.21.15.49:0/3537373036 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa80092a0 con 0x7f9fb414e530 2023-11-30T17:26:05.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.133+0000 7f9fb8858700 1 --2- 172.21.15.49:0/3537373036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fb414e530 0x7f9fb40b0ac0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f9fb4064480 tx=0x7f9fa8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:05.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.133+0000 7f9fb0ff9700 1 -- 172.21.15.49:0/3537373036 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa800f890 con 0x7f9fb414e530 2023-11-30T17:26:05.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.133+0000 7f9fb0ff9700 1 -- 172.21.15.49:0/3537373036 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa800fc50 con 0x7f9fb414e530 2023-11-30T17:26:05.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.133+0000 7f9fb985a700 1 -- 172.21.15.49:0/3537373036 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb4164410 con 0x7f9fb414e530 2023-11-30T17:26:05.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.134+0000 7f9fb0ff9700 1 -- 172.21.15.49:0/3537373036 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa801b410 con 0x7f9fb414e530 2023-11-30T17:26:05.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.134+0000 7f9fb985a700 1 -- 172.21.15.49:0/3537373036 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb40c3310 con 0x7f9fb414e530 2023-11-30T17:26:05.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.135+0000 7f9fb985a700 1 -- 172.21.15.49:0/3537373036 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb40ae640 con 0x7f9fb414e530 2023-11-30T17:26:05.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.135+0000 7f9fb0ff9700 1 -- 172.21.15.49:0/3537373036 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 55) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f9fa801b780 con 0x7f9fb414e530 2023-11-30T17:26:05.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.135+0000 7f9fb0ff9700 1 --2- 172.21.15.49:0/3537373036 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9f9805f390 0x7f9f98061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:05.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.135+0000 7f9fb0ff9700 1 -- 172.21.15.49:0/3537373036 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f9fa807bf80 con 0x7f9fb414e530 2023-11-30T17:26:05.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.135+0000 7f9fb3fff700 1 -- 172.21.15.49:0/3537373036 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9f9805f390 msgr2=0x7f9f98061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:26:05.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.135+0000 7f9fb3fff700 1 --2- 172.21.15.49:0/3537373036 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9f9805f390 0x7f9f98061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:26:05.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.140+0000 7f9fb0ff9700 1 -- 172.21.15.49:0/3537373036 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9fa80aab00 con 0x7f9fb414e530 2023-11-30T17:26:05.200 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:05.198+0000 7f3d853e9680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T17:26:05.227 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:05.226+0000 7f21503b3680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T17:26:05.305 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:05.304+0000 7f21503b3680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T17:26:05.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.313+0000 7f9fb985a700 1 -- 172.21.15.49:0/3537373036 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9fb4062ee0 con 0x7f9fb414e530 2023-11-30T17:26:05.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.313+0000 7f9fb0ff9700 1 -- 172.21.15.49:0/3537373036 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v132) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9fa804ce00 con 0x7f9fb414e530 2023-11-30T17:26:05.315 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T17:26:05.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.316+0000 7f9fb985a700 1 -- 172.21.15.49:0/3537373036 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9f9805f390 msgr2=0x7f9f98061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:26:05.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.316+0000 7f9fb985a700 1 --2- 172.21.15.49:0/3537373036 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9f9805f390 0x7f9f98061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:05.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.316+0000 7f9fb985a700 1 -- 172.21.15.49:0/3537373036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fb414e530 msgr2=0x7f9fb40b0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:05.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.316+0000 7f9fb985a700 1 --2- 172.21.15.49:0/3537373036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fb414e530 0x7f9fb40b0ac0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f9fb4064480 tx=0x7f9fa8017000).stop 2023-11-30T17:26:05.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.316+0000 7f9fb985a700 1 -- 172.21.15.49:0/3537373036 shutdown_connections 2023-11-30T17:26:05.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.316+0000 7f9fb985a700 1 --2- 172.21.15.49:0/3537373036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fb4158570 0x7f9fb40c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:05.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.316+0000 7f9fb985a700 1 --2- 172.21.15.49:0/3537373036 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9f9805f390 0x7f9f98061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:05.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.316+0000 7f9fb985a700 1 --2- 172.21.15.49:0/3537373036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fb414e530 0x7f9fb40b0ac0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:05.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.316+0000 7f9fb985a700 1 --2- 172.21.15.49:0/3537373036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fb4154950 0x7f9fb41496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:05.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.316+0000 7f9fb985a700 1 -- 172.21.15.49:0/3537373036 >> 172.21.15.49:0/3537373036 conn(0x7f9fb4064990 msgr2=0x7f9fb40ca3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:05.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.316+0000 7f9fb985a700 1 -- 172.21.15.49:0/3537373036 shutdown_connections 2023-11-30T17:26:05.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.316+0000 7f9fb985a700 1 -- 172.21.15.49:0/3537373036 wait complete. 2023-11-30T17:26:05.330 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:26:05.378 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:05.377+0000 7f21503b3680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T17:26:05.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.447+0000 7f6141271700 1 Processor -- start 2023-11-30T17:26:05.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.447+0000 7f6141271700 1 -- start start 2023-11-30T17:26:05.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.448+0000 7f6141271700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f613c157a40 0x7f613c0648d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:05.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.448+0000 7f6141271700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f613c0c12c0 con 0x7f613c157660 2023-11-30T17:26:05.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.448+0000 7f6141271700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f613c0c06b0 con 0x7f613c0c0180 2023-11-30T17:26:05.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.448+0000 7f6141271700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f613c0c0990 con 0x7f613c157a40 2023-11-30T17:26:05.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.448+0000 7f613bfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f613c157660 0x7f613c1589c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55866/0 (socket says 172.21.15.49:55866) 2023-11-30T17:26:05.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.448+0000 7f613bfff700 1 -- 172.21.15.49:0/640370050 learned_addr learned my addr 172.21.15.49:0/640370050 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:05.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.448+0000 7f6140a70700 1 --2- 172.21.15.49:0/640370050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f613c157a40 0x7f613c0648d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:05.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.448+0000 7f613affd700 1 -- 172.21.15.49:0/640370050 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 462493574 0 0) 0x7f613c0c12c0 con 0x7f613c157660 2023-11-30T17:26:05.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.449+0000 7f613affd700 1 -- 172.21.15.49:0/640370050 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61240033f0 con 0x7f613c157660 2023-11-30T17:26:05.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.449+0000 7f613affd700 1 -- 172.21.15.49:0/640370050 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4293873831 0 0) 0x7f613c0c06b0 con 0x7f613c0c0180 2023-11-30T17:26:05.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.449+0000 7f613affd700 1 -- 172.21.15.49:0/640370050 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f613c0c12c0 con 0x7f613c0c0180 2023-11-30T17:26:05.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.449+0000 7f6140a70700 1 -- 172.21.15.49:0/640370050 >> v1:172.21.15.115:6789/0 conn(0x7f613c0c0180 legacy=0x7f613c0c1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:05.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.449+0000 7f6140a70700 1 -- 172.21.15.49:0/640370050 >> v1:172.21.15.49:6789/0 conn(0x7f613c157660 legacy=0x7f613c1589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:05.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.449+0000 7f613affd700 1 -- 172.21.15.49:0/640370050 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1507843671 0 0) 0x7f61240033f0 con 0x7f613c157660 2023-11-30T17:26:05.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.449+0000 7f6140a70700 1 -- 172.21.15.49:0/640370050 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f613c0c0c70 con 0x7f613c157a40 2023-11-30T17:26:05.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.449+0000 7f6140a70700 1 --2- 172.21.15.49:0/640370050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f613c157a40 0x7f613c0648d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f613c084710 tx=0x7f6134009780).ready entity=mon.2 client_cookie=bc2289208e2a1310 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:05.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.449+0000 7f613affd700 1 -- 172.21.15.49:0/640370050 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613400e070 con 0x7f613c157a40 2023-11-30T17:26:05.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.449+0000 7f613affd700 1 -- 172.21.15.49:0/640370050 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613400b7a0 con 0x7f613c157a40 2023-11-30T17:26:05.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.449+0000 7f613affd700 1 -- 172.21.15.49:0/640370050 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6130001470 con 0x7f613c157a40 2023-11-30T17:26:05.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.450+0000 7f6141271700 1 -- 172.21.15.49:0/640370050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f613c157a40 msgr2=0x7f613c0648d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:05.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.450+0000 7f6141271700 1 --2- 172.21.15.49:0/640370050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f613c157a40 0x7f613c0648d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f613c084710 tx=0x7f6134009780).stop 2023-11-30T17:26:05.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.450+0000 7f6141271700 1 -- 172.21.15.49:0/640370050 shutdown_connections 2023-11-30T17:26:05.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.450+0000 7f6141271700 1 --2- 172.21.15.49:0/640370050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f613c157a40 0x7f613c0648d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:05.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.450+0000 7f6141271700 1 -- 172.21.15.49:0/640370050 >> 172.21.15.49:0/640370050 conn(0x7f613c0cb000 msgr2=0x7f613c0cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:05.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.450+0000 7f6141271700 1 -- 172.21.15.49:0/640370050 shutdown_connections 2023-11-30T17:26:05.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.450+0000 7f6141271700 1 -- 172.21.15.49:0/640370050 wait complete. 2023-11-30T17:26:05.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.451+0000 7f6141271700 1 Processor -- start 2023-11-30T17:26:05.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.451+0000 7f6141271700 1 -- start start 2023-11-30T17:26:05.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.452+0000 7f6141271700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f613c0c0180 0x7f613c13c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:05.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.452+0000 7f6141271700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f613c157660 0x7f613c151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:05.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.452+0000 7f6141271700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f613c157a40 0x7f613c0adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:05.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.452+0000 7f6141271700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613c1674e0 con 0x7f613c157660 2023-11-30T17:26:05.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.452+0000 7f6141271700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613c168340 con 0x7f613c0c0180 2023-11-30T17:26:05.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.452+0000 7f6141271700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f613c167730 con 0x7f613c157a40 2023-11-30T17:26:05.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.452+0000 7f613b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f613c157660 0x7f613c151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:05.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.452+0000 7f613b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f613c157660 0x7f613c151730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50246/0 (socket says 172.21.15.49:50246) 2023-11-30T17:26:05.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.452+0000 7f613b7fe700 1 -- 172.21.15.49:0/951526165 learned_addr learned my addr 172.21.15.49:0/951526165 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:05.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.452+0000 7f6140a70700 1 --2- 172.21.15.49:0/951526165 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f613c157a40 0x7f613c0adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:05.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.452+0000 7f613bfff700 1 --2- 172.21.15.49:0/951526165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f613c0c0180 0x7f613c13c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:05.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.452+0000 7f613b7fe700 1 -- 172.21.15.49:0/951526165 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f613c157a40 msgr2=0x7f613c0adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:05.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.452+0000 7f613b7fe700 1 --2- 172.21.15.49:0/951526165 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f613c157a40 0x7f613c0adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:05.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.452+0000 7f613b7fe700 1 -- 172.21.15.49:0/951526165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f613c0c0180 msgr2=0x7f613c13c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:05.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.452+0000 7f613b7fe700 1 --2- 172.21.15.49:0/951526165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f613c0c0180 0x7f613c13c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:05.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.452+0000 7f613b7fe700 1 -- 172.21.15.49:0/951526165 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6134009a20 con 0x7f613c157660 2023-11-30T17:26:05.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.453+0000 7f613b7fe700 1 --2- 172.21.15.49:0/951526165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f613c157660 0x7f613c151730 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7f612c00c490 tx=0x7f612c007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:05.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.453+0000 7f6123fff700 1 -- 172.21.15.49:0/951526165 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c00ce40 con 0x7f613c157660 2023-11-30T17:26:05.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.453+0000 7f6123fff700 1 -- 172.21.15.49:0/951526165 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f612c00f470 con 0x7f613c157660 2023-11-30T17:26:05.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.453+0000 7f6141271700 1 -- 172.21.15.49:0/951526165 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f613c167a10 con 0x7f613c157660 2023-11-30T17:26:05.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.453+0000 7f6123fff700 1 -- 172.21.15.49:0/951526165 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c00f810 con 0x7f613c157660 2023-11-30T17:26:05.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.453+0000 7f6141271700 1 -- 172.21.15.49:0/951526165 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f613c167fd0 con 0x7f613c157660 2023-11-30T17:26:05.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.454+0000 7f6141271700 1 -- 172.21.15.49:0/951526165 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f613c06c7c0 con 0x7f613c157660 2023-11-30T17:26:05.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.454+0000 7f6123fff700 1 -- 172.21.15.49:0/951526165 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 55) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f612c00fbc0 con 0x7f613c157660 2023-11-30T17:26:05.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.454+0000 7f6123fff700 1 --2- 172.21.15.49:0/951526165 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f612805f390 0x7f6128061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:05.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.454+0000 7f6123fff700 1 -- 172.21.15.49:0/951526165 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f612c079d10 con 0x7f613c157660 2023-11-30T17:26:05.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.454+0000 7f613bfff700 1 -- 172.21.15.49:0/951526165 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f612805f390 msgr2=0x7f6128061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:26:05.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.455+0000 7f613bfff700 1 --2- 172.21.15.49:0/951526165 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f612805f390 0x7f6128061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:26:05.458 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:05.454+0000 7f3d853e9680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T17:26:05.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.458+0000 7f6123fff700 1 -- 172.21.15.49:0/951526165 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f612c07f020 con 0x7f613c157660 2023-11-30T17:26:05.640 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:05.637+0000 7f3d853e9680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T17:26:05.655 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:05.654+0000 7f21503b3680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T17:26:05.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.656+0000 7f613bfff700 1 -- 172.21.15.49:0/951526165 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f612805f390 msgr2=0x7f6128061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:26:05.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.656+0000 7f613bfff700 1 --2- 172.21.15.49:0/951526165 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f612805f390 0x7f6128061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:26:05.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.675+0000 7f6141271700 1 -- 172.21.15.49:0/951526165 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f613c0c0f50 con 0x7f613c157660 2023-11-30T17:26:05.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.676+0000 7f6123fff700 1 -- 172.21.15.49:0/951526165 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f612c04aad0 con 0x7f613c157660 2023-11-30T17:26:05.677 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:26:05.677 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":53,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/744782933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":744782933},{"type":"v1","addr":"172.21.15.115:6837","nonce":744782933}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7638,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/2409585815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2409585815},{"type":"v1","addr":"172.21.15.49:6834","nonce":2409585815}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7641,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3249829086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3249829086},{"type":"v1","addr":"172.21.15.49:6835","nonce":3249829086}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:25:07.786736+0000","modified":"2023-11-30T17:25:10.793530+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7650},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7650":{"gid":7650,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6835/3436956463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3436956463},{"type":"v1","addr":"172.21.15.115:6835","nonce":3436956463}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-11-30T17:26:05.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.677+0000 7f6141271700 1 -- 172.21.15.49:0/951526165 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f612805f390 msgr2=0x7f6128061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:26:05.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.677+0000 7f6141271700 1 --2- 172.21.15.49:0/951526165 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f612805f390 0x7f6128061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:05.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.677+0000 7f6141271700 1 -- 172.21.15.49:0/951526165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f613c157660 msgr2=0x7f613c151730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:05.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.677+0000 7f6141271700 1 --2- 172.21.15.49:0/951526165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f613c157660 0x7f613c151730 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7f612c00c490 tx=0x7f612c007c90).stop 2023-11-30T17:26:05.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.678+0000 7f6141271700 1 -- 172.21.15.49:0/951526165 shutdown_connections 2023-11-30T17:26:05.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.678+0000 7f6141271700 1 --2- 172.21.15.49:0/951526165 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f613c157a40 0x7f613c0adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:05.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.678+0000 7f6141271700 1 --2- 172.21.15.49:0/951526165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f613c0c0180 0x7f613c13c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:05.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.678+0000 7f6141271700 1 --2- 172.21.15.49:0/951526165 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f612805f390 0x7f6128061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:05.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.678+0000 7f6141271700 1 --2- 172.21.15.49:0/951526165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f613c157660 0x7f613c151730 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:05.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.678+0000 7f6141271700 1 -- 172.21.15.49:0/951526165 >> 172.21.15.49:0/951526165 conn(0x7f613c0cb000 msgr2=0x7f613c0ab1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:05.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.678+0000 7f6141271700 1 -- 172.21.15.49:0/951526165 shutdown_connections 2023-11-30T17:26:05.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.678+0000 7f6141271700 1 -- 172.21.15.49:0/951526165 wait complete. 2023-11-30T17:26:05.681 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 53 2023-11-30T17:26:05.692 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:26:05.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.814+0000 7f94bc874700 1 Processor -- start 2023-11-30T17:26:05.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.814+0000 7f94bc874700 1 -- start start 2023-11-30T17:26:05.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.815+0000 7f94bc874700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94b8066e00 0x7f94b80671e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:05.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.815+0000 7f94bc874700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f94b8155e40 0x7f94b80a5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:05.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.815+0000 7f94bc874700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94b80bd590 con 0x7f94b80a5e70 2023-11-30T17:26:05.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.815+0000 7f94bc874700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b8156370 con 0x7f94b8155e40 2023-11-30T17:26:05.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.815+0000 7f94bc874700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b8156650 con 0x7f94b8066e00 2023-11-30T17:26:05.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.815+0000 7f94b5d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f94b8155e40 0x7f94b80a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:05.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.815+0000 7f94b659c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94b8066e00 0x7f94b80671e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:05.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.815+0000 7f94b6d9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f94b80a5e70 0x7f94b8067980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:47876/0 (socket says 172.21.15.49:47876) 2023-11-30T17:26:05.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.815+0000 7f94b6d9d700 1 -- 172.21.15.49:0/1811477346 learned_addr learned my addr 172.21.15.49:0/1811477346 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:05.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.815+0000 7f94b5d9b700 1 -- 172.21.15.49:0/1811477346 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94b8066e00 msgr2=0x7f94b80671e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:05.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.815+0000 7f94b5d9b700 1 --2- 172.21.15.49:0/1811477346 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94b8066e00 0x7f94b80671e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:05.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.815+0000 7f94b5d9b700 1 -- 172.21.15.49:0/1811477346 >> v1:172.21.15.115:6789/0 conn(0x7f94b80a5e70 legacy=0x7f94b8067980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:05.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.815+0000 7f94b559a700 1 -- 172.21.15.49:0/1811477346 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1605294836 0 0) 0x7f94b80bd590 con 0x7f94b80a5e70 2023-11-30T17:26:05.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.815+0000 7f94b5d9b700 1 -- 172.21.15.49:0/1811477346 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b8156930 con 0x7f94b8155e40 2023-11-30T17:26:05.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.815+0000 7f94b659c700 1 --2- 172.21.15.49:0/1811477346 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94b8066e00 0x7f94b80671e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:26:05.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.815+0000 7f94b5d9b700 1 --2- 172.21.15.49:0/1811477346 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94b8155e40 0x7f94b80a5980 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f94ac009760 tx=0x7f94ac009060).ready entity=mon.1 client_cookie=58cb2f64a3fdc3e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:05.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.816+0000 7f94b559a700 1 -- 172.21.15.49:0/1811477346 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac00f510 con 0x7f94b8155e40 2023-11-30T17:26:05.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.816+0000 7f94b559a700 1 -- 172.21.15.49:0/1811477346 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ac00f670 con 0x7f94b8155e40 2023-11-30T17:26:05.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.816+0000 7f94b559a700 1 -- 172.21.15.49:0/1811477346 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac00f9f0 con 0x7f94b8155e40 2023-11-30T17:26:05.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.816+0000 7f94bc874700 1 -- 172.21.15.49:0/1811477346 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94b8155e40 msgr2=0x7f94b80a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:05.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.816+0000 7f94bc874700 1 --2- 172.21.15.49:0/1811477346 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94b8155e40 0x7f94b80a5980 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f94ac009760 tx=0x7f94ac009060).stop 2023-11-30T17:26:05.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.816+0000 7f94bc874700 1 -- 172.21.15.49:0/1811477346 shutdown_connections 2023-11-30T17:26:05.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.816+0000 7f94bc874700 1 --2- 172.21.15.49:0/1811477346 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94b8066e00 0x7f94b80671e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:05.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.816+0000 7f94bc874700 1 --2- 172.21.15.49:0/1811477346 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94b8155e40 0x7f94b80a5980 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:05.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.816+0000 7f94bc874700 1 -- 172.21.15.49:0/1811477346 >> 172.21.15.49:0/1811477346 conn(0x7f94b80c7fd0 msgr2=0x7f94b80c83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:05.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.816+0000 7f94bc874700 1 -- 172.21.15.49:0/1811477346 shutdown_connections 2023-11-30T17:26:05.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.816+0000 7f94bc874700 1 -- 172.21.15.49:0/1811477346 wait complete. 2023-11-30T17:26:05.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.817+0000 7f94bc874700 1 Processor -- start 2023-11-30T17:26:05.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.818+0000 7f94bc874700 1 -- start start 2023-11-30T17:26:05.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.818+0000 7f94bc874700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94b8066e00 0x7f94b80acb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:05.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.818+0000 7f94bc874700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94b8155e40 0x7f94b81500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:05.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.818+0000 7f94bc874700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94b8153f30 0x7f94b80c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:05.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.818+0000 7f94bc874700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b81505c0 con 0x7f94b8155e40 2023-11-30T17:26:05.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.818+0000 7f94bc874700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b80a7df0 con 0x7f94b8066e00 2023-11-30T17:26:05.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.818+0000 7f94bc874700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b8154710 con 0x7f94b8153f30 2023-11-30T17:26:05.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.818+0000 7f94b5d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94b8155e40 0x7f94b81500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:05.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.818+0000 7f94b5d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94b8155e40 0x7f94b81500d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50250/0 (socket says 172.21.15.49:50250) 2023-11-30T17:26:05.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.818+0000 7f94b5d9b700 1 -- 172.21.15.49:0/2924175104 learned_addr learned my addr 172.21.15.49:0/2924175104 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:05.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.818+0000 7f94b6d9d700 1 --2- 172.21.15.49:0/2924175104 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94b8153f30 0x7f94b80c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:05.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.818+0000 7f94b659c700 1 --2- 172.21.15.49:0/2924175104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94b8066e00 0x7f94b80acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:05.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.819+0000 7f94b5d9b700 1 -- 172.21.15.49:0/2924175104 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94b8153f30 msgr2=0x7f94b80c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:05.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.819+0000 7f94b5d9b700 1 --2- 172.21.15.49:0/2924175104 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94b8153f30 0x7f94b80c4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:05.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.819+0000 7f94b5d9b700 1 -- 172.21.15.49:0/2924175104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94b8066e00 msgr2=0x7f94b80acb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:05.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.819+0000 7f94b5d9b700 1 --2- 172.21.15.49:0/2924175104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94b8066e00 0x7f94b80acb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:05.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.819+0000 7f94b5d9b700 1 -- 172.21.15.49:0/2924175104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a80092a0 con 0x7f94b8155e40 2023-11-30T17:26:05.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.819+0000 7f94b659c700 1 --2- 172.21.15.49:0/2924175104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94b8066e00 0x7f94b80acb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:26:05.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.819+0000 7f94b5d9b700 1 --2- 172.21.15.49:0/2924175104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94b8155e40 0x7f94b81500d0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7f94b80c5dd0 tx=0x7f94ac017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:05.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.819+0000 7f94a67fc700 1 -- 172.21.15.49:0/2924175104 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac00fe80 con 0x7f94b8155e40 2023-11-30T17:26:05.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.819+0000 7f94a67fc700 1 -- 172.21.15.49:0/2924175104 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ac00f7e0 con 0x7f94b8155e40 2023-11-30T17:26:05.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.819+0000 7f94a67fc700 1 -- 172.21.15.49:0/2924175104 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac01c650 con 0x7f94b8155e40 2023-11-30T17:26:05.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.819+0000 7f94bc874700 1 -- 172.21.15.49:0/2924175104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94ac0092a0 con 0x7f94b8155e40 2023-11-30T17:26:05.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.819+0000 7f94bc874700 1 -- 172.21.15.49:0/2924175104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b8154cd0 con 0x7f94b8155e40 2023-11-30T17:26:05.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.820+0000 7f94bc874700 1 -- 172.21.15.49:0/2924175104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b80a7fb0 con 0x7f94b8155e40 2023-11-30T17:26:05.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.821+0000 7f94a67fc700 1 -- 172.21.15.49:0/2924175104 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 55) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f94ac01ca40 con 0x7f94b8155e40 2023-11-30T17:26:05.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.821+0000 7f94a67fc700 1 --2- 172.21.15.49:0/2924175104 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f949805f390 0x7f9498061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:05.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.821+0000 7f94a67fc700 1 -- 172.21.15.49:0/2924175104 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f94ac07c2c0 con 0x7f94b8155e40 2023-11-30T17:26:05.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.821+0000 7f94b659c700 1 -- 172.21.15.49:0/2924175104 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f949805f390 msgr2=0x7f9498061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:26:05.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.821+0000 7f94b659c700 1 --2- 172.21.15.49:0/2924175104 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f949805f390 0x7f9498061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:26:05.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:05.825+0000 7f94a67fc700 1 -- 172.21.15.49:0/2924175104 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f94ac04d140 con 0x7f94b8155e40 2023-11-30T17:26:05.851 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:05.849+0000 7f21503b3680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T17:26:06.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.000+0000 7f94bc874700 1 -- 172.21.15.49:0/2924175104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94b8156c10 con 0x7f94b8155e40 2023-11-30T17:26:06.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.001+0000 7f94a67fc700 1 -- 172.21.15.49:0/2924175104 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+17470 (secure 0 0 0) 0x7f94ac020090 con 0x7f94b8155e40 2023-11-30T17:26:06.002 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:26:06.003 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":132,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:26:04.009905+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:25:06.343377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-11-30T17:25:06.764214+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":132,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/2241073917":"2023-12-01T17:25:20.162884+0000","172.21.15.115:0/1091016185":"2023-12-01T17:25:20.162884+0000","172.21.15.115:0/129391862":"2023-12-01T17:25:20.162884+0000","172.21.15.115:0/1234588325":"2023-12-01T17:25:20.162884+0000","172.21.15.115:6833/89956":"2023-12-01T17:25:20.162884+0000","172.21.15.115:6832/89956":"2023-12-01T17:25:20.162884+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:26:06.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.002+0000 7f94bc874700 1 -- 172.21.15.49:0/2924175104 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f949805f390 msgr2=0x7f9498061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:26:06.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.002+0000 7f94bc874700 1 --2- 172.21.15.49:0/2924175104 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f949805f390 0x7f9498061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:06.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.002+0000 7f94bc874700 1 -- 172.21.15.49:0/2924175104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94b8155e40 msgr2=0x7f94b81500d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:06.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.002+0000 7f94bc874700 1 --2- 172.21.15.49:0/2924175104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94b8155e40 0x7f94b81500d0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7f94b80c5dd0 tx=0x7f94ac017000).stop 2023-11-30T17:26:06.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.002+0000 7f94bc874700 1 -- 172.21.15.49:0/2924175104 shutdown_connections 2023-11-30T17:26:06.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.002+0000 7f94bc874700 1 --2- 172.21.15.49:0/2924175104 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94b8153f30 0x7f94b80c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:06.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.002+0000 7f94bc874700 1 --2- 172.21.15.49:0/2924175104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94b8066e00 0x7f94b80acb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:06.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.002+0000 7f94bc874700 1 --2- 172.21.15.49:0/2924175104 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f949805f390 0x7f9498061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:06.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.002+0000 7f94bc874700 1 --2- 172.21.15.49:0/2924175104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94b8155e40 0x7f94b81500d0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:06.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.003+0000 7f94bc874700 1 -- 172.21.15.49:0/2924175104 >> 172.21.15.49:0/2924175104 conn(0x7f94b80c7fd0 msgr2=0x7f94b80c83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:06.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.003+0000 7f94bc874700 1 -- 172.21.15.49:0/2924175104 shutdown_connections 2023-11-30T17:26:06.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.003+0000 7f94bc874700 1 -- 172.21.15.49:0/2924175104 wait complete. 2023-11-30T17:26:06.017 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-30T17:26:06.017 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:26:06.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.134+0000 7f4d9ca85700 1 Processor -- start 2023-11-30T17:26:06.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.134+0000 7f4d9ca85700 1 -- start start 2023-11-30T17:26:06.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.135+0000 7f4d9ca85700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4d981548c0 0x7f4d9806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:06.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.135+0000 7f4d9ca85700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4d980c6e30 0x7f4d980c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:06.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.135+0000 7f4d9ca85700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d980c69a0 con 0x7f4d981544e0 2023-11-30T17:26:06.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.135+0000 7f4d9ca85700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d980c13a0 con 0x7f4d981548c0 2023-11-30T17:26:06.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.135+0000 7f4d9ca85700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d980c1680 con 0x7f4d980c6e30 2023-11-30T17:26:06.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.135+0000 7f4d95d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4d981548c0 0x7f4d9806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:06.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.135+0000 7f4d9659c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4d981544e0 0x7f4d980c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55880/0 (socket says 172.21.15.49:55880) 2023-11-30T17:26:06.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.135+0000 7f4d9659c700 1 -- 172.21.15.49:0/3313766783 learned_addr learned my addr 172.21.15.49:0/3313766783 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:06.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.136+0000 7f4d96d9d700 1 --2- 172.21.15.49:0/3313766783 >> v2:172.21.15.115:3300/0 conn(0x7f4d980c6e30 0x7f4d980c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:06.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.136+0000 7f4d95d9b700 1 -- 172.21.15.49:0/3313766783 >> v2:172.21.15.115:3300/0 conn(0x7f4d980c6e30 msgr2=0x7f4d980c72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:06.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.136+0000 7f4d95d9b700 1 --2- 172.21.15.49:0/3313766783 >> v2:172.21.15.115:3300/0 conn(0x7f4d980c6e30 0x7f4d980c72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:06.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.136+0000 7f4d95d9b700 1 -- 172.21.15.49:0/3313766783 >> v1:172.21.15.49:6789/0 conn(0x7f4d981544e0 legacy=0x7f4d980c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:06.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.136+0000 7f4d9559a700 1 -- 172.21.15.49:0/3313766783 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3664886247 0 0) 0x7f4d980c69a0 con 0x7f4d981544e0 2023-11-30T17:26:06.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.136+0000 7f4d95d9b700 1 -- 172.21.15.49:0/3313766783 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d980c6630 con 0x7f4d981548c0 2023-11-30T17:26:06.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.136+0000 7f4d95d9b700 1 --2- 172.21.15.49:0/3313766783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d981548c0 0x7f4d9806a610 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7f4d980cb240 tx=0x7f4d80009060).ready entity=mon.0 client_cookie=11bc6c178bc79923 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:06.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.136+0000 7f4d9559a700 1 -- 172.21.15.49:0/3313766783 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8000b580 con 0x7f4d981548c0 2023-11-30T17:26:06.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.136+0000 7f4d9559a700 1 -- 172.21.15.49:0/3313766783 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8000b6e0 con 0x7f4d981548c0 2023-11-30T17:26:06.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.136+0000 7f4d9559a700 1 -- 172.21.15.49:0/3313766783 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8000ba60 con 0x7f4d981548c0 2023-11-30T17:26:06.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.137+0000 7f4d9ca85700 1 -- 172.21.15.49:0/3313766783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d981548c0 msgr2=0x7f4d9806a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:06.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.137+0000 7f4d9ca85700 1 --2- 172.21.15.49:0/3313766783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d981548c0 0x7f4d9806a610 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7f4d980cb240 tx=0x7f4d80009060).stop 2023-11-30T17:26:06.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.137+0000 7f4d9ca85700 1 -- 172.21.15.49:0/3313766783 shutdown_connections 2023-11-30T17:26:06.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.137+0000 7f4d9ca85700 1 --2- 172.21.15.49:0/3313766783 >> v2:172.21.15.115:3300/0 conn(0x7f4d980c6e30 0x7f4d980c72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:06.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.137+0000 7f4d9ca85700 1 --2- 172.21.15.49:0/3313766783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d981548c0 0x7f4d9806a610 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:06.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.137+0000 7f4d9ca85700 1 -- 172.21.15.49:0/3313766783 >> 172.21.15.49:0/3313766783 conn(0x7f4d98085020 msgr2=0x7f4d98094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:06.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.137+0000 7f4d9ca85700 1 -- 172.21.15.49:0/3313766783 shutdown_connections 2023-11-30T17:26:06.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.137+0000 7f4d9ca85700 1 -- 172.21.15.49:0/3313766783 wait complete. 2023-11-30T17:26:06.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.138+0000 7f4d9ca85700 1 Processor -- start 2023-11-30T17:26:06.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.138+0000 7f4d9ca85700 1 -- start start 2023-11-30T17:26:06.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.139+0000 7f4d9ca85700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d980c6e30 0x7f4d980a8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:06.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.139+0000 7f4d9ca85700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d981544e0 0x7f4d98096e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:06.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.139+0000 7f4d9ca85700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d981548c0 0x7f4d98168590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:06.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.139+0000 7f4d9ca85700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d98097710 con 0x7f4d981548c0 2023-11-30T17:26:06.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.139+0000 7f4d9ca85700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d980979f0 con 0x7f4d980c6e30 2023-11-30T17:26:06.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.139+0000 7f4d9ca85700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d98097cd0 con 0x7f4d981544e0 2023-11-30T17:26:06.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.139+0000 7f4d96d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d981548c0 0x7f4d98168590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:06.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.139+0000 7f4d96d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d981548c0 0x7f4d98168590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50268/0 (socket says 172.21.15.49:50268) 2023-11-30T17:26:06.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.139+0000 7f4d96d9d700 1 -- 172.21.15.49:0/412017364 learned_addr learned my addr 172.21.15.49:0/412017364 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:06.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.139+0000 7f4d9659c700 1 --2- 172.21.15.49:0/412017364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d980c6e30 0x7f4d980a8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:06.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.139+0000 7f4d95d9b700 1 --2- 172.21.15.49:0/412017364 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d981544e0 0x7f4d98096e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:06.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.139+0000 7f4d96d9d700 1 -- 172.21.15.49:0/412017364 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d981544e0 msgr2=0x7f4d98096e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:06.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.139+0000 7f4d96d9d700 1 --2- 172.21.15.49:0/412017364 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d981544e0 0x7f4d98096e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:06.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.139+0000 7f4d96d9d700 1 -- 172.21.15.49:0/412017364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d980c6e30 msgr2=0x7f4d980a8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:06.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.139+0000 7f4d96d9d700 1 --2- 172.21.15.49:0/412017364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d980c6e30 0x7f4d980a8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:06.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.139+0000 7f4d96d9d700 1 -- 172.21.15.49:0/412017364 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d800092a0 con 0x7f4d981548c0 2023-11-30T17:26:06.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.139+0000 7f4d96d9d700 1 --2- 172.21.15.49:0/412017364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d981548c0 0x7f4d98168590 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7f4d90007f20 tx=0x7f4d90009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:06.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.140+0000 7f4d8e7fc700 1 -- 172.21.15.49:0/412017364 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9000eb90 con 0x7f4d981548c0 2023-11-30T17:26:06.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.140+0000 7f4d8e7fc700 1 -- 172.21.15.49:0/412017364 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9000ecf0 con 0x7f4d981548c0 2023-11-30T17:26:06.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.140+0000 7f4d9ca85700 1 -- 172.21.15.49:0/412017364 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d98097fb0 con 0x7f4d981548c0 2023-11-30T17:26:06.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.140+0000 7f4d8e7fc700 1 -- 172.21.15.49:0/412017364 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d90014610 con 0x7f4d981548c0 2023-11-30T17:26:06.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.140+0000 7f4d9ca85700 1 -- 172.21.15.49:0/412017364 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d98097300 con 0x7f4d981548c0 2023-11-30T17:26:06.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.141+0000 7f4d9ca85700 1 -- 172.21.15.49:0/412017364 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d9806b9b0 con 0x7f4d981548c0 2023-11-30T17:26:06.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.141+0000 7f4d8e7fc700 1 -- 172.21.15.49:0/412017364 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 55) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f4d90014980 con 0x7f4d981548c0 2023-11-30T17:26:06.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.142+0000 7f4d8e7fc700 1 --2- 172.21.15.49:0/412017364 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4d7805f390 0x7f4d78061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:06.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.142+0000 7f4d8e7fc700 1 -- 172.21.15.49:0/412017364 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f4d9007abf0 con 0x7f4d981548c0 2023-11-30T17:26:06.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.146+0000 7f4d8e7fc700 1 -- 172.21.15.49:0/412017364 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4d9004b9b0 con 0x7f4d981548c0 2023-11-30T17:26:06.286 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:06.283+0000 7f3d853e9680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T17:26:06.354 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:06.352+0000 7f3d853e9680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T17:26:06.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.363+0000 7f4d9ca85700 1 -- 172.21.15.49:0/412017364 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d980984d0 con 0x7f4d981548c0 2023-11-30T17:26:06.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.363+0000 7f4d8e7fc700 1 -- 172.21.15.49:0/412017364 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f4d9000ee60 con 0x7f4d981548c0 2023-11-30T17:26:06.365 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:26:06.365 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":53,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/744782933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":744782933},{"type":"v1","addr":"172.21.15.115:6837","nonce":744782933}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7638,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/2409585815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2409585815},{"type":"v1","addr":"172.21.15.49:6834","nonce":2409585815}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7641,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3249829086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3249829086},{"type":"v1","addr":"172.21.15.49:6835","nonce":3249829086}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:25:07.786736+0000","modified":"2023-11-30T17:25:10.793530+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7650},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7650":{"gid":7650,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6835/3436956463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3436956463},{"type":"v1","addr":"172.21.15.115:6835","nonce":3436956463}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-11-30T17:26:06.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.365+0000 7f4d9ca85700 1 -- 172.21.15.49:0/412017364 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4d7805f390 msgr2=0x7f4d78061850 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-30T17:26:06.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.365+0000 7f4d9ca85700 1 --2- 172.21.15.49:0/412017364 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4d7805f390 0x7f4d78061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:06.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.365+0000 7f4d9ca85700 1 -- 172.21.15.49:0/412017364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d981548c0 msgr2=0x7f4d98168590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:06.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.365+0000 7f4d9ca85700 1 --2- 172.21.15.49:0/412017364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d981548c0 0x7f4d98168590 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7f4d90007f20 tx=0x7f4d90009860).stop 2023-11-30T17:26:06.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.365+0000 7f4d9ca85700 1 -- 172.21.15.49:0/412017364 shutdown_connections 2023-11-30T17:26:06.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.365+0000 7f4d9ca85700 1 --2- 172.21.15.49:0/412017364 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4d7805f390 0x7f4d78061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:06.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.365+0000 7f4d9ca85700 1 --2- 172.21.15.49:0/412017364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d981548c0 0x7f4d98168590 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:06.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.365+0000 7f4d9ca85700 1 --2- 172.21.15.49:0/412017364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d980c6e30 0x7f4d980a8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:06.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.365+0000 7f4d9ca85700 1 --2- 172.21.15.49:0/412017364 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d981544e0 0x7f4d98096e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:06.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.365+0000 7f4d9ca85700 1 -- 172.21.15.49:0/412017364 >> 172.21.15.49:0/412017364 conn(0x7f4d98085020 msgr2=0x7f4d980c9890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:06.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.365+0000 7f4d9ca85700 1 -- 172.21.15.49:0/412017364 shutdown_connections 2023-11-30T17:26:06.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.365+0000 7f4d9ca85700 1 -- 172.21.15.49:0/412017364 wait complete. 2023-11-30T17:26:06.368 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 53 2023-11-30T17:26:06.379 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:26:06.429 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:06.426+0000 7f3d853e9680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T17:26:06.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.501+0000 7f2197515700 1 Processor -- start 2023-11-30T17:26:06.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.501+0000 7f2197515700 1 -- start start 2023-11-30T17:26:06.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.502+0000 7f2197515700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2190066e00 0x7f21900671e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:06.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.502+0000 7f2197515700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2190067980 0x7f2190067e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:06.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.502+0000 7f2197515700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21900bd590 con 0x7f2190155e40 2023-11-30T17:26:06.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.502+0000 7f2197515700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21900a6090 con 0x7f2190067980 2023-11-30T17:26:06.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.502+0000 7f2197515700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2190068300 con 0x7f2190066e00 2023-11-30T17:26:06.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.503+0000 7f2195ab2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2190067980 0x7f2190067e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:06.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.503+0000 7f2194ab0700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2190155e40 0x7f21900a5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55886/0 (socket says 172.21.15.49:55886) 2023-11-30T17:26:06.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.503+0000 7f2194ab0700 1 -- 172.21.15.49:0/2950775424 learned_addr learned my addr 172.21.15.49:0/2950775424 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:06.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.503+0000 7f21952b1700 1 --2- 172.21.15.49:0/2950775424 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2190066e00 0x7f21900671e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:06.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.503+0000 7f2195ab2700 1 -- 172.21.15.49:0/2950775424 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2190066e00 msgr2=0x7f21900671e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:06.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.503+0000 7f2195ab2700 1 --2- 172.21.15.49:0/2950775424 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2190066e00 0x7f21900671e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:06.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.503+0000 7f2195ab2700 1 -- 172.21.15.49:0/2950775424 >> v1:172.21.15.49:6789/0 conn(0x7f2190155e40 legacy=0x7f21900a5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:06.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.503+0000 7f2183fff700 1 -- 172.21.15.49:0/2950775424 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1975386635 0 0) 0x7f21900bd590 con 0x7f2190155e40 2023-11-30T17:26:06.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.503+0000 7f2195ab2700 1 -- 172.21.15.49:0/2950775424 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2190156370 con 0x7f2190067980 2023-11-30T17:26:06.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.503+0000 7f2195ab2700 1 --2- 172.21.15.49:0/2950775424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2190067980 0x7f2190067e10 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f2188009e60 tx=0x7f2188009780).ready entity=mon.0 client_cookie=4534d3f789be39a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:06.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.503+0000 7f2183fff700 1 -- 172.21.15.49:0/2950775424 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218800e070 con 0x7f2190067980 2023-11-30T17:26:06.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.503+0000 7f2183fff700 1 -- 172.21.15.49:0/2950775424 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218800bb60 con 0x7f2190067980 2023-11-30T17:26:06.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.503+0000 7f2183fff700 1 -- 172.21.15.49:0/2950775424 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2188012410 con 0x7f2190067980 2023-11-30T17:26:06.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.504+0000 7f2197515700 1 -- 172.21.15.49:0/2950775424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2190067980 msgr2=0x7f2190067e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:06.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.504+0000 7f2197515700 1 --2- 172.21.15.49:0/2950775424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2190067980 0x7f2190067e10 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f2188009e60 tx=0x7f2188009780).stop 2023-11-30T17:26:06.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.504+0000 7f2197515700 1 -- 172.21.15.49:0/2950775424 shutdown_connections 2023-11-30T17:26:06.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.504+0000 7f2197515700 1 --2- 172.21.15.49:0/2950775424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2190067980 0x7f2190067e10 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:06.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.504+0000 7f2197515700 1 --2- 172.21.15.49:0/2950775424 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2190066e00 0x7f21900671e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:06.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.504+0000 7f2197515700 1 -- 172.21.15.49:0/2950775424 >> 172.21.15.49:0/2950775424 conn(0x7f21900c7fd0 msgr2=0x7f21900c83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:06.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.504+0000 7f2197515700 1 -- 172.21.15.49:0/2950775424 shutdown_connections 2023-11-30T17:26:06.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.504+0000 7f2197515700 1 -- 172.21.15.49:0/2950775424 wait complete. 2023-11-30T17:26:06.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.506+0000 7f2197515700 1 Processor -- start 2023-11-30T17:26:06.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.506+0000 7f2197515700 1 -- start start 2023-11-30T17:26:06.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.507+0000 7f2197515700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2190066e00 0x7f219014f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:06.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.507+0000 7f2197515700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2190067980 0x7f2190154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:06.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.507+0000 7f2197515700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2190155e40 0x7f21900bfa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:06.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.507+0000 7f2197515700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2190154a40 con 0x7f2190066e00 2023-11-30T17:26:06.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.507+0000 7f2197515700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2190153e30 con 0x7f2190155e40 2023-11-30T17:26:06.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.507+0000 7f2197515700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2190154110 con 0x7f2190067980 2023-11-30T17:26:06.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.508+0000 7f21952b1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2190066e00 0x7f219014f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:06.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.508+0000 7f21952b1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2190066e00 0x7f219014f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50290/0 (socket says 172.21.15.49:50290) 2023-11-30T17:26:06.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.508+0000 7f21952b1700 1 -- 172.21.15.49:0/1476327433 learned_addr learned my addr 172.21.15.49:0/1476327433 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:06.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.508+0000 7f2194ab0700 1 --2- 172.21.15.49:0/1476327433 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2190067980 0x7f2190154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:06.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.508+0000 7f2195ab2700 1 --2- 172.21.15.49:0/1476327433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2190155e40 0x7f21900bfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:06.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.508+0000 7f21952b1700 1 -- 172.21.15.49:0/1476327433 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2190067980 msgr2=0x7f2190154ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:06.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.508+0000 7f21952b1700 1 --2- 172.21.15.49:0/1476327433 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2190067980 0x7f2190154ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:06.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.508+0000 7f21952b1700 1 -- 172.21.15.49:0/1476327433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2190155e40 msgr2=0x7f21900bfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:06.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.508+0000 7f21952b1700 1 --2- 172.21.15.49:0/1476327433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2190155e40 0x7f21900bfa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:06.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.508+0000 7f21952b1700 1 -- 172.21.15.49:0/1476327433 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2188009a20 con 0x7f2190066e00 2023-11-30T17:26:06.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.508+0000 7f21952b1700 1 --2- 172.21.15.49:0/1476327433 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2190066e00 0x7f219014f440 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7f218400e930 tx=0x7f2184009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:06.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.508+0000 7f21817fa700 1 -- 172.21.15.49:0/1476327433 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2184012600 con 0x7f2190066e00 2023-11-30T17:26:06.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.508+0000 7f21817fa700 1 -- 172.21.15.49:0/1476327433 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2184012760 con 0x7f2190066e00 2023-11-30T17:26:06.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.508+0000 7f21817fa700 1 -- 172.21.15.49:0/1476327433 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2184012ae0 con 0x7f2190066e00 2023-11-30T17:26:06.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.508+0000 7f2197515700 1 -- 172.21.15.49:0/1476327433 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21901543f0 con 0x7f2190066e00 2023-11-30T17:26:06.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.508+0000 7f2197515700 1 -- 172.21.15.49:0/1476327433 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2190153b20 con 0x7f2190066e00 2023-11-30T17:26:06.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.509+0000 7f2197515700 1 -- 172.21.15.49:0/1476327433 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f219006c860 con 0x7f2190066e00 2023-11-30T17:26:06.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.510+0000 7f21817fa700 1 -- 172.21.15.49:0/1476327433 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 55) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f218401b400 con 0x7f2190066e00 2023-11-30T17:26:06.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.510+0000 7f21817fa700 1 --2- 172.21.15.49:0/1476327433 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f217405f390 0x7f2174061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:06.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.510+0000 7f2194ab0700 1 -- 172.21.15.49:0/1476327433 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f217405f390 msgr2=0x7f2174061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:26:06.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.510+0000 7f21817fa700 1 -- 172.21.15.49:0/1476327433 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f218407aba0 con 0x7f2190066e00 2023-11-30T17:26:06.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.510+0000 7f2194ab0700 1 --2- 172.21.15.49:0/1476327433 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f217405f390 0x7f2174061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:26:06.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.514+0000 7f21817fa700 1 -- 172.21.15.49:0/1476327433 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f218404b9c0 con 0x7f2190066e00 2023-11-30T17:26:06.549 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:06.548+0000 7f21503b3680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T17:26:06.577 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:06.574+0000 7f3d853e9680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T17:26:06.622 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:06.620+0000 7f21503b3680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T17:26:06.646 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:06.644+0000 7f3d853e9680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T17:26:06.700 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:06.699+0000 7f21503b3680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T17:26:06.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.711+0000 7f2194ab0700 1 -- 172.21.15.49:0/1476327433 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f217405f390 msgr2=0x7f2174061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:26:06.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.711+0000 7f2194ab0700 1 --2- 172.21.15.49:0/1476327433 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f217405f390 0x7f2174061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:26:06.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.731+0000 7f2197515700 1 -- 172.21.15.49:0/1476327433 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2190156650 con 0x7f2190066e00 2023-11-30T17:26:06.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.732+0000 7f21817fa700 1 -- 172.21.15.49:0/1476327433 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f218404efe0 con 0x7f2190066e00 2023-11-30T17:26:06.734 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:26:06.734 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":53,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/744782933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":744782933},{"type":"v1","addr":"172.21.15.115:6837","nonce":744782933}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7638,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/2409585815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2409585815},{"type":"v1","addr":"172.21.15.49:6834","nonce":2409585815}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7641,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3249829086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3249829086},{"type":"v1","addr":"172.21.15.49:6835","nonce":3249829086}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:25:07.786736+0000","modified":"2023-11-30T17:25:10.793530+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7650},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7650":{"gid":7650,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6835/3436956463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3436956463},{"type":"v1","addr":"172.21.15.115:6835","nonce":3436956463}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-11-30T17:26:06.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.734+0000 7f2197515700 1 -- 172.21.15.49:0/1476327433 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f217405f390 msgr2=0x7f2174061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:26:06.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.734+0000 7f2197515700 1 --2- 172.21.15.49:0/1476327433 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f217405f390 0x7f2174061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:06.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.734+0000 7f2197515700 1 -- 172.21.15.49:0/1476327433 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2190066e00 msgr2=0x7f219014f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:06.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.734+0000 7f2197515700 1 --2- 172.21.15.49:0/1476327433 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2190066e00 0x7f219014f440 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7f218400e930 tx=0x7f2184009060).stop 2023-11-30T17:26:06.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.734+0000 7f2197515700 1 -- 172.21.15.49:0/1476327433 shutdown_connections 2023-11-30T17:26:06.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.734+0000 7f2197515700 1 --2- 172.21.15.49:0/1476327433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2190155e40 0x7f21900bfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:06.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.734+0000 7f2197515700 1 --2- 172.21.15.49:0/1476327433 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f217405f390 0x7f2174061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:06.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.734+0000 7f2197515700 1 --2- 172.21.15.49:0/1476327433 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2190066e00 0x7f219014f440 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:06.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.734+0000 7f2197515700 1 --2- 172.21.15.49:0/1476327433 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2190067980 0x7f2190154ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:06.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.734+0000 7f2197515700 1 -- 172.21.15.49:0/1476327433 >> 172.21.15.49:0/1476327433 conn(0x7f21900c7fd0 msgr2=0x7f21900bdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:06.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.734+0000 7f2197515700 1 -- 172.21.15.49:0/1476327433 shutdown_connections 2023-11-30T17:26:06.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.734+0000 7f2197515700 1 -- 172.21.15.49:0/1476327433 wait complete. 2023-11-30T17:26:06.737 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 53 2023-11-30T17:26:06.748 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:26:06.762 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:06.759+0000 7f3d853e9680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T17:26:06.857 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:06.856+0000 7f21503b3680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T17:26:06.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.866+0000 7fb6d7e84700 1 Processor -- start 2023-11-30T17:26:06.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.866+0000 7fb6d7e84700 1 -- start start 2023-11-30T17:26:06.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.867+0000 7fb6d7e84700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb6d01542d0 0x7fb6d00697f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:06.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.867+0000 7fb6d7e84700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb6d0069ce0 0x7fb6d0062700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:06.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.867+0000 7fb6d7e84700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6d0062bf0 0x7fb6d0157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:06.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.867+0000 7fb6d7e84700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d0065760 con 0x7fb6d01542d0 2023-11-30T17:26:06.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.867+0000 7fb6d7e84700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d0063080 con 0x7fb6d0069ce0 2023-11-30T17:26:06.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.867+0000 7fb6d7e84700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d00c3250 con 0x7fb6d0062bf0 2023-11-30T17:26:06.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.867+0000 7fb6d5c20700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb6d01542d0 0x7fb6d00697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:06.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.867+0000 7fb6d5c20700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb6d01542d0 0x7fb6d00697f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50298/0 (socket says 172.21.15.49:50298) 2023-11-30T17:26:06.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.867+0000 7fb6d5c20700 1 -- 172.21.15.49:0/4044646502 learned_addr learned my addr 172.21.15.49:0/4044646502 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:06.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.867+0000 7fb6d541f700 1 --2- 172.21.15.49:0/4044646502 >> v2:172.21.15.115:3300/0 conn(0x7fb6d0069ce0 0x7fb6d0062700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:06.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.867+0000 7fb6d6421700 1 --2- 172.21.15.49:0/4044646502 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6d0062bf0 0x7fb6d0157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:06.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.868+0000 7fb6d5c20700 1 -- 172.21.15.49:0/4044646502 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6d0062bf0 msgr2=0x7fb6d0157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:06.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.868+0000 7fb6d5c20700 1 --2- 172.21.15.49:0/4044646502 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6d0062bf0 0x7fb6d0157fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:06.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.868+0000 7fb6d5c20700 1 -- 172.21.15.49:0/4044646502 >> v2:172.21.15.115:3300/0 conn(0x7fb6d0069ce0 msgr2=0x7fb6d0062700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:06.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.868+0000 7fb6d5c20700 1 --2- 172.21.15.49:0/4044646502 >> v2:172.21.15.115:3300/0 conn(0x7fb6d0069ce0 0x7fb6d0062700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:06.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.868+0000 7fb6d5c20700 1 -- 172.21.15.49:0/4044646502 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d006a340 con 0x7fb6d01542d0 2023-11-30T17:26:06.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.868+0000 7fb6d5c20700 1 --2- 172.21.15.49:0/4044646502 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6d01542d0 0x7fb6d00697f0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7fb6d0069020 tx=0x7fb6c40090f0).ready entity=mon.0 client_cookie=fd4f256639081919 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:06.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.868+0000 7fb6d4c1e700 1 -- 172.21.15.49:0/4044646502 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c400f510 con 0x7fb6d01542d0 2023-11-30T17:26:06.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.868+0000 7fb6d4c1e700 1 -- 172.21.15.49:0/4044646502 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c400f670 con 0x7fb6d01542d0 2023-11-30T17:26:06.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.868+0000 7fb6d4c1e700 1 -- 172.21.15.49:0/4044646502 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c400fa10 con 0x7fb6d01542d0 2023-11-30T17:26:06.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.868+0000 7fb6d7e84700 1 -- 172.21.15.49:0/4044646502 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6d01542d0 msgr2=0x7fb6d00697f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:06.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.868+0000 7fb6d7e84700 1 --2- 172.21.15.49:0/4044646502 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6d01542d0 0x7fb6d00697f0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7fb6d0069020 tx=0x7fb6c40090f0).stop 2023-11-30T17:26:06.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.869+0000 7fb6d7e84700 1 -- 172.21.15.49:0/4044646502 shutdown_connections 2023-11-30T17:26:06.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.869+0000 7fb6d7e84700 1 --2- 172.21.15.49:0/4044646502 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6d0062bf0 0x7fb6d0157fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:06.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.869+0000 7fb6d7e84700 1 --2- 172.21.15.49:0/4044646502 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6d01542d0 0x7fb6d00697f0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:06.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.869+0000 7fb6d7e84700 1 --2- 172.21.15.49:0/4044646502 >> v2:172.21.15.115:3300/0 conn(0x7fb6d0069ce0 0x7fb6d0062700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:06.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.869+0000 7fb6d7e84700 1 -- 172.21.15.49:0/4044646502 >> 172.21.15.49:0/4044646502 conn(0x7fb6d00c7fd0 msgr2=0x7fb6d00c83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:06.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.869+0000 7fb6d7e84700 1 -- 172.21.15.49:0/4044646502 shutdown_connections 2023-11-30T17:26:06.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.869+0000 7fb6d7e84700 1 -- 172.21.15.49:0/4044646502 wait complete. 2023-11-30T17:26:06.872 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:06.867+0000 7f3d853e9680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:26:06.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.870+0000 7fb6d7e84700 1 Processor -- start 2023-11-30T17:26:06.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.870+0000 7fb6d7e84700 1 -- start start 2023-11-30T17:26:06.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.871+0000 7fb6d7e84700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6d0062bf0 0x7fb6d00abf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:06.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.871+0000 7fb6d7e84700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6d0069ce0 0x7fb6d00ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:06.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.871+0000 7fb6d7e84700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6d01542d0 0x7fb6d00a8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:06.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.871+0000 7fb6d7e84700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d00ac430 con 0x7fb6d0069ce0 2023-11-30T17:26:06.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.871+0000 7fb6d7e84700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d01646a0 con 0x7fb6d0062bf0 2023-11-30T17:26:06.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.871+0000 7fb6d7e84700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d0164980 con 0x7fb6d01542d0 2023-11-30T17:26:06.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.871+0000 7fb6d541f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6d0069ce0 0x7fb6d00ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:06.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.871+0000 7fb6d541f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6d0069ce0 0x7fb6d00ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50314/0 (socket says 172.21.15.49:50314) 2023-11-30T17:26:06.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.871+0000 7fb6d541f700 1 -- 172.21.15.49:0/2141181987 learned_addr learned my addr 172.21.15.49:0/2141181987 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:06.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.871+0000 7fb6d5c20700 1 --2- 172.21.15.49:0/2141181987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6d0062bf0 0x7fb6d00abf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:06.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.871+0000 7fb6d6421700 1 --2- 172.21.15.49:0/2141181987 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6d01542d0 0x7fb6d00a8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:06.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.871+0000 7fb6d5c20700 1 -- 172.21.15.49:0/2141181987 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6d01542d0 msgr2=0x7fb6d00a8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:06.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.871+0000 7fb6d5c20700 1 --2- 172.21.15.49:0/2141181987 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6d01542d0 0x7fb6d00a8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:06.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.871+0000 7fb6d5c20700 1 -- 172.21.15.49:0/2141181987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6d0069ce0 msgr2=0x7fb6d00ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:06.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.871+0000 7fb6d5c20700 1 --2- 172.21.15.49:0/2141181987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6d0069ce0 0x7fb6d00ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:06.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.871+0000 7fb6d5c20700 1 -- 172.21.15.49:0/2141181987 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c4009370 con 0x7fb6d0062bf0 2023-11-30T17:26:06.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.871+0000 7fb6d541f700 1 --2- 172.21.15.49:0/2141181987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6d0069ce0 0x7fb6d00ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:26:06.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.871+0000 7fb6d5c20700 1 --2- 172.21.15.49:0/2141181987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6d0062bf0 0x7fb6d00abf40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7fb6c4014000 tx=0x7fb6c4017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:06.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.871+0000 7fb6c1ffb700 1 -- 172.21.15.49:0/2141181987 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4006d90 con 0x7fb6d0062bf0 2023-11-30T17:26:06.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.871+0000 7fb6c1ffb700 1 -- 172.21.15.49:0/2141181987 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c4000bc0 con 0x7fb6d0062bf0 2023-11-30T17:26:06.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.872+0000 7fb6d7e84700 1 -- 172.21.15.49:0/2141181987 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d0164c60 con 0x7fb6d0062bf0 2023-11-30T17:26:06.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.872+0000 7fb6c1ffb700 1 -- 172.21.15.49:0/2141181987 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c400f7e0 con 0x7fb6d0062bf0 2023-11-30T17:26:06.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.872+0000 7fb6d7e84700 1 -- 172.21.15.49:0/2141181987 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d0165220 con 0x7fb6d0062bf0 2023-11-30T17:26:06.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.873+0000 7fb6d7e84700 1 -- 172.21.15.49:0/2141181987 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d00c01a0 con 0x7fb6d0062bf0 2023-11-30T17:26:06.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.873+0000 7fb6c1ffb700 1 -- 172.21.15.49:0/2141181987 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 55) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fb6c4022020 con 0x7fb6d0062bf0 2023-11-30T17:26:06.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.873+0000 7fb6c1ffb700 1 --2- 172.21.15.49:0/2141181987 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb6b405f390 0x7fb6b4061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:06.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.873+0000 7fb6c1ffb700 1 -- 172.21.15.49:0/2141181987 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6463+0+0 (secure 0 0 0) 0x7fb6c407be30 con 0x7fb6d0062bf0 2023-11-30T17:26:06.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.873+0000 7fb6d541f700 1 -- 172.21.15.49:0/2141181987 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb6b405f390 msgr2=0x7fb6b4061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:26:06.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.873+0000 7fb6d541f700 1 --2- 172.21.15.49:0/2141181987 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb6b405f390 0x7fb6b4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:26:06.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:06.878+0000 7fb6c1ffb700 1 -- 172.21.15.49:0/2141181987 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb6c404ccb0 con 0x7fb6d0062bf0 2023-11-30T17:26:06.934 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:06.933+0000 7f21503b3680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T17:26:07.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.051+0000 7fb6d7e84700 1 -- 172.21.15.49:0/2141181987 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6d006c860 con 0x7fb6d0062bf0 2023-11-30T17:26:07.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.052+0000 7fb6c1ffb700 1 -- 172.21.15.49:0/2141181987 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+17470 (secure 0 0 0) 0x7fb6c402a030 con 0x7fb6d0062bf0 2023-11-30T17:26:07.053 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:26:07.053 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":132,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:26:04.009905+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:25:06.343377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-11-30T17:25:06.764214+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":132,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/2241073917":"2023-12-01T17:25:20.162884+0000","172.21.15.115:0/1091016185":"2023-12-01T17:25:20.162884+0000","172.21.15.115:0/129391862":"2023-12-01T17:25:20.162884+0000","172.21.15.115:0/1234588325":"2023-12-01T17:25:20.162884+0000","172.21.15.115:6833/89956":"2023-12-01T17:25:20.162884+0000","172.21.15.115:6832/89956":"2023-12-01T17:25:20.162884+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:26:07.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.054+0000 7fb6d7e84700 1 -- 172.21.15.49:0/2141181987 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb6b405f390 msgr2=0x7fb6b4061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:26:07.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.054+0000 7fb6d7e84700 1 --2- 172.21.15.49:0/2141181987 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb6b405f390 0x7fb6b4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:07.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.054+0000 7fb6d7e84700 1 -- 172.21.15.49:0/2141181987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6d0062bf0 msgr2=0x7fb6d00abf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:07.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.054+0000 7fb6d7e84700 1 --2- 172.21.15.49:0/2141181987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6d0062bf0 0x7fb6d00abf40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7fb6c4014000 tx=0x7fb6c4017000).stop 2023-11-30T17:26:07.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.054+0000 7fb6d7e84700 1 -- 172.21.15.49:0/2141181987 shutdown_connections 2023-11-30T17:26:07.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.054+0000 7fb6d7e84700 1 --2- 172.21.15.49:0/2141181987 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6d01542d0 0x7fb6d00a8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:07.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.054+0000 7fb6d7e84700 1 --2- 172.21.15.49:0/2141181987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6d0062bf0 0x7fb6d00abf40 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:07.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.054+0000 7fb6d7e84700 1 --2- 172.21.15.49:0/2141181987 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb6b405f390 0x7fb6b4061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:07.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.054+0000 7fb6d7e84700 1 --2- 172.21.15.49:0/2141181987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6d0069ce0 0x7fb6d00ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:07.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.054+0000 7fb6d7e84700 1 -- 172.21.15.49:0/2141181987 >> 172.21.15.49:0/2141181987 conn(0x7fb6d00c7fd0 msgr2=0x7fb6d00a6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:07.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.054+0000 7fb6d7e84700 1 -- 172.21.15.49:0/2141181987 shutdown_connections 2023-11-30T17:26:07.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.054+0000 7fb6d7e84700 1 -- 172.21.15.49:0/2141181987 wait complete. 2023-11-30T17:26:07.058 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:07.056+0000 7f21503b3680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T17:26:07.068 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-30T17:26:07.161 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:07.158+0000 7f3d853e9680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T17:26:07.174 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:07.172+0000 7f21503b3680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:26:07.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.186+0000 7f4e01bc7700 1 Processor -- start 2023-11-30T17:26:07.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.186+0000 7f4e01bc7700 1 -- start start 2023-11-30T17:26:07.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.187+0000 7f4e01bc7700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4dfc14eb00 0x7f4dfc14eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:07.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.187+0000 7f4e01bc7700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dfc0634a0 con 0x7f4dfc0bc6c0 2023-11-30T17:26:07.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.187+0000 7f4e01bc7700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dfc063780 con 0x7f4dfc062e80 2023-11-30T17:26:07.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.187+0000 7f4e01bc7700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dfc137d90 con 0x7f4dfc14eb00 2023-11-30T17:26:07.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.187+0000 7f4dfaffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4dfc0bc6c0 0x7f4dfc062770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55892/0 (socket says 172.21.15.49:55892) 2023-11-30T17:26:07.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.187+0000 7f4dfaffd700 1 -- 172.21.15.49:0/2749015968 learned_addr learned my addr 172.21.15.49:0/2749015968 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:07.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.187+0000 7f4dfb7fe700 1 --2- 172.21.15.49:0/2749015968 >> v2:172.21.15.115:3300/0 conn(0x7f4dfc14eb00 0x7f4dfc14eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:07.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.188+0000 7f4dfa7fc700 1 -- 172.21.15.49:0/2749015968 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276183021 0 0) 0x7f4dfc0634a0 con 0x7f4dfc0bc6c0 2023-11-30T17:26:07.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.188+0000 7f4dfa7fc700 1 -- 172.21.15.49:0/2749015968 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4de80033f0 con 0x7f4dfc0bc6c0 2023-11-30T17:26:07.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.188+0000 7f4dfa7fc700 1 -- 172.21.15.49:0/2749015968 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271120093 0 0) 0x7f4dfc063780 con 0x7f4dfc062e80 2023-11-30T17:26:07.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.188+0000 7f4dfa7fc700 1 -- 172.21.15.49:0/2749015968 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dfc0634a0 con 0x7f4dfc062e80 2023-11-30T17:26:07.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.188+0000 7f4dfb7fe700 1 -- 172.21.15.49:0/2749015968 >> v1:172.21.15.115:6789/0 conn(0x7f4dfc062e80 legacy=0x7f4dfc155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:07.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.188+0000 7f4dfb7fe700 1 -- 172.21.15.49:0/2749015968 >> v1:172.21.15.49:6789/0 conn(0x7f4dfc0bc6c0 legacy=0x7f4dfc062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:07.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.188+0000 7f4dfb7fe700 1 -- 172.21.15.49:0/2749015968 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dfc063a60 con 0x7f4dfc14eb00 2023-11-30T17:26:07.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.188+0000 7f4dfb7fe700 1 --2- 172.21.15.49:0/2749015968 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dfc14eb00 0x7f4dfc14eee0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f4de4006fd0 tx=0x7f4de4006f40).ready entity=mon.1 client_cookie=13c0d4cee2a3c6c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:07.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.188+0000 7f4dfa7fc700 1 -- 172.21.15.49:0/2749015968 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4005880 con 0x7f4dfc14eb00 2023-11-30T17:26:07.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.188+0000 7f4dfa7fc700 1 -- 172.21.15.49:0/2749015968 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de40059e0 con 0x7f4dfc14eb00 2023-11-30T17:26:07.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.188+0000 7f4dfa7fc700 1 -- 172.21.15.49:0/2749015968 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4005d60 con 0x7f4dfc14eb00 2023-11-30T17:26:07.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.189+0000 7f4e01bc7700 1 -- 172.21.15.49:0/2749015968 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dfc14eb00 msgr2=0x7f4dfc14eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:07.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.189+0000 7f4e01bc7700 1 --2- 172.21.15.49:0/2749015968 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dfc14eb00 0x7f4dfc14eee0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f4de4006fd0 tx=0x7f4de4006f40).stop 2023-11-30T17:26:07.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.189+0000 7f4e01bc7700 1 -- 172.21.15.49:0/2749015968 shutdown_connections 2023-11-30T17:26:07.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.189+0000 7f4e01bc7700 1 --2- 172.21.15.49:0/2749015968 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dfc14eb00 0x7f4dfc14eee0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:07.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.189+0000 7f4e01bc7700 1 -- 172.21.15.49:0/2749015968 >> 172.21.15.49:0/2749015968 conn(0x7f4dfc0c8230 msgr2=0x7f4dfc0c4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:07.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.189+0000 7f4e01bc7700 1 -- 172.21.15.49:0/2749015968 shutdown_connections 2023-11-30T17:26:07.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.189+0000 7f4e01bc7700 1 -- 172.21.15.49:0/2749015968 wait complete. 2023-11-30T17:26:07.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.190+0000 7f4e01bc7700 1 Processor -- start 2023-11-30T17:26:07.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.190+0000 7f4e01bc7700 1 -- start start 2023-11-30T17:26:07.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.191+0000 7f4e01bc7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dfc062e80 0x7f4dfc137290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:07.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.191+0000 7f4e01bc7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4dfc0bc6c0 0x7f4dfc0661b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:07.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.191+0000 7f4e01bc7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dfc14eb00 0x7f4dfc0666a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:07.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.191+0000 7f4e01bc7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc066b90 con 0x7f4dfc062e80 2023-11-30T17:26:07.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.191+0000 7f4e01bc7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc150590 con 0x7f4dfc14eb00 2023-11-30T17:26:07.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.191+0000 7f4e01bc7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc155ce0 con 0x7f4dfc0bc6c0 2023-11-30T17:26:07.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.191+0000 7f4dfb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dfc062e80 0x7f4dfc137290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:07.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.191+0000 7f4dfb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dfc062e80 0x7f4dfc137290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50324/0 (socket says 172.21.15.49:50324) 2023-11-30T17:26:07.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.191+0000 7f4dfb7fe700 1 -- 172.21.15.49:0/1377517662 learned_addr learned my addr 172.21.15.49:0/1377517662 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:07.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.191+0000 7f4dfaffd700 1 --2- 172.21.15.49:0/1377517662 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4dfc0bc6c0 0x7f4dfc0661b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:07.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.191+0000 7f4dfbfff700 1 --2- 172.21.15.49:0/1377517662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dfc14eb00 0x7f4dfc0666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:07.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.191+0000 7f4dfb7fe700 1 -- 172.21.15.49:0/1377517662 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4dfc0bc6c0 msgr2=0x7f4dfc0661b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:07.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.191+0000 7f4dfb7fe700 1 --2- 172.21.15.49:0/1377517662 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4dfc0bc6c0 0x7f4dfc0661b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:07.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.191+0000 7f4dfb7fe700 1 -- 172.21.15.49:0/1377517662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dfc14eb00 msgr2=0x7f4dfc0666a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:07.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.191+0000 7f4dfb7fe700 1 --2- 172.21.15.49:0/1377517662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dfc14eb00 0x7f4dfc0666a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:07.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.191+0000 7f4dfb7fe700 1 -- 172.21.15.49:0/1377517662 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de4009250 con 0x7f4dfc062e80 2023-11-30T17:26:07.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.191+0000 7f4dfbfff700 1 --2- 172.21.15.49:0/1377517662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dfc14eb00 0x7f4dfc0666a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:26:07.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.192+0000 7f4dfb7fe700 1 --2- 172.21.15.49:0/1377517662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dfc062e80 0x7f4dfc137290 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7f4de4006fa0 tx=0x7f4de4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:07.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.192+0000 7f4df37fe700 1 -- 172.21.15.49:0/1377517662 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4005880 con 0x7f4dfc062e80 2023-11-30T17:26:07.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.192+0000 7f4df37fe700 1 -- 172.21.15.49:0/1377517662 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de400d6b0 con 0x7f4dfc062e80 2023-11-30T17:26:07.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.192+0000 7f4e01bc7700 1 -- 172.21.15.49:0/1377517662 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dfc155fc0 con 0x7f4dfc062e80 2023-11-30T17:26:07.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.192+0000 7f4df37fe700 1 -- 172.21.15.49:0/1377517662 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de400da50 con 0x7f4dfc062e80 2023-11-30T17:26:07.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.192+0000 7f4e01bc7700 1 -- 172.21.15.49:0/1377517662 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dfc156580 con 0x7f4dfc062e80 2023-11-30T17:26:07.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.193+0000 7f4e01bc7700 1 -- 172.21.15.49:0/1377517662 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dfc06c860 con 0x7f4dfc062e80 2023-11-30T17:26:07.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.194+0000 7f4df37fe700 1 -- 172.21.15.49:0/1377517662 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 55) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f4de40113f0 con 0x7f4dfc062e80 2023-11-30T17:26:07.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.194+0000 7f4df37fe700 1 --2- 172.21.15.49:0/1377517662 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4ddc05f390 0x7f4ddc061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:07.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.194+0000 7f4df37fe700 1 -- 172.21.15.49:0/1377517662 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f4de407bf60 con 0x7f4dfc062e80 2023-11-30T17:26:07.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.194+0000 7f4dfaffd700 1 -- 172.21.15.49:0/1377517662 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4ddc05f390 msgr2=0x7f4ddc061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:26:07.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.194+0000 7f4dfaffd700 1 --2- 172.21.15.49:0/1377517662 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4ddc05f390 0x7f4ddc061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:26:07.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.202+0000 7f4df37fe700 1 -- 172.21.15.49:0/1377517662 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4de404cd80 con 0x7f4dfc062e80 2023-11-30T17:26:07.233 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:07.230+0000 7f3d853e9680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T17:26:07.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.252+0000 7f4df37fe700 1 -- 172.21.15.49:0/1377517662 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 56) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f4de40798e0 con 0x7f4dfc062e80 2023-11-30T17:26:07.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.253+0000 7f4df37fe700 1 -- 172.21.15.49:0/1377517662 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4ddc05f390 msgr2=0x7f4ddc061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:26:07.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.253+0000 7f4df37fe700 1 --2- 172.21.15.49:0/1377517662 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4ddc05f390 0x7f4ddc061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:07.313 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:07.310+0000 7f3cff37a700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:26:07.313 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:07.310+0000 7f3cff37a700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:26:07.313 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:07.310+0000 7f3cff37a700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:26:07.314 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:07.310+0000 7f3cff37a700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:26:07.314 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:07.310+0000 7f3cff37a700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:26:07.314 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:07.310+0000 7f3d02b81700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:26:07.314 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:07.310+0000 7f3d02b81700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:26:07.314 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:07.310+0000 7f3d02b81700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:26:07.314 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:07.310+0000 7f3d02b81700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:26:07.314 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:07.310+0000 7f3d02b81700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:26:07.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:07.429+0000 7f4e01bc7700 1 -- 172.21.15.49:0/1377517662 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4dfc0c4ac0 con 0x7f4dfc062e80 2023-11-30T17:26:07.489 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:07.487+0000 7f21503b3680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T17:26:07.562 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:07.561+0000 7f21503b3680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T17:26:08.236 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-11-30T17:26:08.233+0000 7f73ac86b700 -1 MDSIOContextBase: failed with -108, restarting... 2023-11-30T17:26:08.242 INFO:tasks.ceph.mds.b.smithi115.stderr: -7845> 2023-11-30T17:25:08.945+0000 7f73b0072700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-30T17:26:08.249 INFO:tasks.ceph.mds.b.smithi115.stderr: -2> 2023-11-30T17:26:08.233+0000 7f73ac86b700 -1 MDSIOContextBase: failed with -108, restarting... 2023-11-30T17:26:08.250 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-11-30T17:26:08.249+0000 7f3888d95700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-30T17:26:08.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.254+0000 7f4df37fe700 1 -- 172.21.15.49:0/1377517662 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mgrmap(e 57) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f4de401bd50 con 0x7f4dfc062e80 2023-11-30T17:26:08.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.255+0000 7f4df37fe700 1 --2- 172.21.15.49:0/1377517662 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4ddc05f390 0x7f4ddc061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:08.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.259+0000 7f4dfaffd700 1 --2- 172.21.15.49:0/1377517662 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4ddc05f390 0x7f4ddc061850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:08.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.260+0000 7f4dfaffd700 1 --2- 172.21.15.49:0/1377517662 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4ddc05f390 0x7f4ddc061850 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f4dec001230 tx=0x7f4dec009040).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:08.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.262+0000 7f4df37fe700 1 -- 172.21.15.49:0/1377517662 <== mon.0 v2:172.21.15.49:3300/0 9 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v54) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4de404df60 con 0x7f4dfc062e80 2023-11-30T17:26:08.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.264+0000 7f4e01bc7700 1 -- 172.21.15.49:0/1377517662 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4ddc05f390 msgr2=0x7f4ddc061850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:08.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.264+0000 7f4e01bc7700 1 --2- 172.21.15.49:0/1377517662 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4ddc05f390 0x7f4ddc061850 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f4dec001230 tx=0x7f4dec009040).stop 2023-11-30T17:26:08.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.264+0000 7f4e01bc7700 1 -- 172.21.15.49:0/1377517662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dfc062e80 msgr2=0x7f4dfc137290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:08.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.264+0000 7f4e01bc7700 1 --2- 172.21.15.49:0/1377517662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dfc062e80 0x7f4dfc137290 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7f4de4006fa0 tx=0x7f4de4015000).stop 2023-11-30T17:26:08.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.264+0000 7f4e01bc7700 1 -- 172.21.15.49:0/1377517662 shutdown_connections 2023-11-30T17:26:08.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.264+0000 7f4e01bc7700 1 --2- 172.21.15.49:0/1377517662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dfc14eb00 0x7f4dfc0666a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:08.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.264+0000 7f4e01bc7700 1 --2- 172.21.15.49:0/1377517662 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4ddc05f390 0x7f4ddc061850 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:08.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.264+0000 7f4e01bc7700 1 --2- 172.21.15.49:0/1377517662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dfc062e80 0x7f4dfc137290 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:08.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.264+0000 7f4e01bc7700 1 --2- 172.21.15.49:0/1377517662 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4dfc0bc6c0 0x7f4dfc0661b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:08.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.264+0000 7f4e01bc7700 1 -- 172.21.15.49:0/1377517662 >> 172.21.15.49:0/1377517662 conn(0x7f4dfc0c8230 msgr2=0x7f4dfc0ac450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:08.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.264+0000 7f4e01bc7700 1 -- 172.21.15.49:0/1377517662 shutdown_connections 2023-11-30T17:26:08.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.264+0000 7f4e01bc7700 1 -- 172.21.15.49:0/1377517662 wait complete. 2023-11-30T17:26:08.267 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-30T17:26:08.273 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-11-30T17:26:08.279 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-30T17:26:08.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.399+0000 7f8146458700 1 Processor -- start 2023-11-30T17:26:08.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.399+0000 7f8146458700 1 -- start start 2023-11-30T17:26:08.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.400+0000 7f8146458700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81400c6190 0x7f81400c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:08.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.400+0000 7f8146458700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8140158320 0x7f81401587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:08.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.400+0000 7f8146458700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8140158cc0 con 0x7f8140098d10 2023-11-30T17:26:08.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.400+0000 7f8146458700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81400c72d0 con 0x7f8140158320 2023-11-30T17:26:08.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.400+0000 7f8146458700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8140064570 con 0x7f81400c6190 2023-11-30T17:26:08.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.400+0000 7f81449f5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8140158320 0x7f81401587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:08.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.400+0000 7f81449f5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8140158320 0x7f81401587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50334/0 (socket says 172.21.15.49:50334) 2023-11-30T17:26:08.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.400+0000 7f81449f5700 1 -- 172.21.15.49:0/995159474 learned_addr learned my addr 172.21.15.49:0/995159474 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:08.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.400+0000 7f813f7fe700 1 --2- 172.21.15.49:0/995159474 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81400c6190 0x7f81400c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:08.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.400+0000 7f81449f5700 1 -- 172.21.15.49:0/995159474 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81400c6190 msgr2=0x7f81400c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:08.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.400+0000 7f81449f5700 1 --2- 172.21.15.49:0/995159474 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81400c6190 0x7f81400c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:08.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.400+0000 7f81449f5700 1 -- 172.21.15.49:0/995159474 >> v1:172.21.15.115:6789/0 conn(0x7f8140098d10 legacy=0x7f8140063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:08.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.400+0000 7f81449f5700 1 -- 172.21.15.49:0/995159474 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8140154bc0 con 0x7f8140158320 2023-11-30T17:26:08.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.400+0000 7f81449f5700 1 --2- 172.21.15.49:0/995159474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8140158320 0x7f81401587d0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7f8138009f20 tx=0x7f8138009840).ready entity=mon.0 client_cookie=517d10860d9cb2eb server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:08.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.400+0000 7f813effd700 1 -- 172.21.15.49:0/995159474 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813800e070 con 0x7f8140158320 2023-11-30T17:26:08.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.400+0000 7f813effd700 1 -- 172.21.15.49:0/995159474 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813800ba80 con 0x7f8140158320 2023-11-30T17:26:08.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.400+0000 7f813effd700 1 -- 172.21.15.49:0/995159474 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813800be00 con 0x7f8140158320 2023-11-30T17:26:08.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.401+0000 7f8146458700 1 -- 172.21.15.49:0/995159474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8140158320 msgr2=0x7f81401587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:08.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.401+0000 7f8146458700 1 --2- 172.21.15.49:0/995159474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8140158320 0x7f81401587d0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7f8138009f20 tx=0x7f8138009840).stop 2023-11-30T17:26:08.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.401+0000 7f8146458700 1 -- 172.21.15.49:0/995159474 shutdown_connections 2023-11-30T17:26:08.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.401+0000 7f8146458700 1 --2- 172.21.15.49:0/995159474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8140158320 0x7f81401587d0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:08.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.401+0000 7f8146458700 1 --2- 172.21.15.49:0/995159474 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81400c6190 0x7f81400c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:08.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.401+0000 7f8146458700 1 -- 172.21.15.49:0/995159474 >> 172.21.15.49:0/995159474 conn(0x7f81400cb310 msgr2=0x7f81400cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:08.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.401+0000 7f8146458700 1 -- 172.21.15.49:0/995159474 shutdown_connections 2023-11-30T17:26:08.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.401+0000 7f8146458700 1 -- 172.21.15.49:0/995159474 wait complete. 2023-11-30T17:26:08.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.402+0000 7f8146458700 1 Processor -- start 2023-11-30T17:26:08.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.402+0000 7f8146458700 1 -- start start 2023-11-30T17:26:08.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.403+0000 7f8146458700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8140098d10 0x7f814014e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:08.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.403+0000 7f8146458700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81400c6190 0x7f8140156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:08.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.403+0000 7f8146458700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8140158320 0x7f81400c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:08.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.403+0000 7f8146458700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81400aef70 con 0x7f8140098d10 2023-11-30T17:26:08.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.403+0000 7f8146458700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81400c29b0 con 0x7f8140158320 2023-11-30T17:26:08.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.403+0000 7f8146458700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81400ae360 con 0x7f81400c6190 2023-11-30T17:26:08.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.403+0000 7f813ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8140098d10 0x7f814014e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:08.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.403+0000 7f813ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8140098d10 0x7f814014e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50338/0 (socket says 172.21.15.49:50338) 2023-11-30T17:26:08.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.403+0000 7f813ffff700 1 -- 172.21.15.49:0/1183100334 learned_addr learned my addr 172.21.15.49:0/1183100334 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:08.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.403+0000 7f81449f5700 1 --2- 172.21.15.49:0/1183100334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8140158320 0x7f81400c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:08.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.403+0000 7f813f7fe700 1 --2- 172.21.15.49:0/1183100334 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81400c6190 0x7f8140156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:08.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.403+0000 7f813ffff700 1 -- 172.21.15.49:0/1183100334 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81400c6190 msgr2=0x7f8140156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:08.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.403+0000 7f813ffff700 1 --2- 172.21.15.49:0/1183100334 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81400c6190 0x7f8140156cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:08.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.403+0000 7f813ffff700 1 -- 172.21.15.49:0/1183100334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8140158320 msgr2=0x7f81400c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:08.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.403+0000 7f813ffff700 1 --2- 172.21.15.49:0/1183100334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8140158320 0x7f81400c93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:08.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.403+0000 7f813ffff700 1 -- 172.21.15.49:0/1183100334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8138009ae0 con 0x7f8140098d10 2023-11-30T17:26:08.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.403+0000 7f81449f5700 1 --2- 172.21.15.49:0/1183100334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8140158320 0x7f81400c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:26:08.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.404+0000 7f813ffff700 1 --2- 172.21.15.49:0/1183100334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8140098d10 0x7f814014e920 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7f813000c4c0 tx=0x7f8130007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:08.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.404+0000 7f8127fff700 1 -- 172.21.15.49:0/1183100334 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8130007020 con 0x7f8140098d10 2023-11-30T17:26:08.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.404+0000 7f8127fff700 1 -- 172.21.15.49:0/1183100334 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8130001e90 con 0x7f8140098d10 2023-11-30T17:26:08.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.404+0000 7f8146458700 1 -- 172.21.15.49:0/1183100334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81400ae640 con 0x7f8140098d10 2023-11-30T17:26:08.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.404+0000 7f8127fff700 1 -- 172.21.15.49:0/1183100334 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81300073b0 con 0x7f8140098d10 2023-11-30T17:26:08.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.404+0000 7f8146458700 1 -- 172.21.15.49:0/1183100334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81400aec00 con 0x7f8140098d10 2023-11-30T17:26:08.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.405+0000 7f8146458700 1 -- 172.21.15.49:0/1183100334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f814006c860 con 0x7f8140098d10 2023-11-30T17:26:08.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.405+0000 7f8127fff700 1 -- 172.21.15.49:0/1183100334 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 57) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f81300068b0 con 0x7f8140098d10 2023-11-30T17:26:08.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.405+0000 7f8127fff700 1 --2- 172.21.15.49:0/1183100334 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f812c05f030 0x7f812c0614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:08.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.406+0000 7f8127fff700 1 -- 172.21.15.49:0/1183100334 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6779+0+0 (secure 0 0 0) 0x7f8130079a90 con 0x7f8140098d10 2023-11-30T17:26:08.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.406+0000 7f813f7fe700 1 --2- 172.21.15.49:0/1183100334 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f812c05f030 0x7f812c0614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:08.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.406+0000 7f813f7fe700 1 --2- 172.21.15.49:0/1183100334 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f812c05f030 0x7f812c0614f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f8134006fd0 tx=0x7f8134008040).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:08.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.410+0000 7f8127fff700 1 -- 172.21.15.49:0/1183100334 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f813004aca0 con 0x7f8140098d10 2023-11-30T17:26:08.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:08.625+0000 7f8146458700 1 -- 172.21.15.49:0/1183100334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8140158cc0 con 0x7f8140098d10 2023-11-30T17:26:09.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.269+0000 7f8127fff700 1 -- 172.21.15.49:0/1183100334 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v55) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8140158cc0 con 0x7f8140098d10 2023-11-30T17:26:09.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.271+0000 7f8146458700 1 -- 172.21.15.49:0/1183100334 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f812c05f030 msgr2=0x7f812c0614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:09.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.271+0000 7f8146458700 1 --2- 172.21.15.49:0/1183100334 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f812c05f030 0x7f812c0614f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f8134006fd0 tx=0x7f8134008040).stop 2023-11-30T17:26:09.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.271+0000 7f8146458700 1 -- 172.21.15.49:0/1183100334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8140098d10 msgr2=0x7f814014e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:09.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.271+0000 7f8146458700 1 --2- 172.21.15.49:0/1183100334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8140098d10 0x7f814014e920 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7f813000c4c0 tx=0x7f8130007e00).stop 2023-11-30T17:26:09.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.271+0000 7f8146458700 1 -- 172.21.15.49:0/1183100334 shutdown_connections 2023-11-30T17:26:09.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.271+0000 7f8146458700 1 --2- 172.21.15.49:0/1183100334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8140158320 0x7f81400c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:09.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.271+0000 7f8146458700 1 --2- 172.21.15.49:0/1183100334 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f812c05f030 0x7f812c0614f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:09.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.271+0000 7f8146458700 1 --2- 172.21.15.49:0/1183100334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8140098d10 0x7f814014e920 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:09.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.271+0000 7f8146458700 1 --2- 172.21.15.49:0/1183100334 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81400c6190 0x7f8140156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:09.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.271+0000 7f8146458700 1 -- 172.21.15.49:0/1183100334 >> 172.21.15.49:0/1183100334 conn(0x7f81400cb310 msgr2=0x7f81400c0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:09.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.271+0000 7f8146458700 1 -- 172.21.15.49:0/1183100334 shutdown_connections 2023-11-30T17:26:09.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.271+0000 7f8146458700 1 -- 172.21.15.49:0/1183100334 wait complete. 2023-11-30T17:26:09.286 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-30T17:26:09.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.409+0000 7f484a433700 1 Processor -- start 2023-11-30T17:26:09.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.409+0000 7f484a433700 1 -- start start 2023-11-30T17:26:09.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.410+0000 7f484a433700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f484413ab60 0x7f4844067780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:09.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.410+0000 7f484a433700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f48441556f0 0x7f48440bd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:09.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.410+0000 7f484a433700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48440bddb0 con 0x7f484413af40 2023-11-30T17:26:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.410+0000 7f484a433700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4844067c70 con 0x7f484413ab60 2023-11-30T17:26:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.410+0000 7f484a433700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48440c3510 con 0x7f48441556f0 2023-11-30T17:26:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.410+0000 7f4843fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f484413ab60 0x7f4844067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.410+0000 7f48437fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f484413af40 0x7f4844154fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55904/0 (socket says 172.21.15.49:55904) 2023-11-30T17:26:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.410+0000 7f48437fe700 1 -- 172.21.15.49:0/684993955 learned_addr learned my addr 172.21.15.49:0/684993955 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.411+0000 7f48489d0700 1 --2- 172.21.15.49:0/684993955 >> v2:172.21.15.115:3300/0 conn(0x7f48441556f0 0x7f48440bd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.411+0000 7f4843fff700 1 -- 172.21.15.49:0/684993955 >> v2:172.21.15.115:3300/0 conn(0x7f48441556f0 msgr2=0x7f48440bd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.411+0000 7f4843fff700 1 --2- 172.21.15.49:0/684993955 >> v2:172.21.15.115:3300/0 conn(0x7f48441556f0 0x7f48440bd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.411+0000 7f4843fff700 1 -- 172.21.15.49:0/684993955 >> v1:172.21.15.49:6789/0 conn(0x7f484413af40 legacy=0x7f4844154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.411+0000 7f4842ffd700 1 -- 172.21.15.49:0/684993955 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3221727142 0 0) 0x7f48440bddb0 con 0x7f484413af40 2023-11-30T17:26:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.411+0000 7f4843fff700 1 -- 172.21.15.49:0/684993955 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48440bdfe0 con 0x7f484413ab60 2023-11-30T17:26:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.411+0000 7f4843fff700 1 --2- 172.21.15.49:0/684993955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f484413ab60 0x7f4844067780 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f484405e620 tx=0x7f4834009060).ready entity=mon.0 client_cookie=5e1d365fa7463ee3 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.411+0000 7f4842ffd700 1 -- 172.21.15.49:0/684993955 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483400b580 con 0x7f484413ab60 2023-11-30T17:26:09.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.411+0000 7f4842ffd700 1 -- 172.21.15.49:0/684993955 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483400b6e0 con 0x7f484413ab60 2023-11-30T17:26:09.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.411+0000 7f4842ffd700 1 -- 172.21.15.49:0/684993955 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483400ba60 con 0x7f484413ab60 2023-11-30T17:26:09.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.411+0000 7f484a433700 1 -- 172.21.15.49:0/684993955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f484413ab60 msgr2=0x7f4844067780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:09.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.411+0000 7f484a433700 1 --2- 172.21.15.49:0/684993955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f484413ab60 0x7f4844067780 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f484405e620 tx=0x7f4834009060).stop 2023-11-30T17:26:09.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.412+0000 7f484a433700 1 -- 172.21.15.49:0/684993955 shutdown_connections 2023-11-30T17:26:09.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.412+0000 7f484a433700 1 --2- 172.21.15.49:0/684993955 >> v2:172.21.15.115:3300/0 conn(0x7f48441556f0 0x7f48440bd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:09.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.412+0000 7f484a433700 1 --2- 172.21.15.49:0/684993955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f484413ab60 0x7f4844067780 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:09.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.412+0000 7f484a433700 1 -- 172.21.15.49:0/684993955 >> 172.21.15.49:0/684993955 conn(0x7f4844063810 msgr2=0x7f4844063c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:09.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.412+0000 7f484a433700 1 -- 172.21.15.49:0/684993955 shutdown_connections 2023-11-30T17:26:09.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.412+0000 7f484a433700 1 -- 172.21.15.49:0/684993955 wait complete. 2023-11-30T17:26:09.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.413+0000 7f484a433700 1 Processor -- start 2023-11-30T17:26:09.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.413+0000 7f484a433700 1 -- start start 2023-11-30T17:26:09.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.414+0000 7f484a433700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f484413ab60 0x7f48440c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:09.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.414+0000 7f484a433700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f484413af40 0x7f48440bf030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:09.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.414+0000 7f484a433700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48441556f0 0x7f48440c4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:09.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.414+0000 7f484a433700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48440c02b0 con 0x7f48441556f0 2023-11-30T17:26:09.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.414+0000 7f484a433700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48440c1420 con 0x7f484413af40 2023-11-30T17:26:09.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.414+0000 7f484a433700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48440c0500 con 0x7f484413ab60 2023-11-30T17:26:09.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.414+0000 7f48489d0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48441556f0 0x7f48440c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:09.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.414+0000 7f48489d0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48441556f0 0x7f48440c4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50358/0 (socket says 172.21.15.49:50358) 2023-11-30T17:26:09.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.414+0000 7f48489d0700 1 -- 172.21.15.49:0/577624123 learned_addr learned my addr 172.21.15.49:0/577624123 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:09.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.414+0000 7f48437fe700 1 --2- 172.21.15.49:0/577624123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f484413af40 0x7f48440bf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:09.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.414+0000 7f4843fff700 1 --2- 172.21.15.49:0/577624123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f484413ab60 0x7f48440c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:09.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.414+0000 7f48489d0700 1 -- 172.21.15.49:0/577624123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f484413ab60 msgr2=0x7f48440c18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:09.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.414+0000 7f48489d0700 1 --2- 172.21.15.49:0/577624123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f484413ab60 0x7f48440c18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:09.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.414+0000 7f48489d0700 1 -- 172.21.15.49:0/577624123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f484413af40 msgr2=0x7f48440bf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:09.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.414+0000 7f48489d0700 1 --2- 172.21.15.49:0/577624123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f484413af40 0x7f48440bf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:09.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.414+0000 7f48489d0700 1 -- 172.21.15.49:0/577624123 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48340092a0 con 0x7f48441556f0 2023-11-30T17:26:09.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.414+0000 7f48489d0700 1 --2- 172.21.15.49:0/577624123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48441556f0 0x7f48440c4420 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7f483c007f50 tx=0x7f483c009800).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:09.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.415+0000 7f483bfff700 1 -- 172.21.15.49:0/577624123 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c00eb10 con 0x7f48441556f0 2023-11-30T17:26:09.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.415+0000 7f483bfff700 1 -- 172.21.15.49:0/577624123 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483c00ec70 con 0x7f48441556f0 2023-11-30T17:26:09.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.415+0000 7f484a433700 1 -- 172.21.15.49:0/577624123 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48440c07e0 con 0x7f48441556f0 2023-11-30T17:26:09.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.415+0000 7f483bfff700 1 -- 172.21.15.49:0/577624123 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c014400 con 0x7f48441556f0 2023-11-30T17:26:09.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.415+0000 7f484a433700 1 -- 172.21.15.49:0/577624123 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48440c10b0 con 0x7f48441556f0 2023-11-30T17:26:09.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.416+0000 7f484a433700 1 -- 172.21.15.49:0/577624123 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48440c15b0 con 0x7f48441556f0 2023-11-30T17:26:09.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.416+0000 7f483bfff700 1 -- 172.21.15.49:0/577624123 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 57) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f483c01d3b0 con 0x7f48441556f0 2023-11-30T17:26:09.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.416+0000 7f483bfff700 1 --2- 172.21.15.49:0/577624123 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f482405f030 0x7f48240614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:09.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.416+0000 7f483bfff700 1 -- 172.21.15.49:0/577624123 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6779+0+0 (secure 0 0 0) 0x7f483c07a550 con 0x7f48441556f0 2023-11-30T17:26:09.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.417+0000 7f4843fff700 1 --2- 172.21.15.49:0/577624123 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f482405f030 0x7f48240614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:09.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.417+0000 7f4843fff700 1 --2- 172.21.15.49:0/577624123 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f482405f030 0x7f48240614f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f4834009fd0 tx=0x7f4834017000).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:09.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.420+0000 7f483bfff700 1 -- 172.21.15.49:0/577624123 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f483c04b700 con 0x7f48441556f0 2023-11-30T17:26:09.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:09.593+0000 7f484a433700 1 -- 172.21.15.49:0/577624123 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f48440be2c0 con 0x7f48441556f0 2023-11-30T17:26:10.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.030+0000 7f483bfff700 1 -- 172.21.15.49:0/577624123 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f483c078260 con 0x7f48441556f0 2023-11-30T17:26:10.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.279+0000 7f483bfff700 1 -- 172.21.15.49:0/577624123 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v136) v1 ==== 181+0+0 (secure 0 0 0) 0x7f483c0730e0 con 0x7f48441556f0 2023-11-30T17:26:10.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.282+0000 7f484a433700 1 -- 172.21.15.49:0/577624123 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f482405f030 msgr2=0x7f48240614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:10.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.282+0000 7f484a433700 1 --2- 172.21.15.49:0/577624123 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f482405f030 0x7f48240614f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f4834009fd0 tx=0x7f4834017000).stop 2023-11-30T17:26:10.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.282+0000 7f484a433700 1 -- 172.21.15.49:0/577624123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48441556f0 msgr2=0x7f48440c4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:10.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.282+0000 7f484a433700 1 --2- 172.21.15.49:0/577624123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48441556f0 0x7f48440c4420 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7f483c007f50 tx=0x7f483c009800).stop 2023-11-30T17:26:10.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.282+0000 7f484a433700 1 -- 172.21.15.49:0/577624123 shutdown_connections 2023-11-30T17:26:10.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.282+0000 7f484a433700 1 --2- 172.21.15.49:0/577624123 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f482405f030 0x7f48240614f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:10.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.282+0000 7f484a433700 1 --2- 172.21.15.49:0/577624123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48441556f0 0x7f48440c4420 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:10.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.282+0000 7f484a433700 1 --2- 172.21.15.49:0/577624123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f484413ab60 0x7f48440c18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:10.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.282+0000 7f484a433700 1 --2- 172.21.15.49:0/577624123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f484413af40 0x7f48440bf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:10.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.282+0000 7f484a433700 1 -- 172.21.15.49:0/577624123 >> 172.21.15.49:0/577624123 conn(0x7f4844063810 msgr2=0x7f4844063bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:10.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.283+0000 7f484a433700 1 -- 172.21.15.49:0/577624123 shutdown_connections 2023-11-30T17:26:10.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.283+0000 7f484a433700 1 -- 172.21.15.49:0/577624123 wait complete. 2023-11-30T17:26:10.286 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2023-11-30T17:26:10.301 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-30T17:26:10.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.427+0000 7f35e92a0700 1 Processor -- start 2023-11-30T17:26:10.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.427+0000 7f35e92a0700 1 -- start start 2023-11-30T17:26:10.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.428+0000 7f35e92a0700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f35e40aa930 0x7f35e40a7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:10.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.428+0000 7f35e92a0700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e40c6630 con 0x7f35e4154910 2023-11-30T17:26:10.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.428+0000 7f35e92a0700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e4064230 con 0x7f35e4154530 2023-11-30T17:26:10.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.428+0000 7f35e92a0700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35e40c6390 con 0x7f35e40aa930 2023-11-30T17:26:10.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.428+0000 7f35e27fc700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f35e4154910 0x7f35e40aa220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55906/0 (socket says 172.21.15.49:55906) 2023-11-30T17:26:10.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.428+0000 7f35e27fc700 1 -- 172.21.15.49:0/2330286205 learned_addr learned my addr 172.21.15.49:0/2330286205 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:10.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.428+0000 7f35e1ffb700 1 -- 172.21.15.49:0/2330286205 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4076523198 0 0) 0x7f35e40c6630 con 0x7f35e4154910 2023-11-30T17:26:10.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.428+0000 7f35e37fe700 1 --2- 172.21.15.49:0/2330286205 >> v2:172.21.15.115:3300/0 conn(0x7f35e40aa930 0x7f35e40a7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:10.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.428+0000 7f35e1ffb700 1 -- 172.21.15.49:0/2330286205 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35d00033f0 con 0x7f35e4154910 2023-11-30T17:26:10.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.429+0000 7f35e1ffb700 1 -- 172.21.15.49:0/2330286205 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1216191081 0 0) 0x7f35d00033f0 con 0x7f35e4154910 2023-11-30T17:26:10.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.429+0000 7f35e1ffb700 1 -- 172.21.15.49:0/2330286205 >> v2:172.21.15.115:3300/0 conn(0x7f35e40aa930 msgr2=0x7f35e40a7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:10.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.429+0000 7f35e1ffb700 1 --2- 172.21.15.49:0/2330286205 >> v2:172.21.15.115:3300/0 conn(0x7f35e40aa930 0x7f35e40a7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:10.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.429+0000 7f35e1ffb700 1 -- 172.21.15.49:0/2330286205 >> v1:172.21.15.115:6789/0 conn(0x7f35e4154530 legacy=0x7f35e40c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:10.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.429+0000 7f35e1ffb700 1 -- 172.21.15.49:0/2330286205 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e4064510 con 0x7f35e4154910 2023-11-30T17:26:10.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.429+0000 7f35e1ffb700 1 -- 172.21.15.49:0/2330286205 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f35cc001470 con 0x7f35e4154910 2023-11-30T17:26:10.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.429+0000 7f35e1ffb700 1 -- 172.21.15.49:0/2330286205 >> v1:172.21.15.49:6789/0 conn(0x7f35e4154910 legacy=0x7f35e40aa220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:10.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.429+0000 7f35e1ffb700 1 --2- 172.21.15.49:0/2330286205 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35d00038e0 0x7f35d0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:10.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.429+0000 7f35e1ffb700 1 --2- 172.21.15.49:0/2330286205 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35d0004690 0x7f35d0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:10.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.429+0000 7f35e1ffb700 1 --2- 172.21.15.49:0/2330286205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35d0005000 0x7f35d000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:10.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.429+0000 7f35e1ffb700 1 -- 172.21.15.49:0/2330286205 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e40c6390 con 0x7f35d0005000 2023-11-30T17:26:10.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.429+0000 7f35e1ffb700 1 -- 172.21.15.49:0/2330286205 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d000bf60 con 0x7f35d00038e0 2023-11-30T17:26:10.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.429+0000 7f35e1ffb700 1 -- 172.21.15.49:0/2330286205 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d000c0f0 con 0x7f35d0004690 2023-11-30T17:26:10.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.429+0000 7f35e37fe700 1 --2- 172.21.15.49:0/2330286205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35d0005000 0x7f35d000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:10.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.429+0000 7f35e2ffd700 1 --2- 172.21.15.49:0/2330286205 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35d00038e0 0x7f35d0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:10.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.429+0000 7f35e27fc700 1 --2- 172.21.15.49:0/2330286205 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35d0004690 0x7f35d0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:10.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.429+0000 7f35e37fe700 1 -- 172.21.15.49:0/2330286205 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35d0004690 msgr2=0x7f35d0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:10.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.429+0000 7f35e37fe700 1 --2- 172.21.15.49:0/2330286205 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35d0004690 0x7f35d0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:10.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.429+0000 7f35e37fe700 1 -- 172.21.15.49:0/2330286205 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35d00038e0 msgr2=0x7f35d0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:10.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.429+0000 7f35e37fe700 1 --2- 172.21.15.49:0/2330286205 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35d00038e0 0x7f35d0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:10.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.429+0000 7f35e37fe700 1 -- 172.21.15.49:0/2330286205 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d00033f0 con 0x7f35d0005000 2023-11-30T17:26:10.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.429+0000 7f35e27fc700 1 --2- 172.21.15.49:0/2330286205 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35d0004690 0x7f35d0004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:26:10.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.429+0000 7f35e37fe700 1 -- 172.21.15.49:0/2330286205 reap_dead start 2023-11-30T17:26:10.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.429+0000 7f35e37fe700 1 --2- 172.21.15.49:0/2330286205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35d0005000 0x7f35d000b8e0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7f35e40a9fe0 tx=0x7f35d400b040).ready entity=mon.0 client_cookie=8613efad756b65ba server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:10.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.430+0000 7f35e1ffb700 1 -- 172.21.15.49:0/2330286205 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d4009ac0 con 0x7f35d0005000 2023-11-30T17:26:10.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.430+0000 7f35e1ffb700 1 -- 172.21.15.49:0/2330286205 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d400f040 con 0x7f35d0005000 2023-11-30T17:26:10.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.430+0000 7f35e1ffb700 1 -- 172.21.15.49:0/2330286205 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d400ece0 con 0x7f35d0005000 2023-11-30T17:26:10.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.430+0000 7f35e92a0700 1 -- 172.21.15.49:0/2330286205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35d0005000 msgr2=0x7f35d000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:10.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.430+0000 7f35e92a0700 1 --2- 172.21.15.49:0/2330286205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35d0005000 0x7f35d000b8e0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7f35e40a9fe0 tx=0x7f35d400b040).stop 2023-11-30T17:26:10.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.430+0000 7f35e92a0700 1 -- 172.21.15.49:0/2330286205 shutdown_connections 2023-11-30T17:26:10.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.430+0000 7f35e92a0700 1 --2- 172.21.15.49:0/2330286205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35d0005000 0x7f35d000b8e0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:10.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.430+0000 7f35e92a0700 1 -- 172.21.15.49:0/2330286205 >> 172.21.15.49:0/2330286205 conn(0x7f35e4094930 msgr2=0x7f35e406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:10.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.430+0000 7f35e92a0700 1 -- 172.21.15.49:0/2330286205 shutdown_connections 2023-11-30T17:26:10.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.430+0000 7f35e92a0700 1 -- 172.21.15.49:0/2330286205 wait complete. 2023-11-30T17:26:10.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.431+0000 7f35e92a0700 1 Processor -- start 2023-11-30T17:26:10.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.431+0000 7f35e92a0700 1 -- start start 2023-11-30T17:26:10.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.432+0000 7f35e92a0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35d0005000 0x7f35e40ada00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:10.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.432+0000 7f35e92a0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35e40aad60 0x7f35e40ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:10.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.432+0000 7f35e92a0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35e40c2f10 0x7f35e40c3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:10.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.432+0000 7f35e92a0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e40aea70 con 0x7f35e40c2f10 2023-11-30T17:26:10.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.432+0000 7f35e92a0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e40ab6d0 con 0x7f35d0005000 2023-11-30T17:26:10.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.432+0000 7f35e92a0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e40c45d0 con 0x7f35e40aad60 2023-11-30T17:26:10.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.432+0000 7f35e37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35e40c2f10 0x7f35e40c3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:10.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.432+0000 7f35e37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35e40c2f10 0x7f35e40c3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50382/0 (socket says 172.21.15.49:50382) 2023-11-30T17:26:10.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.432+0000 7f35e37fe700 1 -- 172.21.15.49:0/337566689 learned_addr learned my addr 172.21.15.49:0/337566689 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:10.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.432+0000 7f35e2ffd700 1 --2- 172.21.15.49:0/337566689 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35d0005000 0x7f35e40ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:10.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.432+0000 7f35e27fc700 1 --2- 172.21.15.49:0/337566689 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35e40aad60 0x7f35e40ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:10.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.433+0000 7f35e37fe700 1 -- 172.21.15.49:0/337566689 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35e40aad60 msgr2=0x7f35e40ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:10.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.433+0000 7f35e37fe700 1 --2- 172.21.15.49:0/337566689 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35e40aad60 0x7f35e40ab1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:10.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.433+0000 7f35e37fe700 1 -- 172.21.15.49:0/337566689 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35d0005000 msgr2=0x7f35e40ada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:10.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.433+0000 7f35e37fe700 1 --2- 172.21.15.49:0/337566689 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35d0005000 0x7f35e40ada00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:10.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.433+0000 7f35e37fe700 1 -- 172.21.15.49:0/337566689 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e40c3d30 con 0x7f35e40c2f10 2023-11-30T17:26:10.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.433+0000 7f35e27fc700 1 --2- 172.21.15.49:0/337566689 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35e40aad60 0x7f35e40ab1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:26:10.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.433+0000 7f35e37fe700 1 --2- 172.21.15.49:0/337566689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35e40c2f10 0x7f35e40c3390 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f35e40848a0 tx=0x7f35d4018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:10.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.433+0000 7f35daffd700 1 -- 172.21.15.49:0/337566689 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d400eed0 con 0x7f35e40c2f10 2023-11-30T17:26:10.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.433+0000 7f35daffd700 1 -- 172.21.15.49:0/337566689 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d401d460 con 0x7f35e40c2f10 2023-11-30T17:26:10.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.433+0000 7f35daffd700 1 -- 172.21.15.49:0/337566689 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d401d820 con 0x7f35e40c2f10 2023-11-30T17:26:10.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.433+0000 7f35e92a0700 1 -- 172.21.15.49:0/337566689 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e40c4010 con 0x7f35e40c2f10 2023-11-30T17:26:10.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.433+0000 7f35e92a0700 1 -- 172.21.15.49:0/337566689 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e40c3880 con 0x7f35e40c2f10 2023-11-30T17:26:10.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.434+0000 7f35e92a0700 1 -- 172.21.15.49:0/337566689 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e406c860 con 0x7f35e40c2f10 2023-11-30T17:26:10.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.434+0000 7f35daffd700 1 -- 172.21.15.49:0/337566689 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f35d4003020 con 0x7f35e40c2f10 2023-11-30T17:26:10.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.435+0000 7f35daffd700 1 --2- 172.21.15.49:0/337566689 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f35c405f270 0x7f35c4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:10.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.435+0000 7f35daffd700 1 -- 172.21.15.49:0/337566689 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6341+0+0 (secure 0 0 0) 0x7f35d407c2d0 con 0x7f35e40c2f10 2023-11-30T17:26:10.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.435+0000 7f35e2ffd700 1 --2- 172.21.15.49:0/337566689 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f35c405f270 0x7f35c4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:10.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.435+0000 7f35e2ffd700 1 --2- 172.21.15.49:0/337566689 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f35c405f270 0x7f35c4061730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f35dc000c00 tx=0x7f35dc007c00).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:10.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.439+0000 7f35daffd700 1 -- 172.21.15.49:0/337566689 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f35d404d340 con 0x7f35e40c2f10 2023-11-30T17:26:10.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:10.615+0000 7f35e92a0700 1 -- 172.21.15.49:0/337566689 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f35e40c3a70 con 0x7f35e40c2f10 2023-11-30T17:26:11.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.281+0000 7f35daffd700 1 -- 172.21.15.49:0/337566689 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v137) v1 ==== 169+0+0 (secure 0 0 0) 0x7f35d4017020 con 0x7f35e40c2f10 2023-11-30T17:26:11.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.285+0000 7f35e92a0700 1 -- 172.21.15.49:0/337566689 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f35c405f270 msgr2=0x7f35c4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:11.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.285+0000 7f35e92a0700 1 --2- 172.21.15.49:0/337566689 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f35c405f270 0x7f35c4061730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f35dc000c00 tx=0x7f35dc007c00).stop 2023-11-30T17:26:11.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.285+0000 7f35e92a0700 1 -- 172.21.15.49:0/337566689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35e40c2f10 msgr2=0x7f35e40c3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:11.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.285+0000 7f35e92a0700 1 --2- 172.21.15.49:0/337566689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35e40c2f10 0x7f35e40c3390 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f35e40848a0 tx=0x7f35d4018000).stop 2023-11-30T17:26:11.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.285+0000 7f35e92a0700 1 -- 172.21.15.49:0/337566689 shutdown_connections 2023-11-30T17:26:11.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.285+0000 7f35e92a0700 1 --2- 172.21.15.49:0/337566689 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f35c405f270 0x7f35c4061730 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:11.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.285+0000 7f35e92a0700 1 --2- 172.21.15.49:0/337566689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35e40c2f10 0x7f35e40c3390 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:11.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.285+0000 7f35e92a0700 1 --2- 172.21.15.49:0/337566689 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35d0005000 0x7f35e40ada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:11.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.285+0000 7f35e92a0700 1 --2- 172.21.15.49:0/337566689 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35e40aad60 0x7f35e40ab1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:11.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.285+0000 7f35e92a0700 1 -- 172.21.15.49:0/337566689 >> 172.21.15.49:0/337566689 conn(0x7f35e4094930 msgr2=0x7f35e40c95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:11.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.285+0000 7f35e92a0700 1 -- 172.21.15.49:0/337566689 shutdown_connections 2023-11-30T17:26:11.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.285+0000 7f35e92a0700 1 -- 172.21.15.49:0/337566689 wait complete. 2023-11-30T17:26:11.288 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2023-11-30T17:26:11.301 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-30T17:26:11.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.429+0000 7f26e33d8700 1 Processor -- start 2023-11-30T17:26:11.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.429+0000 7f26e33d8700 1 -- start start 2023-11-30T17:26:11.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.430+0000 7f26e33d8700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f26dc158a30 0x7f26dc0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:11.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.430+0000 7f26e33d8700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26dc0c72d0 con 0x7f26dc0c6190 2023-11-30T17:26:11.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.430+0000 7f26e33d8700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26dc064570 con 0x7f26dc098d10 2023-11-30T17:26:11.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.430+0000 7f26e33d8700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26dc154bc0 con 0x7f26dc158a30 2023-11-30T17:26:11.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.430+0000 7f26e1975700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f26dc158a30 0x7f26dc0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:11.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.430+0000 7f26e0973700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f26dc0c6190 0x7f26dc158320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48284/0 (socket says 172.21.15.49:48284) 2023-11-30T17:26:11.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.430+0000 7f26e0973700 1 -- 172.21.15.49:0/1319932993 learned_addr learned my addr 172.21.15.49:0/1319932993 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:11.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.430+0000 7f26e1975700 1 -- 172.21.15.49:0/1319932993 >> v1:172.21.15.115:6789/0 conn(0x7f26dc098d10 legacy=0x7f26dc063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:11.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.430+0000 7f26e1975700 1 -- 172.21.15.49:0/1319932993 >> v1:172.21.15.49:6789/0 conn(0x7f26dc0c6190 legacy=0x7f26dc158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:11.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.430+0000 7f26d3fff700 1 -- 172.21.15.49:0/1319932993 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2064760935 0 0) 0x7f26dc0c72d0 con 0x7f26dc0c6190 2023-11-30T17:26:11.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.430+0000 7f26e1975700 1 -- 172.21.15.49:0/1319932993 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26dc0c66c0 con 0x7f26dc158a30 2023-11-30T17:26:11.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.430+0000 7f26e1975700 1 --2- 172.21.15.49:0/1319932993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26dc158a30 0x7f26dc0c7760 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7f26d4009e60 tx=0x7f26d4009780).ready entity=mon.0 client_cookie=b5409d9ff559375c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:11.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.431+0000 7f26d3fff700 1 -- 172.21.15.49:0/1319932993 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d400e070 con 0x7f26dc158a30 2023-11-30T17:26:11.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.431+0000 7f26d3fff700 1 -- 172.21.15.49:0/1319932993 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d400bc30 con 0x7f26dc158a30 2023-11-30T17:26:11.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.431+0000 7f26d3fff700 1 -- 172.21.15.49:0/1319932993 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d4012410 con 0x7f26dc158a30 2023-11-30T17:26:11.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.431+0000 7f26e33d8700 1 -- 172.21.15.49:0/1319932993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26dc158a30 msgr2=0x7f26dc0c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:11.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.431+0000 7f26e33d8700 1 --2- 172.21.15.49:0/1319932993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26dc158a30 0x7f26dc0c7760 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7f26d4009e60 tx=0x7f26d4009780).stop 2023-11-30T17:26:11.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.431+0000 7f26e33d8700 1 -- 172.21.15.49:0/1319932993 shutdown_connections 2023-11-30T17:26:11.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.431+0000 7f26e33d8700 1 --2- 172.21.15.49:0/1319932993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26dc158a30 0x7f26dc0c7760 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:11.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.431+0000 7f26e33d8700 1 -- 172.21.15.49:0/1319932993 >> 172.21.15.49:0/1319932993 conn(0x7f26dc0cb310 msgr2=0x7f26dc0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:11.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.431+0000 7f26e33d8700 1 -- 172.21.15.49:0/1319932993 shutdown_connections 2023-11-30T17:26:11.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.431+0000 7f26e33d8700 1 -- 172.21.15.49:0/1319932993 wait complete. 2023-11-30T17:26:11.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.432+0000 7f26e33d8700 1 Processor -- start 2023-11-30T17:26:11.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.432+0000 7f26e33d8700 1 -- start start 2023-11-30T17:26:11.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.433+0000 7f26e33d8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26dc098d10 0x7f26dc0aec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:11.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.433+0000 7f26e33d8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26dc0c6190 0x7f26dc0c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:11.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.433+0000 7f26e33d8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26dc158a30 0x7f26dc150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:11.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.433+0000 7f26e33d8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc151860 con 0x7f26dc0c6190 2023-11-30T17:26:11.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.433+0000 7f26e33d8700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc165530 con 0x7f26dc098d10 2023-11-30T17:26:11.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.433+0000 7f26e33d8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc0c56a0 con 0x7f26dc158a30 2023-11-30T17:26:11.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.433+0000 7f26e0973700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26dc0c6190 0x7f26dc0c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:11.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.433+0000 7f26e0973700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26dc0c6190 0x7f26dc0c5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59644/0 (socket says 172.21.15.49:59644) 2023-11-30T17:26:11.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.433+0000 7f26e0973700 1 -- 172.21.15.49:0/4118847029 learned_addr learned my addr 172.21.15.49:0/4118847029 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:11.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.434+0000 7f26e1174700 1 --2- 172.21.15.49:0/4118847029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26dc098d10 0x7f26dc0aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:11.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.434+0000 7f26e1975700 1 --2- 172.21.15.49:0/4118847029 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26dc158a30 0x7f26dc150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:11.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.434+0000 7f26e0973700 1 -- 172.21.15.49:0/4118847029 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26dc158a30 msgr2=0x7f26dc150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:11.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.434+0000 7f26e0973700 1 --2- 172.21.15.49:0/4118847029 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26dc158a30 0x7f26dc150d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:11.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.434+0000 7f26e0973700 1 -- 172.21.15.49:0/4118847029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26dc098d10 msgr2=0x7f26dc0aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:11.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.434+0000 7f26e0973700 1 --2- 172.21.15.49:0/4118847029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26dc098d10 0x7f26dc0aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:11.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.434+0000 7f26e0973700 1 -- 172.21.15.49:0/4118847029 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d4009a20 con 0x7f26dc0c6190 2023-11-30T17:26:11.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.434+0000 7f26e1174700 1 --2- 172.21.15.49:0/4118847029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26dc098d10 0x7f26dc0aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:26:11.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.434+0000 7f26e0973700 1 --2- 172.21.15.49:0/4118847029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26dc0c6190 0x7f26dc0c5010 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7f26cc001eb0 tx=0x7f26cc007bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:11.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.434+0000 7f26d17fa700 1 -- 172.21.15.49:0/4118847029 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc0072e0 con 0x7f26dc0c6190 2023-11-30T17:26:11.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.434+0000 7f26d17fa700 1 -- 172.21.15.49:0/4118847029 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26cc007460 con 0x7f26dc0c6190 2023-11-30T17:26:11.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.434+0000 7f26e33d8700 1 -- 172.21.15.49:0/4118847029 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26dc164770 con 0x7f26dc0c6190 2023-11-30T17:26:11.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.434+0000 7f26d17fa700 1 -- 172.21.15.49:0/4118847029 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc0059f0 con 0x7f26dc0c6190 2023-11-30T17:26:11.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.434+0000 7f26e33d8700 1 -- 172.21.15.49:0/4118847029 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26dc164d30 con 0x7f26dc0c6190 2023-11-30T17:26:11.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.435+0000 7f26e33d8700 1 -- 172.21.15.49:0/4118847029 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26dc06c860 con 0x7f26dc0c6190 2023-11-30T17:26:11.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.435+0000 7f26d17fa700 1 -- 172.21.15.49:0/4118847029 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f26cc013450 con 0x7f26dc0c6190 2023-11-30T17:26:11.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.436+0000 7f26d17fa700 1 --2- 172.21.15.49:0/4118847029 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f26c005f270 0x7f26c0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:11.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.436+0000 7f26d17fa700 1 -- 172.21.15.49:0/4118847029 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5927+0+0 (secure 0 0 0) 0x7f26cc079af0 con 0x7f26dc0c6190 2023-11-30T17:26:11.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.436+0000 7f26e1174700 1 --2- 172.21.15.49:0/4118847029 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f26c005f270 0x7f26c0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:11.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.437+0000 7f26e1174700 1 --2- 172.21.15.49:0/4118847029 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f26c005f270 0x7f26c0061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f26d8001710 tx=0x7f26d8009040).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:11.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.440+0000 7f26d17fa700 1 -- 172.21.15.49:0/4118847029 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f26cc04aca0 con 0x7f26dc0c6190 2023-11-30T17:26:11.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.612+0000 7f26e33d8700 1 -- 172.21.15.49:0/4118847029 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f26dc0c69a0 con 0x7f26dc0c6190 2023-11-30T17:26:11.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.615+0000 7f26d17fa700 1 -- 172.21.15.49:0/4118847029 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7f26cc04e2c0 con 0x7f26dc0c6190 2023-11-30T17:26:11.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.617+0000 7f26e33d8700 1 -- 172.21.15.49:0/4118847029 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f26c005f270 msgr2=0x7f26c0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:11.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.617+0000 7f26e33d8700 1 --2- 172.21.15.49:0/4118847029 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f26c005f270 0x7f26c0061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f26d8001710 tx=0x7f26d8009040).stop 2023-11-30T17:26:11.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.617+0000 7f26e33d8700 1 -- 172.21.15.49:0/4118847029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26dc0c6190 msgr2=0x7f26dc0c5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:11.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.617+0000 7f26e33d8700 1 --2- 172.21.15.49:0/4118847029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26dc0c6190 0x7f26dc0c5010 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7f26cc001eb0 tx=0x7f26cc007bf0).stop 2023-11-30T17:26:11.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.617+0000 7f26e33d8700 1 -- 172.21.15.49:0/4118847029 shutdown_connections 2023-11-30T17:26:11.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.617+0000 7f26e33d8700 1 --2- 172.21.15.49:0/4118847029 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26dc158a30 0x7f26dc150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:11.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.617+0000 7f26e33d8700 1 --2- 172.21.15.49:0/4118847029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26dc098d10 0x7f26dc0aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:11.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.617+0000 7f26e33d8700 1 --2- 172.21.15.49:0/4118847029 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f26c005f270 0x7f26c0061730 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:11.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.617+0000 7f26e33d8700 1 --2- 172.21.15.49:0/4118847029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26dc0c6190 0x7f26dc0c5010 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:11.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.618+0000 7f26e33d8700 1 -- 172.21.15.49:0/4118847029 >> 172.21.15.49:0/4118847029 conn(0x7f26dc0cb310 msgr2=0x7f26dc0ca850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:11.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.618+0000 7f26e33d8700 1 -- 172.21.15.49:0/4118847029 shutdown_connections 2023-11-30T17:26:11.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.618+0000 7f26e33d8700 1 -- 172.21.15.49:0/4118847029 wait complete. 2023-11-30T17:26:11.632 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-11-30T17:26:11.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.748+0000 7f6fc9634700 1 Processor -- start 2023-11-30T17:26:11.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.748+0000 7f6fc9634700 1 -- start start 2023-11-30T17:26:11.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.749+0000 7f6fc9634700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6fc4158a30 0x7f6fc40c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:11.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.749+0000 7f6fc9634700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc40c72d0 con 0x7f6fc40c6190 2023-11-30T17:26:11.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.749+0000 7f6fc9634700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc4064570 con 0x7f6fc4098d10 2023-11-30T17:26:11.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.749+0000 7f6fc9634700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc4154bc0 con 0x7f6fc4158a30 2023-11-30T17:26:11.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.749+0000 7f6fc27fc700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6fc40c6190 0x7f6fc4158320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48296/0 (socket says 172.21.15.49:48296) 2023-11-30T17:26:11.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.749+0000 7f6fc27fc700 1 -- 172.21.15.49:0/494728173 learned_addr learned my addr 172.21.15.49:0/494728173 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:11.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.749+0000 7f6fc37fe700 1 --2- 172.21.15.49:0/494728173 >> v2:172.21.15.115:3300/0 conn(0x7f6fc4158a30 0x7f6fc40c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:11.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.750+0000 7f6fc1ffb700 1 -- 172.21.15.49:0/494728173 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2039800124 0 0) 0x7f6fc40c72d0 con 0x7f6fc40c6190 2023-11-30T17:26:11.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.750+0000 7f6fc1ffb700 1 -- 172.21.15.49:0/494728173 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fb00033f0 con 0x7f6fc40c6190 2023-11-30T17:26:11.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.750+0000 7f6fc1ffb700 1 -- 172.21.15.49:0/494728173 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4166100324 0 0) 0x7f6fc4064570 con 0x7f6fc4098d10 2023-11-30T17:26:11.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.750+0000 7f6fc1ffb700 1 -- 172.21.15.49:0/494728173 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fc40c72d0 con 0x7f6fc4098d10 2023-11-30T17:26:11.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.750+0000 7f6fc37fe700 1 -- 172.21.15.49:0/494728173 >> v1:172.21.15.115:6789/0 conn(0x7f6fc4098d10 legacy=0x7f6fc4063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:11.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.750+0000 7f6fc37fe700 1 -- 172.21.15.49:0/494728173 >> v1:172.21.15.49:6789/0 conn(0x7f6fc40c6190 legacy=0x7f6fc4158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:11.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.750+0000 7f6fc37fe700 1 -- 172.21.15.49:0/494728173 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc40c66c0 con 0x7f6fc4158a30 2023-11-30T17:26:11.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.750+0000 7f6fc37fe700 1 --2- 172.21.15.49:0/494728173 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc4158a30 0x7f6fc40c7760 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f6fb4009760 tx=0x7f6fb4009060).ready entity=mon.1 client_cookie=5db95ae67119a0dd server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:11.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.750+0000 7f6fc1ffb700 1 -- 172.21.15.49:0/494728173 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb400d4a0 con 0x7f6fc4158a30 2023-11-30T17:26:11.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.750+0000 7f6fc1ffb700 1 -- 172.21.15.49:0/494728173 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb400d600 con 0x7f6fc4158a30 2023-11-30T17:26:11.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.750+0000 7f6fc1ffb700 1 -- 172.21.15.49:0/494728173 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb400d980 con 0x7f6fc4158a30 2023-11-30T17:26:11.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.750+0000 7f6fc9634700 1 -- 172.21.15.49:0/494728173 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc4158a30 msgr2=0x7f6fc40c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:11.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.750+0000 7f6fc9634700 1 --2- 172.21.15.49:0/494728173 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc4158a30 0x7f6fc40c7760 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f6fb4009760 tx=0x7f6fb4009060).stop 2023-11-30T17:26:11.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.751+0000 7f6fc9634700 1 -- 172.21.15.49:0/494728173 shutdown_connections 2023-11-30T17:26:11.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.751+0000 7f6fc9634700 1 --2- 172.21.15.49:0/494728173 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc4158a30 0x7f6fc40c7760 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:11.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.751+0000 7f6fc9634700 1 -- 172.21.15.49:0/494728173 >> 172.21.15.49:0/494728173 conn(0x7f6fc40cb310 msgr2=0x7f6fc40cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:11.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.751+0000 7f6fc9634700 1 -- 172.21.15.49:0/494728173 shutdown_connections 2023-11-30T17:26:11.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.751+0000 7f6fc9634700 1 -- 172.21.15.49:0/494728173 wait complete. 2023-11-30T17:26:11.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.752+0000 7f6fc9634700 1 Processor -- start 2023-11-30T17:26:11.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.752+0000 7f6fc9634700 1 -- start start 2023-11-30T17:26:11.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.753+0000 7f6fc9634700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6fc4098d10 0x7f6fc4148340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:11.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.753+0000 7f6fc9634700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc40c6190 0x7f6fc40ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:11.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.753+0000 7f6fc9634700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fc4158a30 0x7f6fc40a9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:11.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.753+0000 7f6fc9634700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc40ac580 con 0x7f6fc4158a30 2023-11-30T17:26:11.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.753+0000 7f6fc9634700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc4156070 con 0x7f6fc40c6190 2023-11-30T17:26:11.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.753+0000 7f6fc9634700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc4148830 con 0x7f6fc4098d10 2023-11-30T17:26:11.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.753+0000 7f6fc37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fc4158a30 0x7f6fc40a9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:11.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.753+0000 7f6fc37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fc4158a30 0x7f6fc40a9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59660/0 (socket says 172.21.15.49:59660) 2023-11-30T17:26:11.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.753+0000 7f6fc37fe700 1 -- 172.21.15.49:0/3775656872 learned_addr learned my addr 172.21.15.49:0/3775656872 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:11.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.753+0000 7f6fc2ffd700 1 --2- 172.21.15.49:0/3775656872 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6fc4098d10 0x7f6fc4148340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:11.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.753+0000 7f6fc27fc700 1 --2- 172.21.15.49:0/3775656872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc40c6190 0x7f6fc40ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:11.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.753+0000 7f6fc37fe700 1 -- 172.21.15.49:0/3775656872 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6fc4098d10 msgr2=0x7f6fc4148340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:11.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.753+0000 7f6fc37fe700 1 --2- 172.21.15.49:0/3775656872 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6fc4098d10 0x7f6fc4148340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:11.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.753+0000 7f6fc37fe700 1 -- 172.21.15.49:0/3775656872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc40c6190 msgr2=0x7f6fc40ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:11.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.753+0000 7f6fc37fe700 1 --2- 172.21.15.49:0/3775656872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc40c6190 0x7f6fc40ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:11.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.753+0000 7f6fc37fe700 1 -- 172.21.15.49:0/3775656872 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb40092a0 con 0x7f6fc4158a30 2023-11-30T17:26:11.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.753+0000 7f6fc37fe700 1 --2- 172.21.15.49:0/3775656872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fc4158a30 0x7f6fc40a9830 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7f6fb4010000 tx=0x7f6fb4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:11.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.753+0000 7f6fbaffd700 1 -- 172.21.15.49:0/3775656872 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb400d4a0 con 0x7f6fc4158a30 2023-11-30T17:26:11.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.753+0000 7f6fbaffd700 1 -- 172.21.15.49:0/3775656872 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb400d770 con 0x7f6fc4158a30 2023-11-30T17:26:11.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.753+0000 7f6fc9634700 1 -- 172.21.15.49:0/3775656872 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc40abfc0 con 0x7f6fc4158a30 2023-11-30T17:26:11.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.753+0000 7f6fbaffd700 1 -- 172.21.15.49:0/3775656872 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb401d660 con 0x7f6fc4158a30 2023-11-30T17:26:11.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.753+0000 7f6fc9634700 1 -- 172.21.15.49:0/3775656872 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc4156280 con 0x7f6fc4158a30 2023-11-30T17:26:11.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.755+0000 7f6fc9634700 1 -- 172.21.15.49:0/3775656872 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc406c860 con 0x7f6fc4158a30 2023-11-30T17:26:11.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.755+0000 7f6fbaffd700 1 -- 172.21.15.49:0/3775656872 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6fb401da10 con 0x7f6fc4158a30 2023-11-30T17:26:11.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.755+0000 7f6fbaffd700 1 --2- 172.21.15.49:0/3775656872 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6fa405f240 0x7f6fa4061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:11.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.755+0000 7f6fbaffd700 1 -- 172.21.15.49:0/3775656872 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5927+0+0 (secure 0 0 0) 0x7f6fb407bb40 con 0x7f6fc4158a30 2023-11-30T17:26:11.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.755+0000 7f6fc2ffd700 1 --2- 172.21.15.49:0/3775656872 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6fa405f240 0x7f6fa4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:11.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.756+0000 7f6fc2ffd700 1 --2- 172.21.15.49:0/3775656872 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6fa405f240 0x7f6fa4061700 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f6fbc003fc0 tx=0x7f6fbc007f50).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:11.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.759+0000 7f6fbaffd700 1 -- 172.21.15.49:0/3775656872 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6fb404ce10 con 0x7f6fc4158a30 2023-11-30T17:26:11.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.933+0000 7f6fc9634700 1 -- 172.21.15.49:0/3775656872 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f6fc40c69a0 con 0x7f6fc4158a30 2023-11-30T17:26:11.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.937+0000 7f6fbaffd700 1 -- 172.21.15.49:0/3775656872 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v25) v1 ==== 120+0+0 (secure 0 0 0) 0x7f6fb4050430 con 0x7f6fc4158a30 2023-11-30T17:26:11.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.938+0000 7f6fc9634700 1 -- 172.21.15.49:0/3775656872 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6fa405f240 msgr2=0x7f6fa4061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:11.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.938+0000 7f6fc9634700 1 --2- 172.21.15.49:0/3775656872 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6fa405f240 0x7f6fa4061700 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f6fbc003fc0 tx=0x7f6fbc007f50).stop 2023-11-30T17:26:11.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.938+0000 7f6fc9634700 1 -- 172.21.15.49:0/3775656872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fc4158a30 msgr2=0x7f6fc40a9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:11.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.938+0000 7f6fc9634700 1 --2- 172.21.15.49:0/3775656872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fc4158a30 0x7f6fc40a9830 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7f6fb4010000 tx=0x7f6fb4016000).stop 2023-11-30T17:26:11.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.939+0000 7f6fc9634700 1 -- 172.21.15.49:0/3775656872 shutdown_connections 2023-11-30T17:26:11.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.939+0000 7f6fc9634700 1 --2- 172.21.15.49:0/3775656872 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6fa405f240 0x7f6fa4061700 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:11.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.939+0000 7f6fc9634700 1 --2- 172.21.15.49:0/3775656872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fc4158a30 0x7f6fc40a9830 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:11.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.939+0000 7f6fc9634700 1 --2- 172.21.15.49:0/3775656872 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6fc4098d10 0x7f6fc4148340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:11.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.939+0000 7f6fc9634700 1 --2- 172.21.15.49:0/3775656872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc40c6190 0x7f6fc40ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:11.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.939+0000 7f6fc9634700 1 -- 172.21.15.49:0/3775656872 >> 172.21.15.49:0/3775656872 conn(0x7f6fc40cb310 msgr2=0x7f6fc40cab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:11.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.939+0000 7f6fc9634700 1 -- 172.21.15.49:0/3775656872 shutdown_connections 2023-11-30T17:26:11.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:11.939+0000 7f6fc9634700 1 -- 172.21.15.49:0/3775656872 wait complete. 2023-11-30T17:26:11.953 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-11-30T17:26:12.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.069+0000 7f65d911f700 1 Processor -- start 2023-11-30T17:26:12.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.069+0000 7f65d911f700 1 -- start start 2023-11-30T17:26:12.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.070+0000 7f65d911f700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f65d40caab0 0x7f65d40aa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:12.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.070+0000 7f65d911f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f65d40cae90 0x7f65d40c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:12.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.070+0000 7f65d911f700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65d40a9a90 con 0x7f65d40aa960 2023-11-30T17:26:12.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.070+0000 7f65d911f700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d4154ce0 con 0x7f65d40cae90 2023-11-30T17:26:12.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.070+0000 7f65d911f700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d40a8e80 con 0x7f65d40caab0 2023-11-30T17:26:12.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.070+0000 7f65d259c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f65d40cae90 0x7f65d40c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:12.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.070+0000 7f65d259c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f65d40cae90 0x7f65d40c0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59676/0 (socket says 172.21.15.49:59676) 2023-11-30T17:26:12.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.070+0000 7f65d259c700 1 -- 172.21.15.49:0/3990364655 learned_addr learned my addr 172.21.15.49:0/3990364655 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:12.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.070+0000 7f65d2d9d700 1 --2- 172.21.15.49:0/3990364655 >> v2:172.21.15.115:3300/0 conn(0x7f65d40caab0 0x7f65d40aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:12.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.070+0000 7f65d259c700 1 -- 172.21.15.49:0/3990364655 >> v2:172.21.15.115:3300/0 conn(0x7f65d40caab0 msgr2=0x7f65d40aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:12.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.070+0000 7f65d259c700 1 --2- 172.21.15.49:0/3990364655 >> v2:172.21.15.115:3300/0 conn(0x7f65d40caab0 0x7f65d40aa470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:12.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.070+0000 7f65d259c700 1 -- 172.21.15.49:0/3990364655 >> v1:172.21.15.115:6789/0 conn(0x7f65d40aa960 legacy=0x7f65d40c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:12.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.070+0000 7f65d259c700 1 -- 172.21.15.49:0/3990364655 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d40a9160 con 0x7f65d40cae90 2023-11-30T17:26:12.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.070+0000 7f65d259c700 1 --2- 172.21.15.49:0/3990364655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65d40cae90 0x7f65d40c0ab0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7f65d40848c0 tx=0x7f65bc0090f0).ready entity=mon.0 client_cookie=c58212a6a727f2b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:12.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.070+0000 7f65d1d9b700 1 -- 172.21.15.49:0/3990364655 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65bc00b600 con 0x7f65d40cae90 2023-11-30T17:26:12.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.071+0000 7f65d1d9b700 1 -- 172.21.15.49:0/3990364655 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65bc00b760 con 0x7f65d40cae90 2023-11-30T17:26:12.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.071+0000 7f65d1d9b700 1 -- 172.21.15.49:0/3990364655 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65bc00bae0 con 0x7f65d40cae90 2023-11-30T17:26:12.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.071+0000 7f65d911f700 1 -- 172.21.15.49:0/3990364655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65d40cae90 msgr2=0x7f65d40c0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:12.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.071+0000 7f65d911f700 1 --2- 172.21.15.49:0/3990364655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65d40cae90 0x7f65d40c0ab0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7f65d40848c0 tx=0x7f65bc0090f0).stop 2023-11-30T17:26:12.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.071+0000 7f65d911f700 1 -- 172.21.15.49:0/3990364655 shutdown_connections 2023-11-30T17:26:12.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.071+0000 7f65d911f700 1 --2- 172.21.15.49:0/3990364655 >> v2:172.21.15.115:3300/0 conn(0x7f65d40caab0 0x7f65d40aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:12.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.071+0000 7f65d911f700 1 --2- 172.21.15.49:0/3990364655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65d40cae90 0x7f65d40c0ab0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:12.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.071+0000 7f65d911f700 1 -- 172.21.15.49:0/3990364655 >> 172.21.15.49:0/3990364655 conn(0x7f65d4094920 msgr2=0x7f65d406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:12.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.071+0000 7f65d911f700 1 -- 172.21.15.49:0/3990364655 shutdown_connections 2023-11-30T17:26:12.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.071+0000 7f65d911f700 1 -- 172.21.15.49:0/3990364655 wait complete. 2023-11-30T17:26:12.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.072+0000 7f65d911f700 1 Processor -- start 2023-11-30T17:26:12.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.072+0000 7f65d911f700 1 -- start start 2023-11-30T17:26:12.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.073+0000 7f65d911f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65d40caab0 0x7f65d414bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:12.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.073+0000 7f65d911f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65d40cae90 0x7f65d4155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:12.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.073+0000 7f65d911f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65d4153a10 0x7f65d4153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:12.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.073+0000 7f65d911f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d4155680 con 0x7f65d40caab0 2023-11-30T17:26:12.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.073+0000 7f65d911f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d4154380 con 0x7f65d40cae90 2023-11-30T17:26:12.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.073+0000 7f65d911f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d4168960 con 0x7f65d4153a10 2023-11-30T17:26:12.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.073+0000 7f65d2d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65d40caab0 0x7f65d414bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:12.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.073+0000 7f65d2d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65d40caab0 0x7f65d414bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59688/0 (socket says 172.21.15.49:59688) 2023-11-30T17:26:12.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.073+0000 7f65d2d9d700 1 -- 172.21.15.49:0/1561784224 learned_addr learned my addr 172.21.15.49:0/1561784224 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:12.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.073+0000 7f65d259c700 1 --2- 172.21.15.49:0/1561784224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65d40cae90 0x7f65d4155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:12.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.073+0000 7f65d2d9d700 1 -- 172.21.15.49:0/1561784224 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65d4153a10 msgr2=0x7f65d4153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:12.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.073+0000 7f65d2d9d700 1 --2- 172.21.15.49:0/1561784224 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65d4153a10 0x7f65d4153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:12.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.073+0000 7f65d2d9d700 1 -- 172.21.15.49:0/1561784224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65d40cae90 msgr2=0x7f65d4155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:12.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.073+0000 7f65d2d9d700 1 --2- 172.21.15.49:0/1561784224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65d40cae90 0x7f65d4155b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:12.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.073+0000 7f65d2d9d700 1 -- 172.21.15.49:0/1561784224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65bc009370 con 0x7f65d40caab0 2023-11-30T17:26:12.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.074+0000 7f65d2d9d700 1 --2- 172.21.15.49:0/1561784224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65d40caab0 0x7f65d414bbe0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7f65cc00d890 tx=0x7f65cc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:12.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.074+0000 7f65caffd700 1 -- 172.21.15.49:0/1561784224 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65cc0125f0 con 0x7f65d40caab0 2023-11-30T17:26:12.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.074+0000 7f65caffd700 1 -- 172.21.15.49:0/1561784224 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65cc012750 con 0x7f65d40caab0 2023-11-30T17:26:12.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.074+0000 7f65d911f700 1 -- 172.21.15.49:0/1561784224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d4155030 con 0x7f65d40caab0 2023-11-30T17:26:12.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.074+0000 7f65caffd700 1 -- 172.21.15.49:0/1561784224 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65cc012ad0 con 0x7f65d40caab0 2023-11-30T17:26:12.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.074+0000 7f65d911f700 1 -- 172.21.15.49:0/1561784224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d4167cc0 con 0x7f65d40caab0 2023-11-30T17:26:12.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.075+0000 7f65d911f700 1 -- 172.21.15.49:0/1561784224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d406c860 con 0x7f65d40caab0 2023-11-30T17:26:12.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.075+0000 7f65caffd700 1 -- 172.21.15.49:0/1561784224 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f65cc013480 con 0x7f65d40caab0 2023-11-30T17:26:12.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.075+0000 7f65caffd700 1 --2- 172.21.15.49:0/1561784224 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f65b405f270 0x7f65b4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:12.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.075+0000 7f65caffd700 1 -- 172.21.15.49:0/1561784224 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5927+0+0 (secure 0 0 0) 0x7f65cc07a6b0 con 0x7f65d40caab0 2023-11-30T17:26:12.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.076+0000 7f65d259c700 1 --2- 172.21.15.49:0/1561784224 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f65b405f270 0x7f65b4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:12.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.076+0000 7f65d259c700 1 --2- 172.21.15.49:0/1561784224 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f65b405f270 0x7f65b4061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f65d40b0d10 tx=0x7f65bc017000).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:12.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.080+0000 7f65caffd700 1 -- 172.21.15.49:0/1561784224 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f65cc04b860 con 0x7f65d40caab0 2023-11-30T17:26:12.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:12.322+0000 7f65d911f700 1 -- 172.21.15.49:0/1561784224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7f65d40a9440 con 0x7f65d40caab0 2023-11-30T17:26:13.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.282+0000 7f65caffd700 1 -- 172.21.15.49:0/1561784224 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v704) v1 ==== 148+0+0 (secure 0 0 0) 0x7f65cc04ee80 con 0x7f65d40caab0 2023-11-30T17:26:13.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.284+0000 7f65d911f700 1 -- 172.21.15.49:0/1561784224 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f65b405f270 msgr2=0x7f65b4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:13.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.284+0000 7f65d911f700 1 --2- 172.21.15.49:0/1561784224 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f65b405f270 0x7f65b4061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f65d40b0d10 tx=0x7f65bc017000).stop 2023-11-30T17:26:13.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.284+0000 7f65d911f700 1 -- 172.21.15.49:0/1561784224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65d40caab0 msgr2=0x7f65d414bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:13.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.284+0000 7f65d911f700 1 --2- 172.21.15.49:0/1561784224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65d40caab0 0x7f65d414bbe0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7f65cc00d890 tx=0x7f65cc008040).stop 2023-11-30T17:26:13.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.284+0000 7f65d911f700 1 -- 172.21.15.49:0/1561784224 shutdown_connections 2023-11-30T17:26:13.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.284+0000 7f65d911f700 1 --2- 172.21.15.49:0/1561784224 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65d4153a10 0x7f65d4153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:13.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.284+0000 7f65d911f700 1 --2- 172.21.15.49:0/1561784224 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f65b405f270 0x7f65b4061730 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:13.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.284+0000 7f65d911f700 1 --2- 172.21.15.49:0/1561784224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65d40caab0 0x7f65d414bbe0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:13.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.284+0000 7f65d911f700 1 --2- 172.21.15.49:0/1561784224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65d40cae90 0x7f65d4155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:13.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.284+0000 7f65d911f700 1 -- 172.21.15.49:0/1561784224 >> 172.21.15.49:0/1561784224 conn(0x7f65d4094920 msgr2=0x7f65d40ac010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:13.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.284+0000 7f65d911f700 1 -- 172.21.15.49:0/1561784224 shutdown_connections 2023-11-30T17:26:13.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.285+0000 7f65d911f700 1 -- 172.21.15.49:0/1561784224 wait complete. 2023-11-30T17:26:13.300 INFO:tasks.cephfs_test_runner:Test existence of a scheduled snapshot ... ok 2023-11-30T17:26:13.301 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_for_number_of_snaps_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that number of snaps retained are as per user spec. 2023-11-30T17:26:13.301 INFO:tasks.cephfs_test_runner:test_snap_schedule_for_number_of_snaps_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-11-30T17:26:13.301 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention' 2023-11-30T17:26:13.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.419+0000 7ff11b071700 1 Processor -- start 2023-11-30T17:26:13.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.419+0000 7ff11b071700 1 -- start start 2023-11-30T17:26:13.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.419+0000 7ff11b071700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1141544e0 0x7ff1141548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:13.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.419+0000 7ff11b071700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff1140c6e30 0x7ff1140c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:13.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.420+0000 7ff11b071700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1140c69a0 con 0x7ff11406a610 2023-11-30T17:26:13.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.420+0000 7ff11b071700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1140c13a0 con 0x7ff1140c6e30 2023-11-30T17:26:13.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.420+0000 7ff11b071700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1140c1680 con 0x7ff1141544e0 2023-11-30T17:26:13.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.420+0000 7ff11960e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff1140c6e30 0x7ff1140c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:13.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.420+0000 7ff113fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff11406a610 0x7ff1140c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48300/0 (socket says 172.21.15.49:48300) 2023-11-30T17:26:13.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.420+0000 7ff113fff700 1 -- 172.21.15.49:0/2336606735 learned_addr learned my addr 172.21.15.49:0/2336606735 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:13.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.420+0000 7ff11960e700 1 -- 172.21.15.49:0/2336606735 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1141544e0 msgr2=0x7ff1141548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:13.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.420+0000 7ff118e0d700 1 --2- 172.21.15.49:0/2336606735 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1141544e0 0x7ff1141548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:13.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.420+0000 7ff1137fe700 1 -- 172.21.15.49:0/2336606735 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2164613486 0 0) 0x7ff1140c69a0 con 0x7ff11406a610 2023-11-30T17:26:13.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.420+0000 7ff11960e700 1 --2- 172.21.15.49:0/2336606735 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1141544e0 0x7ff1141548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:13.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.420+0000 7ff11960e700 1 -- 172.21.15.49:0/2336606735 >> v1:172.21.15.49:6789/0 conn(0x7ff11406a610 legacy=0x7ff1140c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:13.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.420+0000 7ff11960e700 1 -- 172.21.15.49:0/2336606735 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1140c6630 con 0x7ff1140c6e30 2023-11-30T17:26:13.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.420+0000 7ff118e0d700 1 --2- 172.21.15.49:0/2336606735 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1141544e0 0x7ff1141548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:26:13.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.420+0000 7ff11960e700 1 --2- 172.21.15.49:0/2336606735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1140c6e30 0x7ff1140c72e0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7ff0fc009760 tx=0x7ff0fc009060).ready entity=mon.0 client_cookie=4c45b678b887bd2a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:13.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.420+0000 7ff1137fe700 1 -- 172.21.15.49:0/2336606735 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc00b580 con 0x7ff1140c6e30 2023-11-30T17:26:13.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.420+0000 7ff1137fe700 1 -- 172.21.15.49:0/2336606735 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0fc00b6e0 con 0x7ff1140c6e30 2023-11-30T17:26:13.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.420+0000 7ff1137fe700 1 -- 172.21.15.49:0/2336606735 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc00ba60 con 0x7ff1140c6e30 2023-11-30T17:26:13.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.421+0000 7ff11b071700 1 -- 172.21.15.49:0/2336606735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1140c6e30 msgr2=0x7ff1140c72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:13.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.421+0000 7ff11b071700 1 --2- 172.21.15.49:0/2336606735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1140c6e30 0x7ff1140c72e0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7ff0fc009760 tx=0x7ff0fc009060).stop 2023-11-30T17:26:13.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.421+0000 7ff11b071700 1 -- 172.21.15.49:0/2336606735 shutdown_connections 2023-11-30T17:26:13.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.421+0000 7ff11b071700 1 --2- 172.21.15.49:0/2336606735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1140c6e30 0x7ff1140c72e0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:13.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.421+0000 7ff11b071700 1 --2- 172.21.15.49:0/2336606735 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1141544e0 0x7ff1141548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:13.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.421+0000 7ff11b071700 1 -- 172.21.15.49:0/2336606735 >> 172.21.15.49:0/2336606735 conn(0x7ff114085020 msgr2=0x7ff114094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:13.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.421+0000 7ff11b071700 1 -- 172.21.15.49:0/2336606735 shutdown_connections 2023-11-30T17:26:13.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.421+0000 7ff11b071700 1 -- 172.21.15.49:0/2336606735 wait complete. 2023-11-30T17:26:13.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.422+0000 7ff11b071700 1 Processor -- start 2023-11-30T17:26:13.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.422+0000 7ff11b071700 1 -- start start 2023-11-30T17:26:13.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.423+0000 7ff11b071700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff11406a610 0x7ff114153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:13.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.423+0000 7ff11b071700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1140c6e30 0x7ff1140964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:13.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.423+0000 7ff11b071700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1141544e0 0x7ff1140981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:13.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.423+0000 7ff11b071700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff114153b40 con 0x7ff1141544e0 2023-11-30T17:26:13.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.423+0000 7ff11b071700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff114095410 con 0x7ff1140c6e30 2023-11-30T17:26:13.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.423+0000 7ff11b071700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1140956f0 con 0x7ff11406a610 2023-11-30T17:26:13.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.423+0000 7ff11960e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1141544e0 0x7ff1140981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:13.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.423+0000 7ff11960e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1141544e0 0x7ff1140981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59710/0 (socket says 172.21.15.49:59710) 2023-11-30T17:26:13.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.423+0000 7ff11960e700 1 -- 172.21.15.49:0/1140530889 learned_addr learned my addr 172.21.15.49:0/1140530889 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:13.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.423+0000 7ff113fff700 1 --2- 172.21.15.49:0/1140530889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1140c6e30 0x7ff1140964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:13.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.423+0000 7ff118e0d700 1 --2- 172.21.15.49:0/1140530889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff11406a610 0x7ff114153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:13.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.423+0000 7ff11960e700 1 -- 172.21.15.49:0/1140530889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff11406a610 msgr2=0x7ff114153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:13.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.423+0000 7ff11960e700 1 --2- 172.21.15.49:0/1140530889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff11406a610 0x7ff114153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:13.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.423+0000 7ff11960e700 1 -- 172.21.15.49:0/1140530889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1140c6e30 msgr2=0x7ff1140964b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:13.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.423+0000 7ff11960e700 1 --2- 172.21.15.49:0/1140530889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1140c6e30 0x7ff1140964b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:13.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.423+0000 7ff11960e700 1 -- 172.21.15.49:0/1140530889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc0092a0 con 0x7ff1141544e0 2023-11-30T17:26:13.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.424+0000 7ff113fff700 1 --2- 172.21.15.49:0/1140530889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1140c6e30 0x7ff1140964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:26:13.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.424+0000 7ff118e0d700 1 --2- 172.21.15.49:0/1140530889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff11406a610 0x7ff114153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:26:13.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.424+0000 7ff11960e700 1 --2- 172.21.15.49:0/1140530889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1141544e0 0x7ff1140981e0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7ff0fc009eb0 tx=0x7ff0fc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:13.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.424+0000 7ff110ff9700 1 -- 172.21.15.49:0/1140530889 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc00ba60 con 0x7ff1141544e0 2023-11-30T17:26:13.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.424+0000 7ff110ff9700 1 -- 172.21.15.49:0/1140530889 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0fc01b440 con 0x7ff1141544e0 2023-11-30T17:26:13.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.424+0000 7ff11b071700 1 -- 172.21.15.49:0/1140530889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1140959d0 con 0x7ff1141544e0 2023-11-30T17:26:13.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.424+0000 7ff110ff9700 1 -- 172.21.15.49:0/1140530889 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc01b7c0 con 0x7ff1141544e0 2023-11-30T17:26:13.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.424+0000 7ff11b071700 1 -- 172.21.15.49:0/1140530889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff114095f90 con 0x7ff1141544e0 2023-11-30T17:26:13.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.425+0000 7ff11b071700 1 -- 172.21.15.49:0/1140530889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff11406c860 con 0x7ff1141544e0 2023-11-30T17:26:13.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.425+0000 7ff110ff9700 1 -- 172.21.15.49:0/1140530889 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff0fc01bbf0 con 0x7ff1141544e0 2023-11-30T17:26:13.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.426+0000 7ff110ff9700 1 --2- 172.21.15.49:0/1140530889 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff0f405f270 0x7ff0f4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:13.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.426+0000 7ff110ff9700 1 -- 172.21.15.49:0/1140530889 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5927+0+0 (secure 0 0 0) 0x7ff0fc07be30 con 0x7ff1141544e0 2023-11-30T17:26:13.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.426+0000 7ff118e0d700 1 --2- 172.21.15.49:0/1140530889 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff0f405f270 0x7ff0f4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:13.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.426+0000 7ff118e0d700 1 --2- 172.21.15.49:0/1140530889 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff0f405f270 0x7ff0f4061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7ff10c0088e0 tx=0x7ff10c008040).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:13.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.430+0000 7ff110ff9700 1 -- 172.21.15.49:0/1140530889 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff0fc04cf80 con 0x7ff1141544e0 2023-11-30T17:26:13.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:13.669+0000 7ff11b071700 1 -- 172.21.15.49:0/1140530889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]} v 0) v1 -- 0x7ff1140c5890 con 0x7ff1141544e0 2023-11-30T17:26:14.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.284+0000 7ff110ff9700 1 -- 172.21.15.49:0/1140530889 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]}]=0 v705) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff0fc028020 con 0x7ff1141544e0 2023-11-30T17:26:14.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.286+0000 7ff11b071700 1 -- 172.21.15.49:0/1140530889 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff0f405f270 msgr2=0x7ff0f4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:14.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.286+0000 7ff11b071700 1 --2- 172.21.15.49:0/1140530889 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff0f405f270 0x7ff0f4061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7ff10c0088e0 tx=0x7ff10c008040).stop 2023-11-30T17:26:14.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.286+0000 7ff11b071700 1 -- 172.21.15.49:0/1140530889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1141544e0 msgr2=0x7ff1140981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:14.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.286+0000 7ff11b071700 1 --2- 172.21.15.49:0/1140530889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1141544e0 0x7ff1140981e0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7ff0fc009eb0 tx=0x7ff0fc017000).stop 2023-11-30T17:26:14.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.286+0000 7ff11b071700 1 -- 172.21.15.49:0/1140530889 shutdown_connections 2023-11-30T17:26:14.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.286+0000 7ff11b071700 1 --2- 172.21.15.49:0/1140530889 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff0f405f270 0x7ff0f4061730 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:14.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.286+0000 7ff11b071700 1 --2- 172.21.15.49:0/1140530889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1141544e0 0x7ff1140981e0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:14.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.286+0000 7ff11b071700 1 --2- 172.21.15.49:0/1140530889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff11406a610 0x7ff114153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:14.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.286+0000 7ff11b071700 1 --2- 172.21.15.49:0/1140530889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1140c6e30 0x7ff1140964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:14.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.286+0000 7ff11b071700 1 -- 172.21.15.49:0/1140530889 >> 172.21.15.49:0/1140530889 conn(0x7ff114085020 msgr2=0x7ff1140b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:14.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.286+0000 7ff11b071700 1 -- 172.21.15.49:0/1140530889 shutdown_connections 2023-11-30T17:26:14.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.286+0000 7ff11b071700 1 -- 172.21.15.49:0/1140530889 wait complete. 2023-11-30T17:26:14.301 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-30T17:26:14.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.422+0000 7f6e0f00c700 1 Processor -- start 2023-11-30T17:26:14.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.422+0000 7f6e0f00c700 1 -- start start 2023-11-30T17:26:14.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.423+0000 7f6e0f00c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6e08098d10 0x7f6e080c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:14.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.423+0000 7f6e0f00c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6e08158320 0x7f6e081587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:14.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.423+0000 7f6e0f00c700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e08158cc0 con 0x7f6e080c6190 2023-11-30T17:26:14.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.423+0000 7f6e0f00c700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e080c72d0 con 0x7f6e08158320 2023-11-30T17:26:14.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.423+0000 7f6e0f00c700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e08064570 con 0x7f6e08098d10 2023-11-30T17:26:14.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.423+0000 7f6e0d5a9700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6e08158320 0x7f6e081587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:14.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.423+0000 7f6e0d5a9700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6e08158320 0x7f6e081587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59726/0 (socket says 172.21.15.49:59726) 2023-11-30T17:26:14.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.423+0000 7f6e0d5a9700 1 -- 172.21.15.49:0/2803782266 learned_addr learned my addr 172.21.15.49:0/2803782266 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:14.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.424+0000 7f6e0d5a9700 1 -- 172.21.15.49:0/2803782266 >> v2:172.21.15.115:3300/0 conn(0x7f6e08098d10 msgr2=0x7f6e080c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:14.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.424+0000 7f6e0cda8700 1 --2- 172.21.15.49:0/2803782266 >> v2:172.21.15.115:3300/0 conn(0x7f6e08098d10 0x7f6e080c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:14.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.424+0000 7f6e0d5a9700 1 --2- 172.21.15.49:0/2803782266 >> v2:172.21.15.115:3300/0 conn(0x7f6e08098d10 0x7f6e080c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:14.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.424+0000 7f6e0d5a9700 1 -- 172.21.15.49:0/2803782266 >> v1:172.21.15.115:6789/0 conn(0x7f6e080c6190 legacy=0x7f6e08063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:14.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.424+0000 7f6e0d5a9700 1 -- 172.21.15.49:0/2803782266 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e08154bc0 con 0x7f6e08158320 2023-11-30T17:26:14.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.424+0000 7f6e0d5a9700 1 --2- 172.21.15.49:0/2803782266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e08158320 0x7f6e081587d0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7f6e08083f80 tx=0x7f6df00090f0).ready entity=mon.0 client_cookie=ff4a9cfb79e9eb33 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:14.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.424+0000 7f6e077fe700 1 -- 172.21.15.49:0/2803782266 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df000b5a0 con 0x7f6e08158320 2023-11-30T17:26:14.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.424+0000 7f6e077fe700 1 -- 172.21.15.49:0/2803782266 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df000b700 con 0x7f6e08158320 2023-11-30T17:26:14.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.424+0000 7f6e077fe700 1 -- 172.21.15.49:0/2803782266 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df000ba80 con 0x7f6e08158320 2023-11-30T17:26:14.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.425+0000 7f6e0f00c700 1 -- 172.21.15.49:0/2803782266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e08158320 msgr2=0x7f6e081587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:14.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.425+0000 7f6e0f00c700 1 --2- 172.21.15.49:0/2803782266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e08158320 0x7f6e081587d0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7f6e08083f80 tx=0x7f6df00090f0).stop 2023-11-30T17:26:14.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.425+0000 7f6e0f00c700 1 -- 172.21.15.49:0/2803782266 shutdown_connections 2023-11-30T17:26:14.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.425+0000 7f6e0f00c700 1 --2- 172.21.15.49:0/2803782266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e08158320 0x7f6e081587d0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:14.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.425+0000 7f6e0f00c700 1 --2- 172.21.15.49:0/2803782266 >> v2:172.21.15.115:3300/0 conn(0x7f6e08098d10 0x7f6e080c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:14.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.425+0000 7f6e0f00c700 1 -- 172.21.15.49:0/2803782266 >> 172.21.15.49:0/2803782266 conn(0x7f6e080cb310 msgr2=0x7f6e080cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:14.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.425+0000 7f6e0f00c700 1 -- 172.21.15.49:0/2803782266 shutdown_connections 2023-11-30T17:26:14.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.425+0000 7f6e0f00c700 1 -- 172.21.15.49:0/2803782266 wait complete. 2023-11-30T17:26:14.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.426+0000 7f6e0f00c700 1 Processor -- start 2023-11-30T17:26:14.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.426+0000 7f6e0f00c700 1 -- start start 2023-11-30T17:26:14.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.427+0000 7f6e0f00c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e08098d10 0x7f6e080c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:14.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.427+0000 7f6e0f00c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e080c6190 0x7f6e08156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:14.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.427+0000 7f6e0f00c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e08158320 0x7f6e08150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:14.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.427+0000 7f6e0f00c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e080c5550 con 0x7f6e08158320 2023-11-30T17:26:14.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.427+0000 7f6e0f00c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e081566f0 con 0x7f6e080c6190 2023-11-30T17:26:14.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.427+0000 7f6e0f00c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e080c4940 con 0x7f6e08098d10 2023-11-30T17:26:14.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.427+0000 7f6e0d5a9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e08158320 0x7f6e08150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:14.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.427+0000 7f6e0d5a9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e08158320 0x7f6e08150280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59728/0 (socket says 172.21.15.49:59728) 2023-11-30T17:26:14.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.427+0000 7f6e0d5a9700 1 -- 172.21.15.49:0/3003012120 learned_addr learned my addr 172.21.15.49:0/3003012120 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:14.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.427+0000 7f6e07fff700 1 --2- 172.21.15.49:0/3003012120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e080c6190 0x7f6e08156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:14.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.427+0000 7f6e0cda8700 1 --2- 172.21.15.49:0/3003012120 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e08098d10 0x7f6e080c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:14.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.427+0000 7f6e0d5a9700 1 -- 172.21.15.49:0/3003012120 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e08098d10 msgr2=0x7f6e080c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:14.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.427+0000 7f6e0d5a9700 1 --2- 172.21.15.49:0/3003012120 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e08098d10 0x7f6e080c42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:14.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.427+0000 7f6e0d5a9700 1 -- 172.21.15.49:0/3003012120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e080c6190 msgr2=0x7f6e08156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:14.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.427+0000 7f6e0d5a9700 1 --2- 172.21.15.49:0/3003012120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e080c6190 0x7f6e08156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:14.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.427+0000 7f6e0d5a9700 1 -- 172.21.15.49:0/3003012120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df0009370 con 0x7f6e08158320 2023-11-30T17:26:14.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.427+0000 7f6e0d5a9700 1 --2- 172.21.15.49:0/3003012120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e08158320 0x7f6e08150280 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7f6df0006df0 tx=0x7f6df0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:14.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.427+0000 7f6e04ff9700 1 -- 172.21.15.49:0/3003012120 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df000ba80 con 0x7f6e08158320 2023-11-30T17:26:14.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.428+0000 7f6e04ff9700 1 -- 172.21.15.49:0/3003012120 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df000bec0 con 0x7f6e08158320 2023-11-30T17:26:14.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.428+0000 7f6e0f00c700 1 -- 172.21.15.49:0/3003012120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e080c4c20 con 0x7f6e08158320 2023-11-30T17:26:14.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.428+0000 7f6e04ff9700 1 -- 172.21.15.49:0/3003012120 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df001c670 con 0x7f6e08158320 2023-11-30T17:26:14.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.428+0000 7f6e0f00c700 1 -- 172.21.15.49:0/3003012120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e080c51e0 con 0x7f6e08158320 2023-11-30T17:26:14.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.429+0000 7f6e0f00c700 1 -- 172.21.15.49:0/3003012120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e080c56c0 con 0x7f6e08158320 2023-11-30T17:26:14.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.429+0000 7f6e04ff9700 1 -- 172.21.15.49:0/3003012120 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6df001ca20 con 0x7f6e08158320 2023-11-30T17:26:14.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.429+0000 7f6e04ff9700 1 --2- 172.21.15.49:0/3003012120 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6de805f240 0x7f6de8061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:14.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.429+0000 7f6e04ff9700 1 -- 172.21.15.49:0/3003012120 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5927+0+0 (secure 0 0 0) 0x7f6df007bea0 con 0x7f6e08158320 2023-11-30T17:26:14.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.429+0000 7f6e0cda8700 1 --2- 172.21.15.49:0/3003012120 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6de805f240 0x7f6de8061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:14.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.430+0000 7f6e0cda8700 1 --2- 172.21.15.49:0/3003012120 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6de805f240 0x7f6de8061700 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f6e0000ab30 tx=0x7f6e00008040).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:14.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.433+0000 7f6e04ff9700 1 -- 172.21.15.49:0/3003012120 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6df004d0b0 con 0x7f6e08158320 2023-11-30T17:26:14.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.607+0000 7f6e0f00c700 1 -- 172.21.15.49:0/3003012120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6e08158cc0 con 0x7f6e08158320 2023-11-30T17:26:14.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.611+0000 7f6e04ff9700 1 -- 172.21.15.49:0/3003012120 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6e08158cc0 con 0x7f6e08158320 2023-11-30T17:26:14.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.613+0000 7f6e0f00c700 1 -- 172.21.15.49:0/3003012120 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6de805f240 msgr2=0x7f6de8061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:14.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.613+0000 7f6e0f00c700 1 --2- 172.21.15.49:0/3003012120 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6de805f240 0x7f6de8061700 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f6e0000ab30 tx=0x7f6e00008040).stop 2023-11-30T17:26:14.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.613+0000 7f6e0f00c700 1 -- 172.21.15.49:0/3003012120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e08158320 msgr2=0x7f6e08150280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:14.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.613+0000 7f6e0f00c700 1 --2- 172.21.15.49:0/3003012120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e08158320 0x7f6e08150280 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7f6df0006df0 tx=0x7f6df0015000).stop 2023-11-30T17:26:14.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.613+0000 7f6e0f00c700 1 -- 172.21.15.49:0/3003012120 shutdown_connections 2023-11-30T17:26:14.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.613+0000 7f6e0f00c700 1 --2- 172.21.15.49:0/3003012120 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f6de805f240 0x7f6de8061700 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:14.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.613+0000 7f6e0f00c700 1 --2- 172.21.15.49:0/3003012120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e08158320 0x7f6e08150280 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:14.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.613+0000 7f6e0f00c700 1 --2- 172.21.15.49:0/3003012120 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e08098d10 0x7f6e080c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:14.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.613+0000 7f6e0f00c700 1 --2- 172.21.15.49:0/3003012120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e080c6190 0x7f6e08156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:14.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.613+0000 7f6e0f00c700 1 -- 172.21.15.49:0/3003012120 >> 172.21.15.49:0/3003012120 conn(0x7f6e080cb310 msgr2=0x7f6e081530f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:14.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.613+0000 7f6e0f00c700 1 -- 172.21.15.49:0/3003012120 shutdown_connections 2023-11-30T17:26:14.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.613+0000 7f6e0f00c700 1 -- 172.21.15.49:0/3003012120 wait complete. 2023-11-30T17:26:14.628 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-30T17:26:14.628 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T17:26:14.667 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T17:26:14.707 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-30T17:26:14.707 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-30T17:26:14.708 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:26:14.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.823+0000 7f7b76a37700 1 Processor -- start 2023-11-30T17:26:14.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.823+0000 7f7b76a37700 1 -- start start 2023-11-30T17:26:14.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.824+0000 7f7b76a37700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7b700cae90 0x7f7b700c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:14.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.824+0000 7f7b76a37700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b700a9a90 con 0x7f7b700ca180 2023-11-30T17:26:14.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.824+0000 7f7b76a37700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b70154ce0 con 0x7f7b700caab0 2023-11-30T17:26:14.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.824+0000 7f7b76a37700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b700aab80 con 0x7f7b700cae90 2023-11-30T17:26:14.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.824+0000 7f7b6f7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7b700cae90 0x7f7b700c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:14.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.824+0000 7f7b74fd4700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7b700ca180 0x7f7b7015e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48308/0 (socket says 172.21.15.49:48308) 2023-11-30T17:26:14.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.824+0000 7f7b74fd4700 1 -- 172.21.15.49:0/1696650940 learned_addr learned my addr 172.21.15.49:0/1696650940 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:14.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.824+0000 7f7b6f7fe700 1 -- 172.21.15.49:0/1696650940 >> v1:172.21.15.115:6789/0 conn(0x7f7b700caab0 legacy=0x7f7b700aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:14.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.824+0000 7f7b6f7fe700 1 -- 172.21.15.49:0/1696650940 >> v1:172.21.15.49:6789/0 conn(0x7f7b700ca180 legacy=0x7f7b7015e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:14.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.824+0000 7f7b6f7fe700 1 -- 172.21.15.49:0/1696650940 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b700a8e80 con 0x7f7b700cae90 2023-11-30T17:26:14.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.824+0000 7f7b6f7fe700 1 --2- 172.21.15.49:0/1696650940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b700cae90 0x7f7b700c0ab0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7f7b64009760 tx=0x7f7b64009060).ready entity=mon.0 client_cookie=25802cbb6df3561 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:14.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.824+0000 7f7b6effd700 1 -- 172.21.15.49:0/1696650940 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6400b520 con 0x7f7b700cae90 2023-11-30T17:26:14.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.825+0000 7f7b6effd700 1 -- 172.21.15.49:0/1696650940 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6400b680 con 0x7f7b700cae90 2023-11-30T17:26:14.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.825+0000 7f7b6effd700 1 -- 172.21.15.49:0/1696650940 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6400ba00 con 0x7f7b700cae90 2023-11-30T17:26:14.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.825+0000 7f7b76a37700 1 -- 172.21.15.49:0/1696650940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b700cae90 msgr2=0x7f7b700c0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:14.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.825+0000 7f7b76a37700 1 --2- 172.21.15.49:0/1696650940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b700cae90 0x7f7b700c0ab0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7f7b64009760 tx=0x7f7b64009060).stop 2023-11-30T17:26:14.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.825+0000 7f7b76a37700 1 -- 172.21.15.49:0/1696650940 shutdown_connections 2023-11-30T17:26:14.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.825+0000 7f7b76a37700 1 --2- 172.21.15.49:0/1696650940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b700cae90 0x7f7b700c0ab0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:14.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.825+0000 7f7b76a37700 1 -- 172.21.15.49:0/1696650940 >> 172.21.15.49:0/1696650940 conn(0x7f7b70094920 msgr2=0x7f7b7006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:14.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.825+0000 7f7b76a37700 1 -- 172.21.15.49:0/1696650940 shutdown_connections 2023-11-30T17:26:14.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.825+0000 7f7b76a37700 1 -- 172.21.15.49:0/1696650940 wait complete. 2023-11-30T17:26:14.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.826+0000 7f7b76a37700 1 Processor -- start 2023-11-30T17:26:14.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.826+0000 7f7b76a37700 1 -- start start 2023-11-30T17:26:14.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.827+0000 7f7b76a37700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b700ca180 0x7f7b70164820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:14.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.827+0000 7f7b76a37700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b700caab0 0x7f7b700c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:14.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.827+0000 7f7b76a37700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b700cae90 0x7f7b70156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:14.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.827+0000 7f7b76a37700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b70164d10 con 0x7f7b700ca180 2023-11-30T17:26:14.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.827+0000 7f7b76a37700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b700c8ad0 con 0x7f7b700caab0 2023-11-30T17:26:14.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.827+0000 7f7b76a37700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b701657c0 con 0x7f7b700cae90 2023-11-30T17:26:14.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.827+0000 7f7b6ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b700ca180 0x7f7b70164820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:14.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.827+0000 7f7b6ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b700ca180 0x7f7b70164820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59750/0 (socket says 172.21.15.49:59750) 2023-11-30T17:26:14.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.827+0000 7f7b6ffff700 1 -- 172.21.15.49:0/1845864083 learned_addr learned my addr 172.21.15.49:0/1845864083 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:14.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.827+0000 7f7b6f7fe700 1 --2- 172.21.15.49:0/1845864083 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b700caab0 0x7f7b700c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:14.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.827+0000 7f7b74fd4700 1 --2- 172.21.15.49:0/1845864083 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b700cae90 0x7f7b70156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:14.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.827+0000 7f7b6ffff700 1 -- 172.21.15.49:0/1845864083 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b700cae90 msgr2=0x7f7b70156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:14.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.827+0000 7f7b6ffff700 1 --2- 172.21.15.49:0/1845864083 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b700cae90 0x7f7b70156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:14.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.827+0000 7f7b6ffff700 1 -- 172.21.15.49:0/1845864083 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b700caab0 msgr2=0x7f7b700c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:14.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.827+0000 7f7b6ffff700 1 --2- 172.21.15.49:0/1845864083 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b700caab0 0x7f7b700c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:14.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.827+0000 7f7b6ffff700 1 -- 172.21.15.49:0/1845864083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b640092a0 con 0x7f7b700ca180 2023-11-30T17:26:14.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.828+0000 7f7b6ffff700 1 --2- 172.21.15.49:0/1845864083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b700ca180 0x7f7b70164820 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7f7b60002f30 tx=0x7f7b60007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:14.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.828+0000 7f7b57fff700 1 -- 172.21.15.49:0/1845864083 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6000ce90 con 0x7f7b700ca180 2023-11-30T17:26:14.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.828+0000 7f7b57fff700 1 -- 172.21.15.49:0/1845864083 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6000f470 con 0x7f7b700ca180 2023-11-30T17:26:14.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.828+0000 7f7b57fff700 1 -- 172.21.15.49:0/1845864083 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6000f830 con 0x7f7b700ca180 2023-11-30T17:26:14.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.828+0000 7f7b76a37700 1 -- 172.21.15.49:0/1845864083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b70164f20 con 0x7f7b700ca180 2023-11-30T17:26:14.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.828+0000 7f7b76a37700 1 -- 172.21.15.49:0/1845864083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b701654e0 con 0x7f7b700ca180 2023-11-30T17:26:14.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.829+0000 7f7b76a37700 1 -- 172.21.15.49:0/1845864083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b700b12f0 con 0x7f7b700ca180 2023-11-30T17:26:14.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.829+0000 7f7b57fff700 1 -- 172.21.15.49:0/1845864083 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f7b6000fc20 con 0x7f7b700ca180 2023-11-30T17:26:14.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.829+0000 7f7b57fff700 1 --2- 172.21.15.49:0/1845864083 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7b5c05f270 0x7f7b5c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:14.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.830+0000 7f7b57fff700 1 -- 172.21.15.49:0/1845864083 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5927+0+0 (secure 0 0 0) 0x7f7b600794b0 con 0x7f7b700ca180 2023-11-30T17:26:14.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.830+0000 7f7b6f7fe700 1 --2- 172.21.15.49:0/1845864083 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7b5c05f270 0x7f7b5c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:14.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.830+0000 7f7b6f7fe700 1 --2- 172.21.15.49:0/1845864083 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7b5c05f270 0x7f7b5c061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f7b6400b2e0 tx=0x7f7b64017000).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:14.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:14.834+0000 7f7b57fff700 1 -- 172.21.15.49:0/1845864083 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7b60047b00 con 0x7f7b700ca180 2023-11-30T17:26:15.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.050+0000 7f7b76a37700 1 -- 172.21.15.49:0/1845864083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b7006c860 con 0x7f7b700ca180 2023-11-30T17:26:15.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.050+0000 7f7b57fff700 1 -- 172.21.15.49:0/1845864083 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f7b6004a770 con 0x7f7b700ca180 2023-11-30T17:26:15.053 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:26:15.053 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":55,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/744782933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":744782933},{"type":"v1","addr":"172.21.15.115:6837","nonce":744782933}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6827,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/2226333758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2226333758},{"type":"v1","addr":"172.21.15.115:6835","nonce":2226333758}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":7638,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/2409585815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2409585815},{"type":"v1","addr":"172.21.15.49:6834","nonce":2409585815}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7641,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3249829086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3249829086},{"type":"v1","addr":"172.21.15.49:6835","nonce":3249829086}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[]} 2023-11-30T17:26:15.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.052+0000 7f7b76a37700 1 -- 172.21.15.49:0/1845864083 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7b5c05f270 msgr2=0x7f7b5c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:15.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.052+0000 7f7b76a37700 1 --2- 172.21.15.49:0/1845864083 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7b5c05f270 0x7f7b5c061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f7b6400b2e0 tx=0x7f7b64017000).stop 2023-11-30T17:26:15.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.052+0000 7f7b76a37700 1 -- 172.21.15.49:0/1845864083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b700ca180 msgr2=0x7f7b70164820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:15.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.052+0000 7f7b76a37700 1 --2- 172.21.15.49:0/1845864083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b700ca180 0x7f7b70164820 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7f7b60002f30 tx=0x7f7b60007e30).stop 2023-11-30T17:26:15.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.052+0000 7f7b76a37700 1 -- 172.21.15.49:0/1845864083 shutdown_connections 2023-11-30T17:26:15.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.052+0000 7f7b76a37700 1 --2- 172.21.15.49:0/1845864083 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b700cae90 0x7f7b70156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:15.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.052+0000 7f7b76a37700 1 --2- 172.21.15.49:0/1845864083 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7b5c05f270 0x7f7b5c061730 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:15.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.052+0000 7f7b76a37700 1 --2- 172.21.15.49:0/1845864083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b700ca180 0x7f7b70164820 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:15.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.052+0000 7f7b76a37700 1 --2- 172.21.15.49:0/1845864083 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b700caab0 0x7f7b700c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:15.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.052+0000 7f7b76a37700 1 -- 172.21.15.49:0/1845864083 >> 172.21.15.49:0/1845864083 conn(0x7f7b70094920 msgr2=0x7f7b700c9520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:15.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.052+0000 7f7b76a37700 1 -- 172.21.15.49:0/1845864083 shutdown_connections 2023-11-30T17:26:15.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.052+0000 7f7b76a37700 1 -- 172.21.15.49:0/1845864083 wait complete. 2023-11-30T17:26:15.056 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 55 2023-11-30T17:26:15.067 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-30T17:26:15.067 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-30T17:26:15.068 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-30T17:26:15.068 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T17:26:15.068 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-30T17:26:15.068 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-30T17:26:15.068 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-30T17:26:15.068 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T17:26:15.068 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-30T17:26:15.069 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-30T17:26:15.069 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-30T17:26:15.069 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T17:26:15.069 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-30T17:26:15.069 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-30T17:26:15.069 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-30T17:26:15.069 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T17:26:15.077 INFO:tasks.ceph.mds.a:Stopped 2023-11-30T17:26:15.077 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-30T17:26:15.078 INFO:tasks.ceph.mds.c:Stopped 2023-11-30T17:26:15.078 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-30T17:26:15.080 INFO:tasks.ceph.mds.b:Stopped 2023-11-30T17:26:15.080 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-30T17:26:15.081 INFO:tasks.ceph.mds.d:Stopped 2023-11-30T17:26:15.081 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-30T17:26:15.120 INFO:tasks.ceph.mds.a:Started 2023-11-30T17:26:15.120 DEBUG:teuthology.parallel:result is None 2023-11-30T17:26:15.121 INFO:tasks.ceph.mds.c:Started 2023-11-30T17:26:15.121 DEBUG:teuthology.parallel:result is None 2023-11-30T17:26:15.123 INFO:tasks.ceph.mds.b:Started 2023-11-30T17:26:15.123 DEBUG:teuthology.parallel:result is None 2023-11-30T17:26:15.124 INFO:tasks.ceph.mds.d:Started 2023-11-30T17:26:15.125 DEBUG:teuthology.parallel:result is None 2023-11-30T17:26:15.125 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-30T17:26:15.195 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-11-30T17:26:15.196 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-11-30T17:26:15.201 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-11-30T17:26:15.202 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-11-30T17:26:15.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.253+0000 7f4c6406d700 1 Processor -- start 2023-11-30T17:26:15.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.253+0000 7f4c6406d700 1 -- start start 2023-11-30T17:26:15.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.254+0000 7f4c6406d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4c5c0c51a0 0x7f4c5c153390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:15.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.254+0000 7f4c6406d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c5c0c5ea0 0x7f4c5c066a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:15.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.254+0000 7f4c6406d700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c5c155f20 con 0x7f4c5c0c5ac0 2023-11-30T17:26:15.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.254+0000 7f4c6406d700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c5c153990 con 0x7f4c5c0c51a0 2023-11-30T17:26:15.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.254+0000 7f4c6406d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c156200 con 0x7f4c5c0c5ea0 2023-11-30T17:26:15.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.254+0000 7f4c61608700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4c5c0c51a0 0x7f4c5c153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:15.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.254+0000 7f4c61608700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4c5c0c51a0 0x7f4c5c153390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59796/0 (socket says 172.21.15.49:59796) 2023-11-30T17:26:15.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.254+0000 7f4c61608700 1 -- 172.21.15.49:0/3441067968 learned_addr learned my addr 172.21.15.49:0/3441067968 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:15.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.254+0000 7f4c6260a700 1 --2- 172.21.15.49:0/3441067968 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c5c0c5ea0 0x7f4c5c066a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:15.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.254+0000 7f4c61608700 1 -- 172.21.15.49:0/3441067968 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c5c0c5ea0 msgr2=0x7f4c5c066a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:15.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.254+0000 7f4c61608700 1 --2- 172.21.15.49:0/3441067968 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c5c0c5ea0 0x7f4c5c066a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:15.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.254+0000 7f4c60e07700 1 -- 172.21.15.49:0/3441067968 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 980016981 0 0) 0x7f4c5c155f20 con 0x7f4c5c0c5ac0 2023-11-30T17:26:15.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.254+0000 7f4c61608700 1 -- 172.21.15.49:0/3441067968 >> v1:172.21.15.115:6789/0 conn(0x7f4c5c0c5ac0 legacy=0x7f4c5c156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:15.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.254+0000 7f4c61608700 1 -- 172.21.15.49:0/3441067968 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c5c0bff70 con 0x7f4c5c0c51a0 2023-11-30T17:26:15.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.255+0000 7f4c61608700 1 --2- 172.21.15.49:0/3441067968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c5c0c51a0 0x7f4c5c153390 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7f4c50006fd0 tx=0x7f4c500090f0).ready entity=mon.0 client_cookie=f7283686858a6609 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:15.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.255+0000 7f4c60e07700 1 -- 172.21.15.49:0/3441067968 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5000b580 con 0x7f4c5c0c51a0 2023-11-30T17:26:15.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.255+0000 7f4c60e07700 1 -- 172.21.15.49:0/3441067968 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5000b6e0 con 0x7f4c5c0c51a0 2023-11-30T17:26:15.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.255+0000 7f4c60e07700 1 -- 172.21.15.49:0/3441067968 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5000ba80 con 0x7f4c5c0c51a0 2023-11-30T17:26:15.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.255+0000 7f4c6406d700 1 -- 172.21.15.49:0/3441067968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c5c0c51a0 msgr2=0x7f4c5c153390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:15.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.255+0000 7f4c6406d700 1 --2- 172.21.15.49:0/3441067968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c5c0c51a0 0x7f4c5c153390 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7f4c50006fd0 tx=0x7f4c500090f0).stop 2023-11-30T17:26:15.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.255+0000 7f4c6406d700 1 -- 172.21.15.49:0/3441067968 shutdown_connections 2023-11-30T17:26:15.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.255+0000 7f4c6406d700 1 --2- 172.21.15.49:0/3441067968 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c5c0c5ea0 0x7f4c5c066a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:15.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.255+0000 7f4c6406d700 1 --2- 172.21.15.49:0/3441067968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c5c0c51a0 0x7f4c5c153390 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:15.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.255+0000 7f4c6406d700 1 -- 172.21.15.49:0/3441067968 >> 172.21.15.49:0/3441067968 conn(0x7f4c5c062700 msgr2=0x7f4c5c062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:15.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.255+0000 7f4c6406d700 1 -- 172.21.15.49:0/3441067968 shutdown_connections 2023-11-30T17:26:15.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.256+0000 7f4c6406d700 1 -- 172.21.15.49:0/3441067968 wait complete. 2023-11-30T17:26:15.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.257+0000 7f4c6406d700 1 Processor -- start 2023-11-30T17:26:15.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.257+0000 7f4c6406d700 1 -- start start 2023-11-30T17:26:15.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.257+0000 7f4c6406d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c5c0c51a0 0x7f4c5c161ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:15.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.257+0000 7f4c6406d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c5c0c5ac0 0x7f4c5c0c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:15.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.257+0000 7f4c6406d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c5c0c5ea0 0x7f4c5c0c3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:15.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.257+0000 7f4c6406d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c0ad0c0 con 0x7f4c5c0c5ea0 2023-11-30T17:26:15.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.257+0000 7f4c6406d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c0adf20 con 0x7f4c5c0c51a0 2023-11-30T17:26:15.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.257+0000 7f4c6406d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c0c1c70 con 0x7f4c5c0c5ac0 2023-11-30T17:26:15.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.257+0000 7f4c6260a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c5c0c5ea0 0x7f4c5c0c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:15.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.257+0000 7f4c6260a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c5c0c5ea0 0x7f4c5c0c3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59816/0 (socket says 172.21.15.49:59816) 2023-11-30T17:26:15.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.257+0000 7f4c6260a700 1 -- 172.21.15.49:0/786861708 learned_addr learned my addr 172.21.15.49:0/786861708 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:15.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.258+0000 7f4c61608700 1 --2- 172.21.15.49:0/786861708 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c5c0c5ac0 0x7f4c5c0c1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:15.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.258+0000 7f4c61e09700 1 --2- 172.21.15.49:0/786861708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c5c0c51a0 0x7f4c5c161ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:15.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.258+0000 7f4c6260a700 1 -- 172.21.15.49:0/786861708 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c5c0c5ac0 msgr2=0x7f4c5c0c1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:15.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.258+0000 7f4c6260a700 1 --2- 172.21.15.49:0/786861708 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c5c0c5ac0 0x7f4c5c0c1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:15.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.258+0000 7f4c6260a700 1 -- 172.21.15.49:0/786861708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c5c0c51a0 msgr2=0x7f4c5c161ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:15.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.258+0000 7f4c6260a700 1 --2- 172.21.15.49:0/786861708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c5c0c51a0 0x7f4c5c161ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:15.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.258+0000 7f4c6260a700 1 -- 172.21.15.49:0/786861708 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c50009370 con 0x7f4c5c0c5ea0 2023-11-30T17:26:15.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.258+0000 7f4c6260a700 1 --2- 172.21.15.49:0/786861708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c5c0c5ea0 0x7f4c5c0c3880 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7f4c4c00e930 tx=0x7f4c4c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:15.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.258+0000 7f4c59ffb700 1 -- 172.21.15.49:0/786861708 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c012600 con 0x7f4c5c0c5ea0 2023-11-30T17:26:15.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.258+0000 7f4c59ffb700 1 -- 172.21.15.49:0/786861708 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4c012760 con 0x7f4c5c0c5ea0 2023-11-30T17:26:15.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.258+0000 7f4c6406d700 1 -- 172.21.15.49:0/786861708 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c5c0ad310 con 0x7f4c5c0c5ea0 2023-11-30T17:26:15.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.258+0000 7f4c59ffb700 1 -- 172.21.15.49:0/786861708 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c012ae0 con 0x7f4c5c0c5ea0 2023-11-30T17:26:15.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.258+0000 7f4c6406d700 1 -- 172.21.15.49:0/786861708 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c5c0ad8d0 con 0x7f4c5c0c5ea0 2023-11-30T17:26:15.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.259+0000 7f4c6406d700 1 -- 172.21.15.49:0/786861708 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c5c0c3420 con 0x7f4c5c0c5ea0 2023-11-30T17:26:15.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.260+0000 7f4c59ffb700 1 -- 172.21.15.49:0/786861708 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4c4c01b400 con 0x7f4c5c0c5ea0 2023-11-30T17:26:15.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.260+0000 7f4c59ffb700 1 --2- 172.21.15.49:0/786861708 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4c4805f270 0x7f4c48061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:15.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.260+0000 7f4c59ffb700 1 -- 172.21.15.49:0/786861708 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5927+0+0 (secure 0 0 0) 0x7f4c4c07a5b0 con 0x7f4c5c0c5ea0 2023-11-30T17:26:15.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.260+0000 7f4c61e09700 1 --2- 172.21.15.49:0/786861708 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4c4805f270 0x7f4c48061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:15.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.261+0000 7f4c61e09700 1 --2- 172.21.15.49:0/786861708 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4c4805f270 0x7f4c48061730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f4c54001560 tx=0x7f4c54007f90).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:15.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.264+0000 7f4c59ffb700 1 -- 172.21.15.49:0/786861708 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4c4c04b760 con 0x7f4c5c0c5ea0 2023-11-30T17:26:15.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:15.453+0000 7f4c6406d700 1 -- 172.21.15.49:0/786861708 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4c5c06c860 con 0x7f4c5c0c5ea0 2023-11-30T17:26:16.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.322+0000 7f4c59ffb700 1 -- 172.21.15.49:0/786861708 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v142) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4c4c04ed80 con 0x7f4c5c0c5ea0 2023-11-30T17:26:16.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.324+0000 7f4c6406d700 1 -- 172.21.15.49:0/786861708 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4c4805f270 msgr2=0x7f4c48061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:16.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.324+0000 7f4c6406d700 1 --2- 172.21.15.49:0/786861708 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4c4805f270 0x7f4c48061730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f4c54001560 tx=0x7f4c54007f90).stop 2023-11-30T17:26:16.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.325+0000 7f4c6406d700 1 -- 172.21.15.49:0/786861708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c5c0c5ea0 msgr2=0x7f4c5c0c3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:16.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.325+0000 7f4c6406d700 1 --2- 172.21.15.49:0/786861708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c5c0c5ea0 0x7f4c5c0c3880 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7f4c4c00e930 tx=0x7f4c4c009060).stop 2023-11-30T17:26:16.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.325+0000 7f4c6406d700 1 -- 172.21.15.49:0/786861708 shutdown_connections 2023-11-30T17:26:16.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.325+0000 7f4c6406d700 1 --2- 172.21.15.49:0/786861708 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4c4805f270 0x7f4c48061730 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:16.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.325+0000 7f4c6406d700 1 --2- 172.21.15.49:0/786861708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c5c0c5ea0 0x7f4c5c0c3880 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:16.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.325+0000 7f4c6406d700 1 --2- 172.21.15.49:0/786861708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c5c0c51a0 0x7f4c5c161ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:16.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.325+0000 7f4c6406d700 1 --2- 172.21.15.49:0/786861708 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c5c0c5ac0 0x7f4c5c0c1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:16.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.325+0000 7f4c6406d700 1 -- 172.21.15.49:0/786861708 >> 172.21.15.49:0/786861708 conn(0x7f4c5c062700 msgr2=0x7f4c5c0ab5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:16.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.325+0000 7f4c6406d700 1 -- 172.21.15.49:0/786861708 shutdown_connections 2023-11-30T17:26:16.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.325+0000 7f4c6406d700 1 -- 172.21.15.49:0/786861708 wait complete. 2023-11-30T17:26:16.328 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2023-11-30T17:26:16.342 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-30T17:26:16.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.462+0000 7f905d6b2700 1 Processor -- start 2023-11-30T17:26:16.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.462+0000 7f905d6b2700 1 -- start start 2023-11-30T17:26:16.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.463+0000 7f905d6b2700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9058063e50 0x7f9058069070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:16.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.463+0000 7f905d6b2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f90581514a0 0x7f9058069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:16.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.463+0000 7f905d6b2700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90580a9ea0 con 0x7f90581510c0 2023-11-30T17:26:16.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.463+0000 7f905d6b2700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9058069a50 con 0x7f90581514a0 2023-11-30T17:26:16.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.463+0000 7f905d6b2700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90580ac4d0 con 0x7f9058063e50 2023-11-30T17:26:16.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.463+0000 7f90577fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f90581514a0 0x7f9058069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:16.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.463+0000 7f90577fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f90581514a0 0x7f9058069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59820/0 (socket says 172.21.15.49:59820) 2023-11-30T17:26:16.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.463+0000 7f90577fe700 1 -- 172.21.15.49:0/536154378 learned_addr learned my addr 172.21.15.49:0/536154378 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:16.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.463+0000 7f90567fc700 1 --2- 172.21.15.49:0/536154378 >> v2:172.21.15.115:3300/0 conn(0x7f9058063e50 0x7f9058069070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:16.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.464+0000 7f90577fe700 1 -- 172.21.15.49:0/536154378 >> v2:172.21.15.115:3300/0 conn(0x7f9058063e50 msgr2=0x7f9058069070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:16.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.464+0000 7f90577fe700 1 --2- 172.21.15.49:0/536154378 >> v2:172.21.15.115:3300/0 conn(0x7f9058063e50 0x7f9058069070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:16.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.464+0000 7f90577fe700 1 -- 172.21.15.49:0/536154378 >> v1:172.21.15.115:6789/0 conn(0x7f90581510c0 legacy=0x7f90580a9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:16.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.464+0000 7f90577fe700 1 -- 172.21.15.49:0/536154378 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90580ad4a0 con 0x7f90581514a0 2023-11-30T17:26:16.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.464+0000 7f90577fe700 1 --2- 172.21.15.49:0/536154378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90581514a0 0x7f9058069560 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7f90580c87b0 tx=0x7f9048009840).ready entity=mon.0 client_cookie=c1d2c891e393c5dc server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:16.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.464+0000 7f9055ffb700 1 -- 172.21.15.49:0/536154378 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904800e070 con 0x7f90581514a0 2023-11-30T17:26:16.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.464+0000 7f9055ffb700 1 -- 172.21.15.49:0/536154378 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904800ba20 con 0x7f90581514a0 2023-11-30T17:26:16.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.464+0000 7f9055ffb700 1 -- 172.21.15.49:0/536154378 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904800bda0 con 0x7f90581514a0 2023-11-30T17:26:16.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.464+0000 7f905d6b2700 1 -- 172.21.15.49:0/536154378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90581514a0 msgr2=0x7f9058069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:16.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.464+0000 7f905d6b2700 1 --2- 172.21.15.49:0/536154378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90581514a0 0x7f9058069560 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7f90580c87b0 tx=0x7f9048009840).stop 2023-11-30T17:26:16.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.464+0000 7f905d6b2700 1 -- 172.21.15.49:0/536154378 shutdown_connections 2023-11-30T17:26:16.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.465+0000 7f905d6b2700 1 --2- 172.21.15.49:0/536154378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90581514a0 0x7f9058069560 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:16.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.465+0000 7f905d6b2700 1 --2- 172.21.15.49:0/536154378 >> v2:172.21.15.115:3300/0 conn(0x7f9058063e50 0x7f9058069070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:16.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.465+0000 7f905d6b2700 1 -- 172.21.15.49:0/536154378 >> 172.21.15.49:0/536154378 conn(0x7f90580c7760 msgr2=0x7f90580c7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:16.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.465+0000 7f905d6b2700 1 -- 172.21.15.49:0/536154378 shutdown_connections 2023-11-30T17:26:16.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.465+0000 7f905d6b2700 1 -- 172.21.15.49:0/536154378 wait complete. 2023-11-30T17:26:16.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.466+0000 7f905d6b2700 1 Processor -- start 2023-11-30T17:26:16.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.466+0000 7f905d6b2700 1 -- start start 2023-11-30T17:26:16.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.467+0000 7f905d6b2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9058063e50 0x7f9058164e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:16.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.467+0000 7f905d6b2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90581510c0 0x7f90580bd790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:16.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.467+0000 7f905d6b2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90581514a0 0x7f90580c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:16.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.467+0000 7f905d6b2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90580a8b80 con 0x7f90581514a0 2023-11-30T17:26:16.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.467+0000 7f905d6b2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90581649f0 con 0x7f9058063e50 2023-11-30T17:26:16.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.467+0000 7f905d6b2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90580a9390 con 0x7f90581510c0 2023-11-30T17:26:16.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.467+0000 7f90577fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90581514a0 0x7f90580c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:16.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.467+0000 7f90577fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90581514a0 0x7f90580c1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59832/0 (socket says 172.21.15.49:59832) 2023-11-30T17:26:16.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.467+0000 7f90577fe700 1 -- 172.21.15.49:0/1523647050 learned_addr learned my addr 172.21.15.49:0/1523647050 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:16.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.467+0000 7f9056ffd700 1 --2- 172.21.15.49:0/1523647050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9058063e50 0x7f9058164e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:16.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.467+0000 7f90567fc700 1 --2- 172.21.15.49:0/1523647050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90581510c0 0x7f90580bd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:16.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.467+0000 7f90577fe700 1 -- 172.21.15.49:0/1523647050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90581510c0 msgr2=0x7f90580bd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:16.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.467+0000 7f90577fe700 1 --2- 172.21.15.49:0/1523647050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90581510c0 0x7f90580bd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:16.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.467+0000 7f90577fe700 1 -- 172.21.15.49:0/1523647050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9058063e50 msgr2=0x7f9058164e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:16.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.467+0000 7f90577fe700 1 --2- 172.21.15.49:0/1523647050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9058063e50 0x7f9058164e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:16.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.467+0000 7f90577fe700 1 -- 172.21.15.49:0/1523647050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9048009ae0 con 0x7f90581514a0 2023-11-30T17:26:16.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.467+0000 7f9056ffd700 1 --2- 172.21.15.49:0/1523647050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9058063e50 0x7f9058164e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:26:16.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.467+0000 7f90577fe700 1 --2- 172.21.15.49:0/1523647050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90581514a0 0x7f90580c1dc0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7f904800bec0 tx=0x7f9048009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:16.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.467+0000 7f904effd700 1 -- 172.21.15.49:0/1523647050 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9048009500 con 0x7f90581514a0 2023-11-30T17:26:16.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.467+0000 7f904effd700 1 -- 172.21.15.49:0/1523647050 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90480092e0 con 0x7f90581514a0 2023-11-30T17:26:16.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.467+0000 7f905d6b2700 1 -- 172.21.15.49:0/1523647050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90580a8dd0 con 0x7f90581514a0 2023-11-30T17:26:16.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.467+0000 7f904effd700 1 -- 172.21.15.49:0/1523647050 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904801e6c0 con 0x7f90581514a0 2023-11-30T17:26:16.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.467+0000 7f905d6b2700 1 -- 172.21.15.49:0/1523647050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9058164680 con 0x7f90581514a0 2023-11-30T17:26:16.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.468+0000 7f905d6b2700 1 -- 172.21.15.49:0/1523647050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9058164b60 con 0x7f90581514a0 2023-11-30T17:26:16.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.469+0000 7f904effd700 1 -- 172.21.15.49:0/1523647050 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f9048003040 con 0x7f90581514a0 2023-11-30T17:26:16.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.469+0000 7f904effd700 1 --2- 172.21.15.49:0/1523647050 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f903805f270 0x7f9038061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:16.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.469+0000 7f904effd700 1 -- 172.21.15.49:0/1523647050 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5325+0+0 (secure 0 0 0) 0x7f904807b5f0 con 0x7f90581514a0 2023-11-30T17:26:16.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.469+0000 7f9056ffd700 1 --2- 172.21.15.49:0/1523647050 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f903805f270 0x7f9038061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:16.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.470+0000 7f9056ffd700 1 --2- 172.21.15.49:0/1523647050 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f903805f270 0x7f9038061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9050001c40 tx=0x7f9050009040).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:16.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.473+0000 7f904effd700 1 -- 172.21.15.49:0/1523647050 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f904804cb10 con 0x7f90581514a0 2023-11-30T17:26:16.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.712+0000 7f905d6b2700 1 -- 172.21.15.49:0/1523647050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f90580ac6e0 con 0x7f90581514a0 2023-11-30T17:26:16.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.713+0000 7f904effd700 1 -- 172.21.15.49:0/1523647050 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f9048023070 con 0x7f90581514a0 2023-11-30T17:26:16.718 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:26:16.718 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T17:26:16.718 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2023-11-30T17:26:16.718 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:26:16.718 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2023-11-30T17:26:16.718 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlwm1FHxAAk+s9c60UZ5jB37wbpGzlcg==", 2023-11-30T17:26:16.718 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:26:16.718 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:26:16.718 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:26:16.718 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:26:16.719 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:26:16.719 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:26:16.719 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:26:16.719 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:26:16.719 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2023-11-30T17:26:16.719 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlADm0KhAArffesGGTXzQwY4NPnJ1Bjw==", 2023-11-30T17:26:16.719 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:26:16.719 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:26:16.719 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:26:16.719 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:26:16.719 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:26:16.719 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:26:16.719 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:26:16.719 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:26:16.720 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2023-11-30T17:26:16.720 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlYnY1JhAA+Lurauug0NhWnK8aZErR3g==", 2023-11-30T17:26:16.720 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:26:16.720 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:26:16.720 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:26:16.720 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:26:16.720 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:26:16.720 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:26:16.720 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:26:16.720 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:26:16.720 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2023-11-30T17:26:16.720 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlQdKCMRAA3h4O2NqkQ2zE3DxOqBoaQQ==", 2023-11-30T17:26:16.720 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:26:16.720 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:26:16.720 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:26:16.721 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:26:16.721 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:26:16.721 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:26:16.721 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:26:16.721 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:26:16.721 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2023-11-30T17:26:16.721 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAPwWhlGdbhFxAAOspNRLMhR59LSWatFbsYDA==", 2023-11-30T17:26:16.721 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:26:16.721 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:26:16.721 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:26:16.721 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:26:16.721 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:26:16.721 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:26:16.721 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:26:16.722 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2023-11-30T17:26:16.722 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQASwWhlfwUEFxAAuj0L8ooIGi1vsb7XWLVlDA==", 2023-11-30T17:26:16.722 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:26:16.722 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:26:16.722 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:26:16.722 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:26:16.722 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:26:16.722 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:26:16.722 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:26:16.722 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2023-11-30T17:26:16.722 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAVwWhl7XYwFBAAuSHZqdfRR8V1Y+hmPT5uuw==", 2023-11-30T17:26:16.722 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:26:16.722 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:26:16.722 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:26:16.723 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:26:16.723 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:26:16.723 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:26:16.723 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:26:16.723 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2023-11-30T17:26:16.723 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAYwWhlkhRCFRAAe3cRLcrhJ3ZoluXuRUhmew==", 2023-11-30T17:26:16.723 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:26:16.723 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:26:16.723 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:26:16.723 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:26:16.723 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:26:16.723 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:26:16.723 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:26:16.723 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2023-11-30T17:26:16.723 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAewWhlrq4qFBAAOSdqozO8iH25BQFrPI1SRQ==", 2023-11-30T17:26:16.723 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:26:16.724 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:26:16.724 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:26:16.724 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:26:16.724 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:26:16.724 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:26:16.724 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:26:16.724 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2023-11-30T17:26:16.724 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAhwWhlZL9WERAA90znWBLNuY5eem3yF6O0wg==", 2023-11-30T17:26:16.724 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:26:16.724 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:26:16.724 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:26:16.724 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:26:16.724 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:26:16.724 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:26:16.724 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:26:16.725 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2023-11-30T17:26:16.725 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAkwWhlCJDiEBAAETLCBNCdaWXFgkPPaulTAA==", 2023-11-30T17:26:16.725 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:26:16.725 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:26:16.725 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:26:16.725 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:26:16.725 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:26:16.725 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:26:16.725 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:26:16.725 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2023-11-30T17:26:16.725 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAnwWhl+IiYEBAAcI3AU5xrv0cYy9lckyu0dQ==", 2023-11-30T17:26:16.725 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:26:16.725 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T17:26:16.725 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T17:26:16.725 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:26:16.726 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:26:16.726 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:26:16.726 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:26:16.726 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2023-11-30T17:26:16.726 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhleYZcNRAA5PoPChH+s6XfbrQ0hmu2NA==", 2023-11-30T17:26:16.726 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:26:16.726 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:26:16.726 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2023-11-30T17:26:16.726 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-30T17:26:16.726 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:26:16.726 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:26:16.726 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:26:16.726 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2023-11-30T17:26:16.726 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAOwWhlFhcfAhAAzaBDtyRxuqeQ9BatfgUuXw==", 2023-11-30T17:26:16.726 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:26:16.727 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:26:16.727 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T17:26:16.727 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T17:26:16.727 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T17:26:16.727 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:26:16.727 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:26:16.727 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:26:16.727 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2023-11-30T17:26:16.727 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlLZrDOhAAHG/dYWYmPouk3+Iqafr7qw==", 2023-11-30T17:26:16.727 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:26:16.727 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:26:16.727 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T17:26:16.727 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T17:26:16.727 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T17:26:16.727 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:26:16.728 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:26:16.728 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:26:16.728 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2023-11-30T17:26:16.728 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAOwWhl6lxuBxAA/YXQDo+U2ppULGzK054Gzg==", 2023-11-30T17:26:16.728 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:26:16.728 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T17:26:16.728 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T17:26:16.728 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T17:26:16.728 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T17:26:16.728 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:26:16.728 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:26:16.728 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:26:16.728 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2023-11-30T17:26:16.728 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhl4JkLAxAAiaLgZ5eiazaT9VanG5ihyQ==", 2023-11-30T17:26:16.728 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:26:16.729 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T17:26:16.729 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T17:26:16.729 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T17:26:16.729 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:26:16.729 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:26:16.729 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:26:16.729 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:26:16.729 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2023-11-30T17:26:16.729 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlH1s2HBAA3ea9Utfv7fZoo2hO+ElDVQ==", 2023-11-30T17:26:16.729 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:26:16.729 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T17:26:16.729 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-11-30T17:26:16.729 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:26:16.729 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:26:16.729 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:26:16.729 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:26:16.730 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2023-11-30T17:26:16.730 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlpy+fFxAA3qmboR+PlQtK6T35ryj+Lw==", 2023-11-30T17:26:16.730 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T17:26:16.730 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T17:26:16.730 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-11-30T17:26:16.730 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T17:26:16.730 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:26:16.730 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:26:16.730 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-11-30T17:26:16.730 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T17:26:16.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.715+0000 7f905d6b2700 1 -- 172.21.15.49:0/1523647050 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f903805f270 msgr2=0x7f9038061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:16.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.715+0000 7f905d6b2700 1 --2- 172.21.15.49:0/1523647050 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f903805f270 0x7f9038061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9050001c40 tx=0x7f9050009040).stop 2023-11-30T17:26:16.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.715+0000 7f905d6b2700 1 -- 172.21.15.49:0/1523647050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90581514a0 msgr2=0x7f90580c1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:16.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.715+0000 7f905d6b2700 1 --2- 172.21.15.49:0/1523647050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90581514a0 0x7f90580c1dc0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7f904800bec0 tx=0x7f9048009840).stop 2023-11-30T17:26:16.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.715+0000 7f905d6b2700 1 -- 172.21.15.49:0/1523647050 shutdown_connections 2023-11-30T17:26:16.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.715+0000 7f905d6b2700 1 --2- 172.21.15.49:0/1523647050 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f903805f270 0x7f9038061730 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:16.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.715+0000 7f905d6b2700 1 --2- 172.21.15.49:0/1523647050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90581514a0 0x7f90580c1dc0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:16.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.715+0000 7f905d6b2700 1 --2- 172.21.15.49:0/1523647050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9058063e50 0x7f9058164e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:16.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.715+0000 7f905d6b2700 1 --2- 172.21.15.49:0/1523647050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90581510c0 0x7f90580bd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:16.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.715+0000 7f905d6b2700 1 -- 172.21.15.49:0/1523647050 >> 172.21.15.49:0/1523647050 conn(0x7f90580c7760 msgr2=0x7f90580c6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:16.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.715+0000 7f905d6b2700 1 -- 172.21.15.49:0/1523647050 shutdown_connections 2023-11-30T17:26:16.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.715+0000 7f905d6b2700 1 -- 172.21.15.49:0/1523647050 wait complete. 2023-11-30T17:26:16.733 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:26:16.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.848+0000 7f12ee8b5700 1 Processor -- start 2023-11-30T17:26:16.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.848+0000 7f12ee8b5700 1 -- start start 2023-11-30T17:26:16.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.849+0000 7f12ee8b5700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f12e8157660 0x7f12e8157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:16.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.849+0000 7f12ee8b5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12e80c0180 0x7f12e81589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:16.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.849+0000 7f12ee8b5700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12e80c12c0 con 0x7f12e80c1750 2023-11-30T17:26:16.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.849+0000 7f12ee8b5700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e80c06b0 con 0x7f12e8157660 2023-11-30T17:26:16.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.849+0000 7f12ee8b5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e80c0990 con 0x7f12e80c0180 2023-11-30T17:26:16.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.850+0000 7f12ed8b3700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f12e8157660 0x7f12e8157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:16.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.850+0000 7f12ed0b2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12e80c0180 0x7f12e81589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:16.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.850+0000 7f12ee0b4700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f12e80c1750 0x7f12e80648d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:33972/0 (socket says 172.21.15.49:33972) 2023-11-30T17:26:16.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.850+0000 7f12ee0b4700 1 -- 172.21.15.49:0/1526775147 learned_addr learned my addr 172.21.15.49:0/1526775147 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:16.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.850+0000 7f12ed8b3700 1 -- 172.21.15.49:0/1526775147 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12e80c0180 msgr2=0x7f12e81589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:16.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.850+0000 7f12ed8b3700 1 --2- 172.21.15.49:0/1526775147 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12e80c0180 0x7f12e81589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:16.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.850+0000 7f12ed8b3700 1 -- 172.21.15.49:0/1526775147 >> v1:172.21.15.115:6789/0 conn(0x7f12e80c1750 legacy=0x7f12e80648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:16.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.850+0000 7f12ec8b1700 1 -- 172.21.15.49:0/1526775147 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2673354570 0 0) 0x7f12e80c12c0 con 0x7f12e80c1750 2023-11-30T17:26:16.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.850+0000 7f12ed8b3700 1 -- 172.21.15.49:0/1526775147 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e80c0c70 con 0x7f12e8157660 2023-11-30T17:26:16.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.850+0000 7f12ed8b3700 1 --2- 172.21.15.49:0/1526775147 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12e8157660 0x7f12e8157a40 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f12e0009760 tx=0x7f12e0009060).ready entity=mon.1 client_cookie=55095727dc4e0763 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:16.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.850+0000 7f12ec8b1700 1 -- 172.21.15.49:0/1526775147 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e000f510 con 0x7f12e8157660 2023-11-30T17:26:16.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.850+0000 7f12ec8b1700 1 -- 172.21.15.49:0/1526775147 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e000f670 con 0x7f12e8157660 2023-11-30T17:26:16.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.850+0000 7f12ec8b1700 1 -- 172.21.15.49:0/1526775147 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e000f9f0 con 0x7f12e8157660 2023-11-30T17:26:16.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.851+0000 7f12ee8b5700 1 -- 172.21.15.49:0/1526775147 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12e8157660 msgr2=0x7f12e8157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:16.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.851+0000 7f12ee8b5700 1 --2- 172.21.15.49:0/1526775147 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12e8157660 0x7f12e8157a40 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f12e0009760 tx=0x7f12e0009060).stop 2023-11-30T17:26:16.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.851+0000 7f12ee8b5700 1 -- 172.21.15.49:0/1526775147 shutdown_connections 2023-11-30T17:26:16.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.851+0000 7f12ee8b5700 1 --2- 172.21.15.49:0/1526775147 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12e8157660 0x7f12e8157a40 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:16.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.851+0000 7f12ee8b5700 1 --2- 172.21.15.49:0/1526775147 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12e80c0180 0x7f12e81589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:16.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.851+0000 7f12ee8b5700 1 -- 172.21.15.49:0/1526775147 >> 172.21.15.49:0/1526775147 conn(0x7f12e80cb000 msgr2=0x7f12e80cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:16.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.851+0000 7f12ee8b5700 1 -- 172.21.15.49:0/1526775147 shutdown_connections 2023-11-30T17:26:16.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.851+0000 7f12ee8b5700 1 -- 172.21.15.49:0/1526775147 wait complete. 2023-11-30T17:26:16.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.852+0000 7f12ee8b5700 1 Processor -- start 2023-11-30T17:26:16.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.852+0000 7f12ee8b5700 1 -- start start 2023-11-30T17:26:16.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.853+0000 7f12ee8b5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12e80c0180 0x7f12e8164af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:16.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.853+0000 7f12ee8b5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12e80c1750 0x7f12e8167770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:16.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.853+0000 7f12ee8b5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12e8157660 0x7f12e80ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:16.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.853+0000 7f12ee8b5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e8152700 con 0x7f12e8157660 2023-11-30T17:26:16.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.853+0000 7f12ee8b5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e8164fe0 con 0x7f12e80c1750 2023-11-30T17:26:16.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.853+0000 7f12ee8b5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e80c2400 con 0x7f12e80c0180 2023-11-30T17:26:16.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.853+0000 7f12ee0b4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12e8157660 0x7f12e80ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:16.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.853+0000 7f12ee0b4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12e8157660 0x7f12e80ca020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59836/0 (socket says 172.21.15.49:59836) 2023-11-30T17:26:16.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.853+0000 7f12ee0b4700 1 -- 172.21.15.49:0/2866186908 learned_addr learned my addr 172.21.15.49:0/2866186908 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:16.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.853+0000 7f12ed0b2700 1 --2- 172.21.15.49:0/2866186908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12e80c1750 0x7f12e8167770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:16.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.853+0000 7f12ed8b3700 1 --2- 172.21.15.49:0/2866186908 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12e80c0180 0x7f12e8164af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:16.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.854+0000 7f12ee0b4700 1 -- 172.21.15.49:0/2866186908 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12e80c0180 msgr2=0x7f12e8164af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:16.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.854+0000 7f12ee0b4700 1 --2- 172.21.15.49:0/2866186908 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12e80c0180 0x7f12e8164af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:16.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.854+0000 7f12ee0b4700 1 -- 172.21.15.49:0/2866186908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12e80c1750 msgr2=0x7f12e8167770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:16.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.854+0000 7f12ee0b4700 1 --2- 172.21.15.49:0/2866186908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12e80c1750 0x7f12e8167770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:16.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.854+0000 7f12ee0b4700 1 -- 172.21.15.49:0/2866186908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e00092a0 con 0x7f12e8157660 2023-11-30T17:26:16.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.854+0000 7f12ee0b4700 1 --2- 172.21.15.49:0/2866186908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12e8157660 0x7f12e80ca020 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7f12d800c7e0 tx=0x7f12d8007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:16.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.854+0000 7f12e5ffb700 1 -- 172.21.15.49:0/2866186908 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d8005d30 con 0x7f12e8157660 2023-11-30T17:26:16.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.854+0000 7f12e5ffb700 1 -- 172.21.15.49:0/2866186908 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d8005e90 con 0x7f12e8157660 2023-11-30T17:26:16.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.854+0000 7f12e5ffb700 1 -- 172.21.15.49:0/2866186908 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d8007320 con 0x7f12e8157660 2023-11-30T17:26:16.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.854+0000 7f12ee8b5700 1 -- 172.21.15.49:0/2866186908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e8156820 con 0x7f12e8157660 2023-11-30T17:26:16.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.854+0000 7f12ee8b5700 1 -- 172.21.15.49:0/2866186908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e80c2090 con 0x7f12e8157660 2023-11-30T17:26:16.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.855+0000 7f12ee8b5700 1 -- 172.21.15.49:0/2866186908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e806c7c0 con 0x7f12e8157660 2023-11-30T17:26:16.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.855+0000 7f12e5ffb700 1 -- 172.21.15.49:0/2866186908 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f12d8007710 con 0x7f12e8157660 2023-11-30T17:26:16.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.856+0000 7f12e5ffb700 1 --2- 172.21.15.49:0/2866186908 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f12d405f270 0x7f12d4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:16.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.856+0000 7f12e5ffb700 1 -- 172.21.15.49:0/2866186908 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5325+0+0 (secure 0 0 0) 0x7f12d807a180 con 0x7f12e8157660 2023-11-30T17:26:16.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.856+0000 7f12ed8b3700 1 --2- 172.21.15.49:0/2866186908 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f12d405f270 0x7f12d4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:16.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.856+0000 7f12ed8b3700 1 --2- 172.21.15.49:0/2866186908 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f12d405f270 0x7f12d4061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f12e0009fd0 tx=0x7f12e0017000).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:16.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:16.860+0000 7f12e5ffb700 1 -- 172.21.15.49:0/2866186908 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f12d804b5f0 con 0x7f12e8157660 2023-11-30T17:26:17.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.031+0000 7f12ee8b5700 1 -- 172.21.15.49:0/2866186908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12e80c0f50 con 0x7f12e8157660 2023-11-30T17:26:17.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.032+0000 7f12e5ffb700 1 -- 172.21.15.49:0/2866186908 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+13811 (secure 0 0 0) 0x7f12d804ec10 con 0x7f12e8157660 2023-11-30T17:26:17.036 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:26:17.036 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":142,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:26:16.317437+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:26:17.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.034+0000 7f12ee8b5700 1 -- 172.21.15.49:0/2866186908 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f12d405f270 msgr2=0x7f12d4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:17.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.034+0000 7f12ee8b5700 1 --2- 172.21.15.49:0/2866186908 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f12d405f270 0x7f12d4061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f12e0009fd0 tx=0x7f12e0017000).stop 2023-11-30T17:26:17.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.034+0000 7f12ee8b5700 1 -- 172.21.15.49:0/2866186908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12e8157660 msgr2=0x7f12e80ca020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:17.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.034+0000 7f12ee8b5700 1 --2- 172.21.15.49:0/2866186908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12e8157660 0x7f12e80ca020 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7f12d800c7e0 tx=0x7f12d8007f90).stop 2023-11-30T17:26:17.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.034+0000 7f12ee8b5700 1 -- 172.21.15.49:0/2866186908 shutdown_connections 2023-11-30T17:26:17.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.034+0000 7f12ee8b5700 1 --2- 172.21.15.49:0/2866186908 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f12d405f270 0x7f12d4061730 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:17.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.034+0000 7f12ee8b5700 1 --2- 172.21.15.49:0/2866186908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12e8157660 0x7f12e80ca020 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:17.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.034+0000 7f12ee8b5700 1 --2- 172.21.15.49:0/2866186908 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12e80c0180 0x7f12e8164af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:17.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.034+0000 7f12ee8b5700 1 --2- 172.21.15.49:0/2866186908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12e80c1750 0x7f12e8167770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:17.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.034+0000 7f12ee8b5700 1 -- 172.21.15.49:0/2866186908 >> 172.21.15.49:0/2866186908 conn(0x7f12e80cb000 msgr2=0x7f12e80abad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:17.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.034+0000 7f12ee8b5700 1 -- 172.21.15.49:0/2866186908 shutdown_connections 2023-11-30T17:26:17.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.034+0000 7f12ee8b5700 1 -- 172.21.15.49:0/2866186908 wait complete. 2023-11-30T17:26:17.050 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '135', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-11-30T17:26:17.050 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T17:26:17.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.169+0000 7f85d4f78700 1 Processor -- start 2023-11-30T17:26:17.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.169+0000 7f85d4f78700 1 -- start start 2023-11-30T17:26:17.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.170+0000 7f85d4f78700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f85d0158a30 0x7f85d00c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:17.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.170+0000 7f85d4f78700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d00c72d0 con 0x7f85d0098d10 2023-11-30T17:26:17.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.170+0000 7f85d4f78700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d0064570 con 0x7f85d00c6190 2023-11-30T17:26:17.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.170+0000 7f85d4f78700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85d0154bc0 con 0x7f85d0158a30 2023-11-30T17:26:17.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.171+0000 7f85ce59c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f85d0098d10 0x7f85d0063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48326/0 (socket says 172.21.15.49:48326) 2023-11-30T17:26:17.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.171+0000 7f85ce59c700 1 -- 172.21.15.49:0/2794847425 learned_addr learned my addr 172.21.15.49:0/2794847425 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:17.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.171+0000 7f85ced9d700 1 --2- 172.21.15.49:0/2794847425 >> v2:172.21.15.49:3300/0 conn(0x7f85d0158a30 0x7f85d00c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:17.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.171+0000 7f85ced9d700 1 -- 172.21.15.49:0/2794847425 >> v1:172.21.15.115:6789/0 conn(0x7f85d00c6190 legacy=0x7f85d0158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:17.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.171+0000 7f85ced9d700 1 -- 172.21.15.49:0/2794847425 >> v1:172.21.15.49:6789/0 conn(0x7f85d0098d10 legacy=0x7f85d0063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:17.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.171+0000 7f85ced9d700 1 -- 172.21.15.49:0/2794847425 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d00c66c0 con 0x7f85d0158a30 2023-11-30T17:26:17.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.171+0000 7f85ced9d700 1 --2- 172.21.15.49:0/2794847425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85d0158a30 0x7f85d00c7760 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7f85c8009e60 tx=0x7f85c8009780).ready entity=mon.0 client_cookie=13f0231925604654 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:17.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.171+0000 7f85cd59a700 1 -- 172.21.15.49:0/2794847425 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c800e070 con 0x7f85d0158a30 2023-11-30T17:26:17.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.171+0000 7f85cd59a700 1 -- 172.21.15.49:0/2794847425 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c800bbf0 con 0x7f85d0158a30 2023-11-30T17:26:17.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.171+0000 7f85cd59a700 1 -- 172.21.15.49:0/2794847425 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c8012410 con 0x7f85d0158a30 2023-11-30T17:26:17.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.172+0000 7f85d4f78700 1 -- 172.21.15.49:0/2794847425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85d0158a30 msgr2=0x7f85d00c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:17.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.172+0000 7f85d4f78700 1 --2- 172.21.15.49:0/2794847425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85d0158a30 0x7f85d00c7760 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7f85c8009e60 tx=0x7f85c8009780).stop 2023-11-30T17:26:17.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.172+0000 7f85d4f78700 1 -- 172.21.15.49:0/2794847425 shutdown_connections 2023-11-30T17:26:17.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.172+0000 7f85d4f78700 1 --2- 172.21.15.49:0/2794847425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85d0158a30 0x7f85d00c7760 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:17.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.172+0000 7f85d4f78700 1 -- 172.21.15.49:0/2794847425 >> 172.21.15.49:0/2794847425 conn(0x7f85d00cb310 msgr2=0x7f85d00cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:17.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.172+0000 7f85d4f78700 1 -- 172.21.15.49:0/2794847425 shutdown_connections 2023-11-30T17:26:17.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.172+0000 7f85d4f78700 1 -- 172.21.15.49:0/2794847425 wait complete. 2023-11-30T17:26:17.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.173+0000 7f85d4f78700 1 Processor -- start 2023-11-30T17:26:17.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.173+0000 7f85d4f78700 1 -- start start 2023-11-30T17:26:17.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.174+0000 7f85d4f78700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85d0098d10 0x7f85d01653d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:17.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.174+0000 7f85d4f78700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85d00c6190 0x7f85d0164180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:17.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.174+0000 7f85d4f78700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85d0158a30 0x7f85d0156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:17.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.174+0000 7f85d4f78700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00ae530 con 0x7f85d0098d10 2023-11-30T17:26:17.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.174+0000 7f85d4f78700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d01658c0 con 0x7f85d0158a30 2023-11-30T17:26:17.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.174+0000 7f85d4f78700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00b0c40 con 0x7f85d00c6190 2023-11-30T17:26:17.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.174+0000 7f85ce59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85d0098d10 0x7f85d01653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:17.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.174+0000 7f85ce59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85d0098d10 0x7f85d01653d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59860/0 (socket says 172.21.15.49:59860) 2023-11-30T17:26:17.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.174+0000 7f85ce59c700 1 -- 172.21.15.49:0/1115514741 learned_addr learned my addr 172.21.15.49:0/1115514741 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:17.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.174+0000 7f85cdd9b700 1 --2- 172.21.15.49:0/1115514741 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85d00c6190 0x7f85d0164180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:17.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.174+0000 7f85ced9d700 1 --2- 172.21.15.49:0/1115514741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85d0158a30 0x7f85d0156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:17.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.174+0000 7f85ce59c700 1 -- 172.21.15.49:0/1115514741 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85d00c6190 msgr2=0x7f85d0164180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:17.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.174+0000 7f85ce59c700 1 --2- 172.21.15.49:0/1115514741 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85d00c6190 0x7f85d0164180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:17.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.174+0000 7f85ce59c700 1 -- 172.21.15.49:0/1115514741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85d0158a30 msgr2=0x7f85d0156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:17.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.174+0000 7f85ce59c700 1 --2- 172.21.15.49:0/1115514741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85d0158a30 0x7f85d0156610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:17.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.174+0000 7f85ce59c700 1 -- 172.21.15.49:0/1115514741 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c8009a20 con 0x7f85d0098d10 2023-11-30T17:26:17.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.174+0000 7f85ced9d700 1 --2- 172.21.15.49:0/1115514741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85d0158a30 0x7f85d0156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:26:17.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.174+0000 7f85ce59c700 1 --2- 172.21.15.49:0/1115514741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85d0098d10 0x7f85d01653d0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7f85c000c4c0 tx=0x7f85c0007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:17.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.174+0000 7f85be7fc700 1 -- 172.21.15.49:0/1115514741 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c00072e0 con 0x7f85d0098d10 2023-11-30T17:26:17.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.174+0000 7f85be7fc700 1 -- 172.21.15.49:0/1115514741 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c0007440 con 0x7f85d0098d10 2023-11-30T17:26:17.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.175+0000 7f85d4f78700 1 -- 172.21.15.49:0/1115514741 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d00b0f20 con 0x7f85d0098d10 2023-11-30T17:26:17.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.175+0000 7f85be7fc700 1 -- 172.21.15.49:0/1115514741 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c00057a0 con 0x7f85d0098d10 2023-11-30T17:26:17.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.175+0000 7f85d4f78700 1 -- 172.21.15.49:0/1115514741 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d0155e10 con 0x7f85d0098d10 2023-11-30T17:26:17.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.175+0000 7f85d4f78700 1 -- 172.21.15.49:0/1115514741 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d006c860 con 0x7f85d0098d10 2023-11-30T17:26:17.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.176+0000 7f85be7fc700 1 -- 172.21.15.49:0/1115514741 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f85c0005b90 con 0x7f85d0098d10 2023-11-30T17:26:17.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.176+0000 7f85be7fc700 1 --2- 172.21.15.49:0/1115514741 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f85b005f270 0x7f85b0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:17.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.176+0000 7f85be7fc700 1 -- 172.21.15.49:0/1115514741 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5325+0+0 (secure 0 0 0) 0x7f85c0079690 con 0x7f85d0098d10 2023-11-30T17:26:17.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.176+0000 7f85cdd9b700 1 --2- 172.21.15.49:0/1115514741 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f85b005f270 0x7f85b0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:17.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.177+0000 7f85cdd9b700 1 --2- 172.21.15.49:0/1115514741 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f85b005f270 0x7f85b0061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f85d01578b0 tx=0x7f85c4007d20).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:17.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.180+0000 7f85be7fc700 1 -- 172.21.15.49:0/1115514741 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f85c004ab00 con 0x7f85d0098d10 2023-11-30T17:26:17.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.356+0000 7f85d4f78700 1 -- 172.21.15.49:0/1115514741 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f85d00c69a0 con 0x7f85d0098d10 2023-11-30T17:26:17.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.357+0000 7f85be7fc700 1 -- 172.21.15.49:0/1115514741 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v142) v1 ==== 110+0+10 (secure 0 0 0) 0x7f85c0018020 con 0x7f85d0098d10 2023-11-30T17:26:17.359 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T17:26:17.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.358+0000 7f85d4f78700 1 -- 172.21.15.49:0/1115514741 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f85b005f270 msgr2=0x7f85b0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:17.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.359+0000 7f85d4f78700 1 --2- 172.21.15.49:0/1115514741 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f85b005f270 0x7f85b0061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f85d01578b0 tx=0x7f85c4007d20).stop 2023-11-30T17:26:17.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.359+0000 7f85d4f78700 1 -- 172.21.15.49:0/1115514741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85d0098d10 msgr2=0x7f85d01653d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:17.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.359+0000 7f85d4f78700 1 --2- 172.21.15.49:0/1115514741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85d0098d10 0x7f85d01653d0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7f85c000c4c0 tx=0x7f85c0007db0).stop 2023-11-30T17:26:17.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.359+0000 7f85d4f78700 1 -- 172.21.15.49:0/1115514741 shutdown_connections 2023-11-30T17:26:17.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.359+0000 7f85d4f78700 1 --2- 172.21.15.49:0/1115514741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85d0158a30 0x7f85d0156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:17.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.359+0000 7f85d4f78700 1 --2- 172.21.15.49:0/1115514741 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f85b005f270 0x7f85b0061730 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:17.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.359+0000 7f85d4f78700 1 --2- 172.21.15.49:0/1115514741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85d0098d10 0x7f85d01653d0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:17.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.359+0000 7f85d4f78700 1 --2- 172.21.15.49:0/1115514741 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85d00c6190 0x7f85d0164180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:17.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.359+0000 7f85d4f78700 1 -- 172.21.15.49:0/1115514741 >> 172.21.15.49:0/1115514741 conn(0x7f85d00cb310 msgr2=0x7f85d00ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:17.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.359+0000 7f85d4f78700 1 -- 172.21.15.49:0/1115514741 shutdown_connections 2023-11-30T17:26:17.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.359+0000 7f85d4f78700 1 -- 172.21.15.49:0/1115514741 wait complete. 2023-11-30T17:26:17.373 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T17:26:17.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.491+0000 7f628b59e700 1 Processor -- start 2023-11-30T17:26:17.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.492+0000 7f628b59e700 1 -- start start 2023-11-30T17:26:17.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.492+0000 7f628b59e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f628c1544b0 0x7f628c0630d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:17.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.492+0000 7f628b59e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f628c069640 0x7f628c0c23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:17.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.492+0000 7f628b59e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f628c06a7c0 con 0x7f628c0c28d0 2023-11-30T17:26:17.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.492+0000 7f628b59e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f628c0635c0 con 0x7f628c069640 2023-11-30T17:26:17.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.492+0000 7f628b59e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f628c0ada70 con 0x7f628c1544b0 2023-11-30T17:26:17.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.493+0000 7f6289d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f628c069640 0x7f628c0c23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:17.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.493+0000 7f628ad9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f628c0c28d0 0x7f628c0c4320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48336/0 (socket says 172.21.15.49:48336) 2023-11-30T17:26:17.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.493+0000 7f628ad9d700 1 -- 172.21.15.49:0/2318376820 learned_addr learned my addr 172.21.15.49:0/2318376820 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:17.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.493+0000 7f6289d9b700 1 --2- 172.21.15.49:0/2318376820 >> v2:172.21.15.49:3300/0 conn(0x7f628c069640 0x7f628c0c23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59874/0 (socket says 172.21.15.49:59874) 2023-11-30T17:26:17.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.493+0000 7f628a59c700 1 --2- 172.21.15.49:0/2318376820 >> v2:172.21.15.115:3300/0 conn(0x7f628c1544b0 0x7f628c0630d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:17.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.493+0000 7f6289d9b700 1 -- 172.21.15.49:0/2318376820 >> v2:172.21.15.115:3300/0 conn(0x7f628c1544b0 msgr2=0x7f628c0630d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:17.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.493+0000 7f6289d9b700 1 --2- 172.21.15.49:0/2318376820 >> v2:172.21.15.115:3300/0 conn(0x7f628c1544b0 0x7f628c0630d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:17.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.493+0000 7f6289d9b700 1 -- 172.21.15.49:0/2318376820 >> v1:172.21.15.49:6789/0 conn(0x7f628c0c28d0 legacy=0x7f628c0c4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:17.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.493+0000 7f628959a700 1 -- 172.21.15.49:0/2318376820 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1806574140 0 0) 0x7f628c06a7c0 con 0x7f628c0c28d0 2023-11-30T17:26:17.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.493+0000 7f6289d9b700 1 -- 172.21.15.49:0/2318376820 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f628c069bb0 con 0x7f628c069640 2023-11-30T17:26:17.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.493+0000 7f6289d9b700 1 --2- 172.21.15.49:0/2318376820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f628c069640 0x7f628c0c23e0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7f628c0c58f0 tx=0x7f6274009060).ready entity=mon.0 client_cookie=3cd3b908ece3d94b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:17.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.493+0000 7f628959a700 1 -- 172.21.15.49:0/2318376820 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627400b580 con 0x7f628c069640 2023-11-30T17:26:17.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.493+0000 7f628959a700 1 -- 172.21.15.49:0/2318376820 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627400b6e0 con 0x7f628c069640 2023-11-30T17:26:17.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.493+0000 7f628959a700 1 -- 172.21.15.49:0/2318376820 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627400ba60 con 0x7f628c069640 2023-11-30T17:26:17.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.494+0000 7f628b59e700 1 -- 172.21.15.49:0/2318376820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f628c069640 msgr2=0x7f628c0c23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:17.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.494+0000 7f628b59e700 1 --2- 172.21.15.49:0/2318376820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f628c069640 0x7f628c0c23e0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7f628c0c58f0 tx=0x7f6274009060).stop 2023-11-30T17:26:17.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.494+0000 7f628b59e700 1 -- 172.21.15.49:0/2318376820 shutdown_connections 2023-11-30T17:26:17.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.494+0000 7f628b59e700 1 --2- 172.21.15.49:0/2318376820 >> v2:172.21.15.115:3300/0 conn(0x7f628c1544b0 0x7f628c0630d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:17.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.494+0000 7f628b59e700 1 --2- 172.21.15.49:0/2318376820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f628c069640 0x7f628c0c23e0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:17.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.494+0000 7f628b59e700 1 -- 172.21.15.49:0/2318376820 >> 172.21.15.49:0/2318376820 conn(0x7f628c063810 msgr2=0x7f628c063c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:17.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.494+0000 7f628b59e700 1 -- 172.21.15.49:0/2318376820 shutdown_connections 2023-11-30T17:26:17.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.494+0000 7f628b59e700 1 -- 172.21.15.49:0/2318376820 wait complete. 2023-11-30T17:26:17.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.495+0000 7f628b59e700 1 Processor -- start 2023-11-30T17:26:17.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.495+0000 7f628b59e700 1 -- start start 2023-11-30T17:26:17.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.496+0000 7f628b59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f628c069640 0x7f628c164540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:17.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.496+0000 7f628b59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f628c0c28d0 0x7f628c155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:17.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.496+0000 7f628b59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f628c1544b0 0x7f628c155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:17.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.496+0000 7f628b59e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628c164bb0 con 0x7f628c069640 2023-11-30T17:26:17.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.496+0000 7f628b59e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628c164e90 con 0x7f628c0c28d0 2023-11-30T17:26:17.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.496+0000 7f628b59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f628c165170 con 0x7f628c1544b0 2023-11-30T17:26:17.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.496+0000 7f628a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f628c069640 0x7f628c164540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:17.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.496+0000 7f628a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f628c069640 0x7f628c164540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59884/0 (socket says 172.21.15.49:59884) 2023-11-30T17:26:17.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.496+0000 7f628a59c700 1 -- 172.21.15.49:0/1020498163 learned_addr learned my addr 172.21.15.49:0/1020498163 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:17.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.496+0000 7f6289d9b700 1 --2- 172.21.15.49:0/1020498163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f628c0c28d0 0x7f628c155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:17.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.496+0000 7f628a59c700 1 -- 172.21.15.49:0/1020498163 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f628c1544b0 msgr2=0x7f628c155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:17.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.496+0000 7f628a59c700 1 --2- 172.21.15.49:0/1020498163 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f628c1544b0 0x7f628c155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:17.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.496+0000 7f628a59c700 1 -- 172.21.15.49:0/1020498163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f628c0c28d0 msgr2=0x7f628c155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:17.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.496+0000 7f628a59c700 1 --2- 172.21.15.49:0/1020498163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f628c0c28d0 0x7f628c155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:17.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.496+0000 7f628a59c700 1 -- 172.21.15.49:0/1020498163 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62740092a0 con 0x7f628c069640 2023-11-30T17:26:17.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.496+0000 7f6289d9b700 1 --2- 172.21.15.49:0/1020498163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f628c0c28d0 0x7f628c155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:26:17.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.496+0000 7f628a59c700 1 --2- 172.21.15.49:0/1020498163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f628c069640 0x7f628c164540 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7f628400c650 tx=0x7f6284008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:17.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.496+0000 7f62827fc700 1 -- 172.21.15.49:0/1020498163 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6284010580 con 0x7f628c069640 2023-11-30T17:26:17.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.497+0000 7f62827fc700 1 -- 172.21.15.49:0/1020498163 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62840106e0 con 0x7f628c069640 2023-11-30T17:26:17.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.497+0000 7f62827fc700 1 -- 172.21.15.49:0/1020498163 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6284010a60 con 0x7f628c069640 2023-11-30T17:26:17.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.497+0000 7f628b59e700 1 -- 172.21.15.49:0/1020498163 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f628c167bf0 con 0x7f628c069640 2023-11-30T17:26:17.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.497+0000 7f628b59e700 1 -- 172.21.15.49:0/1020498163 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f628c0bf640 con 0x7f628c069640 2023-11-30T17:26:17.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.497+0000 7f628b59e700 1 -- 172.21.15.49:0/1020498163 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f628c167e30 con 0x7f628c069640 2023-11-30T17:26:17.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.498+0000 7f62827fc700 1 -- 172.21.15.49:0/1020498163 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f628401b460 con 0x7f628c069640 2023-11-30T17:26:17.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.498+0000 7f62827fc700 1 --2- 172.21.15.49:0/1020498163 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f626c05f270 0x7f626c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:17.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.498+0000 7f62827fc700 1 -- 172.21.15.49:0/1020498163 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5325+0+0 (secure 0 0 0) 0x7f6284079fe0 con 0x7f628c069640 2023-11-30T17:26:17.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.498+0000 7f6289d9b700 1 --2- 172.21.15.49:0/1020498163 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f626c05f270 0x7f626c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:17.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.499+0000 7f6289d9b700 1 --2- 172.21.15.49:0/1020498163 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f626c05f270 0x7f626c061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f628c0c2fd0 tx=0x7f6274017000).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:17.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.503+0000 7f62827fc700 1 -- 172.21.15.49:0/1020498163 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f628c167e30 con 0x7f628c069640 2023-11-30T17:26:17.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.672+0000 7f628b59e700 1 -- 172.21.15.49:0/1020498163 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f628c167e30 con 0x7f628c069640 2023-11-30T17:26:17.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.673+0000 7f62827fc700 1 -- 172.21.15.49:0/1020498163 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v142) v1 ==== 92+0+10 (secure 0 0 0) 0x7f628c167e30 con 0x7f628c069640 2023-11-30T17:26:17.675 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T17:26:17.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.675+0000 7f628b59e700 1 -- 172.21.15.49:0/1020498163 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f626c05f270 msgr2=0x7f626c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:17.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.675+0000 7f628b59e700 1 --2- 172.21.15.49:0/1020498163 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f626c05f270 0x7f626c061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f628c0c2fd0 tx=0x7f6274017000).stop 2023-11-30T17:26:17.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.675+0000 7f628b59e700 1 -- 172.21.15.49:0/1020498163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f628c069640 msgr2=0x7f628c164540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:17.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.675+0000 7f628b59e700 1 --2- 172.21.15.49:0/1020498163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f628c069640 0x7f628c164540 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7f628400c650 tx=0x7f6284008040).stop 2023-11-30T17:26:17.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.675+0000 7f628b59e700 1 -- 172.21.15.49:0/1020498163 shutdown_connections 2023-11-30T17:26:17.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.675+0000 7f628b59e700 1 --2- 172.21.15.49:0/1020498163 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f628c1544b0 0x7f628c155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:17.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.675+0000 7f628b59e700 1 --2- 172.21.15.49:0/1020498163 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f626c05f270 0x7f626c061730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:17.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.675+0000 7f628b59e700 1 --2- 172.21.15.49:0/1020498163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f628c069640 0x7f628c164540 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:17.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.675+0000 7f628b59e700 1 --2- 172.21.15.49:0/1020498163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f628c0c28d0 0x7f628c155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:17.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.675+0000 7f628b59e700 1 -- 172.21.15.49:0/1020498163 >> 172.21.15.49:0/1020498163 conn(0x7f628c063810 msgr2=0x7f628c063bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:17.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.675+0000 7f628b59e700 1 -- 172.21.15.49:0/1020498163 shutdown_connections 2023-11-30T17:26:17.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.675+0000 7f628b59e700 1 -- 172.21.15.49:0/1020498163 wait complete. 2023-11-30T17:26:17.689 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-30T17:26:17.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.804+0000 7feb6dcff700 1 Processor -- start 2023-11-30T17:26:17.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.804+0000 7feb6dcff700 1 -- start start 2023-11-30T17:26:17.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.805+0000 7feb6dcff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7feb680cae90 0x7feb680c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:17.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.805+0000 7feb6dcff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feb680ca180 0x7feb680c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:17.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.805+0000 7feb6dcff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb680a9a90 con 0x7feb680caab0 2023-11-30T17:26:17.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.805+0000 7feb6dcff700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb680c1490 con 0x7feb680ca180 2023-11-30T17:26:17.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.805+0000 7feb6dcff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb68154ce0 con 0x7feb680cae90 2023-11-30T17:26:17.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.805+0000 7feb67fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feb680ca180 0x7feb680c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:17.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.805+0000 7feb67fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feb680ca180 0x7feb680c0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59886/0 (socket says 172.21.15.49:59886) 2023-11-30T17:26:17.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.805+0000 7feb67fff700 1 -- 172.21.15.49:0/2091218780 learned_addr learned my addr 172.21.15.49:0/2091218780 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:17.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.806+0000 7feb66ffd700 1 --2- 172.21.15.49:0/2091218780 >> v2:172.21.15.115:3300/0 conn(0x7feb680cae90 0x7feb680c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:17.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.806+0000 7feb67fff700 1 -- 172.21.15.49:0/2091218780 >> v2:172.21.15.115:3300/0 conn(0x7feb680cae90 msgr2=0x7feb680c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:17.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.806+0000 7feb67fff700 1 --2- 172.21.15.49:0/2091218780 >> v2:172.21.15.115:3300/0 conn(0x7feb680cae90 0x7feb680c0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:17.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.806+0000 7feb67fff700 1 -- 172.21.15.49:0/2091218780 >> v1:172.21.15.115:6789/0 conn(0x7feb680caab0 legacy=0x7feb680aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:17.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.806+0000 7feb67fff700 1 -- 172.21.15.49:0/2091218780 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb680aab80 con 0x7feb680ca180 2023-11-30T17:26:17.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.806+0000 7feb67fff700 1 --2- 172.21.15.49:0/2091218780 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb680ca180 0x7feb680c0fa0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7feb680b1440 tx=0x7feb60009840).ready entity=mon.0 client_cookie=a6adf5bd330b77cb server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:17.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.806+0000 7feb667fc700 1 -- 172.21.15.49:0/2091218780 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6000e070 con 0x7feb680ca180 2023-11-30T17:26:17.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.806+0000 7feb667fc700 1 -- 172.21.15.49:0/2091218780 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6000ba50 con 0x7feb680ca180 2023-11-30T17:26:17.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.806+0000 7feb667fc700 1 -- 172.21.15.49:0/2091218780 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6000bdd0 con 0x7feb680ca180 2023-11-30T17:26:17.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.806+0000 7feb6dcff700 1 -- 172.21.15.49:0/2091218780 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb680ca180 msgr2=0x7feb680c0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:17.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.806+0000 7feb6dcff700 1 --2- 172.21.15.49:0/2091218780 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb680ca180 0x7feb680c0fa0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7feb680b1440 tx=0x7feb60009840).stop 2023-11-30T17:26:17.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.807+0000 7feb6dcff700 1 -- 172.21.15.49:0/2091218780 shutdown_connections 2023-11-30T17:26:17.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.807+0000 7feb6dcff700 1 --2- 172.21.15.49:0/2091218780 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb680ca180 0x7feb680c0fa0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:17.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.807+0000 7feb6dcff700 1 --2- 172.21.15.49:0/2091218780 >> v2:172.21.15.115:3300/0 conn(0x7feb680cae90 0x7feb680c0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:17.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.807+0000 7feb6dcff700 1 -- 172.21.15.49:0/2091218780 >> 172.21.15.49:0/2091218780 conn(0x7feb68094920 msgr2=0x7feb6806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:17.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.807+0000 7feb6dcff700 1 -- 172.21.15.49:0/2091218780 shutdown_connections 2023-11-30T17:26:17.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.807+0000 7feb6dcff700 1 -- 172.21.15.49:0/2091218780 wait complete. 2023-11-30T17:26:17.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.808+0000 7feb6dcff700 1 Processor -- start 2023-11-30T17:26:17.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.808+0000 7feb6dcff700 1 -- start start 2023-11-30T17:26:17.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.809+0000 7feb6dcff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb680ca180 0x7feb681553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:17.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.809+0000 7feb6dcff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb680caab0 0x7feb681579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:17.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.809+0000 7feb6dcff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb680cae90 0x7feb681678f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:17.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.809+0000 7feb6dcff700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb680c7d30 con 0x7feb680ca180 2023-11-30T17:26:17.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.809+0000 7feb6dcff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb680c8010 con 0x7feb680cae90 2023-11-30T17:26:17.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.809+0000 7feb6dcff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb680c82f0 con 0x7feb680caab0 2023-11-30T17:26:17.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.809+0000 7feb677fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb680ca180 0x7feb681553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:17.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.809+0000 7feb677fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb680ca180 0x7feb681553c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59894/0 (socket says 172.21.15.49:59894) 2023-11-30T17:26:17.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.809+0000 7feb677fe700 1 -- 172.21.15.49:0/2532983601 learned_addr learned my addr 172.21.15.49:0/2532983601 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:17.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.809+0000 7feb66ffd700 1 --2- 172.21.15.49:0/2532983601 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb680caab0 0x7feb681579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:17.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.809+0000 7feb67fff700 1 --2- 172.21.15.49:0/2532983601 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb680cae90 0x7feb681678f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:17.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.809+0000 7feb677fe700 1 -- 172.21.15.49:0/2532983601 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb680caab0 msgr2=0x7feb681579b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:17.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.809+0000 7feb677fe700 1 --2- 172.21.15.49:0/2532983601 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb680caab0 0x7feb681579b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:17.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.809+0000 7feb677fe700 1 -- 172.21.15.49:0/2532983601 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb680cae90 msgr2=0x7feb681678f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:17.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.809+0000 7feb677fe700 1 --2- 172.21.15.49:0/2532983601 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb680cae90 0x7feb681678f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:17.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.809+0000 7feb677fe700 1 -- 172.21.15.49:0/2532983601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb60009ae0 con 0x7feb680ca180 2023-11-30T17:26:17.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.809+0000 7feb677fe700 1 --2- 172.21.15.49:0/2532983601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb680ca180 0x7feb681553c0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7feb5800c4c0 tx=0x7feb58007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:17.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.809+0000 7feb4f7fe700 1 -- 172.21.15.49:0/2532983601 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5800ce70 con 0x7feb680ca180 2023-11-30T17:26:17.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.809+0000 7feb4f7fe700 1 -- 172.21.15.49:0/2532983601 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb58007020 con 0x7feb680ca180 2023-11-30T17:26:17.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.809+0000 7feb4f7fe700 1 -- 172.21.15.49:0/2532983601 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb580073c0 con 0x7feb680ca180 2023-11-30T17:26:17.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.809+0000 7feb6dcff700 1 -- 172.21.15.49:0/2532983601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb680c85d0 con 0x7feb680ca180 2023-11-30T17:26:17.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.810+0000 7feb6dcff700 1 -- 172.21.15.49:0/2532983601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb68157ea0 con 0x7feb680ca180 2023-11-30T17:26:17.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.811+0000 7feb6dcff700 1 -- 172.21.15.49:0/2532983601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb680c87f0 con 0x7feb680ca180 2023-11-30T17:26:17.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.811+0000 7feb4f7fe700 1 -- 172.21.15.49:0/2532983601 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7feb58006900 con 0x7feb680ca180 2023-11-30T17:26:17.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.811+0000 7feb4f7fe700 1 --2- 172.21.15.49:0/2532983601 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7feb5405f270 0x7feb54061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:17.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.811+0000 7feb4f7fe700 1 -- 172.21.15.49:0/2532983601 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5325+0+0 (secure 0 0 0) 0x7feb58079a00 con 0x7feb680ca180 2023-11-30T17:26:17.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.811+0000 7feb66ffd700 1 --2- 172.21.15.49:0/2532983601 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7feb5405f270 0x7feb54061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:17.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.812+0000 7feb66ffd700 1 --2- 172.21.15.49:0/2532983601 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7feb5405f270 0x7feb54061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7feb680ad2f0 tx=0x7feb5c008040).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:17.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.815+0000 7feb4f7fe700 1 -- 172.21.15.49:0/2532983601 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7feb5804ae70 con 0x7feb680ca180 2023-11-30T17:26:17.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.989+0000 7feb6dcff700 1 -- 172.21.15.49:0/2532983601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7feb680c7e70 con 0x7feb680ca180 2023-11-30T17:26:17.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.990+0000 7feb4f7fe700 1 -- 172.21.15.49:0/2532983601 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v142) v1 ==== 84+0+143 (secure 0 0 0) 0x7feb680c7e70 con 0x7feb680ca180 2023-11-30T17:26:17.992 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:26:17.992 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-11-30T17:26:17.992 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:26:17.992 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2023-11-30T17:26:17.993 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "device_health_metrics" 2023-11-30T17:26:17.993 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T17:26:17.993 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:26:17.993 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 2, 2023-11-30T17:26:17.993 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "rbd" 2023-11-30T17:26:17.993 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:26:17.993 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-11-30T17:26:17.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.991+0000 7feb6dcff700 1 -- 172.21.15.49:0/2532983601 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7feb5405f270 msgr2=0x7feb54061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:17.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.991+0000 7feb6dcff700 1 --2- 172.21.15.49:0/2532983601 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7feb5405f270 0x7feb54061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7feb680ad2f0 tx=0x7feb5c008040).stop 2023-11-30T17:26:17.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.991+0000 7feb6dcff700 1 -- 172.21.15.49:0/2532983601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb680ca180 msgr2=0x7feb681553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:17.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.991+0000 7feb6dcff700 1 --2- 172.21.15.49:0/2532983601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb680ca180 0x7feb681553c0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7feb5800c4c0 tx=0x7feb58007df0).stop 2023-11-30T17:26:17.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.992+0000 7feb6dcff700 1 -- 172.21.15.49:0/2532983601 shutdown_connections 2023-11-30T17:26:17.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.992+0000 7feb6dcff700 1 --2- 172.21.15.49:0/2532983601 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb680cae90 0x7feb681678f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:17.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.992+0000 7feb6dcff700 1 --2- 172.21.15.49:0/2532983601 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7feb5405f270 0x7feb54061730 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:17.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.992+0000 7feb6dcff700 1 --2- 172.21.15.49:0/2532983601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb680ca180 0x7feb681553c0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:17.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.992+0000 7feb6dcff700 1 --2- 172.21.15.49:0/2532983601 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb680caab0 0x7feb681579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:17.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.992+0000 7feb6dcff700 1 -- 172.21.15.49:0/2532983601 >> 172.21.15.49:0/2532983601 conn(0x7feb68094920 msgr2=0x7feb680c0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:17.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.992+0000 7feb6dcff700 1 -- 172.21.15.49:0/2532983601 shutdown_connections 2023-11-30T17:26:17.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:17.992+0000 7feb6dcff700 1 -- 172.21.15.49:0/2532983601 wait complete. 2023-11-30T17:26:18.006 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-30T17:26:18.007 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-11-30T17:26:18.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.128+0000 7f008971f700 1 Processor -- start 2023-11-30T17:26:18.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.128+0000 7f008971f700 1 -- start start 2023-11-30T17:26:18.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.129+0000 7f008971f700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f00841542d0 0x7f00840a9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:18.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.129+0000 7f008971f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00840c66d0 0x7f00840aa460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:18.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.129+0000 7f008971f700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0084158d50 con 0x7f00841546b0 2023-11-30T17:26:18.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.129+0000 7f008971f700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00840c6b60 con 0x7f00841542d0 2023-11-30T17:26:18.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.129+0000 7f008971f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00840aa950 con 0x7f00840c66d0 2023-11-30T17:26:18.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.129+0000 7f0088f1e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00840c66d0 0x7f00840aa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:18.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.129+0000 7f0083fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f00841542d0 0x7f00840a9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:18.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.129+0000 7f0088f1e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00840c66d0 0x7f00840aa460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:51360/0 (socket says 172.21.15.49:51360) 2023-11-30T17:26:18.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.129+0000 7f00837fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f00841546b0 0x7f00840c5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:33994/0 (socket says 172.21.15.49:33994) 2023-11-30T17:26:18.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.129+0000 7f0088f1e700 1 -- 172.21.15.49:0/2845081447 learned_addr learned my addr 172.21.15.49:0/2845081447 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:18.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.129+0000 7f0088f1e700 1 -- 172.21.15.49:0/2845081447 >> v2:172.21.15.115:3300/0 conn(0x7f00841542d0 msgr2=0x7f00840a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:18.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.129+0000 7f0088f1e700 1 --2- 172.21.15.49:0/2845081447 >> v2:172.21.15.115:3300/0 conn(0x7f00841542d0 0x7f00840a9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:18.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.129+0000 7f0088f1e700 1 -- 172.21.15.49:0/2845081447 >> v1:172.21.15.115:6789/0 conn(0x7f00841546b0 legacy=0x7f00840c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:18.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.129+0000 7f0088f1e700 1 -- 172.21.15.49:0/2845081447 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0084158140 con 0x7f00840c66d0 2023-11-30T17:26:18.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.130+0000 7f0088f1e700 1 --2- 172.21.15.49:0/2845081447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00840c66d0 0x7f00840aa460 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f007c009f20 tx=0x7f007c009840).ready entity=mon.2 client_cookie=c3fc9a4069f6b005 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:18.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.130+0000 7f0082ffd700 1 -- 172.21.15.49:0/2845081447 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007c00e070 con 0x7f00840c66d0 2023-11-30T17:26:18.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.130+0000 7f0082ffd700 1 -- 172.21.15.49:0/2845081447 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007c00b9d0 con 0x7f00840c66d0 2023-11-30T17:26:18.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.130+0000 7f0082ffd700 1 -- 172.21.15.49:0/2845081447 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007c00bd50 con 0x7f00840c66d0 2023-11-30T17:26:18.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.130+0000 7f008971f700 1 -- 172.21.15.49:0/2845081447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00840c66d0 msgr2=0x7f00840aa460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:18.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.130+0000 7f008971f700 1 --2- 172.21.15.49:0/2845081447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00840c66d0 0x7f00840aa460 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f007c009f20 tx=0x7f007c009840).stop 2023-11-30T17:26:18.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.130+0000 7f008971f700 1 -- 172.21.15.49:0/2845081447 shutdown_connections 2023-11-30T17:26:18.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.130+0000 7f008971f700 1 --2- 172.21.15.49:0/2845081447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00840c66d0 0x7f00840aa460 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:18.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.130+0000 7f008971f700 1 --2- 172.21.15.49:0/2845081447 >> v2:172.21.15.115:3300/0 conn(0x7f00841542d0 0x7f00840a9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:18.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.130+0000 7f008971f700 1 -- 172.21.15.49:0/2845081447 >> 172.21.15.49:0/2845081447 conn(0x7f00840cb010 msgr2=0x7f00840cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:18.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.130+0000 7f008971f700 1 -- 172.21.15.49:0/2845081447 shutdown_connections 2023-11-30T17:26:18.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.130+0000 7f008971f700 1 -- 172.21.15.49:0/2845081447 wait complete. 2023-11-30T17:26:18.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.131+0000 7f008971f700 1 Processor -- start 2023-11-30T17:26:18.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.132+0000 7f008971f700 1 -- start start 2023-11-30T17:26:18.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.132+0000 7f008971f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00840c66d0 0x7f00841684a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:18.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.132+0000 7f008971f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00841542d0 0x7f0084156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:18.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.132+0000 7f008971f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00841546b0 0x7f0084154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:18.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.132+0000 7f008971f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008413b900 con 0x7f00841542d0 2023-11-30T17:26:18.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.132+0000 7f008971f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0084168990 con 0x7f00840c66d0 2023-11-30T17:26:18.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.132+0000 7f008971f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0084157970 con 0x7f00841546b0 2023-11-30T17:26:18.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.132+0000 7f00837fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00841542d0 0x7f0084156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:18.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.132+0000 7f00837fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00841542d0 0x7f0084156aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59898/0 (socket says 172.21.15.49:59898) 2023-11-30T17:26:18.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.132+0000 7f00837fe700 1 -- 172.21.15.49:0/1928256541 learned_addr learned my addr 172.21.15.49:0/1928256541 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:18.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.133+0000 7f0088f1e700 1 --2- 172.21.15.49:0/1928256541 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00841546b0 0x7f0084154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:18.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.133+0000 7f0083fff700 1 --2- 172.21.15.49:0/1928256541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00840c66d0 0x7f00841684a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:18.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.133+0000 7f00837fe700 1 -- 172.21.15.49:0/1928256541 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00841546b0 msgr2=0x7f0084154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:18.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.133+0000 7f00837fe700 1 --2- 172.21.15.49:0/1928256541 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00841546b0 0x7f0084154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:18.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.133+0000 7f00837fe700 1 -- 172.21.15.49:0/1928256541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00840c66d0 msgr2=0x7f00841684a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:18.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.133+0000 7f00837fe700 1 --2- 172.21.15.49:0/1928256541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00840c66d0 0x7f00841684a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:18.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.133+0000 7f00837fe700 1 -- 172.21.15.49:0/1928256541 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007c009ae0 con 0x7f00841542d0 2023-11-30T17:26:18.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.133+0000 7f00837fe700 1 --2- 172.21.15.49:0/1928256541 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00841542d0 0x7f0084156aa0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7f0078007fd0 tx=0x7f0078007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:18.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.133+0000 7f006bfff700 1 -- 172.21.15.49:0/1928256541 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00780072e0 con 0x7f00841542d0 2023-11-30T17:26:18.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.133+0000 7f006bfff700 1 -- 172.21.15.49:0/1928256541 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0078007440 con 0x7f00841542d0 2023-11-30T17:26:18.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.133+0000 7f006bfff700 1 -- 172.21.15.49:0/1928256541 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00780058f0 con 0x7f00841542d0 2023-11-30T17:26:18.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.133+0000 7f008971f700 1 -- 172.21.15.49:0/1928256541 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0084157690 con 0x7f00841542d0 2023-11-30T17:26:18.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.133+0000 7f008971f700 1 -- 172.21.15.49:0/1928256541 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00840afbe0 con 0x7f00841542d0 2023-11-30T17:26:18.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.134+0000 7f008971f700 1 -- 172.21.15.49:0/1928256541 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00840af760 con 0x7f00841542d0 2023-11-30T17:26:18.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.134+0000 7f006bfff700 1 -- 172.21.15.49:0/1928256541 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0078005ce0 con 0x7f00841542d0 2023-11-30T17:26:18.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.135+0000 7f006bfff700 1 --2- 172.21.15.49:0/1928256541 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f007005f270 0x7f0070061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:18.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.135+0000 7f006bfff700 1 -- 172.21.15.49:0/1928256541 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5325+0+0 (secure 0 0 0) 0x7f00780798c0 con 0x7f00841542d0 2023-11-30T17:26:18.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.135+0000 7f0083fff700 1 --2- 172.21.15.49:0/1928256541 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f007005f270 0x7f0070061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:18.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.135+0000 7f0083fff700 1 --2- 172.21.15.49:0/1928256541 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f007005f270 0x7f0070061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f0074009bc0 tx=0x7f0074008040).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:18.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.139+0000 7f006bfff700 1 -- 172.21.15.49:0/1928256541 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f00840af760 con 0x7f00841542d0 2023-11-30T17:26:18.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.312+0000 7f008971f700 1 -- 172.21.15.49:0/1928256541 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f00840af760 con 0x7f00841542d0 2023-11-30T17:26:18.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.956+0000 7f006bfff700 1 -- 172.21.15.49:0/1928256541 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v143) v1 ==== 152+0+0 (secure 0 0 0) 0x7f00840af760 con 0x7f00841542d0 2023-11-30T17:26:18.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.960+0000 7f008971f700 1 -- 172.21.15.49:0/1928256541 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f007005f270 msgr2=0x7f0070061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:18.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.960+0000 7f008971f700 1 --2- 172.21.15.49:0/1928256541 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f007005f270 0x7f0070061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f0074009bc0 tx=0x7f0074008040).stop 2023-11-30T17:26:18.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.960+0000 7f008971f700 1 -- 172.21.15.49:0/1928256541 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00841542d0 msgr2=0x7f0084156aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:18.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.960+0000 7f008971f700 1 --2- 172.21.15.49:0/1928256541 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00841542d0 0x7f0084156aa0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7f0078007fd0 tx=0x7f0078007df0).stop 2023-11-30T17:26:18.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.960+0000 7f008971f700 1 -- 172.21.15.49:0/1928256541 shutdown_connections 2023-11-30T17:26:18.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.960+0000 7f008971f700 1 --2- 172.21.15.49:0/1928256541 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f00841546b0 0x7f0084154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:18.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.960+0000 7f008971f700 1 --2- 172.21.15.49:0/1928256541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00840c66d0 0x7f00841684a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:18.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.960+0000 7f008971f700 1 --2- 172.21.15.49:0/1928256541 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f007005f270 0x7f0070061730 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0x7f0074009bc0 tx=0x7f0074008040).stop 2023-11-30T17:26:18.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.960+0000 7f008971f700 1 --2- 172.21.15.49:0/1928256541 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00841542d0 0x7f0084156aa0 secure :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 rx=0x7f0078007fd0 tx=0x7f0078007df0).stop 2023-11-30T17:26:18.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.960+0000 7f008971f700 1 -- 172.21.15.49:0/1928256541 >> 172.21.15.49:0/1928256541 conn(0x7f00840cb010 msgr2=0x7f00840c5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:18.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.962+0000 7f008971f700 1 -- 172.21.15.49:0/1928256541 shutdown_connections 2023-11-30T17:26:18.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:18.962+0000 7f008971f700 1 -- 172.21.15.49:0/1928256541 wait complete. 2023-11-30T17:26:18.969 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2023-11-30T17:26:18.979 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-30T17:26:19.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.105+0000 7fac0d838700 1 Processor -- start 2023-11-30T17:26:19.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.105+0000 7fac0d838700 1 -- start start 2023-11-30T17:26:19.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.106+0000 7fac0d838700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fac08158a30 0x7fac080c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:19.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.106+0000 7fac0d838700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac080c72d0 con 0x7fac08098d10 2023-11-30T17:26:19.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.106+0000 7fac0d838700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac08064570 con 0x7fac080c6190 2023-11-30T17:26:19.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.106+0000 7fac0d838700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac08154bc0 con 0x7fac08158a30 2023-11-30T17:26:19.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.106+0000 7fac06ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fac08098d10 0x7fac08063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48348/0 (socket says 172.21.15.49:48348) 2023-11-30T17:26:19.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.106+0000 7fac06ffd700 1 -- 172.21.15.49:0/2795412627 learned_addr learned my addr 172.21.15.49:0/2795412627 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:19.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.106+0000 7fac077fe700 1 --2- 172.21.15.49:0/2795412627 >> v2:172.21.15.115:3300/0 conn(0x7fac08158a30 0x7fac080c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:19.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.106+0000 7fac05ffb700 1 -- 172.21.15.49:0/2795412627 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1465978353 0 0) 0x7fac080c72d0 con 0x7fac08098d10 2023-11-30T17:26:19.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.106+0000 7fac05ffb700 1 -- 172.21.15.49:0/2795412627 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabf00033f0 con 0x7fac08098d10 2023-11-30T17:26:19.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.106+0000 7fac05ffb700 1 -- 172.21.15.49:0/2795412627 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3275800196 0 0) 0x7fabf00033f0 con 0x7fac08098d10 2023-11-30T17:26:19.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.106+0000 7fac077fe700 1 -- 172.21.15.49:0/2795412627 >> v1:172.21.15.115:6789/0 conn(0x7fac080c6190 legacy=0x7fac08158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:19.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.106+0000 7fac077fe700 1 -- 172.21.15.49:0/2795412627 >> v1:172.21.15.49:6789/0 conn(0x7fac08098d10 legacy=0x7fac08063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:19.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.106+0000 7fac077fe700 1 -- 172.21.15.49:0/2795412627 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac080c66c0 con 0x7fac08158a30 2023-11-30T17:26:19.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.106+0000 7fac077fe700 1 --2- 172.21.15.49:0/2795412627 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac08158a30 0x7fac080c7760 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7fac00009e60 tx=0x7fac00009780).ready entity=mon.1 client_cookie=9f63ab9613a00c0b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:19.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.107+0000 7fac05ffb700 1 -- 172.21.15.49:0/2795412627 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0000e070 con 0x7fac08158a30 2023-11-30T17:26:19.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.107+0000 7fac05ffb700 1 -- 172.21.15.49:0/2795412627 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0000b850 con 0x7fac08158a30 2023-11-30T17:26:19.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.107+0000 7fac05ffb700 1 -- 172.21.15.49:0/2795412627 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf8001470 con 0x7fac08158a30 2023-11-30T17:26:19.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.107+0000 7fac0d838700 1 -- 172.21.15.49:0/2795412627 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac08158a30 msgr2=0x7fac080c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:19.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.107+0000 7fac0d838700 1 --2- 172.21.15.49:0/2795412627 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac08158a30 0x7fac080c7760 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7fac00009e60 tx=0x7fac00009780).stop 2023-11-30T17:26:19.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.107+0000 7fac0d838700 1 -- 172.21.15.49:0/2795412627 shutdown_connections 2023-11-30T17:26:19.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.107+0000 7fac0d838700 1 --2- 172.21.15.49:0/2795412627 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac08158a30 0x7fac080c7760 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:19.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.107+0000 7fac0d838700 1 -- 172.21.15.49:0/2795412627 >> 172.21.15.49:0/2795412627 conn(0x7fac080cb310 msgr2=0x7fac080cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:19.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.107+0000 7fac0d838700 1 -- 172.21.15.49:0/2795412627 shutdown_connections 2023-11-30T17:26:19.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.107+0000 7fac0d838700 1 -- 172.21.15.49:0/2795412627 wait complete. 2023-11-30T17:26:19.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.108+0000 7fac0d838700 1 Processor -- start 2023-11-30T17:26:19.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.109+0000 7fac0d838700 1 -- start start 2023-11-30T17:26:19.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.109+0000 7fac0d838700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fac08098d10 0x7fac080b0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:19.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.109+0000 7fac0d838700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac080c6190 0x7fac080ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:19.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.109+0000 7fac0d838700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac08158a30 0x7fac08155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:19.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.109+0000 7fac0d838700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac08155aa0 con 0x7fac08158a30 2023-11-30T17:26:19.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.109+0000 7fac0d838700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac08154ed0 con 0x7fac080c6190 2023-11-30T17:26:19.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.109+0000 7fac0d838700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac08155170 con 0x7fac08098d10 2023-11-30T17:26:19.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.109+0000 7fac077fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac08158a30 0x7fac08155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:19.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.109+0000 7fac077fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac08158a30 0x7fac08155f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59908/0 (socket says 172.21.15.49:59908) 2023-11-30T17:26:19.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.109+0000 7fac077fe700 1 -- 172.21.15.49:0/817634420 learned_addr learned my addr 172.21.15.49:0/817634420 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:19.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.110+0000 7fac06ffd700 1 --2- 172.21.15.49:0/817634420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fac08098d10 0x7fac080b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:19.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.110+0000 7fac067fc700 1 --2- 172.21.15.49:0/817634420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac080c6190 0x7fac080ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:19.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.110+0000 7fac077fe700 1 -- 172.21.15.49:0/817634420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fac08098d10 msgr2=0x7fac080b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:19.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.110+0000 7fac077fe700 1 --2- 172.21.15.49:0/817634420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fac08098d10 0x7fac080b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:19.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.110+0000 7fac077fe700 1 -- 172.21.15.49:0/817634420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac080c6190 msgr2=0x7fac080ad7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:19.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.110+0000 7fac077fe700 1 --2- 172.21.15.49:0/817634420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac080c6190 0x7fac080ad7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:19.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.110+0000 7fac077fe700 1 -- 172.21.15.49:0/817634420 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac00009a20 con 0x7fac08158a30 2023-11-30T17:26:19.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.110+0000 7fac077fe700 1 --2- 172.21.15.49:0/817634420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac08158a30 0x7fac08155f30 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7fac00010000 tx=0x7fac080a8040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:19.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.110+0000 7fabeeffd700 1 -- 172.21.15.49:0/817634420 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac00009420 con 0x7fac08158a30 2023-11-30T17:26:19.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.110+0000 7fabeeffd700 1 -- 172.21.15.49:0/817634420 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0001e480 con 0x7fac08158a30 2023-11-30T17:26:19.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.110+0000 7fac0d838700 1 -- 172.21.15.49:0/817634420 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac08155450 con 0x7fac08158a30 2023-11-30T17:26:19.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.110+0000 7fabeeffd700 1 -- 172.21.15.49:0/817634420 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0001e840 con 0x7fac08158a30 2023-11-30T17:26:19.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.110+0000 7fac0d838700 1 -- 172.21.15.49:0/817634420 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac080b0bf0 con 0x7fac08158a30 2023-11-30T17:26:19.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.111+0000 7fac0d838700 1 -- 172.21.15.49:0/817634420 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac0806c860 con 0x7fac08158a30 2023-11-30T17:26:19.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.112+0000 7fabeeffd700 1 -- 172.21.15.49:0/817634420 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fac0001ebb0 con 0x7fac08158a30 2023-11-30T17:26:19.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.112+0000 7fabeeffd700 1 --2- 172.21.15.49:0/817634420 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fabf405f240 0x7fabf4061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:19.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.112+0000 7fabeeffd700 1 -- 172.21.15.49:0/817634420 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5695+0+0 (secure 0 0 0) 0x7fac0007ce40 con 0x7fac08158a30 2023-11-30T17:26:19.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.113+0000 7fac06ffd700 1 --2- 172.21.15.49:0/817634420 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fabf405f240 0x7fabf4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:19.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.113+0000 7fac06ffd700 1 --2- 172.21.15.49:0/817634420 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fabf405f240 0x7fabf4061700 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fabf80015a0 tx=0x7fabf80013e0).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:19.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.117+0000 7fabeeffd700 1 -- 172.21.15.49:0/817634420 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fac0004e200 con 0x7fac08158a30 2023-11-30T17:26:19.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.290+0000 7fac0d838700 1 -- 172.21.15.49:0/817634420 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fac0806c860 con 0x7fac08158a30 2023-11-30T17:26:19.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.966+0000 7fabeeffd700 1 -- 172.21.15.49:0/817634420 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v144) v1 ==== 170+0+0 (secure 0 0 0) 0x7fac0001ee60 con 0x7fac08158a30 2023-11-30T17:26:19.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.970+0000 7fac0d838700 1 -- 172.21.15.49:0/817634420 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fabf405f240 msgr2=0x7fabf4061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:19.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.970+0000 7fac0d838700 1 --2- 172.21.15.49:0/817634420 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fabf405f240 0x7fabf4061700 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fabf80015a0 tx=0x7fabf80013e0).stop 2023-11-30T17:26:19.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.970+0000 7fac0d838700 1 -- 172.21.15.49:0/817634420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac08158a30 msgr2=0x7fac08155f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:19.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.970+0000 7fac0d838700 1 --2- 172.21.15.49:0/817634420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac08158a30 0x7fac08155f30 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7fac00010000 tx=0x7fac080a8040).stop 2023-11-30T17:26:19.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.971+0000 7fac0d838700 1 -- 172.21.15.49:0/817634420 shutdown_connections 2023-11-30T17:26:19.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.971+0000 7fac0d838700 1 --2- 172.21.15.49:0/817634420 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fabf405f240 0x7fabf4061700 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0x7fabf80015a0 tx=0x7fabf80013e0).stop 2023-11-30T17:26:19.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.971+0000 7fac0d838700 1 --2- 172.21.15.49:0/817634420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac08158a30 0x7fac08155f30 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:19.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.971+0000 7fac0d838700 1 --2- 172.21.15.49:0/817634420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fac08098d10 0x7fac080b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:19.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.971+0000 7fac0d838700 1 --2- 172.21.15.49:0/817634420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac080c6190 0x7fac080ad7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:19.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.971+0000 7fac0d838700 1 -- 172.21.15.49:0/817634420 >> 172.21.15.49:0/817634420 conn(0x7fac080cb310 msgr2=0x7fac080c1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:19.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.978+0000 7fac0d838700 1 -- 172.21.15.49:0/817634420 shutdown_connections 2023-11-30T17:26:19.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:19.991+0000 7fac0d838700 1 -- 172.21.15.49:0/817634420 wait complete. 2023-11-30T17:26:19.995 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2023-11-30T17:26:20.008 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-30T17:26:20.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.128+0000 7f3d49f7a700 1 Processor -- start 2023-11-30T17:26:20.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.128+0000 7f3d49f7a700 1 -- start start 2023-11-30T17:26:20.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.129+0000 7f3d49f7a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3d440c6190 0x7f3d440c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:20.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.129+0000 7f3d49f7a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3d44158320 0x7f3d441587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:20.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.129+0000 7f3d49f7a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d44158cc0 con 0x7f3d44098d10 2023-11-30T17:26:20.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.129+0000 7f3d49f7a700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d440c72d0 con 0x7f3d440c6190 2023-11-30T17:26:20.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.129+0000 7f3d49f7a700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d44064570 con 0x7f3d44158320 2023-11-30T17:26:20.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.129+0000 7f3d42ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3d440c6190 0x7f3d440c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:20.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.129+0000 7f3d42ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3d440c6190 0x7f3d440c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59916/0 (socket says 172.21.15.49:59916) 2023-11-30T17:26:20.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.129+0000 7f3d437fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3d44098d10 0x7f3d44063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48360/0 (socket says 172.21.15.49:48360) 2023-11-30T17:26:20.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.129+0000 7f3d42ffd700 1 -- 172.21.15.49:0/2854813968 learned_addr learned my addr 172.21.15.49:0/2854813968 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:20.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.129+0000 7f3d43fff700 1 --2- 172.21.15.49:0/2854813968 >> v2:172.21.15.115:3300/0 conn(0x7f3d44158320 0x7f3d441587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:20.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.129+0000 7f3d42ffd700 1 -- 172.21.15.49:0/2854813968 >> v2:172.21.15.115:3300/0 conn(0x7f3d44158320 msgr2=0x7f3d441587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:20.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.129+0000 7f3d42ffd700 1 --2- 172.21.15.49:0/2854813968 >> v2:172.21.15.115:3300/0 conn(0x7f3d44158320 0x7f3d441587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:20.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.129+0000 7f3d42ffd700 1 -- 172.21.15.49:0/2854813968 >> v1:172.21.15.49:6789/0 conn(0x7f3d44098d10 legacy=0x7f3d44063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:20.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.129+0000 7f3d427fc700 1 -- 172.21.15.49:0/2854813968 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032091691 0 0) 0x7f3d34001110 con 0x7f3d44098d10 2023-11-30T17:26:20.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.129+0000 7f3d42ffd700 1 -- 172.21.15.49:0/2854813968 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d44154bc0 con 0x7f3d440c6190 2023-11-30T17:26:20.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.129+0000 7f3d43fff700 1 --2- 172.21.15.49:0/2854813968 >> v2:172.21.15.115:3300/0 conn(0x7f3d44158320 0x7f3d441587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:26:20.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.129+0000 7f3d42ffd700 1 --2- 172.21.15.49:0/2854813968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d440c6190 0x7f3d440c7760 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f3d440657a0 tx=0x7f3d2c0090f0).ready entity=mon.0 client_cookie=8509c83a764d2b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:20.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.129+0000 7f3d427fc700 1 -- 172.21.15.49:0/2854813968 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c00b600 con 0x7f3d440c6190 2023-11-30T17:26:20.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.129+0000 7f3d427fc700 1 -- 172.21.15.49:0/2854813968 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2c00b760 con 0x7f3d440c6190 2023-11-30T17:26:20.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.129+0000 7f3d427fc700 1 -- 172.21.15.49:0/2854813968 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c00bae0 con 0x7f3d440c6190 2023-11-30T17:26:20.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.130+0000 7f3d49f7a700 1 -- 172.21.15.49:0/2854813968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d440c6190 msgr2=0x7f3d440c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:20.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.130+0000 7f3d49f7a700 1 --2- 172.21.15.49:0/2854813968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d440c6190 0x7f3d440c7760 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f3d440657a0 tx=0x7f3d2c0090f0).stop 2023-11-30T17:26:20.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.130+0000 7f3d49f7a700 1 -- 172.21.15.49:0/2854813968 shutdown_connections 2023-11-30T17:26:20.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.130+0000 7f3d49f7a700 1 --2- 172.21.15.49:0/2854813968 >> v2:172.21.15.115:3300/0 conn(0x7f3d44158320 0x7f3d441587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:20.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.130+0000 7f3d49f7a700 1 --2- 172.21.15.49:0/2854813968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d440c6190 0x7f3d440c7760 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:20.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.130+0000 7f3d49f7a700 1 -- 172.21.15.49:0/2854813968 >> 172.21.15.49:0/2854813968 conn(0x7f3d440cb310 msgr2=0x7f3d440cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:20.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.130+0000 7f3d49f7a700 1 -- 172.21.15.49:0/2854813968 shutdown_connections 2023-11-30T17:26:20.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.130+0000 7f3d49f7a700 1 -- 172.21.15.49:0/2854813968 wait complete. 2023-11-30T17:26:20.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.131+0000 7f3d49f7a700 1 Processor -- start 2023-11-30T17:26:20.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.131+0000 7f3d49f7a700 1 -- start start 2023-11-30T17:26:20.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.132+0000 7f3d49f7a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d44098d10 0x7f3d44152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:20.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.132+0000 7f3d49f7a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d440c6190 0x7f3d440c23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:20.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.132+0000 7f3d49f7a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3d44158320 0x7f3d440c28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:20.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.132+0000 7f3d49f7a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d440c2d90 con 0x7f3d440c6190 2023-11-30T17:26:20.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.132+0000 7f3d49f7a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d440affc0 con 0x7f3d44098d10 2023-11-30T17:26:20.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.132+0000 7f3d49f7a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d440c4030 con 0x7f3d44158320 2023-11-30T17:26:20.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.132+0000 7f3d42ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d440c6190 0x7f3d440c23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:20.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.132+0000 7f3d42ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d440c6190 0x7f3d440c23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59930/0 (socket says 172.21.15.49:59930) 2023-11-30T17:26:20.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.132+0000 7f3d42ffd700 1 -- 172.21.15.49:0/3406576150 learned_addr learned my addr 172.21.15.49:0/3406576150 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:20.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.132+0000 7f3d437fe700 1 --2- 172.21.15.49:0/3406576150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d44098d10 0x7f3d44152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:20.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.132+0000 7f3d43fff700 1 --2- 172.21.15.49:0/3406576150 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3d44158320 0x7f3d440c28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:20.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.132+0000 7f3d42ffd700 1 -- 172.21.15.49:0/3406576150 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3d44158320 msgr2=0x7f3d440c28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:20.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.132+0000 7f3d42ffd700 1 --2- 172.21.15.49:0/3406576150 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3d44158320 0x7f3d440c28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:20.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.132+0000 7f3d42ffd700 1 -- 172.21.15.49:0/3406576150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d44098d10 msgr2=0x7f3d44152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:20.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.132+0000 7f3d42ffd700 1 --2- 172.21.15.49:0/3406576150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d44098d10 0x7f3d44152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:20.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.132+0000 7f3d42ffd700 1 -- 172.21.15.49:0/3406576150 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2c009370 con 0x7f3d440c6190 2023-11-30T17:26:20.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.132+0000 7f3d437fe700 1 --2- 172.21.15.49:0/3406576150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d44098d10 0x7f3d44152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:26:20.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.132+0000 7f3d43fff700 1 --2- 172.21.15.49:0/3406576150 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3d44158320 0x7f3d440c28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:26:20.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.133+0000 7f3d42ffd700 1 --2- 172.21.15.49:0/3406576150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d440c6190 0x7f3d440c23b0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7f3d2c011000 tx=0x7f3d2c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:20.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.133+0000 7f3d3b7fe700 1 -- 172.21.15.49:0/3406576150 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c00bea0 con 0x7f3d440c6190 2023-11-30T17:26:20.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.133+0000 7f3d3b7fe700 1 -- 172.21.15.49:0/3406576150 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2c00b8d0 con 0x7f3d440c6190 2023-11-30T17:26:20.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.133+0000 7f3d49f7a700 1 -- 172.21.15.49:0/3406576150 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d440c2f90 con 0x7f3d440c6190 2023-11-30T17:26:20.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.133+0000 7f3d3b7fe700 1 -- 172.21.15.49:0/3406576150 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c0246c0 con 0x7f3d440c6190 2023-11-30T17:26:20.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.133+0000 7f3d49f7a700 1 -- 172.21.15.49:0/3406576150 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d440c3550 con 0x7f3d440c6190 2023-11-30T17:26:20.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.134+0000 7f3d49f7a700 1 -- 172.21.15.49:0/3406576150 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d4406c860 con 0x7f3d440c6190 2023-11-30T17:26:20.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.134+0000 7f3d3b7fe700 1 -- 172.21.15.49:0/3406576150 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f3d2c021070 con 0x7f3d440c6190 2023-11-30T17:26:20.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.135+0000 7f3d3b7fe700 1 --2- 172.21.15.49:0/3406576150 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3d2405f240 0x7f3d24061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:20.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.135+0000 7f3d3b7fe700 1 -- 172.21.15.49:0/3406576150 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6077+0+0 (secure 0 0 0) 0x7f3d2c07c080 con 0x7f3d440c6190 2023-11-30T17:26:20.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.135+0000 7f3d437fe700 1 --2- 172.21.15.49:0/3406576150 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3d2405f240 0x7f3d24061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:20.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.135+0000 7f3d437fe700 1 --2- 172.21.15.49:0/3406576150 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3d2405f240 0x7f3d24061700 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f3d34001740 tx=0x7f3d34009040).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:20.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.139+0000 7f3d3b7fe700 1 -- 172.21.15.49:0/3406576150 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3d2c04d2c0 con 0x7f3d440c6190 2023-11-30T17:26:20.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.355+0000 7f3d49f7a700 1 -- 172.21.15.49:0/3406576150 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3d440c66c0 con 0x7f3d440c6190 2023-11-30T17:26:20.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.365+0000 7f3d3b7fe700 1 -- 172.21.15.49:0/3406576150 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v57) v1 ==== 174+0+0 (secure 0 0 0) 0x7f3d2c0508e0 con 0x7f3d440c6190 2023-11-30T17:26:20.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.373+0000 7f3d49f7a700 1 -- 172.21.15.49:0/3406576150 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3d2405f240 msgr2=0x7f3d24061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:20.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.373+0000 7f3d49f7a700 1 --2- 172.21.15.49:0/3406576150 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3d2405f240 0x7f3d24061700 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f3d34001740 tx=0x7f3d34009040).stop 2023-11-30T17:26:20.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.373+0000 7f3d49f7a700 1 -- 172.21.15.49:0/3406576150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d440c6190 msgr2=0x7f3d440c23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:20.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.373+0000 7f3d49f7a700 1 --2- 172.21.15.49:0/3406576150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d440c6190 0x7f3d440c23b0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7f3d2c011000 tx=0x7f3d2c017000).stop 2023-11-30T17:26:20.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.373+0000 7f3d49f7a700 1 -- 172.21.15.49:0/3406576150 shutdown_connections 2023-11-30T17:26:20.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.373+0000 7f3d49f7a700 1 --2- 172.21.15.49:0/3406576150 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3d44158320 0x7f3d440c28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:20.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.373+0000 7f3d49f7a700 1 --2- 172.21.15.49:0/3406576150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d44098d10 0x7f3d44152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:20.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.373+0000 7f3d49f7a700 1 --2- 172.21.15.49:0/3406576150 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3d2405f240 0x7f3d24061700 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:20.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.373+0000 7f3d49f7a700 1 --2- 172.21.15.49:0/3406576150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d440c6190 0x7f3d440c23b0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:20.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.373+0000 7f3d49f7a700 1 -- 172.21.15.49:0/3406576150 >> 172.21.15.49:0/3406576150 conn(0x7f3d440cb310 msgr2=0x7f3d44153160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:20.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.375+0000 7f3d49f7a700 1 -- 172.21.15.49:0/3406576150 shutdown_connections 2023-11-30T17:26:20.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.375+0000 7f3d49f7a700 1 -- 172.21.15.49:0/3406576150 wait complete. 2023-11-30T17:26:20.387 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 17 and data pool 18 2023-11-30T17:26:20.401 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:26:20.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.516+0000 7effafd32700 1 Processor -- start 2023-11-30T17:26:20.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.516+0000 7effafd32700 1 -- start start 2023-11-30T17:26:20.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.517+0000 7effafd32700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effa80caab0 0x7effa80aa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:20.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.517+0000 7effafd32700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7effa80ca180 0x7effa815e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:20.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.517+0000 7effafd32700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa80a9a90 con 0x7effa80cae90 2023-11-30T17:26:20.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.517+0000 7effafd32700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa8154ce0 con 0x7effa80ca180 2023-11-30T17:26:20.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.517+0000 7effafd32700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa80a8e80 con 0x7effa80caab0 2023-11-30T17:26:20.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.518+0000 7effadace700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effa80caab0 0x7effa80aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:20.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.518+0000 7effae2cf700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7effa80ca180 0x7effa815e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:20.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.518+0000 7effadace700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effa80caab0 0x7effa80aa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:51394/0 (socket says 172.21.15.49:51394) 2023-11-30T17:26:20.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.518+0000 7effadace700 1 -- 172.21.15.49:0/3596430302 learned_addr learned my addr 172.21.15.49:0/3596430302 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:20.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.518+0000 7effae2cf700 1 -- 172.21.15.49:0/3596430302 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effa80caab0 msgr2=0x7effa80aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:20.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.518+0000 7effae2cf700 1 --2- 172.21.15.49:0/3596430302 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effa80caab0 0x7effa80aa470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:20.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.518+0000 7effae2cf700 1 -- 172.21.15.49:0/3596430302 >> v1:172.21.15.115:6789/0 conn(0x7effa80cae90 legacy=0x7effa80c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:20.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.518+0000 7effacacc700 1 -- 172.21.15.49:0/3596430302 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1154349060 0 0) 0x7effa80a9a90 con 0x7effa80cae90 2023-11-30T17:26:20.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.518+0000 7effae2cf700 1 -- 172.21.15.49:0/3596430302 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa80a9160 con 0x7effa80ca180 2023-11-30T17:26:20.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.518+0000 7effadace700 1 --2- 172.21.15.49:0/3596430302 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effa80caab0 0x7effa80aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:26:20.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.518+0000 7effae2cf700 1 --2- 172.21.15.49:0/3596430302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effa80ca180 0x7effa815e3c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7eff98009e60 tx=0x7eff98009780).ready entity=mon.1 client_cookie=a90905597a5b12f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:20.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.519+0000 7effacacc700 1 -- 172.21.15.49:0/3596430302 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9800e070 con 0x7effa80ca180 2023-11-30T17:26:20.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.519+0000 7effacacc700 1 -- 172.21.15.49:0/3596430302 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9800bb60 con 0x7effa80ca180 2023-11-30T17:26:20.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.519+0000 7effacacc700 1 -- 172.21.15.49:0/3596430302 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff98012410 con 0x7effa80ca180 2023-11-30T17:26:20.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.519+0000 7effafd32700 1 -- 172.21.15.49:0/3596430302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effa80ca180 msgr2=0x7effa815e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:20.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.519+0000 7effafd32700 1 --2- 172.21.15.49:0/3596430302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effa80ca180 0x7effa815e3c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7eff98009e60 tx=0x7eff98009780).stop 2023-11-30T17:26:20.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.519+0000 7effafd32700 1 -- 172.21.15.49:0/3596430302 shutdown_connections 2023-11-30T17:26:20.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.519+0000 7effafd32700 1 --2- 172.21.15.49:0/3596430302 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effa80caab0 0x7effa80aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:20.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.519+0000 7effafd32700 1 --2- 172.21.15.49:0/3596430302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effa80ca180 0x7effa815e3c0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:20.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.519+0000 7effafd32700 1 -- 172.21.15.49:0/3596430302 >> 172.21.15.49:0/3596430302 conn(0x7effa8094920 msgr2=0x7effa806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:20.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.519+0000 7effafd32700 1 -- 172.21.15.49:0/3596430302 shutdown_connections 2023-11-30T17:26:20.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.519+0000 7effafd32700 1 -- 172.21.15.49:0/3596430302 wait complete. 2023-11-30T17:26:20.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.520+0000 7effafd32700 1 Processor -- start 2023-11-30T17:26:20.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.520+0000 7effafd32700 1 -- start start 2023-11-30T17:26:20.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.521+0000 7effafd32700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effa80ca180 0x7effa8151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:20.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.521+0000 7effafd32700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effa80caab0 0x7effa80aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:20.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.521+0000 7effafd32700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effa80cae90 0x7effa80c4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:20.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.521+0000 7effafd32700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa8158690 con 0x7effa80caab0 2023-11-30T17:26:20.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.521+0000 7effafd32700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa8151af0 con 0x7effa80ca180 2023-11-30T17:26:20.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.521+0000 7effafd32700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa80b0040 con 0x7effa80cae90 2023-11-30T17:26:20.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.521+0000 7effad2cd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effa80caab0 0x7effa80aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:20.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.521+0000 7effad2cd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effa80caab0 0x7effa80aebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59934/0 (socket says 172.21.15.49:59934) 2023-11-30T17:26:20.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.521+0000 7effad2cd700 1 -- 172.21.15.49:0/3829032301 learned_addr learned my addr 172.21.15.49:0/3829032301 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:20.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.521+0000 7effadace700 1 --2- 172.21.15.49:0/3829032301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effa80ca180 0x7effa8151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:20.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.521+0000 7effae2cf700 1 --2- 172.21.15.49:0/3829032301 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effa80cae90 0x7effa80c4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:20.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.521+0000 7effad2cd700 1 -- 172.21.15.49:0/3829032301 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effa80cae90 msgr2=0x7effa80c4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:20.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.522+0000 7effad2cd700 1 --2- 172.21.15.49:0/3829032301 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effa80cae90 0x7effa80c4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:20.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.522+0000 7effad2cd700 1 -- 172.21.15.49:0/3829032301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effa80ca180 msgr2=0x7effa8151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:20.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.522+0000 7effad2cd700 1 --2- 172.21.15.49:0/3829032301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effa80ca180 0x7effa8151600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:20.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.522+0000 7effad2cd700 1 -- 172.21.15.49:0/3829032301 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa0009300 con 0x7effa80caab0 2023-11-30T17:26:20.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.522+0000 7effad2cd700 1 --2- 172.21.15.49:0/3829032301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effa80caab0 0x7effa80aebe0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7eff9c00c490 tx=0x7eff9c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:20.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.522+0000 7effa5ffb700 1 -- 172.21.15.49:0/3829032301 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c007020 con 0x7effa80caab0 2023-11-30T17:26:20.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.522+0000 7effa5ffb700 1 -- 172.21.15.49:0/3829032301 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9c0071a0 con 0x7effa80caab0 2023-11-30T17:26:20.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.522+0000 7effafd32700 1 -- 172.21.15.49:0/3829032301 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff98009a20 con 0x7effa80caab0 2023-11-30T17:26:20.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.522+0000 7effa5ffb700 1 -- 172.21.15.49:0/3829032301 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c007560 con 0x7effa80caab0 2023-11-30T17:26:20.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.522+0000 7effafd32700 1 -- 172.21.15.49:0/3829032301 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa80b0600 con 0x7effa80caab0 2023-11-30T17:26:20.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.523+0000 7effafd32700 1 -- 172.21.15.49:0/3829032301 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa80ca560 con 0x7effa80caab0 2023-11-30T17:26:20.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.523+0000 7effa5ffb700 1 -- 172.21.15.49:0/3829032301 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7eff9c006ac0 con 0x7effa80caab0 2023-11-30T17:26:20.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.524+0000 7effa5ffb700 1 --2- 172.21.15.49:0/3829032301 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7eff9405f270 0x7eff94061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:20.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.524+0000 7effa5ffb700 1 -- 172.21.15.49:0/3829032301 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6177+0+0 (secure 0 0 0) 0x7eff9c001e40 con 0x7effa80caab0 2023-11-30T17:26:20.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.524+0000 7effadace700 1 --2- 172.21.15.49:0/3829032301 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7eff9405f270 0x7eff94061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:20.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.524+0000 7effadace700 1 --2- 172.21.15.49:0/3829032301 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7eff9405f270 0x7eff94061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7effa0006b40 tx=0x7effa0009060).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:20.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.528+0000 7effa5ffb700 1 -- 172.21.15.49:0/3829032301 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7eff9c04b070 con 0x7effa80caab0 2023-11-30T17:26:20.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.698+0000 7effafd32700 1 -- 172.21.15.49:0/3829032301 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7effa806c860 con 0x7effa80caab0 2023-11-30T17:26:20.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.699+0000 7effa5ffb700 1 -- 172.21.15.49:0/3829032301 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+17044 (secure 0 0 0) 0x7eff9c04e690 con 0x7effa80caab0 2023-11-30T17:26:20.701 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:26:20.702 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":145,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:26:20.357634+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:26:18.350122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-11-30T17:26:19.327933+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:26:20.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.701+0000 7effafd32700 1 -- 172.21.15.49:0/3829032301 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7eff9405f270 msgr2=0x7eff94061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:20.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.701+0000 7effafd32700 1 --2- 172.21.15.49:0/3829032301 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7eff9405f270 0x7eff94061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7effa0006b40 tx=0x7effa0009060).stop 2023-11-30T17:26:20.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.701+0000 7effafd32700 1 -- 172.21.15.49:0/3829032301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effa80caab0 msgr2=0x7effa80aebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:20.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.701+0000 7effafd32700 1 --2- 172.21.15.49:0/3829032301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effa80caab0 0x7effa80aebe0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7eff9c00c490 tx=0x7eff9c007d70).stop 2023-11-30T17:26:20.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.701+0000 7effafd32700 1 -- 172.21.15.49:0/3829032301 shutdown_connections 2023-11-30T17:26:20.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.701+0000 7effafd32700 1 --2- 172.21.15.49:0/3829032301 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effa80cae90 0x7effa80c4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:20.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.701+0000 7effafd32700 1 --2- 172.21.15.49:0/3829032301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effa80ca180 0x7effa8151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:20.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.701+0000 7effafd32700 1 --2- 172.21.15.49:0/3829032301 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7eff9405f270 0x7eff94061730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:20.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.701+0000 7effafd32700 1 --2- 172.21.15.49:0/3829032301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effa80caab0 0x7effa80aebe0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:20.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.701+0000 7effafd32700 1 -- 172.21.15.49:0/3829032301 >> 172.21.15.49:0/3829032301 conn(0x7effa8094920 msgr2=0x7effa80c62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:20.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.701+0000 7effafd32700 1 -- 172.21.15.49:0/3829032301 shutdown_connections 2023-11-30T17:26:20.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.701+0000 7effafd32700 1 -- 172.21.15.49:0/3829032301 wait complete. 2023-11-30T17:26:20.716 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:26:20.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.830+0000 7fc7464fc700 1 Processor -- start 2023-11-30T17:26:20.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.830+0000 7fc7464fc700 1 -- start start 2023-11-30T17:26:20.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.831+0000 7fc7464fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc7401548c0 0x7fc74006a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:20.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.831+0000 7fc7464fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc7400c6e30 0x7fc7400c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:20.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.831+0000 7fc7464fc700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7400c69a0 con 0x7fc7401544e0 2023-11-30T17:26:20.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.831+0000 7fc7464fc700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7400c13a0 con 0x7fc7400c6e30 2023-11-30T17:26:20.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.831+0000 7fc7464fc700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7400c1680 con 0x7fc7401548c0 2023-11-30T17:26:20.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.831+0000 7fc73ffff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc7401544e0 0x7fc7400c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51204/0 (socket says 172.21.15.49:51204) 2023-11-30T17:26:20.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.831+0000 7fc73ffff700 1 -- 172.21.15.49:0/4261333348 learned_addr learned my addr 172.21.15.49:0/4261333348 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:20.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.831+0000 7fc744a99700 1 --2- 172.21.15.49:0/4261333348 >> v2:172.21.15.49:3300/0 conn(0x7fc7400c6e30 0x7fc7400c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:20.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.832+0000 7fc73f7fe700 1 --2- 172.21.15.49:0/4261333348 >> v2:172.21.15.115:3300/0 conn(0x7fc7401548c0 0x7fc74006a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:20.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.832+0000 7fc744a99700 1 -- 172.21.15.49:0/4261333348 >> v2:172.21.15.115:3300/0 conn(0x7fc7401548c0 msgr2=0x7fc74006a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:20.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.832+0000 7fc744a99700 1 --2- 172.21.15.49:0/4261333348 >> v2:172.21.15.115:3300/0 conn(0x7fc7401548c0 0x7fc74006a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:20.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.832+0000 7fc744a99700 1 -- 172.21.15.49:0/4261333348 >> v1:172.21.15.49:6789/0 conn(0x7fc7401544e0 legacy=0x7fc7400c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:20.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.832+0000 7fc744a99700 1 -- 172.21.15.49:0/4261333348 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7400c6630 con 0x7fc7400c6e30 2023-11-30T17:26:20.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.832+0000 7fc73effd700 1 -- 172.21.15.49:0/4261333348 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1056419027 0 0) 0x7fc7400c69a0 con 0x7fc7401544e0 2023-11-30T17:26:20.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.832+0000 7fc73f7fe700 1 --2- 172.21.15.49:0/4261333348 >> v2:172.21.15.115:3300/0 conn(0x7fc7401548c0 0x7fc74006a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:26:20.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.832+0000 7fc744a99700 1 --2- 172.21.15.49:0/4261333348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7400c6e30 0x7fc7400c72a0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7fc7400c12d0 tx=0x7fc738009780).ready entity=mon.0 client_cookie=a4e47ad194e76b63 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:20.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.832+0000 7fc73effd700 1 -- 172.21.15.49:0/4261333348 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73800e070 con 0x7fc7400c6e30 2023-11-30T17:26:20.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.832+0000 7fc73effd700 1 -- 172.21.15.49:0/4261333348 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73800bc30 con 0x7fc7400c6e30 2023-11-30T17:26:20.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.832+0000 7fc73effd700 1 -- 172.21.15.49:0/4261333348 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc738012410 con 0x7fc7400c6e30 2023-11-30T17:26:20.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.832+0000 7fc7464fc700 1 -- 172.21.15.49:0/4261333348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7400c6e30 msgr2=0x7fc7400c72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:20.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.832+0000 7fc7464fc700 1 --2- 172.21.15.49:0/4261333348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7400c6e30 0x7fc7400c72a0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7fc7400c12d0 tx=0x7fc738009780).stop 2023-11-30T17:26:20.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.832+0000 7fc7464fc700 1 -- 172.21.15.49:0/4261333348 shutdown_connections 2023-11-30T17:26:20.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.832+0000 7fc7464fc700 1 --2- 172.21.15.49:0/4261333348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7400c6e30 0x7fc7400c72a0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:20.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.832+0000 7fc7464fc700 1 --2- 172.21.15.49:0/4261333348 >> v2:172.21.15.115:3300/0 conn(0x7fc7401548c0 0x7fc74006a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:20.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.833+0000 7fc7464fc700 1 -- 172.21.15.49:0/4261333348 >> 172.21.15.49:0/4261333348 conn(0x7fc740085020 msgr2=0x7fc740094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:20.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.833+0000 7fc7464fc700 1 -- 172.21.15.49:0/4261333348 shutdown_connections 2023-11-30T17:26:20.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.833+0000 7fc7464fc700 1 -- 172.21.15.49:0/4261333348 wait complete. 2023-11-30T17:26:20.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.834+0000 7fc7464fc700 1 Processor -- start 2023-11-30T17:26:20.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.834+0000 7fc7464fc700 1 -- start start 2023-11-30T17:26:20.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.835+0000 7fc7464fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7400c6e30 0x7fc74014fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:20.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.835+0000 7fc7464fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7401544e0 0x7fc740152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:20.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.835+0000 7fc7464fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7401548c0 0x7fc740157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:20.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.835+0000 7fc7464fc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc740153480 con 0x7fc7401544e0 2023-11-30T17:26:20.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.835+0000 7fc7464fc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc740152610 con 0x7fc7401548c0 2023-11-30T17:26:20.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.835+0000 7fc7464fc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc740158090 con 0x7fc7400c6e30 2023-11-30T17:26:20.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.835+0000 7fc73f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7401544e0 0x7fc740152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:20.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.835+0000 7fc73f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7401544e0 0x7fc740152120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36612/0 (socket says 172.21.15.49:36612) 2023-11-30T17:26:20.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.835+0000 7fc73f7fe700 1 -- 172.21.15.49:0/277376913 learned_addr learned my addr 172.21.15.49:0/277376913 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:20.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.835+0000 7fc73ffff700 1 --2- 172.21.15.49:0/277376913 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7400c6e30 0x7fc74014fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:20.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.835+0000 7fc744a99700 1 --2- 172.21.15.49:0/277376913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7401548c0 0x7fc740157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:20.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.835+0000 7fc73f7fe700 1 -- 172.21.15.49:0/277376913 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7400c6e30 msgr2=0x7fc74014fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:20.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.835+0000 7fc73f7fe700 1 --2- 172.21.15.49:0/277376913 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7400c6e30 0x7fc74014fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:20.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.835+0000 7fc73f7fe700 1 -- 172.21.15.49:0/277376913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7401548c0 msgr2=0x7fc740157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:20.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.835+0000 7fc73f7fe700 1 --2- 172.21.15.49:0/277376913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7401548c0 0x7fc740157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:20.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.835+0000 7fc73f7fe700 1 -- 172.21.15.49:0/277376913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc738009a20 con 0x7fc7401544e0 2023-11-30T17:26:20.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.835+0000 7fc73ffff700 1 --2- 172.21.15.49:0/277376913 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7400c6e30 0x7fc74014fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:26:20.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.835+0000 7fc744a99700 1 --2- 172.21.15.49:0/277376913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7401548c0 0x7fc740157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:26:20.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.835+0000 7fc73f7fe700 1 --2- 172.21.15.49:0/277376913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7401544e0 0x7fc740152120 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7fc73000c880 tx=0x7fc730008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:20.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.835+0000 7fc737fff700 1 -- 172.21.15.49:0/277376913 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc730010580 con 0x7fc7401544e0 2023-11-30T17:26:20.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.835+0000 7fc737fff700 1 -- 172.21.15.49:0/277376913 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7300106e0 con 0x7fc7401544e0 2023-11-30T17:26:20.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.835+0000 7fc7464fc700 1 -- 172.21.15.49:0/277376913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc740152870 con 0x7fc7401544e0 2023-11-30T17:26:20.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.835+0000 7fc737fff700 1 -- 172.21.15.49:0/277376913 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc730010a60 con 0x7fc7401544e0 2023-11-30T17:26:20.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.835+0000 7fc7464fc700 1 -- 172.21.15.49:0/277376913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc740152e30 con 0x7fc7401544e0 2023-11-30T17:26:20.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.836+0000 7fc7464fc700 1 -- 172.21.15.49:0/277376913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7401535f0 con 0x7fc7401544e0 2023-11-30T17:26:20.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.837+0000 7fc737fff700 1 -- 172.21.15.49:0/277376913 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc73001b460 con 0x7fc7401544e0 2023-11-30T17:26:20.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.837+0000 7fc737fff700 1 --2- 172.21.15.49:0/277376913 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc72005f270 0x7fc720061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:20.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.837+0000 7fc737fff700 1 -- 172.21.15.49:0/277376913 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fc73007a480 con 0x7fc7401544e0 2023-11-30T17:26:20.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.837+0000 7fc73ffff700 1 --2- 172.21.15.49:0/277376913 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc72005f270 0x7fc720061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:20.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.837+0000 7fc73ffff700 1 --2- 172.21.15.49:0/277376913 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc72005f270 0x7fc720061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fc728001680 tx=0x7fc728009040).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:20.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:20.841+0000 7fc737fff700 1 -- 172.21.15.49:0/277376913 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc73004b530 con 0x7fc7401544e0 2023-11-30T17:26:21.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.014+0000 7fc7464fc700 1 -- 172.21.15.49:0/277376913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7400c6250 con 0x7fc7401544e0 2023-11-30T17:26:21.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.015+0000 7fc737fff700 1 -- 172.21.15.49:0/277376913 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+17044 (secure 0 0 0) 0x7fc73004eb50 con 0x7fc7401544e0 2023-11-30T17:26:21.019 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:26:21.019 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":145,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:26:20.357634+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:26:18.350122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-11-30T17:26:19.327933+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:26:21.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.017+0000 7fc7464fc700 1 -- 172.21.15.49:0/277376913 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc72005f270 msgr2=0x7fc720061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:21.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.017+0000 7fc7464fc700 1 --2- 172.21.15.49:0/277376913 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc72005f270 0x7fc720061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fc728001680 tx=0x7fc728009040).stop 2023-11-30T17:26:21.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.017+0000 7fc7464fc700 1 -- 172.21.15.49:0/277376913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7401544e0 msgr2=0x7fc740152120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:21.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.017+0000 7fc7464fc700 1 --2- 172.21.15.49:0/277376913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7401544e0 0x7fc740152120 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7fc73000c880 tx=0x7fc730008040).stop 2023-11-30T17:26:21.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.017+0000 7fc7464fc700 1 -- 172.21.15.49:0/277376913 shutdown_connections 2023-11-30T17:26:21.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.017+0000 7fc7464fc700 1 --2- 172.21.15.49:0/277376913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7401548c0 0x7fc740157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:21.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.017+0000 7fc7464fc700 1 --2- 172.21.15.49:0/277376913 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7400c6e30 0x7fc74014fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:21.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.017+0000 7fc7464fc700 1 --2- 172.21.15.49:0/277376913 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc72005f270 0x7fc720061730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:21.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.017+0000 7fc7464fc700 1 --2- 172.21.15.49:0/277376913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7401544e0 0x7fc740152120 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:21.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.017+0000 7fc7464fc700 1 -- 172.21.15.49:0/277376913 >> 172.21.15.49:0/277376913 conn(0x7fc740085020 msgr2=0x7fc740064630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:21.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.017+0000 7fc7464fc700 1 -- 172.21.15.49:0/277376913 shutdown_connections 2023-11-30T17:26:21.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.017+0000 7fc7464fc700 1 -- 172.21.15.49:0/277376913 wait complete. 2023-11-30T17:26:21.032 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-30T17:26:21.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.151+0000 7f661ca30700 1 Processor -- start 2023-11-30T17:26:21.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.151+0000 7f661ca30700 1 -- start start 2023-11-30T17:26:21.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.152+0000 7f661ca30700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f66180c6190 0x7f66180c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:21.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.152+0000 7f661ca30700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66180c72d0 con 0x7f6618098d10 2023-11-30T17:26:21.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.152+0000 7f661ca30700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6618064570 con 0x7f6618158320 2023-11-30T17:26:21.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.152+0000 7f661ca30700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6618154bc0 con 0x7f66180c6190 2023-11-30T17:26:21.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.152+0000 7f661659c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6618098d10 0x7f6618063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51220/0 (socket says 172.21.15.49:51220) 2023-11-30T17:26:21.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.152+0000 7f661659c700 1 -- 172.21.15.49:0/4022702958 learned_addr learned my addr 172.21.15.49:0/4022702958 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:21.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.152+0000 7f6615d9b700 1 --2- 172.21.15.49:0/4022702958 >> v2:172.21.15.115:3300/0 conn(0x7f66180c6190 0x7f66180c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:21.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.152+0000 7f661559a700 1 -- 172.21.15.49:0/4022702958 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1983883527 0 0) 0x7f66180c72d0 con 0x7f6618098d10 2023-11-30T17:26:21.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.153+0000 7f661559a700 1 -- 172.21.15.49:0/4022702958 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66040033f0 con 0x7f6618098d10 2023-11-30T17:26:21.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.153+0000 7f6615d9b700 1 -- 172.21.15.49:0/4022702958 >> v1:172.21.15.115:6789/0 conn(0x7f6618158320 legacy=0x7f66180a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:21.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.153+0000 7f6615d9b700 1 -- 172.21.15.49:0/4022702958 >> v1:172.21.15.49:6789/0 conn(0x7f6618098d10 legacy=0x7f6618063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:21.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.153+0000 7f661559a700 1 -- 172.21.15.49:0/4022702958 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1736540149 0 0) 0x7f66040033f0 con 0x7f6618098d10 2023-11-30T17:26:21.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.153+0000 7f6615d9b700 1 -- 172.21.15.49:0/4022702958 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66180c66c0 con 0x7f66180c6190 2023-11-30T17:26:21.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.153+0000 7f6615d9b700 1 --2- 172.21.15.49:0/4022702958 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66180c6190 0x7f66180c7760 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f6600009760 tx=0x7f6600009060).ready entity=mon.1 client_cookie=4fa6a0e24a7fc146 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:21.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.153+0000 7f661559a700 1 -- 172.21.15.49:0/4022702958 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6610001470 con 0x7f66180c6190 2023-11-30T17:26:21.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.153+0000 7f661559a700 1 -- 172.21.15.49:0/4022702958 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6600011400 con 0x7f66180c6190 2023-11-30T17:26:21.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.153+0000 7f661559a700 1 -- 172.21.15.49:0/4022702958 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6600011780 con 0x7f66180c6190 2023-11-30T17:26:21.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.154+0000 7f661ca30700 1 -- 172.21.15.49:0/4022702958 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66180c6190 msgr2=0x7f66180c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:21.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.154+0000 7f661ca30700 1 --2- 172.21.15.49:0/4022702958 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66180c6190 0x7f66180c7760 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f6600009760 tx=0x7f6600009060).stop 2023-11-30T17:26:21.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.154+0000 7f661ca30700 1 -- 172.21.15.49:0/4022702958 shutdown_connections 2023-11-30T17:26:21.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.154+0000 7f661ca30700 1 --2- 172.21.15.49:0/4022702958 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66180c6190 0x7f66180c7760 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:21.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.154+0000 7f661ca30700 1 -- 172.21.15.49:0/4022702958 >> 172.21.15.49:0/4022702958 conn(0x7f66180cb310 msgr2=0x7f66180cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:21.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.154+0000 7f661ca30700 1 -- 172.21.15.49:0/4022702958 shutdown_connections 2023-11-30T17:26:21.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.154+0000 7f661ca30700 1 -- 172.21.15.49:0/4022702958 wait complete. 2023-11-30T17:26:21.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.155+0000 7f661ca30700 1 Processor -- start 2023-11-30T17:26:21.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.155+0000 7f661ca30700 1 -- start start 2023-11-30T17:26:21.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.156+0000 7f661ca30700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6618098d10 0x7f66180a9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:21.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.156+0000 7f661ca30700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66180c6190 0x7f66181575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:21.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.156+0000 7f661ca30700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6618158320 0x7f6618150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:21.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.156+0000 7f661ca30700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66180a9660 con 0x7f6618158320 2023-11-30T17:26:21.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.156+0000 7f661ca30700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66181514a0 con 0x7f66180c6190 2023-11-30T17:26:21.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.156+0000 7f661ca30700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66180a9010 con 0x7f6618098d10 2023-11-30T17:26:21.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.156+0000 7f6616d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6618158320 0x7f6618150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:21.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.156+0000 7f6616d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6618158320 0x7f6618150880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36622/0 (socket says 172.21.15.49:36622) 2023-11-30T17:26:21.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.156+0000 7f6616d9d700 1 -- 172.21.15.49:0/1304036579 learned_addr learned my addr 172.21.15.49:0/1304036579 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:21.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.156+0000 7f6615d9b700 1 --2- 172.21.15.49:0/1304036579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66180c6190 0x7f66181575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:21.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.156+0000 7f661659c700 1 --2- 172.21.15.49:0/1304036579 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6618098d10 0x7f66180a9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:21.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.156+0000 7f6616d9d700 1 -- 172.21.15.49:0/1304036579 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6618098d10 msgr2=0x7f66180a9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:21.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.156+0000 7f6616d9d700 1 --2- 172.21.15.49:0/1304036579 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6618098d10 0x7f66180a9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:21.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.156+0000 7f6616d9d700 1 -- 172.21.15.49:0/1304036579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66180c6190 msgr2=0x7f66181575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:21.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.156+0000 7f6616d9d700 1 --2- 172.21.15.49:0/1304036579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66180c6190 0x7f66181575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:21.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.156+0000 7f6616d9d700 1 -- 172.21.15.49:0/1304036579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66000092a0 con 0x7f6618158320 2023-11-30T17:26:21.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.156+0000 7f6616d9d700 1 --2- 172.21.15.49:0/1304036579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6618158320 0x7f6618150880 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7f660800c7c0 tx=0x7f6608001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:21.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.156+0000 7f660e7fc700 1 -- 172.21.15.49:0/1304036579 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660800e4a0 con 0x7f6618158320 2023-11-30T17:26:21.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.156+0000 7f660e7fc700 1 -- 172.21.15.49:0/1304036579 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660800e600 con 0x7f6618158320 2023-11-30T17:26:21.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.156+0000 7f661ca30700 1 -- 172.21.15.49:0/1304036579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66180a92f0 con 0x7f6618158320 2023-11-30T17:26:21.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.156+0000 7f660e7fc700 1 -- 172.21.15.49:0/1304036579 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660800e980 con 0x7f6618158320 2023-11-30T17:26:21.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.156+0000 7f661ca30700 1 -- 172.21.15.49:0/1304036579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6618157ac0 con 0x7f6618158320 2023-11-30T17:26:21.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.157+0000 7f661ca30700 1 -- 172.21.15.49:0/1304036579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f661806c860 con 0x7f6618158320 2023-11-30T17:26:21.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.158+0000 7f660e7fc700 1 -- 172.21.15.49:0/1304036579 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6608012400 con 0x7f6618158320 2023-11-30T17:26:21.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.158+0000 7f660e7fc700 1 --2- 172.21.15.49:0/1304036579 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f65f805f240 0x7f65f8061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:21.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.158+0000 7f660e7fc700 1 -- 172.21.15.49:0/1304036579 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f6608079b10 con 0x7f6618158320 2023-11-30T17:26:21.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.158+0000 7f661659c700 1 --2- 172.21.15.49:0/1304036579 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f65f805f240 0x7f65f8061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:21.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.159+0000 7f661659c700 1 --2- 172.21.15.49:0/1304036579 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f65f805f240 0x7f65f8061700 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f66100016e0 tx=0x7f66100014e0).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:21.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.162+0000 7f660e7fc700 1 -- 172.21.15.49:0/1304036579 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6608048b00 con 0x7f6618158320 2023-11-30T17:26:21.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:21.385+0000 7f661ca30700 1 -- 172.21.15.49:0/1304036579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f66180c69a0 con 0x7f6618158320 2023-11-30T17:26:22.222 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:26:22.225 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:26:22.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.365+0000 7f660e7fc700 1 -- 172.21.15.49:0/1304036579 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v60) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6608017030 con 0x7f6618158320 2023-11-30T17:26:22.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.367+0000 7f661ca30700 1 -- 172.21.15.49:0/1304036579 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f65f805f240 msgr2=0x7f65f8061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:22.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.367+0000 7f661ca30700 1 --2- 172.21.15.49:0/1304036579 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f65f805f240 0x7f65f8061700 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f66100016e0 tx=0x7f66100014e0).stop 2023-11-30T17:26:22.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.367+0000 7f661ca30700 1 -- 172.21.15.49:0/1304036579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6618158320 msgr2=0x7f6618150880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:22.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.367+0000 7f661ca30700 1 --2- 172.21.15.49:0/1304036579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6618158320 0x7f6618150880 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7f660800c7c0 tx=0x7f6608001510).stop 2023-11-30T17:26:22.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.367+0000 7f661ca30700 1 -- 172.21.15.49:0/1304036579 shutdown_connections 2023-11-30T17:26:22.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.367+0000 7f661ca30700 1 --2- 172.21.15.49:0/1304036579 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f65f805f240 0x7f65f8061700 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:22.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.367+0000 7f661ca30700 1 --2- 172.21.15.49:0/1304036579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6618158320 0x7f6618150880 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:22.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.367+0000 7f661ca30700 1 --2- 172.21.15.49:0/1304036579 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6618098d10 0x7f66180a9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:22.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.367+0000 7f661ca30700 1 --2- 172.21.15.49:0/1304036579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66180c6190 0x7f66181575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:22.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.367+0000 7f661ca30700 1 -- 172.21.15.49:0/1304036579 >> 172.21.15.49:0/1304036579 conn(0x7f66180cb310 msgr2=0x7f661814bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:22.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.367+0000 7f661ca30700 1 -- 172.21.15.49:0/1304036579 shutdown_connections 2023-11-30T17:26:22.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.367+0000 7f661ca30700 1 -- 172.21.15.49:0/1304036579 wait complete. 2023-11-30T17:26:22.384 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-30T17:26:22.384 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-30T17:26:22.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.506+0000 7f750660f700 1 Processor -- start 2023-11-30T17:26:22.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.506+0000 7f750660f700 1 -- start start 2023-11-30T17:26:22.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.507+0000 7f750660f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7500158a30 0x7f75000c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:22.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.507+0000 7f750660f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75000c72d0 con 0x7f7500098d10 2023-11-30T17:26:22.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.507+0000 7f750660f700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7500064570 con 0x7f75000c6190 2023-11-30T17:26:22.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.507+0000 7f750660f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7500154bc0 con 0x7f7500158a30 2023-11-30T17:26:22.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.507+0000 7f74fffff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7500098d10 0x7f7500063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51224/0 (socket says 172.21.15.49:51224) 2023-11-30T17:26:22.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.507+0000 7f74fffff700 1 -- 172.21.15.49:0/2486446429 learned_addr learned my addr 172.21.15.49:0/2486446429 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:22.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.507+0000 7f7504bac700 1 --2- 172.21.15.49:0/2486446429 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7500158a30 0x7f75000c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:22.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.507+0000 7f74feffd700 1 -- 172.21.15.49:0/2486446429 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3100782204 0 0) 0x7f75000c72d0 con 0x7f7500098d10 2023-11-30T17:26:22.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.507+0000 7f74feffd700 1 -- 172.21.15.49:0/2486446429 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74e80033f0 con 0x7f7500098d10 2023-11-30T17:26:22.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.507+0000 7f74feffd700 1 -- 172.21.15.49:0/2486446429 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 40831551 0 0) 0x7f7500064570 con 0x7f75000c6190 2023-11-30T17:26:22.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.507+0000 7f74feffd700 1 -- 172.21.15.49:0/2486446429 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75000c72d0 con 0x7f75000c6190 2023-11-30T17:26:22.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.507+0000 7f74feffd700 1 -- 172.21.15.49:0/2486446429 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1221689001 0 0) 0x7f74e80033f0 con 0x7f7500098d10 2023-11-30T17:26:22.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.507+0000 7f7504bac700 1 -- 172.21.15.49:0/2486446429 >> v1:172.21.15.115:6789/0 conn(0x7f75000c6190 legacy=0x7f7500158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:22.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.507+0000 7f7504bac700 1 -- 172.21.15.49:0/2486446429 >> v1:172.21.15.49:6789/0 conn(0x7f7500098d10 legacy=0x7f7500063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:22.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.507+0000 7f7504bac700 1 -- 172.21.15.49:0/2486446429 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75000c66c0 con 0x7f7500158a30 2023-11-30T17:26:22.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.508+0000 7f7504bac700 1 --2- 172.21.15.49:0/2486446429 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7500158a30 0x7f75000c7760 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f74f8009e90 tx=0x7f74f8009780).ready entity=mon.2 client_cookie=32c59d61ccabec4 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:22.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.508+0000 7f74feffd700 1 -- 172.21.15.49:0/2486446429 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f800e070 con 0x7f7500158a30 2023-11-30T17:26:22.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.508+0000 7f74feffd700 1 -- 172.21.15.49:0/2486446429 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f800b7a0 con 0x7f7500158a30 2023-11-30T17:26:22.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.508+0000 7f74feffd700 1 -- 172.21.15.49:0/2486446429 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f0001470 con 0x7f7500158a30 2023-11-30T17:26:22.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.508+0000 7f750660f700 1 -- 172.21.15.49:0/2486446429 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7500158a30 msgr2=0x7f75000c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:22.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.508+0000 7f750660f700 1 --2- 172.21.15.49:0/2486446429 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7500158a30 0x7f75000c7760 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f74f8009e90 tx=0x7f74f8009780).stop 2023-11-30T17:26:22.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.508+0000 7f750660f700 1 -- 172.21.15.49:0/2486446429 shutdown_connections 2023-11-30T17:26:22.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.508+0000 7f750660f700 1 --2- 172.21.15.49:0/2486446429 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7500158a30 0x7f75000c7760 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:22.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.508+0000 7f750660f700 1 -- 172.21.15.49:0/2486446429 >> 172.21.15.49:0/2486446429 conn(0x7f75000cb310 msgr2=0x7f75000cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:22.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.508+0000 7f750660f700 1 -- 172.21.15.49:0/2486446429 shutdown_connections 2023-11-30T17:26:22.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.508+0000 7f750660f700 1 -- 172.21.15.49:0/2486446429 wait complete. 2023-11-30T17:26:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.509+0000 7f750660f700 1 Processor -- start 2023-11-30T17:26:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.510+0000 7f750660f700 1 -- start start 2023-11-30T17:26:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.510+0000 7f750660f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7500098d10 0x7f75000c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.510+0000 7f750660f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75000c6190 0x7f75000b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.510+0000 7f750660f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7500158a30 0x7f75000c23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.510+0000 7f750660f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7500154d90 con 0x7f75000c6190 2023-11-30T17:26:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.510+0000 7f750660f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75000b0940 con 0x7f7500098d10 2023-11-30T17:26:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.510+0000 7f750660f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75000b0c20 con 0x7f7500158a30 2023-11-30T17:26:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.510+0000 7f74ff7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75000c6190 0x7f75000b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.510+0000 7f74ff7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75000c6190 0x7f75000b00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36632/0 (socket says 172.21.15.49:36632) 2023-11-30T17:26:22.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.510+0000 7f74ff7fe700 1 -- 172.21.15.49:0/3899825054 learned_addr learned my addr 172.21.15.49:0/3899825054 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:22.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.511+0000 7f74fffff700 1 --2- 172.21.15.49:0/3899825054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7500098d10 0x7f75000c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:22.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.511+0000 7f7504bac700 1 --2- 172.21.15.49:0/3899825054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7500158a30 0x7f75000c23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:22.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.511+0000 7f74ff7fe700 1 -- 172.21.15.49:0/3899825054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7500158a30 msgr2=0x7f75000c23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:22.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.511+0000 7f74ff7fe700 1 --2- 172.21.15.49:0/3899825054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7500158a30 0x7f75000c23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:22.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.511+0000 7f74ff7fe700 1 -- 172.21.15.49:0/3899825054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7500098d10 msgr2=0x7f75000c39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:22.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.511+0000 7f74ff7fe700 1 --2- 172.21.15.49:0/3899825054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7500098d10 0x7f75000c39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:22.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.511+0000 7f74ff7fe700 1 -- 172.21.15.49:0/3899825054 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f8009a20 con 0x7f75000c6190 2023-11-30T17:26:22.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.511+0000 7f7504bac700 1 --2- 172.21.15.49:0/3899825054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7500158a30 0x7f75000c23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:26:22.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.511+0000 7f74ff7fe700 1 --2- 172.21.15.49:0/3899825054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75000c6190 0x7f75000b00f0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f74f400c4c0 tx=0x7f74f4007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:22.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.511+0000 7f74e7fff700 1 -- 172.21.15.49:0/3899825054 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f400f470 con 0x7f75000c6190 2023-11-30T17:26:22.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.511+0000 7f74e7fff700 1 -- 172.21.15.49:0/3899825054 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f400f5d0 con 0x7f75000c6190 2023-11-30T17:26:22.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.511+0000 7f74e7fff700 1 -- 172.21.15.49:0/3899825054 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f400f970 con 0x7f75000c6190 2023-11-30T17:26:22.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.511+0000 7f750660f700 1 -- 172.21.15.49:0/3899825054 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75000b0f00 con 0x7f75000c6190 2023-11-30T17:26:22.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.511+0000 7f750660f700 1 -- 172.21.15.49:0/3899825054 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75000b05e0 con 0x7f75000c6190 2023-11-30T17:26:22.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.512+0000 7f750660f700 1 -- 172.21.15.49:0/3899825054 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f750006c860 con 0x7f75000c6190 2023-11-30T17:26:22.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.512+0000 7f74e7fff700 1 -- 172.21.15.49:0/3899825054 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f74f400fd20 con 0x7f75000c6190 2023-11-30T17:26:22.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.513+0000 7f74e7fff700 1 --2- 172.21.15.49:0/3899825054 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f74ec05f240 0x7f74ec061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:22.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.513+0000 7f74e7fff700 1 -- 172.21.15.49:0/3899825054 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f74f4079950 con 0x7f75000c6190 2023-11-30T17:26:22.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.513+0000 7f74fffff700 1 --2- 172.21.15.49:0/3899825054 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f74ec05f240 0x7f74ec061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:22.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.513+0000 7f74fffff700 1 --2- 172.21.15.49:0/3899825054 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f74ec05f240 0x7f74ec061700 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f74f0001660 tx=0x7f74f0001990).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:22.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.517+0000 7f74e7fff700 1 -- 172.21.15.49:0/3899825054 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f74f404aa00 con 0x7f75000c6190 2023-11-30T17:26:22.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:22.735+0000 7f750660f700 1 -- 172.21.15.49:0/3899825054 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f75000c69a0 con 0x7f75000c6190 2023-11-30T17:26:23.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.366+0000 7f74e7fff700 1 -- 172.21.15.49:0/3899825054 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v61) v1 ==== 122+0+0 (secure 0 0 0) 0x7f74f404e020 con 0x7f75000c6190 2023-11-30T17:26:23.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.368+0000 7f750660f700 1 -- 172.21.15.49:0/3899825054 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f74ec05f240 msgr2=0x7f74ec061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:23.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.368+0000 7f750660f700 1 --2- 172.21.15.49:0/3899825054 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f74ec05f240 0x7f74ec061700 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f74f0001660 tx=0x7f74f0001990).stop 2023-11-30T17:26:23.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.368+0000 7f750660f700 1 -- 172.21.15.49:0/3899825054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75000c6190 msgr2=0x7f75000b00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:23.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.368+0000 7f750660f700 1 --2- 172.21.15.49:0/3899825054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75000c6190 0x7f75000b00f0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f74f400c4c0 tx=0x7f74f4007c20).stop 2023-11-30T17:26:23.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.368+0000 7f750660f700 1 -- 172.21.15.49:0/3899825054 shutdown_connections 2023-11-30T17:26:23.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.368+0000 7f750660f700 1 --2- 172.21.15.49:0/3899825054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7500158a30 0x7f75000c23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:23.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.368+0000 7f750660f700 1 --2- 172.21.15.49:0/3899825054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7500098d10 0x7f75000c39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:23.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.368+0000 7f750660f700 1 --2- 172.21.15.49:0/3899825054 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f74ec05f240 0x7f74ec061700 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:23.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.368+0000 7f750660f700 1 --2- 172.21.15.49:0/3899825054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75000c6190 0x7f75000b00f0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:23.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.368+0000 7f750660f700 1 -- 172.21.15.49:0/3899825054 >> 172.21.15.49:0/3899825054 conn(0x7f75000cb310 msgr2=0x7f7500063990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:23.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.368+0000 7f750660f700 1 -- 172.21.15.49:0/3899825054 shutdown_connections 2023-11-30T17:26:23.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.368+0000 7f750660f700 1 -- 172.21.15.49:0/3899825054 wait complete. 2023-11-30T17:26:23.385 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-30T17:26:23.385 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:26:23.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.506+0000 7f4c66f98700 1 Processor -- start 2023-11-30T17:26:23.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.506+0000 7f4c66f98700 1 -- start start 2023-11-30T17:26:23.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.506+0000 7f4c66f98700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4c60065f30 0x7f4c60066310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:23.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.506+0000 7f4c66f98700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c600bd650 0x7f4c600c14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:23.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.506+0000 7f4c66f98700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c60151740 con 0x7f4c60152450 2023-11-30T17:26:23.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.506+0000 7f4c66f98700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c600c2470 con 0x7f4c60065f30 2023-11-30T17:26:23.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.506+0000 7f4c66f98700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c60066800 con 0x7f4c600bd650 2023-11-30T17:26:23.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.507+0000 7f4c5ffff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4c60152450 0x7f4c600bcf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51230/0 (socket says 172.21.15.49:51230) 2023-11-30T17:26:23.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.507+0000 7f4c5ffff700 1 -- 172.21.15.49:0/3601485039 learned_addr learned my addr 172.21.15.49:0/3601485039 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:23.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.507+0000 7f4c64d34700 1 --2- 172.21.15.49:0/3601485039 >> v2:172.21.15.115:3300/0 conn(0x7f4c60065f30 0x7f4c60066310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:23.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.507+0000 7f4c65535700 1 --2- 172.21.15.49:0/3601485039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c600bd650 0x7f4c600c14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:23.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.507+0000 7f4c5f7fe700 1 -- 172.21.15.49:0/3601485039 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1577954004 0 0) 0x7f4c60151740 con 0x7f4c60152450 2023-11-30T17:26:23.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.507+0000 7f4c5f7fe700 1 -- 172.21.15.49:0/3601485039 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c4c0033f0 con 0x7f4c60152450 2023-11-30T17:26:23.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.507+0000 7f4c5f7fe700 1 -- 172.21.15.49:0/3601485039 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1385602274 0 0) 0x7f4c4c0033f0 con 0x7f4c60152450 2023-11-30T17:26:23.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.507+0000 7f4c5f7fe700 1 -- 172.21.15.49:0/3601485039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c600bd650 msgr2=0x7f4c600c14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:23.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.507+0000 7f4c5f7fe700 1 --2- 172.21.15.49:0/3601485039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c600bd650 0x7f4c600c14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:23.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.507+0000 7f4c5f7fe700 1 -- 172.21.15.49:0/3601485039 >> v2:172.21.15.115:3300/0 conn(0x7f4c60065f30 msgr2=0x7f4c60066310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:23.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.507+0000 7f4c5f7fe700 1 --2- 172.21.15.49:0/3601485039 >> v2:172.21.15.115:3300/0 conn(0x7f4c60065f30 0x7f4c60066310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:23.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.507+0000 7f4c5f7fe700 1 -- 172.21.15.49:0/3601485039 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c600c2190 con 0x7f4c60152450 2023-11-30T17:26:23.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.507+0000 7f4c5f7fe700 1 -- 172.21.15.49:0/3601485039 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f4c50001470 con 0x7f4c60152450 2023-11-30T17:26:23.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.507+0000 7f4c5f7fe700 1 -- 172.21.15.49:0/3601485039 >> v1:172.21.15.49:6789/0 conn(0x7f4c60152450 legacy=0x7f4c600bcf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:23.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.507+0000 7f4c5f7fe700 1 --2- 172.21.15.49:0/3601485039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c4c0038e0 0x7f4c4c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:23.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.507+0000 7f4c5f7fe700 1 --2- 172.21.15.49:0/3601485039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c600bd650 0x7f4c4c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:23.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.507+0000 7f4c5f7fe700 1 --2- 172.21.15.49:0/3601485039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c4c004b80 0x7f4c4c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:23.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.507+0000 7f4c5f7fe700 1 -- 172.21.15.49:0/3601485039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c600c2470 con 0x7f4c4c004b80 2023-11-30T17:26:23.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.507+0000 7f4c5f7fe700 1 -- 172.21.15.49:0/3601485039 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c60066800 con 0x7f4c4c0038e0 2023-11-30T17:26:23.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.507+0000 7f4c5f7fe700 1 -- 172.21.15.49:0/3601485039 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c00b8e0 con 0x7f4c600bd650 2023-11-30T17:26:23.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.507+0000 7f4c64d34700 1 --2- 172.21.15.49:0/3601485039 >> v2:172.21.15.115:3300/0 conn(0x7f4c60065f30 0x7f4c60066310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:26:23.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.507+0000 7f4c65535700 1 --2- 172.21.15.49:0/3601485039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c4c004b80 0x7f4c4c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:23.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.508+0000 7f4c5ffff700 1 --2- 172.21.15.49:0/3601485039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c600bd650 0x7f4c4c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:23.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.508+0000 7f4c64d34700 1 --2- 172.21.15.49:0/3601485039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c4c0038e0 0x7f4c4c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:23.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.508+0000 7f4c65535700 1 -- 172.21.15.49:0/3601485039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c600bd650 msgr2=0x7f4c4c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:23.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.508+0000 7f4c65535700 1 --2- 172.21.15.49:0/3601485039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c600bd650 0x7f4c4c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:23.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.508+0000 7f4c65535700 1 -- 172.21.15.49:0/3601485039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c4c0038e0 msgr2=0x7f4c4c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:23.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.508+0000 7f4c65535700 1 --2- 172.21.15.49:0/3601485039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c4c0038e0 0x7f4c4c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:23.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.508+0000 7f4c65535700 1 -- 172.21.15.49:0/3601485039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4c0033f0 con 0x7f4c4c004b80 2023-11-30T17:26:23.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.508+0000 7f4c64d34700 1 --2- 172.21.15.49:0/3601485039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c4c0038e0 0x7f4c4c003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:26:23.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.508+0000 7f4c65535700 1 --2- 172.21.15.49:0/3601485039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c4c004b80 0x7f4c4c005000 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f4c48009a60 tx=0x7f4c48009060).ready entity=mon.0 client_cookie=3ffe8b46c0da5c77 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:23.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.508+0000 7f4c5f7fe700 1 -- 172.21.15.49:0/3601485039 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c48009ea0 con 0x7f4c4c004b80 2023-11-30T17:26:23.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.508+0000 7f4c5f7fe700 1 -- 172.21.15.49:0/3601485039 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c48009430 con 0x7f4c4c004b80 2023-11-30T17:26:23.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.508+0000 7f4c5f7fe700 1 -- 172.21.15.49:0/3601485039 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4800e870 con 0x7f4c4c004b80 2023-11-30T17:26:23.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.508+0000 7f4c66f98700 1 -- 172.21.15.49:0/3601485039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c4c004b80 msgr2=0x7f4c4c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:23.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.508+0000 7f4c66f98700 1 --2- 172.21.15.49:0/3601485039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c4c004b80 0x7f4c4c005000 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f4c48009a60 tx=0x7f4c48009060).stop 2023-11-30T17:26:23.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.508+0000 7f4c65535700 1 -- 172.21.15.49:0/3601485039 reap_dead start 2023-11-30T17:26:23.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.508+0000 7f4c66f98700 1 -- 172.21.15.49:0/3601485039 shutdown_connections 2023-11-30T17:26:23.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.509+0000 7f4c66f98700 1 -- 172.21.15.49:0/3601485039 >> 172.21.15.49:0/3601485039 conn(0x7f4c600631d0 msgr2=0x7f4c600c6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:23.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.509+0000 7f4c66f98700 1 -- 172.21.15.49:0/3601485039 shutdown_connections 2023-11-30T17:26:23.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.509+0000 7f4c66f98700 1 -- 172.21.15.49:0/3601485039 wait complete. 2023-11-30T17:26:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.510+0000 7f4c66f98700 1 Processor -- start 2023-11-30T17:26:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.510+0000 7f4c66f98700 1 -- start start 2023-11-30T17:26:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.511+0000 7f4c66f98700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c4c004b80 0x7f4c6014dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.511+0000 7f4c66f98700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c600a5d40 0x7f4c600a61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:23.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.511+0000 7f4c66f98700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c600a69b0 0x7f4c600a6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:23.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.511+0000 7f4c66f98700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6014cb00 con 0x7f4c600a69b0 2023-11-30T17:26:23.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.511+0000 7f4c66f98700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6014cde0 con 0x7f4c600a5d40 2023-11-30T17:26:23.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.511+0000 7f4c66f98700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6014d0c0 con 0x7f4c4c004b80 2023-11-30T17:26:23.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.511+0000 7f4c65535700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c600a69b0 0x7f4c600a6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:23.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.511+0000 7f4c65535700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c600a69b0 0x7f4c600a6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36640/0 (socket says 172.21.15.49:36640) 2023-11-30T17:26:23.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.511+0000 7f4c65535700 1 -- 172.21.15.49:0/15828774 learned_addr learned my addr 172.21.15.49:0/15828774 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:23.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.511+0000 7f4c64d34700 1 --2- 172.21.15.49:0/15828774 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c4c004b80 0x7f4c6014dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:23.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.511+0000 7f4c5ffff700 1 --2- 172.21.15.49:0/15828774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c600a5d40 0x7f4c600a61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:23.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.511+0000 7f4c65535700 1 -- 172.21.15.49:0/15828774 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c4c004b80 msgr2=0x7f4c6014dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:23.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.511+0000 7f4c65535700 1 --2- 172.21.15.49:0/15828774 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c4c004b80 0x7f4c6014dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:23.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.511+0000 7f4c65535700 1 -- 172.21.15.49:0/15828774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c600a5d40 msgr2=0x7f4c600a61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:23.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.511+0000 7f4c65535700 1 --2- 172.21.15.49:0/15828774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c600a5d40 0x7f4c600a61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:23.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.511+0000 7f4c65535700 1 -- 172.21.15.49:0/15828774 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c6014d3a0 con 0x7f4c600a69b0 2023-11-30T17:26:23.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.511+0000 7f4c65535700 1 --2- 172.21.15.49:0/15828774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c600a69b0 0x7f4c600a6e10 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7f4c4c0044c0 tx=0x7f4c4801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.511+0000 7f4c5cff9700 1 -- 172.21.15.49:0/15828774 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4800eee0 con 0x7f4c600a69b0 2023-11-30T17:26:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.511+0000 7f4c5cff9700 1 -- 172.21.15.49:0/15828774 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4801c640 con 0x7f4c600a69b0 2023-11-30T17:26:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.511+0000 7f4c66f98700 1 -- 172.21.15.49:0/15828774 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c6014d680 con 0x7f4c600a69b0 2023-11-30T17:26:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.511+0000 7f4c5cff9700 1 -- 172.21.15.49:0/15828774 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4801ca00 con 0x7f4c600a69b0 2023-11-30T17:26:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.511+0000 7f4c66f98700 1 -- 172.21.15.49:0/15828774 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c6014c720 con 0x7f4c600a69b0 2023-11-30T17:26:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.512+0000 7f4c66f98700 1 -- 172.21.15.49:0/15828774 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c6014d870 con 0x7f4c600a69b0 2023-11-30T17:26:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.513+0000 7f4c5cff9700 1 -- 172.21.15.49:0/15828774 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4c480123f0 con 0x7f4c600a69b0 2023-11-30T17:26:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.513+0000 7f4c5cff9700 1 --2- 172.21.15.49:0/15828774 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4c4005f270 0x7f4c40061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.513+0000 7f4c5cff9700 1 -- 172.21.15.49:0/15828774 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f4c4807ac90 con 0x7f4c600a69b0 2023-11-30T17:26:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.513+0000 7f4c64d34700 1 --2- 172.21.15.49:0/15828774 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4c4005f270 0x7f4c40061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.514+0000 7f4c64d34700 1 --2- 172.21.15.49:0/15828774 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4c4005f270 0x7f4c40061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f4c58009fd0 tx=0x7f4c5800b040).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:23.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.517+0000 7f4c5cff9700 1 -- 172.21.15.49:0/15828774 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4c4804bd40 con 0x7f4c600a69b0 2023-11-30T17:26:23.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.735+0000 7f4c66f98700 1 -- 172.21.15.49:0/15828774 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c6006c860 con 0x7f4c600a69b0 2023-11-30T17:26:23.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.735+0000 7f4c5cff9700 1 -- 172.21.15.49:0/15828774 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f4c48016070 con 0x7f4c600a69b0 2023-11-30T17:26:23.738 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:26:23.738 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":61,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6851,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/4266183168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":4266183168},{"type":"v1","addr":"172.21.15.49:6835","nonce":4266183168}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":7810,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1044019551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1044019551},{"type":"v1","addr":"172.21.15.115:6836","nonce":1044019551}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":7813,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/676160579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":676160579},{"type":"v1","addr":"172.21.15.115:6837","nonce":676160579}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:26:20.358070+0000","modified":"2023-11-30T17:26:23.364931+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8085":{"gid":8085,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/2798044365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2798044365},{"type":"v1","addr":"172.21.15.49:6834","nonce":2798044365}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-11-30T17:26:23.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.737+0000 7f4c66f98700 1 -- 172.21.15.49:0/15828774 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4c4005f270 msgr2=0x7f4c40061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:23.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.737+0000 7f4c66f98700 1 --2- 172.21.15.49:0/15828774 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4c4005f270 0x7f4c40061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f4c58009fd0 tx=0x7f4c5800b040).stop 2023-11-30T17:26:23.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.737+0000 7f4c66f98700 1 -- 172.21.15.49:0/15828774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c600a69b0 msgr2=0x7f4c600a6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:23.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.737+0000 7f4c66f98700 1 --2- 172.21.15.49:0/15828774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c600a69b0 0x7f4c600a6e10 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7f4c4c0044c0 tx=0x7f4c4801a000).stop 2023-11-30T17:26:23.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.737+0000 7f4c66f98700 1 -- 172.21.15.49:0/15828774 shutdown_connections 2023-11-30T17:26:23.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.737+0000 7f4c66f98700 1 --2- 172.21.15.49:0/15828774 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4c4005f270 0x7f4c40061730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:23.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.737+0000 7f4c66f98700 1 --2- 172.21.15.49:0/15828774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c600a69b0 0x7f4c600a6e10 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:23.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.737+0000 7f4c66f98700 1 --2- 172.21.15.49:0/15828774 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c4c004b80 0x7f4c6014dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:23.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.737+0000 7f4c66f98700 1 --2- 172.21.15.49:0/15828774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c600a5d40 0x7f4c600a61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:23.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.737+0000 7f4c66f98700 1 -- 172.21.15.49:0/15828774 >> 172.21.15.49:0/15828774 conn(0x7f4c600631d0 msgr2=0x7f4c60152d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:23.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.737+0000 7f4c66f98700 1 -- 172.21.15.49:0/15828774 shutdown_connections 2023-11-30T17:26:23.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.737+0000 7f4c66f98700 1 -- 172.21.15.49:0/15828774 wait complete. 2023-11-30T17:26:23.741 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 61 2023-11-30T17:26:23.751 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T17:26:23.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.866+0000 7f06f5d7e700 1 Processor -- start 2023-11-30T17:26:23.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.866+0000 7f06f5d7e700 1 -- start start 2023-11-30T17:26:23.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.867+0000 7f06f5d7e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06f01544e0 0x7f06f01548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:23.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.867+0000 7f06f5d7e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f06f006a610 0x7f06f00c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:23.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.867+0000 7f06f5d7e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f06f00c6e30 0x7f06f00c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:23.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.867+0000 7f06f5d7e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f00c69a0 con 0x7f06f006a610 2023-11-30T17:26:23.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.867+0000 7f06f5d7e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f00c13a0 con 0x7f06f00c6e30 2023-11-30T17:26:23.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.867+0000 7f06f5d7e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f00c1680 con 0x7f06f01544e0 2023-11-30T17:26:23.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.867+0000 7f06eeffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f06f006a610 0x7f06f00c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:23.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.867+0000 7f06eeffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f06f006a610 0x7f06f00c0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36642/0 (socket says 172.21.15.49:36642) 2023-11-30T17:26:23.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.867+0000 7f06eeffd700 1 -- 172.21.15.49:0/782084495 learned_addr learned my addr 172.21.15.49:0/782084495 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:23.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.867+0000 7f06effff700 1 --2- 172.21.15.49:0/782084495 >> v2:172.21.15.115:3300/0 conn(0x7f06f00c6e30 0x7f06f00c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:23.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.867+0000 7f06ef7fe700 1 --2- 172.21.15.49:0/782084495 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06f01544e0 0x7f06f01548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:23.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.867+0000 7f06eeffd700 1 -- 172.21.15.49:0/782084495 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06f01544e0 msgr2=0x7f06f01548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:23.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.867+0000 7f06eeffd700 1 --2- 172.21.15.49:0/782084495 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06f01544e0 0x7f06f01548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:23.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.867+0000 7f06eeffd700 1 -- 172.21.15.49:0/782084495 >> v2:172.21.15.115:3300/0 conn(0x7f06f00c6e30 msgr2=0x7f06f00c72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:23.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.867+0000 7f06eeffd700 1 --2- 172.21.15.49:0/782084495 >> v2:172.21.15.115:3300/0 conn(0x7f06f00c6e30 0x7f06f00c72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:23.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.867+0000 7f06eeffd700 1 -- 172.21.15.49:0/782084495 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f00c6630 con 0x7f06f006a610 2023-11-30T17:26:23.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.867+0000 7f06effff700 1 --2- 172.21.15.49:0/782084495 >> v2:172.21.15.115:3300/0 conn(0x7f06f00c6e30 0x7f06f00c72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:26:23.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.867+0000 7f06eeffd700 1 --2- 172.21.15.49:0/782084495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06f006a610 0x7f06f00c0bc0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7f06f00c8f30 tx=0x7f06e40090f0).ready entity=mon.0 client_cookie=281705d3dea3960e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:23.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.868+0000 7f06ee7fc700 1 -- 172.21.15.49:0/782084495 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e400b600 con 0x7f06f006a610 2023-11-30T17:26:23.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.868+0000 7f06ee7fc700 1 -- 172.21.15.49:0/782084495 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e400b760 con 0x7f06f006a610 2023-11-30T17:26:23.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.868+0000 7f06ee7fc700 1 -- 172.21.15.49:0/782084495 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e400bae0 con 0x7f06f006a610 2023-11-30T17:26:23.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.868+0000 7f06f5d7e700 1 -- 172.21.15.49:0/782084495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06f006a610 msgr2=0x7f06f00c0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:23.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.868+0000 7f06f5d7e700 1 --2- 172.21.15.49:0/782084495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06f006a610 0x7f06f00c0bc0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7f06f00c8f30 tx=0x7f06e40090f0).stop 2023-11-30T17:26:23.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.868+0000 7f06f5d7e700 1 -- 172.21.15.49:0/782084495 shutdown_connections 2023-11-30T17:26:23.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.868+0000 7f06f5d7e700 1 --2- 172.21.15.49:0/782084495 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06f01544e0 0x7f06f01548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:23.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.868+0000 7f06f5d7e700 1 --2- 172.21.15.49:0/782084495 >> v2:172.21.15.115:3300/0 conn(0x7f06f00c6e30 0x7f06f00c72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:23.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.868+0000 7f06f5d7e700 1 --2- 172.21.15.49:0/782084495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06f006a610 0x7f06f00c0bc0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:23.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.868+0000 7f06f5d7e700 1 -- 172.21.15.49:0/782084495 >> 172.21.15.49:0/782084495 conn(0x7f06f0085020 msgr2=0x7f06f0094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:23.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.868+0000 7f06f5d7e700 1 -- 172.21.15.49:0/782084495 shutdown_connections 2023-11-30T17:26:23.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.868+0000 7f06f5d7e700 1 -- 172.21.15.49:0/782084495 wait complete. 2023-11-30T17:26:23.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.869+0000 7f06f5d7e700 1 Processor -- start 2023-11-30T17:26:23.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.870+0000 7f06f5d7e700 1 -- start start 2023-11-30T17:26:23.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.870+0000 7f06f5d7e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06f006a610 0x7f06f0153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:23.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.870+0000 7f06f5d7e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06f00c6e30 0x7f06f01682f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:23.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.870+0000 7f06f5d7e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06f01544e0 0x7f06f0146ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:23.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.870+0000 7f06f5d7e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f0097770 con 0x7f06f006a610 2023-11-30T17:26:23.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.870+0000 7f06f5d7e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f00aaee0 con 0x7f06f00c6e30 2023-11-30T17:26:23.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.870+0000 7f06f5d7e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f0168ad0 con 0x7f06f01544e0 2023-11-30T17:26:23.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.870+0000 7f06ef7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06f006a610 0x7f06f0153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:23.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.870+0000 7f06ef7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06f006a610 0x7f06f0153280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36646/0 (socket says 172.21.15.49:36646) 2023-11-30T17:26:23.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.870+0000 7f06ef7fe700 1 -- 172.21.15.49:0/2780095654 learned_addr learned my addr 172.21.15.49:0/2780095654 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:23.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.871+0000 7f06effff700 1 --2- 172.21.15.49:0/2780095654 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06f01544e0 0x7f06f0146ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:23.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.871+0000 7f06eeffd700 1 --2- 172.21.15.49:0/2780095654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06f00c6e30 0x7f06f01682f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:23.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.871+0000 7f06ef7fe700 1 -- 172.21.15.49:0/2780095654 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06f01544e0 msgr2=0x7f06f0146ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:23.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.871+0000 7f06ef7fe700 1 --2- 172.21.15.49:0/2780095654 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06f01544e0 0x7f06f0146ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:23.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.871+0000 7f06ef7fe700 1 -- 172.21.15.49:0/2780095654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06f00c6e30 msgr2=0x7f06f01682f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:23.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.871+0000 7f06ef7fe700 1 --2- 172.21.15.49:0/2780095654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06f00c6e30 0x7f06f01682f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:23.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.871+0000 7f06ef7fe700 1 -- 172.21.15.49:0/2780095654 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e4009370 con 0x7f06f006a610 2023-11-30T17:26:23.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.871+0000 7f06eeffd700 1 --2- 172.21.15.49:0/2780095654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06f00c6e30 0x7f06f01682f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:26:23.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.871+0000 7f06ef7fe700 1 --2- 172.21.15.49:0/2780095654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06f006a610 0x7f06f0153280 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7f06e000d680 tx=0x7f06e0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:23.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.871+0000 7f06d77fe700 1 -- 172.21.15.49:0/2780095654 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e0011590 con 0x7f06f006a610 2023-11-30T17:26:23.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.871+0000 7f06d77fe700 1 -- 172.21.15.49:0/2780095654 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e00116f0 con 0x7f06f006a610 2023-11-30T17:26:23.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.871+0000 7f06d77fe700 1 -- 172.21.15.49:0/2780095654 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e0011a70 con 0x7f06f006a610 2023-11-30T17:26:23.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.871+0000 7f06f5d7e700 1 -- 172.21.15.49:0/2780095654 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f0168db0 con 0x7f06f006a610 2023-11-30T17:26:23.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.871+0000 7f06f5d7e700 1 -- 172.21.15.49:0/2780095654 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f00979c0 con 0x7f06f006a610 2023-11-30T17:26:23.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.872+0000 7f06f5d7e700 1 -- 172.21.15.49:0/2780095654 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06f006c860 con 0x7f06f006a610 2023-11-30T17:26:23.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.873+0000 7f06d77fe700 1 -- 172.21.15.49:0/2780095654 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f06e001c460 con 0x7f06f006a610 2023-11-30T17:26:23.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.873+0000 7f06d77fe700 1 --2- 172.21.15.49:0/2780095654 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f06dc05f270 0x7f06dc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:23.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.873+0000 7f06d77fe700 1 -- 172.21.15.49:0/2780095654 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f06e007a470 con 0x7f06f006a610 2023-11-30T17:26:23.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.873+0000 7f06eeffd700 1 --2- 172.21.15.49:0/2780095654 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f06dc05f270 0x7f06dc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:23.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.873+0000 7f06eeffd700 1 --2- 172.21.15.49:0/2780095654 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f06dc05f270 0x7f06dc061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f06f00c8f30 tx=0x7f06e4017000).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:23.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:23.877+0000 7f06d77fe700 1 -- 172.21.15.49:0/2780095654 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f06e004b520 con 0x7f06f006a610 2023-11-30T17:26:24.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.050+0000 7f06f5d7e700 1 -- 172.21.15.49:0/2780095654 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06f00c10b0 con 0x7f06f006a610 2023-11-30T17:26:24.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.051+0000 7f06d77fe700 1 -- 172.21.15.49:0/2780095654 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+17031 (secure 0 0 0) 0x7f06e004eb40 con 0x7f06f006a610 2023-11-30T17:26:24.053 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:26:24.053 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":146,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T17:26:21.359723+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:26:18.350122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-11-30T17:26:19.327933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T17:26:24.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.053+0000 7f06f5d7e700 1 -- 172.21.15.49:0/2780095654 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f06dc05f270 msgr2=0x7f06dc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:24.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.053+0000 7f06f5d7e700 1 --2- 172.21.15.49:0/2780095654 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f06dc05f270 0x7f06dc061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f06f00c8f30 tx=0x7f06e4017000).stop 2023-11-30T17:26:24.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.053+0000 7f06f5d7e700 1 -- 172.21.15.49:0/2780095654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06f006a610 msgr2=0x7f06f0153280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:24.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.053+0000 7f06f5d7e700 1 --2- 172.21.15.49:0/2780095654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06f006a610 0x7f06f0153280 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7f06e000d680 tx=0x7f06e0008040).stop 2023-11-30T17:26:24.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.053+0000 7f06f5d7e700 1 -- 172.21.15.49:0/2780095654 shutdown_connections 2023-11-30T17:26:24.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.053+0000 7f06f5d7e700 1 --2- 172.21.15.49:0/2780095654 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06f01544e0 0x7f06f0146ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:24.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.053+0000 7f06f5d7e700 1 --2- 172.21.15.49:0/2780095654 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f06dc05f270 0x7f06dc061730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:24.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.053+0000 7f06f5d7e700 1 --2- 172.21.15.49:0/2780095654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06f006a610 0x7f06f0153280 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:24.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.053+0000 7f06f5d7e700 1 --2- 172.21.15.49:0/2780095654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06f00c6e30 0x7f06f01682f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:24.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.053+0000 7f06f5d7e700 1 -- 172.21.15.49:0/2780095654 >> 172.21.15.49:0/2780095654 conn(0x7f06f0085020 msgr2=0x7f06f00ae440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:24.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.053+0000 7f06f5d7e700 1 -- 172.21.15.49:0/2780095654 shutdown_connections 2023-11-30T17:26:24.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.053+0000 7f06f5d7e700 1 -- 172.21.15.49:0/2780095654 wait complete. 2023-11-30T17:26:24.068 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-30T17:26:24.068 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:26:24.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.184+0000 7f95df1ee700 1 Processor -- start 2023-11-30T17:26:24.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.184+0000 7f95df1ee700 1 -- start start 2023-11-30T17:26:24.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.185+0000 7f95df1ee700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95d80caab0 0x7f95d80aa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:24.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.185+0000 7f95df1ee700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f95d80ca180 0x7f95d815e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:24.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.185+0000 7f95df1ee700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95d80a9a90 con 0x7f95d80cae90 2023-11-30T17:26:24.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.185+0000 7f95df1ee700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95d8154ce0 con 0x7f95d80ca180 2023-11-30T17:26:24.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.185+0000 7f95df1ee700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d80a8e80 con 0x7f95d80caab0 2023-11-30T17:26:24.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.185+0000 7f95dd78b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f95d80ca180 0x7f95d815e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:24.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.185+0000 7f95dd78b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f95d80ca180 0x7f95d815e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36648/0 (socket says 172.21.15.49:36648) 2023-11-30T17:26:24.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.185+0000 7f95d7fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f95d80cae90 0x7f95d80c0ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51232/0 (socket says 172.21.15.49:51232) 2023-11-30T17:26:24.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.185+0000 7f95dd78b700 1 -- 172.21.15.49:0/1090196675 learned_addr learned my addr 172.21.15.49:0/1090196675 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:24.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.185+0000 7f95dcf8a700 1 --2- 172.21.15.49:0/1090196675 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95d80caab0 0x7f95d80aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:24.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.185+0000 7f95dd78b700 1 -- 172.21.15.49:0/1090196675 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95d80caab0 msgr2=0x7f95d80aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:24.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.185+0000 7f95dd78b700 1 --2- 172.21.15.49:0/1090196675 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95d80caab0 0x7f95d80aa470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:24.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.185+0000 7f95dd78b700 1 -- 172.21.15.49:0/1090196675 >> v1:172.21.15.49:6789/0 conn(0x7f95d80cae90 legacy=0x7f95d80c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:24.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.185+0000 7f95d77fe700 1 -- 172.21.15.49:0/1090196675 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3773557279 0 0) 0x7f95d80a9a90 con 0x7f95d80cae90 2023-11-30T17:26:24.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.185+0000 7f95dd78b700 1 -- 172.21.15.49:0/1090196675 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d80a9160 con 0x7f95d80ca180 2023-11-30T17:26:24.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.185+0000 7f95dd78b700 1 --2- 172.21.15.49:0/1090196675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95d80ca180 0x7f95d815e3c0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7f95d0009f20 tx=0x7f95d0009840).ready entity=mon.0 client_cookie=8d8f9e50e989932a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:24.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.186+0000 7f95d77fe700 1 -- 172.21.15.49:0/1090196675 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d000e070 con 0x7f95d80ca180 2023-11-30T17:26:24.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.186+0000 7f95d77fe700 1 -- 172.21.15.49:0/1090196675 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d000ba80 con 0x7f95d80ca180 2023-11-30T17:26:24.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.186+0000 7f95d77fe700 1 -- 172.21.15.49:0/1090196675 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d000be00 con 0x7f95d80ca180 2023-11-30T17:26:24.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.186+0000 7f95df1ee700 1 -- 172.21.15.49:0/1090196675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95d80ca180 msgr2=0x7f95d815e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:24.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.186+0000 7f95df1ee700 1 --2- 172.21.15.49:0/1090196675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95d80ca180 0x7f95d815e3c0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7f95d0009f20 tx=0x7f95d0009840).stop 2023-11-30T17:26:24.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.186+0000 7f95df1ee700 1 -- 172.21.15.49:0/1090196675 shutdown_connections 2023-11-30T17:26:24.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.186+0000 7f95df1ee700 1 --2- 172.21.15.49:0/1090196675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95d80ca180 0x7f95d815e3c0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:24.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.186+0000 7f95df1ee700 1 --2- 172.21.15.49:0/1090196675 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95d80caab0 0x7f95d80aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:24.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.186+0000 7f95df1ee700 1 -- 172.21.15.49:0/1090196675 >> 172.21.15.49:0/1090196675 conn(0x7f95d8094920 msgr2=0x7f95d806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:24.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.186+0000 7f95df1ee700 1 -- 172.21.15.49:0/1090196675 shutdown_connections 2023-11-30T17:26:24.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.186+0000 7f95df1ee700 1 -- 172.21.15.49:0/1090196675 wait complete. 2023-11-30T17:26:24.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.187+0000 7f95df1ee700 1 Processor -- start 2023-11-30T17:26:24.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.187+0000 7f95df1ee700 1 -- start start 2023-11-30T17:26:24.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.188+0000 7f95df1ee700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95d80ca180 0x7f95d815a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:24.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.188+0000 7f95df1ee700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95d80caab0 0x7f95d80c32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:24.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.188+0000 7f95df1ee700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95d80cae90 0x7f95d814fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:24.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.188+0000 7f95df1ee700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d80c42d0 con 0x7f95d80caab0 2023-11-30T17:26:24.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.188+0000 7f95df1ee700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d815ac30 con 0x7f95d80cae90 2023-11-30T17:26:24.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.188+0000 7f95df1ee700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d80af180 con 0x7f95d80ca180 2023-11-30T17:26:24.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.188+0000 7f95d7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95d80caab0 0x7f95d80c32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:24.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.188+0000 7f95d7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95d80caab0 0x7f95d80c32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36652/0 (socket says 172.21.15.49:36652) 2023-11-30T17:26:24.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.188+0000 7f95d7fff700 1 -- 172.21.15.49:0/624605102 learned_addr learned my addr 172.21.15.49:0/624605102 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:24.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.188+0000 7f95dcf8a700 1 --2- 172.21.15.49:0/624605102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95d80ca180 0x7f95d815a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:24.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.188+0000 7f95dd78b700 1 --2- 172.21.15.49:0/624605102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95d80cae90 0x7f95d814fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:24.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.189+0000 7f95d7fff700 1 -- 172.21.15.49:0/624605102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95d80ca180 msgr2=0x7f95d815a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:24.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.189+0000 7f95d7fff700 1 --2- 172.21.15.49:0/624605102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95d80ca180 0x7f95d815a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:24.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.189+0000 7f95d7fff700 1 -- 172.21.15.49:0/624605102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95d80cae90 msgr2=0x7f95d814fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:24.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.189+0000 7f95d7fff700 1 --2- 172.21.15.49:0/624605102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95d80cae90 0x7f95d814fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:24.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.189+0000 7f95d7fff700 1 -- 172.21.15.49:0/624605102 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d0009ae0 con 0x7f95d80caab0 2023-11-30T17:26:24.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.189+0000 7f95dd78b700 1 --2- 172.21.15.49:0/624605102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95d80cae90 0x7f95d814fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:26:24.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.189+0000 7f95d7fff700 1 --2- 172.21.15.49:0/624605102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95d80caab0 0x7f95d80c32e0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7f95c400c490 tx=0x7f95c4007da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:24.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.189+0000 7f95d4ff9700 1 -- 172.21.15.49:0/624605102 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c400ce90 con 0x7f95d80caab0 2023-11-30T17:26:24.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.189+0000 7f95d4ff9700 1 -- 172.21.15.49:0/624605102 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c40072e0 con 0x7f95d80caab0 2023-11-30T17:26:24.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.189+0000 7f95df1ee700 1 -- 172.21.15.49:0/624605102 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d80c37d0 con 0x7f95d80caab0 2023-11-30T17:26:24.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.189+0000 7f95d4ff9700 1 -- 172.21.15.49:0/624605102 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c40056e0 con 0x7f95d80caab0 2023-11-30T17:26:24.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.189+0000 7f95df1ee700 1 -- 172.21.15.49:0/624605102 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d80c3d10 con 0x7f95d80caab0 2023-11-30T17:26:24.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.190+0000 7f95df1ee700 1 -- 172.21.15.49:0/624605102 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95d806c860 con 0x7f95d80caab0 2023-11-30T17:26:24.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.190+0000 7f95d4ff9700 1 -- 172.21.15.49:0/624605102 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f95c4005ad0 con 0x7f95d80caab0 2023-11-30T17:26:24.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.191+0000 7f95d4ff9700 1 --2- 172.21.15.49:0/624605102 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f95bc05f240 0x7f95bc061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:24.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.191+0000 7f95d4ff9700 1 -- 172.21.15.49:0/624605102 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f95c4079bc0 con 0x7f95d80caab0 2023-11-30T17:26:24.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.191+0000 7f95dcf8a700 1 --2- 172.21.15.49:0/624605102 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f95bc05f240 0x7f95bc061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:24.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.191+0000 7f95dcf8a700 1 --2- 172.21.15.49:0/624605102 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f95bc05f240 0x7f95bc061700 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f95cc006fd0 tx=0x7f95cc008040).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:24.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.195+0000 7f95d4ff9700 1 -- 172.21.15.49:0/624605102 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f95c404acd0 con 0x7f95d80caab0 2023-11-30T17:26:24.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.362+0000 7f95df1ee700 1 -- 172.21.15.49:0/624605102 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f95d80af330 con 0x7f95bc05f240 2023-11-30T17:26:24.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.374+0000 7f95d4ff9700 1 -- 172.21.15.49:0/624605102 <== mgr.6737 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361841 (secure 0 0 0) 0x7f95d80af330 con 0x7f95bc05f240 2023-11-30T17:26:24.381 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:26:24.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.377+0000 7f95df1ee700 1 -- 172.21.15.49:0/624605102 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f95bc05f240 msgr2=0x7f95bc061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:24.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.377+0000 7f95df1ee700 1 --2- 172.21.15.49:0/624605102 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f95bc05f240 0x7f95bc061700 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f95cc006fd0 tx=0x7f95cc008040).stop 2023-11-30T17:26:24.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.377+0000 7f95df1ee700 1 -- 172.21.15.49:0/624605102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95d80caab0 msgr2=0x7f95d80c32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:24.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.377+0000 7f95df1ee700 1 --2- 172.21.15.49:0/624605102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95d80caab0 0x7f95d80c32e0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7f95c400c490 tx=0x7f95c4007da0).stop 2023-11-30T17:26:24.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.377+0000 7f95df1ee700 1 -- 172.21.15.49:0/624605102 shutdown_connections 2023-11-30T17:26:24.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.377+0000 7f95df1ee700 1 --2- 172.21.15.49:0/624605102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95d80cae90 0x7f95d814fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:24.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.377+0000 7f95df1ee700 1 --2- 172.21.15.49:0/624605102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95d80ca180 0x7f95d815a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:24.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.377+0000 7f95df1ee700 1 --2- 172.21.15.49:0/624605102 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f95bc05f240 0x7f95bc061700 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:24.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.377+0000 7f95df1ee700 1 --2- 172.21.15.49:0/624605102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95d80caab0 0x7f95d80c32e0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:24.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.377+0000 7f95df1ee700 1 -- 172.21.15.49:0/624605102 >> 172.21.15.49:0/624605102 conn(0x7f95d8094920 msgr2=0x7f95d80a7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:24.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.377+0000 7f95df1ee700 1 -- 172.21.15.49:0/624605102 shutdown_connections 2023-11-30T17:26:24.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.377+0000 7f95df1ee700 1 -- 172.21.15.49:0/624605102 wait complete. 2023-11-30T17:26:24.385 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:26:24.392 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-30T17:26:23.265351+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":264,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2440104,"kb_used_data":14184,"kb_used_omap":0,"kb_used_meta":2425856,"kb_avail":752534616,"statfs":{"total":773094113280,"available":770595446784,"internally_reserved":0,"allocated":14524416,"data_stored":7333188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2484076544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-20934,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-71,"num_write_kb":-47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.016471"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.385466+0000","last_change":"2023-11-30T17:26:20.381095+0000","last_active":"2023-11-30T17:26:20.385466+0000","last_peered":"2023-11-30T17:26:20.385466+0000","last_clean":"2023-11-30T17:26:20.385466+0000","last_became_active":"2023-11-30T17:26:20.380794+0000","last_became_peered":"2023-11-30T17:26:20.380794+0000","last_unstale":"2023-11-30T17:26:20.385466+0000","last_undegraded":"2023-11-30T17:26:20.385466+0000","last_fullsized":"2023-11-30T17:26:20.385466+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3f","version":"145'3","reported_seq":13,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.389395+0000","last_change":"2023-11-30T17:26:19.987503+0000","last_active":"2023-11-30T17:26:20.389395+0000","last_peered":"2023-11-30T17:26:20.389395+0000","last_clean":"2023-11-30T17:26:20.389395+0000","last_became_active":"2023-11-30T17:26:19.987201+0000","last_became_peered":"2023-11-30T17:26:19.987201+0000","last_unstale":"2023-11-30T17:26:20.389395+0000","last_undegraded":"2023-11-30T17:26:20.389395+0000","last_fullsized":"2023-11-30T17:26:20.389395+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388058+0000","last_change":"2023-11-30T17:26:20.379136+0000","last_active":"2023-11-30T17:26:20.388058+0000","last_peered":"2023-11-30T17:26:20.388058+0000","last_clean":"2023-11-30T17:26:20.388058+0000","last_became_active":"2023-11-30T17:26:20.378802+0000","last_became_peered":"2023-11-30T17:26:20.378802+0000","last_unstale":"2023-11-30T17:26:20.388058+0000","last_undegraded":"2023-11-30T17:26:20.388058+0000","last_fullsized":"2023-11-30T17:26:20.388058+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.375084+0000","last_change":"2023-11-30T17:26:19.981215+0000","last_active":"2023-11-30T17:26:20.375084+0000","last_peered":"2023-11-30T17:26:20.375084+0000","last_clean":"2023-11-30T17:26:20.375084+0000","last_became_active":"2023-11-30T17:26:19.980759+0000","last_became_peered":"2023-11-30T17:26:19.980759+0000","last_unstale":"2023-11-30T17:26:20.375084+0000","last_undegraded":"2023-11-30T17:26:20.375084+0000","last_fullsized":"2023-11-30T17:26:20.375084+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.389787+0000","last_change":"2023-11-30T17:26:20.385727+0000","last_active":"2023-11-30T17:26:20.389787+0000","last_peered":"2023-11-30T17:26:20.389787+0000","last_clean":"2023-11-30T17:26:20.389787+0000","last_became_active":"2023-11-30T17:26:20.385256+0000","last_became_peered":"2023-11-30T17:26:20.385256+0000","last_unstale":"2023-11-30T17:26:20.389787+0000","last_undegraded":"2023-11-30T17:26:20.389787+0000","last_fullsized":"2023-11-30T17:26:20.389787+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.369033+0000","last_change":"2023-11-30T17:26:19.995206+0000","last_active":"2023-11-30T17:26:20.369033+0000","last_peered":"2023-11-30T17:26:20.369033+0000","last_clean":"2023-11-30T17:26:20.369033+0000","last_became_active":"2023-11-30T17:26:19.994873+0000","last_became_peered":"2023-11-30T17:26:19.994873+0000","last_unstale":"2023-11-30T17:26:20.369033+0000","last_undegraded":"2023-11-30T17:26:20.369033+0000","last_fullsized":"2023-11-30T17:26:20.369033+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.386727+0000","last_change":"2023-11-30T17:26:20.382991+0000","last_active":"2023-11-30T17:26:20.386727+0000","last_peered":"2023-11-30T17:26:20.386727+0000","last_clean":"2023-11-30T17:26:20.386727+0000","last_became_active":"2023-11-30T17:26:20.382685+0000","last_became_peered":"2023-11-30T17:26:20.382685+0000","last_unstale":"2023-11-30T17:26:20.386727+0000","last_undegraded":"2023-11-30T17:26:20.386727+0000","last_fullsized":"2023-11-30T17:26:20.386727+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3c","version":"145'2","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388621+0000","last_change":"2023-11-30T17:26:19.981679+0000","last_active":"2023-11-30T17:26:20.388621+0000","last_peered":"2023-11-30T17:26:20.388621+0000","last_clean":"2023-11-30T17:26:20.388621+0000","last_became_active":"2023-11-30T17:26:19.980849+0000","last_became_peered":"2023-11-30T17:26:19.980849+0000","last_unstale":"2023-11-30T17:26:20.388621+0000","last_undegraded":"2023-11-30T17:26:20.388621+0000","last_fullsized":"2023-11-30T17:26:20.388621+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388128+0000","last_change":"2023-11-30T17:26:20.379521+0000","last_active":"2023-11-30T17:26:20.388128+0000","last_peered":"2023-11-30T17:26:20.388128+0000","last_clean":"2023-11-30T17:26:20.388128+0000","last_became_active":"2023-11-30T17:26:20.379066+0000","last_became_peered":"2023-11-30T17:26:20.379066+0000","last_unstale":"2023-11-30T17:26:20.388128+0000","last_undegraded":"2023-11-30T17:26:20.388128+0000","last_fullsized":"2023-11-30T17:26:20.388128+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3b","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.390371+0000","last_change":"2023-11-30T17:26:19.981911+0000","last_active":"2023-11-30T17:26:20.390371+0000","last_peered":"2023-11-30T17:26:20.390371+0000","last_clean":"2023-11-30T17:26:20.390371+0000","last_became_active":"2023-11-30T17:26:19.981028+0000","last_became_peered":"2023-11-30T17:26:19.981028+0000","last_unstale":"2023-11-30T17:26:20.390371+0000","last_undegraded":"2023-11-30T17:26:20.390371+0000","last_fullsized":"2023-11-30T17:26:20.390371+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387481+0000","last_change":"2023-11-30T17:26:20.373693+0000","last_active":"2023-11-30T17:26:20.387481+0000","last_peered":"2023-11-30T17:26:20.387481+0000","last_clean":"2023-11-30T17:26:20.387481+0000","last_became_active":"2023-11-30T17:26:20.373358+0000","last_became_peered":"2023-11-30T17:26:20.373358+0000","last_unstale":"2023-11-30T17:26:20.387481+0000","last_undegraded":"2023-11-30T17:26:20.387481+0000","last_fullsized":"2023-11-30T17:26:20.387481+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3a","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388948+0000","last_change":"2023-11-30T17:26:19.991546+0000","last_active":"2023-11-30T17:26:20.388948+0000","last_peered":"2023-11-30T17:26:20.388948+0000","last_clean":"2023-11-30T17:26:20.388948+0000","last_became_active":"2023-11-30T17:26:19.991205+0000","last_became_peered":"2023-11-30T17:26:19.991205+0000","last_unstale":"2023-11-30T17:26:20.388948+0000","last_undegraded":"2023-11-30T17:26:20.388948+0000","last_fullsized":"2023-11-30T17:26:20.388948+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387245+0000","last_change":"2023-11-30T17:26:20.377086+0000","last_active":"2023-11-30T17:26:20.387245+0000","last_peered":"2023-11-30T17:26:20.387245+0000","last_clean":"2023-11-30T17:26:20.387245+0000","last_became_active":"2023-11-30T17:26:20.376800+0000","last_became_peered":"2023-11-30T17:26:20.376800+0000","last_unstale":"2023-11-30T17:26:20.387245+0000","last_undegraded":"2023-11-30T17:26:20.387245+0000","last_fullsized":"2023-11-30T17:26:20.387245+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.380493+0000","last_change":"2023-11-30T17:26:19.983111+0000","last_active":"2023-11-30T17:26:20.380493+0000","last_peered":"2023-11-30T17:26:20.380493+0000","last_clean":"2023-11-30T17:26:20.380493+0000","last_became_active":"2023-11-30T17:26:19.982664+0000","last_became_peered":"2023-11-30T17:26:19.982664+0000","last_unstale":"2023-11-30T17:26:20.380493+0000","last_undegraded":"2023-11-30T17:26:20.380493+0000","last_fullsized":"2023-11-30T17:26:20.380493+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.393583+0000","last_change":"2023-11-30T17:26:20.389542+0000","last_active":"2023-11-30T17:26:20.393583+0000","last_peered":"2023-11-30T17:26:20.393583+0000","last_clean":"2023-11-30T17:26:20.393583+0000","last_became_active":"2023-11-30T17:26:20.389206+0000","last_became_peered":"2023-11-30T17:26:20.389206+0000","last_unstale":"2023-11-30T17:26:20.393583+0000","last_undegraded":"2023-11-30T17:26:20.393583+0000","last_fullsized":"2023-11-30T17:26:20.393583+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.368345+0000","last_change":"2023-11-30T17:26:19.991912+0000","last_active":"2023-11-30T17:26:20.368345+0000","last_peered":"2023-11-30T17:26:20.368345+0000","last_clean":"2023-11-30T17:26:20.368345+0000","last_became_active":"2023-11-30T17:26:19.991638+0000","last_became_peered":"2023-11-30T17:26:19.991638+0000","last_unstale":"2023-11-30T17:26:20.368345+0000","last_undegraded":"2023-11-30T17:26:20.368345+0000","last_fullsized":"2023-11-30T17:26:20.368345+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388798+0000","last_change":"2023-11-30T17:26:20.385803+0000","last_active":"2023-11-30T17:26:20.388798+0000","last_peered":"2023-11-30T17:26:20.388798+0000","last_clean":"2023-11-30T17:26:20.388798+0000","last_became_active":"2023-11-30T17:26:20.385543+0000","last_became_peered":"2023-11-30T17:26:20.385543+0000","last_unstale":"2023-11-30T17:26:20.388798+0000","last_undegraded":"2023-11-30T17:26:20.388798+0000","last_fullsized":"2023-11-30T17:26:20.388798+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.361805+0000","last_change":"2023-11-30T17:26:19.990110+0000","last_active":"2023-11-30T17:26:20.361805+0000","last_peered":"2023-11-30T17:26:20.361805+0000","last_clean":"2023-11-30T17:26:20.361805+0000","last_became_active":"2023-11-30T17:26:19.989788+0000","last_became_peered":"2023-11-30T17:26:19.989788+0000","last_unstale":"2023-11-30T17:26:20.361805+0000","last_undegraded":"2023-11-30T17:26:20.361805+0000","last_fullsized":"2023-11-30T17:26:20.361805+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388136+0000","last_change":"2023-11-30T17:26:20.386138+0000","last_active":"2023-11-30T17:26:20.388136+0000","last_peered":"2023-11-30T17:26:20.388136+0000","last_clean":"2023-11-30T17:26:20.388136+0000","last_became_active":"2023-11-30T17:26:20.385843+0000","last_became_peered":"2023-11-30T17:26:20.385843+0000","last_unstale":"2023-11-30T17:26:20.388136+0000","last_undegraded":"2023-11-30T17:26:20.388136+0000","last_fullsized":"2023-11-30T17:26:20.388136+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.361983+0000","last_change":"2023-11-30T17:26:19.987471+0000","last_active":"2023-11-30T17:26:20.361983+0000","last_peered":"2023-11-30T17:26:20.361983+0000","last_clean":"2023-11-30T17:26:20.361983+0000","last_became_active":"2023-11-30T17:26:19.987163+0000","last_became_peered":"2023-11-30T17:26:19.987163+0000","last_unstale":"2023-11-30T17:26:20.361983+0000","last_undegraded":"2023-11-30T17:26:20.361983+0000","last_fullsized":"2023-11-30T17:26:20.361983+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.380865+0000","last_change":"2023-11-30T17:26:20.374642+0000","last_active":"2023-11-30T17:26:20.380865+0000","last_peered":"2023-11-30T17:26:20.380865+0000","last_clean":"2023-11-30T17:26:20.380865+0000","last_became_active":"2023-11-30T17:26:20.374408+0000","last_became_peered":"2023-11-30T17:26:20.374408+0000","last_unstale":"2023-11-30T17:26:20.380865+0000","last_undegraded":"2023-11-30T17:26:20.380865+0000","last_fullsized":"2023-11-30T17:26:20.380865+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.375595+0000","last_change":"2023-11-30T17:26:19.984914+0000","last_active":"2023-11-30T17:26:20.375595+0000","last_peered":"2023-11-30T17:26:20.375595+0000","last_clean":"2023-11-30T17:26:20.375595+0000","last_became_active":"2023-11-30T17:26:19.984603+0000","last_became_peered":"2023-11-30T17:26:19.984603+0000","last_unstale":"2023-11-30T17:26:20.375595+0000","last_undegraded":"2023-11-30T17:26:20.375595+0000","last_fullsized":"2023-11-30T17:26:20.375595+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.381358+0000","last_change":"2023-11-30T17:26:20.377269+0000","last_active":"2023-11-30T17:26:20.381358+0000","last_peered":"2023-11-30T17:26:20.381358+0000","last_clean":"2023-11-30T17:26:20.381358+0000","last_became_active":"2023-11-30T17:26:20.377010+0000","last_became_peered":"2023-11-30T17:26:20.377010+0000","last_unstale":"2023-11-30T17:26:20.381358+0000","last_undegraded":"2023-11-30T17:26:20.381358+0000","last_fullsized":"2023-11-30T17:26:20.381358+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.34","version":"145'4","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.392001+0000","last_change":"2023-11-30T17:26:19.981025+0000","last_active":"2023-11-30T17:26:20.392001+0000","last_peered":"2023-11-30T17:26:20.392001+0000","last_clean":"2023-11-30T17:26:20.392001+0000","last_became_active":"2023-11-30T17:26:19.980676+0000","last_became_peered":"2023-11-30T17:26:19.980676+0000","last_unstale":"2023-11-30T17:26:20.392001+0000","last_undegraded":"2023-11-30T17:26:20.392001+0000","last_fullsized":"2023-11-30T17:26:20.392001+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.376617+0000","last_change":"2023-11-30T17:26:20.372762+0000","last_active":"2023-11-30T17:26:20.376617+0000","last_peered":"2023-11-30T17:26:20.376617+0000","last_clean":"2023-11-30T17:26:20.376617+0000","last_became_active":"2023-11-30T17:26:20.372493+0000","last_became_peered":"2023-11-30T17:26:20.372493+0000","last_unstale":"2023-11-30T17:26:20.376617+0000","last_undegraded":"2023-11-30T17:26:20.376617+0000","last_fullsized":"2023-11-30T17:26:20.376617+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.385857+0000","last_change":"2023-11-30T17:26:19.991261+0000","last_active":"2023-11-30T17:26:20.385857+0000","last_peered":"2023-11-30T17:26:20.385857+0000","last_clean":"2023-11-30T17:26:20.385857+0000","last_became_active":"2023-11-30T17:26:19.990918+0000","last_became_peered":"2023-11-30T17:26:19.990918+0000","last_unstale":"2023-11-30T17:26:20.385857+0000","last_undegraded":"2023-11-30T17:26:20.385857+0000","last_fullsized":"2023-11-30T17:26:20.385857+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387036+0000","last_change":"2023-11-30T17:26:20.385369+0000","last_active":"2023-11-30T17:26:20.387036+0000","last_peered":"2023-11-30T17:26:20.387036+0000","last_clean":"2023-11-30T17:26:20.387036+0000","last_became_active":"2023-11-30T17:26:20.385105+0000","last_became_peered":"2023-11-30T17:26:20.385105+0000","last_unstale":"2023-11-30T17:26:20.387036+0000","last_undegraded":"2023-11-30T17:26:20.387036+0000","last_fullsized":"2023-11-30T17:26:20.387036+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.368456+0000","last_change":"2023-11-30T17:26:19.987964+0000","last_active":"2023-11-30T17:26:20.368456+0000","last_peered":"2023-11-30T17:26:20.368456+0000","last_clean":"2023-11-30T17:26:20.368456+0000","last_became_active":"2023-11-30T17:26:19.987671+0000","last_became_peered":"2023-11-30T17:26:19.987671+0000","last_unstale":"2023-11-30T17:26:20.368456+0000","last_undegraded":"2023-11-30T17:26:20.368456+0000","last_fullsized":"2023-11-30T17:26:20.368456+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388363+0000","last_change":"2023-11-30T17:26:20.384255+0000","last_active":"2023-11-30T17:26:20.388363+0000","last_peered":"2023-11-30T17:26:20.388363+0000","last_clean":"2023-11-30T17:26:20.388363+0000","last_became_active":"2023-11-30T17:26:20.383667+0000","last_became_peered":"2023-11-30T17:26:20.383667+0000","last_unstale":"2023-11-30T17:26:20.388363+0000","last_undegraded":"2023-11-30T17:26:20.388363+0000","last_fullsized":"2023-11-30T17:26:20.388363+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.365931+0000","last_change":"2023-11-30T17:26:19.981285+0000","last_active":"2023-11-30T17:26:20.365931+0000","last_peered":"2023-11-30T17:26:20.365931+0000","last_clean":"2023-11-30T17:26:20.365931+0000","last_became_active":"2023-11-30T17:26:19.981001+0000","last_became_peered":"2023-11-30T17:26:19.981001+0000","last_unstale":"2023-11-30T17:26:20.365931+0000","last_undegraded":"2023-11-30T17:26:20.365931+0000","last_fullsized":"2023-11-30T17:26:20.365931+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.385714+0000","last_change":"2023-11-30T17:26:20.383414+0000","last_active":"2023-11-30T17:26:20.385714+0000","last_peered":"2023-11-30T17:26:20.385714+0000","last_clean":"2023-11-30T17:26:20.385714+0000","last_became_active":"2023-11-30T17:26:20.383133+0000","last_became_peered":"2023-11-30T17:26:20.383133+0000","last_unstale":"2023-11-30T17:26:20.385714+0000","last_undegraded":"2023-11-30T17:26:20.385714+0000","last_fullsized":"2023-11-30T17:26:20.385714+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"145'4","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387705+0000","last_change":"2023-11-30T17:26:19.985363+0000","last_active":"2023-11-30T17:26:20.387705+0000","last_peered":"2023-11-30T17:26:20.387705+0000","last_clean":"2023-11-30T17:26:20.387705+0000","last_became_active":"2023-11-30T17:26:19.985060+0000","last_became_peered":"2023-11-30T17:26:19.985060+0000","last_unstale":"2023-11-30T17:26:20.387705+0000","last_undegraded":"2023-11-30T17:26:20.387705+0000","last_fullsized":"2023-11-30T17:26:20.387705+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.381824+0000","last_change":"2023-11-30T17:26:20.380614+0000","last_active":"2023-11-30T17:26:20.381824+0000","last_peered":"2023-11-30T17:26:20.381824+0000","last_clean":"2023-11-30T17:26:20.381824+0000","last_became_active":"2023-11-30T17:26:20.380325+0000","last_became_peered":"2023-11-30T17:26:20.380325+0000","last_unstale":"2023-11-30T17:26:20.381824+0000","last_undegraded":"2023-11-30T17:26:20.381824+0000","last_fullsized":"2023-11-30T17:26:20.381824+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.375294+0000","last_change":"2023-11-30T17:26:19.987692+0000","last_active":"2023-11-30T17:26:20.375294+0000","last_peered":"2023-11-30T17:26:20.375294+0000","last_clean":"2023-11-30T17:26:20.375294+0000","last_became_active":"2023-11-30T17:26:19.986014+0000","last_became_peered":"2023-11-30T17:26:19.986014+0000","last_unstale":"2023-11-30T17:26:20.375294+0000","last_undegraded":"2023-11-30T17:26:20.375294+0000","last_fullsized":"2023-11-30T17:26:20.375294+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.371329+0000","last_change":"2023-11-30T17:26:20.370906+0000","last_active":"2023-11-30T17:26:20.371329+0000","last_peered":"2023-11-30T17:26:20.371329+0000","last_clean":"2023-11-30T17:26:20.371329+0000","last_became_active":"2023-11-30T17:26:20.370579+0000","last_became_peered":"2023-11-30T17:26:20.370579+0000","last_unstale":"2023-11-30T17:26:20.371329+0000","last_undegraded":"2023-11-30T17:26:20.371329+0000","last_fullsized":"2023-11-30T17:26:20.371329+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.365679+0000","last_change":"2023-11-30T17:26:19.980843+0000","last_active":"2023-11-30T17:26:20.365679+0000","last_peered":"2023-11-30T17:26:20.365679+0000","last_clean":"2023-11-30T17:26:20.365679+0000","last_became_active":"2023-11-30T17:26:19.980555+0000","last_became_peered":"2023-11-30T17:26:19.980555+0000","last_unstale":"2023-11-30T17:26:20.365679+0000","last_undegraded":"2023-11-30T17:26:20.365679+0000","last_fullsized":"2023-11-30T17:26:20.365679+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.389765+0000","last_change":"2023-11-30T17:26:20.385543+0000","last_active":"2023-11-30T17:26:20.389765+0000","last_peered":"2023-11-30T17:26:20.389765+0000","last_clean":"2023-11-30T17:26:20.389765+0000","last_became_active":"2023-11-30T17:26:20.385023+0000","last_became_peered":"2023-11-30T17:26:20.385023+0000","last_unstale":"2023-11-30T17:26:20.389765+0000","last_undegraded":"2023-11-30T17:26:20.389765+0000","last_fullsized":"2023-11-30T17:26:20.389765+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.385908+0000","last_change":"2023-11-30T17:26:19.991322+0000","last_active":"2023-11-30T17:26:20.385908+0000","last_peered":"2023-11-30T17:26:20.385908+0000","last_clean":"2023-11-30T17:26:20.385908+0000","last_became_active":"2023-11-30T17:26:19.990924+0000","last_became_peered":"2023-11-30T17:26:19.990924+0000","last_unstale":"2023-11-30T17:26:20.385908+0000","last_undegraded":"2023-11-30T17:26:20.385908+0000","last_fullsized":"2023-11-30T17:26:20.385908+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.385682+0000","last_change":"2023-11-30T17:26:20.383838+0000","last_active":"2023-11-30T17:26:20.385682+0000","last_peered":"2023-11-30T17:26:20.385682+0000","last_clean":"2023-11-30T17:26:20.385682+0000","last_became_active":"2023-11-30T17:26:20.383331+0000","last_became_peered":"2023-11-30T17:26:20.383331+0000","last_unstale":"2023-11-30T17:26:20.385682+0000","last_undegraded":"2023-11-30T17:26:20.385682+0000","last_fullsized":"2023-11-30T17:26:20.385682+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.373849+0000","last_change":"2023-11-30T17:26:19.982247+0000","last_active":"2023-11-30T17:26:20.373849+0000","last_peered":"2023-11-30T17:26:20.373849+0000","last_clean":"2023-11-30T17:26:20.373849+0000","last_became_active":"2023-11-30T17:26:19.980615+0000","last_became_peered":"2023-11-30T17:26:19.980615+0000","last_unstale":"2023-11-30T17:26:20.373849+0000","last_undegraded":"2023-11-30T17:26:20.373849+0000","last_fullsized":"2023-11-30T17:26:20.373849+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.391577+0000","last_change":"2023-11-30T17:26:20.390402+0000","last_active":"2023-11-30T17:26:20.391577+0000","last_peered":"2023-11-30T17:26:20.391577+0000","last_clean":"2023-11-30T17:26:20.391577+0000","last_became_active":"2023-11-30T17:26:20.390183+0000","last_became_peered":"2023-11-30T17:26:20.390183+0000","last_unstale":"2023-11-30T17:26:20.391577+0000","last_undegraded":"2023-11-30T17:26:20.391577+0000","last_fullsized":"2023-11-30T17:26:20.391577+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2b","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387315+0000","last_change":"2023-11-30T17:26:19.987740+0000","last_active":"2023-11-30T17:26:20.387315+0000","last_peered":"2023-11-30T17:26:20.387315+0000","last_clean":"2023-11-30T17:26:20.387315+0000","last_became_active":"2023-11-30T17:26:19.987465+0000","last_became_peered":"2023-11-30T17:26:19.987465+0000","last_unstale":"2023-11-30T17:26:20.387315+0000","last_undegraded":"2023-11-30T17:26:20.387315+0000","last_fullsized":"2023-11-30T17:26:20.387315+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.381841+0000","last_change":"2023-11-30T17:26:20.377421+0000","last_active":"2023-11-30T17:26:20.381841+0000","last_peered":"2023-11-30T17:26:20.381841+0000","last_clean":"2023-11-30T17:26:20.381841+0000","last_became_active":"2023-11-30T17:26:20.376973+0000","last_became_peered":"2023-11-30T17:26:20.376973+0000","last_unstale":"2023-11-30T17:26:20.381841+0000","last_undegraded":"2023-11-30T17:26:20.381841+0000","last_fullsized":"2023-11-30T17:26:20.381841+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.371925+0000","last_change":"2023-11-30T17:26:19.989295+0000","last_active":"2023-11-30T17:26:20.371925+0000","last_peered":"2023-11-30T17:26:20.371925+0000","last_clean":"2023-11-30T17:26:20.371925+0000","last_became_active":"2023-11-30T17:26:19.989015+0000","last_became_peered":"2023-11-30T17:26:19.989015+0000","last_unstale":"2023-11-30T17:26:20.371925+0000","last_undegraded":"2023-11-30T17:26:20.371925+0000","last_fullsized":"2023-11-30T17:26:20.371925+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.385569+0000","last_change":"2023-11-30T17:26:20.380780+0000","last_active":"2023-11-30T17:26:20.385569+0000","last_peered":"2023-11-30T17:26:20.385569+0000","last_clean":"2023-11-30T17:26:20.385569+0000","last_became_active":"2023-11-30T17:26:20.380428+0000","last_became_peered":"2023-11-30T17:26:20.380428+0000","last_unstale":"2023-11-30T17:26:20.385569+0000","last_undegraded":"2023-11-30T17:26:20.385569+0000","last_fullsized":"2023-11-30T17:26:20.385569+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.373516+0000","last_change":"2023-11-30T17:26:19.987926+0000","last_active":"2023-11-30T17:26:20.373516+0000","last_peered":"2023-11-30T17:26:20.373516+0000","last_clean":"2023-11-30T17:26:20.373516+0000","last_became_active":"2023-11-30T17:26:19.986566+0000","last_became_peered":"2023-11-30T17:26:19.986566+0000","last_unstale":"2023-11-30T17:26:20.373516+0000","last_undegraded":"2023-11-30T17:26:20.373516+0000","last_fullsized":"2023-11-30T17:26:20.373516+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387527+0000","last_change":"2023-11-30T17:26:20.383698+0000","last_active":"2023-11-30T17:26:20.387527+0000","last_peered":"2023-11-30T17:26:20.387527+0000","last_clean":"2023-11-30T17:26:20.387527+0000","last_became_active":"2023-11-30T17:26:20.381951+0000","last_became_peered":"2023-11-30T17:26:20.381951+0000","last_unstale":"2023-11-30T17:26:20.387527+0000","last_undegraded":"2023-11-30T17:26:20.387527+0000","last_fullsized":"2023-11-30T17:26:20.387527+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.369741+0000","last_change":"2023-11-30T17:26:19.988883+0000","last_active":"2023-11-30T17:26:20.369741+0000","last_peered":"2023-11-30T17:26:20.369741+0000","last_clean":"2023-11-30T17:26:20.369741+0000","last_became_active":"2023-11-30T17:26:19.988572+0000","last_became_peered":"2023-11-30T17:26:19.988572+0000","last_unstale":"2023-11-30T17:26:20.369741+0000","last_undegraded":"2023-11-30T17:26:20.369741+0000","last_fullsized":"2023-11-30T17:26:20.369741+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388779+0000","last_change":"2023-11-30T17:26:20.385162+0000","last_active":"2023-11-30T17:26:20.388779+0000","last_peered":"2023-11-30T17:26:20.388779+0000","last_clean":"2023-11-30T17:26:20.388779+0000","last_became_active":"2023-11-30T17:26:20.384966+0000","last_became_peered":"2023-11-30T17:26:20.384966+0000","last_unstale":"2023-11-30T17:26:20.388779+0000","last_undegraded":"2023-11-30T17:26:20.388779+0000","last_fullsized":"2023-11-30T17:26:20.388779+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.375436+0000","last_change":"2023-11-30T17:26:19.984962+0000","last_active":"2023-11-30T17:26:20.375436+0000","last_peered":"2023-11-30T17:26:20.375436+0000","last_clean":"2023-11-30T17:26:20.375436+0000","last_became_active":"2023-11-30T17:26:19.984501+0000","last_became_peered":"2023-11-30T17:26:19.984501+0000","last_unstale":"2023-11-30T17:26:20.375436+0000","last_undegraded":"2023-11-30T17:26:20.375436+0000","last_fullsized":"2023-11-30T17:26:20.375436+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387308+0000","last_change":"2023-11-30T17:26:20.376671+0000","last_active":"2023-11-30T17:26:20.387308+0000","last_peered":"2023-11-30T17:26:20.387308+0000","last_clean":"2023-11-30T17:26:20.387308+0000","last_became_active":"2023-11-30T17:26:20.376340+0000","last_became_peered":"2023-11-30T17:26:20.376340+0000","last_unstale":"2023-11-30T17:26:20.387308+0000","last_undegraded":"2023-11-30T17:26:20.387308+0000","last_fullsized":"2023-11-30T17:26:20.387308+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.362083+0000","last_change":"2023-11-30T17:26:19.986008+0000","last_active":"2023-11-30T17:26:20.362083+0000","last_peered":"2023-11-30T17:26:20.362083+0000","last_clean":"2023-11-30T17:26:20.362083+0000","last_became_active":"2023-11-30T17:26:19.985725+0000","last_became_peered":"2023-11-30T17:26:19.985725+0000","last_unstale":"2023-11-30T17:26:20.362083+0000","last_undegraded":"2023-11-30T17:26:20.362083+0000","last_fullsized":"2023-11-30T17:26:20.362083+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.384054+0000","last_change":"2023-11-30T17:26:20.382079+0000","last_active":"2023-11-30T17:26:20.384054+0000","last_peered":"2023-11-30T17:26:20.384054+0000","last_clean":"2023-11-30T17:26:20.384054+0000","last_became_active":"2023-11-30T17:26:20.381802+0000","last_became_peered":"2023-11-30T17:26:20.381802+0000","last_unstale":"2023-11-30T17:26:20.384054+0000","last_undegraded":"2023-11-30T17:26:20.384054+0000","last_fullsized":"2023-11-30T17:26:20.384054+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.367031+0000","last_change":"2023-11-30T17:26:19.988110+0000","last_active":"2023-11-30T17:26:20.367031+0000","last_peered":"2023-11-30T17:26:20.367031+0000","last_clean":"2023-11-30T17:26:20.367031+0000","last_became_active":"2023-11-30T17:26:19.987812+0000","last_became_peered":"2023-11-30T17:26:19.987812+0000","last_unstale":"2023-11-30T17:26:20.367031+0000","last_undegraded":"2023-11-30T17:26:20.367031+0000","last_fullsized":"2023-11-30T17:26:20.367031+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388716+0000","last_change":"2023-11-30T17:26:20.386011+0000","last_active":"2023-11-30T17:26:20.388716+0000","last_peered":"2023-11-30T17:26:20.388716+0000","last_clean":"2023-11-30T17:26:20.388716+0000","last_became_active":"2023-11-30T17:26:20.385659+0000","last_became_peered":"2023-11-30T17:26:20.385659+0000","last_unstale":"2023-11-30T17:26:20.388716+0000","last_undegraded":"2023-11-30T17:26:20.388716+0000","last_fullsized":"2023-11-30T17:26:20.388716+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.368000+0000","last_change":"2023-11-30T17:26:19.987115+0000","last_active":"2023-11-30T17:26:20.368000+0000","last_peered":"2023-11-30T17:26:20.368000+0000","last_clean":"2023-11-30T17:26:20.368000+0000","last_became_active":"2023-11-30T17:26:19.986850+0000","last_became_peered":"2023-11-30T17:26:19.986850+0000","last_unstale":"2023-11-30T17:26:20.368000+0000","last_undegraded":"2023-11-30T17:26:20.368000+0000","last_fullsized":"2023-11-30T17:26:20.368000+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.391595+0000","last_change":"2023-11-30T17:26:20.390743+0000","last_active":"2023-11-30T17:26:20.391595+0000","last_peered":"2023-11-30T17:26:20.391595+0000","last_clean":"2023-11-30T17:26:20.391595+0000","last_became_active":"2023-11-30T17:26:20.389964+0000","last_became_peered":"2023-11-30T17:26:20.389964+0000","last_unstale":"2023-11-30T17:26:20.391595+0000","last_undegraded":"2023-11-30T17:26:20.391595+0000","last_fullsized":"2023-11-30T17:26:20.391595+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.373706+0000","last_change":"2023-11-30T17:26:19.989327+0000","last_active":"2023-11-30T17:26:20.373706+0000","last_peered":"2023-11-30T17:26:20.373706+0000","last_clean":"2023-11-30T17:26:20.373706+0000","last_became_active":"2023-11-30T17:26:19.988828+0000","last_became_peered":"2023-11-30T17:26:19.988828+0000","last_unstale":"2023-11-30T17:26:20.373706+0000","last_undegraded":"2023-11-30T17:26:20.373706+0000","last_fullsized":"2023-11-30T17:26:20.373706+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.386976+0000","last_change":"2023-11-30T17:26:20.383547+0000","last_active":"2023-11-30T17:26:20.386976+0000","last_peered":"2023-11-30T17:26:20.386976+0000","last_clean":"2023-11-30T17:26:20.386976+0000","last_became_active":"2023-11-30T17:26:20.383248+0000","last_became_peered":"2023-11-30T17:26:20.383248+0000","last_unstale":"2023-11-30T17:26:20.386976+0000","last_undegraded":"2023-11-30T17:26:20.386976+0000","last_fullsized":"2023-11-30T17:26:20.386976+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.380495+0000","last_change":"2023-11-30T17:26:19.983885+0000","last_active":"2023-11-30T17:26:20.380495+0000","last_peered":"2023-11-30T17:26:20.380495+0000","last_clean":"2023-11-30T17:26:20.380495+0000","last_became_active":"2023-11-30T17:26:19.983508+0000","last_became_peered":"2023-11-30T17:26:19.983508+0000","last_unstale":"2023-11-30T17:26:20.380495+0000","last_undegraded":"2023-11-30T17:26:20.380495+0000","last_fullsized":"2023-11-30T17:26:20.380495+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.389846+0000","last_change":"2023-11-30T17:26:20.387780+0000","last_active":"2023-11-30T17:26:20.389846+0000","last_peered":"2023-11-30T17:26:20.389846+0000","last_clean":"2023-11-30T17:26:20.389846+0000","last_became_active":"2023-11-30T17:26:20.387484+0000","last_became_peered":"2023-11-30T17:26:20.387484+0000","last_unstale":"2023-11-30T17:26:20.389846+0000","last_undegraded":"2023-11-30T17:26:20.389846+0000","last_fullsized":"2023-11-30T17:26:20.389846+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.362058+0000","last_change":"2023-11-30T17:26:19.988763+0000","last_active":"2023-11-30T17:26:20.362058+0000","last_peered":"2023-11-30T17:26:20.362058+0000","last_clean":"2023-11-30T17:26:20.362058+0000","last_became_active":"2023-11-30T17:26:19.988497+0000","last_became_peered":"2023-11-30T17:26:19.988497+0000","last_unstale":"2023-11-30T17:26:20.362058+0000","last_undegraded":"2023-11-30T17:26:20.362058+0000","last_fullsized":"2023-11-30T17:26:20.362058+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.379498+0000","last_change":"2023-11-30T17:26:20.371710+0000","last_active":"2023-11-30T17:26:20.379498+0000","last_peered":"2023-11-30T17:26:20.379498+0000","last_clean":"2023-11-30T17:26:20.379498+0000","last_became_active":"2023-11-30T17:26:20.371458+0000","last_became_peered":"2023-11-30T17:26:20.371458+0000","last_unstale":"2023-11-30T17:26:20.379498+0000","last_undegraded":"2023-11-30T17:26:20.379498+0000","last_fullsized":"2023-11-30T17:26:20.379498+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.366081+0000","last_change":"2023-11-30T17:26:19.984446+0000","last_active":"2023-11-30T17:26:20.366081+0000","last_peered":"2023-11-30T17:26:20.366081+0000","last_clean":"2023-11-30T17:26:20.366081+0000","last_became_active":"2023-11-30T17:26:19.984148+0000","last_became_peered":"2023-11-30T17:26:19.984148+0000","last_unstale":"2023-11-30T17:26:20.366081+0000","last_undegraded":"2023-11-30T17:26:20.366081+0000","last_fullsized":"2023-11-30T17:26:20.366081+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.382156+0000","last_change":"2023-11-30T17:26:20.375984+0000","last_active":"2023-11-30T17:26:20.382156+0000","last_peered":"2023-11-30T17:26:20.382156+0000","last_clean":"2023-11-30T17:26:20.382156+0000","last_became_active":"2023-11-30T17:26:20.375653+0000","last_became_peered":"2023-11-30T17:26:20.375653+0000","last_unstale":"2023-11-30T17:26:20.382156+0000","last_undegraded":"2023-11-30T17:26:20.382156+0000","last_fullsized":"2023-11-30T17:26:20.382156+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.382880+0000","last_change":"2023-11-30T17:26:19.983531+0000","last_active":"2023-11-30T17:26:20.382880+0000","last_peered":"2023-11-30T17:26:20.382880+0000","last_clean":"2023-11-30T17:26:20.382880+0000","last_became_active":"2023-11-30T17:26:19.983220+0000","last_became_peered":"2023-11-30T17:26:19.983220+0000","last_unstale":"2023-11-30T17:26:20.382880+0000","last_undegraded":"2023-11-30T17:26:20.382880+0000","last_fullsized":"2023-11-30T17:26:20.382880+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387296+0000","last_change":"2023-11-30T17:26:20.377093+0000","last_active":"2023-11-30T17:26:20.387296+0000","last_peered":"2023-11-30T17:26:20.387296+0000","last_clean":"2023-11-30T17:26:20.387296+0000","last_became_active":"2023-11-30T17:26:20.376815+0000","last_became_peered":"2023-11-30T17:26:20.376815+0000","last_unstale":"2023-11-30T17:26:20.387296+0000","last_undegraded":"2023-11-30T17:26:20.387296+0000","last_fullsized":"2023-11-30T17:26:20.387296+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.385529+0000","last_change":"2023-11-30T17:26:19.987645+0000","last_active":"2023-11-30T17:26:20.385529+0000","last_peered":"2023-11-30T17:26:20.385529+0000","last_clean":"2023-11-30T17:26:20.385529+0000","last_became_active":"2023-11-30T17:26:19.987346+0000","last_became_peered":"2023-11-30T17:26:19.987346+0000","last_unstale":"2023-11-30T17:26:20.385529+0000","last_undegraded":"2023-11-30T17:26:20.385529+0000","last_fullsized":"2023-11-30T17:26:20.385529+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.391536+0000","last_change":"2023-11-30T17:26:20.388901+0000","last_active":"2023-11-30T17:26:20.391536+0000","last_peered":"2023-11-30T17:26:20.391536+0000","last_clean":"2023-11-30T17:26:20.391536+0000","last_became_active":"2023-11-30T17:26:20.388624+0000","last_became_peered":"2023-11-30T17:26:20.388624+0000","last_unstale":"2023-11-30T17:26:20.391536+0000","last_undegraded":"2023-11-30T17:26:20.391536+0000","last_fullsized":"2023-11-30T17:26:20.391536+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"145'2","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.385776+0000","last_change":"2023-11-30T17:26:19.991367+0000","last_active":"2023-11-30T17:26:20.385776+0000","last_peered":"2023-11-30T17:26:20.385776+0000","last_clean":"2023-11-30T17:26:20.385776+0000","last_became_active":"2023-11-30T17:26:19.990964+0000","last_became_peered":"2023-11-30T17:26:19.990964+0000","last_unstale":"2023-11-30T17:26:20.385776+0000","last_undegraded":"2023-11-30T17:26:20.385776+0000","last_fullsized":"2023-11-30T17:26:20.385776+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.383944+0000","last_change":"2023-11-30T17:26:20.380100+0000","last_active":"2023-11-30T17:26:20.383944+0000","last_peered":"2023-11-30T17:26:20.383944+0000","last_clean":"2023-11-30T17:26:20.383944+0000","last_became_active":"2023-11-30T17:26:20.379241+0000","last_became_peered":"2023-11-30T17:26:20.379241+0000","last_unstale":"2023-11-30T17:26:20.383944+0000","last_undegraded":"2023-11-30T17:26:20.383944+0000","last_fullsized":"2023-11-30T17:26:20.383944+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.367402+0000","last_change":"2023-11-30T17:26:19.985435+0000","last_active":"2023-11-30T17:26:20.367402+0000","last_peered":"2023-11-30T17:26:20.367402+0000","last_clean":"2023-11-30T17:26:20.367402+0000","last_became_active":"2023-11-30T17:26:19.984327+0000","last_became_peered":"2023-11-30T17:26:19.984327+0000","last_unstale":"2023-11-30T17:26:20.367402+0000","last_undegraded":"2023-11-30T17:26:20.367402+0000","last_fullsized":"2023-11-30T17:26:20.367402+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.375502+0000","last_change":"2023-11-30T17:26:20.372493+0000","last_active":"2023-11-30T17:26:20.375502+0000","last_peered":"2023-11-30T17:26:20.375502+0000","last_clean":"2023-11-30T17:26:20.375502+0000","last_became_active":"2023-11-30T17:26:20.372215+0000","last_became_peered":"2023-11-30T17:26:20.372215+0000","last_unstale":"2023-11-30T17:26:20.375502+0000","last_undegraded":"2023-11-30T17:26:20.375502+0000","last_fullsized":"2023-11-30T17:26:20.375502+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.373795+0000","last_change":"2023-11-30T17:26:19.987201+0000","last_active":"2023-11-30T17:26:20.373795+0000","last_peered":"2023-11-30T17:26:20.373795+0000","last_clean":"2023-11-30T17:26:20.373795+0000","last_became_active":"2023-11-30T17:26:19.986920+0000","last_became_peered":"2023-11-30T17:26:19.986920+0000","last_unstale":"2023-11-30T17:26:20.373795+0000","last_undegraded":"2023-11-30T17:26:20.373795+0000","last_fullsized":"2023-11-30T17:26:20.373795+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387017+0000","last_change":"2023-11-30T17:26:20.383055+0000","last_active":"2023-11-30T17:26:20.387017+0000","last_peered":"2023-11-30T17:26:20.387017+0000","last_clean":"2023-11-30T17:26:20.387017+0000","last_became_active":"2023-11-30T17:26:20.382783+0000","last_became_peered":"2023-11-30T17:26:20.382783+0000","last_unstale":"2023-11-30T17:26:20.387017+0000","last_undegraded":"2023-11-30T17:26:20.387017+0000","last_fullsized":"2023-11-30T17:26:20.387017+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.362556+0000","last_change":"2023-11-30T17:26:19.984053+0000","last_active":"2023-11-30T17:26:20.362556+0000","last_peered":"2023-11-30T17:26:20.362556+0000","last_clean":"2023-11-30T17:26:20.362556+0000","last_became_active":"2023-11-30T17:26:19.983779+0000","last_became_peered":"2023-11-30T17:26:19.983779+0000","last_unstale":"2023-11-30T17:26:20.362556+0000","last_undegraded":"2023-11-30T17:26:20.362556+0000","last_fullsized":"2023-11-30T17:26:20.362556+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.379911+0000","last_change":"2023-11-30T17:26:20.374583+0000","last_active":"2023-11-30T17:26:20.379911+0000","last_peered":"2023-11-30T17:26:20.379911+0000","last_clean":"2023-11-30T17:26:20.379911+0000","last_became_active":"2023-11-30T17:26:20.374333+0000","last_became_peered":"2023-11-30T17:26:20.374333+0000","last_unstale":"2023-11-30T17:26:20.379911+0000","last_undegraded":"2023-11-30T17:26:20.379911+0000","last_fullsized":"2023-11-30T17:26:20.379911+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.382876+0000","last_change":"2023-11-30T17:26:19.985890+0000","last_active":"2023-11-30T17:26:20.382876+0000","last_peered":"2023-11-30T17:26:20.382876+0000","last_clean":"2023-11-30T17:26:20.382876+0000","last_became_active":"2023-11-30T17:26:19.983020+0000","last_became_peered":"2023-11-30T17:26:19.983020+0000","last_unstale":"2023-11-30T17:26:20.382876+0000","last_undegraded":"2023-11-30T17:26:20.382876+0000","last_fullsized":"2023-11-30T17:26:20.382876+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.382233+0000","last_change":"2023-11-30T17:26:20.378610+0000","last_active":"2023-11-30T17:26:20.382233+0000","last_peered":"2023-11-30T17:26:20.382233+0000","last_clean":"2023-11-30T17:26:20.382233+0000","last_became_active":"2023-11-30T17:26:20.375876+0000","last_became_peered":"2023-11-30T17:26:20.375876+0000","last_unstale":"2023-11-30T17:26:20.382233+0000","last_undegraded":"2023-11-30T17:26:20.382233+0000","last_fullsized":"2023-11-30T17:26:20.382233+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.361596+0000","last_change":"2023-11-30T17:26:19.983356+0000","last_active":"2023-11-30T17:26:20.361596+0000","last_peered":"2023-11-30T17:26:20.361596+0000","last_clean":"2023-11-30T17:26:20.361596+0000","last_became_active":"2023-11-30T17:26:19.983067+0000","last_became_peered":"2023-11-30T17:26:19.983067+0000","last_unstale":"2023-11-30T17:26:20.361596+0000","last_undegraded":"2023-11-30T17:26:20.361596+0000","last_fullsized":"2023-11-30T17:26:20.361596+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.391562+0000","last_change":"2023-11-30T17:26:20.389661+0000","last_active":"2023-11-30T17:26:20.391562+0000","last_peered":"2023-11-30T17:26:20.391562+0000","last_clean":"2023-11-30T17:26:20.391562+0000","last_became_active":"2023-11-30T17:26:20.389393+0000","last_became_peered":"2023-11-30T17:26:20.389393+0000","last_unstale":"2023-11-30T17:26:20.391562+0000","last_undegraded":"2023-11-30T17:26:20.391562+0000","last_fullsized":"2023-11-30T17:26:20.391562+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388319+0000","last_change":"2023-11-30T17:26:19.988210+0000","last_active":"2023-11-30T17:26:20.388319+0000","last_peered":"2023-11-30T17:26:20.388319+0000","last_clean":"2023-11-30T17:26:20.388319+0000","last_became_active":"2023-11-30T17:26:19.987860+0000","last_became_peered":"2023-11-30T17:26:19.987860+0000","last_unstale":"2023-11-30T17:26:20.388319+0000","last_undegraded":"2023-11-30T17:26:20.388319+0000","last_fullsized":"2023-11-30T17:26:20.388319+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.384545+0000","last_change":"2023-11-30T17:26:20.381565+0000","last_active":"2023-11-30T17:26:20.384545+0000","last_peered":"2023-11-30T17:26:20.384545+0000","last_clean":"2023-11-30T17:26:20.384545+0000","last_became_active":"2023-11-30T17:26:20.381297+0000","last_became_peered":"2023-11-30T17:26:20.381297+0000","last_unstale":"2023-11-30T17:26:20.384545+0000","last_undegraded":"2023-11-30T17:26:20.384545+0000","last_fullsized":"2023-11-30T17:26:20.384545+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"145'2","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.390515+0000","last_change":"2023-11-30T17:26:19.981375+0000","last_active":"2023-11-30T17:26:20.390515+0000","last_peered":"2023-11-30T17:26:20.390515+0000","last_clean":"2023-11-30T17:26:20.390515+0000","last_became_active":"2023-11-30T17:26:19.981145+0000","last_became_peered":"2023-11-30T17:26:19.981145+0000","last_unstale":"2023-11-30T17:26:20.390515+0000","last_undegraded":"2023-11-30T17:26:20.390515+0000","last_fullsized":"2023-11-30T17:26:20.390515+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.369029+0000","last_change":"2023-11-30T17:26:20.367227+0000","last_active":"2023-11-30T17:26:20.369029+0000","last_peered":"2023-11-30T17:26:20.369029+0000","last_clean":"2023-11-30T17:26:20.369029+0000","last_became_active":"2023-11-30T17:26:20.366972+0000","last_became_peered":"2023-11-30T17:26:20.366972+0000","last_unstale":"2023-11-30T17:26:20.369029+0000","last_undegraded":"2023-11-30T17:26:20.369029+0000","last_fullsized":"2023-11-30T17:26:20.369029+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.369743+0000","last_change":"2023-11-30T17:26:19.990348+0000","last_active":"2023-11-30T17:26:20.369743+0000","last_peered":"2023-11-30T17:26:20.369743+0000","last_clean":"2023-11-30T17:26:20.369743+0000","last_became_active":"2023-11-30T17:26:19.990061+0000","last_became_peered":"2023-11-30T17:26:19.990061+0000","last_unstale":"2023-11-30T17:26:20.369743+0000","last_undegraded":"2023-11-30T17:26:20.369743+0000","last_fullsized":"2023-11-30T17:26:20.369743+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.386210+0000","last_change":"2023-11-30T17:26:20.382452+0000","last_active":"2023-11-30T17:26:20.386210+0000","last_peered":"2023-11-30T17:26:20.386210+0000","last_clean":"2023-11-30T17:26:20.386210+0000","last_became_active":"2023-11-30T17:26:20.382128+0000","last_became_peered":"2023-11-30T17:26:20.382128+0000","last_unstale":"2023-11-30T17:26:20.386210+0000","last_undegraded":"2023-11-30T17:26:20.386210+0000","last_fullsized":"2023-11-30T17:26:20.386210+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.369353+0000","last_change":"2023-11-30T17:26:19.992481+0000","last_active":"2023-11-30T17:26:20.369353+0000","last_peered":"2023-11-30T17:26:20.369353+0000","last_clean":"2023-11-30T17:26:20.369353+0000","last_became_active":"2023-11-30T17:26:19.992238+0000","last_became_peered":"2023-11-30T17:26:19.992238+0000","last_unstale":"2023-11-30T17:26:20.369353+0000","last_undegraded":"2023-11-30T17:26:20.369353+0000","last_fullsized":"2023-11-30T17:26:20.369353+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.372663+0000","last_change":"2023-11-30T17:26:20.367396+0000","last_active":"2023-11-30T17:26:20.372663+0000","last_peered":"2023-11-30T17:26:20.372663+0000","last_clean":"2023-11-30T17:26:20.372663+0000","last_became_active":"2023-11-30T17:26:20.367149+0000","last_became_peered":"2023-11-30T17:26:20.367149+0000","last_unstale":"2023-11-30T17:26:20.372663+0000","last_undegraded":"2023-11-30T17:26:20.372663+0000","last_fullsized":"2023-11-30T17:26:20.372663+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387964+0000","last_change":"2023-11-30T17:26:19.992039+0000","last_active":"2023-11-30T17:26:20.387964+0000","last_peered":"2023-11-30T17:26:20.387964+0000","last_clean":"2023-11-30T17:26:20.387964+0000","last_became_active":"2023-11-30T17:26:19.991746+0000","last_became_peered":"2023-11-30T17:26:19.991746+0000","last_unstale":"2023-11-30T17:26:20.387964+0000","last_undegraded":"2023-11-30T17:26:20.387964+0000","last_fullsized":"2023-11-30T17:26:20.387964+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.389971+0000","last_change":"2023-11-30T17:26:20.387816+0000","last_active":"2023-11-30T17:26:20.389971+0000","last_peered":"2023-11-30T17:26:20.389971+0000","last_clean":"2023-11-30T17:26:20.389971+0000","last_became_active":"2023-11-30T17:26:20.387545+0000","last_became_peered":"2023-11-30T17:26:20.387545+0000","last_unstale":"2023-11-30T17:26:20.389971+0000","last_undegraded":"2023-11-30T17:26:20.389971+0000","last_fullsized":"2023-11-30T17:26:20.389971+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.368559+0000","last_change":"2023-11-30T17:26:19.995200+0000","last_active":"2023-11-30T17:26:20.368559+0000","last_peered":"2023-11-30T17:26:20.368559+0000","last_clean":"2023-11-30T17:26:20.368559+0000","last_became_active":"2023-11-30T17:26:19.994859+0000","last_became_peered":"2023-11-30T17:26:19.994859+0000","last_unstale":"2023-11-30T17:26:20.368559+0000","last_undegraded":"2023-11-30T17:26:20.368559+0000","last_fullsized":"2023-11-30T17:26:20.368559+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388385+0000","last_change":"2023-11-30T17:26:20.384418+0000","last_active":"2023-11-30T17:26:20.388385+0000","last_peered":"2023-11-30T17:26:20.388385+0000","last_clean":"2023-11-30T17:26:20.388385+0000","last_became_active":"2023-11-30T17:26:20.384004+0000","last_became_peered":"2023-11-30T17:26:20.384004+0000","last_unstale":"2023-11-30T17:26:20.388385+0000","last_undegraded":"2023-11-30T17:26:20.388385+0000","last_fullsized":"2023-11-30T17:26:20.388385+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.368469+0000","last_change":"2023-11-30T17:26:19.983949+0000","last_active":"2023-11-30T17:26:20.368469+0000","last_peered":"2023-11-30T17:26:20.368469+0000","last_clean":"2023-11-30T17:26:20.368469+0000","last_became_active":"2023-11-30T17:26:19.983648+0000","last_became_peered":"2023-11-30T17:26:19.983648+0000","last_unstale":"2023-11-30T17:26:20.368469+0000","last_undegraded":"2023-11-30T17:26:20.368469+0000","last_fullsized":"2023-11-30T17:26:20.368469+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.386943+0000","last_change":"2023-11-30T17:26:20.384263+0000","last_active":"2023-11-30T17:26:20.386943+0000","last_peered":"2023-11-30T17:26:20.386943+0000","last_clean":"2023-11-30T17:26:20.386943+0000","last_became_active":"2023-11-30T17:26:20.383973+0000","last_became_peered":"2023-11-30T17:26:20.383973+0000","last_unstale":"2023-11-30T17:26:20.386943+0000","last_undegraded":"2023-11-30T17:26:20.386943+0000","last_fullsized":"2023-11-30T17:26:20.386943+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.368400+0000","last_change":"2023-11-30T17:26:19.992000+0000","last_active":"2023-11-30T17:26:20.368400+0000","last_peered":"2023-11-30T17:26:20.368400+0000","last_clean":"2023-11-30T17:26:20.368400+0000","last_became_active":"2023-11-30T17:26:19.991708+0000","last_became_peered":"2023-11-30T17:26:19.991708+0000","last_unstale":"2023-11-30T17:26:20.368400+0000","last_undegraded":"2023-11-30T17:26:20.368400+0000","last_fullsized":"2023-11-30T17:26:20.368400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388245+0000","last_change":"2023-11-30T17:26:20.379764+0000","last_active":"2023-11-30T17:26:20.388245+0000","last_peered":"2023-11-30T17:26:20.388245+0000","last_clean":"2023-11-30T17:26:20.388245+0000","last_became_active":"2023-11-30T17:26:20.377985+0000","last_became_peered":"2023-11-30T17:26:20.377985+0000","last_unstale":"2023-11-30T17:26:20.388245+0000","last_undegraded":"2023-11-30T17:26:20.388245+0000","last_fullsized":"2023-11-30T17:26:20.388245+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"145'2","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387675+0000","last_change":"2023-11-30T17:26:19.982671+0000","last_active":"2023-11-30T17:26:20.387675+0000","last_peered":"2023-11-30T17:26:20.387675+0000","last_clean":"2023-11-30T17:26:20.387675+0000","last_became_active":"2023-11-30T17:26:19.982327+0000","last_became_peered":"2023-11-30T17:26:19.982327+0000","last_unstale":"2023-11-30T17:26:20.387675+0000","last_undegraded":"2023-11-30T17:26:20.387675+0000","last_fullsized":"2023-11-30T17:26:20.387675+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.377528+0000","last_change":"2023-11-30T17:26:20.372744+0000","last_active":"2023-11-30T17:26:20.377528+0000","last_peered":"2023-11-30T17:26:20.377528+0000","last_clean":"2023-11-30T17:26:20.377528+0000","last_became_active":"2023-11-30T17:26:20.372405+0000","last_became_peered":"2023-11-30T17:26:20.372405+0000","last_unstale":"2023-11-30T17:26:20.377528+0000","last_undegraded":"2023-11-30T17:26:20.377528+0000","last_fullsized":"2023-11-30T17:26:20.377528+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.365733+0000","last_change":"2023-11-30T17:26:19.987336+0000","last_active":"2023-11-30T17:26:20.365733+0000","last_peered":"2023-11-30T17:26:20.365733+0000","last_clean":"2023-11-30T17:26:20.365733+0000","last_became_active":"2023-11-30T17:26:19.987056+0000","last_became_peered":"2023-11-30T17:26:19.987056+0000","last_unstale":"2023-11-30T17:26:20.365733+0000","last_undegraded":"2023-11-30T17:26:20.365733+0000","last_fullsized":"2023-11-30T17:26:20.365733+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387471+0000","last_change":"2023-11-30T17:26:20.384996+0000","last_active":"2023-11-30T17:26:20.387471+0000","last_peered":"2023-11-30T17:26:20.387471+0000","last_clean":"2023-11-30T17:26:20.387471+0000","last_became_active":"2023-11-30T17:26:20.384583+0000","last_became_peered":"2023-11-30T17:26:20.384583+0000","last_unstale":"2023-11-30T17:26:20.387471+0000","last_undegraded":"2023-11-30T17:26:20.387471+0000","last_fullsized":"2023-11-30T17:26:20.387471+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.365840+0000","last_change":"2023-11-30T17:26:19.982892+0000","last_active":"2023-11-30T17:26:20.365840+0000","last_peered":"2023-11-30T17:26:20.365840+0000","last_clean":"2023-11-30T17:26:20.365840+0000","last_became_active":"2023-11-30T17:26:19.982541+0000","last_became_peered":"2023-11-30T17:26:19.982541+0000","last_unstale":"2023-11-30T17:26:20.365840+0000","last_undegraded":"2023-11-30T17:26:20.365840+0000","last_fullsized":"2023-11-30T17:26:20.365840+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.386203+0000","last_change":"2023-11-30T17:26:20.384364+0000","last_active":"2023-11-30T17:26:20.386203+0000","last_peered":"2023-11-30T17:26:20.386203+0000","last_clean":"2023-11-30T17:26:20.386203+0000","last_became_active":"2023-11-30T17:26:20.384056+0000","last_became_peered":"2023-11-30T17:26:20.384056+0000","last_unstale":"2023-11-30T17:26:20.386203+0000","last_undegraded":"2023-11-30T17:26:20.386203+0000","last_fullsized":"2023-11-30T17:26:20.386203+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.362718+0000","last_change":"2023-11-30T17:26:19.992639+0000","last_active":"2023-11-30T17:26:20.362718+0000","last_peered":"2023-11-30T17:26:20.362718+0000","last_clean":"2023-11-30T17:26:20.362718+0000","last_became_active":"2023-11-30T17:26:19.992138+0000","last_became_peered":"2023-11-30T17:26:19.992138+0000","last_unstale":"2023-11-30T17:26:20.362718+0000","last_undegraded":"2023-11-30T17:26:20.362718+0000","last_fullsized":"2023-11-30T17:26:20.362718+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387755+0000","last_change":"2023-11-30T17:26:20.383476+0000","last_active":"2023-11-30T17:26:20.387755+0000","last_peered":"2023-11-30T17:26:20.387755+0000","last_clean":"2023-11-30T17:26:20.387755+0000","last_became_active":"2023-11-30T17:26:20.383216+0000","last_became_peered":"2023-11-30T17:26:20.383216+0000","last_unstale":"2023-11-30T17:26:20.387755+0000","last_undegraded":"2023-11-30T17:26:20.387755+0000","last_fullsized":"2023-11-30T17:26:20.387755+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.373820+0000","last_change":"2023-11-30T17:26:19.989107+0000","last_active":"2023-11-30T17:26:20.373820+0000","last_peered":"2023-11-30T17:26:20.373820+0000","last_clean":"2023-11-30T17:26:20.373820+0000","last_became_active":"2023-11-30T17:26:19.988455+0000","last_became_peered":"2023-11-30T17:26:19.988455+0000","last_unstale":"2023-11-30T17:26:20.373820+0000","last_undegraded":"2023-11-30T17:26:20.373820+0000","last_fullsized":"2023-11-30T17:26:20.373820+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388702+0000","last_change":"2023-11-30T17:26:20.379634+0000","last_active":"2023-11-30T17:26:20.388702+0000","last_peered":"2023-11-30T17:26:20.388702+0000","last_clean":"2023-11-30T17:26:20.388702+0000","last_became_active":"2023-11-30T17:26:20.379397+0000","last_became_peered":"2023-11-30T17:26:20.379397+0000","last_unstale":"2023-11-30T17:26:20.388702+0000","last_undegraded":"2023-11-30T17:26:20.388702+0000","last_fullsized":"2023-11-30T17:26:20.388702+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.373545+0000","last_change":"2023-11-30T17:26:19.981422+0000","last_active":"2023-11-30T17:26:20.373545+0000","last_peered":"2023-11-30T17:26:20.373545+0000","last_clean":"2023-11-30T17:26:20.373545+0000","last_became_active":"2023-11-30T17:26:19.981144+0000","last_became_peered":"2023-11-30T17:26:19.981144+0000","last_unstale":"2023-11-30T17:26:20.373545+0000","last_undegraded":"2023-11-30T17:26:20.373545+0000","last_fullsized":"2023-11-30T17:26:20.373545+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.390207+0000","last_change":"2023-11-30T17:26:20.387973+0000","last_active":"2023-11-30T17:26:20.390207+0000","last_peered":"2023-11-30T17:26:20.390207+0000","last_clean":"2023-11-30T17:26:20.390207+0000","last_became_active":"2023-11-30T17:26:20.387642+0000","last_became_peered":"2023-11-30T17:26:20.387642+0000","last_unstale":"2023-11-30T17:26:20.390207+0000","last_undegraded":"2023-11-30T17:26:20.390207+0000","last_fullsized":"2023-11-30T17:26:20.390207+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.362038+0000","last_change":"2023-11-30T17:26:19.983222+0000","last_active":"2023-11-30T17:26:20.362038+0000","last_peered":"2023-11-30T17:26:20.362038+0000","last_clean":"2023-11-30T17:26:20.362038+0000","last_became_active":"2023-11-30T17:26:19.982924+0000","last_became_peered":"2023-11-30T17:26:19.982924+0000","last_unstale":"2023-11-30T17:26:20.362038+0000","last_undegraded":"2023-11-30T17:26:20.362038+0000","last_fullsized":"2023-11-30T17:26:20.362038+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.382213+0000","last_change":"2023-11-30T17:26:20.378438+0000","last_active":"2023-11-30T17:26:20.382213+0000","last_peered":"2023-11-30T17:26:20.382213+0000","last_clean":"2023-11-30T17:26:20.382213+0000","last_became_active":"2023-11-30T17:26:20.374869+0000","last_became_peered":"2023-11-30T17:26:20.374869+0000","last_unstale":"2023-11-30T17:26:20.382213+0000","last_undegraded":"2023-11-30T17:26:20.382213+0000","last_fullsized":"2023-11-30T17:26:20.382213+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.369625+0000","last_change":"2023-11-30T17:26:19.988134+0000","last_active":"2023-11-30T17:26:20.369625+0000","last_peered":"2023-11-30T17:26:20.369625+0000","last_clean":"2023-11-30T17:26:20.369625+0000","last_became_active":"2023-11-30T17:26:19.987843+0000","last_became_peered":"2023-11-30T17:26:19.987843+0000","last_unstale":"2023-11-30T17:26:20.369625+0000","last_undegraded":"2023-11-30T17:26:20.369625+0000","last_fullsized":"2023-11-30T17:26:20.369625+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388633+0000","last_change":"2023-11-30T17:26:20.379413+0000","last_active":"2023-11-30T17:26:20.388633+0000","last_peered":"2023-11-30T17:26:20.388633+0000","last_clean":"2023-11-30T17:26:20.388633+0000","last_became_active":"2023-11-30T17:26:20.379139+0000","last_became_peered":"2023-11-30T17:26:20.379139+0000","last_unstale":"2023-11-30T17:26:20.388633+0000","last_undegraded":"2023-11-30T17:26:20.388633+0000","last_fullsized":"2023-11-30T17:26:20.388633+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.368642+0000","last_change":"2023-11-30T17:26:19.987984+0000","last_active":"2023-11-30T17:26:20.368642+0000","last_peered":"2023-11-30T17:26:20.368642+0000","last_clean":"2023-11-30T17:26:20.368642+0000","last_became_active":"2023-11-30T17:26:19.986994+0000","last_became_peered":"2023-11-30T17:26:19.986994+0000","last_unstale":"2023-11-30T17:26:20.368642+0000","last_undegraded":"2023-11-30T17:26:20.368642+0000","last_fullsized":"2023-11-30T17:26:20.368642+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":120,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.367486+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:26:20.367486+0000","last_peered":"2023-11-30T17:26:20.367486+0000","last_clean":"2023-11-30T17:26:20.367486+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:26:20.367486+0000","last_undegraded":"2023-11-30T17:26:20.367486+0000","last_fullsized":"2023-11-30T17:26:20.367486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.378419+0000","last_change":"2023-11-30T17:26:20.373690+0000","last_active":"2023-11-30T17:26:20.378419+0000","last_peered":"2023-11-30T17:26:20.378419+0000","last_clean":"2023-11-30T17:26:20.378419+0000","last_became_active":"2023-11-30T17:26:20.373416+0000","last_became_peered":"2023-11-30T17:26:20.373416+0000","last_unstale":"2023-11-30T17:26:20.378419+0000","last_undegraded":"2023-11-30T17:26:20.378419+0000","last_fullsized":"2023-11-30T17:26:20.378419+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.368390+0000","last_change":"2023-11-30T17:26:19.985498+0000","last_active":"2023-11-30T17:26:20.368390+0000","last_peered":"2023-11-30T17:26:20.368390+0000","last_clean":"2023-11-30T17:26:20.368390+0000","last_became_active":"2023-11-30T17:26:19.985216+0000","last_became_peered":"2023-11-30T17:26:19.985216+0000","last_unstale":"2023-11-30T17:26:20.368390+0000","last_undegraded":"2023-11-30T17:26:20.368390+0000","last_fullsized":"2023-11-30T17:26:20.368390+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":119,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.380528+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:26:20.380528+0000","last_peered":"2023-11-30T17:26:20.380528+0000","last_clean":"2023-11-30T17:26:20.380528+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:26:20.380528+0000","last_undegraded":"2023-11-30T17:26:20.380528+0000","last_fullsized":"2023-11-30T17:26:20.380528+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.382119+0000","last_change":"2023-11-30T17:26:20.376591+0000","last_active":"2023-11-30T17:26:20.382119+0000","last_peered":"2023-11-30T17:26:20.382119+0000","last_clean":"2023-11-30T17:26:20.382119+0000","last_became_active":"2023-11-30T17:26:20.376321+0000","last_became_peered":"2023-11-30T17:26:20.376321+0000","last_unstale":"2023-11-30T17:26:20.382119+0000","last_undegraded":"2023-11-30T17:26:20.382119+0000","last_fullsized":"2023-11-30T17:26:20.382119+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.372027+0000","last_change":"2023-11-30T17:26:19.983242+0000","last_active":"2023-11-30T17:26:20.372027+0000","last_peered":"2023-11-30T17:26:20.372027+0000","last_clean":"2023-11-30T17:26:20.372027+0000","last_became_active":"2023-11-30T17:26:19.982752+0000","last_became_peered":"2023-11-30T17:26:19.982752+0000","last_unstale":"2023-11-30T17:26:20.372027+0000","last_undegraded":"2023-11-30T17:26:20.372027+0000","last_fullsized":"2023-11-30T17:26:20.372027+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":125,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.364909+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:26:20.364909+0000","last_peered":"2023-11-30T17:26:20.364909+0000","last_clean":"2023-11-30T17:26:20.364909+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:26:20.364909+0000","last_undegraded":"2023-11-30T17:26:20.364909+0000","last_fullsized":"2023-11-30T17:26:20.364909+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.386117+0000","last_change":"2023-11-30T17:26:20.382988+0000","last_active":"2023-11-30T17:26:20.386117+0000","last_peered":"2023-11-30T17:26:20.386117+0000","last_clean":"2023-11-30T17:26:20.386117+0000","last_became_active":"2023-11-30T17:26:20.381614+0000","last_became_peered":"2023-11-30T17:26:20.381614+0000","last_unstale":"2023-11-30T17:26:20.386117+0000","last_undegraded":"2023-11-30T17:26:20.386117+0000","last_fullsized":"2023-11-30T17:26:20.386117+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"145'4","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387035+0000","last_change":"2023-11-30T17:26:19.983439+0000","last_active":"2023-11-30T17:26:20.387035+0000","last_peered":"2023-11-30T17:26:20.387035+0000","last_clean":"2023-11-30T17:26:20.387035+0000","last_became_active":"2023-11-30T17:26:19.983163+0000","last_became_peered":"2023-11-30T17:26:19.983163+0000","last_unstale":"2023-11-30T17:26:20.387035+0000","last_undegraded":"2023-11-30T17:26:20.387035+0000","last_fullsized":"2023-11-30T17:26:20.387035+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":119,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.380676+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:26:20.380676+0000","last_peered":"2023-11-30T17:26:20.380676+0000","last_clean":"2023-11-30T17:26:20.380676+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:26:20.380676+0000","last_undegraded":"2023-11-30T17:26:20.380676+0000","last_fullsized":"2023-11-30T17:26:20.380676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":118,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.369009+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:26:20.369009+0000","last_peered":"2023-11-30T17:26:20.369009+0000","last_clean":"2023-11-30T17:26:20.369009+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:26:20.369009+0000","last_undegraded":"2023-11-30T17:26:20.369009+0000","last_fullsized":"2023-11-30T17:26:20.369009+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388584+0000","last_change":"2023-11-30T17:26:20.378107+0000","last_active":"2023-11-30T17:26:20.388584+0000","last_peered":"2023-11-30T17:26:20.388584+0000","last_clean":"2023-11-30T17:26:20.388584+0000","last_became_active":"2023-11-30T17:26:20.377828+0000","last_became_peered":"2023-11-30T17:26:20.377828+0000","last_unstale":"2023-11-30T17:26:20.388584+0000","last_undegraded":"2023-11-30T17:26:20.388584+0000","last_fullsized":"2023-11-30T17:26:20.388584+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387999+0000","last_change":"2023-11-30T17:26:19.988123+0000","last_active":"2023-11-30T17:26:20.387999+0000","last_peered":"2023-11-30T17:26:20.387999+0000","last_clean":"2023-11-30T17:26:20.387999+0000","last_became_active":"2023-11-30T17:26:19.987855+0000","last_became_peered":"2023-11-30T17:26:19.987855+0000","last_unstale":"2023-11-30T17:26:20.387999+0000","last_undegraded":"2023-11-30T17:26:20.387999+0000","last_fullsized":"2023-11-30T17:26:20.387999+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":116,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.369095+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:26:20.369095+0000","last_peered":"2023-11-30T17:26:20.369095+0000","last_clean":"2023-11-30T17:26:20.369095+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:26:20.369095+0000","last_undegraded":"2023-11-30T17:26:20.369095+0000","last_fullsized":"2023-11-30T17:26:20.369095+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.391295+0000","last_change":"2023-11-30T17:26:20.387932+0000","last_active":"2023-11-30T17:26:20.391295+0000","last_peered":"2023-11-30T17:26:20.391295+0000","last_clean":"2023-11-30T17:26:20.391295+0000","last_became_active":"2023-11-30T17:26:20.387661+0000","last_became_peered":"2023-11-30T17:26:20.387661+0000","last_unstale":"2023-11-30T17:26:20.391295+0000","last_undegraded":"2023-11-30T17:26:20.391295+0000","last_fullsized":"2023-11-30T17:26:20.391295+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.380774+0000","last_change":"2023-11-30T17:26:19.988366+0000","last_active":"2023-11-30T17:26:20.380774+0000","last_peered":"2023-11-30T17:26:20.380774+0000","last_clean":"2023-11-30T17:26:20.380774+0000","last_became_active":"2023-11-30T17:26:19.988062+0000","last_became_peered":"2023-11-30T17:26:19.988062+0000","last_unstale":"2023-11-30T17:26:20.380774+0000","last_undegraded":"2023-11-30T17:26:20.380774+0000","last_fullsized":"2023-11-30T17:26:20.380774+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":116,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.369831+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:26:20.369831+0000","last_peered":"2023-11-30T17:26:20.369831+0000","last_clean":"2023-11-30T17:26:20.369831+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:26:20.369831+0000","last_undegraded":"2023-11-30T17:26:20.369831+0000","last_fullsized":"2023-11-30T17:26:20.369831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387968+0000","last_change":"2023-11-30T17:26:20.379116+0000","last_active":"2023-11-30T17:26:20.387968+0000","last_peered":"2023-11-30T17:26:20.387968+0000","last_clean":"2023-11-30T17:26:20.387968+0000","last_became_active":"2023-11-30T17:26:20.378824+0000","last_became_peered":"2023-11-30T17:26:20.378824+0000","last_unstale":"2023-11-30T17:26:20.387968+0000","last_undegraded":"2023-11-30T17:26:20.387968+0000","last_fullsized":"2023-11-30T17:26:20.387968+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"145'3","reported_seq":13,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.389927+0000","last_change":"2023-11-30T17:26:19.986818+0000","last_active":"2023-11-30T17:26:20.389927+0000","last_peered":"2023-11-30T17:26:20.389927+0000","last_clean":"2023-11-30T17:26:20.389927+0000","last_became_active":"2023-11-30T17:26:19.986022+0000","last_became_peered":"2023-11-30T17:26:19.986022+0000","last_unstale":"2023-11-30T17:26:20.389927+0000","last_undegraded":"2023-11-30T17:26:20.389927+0000","last_fullsized":"2023-11-30T17:26:20.389927+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":120,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.366892+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:26:20.366892+0000","last_peered":"2023-11-30T17:26:20.366892+0000","last_clean":"2023-11-30T17:26:20.366892+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:26:20.366892+0000","last_undegraded":"2023-11-30T17:26:20.366892+0000","last_fullsized":"2023-11-30T17:26:20.366892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388694+0000","last_change":"2023-11-30T17:26:20.384475+0000","last_active":"2023-11-30T17:26:20.388694+0000","last_peered":"2023-11-30T17:26:20.388694+0000","last_clean":"2023-11-30T17:26:20.388694+0000","last_became_active":"2023-11-30T17:26:20.384010+0000","last_became_peered":"2023-11-30T17:26:20.384010+0000","last_unstale":"2023-11-30T17:26:20.388694+0000","last_undegraded":"2023-11-30T17:26:20.388694+0000","last_fullsized":"2023-11-30T17:26:20.388694+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"145'2","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387207+0000","last_change":"2023-11-30T17:26:19.985131+0000","last_active":"2023-11-30T17:26:20.387207+0000","last_peered":"2023-11-30T17:26:20.387207+0000","last_clean":"2023-11-30T17:26:20.387207+0000","last_became_active":"2023-11-30T17:26:19.984824+0000","last_became_peered":"2023-11-30T17:26:19.984824+0000","last_unstale":"2023-11-30T17:26:20.387207+0000","last_undegraded":"2023-11-30T17:26:20.387207+0000","last_fullsized":"2023-11-30T17:26:20.387207+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":134,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.368724+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:26:20.368724+0000","last_peered":"2023-11-30T17:26:20.368724+0000","last_clean":"2023-11-30T17:26:20.368724+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:26:20.368724+0000","last_undegraded":"2023-11-30T17:26:20.368724+0000","last_fullsized":"2023-11-30T17:26:20.368724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575074,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302972,"kb_used_data":1780,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068868,"statfs":{"total":96636764160,"available":96326520832,"internally_reserved":0,"allocated":1822720,"data_stored":917956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:25:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.315},"max":{"1min":0.67900000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56699999999999995,"15min":0.58299999999999996},"min":{"1min":0.434,"5min":0.41099999999999998,"15min":0.36699999999999999},"max":{"1min":0.68700000000000006,"5min":0.78300000000000003,"15min":0.81899999999999995},"last":0.626}]},{"osd":1,"last update":"Thu Nov 30 17:25:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53600000000000003,"15min":0.54400000000000004},"min":{"1min":0.36199999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.626,"5min":1.181,"15min":1.181},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53300000000000003,"15min":0.54700000000000004},"min":{"1min":0.41599999999999998,"5min":0.32900000000000001,"15min":0.29899999999999999},"max":{"1min":0.64800000000000002,"5min":0.76600000000000001,"15min":0.82499999999999996},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Nov 30 17:25:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.38700000000000001,"5min":0.34200000000000003,"15min":0.33500000000000002},"max":{"1min":0.63800000000000001,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.54000000000000004,"15min":0.55500000000000005},"min":{"1min":0.38700000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.66500000000000004,"5min":0.73699999999999999,"15min":0.83899999999999997},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Nov 30 17:25:47 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.52200000000000002,"15min":0.53900000000000003},"min":{"1min":0.376,"5min":0.36699999999999999,"15min":0.36299999999999999},"max":{"1min":0.65100000000000002,"5min":0.749,"15min":0.78000000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57899999999999996,"15min":0.58399999999999996},"min":{"1min":0.40400000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68000000000000005,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.64800000000000002}]},{"osd":4,"last update":"Thu Nov 30 17:25:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.30099999999999999,"5min":0.29899999999999999,"15min":0.29699999999999999},"max":{"1min":0.68799999999999994,"5min":0.77000000000000002,"15min":0.77500000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.48599999999999999,"15min":0.47999999999999998},"min":{"1min":0.32200000000000001,"5min":0.30099999999999999,"15min":0.29399999999999998},"max":{"1min":0.66600000000000004,"5min":0.748,"15min":0.75800000000000001},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Nov 30 17:25:47 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.49099999999999999,"15min":0.48699999999999999},"min":{"1min":0.34399999999999997,"5min":0.313,"15min":0.29499999999999998},"max":{"1min":0.70299999999999996,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52600000000000002,"15min":0.52100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33300000000000002,"15min":0.32200000000000001},"max":{"1min":0.72599999999999998,"5min":0.80000000000000004,"15min":0.81299999999999994},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Nov 30 17:25:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.36799999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.72599999999999998,"5min":0.81200000000000006,"15min":0.85199999999999998},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.33300000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65700000000000003,"5min":0.78900000000000003,"15min":0.92800000000000005},"last":0.64000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575073,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302964,"kb_used_data":1772,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068876,"statfs":{"total":96636764160,"available":96326529024,"internally_reserved":0,"allocated":1814528,"data_stored":918316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:25:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.57099999999999995},"min":{"1min":0.38800000000000001,"5min":0.32500000000000001,"15min":0.27700000000000002},"max":{"1min":0.69799999999999995,"5min":0.80200000000000005,"15min":0.82899999999999996},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56999999999999995,"15min":0.58699999999999997},"min":{"1min":0.44800000000000001,"5min":0.33500000000000002,"15min":0.308},"max":{"1min":0.75600000000000001,"5min":0.83599999999999997,"15min":0.89300000000000002},"last":0.442}]},{"osd":1,"last update":"Thu Nov 30 17:25:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.56100000000000005},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.74199999999999999,"5min":0.78400000000000003,"15min":0.78500000000000003},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58399999999999996,"15min":0.59799999999999998},"min":{"1min":0.46600000000000003,"5min":0.35899999999999999,"15min":0.313},"max":{"1min":0.78800000000000003,"5min":0.80000000000000004,"15min":0.85199999999999998},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:25:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54400000000000004,"15min":0.56799999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.26500000000000001},"max":{"1min":0.68600000000000005,"5min":0.77500000000000002,"15min":0.80100000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57399999999999995,"15min":0.58299999999999996},"min":{"1min":0.39100000000000001,"5min":0.34399999999999997,"15min":0.34300000000000003},"max":{"1min":0.76600000000000001,"5min":0.82299999999999995,"15min":0.82499999999999996},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Nov 30 17:25:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51100000000000001,"15min":0.52800000000000002},"min":{"1min":0.40000000000000002,"5min":0.32700000000000001,"15min":0.28299999999999997},"max":{"1min":0.67300000000000004,"5min":0.71899999999999997,"15min":0.77200000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52400000000000002,"15min":0.53800000000000003},"min":{"1min":0.434,"5min":0.307,"15min":0.307},"max":{"1min":0.72899999999999998,"5min":0.73499999999999999,"15min":0.79600000000000004},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:25:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.44900000000000001,"15min":0.44800000000000001},"min":{"1min":0.33500000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.80300000000000005,"5min":0.80800000000000005,"15min":0.84199999999999997},"last":0.62},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.46899999999999997,"15min":0.47399999999999998},"min":{"1min":0.35699999999999998,"5min":0.316,"15min":0.23100000000000001},"max":{"1min":0.67000000000000004,"5min":0.746,"15min":0.83899999999999997},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Nov 30 17:25:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46200000000000002,"15min":0.46800000000000003},"min":{"1min":0.34399999999999997,"5min":0.315,"15min":0.29899999999999999},"max":{"1min":0.629,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.502,"15min":0.503},"min":{"1min":0.379,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84299999999999997,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Nov 30 17:25:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52600000000000002},"min":{"1min":0.36599999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71799999999999997,"5min":0.80000000000000004,"15min":0.93200000000000005},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55100000000000005,"15min":0.55700000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.34300000000000003},"max":{"1min":0.77700000000000002,"5min":0.81299999999999994,"15min":0.83499999999999996},"last":0.67200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575073,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307060,"kb_used_data":1772,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064780,"statfs":{"total":96636764160,"available":96322334720,"internally_reserved":0,"allocated":1814528,"data_stored":917784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:25:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.36399999999999999,"15min":0.35999999999999999},"min":{"1min":0.247,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.56799999999999995,"5min":1.78,"15min":1.78},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.46999999999999997,"15min":0.47099999999999997},"min":{"1min":0.34699999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.62,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Nov 30 17:25:55 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.39200000000000002,"15min":0.39100000000000001},"min":{"1min":0.253,"5min":0.249,"15min":0.215},"max":{"1min":0.52100000000000002,"5min":1.665,"15min":1.665},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.495,"15min":0.502},"min":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.33400000000000002},"max":{"1min":0.66700000000000004,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Nov 30 17:25:55 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.307,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70999999999999996,"5min":1.865,"15min":1.865},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.42799999999999999,"15min":0.433},"min":{"1min":0.29499999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57499999999999996,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.442}]},{"osd":4,"last update":"Thu Nov 30 17:25:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58499999999999996,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.35499999999999998,"15min":0.34499999999999997},"max":{"1min":0.80300000000000005,"5min":0.873,"15min":0.89100000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.496,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.75900000000000001,"5min":0.85099999999999998,"15min":1.111},"last":0.75800000000000001}]},{"osd":5,"last update":"Thu Nov 30 17:25:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61099999999999999,"15min":0.60799999999999998},"min":{"1min":0.44700000000000001,"5min":0.39300000000000002,"15min":0.377},"max":{"1min":0.78000000000000003,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.60399999999999998,"15min":0.60899999999999999},"min":{"1min":0.47899999999999998,"5min":0.39300000000000002,"15min":0.36899999999999999},"max":{"1min":0.83999999999999997,"5min":0.874,"15min":0.91300000000000003},"last":0.76300000000000001}]},{"osd":6,"last update":"Thu Nov 30 17:25:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65200000000000002,"15min":0.66000000000000003},"min":{"1min":0.48899999999999999,"5min":0.442,"15min":0.39700000000000002},"max":{"1min":0.80100000000000005,"5min":0.91000000000000003,"15min":1.0600000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.65200000000000002,"15min":0.66000000000000003},"min":{"1min":0.48599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.82499999999999996,"5min":1.635,"15min":1.635},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Nov 30 17:25:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66300000000000003,"15min":0.67100000000000004},"min":{"1min":0.49199999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.86899999999999999,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.751},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.63800000000000001,"15min":0.65000000000000002},"min":{"1min":0.46000000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.879,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.79800000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575073,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302972,"kb_used_data":1780,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068868,"statfs":{"total":96636764160,"available":96326520832,"internally_reserved":0,"allocated":1822720,"data_stored":919230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 17:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.35399999999999998,"15min":0.36399999999999999},"min":{"1min":0.24199999999999999,"5min":0.23200000000000001,"15min":0.221},"max":{"1min":0.46100000000000002,"5min":0.54900000000000004,"15min":0.71199999999999997},"last":0.313},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.372,"15min":0.38200000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.21099999999999999},"max":{"1min":0.45600000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Nov 30 17:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.38100000000000001,"15min":0.38700000000000001},"min":{"1min":0.26300000000000001,"5min":0.24399999999999999,"15min":0.23899999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.441,"15min":0.45600000000000002},"min":{"1min":0.318,"5min":0.253,"15min":0.253},"max":{"1min":0.55800000000000005,"5min":0.65100000000000002,"15min":0.70499999999999996},"last":0.36399999999999999}]},{"osd":3,"last update":"Thu Nov 30 17:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.40999999999999998,"15min":0.42799999999999999},"min":{"1min":0.32300000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.58299999999999996,"5min":0.61699999999999999,"15min":0.66100000000000003},"last":0.371},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.43099999999999999,"15min":0.442},"min":{"1min":0.29999999999999999,"5min":0.27300000000000002,"15min":0.26600000000000001},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Nov 30 17:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57899999999999996,"15min":0.59999999999999998},"min":{"1min":0.40200000000000002,"5min":0.34999999999999998,"15min":0.34100000000000003},"max":{"1min":0.76400000000000001,"5min":0.78800000000000003,"15min":0.96099999999999997},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59099999999999997,"15min":0.61399999999999999},"min":{"1min":0.44400000000000001,"5min":0.379,"15min":0.33300000000000002},"max":{"1min":0.79000000000000004,"5min":0.86899999999999999,"15min":0.98599999999999999},"last":0.42599999999999999}]},{"osd":5,"last update":"Thu Nov 30 17:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59499999999999997,"15min":0.60099999999999998},"min":{"1min":0.41699999999999998,"5min":0.41199999999999998,"15min":0.39200000000000002},"max":{"1min":0.80500000000000005,"5min":0.86799999999999999,"15min":1.0109999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60099999999999998,"15min":0.622},"min":{"1min":0.439,"5min":0.40300000000000002,"15min":0.38400000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":1.004},"last":0.438}]},{"osd":6,"last update":"Thu Nov 30 17:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.374,"15min":0.374},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":1.002},"last":0.495},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61199999999999999,"15min":0.629},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.35299999999999998},"max":{"1min":0.83699999999999997,"5min":0.91500000000000004,"15min":0.96799999999999997},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Nov 30 17:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63100000000000001,"15min":0.64700000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.81299999999999994,"5min":0.94499999999999995,"15min":1.0129999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.66000000000000003,"15min":0.68200000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.40400000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.026},"last":0.53400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575073,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307052,"kb_used_data":1764,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064788,"statfs":{"total":96636764160,"available":96322342912,"internally_reserved":0,"allocated":1806336,"data_stored":911964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.41699999999999998,"15min":0.40300000000000002},"min":{"1min":0.27200000000000002,"5min":0.221,"15min":0.19900000000000001},"max":{"1min":0.58199999999999996,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.43099999999999999,"15min":0.436},"min":{"1min":0.27900000000000003,"5min":0.254,"15min":0.24199999999999999},"max":{"1min":0.57399999999999995,"5min":2.637,"15min":2.637},"last":0.36899999999999999}]},{"osd":1,"last update":"Thu Nov 30 17:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.48299999999999998,"15min":0.46000000000000002},"min":{"1min":0.32600000000000001,"5min":0.23599999999999999,"15min":0.22900000000000001},"max":{"1min":0.58099999999999996,"5min":6.1210000000000004,"15min":6.1210000000000004},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.503,"15min":0.48599999999999999},"min":{"1min":0.32800000000000001,"5min":0.30399999999999999,"15min":0.26700000000000002},"max":{"1min":0.59999999999999998,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.33500000000000002}]},{"osd":3,"last update":"Thu Nov 30 17:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.38400000000000001,"15min":0.40000000000000002},"min":{"1min":0.30499999999999999,"5min":0.23999999999999999,"15min":0.20599999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.86199999999999999},"last":0.313},{"interface":"front","average":{"1min":0.441,"5min":0.44700000000000001,"15min":0.46400000000000002},"min":{"1min":0.29299999999999998,"5min":0.28499999999999998,"15min":0.26900000000000002},"max":{"1min":0.626,"5min":1.756,"15min":1.756},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.68600000000000005,"15min":0.64700000000000002},"min":{"1min":0.41099999999999998,"5min":0.40300000000000002,"15min":0.33500000000000002},"max":{"1min":0.83299999999999996,"5min":8.7170000000000005,"15min":8.7170000000000005},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59199999999999997,"15min":0.60799999999999998},"min":{"1min":0.45600000000000002,"5min":0.40999999999999998,"15min":0.371},"max":{"1min":0.81299999999999994,"5min":1.381,"15min":1.492},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Nov 30 17:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.629,"15min":0.63700000000000001},"min":{"1min":0.42599999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83699999999999997,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.441,"5min":0.39200000000000002,"15min":0.38900000000000001},"max":{"1min":0.80600000000000005,"5min":1.982,"15min":1.982},"last":0.73299999999999998}]},{"osd":6,"last update":"Thu Nov 30 17:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60299999999999998,"15min":0.626},"min":{"1min":0.438,"5min":0.40899999999999997,"15min":0.39600000000000002},"max":{"1min":0.82099999999999995,"5min":0.95999999999999996,"15min":1.359},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65300000000000002,"15min":0.66400000000000003},"min":{"1min":0.434,"5min":0.42999999999999999,"15min":0.39600000000000002},"max":{"1min":0.86599999999999999,"5min":1.861,"15min":1.861},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Nov 30 17:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46300000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.82499999999999996,"5min":4.6849999999999996,"15min":4.6849999999999996},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69799999999999995,"15min":0.69399999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.877,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.747}]}]},{"osd":3,"up_from":13,"seq":55834575073,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311164,"kb_used_data":1780,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060676,"statfs":{"total":96636764160,"available":96318132224,"internally_reserved":0,"allocated":1822720,"data_stored":918440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:25:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.36099999999999999},"min":{"1min":0.224,"5min":0.222,"15min":0.219},"max":{"1min":0.45200000000000001,"5min":0.51100000000000001,"15min":0.66200000000000003},"last":0.20999999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.38200000000000001,"15min":0.40200000000000002},"min":{"1min":0.23499999999999999,"5min":0.22500000000000001,"15min":0.218},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.67600000000000005},"last":0.34799999999999998}]},{"osd":1,"last update":"Thu Nov 30 17:25:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.35699999999999998,"15min":0.38400000000000001},"min":{"1min":0.23799999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.47799999999999998,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.307},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39800000000000002,"15min":0.42599999999999999},"min":{"1min":0.29199999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.53500000000000003,"5min":0.59699999999999998,"15min":0.73399999999999999},"last":0.27300000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:25:43 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41899999999999998,"15min":0.45000000000000001},"min":{"1min":0.27200000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.54500000000000004,"5min":0.66000000000000003,"15min":0.94899999999999995},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47199999999999998,"15min":0.50600000000000001},"min":{"1min":0.34399999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.61499999999999999,"5min":0.68600000000000005,"15min":1.054},"last":0.32000000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:25:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58399999999999996,"15min":0.60499999999999998},"min":{"1min":0.378,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69799999999999995,"5min":0.89900000000000002,"15min":0.97599999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58299999999999996,"15min":0.60799999999999998},"min":{"1min":0.436,"5min":0.315,"15min":0.315},"max":{"1min":0.76400000000000001,"5min":0.82899999999999996,"15min":0.86799999999999999},"last":0.46999999999999997}]},{"osd":5,"last update":"Thu Nov 30 17:25:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57999999999999996,"15min":0.60499999999999998},"min":{"1min":0.46300000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78200000000000003,"5min":0.91400000000000003,"15min":0.98399999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60899999999999999,"15min":0.63600000000000001},"min":{"1min":0.39000000000000001,"5min":0.372,"15min":0.34699999999999998},"max":{"1min":0.81499999999999995,"5min":0.92800000000000005,"15min":1.1779999999999999},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Nov 30 17:25:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60699999999999998,"15min":0.63400000000000001},"min":{"1min":0.46899999999999997,"5min":0.39800000000000002,"15min":0.32300000000000001},"max":{"1min":0.76500000000000001,"5min":0.86599999999999999,"15min":1.1419999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61799999999999999,"15min":0.64500000000000002},"min":{"1min":0.45600000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.78200000000000003,"5min":0.94599999999999995,"15min":1.0389999999999999},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Nov 30 17:25:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.624,"15min":0.65400000000000003},"min":{"1min":0.496,"5min":0.40699999999999997,"15min":0.40500000000000003},"max":{"1min":0.78400000000000003,"5min":0.97599999999999998,"15min":1.0660000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.623,"15min":0.65600000000000003},"min":{"1min":0.434,"5min":0.38,"15min":0.38},"max":{"1min":0.81200000000000006,"5min":0.98999999999999999,"15min":0.99399999999999999},"last":0.55000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575073,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302968,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068872,"statfs":{"total":96636764160,"available":96326524928,"internally_reserved":0,"allocated":1818624,"data_stored":918406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51000000000000001,"15min":0.52600000000000002},"min":{"1min":0.317,"5min":0.30599999999999999,"15min":0.27500000000000002},"max":{"1min":0.72799999999999998,"5min":0.748,"15min":0.77700000000000002},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.501,"5min":0.51400000000000001,"15min":0.53700000000000003},"min":{"1min":0.33400000000000002,"5min":0.28399999999999997,"15min":0.26600000000000001},"max":{"1min":0.66500000000000004,"5min":0.81999999999999995,"15min":1.1879999999999999},"last":0.76200000000000001}]},{"osd":1,"last update":"Thu Nov 30 17:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51900000000000002,"15min":0.53700000000000003},"min":{"1min":0.373,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.77100000000000002},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.53000000000000003,"15min":0.54200000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.30399999999999999},"max":{"1min":0.64600000000000002,"5min":0.77800000000000002,"15min":1.2170000000000001},"last":0.70899999999999996}]},{"osd":2,"last update":"Thu Nov 30 17:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.54900000000000004,"15min":0.56999999999999995},"min":{"1min":0.38500000000000001,"5min":0.36899999999999999,"15min":0.34499999999999997},"max":{"1min":0.68200000000000005,"5min":0.75700000000000001,"15min":0.84099999999999997},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56799999999999995,"15min":0.58799999999999997},"min":{"1min":0.41499999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77300000000000002,"5min":0.78600000000000003,"15min":0.81399999999999995},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Nov 30 17:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.52600000000000002,"15min":0.54300000000000004},"min":{"1min":0.35499999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71299999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54500000000000004,"15min":0.56200000000000006},"min":{"1min":0.38900000000000001,"5min":0.36399999999999999,"15min":0.33100000000000002},"max":{"1min":0.70499999999999996,"5min":0.76500000000000001,"15min":0.79200000000000004},"last":0.748}]},{"osd":5,"last update":"Thu Nov 30 17:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.42799999999999999,"15min":0.433},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.59499999999999997,"5min":0.73599999999999999,"15min":1.272},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.44,"15min":0.44800000000000001},"min":{"1min":0.29699999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.68200000000000005,"5min":0.83399999999999996,"15min":1.1559999999999999},"last":0.42599999999999999}]},{"osd":6,"last update":"Thu Nov 30 17:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48899999999999999,"15min":0.49099999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.314},"max":{"1min":0.65000000000000002,"5min":0.997,"15min":1.2949999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.52800000000000002,"15min":0.53200000000000003},"min":{"1min":0.34899999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.67100000000000004,"5min":0.86499999999999999,"15min":1.129},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Nov 30 17:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.497,"15min":0.502},"min":{"1min":0.29699999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72799999999999998,"5min":0.81999999999999995,"15min":0.82199999999999995},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.55500000000000005,"15min":0.56200000000000006},"min":{"1min":0.42299999999999999,"5min":0.34999999999999998,"15min":0.34599999999999997},"max":{"1min":0.69599999999999995,"5min":0.91500000000000004,"15min":1.2470000000000001},"last":0.55000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575073,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302952,"kb_used_data":1760,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068888,"statfs":{"total":96636764160,"available":96326541312,"internally_reserved":0,"allocated":1802240,"data_stored":911092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52700000000000002,"15min":0.53600000000000003},"min":{"1min":0.379,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71399999999999997,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.35999999999999999,"5min":0.316,"15min":0.31},"max":{"1min":0.78000000000000003,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Nov 30 17:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52100000000000002,"15min":0.53200000000000003},"min":{"1min":0.40200000000000002,"5min":0.33500000000000002,"15min":0.32300000000000001},"max":{"1min":0.72299999999999998,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.44},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52200000000000002,"15min":0.54400000000000004},"min":{"1min":0.38700000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.65100000000000002,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.53100000000000003}]},{"osd":2,"last update":"Thu Nov 30 17:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56699999999999995,"15min":0.58499999999999996},"min":{"1min":0.44500000000000001,"5min":0.36399999999999999,"15min":0.30599999999999999},"max":{"1min":0.81799999999999995,"5min":1.028,"15min":1.028},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57399999999999995,"15min":0.59399999999999997},"min":{"1min":0.437,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77200000000000002,"5min":1.046,"15min":1.046},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Nov 30 17:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.54500000000000004},"min":{"1min":0.35499999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.747,"5min":1.002,"15min":1.002},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.39300000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.70399999999999996,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Nov 30 17:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.44,"15min":0.434},"min":{"1min":0.312,"5min":0.27600000000000002,"15min":0.25900000000000001},"max":{"1min":0.69499999999999995,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.46700000000000003,"15min":0.46300000000000002},"min":{"1min":0.30299999999999999,"5min":0.29299999999999998,"15min":0.27600000000000002},"max":{"1min":0.69299999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.45900000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48899999999999999,"15min":0.48299999999999998},"min":{"1min":0.32900000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73099999999999998,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55000000000000004,"15min":0.54500000000000004},"min":{"1min":0.439,"5min":0.34499999999999997,"15min":0.33500000000000002},"max":{"1min":0.72299999999999998,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.625}]},{"osd":7,"last update":"Thu Nov 30 17:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.35999999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68200000000000005,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57399999999999995,"15min":0.57099999999999995},"min":{"1min":0.40300000000000002,"5min":0.35799999999999998,"15min":0.34899999999999998},"max":{"1min":0.755,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.64100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:26:24.407 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T17:26:24.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.548+0000 7ff98a0e4700 1 Processor -- start 2023-11-30T17:26:24.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.548+0000 7ff98a0e4700 1 -- start start 2023-11-30T17:26:24.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.549+0000 7ff98a0e4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9841544e0 0x7ff9841548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:24.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.549+0000 7ff98a0e4700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff98406a610 0x7ff9840c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:24.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.549+0000 7ff98a0e4700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff9840c6e30 0x7ff9840c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:24.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.549+0000 7ff98a0e4700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9840c69a0 con 0x7ff9840c6e30 2023-11-30T17:26:24.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.549+0000 7ff98a0e4700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9840c13a0 con 0x7ff98406a610 2023-11-30T17:26:24.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.549+0000 7ff98a0e4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9840c1680 con 0x7ff9841544e0 2023-11-30T17:26:24.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.549+0000 7ff983fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff9840c6e30 0x7ff9840c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:24.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.549+0000 7ff983fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff9840c6e30 0x7ff9840c72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36662/0 (socket says 172.21.15.49:36662) 2023-11-30T17:26:24.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.549+0000 7ff983fff700 1 -- 172.21.15.49:0/2923768786 learned_addr learned my addr 172.21.15.49:0/2923768786 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:24.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.549+0000 7ff9837fe700 1 --2- 172.21.15.49:0/2923768786 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9841544e0 0x7ff9841548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:24.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.549+0000 7ff982ffd700 1 --2- 172.21.15.49:0/2923768786 >> v2:172.21.15.115:3300/0 conn(0x7ff98406a610 0x7ff9840c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:24.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.550+0000 7ff983fff700 1 -- 172.21.15.49:0/2923768786 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9841544e0 msgr2=0x7ff9841548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:24.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.550+0000 7ff983fff700 1 --2- 172.21.15.49:0/2923768786 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9841544e0 0x7ff9841548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:24.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.550+0000 7ff983fff700 1 -- 172.21.15.49:0/2923768786 >> v2:172.21.15.115:3300/0 conn(0x7ff98406a610 msgr2=0x7ff9840c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:24.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.550+0000 7ff983fff700 1 --2- 172.21.15.49:0/2923768786 >> v2:172.21.15.115:3300/0 conn(0x7ff98406a610 0x7ff9840c0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:24.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.550+0000 7ff983fff700 1 -- 172.21.15.49:0/2923768786 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9840c6630 con 0x7ff9840c6e30 2023-11-30T17:26:24.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.550+0000 7ff983fff700 1 --2- 172.21.15.49:0/2923768786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9840c6e30 0x7ff9840c72c0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7ff984084a90 tx=0x7ff97c009840).ready entity=mon.0 client_cookie=ac31e88bd06f9a4a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:24.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.550+0000 7ff9827fc700 1 -- 172.21.15.49:0/2923768786 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c00e070 con 0x7ff9840c6e30 2023-11-30T17:26:24.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.550+0000 7ff9827fc700 1 -- 172.21.15.49:0/2923768786 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97c00b970 con 0x7ff9840c6e30 2023-11-30T17:26:24.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.550+0000 7ff9827fc700 1 -- 172.21.15.49:0/2923768786 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c00bcf0 con 0x7ff9840c6e30 2023-11-30T17:26:24.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.551+0000 7ff98a0e4700 1 -- 172.21.15.49:0/2923768786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9840c6e30 msgr2=0x7ff9840c72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:24.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.551+0000 7ff98a0e4700 1 --2- 172.21.15.49:0/2923768786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9840c6e30 0x7ff9840c72c0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7ff984084a90 tx=0x7ff97c009840).stop 2023-11-30T17:26:24.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.551+0000 7ff98a0e4700 1 -- 172.21.15.49:0/2923768786 shutdown_connections 2023-11-30T17:26:24.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.551+0000 7ff98a0e4700 1 --2- 172.21.15.49:0/2923768786 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9841544e0 0x7ff9841548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:24.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.551+0000 7ff98a0e4700 1 --2- 172.21.15.49:0/2923768786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9840c6e30 0x7ff9840c72c0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:24.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.551+0000 7ff98a0e4700 1 --2- 172.21.15.49:0/2923768786 >> v2:172.21.15.115:3300/0 conn(0x7ff98406a610 0x7ff9840c0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:24.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.551+0000 7ff98a0e4700 1 -- 172.21.15.49:0/2923768786 >> 172.21.15.49:0/2923768786 conn(0x7ff984085020 msgr2=0x7ff984094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:24.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.551+0000 7ff98a0e4700 1 -- 172.21.15.49:0/2923768786 shutdown_connections 2023-11-30T17:26:24.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.551+0000 7ff98a0e4700 1 -- 172.21.15.49:0/2923768786 wait complete. 2023-11-30T17:26:24.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.552+0000 7ff98a0e4700 1 Processor -- start 2023-11-30T17:26:24.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.552+0000 7ff98a0e4700 1 -- start start 2023-11-30T17:26:24.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.553+0000 7ff98a0e4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff98406a610 0x7ff9841536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:24.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.553+0000 7ff98a0e4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9840c6e30 0x7ff9840955c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:24.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.553+0000 7ff98a0e4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9841544e0 0x7ff98414fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:24.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.553+0000 7ff98a0e4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff984153520 con 0x7ff9840c6e30 2023-11-30T17:26:24.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.553+0000 7ff98a0e4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff984153bd0 con 0x7ff98406a610 2023-11-30T17:26:24.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.553+0000 7ff98a0e4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff984095130 con 0x7ff9841544e0 2023-11-30T17:26:24.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.553+0000 7ff982ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9840c6e30 0x7ff9840955c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:24.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.553+0000 7ff982ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9840c6e30 0x7ff9840955c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36676/0 (socket says 172.21.15.49:36676) 2023-11-30T17:26:24.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.553+0000 7ff982ffd700 1 -- 172.21.15.49:0/2700788427 learned_addr learned my addr 172.21.15.49:0/2700788427 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:24.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.553+0000 7ff9837fe700 1 --2- 172.21.15.49:0/2700788427 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff98406a610 0x7ff9841536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:24.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.553+0000 7ff983fff700 1 --2- 172.21.15.49:0/2700788427 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9841544e0 0x7ff98414fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:24.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.553+0000 7ff982ffd700 1 -- 172.21.15.49:0/2700788427 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9841544e0 msgr2=0x7ff98414fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:24.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.553+0000 7ff982ffd700 1 --2- 172.21.15.49:0/2700788427 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9841544e0 0x7ff98414fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:24.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.553+0000 7ff982ffd700 1 -- 172.21.15.49:0/2700788427 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff98406a610 msgr2=0x7ff9841536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:24.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.553+0000 7ff982ffd700 1 --2- 172.21.15.49:0/2700788427 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff98406a610 0x7ff9841536e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:24.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.553+0000 7ff982ffd700 1 -- 172.21.15.49:0/2700788427 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97c009ae0 con 0x7ff9840c6e30 2023-11-30T17:26:24.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.553+0000 7ff982ffd700 1 --2- 172.21.15.49:0/2700788427 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9840c6e30 0x7ff9840955c0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7ff97800e900 tx=0x7ff978009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:24.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.553+0000 7ff96b7fe700 1 -- 172.21.15.49:0/2700788427 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff978012600 con 0x7ff9840c6e30 2023-11-30T17:26:24.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.553+0000 7ff96b7fe700 1 -- 172.21.15.49:0/2700788427 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff978012760 con 0x7ff9840c6e30 2023-11-30T17:26:24.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.553+0000 7ff98a0e4700 1 -- 172.21.15.49:0/2700788427 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff984153240 con 0x7ff9840c6e30 2023-11-30T17:26:24.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.553+0000 7ff96b7fe700 1 -- 172.21.15.49:0/2700788427 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff978012ae0 con 0x7ff9840c6e30 2023-11-30T17:26:24.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.554+0000 7ff98a0e4700 1 -- 172.21.15.49:0/2700788427 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff984094dc0 con 0x7ff9840c6e30 2023-11-30T17:26:24.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.555+0000 7ff98a0e4700 1 -- 172.21.15.49:0/2700788427 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9840952e0 con 0x7ff9840c6e30 2023-11-30T17:26:24.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.555+0000 7ff96b7fe700 1 -- 172.21.15.49:0/2700788427 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff97801b400 con 0x7ff9840c6e30 2023-11-30T17:26:24.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.555+0000 7ff96b7fe700 1 --2- 172.21.15.49:0/2700788427 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff97005f270 0x7ff970061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:24.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.555+0000 7ff96b7fe700 1 -- 172.21.15.49:0/2700788427 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6177+0+0 (secure 0 0 0) 0x7ff97807a630 con 0x7ff9840c6e30 2023-11-30T17:26:24.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.555+0000 7ff9837fe700 1 --2- 172.21.15.49:0/2700788427 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff97005f270 0x7ff970061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:24.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.556+0000 7ff9837fe700 1 --2- 172.21.15.49:0/2700788427 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff97005f270 0x7ff970061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7ff974006fd0 tx=0x7ff974006f40).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:24.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.559+0000 7ff96b7fe700 1 -- 172.21.15.49:0/2700788427 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff9840952e0 con 0x7ff9840c6e30 2023-11-30T17:26:24.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.728+0000 7ff98a0e4700 1 -- 172.21.15.49:0/2700788427 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff9840952a0 con 0x7ff97005f270 2023-11-30T17:26:24.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.738+0000 7ff96b7fe700 1 -- 172.21.15.49:0/2700788427 <== mgr.6737 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361841 (secure 0 0 0) 0x7ff9840952a0 con 0x7ff97005f270 2023-11-30T17:26:24.745 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:26:24.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.741+0000 7ff98a0e4700 1 -- 172.21.15.49:0/2700788427 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff97005f270 msgr2=0x7ff970061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:24.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.741+0000 7ff98a0e4700 1 --2- 172.21.15.49:0/2700788427 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff97005f270 0x7ff970061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7ff974006fd0 tx=0x7ff974006f40).stop 2023-11-30T17:26:24.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.741+0000 7ff98a0e4700 1 -- 172.21.15.49:0/2700788427 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9840c6e30 msgr2=0x7ff9840955c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:24.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.741+0000 7ff98a0e4700 1 --2- 172.21.15.49:0/2700788427 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9840c6e30 0x7ff9840955c0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7ff97800e900 tx=0x7ff978009060).stop 2023-11-30T17:26:24.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.741+0000 7ff98a0e4700 1 -- 172.21.15.49:0/2700788427 shutdown_connections 2023-11-30T17:26:24.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.741+0000 7ff98a0e4700 1 --2- 172.21.15.49:0/2700788427 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9841544e0 0x7ff98414fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:24.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.741+0000 7ff98a0e4700 1 --2- 172.21.15.49:0/2700788427 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff98406a610 0x7ff9841536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:24.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.741+0000 7ff98a0e4700 1 --2- 172.21.15.49:0/2700788427 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff97005f270 0x7ff970061730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:24.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.741+0000 7ff98a0e4700 1 --2- 172.21.15.49:0/2700788427 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9840c6e30 0x7ff9840955c0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:24.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.741+0000 7ff98a0e4700 1 -- 172.21.15.49:0/2700788427 >> 172.21.15.49:0/2700788427 conn(0x7ff984085020 msgr2=0x7ff9840ae6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:24.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.741+0000 7ff98a0e4700 1 -- 172.21.15.49:0/2700788427 shutdown_connections 2023-11-30T17:26:24.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.742+0000 7ff98a0e4700 1 -- 172.21.15.49:0/2700788427 wait complete. 2023-11-30T17:26:24.749 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T17:26:24.756 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-30T17:26:23.265351+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":264,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2440104,"kb_used_data":14184,"kb_used_omap":0,"kb_used_meta":2425856,"kb_avail":752534616,"statfs":{"total":773094113280,"available":770595446784,"internally_reserved":0,"allocated":14524416,"data_stored":7333188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2484076544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-20934,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-71,"num_write_kb":-47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.016471"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.385466+0000","last_change":"2023-11-30T17:26:20.381095+0000","last_active":"2023-11-30T17:26:20.385466+0000","last_peered":"2023-11-30T17:26:20.385466+0000","last_clean":"2023-11-30T17:26:20.385466+0000","last_became_active":"2023-11-30T17:26:20.380794+0000","last_became_peered":"2023-11-30T17:26:20.380794+0000","last_unstale":"2023-11-30T17:26:20.385466+0000","last_undegraded":"2023-11-30T17:26:20.385466+0000","last_fullsized":"2023-11-30T17:26:20.385466+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3f","version":"145'3","reported_seq":13,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.389395+0000","last_change":"2023-11-30T17:26:19.987503+0000","last_active":"2023-11-30T17:26:20.389395+0000","last_peered":"2023-11-30T17:26:20.389395+0000","last_clean":"2023-11-30T17:26:20.389395+0000","last_became_active":"2023-11-30T17:26:19.987201+0000","last_became_peered":"2023-11-30T17:26:19.987201+0000","last_unstale":"2023-11-30T17:26:20.389395+0000","last_undegraded":"2023-11-30T17:26:20.389395+0000","last_fullsized":"2023-11-30T17:26:20.389395+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388058+0000","last_change":"2023-11-30T17:26:20.379136+0000","last_active":"2023-11-30T17:26:20.388058+0000","last_peered":"2023-11-30T17:26:20.388058+0000","last_clean":"2023-11-30T17:26:20.388058+0000","last_became_active":"2023-11-30T17:26:20.378802+0000","last_became_peered":"2023-11-30T17:26:20.378802+0000","last_unstale":"2023-11-30T17:26:20.388058+0000","last_undegraded":"2023-11-30T17:26:20.388058+0000","last_fullsized":"2023-11-30T17:26:20.388058+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.375084+0000","last_change":"2023-11-30T17:26:19.981215+0000","last_active":"2023-11-30T17:26:20.375084+0000","last_peered":"2023-11-30T17:26:20.375084+0000","last_clean":"2023-11-30T17:26:20.375084+0000","last_became_active":"2023-11-30T17:26:19.980759+0000","last_became_peered":"2023-11-30T17:26:19.980759+0000","last_unstale":"2023-11-30T17:26:20.375084+0000","last_undegraded":"2023-11-30T17:26:20.375084+0000","last_fullsized":"2023-11-30T17:26:20.375084+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.389787+0000","last_change":"2023-11-30T17:26:20.385727+0000","last_active":"2023-11-30T17:26:20.389787+0000","last_peered":"2023-11-30T17:26:20.389787+0000","last_clean":"2023-11-30T17:26:20.389787+0000","last_became_active":"2023-11-30T17:26:20.385256+0000","last_became_peered":"2023-11-30T17:26:20.385256+0000","last_unstale":"2023-11-30T17:26:20.389787+0000","last_undegraded":"2023-11-30T17:26:20.389787+0000","last_fullsized":"2023-11-30T17:26:20.389787+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.369033+0000","last_change":"2023-11-30T17:26:19.995206+0000","last_active":"2023-11-30T17:26:20.369033+0000","last_peered":"2023-11-30T17:26:20.369033+0000","last_clean":"2023-11-30T17:26:20.369033+0000","last_became_active":"2023-11-30T17:26:19.994873+0000","last_became_peered":"2023-11-30T17:26:19.994873+0000","last_unstale":"2023-11-30T17:26:20.369033+0000","last_undegraded":"2023-11-30T17:26:20.369033+0000","last_fullsized":"2023-11-30T17:26:20.369033+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.386727+0000","last_change":"2023-11-30T17:26:20.382991+0000","last_active":"2023-11-30T17:26:20.386727+0000","last_peered":"2023-11-30T17:26:20.386727+0000","last_clean":"2023-11-30T17:26:20.386727+0000","last_became_active":"2023-11-30T17:26:20.382685+0000","last_became_peered":"2023-11-30T17:26:20.382685+0000","last_unstale":"2023-11-30T17:26:20.386727+0000","last_undegraded":"2023-11-30T17:26:20.386727+0000","last_fullsized":"2023-11-30T17:26:20.386727+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3c","version":"145'2","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388621+0000","last_change":"2023-11-30T17:26:19.981679+0000","last_active":"2023-11-30T17:26:20.388621+0000","last_peered":"2023-11-30T17:26:20.388621+0000","last_clean":"2023-11-30T17:26:20.388621+0000","last_became_active":"2023-11-30T17:26:19.980849+0000","last_became_peered":"2023-11-30T17:26:19.980849+0000","last_unstale":"2023-11-30T17:26:20.388621+0000","last_undegraded":"2023-11-30T17:26:20.388621+0000","last_fullsized":"2023-11-30T17:26:20.388621+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388128+0000","last_change":"2023-11-30T17:26:20.379521+0000","last_active":"2023-11-30T17:26:20.388128+0000","last_peered":"2023-11-30T17:26:20.388128+0000","last_clean":"2023-11-30T17:26:20.388128+0000","last_became_active":"2023-11-30T17:26:20.379066+0000","last_became_peered":"2023-11-30T17:26:20.379066+0000","last_unstale":"2023-11-30T17:26:20.388128+0000","last_undegraded":"2023-11-30T17:26:20.388128+0000","last_fullsized":"2023-11-30T17:26:20.388128+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3b","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.390371+0000","last_change":"2023-11-30T17:26:19.981911+0000","last_active":"2023-11-30T17:26:20.390371+0000","last_peered":"2023-11-30T17:26:20.390371+0000","last_clean":"2023-11-30T17:26:20.390371+0000","last_became_active":"2023-11-30T17:26:19.981028+0000","last_became_peered":"2023-11-30T17:26:19.981028+0000","last_unstale":"2023-11-30T17:26:20.390371+0000","last_undegraded":"2023-11-30T17:26:20.390371+0000","last_fullsized":"2023-11-30T17:26:20.390371+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387481+0000","last_change":"2023-11-30T17:26:20.373693+0000","last_active":"2023-11-30T17:26:20.387481+0000","last_peered":"2023-11-30T17:26:20.387481+0000","last_clean":"2023-11-30T17:26:20.387481+0000","last_became_active":"2023-11-30T17:26:20.373358+0000","last_became_peered":"2023-11-30T17:26:20.373358+0000","last_unstale":"2023-11-30T17:26:20.387481+0000","last_undegraded":"2023-11-30T17:26:20.387481+0000","last_fullsized":"2023-11-30T17:26:20.387481+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3a","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388948+0000","last_change":"2023-11-30T17:26:19.991546+0000","last_active":"2023-11-30T17:26:20.388948+0000","last_peered":"2023-11-30T17:26:20.388948+0000","last_clean":"2023-11-30T17:26:20.388948+0000","last_became_active":"2023-11-30T17:26:19.991205+0000","last_became_peered":"2023-11-30T17:26:19.991205+0000","last_unstale":"2023-11-30T17:26:20.388948+0000","last_undegraded":"2023-11-30T17:26:20.388948+0000","last_fullsized":"2023-11-30T17:26:20.388948+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387245+0000","last_change":"2023-11-30T17:26:20.377086+0000","last_active":"2023-11-30T17:26:20.387245+0000","last_peered":"2023-11-30T17:26:20.387245+0000","last_clean":"2023-11-30T17:26:20.387245+0000","last_became_active":"2023-11-30T17:26:20.376800+0000","last_became_peered":"2023-11-30T17:26:20.376800+0000","last_unstale":"2023-11-30T17:26:20.387245+0000","last_undegraded":"2023-11-30T17:26:20.387245+0000","last_fullsized":"2023-11-30T17:26:20.387245+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.380493+0000","last_change":"2023-11-30T17:26:19.983111+0000","last_active":"2023-11-30T17:26:20.380493+0000","last_peered":"2023-11-30T17:26:20.380493+0000","last_clean":"2023-11-30T17:26:20.380493+0000","last_became_active":"2023-11-30T17:26:19.982664+0000","last_became_peered":"2023-11-30T17:26:19.982664+0000","last_unstale":"2023-11-30T17:26:20.380493+0000","last_undegraded":"2023-11-30T17:26:20.380493+0000","last_fullsized":"2023-11-30T17:26:20.380493+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.393583+0000","last_change":"2023-11-30T17:26:20.389542+0000","last_active":"2023-11-30T17:26:20.393583+0000","last_peered":"2023-11-30T17:26:20.393583+0000","last_clean":"2023-11-30T17:26:20.393583+0000","last_became_active":"2023-11-30T17:26:20.389206+0000","last_became_peered":"2023-11-30T17:26:20.389206+0000","last_unstale":"2023-11-30T17:26:20.393583+0000","last_undegraded":"2023-11-30T17:26:20.393583+0000","last_fullsized":"2023-11-30T17:26:20.393583+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.368345+0000","last_change":"2023-11-30T17:26:19.991912+0000","last_active":"2023-11-30T17:26:20.368345+0000","last_peered":"2023-11-30T17:26:20.368345+0000","last_clean":"2023-11-30T17:26:20.368345+0000","last_became_active":"2023-11-30T17:26:19.991638+0000","last_became_peered":"2023-11-30T17:26:19.991638+0000","last_unstale":"2023-11-30T17:26:20.368345+0000","last_undegraded":"2023-11-30T17:26:20.368345+0000","last_fullsized":"2023-11-30T17:26:20.368345+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388798+0000","last_change":"2023-11-30T17:26:20.385803+0000","last_active":"2023-11-30T17:26:20.388798+0000","last_peered":"2023-11-30T17:26:20.388798+0000","last_clean":"2023-11-30T17:26:20.388798+0000","last_became_active":"2023-11-30T17:26:20.385543+0000","last_became_peered":"2023-11-30T17:26:20.385543+0000","last_unstale":"2023-11-30T17:26:20.388798+0000","last_undegraded":"2023-11-30T17:26:20.388798+0000","last_fullsized":"2023-11-30T17:26:20.388798+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.361805+0000","last_change":"2023-11-30T17:26:19.990110+0000","last_active":"2023-11-30T17:26:20.361805+0000","last_peered":"2023-11-30T17:26:20.361805+0000","last_clean":"2023-11-30T17:26:20.361805+0000","last_became_active":"2023-11-30T17:26:19.989788+0000","last_became_peered":"2023-11-30T17:26:19.989788+0000","last_unstale":"2023-11-30T17:26:20.361805+0000","last_undegraded":"2023-11-30T17:26:20.361805+0000","last_fullsized":"2023-11-30T17:26:20.361805+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388136+0000","last_change":"2023-11-30T17:26:20.386138+0000","last_active":"2023-11-30T17:26:20.388136+0000","last_peered":"2023-11-30T17:26:20.388136+0000","last_clean":"2023-11-30T17:26:20.388136+0000","last_became_active":"2023-11-30T17:26:20.385843+0000","last_became_peered":"2023-11-30T17:26:20.385843+0000","last_unstale":"2023-11-30T17:26:20.388136+0000","last_undegraded":"2023-11-30T17:26:20.388136+0000","last_fullsized":"2023-11-30T17:26:20.388136+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.361983+0000","last_change":"2023-11-30T17:26:19.987471+0000","last_active":"2023-11-30T17:26:20.361983+0000","last_peered":"2023-11-30T17:26:20.361983+0000","last_clean":"2023-11-30T17:26:20.361983+0000","last_became_active":"2023-11-30T17:26:19.987163+0000","last_became_peered":"2023-11-30T17:26:19.987163+0000","last_unstale":"2023-11-30T17:26:20.361983+0000","last_undegraded":"2023-11-30T17:26:20.361983+0000","last_fullsized":"2023-11-30T17:26:20.361983+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.380865+0000","last_change":"2023-11-30T17:26:20.374642+0000","last_active":"2023-11-30T17:26:20.380865+0000","last_peered":"2023-11-30T17:26:20.380865+0000","last_clean":"2023-11-30T17:26:20.380865+0000","last_became_active":"2023-11-30T17:26:20.374408+0000","last_became_peered":"2023-11-30T17:26:20.374408+0000","last_unstale":"2023-11-30T17:26:20.380865+0000","last_undegraded":"2023-11-30T17:26:20.380865+0000","last_fullsized":"2023-11-30T17:26:20.380865+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.375595+0000","last_change":"2023-11-30T17:26:19.984914+0000","last_active":"2023-11-30T17:26:20.375595+0000","last_peered":"2023-11-30T17:26:20.375595+0000","last_clean":"2023-11-30T17:26:20.375595+0000","last_became_active":"2023-11-30T17:26:19.984603+0000","last_became_peered":"2023-11-30T17:26:19.984603+0000","last_unstale":"2023-11-30T17:26:20.375595+0000","last_undegraded":"2023-11-30T17:26:20.375595+0000","last_fullsized":"2023-11-30T17:26:20.375595+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.381358+0000","last_change":"2023-11-30T17:26:20.377269+0000","last_active":"2023-11-30T17:26:20.381358+0000","last_peered":"2023-11-30T17:26:20.381358+0000","last_clean":"2023-11-30T17:26:20.381358+0000","last_became_active":"2023-11-30T17:26:20.377010+0000","last_became_peered":"2023-11-30T17:26:20.377010+0000","last_unstale":"2023-11-30T17:26:20.381358+0000","last_undegraded":"2023-11-30T17:26:20.381358+0000","last_fullsized":"2023-11-30T17:26:20.381358+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.34","version":"145'4","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.392001+0000","last_change":"2023-11-30T17:26:19.981025+0000","last_active":"2023-11-30T17:26:20.392001+0000","last_peered":"2023-11-30T17:26:20.392001+0000","last_clean":"2023-11-30T17:26:20.392001+0000","last_became_active":"2023-11-30T17:26:19.980676+0000","last_became_peered":"2023-11-30T17:26:19.980676+0000","last_unstale":"2023-11-30T17:26:20.392001+0000","last_undegraded":"2023-11-30T17:26:20.392001+0000","last_fullsized":"2023-11-30T17:26:20.392001+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.376617+0000","last_change":"2023-11-30T17:26:20.372762+0000","last_active":"2023-11-30T17:26:20.376617+0000","last_peered":"2023-11-30T17:26:20.376617+0000","last_clean":"2023-11-30T17:26:20.376617+0000","last_became_active":"2023-11-30T17:26:20.372493+0000","last_became_peered":"2023-11-30T17:26:20.372493+0000","last_unstale":"2023-11-30T17:26:20.376617+0000","last_undegraded":"2023-11-30T17:26:20.376617+0000","last_fullsized":"2023-11-30T17:26:20.376617+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.385857+0000","last_change":"2023-11-30T17:26:19.991261+0000","last_active":"2023-11-30T17:26:20.385857+0000","last_peered":"2023-11-30T17:26:20.385857+0000","last_clean":"2023-11-30T17:26:20.385857+0000","last_became_active":"2023-11-30T17:26:19.990918+0000","last_became_peered":"2023-11-30T17:26:19.990918+0000","last_unstale":"2023-11-30T17:26:20.385857+0000","last_undegraded":"2023-11-30T17:26:20.385857+0000","last_fullsized":"2023-11-30T17:26:20.385857+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387036+0000","last_change":"2023-11-30T17:26:20.385369+0000","last_active":"2023-11-30T17:26:20.387036+0000","last_peered":"2023-11-30T17:26:20.387036+0000","last_clean":"2023-11-30T17:26:20.387036+0000","last_became_active":"2023-11-30T17:26:20.385105+0000","last_became_peered":"2023-11-30T17:26:20.385105+0000","last_unstale":"2023-11-30T17:26:20.387036+0000","last_undegraded":"2023-11-30T17:26:20.387036+0000","last_fullsized":"2023-11-30T17:26:20.387036+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.368456+0000","last_change":"2023-11-30T17:26:19.987964+0000","last_active":"2023-11-30T17:26:20.368456+0000","last_peered":"2023-11-30T17:26:20.368456+0000","last_clean":"2023-11-30T17:26:20.368456+0000","last_became_active":"2023-11-30T17:26:19.987671+0000","last_became_peered":"2023-11-30T17:26:19.987671+0000","last_unstale":"2023-11-30T17:26:20.368456+0000","last_undegraded":"2023-11-30T17:26:20.368456+0000","last_fullsized":"2023-11-30T17:26:20.368456+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388363+0000","last_change":"2023-11-30T17:26:20.384255+0000","last_active":"2023-11-30T17:26:20.388363+0000","last_peered":"2023-11-30T17:26:20.388363+0000","last_clean":"2023-11-30T17:26:20.388363+0000","last_became_active":"2023-11-30T17:26:20.383667+0000","last_became_peered":"2023-11-30T17:26:20.383667+0000","last_unstale":"2023-11-30T17:26:20.388363+0000","last_undegraded":"2023-11-30T17:26:20.388363+0000","last_fullsized":"2023-11-30T17:26:20.388363+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.365931+0000","last_change":"2023-11-30T17:26:19.981285+0000","last_active":"2023-11-30T17:26:20.365931+0000","last_peered":"2023-11-30T17:26:20.365931+0000","last_clean":"2023-11-30T17:26:20.365931+0000","last_became_active":"2023-11-30T17:26:19.981001+0000","last_became_peered":"2023-11-30T17:26:19.981001+0000","last_unstale":"2023-11-30T17:26:20.365931+0000","last_undegraded":"2023-11-30T17:26:20.365931+0000","last_fullsized":"2023-11-30T17:26:20.365931+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.385714+0000","last_change":"2023-11-30T17:26:20.383414+0000","last_active":"2023-11-30T17:26:20.385714+0000","last_peered":"2023-11-30T17:26:20.385714+0000","last_clean":"2023-11-30T17:26:20.385714+0000","last_became_active":"2023-11-30T17:26:20.383133+0000","last_became_peered":"2023-11-30T17:26:20.383133+0000","last_unstale":"2023-11-30T17:26:20.385714+0000","last_undegraded":"2023-11-30T17:26:20.385714+0000","last_fullsized":"2023-11-30T17:26:20.385714+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"145'4","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387705+0000","last_change":"2023-11-30T17:26:19.985363+0000","last_active":"2023-11-30T17:26:20.387705+0000","last_peered":"2023-11-30T17:26:20.387705+0000","last_clean":"2023-11-30T17:26:20.387705+0000","last_became_active":"2023-11-30T17:26:19.985060+0000","last_became_peered":"2023-11-30T17:26:19.985060+0000","last_unstale":"2023-11-30T17:26:20.387705+0000","last_undegraded":"2023-11-30T17:26:20.387705+0000","last_fullsized":"2023-11-30T17:26:20.387705+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.381824+0000","last_change":"2023-11-30T17:26:20.380614+0000","last_active":"2023-11-30T17:26:20.381824+0000","last_peered":"2023-11-30T17:26:20.381824+0000","last_clean":"2023-11-30T17:26:20.381824+0000","last_became_active":"2023-11-30T17:26:20.380325+0000","last_became_peered":"2023-11-30T17:26:20.380325+0000","last_unstale":"2023-11-30T17:26:20.381824+0000","last_undegraded":"2023-11-30T17:26:20.381824+0000","last_fullsized":"2023-11-30T17:26:20.381824+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.375294+0000","last_change":"2023-11-30T17:26:19.987692+0000","last_active":"2023-11-30T17:26:20.375294+0000","last_peered":"2023-11-30T17:26:20.375294+0000","last_clean":"2023-11-30T17:26:20.375294+0000","last_became_active":"2023-11-30T17:26:19.986014+0000","last_became_peered":"2023-11-30T17:26:19.986014+0000","last_unstale":"2023-11-30T17:26:20.375294+0000","last_undegraded":"2023-11-30T17:26:20.375294+0000","last_fullsized":"2023-11-30T17:26:20.375294+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.371329+0000","last_change":"2023-11-30T17:26:20.370906+0000","last_active":"2023-11-30T17:26:20.371329+0000","last_peered":"2023-11-30T17:26:20.371329+0000","last_clean":"2023-11-30T17:26:20.371329+0000","last_became_active":"2023-11-30T17:26:20.370579+0000","last_became_peered":"2023-11-30T17:26:20.370579+0000","last_unstale":"2023-11-30T17:26:20.371329+0000","last_undegraded":"2023-11-30T17:26:20.371329+0000","last_fullsized":"2023-11-30T17:26:20.371329+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.365679+0000","last_change":"2023-11-30T17:26:19.980843+0000","last_active":"2023-11-30T17:26:20.365679+0000","last_peered":"2023-11-30T17:26:20.365679+0000","last_clean":"2023-11-30T17:26:20.365679+0000","last_became_active":"2023-11-30T17:26:19.980555+0000","last_became_peered":"2023-11-30T17:26:19.980555+0000","last_unstale":"2023-11-30T17:26:20.365679+0000","last_undegraded":"2023-11-30T17:26:20.365679+0000","last_fullsized":"2023-11-30T17:26:20.365679+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.389765+0000","last_change":"2023-11-30T17:26:20.385543+0000","last_active":"2023-11-30T17:26:20.389765+0000","last_peered":"2023-11-30T17:26:20.389765+0000","last_clean":"2023-11-30T17:26:20.389765+0000","last_became_active":"2023-11-30T17:26:20.385023+0000","last_became_peered":"2023-11-30T17:26:20.385023+0000","last_unstale":"2023-11-30T17:26:20.389765+0000","last_undegraded":"2023-11-30T17:26:20.389765+0000","last_fullsized":"2023-11-30T17:26:20.389765+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.385908+0000","last_change":"2023-11-30T17:26:19.991322+0000","last_active":"2023-11-30T17:26:20.385908+0000","last_peered":"2023-11-30T17:26:20.385908+0000","last_clean":"2023-11-30T17:26:20.385908+0000","last_became_active":"2023-11-30T17:26:19.990924+0000","last_became_peered":"2023-11-30T17:26:19.990924+0000","last_unstale":"2023-11-30T17:26:20.385908+0000","last_undegraded":"2023-11-30T17:26:20.385908+0000","last_fullsized":"2023-11-30T17:26:20.385908+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.385682+0000","last_change":"2023-11-30T17:26:20.383838+0000","last_active":"2023-11-30T17:26:20.385682+0000","last_peered":"2023-11-30T17:26:20.385682+0000","last_clean":"2023-11-30T17:26:20.385682+0000","last_became_active":"2023-11-30T17:26:20.383331+0000","last_became_peered":"2023-11-30T17:26:20.383331+0000","last_unstale":"2023-11-30T17:26:20.385682+0000","last_undegraded":"2023-11-30T17:26:20.385682+0000","last_fullsized":"2023-11-30T17:26:20.385682+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.373849+0000","last_change":"2023-11-30T17:26:19.982247+0000","last_active":"2023-11-30T17:26:20.373849+0000","last_peered":"2023-11-30T17:26:20.373849+0000","last_clean":"2023-11-30T17:26:20.373849+0000","last_became_active":"2023-11-30T17:26:19.980615+0000","last_became_peered":"2023-11-30T17:26:19.980615+0000","last_unstale":"2023-11-30T17:26:20.373849+0000","last_undegraded":"2023-11-30T17:26:20.373849+0000","last_fullsized":"2023-11-30T17:26:20.373849+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.391577+0000","last_change":"2023-11-30T17:26:20.390402+0000","last_active":"2023-11-30T17:26:20.391577+0000","last_peered":"2023-11-30T17:26:20.391577+0000","last_clean":"2023-11-30T17:26:20.391577+0000","last_became_active":"2023-11-30T17:26:20.390183+0000","last_became_peered":"2023-11-30T17:26:20.390183+0000","last_unstale":"2023-11-30T17:26:20.391577+0000","last_undegraded":"2023-11-30T17:26:20.391577+0000","last_fullsized":"2023-11-30T17:26:20.391577+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2b","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387315+0000","last_change":"2023-11-30T17:26:19.987740+0000","last_active":"2023-11-30T17:26:20.387315+0000","last_peered":"2023-11-30T17:26:20.387315+0000","last_clean":"2023-11-30T17:26:20.387315+0000","last_became_active":"2023-11-30T17:26:19.987465+0000","last_became_peered":"2023-11-30T17:26:19.987465+0000","last_unstale":"2023-11-30T17:26:20.387315+0000","last_undegraded":"2023-11-30T17:26:20.387315+0000","last_fullsized":"2023-11-30T17:26:20.387315+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.381841+0000","last_change":"2023-11-30T17:26:20.377421+0000","last_active":"2023-11-30T17:26:20.381841+0000","last_peered":"2023-11-30T17:26:20.381841+0000","last_clean":"2023-11-30T17:26:20.381841+0000","last_became_active":"2023-11-30T17:26:20.376973+0000","last_became_peered":"2023-11-30T17:26:20.376973+0000","last_unstale":"2023-11-30T17:26:20.381841+0000","last_undegraded":"2023-11-30T17:26:20.381841+0000","last_fullsized":"2023-11-30T17:26:20.381841+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.371925+0000","last_change":"2023-11-30T17:26:19.989295+0000","last_active":"2023-11-30T17:26:20.371925+0000","last_peered":"2023-11-30T17:26:20.371925+0000","last_clean":"2023-11-30T17:26:20.371925+0000","last_became_active":"2023-11-30T17:26:19.989015+0000","last_became_peered":"2023-11-30T17:26:19.989015+0000","last_unstale":"2023-11-30T17:26:20.371925+0000","last_undegraded":"2023-11-30T17:26:20.371925+0000","last_fullsized":"2023-11-30T17:26:20.371925+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.385569+0000","last_change":"2023-11-30T17:26:20.380780+0000","last_active":"2023-11-30T17:26:20.385569+0000","last_peered":"2023-11-30T17:26:20.385569+0000","last_clean":"2023-11-30T17:26:20.385569+0000","last_became_active":"2023-11-30T17:26:20.380428+0000","last_became_peered":"2023-11-30T17:26:20.380428+0000","last_unstale":"2023-11-30T17:26:20.385569+0000","last_undegraded":"2023-11-30T17:26:20.385569+0000","last_fullsized":"2023-11-30T17:26:20.385569+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.373516+0000","last_change":"2023-11-30T17:26:19.987926+0000","last_active":"2023-11-30T17:26:20.373516+0000","last_peered":"2023-11-30T17:26:20.373516+0000","last_clean":"2023-11-30T17:26:20.373516+0000","last_became_active":"2023-11-30T17:26:19.986566+0000","last_became_peered":"2023-11-30T17:26:19.986566+0000","last_unstale":"2023-11-30T17:26:20.373516+0000","last_undegraded":"2023-11-30T17:26:20.373516+0000","last_fullsized":"2023-11-30T17:26:20.373516+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387527+0000","last_change":"2023-11-30T17:26:20.383698+0000","last_active":"2023-11-30T17:26:20.387527+0000","last_peered":"2023-11-30T17:26:20.387527+0000","last_clean":"2023-11-30T17:26:20.387527+0000","last_became_active":"2023-11-30T17:26:20.381951+0000","last_became_peered":"2023-11-30T17:26:20.381951+0000","last_unstale":"2023-11-30T17:26:20.387527+0000","last_undegraded":"2023-11-30T17:26:20.387527+0000","last_fullsized":"2023-11-30T17:26:20.387527+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.369741+0000","last_change":"2023-11-30T17:26:19.988883+0000","last_active":"2023-11-30T17:26:20.369741+0000","last_peered":"2023-11-30T17:26:20.369741+0000","last_clean":"2023-11-30T17:26:20.369741+0000","last_became_active":"2023-11-30T17:26:19.988572+0000","last_became_peered":"2023-11-30T17:26:19.988572+0000","last_unstale":"2023-11-30T17:26:20.369741+0000","last_undegraded":"2023-11-30T17:26:20.369741+0000","last_fullsized":"2023-11-30T17:26:20.369741+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388779+0000","last_change":"2023-11-30T17:26:20.385162+0000","last_active":"2023-11-30T17:26:20.388779+0000","last_peered":"2023-11-30T17:26:20.388779+0000","last_clean":"2023-11-30T17:26:20.388779+0000","last_became_active":"2023-11-30T17:26:20.384966+0000","last_became_peered":"2023-11-30T17:26:20.384966+0000","last_unstale":"2023-11-30T17:26:20.388779+0000","last_undegraded":"2023-11-30T17:26:20.388779+0000","last_fullsized":"2023-11-30T17:26:20.388779+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.375436+0000","last_change":"2023-11-30T17:26:19.984962+0000","last_active":"2023-11-30T17:26:20.375436+0000","last_peered":"2023-11-30T17:26:20.375436+0000","last_clean":"2023-11-30T17:26:20.375436+0000","last_became_active":"2023-11-30T17:26:19.984501+0000","last_became_peered":"2023-11-30T17:26:19.984501+0000","last_unstale":"2023-11-30T17:26:20.375436+0000","last_undegraded":"2023-11-30T17:26:20.375436+0000","last_fullsized":"2023-11-30T17:26:20.375436+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387308+0000","last_change":"2023-11-30T17:26:20.376671+0000","last_active":"2023-11-30T17:26:20.387308+0000","last_peered":"2023-11-30T17:26:20.387308+0000","last_clean":"2023-11-30T17:26:20.387308+0000","last_became_active":"2023-11-30T17:26:20.376340+0000","last_became_peered":"2023-11-30T17:26:20.376340+0000","last_unstale":"2023-11-30T17:26:20.387308+0000","last_undegraded":"2023-11-30T17:26:20.387308+0000","last_fullsized":"2023-11-30T17:26:20.387308+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.362083+0000","last_change":"2023-11-30T17:26:19.986008+0000","last_active":"2023-11-30T17:26:20.362083+0000","last_peered":"2023-11-30T17:26:20.362083+0000","last_clean":"2023-11-30T17:26:20.362083+0000","last_became_active":"2023-11-30T17:26:19.985725+0000","last_became_peered":"2023-11-30T17:26:19.985725+0000","last_unstale":"2023-11-30T17:26:20.362083+0000","last_undegraded":"2023-11-30T17:26:20.362083+0000","last_fullsized":"2023-11-30T17:26:20.362083+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.384054+0000","last_change":"2023-11-30T17:26:20.382079+0000","last_active":"2023-11-30T17:26:20.384054+0000","last_peered":"2023-11-30T17:26:20.384054+0000","last_clean":"2023-11-30T17:26:20.384054+0000","last_became_active":"2023-11-30T17:26:20.381802+0000","last_became_peered":"2023-11-30T17:26:20.381802+0000","last_unstale":"2023-11-30T17:26:20.384054+0000","last_undegraded":"2023-11-30T17:26:20.384054+0000","last_fullsized":"2023-11-30T17:26:20.384054+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.367031+0000","last_change":"2023-11-30T17:26:19.988110+0000","last_active":"2023-11-30T17:26:20.367031+0000","last_peered":"2023-11-30T17:26:20.367031+0000","last_clean":"2023-11-30T17:26:20.367031+0000","last_became_active":"2023-11-30T17:26:19.987812+0000","last_became_peered":"2023-11-30T17:26:19.987812+0000","last_unstale":"2023-11-30T17:26:20.367031+0000","last_undegraded":"2023-11-30T17:26:20.367031+0000","last_fullsized":"2023-11-30T17:26:20.367031+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388716+0000","last_change":"2023-11-30T17:26:20.386011+0000","last_active":"2023-11-30T17:26:20.388716+0000","last_peered":"2023-11-30T17:26:20.388716+0000","last_clean":"2023-11-30T17:26:20.388716+0000","last_became_active":"2023-11-30T17:26:20.385659+0000","last_became_peered":"2023-11-30T17:26:20.385659+0000","last_unstale":"2023-11-30T17:26:20.388716+0000","last_undegraded":"2023-11-30T17:26:20.388716+0000","last_fullsized":"2023-11-30T17:26:20.388716+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.368000+0000","last_change":"2023-11-30T17:26:19.987115+0000","last_active":"2023-11-30T17:26:20.368000+0000","last_peered":"2023-11-30T17:26:20.368000+0000","last_clean":"2023-11-30T17:26:20.368000+0000","last_became_active":"2023-11-30T17:26:19.986850+0000","last_became_peered":"2023-11-30T17:26:19.986850+0000","last_unstale":"2023-11-30T17:26:20.368000+0000","last_undegraded":"2023-11-30T17:26:20.368000+0000","last_fullsized":"2023-11-30T17:26:20.368000+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.391595+0000","last_change":"2023-11-30T17:26:20.390743+0000","last_active":"2023-11-30T17:26:20.391595+0000","last_peered":"2023-11-30T17:26:20.391595+0000","last_clean":"2023-11-30T17:26:20.391595+0000","last_became_active":"2023-11-30T17:26:20.389964+0000","last_became_peered":"2023-11-30T17:26:20.389964+0000","last_unstale":"2023-11-30T17:26:20.391595+0000","last_undegraded":"2023-11-30T17:26:20.391595+0000","last_fullsized":"2023-11-30T17:26:20.391595+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.373706+0000","last_change":"2023-11-30T17:26:19.989327+0000","last_active":"2023-11-30T17:26:20.373706+0000","last_peered":"2023-11-30T17:26:20.373706+0000","last_clean":"2023-11-30T17:26:20.373706+0000","last_became_active":"2023-11-30T17:26:19.988828+0000","last_became_peered":"2023-11-30T17:26:19.988828+0000","last_unstale":"2023-11-30T17:26:20.373706+0000","last_undegraded":"2023-11-30T17:26:20.373706+0000","last_fullsized":"2023-11-30T17:26:20.373706+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.386976+0000","last_change":"2023-11-30T17:26:20.383547+0000","last_active":"2023-11-30T17:26:20.386976+0000","last_peered":"2023-11-30T17:26:20.386976+0000","last_clean":"2023-11-30T17:26:20.386976+0000","last_became_active":"2023-11-30T17:26:20.383248+0000","last_became_peered":"2023-11-30T17:26:20.383248+0000","last_unstale":"2023-11-30T17:26:20.386976+0000","last_undegraded":"2023-11-30T17:26:20.386976+0000","last_fullsized":"2023-11-30T17:26:20.386976+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.380495+0000","last_change":"2023-11-30T17:26:19.983885+0000","last_active":"2023-11-30T17:26:20.380495+0000","last_peered":"2023-11-30T17:26:20.380495+0000","last_clean":"2023-11-30T17:26:20.380495+0000","last_became_active":"2023-11-30T17:26:19.983508+0000","last_became_peered":"2023-11-30T17:26:19.983508+0000","last_unstale":"2023-11-30T17:26:20.380495+0000","last_undegraded":"2023-11-30T17:26:20.380495+0000","last_fullsized":"2023-11-30T17:26:20.380495+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.389846+0000","last_change":"2023-11-30T17:26:20.387780+0000","last_active":"2023-11-30T17:26:20.389846+0000","last_peered":"2023-11-30T17:26:20.389846+0000","last_clean":"2023-11-30T17:26:20.389846+0000","last_became_active":"2023-11-30T17:26:20.387484+0000","last_became_peered":"2023-11-30T17:26:20.387484+0000","last_unstale":"2023-11-30T17:26:20.389846+0000","last_undegraded":"2023-11-30T17:26:20.389846+0000","last_fullsized":"2023-11-30T17:26:20.389846+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.362058+0000","last_change":"2023-11-30T17:26:19.988763+0000","last_active":"2023-11-30T17:26:20.362058+0000","last_peered":"2023-11-30T17:26:20.362058+0000","last_clean":"2023-11-30T17:26:20.362058+0000","last_became_active":"2023-11-30T17:26:19.988497+0000","last_became_peered":"2023-11-30T17:26:19.988497+0000","last_unstale":"2023-11-30T17:26:20.362058+0000","last_undegraded":"2023-11-30T17:26:20.362058+0000","last_fullsized":"2023-11-30T17:26:20.362058+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.379498+0000","last_change":"2023-11-30T17:26:20.371710+0000","last_active":"2023-11-30T17:26:20.379498+0000","last_peered":"2023-11-30T17:26:20.379498+0000","last_clean":"2023-11-30T17:26:20.379498+0000","last_became_active":"2023-11-30T17:26:20.371458+0000","last_became_peered":"2023-11-30T17:26:20.371458+0000","last_unstale":"2023-11-30T17:26:20.379498+0000","last_undegraded":"2023-11-30T17:26:20.379498+0000","last_fullsized":"2023-11-30T17:26:20.379498+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.366081+0000","last_change":"2023-11-30T17:26:19.984446+0000","last_active":"2023-11-30T17:26:20.366081+0000","last_peered":"2023-11-30T17:26:20.366081+0000","last_clean":"2023-11-30T17:26:20.366081+0000","last_became_active":"2023-11-30T17:26:19.984148+0000","last_became_peered":"2023-11-30T17:26:19.984148+0000","last_unstale":"2023-11-30T17:26:20.366081+0000","last_undegraded":"2023-11-30T17:26:20.366081+0000","last_fullsized":"2023-11-30T17:26:20.366081+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.382156+0000","last_change":"2023-11-30T17:26:20.375984+0000","last_active":"2023-11-30T17:26:20.382156+0000","last_peered":"2023-11-30T17:26:20.382156+0000","last_clean":"2023-11-30T17:26:20.382156+0000","last_became_active":"2023-11-30T17:26:20.375653+0000","last_became_peered":"2023-11-30T17:26:20.375653+0000","last_unstale":"2023-11-30T17:26:20.382156+0000","last_undegraded":"2023-11-30T17:26:20.382156+0000","last_fullsized":"2023-11-30T17:26:20.382156+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.382880+0000","last_change":"2023-11-30T17:26:19.983531+0000","last_active":"2023-11-30T17:26:20.382880+0000","last_peered":"2023-11-30T17:26:20.382880+0000","last_clean":"2023-11-30T17:26:20.382880+0000","last_became_active":"2023-11-30T17:26:19.983220+0000","last_became_peered":"2023-11-30T17:26:19.983220+0000","last_unstale":"2023-11-30T17:26:20.382880+0000","last_undegraded":"2023-11-30T17:26:20.382880+0000","last_fullsized":"2023-11-30T17:26:20.382880+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387296+0000","last_change":"2023-11-30T17:26:20.377093+0000","last_active":"2023-11-30T17:26:20.387296+0000","last_peered":"2023-11-30T17:26:20.387296+0000","last_clean":"2023-11-30T17:26:20.387296+0000","last_became_active":"2023-11-30T17:26:20.376815+0000","last_became_peered":"2023-11-30T17:26:20.376815+0000","last_unstale":"2023-11-30T17:26:20.387296+0000","last_undegraded":"2023-11-30T17:26:20.387296+0000","last_fullsized":"2023-11-30T17:26:20.387296+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.385529+0000","last_change":"2023-11-30T17:26:19.987645+0000","last_active":"2023-11-30T17:26:20.385529+0000","last_peered":"2023-11-30T17:26:20.385529+0000","last_clean":"2023-11-30T17:26:20.385529+0000","last_became_active":"2023-11-30T17:26:19.987346+0000","last_became_peered":"2023-11-30T17:26:19.987346+0000","last_unstale":"2023-11-30T17:26:20.385529+0000","last_undegraded":"2023-11-30T17:26:20.385529+0000","last_fullsized":"2023-11-30T17:26:20.385529+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.391536+0000","last_change":"2023-11-30T17:26:20.388901+0000","last_active":"2023-11-30T17:26:20.391536+0000","last_peered":"2023-11-30T17:26:20.391536+0000","last_clean":"2023-11-30T17:26:20.391536+0000","last_became_active":"2023-11-30T17:26:20.388624+0000","last_became_peered":"2023-11-30T17:26:20.388624+0000","last_unstale":"2023-11-30T17:26:20.391536+0000","last_undegraded":"2023-11-30T17:26:20.391536+0000","last_fullsized":"2023-11-30T17:26:20.391536+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"145'2","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.385776+0000","last_change":"2023-11-30T17:26:19.991367+0000","last_active":"2023-11-30T17:26:20.385776+0000","last_peered":"2023-11-30T17:26:20.385776+0000","last_clean":"2023-11-30T17:26:20.385776+0000","last_became_active":"2023-11-30T17:26:19.990964+0000","last_became_peered":"2023-11-30T17:26:19.990964+0000","last_unstale":"2023-11-30T17:26:20.385776+0000","last_undegraded":"2023-11-30T17:26:20.385776+0000","last_fullsized":"2023-11-30T17:26:20.385776+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.383944+0000","last_change":"2023-11-30T17:26:20.380100+0000","last_active":"2023-11-30T17:26:20.383944+0000","last_peered":"2023-11-30T17:26:20.383944+0000","last_clean":"2023-11-30T17:26:20.383944+0000","last_became_active":"2023-11-30T17:26:20.379241+0000","last_became_peered":"2023-11-30T17:26:20.379241+0000","last_unstale":"2023-11-30T17:26:20.383944+0000","last_undegraded":"2023-11-30T17:26:20.383944+0000","last_fullsized":"2023-11-30T17:26:20.383944+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.367402+0000","last_change":"2023-11-30T17:26:19.985435+0000","last_active":"2023-11-30T17:26:20.367402+0000","last_peered":"2023-11-30T17:26:20.367402+0000","last_clean":"2023-11-30T17:26:20.367402+0000","last_became_active":"2023-11-30T17:26:19.984327+0000","last_became_peered":"2023-11-30T17:26:19.984327+0000","last_unstale":"2023-11-30T17:26:20.367402+0000","last_undegraded":"2023-11-30T17:26:20.367402+0000","last_fullsized":"2023-11-30T17:26:20.367402+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.375502+0000","last_change":"2023-11-30T17:26:20.372493+0000","last_active":"2023-11-30T17:26:20.375502+0000","last_peered":"2023-11-30T17:26:20.375502+0000","last_clean":"2023-11-30T17:26:20.375502+0000","last_became_active":"2023-11-30T17:26:20.372215+0000","last_became_peered":"2023-11-30T17:26:20.372215+0000","last_unstale":"2023-11-30T17:26:20.375502+0000","last_undegraded":"2023-11-30T17:26:20.375502+0000","last_fullsized":"2023-11-30T17:26:20.375502+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.373795+0000","last_change":"2023-11-30T17:26:19.987201+0000","last_active":"2023-11-30T17:26:20.373795+0000","last_peered":"2023-11-30T17:26:20.373795+0000","last_clean":"2023-11-30T17:26:20.373795+0000","last_became_active":"2023-11-30T17:26:19.986920+0000","last_became_peered":"2023-11-30T17:26:19.986920+0000","last_unstale":"2023-11-30T17:26:20.373795+0000","last_undegraded":"2023-11-30T17:26:20.373795+0000","last_fullsized":"2023-11-30T17:26:20.373795+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387017+0000","last_change":"2023-11-30T17:26:20.383055+0000","last_active":"2023-11-30T17:26:20.387017+0000","last_peered":"2023-11-30T17:26:20.387017+0000","last_clean":"2023-11-30T17:26:20.387017+0000","last_became_active":"2023-11-30T17:26:20.382783+0000","last_became_peered":"2023-11-30T17:26:20.382783+0000","last_unstale":"2023-11-30T17:26:20.387017+0000","last_undegraded":"2023-11-30T17:26:20.387017+0000","last_fullsized":"2023-11-30T17:26:20.387017+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.362556+0000","last_change":"2023-11-30T17:26:19.984053+0000","last_active":"2023-11-30T17:26:20.362556+0000","last_peered":"2023-11-30T17:26:20.362556+0000","last_clean":"2023-11-30T17:26:20.362556+0000","last_became_active":"2023-11-30T17:26:19.983779+0000","last_became_peered":"2023-11-30T17:26:19.983779+0000","last_unstale":"2023-11-30T17:26:20.362556+0000","last_undegraded":"2023-11-30T17:26:20.362556+0000","last_fullsized":"2023-11-30T17:26:20.362556+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.379911+0000","last_change":"2023-11-30T17:26:20.374583+0000","last_active":"2023-11-30T17:26:20.379911+0000","last_peered":"2023-11-30T17:26:20.379911+0000","last_clean":"2023-11-30T17:26:20.379911+0000","last_became_active":"2023-11-30T17:26:20.374333+0000","last_became_peered":"2023-11-30T17:26:20.374333+0000","last_unstale":"2023-11-30T17:26:20.379911+0000","last_undegraded":"2023-11-30T17:26:20.379911+0000","last_fullsized":"2023-11-30T17:26:20.379911+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.382876+0000","last_change":"2023-11-30T17:26:19.985890+0000","last_active":"2023-11-30T17:26:20.382876+0000","last_peered":"2023-11-30T17:26:20.382876+0000","last_clean":"2023-11-30T17:26:20.382876+0000","last_became_active":"2023-11-30T17:26:19.983020+0000","last_became_peered":"2023-11-30T17:26:19.983020+0000","last_unstale":"2023-11-30T17:26:20.382876+0000","last_undegraded":"2023-11-30T17:26:20.382876+0000","last_fullsized":"2023-11-30T17:26:20.382876+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.382233+0000","last_change":"2023-11-30T17:26:20.378610+0000","last_active":"2023-11-30T17:26:20.382233+0000","last_peered":"2023-11-30T17:26:20.382233+0000","last_clean":"2023-11-30T17:26:20.382233+0000","last_became_active":"2023-11-30T17:26:20.375876+0000","last_became_peered":"2023-11-30T17:26:20.375876+0000","last_unstale":"2023-11-30T17:26:20.382233+0000","last_undegraded":"2023-11-30T17:26:20.382233+0000","last_fullsized":"2023-11-30T17:26:20.382233+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.361596+0000","last_change":"2023-11-30T17:26:19.983356+0000","last_active":"2023-11-30T17:26:20.361596+0000","last_peered":"2023-11-30T17:26:20.361596+0000","last_clean":"2023-11-30T17:26:20.361596+0000","last_became_active":"2023-11-30T17:26:19.983067+0000","last_became_peered":"2023-11-30T17:26:19.983067+0000","last_unstale":"2023-11-30T17:26:20.361596+0000","last_undegraded":"2023-11-30T17:26:20.361596+0000","last_fullsized":"2023-11-30T17:26:20.361596+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.391562+0000","last_change":"2023-11-30T17:26:20.389661+0000","last_active":"2023-11-30T17:26:20.391562+0000","last_peered":"2023-11-30T17:26:20.391562+0000","last_clean":"2023-11-30T17:26:20.391562+0000","last_became_active":"2023-11-30T17:26:20.389393+0000","last_became_peered":"2023-11-30T17:26:20.389393+0000","last_unstale":"2023-11-30T17:26:20.391562+0000","last_undegraded":"2023-11-30T17:26:20.391562+0000","last_fullsized":"2023-11-30T17:26:20.391562+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388319+0000","last_change":"2023-11-30T17:26:19.988210+0000","last_active":"2023-11-30T17:26:20.388319+0000","last_peered":"2023-11-30T17:26:20.388319+0000","last_clean":"2023-11-30T17:26:20.388319+0000","last_became_active":"2023-11-30T17:26:19.987860+0000","last_became_peered":"2023-11-30T17:26:19.987860+0000","last_unstale":"2023-11-30T17:26:20.388319+0000","last_undegraded":"2023-11-30T17:26:20.388319+0000","last_fullsized":"2023-11-30T17:26:20.388319+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.384545+0000","last_change":"2023-11-30T17:26:20.381565+0000","last_active":"2023-11-30T17:26:20.384545+0000","last_peered":"2023-11-30T17:26:20.384545+0000","last_clean":"2023-11-30T17:26:20.384545+0000","last_became_active":"2023-11-30T17:26:20.381297+0000","last_became_peered":"2023-11-30T17:26:20.381297+0000","last_unstale":"2023-11-30T17:26:20.384545+0000","last_undegraded":"2023-11-30T17:26:20.384545+0000","last_fullsized":"2023-11-30T17:26:20.384545+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"145'2","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.390515+0000","last_change":"2023-11-30T17:26:19.981375+0000","last_active":"2023-11-30T17:26:20.390515+0000","last_peered":"2023-11-30T17:26:20.390515+0000","last_clean":"2023-11-30T17:26:20.390515+0000","last_became_active":"2023-11-30T17:26:19.981145+0000","last_became_peered":"2023-11-30T17:26:19.981145+0000","last_unstale":"2023-11-30T17:26:20.390515+0000","last_undegraded":"2023-11-30T17:26:20.390515+0000","last_fullsized":"2023-11-30T17:26:20.390515+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.369029+0000","last_change":"2023-11-30T17:26:20.367227+0000","last_active":"2023-11-30T17:26:20.369029+0000","last_peered":"2023-11-30T17:26:20.369029+0000","last_clean":"2023-11-30T17:26:20.369029+0000","last_became_active":"2023-11-30T17:26:20.366972+0000","last_became_peered":"2023-11-30T17:26:20.366972+0000","last_unstale":"2023-11-30T17:26:20.369029+0000","last_undegraded":"2023-11-30T17:26:20.369029+0000","last_fullsized":"2023-11-30T17:26:20.369029+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.369743+0000","last_change":"2023-11-30T17:26:19.990348+0000","last_active":"2023-11-30T17:26:20.369743+0000","last_peered":"2023-11-30T17:26:20.369743+0000","last_clean":"2023-11-30T17:26:20.369743+0000","last_became_active":"2023-11-30T17:26:19.990061+0000","last_became_peered":"2023-11-30T17:26:19.990061+0000","last_unstale":"2023-11-30T17:26:20.369743+0000","last_undegraded":"2023-11-30T17:26:20.369743+0000","last_fullsized":"2023-11-30T17:26:20.369743+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.386210+0000","last_change":"2023-11-30T17:26:20.382452+0000","last_active":"2023-11-30T17:26:20.386210+0000","last_peered":"2023-11-30T17:26:20.386210+0000","last_clean":"2023-11-30T17:26:20.386210+0000","last_became_active":"2023-11-30T17:26:20.382128+0000","last_became_peered":"2023-11-30T17:26:20.382128+0000","last_unstale":"2023-11-30T17:26:20.386210+0000","last_undegraded":"2023-11-30T17:26:20.386210+0000","last_fullsized":"2023-11-30T17:26:20.386210+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.369353+0000","last_change":"2023-11-30T17:26:19.992481+0000","last_active":"2023-11-30T17:26:20.369353+0000","last_peered":"2023-11-30T17:26:20.369353+0000","last_clean":"2023-11-30T17:26:20.369353+0000","last_became_active":"2023-11-30T17:26:19.992238+0000","last_became_peered":"2023-11-30T17:26:19.992238+0000","last_unstale":"2023-11-30T17:26:20.369353+0000","last_undegraded":"2023-11-30T17:26:20.369353+0000","last_fullsized":"2023-11-30T17:26:20.369353+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.372663+0000","last_change":"2023-11-30T17:26:20.367396+0000","last_active":"2023-11-30T17:26:20.372663+0000","last_peered":"2023-11-30T17:26:20.372663+0000","last_clean":"2023-11-30T17:26:20.372663+0000","last_became_active":"2023-11-30T17:26:20.367149+0000","last_became_peered":"2023-11-30T17:26:20.367149+0000","last_unstale":"2023-11-30T17:26:20.372663+0000","last_undegraded":"2023-11-30T17:26:20.372663+0000","last_fullsized":"2023-11-30T17:26:20.372663+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387964+0000","last_change":"2023-11-30T17:26:19.992039+0000","last_active":"2023-11-30T17:26:20.387964+0000","last_peered":"2023-11-30T17:26:20.387964+0000","last_clean":"2023-11-30T17:26:20.387964+0000","last_became_active":"2023-11-30T17:26:19.991746+0000","last_became_peered":"2023-11-30T17:26:19.991746+0000","last_unstale":"2023-11-30T17:26:20.387964+0000","last_undegraded":"2023-11-30T17:26:20.387964+0000","last_fullsized":"2023-11-30T17:26:20.387964+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.389971+0000","last_change":"2023-11-30T17:26:20.387816+0000","last_active":"2023-11-30T17:26:20.389971+0000","last_peered":"2023-11-30T17:26:20.389971+0000","last_clean":"2023-11-30T17:26:20.389971+0000","last_became_active":"2023-11-30T17:26:20.387545+0000","last_became_peered":"2023-11-30T17:26:20.387545+0000","last_unstale":"2023-11-30T17:26:20.389971+0000","last_undegraded":"2023-11-30T17:26:20.389971+0000","last_fullsized":"2023-11-30T17:26:20.389971+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.368559+0000","last_change":"2023-11-30T17:26:19.995200+0000","last_active":"2023-11-30T17:26:20.368559+0000","last_peered":"2023-11-30T17:26:20.368559+0000","last_clean":"2023-11-30T17:26:20.368559+0000","last_became_active":"2023-11-30T17:26:19.994859+0000","last_became_peered":"2023-11-30T17:26:19.994859+0000","last_unstale":"2023-11-30T17:26:20.368559+0000","last_undegraded":"2023-11-30T17:26:20.368559+0000","last_fullsized":"2023-11-30T17:26:20.368559+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388385+0000","last_change":"2023-11-30T17:26:20.384418+0000","last_active":"2023-11-30T17:26:20.388385+0000","last_peered":"2023-11-30T17:26:20.388385+0000","last_clean":"2023-11-30T17:26:20.388385+0000","last_became_active":"2023-11-30T17:26:20.384004+0000","last_became_peered":"2023-11-30T17:26:20.384004+0000","last_unstale":"2023-11-30T17:26:20.388385+0000","last_undegraded":"2023-11-30T17:26:20.388385+0000","last_fullsized":"2023-11-30T17:26:20.388385+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.368469+0000","last_change":"2023-11-30T17:26:19.983949+0000","last_active":"2023-11-30T17:26:20.368469+0000","last_peered":"2023-11-30T17:26:20.368469+0000","last_clean":"2023-11-30T17:26:20.368469+0000","last_became_active":"2023-11-30T17:26:19.983648+0000","last_became_peered":"2023-11-30T17:26:19.983648+0000","last_unstale":"2023-11-30T17:26:20.368469+0000","last_undegraded":"2023-11-30T17:26:20.368469+0000","last_fullsized":"2023-11-30T17:26:20.368469+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.386943+0000","last_change":"2023-11-30T17:26:20.384263+0000","last_active":"2023-11-30T17:26:20.386943+0000","last_peered":"2023-11-30T17:26:20.386943+0000","last_clean":"2023-11-30T17:26:20.386943+0000","last_became_active":"2023-11-30T17:26:20.383973+0000","last_became_peered":"2023-11-30T17:26:20.383973+0000","last_unstale":"2023-11-30T17:26:20.386943+0000","last_undegraded":"2023-11-30T17:26:20.386943+0000","last_fullsized":"2023-11-30T17:26:20.386943+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.368400+0000","last_change":"2023-11-30T17:26:19.992000+0000","last_active":"2023-11-30T17:26:20.368400+0000","last_peered":"2023-11-30T17:26:20.368400+0000","last_clean":"2023-11-30T17:26:20.368400+0000","last_became_active":"2023-11-30T17:26:19.991708+0000","last_became_peered":"2023-11-30T17:26:19.991708+0000","last_unstale":"2023-11-30T17:26:20.368400+0000","last_undegraded":"2023-11-30T17:26:20.368400+0000","last_fullsized":"2023-11-30T17:26:20.368400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388245+0000","last_change":"2023-11-30T17:26:20.379764+0000","last_active":"2023-11-30T17:26:20.388245+0000","last_peered":"2023-11-30T17:26:20.388245+0000","last_clean":"2023-11-30T17:26:20.388245+0000","last_became_active":"2023-11-30T17:26:20.377985+0000","last_became_peered":"2023-11-30T17:26:20.377985+0000","last_unstale":"2023-11-30T17:26:20.388245+0000","last_undegraded":"2023-11-30T17:26:20.388245+0000","last_fullsized":"2023-11-30T17:26:20.388245+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"145'2","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387675+0000","last_change":"2023-11-30T17:26:19.982671+0000","last_active":"2023-11-30T17:26:20.387675+0000","last_peered":"2023-11-30T17:26:20.387675+0000","last_clean":"2023-11-30T17:26:20.387675+0000","last_became_active":"2023-11-30T17:26:19.982327+0000","last_became_peered":"2023-11-30T17:26:19.982327+0000","last_unstale":"2023-11-30T17:26:20.387675+0000","last_undegraded":"2023-11-30T17:26:20.387675+0000","last_fullsized":"2023-11-30T17:26:20.387675+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.377528+0000","last_change":"2023-11-30T17:26:20.372744+0000","last_active":"2023-11-30T17:26:20.377528+0000","last_peered":"2023-11-30T17:26:20.377528+0000","last_clean":"2023-11-30T17:26:20.377528+0000","last_became_active":"2023-11-30T17:26:20.372405+0000","last_became_peered":"2023-11-30T17:26:20.372405+0000","last_unstale":"2023-11-30T17:26:20.377528+0000","last_undegraded":"2023-11-30T17:26:20.377528+0000","last_fullsized":"2023-11-30T17:26:20.377528+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.365733+0000","last_change":"2023-11-30T17:26:19.987336+0000","last_active":"2023-11-30T17:26:20.365733+0000","last_peered":"2023-11-30T17:26:20.365733+0000","last_clean":"2023-11-30T17:26:20.365733+0000","last_became_active":"2023-11-30T17:26:19.987056+0000","last_became_peered":"2023-11-30T17:26:19.987056+0000","last_unstale":"2023-11-30T17:26:20.365733+0000","last_undegraded":"2023-11-30T17:26:20.365733+0000","last_fullsized":"2023-11-30T17:26:20.365733+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387471+0000","last_change":"2023-11-30T17:26:20.384996+0000","last_active":"2023-11-30T17:26:20.387471+0000","last_peered":"2023-11-30T17:26:20.387471+0000","last_clean":"2023-11-30T17:26:20.387471+0000","last_became_active":"2023-11-30T17:26:20.384583+0000","last_became_peered":"2023-11-30T17:26:20.384583+0000","last_unstale":"2023-11-30T17:26:20.387471+0000","last_undegraded":"2023-11-30T17:26:20.387471+0000","last_fullsized":"2023-11-30T17:26:20.387471+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.365840+0000","last_change":"2023-11-30T17:26:19.982892+0000","last_active":"2023-11-30T17:26:20.365840+0000","last_peered":"2023-11-30T17:26:20.365840+0000","last_clean":"2023-11-30T17:26:20.365840+0000","last_became_active":"2023-11-30T17:26:19.982541+0000","last_became_peered":"2023-11-30T17:26:19.982541+0000","last_unstale":"2023-11-30T17:26:20.365840+0000","last_undegraded":"2023-11-30T17:26:20.365840+0000","last_fullsized":"2023-11-30T17:26:20.365840+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.386203+0000","last_change":"2023-11-30T17:26:20.384364+0000","last_active":"2023-11-30T17:26:20.386203+0000","last_peered":"2023-11-30T17:26:20.386203+0000","last_clean":"2023-11-30T17:26:20.386203+0000","last_became_active":"2023-11-30T17:26:20.384056+0000","last_became_peered":"2023-11-30T17:26:20.384056+0000","last_unstale":"2023-11-30T17:26:20.386203+0000","last_undegraded":"2023-11-30T17:26:20.386203+0000","last_fullsized":"2023-11-30T17:26:20.386203+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.362718+0000","last_change":"2023-11-30T17:26:19.992639+0000","last_active":"2023-11-30T17:26:20.362718+0000","last_peered":"2023-11-30T17:26:20.362718+0000","last_clean":"2023-11-30T17:26:20.362718+0000","last_became_active":"2023-11-30T17:26:19.992138+0000","last_became_peered":"2023-11-30T17:26:19.992138+0000","last_unstale":"2023-11-30T17:26:20.362718+0000","last_undegraded":"2023-11-30T17:26:20.362718+0000","last_fullsized":"2023-11-30T17:26:20.362718+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387755+0000","last_change":"2023-11-30T17:26:20.383476+0000","last_active":"2023-11-30T17:26:20.387755+0000","last_peered":"2023-11-30T17:26:20.387755+0000","last_clean":"2023-11-30T17:26:20.387755+0000","last_became_active":"2023-11-30T17:26:20.383216+0000","last_became_peered":"2023-11-30T17:26:20.383216+0000","last_unstale":"2023-11-30T17:26:20.387755+0000","last_undegraded":"2023-11-30T17:26:20.387755+0000","last_fullsized":"2023-11-30T17:26:20.387755+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.373820+0000","last_change":"2023-11-30T17:26:19.989107+0000","last_active":"2023-11-30T17:26:20.373820+0000","last_peered":"2023-11-30T17:26:20.373820+0000","last_clean":"2023-11-30T17:26:20.373820+0000","last_became_active":"2023-11-30T17:26:19.988455+0000","last_became_peered":"2023-11-30T17:26:19.988455+0000","last_unstale":"2023-11-30T17:26:20.373820+0000","last_undegraded":"2023-11-30T17:26:20.373820+0000","last_fullsized":"2023-11-30T17:26:20.373820+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388702+0000","last_change":"2023-11-30T17:26:20.379634+0000","last_active":"2023-11-30T17:26:20.388702+0000","last_peered":"2023-11-30T17:26:20.388702+0000","last_clean":"2023-11-30T17:26:20.388702+0000","last_became_active":"2023-11-30T17:26:20.379397+0000","last_became_peered":"2023-11-30T17:26:20.379397+0000","last_unstale":"2023-11-30T17:26:20.388702+0000","last_undegraded":"2023-11-30T17:26:20.388702+0000","last_fullsized":"2023-11-30T17:26:20.388702+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.373545+0000","last_change":"2023-11-30T17:26:19.981422+0000","last_active":"2023-11-30T17:26:20.373545+0000","last_peered":"2023-11-30T17:26:20.373545+0000","last_clean":"2023-11-30T17:26:20.373545+0000","last_became_active":"2023-11-30T17:26:19.981144+0000","last_became_peered":"2023-11-30T17:26:19.981144+0000","last_unstale":"2023-11-30T17:26:20.373545+0000","last_undegraded":"2023-11-30T17:26:20.373545+0000","last_fullsized":"2023-11-30T17:26:20.373545+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.390207+0000","last_change":"2023-11-30T17:26:20.387973+0000","last_active":"2023-11-30T17:26:20.390207+0000","last_peered":"2023-11-30T17:26:20.390207+0000","last_clean":"2023-11-30T17:26:20.390207+0000","last_became_active":"2023-11-30T17:26:20.387642+0000","last_became_peered":"2023-11-30T17:26:20.387642+0000","last_unstale":"2023-11-30T17:26:20.390207+0000","last_undegraded":"2023-11-30T17:26:20.390207+0000","last_fullsized":"2023-11-30T17:26:20.390207+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.362038+0000","last_change":"2023-11-30T17:26:19.983222+0000","last_active":"2023-11-30T17:26:20.362038+0000","last_peered":"2023-11-30T17:26:20.362038+0000","last_clean":"2023-11-30T17:26:20.362038+0000","last_became_active":"2023-11-30T17:26:19.982924+0000","last_became_peered":"2023-11-30T17:26:19.982924+0000","last_unstale":"2023-11-30T17:26:20.362038+0000","last_undegraded":"2023-11-30T17:26:20.362038+0000","last_fullsized":"2023-11-30T17:26:20.362038+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.382213+0000","last_change":"2023-11-30T17:26:20.378438+0000","last_active":"2023-11-30T17:26:20.382213+0000","last_peered":"2023-11-30T17:26:20.382213+0000","last_clean":"2023-11-30T17:26:20.382213+0000","last_became_active":"2023-11-30T17:26:20.374869+0000","last_became_peered":"2023-11-30T17:26:20.374869+0000","last_unstale":"2023-11-30T17:26:20.382213+0000","last_undegraded":"2023-11-30T17:26:20.382213+0000","last_fullsized":"2023-11-30T17:26:20.382213+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.369625+0000","last_change":"2023-11-30T17:26:19.988134+0000","last_active":"2023-11-30T17:26:20.369625+0000","last_peered":"2023-11-30T17:26:20.369625+0000","last_clean":"2023-11-30T17:26:20.369625+0000","last_became_active":"2023-11-30T17:26:19.987843+0000","last_became_peered":"2023-11-30T17:26:19.987843+0000","last_unstale":"2023-11-30T17:26:20.369625+0000","last_undegraded":"2023-11-30T17:26:20.369625+0000","last_fullsized":"2023-11-30T17:26:20.369625+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388633+0000","last_change":"2023-11-30T17:26:20.379413+0000","last_active":"2023-11-30T17:26:20.388633+0000","last_peered":"2023-11-30T17:26:20.388633+0000","last_clean":"2023-11-30T17:26:20.388633+0000","last_became_active":"2023-11-30T17:26:20.379139+0000","last_became_peered":"2023-11-30T17:26:20.379139+0000","last_unstale":"2023-11-30T17:26:20.388633+0000","last_undegraded":"2023-11-30T17:26:20.388633+0000","last_fullsized":"2023-11-30T17:26:20.388633+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.368642+0000","last_change":"2023-11-30T17:26:19.987984+0000","last_active":"2023-11-30T17:26:20.368642+0000","last_peered":"2023-11-30T17:26:20.368642+0000","last_clean":"2023-11-30T17:26:20.368642+0000","last_became_active":"2023-11-30T17:26:19.986994+0000","last_became_peered":"2023-11-30T17:26:19.986994+0000","last_unstale":"2023-11-30T17:26:20.368642+0000","last_undegraded":"2023-11-30T17:26:20.368642+0000","last_fullsized":"2023-11-30T17:26:20.368642+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":120,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.367486+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T17:26:20.367486+0000","last_peered":"2023-11-30T17:26:20.367486+0000","last_clean":"2023-11-30T17:26:20.367486+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T17:26:20.367486+0000","last_undegraded":"2023-11-30T17:26:20.367486+0000","last_fullsized":"2023-11-30T17:26:20.367486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.378419+0000","last_change":"2023-11-30T17:26:20.373690+0000","last_active":"2023-11-30T17:26:20.378419+0000","last_peered":"2023-11-30T17:26:20.378419+0000","last_clean":"2023-11-30T17:26:20.378419+0000","last_became_active":"2023-11-30T17:26:20.373416+0000","last_became_peered":"2023-11-30T17:26:20.373416+0000","last_unstale":"2023-11-30T17:26:20.378419+0000","last_undegraded":"2023-11-30T17:26:20.378419+0000","last_fullsized":"2023-11-30T17:26:20.378419+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.368390+0000","last_change":"2023-11-30T17:26:19.985498+0000","last_active":"2023-11-30T17:26:20.368390+0000","last_peered":"2023-11-30T17:26:20.368390+0000","last_clean":"2023-11-30T17:26:20.368390+0000","last_became_active":"2023-11-30T17:26:19.985216+0000","last_became_peered":"2023-11-30T17:26:19.985216+0000","last_unstale":"2023-11-30T17:26:20.368390+0000","last_undegraded":"2023-11-30T17:26:20.368390+0000","last_fullsized":"2023-11-30T17:26:20.368390+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":119,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.380528+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T17:26:20.380528+0000","last_peered":"2023-11-30T17:26:20.380528+0000","last_clean":"2023-11-30T17:26:20.380528+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T17:26:20.380528+0000","last_undegraded":"2023-11-30T17:26:20.380528+0000","last_fullsized":"2023-11-30T17:26:20.380528+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.382119+0000","last_change":"2023-11-30T17:26:20.376591+0000","last_active":"2023-11-30T17:26:20.382119+0000","last_peered":"2023-11-30T17:26:20.382119+0000","last_clean":"2023-11-30T17:26:20.382119+0000","last_became_active":"2023-11-30T17:26:20.376321+0000","last_became_peered":"2023-11-30T17:26:20.376321+0000","last_unstale":"2023-11-30T17:26:20.382119+0000","last_undegraded":"2023-11-30T17:26:20.382119+0000","last_fullsized":"2023-11-30T17:26:20.382119+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.372027+0000","last_change":"2023-11-30T17:26:19.983242+0000","last_active":"2023-11-30T17:26:20.372027+0000","last_peered":"2023-11-30T17:26:20.372027+0000","last_clean":"2023-11-30T17:26:20.372027+0000","last_became_active":"2023-11-30T17:26:19.982752+0000","last_became_peered":"2023-11-30T17:26:19.982752+0000","last_unstale":"2023-11-30T17:26:20.372027+0000","last_undegraded":"2023-11-30T17:26:20.372027+0000","last_fullsized":"2023-11-30T17:26:20.372027+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":125,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.364909+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T17:26:20.364909+0000","last_peered":"2023-11-30T17:26:20.364909+0000","last_clean":"2023-11-30T17:26:20.364909+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T17:26:20.364909+0000","last_undegraded":"2023-11-30T17:26:20.364909+0000","last_fullsized":"2023-11-30T17:26:20.364909+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.386117+0000","last_change":"2023-11-30T17:26:20.382988+0000","last_active":"2023-11-30T17:26:20.386117+0000","last_peered":"2023-11-30T17:26:20.386117+0000","last_clean":"2023-11-30T17:26:20.386117+0000","last_became_active":"2023-11-30T17:26:20.381614+0000","last_became_peered":"2023-11-30T17:26:20.381614+0000","last_unstale":"2023-11-30T17:26:20.386117+0000","last_undegraded":"2023-11-30T17:26:20.386117+0000","last_fullsized":"2023-11-30T17:26:20.386117+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"145'4","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387035+0000","last_change":"2023-11-30T17:26:19.983439+0000","last_active":"2023-11-30T17:26:20.387035+0000","last_peered":"2023-11-30T17:26:20.387035+0000","last_clean":"2023-11-30T17:26:20.387035+0000","last_became_active":"2023-11-30T17:26:19.983163+0000","last_became_peered":"2023-11-30T17:26:19.983163+0000","last_unstale":"2023-11-30T17:26:20.387035+0000","last_undegraded":"2023-11-30T17:26:20.387035+0000","last_fullsized":"2023-11-30T17:26:20.387035+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":119,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.380676+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T17:26:20.380676+0000","last_peered":"2023-11-30T17:26:20.380676+0000","last_clean":"2023-11-30T17:26:20.380676+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T17:26:20.380676+0000","last_undegraded":"2023-11-30T17:26:20.380676+0000","last_fullsized":"2023-11-30T17:26:20.380676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":118,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.369009+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T17:26:20.369009+0000","last_peered":"2023-11-30T17:26:20.369009+0000","last_clean":"2023-11-30T17:26:20.369009+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T17:26:20.369009+0000","last_undegraded":"2023-11-30T17:26:20.369009+0000","last_fullsized":"2023-11-30T17:26:20.369009+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388584+0000","last_change":"2023-11-30T17:26:20.378107+0000","last_active":"2023-11-30T17:26:20.388584+0000","last_peered":"2023-11-30T17:26:20.388584+0000","last_clean":"2023-11-30T17:26:20.388584+0000","last_became_active":"2023-11-30T17:26:20.377828+0000","last_became_peered":"2023-11-30T17:26:20.377828+0000","last_unstale":"2023-11-30T17:26:20.388584+0000","last_undegraded":"2023-11-30T17:26:20.388584+0000","last_fullsized":"2023-11-30T17:26:20.388584+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387999+0000","last_change":"2023-11-30T17:26:19.988123+0000","last_active":"2023-11-30T17:26:20.387999+0000","last_peered":"2023-11-30T17:26:20.387999+0000","last_clean":"2023-11-30T17:26:20.387999+0000","last_became_active":"2023-11-30T17:26:19.987855+0000","last_became_peered":"2023-11-30T17:26:19.987855+0000","last_unstale":"2023-11-30T17:26:20.387999+0000","last_undegraded":"2023-11-30T17:26:20.387999+0000","last_fullsized":"2023-11-30T17:26:20.387999+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":116,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.369095+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T17:26:20.369095+0000","last_peered":"2023-11-30T17:26:20.369095+0000","last_clean":"2023-11-30T17:26:20.369095+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T17:26:20.369095+0000","last_undegraded":"2023-11-30T17:26:20.369095+0000","last_fullsized":"2023-11-30T17:26:20.369095+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.391295+0000","last_change":"2023-11-30T17:26:20.387932+0000","last_active":"2023-11-30T17:26:20.391295+0000","last_peered":"2023-11-30T17:26:20.391295+0000","last_clean":"2023-11-30T17:26:20.391295+0000","last_became_active":"2023-11-30T17:26:20.387661+0000","last_became_peered":"2023-11-30T17:26:20.387661+0000","last_unstale":"2023-11-30T17:26:20.391295+0000","last_undegraded":"2023-11-30T17:26:20.391295+0000","last_fullsized":"2023-11-30T17:26:20.391295+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.380774+0000","last_change":"2023-11-30T17:26:19.988366+0000","last_active":"2023-11-30T17:26:20.380774+0000","last_peered":"2023-11-30T17:26:20.380774+0000","last_clean":"2023-11-30T17:26:20.380774+0000","last_became_active":"2023-11-30T17:26:19.988062+0000","last_became_peered":"2023-11-30T17:26:19.988062+0000","last_unstale":"2023-11-30T17:26:20.380774+0000","last_undegraded":"2023-11-30T17:26:20.380774+0000","last_fullsized":"2023-11-30T17:26:20.380774+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":116,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.369831+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T17:26:20.369831+0000","last_peered":"2023-11-30T17:26:20.369831+0000","last_clean":"2023-11-30T17:26:20.369831+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T17:26:20.369831+0000","last_undegraded":"2023-11-30T17:26:20.369831+0000","last_fullsized":"2023-11-30T17:26:20.369831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387968+0000","last_change":"2023-11-30T17:26:20.379116+0000","last_active":"2023-11-30T17:26:20.387968+0000","last_peered":"2023-11-30T17:26:20.387968+0000","last_clean":"2023-11-30T17:26:20.387968+0000","last_became_active":"2023-11-30T17:26:20.378824+0000","last_became_peered":"2023-11-30T17:26:20.378824+0000","last_unstale":"2023-11-30T17:26:20.387968+0000","last_undegraded":"2023-11-30T17:26:20.387968+0000","last_fullsized":"2023-11-30T17:26:20.387968+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"145'3","reported_seq":13,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.389927+0000","last_change":"2023-11-30T17:26:19.986818+0000","last_active":"2023-11-30T17:26:20.389927+0000","last_peered":"2023-11-30T17:26:20.389927+0000","last_clean":"2023-11-30T17:26:20.389927+0000","last_became_active":"2023-11-30T17:26:19.986022+0000","last_became_peered":"2023-11-30T17:26:19.986022+0000","last_unstale":"2023-11-30T17:26:20.389927+0000","last_undegraded":"2023-11-30T17:26:20.389927+0000","last_fullsized":"2023-11-30T17:26:20.389927+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":120,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.366892+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T17:26:20.366892+0000","last_peered":"2023-11-30T17:26:20.366892+0000","last_clean":"2023-11-30T17:26:20.366892+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T17:26:20.366892+0000","last_undegraded":"2023-11-30T17:26:20.366892+0000","last_fullsized":"2023-11-30T17:26:20.366892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.388694+0000","last_change":"2023-11-30T17:26:20.384475+0000","last_active":"2023-11-30T17:26:20.388694+0000","last_peered":"2023-11-30T17:26:20.388694+0000","last_clean":"2023-11-30T17:26:20.388694+0000","last_became_active":"2023-11-30T17:26:20.384010+0000","last_became_peered":"2023-11-30T17:26:20.384010+0000","last_unstale":"2023-11-30T17:26:20.388694+0000","last_undegraded":"2023-11-30T17:26:20.388694+0000","last_fullsized":"2023-11-30T17:26:20.388694+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:19.956237+0000","last_clean_scrub_stamp":"2023-11-30T17:26:19.956237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"145'2","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.387207+0000","last_change":"2023-11-30T17:26:19.985131+0000","last_active":"2023-11-30T17:26:20.387207+0000","last_peered":"2023-11-30T17:26:20.387207+0000","last_clean":"2023-11-30T17:26:20.387207+0000","last_became_active":"2023-11-30T17:26:19.984824+0000","last_became_peered":"2023-11-30T17:26:19.984824+0000","last_unstale":"2023-11-30T17:26:20.387207+0000","last_undegraded":"2023-11-30T17:26:20.387207+0000","last_fullsized":"2023-11-30T17:26:20.387207+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:26:18.953784+0000","last_clean_scrub_stamp":"2023-11-30T17:26:18.953784+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":134,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-11-30T17:26:20.368724+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T17:26:20.368724+0000","last_peered":"2023-11-30T17:26:20.368724+0000","last_clean":"2023-11-30T17:26:20.368724+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T17:26:20.368724+0000","last_undegraded":"2023-11-30T17:26:20.368724+0000","last_fullsized":"2023-11-30T17:26:20.368724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575074,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302972,"kb_used_data":1780,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068868,"statfs":{"total":96636764160,"available":96326520832,"internally_reserved":0,"allocated":1822720,"data_stored":917956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:25:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.315},"max":{"1min":0.67900000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56699999999999995,"15min":0.58299999999999996},"min":{"1min":0.434,"5min":0.41099999999999998,"15min":0.36699999999999999},"max":{"1min":0.68700000000000006,"5min":0.78300000000000003,"15min":0.81899999999999995},"last":0.626}]},{"osd":1,"last update":"Thu Nov 30 17:25:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53600000000000003,"15min":0.54400000000000004},"min":{"1min":0.36199999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.626,"5min":1.181,"15min":1.181},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53300000000000003,"15min":0.54700000000000004},"min":{"1min":0.41599999999999998,"5min":0.32900000000000001,"15min":0.29899999999999999},"max":{"1min":0.64800000000000002,"5min":0.76600000000000001,"15min":0.82499999999999996},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Nov 30 17:25:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.38700000000000001,"5min":0.34200000000000003,"15min":0.33500000000000002},"max":{"1min":0.63800000000000001,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.54000000000000004,"15min":0.55500000000000005},"min":{"1min":0.38700000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.66500000000000004,"5min":0.73699999999999999,"15min":0.83899999999999997},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Nov 30 17:25:47 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.52200000000000002,"15min":0.53900000000000003},"min":{"1min":0.376,"5min":0.36699999999999999,"15min":0.36299999999999999},"max":{"1min":0.65100000000000002,"5min":0.749,"15min":0.78000000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57899999999999996,"15min":0.58399999999999996},"min":{"1min":0.40400000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68000000000000005,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.64800000000000002}]},{"osd":4,"last update":"Thu Nov 30 17:25:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.30099999999999999,"5min":0.29899999999999999,"15min":0.29699999999999999},"max":{"1min":0.68799999999999994,"5min":0.77000000000000002,"15min":0.77500000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.48599999999999999,"15min":0.47999999999999998},"min":{"1min":0.32200000000000001,"5min":0.30099999999999999,"15min":0.29399999999999998},"max":{"1min":0.66600000000000004,"5min":0.748,"15min":0.75800000000000001},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Nov 30 17:25:47 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.49099999999999999,"15min":0.48699999999999999},"min":{"1min":0.34399999999999997,"5min":0.313,"15min":0.29499999999999998},"max":{"1min":0.70299999999999996,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52600000000000002,"15min":0.52100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33300000000000002,"15min":0.32200000000000001},"max":{"1min":0.72599999999999998,"5min":0.80000000000000004,"15min":0.81299999999999994},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Nov 30 17:25:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.36799999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.72599999999999998,"5min":0.81200000000000006,"15min":0.85199999999999998},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.33300000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65700000000000003,"5min":0.78900000000000003,"15min":0.92800000000000005},"last":0.64000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575073,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302964,"kb_used_data":1772,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068876,"statfs":{"total":96636764160,"available":96326529024,"internally_reserved":0,"allocated":1814528,"data_stored":918316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:25:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.57099999999999995},"min":{"1min":0.38800000000000001,"5min":0.32500000000000001,"15min":0.27700000000000002},"max":{"1min":0.69799999999999995,"5min":0.80200000000000005,"15min":0.82899999999999996},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56999999999999995,"15min":0.58699999999999997},"min":{"1min":0.44800000000000001,"5min":0.33500000000000002,"15min":0.308},"max":{"1min":0.75600000000000001,"5min":0.83599999999999997,"15min":0.89300000000000002},"last":0.442}]},{"osd":1,"last update":"Thu Nov 30 17:25:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.56100000000000005},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.74199999999999999,"5min":0.78400000000000003,"15min":0.78500000000000003},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58399999999999996,"15min":0.59799999999999998},"min":{"1min":0.46600000000000003,"5min":0.35899999999999999,"15min":0.313},"max":{"1min":0.78800000000000003,"5min":0.80000000000000004,"15min":0.85199999999999998},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:25:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54400000000000004,"15min":0.56799999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.26500000000000001},"max":{"1min":0.68600000000000005,"5min":0.77500000000000002,"15min":0.80100000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57399999999999995,"15min":0.58299999999999996},"min":{"1min":0.39100000000000001,"5min":0.34399999999999997,"15min":0.34300000000000003},"max":{"1min":0.76600000000000001,"5min":0.82299999999999995,"15min":0.82499999999999996},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Nov 30 17:25:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51100000000000001,"15min":0.52800000000000002},"min":{"1min":0.40000000000000002,"5min":0.32700000000000001,"15min":0.28299999999999997},"max":{"1min":0.67300000000000004,"5min":0.71899999999999997,"15min":0.77200000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52400000000000002,"15min":0.53800000000000003},"min":{"1min":0.434,"5min":0.307,"15min":0.307},"max":{"1min":0.72899999999999998,"5min":0.73499999999999999,"15min":0.79600000000000004},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:25:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.44900000000000001,"15min":0.44800000000000001},"min":{"1min":0.33500000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.80300000000000005,"5min":0.80800000000000005,"15min":0.84199999999999997},"last":0.62},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.46899999999999997,"15min":0.47399999999999998},"min":{"1min":0.35699999999999998,"5min":0.316,"15min":0.23100000000000001},"max":{"1min":0.67000000000000004,"5min":0.746,"15min":0.83899999999999997},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Nov 30 17:25:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46200000000000002,"15min":0.46800000000000003},"min":{"1min":0.34399999999999997,"5min":0.315,"15min":0.29899999999999999},"max":{"1min":0.629,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.502,"15min":0.503},"min":{"1min":0.379,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84299999999999997,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Nov 30 17:25:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52600000000000002},"min":{"1min":0.36599999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71799999999999997,"5min":0.80000000000000004,"15min":0.93200000000000005},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55100000000000005,"15min":0.55700000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.34300000000000003},"max":{"1min":0.77700000000000002,"5min":0.81299999999999994,"15min":0.83499999999999996},"last":0.67200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575073,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307060,"kb_used_data":1772,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064780,"statfs":{"total":96636764160,"available":96322334720,"internally_reserved":0,"allocated":1814528,"data_stored":917784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:25:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.36399999999999999,"15min":0.35999999999999999},"min":{"1min":0.247,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.56799999999999995,"5min":1.78,"15min":1.78},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.46999999999999997,"15min":0.47099999999999997},"min":{"1min":0.34699999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.62,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Nov 30 17:25:55 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.39200000000000002,"15min":0.39100000000000001},"min":{"1min":0.253,"5min":0.249,"15min":0.215},"max":{"1min":0.52100000000000002,"5min":1.665,"15min":1.665},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.495,"15min":0.502},"min":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.33400000000000002},"max":{"1min":0.66700000000000004,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Nov 30 17:25:55 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.307,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70999999999999996,"5min":1.865,"15min":1.865},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.42799999999999999,"15min":0.433},"min":{"1min":0.29499999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57499999999999996,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.442}]},{"osd":4,"last update":"Thu Nov 30 17:25:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58499999999999996,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.35499999999999998,"15min":0.34499999999999997},"max":{"1min":0.80300000000000005,"5min":0.873,"15min":0.89100000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.496,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.75900000000000001,"5min":0.85099999999999998,"15min":1.111},"last":0.75800000000000001}]},{"osd":5,"last update":"Thu Nov 30 17:25:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61099999999999999,"15min":0.60799999999999998},"min":{"1min":0.44700000000000001,"5min":0.39300000000000002,"15min":0.377},"max":{"1min":0.78000000000000003,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.60399999999999998,"15min":0.60899999999999999},"min":{"1min":0.47899999999999998,"5min":0.39300000000000002,"15min":0.36899999999999999},"max":{"1min":0.83999999999999997,"5min":0.874,"15min":0.91300000000000003},"last":0.76300000000000001}]},{"osd":6,"last update":"Thu Nov 30 17:25:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65200000000000002,"15min":0.66000000000000003},"min":{"1min":0.48899999999999999,"5min":0.442,"15min":0.39700000000000002},"max":{"1min":0.80100000000000005,"5min":0.91000000000000003,"15min":1.0600000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.65200000000000002,"15min":0.66000000000000003},"min":{"1min":0.48599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.82499999999999996,"5min":1.635,"15min":1.635},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Nov 30 17:25:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66300000000000003,"15min":0.67100000000000004},"min":{"1min":0.49199999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.86899999999999999,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.751},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.63800000000000001,"15min":0.65000000000000002},"min":{"1min":0.46000000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.879,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.79800000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575073,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302972,"kb_used_data":1780,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068868,"statfs":{"total":96636764160,"available":96326520832,"internally_reserved":0,"allocated":1822720,"data_stored":919230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 17:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.35399999999999998,"15min":0.36399999999999999},"min":{"1min":0.24199999999999999,"5min":0.23200000000000001,"15min":0.221},"max":{"1min":0.46100000000000002,"5min":0.54900000000000004,"15min":0.71199999999999997},"last":0.313},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.372,"15min":0.38200000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.21099999999999999},"max":{"1min":0.45600000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Nov 30 17:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.38100000000000001,"15min":0.38700000000000001},"min":{"1min":0.26300000000000001,"5min":0.24399999999999999,"15min":0.23899999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.441,"15min":0.45600000000000002},"min":{"1min":0.318,"5min":0.253,"15min":0.253},"max":{"1min":0.55800000000000005,"5min":0.65100000000000002,"15min":0.70499999999999996},"last":0.36399999999999999}]},{"osd":3,"last update":"Thu Nov 30 17:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.40999999999999998,"15min":0.42799999999999999},"min":{"1min":0.32300000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.58299999999999996,"5min":0.61699999999999999,"15min":0.66100000000000003},"last":0.371},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.43099999999999999,"15min":0.442},"min":{"1min":0.29999999999999999,"5min":0.27300000000000002,"15min":0.26600000000000001},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Nov 30 17:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57899999999999996,"15min":0.59999999999999998},"min":{"1min":0.40200000000000002,"5min":0.34999999999999998,"15min":0.34100000000000003},"max":{"1min":0.76400000000000001,"5min":0.78800000000000003,"15min":0.96099999999999997},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59099999999999997,"15min":0.61399999999999999},"min":{"1min":0.44400000000000001,"5min":0.379,"15min":0.33300000000000002},"max":{"1min":0.79000000000000004,"5min":0.86899999999999999,"15min":0.98599999999999999},"last":0.42599999999999999}]},{"osd":5,"last update":"Thu Nov 30 17:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59499999999999997,"15min":0.60099999999999998},"min":{"1min":0.41699999999999998,"5min":0.41199999999999998,"15min":0.39200000000000002},"max":{"1min":0.80500000000000005,"5min":0.86799999999999999,"15min":1.0109999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60099999999999998,"15min":0.622},"min":{"1min":0.439,"5min":0.40300000000000002,"15min":0.38400000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":1.004},"last":0.438}]},{"osd":6,"last update":"Thu Nov 30 17:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.374,"15min":0.374},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":1.002},"last":0.495},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61199999999999999,"15min":0.629},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.35299999999999998},"max":{"1min":0.83699999999999997,"5min":0.91500000000000004,"15min":0.96799999999999997},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Nov 30 17:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63100000000000001,"15min":0.64700000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.81299999999999994,"5min":0.94499999999999995,"15min":1.0129999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.66000000000000003,"15min":0.68200000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.40400000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.026},"last":0.53400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575073,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307052,"kb_used_data":1764,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064788,"statfs":{"total":96636764160,"available":96322342912,"internally_reserved":0,"allocated":1806336,"data_stored":911964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.41699999999999998,"15min":0.40300000000000002},"min":{"1min":0.27200000000000002,"5min":0.221,"15min":0.19900000000000001},"max":{"1min":0.58199999999999996,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.43099999999999999,"15min":0.436},"min":{"1min":0.27900000000000003,"5min":0.254,"15min":0.24199999999999999},"max":{"1min":0.57399999999999995,"5min":2.637,"15min":2.637},"last":0.36899999999999999}]},{"osd":1,"last update":"Thu Nov 30 17:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.48299999999999998,"15min":0.46000000000000002},"min":{"1min":0.32600000000000001,"5min":0.23599999999999999,"15min":0.22900000000000001},"max":{"1min":0.58099999999999996,"5min":6.1210000000000004,"15min":6.1210000000000004},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.503,"15min":0.48599999999999999},"min":{"1min":0.32800000000000001,"5min":0.30399999999999999,"15min":0.26700000000000002},"max":{"1min":0.59999999999999998,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.33500000000000002}]},{"osd":3,"last update":"Thu Nov 30 17:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.38400000000000001,"15min":0.40000000000000002},"min":{"1min":0.30499999999999999,"5min":0.23999999999999999,"15min":0.20599999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.86199999999999999},"last":0.313},{"interface":"front","average":{"1min":0.441,"5min":0.44700000000000001,"15min":0.46400000000000002},"min":{"1min":0.29299999999999998,"5min":0.28499999999999998,"15min":0.26900000000000002},"max":{"1min":0.626,"5min":1.756,"15min":1.756},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Nov 30 17:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.68600000000000005,"15min":0.64700000000000002},"min":{"1min":0.41099999999999998,"5min":0.40300000000000002,"15min":0.33500000000000002},"max":{"1min":0.83299999999999996,"5min":8.7170000000000005,"15min":8.7170000000000005},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59199999999999997,"15min":0.60799999999999998},"min":{"1min":0.45600000000000002,"5min":0.40999999999999998,"15min":0.371},"max":{"1min":0.81299999999999994,"5min":1.381,"15min":1.492},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Nov 30 17:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.629,"15min":0.63700000000000001},"min":{"1min":0.42599999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83699999999999997,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.441,"5min":0.39200000000000002,"15min":0.38900000000000001},"max":{"1min":0.80600000000000005,"5min":1.982,"15min":1.982},"last":0.73299999999999998}]},{"osd":6,"last update":"Thu Nov 30 17:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60299999999999998,"15min":0.626},"min":{"1min":0.438,"5min":0.40899999999999997,"15min":0.39600000000000002},"max":{"1min":0.82099999999999995,"5min":0.95999999999999996,"15min":1.359},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65300000000000002,"15min":0.66400000000000003},"min":{"1min":0.434,"5min":0.42999999999999999,"15min":0.39600000000000002},"max":{"1min":0.86599999999999999,"5min":1.861,"15min":1.861},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Nov 30 17:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46300000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.82499999999999996,"5min":4.6849999999999996,"15min":4.6849999999999996},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69799999999999995,"15min":0.69399999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.877,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.747}]}]},{"osd":3,"up_from":13,"seq":55834575073,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311164,"kb_used_data":1780,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060676,"statfs":{"total":96636764160,"available":96318132224,"internally_reserved":0,"allocated":1822720,"data_stored":918440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:25:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.36099999999999999},"min":{"1min":0.224,"5min":0.222,"15min":0.219},"max":{"1min":0.45200000000000001,"5min":0.51100000000000001,"15min":0.66200000000000003},"last":0.20999999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.38200000000000001,"15min":0.40200000000000002},"min":{"1min":0.23499999999999999,"5min":0.22500000000000001,"15min":0.218},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.67600000000000005},"last":0.34799999999999998}]},{"osd":1,"last update":"Thu Nov 30 17:25:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.35699999999999998,"15min":0.38400000000000001},"min":{"1min":0.23799999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.47799999999999998,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.307},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39800000000000002,"15min":0.42599999999999999},"min":{"1min":0.29199999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.53500000000000003,"5min":0.59699999999999998,"15min":0.73399999999999999},"last":0.27300000000000002}]},{"osd":2,"last update":"Thu Nov 30 17:25:43 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41899999999999998,"15min":0.45000000000000001},"min":{"1min":0.27200000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.54500000000000004,"5min":0.66000000000000003,"15min":0.94899999999999995},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47199999999999998,"15min":0.50600000000000001},"min":{"1min":0.34399999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.61499999999999999,"5min":0.68600000000000005,"15min":1.054},"last":0.32000000000000001}]},{"osd":4,"last update":"Thu Nov 30 17:25:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58399999999999996,"15min":0.60499999999999998},"min":{"1min":0.378,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69799999999999995,"5min":0.89900000000000002,"15min":0.97599999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58299999999999996,"15min":0.60799999999999998},"min":{"1min":0.436,"5min":0.315,"15min":0.315},"max":{"1min":0.76400000000000001,"5min":0.82899999999999996,"15min":0.86799999999999999},"last":0.46999999999999997}]},{"osd":5,"last update":"Thu Nov 30 17:25:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57999999999999996,"15min":0.60499999999999998},"min":{"1min":0.46300000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78200000000000003,"5min":0.91400000000000003,"15min":0.98399999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60899999999999999,"15min":0.63600000000000001},"min":{"1min":0.39000000000000001,"5min":0.372,"15min":0.34699999999999998},"max":{"1min":0.81499999999999995,"5min":0.92800000000000005,"15min":1.1779999999999999},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Nov 30 17:25:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60699999999999998,"15min":0.63400000000000001},"min":{"1min":0.46899999999999997,"5min":0.39800000000000002,"15min":0.32300000000000001},"max":{"1min":0.76500000000000001,"5min":0.86599999999999999,"15min":1.1419999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61799999999999999,"15min":0.64500000000000002},"min":{"1min":0.45600000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.78200000000000003,"5min":0.94599999999999995,"15min":1.0389999999999999},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Nov 30 17:25:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.624,"15min":0.65400000000000003},"min":{"1min":0.496,"5min":0.40699999999999997,"15min":0.40500000000000003},"max":{"1min":0.78400000000000003,"5min":0.97599999999999998,"15min":1.0660000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.623,"15min":0.65600000000000003},"min":{"1min":0.434,"5min":0.38,"15min":0.38},"max":{"1min":0.81200000000000006,"5min":0.98999999999999999,"15min":0.99399999999999999},"last":0.55000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575073,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302968,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068872,"statfs":{"total":96636764160,"available":96326524928,"internally_reserved":0,"allocated":1818624,"data_stored":918406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51000000000000001,"15min":0.52600000000000002},"min":{"1min":0.317,"5min":0.30599999999999999,"15min":0.27500000000000002},"max":{"1min":0.72799999999999998,"5min":0.748,"15min":0.77700000000000002},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.501,"5min":0.51400000000000001,"15min":0.53700000000000003},"min":{"1min":0.33400000000000002,"5min":0.28399999999999997,"15min":0.26600000000000001},"max":{"1min":0.66500000000000004,"5min":0.81999999999999995,"15min":1.1879999999999999},"last":0.76200000000000001}]},{"osd":1,"last update":"Thu Nov 30 17:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51900000000000002,"15min":0.53700000000000003},"min":{"1min":0.373,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.77100000000000002},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.53000000000000003,"15min":0.54200000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.30399999999999999},"max":{"1min":0.64600000000000002,"5min":0.77800000000000002,"15min":1.2170000000000001},"last":0.70899999999999996}]},{"osd":2,"last update":"Thu Nov 30 17:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.54900000000000004,"15min":0.56999999999999995},"min":{"1min":0.38500000000000001,"5min":0.36899999999999999,"15min":0.34499999999999997},"max":{"1min":0.68200000000000005,"5min":0.75700000000000001,"15min":0.84099999999999997},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56799999999999995,"15min":0.58799999999999997},"min":{"1min":0.41499999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77300000000000002,"5min":0.78600000000000003,"15min":0.81399999999999995},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Nov 30 17:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.52600000000000002,"15min":0.54300000000000004},"min":{"1min":0.35499999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71299999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54500000000000004,"15min":0.56200000000000006},"min":{"1min":0.38900000000000001,"5min":0.36399999999999999,"15min":0.33100000000000002},"max":{"1min":0.70499999999999996,"5min":0.76500000000000001,"15min":0.79200000000000004},"last":0.748}]},{"osd":5,"last update":"Thu Nov 30 17:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.42799999999999999,"15min":0.433},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.59499999999999997,"5min":0.73599999999999999,"15min":1.272},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.44,"15min":0.44800000000000001},"min":{"1min":0.29699999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.68200000000000005,"5min":0.83399999999999996,"15min":1.1559999999999999},"last":0.42599999999999999}]},{"osd":6,"last update":"Thu Nov 30 17:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48899999999999999,"15min":0.49099999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.314},"max":{"1min":0.65000000000000002,"5min":0.997,"15min":1.2949999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.52800000000000002,"15min":0.53200000000000003},"min":{"1min":0.34899999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.67100000000000004,"5min":0.86499999999999999,"15min":1.129},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Nov 30 17:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.497,"15min":0.502},"min":{"1min":0.29699999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72799999999999998,"5min":0.81999999999999995,"15min":0.82199999999999995},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.55500000000000005,"15min":0.56200000000000006},"min":{"1min":0.42299999999999999,"5min":0.34999999999999998,"15min":0.34599999999999997},"max":{"1min":0.69599999999999995,"5min":0.91500000000000004,"15min":1.2470000000000001},"last":0.55000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575073,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302952,"kb_used_data":1760,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068888,"statfs":{"total":96636764160,"available":96326541312,"internally_reserved":0,"allocated":1802240,"data_stored":911092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 17:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52700000000000002,"15min":0.53600000000000003},"min":{"1min":0.379,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71399999999999997,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.35999999999999999,"5min":0.316,"15min":0.31},"max":{"1min":0.78000000000000003,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Nov 30 17:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52100000000000002,"15min":0.53200000000000003},"min":{"1min":0.40200000000000002,"5min":0.33500000000000002,"15min":0.32300000000000001},"max":{"1min":0.72299999999999998,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.44},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52200000000000002,"15min":0.54400000000000004},"min":{"1min":0.38700000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.65100000000000002,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.53100000000000003}]},{"osd":2,"last update":"Thu Nov 30 17:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56699999999999995,"15min":0.58499999999999996},"min":{"1min":0.44500000000000001,"5min":0.36399999999999999,"15min":0.30599999999999999},"max":{"1min":0.81799999999999995,"5min":1.028,"15min":1.028},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57399999999999995,"15min":0.59399999999999997},"min":{"1min":0.437,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77200000000000002,"5min":1.046,"15min":1.046},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Nov 30 17:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.54500000000000004},"min":{"1min":0.35499999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.747,"5min":1.002,"15min":1.002},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.39300000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.70399999999999996,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Nov 30 17:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.44,"15min":0.434},"min":{"1min":0.312,"5min":0.27600000000000002,"15min":0.25900000000000001},"max":{"1min":0.69499999999999995,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.46700000000000003,"15min":0.46300000000000002},"min":{"1min":0.30299999999999999,"5min":0.29299999999999998,"15min":0.27600000000000002},"max":{"1min":0.69299999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.45900000000000002}]},{"osd":6,"last update":"Thu Nov 30 17:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48899999999999999,"15min":0.48299999999999998},"min":{"1min":0.32900000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73099999999999998,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55000000000000004,"15min":0.54500000000000004},"min":{"1min":0.439,"5min":0.34499999999999997,"15min":0.33500000000000002},"max":{"1min":0.72299999999999998,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.625}]},{"osd":7,"last update":"Thu Nov 30 17:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.35999999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68200000000000005,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57399999999999995,"15min":0.57099999999999995},"min":{"1min":0.40300000000000002,"5min":0.35799999999999998,"15min":0.34899999999999998},"max":{"1min":0.755,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.64100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T17:26:24.762 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-30T17:26:24.762 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-30T17:26:24.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.918+0000 7f25ce4b8700 1 Processor -- start 2023-11-30T17:26:24.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.918+0000 7f25ce4b8700 1 -- start start 2023-11-30T17:26:24.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.919+0000 7f25ce4b8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25c8098d10 0x7f25c80c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:24.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.919+0000 7f25ce4b8700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f25c8158320 0x7f25c81587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:24.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.919+0000 7f25ce4b8700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c8158cc0 con 0x7f25c80c6190 2023-11-30T17:26:24.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.919+0000 7f25ce4b8700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c80c72d0 con 0x7f25c8158320 2023-11-30T17:26:24.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.919+0000 7f25ce4b8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c8064570 con 0x7f25c8098d10 2023-11-30T17:26:24.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.919+0000 7f25cca55700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f25c8158320 0x7f25c81587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:24.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.919+0000 7f25c7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25c8098d10 0x7f25c80c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:24.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.919+0000 7f25c77fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f25c80c6190 0x7f25c8063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:43992/0 (socket says 172.21.15.49:43992) 2023-11-30T17:26:24.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.919+0000 7f25c77fe700 1 -- 172.21.15.49:0/26572201 learned_addr learned my addr 172.21.15.49:0/26572201 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:24.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.919+0000 7f25c6ffd700 1 -- 172.21.15.49:0/26572201 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 225090524 0 0) 0x7f25b0001110 con 0x7f25c80c6190 2023-11-30T17:26:24.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.920+0000 7f25c6ffd700 1 -- 172.21.15.49:0/26572201 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25b40033f0 con 0x7f25c80c6190 2023-11-30T17:26:24.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.920+0000 7f25c7fff700 1 -- 172.21.15.49:0/26572201 >> v2:172.21.15.115:3300/0 conn(0x7f25c8158320 msgr2=0x7f25c81587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:24.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.920+0000 7f25c7fff700 1 --2- 172.21.15.49:0/26572201 >> v2:172.21.15.115:3300/0 conn(0x7f25c8158320 0x7f25c81587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:24.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.920+0000 7f25c7fff700 1 -- 172.21.15.49:0/26572201 >> v1:172.21.15.115:6789/0 conn(0x7f25c80c6190 legacy=0x7f25c8063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:24.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.920+0000 7f25c7fff700 1 -- 172.21.15.49:0/26572201 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c8154bc0 con 0x7f25c8098d10 2023-11-30T17:26:24.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.920+0000 7f25c7fff700 1 --2- 172.21.15.49:0/26572201 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25c8098d10 0x7f25c80c7760 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f25b8009760 tx=0x7f25b8009060).ready entity=mon.2 client_cookie=7354d03dbd15aa78 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:24.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.920+0000 7f25c6ffd700 1 -- 172.21.15.49:0/26572201 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b800d4a0 con 0x7f25c8098d10 2023-11-30T17:26:24.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.920+0000 7f25c6ffd700 1 -- 172.21.15.49:0/26572201 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b800d600 con 0x7f25c8098d10 2023-11-30T17:26:24.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.920+0000 7f25c6ffd700 1 -- 172.21.15.49:0/26572201 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b800d980 con 0x7f25c8098d10 2023-11-30T17:26:24.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.920+0000 7f25ce4b8700 1 -- 172.21.15.49:0/26572201 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25c8098d10 msgr2=0x7f25c80c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:24.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.920+0000 7f25ce4b8700 1 --2- 172.21.15.49:0/26572201 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25c8098d10 0x7f25c80c7760 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f25b8009760 tx=0x7f25b8009060).stop 2023-11-30T17:26:24.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.920+0000 7f25ce4b8700 1 -- 172.21.15.49:0/26572201 shutdown_connections 2023-11-30T17:26:24.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.920+0000 7f25ce4b8700 1 --2- 172.21.15.49:0/26572201 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25c8098d10 0x7f25c80c7760 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:24.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.920+0000 7f25ce4b8700 1 --2- 172.21.15.49:0/26572201 >> v2:172.21.15.115:3300/0 conn(0x7f25c8158320 0x7f25c81587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:24.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.920+0000 7f25ce4b8700 1 -- 172.21.15.49:0/26572201 >> 172.21.15.49:0/26572201 conn(0x7f25c80cb310 msgr2=0x7f25c80cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:24.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.920+0000 7f25ce4b8700 1 -- 172.21.15.49:0/26572201 shutdown_connections 2023-11-30T17:26:24.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.920+0000 7f25ce4b8700 1 -- 172.21.15.49:0/26572201 wait complete. 2023-11-30T17:26:24.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.921+0000 7f25ce4b8700 1 Processor -- start 2023-11-30T17:26:24.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.922+0000 7f25ce4b8700 1 -- start start 2023-11-30T17:26:24.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.922+0000 7f25ce4b8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25c8098d10 0x7f25c80afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:24.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.922+0000 7f25ce4b8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25c80c6190 0x7f25c814beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:24.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.922+0000 7f25ce4b8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25c8158320 0x7f25c8150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:24.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.922+0000 7f25ce4b8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c80b0530 con 0x7f25c80c6190 2023-11-30T17:26:24.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.922+0000 7f25ce4b8700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c8155820 con 0x7f25c8158320 2023-11-30T17:26:24.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.922+0000 7f25ce4b8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c8154e80 con 0x7f25c8098d10 2023-11-30T17:26:24.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.922+0000 7f25c77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25c80c6190 0x7f25c814beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:24.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.923+0000 7f25c77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25c80c6190 0x7f25c814beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36684/0 (socket says 172.21.15.49:36684) 2023-11-30T17:26:24.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.923+0000 7f25c77fe700 1 -- 172.21.15.49:0/1498059440 learned_addr learned my addr 172.21.15.49:0/1498059440 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:24.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.923+0000 7f25c7fff700 1 --2- 172.21.15.49:0/1498059440 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25c8098d10 0x7f25c80afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:24.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.923+0000 7f25cca55700 1 --2- 172.21.15.49:0/1498059440 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25c8158320 0x7f25c8150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:24.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.923+0000 7f25c77fe700 1 -- 172.21.15.49:0/1498059440 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25c8098d10 msgr2=0x7f25c80afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:24.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.923+0000 7f25c77fe700 1 --2- 172.21.15.49:0/1498059440 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25c8098d10 0x7f25c80afc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:24.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.923+0000 7f25c77fe700 1 -- 172.21.15.49:0/1498059440 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25c8158320 msgr2=0x7f25c8150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:24.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.923+0000 7f25c77fe700 1 --2- 172.21.15.49:0/1498059440 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25c8158320 0x7f25c8150f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:24.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.923+0000 7f25c77fe700 1 -- 172.21.15.49:0/1498059440 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b80092a0 con 0x7f25c80c6190 2023-11-30T17:26:24.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.923+0000 7f25c7fff700 1 --2- 172.21.15.49:0/1498059440 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25c8098d10 0x7f25c80afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:26:24.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.923+0000 7f25cca55700 1 --2- 172.21.15.49:0/1498059440 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25c8158320 0x7f25c8150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:26:24.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.923+0000 7f25c77fe700 1 --2- 172.21.15.49:0/1498059440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25c80c6190 0x7f25c814beb0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7f25b000c470 tx=0x7f25b0007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:24.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.923+0000 7f25bffff700 1 -- 172.21.15.49:0/1498059440 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b00072e0 con 0x7f25c80c6190 2023-11-30T17:26:24.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.923+0000 7f25bffff700 1 -- 172.21.15.49:0/1498059440 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b0007440 con 0x7f25c80c6190 2023-11-30T17:26:24.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.923+0000 7f25ce4b8700 1 -- 172.21.15.49:0/1498059440 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c8155160 con 0x7f25c80c6190 2023-11-30T17:26:24.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.923+0000 7f25bffff700 1 -- 172.21.15.49:0/1498059440 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b00057a0 con 0x7f25c80c6190 2023-11-30T17:26:24.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.923+0000 7f25ce4b8700 1 -- 172.21.15.49:0/1498059440 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c80b0120 con 0x7f25c80c6190 2023-11-30T17:26:24.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.924+0000 7f25ce4b8700 1 -- 172.21.15.49:0/1498059440 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c8155960 con 0x7f25c80c6190 2023-11-30T17:26:24.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.925+0000 7f25bffff700 1 -- 172.21.15.49:0/1498059440 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f25b0005b90 con 0x7f25c80c6190 2023-11-30T17:26:24.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.925+0000 7f25bffff700 1 --2- 172.21.15.49:0/1498059440 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f25a805f240 0x7f25a8061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:24.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.925+0000 7f25bffff700 1 -- 172.21.15.49:0/1498059440 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f25b0079b20 con 0x7f25c80c6190 2023-11-30T17:26:24.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.925+0000 7f25c7fff700 1 --2- 172.21.15.49:0/1498059440 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f25a805f240 0x7f25a8061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:24.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.926+0000 7f25c7fff700 1 --2- 172.21.15.49:0/1498059440 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f25a805f240 0x7f25a8061700 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f25b800d260 tx=0x7f25b8016000).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:24.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:24.929+0000 7f25bffff700 1 -- 172.21.15.49:0/1498059440 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f25c8155960 con 0x7f25c80c6190 2023-11-30T17:26:25.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.167+0000 7f25ce4b8700 1 -- 172.21.15.49:0/1498059440 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f25c8158cc0 con 0x7f25c80c6190 2023-11-30T17:26:25.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.171+0000 7f25bffff700 1 -- 172.21.15.49:0/1498059440 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+0 (secure 0 0 0) 0x7f25c8158cc0 con 0x7f25c80c6190 2023-11-30T17:26:25.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.173+0000 7f25ce4b8700 1 -- 172.21.15.49:0/1498059440 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f25a805f240 msgr2=0x7f25a8061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:25.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.173+0000 7f25ce4b8700 1 --2- 172.21.15.49:0/1498059440 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f25a805f240 0x7f25a8061700 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f25b800d260 tx=0x7f25b8016000).stop 2023-11-30T17:26:25.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.173+0000 7f25ce4b8700 1 -- 172.21.15.49:0/1498059440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25c80c6190 msgr2=0x7f25c814beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:25.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.173+0000 7f25ce4b8700 1 --2- 172.21.15.49:0/1498059440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25c80c6190 0x7f25c814beb0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7f25b000c470 tx=0x7f25b0007ad0).stop 2023-11-30T17:26:25.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.173+0000 7f25ce4b8700 1 -- 172.21.15.49:0/1498059440 shutdown_connections 2023-11-30T17:26:25.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.173+0000 7f25ce4b8700 1 --2- 172.21.15.49:0/1498059440 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25c8158320 0x7f25c8150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:25.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.173+0000 7f25ce4b8700 1 --2- 172.21.15.49:0/1498059440 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25c8098d10 0x7f25c80afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:25.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.173+0000 7f25ce4b8700 1 --2- 172.21.15.49:0/1498059440 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f25a805f240 0x7f25a8061700 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:25.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.173+0000 7f25ce4b8700 1 --2- 172.21.15.49:0/1498059440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25c80c6190 0x7f25c814beb0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:25.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.173+0000 7f25ce4b8700 1 -- 172.21.15.49:0/1498059440 >> 172.21.15.49:0/1498059440 conn(0x7f25c80cb310 msgr2=0x7f25c8153dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:25.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.173+0000 7f25ce4b8700 1 -- 172.21.15.49:0/1498059440 shutdown_connections 2023-11-30T17:26:25.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.173+0000 7f25ce4b8700 1 -- 172.21.15.49:0/1498059440 wait complete. 2023-11-30T17:26:25.177 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2023-11-30T17:26:25.188 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T17:26:25.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.304+0000 7fa2f406f700 1 Processor -- start 2023-11-30T17:26:25.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.304+0000 7fa2f406f700 1 -- start start 2023-11-30T17:26:25.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.305+0000 7fa2f406f700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa2ec1544d0 0x7fa2ec155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:25.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.305+0000 7fa2f406f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2ec0673c0 0x7fa2ec15e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:25.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.305+0000 7fa2f406f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2ec0683d0 con 0x7fa2ec066f40 2023-11-30T17:26:25.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.305+0000 7fa2f406f700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2ec067850 con 0x7fa2ec1544d0 2023-11-30T17:26:25.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.305+0000 7fa2f406f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec067b30 con 0x7fa2ec0673c0 2023-11-30T17:26:25.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.305+0000 7fa2f160a700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa2ec066f40 0x7fa2ec095e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51234/0 (socket says 172.21.15.49:51234) 2023-11-30T17:26:25.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.305+0000 7fa2f160a700 1 -- 172.21.15.49:0/3251927869 learned_addr learned my addr 172.21.15.49:0/3251927869 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:25.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.305+0000 7fa2f1e0b700 1 --2- 172.21.15.49:0/3251927869 >> v2:172.21.15.115:3300/0 conn(0x7fa2ec1544d0 0x7fa2ec155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:25.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.305+0000 7fa2f0e09700 1 -- 172.21.15.49:0/3251927869 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 35341224 0 0) 0x7fa2ec0683d0 con 0x7fa2ec066f40 2023-11-30T17:26:25.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.305+0000 7fa2f260c700 1 --2- 172.21.15.49:0/3251927869 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2ec0673c0 0x7fa2ec15e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:25.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.305+0000 7fa2f0e09700 1 -- 172.21.15.49:0/3251927869 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2d40033f0 con 0x7fa2ec066f40 2023-11-30T17:26:25.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.306+0000 7fa2f0e09700 1 -- 172.21.15.49:0/3251927869 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2436732175 0 0) 0x7fa2d40033f0 con 0x7fa2ec066f40 2023-11-30T17:26:25.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.306+0000 7fa2f0e09700 1 -- 172.21.15.49:0/3251927869 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2ec0673c0 msgr2=0x7fa2ec15e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:25.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.306+0000 7fa2f0e09700 1 --2- 172.21.15.49:0/3251927869 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2ec0673c0 0x7fa2ec15e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:25.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.306+0000 7fa2f0e09700 1 -- 172.21.15.49:0/3251927869 >> v2:172.21.15.115:3300/0 conn(0x7fa2ec1544d0 msgr2=0x7fa2ec155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:25.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.306+0000 7fa2f0e09700 1 --2- 172.21.15.49:0/3251927869 >> v2:172.21.15.115:3300/0 conn(0x7fa2ec1544d0 0x7fa2ec155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:25.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.306+0000 7fa2f0e09700 1 -- 172.21.15.49:0/3251927869 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ec067e10 con 0x7fa2ec066f40 2023-11-30T17:26:25.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.306+0000 7fa2f0e09700 1 -- 172.21.15.49:0/3251927869 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fa2e0001470 con 0x7fa2ec066f40 2023-11-30T17:26:25.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.306+0000 7fa2f0e09700 1 -- 172.21.15.49:0/3251927869 >> v1:172.21.15.49:6789/0 conn(0x7fa2ec066f40 legacy=0x7fa2ec095e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:25.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.306+0000 7fa2f0e09700 1 --2- 172.21.15.49:0/3251927869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2d40038e0 0x7fa2d4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:25.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.306+0000 7fa2f0e09700 1 --2- 172.21.15.49:0/3251927869 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2d4004690 0x7fa2d4004ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:25.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.306+0000 7fa2f0e09700 1 --2- 172.21.15.49:0/3251927869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2d4004fc0 0x7fa2d400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:25.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.306+0000 7fa2f0e09700 1 -- 172.21.15.49:0/3251927869 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec067850 con 0x7fa2d4004fc0 2023-11-30T17:26:25.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.306+0000 7fa2f0e09700 1 -- 172.21.15.49:0/3251927869 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec067b30 con 0x7fa2d40038e0 2023-11-30T17:26:25.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.306+0000 7fa2f0e09700 1 -- 172.21.15.49:0/3251927869 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d4004430 con 0x7fa2d4004690 2023-11-30T17:26:25.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.306+0000 7fa2f260c700 1 --2- 172.21.15.49:0/3251927869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2d4004fc0 0x7fa2d400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:25.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.306+0000 7fa2f1e0b700 1 --2- 172.21.15.49:0/3251927869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2d40038e0 0x7fa2d4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:25.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.306+0000 7fa2f160a700 1 --2- 172.21.15.49:0/3251927869 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2d4004690 0x7fa2d4004ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:25.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.306+0000 7fa2f260c700 1 -- 172.21.15.49:0/3251927869 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2d4004690 msgr2=0x7fa2d4004ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:25.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.306+0000 7fa2f260c700 1 --2- 172.21.15.49:0/3251927869 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2d4004690 0x7fa2d4004ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:25.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.306+0000 7fa2f260c700 1 -- 172.21.15.49:0/3251927869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2d40038e0 msgr2=0x7fa2d4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:25.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.306+0000 7fa2f260c700 1 --2- 172.21.15.49:0/3251927869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2d40038e0 0x7fa2d4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:25.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.306+0000 7fa2f260c700 1 -- 172.21.15.49:0/3251927869 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d40033f0 con 0x7fa2d4004fc0 2023-11-30T17:26:25.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.306+0000 7fa2f260c700 1 --2- 172.21.15.49:0/3251927869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2d4004fc0 0x7fa2d400b8e0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7fa2ec0c6f10 tx=0x7fa2dc00b040).ready entity=mon.0 client_cookie=980803980c2a396d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:25.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.306+0000 7fa2f0e09700 1 -- 172.21.15.49:0/3251927869 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc009ac0 con 0x7fa2d4004fc0 2023-11-30T17:26:25.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.307+0000 7fa2f0e09700 1 -- 172.21.15.49:0/3251927869 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2dc00f040 con 0x7fa2d4004fc0 2023-11-30T17:26:25.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.307+0000 7fa2f0e09700 1 -- 172.21.15.49:0/3251927869 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc00ec10 con 0x7fa2d4004fc0 2023-11-30T17:26:25.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.307+0000 7fa2f406f700 1 -- 172.21.15.49:0/3251927869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2d4004fc0 msgr2=0x7fa2d400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:25.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.307+0000 7fa2f406f700 1 --2- 172.21.15.49:0/3251927869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2d4004fc0 0x7fa2d400b8e0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7fa2ec0c6f10 tx=0x7fa2dc00b040).stop 2023-11-30T17:26:25.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.307+0000 7fa2f260c700 1 -- 172.21.15.49:0/3251927869 reap_dead start 2023-11-30T17:26:25.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.307+0000 7fa2f406f700 1 -- 172.21.15.49:0/3251927869 shutdown_connections 2023-11-30T17:26:25.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.307+0000 7fa2f406f700 1 -- 172.21.15.49:0/3251927869 >> 172.21.15.49:0/3251927869 conn(0x7fa2ec0631d0 msgr2=0x7fa2ec0c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:25.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.307+0000 7fa2f406f700 1 -- 172.21.15.49:0/3251927869 shutdown_connections 2023-11-30T17:26:25.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.307+0000 7fa2f406f700 1 -- 172.21.15.49:0/3251927869 wait complete. 2023-11-30T17:26:25.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.308+0000 7fa2f406f700 1 Processor -- start 2023-11-30T17:26:25.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.308+0000 7fa2f406f700 1 -- start start 2023-11-30T17:26:25.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.309+0000 7fa2f406f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2d4004fc0 0x7fa2ec1636d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:25.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.309+0000 7fa2f406f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2ec152a40 0x7fa2ec152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:25.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.309+0000 7fa2f406f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2ec0aab20 0x7fa2ec0aaf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:25.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.309+0000 7fa2f406f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec13f680 con 0x7fa2d4004fc0 2023-11-30T17:26:25.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.309+0000 7fa2f406f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec13ff20 con 0x7fa2ec152a40 2023-11-30T17:26:25.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.309+0000 7fa2f406f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec1533b0 con 0x7fa2ec0aab20 2023-11-30T17:26:25.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.309+0000 7fa2f1e0b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2d4004fc0 0x7fa2ec1636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:25.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.309+0000 7fa2f1e0b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2d4004fc0 0x7fa2ec1636d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36700/0 (socket says 172.21.15.49:36700) 2023-11-30T17:26:25.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.309+0000 7fa2f1e0b700 1 -- 172.21.15.49:0/1978939575 learned_addr learned my addr 172.21.15.49:0/1978939575 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:25.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.309+0000 7fa2f260c700 1 --2- 172.21.15.49:0/1978939575 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2ec0aab20 0x7fa2ec0aaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:25.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.309+0000 7fa2f160a700 1 --2- 172.21.15.49:0/1978939575 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2ec152a40 0x7fa2ec152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:25.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.309+0000 7fa2f1e0b700 1 -- 172.21.15.49:0/1978939575 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2ec0aab20 msgr2=0x7fa2ec0aaf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:25.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.309+0000 7fa2f1e0b700 1 --2- 172.21.15.49:0/1978939575 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2ec0aab20 0x7fa2ec0aaf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:25.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.309+0000 7fa2f1e0b700 1 -- 172.21.15.49:0/1978939575 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2ec152a40 msgr2=0x7fa2ec152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:25.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.309+0000 7fa2f1e0b700 1 --2- 172.21.15.49:0/1978939575 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2ec152a40 0x7fa2ec152ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:25.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.309+0000 7fa2f1e0b700 1 -- 172.21.15.49:0/1978939575 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ec163bc0 con 0x7fa2d4004fc0 2023-11-30T17:26:25.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.310+0000 7fa2f1e0b700 1 --2- 172.21.15.49:0/1978939575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2d4004fc0 0x7fa2ec1636d0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7fa2e40119c0 tx=0x7fa2e4006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:25.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.310+0000 7fa2e9ffb700 1 -- 172.21.15.49:0/1978939575 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e400f940 con 0x7fa2d4004fc0 2023-11-30T17:26:25.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.310+0000 7fa2e9ffb700 1 -- 172.21.15.49:0/1978939575 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e400faa0 con 0x7fa2d4004fc0 2023-11-30T17:26:25.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.310+0000 7fa2f406f700 1 -- 172.21.15.49:0/1978939575 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2ec0ab880 con 0x7fa2d4004fc0 2023-11-30T17:26:25.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.310+0000 7fa2e9ffb700 1 -- 172.21.15.49:0/1978939575 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e400fe20 con 0x7fa2d4004fc0 2023-11-30T17:26:25.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.310+0000 7fa2f406f700 1 -- 172.21.15.49:0/1978939575 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ec13f8d0 con 0x7fa2d4004fc0 2023-11-30T17:26:25.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.311+0000 7fa2f406f700 1 -- 172.21.15.49:0/1978939575 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2ec06c860 con 0x7fa2d4004fc0 2023-11-30T17:26:25.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.312+0000 7fa2e9ffb700 1 -- 172.21.15.49:0/1978939575 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa2e4014650 con 0x7fa2d4004fc0 2023-11-30T17:26:25.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.312+0000 7fa2e9ffb700 1 --2- 172.21.15.49:0/1978939575 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa2d805f270 0x7fa2d8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:25.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.313+0000 7fa2e9ffb700 1 -- 172.21.15.49:0/1978939575 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fa2e407b060 con 0x7fa2d4004fc0 2023-11-30T17:26:25.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.313+0000 7fa2f160a700 1 --2- 172.21.15.49:0/1978939575 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa2d805f270 0x7fa2d8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:25.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.313+0000 7fa2f160a700 1 --2- 172.21.15.49:0/1978939575 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa2d805f270 0x7fa2d8061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fa2e0000e10 tx=0x7fa2e0009040).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:25.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.316+0000 7fa2e9ffb700 1 -- 172.21.15.49:0/1978939575 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa2e404c230 con 0x7fa2d4004fc0 2023-11-30T17:26:25.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.530+0000 7fa2f406f700 1 -- 172.21.15.49:0/1978939575 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2ec0680f0 con 0x7fa2d4004fc0 2023-11-30T17:26:25.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.531+0000 7fa2e9ffb700 1 -- 172.21.15.49:0/1978939575 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fa2e4022070 con 0x7fa2d4004fc0 2023-11-30T17:26:25.533 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:26:25.533 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":61,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6851,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/4266183168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":4266183168},{"type":"v1","addr":"172.21.15.49:6835","nonce":4266183168}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":7810,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1044019551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1044019551},{"type":"v1","addr":"172.21.15.115:6836","nonce":1044019551}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":7813,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/676160579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":676160579},{"type":"v1","addr":"172.21.15.115:6837","nonce":676160579}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:26:20.358070+0000","modified":"2023-11-30T17:26:23.364931+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8085":{"gid":8085,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/2798044365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2798044365},{"type":"v1","addr":"172.21.15.49:6834","nonce":2798044365}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-11-30T17:26:25.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.532+0000 7fa2f406f700 1 -- 172.21.15.49:0/1978939575 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa2d805f270 msgr2=0x7fa2d8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:25.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.532+0000 7fa2f406f700 1 --2- 172.21.15.49:0/1978939575 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa2d805f270 0x7fa2d8061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fa2e0000e10 tx=0x7fa2e0009040).stop 2023-11-30T17:26:25.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.532+0000 7fa2f406f700 1 -- 172.21.15.49:0/1978939575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2d4004fc0 msgr2=0x7fa2ec1636d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:25.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.532+0000 7fa2f406f700 1 --2- 172.21.15.49:0/1978939575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2d4004fc0 0x7fa2ec1636d0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7fa2e40119c0 tx=0x7fa2e4006f40).stop 2023-11-30T17:26:25.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.532+0000 7fa2f406f700 1 -- 172.21.15.49:0/1978939575 shutdown_connections 2023-11-30T17:26:25.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.532+0000 7fa2f406f700 1 --2- 172.21.15.49:0/1978939575 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2ec0aab20 0x7fa2ec0aaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:25.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.532+0000 7fa2f406f700 1 --2- 172.21.15.49:0/1978939575 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa2d805f270 0x7fa2d8061730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:25.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.532+0000 7fa2f406f700 1 --2- 172.21.15.49:0/1978939575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2d4004fc0 0x7fa2ec1636d0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:25.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.532+0000 7fa2f406f700 1 --2- 172.21.15.49:0/1978939575 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2ec152a40 0x7fa2ec152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:25.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.532+0000 7fa2f406f700 1 -- 172.21.15.49:0/1978939575 >> 172.21.15.49:0/1978939575 conn(0x7fa2ec0631d0 msgr2=0x7fa2ec0be070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:25.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.533+0000 7fa2f406f700 1 -- 172.21.15.49:0/1978939575 shutdown_connections 2023-11-30T17:26:25.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:25.533+0000 7fa2f406f700 1 -- 172.21.15.49:0/1978939575 wait complete. 2023-11-30T17:26:25.536 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 61 2023-11-30T17:26:25.617 INFO:tasks.ceph.mds.a.smithi049.stderr:2023-11-30T17:26:25.616+0000 7f2859fc8700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-30T17:26:25.950 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 61, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-30T17:26:20.358070+0000', 'modified': '2023-11-30T17:26:23.364931+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8085}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8085': {'gid': 8085, 'name': 'a', 'rank': 0, 'incarnation': 57, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6834/2798044365', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6832', 'nonce': 2798044365}, {'type': 'v1', 'addr': '172.21.15.49:6834', 'nonce': 2798044365}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-11-30T17:26:25.950 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-30T17:26:25.951 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-30T17:26:26.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.070+0000 7fd86a96f700 1 Processor -- start 2023-11-30T17:26:26.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.070+0000 7fd86a96f700 1 -- start start 2023-11-30T17:26:26.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.071+0000 7fd86a96f700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd86414e530 0x7fd8640c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:26.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.071+0000 7fd86a96f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd864154950 0x7fd86414e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:26.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.071+0000 7fd86a96f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8640c7bc0 con 0x7fd864158570 2023-11-30T17:26:26.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.071+0000 7fd86a96f700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd864155920 con 0x7fd86414e530 2023-11-30T17:26:26.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.071+0000 7fd86a96f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd864154dd0 con 0x7fd864154950 2023-11-30T17:26:26.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.071+0000 7fd86a16e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd864158570 0x7fd8640aa030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51250/0 (socket says 172.21.15.49:51250) 2023-11-30T17:26:26.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.071+0000 7fd86a16e700 1 -- 172.21.15.49:0/1768462743 learned_addr learned my addr 172.21.15.49:0/1768462743 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:26.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.071+0000 7fd86916c700 1 --2- 172.21.15.49:0/1768462743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd864154950 0x7fd86414e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:26.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.071+0000 7fd86996d700 1 --2- 172.21.15.49:0/1768462743 >> v2:172.21.15.115:3300/0 conn(0x7fd86414e530 0x7fd8640c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:26.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.071+0000 7fd86896b700 1 -- 172.21.15.49:0/1768462743 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287239422 0 0) 0x7fd8640c7bc0 con 0x7fd864158570 2023-11-30T17:26:26.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.071+0000 7fd86896b700 1 -- 172.21.15.49:0/1768462743 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd84c0033f0 con 0x7fd864158570 2023-11-30T17:26:26.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.072+0000 7fd86896b700 1 -- 172.21.15.49:0/1768462743 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2373807654 0 0) 0x7fd84c0033f0 con 0x7fd864158570 2023-11-30T17:26:26.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.072+0000 7fd86896b700 1 -- 172.21.15.49:0/1768462743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd864154950 msgr2=0x7fd86414e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:26.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.072+0000 7fd86896b700 1 --2- 172.21.15.49:0/1768462743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd864154950 0x7fd86414e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.072+0000 7fd86896b700 1 -- 172.21.15.49:0/1768462743 >> v2:172.21.15.115:3300/0 conn(0x7fd86414e530 msgr2=0x7fd8640c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:26.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.072+0000 7fd86896b700 1 --2- 172.21.15.49:0/1768462743 >> v2:172.21.15.115:3300/0 conn(0x7fd86414e530 0x7fd8640c66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.072+0000 7fd86896b700 1 -- 172.21.15.49:0/1768462743 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd864155080 con 0x7fd864158570 2023-11-30T17:26:26.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.072+0000 7fd86896b700 1 -- 172.21.15.49:0/1768462743 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fd8540017f0 con 0x7fd864158570 2023-11-30T17:26:26.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.072+0000 7fd86896b700 1 -- 172.21.15.49:0/1768462743 >> v1:172.21.15.49:6789/0 conn(0x7fd864158570 legacy=0x7fd8640aa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:26.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.072+0000 7fd86896b700 1 --2- 172.21.15.49:0/1768462743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd84c0038e0 0x7fd84c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:26.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.072+0000 7fd86896b700 1 --2- 172.21.15.49:0/1768462743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd84c004690 0x7fd84c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:26.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.072+0000 7fd86896b700 1 --2- 172.21.15.49:0/1768462743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd864154950 0x7fd84c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:26.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.072+0000 7fd86896b700 1 -- 172.21.15.49:0/1768462743 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd864155920 con 0x7fd84c0038e0 2023-11-30T17:26:26.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.072+0000 7fd86896b700 1 -- 172.21.15.49:0/1768462743 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd864154dd0 con 0x7fd84c004690 2023-11-30T17:26:26.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.072+0000 7fd86896b700 1 -- 172.21.15.49:0/1768462743 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c00b8e0 con 0x7fd864154950 2023-11-30T17:26:26.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.072+0000 7fd86996d700 1 --2- 172.21.15.49:0/1768462743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd84c0038e0 0x7fd84c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:26.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.072+0000 7fd86916c700 1 --2- 172.21.15.49:0/1768462743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd84c004690 0x7fd84c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:26.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.072+0000 7fd86a16e700 1 --2- 172.21.15.49:0/1768462743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd864154950 0x7fd84c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:26.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.072+0000 7fd86996d700 1 -- 172.21.15.49:0/1768462743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd864154950 msgr2=0x7fd84c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:26.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.072+0000 7fd86996d700 1 --2- 172.21.15.49:0/1768462743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd864154950 0x7fd84c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.072+0000 7fd86996d700 1 -- 172.21.15.49:0/1768462743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd84c004690 msgr2=0x7fd84c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:26.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.072+0000 7fd86996d700 1 --2- 172.21.15.49:0/1768462743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd84c004690 0x7fd84c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.072+0000 7fd86996d700 1 -- 172.21.15.49:0/1768462743 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84c0033f0 con 0x7fd84c0038e0 2023-11-30T17:26:26.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.072+0000 7fd86a16e700 1 --2- 172.21.15.49:0/1768462743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd864154950 0x7fd84c005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:26:26.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.072+0000 7fd86996d700 1 --2- 172.21.15.49:0/1768462743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd84c0038e0 0x7fd84c003d00 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7fd85c009ab0 tx=0x7fd85c009060).ready entity=mon.0 client_cookie=c424e7841526d1d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:26.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.073+0000 7fd86896b700 1 -- 172.21.15.49:0/1768462743 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c009430 con 0x7fd84c0038e0 2023-11-30T17:26:26.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.073+0000 7fd86896b700 1 -- 172.21.15.49:0/1768462743 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85c00e640 con 0x7fd84c0038e0 2023-11-30T17:26:26.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.073+0000 7fd86896b700 1 -- 172.21.15.49:0/1768462743 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c00e9c0 con 0x7fd84c0038e0 2023-11-30T17:26:26.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.073+0000 7fd86a96f700 1 -- 172.21.15.49:0/1768462743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd84c0038e0 msgr2=0x7fd84c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:26.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.073+0000 7fd86a96f700 1 --2- 172.21.15.49:0/1768462743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd84c0038e0 0x7fd84c003d00 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7fd85c009ab0 tx=0x7fd85c009060).stop 2023-11-30T17:26:26.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.073+0000 7fd86a16e700 1 -- 172.21.15.49:0/1768462743 reap_dead start 2023-11-30T17:26:26.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.073+0000 7fd86a96f700 1 -- 172.21.15.49:0/1768462743 shutdown_connections 2023-11-30T17:26:26.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.073+0000 7fd86a96f700 1 -- 172.21.15.49:0/1768462743 >> 172.21.15.49:0/1768462743 conn(0x7fd864064990 msgr2=0x7fd864064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:26.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.073+0000 7fd86a96f700 1 -- 172.21.15.49:0/1768462743 shutdown_connections 2023-11-30T17:26:26.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.073+0000 7fd86a96f700 1 -- 172.21.15.49:0/1768462743 wait complete. 2023-11-30T17:26:26.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.074+0000 7fd86a96f700 1 Processor -- start 2023-11-30T17:26:26.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.074+0000 7fd86a96f700 1 -- start start 2023-11-30T17:26:26.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.075+0000 7fd86a96f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd84c0038e0 0x7fd864142cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:26.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.075+0000 7fd86a96f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd864140430 0x7fd8640c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:26.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.075+0000 7fd86a96f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8640c51d0 0x7fd8640afb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:26.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.075+0000 7fd86a96f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8640c5630 con 0x7fd864140430 2023-11-30T17:26:26.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.075+0000 7fd86a96f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8640c2b60 con 0x7fd84c0038e0 2023-11-30T17:26:26.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.075+0000 7fd86a96f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8640c2e00 con 0x7fd8640c51d0 2023-11-30T17:26:26.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.075+0000 7fd86916c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd864140430 0x7fd8640c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:26.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.075+0000 7fd86916c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd864140430 0x7fd8640c4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36722/0 (socket says 172.21.15.49:36722) 2023-11-30T17:26:26.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.075+0000 7fd86916c700 1 -- 172.21.15.49:0/4110239345 learned_addr learned my addr 172.21.15.49:0/4110239345 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:26.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.075+0000 7fd86916c700 1 -- 172.21.15.49:0/4110239345 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8640c51d0 msgr2=0x7fd8640afb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:26.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.075+0000 7fd86916c700 1 --2- 172.21.15.49:0/4110239345 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8640c51d0 0x7fd8640afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:26.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.075+0000 7fd86996d700 1 --2- 172.21.15.49:0/4110239345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd84c0038e0 0x7fd864142cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:26.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.075+0000 7fd86916c700 1 -- 172.21.15.49:0/4110239345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd84c0038e0 msgr2=0x7fd864142cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:26.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.075+0000 7fd86916c700 1 --2- 172.21.15.49:0/4110239345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd84c0038e0 0x7fd864142cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.075+0000 7fd86916c700 1 -- 172.21.15.49:0/4110239345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8640c30e0 con 0x7fd864140430 2023-11-30T17:26:26.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.076+0000 7fd86916c700 1 --2- 172.21.15.49:0/4110239345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd864140430 0x7fd8640c4ce0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7fd8580119f0 tx=0x7fd858009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:26.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.076+0000 7fd861ffb700 1 -- 172.21.15.49:0/4110239345 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85800f940 con 0x7fd864140430 2023-11-30T17:26:26.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.076+0000 7fd861ffb700 1 -- 172.21.15.49:0/4110239345 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85800faa0 con 0x7fd864140430 2023-11-30T17:26:26.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.076+0000 7fd86a96f700 1 -- 172.21.15.49:0/4110239345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8640c33c0 con 0x7fd864140430 2023-11-30T17:26:26.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.076+0000 7fd861ffb700 1 -- 172.21.15.49:0/4110239345 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85800fe20 con 0x7fd864140430 2023-11-30T17:26:26.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.076+0000 7fd86a96f700 1 -- 172.21.15.49:0/4110239345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8641431c0 con 0x7fd864140430 2023-11-30T17:26:26.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.077+0000 7fd861ffb700 1 -- 172.21.15.49:0/4110239345 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fd858014650 con 0x7fd864140430 2023-11-30T17:26:26.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.078+0000 7fd861ffb700 1 --2- 172.21.15.49:0/4110239345 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd85005f270 0x7fd850061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:26.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.078+0000 7fd861ffb700 1 -- 172.21.15.49:0/4110239345 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fd85807b150 con 0x7fd864140430 2023-11-30T17:26:26.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.078+0000 7fd86996d700 1 --2- 172.21.15.49:0/4110239345 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd85005f270 0x7fd850061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:26.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.078+0000 7fd86996d700 1 --2- 172.21.15.49:0/4110239345 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd85005f270 0x7fd850061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fd85c009ab0 tx=0x7fd85c01a000).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:26.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.080+0000 7fd87d569b80 1 Processor -- start 2023-11-30T17:26:26.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.080+0000 7fd87d569b80 1 -- start start 2023-11-30T17:26:26.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.080+0000 7fd87d569b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b09855e40 0x559b09a99880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:26.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.080+0000 7fd87d569b80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559b09ae24e0 0x559b09a99d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:26.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.080+0000 7fd87d569b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b09ac1cf0 0x559b09a947e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:26.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.080+0000 7fd87d569b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b09a5f060 con 0x559b09855e40 2023-11-30T17:26:26.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.080+0000 7fd87d569b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b099d61f0 con 0x559b09ac1cf0 2023-11-30T17:26:26.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.080+0000 7fd87d569b80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x559b099eb440 con 0x559b09ae24e0 2023-11-30T17:26:26.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.081+0000 7fd86996d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b09855e40 0x559b09a99880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:26.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.081+0000 7fd86996d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b09855e40 0x559b09a99880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36734/0 (socket says 172.21.15.49:36734) 2023-11-30T17:26:26.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.081+0000 7fd86996d700 1 -- 172.21.15.49:0/3132601175 learned_addr learned my addr 172.21.15.49:0/3132601175 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:26.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.081+0000 7fd86a16e700 1 --2- 172.21.15.49:0/3132601175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b09ac1cf0 0x559b09a947e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:26.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.081+0000 7fd86916c700 1 --2- 172.21.15.49:0/3132601175 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559b09ae24e0 0x559b09a99d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:26.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.081+0000 7fd86996d700 1 -- 172.21.15.49:0/3132601175 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559b09ae24e0 msgr2=0x559b09a99d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:26.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.081+0000 7fd86996d700 1 --2- 172.21.15.49:0/3132601175 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559b09ae24e0 0x559b09a99d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.081+0000 7fd86996d700 1 -- 172.21.15.49:0/3132601175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b09ac1cf0 msgr2=0x559b09a947e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:26.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.081+0000 7fd86996d700 1 --2- 172.21.15.49:0/3132601175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b09ac1cf0 0x559b09a947e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.081+0000 7fd86996d700 1 -- 172.21.15.49:0/3132601175 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b099e4620 con 0x559b09855e40 2023-11-30T17:26:26.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.081+0000 7fd86a16e700 1 --2- 172.21.15.49:0/3132601175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b09ac1cf0 0x559b09a947e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:26:26.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.081+0000 7fd86996d700 1 --2- 172.21.15.49:0/3132601175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b09855e40 0x559b09a99880 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7fd85c009500 tx=0x7fd85c021000).ready entity=mon.0 client_cookie=ccd16d50df7d6eff server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:26.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.081+0000 7fd84affd700 1 -- 172.21.15.49:0/3132601175 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c021070 con 0x559b09855e40 2023-11-30T17:26:26.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.081+0000 7fd84affd700 1 -- 172.21.15.49:0/3132601175 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85c00e880 con 0x559b09855e40 2023-11-30T17:26:26.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.081+0000 7fd84affd700 1 -- 172.21.15.49:0/3132601175 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c025650 con 0x559b09855e40 2023-11-30T17:26:26.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.082+0000 7fd87d569b80 1 -- 172.21.15.49:0/3132601175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b09855e40 msgr2=0x559b09a99880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:26.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.082+0000 7fd87d569b80 1 --2- 172.21.15.49:0/3132601175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b09855e40 0x559b09a99880 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7fd85c009500 tx=0x7fd85c021000).stop 2023-11-30T17:26:26.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.082+0000 7fd87d569b80 1 -- 172.21.15.49:0/3132601175 shutdown_connections 2023-11-30T17:26:26.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.082+0000 7fd87d569b80 1 --2- 172.21.15.49:0/3132601175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b09ac1cf0 0x559b09a947e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.082+0000 7fd87d569b80 1 --2- 172.21.15.49:0/3132601175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b09855e40 0x559b09a99880 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.082+0000 7fd87d569b80 1 --2- 172.21.15.49:0/3132601175 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559b09ae24e0 0x559b09a99d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.082+0000 7fd87d569b80 1 -- 172.21.15.49:0/3132601175 >> 172.21.15.49:0/3132601175 conn(0x559b099034a0 msgr2=0x559b09ae2970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:26.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.082+0000 7fd87d569b80 1 -- 172.21.15.49:0/3132601175 shutdown_connections 2023-11-30T17:26:26.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.082+0000 7fd87d569b80 1 -- 172.21.15.49:0/3132601175 wait complete. 2023-11-30T17:26:26.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.082+0000 7fd87d569b80 1 -- start start 2023-11-30T17:26:26.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.082+0000 7fd87d569b80 1 Processor -- start 2023-11-30T17:26:26.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.083+0000 7fd87d569b80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559b09855e40 0x559b09af1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:26.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.083+0000 7fd87d569b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b09ac1cf0 0x559b09abdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:26.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.083+0000 7fd87d569b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b09ae24e0 0x559b09ac36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:26.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.083+0000 7fd87d569b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b099eb580 con 0x559b09ae24e0 2023-11-30T17:26:26.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.083+0000 7fd87d569b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b099eb800 con 0x559b09ac1cf0 2023-11-30T17:26:26.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.083+0000 7fd87d569b80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x559b099b6e10 con 0x559b09855e40 2023-11-30T17:26:26.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.083+0000 7fd87d569b80 10 client.0 ll_register_callbacks cb 0x559b09a59640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-30T17:26:26.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.084+0000 7fd86a16e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b09ae24e0 0x559b09ac36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:26.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.084+0000 7fd86996d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559b09855e40 0x559b09af1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:26.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.084+0000 7fd86a16e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b09ae24e0 0x559b09ac36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36750/0 (socket says 172.21.15.49:36750) 2023-11-30T17:26:26.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.084+0000 7fd86a16e700 1 -- 172.21.15.49:0/1740180810 learned_addr learned my addr 172.21.15.49:0/1740180810 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:26.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.084+0000 7fd86916c700 1 --2- 172.21.15.49:0/1740180810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b09ac1cf0 0x559b09abdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:26.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.084+0000 7fd86a16e700 1 -- 172.21.15.49:0/1740180810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559b09855e40 msgr2=0x559b09af1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:26.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.084+0000 7fd86a16e700 1 --2- 172.21.15.49:0/1740180810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559b09855e40 0x559b09af1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.084+0000 7fd86a16e700 1 -- 172.21.15.49:0/1740180810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b09ac1cf0 msgr2=0x559b09abdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:26.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.084+0000 7fd86a16e700 1 --2- 172.21.15.49:0/1740180810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b09ac1cf0 0x559b09abdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.084+0000 7fd86a16e700 1 -- 172.21.15.49:0/1740180810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd84c0033f0 con 0x559b09ae24e0 2023-11-30T17:26:26.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.084+0000 7fd86a16e700 1 --2- 172.21.15.49:0/1740180810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b09ae24e0 0x559b09ac36d0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7fd854000f80 tx=0x7fd854009040).ready entity=mon.0 client_cookie=df269e8fc450fb03 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:26.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.084+0000 7fd843fff700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-30T17:26:26.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.084+0000 7fd843fff700 1 -- 172.21.15.49:0/1740180810 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd854015410 con 0x559b09ae24e0 2023-11-30T17:26:26.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.084+0000 7fd843fff700 1 -- 172.21.15.49:0/1740180810 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(146..146 src has 1..146) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fd854015570 con 0x559b09ae24e0 2023-11-30T17:26:26.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.084+0000 7fd87d569b80 1 -- 172.21.15.49:0/1740180810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559b09a8d720 con 0x559b09ae24e0 2023-11-30T17:26:26.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.084+0000 7fd843fff700 1 -- 172.21.15.49:0/1740180810 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd854015940 con 0x559b09ae24e0 2023-11-30T17:26:26.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.084+0000 7fd87d569b80 10 client.8229 fetch_fsmap learned FSMap version 61 2023-11-30T17:26:26.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.084+0000 7fd87d569b80 1 -- 172.21.15.49:0/1740180810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) v3 -- 0x559b099df9c0 con 0x559b09ae24e0 2023-11-30T17:26:26.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.084+0000 7fd843fff700 1 -- 172.21.15.49:0/1740180810 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559b09a8d720 con 0x559b09ae24e0 2023-11-30T17:26:26.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.085+0000 7fd843fff700 1 -- 172.21.15.49:0/1740180810 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 61) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd854015aa0 con 0x559b09ae24e0 2023-11-30T17:26:26.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.085+0000 7fd87d569b80 10 client.8229 fetch_fsmap finished waiting for FSMap version 61 2023-11-30T17:26:26.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.085+0000 7fd87d569b80 10 client.8229 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-30T17:26:26.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.085+0000 7fd87d569b80 20 client.8229 populate_metadata read hostname 'smithi049' 2023-11-30T17:26:26.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.085+0000 7fd87d569b80 1 --2- 172.21.15.49:0/1740180810 >> [v2:172.21.15.49:6832/2798044365,v1:172.21.15.49:6834/2798044365] conn(0x559b09abf2d0 0x559b09abf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:26.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.085+0000 7fd87d569b80 4 client.8229 mds_command: new command op to 8085 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-30T17:26:26.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.085+0000 7fd87d569b80 1 -- 172.21.15.49:0/1740180810 --> [v2:172.21.15.49:6832/2798044365,v1:172.21.15.49:6834/2798044365] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559b09851ca0 con 0x559b09abf2d0 2023-11-30T17:26:26.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.085+0000 7fd86996d700 1 --2- 172.21.15.49:0/1740180810 >> [v2:172.21.15.49:6832/2798044365,v1:172.21.15.49:6834/2798044365] conn(0x559b09abf2d0 0x559b09abf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:26.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.085+0000 7fd86996d700 1 --2- 172.21.15.49:0/1740180810 >> [v2:172.21.15.49:6832/2798044365,v1:172.21.15.49:6834/2798044365] conn(0x559b09abf2d0 0x559b09abf6b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ff956ef958ff98ec server_cookie=7abf4fbfe11e13a7 in_seq=0 out_seq=0 2023-11-30T17:26:26.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.085+0000 7fd843fff700 10 client.8229 ms_handle_connect on v2:172.21.15.49:6832/2798044365 2023-11-30T17:26:26.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.086+0000 7fd843fff700 1 -- 172.21.15.49:0/1740180810 <== mds.0 v2:172.21.15.49:6832/2798044365 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x559b09851ca0 con 0x559b09abf2d0 2023-11-30T17:26:26.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.086+0000 7fd843fff700 10 client.8229 handle_command_reply: tid=0 2023-11-30T17:26:26.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.086+0000 7fd87d569b80 1 client.8229 shutdown 2023-11-30T17:26:26.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.086+0000 7fd87d569b80 1 -- 172.21.15.49:0/1740180810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b09ae24e0 msgr2=0x559b09ac36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:26.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.086+0000 7fd87d569b80 1 --2- 172.21.15.49:0/1740180810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b09ae24e0 0x559b09ac36d0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7fd854000f80 tx=0x7fd854009040).stop 2023-11-30T17:26:26.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.086+0000 7fd87d569b80 1 -- 172.21.15.49:0/1740180810 shutdown_connections 2023-11-30T17:26:26.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.086+0000 7fd87d569b80 1 --2- 172.21.15.49:0/1740180810 >> [v2:172.21.15.49:6832/2798044365,v1:172.21.15.49:6834/2798044365] conn(0x559b09abf2d0 0x559b09abf6b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.086+0000 7fd87d569b80 1 --2- 172.21.15.49:0/1740180810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b09ae24e0 0x559b09ac36d0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.086+0000 7fd843fff700 0 client.8229 ms_handle_reset on v2:172.21.15.49:6832/2798044365 2023-11-30T17:26:26.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.086+0000 7fd87d569b80 1 --2- 172.21.15.49:0/1740180810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559b09855e40 0x559b09af1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.086+0000 7fd87d569b80 1 --2- 172.21.15.49:0/1740180810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b09ac1cf0 0x559b09abdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.086+0000 7fd87d569b80 1 -- 172.21.15.49:0/1740180810 >> 172.21.15.49:0/1740180810 conn(0x559b099034a0 msgr2=0x559b09a99880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:26.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.086+0000 7fd87d569b80 1 -- 172.21.15.49:0/1740180810 shutdown_connections 2023-11-30T17:26:26.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.086+0000 7fd87d569b80 1 -- 172.21.15.49:0/1740180810 wait complete. 2023-11-30T17:26:26.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.086+0000 7fd87d569b80 20 client.8229 trim_cache size 0 max 16384 2023-11-30T17:26:26.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.103+0000 7fd87d569b80 1 Processor -- start 2023-11-30T17:26:26.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.103+0000 7fd87d569b80 1 -- start start 2023-11-30T17:26:26.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.103+0000 7fd87d569b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b09855e40 0x559b09abf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:26.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.103+0000 7fd87d569b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b09ac1cf0 0x559b09a965c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:26.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.103+0000 7fd87d569b80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559b09ae24e0 0x559b09af79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:26.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.103+0000 7fd87d569b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b09ac17c0 con 0x559b09855e40 2023-11-30T17:26:26.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.103+0000 7fd87d569b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b09ac54c0 con 0x559b09ac1cf0 2023-11-30T17:26:26.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.103+0000 7fd87d569b80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x559b09abfba0 con 0x559b09ae24e0 2023-11-30T17:26:26.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.103+0000 7fd86996d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b09855e40 0x559b09abf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:26.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.103+0000 7fd86996d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b09855e40 0x559b09abf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36762/0 (socket says 172.21.15.49:36762) 2023-11-30T17:26:26.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.103+0000 7fd86996d700 1 -- 172.21.15.49:0/2327940935 learned_addr learned my addr 172.21.15.49:0/2327940935 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:26.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.104+0000 7fd86a16e700 1 --2- 172.21.15.49:0/2327940935 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559b09ae24e0 0x559b09af79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:26.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.104+0000 7fd86916c700 1 --2- 172.21.15.49:0/2327940935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b09ac1cf0 0x559b09a965c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:26.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.104+0000 7fd86996d700 1 -- 172.21.15.49:0/2327940935 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559b09ae24e0 msgr2=0x559b09af79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:26.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.104+0000 7fd86996d700 1 --2- 172.21.15.49:0/2327940935 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559b09ae24e0 0x559b09af79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.104+0000 7fd86996d700 1 -- 172.21.15.49:0/2327940935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b09ac1cf0 msgr2=0x559b09a965c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:26.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.104+0000 7fd86996d700 1 --2- 172.21.15.49:0/2327940935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b09ac1cf0 0x559b09a965c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.104+0000 7fd86996d700 1 -- 172.21.15.49:0/2327940935 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b099df710 con 0x559b09855e40 2023-11-30T17:26:26.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.104+0000 7fd86996d700 1 --2- 172.21.15.49:0/2327940935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b09855e40 0x559b09abf6b0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7fd85c000e10 tx=0x7fd85c029040).ready entity=mon.0 client_cookie=a3343d56687f7174 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:26.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.104+0000 7fd84b7fe700 1 -- 172.21.15.49:0/2327940935 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c037040 con 0x559b09855e40 2023-11-30T17:26:26.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.104+0000 7fd84b7fe700 1 -- 172.21.15.49:0/2327940935 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85c025420 con 0x559b09855e40 2023-11-30T17:26:26.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.104+0000 7fd84b7fe700 1 -- 172.21.15.49:0/2327940935 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c03b280 con 0x559b09855e40 2023-11-30T17:26:26.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.104+0000 7fd87d569b80 1 -- 172.21.15.49:0/2327940935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b09855e40 msgr2=0x559b09abf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:26.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.104+0000 7fd87d569b80 1 --2- 172.21.15.49:0/2327940935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b09855e40 0x559b09abf6b0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7fd85c000e10 tx=0x7fd85c029040).stop 2023-11-30T17:26:26.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.104+0000 7fd87d569b80 1 -- 172.21.15.49:0/2327940935 shutdown_connections 2023-11-30T17:26:26.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.104+0000 7fd87d569b80 1 --2- 172.21.15.49:0/2327940935 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559b09ae24e0 0x559b09af79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.104+0000 7fd87d569b80 1 --2- 172.21.15.49:0/2327940935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b09855e40 0x559b09abf6b0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.104+0000 7fd87d569b80 1 --2- 172.21.15.49:0/2327940935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b09ac1cf0 0x559b09a965c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.104+0000 7fd87d569b80 1 -- 172.21.15.49:0/2327940935 >> 172.21.15.49:0/2327940935 conn(0x559b099034a0 msgr2=0x559b09ae28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:26.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.104+0000 7fd87d569b80 1 -- 172.21.15.49:0/2327940935 shutdown_connections 2023-11-30T17:26:26.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.104+0000 7fd87d569b80 1 -- 172.21.15.49:0/2327940935 wait complete. 2023-11-30T17:26:26.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.105+0000 7fd87d569b80 1 -- start start 2023-11-30T17:26:26.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.105+0000 7fd87d569b80 1 Processor -- start 2023-11-30T17:26:26.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.106+0000 7fd87d569b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b09855e40 0x559b09b3d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:26.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.106+0000 7fd87d569b80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559b09ac1cf0 0x559b09b437e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:26.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.106+0000 7fd87d569b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b09ae24e0 0x559b09ac3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:26.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.106+0000 7fd87d569b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b09b44f30 con 0x559b09855e40 2023-11-30T17:26:26.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.106+0000 7fd87d569b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b09b43e50 con 0x559b09ae24e0 2023-11-30T17:26:26.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.106+0000 7fd87d569b80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x559b09b440a0 con 0x559b09ac1cf0 2023-11-30T17:26:26.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.106+0000 7fd87d569b80 10 client.0 ll_register_callbacks cb 0x559b09a59640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-30T17:26:26.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.106+0000 7fd86996d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b09855e40 0x559b09b3d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:26.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.106+0000 7fd86996d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b09855e40 0x559b09b3d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36776/0 (socket says 172.21.15.49:36776) 2023-11-30T17:26:26.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.106+0000 7fd86996d700 1 -- 172.21.15.49:0/1949060610 learned_addr learned my addr 172.21.15.49:0/1949060610 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:26.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.106+0000 7fd86a16e700 1 --2- 172.21.15.49:0/1949060610 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b09ae24e0 0x559b09ac3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:26.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.106+0000 7fd86916c700 1 --2- 172.21.15.49:0/1949060610 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559b09ac1cf0 0x559b09b437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:26.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.106+0000 7fd86996d700 1 -- 172.21.15.49:0/1949060610 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559b09ac1cf0 msgr2=0x559b09b437e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:26.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.106+0000 7fd86996d700 1 --2- 172.21.15.49:0/1949060610 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559b09ac1cf0 0x559b09b437e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.106+0000 7fd86996d700 1 -- 172.21.15.49:0/1949060610 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b09ae24e0 msgr2=0x559b09ac3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:26.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.106+0000 7fd86996d700 1 --2- 172.21.15.49:0/1949060610 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b09ae24e0 0x559b09ac3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.106+0000 7fd86996d700 1 -- 172.21.15.49:0/1949060610 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559b099e4620 con 0x559b09855e40 2023-11-30T17:26:26.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.107+0000 7fd86996d700 1 --2- 172.21.15.49:0/1949060610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b09855e40 0x559b09b3d990 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7fd85c006d80 tx=0x7fd85c039000).ready entity=mon.0 client_cookie=104a2ab8294cd38c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:26.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.107+0000 7fd843fff700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-30T17:26:26.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.107+0000 7fd843fff700 1 -- 172.21.15.49:0/1949060610 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c037040 con 0x559b09855e40 2023-11-30T17:26:26.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.107+0000 7fd843fff700 1 -- 172.21.15.49:0/1949060610 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(146..146 src has 1..146) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fd85c031710 con 0x559b09855e40 2023-11-30T17:26:26.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.107+0000 7fd87d569b80 1 -- 172.21.15.49:0/1949060610 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd85c00e880 con 0x559b09855e40 2023-11-30T17:26:26.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.107+0000 7fd843fff700 1 -- 172.21.15.49:0/1949060610 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd85c021040 con 0x559b09855e40 2023-11-30T17:26:26.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.107+0000 7fd87d569b80 10 client.8235 fetch_fsmap learned FSMap version 61 2023-11-30T17:26:26.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.107+0000 7fd87d569b80 1 -- 172.21.15.49:0/1949060610 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) v3 -- 0x559b09856f80 con 0x559b09855e40 2023-11-30T17:26:26.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.107+0000 7fd843fff700 1 -- 172.21.15.49:0/1949060610 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85c00e880 con 0x559b09855e40 2023-11-30T17:26:26.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.107+0000 7fd843fff700 1 -- 172.21.15.49:0/1949060610 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 61) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd85c03a070 con 0x559b09855e40 2023-11-30T17:26:26.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.107+0000 7fd87d569b80 10 client.8235 fetch_fsmap finished waiting for FSMap version 61 2023-11-30T17:26:26.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.107+0000 7fd87d569b80 10 client.8235 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-30T17:26:26.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.107+0000 7fd87d569b80 20 client.8235 populate_metadata read hostname 'smithi049' 2023-11-30T17:26:26.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.107+0000 7fd87d569b80 1 --2- 172.21.15.49:0/1949060610 >> [v2:172.21.15.49:6832/2798044365,v1:172.21.15.49:6834/2798044365] conn(0x559b09ac45f0 0x559b09abaf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:26.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.107+0000 7fd87d569b80 4 client.8235 mds_command: new command op to 8085 tid=0[{"prefix": "status"}] 2023-11-30T17:26:26.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.107+0000 7fd87d569b80 1 -- 172.21.15.49:0/1949060610 --> [v2:172.21.15.49:6832/2798044365,v1:172.21.15.49:6834/2798044365] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559b09888ca0 con 0x559b09ac45f0 2023-11-30T17:26:26.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.107+0000 7fd86916c700 1 --2- 172.21.15.49:0/1949060610 >> [v2:172.21.15.49:6832/2798044365,v1:172.21.15.49:6834/2798044365] conn(0x559b09ac45f0 0x559b09abaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:26.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.108+0000 7fd86916c700 1 --2- 172.21.15.49:0/1949060610 >> [v2:172.21.15.49:6832/2798044365,v1:172.21.15.49:6834/2798044365] conn(0x559b09ac45f0 0x559b09abaf60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ce6fa385ccf63afa server_cookie=268a68f4f7b860a7 in_seq=0 out_seq=0 2023-11-30T17:26:26.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.108+0000 7fd843fff700 10 client.8235 ms_handle_connect on v2:172.21.15.49:6832/2798044365 2023-11-30T17:26:26.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.108+0000 7fd843fff700 1 -- 172.21.15.49:0/1949060610 <== mds.0 v2:172.21.15.49:6832/2798044365 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x559b09888ca0 con 0x559b09ac45f0 2023-11-30T17:26:26.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.108+0000 7fd843fff700 10 client.8235 handle_command_reply: tid=0 2023-11-30T17:26:26.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.108+0000 7fd87d569b80 1 client.8235 shutdown 2023-11-30T17:26:26.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.108+0000 7fd87d569b80 1 -- 172.21.15.49:0/1949060610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b09855e40 msgr2=0x559b09b3d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:26.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.108+0000 7fd87d569b80 1 --2- 172.21.15.49:0/1949060610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b09855e40 0x559b09b3d990 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7fd85c006d80 tx=0x7fd85c039000).stop 2023-11-30T17:26:26.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.108+0000 7fd87d569b80 1 -- 172.21.15.49:0/1949060610 shutdown_connections 2023-11-30T17:26:26.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.108+0000 7fd87d569b80 1 --2- 172.21.15.49:0/1949060610 >> [v2:172.21.15.49:6832/2798044365,v1:172.21.15.49:6834/2798044365] conn(0x559b09ac45f0 0x559b09abaf60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.108+0000 7fd87d569b80 1 --2- 172.21.15.49:0/1949060610 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b09ae24e0 0x559b09ac3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.108+0000 7fd87d569b80 1 --2- 172.21.15.49:0/1949060610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b09855e40 0x559b09b3d990 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.108+0000 7fd843fff700 0 client.8235 ms_handle_reset on v2:172.21.15.49:6832/2798044365 2023-11-30T17:26:26.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.108+0000 7fd87d569b80 1 --2- 172.21.15.49:0/1949060610 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559b09ac1cf0 0x559b09b437e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.108+0000 7fd87d569b80 1 -- 172.21.15.49:0/1949060610 >> 172.21.15.49:0/1949060610 conn(0x559b099034a0 msgr2=0x559b09ae28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:26.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.108+0000 7fd87d569b80 1 -- 172.21.15.49:0/1949060610 shutdown_connections 2023-11-30T17:26:26.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.108+0000 7fd87d569b80 1 -- 172.21.15.49:0/1949060610 wait complete. 2023-11-30T17:26:26.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.108+0000 7fd87d569b80 20 client.8235 trim_cache size 0 max 16384 2023-11-30T17:26:26.117 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T17:26:26.117 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "ef213ed4-8f62-4ad5-b55f-7510fd0ee359", 2023-11-30T17:26:26.117 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2023-11-30T17:26:26.117 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 8085, 2023-11-30T17:26:26.117 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-11-30T17:26:26.117 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-11-30T17:26:26.117 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-11-30T17:26:26.117 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 5.7497071389999999, 2023-11-30T17:26:26.117 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 61, 2023-11-30T17:26:26.117 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 146, 2023-11-30T17:26:26.117 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 146, 2023-11-30T17:26:26.117 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 10.913572974999999 2023-11-30T17:26:26.117 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T17:26:26.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.109+0000 7fd86a96f700 1 -- 172.21.15.49:0/4110239345 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd85005f270 msgr2=0x7fd850061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:26.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.109+0000 7fd86a96f700 1 --2- 172.21.15.49:0/4110239345 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd85005f270 0x7fd850061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fd85c009ab0 tx=0x7fd85c01a000).stop 2023-11-30T17:26:26.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.109+0000 7fd86a96f700 1 -- 172.21.15.49:0/4110239345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd864140430 msgr2=0x7fd8640c4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:26.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.109+0000 7fd86a96f700 1 --2- 172.21.15.49:0/4110239345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd864140430 0x7fd8640c4ce0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7fd8580119f0 tx=0x7fd858009060).stop 2023-11-30T17:26:26.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.109+0000 7fd86a96f700 1 -- 172.21.15.49:0/4110239345 shutdown_connections 2023-11-30T17:26:26.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.109+0000 7fd86a96f700 1 --2- 172.21.15.49:0/4110239345 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8640c51d0 0x7fd8640afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:26.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.109+0000 7fd86a96f700 1 --2- 172.21.15.49:0/4110239345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd84c0038e0 0x7fd864142cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.109+0000 7fd86a96f700 1 --2- 172.21.15.49:0/4110239345 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd85005f270 0x7fd850061730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.109+0000 7fd86a96f700 1 --2- 172.21.15.49:0/4110239345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd864140430 0x7fd8640c4ce0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.109+0000 7fd86a96f700 1 -- 172.21.15.49:0/4110239345 >> 172.21.15.49:0/4110239345 conn(0x7fd864064990 msgr2=0x7fd864064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:26.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.109+0000 7fd86a96f700 1 -- 172.21.15.49:0/4110239345 shutdown_connections 2023-11-30T17:26:26.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.109+0000 7fd86a96f700 1 -- 172.21.15.49:0/4110239345 wait complete. 2023-11-30T17:26:26.123 DEBUG:teuthology.orchestra.run.smithi049:> ceph fs ls 2023-11-30T17:26:26.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.226+0000 7f82de83d700 1 Processor -- start 2023-11-30T17:26:26.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.226+0000 7f82de83d700 1 -- start start 2023-11-30T17:26:26.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.227+0000 7f82de83d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f82d80cab20 0x7f82d80c0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:26.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.227+0000 7f82de83d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f82d80c0e20 0x7f82d80c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:26.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.227+0000 7f82de83d700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d80a9700 con 0x7f82d80ca740 2023-11-30T17:26:26.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.227+0000 7f82de83d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d8154ae0 con 0x7f82d80cab20 2023-11-30T17:26:26.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.227+0000 7f82de83d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d80c1280 con 0x7f82d80c0e20 2023-11-30T17:26:26.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.227+0000 7f82dd83b700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f82d80ca740 0x7f82d80aa0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51264/0 (socket says 172.21.15.49:51264) 2023-11-30T17:26:26.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.227+0000 7f82dd83b700 1 -- 172.21.15.49:0/1373622902 learned_addr learned my addr 172.21.15.49:0/1373622902 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:26.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.227+0000 7f82dd03a700 1 --2- 172.21.15.49:0/1373622902 >> v2:172.21.15.115:3300/0 conn(0x7f82d80cab20 0x7f82d80c0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:26.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.227+0000 7f82de03c700 1 --2- 172.21.15.49:0/1373622902 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f82d80c0e20 0x7f82d80c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:26.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.227+0000 7f82dc839700 1 -- 172.21.15.49:0/1373622902 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945322687 0 0) 0x7f82d80a9700 con 0x7f82d80ca740 2023-11-30T17:26:26.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.227+0000 7f82dc839700 1 -- 172.21.15.49:0/1373622902 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82c00033f0 con 0x7f82d80ca740 2023-11-30T17:26:26.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.228+0000 7f82de03c700 1 -- 172.21.15.49:0/1373622902 >> v2:172.21.15.115:3300/0 conn(0x7f82d80cab20 msgr2=0x7f82d80c0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:26.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.228+0000 7f82de03c700 1 --2- 172.21.15.49:0/1373622902 >> v2:172.21.15.115:3300/0 conn(0x7f82d80cab20 0x7f82d80c0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.228+0000 7f82de03c700 1 -- 172.21.15.49:0/1373622902 >> v1:172.21.15.49:6789/0 conn(0x7f82d80ca740 legacy=0x7f82d80aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:26.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.228+0000 7f82de03c700 1 -- 172.21.15.49:0/1373622902 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d80a9b90 con 0x7f82d80c0e20 2023-11-30T17:26:26.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.228+0000 7f82dd03a700 1 --2- 172.21.15.49:0/1373622902 >> v2:172.21.15.115:3300/0 conn(0x7f82d80cab20 0x7f82d80c0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:26:26.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.228+0000 7f82de03c700 1 --2- 172.21.15.49:0/1373622902 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f82d80c0e20 0x7f82d80c8f70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f82c8009e60 tx=0x7f82c8009780).ready entity=mon.2 client_cookie=163d634057890a9c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:26.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.228+0000 7f82dc839700 1 -- 172.21.15.49:0/1373622902 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c800e070 con 0x7f82d80c0e20 2023-11-30T17:26:26.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.228+0000 7f82dc839700 1 -- 172.21.15.49:0/1373622902 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c800bb40 con 0x7f82d80c0e20 2023-11-30T17:26:26.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.228+0000 7f82dc839700 1 -- 172.21.15.49:0/1373622902 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c8012410 con 0x7f82d80c0e20 2023-11-30T17:26:26.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.228+0000 7f82de83d700 1 -- 172.21.15.49:0/1373622902 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f82d80c0e20 msgr2=0x7f82d80c8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:26.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.228+0000 7f82de83d700 1 --2- 172.21.15.49:0/1373622902 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f82d80c0e20 0x7f82d80c8f70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f82c8009e60 tx=0x7f82c8009780).stop 2023-11-30T17:26:26.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.228+0000 7f82de83d700 1 -- 172.21.15.49:0/1373622902 shutdown_connections 2023-11-30T17:26:26.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.228+0000 7f82de83d700 1 --2- 172.21.15.49:0/1373622902 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f82d80c0e20 0x7f82d80c8f70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.228+0000 7f82de83d700 1 --2- 172.21.15.49:0/1373622902 >> v2:172.21.15.115:3300/0 conn(0x7f82d80cab20 0x7f82d80c0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.228+0000 7f82de83d700 1 -- 172.21.15.49:0/1373622902 >> 172.21.15.49:0/1373622902 conn(0x7f82d80946d0 msgr2=0x7f82d806a690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:26.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.229+0000 7f82de83d700 1 -- 172.21.15.49:0/1373622902 shutdown_connections 2023-11-30T17:26:26.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.229+0000 7f82de83d700 1 -- 172.21.15.49:0/1373622902 wait complete. 2023-11-30T17:26:26.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.230+0000 7f82de83d700 1 Processor -- start 2023-11-30T17:26:26.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.230+0000 7f82de83d700 1 -- start start 2023-11-30T17:26:26.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.230+0000 7f82de83d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f82d80c0e20 0x7f82d813cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:26.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.230+0000 7f82de83d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82d80ca740 0x7f82d80c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:26.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.230+0000 7f82de83d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82d80cab20 0x7f82d80c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:26.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.230+0000 7f82de83d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d80ae9b0 con 0x7f82d80cab20 2023-11-30T17:26:26.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.230+0000 7f82de83d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d80ae660 con 0x7f82d80ca740 2023-11-30T17:26:26.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.230+0000 7f82de83d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d80c4ae0 con 0x7f82d80c0e20 2023-11-30T17:26:26.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.230+0000 7f82de03c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82d80cab20 0x7f82d80c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:26.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.231+0000 7f82de03c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82d80cab20 0x7f82d80c44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36780/0 (socket says 172.21.15.49:36780) 2023-11-30T17:26:26.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.231+0000 7f82de03c700 1 -- 172.21.15.49:0/4046261304 learned_addr learned my addr 172.21.15.49:0/4046261304 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:26.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.231+0000 7f82dd03a700 1 --2- 172.21.15.49:0/4046261304 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82d80ca740 0x7f82d80c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:26.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.231+0000 7f82dd83b700 1 --2- 172.21.15.49:0/4046261304 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f82d80c0e20 0x7f82d813cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:26.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.231+0000 7f82de03c700 1 -- 172.21.15.49:0/4046261304 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f82d80c0e20 msgr2=0x7f82d813cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:26.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.231+0000 7f82de03c700 1 --2- 172.21.15.49:0/4046261304 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f82d80c0e20 0x7f82d813cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.231+0000 7f82de03c700 1 -- 172.21.15.49:0/4046261304 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82d80ca740 msgr2=0x7f82d80c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:26.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.231+0000 7f82de03c700 1 --2- 172.21.15.49:0/4046261304 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82d80ca740 0x7f82d80c4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.231+0000 7f82de03c700 1 -- 172.21.15.49:0/4046261304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82cc0092a0 con 0x7f82d80cab20 2023-11-30T17:26:26.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.231+0000 7f82dd83b700 1 --2- 172.21.15.49:0/4046261304 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f82d80c0e20 0x7f82d813cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T17:26:26.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.231+0000 7f82de03c700 1 --2- 172.21.15.49:0/4046261304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82d80cab20 0x7f82d80c44f0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7f82d8063140 tx=0x7f82d80859a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:26.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.231+0000 7f82d5ffb700 1 -- 172.21.15.49:0/4046261304 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c801d630 con 0x7f82d80cab20 2023-11-30T17:26:26.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.231+0000 7f82d5ffb700 1 -- 172.21.15.49:0/4046261304 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c801d790 con 0x7f82d80cab20 2023-11-30T17:26:26.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.231+0000 7f82d5ffb700 1 -- 172.21.15.49:0/4046261304 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c801db50 con 0x7f82d80cab20 2023-11-30T17:26:26.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.231+0000 7f82de83d700 1 -- 172.21.15.49:0/4046261304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c8009a20 con 0x7f82d80cab20 2023-11-30T17:26:26.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.231+0000 7f82de83d700 1 -- 172.21.15.49:0/4046261304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d813d110 con 0x7f82d80cab20 2023-11-30T17:26:26.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.232+0000 7f82de83d700 1 -- 172.21.15.49:0/4046261304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d80aeaf0 con 0x7f82d80cab20 2023-11-30T17:26:26.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.233+0000 7f82d5ffb700 1 -- 172.21.15.49:0/4046261304 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f82c8003040 con 0x7f82d80cab20 2023-11-30T17:26:26.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.233+0000 7f82d5ffb700 1 --2- 172.21.15.49:0/4046261304 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f82c405f240 0x7f82c4061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:26.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.233+0000 7f82d5ffb700 1 -- 172.21.15.49:0/4046261304 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f82c807c2b0 con 0x7f82d80cab20 2023-11-30T17:26:26.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.234+0000 7f82dd83b700 1 --2- 172.21.15.49:0/4046261304 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f82c405f240 0x7f82c4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:26.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.234+0000 7f82dd83b700 1 --2- 172.21.15.49:0/4046261304 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f82c405f240 0x7f82c4061700 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f82d0007fd0 tx=0x7f82d0009040).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:26.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.238+0000 7f82d5ffb700 1 -- 172.21.15.49:0/4046261304 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f82c804d300 con 0x7f82d80cab20 2023-11-30T17:26:26.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.459+0000 7f82de83d700 1 -- 172.21.15.49:0/4046261304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f82d80a8af0 con 0x7f82d80cab20 2023-11-30T17:26:26.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.460+0000 7f82d5ffb700 1 -- 172.21.15.49:0/4046261304 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v61) v1 ==== 53+0+73 (secure 0 0 0) 0x7f82c8050920 con 0x7f82d80cab20 2023-11-30T17:26:26.462 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-30T17:26:26.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.462+0000 7f82de83d700 1 -- 172.21.15.49:0/4046261304 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f82c405f240 msgr2=0x7f82c4061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:26.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.462+0000 7f82de83d700 1 --2- 172.21.15.49:0/4046261304 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f82c405f240 0x7f82c4061700 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f82d0007fd0 tx=0x7f82d0009040).stop 2023-11-30T17:26:26.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.462+0000 7f82de83d700 1 -- 172.21.15.49:0/4046261304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82d80cab20 msgr2=0x7f82d80c44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:26.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.462+0000 7f82de83d700 1 --2- 172.21.15.49:0/4046261304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82d80cab20 0x7f82d80c44f0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7f82d8063140 tx=0x7f82d80859a0).stop 2023-11-30T17:26:26.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.462+0000 7f82de83d700 1 -- 172.21.15.49:0/4046261304 shutdown_connections 2023-11-30T17:26:26.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.462+0000 7f82de83d700 1 --2- 172.21.15.49:0/4046261304 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f82c405f240 0x7f82c4061700 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.462+0000 7f82de83d700 1 --2- 172.21.15.49:0/4046261304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82d80cab20 0x7f82d80c44f0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.462+0000 7f82de83d700 1 --2- 172.21.15.49:0/4046261304 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f82d80c0e20 0x7f82d813cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.462+0000 7f82de83d700 1 --2- 172.21.15.49:0/4046261304 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82d80ca740 0x7f82d80c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:26.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.462+0000 7f82de83d700 1 -- 172.21.15.49:0/4046261304 >> 172.21.15.49:0/4046261304 conn(0x7f82d80946d0 msgr2=0x7f82d815a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:26.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.462+0000 7f82de83d700 1 -- 172.21.15.49:0/4046261304 shutdown_connections 2023-11-30T17:26:26.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:26.462+0000 7f82de83d700 1 -- 172.21.15.49:0/4046261304 wait complete. 2023-11-30T17:26:26.475 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-30T17:26:26.475 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-30T17:26:26.475 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-11-30T17:26:26.476 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-30T17:26:26.476 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-30T17:26:26.476 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-30T17:26:26.476 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-30T17:26:26.476 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-30T17:26:26.476 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-30T17:26:26.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:26:26.476 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-11-30T17:26:26.492 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-30T17:26:26.492 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-30T17:26:26.492 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-11-30T17:26:26.492 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:26:26.493 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-11-30T17:26:26.493 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:26:26.493 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:26:26.493 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:26:26.493 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-11-30T17:26:26.493 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:26:26.493 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:26:26.493 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-11-30T17:26:26.493 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-30T17:26:26.493 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:26:26.493 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-11-30T17:26:26.493 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-30T17:26:26.493 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 41289sec preferred_lft 41289sec 2023-11-30T17:26:26.493 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2023-11-30T17:26:26.494 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:26:26.494 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T17:26:26.494 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-11-30T17:26:26.494 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-11-30T17:26:26.494 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-30T17:26:26.494 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 32:bf:40:53:4c:5d brd ff:ff:ff:ff:ff:ff 2023-11-30T17:26:26.494 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-30T17:26:26.494 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:26:26.494 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::8b6:11ff:fe93:7174/64 scope link 2023-11-30T17:26:26.494 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:26:26.494 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-30T17:26:26.494 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 3e:e9:3c:a8:7a:95 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-30T17:26:26.494 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::3ce9:3cff:fea8:7a95/64 scope link 2023-11-30T17:26:26.494 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:26:26.495 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-30T17:26:26.495 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 32:bf:40:53:4c:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-30T17:26:26.495 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::30bf:40ff:fe53:4c5d/64 scope link 2023-11-30T17:26:26.495 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T17:26:26.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:26:26.495 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-30T17:26:26.556 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-11-30T17:26:26.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:26:26.558 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-11-30T17:26:26.615 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-11-30T17:26:26.615 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-30T17:26:26.615 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-30T17:26:26.615 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-30T17:26:26.615 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-30T17:26:26.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:26:26.616 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-11-30T17:26:26.616 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-11-30T17:26:26.616 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-30T17:26:26.616 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-30T17:26:26.616 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-30T17:26:26.616 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-11-30T17:26:26.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:26:26.717 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-11-30T17:26:26.732 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-30T17:26:26.732 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-30T17:26:26.732 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-30T17:26:26.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:26:26.733 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-11-30T17:26:26.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:26:26.798 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-11-30T17:26:26.854 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-30T17:26:26.854 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:26:26.934 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:26:26.934 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-30T17:26:26.959 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T17:26:26.959 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-30T17:26:26.962 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-30T17:26:26.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T17:26:26.962 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-30T17:26:27.028 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-30T17:26:27.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.184+0000 7f95ef59e700 1 Processor -- start 2023-11-30T17:26:27.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.184+0000 7f95ef59e700 1 -- start start 2023-11-30T17:26:27.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.185+0000 7f95ef59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95f014e530 0x7f95f00c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:27.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.185+0000 7f95ef59e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f95f0154950 0x7f95f014e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:27.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.185+0000 7f95ef59e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f00c7bc0 con 0x7f95f0158570 2023-11-30T17:26:27.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.185+0000 7f95ef59e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f0155920 con 0x7f95f0154950 2023-11-30T17:26:27.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.185+0000 7f95ef59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f0154dd0 con 0x7f95f014e530 2023-11-30T17:26:27.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.185+0000 7f95ee59c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95f014e530 0x7f95f00c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:27.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.185+0000 7f95edd9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f95f0154950 0x7f95f014e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:27.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.185+0000 7f95ee59c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95f014e530 0x7f95f00c66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:44042/0 (socket says 172.21.15.49:44042) 2023-11-30T17:26:27.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.185+0000 7f95edd9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f95f0154950 0x7f95f014e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:57930/0 (socket says 172.21.15.49:57930) 2023-11-30T17:26:27.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.185+0000 7f95eed9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f95f0158570 0x7f95f00aa030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:44008/0 (socket says 172.21.15.49:44008) 2023-11-30T17:26:27.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.185+0000 7f95ee59c700 1 -- 172.21.15.49:0/3166681811 learned_addr learned my addr 172.21.15.49:0/3166681811 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:27.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.185+0000 7f95ee59c700 1 -- 172.21.15.49:0/3166681811 >> v2:172.21.15.115:3300/0 conn(0x7f95f0154950 msgr2=0x7f95f014e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:27.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.185+0000 7f95ee59c700 1 --2- 172.21.15.49:0/3166681811 >> v2:172.21.15.115:3300/0 conn(0x7f95f0154950 0x7f95f014e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:27.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.185+0000 7f95ee59c700 1 -- 172.21.15.49:0/3166681811 >> v1:172.21.15.115:6789/0 conn(0x7f95f0158570 legacy=0x7f95f00aa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:27.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.186+0000 7f95ee59c700 1 -- 172.21.15.49:0/3166681811 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f0155080 con 0x7f95f014e530 2023-11-30T17:26:27.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.186+0000 7f95ee59c700 1 --2- 172.21.15.49:0/3166681811 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95f014e530 0x7f95f00c66f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f95e8006fd0 tx=0x7f95e80090f0).ready entity=mon.2 client_cookie=a735720aaed10f3d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:27.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.186+0000 7f95ed59a700 1 -- 172.21.15.49:0/3166681811 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e800b580 con 0x7f95f014e530 2023-11-30T17:26:27.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.186+0000 7f95ed59a700 1 -- 172.21.15.49:0/3166681811 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e800b6e0 con 0x7f95f014e530 2023-11-30T17:26:27.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.186+0000 7f95ed59a700 1 -- 172.21.15.49:0/3166681811 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e800ba60 con 0x7f95f014e530 2023-11-30T17:26:27.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.186+0000 7f95ef59e700 1 -- 172.21.15.49:0/3166681811 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95f014e530 msgr2=0x7f95f00c66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:27.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.186+0000 7f95ef59e700 1 --2- 172.21.15.49:0/3166681811 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95f014e530 0x7f95f00c66f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f95e8006fd0 tx=0x7f95e80090f0).stop 2023-11-30T17:26:27.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.186+0000 7f95ef59e700 1 -- 172.21.15.49:0/3166681811 shutdown_connections 2023-11-30T17:26:27.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.186+0000 7f95ef59e700 1 --2- 172.21.15.49:0/3166681811 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95f014e530 0x7f95f00c66f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:27.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.186+0000 7f95ef59e700 1 --2- 172.21.15.49:0/3166681811 >> v2:172.21.15.115:3300/0 conn(0x7f95f0154950 0x7f95f014e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:27.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.186+0000 7f95ef59e700 1 -- 172.21.15.49:0/3166681811 >> 172.21.15.49:0/3166681811 conn(0x7f95f0064990 msgr2=0x7f95f0064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:27.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.186+0000 7f95ef59e700 1 -- 172.21.15.49:0/3166681811 shutdown_connections 2023-11-30T17:26:27.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.186+0000 7f95ef59e700 1 -- 172.21.15.49:0/3166681811 wait complete. 2023-11-30T17:26:27.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.188+0000 7f95ef59e700 1 Processor -- start 2023-11-30T17:26:27.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.188+0000 7f95ef59e700 1 -- start start 2023-11-30T17:26:27.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.188+0000 7f95ef59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95f014e530 0x7f95f00b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:27.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.188+0000 7f95ef59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95f0154950 0x7f95f00c3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:27.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.188+0000 7f95ef59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f0158570 0x7f95f00c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:27.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.188+0000 7f95ef59e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f00af000 con 0x7f95f0158570 2023-11-30T17:26:27.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.188+0000 7f95ef59e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f00af250 con 0x7f95f0154950 2023-11-30T17:26:27.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.188+0000 7f95ef59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f00af530 con 0x7f95f014e530 2023-11-30T17:26:27.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.188+0000 7f95eed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f0158570 0x7f95f00c3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:27.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.189+0000 7f95eed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f0158570 0x7f95f00c3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36792/0 (socket says 172.21.15.49:36792) 2023-11-30T17:26:27.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.189+0000 7f95eed9d700 1 -- 172.21.15.49:0/48409545 learned_addr learned my addr 172.21.15.49:0/48409545 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:27.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.189+0000 7f95ee59c700 1 --2- 172.21.15.49:0/48409545 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95f014e530 0x7f95f00b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:27.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.189+0000 7f95edd9b700 1 --2- 172.21.15.49:0/48409545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95f0154950 0x7f95f00c3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:27.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.189+0000 7f95eed9d700 1 -- 172.21.15.49:0/48409545 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95f014e530 msgr2=0x7f95f00b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:27.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.189+0000 7f95eed9d700 1 --2- 172.21.15.49:0/48409545 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95f014e530 0x7f95f00b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:27.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.189+0000 7f95eed9d700 1 -- 172.21.15.49:0/48409545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95f0154950 msgr2=0x7f95f00c3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:27.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.189+0000 7f95eed9d700 1 --2- 172.21.15.49:0/48409545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95f0154950 0x7f95f00c3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:27.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.189+0000 7f95eed9d700 1 -- 172.21.15.49:0/48409545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e8009370 con 0x7f95f0158570 2023-11-30T17:26:27.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.189+0000 7f95edd9b700 1 --2- 172.21.15.49:0/48409545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95f0154950 0x7f95f00c3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T17:26:27.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.189+0000 7f95eed9d700 1 --2- 172.21.15.49:0/48409545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f0158570 0x7f95f00c3d50 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f95e000c7c0 tx=0x7f95e0001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:27.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.189+0000 7f95e67fc700 1 -- 172.21.15.49:0/48409545 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e0005c70 con 0x7f95f0158570 2023-11-30T17:26:27.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.189+0000 7f95e67fc700 1 -- 172.21.15.49:0/48409545 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e0005dd0 con 0x7f95f0158570 2023-11-30T17:26:27.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.189+0000 7f95e67fc700 1 -- 172.21.15.49:0/48409545 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e0007320 con 0x7f95f0158570 2023-11-30T17:26:27.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.189+0000 7f95ef59e700 1 -- 172.21.15.49:0/48409545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f00af810 con 0x7f95f0158570 2023-11-30T17:26:27.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.189+0000 7f95ef59e700 1 -- 172.21.15.49:0/48409545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f00afdd0 con 0x7f95f0158570 2023-11-30T17:26:27.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.190+0000 7f95ef59e700 1 -- 172.21.15.49:0/48409545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f0062ee0 con 0x7f95f0158570 2023-11-30T17:26:27.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.190+0000 7f95e67fc700 1 -- 172.21.15.49:0/48409545 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f95e0007710 con 0x7f95f0158570 2023-11-30T17:26:27.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.191+0000 7f95e67fc700 1 --2- 172.21.15.49:0/48409545 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f95d005f270 0x7f95d0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:27.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.191+0000 7f95e67fc700 1 -- 172.21.15.49:0/48409545 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f95e007a3d0 con 0x7f95f0158570 2023-11-30T17:26:27.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.191+0000 7f95ee59c700 1 --2- 172.21.15.49:0/48409545 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f95d005f270 0x7f95d0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:27.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.192+0000 7f95ee59c700 1 --2- 172.21.15.49:0/48409545 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f95d005f270 0x7f95d0061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f95e8009fd0 tx=0x7f95e8017000).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:27.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.195+0000 7f95e67fc700 1 -- 172.21.15.49:0/48409545 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f95e004b4e0 con 0x7f95f0158570 2023-11-30T17:26:27.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.396+0000 7f95ef59e700 1 -- 172.21.15.49:0/48409545 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f95f00afff0 con 0x7f95d005f270 2023-11-30T17:26:27.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.397+0000 7f95e67fc700 1 -- 172.21.15.49:0/48409545 <== mgr.6737 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f95f00afff0 con 0x7f95d005f270 2023-11-30T17:26:27.402 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-11-30T17:26:27.402 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T17:26:27.402 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cephfs" 2023-11-30T17:26:27.402 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T17:26:27.402 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-11-30T17:26:27.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.399+0000 7f95ef59e700 1 -- 172.21.15.49:0/48409545 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f95d005f270 msgr2=0x7f95d0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:27.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.399+0000 7f95ef59e700 1 --2- 172.21.15.49:0/48409545 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f95d005f270 0x7f95d0061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f95e8009fd0 tx=0x7f95e8017000).stop 2023-11-30T17:26:27.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.399+0000 7f95ef59e700 1 -- 172.21.15.49:0/48409545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f0158570 msgr2=0x7f95f00c3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:27.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.399+0000 7f95ef59e700 1 --2- 172.21.15.49:0/48409545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f0158570 0x7f95f00c3d50 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f95e000c7c0 tx=0x7f95e0001510).stop 2023-11-30T17:26:27.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.399+0000 7f95ef59e700 1 -- 172.21.15.49:0/48409545 shutdown_connections 2023-11-30T17:26:27.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.399+0000 7f95ef59e700 1 --2- 172.21.15.49:0/48409545 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f95d005f270 0x7f95d0061730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:27.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.399+0000 7f95ef59e700 1 --2- 172.21.15.49:0/48409545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f0158570 0x7f95f00c3d50 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:27.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.399+0000 7f95ef59e700 1 --2- 172.21.15.49:0/48409545 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95f014e530 0x7f95f00b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:27.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.399+0000 7f95ef59e700 1 --2- 172.21.15.49:0/48409545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95f0154950 0x7f95f00c3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:27.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.399+0000 7f95ef59e700 1 -- 172.21.15.49:0/48409545 >> 172.21.15.49:0/48409545 conn(0x7f95f0064990 msgr2=0x7f95f0157090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:27.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.400+0000 7f95ef59e700 1 -- 172.21.15.49:0/48409545 shutdown_connections 2023-11-30T17:26:27.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.400+0000 7f95ef59e700 1 -- 172.21.15.49:0/48409545 wait complete. 2023-11-30T17:26:27.414 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-11-30T17:26:27.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.533+0000 7f07ff401700 1 Processor -- start 2023-11-30T17:26:27.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.533+0000 7f07ff401700 1 -- start start 2023-11-30T17:26:27.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.534+0000 7f07ff401700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07f814e530 0x7f07f80c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:27.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.534+0000 7f07ff401700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f07f8154950 0x7f07f814e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:27.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.534+0000 7f07ff401700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f80c7bc0 con 0x7f07f8158570 2023-11-30T17:26:27.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.534+0000 7f07ff401700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f8155920 con 0x7f07f8154950 2023-11-30T17:26:27.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.534+0000 7f07ff401700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f8154dd0 con 0x7f07f814e530 2023-11-30T17:26:27.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.535+0000 7f07fe3ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07f814e530 0x7f07f80c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:27.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.535+0000 7f07fdbfe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f07f8154950 0x7f07f814e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:27.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.535+0000 7f07fec00700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f07f8158570 0x7f07f80aa030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:44014/0 (socket says 172.21.15.49:44014) 2023-11-30T17:26:27.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.535+0000 7f07fec00700 1 -- 172.21.15.49:0/2236541836 learned_addr learned my addr 172.21.15.49:0/2236541836 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:27.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.535+0000 7f07fd3fd700 1 -- 172.21.15.49:0/2236541836 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601435751 0 0) 0x7f07f80c7bc0 con 0x7f07f8158570 2023-11-30T17:26:27.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.535+0000 7f07fd3fd700 1 -- 172.21.15.49:0/2236541836 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07e40033f0 con 0x7f07f8158570 2023-11-30T17:26:27.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.535+0000 7f07fe3ff700 1 -- 172.21.15.49:0/2236541836 >> v2:172.21.15.115:3300/0 conn(0x7f07f8154950 msgr2=0x7f07f814e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:27.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.535+0000 7f07fe3ff700 1 --2- 172.21.15.49:0/2236541836 >> v2:172.21.15.115:3300/0 conn(0x7f07f8154950 0x7f07f814e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:27.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.535+0000 7f07fe3ff700 1 -- 172.21.15.49:0/2236541836 >> v1:172.21.15.115:6789/0 conn(0x7f07f8158570 legacy=0x7f07f80aa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.535+0000 7f07fe3ff700 1 -- 172.21.15.49:0/2236541836 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f8155080 con 0x7f07f814e530 2023-11-30T17:26:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.535+0000 7f07fdbfe700 1 --2- 172.21.15.49:0/2236541836 >> v2:172.21.15.115:3300/0 conn(0x7f07f8154950 0x7f07f814e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:26:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.535+0000 7f07fe3ff700 1 --2- 172.21.15.49:0/2236541836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07f814e530 0x7f07f80c66f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f07e8009760 tx=0x7f07e8009060).ready entity=mon.2 client_cookie=c6a90b5fedb2c604 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.536+0000 7f07fd3fd700 1 -- 172.21.15.49:0/2236541836 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e800d4a0 con 0x7f07f814e530 2023-11-30T17:26:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.536+0000 7f07fd3fd700 1 -- 172.21.15.49:0/2236541836 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e800d600 con 0x7f07f814e530 2023-11-30T17:26:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.536+0000 7f07fd3fd700 1 -- 172.21.15.49:0/2236541836 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e800d980 con 0x7f07f814e530 2023-11-30T17:26:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.536+0000 7f07ff401700 1 -- 172.21.15.49:0/2236541836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07f814e530 msgr2=0x7f07f80c66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.536+0000 7f07ff401700 1 --2- 172.21.15.49:0/2236541836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07f814e530 0x7f07f80c66f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f07e8009760 tx=0x7f07e8009060).stop 2023-11-30T17:26:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.536+0000 7f07ff401700 1 -- 172.21.15.49:0/2236541836 shutdown_connections 2023-11-30T17:26:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.536+0000 7f07ff401700 1 --2- 172.21.15.49:0/2236541836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07f814e530 0x7f07f80c66f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.536+0000 7f07ff401700 1 --2- 172.21.15.49:0/2236541836 >> v2:172.21.15.115:3300/0 conn(0x7f07f8154950 0x7f07f814e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.536+0000 7f07ff401700 1 -- 172.21.15.49:0/2236541836 >> 172.21.15.49:0/2236541836 conn(0x7f07f8064990 msgr2=0x7f07f8064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.536+0000 7f07ff401700 1 -- 172.21.15.49:0/2236541836 shutdown_connections 2023-11-30T17:26:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.536+0000 7f07ff401700 1 -- 172.21.15.49:0/2236541836 wait complete. 2023-11-30T17:26:27.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.537+0000 7f07ff401700 1 Processor -- start 2023-11-30T17:26:27.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.538+0000 7f07ff401700 1 -- start start 2023-11-30T17:26:27.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.538+0000 7f07ff401700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07f814e530 0x7f07f80c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:27.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.538+0000 7f07ff401700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07f8154950 0x7f07f80b0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:27.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.538+0000 7f07ff401700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07f8158570 0x7f07f80c2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:27.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.538+0000 7f07ff401700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f80b0290 con 0x7f07f814e530 2023-11-30T17:26:27.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.538+0000 7f07ff401700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f80afc80 con 0x7f07f8158570 2023-11-30T17:26:27.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.538+0000 7f07ff401700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f814efd0 con 0x7f07f8154950 2023-11-30T17:26:27.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.538+0000 7f07fe3ff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07f814e530 0x7f07f80c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:27.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.538+0000 7f07fe3ff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07f814e530 0x7f07f80c4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36804/0 (socket says 172.21.15.49:36804) 2023-11-30T17:26:27.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.538+0000 7f07fe3ff700 1 -- 172.21.15.49:0/2800778056 learned_addr learned my addr 172.21.15.49:0/2800778056 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:27.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.538+0000 7f07fdbfe700 1 --2- 172.21.15.49:0/2800778056 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07f8154950 0x7f07f80b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:27.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.538+0000 7f07fec00700 1 --2- 172.21.15.49:0/2800778056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07f8158570 0x7f07f80c2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:27.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.539+0000 7f07fe3ff700 1 -- 172.21.15.49:0/2800778056 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07f8154950 msgr2=0x7f07f80b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:27.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.539+0000 7f07fe3ff700 1 --2- 172.21.15.49:0/2800778056 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07f8154950 0x7f07f80b0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:27.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.539+0000 7f07fe3ff700 1 -- 172.21.15.49:0/2800778056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07f8158570 msgr2=0x7f07f80c2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:27.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.539+0000 7f07fe3ff700 1 --2- 172.21.15.49:0/2800778056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07f8158570 0x7f07f80c2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:27.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.539+0000 7f07fe3ff700 1 -- 172.21.15.49:0/2800778056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f40092a0 con 0x7f07f814e530 2023-11-30T17:26:27.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.539+0000 7f07fe3ff700 1 --2- 172.21.15.49:0/2800778056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07f814e530 0x7f07f80c4810 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7f07e8009d50 tx=0x7f07e8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:27.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.539+0000 7f07ee7fc700 1 -- 172.21.15.49:0/2800778056 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e800dd30 con 0x7f07f814e530 2023-11-30T17:26:27.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.539+0000 7f07ee7fc700 1 -- 172.21.15.49:0/2800778056 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e800de90 con 0x7f07f814e530 2023-11-30T17:26:27.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.539+0000 7f07ff401700 1 -- 172.21.15.49:0/2800778056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e80092a0 con 0x7f07f814e530 2023-11-30T17:26:27.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.539+0000 7f07ee7fc700 1 -- 172.21.15.49:0/2800778056 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e800d980 con 0x7f07f814e530 2023-11-30T17:26:27.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.539+0000 7f07ff401700 1 -- 172.21.15.49:0/2800778056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f80aff20 con 0x7f07f814e530 2023-11-30T17:26:27.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.540+0000 7f07ff401700 1 -- 172.21.15.49:0/2800778056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f80afae0 con 0x7f07f814e530 2023-11-30T17:26:27.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.541+0000 7f07ee7fc700 1 -- 172.21.15.49:0/2800778056 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 58) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f07e801d640 con 0x7f07f814e530 2023-11-30T17:26:27.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.541+0000 7f07ee7fc700 1 --2- 172.21.15.49:0/2800778056 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f07dc05f270 0x7f07dc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:27.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.541+0000 7f07ee7fc700 1 -- 172.21.15.49:0/2800778056 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f07e807ba00 con 0x7f07f814e530 2023-11-30T17:26:27.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.541+0000 7f07fdbfe700 1 --2- 172.21.15.49:0/2800778056 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f07dc05f270 0x7f07dc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:27.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.542+0000 7f07fdbfe700 1 --2- 172.21.15.49:0/2800778056 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f07dc05f270 0x7f07dc061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f07f80c2690 tx=0x7f07f4009060).ready entity=mgr.6737 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:27.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.545+0000 7f07ee7fc700 1 -- 172.21.15.49:0/2800778056 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f07f80afae0 con 0x7f07f814e530 2023-11-30T17:26:27.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:27.763+0000 7f07ff401700 1 -- 172.21.15.49:0/2800778056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f07f80afae0 con 0x7f07f814e530 2023-11-30T17:26:28.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.384+0000 7f07ee7fc700 1 -- 172.21.15.49:0/2800778056 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 59) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f07e8079610 con 0x7f07f814e530 2023-11-30T17:26:28.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.386+0000 7f07ee7fc700 1 -- 172.21.15.49:0/2800778056 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v59) v1 ==== 92+0+0 (secure 0 0 0) 0x7f07e80427e0 con 0x7f07f814e530 2023-11-30T17:26:28.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.388+0000 7f07ff401700 1 -- 172.21.15.49:0/2800778056 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f07dc05f270 msgr2=0x7f07dc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:28.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.388+0000 7f07ff401700 1 --2- 172.21.15.49:0/2800778056 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f07dc05f270 0x7f07dc061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f07f80c2690 tx=0x7f07f4009060).stop 2023-11-30T17:26:28.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.388+0000 7f07ff401700 1 -- 172.21.15.49:0/2800778056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07f814e530 msgr2=0x7f07f80c4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:28.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.388+0000 7f07ff401700 1 --2- 172.21.15.49:0/2800778056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07f814e530 0x7f07f80c4810 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7f07e8009d50 tx=0x7f07e8016000).stop 2023-11-30T17:26:28.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.388+0000 7f07ff401700 1 -- 172.21.15.49:0/2800778056 shutdown_connections 2023-11-30T17:26:28.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.388+0000 7f07ff401700 1 --2- 172.21.15.49:0/2800778056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07f8158570 0x7f07f80c2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:28.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.388+0000 7f07ff401700 1 --2- 172.21.15.49:0/2800778056 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f07dc05f270 0x7f07dc061730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:28.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.388+0000 7f07ff401700 1 --2- 172.21.15.49:0/2800778056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07f814e530 0x7f07f80c4810 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:28.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.388+0000 7f07ff401700 1 --2- 172.21.15.49:0/2800778056 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07f8154950 0x7f07f80b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:28.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.388+0000 7f07ff401700 1 -- 172.21.15.49:0/2800778056 >> 172.21.15.49:0/2800778056 conn(0x7f07f8064990 msgr2=0x7f07f8156a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:28.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.388+0000 7f07ff401700 1 -- 172.21.15.49:0/2800778056 shutdown_connections 2023-11-30T17:26:28.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.388+0000 7f07ff401700 1 -- 172.21.15.49:0/2800778056 wait complete. 2023-11-30T17:26:28.404 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-11-30T17:26:28.529 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:28.528+0000 7efe3c265680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T17:26:28.535 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:28.533+0000 7f74a94d5680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T17:26:28.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.533+0000 7f45da6d7700 1 Processor -- start 2023-11-30T17:26:28.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.533+0000 7f45da6d7700 1 -- start start 2023-11-30T17:26:28.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.534+0000 7f45da6d7700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f45d41547f0 0x7f45d40a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:28.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.534+0000 7f45da6d7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45d4062700 0x7f45d4062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:28.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.534+0000 7f45da6d7700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d40630a0 con 0x7f45d40c86f0 2023-11-30T17:26:28.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.534+0000 7f45da6d7700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45d40c7e30 con 0x7f45d41547f0 2023-11-30T17:26:28.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.534+0000 7f45da6d7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d40bcf40 con 0x7f45d4062700 2023-11-30T17:26:28.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.534+0000 7f45d3fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f45d41547f0 0x7f45d40a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:28.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.534+0000 7f45d8c74700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45d4062700 0x7f45d4062bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:28.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.534+0000 7f45d37fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f45d40c86f0 0x7f45d40c6fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:44032/0 (socket says 172.21.15.49:44032) 2023-11-30T17:26:28.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.534+0000 7f45d37fe700 1 -- 172.21.15.49:0/1489553154 learned_addr learned my addr 172.21.15.49:0/1489553154 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:28.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.534+0000 7f45d3fff700 1 --2- 172.21.15.49:0/1489553154 >> v2:172.21.15.115:3300/0 conn(0x7f45d41547f0 0x7f45d40a72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:57976/0 (socket says 172.21.15.49:57976) 2023-11-30T17:26:28.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.534+0000 7f45d8c74700 1 --2- 172.21.15.49:0/1489553154 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45d4062700 0x7f45d4062bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:44090/0 (socket says 172.21.15.49:44090) 2023-11-30T17:26:28.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.534+0000 7f45d3fff700 1 -- 172.21.15.49:0/1489553154 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45d4062700 msgr2=0x7f45d4062bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:28.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.534+0000 7f45d3fff700 1 --2- 172.21.15.49:0/1489553154 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45d4062700 0x7f45d4062bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:28.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.534+0000 7f45d3fff700 1 -- 172.21.15.49:0/1489553154 >> v1:172.21.15.115:6789/0 conn(0x7f45d40c86f0 legacy=0x7f45d40c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:28.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.534+0000 7f45d2ffd700 1 -- 172.21.15.49:0/1489553154 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276717697 0 0) 0x7f45c8001110 con 0x7f45d40c86f0 2023-11-30T17:26:28.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.534+0000 7f45d3fff700 1 -- 172.21.15.49:0/1489553154 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d40c6b20 con 0x7f45d41547f0 2023-11-30T17:26:28.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.534+0000 7f45d8c74700 1 --2- 172.21.15.49:0/1489553154 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45d4062700 0x7f45d4062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:26:28.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.534+0000 7f45d3fff700 1 --2- 172.21.15.49:0/1489553154 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45d41547f0 0x7f45d40a72e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f45c4009760 tx=0x7f45c4009060).ready entity=mon.1 client_cookie=69d69fb2ebc4778d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:28.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.535+0000 7f45d2ffd700 1 -- 172.21.15.49:0/1489553154 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c40090d0 con 0x7f45d41547f0 2023-11-30T17:26:28.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.535+0000 7f45d2ffd700 1 -- 172.21.15.49:0/1489553154 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c400f510 con 0x7f45d41547f0 2023-11-30T17:26:28.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.535+0000 7f45d2ffd700 1 -- 172.21.15.49:0/1489553154 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c400f890 con 0x7f45d41547f0 2023-11-30T17:26:28.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.535+0000 7f45da6d7700 1 -- 172.21.15.49:0/1489553154 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45d41547f0 msgr2=0x7f45d40a72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:28.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.535+0000 7f45da6d7700 1 --2- 172.21.15.49:0/1489553154 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45d41547f0 0x7f45d40a72e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f45c4009760 tx=0x7f45c4009060).stop 2023-11-30T17:26:28.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.536+0000 7f45da6d7700 1 -- 172.21.15.49:0/1489553154 shutdown_connections 2023-11-30T17:26:28.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.536+0000 7f45da6d7700 1 --2- 172.21.15.49:0/1489553154 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45d4062700 0x7f45d4062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:28.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.536+0000 7f45da6d7700 1 --2- 172.21.15.49:0/1489553154 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45d41547f0 0x7f45d40a72e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:28.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.536+0000 7f45da6d7700 1 -- 172.21.15.49:0/1489553154 >> 172.21.15.49:0/1489553154 conn(0x7f45d40642d0 msgr2=0x7f45d40c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:28.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.536+0000 7f45da6d7700 1 -- 172.21.15.49:0/1489553154 shutdown_connections 2023-11-30T17:26:28.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.536+0000 7f45da6d7700 1 -- 172.21.15.49:0/1489553154 wait complete. 2023-11-30T17:26:28.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.537+0000 7f45da6d7700 1 Processor -- start 2023-11-30T17:26:28.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.537+0000 7f45da6d7700 1 -- start start 2023-11-30T17:26:28.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.538+0000 7f45da6d7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45d4062700 0x7f45d414db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:28.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.538+0000 7f45da6d7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45d40c86f0 0x7f45d4151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:28.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.538+0000 7f45da6d7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45d41547f0 0x7f45d4151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:28.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.538+0000 7f45da6d7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d4157d90 con 0x7f45d4062700 2023-11-30T17:26:28.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.538+0000 7f45da6d7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d4159db0 con 0x7f45d40c86f0 2023-11-30T17:26:28.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.538+0000 7f45da6d7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d414f0a0 con 0x7f45d41547f0 2023-11-30T17:26:28.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.538+0000 7f45d37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45d40c86f0 0x7f45d4151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:28.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.538+0000 7f45d8c74700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45d41547f0 0x7f45d4151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:28.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.538+0000 7f45d3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45d4062700 0x7f45d414db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:28.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.538+0000 7f45d8c74700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45d41547f0 0x7f45d4151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:44104/0 (socket says 172.21.15.49:44104) 2023-11-30T17:26:28.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.538+0000 7f45d37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45d40c86f0 0x7f45d4151970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:57982/0 (socket says 172.21.15.49:57982) 2023-11-30T17:26:28.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.538+0000 7f45d8c74700 1 -- 172.21.15.49:0/1214532343 learned_addr learned my addr 172.21.15.49:0/1214532343 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:28.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.538+0000 7f45d37fe700 1 -- 172.21.15.49:0/1214532343 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45d41547f0 msgr2=0x7f45d4151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:28.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.538+0000 7f45d37fe700 1 --2- 172.21.15.49:0/1214532343 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45d41547f0 0x7f45d4151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:28.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.538+0000 7f45d37fe700 1 -- 172.21.15.49:0/1214532343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45d4062700 msgr2=0x7f45d414db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:28.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.538+0000 7f45d37fe700 1 --2- 172.21.15.49:0/1214532343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45d4062700 0x7f45d414db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:28.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.538+0000 7f45d37fe700 1 -- 172.21.15.49:0/1214532343 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45cc009a20 con 0x7f45d40c86f0 2023-11-30T17:26:28.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.538+0000 7f45d3fff700 1 --2- 172.21.15.49:0/1214532343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45d4062700 0x7f45d414db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T17:26:28.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.538+0000 7f45d37fe700 1 --2- 172.21.15.49:0/1214532343 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45d40c86f0 0x7f45d4151970 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f45c800c460 tx=0x7f45c8007dd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:28.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.539+0000 7f45bbfff700 1 -- 172.21.15.49:0/1214532343 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c80070d0 con 0x7f45d40c86f0 2023-11-30T17:26:28.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.539+0000 7f45bbfff700 1 -- 172.21.15.49:0/1214532343 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c8007230 con 0x7f45d40c86f0 2023-11-30T17:26:28.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.539+0000 7f45bbfff700 1 -- 172.21.15.49:0/1214532343 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c80075b0 con 0x7f45d40c86f0 2023-11-30T17:26:28.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.539+0000 7f45da6d7700 1 -- 172.21.15.49:0/1214532343 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c40092a0 con 0x7f45d40c86f0 2023-11-30T17:26:28.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.539+0000 7f45da6d7700 1 -- 172.21.15.49:0/1214532343 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d414f660 con 0x7f45d40c86f0 2023-11-30T17:26:28.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.540+0000 7f45bbfff700 1 -- 172.21.15.49:0/1214532343 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 59) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f45c80059b0 con 0x7f45d40c86f0 2023-11-30T17:26:28.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.540+0000 7f45da6d7700 1 -- 172.21.15.49:0/1214532343 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d4157ed0 con 0x7f45d40c86f0 2023-11-30T17:26:28.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.540+0000 7f45bbfff700 1 --2- 172.21.15.49:0/1214532343 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f45c005f2c0 0x7f45c0061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:28.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.540+0000 7f45bbfff700 1 -- 172.21.15.49:0/1214532343 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f45c8079800 con 0x7f45d40c86f0 2023-11-30T17:26:28.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.540+0000 7f45d3fff700 1 -- 172.21.15.49:0/1214532343 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f45c005f2c0 msgr2=0x7f45c0061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:26:28.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.541+0000 7f45d3fff700 1 --2- 172.21.15.49:0/1214532343 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f45c005f2c0 0x7f45c0061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:26:28.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.545+0000 7f45bbfff700 1 -- 172.21.15.49:0/1214532343 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f45d4157ed0 con 0x7f45d40c86f0 2023-11-30T17:26:28.594 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:28.592+0000 7efe3c265680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T17:26:28.603 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:28.601+0000 7f74a94d5680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T17:26:28.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.737+0000 7f45da6d7700 1 -- 172.21.15.49:0/1214532343 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f45d40630a0 con 0x7f45d40c86f0 2023-11-30T17:26:28.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.742+0000 7f45d3fff700 1 -- 172.21.15.49:0/1214532343 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f45c005f2c0 msgr2=0x7f45c0061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:26:28.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.742+0000 7f45d3fff700 1 --2- 172.21.15.49:0/1214532343 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f45c005f2c0 0x7f45c0061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:26:28.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.745+0000 7f45bbfff700 1 -- 172.21.15.49:0/1214532343 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v27)=0 v27) v1 ==== 138+0+0 (secure 0 0 0) 0x7f45d40630a0 con 0x7f45d40c86f0 2023-11-30T17:26:28.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.747+0000 7f45da6d7700 1 -- 172.21.15.49:0/1214532343 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f45c005f2c0 msgr2=0x7f45c0061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:26:28.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.747+0000 7f45da6d7700 1 --2- 172.21.15.49:0/1214532343 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f45c005f2c0 0x7f45c0061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:28.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.747+0000 7f45da6d7700 1 -- 172.21.15.49:0/1214532343 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45d40c86f0 msgr2=0x7f45d4151970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:28.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.747+0000 7f45da6d7700 1 --2- 172.21.15.49:0/1214532343 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45d40c86f0 0x7f45d4151970 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f45c800c460 tx=0x7f45c8007dd0).stop 2023-11-30T17:26:28.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.747+0000 7f45da6d7700 1 -- 172.21.15.49:0/1214532343 shutdown_connections 2023-11-30T17:26:28.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.747+0000 7f45da6d7700 1 --2- 172.21.15.49:0/1214532343 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45d41547f0 0x7f45d4151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:28.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.747+0000 7f45da6d7700 1 --2- 172.21.15.49:0/1214532343 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f45c005f2c0 0x7f45c0061780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:28.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.747+0000 7f45da6d7700 1 --2- 172.21.15.49:0/1214532343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45d4062700 0x7f45d414db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:28.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.747+0000 7f45da6d7700 1 --2- 172.21.15.49:0/1214532343 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45d40c86f0 0x7f45d4151970 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:28.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.747+0000 7f45da6d7700 1 -- 172.21.15.49:0/1214532343 >> 172.21.15.49:0/1214532343 conn(0x7f45d40642d0 msgr2=0x7f45d415a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:28.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.747+0000 7f45da6d7700 1 -- 172.21.15.49:0/1214532343 shutdown_connections 2023-11-30T17:26:28.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.747+0000 7f45da6d7700 1 -- 172.21.15.49:0/1214532343 wait complete. 2023-11-30T17:26:28.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T17:26:28.762 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-11-30T17:26:28.785 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1 1M 2023-11-30T17:26:28.868 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:28.866+0000 7efe3c265680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T17:26:28.915 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:28.913+0000 7f74a94d5680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T17:26:28.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.964+0000 7fd3cfecb700 1 Processor -- start 2023-11-30T17:26:28.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.964+0000 7fd3cfecb700 1 -- start start 2023-11-30T17:26:28.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.965+0000 7fd3cfecb700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd3c8063810 0x7fd3c80c5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:28.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.965+0000 7fd3cfecb700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd3c81514e0 0x7fd3c80bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:28.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.965+0000 7fd3cfecb700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c8151900 con 0x7fd3c8151100 2023-11-30T17:26:28.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.965+0000 7fd3cfecb700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c8063d20 con 0x7fd3c81514e0 2023-11-30T17:26:28.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.965+0000 7fd3cfecb700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c80c48b0 con 0x7fd3c8063810 2023-11-30T17:26:28.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.965+0000 7fd3ce468700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd3c81514e0 0x7fd3c80bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:28.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.965+0000 7fd3cdc67700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd3c8151100 0x7fd3c81559d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51274/0 (socket says 172.21.15.49:51274) 2023-11-30T17:26:28.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.965+0000 7fd3cdc67700 1 -- 172.21.15.49:0/722549003 learned_addr learned my addr 172.21.15.49:0/722549003 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:28.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.966+0000 7fd3cd466700 1 --2- 172.21.15.49:0/722549003 >> v2:172.21.15.115:3300/0 conn(0x7fd3c8063810 0x7fd3c80c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:28.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.966+0000 7fd3ce468700 1 -- 172.21.15.49:0/722549003 >> v2:172.21.15.115:3300/0 conn(0x7fd3c8063810 msgr2=0x7fd3c80c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:28.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.966+0000 7fd3ce468700 1 --2- 172.21.15.49:0/722549003 >> v2:172.21.15.115:3300/0 conn(0x7fd3c8063810 0x7fd3c80c5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:28.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.966+0000 7fd3ce468700 1 -- 172.21.15.49:0/722549003 >> v1:172.21.15.49:6789/0 conn(0x7fd3c8151100 legacy=0x7fd3c81559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:28.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.966+0000 7fd3ce468700 1 -- 172.21.15.49:0/722549003 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c80c4b90 con 0x7fd3c81514e0 2023-11-30T17:26:28.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.966+0000 7fd3ccc65700 1 -- 172.21.15.49:0/722549003 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 904827021 0 0) 0x7fd3c8151900 con 0x7fd3c8151100 2023-11-30T17:26:28.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.966+0000 7fd3ce468700 1 --2- 172.21.15.49:0/722549003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3c81514e0 0x7fd3c80bd670 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7fd3c8064220 tx=0x7fd3c0009780).ready entity=mon.0 client_cookie=ecde6959c8370579 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:28.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.966+0000 7fd3ccc65700 1 -- 172.21.15.49:0/722549003 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c000e070 con 0x7fd3c81514e0 2023-11-30T17:26:28.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.966+0000 7fd3ccc65700 1 -- 172.21.15.49:0/722549003 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c000bb60 con 0x7fd3c81514e0 2023-11-30T17:26:28.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.966+0000 7fd3ccc65700 1 -- 172.21.15.49:0/722549003 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0012410 con 0x7fd3c81514e0 2023-11-30T17:26:28.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.967+0000 7fd3cfecb700 1 -- 172.21.15.49:0/722549003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3c81514e0 msgr2=0x7fd3c80bd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:28.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.967+0000 7fd3cfecb700 1 --2- 172.21.15.49:0/722549003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3c81514e0 0x7fd3c80bd670 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7fd3c8064220 tx=0x7fd3c0009780).stop 2023-11-30T17:26:28.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.967+0000 7fd3cfecb700 1 -- 172.21.15.49:0/722549003 shutdown_connections 2023-11-30T17:26:28.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.967+0000 7fd3cfecb700 1 --2- 172.21.15.49:0/722549003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3c81514e0 0x7fd3c80bd670 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:28.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.967+0000 7fd3cfecb700 1 --2- 172.21.15.49:0/722549003 >> v2:172.21.15.115:3300/0 conn(0x7fd3c8063810 0x7fd3c80c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:28.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.967+0000 7fd3cfecb700 1 -- 172.21.15.49:0/722549003 >> 172.21.15.49:0/722549003 conn(0x7fd3c80c8170 msgr2=0x7fd3c80c41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:28.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.967+0000 7fd3cfecb700 1 -- 172.21.15.49:0/722549003 shutdown_connections 2023-11-30T17:26:28.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.967+0000 7fd3cfecb700 1 -- 172.21.15.49:0/722549003 wait complete. 2023-11-30T17:26:28.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.969+0000 7fd3cfecb700 1 Processor -- start 2023-11-30T17:26:28.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.969+0000 7fd3cfecb700 1 -- start start 2023-11-30T17:26:28.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.970+0000 7fd3cfecb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3c8063810 0x7fd3c80a7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:28.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.970+0000 7fd3cfecb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3c8151100 0x7fd3c80c0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:28.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.970+0000 7fd3cfecb700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3c81514e0 0x7fd3c81666a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:28.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.970+0000 7fd3cfecb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c80a7660 con 0x7fd3c8063810 2023-11-30T17:26:28.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.970+0000 7fd3cfecb700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c8139a10 con 0x7fd3c81514e0 2023-11-30T17:26:28.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.970+0000 7fd3cfecb700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c80bf880 con 0x7fd3c8151100 2023-11-30T17:26:28.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.970+0000 7fd3cdc67700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3c8063810 0x7fd3c80a7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:28.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.970+0000 7fd3cdc67700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3c8063810 0x7fd3c80a7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36840/0 (socket says 172.21.15.49:36840) 2023-11-30T17:26:28.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.970+0000 7fd3cdc67700 1 -- 172.21.15.49:0/3082687919 learned_addr learned my addr 172.21.15.49:0/3082687919 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:28.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.970+0000 7fd3cd466700 1 --2- 172.21.15.49:0/3082687919 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3c8151100 0x7fd3c80c0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:28.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.970+0000 7fd3ce468700 1 --2- 172.21.15.49:0/3082687919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3c81514e0 0x7fd3c81666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:28.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.970+0000 7fd3cdc67700 1 -- 172.21.15.49:0/3082687919 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3c8151100 msgr2=0x7fd3c80c0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:28.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.970+0000 7fd3cdc67700 1 --2- 172.21.15.49:0/3082687919 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3c8151100 0x7fd3c80c0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:28.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.970+0000 7fd3cdc67700 1 -- 172.21.15.49:0/3082687919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3c81514e0 msgr2=0x7fd3c81666a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:28.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.970+0000 7fd3cdc67700 1 --2- 172.21.15.49:0/3082687919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3c81514e0 0x7fd3c81666a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:28.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.971+0000 7fd3cdc67700 1 -- 172.21.15.49:0/3082687919 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c0009a20 con 0x7fd3c8063810 2023-11-30T17:26:28.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.971+0000 7fd3cdc67700 1 --2- 172.21.15.49:0/3082687919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3c8063810 0x7fd3c80a7170 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7fd3c400c510 tx=0x7fd3c4007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:28.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.971+0000 7fd3bdffb700 1 -- 172.21.15.49:0/3082687919 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c400ce80 con 0x7fd3c8063810 2023-11-30T17:26:28.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.971+0000 7fd3bdffb700 1 -- 172.21.15.49:0/3082687919 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c40072e0 con 0x7fd3c8063810 2023-11-30T17:26:28.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.971+0000 7fd3cfecb700 1 -- 172.21.15.49:0/3082687919 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c80bfb60 con 0x7fd3c8063810 2023-11-30T17:26:28.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.971+0000 7fd3bdffb700 1 -- 172.21.15.49:0/3082687919 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4007660 con 0x7fd3c8063810 2023-11-30T17:26:28.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.971+0000 7fd3cfecb700 1 -- 172.21.15.49:0/3082687919 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c80bf580 con 0x7fd3c8063810 2023-11-30T17:26:28.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.972+0000 7fd3cfecb700 1 -- 172.21.15.49:0/3082687919 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c80c0080 con 0x7fd3c8063810 2023-11-30T17:26:28.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.973+0000 7fd3bdffb700 1 -- 172.21.15.49:0/3082687919 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 59) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fd3c40059b0 con 0x7fd3c8063810 2023-11-30T17:26:28.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.973+0000 7fd3bdffb700 1 --2- 172.21.15.49:0/3082687919 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd3ac05f2c0 0x7fd3ac061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:28.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.973+0000 7fd3bdffb700 1 -- 172.21.15.49:0/3082687919 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fd3c4079ba0 con 0x7fd3c8063810 2023-11-30T17:26:28.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.973+0000 7fd3cd466700 1 -- 172.21.15.49:0/3082687919 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd3ac05f2c0 msgr2=0x7fd3ac061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:26:28.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.973+0000 7fd3cd466700 1 --2- 172.21.15.49:0/3082687919 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd3ac05f2c0 0x7fd3ac061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T17:26:28.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:28.981+0000 7fd3bdffb700 1 -- 172.21.15.49:0/3082687919 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd3c80c0080 con 0x7fd3c8063810 2023-11-30T17:26:29.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:29.174+0000 7fd3cd466700 1 -- 172.21.15.49:0/3082687919 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd3ac05f2c0 msgr2=0x7fd3ac061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:26:29.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:29.174+0000 7fd3cd466700 1 --2- 172.21.15.49:0/3082687919 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd3ac05f2c0 0x7fd3ac061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T17:26:29.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:29.188+0000 7fd3cfecb700 1 -- 172.21.15.49:0/3082687919 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3c80c0080 con 0x7fd3ac05f2c0 2023-11-30T17:26:29.479 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:29.477+0000 7efe3c265680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T17:26:29.552 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:29.550+0000 7efe3c265680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T17:26:29.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:29.575+0000 7fd3cd466700 1 -- 172.21.15.49:0/3082687919 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd3ac05f2c0 msgr2=0x7fd3ac061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:26:29.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:29.575+0000 7fd3cd466700 1 --2- 172.21.15.49:0/3082687919 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd3ac05f2c0 0x7fd3ac061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-11-30T17:26:29.591 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:29.589+0000 7f74a94d5680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T17:26:29.659 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:29.657+0000 7f74a94d5680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T17:26:29.737 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:29.735+0000 7efe3c265680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T17:26:29.853 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:29.851+0000 7f74a94d5680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T17:26:30.156 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:30.155+0000 7efe3c265680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T17:26:30.260 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:30.258+0000 7efe3c265680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:26:30.290 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:30.288+0000 7f74a94d5680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T17:26:30.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:30.376+0000 7fd3cd466700 1 -- 172.21.15.49:0/3082687919 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd3ac05f2c0 msgr2=0x7fd3ac061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:26:30.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:30.376+0000 7fd3cd466700 1 --2- 172.21.15.49:0/3082687919 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd3ac05f2c0 0x7fd3ac061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-11-30T17:26:30.398 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:30.396+0000 7f74a94d5680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:26:30.412 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:30.410+0000 7efe3c265680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T17:26:30.486 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:30.484+0000 7efe3c265680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T17:26:30.553 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:30.552+0000 7efe3c265680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T17:26:30.557 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:30.555+0000 7f74a94d5680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T17:26:30.635 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:30.632+0000 7f74a94d5680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T17:26:30.705 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:30.702+0000 7f74a94d5680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T17:26:30.808 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:30.807+0000 7efe3c265680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T17:26:30.976 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:30.973+0000 7f74a94d5680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T17:26:30.991 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:30.990+0000 7efe3c265680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T17:26:31.169 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:31.167+0000 7f74a94d5680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T17:26:31.641 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:31.639+0000 7efe3c265680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T17:26:31.709 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:31.707+0000 7efe3c265680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T17:26:31.783 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:31.781+0000 7efe3c265680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T17:26:31.852 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:31.850+0000 7f74a94d5680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T17:26:31.923 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:31.921+0000 7f74a94d5680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T17:26:31.927 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:31.925+0000 7efe3c265680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T17:26:31.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:31.979+0000 7fd3cd466700 1 -- 172.21.15.49:0/3082687919 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd3ac05f2c0 msgr2=0x7fd3ac061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T17:26:31.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:31.979+0000 7fd3cd466700 1 --2- 172.21.15.49:0/3082687919 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd3ac05f2c0 0x7fd3ac061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-11-30T17:26:31.997 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:31.995+0000 7efe3c265680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T17:26:32.001 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:31.999+0000 7f74a94d5680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T17:26:32.110 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:32.109+0000 7efe3c265680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T17:26:32.152 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:32.150+0000 7f74a94d5680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T17:26:32.219 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:32.217+0000 7efe3c265680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:26:32.224 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:32.223+0000 7f74a94d5680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T17:26:32.344 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:32.342+0000 7f74a94d5680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T17:26:32.457 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:32.455+0000 7f74a94d5680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T17:26:32.510 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:32.507+0000 7efe3c265680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T17:26:32.581 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:32.579+0000 7efe3c265680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T17:26:32.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:32.599+0000 7fd3bdffb700 1 -- 172.21.15.49:0/3082687919 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 60) v1 ==== 75287+0+0 (secure 0 0 0) 0x7fd3c4005ce0 con 0x7fd3c8063810 2023-11-30T17:26:32.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:32.600+0000 7fd3bdffb700 1 -- 172.21.15.49:0/3082687919 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd3ac05f2c0 msgr2=0x7fd3ac061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T17:26:32.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:32.600+0000 7fd3bdffb700 1 --2- 172.21.15.49:0/3082687919 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd3ac05f2c0 0x7fd3ac061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T17:26:32.659 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:32.657+0000 7efdb01ea700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:26:32.659 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:32.657+0000 7efdb01ea700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:26:32.659 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:32.657+0000 7efdb01ea700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:26:32.659 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:32.657+0000 7efdb01ea700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:26:32.659 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:32.657+0000 7efdb01ea700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:26:32.659 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:32.657+0000 7efdb39f1700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:26:32.659 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:32.657+0000 7efdb39f1700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:26:32.659 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:32.657+0000 7efdb39f1700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:26:32.660 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:32.657+0000 7efdb39f1700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:26:32.660 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:26:32.657+0000 7efdb39f1700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:26:32.762 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:32.761+0000 7f74a94d5680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T17:26:32.835 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T17:26:32.834+0000 7f74a94d5680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T17:26:33.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.603+0000 7fd3bdffb700 1 -- 172.21.15.49:0/3082687919 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mgrmap(e 61) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fd3c4077b30 con 0x7fd3c8063810 2023-11-30T17:26:33.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.603+0000 7fd3bdffb700 1 --2- 172.21.15.49:0/3082687919 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd3ac05f2c0 0x7fd3ac061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:33.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.603+0000 7fd3bdffb700 1 -- 172.21.15.49:0/3082687919 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3c80c0080 con 0x7fd3ac05f2c0 2023-11-30T17:26:33.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.604+0000 7fd3cd466700 1 --2- 172.21.15.49:0/3082687919 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd3ac05f2c0 0x7fd3ac061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:33.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.604+0000 7fd3cd466700 1 --2- 172.21.15.49:0/3082687919 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd3ac05f2c0 0x7fd3ac061700 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fd3c8150800 tx=0x7fd3b8009060).ready entity=mgr.6983 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:33.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.619+0000 7fd3bdffb700 1 -- 172.21.15.49:0/3082687919 <== mgr.6983 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7fd3c80c0080 con 0x7fd3ac05f2c0 2023-11-30T17:26:33.621 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule set for path /snap_test_dir1 2023-11-30T17:26:33.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.621+0000 7fd3cfecb700 1 -- 172.21.15.49:0/3082687919 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd3ac05f2c0 msgr2=0x7fd3ac061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:33.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.621+0000 7fd3cfecb700 1 --2- 172.21.15.49:0/3082687919 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd3ac05f2c0 0x7fd3ac061700 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fd3c8150800 tx=0x7fd3b8009060).stop 2023-11-30T17:26:33.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.622+0000 7fd3cfecb700 1 -- 172.21.15.49:0/3082687919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3c8063810 msgr2=0x7fd3c80a7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:33.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.622+0000 7fd3cfecb700 1 --2- 172.21.15.49:0/3082687919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3c8063810 0x7fd3c80a7170 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7fd3c400c510 tx=0x7fd3c4007c70).stop 2023-11-30T17:26:33.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.622+0000 7fd3cfecb700 1 -- 172.21.15.49:0/3082687919 shutdown_connections 2023-11-30T17:26:33.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.622+0000 7fd3cfecb700 1 --2- 172.21.15.49:0/3082687919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3c81514e0 0x7fd3c81666a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:33.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.622+0000 7fd3cfecb700 1 --2- 172.21.15.49:0/3082687919 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd3ac05f2c0 0x7fd3ac061700 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:33.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.622+0000 7fd3cfecb700 1 --2- 172.21.15.49:0/3082687919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3c8063810 0x7fd3c80a7170 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:33.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.622+0000 7fd3cfecb700 1 --2- 172.21.15.49:0/3082687919 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3c8151100 0x7fd3c80c0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:33.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.622+0000 7fd3cfecb700 1 -- 172.21.15.49:0/3082687919 >> 172.21.15.49:0/3082687919 conn(0x7fd3c80c8170 msgr2=0x7fd3c80c6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:33.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.622+0000 7fd3cfecb700 1 -- 172.21.15.49:0/3082687919 shutdown_connections 2023-11-30T17:26:33.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.622+0000 7fd3cfecb700 1 -- 172.21.15.49:0/3082687919 wait complete. 2023-11-30T17:26:33.636 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1 2023-11-30T17:26:33.636 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs /snap_test_dir1 55n 2023-11-30T17:26:33.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.762+0000 7fe594fd1700 1 Processor -- start 2023-11-30T17:26:33.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.762+0000 7fe594fd1700 1 -- start start 2023-11-30T17:26:33.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.762+0000 7fe594fd1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe590158160 0x7fe5900a8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:33.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.763+0000 7fe594fd1700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe59014e600 0x7fe59014ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:33.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.763+0000 7fe594fd1700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe590067770 con 0x7fe5900a8280 2023-11-30T17:26:33.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.763+0000 7fe594fd1700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe590159180 con 0x7fe59014e600 2023-11-30T17:26:33.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.763+0000 7fe594fd1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5900be8d0 con 0x7fe590158160 2023-11-30T17:26:33.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.763+0000 7fe58e59c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe5900a8280 0x7fe590155500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36414/0 (socket says 172.21.15.49:36414) 2023-11-30T17:26:33.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.763+0000 7fe58e59c700 1 -- 172.21.15.49:0/2079015749 learned_addr learned my addr 172.21.15.49:0/2079015749 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:33.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.763+0000 7fe58ed9d700 1 --2- 172.21.15.49:0/2079015749 >> v2:172.21.15.115:3300/0 conn(0x7fe59014e600 0x7fe59014ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:33.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.763+0000 7fe58dd9b700 1 --2- 172.21.15.49:0/2079015749 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe590158160 0x7fe5900a8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:33.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.763+0000 7fe58d59a700 1 -- 172.21.15.49:0/2079015749 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1135261836 0 0) 0x7fe590067770 con 0x7fe5900a8280 2023-11-30T17:26:33.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.763+0000 7fe58d59a700 1 -- 172.21.15.49:0/2079015749 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe57c0033f0 con 0x7fe5900a8280 2023-11-30T17:26:33.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.763+0000 7fe58d59a700 1 -- 172.21.15.49:0/2079015749 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2701706165 0 0) 0x7fe57c0033f0 con 0x7fe5900a8280 2023-11-30T17:26:33.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.763+0000 7fe58d59a700 1 -- 172.21.15.49:0/2079015749 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe590158160 msgr2=0x7fe5900a8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:33.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.763+0000 7fe58d59a700 1 --2- 172.21.15.49:0/2079015749 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe590158160 0x7fe5900a8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:33.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.763+0000 7fe58d59a700 1 -- 172.21.15.49:0/2079015749 >> v2:172.21.15.115:3300/0 conn(0x7fe59014e600 msgr2=0x7fe59014ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:33.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.763+0000 7fe58d59a700 1 --2- 172.21.15.49:0/2079015749 >> v2:172.21.15.115:3300/0 conn(0x7fe59014e600 0x7fe59014ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:33.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.763+0000 7fe58d59a700 1 -- 172.21.15.49:0/2079015749 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe590158600 con 0x7fe5900a8280 2023-11-30T17:26:33.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.763+0000 7fe58d59a700 1 -- 172.21.15.49:0/2079015749 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fe588001470 con 0x7fe5900a8280 2023-11-30T17:26:33.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.763+0000 7fe58d59a700 1 -- 172.21.15.49:0/2079015749 >> v1:172.21.15.49:6789/0 conn(0x7fe5900a8280 legacy=0x7fe590155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:33.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.763+0000 7fe58d59a700 1 --2- 172.21.15.49:0/2079015749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe57c0038e0 0x7fe57c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:33.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.763+0000 7fe58d59a700 1 --2- 172.21.15.49:0/2079015749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe57c004690 0x7fe57c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:33.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.763+0000 7fe58d59a700 1 --2- 172.21.15.49:0/2079015749 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe590158160 0x7fe57c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:33.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.763+0000 7fe58d59a700 1 -- 172.21.15.49:0/2079015749 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe590159180 con 0x7fe57c0038e0 2023-11-30T17:26:33.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.763+0000 7fe58d59a700 1 -- 172.21.15.49:0/2079015749 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5900be8d0 con 0x7fe57c004690 2023-11-30T17:26:33.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.763+0000 7fe58d59a700 1 -- 172.21.15.49:0/2079015749 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c00b8e0 con 0x7fe590158160 2023-11-30T17:26:33.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.763+0000 7fe58e59c700 1 --2- 172.21.15.49:0/2079015749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe57c0038e0 0x7fe57c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:33.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.764+0000 7fe58dd9b700 1 --2- 172.21.15.49:0/2079015749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe57c004690 0x7fe57c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:33.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.764+0000 7fe58ed9d700 1 --2- 172.21.15.49:0/2079015749 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe590158160 0x7fe57c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:33.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.764+0000 7fe58e59c700 1 -- 172.21.15.49:0/2079015749 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe590158160 msgr2=0x7fe57c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:33.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.764+0000 7fe58e59c700 1 --2- 172.21.15.49:0/2079015749 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe590158160 0x7fe57c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:33.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.764+0000 7fe58e59c700 1 -- 172.21.15.49:0/2079015749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe57c004690 msgr2=0x7fe57c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:33.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.764+0000 7fe58e59c700 1 --2- 172.21.15.49:0/2079015749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe57c004690 0x7fe57c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:33.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.764+0000 7fe58e59c700 1 -- 172.21.15.49:0/2079015749 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57c0033f0 con 0x7fe57c0038e0 2023-11-30T17:26:33.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.764+0000 7fe58e59c700 1 --2- 172.21.15.49:0/2079015749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe57c0038e0 0x7fe57c003d00 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7fe58800c210 tx=0x7fe588001e90).ready entity=mon.0 client_cookie=55bfb7c1e476cfe server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:33.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.764+0000 7fe58d59a700 1 -- 172.21.15.49:0/2079015749 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe588007a60 con 0x7fe57c0038e0 2023-11-30T17:26:33.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.764+0000 7fe58d59a700 1 -- 172.21.15.49:0/2079015749 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58800cae0 con 0x7fe57c0038e0 2023-11-30T17:26:33.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.764+0000 7fe58d59a700 1 -- 172.21.15.49:0/2079015749 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58800ce60 con 0x7fe57c0038e0 2023-11-30T17:26:33.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.765+0000 7fe594fd1700 1 -- 172.21.15.49:0/2079015749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe57c0038e0 msgr2=0x7fe57c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:33.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.765+0000 7fe594fd1700 1 --2- 172.21.15.49:0/2079015749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe57c0038e0 0x7fe57c003d00 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7fe58800c210 tx=0x7fe588001e90).stop 2023-11-30T17:26:33.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.765+0000 7fe58ed9d700 1 -- 172.21.15.49:0/2079015749 reap_dead start 2023-11-30T17:26:33.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.765+0000 7fe594fd1700 1 -- 172.21.15.49:0/2079015749 shutdown_connections 2023-11-30T17:26:33.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.765+0000 7fe594fd1700 1 -- 172.21.15.49:0/2079015749 >> 172.21.15.49:0/2079015749 conn(0x7fe590062700 msgr2=0x7fe590062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:33.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.765+0000 7fe594fd1700 1 -- 172.21.15.49:0/2079015749 shutdown_connections 2023-11-30T17:26:33.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.765+0000 7fe594fd1700 1 -- 172.21.15.49:0/2079015749 wait complete. 2023-11-30T17:26:33.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.766+0000 7fe594fd1700 1 Processor -- start 2023-11-30T17:26:33.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.766+0000 7fe594fd1700 1 -- start start 2023-11-30T17:26:33.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.767+0000 7fe594fd1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe57c0038e0 0x7fe59014ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:33.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.767+0000 7fe594fd1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5901560a0 0x7fe590156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:33.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.767+0000 7fe594fd1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe59014d830 0x7fe59014dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:33.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.767+0000 7fe594fd1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe590064700 con 0x7fe57c0038e0 2023-11-30T17:26:33.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.767+0000 7fe594fd1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59014e1a0 con 0x7fe59014d830 2023-11-30T17:26:33.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.767+0000 7fe594fd1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe590063810 con 0x7fe5901560a0 2023-11-30T17:26:33.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.767+0000 7fe58e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe57c0038e0 0x7fe59014ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:33.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.767+0000 7fe58e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe57c0038e0 0x7fe59014ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55218/0 (socket says 172.21.15.49:55218) 2023-11-30T17:26:33.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.767+0000 7fe58e59c700 1 -- 172.21.15.49:0/1154516192 learned_addr learned my addr 172.21.15.49:0/1154516192 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:33.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.767+0000 7fe58ed9d700 1 --2- 172.21.15.49:0/1154516192 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe59014d830 0x7fe59014dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:33.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.767+0000 7fe58dd9b700 1 --2- 172.21.15.49:0/1154516192 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5901560a0 0x7fe590156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:33.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.767+0000 7fe58e59c700 1 -- 172.21.15.49:0/1154516192 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5901560a0 msgr2=0x7fe590156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:33.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.767+0000 7fe58e59c700 1 --2- 172.21.15.49:0/1154516192 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5901560a0 0x7fe590156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:33.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.767+0000 7fe58e59c700 1 -- 172.21.15.49:0/1154516192 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe59014d830 msgr2=0x7fe59014dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:33.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.767+0000 7fe58e59c700 1 --2- 172.21.15.49:0/1154516192 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe59014d830 0x7fe59014dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:33.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.767+0000 7fe58e59c700 1 -- 172.21.15.49:0/1154516192 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe590063af0 con 0x7fe57c0038e0 2023-11-30T17:26:33.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.767+0000 7fe58e59c700 1 --2- 172.21.15.49:0/1154516192 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe57c0038e0 0x7fe59014ae00 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7fe588001ed0 tx=0x7fe588015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:33.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.767+0000 7fe5867fc700 1 -- 172.21.15.49:0/1154516192 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5880074f0 con 0x7fe57c0038e0 2023-11-30T17:26:33.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.767+0000 7fe5867fc700 1 -- 172.21.15.49:0/1154516192 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe588007670 con 0x7fe57c0038e0 2023-11-30T17:26:33.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.767+0000 7fe5867fc700 1 -- 172.21.15.49:0/1154516192 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe588004900 con 0x7fe57c0038e0 2023-11-30T17:26:33.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.767+0000 7fe594fd1700 1 -- 172.21.15.49:0/1154516192 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe590063dd0 con 0x7fe57c0038e0 2023-11-30T17:26:33.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.767+0000 7fe594fd1700 1 -- 172.21.15.49:0/1154516192 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe590064390 con 0x7fe57c0038e0 2023-11-30T17:26:33.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.768+0000 7fe594fd1700 1 -- 172.21.15.49:0/1154516192 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5900649e0 con 0x7fe57c0038e0 2023-11-30T17:26:33.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.769+0000 7fe5867fc700 1 -- 172.21.15.49:0/1154516192 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 61) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fe588004cb0 con 0x7fe57c0038e0 2023-11-30T17:26:33.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.769+0000 7fe5867fc700 1 --2- 172.21.15.49:0/1154516192 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe57005f080 0x7fe570061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:33.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.769+0000 7fe5867fc700 1 -- 172.21.15.49:0/1154516192 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6435+0+0 (secure 0 0 0) 0x7fe58807ac00 con 0x7fe57c0038e0 2023-11-30T17:26:33.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.769+0000 7fe58dd9b700 1 --2- 172.21.15.49:0/1154516192 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe57005f080 0x7fe570061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:33.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.769+0000 7fe58dd9b700 1 --2- 172.21.15.49:0/1154516192 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe57005f080 0x7fe570061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fe590096dd0 tx=0x7fe578009060).ready entity=mgr.6983 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:33.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.773+0000 7fe5867fc700 1 -- 172.21.15.49:0/1154516192 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe588080020 con 0x7fe57c0038e0 2023-11-30T17:26:33.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.972+0000 7fe594fd1700 1 -- 172.21.15.49:0/1154516192 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/snap_test_dir1", "retention_spec_or_period": "55n", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5900c8a70 con 0x7fe57005f080 2023-11-30T17:26:33.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.979+0000 7fe5867fc700 1 -- 172.21.15.49:0/1154516192 <== mgr.6983 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+40 (secure 0 0 0) 0x7fe5900c8a70 con 0x7fe57005f080 2023-11-30T17:26:33.981 INFO:teuthology.orchestra.run.smithi049.stdout:Retention added to path /snap_test_dir1 2023-11-30T17:26:33.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.981+0000 7fe594fd1700 1 -- 172.21.15.49:0/1154516192 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe57005f080 msgr2=0x7fe570061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:33.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.981+0000 7fe594fd1700 1 --2- 172.21.15.49:0/1154516192 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe57005f080 0x7fe570061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fe590096dd0 tx=0x7fe578009060).stop 2023-11-30T17:26:33.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.981+0000 7fe594fd1700 1 -- 172.21.15.49:0/1154516192 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe57c0038e0 msgr2=0x7fe59014ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:33.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.981+0000 7fe594fd1700 1 --2- 172.21.15.49:0/1154516192 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe57c0038e0 0x7fe59014ae00 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7fe588001ed0 tx=0x7fe588015000).stop 2023-11-30T17:26:33.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.981+0000 7fe594fd1700 1 -- 172.21.15.49:0/1154516192 shutdown_connections 2023-11-30T17:26:33.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.981+0000 7fe594fd1700 1 --2- 172.21.15.49:0/1154516192 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe59014d830 0x7fe59014dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:33.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.981+0000 7fe594fd1700 1 --2- 172.21.15.49:0/1154516192 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe57005f080 0x7fe570061540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:33.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.981+0000 7fe594fd1700 1 --2- 172.21.15.49:0/1154516192 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe57c0038e0 0x7fe59014ae00 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:33.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.981+0000 7fe594fd1700 1 --2- 172.21.15.49:0/1154516192 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5901560a0 0x7fe590156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:33.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.981+0000 7fe594fd1700 1 -- 172.21.15.49:0/1154516192 >> 172.21.15.49:0/1154516192 conn(0x7fe590062700 msgr2=0x7fe5900a75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:33.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.981+0000 7fe594fd1700 1 -- 172.21.15.49:0/1154516192 shutdown_connections 2023-11-30T17:26:33.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:33.981+0000 7fe594fd1700 1 -- 172.21.15.49:0/1154516192 wait complete. 2023-11-30T17:26:33.994 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path /snap_test_dir1 2023-11-30T17:26:33.995 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2023-11-30T17:26:33.995 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json /snap_test_dir1 2023-11-30T17:26:34.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.114+0000 7efc0e1bc700 1 Processor -- start 2023-11-30T17:26:34.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.114+0000 7efc0e1bc700 1 -- start start 2023-11-30T17:26:34.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.115+0000 7efc0e1bc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efc08154610 0x7efc081582e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:34.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.115+0000 7efc0e1bc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc080aa1c0 0x7efc080aa600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:34.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.115+0000 7efc0e1bc700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc08159210 con 0x7efc080ab3b0 2023-11-30T17:26:34.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.115+0000 7efc0e1bc700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc080c0c70 con 0x7efc08154610 2023-11-30T17:26:34.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.115+0000 7efc0e1bc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc080c2110 con 0x7efc080aa1c0 2023-11-30T17:26:34.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.115+0000 7efc06ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7efc080ab3b0 0x7efc080c80c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36422/0 (socket says 172.21.15.49:36422) 2023-11-30T17:26:34.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.115+0000 7efc06ffd700 1 -- 172.21.15.49:0/1858213807 learned_addr learned my addr 172.21.15.49:0/1858213807 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T17:26:34.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.115+0000 7efc07fff700 1 --2- 172.21.15.49:0/1858213807 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc080aa1c0 0x7efc080aa600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:34.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.115+0000 7efc077fe700 1 --2- 172.21.15.49:0/1858213807 >> v2:172.21.15.115:3300/0 conn(0x7efc08154610 0x7efc081582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:34.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.116+0000 7efc067fc700 1 -- 172.21.15.49:0/1858213807 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4012716965 0 0) 0x7efc08159210 con 0x7efc080ab3b0 2023-11-30T17:26:34.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.116+0000 7efc067fc700 1 -- 172.21.15.49:0/1858213807 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbf00033f0 con 0x7efc080ab3b0 2023-11-30T17:26:34.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.116+0000 7efc067fc700 1 -- 172.21.15.49:0/1858213807 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1205402317 0 0) 0x7efbf00033f0 con 0x7efc080ab3b0 2023-11-30T17:26:34.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.116+0000 7efc067fc700 1 -- 172.21.15.49:0/1858213807 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc080aa1c0 msgr2=0x7efc080aa600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:34.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.116+0000 7efc067fc700 1 --2- 172.21.15.49:0/1858213807 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc080aa1c0 0x7efc080aa600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:34.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.116+0000 7efc067fc700 1 -- 172.21.15.49:0/1858213807 >> v2:172.21.15.115:3300/0 conn(0x7efc08154610 msgr2=0x7efc081582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:34.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.116+0000 7efc067fc700 1 --2- 172.21.15.49:0/1858213807 >> v2:172.21.15.115:3300/0 conn(0x7efc08154610 0x7efc081582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:34.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.116+0000 7efc067fc700 1 -- 172.21.15.49:0/1858213807 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc080aaaf0 con 0x7efc080ab3b0 2023-11-30T17:26:34.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.116+0000 7efc067fc700 1 -- 172.21.15.49:0/1858213807 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7efbfc001470 con 0x7efc080ab3b0 2023-11-30T17:26:34.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.116+0000 7efc067fc700 1 -- 172.21.15.49:0/1858213807 >> v1:172.21.15.49:6789/0 conn(0x7efc080ab3b0 legacy=0x7efc080c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:34.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.116+0000 7efc067fc700 1 --2- 172.21.15.49:0/1858213807 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc080aa1c0 0x7efbf00038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:34.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.116+0000 7efc067fc700 1 --2- 172.21.15.49:0/1858213807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efbf0003e10 0x7efbf0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:34.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.116+0000 7efc067fc700 1 --2- 172.21.15.49:0/1858213807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efbf0004b80 0x7efbf0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:34.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.116+0000 7efc067fc700 1 -- 172.21.15.49:0/1858213807 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc080c0c70 con 0x7efbf0004b80 2023-11-30T17:26:34.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.116+0000 7efc067fc700 1 -- 172.21.15.49:0/1858213807 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc080c2110 con 0x7efbf0003e10 2023-11-30T17:26:34.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.116+0000 7efc067fc700 1 -- 172.21.15.49:0/1858213807 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf000b8e0 con 0x7efc080aa1c0 2023-11-30T17:26:34.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.116+0000 7efc07fff700 1 --2- 172.21.15.49:0/1858213807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efbf0004b80 0x7efbf0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:34.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.116+0000 7efc077fe700 1 --2- 172.21.15.49:0/1858213807 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc080aa1c0 0x7efbf00038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:34.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.116+0000 7efc06ffd700 1 --2- 172.21.15.49:0/1858213807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efbf0003e10 0x7efbf0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:34.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.116+0000 7efc07fff700 1 -- 172.21.15.49:0/1858213807 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc080aa1c0 msgr2=0x7efbf00038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:34.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.116+0000 7efc07fff700 1 --2- 172.21.15.49:0/1858213807 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc080aa1c0 0x7efbf00038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:34.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.116+0000 7efc07fff700 1 -- 172.21.15.49:0/1858213807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efbf0003e10 msgr2=0x7efbf0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T17:26:34.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.116+0000 7efc07fff700 1 --2- 172.21.15.49:0/1858213807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efbf0003e10 0x7efbf0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:34.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.116+0000 7efc07fff700 1 -- 172.21.15.49:0/1858213807 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf00033f0 con 0x7efbf0004b80 2023-11-30T17:26:34.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.116+0000 7efc07fff700 1 --2- 172.21.15.49:0/1858213807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efbf0004b80 0x7efbf0005000 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7efc0000e240 tx=0x7efc0000b040).ready entity=mon.0 client_cookie=6c31116ee21c8e4f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:34.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.117+0000 7efc067fc700 1 -- 172.21.15.49:0/1858213807 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc00009ac0 con 0x7efbf0004b80 2023-11-30T17:26:34.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.117+0000 7efc067fc700 1 -- 172.21.15.49:0/1858213807 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0000f040 con 0x7efbf0004b80 2023-11-30T17:26:34.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.117+0000 7efc067fc700 1 -- 172.21.15.49:0/1858213807 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0000ed00 con 0x7efbf0004b80 2023-11-30T17:26:34.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.117+0000 7efc0e1bc700 1 -- 172.21.15.49:0/1858213807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efbf0004b80 msgr2=0x7efbf0005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:34.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.117+0000 7efc0e1bc700 1 --2- 172.21.15.49:0/1858213807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efbf0004b80 0x7efbf0005000 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7efc0000e240 tx=0x7efc0000b040).stop 2023-11-30T17:26:34.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.117+0000 7efc07fff700 1 -- 172.21.15.49:0/1858213807 reap_dead start 2023-11-30T17:26:34.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.117+0000 7efc0e1bc700 1 -- 172.21.15.49:0/1858213807 shutdown_connections 2023-11-30T17:26:34.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.117+0000 7efc0e1bc700 1 -- 172.21.15.49:0/1858213807 >> 172.21.15.49:0/1858213807 conn(0x7efc080655a0 msgr2=0x7efc08069e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:34.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.117+0000 7efc0e1bc700 1 -- 172.21.15.49:0/1858213807 shutdown_connections 2023-11-30T17:26:34.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.117+0000 7efc0e1bc700 1 -- 172.21.15.49:0/1858213807 wait complete. 2023-11-30T17:26:34.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.118+0000 7efc0e1bc700 1 Processor -- start 2023-11-30T17:26:34.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.119+0000 7efc0e1bc700 1 -- start start 2023-11-30T17:26:34.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.119+0000 7efc0e1bc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc0814c3f0 0x7efc0814c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:34.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.119+0000 7efc0e1bc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc080ad360 0x7efc081549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:34.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.119+0000 7efc0e1bc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc08145d70 0x7efc081461d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:34.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.119+0000 7efc0e1bc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc08156850 con 0x7efc0814c3f0 2023-11-30T17:26:34.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.119+0000 7efc0e1bc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc08157820 con 0x7efc08145d70 2023-11-30T17:26:34.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.119+0000 7efc0e1bc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc080ad7e0 con 0x7efc080ad360 2023-11-30T17:26:34.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.119+0000 7efc077fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc0814c3f0 0x7efc0814c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:34.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.119+0000 7efc077fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc0814c3f0 0x7efc0814c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55226/0 (socket says 172.21.15.49:55226) 2023-11-30T17:26:34.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.119+0000 7efc077fe700 1 -- 172.21.15.49:0/2268294715 learned_addr learned my addr 172.21.15.49:0/2268294715 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T17:26:34.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.120+0000 7efc06ffd700 1 --2- 172.21.15.49:0/2268294715 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc080ad360 0x7efc081549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:34.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.120+0000 7efc077fe700 1 -- 172.21.15.49:0/2268294715 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc080ad360 msgr2=0x7efc081549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:34.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.120+0000 7efc077fe700 1 --2- 172.21.15.49:0/2268294715 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc080ad360 0x7efc081549f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:34.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.120+0000 7efc07fff700 1 --2- 172.21.15.49:0/2268294715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc08145d70 0x7efc081461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:34.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.120+0000 7efc077fe700 1 -- 172.21.15.49:0/2268294715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc08145d70 msgr2=0x7efc081461d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:34.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.120+0000 7efc077fe700 1 --2- 172.21.15.49:0/2268294715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc08145d70 0x7efc081461d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:34.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.120+0000 7efc077fe700 1 -- 172.21.15.49:0/2268294715 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc08154ee0 con 0x7efc0814c3f0 2023-11-30T17:26:34.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.120+0000 7efc077fe700 1 --2- 172.21.15.49:0/2268294715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc0814c3f0 0x7efc0814c7d0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7efbf80119f0 tx=0x7efbf8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:34.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.120+0000 7efbef7fe700 1 -- 172.21.15.49:0/2268294715 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf800f940 con 0x7efc0814c3f0 2023-11-30T17:26:34.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.120+0000 7efbef7fe700 1 -- 172.21.15.49:0/2268294715 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf800faa0 con 0x7efc0814c3f0 2023-11-30T17:26:34.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.120+0000 7efc0e1bc700 1 -- 172.21.15.49:0/2268294715 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc08156a60 con 0x7efc0814c3f0 2023-11-30T17:26:34.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.120+0000 7efbef7fe700 1 -- 172.21.15.49:0/2268294715 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf800fe20 con 0x7efc0814c3f0 2023-11-30T17:26:34.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.120+0000 7efc0e1bc700 1 -- 172.21.15.49:0/2268294715 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc08157020 con 0x7efc0814c3f0 2023-11-30T17:26:34.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.121+0000 7efc0e1bc700 1 -- 172.21.15.49:0/2268294715 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc0806c860 con 0x7efc0814c3f0 2023-11-30T17:26:34.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.121+0000 7efbef7fe700 1 -- 172.21.15.49:0/2268294715 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 61) v1 ==== 75357+0+0 (secure 0 0 0) 0x7efbf8014650 con 0x7efc0814c3f0 2023-11-30T17:26:34.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.122+0000 7efbef7fe700 1 --2- 172.21.15.49:0/2268294715 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efbf405f0b0 0x7efbf4061570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T17:26:34.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.122+0000 7efbef7fe700 1 -- 172.21.15.49:0/2268294715 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6435+0+0 (secure 0 0 0) 0x7efbf807ac60 con 0x7efc0814c3f0 2023-11-30T17:26:34.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.122+0000 7efc06ffd700 1 --2- 172.21.15.49:0/2268294715 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efbf405f0b0 0x7efbf4061570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T17:26:34.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.122+0000 7efc06ffd700 1 --2- 172.21.15.49:0/2268294715 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efbf405f0b0 0x7efbf4061570 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7efbfc007860 tx=0x7efbfc009040).ready entity=mgr.6983 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T17:26:34.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.126+0000 7efbef7fe700 1 -- 172.21.15.49:0/2268294715 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efbf804bfc0 con 0x7efc0814c3f0 2023-11-30T17:26:34.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.325+0000 7efc0e1bc700 1 -- 172.21.15.49:0/2268294715 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efc08158970 con 0x7efbf405f0b0 2023-11-30T17:26:34.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.327+0000 7efbef7fe700 1 -- 172.21.15.49:0/2268294715 <== mgr.6983 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+74 (secure 0 0 0) 0x7efc08158970 con 0x7efbf405f0b0 2023-11-30T17:26:34.329 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T17:26:34.329 INFO:teuthology.orchestra.run.smithi049.stdout:{"path": "/snap_test_dir1", "schedule": ["1M"], "retention": [{"n": 55}]} 2023-11-30T17:26:34.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.329+0000 7efc0e1bc700 1 -- 172.21.15.49:0/2268294715 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efbf405f0b0 msgr2=0x7efbf4061570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:34.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.329+0000 7efc0e1bc700 1 --2- 172.21.15.49:0/2268294715 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efbf405f0b0 0x7efbf4061570 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7efbfc007860 tx=0x7efbfc009040).stop 2023-11-30T17:26:34.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.329+0000 7efc0e1bc700 1 -- 172.21.15.49:0/2268294715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc0814c3f0 msgr2=0x7efc0814c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T17:26:34.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.329+0000 7efc0e1bc700 1 --2- 172.21.15.49:0/2268294715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc0814c3f0 0x7efc0814c7d0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7efbf80119f0 tx=0x7efbf8009060).stop 2023-11-30T17:26:34.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.329+0000 7efc0e1bc700 1 -- 172.21.15.49:0/2268294715 shutdown_connections 2023-11-30T17:26:34.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.329+0000 7efc0e1bc700 1 --2- 172.21.15.49:0/2268294715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc08145d70 0x7efc081461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:34.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.329+0000 7efc0e1bc700 1 --2- 172.21.15.49:0/2268294715 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7efbf405f0b0 0x7efbf4061570 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:34.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.329+0000 7efc0e1bc700 1 --2- 172.21.15.49:0/2268294715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc0814c3f0 0x7efc0814c7d0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:34.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.329+0000 7efc0e1bc700 1 --2- 172.21.15.49:0/2268294715 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc080ad360 0x7efc081549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T17:26:34.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.329+0000 7efc0e1bc700 1 -- 172.21.15.49:0/2268294715 >> 172.21.15.49:0/2268294715 conn(0x7efc080655a0 msgr2=0x7efc080c9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T17:26:34.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.329+0000 7efc0e1bc700 1 -- 172.21.15.49:0/2268294715 shutdown_connections 2023-11-30T17:26:34.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T17:26:34.329+0000 7efc0e1bc700 1 -- 172.21.15.49:0/2268294715 wait complete. 2023-11-30T17:26:34.343 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "/snap_test_dir1", "schedule": ["1M"], "retention": [{"n": 55}]} 2023-11-30T17:26:34.345 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': '/snap_test_dir1', 'schedule': ['1M'], 'retention': [{'n': 55}]} 2023-11-30T17:26:52.299 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:26:52.302 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:27:00.985 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:27:00.982+0000 7efda29cf700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:27:00.985 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:27:00.982+0000 7efda29cf700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:27:00.985 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:27:00.982+0000 7efda29cf700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:27:00.985 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:27:00.982+0000 7efda29cf700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:27:00.985 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T17:27:00.982+0000 7efda29cf700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T17:27:22.452 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:27:22.455 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:27:52.571 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:27:52.575 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:28:22.708 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:28:22.711 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:28:52.770 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:28:52.774 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:29:22.898 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:29:22.902 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:29:53.036 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:29:53.039 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:30:23.222 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:30:23.225 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:30:53.282 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:30:53.286 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:31:23.370 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:31:23.374 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:31:53.505 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:31:53.509 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:32:23.616 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:32:23.619 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:32:53.745 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:32:53.748 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:33:23.891 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:33:23.895 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:33:54.020 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:33:54.022 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:34:24.081 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:34:24.084 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:34:54.225 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:34:54.229 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:35:24.379 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:35:24.383 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:35:54.522 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:35:54.526 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:36:24.651 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:36:24.654 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:36:54.804 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:36:54.807 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:37:24.948 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:37:24.951 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:37:55.076 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:37:55.081 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:38:25.205 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:38:25.209 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:38:55.340 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:38:55.343 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:39:25.485 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:39:25.488 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:39:55.547 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:39:55.550 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:40:25.709 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:40:25.713 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:40:55.837 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:40:55.840 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:41:25.939 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:41:25.943 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:41:56.084 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:41:56.088 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:42:26.212 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:42:26.215 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:42:56.289 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:42:56.292 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:43:26.443 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:43:26.446 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:43:56.530 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:43:56.533 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:44:26.674 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:44:26.677 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:44:56.794 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:44:56.798 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:45:26.938 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:45:26.942 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:45:57.082 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:45:57.086 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:46:27.210 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:46:27.214 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:46:57.363 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:46:57.366 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:47:27.500 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:47:27.503 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:47:57.577 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:47:57.580 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:48:27.722 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:48:27.726 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:48:57.876 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:48:57.879 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:49:28.020 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:49:28.024 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:49:58.089 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:49:58.092 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:50:28.200 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:50:28.204 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:50:58.265 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:50:58.268 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:51:28.328 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:51:28.332 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:51:58.468 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:51:58.472 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:52:28.613 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:52:28.617 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:52:58.707 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:52:58.711 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:53:28.814 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:53:28.817 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:53:58.955 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:53:58.958 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:54:29.033 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:54:29.036 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:54:59.178 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:54:59.181 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:55:29.330 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:55:29.333 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:55:59.391 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:55:59.395 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:56:29.545 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:56:29.549 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:56:59.666 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:56:59.670 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:57:29.786 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:57:29.789 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:57:59.878 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:57:59.882 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:58:30.015 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:58:30.021 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:59:00.083 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:59:00.087 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:59:30.145 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T17:59:30.149 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:00:00.209 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:00:00.212 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:00:30.360 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:00:30.363 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:01:00.497 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:01:00.500 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:01:30.649 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:01:30.653 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:02:00.720 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:02:00.723 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:02:30.830 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:02:30.833 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:03:00.933 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:03:00.937 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:03:31.077 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:03:31.081 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:04:01.138 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:04:01.142 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:04:31.276 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:04:31.280 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:05:01.421 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:05:01.424 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:05:31.549 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:05:31.552 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:06:01.651 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:06:01.655 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:06:31.771 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:06:31.775 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:07:01.882 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:07:01.885 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:07:31.986 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:07:31.989 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:08:02.055 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:08:02.059 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:08:32.123 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:08:32.126 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:09:02.237 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:09:02.240 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:09:32.323 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:09:32.326 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:10:02.461 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:10:02.465 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:10:32.614 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:10:32.618 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:11:02.725 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:11:02.729 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:11:32.863 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:11:32.866 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:12:02.938 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:12:02.942 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:12:33.092 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:12:33.095 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:13:03.187 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:13:03.190 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:13:33.341 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:13:33.344 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:14:03.407 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:14:03.410 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:14:33.555 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:14:33.558 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:15:03.708 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:15:03.711 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:15:33.845 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:15:33.848 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:16:03.956 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:16:03.959 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:16:34.017 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:16:34.020 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:17:04.087 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:17:04.090 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:17:34.158 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:17:34.161 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:18:04.227 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:18:04.230 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:18:34.290 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:18:34.294 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:19:04.369 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:19:04.372 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:19:34.434 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:19:34.437 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:20:04.498 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:20:04.501 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:20:34.568 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:20:34.571 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:21:04.630 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:21:04.633 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:21:34.775 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:21:34.778 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:22:04.902 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:22:04.905 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:22:16.346 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:16.347 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:22:16.370 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_28_00_UTC 2023-11-30T18:22:16.370 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_29_00_UTC 2023-11-30T18:22:16.370 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_30_00_UTC 2023-11-30T18:22:16.370 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_31_00_UTC 2023-11-30T18:22:16.370 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_32_00_UTC 2023-11-30T18:22:16.370 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_33_00_UTC 2023-11-30T18:22:16.370 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_34_00_UTC 2023-11-30T18:22:16.371 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_35_00_UTC 2023-11-30T18:22:16.371 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_36_00_UTC 2023-11-30T18:22:16.371 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_37_00_UTC 2023-11-30T18:22:16.371 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_38_00_UTC 2023-11-30T18:22:16.371 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_39_00_UTC 2023-11-30T18:22:16.371 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_40_00_UTC 2023-11-30T18:22:16.371 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_41_00_UTC 2023-11-30T18:22:16.371 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_42_00_UTC 2023-11-30T18:22:16.371 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_43_00_UTC 2023-11-30T18:22:16.371 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_44_00_UTC 2023-11-30T18:22:16.371 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_45_00_UTC 2023-11-30T18:22:16.371 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_46_00_UTC 2023-11-30T18:22:16.371 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_47_00_UTC 2023-11-30T18:22:16.371 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_48_00_UTC 2023-11-30T18:22:16.372 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_49_00_UTC 2023-11-30T18:22:16.372 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_50_00_UTC 2023-11-30T18:22:16.372 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_51_00_UTC 2023-11-30T18:22:16.372 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_52_00_UTC 2023-11-30T18:22:16.372 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_53_00_UTC 2023-11-30T18:22:16.372 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_54_00_UTC 2023-11-30T18:22:16.372 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_55_00_UTC 2023-11-30T18:22:16.372 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_56_00_UTC 2023-11-30T18:22:16.373 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_57_00_UTC 2023-11-30T18:22:16.373 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_58_00_UTC 2023-11-30T18:22:16.373 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_59_00_UTC 2023-11-30T18:22:16.373 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_00_00_UTC 2023-11-30T18:22:16.373 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_01_00_UTC 2023-11-30T18:22:16.373 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_02_00_UTC 2023-11-30T18:22:16.373 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_03_00_UTC 2023-11-30T18:22:16.373 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_04_00_UTC 2023-11-30T18:22:16.373 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_05_00_UTC 2023-11-30T18:22:16.373 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_06_00_UTC 2023-11-30T18:22:16.373 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_07_00_UTC 2023-11-30T18:22:16.373 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_08_00_UTC 2023-11-30T18:22:16.373 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_09_00_UTC 2023-11-30T18:22:16.373 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_10_00_UTC 2023-11-30T18:22:16.373 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_11_00_UTC 2023-11-30T18:22:16.374 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_12_00_UTC 2023-11-30T18:22:16.374 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_13_00_UTC 2023-11-30T18:22:16.374 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_14_00_UTC 2023-11-30T18:22:16.374 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_15_00_UTC 2023-11-30T18:22:16.374 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_16_00_UTC 2023-11-30T18:22:16.374 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_17_00_UTC 2023-11-30T18:22:16.374 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_18_00_UTC 2023-11-30T18:22:16.374 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_19_00_UTC 2023-11-30T18:22:16.374 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_20_00_UTC 2023-11-30T18:22:16.374 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_21_00_UTC 2023-11-30T18:22:16.374 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_22_00_UTC 2023-11-30T18:22:16.374 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-11-30-17_28_00_UTC', 'scheduled-2023-11-30-17_29_00_UTC', 'scheduled-2023-11-30-17_30_00_UTC', 'scheduled-2023-11-30-17_31_00_UTC', 'scheduled-2023-11-30-17_32_00_UTC', 'scheduled-2023-11-30-17_33_00_UTC', 'scheduled-2023-11-30-17_34_00_UTC', 'scheduled-2023-11-30-17_35_00_UTC', 'scheduled-2023-11-30-17_36_00_UTC', 'scheduled-2023-11-30-17_37_00_UTC', 'scheduled-2023-11-30-17_38_00_UTC', 'scheduled-2023-11-30-17_39_00_UTC', 'scheduled-2023-11-30-17_40_00_UTC', 'scheduled-2023-11-30-17_41_00_UTC', 'scheduled-2023-11-30-17_42_00_UTC', 'scheduled-2023-11-30-17_43_00_UTC', 'scheduled-2023-11-30-17_44_00_UTC', 'scheduled-2023-11-30-17_45_00_UTC', 'scheduled-2023-11-30-17_46_00_UTC', 'scheduled-2023-11-30-17_47_00_UTC', 'scheduled-2023-11-30-17_48_00_UTC', 'scheduled-2023-11-30-17_49_00_UTC', 'scheduled-2023-11-30-17_50_00_UTC', 'scheduled-2023-11-30-17_51_00_UTC', 'scheduled-2023-11-30-17_52_00_UTC', 'scheduled-2023-11-30-17_53_00_UTC', 'scheduled-2023-11-30-17_54_00_UTC', 'scheduled-2023-11-30-17_55_00_UTC', 'scheduled-2023-11-30-17_56_00_UTC', 'scheduled-2023-11-30-17_57_00_UTC', 'scheduled-2023-11-30-17_58_00_UTC', 'scheduled-2023-11-30-17_59_00_UTC', 'scheduled-2023-11-30-18_00_00_UTC', 'scheduled-2023-11-30-18_01_00_UTC', 'scheduled-2023-11-30-18_02_00_UTC', 'scheduled-2023-11-30-18_03_00_UTC', 'scheduled-2023-11-30-18_04_00_UTC', 'scheduled-2023-11-30-18_05_00_UTC', 'scheduled-2023-11-30-18_06_00_UTC', 'scheduled-2023-11-30-18_07_00_UTC', 'scheduled-2023-11-30-18_08_00_UTC', 'scheduled-2023-11-30-18_09_00_UTC', 'scheduled-2023-11-30-18_10_00_UTC', 'scheduled-2023-11-30-18_11_00_UTC', 'scheduled-2023-11-30-18_12_00_UTC', 'scheduled-2023-11-30-18_13_00_UTC', 'scheduled-2023-11-30-18_14_00_UTC', 'scheduled-2023-11-30-18_15_00_UTC', 'scheduled-2023-11-30-18_16_00_UTC', 'scheduled-2023-11-30-18_17_00_UTC', 'scheduled-2023-11-30-18_18_00_UTC', 'scheduled-2023-11-30-18_19_00_UTC', 'scheduled-2023-11-30-18_20_00_UTC', 'scheduled-2023-11-30-18_21_00_UTC', 'scheduled-2023-11-30-18_22_00_UTC'] 2023-11-30T18:22:16.375 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1 2023-11-30T18:22:16.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.540+0000 7fab45c1f700 1 Processor -- start 2023-11-30T18:22:16.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.540+0000 7fab45c1f700 1 -- start start 2023-11-30T18:22:16.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.541+0000 7fab45c1f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab400aa930 0x7fab400a7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:16.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.541+0000 7fab45c1f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab400c6630 con 0x7fab40154910 2023-11-30T18:22:16.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.541+0000 7fab45c1f700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab40064230 con 0x7fab40154530 2023-11-30T18:22:16.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.541+0000 7fab45c1f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab400c6390 con 0x7fab400aa930 2023-11-30T18:22:16.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.541+0000 7fab3effd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fab40154910 0x7fab400aa220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58786/0 (socket says 172.21.15.49:58786) 2023-11-30T18:22:16.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.541+0000 7fab3effd700 1 -- 172.21.15.49:0/1370220897 learned_addr learned my addr 172.21.15.49:0/1370220897 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:22:16.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.542+0000 7fab3ffff700 1 --2- 172.21.15.49:0/1370220897 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab400aa930 0x7fab400a7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:16.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.542+0000 7fab3e7fc700 1 -- 172.21.15.49:0/1370220897 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2689677875 0 0) 0x7fab400c6630 con 0x7fab40154910 2023-11-30T18:22:16.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.542+0000 7fab3e7fc700 1 -- 172.21.15.49:0/1370220897 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab280033f0 con 0x7fab40154910 2023-11-30T18:22:16.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.542+0000 7fab3e7fc700 1 -- 172.21.15.49:0/1370220897 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4220660756 0 0) 0x7fab40064230 con 0x7fab40154530 2023-11-30T18:22:16.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.542+0000 7fab3e7fc700 1 -- 172.21.15.49:0/1370220897 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab400c6630 con 0x7fab40154530 2023-11-30T18:22:16.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.542+0000 7fab3e7fc700 1 -- 172.21.15.49:0/1370220897 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3460398477 0 0) 0x7fab280033f0 con 0x7fab40154910 2023-11-30T18:22:16.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.542+0000 7fab3e7fc700 1 -- 172.21.15.49:0/1370220897 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab400aa930 msgr2=0x7fab400a7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:16.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.542+0000 7fab3e7fc700 1 --2- 172.21.15.49:0/1370220897 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab400aa930 0x7fab400a7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:16.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.542+0000 7fab3e7fc700 1 -- 172.21.15.49:0/1370220897 >> v1:172.21.15.115:6789/0 conn(0x7fab40154530 legacy=0x7fab400c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:16.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.542+0000 7fab3e7fc700 1 -- 172.21.15.49:0/1370220897 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab40064510 con 0x7fab40154910 2023-11-30T18:22:16.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.542+0000 7fab3e7fc700 1 -- 172.21.15.49:0/1370220897 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fab34001470 con 0x7fab40154910 2023-11-30T18:22:16.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.542+0000 7fab3e7fc700 1 -- 172.21.15.49:0/1370220897 >> v1:172.21.15.49:6789/0 conn(0x7fab40154910 legacy=0x7fab400aa220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:16.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.542+0000 7fab3e7fc700 1 --2- 172.21.15.49:0/1370220897 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab400aa930 0x7fab28003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:16.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.542+0000 7fab3e7fc700 1 --2- 172.21.15.49:0/1370220897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab28003fb0 0x7fab28004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:16.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.542+0000 7fab3e7fc700 1 --2- 172.21.15.49:0/1370220897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab28004b80 0x7fab28005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:16.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.542+0000 7fab3e7fc700 1 -- 172.21.15.49:0/1370220897 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab400c6390 con 0x7fab28004b80 2023-11-30T18:22:16.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.542+0000 7fab3e7fc700 1 -- 172.21.15.49:0/1370220897 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2800b990 con 0x7fab28003fb0 2023-11-30T18:22:16.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.542+0000 7fab3e7fc700 1 -- 172.21.15.49:0/1370220897 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab2800bb50 con 0x7fab400aa930 2023-11-30T18:22:16.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.542+0000 7fab3ffff700 1 --2- 172.21.15.49:0/1370220897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab28004b80 0x7fab28005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:16.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.542+0000 7fab3effd700 1 --2- 172.21.15.49:0/1370220897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab28003fb0 0x7fab28004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:16.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.542+0000 7fab3f7fe700 1 --2- 172.21.15.49:0/1370220897 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab400aa930 0x7fab28003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:16.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.543+0000 7fab3ffff700 1 -- 172.21.15.49:0/1370220897 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab400aa930 msgr2=0x7fab28003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:16.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.543+0000 7fab3ffff700 1 --2- 172.21.15.49:0/1370220897 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab400aa930 0x7fab28003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:16.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.543+0000 7fab3ffff700 1 -- 172.21.15.49:0/1370220897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab28003fb0 msgr2=0x7fab28004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:16.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.543+0000 7fab3ffff700 1 --2- 172.21.15.49:0/1370220897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab28003fb0 0x7fab28004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:16.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.543+0000 7fab3ffff700 1 -- 172.21.15.49:0/1370220897 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab280033f0 con 0x7fab28004b80 2023-11-30T18:22:16.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.543+0000 7fab3ffff700 1 --2- 172.21.15.49:0/1370220897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab28004b80 0x7fab28005000 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7fab400856e0 tx=0x7fab3800b040).ready entity=mon.0 client_cookie=44fbfec1e435f5ca server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:16.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.543+0000 7fab3e7fc700 1 -- 172.21.15.49:0/1370220897 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab38009ac0 con 0x7fab28004b80 2023-11-30T18:22:16.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.543+0000 7fab3e7fc700 1 -- 172.21.15.49:0/1370220897 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3800f040 con 0x7fab28004b80 2023-11-30T18:22:16.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.543+0000 7fab3e7fc700 1 -- 172.21.15.49:0/1370220897 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3800ec70 con 0x7fab28004b80 2023-11-30T18:22:16.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.543+0000 7fab45c1f700 1 -- 172.21.15.49:0/1370220897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab28004b80 msgr2=0x7fab28005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:16.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.543+0000 7fab45c1f700 1 --2- 172.21.15.49:0/1370220897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab28004b80 0x7fab28005000 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7fab400856e0 tx=0x7fab3800b040).stop 2023-11-30T18:22:16.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.543+0000 7fab3ffff700 1 -- 172.21.15.49:0/1370220897 reap_dead start 2023-11-30T18:22:16.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.543+0000 7fab45c1f700 1 -- 172.21.15.49:0/1370220897 shutdown_connections 2023-11-30T18:22:16.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.543+0000 7fab45c1f700 1 -- 172.21.15.49:0/1370220897 >> 172.21.15.49:0/1370220897 conn(0x7fab40094930 msgr2=0x7fab4006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:16.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.543+0000 7fab45c1f700 1 -- 172.21.15.49:0/1370220897 shutdown_connections 2023-11-30T18:22:16.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.543+0000 7fab45c1f700 1 -- 172.21.15.49:0/1370220897 wait complete. 2023-11-30T18:22:16.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.545+0000 7fab45c1f700 1 Processor -- start 2023-11-30T18:22:16.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.545+0000 7fab45c1f700 1 -- start start 2023-11-30T18:22:16.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.546+0000 7fab45c1f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab400c2820 0x7fab400c4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:16.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.546+0000 7fab45c1f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab400c2c00 0x7fab40150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:16.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.546+0000 7fab45c1f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab400c75d0 0x7fab400c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:16.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.546+0000 7fab45c1f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab400c51e0 con 0x7fab400c75d0 2023-11-30T18:22:16.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.546+0000 7fab45c1f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab400c71b0 con 0x7fab400c2c00 2023-11-30T18:22:16.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.546+0000 7fab45c1f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab400c4750 con 0x7fab400c2820 2023-11-30T18:22:16.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.546+0000 7fab3ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab400c75d0 0x7fab400c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:16.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.546+0000 7fab3f7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab400c2820 0x7fab400c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:16.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.546+0000 7fab3ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab400c75d0 0x7fab400c7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57734/0 (socket says 172.21.15.49:57734) 2023-11-30T18:22:16.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.546+0000 7fab3effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab400c2c00 0x7fab40150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:16.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.546+0000 7fab3ffff700 1 -- 172.21.15.49:0/3961767585 learned_addr learned my addr 172.21.15.49:0/3961767585 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:16.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.546+0000 7fab3ffff700 1 -- 172.21.15.49:0/3961767585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab400c2820 msgr2=0x7fab400c4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:16.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.546+0000 7fab3ffff700 1 --2- 172.21.15.49:0/3961767585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab400c2820 0x7fab400c4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:16.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.546+0000 7fab3ffff700 1 -- 172.21.15.49:0/3961767585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab400c2c00 msgr2=0x7fab40150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:16.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.546+0000 7fab3ffff700 1 --2- 172.21.15.49:0/3961767585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab400c2c00 0x7fab40150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:16.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.546+0000 7fab3ffff700 1 -- 172.21.15.49:0/3961767585 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab400c4940 con 0x7fab400c75d0 2023-11-30T18:22:16.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.546+0000 7fab3ffff700 1 --2- 172.21.15.49:0/3961767585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab400c75d0 0x7fab400c7a50 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7fab40084a80 tx=0x7fab3801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:16.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.547+0000 7fab277fe700 1 -- 172.21.15.49:0/3961767585 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab38009ac0 con 0x7fab400c75d0 2023-11-30T18:22:16.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.547+0000 7fab277fe700 1 -- 172.21.15.49:0/3961767585 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab38013af0 con 0x7fab400c75d0 2023-11-30T18:22:16.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.547+0000 7fab45c1f700 1 -- 172.21.15.49:0/3961767585 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab400c4c20 con 0x7fab400c75d0 2023-11-30T18:22:16.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.547+0000 7fab277fe700 1 -- 172.21.15.49:0/3961767585 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3801d400 con 0x7fab400c75d0 2023-11-30T18:22:16.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.547+0000 7fab45c1f700 1 -- 172.21.15.49:0/3961767585 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab401508f0 con 0x7fab400c75d0 2023-11-30T18:22:16.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.548+0000 7fab45c1f700 1 -- 172.21.15.49:0/3961767585 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab4006c860 con 0x7fab400c75d0 2023-11-30T18:22:16.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.548+0000 7fab277fe700 1 -- 172.21.15.49:0/3961767585 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 64) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fab38003040 con 0x7fab400c75d0 2023-11-30T18:22:16.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.548+0000 7fab277fe700 1 --2- 172.21.15.49:0/3961767585 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fab2c05f2c0 0x7fab2c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:16.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.548+0000 7fab277fe700 1 -- 172.21.15.49:0/3961767585 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6581+0+0 (secure 0 0 0) 0x7fab3807b7a0 con 0x7fab400c75d0 2023-11-30T18:22:16.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.549+0000 7fab3f7fe700 1 --2- 172.21.15.49:0/3961767585 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fab2c05f2c0 0x7fab2c061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:16.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.549+0000 7fab3f7fe700 1 --2- 172.21.15.49:0/3961767585 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fab2c05f2c0 0x7fab2c061780 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fab30000c00 tx=0x7fab30007c00).ready entity=mgr.6983 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:16.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.553+0000 7fab277fe700 1 -- 172.21.15.49:0/3961767585 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fab3804c720 con 0x7fab400c75d0 2023-11-30T18:22:16.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.750+0000 7fab45c1f700 1 -- 172.21.15.49:0/3961767585 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fab400647f0 con 0x7fab2c05f2c0 2023-11-30T18:22:16.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.752+0000 7fab277fe700 1 -- 172.21.15.49:0/3961767585 <== mgr.6983 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fab400647f0 con 0x7fab2c05f2c0 2023-11-30T18:22:16.754 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:22:16.754 INFO:teuthology.orchestra.run.smithi049.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1", "rel_path": "/snap_test_dir1", "schedule": "1M", "retention": {"n": 55}, "start": "2023-11-30T00:00:00", "created": "2023-11-30T17:26:33", "first": "2023-11-30T17:27:00", "last": "2023-11-30T18:22:00", "last_pruned": "2023-11-30T18:22:00", "created_count": 56, "pruned_count": 1, "active": true}] 2023-11-30T18:22:16.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.754+0000 7fab45c1f700 1 -- 172.21.15.49:0/3961767585 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fab2c05f2c0 msgr2=0x7fab2c061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:16.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.754+0000 7fab45c1f700 1 --2- 172.21.15.49:0/3961767585 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fab2c05f2c0 0x7fab2c061780 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fab30000c00 tx=0x7fab30007c00).stop 2023-11-30T18:22:16.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.754+0000 7fab45c1f700 1 -- 172.21.15.49:0/3961767585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab400c75d0 msgr2=0x7fab400c7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:16.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.754+0000 7fab45c1f700 1 --2- 172.21.15.49:0/3961767585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab400c75d0 0x7fab400c7a50 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7fab40084a80 tx=0x7fab3801a000).stop 2023-11-30T18:22:16.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.754+0000 7fab45c1f700 1 -- 172.21.15.49:0/3961767585 shutdown_connections 2023-11-30T18:22:16.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.754+0000 7fab45c1f700 1 --2- 172.21.15.49:0/3961767585 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fab2c05f2c0 0x7fab2c061780 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:16.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.754+0000 7fab45c1f700 1 --2- 172.21.15.49:0/3961767585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab400c75d0 0x7fab400c7a50 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:16.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.754+0000 7fab45c1f700 1 --2- 172.21.15.49:0/3961767585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab400c2820 0x7fab400c4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:16.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.754+0000 7fab45c1f700 1 --2- 172.21.15.49:0/3961767585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab400c2c00 0x7fab40150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:16.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.754+0000 7fab45c1f700 1 -- 172.21.15.49:0/3961767585 >> 172.21.15.49:0/3961767585 conn(0x7fab40094930 msgr2=0x7fab40153240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:16.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.754+0000 7fab45c1f700 1 -- 172.21.15.49:0/3961767585 shutdown_connections 2023-11-30T18:22:16.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.754+0000 7fab45c1f700 1 -- 172.21.15.49:0/3961767585 wait complete. 2023-11-30T18:22:16.767 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1", "rel_path": "/snap_test_dir1", "schedule": "1M", "retention": {"n": 55}, "start": "2023-11-30T00:00:00", "created": "2023-11-30T17:26:33", "first": "2023-11-30T17:27:00", "last": "2023-11-30T18:22:00", "last_pruned": "2023-11-30T18:22:00", "created_count": 56, "pruned_count": 1, "active": true}] 2023-11-30T18:22:16.767 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1', 'rel_path': '/snap_test_dir1', 'schedule': '1M', 'retention': {'n': 55}, 'start': '2023-11-30T00:00:00', 'created': '2023-11-30T17:26:33', 'first': '2023-11-30T17:27:00', 'last': '2023-11-30T18:22:00', 'last_pruned': '2023-11-30T18:22:00', 'created_count': 56, 'pruned_count': 1, 'active': True} 2023-11-30T18:22:16.768 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 55 2023-11-30T18:22:16.768 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 56 2023-11-30T18:22:16.768 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1 2023-11-30T18:22:16.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.888+0000 7f861dd14700 1 Processor -- start 2023-11-30T18:22:16.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.888+0000 7f861dd14700 1 -- start start 2023-11-30T18:22:16.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.889+0000 7f861dd14700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f86180ab3b0 0x7f86181582e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:16.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.889+0000 7f861dd14700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8618159210 con 0x7f8618154610 2023-11-30T18:22:16.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.889+0000 7f861dd14700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86180c0c70 con 0x7f86180aa1c0 2023-11-30T18:22:16.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.889+0000 7f861dd14700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8618158970 con 0x7f86180ab3b0 2023-11-30T18:22:16.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.889+0000 7f8616ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f86180ab3b0 0x7f86181582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:16.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.889+0000 7f86177fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8618154610 0x7f86180c80c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58800/0 (socket says 172.21.15.49:58800) 2023-11-30T18:22:16.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.889+0000 7f86177fe700 1 -- 172.21.15.49:0/830390505 learned_addr learned my addr 172.21.15.49:0/830390505 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:22:16.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.889+0000 7f8616ffd700 1 -- 172.21.15.49:0/830390505 >> v1:172.21.15.115:6789/0 conn(0x7f86180aa1c0 legacy=0x7f86180c1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:16.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.889+0000 7f8616ffd700 1 -- 172.21.15.49:0/830390505 >> v1:172.21.15.49:6789/0 conn(0x7f8618154610 legacy=0x7f86180c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:16.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.889+0000 7f86167fc700 1 -- 172.21.15.49:0/830390505 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 747835269 0 0) 0x7f8618159210 con 0x7f8618154610 2023-11-30T18:22:16.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.889+0000 7f8616ffd700 1 -- 172.21.15.49:0/830390505 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8618158c50 con 0x7f86180ab3b0 2023-11-30T18:22:16.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.890+0000 7f8616ffd700 1 --2- 172.21.15.49:0/830390505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86180ab3b0 0x7f86181582e0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7f860c009760 tx=0x7f860c009060).ready entity=mon.0 client_cookie=e00a3b3d7f490e93 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:16.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.890+0000 7f86167fc700 1 -- 172.21.15.49:0/830390505 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860c00b580 con 0x7f86180ab3b0 2023-11-30T18:22:16.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.890+0000 7f86167fc700 1 -- 172.21.15.49:0/830390505 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860c00b6e0 con 0x7f86180ab3b0 2023-11-30T18:22:16.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.890+0000 7f86167fc700 1 -- 172.21.15.49:0/830390505 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860c00ba60 con 0x7f86180ab3b0 2023-11-30T18:22:16.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.890+0000 7f861dd14700 1 -- 172.21.15.49:0/830390505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86180ab3b0 msgr2=0x7f86181582e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:16.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.890+0000 7f861dd14700 1 --2- 172.21.15.49:0/830390505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86180ab3b0 0x7f86181582e0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7f860c009760 tx=0x7f860c009060).stop 2023-11-30T18:22:16.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.890+0000 7f861dd14700 1 -- 172.21.15.49:0/830390505 shutdown_connections 2023-11-30T18:22:16.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.890+0000 7f861dd14700 1 --2- 172.21.15.49:0/830390505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86180ab3b0 0x7f86181582e0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:16.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.890+0000 7f861dd14700 1 -- 172.21.15.49:0/830390505 >> 172.21.15.49:0/830390505 conn(0x7f86180655a0 msgr2=0x7f8618069e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:16.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.890+0000 7f861dd14700 1 -- 172.21.15.49:0/830390505 shutdown_connections 2023-11-30T18:22:16.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.890+0000 7f861dd14700 1 -- 172.21.15.49:0/830390505 wait complete. 2023-11-30T18:22:16.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.892+0000 7f861dd14700 1 Processor -- start 2023-11-30T18:22:16.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.892+0000 7f861dd14700 1 -- start start 2023-11-30T18:22:16.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.892+0000 7f861dd14700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86180aa1c0 0x7f861814e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:16.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.892+0000 7f861dd14700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8618154610 0x7f86180c2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:16.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.892+0000 7f861dd14700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86181533b0 0x7f86180b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:16.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.892+0000 7f861dd14700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8618153830 con 0x7f8618154610 2023-11-30T18:22:16.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.892+0000 7f861dd14700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86180c2990 con 0x7f86180aa1c0 2023-11-30T18:22:16.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.892+0000 7f861dd14700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86180c2c70 con 0x7f86181533b0 2023-11-30T18:22:16.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.892+0000 7f8616ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8618154610 0x7f86180c2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:16.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.892+0000 7f8616ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8618154610 0x7f86180c2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57754/0 (socket says 172.21.15.49:57754) 2023-11-30T18:22:16.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.892+0000 7f8616ffd700 1 -- 172.21.15.49:0/1121347522 learned_addr learned my addr 172.21.15.49:0/1121347522 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:16.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.893+0000 7f86177fe700 1 --2- 172.21.15.49:0/1121347522 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86180aa1c0 0x7f861814e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:16.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.893+0000 7f8617fff700 1 --2- 172.21.15.49:0/1121347522 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86181533b0 0x7f86180b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:16.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.893+0000 7f8616ffd700 1 -- 172.21.15.49:0/1121347522 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86181533b0 msgr2=0x7f86180b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:16.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.893+0000 7f8616ffd700 1 --2- 172.21.15.49:0/1121347522 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86181533b0 0x7f86180b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:16.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.893+0000 7f8616ffd700 1 -- 172.21.15.49:0/1121347522 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86180aa1c0 msgr2=0x7f861814e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:16.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.893+0000 7f8616ffd700 1 --2- 172.21.15.49:0/1121347522 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86180aa1c0 0x7f861814e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:16.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.893+0000 7f8616ffd700 1 -- 172.21.15.49:0/1121347522 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c0092a0 con 0x7f8618154610 2023-11-30T18:22:16.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.893+0000 7f8616ffd700 1 --2- 172.21.15.49:0/1121347522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8618154610 0x7f86180c2300 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7f86180cc2d0 tx=0x7f860c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:16.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.893+0000 7f85ff7fe700 1 -- 172.21.15.49:0/1121347522 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860c00ba60 con 0x7f8618154610 2023-11-30T18:22:16.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.893+0000 7f85ff7fe700 1 -- 172.21.15.49:0/1121347522 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860c000c90 con 0x7f8618154610 2023-11-30T18:22:16.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.893+0000 7f861dd14700 1 -- 172.21.15.49:0/1121347522 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86180c2f50 con 0x7f8618154610 2023-11-30T18:22:16.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.893+0000 7f85ff7fe700 1 -- 172.21.15.49:0/1121347522 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860c01b640 con 0x7f8618154610 2023-11-30T18:22:16.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.893+0000 7f861dd14700 1 -- 172.21.15.49:0/1121347522 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86180b0a20 con 0x7f8618154610 2023-11-30T18:22:16.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.894+0000 7f861dd14700 1 -- 172.21.15.49:0/1121347522 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f861806c860 con 0x7f8618154610 2023-11-30T18:22:16.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.895+0000 7f85ff7fe700 1 -- 172.21.15.49:0/1121347522 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 64) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f860c01ba30 con 0x7f8618154610 2023-11-30T18:22:16.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.895+0000 7f85ff7fe700 1 --2- 172.21.15.49:0/1121347522 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f860405f2c0 0x7f8604061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:16.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.895+0000 7f85ff7fe700 1 -- 172.21.15.49:0/1121347522 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6581+0+0 (secure 0 0 0) 0x7f860c07c1f0 con 0x7f8618154610 2023-11-30T18:22:16.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.895+0000 7f86177fe700 1 --2- 172.21.15.49:0/1121347522 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f860405f2c0 0x7f8604061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:16.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.895+0000 7f86177fe700 1 --2- 172.21.15.49:0/1121347522 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f860405f2c0 0x7f8604061780 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f8608000c00 tx=0x7f8608009040).ready entity=mgr.6983 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:16.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:16.899+0000 7f85ff7fe700 1 -- 172.21.15.49:0/1121347522 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f860c04d170 con 0x7f8618154610 2023-11-30T18:22:17.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:17.100+0000 7f861dd14700 1 -- 172.21.15.49:0/1121347522 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f8618153ad0 con 0x7f860405f2c0 2023-11-30T18:22:17.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:17.105+0000 7f85ff7fe700 1 -- 172.21.15.49:0/1121347522 <== mgr.6983 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+42 (secure 0 0 0) 0x7f8618153ad0 con 0x7f860405f2c0 2023-11-30T18:22:17.107 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule removed for path /snap_test_dir1 2023-11-30T18:22:17.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:17.107+0000 7f861dd14700 1 -- 172.21.15.49:0/1121347522 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f860405f2c0 msgr2=0x7f8604061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:17.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:17.107+0000 7f861dd14700 1 --2- 172.21.15.49:0/1121347522 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f860405f2c0 0x7f8604061780 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f8608000c00 tx=0x7f8608009040).stop 2023-11-30T18:22:17.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:17.107+0000 7f861dd14700 1 -- 172.21.15.49:0/1121347522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8618154610 msgr2=0x7f86180c2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:17.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:17.107+0000 7f861dd14700 1 --2- 172.21.15.49:0/1121347522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8618154610 0x7f86180c2300 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7f86180cc2d0 tx=0x7f860c017000).stop 2023-11-30T18:22:17.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:17.107+0000 7f861dd14700 1 -- 172.21.15.49:0/1121347522 shutdown_connections 2023-11-30T18:22:17.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:17.107+0000 7f861dd14700 1 --2- 172.21.15.49:0/1121347522 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86181533b0 0x7f86180b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:17.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:17.107+0000 7f861dd14700 1 --2- 172.21.15.49:0/1121347522 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86180aa1c0 0x7f861814e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:17.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:17.107+0000 7f861dd14700 1 --2- 172.21.15.49:0/1121347522 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f860405f2c0 0x7f8604061780 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:17.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:17.107+0000 7f861dd14700 1 --2- 172.21.15.49:0/1121347522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8618154610 0x7f86180c2300 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:17.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:17.107+0000 7f861dd14700 1 -- 172.21.15.49:0/1121347522 >> 172.21.15.49:0/1121347522 conn(0x7f86180655a0 msgr2=0x7f86180c9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:17.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:17.107+0000 7f861dd14700 1 -- 172.21.15.49:0/1121347522 shutdown_connections 2023-11-30T18:22:17.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:17.107+0000 7f861dd14700 1 -- 172.21.15.49:0/1121347522 wait complete. 2023-11-30T18:22:17.120 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1 2023-11-30T18:22:17.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:17.121 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:22:17.138 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_28_00_UTC 2023-11-30T18:22:17.138 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_29_00_UTC 2023-11-30T18:22:17.138 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_30_00_UTC 2023-11-30T18:22:17.138 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_31_00_UTC 2023-11-30T18:22:17.138 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_32_00_UTC 2023-11-30T18:22:17.138 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_33_00_UTC 2023-11-30T18:22:17.138 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_34_00_UTC 2023-11-30T18:22:17.139 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_35_00_UTC 2023-11-30T18:22:17.139 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_36_00_UTC 2023-11-30T18:22:17.139 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_37_00_UTC 2023-11-30T18:22:17.139 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_38_00_UTC 2023-11-30T18:22:17.139 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_39_00_UTC 2023-11-30T18:22:17.139 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_40_00_UTC 2023-11-30T18:22:17.139 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_41_00_UTC 2023-11-30T18:22:17.139 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_42_00_UTC 2023-11-30T18:22:17.139 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_43_00_UTC 2023-11-30T18:22:17.139 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_44_00_UTC 2023-11-30T18:22:17.139 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_45_00_UTC 2023-11-30T18:22:17.139 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_46_00_UTC 2023-11-30T18:22:17.139 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_47_00_UTC 2023-11-30T18:22:17.139 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_48_00_UTC 2023-11-30T18:22:17.139 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_49_00_UTC 2023-11-30T18:22:17.140 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_50_00_UTC 2023-11-30T18:22:17.140 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_51_00_UTC 2023-11-30T18:22:17.140 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_52_00_UTC 2023-11-30T18:22:17.140 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_53_00_UTC 2023-11-30T18:22:17.140 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_54_00_UTC 2023-11-30T18:22:17.140 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_55_00_UTC 2023-11-30T18:22:17.140 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_56_00_UTC 2023-11-30T18:22:17.140 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_57_00_UTC 2023-11-30T18:22:17.140 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_58_00_UTC 2023-11-30T18:22:17.140 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-17_59_00_UTC 2023-11-30T18:22:17.140 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_00_00_UTC 2023-11-30T18:22:17.140 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_01_00_UTC 2023-11-30T18:22:17.140 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_02_00_UTC 2023-11-30T18:22:17.140 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_03_00_UTC 2023-11-30T18:22:17.141 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_04_00_UTC 2023-11-30T18:22:17.141 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_05_00_UTC 2023-11-30T18:22:17.141 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_06_00_UTC 2023-11-30T18:22:17.141 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_07_00_UTC 2023-11-30T18:22:17.141 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_08_00_UTC 2023-11-30T18:22:17.141 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_09_00_UTC 2023-11-30T18:22:17.141 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_10_00_UTC 2023-11-30T18:22:17.141 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_11_00_UTC 2023-11-30T18:22:17.141 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_12_00_UTC 2023-11-30T18:22:17.141 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_13_00_UTC 2023-11-30T18:22:17.141 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_14_00_UTC 2023-11-30T18:22:17.141 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_15_00_UTC 2023-11-30T18:22:17.141 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_16_00_UTC 2023-11-30T18:22:17.141 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_17_00_UTC 2023-11-30T18:22:17.141 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_18_00_UTC 2023-11-30T18:22:17.142 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_19_00_UTC 2023-11-30T18:22:17.142 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_20_00_UTC 2023-11-30T18:22:17.142 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_21_00_UTC 2023-11-30T18:22:17.142 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_22_00_UTC 2023-11-30T18:22:17.142 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_28_00_UTC 2023-11-30T18:22:17.142 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:17.142 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_28_00_UTC) 2023-11-30T18:22:17.199 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_29_00_UTC 2023-11-30T18:22:17.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:17.199 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_29_00_UTC) 2023-11-30T18:22:17.260 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_30_00_UTC 2023-11-30T18:22:17.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:17.260 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_30_00_UTC) 2023-11-30T18:22:17.320 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_31_00_UTC 2023-11-30T18:22:17.321 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:17.321 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_31_00_UTC) 2023-11-30T18:22:17.381 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_32_00_UTC 2023-11-30T18:22:17.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:17.381 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_32_00_UTC) 2023-11-30T18:22:17.442 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_33_00_UTC 2023-11-30T18:22:17.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:17.442 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_33_00_UTC) 2023-11-30T18:22:17.503 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_34_00_UTC 2023-11-30T18:22:17.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:17.503 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_34_00_UTC) 2023-11-30T18:22:17.564 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_35_00_UTC 2023-11-30T18:22:17.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:17.565 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_35_00_UTC) 2023-11-30T18:22:17.625 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_36_00_UTC 2023-11-30T18:22:17.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:17.625 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_36_00_UTC) 2023-11-30T18:22:17.685 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_37_00_UTC 2023-11-30T18:22:17.685 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:17.686 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_37_00_UTC) 2023-11-30T18:22:17.746 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_38_00_UTC 2023-11-30T18:22:17.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:17.746 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_38_00_UTC) 2023-11-30T18:22:17.808 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_39_00_UTC 2023-11-30T18:22:17.808 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:17.808 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_39_00_UTC) 2023-11-30T18:22:17.868 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_40_00_UTC 2023-11-30T18:22:17.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:17.868 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_40_00_UTC) 2023-11-30T18:22:17.929 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_41_00_UTC 2023-11-30T18:22:17.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:17.930 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_41_00_UTC) 2023-11-30T18:22:17.991 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_42_00_UTC 2023-11-30T18:22:17.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:17.991 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_42_00_UTC) 2023-11-30T18:22:18.052 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_43_00_UTC 2023-11-30T18:22:18.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:18.052 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_43_00_UTC) 2023-11-30T18:22:18.112 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_44_00_UTC 2023-11-30T18:22:18.113 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:18.113 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_44_00_UTC) 2023-11-30T18:22:18.173 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_45_00_UTC 2023-11-30T18:22:18.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:18.173 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_45_00_UTC) 2023-11-30T18:22:18.232 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_46_00_UTC 2023-11-30T18:22:18.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:18.232 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_46_00_UTC) 2023-11-30T18:22:18.294 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_47_00_UTC 2023-11-30T18:22:18.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:18.294 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_47_00_UTC) 2023-11-30T18:22:18.354 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_48_00_UTC 2023-11-30T18:22:18.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:18.354 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_48_00_UTC) 2023-11-30T18:22:18.414 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_49_00_UTC 2023-11-30T18:22:18.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:18.414 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_49_00_UTC) 2023-11-30T18:22:18.475 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_50_00_UTC 2023-11-30T18:22:18.475 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:18.475 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_50_00_UTC) 2023-11-30T18:22:18.544 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_51_00_UTC 2023-11-30T18:22:18.544 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:18.544 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_51_00_UTC) 2023-11-30T18:22:18.607 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_52_00_UTC 2023-11-30T18:22:18.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:18.607 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_52_00_UTC) 2023-11-30T18:22:18.672 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_53_00_UTC 2023-11-30T18:22:18.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:18.672 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_53_00_UTC) 2023-11-30T18:22:18.741 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_54_00_UTC 2023-11-30T18:22:18.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:18.741 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_54_00_UTC) 2023-11-30T18:22:18.807 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_55_00_UTC 2023-11-30T18:22:18.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:18.807 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_55_00_UTC) 2023-11-30T18:22:18.870 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_56_00_UTC 2023-11-30T18:22:18.870 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:18.870 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_56_00_UTC) 2023-11-30T18:22:18.932 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_57_00_UTC 2023-11-30T18:22:18.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:18.933 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_57_00_UTC) 2023-11-30T18:22:18.996 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_58_00_UTC 2023-11-30T18:22:18.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:18.996 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_58_00_UTC) 2023-11-30T18:22:19.059 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-17_59_00_UTC 2023-11-30T18:22:19.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:19.059 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-17_59_00_UTC) 2023-11-30T18:22:19.121 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-18_00_00_UTC 2023-11-30T18:22:19.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:19.122 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-18_00_00_UTC) 2023-11-30T18:22:19.182 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-18_01_00_UTC 2023-11-30T18:22:19.182 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:19.182 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-18_01_00_UTC) 2023-11-30T18:22:19.244 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-18_02_00_UTC 2023-11-30T18:22:19.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:19.244 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-18_02_00_UTC) 2023-11-30T18:22:19.304 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-18_03_00_UTC 2023-11-30T18:22:19.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:19.304 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-18_03_00_UTC) 2023-11-30T18:22:19.364 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-18_04_00_UTC 2023-11-30T18:22:19.364 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:19.364 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-18_04_00_UTC) 2023-11-30T18:22:19.424 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-18_05_00_UTC 2023-11-30T18:22:19.424 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:19.425 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-18_05_00_UTC) 2023-11-30T18:22:19.485 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-18_06_00_UTC 2023-11-30T18:22:19.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:19.485 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-18_06_00_UTC) 2023-11-30T18:22:19.546 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-18_07_00_UTC 2023-11-30T18:22:19.546 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:19.546 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-18_07_00_UTC) 2023-11-30T18:22:19.607 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-18_08_00_UTC 2023-11-30T18:22:19.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:19.607 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-18_08_00_UTC) 2023-11-30T18:22:19.667 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-18_09_00_UTC 2023-11-30T18:22:19.667 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:19.667 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-18_09_00_UTC) 2023-11-30T18:22:19.763 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-18_10_00_UTC 2023-11-30T18:22:19.763 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:19.763 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-18_10_00_UTC) 2023-11-30T18:22:19.793 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-18_11_00_UTC 2023-11-30T18:22:19.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:19.794 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-18_11_00_UTC) 2023-11-30T18:22:19.858 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-18_12_00_UTC 2023-11-30T18:22:19.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:19.858 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-18_12_00_UTC) 2023-11-30T18:22:19.918 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-18_13_00_UTC 2023-11-30T18:22:19.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:19.918 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-18_13_00_UTC) 2023-11-30T18:22:19.978 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-18_14_00_UTC 2023-11-30T18:22:19.978 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:19.978 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-18_14_00_UTC) 2023-11-30T18:22:20.038 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-18_15_00_UTC 2023-11-30T18:22:20.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:20.039 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-18_15_00_UTC) 2023-11-30T18:22:20.099 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-18_16_00_UTC 2023-11-30T18:22:20.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:20.099 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-18_16_00_UTC) 2023-11-30T18:22:20.159 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-18_17_00_UTC 2023-11-30T18:22:20.159 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:20.159 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-18_17_00_UTC) 2023-11-30T18:22:20.231 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-18_18_00_UTC 2023-11-30T18:22:20.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:20.231 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-18_18_00_UTC) 2023-11-30T18:22:20.294 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-18_19_00_UTC 2023-11-30T18:22:20.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:20.295 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-18_19_00_UTC) 2023-11-30T18:22:20.354 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-18_20_00_UTC 2023-11-30T18:22:20.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:20.354 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-18_20_00_UTC) 2023-11-30T18:22:20.414 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-18_21_00_UTC 2023-11-30T18:22:20.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:20.414 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-18_21_00_UTC) 2023-11-30T18:22:20.474 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-18_22_00_UTC 2023-11-30T18:22:20.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:20.474 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-18_22_00_UTC) 2023-11-30T18:22:20.534 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:20.534 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-11-30T18:22:20.592 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-11-30T18:22:20.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.806+0000 7f207ea34700 1 Processor -- start 2023-11-30T18:22:20.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.806+0000 7f207ea34700 1 -- start start 2023-11-30T18:22:20.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.807+0000 7f207ea34700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2078150930 0x7f20780c6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:20.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.807+0000 7f207ea34700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2078150d10 0x7f20780a6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:20.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.808+0000 7f207ea34700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2078062910 con 0x7f20780bcfa0 2023-11-30T18:22:20.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.808+0000 7f207ea34700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20780c2460 con 0x7f2078150930 2023-11-30T18:22:20.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.808+0000 7f207ea34700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20780c6c00 con 0x7f2078150d10 2023-11-30T18:22:20.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.808+0000 7f207cfd1700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f20780bcfa0 0x7f20781547a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:54966/0 (socket says 172.21.15.49:54966) 2023-11-30T18:22:20.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.808+0000 7f207cfd1700 1 -- 172.21.15.49:0/2690133704 learned_addr learned my addr 172.21.15.49:0/2690133704 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:22:20.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.808+0000 7f20777fe700 1 --2- 172.21.15.49:0/2690133704 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2078150d10 0x7f20780a6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:20.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.808+0000 7f2077fff700 1 --2- 172.21.15.49:0/2690133704 >> v2:172.21.15.49:3300/0 conn(0x7f2078150930 0x7f20780c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:20.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.808+0000 7f2077fff700 1 -- 172.21.15.49:0/2690133704 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2078150d10 msgr2=0x7f20780a6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:20.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.808+0000 7f2077fff700 1 --2- 172.21.15.49:0/2690133704 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2078150d10 0x7f20780a6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:20.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.808+0000 7f2077fff700 1 -- 172.21.15.49:0/2690133704 >> v1:172.21.15.49:6789/0 conn(0x7f20780bcfa0 legacy=0x7f20781547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:20.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.808+0000 7f2077fff700 1 -- 172.21.15.49:0/2690133704 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20780c6ee0 con 0x7f2078150930 2023-11-30T18:22:20.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.808+0000 7f2077fff700 1 --2- 172.21.15.49:0/2690133704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2078150930 0x7f20780c6620 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7f206800db70 tx=0x7f206800d4e0).ready entity=mon.0 client_cookie=36bba2acd67c4873 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:20.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.809+0000 7f2076ffd700 1 -- 172.21.15.49:0/2690133704 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2068012070 con 0x7f2078150930 2023-11-30T18:22:20.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.809+0000 7f2076ffd700 1 -- 172.21.15.49:0/2690133704 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206800d550 con 0x7f2078150930 2023-11-30T18:22:20.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.809+0000 7f2076ffd700 1 -- 172.21.15.49:0/2690133704 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2068005ca0 con 0x7f2078150930 2023-11-30T18:22:20.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.810+0000 7f207ea34700 1 -- 172.21.15.49:0/2690133704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2078150930 msgr2=0x7f20780c6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:20.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.810+0000 7f207ea34700 1 --2- 172.21.15.49:0/2690133704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2078150930 0x7f20780c6620 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7f206800db70 tx=0x7f206800d4e0).stop 2023-11-30T18:22:20.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.810+0000 7f207ea34700 1 -- 172.21.15.49:0/2690133704 shutdown_connections 2023-11-30T18:22:20.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.810+0000 7f207ea34700 1 --2- 172.21.15.49:0/2690133704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2078150930 0x7f20780c6620 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:20.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.810+0000 7f207ea34700 1 --2- 172.21.15.49:0/2690133704 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2078150d10 0x7f20780a6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:20.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.810+0000 7f207ea34700 1 -- 172.21.15.49:0/2690133704 >> 172.21.15.49:0/2690133704 conn(0x7f20780c8230 msgr2=0x7f20780c4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:20.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.810+0000 7f207ea34700 1 -- 172.21.15.49:0/2690133704 shutdown_connections 2023-11-30T18:22:20.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.810+0000 7f207ea34700 1 -- 172.21.15.49:0/2690133704 wait complete. 2023-11-30T18:22:20.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.812+0000 7f207ea34700 1 Processor -- start 2023-11-30T18:22:20.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.812+0000 7f207ea34700 1 -- start start 2023-11-30T18:22:20.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.813+0000 7f207ea34700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20780bcfa0 0x7f2078065900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:20.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.813+0000 7f207ea34700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2078150930 0x7f2078149d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:20.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.813+0000 7f207ea34700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2078150d10 0x7f20780a7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:20.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.813+0000 7f207ea34700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2078065df0 con 0x7f20780bcfa0 2023-11-30T18:22:20.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.813+0000 7f207ea34700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20781640f0 con 0x7f2078150d10 2023-11-30T18:22:20.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.813+0000 7f207ea34700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f207814ce60 con 0x7f2078150930 2023-11-30T18:22:20.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.814+0000 7f2077fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20780bcfa0 0x7f2078065900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:20.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.814+0000 7f2077fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20780bcfa0 0x7f2078065900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45616/0 (socket says 172.21.15.49:45616) 2023-11-30T18:22:20.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.814+0000 7f2077fff700 1 -- 172.21.15.49:0/3393375582 learned_addr learned my addr 172.21.15.49:0/3393375582 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:20.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.814+0000 7f20777fe700 1 --2- 172.21.15.49:0/3393375582 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2078150930 0x7f2078149d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:20.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.814+0000 7f207cfd1700 1 --2- 172.21.15.49:0/3393375582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2078150d10 0x7f20780a7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:20.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.814+0000 7f2077fff700 1 -- 172.21.15.49:0/3393375582 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2078150930 msgr2=0x7f2078149d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:20.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.814+0000 7f2077fff700 1 --2- 172.21.15.49:0/3393375582 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2078150930 0x7f2078149d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:20.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.814+0000 7f2077fff700 1 -- 172.21.15.49:0/3393375582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2078150d10 msgr2=0x7f20780a7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:20.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.814+0000 7f2077fff700 1 --2- 172.21.15.49:0/3393375582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2078150d10 0x7f20780a7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:20.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.814+0000 7f2077fff700 1 -- 172.21.15.49:0/3393375582 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f206800d6e0 con 0x7f20780bcfa0 2023-11-30T18:22:20.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.814+0000 7f2077fff700 1 --2- 172.21.15.49:0/3393375582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20780bcfa0 0x7f2078065900 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7f206800f330 tx=0x7f206800d4e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:20.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.815+0000 7f206ffff700 1 -- 172.21.15.49:0/3393375582 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206800f740 con 0x7f20780bcfa0 2023-11-30T18:22:20.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.815+0000 7f206ffff700 1 -- 172.21.15.49:0/3393375582 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206800f8a0 con 0x7f20780bcfa0 2023-11-30T18:22:20.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.815+0000 7f207ea34700 1 -- 172.21.15.49:0/3393375582 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f207814d140 con 0x7f20780bcfa0 2023-11-30T18:22:20.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.815+0000 7f206ffff700 1 -- 172.21.15.49:0/3393375582 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206800fc60 con 0x7f20780bcfa0 2023-11-30T18:22:20.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.815+0000 7f207ea34700 1 -- 172.21.15.49:0/3393375582 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f207814d700 con 0x7f20780bcfa0 2023-11-30T18:22:20.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.816+0000 7f207ea34700 1 -- 172.21.15.49:0/3393375582 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f207806c860 con 0x7f20780bcfa0 2023-11-30T18:22:20.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.816+0000 7f206ffff700 1 -- 172.21.15.49:0/3393375582 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 64) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f2068017420 con 0x7f20780bcfa0 2023-11-30T18:22:20.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.817+0000 7f206ffff700 1 --2- 172.21.15.49:0/3393375582 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f205805f2c0 0x7f2058061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:20.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.817+0000 7f206ffff700 1 -- 172.21.15.49:0/3393375582 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6581+0+0 (secure 0 0 0) 0x7f206807f780 con 0x7f20780bcfa0 2023-11-30T18:22:20.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.817+0000 7f20777fe700 1 --2- 172.21.15.49:0/3393375582 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f205805f2c0 0x7f2058061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:20.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.817+0000 7f20777fe700 1 --2- 172.21.15.49:0/3393375582 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f205805f2c0 0x7f2058061780 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f2078069fc0 tx=0x7f2060008040).ready entity=mgr.6983 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:20.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:20.821+0000 7f206ffff700 1 -- 172.21.15.49:0/3393375582 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f20680506a0 con 0x7f20780bcfa0 2023-11-30T18:22:21.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:21.093+0000 7f207ea34700 1 -- 172.21.15.49:0/3393375582 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f2078064e60 con 0x7f20780bcfa0 2023-11-30T18:22:21.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:21.706+0000 7f206ffff700 1 -- 172.21.15.49:0/3393375582 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 65) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f206807dd50 con 0x7f20780bcfa0 2023-11-30T18:22:21.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:21.708+0000 7f206ffff700 1 -- 172.21.15.49:0/3393375582 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v65) v1 ==== 93+0+0 (secure 0 0 0) 0x7f20680469d0 con 0x7f20780bcfa0 2023-11-30T18:22:21.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:21.712+0000 7f207ea34700 1 -- 172.21.15.49:0/3393375582 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f205805f2c0 msgr2=0x7f2058061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:21.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:21.712+0000 7f207ea34700 1 --2- 172.21.15.49:0/3393375582 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f205805f2c0 0x7f2058061780 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f2078069fc0 tx=0x7f2060008040).stop 2023-11-30T18:22:21.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:21.712+0000 7f207ea34700 1 -- 172.21.15.49:0/3393375582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20780bcfa0 msgr2=0x7f2078065900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:21.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:21.712+0000 7f207ea34700 1 --2- 172.21.15.49:0/3393375582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20780bcfa0 0x7f2078065900 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7f206800f330 tx=0x7f206800d4e0).stop 2023-11-30T18:22:21.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:21.724+0000 7f207ea34700 1 -- 172.21.15.49:0/3393375582 shutdown_connections 2023-11-30T18:22:21.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:21.724+0000 7f207ea34700 1 --2- 172.21.15.49:0/3393375582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2078150d10 0x7f20780a7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:21.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:21.724+0000 7f207ea34700 1 --2- 172.21.15.49:0/3393375582 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f205805f2c0 0x7f2058061780 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:21.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:21.724+0000 7f207ea34700 1 --2- 172.21.15.49:0/3393375582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20780bcfa0 0x7f2078065900 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:21.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:21.724+0000 7f207ea34700 1 --2- 172.21.15.49:0/3393375582 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2078150930 0x7f2078149d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:21.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:21.724+0000 7f207ea34700 1 -- 172.21.15.49:0/3393375582 >> 172.21.15.49:0/3393375582 conn(0x7f20780c8230 msgr2=0x7f20780664a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:21.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:21.725+0000 7f207ea34700 1 -- 172.21.15.49:0/3393375582 shutdown_connections 2023-11-30T18:22:21.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:21.725+0000 7f207ea34700 1 -- 172.21.15.49:0/3393375582 wait complete. 2023-11-30T18:22:21.769 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-30T18:22:21.769 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T18:22:21.810 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T18:22:21.847 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-30T18:22:21.847 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-30T18:22:21.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:21.848 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-30T18:22:21.872 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:21.870+0000 7f05d9481680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T18:22:21.878 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:21.877+0000 7f174b642680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T18:22:21.898 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-11-30T18:22:21.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:22:21.899 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-30T18:22:21.936 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:21.934+0000 7f05d9481680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T18:22:21.945 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:21.944+0000 7f174b642680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T18:22:21.954 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:22:22.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.112+0000 7f21f0245700 1 Processor -- start 2023-11-30T18:22:22.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.113+0000 7f21f0245700 1 -- start start 2023-11-30T18:22:22.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.113+0000 7f21f0245700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f21e8150890 0x7f21e80bbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:22.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.113+0000 7f21f0245700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21e806a010 0x7f21e81544f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:22.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.113+0000 7f21f0245700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e80c28c0 con 0x7f21e80bc320 2023-11-30T18:22:22.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.113+0000 7f21f0245700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e81552e0 con 0x7f21e8150890 2023-11-30T18:22:22.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.113+0000 7f21f0245700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e806a4b0 con 0x7f21e806a010 2023-11-30T18:22:22.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.114+0000 7f21edfe1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f21e8150890 0x7f21e80bbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:22.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.114+0000 7f21edfe1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f21e8150890 0x7f21e80bbe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45628/0 (socket says 172.21.15.49:45628) 2023-11-30T18:22:22.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.114+0000 7f21edfe1700 1 -- 172.21.15.49:0/175202438 learned_addr learned my addr 172.21.15.49:0/175202438 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:22.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.114+0000 7f21ee7e2700 1 --2- 172.21.15.49:0/175202438 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21e806a010 0x7f21e81544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:22.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.114+0000 7f21ecfdf700 1 -- 172.21.15.49:0/175202438 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295381871 0 0) 0x7f21e80c28c0 con 0x7f21e80bc320 2023-11-30T18:22:22.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.114+0000 7f21ecfdf700 1 -- 172.21.15.49:0/175202438 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21d40033f0 con 0x7f21e80bc320 2023-11-30T18:22:22.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.114+0000 7f21edfe1700 1 -- 172.21.15.49:0/175202438 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21e806a010 msgr2=0x7f21e81544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:22.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.114+0000 7f21edfe1700 1 --2- 172.21.15.49:0/175202438 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21e806a010 0x7f21e81544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:22.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.114+0000 7f21edfe1700 1 -- 172.21.15.49:0/175202438 >> v1:172.21.15.115:6789/0 conn(0x7f21e80bc320 legacy=0x7f21e8069900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:22.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.114+0000 7f21edfe1700 1 -- 172.21.15.49:0/175202438 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e80c1f90 con 0x7f21e8150890 2023-11-30T18:22:22.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.114+0000 7f21ee7e2700 1 --2- 172.21.15.49:0/175202438 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21e806a010 0x7f21e81544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:22:22.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.114+0000 7f21edfe1700 1 --2- 172.21.15.49:0/175202438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21e8150890 0x7f21e80bbe30 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7f21dc006fd0 tx=0x7f21dc0090f0).ready entity=mon.0 client_cookie=f9cbdec907f31377 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:22.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.114+0000 7f21ecfdf700 1 -- 172.21.15.49:0/175202438 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc00f510 con 0x7f21e8150890 2023-11-30T18:22:22.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.114+0000 7f21ecfdf700 1 -- 172.21.15.49:0/175202438 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21dc00f670 con 0x7f21e8150890 2023-11-30T18:22:22.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.115+0000 7f21ecfdf700 1 -- 172.21.15.49:0/175202438 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc00f9f0 con 0x7f21e8150890 2023-11-30T18:22:22.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.115+0000 7f21f0245700 1 -- 172.21.15.49:0/175202438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21e8150890 msgr2=0x7f21e80bbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:22.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.115+0000 7f21f0245700 1 --2- 172.21.15.49:0/175202438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21e8150890 0x7f21e80bbe30 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7f21dc006fd0 tx=0x7f21dc0090f0).stop 2023-11-30T18:22:22.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.115+0000 7f21f0245700 1 -- 172.21.15.49:0/175202438 shutdown_connections 2023-11-30T18:22:22.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.115+0000 7f21f0245700 1 --2- 172.21.15.49:0/175202438 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21e806a010 0x7f21e81544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:22.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.115+0000 7f21f0245700 1 --2- 172.21.15.49:0/175202438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21e8150890 0x7f21e80bbe30 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:22.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.115+0000 7f21f0245700 1 -- 172.21.15.49:0/175202438 >> 172.21.15.49:0/175202438 conn(0x7f21e80631d0 msgr2=0x7f21e80c6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:22.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.115+0000 7f21f0245700 1 -- 172.21.15.49:0/175202438 shutdown_connections 2023-11-30T18:22:22.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.115+0000 7f21f0245700 1 -- 172.21.15.49:0/175202438 wait complete. 2023-11-30T18:22:22.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.116+0000 7f21f0245700 1 Processor -- start 2023-11-30T18:22:22.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.116+0000 7f21f0245700 1 -- start start 2023-11-30T18:22:22.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.117+0000 7f21f0245700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21e806a010 0x7f21e80a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:22.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.117+0000 7f21f0245700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21e80bc320 0x7f21e80a9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:22.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.117+0000 7f21f0245700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21e8150890 0x7f21e80a3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:22.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.117+0000 7f21f0245700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e80a9730 con 0x7f21e80bc320 2023-11-30T18:22:22.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.117+0000 7f21f0245700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e80a9940 con 0x7f21e806a010 2023-11-30T18:22:22.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.117+0000 7f21f0245700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e80a6ae0 con 0x7f21e8150890 2023-11-30T18:22:22.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.117+0000 7f21ed7e0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21e80bc320 0x7f21e80a9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:22.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.117+0000 7f21ed7e0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21e80bc320 0x7f21e80a9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45644/0 (socket says 172.21.15.49:45644) 2023-11-30T18:22:22.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.117+0000 7f21edfe1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21e806a010 0x7f21e80a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:22.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.117+0000 7f21ed7e0700 1 -- 172.21.15.49:0/3943464429 learned_addr learned my addr 172.21.15.49:0/3943464429 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:22.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.117+0000 7f21ee7e2700 1 --2- 172.21.15.49:0/3943464429 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21e8150890 0x7f21e80a3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:22.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.118+0000 7f21edfe1700 1 -- 172.21.15.49:0/3943464429 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21e8150890 msgr2=0x7f21e80a3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:22.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.118+0000 7f21edfe1700 1 --2- 172.21.15.49:0/3943464429 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21e8150890 0x7f21e80a3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:22.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.118+0000 7f21edfe1700 1 -- 172.21.15.49:0/3943464429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21e80bc320 msgr2=0x7f21e80a9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:22.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.118+0000 7f21edfe1700 1 --2- 172.21.15.49:0/3943464429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21e80bc320 0x7f21e80a9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:22.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.118+0000 7f21edfe1700 1 -- 172.21.15.49:0/3943464429 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e0009a20 con 0x7f21e806a010 2023-11-30T18:22:22.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.118+0000 7f21ed7e0700 1 --2- 172.21.15.49:0/3943464429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21e80bc320 0x7f21e80a9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:22:22.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.118+0000 7f21edfe1700 1 --2- 172.21.15.49:0/3943464429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21e806a010 0x7f21e80a5360 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f21dc014000 tx=0x7f21dc017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:22.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.118+0000 7f21d9ffb700 1 -- 172.21.15.49:0/3943464429 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc00fe80 con 0x7f21e806a010 2023-11-30T18:22:22.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.118+0000 7f21d9ffb700 1 -- 172.21.15.49:0/3943464429 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21dc006a40 con 0x7f21e806a010 2023-11-30T18:22:22.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.118+0000 7f21f0245700 1 -- 172.21.15.49:0/3943464429 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21dc009370 con 0x7f21e806a010 2023-11-30T18:22:22.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.118+0000 7f21d9ffb700 1 -- 172.21.15.49:0/3943464429 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc00f9f0 con 0x7f21e806a010 2023-11-30T18:22:22.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.118+0000 7f21f0245700 1 -- 172.21.15.49:0/3943464429 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e8091ba0 con 0x7f21e806a010 2023-11-30T18:22:22.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.119+0000 7f21f0245700 1 -- 172.21.15.49:0/3943464429 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21e806c860 con 0x7f21e806a010 2023-11-30T18:22:22.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.120+0000 7f21d9ffb700 1 -- 172.21.15.49:0/3943464429 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 65) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f21dc01c630 con 0x7f21e806a010 2023-11-30T18:22:22.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.120+0000 7f21d9ffb700 1 --2- 172.21.15.49:0/3943464429 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f21cc05f270 0x7f21cc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:22.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.120+0000 7f21d9ffb700 1 -- 172.21.15.49:0/3943464429 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6581+0+0 (secure 0 0 0) 0x7f21dc07bfa0 con 0x7f21e806a010 2023-11-30T18:22:22.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.120+0000 7f21ed7e0700 1 -- 172.21.15.49:0/3943464429 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f21cc05f270 msgr2=0x7f21cc061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:22.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.120+0000 7f21ed7e0700 1 --2- 172.21.15.49:0/3943464429 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f21cc05f270 0x7f21cc061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:22:22.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.124+0000 7f21d9ffb700 1 -- 172.21.15.49:0/3943464429 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f21dc0aab00 con 0x7f21e806a010 2023-11-30T18:22:22.212 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:22.210+0000 7f05d9481680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T18:22:22.238 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:22.236+0000 7f174b642680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T18:22:22.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.321+0000 7f21ed7e0700 1 -- 172.21.15.49:0/3943464429 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f21cc05f270 msgr2=0x7f21cc061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:22.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.321+0000 7f21ed7e0700 1 --2- 172.21.15.49:0/3943464429 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f21cc05f270 0x7f21cc061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T18:22:22.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.340+0000 7f21f0245700 1 -- 172.21.15.49:0/3943464429 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21e80c2270 con 0x7f21e806a010 2023-11-30T18:22:22.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.341+0000 7f21d9ffb700 1 -- 172.21.15.49:0/3943464429 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f21dc020020 con 0x7f21e806a010 2023-11-30T18:22:22.342 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:22:22.343 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":61,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6851,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/4266183168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":4266183168},{"type":"v1","addr":"172.21.15.49:6835","nonce":4266183168}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":7810,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1044019551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1044019551},{"type":"v1","addr":"172.21.15.115:6836","nonce":1044019551}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":7813,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/676160579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":676160579},{"type":"v1","addr":"172.21.15.115:6837","nonce":676160579}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:26:20.358070+0000","modified":"2023-11-30T17:26:23.364931+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8085":{"gid":8085,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/2798044365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2798044365},{"type":"v1","addr":"172.21.15.49:6834","nonce":2798044365}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-11-30T18:22:22.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.343+0000 7f21f0245700 1 -- 172.21.15.49:0/3943464429 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f21cc05f270 msgr2=0x7f21cc061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:22:22.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.343+0000 7f21f0245700 1 --2- 172.21.15.49:0/3943464429 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f21cc05f270 0x7f21cc061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:22.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.343+0000 7f21f0245700 1 -- 172.21.15.49:0/3943464429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21e806a010 msgr2=0x7f21e80a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:22.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.343+0000 7f21f0245700 1 --2- 172.21.15.49:0/3943464429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21e806a010 0x7f21e80a5360 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f21dc014000 tx=0x7f21dc017000).stop 2023-11-30T18:22:22.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.343+0000 7f21f0245700 1 -- 172.21.15.49:0/3943464429 shutdown_connections 2023-11-30T18:22:22.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.343+0000 7f21f0245700 1 --2- 172.21.15.49:0/3943464429 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21e8150890 0x7f21e80a3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:22.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.343+0000 7f21f0245700 1 --2- 172.21.15.49:0/3943464429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21e806a010 0x7f21e80a5360 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:22.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.343+0000 7f21f0245700 1 --2- 172.21.15.49:0/3943464429 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f21cc05f270 0x7f21cc061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:22.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.343+0000 7f21f0245700 1 --2- 172.21.15.49:0/3943464429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21e80bc320 0x7f21e80a9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:22.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.343+0000 7f21f0245700 1 -- 172.21.15.49:0/3943464429 >> 172.21.15.49:0/3943464429 conn(0x7f21e80631d0 msgr2=0x7f21e80c52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:22.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.343+0000 7f21f0245700 1 -- 172.21.15.49:0/3943464429 shutdown_connections 2023-11-30T18:22:22.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.343+0000 7f21f0245700 1 -- 172.21.15.49:0/3943464429 wait complete. 2023-11-30T18:22:22.346 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 61 2023-11-30T18:22:22.358 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:22:22.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.474+0000 7fb58b4b6700 1 Processor -- start 2023-11-30T18:22:22.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.475+0000 7fb58b4b6700 1 -- start start 2023-11-30T18:22:22.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.475+0000 7fb58b4b6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb584064e20 0x7fb584155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:22.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.475+0000 7fb58b4b6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb584095e80 0x7fb584096310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:22.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.475+0000 7fb58b4b6700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb584096800 con 0x7fb5841544d0 2023-11-30T18:22:22.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.475+0000 7fb58b4b6700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb584067650 con 0x7fb584064e20 2023-11-30T18:22:22.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.475+0000 7fb58b4b6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5840683d0 con 0x7fb584095e80 2023-11-30T18:22:22.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.476+0000 7fb588a51700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb584064e20 0x7fb584155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:22.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.476+0000 7fb588a51700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb584064e20 0x7fb584155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45656/0 (socket says 172.21.15.49:45656) 2023-11-30T18:22:22.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.476+0000 7fb588a51700 1 -- 172.21.15.49:0/367032118 learned_addr learned my addr 172.21.15.49:0/367032118 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:22.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.476+0000 7fb589a53700 1 --2- 172.21.15.49:0/367032118 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb584095e80 0x7fb584096310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:22.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.476+0000 7fb588a51700 1 -- 172.21.15.49:0/367032118 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb584095e80 msgr2=0x7fb584096310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:22.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.476+0000 7fb588a51700 1 --2- 172.21.15.49:0/367032118 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb584095e80 0x7fb584096310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:22.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.476+0000 7fb588a51700 1 -- 172.21.15.49:0/367032118 >> v1:172.21.15.115:6789/0 conn(0x7fb5841544d0 legacy=0x7fb584066f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:22.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.476+0000 7fb588a51700 1 -- 172.21.15.49:0/367032118 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb584067850 con 0x7fb584064e20 2023-11-30T18:22:22.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.476+0000 7fb588a51700 1 --2- 172.21.15.49:0/367032118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb584064e20 0x7fb584155750 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7fb574006fd0 tx=0x7fb5740090f0).ready entity=mon.0 client_cookie=2f5e63a8fe48fdbd server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:22.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.476+0000 7fb57bfff700 1 -- 172.21.15.49:0/367032118 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57400b580 con 0x7fb584064e20 2023-11-30T18:22:22.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.476+0000 7fb57bfff700 1 -- 172.21.15.49:0/367032118 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57400b6e0 con 0x7fb584064e20 2023-11-30T18:22:22.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.476+0000 7fb57bfff700 1 -- 172.21.15.49:0/367032118 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57400ba60 con 0x7fb584064e20 2023-11-30T18:22:22.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.477+0000 7fb58b4b6700 1 -- 172.21.15.49:0/367032118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb584064e20 msgr2=0x7fb584155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:22.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.477+0000 7fb58b4b6700 1 --2- 172.21.15.49:0/367032118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb584064e20 0x7fb584155750 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7fb574006fd0 tx=0x7fb5740090f0).stop 2023-11-30T18:22:22.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.477+0000 7fb58b4b6700 1 -- 172.21.15.49:0/367032118 shutdown_connections 2023-11-30T18:22:22.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.477+0000 7fb58b4b6700 1 --2- 172.21.15.49:0/367032118 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb584095e80 0x7fb584096310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:22.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.477+0000 7fb58b4b6700 1 --2- 172.21.15.49:0/367032118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb584064e20 0x7fb584155750 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:22.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.477+0000 7fb58b4b6700 1 -- 172.21.15.49:0/367032118 >> 172.21.15.49:0/367032118 conn(0x7fb5840631d0 msgr2=0x7fb5840c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:22.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.477+0000 7fb58b4b6700 1 -- 172.21.15.49:0/367032118 shutdown_connections 2023-11-30T18:22:22.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.477+0000 7fb58b4b6700 1 -- 172.21.15.49:0/367032118 wait complete. 2023-11-30T18:22:22.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.478+0000 7fb58b4b6700 1 Processor -- start 2023-11-30T18:22:22.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.478+0000 7fb58b4b6700 1 -- start start 2023-11-30T18:22:22.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.479+0000 7fb58b4b6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb584064e20 0x7fb5840c1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:22.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.479+0000 7fb58b4b6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb584095e80 0x7fb58414ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:22.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.479+0000 7fb58b4b6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5841544d0 0x7fb5841554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:22.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.479+0000 7fb58b4b6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5840c0d60 con 0x7fb584064e20 2023-11-30T18:22:22.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.479+0000 7fb58b4b6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5840c1040 con 0x7fb5841544d0 2023-11-30T18:22:22.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.479+0000 7fb58b4b6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5840c1320 con 0x7fb584095e80 2023-11-30T18:22:22.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.479+0000 7fb589252700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb584064e20 0x7fb5840c1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:22.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.479+0000 7fb589252700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb584064e20 0x7fb5840c1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45672/0 (socket says 172.21.15.49:45672) 2023-11-30T18:22:22.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.479+0000 7fb589252700 1 -- 172.21.15.49:0/2049657750 learned_addr learned my addr 172.21.15.49:0/2049657750 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:22.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.479+0000 7fb588a51700 1 --2- 172.21.15.49:0/2049657750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb584095e80 0x7fb58414ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:22.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.479+0000 7fb589a53700 1 --2- 172.21.15.49:0/2049657750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5841544d0 0x7fb5841554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:22.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.480+0000 7fb589252700 1 -- 172.21.15.49:0/2049657750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb584095e80 msgr2=0x7fb58414ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:22.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.480+0000 7fb589252700 1 --2- 172.21.15.49:0/2049657750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb584095e80 0x7fb58414ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:22.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.480+0000 7fb589252700 1 -- 172.21.15.49:0/2049657750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5841544d0 msgr2=0x7fb5841554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:22.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.480+0000 7fb589252700 1 --2- 172.21.15.49:0/2049657750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5841544d0 0x7fb5841554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:22.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.480+0000 7fb589252700 1 -- 172.21.15.49:0/2049657750 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb574009370 con 0x7fb584064e20 2023-11-30T18:22:22.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.480+0000 7fb589252700 1 --2- 172.21.15.49:0/2049657750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb584064e20 0x7fb5840c1e00 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7fb58000c440 tx=0x7fb580007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:22.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.480+0000 7fb5797fa700 1 -- 172.21.15.49:0/2049657750 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb580007020 con 0x7fb584064e20 2023-11-30T18:22:22.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.480+0000 7fb5797fa700 1 -- 172.21.15.49:0/2049657750 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb580007180 con 0x7fb584064e20 2023-11-30T18:22:22.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.480+0000 7fb58b4b6700 1 -- 172.21.15.49:0/2049657750 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5840c1600 con 0x7fb584064e20 2023-11-30T18:22:22.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.480+0000 7fb5797fa700 1 -- 172.21.15.49:0/2049657750 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb580007520 con 0x7fb584064e20 2023-11-30T18:22:22.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.480+0000 7fb58b4b6700 1 -- 172.21.15.49:0/2049657750 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5840c22f0 con 0x7fb584064e20 2023-11-30T18:22:22.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.481+0000 7fb58b4b6700 1 -- 172.21.15.49:0/2049657750 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb58406c860 con 0x7fb584064e20 2023-11-30T18:22:22.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.481+0000 7fb5797fa700 1 -- 172.21.15.49:0/2049657750 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 65) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fb580006900 con 0x7fb584064e20 2023-11-30T18:22:22.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.482+0000 7fb5797fa700 1 --2- 172.21.15.49:0/2049657750 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb56805f270 0x7fb568061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:22.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.482+0000 7fb5797fa700 1 -- 172.21.15.49:0/2049657750 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6581+0+0 (secure 0 0 0) 0x7fb580079860 con 0x7fb584064e20 2023-11-30T18:22:22.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.482+0000 7fb588a51700 1 -- 172.21.15.49:0/2049657750 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb56805f270 msgr2=0x7fb568061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:22.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.482+0000 7fb588a51700 1 --2- 172.21.15.49:0/2049657750 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb56805f270 0x7fb568061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:22:22.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.486+0000 7fb5797fa700 1 -- 172.21.15.49:0/2049657750 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb580047b00 con 0x7fb584064e20 2023-11-30T18:22:22.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.661+0000 7fb58b4b6700 1 -- 172.21.15.49:0/2049657750 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb584067b30 con 0x7fb584064e20 2023-11-30T18:22:22.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.662+0000 7fb5797fa700 1 -- 172.21.15.49:0/2049657750 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) v1 ==== 74+0+17667 (secure 0 0 0) 0x7fb58004a7e0 con 0x7fb584064e20 2023-11-30T18:22:22.664 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:22:22.664 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":154,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:22:21.696592+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:26:18.350122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-11-30T17:26:19.327933+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":112,"snap_epoch":154,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.1a","mappings":[{"from":0,"to":5}]},{"pgid":"17.3c","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/1086530775":"2023-12-01T17:26:32.594059+0000","172.21.15.115:0/390416334":"2023-12-01T17:26:32.594059+0000","172.21.15.115:0/2966399435":"2023-12-01T17:26:32.594059+0000","172.21.15.115:6833/89956":"2023-12-01T17:26:32.594059+0000","172.21.15.115:6832/89956":"2023-12-01T17:26:32.594059+0000","172.21.15.115:0/3029851732":"2023-12-01T17:26:32.594059+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":54},{"begin":59,"length":54}]}],"new_removed_snaps":[{"pool":18,"snaps":[{"begin":52,"length":5},{"begin":108,"length":5}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:22:22.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.665+0000 7fb58b4b6700 1 -- 172.21.15.49:0/2049657750 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb56805f270 msgr2=0x7fb568061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:22:22.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.665+0000 7fb58b4b6700 1 --2- 172.21.15.49:0/2049657750 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb56805f270 0x7fb568061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:22.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.665+0000 7fb58b4b6700 1 -- 172.21.15.49:0/2049657750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb584064e20 msgr2=0x7fb5840c1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:22.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.665+0000 7fb58b4b6700 1 --2- 172.21.15.49:0/2049657750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb584064e20 0x7fb5840c1e00 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7fb58000c440 tx=0x7fb580007e50).stop 2023-11-30T18:22:22.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.665+0000 7fb58b4b6700 1 -- 172.21.15.49:0/2049657750 shutdown_connections 2023-11-30T18:22:22.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.665+0000 7fb58b4b6700 1 --2- 172.21.15.49:0/2049657750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5841544d0 0x7fb5841554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:22.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.665+0000 7fb58b4b6700 1 --2- 172.21.15.49:0/2049657750 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb56805f270 0x7fb568061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:22.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.665+0000 7fb58b4b6700 1 --2- 172.21.15.49:0/2049657750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb584064e20 0x7fb5840c1e00 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:22.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.665+0000 7fb58b4b6700 1 --2- 172.21.15.49:0/2049657750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb584095e80 0x7fb58414ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:22.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.665+0000 7fb58b4b6700 1 -- 172.21.15.49:0/2049657750 >> 172.21.15.49:0/2049657750 conn(0x7fb5840631d0 msgr2=0x7fb58414d490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:22.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.665+0000 7fb58b4b6700 1 -- 172.21.15.49:0/2049657750 shutdown_connections 2023-11-30T18:22:22.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.666+0000 7fb58b4b6700 1 -- 172.21.15.49:0/2049657750 wait complete. 2023-11-30T18:22:22.685 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '149', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-30T17:26:18.350122+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '145', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-11-30T17:26:19.327933+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '154', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 112, 'snap_epoch': 154, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-30T18:22:22.686 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T18:22:22.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.808+0000 7fa88864a700 1 Processor -- start 2023-11-30T18:22:22.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.808+0000 7fa88864a700 1 -- start start 2023-11-30T18:22:22.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.809+0000 7fa88864a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa880098d10 0x7fa8800c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:22.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.809+0000 7fa88864a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa880158320 0x7fa8801587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:22.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.809+0000 7fa88864a700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa880158cc0 con 0x7fa8800c6190 2023-11-30T18:22:22.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.809+0000 7fa88864a700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8800c72d0 con 0x7fa880098d10 2023-11-30T18:22:22.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.809+0000 7fa88864a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa880064570 con 0x7fa880158320 2023-11-30T18:22:22.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.809+0000 7fa886be7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa880158320 0x7fa8801587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:22.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.809+0000 7fa8863e6700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa880098d10 0x7fa8800c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:22.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.810+0000 7fa8863e6700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa880098d10 0x7fa8800c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:42186/0 (socket says 172.21.15.49:42186) 2023-11-30T18:22:22.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.810+0000 7fa885be5700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa8800c6190 0x7fa880063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:38660/0 (socket says 172.21.15.49:38660) 2023-11-30T18:22:22.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.810+0000 7fa8863e6700 1 -- 172.21.15.49:0/3999927164 learned_addr learned my addr 172.21.15.49:0/3999927164 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:22.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.810+0000 7fa886be7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa880158320 0x7fa8801587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:36818/0 (socket says 172.21.15.49:36818) 2023-11-30T18:22:22.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.810+0000 7fa8863e6700 1 -- 172.21.15.49:0/3999927164 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa880158320 msgr2=0x7fa8801587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:22.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.810+0000 7fa8863e6700 1 --2- 172.21.15.49:0/3999927164 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa880158320 0x7fa8801587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:22.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.810+0000 7fa8863e6700 1 -- 172.21.15.49:0/3999927164 >> v1:172.21.15.115:6789/0 conn(0x7fa8800c6190 legacy=0x7fa880063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:22.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.810+0000 7fa8863e6700 1 -- 172.21.15.49:0/3999927164 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa880154bc0 con 0x7fa880098d10 2023-11-30T18:22:22.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.810+0000 7fa8863e6700 1 --2- 172.21.15.49:0/3999927164 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa880098d10 0x7fa8800c7760 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fa870006fd0 tx=0x7fa8700090f0).ready entity=mon.1 client_cookie=da78c39c73051153 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:22.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.811+0000 7fa8853e4700 1 -- 172.21.15.49:0/3999927164 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87000b580 con 0x7fa880098d10 2023-11-30T18:22:22.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.811+0000 7fa8853e4700 1 -- 172.21.15.49:0/3999927164 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87000b6e0 con 0x7fa880098d10 2023-11-30T18:22:22.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.811+0000 7fa8853e4700 1 -- 172.21.15.49:0/3999927164 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87000ba60 con 0x7fa880098d10 2023-11-30T18:22:22.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.811+0000 7fa88864a700 1 -- 172.21.15.49:0/3999927164 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa880098d10 msgr2=0x7fa8800c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:22.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.811+0000 7fa88864a700 1 --2- 172.21.15.49:0/3999927164 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa880098d10 0x7fa8800c7760 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fa870006fd0 tx=0x7fa8700090f0).stop 2023-11-30T18:22:22.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.811+0000 7fa88864a700 1 -- 172.21.15.49:0/3999927164 shutdown_connections 2023-11-30T18:22:22.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.811+0000 7fa88864a700 1 --2- 172.21.15.49:0/3999927164 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa880158320 0x7fa8801587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:22.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.811+0000 7fa88864a700 1 --2- 172.21.15.49:0/3999927164 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa880098d10 0x7fa8800c7760 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:22.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.811+0000 7fa88864a700 1 -- 172.21.15.49:0/3999927164 >> 172.21.15.49:0/3999927164 conn(0x7fa8800cb310 msgr2=0x7fa8800cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:22.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.811+0000 7fa88864a700 1 -- 172.21.15.49:0/3999927164 shutdown_connections 2023-11-30T18:22:22.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.811+0000 7fa88864a700 1 -- 172.21.15.49:0/3999927164 wait complete. 2023-11-30T18:22:22.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.812+0000 7fa88864a700 1 Processor -- start 2023-11-30T18:22:22.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.813+0000 7fa88864a700 1 -- start start 2023-11-30T18:22:22.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.813+0000 7fa88864a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa880098d10 0x7fa8800b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:22.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.813+0000 7fa88864a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8800c6190 0x7fa8800aff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:22.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.813+0000 7fa88864a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa880158320 0x7fa8800b0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:22.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.813+0000 7fa88864a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8801576c0 con 0x7fa8800c6190 2023-11-30T18:22:22.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.813+0000 7fa88864a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8800ac390 con 0x7fa880098d10 2023-11-30T18:22:22.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.813+0000 7fa88864a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8800ab780 con 0x7fa880158320 2023-11-30T18:22:22.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.813+0000 7fa885be5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8800c6190 0x7fa8800aff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:22.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.813+0000 7fa885be5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8800c6190 0x7fa8800aff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45678/0 (socket says 172.21.15.49:45678) 2023-11-30T18:22:22.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.813+0000 7fa885be5700 1 -- 172.21.15.49:0/3196452580 learned_addr learned my addr 172.21.15.49:0/3196452580 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:22.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.813+0000 7fa8863e6700 1 --2- 172.21.15.49:0/3196452580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa880098d10 0x7fa8800b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:22.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.813+0000 7fa886be7700 1 --2- 172.21.15.49:0/3196452580 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa880158320 0x7fa8800b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:22.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.814+0000 7fa885be5700 1 -- 172.21.15.49:0/3196452580 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa880158320 msgr2=0x7fa8800b0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:22.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.814+0000 7fa885be5700 1 --2- 172.21.15.49:0/3196452580 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa880158320 0x7fa8800b0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:22.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.814+0000 7fa885be5700 1 -- 172.21.15.49:0/3196452580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa880098d10 msgr2=0x7fa8800b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:22.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.814+0000 7fa885be5700 1 --2- 172.21.15.49:0/3196452580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa880098d10 0x7fa8800b0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:22.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.814+0000 7fa885be5700 1 -- 172.21.15.49:0/3196452580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa870009370 con 0x7fa8800c6190 2023-11-30T18:22:22.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.814+0000 7fa885be5700 1 --2- 172.21.15.49:0/3196452580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8800c6190 0x7fa8800aff30 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7fa87c00c4f0 tx=0x7fa87c007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:22.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.814+0000 7fa8767fc700 1 -- 172.21.15.49:0/3196452580 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c00ce90 con 0x7fa8800c6190 2023-11-30T18:22:22.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.814+0000 7fa8767fc700 1 -- 172.21.15.49:0/3196452580 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87c0072e0 con 0x7fa8800c6190 2023-11-30T18:22:22.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.814+0000 7fa88864a700 1 -- 172.21.15.49:0/3196452580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8800aba60 con 0x7fa8800c6190 2023-11-30T18:22:22.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.814+0000 7fa8767fc700 1 -- 172.21.15.49:0/3196452580 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c0056e0 con 0x7fa8800c6190 2023-11-30T18:22:22.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.814+0000 7fa88864a700 1 -- 172.21.15.49:0/3196452580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8800ac020 con 0x7fa8800c6190 2023-11-30T18:22:22.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.815+0000 7fa88864a700 1 -- 172.21.15.49:0/3196452580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8800ac520 con 0x7fa8800c6190 2023-11-30T18:22:22.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.816+0000 7fa8767fc700 1 -- 172.21.15.49:0/3196452580 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 65) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fa87c005b10 con 0x7fa8800c6190 2023-11-30T18:22:22.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.816+0000 7fa8767fc700 1 --2- 172.21.15.49:0/3196452580 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa86405f240 0x7fa864061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:22.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.816+0000 7fa8863e6700 1 -- 172.21.15.49:0/3196452580 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa86405f240 msgr2=0x7fa864061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:22.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.816+0000 7fa8767fc700 1 -- 172.21.15.49:0/3196452580 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6581+0+0 (secure 0 0 0) 0x7fa87c0799f0 con 0x7fa8800c6190 2023-11-30T18:22:22.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.816+0000 7fa8863e6700 1 --2- 172.21.15.49:0/3196452580 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa86405f240 0x7fa864061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:22:22.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:22.824+0000 7fa8767fc700 1 -- 172.21.15.49:0/3196452580 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa87c04a970 con 0x7fa8800c6190 2023-11-30T18:22:22.828 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:22.826+0000 7f05d9481680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T18:22:22.900 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:22.899+0000 7f05d9481680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T18:22:22.931 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:22.929+0000 7f174b642680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T18:22:22.999 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:22.998+0000 7f174b642680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T18:22:23.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.017+0000 7fa8863e6700 1 -- 172.21.15.49:0/3196452580 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa86405f240 msgr2=0x7fa864061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:23.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.017+0000 7fa8863e6700 1 --2- 172.21.15.49:0/3196452580 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa86405f240 0x7fa864061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T18:22:23.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.045+0000 7fa88864a700 1 -- 172.21.15.49:0/3196452580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa880158cc0 con 0x7fa8800c6190 2023-11-30T18:22:23.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.046+0000 7fa8767fc700 1 -- 172.21.15.49:0/3196452580 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v154) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa880158cc0 con 0x7fa8800c6190 2023-11-30T18:22:23.047 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T18:22:23.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.048+0000 7fa88864a700 1 -- 172.21.15.49:0/3196452580 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa86405f240 msgr2=0x7fa864061700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:22:23.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.048+0000 7fa88864a700 1 --2- 172.21.15.49:0/3196452580 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa86405f240 0x7fa864061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:23.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.048+0000 7fa88864a700 1 -- 172.21.15.49:0/3196452580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8800c6190 msgr2=0x7fa8800aff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:23.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.048+0000 7fa88864a700 1 --2- 172.21.15.49:0/3196452580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8800c6190 0x7fa8800aff30 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7fa87c00c4f0 tx=0x7fa87c007dc0).stop 2023-11-30T18:22:23.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.048+0000 7fa88864a700 1 -- 172.21.15.49:0/3196452580 shutdown_connections 2023-11-30T18:22:23.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.048+0000 7fa88864a700 1 --2- 172.21.15.49:0/3196452580 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa880158320 0x7fa8800b0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:23.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.048+0000 7fa88864a700 1 --2- 172.21.15.49:0/3196452580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa880098d10 0x7fa8800b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:23.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.048+0000 7fa88864a700 1 --2- 172.21.15.49:0/3196452580 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa86405f240 0x7fa864061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:23.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.048+0000 7fa88864a700 1 --2- 172.21.15.49:0/3196452580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8800c6190 0x7fa8800aff30 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:23.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.048+0000 7fa88864a700 1 -- 172.21.15.49:0/3196452580 >> 172.21.15.49:0/3196452580 conn(0x7fa8800cb310 msgr2=0x7fa880151c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:23.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.048+0000 7fa88864a700 1 -- 172.21.15.49:0/3196452580 shutdown_connections 2023-11-30T18:22:23.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.048+0000 7fa88864a700 1 -- 172.21.15.49:0/3196452580 wait complete. 2023-11-30T18:22:23.063 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T18:22:23.086 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:23.085+0000 7f05d9481680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T18:22:23.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.184+0000 7fdef60db700 1 Processor -- start 2023-11-30T18:22:23.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.184+0000 7fdef60db700 1 -- start start 2023-11-30T18:22:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.185+0000 7fdef60db700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdef01547f0 0x7fdef00a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.185+0000 7fdef60db700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef00c7e30 con 0x7fdef00c86f0 2023-11-30T18:22:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.185+0000 7fdef60db700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef00bcf40 con 0x7fdef0062700 2023-11-30T18:22:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.185+0000 7fdef60db700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdef00c6b20 con 0x7fdef01547f0 2023-11-30T18:22:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.185+0000 7fdeeeffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdef00c86f0 0x7fdef00c6fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:54972/0 (socket says 172.21.15.49:54972) 2023-11-30T18:22:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.185+0000 7fdeeeffd700 1 -- 172.21.15.49:0/166025643 learned_addr learned my addr 172.21.15.49:0/166025643 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:22:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.185+0000 7fdeef7fe700 1 --2- 172.21.15.49:0/166025643 >> v2:172.21.15.115:3300/0 conn(0x7fdef01547f0 0x7fdef00a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.186+0000 7fdeee7fc700 1 -- 172.21.15.49:0/166025643 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2047705835 0 0) 0x7fdef00c7e30 con 0x7fdef00c86f0 2023-11-30T18:22:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.186+0000 7fdeee7fc700 1 -- 172.21.15.49:0/166025643 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fded80033f0 con 0x7fdef00c86f0 2023-11-30T18:22:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.186+0000 7fdeef7fe700 1 -- 172.21.15.49:0/166025643 >> v1:172.21.15.115:6789/0 conn(0x7fdef0062700 legacy=0x7fdef00a4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.186+0000 7fdeef7fe700 1 -- 172.21.15.49:0/166025643 >> v1:172.21.15.49:6789/0 conn(0x7fdef00c86f0 legacy=0x7fdef00c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.186+0000 7fdeef7fe700 1 -- 172.21.15.49:0/166025643 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef00a77d0 con 0x7fdef01547f0 2023-11-30T18:22:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.186+0000 7fdeef7fe700 1 --2- 172.21.15.49:0/166025643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdef01547f0 0x7fdef00a72e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7fdee0009760 tx=0x7fdee0009060).ready entity=mon.1 client_cookie=f5d791b0dfe17e79 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.186+0000 7fdeee7fc700 1 -- 172.21.15.49:0/166025643 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee00090d0 con 0x7fdef01547f0 2023-11-30T18:22:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.186+0000 7fdeee7fc700 1 -- 172.21.15.49:0/166025643 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee000f510 con 0x7fdef01547f0 2023-11-30T18:22:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.186+0000 7fdeee7fc700 1 -- 172.21.15.49:0/166025643 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee000f890 con 0x7fdef01547f0 2023-11-30T18:22:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.187+0000 7fdef60db700 1 -- 172.21.15.49:0/166025643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdef01547f0 msgr2=0x7fdef00a72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.187+0000 7fdef60db700 1 --2- 172.21.15.49:0/166025643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdef01547f0 0x7fdef00a72e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7fdee0009760 tx=0x7fdee0009060).stop 2023-11-30T18:22:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.187+0000 7fdef60db700 1 -- 172.21.15.49:0/166025643 shutdown_connections 2023-11-30T18:22:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.187+0000 7fdef60db700 1 --2- 172.21.15.49:0/166025643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdef01547f0 0x7fdef00a72e0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:23.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.187+0000 7fdef60db700 1 -- 172.21.15.49:0/166025643 >> 172.21.15.49:0/166025643 conn(0x7fdef00642d0 msgr2=0x7fdef00c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:23.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.187+0000 7fdef60db700 1 -- 172.21.15.49:0/166025643 shutdown_connections 2023-11-30T18:22:23.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.187+0000 7fdef60db700 1 -- 172.21.15.49:0/166025643 wait complete. 2023-11-30T18:22:23.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.188+0000 7fdef60db700 1 Processor -- start 2023-11-30T18:22:23.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.188+0000 7fdef60db700 1 -- start start 2023-11-30T18:22:23.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.189+0000 7fdef60db700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdef0062700 0x7fdef0168ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:23.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.189+0000 7fdef60db700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdef00c86f0 0x7fdef01649a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:23.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.189+0000 7fdef60db700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdef01547f0 0x7fdef0164e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:23.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.189+0000 7fdef60db700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef0165380 con 0x7fdef0062700 2023-11-30T18:22:23.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.189+0000 7fdef60db700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef0165860 con 0x7fdef00c86f0 2023-11-30T18:22:23.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.189+0000 7fdef60db700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef014d340 con 0x7fdef01547f0 2023-11-30T18:22:23.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.189+0000 7fdeef7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdef0062700 0x7fdef0168ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:23.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.189+0000 7fdeef7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdef0062700 0x7fdef0168ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45694/0 (socket says 172.21.15.49:45694) 2023-11-30T18:22:23.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.189+0000 7fdeef7fe700 1 -- 172.21.15.49:0/1918085271 learned_addr learned my addr 172.21.15.49:0/1918085271 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:23.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.189+0000 7fdeeeffd700 1 --2- 172.21.15.49:0/1918085271 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdef00c86f0 0x7fdef01649a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:23.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.189+0000 7fdeeffff700 1 --2- 172.21.15.49:0/1918085271 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdef01547f0 0x7fdef0164e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:23.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.189+0000 7fdeef7fe700 1 -- 172.21.15.49:0/1918085271 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdef01547f0 msgr2=0x7fdef0164e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:23.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.189+0000 7fdeef7fe700 1 --2- 172.21.15.49:0/1918085271 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdef01547f0 0x7fdef0164e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:23.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.189+0000 7fdeef7fe700 1 -- 172.21.15.49:0/1918085271 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdef00c86f0 msgr2=0x7fdef01649a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:23.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.189+0000 7fdeef7fe700 1 --2- 172.21.15.49:0/1918085271 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdef00c86f0 0x7fdef01649a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:23.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.189+0000 7fdeef7fe700 1 -- 172.21.15.49:0/1918085271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee00092a0 con 0x7fdef0062700 2023-11-30T18:22:23.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.189+0000 7fdeef7fe700 1 --2- 172.21.15.49:0/1918085271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdef0062700 0x7fdef0168ad0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7fdee0009e00 tx=0x7fdee0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:23.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.190+0000 7fded77fe700 1 -- 172.21.15.49:0/1918085271 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee000f890 con 0x7fdef0062700 2023-11-30T18:22:23.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.190+0000 7fded77fe700 1 -- 172.21.15.49:0/1918085271 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee000fc50 con 0x7fdef0062700 2023-11-30T18:22:23.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.190+0000 7fdef60db700 1 -- 172.21.15.49:0/1918085271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef0167ff0 con 0x7fdef0062700 2023-11-30T18:22:23.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.190+0000 7fded77fe700 1 -- 172.21.15.49:0/1918085271 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee001b410 con 0x7fdef0062700 2023-11-30T18:22:23.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.190+0000 7fdef60db700 1 -- 172.21.15.49:0/1918085271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef01685b0 con 0x7fdef0062700 2023-11-30T18:22:23.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.191+0000 7fdef60db700 1 -- 172.21.15.49:0/1918085271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef006c860 con 0x7fdef0062700 2023-11-30T18:22:23.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.191+0000 7fded77fe700 1 -- 172.21.15.49:0/1918085271 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 65) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fdee001b800 con 0x7fdef0062700 2023-11-30T18:22:23.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.192+0000 7fded77fe700 1 --2- 172.21.15.49:0/1918085271 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdedc05f270 0x7fdedc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:23.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.192+0000 7fdeeeffd700 1 -- 172.21.15.49:0/1918085271 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdedc05f270 msgr2=0x7fdedc061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:23.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.192+0000 7fded77fe700 1 -- 172.21.15.49:0/1918085271 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6581+0+0 (secure 0 0 0) 0x7fdee007beb0 con 0x7fdef0062700 2023-11-30T18:22:23.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.192+0000 7fdeeeffd700 1 --2- 172.21.15.49:0/1918085271 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdedc05f270 0x7fdedc061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:22:23.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.196+0000 7fded77fe700 1 -- 172.21.15.49:0/1918085271 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdee004ce30 con 0x7fdef0062700 2023-11-30T18:22:23.198 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:23.196+0000 7f174b642680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T18:22:23.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.370+0000 7fdef60db700 1 -- 172.21.15.49:0/1918085271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdef0065290 con 0x7fdef0062700 2023-11-30T18:22:23.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.371+0000 7fded77fe700 1 -- 172.21.15.49:0/1918085271 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v154) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdee0029020 con 0x7fdef0062700 2023-11-30T18:22:23.372 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T18:22:23.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.373+0000 7fdef60db700 1 -- 172.21.15.49:0/1918085271 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdedc05f270 msgr2=0x7fdedc061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:22:23.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.373+0000 7fdef60db700 1 --2- 172.21.15.49:0/1918085271 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdedc05f270 0x7fdedc061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:23.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.373+0000 7fdef60db700 1 -- 172.21.15.49:0/1918085271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdef0062700 msgr2=0x7fdef0168ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:23.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.373+0000 7fdef60db700 1 --2- 172.21.15.49:0/1918085271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdef0062700 0x7fdef0168ad0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7fdee0009e00 tx=0x7fdee0017000).stop 2023-11-30T18:22:23.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.373+0000 7fdef60db700 1 -- 172.21.15.49:0/1918085271 shutdown_connections 2023-11-30T18:22:23.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.373+0000 7fdef60db700 1 --2- 172.21.15.49:0/1918085271 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdef01547f0 0x7fdef0164e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:23.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.373+0000 7fdef60db700 1 --2- 172.21.15.49:0/1918085271 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdedc05f270 0x7fdedc061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:23.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.373+0000 7fdef60db700 1 --2- 172.21.15.49:0/1918085271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdef0062700 0x7fdef0168ad0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:23.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.373+0000 7fdef60db700 1 --2- 172.21.15.49:0/1918085271 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdef00c86f0 0x7fdef01649a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:23.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.373+0000 7fdef60db700 1 -- 172.21.15.49:0/1918085271 >> 172.21.15.49:0/1918085271 conn(0x7fdef00642d0 msgr2=0x7fdef015a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:23.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.373+0000 7fdef60db700 1 -- 172.21.15.49:0/1918085271 shutdown_connections 2023-11-30T18:22:23.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.373+0000 7fdef60db700 1 -- 172.21.15.49:0/1918085271 wait complete. 2023-11-30T18:22:23.387 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-30T18:22:23.507 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:23.506+0000 7f05d9481680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T18:22:23.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.511+0000 7f21468c9700 1 Processor -- start 2023-11-30T18:22:23.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.511+0000 7f21468c9700 1 -- start start 2023-11-30T18:22:23.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.512+0000 7f21468c9700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f21400c66f0 0x7f2140154950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:23.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.512+0000 7f21468c9700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2140154e40 con 0x7f214014e530 2023-11-30T18:22:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.512+0000 7f21468c9700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21400c7bc0 con 0x7f2140158570 2023-11-30T18:22:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.512+0000 7f21468c9700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21400c6ba0 con 0x7f21400c66f0 2023-11-30T18:22:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.512+0000 7f21450c6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f21400c66f0 0x7f2140154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.512+0000 7f21450c6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f21400c66f0 0x7f2140154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45698/0 (socket says 172.21.15.49:45698) 2023-11-30T18:22:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.512+0000 7f21450c6700 1 -- 172.21.15.49:0/84618896 learned_addr learned my addr 172.21.15.49:0/84618896 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.512+0000 7f21458c7700 1 --1- 172.21.15.49:0/84618896 >> v1:172.21.15.49:6789/0 conn(0x7f214014e530 0x7f214014e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:54988/0 (socket says 172.21.15.49:54988) 2023-11-30T18:22:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.512+0000 7f21450c6700 1 -- 172.21.15.49:0/84618896 >> v1:172.21.15.115:6789/0 conn(0x7f2140158570 legacy=0x7f21400aa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.512+0000 7f21450c6700 1 -- 172.21.15.49:0/84618896 >> v1:172.21.15.49:6789/0 conn(0x7f214014e530 legacy=0x7f214014e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.512+0000 7f21448c5700 1 -- 172.21.15.49:0/84618896 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2595093987 0 0) 0x7f213c001110 con 0x7f214014e530 2023-11-30T18:22:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.512+0000 7f21450c6700 1 -- 172.21.15.49:0/84618896 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2140155920 con 0x7f21400c66f0 2023-11-30T18:22:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.512+0000 7f21450c6700 1 --2- 172.21.15.49:0/84618896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21400c66f0 0x7f2140154950 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7f2130006fd0 tx=0x7f21300090f0).ready entity=mon.0 client_cookie=6314d6b2cde514f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.513+0000 7f21448c5700 1 -- 172.21.15.49:0/84618896 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213000b600 con 0x7f21400c66f0 2023-11-30T18:22:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.513+0000 7f21448c5700 1 -- 172.21.15.49:0/84618896 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213000b760 con 0x7f21400c66f0 2023-11-30T18:22:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.513+0000 7f21448c5700 1 -- 172.21.15.49:0/84618896 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213000bae0 con 0x7f21400c66f0 2023-11-30T18:22:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.513+0000 7f21468c9700 1 -- 172.21.15.49:0/84618896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21400c66f0 msgr2=0x7f2140154950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.513+0000 7f21468c9700 1 --2- 172.21.15.49:0/84618896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21400c66f0 0x7f2140154950 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7f2130006fd0 tx=0x7f21300090f0).stop 2023-11-30T18:22:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.513+0000 7f21468c9700 1 -- 172.21.15.49:0/84618896 shutdown_connections 2023-11-30T18:22:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.513+0000 7f21468c9700 1 --2- 172.21.15.49:0/84618896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21400c66f0 0x7f2140154950 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.513+0000 7f21468c9700 1 -- 172.21.15.49:0/84618896 >> 172.21.15.49:0/84618896 conn(0x7f2140064990 msgr2=0x7f2140064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.513+0000 7f21468c9700 1 -- 172.21.15.49:0/84618896 shutdown_connections 2023-11-30T18:22:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.513+0000 7f21468c9700 1 -- 172.21.15.49:0/84618896 wait complete. 2023-11-30T18:22:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.514+0000 7f21468c9700 1 Processor -- start 2023-11-30T18:22:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.514+0000 7f21468c9700 1 -- start start 2023-11-30T18:22:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.515+0000 7f21468c9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21400c66f0 0x7f21400c22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.515+0000 7f21468c9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f214014e530 0x7f21400af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.515+0000 7f21468c9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2140158570 0x7f2140167d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.515+0000 7f21468c9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21400c4840 con 0x7f21400c66f0 2023-11-30T18:22:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.515+0000 7f21468c9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21400b08f0 con 0x7f214014e530 2023-11-30T18:22:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.515+0000 7f21468c9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21400af850 con 0x7f2140158570 2023-11-30T18:22:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.515+0000 7f21458c7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21400c66f0 0x7f21400c22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:23.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.515+0000 7f21458c7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21400c66f0 0x7f21400c22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45712/0 (socket says 172.21.15.49:45712) 2023-11-30T18:22:23.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.515+0000 7f21458c7700 1 -- 172.21.15.49:0/554446430 learned_addr learned my addr 172.21.15.49:0/554446430 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:23.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.515+0000 7f21450c6700 1 --2- 172.21.15.49:0/554446430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f214014e530 0x7f21400af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:23.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.515+0000 7f21460c8700 1 --2- 172.21.15.49:0/554446430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2140158570 0x7f2140167d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:23.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.516+0000 7f21458c7700 1 -- 172.21.15.49:0/554446430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2140158570 msgr2=0x7f2140167d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:23.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.516+0000 7f21458c7700 1 --2- 172.21.15.49:0/554446430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2140158570 0x7f2140167d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:23.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.516+0000 7f21458c7700 1 -- 172.21.15.49:0/554446430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f214014e530 msgr2=0x7f21400af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:23.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.516+0000 7f21458c7700 1 --2- 172.21.15.49:0/554446430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f214014e530 0x7f21400af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:23.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.516+0000 7f21458c7700 1 -- 172.21.15.49:0/554446430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2130009370 con 0x7f21400c66f0 2023-11-30T18:22:23.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.516+0000 7f21458c7700 1 --2- 172.21.15.49:0/554446430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21400c66f0 0x7f21400c22b0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7f213c00c4f0 tx=0x7f213c007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:23.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.516+0000 7f2135ffb700 1 -- 172.21.15.49:0/554446430 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c00ce40 con 0x7f21400c66f0 2023-11-30T18:22:23.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.516+0000 7f2135ffb700 1 -- 172.21.15.49:0/554446430 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213c0072e0 con 0x7f21400c66f0 2023-11-30T18:22:23.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.516+0000 7f21468c9700 1 -- 172.21.15.49:0/554446430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21400afb30 con 0x7f21400c66f0 2023-11-30T18:22:23.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.516+0000 7f2135ffb700 1 -- 172.21.15.49:0/554446430 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c0056e0 con 0x7f21400c66f0 2023-11-30T18:22:23.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.516+0000 7f21468c9700 1 -- 172.21.15.49:0/554446430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21400b00f0 con 0x7f21400c66f0 2023-11-30T18:22:23.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.517+0000 7f21468c9700 1 -- 172.21.15.49:0/554446430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2140062ee0 con 0x7f21400c66f0 2023-11-30T18:22:23.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.518+0000 7f2135ffb700 1 -- 172.21.15.49:0/554446430 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 65) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f213c005a90 con 0x7f21400c66f0 2023-11-30T18:22:23.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.518+0000 7f2135ffb700 1 --2- 172.21.15.49:0/554446430 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f212405f270 0x7f2124061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:23.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.519+0000 7f21450c6700 1 -- 172.21.15.49:0/554446430 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f212405f270 msgr2=0x7f2124061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:23.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.519+0000 7f2135ffb700 1 -- 172.21.15.49:0/554446430 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6581+0+0 (secure 0 0 0) 0x7f213c07a1f0 con 0x7f21400c66f0 2023-11-30T18:22:23.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.519+0000 7f21450c6700 1 --2- 172.21.15.49:0/554446430 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f212405f270 0x7f2124061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:22:23.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.522+0000 7f2135ffb700 1 -- 172.21.15.49:0/554446430 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f213c04b130 con 0x7f21400c66f0 2023-11-30T18:22:23.612 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:23.610+0000 7f05d9481680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:22:23.644 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:23.643+0000 7f174b642680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T18:22:23.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.697+0000 7f21468c9700 1 -- 172.21.15.49:0/554446430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f21400b0730 con 0x7f21400c66f0 2023-11-30T18:22:23.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.697+0000 7f2135ffb700 1 -- 172.21.15.49:0/554446430 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v154) v1 ==== 104+0+11 (secure 0 0 0) 0x7f21400b0730 con 0x7f21400c66f0 2023-11-30T18:22:23.699 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T18:22:23.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.699+0000 7f21468c9700 1 -- 172.21.15.49:0/554446430 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f212405f270 msgr2=0x7f2124061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:22:23.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.699+0000 7f21468c9700 1 --2- 172.21.15.49:0/554446430 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f212405f270 0x7f2124061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:23.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.699+0000 7f21468c9700 1 -- 172.21.15.49:0/554446430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21400c66f0 msgr2=0x7f21400c22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:23.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.699+0000 7f21468c9700 1 --2- 172.21.15.49:0/554446430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21400c66f0 0x7f21400c22b0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7f213c00c4f0 tx=0x7f213c007a90).stop 2023-11-30T18:22:23.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.699+0000 7f21468c9700 1 -- 172.21.15.49:0/554446430 shutdown_connections 2023-11-30T18:22:23.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.699+0000 7f21468c9700 1 --2- 172.21.15.49:0/554446430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2140158570 0x7f2140167d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:23.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.699+0000 7f21468c9700 1 --2- 172.21.15.49:0/554446430 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f212405f270 0x7f2124061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:23.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.699+0000 7f21468c9700 1 --2- 172.21.15.49:0/554446430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21400c66f0 0x7f21400c22b0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:23.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.699+0000 7f21468c9700 1 --2- 172.21.15.49:0/554446430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f214014e530 0x7f21400af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:23.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.699+0000 7f21468c9700 1 -- 172.21.15.49:0/554446430 >> 172.21.15.49:0/554446430 conn(0x7f2140064990 msgr2=0x7f21400c18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:23.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.699+0000 7f21468c9700 1 -- 172.21.15.49:0/554446430 shutdown_connections 2023-11-30T18:22:23.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.699+0000 7f21468c9700 1 -- 172.21.15.49:0/554446430 wait complete. 2023-11-30T18:22:23.714 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-30T18:22:23.756 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:23.755+0000 7f174b642680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:22:23.766 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:23.764+0000 7f05d9481680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T18:22:23.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.836+0000 7fc1787bd700 1 Processor -- start 2023-11-30T18:22:23.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.836+0000 7fc1787bd700 1 -- start start 2023-11-30T18:22:23.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.837+0000 7fc1787bd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc1701547f0 0x7fc1700a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:23.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.837+0000 7fc1787bd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc1700c86f0 0x7fc1700c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:23.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.837+0000 7fc1787bd700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1700c7e30 con 0x7fc170062700 2023-11-30T18:22:23.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.837+0000 7fc1787bd700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1700bcf40 con 0x7fc1700c86f0 2023-11-30T18:22:23.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.837+0000 7fc1787bd700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1700c6b20 con 0x7fc1701547f0 2023-11-30T18:22:23.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.838+0000 7fc176d5a700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc170062700 0x7fc1700a4db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:54990/0 (socket says 172.21.15.49:54990) 2023-11-30T18:22:23.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.838+0000 7fc176d5a700 1 -- 172.21.15.49:0/1669908496 learned_addr learned my addr 172.21.15.49:0/1669908496 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:22:23.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.838+0000 7fc176559700 1 --2- 172.21.15.49:0/1669908496 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc1701547f0 0x7fc1700a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:23.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.838+0000 7fc175d58700 1 --2- 172.21.15.49:0/1669908496 >> v2:172.21.15.115:3300/0 conn(0x7fc1700c86f0 0x7fc1700c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:23.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.838+0000 7fc175557700 1 -- 172.21.15.49:0/1669908496 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2328795711 0 0) 0x7fc1700c7e30 con 0x7fc170062700 2023-11-30T18:22:23.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.838+0000 7fc175557700 1 -- 172.21.15.49:0/1669908496 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc15c0033f0 con 0x7fc170062700 2023-11-30T18:22:23.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.838+0000 7fc176559700 1 -- 172.21.15.49:0/1669908496 >> v2:172.21.15.115:3300/0 conn(0x7fc1700c86f0 msgr2=0x7fc1700c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:23.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.838+0000 7fc176559700 1 --2- 172.21.15.49:0/1669908496 >> v2:172.21.15.115:3300/0 conn(0x7fc1700c86f0 0x7fc1700c6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:23.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.838+0000 7fc176559700 1 -- 172.21.15.49:0/1669908496 >> v1:172.21.15.49:6789/0 conn(0x7fc170062700 legacy=0x7fc1700a4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:23.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.838+0000 7fc176559700 1 -- 172.21.15.49:0/1669908496 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1700a77d0 con 0x7fc1701547f0 2023-11-30T18:22:23.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.838+0000 7fc176559700 1 --2- 172.21.15.49:0/1669908496 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc1701547f0 0x7fc1700a72e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fc160009760 tx=0x7fc160009060).ready entity=mon.2 client_cookie=5f8600362ed95bd6 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:23.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.838+0000 7fc175557700 1 -- 172.21.15.49:0/1669908496 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1600090d0 con 0x7fc1701547f0 2023-11-30T18:22:23.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.838+0000 7fc175557700 1 -- 172.21.15.49:0/1669908496 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16000d4a0 con 0x7fc1701547f0 2023-11-30T18:22:23.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.839+0000 7fc175557700 1 -- 172.21.15.49:0/1669908496 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16000d820 con 0x7fc1701547f0 2023-11-30T18:22:23.842 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:23.839+0000 7f05d9481680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T18:22:23.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.839+0000 7fc1787bd700 1 -- 172.21.15.49:0/1669908496 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc1701547f0 msgr2=0x7fc1700a72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:23.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.839+0000 7fc1787bd700 1 --2- 172.21.15.49:0/1669908496 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc1701547f0 0x7fc1700a72e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fc160009760 tx=0x7fc160009060).stop 2023-11-30T18:22:23.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.839+0000 7fc1787bd700 1 -- 172.21.15.49:0/1669908496 shutdown_connections 2023-11-30T18:22:23.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.839+0000 7fc1787bd700 1 --2- 172.21.15.49:0/1669908496 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc1701547f0 0x7fc1700a72e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:23.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.839+0000 7fc1787bd700 1 --2- 172.21.15.49:0/1669908496 >> v2:172.21.15.115:3300/0 conn(0x7fc1700c86f0 0x7fc1700c6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:23.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.839+0000 7fc1787bd700 1 -- 172.21.15.49:0/1669908496 >> 172.21.15.49:0/1669908496 conn(0x7fc1700642d0 msgr2=0x7fc1700c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:23.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.839+0000 7fc1787bd700 1 -- 172.21.15.49:0/1669908496 shutdown_connections 2023-11-30T18:22:23.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.839+0000 7fc1787bd700 1 -- 172.21.15.49:0/1669908496 wait complete. 2023-11-30T18:22:23.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.840+0000 7fc1787bd700 1 Processor -- start 2023-11-30T18:22:23.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.841+0000 7fc1787bd700 1 -- start start 2023-11-30T18:22:23.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.841+0000 7fc1787bd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc170062700 0x7fc170153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:23.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.841+0000 7fc1787bd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1700c86f0 0x7fc17014ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:23.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.841+0000 7fc1787bd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1701547f0 0x7fc170066930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:23.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.841+0000 7fc1787bd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17014e050 con 0x7fc1700c86f0 2023-11-30T18:22:23.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.841+0000 7fc1787bd700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17014e8f0 con 0x7fc1701547f0 2023-11-30T18:22:23.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.841+0000 7fc1787bd700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc170153570 con 0x7fc170062700 2023-11-30T18:22:23.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.841+0000 7fc175d58700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1700c86f0 0x7fc17014ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:23.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.841+0000 7fc175d58700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1700c86f0 0x7fc17014ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45714/0 (socket says 172.21.15.49:45714) 2023-11-30T18:22:23.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.841+0000 7fc175d58700 1 -- 172.21.15.49:0/4009493929 learned_addr learned my addr 172.21.15.49:0/4009493929 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:23.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.841+0000 7fc176d5a700 1 --2- 172.21.15.49:0/4009493929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1701547f0 0x7fc170066930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:23.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.842+0000 7fc176559700 1 --2- 172.21.15.49:0/4009493929 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc170062700 0x7fc170153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:23.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.842+0000 7fc175d58700 1 -- 172.21.15.49:0/4009493929 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc170062700 msgr2=0x7fc170153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:23.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.842+0000 7fc175d58700 1 --2- 172.21.15.49:0/4009493929 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc170062700 0x7fc170153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:23.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.842+0000 7fc175d58700 1 -- 172.21.15.49:0/4009493929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1701547f0 msgr2=0x7fc170066930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:23.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.842+0000 7fc175d58700 1 --2- 172.21.15.49:0/4009493929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1701547f0 0x7fc170066930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:23.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.842+0000 7fc175d58700 1 -- 172.21.15.49:0/4009493929 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1600092a0 con 0x7fc1700c86f0 2023-11-30T18:22:23.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.842+0000 7fc176559700 1 --2- 172.21.15.49:0/4009493929 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc170062700 0x7fc170153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:22:23.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.842+0000 7fc175d58700 1 --2- 172.21.15.49:0/4009493929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1700c86f0 0x7fc17014ed80 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7fc16c00e930 tx=0x7fc16c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:23.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.842+0000 7fc1667fc700 1 -- 172.21.15.49:0/4009493929 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c012600 con 0x7fc1700c86f0 2023-11-30T18:22:23.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.842+0000 7fc1667fc700 1 -- 172.21.15.49:0/4009493929 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c012760 con 0x7fc1700c86f0 2023-11-30T18:22:23.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.842+0000 7fc1667fc700 1 -- 172.21.15.49:0/4009493929 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c012ae0 con 0x7fc1700c86f0 2023-11-30T18:22:23.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.842+0000 7fc1787bd700 1 -- 172.21.15.49:0/4009493929 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc170067130 con 0x7fc1700c86f0 2023-11-30T18:22:23.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.842+0000 7fc1787bd700 1 -- 172.21.15.49:0/4009493929 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17014e580 con 0x7fc1700c86f0 2023-11-30T18:22:23.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.844+0000 7fc1787bd700 1 -- 172.21.15.49:0/4009493929 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc17014ea80 con 0x7fc1700c86f0 2023-11-30T18:22:23.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.844+0000 7fc1667fc700 1 -- 172.21.15.49:0/4009493929 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 65) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fc16c01b400 con 0x7fc1700c86f0 2023-11-30T18:22:23.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.844+0000 7fc1667fc700 1 --2- 172.21.15.49:0/4009493929 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc15405f270 0x7fc154061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:23.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.844+0000 7fc1667fc700 1 -- 172.21.15.49:0/4009493929 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6581+0+0 (secure 0 0 0) 0x7fc16c07a9e0 con 0x7fc1700c86f0 2023-11-30T18:22:23.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.844+0000 7fc176559700 1 -- 172.21.15.49:0/4009493929 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc15405f270 msgr2=0x7fc154061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:23.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.844+0000 7fc176559700 1 --2- 172.21.15.49:0/4009493929 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc15405f270 0x7fc154061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:22:23.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:23.849+0000 7fc1667fc700 1 -- 172.21.15.49:0/4009493929 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc16c04b900 con 0x7fc1700c86f0 2023-11-30T18:22:23.910 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:23.908+0000 7f05d9481680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T18:22:23.918 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:23.916+0000 7f174b642680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T18:22:23.996 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:23.994+0000 7f174b642680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T18:22:24.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.021+0000 7fc1787bd700 1 -- 172.21.15.49:0/4009493929 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc17014f2d0 con 0x7fc1700c86f0 2023-11-30T18:22:24.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.022+0000 7fc1667fc700 1 -- 172.21.15.49:0/4009493929 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v154) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc16c04ef20 con 0x7fc1700c86f0 2023-11-30T18:22:24.024 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T18:22:24.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.024+0000 7fc1787bd700 1 -- 172.21.15.49:0/4009493929 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc15405f270 msgr2=0x7fc154061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:22:24.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.024+0000 7fc1787bd700 1 --2- 172.21.15.49:0/4009493929 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc15405f270 0x7fc154061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:24.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.024+0000 7fc1787bd700 1 -- 172.21.15.49:0/4009493929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1700c86f0 msgr2=0x7fc17014ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:24.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.024+0000 7fc1787bd700 1 --2- 172.21.15.49:0/4009493929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1700c86f0 0x7fc17014ed80 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7fc16c00e930 tx=0x7fc16c009060).stop 2023-11-30T18:22:24.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.024+0000 7fc1787bd700 1 -- 172.21.15.49:0/4009493929 shutdown_connections 2023-11-30T18:22:24.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.024+0000 7fc1787bd700 1 --2- 172.21.15.49:0/4009493929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1701547f0 0x7fc170066930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:24.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.024+0000 7fc1787bd700 1 --2- 172.21.15.49:0/4009493929 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc170062700 0x7fc170153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:24.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.024+0000 7fc1787bd700 1 --2- 172.21.15.49:0/4009493929 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc15405f270 0x7fc154061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:24.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.024+0000 7fc1787bd700 1 --2- 172.21.15.49:0/4009493929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1700c86f0 0x7fc17014ed80 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:24.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.024+0000 7fc1787bd700 1 -- 172.21.15.49:0/4009493929 >> 172.21.15.49:0/4009493929 conn(0x7fc1700642d0 msgr2=0x7fc1700654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:24.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.024+0000 7fc1787bd700 1 -- 172.21.15.49:0/4009493929 shutdown_connections 2023-11-30T18:22:24.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.024+0000 7fc1787bd700 1 -- 172.21.15.49:0/4009493929 wait complete. 2023-11-30T18:22:24.039 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:22:24.067 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:24.065+0000 7f174b642680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T18:22:24.168 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:24.166+0000 7f05d9481680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T18:22:24.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.183+0000 7f08d4c74700 1 Processor -- start 2023-11-30T18:22:24.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.183+0000 7f08d4c74700 1 -- start start 2023-11-30T18:22:24.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.184+0000 7f08d4c74700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08d0064e20 0x7f08d0155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:24.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.184+0000 7f08d4c74700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f08d0095e80 0x7f08d0096310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:24.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.184+0000 7f08d4c74700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08d0096800 con 0x7f08d01544d0 2023-11-30T18:22:24.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.184+0000 7f08d4c74700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d0067650 con 0x7f08d0095e80 2023-11-30T18:22:24.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.184+0000 7f08d4c74700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d00683d0 con 0x7f08d0064e20 2023-11-30T18:22:24.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.185+0000 7f08cdd9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08d0064e20 0x7f08d0155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:24.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.185+0000 7f08ced9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f08d0095e80 0x7f08d0096310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:24.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.185+0000 7f08cdd9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08d0064e20 0x7f08d0155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:36856/0 (socket says 172.21.15.49:36856) 2023-11-30T18:22:24.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.185+0000 7f08ced9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f08d0095e80 0x7f08d0096310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:42230/0 (socket says 172.21.15.49:42230) 2023-11-30T18:22:24.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.185+0000 7f08cdd9b700 1 -- 172.21.15.49:0/1944543447 learned_addr learned my addr 172.21.15.49:0/1944543447 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:24.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.185+0000 7f08ce59c700 1 --1- 172.21.15.49:0/1944543447 >> v1:172.21.15.115:6789/0 conn(0x7f08d01544d0 0x7f08d0066f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:38690/0 (socket says 172.21.15.49:38690) 2023-11-30T18:22:24.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.185+0000 7f08cdd9b700 1 -- 172.21.15.49:0/1944543447 >> v2:172.21.15.115:3300/0 conn(0x7f08d0095e80 msgr2=0x7f08d0096310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:24.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.185+0000 7f08cdd9b700 1 --2- 172.21.15.49:0/1944543447 >> v2:172.21.15.115:3300/0 conn(0x7f08d0095e80 0x7f08d0096310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:24.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.185+0000 7f08cdd9b700 1 -- 172.21.15.49:0/1944543447 >> v1:172.21.15.115:6789/0 conn(0x7f08d01544d0 legacy=0x7f08d0066f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:24.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.185+0000 7f08cdd9b700 1 -- 172.21.15.49:0/1944543447 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d0067850 con 0x7f08d0064e20 2023-11-30T18:22:24.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.185+0000 7f08cd59a700 1 -- 172.21.15.49:0/1944543447 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1048759030 0 0) 0x7f08d0096800 con 0x7f08d01544d0 2023-11-30T18:22:24.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.185+0000 7f08ced9d700 1 --2- 172.21.15.49:0/1944543447 >> v2:172.21.15.115:3300/0 conn(0x7f08d0095e80 0x7f08d0096310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:22:24.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.185+0000 7f08cdd9b700 1 --2- 172.21.15.49:0/1944543447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08d0064e20 0x7f08d0155750 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f08c0006fd0 tx=0x7f08c00090f0).ready entity=mon.2 client_cookie=2e741df2d8e4b431 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:24.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.186+0000 7f08cd59a700 1 -- 172.21.15.49:0/1944543447 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c000b580 con 0x7f08d0064e20 2023-11-30T18:22:24.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.186+0000 7f08cd59a700 1 -- 172.21.15.49:0/1944543447 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c000b6e0 con 0x7f08d0064e20 2023-11-30T18:22:24.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.186+0000 7f08cd59a700 1 -- 172.21.15.49:0/1944543447 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c000ba60 con 0x7f08d0064e20 2023-11-30T18:22:24.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.186+0000 7f08d4c74700 1 -- 172.21.15.49:0/1944543447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08d0064e20 msgr2=0x7f08d0155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:24.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.186+0000 7f08d4c74700 1 --2- 172.21.15.49:0/1944543447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08d0064e20 0x7f08d0155750 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f08c0006fd0 tx=0x7f08c00090f0).stop 2023-11-30T18:22:24.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.186+0000 7f08d4c74700 1 -- 172.21.15.49:0/1944543447 shutdown_connections 2023-11-30T18:22:24.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.186+0000 7f08d4c74700 1 --2- 172.21.15.49:0/1944543447 >> v2:172.21.15.115:3300/0 conn(0x7f08d0095e80 0x7f08d0096310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:24.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.186+0000 7f08d4c74700 1 --2- 172.21.15.49:0/1944543447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08d0064e20 0x7f08d0155750 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:24.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.186+0000 7f08d4c74700 1 -- 172.21.15.49:0/1944543447 >> 172.21.15.49:0/1944543447 conn(0x7f08d00631d0 msgr2=0x7f08d00c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:24.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.186+0000 7f08d4c74700 1 -- 172.21.15.49:0/1944543447 shutdown_connections 2023-11-30T18:22:24.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.186+0000 7f08d4c74700 1 -- 172.21.15.49:0/1944543447 wait complete. 2023-11-30T18:22:24.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.187+0000 7f08d4c74700 1 Processor -- start 2023-11-30T18:22:24.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.187+0000 7f08d4c74700 1 -- start start 2023-11-30T18:22:24.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.188+0000 7f08d4c74700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08d0064e20 0x7f08d014f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:24.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.188+0000 7f08d4c74700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08d0095e80 0x7f08d0167900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:24.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.188+0000 7f08d4c74700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08d01544d0 0x7f08d01523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:24.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.188+0000 7f08d4c74700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d0151f60 con 0x7f08d0064e20 2023-11-30T18:22:24.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.188+0000 7f08d4c74700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d0151c30 con 0x7f08d01544d0 2023-11-30T18:22:24.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.188+0000 7f08d4c74700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d0168200 con 0x7f08d0095e80 2023-11-30T18:22:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.188+0000 7f08ce59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08d0064e20 0x7f08d014f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.188+0000 7f08ce59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08d0064e20 0x7f08d014f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45716/0 (socket says 172.21.15.49:45716) 2023-11-30T18:22:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.188+0000 7f08ce59c700 1 -- 172.21.15.49:0/3180459739 learned_addr learned my addr 172.21.15.49:0/3180459739 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.188+0000 7f08ced9d700 1 --2- 172.21.15.49:0/3180459739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08d01544d0 0x7f08d01523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.188+0000 7f08cdd9b700 1 --2- 172.21.15.49:0/3180459739 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08d0095e80 0x7f08d0167900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.189+0000 7f08ced9d700 1 -- 172.21.15.49:0/3180459739 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08d0095e80 msgr2=0x7f08d0167900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.189+0000 7f08ced9d700 1 --2- 172.21.15.49:0/3180459739 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08d0095e80 0x7f08d0167900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.189+0000 7f08ced9d700 1 -- 172.21.15.49:0/3180459739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08d0064e20 msgr2=0x7f08d014f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.189+0000 7f08ced9d700 1 --2- 172.21.15.49:0/3180459739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08d0064e20 0x7f08d014f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.189+0000 7f08ced9d700 1 -- 172.21.15.49:0/3180459739 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c8009a20 con 0x7f08d01544d0 2023-11-30T18:22:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.189+0000 7f08ce59c700 1 --2- 172.21.15.49:0/3180459739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08d0064e20 0x7f08d014f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:22:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.189+0000 7f08ced9d700 1 --2- 172.21.15.49:0/3180459739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08d01544d0 0x7f08d01523f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f08c8009f10 tx=0x7f08c800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.189+0000 7f08c67fc700 1 -- 172.21.15.49:0/3180459739 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c800cb70 con 0x7f08d01544d0 2023-11-30T18:22:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.189+0000 7f08c67fc700 1 -- 172.21.15.49:0/3180459739 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c800f040 con 0x7f08d01544d0 2023-11-30T18:22:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.189+0000 7f08d4c74700 1 -- 172.21.15.49:0/3180459739 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c0009370 con 0x7f08d01544d0 2023-11-30T18:22:24.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.189+0000 7f08c67fc700 1 -- 172.21.15.49:0/3180459739 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c8013400 con 0x7f08d01544d0 2023-11-30T18:22:24.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.189+0000 7f08d4c74700 1 -- 172.21.15.49:0/3180459739 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d01687c0 con 0x7f08d01544d0 2023-11-30T18:22:24.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.190+0000 7f08d4c74700 1 -- 172.21.15.49:0/3180459739 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d01520d0 con 0x7f08d01544d0 2023-11-30T18:22:24.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.190+0000 7f08c67fc700 1 -- 172.21.15.49:0/3180459739 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 65) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f08c80137f0 con 0x7f08d01544d0 2023-11-30T18:22:24.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.191+0000 7f08c67fc700 1 --2- 172.21.15.49:0/3180459739 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f08b005f270 0x7f08b0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:24.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.191+0000 7f08c67fc700 1 -- 172.21.15.49:0/3180459739 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6581+0+0 (secure 0 0 0) 0x7f08c807adb0 con 0x7f08d01544d0 2023-11-30T18:22:24.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.191+0000 7f08ce59c700 1 -- 172.21.15.49:0/3180459739 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f08b005f270 msgr2=0x7f08b0061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:24.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.191+0000 7f08ce59c700 1 --2- 172.21.15.49:0/3180459739 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f08b005f270 0x7f08b0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:22:24.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.195+0000 7f08c67fc700 1 -- 172.21.15.49:0/3180459739 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f08c804bd30 con 0x7f08d01544d0 2023-11-30T18:22:24.343 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:24.341+0000 7f174b642680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T18:22:24.355 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:24.354+0000 7f05d9481680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T18:22:24.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.392+0000 7f08ce59c700 1 -- 172.21.15.49:0/3180459739 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f08b005f270 msgr2=0x7f08b0061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:24.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.392+0000 7f08ce59c700 1 --2- 172.21.15.49:0/3180459739 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f08b005f270 0x7f08b0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T18:22:24.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.415+0000 7f08d4c74700 1 -- 172.21.15.49:0/3180459739 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08d006c860 con 0x7f08d01544d0 2023-11-30T18:22:24.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.416+0000 7f08c67fc700 1 -- 172.21.15.49:0/3180459739 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f08c804f350 con 0x7f08d01544d0 2023-11-30T18:22:24.418 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:22:24.418 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":61,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6851,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/4266183168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":4266183168},{"type":"v1","addr":"172.21.15.49:6835","nonce":4266183168}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":7810,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1044019551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1044019551},{"type":"v1","addr":"172.21.15.115:6836","nonce":1044019551}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":7813,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/676160579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":676160579},{"type":"v1","addr":"172.21.15.115:6837","nonce":676160579}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:26:20.358070+0000","modified":"2023-11-30T17:26:23.364931+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8085":{"gid":8085,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/2798044365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2798044365},{"type":"v1","addr":"172.21.15.49:6834","nonce":2798044365}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-11-30T18:22:24.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.418+0000 7f08d4c74700 1 -- 172.21.15.49:0/3180459739 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f08b005f270 msgr2=0x7f08b0061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:22:24.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.418+0000 7f08d4c74700 1 --2- 172.21.15.49:0/3180459739 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f08b005f270 0x7f08b0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:24.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.418+0000 7f08d4c74700 1 -- 172.21.15.49:0/3180459739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08d01544d0 msgr2=0x7f08d01523f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:24.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.418+0000 7f08d4c74700 1 --2- 172.21.15.49:0/3180459739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08d01544d0 0x7f08d01523f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f08c8009f10 tx=0x7f08c800b040).stop 2023-11-30T18:22:24.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.418+0000 7f08d4c74700 1 -- 172.21.15.49:0/3180459739 shutdown_connections 2023-11-30T18:22:24.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.418+0000 7f08d4c74700 1 --2- 172.21.15.49:0/3180459739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08d01544d0 0x7f08d01523f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:24.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.418+0000 7f08d4c74700 1 --2- 172.21.15.49:0/3180459739 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f08b005f270 0x7f08b0061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:24.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.418+0000 7f08d4c74700 1 --2- 172.21.15.49:0/3180459739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08d0064e20 0x7f08d014f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:24.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.418+0000 7f08d4c74700 1 --2- 172.21.15.49:0/3180459739 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08d0095e80 0x7f08d0167900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:24.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.418+0000 7f08d4c74700 1 -- 172.21.15.49:0/3180459739 >> 172.21.15.49:0/3180459739 conn(0x7f08d00631d0 msgr2=0x7f08d00c4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:24.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.418+0000 7f08d4c74700 1 -- 172.21.15.49:0/3180459739 shutdown_connections 2023-11-30T18:22:24.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.418+0000 7f08d4c74700 1 -- 172.21.15.49:0/3180459739 wait complete. 2023-11-30T18:22:24.421 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 61 2023-11-30T18:22:24.432 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:22:24.534 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:24.532+0000 7f174b642680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T18:22:24.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.553+0000 7fede6b7b700 1 Processor -- start 2023-11-30T18:22:24.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.553+0000 7fede6b7b700 1 -- start start 2023-11-30T18:22:24.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.554+0000 7fede6b7b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fede0152070 0x7fede0152450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:24.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.554+0000 7fede6b7b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fede0062850 0x7fede0062cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:24.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.554+0000 7fede6b7b700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fede0069070 con 0x7fede00acad0 2023-11-30T18:22:24.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.554+0000 7fede6b7b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fede006a3f0 con 0x7fede0152070 2023-11-30T18:22:24.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.554+0000 7fede6b7b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede0069350 con 0x7fede0062850 2023-11-30T18:22:24.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.554+0000 7feddffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fede0062850 0x7fede0062cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:24.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.554+0000 7fede4917700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fede0152070 0x7fede0152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:24.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.554+0000 7fede4917700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fede0152070 0x7fede0152450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:42248/0 (socket says 172.21.15.49:42248) 2023-11-30T18:22:24.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.554+0000 7feddffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fede0062850 0x7fede0062cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:36866/0 (socket says 172.21.15.49:36866) 2023-11-30T18:22:24.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.554+0000 7fede4917700 1 -- 172.21.15.49:0/1777587203 learned_addr learned my addr 172.21.15.49:0/1777587203 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:24.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.554+0000 7fede5118700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fede00acad0 0x7fede0155f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:38704/0 (socket says 172.21.15.49:38704) 2023-11-30T18:22:24.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.554+0000 7fede4917700 1 -- 172.21.15.49:0/1777587203 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fede0062850 msgr2=0x7fede0062cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:24.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.554+0000 7fede4917700 1 --2- 172.21.15.49:0/1777587203 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fede0062850 0x7fede0062cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:24.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.554+0000 7fede4917700 1 -- 172.21.15.49:0/1777587203 >> v1:172.21.15.115:6789/0 conn(0x7fede00acad0 legacy=0x7fede0155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:24.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.554+0000 7fede4917700 1 -- 172.21.15.49:0/1777587203 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede0069630 con 0x7fede0152070 2023-11-30T18:22:24.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.554+0000 7feddf7fe700 1 -- 172.21.15.49:0/1777587203 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073396118 0 0) 0x7fede0069070 con 0x7fede00acad0 2023-11-30T18:22:24.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.554+0000 7fede4917700 1 --2- 172.21.15.49:0/1777587203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fede0152070 0x7fede0152450 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7fedd4006fd0 tx=0x7fedd40090f0).ready entity=mon.1 client_cookie=f362aa52d7b180c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:24.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.555+0000 7feddf7fe700 1 -- 172.21.15.49:0/1777587203 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd400b580 con 0x7fede0152070 2023-11-30T18:22:24.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.555+0000 7feddf7fe700 1 -- 172.21.15.49:0/1777587203 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd400b6e0 con 0x7fede0152070 2023-11-30T18:22:24.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.555+0000 7feddf7fe700 1 -- 172.21.15.49:0/1777587203 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd400ba60 con 0x7fede0152070 2023-11-30T18:22:24.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.555+0000 7fede6b7b700 1 -- 172.21.15.49:0/1777587203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fede0152070 msgr2=0x7fede0152450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:24.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.555+0000 7fede6b7b700 1 --2- 172.21.15.49:0/1777587203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fede0152070 0x7fede0152450 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7fedd4006fd0 tx=0x7fedd40090f0).stop 2023-11-30T18:22:24.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.555+0000 7fede6b7b700 1 -- 172.21.15.49:0/1777587203 shutdown_connections 2023-11-30T18:22:24.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.555+0000 7fede6b7b700 1 --2- 172.21.15.49:0/1777587203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fede0152070 0x7fede0152450 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:24.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.555+0000 7fede6b7b700 1 --2- 172.21.15.49:0/1777587203 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fede0062850 0x7fede0062cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:24.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.555+0000 7fede6b7b700 1 -- 172.21.15.49:0/1777587203 >> 172.21.15.49:0/1777587203 conn(0x7fede00c7760 msgr2=0x7fede00c7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:24.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.555+0000 7fede6b7b700 1 -- 172.21.15.49:0/1777587203 shutdown_connections 2023-11-30T18:22:24.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.555+0000 7fede6b7b700 1 -- 172.21.15.49:0/1777587203 wait complete. 2023-11-30T18:22:24.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.556+0000 7fede6b7b700 1 Processor -- start 2023-11-30T18:22:24.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.556+0000 7fede6b7b700 1 -- start start 2023-11-30T18:22:24.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.557+0000 7fede6b7b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fede0062850 0x7fede01625a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:24.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.557+0000 7fede6b7b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fede00acad0 0x7fede01499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:24.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.557+0000 7fede6b7b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fede0152070 0x7fede0156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:24.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.557+0000 7fede6b7b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede0162a90 con 0x7fede00acad0 2023-11-30T18:22:24.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.557+0000 7fede6b7b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede0149ec0 con 0x7fede0152070 2023-11-30T18:22:24.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.557+0000 7fede6b7b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede014c2e0 con 0x7fede0062850 2023-11-30T18:22:24.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.557+0000 7feddffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fede00acad0 0x7fede01499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:24.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.557+0000 7fede5118700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fede0152070 0x7fede0156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:24.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.557+0000 7feddffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fede00acad0 0x7fede01499d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45724/0 (socket says 172.21.15.49:45724) 2023-11-30T18:22:24.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.557+0000 7feddffff700 1 -- 172.21.15.49:0/4264402102 learned_addr learned my addr 172.21.15.49:0/4264402102 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:24.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.557+0000 7fede4917700 1 --2- 172.21.15.49:0/4264402102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fede0062850 0x7fede01625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:24.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.558+0000 7fede5118700 1 -- 172.21.15.49:0/4264402102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fede0062850 msgr2=0x7fede01625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:24.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.558+0000 7fede5118700 1 --2- 172.21.15.49:0/4264402102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fede0062850 0x7fede01625a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:24.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.558+0000 7fede5118700 1 -- 172.21.15.49:0/4264402102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fede00acad0 msgr2=0x7fede01499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:24.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.558+0000 7fede5118700 1 --2- 172.21.15.49:0/4264402102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fede00acad0 0x7fede01499d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:24.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.558+0000 7fede5118700 1 -- 172.21.15.49:0/4264402102 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd4009370 con 0x7fede0152070 2023-11-30T18:22:24.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.558+0000 7feddffff700 1 --2- 172.21.15.49:0/4264402102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fede00acad0 0x7fede01499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:22:24.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.558+0000 7fede5118700 1 --2- 172.21.15.49:0/4264402102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fede0152070 0x7fede0156bf0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7fedd8002230 tx=0x7fedd8007eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:24.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.558+0000 7feddcff9700 1 -- 172.21.15.49:0/4264402102 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd8005c70 con 0x7fede0152070 2023-11-30T18:22:24.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.558+0000 7feddcff9700 1 -- 172.21.15.49:0/4264402102 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd8005df0 con 0x7fede0152070 2023-11-30T18:22:24.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.558+0000 7fede6b7b700 1 -- 172.21.15.49:0/4264402102 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede014c580 con 0x7fede0152070 2023-11-30T18:22:24.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.558+0000 7feddcff9700 1 -- 172.21.15.49:0/4264402102 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd8007360 con 0x7fede0152070 2023-11-30T18:22:24.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.558+0000 7fede6b7b700 1 -- 172.21.15.49:0/4264402102 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede014cb40 con 0x7fede0152070 2023-11-30T18:22:24.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.559+0000 7fede6b7b700 1 -- 172.21.15.49:0/4264402102 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede0062fe0 con 0x7fede0152070 2023-11-30T18:22:24.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.559+0000 7feddcff9700 1 -- 172.21.15.49:0/4264402102 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 65) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fedd8007750 con 0x7fede0152070 2023-11-30T18:22:24.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.560+0000 7feddcff9700 1 --2- 172.21.15.49:0/4264402102 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fedc405f270 0x7fedc4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:24.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.560+0000 7fede4917700 1 -- 172.21.15.49:0/4264402102 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fedc405f270 msgr2=0x7fedc4061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:24.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.560+0000 7feddcff9700 1 -- 172.21.15.49:0/4264402102 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6581+0+0 (secure 0 0 0) 0x7fedd807a4f0 con 0x7fede0152070 2023-11-30T18:22:24.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.560+0000 7fede4917700 1 --2- 172.21.15.49:0/4264402102 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fedc405f270 0x7fedc4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:22:24.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.564+0000 7feddcff9700 1 -- 172.21.15.49:0/4264402102 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fedd804b470 con 0x7fede0152070 2023-11-30T18:22:24.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.740+0000 7fede6b7b700 1 -- 172.21.15.49:0/4264402102 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fede006c860 con 0x7fede0152070 2023-11-30T18:22:24.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.741+0000 7feddcff9700 1 -- 172.21.15.49:0/4264402102 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) v1 ==== 74+0+17667 (secure 0 0 0) 0x7fedd804ea90 con 0x7fede0152070 2023-11-30T18:22:24.743 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:22:24.744 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":154,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:22:21.696592+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:26:18.350122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-11-30T17:26:19.327933+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":112,"snap_epoch":154,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.1a","mappings":[{"from":0,"to":5}]},{"pgid":"17.3c","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/1086530775":"2023-12-01T17:26:32.594059+0000","172.21.15.115:0/390416334":"2023-12-01T17:26:32.594059+0000","172.21.15.115:0/2966399435":"2023-12-01T17:26:32.594059+0000","172.21.15.115:6833/89956":"2023-12-01T17:26:32.594059+0000","172.21.15.115:6832/89956":"2023-12-01T17:26:32.594059+0000","172.21.15.115:0/3029851732":"2023-12-01T17:26:32.594059+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":54},{"begin":59,"length":54}]}],"new_removed_snaps":[{"pool":18,"snaps":[{"begin":52,"length":5},{"begin":108,"length":5}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:22:24.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.743+0000 7fede6b7b700 1 -- 172.21.15.49:0/4264402102 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fedc405f270 msgr2=0x7fedc4061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:22:24.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.743+0000 7fede6b7b700 1 --2- 172.21.15.49:0/4264402102 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fedc405f270 0x7fedc4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:24.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.743+0000 7fede6b7b700 1 -- 172.21.15.49:0/4264402102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fede0152070 msgr2=0x7fede0156bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:24.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.743+0000 7fede6b7b700 1 --2- 172.21.15.49:0/4264402102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fede0152070 0x7fede0156bf0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7fedd8002230 tx=0x7fedd8007eb0).stop 2023-11-30T18:22:24.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.743+0000 7fede6b7b700 1 -- 172.21.15.49:0/4264402102 shutdown_connections 2023-11-30T18:22:24.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.743+0000 7fede6b7b700 1 --2- 172.21.15.49:0/4264402102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fede0152070 0x7fede0156bf0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:24.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.743+0000 7fede6b7b700 1 --2- 172.21.15.49:0/4264402102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fede0062850 0x7fede01625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:24.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.743+0000 7fede6b7b700 1 --2- 172.21.15.49:0/4264402102 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fedc405f270 0x7fedc4061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:24.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.743+0000 7fede6b7b700 1 --2- 172.21.15.49:0/4264402102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fede00acad0 0x7fede01499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:24.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.743+0000 7fede6b7b700 1 -- 172.21.15.49:0/4264402102 >> 172.21.15.49:0/4264402102 conn(0x7fede00c7760 msgr2=0x7fede00c6860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:24.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.744+0000 7fede6b7b700 1 -- 172.21.15.49:0/4264402102 shutdown_connections 2023-11-30T18:22:24.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.744+0000 7fede6b7b700 1 -- 172.21.15.49:0/4264402102 wait complete. 2023-11-30T18:22:24.758 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-30T18:22:24.759 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:22:24.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.876+0000 7fbf92c14700 1 Processor -- start 2023-11-30T18:22:24.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.876+0000 7fbf92c14700 1 -- start start 2023-11-30T18:22:24.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.877+0000 7fbf92c14700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbf8c0caab0 0x7fbf8c0aa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:24.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.877+0000 7fbf92c14700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8c0a9a90 con 0x7fbf8c0ca180 2023-11-30T18:22:24.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.877+0000 7fbf92c14700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8c154ce0 con 0x7fbf8c0cae90 2023-11-30T18:22:24.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.877+0000 7fbf92c14700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf8c0a8e80 con 0x7fbf8c0caab0 2023-11-30T18:22:24.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.877+0000 7fbf909b0700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbf8c0caab0 0x7fbf8c0aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:24.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.877+0000 7fbf911b1700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbf8c0ca180 0x7fbf8c15e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:54996/0 (socket says 172.21.15.49:54996) 2023-11-30T18:22:24.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.877+0000 7fbf909b0700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbf8c0caab0 0x7fbf8c0aa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45736/0 (socket says 172.21.15.49:45736) 2023-11-30T18:22:24.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.877+0000 7fbf911b1700 1 -- 172.21.15.49:0/4187983390 learned_addr learned my addr 172.21.15.49:0/4187983390 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:22:24.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.878+0000 7fbf909b0700 1 -- 172.21.15.49:0/4187983390 >> v1:172.21.15.115:6789/0 conn(0x7fbf8c0cae90 legacy=0x7fbf8c0c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:24.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.878+0000 7fbf909b0700 1 -- 172.21.15.49:0/4187983390 >> v1:172.21.15.49:6789/0 conn(0x7fbf8c0ca180 legacy=0x7fbf8c15e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:24.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.878+0000 7fbf909b0700 1 -- 172.21.15.49:0/4187983390 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8c0a9160 con 0x7fbf8c0caab0 2023-11-30T18:22:24.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.878+0000 7fbf8b7fe700 1 -- 172.21.15.49:0/4187983390 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1957214556 0 0) 0x7fbf8c0a9a90 con 0x7fbf8c0ca180 2023-11-30T18:22:24.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.878+0000 7fbf909b0700 1 --2- 172.21.15.49:0/4187983390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf8c0caab0 0x7fbf8c0aa470 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7fbf80006fd0 tx=0x7fbf80006f40).ready entity=mon.0 client_cookie=21b8337b01977871 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:24.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.878+0000 7fbf8b7fe700 1 -- 172.21.15.49:0/4187983390 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf80005880 con 0x7fbf8c0caab0 2023-11-30T18:22:24.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.878+0000 7fbf8b7fe700 1 -- 172.21.15.49:0/4187983390 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf800059e0 con 0x7fbf8c0caab0 2023-11-30T18:22:24.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.878+0000 7fbf8b7fe700 1 -- 172.21.15.49:0/4187983390 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf80005d60 con 0x7fbf8c0caab0 2023-11-30T18:22:24.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.879+0000 7fbf92c14700 1 -- 172.21.15.49:0/4187983390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf8c0caab0 msgr2=0x7fbf8c0aa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:24.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.879+0000 7fbf92c14700 1 --2- 172.21.15.49:0/4187983390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf8c0caab0 0x7fbf8c0aa470 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7fbf80006fd0 tx=0x7fbf80006f40).stop 2023-11-30T18:22:24.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.879+0000 7fbf92c14700 1 -- 172.21.15.49:0/4187983390 shutdown_connections 2023-11-30T18:22:24.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.879+0000 7fbf92c14700 1 --2- 172.21.15.49:0/4187983390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf8c0caab0 0x7fbf8c0aa470 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:24.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.879+0000 7fbf92c14700 1 -- 172.21.15.49:0/4187983390 >> 172.21.15.49:0/4187983390 conn(0x7fbf8c094920 msgr2=0x7fbf8c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:24.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.879+0000 7fbf92c14700 1 -- 172.21.15.49:0/4187983390 shutdown_connections 2023-11-30T18:22:24.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.879+0000 7fbf92c14700 1 -- 172.21.15.49:0/4187983390 wait complete. 2023-11-30T18:22:24.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.880+0000 7fbf92c14700 1 Processor -- start 2023-11-30T18:22:24.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.880+0000 7fbf92c14700 1 -- start start 2023-11-30T18:22:24.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.881+0000 7fbf92c14700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf8c0ca180 0x7fbf8c164aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:24.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.881+0000 7fbf92c14700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf8c0caab0 0x7fbf8c154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:24.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.881+0000 7fbf92c14700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf8c0cae90 0x7fbf8c0c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:24.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.881+0000 7fbf92c14700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c168f50 con 0x7fbf8c0cae90 2023-11-30T18:22:24.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.881+0000 7fbf92c14700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c168340 con 0x7fbf8c0caab0 2023-11-30T18:22:24.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.881+0000 7fbf92c14700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c168620 con 0x7fbf8c0ca180 2023-11-30T18:22:24.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.881+0000 7fbf911b1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf8c0cae90 0x7fbf8c0c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:24.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.881+0000 7fbf911b1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf8c0cae90 0x7fbf8c0c7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45752/0 (socket says 172.21.15.49:45752) 2023-11-30T18:22:24.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.881+0000 7fbf911b1700 1 -- 172.21.15.49:0/3658356336 learned_addr learned my addr 172.21.15.49:0/3658356336 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:24.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.881+0000 7fbf8bfff700 1 --2- 172.21.15.49:0/3658356336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf8c0caab0 0x7fbf8c154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:24.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.881+0000 7fbf909b0700 1 --2- 172.21.15.49:0/3658356336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf8c0ca180 0x7fbf8c164aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:24.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.881+0000 7fbf911b1700 1 -- 172.21.15.49:0/3658356336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf8c0ca180 msgr2=0x7fbf8c164aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:24.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.881+0000 7fbf911b1700 1 --2- 172.21.15.49:0/3658356336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf8c0ca180 0x7fbf8c164aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:24.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.881+0000 7fbf911b1700 1 -- 172.21.15.49:0/3658356336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf8c0caab0 msgr2=0x7fbf8c154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:24.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.881+0000 7fbf911b1700 1 --2- 172.21.15.49:0/3658356336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf8c0caab0 0x7fbf8c154040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:24.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.881+0000 7fbf911b1700 1 -- 172.21.15.49:0/3658356336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf80009250 con 0x7fbf8c0cae90 2023-11-30T18:22:24.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.881+0000 7fbf911b1700 1 --2- 172.21.15.49:0/3658356336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf8c0cae90 0x7fbf8c0c7c40 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7fbf8400c730 tx=0x7fbf84001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:24.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.882+0000 7fbf88ff9700 1 -- 172.21.15.49:0/3658356336 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84005d30 con 0x7fbf8c0cae90 2023-11-30T18:22:24.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.882+0000 7fbf88ff9700 1 -- 172.21.15.49:0/3658356336 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf84005e90 con 0x7fbf8c0cae90 2023-11-30T18:22:24.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.882+0000 7fbf92c14700 1 -- 172.21.15.49:0/3658356336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf8c168900 con 0x7fbf8c0cae90 2023-11-30T18:22:24.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.882+0000 7fbf88ff9700 1 -- 172.21.15.49:0/3658356336 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84007300 con 0x7fbf8c0cae90 2023-11-30T18:22:24.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.882+0000 7fbf92c14700 1 -- 172.21.15.49:0/3658356336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8c0c8860 con 0x7fbf8c0cae90 2023-11-30T18:22:24.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.883+0000 7fbf92c14700 1 -- 172.21.15.49:0/3658356336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf8c154ee0 con 0x7fbf8c0cae90 2023-11-30T18:22:24.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.883+0000 7fbf88ff9700 1 -- 172.21.15.49:0/3658356336 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 65) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fbf840076b0 con 0x7fbf8c0cae90 2023-11-30T18:22:24.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.883+0000 7fbf88ff9700 1 --2- 172.21.15.49:0/3658356336 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbf7005f270 0x7fbf70061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:24.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.883+0000 7fbf88ff9700 1 -- 172.21.15.49:0/3658356336 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6581+0+0 (secure 0 0 0) 0x7fbf84079e80 con 0x7fbf8c0cae90 2023-11-30T18:22:24.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.883+0000 7fbf909b0700 1 -- 172.21.15.49:0/3658356336 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbf7005f270 msgr2=0x7fbf70061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:24.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.883+0000 7fbf909b0700 1 --2- 172.21.15.49:0/3658356336 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbf7005f270 0x7fbf70061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:22:24.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:24.887+0000 7fbf88ff9700 1 -- 172.21.15.49:0/3658356336 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbf8c154ee0 con 0x7fbf8c0cae90 2023-11-30T18:22:25.008 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:25.006+0000 7f05d9481680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T18:22:25.077 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:25.075+0000 7f05d9481680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T18:22:25.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.084+0000 7fbf909b0700 1 -- 172.21.15.49:0/3658356336 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbf7005f270 msgr2=0x7fbf70061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:25.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.084+0000 7fbf909b0700 1 --2- 172.21.15.49:0/3658356336 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbf7005f270 0x7fbf70061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T18:22:25.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.104+0000 7fbf92c14700 1 -- 172.21.15.49:0/3658356336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf8c154ee0 con 0x7fbf8c0cae90 2023-11-30T18:22:25.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.105+0000 7fbf88ff9700 1 -- 172.21.15.49:0/3658356336 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fbf8c154ee0 con 0x7fbf8c0cae90 2023-11-30T18:22:25.107 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:22:25.107 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":61,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6851,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/4266183168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":4266183168},{"type":"v1","addr":"172.21.15.49:6835","nonce":4266183168}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":7810,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1044019551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1044019551},{"type":"v1","addr":"172.21.15.115:6836","nonce":1044019551}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":7813,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/676160579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":676160579},{"type":"v1","addr":"172.21.15.115:6837","nonce":676160579}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:26:20.358070+0000","modified":"2023-11-30T17:26:23.364931+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8085":{"gid":8085,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/2798044365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2798044365},{"type":"v1","addr":"172.21.15.49:6834","nonce":2798044365}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-11-30T18:22:25.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.107+0000 7fbf92c14700 1 -- 172.21.15.49:0/3658356336 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbf7005f270 msgr2=0x7fbf70061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:22:25.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.107+0000 7fbf92c14700 1 --2- 172.21.15.49:0/3658356336 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbf7005f270 0x7fbf70061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:25.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.107+0000 7fbf92c14700 1 -- 172.21.15.49:0/3658356336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf8c0cae90 msgr2=0x7fbf8c0c7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:25.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.107+0000 7fbf92c14700 1 --2- 172.21.15.49:0/3658356336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf8c0cae90 0x7fbf8c0c7c40 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7fbf8400c730 tx=0x7fbf84001520).stop 2023-11-30T18:22:25.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.107+0000 7fbf92c14700 1 -- 172.21.15.49:0/3658356336 shutdown_connections 2023-11-30T18:22:25.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.107+0000 7fbf92c14700 1 --2- 172.21.15.49:0/3658356336 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbf7005f270 0x7fbf70061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:25.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.107+0000 7fbf92c14700 1 --2- 172.21.15.49:0/3658356336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf8c0cae90 0x7fbf8c0c7c40 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:25.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.107+0000 7fbf92c14700 1 --2- 172.21.15.49:0/3658356336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf8c0ca180 0x7fbf8c164aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:25.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.107+0000 7fbf92c14700 1 --2- 172.21.15.49:0/3658356336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf8c0caab0 0x7fbf8c154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:25.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.107+0000 7fbf92c14700 1 -- 172.21.15.49:0/3658356336 >> 172.21.15.49:0/3658356336 conn(0x7fbf8c094920 msgr2=0x7fbf8c1596d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:25.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.107+0000 7fbf92c14700 1 -- 172.21.15.49:0/3658356336 shutdown_connections 2023-11-30T18:22:25.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.107+0000 7fbf92c14700 1 -- 172.21.15.49:0/3658356336 wait complete. 2023-11-30T18:22:25.110 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 61 2023-11-30T18:22:25.122 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:22:25.153 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:25.151+0000 7f05d9481680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T18:22:25.226 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:25.224+0000 7f174b642680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T18:22:25.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.241+0000 7fc3de283700 1 Processor -- start 2023-11-30T18:22:25.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.241+0000 7fc3de283700 1 -- start start 2023-11-30T18:22:25.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.242+0000 7fc3de283700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc3d8155e40 0x7fc3d80671e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:25.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.242+0000 7fc3de283700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc3d8067980 0x7fc3d8067df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:25.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.242+0000 7fc3de283700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3d80bd590 con 0x7fc3d8066e00 2023-11-30T18:22:25.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.242+0000 7fc3de283700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3d80a6090 con 0x7fc3d8155e40 2023-11-30T18:22:25.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.242+0000 7fc3de283700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d80682e0 con 0x7fc3d8067980 2023-11-30T18:22:25.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.242+0000 7fc3d77fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc3d8155e40 0x7fc3d80671e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:25.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.242+0000 7fc3dc820700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc3d8067980 0x7fc3d8067df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:25.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.242+0000 7fc3d77fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc3d8155e40 0x7fc3d80671e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:42288/0 (socket says 172.21.15.49:42288) 2023-11-30T18:22:25.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.242+0000 7fc3dc820700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc3d8067980 0x7fc3d8067df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:36894/0 (socket says 172.21.15.49:36894) 2023-11-30T18:22:25.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.242+0000 7fc3d7fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc3d8066e00 0x7fc3d80a5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:38730/0 (socket says 172.21.15.49:38730) 2023-11-30T18:22:25.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.242+0000 7fc3d77fe700 1 -- 172.21.15.49:0/1057824522 learned_addr learned my addr 172.21.15.49:0/1057824522 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:25.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.242+0000 7fc3d77fe700 1 -- 172.21.15.49:0/1057824522 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc3d8067980 msgr2=0x7fc3d8067df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:25.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.242+0000 7fc3d77fe700 1 --2- 172.21.15.49:0/1057824522 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc3d8067980 0x7fc3d8067df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:25.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.242+0000 7fc3d77fe700 1 -- 172.21.15.49:0/1057824522 >> v1:172.21.15.115:6789/0 conn(0x7fc3d8066e00 legacy=0x7fc3d80a5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:25.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.242+0000 7fc3d77fe700 1 -- 172.21.15.49:0/1057824522 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d8156370 con 0x7fc3d8155e40 2023-11-30T18:22:25.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.242+0000 7fc3d6ffd700 1 -- 172.21.15.49:0/1057824522 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1811944671 0 0) 0x7fc3d80bd590 con 0x7fc3d8066e00 2023-11-30T18:22:25.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.242+0000 7fc3d77fe700 1 --2- 172.21.15.49:0/1057824522 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3d8155e40 0x7fc3d80671e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7fc3cc006fd0 tx=0x7fc3cc0090f0).ready entity=mon.1 client_cookie=7b99593932fdfe26 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:25.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.243+0000 7fc3d6ffd700 1 -- 172.21.15.49:0/1057824522 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc00b580 con 0x7fc3d8155e40 2023-11-30T18:22:25.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.243+0000 7fc3d6ffd700 1 -- 172.21.15.49:0/1057824522 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3cc00b6e0 con 0x7fc3d8155e40 2023-11-30T18:22:25.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.243+0000 7fc3d6ffd700 1 -- 172.21.15.49:0/1057824522 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc00ba60 con 0x7fc3d8155e40 2023-11-30T18:22:25.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.243+0000 7fc3de283700 1 -- 172.21.15.49:0/1057824522 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3d8155e40 msgr2=0x7fc3d80671e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:25.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.243+0000 7fc3de283700 1 --2- 172.21.15.49:0/1057824522 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3d8155e40 0x7fc3d80671e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7fc3cc006fd0 tx=0x7fc3cc0090f0).stop 2023-11-30T18:22:25.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.243+0000 7fc3de283700 1 -- 172.21.15.49:0/1057824522 shutdown_connections 2023-11-30T18:22:25.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.243+0000 7fc3de283700 1 --2- 172.21.15.49:0/1057824522 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc3d8067980 0x7fc3d8067df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:25.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.243+0000 7fc3de283700 1 --2- 172.21.15.49:0/1057824522 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3d8155e40 0x7fc3d80671e0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:25.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.243+0000 7fc3de283700 1 -- 172.21.15.49:0/1057824522 >> 172.21.15.49:0/1057824522 conn(0x7fc3d80c7fd0 msgr2=0x7fc3d80c83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:25.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.243+0000 7fc3de283700 1 -- 172.21.15.49:0/1057824522 shutdown_connections 2023-11-30T18:22:25.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.243+0000 7fc3de283700 1 -- 172.21.15.49:0/1057824522 wait complete. 2023-11-30T18:22:25.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.244+0000 7fc3de283700 1 Processor -- start 2023-11-30T18:22:25.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.245+0000 7fc3de283700 1 -- start start 2023-11-30T18:22:25.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.245+0000 7fc3de283700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc3d8066e00 0x7fc3d80aa580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:25.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.245+0000 7fc3de283700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3d8067980 0x7fc3d80aaf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:25.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.245+0000 7fc3de283700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3d8155e40 0x7fc3d80c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:25.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.245+0000 7fc3de283700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d80a86b0 con 0x7fc3d8155e40 2023-11-30T18:22:25.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.245+0000 7fc3de283700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d80ab940 con 0x7fc3d8067980 2023-11-30T18:22:25.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.245+0000 7fc3de283700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d80abc20 con 0x7fc3d8066e00 2023-11-30T18:22:25.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.246+0000 7fc3d7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc3d8066e00 0x7fc3d80aa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:25.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.246+0000 7fc3d77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3d8067980 0x7fc3d80aaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:25.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.246+0000 7fc3dc820700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3d8155e40 0x7fc3d80c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:25.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.246+0000 7fc3d7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc3d8066e00 0x7fc3d80aa580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:36898/0 (socket says 172.21.15.49:36898) 2023-11-30T18:22:25.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.246+0000 7fc3d77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3d8067980 0x7fc3d80aaf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:42294/0 (socket says 172.21.15.49:42294) 2023-11-30T18:22:25.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.246+0000 7fc3d7fff700 1 -- 172.21.15.49:0/462919721 learned_addr learned my addr 172.21.15.49:0/462919721 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:25.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.246+0000 7fc3d77fe700 1 -- 172.21.15.49:0/462919721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc3d8066e00 msgr2=0x7fc3d80aa580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:25.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.246+0000 7fc3d77fe700 1 --2- 172.21.15.49:0/462919721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc3d8066e00 0x7fc3d80aa580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:25.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.246+0000 7fc3d77fe700 1 -- 172.21.15.49:0/462919721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3d8155e40 msgr2=0x7fc3d80c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:25.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.246+0000 7fc3d77fe700 1 --2- 172.21.15.49:0/462919721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3d8155e40 0x7fc3d80c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:25.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.246+0000 7fc3d77fe700 1 -- 172.21.15.49:0/462919721 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3cc009370 con 0x7fc3d8067980 2023-11-30T18:22:25.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.246+0000 7fc3d77fe700 1 --2- 172.21.15.49:0/462919721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3d8067980 0x7fc3d80aaf60 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7fc3cc014000 tx=0x7fc3cc017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:25.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.246+0000 7fc3bffff700 1 -- 172.21.15.49:0/462919721 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc000bc0 con 0x7fc3d8067980 2023-11-30T18:22:25.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.246+0000 7fc3bffff700 1 -- 172.21.15.49:0/462919721 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3cc00b850 con 0x7fc3d8067980 2023-11-30T18:22:25.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.246+0000 7fc3de283700 1 -- 172.21.15.49:0/462919721 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d80abf00 con 0x7fc3d8067980 2023-11-30T18:22:25.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.246+0000 7fc3bffff700 1 -- 172.21.15.49:0/462919721 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc000d20 con 0x7fc3d8067980 2023-11-30T18:22:25.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.246+0000 7fc3de283700 1 -- 172.21.15.49:0/462919721 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d80aaa70 con 0x7fc3d8067980 2023-11-30T18:22:25.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.247+0000 7fc3de283700 1 -- 172.21.15.49:0/462919721 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d80a8820 con 0x7fc3d8067980 2023-11-30T18:22:25.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.248+0000 7fc3bffff700 1 -- 172.21.15.49:0/462919721 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 65) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fc3cc01cad0 con 0x7fc3d8067980 2023-11-30T18:22:25.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.248+0000 7fc3bffff700 1 --2- 172.21.15.49:0/462919721 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc3c405f270 0x7fc3c4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:25.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.248+0000 7fc3bffff700 1 -- 172.21.15.49:0/462919721 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6581+0+0 (secure 0 0 0) 0x7fc3cc07bf00 con 0x7fc3d8067980 2023-11-30T18:22:25.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.248+0000 7fc3d7fff700 1 -- 172.21.15.49:0/462919721 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc3c405f270 msgr2=0x7fc3c4061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:25.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.248+0000 7fc3d7fff700 1 --2- 172.21.15.49:0/462919721 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc3c405f270 0x7fc3c4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:22:25.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.252+0000 7fc3bffff700 1 -- 172.21.15.49:0/462919721 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc3cc04ce80 con 0x7fc3d8067980 2023-11-30T18:22:25.300 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:25.299+0000 7f174b642680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T18:22:25.302 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:25.300+0000 7f05d9481680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T18:22:25.373 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:25.371+0000 7f05d9481680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T18:22:25.379 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:25.377+0000 7f174b642680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T18:22:25.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.449+0000 7fc3d7fff700 1 -- 172.21.15.49:0/462919721 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc3c405f270 msgr2=0x7fc3c4061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:25.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.449+0000 7fc3d7fff700 1 --2- 172.21.15.49:0/462919721 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc3c405f270 0x7fc3c4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T18:22:25.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.468+0000 7fc3de283700 1 -- 172.21.15.49:0/462919721 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3d8156650 con 0x7fc3d8067980 2023-11-30T18:22:25.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.469+0000 7fc3bffff700 1 -- 172.21.15.49:0/462919721 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fc3cc020070 con 0x7fc3d8067980 2023-11-30T18:22:25.471 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:22:25.471 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":61,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6851,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/4266183168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":4266183168},{"type":"v1","addr":"172.21.15.49:6835","nonce":4266183168}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":7810,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1044019551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1044019551},{"type":"v1","addr":"172.21.15.115:6836","nonce":1044019551}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":7813,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/676160579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":676160579},{"type":"v1","addr":"172.21.15.115:6837","nonce":676160579}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T17:26:20.358070+0000","modified":"2023-11-30T17:26:23.364931+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8085":{"gid":8085,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/2798044365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2798044365},{"type":"v1","addr":"172.21.15.49:6834","nonce":2798044365}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-11-30T18:22:25.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.471+0000 7fc3de283700 1 -- 172.21.15.49:0/462919721 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc3c405f270 msgr2=0x7fc3c4061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:22:25.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.471+0000 7fc3de283700 1 --2- 172.21.15.49:0/462919721 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc3c405f270 0x7fc3c4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:25.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.471+0000 7fc3de283700 1 -- 172.21.15.49:0/462919721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3d8067980 msgr2=0x7fc3d80aaf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:25.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.471+0000 7fc3de283700 1 --2- 172.21.15.49:0/462919721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3d8067980 0x7fc3d80aaf60 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7fc3cc014000 tx=0x7fc3cc017000).stop 2023-11-30T18:22:25.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.471+0000 7fc3de283700 1 -- 172.21.15.49:0/462919721 shutdown_connections 2023-11-30T18:22:25.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.471+0000 7fc3de283700 1 --2- 172.21.15.49:0/462919721 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc3c405f270 0x7fc3c4061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:25.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.471+0000 7fc3de283700 1 --2- 172.21.15.49:0/462919721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3d8155e40 0x7fc3d80c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:25.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.471+0000 7fc3de283700 1 --2- 172.21.15.49:0/462919721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc3d8066e00 0x7fc3d80aa580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:25.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.471+0000 7fc3de283700 1 --2- 172.21.15.49:0/462919721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3d8067980 0x7fc3d80aaf60 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:25.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.471+0000 7fc3de283700 1 -- 172.21.15.49:0/462919721 >> 172.21.15.49:0/462919721 conn(0x7fc3d80c7fd0 msgr2=0x7fc3d80be790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:25.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.471+0000 7fc3de283700 1 -- 172.21.15.49:0/462919721 shutdown_connections 2023-11-30T18:22:25.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.471+0000 7fc3de283700 1 -- 172.21.15.49:0/462919721 wait complete. 2023-11-30T18:22:25.474 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 61 2023-11-30T18:22:25.485 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:22:25.489 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:25.488+0000 7f05d9481680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T18:22:25.534 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:25.533+0000 7f174b642680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T18:22:25.598 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:25.597+0000 7f05d9481680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:22:25.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.603+0000 7f1c2678f700 1 Processor -- start 2023-11-30T18:22:25.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.604+0000 7f1c2678f700 1 -- start start 2023-11-30T18:22:25.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.605+0000 7f1c2678f700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1c201544e0 0x7f1c201548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:25.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.605+0000 7f1c2678f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c200c69a0 con 0x7f1c200c6e30 2023-11-30T18:22:25.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.605+0000 7f1c2678f700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c200c13a0 con 0x7f1c2006a610 2023-11-30T18:22:25.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.605+0000 7f1c2678f700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c200c1680 con 0x7f1c201544e0 2023-11-30T18:22:25.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.605+0000 7f1c24d2c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1c200c6e30 0x7f1c200a8000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:54998/0 (socket says 172.21.15.49:54998) 2023-11-30T18:22:25.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.605+0000 7f1c24d2c700 1 -- 172.21.15.49:0/3788494367 learned_addr learned my addr 172.21.15.49:0/3788494367 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:22:25.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.605+0000 7f1c1ffff700 1 --2- 172.21.15.49:0/3788494367 >> v2:172.21.15.115:3300/0 conn(0x7f1c201544e0 0x7f1c201548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:25.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.606+0000 7f1c1effd700 1 -- 172.21.15.49:0/3788494367 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1281821635 0 0) 0x7f1c200c69a0 con 0x7f1c200c6e30 2023-11-30T18:22:25.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.606+0000 7f1c1effd700 1 -- 172.21.15.49:0/3788494367 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c0c0033f0 con 0x7f1c200c6e30 2023-11-30T18:22:25.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.606+0000 7f1c1ffff700 1 -- 172.21.15.49:0/3788494367 >> v1:172.21.15.115:6789/0 conn(0x7f1c2006a610 legacy=0x7f1c200c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:25.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.606+0000 7f1c1effd700 1 -- 172.21.15.49:0/3788494367 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2124089885 0 0) 0x7f1c200c13a0 con 0x7f1c2006a610 2023-11-30T18:22:25.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.606+0000 7f1c1ffff700 1 -- 172.21.15.49:0/3788494367 >> v1:172.21.15.49:6789/0 conn(0x7f1c200c6e30 legacy=0x7f1c200a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:25.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.606+0000 7f1c1ffff700 1 -- 172.21.15.49:0/3788494367 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c200c6630 con 0x7f1c201544e0 2023-11-30T18:22:25.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.606+0000 7f1c1ffff700 1 --2- 172.21.15.49:0/3788494367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c201544e0 0x7f1c201548c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f1c10006fd0 tx=0x7f1c10006f40).ready entity=mon.1 client_cookie=837602e26398cdb7 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:25.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.606+0000 7f1c1effd700 1 -- 172.21.15.49:0/3788494367 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c10005880 con 0x7f1c201544e0 2023-11-30T18:22:25.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.606+0000 7f1c1effd700 1 -- 172.21.15.49:0/3788494367 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c100059e0 con 0x7f1c201544e0 2023-11-30T18:22:25.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.606+0000 7f1c1effd700 1 -- 172.21.15.49:0/3788494367 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c10005d60 con 0x7f1c201544e0 2023-11-30T18:22:25.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.607+0000 7f1c2678f700 1 -- 172.21.15.49:0/3788494367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c201544e0 msgr2=0x7f1c201548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:25.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.607+0000 7f1c2678f700 1 --2- 172.21.15.49:0/3788494367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c201544e0 0x7f1c201548c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f1c10006fd0 tx=0x7f1c10006f40).stop 2023-11-30T18:22:25.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.607+0000 7f1c2678f700 1 -- 172.21.15.49:0/3788494367 shutdown_connections 2023-11-30T18:22:25.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.607+0000 7f1c2678f700 1 --2- 172.21.15.49:0/3788494367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c201544e0 0x7f1c201548c0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:25.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.607+0000 7f1c2678f700 1 -- 172.21.15.49:0/3788494367 >> 172.21.15.49:0/3788494367 conn(0x7f1c20085020 msgr2=0x7f1c20094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:25.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.607+0000 7f1c2678f700 1 -- 172.21.15.49:0/3788494367 shutdown_connections 2023-11-30T18:22:25.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.607+0000 7f1c2678f700 1 -- 172.21.15.49:0/3788494367 wait complete. 2023-11-30T18:22:25.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.609+0000 7f1c2678f700 1 Processor -- start 2023-11-30T18:22:25.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.609+0000 7f1c2678f700 1 -- start start 2023-11-30T18:22:25.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.610+0000 7f1c2678f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c2006a610 0x7f1c20152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:25.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.610+0000 7f1c2678f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c200c6e30 0x7f1c20098770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:25.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.610+0000 7f1c2678f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c201544e0 0x7f1c201508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:25.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.610+0000 7f1c2678f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c20095b70 con 0x7f1c200c6e30 2023-11-30T18:22:25.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.610+0000 7f1c2678f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c20164890 con 0x7f1c2006a610 2023-11-30T18:22:25.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.610+0000 7f1c2678f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c20095240 con 0x7f1c201544e0 2023-11-30T18:22:25.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.610+0000 7f1c1f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c200c6e30 0x7f1c20098770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:25.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.611+0000 7f1c1f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c200c6e30 0x7f1c20098770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45774/0 (socket says 172.21.15.49:45774) 2023-11-30T18:22:25.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.611+0000 7f1c1f7fe700 1 -- 172.21.15.49:0/1072549788 learned_addr learned my addr 172.21.15.49:0/1072549788 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:25.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.611+0000 7f1c1ffff700 1 --2- 172.21.15.49:0/1072549788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c2006a610 0x7f1c20152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:25.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.611+0000 7f1c24d2c700 1 --2- 172.21.15.49:0/1072549788 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c201544e0 0x7f1c201508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:25.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.611+0000 7f1c1f7fe700 1 -- 172.21.15.49:0/1072549788 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c201544e0 msgr2=0x7f1c201508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:25.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.611+0000 7f1c1f7fe700 1 --2- 172.21.15.49:0/1072549788 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c201544e0 0x7f1c201508d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:25.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.611+0000 7f1c1f7fe700 1 -- 172.21.15.49:0/1072549788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c2006a610 msgr2=0x7f1c20152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:25.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.611+0000 7f1c1f7fe700 1 --2- 172.21.15.49:0/1072549788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c2006a610 0x7f1c20152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:25.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.611+0000 7f1c1f7fe700 1 -- 172.21.15.49:0/1072549788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c10009250 con 0x7f1c200c6e30 2023-11-30T18:22:25.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.611+0000 7f1c1f7fe700 1 --2- 172.21.15.49:0/1072549788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c200c6e30 0x7f1c20098770 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7f1c0800c490 tx=0x7f1c08007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:25.615 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:25.611+0000 7f174b642680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T18:22:25.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.611+0000 7f1c17fff700 1 -- 172.21.15.49:0/1072549788 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c08001ea0 con 0x7f1c200c6e30 2023-11-30T18:22:25.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.611+0000 7f1c17fff700 1 -- 172.21.15.49:0/1072549788 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c08007020 con 0x7f1c200c6e30 2023-11-30T18:22:25.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.611+0000 7f1c2678f700 1 -- 172.21.15.49:0/1072549788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c20095520 con 0x7f1c200c6e30 2023-11-30T18:22:25.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.611+0000 7f1c17fff700 1 -- 172.21.15.49:0/1072549788 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c080073c0 con 0x7f1c200c6e30 2023-11-30T18:22:25.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.611+0000 7f1c2678f700 1 -- 172.21.15.49:0/1072549788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c20098c60 con 0x7f1c200c6e30 2023-11-30T18:22:25.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.612+0000 7f1c2678f700 1 -- 172.21.15.49:0/1072549788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c20095d20 con 0x7f1c200c6e30 2023-11-30T18:22:25.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.613+0000 7f1c17fff700 1 -- 172.21.15.49:0/1072549788 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 65) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f1c08006ac0 con 0x7f1c200c6e30 2023-11-30T18:22:25.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.613+0000 7f1c17fff700 1 --2- 172.21.15.49:0/1072549788 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1c0005f270 0x7f1c00061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:25.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.613+0000 7f1c17fff700 1 -- 172.21.15.49:0/1072549788 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6581+0+0 (secure 0 0 0) 0x7f1c0807a000 con 0x7f1c200c6e30 2023-11-30T18:22:25.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.613+0000 7f1c1ffff700 1 -- 172.21.15.49:0/1072549788 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1c0005f270 msgr2=0x7f1c00061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:25.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.613+0000 7f1c1ffff700 1 --2- 172.21.15.49:0/1072549788 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1c0005f270 0x7f1c00061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:22:25.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.617+0000 7f1c17fff700 1 -- 172.21.15.49:0/1072549788 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1c20095d20 con 0x7f1c200c6e30 2023-11-30T18:22:25.738 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:25.736+0000 7f174b642680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T18:22:25.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.796+0000 7f1c2678f700 1 -- 172.21.15.49:0/1072549788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c20095d20 con 0x7f1c200c6e30 2023-11-30T18:22:25.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.797+0000 7f1c17fff700 1 -- 172.21.15.49:0/1072549788 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+17667 (secure 0 0 0) 0x7f1c20095d20 con 0x7f1c200c6e30 2023-11-30T18:22:25.799 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:22:25.799 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":155,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:22:25.707050+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-11-30T17:26:18.350122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-11-30T17:26:19.327933+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":113,"snap_epoch":155,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.1a","mappings":[{"from":0,"to":5}]},{"pgid":"17.3c","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/1086530775":"2023-12-01T17:26:32.594059+0000","172.21.15.115:0/390416334":"2023-12-01T17:26:32.594059+0000","172.21.15.115:0/2966399435":"2023-12-01T17:26:32.594059+0000","172.21.15.115:6833/89956":"2023-12-01T17:26:32.594059+0000","172.21.15.115:6832/89956":"2023-12-01T17:26:32.594059+0000","172.21.15.115:0/3029851732":"2023-12-01T17:26:32.594059+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[{"pool":18,"snaps":[{"begin":57,"length":1},{"begin":113,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:22:25.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.799+0000 7f1c2678f700 1 -- 172.21.15.49:0/1072549788 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1c0005f270 msgr2=0x7f1c00061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:22:25.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.799+0000 7f1c2678f700 1 --2- 172.21.15.49:0/1072549788 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1c0005f270 0x7f1c00061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:25.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.799+0000 7f1c2678f700 1 -- 172.21.15.49:0/1072549788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c200c6e30 msgr2=0x7f1c20098770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:25.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.799+0000 7f1c2678f700 1 --2- 172.21.15.49:0/1072549788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c200c6e30 0x7f1c20098770 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7f1c0800c490 tx=0x7f1c08007dd0).stop 2023-11-30T18:22:25.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.799+0000 7f1c2678f700 1 -- 172.21.15.49:0/1072549788 shutdown_connections 2023-11-30T18:22:25.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.799+0000 7f1c2678f700 1 --2- 172.21.15.49:0/1072549788 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c201544e0 0x7f1c201508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:25.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.799+0000 7f1c2678f700 1 --2- 172.21.15.49:0/1072549788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c2006a610 0x7f1c20152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:25.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.799+0000 7f1c2678f700 1 --2- 172.21.15.49:0/1072549788 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1c0005f270 0x7f1c00061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:25.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.799+0000 7f1c2678f700 1 --2- 172.21.15.49:0/1072549788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c200c6e30 0x7f1c20098770 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:25.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.799+0000 7f1c2678f700 1 -- 172.21.15.49:0/1072549788 >> 172.21.15.49:0/1072549788 conn(0x7f1c20085020 msgr2=0x7f1c200ca6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:25.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.799+0000 7f1c2678f700 1 -- 172.21.15.49:0/1072549788 shutdown_connections 2023-11-30T18:22:25.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.799+0000 7f1c2678f700 1 -- 172.21.15.49:0/1072549788 wait complete. 2023-11-30T18:22:25.814 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-30T18:22:25.859 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:25.858+0000 7f174b642680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:22:25.897 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:25.895+0000 7f05d9481680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T18:22:25.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.941+0000 7f3727cba700 1 Processor -- start 2023-11-30T18:22:25.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.941+0000 7f3727cba700 1 -- start start 2023-11-30T18:22:25.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.942+0000 7f3727cba700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f37200bcdd0 0x7f372014eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:25.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.942+0000 7f3727cba700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37200634a0 con 0x7f372014eb00 2023-11-30T18:22:25.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.942+0000 7f3727cba700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3720063780 con 0x7f3720062770 2023-11-30T18:22:25.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.942+0000 7f3727cba700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3720137d90 con 0x7f37200bcdd0 2023-11-30T18:22:25.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.942+0000 7f3725255700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f37200bcdd0 0x7f372014eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:25.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.942+0000 7f3725255700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f37200bcdd0 0x7f372014eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45780/0 (socket says 172.21.15.49:45780) 2023-11-30T18:22:25.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.942+0000 7f3725a56700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f372014eb00 0x7f37200bc6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55004/0 (socket says 172.21.15.49:55004) 2023-11-30T18:22:25.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.942+0000 7f3725255700 1 -- 172.21.15.49:0/1320049203 learned_addr learned my addr 172.21.15.49:0/1320049203 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:25.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.942+0000 7f3725255700 1 -- 172.21.15.49:0/1320049203 >> v1:172.21.15.115:6789/0 conn(0x7f3720062770 legacy=0x7f3720062b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:25.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.942+0000 7f3725255700 1 -- 172.21.15.49:0/1320049203 >> v1:172.21.15.49:6789/0 conn(0x7f372014eb00 legacy=0x7f37200bc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:25.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.942+0000 7f3724a54700 1 -- 172.21.15.49:0/1320049203 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2190232620 0 0) 0x7f3720063780 con 0x7f3720062770 2023-11-30T18:22:25.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.942+0000 7f3725255700 1 -- 172.21.15.49:0/1320049203 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3720063a60 con 0x7f37200bcdd0 2023-11-30T18:22:25.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.942+0000 7f3725255700 1 --2- 172.21.15.49:0/1320049203 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37200bcdd0 0x7f372014eee0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f371c009810 tx=0x7f371c009060).ready entity=mon.0 client_cookie=2cdc81604df278b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:25.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.943+0000 7f3724a54700 1 -- 172.21.15.49:0/1320049203 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c00f510 con 0x7f37200bcdd0 2023-11-30T18:22:25.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.943+0000 7f3724a54700 1 -- 172.21.15.49:0/1320049203 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371c00f670 con 0x7f37200bcdd0 2023-11-30T18:22:25.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.943+0000 7f3724a54700 1 -- 172.21.15.49:0/1320049203 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c00f9f0 con 0x7f37200bcdd0 2023-11-30T18:22:25.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.943+0000 7f3727cba700 1 -- 172.21.15.49:0/1320049203 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37200bcdd0 msgr2=0x7f372014eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:25.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.943+0000 7f3727cba700 1 --2- 172.21.15.49:0/1320049203 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37200bcdd0 0x7f372014eee0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f371c009810 tx=0x7f371c009060).stop 2023-11-30T18:22:25.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.943+0000 7f3727cba700 1 -- 172.21.15.49:0/1320049203 shutdown_connections 2023-11-30T18:22:25.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.943+0000 7f3727cba700 1 --2- 172.21.15.49:0/1320049203 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37200bcdd0 0x7f372014eee0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:25.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.943+0000 7f3727cba700 1 -- 172.21.15.49:0/1320049203 >> 172.21.15.49:0/1320049203 conn(0x7f37200c8230 msgr2=0x7f37200c4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:25.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.943+0000 7f3727cba700 1 -- 172.21.15.49:0/1320049203 shutdown_connections 2023-11-30T18:22:25.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.944+0000 7f3727cba700 1 -- 172.21.15.49:0/1320049203 wait complete. 2023-11-30T18:22:25.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.945+0000 7f3727cba700 1 Processor -- start 2023-11-30T18:22:25.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.945+0000 7f3727cba700 1 -- start start 2023-11-30T18:22:25.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.945+0000 7f3727cba700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3720062770 0x7f3720137150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:25.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.945+0000 7f3727cba700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37200bcdd0 0x7f372013a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:25.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.945+0000 7f3727cba700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f372014eb00 0x7f37200c0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:25.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.945+0000 7f3727cba700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37200c1b20 con 0x7f372014eb00 2023-11-30T18:22:25.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.945+0000 7f3727cba700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37200ab6e0 con 0x7f37200bcdd0 2023-11-30T18:22:25.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.945+0000 7f3727cba700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37200ab0e0 con 0x7f3720062770 2023-11-30T18:22:25.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.946+0000 7f3726257700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f372014eb00 0x7f37200c0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:25.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.946+0000 7f3726257700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f372014eb00 0x7f37200c0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45792/0 (socket says 172.21.15.49:45792) 2023-11-30T18:22:25.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.946+0000 7f3726257700 1 -- 172.21.15.49:0/3290254304 learned_addr learned my addr 172.21.15.49:0/3290254304 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:25.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.946+0000 7f3725255700 1 --2- 172.21.15.49:0/3290254304 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37200bcdd0 0x7f372013a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:25.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.946+0000 7f3725a56700 1 --2- 172.21.15.49:0/3290254304 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3720062770 0x7f3720137150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:25.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.946+0000 7f3726257700 1 -- 172.21.15.49:0/3290254304 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3720062770 msgr2=0x7f3720137150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:25.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.946+0000 7f3726257700 1 --2- 172.21.15.49:0/3290254304 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3720062770 0x7f3720137150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:25.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.946+0000 7f3726257700 1 -- 172.21.15.49:0/3290254304 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37200bcdd0 msgr2=0x7f372013a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:25.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.946+0000 7f3726257700 1 --2- 172.21.15.49:0/3290254304 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37200bcdd0 0x7f372013a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:25.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.946+0000 7f3726257700 1 -- 172.21.15.49:0/3290254304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371c009300 con 0x7f372014eb00 2023-11-30T18:22:25.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.946+0000 7f3726257700 1 --2- 172.21.15.49:0/3290254304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f372014eb00 0x7f37200c0820 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7f371800c7e0 tx=0x7f3718007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:25.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.946+0000 7f3711ffb700 1 -- 172.21.15.49:0/3290254304 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3718010510 con 0x7f372014eb00 2023-11-30T18:22:25.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.946+0000 7f3711ffb700 1 -- 172.21.15.49:0/3290254304 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3718010670 con 0x7f372014eb00 2023-11-30T18:22:25.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.946+0000 7f3727cba700 1 -- 172.21.15.49:0/3290254304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37200ad2e0 con 0x7f372014eb00 2023-11-30T18:22:25.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.946+0000 7f3711ffb700 1 -- 172.21.15.49:0/3290254304 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3718010a10 con 0x7f372014eb00 2023-11-30T18:22:25.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.946+0000 7f3727cba700 1 -- 172.21.15.49:0/3290254304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37200ab370 con 0x7f372014eb00 2023-11-30T18:22:25.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.948+0000 7f3711ffb700 1 -- 172.21.15.49:0/3290254304 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 65) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f371801b400 con 0x7f372014eb00 2023-11-30T18:22:25.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.948+0000 7f3727cba700 1 -- 172.21.15.49:0/3290254304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f372006c860 con 0x7f372014eb00 2023-11-30T18:22:25.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.948+0000 7f3711ffb700 1 --2- 172.21.15.49:0/3290254304 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f370405f270 0x7f3704061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:25.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.948+0000 7f3711ffb700 1 -- 172.21.15.49:0/3290254304 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6581+0+0 (secure 0 0 0) 0x7f371807a420 con 0x7f372014eb00 2023-11-30T18:22:25.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.948+0000 7f3725a56700 1 -- 172.21.15.49:0/3290254304 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f370405f270 msgr2=0x7f3704061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:25.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.948+0000 7f3725a56700 1 --2- 172.21.15.49:0/3290254304 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f370405f270 0x7f3704061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:22:25.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.953+0000 7f3711ffb700 1 -- 172.21.15.49:0/3290254304 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f371804b340 con 0x7f372014eb00 2023-11-30T18:22:25.970 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:25.967+0000 7f05d9481680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T18:22:25.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.989+0000 7f3711ffb700 1 -- 172.21.15.49:0/3290254304 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 66) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f3718018d60 con 0x7f372014eb00 2023-11-30T18:22:25.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.989+0000 7f3711ffb700 1 -- 172.21.15.49:0/3290254304 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f370405f270 msgr2=0x7f3704061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:22:25.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:25.989+0000 7f3711ffb700 1 --2- 172.21.15.49:0/3290254304 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f370405f270 0x7f3704061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:26.047 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:26.045+0000 7f0556c19700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:22:26.047 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:26.045+0000 7f0553c13700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:22:26.047 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:26.045+0000 7f0556c19700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:22:26.047 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:26.045+0000 7f0553c13700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:22:26.047 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:26.045+0000 7f0553c13700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:22:26.047 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:26.045+0000 7f0556c19700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:22:26.047 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:26.045+0000 7f0553c13700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:22:26.047 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:26.045+0000 7f0556c19700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:22:26.047 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:26.045+0000 7f0553c13700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:22:26.047 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:26.045+0000 7f0556c19700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:22:26.170 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:26.169+0000 7f174b642680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T18:22:26.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:26.179+0000 7f3727cba700 1 -- 172.21.15.49:0/3290254304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f37200c4ac0 con 0x7f372014eb00 2023-11-30T18:22:26.245 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:26.243+0000 7f174b642680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T18:22:26.986 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-11-30T18:22:26.984+0000 7f3888d95700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-30T18:22:26.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:26.989+0000 7f3711ffb700 1 -- 172.21.15.49:0/3290254304 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mgrmap(e 67) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f3718078220 con 0x7f372014eb00 2023-11-30T18:22:26.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:26.990+0000 7f3711ffb700 1 --2- 172.21.15.49:0/3290254304 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f370405f270 0x7f37040616b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:26.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:26.990+0000 7f3725a56700 1 --2- 172.21.15.49:0/3290254304 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f370405f270 0x7f37040616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:26.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:26.991+0000 7f3725a56700 1 --2- 172.21.15.49:0/3290254304 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f370405f270 0x7f37040616b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f3714007f80 tx=0x7f3714009040).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:26.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:26.997+0000 7f3711ffb700 1 -- 172.21.15.49:0/3290254304 <== mon.0 v2:172.21.15.49:3300/0 9 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v62) v1 ==== 161+0+0 (secure 0 0 0) 0x7f371804c350 con 0x7f372014eb00 2023-11-30T18:22:27.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:26.999+0000 7f3727cba700 1 -- 172.21.15.49:0/3290254304 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f370405f270 msgr2=0x7f37040616b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:27.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:26.999+0000 7f3727cba700 1 --2- 172.21.15.49:0/3290254304 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f370405f270 0x7f37040616b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f3714007f80 tx=0x7f3714009040).stop 2023-11-30T18:22:27.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:26.999+0000 7f3727cba700 1 -- 172.21.15.49:0/3290254304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f372014eb00 msgr2=0x7f37200c0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:27.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:26.999+0000 7f3727cba700 1 --2- 172.21.15.49:0/3290254304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f372014eb00 0x7f37200c0820 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7f371800c7e0 tx=0x7f3718007f70).stop 2023-11-30T18:22:27.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.000+0000 7f3727cba700 1 -- 172.21.15.49:0/3290254304 shutdown_connections 2023-11-30T18:22:27.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.000+0000 7f3727cba700 1 --2- 172.21.15.49:0/3290254304 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f370405f270 0x7f37040616b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:27.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.000+0000 7f3727cba700 1 --2- 172.21.15.49:0/3290254304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f372014eb00 0x7f37200c0820 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:27.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.000+0000 7f3727cba700 1 --2- 172.21.15.49:0/3290254304 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3720062770 0x7f3720137150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:27.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.000+0000 7f3727cba700 1 --2- 172.21.15.49:0/3290254304 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37200bcdd0 0x7f372013a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:27.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.000+0000 7f3727cba700 1 -- 172.21.15.49:0/3290254304 >> 172.21.15.49:0/3290254304 conn(0x7f37200c8230 msgr2=0x7f37200c1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:27.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.001+0000 7f3727cba700 1 -- 172.21.15.49:0/3290254304 shutdown_connections 2023-11-30T18:22:27.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.001+0000 7f3727cba700 1 -- 172.21.15.49:0/3290254304 wait complete. 2023-11-30T18:22:27.003 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-30T18:22:27.017 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-30T18:22:27.035 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-11-30T18:22:27.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.140+0000 7fa151265700 1 Processor -- start 2023-11-30T18:22:27.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.140+0000 7fa151265700 1 -- start start 2023-11-30T18:22:27.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.141+0000 7fa151265700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa14c098d10 0x7fa14c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:27.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.141+0000 7fa151265700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa14c158320 0x7fa14c1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:27.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.141+0000 7fa151265700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa14c158cc0 con 0x7fa14c0c6190 2023-11-30T18:22:27.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.141+0000 7fa151265700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa14c0c72d0 con 0x7fa14c098d10 2023-11-30T18:22:27.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.141+0000 7fa151265700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa14c064570 con 0x7fa14c158320 2023-11-30T18:22:27.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.141+0000 7fa14affd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa14c098d10 0x7fa14c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:27.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.141+0000 7fa14b7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa14c158320 0x7fa14c1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:27.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.141+0000 7fa14a7fc700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa14c0c6190 0x7fa14c063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:38744/0 (socket says 172.21.15.49:38744) 2023-11-30T18:22:27.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.141+0000 7fa14affd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa14c098d10 0x7fa14c0c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:42356/0 (socket says 172.21.15.49:42356) 2023-11-30T18:22:27.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.141+0000 7fa14affd700 1 -- 172.21.15.49:0/1387825706 learned_addr learned my addr 172.21.15.49:0/1387825706 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:27.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.141+0000 7fa14b7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa14c158320 0x7fa14c1587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:36932/0 (socket says 172.21.15.49:36932) 2023-11-30T18:22:27.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.141+0000 7fa14b7fe700 1 -- 172.21.15.49:0/1387825706 >> v2:172.21.15.115:3300/0 conn(0x7fa14c098d10 msgr2=0x7fa14c0c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:27.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.141+0000 7fa14b7fe700 1 --2- 172.21.15.49:0/1387825706 >> v2:172.21.15.115:3300/0 conn(0x7fa14c098d10 0x7fa14c0c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:27.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.141+0000 7fa14b7fe700 1 -- 172.21.15.49:0/1387825706 >> v1:172.21.15.115:6789/0 conn(0x7fa14c0c6190 legacy=0x7fa14c063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:27.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.141+0000 7fa14b7fe700 1 -- 172.21.15.49:0/1387825706 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa14c154bc0 con 0x7fa14c158320 2023-11-30T18:22:27.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.141+0000 7fa14affd700 1 --2- 172.21.15.49:0/1387825706 >> v2:172.21.15.115:3300/0 conn(0x7fa14c098d10 0x7fa14c0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:22:27.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.142+0000 7fa14b7fe700 1 --2- 172.21.15.49:0/1387825706 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa14c158320 0x7fa14c1587d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fa144009e60 tx=0x7fa144009780).ready entity=mon.2 client_cookie=f2eca1324ee73b6a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:27.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.142+0000 7fa149ffb700 1 -- 172.21.15.49:0/1387825706 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14400e070 con 0x7fa14c158320 2023-11-30T18:22:27.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.142+0000 7fa149ffb700 1 -- 172.21.15.49:0/1387825706 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14400bb60 con 0x7fa14c158320 2023-11-30T18:22:27.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.142+0000 7fa149ffb700 1 -- 172.21.15.49:0/1387825706 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa144012410 con 0x7fa14c158320 2023-11-30T18:22:27.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.142+0000 7fa151265700 1 -- 172.21.15.49:0/1387825706 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa14c158320 msgr2=0x7fa14c1587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:27.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.142+0000 7fa151265700 1 --2- 172.21.15.49:0/1387825706 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa14c158320 0x7fa14c1587d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fa144009e60 tx=0x7fa144009780).stop 2023-11-30T18:22:27.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.142+0000 7fa151265700 1 -- 172.21.15.49:0/1387825706 shutdown_connections 2023-11-30T18:22:27.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.142+0000 7fa151265700 1 --2- 172.21.15.49:0/1387825706 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa14c158320 0x7fa14c1587d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:27.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.142+0000 7fa151265700 1 --2- 172.21.15.49:0/1387825706 >> v2:172.21.15.115:3300/0 conn(0x7fa14c098d10 0x7fa14c0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:27.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.142+0000 7fa151265700 1 -- 172.21.15.49:0/1387825706 >> 172.21.15.49:0/1387825706 conn(0x7fa14c0cb310 msgr2=0x7fa14c0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:27.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.142+0000 7fa151265700 1 -- 172.21.15.49:0/1387825706 shutdown_connections 2023-11-30T18:22:27.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.142+0000 7fa151265700 1 -- 172.21.15.49:0/1387825706 wait complete. 2023-11-30T18:22:27.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.144+0000 7fa151265700 1 Processor -- start 2023-11-30T18:22:27.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.144+0000 7fa151265700 1 -- start start 2023-11-30T18:22:27.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.144+0000 7fa151265700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa14c098d10 0x7fa14c0aad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:27.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.144+0000 7fa151265700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa14c0c6190 0x7fa14c149900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:27.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.144+0000 7fa151265700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa14c158320 0x7fa14c1680a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:27.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.144+0000 7fa151265700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14c0ab260 con 0x7fa14c0c6190 2023-11-30T18:22:27.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.145+0000 7fa151265700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14c149df0 con 0x7fa14c158320 2023-11-30T18:22:27.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.145+0000 7fa151265700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa14c1688b0 con 0x7fa14c098d10 2023-11-30T18:22:27.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.145+0000 7fa14a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa14c0c6190 0x7fa14c149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:27.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.145+0000 7fa14a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa14c0c6190 0x7fa14c149900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45798/0 (socket says 172.21.15.49:45798) 2023-11-30T18:22:27.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.145+0000 7fa14a7fc700 1 -- 172.21.15.49:0/2967942536 learned_addr learned my addr 172.21.15.49:0/2967942536 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:27.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.145+0000 7fa14affd700 1 --2- 172.21.15.49:0/2967942536 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa14c098d10 0x7fa14c0aad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:27.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.145+0000 7fa14b7fe700 1 --2- 172.21.15.49:0/2967942536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa14c158320 0x7fa14c1680a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:27.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.145+0000 7fa14a7fc700 1 -- 172.21.15.49:0/2967942536 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa14c098d10 msgr2=0x7fa14c0aad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:27.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.145+0000 7fa14a7fc700 1 --2- 172.21.15.49:0/2967942536 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa14c098d10 0x7fa14c0aad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:27.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.145+0000 7fa14a7fc700 1 -- 172.21.15.49:0/2967942536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa14c158320 msgr2=0x7fa14c1680a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:27.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.145+0000 7fa14a7fc700 1 --2- 172.21.15.49:0/2967942536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa14c158320 0x7fa14c1680a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:27.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.145+0000 7fa14a7fc700 1 -- 172.21.15.49:0/2967942536 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13c009370 con 0x7fa14c0c6190 2023-11-30T18:22:27.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.145+0000 7fa14a7fc700 1 --2- 172.21.15.49:0/2967942536 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa14c0c6190 0x7fa14c149900 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7fa14000c4c0 tx=0x7fa140007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:27.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.145+0000 7fa132ffd700 1 -- 172.21.15.49:0/2967942536 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14000ce10 con 0x7fa14c0c6190 2023-11-30T18:22:27.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.145+0000 7fa132ffd700 1 -- 172.21.15.49:0/2967942536 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1400072e0 con 0x7fa14c0c6190 2023-11-30T18:22:27.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.145+0000 7fa151265700 1 -- 172.21.15.49:0/2967942536 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa144009a20 con 0x7fa14c0c6190 2023-11-30T18:22:27.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.145+0000 7fa132ffd700 1 -- 172.21.15.49:0/2967942536 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1400056e0 con 0x7fa14c0c6190 2023-11-30T18:22:27.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.145+0000 7fa151265700 1 -- 172.21.15.49:0/2967942536 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa14c168e70 con 0x7fa14c0c6190 2023-11-30T18:22:27.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.146+0000 7fa151265700 1 -- 172.21.15.49:0/2967942536 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa14c06c860 con 0x7fa14c0c6190 2023-11-30T18:22:27.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.147+0000 7fa132ffd700 1 -- 172.21.15.49:0/2967942536 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 67) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fa140005b10 con 0x7fa14c0c6190 2023-11-30T18:22:27.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.147+0000 7fa132ffd700 1 --2- 172.21.15.49:0/2967942536 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa13805f000 0x7fa1380614c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:27.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.147+0000 7fa132ffd700 1 -- 172.21.15.49:0/2967942536 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6795+0+0 (secure 0 0 0) 0x7fa1400795e0 con 0x7fa14c0c6190 2023-11-30T18:22:27.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.147+0000 7fa14affd700 1 --2- 172.21.15.49:0/2967942536 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa13805f000 0x7fa1380614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:27.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.148+0000 7fa14affd700 1 --2- 172.21.15.49:0/2967942536 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa13805f000 0x7fa1380614c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fa13c006fd0 tx=0x7fa13c0090f0).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:27.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.151+0000 7fa132ffd700 1 -- 172.21.15.49:0/2967942536 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa14004a7e0 con 0x7fa14c0c6190 2023-11-30T18:22:27.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:27.367+0000 7fa151265700 1 -- 172.21.15.49:0/2967942536 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa14c158cc0 con 0x7fa14c0c6190 2023-11-30T18:22:28.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.002+0000 7fa132ffd700 1 -- 172.21.15.49:0/2967942536 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v63) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa14c158cc0 con 0x7fa14c0c6190 2023-11-30T18:22:28.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.004+0000 7fa151265700 1 -- 172.21.15.49:0/2967942536 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa13805f000 msgr2=0x7fa1380614c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:28.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.004+0000 7fa151265700 1 --2- 172.21.15.49:0/2967942536 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa13805f000 0x7fa1380614c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fa13c006fd0 tx=0x7fa13c0090f0).stop 2023-11-30T18:22:28.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.004+0000 7fa151265700 1 -- 172.21.15.49:0/2967942536 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa14c0c6190 msgr2=0x7fa14c149900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:28.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.004+0000 7fa151265700 1 --2- 172.21.15.49:0/2967942536 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa14c0c6190 0x7fa14c149900 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7fa14000c4c0 tx=0x7fa140007dc0).stop 2023-11-30T18:22:28.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.004+0000 7fa151265700 1 -- 172.21.15.49:0/2967942536 shutdown_connections 2023-11-30T18:22:28.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.004+0000 7fa151265700 1 --2- 172.21.15.49:0/2967942536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa14c158320 0x7fa14c1680a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:28.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.004+0000 7fa151265700 1 --2- 172.21.15.49:0/2967942536 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa14c098d10 0x7fa14c0aad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:28.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.004+0000 7fa151265700 1 --2- 172.21.15.49:0/2967942536 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa13805f000 0x7fa1380614c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:28.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.004+0000 7fa151265700 1 --2- 172.21.15.49:0/2967942536 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa14c0c6190 0x7fa14c149900 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:28.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.004+0000 7fa151265700 1 -- 172.21.15.49:0/2967942536 >> 172.21.15.49:0/2967942536 conn(0x7fa14c0cb310 msgr2=0x7fa14c063990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:28.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.004+0000 7fa151265700 1 -- 172.21.15.49:0/2967942536 shutdown_connections 2023-11-30T18:22:28.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.004+0000 7fa151265700 1 -- 172.21.15.49:0/2967942536 wait complete. 2023-11-30T18:22:28.019 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-30T18:22:28.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.183+0000 7f4441b49700 1 Processor -- start 2023-11-30T18:22:28.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.183+0000 7f4441b49700 1 -- start start 2023-11-30T18:22:28.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.184+0000 7f4441b49700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f443c154610 0x7f443c1582e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:28.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.184+0000 7f4441b49700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f443c159210 con 0x7f443c0aa1c0 2023-11-30T18:22:28.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.184+0000 7f4441b49700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f443c0c0c70 con 0x7f443c0ab3b0 2023-11-30T18:22:28.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.184+0000 7f4441b49700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f443c158970 con 0x7f443c154610 2023-11-30T18:22:28.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.184+0000 7f443bfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f443c0aa1c0 0x7f443c0c1100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55012/0 (socket says 172.21.15.49:55012) 2023-11-30T18:22:28.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.184+0000 7f443bfff700 1 -- 172.21.15.49:0/1681034142 learned_addr learned my addr 172.21.15.49:0/1681034142 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:22:28.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.184+0000 7f443b7fe700 1 --2- 172.21.15.49:0/1681034142 >> v2:172.21.15.115:3300/0 conn(0x7f443c154610 0x7f443c1582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:28.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.185+0000 7f443a7fc700 1 -- 172.21.15.49:0/1681034142 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1599140779 0 0) 0x7f443c159210 con 0x7f443c0aa1c0 2023-11-30T18:22:28.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.185+0000 7f443a7fc700 1 -- 172.21.15.49:0/1681034142 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44240033f0 con 0x7f443c0aa1c0 2023-11-30T18:22:28.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.185+0000 7f443a7fc700 1 -- 172.21.15.49:0/1681034142 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 518795603 0 0) 0x7f443c0c0c70 con 0x7f443c0ab3b0 2023-11-30T18:22:28.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.185+0000 7f443a7fc700 1 -- 172.21.15.49:0/1681034142 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f443c159210 con 0x7f443c0ab3b0 2023-11-30T18:22:28.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.185+0000 7f443a7fc700 1 -- 172.21.15.49:0/1681034142 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 319654811 0 0) 0x7f44240033f0 con 0x7f443c0aa1c0 2023-11-30T18:22:28.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.185+0000 7f443a7fc700 1 -- 172.21.15.49:0/1681034142 >> v2:172.21.15.115:3300/0 conn(0x7f443c154610 msgr2=0x7f443c1582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:28.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.185+0000 7f443a7fc700 1 --2- 172.21.15.49:0/1681034142 >> v2:172.21.15.115:3300/0 conn(0x7f443c154610 0x7f443c1582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:28.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.185+0000 7f443a7fc700 1 -- 172.21.15.49:0/1681034142 >> v1:172.21.15.115:6789/0 conn(0x7f443c0ab3b0 legacy=0x7f443c0c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:28.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.185+0000 7f443a7fc700 1 -- 172.21.15.49:0/1681034142 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443c158c50 con 0x7f443c0aa1c0 2023-11-30T18:22:28.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.185+0000 7f443a7fc700 1 -- 172.21.15.49:0/1681034142 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f44340017f0 con 0x7f443c0aa1c0 2023-11-30T18:22:28.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.185+0000 7f443b7fe700 1 --2- 172.21.15.49:0/1681034142 >> v2:172.21.15.115:3300/0 conn(0x7f443c154610 0x7f443c1582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:22:28.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.185+0000 7f443a7fc700 1 -- 172.21.15.49:0/1681034142 >> v1:172.21.15.49:6789/0 conn(0x7f443c0aa1c0 legacy=0x7f443c0c1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:28.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.185+0000 7f443a7fc700 1 --2- 172.21.15.49:0/1681034142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4424003a70 0x7f4424003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:28.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.185+0000 7f443a7fc700 1 --2- 172.21.15.49:0/1681034142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4424004690 0x7f4424004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:28.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.185+0000 7f443a7fc700 1 --2- 172.21.15.49:0/1681034142 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4424005000 0x7f442400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:28.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.185+0000 7f443a7fc700 1 -- 172.21.15.49:0/1681034142 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c158970 con 0x7f4424004690 2023-11-30T18:22:28.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.185+0000 7f443a7fc700 1 -- 172.21.15.49:0/1681034142 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442400bf60 con 0x7f4424003a70 2023-11-30T18:22:28.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.185+0000 7f443a7fc700 1 -- 172.21.15.49:0/1681034142 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f442400c0d0 con 0x7f4424005000 2023-11-30T18:22:28.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.185+0000 7f443affd700 1 --2- 172.21.15.49:0/1681034142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4424004690 0x7f4424004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:28.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.185+0000 7f443b7fe700 1 --2- 172.21.15.49:0/1681034142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4424003a70 0x7f4424003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:28.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.185+0000 7f443bfff700 1 --2- 172.21.15.49:0/1681034142 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4424005000 0x7f442400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:28.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.185+0000 7f443affd700 1 -- 172.21.15.49:0/1681034142 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4424005000 msgr2=0x7f442400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:28.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.185+0000 7f443affd700 1 --2- 172.21.15.49:0/1681034142 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4424005000 0x7f442400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:28.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.185+0000 7f443affd700 1 -- 172.21.15.49:0/1681034142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4424003a70 msgr2=0x7f4424003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:28.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.185+0000 7f443affd700 1 --2- 172.21.15.49:0/1681034142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4424003a70 0x7f4424003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:28.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.185+0000 7f443affd700 1 -- 172.21.15.49:0/1681034142 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44240033f0 con 0x7f4424004690 2023-11-30T18:22:28.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.185+0000 7f443bfff700 1 -- 172.21.15.49:0/1681034142 reap_dead start 2023-11-30T18:22:28.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.186+0000 7f443affd700 1 --2- 172.21.15.49:0/1681034142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4424004690 0x7f4424004b10 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7f4430001860 tx=0x7f4430007bb0).ready entity=mon.0 client_cookie=30cbc8f162bc5fa9 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:28.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.186+0000 7f443a7fc700 1 -- 172.21.15.49:0/1681034142 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4430007020 con 0x7f4424004690 2023-11-30T18:22:28.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.186+0000 7f443a7fc700 1 -- 172.21.15.49:0/1681034142 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4430007180 con 0x7f4424004690 2023-11-30T18:22:28.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.186+0000 7f443a7fc700 1 -- 172.21.15.49:0/1681034142 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4430007500 con 0x7f4424004690 2023-11-30T18:22:28.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.186+0000 7f4441b49700 1 -- 172.21.15.49:0/1681034142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4424004690 msgr2=0x7f4424004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:28.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.186+0000 7f4441b49700 1 --2- 172.21.15.49:0/1681034142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4424004690 0x7f4424004b10 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7f4430001860 tx=0x7f4430007bb0).stop 2023-11-30T18:22:28.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.186+0000 7f4441b49700 1 -- 172.21.15.49:0/1681034142 shutdown_connections 2023-11-30T18:22:28.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.186+0000 7f4441b49700 1 --2- 172.21.15.49:0/1681034142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4424004690 0x7f4424004b10 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:28.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.186+0000 7f4441b49700 1 -- 172.21.15.49:0/1681034142 >> 172.21.15.49:0/1681034142 conn(0x7f443c0655a0 msgr2=0x7f443c069e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:28.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.186+0000 7f4441b49700 1 -- 172.21.15.49:0/1681034142 shutdown_connections 2023-11-30T18:22:28.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.186+0000 7f4441b49700 1 -- 172.21.15.49:0/1681034142 wait complete. 2023-11-30T18:22:28.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.188+0000 7f4441b49700 1 Processor -- start 2023-11-30T18:22:28.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.188+0000 7f4441b49700 1 -- start start 2023-11-30T18:22:28.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.188+0000 7f4441b49700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4424004690 0x7f443c152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:28.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.188+0000 7f4441b49700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f443c0b0e70 0x7f443c153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:28.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.188+0000 7f4441b49700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f443c1679a0 0x7f443c167e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:28.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.188+0000 7f4441b49700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c0c5230 con 0x7f4424004690 2023-11-30T18:22:28.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.188+0000 7f4441b49700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c0c4640 con 0x7f443c1679a0 2023-11-30T18:22:28.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.188+0000 7f4441b49700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443c1682f0 con 0x7f443c0b0e70 2023-11-30T18:22:28.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.188+0000 7f443b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4424004690 0x7f443c152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:28.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.188+0000 7f443b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4424004690 0x7f443c152e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45812/0 (socket says 172.21.15.49:45812) 2023-11-30T18:22:28.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.188+0000 7f443b7fe700 1 -- 172.21.15.49:0/4098014547 learned_addr learned my addr 172.21.15.49:0/4098014547 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:28.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.189+0000 7f443affd700 1 --2- 172.21.15.49:0/4098014547 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f443c0b0e70 0x7f443c153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:28.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.189+0000 7f443bfff700 1 --2- 172.21.15.49:0/4098014547 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f443c1679a0 0x7f443c167e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:28.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.189+0000 7f443b7fe700 1 -- 172.21.15.49:0/4098014547 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f443c0b0e70 msgr2=0x7f443c153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:28.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.189+0000 7f443b7fe700 1 --2- 172.21.15.49:0/4098014547 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f443c0b0e70 0x7f443c153490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:28.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.189+0000 7f443b7fe700 1 -- 172.21.15.49:0/4098014547 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f443c1679a0 msgr2=0x7f443c167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:28.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.189+0000 7f443b7fe700 1 --2- 172.21.15.49:0/4098014547 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f443c1679a0 0x7f443c167e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:28.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.189+0000 7f443b7fe700 1 -- 172.21.15.49:0/4098014547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443c0c4890 con 0x7f4424004690 2023-11-30T18:22:28.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.189+0000 7f443affd700 1 --2- 172.21.15.49:0/4098014547 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f443c0b0e70 0x7f443c153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:22:28.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.189+0000 7f443bfff700 1 --2- 172.21.15.49:0/4098014547 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f443c1679a0 0x7f443c167e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:22:28.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.189+0000 7f443b7fe700 1 --2- 172.21.15.49:0/4098014547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4424004690 0x7f443c152e00 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7f442c011a20 tx=0x7f442c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:28.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.189+0000 7f44237fe700 1 -- 172.21.15.49:0/4098014547 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c00f940 con 0x7f4424004690 2023-11-30T18:22:28.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.189+0000 7f44237fe700 1 -- 172.21.15.49:0/4098014547 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442c00faa0 con 0x7f4424004690 2023-11-30T18:22:28.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.189+0000 7f4441b49700 1 -- 172.21.15.49:0/4098014547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f443c0c4b70 con 0x7f4424004690 2023-11-30T18:22:28.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.189+0000 7f44237fe700 1 -- 172.21.15.49:0/4098014547 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c00fe20 con 0x7f4424004690 2023-11-30T18:22:28.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.189+0000 7f4441b49700 1 -- 172.21.15.49:0/4098014547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f443c14d4d0 con 0x7f4424004690 2023-11-30T18:22:28.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.190+0000 7f4441b49700 1 -- 172.21.15.49:0/4098014547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f443c06c860 con 0x7f4424004690 2023-11-30T18:22:28.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.191+0000 7f44237fe700 1 -- 172.21.15.49:0/4098014547 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 67) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f442c014650 con 0x7f4424004690 2023-11-30T18:22:28.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.191+0000 7f44237fe700 1 --2- 172.21.15.49:0/4098014547 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f442805f030 0x7f44280614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:28.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.191+0000 7f44237fe700 1 -- 172.21.15.49:0/4098014547 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6795+0+0 (secure 0 0 0) 0x7f442c07b2d0 con 0x7f4424004690 2023-11-30T18:22:28.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.192+0000 7f443affd700 1 --2- 172.21.15.49:0/4098014547 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f442805f030 0x7f44280614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:28.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.192+0000 7f443affd700 1 --2- 172.21.15.49:0/4098014547 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f442805f030 0x7f44280614f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f4430000c00 tx=0x7f4430015000).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:28.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.195+0000 7f44237fe700 1 -- 172.21.15.49:0/4098014547 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f442c04c550 con 0x7f4424004690 2023-11-30T18:22:28.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.367+0000 7f4441b49700 1 -- 172.21.15.49:0/4098014547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f443c0c0540 con 0x7f4424004690 2023-11-30T18:22:28.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.694+0000 7f44237fe700 1 -- 172.21.15.49:0/4098014547 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v159) v1 ==== 181+0+0 (secure 0 0 0) 0x7f442c04fb70 con 0x7f4424004690 2023-11-30T18:22:28.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.699+0000 7f4441b49700 1 -- 172.21.15.49:0/4098014547 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f442805f030 msgr2=0x7f44280614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:28.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.699+0000 7f4441b49700 1 --2- 172.21.15.49:0/4098014547 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f442805f030 0x7f44280614f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f4430000c00 tx=0x7f4430015000).stop 2023-11-30T18:22:28.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.699+0000 7f4441b49700 1 -- 172.21.15.49:0/4098014547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4424004690 msgr2=0x7f443c152e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:28.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.699+0000 7f4441b49700 1 --2- 172.21.15.49:0/4098014547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4424004690 0x7f443c152e00 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7f442c011a20 tx=0x7f442c009060).stop 2023-11-30T18:22:28.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.700+0000 7f4441b49700 1 -- 172.21.15.49:0/4098014547 shutdown_connections 2023-11-30T18:22:28.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.700+0000 7f4441b49700 1 --2- 172.21.15.49:0/4098014547 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f443c1679a0 0x7f443c167e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:28.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.700+0000 7f4441b49700 1 --2- 172.21.15.49:0/4098014547 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f442805f030 0x7f44280614f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:28.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.700+0000 7f4441b49700 1 --2- 172.21.15.49:0/4098014547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4424004690 0x7f443c152e00 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:28.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.700+0000 7f4441b49700 1 --2- 172.21.15.49:0/4098014547 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f443c0b0e70 0x7f443c153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:28.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.700+0000 7f4441b49700 1 -- 172.21.15.49:0/4098014547 >> 172.21.15.49:0/4098014547 conn(0x7f443c0655a0 msgr2=0x7f443c0c9890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:28.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.700+0000 7f4441b49700 1 -- 172.21.15.49:0/4098014547 shutdown_connections 2023-11-30T18:22:28.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.700+0000 7f4441b49700 1 -- 172.21.15.49:0/4098014547 wait complete. 2023-11-30T18:22:28.705 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2023-11-30T18:22:28.717 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-30T18:22:28.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.839+0000 7fb4ecd95700 1 Processor -- start 2023-11-30T18:22:28.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.839+0000 7fb4ecd95700 1 -- start start 2023-11-30T18:22:28.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.840+0000 7fb4ecd95700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4e81373a0 0x7fb4e80c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:28.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.840+0000 7fb4ecd95700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb4e8064b00 0x7fb4e80c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:28.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.840+0000 7fb4ecd95700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e8158e20 con 0x7fb4e80c5f30 2023-11-30T18:22:28.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.840+0000 7fb4ecd95700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e80c68a0 con 0x7fb4e8064b00 2023-11-30T18:22:28.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.840+0000 7fb4ecd95700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e81582a0 con 0x7fb4e81373a0 2023-11-30T18:22:28.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.840+0000 7fb4e6d9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb4e8064b00 0x7fb4e80c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:28.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.840+0000 7fb4e659c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4e81373a0 0x7fb4e80c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:28.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.840+0000 7fb4e5d9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fb4e80c5f30 0x7fb4e80669a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:38768/0 (socket says 172.21.15.49:38768) 2023-11-30T18:22:28.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.840+0000 7fb4e659c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4e81373a0 0x7fb4e80c72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:36972/0 (socket says 172.21.15.49:36972) 2023-11-30T18:22:28.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.840+0000 7fb4e5d9b700 1 -- 172.21.15.49:0/1852774139 learned_addr learned my addr 172.21.15.49:0/1852774139 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:22:28.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.840+0000 7fb4e6d9d700 1 -- 172.21.15.49:0/1852774139 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4e81373a0 msgr2=0x7fb4e80c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:28.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.840+0000 7fb4e6d9d700 1 --2- 172.21.15.49:0/1852774139 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4e81373a0 0x7fb4e80c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:28.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.840+0000 7fb4e6d9d700 1 -- 172.21.15.49:0/1852774139 >> v1:172.21.15.115:6789/0 conn(0x7fb4e80c5f30 legacy=0x7fb4e80669a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:28.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.840+0000 7fb4e6d9d700 1 -- 172.21.15.49:0/1852774139 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e8158580 con 0x7fb4e8064b00 2023-11-30T18:22:28.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.840+0000 7fb4e559a700 1 -- 172.21.15.49:0/1852774139 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897150361 0 0) 0x7fb4e8158e20 con 0x7fb4e80c5f30 2023-11-30T18:22:28.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.840+0000 7fb4e659c700 1 --2- 172.21.15.49:0/1852774139 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4e81373a0 0x7fb4e80c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:22:28.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.840+0000 7fb4e6d9d700 1 --2- 172.21.15.49:0/1852774139 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4e8064b00 0x7fb4e80c63b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fb4d8009760 tx=0x7fb4d8009060).ready entity=mon.1 client_cookie=9e055de1ec9a36f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:28.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.841+0000 7fb4e559a700 1 -- 172.21.15.49:0/1852774139 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d800f510 con 0x7fb4e8064b00 2023-11-30T18:22:28.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.841+0000 7fb4e559a700 1 -- 172.21.15.49:0/1852774139 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d800f670 con 0x7fb4e8064b00 2023-11-30T18:22:28.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.841+0000 7fb4e559a700 1 -- 172.21.15.49:0/1852774139 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d800f9f0 con 0x7fb4e8064b00 2023-11-30T18:22:28.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.841+0000 7fb4ecd95700 1 -- 172.21.15.49:0/1852774139 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4e8064b00 msgr2=0x7fb4e80c63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:28.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.841+0000 7fb4ecd95700 1 --2- 172.21.15.49:0/1852774139 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4e8064b00 0x7fb4e80c63b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fb4d8009760 tx=0x7fb4d8009060).stop 2023-11-30T18:22:28.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.841+0000 7fb4ecd95700 1 -- 172.21.15.49:0/1852774139 shutdown_connections 2023-11-30T18:22:28.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.841+0000 7fb4ecd95700 1 --2- 172.21.15.49:0/1852774139 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4e81373a0 0x7fb4e80c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:28.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.841+0000 7fb4ecd95700 1 --2- 172.21.15.49:0/1852774139 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4e8064b00 0x7fb4e80c63b0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:28.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.841+0000 7fb4ecd95700 1 -- 172.21.15.49:0/1852774139 >> 172.21.15.49:0/1852774139 conn(0x7fb4e80628f0 msgr2=0x7fb4e8062d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:28.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.841+0000 7fb4ecd95700 1 -- 172.21.15.49:0/1852774139 shutdown_connections 2023-11-30T18:22:28.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.841+0000 7fb4ecd95700 1 -- 172.21.15.49:0/1852774139 wait complete. 2023-11-30T18:22:28.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.842+0000 7fb4ecd95700 1 Processor -- start 2023-11-30T18:22:28.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.842+0000 7fb4ecd95700 1 -- start start 2023-11-30T18:22:28.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.843+0000 7fb4ecd95700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4e8064b00 0x7fb4e814efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:28.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.843+0000 7fb4ecd95700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4e80c5f30 0x7fb4e8167cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:28.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.843+0000 7fb4ecd95700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4e81373a0 0x7fb4e81681a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:28.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.843+0000 7fb4ecd95700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80ab350 con 0x7fb4e8064b00 2023-11-30T18:22:28.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.843+0000 7fb4ecd95700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80aa4f0 con 0x7fb4e81373a0 2023-11-30T18:22:28.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.843+0000 7fb4ecd95700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80aa740 con 0x7fb4e80c5f30 2023-11-30T18:22:28.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.843+0000 7fb4e659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4e8064b00 0x7fb4e814efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:28.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.843+0000 7fb4e659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4e8064b00 0x7fb4e814efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45818/0 (socket says 172.21.15.49:45818) 2023-11-30T18:22:28.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.843+0000 7fb4e659c700 1 -- 172.21.15.49:0/1546377949 learned_addr learned my addr 172.21.15.49:0/1546377949 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:28.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.843+0000 7fb4e5d9b700 1 --2- 172.21.15.49:0/1546377949 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4e80c5f30 0x7fb4e8167cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:28.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.843+0000 7fb4e6d9d700 1 --2- 172.21.15.49:0/1546377949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4e81373a0 0x7fb4e81681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:28.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.844+0000 7fb4e659c700 1 -- 172.21.15.49:0/1546377949 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4e80c5f30 msgr2=0x7fb4e8167cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:28.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.844+0000 7fb4e659c700 1 --2- 172.21.15.49:0/1546377949 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4e80c5f30 0x7fb4e8167cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:28.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.844+0000 7fb4e659c700 1 -- 172.21.15.49:0/1546377949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4e81373a0 msgr2=0x7fb4e81681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:28.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.844+0000 7fb4e659c700 1 --2- 172.21.15.49:0/1546377949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4e81373a0 0x7fb4e81681a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:28.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.844+0000 7fb4e659c700 1 -- 172.21.15.49:0/1546377949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e0009a20 con 0x7fb4e8064b00 2023-11-30T18:22:28.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.844+0000 7fb4e659c700 1 --2- 172.21.15.49:0/1546377949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4e8064b00 0x7fb4e814efc0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7fb4e000c0c0 tx=0x7fb4e000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:28.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.844+0000 7fb4de7fc700 1 -- 172.21.15.49:0/1546377949 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e000cc00 con 0x7fb4e8064b00 2023-11-30T18:22:28.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.844+0000 7fb4de7fc700 1 -- 172.21.15.49:0/1546377949 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e000f040 con 0x7fb4e8064b00 2023-11-30T18:22:28.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.844+0000 7fb4ecd95700 1 -- 172.21.15.49:0/1546377949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d80092a0 con 0x7fb4e8064b00 2023-11-30T18:22:28.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.844+0000 7fb4de7fc700 1 -- 172.21.15.49:0/1546377949 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e0013400 con 0x7fb4e8064b00 2023-11-30T18:22:28.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.844+0000 7fb4ecd95700 1 -- 172.21.15.49:0/1546377949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e80aad80 con 0x7fb4e8064b00 2023-11-30T18:22:28.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.845+0000 7fb4ecd95700 1 -- 172.21.15.49:0/1546377949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e80ab630 con 0x7fb4e8064b00 2023-11-30T18:22:28.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.845+0000 7fb4de7fc700 1 -- 172.21.15.49:0/1546377949 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 68) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb4e00137b0 con 0x7fb4e8064b00 2023-11-30T18:22:28.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.846+0000 7fb4de7fc700 1 --2- 172.21.15.49:0/1546377949 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb4c805f270 0x7fb4c8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:28.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.846+0000 7fb4de7fc700 1 -- 172.21.15.49:0/1546377949 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6299+0+0 (secure 0 0 0) 0x7fb4e007ad90 con 0x7fb4e8064b00 2023-11-30T18:22:28.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.846+0000 7fb4e5d9b700 1 --2- 172.21.15.49:0/1546377949 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb4c805f270 0x7fb4c8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:28.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.846+0000 7fb4e5d9b700 1 --2- 172.21.15.49:0/1546377949 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb4c805f270 0x7fb4c8061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fb4e80c5b00 tx=0x7fb4d0007bb0).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:28.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:28.850+0000 7fb4de7fc700 1 -- 172.21.15.49:0/1546377949 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb4e004be30 con 0x7fb4e8064b00 2023-11-30T18:22:29.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:29.023+0000 7fb4ecd95700 1 -- 172.21.15.49:0/1546377949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb4e806c860 con 0x7fb4e8064b00 2023-11-30T18:22:30.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.005+0000 7fb4de7fc700 1 -- 172.21.15.49:0/1546377949 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v160) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb4e004f450 con 0x7fb4e8064b00 2023-11-30T18:22:30.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.009+0000 7fb4ecd95700 1 -- 172.21.15.49:0/1546377949 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb4c805f270 msgr2=0x7fb4c8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:30.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.009+0000 7fb4ecd95700 1 --2- 172.21.15.49:0/1546377949 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb4c805f270 0x7fb4c8061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fb4e80c5b00 tx=0x7fb4d0007bb0).stop 2023-11-30T18:22:30.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.009+0000 7fb4ecd95700 1 -- 172.21.15.49:0/1546377949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4e8064b00 msgr2=0x7fb4e814efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:30.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.009+0000 7fb4ecd95700 1 --2- 172.21.15.49:0/1546377949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4e8064b00 0x7fb4e814efc0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7fb4e000c0c0 tx=0x7fb4e000b040).stop 2023-11-30T18:22:30.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.010+0000 7fb4ecd95700 1 -- 172.21.15.49:0/1546377949 shutdown_connections 2023-11-30T18:22:30.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.010+0000 7fb4ecd95700 1 --2- 172.21.15.49:0/1546377949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4e81373a0 0x7fb4e81681a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:30.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.010+0000 7fb4ecd95700 1 --2- 172.21.15.49:0/1546377949 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb4c805f270 0x7fb4c8061730 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:30.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.010+0000 7fb4ecd95700 1 --2- 172.21.15.49:0/1546377949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4e8064b00 0x7fb4e814efc0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:30.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.010+0000 7fb4ecd95700 1 --2- 172.21.15.49:0/1546377949 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4e80c5f30 0x7fb4e8167cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:30.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.010+0000 7fb4ecd95700 1 -- 172.21.15.49:0/1546377949 >> 172.21.15.49:0/1546377949 conn(0x7fb4e80628f0 msgr2=0x7fb4e80668b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:30.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.010+0000 7fb4ecd95700 1 -- 172.21.15.49:0/1546377949 shutdown_connections 2023-11-30T18:22:30.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.010+0000 7fb4ecd95700 1 -- 172.21.15.49:0/1546377949 wait complete. 2023-11-30T18:22:30.013 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2023-11-30T18:22:30.027 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-30T18:22:30.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.153+0000 7f0db3e8b700 1 Processor -- start 2023-11-30T18:22:30.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.153+0000 7f0db3e8b700 1 -- start start 2023-11-30T18:22:30.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.153+0000 7f0db3e8b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0dac0bfbe0 0x7f0dac067ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:30.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.153+0000 7f0db3e8b700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dac154c00 con 0x7f0dac096590 2023-11-30T18:22:30.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.153+0000 7f0db3e8b700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dac14f190 con 0x7f0dac14edb0 2023-11-30T18:22:30.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.153+0000 7f0db3e8b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dac155770 con 0x7f0dac0bfbe0 2023-11-30T18:22:30.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.153+0000 7f0db1426700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0dac096590 0x7f0dac0673d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55014/0 (socket says 172.21.15.49:55014) 2023-11-30T18:22:30.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.153+0000 7f0db1426700 1 -- 172.21.15.49:0/4250722945 learned_addr learned my addr 172.21.15.49:0/4250722945 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:22:30.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.153+0000 7f0db2428700 1 --2- 172.21.15.49:0/4250722945 >> v2:172.21.15.115:3300/0 conn(0x7f0dac0bfbe0 0x7f0dac067ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:30.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.153+0000 7f0db0c25700 1 -- 172.21.15.49:0/4250722945 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1619373073 0 0) 0x7f0d9c001110 con 0x7f0dac096590 2023-11-30T18:22:30.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.153+0000 7f0db0c25700 1 -- 172.21.15.49:0/4250722945 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d980033f0 con 0x7f0dac096590 2023-11-30T18:22:30.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.153+0000 7f0db0c25700 1 -- 172.21.15.49:0/4250722945 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2481907600 0 0) 0x7f0d980033f0 con 0x7f0dac096590 2023-11-30T18:22:30.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.153+0000 7f0db0c25700 1 -- 172.21.15.49:0/4250722945 >> v2:172.21.15.115:3300/0 conn(0x7f0dac0bfbe0 msgr2=0x7f0dac067ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:30.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.153+0000 7f0db0c25700 1 --2- 172.21.15.49:0/4250722945 >> v2:172.21.15.115:3300/0 conn(0x7f0dac0bfbe0 0x7f0dac067ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:30.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.153+0000 7f0db0c25700 1 -- 172.21.15.49:0/4250722945 >> v1:172.21.15.115:6789/0 conn(0x7f0dac14edb0 legacy=0x7f0dac095e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:30.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.154+0000 7f0db0c25700 1 -- 172.21.15.49:0/4250722945 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac155c00 con 0x7f0dac096590 2023-11-30T18:22:30.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.154+0000 7f0db0c25700 1 -- 172.21.15.49:0/4250722945 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f0d9c001600 con 0x7f0dac096590 2023-11-30T18:22:30.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.154+0000 7f0db0c25700 1 -- 172.21.15.49:0/4250722945 >> v1:172.21.15.49:6789/0 conn(0x7f0dac096590 legacy=0x7f0dac0673d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:30.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.154+0000 7f0db0c25700 1 --2- 172.21.15.49:0/4250722945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d980038e0 0x7f0d98003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:30.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.154+0000 7f0db0c25700 1 --2- 172.21.15.49:0/4250722945 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d98004690 0x7f0d98004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:30.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.154+0000 7f0db0c25700 1 --2- 172.21.15.49:0/4250722945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d98005050 0x7f0d9800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:30.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.154+0000 7f0db0c25700 1 -- 172.21.15.49:0/4250722945 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac155770 con 0x7f0d98005050 2023-11-30T18:22:30.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.154+0000 7f0db0c25700 1 -- 172.21.15.49:0/4250722945 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9800bfe0 con 0x7f0d980038e0 2023-11-30T18:22:30.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.154+0000 7f0db0c25700 1 -- 172.21.15.49:0/4250722945 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9800c1a0 con 0x7f0d98004690 2023-11-30T18:22:30.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.154+0000 7f0db2428700 1 --2- 172.21.15.49:0/4250722945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d98005050 0x7f0d9800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:30.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.154+0000 7f0db1426700 1 --2- 172.21.15.49:0/4250722945 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d98004690 0x7f0d98004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:30.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.154+0000 7f0db1c27700 1 --2- 172.21.15.49:0/4250722945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d980038e0 0x7f0d98003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:30.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.154+0000 7f0db2428700 1 -- 172.21.15.49:0/4250722945 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d98004690 msgr2=0x7f0d98004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:30.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.154+0000 7f0db2428700 1 --2- 172.21.15.49:0/4250722945 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d98004690 0x7f0d98004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:30.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.154+0000 7f0db2428700 1 -- 172.21.15.49:0/4250722945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d980038e0 msgr2=0x7f0d98003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:30.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.154+0000 7f0db2428700 1 --2- 172.21.15.49:0/4250722945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d980038e0 0x7f0d98003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:30.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.154+0000 7f0db2428700 1 -- 172.21.15.49:0/4250722945 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d980033f0 con 0x7f0d98005050 2023-11-30T18:22:30.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.154+0000 7f0db2428700 1 -- 172.21.15.49:0/4250722945 reap_dead start 2023-11-30T18:22:30.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.154+0000 7f0db2428700 1 --2- 172.21.15.49:0/4250722945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d98005050 0x7f0d9800b8e0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7f0da40094d0 tx=0x7f0da400b040).ready entity=mon.0 client_cookie=263768486661a74f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:30.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.154+0000 7f0db0c25700 1 -- 172.21.15.49:0/4250722945 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da400ea00 con 0x7f0d98005050 2023-11-30T18:22:30.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.154+0000 7f0db0c25700 1 -- 172.21.15.49:0/4250722945 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da400f040 con 0x7f0d98005050 2023-11-30T18:22:30.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.154+0000 7f0db0c25700 1 -- 172.21.15.49:0/4250722945 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da400ed90 con 0x7f0d98005050 2023-11-30T18:22:30.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.155+0000 7f0db3e8b700 1 -- 172.21.15.49:0/4250722945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d98005050 msgr2=0x7f0d9800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:30.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.155+0000 7f0db3e8b700 1 --2- 172.21.15.49:0/4250722945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d98005050 0x7f0d9800b8e0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7f0da40094d0 tx=0x7f0da400b040).stop 2023-11-30T18:22:30.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.155+0000 7f0db3e8b700 1 -- 172.21.15.49:0/4250722945 shutdown_connections 2023-11-30T18:22:30.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.155+0000 7f0db3e8b700 1 --2- 172.21.15.49:0/4250722945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d98005050 0x7f0d9800b8e0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:30.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.155+0000 7f0db3e8b700 1 -- 172.21.15.49:0/4250722945 >> 172.21.15.49:0/4250722945 conn(0x7f0dac0631d0 msgr2=0x7f0dac0c9160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:30.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.155+0000 7f0db3e8b700 1 -- 172.21.15.49:0/4250722945 shutdown_connections 2023-11-30T18:22:30.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.155+0000 7f0db3e8b700 1 -- 172.21.15.49:0/4250722945 wait complete. 2023-11-30T18:22:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.156+0000 7f0db3e8b700 1 Processor -- start 2023-11-30T18:22:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.156+0000 7f0db3e8b700 1 -- start start 2023-11-30T18:22:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.157+0000 7f0db3e8b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d98005050 0x7f0dac1683c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.157+0000 7f0db3e8b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0dac1688b0 0x7f0dac1644f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.157+0000 7f0db3e8b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dac0aba00 0x7f0dac0c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.157+0000 7f0db3e8b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac1692f0 con 0x7f0dac0aba00 2023-11-30T18:22:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.157+0000 7f0db3e8b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac0c19d0 con 0x7f0d98005050 2023-11-30T18:22:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.157+0000 7f0db3e8b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac14f320 con 0x7f0dac1688b0 2023-11-30T18:22:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.157+0000 7f0db2428700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dac0aba00 0x7f0dac0c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.157+0000 7f0db2428700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dac0aba00 0x7f0dac0c7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45834/0 (socket says 172.21.15.49:45834) 2023-11-30T18:22:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.157+0000 7f0db2428700 1 -- 172.21.15.49:0/2473320349 learned_addr learned my addr 172.21.15.49:0/2473320349 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.157+0000 7f0db1426700 1 --2- 172.21.15.49:0/2473320349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0dac1688b0 0x7f0dac1644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.157+0000 7f0db1c27700 1 --2- 172.21.15.49:0/2473320349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d98005050 0x7f0dac1683c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.157+0000 7f0db2428700 1 -- 172.21.15.49:0/2473320349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0dac1688b0 msgr2=0x7f0dac1644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.157+0000 7f0db2428700 1 --2- 172.21.15.49:0/2473320349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0dac1688b0 0x7f0dac1644f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.157+0000 7f0db2428700 1 -- 172.21.15.49:0/2473320349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d98005050 msgr2=0x7f0dac1683c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.157+0000 7f0db2428700 1 --2- 172.21.15.49:0/2473320349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d98005050 0x7f0dac1683c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.158+0000 7f0db2428700 1 -- 172.21.15.49:0/2473320349 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac168d30 con 0x7f0dac0aba00 2023-11-30T18:22:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.158+0000 7f0db2428700 1 --2- 172.21.15.49:0/2473320349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dac0aba00 0x7f0dac0c7ff0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f0da4009750 tx=0x7f0da4018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.158+0000 7f0da1ffb700 1 -- 172.21.15.49:0/2473320349 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da40093a0 con 0x7f0dac0aba00 2023-11-30T18:22:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.158+0000 7f0da1ffb700 1 -- 172.21.15.49:0/2473320349 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da401e470 con 0x7f0dac0aba00 2023-11-30T18:22:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.158+0000 7f0da1ffb700 1 -- 172.21.15.49:0/2473320349 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da401e810 con 0x7f0dac0aba00 2023-11-30T18:22:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.158+0000 7f0db3e8b700 1 -- 172.21.15.49:0/2473320349 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dac169010 con 0x7f0dac0aba00 2023-11-30T18:22:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.158+0000 7f0db3e8b700 1 -- 172.21.15.49:0/2473320349 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dac1649e0 con 0x7f0dac0aba00 2023-11-30T18:22:30.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.159+0000 7f0db3e8b700 1 -- 172.21.15.49:0/2473320349 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dac164c90 con 0x7f0dac0aba00 2023-11-30T18:22:30.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.159+0000 7f0da1ffb700 1 -- 172.21.15.49:0/2473320349 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 68) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0da4003020 con 0x7f0dac0aba00 2023-11-30T18:22:30.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.160+0000 7f0da1ffb700 1 --2- 172.21.15.49:0/2473320349 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0d9005f270 0x7f0d90061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:30.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.160+0000 7f0da1ffb700 1 -- 172.21.15.49:0/2473320349 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f0da407c050 con 0x7f0dac0aba00 2023-11-30T18:22:30.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.160+0000 7f0db1c27700 1 --2- 172.21.15.49:0/2473320349 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0d9005f270 0x7f0d90061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:30.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.160+0000 7f0db1c27700 1 --2- 172.21.15.49:0/2473320349 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0d9005f270 0x7f0d90061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f0da8007fd0 tx=0x7f0da8007bb0).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:30.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.165+0000 7f0da1ffb700 1 -- 172.21.15.49:0/2473320349 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0da404d2b0 con 0x7f0dac0aba00 2023-11-30T18:22:30.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.336+0000 7f0db3e8b700 1 -- 172.21.15.49:0/2473320349 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f0dac0c1b40 con 0x7f0dac0aba00 2023-11-30T18:22:30.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.339+0000 7f0da1ffb700 1 -- 172.21.15.49:0/2473320349 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v28) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0da4017020 con 0x7f0dac0aba00 2023-11-30T18:22:30.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.342+0000 7f0db3e8b700 1 -- 172.21.15.49:0/2473320349 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0d9005f270 msgr2=0x7f0d90061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:30.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.342+0000 7f0db3e8b700 1 --2- 172.21.15.49:0/2473320349 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0d9005f270 0x7f0d90061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f0da8007fd0 tx=0x7f0da8007bb0).stop 2023-11-30T18:22:30.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.342+0000 7f0db3e8b700 1 -- 172.21.15.49:0/2473320349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dac0aba00 msgr2=0x7f0dac0c7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:30.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.342+0000 7f0db3e8b700 1 --2- 172.21.15.49:0/2473320349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dac0aba00 0x7f0dac0c7ff0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f0da4009750 tx=0x7f0da4018000).stop 2023-11-30T18:22:30.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.342+0000 7f0db3e8b700 1 -- 172.21.15.49:0/2473320349 shutdown_connections 2023-11-30T18:22:30.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.342+0000 7f0db3e8b700 1 --2- 172.21.15.49:0/2473320349 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0d9005f270 0x7f0d90061730 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:30.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.342+0000 7f0db3e8b700 1 --2- 172.21.15.49:0/2473320349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dac0aba00 0x7f0dac0c7ff0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:30.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.342+0000 7f0db3e8b700 1 --2- 172.21.15.49:0/2473320349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d98005050 0x7f0dac1683c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:30.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.342+0000 7f0db3e8b700 1 --2- 172.21.15.49:0/2473320349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0dac1688b0 0x7f0dac1644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:30.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.342+0000 7f0db3e8b700 1 -- 172.21.15.49:0/2473320349 >> 172.21.15.49:0/2473320349 conn(0x7f0dac0631d0 msgr2=0x7f0dac0a8420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:30.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.342+0000 7f0db3e8b700 1 -- 172.21.15.49:0/2473320349 shutdown_connections 2023-11-30T18:22:30.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.342+0000 7f0db3e8b700 1 -- 172.21.15.49:0/2473320349 wait complete. 2023-11-30T18:22:30.355 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-11-30T18:22:30.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.472+0000 7fece13df700 1 Processor -- start 2023-11-30T18:22:30.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.472+0000 7fece13df700 1 -- start start 2023-11-30T18:22:30.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.473+0000 7fece13df700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecdc0c8780 0x7fecdc0c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:30.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.473+0000 7fece13df700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecdc0c7500 con 0x7fecdc062700 2023-11-30T18:22:30.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.473+0000 7fece13df700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecdc0bd650 con 0x7fecdc13be20 2023-11-30T18:22:30.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.473+0000 7fece13df700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc13c200 con 0x7fecdc0c8780 2023-11-30T18:22:30.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.473+0000 7fecdb7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fecdc062700 0x7fecdc0a4db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55024/0 (socket says 172.21.15.49:55024) 2023-11-30T18:22:30.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.473+0000 7fecdb7fe700 1 -- 172.21.15.49:0/3522777710 learned_addr learned my addr 172.21.15.49:0/3522777710 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:22:30.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.474+0000 7fecda7fc700 1 --2- 172.21.15.49:0/3522777710 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecdc0c8780 0x7fecdc0c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:30.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.474+0000 7fecd9ffb700 1 -- 172.21.15.49:0/3522777710 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2233192858 0 0) 0x7fecdc0c7500 con 0x7fecdc062700 2023-11-30T18:22:30.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.474+0000 7fecd9ffb700 1 -- 172.21.15.49:0/3522777710 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecc80033f0 con 0x7fecdc062700 2023-11-30T18:22:30.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.474+0000 7fecd9ffb700 1 -- 172.21.15.49:0/3522777710 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3327120818 0 0) 0x7fecc80033f0 con 0x7fecdc062700 2023-11-30T18:22:30.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.474+0000 7fecd9ffb700 1 -- 172.21.15.49:0/3522777710 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecdc0c8780 msgr2=0x7fecdc0c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:30.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.474+0000 7fecd9ffb700 1 --2- 172.21.15.49:0/3522777710 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecdc0c8780 0x7fecdc0c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:30.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.474+0000 7fecd9ffb700 1 -- 172.21.15.49:0/3522777710 >> v1:172.21.15.115:6789/0 conn(0x7fecdc13be20 legacy=0x7fecdc0bcf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:30.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.474+0000 7fecd9ffb700 1 -- 172.21.15.49:0/3522777710 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecdc0c68f0 con 0x7fecdc062700 2023-11-30T18:22:30.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.474+0000 7fecd9ffb700 1 -- 172.21.15.49:0/3522777710 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fecd40017f0 con 0x7fecdc062700 2023-11-30T18:22:30.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.474+0000 7fecd9ffb700 1 -- 172.21.15.49:0/3522777710 >> v1:172.21.15.49:6789/0 conn(0x7fecdc062700 legacy=0x7fecdc0a4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:30.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.474+0000 7fecd9ffb700 1 --2- 172.21.15.49:0/3522777710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecc8003910 0x7fecc8003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:30.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.474+0000 7fecd9ffb700 1 --2- 172.21.15.49:0/3522777710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecc8004690 0x7fecc8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:30.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.474+0000 7fecd9ffb700 1 --2- 172.21.15.49:0/3522777710 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecdc0c8780 0x7fecc8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:30.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.474+0000 7fecd9ffb700 1 -- 172.21.15.49:0/3522777710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc13c200 con 0x7fecc8003910 2023-11-30T18:22:30.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.474+0000 7fecd9ffb700 1 -- 172.21.15.49:0/3522777710 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc800b8e0 con 0x7fecc8004690 2023-11-30T18:22:30.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.474+0000 7fecd9ffb700 1 -- 172.21.15.49:0/3522777710 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc800ba50 con 0x7fecdc0c8780 2023-11-30T18:22:30.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.474+0000 7fecdaffd700 1 --2- 172.21.15.49:0/3522777710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecc8003910 0x7fecc8003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:30.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.474+0000 7fecda7fc700 1 --2- 172.21.15.49:0/3522777710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecc8004690 0x7fecc8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:30.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.474+0000 7fecdb7fe700 1 --2- 172.21.15.49:0/3522777710 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecdc0c8780 0x7fecc8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:30.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.475+0000 7fecdaffd700 1 -- 172.21.15.49:0/3522777710 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecdc0c8780 msgr2=0x7fecc8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:30.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.475+0000 7fecdaffd700 1 --2- 172.21.15.49:0/3522777710 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecdc0c8780 0x7fecc8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:30.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.475+0000 7fecdaffd700 1 -- 172.21.15.49:0/3522777710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecc8004690 msgr2=0x7fecc8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:30.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.475+0000 7fecdaffd700 1 --2- 172.21.15.49:0/3522777710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecc8004690 0x7fecc8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:30.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.475+0000 7fecdaffd700 1 -- 172.21.15.49:0/3522777710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc80033f0 con 0x7fecc8003910 2023-11-30T18:22:30.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.475+0000 7fecdaffd700 1 --2- 172.21.15.49:0/3522777710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecc8003910 0x7fecc8003cf0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7feccc001820 tx=0x7feccc007b90).ready entity=mon.0 client_cookie=3c58ca83e14cd75b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:30.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.475+0000 7fecd9ffb700 1 -- 172.21.15.49:0/3522777710 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc007ea0 con 0x7fecc8003910 2023-11-30T18:22:30.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.475+0000 7fecd9ffb700 1 -- 172.21.15.49:0/3522777710 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feccc012400 con 0x7fecc8003910 2023-11-30T18:22:30.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.475+0000 7fecd9ffb700 1 -- 172.21.15.49:0/3522777710 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc0127c0 con 0x7fecc8003910 2023-11-30T18:22:30.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.475+0000 7fece13df700 1 -- 172.21.15.49:0/3522777710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecc8003910 msgr2=0x7fecc8003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:30.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.475+0000 7fece13df700 1 --2- 172.21.15.49:0/3522777710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecc8003910 0x7fecc8003cf0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7feccc001820 tx=0x7feccc007b90).stop 2023-11-30T18:22:30.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.475+0000 7fecdb7fe700 1 -- 172.21.15.49:0/3522777710 reap_dead start 2023-11-30T18:22:30.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.475+0000 7fece13df700 1 -- 172.21.15.49:0/3522777710 shutdown_connections 2023-11-30T18:22:30.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.475+0000 7fece13df700 1 -- 172.21.15.49:0/3522777710 >> 172.21.15.49:0/3522777710 conn(0x7fecdc0642d0 msgr2=0x7fecdc0c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:30.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.475+0000 7fece13df700 1 -- 172.21.15.49:0/3522777710 shutdown_connections 2023-11-30T18:22:30.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.475+0000 7fece13df700 1 -- 172.21.15.49:0/3522777710 wait complete. 2023-11-30T18:22:30.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.477+0000 7fece13df700 1 Processor -- start 2023-11-30T18:22:30.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.477+0000 7fece13df700 1 -- start start 2023-11-30T18:22:30.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.477+0000 7fece13df700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecc8003910 0x7fecdc134de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:30.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.477+0000 7fece13df700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecdc151db0 0x7fecdc136630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:30.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.477+0000 7fece13df700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecdc136b20 0x7fecdc0a91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:30.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.477+0000 7fece13df700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc0a8d60 con 0x7fecdc136b20 2023-11-30T18:22:30.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.477+0000 7fece13df700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc0ad1c0 con 0x7fecc8003910 2023-11-30T18:22:30.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.477+0000 7fece13df700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc0a8710 con 0x7fecdc151db0 2023-11-30T18:22:30.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.477+0000 7fecdb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecdc136b20 0x7fecdc0a91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:30.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.477+0000 7fecdb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecdc136b20 0x7fecdc0a91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45864/0 (socket says 172.21.15.49:45864) 2023-11-30T18:22:30.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.477+0000 7fecdb7fe700 1 -- 172.21.15.49:0/685509774 learned_addr learned my addr 172.21.15.49:0/685509774 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:30.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.478+0000 7fecdaffd700 1 --2- 172.21.15.49:0/685509774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecc8003910 0x7fecdc134de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:30.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.478+0000 7fecda7fc700 1 --2- 172.21.15.49:0/685509774 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecdc151db0 0x7fecdc136630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:30.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.478+0000 7fecdb7fe700 1 -- 172.21.15.49:0/685509774 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecdc151db0 msgr2=0x7fecdc136630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:30.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.478+0000 7fecdb7fe700 1 --2- 172.21.15.49:0/685509774 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecdc151db0 0x7fecdc136630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:30.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.478+0000 7fecdb7fe700 1 -- 172.21.15.49:0/685509774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecc8003910 msgr2=0x7fecdc134de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:30.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.478+0000 7fecdb7fe700 1 --2- 172.21.15.49:0/685509774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecc8003910 0x7fecdc134de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:30.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.478+0000 7fecdb7fe700 1 -- 172.21.15.49:0/685509774 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecdc0a89f0 con 0x7fecdc136b20 2023-11-30T18:22:30.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.478+0000 7fecdb7fe700 1 --2- 172.21.15.49:0/685509774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecdc136b20 0x7fecdc0a91f0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7fecdc0c7f00 tx=0x7fecd4001d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:30.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.478+0000 7fecd2ffd700 1 -- 172.21.15.49:0/685509774 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4011590 con 0x7fecdc136b20 2023-11-30T18:22:30.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.478+0000 7fecd2ffd700 1 -- 172.21.15.49:0/685509774 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd40116f0 con 0x7fecdc136b20 2023-11-30T18:22:30.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.478+0000 7fece13df700 1 -- 172.21.15.49:0/685509774 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecdc136fa0 con 0x7fecdc136b20 2023-11-30T18:22:30.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.478+0000 7fecd2ffd700 1 -- 172.21.15.49:0/685509774 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4011a90 con 0x7fecdc136b20 2023-11-30T18:22:30.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.478+0000 7fece13df700 1 -- 172.21.15.49:0/685509774 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecdc0a96e0 con 0x7fecdc136b20 2023-11-30T18:22:30.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.479+0000 7fece13df700 1 -- 172.21.15.49:0/685509774 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecdc0a8570 con 0x7fecdc136b20 2023-11-30T18:22:30.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.479+0000 7fecd2ffd700 1 -- 172.21.15.49:0/685509774 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 68) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fecd401d3b0 con 0x7fecdc136b20 2023-11-30T18:22:30.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.480+0000 7fecd2ffd700 1 --2- 172.21.15.49:0/685509774 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fecbc05f2a0 0x7fecbc061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:30.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.480+0000 7fecd2ffd700 1 -- 172.21.15.49:0/685509774 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5841+0+0 (secure 0 0 0) 0x7fecd4079a40 con 0x7fecdc136b20 2023-11-30T18:22:30.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.480+0000 7fecdaffd700 1 --2- 172.21.15.49:0/685509774 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fecbc05f2a0 0x7fecbc061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:30.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.480+0000 7fecdaffd700 1 --2- 172.21.15.49:0/685509774 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fecbc05f2a0 0x7fecbc061760 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7feccc000c00 tx=0x7feccc016000).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:30.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.484+0000 7fecd2ffd700 1 -- 172.21.15.49:0/685509774 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fecdc0a8570 con 0x7fecdc136b20 2023-11-30T18:22:30.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.658+0000 7fece13df700 1 -- 172.21.15.49:0/685509774 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fecdc0a8570 con 0x7fecdc136b20 2023-11-30T18:22:30.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.661+0000 7fecd2ffd700 1 -- 172.21.15.49:0/685509774 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v29) v1 ==== 120+0+0 (secure 0 0 0) 0x7fecdc0a8570 con 0x7fecdc136b20 2023-11-30T18:22:30.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.663+0000 7fece13df700 1 -- 172.21.15.49:0/685509774 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fecbc05f2a0 msgr2=0x7fecbc061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:30.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.663+0000 7fece13df700 1 --2- 172.21.15.49:0/685509774 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fecbc05f2a0 0x7fecbc061760 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7feccc000c00 tx=0x7feccc016000).stop 2023-11-30T18:22:30.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.663+0000 7fece13df700 1 -- 172.21.15.49:0/685509774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecdc136b20 msgr2=0x7fecdc0a91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:30.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.663+0000 7fece13df700 1 --2- 172.21.15.49:0/685509774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecdc136b20 0x7fecdc0a91f0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7fecdc0c7f00 tx=0x7fecd4001d90).stop 2023-11-30T18:22:30.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.663+0000 7fece13df700 1 -- 172.21.15.49:0/685509774 shutdown_connections 2023-11-30T18:22:30.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.663+0000 7fece13df700 1 --2- 172.21.15.49:0/685509774 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fecbc05f2a0 0x7fecbc061760 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:30.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.663+0000 7fece13df700 1 --2- 172.21.15.49:0/685509774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecdc136b20 0x7fecdc0a91f0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:30.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.663+0000 7fece13df700 1 --2- 172.21.15.49:0/685509774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecc8003910 0x7fecdc134de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:30.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.663+0000 7fece13df700 1 --2- 172.21.15.49:0/685509774 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecdc151db0 0x7fecdc136630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:30.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.663+0000 7fece13df700 1 -- 172.21.15.49:0/685509774 >> 172.21.15.49:0/685509774 conn(0x7fecdc0642d0 msgr2=0x7fecdc0a66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:30.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.663+0000 7fece13df700 1 -- 172.21.15.49:0/685509774 shutdown_connections 2023-11-30T18:22:30.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.663+0000 7fece13df700 1 -- 172.21.15.49:0/685509774 wait complete. 2023-11-30T18:22:30.676 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention' 2023-11-30T18:22:30.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.794+0000 7fae5d87a700 1 Processor -- start 2023-11-30T18:22:30.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.794+0000 7fae5d87a700 1 -- start start 2023-11-30T18:22:30.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.795+0000 7fae5d87a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fae581548c0 0x7fae5806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:30.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.795+0000 7fae5d87a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fae580c6e30 0x7fae580c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:30.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.795+0000 7fae5d87a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae580c69a0 con 0x7fae581544e0 2023-11-30T18:22:30.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.795+0000 7fae5d87a700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae580c13a0 con 0x7fae580c6e30 2023-11-30T18:22:30.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.795+0000 7fae5d87a700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae580c1680 con 0x7fae581548c0 2023-11-30T18:22:30.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.795+0000 7fae577fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fae580c6e30 0x7fae580c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:30.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.795+0000 7fae577fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fae580c6e30 0x7fae580c72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52338/0 (socket says 172.21.15.49:52338) 2023-11-30T18:22:30.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.795+0000 7fae577fe700 1 -- 172.21.15.49:0/3767742019 learned_addr learned my addr 172.21.15.49:0/3767742019 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:30.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.795+0000 7fae56ffd700 1 --1- 172.21.15.49:0/3767742019 >> v1:172.21.15.49:6789/0 conn(0x7fae581544e0 0x7fae580c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42094/0 (socket says 172.21.15.49:42094) 2023-11-30T18:22:30.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.795+0000 7fae567fc700 1 --2- 172.21.15.49:0/3767742019 >> v2:172.21.15.115:3300/0 conn(0x7fae581548c0 0x7fae5806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:30.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.795+0000 7fae577fe700 1 -- 172.21.15.49:0/3767742019 >> v2:172.21.15.115:3300/0 conn(0x7fae581548c0 msgr2=0x7fae5806a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:30.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.795+0000 7fae577fe700 1 --2- 172.21.15.49:0/3767742019 >> v2:172.21.15.115:3300/0 conn(0x7fae581548c0 0x7fae5806a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:30.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.795+0000 7fae577fe700 1 -- 172.21.15.49:0/3767742019 >> v1:172.21.15.49:6789/0 conn(0x7fae581544e0 legacy=0x7fae580c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:30.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.795+0000 7fae55ffb700 1 -- 172.21.15.49:0/3767742019 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3837751354 0 0) 0x7fae580c69a0 con 0x7fae581544e0 2023-11-30T18:22:30.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.795+0000 7fae577fe700 1 -- 172.21.15.49:0/3767742019 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae580c6630 con 0x7fae580c6e30 2023-11-30T18:22:30.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.795+0000 7fae577fe700 1 --2- 172.21.15.49:0/3767742019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae580c6e30 0x7fae580c72a0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7fae580c12d0 tx=0x7fae48009840).ready entity=mon.0 client_cookie=6d0d27fe41464186 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:30.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.796+0000 7fae55ffb700 1 -- 172.21.15.49:0/3767742019 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4800e070 con 0x7fae580c6e30 2023-11-30T18:22:30.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.796+0000 7fae55ffb700 1 -- 172.21.15.49:0/3767742019 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4800ba50 con 0x7fae580c6e30 2023-11-30T18:22:30.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.796+0000 7fae55ffb700 1 -- 172.21.15.49:0/3767742019 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4800bdd0 con 0x7fae580c6e30 2023-11-30T18:22:30.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.796+0000 7fae5d87a700 1 -- 172.21.15.49:0/3767742019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae580c6e30 msgr2=0x7fae580c72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:30.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.796+0000 7fae5d87a700 1 --2- 172.21.15.49:0/3767742019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae580c6e30 0x7fae580c72a0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7fae580c12d0 tx=0x7fae48009840).stop 2023-11-30T18:22:30.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.796+0000 7fae5d87a700 1 -- 172.21.15.49:0/3767742019 shutdown_connections 2023-11-30T18:22:30.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.796+0000 7fae5d87a700 1 --2- 172.21.15.49:0/3767742019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae580c6e30 0x7fae580c72a0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:30.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.796+0000 7fae5d87a700 1 --2- 172.21.15.49:0/3767742019 >> v2:172.21.15.115:3300/0 conn(0x7fae581548c0 0x7fae5806a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:30.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.796+0000 7fae5d87a700 1 -- 172.21.15.49:0/3767742019 >> 172.21.15.49:0/3767742019 conn(0x7fae58085020 msgr2=0x7fae58094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:30.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.796+0000 7fae5d87a700 1 -- 172.21.15.49:0/3767742019 shutdown_connections 2023-11-30T18:22:30.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.796+0000 7fae5d87a700 1 -- 172.21.15.49:0/3767742019 wait complete. 2023-11-30T18:22:30.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.797+0000 7fae5d87a700 1 Processor -- start 2023-11-30T18:22:30.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.797+0000 7fae5d87a700 1 -- start start 2023-11-30T18:22:30.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.798+0000 7fae5d87a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae580c6e30 0x7fae581500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:30.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.798+0000 7fae5d87a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae581544e0 0x7fae580c4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:30.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.798+0000 7fae5d87a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae581548c0 0x7fae580c4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:30.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.798+0000 7fae5d87a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae580c4e60 con 0x7fae581548c0 2023-11-30T18:22:30.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.798+0000 7fae5d87a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5815b450 con 0x7fae580c6e30 2023-11-30T18:22:30.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.798+0000 7fae5d87a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5815a840 con 0x7fae581544e0 2023-11-30T18:22:30.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.798+0000 7fae577fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae581548c0 0x7fae580c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:30.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.798+0000 7fae577fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae581548c0 0x7fae580c4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52352/0 (socket says 172.21.15.49:52352) 2023-11-30T18:22:30.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.798+0000 7fae577fe700 1 -- 172.21.15.49:0/315671801 learned_addr learned my addr 172.21.15.49:0/315671801 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:30.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.799+0000 7fae56ffd700 1 --2- 172.21.15.49:0/315671801 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae580c6e30 0x7fae581500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:30.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.799+0000 7fae567fc700 1 --2- 172.21.15.49:0/315671801 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae581544e0 0x7fae580c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:30.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.799+0000 7fae577fe700 1 -- 172.21.15.49:0/315671801 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae581544e0 msgr2=0x7fae580c4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:30.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.799+0000 7fae577fe700 1 --2- 172.21.15.49:0/315671801 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae581544e0 0x7fae580c4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:30.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.799+0000 7fae577fe700 1 -- 172.21.15.49:0/315671801 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae580c6e30 msgr2=0x7fae581500e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:30.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.799+0000 7fae577fe700 1 --2- 172.21.15.49:0/315671801 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae580c6e30 0x7fae581500e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:30.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.799+0000 7fae577fe700 1 -- 172.21.15.49:0/315671801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae48009ae0 con 0x7fae581548c0 2023-11-30T18:22:30.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.799+0000 7fae577fe700 1 --2- 172.21.15.49:0/315671801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae581548c0 0x7fae580c4970 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7fae5805fb30 tx=0x7fae48009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:30.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.799+0000 7fae4effd700 1 -- 172.21.15.49:0/315671801 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4800bdd0 con 0x7fae581548c0 2023-11-30T18:22:30.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.799+0000 7fae4effd700 1 -- 172.21.15.49:0/315671801 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4801c400 con 0x7fae581548c0 2023-11-30T18:22:30.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.799+0000 7fae5d87a700 1 -- 172.21.15.49:0/315671801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae5815ab20 con 0x7fae581548c0 2023-11-30T18:22:30.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.799+0000 7fae4effd700 1 -- 172.21.15.49:0/315671801 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4801c7a0 con 0x7fae581548c0 2023-11-30T18:22:30.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.799+0000 7fae5d87a700 1 -- 172.21.15.49:0/315671801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae5815b0e0 con 0x7fae581548c0 2023-11-30T18:22:30.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.800+0000 7fae5d87a700 1 -- 172.21.15.49:0/315671801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae580c0330 con 0x7fae581548c0 2023-11-30T18:22:30.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.800+0000 7fae4effd700 1 -- 172.21.15.49:0/315671801 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 68) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fae4801cbd0 con 0x7fae581548c0 2023-11-30T18:22:30.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.801+0000 7fae4effd700 1 --2- 172.21.15.49:0/315671801 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fae3805f270 0x7fae38061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:30.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.801+0000 7fae4effd700 1 -- 172.21.15.49:0/315671801 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5841+0+0 (secure 0 0 0) 0x7fae4807bd10 con 0x7fae581548c0 2023-11-30T18:22:30.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.801+0000 7fae56ffd700 1 --2- 172.21.15.49:0/315671801 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fae3805f270 0x7fae38061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:30.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.801+0000 7fae56ffd700 1 --2- 172.21.15.49:0/315671801 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fae3805f270 0x7fae38061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fae500026c0 tx=0x7fae50009040).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:30.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:30.805+0000 7fae4effd700 1 -- 172.21.15.49:0/315671801 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fae4804cf70 con 0x7fae581548c0 2023-11-30T18:22:31.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:31.053+0000 7fae5d87a700 1 -- 172.21.15.49:0/315671801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]} v 0) v1 -- 0x7fae5806c860 con 0x7fae581548c0 2023-11-30T18:22:32.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.012+0000 7fae4effd700 1 -- 172.21.15.49:0/315671801 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]}]=0 v2411) v1 ==== 178+0+0 (secure 0 0 0) 0x7fae48050590 con 0x7fae581548c0 2023-11-30T18:22:32.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.014+0000 7fae5d87a700 1 -- 172.21.15.49:0/315671801 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fae3805f270 msgr2=0x7fae38061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:32.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.014+0000 7fae5d87a700 1 --2- 172.21.15.49:0/315671801 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fae3805f270 0x7fae38061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fae500026c0 tx=0x7fae50009040).stop 2023-11-30T18:22:32.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.014+0000 7fae5d87a700 1 -- 172.21.15.49:0/315671801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae581548c0 msgr2=0x7fae580c4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:32.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.014+0000 7fae5d87a700 1 --2- 172.21.15.49:0/315671801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae581548c0 0x7fae580c4970 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7fae5805fb30 tx=0x7fae48009840).stop 2023-11-30T18:22:32.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.014+0000 7fae5d87a700 1 -- 172.21.15.49:0/315671801 shutdown_connections 2023-11-30T18:22:32.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.014+0000 7fae5d87a700 1 --2- 172.21.15.49:0/315671801 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fae3805f270 0x7fae38061730 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:32.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.014+0000 7fae5d87a700 1 --2- 172.21.15.49:0/315671801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae581548c0 0x7fae580c4970 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:32.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.014+0000 7fae5d87a700 1 --2- 172.21.15.49:0/315671801 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae580c6e30 0x7fae581500e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:32.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.014+0000 7fae5d87a700 1 --2- 172.21.15.49:0/315671801 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae581544e0 0x7fae580c4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:32.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.014+0000 7fae5d87a700 1 -- 172.21.15.49:0/315671801 >> 172.21.15.49:0/315671801 conn(0x7fae58085020 msgr2=0x7fae580c0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:32.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.015+0000 7fae5d87a700 1 -- 172.21.15.49:0/315671801 shutdown_connections 2023-11-30T18:22:32.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.015+0000 7fae5d87a700 1 -- 172.21.15.49:0/315671801 wait complete. 2023-11-30T18:22:32.031 INFO:tasks.cephfs_test_runner:Test that number of snaps retained are as per user spec. ... ok 2023-11-30T18:22:32.031 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules post removal of a schedule 2023-11-30T18:22:32.031 INFO:tasks.cephfs_test_runner:test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-11-30T18:22:32.031 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-11-30T18:22:32.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.155+0000 7f0f77dce700 1 Processor -- start 2023-11-30T18:22:32.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.155+0000 7f0f77dce700 1 -- start start 2023-11-30T18:22:32.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.156+0000 7f0f77dce700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0f700caab0 0x7f0f700aa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:32.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.156+0000 7f0f77dce700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f700cae90 0x7f0f700c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:32.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.156+0000 7f0f77dce700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0f700aa960 0x7f0f700c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:32.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.156+0000 7f0f77dce700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f700c1490 con 0x7f0f700aa960 2023-11-30T18:22:32.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.156+0000 7f0f77dce700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f700a9a90 con 0x7f0f700caab0 2023-11-30T18:22:32.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.156+0000 7f0f77dce700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f70154ce0 con 0x7f0f700cae90 2023-11-30T18:22:32.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.156+0000 7f0f7636b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0f700aa960 0x7f0f700c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:32.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.156+0000 7f0f7636b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0f700aa960 0x7f0f700c0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52362/0 (socket says 172.21.15.49:52362) 2023-11-30T18:22:32.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.156+0000 7f0f7636b700 1 -- 172.21.15.49:0/1946934136 learned_addr learned my addr 172.21.15.49:0/1946934136 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:32.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.156+0000 7f0f75369700 1 --2- 172.21.15.49:0/1946934136 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f700cae90 0x7f0f700c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:32.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.156+0000 7f0f75b6a700 1 --2- 172.21.15.49:0/1946934136 >> v2:172.21.15.115:3300/0 conn(0x7f0f700caab0 0x7f0f700aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:32.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.156+0000 7f0f7636b700 1 -- 172.21.15.49:0/1946934136 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f700cae90 msgr2=0x7f0f700c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:32.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.156+0000 7f0f7636b700 1 --2- 172.21.15.49:0/1946934136 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f700cae90 0x7f0f700c0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:32.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.156+0000 7f0f7636b700 1 -- 172.21.15.49:0/1946934136 >> v2:172.21.15.115:3300/0 conn(0x7f0f700caab0 msgr2=0x7f0f700aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:32.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.156+0000 7f0f7636b700 1 --2- 172.21.15.49:0/1946934136 >> v2:172.21.15.115:3300/0 conn(0x7f0f700caab0 0x7f0f700aa470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:32.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.156+0000 7f0f7636b700 1 -- 172.21.15.49:0/1946934136 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f700a8e80 con 0x7f0f700aa960 2023-11-30T18:22:32.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.156+0000 7f0f75369700 1 --2- 172.21.15.49:0/1946934136 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f700cae90 0x7f0f700c0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:22:32.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.157+0000 7f0f7636b700 1 --2- 172.21.15.49:0/1946934136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f700aa960 0x7f0f700c0fa0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7f0f700848c0 tx=0x7f0f68009840).ready entity=mon.0 client_cookie=ec02c76824dba049 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:32.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.157+0000 7f0f74b68700 1 -- 172.21.15.49:0/1946934136 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6800e070 con 0x7f0f700aa960 2023-11-30T18:22:32.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.157+0000 7f0f74b68700 1 -- 172.21.15.49:0/1946934136 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6800ba20 con 0x7f0f700aa960 2023-11-30T18:22:32.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.157+0000 7f0f74b68700 1 -- 172.21.15.49:0/1946934136 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6800bda0 con 0x7f0f700aa960 2023-11-30T18:22:32.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.157+0000 7f0f77dce700 1 -- 172.21.15.49:0/1946934136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f700aa960 msgr2=0x7f0f700c0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:32.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.157+0000 7f0f77dce700 1 --2- 172.21.15.49:0/1946934136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f700aa960 0x7f0f700c0fa0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7f0f700848c0 tx=0x7f0f68009840).stop 2023-11-30T18:22:32.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.157+0000 7f0f77dce700 1 -- 172.21.15.49:0/1946934136 shutdown_connections 2023-11-30T18:22:32.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.157+0000 7f0f77dce700 1 --2- 172.21.15.49:0/1946934136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f700aa960 0x7f0f700c0fa0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:32.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.157+0000 7f0f77dce700 1 --2- 172.21.15.49:0/1946934136 >> v2:172.21.15.115:3300/0 conn(0x7f0f700caab0 0x7f0f700aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:32.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.157+0000 7f0f77dce700 1 --2- 172.21.15.49:0/1946934136 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f700cae90 0x7f0f700c0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:32.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.157+0000 7f0f77dce700 1 -- 172.21.15.49:0/1946934136 >> 172.21.15.49:0/1946934136 conn(0x7f0f70094920 msgr2=0x7f0f7006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:32.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.157+0000 7f0f77dce700 1 -- 172.21.15.49:0/1946934136 shutdown_connections 2023-11-30T18:22:32.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.157+0000 7f0f77dce700 1 -- 172.21.15.49:0/1946934136 wait complete. 2023-11-30T18:22:32.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.158+0000 7f0f77dce700 1 Processor -- start 2023-11-30T18:22:32.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.159+0000 7f0f77dce700 1 -- start start 2023-11-30T18:22:32.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.159+0000 7f0f77dce700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f700caab0 0x7f0f70168720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:32.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.159+0000 7f0f77dce700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f700cae90 0x7f0f70151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:32.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.159+0000 7f0f77dce700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f700ad700 0x7f0f700c3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:32.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.159+0000 7f0f77dce700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f70152700 con 0x7f0f700ad700 2023-11-30T18:22:32.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.159+0000 7f0f77dce700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f70168c10 con 0x7f0f700caab0 2023-11-30T18:22:32.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.159+0000 7f0f77dce700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f700c23b0 con 0x7f0f700cae90 2023-11-30T18:22:32.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.159+0000 7f0f7636b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f700ad700 0x7f0f700c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:32.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.159+0000 7f0f7636b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f700ad700 0x7f0f700c3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52368/0 (socket says 172.21.15.49:52368) 2023-11-30T18:22:32.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.159+0000 7f0f7636b700 1 -- 172.21.15.49:0/147446229 learned_addr learned my addr 172.21.15.49:0/147446229 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:32.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.160+0000 7f0f75b6a700 1 --2- 172.21.15.49:0/147446229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f700caab0 0x7f0f70168720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.160+0000 7f0f75369700 1 --2- 172.21.15.49:0/147446229 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f700cae90 0x7f0f70151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.160+0000 7f0f7636b700 1 -- 172.21.15.49:0/147446229 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f700cae90 msgr2=0x7f0f70151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.160+0000 7f0f7636b700 1 --2- 172.21.15.49:0/147446229 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f700cae90 0x7f0f70151700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.160+0000 7f0f7636b700 1 -- 172.21.15.49:0/147446229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f700caab0 msgr2=0x7f0f70168720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.160+0000 7f0f7636b700 1 --2- 172.21.15.49:0/147446229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f700caab0 0x7f0f70168720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.160+0000 7f0f7636b700 1 -- 172.21.15.49:0/147446229 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f68009ae0 con 0x7f0f700ad700 2023-11-30T18:22:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.160+0000 7f0f7636b700 1 --2- 172.21.15.49:0/147446229 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f700ad700 0x7f0f700c3170 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7f0f70083c30 tx=0x7f0f68009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.160+0000 7f0f65ffb700 1 -- 172.21.15.49:0/147446229 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f680032f0 con 0x7f0f700ad700 2023-11-30T18:22:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.160+0000 7f0f65ffb700 1 -- 172.21.15.49:0/147446229 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f680092e0 con 0x7f0f700ad700 2023-11-30T18:22:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.160+0000 7f0f77dce700 1 -- 172.21.15.49:0/147446229 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f700c2690 con 0x7f0f700ad700 2023-11-30T18:22:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.160+0000 7f0f65ffb700 1 -- 172.21.15.49:0/147446229 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6801e6a0 con 0x7f0f700ad700 2023-11-30T18:22:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.160+0000 7f0f77dce700 1 -- 172.21.15.49:0/147446229 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f700c2c50 con 0x7f0f700ad700 2023-11-30T18:22:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.161+0000 7f0f77dce700 1 -- 172.21.15.49:0/147446229 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f7006c860 con 0x7f0f700ad700 2023-11-30T18:22:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.161+0000 7f0f65ffb700 1 -- 172.21.15.49:0/147446229 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 68) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0f68003040 con 0x7f0f700ad700 2023-11-30T18:22:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.162+0000 7f0f65ffb700 1 --2- 172.21.15.49:0/147446229 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0f5405f270 0x7f0f54061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:32.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.162+0000 7f0f65ffb700 1 -- 172.21.15.49:0/147446229 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f0f6807b6c0 con 0x7f0f700ad700 2023-11-30T18:22:32.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.162+0000 7f0f75b6a700 1 --2- 172.21.15.49:0/147446229 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0f5405f270 0x7f0f54061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:32.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.163+0000 7f0f75b6a700 1 --2- 172.21.15.49:0/147446229 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0f5405f270 0x7f0f54061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f0f6c009200 tx=0x7f0f6c008040).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:32.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.166+0000 7f0f65ffb700 1 -- 172.21.15.49:0/147446229 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0f6804c9d0 con 0x7f0f700ad700 2023-11-30T18:22:32.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:32.406+0000 7f0f77dce700 1 -- 172.21.15.49:0/147446229 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7f0f700a9160 con 0x7f0f700ad700 2023-11-30T18:22:33.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.013+0000 7f0f65ffb700 1 -- 172.21.15.49:0/147446229 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v2412) v1 ==== 177+0+0 (secure 0 0 0) 0x7f0f68023020 con 0x7f0f700ad700 2023-11-30T18:22:33.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.016+0000 7f0f77dce700 1 -- 172.21.15.49:0/147446229 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0f5405f270 msgr2=0x7f0f54061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:33.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.016+0000 7f0f77dce700 1 --2- 172.21.15.49:0/147446229 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0f5405f270 0x7f0f54061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f0f6c009200 tx=0x7f0f6c008040).stop 2023-11-30T18:22:33.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.016+0000 7f0f77dce700 1 -- 172.21.15.49:0/147446229 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f700ad700 msgr2=0x7f0f700c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:33.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.016+0000 7f0f77dce700 1 --2- 172.21.15.49:0/147446229 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f700ad700 0x7f0f700c3170 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7f0f70083c30 tx=0x7f0f68009840).stop 2023-11-30T18:22:33.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.016+0000 7f0f77dce700 1 -- 172.21.15.49:0/147446229 shutdown_connections 2023-11-30T18:22:33.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.016+0000 7f0f77dce700 1 --2- 172.21.15.49:0/147446229 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0f5405f270 0x7f0f54061730 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:33.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.016+0000 7f0f77dce700 1 --2- 172.21.15.49:0/147446229 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f700ad700 0x7f0f700c3170 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:33.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.016+0000 7f0f77dce700 1 --2- 172.21.15.49:0/147446229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f700caab0 0x7f0f70168720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:33.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.016+0000 7f0f77dce700 1 --2- 172.21.15.49:0/147446229 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f700cae90 0x7f0f70151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:33.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.016+0000 7f0f77dce700 1 -- 172.21.15.49:0/147446229 >> 172.21.15.49:0/147446229 conn(0x7f0f70094920 msgr2=0x7f0f700af020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:33.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.016+0000 7f0f77dce700 1 -- 172.21.15.49:0/147446229 shutdown_connections 2023-11-30T18:22:33.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.016+0000 7f0f77dce700 1 -- 172.21.15.49:0/147446229 wait complete. 2023-11-30T18:22:33.030 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-30T18:22:33.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.152+0000 7f9d31a0a700 1 Processor -- start 2023-11-30T18:22:33.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.152+0000 7f9d31a0a700 1 -- start start 2023-11-30T18:22:33.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.153+0000 7f9d31a0a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d2c064fd0 0x7f9d2c157d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:33.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.153+0000 7f9d31a0a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9d2c14e360 0x7f9d2c14e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:33.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.153+0000 7f9d31a0a700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d2c14ed00 con 0x7f9d2c154810 2023-11-30T18:22:33.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.153+0000 7f9d31a0a700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d2c0a48e0 con 0x7f9d2c14e360 2023-11-30T18:22:33.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.153+0000 7f9d31a0a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c158310 con 0x7f9d2c064fd0 2023-11-30T18:22:33.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.153+0000 7f9d2a7fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d2c064fd0 0x7f9d2c157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:33.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.153+0000 7f9d2affd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f9d2c154810 0x7f9d2c0648c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:36712/0 (socket says 172.21.15.49:36712) 2023-11-30T18:22:33.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.153+0000 7f9d2b7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9d2c14e360 0x7f9d2c14e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:33.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.153+0000 7f9d2affd700 1 -- 172.21.15.49:0/397360915 learned_addr learned my addr 172.21.15.49:0/397360915 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:22:33.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.153+0000 7f9d29ffb700 1 -- 172.21.15.49:0/397360915 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2924760207 0 0) 0x7f9d2c14ed00 con 0x7f9d2c154810 2023-11-30T18:22:33.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.153+0000 7f9d29ffb700 1 -- 172.21.15.49:0/397360915 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d180033f0 con 0x7f9d2c154810 2023-11-30T18:22:33.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.153+0000 7f9d2a7fc700 1 -- 172.21.15.49:0/397360915 >> v2:172.21.15.115:3300/0 conn(0x7f9d2c14e360 msgr2=0x7f9d2c14e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:33.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.153+0000 7f9d2a7fc700 1 --2- 172.21.15.49:0/397360915 >> v2:172.21.15.115:3300/0 conn(0x7f9d2c14e360 0x7f9d2c14e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:33.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.153+0000 7f9d2a7fc700 1 -- 172.21.15.49:0/397360915 >> v1:172.21.15.115:6789/0 conn(0x7f9d2c154810 legacy=0x7f9d2c0648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:33.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.153+0000 7f9d2a7fc700 1 -- 172.21.15.49:0/397360915 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2c1585f0 con 0x7f9d2c064fd0 2023-11-30T18:22:33.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.154+0000 7f9d2a7fc700 1 --2- 172.21.15.49:0/397360915 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d2c064fd0 0x7f9d2c157d70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f9d14009760 tx=0x7f9d14009060).ready entity=mon.2 client_cookie=f8eda7ca1192afdd server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:33.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.154+0000 7f9d29ffb700 1 -- 172.21.15.49:0/397360915 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1400d4a0 con 0x7f9d2c064fd0 2023-11-30T18:22:33.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.154+0000 7f9d29ffb700 1 -- 172.21.15.49:0/397360915 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1400d600 con 0x7f9d2c064fd0 2023-11-30T18:22:33.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.154+0000 7f9d29ffb700 1 -- 172.21.15.49:0/397360915 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1400d980 con 0x7f9d2c064fd0 2023-11-30T18:22:33.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.154+0000 7f9d31a0a700 1 -- 172.21.15.49:0/397360915 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d2c064fd0 msgr2=0x7f9d2c157d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:33.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.154+0000 7f9d31a0a700 1 --2- 172.21.15.49:0/397360915 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d2c064fd0 0x7f9d2c157d70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f9d14009760 tx=0x7f9d14009060).stop 2023-11-30T18:22:33.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.154+0000 7f9d31a0a700 1 -- 172.21.15.49:0/397360915 shutdown_connections 2023-11-30T18:22:33.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.154+0000 7f9d31a0a700 1 --2- 172.21.15.49:0/397360915 >> v2:172.21.15.115:3300/0 conn(0x7f9d2c14e360 0x7f9d2c14e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:33.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.154+0000 7f9d31a0a700 1 --2- 172.21.15.49:0/397360915 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d2c064fd0 0x7f9d2c157d70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:33.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.154+0000 7f9d31a0a700 1 -- 172.21.15.49:0/397360915 >> 172.21.15.49:0/397360915 conn(0x7f9d2c0c70e0 msgr2=0x7f9d2c0c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:33.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.154+0000 7f9d31a0a700 1 -- 172.21.15.49:0/397360915 shutdown_connections 2023-11-30T18:22:33.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.154+0000 7f9d31a0a700 1 -- 172.21.15.49:0/397360915 wait complete. 2023-11-30T18:22:33.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.156+0000 7f9d31a0a700 1 Processor -- start 2023-11-30T18:22:33.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.156+0000 7f9d31a0a700 1 -- start start 2023-11-30T18:22:33.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.156+0000 7f9d31a0a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d2c064fd0 0x7f9d2c155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:33.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.156+0000 7f9d31a0a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d2c14e360 0x7f9d2c0a9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:33.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.156+0000 7f9d31a0a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d2c154810 0x7f9d2c1348f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:33.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.156+0000 7f9d31a0a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c156db0 con 0x7f9d2c154810 2023-11-30T18:22:33.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.156+0000 7f9d31a0a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c1561a0 con 0x7f9d2c14e360 2023-11-30T18:22:33.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.156+0000 7f9d31a0a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c156480 con 0x7f9d2c064fd0 2023-11-30T18:22:33.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.157+0000 7f9d2b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d2c154810 0x7f9d2c1348f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:33.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.157+0000 7f9d2b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d2c154810 0x7f9d2c1348f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52370/0 (socket says 172.21.15.49:52370) 2023-11-30T18:22:33.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.157+0000 7f9d2b7fe700 1 -- 172.21.15.49:0/3640151360 learned_addr learned my addr 172.21.15.49:0/3640151360 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:33.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.157+0000 7f9d2affd700 1 --2- 172.21.15.49:0/3640151360 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d2c064fd0 0x7f9d2c155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:33.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.157+0000 7f9d2a7fc700 1 --2- 172.21.15.49:0/3640151360 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d2c14e360 0x7f9d2c0a9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:33.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.157+0000 7f9d2b7fe700 1 -- 172.21.15.49:0/3640151360 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d2c064fd0 msgr2=0x7f9d2c155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:33.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.157+0000 7f9d2b7fe700 1 --2- 172.21.15.49:0/3640151360 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d2c064fd0 0x7f9d2c155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:33.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.157+0000 7f9d2b7fe700 1 -- 172.21.15.49:0/3640151360 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d2c14e360 msgr2=0x7f9d2c0a9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:33.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.157+0000 7f9d2b7fe700 1 --2- 172.21.15.49:0/3640151360 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d2c14e360 0x7f9d2c0a9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:33.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.157+0000 7f9d2b7fe700 1 -- 172.21.15.49:0/3640151360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d140092a0 con 0x7f9d2c154810 2023-11-30T18:22:33.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.157+0000 7f9d2b7fe700 1 --2- 172.21.15.49:0/3640151360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d2c154810 0x7f9d2c1348f0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7f9d2400e8d0 tx=0x7f9d24009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:33.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.157+0000 7f9d22ffd700 1 -- 172.21.15.49:0/3640151360 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d24009530 con 0x7f9d2c154810 2023-11-30T18:22:33.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.157+0000 7f9d22ffd700 1 -- 172.21.15.49:0/3640151360 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d24012600 con 0x7f9d2c154810 2023-11-30T18:22:33.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.157+0000 7f9d31a0a700 1 -- 172.21.15.49:0/3640151360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d2c156760 con 0x7f9d2c154810 2023-11-30T18:22:33.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.157+0000 7f9d22ffd700 1 -- 172.21.15.49:0/3640151360 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d24012980 con 0x7f9d2c154810 2023-11-30T18:22:33.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.157+0000 7f9d31a0a700 1 -- 172.21.15.49:0/3640151360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2c0a9b10 con 0x7f9d2c154810 2023-11-30T18:22:33.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.158+0000 7f9d31a0a700 1 -- 172.21.15.49:0/3640151360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d2c156f20 con 0x7f9d2c154810 2023-11-30T18:22:33.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.159+0000 7f9d22ffd700 1 -- 172.21.15.49:0/3640151360 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 68) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f9d24012d30 con 0x7f9d2c154810 2023-11-30T18:22:33.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.159+0000 7f9d22ffd700 1 --2- 172.21.15.49:0/3640151360 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9d0c05f270 0x7f9d0c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:33.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.159+0000 7f9d22ffd700 1 -- 172.21.15.49:0/3640151360 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f9d2407a6e0 con 0x7f9d2c154810 2023-11-30T18:22:33.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.159+0000 7f9d2affd700 1 --2- 172.21.15.49:0/3640151360 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9d0c05f270 0x7f9d0c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:33.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.160+0000 7f9d2affd700 1 --2- 172.21.15.49:0/3640151360 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9d0c05f270 0x7f9d0c061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f9d2c154530 tx=0x7f9d1c009040).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:33.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.163+0000 7f9d22ffd700 1 -- 172.21.15.49:0/3640151360 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9d2404b940 con 0x7f9d2c154810 2023-11-30T18:22:33.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.335+0000 7f9d31a0a700 1 -- 172.21.15.49:0/3640151360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9d2c1588d0 con 0x7f9d2c154810 2023-11-30T18:22:33.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.342+0000 7f9d22ffd700 1 -- 172.21.15.49:0/3640151360 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9d2404ef60 con 0x7f9d2c154810 2023-11-30T18:22:33.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.344+0000 7f9d31a0a700 1 -- 172.21.15.49:0/3640151360 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9d0c05f270 msgr2=0x7f9d0c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:33.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.344+0000 7f9d31a0a700 1 --2- 172.21.15.49:0/3640151360 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9d0c05f270 0x7f9d0c061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f9d2c154530 tx=0x7f9d1c009040).stop 2023-11-30T18:22:33.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.344+0000 7f9d31a0a700 1 -- 172.21.15.49:0/3640151360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d2c154810 msgr2=0x7f9d2c1348f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:33.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.344+0000 7f9d31a0a700 1 --2- 172.21.15.49:0/3640151360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d2c154810 0x7f9d2c1348f0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7f9d2400e8d0 tx=0x7f9d24009060).stop 2023-11-30T18:22:33.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.344+0000 7f9d31a0a700 1 -- 172.21.15.49:0/3640151360 shutdown_connections 2023-11-30T18:22:33.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.344+0000 7f9d31a0a700 1 --2- 172.21.15.49:0/3640151360 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9d0c05f270 0x7f9d0c061730 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:33.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.344+0000 7f9d31a0a700 1 --2- 172.21.15.49:0/3640151360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d2c154810 0x7f9d2c1348f0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:33.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.344+0000 7f9d31a0a700 1 --2- 172.21.15.49:0/3640151360 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d2c064fd0 0x7f9d2c155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:33.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.344+0000 7f9d31a0a700 1 --2- 172.21.15.49:0/3640151360 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d2c14e360 0x7f9d2c0a9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:33.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.344+0000 7f9d31a0a700 1 -- 172.21.15.49:0/3640151360 >> 172.21.15.49:0/3640151360 conn(0x7f9d2c0c70e0 msgr2=0x7f9d2c0a4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:33.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.344+0000 7f9d31a0a700 1 -- 172.21.15.49:0/3640151360 shutdown_connections 2023-11-30T18:22:33.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.344+0000 7f9d31a0a700 1 -- 172.21.15.49:0/3640151360 wait complete. 2023-11-30T18:22:33.357 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-30T18:22:33.357 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T18:22:33.405 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T18:22:33.448 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-30T18:22:33.448 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-30T18:22:33.449 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:22:33.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.566+0000 7fa7d613a700 1 Processor -- start 2023-11-30T18:22:33.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.566+0000 7fa7d613a700 1 -- start start 2023-11-30T18:22:33.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.567+0000 7fa7d613a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d0096590 0x7fa7d0155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:33.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.567+0000 7fa7d613a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d00683d0 con 0x7fa7d01544d0 2023-11-30T18:22:33.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.567+0000 7fa7d613a700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d0067850 con 0x7fa7d0064e20 2023-11-30T18:22:33.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.567+0000 7fa7d613a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d0067650 con 0x7fa7d0096590 2023-11-30T18:22:33.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.567+0000 7fa7cf7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa7d01544d0 0x7fa7d0066f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42104/0 (socket says 172.21.15.49:42104) 2023-11-30T18:22:33.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.567+0000 7fa7cf7fe700 1 -- 172.21.15.49:0/930456145 learned_addr learned my addr 172.21.15.49:0/930456145 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:22:33.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.567+0000 7fa7cffff700 1 --2- 172.21.15.49:0/930456145 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d0096590 0x7fa7d0155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:33.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.568+0000 7fa7ce7fc700 1 -- 172.21.15.49:0/930456145 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2079702415 0 0) 0x7fa7d00683d0 con 0x7fa7d01544d0 2023-11-30T18:22:33.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.568+0000 7fa7ce7fc700 1 -- 172.21.15.49:0/930456145 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7b80033f0 con 0x7fa7d01544d0 2023-11-30T18:22:33.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.568+0000 7fa7ce7fc700 1 -- 172.21.15.49:0/930456145 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2011903207 0 0) 0x7fa7b80033f0 con 0x7fa7d01544d0 2023-11-30T18:22:33.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.568+0000 7fa7ce7fc700 1 -- 172.21.15.49:0/930456145 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d0096590 msgr2=0x7fa7d0155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:33.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.568+0000 7fa7ce7fc700 1 --2- 172.21.15.49:0/930456145 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d0096590 0x7fa7d0155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:33.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.568+0000 7fa7ce7fc700 1 -- 172.21.15.49:0/930456145 >> v1:172.21.15.115:6789/0 conn(0x7fa7d0064e20 legacy=0x7fa7d0095e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:33.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.568+0000 7fa7ce7fc700 1 -- 172.21.15.49:0/930456145 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d0067b30 con 0x7fa7d01544d0 2023-11-30T18:22:33.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.568+0000 7fa7ce7fc700 1 -- 172.21.15.49:0/930456145 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fa7c00015f0 con 0x7fa7d01544d0 2023-11-30T18:22:33.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.568+0000 7fa7ce7fc700 1 -- 172.21.15.49:0/930456145 >> v1:172.21.15.49:6789/0 conn(0x7fa7d01544d0 legacy=0x7fa7d0066f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:33.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.568+0000 7fa7ce7fc700 1 --2- 172.21.15.49:0/930456145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7b8003910 0x7fa7b8003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:33.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.568+0000 7fa7ce7fc700 1 --2- 172.21.15.49:0/930456145 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7b8004690 0x7fa7b8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:33.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.568+0000 7fa7ce7fc700 1 --2- 172.21.15.49:0/930456145 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d0096590 0x7fa7b8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:33.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.568+0000 7fa7ce7fc700 1 -- 172.21.15.49:0/930456145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d0067650 con 0x7fa7b8003910 2023-11-30T18:22:33.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.568+0000 7fa7ce7fc700 1 -- 172.21.15.49:0/930456145 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b800b8e0 con 0x7fa7b8004690 2023-11-30T18:22:33.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.568+0000 7fa7ce7fc700 1 -- 172.21.15.49:0/930456145 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b800ba70 con 0x7fa7d0096590 2023-11-30T18:22:33.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.568+0000 7fa7cf7fe700 1 --2- 172.21.15.49:0/930456145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7b8003910 0x7fa7b8003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:33.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.568+0000 7fa7cffff700 1 --2- 172.21.15.49:0/930456145 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d0096590 0x7fa7b8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:33.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.568+0000 7fa7ceffd700 1 --2- 172.21.15.49:0/930456145 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7b8004690 0x7fa7b8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:33.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.568+0000 7fa7cf7fe700 1 -- 172.21.15.49:0/930456145 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d0096590 msgr2=0x7fa7b8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:33.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.568+0000 7fa7cf7fe700 1 --2- 172.21.15.49:0/930456145 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d0096590 0x7fa7b8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:33.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.568+0000 7fa7cf7fe700 1 -- 172.21.15.49:0/930456145 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7b8004690 msgr2=0x7fa7b8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:33.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.568+0000 7fa7cf7fe700 1 --2- 172.21.15.49:0/930456145 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7b8004690 0x7fa7b8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:33.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.568+0000 7fa7cf7fe700 1 -- 172.21.15.49:0/930456145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b80033f0 con 0x7fa7b8003910 2023-11-30T18:22:33.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.569+0000 7fa7cf7fe700 1 --2- 172.21.15.49:0/930456145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7b8003910 0x7fa7b8003cf0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7fa7c000c110 tx=0x7fa7c0007720).ready entity=mon.0 client_cookie=4f752dfeee6a20d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:33.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.569+0000 7fa7ce7fc700 1 -- 172.21.15.49:0/930456145 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0007930 con 0x7fa7b8003910 2023-11-30T18:22:33.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.569+0000 7fa7ce7fc700 1 -- 172.21.15.49:0/930456145 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c00070d0 con 0x7fa7b8003910 2023-11-30T18:22:33.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.569+0000 7fa7ce7fc700 1 -- 172.21.15.49:0/930456145 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0007450 con 0x7fa7b8003910 2023-11-30T18:22:33.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.569+0000 7fa7d613a700 1 -- 172.21.15.49:0/930456145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7b8003910 msgr2=0x7fa7b8003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:33.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.569+0000 7fa7d613a700 1 --2- 172.21.15.49:0/930456145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7b8003910 0x7fa7b8003cf0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7fa7c000c110 tx=0x7fa7c0007720).stop 2023-11-30T18:22:33.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.569+0000 7fa7cffff700 1 -- 172.21.15.49:0/930456145 reap_dead start 2023-11-30T18:22:33.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.569+0000 7fa7d613a700 1 -- 172.21.15.49:0/930456145 shutdown_connections 2023-11-30T18:22:33.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.569+0000 7fa7d613a700 1 -- 172.21.15.49:0/930456145 >> 172.21.15.49:0/930456145 conn(0x7fa7d00631d0 msgr2=0x7fa7d00c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:33.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.569+0000 7fa7d613a700 1 -- 172.21.15.49:0/930456145 shutdown_connections 2023-11-30T18:22:33.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.569+0000 7fa7d613a700 1 -- 172.21.15.49:0/930456145 wait complete. 2023-11-30T18:22:33.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.570+0000 7fa7d613a700 1 Processor -- start 2023-11-30T18:22:33.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.570+0000 7fa7d613a700 1 -- start start 2023-11-30T18:22:33.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.571+0000 7fa7d613a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7d0152d20 0x7fa7d0153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:33.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.571+0000 7fa7d613a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d01554a0 0x7fa7d0167fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:33.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.571+0000 7fa7d613a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d00a9750 0x7fa7d00a9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:33.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.571+0000 7fa7d613a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d01565b0 con 0x7fa7d01554a0 2023-11-30T18:22:33.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.571+0000 7fa7d613a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d00a7200 con 0x7fa7d0152d20 2023-11-30T18:22:33.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.571+0000 7fa7d613a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d01684d0 con 0x7fa7d00a9750 2023-11-30T18:22:33.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.571+0000 7fa7ceffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d01554a0 0x7fa7d0167fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:33.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.571+0000 7fa7ceffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d01554a0 0x7fa7d0167fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52384/0 (socket says 172.21.15.49:52384) 2023-11-30T18:22:33.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.571+0000 7fa7ceffd700 1 -- 172.21.15.49:0/972910905 learned_addr learned my addr 172.21.15.49:0/972910905 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:33.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.572+0000 7fa7cf7fe700 1 --2- 172.21.15.49:0/972910905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7d0152d20 0x7fa7d0153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:33.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.572+0000 7fa7cffff700 1 --2- 172.21.15.49:0/972910905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d00a9750 0x7fa7d00a9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:33.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.572+0000 7fa7ceffd700 1 -- 172.21.15.49:0/972910905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d00a9750 msgr2=0x7fa7d00a9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:33.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.572+0000 7fa7ceffd700 1 --2- 172.21.15.49:0/972910905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d00a9750 0x7fa7d00a9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:33.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.572+0000 7fa7ceffd700 1 -- 172.21.15.49:0/972910905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7d0152d20 msgr2=0x7fa7d0153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:33.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.572+0000 7fa7ceffd700 1 --2- 172.21.15.49:0/972910905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7d0152d20 0x7fa7d0153100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:33.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.572+0000 7fa7ceffd700 1 -- 172.21.15.49:0/972910905 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d0155930 con 0x7fa7d01554a0 2023-11-30T18:22:33.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.572+0000 7fa7cf7fe700 1 --2- 172.21.15.49:0/972910905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7d0152d20 0x7fa7d0153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:22:33.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.572+0000 7fa7ceffd700 1 --2- 172.21.15.49:0/972910905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d01554a0 0x7fa7d0167fe0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7fa7c4002910 tx=0x7fa7c4007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:33.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.572+0000 7fa7b77fe700 1 -- 172.21.15.49:0/972910905 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c400f8d0 con 0x7fa7d01554a0 2023-11-30T18:22:33.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.572+0000 7fa7b77fe700 1 -- 172.21.15.49:0/972910905 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c400fa30 con 0x7fa7d01554a0 2023-11-30T18:22:33.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.572+0000 7fa7b77fe700 1 -- 172.21.15.49:0/972910905 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c400fdb0 con 0x7fa7d01554a0 2023-11-30T18:22:33.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.572+0000 7fa7d613a700 1 -- 172.21.15.49:0/972910905 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d0155c10 con 0x7fa7d01554a0 2023-11-30T18:22:33.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.572+0000 7fa7d613a700 1 -- 172.21.15.49:0/972910905 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d01561d0 con 0x7fa7d01554a0 2023-11-30T18:22:33.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.573+0000 7fa7d613a700 1 -- 172.21.15.49:0/972910905 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d01566f0 con 0x7fa7d01554a0 2023-11-30T18:22:33.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.573+0000 7fa7b77fe700 1 -- 172.21.15.49:0/972910905 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 68) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa7c4014660 con 0x7fa7d01554a0 2023-11-30T18:22:33.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.574+0000 7fa7b77fe700 1 --2- 172.21.15.49:0/972910905 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa7bc05f240 0x7fa7bc061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:33.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.574+0000 7fa7b77fe700 1 -- 172.21.15.49:0/972910905 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5841+0+0 (secure 0 0 0) 0x7fa7c407a190 con 0x7fa7d01554a0 2023-11-30T18:22:33.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.574+0000 7fa7cf7fe700 1 --2- 172.21.15.49:0/972910905 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa7bc05f240 0x7fa7bc061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:33.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.574+0000 7fa7cf7fe700 1 --2- 172.21.15.49:0/972910905 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa7bc05f240 0x7fa7bc061700 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fa7d006a960 tx=0x7fa7c0015000).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:33.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.578+0000 7fa7b77fe700 1 -- 172.21.15.49:0/972910905 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa7c404ab00 con 0x7fa7d01554a0 2023-11-30T18:22:33.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.791+0000 7fa7d613a700 1 -- 172.21.15.49:0/972910905 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7d006c860 con 0x7fa7d01554a0 2023-11-30T18:22:33.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.791+0000 7fa7b77fe700 1 -- 172.21.15.49:0/972910905 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fa7d01566f0 con 0x7fa7d01554a0 2023-11-30T18:22:33.792 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:22:33.792 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":63,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6851,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/4266183168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":4266183168},{"type":"v1","addr":"172.21.15.49:6835","nonce":4266183168}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":7810,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1044019551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1044019551},{"type":"v1","addr":"172.21.15.115:6836","nonce":1044019551}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":7813,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/676160579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":676160579},{"type":"v1","addr":"172.21.15.115:6837","nonce":676160579}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":8451,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/707698071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":707698071},{"type":"v1","addr":"172.21.15.49:6834","nonce":707698071}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[]} 2023-11-30T18:22:33.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.793+0000 7fa7d613a700 1 -- 172.21.15.49:0/972910905 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa7bc05f240 msgr2=0x7fa7bc061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:33.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.793+0000 7fa7d613a700 1 --2- 172.21.15.49:0/972910905 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa7bc05f240 0x7fa7bc061700 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fa7d006a960 tx=0x7fa7c0015000).stop 2023-11-30T18:22:33.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.793+0000 7fa7d613a700 1 -- 172.21.15.49:0/972910905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d01554a0 msgr2=0x7fa7d0167fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:33.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.793+0000 7fa7d613a700 1 --2- 172.21.15.49:0/972910905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d01554a0 0x7fa7d0167fe0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7fa7c4002910 tx=0x7fa7c4007bb0).stop 2023-11-30T18:22:33.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.793+0000 7fa7d613a700 1 -- 172.21.15.49:0/972910905 shutdown_connections 2023-11-30T18:22:33.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.793+0000 7fa7d613a700 1 --2- 172.21.15.49:0/972910905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d00a9750 0x7fa7d00a9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:33.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.793+0000 7fa7d613a700 1 --2- 172.21.15.49:0/972910905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7d0152d20 0x7fa7d0153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:33.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.793+0000 7fa7d613a700 1 --2- 172.21.15.49:0/972910905 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa7bc05f240 0x7fa7bc061700 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:33.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.793+0000 7fa7d613a700 1 --2- 172.21.15.49:0/972910905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d01554a0 0x7fa7d0167fe0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:33.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.793+0000 7fa7d613a700 1 -- 172.21.15.49:0/972910905 >> 172.21.15.49:0/972910905 conn(0x7fa7d00631d0 msgr2=0x7fa7d0150c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:33.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.793+0000 7fa7d613a700 1 -- 172.21.15.49:0/972910905 shutdown_connections 2023-11-30T18:22:33.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:33.793+0000 7fa7d613a700 1 -- 172.21.15.49:0/972910905 wait complete. 2023-11-30T18:22:33.796 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 63 2023-11-30T18:22:33.806 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-30T18:22:33.807 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-30T18:22:33.807 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-30T18:22:33.807 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:22:33.807 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-30T18:22:33.807 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-30T18:22:33.807 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-30T18:22:33.808 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:22:33.808 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-30T18:22:33.808 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-30T18:22:33.808 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-30T18:22:33.808 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:22:33.809 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-30T18:22:33.809 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-30T18:22:33.809 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-30T18:22:33.809 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:22:33.816 INFO:tasks.ceph.mds.a:Stopped 2023-11-30T18:22:33.817 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-30T18:22:33.818 INFO:tasks.ceph.mds.c:Stopped 2023-11-30T18:22:33.819 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-30T18:22:33.820 INFO:tasks.ceph.mds.b:Stopped 2023-11-30T18:22:33.820 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-30T18:22:33.821 INFO:tasks.ceph.mds.d:Stopped 2023-11-30T18:22:33.821 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-30T18:22:33.863 INFO:tasks.ceph.mds.a:Started 2023-11-30T18:22:33.863 DEBUG:teuthology.parallel:result is None 2023-11-30T18:22:33.865 INFO:tasks.ceph.mds.c:Started 2023-11-30T18:22:33.866 DEBUG:teuthology.parallel:result is None 2023-11-30T18:22:33.867 INFO:tasks.ceph.mds.b:Started 2023-11-30T18:22:33.868 DEBUG:teuthology.parallel:result is None 2023-11-30T18:22:33.869 INFO:tasks.ceph.mds.d:Started 2023-11-30T18:22:33.869 DEBUG:teuthology.parallel:result is None 2023-11-30T18:22:33.869 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-30T18:22:33.936 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-11-30T18:22:33.942 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-11-30T18:22:33.953 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-11-30T18:22:33.953 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-11-30T18:22:34.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.000+0000 7ff0739b3700 1 Processor -- start 2023-11-30T18:22:34.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.000+0000 7ff0739b3700 1 -- start start 2023-11-30T18:22:34.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.001+0000 7ff0739b3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff06c154440 0x7ff06c154820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:34.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.001+0000 7ff0739b3700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff06c0c1dd0 0x7ff06c0bd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:34.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.001+0000 7ff0739b3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff06c0650a0 0x7ff06c0c2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:34.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.001+0000 7ff0739b3700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff06c0627a0 con 0x7ff06c154440 2023-11-30T18:22:34.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.001+0000 7ff0739b3700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff06c0be1a0 con 0x7ff06c0c1dd0 2023-11-30T18:22:34.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.001+0000 7ff0739b3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c062a40 con 0x7ff06c0650a0 2023-11-30T18:22:34.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.001+0000 7ff07174f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff06c154440 0x7ff06c154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:34.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.001+0000 7ff07174f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff06c154440 0x7ff06c154820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52430/0 (socket says 172.21.15.49:52430) 2023-11-30T18:22:34.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.001+0000 7ff07174f700 1 -- 172.21.15.49:0/3219714597 learned_addr learned my addr 172.21.15.49:0/3219714597 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:34.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.001+0000 7ff070f4e700 1 --2- 172.21.15.49:0/3219714597 >> v2:172.21.15.115:3300/0 conn(0x7ff06c0c1dd0 0x7ff06c0bd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:34.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.001+0000 7ff071f50700 1 --2- 172.21.15.49:0/3219714597 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff06c0650a0 0x7ff06c0c2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:34.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.001+0000 7ff07174f700 1 -- 172.21.15.49:0/3219714597 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff06c0650a0 msgr2=0x7ff06c0c2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:34.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.001+0000 7ff07174f700 1 --2- 172.21.15.49:0/3219714597 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff06c0650a0 0x7ff06c0c2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:34.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.001+0000 7ff07174f700 1 -- 172.21.15.49:0/3219714597 >> v2:172.21.15.115:3300/0 conn(0x7ff06c0c1dd0 msgr2=0x7ff06c0bd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:34.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.001+0000 7ff07174f700 1 --2- 172.21.15.49:0/3219714597 >> v2:172.21.15.115:3300/0 conn(0x7ff06c0c1dd0 0x7ff06c0bd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:34.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.001+0000 7ff07174f700 1 -- 172.21.15.49:0/3219714597 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06c062d20 con 0x7ff06c154440 2023-11-30T18:22:34.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.001+0000 7ff070f4e700 1 --2- 172.21.15.49:0/3219714597 >> v2:172.21.15.115:3300/0 conn(0x7ff06c0c1dd0 0x7ff06c0bd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:22:34.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.001+0000 7ff071f50700 1 --2- 172.21.15.49:0/3219714597 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff06c0650a0 0x7ff06c0c2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:22:34.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.001+0000 7ff07174f700 1 --2- 172.21.15.49:0/3219714597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff06c154440 0x7ff06c154820 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7ff06c06a3d0 tx=0x7ff068009060).ready entity=mon.0 client_cookie=8046fda66853931b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:34.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.001+0000 7ff063fff700 1 -- 172.21.15.49:0/3219714597 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff068005880 con 0x7ff06c154440 2023-11-30T18:22:34.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.001+0000 7ff063fff700 1 -- 172.21.15.49:0/3219714597 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0680059e0 con 0x7ff06c154440 2023-11-30T18:22:34.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.001+0000 7ff063fff700 1 -- 172.21.15.49:0/3219714597 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff068005d60 con 0x7ff06c154440 2023-11-30T18:22:34.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.002+0000 7ff0739b3700 1 -- 172.21.15.49:0/3219714597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff06c154440 msgr2=0x7ff06c154820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:34.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.002+0000 7ff0739b3700 1 --2- 172.21.15.49:0/3219714597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff06c154440 0x7ff06c154820 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7ff06c06a3d0 tx=0x7ff068009060).stop 2023-11-30T18:22:34.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.002+0000 7ff0739b3700 1 -- 172.21.15.49:0/3219714597 shutdown_connections 2023-11-30T18:22:34.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.002+0000 7ff0739b3700 1 --2- 172.21.15.49:0/3219714597 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff06c0650a0 0x7ff06c0c2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:34.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.002+0000 7ff0739b3700 1 --2- 172.21.15.49:0/3219714597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff06c154440 0x7ff06c154820 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:34.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.002+0000 7ff0739b3700 1 --2- 172.21.15.49:0/3219714597 >> v2:172.21.15.115:3300/0 conn(0x7ff06c0c1dd0 0x7ff06c0bd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:34.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.002+0000 7ff0739b3700 1 -- 172.21.15.49:0/3219714597 >> 172.21.15.49:0/3219714597 conn(0x7ff06c0c4200 msgr2=0x7ff06c0c4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:34.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.002+0000 7ff0739b3700 1 -- 172.21.15.49:0/3219714597 shutdown_connections 2023-11-30T18:22:34.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.002+0000 7ff0739b3700 1 -- 172.21.15.49:0/3219714597 wait complete. 2023-11-30T18:22:34.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.003+0000 7ff0739b3700 1 Processor -- start 2023-11-30T18:22:34.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.003+0000 7ff0739b3700 1 -- start start 2023-11-30T18:22:34.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.004+0000 7ff0739b3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff06c0650a0 0x7ff06c147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:34.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.004+0000 7ff0739b3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff06c0c1dd0 0x7ff06c0a9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:34.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.004+0000 7ff0739b3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff06c154440 0x7ff06c0a9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:34.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.004+0000 7ff0739b3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c0a9b40 con 0x7ff06c0c1dd0 2023-11-30T18:22:34.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.004+0000 7ff0739b3700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c0aa2e0 con 0x7ff06c154440 2023-11-30T18:22:34.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.004+0000 7ff0739b3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c0aabb0 con 0x7ff06c0650a0 2023-11-30T18:22:34.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.004+0000 7ff070f4e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff06c0c1dd0 0x7ff06c0a9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:34.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.004+0000 7ff070f4e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff06c0c1dd0 0x7ff06c0a9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52438/0 (socket says 172.21.15.49:52438) 2023-11-30T18:22:34.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.004+0000 7ff070f4e700 1 -- 172.21.15.49:0/3000880735 learned_addr learned my addr 172.21.15.49:0/3000880735 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:34.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.004+0000 7ff07174f700 1 --2- 172.21.15.49:0/3000880735 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff06c0650a0 0x7ff06c147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:34.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.004+0000 7ff071f50700 1 --2- 172.21.15.49:0/3000880735 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff06c154440 0x7ff06c0a9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:34.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.004+0000 7ff070f4e700 1 -- 172.21.15.49:0/3000880735 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff06c0650a0 msgr2=0x7ff06c147690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:34.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.004+0000 7ff070f4e700 1 --2- 172.21.15.49:0/3000880735 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff06c0650a0 0x7ff06c147690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:34.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.004+0000 7ff070f4e700 1 -- 172.21.15.49:0/3000880735 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff06c154440 msgr2=0x7ff06c0a9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:34.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.004+0000 7ff070f4e700 1 --2- 172.21.15.49:0/3000880735 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff06c154440 0x7ff06c0a9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:34.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.005+0000 7ff070f4e700 1 -- 172.21.15.49:0/3000880735 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff068009300 con 0x7ff06c0c1dd0 2023-11-30T18:22:34.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.005+0000 7ff07174f700 1 --2- 172.21.15.49:0/3000880735 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff06c0650a0 0x7ff06c147690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:22:34.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.005+0000 7ff070f4e700 1 --2- 172.21.15.49:0/3000880735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff06c0c1dd0 0x7ff06c0a9160 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7ff05c00c880 tx=0x7ff05c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:34.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.005+0000 7ff0617fa700 1 -- 172.21.15.49:0/3000880735 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05c010580 con 0x7ff06c0c1dd0 2023-11-30T18:22:34.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.005+0000 7ff0617fa700 1 -- 172.21.15.49:0/3000880735 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05c0106e0 con 0x7ff06c0c1dd0 2023-11-30T18:22:34.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.005+0000 7ff0739b3700 1 -- 172.21.15.49:0/3000880735 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff06c0a9d20 con 0x7ff06c0c1dd0 2023-11-30T18:22:34.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.005+0000 7ff0617fa700 1 -- 172.21.15.49:0/3000880735 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05c010a60 con 0x7ff06c0c1dd0 2023-11-30T18:22:34.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.005+0000 7ff0739b3700 1 -- 172.21.15.49:0/3000880735 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff06c0aa840 con 0x7ff06c0c1dd0 2023-11-30T18:22:34.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.006+0000 7ff0739b3700 1 -- 172.21.15.49:0/3000880735 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff06c06c860 con 0x7ff06c0c1dd0 2023-11-30T18:22:34.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.006+0000 7ff0617fa700 1 -- 172.21.15.49:0/3000880735 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 68) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff05c01b460 con 0x7ff06c0c1dd0 2023-11-30T18:22:34.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.006+0000 7ff0617fa700 1 --2- 172.21.15.49:0/3000880735 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff05005f270 0x7ff050061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:34.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.007+0000 7ff0617fa700 1 -- 172.21.15.49:0/3000880735 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5841+0+0 (secure 0 0 0) 0x7ff05c07a2b0 con 0x7ff06c0c1dd0 2023-11-30T18:22:34.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.007+0000 7ff07174f700 1 --2- 172.21.15.49:0/3000880735 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff05005f270 0x7ff050061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:34.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.007+0000 7ff07174f700 1 --2- 172.21.15.49:0/3000880735 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff05005f270 0x7ff050061730 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7ff06c06a3d0 tx=0x7ff068016000).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:34.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.011+0000 7ff0617fa700 1 -- 172.21.15.49:0/3000880735 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff05c04b4b0 con 0x7ff06c0c1dd0 2023-11-30T18:22:34.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:34.199+0000 7ff0739b3700 1 -- 172.21.15.49:0/3000880735 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff06c0be480 con 0x7ff06c0c1dd0 2023-11-30T18:22:35.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.019+0000 7ff0617fa700 1 -- 172.21.15.49:0/3000880735 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v165) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff05c04ead0 con 0x7ff06c0c1dd0 2023-11-30T18:22:35.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.021+0000 7ff0739b3700 1 -- 172.21.15.49:0/3000880735 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff05005f270 msgr2=0x7ff050061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:35.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.021+0000 7ff0739b3700 1 --2- 172.21.15.49:0/3000880735 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff05005f270 0x7ff050061730 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7ff06c06a3d0 tx=0x7ff068016000).stop 2023-11-30T18:22:35.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.021+0000 7ff0739b3700 1 -- 172.21.15.49:0/3000880735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff06c0c1dd0 msgr2=0x7ff06c0a9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:35.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.021+0000 7ff0739b3700 1 --2- 172.21.15.49:0/3000880735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff06c0c1dd0 0x7ff06c0a9160 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7ff05c00c880 tx=0x7ff05c008040).stop 2023-11-30T18:22:35.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.021+0000 7ff0739b3700 1 -- 172.21.15.49:0/3000880735 shutdown_connections 2023-11-30T18:22:35.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.021+0000 7ff0739b3700 1 --2- 172.21.15.49:0/3000880735 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff06c154440 0x7ff06c0a9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:35.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.021+0000 7ff0739b3700 1 --2- 172.21.15.49:0/3000880735 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff06c0650a0 0x7ff06c147690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:35.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.021+0000 7ff0739b3700 1 --2- 172.21.15.49:0/3000880735 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff05005f270 0x7ff050061730 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:35.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.021+0000 7ff0739b3700 1 --2- 172.21.15.49:0/3000880735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff06c0c1dd0 0x7ff06c0a9160 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:35.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.021+0000 7ff0739b3700 1 -- 172.21.15.49:0/3000880735 >> 172.21.15.49:0/3000880735 conn(0x7ff06c0c4200 msgr2=0x7ff06c0a53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:35.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.021+0000 7ff0739b3700 1 -- 172.21.15.49:0/3000880735 shutdown_connections 2023-11-30T18:22:35.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.022+0000 7ff0739b3700 1 -- 172.21.15.49:0/3000880735 wait complete. 2023-11-30T18:22:35.023 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2023-11-30T18:22:35.037 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-30T18:22:35.047 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:22:35.082 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:22:35.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.161+0000 7f118744e700 1 Processor -- start 2023-11-30T18:22:35.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.161+0000 7f118744e700 1 -- start start 2023-11-30T18:22:35.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.162+0000 7f118744e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f11800caab0 0x7f11800aa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:35.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.162+0000 7f118744e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f11800ca180 0x7f118015e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:35.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.162+0000 7f118744e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11800a9a90 con 0x7f11800cae90 2023-11-30T18:22:35.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.162+0000 7f118744e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1180154ce0 con 0x7f11800caab0 2023-11-30T18:22:35.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.162+0000 7f118744e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11800a8e80 con 0x7f11800ca180 2023-11-30T18:22:35.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.162+0000 7f11851ea700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f11800caab0 0x7f11800aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:35.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.162+0000 7f11851ea700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f11800caab0 0x7f11800aa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52454/0 (socket says 172.21.15.49:52454) 2023-11-30T18:22:35.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.162+0000 7f11851ea700 1 -- 172.21.15.49:0/3031546796 learned_addr learned my addr 172.21.15.49:0/3031546796 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:35.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.163+0000 7f11859eb700 1 --2- 172.21.15.49:0/3031546796 >> v2:172.21.15.115:3300/0 conn(0x7f11800ca180 0x7f118015e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:35.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.163+0000 7f11851ea700 1 -- 172.21.15.49:0/3031546796 >> v2:172.21.15.115:3300/0 conn(0x7f11800ca180 msgr2=0x7f118015e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:35.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.163+0000 7f11851ea700 1 --2- 172.21.15.49:0/3031546796 >> v2:172.21.15.115:3300/0 conn(0x7f11800ca180 0x7f118015e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:35.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.163+0000 7f11851ea700 1 -- 172.21.15.49:0/3031546796 >> v1:172.21.15.115:6789/0 conn(0x7f11800cae90 legacy=0x7f11800c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:35.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.163+0000 7f11851ea700 1 -- 172.21.15.49:0/3031546796 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11800a9160 con 0x7f11800caab0 2023-11-30T18:22:35.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.163+0000 7f11851ea700 1 --2- 172.21.15.49:0/3031546796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11800caab0 0x7f11800aa470 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7f11800a9a00 tx=0x7f1178009840).ready entity=mon.0 client_cookie=c424d7c58d13c946 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:35.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.163+0000 7f117ffff700 1 -- 172.21.15.49:0/3031546796 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117800e070 con 0x7f11800caab0 2023-11-30T18:22:35.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.163+0000 7f117ffff700 1 -- 172.21.15.49:0/3031546796 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117800bad0 con 0x7f11800caab0 2023-11-30T18:22:35.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.163+0000 7f117ffff700 1 -- 172.21.15.49:0/3031546796 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117800be50 con 0x7f11800caab0 2023-11-30T18:22:35.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.163+0000 7f118744e700 1 -- 172.21.15.49:0/3031546796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11800caab0 msgr2=0x7f11800aa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:35.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.163+0000 7f118744e700 1 --2- 172.21.15.49:0/3031546796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11800caab0 0x7f11800aa470 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7f11800a9a00 tx=0x7f1178009840).stop 2023-11-30T18:22:35.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.164+0000 7f118744e700 1 -- 172.21.15.49:0/3031546796 shutdown_connections 2023-11-30T18:22:35.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.164+0000 7f118744e700 1 --2- 172.21.15.49:0/3031546796 >> v2:172.21.15.115:3300/0 conn(0x7f11800ca180 0x7f118015e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:35.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.164+0000 7f118744e700 1 --2- 172.21.15.49:0/3031546796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11800caab0 0x7f11800aa470 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:35.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.164+0000 7f118744e700 1 -- 172.21.15.49:0/3031546796 >> 172.21.15.49:0/3031546796 conn(0x7f1180094920 msgr2=0x7f118006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:35.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.164+0000 7f118744e700 1 -- 172.21.15.49:0/3031546796 shutdown_connections 2023-11-30T18:22:35.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.164+0000 7f118744e700 1 -- 172.21.15.49:0/3031546796 wait complete. 2023-11-30T18:22:35.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.165+0000 7f118744e700 1 Processor -- start 2023-11-30T18:22:35.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.165+0000 7f118744e700 1 -- start start 2023-11-30T18:22:35.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.166+0000 7f118744e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11800ca180 0x7f1180141690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:35.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.166+0000 7f118744e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11800caab0 0x7f11800c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:35.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.166+0000 7f118744e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11800cae90 0x7f11800aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:35.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.166+0000 7f118744e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11800c8770 con 0x7f11800caab0 2023-11-30T18:22:35.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.166+0000 7f118744e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11800c8160 con 0x7f11800ca180 2023-11-30T18:22:35.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.166+0000 7f118744e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11801657c0 con 0x7f11800cae90 2023-11-30T18:22:35.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.166+0000 7f11849e9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11800caab0 0x7f11800c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:35.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.166+0000 7f11849e9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11800caab0 0x7f11800c8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52466/0 (socket says 172.21.15.49:52466) 2023-11-30T18:22:35.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.166+0000 7f11849e9700 1 -- 172.21.15.49:0/63758844 learned_addr learned my addr 172.21.15.49:0/63758844 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:35.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.166+0000 7f11851ea700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11800ca180 0x7f1180141690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:35.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.166+0000 7f11859eb700 1 --2- 172.21.15.49:0/63758844 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11800cae90 0x7f11800aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:35.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.166+0000 7f11849e9700 1 -- 172.21.15.49:0/63758844 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11800cae90 msgr2=0x7f11800aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:35.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.166+0000 7f11849e9700 1 --2- 172.21.15.49:0/63758844 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11800cae90 0x7f11800aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:35.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.166+0000 7f11849e9700 1 -- 172.21.15.49:0/63758844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11800ca180 msgr2=0x7f1180141690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:35.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.166+0000 7f11849e9700 1 --2- 172.21.15.49:0/63758844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11800ca180 0x7f1180141690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:35.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.166+0000 7f11849e9700 1 -- 172.21.15.49:0/63758844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1178009ae0 con 0x7f11800caab0 2023-11-30T18:22:35.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.166+0000 7f11849e9700 1 --2- 172.21.15.49:0/63758844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11800caab0 0x7f11800c8c00 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7f117400c440 tx=0x7f1174007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:35.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.167+0000 7f117d7fa700 1 -- 172.21.15.49:0/63758844 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11740123f0 con 0x7f11800caab0 2023-11-30T18:22:35.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.167+0000 7f117d7fa700 1 -- 172.21.15.49:0/63758844 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1174001e90 con 0x7f11800caab0 2023-11-30T18:22:35.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.167+0000 7f118744e700 1 -- 172.21.15.49:0/63758844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11800c8400 con 0x7f11800caab0 2023-11-30T18:22:35.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.167+0000 7f117d7fa700 1 -- 172.21.15.49:0/63758844 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1174012780 con 0x7f11800caab0 2023-11-30T18:22:35.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.167+0000 7f118744e700 1 -- 172.21.15.49:0/63758844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1180141b80 con 0x7f11800caab0 2023-11-30T18:22:35.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.168+0000 7f118744e700 1 -- 172.21.15.49:0/63758844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1180141da0 con 0x7f11800caab0 2023-11-30T18:22:35.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.168+0000 7f117d7fa700 1 -- 172.21.15.49:0/63758844 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 68) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f1174012b30 con 0x7f11800caab0 2023-11-30T18:22:35.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.168+0000 7f117d7fa700 1 --2- 172.21.15.49:0/63758844 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f116c05f270 0x7f116c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:35.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.168+0000 7f117d7fa700 1 -- 172.21.15.49:0/63758844 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5325+0+0 (secure 0 0 0) 0x7f1174079320 con 0x7f11800caab0 2023-11-30T18:22:35.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.169+0000 7f11851ea700 1 --2- 172.21.15.49:0/63758844 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f116c05f270 0x7f116c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:35.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.169+0000 7f11851ea700 1 --2- 172.21.15.49:0/63758844 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f116c05f270 0x7f116c061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f1178009fd0 tx=0x7f1178009840).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:35.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.172+0000 7f117d7fa700 1 -- 172.21.15.49:0/63758844 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1174047b00 con 0x7f11800caab0 2023-11-30T18:22:35.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.406+0000 7f118744e700 1 -- 172.21.15.49:0/63758844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f118006c860 con 0x7f11800caab0 2023-11-30T18:22:35.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.406+0000 7f117d7fa700 1 -- 172.21.15.49:0/63758844 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v40) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f117404a790 con 0x7f11800caab0 2023-11-30T18:22:35.407 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:22:35.407 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T18:22:35.407 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2023-11-30T18:22:35.407 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:22:35.408 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2023-11-30T18:22:35.408 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlwm1FHxAAk+s9c60UZ5jB37wbpGzlcg==", 2023-11-30T18:22:35.408 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:22:35.408 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:22:35.408 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T18:22:35.408 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T18:22:35.408 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:22:35.408 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:22:35.408 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:22:35.408 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:22:35.408 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2023-11-30T18:22:35.408 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlADm0KhAArffesGGTXzQwY4NPnJ1Bjw==", 2023-11-30T18:22:35.408 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:22:35.409 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:22:35.409 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T18:22:35.409 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T18:22:35.409 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:22:35.409 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:22:35.409 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:22:35.409 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:22:35.409 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2023-11-30T18:22:35.409 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlYnY1JhAA+Lurauug0NhWnK8aZErR3g==", 2023-11-30T18:22:35.409 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:22:35.409 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:22:35.409 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T18:22:35.409 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T18:22:35.409 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:22:35.410 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:22:35.410 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:22:35.410 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:22:35.410 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2023-11-30T18:22:35.410 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlQdKCMRAA3h4O2NqkQ2zE3DxOqBoaQQ==", 2023-11-30T18:22:35.410 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:22:35.410 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:22:35.410 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T18:22:35.410 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T18:22:35.410 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:22:35.410 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:22:35.410 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:22:35.411 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:22:35.411 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2023-11-30T18:22:35.411 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAPwWhlGdbhFxAAOspNRLMhR59LSWatFbsYDA==", 2023-11-30T18:22:35.411 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:22:35.411 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:22:35.411 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:22:35.411 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:22:35.411 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:22:35.411 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:22:35.411 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:22:35.411 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2023-11-30T18:22:35.411 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQASwWhlfwUEFxAAuj0L8ooIGi1vsb7XWLVlDA==", 2023-11-30T18:22:35.412 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:22:35.412 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:22:35.412 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:22:35.412 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:22:35.412 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:22:35.412 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:22:35.412 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:22:35.412 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2023-11-30T18:22:35.412 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAVwWhl7XYwFBAAuSHZqdfRR8V1Y+hmPT5uuw==", 2023-11-30T18:22:35.412 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:22:35.412 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:22:35.412 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:22:35.413 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:22:35.413 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:22:35.413 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:22:35.413 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:22:35.413 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2023-11-30T18:22:35.413 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAYwWhlkhRCFRAAe3cRLcrhJ3ZoluXuRUhmew==", 2023-11-30T18:22:35.413 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:22:35.413 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:22:35.413 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:22:35.413 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:22:35.413 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:22:35.413 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:22:35.413 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:22:35.414 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2023-11-30T18:22:35.414 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAewWhlrq4qFBAAOSdqozO8iH25BQFrPI1SRQ==", 2023-11-30T18:22:35.414 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:22:35.414 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:22:35.414 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:22:35.414 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:22:35.414 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:22:35.414 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:22:35.414 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:22:35.414 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2023-11-30T18:22:35.414 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAhwWhlZL9WERAA90znWBLNuY5eem3yF6O0wg==", 2023-11-30T18:22:35.414 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:22:35.414 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:22:35.414 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:22:35.415 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:22:35.415 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:22:35.415 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:22:35.415 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:22:35.415 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2023-11-30T18:22:35.415 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAkwWhlCJDiEBAAETLCBNCdaWXFgkPPaulTAA==", 2023-11-30T18:22:35.415 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:22:35.415 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:22:35.415 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:22:35.415 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:22:35.415 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:22:35.415 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:22:35.415 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:22:35.415 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2023-11-30T18:22:35.416 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAnwWhl+IiYEBAAcI3AU5xrv0cYy9lckyu0dQ==", 2023-11-30T18:22:35.416 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:22:35.416 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:22:35.416 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:22:35.416 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:22:35.416 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:22:35.416 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:22:35.416 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:22:35.416 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2023-11-30T18:22:35.416 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhleYZcNRAA5PoPChH+s6XfbrQ0hmu2NA==", 2023-11-30T18:22:35.416 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:22:35.416 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:22:35.416 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2023-11-30T18:22:35.416 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-30T18:22:35.417 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:22:35.417 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:22:35.417 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:22:35.417 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2023-11-30T18:22:35.417 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAOwWhlFhcfAhAAzaBDtyRxuqeQ9BatfgUuXw==", 2023-11-30T18:22:35.417 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:22:35.417 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:22:35.417 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T18:22:35.417 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T18:22:35.417 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T18:22:35.417 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:22:35.417 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:22:35.417 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:22:35.417 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2023-11-30T18:22:35.418 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlLZrDOhAAHG/dYWYmPouk3+Iqafr7qw==", 2023-11-30T18:22:35.418 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:22:35.418 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:22:35.418 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T18:22:35.418 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T18:22:35.418 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T18:22:35.418 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:22:35.418 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:22:35.418 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:22:35.418 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2023-11-30T18:22:35.418 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAOwWhl6lxuBxAA/YXQDo+U2ppULGzK054Gzg==", 2023-11-30T18:22:35.418 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:22:35.418 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:22:35.419 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T18:22:35.419 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T18:22:35.419 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T18:22:35.419 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:22:35.419 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:22:35.419 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:22:35.419 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2023-11-30T18:22:35.419 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhl4JkLAxAAiaLgZ5eiazaT9VanG5ihyQ==", 2023-11-30T18:22:35.419 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:22:35.419 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T18:22:35.419 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T18:22:35.419 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T18:22:35.419 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:22:35.419 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:22:35.420 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:22:35.420 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:22:35.420 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2023-11-30T18:22:35.420 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlH1s2HBAA3ea9Utfv7fZoo2hO+ElDVQ==", 2023-11-30T18:22:35.420 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:22:35.420 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T18:22:35.420 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-11-30T18:22:35.420 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:22:35.420 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:22:35.420 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:22:35.420 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:22:35.421 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2023-11-30T18:22:35.421 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlpy+fFxAA3qmboR+PlQtK6T35ryj+Lw==", 2023-11-30T18:22:35.421 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:22:35.421 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T18:22:35.421 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-11-30T18:22:35.421 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:22:35.421 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:22:35.421 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:22:35.421 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-11-30T18:22:35.421 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T18:22:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.408+0000 7f118744e700 1 -- 172.21.15.49:0/63758844 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f116c05f270 msgr2=0x7f116c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.408+0000 7f118744e700 1 --2- 172.21.15.49:0/63758844 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f116c05f270 0x7f116c061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f1178009fd0 tx=0x7f1178009840).stop 2023-11-30T18:22:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.408+0000 7f118744e700 1 -- 172.21.15.49:0/63758844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11800caab0 msgr2=0x7f11800c8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.408+0000 7f118744e700 1 --2- 172.21.15.49:0/63758844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11800caab0 0x7f11800c8c00 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7f117400c440 tx=0x7f1174007db0).stop 2023-11-30T18:22:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.408+0000 7f118744e700 1 -- 172.21.15.49:0/63758844 shutdown_connections 2023-11-30T18:22:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.408+0000 7f118744e700 1 --2- 172.21.15.49:0/63758844 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11800cae90 0x7f11800aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.408+0000 7f118744e700 1 --2- 172.21.15.49:0/63758844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11800ca180 0x7f1180141690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.408+0000 7f118744e700 1 --2- 172.21.15.49:0/63758844 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f116c05f270 0x7f116c061730 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.408+0000 7f118744e700 1 --2- 172.21.15.49:0/63758844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11800caab0 0x7f11800c8c00 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.408+0000 7f118744e700 1 -- 172.21.15.49:0/63758844 >> 172.21.15.49:0/63758844 conn(0x7f1180094920 msgr2=0x7f11801598d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.408+0000 7f118744e700 1 -- 172.21.15.49:0/63758844 shutdown_connections 2023-11-30T18:22:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.408+0000 7f118744e700 1 -- 172.21.15.49:0/63758844 wait complete. 2023-11-30T18:22:35.424 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:22:35.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.580+0000 7f577133f700 1 Processor -- start 2023-11-30T18:22:35.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.580+0000 7f577133f700 1 -- start start 2023-11-30T18:22:35.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.581+0000 7f577133f700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f576c1544d0 0x7f576c155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:35.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.581+0000 7f577133f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f576c066f40 0x7f576c095e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:35.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.581+0000 7f577133f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f576c0683d0 con 0x7f576c0673c0 2023-11-30T18:22:35.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.581+0000 7f577133f700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f576c067850 con 0x7f576c066f40 2023-11-30T18:22:35.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.581+0000 7f577133f700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f576c067b30 con 0x7f576c1544d0 2023-11-30T18:22:35.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.581+0000 7f576a7fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f576c066f40 0x7f576c095e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:35.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.581+0000 7f576a7fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f576c066f40 0x7f576c095e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52470/0 (socket says 172.21.15.49:52470) 2023-11-30T18:22:35.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.581+0000 7f576b7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f576c0673c0 0x7f576c063e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42112/0 (socket says 172.21.15.49:42112) 2023-11-30T18:22:35.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.581+0000 7f576a7fc700 1 -- 172.21.15.49:0/467179317 learned_addr learned my addr 172.21.15.49:0/467179317 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:35.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.582+0000 7f576affd700 1 --2- 172.21.15.49:0/467179317 >> v2:172.21.15.115:3300/0 conn(0x7f576c1544d0 0x7f576c155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:35.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.582+0000 7f576a7fc700 1 -- 172.21.15.49:0/467179317 >> v2:172.21.15.115:3300/0 conn(0x7f576c1544d0 msgr2=0x7f576c155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:35.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.582+0000 7f576a7fc700 1 --2- 172.21.15.49:0/467179317 >> v2:172.21.15.115:3300/0 conn(0x7f576c1544d0 0x7f576c155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:35.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.582+0000 7f576a7fc700 1 -- 172.21.15.49:0/467179317 >> v1:172.21.15.49:6789/0 conn(0x7f576c0673c0 legacy=0x7f576c063e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:35.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.582+0000 7f5769ffb700 1 -- 172.21.15.49:0/467179317 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1385313172 0 0) 0x7f576c0683d0 con 0x7f576c0673c0 2023-11-30T18:22:35.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.582+0000 7f576a7fc700 1 -- 172.21.15.49:0/467179317 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576c067e10 con 0x7f576c066f40 2023-11-30T18:22:35.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.582+0000 7f576affd700 1 --2- 172.21.15.49:0/467179317 >> v2:172.21.15.115:3300/0 conn(0x7f576c1544d0 0x7f576c155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:22:35.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.582+0000 7f576a7fc700 1 --2- 172.21.15.49:0/467179317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f576c066f40 0x7f576c095e80 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7f576c06c7c0 tx=0x7f57540090f0).ready entity=mon.0 client_cookie=6830c84d149b0060 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:35.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.582+0000 7f5769ffb700 1 -- 172.21.15.49:0/467179317 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575400b600 con 0x7f576c066f40 2023-11-30T18:22:35.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.582+0000 7f5769ffb700 1 -- 172.21.15.49:0/467179317 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575400b760 con 0x7f576c066f40 2023-11-30T18:22:35.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.582+0000 7f5769ffb700 1 -- 172.21.15.49:0/467179317 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575400bae0 con 0x7f576c066f40 2023-11-30T18:22:35.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.582+0000 7f577133f700 1 -- 172.21.15.49:0/467179317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f576c066f40 msgr2=0x7f576c095e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:35.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.582+0000 7f577133f700 1 --2- 172.21.15.49:0/467179317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f576c066f40 0x7f576c095e80 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7f576c06c7c0 tx=0x7f57540090f0).stop 2023-11-30T18:22:35.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.582+0000 7f577133f700 1 -- 172.21.15.49:0/467179317 shutdown_connections 2023-11-30T18:22:35.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.582+0000 7f577133f700 1 --2- 172.21.15.49:0/467179317 >> v2:172.21.15.115:3300/0 conn(0x7f576c1544d0 0x7f576c155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:35.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.582+0000 7f577133f700 1 --2- 172.21.15.49:0/467179317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f576c066f40 0x7f576c095e80 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:35.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.582+0000 7f577133f700 1 -- 172.21.15.49:0/467179317 >> 172.21.15.49:0/467179317 conn(0x7f576c0631d0 msgr2=0x7f576c0c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:35.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.583+0000 7f577133f700 1 -- 172.21.15.49:0/467179317 shutdown_connections 2023-11-30T18:22:35.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.583+0000 7f577133f700 1 -- 172.21.15.49:0/467179317 wait complete. 2023-11-30T18:22:35.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.584+0000 7f577133f700 1 Processor -- start 2023-11-30T18:22:35.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.584+0000 7f577133f700 1 -- start start 2023-11-30T18:22:35.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.585+0000 7f577133f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f576c066f40 0x7f576c14b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:35.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.585+0000 7f577133f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f576c1544d0 0x7f576c155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:35.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.585+0000 7f577133f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f576c14ba60 0x7f576c14e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:35.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.585+0000 7f577133f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576c152710 con 0x7f576c066f40 2023-11-30T18:22:35.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.585+0000 7f577133f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576c14bfd0 con 0x7f576c14ba60 2023-11-30T18:22:35.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.585+0000 7f577133f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576c14c2b0 con 0x7f576c1544d0 2023-11-30T18:22:35.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.585+0000 7f576affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f576c066f40 0x7f576c14b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:35.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.585+0000 7f576affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f576c066f40 0x7f576c14b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52478/0 (socket says 172.21.15.49:52478) 2023-11-30T18:22:35.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.585+0000 7f576affd700 1 -- 172.21.15.49:0/2266461353 learned_addr learned my addr 172.21.15.49:0/2266461353 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:35.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.585+0000 7f576b7fe700 1 --2- 172.21.15.49:0/2266461353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f576c14ba60 0x7f576c14e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:35.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.585+0000 7f576a7fc700 1 --2- 172.21.15.49:0/2266461353 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f576c1544d0 0x7f576c155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:35.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.585+0000 7f576affd700 1 -- 172.21.15.49:0/2266461353 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f576c1544d0 msgr2=0x7f576c155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:35.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.585+0000 7f576affd700 1 --2- 172.21.15.49:0/2266461353 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f576c1544d0 0x7f576c155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:35.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.585+0000 7f576affd700 1 -- 172.21.15.49:0/2266461353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f576c14ba60 msgr2=0x7f576c14e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:35.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.585+0000 7f576affd700 1 --2- 172.21.15.49:0/2266461353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f576c14ba60 0x7f576c14e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:35.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.585+0000 7f576affd700 1 -- 172.21.15.49:0/2266461353 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5754009370 con 0x7f576c066f40 2023-11-30T18:22:35.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.585+0000 7f576b7fe700 1 --2- 172.21.15.49:0/2266461353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f576c14ba60 0x7f576c14e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:22:35.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.585+0000 7f576a7fc700 1 --2- 172.21.15.49:0/2266461353 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f576c1544d0 0x7f576c155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:22:35.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.585+0000 7f576affd700 1 --2- 172.21.15.49:0/2266461353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f576c066f40 0x7f576c14b250 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f575c00c880 tx=0x7f575c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:35.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.585+0000 7f5762ffd700 1 -- 172.21.15.49:0/2266461353 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c010580 con 0x7f576c066f40 2023-11-30T18:22:35.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.585+0000 7f5762ffd700 1 -- 172.21.15.49:0/2266461353 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575c0106e0 con 0x7f576c066f40 2023-11-30T18:22:35.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.585+0000 7f577133f700 1 -- 172.21.15.49:0/2266461353 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f576c1523a0 con 0x7f576c066f40 2023-11-30T18:22:35.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.585+0000 7f5762ffd700 1 -- 172.21.15.49:0/2266461353 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c010a60 con 0x7f576c066f40 2023-11-30T18:22:35.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.585+0000 7f577133f700 1 -- 172.21.15.49:0/2266461353 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f576c14b740 con 0x7f576c066f40 2023-11-30T18:22:35.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.586+0000 7f577133f700 1 -- 172.21.15.49:0/2266461353 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f576c06c860 con 0x7f576c066f40 2023-11-30T18:22:35.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.587+0000 7f5762ffd700 1 -- 172.21.15.49:0/2266461353 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 68) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f575c01a410 con 0x7f576c066f40 2023-11-30T18:22:35.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.587+0000 7f5762ffd700 1 --2- 172.21.15.49:0/2266461353 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f574c05f270 0x7f574c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:35.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.587+0000 7f5762ffd700 1 -- 172.21.15.49:0/2266461353 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5325+0+0 (secure 0 0 0) 0x7f575c079b30 con 0x7f576c066f40 2023-11-30T18:22:35.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.587+0000 7f576a7fc700 1 --2- 172.21.15.49:0/2266461353 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f574c05f270 0x7f574c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:35.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.588+0000 7f576a7fc700 1 --2- 172.21.15.49:0/2266461353 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f574c05f270 0x7f574c061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f5754009130 tx=0x7f5754017000).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:35.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.591+0000 7f5762ffd700 1 -- 172.21.15.49:0/2266461353 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f575c04af40 con 0x7f576c066f40 2023-11-30T18:22:35.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.764+0000 7f577133f700 1 -- 172.21.15.49:0/2266461353 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f576c0680f0 con 0x7f576c066f40 2023-11-30T18:22:35.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.765+0000 7f5762ffd700 1 -- 172.21.15.49:0/2266461353 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) v1 ==== 74+0+13811 (secure 0 0 0) 0x7f575c04e560 con 0x7f576c066f40 2023-11-30T18:22:35.766 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:22:35.766 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":165,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:22:35.013655+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:22:35.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.767+0000 7f577133f700 1 -- 172.21.15.49:0/2266461353 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f574c05f270 msgr2=0x7f574c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:35.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.767+0000 7f577133f700 1 --2- 172.21.15.49:0/2266461353 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f574c05f270 0x7f574c061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f5754009130 tx=0x7f5754017000).stop 2023-11-30T18:22:35.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.767+0000 7f577133f700 1 -- 172.21.15.49:0/2266461353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f576c066f40 msgr2=0x7f576c14b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:35.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.767+0000 7f577133f700 1 --2- 172.21.15.49:0/2266461353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f576c066f40 0x7f576c14b250 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f575c00c880 tx=0x7f575c008040).stop 2023-11-30T18:22:35.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.767+0000 7f577133f700 1 -- 172.21.15.49:0/2266461353 shutdown_connections 2023-11-30T18:22:35.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.767+0000 7f577133f700 1 --2- 172.21.15.49:0/2266461353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f576c14ba60 0x7f576c14e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:35.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.767+0000 7f577133f700 1 --2- 172.21.15.49:0/2266461353 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f574c05f270 0x7f574c061730 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:35.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.767+0000 7f577133f700 1 --2- 172.21.15.49:0/2266461353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f576c066f40 0x7f576c14b250 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:35.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.767+0000 7f577133f700 1 --2- 172.21.15.49:0/2266461353 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f576c1544d0 0x7f576c155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:35.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.767+0000 7f577133f700 1 -- 172.21.15.49:0/2266461353 >> 172.21.15.49:0/2266461353 conn(0x7f576c0631d0 msgr2=0x7f576c064a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:35.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.767+0000 7f577133f700 1 -- 172.21.15.49:0/2266461353 shutdown_connections 2023-11-30T18:22:35.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.767+0000 7f577133f700 1 -- 172.21.15.49:0/2266461353 wait complete. 2023-11-30T18:22:35.780 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '158', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-11-30T18:22:35.781 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T18:22:35.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.901+0000 7f43612fb700 1 Processor -- start 2023-11-30T18:22:35.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.901+0000 7f43612fb700 1 -- start start 2023-11-30T18:22:35.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.902+0000 7f43612fb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f435c154270 0x7f435c0c6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:35.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.902+0000 7f43612fb700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f435c154650 0x7f435c157f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:35.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.902+0000 7f43612fb700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f435c0c9730 con 0x7f435c0aa060 2023-11-30T18:22:35.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.902+0000 7f43612fb700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f435c0c99f0 con 0x7f435c154650 2023-11-30T18:22:35.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.902+0000 7f43612fb700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435c0c6b40 con 0x7f435c154270 2023-11-30T18:22:35.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.902+0000 7f435a7fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f435c154650 0x7f435c157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:35.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.902+0000 7f435a7fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f435c154650 0x7f435c157f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52488/0 (socket says 172.21.15.49:52488) 2023-11-30T18:22:35.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.902+0000 7f435a7fc700 1 -- 172.21.15.49:0/768378475 learned_addr learned my addr 172.21.15.49:0/768378475 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:35.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.902+0000 7f435affd700 1 --2- 172.21.15.49:0/768378475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f435c154270 0x7f435c0c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:35.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.902+0000 7f435a7fc700 1 -- 172.21.15.49:0/768378475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f435c154270 msgr2=0x7f435c0c6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:35.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.902+0000 7f435a7fc700 1 --2- 172.21.15.49:0/768378475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f435c154270 0x7f435c0c6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:35.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.902+0000 7f435a7fc700 1 -- 172.21.15.49:0/768378475 >> v1:172.21.15.115:6789/0 conn(0x7f435c0aa060 legacy=0x7f435c0aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:35.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.902+0000 7f435a7fc700 1 -- 172.21.15.49:0/768378475 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435c158450 con 0x7f435c154650 2023-11-30T18:22:35.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.902+0000 7f435affd700 1 --2- 172.21.15.49:0/768378475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f435c154270 0x7f435c0c6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:22:35.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.903+0000 7f435a7fc700 1 --2- 172.21.15.49:0/768378475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f435c154650 0x7f435c157f60 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7f4350006fd0 tx=0x7f43500090f0).ready entity=mon.0 client_cookie=5e7750b95ccda99e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:35.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.903+0000 7f4359ffb700 1 -- 172.21.15.49:0/768378475 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435000b600 con 0x7f435c154650 2023-11-30T18:22:35.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.903+0000 7f4359ffb700 1 -- 172.21.15.49:0/768378475 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435000b760 con 0x7f435c154650 2023-11-30T18:22:35.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.903+0000 7f4359ffb700 1 -- 172.21.15.49:0/768378475 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435000bb00 con 0x7f435c154650 2023-11-30T18:22:35.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.903+0000 7f43612fb700 1 -- 172.21.15.49:0/768378475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f435c154650 msgr2=0x7f435c157f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:35.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.903+0000 7f43612fb700 1 --2- 172.21.15.49:0/768378475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f435c154650 0x7f435c157f60 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7f4350006fd0 tx=0x7f43500090f0).stop 2023-11-30T18:22:35.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.903+0000 7f43612fb700 1 -- 172.21.15.49:0/768378475 shutdown_connections 2023-11-30T18:22:35.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.903+0000 7f43612fb700 1 --2- 172.21.15.49:0/768378475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f435c154270 0x7f435c0c6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:35.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.903+0000 7f43612fb700 1 --2- 172.21.15.49:0/768378475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f435c154650 0x7f435c157f60 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:35.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.903+0000 7f43612fb700 1 -- 172.21.15.49:0/768378475 >> 172.21.15.49:0/768378475 conn(0x7f435c0649b0 msgr2=0x7f435c064dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:35.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.903+0000 7f43612fb700 1 -- 172.21.15.49:0/768378475 shutdown_connections 2023-11-30T18:22:35.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.903+0000 7f43612fb700 1 -- 172.21.15.49:0/768378475 wait complete. 2023-11-30T18:22:35.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.904+0000 7f43612fb700 1 Processor -- start 2023-11-30T18:22:35.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.904+0000 7f43612fb700 1 -- start start 2023-11-30T18:22:35.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.905+0000 7f43612fb700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f435c0aa060 0x7f435c141ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:35.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.905+0000 7f43612fb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f435c154270 0x7f435c0c2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:35.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.905+0000 7f43612fb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f435c154650 0x7f435c0c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:35.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.905+0000 7f43612fb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c156d10 con 0x7f435c154650 2023-11-30T18:22:35.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.905+0000 7f43612fb700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c156ff0 con 0x7f435c0aa060 2023-11-30T18:22:35.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.905+0000 7f43612fb700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435c1572d0 con 0x7f435c154270 2023-11-30T18:22:35.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.905+0000 7f435b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f435c154650 0x7f435c0c3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:35.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.905+0000 7f435b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f435c154650 0x7f435c0c3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52492/0 (socket says 172.21.15.49:52492) 2023-11-30T18:22:35.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.905+0000 7f435b7fe700 1 -- 172.21.15.49:0/3562444827 learned_addr learned my addr 172.21.15.49:0/3562444827 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:35.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.905+0000 7f435a7fc700 1 --2- 172.21.15.49:0/3562444827 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f435c154270 0x7f435c0c2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:35.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.906+0000 7f435affd700 1 --2- 172.21.15.49:0/3562444827 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f435c0aa060 0x7f435c141ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:35.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.906+0000 7f435b7fe700 1 -- 172.21.15.49:0/3562444827 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f435c154270 msgr2=0x7f435c0c2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:35.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.906+0000 7f435b7fe700 1 --2- 172.21.15.49:0/3562444827 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f435c154270 0x7f435c0c2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:35.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.906+0000 7f435b7fe700 1 -- 172.21.15.49:0/3562444827 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f435c0aa060 msgr2=0x7f435c141ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:35.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.906+0000 7f435b7fe700 1 --2- 172.21.15.49:0/3562444827 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f435c0aa060 0x7f435c141ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:35.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.906+0000 7f435b7fe700 1 -- 172.21.15.49:0/3562444827 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4350009370 con 0x7f435c154650 2023-11-30T18:22:35.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.906+0000 7f435affd700 1 --2- 172.21.15.49:0/3562444827 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f435c0aa060 0x7f435c141ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:22:35.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.906+0000 7f435b7fe700 1 --2- 172.21.15.49:0/3562444827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f435c154650 0x7f435c0c3d50 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7f4354002230 tx=0x7f43540015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:35.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.906+0000 7f4342ffd700 1 -- 172.21.15.49:0/3562444827 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4354010510 con 0x7f435c154650 2023-11-30T18:22:35.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.906+0000 7f4342ffd700 1 -- 172.21.15.49:0/3562444827 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4354010670 con 0x7f435c154650 2023-11-30T18:22:35.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.906+0000 7f43612fb700 1 -- 172.21.15.49:0/3562444827 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f435c0aeaa0 con 0x7f435c154650 2023-11-30T18:22:35.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.906+0000 7f4342ffd700 1 -- 172.21.15.49:0/3562444827 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43540109f0 con 0x7f435c154650 2023-11-30T18:22:35.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.906+0000 7f43612fb700 1 -- 172.21.15.49:0/3562444827 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435c164430 con 0x7f435c154650 2023-11-30T18:22:35.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.907+0000 7f43612fb700 1 -- 172.21.15.49:0/3562444827 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f435c062f00 con 0x7f435c154650 2023-11-30T18:22:35.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.907+0000 7f4342ffd700 1 -- 172.21.15.49:0/3562444827 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 68) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f435401b400 con 0x7f435c154650 2023-11-30T18:22:35.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.908+0000 7f4342ffd700 1 --2- 172.21.15.49:0/3562444827 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f434805f270 0x7f4348061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:35.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.908+0000 7f4342ffd700 1 -- 172.21.15.49:0/3562444827 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5325+0+0 (secure 0 0 0) 0x7f4354079ea0 con 0x7f435c154650 2023-11-30T18:22:35.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.908+0000 7f435affd700 1 --2- 172.21.15.49:0/3562444827 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f434805f270 0x7f4348061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:35.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.908+0000 7f435affd700 1 --2- 172.21.15.49:0/3562444827 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f434805f270 0x7f4348061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f434c006fd0 tx=0x7f434c008040).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:35.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:35.912+0000 7f4342ffd700 1 -- 172.21.15.49:0/3562444827 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f435404b2b0 con 0x7f435c154650 2023-11-30T18:22:36.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.083+0000 7f43612fb700 1 -- 172.21.15.49:0/3562444827 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f435c06c7c0 con 0x7f435c154650 2023-11-30T18:22:36.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.084+0000 7f4342ffd700 1 -- 172.21.15.49:0/3562444827 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v165) v1 ==== 110+0+10 (secure 0 0 0) 0x7f435404e8d0 con 0x7f435c154650 2023-11-30T18:22:36.085 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T18:22:36.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.085+0000 7f43612fb700 1 -- 172.21.15.49:0/3562444827 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f434805f270 msgr2=0x7f4348061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:36.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.085+0000 7f43612fb700 1 --2- 172.21.15.49:0/3562444827 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f434805f270 0x7f4348061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f434c006fd0 tx=0x7f434c008040).stop 2023-11-30T18:22:36.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.085+0000 7f43612fb700 1 -- 172.21.15.49:0/3562444827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f435c154650 msgr2=0x7f435c0c3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:36.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.085+0000 7f43612fb700 1 --2- 172.21.15.49:0/3562444827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f435c154650 0x7f435c0c3d50 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7f4354002230 tx=0x7f43540015e0).stop 2023-11-30T18:22:36.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.086+0000 7f43612fb700 1 -- 172.21.15.49:0/3562444827 shutdown_connections 2023-11-30T18:22:36.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.086+0000 7f43612fb700 1 --2- 172.21.15.49:0/3562444827 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f434805f270 0x7f4348061730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:36.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.086+0000 7f43612fb700 1 --2- 172.21.15.49:0/3562444827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f435c154650 0x7f435c0c3d50 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:36.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.086+0000 7f43612fb700 1 --2- 172.21.15.49:0/3562444827 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f435c0aa060 0x7f435c141ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:36.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.086+0000 7f43612fb700 1 --2- 172.21.15.49:0/3562444827 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f435c154270 0x7f435c0c2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:36.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.086+0000 7f43612fb700 1 -- 172.21.15.49:0/3562444827 >> 172.21.15.49:0/3562444827 conn(0x7f435c0649b0 msgr2=0x7f435c14da10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:36.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.086+0000 7f43612fb700 1 -- 172.21.15.49:0/3562444827 shutdown_connections 2023-11-30T18:22:36.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.086+0000 7f43612fb700 1 -- 172.21.15.49:0/3562444827 wait complete. 2023-11-30T18:22:36.099 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T18:22:36.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.218+0000 7f376234e700 1 Processor -- start 2023-11-30T18:22:36.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.218+0000 7f376234e700 1 -- start start 2023-11-30T18:22:36.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.219+0000 7f376234e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f375c14eb00 0x7f375c14eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:36.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.219+0000 7f376234e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f375c062e80 0x7f375c0bcb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:36.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.219+0000 7f376234e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f375c0bd060 con 0x7f375c0bc6c0 2023-11-30T18:22:36.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.219+0000 7f376234e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f375c137d90 con 0x7f375c14eb00 2023-11-30T18:22:36.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.219+0000 7f376234e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f375c0634a0 con 0x7f375c062e80 2023-11-30T18:22:36.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.219+0000 7f375bfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f375c14eb00 0x7f375c14eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:36.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.219+0000 7f375bfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f375c14eb00 0x7f375c14eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52504/0 (socket says 172.21.15.49:52504) 2023-11-30T18:22:36.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.219+0000 7f375b7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f375c0bc6c0 0x7f375c062770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42118/0 (socket says 172.21.15.49:42118) 2023-11-30T18:22:36.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.219+0000 7f375bfff700 1 -- 172.21.15.49:0/2126449697 learned_addr learned my addr 172.21.15.49:0/2126449697 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:36.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.219+0000 7f37608eb700 1 --2- 172.21.15.49:0/2126449697 >> v2:172.21.15.115:3300/0 conn(0x7f375c062e80 0x7f375c0bcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:36.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.219+0000 7f375bfff700 1 -- 172.21.15.49:0/2126449697 >> v2:172.21.15.115:3300/0 conn(0x7f375c062e80 msgr2=0x7f375c0bcb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:36.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.219+0000 7f375bfff700 1 --2- 172.21.15.49:0/2126449697 >> v2:172.21.15.115:3300/0 conn(0x7f375c062e80 0x7f375c0bcb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:36.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.219+0000 7f375bfff700 1 -- 172.21.15.49:0/2126449697 >> v1:172.21.15.49:6789/0 conn(0x7f375c0bc6c0 legacy=0x7f375c062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:36.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.219+0000 7f375affd700 1 -- 172.21.15.49:0/2126449697 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 501744372 0 0) 0x7f37500011d0 con 0x7f375c0bc6c0 2023-11-30T18:22:36.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.219+0000 7f375bfff700 1 -- 172.21.15.49:0/2126449697 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375c063780 con 0x7f375c14eb00 2023-11-30T18:22:36.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.220+0000 7f375bfff700 1 --2- 172.21.15.49:0/2126449697 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f375c14eb00 0x7f375c14eee0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7f375c13b080 tx=0x7f374c009060).ready entity=mon.0 client_cookie=5b45326ecad45c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:36.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.220+0000 7f375affd700 1 -- 172.21.15.49:0/2126449697 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c005880 con 0x7f375c14eb00 2023-11-30T18:22:36.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.220+0000 7f375affd700 1 -- 172.21.15.49:0/2126449697 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374c0059e0 con 0x7f375c14eb00 2023-11-30T18:22:36.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.220+0000 7f375affd700 1 -- 172.21.15.49:0/2126449697 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c005d60 con 0x7f375c14eb00 2023-11-30T18:22:36.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.220+0000 7f376234e700 1 -- 172.21.15.49:0/2126449697 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f375c14eb00 msgr2=0x7f375c14eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:36.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.220+0000 7f376234e700 1 --2- 172.21.15.49:0/2126449697 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f375c14eb00 0x7f375c14eee0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7f375c13b080 tx=0x7f374c009060).stop 2023-11-30T18:22:36.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.220+0000 7f376234e700 1 -- 172.21.15.49:0/2126449697 shutdown_connections 2023-11-30T18:22:36.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.220+0000 7f376234e700 1 --2- 172.21.15.49:0/2126449697 >> v2:172.21.15.115:3300/0 conn(0x7f375c062e80 0x7f375c0bcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:36.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.220+0000 7f376234e700 1 --2- 172.21.15.49:0/2126449697 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f375c14eb00 0x7f375c14eee0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:36.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.220+0000 7f376234e700 1 -- 172.21.15.49:0/2126449697 >> 172.21.15.49:0/2126449697 conn(0x7f375c0c8230 msgr2=0x7f375c0c4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:36.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.220+0000 7f376234e700 1 -- 172.21.15.49:0/2126449697 shutdown_connections 2023-11-30T18:22:36.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.220+0000 7f376234e700 1 -- 172.21.15.49:0/2126449697 wait complete. 2023-11-30T18:22:36.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.221+0000 7f376234e700 1 Processor -- start 2023-11-30T18:22:36.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.222+0000 7f376234e700 1 -- start start 2023-11-30T18:22:36.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.222+0000 7f376234e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f375c062e80 0x7f375c0c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:36.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.222+0000 7f376234e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f375c0bc6c0 0x7f375c14fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:36.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.222+0000 7f376234e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f375c14eb00 0x7f375c150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:36.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.222+0000 7f376234e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c150780 con 0x7f375c14eb00 2023-11-30T18:22:36.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.222+0000 7f376234e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c135720 con 0x7f375c062e80 2023-11-30T18:22:36.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.222+0000 7f376234e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375c134df0 con 0x7f375c0bc6c0 2023-11-30T18:22:36.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.222+0000 7f37608eb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f375c14eb00 0x7f375c150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:36.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.222+0000 7f37608eb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f375c14eb00 0x7f375c150170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52514/0 (socket says 172.21.15.49:52514) 2023-11-30T18:22:36.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.222+0000 7f37608eb700 1 -- 172.21.15.49:0/4226962055 learned_addr learned my addr 172.21.15.49:0/4226962055 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:36.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.223+0000 7f375bfff700 1 --2- 172.21.15.49:0/4226962055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f375c062e80 0x7f375c0c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:36.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.223+0000 7f375b7fe700 1 --2- 172.21.15.49:0/4226962055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f375c0bc6c0 0x7f375c14fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:36.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.223+0000 7f37608eb700 1 -- 172.21.15.49:0/4226962055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f375c0bc6c0 msgr2=0x7f375c14fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:36.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.223+0000 7f37608eb700 1 --2- 172.21.15.49:0/4226962055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f375c0bc6c0 0x7f375c14fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:36.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.223+0000 7f37608eb700 1 -- 172.21.15.49:0/4226962055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f375c062e80 msgr2=0x7f375c0c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:36.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.223+0000 7f37608eb700 1 --2- 172.21.15.49:0/4226962055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f375c062e80 0x7f375c0c31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:36.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.223+0000 7f37608eb700 1 -- 172.21.15.49:0/4226962055 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374c009300 con 0x7f375c14eb00 2023-11-30T18:22:36.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.223+0000 7f375bfff700 1 --2- 172.21.15.49:0/4226962055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f375c062e80 0x7f375c0c31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:22:36.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.223+0000 7f37608eb700 1 --2- 172.21.15.49:0/4226962055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f375c14eb00 0x7f375c150170 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7f3754009df0 tx=0x7f375400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:36.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.223+0000 7f3743fff700 1 -- 172.21.15.49:0/4226962055 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375400cb50 con 0x7f375c14eb00 2023-11-30T18:22:36.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.223+0000 7f3743fff700 1 -- 172.21.15.49:0/4226962055 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375400f040 con 0x7f375c14eb00 2023-11-30T18:22:36.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.223+0000 7f376234e700 1 -- 172.21.15.49:0/4226962055 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f375c1350d0 con 0x7f375c14eb00 2023-11-30T18:22:36.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.223+0000 7f3743fff700 1 -- 172.21.15.49:0/4226962055 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375400cec0 con 0x7f375c14eb00 2023-11-30T18:22:36.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.223+0000 7f376234e700 1 -- 172.21.15.49:0/4226962055 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375c137440 con 0x7f375c14eb00 2023-11-30T18:22:36.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.224+0000 7f376234e700 1 -- 172.21.15.49:0/4226962055 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f375c1358d0 con 0x7f375c14eb00 2023-11-30T18:22:36.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.225+0000 7f3743fff700 1 -- 172.21.15.49:0/4226962055 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 68) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f3754013610 con 0x7f375c14eb00 2023-11-30T18:22:36.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.225+0000 7f3743fff700 1 --2- 172.21.15.49:0/4226962055 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f374805f270 0x7f3748061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:36.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.225+0000 7f3743fff700 1 -- 172.21.15.49:0/4226962055 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5325+0+0 (secure 0 0 0) 0x7f375407a8b0 con 0x7f375c14eb00 2023-11-30T18:22:36.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.225+0000 7f375bfff700 1 --2- 172.21.15.49:0/4226962055 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f374805f270 0x7f3748061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:36.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.226+0000 7f375bfff700 1 --2- 172.21.15.49:0/4226962055 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f374805f270 0x7f3748061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f374c00b340 tx=0x7f374c016000).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:36.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.229+0000 7f3743fff700 1 -- 172.21.15.49:0/4226962055 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f375c1358d0 con 0x7f375c14eb00 2023-11-30T18:22:36.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.402+0000 7f376234e700 1 -- 172.21.15.49:0/4226962055 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f375c135890 con 0x7f375c14eb00 2023-11-30T18:22:36.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.403+0000 7f3743fff700 1 -- 172.21.15.49:0/4226962055 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v165) v1 ==== 92+0+10 (secure 0 0 0) 0x7f375404bd20 con 0x7f375c14eb00 2023-11-30T18:22:36.404 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T18:22:36.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.404+0000 7f376234e700 1 -- 172.21.15.49:0/4226962055 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f374805f270 msgr2=0x7f3748061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:36.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.404+0000 7f376234e700 1 --2- 172.21.15.49:0/4226962055 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f374805f270 0x7f3748061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f374c00b340 tx=0x7f374c016000).stop 2023-11-30T18:22:36.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.404+0000 7f376234e700 1 -- 172.21.15.49:0/4226962055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f375c14eb00 msgr2=0x7f375c150170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:36.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.404+0000 7f376234e700 1 --2- 172.21.15.49:0/4226962055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f375c14eb00 0x7f375c150170 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7f3754009df0 tx=0x7f375400b040).stop 2023-11-30T18:22:36.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.404+0000 7f376234e700 1 -- 172.21.15.49:0/4226962055 shutdown_connections 2023-11-30T18:22:36.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.404+0000 7f376234e700 1 --2- 172.21.15.49:0/4226962055 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f374805f270 0x7f3748061730 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:36.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.404+0000 7f376234e700 1 --2- 172.21.15.49:0/4226962055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f375c14eb00 0x7f375c150170 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:36.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.404+0000 7f376234e700 1 --2- 172.21.15.49:0/4226962055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f375c062e80 0x7f375c0c31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:36.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.404+0000 7f376234e700 1 --2- 172.21.15.49:0/4226962055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f375c0bc6c0 0x7f375c14fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:36.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.404+0000 7f376234e700 1 -- 172.21.15.49:0/4226962055 >> 172.21.15.49:0/4226962055 conn(0x7f375c0c8230 msgr2=0x7f375c139b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:36.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.405+0000 7f376234e700 1 -- 172.21.15.49:0/4226962055 shutdown_connections 2023-11-30T18:22:36.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.405+0000 7f376234e700 1 -- 172.21.15.49:0/4226962055 wait complete. 2023-11-30T18:22:36.417 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-30T18:22:36.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.535+0000 7f1e41f9e700 1 Processor -- start 2023-11-30T18:22:36.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.535+0000 7f1e41f9e700 1 -- start start 2023-11-30T18:22:36.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.536+0000 7f1e41f9e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1e3c1544e0 0x7f1e3c1548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:36.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.536+0000 7f1e41f9e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e3c06a610 0x7f1e3c0c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:36.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.536+0000 7f1e41f9e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e3c0c69a0 con 0x7f1e3c0c6e30 2023-11-30T18:22:36.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.536+0000 7f1e41f9e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e3c0c13a0 con 0x7f1e3c1544e0 2023-11-30T18:22:36.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.536+0000 7f1e41f9e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c0c1680 con 0x7f1e3c06a610 2023-11-30T18:22:36.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.536+0000 7f1e3b7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1e3c1544e0 0x7f1e3c1548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:36.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.536+0000 7f1e3b7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1e3c1544e0 0x7f1e3c1548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52524/0 (socket says 172.21.15.49:52524) 2023-11-30T18:22:36.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.536+0000 7f1e3b7fe700 1 -- 172.21.15.49:0/4035072654 learned_addr learned my addr 172.21.15.49:0/4035072654 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:36.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.536+0000 7f1e3affd700 1 --2- 172.21.15.49:0/4035072654 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e3c06a610 0x7f1e3c0c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:36.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.536+0000 7f1e3b7fe700 1 -- 172.21.15.49:0/4035072654 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e3c06a610 msgr2=0x7f1e3c0c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:36.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.536+0000 7f1e3b7fe700 1 --2- 172.21.15.49:0/4035072654 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e3c06a610 0x7f1e3c0c0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:36.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.536+0000 7f1e3b7fe700 1 -- 172.21.15.49:0/4035072654 >> v1:172.21.15.115:6789/0 conn(0x7f1e3c0c6e30 legacy=0x7f1e3c0a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:36.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.536+0000 7f1e3b7fe700 1 -- 172.21.15.49:0/4035072654 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3c0c6630 con 0x7f1e3c1544e0 2023-11-30T18:22:36.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.536+0000 7f1e3b7fe700 1 --2- 172.21.15.49:0/4035072654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e3c1544e0 0x7f1e3c1548c0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7f1e2c009810 tx=0x7f1e2c009060).ready entity=mon.0 client_cookie=ff748aecfacb47ad server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:36.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.537+0000 7f1e3a7fc700 1 -- 172.21.15.49:0/4035072654 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c005880 con 0x7f1e3c1544e0 2023-11-30T18:22:36.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.537+0000 7f1e3a7fc700 1 -- 172.21.15.49:0/4035072654 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2c0059e0 con 0x7f1e3c1544e0 2023-11-30T18:22:36.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.537+0000 7f1e3a7fc700 1 -- 172.21.15.49:0/4035072654 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c005d60 con 0x7f1e3c1544e0 2023-11-30T18:22:36.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.537+0000 7f1e41f9e700 1 -- 172.21.15.49:0/4035072654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e3c1544e0 msgr2=0x7f1e3c1548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:36.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.537+0000 7f1e41f9e700 1 --2- 172.21.15.49:0/4035072654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e3c1544e0 0x7f1e3c1548c0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7f1e2c009810 tx=0x7f1e2c009060).stop 2023-11-30T18:22:36.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.537+0000 7f1e41f9e700 1 -- 172.21.15.49:0/4035072654 shutdown_connections 2023-11-30T18:22:36.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.537+0000 7f1e41f9e700 1 --2- 172.21.15.49:0/4035072654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e3c1544e0 0x7f1e3c1548c0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:36.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.537+0000 7f1e41f9e700 1 --2- 172.21.15.49:0/4035072654 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e3c06a610 0x7f1e3c0c0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:36.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.537+0000 7f1e41f9e700 1 -- 172.21.15.49:0/4035072654 >> 172.21.15.49:0/4035072654 conn(0x7f1e3c085020 msgr2=0x7f1e3c094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:36.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.537+0000 7f1e41f9e700 1 -- 172.21.15.49:0/4035072654 shutdown_connections 2023-11-30T18:22:36.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.537+0000 7f1e41f9e700 1 -- 172.21.15.49:0/4035072654 wait complete. 2023-11-30T18:22:36.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.538+0000 7f1e41f9e700 1 Processor -- start 2023-11-30T18:22:36.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.538+0000 7f1e41f9e700 1 -- start start 2023-11-30T18:22:36.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.539+0000 7f1e41f9e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e3c06a610 0x7f1e3c0cb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:36.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.539+0000 7f1e41f9e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e3c0c6e30 0x7f1e3c096be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:36.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.539+0000 7f1e41f9e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e3c1544e0 0x7f1e3c144ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:36.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.539+0000 7f1e41f9e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c0cb600 con 0x7f1e3c1544e0 2023-11-30T18:22:36.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.539+0000 7f1e41f9e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c0970d0 con 0x7f1e3c0c6e30 2023-11-30T18:22:36.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.539+0000 7f1e41f9e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c0cc0b0 con 0x7f1e3c06a610 2023-11-30T18:22:36.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.539+0000 7f1e3bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e3c1544e0 0x7f1e3c144ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:36.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.539+0000 7f1e3bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e3c1544e0 0x7f1e3c144ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52536/0 (socket says 172.21.15.49:52536) 2023-11-30T18:22:36.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.539+0000 7f1e3bfff700 1 -- 172.21.15.49:0/1650405908 learned_addr learned my addr 172.21.15.49:0/1650405908 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:36.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.539+0000 7f1e3affd700 1 --2- 172.21.15.49:0/1650405908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e3c0c6e30 0x7f1e3c096be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:36.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.540+0000 7f1e3b7fe700 1 --2- 172.21.15.49:0/1650405908 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e3c06a610 0x7f1e3c0cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:36.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.540+0000 7f1e3bfff700 1 -- 172.21.15.49:0/1650405908 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e3c06a610 msgr2=0x7f1e3c0cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:36.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.540+0000 7f1e3bfff700 1 --2- 172.21.15.49:0/1650405908 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e3c06a610 0x7f1e3c0cb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:36.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.540+0000 7f1e3bfff700 1 -- 172.21.15.49:0/1650405908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e3c0c6e30 msgr2=0x7f1e3c096be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:36.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.540+0000 7f1e3bfff700 1 --2- 172.21.15.49:0/1650405908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e3c0c6e30 0x7f1e3c096be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:36.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.540+0000 7f1e3bfff700 1 -- 172.21.15.49:0/1650405908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2c009300 con 0x7f1e3c1544e0 2023-11-30T18:22:36.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.540+0000 7f1e3bfff700 1 --2- 172.21.15.49:0/1650405908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e3c1544e0 0x7f1e3c144ec0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f1e3400c7c0 tx=0x7f1e34001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:36.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.540+0000 7f1e237fe700 1 -- 172.21.15.49:0/1650405908 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3400e4a0 con 0x7f1e3c1544e0 2023-11-30T18:22:36.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.540+0000 7f1e237fe700 1 -- 172.21.15.49:0/1650405908 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3400e600 con 0x7f1e3c1544e0 2023-11-30T18:22:36.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.540+0000 7f1e41f9e700 1 -- 172.21.15.49:0/1650405908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3c165090 con 0x7f1e3c1544e0 2023-11-30T18:22:36.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.540+0000 7f1e237fe700 1 -- 172.21.15.49:0/1650405908 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3400e980 con 0x7f1e3c1544e0 2023-11-30T18:22:36.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.540+0000 7f1e41f9e700 1 -- 172.21.15.49:0/1650405908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e3c0cbaf0 con 0x7f1e3c1544e0 2023-11-30T18:22:36.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.541+0000 7f1e41f9e700 1 -- 172.21.15.49:0/1650405908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e3c165220 con 0x7f1e3c1544e0 2023-11-30T18:22:36.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.541+0000 7f1e237fe700 1 -- 172.21.15.49:0/1650405908 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 68) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f1e34012400 con 0x7f1e3c1544e0 2023-11-30T18:22:36.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.542+0000 7f1e237fe700 1 --2- 172.21.15.49:0/1650405908 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1e2805f270 0x7f1e28061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:36.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.542+0000 7f1e237fe700 1 -- 172.21.15.49:0/1650405908 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5325+0+0 (secure 0 0 0) 0x7f1e340796c0 con 0x7f1e3c1544e0 2023-11-30T18:22:36.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.542+0000 7f1e3b7fe700 1 --2- 172.21.15.49:0/1650405908 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1e2805f270 0x7f1e28061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:36.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.542+0000 7f1e3b7fe700 1 --2- 172.21.15.49:0/1650405908 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1e2805f270 0x7f1e28061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f1e2c009fd0 tx=0x7f1e2c016000).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:36.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.546+0000 7f1e237fe700 1 -- 172.21.15.49:0/1650405908 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1e34048b00 con 0x7f1e3c1544e0 2023-11-30T18:22:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.721+0000 7f1e41f9e700 1 -- 172.21.15.49:0/1650405908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1e3c06c860 con 0x7f1e3c1544e0 2023-11-30T18:22:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.722+0000 7f1e237fe700 1 -- 172.21.15.49:0/1650405908 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v165) v1 ==== 84+0+143 (secure 0 0 0) 0x7f1e34017070 con 0x7f1e3c1544e0 2023-11-30T18:22:36.723 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:22:36.723 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-11-30T18:22:36.723 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:22:36.723 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2023-11-30T18:22:36.723 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "device_health_metrics" 2023-11-30T18:22:36.723 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:22:36.723 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:22:36.723 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 2, 2023-11-30T18:22:36.723 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "rbd" 2023-11-30T18:22:36.723 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:22:36.723 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-11-30T18:22:36.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.723+0000 7f1e41f9e700 1 -- 172.21.15.49:0/1650405908 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1e2805f270 msgr2=0x7f1e28061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:36.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.723+0000 7f1e41f9e700 1 --2- 172.21.15.49:0/1650405908 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1e2805f270 0x7f1e28061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f1e2c009fd0 tx=0x7f1e2c016000).stop 2023-11-30T18:22:36.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.723+0000 7f1e41f9e700 1 -- 172.21.15.49:0/1650405908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e3c1544e0 msgr2=0x7f1e3c144ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.723+0000 7f1e41f9e700 1 --2- 172.21.15.49:0/1650405908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e3c1544e0 0x7f1e3c144ec0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f1e3400c7c0 tx=0x7f1e34001510).stop 2023-11-30T18:22:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.723+0000 7f1e41f9e700 1 -- 172.21.15.49:0/1650405908 shutdown_connections 2023-11-30T18:22:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.723+0000 7f1e41f9e700 1 --2- 172.21.15.49:0/1650405908 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f1e2805f270 0x7f1e28061730 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.723+0000 7f1e41f9e700 1 --2- 172.21.15.49:0/1650405908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e3c1544e0 0x7f1e3c144ec0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.723+0000 7f1e41f9e700 1 --2- 172.21.15.49:0/1650405908 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e3c06a610 0x7f1e3c0cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.723+0000 7f1e41f9e700 1 --2- 172.21.15.49:0/1650405908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e3c0c6e30 0x7f1e3c096be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.723+0000 7f1e41f9e700 1 -- 172.21.15.49:0/1650405908 >> 172.21.15.49:0/1650405908 conn(0x7f1e3c085020 msgr2=0x7f1e3c0c9070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.724+0000 7f1e41f9e700 1 -- 172.21.15.49:0/1650405908 shutdown_connections 2023-11-30T18:22:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.724+0000 7f1e41f9e700 1 -- 172.21.15.49:0/1650405908 wait complete. 2023-11-30T18:22:36.736 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-30T18:22:36.736 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-11-30T18:22:36.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.858+0000 7f17d4739700 1 Processor -- start 2023-11-30T18:22:36.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.858+0000 7f17d4739700 1 -- start start 2023-11-30T18:22:36.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.859+0000 7f17d4739700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f17cc1373a0 0x7f17cc0c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:36.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.859+0000 7f17d4739700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f17cc0c5f30 0x7f17cc0c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:36.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.859+0000 7f17d4739700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17cc0669a0 0x7f17cc066e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:36.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.859+0000 7f17d4739700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17cc0c68d0 con 0x7f17cc1373a0 2023-11-30T18:22:36.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.859+0000 7f17d4739700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17cc158e20 con 0x7f17cc0c5f30 2023-11-30T18:22:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.859+0000 7f17d4739700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc1582a0 con 0x7f17cc0669a0 2023-11-30T18:22:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.859+0000 7f17d24d5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f17cc1373a0 0x7f17cc0c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.859+0000 7f17d24d5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f17cc1373a0 0x7f17cc0c72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52550/0 (socket says 172.21.15.49:52550) 2023-11-30T18:22:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.859+0000 7f17d24d5700 1 -- 172.21.15.49:0/3859172346 learned_addr learned my addr 172.21.15.49:0/3859172346 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.859+0000 7f17d1cd4700 1 --2- 172.21.15.49:0/3859172346 >> v2:172.21.15.115:3300/0 conn(0x7f17cc0c5f30 0x7f17cc0c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.859+0000 7f17d2cd6700 1 --2- 172.21.15.49:0/3859172346 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17cc0669a0 0x7f17cc066e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.859+0000 7f17d24d5700 1 -- 172.21.15.49:0/3859172346 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17cc0669a0 msgr2=0x7f17cc066e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.859+0000 7f17d24d5700 1 --2- 172.21.15.49:0/3859172346 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17cc0669a0 0x7f17cc066e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.859+0000 7f17d24d5700 1 -- 172.21.15.49:0/3859172346 >> v2:172.21.15.115:3300/0 conn(0x7f17cc0c5f30 msgr2=0x7f17cc0c63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.859+0000 7f17d24d5700 1 --2- 172.21.15.49:0/3859172346 >> v2:172.21.15.115:3300/0 conn(0x7f17cc0c5f30 0x7f17cc0c63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.859+0000 7f17d24d5700 1 -- 172.21.15.49:0/3859172346 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17cc158580 con 0x7f17cc1373a0 2023-11-30T18:22:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.859+0000 7f17d2cd6700 1 --2- 172.21.15.49:0/3859172346 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17cc0669a0 0x7f17cc066e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:22:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.860+0000 7f17d24d5700 1 --2- 172.21.15.49:0/3859172346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17cc1373a0 0x7f17cc0c72e0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7f17cc069110 tx=0x7f17c4009840).ready entity=mon.0 client_cookie=fb8e155b6c03d31e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.860+0000 7f17d14d3700 1 -- 172.21.15.49:0/3859172346 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c400e070 con 0x7f17cc1373a0 2023-11-30T18:22:36.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.860+0000 7f17d14d3700 1 -- 172.21.15.49:0/3859172346 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c400ba20 con 0x7f17cc1373a0 2023-11-30T18:22:36.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.860+0000 7f17d14d3700 1 -- 172.21.15.49:0/3859172346 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c400bda0 con 0x7f17cc1373a0 2023-11-30T18:22:36.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.860+0000 7f17d4739700 1 -- 172.21.15.49:0/3859172346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17cc1373a0 msgr2=0x7f17cc0c72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:36.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.860+0000 7f17d4739700 1 --2- 172.21.15.49:0/3859172346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17cc1373a0 0x7f17cc0c72e0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7f17cc069110 tx=0x7f17c4009840).stop 2023-11-30T18:22:36.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.860+0000 7f17d4739700 1 -- 172.21.15.49:0/3859172346 shutdown_connections 2023-11-30T18:22:36.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.860+0000 7f17d4739700 1 --2- 172.21.15.49:0/3859172346 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17cc0669a0 0x7f17cc066e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:36.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.860+0000 7f17d4739700 1 --2- 172.21.15.49:0/3859172346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17cc1373a0 0x7f17cc0c72e0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:36.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.860+0000 7f17d4739700 1 --2- 172.21.15.49:0/3859172346 >> v2:172.21.15.115:3300/0 conn(0x7f17cc0c5f30 0x7f17cc0c63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:36.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.860+0000 7f17d4739700 1 -- 172.21.15.49:0/3859172346 >> 172.21.15.49:0/3859172346 conn(0x7f17cc0628f0 msgr2=0x7f17cc062d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:36.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.860+0000 7f17d4739700 1 -- 172.21.15.49:0/3859172346 shutdown_connections 2023-11-30T18:22:36.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.860+0000 7f17d4739700 1 -- 172.21.15.49:0/3859172346 wait complete. 2023-11-30T18:22:36.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.861+0000 7f17d4739700 1 Processor -- start 2023-11-30T18:22:36.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.861+0000 7f17d4739700 1 -- start start 2023-11-30T18:22:36.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.862+0000 7f17d4739700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17cc0669a0 0x7f17cc0aa270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:36.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.862+0000 7f17d4739700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17cc0c5f30 0x7f17cc1364d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:36.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.862+0000 7f17d4739700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17cc1373a0 0x7f17cc1369c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:36.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.862+0000 7f17d4739700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc136eb0 con 0x7f17cc0c5f30 2023-11-30T18:22:36.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.862+0000 7f17d4739700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc167e90 con 0x7f17cc1373a0 2023-11-30T18:22:36.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.862+0000 7f17d4739700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc1680e0 con 0x7f17cc0669a0 2023-11-30T18:22:36.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.862+0000 7f17d1cd4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17cc0c5f30 0x7f17cc1364d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:36.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.862+0000 7f17d1cd4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17cc0c5f30 0x7f17cc1364d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52560/0 (socket says 172.21.15.49:52560) 2023-11-30T18:22:36.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.862+0000 7f17d1cd4700 1 -- 172.21.15.49:0/3470881179 learned_addr learned my addr 172.21.15.49:0/3470881179 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:36.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.862+0000 7f17d2cd6700 1 --2- 172.21.15.49:0/3470881179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17cc1373a0 0x7f17cc1369c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:36.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.862+0000 7f17d24d5700 1 --2- 172.21.15.49:0/3470881179 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17cc0669a0 0x7f17cc0aa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:36.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.863+0000 7f17d1cd4700 1 -- 172.21.15.49:0/3470881179 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17cc0669a0 msgr2=0x7f17cc0aa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:36.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.863+0000 7f17d1cd4700 1 --2- 172.21.15.49:0/3470881179 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17cc0669a0 0x7f17cc0aa270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:36.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.863+0000 7f17d1cd4700 1 -- 172.21.15.49:0/3470881179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17cc1373a0 msgr2=0x7f17cc1369c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:36.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.863+0000 7f17d1cd4700 1 --2- 172.21.15.49:0/3470881179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17cc1373a0 0x7f17cc1369c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:36.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.863+0000 7f17d1cd4700 1 -- 172.21.15.49:0/3470881179 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c4009ae0 con 0x7f17cc0c5f30 2023-11-30T18:22:36.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.863+0000 7f17d2cd6700 1 --2- 172.21.15.49:0/3470881179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17cc1373a0 0x7f17cc1369c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:22:36.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.863+0000 7f17d1cd4700 1 --2- 172.21.15.49:0/3470881179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17cc0c5f30 0x7f17cc1364d0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7f17c000e930 tx=0x7f17c0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:36.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.863+0000 7f17ca7fc700 1 -- 172.21.15.49:0/3470881179 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c000eed0 con 0x7f17cc0c5f30 2023-11-30T18:22:36.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.863+0000 7f17ca7fc700 1 -- 172.21.15.49:0/3470881179 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c0009510 con 0x7f17cc0c5f30 2023-11-30T18:22:36.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.863+0000 7f17ca7fc700 1 -- 172.21.15.49:0/3470881179 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c000ca60 con 0x7f17cc0c5f30 2023-11-30T18:22:36.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.863+0000 7f17d4739700 1 -- 172.21.15.49:0/3470881179 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17cc1683c0 con 0x7f17cc0c5f30 2023-11-30T18:22:36.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.863+0000 7f17d4739700 1 -- 172.21.15.49:0/3470881179 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17cc168980 con 0x7f17cc0c5f30 2023-11-30T18:22:36.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.864+0000 7f17d4739700 1 -- 172.21.15.49:0/3470881179 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17cc06c860 con 0x7f17cc0c5f30 2023-11-30T18:22:36.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.864+0000 7f17ca7fc700 1 -- 172.21.15.49:0/3470881179 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 68) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f17c001b400 con 0x7f17cc0c5f30 2023-11-30T18:22:36.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.865+0000 7f17ca7fc700 1 --2- 172.21.15.49:0/3470881179 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f17b805f270 0x7f17b8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:36.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.865+0000 7f17ca7fc700 1 -- 172.21.15.49:0/3470881179 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5325+0+0 (secure 0 0 0) 0x7f17c007a620 con 0x7f17cc0c5f30 2023-11-30T18:22:36.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.865+0000 7f17d24d5700 1 --2- 172.21.15.49:0/3470881179 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f17b805f270 0x7f17b8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:36.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.865+0000 7f17d24d5700 1 --2- 172.21.15.49:0/3470881179 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f17b805f270 0x7f17b8061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f17c400b9f0 tx=0x7f17c4009840).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:36.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:36.869+0000 7f17ca7fc700 1 -- 172.21.15.49:0/3470881179 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f17c004ba30 con 0x7f17cc0c5f30 2023-11-30T18:22:37.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:37.045+0000 7f17d4739700 1 -- 172.21.15.49:0/3470881179 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f17cc158860 con 0x7f17cc0c5f30 2023-11-30T18:22:38.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.031+0000 7f17ca7fc700 1 -- 172.21.15.49:0/3470881179 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v166) v1 ==== 152+0+0 (secure 0 0 0) 0x7f17c004f050 con 0x7f17cc0c5f30 2023-11-30T18:22:38.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.035+0000 7f17d4739700 1 -- 172.21.15.49:0/3470881179 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f17b805f270 msgr2=0x7f17b8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:38.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.035+0000 7f17d4739700 1 --2- 172.21.15.49:0/3470881179 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f17b805f270 0x7f17b8061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f17c400b9f0 tx=0x7f17c4009840).stop 2023-11-30T18:22:38.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.035+0000 7f17d4739700 1 -- 172.21.15.49:0/3470881179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17cc0c5f30 msgr2=0x7f17cc1364d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:38.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.035+0000 7f17d4739700 1 --2- 172.21.15.49:0/3470881179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17cc0c5f30 0x7f17cc1364d0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7f17c000e930 tx=0x7f17c0009060).stop 2023-11-30T18:22:38.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.035+0000 7f17d4739700 1 -- 172.21.15.49:0/3470881179 shutdown_connections 2023-11-30T18:22:38.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.035+0000 7f17d4739700 1 --2- 172.21.15.49:0/3470881179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17cc1373a0 0x7f17cc1369c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:38.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.035+0000 7f17d4739700 1 --2- 172.21.15.49:0/3470881179 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f17cc0669a0 0x7f17cc0aa270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:38.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.035+0000 7f17d4739700 1 --2- 172.21.15.49:0/3470881179 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f17b805f270 0x7f17b8061730 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0x7f17c400b9f0 tx=0x7f17c4009840).stop 2023-11-30T18:22:38.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.035+0000 7f17d4739700 1 --2- 172.21.15.49:0/3470881179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17cc0c5f30 0x7f17cc1364d0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:38.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.035+0000 7f17d4739700 1 -- 172.21.15.49:0/3470881179 >> 172.21.15.49:0/3470881179 conn(0x7f17cc0628f0 msgr2=0x7f17cc1359f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:38.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.036+0000 7f17d4739700 1 -- 172.21.15.49:0/3470881179 shutdown_connections 2023-11-30T18:22:38.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.036+0000 7f17d4739700 1 -- 172.21.15.49:0/3470881179 wait complete. 2023-11-30T18:22:38.041 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2023-11-30T18:22:38.054 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-30T18:22:38.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.182+0000 7f48b72c2700 1 Processor -- start 2023-11-30T18:22:38.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.183+0000 7f48b72c2700 1 -- start start 2023-11-30T18:22:38.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.183+0000 7f48b72c2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48b0098d10 0x7f48b00c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:38.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.183+0000 7f48b72c2700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f48b00c6190 0x7f48b0063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:38.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.183+0000 7f48b72c2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f48b0064350 0x7f48b0158320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:38.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.183+0000 7f48b72c2700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b00c72d0 con 0x7f48b0064350 2023-11-30T18:22:38.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.183+0000 7f48b72c2700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b0154bc0 con 0x7f48b00c6190 2023-11-30T18:22:38.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.183+0000 7f48b72c2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b00c66c0 con 0x7f48b0098d10 2023-11-30T18:22:38.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.184+0000 7f48b585f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f48b0064350 0x7f48b0158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:38.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.184+0000 7f48b585f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f48b0064350 0x7f48b0158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52562/0 (socket says 172.21.15.49:52562) 2023-11-30T18:22:38.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.184+0000 7f48b585f700 1 -- 172.21.15.49:0/2324116094 learned_addr learned my addr 172.21.15.49:0/2324116094 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:38.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.184+0000 7f48b485d700 1 --2- 172.21.15.49:0/2324116094 >> v2:172.21.15.115:3300/0 conn(0x7f48b00c6190 0x7f48b0063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:38.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.184+0000 7f48b505e700 1 --2- 172.21.15.49:0/2324116094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48b0098d10 0x7f48b00c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:38.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.184+0000 7f48b585f700 1 -- 172.21.15.49:0/2324116094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48b0098d10 msgr2=0x7f48b00c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:38.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.184+0000 7f48b585f700 1 --2- 172.21.15.49:0/2324116094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48b0098d10 0x7f48b00c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:38.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.184+0000 7f48b585f700 1 -- 172.21.15.49:0/2324116094 >> v2:172.21.15.115:3300/0 conn(0x7f48b00c6190 msgr2=0x7f48b0063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:38.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.184+0000 7f48b585f700 1 --2- 172.21.15.49:0/2324116094 >> v2:172.21.15.115:3300/0 conn(0x7f48b00c6190 0x7f48b0063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:38.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.184+0000 7f48b585f700 1 -- 172.21.15.49:0/2324116094 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b00c69a0 con 0x7f48b0064350 2023-11-30T18:22:38.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.184+0000 7f48b485d700 1 --2- 172.21.15.49:0/2324116094 >> v2:172.21.15.115:3300/0 conn(0x7f48b00c6190 0x7f48b0063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:22:38.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.184+0000 7f48b585f700 1 --2- 172.21.15.49:0/2324116094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b0064350 0x7f48b0158320 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7f48b00c8e20 tx=0x7f48a0009840).ready entity=mon.0 client_cookie=df700da86d64a1e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:38.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.184+0000 7f48affff700 1 -- 172.21.15.49:0/2324116094 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a000e070 con 0x7f48b0064350 2023-11-30T18:22:38.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.184+0000 7f48affff700 1 -- 172.21.15.49:0/2324116094 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a000ba50 con 0x7f48b0064350 2023-11-30T18:22:38.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.184+0000 7f48affff700 1 -- 172.21.15.49:0/2324116094 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a000bdd0 con 0x7f48b0064350 2023-11-30T18:22:38.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.185+0000 7f48b72c2700 1 -- 172.21.15.49:0/2324116094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b0064350 msgr2=0x7f48b0158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:38.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.185+0000 7f48b72c2700 1 --2- 172.21.15.49:0/2324116094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b0064350 0x7f48b0158320 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7f48b00c8e20 tx=0x7f48a0009840).stop 2023-11-30T18:22:38.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.185+0000 7f48b72c2700 1 -- 172.21.15.49:0/2324116094 shutdown_connections 2023-11-30T18:22:38.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.185+0000 7f48b72c2700 1 --2- 172.21.15.49:0/2324116094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48b0098d10 0x7f48b00c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:38.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.185+0000 7f48b72c2700 1 --2- 172.21.15.49:0/2324116094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b0064350 0x7f48b0158320 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:38.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.185+0000 7f48b72c2700 1 --2- 172.21.15.49:0/2324116094 >> v2:172.21.15.115:3300/0 conn(0x7f48b00c6190 0x7f48b0063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:38.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.185+0000 7f48b72c2700 1 -- 172.21.15.49:0/2324116094 >> 172.21.15.49:0/2324116094 conn(0x7f48b00cb310 msgr2=0x7f48b00cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:38.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.185+0000 7f48b72c2700 1 -- 172.21.15.49:0/2324116094 shutdown_connections 2023-11-30T18:22:38.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.185+0000 7f48b72c2700 1 -- 172.21.15.49:0/2324116094 wait complete. 2023-11-30T18:22:38.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.186+0000 7f48b72c2700 1 Processor -- start 2023-11-30T18:22:38.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.186+0000 7f48b72c2700 1 -- start start 2023-11-30T18:22:38.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.187+0000 7f48b72c2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48b0064350 0x7f48b0167cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:38.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.187+0000 7f48b72c2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b0098d10 0x7f48b01658d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:38.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.187+0000 7f48b72c2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48b00c6190 0x7f48b0167550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:38.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.187+0000 7f48b72c2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b00c33f0 con 0x7f48b0098d10 2023-11-30T18:22:38.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.187+0000 7f48b72c2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b0167a40 con 0x7f48b0064350 2023-11-30T18:22:38.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.187+0000 7f48b72c2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b0168290 con 0x7f48b00c6190 2023-11-30T18:22:38.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.187+0000 7f48b485d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b0098d10 0x7f48b01658d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:38.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.187+0000 7f48b485d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b0098d10 0x7f48b01658d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52568/0 (socket says 172.21.15.49:52568) 2023-11-30T18:22:38.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.187+0000 7f48b485d700 1 -- 172.21.15.49:0/1581181205 learned_addr learned my addr 172.21.15.49:0/1581181205 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:38.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.187+0000 7f48b585f700 1 --2- 172.21.15.49:0/1581181205 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48b00c6190 0x7f48b0167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:38.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.187+0000 7f48b505e700 1 --2- 172.21.15.49:0/1581181205 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48b0064350 0x7f48b0167cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:38.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.187+0000 7f48b485d700 1 -- 172.21.15.49:0/1581181205 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48b00c6190 msgr2=0x7f48b0167550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:38.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.187+0000 7f48b485d700 1 --2- 172.21.15.49:0/1581181205 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48b00c6190 0x7f48b0167550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:38.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.187+0000 7f48b485d700 1 -- 172.21.15.49:0/1581181205 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48b0064350 msgr2=0x7f48b0167cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:38.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.187+0000 7f48b485d700 1 --2- 172.21.15.49:0/1581181205 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48b0064350 0x7f48b0167cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:38.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.187+0000 7f48b485d700 1 -- 172.21.15.49:0/1581181205 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a0009ae0 con 0x7f48b0098d10 2023-11-30T18:22:38.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.188+0000 7f48b485d700 1 --2- 172.21.15.49:0/1581181205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b0098d10 0x7f48b01658d0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7f48a400c880 tx=0x7f48a4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:38.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.188+0000 7f48ad7fa700 1 -- 172.21.15.49:0/1581181205 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a4010580 con 0x7f48b0098d10 2023-11-30T18:22:38.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.188+0000 7f48ad7fa700 1 -- 172.21.15.49:0/1581181205 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a40106e0 con 0x7f48b0098d10 2023-11-30T18:22:38.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.188+0000 7f48b72c2700 1 -- 172.21.15.49:0/1581181205 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b0168570 con 0x7f48b0098d10 2023-11-30T18:22:38.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.188+0000 7f48ad7fa700 1 -- 172.21.15.49:0/1581181205 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a4010a60 con 0x7f48b0098d10 2023-11-30T18:22:38.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.188+0000 7f48b72c2700 1 -- 172.21.15.49:0/1581181205 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b0168b30 con 0x7f48b0098d10 2023-11-30T18:22:38.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.189+0000 7f48b72c2700 1 -- 172.21.15.49:0/1581181205 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b00c3720 con 0x7f48b0098d10 2023-11-30T18:22:38.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.189+0000 7f48ad7fa700 1 -- 172.21.15.49:0/1581181205 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 68) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f48a4011410 con 0x7f48b0098d10 2023-11-30T18:22:38.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.190+0000 7f48ad7fa700 1 --2- 172.21.15.49:0/1581181205 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f489c05f240 0x7f489c061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:38.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.190+0000 7f48ad7fa700 1 -- 172.21.15.49:0/1581181205 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5695+0+0 (secure 0 0 0) 0x7f48a407ab20 con 0x7f48b0098d10 2023-11-30T18:22:38.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.190+0000 7f48b505e700 1 --2- 172.21.15.49:0/1581181205 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f489c05f240 0x7f489c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:38.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.190+0000 7f48b505e700 1 --2- 172.21.15.49:0/1581181205 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f489c05f240 0x7f489c061700 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f48a800bbc0 tx=0x7f48a8008040).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:38.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.194+0000 7f48ad7fa700 1 -- 172.21.15.49:0/1581181205 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f48a404be80 con 0x7f48b0098d10 2023-11-30T18:22:38.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:38.368+0000 7f48b72c2700 1 -- 172.21.15.49:0/1581181205 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f48b00c3250 con 0x7f48b0098d10 2023-11-30T18:22:39.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.038+0000 7f48ad7fa700 1 -- 172.21.15.49:0/1581181205 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v167) v1 ==== 170+0+0 (secure 0 0 0) 0x7f48b00c3250 con 0x7f48b0098d10 2023-11-30T18:22:39.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.045+0000 7f48b72c2700 1 -- 172.21.15.49:0/1581181205 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f489c05f240 msgr2=0x7f489c061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:39.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.045+0000 7f48b72c2700 1 --2- 172.21.15.49:0/1581181205 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f489c05f240 0x7f489c061700 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f48a800bbc0 tx=0x7f48a8008040).stop 2023-11-30T18:22:39.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.045+0000 7f48b72c2700 1 -- 172.21.15.49:0/1581181205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b0098d10 msgr2=0x7f48b01658d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:39.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.045+0000 7f48b72c2700 1 --2- 172.21.15.49:0/1581181205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b0098d10 0x7f48b01658d0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7f48a400c880 tx=0x7f48a4008040).stop 2023-11-30T18:22:39.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.048+0000 7f48b72c2700 1 -- 172.21.15.49:0/1581181205 shutdown_connections 2023-11-30T18:22:39.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.048+0000 7f48b72c2700 1 --2- 172.21.15.49:0/1581181205 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48b00c6190 0x7f48b0167550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:39.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.048+0000 7f48b72c2700 1 --2- 172.21.15.49:0/1581181205 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48b0064350 0x7f48b0167cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:39.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.048+0000 7f48b72c2700 1 --2- 172.21.15.49:0/1581181205 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f489c05f240 0x7f489c061700 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:39.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.048+0000 7f48b72c2700 1 --2- 172.21.15.49:0/1581181205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b0098d10 0x7f48b01658d0 secure :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 rx=0x7f48a400c880 tx=0x7f48a4008040).stop 2023-11-30T18:22:39.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.048+0000 7f48b72c2700 1 -- 172.21.15.49:0/1581181205 >> 172.21.15.49:0/1581181205 conn(0x7f48b00cb310 msgr2=0x7f48b00ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:39.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.055+0000 7f48b72c2700 1 -- 172.21.15.49:0/1581181205 shutdown_connections 2023-11-30T18:22:39.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.055+0000 7f48b72c2700 1 -- 172.21.15.49:0/1581181205 wait complete. 2023-11-30T18:22:39.063 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2023-11-30T18:22:39.076 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-30T18:22:39.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.198+0000 7ff55a1f2700 1 Processor -- start 2023-11-30T18:22:39.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.198+0000 7ff55a1f2700 1 -- start start 2023-11-30T18:22:39.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.198+0000 7ff55a1f2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5540c6190 0x7ff5540c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:39.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.198+0000 7ff55a1f2700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5540c72d0 con 0x7ff554098d10 2023-11-30T18:22:39.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.198+0000 7ff55a1f2700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff554064570 con 0x7ff554158320 2023-11-30T18:22:39.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.198+0000 7ff55a1f2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff554154bc0 con 0x7ff5540c6190 2023-11-30T18:22:39.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.199+0000 7ff5537fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff554098d10 0x7ff554063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42134/0 (socket says 172.21.15.49:42134) 2023-11-30T18:22:39.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.199+0000 7ff5537fe700 1 -- 172.21.15.49:0/3704294777 learned_addr learned my addr 172.21.15.49:0/3704294777 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:22:39.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.199+0000 7ff552ffd700 1 --2- 172.21.15.49:0/3704294777 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5540c6190 0x7ff5540c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:39.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.199+0000 7ff5527fc700 1 -- 172.21.15.49:0/3704294777 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 651121646 0 0) 0x7ff5540c72d0 con 0x7ff554098d10 2023-11-30T18:22:39.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.199+0000 7ff5527fc700 1 -- 172.21.15.49:0/3704294777 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff53c0033f0 con 0x7ff554098d10 2023-11-30T18:22:39.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.199+0000 7ff5527fc700 1 -- 172.21.15.49:0/3704294777 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 816269926 0 0) 0x7ff554064570 con 0x7ff554158320 2023-11-30T18:22:39.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.199+0000 7ff5527fc700 1 -- 172.21.15.49:0/3704294777 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5540c72d0 con 0x7ff554158320 2023-11-30T18:22:39.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.199+0000 7ff552ffd700 1 -- 172.21.15.49:0/3704294777 >> v1:172.21.15.115:6789/0 conn(0x7ff554158320 legacy=0x7ff5540a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:39.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.199+0000 7ff552ffd700 1 -- 172.21.15.49:0/3704294777 >> v1:172.21.15.49:6789/0 conn(0x7ff554098d10 legacy=0x7ff554063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:39.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.199+0000 7ff5527fc700 1 -- 172.21.15.49:0/3704294777 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 894032399 0 0) 0x7ff53c0033f0 con 0x7ff554098d10 2023-11-30T18:22:39.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.199+0000 7ff552ffd700 1 -- 172.21.15.49:0/3704294777 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5540c66c0 con 0x7ff5540c6190 2023-11-30T18:22:39.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.199+0000 7ff552ffd700 1 --2- 172.21.15.49:0/3704294777 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5540c6190 0x7ff5540c7760 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7ff548009790 tx=0x7ff548009060).ready entity=mon.2 client_cookie=81d046ff9a8b950e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:39.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.199+0000 7ff5527fc700 1 -- 172.21.15.49:0/3704294777 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff544001470 con 0x7ff5540c6190 2023-11-30T18:22:39.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.199+0000 7ff5527fc700 1 -- 172.21.15.49:0/3704294777 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff548011400 con 0x7ff5540c6190 2023-11-30T18:22:39.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.199+0000 7ff5527fc700 1 -- 172.21.15.49:0/3704294777 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff548011780 con 0x7ff5540c6190 2023-11-30T18:22:39.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.200+0000 7ff55a1f2700 1 -- 172.21.15.49:0/3704294777 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5540c6190 msgr2=0x7ff5540c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:39.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.200+0000 7ff55a1f2700 1 --2- 172.21.15.49:0/3704294777 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5540c6190 0x7ff5540c7760 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7ff548009790 tx=0x7ff548009060).stop 2023-11-30T18:22:39.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.200+0000 7ff55a1f2700 1 -- 172.21.15.49:0/3704294777 shutdown_connections 2023-11-30T18:22:39.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.200+0000 7ff55a1f2700 1 --2- 172.21.15.49:0/3704294777 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5540c6190 0x7ff5540c7760 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:39.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.200+0000 7ff55a1f2700 1 -- 172.21.15.49:0/3704294777 >> 172.21.15.49:0/3704294777 conn(0x7ff5540cb310 msgr2=0x7ff5540cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:39.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.200+0000 7ff55a1f2700 1 -- 172.21.15.49:0/3704294777 shutdown_connections 2023-11-30T18:22:39.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.200+0000 7ff55a1f2700 1 -- 172.21.15.49:0/3704294777 wait complete. 2023-11-30T18:22:39.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.201+0000 7ff55a1f2700 1 Processor -- start 2023-11-30T18:22:39.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.201+0000 7ff55a1f2700 1 -- start start 2023-11-30T18:22:39.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.202+0000 7ff55a1f2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff554098d10 0x7ff554167a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:39.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.202+0000 7ff55a1f2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5540c6190 0x7ff5540c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:39.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.202+0000 7ff55a1f2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff554158320 0x7ff554151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:39.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.202+0000 7ff55a1f2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5540c5330 con 0x7ff554158320 2023-11-30T18:22:39.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.202+0000 7ff55a1f2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5540c4720 con 0x7ff554098d10 2023-11-30T18:22:39.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.202+0000 7ff55a1f2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5540c4a00 con 0x7ff5540c6190 2023-11-30T18:22:39.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.202+0000 7ff553fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff554158320 0x7ff554151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:39.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.202+0000 7ff553fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff554158320 0x7ff554151860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52578/0 (socket says 172.21.15.49:52578) 2023-11-30T18:22:39.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.202+0000 7ff553fff700 1 -- 172.21.15.49:0/2606288797 learned_addr learned my addr 172.21.15.49:0/2606288797 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:39.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.202+0000 7ff552ffd700 1 --2- 172.21.15.49:0/2606288797 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5540c6190 0x7ff5540c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:39.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.202+0000 7ff5537fe700 1 --2- 172.21.15.49:0/2606288797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff554098d10 0x7ff554167a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:39.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.203+0000 7ff553fff700 1 -- 172.21.15.49:0/2606288797 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5540c6190 msgr2=0x7ff5540c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:39.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.203+0000 7ff553fff700 1 --2- 172.21.15.49:0/2606288797 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5540c6190 0x7ff5540c3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:39.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.203+0000 7ff553fff700 1 -- 172.21.15.49:0/2606288797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff554098d10 msgr2=0x7ff554167a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:39.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.203+0000 7ff553fff700 1 --2- 172.21.15.49:0/2606288797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff554098d10 0x7ff554167a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:39.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.203+0000 7ff553fff700 1 -- 172.21.15.49:0/2606288797 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5480092a0 con 0x7ff554158320 2023-11-30T18:22:39.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.203+0000 7ff553fff700 1 --2- 172.21.15.49:0/2606288797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff554158320 0x7ff554151860 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 rx=0x7ff54c00c710 tx=0x7ff54c00cad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:39.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.203+0000 7ff53b7fe700 1 -- 172.21.15.49:0/2606288797 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54c010510 con 0x7ff554158320 2023-11-30T18:22:39.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.203+0000 7ff53b7fe700 1 -- 172.21.15.49:0/2606288797 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54c010670 con 0x7ff554158320 2023-11-30T18:22:39.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.203+0000 7ff53b7fe700 1 -- 172.21.15.49:0/2606288797 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54c0109f0 con 0x7ff554158320 2023-11-30T18:22:39.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.203+0000 7ff55a1f2700 1 -- 172.21.15.49:0/2606288797 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5540c4ce0 con 0x7ff554158320 2023-11-30T18:22:39.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.203+0000 7ff55a1f2700 1 -- 172.21.15.49:0/2606288797 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff554167f60 con 0x7ff554158320 2023-11-30T18:22:39.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.204+0000 7ff55a1f2700 1 -- 172.21.15.49:0/2606288797 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff55406c860 con 0x7ff554158320 2023-11-30T18:22:39.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.204+0000 7ff53b7fe700 1 -- 172.21.15.49:0/2606288797 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 68) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff54c01b400 con 0x7ff554158320 2023-11-30T18:22:39.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.205+0000 7ff53b7fe700 1 --2- 172.21.15.49:0/2606288797 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff54005f270 0x7ff540061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:39.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.205+0000 7ff53b7fe700 1 -- 172.21.15.49:0/2606288797 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6077+0+0 (secure 0 0 0) 0x7ff54c07a230 con 0x7ff554158320 2023-11-30T18:22:39.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.205+0000 7ff5537fe700 1 --2- 172.21.15.49:0/2606288797 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff54005f270 0x7ff540061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:39.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.206+0000 7ff5537fe700 1 --2- 172.21.15.49:0/2606288797 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff54005f270 0x7ff540061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff544001660 tx=0x7ff5440014e0).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:39.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.209+0000 7ff53b7fe700 1 -- 172.21.15.49:0/2606288797 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff54c04b350 con 0x7ff554158320 2023-11-30T18:22:39.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.424+0000 7ff55a1f2700 1 -- 172.21.15.49:0/2606288797 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff5540c69a0 con 0x7ff554158320 2023-11-30T18:22:39.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.432+0000 7ff53b7fe700 1 -- 172.21.15.49:0/2606288797 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v65) v1 ==== 174+0+0 (secure 0 0 0) 0x7ff54c04e970 con 0x7ff554158320 2023-11-30T18:22:39.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.435+0000 7ff55a1f2700 1 -- 172.21.15.49:0/2606288797 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff54005f270 msgr2=0x7ff540061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:39.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.435+0000 7ff55a1f2700 1 --2- 172.21.15.49:0/2606288797 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff54005f270 0x7ff540061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff544001660 tx=0x7ff5440014e0).stop 2023-11-30T18:22:39.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.435+0000 7ff55a1f2700 1 -- 172.21.15.49:0/2606288797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff554158320 msgr2=0x7ff554151860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:39.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.435+0000 7ff55a1f2700 1 --2- 172.21.15.49:0/2606288797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff554158320 0x7ff554151860 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 rx=0x7ff54c00c710 tx=0x7ff54c00cad0).stop 2023-11-30T18:22:39.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.436+0000 7ff55a1f2700 1 -- 172.21.15.49:0/2606288797 shutdown_connections 2023-11-30T18:22:39.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.436+0000 7ff55a1f2700 1 --2- 172.21.15.49:0/2606288797 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff54005f270 0x7ff540061730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:39.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.436+0000 7ff55a1f2700 1 --2- 172.21.15.49:0/2606288797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff554158320 0x7ff554151860 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:39.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.436+0000 7ff55a1f2700 1 --2- 172.21.15.49:0/2606288797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff554098d10 0x7ff554167a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:39.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.436+0000 7ff55a1f2700 1 --2- 172.21.15.49:0/2606288797 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5540c6190 0x7ff5540c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:39.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.436+0000 7ff55a1f2700 1 -- 172.21.15.49:0/2606288797 >> 172.21.15.49:0/2606288797 conn(0x7ff5540cb310 msgr2=0x7ff5540c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:39.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.437+0000 7ff55a1f2700 1 -- 172.21.15.49:0/2606288797 shutdown_connections 2023-11-30T18:22:39.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.437+0000 7ff55a1f2700 1 -- 172.21.15.49:0/2606288797 wait complete. 2023-11-30T18:22:39.446 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 19 and data pool 20 2023-11-30T18:22:39.462 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:22:39.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.579+0000 7f661c079700 1 Processor -- start 2023-11-30T18:22:39.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.579+0000 7f661c079700 1 -- start start 2023-11-30T18:22:39.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.580+0000 7f661c079700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6614064e20 0x7f6614155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:39.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.580+0000 7f661c079700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6614095e80 0x7f66140962f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:39.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.580+0000 7f661c079700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66140967e0 con 0x7f66141544d0 2023-11-30T18:22:39.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.580+0000 7f661c079700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6614067650 con 0x7f6614064e20 2023-11-30T18:22:39.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.580+0000 7f661c079700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66140683d0 con 0x7f6614095e80 2023-11-30T18:22:39.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.580+0000 7f6619614700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6614064e20 0x7f6614155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:39.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.580+0000 7f6619614700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6614064e20 0x7f6614155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52592/0 (socket says 172.21.15.49:52592) 2023-11-30T18:22:39.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.580+0000 7f6619614700 1 -- 172.21.15.49:0/3734501483 learned_addr learned my addr 172.21.15.49:0/3734501483 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:39.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.580+0000 7f661a616700 1 --2- 172.21.15.49:0/3734501483 >> v2:172.21.15.115:3300/0 conn(0x7f6614095e80 0x7f66140962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:39.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.581+0000 7f6619614700 1 -- 172.21.15.49:0/3734501483 >> v2:172.21.15.115:3300/0 conn(0x7f6614095e80 msgr2=0x7f66140962f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:39.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.581+0000 7f6619614700 1 --2- 172.21.15.49:0/3734501483 >> v2:172.21.15.115:3300/0 conn(0x7f6614095e80 0x7f66140962f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:39.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.581+0000 7f6619614700 1 -- 172.21.15.49:0/3734501483 >> v1:172.21.15.115:6789/0 conn(0x7f66141544d0 legacy=0x7f6614066f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:39.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.581+0000 7f6619614700 1 -- 172.21.15.49:0/3734501483 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6614067850 con 0x7f6614064e20 2023-11-30T18:22:39.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.581+0000 7f6619614700 1 --2- 172.21.15.49:0/3734501483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6614064e20 0x7f6614155750 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7f66140c9020 tx=0x7f66080090f0).ready entity=mon.0 client_cookie=22ca4fde955a98cd server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:39.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.581+0000 7f6618e13700 1 -- 172.21.15.49:0/3734501483 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660800b520 con 0x7f6614064e20 2023-11-30T18:22:39.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.581+0000 7f6618e13700 1 -- 172.21.15.49:0/3734501483 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660800b680 con 0x7f6614064e20 2023-11-30T18:22:39.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.581+0000 7f6618e13700 1 -- 172.21.15.49:0/3734501483 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660800ba00 con 0x7f6614064e20 2023-11-30T18:22:39.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.581+0000 7f661c079700 1 -- 172.21.15.49:0/3734501483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6614064e20 msgr2=0x7f6614155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:39.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.581+0000 7f661c079700 1 --2- 172.21.15.49:0/3734501483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6614064e20 0x7f6614155750 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7f66140c9020 tx=0x7f66080090f0).stop 2023-11-30T18:22:39.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.581+0000 7f661c079700 1 -- 172.21.15.49:0/3734501483 shutdown_connections 2023-11-30T18:22:39.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.581+0000 7f661c079700 1 --2- 172.21.15.49:0/3734501483 >> v2:172.21.15.115:3300/0 conn(0x7f6614095e80 0x7f66140962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:39.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.581+0000 7f661c079700 1 --2- 172.21.15.49:0/3734501483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6614064e20 0x7f6614155750 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:39.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.581+0000 7f661c079700 1 -- 172.21.15.49:0/3734501483 >> 172.21.15.49:0/3734501483 conn(0x7f66140631d0 msgr2=0x7f66140c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:39.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.581+0000 7f661c079700 1 -- 172.21.15.49:0/3734501483 shutdown_connections 2023-11-30T18:22:39.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.581+0000 7f661c079700 1 -- 172.21.15.49:0/3734501483 wait complete. 2023-11-30T18:22:39.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.582+0000 7f661c079700 1 Processor -- start 2023-11-30T18:22:39.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.583+0000 7f661c079700 1 -- start start 2023-11-30T18:22:39.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.583+0000 7f661c079700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6614064e20 0x7f66140c2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:39.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.583+0000 7f661c079700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6614095e80 0x7f66140c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:39.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.583+0000 7f661c079700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66141544d0 0x7f661414db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:39.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.583+0000 7f661c079700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66140c3010 con 0x7f6614064e20 2023-11-30T18:22:39.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.583+0000 7f661c079700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66140c8ae0 con 0x7f66141544d0 2023-11-30T18:22:39.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.583+0000 7f661c079700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66140c8d10 con 0x7f6614095e80 2023-11-30T18:22:39.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.583+0000 7f6619e15700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6614064e20 0x7f66140c2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:39.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.583+0000 7f6619e15700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6614064e20 0x7f66140c2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52602/0 (socket says 172.21.15.49:52602) 2023-11-30T18:22:39.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.583+0000 7f6619e15700 1 -- 172.21.15.49:0/2170691824 learned_addr learned my addr 172.21.15.49:0/2170691824 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:39.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.583+0000 7f661a616700 1 --2- 172.21.15.49:0/2170691824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66141544d0 0x7f661414db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:39.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.583+0000 7f6619614700 1 --2- 172.21.15.49:0/2170691824 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6614095e80 0x7f66140c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:39.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.584+0000 7f6619e15700 1 -- 172.21.15.49:0/2170691824 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6614095e80 msgr2=0x7f66140c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:39.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.584+0000 7f6619e15700 1 --2- 172.21.15.49:0/2170691824 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6614095e80 0x7f66140c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:39.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.584+0000 7f6619e15700 1 -- 172.21.15.49:0/2170691824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66141544d0 msgr2=0x7f661414db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:39.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.584+0000 7f6619e15700 1 --2- 172.21.15.49:0/2170691824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66141544d0 0x7f661414db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:39.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.584+0000 7f6619e15700 1 -- 172.21.15.49:0/2170691824 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6608009370 con 0x7f6614064e20 2023-11-30T18:22:39.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.584+0000 7f6619e15700 1 --2- 172.21.15.49:0/2170691824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6614064e20 0x7f66140c2b20 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7f660c00c440 tx=0x7f660c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:39.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.584+0000 7f6611ffb700 1 -- 172.21.15.49:0/2170691824 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c0123f0 con 0x7f6614064e20 2023-11-30T18:22:39.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.584+0000 7f6611ffb700 1 -- 172.21.15.49:0/2170691824 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660c012550 con 0x7f6614064e20 2023-11-30T18:22:39.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.584+0000 7f661c079700 1 -- 172.21.15.49:0/2170691824 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66140c0520 con 0x7f6614064e20 2023-11-30T18:22:39.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.584+0000 7f6611ffb700 1 -- 172.21.15.49:0/2170691824 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c0128f0 con 0x7f6614064e20 2023-11-30T18:22:39.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.584+0000 7f661c079700 1 -- 172.21.15.49:0/2170691824 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66140c0ae0 con 0x7f6614064e20 2023-11-30T18:22:39.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.585+0000 7f661c079700 1 -- 172.21.15.49:0/2170691824 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f661406c860 con 0x7f6614064e20 2023-11-30T18:22:39.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.585+0000 7f6611ffb700 1 -- 172.21.15.49:0/2170691824 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 68) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f660c012c60 con 0x7f6614064e20 2023-11-30T18:22:39.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.586+0000 7f6611ffb700 1 --2- 172.21.15.49:0/2170691824 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f660005f270 0x7f6600061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:39.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.586+0000 7f6611ffb700 1 -- 172.21.15.49:0/2170691824 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f660c0797d0 con 0x7f6614064e20 2023-11-30T18:22:39.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.586+0000 7f6619614700 1 --2- 172.21.15.49:0/2170691824 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f660005f270 0x7f6600061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:39.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.586+0000 7f6619614700 1 --2- 172.21.15.49:0/2170691824 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f660005f270 0x7f6600061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f6608009130 tx=0x7f6608017000).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:39.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.590+0000 7f6611ffb700 1 -- 172.21.15.49:0/2170691824 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f660c047b00 con 0x7f6614064e20 2023-11-30T18:22:39.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.764+0000 7f661c079700 1 -- 172.21.15.49:0/2170691824 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6614067b30 con 0x7f6614064e20 2023-11-30T18:22:39.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.765+0000 7f6611ffb700 1 -- 172.21.15.49:0/2170691824 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+17044 (secure 0 0 0) 0x7f660c04a8e0 con 0x7f6614064e20 2023-11-30T18:22:39.766 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:22:39.766 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":168,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:22:39.425724+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-11-30T18:22:37.085862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-11-30T18:22:38.409621+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:22:39.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.767+0000 7f661c079700 1 -- 172.21.15.49:0/2170691824 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f660005f270 msgr2=0x7f6600061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:39.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.767+0000 7f661c079700 1 --2- 172.21.15.49:0/2170691824 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f660005f270 0x7f6600061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f6608009130 tx=0x7f6608017000).stop 2023-11-30T18:22:39.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.767+0000 7f661c079700 1 -- 172.21.15.49:0/2170691824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6614064e20 msgr2=0x7f66140c2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:39.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.767+0000 7f661c079700 1 --2- 172.21.15.49:0/2170691824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6614064e20 0x7f66140c2b20 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7f660c00c440 tx=0x7f660c007e00).stop 2023-11-30T18:22:39.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.767+0000 7f661c079700 1 -- 172.21.15.49:0/2170691824 shutdown_connections 2023-11-30T18:22:39.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.767+0000 7f661c079700 1 --2- 172.21.15.49:0/2170691824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66141544d0 0x7f661414db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:39.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.767+0000 7f661c079700 1 --2- 172.21.15.49:0/2170691824 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f660005f270 0x7f6600061730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:39.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.767+0000 7f661c079700 1 --2- 172.21.15.49:0/2170691824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6614064e20 0x7f66140c2b20 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:39.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.767+0000 7f661c079700 1 --2- 172.21.15.49:0/2170691824 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6614095e80 0x7f66140c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:39.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.767+0000 7f661c079700 1 -- 172.21.15.49:0/2170691824 >> 172.21.15.49:0/2170691824 conn(0x7f66140631d0 msgr2=0x7f66140c92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:39.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.768+0000 7f661c079700 1 -- 172.21.15.49:0/2170691824 shutdown_connections 2023-11-30T18:22:39.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.768+0000 7f661c079700 1 -- 172.21.15.49:0/2170691824 wait complete. 2023-11-30T18:22:39.781 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:22:39.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.898+0000 7f10f702b700 1 Processor -- start 2023-11-30T18:22:39.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.898+0000 7f10f702b700 1 -- start start 2023-11-30T18:22:39.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.899+0000 7f10f702b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10f01544e0 0x7f10f01548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:39.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.899+0000 7f10f702b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f10f00c6e30 0x7f10f00c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:39.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.899+0000 7f10f702b700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f00c69a0 con 0x7f10f006a610 2023-11-30T18:22:39.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.899+0000 7f10f702b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f00c13a0 con 0x7f10f00c6e30 2023-11-30T18:22:39.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.899+0000 7f10f702b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f00c1680 con 0x7f10f01544e0 2023-11-30T18:22:39.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.899+0000 7f10f4dc7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10f01544e0 0x7f10f01548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:39.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.899+0000 7f10f55c8700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f10f00c6e30 0x7f10f00c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:39.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.899+0000 7f10f4dc7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10f01544e0 0x7f10f01548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:33646/0 (socket says 172.21.15.49:33646) 2023-11-30T18:22:39.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.899+0000 7f10f4dc7700 1 -- 172.21.15.49:0/1977679259 learned_addr learned my addr 172.21.15.49:0/1977679259 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:39.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.900+0000 7f10f4dc7700 1 -- 172.21.15.49:0/1977679259 >> v2:172.21.15.115:3300/0 conn(0x7f10f00c6e30 msgr2=0x7f10f00c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:39.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.900+0000 7f10f4dc7700 1 --2- 172.21.15.49:0/1977679259 >> v2:172.21.15.115:3300/0 conn(0x7f10f00c6e30 0x7f10f00c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:39.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.900+0000 7f10f4dc7700 1 -- 172.21.15.49:0/1977679259 >> v1:172.21.15.115:6789/0 conn(0x7f10f006a610 legacy=0x7f10f00c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:39.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.900+0000 7f10f4dc7700 1 -- 172.21.15.49:0/1977679259 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f00c6630 con 0x7f10f01544e0 2023-11-30T18:22:39.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.900+0000 7f10f4dc7700 1 --2- 172.21.15.49:0/1977679259 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10f01544e0 0x7f10f01548c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f10d8009810 tx=0x7f10d8009060).ready entity=mon.2 client_cookie=d5c3e038865f2597 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:39.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.900+0000 7f10ef7fe700 1 -- 172.21.15.49:0/1977679259 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d8005880 con 0x7f10f01544e0 2023-11-30T18:22:39.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.900+0000 7f10ef7fe700 1 -- 172.21.15.49:0/1977679259 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d80059e0 con 0x7f10f01544e0 2023-11-30T18:22:39.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.900+0000 7f10ef7fe700 1 -- 172.21.15.49:0/1977679259 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d8005d60 con 0x7f10f01544e0 2023-11-30T18:22:39.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.900+0000 7f10f702b700 1 -- 172.21.15.49:0/1977679259 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10f01544e0 msgr2=0x7f10f01548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:39.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.900+0000 7f10f702b700 1 --2- 172.21.15.49:0/1977679259 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10f01544e0 0x7f10f01548c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f10d8009810 tx=0x7f10d8009060).stop 2023-11-30T18:22:39.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.900+0000 7f10f702b700 1 -- 172.21.15.49:0/1977679259 shutdown_connections 2023-11-30T18:22:39.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.900+0000 7f10f702b700 1 --2- 172.21.15.49:0/1977679259 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10f01544e0 0x7f10f01548c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:39.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.900+0000 7f10f702b700 1 --2- 172.21.15.49:0/1977679259 >> v2:172.21.15.115:3300/0 conn(0x7f10f00c6e30 0x7f10f00c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:39.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.900+0000 7f10f702b700 1 -- 172.21.15.49:0/1977679259 >> 172.21.15.49:0/1977679259 conn(0x7f10f0085020 msgr2=0x7f10f0094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:39.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.900+0000 7f10f702b700 1 -- 172.21.15.49:0/1977679259 shutdown_connections 2023-11-30T18:22:39.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.900+0000 7f10f702b700 1 -- 172.21.15.49:0/1977679259 wait complete. 2023-11-30T18:22:39.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.901+0000 7f10f702b700 1 Processor -- start 2023-11-30T18:22:39.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.902+0000 7f10f702b700 1 -- start start 2023-11-30T18:22:39.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.902+0000 7f10f702b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f006a610 0x7f10f0143f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:39.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.902+0000 7f10f702b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10f00c6e30 0x7f10f0097150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:39.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.902+0000 7f10f702b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10f01544e0 0x7f10f0097640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:39.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.902+0000 7f10f702b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f0097b30 con 0x7f10f006a610 2023-11-30T18:22:39.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.902+0000 7f10f702b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f00c4d50 con 0x7f10f00c6e30 2023-11-30T18:22:39.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.902+0000 7f10f702b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f0095450 con 0x7f10f01544e0 2023-11-30T18:22:39.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.903+0000 7f10f4dc7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f006a610 0x7f10f0143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:39.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.903+0000 7f10f4dc7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f006a610 0x7f10f0143f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52608/0 (socket says 172.21.15.49:52608) 2023-11-30T18:22:39.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.903+0000 7f10f4dc7700 1 -- 172.21.15.49:0/394962883 learned_addr learned my addr 172.21.15.49:0/394962883 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:39.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.903+0000 7f10f55c8700 1 --2- 172.21.15.49:0/394962883 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10f01544e0 0x7f10f0097640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:39.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.903+0000 7f10effff700 1 --2- 172.21.15.49:0/394962883 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10f00c6e30 0x7f10f0097150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:39.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.903+0000 7f10f4dc7700 1 -- 172.21.15.49:0/394962883 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10f01544e0 msgr2=0x7f10f0097640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:39.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.903+0000 7f10f4dc7700 1 --2- 172.21.15.49:0/394962883 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10f01544e0 0x7f10f0097640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:39.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.903+0000 7f10f4dc7700 1 -- 172.21.15.49:0/394962883 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10f00c6e30 msgr2=0x7f10f0097150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:39.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.903+0000 7f10f4dc7700 1 --2- 172.21.15.49:0/394962883 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10f00c6e30 0x7f10f0097150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:39.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.903+0000 7f10f4dc7700 1 -- 172.21.15.49:0/394962883 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d8009300 con 0x7f10f006a610 2023-11-30T18:22:39.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.903+0000 7f10f4dc7700 1 --2- 172.21.15.49:0/394962883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f006a610 0x7f10f0143f80 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7f10f0084590 tx=0x7f10d8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:39.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.903+0000 7f10ecff9700 1 -- 172.21.15.49:0/394962883 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d80067e0 con 0x7f10f006a610 2023-11-30T18:22:39.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.903+0000 7f10ecff9700 1 -- 172.21.15.49:0/394962883 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d800b790 con 0x7f10f006a610 2023-11-30T18:22:39.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.903+0000 7f10f702b700 1 -- 172.21.15.49:0/394962883 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f0144470 con 0x7f10f006a610 2023-11-30T18:22:39.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.903+0000 7f10ecff9700 1 -- 172.21.15.49:0/394962883 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d800bb30 con 0x7f10f006a610 2023-11-30T18:22:39.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.903+0000 7f10f702b700 1 -- 172.21.15.49:0/394962883 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f0094e00 con 0x7f10f006a610 2023-11-30T18:22:39.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.904+0000 7f10f702b700 1 -- 172.21.15.49:0/394962883 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f006c860 con 0x7f10f006a610 2023-11-30T18:22:39.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.905+0000 7f10ecff9700 1 -- 172.21.15.49:0/394962883 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 68) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f10d8026460 con 0x7f10f006a610 2023-11-30T18:22:39.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.905+0000 7f10ecff9700 1 --2- 172.21.15.49:0/394962883 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f10d005f240 0x7f10d0061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:39.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.905+0000 7f10ecff9700 1 -- 172.21.15.49:0/394962883 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f10d807ba20 con 0x7f10f006a610 2023-11-30T18:22:39.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.905+0000 7f10effff700 1 --2- 172.21.15.49:0/394962883 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f10d005f240 0x7f10d0061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:39.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.906+0000 7f10effff700 1 --2- 172.21.15.49:0/394962883 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f10d005f240 0x7f10d0061700 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f10f0096d60 tx=0x7f10e0009040).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:39.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:39.909+0000 7f10ecff9700 1 -- 172.21.15.49:0/394962883 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f10d804cad0 con 0x7f10f006a610 2023-11-30T18:22:40.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.085+0000 7f10f702b700 1 -- 172.21.15.49:0/394962883 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10f00c6250 con 0x7f10f006a610 2023-11-30T18:22:40.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.086+0000 7f10ecff9700 1 -- 172.21.15.49:0/394962883 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+17044 (secure 0 0 0) 0x7f10d80500f0 con 0x7f10f006a610 2023-11-30T18:22:40.087 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:22:40.087 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":168,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:22:39.425724+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-11-30T18:22:37.085862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-11-30T18:22:38.409621+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:22:40.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.088+0000 7f10f702b700 1 -- 172.21.15.49:0/394962883 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f10d005f240 msgr2=0x7f10d0061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:40.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.088+0000 7f10f702b700 1 --2- 172.21.15.49:0/394962883 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f10d005f240 0x7f10d0061700 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f10f0096d60 tx=0x7f10e0009040).stop 2023-11-30T18:22:40.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.088+0000 7f10f702b700 1 -- 172.21.15.49:0/394962883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f006a610 msgr2=0x7f10f0143f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:40.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.088+0000 7f10f702b700 1 --2- 172.21.15.49:0/394962883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f006a610 0x7f10f0143f80 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7f10f0084590 tx=0x7f10d8016000).stop 2023-11-30T18:22:40.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.088+0000 7f10f702b700 1 -- 172.21.15.49:0/394962883 shutdown_connections 2023-11-30T18:22:40.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.088+0000 7f10f702b700 1 --2- 172.21.15.49:0/394962883 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10f01544e0 0x7f10f0097640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:40.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.088+0000 7f10f702b700 1 --2- 172.21.15.49:0/394962883 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f10d005f240 0x7f10d0061700 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:40.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.088+0000 7f10f702b700 1 --2- 172.21.15.49:0/394962883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f006a610 0x7f10f0143f80 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:40.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.088+0000 7f10f702b700 1 --2- 172.21.15.49:0/394962883 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10f00c6e30 0x7f10f0097150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:40.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.088+0000 7f10f702b700 1 -- 172.21.15.49:0/394962883 >> 172.21.15.49:0/394962883 conn(0x7f10f0085020 msgr2=0x7f10f0064630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:40.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.088+0000 7f10f702b700 1 -- 172.21.15.49:0/394962883 shutdown_connections 2023-11-30T18:22:40.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.088+0000 7f10f702b700 1 -- 172.21.15.49:0/394962883 wait complete. 2023-11-30T18:22:40.101 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-30T18:22:40.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.221+0000 7fb9d905e700 1 Processor -- start 2023-11-30T18:22:40.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.221+0000 7fb9d905e700 1 -- start start 2023-11-30T18:22:40.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.221+0000 7fb9d905e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb9d4098d10 0x7fb9d40c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:40.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.221+0000 7fb9d905e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb9d40c6190 0x7fb9d4063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:40.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.221+0000 7fb9d905e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9d4064350 0x7fb9d4158320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:40.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.221+0000 7fb9d905e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9d40c72d0 con 0x7fb9d40c6190 2023-11-30T18:22:40.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.221+0000 7fb9d905e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9d4154bc0 con 0x7fb9d4098d10 2023-11-30T18:22:40.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.221+0000 7fb9d905e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d40c66c0 con 0x7fb9d4064350 2023-11-30T18:22:40.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.222+0000 7fb9d259c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb9d40c6190 0x7fb9d4063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:40.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.222+0000 7fb9d259c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb9d40c6190 0x7fb9d4063e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52614/0 (socket says 172.21.15.49:52614) 2023-11-30T18:22:40.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.222+0000 7fb9d259c700 1 -- 172.21.15.49:0/4007435868 learned_addr learned my addr 172.21.15.49:0/4007435868 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:40.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.222+0000 7fb9d359e700 1 --2- 172.21.15.49:0/4007435868 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9d4064350 0x7fb9d4158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:40.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.222+0000 7fb9d2d9d700 1 --2- 172.21.15.49:0/4007435868 >> v2:172.21.15.115:3300/0 conn(0x7fb9d4098d10 0x7fb9d40c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:40.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.222+0000 7fb9d259c700 1 -- 172.21.15.49:0/4007435868 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9d4064350 msgr2=0x7fb9d4158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:40.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.222+0000 7fb9d259c700 1 --2- 172.21.15.49:0/4007435868 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9d4064350 0x7fb9d4158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:40.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.222+0000 7fb9d259c700 1 -- 172.21.15.49:0/4007435868 >> v2:172.21.15.115:3300/0 conn(0x7fb9d4098d10 msgr2=0x7fb9d40c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:40.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.222+0000 7fb9d259c700 1 --2- 172.21.15.49:0/4007435868 >> v2:172.21.15.115:3300/0 conn(0x7fb9d4098d10 0x7fb9d40c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:40.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.222+0000 7fb9d259c700 1 -- 172.21.15.49:0/4007435868 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d40c69a0 con 0x7fb9d40c6190 2023-11-30T18:22:40.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.222+0000 7fb9d259c700 1 --2- 172.21.15.49:0/4007435868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9d40c6190 0x7fb9d4063e60 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7fb9d4083f80 tx=0x7fb9bc0090f0).ready entity=mon.0 client_cookie=85d69c690215462e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:40.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.222+0000 7fb9d1d9b700 1 -- 172.21.15.49:0/4007435868 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc00f510 con 0x7fb9d40c6190 2023-11-30T18:22:40.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.222+0000 7fb9d1d9b700 1 -- 172.21.15.49:0/4007435868 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9bc00f670 con 0x7fb9d40c6190 2023-11-30T18:22:40.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.222+0000 7fb9d1d9b700 1 -- 172.21.15.49:0/4007435868 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc00f9f0 con 0x7fb9d40c6190 2023-11-30T18:22:40.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.223+0000 7fb9d905e700 1 -- 172.21.15.49:0/4007435868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9d40c6190 msgr2=0x7fb9d4063e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:40.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.223+0000 7fb9d905e700 1 --2- 172.21.15.49:0/4007435868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9d40c6190 0x7fb9d4063e60 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7fb9d4083f80 tx=0x7fb9bc0090f0).stop 2023-11-30T18:22:40.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.223+0000 7fb9d905e700 1 -- 172.21.15.49:0/4007435868 shutdown_connections 2023-11-30T18:22:40.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.223+0000 7fb9d905e700 1 --2- 172.21.15.49:0/4007435868 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9d4064350 0x7fb9d4158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:40.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.223+0000 7fb9d905e700 1 --2- 172.21.15.49:0/4007435868 >> v2:172.21.15.115:3300/0 conn(0x7fb9d4098d10 0x7fb9d40c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:40.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.223+0000 7fb9d905e700 1 --2- 172.21.15.49:0/4007435868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9d40c6190 0x7fb9d4063e60 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:40.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.223+0000 7fb9d905e700 1 -- 172.21.15.49:0/4007435868 >> 172.21.15.49:0/4007435868 conn(0x7fb9d40cb310 msgr2=0x7fb9d40cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:40.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.223+0000 7fb9d905e700 1 -- 172.21.15.49:0/4007435868 shutdown_connections 2023-11-30T18:22:40.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.223+0000 7fb9d905e700 1 -- 172.21.15.49:0/4007435868 wait complete. 2023-11-30T18:22:40.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.224+0000 7fb9d905e700 1 Processor -- start 2023-11-30T18:22:40.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.224+0000 7fb9d905e700 1 -- start start 2023-11-30T18:22:40.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.225+0000 7fb9d905e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9d4064350 0x7fb9d4154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:40.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.225+0000 7fb9d905e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9d4098d10 0x7fb9d414ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:40.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.225+0000 7fb9d905e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9d40c6190 0x7fb9d4165260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:40.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.225+0000 7fb9d905e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d4157450 con 0x7fb9d40c6190 2023-11-30T18:22:40.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.225+0000 7fb9d905e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d4157730 con 0x7fb9d4098d10 2023-11-30T18:22:40.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.225+0000 7fb9d905e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d4157a10 con 0x7fb9d4064350 2023-11-30T18:22:40.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.225+0000 7fb9d359e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9d40c6190 0x7fb9d4165260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:40.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.225+0000 7fb9d359e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9d40c6190 0x7fb9d4165260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52622/0 (socket says 172.21.15.49:52622) 2023-11-30T18:22:40.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.225+0000 7fb9d359e700 1 -- 172.21.15.49:0/4041548806 learned_addr learned my addr 172.21.15.49:0/4041548806 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:40.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.225+0000 7fb9d2d9d700 1 --2- 172.21.15.49:0/4041548806 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9d4064350 0x7fb9d4154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:40.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.225+0000 7fb9d259c700 1 --2- 172.21.15.49:0/4041548806 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9d4098d10 0x7fb9d414ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:40.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.225+0000 7fb9d359e700 1 -- 172.21.15.49:0/4041548806 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9d4064350 msgr2=0x7fb9d4154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:40.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.225+0000 7fb9d359e700 1 --2- 172.21.15.49:0/4041548806 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9d4064350 0x7fb9d4154dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:40.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.225+0000 7fb9d359e700 1 -- 172.21.15.49:0/4041548806 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9d4098d10 msgr2=0x7fb9d414ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:40.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.225+0000 7fb9d359e700 1 --2- 172.21.15.49:0/4041548806 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9d4098d10 0x7fb9d414ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:40.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.225+0000 7fb9d359e700 1 -- 172.21.15.49:0/4041548806 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9bc009370 con 0x7fb9d40c6190 2023-11-30T18:22:40.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.225+0000 7fb9d359e700 1 --2- 172.21.15.49:0/4041548806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9d40c6190 0x7fb9d4165260 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7fb9c4009e90 tx=0x7fb9c400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:40.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.226+0000 7fb9caffd700 1 -- 172.21.15.49:0/4041548806 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c400caa0 con 0x7fb9d40c6190 2023-11-30T18:22:40.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.226+0000 7fb9caffd700 1 -- 172.21.15.49:0/4041548806 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c400f040 con 0x7fb9d40c6190 2023-11-30T18:22:40.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.226+0000 7fb9d905e700 1 -- 172.21.15.49:0/4041548806 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9d40af840 con 0x7fb9d40c6190 2023-11-30T18:22:40.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.226+0000 7fb9caffd700 1 -- 172.21.15.49:0/4041548806 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c400ce10 con 0x7fb9d40c6190 2023-11-30T18:22:40.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.226+0000 7fb9d905e700 1 -- 172.21.15.49:0/4041548806 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d4165750 con 0x7fb9d40c6190 2023-11-30T18:22:40.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.227+0000 7fb9d905e700 1 -- 172.21.15.49:0/4041548806 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9d40af6a0 con 0x7fb9d40c6190 2023-11-30T18:22:40.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.227+0000 7fb9caffd700 1 -- 172.21.15.49:0/4041548806 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 68) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb9c4013610 con 0x7fb9d40c6190 2023-11-30T18:22:40.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.227+0000 7fb9caffd700 1 --2- 172.21.15.49:0/4041548806 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb9b405f270 0x7fb9b4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:40.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.227+0000 7fb9caffd700 1 -- 172.21.15.49:0/4041548806 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fb9c407ac00 con 0x7fb9d40c6190 2023-11-30T18:22:40.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.228+0000 7fb9d2d9d700 1 --2- 172.21.15.49:0/4041548806 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb9b405f270 0x7fb9b4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:40.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.228+0000 7fb9d2d9d700 1 --2- 172.21.15.49:0/4041548806 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb9b405f270 0x7fb9b4061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fb9cc009ba0 tx=0x7fb9cc009060).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:40.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.232+0000 7fb9caffd700 1 -- 172.21.15.49:0/4041548806 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb9d40af6a0 con 0x7fb9d40c6190 2023-11-30T18:22:40.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:40.449+0000 7fb9d905e700 1 -- 172.21.15.49:0/4041548806 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb9d40af6a0 con 0x7fb9d40c6190 2023-11-30T18:22:41.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.437+0000 7fb9caffd700 1 -- 172.21.15.49:0/4041548806 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v68) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb9d40af6a0 con 0x7fb9d40c6190 2023-11-30T18:22:41.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.440+0000 7fb9d905e700 1 -- 172.21.15.49:0/4041548806 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb9b405f270 msgr2=0x7fb9b4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:41.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.440+0000 7fb9d905e700 1 --2- 172.21.15.49:0/4041548806 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb9b405f270 0x7fb9b4061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fb9cc009ba0 tx=0x7fb9cc009060).stop 2023-11-30T18:22:41.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.440+0000 7fb9d905e700 1 -- 172.21.15.49:0/4041548806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9d40c6190 msgr2=0x7fb9d4165260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:41.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.440+0000 7fb9d905e700 1 --2- 172.21.15.49:0/4041548806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9d40c6190 0x7fb9d4165260 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7fb9c4009e90 tx=0x7fb9c400b040).stop 2023-11-30T18:22:41.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.440+0000 7fb9d905e700 1 -- 172.21.15.49:0/4041548806 shutdown_connections 2023-11-30T18:22:41.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.440+0000 7fb9d905e700 1 --2- 172.21.15.49:0/4041548806 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb9b405f270 0x7fb9b4061730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:41.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.440+0000 7fb9d905e700 1 --2- 172.21.15.49:0/4041548806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9d40c6190 0x7fb9d4165260 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:41.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.440+0000 7fb9d905e700 1 --2- 172.21.15.49:0/4041548806 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9d4064350 0x7fb9d4154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:41.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.440+0000 7fb9d905e700 1 --2- 172.21.15.49:0/4041548806 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9d4098d10 0x7fb9d414ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:41.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.440+0000 7fb9d905e700 1 -- 172.21.15.49:0/4041548806 >> 172.21.15.49:0/4041548806 conn(0x7fb9d40cb310 msgr2=0x7fb9d4158820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:41.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.440+0000 7fb9d905e700 1 -- 172.21.15.49:0/4041548806 shutdown_connections 2023-11-30T18:22:41.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.440+0000 7fb9d905e700 1 -- 172.21.15.49:0/4041548806 wait complete. 2023-11-30T18:22:41.456 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-30T18:22:41.456 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-30T18:22:41.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.583+0000 7f25eb78b700 1 Processor -- start 2023-11-30T18:22:41.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.583+0000 7f25eb78b700 1 -- start start 2023-11-30T18:22:41.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.584+0000 7f25eb78b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f25e414ed10 0x7f25e40a8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:41.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.584+0000 7f25eb78b700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e4067770 con 0x7f25e4158160 2023-11-30T18:22:41.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.584+0000 7f25eb78b700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e40be8d0 con 0x7f25e40a8280 2023-11-30T18:22:41.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.584+0000 7f25eb78b700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e4159180 con 0x7f25e414ed10 2023-11-30T18:22:41.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.584+0000 7f25e9d28700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f25e414ed10 0x7f25e40a8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:41.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.584+0000 7f25e9d28700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f25e414ed10 0x7f25e40a8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36842/0 (socket says 172.21.15.49:36842) 2023-11-30T18:22:41.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.584+0000 7f25e9d28700 1 -- 172.21.15.49:0/1329483106 learned_addr learned my addr 172.21.15.49:0/1329483106 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:41.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.584+0000 7f25e8d26700 1 --1- 172.21.15.49:0/1329483106 >> v1:172.21.15.49:6789/0 conn(0x7f25e4158160 0x7f25e414e600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59074/0 (socket says 172.21.15.49:59074) 2023-11-30T18:22:41.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.584+0000 7f25e9d28700 1 -- 172.21.15.49:0/1329483106 >> v1:172.21.15.115:6789/0 conn(0x7f25e40a8280 legacy=0x7f25e4155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:41.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.584+0000 7f25e9d28700 1 -- 172.21.15.49:0/1329483106 >> v1:172.21.15.49:6789/0 conn(0x7f25e4158160 legacy=0x7f25e414e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:41.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.584+0000 7f25e3fff700 1 -- 172.21.15.49:0/1329483106 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 16432075 0 0) 0x7f25e4067770 con 0x7f25e4158160 2023-11-30T18:22:41.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.584+0000 7f25e9d28700 1 -- 172.21.15.49:0/1329483106 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e4158600 con 0x7f25e414ed10 2023-11-30T18:22:41.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.584+0000 7f25e9d28700 1 --2- 172.21.15.49:0/1329483106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25e414ed10 0x7f25e40a8660 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7f25d4009f20 tx=0x7f25d4009840).ready entity=mon.0 client_cookie=a7c716b1e02c1d18 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:41.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.585+0000 7f25e3fff700 1 -- 172.21.15.49:0/1329483106 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d400e070 con 0x7f25e414ed10 2023-11-30T18:22:41.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.585+0000 7f25e3fff700 1 -- 172.21.15.49:0/1329483106 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d400ba40 con 0x7f25e414ed10 2023-11-30T18:22:41.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.585+0000 7f25e3fff700 1 -- 172.21.15.49:0/1329483106 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d400bdc0 con 0x7f25e414ed10 2023-11-30T18:22:41.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.585+0000 7f25eb78b700 1 -- 172.21.15.49:0/1329483106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25e414ed10 msgr2=0x7f25e40a8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:41.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.585+0000 7f25eb78b700 1 --2- 172.21.15.49:0/1329483106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25e414ed10 0x7f25e40a8660 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7f25d4009f20 tx=0x7f25d4009840).stop 2023-11-30T18:22:41.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.585+0000 7f25eb78b700 1 -- 172.21.15.49:0/1329483106 shutdown_connections 2023-11-30T18:22:41.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.585+0000 7f25eb78b700 1 --2- 172.21.15.49:0/1329483106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25e414ed10 0x7f25e40a8660 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:41.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.585+0000 7f25eb78b700 1 -- 172.21.15.49:0/1329483106 >> 172.21.15.49:0/1329483106 conn(0x7f25e4062700 msgr2=0x7f25e4062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:41.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.585+0000 7f25eb78b700 1 -- 172.21.15.49:0/1329483106 shutdown_connections 2023-11-30T18:22:41.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.585+0000 7f25eb78b700 1 -- 172.21.15.49:0/1329483106 wait complete. 2023-11-30T18:22:41.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.586+0000 7f25eb78b700 1 Processor -- start 2023-11-30T18:22:41.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.586+0000 7f25eb78b700 1 -- start start 2023-11-30T18:22:41.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.587+0000 7f25eb78b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25e40a8280 0x7f25e4161890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:41.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.587+0000 7f25eb78b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25e414ed10 0x7f25e4157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:41.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.587+0000 7f25eb78b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25e4158160 0x7f25e40a6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:41.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.587+0000 7f25eb78b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e4167990 con 0x7f25e414ed10 2023-11-30T18:22:41.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.587+0000 7f25eb78b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e4161d80 con 0x7f25e4158160 2023-11-30T18:22:41.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.587+0000 7f25eb78b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e41654d0 con 0x7f25e40a8280 2023-11-30T18:22:41.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.587+0000 7f25e8d26700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25e414ed10 0x7f25e4157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:41.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.587+0000 7f25e8d26700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25e414ed10 0x7f25e4157620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36852/0 (socket says 172.21.15.49:36852) 2023-11-30T18:22:41.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.587+0000 7f25e8d26700 1 -- 172.21.15.49:0/848615853 learned_addr learned my addr 172.21.15.49:0/848615853 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:41.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.587+0000 7f25e9d28700 1 --2- 172.21.15.49:0/848615853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25e4158160 0x7f25e40a6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:41.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.588+0000 7f25e9527700 1 --2- 172.21.15.49:0/848615853 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25e40a8280 0x7f25e4161890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:41.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.588+0000 7f25e8d26700 1 -- 172.21.15.49:0/848615853 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25e40a8280 msgr2=0x7f25e4161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:41.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.588+0000 7f25e8d26700 1 --2- 172.21.15.49:0/848615853 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25e40a8280 0x7f25e4161890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:41.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.588+0000 7f25e8d26700 1 -- 172.21.15.49:0/848615853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25e4158160 msgr2=0x7f25e40a6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:41.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.588+0000 7f25e8d26700 1 --2- 172.21.15.49:0/848615853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25e4158160 0x7f25e40a6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:41.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.588+0000 7f25e8d26700 1 -- 172.21.15.49:0/848615853 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d4009ae0 con 0x7f25e414ed10 2023-11-30T18:22:41.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.588+0000 7f25e9527700 1 --2- 172.21.15.49:0/848615853 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25e40a8280 0x7f25e4161890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:22:41.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.588+0000 7f25e8d26700 1 --2- 172.21.15.49:0/848615853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25e414ed10 0x7f25e4157620 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7f25d800c440 tx=0x7f25d8007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:41.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.588+0000 7f25e17fa700 1 -- 172.21.15.49:0/848615853 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d800cea0 con 0x7f25e414ed10 2023-11-30T18:22:41.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.588+0000 7f25e17fa700 1 -- 172.21.15.49:0/848615853 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d80072e0 con 0x7f25e414ed10 2023-11-30T18:22:41.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.588+0000 7f25e17fa700 1 -- 172.21.15.49:0/848615853 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d80056e0 con 0x7f25e414ed10 2023-11-30T18:22:41.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.588+0000 7f25eb78b700 1 -- 172.21.15.49:0/848615853 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e4167be0 con 0x7f25e414ed10 2023-11-30T18:22:41.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.588+0000 7f25eb78b700 1 -- 172.21.15.49:0/848615853 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e41681a0 con 0x7f25e414ed10 2023-11-30T18:22:41.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.589+0000 7f25eb78b700 1 -- 172.21.15.49:0/848615853 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e406c860 con 0x7f25e414ed10 2023-11-30T18:22:41.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.589+0000 7f25e17fa700 1 -- 172.21.15.49:0/848615853 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 68) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f25d8005b10 con 0x7f25e414ed10 2023-11-30T18:22:41.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.590+0000 7f25e17fa700 1 --2- 172.21.15.49:0/848615853 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f25d005f270 0x7f25d0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:41.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.590+0000 7f25e17fa700 1 -- 172.21.15.49:0/848615853 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f25d80799b0 con 0x7f25e414ed10 2023-11-30T18:22:41.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.590+0000 7f25e9527700 1 --2- 172.21.15.49:0/848615853 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f25d005f270 0x7f25d0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:41.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.590+0000 7f25e9527700 1 --2- 172.21.15.49:0/848615853 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f25d005f270 0x7f25d0061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f25e414e390 tx=0x7f25dc009040).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:41.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.594+0000 7f25e17fa700 1 -- 172.21.15.49:0/848615853 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f25d804aac0 con 0x7f25e414ed10 2023-11-30T18:22:41.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:41.813+0000 7f25eb78b700 1 -- 172.21.15.49:0/848615853 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f25e40c3c90 con 0x7f25e414ed10 2023-11-30T18:22:42.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.442+0000 7f25e17fa700 1 -- 172.21.15.49:0/848615853 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v69) v1 ==== 122+0+0 (secure 0 0 0) 0x7f25d804e0e0 con 0x7f25e414ed10 2023-11-30T18:22:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.445+0000 7f25eb78b700 1 -- 172.21.15.49:0/848615853 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f25d005f270 msgr2=0x7f25d0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.445+0000 7f25eb78b700 1 --2- 172.21.15.49:0/848615853 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f25d005f270 0x7f25d0061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f25e414e390 tx=0x7f25dc009040).stop 2023-11-30T18:22:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.445+0000 7f25eb78b700 1 -- 172.21.15.49:0/848615853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25e414ed10 msgr2=0x7f25e4157620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.445+0000 7f25eb78b700 1 --2- 172.21.15.49:0/848615853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25e414ed10 0x7f25e4157620 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7f25d800c440 tx=0x7f25d8007e30).stop 2023-11-30T18:22:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.445+0000 7f25eb78b700 1 -- 172.21.15.49:0/848615853 shutdown_connections 2023-11-30T18:22:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.445+0000 7f25eb78b700 1 --2- 172.21.15.49:0/848615853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25e4158160 0x7f25e40a6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.445+0000 7f25eb78b700 1 --2- 172.21.15.49:0/848615853 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25e40a8280 0x7f25e4161890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.445+0000 7f25eb78b700 1 --2- 172.21.15.49:0/848615853 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f25d005f270 0x7f25d0061730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.445+0000 7f25eb78b700 1 --2- 172.21.15.49:0/848615853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25e414ed10 0x7f25e4157620 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.445+0000 7f25eb78b700 1 -- 172.21.15.49:0/848615853 >> 172.21.15.49:0/848615853 conn(0x7f25e4062700 msgr2=0x7f25e4062ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.445+0000 7f25eb78b700 1 -- 172.21.15.49:0/848615853 shutdown_connections 2023-11-30T18:22:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.445+0000 7f25eb78b700 1 -- 172.21.15.49:0/848615853 wait complete. 2023-11-30T18:22:42.459 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-30T18:22:42.459 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:22:42.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.580+0000 7f49a211c700 1 Processor -- start 2023-11-30T18:22:42.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.580+0000 7f49a211c700 1 -- start start 2023-11-30T18:22:42.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.581+0000 7f49a211c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f499c157660 0x7f499c157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:42.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.581+0000 7f49a211c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f499c0c0180 0x7f499c1589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:42.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.581+0000 7f49a211c700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f499c0c12c0 con 0x7f499c0c1750 2023-11-30T18:22:42.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.581+0000 7f49a211c700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f499c0c06b0 con 0x7f499c0c0180 2023-11-30T18:22:42.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.581+0000 7f49a211c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499c0c0990 con 0x7f499c157660 2023-11-30T18:22:42.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.581+0000 7f49a0919700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f499c0c0180 0x7f499c1589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:42.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.581+0000 7f49a0919700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f499c0c0180 0x7f499c1589c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36868/0 (socket says 172.21.15.49:36868) 2023-11-30T18:22:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.581+0000 7f49a0919700 1 -- 172.21.15.49:0/1663085196 learned_addr learned my addr 172.21.15.49:0/1663085196 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.581+0000 7f49a111a700 1 --2- 172.21.15.49:0/1663085196 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f499c157660 0x7f499c157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.581+0000 7f49a0919700 1 -- 172.21.15.49:0/1663085196 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f499c157660 msgr2=0x7f499c157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.581+0000 7f49a0919700 1 --2- 172.21.15.49:0/1663085196 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f499c157660 0x7f499c157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.581+0000 7f49a0919700 1 -- 172.21.15.49:0/1663085196 >> v1:172.21.15.115:6789/0 conn(0x7f499c0c1750 legacy=0x7f499c0648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.581+0000 7f49a0919700 1 -- 172.21.15.49:0/1663085196 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c0c0c70 con 0x7f499c0c0180 2023-11-30T18:22:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.581+0000 7f49a0919700 1 --2- 172.21.15.49:0/1663085196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f499c0c0180 0x7f499c1589c0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7f498c006fd0 tx=0x7f498c0090f0).ready entity=mon.0 client_cookie=17be66c64ba1a2e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.582+0000 7f4993fff700 1 -- 172.21.15.49:0/1663085196 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c00b580 con 0x7f499c0c0180 2023-11-30T18:22:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.582+0000 7f4993fff700 1 -- 172.21.15.49:0/1663085196 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498c00b6e0 con 0x7f499c0c0180 2023-11-30T18:22:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.582+0000 7f4993fff700 1 -- 172.21.15.49:0/1663085196 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c00ba60 con 0x7f499c0c0180 2023-11-30T18:22:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.582+0000 7f49a211c700 1 -- 172.21.15.49:0/1663085196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f499c0c0180 msgr2=0x7f499c1589c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.582+0000 7f49a211c700 1 --2- 172.21.15.49:0/1663085196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f499c0c0180 0x7f499c1589c0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7f498c006fd0 tx=0x7f498c0090f0).stop 2023-11-30T18:22:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.582+0000 7f49a211c700 1 -- 172.21.15.49:0/1663085196 shutdown_connections 2023-11-30T18:22:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.582+0000 7f49a211c700 1 --2- 172.21.15.49:0/1663085196 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f499c157660 0x7f499c157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.582+0000 7f49a211c700 1 --2- 172.21.15.49:0/1663085196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f499c0c0180 0x7f499c1589c0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:42.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.582+0000 7f49a211c700 1 -- 172.21.15.49:0/1663085196 >> 172.21.15.49:0/1663085196 conn(0x7f499c0cb000 msgr2=0x7f499c0cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:42.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.582+0000 7f49a211c700 1 -- 172.21.15.49:0/1663085196 shutdown_connections 2023-11-30T18:22:42.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.582+0000 7f49a211c700 1 -- 172.21.15.49:0/1663085196 wait complete. 2023-11-30T18:22:42.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.583+0000 7f49a211c700 1 Processor -- start 2023-11-30T18:22:42.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.583+0000 7f49a211c700 1 -- start start 2023-11-30T18:22:42.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.584+0000 7f49a211c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f499c0c0180 0x7f499c1482d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:42.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.584+0000 7f49a211c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f499c0c1750 0x7f499c1560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:42.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.584+0000 7f49a211c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f499c157660 0x7f499c156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:42.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.584+0000 7f49a211c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499c156a80 con 0x7f499c0c0180 2023-11-30T18:22:42.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.584+0000 7f49a211c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499c154970 con 0x7f499c0c1750 2023-11-30T18:22:42.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.584+0000 7f49a211c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499c0c4720 con 0x7f499c157660 2023-11-30T18:22:42.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.584+0000 7f49a111a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f499c0c0180 0x7f499c1482d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:42.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.584+0000 7f49a111a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f499c0c0180 0x7f499c1482d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36878/0 (socket says 172.21.15.49:36878) 2023-11-30T18:22:42.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.585+0000 7f49a111a700 1 -- 172.21.15.49:0/1729404593 learned_addr learned my addr 172.21.15.49:0/1729404593 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:42.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.585+0000 7f49a0919700 1 --2- 172.21.15.49:0/1729404593 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f499c0c1750 0x7f499c1560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:42.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.585+0000 7f49a191b700 1 --2- 172.21.15.49:0/1729404593 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f499c157660 0x7f499c156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:42.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.585+0000 7f49a111a700 1 -- 172.21.15.49:0/1729404593 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f499c157660 msgr2=0x7f499c156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:42.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.585+0000 7f49a111a700 1 --2- 172.21.15.49:0/1729404593 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f499c157660 0x7f499c156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:42.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.585+0000 7f49a111a700 1 -- 172.21.15.49:0/1729404593 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f499c0c1750 msgr2=0x7f499c1560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:42.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.585+0000 7f49a111a700 1 --2- 172.21.15.49:0/1729404593 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f499c0c1750 0x7f499c1560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:42.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.585+0000 7f49a111a700 1 -- 172.21.15.49:0/1729404593 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498c009370 con 0x7f499c0c0180 2023-11-30T18:22:42.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.585+0000 7f49a111a700 1 --2- 172.21.15.49:0/1729404593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f499c0c0180 0x7f499c1482d0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7f499800e900 tx=0x7f4998009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:42.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.585+0000 7f49917fa700 1 -- 172.21.15.49:0/1729404593 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4998012600 con 0x7f499c0c0180 2023-11-30T18:22:42.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.585+0000 7f49917fa700 1 -- 172.21.15.49:0/1729404593 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4998012760 con 0x7f499c0c0180 2023-11-30T18:22:42.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.585+0000 7f49a211c700 1 -- 172.21.15.49:0/1729404593 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f499c154040 con 0x7f499c0c0180 2023-11-30T18:22:42.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.585+0000 7f49917fa700 1 -- 172.21.15.49:0/1729404593 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4998012ae0 con 0x7f499c0c0180 2023-11-30T18:22:42.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.585+0000 7f49a211c700 1 -- 172.21.15.49:0/1729404593 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f499c154600 con 0x7f499c0c0180 2023-11-30T18:22:42.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.586+0000 7f49a211c700 1 -- 172.21.15.49:0/1729404593 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f499c06c7c0 con 0x7f499c0c0180 2023-11-30T18:22:42.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.586+0000 7f49917fa700 1 -- 172.21.15.49:0/1729404593 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 68) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f499801b400 con 0x7f499c0c0180 2023-11-30T18:22:42.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.587+0000 7f49917fa700 1 --2- 172.21.15.49:0/1729404593 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f498005f240 0x7f4980061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:42.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.587+0000 7f49917fa700 1 -- 172.21.15.49:0/1729404593 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f499807a720 con 0x7f499c0c0180 2023-11-30T18:22:42.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.587+0000 7f49a0919700 1 --2- 172.21.15.49:0/1729404593 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f498005f240 0x7f4980061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:42.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.587+0000 7f49a0919700 1 --2- 172.21.15.49:0/1729404593 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f498005f240 0x7f4980061700 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f498c006fd0 tx=0x7f498c017000).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:42.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.591+0000 7f49917fa700 1 -- 172.21.15.49:0/1729404593 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f499804b7d0 con 0x7f499c0c0180 2023-11-30T18:22:42.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.805+0000 7f49a211c700 1 -- 172.21.15.49:0/1729404593 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f499c0c0f50 con 0x7f499c0c0180 2023-11-30T18:22:42.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.806+0000 7f49917fa700 1 -- 172.21.15.49:0/1729404593 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f4998016090 con 0x7f499c0c0180 2023-11-30T18:22:42.806 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:22:42.807 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":69,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7193,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/4003300500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4003300500},{"type":"v1","addr":"172.21.15.49:6835","nonce":4003300500}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7205,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3715169351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3715169351},{"type":"v1","addr":"172.21.15.115:6837","nonce":3715169351}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":8272,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2922134566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2922134566},{"type":"v1","addr":"172.21.15.115:6836","nonce":2922134566}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T18:22:39.426066+0000","modified":"2023-11-30T18:22:42.436489+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8505},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8505":{"gid":8505,"name":"a","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6833/3939533550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3939533550},{"type":"v1","addr":"172.21.15.49:6833","nonce":3939533550}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-11-30T18:22:42.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.807+0000 7f49a211c700 1 -- 172.21.15.49:0/1729404593 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f498005f240 msgr2=0x7f4980061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:42.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.807+0000 7f49a211c700 1 --2- 172.21.15.49:0/1729404593 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f498005f240 0x7f4980061700 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f498c006fd0 tx=0x7f498c017000).stop 2023-11-30T18:22:42.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.807+0000 7f49a211c700 1 -- 172.21.15.49:0/1729404593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f499c0c0180 msgr2=0x7f499c1482d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:42.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.807+0000 7f49a211c700 1 --2- 172.21.15.49:0/1729404593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f499c0c0180 0x7f499c1482d0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7f499800e900 tx=0x7f4998009060).stop 2023-11-30T18:22:42.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.807+0000 7f49a211c700 1 -- 172.21.15.49:0/1729404593 shutdown_connections 2023-11-30T18:22:42.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.807+0000 7f49a211c700 1 --2- 172.21.15.49:0/1729404593 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f499c157660 0x7f499c156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:42.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.807+0000 7f49a211c700 1 --2- 172.21.15.49:0/1729404593 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f498005f240 0x7f4980061700 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:42.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.807+0000 7f49a211c700 1 --2- 172.21.15.49:0/1729404593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f499c0c0180 0x7f499c1482d0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:42.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.807+0000 7f49a211c700 1 --2- 172.21.15.49:0/1729404593 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f499c0c1750 0x7f499c1560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:42.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.807+0000 7f49a211c700 1 -- 172.21.15.49:0/1729404593 >> 172.21.15.49:0/1729404593 conn(0x7f499c0cb000 msgr2=0x7f499c0aa500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:42.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.808+0000 7f49a211c700 1 -- 172.21.15.49:0/1729404593 shutdown_connections 2023-11-30T18:22:42.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.808+0000 7f49a211c700 1 -- 172.21.15.49:0/1729404593 wait complete. 2023-11-30T18:22:42.809 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 69 2023-11-30T18:22:42.820 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:22:42.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.938+0000 7f1654de4700 1 Processor -- start 2023-11-30T18:22:42.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.938+0000 7f1654de4700 1 -- start start 2023-11-30T18:22:42.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.939+0000 7f1654de4700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1650065f30 0x7f1650066310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:42.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.939+0000 7f1654de4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1650152450 0x7f16500bcf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:42.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.939+0000 7f1654de4700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1650151740 con 0x7f16500bd430 2023-11-30T18:22:42.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.939+0000 7f1654de4700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16500c2470 con 0x7f1650065f30 2023-11-30T18:22:42.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.939+0000 7f1654de4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16500bd8c0 con 0x7f1650152450 2023-11-30T18:22:42.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.939+0000 7f164e59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1650065f30 0x7f1650066310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:42.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.939+0000 7f164dd9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1650152450 0x7f16500bcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:42.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.939+0000 7f164dd9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1650152450 0x7f16500bcf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:49552/0 (socket says 172.21.15.49:49552) 2023-11-30T18:22:42.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.939+0000 7f164e59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1650065f30 0x7f1650066310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:59884/0 (socket says 172.21.15.49:59884) 2023-11-30T18:22:42.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.939+0000 7f164dd9b700 1 -- 172.21.15.49:0/1726475952 learned_addr learned my addr 172.21.15.49:0/1726475952 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:42.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.939+0000 7f164ed9d700 1 --1- 172.21.15.49:0/1726475952 >> v1:172.21.15.115:6789/0 conn(0x7f16500bd430 0x7f16500c14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:47484/0 (socket says 172.21.15.49:47484) 2023-11-30T18:22:42.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.939+0000 7f164dd9b700 1 -- 172.21.15.49:0/1726475952 >> v2:172.21.15.115:3300/0 conn(0x7f1650065f30 msgr2=0x7f1650066310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:42.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.939+0000 7f164dd9b700 1 --2- 172.21.15.49:0/1726475952 >> v2:172.21.15.115:3300/0 conn(0x7f1650065f30 0x7f1650066310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:42.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.939+0000 7f164dd9b700 1 -- 172.21.15.49:0/1726475952 >> v1:172.21.15.115:6789/0 conn(0x7f16500bd430 legacy=0x7f16500c14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:42.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.939+0000 7f164dd9b700 1 -- 172.21.15.49:0/1726475952 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1650066800 con 0x7f1650152450 2023-11-30T18:22:42.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.939+0000 7f164e59c700 1 --2- 172.21.15.49:0/1726475952 >> v2:172.21.15.115:3300/0 conn(0x7f1650065f30 0x7f1650066310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:22:42.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.940+0000 7f164dd9b700 1 --2- 172.21.15.49:0/1726475952 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1650152450 0x7f16500bcf40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f1644009830 tx=0x7f16440090f0).ready entity=mon.2 client_cookie=5233ff81dec8bc7f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:42.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.940+0000 7f164d59a700 1 -- 172.21.15.49:0/1726475952 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164400b580 con 0x7f1650152450 2023-11-30T18:22:42.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.940+0000 7f164d59a700 1 -- 172.21.15.49:0/1726475952 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164400b6e0 con 0x7f1650152450 2023-11-30T18:22:42.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.940+0000 7f164d59a700 1 -- 172.21.15.49:0/1726475952 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164400ba60 con 0x7f1650152450 2023-11-30T18:22:42.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.940+0000 7f1654de4700 1 -- 172.21.15.49:0/1726475952 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1650152450 msgr2=0x7f16500bcf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:42.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.940+0000 7f1654de4700 1 --2- 172.21.15.49:0/1726475952 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1650152450 0x7f16500bcf40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f1644009830 tx=0x7f16440090f0).stop 2023-11-30T18:22:42.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.940+0000 7f1654de4700 1 -- 172.21.15.49:0/1726475952 shutdown_connections 2023-11-30T18:22:42.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.940+0000 7f1654de4700 1 --2- 172.21.15.49:0/1726475952 >> v2:172.21.15.115:3300/0 conn(0x7f1650065f30 0x7f1650066310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:42.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.940+0000 7f1654de4700 1 --2- 172.21.15.49:0/1726475952 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1650152450 0x7f16500bcf40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:42.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.940+0000 7f1654de4700 1 -- 172.21.15.49:0/1726475952 >> 172.21.15.49:0/1726475952 conn(0x7f16500631d0 msgr2=0x7f16500c6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:42.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.940+0000 7f1654de4700 1 -- 172.21.15.49:0/1726475952 shutdown_connections 2023-11-30T18:22:42.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.940+0000 7f1654de4700 1 -- 172.21.15.49:0/1726475952 wait complete. 2023-11-30T18:22:42.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.942+0000 7f1654de4700 1 Processor -- start 2023-11-30T18:22:42.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.942+0000 7f1654de4700 1 -- start start 2023-11-30T18:22:42.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.942+0000 7f1654de4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1650065f30 0x7f1650138250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:42.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.942+0000 7f1654de4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f16500bd430 0x7f16500a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:42.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.942+0000 7f1654de4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1650152450 0x7f16500a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:42.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.942+0000 7f1654de4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16500aa250 con 0x7f1650065f30 2023-11-30T18:22:42.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.942+0000 7f1654de4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16500a9f20 con 0x7f1650152450 2023-11-30T18:22:42.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.942+0000 7f1654de4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16500a5e30 con 0x7f16500bd430 2023-11-30T18:22:42.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.942+0000 7f164e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1650065f30 0x7f1650138250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:42.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.942+0000 7f164e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1650065f30 0x7f1650138250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36884/0 (socket says 172.21.15.49:36884) 2023-11-30T18:22:42.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.942+0000 7f164e59c700 1 -- 172.21.15.49:0/1592893184 learned_addr learned my addr 172.21.15.49:0/1592893184 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:42.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.943+0000 7f164dd9b700 1 --2- 172.21.15.49:0/1592893184 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f16500bd430 0x7f16500a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:42.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.943+0000 7f164ed9d700 1 --2- 172.21.15.49:0/1592893184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1650152450 0x7f16500a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:42.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.943+0000 7f164e59c700 1 -- 172.21.15.49:0/1592893184 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f16500bd430 msgr2=0x7f16500a52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:42.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.943+0000 7f164e59c700 1 --2- 172.21.15.49:0/1592893184 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f16500bd430 0x7f16500a52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:42.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.943+0000 7f164e59c700 1 -- 172.21.15.49:0/1592893184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1650152450 msgr2=0x7f16500a57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:42.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.943+0000 7f164e59c700 1 --2- 172.21.15.49:0/1592893184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1650152450 0x7f16500a57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:42.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.943+0000 7f164e59c700 1 -- 172.21.15.49:0/1592893184 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16400092a0 con 0x7f1650065f30 2023-11-30T18:22:42.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.943+0000 7f164e59c700 1 --2- 172.21.15.49:0/1592893184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1650065f30 0x7f1650138250 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7f164000e980 tx=0x7f1640009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:42.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.943+0000 7f163e7fc700 1 -- 172.21.15.49:0/1592893184 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640012600 con 0x7f1650065f30 2023-11-30T18:22:42.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.943+0000 7f163e7fc700 1 -- 172.21.15.49:0/1592893184 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1640012760 con 0x7f1650065f30 2023-11-30T18:22:42.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.943+0000 7f1654de4700 1 -- 172.21.15.49:0/1592893184 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1644009370 con 0x7f1650065f30 2023-11-30T18:22:42.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.943+0000 7f163e7fc700 1 -- 172.21.15.49:0/1592893184 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640012ae0 con 0x7f1650065f30 2023-11-30T18:22:42.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.943+0000 7f1654de4700 1 -- 172.21.15.49:0/1592893184 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16500a63f0 con 0x7f1650065f30 2023-11-30T18:22:42.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.944+0000 7f1654de4700 1 -- 172.21.15.49:0/1592893184 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16500aa530 con 0x7f1650065f30 2023-11-30T18:22:42.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.945+0000 7f163e7fc700 1 -- 172.21.15.49:0/1592893184 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 68) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f164001b400 con 0x7f1650065f30 2023-11-30T18:22:42.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.945+0000 7f163e7fc700 1 --2- 172.21.15.49:0/1592893184 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f163005f270 0x7f1630061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:42.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.945+0000 7f163e7fc700 1 -- 172.21.15.49:0/1592893184 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f164007a8c0 con 0x7f1650065f30 2023-11-30T18:22:42.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.945+0000 7f164dd9b700 1 --2- 172.21.15.49:0/1592893184 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f163005f270 0x7f1630061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:42.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.946+0000 7f164dd9b700 1 --2- 172.21.15.49:0/1592893184 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f163005f270 0x7f1630061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f16501528b0 tx=0x7f1644017000).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:42.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:42.949+0000 7f163e7fc700 1 -- 172.21.15.49:0/1592893184 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f164004b970 con 0x7f1650065f30 2023-11-30T18:22:43.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.122+0000 7f1654de4700 1 -- 172.21.15.49:0/1592893184 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f165006c860 con 0x7f1650065f30 2023-11-30T18:22:43.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.123+0000 7f163e7fc700 1 -- 172.21.15.49:0/1592893184 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v169) v1 ==== 74+0+17031 (secure 0 0 0) 0x7f164004ef90 con 0x7f1650065f30 2023-11-30T18:22:43.125 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:22:43.125 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":169,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:22:40.427949+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-11-30T18:22:37.085862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-11-30T18:22:38.409621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:22:43.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.125+0000 7f1654de4700 1 -- 172.21.15.49:0/1592893184 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f163005f270 msgr2=0x7f1630061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:43.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.125+0000 7f1654de4700 1 --2- 172.21.15.49:0/1592893184 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f163005f270 0x7f1630061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f16501528b0 tx=0x7f1644017000).stop 2023-11-30T18:22:43.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.125+0000 7f1654de4700 1 -- 172.21.15.49:0/1592893184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1650065f30 msgr2=0x7f1650138250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:43.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.125+0000 7f1654de4700 1 --2- 172.21.15.49:0/1592893184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1650065f30 0x7f1650138250 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7f164000e980 tx=0x7f1640009060).stop 2023-11-30T18:22:43.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.125+0000 7f1654de4700 1 -- 172.21.15.49:0/1592893184 shutdown_connections 2023-11-30T18:22:43.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.125+0000 7f1654de4700 1 --2- 172.21.15.49:0/1592893184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1650152450 0x7f16500a57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:43.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.125+0000 7f1654de4700 1 --2- 172.21.15.49:0/1592893184 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f163005f270 0x7f1630061730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:43.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.125+0000 7f1654de4700 1 --2- 172.21.15.49:0/1592893184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1650065f30 0x7f1650138250 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:43.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.125+0000 7f1654de4700 1 --2- 172.21.15.49:0/1592893184 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f16500bd430 0x7f16500a52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:43.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.125+0000 7f1654de4700 1 -- 172.21.15.49:0/1592893184 >> 172.21.15.49:0/1592893184 conn(0x7f16500631d0 msgr2=0x7f1650150870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:43.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.125+0000 7f1654de4700 1 -- 172.21.15.49:0/1592893184 shutdown_connections 2023-11-30T18:22:43.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.125+0000 7f1654de4700 1 -- 172.21.15.49:0/1592893184 wait complete. 2023-11-30T18:22:43.138 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-30T18:22:43.138 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T18:22:43.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.255+0000 7fedbf7c6700 1 Processor -- start 2023-11-30T18:22:43.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.256+0000 7fedbf7c6700 1 -- start start 2023-11-30T18:22:43.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.256+0000 7fedbf7c6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fedb80ca180 0x7fedb815f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:43.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.256+0000 7fedbf7c6700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb80a9a90 con 0x7fedb80caab0 2023-11-30T18:22:43.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.256+0000 7fedbf7c6700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb8154ce0 con 0x7fedb80cae90 2023-11-30T18:22:43.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.256+0000 7fedbf7c6700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb80aab80 con 0x7fedb80ca180 2023-11-30T18:22:43.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.257+0000 7fedbd562700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fedb80caab0 0x7fedb80aa470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59078/0 (socket says 172.21.15.49:59078) 2023-11-30T18:22:43.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.257+0000 7fedbd562700 1 -- 172.21.15.49:0/2793093316 learned_addr learned my addr 172.21.15.49:0/2793093316 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:22:43.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.257+0000 7fedbdd63700 1 --2- 172.21.15.49:0/2793093316 >> v2:172.21.15.49:3300/0 conn(0x7fedb80ca180 0x7fedb815f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:43.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.257+0000 7fedb7fff700 1 -- 172.21.15.49:0/2793093316 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 265302970 0 0) 0x7fedb80a9a90 con 0x7fedb80caab0 2023-11-30T18:22:43.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.257+0000 7fedb7fff700 1 -- 172.21.15.49:0/2793093316 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feda00033f0 con 0x7fedb80caab0 2023-11-30T18:22:43.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.257+0000 7fedbdd63700 1 -- 172.21.15.49:0/2793093316 >> v1:172.21.15.115:6789/0 conn(0x7fedb80cae90 legacy=0x7fedb80c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:43.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.257+0000 7fedbdd63700 1 -- 172.21.15.49:0/2793093316 >> v1:172.21.15.49:6789/0 conn(0x7fedb80caab0 legacy=0x7fedb80aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:43.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.257+0000 7fedbdd63700 1 -- 172.21.15.49:0/2793093316 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb80a8e80 con 0x7fedb80ca180 2023-11-30T18:22:43.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.257+0000 7fedbdd63700 1 --2- 172.21.15.49:0/2793093316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedb80ca180 0x7fedb815f3d0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7feda8009e60 tx=0x7feda8009780).ready entity=mon.0 client_cookie=fe3d50a85e036121 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:43.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.257+0000 7fedb7fff700 1 -- 172.21.15.49:0/2793093316 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda800e070 con 0x7fedb80ca180 2023-11-30T18:22:43.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.257+0000 7fedb7fff700 1 -- 172.21.15.49:0/2793093316 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda800bb60 con 0x7fedb80ca180 2023-11-30T18:22:43.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.257+0000 7fedb7fff700 1 -- 172.21.15.49:0/2793093316 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda8012410 con 0x7fedb80ca180 2023-11-30T18:22:43.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.258+0000 7fedbf7c6700 1 -- 172.21.15.49:0/2793093316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedb80ca180 msgr2=0x7fedb815f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:43.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.258+0000 7fedbf7c6700 1 --2- 172.21.15.49:0/2793093316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedb80ca180 0x7fedb815f3d0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7feda8009e60 tx=0x7feda8009780).stop 2023-11-30T18:22:43.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.258+0000 7fedbf7c6700 1 -- 172.21.15.49:0/2793093316 shutdown_connections 2023-11-30T18:22:43.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.258+0000 7fedbf7c6700 1 --2- 172.21.15.49:0/2793093316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedb80ca180 0x7fedb815f3d0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:43.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.258+0000 7fedbf7c6700 1 -- 172.21.15.49:0/2793093316 >> 172.21.15.49:0/2793093316 conn(0x7fedb8094920 msgr2=0x7fedb806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:43.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.258+0000 7fedbf7c6700 1 -- 172.21.15.49:0/2793093316 shutdown_connections 2023-11-30T18:22:43.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.258+0000 7fedbf7c6700 1 -- 172.21.15.49:0/2793093316 wait complete. 2023-11-30T18:22:43.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.259+0000 7fedbf7c6700 1 Processor -- start 2023-11-30T18:22:43.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.259+0000 7fedbf7c6700 1 -- start start 2023-11-30T18:22:43.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.260+0000 7fedbf7c6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fedb80ca180 0x7fedb8151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:43.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.260+0000 7fedbf7c6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb80caab0 0x7fedb8148e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:43.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.260+0000 7fedbf7c6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedb80cae90 0x7fedb8149380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:43.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.260+0000 7fedbf7c6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb8149870 con 0x7fedb80cae90 2023-11-30T18:22:43.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.260+0000 7fedbf7c6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb80c7c00 con 0x7fedb80caab0 2023-11-30T18:22:43.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.260+0000 7fedbf7c6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb80c6ff0 con 0x7fedb80ca180 2023-11-30T18:22:43.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.260+0000 7fedbdd63700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedb80cae90 0x7fedb8149380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:43.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.260+0000 7fedbdd63700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedb80cae90 0x7fedb8149380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36892/0 (socket says 172.21.15.49:36892) 2023-11-30T18:22:43.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.260+0000 7fedbdd63700 1 -- 172.21.15.49:0/1385803865 learned_addr learned my addr 172.21.15.49:0/1385803865 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:43.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.260+0000 7fedbd562700 1 --2- 172.21.15.49:0/1385803865 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fedb80ca180 0x7fedb8151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:43.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.260+0000 7fedbcd61700 1 --2- 172.21.15.49:0/1385803865 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb80caab0 0x7fedb8148e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:43.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.260+0000 7fedbdd63700 1 -- 172.21.15.49:0/1385803865 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fedb80ca180 msgr2=0x7fedb8151b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:43.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.260+0000 7fedbdd63700 1 --2- 172.21.15.49:0/1385803865 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fedb80ca180 0x7fedb8151b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:43.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.260+0000 7fedbdd63700 1 -- 172.21.15.49:0/1385803865 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb80caab0 msgr2=0x7fedb8148e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:43.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.260+0000 7fedbdd63700 1 --2- 172.21.15.49:0/1385803865 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb80caab0 0x7fedb8148e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:43.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.260+0000 7fedbdd63700 1 -- 172.21.15.49:0/1385803865 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda8009a20 con 0x7fedb80cae90 2023-11-30T18:22:43.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.261+0000 7fedbdd63700 1 --2- 172.21.15.49:0/1385803865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedb80cae90 0x7fedb8149380 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7fedb8083c30 tx=0x7feda8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:43.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.261+0000 7fedb57fa700 1 -- 172.21.15.49:0/1385803865 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda8012410 con 0x7fedb80cae90 2023-11-30T18:22:43.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.261+0000 7fedb57fa700 1 -- 172.21.15.49:0/1385803865 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda801d630 con 0x7fedb80cae90 2023-11-30T18:22:43.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.261+0000 7fedbf7c6700 1 -- 172.21.15.49:0/1385803865 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb80c72d0 con 0x7fedb80cae90 2023-11-30T18:22:43.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.261+0000 7fedb57fa700 1 -- 172.21.15.49:0/1385803865 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda801d9f0 con 0x7fedb80cae90 2023-11-30T18:22:43.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.261+0000 7fedbf7c6700 1 -- 172.21.15.49:0/1385803865 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb80c7890 con 0x7fedb80cae90 2023-11-30T18:22:43.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.262+0000 7fedbf7c6700 1 -- 172.21.15.49:0/1385803865 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb806c860 con 0x7fedb80cae90 2023-11-30T18:22:43.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.262+0000 7fedb57fa700 1 -- 172.21.15.49:0/1385803865 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 68) v1 ==== 75548+0+0 (secure 0 0 0) 0x7feda8026410 con 0x7fedb80cae90 2023-11-30T18:22:43.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.263+0000 7fedb57fa700 1 --2- 172.21.15.49:0/1385803865 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7feda405f240 0x7feda4061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:43.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.263+0000 7fedb57fa700 1 -- 172.21.15.49:0/1385803865 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6177+0+0 (secure 0 0 0) 0x7feda807c100 con 0x7fedb80cae90 2023-11-30T18:22:43.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.263+0000 7fedbd562700 1 --2- 172.21.15.49:0/1385803865 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7feda405f240 0x7feda4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:43.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.263+0000 7fedbd562700 1 --2- 172.21.15.49:0/1385803865 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7feda405f240 0x7feda4061700 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fedb0007fd0 tx=0x7fedb0009040).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:43.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.267+0000 7fedb57fa700 1 -- 172.21.15.49:0/1385803865 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7feda804d270 con 0x7fedb80cae90 2023-11-30T18:22:43.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.434+0000 7fedbf7c6700 1 -- 172.21.15.49:0/1385803865 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fedb80c7d40 con 0x7feda405f240 2023-11-30T18:22:43.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.446+0000 7fedb57fa700 1 -- 172.21.15.49:0/1385803865 <== mgr.7052 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362177 (secure 0 0 0) 0x7fedb80c7d40 con 0x7feda405f240 2023-11-30T18:22:43.447 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:22:43.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.449+0000 7fedbf7c6700 1 -- 172.21.15.49:0/1385803865 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7feda405f240 msgr2=0x7feda4061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:43.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.449+0000 7fedbf7c6700 1 --2- 172.21.15.49:0/1385803865 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7feda405f240 0x7feda4061700 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fedb0007fd0 tx=0x7fedb0009040).stop 2023-11-30T18:22:43.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.449+0000 7fedbf7c6700 1 -- 172.21.15.49:0/1385803865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedb80cae90 msgr2=0x7fedb8149380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:43.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.449+0000 7fedbf7c6700 1 --2- 172.21.15.49:0/1385803865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedb80cae90 0x7fedb8149380 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7fedb8083c30 tx=0x7feda8009780).stop 2023-11-30T18:22:43.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.449+0000 7fedbf7c6700 1 -- 172.21.15.49:0/1385803865 shutdown_connections 2023-11-30T18:22:43.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.449+0000 7fedbf7c6700 1 --2- 172.21.15.49:0/1385803865 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7feda405f240 0x7feda4061700 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:43.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.449+0000 7fedbf7c6700 1 --2- 172.21.15.49:0/1385803865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedb80cae90 0x7fedb8149380 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:43.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.449+0000 7fedbf7c6700 1 --2- 172.21.15.49:0/1385803865 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fedb80ca180 0x7fedb8151b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:43.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.449+0000 7fedbf7c6700 1 --2- 172.21.15.49:0/1385803865 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb80caab0 0x7fedb8148e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:43.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.450+0000 7fedbf7c6700 1 -- 172.21.15.49:0/1385803865 >> 172.21.15.49:0/1385803865 conn(0x7fedb8094920 msgr2=0x7fedb80a7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:43.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.450+0000 7fedbf7c6700 1 -- 172.21.15.49:0/1385803865 shutdown_connections 2023-11-30T18:22:43.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.450+0000 7fedbf7c6700 1 -- 172.21.15.49:0/1385803865 wait complete. 2023-11-30T18:22:43.455 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T18:22:43.462 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-30T18:22:42.000513+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2458772,"kb_used_data":16468,"kb_used_omap":0,"kb_used_meta":2442240,"kb_avail":752515948,"statfs":{"total":773094113280,"available":770576330752,"internally_reserved":0,"allocated":16863232,"data_stored":8585332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2500853760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5037797,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-520,"num_write_kb":-5313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.694433"},"pg_stats":[{"pgid":"20.38","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.459521+0000","last_change":"2023-11-30T18:22:39.448243+0000","last_active":"2023-11-30T18:22:39.459521+0000","last_peered":"2023-11-30T18:22:39.459521+0000","last_clean":"2023-11-30T18:22:39.459521+0000","last_became_active":"2023-11-30T18:22:39.447924+0000","last_became_peered":"2023-11-30T18:22:39.447924+0000","last_unstale":"2023-11-30T18:22:39.459521+0000","last_undegraded":"2023-11-30T18:22:39.459521+0000","last_fullsized":"2023-11-30T18:22:39.459521+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3f","version":"168'3","reported_seq":13,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.442643+0000","last_change":"2023-11-30T18:22:39.060071+0000","last_active":"2023-11-30T18:22:39.442643+0000","last_peered":"2023-11-30T18:22:39.442643+0000","last_clean":"2023-11-30T18:22:39.442643+0000","last_became_active":"2023-11-30T18:22:39.059789+0000","last_became_peered":"2023-11-30T18:22:39.059789+0000","last_unstale":"2023-11-30T18:22:39.442643+0000","last_undegraded":"2023-11-30T18:22:39.442643+0000","last_fullsized":"2023-11-30T18:22:39.442643+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.459956+0000","last_change":"2023-11-30T18:22:39.458951+0000","last_active":"2023-11-30T18:22:39.459956+0000","last_peered":"2023-11-30T18:22:39.459956+0000","last_clean":"2023-11-30T18:22:39.459956+0000","last_became_active":"2023-11-30T18:22:39.458653+0000","last_became_peered":"2023-11-30T18:22:39.458653+0000","last_unstale":"2023-11-30T18:22:39.459956+0000","last_undegraded":"2023-11-30T18:22:39.459956+0000","last_fullsized":"2023-11-30T18:22:39.459956+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.438315+0000","last_change":"2023-11-30T18:22:39.056686+0000","last_active":"2023-11-30T18:22:39.438315+0000","last_peered":"2023-11-30T18:22:39.438315+0000","last_clean":"2023-11-30T18:22:39.438315+0000","last_became_active":"2023-11-30T18:22:39.056356+0000","last_became_peered":"2023-11-30T18:22:39.056356+0000","last_unstale":"2023-11-30T18:22:39.438315+0000","last_undegraded":"2023-11-30T18:22:39.438315+0000","last_fullsized":"2023-11-30T18:22:39.438315+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.459559+0000","last_change":"2023-11-30T18:22:39.458190+0000","last_active":"2023-11-30T18:22:39.459559+0000","last_peered":"2023-11-30T18:22:39.459559+0000","last_clean":"2023-11-30T18:22:39.459559+0000","last_became_active":"2023-11-30T18:22:39.457909+0000","last_became_peered":"2023-11-30T18:22:39.457909+0000","last_unstale":"2023-11-30T18:22:39.459559+0000","last_undegraded":"2023-11-30T18:22:39.459559+0000","last_fullsized":"2023-11-30T18:22:39.459559+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.442543+0000","last_change":"2023-11-30T18:22:39.056857+0000","last_active":"2023-11-30T18:22:39.442543+0000","last_peered":"2023-11-30T18:22:39.442543+0000","last_clean":"2023-11-30T18:22:39.442543+0000","last_became_active":"2023-11-30T18:22:39.056413+0000","last_became_peered":"2023-11-30T18:22:39.056413+0000","last_unstale":"2023-11-30T18:22:39.442543+0000","last_undegraded":"2023-11-30T18:22:39.442543+0000","last_fullsized":"2023-11-30T18:22:39.442543+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.457227+0000","last_change":"2023-11-30T18:22:39.455105+0000","last_active":"2023-11-30T18:22:39.457227+0000","last_peered":"2023-11-30T18:22:39.457227+0000","last_clean":"2023-11-30T18:22:39.457227+0000","last_became_active":"2023-11-30T18:22:39.454774+0000","last_became_peered":"2023-11-30T18:22:39.454774+0000","last_unstale":"2023-11-30T18:22:39.457227+0000","last_undegraded":"2023-11-30T18:22:39.457227+0000","last_fullsized":"2023-11-30T18:22:39.457227+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"168'2","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.442913+0000","last_change":"2023-11-30T18:22:39.058274+0000","last_active":"2023-11-30T18:22:39.442913+0000","last_peered":"2023-11-30T18:22:39.442913+0000","last_clean":"2023-11-30T18:22:39.442913+0000","last_became_active":"2023-11-30T18:22:39.057986+0000","last_became_peered":"2023-11-30T18:22:39.057986+0000","last_unstale":"2023-11-30T18:22:39.442913+0000","last_undegraded":"2023-11-30T18:22:39.442913+0000","last_fullsized":"2023-11-30T18:22:39.442913+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.449984+0000","last_change":"2023-11-30T18:22:39.446405+0000","last_active":"2023-11-30T18:22:39.449984+0000","last_peered":"2023-11-30T18:22:39.449984+0000","last_clean":"2023-11-30T18:22:39.449984+0000","last_became_active":"2023-11-30T18:22:39.446050+0000","last_became_peered":"2023-11-30T18:22:39.446050+0000","last_unstale":"2023-11-30T18:22:39.449984+0000","last_undegraded":"2023-11-30T18:22:39.449984+0000","last_fullsized":"2023-11-30T18:22:39.449984+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"168'1","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.455317+0000","last_change":"2023-11-30T18:22:39.060932+0000","last_active":"2023-11-30T18:22:39.455317+0000","last_peered":"2023-11-30T18:22:39.455317+0000","last_clean":"2023-11-30T18:22:39.455317+0000","last_became_active":"2023-11-30T18:22:39.060289+0000","last_became_peered":"2023-11-30T18:22:39.060289+0000","last_unstale":"2023-11-30T18:22:39.455317+0000","last_undegraded":"2023-11-30T18:22:39.455317+0000","last_fullsized":"2023-11-30T18:22:39.455317+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.459452+0000","last_change":"2023-11-30T18:22:39.454905+0000","last_active":"2023-11-30T18:22:39.459452+0000","last_peered":"2023-11-30T18:22:39.459452+0000","last_clean":"2023-11-30T18:22:39.459452+0000","last_became_active":"2023-11-30T18:22:39.454588+0000","last_became_peered":"2023-11-30T18:22:39.454588+0000","last_unstale":"2023-11-30T18:22:39.459452+0000","last_undegraded":"2023-11-30T18:22:39.459452+0000","last_fullsized":"2023-11-30T18:22:39.459452+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3a","version":"168'1","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.449415+0000","last_change":"2023-11-30T18:22:39.052992+0000","last_active":"2023-11-30T18:22:39.449415+0000","last_peered":"2023-11-30T18:22:39.449415+0000","last_clean":"2023-11-30T18:22:39.449415+0000","last_became_active":"2023-11-30T18:22:39.052051+0000","last_became_peered":"2023-11-30T18:22:39.052051+0000","last_unstale":"2023-11-30T18:22:39.449415+0000","last_undegraded":"2023-11-30T18:22:39.449415+0000","last_fullsized":"2023-11-30T18:22:39.449415+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.454201+0000","last_change":"2023-11-30T18:22:39.451078+0000","last_active":"2023-11-30T18:22:39.454201+0000","last_peered":"2023-11-30T18:22:39.454201+0000","last_clean":"2023-11-30T18:22:39.454201+0000","last_became_active":"2023-11-30T18:22:39.450122+0000","last_became_peered":"2023-11-30T18:22:39.450122+0000","last_unstale":"2023-11-30T18:22:39.454201+0000","last_undegraded":"2023-11-30T18:22:39.454201+0000","last_fullsized":"2023-11-30T18:22:39.454201+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.440619+0000","last_change":"2023-11-30T18:22:39.053789+0000","last_active":"2023-11-30T18:22:39.440619+0000","last_peered":"2023-11-30T18:22:39.440619+0000","last_clean":"2023-11-30T18:22:39.440619+0000","last_became_active":"2023-11-30T18:22:39.053466+0000","last_became_peered":"2023-11-30T18:22:39.053466+0000","last_unstale":"2023-11-30T18:22:39.440619+0000","last_undegraded":"2023-11-30T18:22:39.440619+0000","last_fullsized":"2023-11-30T18:22:39.440619+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.444549+0000","last_change":"2023-11-30T18:22:39.439777+0000","last_active":"2023-11-30T18:22:39.444549+0000","last_peered":"2023-11-30T18:22:39.444549+0000","last_clean":"2023-11-30T18:22:39.444549+0000","last_became_active":"2023-11-30T18:22:39.439484+0000","last_became_peered":"2023-11-30T18:22:39.439484+0000","last_unstale":"2023-11-30T18:22:39.444549+0000","last_undegraded":"2023-11-30T18:22:39.444549+0000","last_fullsized":"2023-11-30T18:22:39.444549+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.443650+0000","last_change":"2023-11-30T18:22:39.056766+0000","last_active":"2023-11-30T18:22:39.443650+0000","last_peered":"2023-11-30T18:22:39.443650+0000","last_clean":"2023-11-30T18:22:39.443650+0000","last_became_active":"2023-11-30T18:22:39.056113+0000","last_became_peered":"2023-11-30T18:22:39.056113+0000","last_unstale":"2023-11-30T18:22:39.443650+0000","last_undegraded":"2023-11-30T18:22:39.443650+0000","last_fullsized":"2023-11-30T18:22:39.443650+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.457912+0000","last_change":"2023-11-30T18:22:39.456567+0000","last_active":"2023-11-30T18:22:39.457912+0000","last_peered":"2023-11-30T18:22:39.457912+0000","last_clean":"2023-11-30T18:22:39.457912+0000","last_became_active":"2023-11-30T18:22:39.455988+0000","last_became_peered":"2023-11-30T18:22:39.455988+0000","last_unstale":"2023-11-30T18:22:39.457912+0000","last_undegraded":"2023-11-30T18:22:39.457912+0000","last_fullsized":"2023-11-30T18:22:39.457912+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.438714+0000","last_change":"2023-11-30T18:22:39.058789+0000","last_active":"2023-11-30T18:22:39.438714+0000","last_peered":"2023-11-30T18:22:39.438714+0000","last_clean":"2023-11-30T18:22:39.438714+0000","last_became_active":"2023-11-30T18:22:39.058464+0000","last_became_peered":"2023-11-30T18:22:39.058464+0000","last_unstale":"2023-11-30T18:22:39.438714+0000","last_undegraded":"2023-11-30T18:22:39.438714+0000","last_fullsized":"2023-11-30T18:22:39.438714+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.450476+0000","last_change":"2023-11-30T18:22:39.449145+0000","last_active":"2023-11-30T18:22:39.450476+0000","last_peered":"2023-11-30T18:22:39.450476+0000","last_clean":"2023-11-30T18:22:39.450476+0000","last_became_active":"2023-11-30T18:22:39.448878+0000","last_became_peered":"2023-11-30T18:22:39.448878+0000","last_unstale":"2023-11-30T18:22:39.450476+0000","last_undegraded":"2023-11-30T18:22:39.450476+0000","last_fullsized":"2023-11-30T18:22:39.450476+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.438413+0000","last_change":"2023-11-30T18:22:39.056457+0000","last_active":"2023-11-30T18:22:39.438413+0000","last_peered":"2023-11-30T18:22:39.438413+0000","last_clean":"2023-11-30T18:22:39.438413+0000","last_became_active":"2023-11-30T18:22:39.055960+0000","last_became_peered":"2023-11-30T18:22:39.055960+0000","last_unstale":"2023-11-30T18:22:39.438413+0000","last_undegraded":"2023-11-30T18:22:39.438413+0000","last_fullsized":"2023-11-30T18:22:39.438413+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.453332+0000","last_change":"2023-11-30T18:22:39.452517+0000","last_active":"2023-11-30T18:22:39.453332+0000","last_peered":"2023-11-30T18:22:39.453332+0000","last_clean":"2023-11-30T18:22:39.453332+0000","last_became_active":"2023-11-30T18:22:39.452178+0000","last_became_peered":"2023-11-30T18:22:39.452178+0000","last_unstale":"2023-11-30T18:22:39.453332+0000","last_undegraded":"2023-11-30T18:22:39.453332+0000","last_fullsized":"2023-11-30T18:22:39.453332+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.435144+0000","last_change":"2023-11-30T18:22:39.053035+0000","last_active":"2023-11-30T18:22:39.435144+0000","last_peered":"2023-11-30T18:22:39.435144+0000","last_clean":"2023-11-30T18:22:39.435144+0000","last_became_active":"2023-11-30T18:22:39.052707+0000","last_became_peered":"2023-11-30T18:22:39.052707+0000","last_unstale":"2023-11-30T18:22:39.435144+0000","last_undegraded":"2023-11-30T18:22:39.435144+0000","last_fullsized":"2023-11-30T18:22:39.435144+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.460801+0000","last_change":"2023-11-30T18:22:39.460392+0000","last_active":"2023-11-30T18:22:39.460801+0000","last_peered":"2023-11-30T18:22:39.460801+0000","last_clean":"2023-11-30T18:22:39.460801+0000","last_became_active":"2023-11-30T18:22:39.460064+0000","last_became_peered":"2023-11-30T18:22:39.460064+0000","last_unstale":"2023-11-30T18:22:39.460801+0000","last_undegraded":"2023-11-30T18:22:39.460801+0000","last_fullsized":"2023-11-30T18:22:39.460801+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.34","version":"168'4","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.466610+0000","last_change":"2023-11-30T18:22:39.057631+0000","last_active":"2023-11-30T18:22:39.466610+0000","last_peered":"2023-11-30T18:22:39.466610+0000","last_clean":"2023-11-30T18:22:39.466610+0000","last_became_active":"2023-11-30T18:22:39.057336+0000","last_became_peered":"2023-11-30T18:22:39.057336+0000","last_unstale":"2023-11-30T18:22:39.466610+0000","last_undegraded":"2023-11-30T18:22:39.466610+0000","last_fullsized":"2023-11-30T18:22:39.466610+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.457569+0000","last_change":"2023-11-30T18:22:39.456375+0000","last_active":"2023-11-30T18:22:39.457569+0000","last_peered":"2023-11-30T18:22:39.457569+0000","last_clean":"2023-11-30T18:22:39.457569+0000","last_became_active":"2023-11-30T18:22:39.456110+0000","last_became_peered":"2023-11-30T18:22:39.456110+0000","last_unstale":"2023-11-30T18:22:39.457569+0000","last_undegraded":"2023-11-30T18:22:39.457569+0000","last_fullsized":"2023-11-30T18:22:39.457569+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.33","version":"168'1","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.439102+0000","last_change":"2023-11-30T18:22:39.060652+0000","last_active":"2023-11-30T18:22:39.439102+0000","last_peered":"2023-11-30T18:22:39.439102+0000","last_clean":"2023-11-30T18:22:39.439102+0000","last_became_active":"2023-11-30T18:22:39.060367+0000","last_became_peered":"2023-11-30T18:22:39.060367+0000","last_unstale":"2023-11-30T18:22:39.439102+0000","last_undegraded":"2023-11-30T18:22:39.439102+0000","last_fullsized":"2023-11-30T18:22:39.439102+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.461908+0000","last_change":"2023-11-30T18:22:39.458309+0000","last_active":"2023-11-30T18:22:39.461908+0000","last_peered":"2023-11-30T18:22:39.461908+0000","last_clean":"2023-11-30T18:22:39.461908+0000","last_became_active":"2023-11-30T18:22:39.458053+0000","last_became_peered":"2023-11-30T18:22:39.458053+0000","last_unstale":"2023-11-30T18:22:39.461908+0000","last_undegraded":"2023-11-30T18:22:39.461908+0000","last_fullsized":"2023-11-30T18:22:39.461908+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.437590+0000","last_change":"2023-11-30T18:22:39.065520+0000","last_active":"2023-11-30T18:22:39.437590+0000","last_peered":"2023-11-30T18:22:39.437590+0000","last_clean":"2023-11-30T18:22:39.437590+0000","last_became_active":"2023-11-30T18:22:39.065163+0000","last_became_peered":"2023-11-30T18:22:39.065163+0000","last_unstale":"2023-11-30T18:22:39.437590+0000","last_undegraded":"2023-11-30T18:22:39.437590+0000","last_fullsized":"2023-11-30T18:22:39.437590+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.448449+0000","last_change":"2023-11-30T18:22:39.447335+0000","last_active":"2023-11-30T18:22:39.448449+0000","last_peered":"2023-11-30T18:22:39.448449+0000","last_clean":"2023-11-30T18:22:39.448449+0000","last_became_active":"2023-11-30T18:22:39.447098+0000","last_became_peered":"2023-11-30T18:22:39.447098+0000","last_unstale":"2023-11-30T18:22:39.448449+0000","last_undegraded":"2023-11-30T18:22:39.448449+0000","last_fullsized":"2023-11-30T18:22:39.448449+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.430782+0000","last_change":"2023-11-30T18:22:39.062156+0000","last_active":"2023-11-30T18:22:39.430782+0000","last_peered":"2023-11-30T18:22:39.430782+0000","last_clean":"2023-11-30T18:22:39.430782+0000","last_became_active":"2023-11-30T18:22:39.061897+0000","last_became_peered":"2023-11-30T18:22:39.061897+0000","last_unstale":"2023-11-30T18:22:39.430782+0000","last_undegraded":"2023-11-30T18:22:39.430782+0000","last_fullsized":"2023-11-30T18:22:39.430782+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.448583+0000","last_change":"2023-11-30T18:22:39.447723+0000","last_active":"2023-11-30T18:22:39.448583+0000","last_peered":"2023-11-30T18:22:39.448583+0000","last_clean":"2023-11-30T18:22:39.448583+0000","last_became_active":"2023-11-30T18:22:39.447285+0000","last_became_peered":"2023-11-30T18:22:39.447285+0000","last_unstale":"2023-11-30T18:22:39.448583+0000","last_undegraded":"2023-11-30T18:22:39.448583+0000","last_fullsized":"2023-11-30T18:22:39.448583+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.30","version":"168'4","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.455206+0000","last_change":"2023-11-30T18:22:39.052826+0000","last_active":"2023-11-30T18:22:39.455206+0000","last_peered":"2023-11-30T18:22:39.455206+0000","last_clean":"2023-11-30T18:22:39.455206+0000","last_became_active":"2023-11-30T18:22:39.047108+0000","last_became_peered":"2023-11-30T18:22:39.047108+0000","last_unstale":"2023-11-30T18:22:39.455206+0000","last_undegraded":"2023-11-30T18:22:39.455206+0000","last_fullsized":"2023-11-30T18:22:39.455206+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.449381+0000","last_change":"2023-11-30T18:22:39.448578+0000","last_active":"2023-11-30T18:22:39.449381+0000","last_peered":"2023-11-30T18:22:39.449381+0000","last_clean":"2023-11-30T18:22:39.449381+0000","last_became_active":"2023-11-30T18:22:39.448279+0000","last_became_peered":"2023-11-30T18:22:39.448279+0000","last_unstale":"2023-11-30T18:22:39.449381+0000","last_undegraded":"2023-11-30T18:22:39.449381+0000","last_fullsized":"2023-11-30T18:22:39.449381+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.443311+0000","last_change":"2023-11-30T18:22:39.056470+0000","last_active":"2023-11-30T18:22:39.443311+0000","last_peered":"2023-11-30T18:22:39.443311+0000","last_clean":"2023-11-30T18:22:39.443311+0000","last_became_active":"2023-11-30T18:22:39.056134+0000","last_became_peered":"2023-11-30T18:22:39.056134+0000","last_unstale":"2023-11-30T18:22:39.443311+0000","last_undegraded":"2023-11-30T18:22:39.443311+0000","last_fullsized":"2023-11-30T18:22:39.443311+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.460581+0000","last_change":"2023-11-30T18:22:39.453263+0000","last_active":"2023-11-30T18:22:39.460581+0000","last_peered":"2023-11-30T18:22:39.460581+0000","last_clean":"2023-11-30T18:22:39.460581+0000","last_became_active":"2023-11-30T18:22:39.452912+0000","last_became_peered":"2023-11-30T18:22:39.452912+0000","last_unstale":"2023-11-30T18:22:39.460581+0000","last_undegraded":"2023-11-30T18:22:39.460581+0000","last_fullsized":"2023-11-30T18:22:39.460581+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.441226+0000","last_change":"2023-11-30T18:22:39.062306+0000","last_active":"2023-11-30T18:22:39.441226+0000","last_peered":"2023-11-30T18:22:39.441226+0000","last_clean":"2023-11-30T18:22:39.441226+0000","last_became_active":"2023-11-30T18:22:39.061781+0000","last_became_peered":"2023-11-30T18:22:39.061781+0000","last_unstale":"2023-11-30T18:22:39.441226+0000","last_undegraded":"2023-11-30T18:22:39.441226+0000","last_fullsized":"2023-11-30T18:22:39.441226+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.453136+0000","last_change":"2023-11-30T18:22:39.452439+0000","last_active":"2023-11-30T18:22:39.453136+0000","last_peered":"2023-11-30T18:22:39.453136+0000","last_clean":"2023-11-30T18:22:39.453136+0000","last_became_active":"2023-11-30T18:22:39.451782+0000","last_became_peered":"2023-11-30T18:22:39.451782+0000","last_unstale":"2023-11-30T18:22:39.453136+0000","last_undegraded":"2023-11-30T18:22:39.453136+0000","last_fullsized":"2023-11-30T18:22:39.453136+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.2d","version":"168'1","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.448440+0000","last_change":"2023-11-30T18:22:39.056875+0000","last_active":"2023-11-30T18:22:39.448440+0000","last_peered":"2023-11-30T18:22:39.448440+0000","last_clean":"2023-11-30T18:22:39.448440+0000","last_became_active":"2023-11-30T18:22:39.056488+0000","last_became_peered":"2023-11-30T18:22:39.056488+0000","last_unstale":"2023-11-30T18:22:39.448440+0000","last_undegraded":"2023-11-30T18:22:39.448440+0000","last_fullsized":"2023-11-30T18:22:39.448440+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.450911+0000","last_change":"2023-11-30T18:22:39.446555+0000","last_active":"2023-11-30T18:22:39.450911+0000","last_peered":"2023-11-30T18:22:39.450911+0000","last_clean":"2023-11-30T18:22:39.450911+0000","last_became_active":"2023-11-30T18:22:39.446258+0000","last_became_peered":"2023-11-30T18:22:39.446258+0000","last_unstale":"2023-11-30T18:22:39.450911+0000","last_undegraded":"2023-11-30T18:22:39.450911+0000","last_fullsized":"2023-11-30T18:22:39.450911+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.441807+0000","last_change":"2023-11-30T18:22:39.062736+0000","last_active":"2023-11-30T18:22:39.441807+0000","last_peered":"2023-11-30T18:22:39.441807+0000","last_clean":"2023-11-30T18:22:39.441807+0000","last_became_active":"2023-11-30T18:22:39.061095+0000","last_became_peered":"2023-11-30T18:22:39.061095+0000","last_unstale":"2023-11-30T18:22:39.441807+0000","last_undegraded":"2023-11-30T18:22:39.441807+0000","last_fullsized":"2023-11-30T18:22:39.441807+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.455652+0000","last_change":"2023-11-30T18:22:39.454399+0000","last_active":"2023-11-30T18:22:39.455652+0000","last_peered":"2023-11-30T18:22:39.455652+0000","last_clean":"2023-11-30T18:22:39.455652+0000","last_became_active":"2023-11-30T18:22:39.454140+0000","last_became_peered":"2023-11-30T18:22:39.454140+0000","last_unstale":"2023-11-30T18:22:39.455652+0000","last_undegraded":"2023-11-30T18:22:39.455652+0000","last_fullsized":"2023-11-30T18:22:39.455652+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"168'1","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.454923+0000","last_change":"2023-11-30T18:22:39.060703+0000","last_active":"2023-11-30T18:22:39.454923+0000","last_peered":"2023-11-30T18:22:39.454923+0000","last_clean":"2023-11-30T18:22:39.454923+0000","last_became_active":"2023-11-30T18:22:39.060306+0000","last_became_peered":"2023-11-30T18:22:39.060306+0000","last_unstale":"2023-11-30T18:22:39.454923+0000","last_undegraded":"2023-11-30T18:22:39.454923+0000","last_fullsized":"2023-11-30T18:22:39.454923+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.464103+0000","last_change":"2023-11-30T18:22:39.460643+0000","last_active":"2023-11-30T18:22:39.464103+0000","last_peered":"2023-11-30T18:22:39.464103+0000","last_clean":"2023-11-30T18:22:39.464103+0000","last_became_active":"2023-11-30T18:22:39.460359+0000","last_became_peered":"2023-11-30T18:22:39.460359+0000","last_unstale":"2023-11-30T18:22:39.464103+0000","last_undegraded":"2023-11-30T18:22:39.464103+0000","last_fullsized":"2023-11-30T18:22:39.464103+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.434546+0000","last_change":"2023-11-30T18:22:39.052313+0000","last_active":"2023-11-30T18:22:39.434546+0000","last_peered":"2023-11-30T18:22:39.434546+0000","last_clean":"2023-11-30T18:22:39.434546+0000","last_became_active":"2023-11-30T18:22:39.052028+0000","last_became_peered":"2023-11-30T18:22:39.052028+0000","last_unstale":"2023-11-30T18:22:39.434546+0000","last_undegraded":"2023-11-30T18:22:39.434546+0000","last_fullsized":"2023-11-30T18:22:39.434546+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.457203+0000","last_change":"2023-11-30T18:22:39.454642+0000","last_active":"2023-11-30T18:22:39.457203+0000","last_peered":"2023-11-30T18:22:39.457203+0000","last_clean":"2023-11-30T18:22:39.457203+0000","last_became_active":"2023-11-30T18:22:39.454351+0000","last_became_peered":"2023-11-30T18:22:39.454351+0000","last_unstale":"2023-11-30T18:22:39.457203+0000","last_undegraded":"2023-11-30T18:22:39.457203+0000","last_fullsized":"2023-11-30T18:22:39.457203+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.445441+0000","last_change":"2023-11-30T18:22:39.060274+0000","last_active":"2023-11-30T18:22:39.445441+0000","last_peered":"2023-11-30T18:22:39.445441+0000","last_clean":"2023-11-30T18:22:39.445441+0000","last_became_active":"2023-11-30T18:22:39.059206+0000","last_became_peered":"2023-11-30T18:22:39.059206+0000","last_unstale":"2023-11-30T18:22:39.445441+0000","last_undegraded":"2023-11-30T18:22:39.445441+0000","last_fullsized":"2023-11-30T18:22:39.445441+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.457361+0000","last_change":"2023-11-30T18:22:39.455095+0000","last_active":"2023-11-30T18:22:39.457361+0000","last_peered":"2023-11-30T18:22:39.457361+0000","last_clean":"2023-11-30T18:22:39.457361+0000","last_became_active":"2023-11-30T18:22:39.454812+0000","last_became_peered":"2023-11-30T18:22:39.454812+0000","last_unstale":"2023-11-30T18:22:39.457361+0000","last_undegraded":"2023-11-30T18:22:39.457361+0000","last_fullsized":"2023-11-30T18:22:39.457361+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.433996+0000","last_change":"2023-11-30T18:22:39.057385+0000","last_active":"2023-11-30T18:22:39.433996+0000","last_peered":"2023-11-30T18:22:39.433996+0000","last_clean":"2023-11-30T18:22:39.433996+0000","last_became_active":"2023-11-30T18:22:39.057080+0000","last_became_peered":"2023-11-30T18:22:39.057080+0000","last_unstale":"2023-11-30T18:22:39.433996+0000","last_undegraded":"2023-11-30T18:22:39.433996+0000","last_fullsized":"2023-11-30T18:22:39.433996+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.445435+0000","last_change":"2023-11-30T18:22:39.443927+0000","last_active":"2023-11-30T18:22:39.445435+0000","last_peered":"2023-11-30T18:22:39.445435+0000","last_clean":"2023-11-30T18:22:39.445435+0000","last_became_active":"2023-11-30T18:22:39.443646+0000","last_became_peered":"2023-11-30T18:22:39.443646+0000","last_unstale":"2023-11-30T18:22:39.445435+0000","last_undegraded":"2023-11-30T18:22:39.445435+0000","last_fullsized":"2023-11-30T18:22:39.445435+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.438455+0000","last_change":"2023-11-30T18:22:39.059159+0000","last_active":"2023-11-30T18:22:39.438455+0000","last_peered":"2023-11-30T18:22:39.438455+0000","last_clean":"2023-11-30T18:22:39.438455+0000","last_became_active":"2023-11-30T18:22:39.058889+0000","last_became_peered":"2023-11-30T18:22:39.058889+0000","last_unstale":"2023-11-30T18:22:39.438455+0000","last_undegraded":"2023-11-30T18:22:39.438455+0000","last_fullsized":"2023-11-30T18:22:39.438455+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.454402+0000","last_change":"2023-11-30T18:22:39.444887+0000","last_active":"2023-11-30T18:22:39.454402+0000","last_peered":"2023-11-30T18:22:39.454402+0000","last_clean":"2023-11-30T18:22:39.454402+0000","last_became_active":"2023-11-30T18:22:39.444618+0000","last_became_peered":"2023-11-30T18:22:39.444618+0000","last_unstale":"2023-11-30T18:22:39.454402+0000","last_undegraded":"2023-11-30T18:22:39.454402+0000","last_fullsized":"2023-11-30T18:22:39.454402+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.441109+0000","last_change":"2023-11-30T18:22:39.057242+0000","last_active":"2023-11-30T18:22:39.441109+0000","last_peered":"2023-11-30T18:22:39.441109+0000","last_clean":"2023-11-30T18:22:39.441109+0000","last_became_active":"2023-11-30T18:22:39.056542+0000","last_became_peered":"2023-11-30T18:22:39.056542+0000","last_unstale":"2023-11-30T18:22:39.441109+0000","last_undegraded":"2023-11-30T18:22:39.441109+0000","last_fullsized":"2023-11-30T18:22:39.441109+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.461645+0000","last_change":"2023-11-30T18:22:39.456817+0000","last_active":"2023-11-30T18:22:39.461645+0000","last_peered":"2023-11-30T18:22:39.461645+0000","last_clean":"2023-11-30T18:22:39.461645+0000","last_became_active":"2023-11-30T18:22:39.456443+0000","last_became_peered":"2023-11-30T18:22:39.456443+0000","last_unstale":"2023-11-30T18:22:39.461645+0000","last_undegraded":"2023-11-30T18:22:39.461645+0000","last_fullsized":"2023-11-30T18:22:39.461645+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.430430+0000","last_change":"2023-11-30T18:22:39.059063+0000","last_active":"2023-11-30T18:22:39.430430+0000","last_peered":"2023-11-30T18:22:39.430430+0000","last_clean":"2023-11-30T18:22:39.430430+0000","last_became_active":"2023-11-30T18:22:39.058720+0000","last_became_peered":"2023-11-30T18:22:39.058720+0000","last_unstale":"2023-11-30T18:22:39.430430+0000","last_undegraded":"2023-11-30T18:22:39.430430+0000","last_fullsized":"2023-11-30T18:22:39.430430+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.461699+0000","last_change":"2023-11-30T18:22:39.458012+0000","last_active":"2023-11-30T18:22:39.461699+0000","last_peered":"2023-11-30T18:22:39.461699+0000","last_clean":"2023-11-30T18:22:39.461699+0000","last_became_active":"2023-11-30T18:22:39.456381+0000","last_became_peered":"2023-11-30T18:22:39.456381+0000","last_unstale":"2023-11-30T18:22:39.461699+0000","last_undegraded":"2023-11-30T18:22:39.461699+0000","last_fullsized":"2023-11-30T18:22:39.461699+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.442454+0000","last_change":"2023-11-30T18:22:39.061319+0000","last_active":"2023-11-30T18:22:39.442454+0000","last_peered":"2023-11-30T18:22:39.442454+0000","last_clean":"2023-11-30T18:22:39.442454+0000","last_became_active":"2023-11-30T18:22:39.061034+0000","last_became_peered":"2023-11-30T18:22:39.061034+0000","last_unstale":"2023-11-30T18:22:39.442454+0000","last_undegraded":"2023-11-30T18:22:39.442454+0000","last_fullsized":"2023-11-30T18:22:39.442454+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.451234+0000","last_change":"2023-11-30T18:22:39.449374+0000","last_active":"2023-11-30T18:22:39.451234+0000","last_peered":"2023-11-30T18:22:39.451234+0000","last_clean":"2023-11-30T18:22:39.451234+0000","last_became_active":"2023-11-30T18:22:39.449110+0000","last_became_peered":"2023-11-30T18:22:39.449110+0000","last_unstale":"2023-11-30T18:22:39.451234+0000","last_undegraded":"2023-11-30T18:22:39.451234+0000","last_fullsized":"2023-11-30T18:22:39.451234+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.431188+0000","last_change":"2023-11-30T18:22:39.052584+0000","last_active":"2023-11-30T18:22:39.431188+0000","last_peered":"2023-11-30T18:22:39.431188+0000","last_clean":"2023-11-30T18:22:39.431188+0000","last_became_active":"2023-11-30T18:22:39.052296+0000","last_became_peered":"2023-11-30T18:22:39.052296+0000","last_unstale":"2023-11-30T18:22:39.431188+0000","last_undegraded":"2023-11-30T18:22:39.431188+0000","last_fullsized":"2023-11-30T18:22:39.431188+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.457273+0000","last_change":"2023-11-30T18:22:39.454486+0000","last_active":"2023-11-30T18:22:39.457273+0000","last_peered":"2023-11-30T18:22:39.457273+0000","last_clean":"2023-11-30T18:22:39.457273+0000","last_became_active":"2023-11-30T18:22:39.452476+0000","last_became_peered":"2023-11-30T18:22:39.452476+0000","last_unstale":"2023-11-30T18:22:39.457273+0000","last_undegraded":"2023-11-30T18:22:39.457273+0000","last_fullsized":"2023-11-30T18:22:39.457273+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.430155+0000","last_change":"2023-11-30T18:22:39.060692+0000","last_active":"2023-11-30T18:22:39.430155+0000","last_peered":"2023-11-30T18:22:39.430155+0000","last_clean":"2023-11-30T18:22:39.430155+0000","last_became_active":"2023-11-30T18:22:39.060204+0000","last_became_peered":"2023-11-30T18:22:39.060204+0000","last_unstale":"2023-11-30T18:22:39.430155+0000","last_undegraded":"2023-11-30T18:22:39.430155+0000","last_fullsized":"2023-11-30T18:22:39.430155+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.461491+0000","last_change":"2023-11-30T18:22:39.457109+0000","last_active":"2023-11-30T18:22:39.461491+0000","last_peered":"2023-11-30T18:22:39.461491+0000","last_clean":"2023-11-30T18:22:39.461491+0000","last_became_active":"2023-11-30T18:22:39.456308+0000","last_became_peered":"2023-11-30T18:22:39.456308+0000","last_unstale":"2023-11-30T18:22:39.461491+0000","last_undegraded":"2023-11-30T18:22:39.461491+0000","last_fullsized":"2023-11-30T18:22:39.461491+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.446470+0000","last_change":"2023-11-30T18:22:39.066356+0000","last_active":"2023-11-30T18:22:39.446470+0000","last_peered":"2023-11-30T18:22:39.446470+0000","last_clean":"2023-11-30T18:22:39.446470+0000","last_became_active":"2023-11-30T18:22:39.066104+0000","last_became_peered":"2023-11-30T18:22:39.066104+0000","last_unstale":"2023-11-30T18:22:39.446470+0000","last_undegraded":"2023-11-30T18:22:39.446470+0000","last_fullsized":"2023-11-30T18:22:39.446470+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.458917+0000","last_change":"2023-11-30T18:22:39.452867+0000","last_active":"2023-11-30T18:22:39.458917+0000","last_peered":"2023-11-30T18:22:39.458917+0000","last_clean":"2023-11-30T18:22:39.458917+0000","last_became_active":"2023-11-30T18:22:39.452483+0000","last_became_peered":"2023-11-30T18:22:39.452483+0000","last_unstale":"2023-11-30T18:22:39.458917+0000","last_undegraded":"2023-11-30T18:22:39.458917+0000","last_fullsized":"2023-11-30T18:22:39.458917+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.440505+0000","last_change":"2023-11-30T18:22:39.060195+0000","last_active":"2023-11-30T18:22:39.440505+0000","last_peered":"2023-11-30T18:22:39.440505+0000","last_clean":"2023-11-30T18:22:39.440505+0000","last_became_active":"2023-11-30T18:22:39.059913+0000","last_became_peered":"2023-11-30T18:22:39.059913+0000","last_unstale":"2023-11-30T18:22:39.440505+0000","last_undegraded":"2023-11-30T18:22:39.440505+0000","last_fullsized":"2023-11-30T18:22:39.440505+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.460094+0000","last_change":"2023-11-30T18:22:39.451229+0000","last_active":"2023-11-30T18:22:39.460094+0000","last_peered":"2023-11-30T18:22:39.460094+0000","last_clean":"2023-11-30T18:22:39.460094+0000","last_became_active":"2023-11-30T18:22:39.450946+0000","last_became_peered":"2023-11-30T18:22:39.450946+0000","last_unstale":"2023-11-30T18:22:39.460094+0000","last_undegraded":"2023-11-30T18:22:39.460094+0000","last_fullsized":"2023-11-30T18:22:39.460094+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"168'1","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.456134+0000","last_change":"2023-11-30T18:22:39.050289+0000","last_active":"2023-11-30T18:22:39.456134+0000","last_peered":"2023-11-30T18:22:39.456134+0000","last_clean":"2023-11-30T18:22:39.456134+0000","last_became_active":"2023-11-30T18:22:39.050014+0000","last_became_peered":"2023-11-30T18:22:39.050014+0000","last_unstale":"2023-11-30T18:22:39.456134+0000","last_undegraded":"2023-11-30T18:22:39.456134+0000","last_fullsized":"2023-11-30T18:22:39.456134+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.452835+0000","last_change":"2023-11-30T18:22:39.452045+0000","last_active":"2023-11-30T18:22:39.452835+0000","last_peered":"2023-11-30T18:22:39.452835+0000","last_clean":"2023-11-30T18:22:39.452835+0000","last_became_active":"2023-11-30T18:22:39.451708+0000","last_became_peered":"2023-11-30T18:22:39.451708+0000","last_unstale":"2023-11-30T18:22:39.452835+0000","last_undegraded":"2023-11-30T18:22:39.452835+0000","last_fullsized":"2023-11-30T18:22:39.452835+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"168'1","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.454017+0000","last_change":"2023-11-30T18:22:39.062083+0000","last_active":"2023-11-30T18:22:39.454017+0000","last_peered":"2023-11-30T18:22:39.454017+0000","last_clean":"2023-11-30T18:22:39.454017+0000","last_became_active":"2023-11-30T18:22:39.061144+0000","last_became_peered":"2023-11-30T18:22:39.061144+0000","last_unstale":"2023-11-30T18:22:39.454017+0000","last_undegraded":"2023-11-30T18:22:39.454017+0000","last_fullsized":"2023-11-30T18:22:39.454017+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.454700+0000","last_change":"2023-11-30T18:22:39.451664+0000","last_active":"2023-11-30T18:22:39.454700+0000","last_peered":"2023-11-30T18:22:39.454700+0000","last_clean":"2023-11-30T18:22:39.454700+0000","last_became_active":"2023-11-30T18:22:39.451386+0000","last_became_peered":"2023-11-30T18:22:39.451386+0000","last_unstale":"2023-11-30T18:22:39.454700+0000","last_undegraded":"2023-11-30T18:22:39.454700+0000","last_fullsized":"2023-11-30T18:22:39.454700+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"168'2","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.455646+0000","last_change":"2023-11-30T18:22:39.057857+0000","last_active":"2023-11-30T18:22:39.455646+0000","last_peered":"2023-11-30T18:22:39.455646+0000","last_clean":"2023-11-30T18:22:39.455646+0000","last_became_active":"2023-11-30T18:22:39.057598+0000","last_became_peered":"2023-11-30T18:22:39.057598+0000","last_unstale":"2023-11-30T18:22:39.455646+0000","last_undegraded":"2023-11-30T18:22:39.455646+0000","last_fullsized":"2023-11-30T18:22:39.455646+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.452936+0000","last_change":"2023-11-30T18:22:39.451999+0000","last_active":"2023-11-30T18:22:39.452936+0000","last_peered":"2023-11-30T18:22:39.452936+0000","last_clean":"2023-11-30T18:22:39.452936+0000","last_became_active":"2023-11-30T18:22:39.451795+0000","last_became_peered":"2023-11-30T18:22:39.451795+0000","last_unstale":"2023-11-30T18:22:39.452936+0000","last_undegraded":"2023-11-30T18:22:39.452936+0000","last_fullsized":"2023-11-30T18:22:39.452936+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.446864+0000","last_change":"2023-11-30T18:22:39.059221+0000","last_active":"2023-11-30T18:22:39.446864+0000","last_peered":"2023-11-30T18:22:39.446864+0000","last_clean":"2023-11-30T18:22:39.446864+0000","last_became_active":"2023-11-30T18:22:39.058911+0000","last_became_peered":"2023-11-30T18:22:39.058911+0000","last_unstale":"2023-11-30T18:22:39.446864+0000","last_undegraded":"2023-11-30T18:22:39.446864+0000","last_fullsized":"2023-11-30T18:22:39.446864+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.459886+0000","last_change":"2023-11-30T18:22:39.448909+0000","last_active":"2023-11-30T18:22:39.459886+0000","last_peered":"2023-11-30T18:22:39.459886+0000","last_clean":"2023-11-30T18:22:39.459886+0000","last_became_active":"2023-11-30T18:22:39.448636+0000","last_became_peered":"2023-11-30T18:22:39.448636+0000","last_unstale":"2023-11-30T18:22:39.459886+0000","last_undegraded":"2023-11-30T18:22:39.459886+0000","last_fullsized":"2023-11-30T18:22:39.459886+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.440743+0000","last_change":"2023-11-30T18:22:39.056529+0000","last_active":"2023-11-30T18:22:39.440743+0000","last_peered":"2023-11-30T18:22:39.440743+0000","last_clean":"2023-11-30T18:22:39.440743+0000","last_became_active":"2023-11-30T18:22:39.056186+0000","last_became_peered":"2023-11-30T18:22:39.056186+0000","last_unstale":"2023-11-30T18:22:39.440743+0000","last_undegraded":"2023-11-30T18:22:39.440743+0000","last_fullsized":"2023-11-30T18:22:39.440743+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.454051+0000","last_change":"2023-11-30T18:22:39.445391+0000","last_active":"2023-11-30T18:22:39.454051+0000","last_peered":"2023-11-30T18:22:39.454051+0000","last_clean":"2023-11-30T18:22:39.454051+0000","last_became_active":"2023-11-30T18:22:39.444741+0000","last_became_peered":"2023-11-30T18:22:39.444741+0000","last_unstale":"2023-11-30T18:22:39.454051+0000","last_undegraded":"2023-11-30T18:22:39.454051+0000","last_fullsized":"2023-11-30T18:22:39.454051+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.436592+0000","last_change":"2023-11-30T18:22:39.053629+0000","last_active":"2023-11-30T18:22:39.436592+0000","last_peered":"2023-11-30T18:22:39.436592+0000","last_clean":"2023-11-30T18:22:39.436592+0000","last_became_active":"2023-11-30T18:22:39.053298+0000","last_became_peered":"2023-11-30T18:22:39.053298+0000","last_unstale":"2023-11-30T18:22:39.436592+0000","last_undegraded":"2023-11-30T18:22:39.436592+0000","last_fullsized":"2023-11-30T18:22:39.436592+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.457163+0000","last_change":"2023-11-30T18:22:39.454391+0000","last_active":"2023-11-30T18:22:39.457163+0000","last_peered":"2023-11-30T18:22:39.457163+0000","last_clean":"2023-11-30T18:22:39.457163+0000","last_became_active":"2023-11-30T18:22:39.454100+0000","last_became_peered":"2023-11-30T18:22:39.454100+0000","last_unstale":"2023-11-30T18:22:39.457163+0000","last_undegraded":"2023-11-30T18:22:39.457163+0000","last_fullsized":"2023-11-30T18:22:39.457163+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.435751+0000","last_change":"2023-11-30T18:22:39.060933+0000","last_active":"2023-11-30T18:22:39.435751+0000","last_peered":"2023-11-30T18:22:39.435751+0000","last_clean":"2023-11-30T18:22:39.435751+0000","last_became_active":"2023-11-30T18:22:39.060619+0000","last_became_peered":"2023-11-30T18:22:39.060619+0000","last_unstale":"2023-11-30T18:22:39.435751+0000","last_undegraded":"2023-11-30T18:22:39.435751+0000","last_fullsized":"2023-11-30T18:22:39.435751+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.457500+0000","last_change":"2023-11-30T18:22:39.454278+0000","last_active":"2023-11-30T18:22:39.457500+0000","last_peered":"2023-11-30T18:22:39.457500+0000","last_clean":"2023-11-30T18:22:39.457500+0000","last_became_active":"2023-11-30T18:22:39.453955+0000","last_became_peered":"2023-11-30T18:22:39.453955+0000","last_unstale":"2023-11-30T18:22:39.457500+0000","last_undegraded":"2023-11-30T18:22:39.457500+0000","last_fullsized":"2023-11-30T18:22:39.457500+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.447082+0000","last_change":"2023-11-30T18:22:39.056949+0000","last_active":"2023-11-30T18:22:39.447082+0000","last_peered":"2023-11-30T18:22:39.447082+0000","last_clean":"2023-11-30T18:22:39.447082+0000","last_became_active":"2023-11-30T18:22:39.056469+0000","last_became_peered":"2023-11-30T18:22:39.056469+0000","last_unstale":"2023-11-30T18:22:39.447082+0000","last_undegraded":"2023-11-30T18:22:39.447082+0000","last_fullsized":"2023-11-30T18:22:39.447082+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.461583+0000","last_change":"2023-11-30T18:22:39.457349+0000","last_active":"2023-11-30T18:22:39.461583+0000","last_peered":"2023-11-30T18:22:39.461583+0000","last_clean":"2023-11-30T18:22:39.461583+0000","last_became_active":"2023-11-30T18:22:39.457033+0000","last_became_peered":"2023-11-30T18:22:39.457033+0000","last_unstale":"2023-11-30T18:22:39.461583+0000","last_undegraded":"2023-11-30T18:22:39.461583+0000","last_fullsized":"2023-11-30T18:22:39.461583+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"168'1","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.447278+0000","last_change":"2023-11-30T18:22:39.058987+0000","last_active":"2023-11-30T18:22:39.447278+0000","last_peered":"2023-11-30T18:22:39.447278+0000","last_clean":"2023-11-30T18:22:39.447278+0000","last_became_active":"2023-11-30T18:22:39.058698+0000","last_became_peered":"2023-11-30T18:22:39.058698+0000","last_unstale":"2023-11-30T18:22:39.447278+0000","last_undegraded":"2023-11-30T18:22:39.447278+0000","last_fullsized":"2023-11-30T18:22:39.447278+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.458330+0000","last_change":"2023-11-30T18:22:39.456215+0000","last_active":"2023-11-30T18:22:39.458330+0000","last_peered":"2023-11-30T18:22:39.458330+0000","last_clean":"2023-11-30T18:22:39.458330+0000","last_became_active":"2023-11-30T18:22:39.455852+0000","last_became_peered":"2023-11-30T18:22:39.455852+0000","last_unstale":"2023-11-30T18:22:39.458330+0000","last_undegraded":"2023-11-30T18:22:39.458330+0000","last_fullsized":"2023-11-30T18:22:39.458330+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"168'2","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.456917+0000","last_change":"2023-11-30T18:22:39.050853+0000","last_active":"2023-11-30T18:22:39.456917+0000","last_peered":"2023-11-30T18:22:39.456917+0000","last_clean":"2023-11-30T18:22:39.456917+0000","last_became_active":"2023-11-30T18:22:39.050549+0000","last_became_peered":"2023-11-30T18:22:39.050549+0000","last_unstale":"2023-11-30T18:22:39.456917+0000","last_undegraded":"2023-11-30T18:22:39.456917+0000","last_fullsized":"2023-11-30T18:22:39.456917+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.455487+0000","last_change":"2023-11-30T18:22:39.451927+0000","last_active":"2023-11-30T18:22:39.455487+0000","last_peered":"2023-11-30T18:22:39.455487+0000","last_clean":"2023-11-30T18:22:39.455487+0000","last_became_active":"2023-11-30T18:22:39.451654+0000","last_became_peered":"2023-11-30T18:22:39.451654+0000","last_unstale":"2023-11-30T18:22:39.455487+0000","last_undegraded":"2023-11-30T18:22:39.455487+0000","last_fullsized":"2023-11-30T18:22:39.455487+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.438803+0000","last_change":"2023-11-30T18:22:39.061371+0000","last_active":"2023-11-30T18:22:39.438803+0000","last_peered":"2023-11-30T18:22:39.438803+0000","last_clean":"2023-11-30T18:22:39.438803+0000","last_became_active":"2023-11-30T18:22:39.060699+0000","last_became_peered":"2023-11-30T18:22:39.060699+0000","last_unstale":"2023-11-30T18:22:39.438803+0000","last_undegraded":"2023-11-30T18:22:39.438803+0000","last_fullsized":"2023-11-30T18:22:39.438803+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.459802+0000","last_change":"2023-11-30T18:22:39.459278+0000","last_active":"2023-11-30T18:22:39.459802+0000","last_peered":"2023-11-30T18:22:39.459802+0000","last_clean":"2023-11-30T18:22:39.459802+0000","last_became_active":"2023-11-30T18:22:39.458976+0000","last_became_peered":"2023-11-30T18:22:39.458976+0000","last_unstale":"2023-11-30T18:22:39.459802+0000","last_undegraded":"2023-11-30T18:22:39.459802+0000","last_fullsized":"2023-11-30T18:22:39.459802+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.441860+0000","last_change":"2023-11-30T18:22:39.056878+0000","last_active":"2023-11-30T18:22:39.441860+0000","last_peered":"2023-11-30T18:22:39.441860+0000","last_clean":"2023-11-30T18:22:39.441860+0000","last_became_active":"2023-11-30T18:22:39.056397+0000","last_became_peered":"2023-11-30T18:22:39.056397+0000","last_unstale":"2023-11-30T18:22:39.441860+0000","last_undegraded":"2023-11-30T18:22:39.441860+0000","last_fullsized":"2023-11-30T18:22:39.441860+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.457357+0000","last_change":"2023-11-30T18:22:39.455070+0000","last_active":"2023-11-30T18:22:39.457357+0000","last_peered":"2023-11-30T18:22:39.457357+0000","last_clean":"2023-11-30T18:22:39.457357+0000","last_became_active":"2023-11-30T18:22:39.454141+0000","last_became_peered":"2023-11-30T18:22:39.454141+0000","last_unstale":"2023-11-30T18:22:39.457357+0000","last_undegraded":"2023-11-30T18:22:39.457357+0000","last_fullsized":"2023-11-30T18:22:39.457357+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"168'1","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.459887+0000","last_change":"2023-11-30T18:22:39.053818+0000","last_active":"2023-11-30T18:22:39.459887+0000","last_peered":"2023-11-30T18:22:39.459887+0000","last_clean":"2023-11-30T18:22:39.459887+0000","last_became_active":"2023-11-30T18:22:39.053490+0000","last_became_peered":"2023-11-30T18:22:39.053490+0000","last_unstale":"2023-11-30T18:22:39.459887+0000","last_undegraded":"2023-11-30T18:22:39.459887+0000","last_fullsized":"2023-11-30T18:22:39.459887+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.453108+0000","last_change":"2023-11-30T18:22:39.452227+0000","last_active":"2023-11-30T18:22:39.453108+0000","last_peered":"2023-11-30T18:22:39.453108+0000","last_clean":"2023-11-30T18:22:39.453108+0000","last_became_active":"2023-11-30T18:22:39.451952+0000","last_became_peered":"2023-11-30T18:22:39.451952+0000","last_unstale":"2023-11-30T18:22:39.453108+0000","last_undegraded":"2023-11-30T18:22:39.453108+0000","last_fullsized":"2023-11-30T18:22:39.453108+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.430262+0000","last_change":"2023-11-30T18:22:39.060507+0000","last_active":"2023-11-30T18:22:39.430262+0000","last_peered":"2023-11-30T18:22:39.430262+0000","last_clean":"2023-11-30T18:22:39.430262+0000","last_became_active":"2023-11-30T18:22:39.059828+0000","last_became_peered":"2023-11-30T18:22:39.059828+0000","last_unstale":"2023-11-30T18:22:39.430262+0000","last_undegraded":"2023-11-30T18:22:39.430262+0000","last_fullsized":"2023-11-30T18:22:39.430262+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.459252+0000","last_change":"2023-11-30T18:22:39.458628+0000","last_active":"2023-11-30T18:22:39.459252+0000","last_peered":"2023-11-30T18:22:39.459252+0000","last_clean":"2023-11-30T18:22:39.459252+0000","last_became_active":"2023-11-30T18:22:39.458340+0000","last_became_peered":"2023-11-30T18:22:39.458340+0000","last_unstale":"2023-11-30T18:22:39.459252+0000","last_undegraded":"2023-11-30T18:22:39.459252+0000","last_fullsized":"2023-11-30T18:22:39.459252+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.446586+0000","last_change":"2023-11-30T18:22:39.066364+0000","last_active":"2023-11-30T18:22:39.446586+0000","last_peered":"2023-11-30T18:22:39.446586+0000","last_clean":"2023-11-30T18:22:39.446586+0000","last_became_active":"2023-11-30T18:22:39.066158+0000","last_became_peered":"2023-11-30T18:22:39.066158+0000","last_unstale":"2023-11-30T18:22:39.446586+0000","last_undegraded":"2023-11-30T18:22:39.446586+0000","last_fullsized":"2023-11-30T18:22:39.446586+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.461912+0000","last_change":"2023-11-30T18:22:39.458249+0000","last_active":"2023-11-30T18:22:39.461912+0000","last_peered":"2023-11-30T18:22:39.461912+0000","last_clean":"2023-11-30T18:22:39.461912+0000","last_became_active":"2023-11-30T18:22:39.457965+0000","last_became_peered":"2023-11-30T18:22:39.457965+0000","last_unstale":"2023-11-30T18:22:39.461912+0000","last_undegraded":"2023-11-30T18:22:39.461912+0000","last_fullsized":"2023-11-30T18:22:39.461912+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.434919+0000","last_change":"2023-11-30T18:22:39.058085+0000","last_active":"2023-11-30T18:22:39.434919+0000","last_peered":"2023-11-30T18:22:39.434919+0000","last_clean":"2023-11-30T18:22:39.434919+0000","last_became_active":"2023-11-30T18:22:39.057786+0000","last_became_peered":"2023-11-30T18:22:39.057786+0000","last_unstale":"2023-11-30T18:22:39.434919+0000","last_undegraded":"2023-11-30T18:22:39.434919+0000","last_fullsized":"2023-11-30T18:22:39.434919+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.455273+0000","last_change":"2023-11-30T18:22:39.450310+0000","last_active":"2023-11-30T18:22:39.455273+0000","last_peered":"2023-11-30T18:22:39.455273+0000","last_clean":"2023-11-30T18:22:39.455273+0000","last_became_active":"2023-11-30T18:22:39.450014+0000","last_became_peered":"2023-11-30T18:22:39.450014+0000","last_unstale":"2023-11-30T18:22:39.455273+0000","last_undegraded":"2023-11-30T18:22:39.455273+0000","last_fullsized":"2023-11-30T18:22:39.455273+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"168'2","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.453706+0000","last_change":"2023-11-30T18:22:39.052735+0000","last_active":"2023-11-30T18:22:39.453706+0000","last_peered":"2023-11-30T18:22:39.453706+0000","last_clean":"2023-11-30T18:22:39.453706+0000","last_became_active":"2023-11-30T18:22:39.052209+0000","last_became_peered":"2023-11-30T18:22:39.052209+0000","last_unstale":"2023-11-30T18:22:39.453706+0000","last_undegraded":"2023-11-30T18:22:39.453706+0000","last_fullsized":"2023-11-30T18:22:39.453706+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.461579+0000","last_change":"2023-11-30T18:22:39.457352+0000","last_active":"2023-11-30T18:22:39.461579+0000","last_peered":"2023-11-30T18:22:39.461579+0000","last_clean":"2023-11-30T18:22:39.461579+0000","last_became_active":"2023-11-30T18:22:39.457093+0000","last_became_peered":"2023-11-30T18:22:39.457093+0000","last_unstale":"2023-11-30T18:22:39.461579+0000","last_undegraded":"2023-11-30T18:22:39.461579+0000","last_fullsized":"2023-11-30T18:22:39.461579+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.443709+0000","last_change":"2023-11-30T18:22:39.055867+0000","last_active":"2023-11-30T18:22:39.443709+0000","last_peered":"2023-11-30T18:22:39.443709+0000","last_clean":"2023-11-30T18:22:39.443709+0000","last_became_active":"2023-11-30T18:22:39.055514+0000","last_became_peered":"2023-11-30T18:22:39.055514+0000","last_unstale":"2023-11-30T18:22:39.443709+0000","last_undegraded":"2023-11-30T18:22:39.443709+0000","last_fullsized":"2023-11-30T18:22:39.443709+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.461701+0000","last_change":"2023-11-30T18:22:39.459637+0000","last_active":"2023-11-30T18:22:39.461701+0000","last_peered":"2023-11-30T18:22:39.461701+0000","last_clean":"2023-11-30T18:22:39.461701+0000","last_became_active":"2023-11-30T18:22:39.459339+0000","last_became_peered":"2023-11-30T18:22:39.459339+0000","last_unstale":"2023-11-30T18:22:39.461701+0000","last_undegraded":"2023-11-30T18:22:39.461701+0000","last_fullsized":"2023-11-30T18:22:39.461701+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.443062+0000","last_change":"2023-11-30T18:22:39.052356+0000","last_active":"2023-11-30T18:22:39.443062+0000","last_peered":"2023-11-30T18:22:39.443062+0000","last_clean":"2023-11-30T18:22:39.443062+0000","last_became_active":"2023-11-30T18:22:39.052101+0000","last_became_peered":"2023-11-30T18:22:39.052101+0000","last_unstale":"2023-11-30T18:22:39.443062+0000","last_undegraded":"2023-11-30T18:22:39.443062+0000","last_fullsized":"2023-11-30T18:22:39.443062+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.448990+0000","last_change":"2023-11-30T18:22:39.448050+0000","last_active":"2023-11-30T18:22:39.448990+0000","last_peered":"2023-11-30T18:22:39.448990+0000","last_clean":"2023-11-30T18:22:39.448990+0000","last_became_active":"2023-11-30T18:22:39.447816+0000","last_became_peered":"2023-11-30T18:22:39.447816+0000","last_unstale":"2023-11-30T18:22:39.448990+0000","last_undegraded":"2023-11-30T18:22:39.448990+0000","last_fullsized":"2023-11-30T18:22:39.448990+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.439001+0000","last_change":"2023-11-30T18:22:39.057614+0000","last_active":"2023-11-30T18:22:39.439001+0000","last_peered":"2023-11-30T18:22:39.439001+0000","last_clean":"2023-11-30T18:22:39.439001+0000","last_became_active":"2023-11-30T18:22:39.057323+0000","last_became_peered":"2023-11-30T18:22:39.057323+0000","last_unstale":"2023-11-30T18:22:39.439001+0000","last_undegraded":"2023-11-30T18:22:39.439001+0000","last_fullsized":"2023-11-30T18:22:39.439001+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.444916+0000","last_change":"2023-11-30T18:22:39.442121+0000","last_active":"2023-11-30T18:22:39.444916+0000","last_peered":"2023-11-30T18:22:39.444916+0000","last_clean":"2023-11-30T18:22:39.444916+0000","last_became_active":"2023-11-30T18:22:39.440944+0000","last_became_peered":"2023-11-30T18:22:39.440944+0000","last_unstale":"2023-11-30T18:22:39.444916+0000","last_undegraded":"2023-11-30T18:22:39.444916+0000","last_fullsized":"2023-11-30T18:22:39.444916+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.441864+0000","last_change":"2023-11-30T18:22:39.068059+0000","last_active":"2023-11-30T18:22:39.441864+0000","last_peered":"2023-11-30T18:22:39.441864+0000","last_clean":"2023-11-30T18:22:39.441864+0000","last_became_active":"2023-11-30T18:22:39.067777+0000","last_became_peered":"2023-11-30T18:22:39.067777+0000","last_unstale":"2023-11-30T18:22:39.441864+0000","last_undegraded":"2023-11-30T18:22:39.441864+0000","last_fullsized":"2023-11-30T18:22:39.441864+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.445344+0000","last_change":"2023-11-30T18:22:39.442692+0000","last_active":"2023-11-30T18:22:39.445344+0000","last_peered":"2023-11-30T18:22:39.445344+0000","last_clean":"2023-11-30T18:22:39.445344+0000","last_became_active":"2023-11-30T18:22:39.442401+0000","last_became_peered":"2023-11-30T18:22:39.442401+0000","last_unstale":"2023-11-30T18:22:39.445344+0000","last_undegraded":"2023-11-30T18:22:39.445344+0000","last_fullsized":"2023-11-30T18:22:39.445344+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.446280+0000","last_change":"2023-11-30T18:22:39.060623+0000","last_active":"2023-11-30T18:22:39.446280+0000","last_peered":"2023-11-30T18:22:39.446280+0000","last_clean":"2023-11-30T18:22:39.446280+0000","last_became_active":"2023-11-30T18:22:39.060357+0000","last_became_peered":"2023-11-30T18:22:39.060357+0000","last_unstale":"2023-11-30T18:22:39.446280+0000","last_undegraded":"2023-11-30T18:22:39.446280+0000","last_fullsized":"2023-11-30T18:22:39.446280+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.451410+0000","last_change":"2023-11-30T18:22:39.450151+0000","last_active":"2023-11-30T18:22:39.451410+0000","last_peered":"2023-11-30T18:22:39.451410+0000","last_clean":"2023-11-30T18:22:39.451410+0000","last_became_active":"2023-11-30T18:22:39.449847+0000","last_became_peered":"2023-11-30T18:22:39.449847+0000","last_unstale":"2023-11-30T18:22:39.451410+0000","last_undegraded":"2023-11-30T18:22:39.451410+0000","last_fullsized":"2023-11-30T18:22:39.451410+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.437518+0000","last_change":"2023-11-30T18:22:39.058157+0000","last_active":"2023-11-30T18:22:39.437518+0000","last_peered":"2023-11-30T18:22:39.437518+0000","last_clean":"2023-11-30T18:22:39.437518+0000","last_became_active":"2023-11-30T18:22:39.057887+0000","last_became_peered":"2023-11-30T18:22:39.057887+0000","last_unstale":"2023-11-30T18:22:39.437518+0000","last_undegraded":"2023-11-30T18:22:39.437518+0000","last_fullsized":"2023-11-30T18:22:39.437518+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.459304+0000","last_change":"2023-11-30T18:22:39.457281+0000","last_active":"2023-11-30T18:22:39.459304+0000","last_peered":"2023-11-30T18:22:39.459304+0000","last_clean":"2023-11-30T18:22:39.459304+0000","last_became_active":"2023-11-30T18:22:39.456974+0000","last_became_peered":"2023-11-30T18:22:39.456974+0000","last_unstale":"2023-11-30T18:22:39.459304+0000","last_undegraded":"2023-11-30T18:22:39.459304+0000","last_fullsized":"2023-11-30T18:22:39.459304+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.437129+0000","last_change":"2023-11-30T18:22:39.053644+0000","last_active":"2023-11-30T18:22:39.437129+0000","last_peered":"2023-11-30T18:22:39.437129+0000","last_clean":"2023-11-30T18:22:39.437129+0000","last_became_active":"2023-11-30T18:22:39.053326+0000","last_became_peered":"2023-11-30T18:22:39.053326+0000","last_unstale":"2023-11-30T18:22:39.437129+0000","last_undegraded":"2023-11-30T18:22:39.437129+0000","last_fullsized":"2023-11-30T18:22:39.437129+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.458945+0000","last_change":"2023-11-30T18:22:39.452884+0000","last_active":"2023-11-30T18:22:39.458945+0000","last_peered":"2023-11-30T18:22:39.458945+0000","last_clean":"2023-11-30T18:22:39.458945+0000","last_became_active":"2023-11-30T18:22:39.452523+0000","last_became_peered":"2023-11-30T18:22:39.452523+0000","last_unstale":"2023-11-30T18:22:39.458945+0000","last_undegraded":"2023-11-30T18:22:39.458945+0000","last_fullsized":"2023-11-30T18:22:39.458945+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"168'3","reported_seq":13,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.461746+0000","last_change":"2023-11-30T18:22:39.059630+0000","last_active":"2023-11-30T18:22:39.461746+0000","last_peered":"2023-11-30T18:22:39.461746+0000","last_clean":"2023-11-30T18:22:39.461746+0000","last_became_active":"2023-11-30T18:22:39.059369+0000","last_became_peered":"2023-11-30T18:22:39.059369+0000","last_unstale":"2023-11-30T18:22:39.461746+0000","last_undegraded":"2023-11-30T18:22:39.461746+0000","last_fullsized":"2023-11-30T18:22:39.461746+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":141,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.439079+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T18:22:39.439079+0000","last_peered":"2023-11-30T18:22:39.439079+0000","last_clean":"2023-11-30T18:22:39.439079+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T18:22:39.439079+0000","last_undegraded":"2023-11-30T18:22:39.439079+0000","last_fullsized":"2023-11-30T18:22:39.439079+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.443848+0000","last_change":"2023-11-30T18:22:39.441870+0000","last_active":"2023-11-30T18:22:39.443848+0000","last_peered":"2023-11-30T18:22:39.443848+0000","last_clean":"2023-11-30T18:22:39.443848+0000","last_became_active":"2023-11-30T18:22:39.441521+0000","last_became_peered":"2023-11-30T18:22:39.441521+0000","last_unstale":"2023-11-30T18:22:39.443848+0000","last_undegraded":"2023-11-30T18:22:39.443848+0000","last_fullsized":"2023-11-30T18:22:39.443848+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"168'1","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.443559+0000","last_change":"2023-11-30T18:22:39.057464+0000","last_active":"2023-11-30T18:22:39.443559+0000","last_peered":"2023-11-30T18:22:39.443559+0000","last_clean":"2023-11-30T18:22:39.443559+0000","last_became_active":"2023-11-30T18:22:39.057118+0000","last_became_peered":"2023-11-30T18:22:39.057118+0000","last_unstale":"2023-11-30T18:22:39.443559+0000","last_undegraded":"2023-11-30T18:22:39.443559+0000","last_fullsized":"2023-11-30T18:22:39.443559+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":139,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.443032+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T18:22:39.443032+0000","last_peered":"2023-11-30T18:22:39.443032+0000","last_clean":"2023-11-30T18:22:39.443032+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T18:22:39.443032+0000","last_undegraded":"2023-11-30T18:22:39.443032+0000","last_fullsized":"2023-11-30T18:22:39.443032+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.454589+0000","last_change":"2023-11-30T18:22:39.445490+0000","last_active":"2023-11-30T18:22:39.454589+0000","last_peered":"2023-11-30T18:22:39.454589+0000","last_clean":"2023-11-30T18:22:39.454589+0000","last_became_active":"2023-11-30T18:22:39.445231+0000","last_became_peered":"2023-11-30T18:22:39.445231+0000","last_unstale":"2023-11-30T18:22:39.454589+0000","last_undegraded":"2023-11-30T18:22:39.454589+0000","last_fullsized":"2023-11-30T18:22:39.454589+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"168'4","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.457858+0000","last_change":"2023-11-30T18:22:39.053664+0000","last_active":"2023-11-30T18:22:39.457858+0000","last_peered":"2023-11-30T18:22:39.457858+0000","last_clean":"2023-11-30T18:22:39.457858+0000","last_became_active":"2023-11-30T18:22:39.053373+0000","last_became_peered":"2023-11-30T18:22:39.053373+0000","last_unstale":"2023-11-30T18:22:39.457858+0000","last_undegraded":"2023-11-30T18:22:39.457858+0000","last_fullsized":"2023-11-30T18:22:39.457858+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":145,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.430862+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T18:22:39.430862+0000","last_peered":"2023-11-30T18:22:39.430862+0000","last_clean":"2023-11-30T18:22:39.430862+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T18:22:39.430862+0000","last_undegraded":"2023-11-30T18:22:39.430862+0000","last_fullsized":"2023-11-30T18:22:39.430862+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.461614+0000","last_change":"2023-11-30T18:22:39.457282+0000","last_active":"2023-11-30T18:22:39.461614+0000","last_peered":"2023-11-30T18:22:39.461614+0000","last_clean":"2023-11-30T18:22:39.461614+0000","last_became_active":"2023-11-30T18:22:39.456461+0000","last_became_peered":"2023-11-30T18:22:39.456461+0000","last_unstale":"2023-11-30T18:22:39.461614+0000","last_undegraded":"2023-11-30T18:22:39.461614+0000","last_fullsized":"2023-11-30T18:22:39.461614+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.446178+0000","last_change":"2023-11-30T18:22:39.065942+0000","last_active":"2023-11-30T18:22:39.446178+0000","last_peered":"2023-11-30T18:22:39.446178+0000","last_clean":"2023-11-30T18:22:39.446178+0000","last_became_active":"2023-11-30T18:22:39.065735+0000","last_became_peered":"2023-11-30T18:22:39.065735+0000","last_unstale":"2023-11-30T18:22:39.446178+0000","last_undegraded":"2023-11-30T18:22:39.446178+0000","last_fullsized":"2023-11-30T18:22:39.446178+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":139,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.442395+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T18:22:39.442395+0000","last_peered":"2023-11-30T18:22:39.442395+0000","last_clean":"2023-11-30T18:22:39.442395+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T18:22:39.442395+0000","last_undegraded":"2023-11-30T18:22:39.442395+0000","last_fullsized":"2023-11-30T18:22:39.442395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":138,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.445279+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T18:22:39.445279+0000","last_peered":"2023-11-30T18:22:39.445279+0000","last_clean":"2023-11-30T18:22:39.445279+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T18:22:39.445279+0000","last_undegraded":"2023-11-30T18:22:39.445279+0000","last_fullsized":"2023-11-30T18:22:39.445279+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.458298+0000","last_change":"2023-11-30T18:22:39.455452+0000","last_active":"2023-11-30T18:22:39.458298+0000","last_peered":"2023-11-30T18:22:39.458298+0000","last_clean":"2023-11-30T18:22:39.458298+0000","last_became_active":"2023-11-30T18:22:39.455089+0000","last_became_peered":"2023-11-30T18:22:39.455089+0000","last_unstale":"2023-11-30T18:22:39.458298+0000","last_undegraded":"2023-11-30T18:22:39.458298+0000","last_fullsized":"2023-11-30T18:22:39.458298+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.445539+0000","last_change":"2023-11-30T18:22:39.055780+0000","last_active":"2023-11-30T18:22:39.445539+0000","last_peered":"2023-11-30T18:22:39.445539+0000","last_clean":"2023-11-30T18:22:39.445539+0000","last_became_active":"2023-11-30T18:22:39.055588+0000","last_became_peered":"2023-11-30T18:22:39.055588+0000","last_unstale":"2023-11-30T18:22:39.445539+0000","last_undegraded":"2023-11-30T18:22:39.445539+0000","last_fullsized":"2023-11-30T18:22:39.445539+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":136,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.445367+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T18:22:39.445367+0000","last_peered":"2023-11-30T18:22:39.445367+0000","last_clean":"2023-11-30T18:22:39.445367+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T18:22:39.445367+0000","last_undegraded":"2023-11-30T18:22:39.445367+0000","last_fullsized":"2023-11-30T18:22:39.445367+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.461679+0000","last_change":"2023-11-30T18:22:39.457691+0000","last_active":"2023-11-30T18:22:39.461679+0000","last_peered":"2023-11-30T18:22:39.461679+0000","last_clean":"2023-11-30T18:22:39.461679+0000","last_became_active":"2023-11-30T18:22:39.456542+0000","last_became_peered":"2023-11-30T18:22:39.456542+0000","last_unstale":"2023-11-30T18:22:39.461679+0000","last_undegraded":"2023-11-30T18:22:39.461679+0000","last_fullsized":"2023-11-30T18:22:39.461679+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"168'2","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.457594+0000","last_change":"2023-11-30T18:22:39.063623+0000","last_active":"2023-11-30T18:22:39.457594+0000","last_peered":"2023-11-30T18:22:39.457594+0000","last_clean":"2023-11-30T18:22:39.457594+0000","last_became_active":"2023-11-30T18:22:39.063309+0000","last_became_peered":"2023-11-30T18:22:39.063309+0000","last_unstale":"2023-11-30T18:22:39.457594+0000","last_undegraded":"2023-11-30T18:22:39.457594+0000","last_fullsized":"2023-11-30T18:22:39.457594+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":136,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.447560+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T18:22:39.447560+0000","last_peered":"2023-11-30T18:22:39.447560+0000","last_clean":"2023-11-30T18:22:39.447560+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T18:22:39.447560+0000","last_undegraded":"2023-11-30T18:22:39.447560+0000","last_fullsized":"2023-11-30T18:22:39.447560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.458699+0000","last_change":"2023-11-30T18:22:39.458077+0000","last_active":"2023-11-30T18:22:39.458699+0000","last_peered":"2023-11-30T18:22:39.458699+0000","last_clean":"2023-11-30T18:22:39.458699+0000","last_became_active":"2023-11-30T18:22:39.457772+0000","last_became_peered":"2023-11-30T18:22:39.457772+0000","last_unstale":"2023-11-30T18:22:39.458699+0000","last_undegraded":"2023-11-30T18:22:39.458699+0000","last_fullsized":"2023-11-30T18:22:39.458699+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.441769+0000","last_change":"2023-11-30T18:22:39.062023+0000","last_active":"2023-11-30T18:22:39.441769+0000","last_peered":"2023-11-30T18:22:39.441769+0000","last_clean":"2023-11-30T18:22:39.441769+0000","last_became_active":"2023-11-30T18:22:39.061779+0000","last_became_peered":"2023-11-30T18:22:39.061779+0000","last_unstale":"2023-11-30T18:22:39.441769+0000","last_undegraded":"2023-11-30T18:22:39.441769+0000","last_fullsized":"2023-11-30T18:22:39.441769+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":141,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.438515+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T18:22:39.438515+0000","last_peered":"2023-11-30T18:22:39.438515+0000","last_clean":"2023-11-30T18:22:39.438515+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T18:22:39.438515+0000","last_undegraded":"2023-11-30T18:22:39.438515+0000","last_fullsized":"2023-11-30T18:22:39.438515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.445585+0000","last_change":"2023-11-30T18:22:39.444097+0000","last_active":"2023-11-30T18:22:39.445585+0000","last_peered":"2023-11-30T18:22:39.445585+0000","last_clean":"2023-11-30T18:22:39.445585+0000","last_became_active":"2023-11-30T18:22:39.443832+0000","last_became_peered":"2023-11-30T18:22:39.443832+0000","last_unstale":"2023-11-30T18:22:39.445585+0000","last_undegraded":"2023-11-30T18:22:39.445585+0000","last_fullsized":"2023-11-30T18:22:39.445585+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.430573+0000","last_change":"2023-11-30T18:22:39.056110+0000","last_active":"2023-11-30T18:22:39.430573+0000","last_peered":"2023-11-30T18:22:39.430573+0000","last_clean":"2023-11-30T18:22:39.430573+0000","last_became_active":"2023-11-30T18:22:39.055799+0000","last_became_peered":"2023-11-30T18:22:39.055799+0000","last_unstale":"2023-11-30T18:22:39.430573+0000","last_undegraded":"2023-11-30T18:22:39.430573+0000","last_fullsized":"2023-11-30T18:22:39.430573+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":157,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.438916+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T18:22:39.438916+0000","last_peered":"2023-11-30T18:22:39.438916+0000","last_clean":"2023-11-30T18:22:39.438916+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T18:22:39.438916+0000","last_undegraded":"2023-11-30T18:22:39.438916+0000","last_fullsized":"2023-11-30T18:22:39.438916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575749,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303256,"kb_used_data":2064,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068584,"statfs":{"total":96636764160,"available":96326230016,"internally_reserved":0,"allocated":2113536,"data_stored":1074169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.32500000000000001},"max":{"1min":0.68700000000000006,"5min":0.81699999999999995,"15min":0.83599999999999997},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.60699999999999998,"15min":0.61799999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.71499999999999997,"5min":0.82199999999999995,"15min":0.84999999999999998},"last":0.59099999999999997}]},{"osd":1,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55000000000000004,"15min":0.55900000000000005},"min":{"1min":0.35599999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71599999999999997,"5min":0.80500000000000005,"15min":0.875},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.39800000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71699999999999997,"5min":0.79100000000000004,"15min":0.82099999999999995},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70399999999999996,"5min":0.76900000000000002,"15min":0.85399999999999998},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.66500000000000004,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.625}]},{"osd":3,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.34300000000000003},"max":{"1min":0.65700000000000003,"5min":0.79300000000000004,"15min":0.90800000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60199999999999998,"15min":0.60299999999999998},"min":{"1min":0.41099999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.73399999999999999,"5min":0.80000000000000004,"15min":0.80300000000000005},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.45300000000000001,"15min":0.44400000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63900000000000001,"5min":0.70299999999999996,"15min":0.73799999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46400000000000002,"15min":0.46500000000000002},"min":{"1min":0.32100000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.66400000000000003,"5min":0.71999999999999997,"15min":0.78100000000000003},"last":0.38400000000000001}]},{"osd":5,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.65000000000000002,"5min":0.749,"15min":0.753},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.51000000000000001,"15min":0.505},"min":{"1min":0.371,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":0.69099999999999995,"5min":0.76000000000000001,"15min":0.81999999999999995},"last":0.495}]},{"osd":6,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.372,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.74299999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.751,"5min":0.81499999999999995,"15min":0.83599999999999997},"last":0.41799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575748,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307348,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064492,"statfs":{"total":96636764160,"available":96322039808,"internally_reserved":0,"allocated":2109440,"data_stored":1074417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.313},"max":{"1min":0.78600000000000003,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.628,"15min":0.61799999999999999},"min":{"1min":0.41099999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Nov 30 18:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59799999999999998,"15min":0.59099999999999997},"min":{"1min":0.40100000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.627,"15min":0.623},"min":{"1min":0.46800000000000003,"5min":0.39000000000000001,"15min":0.35199999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Nov 30 18:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61599999999999999,"15min":0.60299999999999998},"min":{"1min":0.48099999999999998,"5min":0.38400000000000001,"15min":0.38100000000000001},"max":{"1min":0.79800000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.496,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Nov 30 18:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.42199999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77000000000000002,"5min":0.82299999999999995,"15min":0.83499999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.56899999999999995},"min":{"1min":0.41599999999999998,"5min":0.38600000000000001,"15min":0.33200000000000002},"max":{"1min":0.76700000000000002,"5min":0.79100000000000004,"15min":0.80100000000000005},"last":0.626}]},{"osd":4,"last update":"Thu Nov 30 18:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.45700000000000002,"15min":0.45300000000000001},"min":{"1min":0.318,"5min":0.30499999999999999,"15min":0.28399999999999997},"max":{"1min":0.76000000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.48299999999999998,"15min":0.47599999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.312},"max":{"1min":0.66400000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Nov 30 18:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.46800000000000003,"15min":0.46899999999999997},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.31},"max":{"1min":0.63600000000000001,"5min":0.76400000000000001,"15min":0.81999999999999995},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.32500000000000001},"max":{"1min":0.72499999999999998,"5min":0.81999999999999995,"15min":0.83499999999999996},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Nov 30 18:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53700000000000003,"15min":0.53200000000000003},"min":{"1min":0.37,"5min":0.36899999999999999,"15min":0.29999999999999999},"max":{"1min":0.73399999999999999,"5min":0.80100000000000005,"15min":0.86799999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41899999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.67700000000000005,"5min":0.80800000000000005,"15min":0.86599999999999999},"last":0.69299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575748,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307340,"kb_used_data":2052,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064500,"statfs":{"total":96636764160,"available":96322048000,"internally_reserved":0,"allocated":2101248,"data_stored":1073435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:21:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.36399999999999999,"15min":0.36899999999999999},"min":{"1min":0.27200000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.54200000000000004,"5min":0.67500000000000004,"15min":0.70699999999999996},"last":0.216},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.49299999999999999,"15min":0.5},"min":{"1min":0.377,"5min":0.318,"15min":0.318},"max":{"1min":0.64300000000000002,"5min":0.71299999999999997,"15min":0.78100000000000003},"last":0.29099999999999998}]},{"osd":2,"last update":"Thu Nov 30 18:21:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.39500000000000002,"15min":0.40000000000000002},"min":{"1min":0.29899999999999999,"5min":0.26300000000000001,"15min":0.25600000000000001},"max":{"1min":0.46200000000000002,"5min":0.60599999999999998,"15min":0.67500000000000004},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.41099999999999998,"5min":0.371,"15min":0.36899999999999999},"max":{"1min":0.61399999999999999,"5min":0.72499999999999998,"15min":0.85599999999999998},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Nov 30 18:21:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.46800000000000003,"15min":0.46899999999999997},"min":{"1min":0.35699999999999998,"5min":0.32000000000000001,"15min":0.29999999999999999},"max":{"1min":0.52200000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.44500000000000001,"15min":0.45100000000000001},"min":{"1min":0.34799999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.50900000000000001,"5min":0.65400000000000003,"15min":0.68000000000000005},"last":0.28000000000000003}]},{"osd":4,"last update":"Thu Nov 30 18:21:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.47199999999999998,"5min":0.374,"15min":0.314},"max":{"1min":0.745,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.64300000000000002,"15min":0.64500000000000002},"min":{"1min":0.52400000000000002,"5min":0.45700000000000002,"15min":0.38800000000000001},"max":{"1min":0.70999999999999996,"5min":0.85799999999999998,"15min":0.90600000000000003},"last":0.54000000000000004}]},{"osd":5,"last update":"Thu Nov 30 18:21:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.623,"15min":0.628},"min":{"1min":0.44600000000000001,"5min":0.39600000000000002,"15min":0.377},"max":{"1min":0.77900000000000003,"5min":0.86599999999999999,"15min":0.90200000000000002},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.504,"5min":0.42699999999999999,"15min":0.36799999999999999},"max":{"1min":0.73099999999999998,"5min":0.90100000000000002,"15min":0.90800000000000003},"last":0.45800000000000002}]},{"osd":6,"last update":"Thu Nov 30 18:21:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.68899999999999995,"15min":0.69299999999999995},"min":{"1min":0.52500000000000002,"5min":0.505,"15min":0.47399999999999998},"max":{"1min":0.77100000000000002,"5min":0.91300000000000003,"15min":0.95499999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67900000000000005,"15min":0.67800000000000005},"min":{"1min":0.53000000000000003,"5min":0.45100000000000001,"15min":0.42599999999999999},"max":{"1min":0.83999999999999997,"5min":0.94799999999999995,"15min":1.0049999999999999},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Nov 30 18:21:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.68500000000000005,"15min":0.69299999999999995},"min":{"1min":0.48999999999999999,"5min":0.439,"15min":0.38},"max":{"1min":0.81299999999999994,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.54100000000000004,"5min":0.436,"15min":0.436},"max":{"1min":0.75900000000000001,"5min":0.94399999999999995,"15min":0.95899999999999996},"last":0.48399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575748,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307352,"kb_used_data":2064,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064488,"statfs":{"total":96636764160,"available":96322035712,"internally_reserved":0,"allocated":2113536,"data_stored":1073561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.38300000000000001,"15min":0.38900000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.51900000000000002,"5min":0.56799999999999995,"15min":0.61099999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41099999999999998,"15min":0.40999999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.249},"max":{"1min":0.55600000000000005,"5min":0.65600000000000003,"15min":0.68400000000000005},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41599999999999998,"15min":0.40899999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.57499999999999996,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.49299999999999999,"15min":0.48999999999999999},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.59399999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.373}]},{"osd":3,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.44600000000000001,"15min":0.45200000000000001},"min":{"1min":0.311,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.53500000000000003,"5min":0.71699999999999997,"15min":0.77500000000000002},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46899999999999997,"15min":0.46800000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65300000000000002,"5min":0.67600000000000005,"15min":0.69499999999999995},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65000000000000002,"15min":0.63700000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.42199999999999999},"max":{"1min":0.81000000000000005,"5min":0.96399999999999997,"15min":0.995},"last":0.621},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66600000000000004,"15min":0.65400000000000003},"min":{"1min":0.47799999999999998,"5min":0.42799999999999999,"15min":0.41499999999999998},"max":{"1min":0.75900000000000001,"5min":1.03,"15min":1.03},"last":0.47699999999999998}]},{"osd":5,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65200000000000002,"15min":0.64100000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.40799999999999997},"max":{"1min":0.86499999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.68100000000000005,"15min":0.65900000000000003},"min":{"1min":0.48199999999999998,"5min":0.44800000000000001,"15min":0.41299999999999998},"max":{"1min":0.91900000000000004,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67700000000000005,"15min":0.67300000000000004},"min":{"1min":0.52300000000000002,"5min":0.443,"15min":0.40600000000000003},"max":{"1min":0.81799999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68600000000000005,"15min":0.67700000000000005},"min":{"1min":0.49099999999999999,"5min":0.442,"15min":0.44},"max":{"1min":0.90400000000000003,"5min":1.05,"15min":1.05},"last":0.57699999999999996}]},{"osd":7,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71299999999999997,"15min":0.69799999999999995},"min":{"1min":0.55600000000000005,"5min":0.45200000000000001,"15min":0.42599999999999999},"max":{"1min":0.88600000000000001,"5min":1.167,"15min":1.167},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73199999999999998,"15min":0.72299999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.48399999999999999},"max":{"1min":0.876,"5min":1.024,"15min":1.024},"last":0.56599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575748,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311444,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060396,"statfs":{"total":96636764160,"available":96317845504,"internally_reserved":0,"allocated":2109440,"data_stored":1074023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.39500000000000002,"15min":0.40100000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.25700000000000001},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.71699999999999997},"last":0.307},{"interface":"front","average":{"1min":0.441,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68999999999999995,"5min":0.70599999999999996,"15min":0.751},"last":0.372}]},{"osd":1,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.443,"15min":0.44900000000000001},"min":{"1min":0.33500000000000002,"5min":0.309,"15min":0.29299999999999998},"max":{"1min":0.68700000000000006,"5min":0.755,"15min":0.755},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.32300000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.81799999999999995},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39500000000000002,"15min":0.40699999999999997},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.76000000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.308,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.75800000000000001},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.626,"15min":0.63400000000000001},"min":{"1min":0.44900000000000001,"5min":0.42199999999999999,"15min":0.40100000000000002},"max":{"1min":0.88800000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60699999999999998,"15min":0.61899999999999999},"min":{"1min":0.42199999999999999,"5min":0.40999999999999998,"15min":0.377},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.94999999999999996},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63300000000000001,"15min":0.64400000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.97399999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64700000000000002,"15min":0.64800000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85599999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.628,"15min":0.63800000000000001},"min":{"1min":0.46200000000000002,"5min":0.434,"15min":0.41099999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.97799999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67000000000000004,"15min":0.67300000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67300000000000004,"15min":0.68799999999999994},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46000000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.96599999999999997},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.504,"5min":0.49199999999999999,"15min":0.46200000000000002},"max":{"1min":0.97199999999999998,"5min":0.995,"15min":1.014},"last":0.61799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575748,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311444,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060396,"statfs":{"total":96636764160,"available":96317845504,"internally_reserved":0,"allocated":2109440,"data_stored":1074079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38500000000000001,"15min":0.375},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.41199999999999998,"15min":0.40899999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.59299999999999997,"5min":0.61099999999999999,"15min":0.66200000000000003},"last":0.26800000000000002}]},{"osd":1,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.40999999999999998,"15min":0.39700000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44800000000000001,"15min":0.441},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.28699999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.255}]},{"osd":2,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.47699999999999998,"15min":0.46899999999999997},"min":{"1min":0.35099999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58299999999999996,"5min":0.70899999999999996,"15min":0.71599999999999997},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52000000000000002,"15min":0.51500000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73199999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.39300000000000002}]},{"osd":4,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63200000000000001,"15min":0.63500000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92800000000000005,"5min":1.081,"15min":1.081},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64900000000000002,"15min":0.63800000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.64300000000000002,"15min":0.63500000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67100000000000004,"15min":0.66200000000000003},"min":{"1min":0.47399999999999998,"5min":0.46200000000000002,"15min":0.42399999999999999},"max":{"1min":0.99199999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.54300000000000004}]},{"osd":6,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68600000000000005,"15min":0.67900000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.40100000000000002},"max":{"1min":0.96999999999999997,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48599999999999999,"5min":0.47099999999999997,"15min":0.41499999999999998},"max":{"1min":0.84299999999999997,"5min":1.206,"15min":1.206},"last":0.45600000000000002}]},{"osd":7,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.44800000000000001},"max":{"1min":0.98599999999999999,"5min":1.131,"15min":1.131},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70599999999999996,"15min":0.69499999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.56899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575748,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303252,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068588,"statfs":{"total":96636764160,"available":96326234112,"internally_reserved":0,"allocated":2109440,"data_stored":1074059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.54500000000000004,"15min":0.55800000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.63700000000000001,"5min":0.80600000000000005,"15min":0.94799999999999995},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.54400000000000004,"15min":0.55100000000000005},"min":{"1min":0.33200000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.66500000000000004,"5min":0.82599999999999996,"15min":0.83699999999999997},"last":0.66900000000000004}]},{"osd":1,"last update":"Thu Nov 30 18:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64500000000000002,"5min":0.92400000000000004,"15min":1.006},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.628,"5min":0.79300000000000004,"15min":0.82299999999999995},"last":0.70999999999999996}]},{"osd":2,"last update":"Thu Nov 30 18:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58499999999999996,"15min":0.58999999999999997},"min":{"1min":0.42299999999999999,"5min":0.35499999999999998,"15min":0.33600000000000002},"max":{"1min":0.65900000000000003,"5min":0.82399999999999995,"15min":0.85299999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.41399999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.70899999999999996,"5min":0.95299999999999996,"15min":1.0429999999999999},"last":0.67900000000000005}]},{"osd":3,"last update":"Thu Nov 30 18:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.34599999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69199999999999995,"5min":0.78100000000000003,"15min":0.79900000000000004},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.42099999999999999,"5min":0.40300000000000002,"15min":0.35999999999999999},"max":{"1min":0.72899999999999998,"5min":0.79600000000000004,"15min":1.1679999999999999},"last":0.73899999999999999}]},{"osd":5,"last update":"Thu Nov 30 18:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.443,"15min":0.44},"min":{"1min":0.318,"5min":0.28999999999999998,"15min":0.27600000000000002},"max":{"1min":0.63500000000000001,"5min":0.71099999999999997,"15min":0.80700000000000005},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.442,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.33300000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67200000000000004,"5min":0.68100000000000005,"15min":1.3919999999999999},"last":0.46000000000000002}]},{"osd":6,"last update":"Thu Nov 30 18:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50600000000000001,"15min":0.496},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.31},"max":{"1min":0.77200000000000002,"5min":0.83599999999999997,"15min":0.93300000000000005},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.40200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69799999999999995,"5min":0.78100000000000003,"15min":0.92500000000000004},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Nov 30 18:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51600000000000001,"15min":0.52300000000000002},"min":{"1min":0.34499999999999997,"5min":0.32500000000000001,"15min":0.30099999999999999},"max":{"1min":0.74099999999999999,"5min":0.85699999999999998,"15min":1.246},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.41999999999999998,"5min":0.39900000000000002,"15min":0.371},"max":{"1min":0.80900000000000005,"5min":0.88900000000000001,"15min":1.321},"last":0.60999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575748,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307336,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064504,"statfs":{"total":96636764160,"available":96322052096,"internally_reserved":0,"allocated":2097152,"data_stored":1067589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56200000000000006,"15min":0.55500000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.30099999999999999},"max":{"1min":0.73799999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56200000000000006,"15min":0.55300000000000005},"min":{"1min":0.39900000000000002,"5min":0.35699999999999998,"15min":0.30399999999999999},"max":{"1min":0.70799999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Nov 30 18:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57099999999999995,"15min":0.56399999999999995},"min":{"1min":0.44700000000000001,"5min":0.33200000000000002,"15min":0.29499999999999998},"max":{"1min":0.70299999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58199999999999996,"15min":0.56999999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.35499999999999998},"max":{"1min":0.751,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Nov 30 18:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.372,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77400000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63600000000000001,"15min":0.62},"min":{"1min":0.52100000000000002,"5min":0.40899999999999997,"15min":0.35299999999999998},"max":{"1min":0.76700000000000002,"5min":0.876,"15min":0.876},"last":0.495}]},{"osd":3,"last update":"Thu Nov 30 18:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57999999999999996,"15min":0.57299999999999995},"min":{"1min":0.44500000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.83499999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.371},"max":{"1min":0.748,"5min":0.81799999999999995,"15min":0.86799999999999999},"last":0.505}]},{"osd":4,"last update":"Thu Nov 30 18:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.43099999999999999,"15min":0.435},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.52900000000000003,"5min":0.69599999999999995,"15min":0.79400000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.434,"5min":0.46700000000000003,"15min":0.46500000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29699999999999999},"max":{"1min":0.55200000000000005,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Nov 30 18:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47899999999999998,"15min":0.47799999999999998},"min":{"1min":0.38800000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.60299999999999998,"5min":0.73099999999999998,"15min":0.76200000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.38400000000000001,"5min":0.38100000000000001,"15min":0.313},"max":{"1min":0.67400000000000004,"5min":0.83499999999999996,"15min":0.83799999999999997},"last":0.629}]},{"osd":7,"last update":"Thu Nov 30 18:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.52100000000000002,"15min":0.52000000000000002},"min":{"1min":0.34399999999999997,"5min":0.313,"15min":0.313},"max":{"1min":0.60799999999999998,"5min":0.79300000000000004,"15min":0.80900000000000005},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68100000000000005,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.61599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T18:22:43.469 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T18:22:43.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.619+0000 7fdf416b0700 1 Processor -- start 2023-11-30T18:22:43.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.619+0000 7fdf416b0700 1 -- start start 2023-11-30T18:22:43.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.620+0000 7fdf416b0700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdf3c1520c0 0x7fdf3c066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:43.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.620+0000 7fdf416b0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf3c068150 0x7fdf3c066a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:43.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.620+0000 7fdf416b0700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf3c0be110 con 0x7fdf3c1524a0 2023-11-30T18:22:43.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.620+0000 7fdf416b0700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf3c066fc0 con 0x7fdf3c1520c0 2023-11-30T18:22:43.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.620+0000 7fdf416b0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c0672a0 con 0x7fdf3c068150 2023-11-30T18:22:43.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.620+0000 7fdf3affd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdf3c1520c0 0x7fdf3c066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:43.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.620+0000 7fdf3a7fc700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdf3c1524a0 0x7fdf3c067a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59092/0 (socket says 172.21.15.49:59092) 2023-11-30T18:22:43.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.620+0000 7fdf3affd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdf3c1520c0 0x7fdf3c066520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36906/0 (socket says 172.21.15.49:36906) 2023-11-30T18:22:43.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.620+0000 7fdf3a7fc700 1 -- 172.21.15.49:0/3125683123 learned_addr learned my addr 172.21.15.49:0/3125683123 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:22:43.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.621+0000 7fdf3b7fe700 1 --2- 172.21.15.49:0/3125683123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf3c068150 0x7fdf3c066a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:43.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.621+0000 7fdf3affd700 1 -- 172.21.15.49:0/3125683123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf3c068150 msgr2=0x7fdf3c066a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:43.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.621+0000 7fdf3affd700 1 --2- 172.21.15.49:0/3125683123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf3c068150 0x7fdf3c066a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:43.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.621+0000 7fdf3affd700 1 -- 172.21.15.49:0/3125683123 >> v1:172.21.15.49:6789/0 conn(0x7fdf3c1524a0 legacy=0x7fdf3c067a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:43.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.621+0000 7fdf39ffb700 1 -- 172.21.15.49:0/3125683123 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541678128 0 0) 0x7fdf3c0be110 con 0x7fdf3c1524a0 2023-11-30T18:22:43.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.621+0000 7fdf3affd700 1 -- 172.21.15.49:0/3125683123 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3c0be380 con 0x7fdf3c1520c0 2023-11-30T18:22:43.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.621+0000 7fdf3affd700 1 --2- 172.21.15.49:0/3125683123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf3c1520c0 0x7fdf3c066520 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7fdf34006fd0 tx=0x7fdf34006f40).ready entity=mon.0 client_cookie=95797d4be03e80d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:43.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.621+0000 7fdf39ffb700 1 -- 172.21.15.49:0/3125683123 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf34005880 con 0x7fdf3c1520c0 2023-11-30T18:22:43.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.621+0000 7fdf39ffb700 1 -- 172.21.15.49:0/3125683123 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf340059e0 con 0x7fdf3c1520c0 2023-11-30T18:22:43.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.621+0000 7fdf39ffb700 1 -- 172.21.15.49:0/3125683123 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf34005d60 con 0x7fdf3c1520c0 2023-11-30T18:22:43.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.621+0000 7fdf416b0700 1 -- 172.21.15.49:0/3125683123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf3c1520c0 msgr2=0x7fdf3c066520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:43.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.621+0000 7fdf416b0700 1 --2- 172.21.15.49:0/3125683123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf3c1520c0 0x7fdf3c066520 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7fdf34006fd0 tx=0x7fdf34006f40).stop 2023-11-30T18:22:43.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.622+0000 7fdf416b0700 1 -- 172.21.15.49:0/3125683123 shutdown_connections 2023-11-30T18:22:43.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.622+0000 7fdf416b0700 1 --2- 172.21.15.49:0/3125683123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf3c068150 0x7fdf3c066a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:43.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.622+0000 7fdf416b0700 1 --2- 172.21.15.49:0/3125683123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf3c1520c0 0x7fdf3c066520 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:43.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.622+0000 7fdf416b0700 1 -- 172.21.15.49:0/3125683123 >> 172.21.15.49:0/3125683123 conn(0x7fdf3c0631d0 msgr2=0x7fdf3c0c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:43.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.622+0000 7fdf416b0700 1 -- 172.21.15.49:0/3125683123 shutdown_connections 2023-11-30T18:22:43.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.622+0000 7fdf416b0700 1 -- 172.21.15.49:0/3125683123 wait complete. 2023-11-30T18:22:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.623+0000 7fdf416b0700 1 Processor -- start 2023-11-30T18:22:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.623+0000 7fdf416b0700 1 -- start start 2023-11-30T18:22:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.624+0000 7fdf416b0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf3c068150 0x7fdf3c063810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.624+0000 7fdf416b0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf3c1520c0 0x7fdf3c0a9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.624+0000 7fdf416b0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf3c1524a0 0x7fdf3c0ab3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.624+0000 7fdf416b0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c164780 con 0x7fdf3c1524a0 2023-11-30T18:22:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.624+0000 7fdf416b0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c164a60 con 0x7fdf3c068150 2023-11-30T18:22:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.624+0000 7fdf416b0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c164d40 con 0x7fdf3c1520c0 2023-11-30T18:22:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.624+0000 7fdf3b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf3c1524a0 0x7fdf3c0ab3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.624+0000 7fdf3b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf3c1524a0 0x7fdf3c0ab3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36914/0 (socket says 172.21.15.49:36914) 2023-11-30T18:22:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.624+0000 7fdf3b7fe700 1 -- 172.21.15.49:0/358047395 learned_addr learned my addr 172.21.15.49:0/358047395 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:43.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.624+0000 7fdf3a7fc700 1 --2- 172.21.15.49:0/358047395 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf3c1520c0 0x7fdf3c0a9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:43.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.624+0000 7fdf3affd700 1 --2- 172.21.15.49:0/358047395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf3c068150 0x7fdf3c063810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:43.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.624+0000 7fdf3b7fe700 1 -- 172.21.15.49:0/358047395 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf3c1520c0 msgr2=0x7fdf3c0a9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:43.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.624+0000 7fdf3b7fe700 1 --2- 172.21.15.49:0/358047395 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf3c1520c0 0x7fdf3c0a9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:43.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.624+0000 7fdf3b7fe700 1 -- 172.21.15.49:0/358047395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf3c068150 msgr2=0x7fdf3c063810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:43.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.624+0000 7fdf3b7fe700 1 --2- 172.21.15.49:0/358047395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf3c068150 0x7fdf3c063810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:43.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.624+0000 7fdf3b7fe700 1 -- 172.21.15.49:0/358047395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf34009250 con 0x7fdf3c1524a0 2023-11-30T18:22:43.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.624+0000 7fdf3b7fe700 1 --2- 172.21.15.49:0/358047395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf3c1524a0 0x7fdf3c0ab3d0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7fdf2c009fa0 tx=0x7fdf2c009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:43.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.624+0000 7fdf32ffd700 1 -- 172.21.15.49:0/358047395 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c00ebc0 con 0x7fdf3c1524a0 2023-11-30T18:22:43.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.624+0000 7fdf32ffd700 1 -- 172.21.15.49:0/358047395 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2c00ed20 con 0x7fdf3c1524a0 2023-11-30T18:22:43.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.624+0000 7fdf416b0700 1 -- 172.21.15.49:0/358047395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf3c165020 con 0x7fdf3c1524a0 2023-11-30T18:22:43.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.624+0000 7fdf32ffd700 1 -- 172.21.15.49:0/358047395 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c014610 con 0x7fdf3c1524a0 2023-11-30T18:22:43.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.625+0000 7fdf416b0700 1 -- 172.21.15.49:0/358047395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf3c0a8970 con 0x7fdf3c1524a0 2023-11-30T18:22:43.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.625+0000 7fdf416b0700 1 -- 172.21.15.49:0/358047395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf3c06c860 con 0x7fdf3c1524a0 2023-11-30T18:22:43.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.626+0000 7fdf32ffd700 1 -- 172.21.15.49:0/358047395 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 68) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fdf2c01d3b0 con 0x7fdf3c1524a0 2023-11-30T18:22:43.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.626+0000 7fdf32ffd700 1 --2- 172.21.15.49:0/358047395 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdf1c05f270 0x7fdf1c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:43.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.626+0000 7fdf32ffd700 1 -- 172.21.15.49:0/358047395 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fdf2c07a7e0 con 0x7fdf3c1524a0 2023-11-30T18:22:43.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.626+0000 7fdf3affd700 1 --2- 172.21.15.49:0/358047395 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdf1c05f270 0x7fdf1c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:43.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.627+0000 7fdf3affd700 1 --2- 172.21.15.49:0/358047395 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdf1c05f270 0x7fdf1c061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fdf34006f80 tx=0x7fdf34016000).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:43.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.630+0000 7fdf32ffd700 1 -- 172.21.15.49:0/358047395 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdf2c04b890 con 0x7fdf3c1524a0 2023-11-30T18:22:43.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.799+0000 7fdf416b0700 1 -- 172.21.15.49:0/358047395 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdf3c0c5880 con 0x7fdf1c05f270 2023-11-30T18:22:43.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.809+0000 7fdf32ffd700 1 -- 172.21.15.49:0/358047395 <== mgr.7052 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362177 (secure 0 0 0) 0x7fdf3c0c5880 con 0x7fdf1c05f270 2023-11-30T18:22:43.815 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:22:43.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.812+0000 7fdf416b0700 1 -- 172.21.15.49:0/358047395 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdf1c05f270 msgr2=0x7fdf1c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:43.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.812+0000 7fdf416b0700 1 --2- 172.21.15.49:0/358047395 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdf1c05f270 0x7fdf1c061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fdf34006f80 tx=0x7fdf34016000).stop 2023-11-30T18:22:43.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.812+0000 7fdf416b0700 1 -- 172.21.15.49:0/358047395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf3c1524a0 msgr2=0x7fdf3c0ab3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:43.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.812+0000 7fdf416b0700 1 --2- 172.21.15.49:0/358047395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf3c1524a0 0x7fdf3c0ab3d0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7fdf2c009fa0 tx=0x7fdf2c009900).stop 2023-11-30T18:22:43.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.812+0000 7fdf416b0700 1 -- 172.21.15.49:0/358047395 shutdown_connections 2023-11-30T18:22:43.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.812+0000 7fdf416b0700 1 --2- 172.21.15.49:0/358047395 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdf1c05f270 0x7fdf1c061730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:43.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.812+0000 7fdf416b0700 1 --2- 172.21.15.49:0/358047395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf3c1524a0 0x7fdf3c0ab3d0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:43.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.812+0000 7fdf416b0700 1 --2- 172.21.15.49:0/358047395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf3c068150 0x7fdf3c063810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:43.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.812+0000 7fdf416b0700 1 --2- 172.21.15.49:0/358047395 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf3c1520c0 0x7fdf3c0a9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:43.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.813+0000 7fdf416b0700 1 -- 172.21.15.49:0/358047395 >> 172.21.15.49:0/358047395 conn(0x7fdf3c0631d0 msgr2=0x7fdf3c0c6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:43.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.813+0000 7fdf416b0700 1 -- 172.21.15.49:0/358047395 shutdown_connections 2023-11-30T18:22:43.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.813+0000 7fdf416b0700 1 -- 172.21.15.49:0/358047395 wait complete. 2023-11-30T18:22:43.820 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T18:22:43.825 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-30T18:22:42.000513+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2458772,"kb_used_data":16468,"kb_used_omap":0,"kb_used_meta":2442240,"kb_avail":752515948,"statfs":{"total":773094113280,"available":770576330752,"internally_reserved":0,"allocated":16863232,"data_stored":8585332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2500853760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5037797,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-520,"num_write_kb":-5313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.694433"},"pg_stats":[{"pgid":"20.38","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.459521+0000","last_change":"2023-11-30T18:22:39.448243+0000","last_active":"2023-11-30T18:22:39.459521+0000","last_peered":"2023-11-30T18:22:39.459521+0000","last_clean":"2023-11-30T18:22:39.459521+0000","last_became_active":"2023-11-30T18:22:39.447924+0000","last_became_peered":"2023-11-30T18:22:39.447924+0000","last_unstale":"2023-11-30T18:22:39.459521+0000","last_undegraded":"2023-11-30T18:22:39.459521+0000","last_fullsized":"2023-11-30T18:22:39.459521+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3f","version":"168'3","reported_seq":13,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.442643+0000","last_change":"2023-11-30T18:22:39.060071+0000","last_active":"2023-11-30T18:22:39.442643+0000","last_peered":"2023-11-30T18:22:39.442643+0000","last_clean":"2023-11-30T18:22:39.442643+0000","last_became_active":"2023-11-30T18:22:39.059789+0000","last_became_peered":"2023-11-30T18:22:39.059789+0000","last_unstale":"2023-11-30T18:22:39.442643+0000","last_undegraded":"2023-11-30T18:22:39.442643+0000","last_fullsized":"2023-11-30T18:22:39.442643+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.459956+0000","last_change":"2023-11-30T18:22:39.458951+0000","last_active":"2023-11-30T18:22:39.459956+0000","last_peered":"2023-11-30T18:22:39.459956+0000","last_clean":"2023-11-30T18:22:39.459956+0000","last_became_active":"2023-11-30T18:22:39.458653+0000","last_became_peered":"2023-11-30T18:22:39.458653+0000","last_unstale":"2023-11-30T18:22:39.459956+0000","last_undegraded":"2023-11-30T18:22:39.459956+0000","last_fullsized":"2023-11-30T18:22:39.459956+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.438315+0000","last_change":"2023-11-30T18:22:39.056686+0000","last_active":"2023-11-30T18:22:39.438315+0000","last_peered":"2023-11-30T18:22:39.438315+0000","last_clean":"2023-11-30T18:22:39.438315+0000","last_became_active":"2023-11-30T18:22:39.056356+0000","last_became_peered":"2023-11-30T18:22:39.056356+0000","last_unstale":"2023-11-30T18:22:39.438315+0000","last_undegraded":"2023-11-30T18:22:39.438315+0000","last_fullsized":"2023-11-30T18:22:39.438315+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.459559+0000","last_change":"2023-11-30T18:22:39.458190+0000","last_active":"2023-11-30T18:22:39.459559+0000","last_peered":"2023-11-30T18:22:39.459559+0000","last_clean":"2023-11-30T18:22:39.459559+0000","last_became_active":"2023-11-30T18:22:39.457909+0000","last_became_peered":"2023-11-30T18:22:39.457909+0000","last_unstale":"2023-11-30T18:22:39.459559+0000","last_undegraded":"2023-11-30T18:22:39.459559+0000","last_fullsized":"2023-11-30T18:22:39.459559+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.442543+0000","last_change":"2023-11-30T18:22:39.056857+0000","last_active":"2023-11-30T18:22:39.442543+0000","last_peered":"2023-11-30T18:22:39.442543+0000","last_clean":"2023-11-30T18:22:39.442543+0000","last_became_active":"2023-11-30T18:22:39.056413+0000","last_became_peered":"2023-11-30T18:22:39.056413+0000","last_unstale":"2023-11-30T18:22:39.442543+0000","last_undegraded":"2023-11-30T18:22:39.442543+0000","last_fullsized":"2023-11-30T18:22:39.442543+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.457227+0000","last_change":"2023-11-30T18:22:39.455105+0000","last_active":"2023-11-30T18:22:39.457227+0000","last_peered":"2023-11-30T18:22:39.457227+0000","last_clean":"2023-11-30T18:22:39.457227+0000","last_became_active":"2023-11-30T18:22:39.454774+0000","last_became_peered":"2023-11-30T18:22:39.454774+0000","last_unstale":"2023-11-30T18:22:39.457227+0000","last_undegraded":"2023-11-30T18:22:39.457227+0000","last_fullsized":"2023-11-30T18:22:39.457227+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"168'2","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.442913+0000","last_change":"2023-11-30T18:22:39.058274+0000","last_active":"2023-11-30T18:22:39.442913+0000","last_peered":"2023-11-30T18:22:39.442913+0000","last_clean":"2023-11-30T18:22:39.442913+0000","last_became_active":"2023-11-30T18:22:39.057986+0000","last_became_peered":"2023-11-30T18:22:39.057986+0000","last_unstale":"2023-11-30T18:22:39.442913+0000","last_undegraded":"2023-11-30T18:22:39.442913+0000","last_fullsized":"2023-11-30T18:22:39.442913+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.449984+0000","last_change":"2023-11-30T18:22:39.446405+0000","last_active":"2023-11-30T18:22:39.449984+0000","last_peered":"2023-11-30T18:22:39.449984+0000","last_clean":"2023-11-30T18:22:39.449984+0000","last_became_active":"2023-11-30T18:22:39.446050+0000","last_became_peered":"2023-11-30T18:22:39.446050+0000","last_unstale":"2023-11-30T18:22:39.449984+0000","last_undegraded":"2023-11-30T18:22:39.449984+0000","last_fullsized":"2023-11-30T18:22:39.449984+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"168'1","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.455317+0000","last_change":"2023-11-30T18:22:39.060932+0000","last_active":"2023-11-30T18:22:39.455317+0000","last_peered":"2023-11-30T18:22:39.455317+0000","last_clean":"2023-11-30T18:22:39.455317+0000","last_became_active":"2023-11-30T18:22:39.060289+0000","last_became_peered":"2023-11-30T18:22:39.060289+0000","last_unstale":"2023-11-30T18:22:39.455317+0000","last_undegraded":"2023-11-30T18:22:39.455317+0000","last_fullsized":"2023-11-30T18:22:39.455317+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.459452+0000","last_change":"2023-11-30T18:22:39.454905+0000","last_active":"2023-11-30T18:22:39.459452+0000","last_peered":"2023-11-30T18:22:39.459452+0000","last_clean":"2023-11-30T18:22:39.459452+0000","last_became_active":"2023-11-30T18:22:39.454588+0000","last_became_peered":"2023-11-30T18:22:39.454588+0000","last_unstale":"2023-11-30T18:22:39.459452+0000","last_undegraded":"2023-11-30T18:22:39.459452+0000","last_fullsized":"2023-11-30T18:22:39.459452+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3a","version":"168'1","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.449415+0000","last_change":"2023-11-30T18:22:39.052992+0000","last_active":"2023-11-30T18:22:39.449415+0000","last_peered":"2023-11-30T18:22:39.449415+0000","last_clean":"2023-11-30T18:22:39.449415+0000","last_became_active":"2023-11-30T18:22:39.052051+0000","last_became_peered":"2023-11-30T18:22:39.052051+0000","last_unstale":"2023-11-30T18:22:39.449415+0000","last_undegraded":"2023-11-30T18:22:39.449415+0000","last_fullsized":"2023-11-30T18:22:39.449415+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.454201+0000","last_change":"2023-11-30T18:22:39.451078+0000","last_active":"2023-11-30T18:22:39.454201+0000","last_peered":"2023-11-30T18:22:39.454201+0000","last_clean":"2023-11-30T18:22:39.454201+0000","last_became_active":"2023-11-30T18:22:39.450122+0000","last_became_peered":"2023-11-30T18:22:39.450122+0000","last_unstale":"2023-11-30T18:22:39.454201+0000","last_undegraded":"2023-11-30T18:22:39.454201+0000","last_fullsized":"2023-11-30T18:22:39.454201+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.440619+0000","last_change":"2023-11-30T18:22:39.053789+0000","last_active":"2023-11-30T18:22:39.440619+0000","last_peered":"2023-11-30T18:22:39.440619+0000","last_clean":"2023-11-30T18:22:39.440619+0000","last_became_active":"2023-11-30T18:22:39.053466+0000","last_became_peered":"2023-11-30T18:22:39.053466+0000","last_unstale":"2023-11-30T18:22:39.440619+0000","last_undegraded":"2023-11-30T18:22:39.440619+0000","last_fullsized":"2023-11-30T18:22:39.440619+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.444549+0000","last_change":"2023-11-30T18:22:39.439777+0000","last_active":"2023-11-30T18:22:39.444549+0000","last_peered":"2023-11-30T18:22:39.444549+0000","last_clean":"2023-11-30T18:22:39.444549+0000","last_became_active":"2023-11-30T18:22:39.439484+0000","last_became_peered":"2023-11-30T18:22:39.439484+0000","last_unstale":"2023-11-30T18:22:39.444549+0000","last_undegraded":"2023-11-30T18:22:39.444549+0000","last_fullsized":"2023-11-30T18:22:39.444549+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.443650+0000","last_change":"2023-11-30T18:22:39.056766+0000","last_active":"2023-11-30T18:22:39.443650+0000","last_peered":"2023-11-30T18:22:39.443650+0000","last_clean":"2023-11-30T18:22:39.443650+0000","last_became_active":"2023-11-30T18:22:39.056113+0000","last_became_peered":"2023-11-30T18:22:39.056113+0000","last_unstale":"2023-11-30T18:22:39.443650+0000","last_undegraded":"2023-11-30T18:22:39.443650+0000","last_fullsized":"2023-11-30T18:22:39.443650+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.457912+0000","last_change":"2023-11-30T18:22:39.456567+0000","last_active":"2023-11-30T18:22:39.457912+0000","last_peered":"2023-11-30T18:22:39.457912+0000","last_clean":"2023-11-30T18:22:39.457912+0000","last_became_active":"2023-11-30T18:22:39.455988+0000","last_became_peered":"2023-11-30T18:22:39.455988+0000","last_unstale":"2023-11-30T18:22:39.457912+0000","last_undegraded":"2023-11-30T18:22:39.457912+0000","last_fullsized":"2023-11-30T18:22:39.457912+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.438714+0000","last_change":"2023-11-30T18:22:39.058789+0000","last_active":"2023-11-30T18:22:39.438714+0000","last_peered":"2023-11-30T18:22:39.438714+0000","last_clean":"2023-11-30T18:22:39.438714+0000","last_became_active":"2023-11-30T18:22:39.058464+0000","last_became_peered":"2023-11-30T18:22:39.058464+0000","last_unstale":"2023-11-30T18:22:39.438714+0000","last_undegraded":"2023-11-30T18:22:39.438714+0000","last_fullsized":"2023-11-30T18:22:39.438714+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.450476+0000","last_change":"2023-11-30T18:22:39.449145+0000","last_active":"2023-11-30T18:22:39.450476+0000","last_peered":"2023-11-30T18:22:39.450476+0000","last_clean":"2023-11-30T18:22:39.450476+0000","last_became_active":"2023-11-30T18:22:39.448878+0000","last_became_peered":"2023-11-30T18:22:39.448878+0000","last_unstale":"2023-11-30T18:22:39.450476+0000","last_undegraded":"2023-11-30T18:22:39.450476+0000","last_fullsized":"2023-11-30T18:22:39.450476+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.438413+0000","last_change":"2023-11-30T18:22:39.056457+0000","last_active":"2023-11-30T18:22:39.438413+0000","last_peered":"2023-11-30T18:22:39.438413+0000","last_clean":"2023-11-30T18:22:39.438413+0000","last_became_active":"2023-11-30T18:22:39.055960+0000","last_became_peered":"2023-11-30T18:22:39.055960+0000","last_unstale":"2023-11-30T18:22:39.438413+0000","last_undegraded":"2023-11-30T18:22:39.438413+0000","last_fullsized":"2023-11-30T18:22:39.438413+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.453332+0000","last_change":"2023-11-30T18:22:39.452517+0000","last_active":"2023-11-30T18:22:39.453332+0000","last_peered":"2023-11-30T18:22:39.453332+0000","last_clean":"2023-11-30T18:22:39.453332+0000","last_became_active":"2023-11-30T18:22:39.452178+0000","last_became_peered":"2023-11-30T18:22:39.452178+0000","last_unstale":"2023-11-30T18:22:39.453332+0000","last_undegraded":"2023-11-30T18:22:39.453332+0000","last_fullsized":"2023-11-30T18:22:39.453332+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.435144+0000","last_change":"2023-11-30T18:22:39.053035+0000","last_active":"2023-11-30T18:22:39.435144+0000","last_peered":"2023-11-30T18:22:39.435144+0000","last_clean":"2023-11-30T18:22:39.435144+0000","last_became_active":"2023-11-30T18:22:39.052707+0000","last_became_peered":"2023-11-30T18:22:39.052707+0000","last_unstale":"2023-11-30T18:22:39.435144+0000","last_undegraded":"2023-11-30T18:22:39.435144+0000","last_fullsized":"2023-11-30T18:22:39.435144+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.460801+0000","last_change":"2023-11-30T18:22:39.460392+0000","last_active":"2023-11-30T18:22:39.460801+0000","last_peered":"2023-11-30T18:22:39.460801+0000","last_clean":"2023-11-30T18:22:39.460801+0000","last_became_active":"2023-11-30T18:22:39.460064+0000","last_became_peered":"2023-11-30T18:22:39.460064+0000","last_unstale":"2023-11-30T18:22:39.460801+0000","last_undegraded":"2023-11-30T18:22:39.460801+0000","last_fullsized":"2023-11-30T18:22:39.460801+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.34","version":"168'4","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.466610+0000","last_change":"2023-11-30T18:22:39.057631+0000","last_active":"2023-11-30T18:22:39.466610+0000","last_peered":"2023-11-30T18:22:39.466610+0000","last_clean":"2023-11-30T18:22:39.466610+0000","last_became_active":"2023-11-30T18:22:39.057336+0000","last_became_peered":"2023-11-30T18:22:39.057336+0000","last_unstale":"2023-11-30T18:22:39.466610+0000","last_undegraded":"2023-11-30T18:22:39.466610+0000","last_fullsized":"2023-11-30T18:22:39.466610+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.457569+0000","last_change":"2023-11-30T18:22:39.456375+0000","last_active":"2023-11-30T18:22:39.457569+0000","last_peered":"2023-11-30T18:22:39.457569+0000","last_clean":"2023-11-30T18:22:39.457569+0000","last_became_active":"2023-11-30T18:22:39.456110+0000","last_became_peered":"2023-11-30T18:22:39.456110+0000","last_unstale":"2023-11-30T18:22:39.457569+0000","last_undegraded":"2023-11-30T18:22:39.457569+0000","last_fullsized":"2023-11-30T18:22:39.457569+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.33","version":"168'1","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.439102+0000","last_change":"2023-11-30T18:22:39.060652+0000","last_active":"2023-11-30T18:22:39.439102+0000","last_peered":"2023-11-30T18:22:39.439102+0000","last_clean":"2023-11-30T18:22:39.439102+0000","last_became_active":"2023-11-30T18:22:39.060367+0000","last_became_peered":"2023-11-30T18:22:39.060367+0000","last_unstale":"2023-11-30T18:22:39.439102+0000","last_undegraded":"2023-11-30T18:22:39.439102+0000","last_fullsized":"2023-11-30T18:22:39.439102+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.461908+0000","last_change":"2023-11-30T18:22:39.458309+0000","last_active":"2023-11-30T18:22:39.461908+0000","last_peered":"2023-11-30T18:22:39.461908+0000","last_clean":"2023-11-30T18:22:39.461908+0000","last_became_active":"2023-11-30T18:22:39.458053+0000","last_became_peered":"2023-11-30T18:22:39.458053+0000","last_unstale":"2023-11-30T18:22:39.461908+0000","last_undegraded":"2023-11-30T18:22:39.461908+0000","last_fullsized":"2023-11-30T18:22:39.461908+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.437590+0000","last_change":"2023-11-30T18:22:39.065520+0000","last_active":"2023-11-30T18:22:39.437590+0000","last_peered":"2023-11-30T18:22:39.437590+0000","last_clean":"2023-11-30T18:22:39.437590+0000","last_became_active":"2023-11-30T18:22:39.065163+0000","last_became_peered":"2023-11-30T18:22:39.065163+0000","last_unstale":"2023-11-30T18:22:39.437590+0000","last_undegraded":"2023-11-30T18:22:39.437590+0000","last_fullsized":"2023-11-30T18:22:39.437590+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.448449+0000","last_change":"2023-11-30T18:22:39.447335+0000","last_active":"2023-11-30T18:22:39.448449+0000","last_peered":"2023-11-30T18:22:39.448449+0000","last_clean":"2023-11-30T18:22:39.448449+0000","last_became_active":"2023-11-30T18:22:39.447098+0000","last_became_peered":"2023-11-30T18:22:39.447098+0000","last_unstale":"2023-11-30T18:22:39.448449+0000","last_undegraded":"2023-11-30T18:22:39.448449+0000","last_fullsized":"2023-11-30T18:22:39.448449+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.430782+0000","last_change":"2023-11-30T18:22:39.062156+0000","last_active":"2023-11-30T18:22:39.430782+0000","last_peered":"2023-11-30T18:22:39.430782+0000","last_clean":"2023-11-30T18:22:39.430782+0000","last_became_active":"2023-11-30T18:22:39.061897+0000","last_became_peered":"2023-11-30T18:22:39.061897+0000","last_unstale":"2023-11-30T18:22:39.430782+0000","last_undegraded":"2023-11-30T18:22:39.430782+0000","last_fullsized":"2023-11-30T18:22:39.430782+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.448583+0000","last_change":"2023-11-30T18:22:39.447723+0000","last_active":"2023-11-30T18:22:39.448583+0000","last_peered":"2023-11-30T18:22:39.448583+0000","last_clean":"2023-11-30T18:22:39.448583+0000","last_became_active":"2023-11-30T18:22:39.447285+0000","last_became_peered":"2023-11-30T18:22:39.447285+0000","last_unstale":"2023-11-30T18:22:39.448583+0000","last_undegraded":"2023-11-30T18:22:39.448583+0000","last_fullsized":"2023-11-30T18:22:39.448583+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.30","version":"168'4","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.455206+0000","last_change":"2023-11-30T18:22:39.052826+0000","last_active":"2023-11-30T18:22:39.455206+0000","last_peered":"2023-11-30T18:22:39.455206+0000","last_clean":"2023-11-30T18:22:39.455206+0000","last_became_active":"2023-11-30T18:22:39.047108+0000","last_became_peered":"2023-11-30T18:22:39.047108+0000","last_unstale":"2023-11-30T18:22:39.455206+0000","last_undegraded":"2023-11-30T18:22:39.455206+0000","last_fullsized":"2023-11-30T18:22:39.455206+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.449381+0000","last_change":"2023-11-30T18:22:39.448578+0000","last_active":"2023-11-30T18:22:39.449381+0000","last_peered":"2023-11-30T18:22:39.449381+0000","last_clean":"2023-11-30T18:22:39.449381+0000","last_became_active":"2023-11-30T18:22:39.448279+0000","last_became_peered":"2023-11-30T18:22:39.448279+0000","last_unstale":"2023-11-30T18:22:39.449381+0000","last_undegraded":"2023-11-30T18:22:39.449381+0000","last_fullsized":"2023-11-30T18:22:39.449381+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.443311+0000","last_change":"2023-11-30T18:22:39.056470+0000","last_active":"2023-11-30T18:22:39.443311+0000","last_peered":"2023-11-30T18:22:39.443311+0000","last_clean":"2023-11-30T18:22:39.443311+0000","last_became_active":"2023-11-30T18:22:39.056134+0000","last_became_peered":"2023-11-30T18:22:39.056134+0000","last_unstale":"2023-11-30T18:22:39.443311+0000","last_undegraded":"2023-11-30T18:22:39.443311+0000","last_fullsized":"2023-11-30T18:22:39.443311+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.460581+0000","last_change":"2023-11-30T18:22:39.453263+0000","last_active":"2023-11-30T18:22:39.460581+0000","last_peered":"2023-11-30T18:22:39.460581+0000","last_clean":"2023-11-30T18:22:39.460581+0000","last_became_active":"2023-11-30T18:22:39.452912+0000","last_became_peered":"2023-11-30T18:22:39.452912+0000","last_unstale":"2023-11-30T18:22:39.460581+0000","last_undegraded":"2023-11-30T18:22:39.460581+0000","last_fullsized":"2023-11-30T18:22:39.460581+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.441226+0000","last_change":"2023-11-30T18:22:39.062306+0000","last_active":"2023-11-30T18:22:39.441226+0000","last_peered":"2023-11-30T18:22:39.441226+0000","last_clean":"2023-11-30T18:22:39.441226+0000","last_became_active":"2023-11-30T18:22:39.061781+0000","last_became_peered":"2023-11-30T18:22:39.061781+0000","last_unstale":"2023-11-30T18:22:39.441226+0000","last_undegraded":"2023-11-30T18:22:39.441226+0000","last_fullsized":"2023-11-30T18:22:39.441226+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.453136+0000","last_change":"2023-11-30T18:22:39.452439+0000","last_active":"2023-11-30T18:22:39.453136+0000","last_peered":"2023-11-30T18:22:39.453136+0000","last_clean":"2023-11-30T18:22:39.453136+0000","last_became_active":"2023-11-30T18:22:39.451782+0000","last_became_peered":"2023-11-30T18:22:39.451782+0000","last_unstale":"2023-11-30T18:22:39.453136+0000","last_undegraded":"2023-11-30T18:22:39.453136+0000","last_fullsized":"2023-11-30T18:22:39.453136+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.2d","version":"168'1","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.448440+0000","last_change":"2023-11-30T18:22:39.056875+0000","last_active":"2023-11-30T18:22:39.448440+0000","last_peered":"2023-11-30T18:22:39.448440+0000","last_clean":"2023-11-30T18:22:39.448440+0000","last_became_active":"2023-11-30T18:22:39.056488+0000","last_became_peered":"2023-11-30T18:22:39.056488+0000","last_unstale":"2023-11-30T18:22:39.448440+0000","last_undegraded":"2023-11-30T18:22:39.448440+0000","last_fullsized":"2023-11-30T18:22:39.448440+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.450911+0000","last_change":"2023-11-30T18:22:39.446555+0000","last_active":"2023-11-30T18:22:39.450911+0000","last_peered":"2023-11-30T18:22:39.450911+0000","last_clean":"2023-11-30T18:22:39.450911+0000","last_became_active":"2023-11-30T18:22:39.446258+0000","last_became_peered":"2023-11-30T18:22:39.446258+0000","last_unstale":"2023-11-30T18:22:39.450911+0000","last_undegraded":"2023-11-30T18:22:39.450911+0000","last_fullsized":"2023-11-30T18:22:39.450911+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.441807+0000","last_change":"2023-11-30T18:22:39.062736+0000","last_active":"2023-11-30T18:22:39.441807+0000","last_peered":"2023-11-30T18:22:39.441807+0000","last_clean":"2023-11-30T18:22:39.441807+0000","last_became_active":"2023-11-30T18:22:39.061095+0000","last_became_peered":"2023-11-30T18:22:39.061095+0000","last_unstale":"2023-11-30T18:22:39.441807+0000","last_undegraded":"2023-11-30T18:22:39.441807+0000","last_fullsized":"2023-11-30T18:22:39.441807+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.455652+0000","last_change":"2023-11-30T18:22:39.454399+0000","last_active":"2023-11-30T18:22:39.455652+0000","last_peered":"2023-11-30T18:22:39.455652+0000","last_clean":"2023-11-30T18:22:39.455652+0000","last_became_active":"2023-11-30T18:22:39.454140+0000","last_became_peered":"2023-11-30T18:22:39.454140+0000","last_unstale":"2023-11-30T18:22:39.455652+0000","last_undegraded":"2023-11-30T18:22:39.455652+0000","last_fullsized":"2023-11-30T18:22:39.455652+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"168'1","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.454923+0000","last_change":"2023-11-30T18:22:39.060703+0000","last_active":"2023-11-30T18:22:39.454923+0000","last_peered":"2023-11-30T18:22:39.454923+0000","last_clean":"2023-11-30T18:22:39.454923+0000","last_became_active":"2023-11-30T18:22:39.060306+0000","last_became_peered":"2023-11-30T18:22:39.060306+0000","last_unstale":"2023-11-30T18:22:39.454923+0000","last_undegraded":"2023-11-30T18:22:39.454923+0000","last_fullsized":"2023-11-30T18:22:39.454923+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.464103+0000","last_change":"2023-11-30T18:22:39.460643+0000","last_active":"2023-11-30T18:22:39.464103+0000","last_peered":"2023-11-30T18:22:39.464103+0000","last_clean":"2023-11-30T18:22:39.464103+0000","last_became_active":"2023-11-30T18:22:39.460359+0000","last_became_peered":"2023-11-30T18:22:39.460359+0000","last_unstale":"2023-11-30T18:22:39.464103+0000","last_undegraded":"2023-11-30T18:22:39.464103+0000","last_fullsized":"2023-11-30T18:22:39.464103+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.434546+0000","last_change":"2023-11-30T18:22:39.052313+0000","last_active":"2023-11-30T18:22:39.434546+0000","last_peered":"2023-11-30T18:22:39.434546+0000","last_clean":"2023-11-30T18:22:39.434546+0000","last_became_active":"2023-11-30T18:22:39.052028+0000","last_became_peered":"2023-11-30T18:22:39.052028+0000","last_unstale":"2023-11-30T18:22:39.434546+0000","last_undegraded":"2023-11-30T18:22:39.434546+0000","last_fullsized":"2023-11-30T18:22:39.434546+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.457203+0000","last_change":"2023-11-30T18:22:39.454642+0000","last_active":"2023-11-30T18:22:39.457203+0000","last_peered":"2023-11-30T18:22:39.457203+0000","last_clean":"2023-11-30T18:22:39.457203+0000","last_became_active":"2023-11-30T18:22:39.454351+0000","last_became_peered":"2023-11-30T18:22:39.454351+0000","last_unstale":"2023-11-30T18:22:39.457203+0000","last_undegraded":"2023-11-30T18:22:39.457203+0000","last_fullsized":"2023-11-30T18:22:39.457203+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.445441+0000","last_change":"2023-11-30T18:22:39.060274+0000","last_active":"2023-11-30T18:22:39.445441+0000","last_peered":"2023-11-30T18:22:39.445441+0000","last_clean":"2023-11-30T18:22:39.445441+0000","last_became_active":"2023-11-30T18:22:39.059206+0000","last_became_peered":"2023-11-30T18:22:39.059206+0000","last_unstale":"2023-11-30T18:22:39.445441+0000","last_undegraded":"2023-11-30T18:22:39.445441+0000","last_fullsized":"2023-11-30T18:22:39.445441+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.457361+0000","last_change":"2023-11-30T18:22:39.455095+0000","last_active":"2023-11-30T18:22:39.457361+0000","last_peered":"2023-11-30T18:22:39.457361+0000","last_clean":"2023-11-30T18:22:39.457361+0000","last_became_active":"2023-11-30T18:22:39.454812+0000","last_became_peered":"2023-11-30T18:22:39.454812+0000","last_unstale":"2023-11-30T18:22:39.457361+0000","last_undegraded":"2023-11-30T18:22:39.457361+0000","last_fullsized":"2023-11-30T18:22:39.457361+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.433996+0000","last_change":"2023-11-30T18:22:39.057385+0000","last_active":"2023-11-30T18:22:39.433996+0000","last_peered":"2023-11-30T18:22:39.433996+0000","last_clean":"2023-11-30T18:22:39.433996+0000","last_became_active":"2023-11-30T18:22:39.057080+0000","last_became_peered":"2023-11-30T18:22:39.057080+0000","last_unstale":"2023-11-30T18:22:39.433996+0000","last_undegraded":"2023-11-30T18:22:39.433996+0000","last_fullsized":"2023-11-30T18:22:39.433996+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.445435+0000","last_change":"2023-11-30T18:22:39.443927+0000","last_active":"2023-11-30T18:22:39.445435+0000","last_peered":"2023-11-30T18:22:39.445435+0000","last_clean":"2023-11-30T18:22:39.445435+0000","last_became_active":"2023-11-30T18:22:39.443646+0000","last_became_peered":"2023-11-30T18:22:39.443646+0000","last_unstale":"2023-11-30T18:22:39.445435+0000","last_undegraded":"2023-11-30T18:22:39.445435+0000","last_fullsized":"2023-11-30T18:22:39.445435+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.438455+0000","last_change":"2023-11-30T18:22:39.059159+0000","last_active":"2023-11-30T18:22:39.438455+0000","last_peered":"2023-11-30T18:22:39.438455+0000","last_clean":"2023-11-30T18:22:39.438455+0000","last_became_active":"2023-11-30T18:22:39.058889+0000","last_became_peered":"2023-11-30T18:22:39.058889+0000","last_unstale":"2023-11-30T18:22:39.438455+0000","last_undegraded":"2023-11-30T18:22:39.438455+0000","last_fullsized":"2023-11-30T18:22:39.438455+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.454402+0000","last_change":"2023-11-30T18:22:39.444887+0000","last_active":"2023-11-30T18:22:39.454402+0000","last_peered":"2023-11-30T18:22:39.454402+0000","last_clean":"2023-11-30T18:22:39.454402+0000","last_became_active":"2023-11-30T18:22:39.444618+0000","last_became_peered":"2023-11-30T18:22:39.444618+0000","last_unstale":"2023-11-30T18:22:39.454402+0000","last_undegraded":"2023-11-30T18:22:39.454402+0000","last_fullsized":"2023-11-30T18:22:39.454402+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.441109+0000","last_change":"2023-11-30T18:22:39.057242+0000","last_active":"2023-11-30T18:22:39.441109+0000","last_peered":"2023-11-30T18:22:39.441109+0000","last_clean":"2023-11-30T18:22:39.441109+0000","last_became_active":"2023-11-30T18:22:39.056542+0000","last_became_peered":"2023-11-30T18:22:39.056542+0000","last_unstale":"2023-11-30T18:22:39.441109+0000","last_undegraded":"2023-11-30T18:22:39.441109+0000","last_fullsized":"2023-11-30T18:22:39.441109+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.461645+0000","last_change":"2023-11-30T18:22:39.456817+0000","last_active":"2023-11-30T18:22:39.461645+0000","last_peered":"2023-11-30T18:22:39.461645+0000","last_clean":"2023-11-30T18:22:39.461645+0000","last_became_active":"2023-11-30T18:22:39.456443+0000","last_became_peered":"2023-11-30T18:22:39.456443+0000","last_unstale":"2023-11-30T18:22:39.461645+0000","last_undegraded":"2023-11-30T18:22:39.461645+0000","last_fullsized":"2023-11-30T18:22:39.461645+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.430430+0000","last_change":"2023-11-30T18:22:39.059063+0000","last_active":"2023-11-30T18:22:39.430430+0000","last_peered":"2023-11-30T18:22:39.430430+0000","last_clean":"2023-11-30T18:22:39.430430+0000","last_became_active":"2023-11-30T18:22:39.058720+0000","last_became_peered":"2023-11-30T18:22:39.058720+0000","last_unstale":"2023-11-30T18:22:39.430430+0000","last_undegraded":"2023-11-30T18:22:39.430430+0000","last_fullsized":"2023-11-30T18:22:39.430430+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.461699+0000","last_change":"2023-11-30T18:22:39.458012+0000","last_active":"2023-11-30T18:22:39.461699+0000","last_peered":"2023-11-30T18:22:39.461699+0000","last_clean":"2023-11-30T18:22:39.461699+0000","last_became_active":"2023-11-30T18:22:39.456381+0000","last_became_peered":"2023-11-30T18:22:39.456381+0000","last_unstale":"2023-11-30T18:22:39.461699+0000","last_undegraded":"2023-11-30T18:22:39.461699+0000","last_fullsized":"2023-11-30T18:22:39.461699+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.442454+0000","last_change":"2023-11-30T18:22:39.061319+0000","last_active":"2023-11-30T18:22:39.442454+0000","last_peered":"2023-11-30T18:22:39.442454+0000","last_clean":"2023-11-30T18:22:39.442454+0000","last_became_active":"2023-11-30T18:22:39.061034+0000","last_became_peered":"2023-11-30T18:22:39.061034+0000","last_unstale":"2023-11-30T18:22:39.442454+0000","last_undegraded":"2023-11-30T18:22:39.442454+0000","last_fullsized":"2023-11-30T18:22:39.442454+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.451234+0000","last_change":"2023-11-30T18:22:39.449374+0000","last_active":"2023-11-30T18:22:39.451234+0000","last_peered":"2023-11-30T18:22:39.451234+0000","last_clean":"2023-11-30T18:22:39.451234+0000","last_became_active":"2023-11-30T18:22:39.449110+0000","last_became_peered":"2023-11-30T18:22:39.449110+0000","last_unstale":"2023-11-30T18:22:39.451234+0000","last_undegraded":"2023-11-30T18:22:39.451234+0000","last_fullsized":"2023-11-30T18:22:39.451234+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.431188+0000","last_change":"2023-11-30T18:22:39.052584+0000","last_active":"2023-11-30T18:22:39.431188+0000","last_peered":"2023-11-30T18:22:39.431188+0000","last_clean":"2023-11-30T18:22:39.431188+0000","last_became_active":"2023-11-30T18:22:39.052296+0000","last_became_peered":"2023-11-30T18:22:39.052296+0000","last_unstale":"2023-11-30T18:22:39.431188+0000","last_undegraded":"2023-11-30T18:22:39.431188+0000","last_fullsized":"2023-11-30T18:22:39.431188+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.457273+0000","last_change":"2023-11-30T18:22:39.454486+0000","last_active":"2023-11-30T18:22:39.457273+0000","last_peered":"2023-11-30T18:22:39.457273+0000","last_clean":"2023-11-30T18:22:39.457273+0000","last_became_active":"2023-11-30T18:22:39.452476+0000","last_became_peered":"2023-11-30T18:22:39.452476+0000","last_unstale":"2023-11-30T18:22:39.457273+0000","last_undegraded":"2023-11-30T18:22:39.457273+0000","last_fullsized":"2023-11-30T18:22:39.457273+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.430155+0000","last_change":"2023-11-30T18:22:39.060692+0000","last_active":"2023-11-30T18:22:39.430155+0000","last_peered":"2023-11-30T18:22:39.430155+0000","last_clean":"2023-11-30T18:22:39.430155+0000","last_became_active":"2023-11-30T18:22:39.060204+0000","last_became_peered":"2023-11-30T18:22:39.060204+0000","last_unstale":"2023-11-30T18:22:39.430155+0000","last_undegraded":"2023-11-30T18:22:39.430155+0000","last_fullsized":"2023-11-30T18:22:39.430155+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.461491+0000","last_change":"2023-11-30T18:22:39.457109+0000","last_active":"2023-11-30T18:22:39.461491+0000","last_peered":"2023-11-30T18:22:39.461491+0000","last_clean":"2023-11-30T18:22:39.461491+0000","last_became_active":"2023-11-30T18:22:39.456308+0000","last_became_peered":"2023-11-30T18:22:39.456308+0000","last_unstale":"2023-11-30T18:22:39.461491+0000","last_undegraded":"2023-11-30T18:22:39.461491+0000","last_fullsized":"2023-11-30T18:22:39.461491+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.446470+0000","last_change":"2023-11-30T18:22:39.066356+0000","last_active":"2023-11-30T18:22:39.446470+0000","last_peered":"2023-11-30T18:22:39.446470+0000","last_clean":"2023-11-30T18:22:39.446470+0000","last_became_active":"2023-11-30T18:22:39.066104+0000","last_became_peered":"2023-11-30T18:22:39.066104+0000","last_unstale":"2023-11-30T18:22:39.446470+0000","last_undegraded":"2023-11-30T18:22:39.446470+0000","last_fullsized":"2023-11-30T18:22:39.446470+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.458917+0000","last_change":"2023-11-30T18:22:39.452867+0000","last_active":"2023-11-30T18:22:39.458917+0000","last_peered":"2023-11-30T18:22:39.458917+0000","last_clean":"2023-11-30T18:22:39.458917+0000","last_became_active":"2023-11-30T18:22:39.452483+0000","last_became_peered":"2023-11-30T18:22:39.452483+0000","last_unstale":"2023-11-30T18:22:39.458917+0000","last_undegraded":"2023-11-30T18:22:39.458917+0000","last_fullsized":"2023-11-30T18:22:39.458917+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.440505+0000","last_change":"2023-11-30T18:22:39.060195+0000","last_active":"2023-11-30T18:22:39.440505+0000","last_peered":"2023-11-30T18:22:39.440505+0000","last_clean":"2023-11-30T18:22:39.440505+0000","last_became_active":"2023-11-30T18:22:39.059913+0000","last_became_peered":"2023-11-30T18:22:39.059913+0000","last_unstale":"2023-11-30T18:22:39.440505+0000","last_undegraded":"2023-11-30T18:22:39.440505+0000","last_fullsized":"2023-11-30T18:22:39.440505+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.460094+0000","last_change":"2023-11-30T18:22:39.451229+0000","last_active":"2023-11-30T18:22:39.460094+0000","last_peered":"2023-11-30T18:22:39.460094+0000","last_clean":"2023-11-30T18:22:39.460094+0000","last_became_active":"2023-11-30T18:22:39.450946+0000","last_became_peered":"2023-11-30T18:22:39.450946+0000","last_unstale":"2023-11-30T18:22:39.460094+0000","last_undegraded":"2023-11-30T18:22:39.460094+0000","last_fullsized":"2023-11-30T18:22:39.460094+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"168'1","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.456134+0000","last_change":"2023-11-30T18:22:39.050289+0000","last_active":"2023-11-30T18:22:39.456134+0000","last_peered":"2023-11-30T18:22:39.456134+0000","last_clean":"2023-11-30T18:22:39.456134+0000","last_became_active":"2023-11-30T18:22:39.050014+0000","last_became_peered":"2023-11-30T18:22:39.050014+0000","last_unstale":"2023-11-30T18:22:39.456134+0000","last_undegraded":"2023-11-30T18:22:39.456134+0000","last_fullsized":"2023-11-30T18:22:39.456134+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.452835+0000","last_change":"2023-11-30T18:22:39.452045+0000","last_active":"2023-11-30T18:22:39.452835+0000","last_peered":"2023-11-30T18:22:39.452835+0000","last_clean":"2023-11-30T18:22:39.452835+0000","last_became_active":"2023-11-30T18:22:39.451708+0000","last_became_peered":"2023-11-30T18:22:39.451708+0000","last_unstale":"2023-11-30T18:22:39.452835+0000","last_undegraded":"2023-11-30T18:22:39.452835+0000","last_fullsized":"2023-11-30T18:22:39.452835+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"168'1","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.454017+0000","last_change":"2023-11-30T18:22:39.062083+0000","last_active":"2023-11-30T18:22:39.454017+0000","last_peered":"2023-11-30T18:22:39.454017+0000","last_clean":"2023-11-30T18:22:39.454017+0000","last_became_active":"2023-11-30T18:22:39.061144+0000","last_became_peered":"2023-11-30T18:22:39.061144+0000","last_unstale":"2023-11-30T18:22:39.454017+0000","last_undegraded":"2023-11-30T18:22:39.454017+0000","last_fullsized":"2023-11-30T18:22:39.454017+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.454700+0000","last_change":"2023-11-30T18:22:39.451664+0000","last_active":"2023-11-30T18:22:39.454700+0000","last_peered":"2023-11-30T18:22:39.454700+0000","last_clean":"2023-11-30T18:22:39.454700+0000","last_became_active":"2023-11-30T18:22:39.451386+0000","last_became_peered":"2023-11-30T18:22:39.451386+0000","last_unstale":"2023-11-30T18:22:39.454700+0000","last_undegraded":"2023-11-30T18:22:39.454700+0000","last_fullsized":"2023-11-30T18:22:39.454700+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"168'2","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.455646+0000","last_change":"2023-11-30T18:22:39.057857+0000","last_active":"2023-11-30T18:22:39.455646+0000","last_peered":"2023-11-30T18:22:39.455646+0000","last_clean":"2023-11-30T18:22:39.455646+0000","last_became_active":"2023-11-30T18:22:39.057598+0000","last_became_peered":"2023-11-30T18:22:39.057598+0000","last_unstale":"2023-11-30T18:22:39.455646+0000","last_undegraded":"2023-11-30T18:22:39.455646+0000","last_fullsized":"2023-11-30T18:22:39.455646+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.452936+0000","last_change":"2023-11-30T18:22:39.451999+0000","last_active":"2023-11-30T18:22:39.452936+0000","last_peered":"2023-11-30T18:22:39.452936+0000","last_clean":"2023-11-30T18:22:39.452936+0000","last_became_active":"2023-11-30T18:22:39.451795+0000","last_became_peered":"2023-11-30T18:22:39.451795+0000","last_unstale":"2023-11-30T18:22:39.452936+0000","last_undegraded":"2023-11-30T18:22:39.452936+0000","last_fullsized":"2023-11-30T18:22:39.452936+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.446864+0000","last_change":"2023-11-30T18:22:39.059221+0000","last_active":"2023-11-30T18:22:39.446864+0000","last_peered":"2023-11-30T18:22:39.446864+0000","last_clean":"2023-11-30T18:22:39.446864+0000","last_became_active":"2023-11-30T18:22:39.058911+0000","last_became_peered":"2023-11-30T18:22:39.058911+0000","last_unstale":"2023-11-30T18:22:39.446864+0000","last_undegraded":"2023-11-30T18:22:39.446864+0000","last_fullsized":"2023-11-30T18:22:39.446864+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.459886+0000","last_change":"2023-11-30T18:22:39.448909+0000","last_active":"2023-11-30T18:22:39.459886+0000","last_peered":"2023-11-30T18:22:39.459886+0000","last_clean":"2023-11-30T18:22:39.459886+0000","last_became_active":"2023-11-30T18:22:39.448636+0000","last_became_peered":"2023-11-30T18:22:39.448636+0000","last_unstale":"2023-11-30T18:22:39.459886+0000","last_undegraded":"2023-11-30T18:22:39.459886+0000","last_fullsized":"2023-11-30T18:22:39.459886+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.440743+0000","last_change":"2023-11-30T18:22:39.056529+0000","last_active":"2023-11-30T18:22:39.440743+0000","last_peered":"2023-11-30T18:22:39.440743+0000","last_clean":"2023-11-30T18:22:39.440743+0000","last_became_active":"2023-11-30T18:22:39.056186+0000","last_became_peered":"2023-11-30T18:22:39.056186+0000","last_unstale":"2023-11-30T18:22:39.440743+0000","last_undegraded":"2023-11-30T18:22:39.440743+0000","last_fullsized":"2023-11-30T18:22:39.440743+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.454051+0000","last_change":"2023-11-30T18:22:39.445391+0000","last_active":"2023-11-30T18:22:39.454051+0000","last_peered":"2023-11-30T18:22:39.454051+0000","last_clean":"2023-11-30T18:22:39.454051+0000","last_became_active":"2023-11-30T18:22:39.444741+0000","last_became_peered":"2023-11-30T18:22:39.444741+0000","last_unstale":"2023-11-30T18:22:39.454051+0000","last_undegraded":"2023-11-30T18:22:39.454051+0000","last_fullsized":"2023-11-30T18:22:39.454051+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.436592+0000","last_change":"2023-11-30T18:22:39.053629+0000","last_active":"2023-11-30T18:22:39.436592+0000","last_peered":"2023-11-30T18:22:39.436592+0000","last_clean":"2023-11-30T18:22:39.436592+0000","last_became_active":"2023-11-30T18:22:39.053298+0000","last_became_peered":"2023-11-30T18:22:39.053298+0000","last_unstale":"2023-11-30T18:22:39.436592+0000","last_undegraded":"2023-11-30T18:22:39.436592+0000","last_fullsized":"2023-11-30T18:22:39.436592+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.457163+0000","last_change":"2023-11-30T18:22:39.454391+0000","last_active":"2023-11-30T18:22:39.457163+0000","last_peered":"2023-11-30T18:22:39.457163+0000","last_clean":"2023-11-30T18:22:39.457163+0000","last_became_active":"2023-11-30T18:22:39.454100+0000","last_became_peered":"2023-11-30T18:22:39.454100+0000","last_unstale":"2023-11-30T18:22:39.457163+0000","last_undegraded":"2023-11-30T18:22:39.457163+0000","last_fullsized":"2023-11-30T18:22:39.457163+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.435751+0000","last_change":"2023-11-30T18:22:39.060933+0000","last_active":"2023-11-30T18:22:39.435751+0000","last_peered":"2023-11-30T18:22:39.435751+0000","last_clean":"2023-11-30T18:22:39.435751+0000","last_became_active":"2023-11-30T18:22:39.060619+0000","last_became_peered":"2023-11-30T18:22:39.060619+0000","last_unstale":"2023-11-30T18:22:39.435751+0000","last_undegraded":"2023-11-30T18:22:39.435751+0000","last_fullsized":"2023-11-30T18:22:39.435751+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.457500+0000","last_change":"2023-11-30T18:22:39.454278+0000","last_active":"2023-11-30T18:22:39.457500+0000","last_peered":"2023-11-30T18:22:39.457500+0000","last_clean":"2023-11-30T18:22:39.457500+0000","last_became_active":"2023-11-30T18:22:39.453955+0000","last_became_peered":"2023-11-30T18:22:39.453955+0000","last_unstale":"2023-11-30T18:22:39.457500+0000","last_undegraded":"2023-11-30T18:22:39.457500+0000","last_fullsized":"2023-11-30T18:22:39.457500+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.447082+0000","last_change":"2023-11-30T18:22:39.056949+0000","last_active":"2023-11-30T18:22:39.447082+0000","last_peered":"2023-11-30T18:22:39.447082+0000","last_clean":"2023-11-30T18:22:39.447082+0000","last_became_active":"2023-11-30T18:22:39.056469+0000","last_became_peered":"2023-11-30T18:22:39.056469+0000","last_unstale":"2023-11-30T18:22:39.447082+0000","last_undegraded":"2023-11-30T18:22:39.447082+0000","last_fullsized":"2023-11-30T18:22:39.447082+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.461583+0000","last_change":"2023-11-30T18:22:39.457349+0000","last_active":"2023-11-30T18:22:39.461583+0000","last_peered":"2023-11-30T18:22:39.461583+0000","last_clean":"2023-11-30T18:22:39.461583+0000","last_became_active":"2023-11-30T18:22:39.457033+0000","last_became_peered":"2023-11-30T18:22:39.457033+0000","last_unstale":"2023-11-30T18:22:39.461583+0000","last_undegraded":"2023-11-30T18:22:39.461583+0000","last_fullsized":"2023-11-30T18:22:39.461583+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"168'1","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.447278+0000","last_change":"2023-11-30T18:22:39.058987+0000","last_active":"2023-11-30T18:22:39.447278+0000","last_peered":"2023-11-30T18:22:39.447278+0000","last_clean":"2023-11-30T18:22:39.447278+0000","last_became_active":"2023-11-30T18:22:39.058698+0000","last_became_peered":"2023-11-30T18:22:39.058698+0000","last_unstale":"2023-11-30T18:22:39.447278+0000","last_undegraded":"2023-11-30T18:22:39.447278+0000","last_fullsized":"2023-11-30T18:22:39.447278+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.458330+0000","last_change":"2023-11-30T18:22:39.456215+0000","last_active":"2023-11-30T18:22:39.458330+0000","last_peered":"2023-11-30T18:22:39.458330+0000","last_clean":"2023-11-30T18:22:39.458330+0000","last_became_active":"2023-11-30T18:22:39.455852+0000","last_became_peered":"2023-11-30T18:22:39.455852+0000","last_unstale":"2023-11-30T18:22:39.458330+0000","last_undegraded":"2023-11-30T18:22:39.458330+0000","last_fullsized":"2023-11-30T18:22:39.458330+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"168'2","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.456917+0000","last_change":"2023-11-30T18:22:39.050853+0000","last_active":"2023-11-30T18:22:39.456917+0000","last_peered":"2023-11-30T18:22:39.456917+0000","last_clean":"2023-11-30T18:22:39.456917+0000","last_became_active":"2023-11-30T18:22:39.050549+0000","last_became_peered":"2023-11-30T18:22:39.050549+0000","last_unstale":"2023-11-30T18:22:39.456917+0000","last_undegraded":"2023-11-30T18:22:39.456917+0000","last_fullsized":"2023-11-30T18:22:39.456917+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.455487+0000","last_change":"2023-11-30T18:22:39.451927+0000","last_active":"2023-11-30T18:22:39.455487+0000","last_peered":"2023-11-30T18:22:39.455487+0000","last_clean":"2023-11-30T18:22:39.455487+0000","last_became_active":"2023-11-30T18:22:39.451654+0000","last_became_peered":"2023-11-30T18:22:39.451654+0000","last_unstale":"2023-11-30T18:22:39.455487+0000","last_undegraded":"2023-11-30T18:22:39.455487+0000","last_fullsized":"2023-11-30T18:22:39.455487+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.438803+0000","last_change":"2023-11-30T18:22:39.061371+0000","last_active":"2023-11-30T18:22:39.438803+0000","last_peered":"2023-11-30T18:22:39.438803+0000","last_clean":"2023-11-30T18:22:39.438803+0000","last_became_active":"2023-11-30T18:22:39.060699+0000","last_became_peered":"2023-11-30T18:22:39.060699+0000","last_unstale":"2023-11-30T18:22:39.438803+0000","last_undegraded":"2023-11-30T18:22:39.438803+0000","last_fullsized":"2023-11-30T18:22:39.438803+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.459802+0000","last_change":"2023-11-30T18:22:39.459278+0000","last_active":"2023-11-30T18:22:39.459802+0000","last_peered":"2023-11-30T18:22:39.459802+0000","last_clean":"2023-11-30T18:22:39.459802+0000","last_became_active":"2023-11-30T18:22:39.458976+0000","last_became_peered":"2023-11-30T18:22:39.458976+0000","last_unstale":"2023-11-30T18:22:39.459802+0000","last_undegraded":"2023-11-30T18:22:39.459802+0000","last_fullsized":"2023-11-30T18:22:39.459802+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.441860+0000","last_change":"2023-11-30T18:22:39.056878+0000","last_active":"2023-11-30T18:22:39.441860+0000","last_peered":"2023-11-30T18:22:39.441860+0000","last_clean":"2023-11-30T18:22:39.441860+0000","last_became_active":"2023-11-30T18:22:39.056397+0000","last_became_peered":"2023-11-30T18:22:39.056397+0000","last_unstale":"2023-11-30T18:22:39.441860+0000","last_undegraded":"2023-11-30T18:22:39.441860+0000","last_fullsized":"2023-11-30T18:22:39.441860+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.457357+0000","last_change":"2023-11-30T18:22:39.455070+0000","last_active":"2023-11-30T18:22:39.457357+0000","last_peered":"2023-11-30T18:22:39.457357+0000","last_clean":"2023-11-30T18:22:39.457357+0000","last_became_active":"2023-11-30T18:22:39.454141+0000","last_became_peered":"2023-11-30T18:22:39.454141+0000","last_unstale":"2023-11-30T18:22:39.457357+0000","last_undegraded":"2023-11-30T18:22:39.457357+0000","last_fullsized":"2023-11-30T18:22:39.457357+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"168'1","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.459887+0000","last_change":"2023-11-30T18:22:39.053818+0000","last_active":"2023-11-30T18:22:39.459887+0000","last_peered":"2023-11-30T18:22:39.459887+0000","last_clean":"2023-11-30T18:22:39.459887+0000","last_became_active":"2023-11-30T18:22:39.053490+0000","last_became_peered":"2023-11-30T18:22:39.053490+0000","last_unstale":"2023-11-30T18:22:39.459887+0000","last_undegraded":"2023-11-30T18:22:39.459887+0000","last_fullsized":"2023-11-30T18:22:39.459887+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.453108+0000","last_change":"2023-11-30T18:22:39.452227+0000","last_active":"2023-11-30T18:22:39.453108+0000","last_peered":"2023-11-30T18:22:39.453108+0000","last_clean":"2023-11-30T18:22:39.453108+0000","last_became_active":"2023-11-30T18:22:39.451952+0000","last_became_peered":"2023-11-30T18:22:39.451952+0000","last_unstale":"2023-11-30T18:22:39.453108+0000","last_undegraded":"2023-11-30T18:22:39.453108+0000","last_fullsized":"2023-11-30T18:22:39.453108+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.430262+0000","last_change":"2023-11-30T18:22:39.060507+0000","last_active":"2023-11-30T18:22:39.430262+0000","last_peered":"2023-11-30T18:22:39.430262+0000","last_clean":"2023-11-30T18:22:39.430262+0000","last_became_active":"2023-11-30T18:22:39.059828+0000","last_became_peered":"2023-11-30T18:22:39.059828+0000","last_unstale":"2023-11-30T18:22:39.430262+0000","last_undegraded":"2023-11-30T18:22:39.430262+0000","last_fullsized":"2023-11-30T18:22:39.430262+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.459252+0000","last_change":"2023-11-30T18:22:39.458628+0000","last_active":"2023-11-30T18:22:39.459252+0000","last_peered":"2023-11-30T18:22:39.459252+0000","last_clean":"2023-11-30T18:22:39.459252+0000","last_became_active":"2023-11-30T18:22:39.458340+0000","last_became_peered":"2023-11-30T18:22:39.458340+0000","last_unstale":"2023-11-30T18:22:39.459252+0000","last_undegraded":"2023-11-30T18:22:39.459252+0000","last_fullsized":"2023-11-30T18:22:39.459252+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.446586+0000","last_change":"2023-11-30T18:22:39.066364+0000","last_active":"2023-11-30T18:22:39.446586+0000","last_peered":"2023-11-30T18:22:39.446586+0000","last_clean":"2023-11-30T18:22:39.446586+0000","last_became_active":"2023-11-30T18:22:39.066158+0000","last_became_peered":"2023-11-30T18:22:39.066158+0000","last_unstale":"2023-11-30T18:22:39.446586+0000","last_undegraded":"2023-11-30T18:22:39.446586+0000","last_fullsized":"2023-11-30T18:22:39.446586+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.461912+0000","last_change":"2023-11-30T18:22:39.458249+0000","last_active":"2023-11-30T18:22:39.461912+0000","last_peered":"2023-11-30T18:22:39.461912+0000","last_clean":"2023-11-30T18:22:39.461912+0000","last_became_active":"2023-11-30T18:22:39.457965+0000","last_became_peered":"2023-11-30T18:22:39.457965+0000","last_unstale":"2023-11-30T18:22:39.461912+0000","last_undegraded":"2023-11-30T18:22:39.461912+0000","last_fullsized":"2023-11-30T18:22:39.461912+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.434919+0000","last_change":"2023-11-30T18:22:39.058085+0000","last_active":"2023-11-30T18:22:39.434919+0000","last_peered":"2023-11-30T18:22:39.434919+0000","last_clean":"2023-11-30T18:22:39.434919+0000","last_became_active":"2023-11-30T18:22:39.057786+0000","last_became_peered":"2023-11-30T18:22:39.057786+0000","last_unstale":"2023-11-30T18:22:39.434919+0000","last_undegraded":"2023-11-30T18:22:39.434919+0000","last_fullsized":"2023-11-30T18:22:39.434919+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.455273+0000","last_change":"2023-11-30T18:22:39.450310+0000","last_active":"2023-11-30T18:22:39.455273+0000","last_peered":"2023-11-30T18:22:39.455273+0000","last_clean":"2023-11-30T18:22:39.455273+0000","last_became_active":"2023-11-30T18:22:39.450014+0000","last_became_peered":"2023-11-30T18:22:39.450014+0000","last_unstale":"2023-11-30T18:22:39.455273+0000","last_undegraded":"2023-11-30T18:22:39.455273+0000","last_fullsized":"2023-11-30T18:22:39.455273+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"168'2","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.453706+0000","last_change":"2023-11-30T18:22:39.052735+0000","last_active":"2023-11-30T18:22:39.453706+0000","last_peered":"2023-11-30T18:22:39.453706+0000","last_clean":"2023-11-30T18:22:39.453706+0000","last_became_active":"2023-11-30T18:22:39.052209+0000","last_became_peered":"2023-11-30T18:22:39.052209+0000","last_unstale":"2023-11-30T18:22:39.453706+0000","last_undegraded":"2023-11-30T18:22:39.453706+0000","last_fullsized":"2023-11-30T18:22:39.453706+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.461579+0000","last_change":"2023-11-30T18:22:39.457352+0000","last_active":"2023-11-30T18:22:39.461579+0000","last_peered":"2023-11-30T18:22:39.461579+0000","last_clean":"2023-11-30T18:22:39.461579+0000","last_became_active":"2023-11-30T18:22:39.457093+0000","last_became_peered":"2023-11-30T18:22:39.457093+0000","last_unstale":"2023-11-30T18:22:39.461579+0000","last_undegraded":"2023-11-30T18:22:39.461579+0000","last_fullsized":"2023-11-30T18:22:39.461579+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.443709+0000","last_change":"2023-11-30T18:22:39.055867+0000","last_active":"2023-11-30T18:22:39.443709+0000","last_peered":"2023-11-30T18:22:39.443709+0000","last_clean":"2023-11-30T18:22:39.443709+0000","last_became_active":"2023-11-30T18:22:39.055514+0000","last_became_peered":"2023-11-30T18:22:39.055514+0000","last_unstale":"2023-11-30T18:22:39.443709+0000","last_undegraded":"2023-11-30T18:22:39.443709+0000","last_fullsized":"2023-11-30T18:22:39.443709+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.461701+0000","last_change":"2023-11-30T18:22:39.459637+0000","last_active":"2023-11-30T18:22:39.461701+0000","last_peered":"2023-11-30T18:22:39.461701+0000","last_clean":"2023-11-30T18:22:39.461701+0000","last_became_active":"2023-11-30T18:22:39.459339+0000","last_became_peered":"2023-11-30T18:22:39.459339+0000","last_unstale":"2023-11-30T18:22:39.461701+0000","last_undegraded":"2023-11-30T18:22:39.461701+0000","last_fullsized":"2023-11-30T18:22:39.461701+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.443062+0000","last_change":"2023-11-30T18:22:39.052356+0000","last_active":"2023-11-30T18:22:39.443062+0000","last_peered":"2023-11-30T18:22:39.443062+0000","last_clean":"2023-11-30T18:22:39.443062+0000","last_became_active":"2023-11-30T18:22:39.052101+0000","last_became_peered":"2023-11-30T18:22:39.052101+0000","last_unstale":"2023-11-30T18:22:39.443062+0000","last_undegraded":"2023-11-30T18:22:39.443062+0000","last_fullsized":"2023-11-30T18:22:39.443062+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.448990+0000","last_change":"2023-11-30T18:22:39.448050+0000","last_active":"2023-11-30T18:22:39.448990+0000","last_peered":"2023-11-30T18:22:39.448990+0000","last_clean":"2023-11-30T18:22:39.448990+0000","last_became_active":"2023-11-30T18:22:39.447816+0000","last_became_peered":"2023-11-30T18:22:39.447816+0000","last_unstale":"2023-11-30T18:22:39.448990+0000","last_undegraded":"2023-11-30T18:22:39.448990+0000","last_fullsized":"2023-11-30T18:22:39.448990+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.439001+0000","last_change":"2023-11-30T18:22:39.057614+0000","last_active":"2023-11-30T18:22:39.439001+0000","last_peered":"2023-11-30T18:22:39.439001+0000","last_clean":"2023-11-30T18:22:39.439001+0000","last_became_active":"2023-11-30T18:22:39.057323+0000","last_became_peered":"2023-11-30T18:22:39.057323+0000","last_unstale":"2023-11-30T18:22:39.439001+0000","last_undegraded":"2023-11-30T18:22:39.439001+0000","last_fullsized":"2023-11-30T18:22:39.439001+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.444916+0000","last_change":"2023-11-30T18:22:39.442121+0000","last_active":"2023-11-30T18:22:39.444916+0000","last_peered":"2023-11-30T18:22:39.444916+0000","last_clean":"2023-11-30T18:22:39.444916+0000","last_became_active":"2023-11-30T18:22:39.440944+0000","last_became_peered":"2023-11-30T18:22:39.440944+0000","last_unstale":"2023-11-30T18:22:39.444916+0000","last_undegraded":"2023-11-30T18:22:39.444916+0000","last_fullsized":"2023-11-30T18:22:39.444916+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.441864+0000","last_change":"2023-11-30T18:22:39.068059+0000","last_active":"2023-11-30T18:22:39.441864+0000","last_peered":"2023-11-30T18:22:39.441864+0000","last_clean":"2023-11-30T18:22:39.441864+0000","last_became_active":"2023-11-30T18:22:39.067777+0000","last_became_peered":"2023-11-30T18:22:39.067777+0000","last_unstale":"2023-11-30T18:22:39.441864+0000","last_undegraded":"2023-11-30T18:22:39.441864+0000","last_fullsized":"2023-11-30T18:22:39.441864+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.445344+0000","last_change":"2023-11-30T18:22:39.442692+0000","last_active":"2023-11-30T18:22:39.445344+0000","last_peered":"2023-11-30T18:22:39.445344+0000","last_clean":"2023-11-30T18:22:39.445344+0000","last_became_active":"2023-11-30T18:22:39.442401+0000","last_became_peered":"2023-11-30T18:22:39.442401+0000","last_unstale":"2023-11-30T18:22:39.445344+0000","last_undegraded":"2023-11-30T18:22:39.445344+0000","last_fullsized":"2023-11-30T18:22:39.445344+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.446280+0000","last_change":"2023-11-30T18:22:39.060623+0000","last_active":"2023-11-30T18:22:39.446280+0000","last_peered":"2023-11-30T18:22:39.446280+0000","last_clean":"2023-11-30T18:22:39.446280+0000","last_became_active":"2023-11-30T18:22:39.060357+0000","last_became_peered":"2023-11-30T18:22:39.060357+0000","last_unstale":"2023-11-30T18:22:39.446280+0000","last_undegraded":"2023-11-30T18:22:39.446280+0000","last_fullsized":"2023-11-30T18:22:39.446280+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.451410+0000","last_change":"2023-11-30T18:22:39.450151+0000","last_active":"2023-11-30T18:22:39.451410+0000","last_peered":"2023-11-30T18:22:39.451410+0000","last_clean":"2023-11-30T18:22:39.451410+0000","last_became_active":"2023-11-30T18:22:39.449847+0000","last_became_peered":"2023-11-30T18:22:39.449847+0000","last_unstale":"2023-11-30T18:22:39.451410+0000","last_undegraded":"2023-11-30T18:22:39.451410+0000","last_fullsized":"2023-11-30T18:22:39.451410+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.437518+0000","last_change":"2023-11-30T18:22:39.058157+0000","last_active":"2023-11-30T18:22:39.437518+0000","last_peered":"2023-11-30T18:22:39.437518+0000","last_clean":"2023-11-30T18:22:39.437518+0000","last_became_active":"2023-11-30T18:22:39.057887+0000","last_became_peered":"2023-11-30T18:22:39.057887+0000","last_unstale":"2023-11-30T18:22:39.437518+0000","last_undegraded":"2023-11-30T18:22:39.437518+0000","last_fullsized":"2023-11-30T18:22:39.437518+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.459304+0000","last_change":"2023-11-30T18:22:39.457281+0000","last_active":"2023-11-30T18:22:39.459304+0000","last_peered":"2023-11-30T18:22:39.459304+0000","last_clean":"2023-11-30T18:22:39.459304+0000","last_became_active":"2023-11-30T18:22:39.456974+0000","last_became_peered":"2023-11-30T18:22:39.456974+0000","last_unstale":"2023-11-30T18:22:39.459304+0000","last_undegraded":"2023-11-30T18:22:39.459304+0000","last_fullsized":"2023-11-30T18:22:39.459304+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.437129+0000","last_change":"2023-11-30T18:22:39.053644+0000","last_active":"2023-11-30T18:22:39.437129+0000","last_peered":"2023-11-30T18:22:39.437129+0000","last_clean":"2023-11-30T18:22:39.437129+0000","last_became_active":"2023-11-30T18:22:39.053326+0000","last_became_peered":"2023-11-30T18:22:39.053326+0000","last_unstale":"2023-11-30T18:22:39.437129+0000","last_undegraded":"2023-11-30T18:22:39.437129+0000","last_fullsized":"2023-11-30T18:22:39.437129+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.458945+0000","last_change":"2023-11-30T18:22:39.452884+0000","last_active":"2023-11-30T18:22:39.458945+0000","last_peered":"2023-11-30T18:22:39.458945+0000","last_clean":"2023-11-30T18:22:39.458945+0000","last_became_active":"2023-11-30T18:22:39.452523+0000","last_became_peered":"2023-11-30T18:22:39.452523+0000","last_unstale":"2023-11-30T18:22:39.458945+0000","last_undegraded":"2023-11-30T18:22:39.458945+0000","last_fullsized":"2023-11-30T18:22:39.458945+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"168'3","reported_seq":13,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.461746+0000","last_change":"2023-11-30T18:22:39.059630+0000","last_active":"2023-11-30T18:22:39.461746+0000","last_peered":"2023-11-30T18:22:39.461746+0000","last_clean":"2023-11-30T18:22:39.461746+0000","last_became_active":"2023-11-30T18:22:39.059369+0000","last_became_peered":"2023-11-30T18:22:39.059369+0000","last_unstale":"2023-11-30T18:22:39.461746+0000","last_undegraded":"2023-11-30T18:22:39.461746+0000","last_fullsized":"2023-11-30T18:22:39.461746+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":141,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.439079+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T18:22:39.439079+0000","last_peered":"2023-11-30T18:22:39.439079+0000","last_clean":"2023-11-30T18:22:39.439079+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T18:22:39.439079+0000","last_undegraded":"2023-11-30T18:22:39.439079+0000","last_fullsized":"2023-11-30T18:22:39.439079+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.443848+0000","last_change":"2023-11-30T18:22:39.441870+0000","last_active":"2023-11-30T18:22:39.443848+0000","last_peered":"2023-11-30T18:22:39.443848+0000","last_clean":"2023-11-30T18:22:39.443848+0000","last_became_active":"2023-11-30T18:22:39.441521+0000","last_became_peered":"2023-11-30T18:22:39.441521+0000","last_unstale":"2023-11-30T18:22:39.443848+0000","last_undegraded":"2023-11-30T18:22:39.443848+0000","last_fullsized":"2023-11-30T18:22:39.443848+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"168'1","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.443559+0000","last_change":"2023-11-30T18:22:39.057464+0000","last_active":"2023-11-30T18:22:39.443559+0000","last_peered":"2023-11-30T18:22:39.443559+0000","last_clean":"2023-11-30T18:22:39.443559+0000","last_became_active":"2023-11-30T18:22:39.057118+0000","last_became_peered":"2023-11-30T18:22:39.057118+0000","last_unstale":"2023-11-30T18:22:39.443559+0000","last_undegraded":"2023-11-30T18:22:39.443559+0000","last_fullsized":"2023-11-30T18:22:39.443559+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":139,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.443032+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T18:22:39.443032+0000","last_peered":"2023-11-30T18:22:39.443032+0000","last_clean":"2023-11-30T18:22:39.443032+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T18:22:39.443032+0000","last_undegraded":"2023-11-30T18:22:39.443032+0000","last_fullsized":"2023-11-30T18:22:39.443032+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.454589+0000","last_change":"2023-11-30T18:22:39.445490+0000","last_active":"2023-11-30T18:22:39.454589+0000","last_peered":"2023-11-30T18:22:39.454589+0000","last_clean":"2023-11-30T18:22:39.454589+0000","last_became_active":"2023-11-30T18:22:39.445231+0000","last_became_peered":"2023-11-30T18:22:39.445231+0000","last_unstale":"2023-11-30T18:22:39.454589+0000","last_undegraded":"2023-11-30T18:22:39.454589+0000","last_fullsized":"2023-11-30T18:22:39.454589+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"168'4","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.457858+0000","last_change":"2023-11-30T18:22:39.053664+0000","last_active":"2023-11-30T18:22:39.457858+0000","last_peered":"2023-11-30T18:22:39.457858+0000","last_clean":"2023-11-30T18:22:39.457858+0000","last_became_active":"2023-11-30T18:22:39.053373+0000","last_became_peered":"2023-11-30T18:22:39.053373+0000","last_unstale":"2023-11-30T18:22:39.457858+0000","last_undegraded":"2023-11-30T18:22:39.457858+0000","last_fullsized":"2023-11-30T18:22:39.457858+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":145,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.430862+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T18:22:39.430862+0000","last_peered":"2023-11-30T18:22:39.430862+0000","last_clean":"2023-11-30T18:22:39.430862+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T18:22:39.430862+0000","last_undegraded":"2023-11-30T18:22:39.430862+0000","last_fullsized":"2023-11-30T18:22:39.430862+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.461614+0000","last_change":"2023-11-30T18:22:39.457282+0000","last_active":"2023-11-30T18:22:39.461614+0000","last_peered":"2023-11-30T18:22:39.461614+0000","last_clean":"2023-11-30T18:22:39.461614+0000","last_became_active":"2023-11-30T18:22:39.456461+0000","last_became_peered":"2023-11-30T18:22:39.456461+0000","last_unstale":"2023-11-30T18:22:39.461614+0000","last_undegraded":"2023-11-30T18:22:39.461614+0000","last_fullsized":"2023-11-30T18:22:39.461614+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.446178+0000","last_change":"2023-11-30T18:22:39.065942+0000","last_active":"2023-11-30T18:22:39.446178+0000","last_peered":"2023-11-30T18:22:39.446178+0000","last_clean":"2023-11-30T18:22:39.446178+0000","last_became_active":"2023-11-30T18:22:39.065735+0000","last_became_peered":"2023-11-30T18:22:39.065735+0000","last_unstale":"2023-11-30T18:22:39.446178+0000","last_undegraded":"2023-11-30T18:22:39.446178+0000","last_fullsized":"2023-11-30T18:22:39.446178+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":139,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.442395+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T18:22:39.442395+0000","last_peered":"2023-11-30T18:22:39.442395+0000","last_clean":"2023-11-30T18:22:39.442395+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T18:22:39.442395+0000","last_undegraded":"2023-11-30T18:22:39.442395+0000","last_fullsized":"2023-11-30T18:22:39.442395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":138,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.445279+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T18:22:39.445279+0000","last_peered":"2023-11-30T18:22:39.445279+0000","last_clean":"2023-11-30T18:22:39.445279+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T18:22:39.445279+0000","last_undegraded":"2023-11-30T18:22:39.445279+0000","last_fullsized":"2023-11-30T18:22:39.445279+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.458298+0000","last_change":"2023-11-30T18:22:39.455452+0000","last_active":"2023-11-30T18:22:39.458298+0000","last_peered":"2023-11-30T18:22:39.458298+0000","last_clean":"2023-11-30T18:22:39.458298+0000","last_became_active":"2023-11-30T18:22:39.455089+0000","last_became_peered":"2023-11-30T18:22:39.455089+0000","last_unstale":"2023-11-30T18:22:39.458298+0000","last_undegraded":"2023-11-30T18:22:39.458298+0000","last_fullsized":"2023-11-30T18:22:39.458298+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.445539+0000","last_change":"2023-11-30T18:22:39.055780+0000","last_active":"2023-11-30T18:22:39.445539+0000","last_peered":"2023-11-30T18:22:39.445539+0000","last_clean":"2023-11-30T18:22:39.445539+0000","last_became_active":"2023-11-30T18:22:39.055588+0000","last_became_peered":"2023-11-30T18:22:39.055588+0000","last_unstale":"2023-11-30T18:22:39.445539+0000","last_undegraded":"2023-11-30T18:22:39.445539+0000","last_fullsized":"2023-11-30T18:22:39.445539+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":136,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.445367+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T18:22:39.445367+0000","last_peered":"2023-11-30T18:22:39.445367+0000","last_clean":"2023-11-30T18:22:39.445367+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T18:22:39.445367+0000","last_undegraded":"2023-11-30T18:22:39.445367+0000","last_fullsized":"2023-11-30T18:22:39.445367+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.461679+0000","last_change":"2023-11-30T18:22:39.457691+0000","last_active":"2023-11-30T18:22:39.461679+0000","last_peered":"2023-11-30T18:22:39.461679+0000","last_clean":"2023-11-30T18:22:39.461679+0000","last_became_active":"2023-11-30T18:22:39.456542+0000","last_became_peered":"2023-11-30T18:22:39.456542+0000","last_unstale":"2023-11-30T18:22:39.461679+0000","last_undegraded":"2023-11-30T18:22:39.461679+0000","last_fullsized":"2023-11-30T18:22:39.461679+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"168'2","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.457594+0000","last_change":"2023-11-30T18:22:39.063623+0000","last_active":"2023-11-30T18:22:39.457594+0000","last_peered":"2023-11-30T18:22:39.457594+0000","last_clean":"2023-11-30T18:22:39.457594+0000","last_became_active":"2023-11-30T18:22:39.063309+0000","last_became_peered":"2023-11-30T18:22:39.063309+0000","last_unstale":"2023-11-30T18:22:39.457594+0000","last_undegraded":"2023-11-30T18:22:39.457594+0000","last_fullsized":"2023-11-30T18:22:39.457594+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":136,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.447560+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T18:22:39.447560+0000","last_peered":"2023-11-30T18:22:39.447560+0000","last_clean":"2023-11-30T18:22:39.447560+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T18:22:39.447560+0000","last_undegraded":"2023-11-30T18:22:39.447560+0000","last_fullsized":"2023-11-30T18:22:39.447560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.458699+0000","last_change":"2023-11-30T18:22:39.458077+0000","last_active":"2023-11-30T18:22:39.458699+0000","last_peered":"2023-11-30T18:22:39.458699+0000","last_clean":"2023-11-30T18:22:39.458699+0000","last_became_active":"2023-11-30T18:22:39.457772+0000","last_became_peered":"2023-11-30T18:22:39.457772+0000","last_unstale":"2023-11-30T18:22:39.458699+0000","last_undegraded":"2023-11-30T18:22:39.458699+0000","last_fullsized":"2023-11-30T18:22:39.458699+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.441769+0000","last_change":"2023-11-30T18:22:39.062023+0000","last_active":"2023-11-30T18:22:39.441769+0000","last_peered":"2023-11-30T18:22:39.441769+0000","last_clean":"2023-11-30T18:22:39.441769+0000","last_became_active":"2023-11-30T18:22:39.061779+0000","last_became_peered":"2023-11-30T18:22:39.061779+0000","last_unstale":"2023-11-30T18:22:39.441769+0000","last_undegraded":"2023-11-30T18:22:39.441769+0000","last_fullsized":"2023-11-30T18:22:39.441769+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":141,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.438515+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T18:22:39.438515+0000","last_peered":"2023-11-30T18:22:39.438515+0000","last_clean":"2023-11-30T18:22:39.438515+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T18:22:39.438515+0000","last_undegraded":"2023-11-30T18:22:39.438515+0000","last_fullsized":"2023-11-30T18:22:39.438515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.445585+0000","last_change":"2023-11-30T18:22:39.444097+0000","last_active":"2023-11-30T18:22:39.445585+0000","last_peered":"2023-11-30T18:22:39.445585+0000","last_clean":"2023-11-30T18:22:39.445585+0000","last_became_active":"2023-11-30T18:22:39.443832+0000","last_became_peered":"2023-11-30T18:22:39.443832+0000","last_unstale":"2023-11-30T18:22:39.445585+0000","last_undegraded":"2023-11-30T18:22:39.445585+0000","last_fullsized":"2023-11-30T18:22:39.445585+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:39.029772+0000","last_clean_scrub_stamp":"2023-11-30T18:22:39.029772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.430573+0000","last_change":"2023-11-30T18:22:39.056110+0000","last_active":"2023-11-30T18:22:39.430573+0000","last_peered":"2023-11-30T18:22:39.430573+0000","last_clean":"2023-11-30T18:22:39.430573+0000","last_became_active":"2023-11-30T18:22:39.055799+0000","last_became_peered":"2023-11-30T18:22:39.055799+0000","last_unstale":"2023-11-30T18:22:39.430573+0000","last_undegraded":"2023-11-30T18:22:39.430573+0000","last_fullsized":"2023-11-30T18:22:39.430573+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:22:38.024901+0000","last_clean_scrub_stamp":"2023-11-30T18:22:38.024901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":157,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-11-30T18:22:39.438916+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T18:22:39.438916+0000","last_peered":"2023-11-30T18:22:39.438916+0000","last_clean":"2023-11-30T18:22:39.438916+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T18:22:39.438916+0000","last_undegraded":"2023-11-30T18:22:39.438916+0000","last_fullsized":"2023-11-30T18:22:39.438916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575749,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303256,"kb_used_data":2064,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068584,"statfs":{"total":96636764160,"available":96326230016,"internally_reserved":0,"allocated":2113536,"data_stored":1074169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.32500000000000001},"max":{"1min":0.68700000000000006,"5min":0.81699999999999995,"15min":0.83599999999999997},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.60699999999999998,"15min":0.61799999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.71499999999999997,"5min":0.82199999999999995,"15min":0.84999999999999998},"last":0.59099999999999997}]},{"osd":1,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55000000000000004,"15min":0.55900000000000005},"min":{"1min":0.35599999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71599999999999997,"5min":0.80500000000000005,"15min":0.875},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.39800000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71699999999999997,"5min":0.79100000000000004,"15min":0.82099999999999995},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70399999999999996,"5min":0.76900000000000002,"15min":0.85399999999999998},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.66500000000000004,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.625}]},{"osd":3,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.34300000000000003},"max":{"1min":0.65700000000000003,"5min":0.79300000000000004,"15min":0.90800000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60199999999999998,"15min":0.60299999999999998},"min":{"1min":0.41099999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.73399999999999999,"5min":0.80000000000000004,"15min":0.80300000000000005},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.45300000000000001,"15min":0.44400000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63900000000000001,"5min":0.70299999999999996,"15min":0.73799999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46400000000000002,"15min":0.46500000000000002},"min":{"1min":0.32100000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.66400000000000003,"5min":0.71999999999999997,"15min":0.78100000000000003},"last":0.38400000000000001}]},{"osd":5,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.65000000000000002,"5min":0.749,"15min":0.753},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.51000000000000001,"15min":0.505},"min":{"1min":0.371,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":0.69099999999999995,"5min":0.76000000000000001,"15min":0.81999999999999995},"last":0.495}]},{"osd":6,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.372,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.74299999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.751,"5min":0.81499999999999995,"15min":0.83599999999999997},"last":0.41799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575748,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307348,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064492,"statfs":{"total":96636764160,"available":96322039808,"internally_reserved":0,"allocated":2109440,"data_stored":1074417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.313},"max":{"1min":0.78600000000000003,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.628,"15min":0.61799999999999999},"min":{"1min":0.41099999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Nov 30 18:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59799999999999998,"15min":0.59099999999999997},"min":{"1min":0.40100000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.627,"15min":0.623},"min":{"1min":0.46800000000000003,"5min":0.39000000000000001,"15min":0.35199999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Nov 30 18:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61599999999999999,"15min":0.60299999999999998},"min":{"1min":0.48099999999999998,"5min":0.38400000000000001,"15min":0.38100000000000001},"max":{"1min":0.79800000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.496,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Nov 30 18:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.42199999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77000000000000002,"5min":0.82299999999999995,"15min":0.83499999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.56899999999999995},"min":{"1min":0.41599999999999998,"5min":0.38600000000000001,"15min":0.33200000000000002},"max":{"1min":0.76700000000000002,"5min":0.79100000000000004,"15min":0.80100000000000005},"last":0.626}]},{"osd":4,"last update":"Thu Nov 30 18:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.45700000000000002,"15min":0.45300000000000001},"min":{"1min":0.318,"5min":0.30499999999999999,"15min":0.28399999999999997},"max":{"1min":0.76000000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.48299999999999998,"15min":0.47599999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.312},"max":{"1min":0.66400000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Nov 30 18:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.46800000000000003,"15min":0.46899999999999997},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.31},"max":{"1min":0.63600000000000001,"5min":0.76400000000000001,"15min":0.81999999999999995},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.32500000000000001},"max":{"1min":0.72499999999999998,"5min":0.81999999999999995,"15min":0.83499999999999996},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Nov 30 18:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53700000000000003,"15min":0.53200000000000003},"min":{"1min":0.37,"5min":0.36899999999999999,"15min":0.29999999999999999},"max":{"1min":0.73399999999999999,"5min":0.80100000000000005,"15min":0.86799999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41899999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.67700000000000005,"5min":0.80800000000000005,"15min":0.86599999999999999},"last":0.69299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575748,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307340,"kb_used_data":2052,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064500,"statfs":{"total":96636764160,"available":96322048000,"internally_reserved":0,"allocated":2101248,"data_stored":1073435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:21:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.36399999999999999,"15min":0.36899999999999999},"min":{"1min":0.27200000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.54200000000000004,"5min":0.67500000000000004,"15min":0.70699999999999996},"last":0.216},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.49299999999999999,"15min":0.5},"min":{"1min":0.377,"5min":0.318,"15min":0.318},"max":{"1min":0.64300000000000002,"5min":0.71299999999999997,"15min":0.78100000000000003},"last":0.29099999999999998}]},{"osd":2,"last update":"Thu Nov 30 18:21:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.39500000000000002,"15min":0.40000000000000002},"min":{"1min":0.29899999999999999,"5min":0.26300000000000001,"15min":0.25600000000000001},"max":{"1min":0.46200000000000002,"5min":0.60599999999999998,"15min":0.67500000000000004},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.41099999999999998,"5min":0.371,"15min":0.36899999999999999},"max":{"1min":0.61399999999999999,"5min":0.72499999999999998,"15min":0.85599999999999998},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Nov 30 18:21:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.46800000000000003,"15min":0.46899999999999997},"min":{"1min":0.35699999999999998,"5min":0.32000000000000001,"15min":0.29999999999999999},"max":{"1min":0.52200000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.44500000000000001,"15min":0.45100000000000001},"min":{"1min":0.34799999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.50900000000000001,"5min":0.65400000000000003,"15min":0.68000000000000005},"last":0.28000000000000003}]},{"osd":4,"last update":"Thu Nov 30 18:21:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.47199999999999998,"5min":0.374,"15min":0.314},"max":{"1min":0.745,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.64300000000000002,"15min":0.64500000000000002},"min":{"1min":0.52400000000000002,"5min":0.45700000000000002,"15min":0.38800000000000001},"max":{"1min":0.70999999999999996,"5min":0.85799999999999998,"15min":0.90600000000000003},"last":0.54000000000000004}]},{"osd":5,"last update":"Thu Nov 30 18:21:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.623,"15min":0.628},"min":{"1min":0.44600000000000001,"5min":0.39600000000000002,"15min":0.377},"max":{"1min":0.77900000000000003,"5min":0.86599999999999999,"15min":0.90200000000000002},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.504,"5min":0.42699999999999999,"15min":0.36799999999999999},"max":{"1min":0.73099999999999998,"5min":0.90100000000000002,"15min":0.90800000000000003},"last":0.45800000000000002}]},{"osd":6,"last update":"Thu Nov 30 18:21:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.68899999999999995,"15min":0.69299999999999995},"min":{"1min":0.52500000000000002,"5min":0.505,"15min":0.47399999999999998},"max":{"1min":0.77100000000000002,"5min":0.91300000000000003,"15min":0.95499999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67900000000000005,"15min":0.67800000000000005},"min":{"1min":0.53000000000000003,"5min":0.45100000000000001,"15min":0.42599999999999999},"max":{"1min":0.83999999999999997,"5min":0.94799999999999995,"15min":1.0049999999999999},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Nov 30 18:21:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.68500000000000005,"15min":0.69299999999999995},"min":{"1min":0.48999999999999999,"5min":0.439,"15min":0.38},"max":{"1min":0.81299999999999994,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.54100000000000004,"5min":0.436,"15min":0.436},"max":{"1min":0.75900000000000001,"5min":0.94399999999999995,"15min":0.95899999999999996},"last":0.48399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575748,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307352,"kb_used_data":2064,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064488,"statfs":{"total":96636764160,"available":96322035712,"internally_reserved":0,"allocated":2113536,"data_stored":1073561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.38300000000000001,"15min":0.38900000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.51900000000000002,"5min":0.56799999999999995,"15min":0.61099999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41099999999999998,"15min":0.40999999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.249},"max":{"1min":0.55600000000000005,"5min":0.65600000000000003,"15min":0.68400000000000005},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41599999999999998,"15min":0.40899999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.57499999999999996,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.49299999999999999,"15min":0.48999999999999999},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.59399999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.373}]},{"osd":3,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.44600000000000001,"15min":0.45200000000000001},"min":{"1min":0.311,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.53500000000000003,"5min":0.71699999999999997,"15min":0.77500000000000002},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46899999999999997,"15min":0.46800000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65300000000000002,"5min":0.67600000000000005,"15min":0.69499999999999995},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65000000000000002,"15min":0.63700000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.42199999999999999},"max":{"1min":0.81000000000000005,"5min":0.96399999999999997,"15min":0.995},"last":0.621},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66600000000000004,"15min":0.65400000000000003},"min":{"1min":0.47799999999999998,"5min":0.42799999999999999,"15min":0.41499999999999998},"max":{"1min":0.75900000000000001,"5min":1.03,"15min":1.03},"last":0.47699999999999998}]},{"osd":5,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65200000000000002,"15min":0.64100000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.40799999999999997},"max":{"1min":0.86499999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.68100000000000005,"15min":0.65900000000000003},"min":{"1min":0.48199999999999998,"5min":0.44800000000000001,"15min":0.41299999999999998},"max":{"1min":0.91900000000000004,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67700000000000005,"15min":0.67300000000000004},"min":{"1min":0.52300000000000002,"5min":0.443,"15min":0.40600000000000003},"max":{"1min":0.81799999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68600000000000005,"15min":0.67700000000000005},"min":{"1min":0.49099999999999999,"5min":0.442,"15min":0.44},"max":{"1min":0.90400000000000003,"5min":1.05,"15min":1.05},"last":0.57699999999999996}]},{"osd":7,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71299999999999997,"15min":0.69799999999999995},"min":{"1min":0.55600000000000005,"5min":0.45200000000000001,"15min":0.42599999999999999},"max":{"1min":0.88600000000000001,"5min":1.167,"15min":1.167},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73199999999999998,"15min":0.72299999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.48399999999999999},"max":{"1min":0.876,"5min":1.024,"15min":1.024},"last":0.56599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575748,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311444,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060396,"statfs":{"total":96636764160,"available":96317845504,"internally_reserved":0,"allocated":2109440,"data_stored":1074023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.39500000000000002,"15min":0.40100000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.25700000000000001},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.71699999999999997},"last":0.307},{"interface":"front","average":{"1min":0.441,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68999999999999995,"5min":0.70599999999999996,"15min":0.751},"last":0.372}]},{"osd":1,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.443,"15min":0.44900000000000001},"min":{"1min":0.33500000000000002,"5min":0.309,"15min":0.29299999999999998},"max":{"1min":0.68700000000000006,"5min":0.755,"15min":0.755},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.32300000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.81799999999999995},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39500000000000002,"15min":0.40699999999999997},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.76000000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.308,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.75800000000000001},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.626,"15min":0.63400000000000001},"min":{"1min":0.44900000000000001,"5min":0.42199999999999999,"15min":0.40100000000000002},"max":{"1min":0.88800000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60699999999999998,"15min":0.61899999999999999},"min":{"1min":0.42199999999999999,"5min":0.40999999999999998,"15min":0.377},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.94999999999999996},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63300000000000001,"15min":0.64400000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.97399999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64700000000000002,"15min":0.64800000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85599999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.628,"15min":0.63800000000000001},"min":{"1min":0.46200000000000002,"5min":0.434,"15min":0.41099999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.97799999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67000000000000004,"15min":0.67300000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67300000000000004,"15min":0.68799999999999994},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46000000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.96599999999999997},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.504,"5min":0.49199999999999999,"15min":0.46200000000000002},"max":{"1min":0.97199999999999998,"5min":0.995,"15min":1.014},"last":0.61799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575748,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311444,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060396,"statfs":{"total":96636764160,"available":96317845504,"internally_reserved":0,"allocated":2109440,"data_stored":1074079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38500000000000001,"15min":0.375},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.41199999999999998,"15min":0.40899999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.59299999999999997,"5min":0.61099999999999999,"15min":0.66200000000000003},"last":0.26800000000000002}]},{"osd":1,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.40999999999999998,"15min":0.39700000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44800000000000001,"15min":0.441},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.28699999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.255}]},{"osd":2,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.47699999999999998,"15min":0.46899999999999997},"min":{"1min":0.35099999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58299999999999996,"5min":0.70899999999999996,"15min":0.71599999999999997},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52000000000000002,"15min":0.51500000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73199999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.39300000000000002}]},{"osd":4,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63200000000000001,"15min":0.63500000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92800000000000005,"5min":1.081,"15min":1.081},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64900000000000002,"15min":0.63800000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.64300000000000002,"15min":0.63500000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67100000000000004,"15min":0.66200000000000003},"min":{"1min":0.47399999999999998,"5min":0.46200000000000002,"15min":0.42399999999999999},"max":{"1min":0.99199999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.54300000000000004}]},{"osd":6,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68600000000000005,"15min":0.67900000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.40100000000000002},"max":{"1min":0.96999999999999997,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48599999999999999,"5min":0.47099999999999997,"15min":0.41499999999999998},"max":{"1min":0.84299999999999997,"5min":1.206,"15min":1.206},"last":0.45600000000000002}]},{"osd":7,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.44800000000000001},"max":{"1min":0.98599999999999999,"5min":1.131,"15min":1.131},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70599999999999996,"15min":0.69499999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.56899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575748,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303252,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068588,"statfs":{"total":96636764160,"available":96326234112,"internally_reserved":0,"allocated":2109440,"data_stored":1074059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.54500000000000004,"15min":0.55800000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.63700000000000001,"5min":0.80600000000000005,"15min":0.94799999999999995},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.54400000000000004,"15min":0.55100000000000005},"min":{"1min":0.33200000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.66500000000000004,"5min":0.82599999999999996,"15min":0.83699999999999997},"last":0.66900000000000004}]},{"osd":1,"last update":"Thu Nov 30 18:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64500000000000002,"5min":0.92400000000000004,"15min":1.006},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.628,"5min":0.79300000000000004,"15min":0.82299999999999995},"last":0.70999999999999996}]},{"osd":2,"last update":"Thu Nov 30 18:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58499999999999996,"15min":0.58999999999999997},"min":{"1min":0.42299999999999999,"5min":0.35499999999999998,"15min":0.33600000000000002},"max":{"1min":0.65900000000000003,"5min":0.82399999999999995,"15min":0.85299999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.41399999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.70899999999999996,"5min":0.95299999999999996,"15min":1.0429999999999999},"last":0.67900000000000005}]},{"osd":3,"last update":"Thu Nov 30 18:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.34599999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69199999999999995,"5min":0.78100000000000003,"15min":0.79900000000000004},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.42099999999999999,"5min":0.40300000000000002,"15min":0.35999999999999999},"max":{"1min":0.72899999999999998,"5min":0.79600000000000004,"15min":1.1679999999999999},"last":0.73899999999999999}]},{"osd":5,"last update":"Thu Nov 30 18:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.443,"15min":0.44},"min":{"1min":0.318,"5min":0.28999999999999998,"15min":0.27600000000000002},"max":{"1min":0.63500000000000001,"5min":0.71099999999999997,"15min":0.80700000000000005},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.442,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.33300000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67200000000000004,"5min":0.68100000000000005,"15min":1.3919999999999999},"last":0.46000000000000002}]},{"osd":6,"last update":"Thu Nov 30 18:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50600000000000001,"15min":0.496},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.31},"max":{"1min":0.77200000000000002,"5min":0.83599999999999997,"15min":0.93300000000000005},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.40200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69799999999999995,"5min":0.78100000000000003,"15min":0.92500000000000004},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Nov 30 18:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51600000000000001,"15min":0.52300000000000002},"min":{"1min":0.34499999999999997,"5min":0.32500000000000001,"15min":0.30099999999999999},"max":{"1min":0.74099999999999999,"5min":0.85699999999999998,"15min":1.246},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.41999999999999998,"5min":0.39900000000000002,"15min":0.371},"max":{"1min":0.80900000000000005,"5min":0.88900000000000001,"15min":1.321},"last":0.60999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575748,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307336,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064504,"statfs":{"total":96636764160,"available":96322052096,"internally_reserved":0,"allocated":2097152,"data_stored":1067589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56200000000000006,"15min":0.55500000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.30099999999999999},"max":{"1min":0.73799999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56200000000000006,"15min":0.55300000000000005},"min":{"1min":0.39900000000000002,"5min":0.35699999999999998,"15min":0.30399999999999999},"max":{"1min":0.70799999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Nov 30 18:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57099999999999995,"15min":0.56399999999999995},"min":{"1min":0.44700000000000001,"5min":0.33200000000000002,"15min":0.29499999999999998},"max":{"1min":0.70299999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58199999999999996,"15min":0.56999999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.35499999999999998},"max":{"1min":0.751,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Nov 30 18:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.372,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77400000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63600000000000001,"15min":0.62},"min":{"1min":0.52100000000000002,"5min":0.40899999999999997,"15min":0.35299999999999998},"max":{"1min":0.76700000000000002,"5min":0.876,"15min":0.876},"last":0.495}]},{"osd":3,"last update":"Thu Nov 30 18:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57999999999999996,"15min":0.57299999999999995},"min":{"1min":0.44500000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.83499999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.371},"max":{"1min":0.748,"5min":0.81799999999999995,"15min":0.86799999999999999},"last":0.505}]},{"osd":4,"last update":"Thu Nov 30 18:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.43099999999999999,"15min":0.435},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.52900000000000003,"5min":0.69599999999999995,"15min":0.79400000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.434,"5min":0.46700000000000003,"15min":0.46500000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29699999999999999},"max":{"1min":0.55200000000000005,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Nov 30 18:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47899999999999998,"15min":0.47799999999999998},"min":{"1min":0.38800000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.60299999999999998,"5min":0.73099999999999998,"15min":0.76200000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.38400000000000001,"5min":0.38100000000000001,"15min":0.313},"max":{"1min":0.67400000000000004,"5min":0.83499999999999996,"15min":0.83799999999999997},"last":0.629}]},{"osd":7,"last update":"Thu Nov 30 18:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.52100000000000002,"15min":0.52000000000000002},"min":{"1min":0.34399999999999997,"5min":0.313,"15min":0.313},"max":{"1min":0.60799999999999998,"5min":0.79300000000000004,"15min":0.80900000000000005},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68100000000000005,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.61599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T18:22:43.831 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-30T18:22:43.832 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-30T18:22:43.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.990+0000 7fe8b36d9700 1 Processor -- start 2023-11-30T18:22:43.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.990+0000 7fe8b36d9700 1 -- start start 2023-11-30T18:22:43.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.991+0000 7fe8b36d9700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe8ac0c5140 0x7fe8ac062c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:43.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.991+0000 7fe8b36d9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8ac0be5d0 0x7fe8ac154e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:43.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.991+0000 7fe8b36d9700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8ac0bed70 con 0x7fe8ac152640 2023-11-30T18:22:43.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.991+0000 7fe8b36d9700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8ac158420 con 0x7fe8ac0c5140 2023-11-30T18:22:43.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.991+0000 7fe8b36d9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac158700 con 0x7fe8ac0be5d0 2023-11-30T18:22:43.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.991+0000 7fe8b0c74700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe8ac0c5140 0x7fe8ac062c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:43.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.991+0000 7fe8b0c74700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe8ac0c5140 0x7fe8ac062c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36926/0 (socket says 172.21.15.49:36926) 2023-11-30T18:22:43.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.991+0000 7fe8b0c74700 1 -- 172.21.15.49:0/4105991194 learned_addr learned my addr 172.21.15.49:0/4105991194 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:43.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.991+0000 7fe8b1c76700 1 --2- 172.21.15.49:0/4105991194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8ac0be5d0 0x7fe8ac154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:43.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.991+0000 7fe8b0c74700 1 -- 172.21.15.49:0/4105991194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8ac0be5d0 msgr2=0x7fe8ac154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:43.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.991+0000 7fe8b0c74700 1 --2- 172.21.15.49:0/4105991194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8ac0be5d0 0x7fe8ac154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:43.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.991+0000 7fe8b0c74700 1 -- 172.21.15.49:0/4105991194 >> v1:172.21.15.115:6789/0 conn(0x7fe8ac152640 legacy=0x7fe8ac0c4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:43.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.991+0000 7fe8b0c74700 1 -- 172.21.15.49:0/4105991194 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ac1589e0 con 0x7fe8ac0c5140 2023-11-30T18:22:43.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.991+0000 7fe8b0c74700 1 --2- 172.21.15.49:0/4105991194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8ac0c5140 0x7fe8ac062c70 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7fe8a0006fd0 tx=0x7fe8a00090f0).ready entity=mon.0 client_cookie=deb80e1f9071ea32 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:43.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.991+0000 7fe8abfff700 1 -- 172.21.15.49:0/4105991194 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a000b600 con 0x7fe8ac0c5140 2023-11-30T18:22:43.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.991+0000 7fe8abfff700 1 -- 172.21.15.49:0/4105991194 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a000b760 con 0x7fe8ac0c5140 2023-11-30T18:22:43.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.991+0000 7fe8abfff700 1 -- 172.21.15.49:0/4105991194 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a000bae0 con 0x7fe8ac0c5140 2023-11-30T18:22:43.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.992+0000 7fe8b36d9700 1 -- 172.21.15.49:0/4105991194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8ac0c5140 msgr2=0x7fe8ac062c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:43.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.992+0000 7fe8b36d9700 1 --2- 172.21.15.49:0/4105991194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8ac0c5140 0x7fe8ac062c70 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7fe8a0006fd0 tx=0x7fe8a00090f0).stop 2023-11-30T18:22:43.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.992+0000 7fe8b36d9700 1 -- 172.21.15.49:0/4105991194 shutdown_connections 2023-11-30T18:22:43.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.992+0000 7fe8b36d9700 1 --2- 172.21.15.49:0/4105991194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8ac0be5d0 0x7fe8ac154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:43.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.992+0000 7fe8b36d9700 1 --2- 172.21.15.49:0/4105991194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8ac0c5140 0x7fe8ac062c70 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:43.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.992+0000 7fe8b36d9700 1 -- 172.21.15.49:0/4105991194 >> 172.21.15.49:0/4105991194 conn(0x7fe8ac063810 msgr2=0x7fe8ac063c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:43.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.992+0000 7fe8b36d9700 1 -- 172.21.15.49:0/4105991194 shutdown_connections 2023-11-30T18:22:43.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.992+0000 7fe8b36d9700 1 -- 172.21.15.49:0/4105991194 wait complete. 2023-11-30T18:22:43.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.993+0000 7fe8b36d9700 1 Processor -- start 2023-11-30T18:22:43.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.993+0000 7fe8b36d9700 1 -- start start 2023-11-30T18:22:43.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.994+0000 7fe8b36d9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8ac0be5d0 0x7fe8ac156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:43.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.994+0000 7fe8b36d9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8ac0c5140 0x7fe8ac165a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:43.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.994+0000 7fe8b36d9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8ac152640 0x7fe8ac0a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:43.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.994+0000 7fe8b36d9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac1571d0 con 0x7fe8ac152640 2023-11-30T18:22:43.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.994+0000 7fe8b36d9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac1565c0 con 0x7fe8ac0be5d0 2023-11-30T18:22:43.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.994+0000 7fe8b36d9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac1568a0 con 0x7fe8ac0c5140 2023-11-30T18:22:43.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.994+0000 7fe8b1c76700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8ac152640 0x7fe8ac0a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:43.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.994+0000 7fe8b1c76700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8ac152640 0x7fe8ac0a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36934/0 (socket says 172.21.15.49:36934) 2023-11-30T18:22:43.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.994+0000 7fe8b1c76700 1 -- 172.21.15.49:0/1633549236 learned_addr learned my addr 172.21.15.49:0/1633549236 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:43.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.994+0000 7fe8b0c74700 1 --2- 172.21.15.49:0/1633549236 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8ac0c5140 0x7fe8ac165a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:43.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.994+0000 7fe8b1475700 1 --2- 172.21.15.49:0/1633549236 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8ac0be5d0 0x7fe8ac156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:43.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.995+0000 7fe8b1c76700 1 -- 172.21.15.49:0/1633549236 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8ac0c5140 msgr2=0x7fe8ac165a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:43.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.995+0000 7fe8b1c76700 1 --2- 172.21.15.49:0/1633549236 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8ac0c5140 0x7fe8ac165a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:43.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.995+0000 7fe8b1c76700 1 -- 172.21.15.49:0/1633549236 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8ac0be5d0 msgr2=0x7fe8ac156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:43.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.995+0000 7fe8b1c76700 1 --2- 172.21.15.49:0/1633549236 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8ac0be5d0 0x7fe8ac156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:43.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.995+0000 7fe8b1c76700 1 -- 172.21.15.49:0/1633549236 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a0009370 con 0x7fe8ac152640 2023-11-30T18:22:43.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.995+0000 7fe8b0c74700 1 --2- 172.21.15.49:0/1633549236 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8ac0c5140 0x7fe8ac165a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:22:43.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.995+0000 7fe8b1c76700 1 --2- 172.21.15.49:0/1633549236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8ac152640 0x7fe8ac0a70c0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7fe8a400d890 tx=0x7fe8a4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:43.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.995+0000 7fe8a97fa700 1 -- 172.21.15.49:0/1633549236 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a40125f0 con 0x7fe8ac152640 2023-11-30T18:22:43.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.995+0000 7fe8a97fa700 1 -- 172.21.15.49:0/1633549236 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a4012750 con 0x7fe8ac152640 2023-11-30T18:22:43.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.995+0000 7fe8b36d9700 1 -- 172.21.15.49:0/1633549236 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8ac156b80 con 0x7fe8ac152640 2023-11-30T18:22:43.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.995+0000 7fe8a97fa700 1 -- 172.21.15.49:0/1633549236 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a4012ad0 con 0x7fe8ac152640 2023-11-30T18:22:43.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.995+0000 7fe8b36d9700 1 -- 172.21.15.49:0/1633549236 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ac165f50 con 0x7fe8ac152640 2023-11-30T18:22:44.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.996+0000 7fe8b36d9700 1 -- 172.21.15.49:0/1633549236 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8ac06c860 con 0x7fe8ac152640 2023-11-30T18:22:44.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.996+0000 7fe8a97fa700 1 -- 172.21.15.49:0/1633549236 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 68) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe8a4013480 con 0x7fe8ac152640 2023-11-30T18:22:44.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.997+0000 7fe8a97fa700 1 --2- 172.21.15.49:0/1633549236 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe89805f270 0x7fe898061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:44.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.997+0000 7fe8a97fa700 1 -- 172.21.15.49:0/1633549236 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fe8a407a1b0 con 0x7fe8ac152640 2023-11-30T18:22:44.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.997+0000 7fe8b1475700 1 --2- 172.21.15.49:0/1633549236 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe89805f270 0x7fe898061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:44.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:43.997+0000 7fe8b1475700 1 --2- 172.21.15.49:0/1633549236 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe89805f270 0x7fe898061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fe89c006fd0 tx=0x7fe89c008040).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:44.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.001+0000 7fe8a97fa700 1 -- 172.21.15.49:0/1633549236 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe8a404b260 con 0x7fe8ac152640 2023-11-30T18:22:44.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.240+0000 7fe8b36d9700 1 -- 172.21.15.49:0/1633549236 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe8ac158cc0 con 0x7fe8ac152640 2023-11-30T18:22:44.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.243+0000 7fe8a97fa700 1 -- 172.21.15.49:0/1633549236 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v41) v1 ==== 190+0+0 (secure 0 0 0) 0x7fe8a404e880 con 0x7fe8ac152640 2023-11-30T18:22:44.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.245+0000 7fe8b36d9700 1 -- 172.21.15.49:0/1633549236 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe89805f270 msgr2=0x7fe898061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:44.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.245+0000 7fe8b36d9700 1 --2- 172.21.15.49:0/1633549236 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe89805f270 0x7fe898061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fe89c006fd0 tx=0x7fe89c008040).stop 2023-11-30T18:22:44.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.245+0000 7fe8b36d9700 1 -- 172.21.15.49:0/1633549236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8ac152640 msgr2=0x7fe8ac0a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:44.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.245+0000 7fe8b36d9700 1 --2- 172.21.15.49:0/1633549236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8ac152640 0x7fe8ac0a70c0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7fe8a400d890 tx=0x7fe8a4008040).stop 2023-11-30T18:22:44.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.245+0000 7fe8b36d9700 1 -- 172.21.15.49:0/1633549236 shutdown_connections 2023-11-30T18:22:44.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.245+0000 7fe8b36d9700 1 --2- 172.21.15.49:0/1633549236 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe89805f270 0x7fe898061730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:44.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.245+0000 7fe8b36d9700 1 --2- 172.21.15.49:0/1633549236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8ac152640 0x7fe8ac0a70c0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:44.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.245+0000 7fe8b36d9700 1 --2- 172.21.15.49:0/1633549236 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8ac0be5d0 0x7fe8ac156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:44.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.245+0000 7fe8b36d9700 1 --2- 172.21.15.49:0/1633549236 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8ac0c5140 0x7fe8ac165a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:44.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.245+0000 7fe8b36d9700 1 -- 172.21.15.49:0/1633549236 >> 172.21.15.49:0/1633549236 conn(0x7fe8ac063810 msgr2=0x7fe8ac14ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:44.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.245+0000 7fe8b36d9700 1 -- 172.21.15.49:0/1633549236 shutdown_connections 2023-11-30T18:22:44.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.245+0000 7fe8b36d9700 1 -- 172.21.15.49:0/1633549236 wait complete. 2023-11-30T18:22:44.247 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2023-11-30T18:22:44.258 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:22:44.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.375+0000 7f3a0d932700 1 Processor -- start 2023-11-30T18:22:44.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.375+0000 7f3a0d932700 1 -- start start 2023-11-30T18:22:44.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.376+0000 7f3a0d932700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3a081544e0 0x7f3a081548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:44.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.376+0000 7f3a0d932700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a080c69a0 con 0x7f3a0806a610 2023-11-30T18:22:44.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.376+0000 7f3a0d932700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a080c13a0 con 0x7f3a080c6e30 2023-11-30T18:22:44.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.376+0000 7f3a0d932700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a080c1680 con 0x7f3a081544e0 2023-11-30T18:22:44.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.376+0000 7f3a06ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3a081544e0 0x7f3a081548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:44.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.376+0000 7f3a06ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3a081544e0 0x7f3a081548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36948/0 (socket says 172.21.15.49:36948) 2023-11-30T18:22:44.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.376+0000 7f3a06ffd700 1 -- 172.21.15.49:0/171192124 learned_addr learned my addr 172.21.15.49:0/171192124 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:44.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.376+0000 7f3a067fc700 1 --1- 172.21.15.49:0/171192124 >> v1:172.21.15.49:6789/0 conn(0x7f3a0806a610 0x7f3a080c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59098/0 (socket says 172.21.15.49:59098) 2023-11-30T18:22:44.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.376+0000 7f3a06ffd700 1 -- 172.21.15.49:0/171192124 >> v1:172.21.15.115:6789/0 conn(0x7f3a080c6e30 legacy=0x7f3a080a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:44.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.376+0000 7f3a06ffd700 1 -- 172.21.15.49:0/171192124 >> v1:172.21.15.49:6789/0 conn(0x7f3a0806a610 legacy=0x7f3a080c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:44.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.376+0000 7f3a06ffd700 1 -- 172.21.15.49:0/171192124 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a080c6630 con 0x7f3a081544e0 2023-11-30T18:22:44.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.376+0000 7f3a05ffb700 1 -- 172.21.15.49:0/171192124 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4021502300 0 0) 0x7f3a080c69a0 con 0x7f3a0806a610 2023-11-30T18:22:44.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.376+0000 7f3a06ffd700 1 --2- 172.21.15.49:0/171192124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a081544e0 0x7f3a081548c0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7f3a00009f70 tx=0x7f3a00009840).ready entity=mon.0 client_cookie=89a9148550625631 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:44.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.376+0000 7f3a05ffb700 1 -- 172.21.15.49:0/171192124 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0000e070 con 0x7f3a081544e0 2023-11-30T18:22:44.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.376+0000 7f3a05ffb700 1 -- 172.21.15.49:0/171192124 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0000bad0 con 0x7f3a081544e0 2023-11-30T18:22:44.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.376+0000 7f3a05ffb700 1 -- 172.21.15.49:0/171192124 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0000be50 con 0x7f3a081544e0 2023-11-30T18:22:44.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.377+0000 7f3a0d932700 1 -- 172.21.15.49:0/171192124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a081544e0 msgr2=0x7f3a081548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:44.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.377+0000 7f3a0d932700 1 --2- 172.21.15.49:0/171192124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a081544e0 0x7f3a081548c0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7f3a00009f70 tx=0x7f3a00009840).stop 2023-11-30T18:22:44.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.377+0000 7f3a0d932700 1 -- 172.21.15.49:0/171192124 shutdown_connections 2023-11-30T18:22:44.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.377+0000 7f3a0d932700 1 --2- 172.21.15.49:0/171192124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a081544e0 0x7f3a081548c0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:44.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.377+0000 7f3a0d932700 1 -- 172.21.15.49:0/171192124 >> 172.21.15.49:0/171192124 conn(0x7f3a08085020 msgr2=0x7f3a08094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:44.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.377+0000 7f3a0d932700 1 -- 172.21.15.49:0/171192124 shutdown_connections 2023-11-30T18:22:44.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.377+0000 7f3a0d932700 1 -- 172.21.15.49:0/171192124 wait complete. 2023-11-30T18:22:44.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.378+0000 7f3a0d932700 1 Processor -- start 2023-11-30T18:22:44.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.378+0000 7f3a0d932700 1 -- start start 2023-11-30T18:22:44.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.379+0000 7f3a0d932700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a0806a610 0x7f3a08150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:44.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.379+0000 7f3a0d932700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a080c6e30 0x7f3a08152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:44.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.379+0000 7f3a0d932700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a081544e0 0x7f3a081534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:44.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.379+0000 7f3a0d932700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a081539c0 con 0x7f3a080c6e30 2023-11-30T18:22:44.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.379+0000 7f3a0d932700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a08150ec0 con 0x7f3a081544e0 2023-11-30T18:22:44.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.379+0000 7f3a0d932700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a08151720 con 0x7f3a0806a610 2023-11-30T18:22:44.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.379+0000 7f3a067fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a080c6e30 0x7f3a08152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:44.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.379+0000 7f3a067fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a080c6e30 0x7f3a08152fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36960/0 (socket says 172.21.15.49:36960) 2023-11-30T18:22:44.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.379+0000 7f3a067fc700 1 -- 172.21.15.49:0/2554223271 learned_addr learned my addr 172.21.15.49:0/2554223271 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:44.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.379+0000 7f3a06ffd700 1 --2- 172.21.15.49:0/2554223271 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a0806a610 0x7f3a08150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:44.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.379+0000 7f3a077fe700 1 --2- 172.21.15.49:0/2554223271 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a081544e0 0x7f3a081534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:44.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.380+0000 7f3a067fc700 1 -- 172.21.15.49:0/2554223271 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a0806a610 msgr2=0x7f3a08150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:44.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.380+0000 7f3a067fc700 1 --2- 172.21.15.49:0/2554223271 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a0806a610 0x7f3a08150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:44.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.380+0000 7f3a067fc700 1 -- 172.21.15.49:0/2554223271 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a081544e0 msgr2=0x7f3a081534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:44.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.380+0000 7f3a067fc700 1 --2- 172.21.15.49:0/2554223271 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a081544e0 0x7f3a081534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:44.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.380+0000 7f3a067fc700 1 -- 172.21.15.49:0/2554223271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a00009ae0 con 0x7f3a080c6e30 2023-11-30T18:22:44.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.380+0000 7f3a067fc700 1 --2- 172.21.15.49:0/2554223271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a080c6e30 0x7f3a08152fe0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f39f000c490 tx=0x7f39f0007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:44.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.380+0000 7f39feffd700 1 -- 172.21.15.49:0/2554223271 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f00070d0 con 0x7f3a080c6e30 2023-11-30T18:22:44.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.380+0000 7f39feffd700 1 -- 172.21.15.49:0/2554223271 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f0007250 con 0x7f3a080c6e30 2023-11-30T18:22:44.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.380+0000 7f3a0d932700 1 -- 172.21.15.49:0/2554223271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a08155900 con 0x7f3a080c6e30 2023-11-30T18:22:44.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.380+0000 7f39feffd700 1 -- 172.21.15.49:0/2554223271 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f00056e0 con 0x7f3a080c6e30 2023-11-30T18:22:44.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.380+0000 7f3a0d932700 1 -- 172.21.15.49:0/2554223271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a081510d0 con 0x7f3a080c6e30 2023-11-30T18:22:44.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.381+0000 7f3a0d932700 1 -- 172.21.15.49:0/2554223271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a081518d0 con 0x7f3a080c6e30 2023-11-30T18:22:44.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.381+0000 7f39feffd700 1 -- 172.21.15.49:0/2554223271 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 68) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f39f0005ad0 con 0x7f3a080c6e30 2023-11-30T18:22:44.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.382+0000 7f39feffd700 1 --2- 172.21.15.49:0/2554223271 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f39e805f270 0x7f39e8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:44.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.382+0000 7f39feffd700 1 -- 172.21.15.49:0/2554223271 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f39f0079ac0 con 0x7f3a080c6e30 2023-11-30T18:22:44.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.382+0000 7f3a06ffd700 1 --2- 172.21.15.49:0/2554223271 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f39e805f270 0x7f39e8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:44.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.382+0000 7f3a06ffd700 1 --2- 172.21.15.49:0/2554223271 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f39e805f270 0x7f39e8061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f3a00009590 tx=0x7f3a00009840).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:44.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.386+0000 7f39feffd700 1 -- 172.21.15.49:0/2554223271 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3a081518d0 con 0x7f3a080c6e30 2023-11-30T18:22:44.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.601+0000 7f3a0d932700 1 -- 172.21.15.49:0/2554223271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a08151890 con 0x7f3a080c6e30 2023-11-30T18:22:44.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.601+0000 7f39feffd700 1 -- 172.21.15.49:0/2554223271 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f39f0018030 con 0x7f3a080c6e30 2023-11-30T18:22:44.603 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:22:44.603 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":69,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7193,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/4003300500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4003300500},{"type":"v1","addr":"172.21.15.49:6835","nonce":4003300500}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7205,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3715169351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3715169351},{"type":"v1","addr":"172.21.15.115:6837","nonce":3715169351}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":8272,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2922134566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2922134566},{"type":"v1","addr":"172.21.15.115:6836","nonce":2922134566}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T18:22:39.426066+0000","modified":"2023-11-30T18:22:42.436489+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8505},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8505":{"gid":8505,"name":"a","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6833/3939533550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3939533550},{"type":"v1","addr":"172.21.15.49:6833","nonce":3939533550}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-11-30T18:22:44.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.603+0000 7f3a0d932700 1 -- 172.21.15.49:0/2554223271 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f39e805f270 msgr2=0x7f39e8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:44.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.603+0000 7f3a0d932700 1 --2- 172.21.15.49:0/2554223271 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f39e805f270 0x7f39e8061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f3a00009590 tx=0x7f3a00009840).stop 2023-11-30T18:22:44.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.603+0000 7f3a0d932700 1 -- 172.21.15.49:0/2554223271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a080c6e30 msgr2=0x7f3a08152fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:44.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.603+0000 7f3a0d932700 1 --2- 172.21.15.49:0/2554223271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a080c6e30 0x7f3a08152fe0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f39f000c490 tx=0x7f39f0007db0).stop 2023-11-30T18:22:44.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.603+0000 7f3a0d932700 1 -- 172.21.15.49:0/2554223271 shutdown_connections 2023-11-30T18:22:44.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.603+0000 7f3a0d932700 1 --2- 172.21.15.49:0/2554223271 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a081544e0 0x7f3a081534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:44.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.603+0000 7f3a0d932700 1 --2- 172.21.15.49:0/2554223271 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a0806a610 0x7f3a08150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:44.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.603+0000 7f3a0d932700 1 --2- 172.21.15.49:0/2554223271 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f39e805f270 0x7f39e8061730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:44.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.603+0000 7f3a0d932700 1 --2- 172.21.15.49:0/2554223271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a080c6e30 0x7f3a08152fe0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:44.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.603+0000 7f3a0d932700 1 -- 172.21.15.49:0/2554223271 >> 172.21.15.49:0/2554223271 conn(0x7f3a08085020 msgr2=0x7f3a080caad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:44.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.603+0000 7f3a0d932700 1 -- 172.21.15.49:0/2554223271 shutdown_connections 2023-11-30T18:22:44.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:44.603+0000 7f3a0d932700 1 -- 172.21.15.49:0/2554223271 wait complete. 2023-11-30T18:22:44.606 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 69 2023-11-30T18:22:44.700 INFO:tasks.ceph.mds.a.smithi049.stderr:2023-11-30T18:22:44.699+0000 7ff82ebce700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-30T18:22:45.020 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 69, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-30T18:22:39.426066+0000', 'modified': '2023-11-30T18:22:42.436489+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8505}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8505': {'gid': 8505, 'name': 'a', 'rank': 0, 'incarnation': 65, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6833/3939533550', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6832', 'nonce': 3939533550}, {'type': 'v1', 'addr': '172.21.15.49:6833', 'nonce': 3939533550}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-11-30T18:22:45.020 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-30T18:22:45.020 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-30T18:22:45.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.140+0000 7f2f95165700 1 Processor -- start 2023-11-30T18:22:45.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.140+0000 7f2f95165700 1 -- start start 2023-11-30T18:22:45.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.141+0000 7f2f95165700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f90098d10 0x7f2f900c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:45.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.141+0000 7f2f95165700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2f900c6190 0x7f2f90063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:45.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.141+0000 7f2f95165700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f900c72d0 con 0x7f2f90064350 2023-11-30T18:22:45.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.141+0000 7f2f95165700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f90154bc0 con 0x7f2f900c6190 2023-11-30T18:22:45.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.141+0000 7f2f95165700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f900c66c0 con 0x7f2f90098d10 2023-11-30T18:22:45.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.141+0000 7f2f8e59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2f900c6190 0x7f2f90063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:45.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.141+0000 7f2f8f59e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2f90064350 0x7f2f90158320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59100/0 (socket says 172.21.15.49:59100) 2023-11-30T18:22:45.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.141+0000 7f2f8f59e700 1 -- 172.21.15.49:0/1146450157 learned_addr learned my addr 172.21.15.49:0/1146450157 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:22:45.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.141+0000 7f2f8ed9d700 1 --2- 172.21.15.49:0/1146450157 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f90098d10 0x7f2f900c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:45.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.142+0000 7f2f8e59c700 1 -- 172.21.15.49:0/1146450157 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f90098d10 msgr2=0x7f2f900c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:45.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.142+0000 7f2f8e59c700 1 --2- 172.21.15.49:0/1146450157 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f90098d10 0x7f2f900c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.142+0000 7f2f8e59c700 1 -- 172.21.15.49:0/1146450157 >> v1:172.21.15.49:6789/0 conn(0x7f2f90064350 legacy=0x7f2f90158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:45.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.142+0000 7f2f8dd9b700 1 -- 172.21.15.49:0/1146450157 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1372182500 0 0) 0x7f2f900c72d0 con 0x7f2f90064350 2023-11-30T18:22:45.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.142+0000 7f2f8e59c700 1 -- 172.21.15.49:0/1146450157 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f900c69a0 con 0x7f2f900c6190 2023-11-30T18:22:45.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.142+0000 7f2f8e59c700 1 --2- 172.21.15.49:0/1146450157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f900c6190 0x7f2f90063e60 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f2f78009760 tx=0x7f2f78009060).ready entity=mon.0 client_cookie=60e7e22cabc5d202 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:45.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.142+0000 7f2f8dd9b700 1 -- 172.21.15.49:0/1146450157 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7800f510 con 0x7f2f900c6190 2023-11-30T18:22:45.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.142+0000 7f2f8dd9b700 1 -- 172.21.15.49:0/1146450157 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7800f670 con 0x7f2f900c6190 2023-11-30T18:22:45.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.142+0000 7f2f8dd9b700 1 -- 172.21.15.49:0/1146450157 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7800f9f0 con 0x7f2f900c6190 2023-11-30T18:22:45.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.142+0000 7f2f95165700 1 -- 172.21.15.49:0/1146450157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f900c6190 msgr2=0x7f2f90063e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:45.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.142+0000 7f2f95165700 1 --2- 172.21.15.49:0/1146450157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f900c6190 0x7f2f90063e60 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f2f78009760 tx=0x7f2f78009060).stop 2023-11-30T18:22:45.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.142+0000 7f2f95165700 1 -- 172.21.15.49:0/1146450157 shutdown_connections 2023-11-30T18:22:45.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.142+0000 7f2f95165700 1 --2- 172.21.15.49:0/1146450157 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f90098d10 0x7f2f900c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.142+0000 7f2f95165700 1 --2- 172.21.15.49:0/1146450157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f900c6190 0x7f2f90063e60 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.142+0000 7f2f95165700 1 -- 172.21.15.49:0/1146450157 >> 172.21.15.49:0/1146450157 conn(0x7f2f900cb310 msgr2=0x7f2f900cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:45.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.142+0000 7f2f95165700 1 -- 172.21.15.49:0/1146450157 shutdown_connections 2023-11-30T18:22:45.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.142+0000 7f2f95165700 1 -- 172.21.15.49:0/1146450157 wait complete. 2023-11-30T18:22:45.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.144+0000 7f2f95165700 1 Processor -- start 2023-11-30T18:22:45.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.144+0000 7f2f95165700 1 -- start start 2023-11-30T18:22:45.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.144+0000 7f2f95165700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f90064350 0x7f2f90164d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:45.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.144+0000 7f2f95165700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f90098d10 0x7f2f90159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:45.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.144+0000 7f2f95165700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f900c6190 0x7f2f90155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:45.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.144+0000 7f2f95165700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f900c3bc0 con 0x7f2f90064350 2023-11-30T18:22:45.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.144+0000 7f2f95165700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f90164730 con 0x7f2f900c6190 2023-11-30T18:22:45.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.144+0000 7f2f95165700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f90156840 con 0x7f2f90098d10 2023-11-30T18:22:45.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.144+0000 7f2f8ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f90064350 0x7f2f90164d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:45.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.144+0000 7f2f8ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f90064350 0x7f2f90164d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36978/0 (socket says 172.21.15.49:36978) 2023-11-30T18:22:45.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.144+0000 7f2f8ed9d700 1 -- 172.21.15.49:0/3612189730 learned_addr learned my addr 172.21.15.49:0/3612189730 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:45.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.145+0000 7f2f8e59c700 1 --2- 172.21.15.49:0/3612189730 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f90098d10 0x7f2f90159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:45.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.145+0000 7f2f8f59e700 1 --2- 172.21.15.49:0/3612189730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f900c6190 0x7f2f90155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:45.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.145+0000 7f2f8ed9d700 1 -- 172.21.15.49:0/3612189730 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f90098d10 msgr2=0x7f2f90159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:45.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.145+0000 7f2f8ed9d700 1 --2- 172.21.15.49:0/3612189730 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f90098d10 0x7f2f90159480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.145+0000 7f2f8ed9d700 1 -- 172.21.15.49:0/3612189730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f900c6190 msgr2=0x7f2f90155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:45.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.145+0000 7f2f8ed9d700 1 --2- 172.21.15.49:0/3612189730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f900c6190 0x7f2f90155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.145+0000 7f2f8ed9d700 1 -- 172.21.15.49:0/3612189730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f780092a0 con 0x7f2f90064350 2023-11-30T18:22:45.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.145+0000 7f2f8ed9d700 1 --2- 172.21.15.49:0/3612189730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f90064350 0x7f2f90164d50 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f2f8800e950 tx=0x7f2f88009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:45.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.145+0000 7f2f86ffd700 1 -- 172.21.15.49:0/3612189730 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8800c850 con 0x7f2f90064350 2023-11-30T18:22:45.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.145+0000 7f2f86ffd700 1 -- 172.21.15.49:0/3612189730 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8800c9b0 con 0x7f2f90064350 2023-11-30T18:22:45.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.145+0000 7f2f95165700 1 -- 172.21.15.49:0/3612189730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f90156b20 con 0x7f2f90064350 2023-11-30T18:22:45.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.145+0000 7f2f86ffd700 1 -- 172.21.15.49:0/3612189730 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8800cd30 con 0x7f2f90064350 2023-11-30T18:22:45.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.145+0000 7f2f95165700 1 -- 172.21.15.49:0/3612189730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f900c3850 con 0x7f2f90064350 2023-11-30T18:22:45.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.146+0000 7f2f86ffd700 1 -- 172.21.15.49:0/3612189730 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 68) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f2f88012600 con 0x7f2f90064350 2023-11-30T18:22:45.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.147+0000 7f2f86ffd700 1 --2- 172.21.15.49:0/3612189730 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2f7005f270 0x7f2f70061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:45.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.147+0000 7f2f86ffd700 1 -- 172.21.15.49:0/3612189730 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f2f8807aa20 con 0x7f2f90064350 2023-11-30T18:22:45.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.147+0000 7f2f8e59c700 1 --2- 172.21.15.49:0/3612189730 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2f7005f270 0x7f2f70061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:45.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.147+0000 7f2f8e59c700 1 --2- 172.21.15.49:0/3612189730 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2f7005f270 0x7f2f70061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f2f78009760 tx=0x7f2f78017000).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:45.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.149+0000 7f2fa6afdb80 1 Processor -- start 2023-11-30T18:22:45.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.149+0000 7f2fa6afdb80 1 -- start start 2023-11-30T18:22:45.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.150+0000 7f2fa6afdb80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55bc8a7efe40 0x55bc8aa5bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:45.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.150+0000 7f2fa6afdb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bc8aa7cea0 0x55bc8aa337c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:45.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.150+0000 7f2fa6afdb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bc8aa33cb0 0x55bc8aa2e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:45.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.150+0000 7f2fa6afdb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc8a9f9060 con 0x55bc8aa7cea0 2023-11-30T18:22:45.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.150+0000 7f2fa6afdb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc8a9701f0 con 0x55bc8aa33cb0 2023-11-30T18:22:45.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.150+0000 7f2fa6afdb80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc8a985440 con 0x55bc8a7efe40 2023-11-30T18:22:45.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.150+0000 7f2f8e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bc8aa7cea0 0x55bc8aa337c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:45.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.150+0000 7f2f8e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bc8aa7cea0 0x55bc8aa337c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36986/0 (socket says 172.21.15.49:36986) 2023-11-30T18:22:45.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.150+0000 7f2f8e59c700 1 -- 172.21.15.49:0/4056499508 learned_addr learned my addr 172.21.15.49:0/4056499508 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:45.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.150+0000 7f2f8ed9d700 1 --2- 172.21.15.49:0/4056499508 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55bc8a7efe40 0x55bc8aa5bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:45.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.150+0000 7f2f8f59e700 1 --2- 172.21.15.49:0/4056499508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bc8aa33cb0 0x55bc8aa2e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:45.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.150+0000 7f2f8e59c700 1 -- 172.21.15.49:0/4056499508 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55bc8a7efe40 msgr2=0x55bc8aa5bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:45.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.150+0000 7f2f8e59c700 1 --2- 172.21.15.49:0/4056499508 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55bc8a7efe40 0x55bc8aa5bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.150+0000 7f2f8e59c700 1 -- 172.21.15.49:0/4056499508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bc8aa33cb0 msgr2=0x55bc8aa2e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:45.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.150+0000 7f2f8e59c700 1 --2- 172.21.15.49:0/4056499508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bc8aa33cb0 0x55bc8aa2e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.150+0000 7f2f8e59c700 1 -- 172.21.15.49:0/4056499508 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc8a97e620 con 0x55bc8aa7cea0 2023-11-30T18:22:45.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.150+0000 7f2f8f59e700 1 --2- 172.21.15.49:0/4056499508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bc8aa33cb0 0x55bc8aa2e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:22:45.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.151+0000 7f2f8e59c700 1 --2- 172.21.15.49:0/4056499508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bc8aa7cea0 0x55bc8aa337c0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7f2f78009e00 tx=0x7f2f7801d070).ready entity=mon.0 client_cookie=f216a4ac10d3682d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:45.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.151+0000 7f2f6ffff700 1 -- 172.21.15.49:0/4056499508 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f78006c70 con 0x55bc8aa7cea0 2023-11-30T18:22:45.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.151+0000 7f2f6ffff700 1 -- 172.21.15.49:0/4056499508 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7801f070 con 0x55bc8aa7cea0 2023-11-30T18:22:45.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.151+0000 7f2f6ffff700 1 -- 172.21.15.49:0/4056499508 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7800f960 con 0x55bc8aa7cea0 2023-11-30T18:22:45.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.151+0000 7f2fa6afdb80 1 -- 172.21.15.49:0/4056499508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bc8aa7cea0 msgr2=0x55bc8aa337c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:45.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.151+0000 7f2fa6afdb80 1 --2- 172.21.15.49:0/4056499508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bc8aa7cea0 0x55bc8aa337c0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7f2f78009e00 tx=0x7f2f7801d070).stop 2023-11-30T18:22:45.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.151+0000 7f2fa6afdb80 1 -- 172.21.15.49:0/4056499508 shutdown_connections 2023-11-30T18:22:45.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.151+0000 7f2fa6afdb80 1 --2- 172.21.15.49:0/4056499508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bc8aa33cb0 0x55bc8aa2e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.151+0000 7f2fa6afdb80 1 --2- 172.21.15.49:0/4056499508 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55bc8a7efe40 0x55bc8aa5bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.151+0000 7f2fa6afdb80 1 --2- 172.21.15.49:0/4056499508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bc8aa7cea0 0x55bc8aa337c0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.151+0000 7f2fa6afdb80 1 -- 172.21.15.49:0/4056499508 >> 172.21.15.49:0/4056499508 conn(0x55bc8a89d4a0 msgr2=0x55bc8aa7c790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:45.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.152+0000 7f2fa6afdb80 1 -- 172.21.15.49:0/4056499508 shutdown_connections 2023-11-30T18:22:45.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.152+0000 7f2fa6afdb80 1 -- 172.21.15.49:0/4056499508 wait complete. 2023-11-30T18:22:45.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.152+0000 7f2fa6afdb80 1 -- start start 2023-11-30T18:22:45.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.152+0000 7f2fa6afdb80 1 Processor -- start 2023-11-30T18:22:45.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.153+0000 7f2fa6afdb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bc8a7efe40 0x55bc8aa88b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:45.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.153+0000 7f2fa6afdb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bc8aa33cb0 0x55bc8aa88450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:45.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.153+0000 7f2fa6afdb80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55bc8aa7cea0 0x55bc8aa75ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:45.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.153+0000 7f2fa6afdb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc8a985580 con 0x55bc8a7efe40 2023-11-30T18:22:45.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.153+0000 7f2fa6afdb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc8a985800 con 0x55bc8aa33cb0 2023-11-30T18:22:45.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.153+0000 7f2fa6afdb80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc8a950e10 con 0x55bc8aa7cea0 2023-11-30T18:22:45.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.153+0000 7f2fa6afdb80 10 client.0 ll_register_callbacks cb 0x55bc8a9f3460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-30T18:22:45.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.153+0000 7f2f8ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bc8a7efe40 0x55bc8aa88b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:45.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.153+0000 7f2f8ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bc8a7efe40 0x55bc8aa88b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36996/0 (socket says 172.21.15.49:36996) 2023-11-30T18:22:45.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.153+0000 7f2f8ed9d700 1 -- 172.21.15.49:0/986806970 learned_addr learned my addr 172.21.15.49:0/986806970 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:45.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.153+0000 7f2f8f59e700 1 --2- 172.21.15.49:0/986806970 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55bc8aa7cea0 0x55bc8aa75ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:45.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.153+0000 7f2f8e59c700 1 --2- 172.21.15.49:0/986806970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bc8aa33cb0 0x55bc8aa88450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:45.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.154+0000 7f2f8ed9d700 1 -- 172.21.15.49:0/986806970 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55bc8aa7cea0 msgr2=0x55bc8aa75ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:45.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.154+0000 7f2f8ed9d700 1 --2- 172.21.15.49:0/986806970 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55bc8aa7cea0 0x55bc8aa75ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.154+0000 7f2f8ed9d700 1 -- 172.21.15.49:0/986806970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bc8aa33cb0 msgr2=0x55bc8aa88450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:45.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.154+0000 7f2f8ed9d700 1 --2- 172.21.15.49:0/986806970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bc8aa33cb0 0x55bc8aa88450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.154+0000 7f2f8ed9d700 1 -- 172.21.15.49:0/986806970 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f900c69a0 con 0x55bc8a7efe40 2023-11-30T18:22:45.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.154+0000 7f2f8ed9d700 1 --2- 172.21.15.49:0/986806970 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bc8a7efe40 0x55bc8aa88b80 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7f2f8804f6d0 tx=0x7f2f88011000).ready entity=mon.0 client_cookie=caada209f01f5547 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:45.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.154+0000 7f2f6d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-30T18:22:45.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.154+0000 7f2f6d7fa700 1 -- 172.21.15.49:0/986806970 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88019e50 con 0x55bc8a7efe40 2023-11-30T18:22:45.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.154+0000 7f2fa6afdb80 1 -- 172.21.15.49:0/986806970 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bc8aa27720 con 0x55bc8a7efe40 2023-11-30T18:22:45.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.154+0000 7f2f6d7fa700 1 -- 172.21.15.49:0/986806970 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(169..169 src has 1..169) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f2f8805ccb0 con 0x55bc8a7efe40 2023-11-30T18:22:45.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.154+0000 7f2f6d7fa700 1 -- 172.21.15.49:0/986806970 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f8805ce70 con 0x55bc8a7efe40 2023-11-30T18:22:45.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.154+0000 7f2fa6afdb80 10 client.8658 fetch_fsmap learned FSMap version 69 2023-11-30T18:22:45.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.154+0000 7f2fa6afdb80 1 -- 172.21.15.49:0/986806970 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) v3 -- 0x55bc8a9799c0 con 0x55bc8a7efe40 2023-11-30T18:22:45.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.154+0000 7f2f6d7fa700 1 -- 172.21.15.49:0/986806970 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bc8aa27720 con 0x55bc8a7efe40 2023-11-30T18:22:45.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.154+0000 7f2f6d7fa700 1 -- 172.21.15.49:0/986806970 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 69) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2f8804b5e0 con 0x55bc8a7efe40 2023-11-30T18:22:45.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.154+0000 7f2fa6afdb80 10 client.8658 fetch_fsmap finished waiting for FSMap version 69 2023-11-30T18:22:45.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.154+0000 7f2fa6afdb80 10 client.8658 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-30T18:22:45.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.154+0000 7f2fa6afdb80 20 client.8658 populate_metadata read hostname 'smithi049' 2023-11-30T18:22:45.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.154+0000 7f2fa6afdb80 1 --2- 172.21.15.49:0/986806970 >> [v2:172.21.15.49:6832/3939533550,v1:172.21.15.49:6833/3939533550] conn(0x55bc8aa79130 0x55bc8aa79510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:45.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.154+0000 7f2fa6afdb80 4 client.8658 mds_command: new command op to 8505 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-30T18:22:45.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.154+0000 7f2fa6afdb80 1 -- 172.21.15.49:0/986806970 --> [v2:172.21.15.49:6832/3939533550,v1:172.21.15.49:6833/3939533550] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bc8a7ebca0 con 0x55bc8aa79130 2023-11-30T18:22:45.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.154+0000 7f2f8e59c700 1 --2- 172.21.15.49:0/986806970 >> [v2:172.21.15.49:6832/3939533550,v1:172.21.15.49:6833/3939533550] conn(0x55bc8aa79130 0x55bc8aa79510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:45.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.155+0000 7f2f6d7fa700 10 client.8658 ms_handle_connect on v2:172.21.15.49:6832/3939533550 2023-11-30T18:22:45.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.155+0000 7f2f8e59c700 1 --2- 172.21.15.49:0/986806970 >> [v2:172.21.15.49:6832/3939533550,v1:172.21.15.49:6833/3939533550] conn(0x55bc8aa79130 0x55bc8aa79510 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=251abc8ae83608e4 server_cookie=4d70605863ca791d in_seq=0 out_seq=0 2023-11-30T18:22:45.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.155+0000 7f2f6d7fa700 1 -- 172.21.15.49:0/986806970 <== mds.0 v2:172.21.15.49:6832/3939533550 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55bc8a7ebca0 con 0x55bc8aa79130 2023-11-30T18:22:45.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.155+0000 7f2f6d7fa700 10 client.8658 handle_command_reply: tid=0 2023-11-30T18:22:45.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.155+0000 7f2fa6afdb80 1 client.8658 shutdown 2023-11-30T18:22:45.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.155+0000 7f2fa6afdb80 1 -- 172.21.15.49:0/986806970 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bc8a7efe40 msgr2=0x55bc8aa88b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:45.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.155+0000 7f2fa6afdb80 1 --2- 172.21.15.49:0/986806970 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bc8a7efe40 0x55bc8aa88b80 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7f2f8804f6d0 tx=0x7f2f88011000).stop 2023-11-30T18:22:45.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.156+0000 7f2fa6afdb80 1 -- 172.21.15.49:0/986806970 shutdown_connections 2023-11-30T18:22:45.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.156+0000 7f2fa6afdb80 1 --2- 172.21.15.49:0/986806970 >> [v2:172.21.15.49:6832/3939533550,v1:172.21.15.49:6833/3939533550] conn(0x55bc8aa79130 0x55bc8aa79510 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.156+0000 7f2fa6afdb80 1 --2- 172.21.15.49:0/986806970 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55bc8aa7cea0 0x55bc8aa75ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.156+0000 7f2f6d7fa700 0 client.8658 ms_handle_reset on v2:172.21.15.49:6832/3939533550 2023-11-30T18:22:45.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.156+0000 7f2fa6afdb80 1 --2- 172.21.15.49:0/986806970 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bc8a7efe40 0x55bc8aa88b80 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.156+0000 7f2fa6afdb80 1 --2- 172.21.15.49:0/986806970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bc8aa33cb0 0x55bc8aa88450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.156+0000 7f2fa6afdb80 1 -- 172.21.15.49:0/986806970 >> 172.21.15.49:0/986806970 conn(0x55bc8a89d4a0 msgr2=0x55bc8aa34a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:45.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.156+0000 7f2fa6afdb80 1 -- 172.21.15.49:0/986806970 shutdown_connections 2023-11-30T18:22:45.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.156+0000 7f2fa6afdb80 1 -- 172.21.15.49:0/986806970 wait complete. 2023-11-30T18:22:45.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.156+0000 7f2fa6afdb80 20 client.8658 trim_cache size 0 max 16384 2023-11-30T18:22:45.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.172+0000 7f2fa6afdb80 1 Processor -- start 2023-11-30T18:22:45.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.172+0000 7f2fa6afdb80 1 -- start start 2023-11-30T18:22:45.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.173+0000 7f2fa6afdb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bc8a7efe40 0x55bc8aa34dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:45.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.173+0000 7f2fa6afdb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bc8aa33cb0 0x55bc8aa72d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:45.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.173+0000 7f2fa6afdb80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55bc8aa7cea0 0x55bc8aa731f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:45.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.173+0000 7f2fa6afdb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc8aa736e0 con 0x55bc8a7efe40 2023-11-30T18:22:45.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.173+0000 7f2fa6afdb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc8aa628b0 con 0x55bc8aa33cb0 2023-11-30T18:22:45.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.173+0000 7f2fa6afdb80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc8aa324f0 con 0x55bc8aa7cea0 2023-11-30T18:22:45.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.173+0000 7f2f8ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bc8a7efe40 0x55bc8aa34dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:45.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.173+0000 7f2f8ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bc8a7efe40 0x55bc8aa34dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37008/0 (socket says 172.21.15.49:37008) 2023-11-30T18:22:45.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.173+0000 7f2f8ed9d700 1 -- 172.21.15.49:0/2051064357 learned_addr learned my addr 172.21.15.49:0/2051064357 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:45.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.173+0000 7f2f8ed9d700 1 -- 172.21.15.49:0/2051064357 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55bc8aa7cea0 msgr2=0x55bc8aa731f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:45.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.173+0000 7f2f8ed9d700 1 --2- 172.21.15.49:0/2051064357 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55bc8aa7cea0 0x55bc8aa731f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:45.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.173+0000 7f2f8ed9d700 1 -- 172.21.15.49:0/2051064357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bc8aa33cb0 msgr2=0x55bc8aa72d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:45.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.173+0000 7f2f8ed9d700 1 --2- 172.21.15.49:0/2051064357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bc8aa33cb0 0x55bc8aa72d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:45.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.173+0000 7f2f8ed9d700 1 -- 172.21.15.49:0/2051064357 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc8aa27340 con 0x55bc8a7efe40 2023-11-30T18:22:45.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.174+0000 7f2f8ed9d700 1 --2- 172.21.15.49:0/2051064357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bc8a7efe40 0x55bc8aa34dd0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f2f8800c430 tx=0x7f2f88060000).ready entity=mon.0 client_cookie=bdfba535b04b33ad server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:45.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.174+0000 7f2f84bcf700 1 -- 172.21.15.49:0/2051064357 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8804f560 con 0x55bc8a7efe40 2023-11-30T18:22:45.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.174+0000 7f2f84bcf700 1 -- 172.21.15.49:0/2051064357 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8804db90 con 0x55bc8a7efe40 2023-11-30T18:22:45.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.174+0000 7f2f84bcf700 1 -- 172.21.15.49:0/2051064357 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8800e030 con 0x55bc8a7efe40 2023-11-30T18:22:45.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.174+0000 7f2fa6afdb80 1 -- 172.21.15.49:0/2051064357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bc8a7efe40 msgr2=0x55bc8aa34dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:45.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.174+0000 7f2fa6afdb80 1 --2- 172.21.15.49:0/2051064357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bc8a7efe40 0x55bc8aa34dd0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f2f8800c430 tx=0x7f2f88060000).stop 2023-11-30T18:22:45.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.174+0000 7f2fa6afdb80 1 -- 172.21.15.49:0/2051064357 shutdown_connections 2023-11-30T18:22:45.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.174+0000 7f2fa6afdb80 1 --2- 172.21.15.49:0/2051064357 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55bc8aa7cea0 0x55bc8aa731f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:45.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.174+0000 7f2fa6afdb80 1 --2- 172.21.15.49:0/2051064357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bc8a7efe40 0x55bc8aa34dd0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.174+0000 7f2fa6afdb80 1 --2- 172.21.15.49:0/2051064357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bc8aa33cb0 0x55bc8aa72d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:45.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.174+0000 7f2fa6afdb80 1 -- 172.21.15.49:0/2051064357 >> 172.21.15.49:0/2051064357 conn(0x55bc8a89d4a0 msgr2=0x55bc8aa88b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:45.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.174+0000 7f2fa6afdb80 1 -- 172.21.15.49:0/2051064357 shutdown_connections 2023-11-30T18:22:45.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.174+0000 7f2fa6afdb80 1 -- 172.21.15.49:0/2051064357 wait complete. 2023-11-30T18:22:45.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.175+0000 7f2fa6afdb80 1 -- start start 2023-11-30T18:22:45.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.175+0000 7f2fa6afdb80 1 Processor -- start 2023-11-30T18:22:45.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.176+0000 7f2fa6afdb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bc8a7efe40 0x55bc8aae0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:45.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.176+0000 7f2fa6afdb80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55bc8aa33cb0 0x55bc8aa72d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:45.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.176+0000 7f2fa6afdb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bc8aa7cea0 0x55bc8aa731f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:45.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.176+0000 7f2fa6afdb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc8aa30c70 con 0x55bc8aa7cea0 2023-11-30T18:22:45.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.176+0000 7f2fa6afdb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc8aa736e0 con 0x55bc8a7efe40 2023-11-30T18:22:45.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.176+0000 7f2fa6afdb80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc8aa60220 con 0x55bc8aa33cb0 2023-11-30T18:22:45.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.176+0000 7f2fa6afdb80 10 client.0 ll_register_callbacks cb 0x55bc8a9f3460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-30T18:22:45.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.176+0000 7f2f8f59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bc8aa7cea0 0x55bc8aa731f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:45.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.176+0000 7f2f8f59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bc8aa7cea0 0x55bc8aa731f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37012/0 (socket says 172.21.15.49:37012) 2023-11-30T18:22:45.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.176+0000 7f2f8f59e700 1 -- 172.21.15.49:0/52605630 learned_addr learned my addr 172.21.15.49:0/52605630 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:45.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.176+0000 7f2f8e59c700 1 --2- 172.21.15.49:0/52605630 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55bc8aa33cb0 0x55bc8aa72d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:45.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.176+0000 7f2f8ed9d700 1 --2- 172.21.15.49:0/52605630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bc8a7efe40 0x55bc8aae0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:45.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.176+0000 7f2f8f59e700 1 -- 172.21.15.49:0/52605630 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55bc8aa33cb0 msgr2=0x55bc8aa72d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:45.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.176+0000 7f2f8f59e700 1 --2- 172.21.15.49:0/52605630 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55bc8aa33cb0 0x55bc8aa72d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.176+0000 7f2f8f59e700 1 -- 172.21.15.49:0/52605630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bc8a7efe40 msgr2=0x55bc8aae0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:45.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.176+0000 7f2f8f59e700 1 --2- 172.21.15.49:0/52605630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bc8a7efe40 0x55bc8aae0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.176+0000 7f2f8f59e700 1 -- 172.21.15.49:0/52605630 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bc8a9799c0 con 0x55bc8aa7cea0 2023-11-30T18:22:45.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.176+0000 7f2f8ed9d700 1 --2- 172.21.15.49:0/52605630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bc8a7efe40 0x55bc8aae0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:22:45.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.176+0000 7f2f8f59e700 1 --2- 172.21.15.49:0/52605630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bc8aa7cea0 0x55bc8aa731f0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7f2f80000f80 tx=0x7f2f80009040).ready entity=mon.0 client_cookie=f6665eaf9c0efc1c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:45.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.176+0000 7f2f6d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-30T18:22:45.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.177+0000 7f2f6d7fa700 1 -- 172.21.15.49:0/52605630 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f800018c0 con 0x55bc8aa7cea0 2023-11-30T18:22:45.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.177+0000 7f2f6d7fa700 1 -- 172.21.15.49:0/52605630 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(169..169 src has 1..169) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f2f80005d10 con 0x55bc8aa7cea0 2023-11-30T18:22:45.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.177+0000 7f2fa6afdb80 1 -- 172.21.15.49:0/52605630 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bc8a822ca0 con 0x55bc8aa7cea0 2023-11-30T18:22:45.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.177+0000 7f2f6d7fa700 1 -- 172.21.15.49:0/52605630 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f800072e0 con 0x55bc8aa7cea0 2023-11-30T18:22:45.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.177+0000 7f2fa6afdb80 10 client.8664 fetch_fsmap learned FSMap version 69 2023-11-30T18:22:45.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.177+0000 7f2fa6afdb80 1 -- 172.21.15.49:0/52605630 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) v3 -- 0x55bc8a979710 con 0x55bc8aa7cea0 2023-11-30T18:22:45.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.177+0000 7f2f6d7fa700 1 -- 172.21.15.49:0/52605630 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bc8a822ca0 con 0x55bc8aa7cea0 2023-11-30T18:22:45.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.177+0000 7f2f6d7fa700 1 -- 172.21.15.49:0/52605630 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 69) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2f80007440 con 0x55bc8aa7cea0 2023-11-30T18:22:45.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.177+0000 7f2fa6afdb80 10 client.8664 fetch_fsmap finished waiting for FSMap version 69 2023-11-30T18:22:45.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.177+0000 7f2fa6afdb80 10 client.8664 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-30T18:22:45.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.177+0000 7f2fa6afdb80 20 client.8664 populate_metadata read hostname 'smithi049' 2023-11-30T18:22:45.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.177+0000 7f2fa6afdb80 1 --2- 172.21.15.49:0/52605630 >> [v2:172.21.15.49:6832/3939533550,v1:172.21.15.49:6833/3939533550] conn(0x55bc8aa89060 0x55bc8aae0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:45.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.177+0000 7f2fa6afdb80 4 client.8664 mds_command: new command op to 8505 tid=0[{"prefix": "status"}] 2023-11-30T18:22:45.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.177+0000 7f2fa6afdb80 1 -- 172.21.15.49:0/52605630 --> [v2:172.21.15.49:6832/3939533550,v1:172.21.15.49:6833/3939533550] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bc8a851540 con 0x55bc8aa89060 2023-11-30T18:22:45.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.177+0000 7f2f8ed9d700 1 --2- 172.21.15.49:0/52605630 >> [v2:172.21.15.49:6832/3939533550,v1:172.21.15.49:6833/3939533550] conn(0x55bc8aa89060 0x55bc8aae0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:45.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.177+0000 7f2f6d7fa700 10 client.8664 ms_handle_connect on v2:172.21.15.49:6832/3939533550 2023-11-30T18:22:45.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.177+0000 7f2f8ed9d700 1 --2- 172.21.15.49:0/52605630 >> [v2:172.21.15.49:6832/3939533550,v1:172.21.15.49:6833/3939533550] conn(0x55bc8aa89060 0x55bc8aae0cd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=a37d7ef07a40438 server_cookie=b0336231ba1c78bc in_seq=0 out_seq=0 2023-11-30T18:22:45.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.178+0000 7f2f6d7fa700 1 -- 172.21.15.49:0/52605630 <== mds.0 v2:172.21.15.49:6832/3939533550 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55bc8a851540 con 0x55bc8aa89060 2023-11-30T18:22:45.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.178+0000 7f2f6d7fa700 10 client.8664 handle_command_reply: tid=0 2023-11-30T18:22:45.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.178+0000 7f2fa6afdb80 1 client.8664 shutdown 2023-11-30T18:22:45.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.178+0000 7f2fa6afdb80 1 -- 172.21.15.49:0/52605630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bc8aa7cea0 msgr2=0x55bc8aa731f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:45.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.178+0000 7f2fa6afdb80 1 --2- 172.21.15.49:0/52605630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bc8aa7cea0 0x55bc8aa731f0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7f2f80000f80 tx=0x7f2f80009040).stop 2023-11-30T18:22:45.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.178+0000 7f2fa6afdb80 1 -- 172.21.15.49:0/52605630 shutdown_connections 2023-11-30T18:22:45.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.178+0000 7f2fa6afdb80 1 --2- 172.21.15.49:0/52605630 >> [v2:172.21.15.49:6832/3939533550,v1:172.21.15.49:6833/3939533550] conn(0x55bc8aa89060 0x55bc8aae0cd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.178+0000 7f2fa6afdb80 1 --2- 172.21.15.49:0/52605630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bc8aa7cea0 0x55bc8aa731f0 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.178+0000 7f2fa6afdb80 1 --2- 172.21.15.49:0/52605630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bc8a7efe40 0x55bc8aae0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.178+0000 7f2fa6afdb80 1 --2- 172.21.15.49:0/52605630 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55bc8aa33cb0 0x55bc8aa72d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.178+0000 7f2f6d7fa700 0 client.8664 ms_handle_reset on v2:172.21.15.49:6832/3939533550 2023-11-30T18:22:45.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.178+0000 7f2fa6afdb80 1 -- 172.21.15.49:0/52605630 >> 172.21.15.49:0/52605630 conn(0x55bc8a89d4a0 msgr2=0x55bc8aa2f680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:45.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.178+0000 7f2fa6afdb80 1 -- 172.21.15.49:0/52605630 shutdown_connections 2023-11-30T18:22:45.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.178+0000 7f2fa6afdb80 1 -- 172.21.15.49:0/52605630 wait complete. 2023-11-30T18:22:45.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.178+0000 7f2fa6afdb80 20 client.8664 trim_cache size 0 max 16384 2023-11-30T18:22:45.186 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T18:22:45.186 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "ef213ed4-8f62-4ad5-b55f-7510fd0ee359", 2023-11-30T18:22:45.186 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2023-11-30T18:22:45.186 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 8505, 2023-11-30T18:22:45.186 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-11-30T18:22:45.186 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-11-30T18:22:45.186 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-11-30T18:22:45.187 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 5.7515599640000001, 2023-11-30T18:22:45.187 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 69, 2023-11-30T18:22:45.187 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 169, 2023-11-30T18:22:45.187 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 169, 2023-11-30T18:22:45.187 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 11.242673103 2023-11-30T18:22:45.187 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T18:22:45.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.178+0000 7f2f95165700 1 -- 172.21.15.49:0/3612189730 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2f7005f270 msgr2=0x7f2f70061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:45.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.178+0000 7f2f95165700 1 --2- 172.21.15.49:0/3612189730 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2f7005f270 0x7f2f70061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f2f78009760 tx=0x7f2f78017000).stop 2023-11-30T18:22:45.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.178+0000 7f2f95165700 1 -- 172.21.15.49:0/3612189730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f90064350 msgr2=0x7f2f90164d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:45.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.178+0000 7f2f95165700 1 --2- 172.21.15.49:0/3612189730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f90064350 0x7f2f90164d50 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f2f8800e950 tx=0x7f2f88009060).stop 2023-11-30T18:22:45.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.179+0000 7f2f95165700 1 -- 172.21.15.49:0/3612189730 shutdown_connections 2023-11-30T18:22:45.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.179+0000 7f2f95165700 1 --2- 172.21.15.49:0/3612189730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f900c6190 0x7f2f90155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.179+0000 7f2f95165700 1 --2- 172.21.15.49:0/3612189730 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f2f7005f270 0x7f2f70061730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.179+0000 7f2f95165700 1 --2- 172.21.15.49:0/3612189730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f90064350 0x7f2f90164d50 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.179+0000 7f2f95165700 1 --2- 172.21.15.49:0/3612189730 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f90098d10 0x7f2f90159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.179+0000 7f2f95165700 1 -- 172.21.15.49:0/3612189730 >> 172.21.15.49:0/3612189730 conn(0x7f2f900cb310 msgr2=0x7f2f900cab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:45.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.179+0000 7f2f95165700 1 -- 172.21.15.49:0/3612189730 shutdown_connections 2023-11-30T18:22:45.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.179+0000 7f2f95165700 1 -- 172.21.15.49:0/3612189730 wait complete. 2023-11-30T18:22:45.192 DEBUG:teuthology.orchestra.run.smithi049:> ceph fs ls 2023-11-30T18:22:45.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.295+0000 7f3420a56700 1 Processor -- start 2023-11-30T18:22:45.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.295+0000 7f3420a56700 1 -- start start 2023-11-30T18:22:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.296+0000 7f3420a56700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f341c154700 0x7f341c0c7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.296+0000 7f3420a56700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f341c0c7c50 0x7f341c0c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.296+0000 7f3420a56700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f341c0c6d80 con 0x7f341c0c7700 2023-11-30T18:22:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.296+0000 7f3420a56700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f341c0c85d0 con 0x7f341c154700 2023-11-30T18:22:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.296+0000 7f3420a56700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341c154ae0 con 0x7f341c0c7c50 2023-11-30T18:22:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.297+0000 7f341a59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f341c154700 0x7f341c0c7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.297+0000 7f341ad9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f341c0c7c50 0x7f341c0c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.297+0000 7f3419d9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f341c0c7700 0x7f341c0aa1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:47530/0 (socket says 172.21.15.49:47530) 2023-11-30T18:22:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.297+0000 7f341a59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f341c154700 0x7f341c0c7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:60000/0 (socket says 172.21.15.49:60000) 2023-11-30T18:22:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.297+0000 7f341ad9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f341c0c7c50 0x7f341c0c80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:49654/0 (socket says 172.21.15.49:49654) 2023-11-30T18:22:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.297+0000 7f3419d9b700 1 -- 172.21.15.49:0/466217847 learned_addr learned my addr 172.21.15.49:0/466217847 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:22:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.297+0000 7f341959a700 1 -- 172.21.15.49:0/466217847 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3690891047 0 0) 0x7f341c0c6d80 con 0x7f341c0c7700 2023-11-30T18:22:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.297+0000 7f341ad9d700 1 -- 172.21.15.49:0/466217847 >> v2:172.21.15.115:3300/0 conn(0x7f341c154700 msgr2=0x7f341c0c7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.297+0000 7f341ad9d700 1 --2- 172.21.15.49:0/466217847 >> v2:172.21.15.115:3300/0 conn(0x7f341c154700 0x7f341c0c7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.297+0000 7f341ad9d700 1 -- 172.21.15.49:0/466217847 >> v1:172.21.15.115:6789/0 conn(0x7f341c0c7700 legacy=0x7f341c0aa1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.297+0000 7f341ad9d700 1 -- 172.21.15.49:0/466217847 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341c064c30 con 0x7f341c0c7c50 2023-11-30T18:22:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.297+0000 7f341ad9d700 1 --2- 172.21.15.49:0/466217847 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f341c0c7c50 0x7f341c0c80e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f340c009760 tx=0x7f340c009060).ready entity=mon.2 client_cookie=82c5dc688cfd8164 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.297+0000 7f341959a700 1 -- 172.21.15.49:0/466217847 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340c00f510 con 0x7f341c0c7c50 2023-11-30T18:22:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.297+0000 7f341959a700 1 -- 172.21.15.49:0/466217847 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340c00f670 con 0x7f341c0c7c50 2023-11-30T18:22:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.297+0000 7f341959a700 1 -- 172.21.15.49:0/466217847 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340c00f9f0 con 0x7f341c0c7c50 2023-11-30T18:22:45.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.298+0000 7f3420a56700 1 -- 172.21.15.49:0/466217847 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f341c0c7c50 msgr2=0x7f341c0c80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:45.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.298+0000 7f3420a56700 1 --2- 172.21.15.49:0/466217847 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f341c0c7c50 0x7f341c0c80e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f340c009760 tx=0x7f340c009060).stop 2023-11-30T18:22:45.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.298+0000 7f3420a56700 1 -- 172.21.15.49:0/466217847 shutdown_connections 2023-11-30T18:22:45.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.298+0000 7f3420a56700 1 --2- 172.21.15.49:0/466217847 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f341c0c7c50 0x7f341c0c80e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.298+0000 7f3420a56700 1 --2- 172.21.15.49:0/466217847 >> v2:172.21.15.115:3300/0 conn(0x7f341c154700 0x7f341c0c7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.298+0000 7f3420a56700 1 -- 172.21.15.49:0/466217847 >> 172.21.15.49:0/466217847 conn(0x7f341c0948b0 msgr2=0x7f341c06a690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:45.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.298+0000 7f3420a56700 1 -- 172.21.15.49:0/466217847 shutdown_connections 2023-11-30T18:22:45.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.298+0000 7f3420a56700 1 -- 172.21.15.49:0/466217847 wait complete. 2023-11-30T18:22:45.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.299+0000 7f3420a56700 1 Processor -- start 2023-11-30T18:22:45.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.299+0000 7f3420a56700 1 -- start start 2023-11-30T18:22:45.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.300+0000 7f3420a56700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f341c0c7700 0x7f341c148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:45.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.300+0000 7f3420a56700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f341c0c7c50 0x7f341c157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:45.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.300+0000 7f3420a56700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f341c154700 0x7f341c157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:45.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.300+0000 7f3420a56700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341c0acce0 con 0x7f341c0c7700 2023-11-30T18:22:45.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.300+0000 7f3420a56700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341c0ac110 con 0x7f341c154700 2023-11-30T18:22:45.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.300+0000 7f3420a56700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341c0ac3b0 con 0x7f341c0c7c50 2023-11-30T18:22:45.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.300+0000 7f341a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f341c0c7700 0x7f341c148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:45.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.300+0000 7f341a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f341c0c7700 0x7f341c148fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37022/0 (socket says 172.21.15.49:37022) 2023-11-30T18:22:45.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.300+0000 7f341a59c700 1 -- 172.21.15.49:0/1588932565 learned_addr learned my addr 172.21.15.49:0/1588932565 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:45.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.300+0000 7f3419d9b700 1 --2- 172.21.15.49:0/1588932565 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f341c0c7c50 0x7f341c157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:45.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.300+0000 7f341ad9d700 1 --2- 172.21.15.49:0/1588932565 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f341c154700 0x7f341c157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:45.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.300+0000 7f341a59c700 1 -- 172.21.15.49:0/1588932565 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f341c0c7c50 msgr2=0x7f341c157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:45.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.300+0000 7f341a59c700 1 --2- 172.21.15.49:0/1588932565 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f341c0c7c50 0x7f341c157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.300+0000 7f341a59c700 1 -- 172.21.15.49:0/1588932565 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f341c154700 msgr2=0x7f341c157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:45.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.300+0000 7f341a59c700 1 --2- 172.21.15.49:0/1588932565 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f341c154700 0x7f341c157780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.300+0000 7f341a59c700 1 -- 172.21.15.49:0/1588932565 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340c0092a0 con 0x7f341c0c7700 2023-11-30T18:22:45.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.300+0000 7f341ad9d700 1 --2- 172.21.15.49:0/1588932565 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f341c154700 0x7f341c157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:22:45.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.300+0000 7f341a59c700 1 --2- 172.21.15.49:0/1588932565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f341c0c7700 0x7f341c148fa0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7f3414009e50 tx=0x7f341400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:45.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.301+0000 7f34127fc700 1 -- 172.21.15.49:0/1588932565 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341400cb50 con 0x7f341c0c7700 2023-11-30T18:22:45.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.301+0000 7f34127fc700 1 -- 172.21.15.49:0/1588932565 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341400f040 con 0x7f341c0c7700 2023-11-30T18:22:45.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.301+0000 7f3420a56700 1 -- 172.21.15.49:0/1588932565 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f341c0ac690 con 0x7f341c0c7700 2023-11-30T18:22:45.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.301+0000 7f34127fc700 1 -- 172.21.15.49:0/1588932565 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3414013400 con 0x7f341c0c7700 2023-11-30T18:22:45.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.301+0000 7f3420a56700 1 -- 172.21.15.49:0/1588932565 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f341c156db0 con 0x7f341c0c7700 2023-11-30T18:22:45.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.301+0000 7f3420a56700 1 -- 172.21.15.49:0/1588932565 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f341c084d10 con 0x7f341c0c7700 2023-11-30T18:22:45.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.302+0000 7f34127fc700 1 -- 172.21.15.49:0/1588932565 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 68) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f3414013770 con 0x7f341c0c7700 2023-11-30T18:22:45.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.302+0000 7f34127fc700 1 --2- 172.21.15.49:0/1588932565 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f33fc05f270 0x7f33fc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:45.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.302+0000 7f34127fc700 1 -- 172.21.15.49:0/1588932565 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f341407abc0 con 0x7f341c0c7700 2023-11-30T18:22:45.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.303+0000 7f3419d9b700 1 --2- 172.21.15.49:0/1588932565 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f33fc05f270 0x7f33fc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:45.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.303+0000 7f3419d9b700 1 --2- 172.21.15.49:0/1588932565 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f33fc05f270 0x7f33fc061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f341c0c0c20 tx=0x7f3404007bb0).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:45.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.306+0000 7f34127fc700 1 -- 172.21.15.49:0/1588932565 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f341404bcd0 con 0x7f341c0c7700 2023-11-30T18:22:45.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.525+0000 7f3420a56700 1 -- 172.21.15.49:0/1588932565 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f341c0acfc0 con 0x7f341c0c7700 2023-11-30T18:22:45.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.526+0000 7f34127fc700 1 -- 172.21.15.49:0/1588932565 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v69) v1 ==== 53+0+73 (secure 0 0 0) 0x7f341404f2f0 con 0x7f341c0c7700 2023-11-30T18:22:45.528 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-30T18:22:45.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.527+0000 7f3420a56700 1 -- 172.21.15.49:0/1588932565 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f33fc05f270 msgr2=0x7f33fc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:45.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.527+0000 7f3420a56700 1 --2- 172.21.15.49:0/1588932565 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f33fc05f270 0x7f33fc061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f341c0c0c20 tx=0x7f3404007bb0).stop 2023-11-30T18:22:45.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.527+0000 7f3420a56700 1 -- 172.21.15.49:0/1588932565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f341c0c7700 msgr2=0x7f341c148fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:45.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.527+0000 7f3420a56700 1 --2- 172.21.15.49:0/1588932565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f341c0c7700 0x7f341c148fa0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7f3414009e50 tx=0x7f341400b040).stop 2023-11-30T18:22:45.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.527+0000 7f3420a56700 1 -- 172.21.15.49:0/1588932565 shutdown_connections 2023-11-30T18:22:45.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.527+0000 7f3420a56700 1 --2- 172.21.15.49:0/1588932565 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f341c154700 0x7f341c157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.527+0000 7f3420a56700 1 --2- 172.21.15.49:0/1588932565 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f33fc05f270 0x7f33fc061730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.527+0000 7f3420a56700 1 --2- 172.21.15.49:0/1588932565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f341c0c7700 0x7f341c148fa0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.527+0000 7f3420a56700 1 --2- 172.21.15.49:0/1588932565 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f341c0c7c50 0x7f341c157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:45.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.527+0000 7f3420a56700 1 -- 172.21.15.49:0/1588932565 >> 172.21.15.49:0/1588932565 conn(0x7f341c0948b0 msgr2=0x7f341c0c6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:45.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.527+0000 7f3420a56700 1 -- 172.21.15.49:0/1588932565 shutdown_connections 2023-11-30T18:22:45.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:45.527+0000 7f3420a56700 1 -- 172.21.15.49:0/1588932565 wait complete. 2023-11-30T18:22:45.540 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-30T18:22:45.540 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-30T18:22:45.540 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-11-30T18:22:45.540 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-30T18:22:45.540 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-30T18:22:45.540 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-30T18:22:45.540 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-30T18:22:45.540 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-30T18:22:45.541 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-30T18:22:45.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:22:45.541 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-11-30T18:22:45.556 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-30T18:22:45.557 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-30T18:22:45.557 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-11-30T18:22:45.557 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T18:22:45.557 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-11-30T18:22:45.557 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T18:22:45.557 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T18:22:45.557 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-11-30T18:22:45.557 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-11-30T18:22:45.557 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T18:22:45.557 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-11-30T18:22:45.557 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-11-30T18:22:45.557 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-30T18:22:45.557 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-11-30T18:22:45.558 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-11-30T18:22:45.558 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-30T18:22:45.558 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 37909sec preferred_lft 37909sec 2023-11-30T18:22:45.558 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2023-11-30T18:22:45.558 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T18:22:45.558 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T18:22:45.558 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-11-30T18:22:45.558 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-11-30T18:22:45.558 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-30T18:22:45.558 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 32:bf:40:53:4c:5d brd ff:ff:ff:ff:ff:ff 2023-11-30T18:22:45.558 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-30T18:22:45.558 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T18:22:45.558 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::8b6:11ff:fe93:7174/64 scope link 2023-11-30T18:22:45.559 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T18:22:45.559 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-30T18:22:45.559 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 3e:e9:3c:a8:7a:95 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-30T18:22:45.559 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::3ce9:3cff:fea8:7a95/64 scope link 2023-11-30T18:22:45.559 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T18:22:45.559 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-30T18:22:45.559 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 32:bf:40:53:4c:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-30T18:22:45.559 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::30bf:40ff:fe53:4c5d/64 scope link 2023-11-30T18:22:45.559 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T18:22:45.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:22:45.560 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-30T18:22:45.620 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-11-30T18:22:45.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:22:45.622 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-11-30T18:22:45.678 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-11-30T18:22:45.678 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-30T18:22:45.678 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-30T18:22:45.678 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-30T18:22:45.679 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-30T18:22:45.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:22:45.679 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-11-30T18:22:45.679 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-11-30T18:22:45.679 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-30T18:22:45.679 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-30T18:22:45.679 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-30T18:22:45.679 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-11-30T18:22:45.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:22:45.781 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-11-30T18:22:45.796 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-30T18:22:45.796 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-30T18:22:45.796 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-30T18:22:45.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:22:45.796 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-11-30T18:22:45.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:22:45.860 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-11-30T18:22:45.915 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-30T18:22:45.916 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T18:22:45.995 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T18:22:45.996 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-30T18:22:46.021 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T18:22:46.021 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-30T18:22:46.023 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-30T18:22:46.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:22:46.023 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-30T18:22:46.089 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-30T18:22:46.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.246+0000 7f297d9eb700 1 Processor -- start 2023-11-30T18:22:46.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.246+0000 7f297d9eb700 1 -- start start 2023-11-30T18:22:46.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.247+0000 7f297d9eb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29780c0250 0x7f29780c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:46.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.247+0000 7f297d9eb700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29780c12f0 con 0x7f29780ca3c0 2023-11-30T18:22:46.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.247+0000 7f297d9eb700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29780a8790 con 0x7f2978157c10 2023-11-30T18:22:46.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.247+0000 7f297d9eb700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29780c06e0 con 0x7f29780c0250 2023-11-30T18:22:46.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.247+0000 7f29777fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f29780ca3c0 0x7f29780c1780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59112/0 (socket says 172.21.15.49:59112) 2023-11-30T18:22:46.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.247+0000 7f29777fe700 1 -- 172.21.15.49:0/4052896147 learned_addr learned my addr 172.21.15.49:0/4052896147 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:22:46.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.248+0000 7f29767fc700 1 --2- 172.21.15.49:0/4052896147 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29780c0250 0x7f29780c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:46.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.248+0000 7f2975ffb700 1 -- 172.21.15.49:0/4052896147 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4209897744 0 0) 0x7f29780c12f0 con 0x7f29780ca3c0 2023-11-30T18:22:46.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.248+0000 7f2975ffb700 1 -- 172.21.15.49:0/4052896147 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29640033f0 con 0x7f29780ca3c0 2023-11-30T18:22:46.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.248+0000 7f2975ffb700 1 -- 172.21.15.49:0/4052896147 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2222720940 0 0) 0x7f29780a8790 con 0x7f2978157c10 2023-11-30T18:22:46.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.248+0000 7f2975ffb700 1 -- 172.21.15.49:0/4052896147 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29780c12f0 con 0x7f2978157c10 2023-11-30T18:22:46.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.248+0000 7f29767fc700 1 -- 172.21.15.49:0/4052896147 >> v1:172.21.15.115:6789/0 conn(0x7f2978157c10 legacy=0x7f29780a8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:46.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.248+0000 7f29767fc700 1 -- 172.21.15.49:0/4052896147 >> v1:172.21.15.49:6789/0 conn(0x7f29780ca3c0 legacy=0x7f29780c1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:46.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.248+0000 7f2975ffb700 1 -- 172.21.15.49:0/4052896147 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2561761259 0 0) 0x7f29640033f0 con 0x7f29780ca3c0 2023-11-30T18:22:46.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.248+0000 7f29767fc700 1 -- 172.21.15.49:0/4052896147 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29780c09c0 con 0x7f29780c0250 2023-11-30T18:22:46.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.248+0000 7f29767fc700 1 --2- 172.21.15.49:0/4052896147 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29780c0250 0x7f29780c9ed0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f2960009790 tx=0x7f2960009060).ready entity=mon.2 client_cookie=1d2e920dc433c1a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:46.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.248+0000 7f2975ffb700 1 -- 172.21.15.49:0/4052896147 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2968001470 con 0x7f29780c0250 2023-11-30T18:22:46.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.248+0000 7f2975ffb700 1 -- 172.21.15.49:0/4052896147 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2960011400 con 0x7f29780c0250 2023-11-30T18:22:46.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.248+0000 7f2975ffb700 1 -- 172.21.15.49:0/4052896147 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2960011780 con 0x7f29780c0250 2023-11-30T18:22:46.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.249+0000 7f297d9eb700 1 -- 172.21.15.49:0/4052896147 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29780c0250 msgr2=0x7f29780c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:46.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.249+0000 7f297d9eb700 1 --2- 172.21.15.49:0/4052896147 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29780c0250 0x7f29780c9ed0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f2960009790 tx=0x7f2960009060).stop 2023-11-30T18:22:46.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.249+0000 7f297d9eb700 1 -- 172.21.15.49:0/4052896147 shutdown_connections 2023-11-30T18:22:46.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.249+0000 7f297d9eb700 1 --2- 172.21.15.49:0/4052896147 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29780c0250 0x7f29780c9ed0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:46.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.249+0000 7f297d9eb700 1 -- 172.21.15.49:0/4052896147 >> 172.21.15.49:0/4052896147 conn(0x7f297806a610 msgr2=0x7f29780cb2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:46.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.249+0000 7f297d9eb700 1 -- 172.21.15.49:0/4052896147 shutdown_connections 2023-11-30T18:22:46.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.249+0000 7f297d9eb700 1 -- 172.21.15.49:0/4052896147 wait complete. 2023-11-30T18:22:46.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.250+0000 7f297d9eb700 1 Processor -- start 2023-11-30T18:22:46.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.250+0000 7f297d9eb700 1 -- start start 2023-11-30T18:22:46.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.251+0000 7f297d9eb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29780ca3c0 0x7f2978150a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:46.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.251+0000 7f297d9eb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2978157c10 0x7f2978155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:46.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.251+0000 7f297d9eb700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2978152e40 0x7f29780abf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:46.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.251+0000 7f297d9eb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29781563d0 con 0x7f29780ca3c0 2023-11-30T18:22:46.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.251+0000 7f297d9eb700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2978150f80 con 0x7f2978152e40 2023-11-30T18:22:46.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.251+0000 7f297d9eb700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29780a90b0 con 0x7f2978157c10 2023-11-30T18:22:46.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.251+0000 7f2976ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29780ca3c0 0x7f2978150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:46.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.251+0000 7f2976ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29780ca3c0 0x7f2978150a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37036/0 (socket says 172.21.15.49:37036) 2023-11-30T18:22:46.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.251+0000 7f2976ffd700 1 -- 172.21.15.49:0/3576172748 learned_addr learned my addr 172.21.15.49:0/3576172748 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:46.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.251+0000 7f29767fc700 1 --2- 172.21.15.49:0/3576172748 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2978157c10 0x7f2978155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:46.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.251+0000 7f29777fe700 1 --2- 172.21.15.49:0/3576172748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2978152e40 0x7f29780abf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:46.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.251+0000 7f2976ffd700 1 -- 172.21.15.49:0/3576172748 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2978157c10 msgr2=0x7f2978155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:46.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.251+0000 7f2976ffd700 1 --2- 172.21.15.49:0/3576172748 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2978157c10 0x7f2978155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:46.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.251+0000 7f2976ffd700 1 -- 172.21.15.49:0/3576172748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2978152e40 msgr2=0x7f29780abf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:46.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.251+0000 7f2976ffd700 1 --2- 172.21.15.49:0/3576172748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2978152e40 0x7f29780abf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:46.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.251+0000 7f2976ffd700 1 -- 172.21.15.49:0/3576172748 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29600092a0 con 0x7f29780ca3c0 2023-11-30T18:22:46.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.251+0000 7f29777fe700 1 --2- 172.21.15.49:0/3576172748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2978152e40 0x7f29780abf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:22:46.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.251+0000 7f2976ffd700 1 --2- 172.21.15.49:0/3576172748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29780ca3c0 0x7f2978150a90 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7f297000c840 tx=0x7f29700026b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:46.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.252+0000 7f296effd700 1 -- 172.21.15.49:0/3576172748 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2970010510 con 0x7f29780ca3c0 2023-11-30T18:22:46.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.252+0000 7f296effd700 1 -- 172.21.15.49:0/3576172748 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2970010670 con 0x7f29780ca3c0 2023-11-30T18:22:46.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.252+0000 7f297d9eb700 1 -- 172.21.15.49:0/3576172748 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29780a9390 con 0x7f29780ca3c0 2023-11-30T18:22:46.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.252+0000 7f296effd700 1 -- 172.21.15.49:0/3576172748 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2970010a10 con 0x7f29780ca3c0 2023-11-30T18:22:46.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.252+0000 7f297d9eb700 1 -- 172.21.15.49:0/3576172748 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29780a9950 con 0x7f29780ca3c0 2023-11-30T18:22:46.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.253+0000 7f297d9eb700 1 -- 172.21.15.49:0/3576172748 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29780a9b40 con 0x7f29780ca3c0 2023-11-30T18:22:46.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.253+0000 7f296effd700 1 -- 172.21.15.49:0/3576172748 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 68) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f297001b400 con 0x7f29780ca3c0 2023-11-30T18:22:46.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.253+0000 7f296effd700 1 --2- 172.21.15.49:0/3576172748 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f295805f270 0x7f2958061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:46.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.254+0000 7f296effd700 1 -- 172.21.15.49:0/3576172748 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f297007a310 con 0x7f29780ca3c0 2023-11-30T18:22:46.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.254+0000 7f29767fc700 1 --2- 172.21.15.49:0/3576172748 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f295805f270 0x7f2958061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:46.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.254+0000 7f29767fc700 1 --2- 172.21.15.49:0/3576172748 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f295805f270 0x7f2958061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f29600096e0 tx=0x7f2960016000).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:46.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.258+0000 7f296effd700 1 -- 172.21.15.49:0/3576172748 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f297004b3c0 con 0x7f29780ca3c0 2023-11-30T18:22:46.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.457+0000 7f297d9eb700 1 -- 172.21.15.49:0/3576172748 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f297806c860 con 0x7f295805f270 2023-11-30T18:22:46.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.459+0000 7f296effd700 1 -- 172.21.15.49:0/3576172748 <== mgr.7052 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f297806c860 con 0x7f295805f270 2023-11-30T18:22:46.461 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-11-30T18:22:46.461 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:22:46.461 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cephfs" 2023-11-30T18:22:46.461 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:22:46.461 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-11-30T18:22:46.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.461+0000 7f297d9eb700 1 -- 172.21.15.49:0/3576172748 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f295805f270 msgr2=0x7f2958061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:46.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.461+0000 7f297d9eb700 1 --2- 172.21.15.49:0/3576172748 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f295805f270 0x7f2958061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f29600096e0 tx=0x7f2960016000).stop 2023-11-30T18:22:46.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.461+0000 7f297d9eb700 1 -- 172.21.15.49:0/3576172748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29780ca3c0 msgr2=0x7f2978150a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:46.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.461+0000 7f297d9eb700 1 --2- 172.21.15.49:0/3576172748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29780ca3c0 0x7f2978150a90 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7f297000c840 tx=0x7f29700026b0).stop 2023-11-30T18:22:46.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.461+0000 7f297d9eb700 1 -- 172.21.15.49:0/3576172748 shutdown_connections 2023-11-30T18:22:46.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.461+0000 7f297d9eb700 1 --2- 172.21.15.49:0/3576172748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2978152e40 0x7f29780abf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:46.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.461+0000 7f297d9eb700 1 --2- 172.21.15.49:0/3576172748 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f295805f270 0x7f2958061730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:46.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.461+0000 7f297d9eb700 1 --2- 172.21.15.49:0/3576172748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29780ca3c0 0x7f2978150a90 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:46.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.461+0000 7f297d9eb700 1 --2- 172.21.15.49:0/3576172748 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2978157c10 0x7f2978155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:46.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.461+0000 7f297d9eb700 1 -- 172.21.15.49:0/3576172748 >> 172.21.15.49:0/3576172748 conn(0x7f297806a610 msgr2=0x7f2978154670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:46.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.461+0000 7f297d9eb700 1 -- 172.21.15.49:0/3576172748 shutdown_connections 2023-11-30T18:22:46.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.461+0000 7f297d9eb700 1 -- 172.21.15.49:0/3576172748 wait complete. 2023-11-30T18:22:46.475 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-11-30T18:22:46.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.592+0000 7fa8c7d1d700 1 Processor -- start 2023-11-30T18:22:46.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.592+0000 7fa8c7d1d700 1 -- start start 2023-11-30T18:22:46.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.593+0000 7fa8c7d1d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa8c00c6190 0x7fa8c00c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:46.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.593+0000 7fa8c7d1d700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c00c72d0 con 0x7fa8c0158320 2023-11-30T18:22:46.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.593+0000 7fa8c7d1d700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c0064570 con 0x7fa8c0098d10 2023-11-30T18:22:46.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.593+0000 7fa8c7d1d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c0154bc0 con 0x7fa8c00c6190 2023-11-30T18:22:46.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.593+0000 7fa8c62ba700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa8c0158320 0x7fa8c00a80f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59118/0 (socket says 172.21.15.49:59118) 2023-11-30T18:22:46.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.593+0000 7fa8c62ba700 1 -- 172.21.15.49:0/1464779828 learned_addr learned my addr 172.21.15.49:0/1464779828 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:22:46.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.593+0000 7fa8c52b8700 1 --2- 172.21.15.49:0/1464779828 >> v2:172.21.15.115:3300/0 conn(0x7fa8c00c6190 0x7fa8c00c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:46.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.594+0000 7fa8c4ab7700 1 -- 172.21.15.49:0/1464779828 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3291735187 0 0) 0x7fa8c00c72d0 con 0x7fa8c0158320 2023-11-30T18:22:46.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.594+0000 7fa8c4ab7700 1 -- 172.21.15.49:0/1464779828 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8a80033f0 con 0x7fa8c0158320 2023-11-30T18:22:46.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.594+0000 7fa8c52b8700 1 -- 172.21.15.49:0/1464779828 >> v1:172.21.15.115:6789/0 conn(0x7fa8c0098d10 legacy=0x7fa8c0063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:46.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.594+0000 7fa8c52b8700 1 -- 172.21.15.49:0/1464779828 >> v1:172.21.15.49:6789/0 conn(0x7fa8c0158320 legacy=0x7fa8c00a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:46.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.594+0000 7fa8c52b8700 1 -- 172.21.15.49:0/1464779828 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c00c66c0 con 0x7fa8c00c6190 2023-11-30T18:22:46.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.594+0000 7fa8c52b8700 1 --2- 172.21.15.49:0/1464779828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8c00c6190 0x7fa8c00c7760 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7fa8b4009760 tx=0x7fa8b4009060).ready entity=mon.1 client_cookie=8a75655718cd29b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:46.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.594+0000 7fa8c4ab7700 1 -- 172.21.15.49:0/1464779828 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b400f510 con 0x7fa8c00c6190 2023-11-30T18:22:46.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.594+0000 7fa8c4ab7700 1 -- 172.21.15.49:0/1464779828 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b400f670 con 0x7fa8c00c6190 2023-11-30T18:22:46.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.594+0000 7fa8c4ab7700 1 -- 172.21.15.49:0/1464779828 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b400f9f0 con 0x7fa8c00c6190 2023-11-30T18:22:46.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.595+0000 7fa8c7d1d700 1 -- 172.21.15.49:0/1464779828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8c00c6190 msgr2=0x7fa8c00c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:46.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.595+0000 7fa8c7d1d700 1 --2- 172.21.15.49:0/1464779828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8c00c6190 0x7fa8c00c7760 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7fa8b4009760 tx=0x7fa8b4009060).stop 2023-11-30T18:22:46.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.595+0000 7fa8c7d1d700 1 -- 172.21.15.49:0/1464779828 shutdown_connections 2023-11-30T18:22:46.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.595+0000 7fa8c7d1d700 1 --2- 172.21.15.49:0/1464779828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8c00c6190 0x7fa8c00c7760 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:46.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.595+0000 7fa8c7d1d700 1 -- 172.21.15.49:0/1464779828 >> 172.21.15.49:0/1464779828 conn(0x7fa8c00cb310 msgr2=0x7fa8c00cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:46.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.595+0000 7fa8c7d1d700 1 -- 172.21.15.49:0/1464779828 shutdown_connections 2023-11-30T18:22:46.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.595+0000 7fa8c7d1d700 1 -- 172.21.15.49:0/1464779828 wait complete. 2023-11-30T18:22:46.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.596+0000 7fa8c7d1d700 1 Processor -- start 2023-11-30T18:22:46.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.596+0000 7fa8c7d1d700 1 -- start start 2023-11-30T18:22:46.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.597+0000 7fa8c7d1d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8c0098d10 0x7fa8c0165390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:46.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.597+0000 7fa8c7d1d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8c00c6190 0x7fa8c00c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:46.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.597+0000 7fa8c7d1d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8c0158320 0x7fa8c00ca450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:46.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.597+0000 7fa8c7d1d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c0165880 con 0x7fa8c0158320 2023-11-30T18:22:46.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.597+0000 7fa8c7d1d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c00c8ec0 con 0x7fa8c0098d10 2023-11-30T18:22:46.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.597+0000 7fa8c7d1d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c00c91a0 con 0x7fa8c00c6190 2023-11-30T18:22:46.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.597+0000 7fa8c62ba700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8c0158320 0x7fa8c00ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:46.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.597+0000 7fa8c62ba700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8c0158320 0x7fa8c00ca450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37044/0 (socket says 172.21.15.49:37044) 2023-11-30T18:22:46.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.597+0000 7fa8c62ba700 1 -- 172.21.15.49:0/2941010452 learned_addr learned my addr 172.21.15.49:0/2941010452 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:46.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.597+0000 7fa8c52b8700 1 --2- 172.21.15.49:0/2941010452 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8c00c6190 0x7fa8c00c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:46.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.597+0000 7fa8c5ab9700 1 --2- 172.21.15.49:0/2941010452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8c0098d10 0x7fa8c0165390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:46.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.597+0000 7fa8c62ba700 1 -- 172.21.15.49:0/2941010452 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8c00c6190 msgr2=0x7fa8c00c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:46.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.597+0000 7fa8c62ba700 1 --2- 172.21.15.49:0/2941010452 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8c00c6190 0x7fa8c00c9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:46.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.597+0000 7fa8c62ba700 1 -- 172.21.15.49:0/2941010452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8c0098d10 msgr2=0x7fa8c0165390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:46.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.597+0000 7fa8c62ba700 1 --2- 172.21.15.49:0/2941010452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8c0098d10 0x7fa8c0165390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:46.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.597+0000 7fa8c62ba700 1 -- 172.21.15.49:0/2941010452 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b40092a0 con 0x7fa8c0158320 2023-11-30T18:22:46.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.597+0000 7fa8c62ba700 1 --2- 172.21.15.49:0/2941010452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8c0158320 0x7fa8c00ca450 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7fa8b00010e0 tx=0x7fa8b0007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:46.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.597+0000 7fa8bdffb700 1 -- 172.21.15.49:0/2941010452 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b00072e0 con 0x7fa8c0158320 2023-11-30T18:22:46.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.597+0000 7fa8bdffb700 1 -- 172.21.15.49:0/2941010452 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b0007440 con 0x7fa8c0158320 2023-11-30T18:22:46.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.597+0000 7fa8c7d1d700 1 -- 172.21.15.49:0/2941010452 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c00c9480 con 0x7fa8c0158320 2023-11-30T18:22:46.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.597+0000 7fa8bdffb700 1 -- 172.21.15.49:0/2941010452 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b00057a0 con 0x7fa8c0158320 2023-11-30T18:22:46.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.598+0000 7fa8c7d1d700 1 -- 172.21.15.49:0/2941010452 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c00c9a40 con 0x7fa8c0158320 2023-11-30T18:22:46.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.598+0000 7fa8c7d1d700 1 -- 172.21.15.49:0/2941010452 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c006c860 con 0x7fa8c0158320 2023-11-30T18:22:46.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.599+0000 7fa8bdffb700 1 -- 172.21.15.49:0/2941010452 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 68) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa8b0005bd0 con 0x7fa8c0158320 2023-11-30T18:22:46.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.599+0000 7fa8bdffb700 1 --2- 172.21.15.49:0/2941010452 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa8ac05f240 0x7fa8ac061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:46.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.599+0000 7fa8bdffb700 1 -- 172.21.15.49:0/2941010452 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fa8b0079b50 con 0x7fa8c0158320 2023-11-30T18:22:46.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.599+0000 7fa8c5ab9700 1 --2- 172.21.15.49:0/2941010452 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa8ac05f240 0x7fa8ac061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:46.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.600+0000 7fa8c5ab9700 1 --2- 172.21.15.49:0/2941010452 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa8ac05f240 0x7fa8ac061700 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fa8b8007fd0 tx=0x7fa8b8009040).ready entity=mgr.7052 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:46.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.603+0000 7fa8bdffb700 1 -- 172.21.15.49:0/2941010452 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa8b004ac60 con 0x7fa8c0158320 2023-11-30T18:22:46.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:46.821+0000 7fa8c7d1d700 1 -- 172.21.15.49:0/2941010452 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fa8c00c69a0 con 0x7fa8c0158320 2023-11-30T18:22:47.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.709+0000 7fa8bdffb700 1 -- 172.21.15.49:0/2941010452 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 69) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fa8b0077760 con 0x7fa8c0158320 2023-11-30T18:22:47.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.711+0000 7fa8bdffb700 1 -- 172.21.15.49:0/2941010452 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v69) v1 ==== 92+0+0 (secure 0 0 0) 0x7fa8b00738e0 con 0x7fa8c0158320 2023-11-30T18:22:47.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.713+0000 7fa8c7d1d700 1 -- 172.21.15.49:0/2941010452 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa8ac05f240 msgr2=0x7fa8ac061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:47.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.713+0000 7fa8c7d1d700 1 --2- 172.21.15.49:0/2941010452 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa8ac05f240 0x7fa8ac061700 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fa8b8007fd0 tx=0x7fa8b8009040).stop 2023-11-30T18:22:47.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.713+0000 7fa8c7d1d700 1 -- 172.21.15.49:0/2941010452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8c0158320 msgr2=0x7fa8c00ca450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:47.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.713+0000 7fa8c7d1d700 1 --2- 172.21.15.49:0/2941010452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8c0158320 0x7fa8c00ca450 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7fa8b00010e0 tx=0x7fa8b0007c50).stop 2023-11-30T18:22:47.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.713+0000 7fa8c7d1d700 1 -- 172.21.15.49:0/2941010452 shutdown_connections 2023-11-30T18:22:47.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.713+0000 7fa8c7d1d700 1 --2- 172.21.15.49:0/2941010452 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa8ac05f240 0x7fa8ac061700 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:47.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.713+0000 7fa8c7d1d700 1 --2- 172.21.15.49:0/2941010452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8c0158320 0x7fa8c00ca450 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:47.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.713+0000 7fa8c7d1d700 1 --2- 172.21.15.49:0/2941010452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8c0098d10 0x7fa8c0165390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:47.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.713+0000 7fa8c7d1d700 1 --2- 172.21.15.49:0/2941010452 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8c00c6190 0x7fa8c00c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:47.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.713+0000 7fa8c7d1d700 1 -- 172.21.15.49:0/2941010452 >> 172.21.15.49:0/2941010452 conn(0x7fa8c00cb310 msgr2=0x7fa8c0153ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:47.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.713+0000 7fa8c7d1d700 1 -- 172.21.15.49:0/2941010452 shutdown_connections 2023-11-30T18:22:47.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.713+0000 7fa8c7d1d700 1 -- 172.21.15.49:0/2941010452 wait complete. 2023-11-30T18:22:47.730 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-11-30T18:22:47.856 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:47.855+0000 7fbf7d688680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T18:22:47.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.856+0000 7f94f2007700 1 Processor -- start 2023-11-30T18:22:47.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.857+0000 7f94f2007700 1 -- start start 2023-11-30T18:22:47.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.857+0000 7f94f2007700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94ec1547f0 0x7f94ec0a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:47.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.857+0000 7f94f2007700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f94ec0c86f0 0x7f94ec0c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:47.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.857+0000 7f94f2007700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ec0c7e30 con 0x7f94ec062700 2023-11-30T18:22:47.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.857+0000 7f94f2007700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94ec0bcf40 con 0x7f94ec0c86f0 2023-11-30T18:22:47.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.858+0000 7f94f2007700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec0c6b20 con 0x7f94ec1547f0 2023-11-30T18:22:47.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.858+0000 7f94e2ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f94ec0c86f0 0x7f94ec0c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:47.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.858+0000 7f94eb7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94ec1547f0 0x7f94ec0a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:47.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.858+0000 7f94e2ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f94ec0c86f0 0x7f94ec0c6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:60060/0 (socket says 172.21.15.49:60060) 2023-11-30T18:22:47.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.858+0000 7f94ebfff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f94ec062700 0x7f94ec0a4db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:47558/0 (socket says 172.21.15.49:47558) 2023-11-30T18:22:47.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.858+0000 7f94e2ffd700 1 -- 172.21.15.49:0/494773576 learned_addr learned my addr 172.21.15.49:0/494773576 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:47.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.858+0000 7f94e2ffd700 1 -- 172.21.15.49:0/494773576 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94ec1547f0 msgr2=0x7f94ec0a72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:47.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.858+0000 7f94e2ffd700 1 --2- 172.21.15.49:0/494773576 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94ec1547f0 0x7f94ec0a72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:47.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.858+0000 7f94e2ffd700 1 -- 172.21.15.49:0/494773576 >> v1:172.21.15.115:6789/0 conn(0x7f94ec062700 legacy=0x7f94ec0a4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:47.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.858+0000 7f94eaffd700 1 -- 172.21.15.49:0/494773576 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1852403746 0 0) 0x7f94ec0c7e30 con 0x7f94ec062700 2023-11-30T18:22:47.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.858+0000 7f94e2ffd700 1 -- 172.21.15.49:0/494773576 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec0a77d0 con 0x7f94ec0c86f0 2023-11-30T18:22:47.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.858+0000 7f94eb7fe700 1 --2- 172.21.15.49:0/494773576 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94ec1547f0 0x7f94ec0a72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:22:47.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.858+0000 7f94e2ffd700 1 --2- 172.21.15.49:0/494773576 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94ec0c86f0 0x7f94ec0c6fb0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f94d4006fd0 tx=0x7f94d40090f0).ready entity=mon.1 client_cookie=7930c440fc87c258 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:47.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.858+0000 7f94eaffd700 1 -- 172.21.15.49:0/494773576 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d400b580 con 0x7f94ec0c86f0 2023-11-30T18:22:47.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.859+0000 7f94eaffd700 1 -- 172.21.15.49:0/494773576 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d400b6e0 con 0x7f94ec0c86f0 2023-11-30T18:22:47.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.859+0000 7f94eaffd700 1 -- 172.21.15.49:0/494773576 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d400ba80 con 0x7f94ec0c86f0 2023-11-30T18:22:47.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.859+0000 7f94f2007700 1 -- 172.21.15.49:0/494773576 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94ec0c86f0 msgr2=0x7f94ec0c6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:47.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.859+0000 7f94f2007700 1 --2- 172.21.15.49:0/494773576 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94ec0c86f0 0x7f94ec0c6fb0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f94d4006fd0 tx=0x7f94d40090f0).stop 2023-11-30T18:22:47.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.859+0000 7f94f2007700 1 -- 172.21.15.49:0/494773576 shutdown_connections 2023-11-30T18:22:47.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.859+0000 7f94f2007700 1 --2- 172.21.15.49:0/494773576 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94ec1547f0 0x7f94ec0a72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:47.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.859+0000 7f94f2007700 1 --2- 172.21.15.49:0/494773576 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94ec0c86f0 0x7f94ec0c6fb0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:47.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.859+0000 7f94f2007700 1 -- 172.21.15.49:0/494773576 >> 172.21.15.49:0/494773576 conn(0x7f94ec0642d0 msgr2=0x7f94ec0c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:47.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.859+0000 7f94f2007700 1 -- 172.21.15.49:0/494773576 shutdown_connections 2023-11-30T18:22:47.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.859+0000 7f94f2007700 1 -- 172.21.15.49:0/494773576 wait complete. 2023-11-30T18:22:47.864 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:47.860+0000 7f4bd7576680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T18:22:47.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.860+0000 7f94f2007700 1 Processor -- start 2023-11-30T18:22:47.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.860+0000 7f94f2007700 1 -- start start 2023-11-30T18:22:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.861+0000 7f94f2007700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94ec062700 0x7f94ec0c0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.861+0000 7f94f2007700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94ec0c86f0 0x7f94ec153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.861+0000 7f94f2007700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94ec1547f0 0x7f94ec14c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.861+0000 7f94f2007700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec14cd50 con 0x7f94ec1547f0 2023-11-30T18:22:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.861+0000 7f94f2007700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec0bfdd0 con 0x7f94ec0c86f0 2023-11-30T18:22:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.861+0000 7f94f2007700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec14d700 con 0x7f94ec062700 2023-11-30T18:22:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.861+0000 7f94ebfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94ec1547f0 0x7f94ec14c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.861+0000 7f94ebfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94ec1547f0 0x7f94ec14c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37070/0 (socket says 172.21.15.49:37070) 2023-11-30T18:22:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.861+0000 7f94ebfff700 1 -- 172.21.15.49:0/3331742367 learned_addr learned my addr 172.21.15.49:0/3331742367 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.861+0000 7f94e2ffd700 1 --2- 172.21.15.49:0/3331742367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94ec0c86f0 0x7f94ec153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.861+0000 7f94eb7fe700 1 --2- 172.21.15.49:0/3331742367 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94ec062700 0x7f94ec0c0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.862+0000 7f94ebfff700 1 -- 172.21.15.49:0/3331742367 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94ec062700 msgr2=0x7f94ec0c0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.862+0000 7f94ebfff700 1 --2- 172.21.15.49:0/3331742367 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94ec062700 0x7f94ec0c0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.862+0000 7f94ebfff700 1 -- 172.21.15.49:0/3331742367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94ec0c86f0 msgr2=0x7f94ec153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.862+0000 7f94ebfff700 1 --2- 172.21.15.49:0/3331742367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94ec0c86f0 0x7f94ec153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.862+0000 7f94ebfff700 1 -- 172.21.15.49:0/3331742367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94dc0092a0 con 0x7f94ec1547f0 2023-11-30T18:22:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.862+0000 7f94e2ffd700 1 --2- 172.21.15.49:0/3331742367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94ec0c86f0 0x7f94ec153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:22:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.862+0000 7f94ebfff700 1 --2- 172.21.15.49:0/3331742367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94ec1547f0 0x7f94ec14c860 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7f94e400c7e0 tx=0x7f94e4007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.862+0000 7f94e3fff700 1 -- 172.21.15.49:0/3331742367 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e4005c70 con 0x7f94ec1547f0 2023-11-30T18:22:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.862+0000 7f94e3fff700 1 -- 172.21.15.49:0/3331742367 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e4005dd0 con 0x7f94ec1547f0 2023-11-30T18:22:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.862+0000 7f94f2007700 1 -- 172.21.15.49:0/3331742367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d4009370 con 0x7f94ec1547f0 2023-11-30T18:22:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.862+0000 7f94e3fff700 1 -- 172.21.15.49:0/3331742367 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e4007320 con 0x7f94ec1547f0 2023-11-30T18:22:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.862+0000 7f94f2007700 1 -- 172.21.15.49:0/3331742367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94ec0bf4a0 con 0x7f94ec1547f0 2023-11-30T18:22:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.863+0000 7f94f2007700 1 -- 172.21.15.49:0/3331742367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94ec06c860 con 0x7f94ec1547f0 2023-11-30T18:22:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.863+0000 7f94e3fff700 1 -- 172.21.15.49:0/3331742367 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 69) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f94e40076d0 con 0x7f94ec1547f0 2023-11-30T18:22:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.864+0000 7f94e3fff700 1 --2- 172.21.15.49:0/3331742367 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f94cc05f2f0 0x7f94cc0617b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.864+0000 7f94e3fff700 1 -- 172.21.15.49:0/3331742367 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f94e407a3d0 con 0x7f94ec1547f0 2023-11-30T18:22:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.864+0000 7f94eb7fe700 1 -- 172.21.15.49:0/3331742367 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f94cc05f2f0 msgr2=0x7f94cc0617b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.864+0000 7f94eb7fe700 1 --2- 172.21.15.49:0/3331742367 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f94cc05f2f0 0x7f94cc0617b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:22:47.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:47.868+0000 7f94e3fff700 1 -- 172.21.15.49:0/3331742367 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f94e404b4e0 con 0x7f94ec1547f0 2023-11-30T18:22:47.920 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:47.919+0000 7fbf7d688680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T18:22:47.929 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:47.927+0000 7f4bd7576680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T18:22:48.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.046+0000 7f94f2007700 1 -- 172.21.15.49:0/3331742367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f94ec065290 con 0x7f94ec1547f0 2023-11-30T18:22:48.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.049+0000 7f94e3fff700 1 -- 172.21.15.49:0/3331742367 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v31)=0 v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7f94e404eb00 con 0x7f94ec1547f0 2023-11-30T18:22:48.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.051+0000 7f94f2007700 1 -- 172.21.15.49:0/3331742367 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f94cc05f2f0 msgr2=0x7f94cc0617b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:22:48.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.051+0000 7f94f2007700 1 --2- 172.21.15.49:0/3331742367 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f94cc05f2f0 0x7f94cc0617b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:48.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.051+0000 7f94f2007700 1 -- 172.21.15.49:0/3331742367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94ec1547f0 msgr2=0x7f94ec14c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:48.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.051+0000 7f94f2007700 1 --2- 172.21.15.49:0/3331742367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94ec1547f0 0x7f94ec14c860 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7f94e400c7e0 tx=0x7f94e4007f60).stop 2023-11-30T18:22:48.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.051+0000 7f94f2007700 1 -- 172.21.15.49:0/3331742367 shutdown_connections 2023-11-30T18:22:48.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.051+0000 7f94f2007700 1 --2- 172.21.15.49:0/3331742367 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f94cc05f2f0 0x7f94cc0617b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:48.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.051+0000 7f94f2007700 1 --2- 172.21.15.49:0/3331742367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94ec1547f0 0x7f94ec14c860 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:48.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.051+0000 7f94f2007700 1 --2- 172.21.15.49:0/3331742367 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94ec062700 0x7f94ec0c0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:48.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.051+0000 7f94f2007700 1 --2- 172.21.15.49:0/3331742367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94ec0c86f0 0x7f94ec153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:48.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.051+0000 7f94f2007700 1 -- 172.21.15.49:0/3331742367 >> 172.21.15.49:0/3331742367 conn(0x7f94ec0642d0 msgr2=0x7f94ec14dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:48.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.051+0000 7f94f2007700 1 -- 172.21.15.49:0/3331742367 shutdown_connections 2023-11-30T18:22:48.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.051+0000 7f94f2007700 1 -- 172.21.15.49:0/3331742367 wait complete. 2023-11-30T18:22:48.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:48.066 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-11-30T18:22:48.086 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1h 2023-11-30T18:22:48.195 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:48.194+0000 7fbf7d688680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T18:22:48.220 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:48.218+0000 7f4bd7576680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T18:22:48.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.249+0000 7fb634e16700 1 Processor -- start 2023-11-30T18:22:48.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.249+0000 7fb634e16700 1 -- start start 2023-11-30T18:22:48.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.250+0000 7fb634e16700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb63014eb50 0x7fb6300bcb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:48.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.250+0000 7fb634e16700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb6300c2b90 0x7fb630062700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:48.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.250+0000 7fb634e16700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6300bdd50 con 0x7fb630155430 2023-11-30T18:22:48.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.250+0000 7fb634e16700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb63014ef30 con 0x7fb6300c2b90 2023-11-30T18:22:48.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.250+0000 7fb634e16700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6300bd140 con 0x7fb63014eb50 2023-11-30T18:22:48.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.250+0000 7fb62f7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb63014eb50 0x7fb6300bcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:48.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.250+0000 7fb62ffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb6300c2b90 0x7fb630062700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:48.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.250+0000 7fb62effd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fb630155430 0x7fb6300c2480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:47568/0 (socket says 172.21.15.49:47568) 2023-11-30T18:22:48.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.250+0000 7fb62effd700 1 -- 172.21.15.49:0/3461471116 learned_addr learned my addr 172.21.15.49:0/3461471116 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:22:48.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.251+0000 7fb62e7fc700 1 -- 172.21.15.49:0/3461471116 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1984154142 0 0) 0x7fb6300bdd50 con 0x7fb630155430 2023-11-30T18:22:48.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.251+0000 7fb62e7fc700 1 -- 172.21.15.49:0/3461471116 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6180033f0 con 0x7fb630155430 2023-11-30T18:22:48.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.251+0000 7fb62ffff700 1 -- 172.21.15.49:0/3461471116 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb63014eb50 msgr2=0x7fb6300bcb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:48.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.251+0000 7fb62ffff700 1 --2- 172.21.15.49:0/3461471116 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb63014eb50 0x7fb6300bcb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:48.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.251+0000 7fb62ffff700 1 -- 172.21.15.49:0/3461471116 >> v1:172.21.15.115:6789/0 conn(0x7fb630155430 legacy=0x7fb6300c2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:48.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.251+0000 7fb62ffff700 1 -- 172.21.15.49:0/3461471116 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6300bd420 con 0x7fb6300c2b90 2023-11-30T18:22:48.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.251+0000 7fb62f7fe700 1 --2- 172.21.15.49:0/3461471116 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb63014eb50 0x7fb6300bcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:22:48.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.251+0000 7fb62ffff700 1 --2- 172.21.15.49:0/3461471116 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6300c2b90 0x7fb630062700 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7fb628009e60 tx=0x7fb628009780).ready entity=mon.1 client_cookie=dd397ee3de90cd51 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:48.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.251+0000 7fb62e7fc700 1 -- 172.21.15.49:0/3461471116 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62800e070 con 0x7fb6300c2b90 2023-11-30T18:22:48.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.251+0000 7fb62e7fc700 1 -- 172.21.15.49:0/3461471116 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62800bab0 con 0x7fb6300c2b90 2023-11-30T18:22:48.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.251+0000 7fb62e7fc700 1 -- 172.21.15.49:0/3461471116 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62800be30 con 0x7fb6300c2b90 2023-11-30T18:22:48.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.252+0000 7fb634e16700 1 -- 172.21.15.49:0/3461471116 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6300c2b90 msgr2=0x7fb630062700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:48.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.252+0000 7fb634e16700 1 --2- 172.21.15.49:0/3461471116 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6300c2b90 0x7fb630062700 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7fb628009e60 tx=0x7fb628009780).stop 2023-11-30T18:22:48.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.252+0000 7fb634e16700 1 -- 172.21.15.49:0/3461471116 shutdown_connections 2023-11-30T18:22:48.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.252+0000 7fb634e16700 1 --2- 172.21.15.49:0/3461471116 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb63014eb50 0x7fb6300bcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:48.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.252+0000 7fb634e16700 1 --2- 172.21.15.49:0/3461471116 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6300c2b90 0x7fb630062700 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:48.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.252+0000 7fb634e16700 1 -- 172.21.15.49:0/3461471116 >> 172.21.15.49:0/3461471116 conn(0x7fb6300c3f40 msgr2=0x7fb6300c4350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:48.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.252+0000 7fb634e16700 1 -- 172.21.15.49:0/3461471116 shutdown_connections 2023-11-30T18:22:48.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.252+0000 7fb634e16700 1 -- 172.21.15.49:0/3461471116 wait complete. 2023-11-30T18:22:48.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.253+0000 7fb634e16700 1 Processor -- start 2023-11-30T18:22:48.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.253+0000 7fb634e16700 1 -- start start 2023-11-30T18:22:48.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.254+0000 7fb634e16700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6300c2b90 0x7fb63014e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:48.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.254+0000 7fb634e16700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb63014eb50 0x7fb6300ab090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:48.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.254+0000 7fb634e16700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb630155430 0x7fb630153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:48.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.254+0000 7fb634e16700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6300aac00 con 0x7fb63014eb50 2023-11-30T18:22:48.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.254+0000 7fb634e16700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6300aa5f0 con 0x7fb6300c2b90 2023-11-30T18:22:48.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.254+0000 7fb634e16700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6300ad080 con 0x7fb630155430 2023-11-30T18:22:48.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.254+0000 7fb62f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6300c2b90 0x7fb63014e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:48.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.254+0000 7fb62effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb63014eb50 0x7fb6300ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:48.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.254+0000 7fb62f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6300c2b90 0x7fb63014e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:60096/0 (socket says 172.21.15.49:60096) 2023-11-30T18:22:48.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.254+0000 7fb62f7fe700 1 -- 172.21.15.49:0/3698545368 learned_addr learned my addr 172.21.15.49:0/3698545368 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:48.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.254+0000 7fb62effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb63014eb50 0x7fb6300ab090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37080/0 (socket says 172.21.15.49:37080) 2023-11-30T18:22:48.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.254+0000 7fb62ffff700 1 --2- 172.21.15.49:0/3698545368 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb630155430 0x7fb630153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:48.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.254+0000 7fb62f7fe700 1 -- 172.21.15.49:0/3698545368 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb630155430 msgr2=0x7fb630153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:48.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.254+0000 7fb62f7fe700 1 --2- 172.21.15.49:0/3698545368 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb630155430 0x7fb630153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:48.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.254+0000 7fb62f7fe700 1 -- 172.21.15.49:0/3698545368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb63014eb50 msgr2=0x7fb6300ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:48.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.254+0000 7fb62f7fe700 1 --2- 172.21.15.49:0/3698545368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb63014eb50 0x7fb6300ab090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:48.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.254+0000 7fb62f7fe700 1 -- 172.21.15.49:0/3698545368 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6200092a0 con 0x7fb6300c2b90 2023-11-30T18:22:48.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.254+0000 7fb62f7fe700 1 --2- 172.21.15.49:0/3698545368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6300c2b90 0x7fb63014e010 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7fb62000ea20 tx=0x7fb620009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:48.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.255+0000 7fb6177fe700 1 -- 172.21.15.49:0/3698545368 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62000ee60 con 0x7fb6300c2b90 2023-11-30T18:22:48.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.255+0000 7fb6177fe700 1 -- 172.21.15.49:0/3698545368 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62000c850 con 0x7fb6300c2b90 2023-11-30T18:22:48.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.255+0000 7fb634e16700 1 -- 172.21.15.49:0/3698545368 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb628009a20 con 0x7fb6300c2b90 2023-11-30T18:22:48.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.255+0000 7fb6177fe700 1 -- 172.21.15.49:0/3698545368 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62000cbd0 con 0x7fb6300c2b90 2023-11-30T18:22:48.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.255+0000 7fb634e16700 1 -- 172.21.15.49:0/3698545368 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6300aa890 con 0x7fb6300c2b90 2023-11-30T18:22:48.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.256+0000 7fb634e16700 1 -- 172.21.15.49:0/3698545368 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6300aaee0 con 0x7fb6300c2b90 2023-11-30T18:22:48.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.256+0000 7fb6177fe700 1 -- 172.21.15.49:0/3698545368 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 69) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fb62001b400 con 0x7fb6300c2b90 2023-11-30T18:22:48.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.256+0000 7fb6177fe700 1 --2- 172.21.15.49:0/3698545368 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb61c05f2c0 0x7fb61c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:48.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.256+0000 7fb6177fe700 1 -- 172.21.15.49:0/3698545368 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fb62007a950 con 0x7fb6300c2b90 2023-11-30T18:22:48.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.256+0000 7fb62effd700 1 -- 172.21.15.49:0/3698545368 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb61c05f2c0 msgr2=0x7fb61c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:48.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.256+0000 7fb62effd700 1 --2- 172.21.15.49:0/3698545368 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb61c05f2c0 0x7fb61c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:22:48.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.261+0000 7fb6177fe700 1 -- 172.21.15.49:0/3698545368 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb62004bab0 con 0x7fb6300c2b90 2023-11-30T18:22:48.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.457+0000 7fb62effd700 1 -- 172.21.15.49:0/3698545368 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb61c05f2c0 msgr2=0x7fb61c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:48.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.457+0000 7fb62effd700 1 --2- 172.21.15.49:0/3698545368 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb61c05f2c0 0x7fb61c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T18:22:48.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.462+0000 7fb634e16700 1 -- 172.21.15.49:0/3698545368 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7fb63006c7c0 con 0x7fb61c05f2c0 2023-11-30T18:22:48.814 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:48.810+0000 7fbf7d688680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T18:22:48.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.858+0000 7fb62effd700 1 -- 172.21.15.49:0/3698545368 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb61c05f2c0 msgr2=0x7fb61c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:48.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:48.858+0000 7fb62effd700 1 --2- 172.21.15.49:0/3698545368 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb61c05f2c0 0x7fb61c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-11-30T18:22:48.883 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:48.882+0000 7fbf7d688680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T18:22:48.888 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:48.887+0000 7f4bd7576680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T18:22:48.958 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:48.956+0000 7f4bd7576680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T18:22:49.070 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:49.069+0000 7fbf7d688680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T18:22:49.152 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:49.150+0000 7f4bd7576680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T18:22:49.489 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:49.488+0000 7fbf7d688680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T18:22:49.590 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:49.588+0000 7f4bd7576680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T18:22:49.592 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:49.591+0000 7fbf7d688680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:22:49.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:49.659+0000 7fb62effd700 1 -- 172.21.15.49:0/3698545368 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb61c05f2c0 msgr2=0x7fb61c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:49.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:49.659+0000 7fb62effd700 1 --2- 172.21.15.49:0/3698545368 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb61c05f2c0 0x7fb61c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-11-30T18:22:49.699 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:49.697+0000 7f4bd7576680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:22:49.775 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:49.743+0000 7fbf7d688680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T18:22:49.818 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:49.817+0000 7fbf7d688680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T18:22:49.857 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:49.855+0000 7f4bd7576680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T18:22:49.885 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:49.884+0000 7fbf7d688680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T18:22:49.935 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:49.933+0000 7f4bd7576680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T18:22:50.005 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:50.004+0000 7f4bd7576680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T18:22:50.142 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:50.141+0000 7fbf7d688680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T18:22:50.277 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:50.275+0000 7f4bd7576680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T18:22:50.324 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:50.323+0000 7fbf7d688680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T18:22:50.466 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:50.465+0000 7f4bd7576680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T18:22:50.970 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:50.970+0000 7fbf7d688680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T18:22:51.039 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:51.038+0000 7fbf7d688680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T18:22:51.114 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:51.114+0000 7fbf7d688680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T18:22:51.148 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:51.146+0000 7f4bd7576680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T18:22:51.219 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:51.218+0000 7f4bd7576680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T18:22:51.262 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:51.261+0000 7fbf7d688680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T18:22:51.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:51.261+0000 7fb62effd700 1 -- 172.21.15.49:0/3698545368 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb61c05f2c0 msgr2=0x7fb61c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:51.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:51.261+0000 7fb62effd700 1 --2- 172.21.15.49:0/3698545368 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb61c05f2c0 0x7fb61c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-11-30T18:22:51.298 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:51.296+0000 7f4bd7576680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T18:22:51.332 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:51.332+0000 7fbf7d688680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T18:22:51.447 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:51.447+0000 7fbf7d688680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T18:22:51.451 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:51.449+0000 7f4bd7576680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T18:22:51.524 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:51.523+0000 7f4bd7576680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T18:22:51.556 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:51.555+0000 7fbf7d688680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:22:51.644 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:51.643+0000 7f4bd7576680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T18:22:51.757 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:51.756+0000 7f4bd7576680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:22:51.844 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:51.842+0000 7fbf7d688680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T18:22:51.914 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:51.914+0000 7fbf7d688680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T18:22:51.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:51.936+0000 7fb6177fe700 1 -- 172.21.15.49:0/3698545368 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mgrmap(e 70) v1 ==== 75287+0+0 (secure 0 0 0) 0x7fb620078560 con 0x7fb6300c2b90 2023-11-30T18:22:51.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:51.936+0000 7fb6177fe700 1 -- 172.21.15.49:0/3698545368 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb61c05f2c0 msgr2=0x7fb61c061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:22:51.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:51.936+0000 7fb6177fe700 1 --2- 172.21.15.49:0/3698545368 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb61c05f2c0 0x7fb61c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:52.002 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:52.001+0000 7fbef4613700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:22:52.003 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:52.001+0000 7fbef4613700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:22:52.003 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:52.001+0000 7fbef4613700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:22:52.003 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:52.001+0000 7fbef4613700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:22:52.003 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:52.001+0000 7fbef4613700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:22:52.003 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:52.001+0000 7fbef160d700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:22:52.003 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:52.001+0000 7fbef160d700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:22:52.003 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:52.001+0000 7fbef160d700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:22:52.003 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:52.001+0000 7fbef160d700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:22:52.003 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:52.001+0000 7fbef160d700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:22:52.070 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:52.068+0000 7f4bd7576680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T18:22:52.144 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:52.142+0000 7f4bd7576680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T18:22:52.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:52.937+0000 7fb6177fe700 1 -- 172.21.15.49:0/3698545368 <== mon.1 v2:172.21.15.115:3300/0 8 ==== mgrmap(e 71) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fb6200788e0 con 0x7fb6300c2b90 2023-11-30T18:22:52.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:52.937+0000 7fb6177fe700 1 --2- 172.21.15.49:0/3698545368 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb61c05f2c0 0x7fb61c061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:52.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:52.937+0000 7fb6177fe700 1 -- 172.21.15.49:0/3698545368 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7fb63006c7c0 con 0x7fb61c05f2c0 2023-11-30T18:22:52.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:52.938+0000 7fb62effd700 1 --2- 172.21.15.49:0/3698545368 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb61c05f2c0 0x7fb61c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:52.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:52.939+0000 7fb62effd700 1 --2- 172.21.15.49:0/3698545368 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb61c05f2c0 0x7fb61c061700 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fb624007fd0 tx=0x7fb624009040).ready entity=mgr.8425 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:52.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:52.946+0000 7fb6177fe700 1 -- 172.21.15.49:0/3698545368 <== mgr.8425 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb63006c7c0 con 0x7fb61c05f2c0 2023-11-30T18:22:52.947 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule set for path snap_test_dir1 2023-11-30T18:22:52.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:52.948+0000 7fb634e16700 1 -- 172.21.15.49:0/3698545368 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb61c05f2c0 msgr2=0x7fb61c061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:52.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:52.948+0000 7fb634e16700 1 --2- 172.21.15.49:0/3698545368 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb61c05f2c0 0x7fb61c061700 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fb624007fd0 tx=0x7fb624009040).stop 2023-11-30T18:22:52.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:52.948+0000 7fb634e16700 1 -- 172.21.15.49:0/3698545368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6300c2b90 msgr2=0x7fb63014e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:52.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:52.948+0000 7fb634e16700 1 --2- 172.21.15.49:0/3698545368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6300c2b90 0x7fb63014e010 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7fb62000ea20 tx=0x7fb620009060).stop 2023-11-30T18:22:52.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:52.948+0000 7fb634e16700 1 -- 172.21.15.49:0/3698545368 shutdown_connections 2023-11-30T18:22:52.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:52.948+0000 7fb634e16700 1 --2- 172.21.15.49:0/3698545368 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb630155430 0x7fb630153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:52.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:52.948+0000 7fb634e16700 1 --2- 172.21.15.49:0/3698545368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6300c2b90 0x7fb63014e010 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:52.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:52.948+0000 7fb634e16700 1 --2- 172.21.15.49:0/3698545368 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb61c05f2c0 0x7fb61c061700 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:52.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:52.948+0000 7fb634e16700 1 --2- 172.21.15.49:0/3698545368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb63014eb50 0x7fb6300ab090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:52.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:52.948+0000 7fb634e16700 1 -- 172.21.15.49:0/3698545368 >> 172.21.15.49:0/3698545368 conn(0x7fb6300c3f40 msgr2=0x7fb630063000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:52.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:52.948+0000 7fb634e16700 1 -- 172.21.15.49:0/3698545368 shutdown_connections 2023-11-30T18:22:52.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:52.948+0000 7fb634e16700 1 -- 172.21.15.49:0/3698545368 wait complete. 2023-11-30T18:22:52.965 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-11-30T18:22:52.965 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-11-30T18:22:53.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.092+0000 7fc7fc434700 1 Processor -- start 2023-11-30T18:22:53.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.092+0000 7fc7fc434700 1 -- start start 2023-11-30T18:22:53.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.093+0000 7fc7fc434700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc7f40bcd70 0x7fc7f414ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:53.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.093+0000 7fc7fc434700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc7f4062770 0x7fc7f4062be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:53.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.093+0000 7fc7fc434700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f40634e0 con 0x7fc7f414ea80 2023-11-30T18:22:53.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.093+0000 7fc7fc434700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f40640f0 con 0x7fc7f4062770 2023-11-30T18:22:53.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.093+0000 7fc7fc434700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f40637c0 con 0x7fc7f40bcd70 2023-11-30T18:22:53.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.093+0000 7fc7fa9d1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc7f4062770 0x7fc7f4062be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:53.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.093+0000 7fc7fa9d1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc7f4062770 0x7fc7f4062be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55164/0 (socket says 172.21.15.49:55164) 2023-11-30T18:22:53.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.093+0000 7fc7fa9d1700 1 -- 172.21.15.49:0/2409825634 learned_addr learned my addr 172.21.15.49:0/2409825634 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:53.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.093+0000 7fc7f99cf700 1 --2- 172.21.15.49:0/2409825634 >> v2:172.21.15.115:3300/0 conn(0x7fc7f40bcd70 0x7fc7f414ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:53.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.093+0000 7fc7fa9d1700 1 -- 172.21.15.49:0/2409825634 >> v2:172.21.15.115:3300/0 conn(0x7fc7f40bcd70 msgr2=0x7fc7f414ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:53.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.093+0000 7fc7fa9d1700 1 --2- 172.21.15.49:0/2409825634 >> v2:172.21.15.115:3300/0 conn(0x7fc7f40bcd70 0x7fc7f414ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:53.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.093+0000 7fc7fa9d1700 1 -- 172.21.15.49:0/2409825634 >> v1:172.21.15.115:6789/0 conn(0x7fc7f414ea80 legacy=0x7fc7f40bc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:53.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.093+0000 7fc7fa9d1700 1 -- 172.21.15.49:0/2409825634 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f4063aa0 con 0x7fc7f4062770 2023-11-30T18:22:53.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.094+0000 7fc7fa9d1700 1 --2- 172.21.15.49:0/2409825634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7f4062770 0x7fc7f4062be0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7fc7f413e4a0 tx=0x7fc7e4009840).ready entity=mon.0 client_cookie=9d3e749ee9bd7fcc server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:53.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.094+0000 7fc7f91ce700 1 -- 172.21.15.49:0/2409825634 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e400e070 con 0x7fc7f4062770 2023-11-30T18:22:53.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.094+0000 7fc7f91ce700 1 -- 172.21.15.49:0/2409825634 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e400ba50 con 0x7fc7f4062770 2023-11-30T18:22:53.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.094+0000 7fc7f91ce700 1 -- 172.21.15.49:0/2409825634 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e400bdd0 con 0x7fc7f4062770 2023-11-30T18:22:53.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.094+0000 7fc7fc434700 1 -- 172.21.15.49:0/2409825634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7f4062770 msgr2=0x7fc7f4062be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:53.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.094+0000 7fc7fc434700 1 --2- 172.21.15.49:0/2409825634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7f4062770 0x7fc7f4062be0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7fc7f413e4a0 tx=0x7fc7e4009840).stop 2023-11-30T18:22:53.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.094+0000 7fc7fc434700 1 -- 172.21.15.49:0/2409825634 shutdown_connections 2023-11-30T18:22:53.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.094+0000 7fc7fc434700 1 --2- 172.21.15.49:0/2409825634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7f4062770 0x7fc7f4062be0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:53.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.094+0000 7fc7fc434700 1 --2- 172.21.15.49:0/2409825634 >> v2:172.21.15.115:3300/0 conn(0x7fc7f40bcd70 0x7fc7f414ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:53.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.094+0000 7fc7fc434700 1 -- 172.21.15.49:0/2409825634 >> 172.21.15.49:0/2409825634 conn(0x7fc7f40c8170 msgr2=0x7fc7f40c41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:53.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.094+0000 7fc7fc434700 1 -- 172.21.15.49:0/2409825634 shutdown_connections 2023-11-30T18:22:53.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.094+0000 7fc7fc434700 1 -- 172.21.15.49:0/2409825634 wait complete. 2023-11-30T18:22:53.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.096+0000 7fc7fc434700 1 Processor -- start 2023-11-30T18:22:53.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.096+0000 7fc7fc434700 1 -- start start 2023-11-30T18:22:53.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.096+0000 7fc7fc434700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7f4062770 0x7fc7f4135280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:53.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.096+0000 7fc7fc434700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7f40bcd70 0x7fc7f413a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:53.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.096+0000 7fc7fc434700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7f414ea80 0x7fc7f413a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:53.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.096+0000 7fc7fc434700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f413ac70 con 0x7fc7f414ea80 2023-11-30T18:22:53.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.096+0000 7fc7fc434700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f40a73a0 con 0x7fc7f4062770 2023-11-30T18:22:53.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.096+0000 7fc7fc434700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f4169120 con 0x7fc7f40bcd70 2023-11-30T18:22:53.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.097+0000 7fc7fa9d1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7f414ea80 0x7fc7f413a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:53.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.097+0000 7fc7fa9d1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7f414ea80 0x7fc7f413a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55168/0 (socket says 172.21.15.49:55168) 2023-11-30T18:22:53.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.097+0000 7fc7fa9d1700 1 -- 172.21.15.49:0/2745215077 learned_addr learned my addr 172.21.15.49:0/2745215077 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:53.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.097+0000 7fc7fa1d0700 1 --2- 172.21.15.49:0/2745215077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7f4062770 0x7fc7f4135280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:53.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.097+0000 7fc7f99cf700 1 --2- 172.21.15.49:0/2745215077 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7f40bcd70 0x7fc7f413a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:53.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.097+0000 7fc7fa9d1700 1 -- 172.21.15.49:0/2745215077 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7f40bcd70 msgr2=0x7fc7f413a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:53.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.097+0000 7fc7fa9d1700 1 --2- 172.21.15.49:0/2745215077 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7f40bcd70 0x7fc7f413a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:53.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.097+0000 7fc7fa9d1700 1 -- 172.21.15.49:0/2745215077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7f4062770 msgr2=0x7fc7f4135280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:53.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.097+0000 7fc7fa9d1700 1 --2- 172.21.15.49:0/2745215077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7f4062770 0x7fc7f4135280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:53.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.097+0000 7fc7fa9d1700 1 -- 172.21.15.49:0/2745215077 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e4009ae0 con 0x7fc7f414ea80 2023-11-30T18:22:53.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.097+0000 7fc7fa1d0700 1 --2- 172.21.15.49:0/2745215077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7f4062770 0x7fc7f4135280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:22:53.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.097+0000 7fc7fa9d1700 1 --2- 172.21.15.49:0/2745215077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7f414ea80 0x7fc7f413a780 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7fc7e4009fd0 tx=0x7fc7f4064060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:53.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.097+0000 7fc7f27fc700 1 -- 172.21.15.49:0/2745215077 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e40092e0 con 0x7fc7f414ea80 2023-11-30T18:22:53.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.097+0000 7fc7f27fc700 1 -- 172.21.15.49:0/2745215077 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e401e470 con 0x7fc7f414ea80 2023-11-30T18:22:53.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.097+0000 7fc7fc434700 1 -- 172.21.15.49:0/2745215077 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f413ba00 con 0x7fc7f414ea80 2023-11-30T18:22:53.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.097+0000 7fc7f27fc700 1 -- 172.21.15.49:0/2745215077 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e401e810 con 0x7fc7f414ea80 2023-11-30T18:22:53.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.097+0000 7fc7fc434700 1 -- 172.21.15.49:0/2745215077 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f413b3b0 con 0x7fc7f414ea80 2023-11-30T18:22:53.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.098+0000 7fc7fc434700 1 -- 172.21.15.49:0/2745215077 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f413bb90 con 0x7fc7f414ea80 2023-11-30T18:22:53.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.098+0000 7fc7f27fc700 1 -- 172.21.15.49:0/2745215077 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 71) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fc7e4003040 con 0x7fc7f414ea80 2023-11-30T18:22:53.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.099+0000 7fc7f27fc700 1 --2- 172.21.15.49:0/2745215077 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc7e005f080 0x7fc7e0061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:53.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.099+0000 7fc7f27fc700 1 -- 172.21.15.49:0/2745215077 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6435+0+0 (secure 0 0 0) 0x7fc7e407b670 con 0x7fc7f414ea80 2023-11-30T18:22:53.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.099+0000 7fc7fa1d0700 1 --2- 172.21.15.49:0/2745215077 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc7e005f080 0x7fc7e0061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:53.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.099+0000 7fc7fa1d0700 1 --2- 172.21.15.49:0/2745215077 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc7e005f080 0x7fc7e0061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fc7ec000c00 tx=0x7fc7ec009040).ready entity=mgr.8425 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:53.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.103+0000 7fc7f27fc700 1 -- 172.21.15.49:0/2745215077 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc7e404c9d0 con 0x7fc7f414ea80 2023-11-30T18:22:53.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.301+0000 7fc7fc434700 1 -- 172.21.15.49:0/2745215077 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7f4063d80 con 0x7fc7e005f080 2023-11-30T18:22:53.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.304+0000 7fc7f27fc700 1 -- 172.21.15.49:0/2745215077 <== mgr.8425 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fc7f4063d80 con 0x7fc7e005f080 2023-11-30T18:22:53.306 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule removed for path snap_test_dir1 2023-11-30T18:22:53.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.306+0000 7fc7fc434700 1 -- 172.21.15.49:0/2745215077 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc7e005f080 msgr2=0x7fc7e0061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:53.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.306+0000 7fc7fc434700 1 --2- 172.21.15.49:0/2745215077 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc7e005f080 0x7fc7e0061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fc7ec000c00 tx=0x7fc7ec009040).stop 2023-11-30T18:22:53.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.306+0000 7fc7fc434700 1 -- 172.21.15.49:0/2745215077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7f414ea80 msgr2=0x7fc7f413a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:53.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.306+0000 7fc7fc434700 1 --2- 172.21.15.49:0/2745215077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7f414ea80 0x7fc7f413a780 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7fc7e4009fd0 tx=0x7fc7f4064060).stop 2023-11-30T18:22:53.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.306+0000 7fc7fc434700 1 -- 172.21.15.49:0/2745215077 shutdown_connections 2023-11-30T18:22:53.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.306+0000 7fc7fc434700 1 --2- 172.21.15.49:0/2745215077 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc7e005f080 0x7fc7e0061540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:53.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.306+0000 7fc7fc434700 1 --2- 172.21.15.49:0/2745215077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7f414ea80 0x7fc7f413a780 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:53.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.306+0000 7fc7fc434700 1 --2- 172.21.15.49:0/2745215077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7f4062770 0x7fc7f4135280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:53.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.306+0000 7fc7fc434700 1 --2- 172.21.15.49:0/2745215077 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7f40bcd70 0x7fc7f413a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:53.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.306+0000 7fc7fc434700 1 -- 172.21.15.49:0/2745215077 >> 172.21.15.49:0/2745215077 conn(0x7fc7f40c8170 msgr2=0x7fc7f4154510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:53.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.306+0000 7fc7fc434700 1 -- 172.21.15.49:0/2745215077 shutdown_connections 2023-11-30T18:22:53.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.306+0000 7fc7fc434700 1 -- 172.21.15.49:0/2745215077 wait complete. 2023-11-30T18:22:53.320 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-11-30T18:22:53.320 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-11-30T18:22:53.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.440+0000 7fef7eda2700 1 Processor -- start 2023-11-30T18:22:53.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.440+0000 7fef7eda2700 1 -- start start 2023-11-30T18:22:53.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.441+0000 7fef7eda2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fef78154530 0x7fef78154910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:53.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.441+0000 7fef7eda2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef780a7ff0 0x7fef780c8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:53.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.441+0000 7fef7eda2700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef780c6630 con 0x7fef780aa220 2023-11-30T18:22:53.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.441+0000 7fef7eda2700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef780c6390 con 0x7fef78154530 2023-11-30T18:22:53.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.441+0000 7fef7eda2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef780a8470 con 0x7fef780a7ff0 2023-11-30T18:22:53.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.441+0000 7fef7cb3e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fef78154530 0x7fef78154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:53.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.441+0000 7fef7cb3e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fef78154530 0x7fef78154910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55176/0 (socket says 172.21.15.49:55176) 2023-11-30T18:22:53.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.441+0000 7fef7cb3e700 1 -- 172.21.15.49:0/777885641 learned_addr learned my addr 172.21.15.49:0/777885641 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:53.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.441+0000 7fef77fff700 1 --2- 172.21.15.49:0/777885641 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef780a7ff0 0x7fef780c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:53.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.441+0000 7fef7cb3e700 1 -- 172.21.15.49:0/777885641 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef780a7ff0 msgr2=0x7fef780c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:53.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.442+0000 7fef7cb3e700 1 --2- 172.21.15.49:0/777885641 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef780a7ff0 0x7fef780c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:53.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.442+0000 7fef7cb3e700 1 -- 172.21.15.49:0/777885641 >> v1:172.21.15.115:6789/0 conn(0x7fef780aa220 legacy=0x7fef780c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:53.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.442+0000 7fef777fe700 1 -- 172.21.15.49:0/777885641 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858312100 0 0) 0x7fef780c6630 con 0x7fef780aa220 2023-11-30T18:22:53.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.442+0000 7fef7cb3e700 1 -- 172.21.15.49:0/777885641 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef78064230 con 0x7fef78154530 2023-11-30T18:22:53.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.442+0000 7fef7cb3e700 1 --2- 172.21.15.49:0/777885641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef78154530 0x7fef78154910 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7fef70009f70 tx=0x7fef70009840).ready entity=mon.0 client_cookie=7d186596a50b6b36 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:53.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.442+0000 7fef777fe700 1 -- 172.21.15.49:0/777885641 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7000e070 con 0x7fef78154530 2023-11-30T18:22:53.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.442+0000 7fef777fe700 1 -- 172.21.15.49:0/777885641 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7000ba20 con 0x7fef78154530 2023-11-30T18:22:53.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.442+0000 7fef777fe700 1 -- 172.21.15.49:0/777885641 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7000bda0 con 0x7fef78154530 2023-11-30T18:22:53.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.442+0000 7fef7eda2700 1 -- 172.21.15.49:0/777885641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef78154530 msgr2=0x7fef78154910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:53.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.442+0000 7fef7eda2700 1 --2- 172.21.15.49:0/777885641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef78154530 0x7fef78154910 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7fef70009f70 tx=0x7fef70009840).stop 2023-11-30T18:22:53.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.442+0000 7fef7eda2700 1 -- 172.21.15.49:0/777885641 shutdown_connections 2023-11-30T18:22:53.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.442+0000 7fef7eda2700 1 --2- 172.21.15.49:0/777885641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef78154530 0x7fef78154910 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:53.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.442+0000 7fef7eda2700 1 --2- 172.21.15.49:0/777885641 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef780a7ff0 0x7fef780c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:53.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.442+0000 7fef7eda2700 1 -- 172.21.15.49:0/777885641 >> 172.21.15.49:0/777885641 conn(0x7fef78094930 msgr2=0x7fef7806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:53.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.442+0000 7fef7eda2700 1 -- 172.21.15.49:0/777885641 shutdown_connections 2023-11-30T18:22:53.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.442+0000 7fef7eda2700 1 -- 172.21.15.49:0/777885641 wait complete. 2023-11-30T18:22:53.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.444+0000 7fef7eda2700 1 Processor -- start 2023-11-30T18:22:53.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.444+0000 7fef7eda2700 1 -- start start 2023-11-30T18:22:53.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.444+0000 7fef7eda2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef780a7ff0 0x7fef78165230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:53.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.444+0000 7fef7eda2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef780aa220 0x7fef780c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:53.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.444+0000 7fef7eda2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef78154530 0x7fef780ca000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:53.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.445+0000 7fef7eda2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef780c46b0 con 0x7fef780aa220 2023-11-30T18:22:53.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.445+0000 7fef7eda2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef78165720 con 0x7fef780a7ff0 2023-11-30T18:22:53.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.445+0000 7fef7eda2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef780c2740 con 0x7fef78154530 2023-11-30T18:22:53.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.445+0000 7fef77fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef780aa220 0x7fef780c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:53.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.445+0000 7fef77fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef780aa220 0x7fef780c4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55188/0 (socket says 172.21.15.49:55188) 2023-11-30T18:22:53.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.445+0000 7fef77fff700 1 -- 172.21.15.49:0/1905858041 learned_addr learned my addr 172.21.15.49:0/1905858041 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:53.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.445+0000 7fef7cb3e700 1 --2- 172.21.15.49:0/1905858041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef780a7ff0 0x7fef78165230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:53.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.445+0000 7fef7d33f700 1 --2- 172.21.15.49:0/1905858041 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef78154530 0x7fef780ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:53.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.445+0000 7fef77fff700 1 -- 172.21.15.49:0/1905858041 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef78154530 msgr2=0x7fef780ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:53.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.445+0000 7fef77fff700 1 --2- 172.21.15.49:0/1905858041 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef78154530 0x7fef780ca000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:53.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.445+0000 7fef77fff700 1 -- 172.21.15.49:0/1905858041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef780a7ff0 msgr2=0x7fef78165230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:53.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.445+0000 7fef77fff700 1 --2- 172.21.15.49:0/1905858041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef780a7ff0 0x7fef78165230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:53.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.445+0000 7fef77fff700 1 -- 172.21.15.49:0/1905858041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef70009ae0 con 0x7fef780aa220 2023-11-30T18:22:53.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.445+0000 7fef77fff700 1 --2- 172.21.15.49:0/1905858041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef780aa220 0x7fef780c4b40 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7fef6c00e900 tx=0x7fef6c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:53.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.445+0000 7fef74ff9700 1 -- 172.21.15.49:0/1905858041 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c012600 con 0x7fef780aa220 2023-11-30T18:22:53.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.445+0000 7fef74ff9700 1 -- 172.21.15.49:0/1905858041 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6c012760 con 0x7fef780aa220 2023-11-30T18:22:53.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.445+0000 7fef74ff9700 1 -- 172.21.15.49:0/1905858041 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c012ae0 con 0x7fef780aa220 2023-11-30T18:22:53.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.445+0000 7fef7eda2700 1 -- 172.21.15.49:0/1905858041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef780c2a20 con 0x7fef780aa220 2023-11-30T18:22:53.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.445+0000 7fef7eda2700 1 -- 172.21.15.49:0/1905858041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef780c4340 con 0x7fef780aa220 2023-11-30T18:22:53.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.446+0000 7fef7eda2700 1 -- 172.21.15.49:0/1905858041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef7806c860 con 0x7fef780aa220 2023-11-30T18:22:53.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.447+0000 7fef74ff9700 1 -- 172.21.15.49:0/1905858041 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 71) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fef6c01b400 con 0x7fef780aa220 2023-11-30T18:22:53.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.447+0000 7fef74ff9700 1 --2- 172.21.15.49:0/1905858041 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fef6405f080 0x7fef64061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:53.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.447+0000 7fef74ff9700 1 -- 172.21.15.49:0/1905858041 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6435+0+0 (secure 0 0 0) 0x7fef6c07a440 con 0x7fef780aa220 2023-11-30T18:22:53.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.447+0000 7fef7cb3e700 1 --2- 172.21.15.49:0/1905858041 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fef6405f080 0x7fef64061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:53.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.448+0000 7fef7cb3e700 1 --2- 172.21.15.49:0/1905858041 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fef6405f080 0x7fef64061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fef780abe70 tx=0x7fef70009840).ready entity=mgr.8425 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:53.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.452+0000 7fef74ff9700 1 -- 172.21.15.49:0/1905858041 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fef6c04b740 con 0x7fef780aa220 2023-11-30T18:22:53.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.649+0000 7fef7eda2700 1 -- 172.21.15.49:0/1905858041 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fef78064510 con 0x7fef6405f080 2023-11-30T18:22:53.652 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:53.652+0000 7fbefce24700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-11-30T18:22:53.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.652+0000 7fef74ff9700 1 -- 172.21.15.49:0/1905858041 <== mgr.8425 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7fef78064510 con 0x7fef6405f080 2023-11-30T18:22:53.654 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-11-30T18:22:53.657 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-11-30T18:22:53.658 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:53.658 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-11-30T18:22:53.675 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-11-30T18:22:53.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.832+0000 7f46463d8700 1 Processor -- start 2023-11-30T18:22:53.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.833+0000 7f46463d8700 1 -- start start 2023-11-30T18:22:53.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.833+0000 7f46463d8700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4640098d10 0x7f46400c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:53.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.833+0000 7f46463d8700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f46400c6190 0x7f4640063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:53.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.833+0000 7f46463d8700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46400c72d0 con 0x7f4640064350 2023-11-30T18:22:53.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.833+0000 7f46463d8700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4640154bc0 con 0x7f4640098d10 2023-11-30T18:22:53.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.833+0000 7f46463d8700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46400c66c0 con 0x7f46400c6190 2023-11-30T18:22:53.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.834+0000 7f463ffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4640098d10 0x7f46400c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:53.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.834+0000 7f4644975700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4640064350 0x7f4640158320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43400/0 (socket says 172.21.15.49:43400) 2023-11-30T18:22:53.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.834+0000 7f463ffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4640098d10 0x7f46400c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55202/0 (socket says 172.21.15.49:55202) 2023-11-30T18:22:53.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.834+0000 7f4644975700 1 -- 172.21.15.49:0/1697778860 learned_addr learned my addr 172.21.15.49:0/1697778860 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:22:53.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.834+0000 7f463f7fe700 1 --2- 172.21.15.49:0/1697778860 >> v2:172.21.15.115:3300/0 conn(0x7f46400c6190 0x7f4640063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:53.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.834+0000 7f463ffff700 1 -- 172.21.15.49:0/1697778860 >> v2:172.21.15.115:3300/0 conn(0x7f46400c6190 msgr2=0x7f4640063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:53.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.834+0000 7f463ffff700 1 --2- 172.21.15.49:0/1697778860 >> v2:172.21.15.115:3300/0 conn(0x7f46400c6190 0x7f4640063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:53.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.834+0000 7f463ffff700 1 -- 172.21.15.49:0/1697778860 >> v1:172.21.15.49:6789/0 conn(0x7f4640064350 legacy=0x7f4640158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:53.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.834+0000 7f463effd700 1 -- 172.21.15.49:0/1697778860 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 328664356 0 0) 0x7f46400c72d0 con 0x7f4640064350 2023-11-30T18:22:53.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.834+0000 7f463ffff700 1 -- 172.21.15.49:0/1697778860 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46400c69a0 con 0x7f4640098d10 2023-11-30T18:22:53.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.834+0000 7f463ffff700 1 --2- 172.21.15.49:0/1697778860 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4640098d10 0x7f46400c7760 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f46400c5b40 tx=0x7f4630009060).ready entity=mon.0 client_cookie=d8c17b3329fc6637 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:53.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.834+0000 7f463effd700 1 -- 172.21.15.49:0/1697778860 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463000b580 con 0x7f4640098d10 2023-11-30T18:22:53.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.834+0000 7f463effd700 1 -- 172.21.15.49:0/1697778860 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463000b6e0 con 0x7f4640098d10 2023-11-30T18:22:53.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.834+0000 7f463effd700 1 -- 172.21.15.49:0/1697778860 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463000ba60 con 0x7f4640098d10 2023-11-30T18:22:53.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.835+0000 7f46463d8700 1 -- 172.21.15.49:0/1697778860 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4640098d10 msgr2=0x7f46400c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:53.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.835+0000 7f46463d8700 1 --2- 172.21.15.49:0/1697778860 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4640098d10 0x7f46400c7760 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f46400c5b40 tx=0x7f4630009060).stop 2023-11-30T18:22:53.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.835+0000 7f46463d8700 1 -- 172.21.15.49:0/1697778860 shutdown_connections 2023-11-30T18:22:53.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.835+0000 7f46463d8700 1 --2- 172.21.15.49:0/1697778860 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4640098d10 0x7f46400c7760 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:53.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.835+0000 7f46463d8700 1 --2- 172.21.15.49:0/1697778860 >> v2:172.21.15.115:3300/0 conn(0x7f46400c6190 0x7f4640063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:53.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.835+0000 7f46463d8700 1 -- 172.21.15.49:0/1697778860 >> 172.21.15.49:0/1697778860 conn(0x7f46400cb310 msgr2=0x7f46400cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:53.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.835+0000 7f46463d8700 1 -- 172.21.15.49:0/1697778860 shutdown_connections 2023-11-30T18:22:53.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.835+0000 7f46463d8700 1 -- 172.21.15.49:0/1697778860 wait complete. 2023-11-30T18:22:53.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.836+0000 7f46463d8700 1 Processor -- start 2023-11-30T18:22:53.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.836+0000 7f46463d8700 1 -- start start 2023-11-30T18:22:53.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.837+0000 7f46463d8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4640064350 0x7f4640155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:53.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.837+0000 7f46463d8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4640098d10 0x7f464014b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:53.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.837+0000 7f46463d8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46400c6190 0x7f4640157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:53.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.837+0000 7f46463d8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464014b9c0 con 0x7f4640064350 2023-11-30T18:22:53.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.837+0000 7f46463d8700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46400aad70 con 0x7f46400c6190 2023-11-30T18:22:53.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.837+0000 7f46463d8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46400afc60 con 0x7f4640098d10 2023-11-30T18:22:53.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.837+0000 7f463ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4640064350 0x7f4640155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:53.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.837+0000 7f463ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4640064350 0x7f4640155450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55208/0 (socket says 172.21.15.49:55208) 2023-11-30T18:22:53.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.837+0000 7f463ffff700 1 -- 172.21.15.49:0/4268066732 learned_addr learned my addr 172.21.15.49:0/4268066732 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:53.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.837+0000 7f463f7fe700 1 --2- 172.21.15.49:0/4268066732 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4640098d10 0x7f464014b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:53.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.837+0000 7f4644975700 1 --2- 172.21.15.49:0/4268066732 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46400c6190 0x7f4640157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:53.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.837+0000 7f463ffff700 1 -- 172.21.15.49:0/4268066732 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4640098d10 msgr2=0x7f464014b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:53.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.837+0000 7f463ffff700 1 --2- 172.21.15.49:0/4268066732 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4640098d10 0x7f464014b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:53.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.837+0000 7f463ffff700 1 -- 172.21.15.49:0/4268066732 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46400c6190 msgr2=0x7f4640157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:53.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.837+0000 7f463ffff700 1 --2- 172.21.15.49:0/4268066732 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46400c6190 0x7f4640157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:53.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.837+0000 7f463ffff700 1 -- 172.21.15.49:0/4268066732 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46300092a0 con 0x7f4640064350 2023-11-30T18:22:53.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.837+0000 7f463ffff700 1 --2- 172.21.15.49:0/4268066732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4640064350 0x7f4640155450 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7f46400c2360 tx=0x7f4630017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:53.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.837+0000 7f4627fff700 1 -- 172.21.15.49:0/4268066732 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4630000bc0 con 0x7f4640064350 2023-11-30T18:22:53.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.837+0000 7f4627fff700 1 -- 172.21.15.49:0/4268066732 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463000b850 con 0x7f4640064350 2023-11-30T18:22:53.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.837+0000 7f46463d8700 1 -- 172.21.15.49:0/4268066732 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4640155a30 con 0x7f4640064350 2023-11-30T18:22:53.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.837+0000 7f4627fff700 1 -- 172.21.15.49:0/4268066732 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4630000d20 con 0x7f4640064350 2023-11-30T18:22:53.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.838+0000 7f46463d8700 1 -- 172.21.15.49:0/4268066732 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4640155ff0 con 0x7f4640064350 2023-11-30T18:22:53.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.839+0000 7f46463d8700 1 -- 172.21.15.49:0/4268066732 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46400afa30 con 0x7f4640064350 2023-11-30T18:22:53.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.839+0000 7f4627fff700 1 -- 172.21.15.49:0/4268066732 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 71) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f463001b870 con 0x7f4640064350 2023-11-30T18:22:53.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.839+0000 7f4627fff700 1 --2- 172.21.15.49:0/4268066732 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f462c05f050 0x7f462c061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:53.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.839+0000 7f4627fff700 1 -- 172.21.15.49:0/4268066732 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6435+0+0 (secure 0 0 0) 0x7f463007baf0 con 0x7f4640064350 2023-11-30T18:22:53.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.840+0000 7f463f7fe700 1 --2- 172.21.15.49:0/4268066732 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f462c05f050 0x7f462c061510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:53.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.840+0000 7f463f7fe700 1 --2- 172.21.15.49:0/4268066732 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f462c05f050 0x7f462c061510 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f46400af820 tx=0x7f4634008040).ready entity=mgr.8425 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:53.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:53.844+0000 7f4627fff700 1 -- 172.21.15.49:0/4268066732 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f463007f030 con 0x7f4640064350 2023-11-30T18:22:54.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:54.064+0000 7f46463d8700 1 -- 172.21.15.49:0/4268066732 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f464006c860 con 0x7f4640064350 2023-11-30T18:22:54.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:54.942+0000 7f4627fff700 1 -- 172.21.15.49:0/4268066732 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 72) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f4630079950 con 0x7f4640064350 2023-11-30T18:22:54.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:54.944+0000 7f4627fff700 1 -- 172.21.15.49:0/4268066732 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v72) v1 ==== 93+0+0 (secure 0 0 0) 0x7f4630054e00 con 0x7f4640064350 2023-11-30T18:22:54.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:54.946+0000 7f46463d8700 1 -- 172.21.15.49:0/4268066732 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f462c05f050 msgr2=0x7f462c061510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:54.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:54.946+0000 7f46463d8700 1 --2- 172.21.15.49:0/4268066732 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f462c05f050 0x7f462c061510 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f46400af820 tx=0x7f4634008040).stop 2023-11-30T18:22:54.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:54.946+0000 7f46463d8700 1 -- 172.21.15.49:0/4268066732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4640064350 msgr2=0x7f4640155450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:54.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:54.946+0000 7f46463d8700 1 --2- 172.21.15.49:0/4268066732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4640064350 0x7f4640155450 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7f46400c2360 tx=0x7f4630017000).stop 2023-11-30T18:22:54.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:54.946+0000 7f46463d8700 1 -- 172.21.15.49:0/4268066732 shutdown_connections 2023-11-30T18:22:54.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:54.946+0000 7f46463d8700 1 --2- 172.21.15.49:0/4268066732 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46400c6190 0x7f4640157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:54.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:54.947+0000 7f46463d8700 1 --2- 172.21.15.49:0/4268066732 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f462c05f050 0x7f462c061510 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:54.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:54.947+0000 7f46463d8700 1 --2- 172.21.15.49:0/4268066732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4640064350 0x7f4640155450 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:54.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:54.947+0000 7f46463d8700 1 --2- 172.21.15.49:0/4268066732 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4640098d10 0x7f464014b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:54.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:54.947+0000 7f46463d8700 1 -- 172.21.15.49:0/4268066732 >> 172.21.15.49:0/4268066732 conn(0x7f46400cb310 msgr2=0x7f4640159c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:54.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:54.947+0000 7f46463d8700 1 -- 172.21.15.49:0/4268066732 shutdown_connections 2023-11-30T18:22:54.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:54.947+0000 7f46463d8700 1 -- 172.21.15.49:0/4268066732 wait complete. 2023-11-30T18:22:54.964 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-30T18:22:54.964 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T18:22:55.010 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T18:22:55.051 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-30T18:22:55.051 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-30T18:22:55.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:22:55.051 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-30T18:22:55.089 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-11-30T18:22:55.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:22:55.089 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-30T18:22:55.096 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:55.095+0000 7f8897cea680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T18:22:55.100 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:55.099+0000 7fbfb2bd2680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T18:22:55.115 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:22:55.159 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:55.159+0000 7f8897cea680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T18:22:55.166 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:55.165+0000 7fbfb2bd2680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T18:22:55.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.273+0000 7faa5a7ab700 1 Processor -- start 2023-11-30T18:22:55.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.273+0000 7faa5a7ab700 1 -- start start 2023-11-30T18:22:55.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.274+0000 7faa5a7ab700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faa54151c40 0x7faa54152020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:55.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.274+0000 7faa5a7ab700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa541548c0 0x7faa54065840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:55.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.274+0000 7faa5a7ab700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7faa540a6f70 0x7faa54062700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:55.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.274+0000 7faa5a7ab700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa54065d30 con 0x7faa54151c40 2023-11-30T18:22:55.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.274+0000 7faa5a7ab700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa54154d60 con 0x7faa540a6f70 2023-11-30T18:22:55.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.274+0000 7faa5a7ab700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa54155020 con 0x7faa541548c0 2023-11-30T18:22:55.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.274+0000 7faa597a9700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faa54151c40 0x7faa54152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:55.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.274+0000 7faa597a9700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faa54151c40 0x7faa54152020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55234/0 (socket says 172.21.15.49:55234) 2023-11-30T18:22:55.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.274+0000 7faa597a9700 1 -- 172.21.15.49:0/3430470603 learned_addr learned my addr 172.21.15.49:0/3430470603 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:55.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.274+0000 7faa58fa8700 1 --2- 172.21.15.49:0/3430470603 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa541548c0 0x7faa54065840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:55.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.274+0000 7faa59faa700 1 --2- 172.21.15.49:0/3430470603 >> v2:172.21.15.115:3300/0 conn(0x7faa540a6f70 0x7faa54062700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:55.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.274+0000 7faa597a9700 1 -- 172.21.15.49:0/3430470603 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa541548c0 msgr2=0x7faa54065840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:55.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.274+0000 7faa597a9700 1 --2- 172.21.15.49:0/3430470603 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa541548c0 0x7faa54065840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:55.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.274+0000 7faa597a9700 1 -- 172.21.15.49:0/3430470603 >> v2:172.21.15.115:3300/0 conn(0x7faa540a6f70 msgr2=0x7faa54062700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:55.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.274+0000 7faa597a9700 1 --2- 172.21.15.49:0/3430470603 >> v2:172.21.15.115:3300/0 conn(0x7faa540a6f70 0x7faa54062700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:55.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.274+0000 7faa597a9700 1 -- 172.21.15.49:0/3430470603 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa54155300 con 0x7faa54151c40 2023-11-30T18:22:55.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.275+0000 7faa597a9700 1 --2- 172.21.15.49:0/3430470603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa54151c40 0x7faa54152020 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7faa54063520 tx=0x7faa500090f0).ready entity=mon.0 client_cookie=e052cfa6b835f1dd server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:55.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.275+0000 7faa4bfff700 1 -- 172.21.15.49:0/3430470603 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5000f510 con 0x7faa54151c40 2023-11-30T18:22:55.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.275+0000 7faa4bfff700 1 -- 172.21.15.49:0/3430470603 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5000f670 con 0x7faa54151c40 2023-11-30T18:22:55.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.275+0000 7faa4bfff700 1 -- 172.21.15.49:0/3430470603 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5000fa10 con 0x7faa54151c40 2023-11-30T18:22:55.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.275+0000 7faa5a7ab700 1 -- 172.21.15.49:0/3430470603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa54151c40 msgr2=0x7faa54152020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:55.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.275+0000 7faa5a7ab700 1 --2- 172.21.15.49:0/3430470603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa54151c40 0x7faa54152020 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7faa54063520 tx=0x7faa500090f0).stop 2023-11-30T18:22:55.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.275+0000 7faa5a7ab700 1 -- 172.21.15.49:0/3430470603 shutdown_connections 2023-11-30T18:22:55.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.275+0000 7faa5a7ab700 1 --2- 172.21.15.49:0/3430470603 >> v2:172.21.15.115:3300/0 conn(0x7faa540a6f70 0x7faa54062700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:55.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.275+0000 7faa5a7ab700 1 --2- 172.21.15.49:0/3430470603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa54151c40 0x7faa54152020 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:55.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.275+0000 7faa5a7ab700 1 --2- 172.21.15.49:0/3430470603 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa541548c0 0x7faa54065840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:55.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.275+0000 7faa5a7ab700 1 -- 172.21.15.49:0/3430470603 >> 172.21.15.49:0/3430470603 conn(0x7faa540642e0 msgr2=0x7faa540c7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:55.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.275+0000 7faa5a7ab700 1 -- 172.21.15.49:0/3430470603 shutdown_connections 2023-11-30T18:22:55.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.275+0000 7faa5a7ab700 1 -- 172.21.15.49:0/3430470603 wait complete. 2023-11-30T18:22:55.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.277+0000 7faa5a7ab700 1 Processor -- start 2023-11-30T18:22:55.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.277+0000 7faa5a7ab700 1 -- start start 2023-11-30T18:22:55.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.277+0000 7faa5a7ab700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa540a6f70 0x7faa541522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:55.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.278+0000 7faa5a7ab700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa54151c40 0x7faa54152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:55.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.278+0000 7faa5a7ab700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa541548c0 0x7faa5413bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:55.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.278+0000 7faa5a7ab700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa54153970 con 0x7faa541548c0 2023-11-30T18:22:55.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.278+0000 7faa5a7ab700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa541507f0 con 0x7faa54151c40 2023-11-30T18:22:55.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.278+0000 7faa5a7ab700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa54152d60 con 0x7faa540a6f70 2023-11-30T18:22:55.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.278+0000 7faa59faa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa541548c0 0x7faa5413bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:55.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.278+0000 7faa59faa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa541548c0 0x7faa5413bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55238/0 (socket says 172.21.15.49:55238) 2023-11-30T18:22:55.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.278+0000 7faa59faa700 1 -- 172.21.15.49:0/2133716040 learned_addr learned my addr 172.21.15.49:0/2133716040 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:55.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.278+0000 7faa58fa8700 1 --2- 172.21.15.49:0/2133716040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa54151c40 0x7faa54152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:55.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.278+0000 7faa597a9700 1 --2- 172.21.15.49:0/2133716040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa540a6f70 0x7faa541522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:55.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.278+0000 7faa59faa700 1 -- 172.21.15.49:0/2133716040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa540a6f70 msgr2=0x7faa541522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:55.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.278+0000 7faa59faa700 1 --2- 172.21.15.49:0/2133716040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa540a6f70 0x7faa541522a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:55.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.278+0000 7faa59faa700 1 -- 172.21.15.49:0/2133716040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa54151c40 msgr2=0x7faa54152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:55.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.278+0000 7faa59faa700 1 --2- 172.21.15.49:0/2133716040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa54151c40 0x7faa54152790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:55.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.278+0000 7faa59faa700 1 -- 172.21.15.49:0/2133716040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa50009370 con 0x7faa541548c0 2023-11-30T18:22:55.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.278+0000 7faa58fa8700 1 --2- 172.21.15.49:0/2133716040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa54151c40 0x7faa54152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:22:55.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.278+0000 7faa59faa700 1 --2- 172.21.15.49:0/2133716040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa541548c0 0x7faa5413bfa0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7faa4c009df0 tx=0x7faa4c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:55.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.278+0000 7faa497fa700 1 -- 172.21.15.49:0/2133716040 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c00caa0 con 0x7faa541548c0 2023-11-30T18:22:55.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.278+0000 7faa497fa700 1 -- 172.21.15.49:0/2133716040 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4c00f040 con 0x7faa541548c0 2023-11-30T18:22:55.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.278+0000 7faa497fa700 1 -- 172.21.15.49:0/2133716040 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c00ce10 con 0x7faa541548c0 2023-11-30T18:22:55.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.278+0000 7faa5a7ab700 1 -- 172.21.15.49:0/2133716040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa54153040 con 0x7faa541548c0 2023-11-30T18:22:55.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.278+0000 7faa5a7ab700 1 -- 172.21.15.49:0/2133716040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa54153600 con 0x7faa541548c0 2023-11-30T18:22:55.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.280+0000 7faa5a7ab700 1 -- 172.21.15.49:0/2133716040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa54153b20 con 0x7faa541548c0 2023-11-30T18:22:55.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.280+0000 7faa497fa700 1 -- 172.21.15.49:0/2133716040 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 72) v1 ==== 75605+0+0 (secure 0 0 0) 0x7faa4c013610 con 0x7faa541548c0 2023-11-30T18:22:55.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.280+0000 7faa497fa700 1 --2- 172.21.15.49:0/2133716040 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faa3805f2d0 0x7faa38061790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:55.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.280+0000 7faa497fa700 1 -- 172.21.15.49:0/2133716040 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6435+0+0 (secure 0 0 0) 0x7faa4c07ae10 con 0x7faa541548c0 2023-11-30T18:22:55.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.280+0000 7faa597a9700 1 -- 172.21.15.49:0/2133716040 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faa3805f2d0 msgr2=0x7faa38061790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:55.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.280+0000 7faa597a9700 1 --2- 172.21.15.49:0/2133716040 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faa3805f2d0 0x7faa38061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:22:55.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.284+0000 7faa497fa700 1 -- 172.21.15.49:0/2133716040 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7faa54153b20 con 0x7faa541548c0 2023-11-30T18:22:55.435 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:55.435+0000 7f8897cea680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T18:22:55.462 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:55.461+0000 7fbfb2bd2680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T18:22:55.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.481+0000 7faa597a9700 1 -- 172.21.15.49:0/2133716040 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faa3805f2d0 msgr2=0x7faa38061790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:55.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.481+0000 7faa597a9700 1 --2- 172.21.15.49:0/2133716040 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faa3805f2d0 0x7faa38061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T18:22:55.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.504+0000 7faa5a7ab700 1 -- 172.21.15.49:0/2133716040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa54153ab0 con 0x7faa541548c0 2023-11-30T18:22:55.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.505+0000 7faa497fa700 1 -- 172.21.15.49:0/2133716040 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4497 (secure 0 0 0) 0x7faa4c04bd10 con 0x7faa541548c0 2023-11-30T18:22:55.507 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:22:55.507 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":69,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7193,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/4003300500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4003300500},{"type":"v1","addr":"172.21.15.49:6835","nonce":4003300500}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7205,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3715169351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3715169351},{"type":"v1","addr":"172.21.15.115:6837","nonce":3715169351}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":8272,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2922134566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2922134566},{"type":"v1","addr":"172.21.15.115:6836","nonce":2922134566}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T18:22:39.426066+0000","modified":"2023-11-30T18:22:42.436489+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8505},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8505":{"gid":8505,"name":"a","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6833/3939533550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3939533550},{"type":"v1","addr":"172.21.15.49:6833","nonce":3939533550}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-11-30T18:22:55.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.507+0000 7faa5a7ab700 1 -- 172.21.15.49:0/2133716040 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faa3805f2d0 msgr2=0x7faa38061790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:22:55.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.507+0000 7faa5a7ab700 1 --2- 172.21.15.49:0/2133716040 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faa3805f2d0 0x7faa38061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:55.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.507+0000 7faa5a7ab700 1 -- 172.21.15.49:0/2133716040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa541548c0 msgr2=0x7faa5413bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:55.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.507+0000 7faa5a7ab700 1 --2- 172.21.15.49:0/2133716040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa541548c0 0x7faa5413bfa0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7faa4c009df0 tx=0x7faa4c00b040).stop 2023-11-30T18:22:55.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.507+0000 7faa5a7ab700 1 -- 172.21.15.49:0/2133716040 shutdown_connections 2023-11-30T18:22:55.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.507+0000 7faa5a7ab700 1 --2- 172.21.15.49:0/2133716040 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7faa3805f2d0 0x7faa38061790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:55.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.507+0000 7faa5a7ab700 1 --2- 172.21.15.49:0/2133716040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa541548c0 0x7faa5413bfa0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:55.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.507+0000 7faa5a7ab700 1 --2- 172.21.15.49:0/2133716040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa540a6f70 0x7faa541522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:55.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.507+0000 7faa5a7ab700 1 --2- 172.21.15.49:0/2133716040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa54151c40 0x7faa54152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:55.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.507+0000 7faa5a7ab700 1 -- 172.21.15.49:0/2133716040 >> 172.21.15.49:0/2133716040 conn(0x7faa540642e0 msgr2=0x7faa541560f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:55.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.507+0000 7faa5a7ab700 1 -- 172.21.15.49:0/2133716040 shutdown_connections 2023-11-30T18:22:55.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.507+0000 7faa5a7ab700 1 -- 172.21.15.49:0/2133716040 wait complete. 2023-11-30T18:22:55.510 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 69 2023-11-30T18:22:55.522 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:22:55.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.679+0000 7f913b1d6700 1 Processor -- start 2023-11-30T18:22:55.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.679+0000 7f913b1d6700 1 -- start start 2023-11-30T18:22:55.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.680+0000 7f913b1d6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9134096590 0x7f9134155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:55.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.680+0000 7f913b1d6700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91340683d0 con 0x7f91341544d0 2023-11-30T18:22:55.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.680+0000 7f913b1d6700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9134067850 con 0x7f9134064e20 2023-11-30T18:22:55.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.680+0000 7f913b1d6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9134067650 con 0x7f9134096590 2023-11-30T18:22:55.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.680+0000 7f9138f72700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f91341544d0 0x7f9134066f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43430/0 (socket says 172.21.15.49:43430) 2023-11-30T18:22:55.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.680+0000 7f9138f72700 1 -- 172.21.15.49:0/4205480998 learned_addr learned my addr 172.21.15.49:0/4205480998 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:22:55.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.680+0000 7f9139773700 1 --2- 172.21.15.49:0/4205480998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9134096590 0x7f9134155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:55.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.681+0000 7f91337fe700 1 -- 172.21.15.49:0/4205480998 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610685447 0 0) 0x7f91340683d0 con 0x7f91341544d0 2023-11-30T18:22:55.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.681+0000 7f91337fe700 1 -- 172.21.15.49:0/4205480998 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91240033f0 con 0x7f91341544d0 2023-11-30T18:22:55.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.681+0000 7f91337fe700 1 -- 172.21.15.49:0/4205480998 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 289598146 0 0) 0x7f9134067850 con 0x7f9134064e20 2023-11-30T18:22:55.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.681+0000 7f91337fe700 1 -- 172.21.15.49:0/4205480998 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91340683d0 con 0x7f9134064e20 2023-11-30T18:22:55.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.681+0000 7f9139773700 1 -- 172.21.15.49:0/4205480998 >> v1:172.21.15.115:6789/0 conn(0x7f9134064e20 legacy=0x7f9134095e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:55.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.681+0000 7f9139773700 1 -- 172.21.15.49:0/4205480998 >> v1:172.21.15.49:6789/0 conn(0x7f91341544d0 legacy=0x7f9134066f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:55.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.681+0000 7f9139773700 1 -- 172.21.15.49:0/4205480998 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9134067b30 con 0x7f9134096590 2023-11-30T18:22:55.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.681+0000 7f9139773700 1 --2- 172.21.15.49:0/4205480998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9134096590 0x7f9134155750 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f912c009e90 tx=0x7f912c009780).ready entity=mon.2 client_cookie=45259e6a3cf1562a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:55.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.681+0000 7f91337fe700 1 -- 172.21.15.49:0/4205480998 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c00e070 con 0x7f9134096590 2023-11-30T18:22:55.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.681+0000 7f91337fe700 1 -- 172.21.15.49:0/4205480998 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912c00bab0 con 0x7f9134096590 2023-11-30T18:22:55.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.681+0000 7f91337fe700 1 -- 172.21.15.49:0/4205480998 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c00be30 con 0x7f9134096590 2023-11-30T18:22:55.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.682+0000 7f913b1d6700 1 -- 172.21.15.49:0/4205480998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9134096590 msgr2=0x7f9134155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:55.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.682+0000 7f913b1d6700 1 --2- 172.21.15.49:0/4205480998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9134096590 0x7f9134155750 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f912c009e90 tx=0x7f912c009780).stop 2023-11-30T18:22:55.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.682+0000 7f913b1d6700 1 -- 172.21.15.49:0/4205480998 shutdown_connections 2023-11-30T18:22:55.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.682+0000 7f913b1d6700 1 --2- 172.21.15.49:0/4205480998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9134096590 0x7f9134155750 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:55.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.682+0000 7f913b1d6700 1 -- 172.21.15.49:0/4205480998 >> 172.21.15.49:0/4205480998 conn(0x7f91340631d0 msgr2=0x7f91340c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:55.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.682+0000 7f913b1d6700 1 -- 172.21.15.49:0/4205480998 shutdown_connections 2023-11-30T18:22:55.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.682+0000 7f913b1d6700 1 -- 172.21.15.49:0/4205480998 wait complete. 2023-11-30T18:22:55.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.683+0000 7f913b1d6700 1 Processor -- start 2023-11-30T18:22:55.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.683+0000 7f913b1d6700 1 -- start start 2023-11-30T18:22:55.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.684+0000 7f913b1d6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9134064e20 0x7f913414dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:55.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.684+0000 7f913b1d6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9134096590 0x7f9134155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:55.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.684+0000 7f913b1d6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91341544d0 0x7f9134153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:55.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.684+0000 7f913b1d6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91341566e0 con 0x7f9134096590 2023-11-30T18:22:55.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.684+0000 7f913b1d6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91341569c0 con 0x7f91341544d0 2023-11-30T18:22:55.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.684+0000 7f913b1d6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9134156ca0 con 0x7f9134064e20 2023-11-30T18:22:55.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.684+0000 7f9133fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9134096590 0x7f9134155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:55.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.684+0000 7f9133fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9134096590 0x7f9134155e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55250/0 (socket says 172.21.15.49:55250) 2023-11-30T18:22:55.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.684+0000 7f9133fff700 1 -- 172.21.15.49:0/1708345231 learned_addr learned my addr 172.21.15.49:0/1708345231 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:55.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.684+0000 7f9138f72700 1 --2- 172.21.15.49:0/1708345231 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9134064e20 0x7f913414dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:55.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.684+0000 7f9139773700 1 --2- 172.21.15.49:0/1708345231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91341544d0 0x7f9134153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:55.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.684+0000 7f9133fff700 1 -- 172.21.15.49:0/1708345231 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9134064e20 msgr2=0x7f913414dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:55.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.684+0000 7f9133fff700 1 --2- 172.21.15.49:0/1708345231 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9134064e20 0x7f913414dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:55.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.684+0000 7f9133fff700 1 -- 172.21.15.49:0/1708345231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91341544d0 msgr2=0x7f9134153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:55.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.684+0000 7f9133fff700 1 --2- 172.21.15.49:0/1708345231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91341544d0 0x7f9134153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:55.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.684+0000 7f9133fff700 1 -- 172.21.15.49:0/1708345231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912c009a20 con 0x7f9134096590 2023-11-30T18:22:55.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.685+0000 7f9133fff700 1 --2- 172.21.15.49:0/1708345231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9134096590 0x7f9134155e00 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f912000c4a0 tx=0x7f9120007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:55.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.685+0000 7f9130ff9700 1 -- 172.21.15.49:0/1708345231 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912000ce50 con 0x7f9134096590 2023-11-30T18:22:55.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.685+0000 7f9130ff9700 1 -- 172.21.15.49:0/1708345231 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912000f470 con 0x7f9134096590 2023-11-30T18:22:55.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.685+0000 7f913b1d6700 1 -- 172.21.15.49:0/1708345231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9134156f80 con 0x7f9134096590 2023-11-30T18:22:55.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.685+0000 7f9130ff9700 1 -- 172.21.15.49:0/1708345231 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912000f810 con 0x7f9134096590 2023-11-30T18:22:55.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.685+0000 7f913b1d6700 1 -- 172.21.15.49:0/1708345231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f913414e130 con 0x7f9134096590 2023-11-30T18:22:55.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.686+0000 7f913b1d6700 1 -- 172.21.15.49:0/1708345231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9134157480 con 0x7f9134096590 2023-11-30T18:22:55.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.686+0000 7f9130ff9700 1 -- 172.21.15.49:0/1708345231 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 72) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f912000fbc0 con 0x7f9134096590 2023-11-30T18:22:55.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.686+0000 7f9130ff9700 1 --2- 172.21.15.49:0/1708345231 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f911805f300 0x7f91180617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:55.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.687+0000 7f9130ff9700 1 -- 172.21.15.49:0/1708345231 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6435+0+0 (secure 0 0 0) 0x7f9120079a80 con 0x7f9134096590 2023-11-30T18:22:55.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.687+0000 7f9138f72700 1 -- 172.21.15.49:0/1708345231 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f911805f300 msgr2=0x7f91180617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:55.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.687+0000 7f9138f72700 1 --2- 172.21.15.49:0/1708345231 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f911805f300 0x7f91180617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:22:55.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.691+0000 7f9130ff9700 1 -- 172.21.15.49:0/1708345231 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f912004a9b0 con 0x7f9134096590 2023-11-30T18:22:55.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.864+0000 7f913b1d6700 1 -- 172.21.15.49:0/1708345231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f913406c860 con 0x7f9134096590 2023-11-30T18:22:55.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.865+0000 7f9130ff9700 1 -- 172.21.15.49:0/1708345231 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+17403 (secure 0 0 0) 0x7f912004dfd0 con 0x7f9134096590 2023-11-30T18:22:55.867 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:22:55.867 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":170,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:22:51.928387+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-11-30T18:22:37.085862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-11-30T18:22:38.409621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/1847633149":"2023-12-01T18:22:51.928346+0000","172.21.15.115:6833/89956":"2023-12-01T18:22:51.928346+0000","172.21.15.115:6832/89956":"2023-12-01T18:22:51.928346+0000","172.21.15.115:0/3691284164":"2023-12-01T18:22:51.928346+0000","172.21.15.115:0/1259529053":"2023-12-01T18:22:51.928346+0000","172.21.15.115:0/596329516":"2023-12-01T18:22:51.928346+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:22:55.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.867+0000 7f913b1d6700 1 -- 172.21.15.49:0/1708345231 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f911805f300 msgr2=0x7f91180617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:22:55.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.867+0000 7f913b1d6700 1 --2- 172.21.15.49:0/1708345231 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f911805f300 0x7f91180617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:55.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.867+0000 7f913b1d6700 1 -- 172.21.15.49:0/1708345231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9134096590 msgr2=0x7f9134155e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:55.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.867+0000 7f913b1d6700 1 --2- 172.21.15.49:0/1708345231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9134096590 0x7f9134155e00 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f912000c4a0 tx=0x7f9120007c50).stop 2023-11-30T18:22:55.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.867+0000 7f913b1d6700 1 -- 172.21.15.49:0/1708345231 shutdown_connections 2023-11-30T18:22:55.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.867+0000 7f913b1d6700 1 --2- 172.21.15.49:0/1708345231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91341544d0 0x7f9134153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:55.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.867+0000 7f913b1d6700 1 --2- 172.21.15.49:0/1708345231 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9134064e20 0x7f913414dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:55.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.867+0000 7f913b1d6700 1 --2- 172.21.15.49:0/1708345231 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f911805f300 0x7f91180617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:55.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.867+0000 7f913b1d6700 1 --2- 172.21.15.49:0/1708345231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9134096590 0x7f9134155e00 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:55.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.867+0000 7f913b1d6700 1 -- 172.21.15.49:0/1708345231 >> 172.21.15.49:0/1708345231 conn(0x7f91340631d0 msgr2=0x7f91340c4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:55.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.867+0000 7f913b1d6700 1 -- 172.21.15.49:0/1708345231 shutdown_connections 2023-11-30T18:22:55.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:55.867+0000 7f913b1d6700 1 -- 172.21.15.49:0/1708345231 wait complete. 2023-11-30T18:22:55.882 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '158', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-30T18:22:37.085862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '168', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-11-30T18:22:38.409621+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '169', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-30T18:22:55.882 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T18:22:56.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.004+0000 7fb4e92d8700 1 Processor -- start 2023-11-30T18:22:56.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.004+0000 7fb4e92d8700 1 -- start start 2023-11-30T18:22:56.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.006+0000 7fb4e92d8700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb4e40a9ca0 0x7fb4e4151300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:56.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.006+0000 7fb4e92d8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4e40c46e0 0x7fb4e40bd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:56.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.006+0000 7fb4e92d8700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e40c4b90 con 0x7fb4e4150f20 2023-11-30T18:22:56.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.006+0000 7fb4e92d8700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e4155d50 con 0x7fb4e40a9ca0 2023-11-30T18:22:56.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.006+0000 7fb4e92d8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e40c3180 con 0x7fb4e40c46e0 2023-11-30T18:22:56.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.006+0000 7fb4e27fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb4e40a9ca0 0x7fb4e4151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:56.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.006+0000 7fb4e27fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb4e40a9ca0 0x7fb4e4151300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55266/0 (socket says 172.21.15.49:55266) 2023-11-30T18:22:56.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.006+0000 7fb4e27fc700 1 -- 172.21.15.49:0/591194873 learned_addr learned my addr 172.21.15.49:0/591194873 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:56.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.006+0000 7fb4e2ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb4e4150f20 0x7fb4e40c3610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43436/0 (socket says 172.21.15.49:43436) 2023-11-30T18:22:56.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.006+0000 7fb4e37fe700 1 --2- 172.21.15.49:0/591194873 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4e40c46e0 0x7fb4e40bd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:56.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.006+0000 7fb4e27fc700 1 -- 172.21.15.49:0/591194873 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4e40c46e0 msgr2=0x7fb4e40bd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:56.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.006+0000 7fb4e27fc700 1 --2- 172.21.15.49:0/591194873 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4e40c46e0 0x7fb4e40bd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:56.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.006+0000 7fb4e27fc700 1 -- 172.21.15.49:0/591194873 >> v1:172.21.15.49:6789/0 conn(0x7fb4e4150f20 legacy=0x7fb4e40c3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:56.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.006+0000 7fb4e1ffb700 1 -- 172.21.15.49:0/591194873 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3510190764 0 0) 0x7fb4e40c4b90 con 0x7fb4e4150f20 2023-11-30T18:22:56.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.006+0000 7fb4e27fc700 1 -- 172.21.15.49:0/591194873 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e40be3b0 con 0x7fb4e40a9ca0 2023-11-30T18:22:56.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.006+0000 7fb4e37fe700 1 --2- 172.21.15.49:0/591194873 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4e40c46e0 0x7fb4e40bd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:22:56.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.006+0000 7fb4e27fc700 1 --2- 172.21.15.49:0/591194873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4e40a9ca0 0x7fb4e4151300 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7fb4d4006fd0 tx=0x7fb4d40090f0).ready entity=mon.0 client_cookie=6b631b38c1957e3a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:56.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.007+0000 7fb4e1ffb700 1 -- 172.21.15.49:0/591194873 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d400b600 con 0x7fb4e40a9ca0 2023-11-30T18:22:56.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.007+0000 7fb4e1ffb700 1 -- 172.21.15.49:0/591194873 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d400b760 con 0x7fb4e40a9ca0 2023-11-30T18:22:56.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.007+0000 7fb4e1ffb700 1 -- 172.21.15.49:0/591194873 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d400bae0 con 0x7fb4e40a9ca0 2023-11-30T18:22:56.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.007+0000 7fb4e92d8700 1 -- 172.21.15.49:0/591194873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4e40a9ca0 msgr2=0x7fb4e4151300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:56.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.007+0000 7fb4e92d8700 1 --2- 172.21.15.49:0/591194873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4e40a9ca0 0x7fb4e4151300 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7fb4d4006fd0 tx=0x7fb4d40090f0).stop 2023-11-30T18:22:56.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.007+0000 7fb4e92d8700 1 -- 172.21.15.49:0/591194873 shutdown_connections 2023-11-30T18:22:56.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.007+0000 7fb4e92d8700 1 --2- 172.21.15.49:0/591194873 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4e40c46e0 0x7fb4e40bd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:56.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.007+0000 7fb4e92d8700 1 --2- 172.21.15.49:0/591194873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4e40a9ca0 0x7fb4e4151300 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:56.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.007+0000 7fb4e92d8700 1 -- 172.21.15.49:0/591194873 >> 172.21.15.49:0/591194873 conn(0x7fb4e40c7fb0 msgr2=0x7fb4e40c3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:56.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.007+0000 7fb4e92d8700 1 -- 172.21.15.49:0/591194873 shutdown_connections 2023-11-30T18:22:56.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.007+0000 7fb4e92d8700 1 -- 172.21.15.49:0/591194873 wait complete. 2023-11-30T18:22:56.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.008+0000 7fb4e92d8700 1 Processor -- start 2023-11-30T18:22:56.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.009+0000 7fb4e92d8700 1 -- start start 2023-11-30T18:22:56.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.009+0000 7fb4e92d8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4e40a9ca0 0x7fb4e4149640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:56.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.009+0000 7fb4e92d8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4e40c46e0 0x7fb4e413e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:56.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.009+0000 7fb4e92d8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4e4150f20 0x7fb4e40bfb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:56.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.009+0000 7fb4e92d8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e4168bd0 con 0x7fb4e4150f20 2023-11-30T18:22:56.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.009+0000 7fb4e92d8700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e40c0030 con 0x7fb4e40c46e0 2023-11-30T18:22:56.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.009+0000 7fb4e92d8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e4164900 con 0x7fb4e40a9ca0 2023-11-30T18:22:56.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.009+0000 7fb4e37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4e4150f20 0x7fb4e40bfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:56.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.009+0000 7fb4e37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4e4150f20 0x7fb4e40bfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55278/0 (socket says 172.21.15.49:55278) 2023-11-30T18:22:56.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.009+0000 7fb4e37fe700 1 -- 172.21.15.49:0/3683342781 learned_addr learned my addr 172.21.15.49:0/3683342781 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:56.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.009+0000 7fb4e2ffd700 1 --2- 172.21.15.49:0/3683342781 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4e40a9ca0 0x7fb4e4149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:56.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.010+0000 7fb4e27fc700 1 --2- 172.21.15.49:0/3683342781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4e40c46e0 0x7fb4e413e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:56.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.010+0000 7fb4e37fe700 1 -- 172.21.15.49:0/3683342781 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4e40a9ca0 msgr2=0x7fb4e4149640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:56.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.010+0000 7fb4e37fe700 1 --2- 172.21.15.49:0/3683342781 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4e40a9ca0 0x7fb4e4149640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:56.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.010+0000 7fb4e37fe700 1 -- 172.21.15.49:0/3683342781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4e40c46e0 msgr2=0x7fb4e413e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:56.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.010+0000 7fb4e37fe700 1 --2- 172.21.15.49:0/3683342781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4e40c46e0 0x7fb4e413e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:56.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.010+0000 7fb4e37fe700 1 -- 172.21.15.49:0/3683342781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d4009370 con 0x7fb4e4150f20 2023-11-30T18:22:56.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.010+0000 7fb4e37fe700 1 --2- 172.21.15.49:0/3683342781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4e4150f20 0x7fb4e40bfb40 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7fb4dc009fc0 tx=0x7fb4dc0099b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:56.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.010+0000 7fb4caffd700 1 -- 172.21.15.49:0/3683342781 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc00dbe0 con 0x7fb4e4150f20 2023-11-30T18:22:56.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.010+0000 7fb4caffd700 1 -- 172.21.15.49:0/3683342781 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4dc00f040 con 0x7fb4e4150f20 2023-11-30T18:22:56.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.010+0000 7fb4e92d8700 1 -- 172.21.15.49:0/3683342781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e4167fc0 con 0x7fb4e4150f20 2023-11-30T18:22:56.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.010+0000 7fb4caffd700 1 -- 172.21.15.49:0/3683342781 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc0133f0 con 0x7fb4e4150f20 2023-11-30T18:22:56.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.010+0000 7fb4e92d8700 1 -- 172.21.15.49:0/3683342781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e4168580 con 0x7fb4e4150f20 2023-11-30T18:22:56.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.011+0000 7fb4e92d8700 1 -- 172.21.15.49:0/3683342781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e40c1900 con 0x7fb4e4150f20 2023-11-30T18:22:56.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.012+0000 7fb4caffd700 1 -- 172.21.15.49:0/3683342781 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 72) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fb4dc0137e0 con 0x7fb4e4150f20 2023-11-30T18:22:56.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.012+0000 7fb4caffd700 1 --2- 172.21.15.49:0/3683342781 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb4d005f300 0x7fb4d00617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:56.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.012+0000 7fb4caffd700 1 -- 172.21.15.49:0/3683342781 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6435+0+0 (secure 0 0 0) 0x7fb4dc07ad10 con 0x7fb4e4150f20 2023-11-30T18:22:56.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.012+0000 7fb4e2ffd700 1 -- 172.21.15.49:0/3683342781 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb4d005f300 msgr2=0x7fb4d00617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:56.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.012+0000 7fb4e2ffd700 1 --2- 172.21.15.49:0/3683342781 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb4d005f300 0x7fb4d00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:22:56.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.020+0000 7fb4caffd700 1 -- 172.21.15.49:0/3683342781 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb4dc04bb90 con 0x7fb4e4150f20 2023-11-30T18:22:56.053 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:56.052+0000 7f8897cea680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T18:22:56.124 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:56.124+0000 7f8897cea680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T18:22:56.135 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:56.133+0000 7fbfb2bd2680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T18:22:56.206 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:56.204+0000 7fbfb2bd2680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T18:22:56.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.213+0000 7fb4e2ffd700 1 -- 172.21.15.49:0/3683342781 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb4d005f300 msgr2=0x7fb4d00617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:56.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.213+0000 7fb4e2ffd700 1 --2- 172.21.15.49:0/3683342781 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb4d005f300 0x7fb4d00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T18:22:56.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.241+0000 7fb4e92d8700 1 -- 172.21.15.49:0/3683342781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb4e406c7c0 con 0x7fb4e4150f20 2023-11-30T18:22:56.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.242+0000 7fb4caffd700 1 -- 172.21.15.49:0/3683342781 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v170) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb4dc04f1b0 con 0x7fb4e4150f20 2023-11-30T18:22:56.244 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T18:22:56.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.244+0000 7fb4e92d8700 1 -- 172.21.15.49:0/3683342781 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb4d005f300 msgr2=0x7fb4d00617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:22:56.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.244+0000 7fb4e92d8700 1 --2- 172.21.15.49:0/3683342781 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb4d005f300 0x7fb4d00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:56.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.244+0000 7fb4e92d8700 1 -- 172.21.15.49:0/3683342781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4e4150f20 msgr2=0x7fb4e40bfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:56.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.244+0000 7fb4e92d8700 1 --2- 172.21.15.49:0/3683342781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4e4150f20 0x7fb4e40bfb40 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7fb4dc009fc0 tx=0x7fb4dc0099b0).stop 2023-11-30T18:22:56.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.244+0000 7fb4e92d8700 1 -- 172.21.15.49:0/3683342781 shutdown_connections 2023-11-30T18:22:56.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.244+0000 7fb4e92d8700 1 --2- 172.21.15.49:0/3683342781 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb4d005f300 0x7fb4d00617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:56.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.244+0000 7fb4e92d8700 1 --2- 172.21.15.49:0/3683342781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4e4150f20 0x7fb4e40bfb40 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:56.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.244+0000 7fb4e92d8700 1 --2- 172.21.15.49:0/3683342781 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4e40a9ca0 0x7fb4e4149640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:56.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.244+0000 7fb4e92d8700 1 --2- 172.21.15.49:0/3683342781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4e40c46e0 0x7fb4e413e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:56.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.244+0000 7fb4e92d8700 1 -- 172.21.15.49:0/3683342781 >> 172.21.15.49:0/3683342781 conn(0x7fb4e40c7fb0 msgr2=0x7fb4e4069840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:56.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.244+0000 7fb4e92d8700 1 -- 172.21.15.49:0/3683342781 shutdown_connections 2023-11-30T18:22:56.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.244+0000 7fb4e92d8700 1 -- 172.21.15.49:0/3683342781 wait complete. 2023-11-30T18:22:56.259 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T18:22:56.312 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:56.311+0000 7f8897cea680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T18:22:56.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.381+0000 7fb0d98fc700 1 Processor -- start 2023-11-30T18:22:56.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.381+0000 7fb0d98fc700 1 -- start start 2023-11-30T18:22:56.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.382+0000 7fb0d98fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb0d414e530 0x7fb0d40c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:56.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.382+0000 7fb0d98fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0d4154950 0x7fb0d414e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:56.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.382+0000 7fb0d98fc700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d40c7bc0 con 0x7fb0d4158570 2023-11-30T18:22:56.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.382+0000 7fb0d98fc700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d4155920 con 0x7fb0d414e530 2023-11-30T18:22:56.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.382+0000 7fb0d98fc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d4154dd0 con 0x7fb0d4154950 2023-11-30T18:22:56.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.382+0000 7fb0d90fb700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb0d4158570 0x7fb0d40aa030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43448/0 (socket says 172.21.15.49:43448) 2023-11-30T18:22:56.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.382+0000 7fb0d90fb700 1 -- 172.21.15.49:0/4072510606 learned_addr learned my addr 172.21.15.49:0/4072510606 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:22:56.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.382+0000 7fb0d88fa700 1 --2- 172.21.15.49:0/4072510606 >> v2:172.21.15.115:3300/0 conn(0x7fb0d414e530 0x7fb0d40c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:56.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.382+0000 7fb0d3fff700 1 --2- 172.21.15.49:0/4072510606 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0d4154950 0x7fb0d414e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:56.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.383+0000 7fb0d37fe700 1 -- 172.21.15.49:0/4072510606 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803071435 0 0) 0x7fb0d40c7bc0 con 0x7fb0d4158570 2023-11-30T18:22:56.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.383+0000 7fb0d37fe700 1 -- 172.21.15.49:0/4072510606 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0c40033f0 con 0x7fb0d4158570 2023-11-30T18:22:56.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.383+0000 7fb0d88fa700 1 -- 172.21.15.49:0/4072510606 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0d4154950 msgr2=0x7fb0d414e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:56.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.383+0000 7fb0d88fa700 1 --2- 172.21.15.49:0/4072510606 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0d4154950 0x7fb0d414e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:56.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.383+0000 7fb0d88fa700 1 -- 172.21.15.49:0/4072510606 >> v1:172.21.15.49:6789/0 conn(0x7fb0d4158570 legacy=0x7fb0d40aa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:56.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.383+0000 7fb0d88fa700 1 -- 172.21.15.49:0/4072510606 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d4155080 con 0x7fb0d414e530 2023-11-30T18:22:56.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.383+0000 7fb0d88fa700 1 --2- 172.21.15.49:0/4072510606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0d414e530 0x7fb0d40c66f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7fb0c8009760 tx=0x7fb0c8009060).ready entity=mon.1 client_cookie=fd031f343be2b857 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:56.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.383+0000 7fb0d37fe700 1 -- 172.21.15.49:0/4072510606 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c80090d0 con 0x7fb0d414e530 2023-11-30T18:22:56.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.383+0000 7fb0d37fe700 1 -- 172.21.15.49:0/4072510606 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c800d4a0 con 0x7fb0d414e530 2023-11-30T18:22:56.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.383+0000 7fb0d37fe700 1 -- 172.21.15.49:0/4072510606 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c800d820 con 0x7fb0d414e530 2023-11-30T18:22:56.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.384+0000 7fb0d98fc700 1 -- 172.21.15.49:0/4072510606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0d414e530 msgr2=0x7fb0d40c66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:56.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.384+0000 7fb0d98fc700 1 --2- 172.21.15.49:0/4072510606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0d414e530 0x7fb0d40c66f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7fb0c8009760 tx=0x7fb0c8009060).stop 2023-11-30T18:22:56.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.384+0000 7fb0d98fc700 1 -- 172.21.15.49:0/4072510606 shutdown_connections 2023-11-30T18:22:56.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.384+0000 7fb0d98fc700 1 --2- 172.21.15.49:0/4072510606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0d414e530 0x7fb0d40c66f0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:56.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.384+0000 7fb0d98fc700 1 --2- 172.21.15.49:0/4072510606 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0d4154950 0x7fb0d414e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:56.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.384+0000 7fb0d98fc700 1 -- 172.21.15.49:0/4072510606 >> 172.21.15.49:0/4072510606 conn(0x7fb0d4064990 msgr2=0x7fb0d4064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:56.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.384+0000 7fb0d98fc700 1 -- 172.21.15.49:0/4072510606 shutdown_connections 2023-11-30T18:22:56.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.384+0000 7fb0d98fc700 1 -- 172.21.15.49:0/4072510606 wait complete. 2023-11-30T18:22:56.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.385+0000 7fb0d98fc700 1 Processor -- start 2023-11-30T18:22:56.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.385+0000 7fb0d98fc700 1 -- start start 2023-11-30T18:22:56.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.386+0000 7fb0d98fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0d414e530 0x7fb0d40c2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:56.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.386+0000 7fb0d98fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0d4154950 0x7fb0d40c0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:56.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.386+0000 7fb0d98fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0d4158570 0x7fb0d40c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:56.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.386+0000 7fb0d98fc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d40c2610 con 0x7fb0d4154950 2023-11-30T18:22:56.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.386+0000 7fb0d98fc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d40b1000 con 0x7fb0d4158570 2023-11-30T18:22:56.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.386+0000 7fb0d98fc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d40c2820 con 0x7fb0d414e530 2023-11-30T18:22:56.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.386+0000 7fb0d3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0d4154950 0x7fb0d40c0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:56.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.386+0000 7fb0d3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0d4154950 0x7fb0d40c0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55286/0 (socket says 172.21.15.49:55286) 2023-11-30T18:22:56.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.386+0000 7fb0d3fff700 1 -- 172.21.15.49:0/2774715159 learned_addr learned my addr 172.21.15.49:0/2774715159 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:56.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.386+0000 7fb0d88fa700 1 --2- 172.21.15.49:0/2774715159 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0d414e530 0x7fb0d40c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:56.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.386+0000 7fb0d90fb700 1 --2- 172.21.15.49:0/2774715159 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0d4158570 0x7fb0d40c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:56.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.387+0000 7fb0d3fff700 1 -- 172.21.15.49:0/2774715159 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0d414e530 msgr2=0x7fb0d40c2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:56.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.387+0000 7fb0d3fff700 1 --2- 172.21.15.49:0/2774715159 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0d414e530 0x7fb0d40c2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:56.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.387+0000 7fb0d3fff700 1 -- 172.21.15.49:0/2774715159 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0d4158570 msgr2=0x7fb0d40c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:56.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.387+0000 7fb0d3fff700 1 --2- 172.21.15.49:0/2774715159 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0d4158570 0x7fb0d40c3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:56.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.387+0000 7fb0d3fff700 1 -- 172.21.15.49:0/2774715159 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c80092a0 con 0x7fb0d4154950 2023-11-30T18:22:56.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.387+0000 7fb0d90fb700 1 --2- 172.21.15.49:0/2774715159 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0d4158570 0x7fb0d40c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:22:56.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.387+0000 7fb0d3fff700 1 --2- 172.21.15.49:0/2774715159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0d4154950 0x7fb0d40c0510 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7fb0c000e930 tx=0x7fb0c0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:56.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.387+0000 7fb0d0ff9700 1 -- 172.21.15.49:0/2774715159 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0012600 con 0x7fb0d4154950 2023-11-30T18:22:56.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.387+0000 7fb0d0ff9700 1 -- 172.21.15.49:0/2774715159 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c0012760 con 0x7fb0d4154950 2023-11-30T18:22:56.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.387+0000 7fb0d0ff9700 1 -- 172.21.15.49:0/2774715159 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0012ae0 con 0x7fb0d4154950 2023-11-30T18:22:56.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.387+0000 7fb0d98fc700 1 -- 172.21.15.49:0/2774715159 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d40c2b00 con 0x7fb0d4154950 2023-11-30T18:22:56.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.387+0000 7fb0d98fc700 1 -- 172.21.15.49:0/2774715159 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d40c33a0 con 0x7fb0d4154950 2023-11-30T18:22:56.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.388+0000 7fb0d0ff9700 1 -- 172.21.15.49:0/2774715159 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 72) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fb0c001b400 con 0x7fb0d4154950 2023-11-30T18:22:56.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.389+0000 7fb0d98fc700 1 -- 172.21.15.49:0/2774715159 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d4062ee0 con 0x7fb0d4154950 2023-11-30T18:22:56.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.389+0000 7fb0d0ff9700 1 --2- 172.21.15.49:0/2774715159 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb0b805f300 0x7fb0b80617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:56.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.389+0000 7fb0d0ff9700 1 -- 172.21.15.49:0/2774715159 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6435+0+0 (secure 0 0 0) 0x7fb0c007aa60 con 0x7fb0d4154950 2023-11-30T18:22:56.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.389+0000 7fb0d88fa700 1 -- 172.21.15.49:0/2774715159 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb0b805f300 msgr2=0x7fb0b80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:56.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.389+0000 7fb0d88fa700 1 --2- 172.21.15.49:0/2774715159 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb0b805f300 0x7fb0b80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:22:56.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.393+0000 7fb0d0ff9700 1 -- 172.21.15.49:0/2774715159 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb0c004b990 con 0x7fb0d4154950 2023-11-30T18:22:56.410 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:56.409+0000 7fbfb2bd2680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T18:22:56.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.572+0000 7fb0d98fc700 1 -- 172.21.15.49:0/2774715159 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb0d40c2cf0 con 0x7fb0d4154950 2023-11-30T18:22:56.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.573+0000 7fb0d0ff9700 1 -- 172.21.15.49:0/2774715159 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v170) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb0c004efb0 con 0x7fb0d4154950 2023-11-30T18:22:56.575 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T18:22:56.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.575+0000 7fb0d98fc700 1 -- 172.21.15.49:0/2774715159 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb0b805f300 msgr2=0x7fb0b80617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:22:56.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.575+0000 7fb0d98fc700 1 --2- 172.21.15.49:0/2774715159 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb0b805f300 0x7fb0b80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:56.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.575+0000 7fb0d98fc700 1 -- 172.21.15.49:0/2774715159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0d4154950 msgr2=0x7fb0d40c0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:56.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.575+0000 7fb0d98fc700 1 --2- 172.21.15.49:0/2774715159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0d4154950 0x7fb0d40c0510 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7fb0c000e930 tx=0x7fb0c0009060).stop 2023-11-30T18:22:56.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.575+0000 7fb0d98fc700 1 -- 172.21.15.49:0/2774715159 shutdown_connections 2023-11-30T18:22:56.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.575+0000 7fb0d98fc700 1 --2- 172.21.15.49:0/2774715159 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0d4158570 0x7fb0d40c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:56.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.575+0000 7fb0d98fc700 1 --2- 172.21.15.49:0/2774715159 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0d414e530 0x7fb0d40c2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:56.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.575+0000 7fb0d98fc700 1 --2- 172.21.15.49:0/2774715159 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb0b805f300 0x7fb0b80617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:56.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.575+0000 7fb0d98fc700 1 --2- 172.21.15.49:0/2774715159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0d4154950 0x7fb0d40c0510 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:56.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.575+0000 7fb0d98fc700 1 -- 172.21.15.49:0/2774715159 >> 172.21.15.49:0/2774715159 conn(0x7fb0d4064990 msgr2=0x7fb0d40ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:56.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.575+0000 7fb0d98fc700 1 -- 172.21.15.49:0/2774715159 shutdown_connections 2023-11-30T18:22:56.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.575+0000 7fb0d98fc700 1 -- 172.21.15.49:0/2774715159 wait complete. 2023-11-30T18:22:56.589 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-30T18:22:56.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.711+0000 7f4eddffc700 1 Processor -- start 2023-11-30T18:22:56.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.712+0000 7f4eddffc700 1 -- start start 2023-11-30T18:22:56.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.712+0000 7f4eddffc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4ed814e530 0x7f4ed80c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:56.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.712+0000 7f4eddffc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ed8154950 0x7f4ed814e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:56.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.712+0000 7f4eddffc700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed80c7bc0 con 0x7f4ed8158570 2023-11-30T18:22:56.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.712+0000 7f4eddffc700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed8155920 con 0x7f4ed814e530 2023-11-30T18:22:56.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.712+0000 7f4eddffc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed8154dd0 con 0x7f4ed8154950 2023-11-30T18:22:56.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.713+0000 7f4edd7fb700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4ed8158570 0x7f4ed80aa030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43452/0 (socket says 172.21.15.49:43452) 2023-11-30T18:22:56.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.713+0000 7f4edd7fb700 1 -- 172.21.15.49:0/2961807818 learned_addr learned my addr 172.21.15.49:0/2961807818 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:22:56.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.713+0000 7f4edcffa700 1 --2- 172.21.15.49:0/2961807818 >> v2:172.21.15.115:3300/0 conn(0x7f4ed814e530 0x7f4ed80c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:56.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.713+0000 7f4ed7fff700 1 --2- 172.21.15.49:0/2961807818 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ed8154950 0x7f4ed814e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:56.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.713+0000 7f4ed77fe700 1 -- 172.21.15.49:0/2961807818 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582566417 0 0) 0x7f4ed80c7bc0 con 0x7f4ed8158570 2023-11-30T18:22:56.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.713+0000 7f4ed77fe700 1 -- 172.21.15.49:0/2961807818 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ec80033f0 con 0x7f4ed8158570 2023-11-30T18:22:56.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.713+0000 7f4edcffa700 1 -- 172.21.15.49:0/2961807818 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ed8154950 msgr2=0x7f4ed814e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:56.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.713+0000 7f4edcffa700 1 --2- 172.21.15.49:0/2961807818 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ed8154950 0x7f4ed814e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:56.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.713+0000 7f4edcffa700 1 -- 172.21.15.49:0/2961807818 >> v1:172.21.15.49:6789/0 conn(0x7f4ed8158570 legacy=0x7f4ed80aa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:56.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.713+0000 7f4edcffa700 1 -- 172.21.15.49:0/2961807818 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed8155080 con 0x7f4ed814e530 2023-11-30T18:22:56.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.713+0000 7f4edcffa700 1 --2- 172.21.15.49:0/2961807818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ed814e530 0x7f4ed80c66f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f4ecc009760 tx=0x7f4ecc009060).ready entity=mon.1 client_cookie=75e19530828eb2ae server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:56.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.713+0000 7f4ed77fe700 1 -- 172.21.15.49:0/2961807818 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc0090d0 con 0x7f4ed814e530 2023-11-30T18:22:56.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.713+0000 7f4ed77fe700 1 -- 172.21.15.49:0/2961807818 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ecc00d4a0 con 0x7f4ed814e530 2023-11-30T18:22:56.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.713+0000 7f4ed77fe700 1 -- 172.21.15.49:0/2961807818 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc00d820 con 0x7f4ed814e530 2023-11-30T18:22:56.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.714+0000 7f4eddffc700 1 -- 172.21.15.49:0/2961807818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ed814e530 msgr2=0x7f4ed80c66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:56.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.714+0000 7f4eddffc700 1 --2- 172.21.15.49:0/2961807818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ed814e530 0x7f4ed80c66f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f4ecc009760 tx=0x7f4ecc009060).stop 2023-11-30T18:22:56.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.714+0000 7f4eddffc700 1 -- 172.21.15.49:0/2961807818 shutdown_connections 2023-11-30T18:22:56.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.714+0000 7f4eddffc700 1 --2- 172.21.15.49:0/2961807818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ed814e530 0x7f4ed80c66f0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:56.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.714+0000 7f4eddffc700 1 --2- 172.21.15.49:0/2961807818 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ed8154950 0x7f4ed814e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:56.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.714+0000 7f4eddffc700 1 -- 172.21.15.49:0/2961807818 >> 172.21.15.49:0/2961807818 conn(0x7f4ed8064990 msgr2=0x7f4ed8064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:56.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.714+0000 7f4eddffc700 1 -- 172.21.15.49:0/2961807818 shutdown_connections 2023-11-30T18:22:56.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.714+0000 7f4eddffc700 1 -- 172.21.15.49:0/2961807818 wait complete. 2023-11-30T18:22:56.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.715+0000 7f4eddffc700 1 Processor -- start 2023-11-30T18:22:56.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.715+0000 7f4eddffc700 1 -- start start 2023-11-30T18:22:56.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.716+0000 7f4eddffc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ed814e530 0x7f4ed80c2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:56.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.716+0000 7f4eddffc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ed8154950 0x7f4ed80c0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:56.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.716+0000 7f4eddffc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ed8158570 0x7f4ed80c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:56.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.716+0000 7f4eddffc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed80c2610 con 0x7f4ed8158570 2023-11-30T18:22:56.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.716+0000 7f4eddffc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed80b1000 con 0x7f4ed814e530 2023-11-30T18:22:56.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.716+0000 7f4eddffc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed80c2820 con 0x7f4ed8154950 2023-11-30T18:22:56.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.716+0000 7f4edd7fb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ed8158570 0x7f4ed80c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:56.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.716+0000 7f4edd7fb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ed8158570 0x7f4ed80c3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55300/0 (socket says 172.21.15.49:55300) 2023-11-30T18:22:56.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.716+0000 7f4edd7fb700 1 -- 172.21.15.49:0/714773545 learned_addr learned my addr 172.21.15.49:0/714773545 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:56.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.716+0000 7f4edcffa700 1 --2- 172.21.15.49:0/714773545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ed814e530 0x7f4ed80c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:56.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.716+0000 7f4ed7fff700 1 --2- 172.21.15.49:0/714773545 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ed8154950 0x7f4ed80c0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:56.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.717+0000 7f4edd7fb700 1 -- 172.21.15.49:0/714773545 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ed8154950 msgr2=0x7f4ed80c0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:56.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.717+0000 7f4edd7fb700 1 --2- 172.21.15.49:0/714773545 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ed8154950 0x7f4ed80c0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:56.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.717+0000 7f4edd7fb700 1 -- 172.21.15.49:0/714773545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ed814e530 msgr2=0x7f4ed80c2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:56.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.717+0000 7f4edd7fb700 1 --2- 172.21.15.49:0/714773545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ed814e530 0x7f4ed80c2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:56.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.717+0000 7f4edd7fb700 1 -- 172.21.15.49:0/714773545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ecc0092a0 con 0x7f4ed8158570 2023-11-30T18:22:56.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.717+0000 7f4edcffa700 1 --2- 172.21.15.49:0/714773545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ed814e530 0x7f4ed80c2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:22:56.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.717+0000 7f4edd7fb700 1 --2- 172.21.15.49:0/714773545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ed8158570 0x7f4ed80c3ea0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7f4ed0005ad0 tx=0x7f4ed00015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:56.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.717+0000 7f4ed4ff9700 1 -- 172.21.15.49:0/714773545 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0005d30 con 0x7f4ed8158570 2023-11-30T18:22:56.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.717+0000 7f4ed4ff9700 1 -- 172.21.15.49:0/714773545 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed0005e90 con 0x7f4ed8158570 2023-11-30T18:22:56.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.717+0000 7f4eddffc700 1 -- 172.21.15.49:0/714773545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed80c2b00 con 0x7f4ed8158570 2023-11-30T18:22:56.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.717+0000 7f4ed4ff9700 1 -- 172.21.15.49:0/714773545 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed00072e0 con 0x7f4ed8158570 2023-11-30T18:22:56.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.717+0000 7f4eddffc700 1 -- 172.21.15.49:0/714773545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed80c33a0 con 0x7f4ed8158570 2023-11-30T18:22:56.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.718+0000 7f4eddffc700 1 -- 172.21.15.49:0/714773545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed8062ee0 con 0x7f4ed8158570 2023-11-30T18:22:56.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.719+0000 7f4ed4ff9700 1 -- 172.21.15.49:0/714773545 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 72) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f4ed00076d0 con 0x7f4ed8158570 2023-11-30T18:22:56.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.719+0000 7f4ed4ff9700 1 --2- 172.21.15.49:0/714773545 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4ebc05f300 0x7f4ebc0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:56.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.719+0000 7f4edcffa700 1 -- 172.21.15.49:0/714773545 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4ebc05f300 msgr2=0x7f4ebc0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:56.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.719+0000 7f4ed4ff9700 1 -- 172.21.15.49:0/714773545 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6435+0+0 (secure 0 0 0) 0x7f4ed0079e70 con 0x7f4ed8158570 2023-11-30T18:22:56.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.719+0000 7f4edcffa700 1 --2- 172.21.15.49:0/714773545 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4ebc05f300 0x7f4ebc0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:22:56.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.723+0000 7f4ed4ff9700 1 -- 172.21.15.49:0/714773545 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4ed004ae00 con 0x7f4ed8158570 2023-11-30T18:22:56.736 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:56.735+0000 7f8897cea680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T18:22:56.840 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:56.839+0000 7f8897cea680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:22:56.858 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:56.856+0000 7fbfb2bd2680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T18:22:56.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.895+0000 7f4eddffc700 1 -- 172.21.15.49:0/714773545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4ed80c2cf0 con 0x7f4ed8158570 2023-11-30T18:22:56.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.896+0000 7f4ed4ff9700 1 -- 172.21.15.49:0/714773545 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v170) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4ed004e420 con 0x7f4ed8158570 2023-11-30T18:22:56.897 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T18:22:56.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.898+0000 7f4eddffc700 1 -- 172.21.15.49:0/714773545 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4ebc05f300 msgr2=0x7f4ebc0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:22:56.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.898+0000 7f4eddffc700 1 --2- 172.21.15.49:0/714773545 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4ebc05f300 0x7f4ebc0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:56.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.898+0000 7f4eddffc700 1 -- 172.21.15.49:0/714773545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ed8158570 msgr2=0x7f4ed80c3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:56.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.898+0000 7f4eddffc700 1 --2- 172.21.15.49:0/714773545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ed8158570 0x7f4ed80c3ea0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7f4ed0005ad0 tx=0x7f4ed00015b0).stop 2023-11-30T18:22:56.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.898+0000 7f4eddffc700 1 -- 172.21.15.49:0/714773545 shutdown_connections 2023-11-30T18:22:56.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.898+0000 7f4eddffc700 1 --2- 172.21.15.49:0/714773545 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4ebc05f300 0x7f4ebc0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:56.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.898+0000 7f4eddffc700 1 --2- 172.21.15.49:0/714773545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ed8158570 0x7f4ed80c3ea0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:56.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.898+0000 7f4eddffc700 1 --2- 172.21.15.49:0/714773545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ed814e530 0x7f4ed80c2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:56.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.898+0000 7f4eddffc700 1 --2- 172.21.15.49:0/714773545 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ed8154950 0x7f4ed80c0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:56.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.898+0000 7f4eddffc700 1 -- 172.21.15.49:0/714773545 >> 172.21.15.49:0/714773545 conn(0x7f4ed8064990 msgr2=0x7f4ed80ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:56.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.898+0000 7f4eddffc700 1 -- 172.21.15.49:0/714773545 shutdown_connections 2023-11-30T18:22:56.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:56.898+0000 7f4eddffc700 1 -- 172.21.15.49:0/714773545 wait complete. 2023-11-30T18:22:56.912 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-30T18:22:56.970 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:56.968+0000 7fbfb2bd2680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:22:56.994 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:56.993+0000 7f8897cea680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T18:22:57.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.033+0000 7f33f1835700 1 Processor -- start 2023-11-30T18:22:57.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.033+0000 7f33f1835700 1 -- start start 2023-11-30T18:22:57.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.034+0000 7f33f1835700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f33ec098d10 0x7f33ec0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:57.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.034+0000 7f33f1835700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33ec0c6190 0x7f33ec063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:57.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.034+0000 7f33f1835700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33ec0c72d0 con 0x7f33ec064350 2023-11-30T18:22:57.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.034+0000 7f33f1835700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ec154bc0 con 0x7f33ec098d10 2023-11-30T18:22:57.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.034+0000 7f33f1835700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec0c66c0 con 0x7f33ec0c6190 2023-11-30T18:22:57.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.034+0000 7f33eb7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f33ec064350 0x7f33ec158320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43466/0 (socket says 172.21.15.49:43466) 2023-11-30T18:22:57.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.034+0000 7f33eb7fe700 1 -- 172.21.15.49:0/3645500056 learned_addr learned my addr 172.21.15.49:0/3645500056 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:22:57.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.034+0000 7f33eaffd700 1 --2- 172.21.15.49:0/3645500056 >> v2:172.21.15.115:3300/0 conn(0x7f33ec098d10 0x7f33ec0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:57.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.034+0000 7f33ea7fc700 1 --2- 172.21.15.49:0/3645500056 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33ec0c6190 0x7f33ec063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:57.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.034+0000 7f33e9ffb700 1 -- 172.21.15.49:0/3645500056 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2746144861 0 0) 0x7f33ec0c72d0 con 0x7f33ec064350 2023-11-30T18:22:57.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.034+0000 7f33e9ffb700 1 -- 172.21.15.49:0/3645500056 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33d40033f0 con 0x7f33ec064350 2023-11-30T18:22:57.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.034+0000 7f33eaffd700 1 -- 172.21.15.49:0/3645500056 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33ec0c6190 msgr2=0x7f33ec063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:57.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.034+0000 7f33eaffd700 1 --2- 172.21.15.49:0/3645500056 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33ec0c6190 0x7f33ec063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:57.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.034+0000 7f33eaffd700 1 -- 172.21.15.49:0/3645500056 >> v1:172.21.15.49:6789/0 conn(0x7f33ec064350 legacy=0x7f33ec158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:57.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.034+0000 7f33eaffd700 1 -- 172.21.15.49:0/3645500056 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec0c69a0 con 0x7f33ec098d10 2023-11-30T18:22:57.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.034+0000 7f33eaffd700 1 --2- 172.21.15.49:0/3645500056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33ec098d10 0x7f33ec0c7760 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f33dc009760 tx=0x7f33dc009060).ready entity=mon.1 client_cookie=f5e28542fdaf9cb8 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:57.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.035+0000 7f33e9ffb700 1 -- 172.21.15.49:0/3645500056 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc00d4a0 con 0x7f33ec098d10 2023-11-30T18:22:57.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.035+0000 7f33e9ffb700 1 -- 172.21.15.49:0/3645500056 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33dc00d600 con 0x7f33ec098d10 2023-11-30T18:22:57.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.035+0000 7f33e9ffb700 1 -- 172.21.15.49:0/3645500056 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc00d980 con 0x7f33ec098d10 2023-11-30T18:22:57.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.035+0000 7f33f1835700 1 -- 172.21.15.49:0/3645500056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33ec098d10 msgr2=0x7f33ec0c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:57.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.035+0000 7f33f1835700 1 --2- 172.21.15.49:0/3645500056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33ec098d10 0x7f33ec0c7760 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f33dc009760 tx=0x7f33dc009060).stop 2023-11-30T18:22:57.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.035+0000 7f33f1835700 1 -- 172.21.15.49:0/3645500056 shutdown_connections 2023-11-30T18:22:57.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.035+0000 7f33f1835700 1 --2- 172.21.15.49:0/3645500056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33ec098d10 0x7f33ec0c7760 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:57.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.035+0000 7f33f1835700 1 --2- 172.21.15.49:0/3645500056 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33ec0c6190 0x7f33ec063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:57.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.035+0000 7f33f1835700 1 -- 172.21.15.49:0/3645500056 >> 172.21.15.49:0/3645500056 conn(0x7f33ec0cb310 msgr2=0x7f33ec0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:57.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.035+0000 7f33f1835700 1 -- 172.21.15.49:0/3645500056 shutdown_connections 2023-11-30T18:22:57.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.035+0000 7f33f1835700 1 -- 172.21.15.49:0/3645500056 wait complete. 2023-11-30T18:22:57.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.037+0000 7f33f1835700 1 Processor -- start 2023-11-30T18:22:57.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.037+0000 7f33f1835700 1 -- start start 2023-11-30T18:22:57.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.037+0000 7f33f1835700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33ec064350 0x7f33ec0ab460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:57.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.038+0000 7f33f1835700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33ec098d10 0x7f33ec1559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:57.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.038+0000 7f33f1835700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33ec0c6190 0x7f33ec14b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:57.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.038+0000 7f33f1835700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec0ab950 con 0x7f33ec098d10 2023-11-30T18:22:57.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.038+0000 7f33f1835700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec155e90 con 0x7f33ec0c6190 2023-11-30T18:22:57.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.038+0000 7f33f1835700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec14b790 con 0x7f33ec064350 2023-11-30T18:22:57.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.038+0000 7f33ea7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33ec098d10 0x7f33ec1559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:57.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.038+0000 7f33ea7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33ec098d10 0x7f33ec1559a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55312/0 (socket says 172.21.15.49:55312) 2023-11-30T18:22:57.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.038+0000 7f33ea7fc700 1 -- 172.21.15.49:0/478301471 learned_addr learned my addr 172.21.15.49:0/478301471 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:57.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.038+0000 7f33eb7fe700 1 --2- 172.21.15.49:0/478301471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33ec0c6190 0x7f33ec14b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:57.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.038+0000 7f33eaffd700 1 --2- 172.21.15.49:0/478301471 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33ec064350 0x7f33ec0ab460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:57.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.038+0000 7f33ea7fc700 1 -- 172.21.15.49:0/478301471 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33ec064350 msgr2=0x7f33ec0ab460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:57.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.038+0000 7f33ea7fc700 1 --2- 172.21.15.49:0/478301471 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33ec064350 0x7f33ec0ab460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:57.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.038+0000 7f33ea7fc700 1 -- 172.21.15.49:0/478301471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33ec0c6190 msgr2=0x7f33ec14b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:57.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.038+0000 7f33ea7fc700 1 --2- 172.21.15.49:0/478301471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33ec0c6190 0x7f33ec14b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:57.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.038+0000 7f33ea7fc700 1 -- 172.21.15.49:0/478301471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc0092a0 con 0x7f33ec098d10 2023-11-30T18:22:57.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.038+0000 7f33ea7fc700 1 --2- 172.21.15.49:0/478301471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33ec098d10 0x7f33ec1559a0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f33e000e930 tx=0x7f33e0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:57.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.038+0000 7f33d2ffd700 1 -- 172.21.15.49:0/478301471 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e0009390 con 0x7f33ec098d10 2023-11-30T18:22:57.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.038+0000 7f33d2ffd700 1 -- 172.21.15.49:0/478301471 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e0012600 con 0x7f33ec098d10 2023-11-30T18:22:57.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.038+0000 7f33f1835700 1 -- 172.21.15.49:0/478301471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33ec156b10 con 0x7f33ec098d10 2023-11-30T18:22:57.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.038+0000 7f33d2ffd700 1 -- 172.21.15.49:0/478301471 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e0012980 con 0x7f33ec098d10 2023-11-30T18:22:57.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.038+0000 7f33f1835700 1 -- 172.21.15.49:0/478301471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33ec157090 con 0x7f33ec098d10 2023-11-30T18:22:57.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.040+0000 7f33d2ffd700 1 -- 172.21.15.49:0/478301471 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 72) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f33e001b400 con 0x7f33ec098d10 2023-11-30T18:22:57.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.040+0000 7f33f1835700 1 -- 172.21.15.49:0/478301471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33ec06c860 con 0x7f33ec098d10 2023-11-30T18:22:57.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.040+0000 7f33d2ffd700 1 --2- 172.21.15.49:0/478301471 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f33d805f300 0x7f33d80617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:57.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.040+0000 7f33d2ffd700 1 -- 172.21.15.49:0/478301471 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6435+0+0 (secure 0 0 0) 0x7f33e007a760 con 0x7f33ec098d10 2023-11-30T18:22:57.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.040+0000 7f33eaffd700 1 -- 172.21.15.49:0/478301471 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f33d805f300 msgr2=0x7f33d80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:57.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.040+0000 7f33eaffd700 1 --2- 172.21.15.49:0/478301471 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f33d805f300 0x7f33d80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:22:57.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.044+0000 7f33d2ffd700 1 -- 172.21.15.49:0/478301471 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f33e004b690 con 0x7f33ec098d10 2023-11-30T18:22:57.070 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:57.069+0000 7f8897cea680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T18:22:57.137 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:57.136+0000 7f8897cea680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T18:22:57.138 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:57.137+0000 7fbfb2bd2680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T18:22:57.217 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:57.215+0000 7fbfb2bd2680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T18:22:57.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.225+0000 7f33f1835700 1 -- 172.21.15.49:0/478301471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f33ec0c6c80 con 0x7f33ec098d10 2023-11-30T18:22:57.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.225+0000 7f33d2ffd700 1 -- 172.21.15.49:0/478301471 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v170) v1 ==== 100+0+11 (secure 0 0 0) 0x7f33e0016020 con 0x7f33ec098d10 2023-11-30T18:22:57.227 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T18:22:57.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.228+0000 7f33f1835700 1 -- 172.21.15.49:0/478301471 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f33d805f300 msgr2=0x7f33d80617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:22:57.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.228+0000 7f33f1835700 1 --2- 172.21.15.49:0/478301471 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f33d805f300 0x7f33d80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:57.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.228+0000 7f33f1835700 1 -- 172.21.15.49:0/478301471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33ec098d10 msgr2=0x7f33ec1559a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:57.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.228+0000 7f33f1835700 1 --2- 172.21.15.49:0/478301471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33ec098d10 0x7f33ec1559a0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f33e000e930 tx=0x7f33e0009060).stop 2023-11-30T18:22:57.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.229+0000 7f33f1835700 1 -- 172.21.15.49:0/478301471 shutdown_connections 2023-11-30T18:22:57.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.229+0000 7f33f1835700 1 --2- 172.21.15.49:0/478301471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33ec0c6190 0x7f33ec14b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:57.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.229+0000 7f33f1835700 1 --2- 172.21.15.49:0/478301471 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f33ec064350 0x7f33ec0ab460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:57.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.229+0000 7f33f1835700 1 --2- 172.21.15.49:0/478301471 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f33d805f300 0x7f33d80617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:57.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.229+0000 7f33f1835700 1 --2- 172.21.15.49:0/478301471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33ec098d10 0x7f33ec1559a0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:57.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.229+0000 7f33f1835700 1 -- 172.21.15.49:0/478301471 >> 172.21.15.49:0/478301471 conn(0x7f33ec0cb310 msgr2=0x7f33ec0ca360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:57.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.229+0000 7f33f1835700 1 -- 172.21.15.49:0/478301471 shutdown_connections 2023-11-30T18:22:57.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.229+0000 7f33f1835700 1 -- 172.21.15.49:0/478301471 wait complete. 2023-11-30T18:22:57.248 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:22:57.297 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:57.295+0000 7fbfb2bd2680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T18:22:57.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.366+0000 7fbeddba0700 1 Processor -- start 2023-11-30T18:22:57.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.366+0000 7fbeddba0700 1 -- start start 2023-11-30T18:22:57.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.367+0000 7fbeddba0700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbed8069330 0x7fbed806b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:57.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.367+0000 7fbeddba0700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbed8157a60 0x7fbed80c1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:57.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.367+0000 7fbeddba0700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed8062f60 con 0x7fbed8157680 2023-11-30T18:22:57.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.367+0000 7fbeddba0700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed8062700 con 0x7fbed8157a60 2023-11-30T18:22:57.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.367+0000 7fbeddba0700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed80c1f30 con 0x7fbed8069330 2023-11-30T18:22:57.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.367+0000 7fbedd39f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbed8157a60 0x7fbed80c1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:57.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.367+0000 7fbedd39f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbed8157a60 0x7fbed80c1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55328/0 (socket says 172.21.15.49:55328) 2023-11-30T18:22:57.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.367+0000 7fbedd39f700 1 -- 172.21.15.49:0/1940878053 learned_addr learned my addr 172.21.15.49:0/1940878053 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:57.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.367+0000 7fbed7fff700 1 --2- 172.21.15.49:0/1940878053 >> v2:172.21.15.115:3300/0 conn(0x7fbed8069330 0x7fbed806b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:57.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.368+0000 7fbedd39f700 1 -- 172.21.15.49:0/1940878053 >> v2:172.21.15.115:3300/0 conn(0x7fbed8069330 msgr2=0x7fbed806b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:57.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.368+0000 7fbedd39f700 1 --2- 172.21.15.49:0/1940878053 >> v2:172.21.15.115:3300/0 conn(0x7fbed8069330 0x7fbed806b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:57.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.368+0000 7fbedd39f700 1 -- 172.21.15.49:0/1940878053 >> v1:172.21.15.115:6789/0 conn(0x7fbed8157680 legacy=0x7fbed8068c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:57.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.368+0000 7fbedd39f700 1 -- 172.21.15.49:0/1940878053 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed8069f80 con 0x7fbed8157a60 2023-11-30T18:22:57.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.368+0000 7fbedd39f700 1 --2- 172.21.15.49:0/1940878053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbed8157a60 0x7fbed80c1a40 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7fbed80687d0 tx=0x7fbed0009840).ready entity=mon.0 client_cookie=15ed16e6a9412beb server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:57.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.368+0000 7fbed77fe700 1 -- 172.21.15.49:0/1940878053 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed000e070 con 0x7fbed8157a60 2023-11-30T18:22:57.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.368+0000 7fbed77fe700 1 -- 172.21.15.49:0/1940878053 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed000ba20 con 0x7fbed8157a60 2023-11-30T18:22:57.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.368+0000 7fbed77fe700 1 -- 172.21.15.49:0/1940878053 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed000bda0 con 0x7fbed8157a60 2023-11-30T18:22:57.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.369+0000 7fbeddba0700 1 -- 172.21.15.49:0/1940878053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbed8157a60 msgr2=0x7fbed80c1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:57.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.369+0000 7fbeddba0700 1 --2- 172.21.15.49:0/1940878053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbed8157a60 0x7fbed80c1a40 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7fbed80687d0 tx=0x7fbed0009840).stop 2023-11-30T18:22:57.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.369+0000 7fbeddba0700 1 -- 172.21.15.49:0/1940878053 shutdown_connections 2023-11-30T18:22:57.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.369+0000 7fbeddba0700 1 --2- 172.21.15.49:0/1940878053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbed8157a60 0x7fbed80c1a40 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:57.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.369+0000 7fbeddba0700 1 --2- 172.21.15.49:0/1940878053 >> v2:172.21.15.115:3300/0 conn(0x7fbed8069330 0x7fbed806b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:57.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.369+0000 7fbeddba0700 1 -- 172.21.15.49:0/1940878053 >> 172.21.15.49:0/1940878053 conn(0x7fbed80c7eb0 msgr2=0x7fbed80c3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:57.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.369+0000 7fbeddba0700 1 -- 172.21.15.49:0/1940878053 shutdown_connections 2023-11-30T18:22:57.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.369+0000 7fbeddba0700 1 -- 172.21.15.49:0/1940878053 wait complete. 2023-11-30T18:22:57.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.370+0000 7fbeddba0700 1 Processor -- start 2023-11-30T18:22:57.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.370+0000 7fbeddba0700 1 -- start start 2023-11-30T18:22:57.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.371+0000 7fbeddba0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbed8069330 0x7fbed8165180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:57.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.371+0000 7fbeddba0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbed8157680 0x7fbed80c0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:57.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.371+0000 7fbeddba0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbed8157a60 0x7fbed8151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:57.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.371+0000 7fbeddba0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed814bed0 con 0x7fbed8157680 2023-11-30T18:22:57.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.371+0000 7fbeddba0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed814b2c0 con 0x7fbed8069330 2023-11-30T18:22:57.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.371+0000 7fbeddba0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed814b5a0 con 0x7fbed8157a60 2023-11-30T18:22:57.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.371+0000 7fbed7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbed8157680 0x7fbed80c0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:57.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.371+0000 7fbed7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbed8157680 0x7fbed80c0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55332/0 (socket says 172.21.15.49:55332) 2023-11-30T18:22:57.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.371+0000 7fbed7fff700 1 -- 172.21.15.49:0/3837303249 learned_addr learned my addr 172.21.15.49:0/3837303249 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:57.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.371+0000 7fbedcb9e700 1 --2- 172.21.15.49:0/3837303249 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbed8069330 0x7fbed8165180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:57.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.371+0000 7fbedd39f700 1 --2- 172.21.15.49:0/3837303249 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbed8157a60 0x7fbed8151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:57.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.371+0000 7fbed7fff700 1 -- 172.21.15.49:0/3837303249 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbed8157a60 msgr2=0x7fbed8151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:57.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.371+0000 7fbed7fff700 1 --2- 172.21.15.49:0/3837303249 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbed8157a60 0x7fbed8151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:57.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.371+0000 7fbed7fff700 1 -- 172.21.15.49:0/3837303249 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbed8069330 msgr2=0x7fbed8165180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:57.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.371+0000 7fbed7fff700 1 --2- 172.21.15.49:0/3837303249 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbed8069330 0x7fbed8165180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:57.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.371+0000 7fbed7fff700 1 -- 172.21.15.49:0/3837303249 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed0009ae0 con 0x7fbed8157680 2023-11-30T18:22:57.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.371+0000 7fbed7fff700 1 --2- 172.21.15.49:0/3837303249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbed8157680 0x7fbed80c0d70 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7fbec400e900 tx=0x7fbec4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:57.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.372+0000 7fbed4ff9700 1 -- 172.21.15.49:0/3837303249 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec4012600 con 0x7fbed8157680 2023-11-30T18:22:57.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.372+0000 7fbed4ff9700 1 -- 172.21.15.49:0/3837303249 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec4012760 con 0x7fbed8157680 2023-11-30T18:22:57.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.372+0000 7fbed4ff9700 1 -- 172.21.15.49:0/3837303249 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec4012ae0 con 0x7fbed8157680 2023-11-30T18:22:57.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.372+0000 7fbeddba0700 1 -- 172.21.15.49:0/3837303249 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed814b880 con 0x7fbed8157680 2023-11-30T18:22:57.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.372+0000 7fbeddba0700 1 -- 172.21.15.49:0/3837303249 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed8165670 con 0x7fbed8157680 2023-11-30T18:22:57.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.373+0000 7fbeddba0700 1 -- 172.21.15.49:0/3837303249 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbed806c7c0 con 0x7fbed8157680 2023-11-30T18:22:57.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.374+0000 7fbed4ff9700 1 -- 172.21.15.49:0/3837303249 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 72) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fbec401b400 con 0x7fbed8157680 2023-11-30T18:22:57.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.374+0000 7fbed4ff9700 1 --2- 172.21.15.49:0/3837303249 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbebc05f300 0x7fbebc0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:57.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.374+0000 7fbedcb9e700 1 -- 172.21.15.49:0/3837303249 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbebc05f300 msgr2=0x7fbebc0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:57.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.374+0000 7fbed4ff9700 1 -- 172.21.15.49:0/3837303249 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6435+0+0 (secure 0 0 0) 0x7fbec407aa30 con 0x7fbed8157680 2023-11-30T18:22:57.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.374+0000 7fbedcb9e700 1 --2- 172.21.15.49:0/3837303249 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbebc05f300 0x7fbebc0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:22:57.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.382+0000 7fbed4ff9700 1 -- 172.21.15.49:0/3837303249 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbec404b960 con 0x7fbed8157680 2023-11-30T18:22:57.398 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:57.397+0000 7f8897cea680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T18:22:57.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.575+0000 7fbedcb9e700 1 -- 172.21.15.49:0/3837303249 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbebc05f300 msgr2=0x7fbebc0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:57.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.575+0000 7fbedcb9e700 1 --2- 172.21.15.49:0/3837303249 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbebc05f300 0x7fbebc0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T18:22:57.578 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:57.577+0000 7fbfb2bd2680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T18:22:57.581 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:57.580+0000 7f8897cea680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T18:22:57.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.600+0000 7fbeddba0700 1 -- 172.21.15.49:0/3837303249 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbed814c010 con 0x7fbed8157680 2023-11-30T18:22:57.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.601+0000 7fbed4ff9700 1 -- 172.21.15.49:0/3837303249 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4497 (secure 0 0 0) 0x7fbec4016070 con 0x7fbed8157680 2023-11-30T18:22:57.603 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:22:57.603 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":69,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7193,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/4003300500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4003300500},{"type":"v1","addr":"172.21.15.49:6835","nonce":4003300500}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7205,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3715169351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3715169351},{"type":"v1","addr":"172.21.15.115:6837","nonce":3715169351}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":8272,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2922134566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2922134566},{"type":"v1","addr":"172.21.15.115:6836","nonce":2922134566}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T18:22:39.426066+0000","modified":"2023-11-30T18:22:42.436489+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8505},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8505":{"gid":8505,"name":"a","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6833/3939533550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3939533550},{"type":"v1","addr":"172.21.15.49:6833","nonce":3939533550}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-11-30T18:22:57.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.603+0000 7fbeddba0700 1 -- 172.21.15.49:0/3837303249 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbebc05f300 msgr2=0x7fbebc0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:22:57.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.603+0000 7fbeddba0700 1 --2- 172.21.15.49:0/3837303249 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbebc05f300 0x7fbebc0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:57.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.603+0000 7fbeddba0700 1 -- 172.21.15.49:0/3837303249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbed8157680 msgr2=0x7fbed80c0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:57.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.603+0000 7fbeddba0700 1 --2- 172.21.15.49:0/3837303249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbed8157680 0x7fbed80c0d70 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7fbec400e900 tx=0x7fbec4009060).stop 2023-11-30T18:22:57.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.603+0000 7fbeddba0700 1 -- 172.21.15.49:0/3837303249 shutdown_connections 2023-11-30T18:22:57.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.603+0000 7fbeddba0700 1 --2- 172.21.15.49:0/3837303249 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbed8157a60 0x7fbed8151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:57.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.603+0000 7fbeddba0700 1 --2- 172.21.15.49:0/3837303249 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbed8069330 0x7fbed8165180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:57.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.603+0000 7fbeddba0700 1 --2- 172.21.15.49:0/3837303249 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbebc05f300 0x7fbebc0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:57.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.603+0000 7fbeddba0700 1 --2- 172.21.15.49:0/3837303249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbed8157680 0x7fbed80c0d70 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:57.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.603+0000 7fbeddba0700 1 -- 172.21.15.49:0/3837303249 >> 172.21.15.49:0/3837303249 conn(0x7fbed80c7eb0 msgr2=0x7fbed80c1720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:57.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.603+0000 7fbeddba0700 1 -- 172.21.15.49:0/3837303249 shutdown_connections 2023-11-30T18:22:57.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.603+0000 7fbeddba0700 1 -- 172.21.15.49:0/3837303249 wait complete. 2023-11-30T18:22:57.606 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 69 2023-11-30T18:22:57.617 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:22:57.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.738+0000 7f3c0e7ec700 1 Processor -- start 2023-11-30T18:22:57.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.738+0000 7f3c0e7ec700 1 -- start start 2023-11-30T18:22:57.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.739+0000 7f3c0e7ec700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c080bc8a0 0x7f3c08154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:57.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.739+0000 7f3c0e7ec700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3c081552b0 0x7f3c08155740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:57.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.739+0000 7f3c0e7ec700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c08065ca0 con 0x7f3c080bc4c0 2023-11-30T18:22:57.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.739+0000 7f3c0e7ec700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c080bcd00 con 0x7f3c081552b0 2023-11-30T18:22:57.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.739+0000 7f3c0e7ec700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c08158050 con 0x7f3c080bc8a0 2023-11-30T18:22:57.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.739+0000 7f3c0cd89700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3c081552b0 0x7f3c08155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:57.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.739+0000 7f3c07fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3c080bc4c0 0x7f3c08065590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43472/0 (socket says 172.21.15.49:43472) 2023-11-30T18:22:57.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.739+0000 7f3c0cd89700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3c081552b0 0x7f3c08155740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55338/0 (socket says 172.21.15.49:55338) 2023-11-30T18:22:57.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.739+0000 7f3c07fff700 1 -- 172.21.15.49:0/3263867680 learned_addr learned my addr 172.21.15.49:0/3263867680 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:22:57.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.739+0000 7f3c077fe700 1 --2- 172.21.15.49:0/3263867680 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c080bc8a0 0x7f3c08154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:57.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.739+0000 7f3c0cd89700 1 -- 172.21.15.49:0/3263867680 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c080bc8a0 msgr2=0x7f3c08154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:57.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.739+0000 7f3c0cd89700 1 --2- 172.21.15.49:0/3263867680 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c080bc8a0 0x7f3c08154dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:57.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.739+0000 7f3c0cd89700 1 -- 172.21.15.49:0/3263867680 >> v1:172.21.15.49:6789/0 conn(0x7f3c080bc4c0 legacy=0x7f3c08065590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:57.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.739+0000 7f3c06ffd700 1 -- 172.21.15.49:0/3263867680 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 571264713 0 0) 0x7f3c08065ca0 con 0x7f3c080bc4c0 2023-11-30T18:22:57.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.739+0000 7f3c0cd89700 1 -- 172.21.15.49:0/3263867680 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c08158330 con 0x7f3c081552b0 2023-11-30T18:22:57.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.739+0000 7f3c0cd89700 1 --2- 172.21.15.49:0/3263867680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c081552b0 0x7f3c08155740 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7f3c00009e60 tx=0x7f3c00009780).ready entity=mon.0 client_cookie=f4d683208b1f562c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:57.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.740+0000 7f3c06ffd700 1 -- 172.21.15.49:0/3263867680 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0000e070 con 0x7f3c081552b0 2023-11-30T18:22:57.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.740+0000 7f3c06ffd700 1 -- 172.21.15.49:0/3263867680 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0000bbf0 con 0x7f3c081552b0 2023-11-30T18:22:57.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.740+0000 7f3c06ffd700 1 -- 172.21.15.49:0/3263867680 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00012410 con 0x7f3c081552b0 2023-11-30T18:22:57.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.740+0000 7f3c0e7ec700 1 -- 172.21.15.49:0/3263867680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c081552b0 msgr2=0x7f3c08155740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:57.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.740+0000 7f3c0e7ec700 1 --2- 172.21.15.49:0/3263867680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c081552b0 0x7f3c08155740 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7f3c00009e60 tx=0x7f3c00009780).stop 2023-11-30T18:22:57.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.740+0000 7f3c0e7ec700 1 -- 172.21.15.49:0/3263867680 shutdown_connections 2023-11-30T18:22:57.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.740+0000 7f3c0e7ec700 1 --2- 172.21.15.49:0/3263867680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c081552b0 0x7f3c08155740 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:57.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.740+0000 7f3c0e7ec700 1 --2- 172.21.15.49:0/3263867680 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c080bc8a0 0x7f3c08154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:57.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.740+0000 7f3c0e7ec700 1 -- 172.21.15.49:0/3263867680 >> 172.21.15.49:0/3263867680 conn(0x7f3c0806b510 msgr2=0x7f3c0806b920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:57.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.740+0000 7f3c0e7ec700 1 -- 172.21.15.49:0/3263867680 shutdown_connections 2023-11-30T18:22:57.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.740+0000 7f3c0e7ec700 1 -- 172.21.15.49:0/3263867680 wait complete. 2023-11-30T18:22:57.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.741+0000 7f3c0e7ec700 1 Processor -- start 2023-11-30T18:22:57.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.742+0000 7f3c0e7ec700 1 -- start start 2023-11-30T18:22:57.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.742+0000 7f3c0e7ec700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c080bc4c0 0x7f3c080c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:57.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.742+0000 7f3c0e7ec700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c080bc8a0 0x7f3c080c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:57.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.742+0000 7f3c0e7ec700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c081552b0 0x7f3c08144f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:57.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.742+0000 7f3c0e7ec700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c080c63e0 con 0x7f3c081552b0 2023-11-30T18:22:57.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.742+0000 7f3c0e7ec700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c080ab2e0 con 0x7f3c080bc4c0 2023-11-30T18:22:57.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.742+0000 7f3c0e7ec700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c080ab880 con 0x7f3c080bc8a0 2023-11-30T18:22:57.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.742+0000 7f3c0cd89700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c081552b0 0x7f3c08144f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:57.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.743+0000 7f3c0cd89700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c081552b0 0x7f3c08144f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55344/0 (socket says 172.21.15.49:55344) 2023-11-30T18:22:57.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.743+0000 7f3c0cd89700 1 -- 172.21.15.49:0/1940279470 learned_addr learned my addr 172.21.15.49:0/1940279470 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:57.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.743+0000 7f3c077fe700 1 --2- 172.21.15.49:0/1940279470 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c080bc8a0 0x7f3c080c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:57.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.743+0000 7f3c07fff700 1 --2- 172.21.15.49:0/1940279470 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c080bc4c0 0x7f3c080c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:57.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.743+0000 7f3c0cd89700 1 -- 172.21.15.49:0/1940279470 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c080bc8a0 msgr2=0x7f3c080c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:57.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.743+0000 7f3c0cd89700 1 --2- 172.21.15.49:0/1940279470 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c080bc8a0 0x7f3c080c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:57.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.743+0000 7f3c0cd89700 1 -- 172.21.15.49:0/1940279470 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c080bc4c0 msgr2=0x7f3c080c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:57.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.743+0000 7f3c0cd89700 1 --2- 172.21.15.49:0/1940279470 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c080bc4c0 0x7f3c080c65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:57.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.743+0000 7f3c0cd89700 1 -- 172.21.15.49:0/1940279470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c00009a20 con 0x7f3c081552b0 2023-11-30T18:22:57.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.743+0000 7f3c0cd89700 1 --2- 172.21.15.49:0/1940279470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c081552b0 0x7f3c08144f30 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7f3c0000b6c0 tx=0x7f3c00009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:57.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.743+0000 7f3beffff700 1 -- 172.21.15.49:0/1940279470 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0001d630 con 0x7f3c081552b0 2023-11-30T18:22:57.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.743+0000 7f3beffff700 1 -- 172.21.15.49:0/1940279470 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0001d790 con 0x7f3c081552b0 2023-11-30T18:22:57.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.743+0000 7f3c0e7ec700 1 -- 172.21.15.49:0/1940279470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c080c5e20 con 0x7f3c081552b0 2023-11-30T18:22:57.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.743+0000 7f3beffff700 1 -- 172.21.15.49:0/1940279470 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0001db30 con 0x7f3c081552b0 2023-11-30T18:22:57.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.743+0000 7f3c0e7ec700 1 -- 172.21.15.49:0/1940279470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c080ab510 con 0x7f3c081552b0 2023-11-30T18:22:57.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.744+0000 7f3c0e7ec700 1 -- 172.21.15.49:0/1940279470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c0806c860 con 0x7f3c081552b0 2023-11-30T18:22:57.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.745+0000 7f3beffff700 1 -- 172.21.15.49:0/1940279470 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 72) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f3c00003040 con 0x7f3c081552b0 2023-11-30T18:22:57.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.745+0000 7f3beffff700 1 --2- 172.21.15.49:0/1940279470 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3bf405f300 0x7f3bf40617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:57.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.745+0000 7f3beffff700 1 -- 172.21.15.49:0/1940279470 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6435+0+0 (secure 0 0 0) 0x7f3c0007c640 con 0x7f3c081552b0 2023-11-30T18:22:57.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.745+0000 7f3c07fff700 1 -- 172.21.15.49:0/1940279470 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3bf405f300 msgr2=0x7f3bf40617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:57.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.745+0000 7f3c07fff700 1 --2- 172.21.15.49:0/1940279470 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3bf405f300 0x7f3bf40617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:22:57.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.749+0000 7f3beffff700 1 -- 172.21.15.49:0/1940279470 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3c00050f70 con 0x7f3c081552b0 2023-11-30T18:22:57.774 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:57.772+0000 7fbfb2bd2680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T18:22:57.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.923+0000 7f3c0e7ec700 1 -- 172.21.15.49:0/1940279470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c080ab9c0 con 0x7f3c081552b0 2023-11-30T18:22:57.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.924+0000 7f3beffff700 1 -- 172.21.15.49:0/1940279470 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+17403 (secure 0 0 0) 0x7f3c00050b60 con 0x7f3c081552b0 2023-11-30T18:22:57.926 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:22:57.926 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":170,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:22:51.928387+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-11-30T18:22:37.085862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-11-30T18:22:38.409621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/1847633149":"2023-12-01T18:22:51.928346+0000","172.21.15.115:6833/89956":"2023-12-01T18:22:51.928346+0000","172.21.15.115:6832/89956":"2023-12-01T18:22:51.928346+0000","172.21.15.115:0/3691284164":"2023-12-01T18:22:51.928346+0000","172.21.15.115:0/1259529053":"2023-12-01T18:22:51.928346+0000","172.21.15.115:0/596329516":"2023-12-01T18:22:51.928346+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:22:57.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.926+0000 7f3c0e7ec700 1 -- 172.21.15.49:0/1940279470 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3bf405f300 msgr2=0x7f3bf40617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:22:57.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.926+0000 7f3c0e7ec700 1 --2- 172.21.15.49:0/1940279470 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3bf405f300 0x7f3bf40617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:57.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.926+0000 7f3c0e7ec700 1 -- 172.21.15.49:0/1940279470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c081552b0 msgr2=0x7f3c08144f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:57.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.926+0000 7f3c0e7ec700 1 --2- 172.21.15.49:0/1940279470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c081552b0 0x7f3c08144f30 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7f3c0000b6c0 tx=0x7f3c00009780).stop 2023-11-30T18:22:57.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.926+0000 7f3c0e7ec700 1 -- 172.21.15.49:0/1940279470 shutdown_connections 2023-11-30T18:22:57.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.926+0000 7f3c0e7ec700 1 --2- 172.21.15.49:0/1940279470 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f3bf405f300 0x7f3bf40617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:57.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.926+0000 7f3c0e7ec700 1 --2- 172.21.15.49:0/1940279470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c081552b0 0x7f3c08144f30 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:57.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.926+0000 7f3c0e7ec700 1 --2- 172.21.15.49:0/1940279470 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c080bc4c0 0x7f3c080c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:57.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.926+0000 7f3c0e7ec700 1 --2- 172.21.15.49:0/1940279470 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c080bc8a0 0x7f3c080c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:57.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.926+0000 7f3c0e7ec700 1 -- 172.21.15.49:0/1940279470 >> 172.21.15.49:0/1940279470 conn(0x7f3c0806b510 msgr2=0x7f3c0806b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:57.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.926+0000 7f3c0e7ec700 1 -- 172.21.15.49:0/1940279470 shutdown_connections 2023-11-30T18:22:57.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:57.926+0000 7f3c0e7ec700 1 -- 172.21.15.49:0/1940279470 wait complete. 2023-11-30T18:22:57.941 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-30T18:22:57.941 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:22:58.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.060+0000 7f39ea59d700 1 Processor -- start 2023-11-30T18:22:58.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.060+0000 7f39ea59d700 1 -- start start 2023-11-30T18:22:58.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.061+0000 7f39ea59d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f39e40cae90 0x7f39e40c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:58.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.061+0000 7f39ea59d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39e40ca180 0x7f39e40c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:58.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.061+0000 7f39ea59d700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e40a9a90 con 0x7f39e40caab0 2023-11-30T18:22:58.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.061+0000 7f39ea59d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39e40c1490 con 0x7f39e40cae90 2023-11-30T18:22:58.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.061+0000 7f39ea59d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e4154ce0 con 0x7f39e40ca180 2023-11-30T18:22:58.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.061+0000 7f39e3fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f39e40caab0 0x7f39e40aa470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43488/0 (socket says 172.21.15.49:43488) 2023-11-30T18:22:58.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.061+0000 7f39e3fff700 1 -- 172.21.15.49:0/1862089233 learned_addr learned my addr 172.21.15.49:0/1862089233 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:22:58.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.062+0000 7f39e37fe700 1 --2- 172.21.15.49:0/1862089233 >> v2:172.21.15.115:3300/0 conn(0x7f39e40cae90 0x7f39e40c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:58.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.062+0000 7f39e8b3a700 1 --2- 172.21.15.49:0/1862089233 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39e40ca180 0x7f39e40c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:58.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.062+0000 7f39e2ffd700 1 -- 172.21.15.49:0/1862089233 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867464281 0 0) 0x7f39e40a9a90 con 0x7f39e40caab0 2023-11-30T18:22:58.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.062+0000 7f39e2ffd700 1 -- 172.21.15.49:0/1862089233 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39cc0033f0 con 0x7f39e40caab0 2023-11-30T18:22:58.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.062+0000 7f39e2ffd700 1 -- 172.21.15.49:0/1862089233 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 509797087 0 0) 0x7f39cc0033f0 con 0x7f39e40caab0 2023-11-30T18:22:58.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.062+0000 7f39e37fe700 1 -- 172.21.15.49:0/1862089233 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39e40ca180 msgr2=0x7f39e40c0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:58.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.062+0000 7f39e37fe700 1 --2- 172.21.15.49:0/1862089233 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39e40ca180 0x7f39e40c0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:58.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.062+0000 7f39e37fe700 1 -- 172.21.15.49:0/1862089233 >> v1:172.21.15.49:6789/0 conn(0x7f39e40caab0 legacy=0x7f39e40aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:58.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.062+0000 7f39e37fe700 1 -- 172.21.15.49:0/1862089233 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e40aab80 con 0x7f39e40cae90 2023-11-30T18:22:58.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.062+0000 7f39e8b3a700 1 --2- 172.21.15.49:0/1862089233 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39e40ca180 0x7f39e40c0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:22:58.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.062+0000 7f39e37fe700 1 --2- 172.21.15.49:0/1862089233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39e40cae90 0x7f39e40c0ab0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f39d4009760 tx=0x7f39d4009060).ready entity=mon.1 client_cookie=14f348da8c9b35cd server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:58.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.062+0000 7f39e2ffd700 1 -- 172.21.15.49:0/1862089233 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d80015f0 con 0x7f39e40cae90 2023-11-30T18:22:58.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.062+0000 7f39e2ffd700 1 -- 172.21.15.49:0/1862089233 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d4011400 con 0x7f39e40cae90 2023-11-30T18:22:58.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.062+0000 7f39e2ffd700 1 -- 172.21.15.49:0/1862089233 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d4011780 con 0x7f39e40cae90 2023-11-30T18:22:58.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.063+0000 7f39ea59d700 1 -- 172.21.15.49:0/1862089233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39e40cae90 msgr2=0x7f39e40c0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:58.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.063+0000 7f39ea59d700 1 --2- 172.21.15.49:0/1862089233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39e40cae90 0x7f39e40c0ab0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f39d4009760 tx=0x7f39d4009060).stop 2023-11-30T18:22:58.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.063+0000 7f39ea59d700 1 -- 172.21.15.49:0/1862089233 shutdown_connections 2023-11-30T18:22:58.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.063+0000 7f39ea59d700 1 --2- 172.21.15.49:0/1862089233 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39e40ca180 0x7f39e40c0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:58.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.063+0000 7f39ea59d700 1 --2- 172.21.15.49:0/1862089233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39e40cae90 0x7f39e40c0ab0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:58.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.063+0000 7f39ea59d700 1 -- 172.21.15.49:0/1862089233 >> 172.21.15.49:0/1862089233 conn(0x7f39e4094920 msgr2=0x7f39e406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:58.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.063+0000 7f39ea59d700 1 -- 172.21.15.49:0/1862089233 shutdown_connections 2023-11-30T18:22:58.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.063+0000 7f39ea59d700 1 -- 172.21.15.49:0/1862089233 wait complete. 2023-11-30T18:22:58.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.064+0000 7f39ea59d700 1 Processor -- start 2023-11-30T18:22:58.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.064+0000 7f39ea59d700 1 -- start start 2023-11-30T18:22:58.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.065+0000 7f39ea59d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39e40ca180 0x7f39e414cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:58.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.065+0000 7f39ea59d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39e40caab0 0x7f39e40c3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:58.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.065+0000 7f39ea59d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39e40cae90 0x7f39e4159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:58.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.065+0000 7f39ea59d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e40c2310 con 0x7f39e40ca180 2023-11-30T18:22:58.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.065+0000 7f39ea59d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e40c2560 con 0x7f39e40caab0 2023-11-30T18:22:58.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.065+0000 7f39ea59d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e40c2840 con 0x7f39e40cae90 2023-11-30T18:22:58.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.065+0000 7f39e3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39e40ca180 0x7f39e414cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:58.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.065+0000 7f39e3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39e40ca180 0x7f39e414cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55352/0 (socket says 172.21.15.49:55352) 2023-11-30T18:22:58.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.065+0000 7f39e3fff700 1 -- 172.21.15.49:0/1122677547 learned_addr learned my addr 172.21.15.49:0/1122677547 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:58.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.065+0000 7f39e37fe700 1 --2- 172.21.15.49:0/1122677547 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39e40caab0 0x7f39e40c3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:58.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.065+0000 7f39e8b3a700 1 --2- 172.21.15.49:0/1122677547 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39e40cae90 0x7f39e4159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:58.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.066+0000 7f39e3fff700 1 -- 172.21.15.49:0/1122677547 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39e40cae90 msgr2=0x7f39e4159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:58.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.066+0000 7f39e3fff700 1 --2- 172.21.15.49:0/1122677547 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39e40cae90 0x7f39e4159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:58.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.066+0000 7f39e3fff700 1 -- 172.21.15.49:0/1122677547 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39e40caab0 msgr2=0x7f39e40c3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:58.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.066+0000 7f39e3fff700 1 --2- 172.21.15.49:0/1122677547 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39e40caab0 0x7f39e40c3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:58.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.066+0000 7f39e3fff700 1 -- 172.21.15.49:0/1122677547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39dc009a20 con 0x7f39e40ca180 2023-11-30T18:22:58.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.066+0000 7f39e37fe700 1 --2- 172.21.15.49:0/1122677547 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39e40caab0 0x7f39e40c3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:22:58.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.066+0000 7f39e3fff700 1 --2- 172.21.15.49:0/1122677547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39e40ca180 0x7f39e414cff0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7f39d800c810 tx=0x7f39d8001440).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:58.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.066+0000 7f39cbfff700 1 -- 172.21.15.49:0/1122677547 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8007320 con 0x7f39e40ca180 2023-11-30T18:22:58.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.066+0000 7f39cbfff700 1 -- 172.21.15.49:0/1122677547 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d8007480 con 0x7f39e40ca180 2023-11-30T18:22:58.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.066+0000 7f39ea59d700 1 -- 172.21.15.49:0/1122677547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d40092a0 con 0x7f39e40ca180 2023-11-30T18:22:58.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.066+0000 7f39cbfff700 1 -- 172.21.15.49:0/1122677547 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8005880 con 0x7f39e40ca180 2023-11-30T18:22:58.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.066+0000 7f39ea59d700 1 -- 172.21.15.49:0/1122677547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e40c2e80 con 0x7f39e40ca180 2023-11-30T18:22:58.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.067+0000 7f39ea59d700 1 -- 172.21.15.49:0/1122677547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39e406c860 con 0x7f39e40ca180 2023-11-30T18:22:58.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.067+0000 7f39cbfff700 1 -- 172.21.15.49:0/1122677547 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 72) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f39d8005c70 con 0x7f39e40ca180 2023-11-30T18:22:58.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.068+0000 7f39cbfff700 1 --2- 172.21.15.49:0/1122677547 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f39d005f300 0x7f39d00617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:58.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.068+0000 7f39cbfff700 1 -- 172.21.15.49:0/1122677547 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6435+0+0 (secure 0 0 0) 0x7f39d807a590 con 0x7f39e40ca180 2023-11-30T18:22:58.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.068+0000 7f39e37fe700 1 -- 172.21.15.49:0/1122677547 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f39d005f300 msgr2=0x7f39d00617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:58.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.068+0000 7f39e37fe700 1 --2- 172.21.15.49:0/1122677547 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f39d005f300 0x7f39d00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:22:58.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.072+0000 7f39cbfff700 1 -- 172.21.15.49:0/1122677547 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f39d804b520 con 0x7f39e40ca180 2023-11-30T18:22:58.239 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:58.238+0000 7f8897cea680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T18:22:58.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.269+0000 7f39e37fe700 1 -- 172.21.15.49:0/1122677547 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f39d005f300 msgr2=0x7f39d00617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:58.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.269+0000 7f39e37fe700 1 --2- 172.21.15.49:0/1122677547 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f39d005f300 0x7f39d00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T18:22:58.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.287+0000 7f39ea59d700 1 -- 172.21.15.49:0/1122677547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39e40a8e80 con 0x7f39e40ca180 2023-11-30T18:22:58.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.287+0000 7f39cbfff700 1 -- 172.21.15.49:0/1122677547 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f39d804eb40 con 0x7f39e40ca180 2023-11-30T18:22:58.289 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:22:58.289 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":69,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7193,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/4003300500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4003300500},{"type":"v1","addr":"172.21.15.49:6835","nonce":4003300500}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7205,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3715169351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3715169351},{"type":"v1","addr":"172.21.15.115:6837","nonce":3715169351}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":8272,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2922134566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2922134566},{"type":"v1","addr":"172.21.15.115:6836","nonce":2922134566}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T18:22:39.426066+0000","modified":"2023-11-30T18:22:42.436489+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8505},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8505":{"gid":8505,"name":"a","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6833/3939533550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3939533550},{"type":"v1","addr":"172.21.15.49:6833","nonce":3939533550}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-11-30T18:22:58.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.289+0000 7f39ea59d700 1 -- 172.21.15.49:0/1122677547 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f39d005f300 msgr2=0x7f39d00617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:22:58.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.289+0000 7f39ea59d700 1 --2- 172.21.15.49:0/1122677547 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f39d005f300 0x7f39d00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:58.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.289+0000 7f39ea59d700 1 -- 172.21.15.49:0/1122677547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39e40ca180 msgr2=0x7f39e414cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:58.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.289+0000 7f39ea59d700 1 --2- 172.21.15.49:0/1122677547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39e40ca180 0x7f39e414cff0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7f39d800c810 tx=0x7f39d8001440).stop 2023-11-30T18:22:58.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.289+0000 7f39ea59d700 1 -- 172.21.15.49:0/1122677547 shutdown_connections 2023-11-30T18:22:58.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.289+0000 7f39ea59d700 1 --2- 172.21.15.49:0/1122677547 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39e40cae90 0x7f39e4159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:58.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.289+0000 7f39ea59d700 1 --2- 172.21.15.49:0/1122677547 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f39d005f300 0x7f39d00617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:58.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.289+0000 7f39ea59d700 1 --2- 172.21.15.49:0/1122677547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39e40ca180 0x7f39e414cff0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:58.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.289+0000 7f39ea59d700 1 --2- 172.21.15.49:0/1122677547 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39e40caab0 0x7f39e40c3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:58.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.289+0000 7f39ea59d700 1 -- 172.21.15.49:0/1122677547 >> 172.21.15.49:0/1122677547 conn(0x7f39e4094920 msgr2=0x7f39e40a7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:58.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.289+0000 7f39ea59d700 1 -- 172.21.15.49:0/1122677547 shutdown_connections 2023-11-30T18:22:58.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.289+0000 7f39ea59d700 1 -- 172.21.15.49:0/1122677547 wait complete. 2023-11-30T18:22:58.292 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 69 2023-11-30T18:22:58.304 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:22:58.308 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:58.307+0000 7f8897cea680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T18:22:58.383 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:58.383+0000 7f8897cea680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T18:22:58.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.424+0000 7f3584258700 1 Processor -- start 2023-11-30T18:22:58.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.425+0000 7f3584258700 1 -- start start 2023-11-30T18:22:58.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.425+0000 7f3584258700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f357c06a610 0x7f357c0a8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:58.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.425+0000 7f3584258700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f357c0c69a0 con 0x7f357c1548c0 2023-11-30T18:22:58.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.425+0000 7f3584258700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f357c0c13a0 con 0x7f357c1544e0 2023-11-30T18:22:58.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.425+0000 7f3584258700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f357c0c1680 con 0x7f357c06a610 2023-11-30T18:22:58.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.426+0000 7f35827f5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f357c06a610 0x7f357c0a8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:58.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.426+0000 7f35827f5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f357c06a610 0x7f357c0a8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55364/0 (socket says 172.21.15.49:55364) 2023-11-30T18:22:58.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.426+0000 7f35827f5700 1 -- 172.21.15.49:0/2578829998 learned_addr learned my addr 172.21.15.49:0/2578829998 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:58.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.426+0000 7f35817f3700 1 --1- 172.21.15.49:0/2578829998 >> v1:172.21.15.49:6789/0 conn(0x7f357c1548c0 0x7f357c0c6e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43500/0 (socket says 172.21.15.49:43500) 2023-11-30T18:22:58.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.426+0000 7f35827f5700 1 -- 172.21.15.49:0/2578829998 >> v1:172.21.15.115:6789/0 conn(0x7f357c1544e0 legacy=0x7f357c0c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:58.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.426+0000 7f35827f5700 1 -- 172.21.15.49:0/2578829998 >> v1:172.21.15.49:6789/0 conn(0x7f357c1548c0 legacy=0x7f357c0c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:58.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.426+0000 7f3580ff2700 1 -- 172.21.15.49:0/2578829998 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2616496903 0 0) 0x7f357c0c69a0 con 0x7f357c1548c0 2023-11-30T18:22:58.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.426+0000 7f35827f5700 1 -- 172.21.15.49:0/2578829998 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c0c6630 con 0x7f357c06a610 2023-11-30T18:22:58.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.426+0000 7f35827f5700 1 --2- 172.21.15.49:0/2578829998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f357c06a610 0x7f357c0a8000 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7f3574009f20 tx=0x7f3574009840).ready entity=mon.0 client_cookie=fcd42f7e29a74b8b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:58.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.426+0000 7f3580ff2700 1 -- 172.21.15.49:0/2578829998 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357400e070 con 0x7f357c06a610 2023-11-30T18:22:58.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.426+0000 7f3580ff2700 1 -- 172.21.15.49:0/2578829998 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357400ba80 con 0x7f357c06a610 2023-11-30T18:22:58.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.426+0000 7f3580ff2700 1 -- 172.21.15.49:0/2578829998 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357400be00 con 0x7f357c06a610 2023-11-30T18:22:58.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.427+0000 7f3584258700 1 -- 172.21.15.49:0/2578829998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f357c06a610 msgr2=0x7f357c0a8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:58.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.427+0000 7f3584258700 1 --2- 172.21.15.49:0/2578829998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f357c06a610 0x7f357c0a8000 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7f3574009f20 tx=0x7f3574009840).stop 2023-11-30T18:22:58.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.427+0000 7f3584258700 1 -- 172.21.15.49:0/2578829998 shutdown_connections 2023-11-30T18:22:58.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.427+0000 7f3584258700 1 --2- 172.21.15.49:0/2578829998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f357c06a610 0x7f357c0a8000 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:58.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.427+0000 7f3584258700 1 -- 172.21.15.49:0/2578829998 >> 172.21.15.49:0/2578829998 conn(0x7f357c085020 msgr2=0x7f357c094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:58.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.427+0000 7f3584258700 1 -- 172.21.15.49:0/2578829998 shutdown_connections 2023-11-30T18:22:58.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.427+0000 7f3584258700 1 -- 172.21.15.49:0/2578829998 wait complete. 2023-11-30T18:22:58.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.428+0000 7f3584258700 1 Processor -- start 2023-11-30T18:22:58.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.428+0000 7f3584258700 1 -- start start 2023-11-30T18:22:58.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.429+0000 7f3584258700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f357c06a610 0x7f357c164a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:58.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.429+0000 7f3584258700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f357c1544e0 0x7f357c095ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:58.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.429+0000 7f3584258700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f357c1548c0 0x7f357c098950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:58.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.429+0000 7f3584258700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c095fa0 con 0x7f357c1548c0 2023-11-30T18:22:58.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.429+0000 7f3584258700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c1535d0 con 0x7f357c06a610 2023-11-30T18:22:58.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.429+0000 7f3584258700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357c164fa0 con 0x7f357c1544e0 2023-11-30T18:22:58.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.429+0000 7f35827f5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f357c1548c0 0x7f357c098950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:58.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.429+0000 7f35827f5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f357c1548c0 0x7f357c098950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55372/0 (socket says 172.21.15.49:55372) 2023-11-30T18:22:58.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.429+0000 7f35827f5700 1 -- 172.21.15.49:0/3082329962 learned_addr learned my addr 172.21.15.49:0/3082329962 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:58.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.429+0000 7f3581ff4700 1 --2- 172.21.15.49:0/3082329962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f357c06a610 0x7f357c164a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:58.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.429+0000 7f35817f3700 1 --2- 172.21.15.49:0/3082329962 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f357c1544e0 0x7f357c095ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:58.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.429+0000 7f35827f5700 1 -- 172.21.15.49:0/3082329962 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f357c1544e0 msgr2=0x7f357c095ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:58.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.429+0000 7f35827f5700 1 --2- 172.21.15.49:0/3082329962 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f357c1544e0 0x7f357c095ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:58.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.429+0000 7f35827f5700 1 -- 172.21.15.49:0/3082329962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f357c06a610 msgr2=0x7f357c164a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:58.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.429+0000 7f35827f5700 1 --2- 172.21.15.49:0/3082329962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f357c06a610 0x7f357c164a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:58.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.429+0000 7f35827f5700 1 -- 172.21.15.49:0/3082329962 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3574009ae0 con 0x7f357c1548c0 2023-11-30T18:22:58.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.430+0000 7f35827f5700 1 --2- 172.21.15.49:0/3082329962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f357c1548c0 0x7f357c098950 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7f357400b6c0 tx=0x7f3574009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:58.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.430+0000 7f356dffb700 1 -- 172.21.15.49:0/3082329962 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35740092e0 con 0x7f357c1548c0 2023-11-30T18:22:58.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.430+0000 7f356dffb700 1 -- 172.21.15.49:0/3082329962 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357401d410 con 0x7f357c1548c0 2023-11-30T18:22:58.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.430+0000 7f3584258700 1 -- 172.21.15.49:0/3082329962 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f357c165280 con 0x7f357c1548c0 2023-11-30T18:22:58.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.430+0000 7f356dffb700 1 -- 172.21.15.49:0/3082329962 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357401d790 con 0x7f357c1548c0 2023-11-30T18:22:58.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.430+0000 7f3584258700 1 -- 172.21.15.49:0/3082329962 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f357c168070 con 0x7f357c1548c0 2023-11-30T18:22:58.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.432+0000 7f356dffb700 1 -- 172.21.15.49:0/3082329962 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 72) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f357401db00 con 0x7f357c1548c0 2023-11-30T18:22:58.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.432+0000 7f3584258700 1 -- 172.21.15.49:0/3082329962 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f357c06c860 con 0x7f357c1548c0 2023-11-30T18:22:58.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.432+0000 7f356dffb700 1 --2- 172.21.15.49:0/3082329962 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f356005f300 0x7f35600617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:58.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.432+0000 7f356dffb700 1 -- 172.21.15.49:0/3082329962 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6435+0+0 (secure 0 0 0) 0x7f357407c3c0 con 0x7f357c1548c0 2023-11-30T18:22:58.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.432+0000 7f3581ff4700 1 -- 172.21.15.49:0/3082329962 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f356005f300 msgr2=0x7f35600617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:58.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.432+0000 7f3581ff4700 1 --2- 172.21.15.49:0/3082329962 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f356005f300 0x7f35600617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:22:58.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.436+0000 7f356dffb700 1 -- 172.21.15.49:0/3082329962 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f357404d240 con 0x7f357c1548c0 2023-11-30T18:22:58.470 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:58.468+0000 7fbfb2bd2680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T18:22:58.532 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:58.531+0000 7f8897cea680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T18:22:58.543 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:58.541+0000 7fbfb2bd2680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T18:22:58.603 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:58.602+0000 7f8897cea680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T18:22:58.622 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:58.620+0000 7fbfb2bd2680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T18:22:58.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.633+0000 7f3581ff4700 1 -- 172.21.15.49:0/3082329962 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f356005f300 msgr2=0x7f35600617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:58.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.633+0000 7f3581ff4700 1 --2- 172.21.15.49:0/3082329962 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f356005f300 0x7f35600617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T18:22:58.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.650+0000 7f3584258700 1 -- 172.21.15.49:0/3082329962 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f357c0c5890 con 0x7f357c1548c0 2023-11-30T18:22:58.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.651+0000 7f356dffb700 1 -- 172.21.15.49:0/3082329962 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f357401ddb0 con 0x7f357c1548c0 2023-11-30T18:22:58.655 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:22:58.655 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":69,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7193,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/4003300500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4003300500},{"type":"v1","addr":"172.21.15.49:6835","nonce":4003300500}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7205,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3715169351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3715169351},{"type":"v1","addr":"172.21.15.115:6837","nonce":3715169351}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":8272,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2922134566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2922134566},{"type":"v1","addr":"172.21.15.115:6836","nonce":2922134566}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T18:22:39.426066+0000","modified":"2023-11-30T18:22:42.436489+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8505},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8505":{"gid":8505,"name":"a","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6833/3939533550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3939533550},{"type":"v1","addr":"172.21.15.49:6833","nonce":3939533550}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-11-30T18:22:58.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.653+0000 7f3584258700 1 -- 172.21.15.49:0/3082329962 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f356005f300 msgr2=0x7f35600617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:22:58.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.653+0000 7f3584258700 1 --2- 172.21.15.49:0/3082329962 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f356005f300 0x7f35600617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:58.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.653+0000 7f3584258700 1 -- 172.21.15.49:0/3082329962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f357c1548c0 msgr2=0x7f357c098950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:58.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.653+0000 7f3584258700 1 --2- 172.21.15.49:0/3082329962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f357c1548c0 0x7f357c098950 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7f357400b6c0 tx=0x7f3574009840).stop 2023-11-30T18:22:58.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.653+0000 7f3584258700 1 -- 172.21.15.49:0/3082329962 shutdown_connections 2023-11-30T18:22:58.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.653+0000 7f3584258700 1 --2- 172.21.15.49:0/3082329962 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f356005f300 0x7f35600617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:58.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.653+0000 7f3584258700 1 --2- 172.21.15.49:0/3082329962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f357c1548c0 0x7f357c098950 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:58.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.653+0000 7f3584258700 1 --2- 172.21.15.49:0/3082329962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f357c06a610 0x7f357c164a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:58.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.653+0000 7f3584258700 1 --2- 172.21.15.49:0/3082329962 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f357c1544e0 0x7f357c095ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:58.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.653+0000 7f3584258700 1 -- 172.21.15.49:0/3082329962 >> 172.21.15.49:0/3082329962 conn(0x7f357c085020 msgr2=0x7f357c0c0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:58.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.653+0000 7f3584258700 1 -- 172.21.15.49:0/3082329962 shutdown_connections 2023-11-30T18:22:58.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.653+0000 7f3584258700 1 -- 172.21.15.49:0/3082329962 wait complete. 2023-11-30T18:22:58.659 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 69 2023-11-30T18:22:58.667 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:22:58.720 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:58.719+0000 7f8897cea680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T18:22:58.782 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:58.781+0000 7fbfb2bd2680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T18:22:58.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.785+0000 7fa7b042e700 1 Processor -- start 2023-11-30T18:22:58.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.785+0000 7fa7b042e700 1 -- start start 2023-11-30T18:22:58.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.786+0000 7fa7b042e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa7a81542d0 0x7fa7a80697f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:58.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.786+0000 7fa7b042e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7a8069ce0 0x7fa7a8062700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:58.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.786+0000 7fa7b042e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a8065760 con 0x7fa7a8062bf0 2023-11-30T18:22:58.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.786+0000 7fa7b042e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a806a160 con 0x7fa7a81542d0 2023-11-30T18:22:58.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.786+0000 7fa7b042e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a8063080 con 0x7fa7a8069ce0 2023-11-30T18:22:58.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.786+0000 7fa7ae9cb700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa7a8062bf0 0x7fa7a8157fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43502/0 (socket says 172.21.15.49:43502) 2023-11-30T18:22:58.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.786+0000 7fa7ae9cb700 1 -- 172.21.15.49:0/1934452800 learned_addr learned my addr 172.21.15.49:0/1934452800 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:22:58.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.786+0000 7fa7ad9c9700 1 --2- 172.21.15.49:0/1934452800 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7a8069ce0 0x7fa7a8062700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:58.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.786+0000 7fa7ae1ca700 1 --2- 172.21.15.49:0/1934452800 >> v2:172.21.15.115:3300/0 conn(0x7fa7a81542d0 0x7fa7a80697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:58.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.786+0000 7fa7ad1c8700 1 -- 172.21.15.49:0/1934452800 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3779430401 0 0) 0x7fa7a8065760 con 0x7fa7a8062bf0 2023-11-30T18:22:58.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.786+0000 7fa7ad1c8700 1 -- 172.21.15.49:0/1934452800 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7940033f0 con 0x7fa7a8062bf0 2023-11-30T18:22:58.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.786+0000 7fa7ad9c9700 1 -- 172.21.15.49:0/1934452800 >> v2:172.21.15.115:3300/0 conn(0x7fa7a81542d0 msgr2=0x7fa7a80697f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:58.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.786+0000 7fa7ad9c9700 1 --2- 172.21.15.49:0/1934452800 >> v2:172.21.15.115:3300/0 conn(0x7fa7a81542d0 0x7fa7a80697f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:58.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.786+0000 7fa7ad9c9700 1 -- 172.21.15.49:0/1934452800 >> v1:172.21.15.49:6789/0 conn(0x7fa7a8062bf0 legacy=0x7fa7a8157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:58.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.786+0000 7fa7ad9c9700 1 -- 172.21.15.49:0/1934452800 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a80c3250 con 0x7fa7a8069ce0 2023-11-30T18:22:58.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.786+0000 7fa7ae1ca700 1 --2- 172.21.15.49:0/1934452800 >> v2:172.21.15.115:3300/0 conn(0x7fa7a81542d0 0x7fa7a80697f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:22:58.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.787+0000 7fa7ad9c9700 1 --2- 172.21.15.49:0/1934452800 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7a8069ce0 0x7fa7a8062700 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fa798009760 tx=0x7fa798009060).ready entity=mon.2 client_cookie=2dc145d7a09c2906 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:58.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.787+0000 7fa7ad1c8700 1 -- 172.21.15.49:0/1934452800 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79800d4a0 con 0x7fa7a8069ce0 2023-11-30T18:22:58.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.787+0000 7fa7ad1c8700 1 -- 172.21.15.49:0/1934452800 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79800d600 con 0x7fa7a8069ce0 2023-11-30T18:22:58.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.787+0000 7fa7ad1c8700 1 -- 172.21.15.49:0/1934452800 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79800d980 con 0x7fa7a8069ce0 2023-11-30T18:22:58.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.787+0000 7fa7b042e700 1 -- 172.21.15.49:0/1934452800 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7a8069ce0 msgr2=0x7fa7a8062700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:58.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.787+0000 7fa7b042e700 1 --2- 172.21.15.49:0/1934452800 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7a8069ce0 0x7fa7a8062700 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fa798009760 tx=0x7fa798009060).stop 2023-11-30T18:22:58.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.787+0000 7fa7b042e700 1 -- 172.21.15.49:0/1934452800 shutdown_connections 2023-11-30T18:22:58.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.787+0000 7fa7b042e700 1 --2- 172.21.15.49:0/1934452800 >> v2:172.21.15.115:3300/0 conn(0x7fa7a81542d0 0x7fa7a80697f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:58.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.787+0000 7fa7b042e700 1 --2- 172.21.15.49:0/1934452800 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7a8069ce0 0x7fa7a8062700 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:58.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.787+0000 7fa7b042e700 1 -- 172.21.15.49:0/1934452800 >> 172.21.15.49:0/1934452800 conn(0x7fa7a80c7fd0 msgr2=0x7fa7a80c83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:58.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.788+0000 7fa7b042e700 1 -- 172.21.15.49:0/1934452800 shutdown_connections 2023-11-30T18:22:58.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.788+0000 7fa7b042e700 1 -- 172.21.15.49:0/1934452800 wait complete. 2023-11-30T18:22:58.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.789+0000 7fa7b042e700 1 Processor -- start 2023-11-30T18:22:58.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.789+0000 7fa7b042e700 1 -- start start 2023-11-30T18:22:58.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.790+0000 7fa7b042e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7a8062bf0 0x7fa7a814db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:58.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.790+0000 7fa7b042e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7a8069ce0 0x7fa7a80ad7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:58.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.790+0000 7fa7b042e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7a81542d0 0x7fa7a80a9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:58.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.790+0000 7fa7b042e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a80a9770 con 0x7fa7a8062bf0 2023-11-30T18:22:58.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.790+0000 7fa7b042e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a80a9450 con 0x7fa7a8069ce0 2023-11-30T18:22:58.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.790+0000 7fa7b042e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a8151060 con 0x7fa7a81542d0 2023-11-30T18:22:58.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.790+0000 7fa7ae1ca700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7a8062bf0 0x7fa7a814db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:58.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.790+0000 7fa7ae1ca700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7a8062bf0 0x7fa7a814db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55386/0 (socket says 172.21.15.49:55386) 2023-11-30T18:22:58.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.790+0000 7fa7ae1ca700 1 -- 172.21.15.49:0/4039426075 learned_addr learned my addr 172.21.15.49:0/4039426075 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:58.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.790+0000 7fa7ae9cb700 1 --2- 172.21.15.49:0/4039426075 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7a81542d0 0x7fa7a80a9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:58.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.790+0000 7fa7ad9c9700 1 --2- 172.21.15.49:0/4039426075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7a8069ce0 0x7fa7a80ad7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:58.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.790+0000 7fa7ae1ca700 1 -- 172.21.15.49:0/4039426075 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7a81542d0 msgr2=0x7fa7a80a9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:58.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.790+0000 7fa7ae1ca700 1 --2- 172.21.15.49:0/4039426075 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7a81542d0 0x7fa7a80a9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:58.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.790+0000 7fa7ae1ca700 1 -- 172.21.15.49:0/4039426075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7a8069ce0 msgr2=0x7fa7a80ad7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:58.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.790+0000 7fa7ae1ca700 1 --2- 172.21.15.49:0/4039426075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7a8069ce0 0x7fa7a80ad7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:58.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.790+0000 7fa7ae1ca700 1 -- 172.21.15.49:0/4039426075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a40092a0 con 0x7fa7a8062bf0 2023-11-30T18:22:58.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.790+0000 7fa7ae1ca700 1 --2- 172.21.15.49:0/4039426075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7a8062bf0 0x7fa7a814db00 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7fa7a400e980 tx=0x7fa7a4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:58.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.790+0000 7fa79e7fc700 1 -- 172.21.15.49:0/4039426075 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4009560 con 0x7fa7a8062bf0 2023-11-30T18:22:58.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.790+0000 7fa79e7fc700 1 -- 172.21.15.49:0/4039426075 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a4012600 con 0x7fa7a8062bf0 2023-11-30T18:22:58.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.790+0000 7fa7b042e700 1 -- 172.21.15.49:0/4039426075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7980092a0 con 0x7fa7a8062bf0 2023-11-30T18:22:58.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.790+0000 7fa79e7fc700 1 -- 172.21.15.49:0/4039426075 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4012980 con 0x7fa7a8062bf0 2023-11-30T18:22:58.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.790+0000 7fa7b042e700 1 -- 172.21.15.49:0/4039426075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a8151620 con 0x7fa7a8062bf0 2023-11-30T18:22:58.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.791+0000 7fa7b042e700 1 -- 172.21.15.49:0/4039426075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a80a9a50 con 0x7fa7a8062bf0 2023-11-30T18:22:58.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.792+0000 7fa79e7fc700 1 -- 172.21.15.49:0/4039426075 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 72) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fa7a4012cf0 con 0x7fa7a8062bf0 2023-11-30T18:22:58.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.792+0000 7fa79e7fc700 1 --2- 172.21.15.49:0/4039426075 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa78c05f330 0x7fa78c0617f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:58.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.792+0000 7fa7ad9c9700 1 -- 172.21.15.49:0/4039426075 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa78c05f330 msgr2=0x7fa78c0617f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:58.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.792+0000 7fa79e7fc700 1 -- 172.21.15.49:0/4039426075 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6435+0+0 (secure 0 0 0) 0x7fa7a407a9b0 con 0x7fa7a8062bf0 2023-11-30T18:22:58.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.792+0000 7fa7ad9c9700 1 --2- 172.21.15.49:0/4039426075 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa78c05f330 0x7fa78c0617f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:22:58.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.800+0000 7fa79e7fc700 1 -- 172.21.15.49:0/4039426075 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa7a404b940 con 0x7fa7a8062bf0 2023-11-30T18:22:58.830 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:58.829+0000 7f8897cea680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:22:58.862 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:58.860+0000 7fbfb2bd2680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T18:22:58.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.975+0000 7fa7b042e700 1 -- 172.21.15.49:0/4039426075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7a806c860 con 0x7fa7a8062bf0 2023-11-30T18:22:58.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.977+0000 7fa79e7fc700 1 -- 172.21.15.49:0/4039426075 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+17403 (secure 0 0 0) 0x7fa7a4016090 con 0x7fa7a8062bf0 2023-11-30T18:22:58.979 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:22:58.979 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":170,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:22:51.928387+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-11-30T18:22:37.085862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-11-30T18:22:38.409621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/1847633149":"2023-12-01T18:22:51.928346+0000","172.21.15.115:6833/89956":"2023-12-01T18:22:51.928346+0000","172.21.15.115:6832/89956":"2023-12-01T18:22:51.928346+0000","172.21.15.115:0/3691284164":"2023-12-01T18:22:51.928346+0000","172.21.15.115:0/1259529053":"2023-12-01T18:22:51.928346+0000","172.21.15.115:0/596329516":"2023-12-01T18:22:51.928346+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:22:58.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.979+0000 7fa7b042e700 1 -- 172.21.15.49:0/4039426075 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa78c05f330 msgr2=0x7fa78c0617f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:22:58.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.979+0000 7fa7b042e700 1 --2- 172.21.15.49:0/4039426075 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa78c05f330 0x7fa78c0617f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:58.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.979+0000 7fa7b042e700 1 -- 172.21.15.49:0/4039426075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7a8062bf0 msgr2=0x7fa7a814db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:58.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.979+0000 7fa7b042e700 1 --2- 172.21.15.49:0/4039426075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7a8062bf0 0x7fa7a814db00 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7fa7a400e980 tx=0x7fa7a4009060).stop 2023-11-30T18:22:58.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.979+0000 7fa7b042e700 1 -- 172.21.15.49:0/4039426075 shutdown_connections 2023-11-30T18:22:58.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.979+0000 7fa7b042e700 1 --2- 172.21.15.49:0/4039426075 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7a81542d0 0x7fa7a80a9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:58.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.979+0000 7fa7b042e700 1 --2- 172.21.15.49:0/4039426075 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa78c05f330 0x7fa78c0617f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:58.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.979+0000 7fa7b042e700 1 --2- 172.21.15.49:0/4039426075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7a8062bf0 0x7fa7a814db00 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:58.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.979+0000 7fa7b042e700 1 --2- 172.21.15.49:0/4039426075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7a8069ce0 0x7fa7a80ad7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:58.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.979+0000 7fa7b042e700 1 -- 172.21.15.49:0/4039426075 >> 172.21.15.49:0/4039426075 conn(0x7fa7a80c7fd0 msgr2=0x7fa7a80a7080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:58.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.979+0000 7fa7b042e700 1 -- 172.21.15.49:0/4039426075 shutdown_connections 2023-11-30T18:22:58.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:58.979+0000 7fa7b042e700 1 -- 172.21.15.49:0/4039426075 wait complete. 2023-11-30T18:22:58.985 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:58.984+0000 7fbfb2bd2680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T18:22:58.993 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-30T18:22:59.102 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:59.101+0000 7fbfb2bd2680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:22:59.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.111+0000 7f7327b76700 1 Processor -- start 2023-11-30T18:22:59.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.111+0000 7f7327b76700 1 -- start start 2023-11-30T18:22:59.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.112+0000 7f7327b76700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f73200bcdd0 0x7f732014eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:59.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.112+0000 7f7327b76700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7320062770 0x7f7320062be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:59.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.112+0000 7f7327b76700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73200634a0 con 0x7f732014eb00 2023-11-30T18:22:59.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.112+0000 7f7327b76700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7320137d90 con 0x7f73200bcdd0 2023-11-30T18:22:59.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.112+0000 7f7327b76700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7320063780 con 0x7f7320062770 2023-11-30T18:22:59.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.113+0000 7f7326113700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7320062770 0x7f7320062be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:59.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.113+0000 7f7325111700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f73200bcdd0 0x7f732014eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:59.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.113+0000 7f7325111700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f73200bcdd0 0x7f732014eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:40160/0 (socket says 172.21.15.49:40160) 2023-11-30T18:22:59.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.113+0000 7f7326113700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7320062770 0x7f7320062be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:60478/0 (socket says 172.21.15.49:60478) 2023-11-30T18:22:59.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.113+0000 7f7325912700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f732014eb00 0x7f73200bc6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:33654/0 (socket says 172.21.15.49:33654) 2023-11-30T18:22:59.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.113+0000 7f7325111700 1 -- 172.21.15.49:0/605645836 learned_addr learned my addr 172.21.15.49:0/605645836 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:59.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.113+0000 7f7325111700 1 -- 172.21.15.49:0/605645836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7320062770 msgr2=0x7f7320062be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:22:59.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.113+0000 7f7325111700 1 --2- 172.21.15.49:0/605645836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7320062770 0x7f7320062be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:59.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.113+0000 7f7325111700 1 -- 172.21.15.49:0/605645836 >> v1:172.21.15.115:6789/0 conn(0x7f732014eb00 legacy=0x7f73200bc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:59.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.113+0000 7f7325111700 1 -- 172.21.15.49:0/605645836 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7320063a60 con 0x7f73200bcdd0 2023-11-30T18:22:59.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.113+0000 7f7324910700 1 -- 172.21.15.49:0/605645836 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1879785032 0 0) 0x7f73200634a0 con 0x7f732014eb00 2023-11-30T18:22:59.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.113+0000 7f7326113700 1 --2- 172.21.15.49:0/605645836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7320062770 0x7f7320062be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:22:59.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.113+0000 7f7325111700 1 --2- 172.21.15.49:0/605645836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73200bcdd0 0x7f732014eee0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f731c009810 tx=0x7f731c009060).ready entity=mon.1 client_cookie=b39a8d6f810fb626 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:59.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.113+0000 7f7324910700 1 -- 172.21.15.49:0/605645836 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c005880 con 0x7f73200bcdd0 2023-11-30T18:22:59.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.113+0000 7f7324910700 1 -- 172.21.15.49:0/605645836 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731c0059e0 con 0x7f73200bcdd0 2023-11-30T18:22:59.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.113+0000 7f7324910700 1 -- 172.21.15.49:0/605645836 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c005d60 con 0x7f73200bcdd0 2023-11-30T18:22:59.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.114+0000 7f7327b76700 1 -- 172.21.15.49:0/605645836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73200bcdd0 msgr2=0x7f732014eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:59.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.114+0000 7f7327b76700 1 --2- 172.21.15.49:0/605645836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73200bcdd0 0x7f732014eee0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f731c009810 tx=0x7f731c009060).stop 2023-11-30T18:22:59.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.114+0000 7f7327b76700 1 -- 172.21.15.49:0/605645836 shutdown_connections 2023-11-30T18:22:59.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.114+0000 7f7327b76700 1 --2- 172.21.15.49:0/605645836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7320062770 0x7f7320062be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:59.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.114+0000 7f7327b76700 1 --2- 172.21.15.49:0/605645836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73200bcdd0 0x7f732014eee0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:59.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.114+0000 7f7327b76700 1 -- 172.21.15.49:0/605645836 >> 172.21.15.49:0/605645836 conn(0x7f73200c8230 msgr2=0x7f73200c4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:22:59.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.114+0000 7f7327b76700 1 -- 172.21.15.49:0/605645836 shutdown_connections 2023-11-30T18:22:59.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.114+0000 7f7327b76700 1 -- 172.21.15.49:0/605645836 wait complete. 2023-11-30T18:22:59.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.115+0000 7f7327b76700 1 Processor -- start 2023-11-30T18:22:59.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.115+0000 7f7327b76700 1 -- start start 2023-11-30T18:22:59.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.116+0000 7f7327b76700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7320062770 0x7f732014dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:59.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.116+0000 7f7327b76700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73200bcdd0 0x7f73200c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:59.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.116+0000 7f7327b76700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f732014eb00 0x7f73200c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:59.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.116+0000 7f7327b76700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73200c6320 con 0x7f73200bcdd0 2023-11-30T18:22:59.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.116+0000 7f7327b76700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73200bf130 con 0x7f732014eb00 2023-11-30T18:22:59.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.116+0000 7f7327b76700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7320138340 con 0x7f7320062770 2023-11-30T18:22:59.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.116+0000 7f7325111700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73200bcdd0 0x7f73200c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:59.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.116+0000 7f7325111700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73200bcdd0 0x7f73200c5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55388/0 (socket says 172.21.15.49:55388) 2023-11-30T18:22:59.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.116+0000 7f7325111700 1 -- 172.21.15.49:0/3249633080 learned_addr learned my addr 172.21.15.49:0/3249633080 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:22:59.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.116+0000 7f7326113700 1 --2- 172.21.15.49:0/3249633080 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f732014eb00 0x7f73200c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:59.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.116+0000 7f7325912700 1 --2- 172.21.15.49:0/3249633080 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7320062770 0x7f732014dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:22:59.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.116+0000 7f7325111700 1 -- 172.21.15.49:0/3249633080 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7320062770 msgr2=0x7f732014dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:59.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.116+0000 7f7325111700 1 --2- 172.21.15.49:0/3249633080 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7320062770 0x7f732014dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:59.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.116+0000 7f7325111700 1 -- 172.21.15.49:0/3249633080 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f732014eb00 msgr2=0x7f73200c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:22:59.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.116+0000 7f7325111700 1 --2- 172.21.15.49:0/3249633080 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f732014eb00 0x7f73200c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:22:59.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.116+0000 7f7325111700 1 -- 172.21.15.49:0/3249633080 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7318009a20 con 0x7f73200bcdd0 2023-11-30T18:22:59.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.116+0000 7f7326113700 1 --2- 172.21.15.49:0/3249633080 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f732014eb00 0x7f73200c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:22:59.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.117+0000 7f7325111700 1 --2- 172.21.15.49:0/3249633080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73200bcdd0 0x7f73200c5940 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 rx=0x7f731c009eb0 tx=0x7f731c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:22:59.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.117+0000 7f7315ffb700 1 -- 172.21.15.49:0/3249633080 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c005880 con 0x7f73200bcdd0 2023-11-30T18:22:59.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.117+0000 7f7327b76700 1 -- 172.21.15.49:0/3249633080 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f731c009300 con 0x7f73200bcdd0 2023-11-30T18:22:59.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.117+0000 7f7315ffb700 1 -- 172.21.15.49:0/3249633080 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731c00b790 con 0x7f73200bcdd0 2023-11-30T18:22:59.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.117+0000 7f7315ffb700 1 -- 172.21.15.49:0/3249633080 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c00bb30 con 0x7f73200bcdd0 2023-11-30T18:22:59.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.117+0000 7f7327b76700 1 -- 172.21.15.49:0/3249633080 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73200beae0 con 0x7f73200bcdd0 2023-11-30T18:22:59.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.118+0000 7f7327b76700 1 -- 172.21.15.49:0/3249633080 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73200bf2e0 con 0x7f73200bcdd0 2023-11-30T18:22:59.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.118+0000 7f7315ffb700 1 -- 172.21.15.49:0/3249633080 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 72) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f731c018070 con 0x7f73200bcdd0 2023-11-30T18:22:59.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.119+0000 7f7315ffb700 1 --2- 172.21.15.49:0/3249633080 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f730405f300 0x7f73040617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:22:59.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.119+0000 7f7315ffb700 1 -- 172.21.15.49:0/3249633080 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6435+0+0 (secure 0 0 0) 0x7f731c07b600 con 0x7f73200bcdd0 2023-11-30T18:22:59.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.119+0000 7f7325912700 1 -- 172.21.15.49:0/3249633080 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f730405f300 msgr2=0x7f73040617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:22:59.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.119+0000 7f7325912700 1 --2- 172.21.15.49:0/3249633080 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f730405f300 0x7f73040617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:22:59.122 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:59.121+0000 7f8897cea680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T18:22:59.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.123+0000 7f7315ffb700 1 -- 172.21.15.49:0/3249633080 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f73200bf2e0 con 0x7f73200bcdd0 2023-11-30T18:22:59.196 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:59.195+0000 7f8897cea680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T18:22:59.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.217+0000 7f7315ffb700 1 -- 172.21.15.49:0/3249633080 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 73) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f731c079110 con 0x7f73200bcdd0 2023-11-30T18:22:59.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.217+0000 7f7315ffb700 1 -- 172.21.15.49:0/3249633080 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f730405f300 msgr2=0x7f73040617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:22:59.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.217+0000 7f7315ffb700 1 --2- 172.21.15.49:0/3249633080 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f730405f300 0x7f73040617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:22:59.274 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:59.273+0000 7f8811c7b700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:22:59.275 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:59.273+0000 7f8811c7b700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:22:59.275 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:59.273+0000 7f8811c7b700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:22:59.275 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:59.273+0000 7f8811c7b700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:22:59.275 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:59.273+0000 7f8811c7b700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:22:59.275 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:59.273+0000 7f8815482700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:22:59.275 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:59.273+0000 7f8815482700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:22:59.275 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:59.273+0000 7f8815482700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:22:59.275 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:59.273+0000 7f8815482700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:22:59.275 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:22:59.273+0000 7f8815482700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:22:59.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:22:59.347+0000 7f7327b76700 1 -- 172.21.15.49:0/3249633080 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f73200bf2a0 con 0x7f73200bcdd0 2023-11-30T18:22:59.412 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:59.411+0000 7fbfb2bd2680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T18:22:59.487 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:22:59.485+0000 7fbfb2bd2680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T18:23:00.213 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-11-30T18:23:00.212+0000 7f3888d95700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-30T18:23:00.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.214+0000 7f7315ffb700 1 -- 172.21.15.49:0/3249633080 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v70) v1 ==== 161+0+0 (secure 0 0 0) 0x7f731c054680 con 0x7f73200bcdd0 2023-11-30T18:23:00.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.217+0000 7f7327b76700 1 -- 172.21.15.49:0/3249633080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73200bcdd0 msgr2=0x7f73200c5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:00.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.217+0000 7f7327b76700 1 --2- 172.21.15.49:0/3249633080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73200bcdd0 0x7f73200c5940 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 rx=0x7f731c009eb0 tx=0x7f731c016000).stop 2023-11-30T18:23:00.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.217+0000 7f7327b76700 1 -- 172.21.15.49:0/3249633080 shutdown_connections 2023-11-30T18:23:00.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.217+0000 7f7327b76700 1 --2- 172.21.15.49:0/3249633080 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f732014eb00 0x7f73200c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:00.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.217+0000 7f7327b76700 1 --2- 172.21.15.49:0/3249633080 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7320062770 0x7f732014dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:00.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.217+0000 7f7327b76700 1 --2- 172.21.15.49:0/3249633080 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f730405f300 0x7f73040617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:23:00.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.217+0000 7f7327b76700 1 --2- 172.21.15.49:0/3249633080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73200bcdd0 0x7f73200c5940 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:00.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.217+0000 7f7327b76700 1 -- 172.21.15.49:0/3249633080 >> 172.21.15.49:0/3249633080 conn(0x7f73200c8230 msgr2=0x7f7320137250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:00.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.217+0000 7f7327b76700 1 -- 172.21.15.49:0/3249633080 shutdown_connections 2023-11-30T18:23:00.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.217+0000 7f7327b76700 1 -- 172.21.15.49:0/3249633080 wait complete. 2023-11-30T18:23:00.220 INFO:tasks.ceph.mds.a.smithi049.stderr: -2660> 2023-11-30T18:22:44.699+0000 7ff82ebce700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-30T18:23:00.220 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-30T18:23:00.236 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-30T18:23:00.246 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-11-30T18:23:00.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.358+0000 7f0f6f59e700 1 Processor -- start 2023-11-30T18:23:00.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.358+0000 7f0f6f59e700 1 -- start start 2023-11-30T18:23:00.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.358+0000 7f0f6f59e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0f7013db60 0x7f0f7015f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:00.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.359+0000 7f0f6f59e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f701586a0 con 0x7f0f70066e10 2023-11-30T18:23:00.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.359+0000 7f0f6f59e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f70157de0 con 0x7f0f70066a30 2023-11-30T18:23:00.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.359+0000 7f0f6f59e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f70064820 con 0x7f0f7013db60 2023-11-30T18:23:00.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.359+0000 7f0f65d9b700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0f70066e10 0x7f0f7013d450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43506/0 (socket says 172.21.15.49:43506) 2023-11-30T18:23:00.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.359+0000 7f0f65d9b700 1 -- 172.21.15.49:0/3221724527 learned_addr learned my addr 172.21.15.49:0/3221724527 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:23:00.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.359+0000 7f0f6ed9d700 1 --2- 172.21.15.49:0/3221724527 >> v2:172.21.15.115:3300/0 conn(0x7f0f7013db60 0x7f0f7015f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:00.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.359+0000 7f0f6dd9b700 1 -- 172.21.15.49:0/3221724527 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 93780225 0 0) 0x7f0f701586a0 con 0x7f0f70066e10 2023-11-30T18:23:00.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.359+0000 7f0f6dd9b700 1 -- 172.21.15.49:0/3221724527 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f5c0033f0 con 0x7f0f70066e10 2023-11-30T18:23:00.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.359+0000 7f0f6dd9b700 1 -- 172.21.15.49:0/3221724527 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1033889164 0 0) 0x7f0f70157de0 con 0x7f0f70066a30 2023-11-30T18:23:00.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.359+0000 7f0f6dd9b700 1 -- 172.21.15.49:0/3221724527 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f701586a0 con 0x7f0f70066a30 2023-11-30T18:23:00.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.359+0000 7f0f6ed9d700 1 -- 172.21.15.49:0/3221724527 >> v1:172.21.15.115:6789/0 conn(0x7f0f70066a30 legacy=0x7f0f700c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:00.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.359+0000 7f0f6ed9d700 1 -- 172.21.15.49:0/3221724527 >> v1:172.21.15.49:6789/0 conn(0x7f0f70066e10 legacy=0x7f0f7013d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:00.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.359+0000 7f0f6ed9d700 1 -- 172.21.15.49:0/3221724527 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f700c7140 con 0x7f0f7013db60 2023-11-30T18:23:00.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.359+0000 7f0f6ed9d700 1 --2- 172.21.15.49:0/3221724527 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f7013db60 0x7f0f7015f0e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f0f68009e60 tx=0x7f0f68009780).ready entity=mon.1 client_cookie=873e91691c81199f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:00.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.359+0000 7f0f6dd9b700 1 -- 172.21.15.49:0/3221724527 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6800e070 con 0x7f0f7013db60 2023-11-30T18:23:00.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.359+0000 7f0f6dd9b700 1 -- 172.21.15.49:0/3221724527 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6800bab0 con 0x7f0f7013db60 2023-11-30T18:23:00.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.359+0000 7f0f6dd9b700 1 -- 172.21.15.49:0/3221724527 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6800be30 con 0x7f0f7013db60 2023-11-30T18:23:00.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.360+0000 7f0f6f59e700 1 -- 172.21.15.49:0/3221724527 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f7013db60 msgr2=0x7f0f7015f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:00.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.360+0000 7f0f6f59e700 1 --2- 172.21.15.49:0/3221724527 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f7013db60 0x7f0f7015f0e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f0f68009e60 tx=0x7f0f68009780).stop 2023-11-30T18:23:00.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.360+0000 7f0f6f59e700 1 -- 172.21.15.49:0/3221724527 shutdown_connections 2023-11-30T18:23:00.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.360+0000 7f0f6f59e700 1 --2- 172.21.15.49:0/3221724527 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f7013db60 0x7f0f7015f0e0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:00.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.360+0000 7f0f6f59e700 1 -- 172.21.15.49:0/3221724527 >> 172.21.15.49:0/3221724527 conn(0x7f0f700c8ed0 msgr2=0x7f0f700c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:00.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.360+0000 7f0f6f59e700 1 -- 172.21.15.49:0/3221724527 shutdown_connections 2023-11-30T18:23:00.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.360+0000 7f0f6f59e700 1 -- 172.21.15.49:0/3221724527 wait complete. 2023-11-30T18:23:00.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.361+0000 7f0f6f59e700 1 Processor -- start 2023-11-30T18:23:00.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.361+0000 7f0f6f59e700 1 -- start start 2023-11-30T18:23:00.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.362+0000 7f0f6f59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f70066a30 0x7f0f70153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:00.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.362+0000 7f0f6f59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f70066e10 0x7f0f700ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:00.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.362+0000 7f0f6f59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f7013db60 0x7f0f700ad4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:00.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.362+0000 7f0f6f59e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f700c0770 con 0x7f0f70066e10 2023-11-30T18:23:00.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.362+0000 7f0f6f59e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f700adaa0 con 0x7f0f7013db60 2023-11-30T18:23:00.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.362+0000 7f0f6f59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f700add80 con 0x7f0f70066a30 2023-11-30T18:23:00.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.362+0000 7f0f65d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f70066e10 0x7f0f700ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:00.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.362+0000 7f0f65d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f70066e10 0x7f0f700ad000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55404/0 (socket says 172.21.15.49:55404) 2023-11-30T18:23:00.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.362+0000 7f0f65d9b700 1 -- 172.21.15.49:0/2486336971 learned_addr learned my addr 172.21.15.49:0/2486336971 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:00.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.362+0000 7f0f6ed9d700 1 --2- 172.21.15.49:0/2486336971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f7013db60 0x7f0f700ad4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:00.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.362+0000 7f0f6e59c700 1 --2- 172.21.15.49:0/2486336971 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f70066a30 0x7f0f70153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:00.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.362+0000 7f0f65d9b700 1 -- 172.21.15.49:0/2486336971 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f70066a30 msgr2=0x7f0f70153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:00.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.362+0000 7f0f65d9b700 1 --2- 172.21.15.49:0/2486336971 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f70066a30 0x7f0f70153920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:00.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.362+0000 7f0f65d9b700 1 -- 172.21.15.49:0/2486336971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f7013db60 msgr2=0x7f0f700ad4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:00.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.362+0000 7f0f65d9b700 1 --2- 172.21.15.49:0/2486336971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f7013db60 0x7f0f700ad4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:00.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.362+0000 7f0f65d9b700 1 -- 172.21.15.49:0/2486336971 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f68009a20 con 0x7f0f70066e10 2023-11-30T18:23:00.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.362+0000 7f0f65d9b700 1 --2- 172.21.15.49:0/2486336971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f70066e10 0x7f0f700ad000 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f0f5800c560 tx=0x7f0f58007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:00.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.363+0000 7f0f66ffd700 1 -- 172.21.15.49:0/2486336971 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5800ce70 con 0x7f0f70066e10 2023-11-30T18:23:00.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.363+0000 7f0f66ffd700 1 -- 172.21.15.49:0/2486336971 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f580072e0 con 0x7f0f70066e10 2023-11-30T18:23:00.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.363+0000 7f0f6f59e700 1 -- 172.21.15.49:0/2486336971 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f700ae060 con 0x7f0f70066e10 2023-11-30T18:23:00.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.363+0000 7f0f66ffd700 1 -- 172.21.15.49:0/2486336971 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f58007660 con 0x7f0f70066e10 2023-11-30T18:23:00.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.363+0000 7f0f6f59e700 1 -- 172.21.15.49:0/2486336971 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f7013ac20 con 0x7f0f70066e10 2023-11-30T18:23:00.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.364+0000 7f0f6f59e700 1 -- 172.21.15.49:0/2486336971 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f700c0920 con 0x7f0f70066e10 2023-11-30T18:23:00.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.364+0000 7f0f66ffd700 1 -- 172.21.15.49:0/2486336971 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 74) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f0f580059b0 con 0x7f0f70066e10 2023-11-30T18:23:00.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.364+0000 7f0f66ffd700 1 --2- 172.21.15.49:0/2486336971 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0f5005f030 0x7f0f500614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:00.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.364+0000 7f0f66ffd700 1 -- 172.21.15.49:0/2486336971 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6736+0+0 (secure 0 0 0) 0x7f0f580797e0 con 0x7f0f70066e10 2023-11-30T18:23:00.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.364+0000 7f0f6e59c700 1 --2- 172.21.15.49:0/2486336971 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0f5005f030 0x7f0f500614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:00.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.365+0000 7f0f6e59c700 1 --2- 172.21.15.49:0/2486336971 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0f5005f030 0x7f0f500614f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f0f60003890 tx=0x7f0f60007bd0).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:00.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.369+0000 7f0f66ffd700 1 -- 172.21.15.49:0/2486336971 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0f700c0920 con 0x7f0f70066e10 2023-11-30T18:23:00.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:00.587+0000 7f0f6f59e700 1 -- 172.21.15.49:0/2486336971 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0f700c08b0 con 0x7f0f70066e10 2023-11-30T18:23:01.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.221+0000 7f0f66ffd700 1 -- 172.21.15.49:0/2486336971 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v71) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0f5804aa20 con 0x7f0f70066e10 2023-11-30T18:23:01.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.224+0000 7f0f6f59e700 1 -- 172.21.15.49:0/2486336971 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0f5005f030 msgr2=0x7f0f500614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:01.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.224+0000 7f0f6f59e700 1 --2- 172.21.15.49:0/2486336971 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0f5005f030 0x7f0f500614f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f0f60003890 tx=0x7f0f60007bd0).stop 2023-11-30T18:23:01.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.224+0000 7f0f6f59e700 1 -- 172.21.15.49:0/2486336971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f70066e10 msgr2=0x7f0f700ad000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:01.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.224+0000 7f0f6f59e700 1 --2- 172.21.15.49:0/2486336971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f70066e10 0x7f0f700ad000 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f0f5800c560 tx=0x7f0f58007d20).stop 2023-11-30T18:23:01.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.224+0000 7f0f6f59e700 1 -- 172.21.15.49:0/2486336971 shutdown_connections 2023-11-30T18:23:01.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.224+0000 7f0f6f59e700 1 --2- 172.21.15.49:0/2486336971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f7013db60 0x7f0f700ad4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:01.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.224+0000 7f0f6f59e700 1 --2- 172.21.15.49:0/2486336971 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f70066a30 0x7f0f70153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:01.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.224+0000 7f0f6f59e700 1 --2- 172.21.15.49:0/2486336971 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0f5005f030 0x7f0f500614f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:01.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.224+0000 7f0f6f59e700 1 --2- 172.21.15.49:0/2486336971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f70066e10 0x7f0f700ad000 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:01.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.224+0000 7f0f6f59e700 1 -- 172.21.15.49:0/2486336971 >> 172.21.15.49:0/2486336971 conn(0x7f0f700c8ed0 msgr2=0x7f0f7013b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:01.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.224+0000 7f0f6f59e700 1 -- 172.21.15.49:0/2486336971 shutdown_connections 2023-11-30T18:23:01.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.224+0000 7f0f6f59e700 1 -- 172.21.15.49:0/2486336971 wait complete. 2023-11-30T18:23:01.241 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-30T18:23:01.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.407+0000 7fd0d55ed700 1 Processor -- start 2023-11-30T18:23:01.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.407+0000 7fd0d55ed700 1 -- start start 2023-11-30T18:23:01.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.408+0000 7fd0d55ed700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd0d01580b0 0x7fd0d00a9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:01.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.408+0000 7fd0d55ed700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0d00aa490 0x7fd0d00c0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:01.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.408+0000 7fd0d55ed700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d00c0a00 con 0x7fd0d0154420 2023-11-30T18:23:01.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.408+0000 7fd0d55ed700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0d0158530 con 0x7fd0d01580b0 2023-11-30T18:23:01.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.408+0000 7fd0d55ed700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d00aa8f0 con 0x7fd0d00aa490 2023-11-30T18:23:01.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.408+0000 7fd0ceffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd0d0154420 0x7fd0d0064d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42858/0 (socket says 172.21.15.49:42858) 2023-11-30T18:23:01.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.408+0000 7fd0ceffd700 1 -- 172.21.15.49:0/278127099 learned_addr learned my addr 172.21.15.49:0/278127099 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:23:01.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.408+0000 7fd0cf7fe700 1 --2- 172.21.15.49:0/278127099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0d00aa490 0x7fd0d00c0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:01.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.408+0000 7fd0cdffb700 1 -- 172.21.15.49:0/278127099 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3388707763 0 0) 0x7fd0d00c0a00 con 0x7fd0d0154420 2023-11-30T18:23:01.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.408+0000 7fd0ce7fc700 1 --2- 172.21.15.49:0/278127099 >> v2:172.21.15.115:3300/0 conn(0x7fd0d01580b0 0x7fd0d00a9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:01.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.408+0000 7fd0cdffb700 1 -- 172.21.15.49:0/278127099 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0bc0033f0 con 0x7fd0d0154420 2023-11-30T18:23:01.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.409+0000 7fd0cdffb700 1 -- 172.21.15.49:0/278127099 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 957927127 0 0) 0x7fd0bc0033f0 con 0x7fd0d0154420 2023-11-30T18:23:01.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.409+0000 7fd0cdffb700 1 -- 172.21.15.49:0/278127099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0d00aa490 msgr2=0x7fd0d00c0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:01.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.409+0000 7fd0cdffb700 1 --2- 172.21.15.49:0/278127099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0d00aa490 0x7fd0d00c0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:01.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.409+0000 7fd0cdffb700 1 -- 172.21.15.49:0/278127099 >> v2:172.21.15.115:3300/0 conn(0x7fd0d01580b0 msgr2=0x7fd0d00a9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:01.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.409+0000 7fd0cdffb700 1 --2- 172.21.15.49:0/278127099 >> v2:172.21.15.115:3300/0 conn(0x7fd0d01580b0 0x7fd0d00a9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:01.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.409+0000 7fd0cdffb700 1 -- 172.21.15.49:0/278127099 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d0158fc0 con 0x7fd0d0154420 2023-11-30T18:23:01.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.409+0000 7fd0cdffb700 1 -- 172.21.15.49:0/278127099 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fd0c00017f0 con 0x7fd0d0154420 2023-11-30T18:23:01.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.409+0000 7fd0cdffb700 1 -- 172.21.15.49:0/278127099 >> v1:172.21.15.49:6789/0 conn(0x7fd0d0154420 legacy=0x7fd0d0064d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:01.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.409+0000 7fd0cdffb700 1 --2- 172.21.15.49:0/278127099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0bc0038e0 0x7fd0bc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:01.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.409+0000 7fd0cdffb700 1 --2- 172.21.15.49:0/278127099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0bc004690 0x7fd0bc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:01.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.409+0000 7fd0cdffb700 1 --2- 172.21.15.49:0/278127099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0d00aa490 0x7fd0bc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:01.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.409+0000 7fd0cdffb700 1 -- 172.21.15.49:0/278127099 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d00aa8f0 con 0x7fd0bc0038e0 2023-11-30T18:23:01.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.409+0000 7fd0cdffb700 1 -- 172.21.15.49:0/278127099 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc0044e0 con 0x7fd0bc004690 2023-11-30T18:23:01.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.409+0000 7fd0cdffb700 1 -- 172.21.15.49:0/278127099 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc00b960 con 0x7fd0d00aa490 2023-11-30T18:23:01.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.409+0000 7fd0ceffd700 1 --2- 172.21.15.49:0/278127099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0bc0038e0 0x7fd0bc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:01.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.409+0000 7fd0ce7fc700 1 --2- 172.21.15.49:0/278127099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0bc004690 0x7fd0bc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:01.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.409+0000 7fd0cf7fe700 1 --2- 172.21.15.49:0/278127099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0d00aa490 0x7fd0bc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:01.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.409+0000 7fd0ceffd700 1 -- 172.21.15.49:0/278127099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0d00aa490 msgr2=0x7fd0bc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:01.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.409+0000 7fd0ceffd700 1 --2- 172.21.15.49:0/278127099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0d00aa490 0x7fd0bc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:01.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.409+0000 7fd0ceffd700 1 -- 172.21.15.49:0/278127099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0bc004690 msgr2=0x7fd0bc004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:01.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.409+0000 7fd0ceffd700 1 --2- 172.21.15.49:0/278127099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0bc004690 0x7fd0bc004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:01.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.409+0000 7fd0ceffd700 1 -- 172.21.15.49:0/278127099 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0bc0033f0 con 0x7fd0bc0038e0 2023-11-30T18:23:01.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.409+0000 7fd0ceffd700 1 --2- 172.21.15.49:0/278127099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0bc0038e0 0x7fd0bc003d00 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7fd0c000c530 tx=0x7fd0c0001d90).ready entity=mon.0 client_cookie=2bda6cdc72d8fd85 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:01.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.409+0000 7fd0cdffb700 1 -- 172.21.15.49:0/278127099 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c000ce60 con 0x7fd0bc0038e0 2023-11-30T18:23:01.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.409+0000 7fd0cdffb700 1 -- 172.21.15.49:0/278127099 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c0005b20 con 0x7fd0bc0038e0 2023-11-30T18:23:01.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.409+0000 7fd0cdffb700 1 -- 172.21.15.49:0/278127099 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c00070d0 con 0x7fd0bc0038e0 2023-11-30T18:23:01.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.410+0000 7fd0d55ed700 1 -- 172.21.15.49:0/278127099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0bc0038e0 msgr2=0x7fd0bc003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:01.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.410+0000 7fd0d55ed700 1 --2- 172.21.15.49:0/278127099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0bc0038e0 0x7fd0bc003d00 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7fd0c000c530 tx=0x7fd0c0001d90).stop 2023-11-30T18:23:01.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.410+0000 7fd0cf7fe700 1 -- 172.21.15.49:0/278127099 reap_dead start 2023-11-30T18:23:01.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.410+0000 7fd0d55ed700 1 -- 172.21.15.49:0/278127099 shutdown_connections 2023-11-30T18:23:01.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.410+0000 7fd0d55ed700 1 -- 172.21.15.49:0/278127099 >> 172.21.15.49:0/278127099 conn(0x7fd0d00c7af0 msgr2=0x7fd0d00c7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:01.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.410+0000 7fd0d55ed700 1 -- 172.21.15.49:0/278127099 shutdown_connections 2023-11-30T18:23:01.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.410+0000 7fd0d55ed700 1 -- 172.21.15.49:0/278127099 wait complete. 2023-11-30T18:23:01.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.411+0000 7fd0d55ed700 1 Processor -- start 2023-11-30T18:23:01.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.411+0000 7fd0d55ed700 1 -- start start 2023-11-30T18:23:01.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.412+0000 7fd0d55ed700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0bc0038e0 0x7fd0d014e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:01.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.412+0000 7fd0d55ed700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0d00b0570 0x7fd0d00b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:01.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.412+0000 7fd0d55ed700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0d014fac0 0x7fd0d014ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:01.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.412+0000 7fd0d55ed700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d0155710 con 0x7fd0d014fac0 2023-11-30T18:23:01.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.412+0000 7fd0d55ed700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d0150430 con 0x7fd0bc0038e0 2023-11-30T18:23:01.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.412+0000 7fd0d55ed700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d0167b90 con 0x7fd0d00b0570 2023-11-30T18:23:01.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.412+0000 7fd0cf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0d014fac0 0x7fd0d014ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:01.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.412+0000 7fd0cf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0d014fac0 0x7fd0d014ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44844/0 (socket says 172.21.15.49:44844) 2023-11-30T18:23:01.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.412+0000 7fd0cf7fe700 1 -- 172.21.15.49:0/4261142160 learned_addr learned my addr 172.21.15.49:0/4261142160 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:01.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.412+0000 7fd0ce7fc700 1 --2- 172.21.15.49:0/4261142160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0d00b0570 0x7fd0d00b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:01.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.412+0000 7fd0ceffd700 1 --2- 172.21.15.49:0/4261142160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0bc0038e0 0x7fd0d014e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:01.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.412+0000 7fd0cf7fe700 1 -- 172.21.15.49:0/4261142160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0d00b0570 msgr2=0x7fd0d00b09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:01.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.412+0000 7fd0cf7fe700 1 --2- 172.21.15.49:0/4261142160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0d00b0570 0x7fd0d00b09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:01.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.412+0000 7fd0cf7fe700 1 -- 172.21.15.49:0/4261142160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0bc0038e0 msgr2=0x7fd0d014e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:01.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.413+0000 7fd0cf7fe700 1 --2- 172.21.15.49:0/4261142160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0bc0038e0 0x7fd0d014e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:01.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.413+0000 7fd0cf7fe700 1 -- 172.21.15.49:0/4261142160 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d0167e70 con 0x7fd0d014fac0 2023-11-30T18:23:01.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.413+0000 7fd0ceffd700 1 --2- 172.21.15.49:0/4261142160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0bc0038e0 0x7fd0d014e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:23:01.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.413+0000 7fd0cf7fe700 1 --2- 172.21.15.49:0/4261142160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0d014fac0 0x7fd0d014ff40 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7fd0c8006d80 tx=0x7fd0c8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:01.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.413+0000 7fd0c6ffd700 1 -- 172.21.15.49:0/4261142160 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c800f730 con 0x7fd0d014fac0 2023-11-30T18:23:01.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.413+0000 7fd0c6ffd700 1 -- 172.21.15.49:0/4261142160 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c800f890 con 0x7fd0d014fac0 2023-11-30T18:23:01.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.413+0000 7fd0d55ed700 1 -- 172.21.15.49:0/4261142160 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d0168150 con 0x7fd0d014fac0 2023-11-30T18:23:01.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.413+0000 7fd0c6ffd700 1 -- 172.21.15.49:0/4261142160 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c800fc30 con 0x7fd0d014fac0 2023-11-30T18:23:01.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.413+0000 7fd0d55ed700 1 -- 172.21.15.49:0/4261142160 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d014eb10 con 0x7fd0d014fac0 2023-11-30T18:23:01.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.414+0000 7fd0d55ed700 1 -- 172.21.15.49:0/4261142160 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d01685f0 con 0x7fd0d014fac0 2023-11-30T18:23:01.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.414+0000 7fd0c6ffd700 1 -- 172.21.15.49:0/4261142160 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 74) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fd0c8014440 con 0x7fd0d014fac0 2023-11-30T18:23:01.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.415+0000 7fd0c6ffd700 1 --2- 172.21.15.49:0/4261142160 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd0b005f000 0x7fd0b00614c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:01.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.415+0000 7fd0c6ffd700 1 -- 172.21.15.49:0/4261142160 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6736+0+0 (secure 0 0 0) 0x7fd0c807aa70 con 0x7fd0d014fac0 2023-11-30T18:23:01.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.415+0000 7fd0ceffd700 1 --2- 172.21.15.49:0/4261142160 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd0b005f000 0x7fd0b00614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:01.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.415+0000 7fd0ceffd700 1 --2- 172.21.15.49:0/4261142160 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd0b005f000 0x7fd0b00614c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fd0c00014a0 tx=0x7fd0c0015000).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:01.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.419+0000 7fd0c6ffd700 1 -- 172.21.15.49:0/4261142160 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd0c804bc50 con 0x7fd0d014fac0 2023-11-30T18:23:01.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:01.590+0000 7fd0d55ed700 1 -- 172.21.15.49:0/4261142160 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd0d006c7c0 con 0x7fd0d014fac0 2023-11-30T18:23:02.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.233+0000 7fd0c6ffd700 1 -- 172.21.15.49:0/4261142160 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fd0c80787b0 con 0x7fd0d014fac0 2023-11-30T18:23:02.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.236+0000 7fd0c6ffd700 1 -- 172.21.15.49:0/4261142160 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v174) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd0c8070820 con 0x7fd0d014fac0 2023-11-30T18:23:02.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.242+0000 7fd0d55ed700 1 -- 172.21.15.49:0/4261142160 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd0b005f000 msgr2=0x7fd0b00614c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:02.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.242+0000 7fd0d55ed700 1 --2- 172.21.15.49:0/4261142160 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd0b005f000 0x7fd0b00614c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fd0c00014a0 tx=0x7fd0c0015000).stop 2023-11-30T18:23:02.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.242+0000 7fd0d55ed700 1 -- 172.21.15.49:0/4261142160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0d014fac0 msgr2=0x7fd0d014ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:02.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.242+0000 7fd0d55ed700 1 --2- 172.21.15.49:0/4261142160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0d014fac0 0x7fd0d014ff40 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7fd0c8006d80 tx=0x7fd0c8009060).stop 2023-11-30T18:23:02.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.242+0000 7fd0d55ed700 1 -- 172.21.15.49:0/4261142160 shutdown_connections 2023-11-30T18:23:02.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.242+0000 7fd0d55ed700 1 --2- 172.21.15.49:0/4261142160 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fd0b005f000 0x7fd0b00614c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:02.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.242+0000 7fd0d55ed700 1 --2- 172.21.15.49:0/4261142160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0d014fac0 0x7fd0d014ff40 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:02.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.242+0000 7fd0d55ed700 1 --2- 172.21.15.49:0/4261142160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0bc0038e0 0x7fd0d014e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:02.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.242+0000 7fd0d55ed700 1 --2- 172.21.15.49:0/4261142160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0d00b0570 0x7fd0d00b09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:02.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.242+0000 7fd0d55ed700 1 -- 172.21.15.49:0/4261142160 >> 172.21.15.49:0/4261142160 conn(0x7fd0d00c7af0 msgr2=0x7fd0d00ca310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:02.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.243+0000 7fd0d55ed700 1 -- 172.21.15.49:0/4261142160 shutdown_connections 2023-11-30T18:23:02.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.243+0000 7fd0d55ed700 1 -- 172.21.15.49:0/4261142160 wait complete. 2023-11-30T18:23:02.246 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2023-11-30T18:23:02.260 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-30T18:23:02.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.387+0000 7f04b5422700 1 Processor -- start 2023-11-30T18:23:02.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.387+0000 7f04b5422700 1 -- start start 2023-11-30T18:23:02.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.387+0000 7f04b5422700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f04b00aa930 0x7f04b00a7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:02.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.387+0000 7f04b5422700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b00c6630 con 0x7f04b0154530 2023-11-30T18:23:02.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.387+0000 7f04b5422700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b0064230 con 0x7f04b0154910 2023-11-30T18:23:02.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.387+0000 7f04b5422700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04b00c6390 con 0x7f04b00aa930 2023-11-30T18:23:02.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.388+0000 7f04aeffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f04b0154530 0x7f04b00c8580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42870/0 (socket says 172.21.15.49:42870) 2023-11-30T18:23:02.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.388+0000 7f04aeffd700 1 -- 172.21.15.49:0/613916720 learned_addr learned my addr 172.21.15.49:0/613916720 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:23:02.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.388+0000 7f04af7fe700 1 --2- 172.21.15.49:0/613916720 >> v2:172.21.15.115:3300/0 conn(0x7f04b00aa930 0x7f04b00a7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:02.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.388+0000 7f04adffb700 1 -- 172.21.15.49:0/613916720 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1785081680 0 0) 0x7f04b00c6630 con 0x7f04b0154530 2023-11-30T18:23:02.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.388+0000 7f04adffb700 1 -- 172.21.15.49:0/613916720 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04980033f0 con 0x7f04b0154530 2023-11-30T18:23:02.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.388+0000 7f04adffb700 1 -- 172.21.15.49:0/613916720 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1714940874 0 0) 0x7f04980033f0 con 0x7f04b0154530 2023-11-30T18:23:02.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.388+0000 7f04adffb700 1 -- 172.21.15.49:0/613916720 >> v2:172.21.15.115:3300/0 conn(0x7f04b00aa930 msgr2=0x7f04b00a7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:02.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.388+0000 7f04adffb700 1 --2- 172.21.15.49:0/613916720 >> v2:172.21.15.115:3300/0 conn(0x7f04b00aa930 0x7f04b00a7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:02.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.388+0000 7f04adffb700 1 -- 172.21.15.49:0/613916720 >> v1:172.21.15.115:6789/0 conn(0x7f04b0154910 legacy=0x7f04b00aa220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:02.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.388+0000 7f04adffb700 1 -- 172.21.15.49:0/613916720 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b0064510 con 0x7f04b0154530 2023-11-30T18:23:02.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.388+0000 7f04adffb700 1 -- 172.21.15.49:0/613916720 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f04a00015f0 con 0x7f04b0154530 2023-11-30T18:23:02.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.388+0000 7f04adffb700 1 -- 172.21.15.49:0/613916720 >> v1:172.21.15.49:6789/0 conn(0x7f04b0154530 legacy=0x7f04b00c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:02.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.388+0000 7f04adffb700 1 --2- 172.21.15.49:0/613916720 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04980038e0 0x7f0498003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:02.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.388+0000 7f04adffb700 1 --2- 172.21.15.49:0/613916720 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0498004690 0x7f0498004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:02.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.388+0000 7f04adffb700 1 --2- 172.21.15.49:0/613916720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0498005000 0x7f049800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:02.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.388+0000 7f04adffb700 1 -- 172.21.15.49:0/613916720 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b00c6390 con 0x7f0498005000 2023-11-30T18:23:02.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.388+0000 7f04adffb700 1 -- 172.21.15.49:0/613916720 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049800bf60 con 0x7f0498004690 2023-11-30T18:23:02.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.388+0000 7f04adffb700 1 -- 172.21.15.49:0/613916720 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049800c0f0 con 0x7f04980038e0 2023-11-30T18:23:02.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.388+0000 7f04af7fe700 1 --2- 172.21.15.49:0/613916720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0498005000 0x7f049800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:02.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.388+0000 7f04ae7fc700 1 --2- 172.21.15.49:0/613916720 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0498004690 0x7f0498004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:02.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.388+0000 7f04aeffd700 1 --2- 172.21.15.49:0/613916720 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04980038e0 0x7f0498003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:02.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.389+0000 7f04af7fe700 1 -- 172.21.15.49:0/613916720 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04980038e0 msgr2=0x7f0498003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:02.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.389+0000 7f04af7fe700 1 --2- 172.21.15.49:0/613916720 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04980038e0 0x7f0498003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:02.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.389+0000 7f04af7fe700 1 -- 172.21.15.49:0/613916720 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0498004690 msgr2=0x7f0498004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:02.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.389+0000 7f04af7fe700 1 --2- 172.21.15.49:0/613916720 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0498004690 0x7f0498004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:02.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.389+0000 7f04af7fe700 1 -- 172.21.15.49:0/613916720 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04980033f0 con 0x7f0498005000 2023-11-30T18:23:02.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.389+0000 7f04af7fe700 1 -- 172.21.15.49:0/613916720 reap_dead start 2023-11-30T18:23:02.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.389+0000 7f04af7fe700 1 --2- 172.21.15.49:0/613916720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0498005000 0x7f049800b8e0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7f04b00a9fe0 tx=0x7f04a800b040).ready entity=mon.0 client_cookie=b19bb261834c380e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:02.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.389+0000 7f04adffb700 1 -- 172.21.15.49:0/613916720 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8009ac0 con 0x7f0498005000 2023-11-30T18:23:02.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.389+0000 7f04adffb700 1 -- 172.21.15.49:0/613916720 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a800f040 con 0x7f0498005000 2023-11-30T18:23:02.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.389+0000 7f04adffb700 1 -- 172.21.15.49:0/613916720 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a800ece0 con 0x7f0498005000 2023-11-30T18:23:02.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.389+0000 7f04b5422700 1 -- 172.21.15.49:0/613916720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0498005000 msgr2=0x7f049800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:02.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.389+0000 7f04b5422700 1 --2- 172.21.15.49:0/613916720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0498005000 0x7f049800b8e0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7f04b00a9fe0 tx=0x7f04a800b040).stop 2023-11-30T18:23:02.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.389+0000 7f04b5422700 1 -- 172.21.15.49:0/613916720 shutdown_connections 2023-11-30T18:23:02.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.389+0000 7f04b5422700 1 --2- 172.21.15.49:0/613916720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0498005000 0x7f049800b8e0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:02.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.389+0000 7f04b5422700 1 -- 172.21.15.49:0/613916720 >> 172.21.15.49:0/613916720 conn(0x7f04b0094930 msgr2=0x7f04b006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:02.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.389+0000 7f04b5422700 1 -- 172.21.15.49:0/613916720 shutdown_connections 2023-11-30T18:23:02.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.390+0000 7f04b5422700 1 -- 172.21.15.49:0/613916720 wait complete. 2023-11-30T18:23:02.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.391+0000 7f04b5422700 1 Processor -- start 2023-11-30T18:23:02.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.391+0000 7f04b5422700 1 -- start start 2023-11-30T18:23:02.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.392+0000 7f04b5422700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0498005000 0x7f04b014f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:02.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.392+0000 7f04b5422700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04b00b1030 0x7f04b0167e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:02.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.392+0000 7f04b5422700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04b0168340 0x7f04b00acab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:02.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.392+0000 7f04b5422700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b00ac620 con 0x7f0498005000 2023-11-30T18:23:02.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.392+0000 7f04b5422700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b01687c0 con 0x7f04b00b1030 2023-11-30T18:23:02.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.392+0000 7f04b5422700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b014f9d0 con 0x7f04b0168340 2023-11-30T18:23:02.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.392+0000 7f04aeffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0498005000 0x7f04b014f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:02.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.392+0000 7f04aeffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0498005000 0x7f04b014f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44866/0 (socket says 172.21.15.49:44866) 2023-11-30T18:23:02.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.392+0000 7f04aeffd700 1 -- 172.21.15.49:0/3136324241 learned_addr learned my addr 172.21.15.49:0/3136324241 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:02.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.392+0000 7f04af7fe700 1 --2- 172.21.15.49:0/3136324241 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04b0168340 0x7f04b00acab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:02.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.392+0000 7f04ae7fc700 1 --2- 172.21.15.49:0/3136324241 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04b00b1030 0x7f04b0167e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:02.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.392+0000 7f04aeffd700 1 -- 172.21.15.49:0/3136324241 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04b0168340 msgr2=0x7f04b00acab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:02.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.392+0000 7f04aeffd700 1 --2- 172.21.15.49:0/3136324241 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04b0168340 0x7f04b00acab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:02.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.392+0000 7f04aeffd700 1 -- 172.21.15.49:0/3136324241 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04b00b1030 msgr2=0x7f04b0167e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:02.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.392+0000 7f04aeffd700 1 --2- 172.21.15.49:0/3136324241 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04b00b1030 0x7f04b0167e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:02.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.392+0000 7f04aeffd700 1 -- 172.21.15.49:0/3136324241 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b00c4e80 con 0x7f0498005000 2023-11-30T18:23:02.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.392+0000 7f04aeffd700 1 --2- 172.21.15.49:0/3136324241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0498005000 0x7f04b014f4e0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7f04a000f8e0 tx=0x7f04a0009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:02.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.392+0000 7f0496ffd700 1 -- 172.21.15.49:0/3136324241 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a00070d0 con 0x7f0498005000 2023-11-30T18:23:02.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.392+0000 7f0496ffd700 1 -- 172.21.15.49:0/3136324241 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a0007230 con 0x7f0498005000 2023-11-30T18:23:02.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.392+0000 7f04b5422700 1 -- 172.21.15.49:0/3136324241 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b00abcf0 con 0x7f0498005000 2023-11-30T18:23:02.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.392+0000 7f0496ffd700 1 -- 172.21.15.49:0/3136324241 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a0005880 con 0x7f0498005000 2023-11-30T18:23:02.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.392+0000 7f04b5422700 1 -- 172.21.15.49:0/3136324241 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b00ac2b0 con 0x7f0498005000 2023-11-30T18:23:02.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.394+0000 7f04b5422700 1 -- 172.21.15.49:0/3136324241 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b00ac900 con 0x7f0498005000 2023-11-30T18:23:02.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.394+0000 7f0496ffd700 1 -- 172.21.15.49:0/3136324241 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f04a0005bf0 con 0x7f0498005000 2023-11-30T18:23:02.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.394+0000 7f0496ffd700 1 --2- 172.21.15.49:0/3136324241 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f049c05f270 0x7f049c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:02.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.394+0000 7f0496ffd700 1 -- 172.21.15.49:0/3136324241 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6298+0+0 (secure 0 0 0) 0x7f04a0079dd0 con 0x7f0498005000 2023-11-30T18:23:02.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.394+0000 7f04ae7fc700 1 --2- 172.21.15.49:0/3136324241 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f049c05f270 0x7f049c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:02.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.395+0000 7f04ae7fc700 1 --2- 172.21.15.49:0/3136324241 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f049c05f270 0x7f049c061730 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f04b0167db0 tx=0x7f04a4007bb0).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:02.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.398+0000 7f0496ffd700 1 -- 172.21.15.49:0/3136324241 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f04a004ae70 con 0x7f0498005000 2023-11-30T18:23:02.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:02.574+0000 7f04b5422700 1 -- 172.21.15.49:0/3136324241 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f04b006c860 con 0x7f0498005000 2023-11-30T18:23:03.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.231+0000 7f0496ffd700 1 -- 172.21.15.49:0/3136324241 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v175) v1 ==== 169+0+0 (secure 0 0 0) 0x7f04a004e490 con 0x7f0498005000 2023-11-30T18:23:03.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.237+0000 7f04b5422700 1 -- 172.21.15.49:0/3136324241 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f049c05f270 msgr2=0x7f049c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:03.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.237+0000 7f04b5422700 1 --2- 172.21.15.49:0/3136324241 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f049c05f270 0x7f049c061730 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f04b0167db0 tx=0x7f04a4007bb0).stop 2023-11-30T18:23:03.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.237+0000 7f04b5422700 1 -- 172.21.15.49:0/3136324241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0498005000 msgr2=0x7f04b014f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:03.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.237+0000 7f04b5422700 1 --2- 172.21.15.49:0/3136324241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0498005000 0x7f04b014f4e0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7f04a000f8e0 tx=0x7f04a0009040).stop 2023-11-30T18:23:03.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.238+0000 7f04b5422700 1 -- 172.21.15.49:0/3136324241 shutdown_connections 2023-11-30T18:23:03.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.238+0000 7f04b5422700 1 --2- 172.21.15.49:0/3136324241 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04b0168340 0x7f04b00acab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:03.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.238+0000 7f04b5422700 1 --2- 172.21.15.49:0/3136324241 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f049c05f270 0x7f049c061730 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:03.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.238+0000 7f04b5422700 1 --2- 172.21.15.49:0/3136324241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0498005000 0x7f04b014f4e0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:03.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.238+0000 7f04b5422700 1 --2- 172.21.15.49:0/3136324241 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04b00b1030 0x7f04b0167e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:03.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.238+0000 7f04b5422700 1 -- 172.21.15.49:0/3136324241 >> 172.21.15.49:0/3136324241 conn(0x7f04b0094930 msgr2=0x7f04b014fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:03.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.238+0000 7f04b5422700 1 -- 172.21.15.49:0/3136324241 shutdown_connections 2023-11-30T18:23:03.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.239+0000 7f04b5422700 1 -- 172.21.15.49:0/3136324241 wait complete. 2023-11-30T18:23:03.242 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2023-11-30T18:23:03.257 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-30T18:23:03.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.387+0000 7ff1d2271700 1 Processor -- start 2023-11-30T18:23:03.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.387+0000 7ff1d2271700 1 -- start start 2023-11-30T18:23:03.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.387+0000 7ff1d2271700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1cc0c6190 0x7ff1cc0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:03.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.388+0000 7ff1d2271700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1cc0c72d0 con 0x7ff1cc098d10 2023-11-30T18:23:03.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.388+0000 7ff1d2271700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1cc064570 con 0x7ff1cc158320 2023-11-30T18:23:03.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.388+0000 7ff1d2271700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc154bc0 con 0x7ff1cc0c6190 2023-11-30T18:23:03.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.388+0000 7ff1cbfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff1cc098d10 0x7ff1cc063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42872/0 (socket says 172.21.15.49:42872) 2023-11-30T18:23:03.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.388+0000 7ff1cbfff700 1 -- 172.21.15.49:0/1700075516 learned_addr learned my addr 172.21.15.49:0/1700075516 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:23:03.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.388+0000 7ff1cb7fe700 1 --2- 172.21.15.49:0/1700075516 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1cc0c6190 0x7ff1cc0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:03.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.388+0000 7ff1caffd700 1 -- 172.21.15.49:0/1700075516 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2305027578 0 0) 0x7ff1cc0c72d0 con 0x7ff1cc098d10 2023-11-30T18:23:03.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.388+0000 7ff1caffd700 1 -- 172.21.15.49:0/1700075516 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1b40033f0 con 0x7ff1cc098d10 2023-11-30T18:23:03.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.388+0000 7ff1caffd700 1 -- 172.21.15.49:0/1700075516 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 700455634 0 0) 0x7ff1b40033f0 con 0x7ff1cc098d10 2023-11-30T18:23:03.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.388+0000 7ff1caffd700 1 -- 172.21.15.49:0/1700075516 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1cc0c6190 msgr2=0x7ff1cc0c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:03.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.388+0000 7ff1caffd700 1 --2- 172.21.15.49:0/1700075516 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1cc0c6190 0x7ff1cc0c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:03.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.388+0000 7ff1caffd700 1 -- 172.21.15.49:0/1700075516 >> v1:172.21.15.115:6789/0 conn(0x7ff1cc158320 legacy=0x7ff1cc0a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:03.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.388+0000 7ff1caffd700 1 -- 172.21.15.49:0/1700075516 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc0c66c0 con 0x7ff1cc098d10 2023-11-30T18:23:03.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.388+0000 7ff1caffd700 1 -- 172.21.15.49:0/1700075516 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7ff1bc001470 con 0x7ff1cc098d10 2023-11-30T18:23:03.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.388+0000 7ff1caffd700 1 -- 172.21.15.49:0/1700075516 >> v1:172.21.15.49:6789/0 conn(0x7ff1cc098d10 legacy=0x7ff1cc063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:03.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.388+0000 7ff1caffd700 1 --2- 172.21.15.49:0/1700075516 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1cc0c6190 0x7ff1b4003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:03.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.388+0000 7ff1caffd700 1 --2- 172.21.15.49:0/1700075516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1b4003e00 0x7ff1b4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:03.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.388+0000 7ff1caffd700 1 --2- 172.21.15.49:0/1700075516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1b4004b80 0x7ff1b4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:03.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.388+0000 7ff1caffd700 1 -- 172.21.15.49:0/1700075516 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc154bc0 con 0x7ff1b4004b80 2023-11-30T18:23:03.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.388+0000 7ff1caffd700 1 -- 172.21.15.49:0/1700075516 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b400b8e0 con 0x7ff1b4003e00 2023-11-30T18:23:03.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.388+0000 7ff1caffd700 1 -- 172.21.15.49:0/1700075516 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b400baa0 con 0x7ff1cc0c6190 2023-11-30T18:23:03.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.388+0000 7ff1d080e700 1 --2- 172.21.15.49:0/1700075516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1b4004b80 0x7ff1b4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:03.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.389+0000 7ff1cbfff700 1 --2- 172.21.15.49:0/1700075516 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1cc0c6190 0x7ff1b4003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:03.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.389+0000 7ff1cb7fe700 1 --2- 172.21.15.49:0/1700075516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1b4003e00 0x7ff1b4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:03.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.389+0000 7ff1d080e700 1 -- 172.21.15.49:0/1700075516 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1cc0c6190 msgr2=0x7ff1b4003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:03.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.389+0000 7ff1d080e700 1 --2- 172.21.15.49:0/1700075516 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1cc0c6190 0x7ff1b4003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:03.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.389+0000 7ff1d080e700 1 -- 172.21.15.49:0/1700075516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1b4003e00 msgr2=0x7ff1b4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:03.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.389+0000 7ff1d080e700 1 --2- 172.21.15.49:0/1700075516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1b4003e00 0x7ff1b4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:03.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.389+0000 7ff1d080e700 1 -- 172.21.15.49:0/1700075516 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b40033f0 con 0x7ff1b4004b80 2023-11-30T18:23:03.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.389+0000 7ff1d080e700 1 --2- 172.21.15.49:0/1700075516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1b4004b80 0x7ff1b4005000 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7ff1c4001f20 tx=0x7ff1c4007f10).ready entity=mon.0 client_cookie=60e4d1911963728c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:03.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.389+0000 7ff1caffd700 1 -- 172.21.15.49:0/1700075516 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c40017e0 con 0x7ff1b4004b80 2023-11-30T18:23:03.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.389+0000 7ff1caffd700 1 -- 172.21.15.49:0/1700075516 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c400c6d0 con 0x7ff1b4004b80 2023-11-30T18:23:03.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.389+0000 7ff1caffd700 1 -- 172.21.15.49:0/1700075516 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c400ca50 con 0x7ff1b4004b80 2023-11-30T18:23:03.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.390+0000 7ff1d2271700 1 -- 172.21.15.49:0/1700075516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1b4004b80 msgr2=0x7ff1b4005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:03.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.390+0000 7ff1d2271700 1 --2- 172.21.15.49:0/1700075516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1b4004b80 0x7ff1b4005000 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7ff1c4001f20 tx=0x7ff1c4007f10).stop 2023-11-30T18:23:03.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.390+0000 7ff1d080e700 1 -- 172.21.15.49:0/1700075516 reap_dead start 2023-11-30T18:23:03.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.390+0000 7ff1d2271700 1 -- 172.21.15.49:0/1700075516 shutdown_connections 2023-11-30T18:23:03.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.390+0000 7ff1d2271700 1 -- 172.21.15.49:0/1700075516 >> 172.21.15.49:0/1700075516 conn(0x7ff1cc0cb310 msgr2=0x7ff1cc0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:03.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.390+0000 7ff1d2271700 1 -- 172.21.15.49:0/1700075516 shutdown_connections 2023-11-30T18:23:03.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.390+0000 7ff1d2271700 1 -- 172.21.15.49:0/1700075516 wait complete. 2023-11-30T18:23:03.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.391+0000 7ff1d2271700 1 Processor -- start 2023-11-30T18:23:03.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.391+0000 7ff1d2271700 1 -- start start 2023-11-30T18:23:03.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.392+0000 7ff1d2271700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1b4004b80 0x7ff1cc150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:03.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.392+0000 7ff1d2271700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1cc0ca0b0 0x7ff1cc0b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:03.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.392+0000 7ff1d2271700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1cc0ca530 0x7ff1cc0b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:03.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.392+0000 7ff1d2271700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0aee80 con 0x7ff1cc0ca0b0 2023-11-30T18:23:03.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.392+0000 7ff1d2271700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0ac810 con 0x7ff1b4004b80 2023-11-30T18:23:03.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.392+0000 7ff1d2271700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0c7660 con 0x7ff1cc0ca530 2023-11-30T18:23:03.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.392+0000 7ff1cb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1cc0ca0b0 0x7ff1cc0b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:03.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.392+0000 7ff1cb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1cc0ca0b0 0x7ff1cc0b06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44884/0 (socket says 172.21.15.49:44884) 2023-11-30T18:23:03.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.392+0000 7ff1cb7fe700 1 -- 172.21.15.49:0/3723371817 learned_addr learned my addr 172.21.15.49:0/3723371817 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:03.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.392+0000 7ff1cbfff700 1 --2- 172.21.15.49:0/3723371817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1b4004b80 0x7ff1cc150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:03.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.392+0000 7ff1d080e700 1 --2- 172.21.15.49:0/3723371817 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1cc0ca530 0x7ff1cc0b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:03.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.392+0000 7ff1cb7fe700 1 -- 172.21.15.49:0/3723371817 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1cc0ca530 msgr2=0x7ff1cc0b0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:03.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.392+0000 7ff1cb7fe700 1 --2- 172.21.15.49:0/3723371817 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1cc0ca530 0x7ff1cc0b0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:03.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.392+0000 7ff1cb7fe700 1 -- 172.21.15.49:0/3723371817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1b4004b80 msgr2=0x7ff1cc150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:03.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.392+0000 7ff1cb7fe700 1 --2- 172.21.15.49:0/3723371817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1b4004b80 0x7ff1cc150490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:03.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.392+0000 7ff1cb7fe700 1 -- 172.21.15.49:0/3723371817 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc0ab920 con 0x7ff1cc0ca0b0 2023-11-30T18:23:03.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.392+0000 7ff1cb7fe700 1 --2- 172.21.15.49:0/3723371817 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1cc0ca0b0 0x7ff1cc0b06a0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7ff1c00119f0 tx=0x7ff1c0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:03.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.392+0000 7ff1b3fff700 1 -- 172.21.15.49:0/3723371817 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c000f6e0 con 0x7ff1cc0ca0b0 2023-11-30T18:23:03.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.392+0000 7ff1b3fff700 1 -- 172.21.15.49:0/3723371817 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c000f840 con 0x7ff1cc0ca0b0 2023-11-30T18:23:03.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.392+0000 7ff1d2271700 1 -- 172.21.15.49:0/3723371817 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1cc0abc00 con 0x7ff1cc0ca0b0 2023-11-30T18:23:03.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.392+0000 7ff1b3fff700 1 -- 172.21.15.49:0/3723371817 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c000fbc0 con 0x7ff1cc0ca0b0 2023-11-30T18:23:03.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.393+0000 7ff1d2271700 1 -- 172.21.15.49:0/3723371817 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1cc0ac1c0 con 0x7ff1cc0ca0b0 2023-11-30T18:23:03.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.393+0000 7ff1d2271700 1 -- 172.21.15.49:0/3723371817 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1cc0ac980 con 0x7ff1cc0ca0b0 2023-11-30T18:23:03.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.394+0000 7ff1b3fff700 1 -- 172.21.15.49:0/3723371817 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff1c001d450 con 0x7ff1cc0ca0b0 2023-11-30T18:23:03.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.394+0000 7ff1b3fff700 1 --2- 172.21.15.49:0/3723371817 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff1b805f240 0x7ff1b8061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:03.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.394+0000 7ff1b3fff700 1 -- 172.21.15.49:0/3723371817 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5884+0+0 (secure 0 0 0) 0x7ff1c007af10 con 0x7ff1cc0ca0b0 2023-11-30T18:23:03.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.394+0000 7ff1cbfff700 1 --2- 172.21.15.49:0/3723371817 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff1b805f240 0x7ff1b8061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:03.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.395+0000 7ff1cbfff700 1 --2- 172.21.15.49:0/3723371817 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff1b805f240 0x7ff1b8061700 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ff1bc0010e0 tx=0x7ff1bc001e70).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:03.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.398+0000 7ff1b3fff700 1 -- 172.21.15.49:0/3723371817 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff1c004c0f0 con 0x7ff1cc0ca0b0 2023-11-30T18:23:03.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.570+0000 7ff1d2271700 1 -- 172.21.15.49:0/3723371817 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff1cc06c860 con 0x7ff1cc0ca0b0 2023-11-30T18:23:03.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.573+0000 7ff1b3fff700 1 -- 172.21.15.49:0/3723371817 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v32) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff1c0022070 con 0x7ff1cc0ca0b0 2023-11-30T18:23:03.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.575+0000 7ff1d2271700 1 -- 172.21.15.49:0/3723371817 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff1b805f240 msgr2=0x7ff1b8061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:03.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.575+0000 7ff1d2271700 1 --2- 172.21.15.49:0/3723371817 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff1b805f240 0x7ff1b8061700 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ff1bc0010e0 tx=0x7ff1bc001e70).stop 2023-11-30T18:23:03.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.575+0000 7ff1d2271700 1 -- 172.21.15.49:0/3723371817 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1cc0ca0b0 msgr2=0x7ff1cc0b06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:03.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.575+0000 7ff1d2271700 1 --2- 172.21.15.49:0/3723371817 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1cc0ca0b0 0x7ff1cc0b06a0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7ff1c00119f0 tx=0x7ff1c0009060).stop 2023-11-30T18:23:03.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.575+0000 7ff1d2271700 1 -- 172.21.15.49:0/3723371817 shutdown_connections 2023-11-30T18:23:03.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.575+0000 7ff1d2271700 1 --2- 172.21.15.49:0/3723371817 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1cc0ca530 0x7ff1cc0b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:03.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.575+0000 7ff1d2271700 1 --2- 172.21.15.49:0/3723371817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1b4004b80 0x7ff1cc150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:03.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.575+0000 7ff1d2271700 1 --2- 172.21.15.49:0/3723371817 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff1b805f240 0x7ff1b8061700 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:03.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.575+0000 7ff1d2271700 1 --2- 172.21.15.49:0/3723371817 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1cc0ca0b0 0x7ff1cc0b06a0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:03.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.575+0000 7ff1d2271700 1 -- 172.21.15.49:0/3723371817 >> 172.21.15.49:0/3723371817 conn(0x7ff1cc0cb310 msgr2=0x7ff1cc154dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:03.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.575+0000 7ff1d2271700 1 -- 172.21.15.49:0/3723371817 shutdown_connections 2023-11-30T18:23:03.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.575+0000 7ff1d2271700 1 -- 172.21.15.49:0/3723371817 wait complete. 2023-11-30T18:23:03.589 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-11-30T18:23:03.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.707+0000 7f08d5769700 1 Processor -- start 2023-11-30T18:23:03.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.707+0000 7f08d5769700 1 -- start start 2023-11-30T18:23:03.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.708+0000 7f08d5769700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08d00c1780 0x7f08d00c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:03.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.708+0000 7f08d5769700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08d00c12f0 con 0x7f08d0157c10 2023-11-30T18:23:03.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.708+0000 7f08d5769700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08d00a8790 con 0x7f08d00c0250 2023-11-30T18:23:03.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.708+0000 7f08d5769700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d00c06e0 con 0x7f08d00c1780 2023-11-30T18:23:03.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.708+0000 7f08ceffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f08d0157c10 0x7f08d00a8080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42886/0 (socket says 172.21.15.49:42886) 2023-11-30T18:23:03.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.708+0000 7f08ceffd700 1 -- 172.21.15.49:0/2102881341 learned_addr learned my addr 172.21.15.49:0/2102881341 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:23:03.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.708+0000 7f08cf7fe700 1 --2- 172.21.15.49:0/2102881341 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08d00c1780 0x7f08d00c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:03.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.708+0000 7f08cdffb700 1 -- 172.21.15.49:0/2102881341 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 726084267 0 0) 0x7f08d00c12f0 con 0x7f08d0157c10 2023-11-30T18:23:03.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.708+0000 7f08cdffb700 1 -- 172.21.15.49:0/2102881341 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08bc0033f0 con 0x7f08d0157c10 2023-11-30T18:23:03.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.708+0000 7f08cf7fe700 1 -- 172.21.15.49:0/2102881341 >> v1:172.21.15.115:6789/0 conn(0x7f08d00c0250 legacy=0x7f08d00c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:03.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.708+0000 7f08cf7fe700 1 -- 172.21.15.49:0/2102881341 >> v1:172.21.15.49:6789/0 conn(0x7f08d0157c10 legacy=0x7f08d00a8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:03.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.708+0000 7f08cf7fe700 1 -- 172.21.15.49:0/2102881341 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d00c09c0 con 0x7f08d00c1780 2023-11-30T18:23:03.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.709+0000 7f08cf7fe700 1 --2- 172.21.15.49:0/2102881341 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08d00c1780 0x7f08d00c1bf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f08c0009790 tx=0x7f08c0009060).ready entity=mon.2 client_cookie=5942eeaf8d7e2f63 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:03.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.710+0000 7f08cdffb700 1 -- 172.21.15.49:0/2102881341 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c000f510 con 0x7f08d00c1780 2023-11-30T18:23:03.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.710+0000 7f08cdffb700 1 -- 172.21.15.49:0/2102881341 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c000f670 con 0x7f08d00c1780 2023-11-30T18:23:03.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.710+0000 7f08cdffb700 1 -- 172.21.15.49:0/2102881341 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c000f9f0 con 0x7f08d00c1780 2023-11-30T18:23:03.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.711+0000 7f08d5769700 1 -- 172.21.15.49:0/2102881341 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08d00c1780 msgr2=0x7f08d00c1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:03.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.711+0000 7f08d5769700 1 --2- 172.21.15.49:0/2102881341 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08d00c1780 0x7f08d00c1bf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f08c0009790 tx=0x7f08c0009060).stop 2023-11-30T18:23:03.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.711+0000 7f08d5769700 1 -- 172.21.15.49:0/2102881341 shutdown_connections 2023-11-30T18:23:03.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.711+0000 7f08d5769700 1 --2- 172.21.15.49:0/2102881341 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08d00c1780 0x7f08d00c1bf0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:03.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.711+0000 7f08d5769700 1 -- 172.21.15.49:0/2102881341 >> 172.21.15.49:0/2102881341 conn(0x7f08d006a610 msgr2=0x7f08d00cb2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:03.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.711+0000 7f08d5769700 1 -- 172.21.15.49:0/2102881341 shutdown_connections 2023-11-30T18:23:03.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.711+0000 7f08d5769700 1 -- 172.21.15.49:0/2102881341 wait complete. 2023-11-30T18:23:03.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.712+0000 7f08d5769700 1 Processor -- start 2023-11-30T18:23:03.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.712+0000 7f08d5769700 1 -- start start 2023-11-30T18:23:03.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.713+0000 7f08d5769700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08d00c1780 0x7f08d00abb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:03.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.713+0000 7f08d5769700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08d0157c10 0x7f08d0151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:03.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.713+0000 7f08d5769700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08d00c38f0 0x7f08d00c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:03.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.713+0000 7f08d5769700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d00ac7a0 con 0x7f08d0157c10 2023-11-30T18:23:03.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.713+0000 7f08d5769700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d00c3d70 con 0x7f08d00c1780 2023-11-30T18:23:03.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.713+0000 7f08d5769700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d00ac1e0 con 0x7f08d00c38f0 2023-11-30T18:23:03.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.713+0000 7f08ce7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08d0157c10 0x7f08d0151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:03.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.713+0000 7f08ce7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08d0157c10 0x7f08d0151570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44898/0 (socket says 172.21.15.49:44898) 2023-11-30T18:23:03.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.713+0000 7f08ce7fc700 1 -- 172.21.15.49:0/3491280200 learned_addr learned my addr 172.21.15.49:0/3491280200 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:03.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.713+0000 7f08ceffd700 1 --2- 172.21.15.49:0/3491280200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08d00c1780 0x7f08d00abb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:03.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.713+0000 7f08cf7fe700 1 --2- 172.21.15.49:0/3491280200 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08d00c38f0 0x7f08d00c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:03.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.713+0000 7f08ce7fc700 1 -- 172.21.15.49:0/3491280200 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08d00c38f0 msgr2=0x7f08d00c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:03.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.713+0000 7f08ce7fc700 1 --2- 172.21.15.49:0/3491280200 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08d00c38f0 0x7f08d00c49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:03.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.713+0000 7f08ce7fc700 1 -- 172.21.15.49:0/3491280200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08d00c1780 msgr2=0x7f08d00abb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:03.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.713+0000 7f08ce7fc700 1 --2- 172.21.15.49:0/3491280200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08d00c1780 0x7f08d00abb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:03.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.713+0000 7f08ce7fc700 1 -- 172.21.15.49:0/3491280200 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c00092a0 con 0x7f08d0157c10 2023-11-30T18:23:03.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.713+0000 7f08ce7fc700 1 --2- 172.21.15.49:0/3491280200 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08d0157c10 0x7f08d0151570 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7f08b800c4c0 tx=0x7f08b8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:03.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.714+0000 7f08c6ffd700 1 -- 172.21.15.49:0/3491280200 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b800ce70 con 0x7f08d0157c10 2023-11-30T18:23:03.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.714+0000 7f08c6ffd700 1 -- 172.21.15.49:0/3491280200 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b8001e90 con 0x7f08d0157c10 2023-11-30T18:23:03.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.714+0000 7f08d5769700 1 -- 172.21.15.49:0/3491280200 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d00ac4c0 con 0x7f08d0157c10 2023-11-30T18:23:03.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.714+0000 7f08c6ffd700 1 -- 172.21.15.49:0/3491280200 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b8007250 con 0x7f08d0157c10 2023-11-30T18:23:03.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.714+0000 7f08d5769700 1 -- 172.21.15.49:0/3491280200 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d00c44b0 con 0x7f08d0157c10 2023-11-30T18:23:03.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.715+0000 7f08d5769700 1 -- 172.21.15.49:0/3491280200 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d00c4030 con 0x7f08d0157c10 2023-11-30T18:23:03.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.715+0000 7f08c6ffd700 1 -- 172.21.15.49:0/3491280200 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f08b80066a0 con 0x7f08d0157c10 2023-11-30T18:23:03.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.715+0000 7f08c6ffd700 1 --2- 172.21.15.49:0/3491280200 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f08b005f270 0x7f08b0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:03.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.716+0000 7f08c6ffd700 1 -- 172.21.15.49:0/3491280200 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5884+0+0 (secure 0 0 0) 0x7f08b8079ba0 con 0x7f08d0157c10 2023-11-30T18:23:03.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.716+0000 7f08ceffd700 1 --2- 172.21.15.49:0/3491280200 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f08b005f270 0x7f08b0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:03.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.716+0000 7f08ceffd700 1 --2- 172.21.15.49:0/3491280200 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f08b005f270 0x7f08b0061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f08c80016e0 tx=0x7f08c8009040).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:03.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.720+0000 7f08c6ffd700 1 -- 172.21.15.49:0/3491280200 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f08d00c4030 con 0x7f08d0157c10 2023-11-30T18:23:03.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.894+0000 7f08d5769700 1 -- 172.21.15.49:0/3491280200 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f08d00c4030 con 0x7f08d0157c10 2023-11-30T18:23:03.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.898+0000 7f08c6ffd700 1 -- 172.21.15.49:0/3491280200 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v33) v1 ==== 120+0+0 (secure 0 0 0) 0x7f08d00c4030 con 0x7f08d0157c10 2023-11-30T18:23:03.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.900+0000 7f08d5769700 1 -- 172.21.15.49:0/3491280200 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f08b005f270 msgr2=0x7f08b0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:03.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.900+0000 7f08d5769700 1 --2- 172.21.15.49:0/3491280200 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f08b005f270 0x7f08b0061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f08c80016e0 tx=0x7f08c8009040).stop 2023-11-30T18:23:03.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.900+0000 7f08d5769700 1 -- 172.21.15.49:0/3491280200 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08d0157c10 msgr2=0x7f08d0151570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:03.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.900+0000 7f08d5769700 1 --2- 172.21.15.49:0/3491280200 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08d0157c10 0x7f08d0151570 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7f08b800c4c0 tx=0x7f08b8007e00).stop 2023-11-30T18:23:03.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.900+0000 7f08d5769700 1 -- 172.21.15.49:0/3491280200 shutdown_connections 2023-11-30T18:23:03.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.900+0000 7f08d5769700 1 --2- 172.21.15.49:0/3491280200 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08d00c38f0 0x7f08d00c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:03.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.900+0000 7f08d5769700 1 --2- 172.21.15.49:0/3491280200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08d00c1780 0x7f08d00abb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:03.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.900+0000 7f08d5769700 1 --2- 172.21.15.49:0/3491280200 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f08b005f270 0x7f08b0061730 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:03.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.900+0000 7f08d5769700 1 --2- 172.21.15.49:0/3491280200 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08d0157c10 0x7f08d0151570 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:03.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.900+0000 7f08d5769700 1 -- 172.21.15.49:0/3491280200 >> 172.21.15.49:0/3491280200 conn(0x7f08d006a610 msgr2=0x7f08d01532b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:03.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.900+0000 7f08d5769700 1 -- 172.21.15.49:0/3491280200 shutdown_connections 2023-11-30T18:23:03.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:03.900+0000 7f08d5769700 1 -- 172.21.15.49:0/3491280200 wait complete. 2023-11-30T18:23:03.914 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-11-30T18:23:04.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.030+0000 7fb5791b5700 1 Processor -- start 2023-11-30T18:23:04.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.030+0000 7fb5791b5700 1 -- start start 2023-11-30T18:23:04.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.031+0000 7fb5791b5700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb574154230 0x7fb5740a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:04.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.031+0000 7fb5791b5700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5740a6720 con 0x7fb574062700 2023-11-30T18:23:04.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.031+0000 7fb5791b5700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5740c2540 con 0x7fb5740c2cb0 2023-11-30T18:23:04.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.031+0000 7fb5791b5700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5740a4f70 con 0x7fb574154230 2023-11-30T18:23:04.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.032+0000 7fb5789b4700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb574062700 0x7fb574062b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42894/0 (socket says 172.21.15.49:42894) 2023-11-30T18:23:04.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.032+0000 7fb5789b4700 1 -- 172.21.15.49:0/1104829150 learned_addr learned my addr 172.21.15.49:0/1104829150 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:23:04.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.032+0000 7fb573fff700 1 --2- 172.21.15.49:0/1104829150 >> v2:172.21.15.115:3300/0 conn(0x7fb574154230 0x7fb5740a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:04.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.032+0000 7fb572ffd700 1 -- 172.21.15.49:0/1104829150 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1114510737 0 0) 0x7fb5740a6720 con 0x7fb574062700 2023-11-30T18:23:04.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.032+0000 7fb572ffd700 1 -- 172.21.15.49:0/1104829150 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb55c0033f0 con 0x7fb574062700 2023-11-30T18:23:04.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.032+0000 7fb573fff700 1 -- 172.21.15.49:0/1104829150 >> v1:172.21.15.115:6789/0 conn(0x7fb5740c2cb0 legacy=0x7fb5740a6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:04.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.032+0000 7fb573fff700 1 -- 172.21.15.49:0/1104829150 >> v1:172.21.15.49:6789/0 conn(0x7fb574062700 legacy=0x7fb574062b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:04.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.032+0000 7fb573fff700 1 -- 172.21.15.49:0/1104829150 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5740a5250 con 0x7fb574154230 2023-11-30T18:23:04.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.032+0000 7fb573fff700 1 --2- 172.21.15.49:0/1104829150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb574154230 0x7fb5740a48e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fb564009760 tx=0x7fb564009060).ready entity=mon.1 client_cookie=4b75ff2531ad03b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:04.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.032+0000 7fb572ffd700 1 -- 172.21.15.49:0/1104829150 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56400f510 con 0x7fb574154230 2023-11-30T18:23:04.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.032+0000 7fb572ffd700 1 -- 172.21.15.49:0/1104829150 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56400f670 con 0x7fb574154230 2023-11-30T18:23:04.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.032+0000 7fb572ffd700 1 -- 172.21.15.49:0/1104829150 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56400f9f0 con 0x7fb574154230 2023-11-30T18:23:04.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.033+0000 7fb5791b5700 1 -- 172.21.15.49:0/1104829150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb574154230 msgr2=0x7fb5740a48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:04.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.033+0000 7fb5791b5700 1 --2- 172.21.15.49:0/1104829150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb574154230 0x7fb5740a48e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fb564009760 tx=0x7fb564009060).stop 2023-11-30T18:23:04.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.033+0000 7fb5791b5700 1 -- 172.21.15.49:0/1104829150 shutdown_connections 2023-11-30T18:23:04.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.033+0000 7fb5791b5700 1 --2- 172.21.15.49:0/1104829150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb574154230 0x7fb5740a48e0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:04.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.033+0000 7fb5791b5700 1 -- 172.21.15.49:0/1104829150 >> 172.21.15.49:0/1104829150 conn(0x7fb5740c7ca0 msgr2=0x7fb5740c80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:04.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.033+0000 7fb5791b5700 1 -- 172.21.15.49:0/1104829150 shutdown_connections 2023-11-30T18:23:04.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.033+0000 7fb5791b5700 1 -- 172.21.15.49:0/1104829150 wait complete. 2023-11-30T18:23:04.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.034+0000 7fb5791b5700 1 Processor -- start 2023-11-30T18:23:04.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.034+0000 7fb5791b5700 1 -- start start 2023-11-30T18:23:04.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.035+0000 7fb5791b5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb574062700 0x7fb574066c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:04.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.035+0000 7fb5791b5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5740c2cb0 0x7fb5741503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:04.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.035+0000 7fb5791b5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb574154230 0x7fb5741508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:04.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.035+0000 7fb5791b5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5740aa190 con 0x7fb5740c2cb0 2023-11-30T18:23:04.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.035+0000 7fb5791b5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb574150d90 con 0x7fb574062700 2023-11-30T18:23:04.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.035+0000 7fb5791b5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb574164020 con 0x7fb574154230 2023-11-30T18:23:04.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.035+0000 7fb5737fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5740c2cb0 0x7fb5741503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:04.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.035+0000 7fb5737fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5740c2cb0 0x7fb5741503b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44902/0 (socket says 172.21.15.49:44902) 2023-11-30T18:23:04.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.035+0000 7fb5737fe700 1 -- 172.21.15.49:0/2315391288 learned_addr learned my addr 172.21.15.49:0/2315391288 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:04.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.035+0000 7fb573fff700 1 --2- 172.21.15.49:0/2315391288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb574062700 0x7fb574066c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:04.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.035+0000 7fb5789b4700 1 --2- 172.21.15.49:0/2315391288 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb574154230 0x7fb5741508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:04.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.035+0000 7fb5737fe700 1 -- 172.21.15.49:0/2315391288 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb574154230 msgr2=0x7fb5741508a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:04.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.035+0000 7fb5737fe700 1 --2- 172.21.15.49:0/2315391288 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb574154230 0x7fb5741508a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:04.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.035+0000 7fb5737fe700 1 -- 172.21.15.49:0/2315391288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb574062700 msgr2=0x7fb574066c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:04.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.035+0000 7fb5737fe700 1 --2- 172.21.15.49:0/2315391288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb574062700 0x7fb574066c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:04.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.035+0000 7fb5737fe700 1 -- 172.21.15.49:0/2315391288 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5640092a0 con 0x7fb5740c2cb0 2023-11-30T18:23:04.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.035+0000 7fb5789b4700 1 --2- 172.21.15.49:0/2315391288 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb574154230 0x7fb5741508a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:23:04.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.036+0000 7fb5737fe700 1 --2- 172.21.15.49:0/2315391288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5740c2cb0 0x7fb5741503b0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7fb56800c4c0 tx=0x7fb568007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:04.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.036+0000 7fb55bfff700 1 -- 172.21.15.49:0/2315391288 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb568007020 con 0x7fb5740c2cb0 2023-11-30T18:23:04.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.036+0000 7fb55bfff700 1 -- 172.21.15.49:0/2315391288 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb568001e90 con 0x7fb5740c2cb0 2023-11-30T18:23:04.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.036+0000 7fb55bfff700 1 -- 172.21.15.49:0/2315391288 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5680073b0 con 0x7fb5740c2cb0 2023-11-30T18:23:04.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.036+0000 7fb5791b5700 1 -- 172.21.15.49:0/2315391288 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb574164300 con 0x7fb5740c2cb0 2023-11-30T18:23:04.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.036+0000 7fb5791b5700 1 -- 172.21.15.49:0/2315391288 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb574164ba0 con 0x7fb5740c2cb0 2023-11-30T18:23:04.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.037+0000 7fb5791b5700 1 -- 172.21.15.49:0/2315391288 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb574164700 con 0x7fb5740c2cb0 2023-11-30T18:23:04.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.037+0000 7fb55bfff700 1 -- 172.21.15.49:0/2315391288 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb5680068b0 con 0x7fb5740c2cb0 2023-11-30T18:23:04.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.038+0000 7fb55bfff700 1 --2- 172.21.15.49:0/2315391288 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb56005f270 0x7fb560061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:04.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.038+0000 7fb55bfff700 1 -- 172.21.15.49:0/2315391288 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5884+0+0 (secure 0 0 0) 0x7fb568079b80 con 0x7fb5740c2cb0 2023-11-30T18:23:04.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.038+0000 7fb573fff700 1 --2- 172.21.15.49:0/2315391288 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb56005f270 0x7fb560061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:04.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.038+0000 7fb573fff700 1 --2- 172.21.15.49:0/2315391288 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb56005f270 0x7fb560061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fb564009760 tx=0x7fb564017000).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:04.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.042+0000 7fb55bfff700 1 -- 172.21.15.49:0/2315391288 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb56804adc0 con 0x7fb5740c2cb0 2023-11-30T18:23:04.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:04.286+0000 7fb5791b5700 1 -- 172.21.15.49:0/2315391288 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7fb574164dc0 con 0x7fb5740c2cb0 2023-11-30T18:23:05.208 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:23:05.218 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:23:05.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.240+0000 7fb55bfff700 1 -- 172.21.15.49:0/2315391288 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v2439) v1 ==== 174+0+0 (secure 0 0 0) 0x7fb56804e3e0 con 0x7fb5740c2cb0 2023-11-30T18:23:05.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.242+0000 7fb5791b5700 1 -- 172.21.15.49:0/2315391288 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb56005f270 msgr2=0x7fb560061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:05.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.242+0000 7fb5791b5700 1 --2- 172.21.15.49:0/2315391288 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb56005f270 0x7fb560061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fb564009760 tx=0x7fb564017000).stop 2023-11-30T18:23:05.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.242+0000 7fb5791b5700 1 -- 172.21.15.49:0/2315391288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5740c2cb0 msgr2=0x7fb5741503b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:05.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.242+0000 7fb5791b5700 1 --2- 172.21.15.49:0/2315391288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5740c2cb0 0x7fb5741503b0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7fb56800c4c0 tx=0x7fb568007e00).stop 2023-11-30T18:23:05.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.242+0000 7fb5791b5700 1 -- 172.21.15.49:0/2315391288 shutdown_connections 2023-11-30T18:23:05.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.242+0000 7fb5791b5700 1 --2- 172.21.15.49:0/2315391288 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb574154230 0x7fb5741508a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:05.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.242+0000 7fb5791b5700 1 --2- 172.21.15.49:0/2315391288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb574062700 0x7fb574066c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:05.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.242+0000 7fb5791b5700 1 --2- 172.21.15.49:0/2315391288 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fb56005f270 0x7fb560061730 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:05.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.242+0000 7fb5791b5700 1 --2- 172.21.15.49:0/2315391288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5740c2cb0 0x7fb5741503b0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:05.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.242+0000 7fb5791b5700 1 -- 172.21.15.49:0/2315391288 >> 172.21.15.49:0/2315391288 conn(0x7fb5740c7ca0 msgr2=0x7fb5740c5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:05.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.242+0000 7fb5791b5700 1 -- 172.21.15.49:0/2315391288 shutdown_connections 2023-11-30T18:23:05.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.242+0000 7fb5791b5700 1 -- 172.21.15.49:0/2315391288 wait complete. 2023-11-30T18:23:05.259 INFO:tasks.cephfs_test_runner:Test listing snap schedules post removal of a schedule ... ok 2023-11-30T18:23:05.259 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that snap schedule is resumed after mgr restart 2023-11-30T18:23:05.259 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-11-30T18:23:05.260 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-11-30T18:23:05.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.425+0000 7ff26933d700 1 Processor -- start 2023-11-30T18:23:05.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.425+0000 7ff26933d700 1 -- start start 2023-11-30T18:23:05.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.426+0000 7ff26933d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff2641544e0 0x7ff2641548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:05.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.426+0000 7ff26933d700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2640c69a0 con 0x7ff26406a610 2023-11-30T18:23:05.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.426+0000 7ff26933d700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2640c13a0 con 0x7ff2640c6e30 2023-11-30T18:23:05.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.426+0000 7ff26933d700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2640c1680 con 0x7ff2641544e0 2023-11-30T18:23:05.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.426+0000 7ff262ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff2641544e0 0x7ff2641548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:05.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.426+0000 7ff2627fc700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff26406a610 0x7ff2640c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42908/0 (socket says 172.21.15.49:42908) 2023-11-30T18:23:05.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.426+0000 7ff2627fc700 1 -- 172.21.15.49:0/1638673530 learned_addr learned my addr 172.21.15.49:0/1638673530 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:23:05.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.427+0000 7ff261ffb700 1 -- 172.21.15.49:0/1638673530 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1560021652 0 0) 0x7ff2640c69a0 con 0x7ff26406a610 2023-11-30T18:23:05.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.427+0000 7ff261ffb700 1 -- 172.21.15.49:0/1638673530 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2500033f0 con 0x7ff26406a610 2023-11-30T18:23:05.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.427+0000 7ff262ffd700 1 -- 172.21.15.49:0/1638673530 >> v1:172.21.15.115:6789/0 conn(0x7ff2640c6e30 legacy=0x7ff2640a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:05.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.427+0000 7ff262ffd700 1 -- 172.21.15.49:0/1638673530 >> v1:172.21.15.49:6789/0 conn(0x7ff26406a610 legacy=0x7ff2640c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:05.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.427+0000 7ff262ffd700 1 -- 172.21.15.49:0/1638673530 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2640c6630 con 0x7ff2641544e0 2023-11-30T18:23:05.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.427+0000 7ff262ffd700 1 --2- 172.21.15.49:0/1638673530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2641544e0 0x7ff2641548c0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7ff25c006fd0 tx=0x7ff25c006f40).ready entity=mon.0 client_cookie=397c78334f7fa34 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:05.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.427+0000 7ff261ffb700 1 -- 172.21.15.49:0/1638673530 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c005880 con 0x7ff2641544e0 2023-11-30T18:23:05.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.427+0000 7ff261ffb700 1 -- 172.21.15.49:0/1638673530 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25c0059e0 con 0x7ff2641544e0 2023-11-30T18:23:05.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.427+0000 7ff261ffb700 1 -- 172.21.15.49:0/1638673530 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c005d60 con 0x7ff2641544e0 2023-11-30T18:23:05.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.427+0000 7ff26933d700 1 -- 172.21.15.49:0/1638673530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2641544e0 msgr2=0x7ff2641548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:05.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.427+0000 7ff26933d700 1 --2- 172.21.15.49:0/1638673530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2641544e0 0x7ff2641548c0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7ff25c006fd0 tx=0x7ff25c006f40).stop 2023-11-30T18:23:05.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.428+0000 7ff26933d700 1 -- 172.21.15.49:0/1638673530 shutdown_connections 2023-11-30T18:23:05.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.428+0000 7ff26933d700 1 --2- 172.21.15.49:0/1638673530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2641544e0 0x7ff2641548c0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:05.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.428+0000 7ff26933d700 1 -- 172.21.15.49:0/1638673530 >> 172.21.15.49:0/1638673530 conn(0x7ff264085020 msgr2=0x7ff264094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:05.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.428+0000 7ff26933d700 1 -- 172.21.15.49:0/1638673530 shutdown_connections 2023-11-30T18:23:05.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.428+0000 7ff26933d700 1 -- 172.21.15.49:0/1638673530 wait complete. 2023-11-30T18:23:05.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.429+0000 7ff26933d700 1 Processor -- start 2023-11-30T18:23:05.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.429+0000 7ff26933d700 1 -- start start 2023-11-30T18:23:05.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.430+0000 7ff26933d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff26406a610 0x7ff264142da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:05.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.430+0000 7ff26933d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2640c6e30 0x7ff2640983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:05.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.430+0000 7ff26933d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2641544e0 0x7ff2640988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:05.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.430+0000 7ff26933d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff264098da0 con 0x7ff2640c6e30 2023-11-30T18:23:05.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.430+0000 7ff26933d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff264095320 con 0x7ff2641544e0 2023-11-30T18:23:05.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.430+0000 7ff26933d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2640958e0 con 0x7ff26406a610 2023-11-30T18:23:05.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.430+0000 7ff2627fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2640c6e30 0x7ff2640983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:05.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.430+0000 7ff2627fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2640c6e30 0x7ff2640983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44924/0 (socket says 172.21.15.49:44924) 2023-11-30T18:23:05.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.430+0000 7ff2627fc700 1 -- 172.21.15.49:0/63668468 learned_addr learned my addr 172.21.15.49:0/63668468 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:05.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.430+0000 7ff262ffd700 1 --2- 172.21.15.49:0/63668468 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff26406a610 0x7ff264142da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:05.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.430+0000 7ff2637fe700 1 --2- 172.21.15.49:0/63668468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2641544e0 0x7ff2640988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:05.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.430+0000 7ff2627fc700 1 -- 172.21.15.49:0/63668468 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff26406a610 msgr2=0x7ff264142da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:05.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.430+0000 7ff2627fc700 1 --2- 172.21.15.49:0/63668468 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff26406a610 0x7ff264142da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:05.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.430+0000 7ff2627fc700 1 -- 172.21.15.49:0/63668468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2641544e0 msgr2=0x7ff2640988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:05.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.430+0000 7ff2627fc700 1 --2- 172.21.15.49:0/63668468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2641544e0 0x7ff2640988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:05.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.430+0000 7ff2627fc700 1 -- 172.21.15.49:0/63668468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff25c009250 con 0x7ff2640c6e30 2023-11-30T18:23:05.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.430+0000 7ff2637fe700 1 --2- 172.21.15.49:0/63668468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2641544e0 0x7ff2640988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:23:05.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.430+0000 7ff262ffd700 1 --2- 172.21.15.49:0/63668468 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff26406a610 0x7ff264142da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:23:05.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.430+0000 7ff2627fc700 1 --2- 172.21.15.49:0/63668468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2640c6e30 0x7ff2640983c0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7ff24c00c420 tx=0x7ff24c007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:05.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.430+0000 7ff25affd700 1 -- 172.21.15.49:0/63668468 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24c0072e0 con 0x7ff2640c6e30 2023-11-30T18:23:05.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.430+0000 7ff25affd700 1 -- 172.21.15.49:0/63668468 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff24c007440 con 0x7ff2640c6e30 2023-11-30T18:23:05.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.430+0000 7ff26933d700 1 -- 172.21.15.49:0/63668468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2640a8ec0 con 0x7ff2640c6e30 2023-11-30T18:23:05.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.430+0000 7ff25affd700 1 -- 172.21.15.49:0/63668468 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24c0057a0 con 0x7ff2640c6e30 2023-11-30T18:23:05.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.430+0000 7ff26933d700 1 -- 172.21.15.49:0/63668468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff264095570 con 0x7ff2640c6e30 2023-11-30T18:23:05.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.432+0000 7ff26933d700 1 -- 172.21.15.49:0/63668468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff264095a90 con 0x7ff2640c6e30 2023-11-30T18:23:05.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.432+0000 7ff25affd700 1 -- 172.21.15.49:0/63668468 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff24c005bd0 con 0x7ff2640c6e30 2023-11-30T18:23:05.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.432+0000 7ff25affd700 1 --2- 172.21.15.49:0/63668468 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff24405f270 0x7ff244061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:05.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.432+0000 7ff25affd700 1 -- 172.21.15.49:0/63668468 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5884+0+0 (secure 0 0 0) 0x7ff24c079b10 con 0x7ff2640c6e30 2023-11-30T18:23:05.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.432+0000 7ff262ffd700 1 --2- 172.21.15.49:0/63668468 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff24405f270 0x7ff244061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:05.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.433+0000 7ff262ffd700 1 --2- 172.21.15.49:0/63668468 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff24405f270 0x7ff244061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7ff25c006d00 tx=0x7ff25c016000).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:05.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.436+0000 7ff25affd700 1 -- 172.21.15.49:0/63668468 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff264095a90 con 0x7ff2640c6e30 2023-11-30T18:23:05.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:05.674+0000 7ff26933d700 1 -- 172.21.15.49:0/63668468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7ff264095a50 con 0x7ff2640c6e30 2023-11-30T18:23:06.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.240+0000 7ff25affd700 1 -- 172.21.15.49:0/63668468 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v2440) v1 ==== 168+0+0 (secure 0 0 0) 0x7ff24c018070 con 0x7ff2640c6e30 2023-11-30T18:23:06.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.242+0000 7ff26933d700 1 -- 172.21.15.49:0/63668468 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff24405f270 msgr2=0x7ff244061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:06.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.242+0000 7ff26933d700 1 --2- 172.21.15.49:0/63668468 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff24405f270 0x7ff244061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7ff25c006d00 tx=0x7ff25c016000).stop 2023-11-30T18:23:06.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.242+0000 7ff26933d700 1 -- 172.21.15.49:0/63668468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2640c6e30 msgr2=0x7ff2640983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:06.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.242+0000 7ff26933d700 1 --2- 172.21.15.49:0/63668468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2640c6e30 0x7ff2640983c0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7ff24c00c420 tx=0x7ff24c007c50).stop 2023-11-30T18:23:06.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.242+0000 7ff26933d700 1 -- 172.21.15.49:0/63668468 shutdown_connections 2023-11-30T18:23:06.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.242+0000 7ff26933d700 1 --2- 172.21.15.49:0/63668468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2641544e0 0x7ff2640988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:06.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.242+0000 7ff26933d700 1 --2- 172.21.15.49:0/63668468 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff26406a610 0x7ff264142da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:06.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.242+0000 7ff26933d700 1 --2- 172.21.15.49:0/63668468 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff24405f270 0x7ff244061730 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:06.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.242+0000 7ff26933d700 1 --2- 172.21.15.49:0/63668468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2640c6e30 0x7ff2640983c0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:06.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.242+0000 7ff26933d700 1 -- 172.21.15.49:0/63668468 >> 172.21.15.49:0/63668468 conn(0x7ff264085020 msgr2=0x7ff2640c9070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:06.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.242+0000 7ff26933d700 1 -- 172.21.15.49:0/63668468 shutdown_connections 2023-11-30T18:23:06.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.242+0000 7ff26933d700 1 -- 172.21.15.49:0/63668468 wait complete. 2023-11-30T18:23:06.256 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-30T18:23:06.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.377+0000 7f8e54663700 1 Processor -- start 2023-11-30T18:23:06.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.377+0000 7f8e54663700 1 -- start start 2023-11-30T18:23:06.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.378+0000 7f8e54663700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8e4c098d10 0x7f8e4c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:06.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.378+0000 7f8e54663700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8e4c158320 0x7f8e4c1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:06.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.379+0000 7f8e54663700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e4c158cc0 con 0x7f8e4c0c6190 2023-11-30T18:23:06.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.379+0000 7f8e54663700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e4c0c72d0 con 0x7f8e4c158320 2023-11-30T18:23:06.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.379+0000 7f8e54663700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e4c064570 con 0x7f8e4c098d10 2023-11-30T18:23:06.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.379+0000 7f8e52c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8e4c158320 0x7f8e4c1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:06.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.379+0000 7f8e52c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8e4c158320 0x7f8e4c1587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44936/0 (socket says 172.21.15.49:44936) 2023-11-30T18:23:06.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.379+0000 7f8e52c00700 1 -- 172.21.15.49:0/1195708772 learned_addr learned my addr 172.21.15.49:0/1195708772 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:06.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.379+0000 7f8e523ff700 1 --2- 172.21.15.49:0/1195708772 >> v2:172.21.15.115:3300/0 conn(0x7f8e4c098d10 0x7f8e4c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:06.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.379+0000 7f8e52c00700 1 -- 172.21.15.49:0/1195708772 >> v2:172.21.15.115:3300/0 conn(0x7f8e4c098d10 msgr2=0x7f8e4c0c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:06.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.379+0000 7f8e52c00700 1 --2- 172.21.15.49:0/1195708772 >> v2:172.21.15.115:3300/0 conn(0x7f8e4c098d10 0x7f8e4c0c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:06.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.379+0000 7f8e52c00700 1 -- 172.21.15.49:0/1195708772 >> v1:172.21.15.115:6789/0 conn(0x7f8e4c0c6190 legacy=0x7f8e4c063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:06.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.379+0000 7f8e52c00700 1 -- 172.21.15.49:0/1195708772 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4c154bc0 con 0x7f8e4c158320 2023-11-30T18:23:06.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.379+0000 7f8e52c00700 1 --2- 172.21.15.49:0/1195708772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e4c158320 0x7f8e4c1587d0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7f8e4c083f80 tx=0x7f8e44009840).ready entity=mon.0 client_cookie=920839fe6c106067 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:06.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.379+0000 7f8e513fd700 1 -- 172.21.15.49:0/1195708772 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4400e070 con 0x7f8e4c158320 2023-11-30T18:23:06.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.379+0000 7f8e513fd700 1 -- 172.21.15.49:0/1195708772 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4400ba50 con 0x7f8e4c158320 2023-11-30T18:23:06.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.379+0000 7f8e513fd700 1 -- 172.21.15.49:0/1195708772 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4400bdd0 con 0x7f8e4c158320 2023-11-30T18:23:06.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.380+0000 7f8e54663700 1 -- 172.21.15.49:0/1195708772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e4c158320 msgr2=0x7f8e4c1587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:06.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.380+0000 7f8e54663700 1 --2- 172.21.15.49:0/1195708772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e4c158320 0x7f8e4c1587d0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7f8e4c083f80 tx=0x7f8e44009840).stop 2023-11-30T18:23:06.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.380+0000 7f8e54663700 1 -- 172.21.15.49:0/1195708772 shutdown_connections 2023-11-30T18:23:06.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.380+0000 7f8e54663700 1 --2- 172.21.15.49:0/1195708772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e4c158320 0x7f8e4c1587d0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:06.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.380+0000 7f8e54663700 1 --2- 172.21.15.49:0/1195708772 >> v2:172.21.15.115:3300/0 conn(0x7f8e4c098d10 0x7f8e4c0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:06.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.380+0000 7f8e54663700 1 -- 172.21.15.49:0/1195708772 >> 172.21.15.49:0/1195708772 conn(0x7f8e4c0cb310 msgr2=0x7f8e4c0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:06.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.380+0000 7f8e54663700 1 -- 172.21.15.49:0/1195708772 shutdown_connections 2023-11-30T18:23:06.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.380+0000 7f8e54663700 1 -- 172.21.15.49:0/1195708772 wait complete. 2023-11-30T18:23:06.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.381+0000 7f8e54663700 1 Processor -- start 2023-11-30T18:23:06.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.381+0000 7f8e54663700 1 -- start start 2023-11-30T18:23:06.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.382+0000 7f8e54663700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e4c098d10 0x7f8e4c0b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:06.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.382+0000 7f8e54663700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e4c0c6190 0x7f8e4c0ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:06.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.382+0000 7f8e54663700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e4c158320 0x7f8e4c0ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:06.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.382+0000 7f8e54663700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c0aeca0 con 0x7f8e4c098d10 2023-11-30T18:23:06.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.382+0000 7f8e54663700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c155400 con 0x7f8e4c0c6190 2023-11-30T18:23:06.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.382+0000 7f8e54663700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c148860 con 0x7f8e4c158320 2023-11-30T18:23:06.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.382+0000 7f8e523ff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e4c098d10 0x7f8e4c0b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:06.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.382+0000 7f8e523ff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e4c098d10 0x7f8e4c0b0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44940/0 (socket says 172.21.15.49:44940) 2023-11-30T18:23:06.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.382+0000 7f8e523ff700 1 -- 172.21.15.49:0/1255005963 learned_addr learned my addr 172.21.15.49:0/1255005963 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:06.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.382+0000 7f8e52c00700 1 --2- 172.21.15.49:0/1255005963 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e4c158320 0x7f8e4c0ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:06.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.382+0000 7f8e51bfe700 1 --2- 172.21.15.49:0/1255005963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e4c0c6190 0x7f8e4c0ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:06.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.383+0000 7f8e523ff700 1 -- 172.21.15.49:0/1255005963 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e4c158320 msgr2=0x7f8e4c0ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:06.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.383+0000 7f8e523ff700 1 --2- 172.21.15.49:0/1255005963 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e4c158320 0x7f8e4c0ae7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:06.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.383+0000 7f8e523ff700 1 -- 172.21.15.49:0/1255005963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e4c0c6190 msgr2=0x7f8e4c0ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:06.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.383+0000 7f8e523ff700 1 --2- 172.21.15.49:0/1255005963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e4c0c6190 0x7f8e4c0ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:06.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.383+0000 7f8e523ff700 1 -- 172.21.15.49:0/1255005963 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e44009ae0 con 0x7f8e4c098d10 2023-11-30T18:23:06.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.383+0000 7f8e523ff700 1 --2- 172.21.15.49:0/1255005963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e4c098d10 0x7f8e4c0b0270 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7f8e4000d890 tx=0x7f8e40008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:06.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.383+0000 7f8e3e7fc700 1 -- 172.21.15.49:0/1255005963 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e40011590 con 0x7f8e4c098d10 2023-11-30T18:23:06.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.383+0000 7f8e3e7fc700 1 -- 172.21.15.49:0/1255005963 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e400116f0 con 0x7f8e4c098d10 2023-11-30T18:23:06.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.383+0000 7f8e54663700 1 -- 172.21.15.49:0/1255005963 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e4c0b0fc0 con 0x7f8e4c098d10 2023-11-30T18:23:06.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.383+0000 7f8e3e7fc700 1 -- 172.21.15.49:0/1255005963 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e40011a70 con 0x7f8e4c098d10 2023-11-30T18:23:06.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.383+0000 7f8e54663700 1 -- 172.21.15.49:0/1255005963 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4c0c3380 con 0x7f8e4c098d10 2023-11-30T18:23:06.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.384+0000 7f8e54663700 1 -- 172.21.15.49:0/1255005963 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e4c06c860 con 0x7f8e4c098d10 2023-11-30T18:23:06.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.384+0000 7f8e3e7fc700 1 -- 172.21.15.49:0/1255005963 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8e40012420 con 0x7f8e4c098d10 2023-11-30T18:23:06.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.385+0000 7f8e3e7fc700 1 --2- 172.21.15.49:0/1255005963 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8e3005f270 0x7f8e30061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:06.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.385+0000 7f8e3e7fc700 1 -- 172.21.15.49:0/1255005963 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5884+0+0 (secure 0 0 0) 0x7f8e40079c90 con 0x7f8e4c098d10 2023-11-30T18:23:06.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.385+0000 7f8e51bfe700 1 --2- 172.21.15.49:0/1255005963 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8e3005f270 0x7f8e30061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:06.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.385+0000 7f8e51bfe700 1 --2- 172.21.15.49:0/1255005963 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8e3005f270 0x7f8e30061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f8e4c0c08a0 tx=0x7f8e48007d40).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:06.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.389+0000 7f8e3e7fc700 1 -- 172.21.15.49:0/1255005963 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8e4004ae70 con 0x7f8e4c098d10 2023-11-30T18:23:06.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.560+0000 7f8e54663700 1 -- 172.21.15.49:0/1255005963 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8e4c0c66c0 con 0x7f8e4c098d10 2023-11-30T18:23:06.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.563+0000 7f8e3e7fc700 1 -- 172.21.15.49:0/1255005963 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8e4004e490 con 0x7f8e4c098d10 2023-11-30T18:23:06.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.565+0000 7f8e54663700 1 -- 172.21.15.49:0/1255005963 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8e3005f270 msgr2=0x7f8e30061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:06.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.565+0000 7f8e54663700 1 --2- 172.21.15.49:0/1255005963 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8e3005f270 0x7f8e30061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f8e4c0c08a0 tx=0x7f8e48007d40).stop 2023-11-30T18:23:06.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.565+0000 7f8e54663700 1 -- 172.21.15.49:0/1255005963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e4c098d10 msgr2=0x7f8e4c0b0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:06.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.565+0000 7f8e54663700 1 --2- 172.21.15.49:0/1255005963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e4c098d10 0x7f8e4c0b0270 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7f8e4000d890 tx=0x7f8e40008040).stop 2023-11-30T18:23:06.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.565+0000 7f8e54663700 1 -- 172.21.15.49:0/1255005963 shutdown_connections 2023-11-30T18:23:06.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.565+0000 7f8e54663700 1 --2- 172.21.15.49:0/1255005963 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e4c158320 0x7f8e4c0ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:06.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.565+0000 7f8e54663700 1 --2- 172.21.15.49:0/1255005963 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f8e3005f270 0x7f8e30061730 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:06.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.565+0000 7f8e54663700 1 --2- 172.21.15.49:0/1255005963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e4c098d10 0x7f8e4c0b0270 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:06.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.565+0000 7f8e54663700 1 --2- 172.21.15.49:0/1255005963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e4c0c6190 0x7f8e4c0ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:06.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.565+0000 7f8e54663700 1 -- 172.21.15.49:0/1255005963 >> 172.21.15.49:0/1255005963 conn(0x7f8e4c0cb310 msgr2=0x7f8e4c1532e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:06.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.565+0000 7f8e54663700 1 -- 172.21.15.49:0/1255005963 shutdown_connections 2023-11-30T18:23:06.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.565+0000 7f8e54663700 1 -- 172.21.15.49:0/1255005963 wait complete. 2023-11-30T18:23:06.578 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-30T18:23:06.578 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T18:23:06.620 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T18:23:06.662 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-30T18:23:06.662 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-30T18:23:06.662 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:23:06.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.779+0000 7fe502808700 1 Processor -- start 2023-11-30T18:23:06.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.779+0000 7fe502808700 1 -- start start 2023-11-30T18:23:06.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.780+0000 7fe502808700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe4fc06b510 0x7fe4fc1546f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:06.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.780+0000 7fe502808700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4fc063380 con 0x7fe4fc0c0d10 2023-11-30T18:23:06.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.780+0000 7fe502808700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4fc062770 con 0x7fe4fc0c10f0 2023-11-30T18:23:06.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.780+0000 7fe502808700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4fc0c19e0 con 0x7fe4fc06b510 2023-11-30T18:23:06.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.780+0000 7fe4fbfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe4fc0c0d10 0x7fe4fc153fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42916/0 (socket says 172.21.15.49:42916) 2023-11-30T18:23:06.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.780+0000 7fe4fbfff700 1 -- 172.21.15.49:0/2051210734 learned_addr learned my addr 172.21.15.49:0/2051210734 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:23:06.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.780+0000 7fe4faffd700 1 -- 172.21.15.49:0/2051210734 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2780831478 0 0) 0x7fe4fc063380 con 0x7fe4fc0c0d10 2023-11-30T18:23:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.780+0000 7fe4faffd700 1 -- 172.21.15.49:0/2051210734 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4e80033f0 con 0x7fe4fc0c0d10 2023-11-30T18:23:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.780+0000 7fe4fb7fe700 1 --2- 172.21.15.49:0/2051210734 >> v2:172.21.15.115:3300/0 conn(0x7fe4fc06b510 0x7fe4fc1546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.781+0000 7fe4faffd700 1 -- 172.21.15.49:0/2051210734 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4274098806 0 0) 0x7fe4e80033f0 con 0x7fe4fc0c0d10 2023-11-30T18:23:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.781+0000 7fe4faffd700 1 -- 172.21.15.49:0/2051210734 >> v2:172.21.15.115:3300/0 conn(0x7fe4fc06b510 msgr2=0x7fe4fc1546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.781+0000 7fe4faffd700 1 --2- 172.21.15.49:0/2051210734 >> v2:172.21.15.115:3300/0 conn(0x7fe4fc06b510 0x7fe4fc1546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.781+0000 7fe4faffd700 1 -- 172.21.15.49:0/2051210734 >> v1:172.21.15.115:6789/0 conn(0x7fe4fc0c10f0 legacy=0x7fe4fc0c2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.781+0000 7fe4faffd700 1 -- 172.21.15.49:0/2051210734 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4fc062a50 con 0x7fe4fc0c0d10 2023-11-30T18:23:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.781+0000 7fe4faffd700 1 -- 172.21.15.49:0/2051210734 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fe4ec001470 con 0x7fe4fc0c0d10 2023-11-30T18:23:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.781+0000 7fe4faffd700 1 -- 172.21.15.49:0/2051210734 >> v1:172.21.15.49:6789/0 conn(0x7fe4fc0c0d10 legacy=0x7fe4fc153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.781+0000 7fe4faffd700 1 --2- 172.21.15.49:0/2051210734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4e80038e0 0x7fe4e8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.781+0000 7fe4faffd700 1 --2- 172.21.15.49:0/2051210734 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4e8004690 0x7fe4e8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.781+0000 7fe4faffd700 1 --2- 172.21.15.49:0/2051210734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4e8005050 0x7fe4e800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:06.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.781+0000 7fe4faffd700 1 -- 172.21.15.49:0/2051210734 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc0c19e0 con 0x7fe4e80038e0 2023-11-30T18:23:06.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.781+0000 7fe4faffd700 1 -- 172.21.15.49:0/2051210734 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e800bf30 con 0x7fe4e8005050 2023-11-30T18:23:06.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.781+0000 7fe4faffd700 1 -- 172.21.15.49:0/2051210734 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e800c0f0 con 0x7fe4e8004690 2023-11-30T18:23:06.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.781+0000 7fe4fbfff700 1 --2- 172.21.15.49:0/2051210734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4e80038e0 0x7fe4e8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:06.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.781+0000 7fe500da5700 1 --2- 172.21.15.49:0/2051210734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4e8005050 0x7fe4e800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:06.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.781+0000 7fe4fb7fe700 1 --2- 172.21.15.49:0/2051210734 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4e8004690 0x7fe4e8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:06.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.781+0000 7fe4fbfff700 1 -- 172.21.15.49:0/2051210734 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4e8004690 msgr2=0x7fe4e8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:06.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.781+0000 7fe4fbfff700 1 --2- 172.21.15.49:0/2051210734 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4e8004690 0x7fe4e8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:06.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.781+0000 7fe4fbfff700 1 -- 172.21.15.49:0/2051210734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4e8005050 msgr2=0x7fe4e800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:06.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.781+0000 7fe4fbfff700 1 --2- 172.21.15.49:0/2051210734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4e8005050 0x7fe4e800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:06.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.781+0000 7fe4fbfff700 1 -- 172.21.15.49:0/2051210734 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e80033f0 con 0x7fe4e80038e0 2023-11-30T18:23:06.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.781+0000 7fe500da5700 1 -- 172.21.15.49:0/2051210734 reap_dead start 2023-11-30T18:23:06.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.781+0000 7fe4fbfff700 1 --2- 172.21.15.49:0/2051210734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4e80038e0 0x7fe4e8003d00 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7fe4ec00c190 tx=0x7fe4ec001e50).ready entity=mon.0 client_cookie=989b8bcbb58276c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:06.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.781+0000 7fe4faffd700 1 -- 172.21.15.49:0/2051210734 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec007a20 con 0x7fe4e80038e0 2023-11-30T18:23:06.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.782+0000 7fe4faffd700 1 -- 172.21.15.49:0/2051210734 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ec00cac0 con 0x7fe4e80038e0 2023-11-30T18:23:06.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.782+0000 7fe4faffd700 1 -- 172.21.15.49:0/2051210734 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec00ce40 con 0x7fe4e80038e0 2023-11-30T18:23:06.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.782+0000 7fe502808700 1 -- 172.21.15.49:0/2051210734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4e80038e0 msgr2=0x7fe4e8003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:06.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.782+0000 7fe502808700 1 --2- 172.21.15.49:0/2051210734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4e80038e0 0x7fe4e8003d00 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7fe4ec00c190 tx=0x7fe4ec001e50).stop 2023-11-30T18:23:06.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.782+0000 7fe502808700 1 -- 172.21.15.49:0/2051210734 shutdown_connections 2023-11-30T18:23:06.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.782+0000 7fe502808700 1 --2- 172.21.15.49:0/2051210734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4e80038e0 0x7fe4e8003d00 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:06.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.782+0000 7fe502808700 1 -- 172.21.15.49:0/2051210734 >> 172.21.15.49:0/2051210734 conn(0x7fe4fc0c7760 msgr2=0x7fe4fc0c7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:06.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.782+0000 7fe502808700 1 -- 172.21.15.49:0/2051210734 shutdown_connections 2023-11-30T18:23:06.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.782+0000 7fe502808700 1 -- 172.21.15.49:0/2051210734 wait complete. 2023-11-30T18:23:06.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.783+0000 7fe502808700 1 Processor -- start 2023-11-30T18:23:06.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.783+0000 7fe502808700 1 -- start start 2023-11-30T18:23:06.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.784+0000 7fe502808700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4e80038e0 0x7fe4fc167880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:06.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.784+0000 7fe502808700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4fc0a0e80 0x7fe4fc153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:06.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.784+0000 7fe502808700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4fc0a1300 0x7fe4fc153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:06.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.784+0000 7fe502808700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc153a20 con 0x7fe4fc0a0e80 2023-11-30T18:23:06.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.784+0000 7fe502808700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc158fe0 con 0x7fe4e80038e0 2023-11-30T18:23:06.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.784+0000 7fe502808700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc157100 con 0x7fe4fc0a1300 2023-11-30T18:23:06.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.784+0000 7fe4fb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4fc0a0e80 0x7fe4fc153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:06.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.784+0000 7fe4fb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4fc0a0e80 0x7fe4fc153040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44960/0 (socket says 172.21.15.49:44960) 2023-11-30T18:23:06.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.784+0000 7fe4fb7fe700 1 -- 172.21.15.49:0/1665793437 learned_addr learned my addr 172.21.15.49:0/1665793437 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:06.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.784+0000 7fe500da5700 1 --2- 172.21.15.49:0/1665793437 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4fc0a1300 0x7fe4fc153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:06.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.784+0000 7fe4fbfff700 1 --2- 172.21.15.49:0/1665793437 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4e80038e0 0x7fe4fc167880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:06.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.784+0000 7fe4fb7fe700 1 -- 172.21.15.49:0/1665793437 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4fc0a1300 msgr2=0x7fe4fc153530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:06.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.784+0000 7fe4fb7fe700 1 --2- 172.21.15.49:0/1665793437 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4fc0a1300 0x7fe4fc153530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:06.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.784+0000 7fe4fb7fe700 1 -- 172.21.15.49:0/1665793437 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4e80038e0 msgr2=0x7fe4fc167880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:06.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.784+0000 7fe4fb7fe700 1 --2- 172.21.15.49:0/1665793437 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4e80038e0 0x7fe4fc167880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:06.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.784+0000 7fe4fb7fe700 1 -- 172.21.15.49:0/1665793437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4fc167d70 con 0x7fe4fc0a0e80 2023-11-30T18:23:06.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.785+0000 7fe4fb7fe700 1 --2- 172.21.15.49:0/1665793437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4fc0a0e80 0x7fe4fc153040 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7fe4e4010a10 tx=0x7fe4e4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:06.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.785+0000 7fe4f3fff700 1 -- 172.21.15.49:0/1665793437 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e400e8d0 con 0x7fe4fc0a0e80 2023-11-30T18:23:06.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.785+0000 7fe4f3fff700 1 -- 172.21.15.49:0/1665793437 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e400ea30 con 0x7fe4fc0a0e80 2023-11-30T18:23:06.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.785+0000 7fe502808700 1 -- 172.21.15.49:0/1665793437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4fc1583d0 con 0x7fe4fc0a0e80 2023-11-30T18:23:06.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.785+0000 7fe4f3fff700 1 -- 172.21.15.49:0/1665793437 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e400edb0 con 0x7fe4fc0a0e80 2023-11-30T18:23:06.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.785+0000 7fe502808700 1 -- 172.21.15.49:0/1665793437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4fc158990 con 0x7fe4fc0a0e80 2023-11-30T18:23:06.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.786+0000 7fe502808700 1 -- 172.21.15.49:0/1665793437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4fc164a80 con 0x7fe4fc0a0e80 2023-11-30T18:23:06.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.786+0000 7fe4f3fff700 1 -- 172.21.15.49:0/1665793437 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe4e4014680 con 0x7fe4fc0a0e80 2023-11-30T18:23:06.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.787+0000 7fe4f3fff700 1 --2- 172.21.15.49:0/1665793437 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe4dc05f270 0x7fe4dc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:06.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.787+0000 7fe4f3fff700 1 -- 172.21.15.49:0/1665793437 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5884+0+0 (secure 0 0 0) 0x7fe4e407a780 con 0x7fe4fc0a0e80 2023-11-30T18:23:06.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.787+0000 7fe4fbfff700 1 --2- 172.21.15.49:0/1665793437 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe4dc05f270 0x7fe4dc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:06.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.787+0000 7fe4fbfff700 1 --2- 172.21.15.49:0/1665793437 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe4dc05f270 0x7fe4dc061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fe4ec001ed0 tx=0x7fe4ec015000).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:06.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:06.791+0000 7fe4f3fff700 1 -- 172.21.15.49:0/1665793437 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe4e404b960 con 0x7fe4fc0a0e80 2023-11-30T18:23:07.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.008+0000 7fe502808700 1 -- 172.21.15.49:0/1665793437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4fc06c860 con 0x7fe4fc0a0e80 2023-11-30T18:23:07.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.009+0000 7fe4f3fff700 1 -- 172.21.15.49:0/1665793437 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fe4e404ef80 con 0x7fe4fc0a0e80 2023-11-30T18:23:07.010 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:23:07.010 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":71,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7193,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/4003300500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4003300500},{"type":"v1","addr":"172.21.15.49:6835","nonce":4003300500}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7205,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3715169351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3715169351},{"type":"v1","addr":"172.21.15.115:6837","nonce":3715169351}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":8272,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2922134566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2922134566},{"type":"v1","addr":"172.21.15.115:6836","nonce":2922134566}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":8865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/2278859946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2278859946},{"type":"v1","addr":"172.21.15.49:6833","nonce":2278859946}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[]} 2023-11-30T18:23:07.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.011+0000 7fe502808700 1 -- 172.21.15.49:0/1665793437 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe4dc05f270 msgr2=0x7fe4dc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:07.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.011+0000 7fe502808700 1 --2- 172.21.15.49:0/1665793437 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe4dc05f270 0x7fe4dc061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fe4ec001ed0 tx=0x7fe4ec015000).stop 2023-11-30T18:23:07.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.011+0000 7fe502808700 1 -- 172.21.15.49:0/1665793437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4fc0a0e80 msgr2=0x7fe4fc153040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:07.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.011+0000 7fe502808700 1 --2- 172.21.15.49:0/1665793437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4fc0a0e80 0x7fe4fc153040 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7fe4e4010a10 tx=0x7fe4e4008040).stop 2023-11-30T18:23:07.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.011+0000 7fe502808700 1 -- 172.21.15.49:0/1665793437 shutdown_connections 2023-11-30T18:23:07.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.011+0000 7fe502808700 1 --2- 172.21.15.49:0/1665793437 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4fc0a1300 0x7fe4fc153530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:07.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.011+0000 7fe502808700 1 --2- 172.21.15.49:0/1665793437 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4e80038e0 0x7fe4fc167880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:07.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.011+0000 7fe502808700 1 --2- 172.21.15.49:0/1665793437 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe4dc05f270 0x7fe4dc061730 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:07.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.011+0000 7fe502808700 1 --2- 172.21.15.49:0/1665793437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4fc0a0e80 0x7fe4fc153040 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:07.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.011+0000 7fe502808700 1 -- 172.21.15.49:0/1665793437 >> 172.21.15.49:0/1665793437 conn(0x7fe4fc0c7760 msgr2=0x7fe4fc1526c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:07.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.011+0000 7fe502808700 1 -- 172.21.15.49:0/1665793437 shutdown_connections 2023-11-30T18:23:07.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.011+0000 7fe502808700 1 -- 172.21.15.49:0/1665793437 wait complete. 2023-11-30T18:23:07.013 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 71 2023-11-30T18:23:07.024 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-30T18:23:07.024 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-30T18:23:07.024 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-30T18:23:07.024 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:23:07.025 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-30T18:23:07.025 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-30T18:23:07.025 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-30T18:23:07.025 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:23:07.025 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-30T18:23:07.025 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-30T18:23:07.026 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-30T18:23:07.026 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:23:07.026 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-30T18:23:07.026 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-30T18:23:07.026 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-30T18:23:07.026 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:23:07.034 INFO:tasks.ceph.mds.a:Stopped 2023-11-30T18:23:07.034 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-30T18:23:07.035 INFO:tasks.ceph.mds.c:Stopped 2023-11-30T18:23:07.035 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-30T18:23:07.040 INFO:tasks.ceph.mds.d:Stopped 2023-11-30T18:23:07.040 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-30T18:23:07.041 INFO:tasks.ceph.mds.b:Stopped 2023-11-30T18:23:07.041 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-30T18:23:07.076 INFO:tasks.ceph.mds.a:Started 2023-11-30T18:23:07.076 DEBUG:teuthology.parallel:result is None 2023-11-30T18:23:07.077 INFO:tasks.ceph.mds.c:Started 2023-11-30T18:23:07.077 DEBUG:teuthology.parallel:result is None 2023-11-30T18:23:07.082 INFO:tasks.ceph.mds.d:Started 2023-11-30T18:23:07.082 DEBUG:teuthology.parallel:result is None 2023-11-30T18:23:07.083 INFO:tasks.ceph.mds.b:Started 2023-11-30T18:23:07.083 DEBUG:teuthology.parallel:result is None 2023-11-30T18:23:07.083 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-30T18:23:07.151 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-11-30T18:23:07.151 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-11-30T18:23:07.165 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-11-30T18:23:07.166 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-11-30T18:23:07.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.209+0000 7f4530278700 1 Processor -- start 2023-11-30T18:23:07.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.209+0000 7f4530278700 1 -- start start 2023-11-30T18:23:07.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.210+0000 7f4530278700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f45280c6950 0x7f452814eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:07.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.210+0000 7f4530278700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45280634a0 con 0x7f452814eb00 2023-11-30T18:23:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.210+0000 7f4530278700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4528063780 con 0x7f45280bcdd0 2023-11-30T18:23:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.210+0000 7f4530278700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4528137d90 con 0x7f45280c6950 2023-11-30T18:23:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.210+0000 7f452e014700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f452814eb00 0x7f45280bc6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42956/0 (socket says 172.21.15.49:42956) 2023-11-30T18:23:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.210+0000 7f452e014700 1 -- 172.21.15.49:0/3120017721 learned_addr learned my addr 172.21.15.49:0/3120017721 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:23:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.211+0000 7f452e815700 1 --2- 172.21.15.49:0/3120017721 >> v2:172.21.15.115:3300/0 conn(0x7f45280c6950 0x7f452814eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.211+0000 7f452d012700 1 -- 172.21.15.49:0/3120017721 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 237142018 0 0) 0x7f45280634a0 con 0x7f452814eb00 2023-11-30T18:23:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.211+0000 7f452d012700 1 -- 172.21.15.49:0/3120017721 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45100033f0 con 0x7f452814eb00 2023-11-30T18:23:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.211+0000 7f452d012700 1 -- 172.21.15.49:0/3120017721 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3226315186 0 0) 0x7f45100033f0 con 0x7f452814eb00 2023-11-30T18:23:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.211+0000 7f452d012700 1 -- 172.21.15.49:0/3120017721 >> v2:172.21.15.115:3300/0 conn(0x7f45280c6950 msgr2=0x7f452814eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.211+0000 7f452d012700 1 --2- 172.21.15.49:0/3120017721 >> v2:172.21.15.115:3300/0 conn(0x7f45280c6950 0x7f452814eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.211+0000 7f452d012700 1 -- 172.21.15.49:0/3120017721 >> v1:172.21.15.115:6789/0 conn(0x7f45280bcdd0 legacy=0x7f4528062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.211+0000 7f452d012700 1 -- 172.21.15.49:0/3120017721 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4528063a60 con 0x7f452814eb00 2023-11-30T18:23:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.211+0000 7f452d012700 1 -- 172.21.15.49:0/3120017721 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f45200015f0 con 0x7f452814eb00 2023-11-30T18:23:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.211+0000 7f452d012700 1 -- 172.21.15.49:0/3120017721 >> v1:172.21.15.49:6789/0 conn(0x7f452814eb00 legacy=0x7f45280bc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:07.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.211+0000 7f452d012700 1 --2- 172.21.15.49:0/3120017721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45100038e0 0x7f4510003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:07.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.211+0000 7f452d012700 1 --2- 172.21.15.49:0/3120017721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4510004690 0x7f4510004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:07.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.211+0000 7f452d012700 1 --2- 172.21.15.49:0/3120017721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4510005000 0x7f451000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:07.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.211+0000 7f452d012700 1 -- 172.21.15.49:0/3120017721 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4528137d90 con 0x7f4510005000 2023-11-30T18:23:07.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.211+0000 7f452d012700 1 -- 172.21.15.49:0/3120017721 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451000bf60 con 0x7f45100038e0 2023-11-30T18:23:07.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.211+0000 7f452d012700 1 -- 172.21.15.49:0/3120017721 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f451000c0f0 con 0x7f4510004690 2023-11-30T18:23:07.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.211+0000 7f452e014700 1 --2- 172.21.15.49:0/3120017721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45100038e0 0x7f4510003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:07.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.211+0000 7f452e815700 1 --2- 172.21.15.49:0/3120017721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4510005000 0x7f451000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:07.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.211+0000 7f452d813700 1 --2- 172.21.15.49:0/3120017721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4510004690 0x7f4510004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:07.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.211+0000 7f452e815700 1 -- 172.21.15.49:0/3120017721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4510004690 msgr2=0x7f4510004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:07.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.211+0000 7f452e815700 1 --2- 172.21.15.49:0/3120017721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4510004690 0x7f4510004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:07.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.211+0000 7f452e815700 1 -- 172.21.15.49:0/3120017721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45100038e0 msgr2=0x7f4510003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:07.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.211+0000 7f452e815700 1 --2- 172.21.15.49:0/3120017721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45100038e0 0x7f4510003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:07.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.211+0000 7f452e815700 1 -- 172.21.15.49:0/3120017721 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45100033f0 con 0x7f4510005000 2023-11-30T18:23:07.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.211+0000 7f452e014700 1 --2- 172.21.15.49:0/3120017721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45100038e0 0x7f4510003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:23:07.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.211+0000 7f452e815700 1 -- 172.21.15.49:0/3120017721 reap_dead start 2023-11-30T18:23:07.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.212+0000 7f452e815700 1 --2- 172.21.15.49:0/3120017721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4510005000 0x7f451000b8e0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7f451800e210 tx=0x7f451800b040).ready entity=mon.0 client_cookie=8cad8a0477cc8ea5 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:07.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.212+0000 7f452d012700 1 -- 172.21.15.49:0/3120017721 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4518009ac0 con 0x7f4510005000 2023-11-30T18:23:07.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.212+0000 7f452d012700 1 -- 172.21.15.49:0/3120017721 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451800f040 con 0x7f4510005000 2023-11-30T18:23:07.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.212+0000 7f452d012700 1 -- 172.21.15.49:0/3120017721 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451800ed10 con 0x7f4510005000 2023-11-30T18:23:07.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.212+0000 7f4530278700 1 -- 172.21.15.49:0/3120017721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4510005000 msgr2=0x7f451000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:07.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.212+0000 7f4530278700 1 --2- 172.21.15.49:0/3120017721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4510005000 0x7f451000b8e0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7f451800e210 tx=0x7f451800b040).stop 2023-11-30T18:23:07.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.212+0000 7f4530278700 1 -- 172.21.15.49:0/3120017721 shutdown_connections 2023-11-30T18:23:07.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.212+0000 7f4530278700 1 --2- 172.21.15.49:0/3120017721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4510005000 0x7f451000b8e0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:07.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.212+0000 7f4530278700 1 -- 172.21.15.49:0/3120017721 >> 172.21.15.49:0/3120017721 conn(0x7f45280c8230 msgr2=0x7f45280c4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:07.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.212+0000 7f4530278700 1 -- 172.21.15.49:0/3120017721 shutdown_connections 2023-11-30T18:23:07.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.212+0000 7f4530278700 1 -- 172.21.15.49:0/3120017721 wait complete. 2023-11-30T18:23:07.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.213+0000 7f4530278700 1 Processor -- start 2023-11-30T18:23:07.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.213+0000 7f4530278700 1 -- start start 2023-11-30T18:23:07.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.214+0000 7f4530278700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4510005000 0x7f45281363c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:07.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.214+0000 7f4530278700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45280a5e40 0x7f45280a62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:07.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.214+0000 7f4530278700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45280bfca0 0x7f45280c0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:07.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.214+0000 7f4530278700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4528138c30 con 0x7f45280bfca0 2023-11-30T18:23:07.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.214+0000 7f4530278700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45280a67b0 con 0x7f4510005000 2023-11-30T18:23:07.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.214+0000 7f4530278700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45281368b0 con 0x7f45280a5e40 2023-11-30T18:23:07.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.214+0000 7f452e815700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45280bfca0 0x7f45280c0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:07.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.214+0000 7f452e815700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45280bfca0 0x7f45280c0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45014/0 (socket says 172.21.15.49:45014) 2023-11-30T18:23:07.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.214+0000 7f452e815700 1 -- 172.21.15.49:0/3906718670 learned_addr learned my addr 172.21.15.49:0/3906718670 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:07.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.214+0000 7f452e014700 1 --2- 172.21.15.49:0/3906718670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4510005000 0x7f45281363c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:07.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.214+0000 7f452d813700 1 --2- 172.21.15.49:0/3906718670 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45280a5e40 0x7f45280a62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:07.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.214+0000 7f452e815700 1 -- 172.21.15.49:0/3906718670 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45280a5e40 msgr2=0x7f45280a62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:07.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.215+0000 7f452e815700 1 --2- 172.21.15.49:0/3906718670 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45280a5e40 0x7f45280a62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:07.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.215+0000 7f452e815700 1 -- 172.21.15.49:0/3906718670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4510005000 msgr2=0x7f45281363c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:07.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.215+0000 7f452e815700 1 --2- 172.21.15.49:0/3906718670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4510005000 0x7f45281363c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:07.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.215+0000 7f452e815700 1 -- 172.21.15.49:0/3906718670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4528138020 con 0x7f45280bfca0 2023-11-30T18:23:07.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.215+0000 7f452e815700 1 --2- 172.21.15.49:0/3906718670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45280bfca0 0x7f45280c0120 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7f45280bd1b0 tx=0x7f4518018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:07.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.215+0000 7f45267fc700 1 -- 172.21.15.49:0/3906718670 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451801d460 con 0x7f45280bfca0 2023-11-30T18:23:07.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.215+0000 7f45267fc700 1 -- 172.21.15.49:0/3906718670 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451801d5e0 con 0x7f45280bfca0 2023-11-30T18:23:07.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.215+0000 7f4530278700 1 -- 172.21.15.49:0/3906718670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4528138c30 con 0x7f45280bfca0 2023-11-30T18:23:07.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.215+0000 7f45267fc700 1 -- 172.21.15.49:0/3906718670 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451801d9a0 con 0x7f45280bfca0 2023-11-30T18:23:07.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.215+0000 7f4530278700 1 -- 172.21.15.49:0/3906718670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45281385e0 con 0x7f45280bfca0 2023-11-30T18:23:07.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.216+0000 7f4530278700 1 -- 172.21.15.49:0/3906718670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4528138dc0 con 0x7f45280bfca0 2023-11-30T18:23:07.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.216+0000 7f45267fc700 1 -- 172.21.15.49:0/3906718670 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4518003020 con 0x7f45280bfca0 2023-11-30T18:23:07.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.217+0000 7f45267fc700 1 --2- 172.21.15.49:0/3906718670 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f451405f270 0x7f4514061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:07.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.217+0000 7f45267fc700 1 -- 172.21.15.49:0/3906718670 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 5884+0+0 (secure 0 0 0) 0x7f451807c080 con 0x7f45280bfca0 2023-11-30T18:23:07.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.217+0000 7f452e014700 1 --2- 172.21.15.49:0/3906718670 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f451405f270 0x7f4514061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:07.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.217+0000 7f452e014700 1 --2- 172.21.15.49:0/3906718670 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f451405f270 0x7f4514061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f4520001860 tx=0x7f4520009040).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:07.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.221+0000 7f45267fc700 1 -- 172.21.15.49:0/3906718670 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f451804d2c0 con 0x7f45280bfca0 2023-11-30T18:23:07.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:07.410+0000 7f4530278700 1 -- 172.21.15.49:0/3906718670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f452806c860 con 0x7f45280bfca0 2023-11-30T18:23:08.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.251+0000 7f45267fc700 1 -- 172.21.15.49:0/3906718670 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v180) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4518017080 con 0x7f45280bfca0 2023-11-30T18:23:08.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.254+0000 7f4530278700 1 -- 172.21.15.49:0/3906718670 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f451405f270 msgr2=0x7f4514061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:08.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.254+0000 7f4530278700 1 --2- 172.21.15.49:0/3906718670 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f451405f270 0x7f4514061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f4520001860 tx=0x7f4520009040).stop 2023-11-30T18:23:08.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.254+0000 7f4530278700 1 -- 172.21.15.49:0/3906718670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45280bfca0 msgr2=0x7f45280c0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:08.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.254+0000 7f4530278700 1 --2- 172.21.15.49:0/3906718670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45280bfca0 0x7f45280c0120 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7f45280bd1b0 tx=0x7f4518018000).stop 2023-11-30T18:23:08.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.254+0000 7f4530278700 1 -- 172.21.15.49:0/3906718670 shutdown_connections 2023-11-30T18:23:08.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.254+0000 7f4530278700 1 --2- 172.21.15.49:0/3906718670 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f451405f270 0x7f4514061730 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:08.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.254+0000 7f4530278700 1 --2- 172.21.15.49:0/3906718670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45280bfca0 0x7f45280c0120 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:08.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.254+0000 7f4530278700 1 --2- 172.21.15.49:0/3906718670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4510005000 0x7f45281363c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:08.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.254+0000 7f4530278700 1 --2- 172.21.15.49:0/3906718670 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45280a5e40 0x7f45280a62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:08.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.254+0000 7f4530278700 1 -- 172.21.15.49:0/3906718670 >> 172.21.15.49:0/3906718670 conn(0x7f45280c8230 msgr2=0x7f45280665f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:08.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.254+0000 7f4530278700 1 -- 172.21.15.49:0/3906718670 shutdown_connections 2023-11-30T18:23:08.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.254+0000 7f4530278700 1 -- 172.21.15.49:0/3906718670 wait complete. 2023-11-30T18:23:08.256 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2023-11-30T18:23:08.270 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-30T18:23:08.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.393+0000 7ff62483d700 1 Processor -- start 2023-11-30T18:23:08.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.393+0000 7ff62483d700 1 -- start start 2023-11-30T18:23:08.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.394+0000 7ff62483d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff6201544d0 0x7ff620155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:08.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.394+0000 7ff62483d700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6200683d0 con 0x7ff6200673c0 2023-11-30T18:23:08.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.394+0000 7ff62483d700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff620067850 con 0x7ff620066f40 2023-11-30T18:23:08.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.394+0000 7ff62483d700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff620067b30 con 0x7ff6201544d0 2023-11-30T18:23:08.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.394+0000 7ff61e59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff6201544d0 0x7ff620155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:08.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.394+0000 7ff61e59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff6201544d0 0x7ff620155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45020/0 (socket says 172.21.15.49:45020) 2023-11-30T18:23:08.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.394+0000 7ff61ed9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff6200673c0 0x7ff62015e0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42960/0 (socket says 172.21.15.49:42960) 2023-11-30T18:23:08.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.394+0000 7ff61e59c700 1 -- 172.21.15.49:0/400598916 learned_addr learned my addr 172.21.15.49:0/400598916 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:08.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.394+0000 7ff61e59c700 1 -- 172.21.15.49:0/400598916 >> v1:172.21.15.115:6789/0 conn(0x7ff620066f40 legacy=0x7ff620095e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:08.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.394+0000 7ff61e59c700 1 -- 172.21.15.49:0/400598916 >> v1:172.21.15.49:6789/0 conn(0x7ff6200673c0 legacy=0x7ff62015e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:08.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.394+0000 7ff61e59c700 1 -- 172.21.15.49:0/400598916 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff620067e10 con 0x7ff6201544d0 2023-11-30T18:23:08.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.394+0000 7ff61d59a700 1 -- 172.21.15.49:0/400598916 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 119107063 0 0) 0x7ff6200683d0 con 0x7ff6200673c0 2023-11-30T18:23:08.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.394+0000 7ff61e59c700 1 --2- 172.21.15.49:0/400598916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6201544d0 0x7ff620155750 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7ff610009810 tx=0x7ff610009060).ready entity=mon.0 client_cookie=95f1ef58a56bde6e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:08.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.394+0000 7ff61d59a700 1 -- 172.21.15.49:0/400598916 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff610005880 con 0x7ff6201544d0 2023-11-30T18:23:08.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.394+0000 7ff61d59a700 1 -- 172.21.15.49:0/400598916 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6100059e0 con 0x7ff6201544d0 2023-11-30T18:23:08.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.394+0000 7ff61d59a700 1 -- 172.21.15.49:0/400598916 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff610005d60 con 0x7ff6201544d0 2023-11-30T18:23:08.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.395+0000 7ff62483d700 1 -- 172.21.15.49:0/400598916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6201544d0 msgr2=0x7ff620155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:08.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.395+0000 7ff62483d700 1 --2- 172.21.15.49:0/400598916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6201544d0 0x7ff620155750 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7ff610009810 tx=0x7ff610009060).stop 2023-11-30T18:23:08.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.395+0000 7ff62483d700 1 -- 172.21.15.49:0/400598916 shutdown_connections 2023-11-30T18:23:08.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.395+0000 7ff62483d700 1 --2- 172.21.15.49:0/400598916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6201544d0 0x7ff620155750 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:08.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.395+0000 7ff62483d700 1 -- 172.21.15.49:0/400598916 >> 172.21.15.49:0/400598916 conn(0x7ff6200631d0 msgr2=0x7ff6200c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:08.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.395+0000 7ff62483d700 1 -- 172.21.15.49:0/400598916 shutdown_connections 2023-11-30T18:23:08.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.395+0000 7ff62483d700 1 -- 172.21.15.49:0/400598916 wait complete. 2023-11-30T18:23:08.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.396+0000 7ff62483d700 1 Processor -- start 2023-11-30T18:23:08.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.396+0000 7ff62483d700 1 -- start start 2023-11-30T18:23:08.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.397+0000 7ff62483d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff620066f40 0x7ff62014d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:08.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.397+0000 7ff62483d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6201544d0 0x7ff6200c01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:08.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.397+0000 7ff62483d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff62014da40 0x7ff6200c06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:08.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.397+0000 7ff62483d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff620155df0 con 0x7ff6201544d0 2023-11-30T18:23:08.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.397+0000 7ff62483d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6201557e0 con 0x7ff620066f40 2023-11-30T18:23:08.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.397+0000 7ff62483d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff620159490 con 0x7ff62014da40 2023-11-30T18:23:08.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.397+0000 7ff61dd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6201544d0 0x7ff6200c01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:08.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.397+0000 7ff61dd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6201544d0 0x7ff6200c01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45026/0 (socket says 172.21.15.49:45026) 2023-11-30T18:23:08.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.397+0000 7ff61dd9b700 1 -- 172.21.15.49:0/2661925673 learned_addr learned my addr 172.21.15.49:0/2661925673 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:08.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.397+0000 7ff61e59c700 1 --2- 172.21.15.49:0/2661925673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff620066f40 0x7ff62014d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:08.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.397+0000 7ff61ed9d700 1 --2- 172.21.15.49:0/2661925673 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff62014da40 0x7ff6200c06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:08.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.397+0000 7ff61dd9b700 1 -- 172.21.15.49:0/2661925673 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff62014da40 msgr2=0x7ff6200c06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:08.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.397+0000 7ff61dd9b700 1 --2- 172.21.15.49:0/2661925673 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff62014da40 0x7ff6200c06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:08.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.397+0000 7ff61dd9b700 1 -- 172.21.15.49:0/2661925673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff620066f40 msgr2=0x7ff62014d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:08.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.397+0000 7ff61dd9b700 1 --2- 172.21.15.49:0/2661925673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff620066f40 0x7ff62014d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:08.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.397+0000 7ff61dd9b700 1 -- 172.21.15.49:0/2661925673 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff610009300 con 0x7ff6201544d0 2023-11-30T18:23:08.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.398+0000 7ff61dd9b700 1 --2- 172.21.15.49:0/2661925673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6201544d0 0x7ff6200c01b0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7ff60800c4c0 tx=0x7ff608007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:08.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.398+0000 7ff6167fc700 1 -- 172.21.15.49:0/2661925673 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60800ce70 con 0x7ff6201544d0 2023-11-30T18:23:08.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.398+0000 7ff6167fc700 1 -- 172.21.15.49:0/2661925673 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff608001e90 con 0x7ff6201544d0 2023-11-30T18:23:08.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.398+0000 7ff6167fc700 1 -- 172.21.15.49:0/2661925673 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff608007250 con 0x7ff6201544d0 2023-11-30T18:23:08.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.398+0000 7ff62483d700 1 -- 172.21.15.49:0/2661925673 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff620155a80 con 0x7ff6201544d0 2023-11-30T18:23:08.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.398+0000 7ff62483d700 1 -- 172.21.15.49:0/2661925673 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6200c0b90 con 0x7ff6201544d0 2023-11-30T18:23:08.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.399+0000 7ff62483d700 1 -- 172.21.15.49:0/2661925673 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff62006c860 con 0x7ff6201544d0 2023-11-30T18:23:08.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.399+0000 7ff6167fc700 1 -- 172.21.15.49:0/2661925673 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff6080066a0 con 0x7ff6201544d0 2023-11-30T18:23:08.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.400+0000 7ff6167fc700 1 --2- 172.21.15.49:0/2661925673 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff60005f270 0x7ff600061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:08.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.400+0000 7ff6167fc700 1 -- 172.21.15.49:0/2661925673 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5325+0+0 (secure 0 0 0) 0x7ff608079920 con 0x7ff6201544d0 2023-11-30T18:23:08.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.400+0000 7ff61e59c700 1 --2- 172.21.15.49:0/2661925673 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff60005f270 0x7ff600061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:08.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.400+0000 7ff61e59c700 1 --2- 172.21.15.49:0/2661925673 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff60005f270 0x7ff600061730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7ff610009fd0 tx=0x7ff610016000).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:08.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.404+0000 7ff6167fc700 1 -- 172.21.15.49:0/2661925673 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff60804ad90 con 0x7ff6201544d0 2023-11-30T18:23:08.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.642+0000 7ff62483d700 1 -- 172.21.15.49:0/2661925673 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff6200680f0 con 0x7ff6201544d0 2023-11-30T18:23:08.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.643+0000 7ff6167fc700 1 -- 172.21.15.49:0/2661925673 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v42) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ff60804e3b0 con 0x7ff6201544d0 2023-11-30T18:23:08.644 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:23:08.644 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T18:23:08.644 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2023-11-30T18:23:08.644 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:23:08.644 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2023-11-30T18:23:08.644 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlwm1FHxAAk+s9c60UZ5jB37wbpGzlcg==", 2023-11-30T18:23:08.645 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:23:08.645 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:23:08.645 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T18:23:08.645 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T18:23:08.645 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:23:08.645 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:23:08.645 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:23:08.645 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:23:08.645 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2023-11-30T18:23:08.645 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlADm0KhAArffesGGTXzQwY4NPnJ1Bjw==", 2023-11-30T18:23:08.645 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:23:08.645 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:23:08.645 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T18:23:08.645 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T18:23:08.645 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:23:08.646 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:23:08.646 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:23:08.646 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:23:08.646 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2023-11-30T18:23:08.646 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlYnY1JhAA+Lurauug0NhWnK8aZErR3g==", 2023-11-30T18:23:08.646 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:23:08.646 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:23:08.646 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T18:23:08.646 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T18:23:08.646 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:23:08.646 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:23:08.646 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:23:08.646 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:23:08.646 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2023-11-30T18:23:08.646 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlQdKCMRAA3h4O2NqkQ2zE3DxOqBoaQQ==", 2023-11-30T18:23:08.647 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:23:08.647 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:23:08.647 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T18:23:08.647 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T18:23:08.647 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:23:08.647 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:23:08.647 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:23:08.647 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:23:08.647 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2023-11-30T18:23:08.647 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAPwWhlGdbhFxAAOspNRLMhR59LSWatFbsYDA==", 2023-11-30T18:23:08.647 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:23:08.647 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:23:08.647 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:23:08.647 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:23:08.647 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:23:08.648 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:23:08.648 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:23:08.648 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2023-11-30T18:23:08.648 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQASwWhlfwUEFxAAuj0L8ooIGi1vsb7XWLVlDA==", 2023-11-30T18:23:08.648 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:23:08.648 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:23:08.648 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:23:08.648 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:23:08.648 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:23:08.648 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:23:08.648 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:23:08.648 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2023-11-30T18:23:08.648 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAVwWhl7XYwFBAAuSHZqdfRR8V1Y+hmPT5uuw==", 2023-11-30T18:23:08.648 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:23:08.648 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:23:08.649 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:23:08.649 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:23:08.649 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:23:08.649 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:23:08.649 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:23:08.649 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2023-11-30T18:23:08.649 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAYwWhlkhRCFRAAe3cRLcrhJ3ZoluXuRUhmew==", 2023-11-30T18:23:08.649 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:23:08.649 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:23:08.649 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:23:08.649 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:23:08.649 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:23:08.649 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:23:08.649 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:23:08.649 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2023-11-30T18:23:08.650 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAewWhlrq4qFBAAOSdqozO8iH25BQFrPI1SRQ==", 2023-11-30T18:23:08.650 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:23:08.650 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:23:08.650 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:23:08.650 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:23:08.650 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:23:08.650 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:23:08.650 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:23:08.650 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2023-11-30T18:23:08.650 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAhwWhlZL9WERAA90znWBLNuY5eem3yF6O0wg==", 2023-11-30T18:23:08.650 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:23:08.650 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:23:08.650 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:23:08.650 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:23:08.651 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:23:08.651 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:23:08.651 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:23:08.651 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2023-11-30T18:23:08.651 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAkwWhlCJDiEBAAETLCBNCdaWXFgkPPaulTAA==", 2023-11-30T18:23:08.651 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:23:08.651 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:23:08.651 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:23:08.651 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:23:08.651 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:23:08.651 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:23:08.651 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:23:08.651 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2023-11-30T18:23:08.651 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAnwWhl+IiYEBAAcI3AU5xrv0cYy9lckyu0dQ==", 2023-11-30T18:23:08.651 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:23:08.652 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:23:08.652 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:23:08.652 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:23:08.652 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:23:08.652 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:23:08.652 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:23:08.652 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2023-11-30T18:23:08.652 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhleYZcNRAA5PoPChH+s6XfbrQ0hmu2NA==", 2023-11-30T18:23:08.652 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:23:08.652 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:23:08.652 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2023-11-30T18:23:08.652 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-30T18:23:08.652 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:23:08.652 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:23:08.652 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:23:08.653 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2023-11-30T18:23:08.653 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAOwWhlFhcfAhAAzaBDtyRxuqeQ9BatfgUuXw==", 2023-11-30T18:23:08.653 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:23:08.653 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:23:08.653 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T18:23:08.653 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T18:23:08.653 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T18:23:08.653 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:23:08.653 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:23:08.653 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:23:08.653 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2023-11-30T18:23:08.653 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlLZrDOhAAHG/dYWYmPouk3+Iqafr7qw==", 2023-11-30T18:23:08.653 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:23:08.653 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:23:08.653 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T18:23:08.654 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T18:23:08.654 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T18:23:08.654 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:23:08.654 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:23:08.654 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:23:08.654 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2023-11-30T18:23:08.654 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAOwWhl6lxuBxAA/YXQDo+U2ppULGzK054Gzg==", 2023-11-30T18:23:08.654 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:23:08.654 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:23:08.654 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T18:23:08.654 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T18:23:08.654 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T18:23:08.654 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:23:08.654 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:23:08.655 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:23:08.655 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2023-11-30T18:23:08.655 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhl4JkLAxAAiaLgZ5eiazaT9VanG5ihyQ==", 2023-11-30T18:23:08.655 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:23:08.655 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T18:23:08.655 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T18:23:08.655 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T18:23:08.655 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:23:08.655 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:23:08.655 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:23:08.655 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:23:08.655 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2023-11-30T18:23:08.655 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlH1s2HBAA3ea9Utfv7fZoo2hO+ElDVQ==", 2023-11-30T18:23:08.655 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:23:08.655 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T18:23:08.656 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-11-30T18:23:08.656 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:23:08.656 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:23:08.656 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:23:08.656 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:23:08.656 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2023-11-30T18:23:08.656 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlpy+fFxAA3qmboR+PlQtK6T35ryj+Lw==", 2023-11-30T18:23:08.656 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:23:08.656 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T18:23:08.656 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-11-30T18:23:08.656 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:23:08.656 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:23:08.656 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:23:08.656 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-11-30T18:23:08.656 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T18:23:08.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.645+0000 7ff62483d700 1 -- 172.21.15.49:0/2661925673 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff60005f270 msgr2=0x7ff600061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:08.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.645+0000 7ff62483d700 1 --2- 172.21.15.49:0/2661925673 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff60005f270 0x7ff600061730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7ff610009fd0 tx=0x7ff610016000).stop 2023-11-30T18:23:08.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.645+0000 7ff62483d700 1 -- 172.21.15.49:0/2661925673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6201544d0 msgr2=0x7ff6200c01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:08.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.645+0000 7ff62483d700 1 --2- 172.21.15.49:0/2661925673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6201544d0 0x7ff6200c01b0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7ff60800c4c0 tx=0x7ff608007e00).stop 2023-11-30T18:23:08.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.645+0000 7ff62483d700 1 -- 172.21.15.49:0/2661925673 shutdown_connections 2023-11-30T18:23:08.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.645+0000 7ff62483d700 1 --2- 172.21.15.49:0/2661925673 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff62014da40 0x7ff6200c06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:08.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.645+0000 7ff62483d700 1 --2- 172.21.15.49:0/2661925673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff620066f40 0x7ff62014d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:08.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.645+0000 7ff62483d700 1 --2- 172.21.15.49:0/2661925673 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7ff60005f270 0x7ff600061730 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:08.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.645+0000 7ff62483d700 1 --2- 172.21.15.49:0/2661925673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6201544d0 0x7ff6200c01b0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:08.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.645+0000 7ff62483d700 1 -- 172.21.15.49:0/2661925673 >> 172.21.15.49:0/2661925673 conn(0x7ff6200631d0 msgr2=0x7ff6200c90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:08.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.645+0000 7ff62483d700 1 -- 172.21.15.49:0/2661925673 shutdown_connections 2023-11-30T18:23:08.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.645+0000 7ff62483d700 1 -- 172.21.15.49:0/2661925673 wait complete. 2023-11-30T18:23:08.659 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:23:08.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.775+0000 7f12aa2ab700 1 Processor -- start 2023-11-30T18:23:08.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.775+0000 7f12aa2ab700 1 -- start start 2023-11-30T18:23:08.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.776+0000 7f12aa2ab700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f12a40cae90 0x7f12a40c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:08.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.776+0000 7f12aa2ab700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f12a40ca180 0x7f12a40c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:08.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.776+0000 7f12aa2ab700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12a40a9a90 con 0x7f12a40caab0 2023-11-30T18:23:08.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.776+0000 7f12aa2ab700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a40c1490 con 0x7f12a40ca180 2023-11-30T18:23:08.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.776+0000 7f12aa2ab700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a4154ce0 con 0x7f12a40cae90 2023-11-30T18:23:08.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.776+0000 7f12a8848700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f12a40ca180 0x7f12a40c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:08.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.776+0000 7f12a3fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f12a40caab0 0x7f12a40aa470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42966/0 (socket says 172.21.15.49:42966) 2023-11-30T18:23:08.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.776+0000 7f12a3fff700 1 -- 172.21.15.49:0/3103102087 learned_addr learned my addr 172.21.15.49:0/3103102087 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:23:08.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.777+0000 7f12a37fe700 1 --2- 172.21.15.49:0/3103102087 >> v2:172.21.15.115:3300/0 conn(0x7f12a40cae90 0x7f12a40c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:08.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.777+0000 7f12a8848700 1 -- 172.21.15.49:0/3103102087 >> v2:172.21.15.115:3300/0 conn(0x7f12a40cae90 msgr2=0x7f12a40c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:08.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.777+0000 7f12a8848700 1 --2- 172.21.15.49:0/3103102087 >> v2:172.21.15.115:3300/0 conn(0x7f12a40cae90 0x7f12a40c0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:08.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.777+0000 7f12a8848700 1 -- 172.21.15.49:0/3103102087 >> v1:172.21.15.49:6789/0 conn(0x7f12a40caab0 legacy=0x7f12a40aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:08.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.777+0000 7f12a8848700 1 -- 172.21.15.49:0/3103102087 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a40aab80 con 0x7f12a40ca180 2023-11-30T18:23:08.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.777+0000 7f12a2ffd700 1 -- 172.21.15.49:0/3103102087 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3619581578 0 0) 0x7f12a40a9a90 con 0x7f12a40caab0 2023-11-30T18:23:08.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.777+0000 7f12a8848700 1 --2- 172.21.15.49:0/3103102087 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12a40ca180 0x7f12a40c0fa0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7f12a40b1440 tx=0x7f129c009780).ready entity=mon.0 client_cookie=edf70410307f22da server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:08.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.777+0000 7f12a2ffd700 1 -- 172.21.15.49:0/3103102087 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c00e070 con 0x7f12a40ca180 2023-11-30T18:23:08.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.777+0000 7f12a2ffd700 1 -- 172.21.15.49:0/3103102087 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129c00bc30 con 0x7f12a40ca180 2023-11-30T18:23:08.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.777+0000 7f12a2ffd700 1 -- 172.21.15.49:0/3103102087 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c012410 con 0x7f12a40ca180 2023-11-30T18:23:08.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.777+0000 7f12aa2ab700 1 -- 172.21.15.49:0/3103102087 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12a40ca180 msgr2=0x7f12a40c0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:08.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.777+0000 7f12aa2ab700 1 --2- 172.21.15.49:0/3103102087 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12a40ca180 0x7f12a40c0fa0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7f12a40b1440 tx=0x7f129c009780).stop 2023-11-30T18:23:08.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.777+0000 7f12aa2ab700 1 -- 172.21.15.49:0/3103102087 shutdown_connections 2023-11-30T18:23:08.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.777+0000 7f12aa2ab700 1 --2- 172.21.15.49:0/3103102087 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12a40ca180 0x7f12a40c0fa0 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:08.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.777+0000 7f12aa2ab700 1 --2- 172.21.15.49:0/3103102087 >> v2:172.21.15.115:3300/0 conn(0x7f12a40cae90 0x7f12a40c0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:08.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.777+0000 7f12aa2ab700 1 -- 172.21.15.49:0/3103102087 >> 172.21.15.49:0/3103102087 conn(0x7f12a4094920 msgr2=0x7f12a406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:08.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.778+0000 7f12aa2ab700 1 -- 172.21.15.49:0/3103102087 shutdown_connections 2023-11-30T18:23:08.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.778+0000 7f12aa2ab700 1 -- 172.21.15.49:0/3103102087 wait complete. 2023-11-30T18:23:08.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.779+0000 7f12aa2ab700 1 Processor -- start 2023-11-30T18:23:08.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.779+0000 7f12aa2ab700 1 -- start start 2023-11-30T18:23:08.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.780+0000 7f12aa2ab700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12a40ca180 0x7f12a414ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:08.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.780+0000 7f12aa2ab700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12a40caab0 0x7f12a40a7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:08.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.780+0000 7f12aa2ab700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12a40cae90 0x7f12a40a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:08.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.780+0000 7f12aa2ab700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a41682a0 con 0x7f12a40caab0 2023-11-30T18:23:08.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.780+0000 7f12aa2ab700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a40a89c0 con 0x7f12a40ca180 2023-11-30T18:23:08.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.780+0000 7f12aa2ab700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a4167620 con 0x7f12a40cae90 2023-11-30T18:23:08.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.780+0000 7f12a37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12a40caab0 0x7f12a40a7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:08.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.780+0000 7f12a3fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12a40ca180 0x7f12a414ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:08.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.780+0000 7f12a37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12a40caab0 0x7f12a40a7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45048/0 (socket says 172.21.15.49:45048) 2023-11-30T18:23:08.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.780+0000 7f12a37fe700 1 -- 172.21.15.49:0/3689555358 learned_addr learned my addr 172.21.15.49:0/3689555358 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:08.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.780+0000 7f12a8848700 1 --2- 172.21.15.49:0/3689555358 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12a40cae90 0x7f12a40a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:08.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.780+0000 7f12a37fe700 1 -- 172.21.15.49:0/3689555358 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12a40cae90 msgr2=0x7f12a40a84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:08.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.780+0000 7f12a37fe700 1 --2- 172.21.15.49:0/3689555358 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12a40cae90 0x7f12a40a84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:08.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.780+0000 7f12a37fe700 1 -- 172.21.15.49:0/3689555358 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12a40ca180 msgr2=0x7f12a414ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:08.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.780+0000 7f12a37fe700 1 --2- 172.21.15.49:0/3689555358 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12a40ca180 0x7f12a414ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:08.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.780+0000 7f12a37fe700 1 -- 172.21.15.49:0/3689555358 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129c009a20 con 0x7f12a40caab0 2023-11-30T18:23:08.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.780+0000 7f12a37fe700 1 --2- 172.21.15.49:0/3689555358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12a40caab0 0x7f12a40a7fe0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7f129800d890 tx=0x7f1298008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:08.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.780+0000 7f128bfff700 1 -- 172.21.15.49:0/3689555358 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298011590 con 0x7f12a40caab0 2023-11-30T18:23:08.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.780+0000 7f128bfff700 1 -- 172.21.15.49:0/3689555358 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12980116f0 con 0x7f12a40caab0 2023-11-30T18:23:08.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.780+0000 7f12aa2ab700 1 -- 172.21.15.49:0/3689555358 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a4167900 con 0x7f12a40caab0 2023-11-30T18:23:08.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.780+0000 7f128bfff700 1 -- 172.21.15.49:0/3689555358 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298011a70 con 0x7f12a40caab0 2023-11-30T18:23:08.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.781+0000 7f12aa2ab700 1 -- 172.21.15.49:0/3689555358 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a4167ec0 con 0x7f12a40caab0 2023-11-30T18:23:08.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.781+0000 7f12aa2ab700 1 -- 172.21.15.49:0/3689555358 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a41683e0 con 0x7f12a40caab0 2023-11-30T18:23:08.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.782+0000 7f128bfff700 1 -- 172.21.15.49:0/3689555358 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f129801c460 con 0x7f12a40caab0 2023-11-30T18:23:08.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.782+0000 7f128bfff700 1 --2- 172.21.15.49:0/3689555358 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f129005f270 0x7f1290061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:08.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.782+0000 7f128bfff700 1 -- 172.21.15.49:0/3689555358 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5325+0+0 (secure 0 0 0) 0x7f1298079e00 con 0x7f12a40caab0 2023-11-30T18:23:08.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.782+0000 7f12a3fff700 1 --2- 172.21.15.49:0/3689555358 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f129005f270 0x7f1290061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:08.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.783+0000 7f12a3fff700 1 --2- 172.21.15.49:0/3689555358 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f129005f270 0x7f1290061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1294001360 tx=0x7f1294009040).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:08.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.786+0000 7f128bfff700 1 -- 172.21.15.49:0/3689555358 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f12a41683e0 con 0x7f12a40caab0 2023-11-30T18:23:08.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.962+0000 7f12aa2ab700 1 -- 172.21.15.49:0/3689555358 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12a41683e0 con 0x7f12a40caab0 2023-11-30T18:23:08.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.963+0000 7f128bfff700 1 -- 172.21.15.49:0/3689555358 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+13811 (secure 0 0 0) 0x7f12a41683e0 con 0x7f12a40caab0 2023-11-30T18:23:08.964 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:23:08.964 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":180,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:23:08.240954+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:23:08.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.965+0000 7f12aa2ab700 1 -- 172.21.15.49:0/3689555358 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f129005f270 msgr2=0x7f1290061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:08.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.965+0000 7f12aa2ab700 1 --2- 172.21.15.49:0/3689555358 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f129005f270 0x7f1290061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1294001360 tx=0x7f1294009040).stop 2023-11-30T18:23:08.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.965+0000 7f12aa2ab700 1 -- 172.21.15.49:0/3689555358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12a40caab0 msgr2=0x7f12a40a7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:08.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.965+0000 7f12aa2ab700 1 --2- 172.21.15.49:0/3689555358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12a40caab0 0x7f12a40a7fe0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7f129800d890 tx=0x7f1298008040).stop 2023-11-30T18:23:08.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.965+0000 7f12aa2ab700 1 -- 172.21.15.49:0/3689555358 shutdown_connections 2023-11-30T18:23:08.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.965+0000 7f12aa2ab700 1 --2- 172.21.15.49:0/3689555358 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12a40cae90 0x7f12a40a84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:08.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.965+0000 7f12aa2ab700 1 --2- 172.21.15.49:0/3689555358 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12a40ca180 0x7f12a414ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:08.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.965+0000 7f12aa2ab700 1 --2- 172.21.15.49:0/3689555358 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f129005f270 0x7f1290061730 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:08.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.965+0000 7f12aa2ab700 1 --2- 172.21.15.49:0/3689555358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12a40caab0 0x7f12a40a7fe0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:08.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.965+0000 7f12aa2ab700 1 -- 172.21.15.49:0/3689555358 >> 172.21.15.49:0/3689555358 conn(0x7f12a4094920 msgr2=0x7f12a40af250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:08.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.965+0000 7f12aa2ab700 1 -- 172.21.15.49:0/3689555358 shutdown_connections 2023-11-30T18:23:08.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:08.965+0000 7f12aa2ab700 1 -- 172.21.15.49:0/3689555358 wait complete. 2023-11-30T18:23:08.978 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '173', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-11-30T18:23:08.978 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T18:23:09.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.098+0000 7f9a22bc1700 1 Processor -- start 2023-11-30T18:23:09.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.098+0000 7f9a22bc1700 1 -- start start 2023-11-30T18:23:09.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.099+0000 7f9a22bc1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9a1c158a30 0x7f9a1c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:09.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.099+0000 7f9a22bc1700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a1c0c72d0 con 0x7f9a1c098d10 2023-11-30T18:23:09.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.099+0000 7f9a22bc1700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a1c064570 con 0x7f9a1c0c6190 2023-11-30T18:23:09.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.099+0000 7f9a22bc1700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a1c154bc0 con 0x7f9a1c158a30 2023-11-30T18:23:09.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.099+0000 7f9a2115e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9a1c158a30 0x7f9a1c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:09.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.099+0000 7f9a2095d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9a1c098d10 0x7f9a1c063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42976/0 (socket says 172.21.15.49:42976) 2023-11-30T18:23:09.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.099+0000 7f9a2095d700 1 -- 172.21.15.49:0/3369282184 learned_addr learned my addr 172.21.15.49:0/3369282184 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:23:09.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.100+0000 7f9a2115e700 1 -- 172.21.15.49:0/3369282184 >> v1:172.21.15.115:6789/0 conn(0x7f9a1c0c6190 legacy=0x7f9a1c158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:09.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.100+0000 7f9a2115e700 1 -- 172.21.15.49:0/3369282184 >> v1:172.21.15.49:6789/0 conn(0x7f9a1c098d10 legacy=0x7f9a1c063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:09.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.100+0000 7f9a1b7fe700 1 -- 172.21.15.49:0/3369282184 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544328944 0 0) 0x7f9a1c0c72d0 con 0x7f9a1c098d10 2023-11-30T18:23:09.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.100+0000 7f9a2115e700 1 -- 172.21.15.49:0/3369282184 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1c0c66c0 con 0x7f9a1c158a30 2023-11-30T18:23:09.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.100+0000 7f9a2115e700 1 --2- 172.21.15.49:0/3369282184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a1c158a30 0x7f9a1c0c7760 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7f9a14009e60 tx=0x7f9a14009780).ready entity=mon.0 client_cookie=151f086c7c484c2e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:09.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.100+0000 7f9a1b7fe700 1 -- 172.21.15.49:0/3369282184 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1400e070 con 0x7f9a1c158a30 2023-11-30T18:23:09.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.100+0000 7f9a1b7fe700 1 -- 172.21.15.49:0/3369282184 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1400bc30 con 0x7f9a1c158a30 2023-11-30T18:23:09.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.100+0000 7f9a1b7fe700 1 -- 172.21.15.49:0/3369282184 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a14012410 con 0x7f9a1c158a30 2023-11-30T18:23:09.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.100+0000 7f9a22bc1700 1 -- 172.21.15.49:0/3369282184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a1c158a30 msgr2=0x7f9a1c0c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:09.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.100+0000 7f9a22bc1700 1 --2- 172.21.15.49:0/3369282184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a1c158a30 0x7f9a1c0c7760 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7f9a14009e60 tx=0x7f9a14009780).stop 2023-11-30T18:23:09.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.100+0000 7f9a22bc1700 1 -- 172.21.15.49:0/3369282184 shutdown_connections 2023-11-30T18:23:09.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.100+0000 7f9a22bc1700 1 --2- 172.21.15.49:0/3369282184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a1c158a30 0x7f9a1c0c7760 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:09.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.100+0000 7f9a22bc1700 1 -- 172.21.15.49:0/3369282184 >> 172.21.15.49:0/3369282184 conn(0x7f9a1c0cb310 msgr2=0x7f9a1c0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:09.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.101+0000 7f9a22bc1700 1 -- 172.21.15.49:0/3369282184 shutdown_connections 2023-11-30T18:23:09.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.101+0000 7f9a22bc1700 1 -- 172.21.15.49:0/3369282184 wait complete. 2023-11-30T18:23:09.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.102+0000 7f9a22bc1700 1 Processor -- start 2023-11-30T18:23:09.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.102+0000 7f9a22bc1700 1 -- start start 2023-11-30T18:23:09.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.103+0000 7f9a22bc1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a1c098d10 0x7f9a1c1647c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:09.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.103+0000 7f9a22bc1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a1c0c6190 0x7f9a1c0b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:09.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.103+0000 7f9a22bc1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a1c158a30 0x7f9a1c0c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:09.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.103+0000 7f9a22bc1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c13b800 con 0x7f9a1c158a30 2023-11-30T18:23:09.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.103+0000 7f9a22bc1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c0c2aa0 con 0x7f9a1c098d10 2023-11-30T18:23:09.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.103+0000 7f9a22bc1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c0b1330 con 0x7f9a1c0c6190 2023-11-30T18:23:09.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.103+0000 7f9a2115e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a1c158a30 0x7f9a1c0c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:09.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.103+0000 7f9a2115e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a1c158a30 0x7f9a1c0c13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45058/0 (socket says 172.21.15.49:45058) 2023-11-30T18:23:09.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.103+0000 7f9a2115e700 1 -- 172.21.15.49:0/2412594336 learned_addr learned my addr 172.21.15.49:0/2412594336 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:09.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.103+0000 7f9a2095d700 1 --2- 172.21.15.49:0/2412594336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a1c098d10 0x7f9a1c1647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:09.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.103+0000 7f9a1bfff700 1 --2- 172.21.15.49:0/2412594336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a1c0c6190 0x7f9a1c0b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:09.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.103+0000 7f9a2115e700 1 -- 172.21.15.49:0/2412594336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a1c0c6190 msgr2=0x7f9a1c0b07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:09.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.103+0000 7f9a2115e700 1 --2- 172.21.15.49:0/2412594336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a1c0c6190 0x7f9a1c0b07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:09.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.103+0000 7f9a2115e700 1 -- 172.21.15.49:0/2412594336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a1c098d10 msgr2=0x7f9a1c1647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:09.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.103+0000 7f9a2115e700 1 --2- 172.21.15.49:0/2412594336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a1c098d10 0x7f9a1c1647c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:09.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.103+0000 7f9a2115e700 1 -- 172.21.15.49:0/2412594336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a14009a20 con 0x7f9a1c158a30 2023-11-30T18:23:09.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.103+0000 7f9a1bfff700 1 --2- 172.21.15.49:0/2412594336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a1c0c6190 0x7f9a1c0b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:23:09.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.103+0000 7f9a2095d700 1 --2- 172.21.15.49:0/2412594336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a1c098d10 0x7f9a1c1647c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:23:09.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.103+0000 7f9a2115e700 1 --2- 172.21.15.49:0/2412594336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a1c158a30 0x7f9a1c0c13b0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7f9a1400b6c0 tx=0x7f9a1c0a8040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:09.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.103+0000 7f9a18ff9700 1 -- 172.21.15.49:0/2412594336 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a140116d0 con 0x7f9a1c158a30 2023-11-30T18:23:09.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.103+0000 7f9a18ff9700 1 -- 172.21.15.49:0/2412594336 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a14011830 con 0x7f9a1c158a30 2023-11-30T18:23:09.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.103+0000 7f9a22bc1700 1 -- 172.21.15.49:0/2412594336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a1c0b1050 con 0x7f9a1c158a30 2023-11-30T18:23:09.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.103+0000 7f9a18ff9700 1 -- 172.21.15.49:0/2412594336 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a14011bb0 con 0x7f9a1c158a30 2023-11-30T18:23:09.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.103+0000 7f9a22bc1700 1 -- 172.21.15.49:0/2412594336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a1c0c2730 con 0x7f9a1c158a30 2023-11-30T18:23:09.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.105+0000 7f9a22bc1700 1 -- 172.21.15.49:0/2412594336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a1c06c860 con 0x7f9a1c158a30 2023-11-30T18:23:09.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.106+0000 7f9a18ff9700 1 -- 172.21.15.49:0/2412594336 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f9a14027460 con 0x7f9a1c158a30 2023-11-30T18:23:09.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.106+0000 7f9a18ff9700 1 --2- 172.21.15.49:0/2412594336 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a0805f240 0x7f9a08061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:09.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.106+0000 7f9a18ff9700 1 -- 172.21.15.49:0/2412594336 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5325+0+0 (secure 0 0 0) 0x7f9a1407cc30 con 0x7f9a1c158a30 2023-11-30T18:23:09.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.106+0000 7f9a2095d700 1 --2- 172.21.15.49:0/2412594336 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a0805f240 0x7f9a08061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:09.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.107+0000 7f9a2095d700 1 --2- 172.21.15.49:0/2412594336 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a0805f240 0x7f9a08061700 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9a0c000c00 tx=0x7f9a0c009040).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:09.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.109+0000 7f9a18ff9700 1 -- 172.21.15.49:0/2412594336 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9a1404e100 con 0x7f9a1c158a30 2023-11-30T18:23:09.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.281+0000 7f9a22bc1700 1 -- 172.21.15.49:0/2412594336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9a1c0c69a0 con 0x7f9a1c158a30 2023-11-30T18:23:09.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.281+0000 7f9a18ff9700 1 -- 172.21.15.49:0/2412594336 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v180) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9a14051720 con 0x7f9a1c158a30 2023-11-30T18:23:09.285 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T18:23:09.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.283+0000 7f9a22bc1700 1 -- 172.21.15.49:0/2412594336 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a0805f240 msgr2=0x7f9a08061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:09.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.283+0000 7f9a22bc1700 1 --2- 172.21.15.49:0/2412594336 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a0805f240 0x7f9a08061700 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9a0c000c00 tx=0x7f9a0c009040).stop 2023-11-30T18:23:09.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.283+0000 7f9a22bc1700 1 -- 172.21.15.49:0/2412594336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a1c158a30 msgr2=0x7f9a1c0c13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:09.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.283+0000 7f9a22bc1700 1 --2- 172.21.15.49:0/2412594336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a1c158a30 0x7f9a1c0c13b0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7f9a1400b6c0 tx=0x7f9a1c0a8040).stop 2023-11-30T18:23:09.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.284+0000 7f9a22bc1700 1 -- 172.21.15.49:0/2412594336 shutdown_connections 2023-11-30T18:23:09.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.284+0000 7f9a22bc1700 1 --2- 172.21.15.49:0/2412594336 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f9a0805f240 0x7f9a08061700 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:09.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.284+0000 7f9a22bc1700 1 --2- 172.21.15.49:0/2412594336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a1c158a30 0x7f9a1c0c13b0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:09.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.284+0000 7f9a22bc1700 1 --2- 172.21.15.49:0/2412594336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a1c098d10 0x7f9a1c1647c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:09.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.284+0000 7f9a22bc1700 1 --2- 172.21.15.49:0/2412594336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a1c0c6190 0x7f9a1c0b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:09.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.284+0000 7f9a22bc1700 1 -- 172.21.15.49:0/2412594336 >> 172.21.15.49:0/2412594336 conn(0x7f9a1c0cb310 msgr2=0x7f9a1c0ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:09.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.284+0000 7f9a22bc1700 1 -- 172.21.15.49:0/2412594336 shutdown_connections 2023-11-30T18:23:09.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.284+0000 7f9a22bc1700 1 -- 172.21.15.49:0/2412594336 wait complete. 2023-11-30T18:23:09.296 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T18:23:09.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.416+0000 7fbefbc94700 1 Processor -- start 2023-11-30T18:23:09.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.416+0000 7fbefbc94700 1 -- start start 2023-11-30T18:23:09.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.417+0000 7fbefbc94700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbef4098d10 0x7fbef40c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:09.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.417+0000 7fbefbc94700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbef40c6190 0x7fbef4063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:09.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.417+0000 7fbefbc94700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef40c72d0 con 0x7fbef4064350 2023-11-30T18:23:09.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.417+0000 7fbefbc94700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef4154bc0 con 0x7fbef4098d10 2023-11-30T18:23:09.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.417+0000 7fbefbc94700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef40c66c0 con 0x7fbef40c6190 2023-11-30T18:23:09.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.417+0000 7fbef922f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbef40c6190 0x7fbef4063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:09.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.417+0000 7fbef9a30700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbef4098d10 0x7fbef40c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:09.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.417+0000 7fbef922f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbef40c6190 0x7fbef4063e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:33112/0 (socket says 172.21.15.49:33112) 2023-11-30T18:23:09.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.417+0000 7fbefa231700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fbef4064350 0x7fbef4158320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:49668/0 (socket says 172.21.15.49:49668) 2023-11-30T18:23:09.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.417+0000 7fbef922f700 1 -- 172.21.15.49:0/1717414347 learned_addr learned my addr 172.21.15.49:0/1717414347 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:09.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.417+0000 7fbef9a30700 1 --2- 172.21.15.49:0/1717414347 >> v2:172.21.15.115:3300/0 conn(0x7fbef4098d10 0x7fbef40c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:52226/0 (socket says 172.21.15.49:52226) 2023-11-30T18:23:09.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.418+0000 7fbef9a30700 1 -- 172.21.15.49:0/1717414347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbef40c6190 msgr2=0x7fbef4063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:09.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.418+0000 7fbef9a30700 1 --2- 172.21.15.49:0/1717414347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbef40c6190 0x7fbef4063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:09.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.418+0000 7fbef9a30700 1 -- 172.21.15.49:0/1717414347 >> v1:172.21.15.115:6789/0 conn(0x7fbef4064350 legacy=0x7fbef4158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:09.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.418+0000 7fbef8a2e700 1 -- 172.21.15.49:0/1717414347 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1069992010 0 0) 0x7fbef40c72d0 con 0x7fbef4064350 2023-11-30T18:23:09.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.418+0000 7fbef9a30700 1 -- 172.21.15.49:0/1717414347 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef40c69a0 con 0x7fbef4098d10 2023-11-30T18:23:09.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.418+0000 7fbef922f700 1 --2- 172.21.15.49:0/1717414347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbef40c6190 0x7fbef4063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:23:09.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.418+0000 7fbef9a30700 1 --2- 172.21.15.49:0/1717414347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbef4098d10 0x7fbef40c7760 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7fbef0009760 tx=0x7fbef0009060).ready entity=mon.1 client_cookie=224d035052f58b9b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:09.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.418+0000 7fbef8a2e700 1 -- 172.21.15.49:0/1717414347 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef000f510 con 0x7fbef4098d10 2023-11-30T18:23:09.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.418+0000 7fbef8a2e700 1 -- 172.21.15.49:0/1717414347 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef000f670 con 0x7fbef4098d10 2023-11-30T18:23:09.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.418+0000 7fbef8a2e700 1 -- 172.21.15.49:0/1717414347 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef000f9f0 con 0x7fbef4098d10 2023-11-30T18:23:09.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.418+0000 7fbefbc94700 1 -- 172.21.15.49:0/1717414347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbef4098d10 msgr2=0x7fbef40c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:09.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.418+0000 7fbefbc94700 1 --2- 172.21.15.49:0/1717414347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbef4098d10 0x7fbef40c7760 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7fbef0009760 tx=0x7fbef0009060).stop 2023-11-30T18:23:09.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.418+0000 7fbefbc94700 1 -- 172.21.15.49:0/1717414347 shutdown_connections 2023-11-30T18:23:09.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.418+0000 7fbefbc94700 1 --2- 172.21.15.49:0/1717414347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbef4098d10 0x7fbef40c7760 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:09.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.418+0000 7fbefbc94700 1 --2- 172.21.15.49:0/1717414347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbef40c6190 0x7fbef4063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:09.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.418+0000 7fbefbc94700 1 -- 172.21.15.49:0/1717414347 >> 172.21.15.49:0/1717414347 conn(0x7fbef40cb310 msgr2=0x7fbef40cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:09.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.419+0000 7fbefbc94700 1 -- 172.21.15.49:0/1717414347 shutdown_connections 2023-11-30T18:23:09.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.419+0000 7fbefbc94700 1 -- 172.21.15.49:0/1717414347 wait complete. 2023-11-30T18:23:09.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.420+0000 7fbefbc94700 1 Processor -- start 2023-11-30T18:23:09.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.420+0000 7fbefbc94700 1 -- start start 2023-11-30T18:23:09.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.420+0000 7fbefbc94700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbef4064350 0x7fbef40b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:09.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.420+0000 7fbefbc94700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbef4098d10 0x7fbef40c4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:09.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.420+0000 7fbefbc94700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbef40c6190 0x7fbef4164a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:09.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.420+0000 7fbefbc94700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef40c5380 con 0x7fbef40c6190 2023-11-30T18:23:09.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.420+0000 7fbefbc94700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef414f9a0 con 0x7fbef4064350 2023-11-30T18:23:09.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.420+0000 7fbefbc94700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef40c4a50 con 0x7fbef4098d10 2023-11-30T18:23:09.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.421+0000 7fbefa231700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbef40c6190 0x7fbef4164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:09.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.421+0000 7fbefa231700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbef40c6190 0x7fbef4164a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45060/0 (socket says 172.21.15.49:45060) 2023-11-30T18:23:09.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.421+0000 7fbefa231700 1 -- 172.21.15.49:0/3036206682 learned_addr learned my addr 172.21.15.49:0/3036206682 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:09.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.421+0000 7fbef9a30700 1 --2- 172.21.15.49:0/3036206682 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbef4064350 0x7fbef40b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:09.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.421+0000 7fbef922f700 1 --2- 172.21.15.49:0/3036206682 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbef4098d10 0x7fbef40c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:09.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.421+0000 7fbefa231700 1 -- 172.21.15.49:0/3036206682 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbef4098d10 msgr2=0x7fbef40c4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:09.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.421+0000 7fbefa231700 1 --2- 172.21.15.49:0/3036206682 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbef4098d10 0x7fbef40c4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:09.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.421+0000 7fbefa231700 1 -- 172.21.15.49:0/3036206682 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbef4064350 msgr2=0x7fbef40b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:09.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.421+0000 7fbefa231700 1 --2- 172.21.15.49:0/3036206682 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbef4064350 0x7fbef40b0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:09.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.421+0000 7fbefa231700 1 -- 172.21.15.49:0/3036206682 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee4009370 con 0x7fbef40c6190 2023-11-30T18:23:09.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.421+0000 7fbef9a30700 1 --2- 172.21.15.49:0/3036206682 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbef4064350 0x7fbef40b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:23:09.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.421+0000 7fbefa231700 1 --2- 172.21.15.49:0/3036206682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbef40c6190 0x7fbef4164a20 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7fbeec00c810 tx=0x7fbeec007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:09.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.421+0000 7fbee9ffb700 1 -- 172.21.15.49:0/3036206682 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec005c70 con 0x7fbef40c6190 2023-11-30T18:23:09.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.421+0000 7fbee9ffb700 1 -- 172.21.15.49:0/3036206682 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeec005df0 con 0x7fbef40c6190 2023-11-30T18:23:09.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.421+0000 7fbefbc94700 1 -- 172.21.15.49:0/3036206682 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef00092a0 con 0x7fbef40c6190 2023-11-30T18:23:09.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.421+0000 7fbee9ffb700 1 -- 172.21.15.49:0/3036206682 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec007360 con 0x7fbef40c6190 2023-11-30T18:23:09.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.422+0000 7fbefbc94700 1 -- 172.21.15.49:0/3036206682 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef40c5010 con 0x7fbef40c6190 2023-11-30T18:23:09.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.422+0000 7fbefbc94700 1 -- 172.21.15.49:0/3036206682 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef40c5530 con 0x7fbef40c6190 2023-11-30T18:23:09.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.423+0000 7fbee9ffb700 1 -- 172.21.15.49:0/3036206682 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fbeec007750 con 0x7fbef40c6190 2023-11-30T18:23:09.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.423+0000 7fbee9ffb700 1 --2- 172.21.15.49:0/3036206682 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbed805f270 0x7fbed8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:09.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.423+0000 7fbee9ffb700 1 -- 172.21.15.49:0/3036206682 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5325+0+0 (secure 0 0 0) 0x7fbeec07a0c0 con 0x7fbef40c6190 2023-11-30T18:23:09.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.423+0000 7fbef9a30700 1 --2- 172.21.15.49:0/3036206682 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbed805f270 0x7fbed8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:09.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.424+0000 7fbef9a30700 1 --2- 172.21.15.49:0/3036206682 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbed805f270 0x7fbed8061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fbef0009fd0 tx=0x7fbef0017000).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:09.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.427+0000 7fbee9ffb700 1 -- 172.21.15.49:0/3036206682 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbef40c5530 con 0x7fbef40c6190 2023-11-30T18:23:09.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.598+0000 7fbefbc94700 1 -- 172.21.15.49:0/3036206682 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbef40c5530 con 0x7fbef40c6190 2023-11-30T18:23:09.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.599+0000 7fbee9ffb700 1 -- 172.21.15.49:0/3036206682 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v180) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbef40c5530 con 0x7fbef40c6190 2023-11-30T18:23:09.600 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T18:23:09.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.600+0000 7fbefbc94700 1 -- 172.21.15.49:0/3036206682 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbed805f270 msgr2=0x7fbed8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:09.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.600+0000 7fbefbc94700 1 --2- 172.21.15.49:0/3036206682 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbed805f270 0x7fbed8061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fbef0009fd0 tx=0x7fbef0017000).stop 2023-11-30T18:23:09.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.600+0000 7fbefbc94700 1 -- 172.21.15.49:0/3036206682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbef40c6190 msgr2=0x7fbef4164a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:09.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.600+0000 7fbefbc94700 1 --2- 172.21.15.49:0/3036206682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbef40c6190 0x7fbef4164a20 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7fbeec00c810 tx=0x7fbeec007f10).stop 2023-11-30T18:23:09.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.601+0000 7fbefbc94700 1 -- 172.21.15.49:0/3036206682 shutdown_connections 2023-11-30T18:23:09.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.601+0000 7fbefbc94700 1 --2- 172.21.15.49:0/3036206682 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fbed805f270 0x7fbed8061730 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:09.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.601+0000 7fbefbc94700 1 --2- 172.21.15.49:0/3036206682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbef40c6190 0x7fbef4164a20 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:09.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.601+0000 7fbefbc94700 1 --2- 172.21.15.49:0/3036206682 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbef4064350 0x7fbef40b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:09.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.601+0000 7fbefbc94700 1 --2- 172.21.15.49:0/3036206682 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbef4098d10 0x7fbef40c4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:09.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.601+0000 7fbefbc94700 1 -- 172.21.15.49:0/3036206682 >> 172.21.15.49:0/3036206682 conn(0x7fbef40cb310 msgr2=0x7fbef40ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:09.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.601+0000 7fbefbc94700 1 -- 172.21.15.49:0/3036206682 shutdown_connections 2023-11-30T18:23:09.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.601+0000 7fbefbc94700 1 -- 172.21.15.49:0/3036206682 wait complete. 2023-11-30T18:23:09.613 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-30T18:23:09.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.730+0000 7fc3bd486700 1 Processor -- start 2023-11-30T18:23:09.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.730+0000 7fc3bd486700 1 -- start start 2023-11-30T18:23:09.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.731+0000 7fc3bd486700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc3b8066e00 0x7fc3b80671e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:09.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.731+0000 7fc3bd486700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc3b8155e40 0x7fc3b80a5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:09.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.731+0000 7fc3bd486700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3b80bd590 con 0x7fc3b80a5e70 2023-11-30T18:23:09.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.731+0000 7fc3bd486700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b8156370 con 0x7fc3b8155e40 2023-11-30T18:23:09.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.731+0000 7fc3bd486700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b8156650 con 0x7fc3b8066e00 2023-11-30T18:23:09.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.731+0000 7fc3b67fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc3b8155e40 0x7fc3b80a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:09.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.731+0000 7fc3b77fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc3b80a5e70 0x7fc3b8067980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42992/0 (socket says 172.21.15.49:42992) 2023-11-30T18:23:09.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.731+0000 7fc3b67fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc3b8155e40 0x7fc3b80a5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45064/0 (socket says 172.21.15.49:45064) 2023-11-30T18:23:09.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.731+0000 7fc3b77fe700 1 -- 172.21.15.49:0/2787011061 learned_addr learned my addr 172.21.15.49:0/2787011061 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:23:09.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.731+0000 7fc3b6ffd700 1 --2- 172.21.15.49:0/2787011061 >> v2:172.21.15.115:3300/0 conn(0x7fc3b8066e00 0x7fc3b80671e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:09.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.732+0000 7fc3b67fc700 1 -- 172.21.15.49:0/2787011061 >> v2:172.21.15.115:3300/0 conn(0x7fc3b8066e00 msgr2=0x7fc3b80671e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:09.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.732+0000 7fc3b67fc700 1 --2- 172.21.15.49:0/2787011061 >> v2:172.21.15.115:3300/0 conn(0x7fc3b8066e00 0x7fc3b80671e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:09.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.732+0000 7fc3b5ffb700 1 -- 172.21.15.49:0/2787011061 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105882915 0 0) 0x7fc3b80bd590 con 0x7fc3b80a5e70 2023-11-30T18:23:09.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.732+0000 7fc3b67fc700 1 -- 172.21.15.49:0/2787011061 >> v1:172.21.15.49:6789/0 conn(0x7fc3b80a5e70 legacy=0x7fc3b8067980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:09.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.732+0000 7fc3b67fc700 1 -- 172.21.15.49:0/2787011061 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b8156930 con 0x7fc3b8155e40 2023-11-30T18:23:09.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.732+0000 7fc3b67fc700 1 --2- 172.21.15.49:0/2787011061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3b8155e40 0x7fc3b80a5980 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7fc3b806a8b0 tx=0x7fc3a0009060).ready entity=mon.0 client_cookie=e299169dd6d96d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:09.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.732+0000 7fc3b5ffb700 1 -- 172.21.15.49:0/2787011061 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a000f510 con 0x7fc3b8155e40 2023-11-30T18:23:09.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.732+0000 7fc3b5ffb700 1 -- 172.21.15.49:0/2787011061 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a000f670 con 0x7fc3b8155e40 2023-11-30T18:23:09.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.732+0000 7fc3b5ffb700 1 -- 172.21.15.49:0/2787011061 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a000f9f0 con 0x7fc3b8155e40 2023-11-30T18:23:09.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.732+0000 7fc3bd486700 1 -- 172.21.15.49:0/2787011061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3b8155e40 msgr2=0x7fc3b80a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:09.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.732+0000 7fc3bd486700 1 --2- 172.21.15.49:0/2787011061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3b8155e40 0x7fc3b80a5980 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7fc3b806a8b0 tx=0x7fc3a0009060).stop 2023-11-30T18:23:09.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.732+0000 7fc3bd486700 1 -- 172.21.15.49:0/2787011061 shutdown_connections 2023-11-30T18:23:09.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.732+0000 7fc3bd486700 1 --2- 172.21.15.49:0/2787011061 >> v2:172.21.15.115:3300/0 conn(0x7fc3b8066e00 0x7fc3b80671e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:09.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.732+0000 7fc3bd486700 1 --2- 172.21.15.49:0/2787011061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3b8155e40 0x7fc3b80a5980 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:09.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.732+0000 7fc3bd486700 1 -- 172.21.15.49:0/2787011061 >> 172.21.15.49:0/2787011061 conn(0x7fc3b80c7fd0 msgr2=0x7fc3b80c83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:09.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.733+0000 7fc3bd486700 1 -- 172.21.15.49:0/2787011061 shutdown_connections 2023-11-30T18:23:09.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.733+0000 7fc3bd486700 1 -- 172.21.15.49:0/2787011061 wait complete. 2023-11-30T18:23:09.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.734+0000 7fc3bd486700 1 Processor -- start 2023-11-30T18:23:09.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.734+0000 7fc3bd486700 1 -- start start 2023-11-30T18:23:09.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.734+0000 7fc3bd486700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3b8066e00 0x7fc3b814de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:09.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.735+0000 7fc3bd486700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3b8155e40 0x7fc3b81535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:09.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.735+0000 7fc3bd486700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc3b8153a90 0x7fc3b80c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:09.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.735+0000 7fc3bd486700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b80ab200 con 0x7fc3b8155e40 2023-11-30T18:23:09.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.735+0000 7fc3bd486700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b814e370 con 0x7fc3b8066e00 2023-11-30T18:23:09.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.735+0000 7fc3bd486700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b8153110 con 0x7fc3b8153a90 2023-11-30T18:23:09.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.735+0000 7fc3b67fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3b8155e40 0x7fc3b81535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:09.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.735+0000 7fc3b67fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3b8155e40 0x7fc3b81535a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45066/0 (socket says 172.21.15.49:45066) 2023-11-30T18:23:09.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.735+0000 7fc3b67fc700 1 -- 172.21.15.49:0/3046826497 learned_addr learned my addr 172.21.15.49:0/3046826497 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:09.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.735+0000 7fc3b6ffd700 1 --2- 172.21.15.49:0/3046826497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3b8066e00 0x7fc3b814de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:09.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.735+0000 7fc3b77fe700 1 --2- 172.21.15.49:0/3046826497 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc3b8153a90 0x7fc3b80c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:09.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.735+0000 7fc3b67fc700 1 -- 172.21.15.49:0/3046826497 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc3b8153a90 msgr2=0x7fc3b80c83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:09.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.735+0000 7fc3b67fc700 1 --2- 172.21.15.49:0/3046826497 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc3b8153a90 0x7fc3b80c83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:09.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.735+0000 7fc3b67fc700 1 -- 172.21.15.49:0/3046826497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3b8066e00 msgr2=0x7fc3b814de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:09.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.735+0000 7fc3b67fc700 1 --2- 172.21.15.49:0/3046826497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3b8066e00 0x7fc3b814de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:09.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.735+0000 7fc3b67fc700 1 -- 172.21.15.49:0/3046826497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a00092a0 con 0x7fc3b8155e40 2023-11-30T18:23:09.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.735+0000 7fc3b67fc700 1 --2- 172.21.15.49:0/3046826497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3b8155e40 0x7fc3b81535a0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7fc3a0009dd0 tx=0x7fc3a0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:09.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.735+0000 7fc3aeffd700 1 -- 172.21.15.49:0/3046826497 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a000f7e0 con 0x7fc3b8155e40 2023-11-30T18:23:09.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.735+0000 7fc3aeffd700 1 -- 172.21.15.49:0/3046826497 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a000f940 con 0x7fc3b8155e40 2023-11-30T18:23:09.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.735+0000 7fc3bd486700 1 -- 172.21.15.49:0/3046826497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b81657e0 con 0x7fc3b8155e40 2023-11-30T18:23:09.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.735+0000 7fc3aeffd700 1 -- 172.21.15.49:0/3046826497 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a001b620 con 0x7fc3b8155e40 2023-11-30T18:23:09.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.735+0000 7fc3bd486700 1 -- 172.21.15.49:0/3046826497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b8152da0 con 0x7fc3b8155e40 2023-11-30T18:23:09.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.736+0000 7fc3bd486700 1 -- 172.21.15.49:0/3046826497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b8152920 con 0x7fc3b8155e40 2023-11-30T18:23:09.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.737+0000 7fc3aeffd700 1 -- 172.21.15.49:0/3046826497 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc3a001b9d0 con 0x7fc3b8155e40 2023-11-30T18:23:09.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.737+0000 7fc3aeffd700 1 --2- 172.21.15.49:0/3046826497 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc39805f270 0x7fc398061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:09.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.737+0000 7fc3aeffd700 1 -- 172.21.15.49:0/3046826497 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5325+0+0 (secure 0 0 0) 0x7fc3a007b750 con 0x7fc3b8155e40 2023-11-30T18:23:09.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.737+0000 7fc3b6ffd700 1 --2- 172.21.15.49:0/3046826497 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc39805f270 0x7fc398061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:09.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.738+0000 7fc3b6ffd700 1 --2- 172.21.15.49:0/3046826497 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc39805f270 0x7fc398061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fc3b0009c30 tx=0x7fc3b0009060).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:09.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.741+0000 7fc3aeffd700 1 -- 172.21.15.49:0/3046826497 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc3b8152920 con 0x7fc3b8155e40 2023-11-30T18:23:09.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.914+0000 7fc3bd486700 1 -- 172.21.15.49:0/3046826497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc3b8152920 con 0x7fc3b8155e40 2023-11-30T18:23:09.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.914+0000 7fc3aeffd700 1 -- 172.21.15.49:0/3046826497 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v180) v1 ==== 84+0+143 (secure 0 0 0) 0x7fc3b8152920 con 0x7fc3b8155e40 2023-11-30T18:23:09.915 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:23:09.915 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-11-30T18:23:09.915 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:23:09.915 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2023-11-30T18:23:09.915 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "device_health_metrics" 2023-11-30T18:23:09.916 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:23:09.916 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:23:09.916 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 2, 2023-11-30T18:23:09.916 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "rbd" 2023-11-30T18:23:09.916 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:23:09.916 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-11-30T18:23:09.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.916+0000 7fc3bd486700 1 -- 172.21.15.49:0/3046826497 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc39805f270 msgr2=0x7fc398061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:09.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.916+0000 7fc3bd486700 1 --2- 172.21.15.49:0/3046826497 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc39805f270 0x7fc398061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fc3b0009c30 tx=0x7fc3b0009060).stop 2023-11-30T18:23:09.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.916+0000 7fc3bd486700 1 -- 172.21.15.49:0/3046826497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3b8155e40 msgr2=0x7fc3b81535a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:09.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.916+0000 7fc3bd486700 1 --2- 172.21.15.49:0/3046826497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3b8155e40 0x7fc3b81535a0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7fc3a0009dd0 tx=0x7fc3a0017000).stop 2023-11-30T18:23:09.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.916+0000 7fc3bd486700 1 -- 172.21.15.49:0/3046826497 shutdown_connections 2023-11-30T18:23:09.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.916+0000 7fc3bd486700 1 --2- 172.21.15.49:0/3046826497 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc3b8153a90 0x7fc3b80c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:09.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.916+0000 7fc3bd486700 1 --2- 172.21.15.49:0/3046826497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3b8066e00 0x7fc3b814de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:09.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.916+0000 7fc3bd486700 1 --2- 172.21.15.49:0/3046826497 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc39805f270 0x7fc398061730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:09.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.916+0000 7fc3bd486700 1 --2- 172.21.15.49:0/3046826497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3b8155e40 0x7fc3b81535a0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:09.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.916+0000 7fc3bd486700 1 -- 172.21.15.49:0/3046826497 >> 172.21.15.49:0/3046826497 conn(0x7fc3b80c7fd0 msgr2=0x7fc3b8150f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:09.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.916+0000 7fc3bd486700 1 -- 172.21.15.49:0/3046826497 shutdown_connections 2023-11-30T18:23:09.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:09.916+0000 7fc3bd486700 1 -- 172.21.15.49:0/3046826497 wait complete. 2023-11-30T18:23:09.929 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-30T18:23:09.929 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-11-30T18:23:10.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.051+0000 7f4d068ed700 1 Processor -- start 2023-11-30T18:23:10.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.051+0000 7f4d068ed700 1 -- start start 2023-11-30T18:23:10.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.052+0000 7f4d068ed700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4d00154530 0x7f4d00154910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:10.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.052+0000 7f4d068ed700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d000aa220 0x7f4d000aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:10.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.052+0000 7f4d068ed700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d000c6630 con 0x7f4d000a7ff0 2023-11-30T18:23:10.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.052+0000 7f4d068ed700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d000c6390 con 0x7f4d00154530 2023-11-30T18:23:10.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.052+0000 7f4d068ed700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d000aaba0 con 0x7f4d000aa220 2023-11-30T18:23:10.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.052+0000 7f4cff7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4d000a7ff0 0x7f4d000c8580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42996/0 (socket says 172.21.15.49:42996) 2023-11-30T18:23:10.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.052+0000 7f4cff7fe700 1 -- 172.21.15.49:0/1133073340 learned_addr learned my addr 172.21.15.49:0/1133073340 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:23:10.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.052+0000 7f4d04e8a700 1 --2- 172.21.15.49:0/1133073340 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d000aa220 0x7f4d000aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:10.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.052+0000 7f4cfffff700 1 --2- 172.21.15.49:0/1133073340 >> v2:172.21.15.115:3300/0 conn(0x7f4d00154530 0x7f4d00154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:10.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.052+0000 7f4cfeffd700 1 -- 172.21.15.49:0/1133073340 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2009916072 0 0) 0x7f4d000c6630 con 0x7f4d000a7ff0 2023-11-30T18:23:10.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.052+0000 7f4cfeffd700 1 -- 172.21.15.49:0/1133073340 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ce80033f0 con 0x7f4d000a7ff0 2023-11-30T18:23:10.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.053+0000 7f4cfeffd700 1 -- 172.21.15.49:0/1133073340 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1141134810 0 0) 0x7f4ce80033f0 con 0x7f4d000a7ff0 2023-11-30T18:23:10.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.053+0000 7f4d04e8a700 1 -- 172.21.15.49:0/1133073340 >> v2:172.21.15.115:3300/0 conn(0x7f4d00154530 msgr2=0x7f4d00154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:10.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.053+0000 7f4d04e8a700 1 --2- 172.21.15.49:0/1133073340 >> v2:172.21.15.115:3300/0 conn(0x7f4d00154530 0x7f4d00154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:10.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.053+0000 7f4d04e8a700 1 -- 172.21.15.49:0/1133073340 >> v1:172.21.15.49:6789/0 conn(0x7f4d000a7ff0 legacy=0x7f4d000c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:10.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.053+0000 7f4d04e8a700 1 -- 172.21.15.49:0/1133073340 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d000a8470 con 0x7f4d000aa220 2023-11-30T18:23:10.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.053+0000 7f4d04e8a700 1 --2- 172.21.15.49:0/1133073340 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d000aa220 0x7f4d000aa6b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f4cf8009e60 tx=0x7f4cf8009780).ready entity=mon.2 client_cookie=703721a52628e40b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:10.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.053+0000 7f4cfeffd700 1 -- 172.21.15.49:0/1133073340 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf800e070 con 0x7f4d000aa220 2023-11-30T18:23:10.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.053+0000 7f4cfeffd700 1 -- 172.21.15.49:0/1133073340 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf800b7a0 con 0x7f4d000aa220 2023-11-30T18:23:10.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.053+0000 7f4cfeffd700 1 -- 172.21.15.49:0/1133073340 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4001470 con 0x7f4d000aa220 2023-11-30T18:23:10.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.053+0000 7f4d068ed700 1 -- 172.21.15.49:0/1133073340 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d000aa220 msgr2=0x7f4d000aa6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:10.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.053+0000 7f4d068ed700 1 --2- 172.21.15.49:0/1133073340 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d000aa220 0x7f4d000aa6b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f4cf8009e60 tx=0x7f4cf8009780).stop 2023-11-30T18:23:10.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.053+0000 7f4d068ed700 1 -- 172.21.15.49:0/1133073340 shutdown_connections 2023-11-30T18:23:10.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.053+0000 7f4d068ed700 1 --2- 172.21.15.49:0/1133073340 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d000aa220 0x7f4d000aa6b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:10.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.053+0000 7f4d068ed700 1 --2- 172.21.15.49:0/1133073340 >> v2:172.21.15.115:3300/0 conn(0x7f4d00154530 0x7f4d00154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:10.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.053+0000 7f4d068ed700 1 -- 172.21.15.49:0/1133073340 >> 172.21.15.49:0/1133073340 conn(0x7f4d00094930 msgr2=0x7f4d0006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:10.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.053+0000 7f4d068ed700 1 -- 172.21.15.49:0/1133073340 shutdown_connections 2023-11-30T18:23:10.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.053+0000 7f4d068ed700 1 -- 172.21.15.49:0/1133073340 wait complete. 2023-11-30T18:23:10.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.055+0000 7f4d068ed700 1 Processor -- start 2023-11-30T18:23:10.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.055+0000 7f4d068ed700 1 -- start start 2023-11-30T18:23:10.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.055+0000 7f4d068ed700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d000a7ff0 0x7f4d000ad0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:10.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.055+0000 7f4d068ed700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d000aa220 0x7f4d000ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:10.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.055+0000 7f4d068ed700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d00154530 0x7f4d0014f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:10.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.055+0000 7f4d068ed700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d000ae720 con 0x7f4d000a7ff0 2023-11-30T18:23:10.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.056+0000 7f4d068ed700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d000af1d0 con 0x7f4d00154530 2023-11-30T18:23:10.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.056+0000 7f4d068ed700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0014f650 con 0x7f4d000aa220 2023-11-30T18:23:10.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.056+0000 7f4cfffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d000a7ff0 0x7f4d000ad0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:10.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.056+0000 7f4cfffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d000a7ff0 0x7f4d000ad0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45074/0 (socket says 172.21.15.49:45074) 2023-11-30T18:23:10.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.056+0000 7f4cfffff700 1 -- 172.21.15.49:0/3977279683 learned_addr learned my addr 172.21.15.49:0/3977279683 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:10.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.056+0000 7f4cff7fe700 1 --2- 172.21.15.49:0/3977279683 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d000aa220 0x7f4d000ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:10.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.056+0000 7f4d04e8a700 1 --2- 172.21.15.49:0/3977279683 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d00154530 0x7f4d0014f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:10.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.056+0000 7f4cfffff700 1 -- 172.21.15.49:0/3977279683 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d000aa220 msgr2=0x7f4d000ae230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:10.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.056+0000 7f4cfffff700 1 --2- 172.21.15.49:0/3977279683 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d000aa220 0x7f4d000ae230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:10.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.056+0000 7f4cfffff700 1 -- 172.21.15.49:0/3977279683 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d00154530 msgr2=0x7f4d0014f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:10.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.056+0000 7f4cfffff700 1 --2- 172.21.15.49:0/3977279683 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d00154530 0x7f4d0014f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:10.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.056+0000 7f4cfffff700 1 -- 172.21.15.49:0/3977279683 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf8009a20 con 0x7f4d000a7ff0 2023-11-30T18:23:10.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.056+0000 7f4cfffff700 1 --2- 172.21.15.49:0/3977279683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d000a7ff0 0x7f4d000ad0e0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f4cf000e900 tx=0x7f4cf0006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:10.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.056+0000 7f4ce7fff700 1 -- 172.21.15.49:0/3977279683 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf00093b0 con 0x7f4d000a7ff0 2023-11-30T18:23:10.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.056+0000 7f4ce7fff700 1 -- 172.21.15.49:0/3977279683 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf000c640 con 0x7f4d000a7ff0 2023-11-30T18:23:10.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.056+0000 7f4d068ed700 1 -- 172.21.15.49:0/3977279683 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d000ae930 con 0x7f4d000a7ff0 2023-11-30T18:23:10.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.056+0000 7f4ce7fff700 1 -- 172.21.15.49:0/3977279683 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf000c9c0 con 0x7f4d000a7ff0 2023-11-30T18:23:10.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.056+0000 7f4d068ed700 1 -- 172.21.15.49:0/3977279683 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d000aeef0 con 0x7f4d000a7ff0 2023-11-30T18:23:10.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.057+0000 7f4d068ed700 1 -- 172.21.15.49:0/3977279683 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d000ab1e0 con 0x7f4d000a7ff0 2023-11-30T18:23:10.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.058+0000 7f4ce7fff700 1 -- 172.21.15.49:0/3977279683 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4cf000cd30 con 0x7f4d000a7ff0 2023-11-30T18:23:10.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.058+0000 7f4ce7fff700 1 --2- 172.21.15.49:0/3977279683 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4cec05f270 0x7f4cec061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:10.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.058+0000 7f4ce7fff700 1 -- 172.21.15.49:0/3977279683 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5325+0+0 (secure 0 0 0) 0x7f4cf007a3d0 con 0x7f4d000a7ff0 2023-11-30T18:23:10.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.058+0000 7f4cff7fe700 1 --2- 172.21.15.49:0/3977279683 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4cec05f270 0x7f4cec061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:10.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.059+0000 7f4cff7fe700 1 --2- 172.21.15.49:0/3977279683 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4cec05f270 0x7f4cec061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f4cf4001620 tx=0x7f4cf4009040).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:10.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.062+0000 7f4ce7fff700 1 -- 172.21.15.49:0/3977279683 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4cf004b840 con 0x7f4d000a7ff0 2023-11-30T18:23:10.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.235+0000 7f4d068ed700 1 -- 172.21.15.49:0/3977279683 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f4d0006c860 con 0x7f4d000a7ff0 2023-11-30T18:23:10.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.704+0000 7f4ce7fff700 1 -- 172.21.15.49:0/3977279683 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v181) v1 ==== 152+0+0 (secure 0 0 0) 0x7f4cf00160c0 con 0x7f4d000a7ff0 2023-11-30T18:23:10.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.708+0000 7f4d068ed700 1 -- 172.21.15.49:0/3977279683 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4cec05f270 msgr2=0x7f4cec061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:10.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.708+0000 7f4d068ed700 1 --2- 172.21.15.49:0/3977279683 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4cec05f270 0x7f4cec061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f4cf4001620 tx=0x7f4cf4009040).stop 2023-11-30T18:23:10.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.708+0000 7f4d068ed700 1 -- 172.21.15.49:0/3977279683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d000a7ff0 msgr2=0x7f4d000ad0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:10.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.708+0000 7f4d068ed700 1 --2- 172.21.15.49:0/3977279683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d000a7ff0 0x7f4d000ad0e0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f4cf000e900 tx=0x7f4cf0006f40).stop 2023-11-30T18:23:10.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.708+0000 7f4d068ed700 1 -- 172.21.15.49:0/3977279683 shutdown_connections 2023-11-30T18:23:10.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.708+0000 7f4d068ed700 1 --2- 172.21.15.49:0/3977279683 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d00154530 0x7f4d0014f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:10.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.708+0000 7f4d068ed700 1 --2- 172.21.15.49:0/3977279683 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4cec05f270 0x7f4cec061730 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:10.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.708+0000 7f4d068ed700 1 --2- 172.21.15.49:0/3977279683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d000a7ff0 0x7f4d000ad0e0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:10.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.708+0000 7f4d068ed700 1 --2- 172.21.15.49:0/3977279683 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d000aa220 0x7f4d000ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:10.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.708+0000 7f4d068ed700 1 -- 172.21.15.49:0/3977279683 >> 172.21.15.49:0/3977279683 conn(0x7f4d00094930 msgr2=0x7f4d000c01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:10.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.708+0000 7f4d068ed700 1 -- 172.21.15.49:0/3977279683 shutdown_connections 2023-11-30T18:23:10.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.708+0000 7f4d068ed700 1 -- 172.21.15.49:0/3977279683 wait complete. 2023-11-30T18:23:10.713 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2023-11-30T18:23:10.727 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-30T18:23:10.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.852+0000 7f6664399700 1 Processor -- start 2023-11-30T18:23:10.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.852+0000 7f6664399700 1 -- start start 2023-11-30T18:23:10.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.853+0000 7f6664399700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f665c0c65d0 0x7f665c155c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:10.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.853+0000 7f6664399700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f665c1529c0 con 0x7f665c0c3090 2023-11-30T18:23:10.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.853+0000 7f6664399700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f665c151db0 con 0x7f665c155830 2023-11-30T18:23:10.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.853+0000 7f6664399700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f665c152090 con 0x7f665c0c65d0 2023-11-30T18:23:10.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.853+0000 7f6662936700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f665c0c65d0 0x7f665c155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:10.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.853+0000 7f6662936700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f665c0c65d0 0x7f665c155c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45860/0 (socket says 172.21.15.49:45860) 2023-11-30T18:23:10.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.853+0000 7f6662936700 1 -- 172.21.15.49:0/3031518745 learned_addr learned my addr 172.21.15.49:0/3031518745 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:10.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.853+0000 7f6661934700 1 --1- 172.21.15.49:0/3031518745 >> v1:172.21.15.49:6789/0 conn(0x7f665c0c3090 0x7f665c0c5ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39030/0 (socket says 172.21.15.49:39030) 2023-11-30T18:23:10.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.853+0000 7f6662936700 1 -- 172.21.15.49:0/3031518745 >> v1:172.21.15.115:6789/0 conn(0x7f665c155830 legacy=0x7f665c0c2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:10.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.853+0000 7f6662936700 1 -- 172.21.15.49:0/3031518745 >> v1:172.21.15.49:6789/0 conn(0x7f665c0c3090 legacy=0x7f665c0c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:10.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.853+0000 7f6661133700 1 -- 172.21.15.49:0/3031518745 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1131812786 0 0) 0x7f665c1529c0 con 0x7f665c0c3090 2023-11-30T18:23:10.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.853+0000 7f6662936700 1 -- 172.21.15.49:0/3031518745 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665c152370 con 0x7f665c0c65d0 2023-11-30T18:23:10.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.854+0000 7f6662936700 1 --2- 172.21.15.49:0/3031518745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f665c0c65d0 0x7f665c155c10 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7f664c009f20 tx=0x7f664c009840).ready entity=mon.0 client_cookie=df48e749d9712eea server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:10.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.854+0000 7f6661133700 1 -- 172.21.15.49:0/3031518745 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664c00e070 con 0x7f665c0c65d0 2023-11-30T18:23:10.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.854+0000 7f6661133700 1 -- 172.21.15.49:0/3031518745 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664c00ba80 con 0x7f665c0c65d0 2023-11-30T18:23:10.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.854+0000 7f6661133700 1 -- 172.21.15.49:0/3031518745 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664c00be00 con 0x7f665c0c65d0 2023-11-30T18:23:10.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.854+0000 7f6664399700 1 -- 172.21.15.49:0/3031518745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f665c0c65d0 msgr2=0x7f665c155c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:10.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.854+0000 7f6664399700 1 --2- 172.21.15.49:0/3031518745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f665c0c65d0 0x7f665c155c10 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7f664c009f20 tx=0x7f664c009840).stop 2023-11-30T18:23:10.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.854+0000 7f6664399700 1 -- 172.21.15.49:0/3031518745 shutdown_connections 2023-11-30T18:23:10.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.854+0000 7f6664399700 1 --2- 172.21.15.49:0/3031518745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f665c0c65d0 0x7f665c155c10 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:10.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.854+0000 7f6664399700 1 -- 172.21.15.49:0/3031518745 >> 172.21.15.49:0/3031518745 conn(0x7f665c062700 msgr2=0x7f665c062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:10.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.854+0000 7f6664399700 1 -- 172.21.15.49:0/3031518745 shutdown_connections 2023-11-30T18:23:10.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.854+0000 7f6664399700 1 -- 172.21.15.49:0/3031518745 wait complete. 2023-11-30T18:23:10.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.855+0000 7f6664399700 1 Processor -- start 2023-11-30T18:23:10.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.856+0000 7f6664399700 1 -- start start 2023-11-30T18:23:10.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.856+0000 7f6664399700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f665c0c3090 0x7f665c1545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:10.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.856+0000 7f6664399700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f665c0c65d0 0x7f665c0ab570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:10.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.856+0000 7f6664399700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f665c155830 0x7f665c1608a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:10.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.856+0000 7f6664399700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665c0ace80 con 0x7f665c155830 2023-11-30T18:23:10.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.856+0000 7f6664399700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665c0ac9f0 con 0x7f665c0c3090 2023-11-30T18:23:10.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.856+0000 7f6664399700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665c154a90 con 0x7f665c0c65d0 2023-11-30T18:23:10.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.856+0000 7f6662936700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f665c155830 0x7f665c1608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:10.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.856+0000 7f6662936700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f665c155830 0x7f665c1608a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45868/0 (socket says 172.21.15.49:45868) 2023-11-30T18:23:10.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.856+0000 7f6662936700 1 -- 172.21.15.49:0/1646627160 learned_addr learned my addr 172.21.15.49:0/1646627160 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:10.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.856+0000 7f6661934700 1 --2- 172.21.15.49:0/1646627160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f665c0c65d0 0x7f665c0ab570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:10.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.856+0000 7f6662135700 1 --2- 172.21.15.49:0/1646627160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f665c0c3090 0x7f665c1545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:10.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.857+0000 7f6662936700 1 -- 172.21.15.49:0/1646627160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f665c0c65d0 msgr2=0x7f665c0ab570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:10.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.857+0000 7f6662936700 1 --2- 172.21.15.49:0/1646627160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f665c0c65d0 0x7f665c0ab570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:10.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.857+0000 7f6662936700 1 -- 172.21.15.49:0/1646627160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f665c0c3090 msgr2=0x7f665c1545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:10.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.857+0000 7f6662936700 1 --2- 172.21.15.49:0/1646627160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f665c0c3090 0x7f665c1545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:10.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.857+0000 7f6662936700 1 -- 172.21.15.49:0/1646627160 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f664c009ae0 con 0x7f665c155830 2023-11-30T18:23:10.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.857+0000 7f6662135700 1 --2- 172.21.15.49:0/1646627160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f665c0c3090 0x7f665c1545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:23:10.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.857+0000 7f6661934700 1 --2- 172.21.15.49:0/1646627160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f665c0c65d0 0x7f665c0ab570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:23:10.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.857+0000 7f6662936700 1 --2- 172.21.15.49:0/1646627160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f665c155830 0x7f665c1608a0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7f665c0677f0 tx=0x7f664c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:10.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.857+0000 7f665a7fc700 1 -- 172.21.15.49:0/1646627160 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664c0092e0 con 0x7f665c155830 2023-11-30T18:23:10.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.857+0000 7f665a7fc700 1 -- 172.21.15.49:0/1646627160 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664c01e470 con 0x7f665c155830 2023-11-30T18:23:10.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.857+0000 7f665a7fc700 1 -- 172.21.15.49:0/1646627160 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664c01e810 con 0x7f665c155830 2023-11-30T18:23:10.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.857+0000 7f6664399700 1 -- 172.21.15.49:0/1646627160 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f665c0abde0 con 0x7f665c155830 2023-11-30T18:23:10.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.857+0000 7f6664399700 1 -- 172.21.15.49:0/1646627160 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f665c0ac3a0 con 0x7f665c155830 2023-11-30T18:23:10.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.858+0000 7f6664399700 1 -- 172.21.15.49:0/1646627160 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f665c093500 con 0x7f665c155830 2023-11-30T18:23:10.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.859+0000 7f665a7fc700 1 -- 172.21.15.49:0/1646627160 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f664c003040 con 0x7f665c155830 2023-11-30T18:23:10.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.859+0000 7f665a7fc700 1 --2- 172.21.15.49:0/1646627160 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f664805f270 0x7f6648061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:10.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.859+0000 7f665a7fc700 1 -- 172.21.15.49:0/1646627160 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5695+0+0 (secure 0 0 0) 0x7f664c07b9a0 con 0x7f665c155830 2023-11-30T18:23:10.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.859+0000 7f6662135700 1 --2- 172.21.15.49:0/1646627160 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f664805f270 0x7f6648061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:10.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.860+0000 7f6662135700 1 --2- 172.21.15.49:0/1646627160 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f664805f270 0x7f6648061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f6654001690 tx=0x7f6654009040).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:10.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:10.863+0000 7f665a7fc700 1 -- 172.21.15.49:0/1646627160 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f664c04cd60 con 0x7f665c155830 2023-11-30T18:23:11.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.036+0000 7f6664399700 1 -- 172.21.15.49:0/1646627160 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f665c0acb60 con 0x7f665c155830 2023-11-30T18:23:11.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.709+0000 7f665a7fc700 1 -- 172.21.15.49:0/1646627160 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v182) v1 ==== 170+0+0 (secure 0 0 0) 0x7f664c023070 con 0x7f665c155830 2023-11-30T18:23:11.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.717+0000 7f6664399700 1 -- 172.21.15.49:0/1646627160 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f664805f270 msgr2=0x7f6648061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:11.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.718+0000 7f6664399700 1 --2- 172.21.15.49:0/1646627160 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f664805f270 0x7f6648061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f6654001690 tx=0x7f6654009040).stop 2023-11-30T18:23:11.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.718+0000 7f6664399700 1 -- 172.21.15.49:0/1646627160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f665c155830 msgr2=0x7f665c1608a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:11.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.718+0000 7f6664399700 1 --2- 172.21.15.49:0/1646627160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f665c155830 0x7f665c1608a0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7f665c0677f0 tx=0x7f664c009840).stop 2023-11-30T18:23:11.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.718+0000 7f6664399700 1 -- 172.21.15.49:0/1646627160 shutdown_connections 2023-11-30T18:23:11.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.718+0000 7f6664399700 1 --2- 172.21.15.49:0/1646627160 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f664805f270 0x7f6648061730 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:11.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.718+0000 7f6664399700 1 --2- 172.21.15.49:0/1646627160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f665c155830 0x7f665c1608a0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:11.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.718+0000 7f6664399700 1 --2- 172.21.15.49:0/1646627160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f665c0c3090 0x7f665c1545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:11.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.718+0000 7f6664399700 1 --2- 172.21.15.49:0/1646627160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f665c0c65d0 0x7f665c0ab570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:11.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.718+0000 7f6664399700 1 -- 172.21.15.49:0/1646627160 >> 172.21.15.49:0/1646627160 conn(0x7f665c062700 msgr2=0x7f665c06a210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:11.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.718+0000 7f6664399700 1 -- 172.21.15.49:0/1646627160 shutdown_connections 2023-11-30T18:23:11.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.718+0000 7f6664399700 1 -- 172.21.15.49:0/1646627160 wait complete. 2023-11-30T18:23:11.727 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2023-11-30T18:23:11.745 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-30T18:23:11.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.867+0000 7fdd237ac700 1 Processor -- start 2023-11-30T18:23:11.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.868+0000 7fdd237ac700 1 -- start start 2023-11-30T18:23:11.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.868+0000 7fdd237ac700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdd1c158a30 0x7fdd1c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:11.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.868+0000 7fdd237ac700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd1c0c72d0 con 0x7fdd1c098d10 2023-11-30T18:23:11.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.868+0000 7fdd237ac700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd1c064570 con 0x7fdd1c0c6190 2023-11-30T18:23:11.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.868+0000 7fdd237ac700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd1c154bc0 con 0x7fdd1c158a30 2023-11-30T18:23:11.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.868+0000 7fdd21d49700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdd1c158a30 0x7fdd1c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:11.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.869+0000 7fdd21d49700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdd1c158a30 0x7fdd1c0c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45874/0 (socket says 172.21.15.49:45874) 2023-11-30T18:23:11.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.869+0000 7fdd21548700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdd1c098d10 0x7fdd1c063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39032/0 (socket says 172.21.15.49:39032) 2023-11-30T18:23:11.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.869+0000 7fdd21d49700 1 -- 172.21.15.49:0/3549212419 learned_addr learned my addr 172.21.15.49:0/3549212419 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:11.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.869+0000 7fdd21d49700 1 -- 172.21.15.49:0/3549212419 >> v1:172.21.15.115:6789/0 conn(0x7fdd1c0c6190 legacy=0x7fdd1c158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:11.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.869+0000 7fdd21d49700 1 -- 172.21.15.49:0/3549212419 >> v1:172.21.15.49:6789/0 conn(0x7fdd1c098d10 legacy=0x7fdd1c063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:11.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.869+0000 7fdd21d49700 1 -- 172.21.15.49:0/3549212419 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c0c66c0 con 0x7fdd1c158a30 2023-11-30T18:23:11.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.869+0000 7fdd1bfff700 1 -- 172.21.15.49:0/3549212419 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 453058868 0 0) 0x7fdd1c0c72d0 con 0x7fdd1c098d10 2023-11-30T18:23:11.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.869+0000 7fdd21d49700 1 --2- 172.21.15.49:0/3549212419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd1c158a30 0x7fdd1c0c7760 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7fdd0c009f20 tx=0x7fdd0c009840).ready entity=mon.0 client_cookie=afc7fae5253476b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:11.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.869+0000 7fdd1bfff700 1 -- 172.21.15.49:0/3549212419 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c00e070 con 0x7fdd1c158a30 2023-11-30T18:23:11.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.869+0000 7fdd1bfff700 1 -- 172.21.15.49:0/3549212419 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0c00ba80 con 0x7fdd1c158a30 2023-11-30T18:23:11.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.869+0000 7fdd1bfff700 1 -- 172.21.15.49:0/3549212419 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c00be00 con 0x7fdd1c158a30 2023-11-30T18:23:11.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.870+0000 7fdd237ac700 1 -- 172.21.15.49:0/3549212419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd1c158a30 msgr2=0x7fdd1c0c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:11.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.870+0000 7fdd237ac700 1 --2- 172.21.15.49:0/3549212419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd1c158a30 0x7fdd1c0c7760 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7fdd0c009f20 tx=0x7fdd0c009840).stop 2023-11-30T18:23:11.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.870+0000 7fdd237ac700 1 -- 172.21.15.49:0/3549212419 shutdown_connections 2023-11-30T18:23:11.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.870+0000 7fdd237ac700 1 --2- 172.21.15.49:0/3549212419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd1c158a30 0x7fdd1c0c7760 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:11.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.870+0000 7fdd237ac700 1 -- 172.21.15.49:0/3549212419 >> 172.21.15.49:0/3549212419 conn(0x7fdd1c0cb310 msgr2=0x7fdd1c0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:11.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.870+0000 7fdd237ac700 1 -- 172.21.15.49:0/3549212419 shutdown_connections 2023-11-30T18:23:11.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.870+0000 7fdd237ac700 1 -- 172.21.15.49:0/3549212419 wait complete. 2023-11-30T18:23:11.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.871+0000 7fdd237ac700 1 Processor -- start 2023-11-30T18:23:11.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.871+0000 7fdd237ac700 1 -- start start 2023-11-30T18:23:11.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.872+0000 7fdd237ac700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd1c098d10 0x7fdd1c165540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:11.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.872+0000 7fdd237ac700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd1c0c6190 0x7fdd1c0afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:11.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.872+0000 7fdd237ac700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd1c158a30 0x7fdd1c1528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:11.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.872+0000 7fdd237ac700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c165a30 con 0x7fdd1c0c6190 2023-11-30T18:23:11.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.872+0000 7fdd237ac700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c0aec50 con 0x7fdd1c098d10 2023-11-30T18:23:11.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.872+0000 7fdd237ac700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c0b02e0 con 0x7fdd1c158a30 2023-11-30T18:23:11.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.872+0000 7fdd20d47700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd1c0c6190 0x7fdd1c0afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:11.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.872+0000 7fdd20d47700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd1c0c6190 0x7fdd1c0afdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45882/0 (socket says 172.21.15.49:45882) 2023-11-30T18:23:11.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.872+0000 7fdd20d47700 1 -- 172.21.15.49:0/2903968471 learned_addr learned my addr 172.21.15.49:0/2903968471 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:11.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.872+0000 7fdd21d49700 1 --2- 172.21.15.49:0/2903968471 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd1c158a30 0x7fdd1c1528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:11.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.872+0000 7fdd21548700 1 --2- 172.21.15.49:0/2903968471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd1c098d10 0x7fdd1c165540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:11.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.872+0000 7fdd20d47700 1 -- 172.21.15.49:0/2903968471 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd1c158a30 msgr2=0x7fdd1c1528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:11.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.872+0000 7fdd20d47700 1 --2- 172.21.15.49:0/2903968471 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd1c158a30 0x7fdd1c1528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:11.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.872+0000 7fdd20d47700 1 -- 172.21.15.49:0/2903968471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd1c098d10 msgr2=0x7fdd1c165540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:11.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.872+0000 7fdd20d47700 1 --2- 172.21.15.49:0/2903968471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd1c098d10 0x7fdd1c165540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:11.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.872+0000 7fdd20d47700 1 -- 172.21.15.49:0/2903968471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0c009ae0 con 0x7fdd1c0c6190 2023-11-30T18:23:11.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.872+0000 7fdd20d47700 1 --2- 172.21.15.49:0/2903968471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd1c0c6190 0x7fdd1c0afdf0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7fdd1000c4f0 tx=0x7fdd10007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:11.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.873+0000 7fdd197fa700 1 -- 172.21.15.49:0/2903968471 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1000ce00 con 0x7fdd1c0c6190 2023-11-30T18:23:11.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.873+0000 7fdd197fa700 1 -- 172.21.15.49:0/2903968471 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd10007020 con 0x7fdd1c0c6190 2023-11-30T18:23:11.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.873+0000 7fdd237ac700 1 -- 172.21.15.49:0/2903968471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1c0ae360 con 0x7fdd1c0c6190 2023-11-30T18:23:11.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.873+0000 7fdd197fa700 1 -- 172.21.15.49:0/2903968471 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd100073c0 con 0x7fdd1c0c6190 2023-11-30T18:23:11.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.873+0000 7fdd237ac700 1 -- 172.21.15.49:0/2903968471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1c0ae8e0 con 0x7fdd1c0c6190 2023-11-30T18:23:11.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.874+0000 7fdd237ac700 1 -- 172.21.15.49:0/2903968471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd1c0b0620 con 0x7fdd1c0c6190 2023-11-30T18:23:11.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.874+0000 7fdd197fa700 1 -- 172.21.15.49:0/2903968471 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fdd100068b0 con 0x7fdd1c0c6190 2023-11-30T18:23:11.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.874+0000 7fdd197fa700 1 --2- 172.21.15.49:0/2903968471 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdd0805f240 0x7fdd08061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:11.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.874+0000 7fdd197fa700 1 -- 172.21.15.49:0/2903968471 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6077+0+0 (secure 0 0 0) 0x7fdd10079670 con 0x7fdd1c0c6190 2023-11-30T18:23:11.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.875+0000 7fdd21548700 1 --2- 172.21.15.49:0/2903968471 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdd0805f240 0x7fdd08061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:11.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.875+0000 7fdd21548700 1 --2- 172.21.15.49:0/2903968471 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdd0805f240 0x7fdd08061700 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fdd140011e0 tx=0x7fdd14007bb0).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:11.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:11.879+0000 7fdd197fa700 1 -- 172.21.15.49:0/2903968471 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdd10047b00 con 0x7fdd1c0c6190 2023-11-30T18:23:12.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.094+0000 7fdd237ac700 1 -- 172.21.15.49:0/2903968471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdd1c0aee00 con 0x7fdd1c0c6190 2023-11-30T18:23:12.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.102+0000 7fdd197fa700 1 -- 172.21.15.49:0/2903968471 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v73) v1 ==== 174+0+0 (secure 0 0 0) 0x7fdd1c0aee00 con 0x7fdd1c0c6190 2023-11-30T18:23:12.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.114+0000 7fdd237ac700 1 -- 172.21.15.49:0/2903968471 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdd0805f240 msgr2=0x7fdd08061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:12.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.114+0000 7fdd237ac700 1 --2- 172.21.15.49:0/2903968471 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdd0805f240 0x7fdd08061700 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fdd140011e0 tx=0x7fdd14007bb0).stop 2023-11-30T18:23:12.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.114+0000 7fdd237ac700 1 -- 172.21.15.49:0/2903968471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd1c0c6190 msgr2=0x7fdd1c0afdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:12.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.114+0000 7fdd237ac700 1 --2- 172.21.15.49:0/2903968471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd1c0c6190 0x7fdd1c0afdf0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7fdd1000c4f0 tx=0x7fdd10007dd0).stop 2023-11-30T18:23:12.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.115+0000 7fdd237ac700 1 -- 172.21.15.49:0/2903968471 shutdown_connections 2023-11-30T18:23:12.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.115+0000 7fdd237ac700 1 --2- 172.21.15.49:0/2903968471 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd1c158a30 0x7fdd1c1528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:12.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.115+0000 7fdd237ac700 1 --2- 172.21.15.49:0/2903968471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd1c098d10 0x7fdd1c165540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:12.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.115+0000 7fdd237ac700 1 --2- 172.21.15.49:0/2903968471 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdd0805f240 0x7fdd08061700 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:12.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.115+0000 7fdd237ac700 1 --2- 172.21.15.49:0/2903968471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd1c0c6190 0x7fdd1c0afdf0 secure :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 rx=0x7fdd1000c4f0 tx=0x7fdd10007dd0).stop 2023-11-30T18:23:12.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.115+0000 7fdd237ac700 1 -- 172.21.15.49:0/2903968471 >> 172.21.15.49:0/2903968471 conn(0x7fdd1c0cb310 msgr2=0x7fdd1c0c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:12.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.120+0000 7fdd237ac700 1 -- 172.21.15.49:0/2903968471 shutdown_connections 2023-11-30T18:23:12.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.120+0000 7fdd237ac700 1 -- 172.21.15.49:0/2903968471 wait complete. 2023-11-30T18:23:12.126 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 21 and data pool 22 2023-11-30T18:23:12.136 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:23:12.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.252+0000 7fa245d53700 1 Processor -- start 2023-11-30T18:23:12.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.253+0000 7fa245d53700 1 -- start start 2023-11-30T18:23:12.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.253+0000 7fa245d53700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa240064e20 0x7fa240155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:12.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.253+0000 7fa245d53700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa240095e80 0x7fa2400962f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:12.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.253+0000 7fa245d53700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2400967e0 con 0x7fa2401544d0 2023-11-30T18:23:12.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.253+0000 7fa245d53700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa240067650 con 0x7fa240095e80 2023-11-30T18:23:12.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.253+0000 7fa245d53700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2400683d0 con 0x7fa240064e20 2023-11-30T18:23:12.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.254+0000 7fa23ffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa240095e80 0x7fa2400962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:12.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.254+0000 7fa23ffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa240095e80 0x7fa2400962f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45896/0 (socket says 172.21.15.49:45896) 2023-11-30T18:23:12.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.254+0000 7fa23ffff700 1 -- 172.21.15.49:0/3719614056 learned_addr learned my addr 172.21.15.49:0/3719614056 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:12.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.254+0000 7fa23effd700 1 --2- 172.21.15.49:0/3719614056 >> v2:172.21.15.115:3300/0 conn(0x7fa240064e20 0x7fa240155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:12.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.254+0000 7fa23ffff700 1 -- 172.21.15.49:0/3719614056 >> v2:172.21.15.115:3300/0 conn(0x7fa240064e20 msgr2=0x7fa240155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:12.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.254+0000 7fa23ffff700 1 --2- 172.21.15.49:0/3719614056 >> v2:172.21.15.115:3300/0 conn(0x7fa240064e20 0x7fa240155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:12.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.254+0000 7fa23ffff700 1 -- 172.21.15.49:0/3719614056 >> v1:172.21.15.115:6789/0 conn(0x7fa2401544d0 legacy=0x7fa240066f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:12.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.254+0000 7fa23ffff700 1 -- 172.21.15.49:0/3719614056 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa240067850 con 0x7fa240095e80 2023-11-30T18:23:12.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.254+0000 7fa23ffff700 1 --2- 172.21.15.49:0/3719614056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa240095e80 0x7fa2400962f0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7fa24006a7d0 tx=0x7fa238009840).ready entity=mon.0 client_cookie=4592beae33ff765 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:12.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.254+0000 7fa23e7fc700 1 -- 172.21.15.49:0/3719614056 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23800e070 con 0x7fa240095e80 2023-11-30T18:23:12.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.254+0000 7fa23e7fc700 1 -- 172.21.15.49:0/3719614056 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23800ba20 con 0x7fa240095e80 2023-11-30T18:23:12.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.254+0000 7fa23e7fc700 1 -- 172.21.15.49:0/3719614056 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23800bda0 con 0x7fa240095e80 2023-11-30T18:23:12.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.255+0000 7fa245d53700 1 -- 172.21.15.49:0/3719614056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa240095e80 msgr2=0x7fa2400962f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:12.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.255+0000 7fa245d53700 1 --2- 172.21.15.49:0/3719614056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa240095e80 0x7fa2400962f0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7fa24006a7d0 tx=0x7fa238009840).stop 2023-11-30T18:23:12.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.255+0000 7fa245d53700 1 -- 172.21.15.49:0/3719614056 shutdown_connections 2023-11-30T18:23:12.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.255+0000 7fa245d53700 1 --2- 172.21.15.49:0/3719614056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa240095e80 0x7fa2400962f0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:12.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.255+0000 7fa245d53700 1 --2- 172.21.15.49:0/3719614056 >> v2:172.21.15.115:3300/0 conn(0x7fa240064e20 0x7fa240155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:12.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.255+0000 7fa245d53700 1 -- 172.21.15.49:0/3719614056 >> 172.21.15.49:0/3719614056 conn(0x7fa2400631d0 msgr2=0x7fa2400c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:12.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.255+0000 7fa245d53700 1 -- 172.21.15.49:0/3719614056 shutdown_connections 2023-11-30T18:23:12.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.255+0000 7fa245d53700 1 -- 172.21.15.49:0/3719614056 wait complete. 2023-11-30T18:23:12.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.256+0000 7fa245d53700 1 Processor -- start 2023-11-30T18:23:12.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.256+0000 7fa245d53700 1 -- start start 2023-11-30T18:23:12.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.257+0000 7fa245d53700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa240064e20 0x7fa24014db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:12.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.257+0000 7fa245d53700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa240095e80 0x7fa2400a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:12.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.257+0000 7fa245d53700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2401544d0 0x7fa2400a7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:12.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.257+0000 7fa245d53700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2400a7810 con 0x7fa240064e20 2023-11-30T18:23:12.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.257+0000 7fa245d53700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2400ad920 con 0x7fa240095e80 2023-11-30T18:23:12.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.257+0000 7fa245d53700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2400acd10 con 0x7fa2401544d0 2023-11-30T18:23:12.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.257+0000 7fa23f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa240064e20 0x7fa24014db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:12.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.257+0000 7fa23f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa240064e20 0x7fa24014db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45906/0 (socket says 172.21.15.49:45906) 2023-11-30T18:23:12.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.257+0000 7fa23f7fe700 1 -- 172.21.15.49:0/4205284946 learned_addr learned my addr 172.21.15.49:0/4205284946 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:12.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.257+0000 7fa23effd700 1 --2- 172.21.15.49:0/4205284946 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa240095e80 0x7fa2400a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:12.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.257+0000 7fa23ffff700 1 --2- 172.21.15.49:0/4205284946 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2401544d0 0x7fa2400a7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:12.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.257+0000 7fa23f7fe700 1 -- 172.21.15.49:0/4205284946 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2401544d0 msgr2=0x7fa2400a7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:12.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.257+0000 7fa23f7fe700 1 --2- 172.21.15.49:0/4205284946 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2401544d0 0x7fa2400a7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:12.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.257+0000 7fa23f7fe700 1 -- 172.21.15.49:0/4205284946 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa240095e80 msgr2=0x7fa2400a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:12.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.257+0000 7fa23f7fe700 1 --2- 172.21.15.49:0/4205284946 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa240095e80 0x7fa2400a6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:12.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.257+0000 7fa23f7fe700 1 -- 172.21.15.49:0/4205284946 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa238009ae0 con 0x7fa240064e20 2023-11-30T18:23:12.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.257+0000 7fa23f7fe700 1 --2- 172.21.15.49:0/4205284946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa240064e20 0x7fa24014db50 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7fa23000c440 tx=0x7fa230007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:12.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.257+0000 7fa2277fe700 1 -- 172.21.15.49:0/4205284946 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa230007020 con 0x7fa240064e20 2023-11-30T18:23:12.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.257+0000 7fa2277fe700 1 -- 172.21.15.49:0/4205284946 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa230007180 con 0x7fa240064e20 2023-11-30T18:23:12.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.257+0000 7fa245d53700 1 -- 172.21.15.49:0/4205284946 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2400acff0 con 0x7fa240064e20 2023-11-30T18:23:12.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.257+0000 7fa2277fe700 1 -- 172.21.15.49:0/4205284946 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa230007520 con 0x7fa240064e20 2023-11-30T18:23:12.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.258+0000 7fa245d53700 1 -- 172.21.15.49:0/4205284946 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2400ad5b0 con 0x7fa240064e20 2023-11-30T18:23:12.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.258+0000 7fa245d53700 1 -- 172.21.15.49:0/4205284946 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa24006c860 con 0x7fa240064e20 2023-11-30T18:23:12.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.259+0000 7fa2277fe700 1 -- 172.21.15.49:0/4205284946 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa230006900 con 0x7fa240064e20 2023-11-30T18:23:12.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.259+0000 7fa2277fe700 1 --2- 172.21.15.49:0/4205284946 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa22c05f270 0x7fa22c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:12.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.259+0000 7fa2277fe700 1 -- 172.21.15.49:0/4205284946 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fa2300796c0 con 0x7fa240064e20 2023-11-30T18:23:12.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.259+0000 7fa23effd700 1 --2- 172.21.15.49:0/4205284946 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa22c05f270 0x7fa22c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:12.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.260+0000 7fa23effd700 1 --2- 172.21.15.49:0/4205284946 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa22c05f270 0x7fa22c061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fa2400c3160 tx=0x7fa234009060).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:12.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.263+0000 7fa2277fe700 1 -- 172.21.15.49:0/4205284946 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa230047b00 con 0x7fa240064e20 2023-11-30T18:23:12.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.437+0000 7fa245d53700 1 -- 172.21.15.49:0/4205284946 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2400ae020 con 0x7fa240064e20 2023-11-30T18:23:12.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.438+0000 7fa2277fe700 1 -- 172.21.15.49:0/4205284946 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+17044 (secure 0 0 0) 0x7fa23004a7d0 con 0x7fa240064e20 2023-11-30T18:23:12.438 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:23:12.439 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":183,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:23:12.095623+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-11-30T18:23:10.276504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-11-30T18:23:11.078075+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:23:12.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.440+0000 7fa245d53700 1 -- 172.21.15.49:0/4205284946 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa22c05f270 msgr2=0x7fa22c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:12.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.440+0000 7fa245d53700 1 --2- 172.21.15.49:0/4205284946 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa22c05f270 0x7fa22c061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fa2400c3160 tx=0x7fa234009060).stop 2023-11-30T18:23:12.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.440+0000 7fa245d53700 1 -- 172.21.15.49:0/4205284946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa240064e20 msgr2=0x7fa24014db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:12.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.440+0000 7fa245d53700 1 --2- 172.21.15.49:0/4205284946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa240064e20 0x7fa24014db50 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7fa23000c440 tx=0x7fa230007e50).stop 2023-11-30T18:23:12.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.440+0000 7fa245d53700 1 -- 172.21.15.49:0/4205284946 shutdown_connections 2023-11-30T18:23:12.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.440+0000 7fa245d53700 1 --2- 172.21.15.49:0/4205284946 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2401544d0 0x7fa2400a7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:12.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.440+0000 7fa245d53700 1 --2- 172.21.15.49:0/4205284946 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fa22c05f270 0x7fa22c061730 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:12.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.440+0000 7fa245d53700 1 --2- 172.21.15.49:0/4205284946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa240064e20 0x7fa24014db50 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:12.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.440+0000 7fa245d53700 1 --2- 172.21.15.49:0/4205284946 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa240095e80 0x7fa2400a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:12.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.440+0000 7fa245d53700 1 -- 172.21.15.49:0/4205284946 >> 172.21.15.49:0/4205284946 conn(0x7fa2400631d0 msgr2=0x7fa2400c4950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:12.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.440+0000 7fa245d53700 1 -- 172.21.15.49:0/4205284946 shutdown_connections 2023-11-30T18:23:12.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.440+0000 7fa245d53700 1 -- 172.21.15.49:0/4205284946 wait complete. 2023-11-30T18:23:12.453 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:23:12.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.570+0000 7f1370da9700 1 Processor -- start 2023-11-30T18:23:12.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.570+0000 7f1370da9700 1 -- start start 2023-11-30T18:23:12.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.571+0000 7f1370da9700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f136c065f30 0x7f136c066310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:12.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.571+0000 7f1370da9700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f136c152450 0x7f136c0bcf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:12.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.571+0000 7f1370da9700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136c151740 con 0x7f136c0bd430 2023-11-30T18:23:12.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.571+0000 7f1370da9700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136c0c2470 con 0x7f136c065f30 2023-11-30T18:23:12.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.571+0000 7f1370da9700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136c0bd8a0 con 0x7f136c152450 2023-11-30T18:23:12.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.571+0000 7f136a59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f136c065f30 0x7f136c066310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:12.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.571+0000 7f136a59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f136c065f30 0x7f136c066310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45908/0 (socket says 172.21.15.49:45908) 2023-11-30T18:23:12.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.571+0000 7f136a59c700 1 -- 172.21.15.49:0/2033057993 learned_addr learned my addr 172.21.15.49:0/2033057993 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:12.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.571+0000 7f136ad9d700 1 --1- 172.21.15.49:0/2033057993 >> v1:172.21.15.49:6789/0 conn(0x7f136c0bd430 0x7f136c0c14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39034/0 (socket says 172.21.15.49:39034) 2023-11-30T18:23:12.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.571+0000 7f1369d9b700 1 --2- 172.21.15.49:0/2033057993 >> v2:172.21.15.115:3300/0 conn(0x7f136c152450 0x7f136c0bcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:12.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.571+0000 7f136a59c700 1 -- 172.21.15.49:0/2033057993 >> v2:172.21.15.115:3300/0 conn(0x7f136c152450 msgr2=0x7f136c0bcf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:12.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.571+0000 7f136a59c700 1 --2- 172.21.15.49:0/2033057993 >> v2:172.21.15.115:3300/0 conn(0x7f136c152450 0x7f136c0bcf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:12.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.571+0000 7f136a59c700 1 -- 172.21.15.49:0/2033057993 >> v1:172.21.15.49:6789/0 conn(0x7f136c0bd430 legacy=0x7f136c0c14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:12.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.571+0000 7f136a59c700 1 -- 172.21.15.49:0/2033057993 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c066800 con 0x7f136c065f30 2023-11-30T18:23:12.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.571+0000 7f1369d9b700 1 --2- 172.21.15.49:0/2033057993 >> v2:172.21.15.115:3300/0 conn(0x7f136c152450 0x7f136c0bcf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:23:12.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.571+0000 7f136a59c700 1 --2- 172.21.15.49:0/2033057993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f136c065f30 0x7f136c066310 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7f136c0c2f20 tx=0x7f135c00b3b0).ready entity=mon.0 client_cookie=815495b92b1342ae server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:12.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.572+0000 7f136959a700 1 -- 172.21.15.49:0/2033057993 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c00db10 con 0x7f136c065f30 2023-11-30T18:23:12.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.572+0000 7f136959a700 1 -- 172.21.15.49:0/2033057993 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135c00dc70 con 0x7f136c065f30 2023-11-30T18:23:12.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.572+0000 7f136959a700 1 -- 172.21.15.49:0/2033057993 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c010470 con 0x7f136c065f30 2023-11-30T18:23:12.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.572+0000 7f1370da9700 1 -- 172.21.15.49:0/2033057993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f136c065f30 msgr2=0x7f136c066310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:12.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.572+0000 7f1370da9700 1 --2- 172.21.15.49:0/2033057993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f136c065f30 0x7f136c066310 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7f136c0c2f20 tx=0x7f135c00b3b0).stop 2023-11-30T18:23:12.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.572+0000 7f1370da9700 1 -- 172.21.15.49:0/2033057993 shutdown_connections 2023-11-30T18:23:12.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.572+0000 7f1370da9700 1 --2- 172.21.15.49:0/2033057993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f136c065f30 0x7f136c066310 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:12.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.572+0000 7f1370da9700 1 --2- 172.21.15.49:0/2033057993 >> v2:172.21.15.115:3300/0 conn(0x7f136c152450 0x7f136c0bcf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:12.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.572+0000 7f1370da9700 1 -- 172.21.15.49:0/2033057993 >> 172.21.15.49:0/2033057993 conn(0x7f136c0631d0 msgr2=0x7f136c0c6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:12.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.572+0000 7f1370da9700 1 -- 172.21.15.49:0/2033057993 shutdown_connections 2023-11-30T18:23:12.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.572+0000 7f1370da9700 1 -- 172.21.15.49:0/2033057993 wait complete. 2023-11-30T18:23:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.573+0000 7f1370da9700 1 Processor -- start 2023-11-30T18:23:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.573+0000 7f1370da9700 1 -- start start 2023-11-30T18:23:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.574+0000 7f1370da9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f136c065f30 0x7f136c0a7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.574+0000 7f1370da9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f136c0bd430 0x7f136c0a8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.574+0000 7f1370da9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f136c152450 0x7f136c0a6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.574+0000 7f1370da9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c0a6610 con 0x7f136c065f30 2023-11-30T18:23:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.574+0000 7f1370da9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c0949a0 con 0x7f136c152450 2023-11-30T18:23:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.574+0000 7f1370da9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136c160bf0 con 0x7f136c0bd430 2023-11-30T18:23:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.574+0000 7f136a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f136c065f30 0x7f136c0a7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.574+0000 7f136a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f136c065f30 0x7f136c0a7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45910/0 (socket says 172.21.15.49:45910) 2023-11-30T18:23:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.574+0000 7f136a59c700 1 -- 172.21.15.49:0/2809597255 learned_addr learned my addr 172.21.15.49:0/2809597255 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:12.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.574+0000 7f1369d9b700 1 --2- 172.21.15.49:0/2809597255 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f136c0bd430 0x7f136c0a8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:12.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.574+0000 7f136a59c700 1 -- 172.21.15.49:0/2809597255 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f136c0bd430 msgr2=0x7f136c0a8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:12.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.574+0000 7f136a59c700 1 --2- 172.21.15.49:0/2809597255 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f136c0bd430 0x7f136c0a8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:12.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.574+0000 7f136ad9d700 1 --2- 172.21.15.49:0/2809597255 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f136c152450 0x7f136c0a6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:12.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.574+0000 7f136a59c700 1 -- 172.21.15.49:0/2809597255 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f136c152450 msgr2=0x7f136c0a6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:12.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.574+0000 7f136a59c700 1 --2- 172.21.15.49:0/2809597255 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f136c152450 0x7f136c0a6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:12.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.575+0000 7f136a59c700 1 -- 172.21.15.49:0/2809597255 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135c00b610 con 0x7f136c065f30 2023-11-30T18:23:12.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.575+0000 7f136ad9d700 1 --2- 172.21.15.49:0/2809597255 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f136c152450 0x7f136c0a6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:23:12.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.575+0000 7f1369d9b700 1 --2- 172.21.15.49:0/2809597255 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f136c0bd430 0x7f136c0a8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:23:12.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.575+0000 7f136a59c700 1 --2- 172.21.15.49:0/2809597255 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f136c065f30 0x7f136c0a7360 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7f135c00bf90 tx=0x7f136c066990).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:12.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.575+0000 7f13627fc700 1 -- 172.21.15.49:0/2809597255 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c01f070 con 0x7f136c065f30 2023-11-30T18:23:12.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.575+0000 7f13627fc700 1 -- 172.21.15.49:0/2809597255 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135c000c90 con 0x7f136c065f30 2023-11-30T18:23:12.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.575+0000 7f1370da9700 1 -- 172.21.15.49:0/2809597255 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136c0a9270 con 0x7f136c065f30 2023-11-30T18:23:12.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.575+0000 7f13627fc700 1 -- 172.21.15.49:0/2809597255 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c019870 con 0x7f136c065f30 2023-11-30T18:23:12.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.575+0000 7f1370da9700 1 -- 172.21.15.49:0/2809597255 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136c0a9830 con 0x7f136c065f30 2023-11-30T18:23:12.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.576+0000 7f1370da9700 1 -- 172.21.15.49:0/2809597255 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f136c06c860 con 0x7f136c065f30 2023-11-30T18:23:12.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.576+0000 7f13627fc700 1 -- 172.21.15.49:0/2809597255 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f135c019be0 con 0x7f136c065f30 2023-11-30T18:23:12.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.576+0000 7f13627fc700 1 --2- 172.21.15.49:0/2809597255 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f134c05f270 0x7f134c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:12.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.577+0000 7f13627fc700 1 -- 172.21.15.49:0/2809597255 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f135c07deb0 con 0x7f136c065f30 2023-11-30T18:23:12.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.577+0000 7f1369d9b700 1 --2- 172.21.15.49:0/2809597255 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f134c05f270 0x7f134c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:12.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.577+0000 7f1369d9b700 1 --2- 172.21.15.49:0/2809597255 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f134c05f270 0x7f134c061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f1354006d80 tx=0x7f1354008040).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:12.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.581+0000 7f13627fc700 1 -- 172.21.15.49:0/2809597255 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f135c04efc0 con 0x7f136c065f30 2023-11-30T18:23:12.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.756+0000 7f1370da9700 1 -- 172.21.15.49:0/2809597255 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f136c0c25b0 con 0x7f136c065f30 2023-11-30T18:23:12.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.756+0000 7f13627fc700 1 -- 172.21.15.49:0/2809597255 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+17044 (secure 0 0 0) 0x7f135c0525e0 con 0x7f136c065f30 2023-11-30T18:23:12.758 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:23:12.758 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":183,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:23:12.095623+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-11-30T18:23:10.276504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-11-30T18:23:11.078075+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:23:12.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.758+0000 7f1370da9700 1 -- 172.21.15.49:0/2809597255 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f134c05f270 msgr2=0x7f134c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:12.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.758+0000 7f1370da9700 1 --2- 172.21.15.49:0/2809597255 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f134c05f270 0x7f134c061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f1354006d80 tx=0x7f1354008040).stop 2023-11-30T18:23:12.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.758+0000 7f1370da9700 1 -- 172.21.15.49:0/2809597255 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f136c065f30 msgr2=0x7f136c0a7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:12.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.758+0000 7f1370da9700 1 --2- 172.21.15.49:0/2809597255 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f136c065f30 0x7f136c0a7360 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7f135c00bf90 tx=0x7f136c066990).stop 2023-11-30T18:23:12.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.759+0000 7f1370da9700 1 -- 172.21.15.49:0/2809597255 shutdown_connections 2023-11-30T18:23:12.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.759+0000 7f1370da9700 1 --2- 172.21.15.49:0/2809597255 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f136c152450 0x7f136c0a6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:12.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.759+0000 7f1370da9700 1 --2- 172.21.15.49:0/2809597255 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f134c05f270 0x7f134c061730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:12.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.759+0000 7f1370da9700 1 --2- 172.21.15.49:0/2809597255 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f136c065f30 0x7f136c0a7360 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:12.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.759+0000 7f1370da9700 1 --2- 172.21.15.49:0/2809597255 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f136c0bd430 0x7f136c0a8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:12.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.759+0000 7f1370da9700 1 -- 172.21.15.49:0/2809597255 >> 172.21.15.49:0/2809597255 conn(0x7f136c0631d0 msgr2=0x7f136c1528e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:12.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.759+0000 7f1370da9700 1 -- 172.21.15.49:0/2809597255 shutdown_connections 2023-11-30T18:23:12.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.759+0000 7f1370da9700 1 -- 172.21.15.49:0/2809597255 wait complete. 2023-11-30T18:23:12.772 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-30T18:23:12.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.892+0000 7f13a49c7700 1 Processor -- start 2023-11-30T18:23:12.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.892+0000 7f13a49c7700 1 -- start start 2023-11-30T18:23:12.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.893+0000 7f13a49c7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13a0154950 0x7f13a00ca540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:12.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.893+0000 7f13a49c7700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a00c7bc0 con 0x7f13a00c66f0 2023-11-30T18:23:12.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.893+0000 7f13a49c7700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a0155920 con 0x7f13a014e530 2023-11-30T18:23:12.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.893+0000 7f13a49c7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a00c6ba0 con 0x7f13a0154950 2023-11-30T18:23:12.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.893+0000 7f139effd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f13a00c66f0 0x7f13a0158570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39044/0 (socket says 172.21.15.49:39044) 2023-11-30T18:23:12.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.893+0000 7f139effd700 1 -- 172.21.15.49:0/3224704512 learned_addr learned my addr 172.21.15.49:0/3224704512 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:23:12.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.893+0000 7f139ffff700 1 --2- 172.21.15.49:0/3224704512 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13a0154950 0x7f13a00ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:12.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.893+0000 7f139e7fc700 1 -- 172.21.15.49:0/3224704512 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4240008862 0 0) 0x7f13a00c7bc0 con 0x7f13a00c66f0 2023-11-30T18:23:12.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.893+0000 7f139e7fc700 1 -- 172.21.15.49:0/3224704512 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13880033f0 con 0x7f13a00c66f0 2023-11-30T18:23:12.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.893+0000 7f139e7fc700 1 -- 172.21.15.49:0/3224704512 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4127884295 0 0) 0x7f13a0155920 con 0x7f13a014e530 2023-11-30T18:23:12.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.893+0000 7f139e7fc700 1 -- 172.21.15.49:0/3224704512 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13a00c7bc0 con 0x7f13a014e530 2023-11-30T18:23:12.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.893+0000 7f139e7fc700 1 -- 172.21.15.49:0/3224704512 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2185878714 0 0) 0x7f13880033f0 con 0x7f13a00c66f0 2023-11-30T18:23:12.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.893+0000 7f139e7fc700 1 -- 172.21.15.49:0/3224704512 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13a0154950 msgr2=0x7f13a00ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:12.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.893+0000 7f139e7fc700 1 --2- 172.21.15.49:0/3224704512 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13a0154950 0x7f13a00ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:12.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.893+0000 7f139e7fc700 1 -- 172.21.15.49:0/3224704512 >> v1:172.21.15.115:6789/0 conn(0x7f13a014e530 legacy=0x7f13a014e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:12.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.893+0000 7f139e7fc700 1 -- 172.21.15.49:0/3224704512 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a0154de0 con 0x7f13a00c66f0 2023-11-30T18:23:12.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.893+0000 7f139e7fc700 1 -- 172.21.15.49:0/3224704512 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f1394001470 con 0x7f13a00c66f0 2023-11-30T18:23:12.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.894+0000 7f139e7fc700 1 -- 172.21.15.49:0/3224704512 >> v1:172.21.15.49:6789/0 conn(0x7f13a00c66f0 legacy=0x7f13a0158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:12.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.894+0000 7f139e7fc700 1 --2- 172.21.15.49:0/3224704512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1388003aa0 0x7f1388003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:12.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.894+0000 7f139e7fc700 1 --2- 172.21.15.49:0/3224704512 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13a0154950 0x7f1388004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:12.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.894+0000 7f139e7fc700 1 --2- 172.21.15.49:0/3224704512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1388004b80 0x7f1388005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:12.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.894+0000 7f139e7fc700 1 -- 172.21.15.49:0/3224704512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a00c6ba0 con 0x7f1388004b80 2023-11-30T18:23:12.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.894+0000 7f139e7fc700 1 -- 172.21.15.49:0/3224704512 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138800b910 con 0x7f1388003aa0 2023-11-30T18:23:12.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.894+0000 7f139e7fc700 1 -- 172.21.15.49:0/3224704512 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138800bad0 con 0x7f13a0154950 2023-11-30T18:23:12.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.894+0000 7f139ffff700 1 --2- 172.21.15.49:0/3224704512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1388004b80 0x7f1388005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:12.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.894+0000 7f139f7fe700 1 --2- 172.21.15.49:0/3224704512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1388003aa0 0x7f1388003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:12.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.894+0000 7f139effd700 1 --2- 172.21.15.49:0/3224704512 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13a0154950 0x7f1388004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:12.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.894+0000 7f139ffff700 1 -- 172.21.15.49:0/3224704512 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13a0154950 msgr2=0x7f1388004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:12.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.894+0000 7f139ffff700 1 --2- 172.21.15.49:0/3224704512 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13a0154950 0x7f1388004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:12.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.894+0000 7f139ffff700 1 -- 172.21.15.49:0/3224704512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1388003aa0 msgr2=0x7f1388003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:12.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.894+0000 7f139ffff700 1 --2- 172.21.15.49:0/3224704512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1388003aa0 0x7f1388003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:12.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.894+0000 7f139ffff700 1 -- 172.21.15.49:0/3224704512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13880033f0 con 0x7f1388004b80 2023-11-30T18:23:12.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.894+0000 7f139ffff700 1 --2- 172.21.15.49:0/3224704512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1388004b80 0x7f1388005000 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f139800e210 tx=0x7f139800b040).ready entity=mon.0 client_cookie=5a68748395d25bd8 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:12.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.894+0000 7f139e7fc700 1 -- 172.21.15.49:0/3224704512 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398009ac0 con 0x7f1388004b80 2023-11-30T18:23:12.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.894+0000 7f139e7fc700 1 -- 172.21.15.49:0/3224704512 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139800f040 con 0x7f1388004b80 2023-11-30T18:23:12.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.894+0000 7f139e7fc700 1 -- 172.21.15.49:0/3224704512 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139800ecd0 con 0x7f1388004b80 2023-11-30T18:23:12.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.895+0000 7f13a49c7700 1 -- 172.21.15.49:0/3224704512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1388004b80 msgr2=0x7f1388005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:12.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.895+0000 7f13a49c7700 1 --2- 172.21.15.49:0/3224704512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1388004b80 0x7f1388005000 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f139800e210 tx=0x7f139800b040).stop 2023-11-30T18:23:12.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.895+0000 7f139ffff700 1 -- 172.21.15.49:0/3224704512 reap_dead start 2023-11-30T18:23:12.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.895+0000 7f13a49c7700 1 -- 172.21.15.49:0/3224704512 shutdown_connections 2023-11-30T18:23:12.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.895+0000 7f13a49c7700 1 -- 172.21.15.49:0/3224704512 >> 172.21.15.49:0/3224704512 conn(0x7f13a0064990 msgr2=0x7f13a0064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:12.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.895+0000 7f13a49c7700 1 -- 172.21.15.49:0/3224704512 shutdown_connections 2023-11-30T18:23:12.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.895+0000 7f13a49c7700 1 -- 172.21.15.49:0/3224704512 wait complete. 2023-11-30T18:23:12.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.896+0000 7f13a49c7700 1 Processor -- start 2023-11-30T18:23:12.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.896+0000 7f13a49c7700 1 -- start start 2023-11-30T18:23:12.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.897+0000 7f13a49c7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1388004b80 0x7f13a0163f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:12.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.897+0000 7f13a49c7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13a0166bc0 0x7f13a00c1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:12.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.897+0000 7f13a49c7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13a0167020 0x7f13a00c1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:12.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.897+0000 7f13a49c7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a00c1d40 con 0x7f13a0166bc0 2023-11-30T18:23:12.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.897+0000 7f13a49c7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a0142220 con 0x7f13a0167020 2023-11-30T18:23:12.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.897+0000 7f13a49c7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a0141610 con 0x7f1388004b80 2023-11-30T18:23:12.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.897+0000 7f139effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13a0166bc0 0x7f13a00c1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:12.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.897+0000 7f139effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13a0166bc0 0x7f13a00c1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45938/0 (socket says 172.21.15.49:45938) 2023-11-30T18:23:12.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.897+0000 7f139effd700 1 -- 172.21.15.49:0/418894358 learned_addr learned my addr 172.21.15.49:0/418894358 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:12.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.897+0000 7f139f7fe700 1 --2- 172.21.15.49:0/418894358 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1388004b80 0x7f13a0163f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:12.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.897+0000 7f139ffff700 1 --2- 172.21.15.49:0/418894358 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13a0167020 0x7f13a00c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:12.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.897+0000 7f139effd700 1 -- 172.21.15.49:0/418894358 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1388004b80 msgr2=0x7f13a0163f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:12.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.897+0000 7f139effd700 1 --2- 172.21.15.49:0/418894358 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1388004b80 0x7f13a0163f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:12.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.897+0000 7f139effd700 1 -- 172.21.15.49:0/418894358 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13a0167020 msgr2=0x7f13a00c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:12.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.897+0000 7f139effd700 1 --2- 172.21.15.49:0/418894358 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13a0167020 0x7f13a00c1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:12.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.897+0000 7f139effd700 1 -- 172.21.15.49:0/418894358 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a01418f0 con 0x7f13a0166bc0 2023-11-30T18:23:12.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.897+0000 7f139effd700 1 --2- 172.21.15.49:0/418894358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13a0166bc0 0x7f13a00c1360 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7f1394004a10 tx=0x7f1394001df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:12.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.898+0000 7f13877fe700 1 -- 172.21.15.49:0/418894358 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1394001030 con 0x7f13a0166bc0 2023-11-30T18:23:12.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.898+0000 7f13877fe700 1 -- 172.21.15.49:0/418894358 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139400f8d0 con 0x7f13a0166bc0 2023-11-30T18:23:12.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.898+0000 7f13877fe700 1 -- 172.21.15.49:0/418894358 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139400fc70 con 0x7f13a0166bc0 2023-11-30T18:23:12.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.898+0000 7f13a49c7700 1 -- 172.21.15.49:0/418894358 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a0141bd0 con 0x7f13a0166bc0 2023-11-30T18:23:12.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.898+0000 7f13a49c7700 1 -- 172.21.15.49:0/418894358 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a01408a0 con 0x7f13a0166bc0 2023-11-30T18:23:12.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.899+0000 7f13a49c7700 1 -- 172.21.15.49:0/418894358 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a0062ee0 con 0x7f13a0166bc0 2023-11-30T18:23:12.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.899+0000 7f13877fe700 1 -- 172.21.15.49:0/418894358 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f1394015410 con 0x7f13a0166bc0 2023-11-30T18:23:12.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.899+0000 7f13877fe700 1 --2- 172.21.15.49:0/418894358 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f138c05f270 0x7f138c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:12.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.899+0000 7f13877fe700 1 -- 172.21.15.49:0/418894358 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f139407a740 con 0x7f13a0166bc0 2023-11-30T18:23:12.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.900+0000 7f139f7fe700 1 --2- 172.21.15.49:0/418894358 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f138c05f270 0x7f138c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:12.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.900+0000 7f139f7fe700 1 --2- 172.21.15.49:0/418894358 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f138c05f270 0x7f138c061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1390000c00 tx=0x7f1390009040).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:12.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:12.903+0000 7f13877fe700 1 -- 172.21.15.49:0/418894358 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f139404b7f0 con 0x7f13a0166bc0 2023-11-30T18:23:13.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:13.123+0000 7f13a49c7700 1 -- 172.21.15.49:0/418894358 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f13a006c7c0 con 0x7f13a0166bc0 2023-11-30T18:23:14.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.120+0000 7f13877fe700 1 -- 172.21.15.49:0/418894358 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v76) v1 ==== 118+0+0 (secure 0 0 0) 0x7f139404ee10 con 0x7f13a0166bc0 2023-11-30T18:23:14.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.123+0000 7f13a49c7700 1 -- 172.21.15.49:0/418894358 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f138c05f270 msgr2=0x7f138c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:14.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.123+0000 7f13a49c7700 1 --2- 172.21.15.49:0/418894358 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f138c05f270 0x7f138c061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1390000c00 tx=0x7f1390009040).stop 2023-11-30T18:23:14.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.123+0000 7f13a49c7700 1 -- 172.21.15.49:0/418894358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13a0166bc0 msgr2=0x7f13a00c1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:14.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.123+0000 7f13a49c7700 1 --2- 172.21.15.49:0/418894358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13a0166bc0 0x7f13a00c1360 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7f1394004a10 tx=0x7f1394001df0).stop 2023-11-30T18:23:14.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.123+0000 7f13a49c7700 1 -- 172.21.15.49:0/418894358 shutdown_connections 2023-11-30T18:23:14.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.123+0000 7f13a49c7700 1 --2- 172.21.15.49:0/418894358 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13a0167020 0x7f13a00c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:14.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.123+0000 7f13a49c7700 1 --2- 172.21.15.49:0/418894358 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1388004b80 0x7f13a0163f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:14.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.123+0000 7f13a49c7700 1 --2- 172.21.15.49:0/418894358 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f138c05f270 0x7f138c061730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:14.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.123+0000 7f13a49c7700 1 --2- 172.21.15.49:0/418894358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13a0166bc0 0x7f13a00c1360 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:14.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.123+0000 7f13a49c7700 1 -- 172.21.15.49:0/418894358 >> 172.21.15.49:0/418894358 conn(0x7f13a0064990 msgr2=0x7f13a00caf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:14.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.123+0000 7f13a49c7700 1 -- 172.21.15.49:0/418894358 shutdown_connections 2023-11-30T18:23:14.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.123+0000 7f13a49c7700 1 -- 172.21.15.49:0/418894358 wait complete. 2023-11-30T18:23:14.138 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-30T18:23:14.139 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-30T18:23:14.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.265+0000 7fae61240700 1 Processor -- start 2023-11-30T18:23:14.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.265+0000 7fae61240700 1 -- start start 2023-11-30T18:23:14.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.266+0000 7fae61240700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae5c0c51a0 0x7fae5c153390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:14.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.266+0000 7fae61240700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fae5c0c5ea0 0x7fae5c066a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:14.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.266+0000 7fae61240700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae5c155f20 con 0x7fae5c0c5ac0 2023-11-30T18:23:14.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.266+0000 7fae61240700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae5c153990 con 0x7fae5c0c5ea0 2023-11-30T18:23:14.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.266+0000 7fae61240700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c156200 con 0x7fae5c0c51a0 2023-11-30T18:23:14.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.266+0000 7fae5b59e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fae5c0c5ea0 0x7fae5c066a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:14.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.266+0000 7fae5ad9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fae5c0c5ac0 0x7fae5c156690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39058/0 (socket says 172.21.15.49:39058) 2023-11-30T18:23:14.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.266+0000 7fae5ad9d700 1 -- 172.21.15.49:0/3413765998 learned_addr learned my addr 172.21.15.49:0/3413765998 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:23:14.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.266+0000 7fae5a59c700 1 --2- 172.21.15.49:0/3413765998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae5c0c51a0 0x7fae5c153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:14.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.267+0000 7fae5b59e700 1 -- 172.21.15.49:0/3413765998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae5c0c51a0 msgr2=0x7fae5c153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:14.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.267+0000 7fae5b59e700 1 --2- 172.21.15.49:0/3413765998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae5c0c51a0 0x7fae5c153390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:14.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.267+0000 7fae5b59e700 1 -- 172.21.15.49:0/3413765998 >> v1:172.21.15.49:6789/0 conn(0x7fae5c0c5ac0 legacy=0x7fae5c156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:14.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.267+0000 7fae5b59e700 1 -- 172.21.15.49:0/3413765998 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae5c0bff70 con 0x7fae5c0c5ea0 2023-11-30T18:23:14.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.267+0000 7fae59d9b700 1 -- 172.21.15.49:0/3413765998 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3323469083 0 0) 0x7fae5c155f20 con 0x7fae5c0c5ac0 2023-11-30T18:23:14.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.267+0000 7fae5a59c700 1 --2- 172.21.15.49:0/3413765998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae5c0c51a0 0x7fae5c153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:23:14.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.267+0000 7fae5b59e700 1 --2- 172.21.15.49:0/3413765998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae5c0c5ea0 0x7fae5c066a70 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7fae54009e60 tx=0x7fae54009780).ready entity=mon.0 client_cookie=aaa106e9b9183835 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:14.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.267+0000 7fae59d9b700 1 -- 172.21.15.49:0/3413765998 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5400e070 con 0x7fae5c0c5ea0 2023-11-30T18:23:14.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.267+0000 7fae59d9b700 1 -- 172.21.15.49:0/3413765998 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5400bc30 con 0x7fae5c0c5ea0 2023-11-30T18:23:14.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.267+0000 7fae59d9b700 1 -- 172.21.15.49:0/3413765998 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae54012410 con 0x7fae5c0c5ea0 2023-11-30T18:23:14.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.267+0000 7fae61240700 1 -- 172.21.15.49:0/3413765998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae5c0c5ea0 msgr2=0x7fae5c066a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:14.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.267+0000 7fae61240700 1 --2- 172.21.15.49:0/3413765998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae5c0c5ea0 0x7fae5c066a70 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7fae54009e60 tx=0x7fae54009780).stop 2023-11-30T18:23:14.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.267+0000 7fae61240700 1 -- 172.21.15.49:0/3413765998 shutdown_connections 2023-11-30T18:23:14.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.267+0000 7fae61240700 1 --2- 172.21.15.49:0/3413765998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae5c0c5ea0 0x7fae5c066a70 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:14.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.267+0000 7fae61240700 1 --2- 172.21.15.49:0/3413765998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae5c0c51a0 0x7fae5c153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:14.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.267+0000 7fae61240700 1 -- 172.21.15.49:0/3413765998 >> 172.21.15.49:0/3413765998 conn(0x7fae5c062700 msgr2=0x7fae5c062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:14.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.267+0000 7fae61240700 1 -- 172.21.15.49:0/3413765998 shutdown_connections 2023-11-30T18:23:14.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.267+0000 7fae61240700 1 -- 172.21.15.49:0/3413765998 wait complete. 2023-11-30T18:23:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.269+0000 7fae61240700 1 Processor -- start 2023-11-30T18:23:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.269+0000 7fae61240700 1 -- start start 2023-11-30T18:23:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.269+0000 7fae61240700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae5c0c51a0 0x7fae5c14f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.269+0000 7fae61240700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae5c0c5ac0 0x7fae5c0ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.269+0000 7fae61240700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae5c0c5ea0 0x7fae5c0c1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.269+0000 7fae61240700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c0ad0c0 con 0x7fae5c0c5ac0 2023-11-30T18:23:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.269+0000 7fae61240700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c0adf20 con 0x7fae5c0c5ea0 2023-11-30T18:23:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.269+0000 7fae61240700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c14f8d0 con 0x7fae5c0c51a0 2023-11-30T18:23:14.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.270+0000 7fae5a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae5c0c5ac0 0x7fae5c0ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:14.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.270+0000 7fae5a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae5c0c5ac0 0x7fae5c0ae3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45952/0 (socket says 172.21.15.49:45952) 2023-11-30T18:23:14.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.270+0000 7fae5a59c700 1 -- 172.21.15.49:0/3329508460 learned_addr learned my addr 172.21.15.49:0/3329508460 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:14.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.270+0000 7fae5ad9d700 1 --2- 172.21.15.49:0/3329508460 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae5c0c51a0 0x7fae5c14f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:14.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.270+0000 7fae5b59e700 1 --2- 172.21.15.49:0/3329508460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae5c0c5ea0 0x7fae5c0c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:14.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.270+0000 7fae5a59c700 1 -- 172.21.15.49:0/3329508460 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae5c0c51a0 msgr2=0x7fae5c14f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:14.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.270+0000 7fae5a59c700 1 --2- 172.21.15.49:0/3329508460 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae5c0c51a0 0x7fae5c14f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:14.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.270+0000 7fae5a59c700 1 -- 172.21.15.49:0/3329508460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae5c0c5ea0 msgr2=0x7fae5c0c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:14.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.270+0000 7fae5a59c700 1 --2- 172.21.15.49:0/3329508460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae5c0c5ea0 0x7fae5c0c1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:14.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.270+0000 7fae5a59c700 1 -- 172.21.15.49:0/3329508460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae54009a20 con 0x7fae5c0c5ac0 2023-11-30T18:23:14.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.270+0000 7fae5a59c700 1 --2- 172.21.15.49:0/3329508460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae5c0c5ac0 0x7fae5c0ae3b0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7fae5000c880 tx=0x7fae50008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:14.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.270+0000 7fae42ffd700 1 -- 172.21.15.49:0/3329508460 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae50010580 con 0x7fae5c0c5ac0 2023-11-30T18:23:14.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.270+0000 7fae42ffd700 1 -- 172.21.15.49:0/3329508460 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae500106e0 con 0x7fae5c0c5ac0 2023-11-30T18:23:14.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.270+0000 7fae61240700 1 -- 172.21.15.49:0/3329508460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae5c0ad310 con 0x7fae5c0c5ac0 2023-11-30T18:23:14.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.270+0000 7fae42ffd700 1 -- 172.21.15.49:0/3329508460 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae50010a60 con 0x7fae5c0c5ac0 2023-11-30T18:23:14.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.270+0000 7fae61240700 1 -- 172.21.15.49:0/3329508460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae5c0ad8d0 con 0x7fae5c0c5ac0 2023-11-30T18:23:14.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.271+0000 7fae61240700 1 -- 172.21.15.49:0/3329508460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae5c0ae0d0 con 0x7fae5c0c5ac0 2023-11-30T18:23:14.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.272+0000 7fae42ffd700 1 -- 172.21.15.49:0/3329508460 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fae5001b460 con 0x7fae5c0c5ac0 2023-11-30T18:23:14.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.272+0000 7fae42ffd700 1 --2- 172.21.15.49:0/3329508460 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fae4805f270 0x7fae48061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:14.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.272+0000 7fae42ffd700 1 -- 172.21.15.49:0/3329508460 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fae5007a3e0 con 0x7fae5c0c5ac0 2023-11-30T18:23:14.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.272+0000 7fae5ad9d700 1 --2- 172.21.15.49:0/3329508460 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fae4805f270 0x7fae48061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:14.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.272+0000 7fae5ad9d700 1 --2- 172.21.15.49:0/3329508460 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fae4805f270 0x7fae48061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fae4c0011e0 tx=0x7fae4c009040).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:14.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.276+0000 7fae42ffd700 1 -- 172.21.15.49:0/3329508460 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fae5c0ae0d0 con 0x7fae5c0c5ac0 2023-11-30T18:23:14.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:14.492+0000 7fae61240700 1 -- 172.21.15.49:0/3329508460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fae5c0ae090 con 0x7fae5c0c5ac0 2023-11-30T18:23:15.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.121+0000 7fae42ffd700 1 -- 172.21.15.49:0/3329508460 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v77) v1 ==== 122+0+0 (secure 0 0 0) 0x7fae5004b490 con 0x7fae5c0c5ac0 2023-11-30T18:23:15.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.125+0000 7fae61240700 1 -- 172.21.15.49:0/3329508460 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fae4805f270 msgr2=0x7fae48061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:15.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.125+0000 7fae61240700 1 --2- 172.21.15.49:0/3329508460 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fae4805f270 0x7fae48061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fae4c0011e0 tx=0x7fae4c009040).stop 2023-11-30T18:23:15.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.125+0000 7fae61240700 1 -- 172.21.15.49:0/3329508460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae5c0c5ac0 msgr2=0x7fae5c0ae3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:15.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.125+0000 7fae61240700 1 --2- 172.21.15.49:0/3329508460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae5c0c5ac0 0x7fae5c0ae3b0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7fae5000c880 tx=0x7fae50008040).stop 2023-11-30T18:23:15.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.125+0000 7fae61240700 1 -- 172.21.15.49:0/3329508460 shutdown_connections 2023-11-30T18:23:15.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.125+0000 7fae61240700 1 --2- 172.21.15.49:0/3329508460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae5c0c5ea0 0x7fae5c0c1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:15.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.125+0000 7fae61240700 1 --2- 172.21.15.49:0/3329508460 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae5c0c51a0 0x7fae5c14f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:15.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.125+0000 7fae61240700 1 --2- 172.21.15.49:0/3329508460 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fae4805f270 0x7fae48061730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:15.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.125+0000 7fae61240700 1 --2- 172.21.15.49:0/3329508460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae5c0c5ac0 0x7fae5c0ae3b0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:15.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.125+0000 7fae61240700 1 -- 172.21.15.49:0/3329508460 >> 172.21.15.49:0/3329508460 conn(0x7fae5c062700 msgr2=0x7fae5c0c3880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:15.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.125+0000 7fae61240700 1 -- 172.21.15.49:0/3329508460 shutdown_connections 2023-11-30T18:23:15.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.125+0000 7fae61240700 1 -- 172.21.15.49:0/3329508460 wait complete. 2023-11-30T18:23:15.141 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-30T18:23:15.141 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:23:15.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.262+0000 7f7ebe914700 1 Processor -- start 2023-11-30T18:23:15.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.262+0000 7f7ebe914700 1 -- start start 2023-11-30T18:23:15.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.262+0000 7f7ebe914700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7eb81520c0 0x7f7eb8066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:15.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.262+0000 7f7ebe914700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7eb8068150 0x7f7eb8066a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:15.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.262+0000 7f7ebe914700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb80be110 con 0x7f7eb81524a0 2023-11-30T18:23:15.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.262+0000 7f7ebe914700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb8066fc0 con 0x7f7eb8068150 2023-11-30T18:23:15.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.262+0000 7f7ebe914700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb80672a0 con 0x7f7eb81520c0 2023-11-30T18:23:15.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.263+0000 7f7ebceb1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7eb8068150 0x7f7eb8066a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:15.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.263+0000 7f7ebceb1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7eb8068150 0x7f7eb8066a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45958/0 (socket says 172.21.15.49:45958) 2023-11-30T18:23:15.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.263+0000 7f7ebceb1700 1 -- 172.21.15.49:0/3289233982 learned_addr learned my addr 172.21.15.49:0/3289233982 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:15.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.263+0000 7f7eb7fff700 1 --2- 172.21.15.49:0/3289233982 >> v2:172.21.15.115:3300/0 conn(0x7f7eb81520c0 0x7f7eb8066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:15.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.263+0000 7f7ebceb1700 1 -- 172.21.15.49:0/3289233982 >> v2:172.21.15.115:3300/0 conn(0x7f7eb81520c0 msgr2=0x7f7eb8066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:15.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.263+0000 7f7ebceb1700 1 --2- 172.21.15.49:0/3289233982 >> v2:172.21.15.115:3300/0 conn(0x7f7eb81520c0 0x7f7eb8066520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:15.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.263+0000 7f7ebceb1700 1 -- 172.21.15.49:0/3289233982 >> v1:172.21.15.115:6789/0 conn(0x7f7eb81524a0 legacy=0x7f7eb8067a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:15.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.263+0000 7f7ebceb1700 1 -- 172.21.15.49:0/3289233982 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb80be380 con 0x7f7eb8068150 2023-11-30T18:23:15.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.263+0000 7f7ebceb1700 1 --2- 172.21.15.49:0/3289233982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7eb8068150 0x7f7eb8066a10 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7f7eb80c5b10 tx=0x7f7eb0009840).ready entity=mon.0 client_cookie=c95478686c0ba6b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:15.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.263+0000 7f7eb6ffd700 1 -- 172.21.15.49:0/3289233982 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb000e070 con 0x7f7eb8068150 2023-11-30T18:23:15.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.263+0000 7f7eb6ffd700 1 -- 172.21.15.49:0/3289233982 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb000ba20 con 0x7f7eb8068150 2023-11-30T18:23:15.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.263+0000 7f7eb6ffd700 1 -- 172.21.15.49:0/3289233982 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb000bda0 con 0x7f7eb8068150 2023-11-30T18:23:15.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.264+0000 7f7ebe914700 1 -- 172.21.15.49:0/3289233982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7eb8068150 msgr2=0x7f7eb8066a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:15.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.264+0000 7f7ebe914700 1 --2- 172.21.15.49:0/3289233982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7eb8068150 0x7f7eb8066a10 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7f7eb80c5b10 tx=0x7f7eb0009840).stop 2023-11-30T18:23:15.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.264+0000 7f7ebe914700 1 -- 172.21.15.49:0/3289233982 shutdown_connections 2023-11-30T18:23:15.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.264+0000 7f7ebe914700 1 --2- 172.21.15.49:0/3289233982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7eb8068150 0x7f7eb8066a10 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:15.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.264+0000 7f7ebe914700 1 --2- 172.21.15.49:0/3289233982 >> v2:172.21.15.115:3300/0 conn(0x7f7eb81520c0 0x7f7eb8066520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:15.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.264+0000 7f7ebe914700 1 -- 172.21.15.49:0/3289233982 >> 172.21.15.49:0/3289233982 conn(0x7f7eb80631d0 msgr2=0x7f7eb80c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:15.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.264+0000 7f7ebe914700 1 -- 172.21.15.49:0/3289233982 shutdown_connections 2023-11-30T18:23:15.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.264+0000 7f7ebe914700 1 -- 172.21.15.49:0/3289233982 wait complete. 2023-11-30T18:23:15.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.265+0000 7f7ebe914700 1 Processor -- start 2023-11-30T18:23:15.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.265+0000 7f7ebe914700 1 -- start start 2023-11-30T18:23:15.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.266+0000 7f7ebe914700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7eb8068150 0x7f7eb814bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:15.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.266+0000 7f7ebe914700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7eb81520c0 0x7f7eb81576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:15.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.266+0000 7f7ebe914700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7eb81524a0 0x7f7eb814fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:15.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.266+0000 7f7ebe914700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb81529f0 con 0x7f7eb81524a0 2023-11-30T18:23:15.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.266+0000 7f7ebe914700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb8152cd0 con 0x7f7eb81520c0 2023-11-30T18:23:15.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.266+0000 7f7ebe914700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb8152fb0 con 0x7f7eb8068150 2023-11-30T18:23:15.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.266+0000 7f7ebceb1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7eb81524a0 0x7f7eb814fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:15.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.266+0000 7f7ebceb1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7eb81524a0 0x7f7eb814fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45970/0 (socket says 172.21.15.49:45970) 2023-11-30T18:23:15.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.266+0000 7f7ebceb1700 1 -- 172.21.15.49:0/3600682089 learned_addr learned my addr 172.21.15.49:0/3600682089 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:15.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.266+0000 7f7eb77fe700 1 --2- 172.21.15.49:0/3600682089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7eb81520c0 0x7f7eb81576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:15.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.266+0000 7f7eb7fff700 1 --2- 172.21.15.49:0/3600682089 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7eb8068150 0x7f7eb814bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:15.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.266+0000 7f7ebceb1700 1 -- 172.21.15.49:0/3600682089 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7eb8068150 msgr2=0x7f7eb814bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:15.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.266+0000 7f7ebceb1700 1 --2- 172.21.15.49:0/3600682089 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7eb8068150 0x7f7eb814bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:15.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.266+0000 7f7ebceb1700 1 -- 172.21.15.49:0/3600682089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7eb81520c0 msgr2=0x7f7eb81576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:15.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.266+0000 7f7ebceb1700 1 --2- 172.21.15.49:0/3600682089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7eb81520c0 0x7f7eb81576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:15.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.266+0000 7f7ebceb1700 1 -- 172.21.15.49:0/3600682089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb0009ae0 con 0x7f7eb81524a0 2023-11-30T18:23:15.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.266+0000 7f7eb77fe700 1 --2- 172.21.15.49:0/3600682089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7eb81520c0 0x7f7eb81576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:23:15.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.267+0000 7f7ebceb1700 1 --2- 172.21.15.49:0/3600682089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7eb81524a0 0x7f7eb814fbe0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7f7eb8047d20 tx=0x7f7eb0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:15.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.267+0000 7f7e9ffff700 1 -- 172.21.15.49:0/3600682089 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb00092e0 con 0x7f7eb81524a0 2023-11-30T18:23:15.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.267+0000 7f7e9ffff700 1 -- 172.21.15.49:0/3600682089 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb001e470 con 0x7f7eb81524a0 2023-11-30T18:23:15.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.267+0000 7f7ebe914700 1 -- 172.21.15.49:0/3600682089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb8153290 con 0x7f7eb81524a0 2023-11-30T18:23:15.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.267+0000 7f7e9ffff700 1 -- 172.21.15.49:0/3600682089 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb001e830 con 0x7f7eb81524a0 2023-11-30T18:23:15.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.267+0000 7f7ebe914700 1 -- 172.21.15.49:0/3600682089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb814c3b0 con 0x7f7eb81524a0 2023-11-30T18:23:15.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.268+0000 7f7ebe914700 1 -- 172.21.15.49:0/3600682089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb81537b0 con 0x7f7eb81524a0 2023-11-30T18:23:15.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.268+0000 7f7e9ffff700 1 -- 172.21.15.49:0/3600682089 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f7eb0003040 con 0x7f7eb81524a0 2023-11-30T18:23:15.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.269+0000 7f7e9ffff700 1 --2- 172.21.15.49:0/3600682089 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7ea405f270 0x7f7ea4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:15.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.269+0000 7f7e9ffff700 1 -- 172.21.15.49:0/3600682089 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f7eb007b980 con 0x7f7eb81524a0 2023-11-30T18:23:15.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.269+0000 7f7eb7fff700 1 --2- 172.21.15.49:0/3600682089 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7ea405f270 0x7f7ea4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:15.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.269+0000 7f7eb7fff700 1 --2- 172.21.15.49:0/3600682089 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7ea405f270 0x7f7ea4061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f7ea8009200 tx=0x7f7ea8008040).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:15.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.273+0000 7f7e9ffff700 1 -- 172.21.15.49:0/3600682089 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7eb81537b0 con 0x7f7eb81524a0 2023-11-30T18:23:15.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.489+0000 7f7ebe914700 1 -- 172.21.15.49:0/3600682089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7eb81537b0 con 0x7f7eb81524a0 2023-11-30T18:23:15.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.489+0000 7f7e9ffff700 1 -- 172.21.15.49:0/3600682089 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4499 (secure 0 0 0) 0x7f7eb81537b0 con 0x7f7eb81524a0 2023-11-30T18:23:15.490 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:23:15.490 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":77,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1849144206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1849144206},{"type":"v1","addr":"172.21.15.115:6837","nonce":1849144206}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":8686,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/3927708641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3927708641},{"type":"v1","addr":"172.21.15.115:6836","nonce":3927708641}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":8934,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3388701250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3388701250},{"type":"v1","addr":"172.21.15.49:6835","nonce":3388701250}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T18:23:12.095964+0000","modified":"2023-11-30T18:23:15.119579+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8937},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8937":{"gid":8937,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/3993546381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3993546381},{"type":"v1","addr":"172.21.15.49:6834","nonce":3993546381}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-11-30T18:23:15.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.491+0000 7f7ebe914700 1 -- 172.21.15.49:0/3600682089 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7ea405f270 msgr2=0x7f7ea4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:15.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.491+0000 7f7ebe914700 1 --2- 172.21.15.49:0/3600682089 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7ea405f270 0x7f7ea4061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f7ea8009200 tx=0x7f7ea8008040).stop 2023-11-30T18:23:15.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.491+0000 7f7ebe914700 1 -- 172.21.15.49:0/3600682089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7eb81524a0 msgr2=0x7f7eb814fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:15.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.491+0000 7f7ebe914700 1 --2- 172.21.15.49:0/3600682089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7eb81524a0 0x7f7eb814fbe0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7f7eb8047d20 tx=0x7f7eb0009840).stop 2023-11-30T18:23:15.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.491+0000 7f7ebe914700 1 -- 172.21.15.49:0/3600682089 shutdown_connections 2023-11-30T18:23:15.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.491+0000 7f7ebe914700 1 --2- 172.21.15.49:0/3600682089 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f7ea405f270 0x7f7ea4061730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:15.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.491+0000 7f7ebe914700 1 --2- 172.21.15.49:0/3600682089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7eb81524a0 0x7f7eb814fbe0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:15.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.491+0000 7f7ebe914700 1 --2- 172.21.15.49:0/3600682089 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7eb8068150 0x7f7eb814bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:15.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.491+0000 7f7ebe914700 1 --2- 172.21.15.49:0/3600682089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7eb81520c0 0x7f7eb81576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:15.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.491+0000 7f7ebe914700 1 -- 172.21.15.49:0/3600682089 >> 172.21.15.49:0/3600682089 conn(0x7f7eb80631d0 msgr2=0x7f7eb8158060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:15.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.491+0000 7f7ebe914700 1 -- 172.21.15.49:0/3600682089 shutdown_connections 2023-11-30T18:23:15.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.491+0000 7f7ebe914700 1 -- 172.21.15.49:0/3600682089 wait complete. 2023-11-30T18:23:15.493 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 77 2023-11-30T18:23:15.504 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:23:15.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.625+0000 7f402606f700 1 Processor -- start 2023-11-30T18:23:15.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.625+0000 7f402606f700 1 -- start start 2023-11-30T18:23:15.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.626+0000 7f402606f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f402006a610 0x7f40200a8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:15.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.626+0000 7f402606f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40200c69a0 con 0x7f40201544e0 2023-11-30T18:23:15.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.626+0000 7f402606f700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40200c13a0 con 0x7f40201548c0 2023-11-30T18:23:15.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.626+0000 7f402606f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40200c1680 con 0x7f402006a610 2023-11-30T18:23:15.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.626+0000 7f401f7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f40201544e0 0x7f40200c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39068/0 (socket says 172.21.15.49:39068) 2023-11-30T18:23:15.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.626+0000 7f401f7fe700 1 -- 172.21.15.49:0/699008851 learned_addr learned my addr 172.21.15.49:0/699008851 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:23:15.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.626+0000 7f401ffff700 1 --2- 172.21.15.49:0/699008851 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f402006a610 0x7f40200a8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:15.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.626+0000 7f401e7fc700 1 -- 172.21.15.49:0/699008851 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3127589521 0 0) 0x7f40200c69a0 con 0x7f40201544e0 2023-11-30T18:23:15.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.626+0000 7f401e7fc700 1 -- 172.21.15.49:0/699008851 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f400c0033f0 con 0x7f40201544e0 2023-11-30T18:23:15.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.626+0000 7f401e7fc700 1 -- 172.21.15.49:0/699008851 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2040095324 0 0) 0x7f40200c13a0 con 0x7f40201548c0 2023-11-30T18:23:15.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.626+0000 7f401e7fc700 1 -- 172.21.15.49:0/699008851 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40200c69a0 con 0x7f40201548c0 2023-11-30T18:23:15.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.626+0000 7f401ffff700 1 -- 172.21.15.49:0/699008851 >> v1:172.21.15.115:6789/0 conn(0x7f40201548c0 legacy=0x7f40200c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:15.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.626+0000 7f401e7fc700 1 -- 172.21.15.49:0/699008851 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2469738913 0 0) 0x7f400c0033f0 con 0x7f40201544e0 2023-11-30T18:23:15.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.626+0000 7f401ffff700 1 -- 172.21.15.49:0/699008851 >> v1:172.21.15.49:6789/0 conn(0x7f40201544e0 legacy=0x7f40200c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:15.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.626+0000 7f401ffff700 1 -- 172.21.15.49:0/699008851 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40200c6630 con 0x7f402006a610 2023-11-30T18:23:15.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.626+0000 7f401ffff700 1 --2- 172.21.15.49:0/699008851 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f402006a610 0x7f40200a8000 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f4010009790 tx=0x7f4010009060).ready entity=mon.2 client_cookie=8a10a1266b47a1cb server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:15.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.627+0000 7f401e7fc700 1 -- 172.21.15.49:0/699008851 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4018001970 con 0x7f402006a610 2023-11-30T18:23:15.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.627+0000 7f401e7fc700 1 -- 172.21.15.49:0/699008851 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4010011400 con 0x7f402006a610 2023-11-30T18:23:15.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.627+0000 7f401e7fc700 1 -- 172.21.15.49:0/699008851 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4010011780 con 0x7f402006a610 2023-11-30T18:23:15.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.627+0000 7f402606f700 1 -- 172.21.15.49:0/699008851 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f402006a610 msgr2=0x7f40200a8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:15.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.627+0000 7f402606f700 1 --2- 172.21.15.49:0/699008851 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f402006a610 0x7f40200a8000 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f4010009790 tx=0x7f4010009060).stop 2023-11-30T18:23:15.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.627+0000 7f402606f700 1 -- 172.21.15.49:0/699008851 shutdown_connections 2023-11-30T18:23:15.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.627+0000 7f402606f700 1 --2- 172.21.15.49:0/699008851 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f402006a610 0x7f40200a8000 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:15.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.627+0000 7f402606f700 1 -- 172.21.15.49:0/699008851 >> 172.21.15.49:0/699008851 conn(0x7f4020085020 msgr2=0x7f4020094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:15.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.627+0000 7f402606f700 1 -- 172.21.15.49:0/699008851 shutdown_connections 2023-11-30T18:23:15.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.627+0000 7f402606f700 1 -- 172.21.15.49:0/699008851 wait complete. 2023-11-30T18:23:15.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.628+0000 7f402606f700 1 Processor -- start 2023-11-30T18:23:15.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.628+0000 7f402606f700 1 -- start start 2023-11-30T18:23:15.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.629+0000 7f402606f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f402006a610 0x7f40200a8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:15.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.629+0000 7f402606f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40201544e0 0x7f4020167300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:15.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.629+0000 7f402606f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40201548c0 0x7f40201677f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:15.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.629+0000 7f402606f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4020096240 con 0x7f40201544e0 2023-11-30T18:23:15.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.629+0000 7f402606f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4020167ce0 con 0x7f40201548c0 2023-11-30T18:23:15.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.629+0000 7f402606f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4020095630 con 0x7f402006a610 2023-11-30T18:23:15.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.629+0000 7f401effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40201544e0 0x7f4020167300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:15.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.629+0000 7f401effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40201544e0 0x7f4020167300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45984/0 (socket says 172.21.15.49:45984) 2023-11-30T18:23:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.629+0000 7f401effd700 1 -- 172.21.15.49:0/1595484031 learned_addr learned my addr 172.21.15.49:0/1595484031 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.629+0000 7f401f7fe700 1 --2- 172.21.15.49:0/1595484031 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f402006a610 0x7f40200a8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.629+0000 7f401ffff700 1 --2- 172.21.15.49:0/1595484031 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40201548c0 0x7f40201677f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.629+0000 7f401effd700 1 -- 172.21.15.49:0/1595484031 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f402006a610 msgr2=0x7f40200a8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.629+0000 7f401effd700 1 --2- 172.21.15.49:0/1595484031 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f402006a610 0x7f40200a8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.630+0000 7f401effd700 1 -- 172.21.15.49:0/1595484031 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40201548c0 msgr2=0x7f40201677f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.630+0000 7f401effd700 1 --2- 172.21.15.49:0/1595484031 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40201548c0 0x7f40201677f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.630+0000 7f401effd700 1 -- 172.21.15.49:0/1595484031 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40100092a0 con 0x7f40201544e0 2023-11-30T18:23:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.630+0000 7f401f7fe700 1 --2- 172.21.15.49:0/1595484031 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f402006a610 0x7f40200a8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:23:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.630+0000 7f401effd700 1 --2- 172.21.15.49:0/1595484031 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40201544e0 0x7f4020167300 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7f400800c490 tx=0x7f4008007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.630+0000 7f40177fe700 1 -- 172.21.15.49:0/1595484031 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400800f470 con 0x7f40201544e0 2023-11-30T18:23:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.630+0000 7f40177fe700 1 -- 172.21.15.49:0/1595484031 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400800f5d0 con 0x7f40201544e0 2023-11-30T18:23:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.630+0000 7f402606f700 1 -- 172.21.15.49:0/1595484031 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4020095910 con 0x7f40201544e0 2023-11-30T18:23:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.630+0000 7f40177fe700 1 -- 172.21.15.49:0/1595484031 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400800f970 con 0x7f40201544e0 2023-11-30T18:23:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.630+0000 7f402606f700 1 -- 172.21.15.49:0/1595484031 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4020095ed0 con 0x7f40201544e0 2023-11-30T18:23:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.631+0000 7f402606f700 1 -- 172.21.15.49:0/1595484031 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40200654a0 con 0x7f40201544e0 2023-11-30T18:23:15.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.631+0000 7f40177fe700 1 -- 172.21.15.49:0/1595484031 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f400800fd20 con 0x7f40201544e0 2023-11-30T18:23:15.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.632+0000 7f40177fe700 1 --2- 172.21.15.49:0/1595484031 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f400005f270 0x7f4000061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:15.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.632+0000 7f40177fe700 1 -- 172.21.15.49:0/1595484031 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f4008079a30 con 0x7f40201544e0 2023-11-30T18:23:15.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.632+0000 7f401f7fe700 1 --2- 172.21.15.49:0/1595484031 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f400005f270 0x7f4000061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:15.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.632+0000 7f401f7fe700 1 --2- 172.21.15.49:0/1595484031 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f400005f270 0x7f4000061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f4018000f80 tx=0x7f4018009040).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:15.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.636+0000 7f40177fe700 1 -- 172.21.15.49:0/1595484031 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f400807be60 con 0x7f40201544e0 2023-11-30T18:23:15.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.809+0000 7f402606f700 1 -- 172.21.15.49:0/1595484031 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f402006c860 con 0x7f40201544e0 2023-11-30T18:23:15.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.810+0000 7f40177fe700 1 -- 172.21.15.49:0/1595484031 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v184) v1 ==== 74+0+17031 (secure 0 0 0) 0x7f400804ab40 con 0x7f40201544e0 2023-11-30T18:23:15.811 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:23:15.811 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":184,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:23:13.097198+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-11-30T18:23:10.276504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-11-30T18:23:11.078075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:23:15.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.812+0000 7f402606f700 1 -- 172.21.15.49:0/1595484031 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f400005f270 msgr2=0x7f4000061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:15.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.812+0000 7f402606f700 1 --2- 172.21.15.49:0/1595484031 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f400005f270 0x7f4000061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f4018000f80 tx=0x7f4018009040).stop 2023-11-30T18:23:15.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.812+0000 7f402606f700 1 -- 172.21.15.49:0/1595484031 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40201544e0 msgr2=0x7f4020167300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:15.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.812+0000 7f402606f700 1 --2- 172.21.15.49:0/1595484031 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40201544e0 0x7f4020167300 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7f400800c490 tx=0x7f4008007c90).stop 2023-11-30T18:23:15.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.812+0000 7f402606f700 1 -- 172.21.15.49:0/1595484031 shutdown_connections 2023-11-30T18:23:15.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.812+0000 7f402606f700 1 --2- 172.21.15.49:0/1595484031 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40201548c0 0x7f40201677f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:15.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.812+0000 7f402606f700 1 --2- 172.21.15.49:0/1595484031 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f402006a610 0x7f40200a8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:15.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.812+0000 7f402606f700 1 --2- 172.21.15.49:0/1595484031 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f400005f270 0x7f4000061730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:15.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.812+0000 7f402606f700 1 --2- 172.21.15.49:0/1595484031 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40201544e0 0x7f4020167300 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:15.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.812+0000 7f402606f700 1 -- 172.21.15.49:0/1595484031 >> 172.21.15.49:0/1595484031 conn(0x7f4020085020 msgr2=0x7f40200ae510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:15.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.812+0000 7f402606f700 1 -- 172.21.15.49:0/1595484031 shutdown_connections 2023-11-30T18:23:15.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.812+0000 7f402606f700 1 -- 172.21.15.49:0/1595484031 wait complete. 2023-11-30T18:23:15.825 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-30T18:23:15.825 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T18:23:15.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.943+0000 7f4b29875700 1 Processor -- start 2023-11-30T18:23:15.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.943+0000 7f4b29875700 1 -- start start 2023-11-30T18:23:15.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.944+0000 7f4b29875700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4b241544d0 0x7f4b24155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:15.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.944+0000 7f4b29875700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4b24066f40 0x7f4b24095e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:15.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.944+0000 7f4b29875700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b240673c0 0x7f4b24096370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:15.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.944+0000 7f4b29875700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b24096860 con 0x7f4b24066f40 2023-11-30T18:23:15.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.944+0000 7f4b29875700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b240683d0 con 0x7f4b241544d0 2023-11-30T18:23:15.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.944+0000 7f4b29875700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b24067850 con 0x7f4b240673c0 2023-11-30T18:23:15.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.944+0000 7f4b227fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4b24066f40 0x7f4b24095e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:15.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.944+0000 7f4b227fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4b24066f40 0x7f4b24095e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45988/0 (socket says 172.21.15.49:45988) 2023-11-30T18:23:15.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.944+0000 7f4b227fc700 1 -- 172.21.15.49:0/2433855589 learned_addr learned my addr 172.21.15.49:0/2433855589 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:15.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.944+0000 7f4b22ffd700 1 --2- 172.21.15.49:0/2433855589 >> v2:172.21.15.115:3300/0 conn(0x7f4b241544d0 0x7f4b24155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:15.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.944+0000 7f4b227fc700 1 -- 172.21.15.49:0/2433855589 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b240673c0 msgr2=0x7f4b24096370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:15.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.944+0000 7f4b237fe700 1 --2- 172.21.15.49:0/2433855589 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b240673c0 0x7f4b24096370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:15.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.944+0000 7f4b227fc700 1 --2- 172.21.15.49:0/2433855589 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b240673c0 0x7f4b24096370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:15.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.944+0000 7f4b227fc700 1 -- 172.21.15.49:0/2433855589 >> v2:172.21.15.115:3300/0 conn(0x7f4b241544d0 msgr2=0x7f4b24155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:15.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.944+0000 7f4b227fc700 1 --2- 172.21.15.49:0/2433855589 >> v2:172.21.15.115:3300/0 conn(0x7f4b241544d0 0x7f4b24155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:15.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.944+0000 7f4b227fc700 1 -- 172.21.15.49:0/2433855589 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b24067b30 con 0x7f4b24066f40 2023-11-30T18:23:15.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.944+0000 7f4b227fc700 1 --2- 172.21.15.49:0/2433855589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b24066f40 0x7f4b24095e80 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f4b2406c7c0 tx=0x7f4b180090f0).ready entity=mon.0 client_cookie=7af8996ac25fe050 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:15.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.944+0000 7f4b21ffb700 1 -- 172.21.15.49:0/2433855589 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1800b600 con 0x7f4b24066f40 2023-11-30T18:23:15.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.944+0000 7f4b21ffb700 1 -- 172.21.15.49:0/2433855589 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1800b760 con 0x7f4b24066f40 2023-11-30T18:23:15.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.944+0000 7f4b21ffb700 1 -- 172.21.15.49:0/2433855589 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1800bae0 con 0x7f4b24066f40 2023-11-30T18:23:15.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.945+0000 7f4b29875700 1 -- 172.21.15.49:0/2433855589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b24066f40 msgr2=0x7f4b24095e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:15.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.945+0000 7f4b29875700 1 --2- 172.21.15.49:0/2433855589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b24066f40 0x7f4b24095e80 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f4b2406c7c0 tx=0x7f4b180090f0).stop 2023-11-30T18:23:15.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.945+0000 7f4b29875700 1 -- 172.21.15.49:0/2433855589 shutdown_connections 2023-11-30T18:23:15.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.945+0000 7f4b29875700 1 --2- 172.21.15.49:0/2433855589 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b240673c0 0x7f4b24096370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:15.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.945+0000 7f4b29875700 1 --2- 172.21.15.49:0/2433855589 >> v2:172.21.15.115:3300/0 conn(0x7f4b241544d0 0x7f4b24155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:15.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.945+0000 7f4b29875700 1 --2- 172.21.15.49:0/2433855589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b24066f40 0x7f4b24095e80 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:15.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.945+0000 7f4b29875700 1 -- 172.21.15.49:0/2433855589 >> 172.21.15.49:0/2433855589 conn(0x7f4b240631d0 msgr2=0x7f4b240c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:15.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.945+0000 7f4b29875700 1 -- 172.21.15.49:0/2433855589 shutdown_connections 2023-11-30T18:23:15.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.945+0000 7f4b29875700 1 -- 172.21.15.49:0/2433855589 wait complete. 2023-11-30T18:23:15.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.946+0000 7f4b29875700 1 Processor -- start 2023-11-30T18:23:15.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.946+0000 7f4b29875700 1 -- start start 2023-11-30T18:23:15.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.947+0000 7f4b29875700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b24066f40 0x7f4b241563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:15.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.947+0000 7f4b29875700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b241544d0 0x7f4b241554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:15.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.947+0000 7f4b29875700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b240c48f0 0x7f4b240c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:15.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.947+0000 7f4b29875700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2414c540 con 0x7f4b241544d0 2023-11-30T18:23:15.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.947+0000 7f4b29875700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b240c5240 con 0x7f4b240c48f0 2023-11-30T18:23:15.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.947+0000 7f4b29875700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b24150700 con 0x7f4b24066f40 2023-11-30T18:23:15.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.947+0000 7f4b227fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b241544d0 0x7f4b241554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:15.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.947+0000 7f4b227fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b241544d0 0x7f4b241554a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45994/0 (socket says 172.21.15.49:45994) 2023-11-30T18:23:15.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.947+0000 7f4b227fc700 1 -- 172.21.15.49:0/2557371341 learned_addr learned my addr 172.21.15.49:0/2557371341 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:15.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.947+0000 7f4b22ffd700 1 --2- 172.21.15.49:0/2557371341 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b24066f40 0x7f4b241563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:15.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.947+0000 7f4b237fe700 1 --2- 172.21.15.49:0/2557371341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b240c48f0 0x7f4b240c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:15.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.947+0000 7f4b227fc700 1 -- 172.21.15.49:0/2557371341 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b24066f40 msgr2=0x7f4b241563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:15.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.947+0000 7f4b227fc700 1 --2- 172.21.15.49:0/2557371341 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b24066f40 0x7f4b241563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:15.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.947+0000 7f4b227fc700 1 -- 172.21.15.49:0/2557371341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b240c48f0 msgr2=0x7f4b240c4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:15.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.947+0000 7f4b227fc700 1 --2- 172.21.15.49:0/2557371341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b240c48f0 0x7f4b240c4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:15.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.947+0000 7f4b227fc700 1 -- 172.21.15.49:0/2557371341 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b18009370 con 0x7f4b241544d0 2023-11-30T18:23:15.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.947+0000 7f4b22ffd700 1 --2- 172.21.15.49:0/2557371341 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b24066f40 0x7f4b241563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:23:15.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.947+0000 7f4b237fe700 1 --2- 172.21.15.49:0/2557371341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b240c48f0 0x7f4b240c4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:23:15.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.948+0000 7f4b227fc700 1 --2- 172.21.15.49:0/2557371341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b241544d0 0x7f4b241554a0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7f4b18009130 tx=0x7f4b18017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:15.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.948+0000 7f4b0affd700 1 -- 172.21.15.49:0/2557371341 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1800bae0 con 0x7f4b241544d0 2023-11-30T18:23:15.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.948+0000 7f4b0affd700 1 -- 172.21.15.49:0/2557371341 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b18000c90 con 0x7f4b241544d0 2023-11-30T18:23:15.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.948+0000 7f4b29875700 1 -- 172.21.15.49:0/2557371341 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b241509a0 con 0x7f4b241544d0 2023-11-30T18:23:15.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.948+0000 7f4b0affd700 1 -- 172.21.15.49:0/2557371341 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1801c670 con 0x7f4b241544d0 2023-11-30T18:23:15.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.948+0000 7f4b29875700 1 -- 172.21.15.49:0/2557371341 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b24150f60 con 0x7f4b241544d0 2023-11-30T18:23:15.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.949+0000 7f4b29875700 1 -- 172.21.15.49:0/2557371341 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b2406c860 con 0x7f4b241544d0 2023-11-30T18:23:15.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.949+0000 7f4b0affd700 1 -- 172.21.15.49:0/2557371341 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4b1801ca20 con 0x7f4b241544d0 2023-11-30T18:23:15.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.949+0000 7f4b0affd700 1 --2- 172.21.15.49:0/2557371341 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4b1005f270 0x7f4b10061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:15.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.949+0000 7f4b0affd700 1 -- 172.21.15.49:0/2557371341 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f4b1807c1b0 con 0x7f4b241544d0 2023-11-30T18:23:15.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.950+0000 7f4b22ffd700 1 --2- 172.21.15.49:0/2557371341 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4b1005f270 0x7f4b10061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:15.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.950+0000 7f4b22ffd700 1 --2- 172.21.15.49:0/2557371341 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4b1005f270 0x7f4b10061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f4b14006fd0 tx=0x7f4b14008040).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:15.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:15.954+0000 7f4b0affd700 1 -- 172.21.15.49:0/2557371341 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4b18050cf0 con 0x7f4b241544d0 2023-11-30T18:23:16.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.125+0000 7f4b29875700 1 -- 172.21.15.49:0/2557371341 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4b24067e10 con 0x7f4b1005f270 2023-11-30T18:23:16.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.136+0000 7f4b0affd700 1 -- 172.21.15.49:0/2557371341 <== mgr.7394 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359469 (secure 0 0 0) 0x7f4b24067e10 con 0x7f4b1005f270 2023-11-30T18:23:16.141 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:23:16.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.139+0000 7f4b29875700 1 -- 172.21.15.49:0/2557371341 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4b1005f270 msgr2=0x7f4b10061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:16.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.139+0000 7f4b29875700 1 --2- 172.21.15.49:0/2557371341 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4b1005f270 0x7f4b10061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f4b14006fd0 tx=0x7f4b14008040).stop 2023-11-30T18:23:16.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.139+0000 7f4b29875700 1 -- 172.21.15.49:0/2557371341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b241544d0 msgr2=0x7f4b241554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:16.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.139+0000 7f4b29875700 1 --2- 172.21.15.49:0/2557371341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b241544d0 0x7f4b241554a0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7f4b18009130 tx=0x7f4b18017000).stop 2023-11-30T18:23:16.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.140+0000 7f4b29875700 1 -- 172.21.15.49:0/2557371341 shutdown_connections 2023-11-30T18:23:16.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.140+0000 7f4b29875700 1 --2- 172.21.15.49:0/2557371341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b240c48f0 0x7f4b240c4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:16.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.140+0000 7f4b29875700 1 --2- 172.21.15.49:0/2557371341 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b24066f40 0x7f4b241563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:16.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.140+0000 7f4b29875700 1 --2- 172.21.15.49:0/2557371341 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f4b1005f270 0x7f4b10061730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:16.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.140+0000 7f4b29875700 1 --2- 172.21.15.49:0/2557371341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b241544d0 0x7f4b241554a0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:16.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.140+0000 7f4b29875700 1 -- 172.21.15.49:0/2557371341 >> 172.21.15.49:0/2557371341 conn(0x7f4b240631d0 msgr2=0x7f4b2414c840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:16.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.140+0000 7f4b29875700 1 -- 172.21.15.49:0/2557371341 shutdown_connections 2023-11-30T18:23:16.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.140+0000 7f4b29875700 1 -- 172.21.15.49:0/2557371341 wait complete. 2023-11-30T18:23:16.144 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T18:23:16.152 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-30T18:23:15.227279+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":212,"acting":212,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2464280,"kb_used_data":17880,"kb_used_omap":0,"kb_used_meta":2446336,"kb_avail":752510440,"statfs":{"total":773094113280,"available":770570690560,"internally_reserved":0,"allocated":18309120,"data_stored":9329994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2505048064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13567,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-67,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.003614"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3f","version":"183'3","reported_seq":13,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120488+0000","last_change":"2023-11-30T18:23:11.729396+0000","last_active":"2023-11-30T18:23:12.120488+0000","last_peered":"2023-11-30T18:23:12.120488+0000","last_clean":"2023-11-30T18:23:12.120488+0000","last_became_active":"2023-11-30T18:23:11.729108+0000","last_became_peered":"2023-11-30T18:23:11.729108+0000","last_unstale":"2023-11-30T18:23:12.120488+0000","last_undegraded":"2023-11-30T18:23:12.120488+0000","last_fullsized":"2023-11-30T18:23:12.120488+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120073+0000","last_change":"2023-11-30T18:23:12.118530+0000","last_active":"2023-11-30T18:23:12.120073+0000","last_peered":"2023-11-30T18:23:12.120073+0000","last_clean":"2023-11-30T18:23:12.120073+0000","last_became_active":"2023-11-30T18:23:12.118224+0000","last_became_peered":"2023-11-30T18:23:12.118224+0000","last_unstale":"2023-11-30T18:23:12.120073+0000","last_undegraded":"2023-11-30T18:23:12.120073+0000","last_fullsized":"2023-11-30T18:23:12.120073+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.104272+0000","last_change":"2023-11-30T18:23:11.724379+0000","last_active":"2023-11-30T18:23:12.104272+0000","last_peered":"2023-11-30T18:23:12.104272+0000","last_clean":"2023-11-30T18:23:12.104272+0000","last_became_active":"2023-11-30T18:23:11.724081+0000","last_became_peered":"2023-11-30T18:23:11.724081+0000","last_unstale":"2023-11-30T18:23:12.104272+0000","last_undegraded":"2023-11-30T18:23:12.104272+0000","last_fullsized":"2023-11-30T18:23:12.104272+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112554+0000","last_change":"2023-11-30T18:23:12.108411+0000","last_active":"2023-11-30T18:23:12.112554+0000","last_peered":"2023-11-30T18:23:12.112554+0000","last_clean":"2023-11-30T18:23:12.112554+0000","last_became_active":"2023-11-30T18:23:12.108120+0000","last_became_peered":"2023-11-30T18:23:12.108120+0000","last_unstale":"2023-11-30T18:23:12.112554+0000","last_undegraded":"2023-11-30T18:23:12.112554+0000","last_fullsized":"2023-11-30T18:23:12.112554+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120555+0000","last_change":"2023-11-30T18:23:12.112331+0000","last_active":"2023-11-30T18:23:12.120555+0000","last_peered":"2023-11-30T18:23:12.120555+0000","last_clean":"2023-11-30T18:23:12.120555+0000","last_became_active":"2023-11-30T18:23:12.111049+0000","last_became_peered":"2023-11-30T18:23:12.111049+0000","last_unstale":"2023-11-30T18:23:12.120555+0000","last_undegraded":"2023-11-30T18:23:12.120555+0000","last_fullsized":"2023-11-30T18:23:12.120555+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128170+0000","last_change":"2023-11-30T18:23:11.730906+0000","last_active":"2023-11-30T18:23:12.128170+0000","last_peered":"2023-11-30T18:23:12.128170+0000","last_clean":"2023-11-30T18:23:12.128170+0000","last_became_active":"2023-11-30T18:23:11.729501+0000","last_became_peered":"2023-11-30T18:23:11.729501+0000","last_unstale":"2023-11-30T18:23:12.128170+0000","last_undegraded":"2023-11-30T18:23:12.128170+0000","last_fullsized":"2023-11-30T18:23:12.128170+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120886+0000","last_change":"2023-11-30T18:23:12.118680+0000","last_active":"2023-11-30T18:23:12.120886+0000","last_peered":"2023-11-30T18:23:12.120886+0000","last_clean":"2023-11-30T18:23:12.120886+0000","last_became_active":"2023-11-30T18:23:12.118358+0000","last_became_peered":"2023-11-30T18:23:12.118358+0000","last_unstale":"2023-11-30T18:23:12.120886+0000","last_undegraded":"2023-11-30T18:23:12.120886+0000","last_fullsized":"2023-11-30T18:23:12.120886+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114112+0000","last_change":"2023-11-30T18:23:11.732949+0000","last_active":"2023-11-30T18:23:12.114112+0000","last_peered":"2023-11-30T18:23:12.114112+0000","last_clean":"2023-11-30T18:23:12.114112+0000","last_became_active":"2023-11-30T18:23:11.732627+0000","last_became_peered":"2023-11-30T18:23:11.732627+0000","last_unstale":"2023-11-30T18:23:12.114112+0000","last_undegraded":"2023-11-30T18:23:12.114112+0000","last_fullsized":"2023-11-30T18:23:12.114112+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.123862+0000","last_change":"2023-11-30T18:23:12.121133+0000","last_active":"2023-11-30T18:23:12.123862+0000","last_peered":"2023-11-30T18:23:12.123862+0000","last_clean":"2023-11-30T18:23:12.123862+0000","last_became_active":"2023-11-30T18:23:12.120811+0000","last_became_peered":"2023-11-30T18:23:12.120811+0000","last_unstale":"2023-11-30T18:23:12.123862+0000","last_undegraded":"2023-11-30T18:23:12.123862+0000","last_fullsized":"2023-11-30T18:23:12.123862+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105568+0000","last_change":"2023-11-30T18:23:11.732157+0000","last_active":"2023-11-30T18:23:12.105568+0000","last_peered":"2023-11-30T18:23:12.105568+0000","last_clean":"2023-11-30T18:23:12.105568+0000","last_became_active":"2023-11-30T18:23:11.731678+0000","last_became_peered":"2023-11-30T18:23:11.731678+0000","last_unstale":"2023-11-30T18:23:12.105568+0000","last_undegraded":"2023-11-30T18:23:12.105568+0000","last_fullsized":"2023-11-30T18:23:12.105568+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124562+0000","last_change":"2023-11-30T18:23:12.121281+0000","last_active":"2023-11-30T18:23:12.124562+0000","last_peered":"2023-11-30T18:23:12.124562+0000","last_clean":"2023-11-30T18:23:12.124562+0000","last_became_active":"2023-11-30T18:23:12.119940+0000","last_became_peered":"2023-11-30T18:23:12.119940+0000","last_unstale":"2023-11-30T18:23:12.124562+0000","last_undegraded":"2023-11-30T18:23:12.124562+0000","last_fullsized":"2023-11-30T18:23:12.124562+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.099560+0000","last_change":"2023-11-30T18:23:11.729413+0000","last_active":"2023-11-30T18:23:12.099560+0000","last_peered":"2023-11-30T18:23:12.099560+0000","last_clean":"2023-11-30T18:23:12.099560+0000","last_became_active":"2023-11-30T18:23:11.729096+0000","last_became_peered":"2023-11-30T18:23:11.729096+0000","last_unstale":"2023-11-30T18:23:12.099560+0000","last_undegraded":"2023-11-30T18:23:12.099560+0000","last_fullsized":"2023-11-30T18:23:12.099560+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.103587+0000","last_change":"2023-11-30T18:23:11.731558+0000","last_active":"2023-11-30T18:23:12.103587+0000","last_peered":"2023-11-30T18:23:12.103587+0000","last_clean":"2023-11-30T18:23:12.103587+0000","last_became_active":"2023-11-30T18:23:11.731257+0000","last_became_peered":"2023-11-30T18:23:11.731257+0000","last_unstale":"2023-11-30T18:23:12.103587+0000","last_undegraded":"2023-11-30T18:23:12.103587+0000","last_fullsized":"2023-11-30T18:23:12.103587+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124485+0000","last_change":"2023-11-30T18:23:12.119514+0000","last_active":"2023-11-30T18:23:12.124485+0000","last_peered":"2023-11-30T18:23:12.124485+0000","last_clean":"2023-11-30T18:23:12.124485+0000","last_became_active":"2023-11-30T18:23:12.119170+0000","last_became_peered":"2023-11-30T18:23:12.119170+0000","last_unstale":"2023-11-30T18:23:12.124485+0000","last_undegraded":"2023-11-30T18:23:12.124485+0000","last_fullsized":"2023-11-30T18:23:12.124485+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.118785+0000","last_change":"2023-11-30T18:23:11.733798+0000","last_active":"2023-11-30T18:23:12.118785+0000","last_peered":"2023-11-30T18:23:12.118785+0000","last_clean":"2023-11-30T18:23:12.118785+0000","last_became_active":"2023-11-30T18:23:11.733491+0000","last_became_peered":"2023-11-30T18:23:11.733491+0000","last_unstale":"2023-11-30T18:23:12.118785+0000","last_undegraded":"2023-11-30T18:23:12.118785+0000","last_fullsized":"2023-11-30T18:23:12.118785+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.113796+0000","last_change":"2023-11-30T18:23:12.111493+0000","last_active":"2023-11-30T18:23:12.113796+0000","last_peered":"2023-11-30T18:23:12.113796+0000","last_clean":"2023-11-30T18:23:12.113796+0000","last_became_active":"2023-11-30T18:23:12.111224+0000","last_became_peered":"2023-11-30T18:23:12.111224+0000","last_unstale":"2023-11-30T18:23:12.113796+0000","last_undegraded":"2023-11-30T18:23:12.113796+0000","last_fullsized":"2023-11-30T18:23:12.113796+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101233+0000","last_change":"2023-11-30T18:23:11.732288+0000","last_active":"2023-11-30T18:23:12.101233+0000","last_peered":"2023-11-30T18:23:12.101233+0000","last_clean":"2023-11-30T18:23:12.101233+0000","last_became_active":"2023-11-30T18:23:11.731998+0000","last_became_peered":"2023-11-30T18:23:11.731998+0000","last_unstale":"2023-11-30T18:23:12.101233+0000","last_undegraded":"2023-11-30T18:23:12.101233+0000","last_fullsized":"2023-11-30T18:23:12.101233+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.123377+0000","last_change":"2023-11-30T18:23:12.118762+0000","last_active":"2023-11-30T18:23:12.123377+0000","last_peered":"2023-11-30T18:23:12.123377+0000","last_clean":"2023-11-30T18:23:12.123377+0000","last_became_active":"2023-11-30T18:23:12.118456+0000","last_became_peered":"2023-11-30T18:23:12.118456+0000","last_unstale":"2023-11-30T18:23:12.123377+0000","last_undegraded":"2023-11-30T18:23:12.123377+0000","last_fullsized":"2023-11-30T18:23:12.123377+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.34","version":"183'4","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.133525+0000","last_change":"2023-11-30T18:23:11.735207+0000","last_active":"2023-11-30T18:23:12.133525+0000","last_peered":"2023-11-30T18:23:12.133525+0000","last_clean":"2023-11-30T18:23:12.133525+0000","last_became_active":"2023-11-30T18:23:11.734947+0000","last_became_peered":"2023-11-30T18:23:11.734947+0000","last_unstale":"2023-11-30T18:23:12.133525+0000","last_undegraded":"2023-11-30T18:23:12.133525+0000","last_fullsized":"2023-11-30T18:23:12.133525+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112616+0000","last_change":"2023-11-30T18:23:12.110171+0000","last_active":"2023-11-30T18:23:12.112616+0000","last_peered":"2023-11-30T18:23:12.112616+0000","last_clean":"2023-11-30T18:23:12.112616+0000","last_became_active":"2023-11-30T18:23:12.109894+0000","last_became_peered":"2023-11-30T18:23:12.109894+0000","last_unstale":"2023-11-30T18:23:12.112616+0000","last_undegraded":"2023-11-30T18:23:12.112616+0000","last_fullsized":"2023-11-30T18:23:12.112616+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.33","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128319+0000","last_change":"2023-11-30T18:23:11.732423+0000","last_active":"2023-11-30T18:23:12.128319+0000","last_peered":"2023-11-30T18:23:12.128319+0000","last_clean":"2023-11-30T18:23:12.128319+0000","last_became_active":"2023-11-30T18:23:11.732141+0000","last_became_peered":"2023-11-30T18:23:11.732141+0000","last_unstale":"2023-11-30T18:23:12.128319+0000","last_undegraded":"2023-11-30T18:23:12.128319+0000","last_fullsized":"2023-11-30T18:23:12.128319+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114206+0000","last_change":"2023-11-30T18:23:12.113067+0000","last_active":"2023-11-30T18:23:12.114206+0000","last_peered":"2023-11-30T18:23:12.114206+0000","last_clean":"2023-11-30T18:23:12.114206+0000","last_became_active":"2023-11-30T18:23:12.112084+0000","last_became_peered":"2023-11-30T18:23:12.112084+0000","last_unstale":"2023-11-30T18:23:12.114206+0000","last_undegraded":"2023-11-30T18:23:12.114206+0000","last_fullsized":"2023-11-30T18:23:12.114206+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114699+0000","last_change":"2023-11-30T18:23:11.731206+0000","last_active":"2023-11-30T18:23:12.114699+0000","last_peered":"2023-11-30T18:23:12.114699+0000","last_clean":"2023-11-30T18:23:12.114699+0000","last_became_active":"2023-11-30T18:23:11.730937+0000","last_became_peered":"2023-11-30T18:23:11.730937+0000","last_unstale":"2023-11-30T18:23:12.114699+0000","last_undegraded":"2023-11-30T18:23:12.114699+0000","last_fullsized":"2023-11-30T18:23:12.114699+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.116858+0000","last_change":"2023-11-30T18:23:12.115316+0000","last_active":"2023-11-30T18:23:12.116858+0000","last_peered":"2023-11-30T18:23:12.116858+0000","last_clean":"2023-11-30T18:23:12.116858+0000","last_became_active":"2023-11-30T18:23:12.114473+0000","last_became_peered":"2023-11-30T18:23:12.114473+0000","last_unstale":"2023-11-30T18:23:12.116858+0000","last_undegraded":"2023-11-30T18:23:12.116858+0000","last_fullsized":"2023-11-30T18:23:12.116858+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.30","version":"183'4","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.127276+0000","last_change":"2023-11-30T18:23:11.729498+0000","last_active":"2023-11-30T18:23:12.127276+0000","last_peered":"2023-11-30T18:23:12.127276+0000","last_clean":"2023-11-30T18:23:12.127276+0000","last_became_active":"2023-11-30T18:23:11.729221+0000","last_became_peered":"2023-11-30T18:23:11.729221+0000","last_unstale":"2023-11-30T18:23:12.127276+0000","last_undegraded":"2023-11-30T18:23:12.127276+0000","last_fullsized":"2023-11-30T18:23:12.127276+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.118300+0000","last_change":"2023-11-30T18:23:12.113823+0000","last_active":"2023-11-30T18:23:12.118300+0000","last_peered":"2023-11-30T18:23:12.118300+0000","last_clean":"2023-11-30T18:23:12.118300+0000","last_became_active":"2023-11-30T18:23:12.113041+0000","last_became_peered":"2023-11-30T18:23:12.113041+0000","last_unstale":"2023-11-30T18:23:12.118300+0000","last_undegraded":"2023-11-30T18:23:12.118300+0000","last_fullsized":"2023-11-30T18:23:12.118300+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120207+0000","last_change":"2023-11-30T18:23:11.737572+0000","last_active":"2023-11-30T18:23:12.120207+0000","last_peered":"2023-11-30T18:23:12.120207+0000","last_clean":"2023-11-30T18:23:12.120207+0000","last_became_active":"2023-11-30T18:23:11.737226+0000","last_became_peered":"2023-11-30T18:23:11.737226+0000","last_unstale":"2023-11-30T18:23:12.120207+0000","last_undegraded":"2023-11-30T18:23:12.120207+0000","last_fullsized":"2023-11-30T18:23:12.120207+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.136298+0000","last_change":"2023-11-30T18:23:12.131062+0000","last_active":"2023-11-30T18:23:12.136298+0000","last_peered":"2023-11-30T18:23:12.136298+0000","last_clean":"2023-11-30T18:23:12.136298+0000","last_became_active":"2023-11-30T18:23:12.130780+0000","last_became_peered":"2023-11-30T18:23:12.130780+0000","last_unstale":"2023-11-30T18:23:12.136298+0000","last_undegraded":"2023-11-30T18:23:12.136298+0000","last_fullsized":"2023-11-30T18:23:12.136298+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124700+0000","last_change":"2023-11-30T18:23:12.122966+0000","last_active":"2023-11-30T18:23:12.124700+0000","last_peered":"2023-11-30T18:23:12.124700+0000","last_clean":"2023-11-30T18:23:12.124700+0000","last_became_active":"2023-11-30T18:23:12.122442+0000","last_became_peered":"2023-11-30T18:23:12.122442+0000","last_unstale":"2023-11-30T18:23:12.124700+0000","last_undegraded":"2023-11-30T18:23:12.124700+0000","last_fullsized":"2023-11-30T18:23:12.124700+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.125158+0000","last_change":"2023-11-30T18:23:11.732298+0000","last_active":"2023-11-30T18:23:12.125158+0000","last_peered":"2023-11-30T18:23:12.125158+0000","last_clean":"2023-11-30T18:23:12.125158+0000","last_became_active":"2023-11-30T18:23:11.731767+0000","last_became_peered":"2023-11-30T18:23:11.731767+0000","last_unstale":"2023-11-30T18:23:12.125158+0000","last_undegraded":"2023-11-30T18:23:12.125158+0000","last_fullsized":"2023-11-30T18:23:12.125158+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.121943+0000","last_change":"2023-11-30T18:23:11.728290+0000","last_active":"2023-11-30T18:23:12.121943+0000","last_peered":"2023-11-30T18:23:12.121943+0000","last_clean":"2023-11-30T18:23:12.121943+0000","last_became_active":"2023-11-30T18:23:11.727972+0000","last_became_peered":"2023-11-30T18:23:11.727972+0000","last_unstale":"2023-11-30T18:23:12.121943+0000","last_undegraded":"2023-11-30T18:23:12.121943+0000","last_fullsized":"2023-11-30T18:23:12.121943+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.125287+0000","last_change":"2023-11-30T18:23:12.117183+0000","last_active":"2023-11-30T18:23:12.125287+0000","last_peered":"2023-11-30T18:23:12.125287+0000","last_clean":"2023-11-30T18:23:12.125287+0000","last_became_active":"2023-11-30T18:23:12.116864+0000","last_became_peered":"2023-11-30T18:23:12.116864+0000","last_unstale":"2023-11-30T18:23:12.125287+0000","last_undegraded":"2023-11-30T18:23:12.125287+0000","last_fullsized":"2023-11-30T18:23:12.125287+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.127634+0000","last_change":"2023-11-30T18:23:11.735658+0000","last_active":"2023-11-30T18:23:12.127634+0000","last_peered":"2023-11-30T18:23:12.127634+0000","last_clean":"2023-11-30T18:23:12.127634+0000","last_became_active":"2023-11-30T18:23:11.735382+0000","last_became_peered":"2023-11-30T18:23:11.735382+0000","last_unstale":"2023-11-30T18:23:12.127634+0000","last_undegraded":"2023-11-30T18:23:12.127634+0000","last_fullsized":"2023-11-30T18:23:12.127634+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128740+0000","last_change":"2023-11-30T18:23:12.124153+0000","last_active":"2023-11-30T18:23:12.128740+0000","last_peered":"2023-11-30T18:23:12.128740+0000","last_clean":"2023-11-30T18:23:12.128740+0000","last_became_active":"2023-11-30T18:23:12.123877+0000","last_became_peered":"2023-11-30T18:23:12.123877+0000","last_unstale":"2023-11-30T18:23:12.128740+0000","last_undegraded":"2023-11-30T18:23:12.128740+0000","last_fullsized":"2023-11-30T18:23:12.128740+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.126056+0000","last_change":"2023-11-30T18:23:12.124681+0000","last_active":"2023-11-30T18:23:12.126056+0000","last_peered":"2023-11-30T18:23:12.126056+0000","last_clean":"2023-11-30T18:23:12.126056+0000","last_became_active":"2023-11-30T18:23:12.124348+0000","last_became_peered":"2023-11-30T18:23:12.124348+0000","last_unstale":"2023-11-30T18:23:12.126056+0000","last_undegraded":"2023-11-30T18:23:12.126056+0000","last_fullsized":"2023-11-30T18:23:12.126056+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.116384+0000","last_change":"2023-11-30T18:23:11.734523+0000","last_active":"2023-11-30T18:23:12.116384+0000","last_peered":"2023-11-30T18:23:12.116384+0000","last_clean":"2023-11-30T18:23:12.116384+0000","last_became_active":"2023-11-30T18:23:11.734241+0000","last_became_peered":"2023-11-30T18:23:11.734241+0000","last_unstale":"2023-11-30T18:23:12.116384+0000","last_undegraded":"2023-11-30T18:23:12.116384+0000","last_fullsized":"2023-11-30T18:23:12.116384+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124583+0000","last_change":"2023-11-30T18:23:12.122081+0000","last_active":"2023-11-30T18:23:12.124583+0000","last_peered":"2023-11-30T18:23:12.124583+0000","last_clean":"2023-11-30T18:23:12.124583+0000","last_became_active":"2023-11-30T18:23:12.121493+0000","last_became_peered":"2023-11-30T18:23:12.121493+0000","last_unstale":"2023-11-30T18:23:12.124583+0000","last_undegraded":"2023-11-30T18:23:12.124583+0000","last_fullsized":"2023-11-30T18:23:12.124583+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.119133+0000","last_change":"2023-11-30T18:23:11.734920+0000","last_active":"2023-11-30T18:23:12.119133+0000","last_peered":"2023-11-30T18:23:12.119133+0000","last_clean":"2023-11-30T18:23:12.119133+0000","last_became_active":"2023-11-30T18:23:11.734578+0000","last_became_peered":"2023-11-30T18:23:11.734578+0000","last_unstale":"2023-11-30T18:23:12.119133+0000","last_undegraded":"2023-11-30T18:23:12.119133+0000","last_fullsized":"2023-11-30T18:23:12.119133+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.123244+0000","last_change":"2023-11-30T18:23:12.118073+0000","last_active":"2023-11-30T18:23:12.123244+0000","last_peered":"2023-11-30T18:23:12.123244+0000","last_clean":"2023-11-30T18:23:12.123244+0000","last_became_active":"2023-11-30T18:23:12.117796+0000","last_became_peered":"2023-11-30T18:23:12.117796+0000","last_unstale":"2023-11-30T18:23:12.123244+0000","last_undegraded":"2023-11-30T18:23:12.123244+0000","last_fullsized":"2023-11-30T18:23:12.123244+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101617+0000","last_change":"2023-11-30T18:23:11.728070+0000","last_active":"2023-11-30T18:23:12.101617+0000","last_peered":"2023-11-30T18:23:12.101617+0000","last_clean":"2023-11-30T18:23:12.101617+0000","last_became_active":"2023-11-30T18:23:11.727817+0000","last_became_peered":"2023-11-30T18:23:11.727817+0000","last_unstale":"2023-11-30T18:23:12.101617+0000","last_undegraded":"2023-11-30T18:23:12.101617+0000","last_fullsized":"2023-11-30T18:23:12.101617+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120898+0000","last_change":"2023-11-30T18:23:12.119472+0000","last_active":"2023-11-30T18:23:12.120898+0000","last_peered":"2023-11-30T18:23:12.120898+0000","last_clean":"2023-11-30T18:23:12.120898+0000","last_became_active":"2023-11-30T18:23:12.119192+0000","last_became_peered":"2023-11-30T18:23:12.119192+0000","last_unstale":"2023-11-30T18:23:12.120898+0000","last_undegraded":"2023-11-30T18:23:12.120898+0000","last_fullsized":"2023-11-30T18:23:12.120898+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.119296+0000","last_change":"2023-11-30T18:23:11.725649+0000","last_active":"2023-11-30T18:23:12.119296+0000","last_peered":"2023-11-30T18:23:12.119296+0000","last_clean":"2023-11-30T18:23:12.119296+0000","last_became_active":"2023-11-30T18:23:11.725358+0000","last_became_peered":"2023-11-30T18:23:11.725358+0000","last_unstale":"2023-11-30T18:23:12.119296+0000","last_undegraded":"2023-11-30T18:23:12.119296+0000","last_fullsized":"2023-11-30T18:23:12.119296+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.121579+0000","last_change":"2023-11-30T18:23:12.119529+0000","last_active":"2023-11-30T18:23:12.121579+0000","last_peered":"2023-11-30T18:23:12.121579+0000","last_clean":"2023-11-30T18:23:12.121579+0000","last_became_active":"2023-11-30T18:23:12.119258+0000","last_became_peered":"2023-11-30T18:23:12.119258+0000","last_unstale":"2023-11-30T18:23:12.121579+0000","last_undegraded":"2023-11-30T18:23:12.121579+0000","last_fullsized":"2023-11-30T18:23:12.121579+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.107434+0000","last_change":"2023-11-30T18:23:11.726054+0000","last_active":"2023-11-30T18:23:12.107434+0000","last_peered":"2023-11-30T18:23:12.107434+0000","last_clean":"2023-11-30T18:23:12.107434+0000","last_became_active":"2023-11-30T18:23:11.725740+0000","last_became_peered":"2023-11-30T18:23:11.725740+0000","last_unstale":"2023-11-30T18:23:12.107434+0000","last_undegraded":"2023-11-30T18:23:12.107434+0000","last_fullsized":"2023-11-30T18:23:12.107434+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.100712+0000","last_change":"2023-11-30T18:23:11.727466+0000","last_active":"2023-11-30T18:23:12.100712+0000","last_peered":"2023-11-30T18:23:12.100712+0000","last_clean":"2023-11-30T18:23:12.100712+0000","last_became_active":"2023-11-30T18:23:11.727184+0000","last_became_peered":"2023-11-30T18:23:11.727184+0000","last_unstale":"2023-11-30T18:23:12.100712+0000","last_undegraded":"2023-11-30T18:23:12.100712+0000","last_fullsized":"2023-11-30T18:23:12.100712+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.113593+0000","last_change":"2023-11-30T18:23:12.108335+0000","last_active":"2023-11-30T18:23:12.113593+0000","last_peered":"2023-11-30T18:23:12.113593+0000","last_clean":"2023-11-30T18:23:12.113593+0000","last_became_active":"2023-11-30T18:23:12.108065+0000","last_became_peered":"2023-11-30T18:23:12.108065+0000","last_unstale":"2023-11-30T18:23:12.113593+0000","last_undegraded":"2023-11-30T18:23:12.113593+0000","last_fullsized":"2023-11-30T18:23:12.113593+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124728+0000","last_change":"2023-11-30T18:23:12.118313+0000","last_active":"2023-11-30T18:23:12.124728+0000","last_peered":"2023-11-30T18:23:12.124728+0000","last_clean":"2023-11-30T18:23:12.124728+0000","last_became_active":"2023-11-30T18:23:12.114897+0000","last_became_peered":"2023-11-30T18:23:12.114897+0000","last_unstale":"2023-11-30T18:23:12.124728+0000","last_undegraded":"2023-11-30T18:23:12.124728+0000","last_fullsized":"2023-11-30T18:23:12.124728+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.103019+0000","last_change":"2023-11-30T18:23:11.728348+0000","last_active":"2023-11-30T18:23:12.103019+0000","last_peered":"2023-11-30T18:23:12.103019+0000","last_clean":"2023-11-30T18:23:12.103019+0000","last_became_active":"2023-11-30T18:23:11.728052+0000","last_became_peered":"2023-11-30T18:23:11.728052+0000","last_unstale":"2023-11-30T18:23:12.103019+0000","last_undegraded":"2023-11-30T18:23:12.103019+0000","last_fullsized":"2023-11-30T18:23:12.103019+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.116614+0000","last_change":"2023-11-30T18:23:11.733562+0000","last_active":"2023-11-30T18:23:12.116614+0000","last_peered":"2023-11-30T18:23:12.116614+0000","last_clean":"2023-11-30T18:23:12.116614+0000","last_became_active":"2023-11-30T18:23:11.733271+0000","last_became_peered":"2023-11-30T18:23:11.733271+0000","last_unstale":"2023-11-30T18:23:12.116614+0000","last_undegraded":"2023-11-30T18:23:12.116614+0000","last_fullsized":"2023-11-30T18:23:12.116614+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.122060+0000","last_change":"2023-11-30T18:23:12.120946+0000","last_active":"2023-11-30T18:23:12.122060+0000","last_peered":"2023-11-30T18:23:12.122060+0000","last_clean":"2023-11-30T18:23:12.122060+0000","last_became_active":"2023-11-30T18:23:12.120510+0000","last_became_peered":"2023-11-30T18:23:12.120510+0000","last_unstale":"2023-11-30T18:23:12.122060+0000","last_undegraded":"2023-11-30T18:23:12.122060+0000","last_fullsized":"2023-11-30T18:23:12.122060+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.118883+0000","last_change":"2023-11-30T18:23:11.722137+0000","last_active":"2023-11-30T18:23:12.118883+0000","last_peered":"2023-11-30T18:23:12.118883+0000","last_clean":"2023-11-30T18:23:12.118883+0000","last_became_active":"2023-11-30T18:23:11.721662+0000","last_became_peered":"2023-11-30T18:23:11.721662+0000","last_unstale":"2023-11-30T18:23:12.118883+0000","last_undegraded":"2023-11-30T18:23:12.118883+0000","last_fullsized":"2023-11-30T18:23:12.118883+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112020+0000","last_change":"2023-11-30T18:23:12.108920+0000","last_active":"2023-11-30T18:23:12.112020+0000","last_peered":"2023-11-30T18:23:12.112020+0000","last_clean":"2023-11-30T18:23:12.112020+0000","last_became_active":"2023-11-30T18:23:12.108658+0000","last_became_peered":"2023-11-30T18:23:12.108658+0000","last_unstale":"2023-11-30T18:23:12.112020+0000","last_undegraded":"2023-11-30T18:23:12.112020+0000","last_fullsized":"2023-11-30T18:23:12.112020+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.127959+0000","last_change":"2023-11-30T18:23:11.735560+0000","last_active":"2023-11-30T18:23:12.127959+0000","last_peered":"2023-11-30T18:23:12.127959+0000","last_clean":"2023-11-30T18:23:12.127959+0000","last_became_active":"2023-11-30T18:23:11.735257+0000","last_became_peered":"2023-11-30T18:23:11.735257+0000","last_unstale":"2023-11-30T18:23:12.127959+0000","last_undegraded":"2023-11-30T18:23:12.127959+0000","last_fullsized":"2023-11-30T18:23:12.127959+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"183'2","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128863+0000","last_change":"2023-11-30T18:23:11.735338+0000","last_active":"2023-11-30T18:23:12.128863+0000","last_peered":"2023-11-30T18:23:12.128863+0000","last_clean":"2023-11-30T18:23:12.128863+0000","last_became_active":"2023-11-30T18:23:11.735068+0000","last_became_peered":"2023-11-30T18:23:11.735068+0000","last_unstale":"2023-11-30T18:23:12.128863+0000","last_undegraded":"2023-11-30T18:23:12.128863+0000","last_fullsized":"2023-11-30T18:23:12.128863+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.130572+0000","last_change":"2023-11-30T18:23:12.128165+0000","last_active":"2023-11-30T18:23:12.130572+0000","last_peered":"2023-11-30T18:23:12.130572+0000","last_clean":"2023-11-30T18:23:12.130572+0000","last_became_active":"2023-11-30T18:23:12.127878+0000","last_became_peered":"2023-11-30T18:23:12.127878+0000","last_unstale":"2023-11-30T18:23:12.130572+0000","last_undegraded":"2023-11-30T18:23:12.130572+0000","last_fullsized":"2023-11-30T18:23:12.130572+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.100901+0000","last_change":"2023-11-30T18:23:11.734177+0000","last_active":"2023-11-30T18:23:12.100901+0000","last_peered":"2023-11-30T18:23:12.100901+0000","last_clean":"2023-11-30T18:23:12.100901+0000","last_became_active":"2023-11-30T18:23:11.733869+0000","last_became_peered":"2023-11-30T18:23:11.733869+0000","last_unstale":"2023-11-30T18:23:12.100901+0000","last_undegraded":"2023-11-30T18:23:12.100901+0000","last_fullsized":"2023-11-30T18:23:12.100901+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.126660+0000","last_change":"2023-11-30T18:23:12.125934+0000","last_active":"2023-11-30T18:23:12.126660+0000","last_peered":"2023-11-30T18:23:12.126660+0000","last_clean":"2023-11-30T18:23:12.126660+0000","last_became_active":"2023-11-30T18:23:12.125609+0000","last_became_peered":"2023-11-30T18:23:12.125609+0000","last_unstale":"2023-11-30T18:23:12.126660+0000","last_undegraded":"2023-11-30T18:23:12.126660+0000","last_fullsized":"2023-11-30T18:23:12.126660+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105169+0000","last_change":"2023-11-30T18:23:11.726273+0000","last_active":"2023-11-30T18:23:12.105169+0000","last_peered":"2023-11-30T18:23:12.105169+0000","last_clean":"2023-11-30T18:23:12.105169+0000","last_became_active":"2023-11-30T18:23:11.726024+0000","last_became_peered":"2023-11-30T18:23:11.726024+0000","last_unstale":"2023-11-30T18:23:12.105169+0000","last_undegraded":"2023-11-30T18:23:12.105169+0000","last_fullsized":"2023-11-30T18:23:12.105169+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114198+0000","last_change":"2023-11-30T18:23:12.111598+0000","last_active":"2023-11-30T18:23:12.114198+0000","last_peered":"2023-11-30T18:23:12.114198+0000","last_clean":"2023-11-30T18:23:12.114198+0000","last_became_active":"2023-11-30T18:23:12.110743+0000","last_became_peered":"2023-11-30T18:23:12.110743+0000","last_unstale":"2023-11-30T18:23:12.114198+0000","last_undegraded":"2023-11-30T18:23:12.114198+0000","last_fullsized":"2023-11-30T18:23:12.114198+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105796+0000","last_change":"2023-11-30T18:23:11.734590+0000","last_active":"2023-11-30T18:23:12.105796+0000","last_peered":"2023-11-30T18:23:12.105796+0000","last_clean":"2023-11-30T18:23:12.105796+0000","last_became_active":"2023-11-30T18:23:11.734303+0000","last_became_peered":"2023-11-30T18:23:11.734303+0000","last_unstale":"2023-11-30T18:23:12.105796+0000","last_undegraded":"2023-11-30T18:23:12.105796+0000","last_fullsized":"2023-11-30T18:23:12.105796+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120605+0000","last_change":"2023-11-30T18:23:12.112705+0000","last_active":"2023-11-30T18:23:12.120605+0000","last_peered":"2023-11-30T18:23:12.120605+0000","last_clean":"2023-11-30T18:23:12.120605+0000","last_became_active":"2023-11-30T18:23:12.111139+0000","last_became_peered":"2023-11-30T18:23:12.111139+0000","last_unstale":"2023-11-30T18:23:12.120605+0000","last_undegraded":"2023-11-30T18:23:12.120605+0000","last_fullsized":"2023-11-30T18:23:12.120605+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.103710+0000","last_change":"2023-11-30T18:23:11.728671+0000","last_active":"2023-11-30T18:23:12.103710+0000","last_peered":"2023-11-30T18:23:12.103710+0000","last_clean":"2023-11-30T18:23:12.103710+0000","last_became_active":"2023-11-30T18:23:11.728345+0000","last_became_peered":"2023-11-30T18:23:11.728345+0000","last_unstale":"2023-11-30T18:23:12.103710+0000","last_undegraded":"2023-11-30T18:23:12.103710+0000","last_fullsized":"2023-11-30T18:23:12.103710+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128782+0000","last_change":"2023-11-30T18:23:12.124792+0000","last_active":"2023-11-30T18:23:12.128782+0000","last_peered":"2023-11-30T18:23:12.128782+0000","last_clean":"2023-11-30T18:23:12.128782+0000","last_became_active":"2023-11-30T18:23:12.124193+0000","last_became_peered":"2023-11-30T18:23:12.124193+0000","last_unstale":"2023-11-30T18:23:12.128782+0000","last_undegraded":"2023-11-30T18:23:12.128782+0000","last_fullsized":"2023-11-30T18:23:12.128782+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128865+0000","last_change":"2023-11-30T18:23:11.727412+0000","last_active":"2023-11-30T18:23:12.128865+0000","last_peered":"2023-11-30T18:23:12.128865+0000","last_clean":"2023-11-30T18:23:12.128865+0000","last_became_active":"2023-11-30T18:23:11.727129+0000","last_became_peered":"2023-11-30T18:23:11.727129+0000","last_unstale":"2023-11-30T18:23:12.128865+0000","last_undegraded":"2023-11-30T18:23:12.128865+0000","last_fullsized":"2023-11-30T18:23:12.128865+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.136285+0000","last_change":"2023-11-30T18:23:12.130940+0000","last_active":"2023-11-30T18:23:12.136285+0000","last_peered":"2023-11-30T18:23:12.136285+0000","last_clean":"2023-11-30T18:23:12.136285+0000","last_became_active":"2023-11-30T18:23:12.130705+0000","last_became_peered":"2023-11-30T18:23:12.130705+0000","last_unstale":"2023-11-30T18:23:12.136285+0000","last_undegraded":"2023-11-30T18:23:12.136285+0000","last_fullsized":"2023-11-30T18:23:12.136285+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"183'2","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128162+0000","last_change":"2023-11-30T18:23:11.736457+0000","last_active":"2023-11-30T18:23:12.128162+0000","last_peered":"2023-11-30T18:23:12.128162+0000","last_clean":"2023-11-30T18:23:12.128162+0000","last_became_active":"2023-11-30T18:23:11.736059+0000","last_became_peered":"2023-11-30T18:23:11.736059+0000","last_unstale":"2023-11-30T18:23:12.128162+0000","last_undegraded":"2023-11-30T18:23:12.128162+0000","last_fullsized":"2023-11-30T18:23:12.128162+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120877+0000","last_change":"2023-11-30T18:23:12.116925+0000","last_active":"2023-11-30T18:23:12.120877+0000","last_peered":"2023-11-30T18:23:12.120877+0000","last_clean":"2023-11-30T18:23:12.120877+0000","last_became_active":"2023-11-30T18:23:12.116645+0000","last_became_peered":"2023-11-30T18:23:12.116645+0000","last_unstale":"2023-11-30T18:23:12.120877+0000","last_undegraded":"2023-11-30T18:23:12.120877+0000","last_fullsized":"2023-11-30T18:23:12.120877+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101414+0000","last_change":"2023-11-30T18:23:11.732070+0000","last_active":"2023-11-30T18:23:12.101414+0000","last_peered":"2023-11-30T18:23:12.101414+0000","last_clean":"2023-11-30T18:23:12.101414+0000","last_became_active":"2023-11-30T18:23:11.731413+0000","last_became_peered":"2023-11-30T18:23:11.731413+0000","last_unstale":"2023-11-30T18:23:12.101414+0000","last_undegraded":"2023-11-30T18:23:12.101414+0000","last_fullsized":"2023-11-30T18:23:12.101414+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.117119+0000","last_change":"2023-11-30T18:23:12.109130+0000","last_active":"2023-11-30T18:23:12.117119+0000","last_peered":"2023-11-30T18:23:12.117119+0000","last_clean":"2023-11-30T18:23:12.117119+0000","last_became_active":"2023-11-30T18:23:12.108797+0000","last_became_peered":"2023-11-30T18:23:12.108797+0000","last_unstale":"2023-11-30T18:23:12.117119+0000","last_undegraded":"2023-11-30T18:23:12.117119+0000","last_fullsized":"2023-11-30T18:23:12.117119+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.133312+0000","last_change":"2023-11-30T18:23:12.128309+0000","last_active":"2023-11-30T18:23:12.133312+0000","last_peered":"2023-11-30T18:23:12.133312+0000","last_clean":"2023-11-30T18:23:12.133312+0000","last_became_active":"2023-11-30T18:23:12.128014+0000","last_became_peered":"2023-11-30T18:23:12.128014+0000","last_unstale":"2023-11-30T18:23:12.133312+0000","last_undegraded":"2023-11-30T18:23:12.133312+0000","last_fullsized":"2023-11-30T18:23:12.133312+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112901+0000","last_change":"2023-11-30T18:23:11.731121+0000","last_active":"2023-11-30T18:23:12.112901+0000","last_peered":"2023-11-30T18:23:12.112901+0000","last_clean":"2023-11-30T18:23:12.112901+0000","last_became_active":"2023-11-30T18:23:11.730804+0000","last_became_peered":"2023-11-30T18:23:11.730804+0000","last_unstale":"2023-11-30T18:23:12.112901+0000","last_undegraded":"2023-11-30T18:23:12.112901+0000","last_fullsized":"2023-11-30T18:23:12.112901+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114635+0000","last_change":"2023-11-30T18:23:12.113494+0000","last_active":"2023-11-30T18:23:12.114635+0000","last_peered":"2023-11-30T18:23:12.114635+0000","last_clean":"2023-11-30T18:23:12.114635+0000","last_became_active":"2023-11-30T18:23:12.112805+0000","last_became_peered":"2023-11-30T18:23:12.112805+0000","last_unstale":"2023-11-30T18:23:12.114635+0000","last_undegraded":"2023-11-30T18:23:12.114635+0000","last_fullsized":"2023-11-30T18:23:12.114635+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128947+0000","last_change":"2023-11-30T18:23:12.125304+0000","last_active":"2023-11-30T18:23:12.128947+0000","last_peered":"2023-11-30T18:23:12.128947+0000","last_clean":"2023-11-30T18:23:12.128947+0000","last_became_active":"2023-11-30T18:23:12.125058+0000","last_became_peered":"2023-11-30T18:23:12.125058+0000","last_unstale":"2023-11-30T18:23:12.128947+0000","last_undegraded":"2023-11-30T18:23:12.128947+0000","last_fullsized":"2023-11-30T18:23:12.128947+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105672+0000","last_change":"2023-11-30T18:23:11.731979+0000","last_active":"2023-11-30T18:23:12.105672+0000","last_peered":"2023-11-30T18:23:12.105672+0000","last_clean":"2023-11-30T18:23:12.105672+0000","last_became_active":"2023-11-30T18:23:11.731333+0000","last_became_peered":"2023-11-30T18:23:11.731333+0000","last_unstale":"2023-11-30T18:23:12.105672+0000","last_undegraded":"2023-11-30T18:23:12.105672+0000","last_fullsized":"2023-11-30T18:23:12.105672+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112581+0000","last_change":"2023-11-30T18:23:12.108480+0000","last_active":"2023-11-30T18:23:12.112581+0000","last_peered":"2023-11-30T18:23:12.112581+0000","last_clean":"2023-11-30T18:23:12.112581+0000","last_became_active":"2023-11-30T18:23:12.108192+0000","last_became_peered":"2023-11-30T18:23:12.108192+0000","last_unstale":"2023-11-30T18:23:12.112581+0000","last_undegraded":"2023-11-30T18:23:12.112581+0000","last_fullsized":"2023-11-30T18:23:12.112581+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.123835+0000","last_change":"2023-11-30T18:23:12.121094+0000","last_active":"2023-11-30T18:23:12.123835+0000","last_peered":"2023-11-30T18:23:12.123835+0000","last_clean":"2023-11-30T18:23:12.123835+0000","last_became_active":"2023-11-30T18:23:12.119586+0000","last_became_peered":"2023-11-30T18:23:12.119586+0000","last_unstale":"2023-11-30T18:23:12.123835+0000","last_undegraded":"2023-11-30T18:23:12.123835+0000","last_fullsized":"2023-11-30T18:23:12.123835+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105796+0000","last_change":"2023-11-30T18:23:11.728944+0000","last_active":"2023-11-30T18:23:12.105796+0000","last_peered":"2023-11-30T18:23:12.105796+0000","last_clean":"2023-11-30T18:23:12.105796+0000","last_became_active":"2023-11-30T18:23:11.728632+0000","last_became_peered":"2023-11-30T18:23:11.728632+0000","last_unstale":"2023-11-30T18:23:12.105796+0000","last_undegraded":"2023-11-30T18:23:12.105796+0000","last_fullsized":"2023-11-30T18:23:12.105796+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120459+0000","last_change":"2023-11-30T18:23:12.111474+0000","last_active":"2023-11-30T18:23:12.120459+0000","last_peered":"2023-11-30T18:23:12.120459+0000","last_clean":"2023-11-30T18:23:12.120459+0000","last_became_active":"2023-11-30T18:23:12.111119+0000","last_became_peered":"2023-11-30T18:23:12.111119+0000","last_unstale":"2023-11-30T18:23:12.120459+0000","last_undegraded":"2023-11-30T18:23:12.120459+0000","last_fullsized":"2023-11-30T18:23:12.120459+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101462+0000","last_change":"2023-11-30T18:23:11.733982+0000","last_active":"2023-11-30T18:23:12.101462+0000","last_peered":"2023-11-30T18:23:12.101462+0000","last_clean":"2023-11-30T18:23:12.101462+0000","last_became_active":"2023-11-30T18:23:11.733689+0000","last_became_peered":"2023-11-30T18:23:11.733689+0000","last_unstale":"2023-11-30T18:23:12.101462+0000","last_undegraded":"2023-11-30T18:23:12.101462+0000","last_fullsized":"2023-11-30T18:23:12.101462+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120038+0000","last_change":"2023-11-30T18:23:12.116461+0000","last_active":"2023-11-30T18:23:12.120038+0000","last_peered":"2023-11-30T18:23:12.120038+0000","last_clean":"2023-11-30T18:23:12.120038+0000","last_became_active":"2023-11-30T18:23:12.115880+0000","last_became_peered":"2023-11-30T18:23:12.115880+0000","last_unstale":"2023-11-30T18:23:12.120038+0000","last_undegraded":"2023-11-30T18:23:12.120038+0000","last_fullsized":"2023-11-30T18:23:12.120038+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.104010+0000","last_change":"2023-11-30T18:23:11.728276+0000","last_active":"2023-11-30T18:23:12.104010+0000","last_peered":"2023-11-30T18:23:12.104010+0000","last_clean":"2023-11-30T18:23:12.104010+0000","last_became_active":"2023-11-30T18:23:11.727974+0000","last_became_peered":"2023-11-30T18:23:11.727974+0000","last_unstale":"2023-11-30T18:23:12.104010+0000","last_undegraded":"2023-11-30T18:23:12.104010+0000","last_fullsized":"2023-11-30T18:23:12.104010+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.106016+0000","last_change":"2023-11-30T18:23:11.730729+0000","last_active":"2023-11-30T18:23:12.106016+0000","last_peered":"2023-11-30T18:23:12.106016+0000","last_clean":"2023-11-30T18:23:12.106016+0000","last_became_active":"2023-11-30T18:23:11.728274+0000","last_became_peered":"2023-11-30T18:23:11.728274+0000","last_unstale":"2023-11-30T18:23:12.106016+0000","last_undegraded":"2023-11-30T18:23:12.106016+0000","last_fullsized":"2023-11-30T18:23:12.106016+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.119835+0000","last_change":"2023-11-30T18:23:11.729709+0000","last_active":"2023-11-30T18:23:12.119835+0000","last_peered":"2023-11-30T18:23:12.119835+0000","last_clean":"2023-11-30T18:23:12.119835+0000","last_became_active":"2023-11-30T18:23:11.728696+0000","last_became_peered":"2023-11-30T18:23:11.728696+0000","last_unstale":"2023-11-30T18:23:12.119835+0000","last_undegraded":"2023-11-30T18:23:12.119835+0000","last_fullsized":"2023-11-30T18:23:12.119835+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112118+0000","last_change":"2023-11-30T18:23:12.110191+0000","last_active":"2023-11-30T18:23:12.112118+0000","last_peered":"2023-11-30T18:23:12.112118+0000","last_clean":"2023-11-30T18:23:12.112118+0000","last_became_active":"2023-11-30T18:23:12.108068+0000","last_became_peered":"2023-11-30T18:23:12.108068+0000","last_unstale":"2023-11-30T18:23:12.112118+0000","last_undegraded":"2023-11-30T18:23:12.112118+0000","last_fullsized":"2023-11-30T18:23:12.112118+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.106165+0000","last_change":"2023-11-30T18:23:11.724242+0000","last_active":"2023-11-30T18:23:12.106165+0000","last_peered":"2023-11-30T18:23:12.106165+0000","last_clean":"2023-11-30T18:23:12.106165+0000","last_became_active":"2023-11-30T18:23:11.723941+0000","last_became_peered":"2023-11-30T18:23:11.723941+0000","last_unstale":"2023-11-30T18:23:12.106165+0000","last_undegraded":"2023-11-30T18:23:12.106165+0000","last_fullsized":"2023-11-30T18:23:12.106165+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.116481+0000","last_change":"2023-11-30T18:23:11.733023+0000","last_active":"2023-11-30T18:23:12.116481+0000","last_peered":"2023-11-30T18:23:12.116481+0000","last_clean":"2023-11-30T18:23:12.116481+0000","last_became_active":"2023-11-30T18:23:11.732439+0000","last_became_peered":"2023-11-30T18:23:11.732439+0000","last_unstale":"2023-11-30T18:23:12.116481+0000","last_undegraded":"2023-11-30T18:23:12.116481+0000","last_fullsized":"2023-11-30T18:23:12.116481+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.118736+0000","last_change":"2023-11-30T18:23:11.724253+0000","last_active":"2023-11-30T18:23:12.118736+0000","last_peered":"2023-11-30T18:23:12.118736+0000","last_clean":"2023-11-30T18:23:12.118736+0000","last_became_active":"2023-11-30T18:23:11.723936+0000","last_became_peered":"2023-11-30T18:23:11.723936+0000","last_unstale":"2023-11-30T18:23:12.118736+0000","last_undegraded":"2023-11-30T18:23:12.118736+0000","last_fullsized":"2023-11-30T18:23:12.118736+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":154,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.100854+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T18:23:12.100854+0000","last_peered":"2023-11-30T18:23:12.100854+0000","last_clean":"2023-11-30T18:23:12.100854+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T18:23:12.100854+0000","last_undegraded":"2023-11-30T18:23:12.100854+0000","last_fullsized":"2023-11-30T18:23:12.100854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124990+0000","last_change":"2023-11-30T18:23:12.122702+0000","last_active":"2023-11-30T18:23:12.124990+0000","last_peered":"2023-11-30T18:23:12.124990+0000","last_clean":"2023-11-30T18:23:12.124990+0000","last_became_active":"2023-11-30T18:23:12.122115+0000","last_became_peered":"2023-11-30T18:23:12.122115+0000","last_unstale":"2023-11-30T18:23:12.124990+0000","last_undegraded":"2023-11-30T18:23:12.124990+0000","last_fullsized":"2023-11-30T18:23:12.124990+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"183'3","reported_seq":13,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124889+0000","last_change":"2023-11-30T18:23:11.723777+0000","last_active":"2023-11-30T18:23:12.124889+0000","last_peered":"2023-11-30T18:23:12.124889+0000","last_clean":"2023-11-30T18:23:12.124889+0000","last_became_active":"2023-11-30T18:23:11.723321+0000","last_became_peered":"2023-11-30T18:23:11.723321+0000","last_unstale":"2023-11-30T18:23:12.124889+0000","last_undegraded":"2023-11-30T18:23:12.124889+0000","last_fullsized":"2023-11-30T18:23:12.124889+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":151,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105479+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T18:23:12.105479+0000","last_peered":"2023-11-30T18:23:12.105479+0000","last_clean":"2023-11-30T18:23:12.105479+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T18:23:12.105479+0000","last_undegraded":"2023-11-30T18:23:12.105479+0000","last_fullsized":"2023-11-30T18:23:12.105479+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124947+0000","last_change":"2023-11-30T18:23:12.123908+0000","last_active":"2023-11-30T18:23:12.124947+0000","last_peered":"2023-11-30T18:23:12.124947+0000","last_clean":"2023-11-30T18:23:12.124947+0000","last_became_active":"2023-11-30T18:23:12.123674+0000","last_became_peered":"2023-11-30T18:23:12.123674+0000","last_unstale":"2023-11-30T18:23:12.124947+0000","last_undegraded":"2023-11-30T18:23:12.124947+0000","last_fullsized":"2023-11-30T18:23:12.124947+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105691+0000","last_change":"2023-11-30T18:23:11.726548+0000","last_active":"2023-11-30T18:23:12.105691+0000","last_peered":"2023-11-30T18:23:12.105691+0000","last_clean":"2023-11-30T18:23:12.105691+0000","last_became_active":"2023-11-30T18:23:11.726202+0000","last_became_peered":"2023-11-30T18:23:11.726202+0000","last_unstale":"2023-11-30T18:23:12.105691+0000","last_undegraded":"2023-11-30T18:23:12.105691+0000","last_fullsized":"2023-11-30T18:23:12.105691+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":158,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.118025+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T18:23:12.118025+0000","last_peered":"2023-11-30T18:23:12.118025+0000","last_clean":"2023-11-30T18:23:12.118025+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T18:23:12.118025+0000","last_undegraded":"2023-11-30T18:23:12.118025+0000","last_fullsized":"2023-11-30T18:23:12.118025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"183'2","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.113944+0000","last_change":"2023-11-30T18:23:11.732729+0000","last_active":"2023-11-30T18:23:12.113944+0000","last_peered":"2023-11-30T18:23:12.113944+0000","last_clean":"2023-11-30T18:23:12.113944+0000","last_became_active":"2023-11-30T18:23:11.732454+0000","last_became_peered":"2023-11-30T18:23:11.732454+0000","last_unstale":"2023-11-30T18:23:12.113944+0000","last_undegraded":"2023-11-30T18:23:12.113944+0000","last_fullsized":"2023-11-30T18:23:12.113944+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":151,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.106039+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T18:23:12.106039+0000","last_peered":"2023-11-30T18:23:12.106039+0000","last_clean":"2023-11-30T18:23:12.106039+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T18:23:12.106039+0000","last_undegraded":"2023-11-30T18:23:12.106039+0000","last_fullsized":"2023-11-30T18:23:12.106039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":148,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.116542+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T18:23:12.116542+0000","last_peered":"2023-11-30T18:23:12.116542+0000","last_clean":"2023-11-30T18:23:12.116542+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T18:23:12.116542+0000","last_undegraded":"2023-11-30T18:23:12.116542+0000","last_fullsized":"2023-11-30T18:23:12.116542+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120308+0000","last_change":"2023-11-30T18:23:11.737931+0000","last_active":"2023-11-30T18:23:12.120308+0000","last_peered":"2023-11-30T18:23:12.120308+0000","last_clean":"2023-11-30T18:23:12.120308+0000","last_became_active":"2023-11-30T18:23:11.737593+0000","last_became_peered":"2023-11-30T18:23:11.737593+0000","last_unstale":"2023-11-30T18:23:12.120308+0000","last_undegraded":"2023-11-30T18:23:12.120308+0000","last_fullsized":"2023-11-30T18:23:12.120308+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":146,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.116609+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T18:23:12.116609+0000","last_peered":"2023-11-30T18:23:12.116609+0000","last_clean":"2023-11-30T18:23:12.116609+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T18:23:12.116609+0000","last_undegraded":"2023-11-30T18:23:12.116609+0000","last_fullsized":"2023-11-30T18:23:12.116609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114593+0000","last_change":"2023-11-30T18:23:12.113259+0000","last_active":"2023-11-30T18:23:12.114593+0000","last_peered":"2023-11-30T18:23:12.114593+0000","last_clean":"2023-11-30T18:23:12.114593+0000","last_became_active":"2023-11-30T18:23:12.112451+0000","last_became_peered":"2023-11-30T18:23:12.112451+0000","last_unstale":"2023-11-30T18:23:12.114593+0000","last_undegraded":"2023-11-30T18:23:12.114593+0000","last_fullsized":"2023-11-30T18:23:12.114593+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":146,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.121501+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T18:23:12.121501+0000","last_peered":"2023-11-30T18:23:12.121501+0000","last_clean":"2023-11-30T18:23:12.121501+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T18:23:12.121501+0000","last_undegraded":"2023-11-30T18:23:12.121501+0000","last_fullsized":"2023-11-30T18:23:12.121501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.123443+0000","last_change":"2023-11-30T18:23:12.119562+0000","last_active":"2023-11-30T18:23:12.123443+0000","last_peered":"2023-11-30T18:23:12.123443+0000","last_clean":"2023-11-30T18:23:12.123443+0000","last_became_active":"2023-11-30T18:23:12.119194+0000","last_became_peered":"2023-11-30T18:23:12.119194+0000","last_unstale":"2023-11-30T18:23:12.123443+0000","last_undegraded":"2023-11-30T18:23:12.123443+0000","last_fullsized":"2023-11-30T18:23:12.123443+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":154,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101695+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T18:23:12.101695+0000","last_peered":"2023-11-30T18:23:12.101695+0000","last_clean":"2023-11-30T18:23:12.101695+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T18:23:12.101695+0000","last_undegraded":"2023-11-30T18:23:12.101695+0000","last_fullsized":"2023-11-30T18:23:12.101695+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.113473+0000","last_change":"2023-11-30T18:23:12.111164+0000","last_active":"2023-11-30T18:23:12.113473+0000","last_peered":"2023-11-30T18:23:12.113473+0000","last_clean":"2023-11-30T18:23:12.113473+0000","last_became_active":"2023-11-30T18:23:12.110887+0000","last_became_peered":"2023-11-30T18:23:12.110887+0000","last_unstale":"2023-11-30T18:23:12.113473+0000","last_undegraded":"2023-11-30T18:23:12.113473+0000","last_fullsized":"2023-11-30T18:23:12.113473+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"183'4","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128421+0000","last_change":"2023-11-30T18:23:11.728962+0000","last_active":"2023-11-30T18:23:12.128421+0000","last_peered":"2023-11-30T18:23:12.128421+0000","last_clean":"2023-11-30T18:23:12.128421+0000","last_became_active":"2023-11-30T18:23:11.728681+0000","last_became_peered":"2023-11-30T18:23:11.728681+0000","last_unstale":"2023-11-30T18:23:12.128421+0000","last_undegraded":"2023-11-30T18:23:12.128421+0000","last_fullsized":"2023-11-30T18:23:12.128421+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":168,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-11-30T18:23:07.189838+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T18:23:07.189838+0000","last_peered":"2023-11-30T18:23:07.189838+0000","last_clean":"2023-11-30T18:23:07.189838+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T18:23:07.189838+0000","last_undegraded":"2023-11-30T18:23:07.189838+0000","last_fullsized":"2023-11-30T18:23:07.189838+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":100,"acting":100,"num_store_stats":6},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":94,"acting":94,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575755,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303444,"kb_used_data":2252,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068396,"statfs":{"total":96636764160,"available":96326037504,"internally_reserved":0,"allocated":2306048,"data_stored":1173973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.32500000000000001},"max":{"1min":0.68700000000000006,"5min":0.81699999999999995,"15min":0.83599999999999997},"last":0.503},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.60699999999999998,"15min":0.61799999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.71499999999999997,"5min":0.82199999999999995,"15min":0.84999999999999998},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55000000000000004,"15min":0.55900000000000005},"min":{"1min":0.35599999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71599999999999997,"5min":0.80500000000000005,"15min":0.875},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.39800000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71699999999999997,"5min":0.79100000000000004,"15min":0.82099999999999995},"last":0.54400000000000004}]},{"osd":2,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70399999999999996,"5min":0.76900000000000002,"15min":0.85399999999999998},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.66500000000000004,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.34300000000000003},"max":{"1min":0.65700000000000003,"5min":0.79300000000000004,"15min":0.90800000000000003},"last":0.373},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60199999999999998,"15min":0.60299999999999998},"min":{"1min":0.41099999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.73399999999999999,"5min":0.80000000000000004,"15min":0.80300000000000005},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.45300000000000001,"15min":0.44400000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63900000000000001,"5min":0.70299999999999996,"15min":0.73799999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46400000000000002,"15min":0.46500000000000002},"min":{"1min":0.32100000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.66400000000000003,"5min":0.71999999999999997,"15min":0.78100000000000003},"last":0.438}]},{"osd":5,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.65000000000000002,"5min":0.749,"15min":0.753},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.51000000000000001,"15min":0.505},"min":{"1min":0.371,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":0.69099999999999995,"5min":0.76000000000000001,"15min":0.81999999999999995},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.372,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.74299999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.751,"5min":0.81499999999999995,"15min":0.83599999999999997},"last":0.53100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575753,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307480,"kb_used_data":2192,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064360,"statfs":{"total":96636764160,"available":96321904640,"internally_reserved":0,"allocated":2244608,"data_stored":1145498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.58999999999999997,"15min":0.59799999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68000000000000005,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.61799999999999999,"15min":0.61699999999999999},"min":{"1min":0.45100000000000001,"5min":0.41099999999999998,"15min":0.33600000000000002},"max":{"1min":0.72599999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.32400000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.70899999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.40999999999999998,"5min":0.39000000000000001,"15min":0.35199999999999998},"max":{"1min":0.751,"5min":0.876,"15min":0.876},"last":0.60999999999999999}]},{"osd":2,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.59699999999999998,"15min":0.59799999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71399999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.39000000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73399999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54700000000000004,"15min":0.55700000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73399999999999999,"5min":0.82299999999999995,"15min":0.83499999999999996},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.39900000000000002,"5min":0.39000000000000001,"15min":0.33200000000000002},"max":{"1min":0.64400000000000002,"5min":0.79100000000000004,"15min":0.80100000000000005},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45200000000000001,"15min":0.45100000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.68899999999999995,"5min":0.81000000000000005,"15min":0.94999999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47799999999999998,"15min":0.47599999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70399999999999996,"5min":0.76400000000000001,"15min":0.82299999999999995},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46999999999999997,"15min":0.46700000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.66300000000000003,"5min":0.76400000000000001,"15min":0.81999999999999995},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70999999999999996,"5min":0.81999999999999995,"15min":0.83499999999999996},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.29999999999999999},"max":{"1min":0.72499999999999998,"5min":0.80100000000000005,"15min":0.86799999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.376,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71599999999999997,"5min":0.80800000000000005,"15min":0.86599999999999999},"last":0.64900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575754,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307536,"kb_used_data":2248,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064304,"statfs":{"total":96636764160,"available":96321847296,"internally_reserved":0,"allocated":2301952,"data_stored":1173129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34200000000000003,"15min":0.36399999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.42799999999999999,"5min":0.54200000000000004,"15min":0.70699999999999996},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47299999999999998,"15min":0.49399999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.78100000000000003},"last":0.33100000000000002}]},{"osd":2,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.376,"15min":0.39600000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.48099999999999998,"5min":0.60599999999999998,"15min":0.67500000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.498,"15min":0.51600000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63200000000000001,"5min":0.72499999999999998,"15min":0.85599999999999998},"last":0.38}]},{"osd":3,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.44700000000000001,"15min":0.46300000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.53700000000000003,"5min":0.70599999999999996,"15min":0.79600000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.42299999999999999,"15min":0.44600000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.50700000000000001,"5min":0.65400000000000003,"15min":0.68000000000000005},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.58399999999999996,"15min":0.60999999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.314},"max":{"1min":0.80100000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.61799999999999999,"15min":0.64100000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38800000000000001},"max":{"1min":0.77900000000000003,"5min":0.80800000000000005,"15min":0.90600000000000003},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.60399999999999998,"15min":0.623},"min":{"1min":0.379,"5min":0.379,"15min":0.377},"max":{"1min":0.78400000000000003,"5min":0.86599999999999999,"15min":0.90200000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60899999999999999,"15min":0.63300000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.36799999999999999},"max":{"1min":0.79400000000000004,"5min":0.878,"15min":0.90800000000000003},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.66700000000000004,"15min":0.68899999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66300000000000003,"15min":0.67600000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42599999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.0049999999999999},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.66600000000000004,"15min":0.68999999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.96999999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.65100000000000002,"15min":0.67200000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.95899999999999996},"last":0.52100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575754,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307544,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064296,"statfs":{"total":96636764160,"available":96321839104,"internally_reserved":0,"allocated":2310144,"data_stored":1173273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.38300000000000001,"15min":0.38900000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.51900000000000002,"5min":0.56799999999999995,"15min":0.61099999999999999},"last":0.246},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41099999999999998,"15min":0.40999999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.249},"max":{"1min":0.55600000000000005,"5min":0.65600000000000003,"15min":0.68400000000000005},"last":0.34000000000000002}]},{"osd":2,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41599999999999998,"15min":0.40899999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.57499999999999996,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.49299999999999999,"15min":0.48999999999999999},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.59399999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.44600000000000001,"15min":0.45200000000000001},"min":{"1min":0.311,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.53500000000000003,"5min":0.71699999999999997,"15min":0.77500000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46899999999999997,"15min":0.46800000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65300000000000002,"5min":0.67600000000000005,"15min":0.69499999999999995},"last":0.26000000000000001}]},{"osd":4,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65000000000000002,"15min":0.63700000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.42199999999999999},"max":{"1min":0.81000000000000005,"5min":0.96399999999999997,"15min":0.995},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66600000000000004,"15min":0.65400000000000003},"min":{"1min":0.47799999999999998,"5min":0.42799999999999999,"15min":0.41499999999999998},"max":{"1min":0.75900000000000001,"5min":1.03,"15min":1.03},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65200000000000002,"15min":0.64100000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.40799999999999997},"max":{"1min":0.86499999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.68100000000000005,"15min":0.65900000000000003},"min":{"1min":0.48199999999999998,"5min":0.44800000000000001,"15min":0.41299999999999998},"max":{"1min":0.91900000000000004,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.45600000000000002}]},{"osd":6,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67700000000000005,"15min":0.67300000000000004},"min":{"1min":0.52300000000000002,"5min":0.443,"15min":0.40600000000000003},"max":{"1min":0.81799999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68600000000000005,"15min":0.67700000000000005},"min":{"1min":0.49099999999999999,"5min":0.442,"15min":0.44},"max":{"1min":0.90400000000000003,"5min":1.05,"15min":1.05},"last":0.51400000000000001}]},{"osd":7,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71299999999999997,"15min":0.69799999999999995},"min":{"1min":0.55600000000000005,"5min":0.45200000000000001,"15min":0.42599999999999999},"max":{"1min":0.88600000000000001,"5min":1.167,"15min":1.167},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73199999999999998,"15min":0.72299999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.48399999999999999},"max":{"1min":0.876,"5min":1.024,"15min":1.024},"last":0.54000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575754,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311636,"kb_used_data":2252,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060204,"statfs":{"total":96636764160,"available":96317648896,"internally_reserved":0,"allocated":2306048,"data_stored":1172687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.39500000000000002,"15min":0.40100000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.25700000000000001},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.71699999999999997},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68999999999999995,"5min":0.70599999999999996,"15min":0.751},"last":0.379}]},{"osd":1,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.443,"15min":0.44900000000000001},"min":{"1min":0.33500000000000002,"5min":0.309,"15min":0.29299999999999998},"max":{"1min":0.68700000000000006,"5min":0.755,"15min":0.755},"last":0.437},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.32300000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.81799999999999995},"last":0.42699999999999999}]},{"osd":3,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39500000000000002,"15min":0.40699999999999997},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.76000000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.308,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.75800000000000001},"last":0.314}]},{"osd":4,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.626,"15min":0.63400000000000001},"min":{"1min":0.44900000000000001,"5min":0.42199999999999999,"15min":0.40100000000000002},"max":{"1min":0.88800000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60699999999999998,"15min":0.61899999999999999},"min":{"1min":0.42199999999999999,"5min":0.40999999999999998,"15min":0.377},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.94999999999999996},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63300000000000001,"15min":0.64400000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.97399999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64700000000000002,"15min":0.64800000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85599999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.628,"15min":0.63800000000000001},"min":{"1min":0.46200000000000002,"5min":0.434,"15min":0.41099999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.97799999999999998},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67000000000000004,"15min":0.67300000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67300000000000004,"15min":0.68799999999999994},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46000000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.96599999999999997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.504,"5min":0.49199999999999999,"15min":0.46200000000000002},"max":{"1min":0.97199999999999998,"5min":0.995,"15min":1.014},"last":0.68600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575754,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315724,"kb_used_data":2244,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94056116,"statfs":{"total":96636764160,"available":96313462784,"internally_reserved":0,"allocated":2297856,"data_stored":1172539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38500000000000001,"15min":0.375},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.311},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.41199999999999998,"15min":0.40899999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.59299999999999997,"5min":0.61099999999999999,"15min":0.66200000000000003},"last":0.32900000000000001}]},{"osd":1,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.40999999999999998,"15min":0.39700000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44800000000000001,"15min":0.441},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.28699999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.26100000000000001}]},{"osd":2,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.47699999999999998,"15min":0.46899999999999997},"min":{"1min":0.35099999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58299999999999996,"5min":0.70899999999999996,"15min":0.71599999999999997},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52000000000000002,"15min":0.51500000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73199999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63200000000000001,"15min":0.63500000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92800000000000005,"5min":1.081,"15min":1.081},"last":0.436},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64900000000000002,"15min":0.63800000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.64300000000000002,"15min":0.63500000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67100000000000004,"15min":0.66200000000000003},"min":{"1min":0.47399999999999998,"5min":0.46200000000000002,"15min":0.42399999999999999},"max":{"1min":0.99199999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.52300000000000002}]},{"osd":6,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68600000000000005,"15min":0.67900000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.40100000000000002},"max":{"1min":0.96999999999999997,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48599999999999999,"5min":0.47099999999999997,"15min":0.41499999999999998},"max":{"1min":0.84299999999999997,"5min":1.206,"15min":1.206},"last":0.48499999999999999}]},{"osd":7,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.44800000000000001},"max":{"1min":0.98599999999999999,"5min":1.131,"15min":1.131},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70599999999999996,"15min":0.69499999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.44800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303384,"kb_used_data":2192,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068456,"statfs":{"total":96636764160,"available":96326098944,"internally_reserved":0,"allocated":2244608,"data_stored":1145498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54200000000000004,"15min":0.55400000000000005},"min":{"1min":0.31900000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77200000000000002,"5min":0.80600000000000005,"15min":0.94799999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.26900000000000002},"max":{"1min":0.71399999999999997,"5min":0.82599999999999996,"15min":0.83699999999999997},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54800000000000004,"15min":0.55100000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79200000000000004,"5min":0.92400000000000004,"15min":1.006},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56200000000000006,"15min":0.56399999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70999999999999996,"5min":0.79300000000000004,"15min":0.82299999999999995},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57799999999999996,"15min":0.58699999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35499999999999998},"max":{"1min":0.68700000000000006,"5min":0.82399999999999995,"15min":0.85299999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.59999999999999998,"15min":0.61499999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70099999999999996,"5min":0.95299999999999996,"15min":1.0429999999999999},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54400000000000004,"15min":0.55100000000000005},"min":{"1min":0.35799999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69399999999999995,"5min":0.78100000000000003,"15min":0.79900000000000004},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73899999999999999,"5min":0.79600000000000004,"15min":1.1679999999999999},"last":0.623}]},{"osd":5,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.27600000000000002},"max":{"1min":0.58399999999999996,"5min":0.71099999999999997,"15min":0.80700000000000005},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46200000000000002,"15min":0.45900000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.63500000000000001,"5min":0.68100000000000005,"15min":1.3919999999999999},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.50600000000000001,"15min":0.496},"min":{"1min":0.316,"5min":0.316,"15min":0.31},"max":{"1min":0.64800000000000002,"5min":0.83599999999999997,"15min":0.93300000000000005},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54900000000000004,"15min":0.54400000000000004},"min":{"1min":0.41499999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67600000000000005,"5min":0.78100000000000003,"15min":0.92500000000000004},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51300000000000001,"15min":0.51900000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30099999999999999},"max":{"1min":0.70099999999999996,"5min":0.85699999999999998,"15min":1.246},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.41499999999999998,"5min":0.39900000000000002,"15min":0.371},"max":{"1min":0.72299999999999998,"5min":0.88900000000000001,"15min":1.321},"last":0.63800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575754,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307532,"kb_used_data":2244,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064308,"statfs":{"total":96636764160,"available":96321851392,"internally_reserved":0,"allocated":2297856,"data_stored":1173397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.54300000000000004,"15min":0.55000000000000004},"min":{"1min":0.34799999999999998,"5min":0.33400000000000002,"15min":0.30099999999999999},"max":{"1min":0.59999999999999998,"5min":0.73799999999999999,"15min":0.81899999999999995},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.54700000000000004,"15min":0.55000000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.30399999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.59099999999999997}]},{"osd":1,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.34799999999999998,"5min":0.33200000000000002,"15min":0.29499999999999998},"max":{"1min":0.72299999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.55800000000000005,"15min":0.56399999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.69399999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.73999999999999999}]},{"osd":2,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.376,"5min":0.372,"15min":0.35099999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.35299999999999998},"max":{"1min":0.66500000000000004,"5min":0.84999999999999998,"15min":0.876},"last":0.72199999999999998}]},{"osd":3,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.622}]},{"osd":4,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.441,"15min":0.437},"min":{"1min":0.309,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.47399999999999998,"15min":0.46700000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.42799999999999999}]},{"osd":6,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48199999999999998,"15min":0.47899999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55700000000000005,"15min":0.54900000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.313},"max":{"1min":0.73499999999999999,"5min":0.76700000000000002,"15min":0.83499999999999996},"last":0.50600000000000001}]},{"osd":7,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.54300000000000004,"15min":0.52600000000000002},"min":{"1min":0.33300000000000002,"5min":0.313,"15min":0.313},"max":{"1min":3.2240000000000002,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.59099999999999997,"15min":0.57899999999999996},"min":{"1min":0.42999999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":3.1659999999999999,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.51700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T18:23:16.158 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T18:23:16.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.310+0000 7f053ec6e700 1 Processor -- start 2023-11-30T18:23:16.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.310+0000 7f053ec6e700 1 -- start start 2023-11-30T18:23:16.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.311+0000 7f053ec6e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05380caab0 0x7f05380aa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:16.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.311+0000 7f053ec6e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f05380cae90 0x7f05380c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:16.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.311+0000 7f053ec6e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05380a9a90 con 0x7f05380aa960 2023-11-30T18:23:16.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.311+0000 7f053ec6e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0538154ce0 con 0x7f05380cae90 2023-11-30T18:23:16.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.311+0000 7f053ec6e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05380a8e80 con 0x7f05380caab0 2023-11-30T18:23:16.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.311+0000 7f0537fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f05380cae90 0x7f05380c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:16.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.311+0000 7f053d20b700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f05380aa960 0x7f05380c9170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39074/0 (socket says 172.21.15.49:39074) 2023-11-30T18:23:16.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.311+0000 7f0537fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f05380cae90 0x7f05380c0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46002/0 (socket says 172.21.15.49:46002) 2023-11-30T18:23:16.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.311+0000 7f053d20b700 1 -- 172.21.15.49:0/3316027979 learned_addr learned my addr 172.21.15.49:0/3316027979 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:23:16.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.311+0000 7f053ca0a700 1 --2- 172.21.15.49:0/3316027979 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05380caab0 0x7f05380aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:16.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.311+0000 7f0537fff700 1 -- 172.21.15.49:0/3316027979 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05380caab0 msgr2=0x7f05380aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:16.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.311+0000 7f0537fff700 1 --2- 172.21.15.49:0/3316027979 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05380caab0 0x7f05380aa470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:16.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.311+0000 7f0537fff700 1 -- 172.21.15.49:0/3316027979 >> v1:172.21.15.49:6789/0 conn(0x7f05380aa960 legacy=0x7f05380c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:16.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.311+0000 7f0537fff700 1 -- 172.21.15.49:0/3316027979 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05380a9160 con 0x7f05380cae90 2023-11-30T18:23:16.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.311+0000 7f05377fe700 1 -- 172.21.15.49:0/3316027979 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3231193796 0 0) 0x7f05380a9a90 con 0x7f05380aa960 2023-11-30T18:23:16.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.311+0000 7f0537fff700 1 --2- 172.21.15.49:0/3316027979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05380cae90 0x7f05380c0ab0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7f0528009e60 tx=0x7f0528009780).ready entity=mon.0 client_cookie=359334d0d094f1ab server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:16.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.311+0000 7f05377fe700 1 -- 172.21.15.49:0/3316027979 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052800e070 con 0x7f05380cae90 2023-11-30T18:23:16.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.312+0000 7f05377fe700 1 -- 172.21.15.49:0/3316027979 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052800bc30 con 0x7f05380cae90 2023-11-30T18:23:16.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.312+0000 7f05377fe700 1 -- 172.21.15.49:0/3316027979 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0528012410 con 0x7f05380cae90 2023-11-30T18:23:16.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.312+0000 7f053ec6e700 1 -- 172.21.15.49:0/3316027979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05380cae90 msgr2=0x7f05380c0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:16.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.312+0000 7f053ec6e700 1 --2- 172.21.15.49:0/3316027979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05380cae90 0x7f05380c0ab0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7f0528009e60 tx=0x7f0528009780).stop 2023-11-30T18:23:16.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.312+0000 7f053ec6e700 1 -- 172.21.15.49:0/3316027979 shutdown_connections 2023-11-30T18:23:16.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.312+0000 7f053ec6e700 1 --2- 172.21.15.49:0/3316027979 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05380caab0 0x7f05380aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:16.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.312+0000 7f053ec6e700 1 --2- 172.21.15.49:0/3316027979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05380cae90 0x7f05380c0ab0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:16.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.312+0000 7f053ec6e700 1 -- 172.21.15.49:0/3316027979 >> 172.21.15.49:0/3316027979 conn(0x7f0538094920 msgr2=0x7f053806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:16.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.312+0000 7f053ec6e700 1 -- 172.21.15.49:0/3316027979 shutdown_connections 2023-11-30T18:23:16.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.312+0000 7f053ec6e700 1 -- 172.21.15.49:0/3316027979 wait complete. 2023-11-30T18:23:16.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.313+0000 7f053ec6e700 1 Processor -- start 2023-11-30T18:23:16.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.313+0000 7f053ec6e700 1 -- start start 2023-11-30T18:23:16.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.314+0000 7f053ec6e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05380caab0 0x7f053814c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:16.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.314+0000 7f053ec6e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05380cae90 0x7f05381559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:16.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.314+0000 7f053ec6e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0538155ec0 0x7f0538151db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:16.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.314+0000 7f053ec6e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0538164f10 con 0x7f05380cae90 2023-11-30T18:23:16.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.314+0000 7f053ec6e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05381651f0 con 0x7f05380caab0 2023-11-30T18:23:16.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.314+0000 7f053ec6e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05381654d0 con 0x7f0538155ec0 2023-11-30T18:23:16.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.314+0000 7f0537fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05380cae90 0x7f05381559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:16.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.314+0000 7f0537fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05380cae90 0x7f05381559d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46018/0 (socket says 172.21.15.49:46018) 2023-11-30T18:23:16.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.314+0000 7f0537fff700 1 -- 172.21.15.49:0/1769350504 learned_addr learned my addr 172.21.15.49:0/1769350504 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:16.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.314+0000 7f053ca0a700 1 --2- 172.21.15.49:0/1769350504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05380caab0 0x7f053814c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:16.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.314+0000 7f053d20b700 1 --2- 172.21.15.49:0/1769350504 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0538155ec0 0x7f0538151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:16.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.314+0000 7f0537fff700 1 -- 172.21.15.49:0/1769350504 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0538155ec0 msgr2=0x7f0538151db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:16.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.314+0000 7f0537fff700 1 --2- 172.21.15.49:0/1769350504 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0538155ec0 0x7f0538151db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:16.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.314+0000 7f0537fff700 1 -- 172.21.15.49:0/1769350504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05380caab0 msgr2=0x7f053814c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:16.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.314+0000 7f0537fff700 1 --2- 172.21.15.49:0/1769350504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05380caab0 0x7f053814c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:16.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.314+0000 7f0537fff700 1 -- 172.21.15.49:0/1769350504 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0528009a20 con 0x7f05380cae90 2023-11-30T18:23:16.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.314+0000 7f053ca0a700 1 --2- 172.21.15.49:0/1769350504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05380caab0 0x7f053814c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:23:16.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.315+0000 7f0537fff700 1 --2- 172.21.15.49:0/1769350504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05380cae90 0x7f05381559d0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7f0538083c30 tx=0x7f0528009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:16.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.315+0000 7f0534ff9700 1 -- 172.21.15.49:0/1769350504 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052801d630 con 0x7f05380cae90 2023-11-30T18:23:16.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.315+0000 7f0534ff9700 1 -- 172.21.15.49:0/1769350504 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052801d790 con 0x7f05380cae90 2023-11-30T18:23:16.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.315+0000 7f053ec6e700 1 -- 172.21.15.49:0/1769350504 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05381657b0 con 0x7f05380cae90 2023-11-30T18:23:16.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.315+0000 7f0534ff9700 1 -- 172.21.15.49:0/1769350504 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052801db10 con 0x7f05380cae90 2023-11-30T18:23:16.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.315+0000 7f053ec6e700 1 -- 172.21.15.49:0/1769350504 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0538164ac0 con 0x7f05380cae90 2023-11-30T18:23:16.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.316+0000 7f053ec6e700 1 -- 172.21.15.49:0/1769350504 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0538164ce0 con 0x7f05380cae90 2023-11-30T18:23:16.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.316+0000 7f0534ff9700 1 -- 172.21.15.49:0/1769350504 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0528003040 con 0x7f05380cae90 2023-11-30T18:23:16.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.316+0000 7f0534ff9700 1 --2- 172.21.15.49:0/1769350504 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f051805f270 0x7f0518061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:16.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.316+0000 7f0534ff9700 1 -- 172.21.15.49:0/1769350504 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f052807c130 con 0x7f05380cae90 2023-11-30T18:23:16.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.317+0000 7f053ca0a700 1 --2- 172.21.15.49:0/1769350504 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f051805f270 0x7f0518061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:16.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.317+0000 7f053ca0a700 1 --2- 172.21.15.49:0/1769350504 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f051805f270 0x7f0518061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f0520006fd0 tx=0x7f0520008040).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:16.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.321+0000 7f0534ff9700 1 -- 172.21.15.49:0/1769350504 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f052804d240 con 0x7f05380cae90 2023-11-30T18:23:16.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.491+0000 7f053ec6e700 1 -- 172.21.15.49:0/1769350504 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0538165360 con 0x7f051805f270 2023-11-30T18:23:16.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.501+0000 7f0534ff9700 1 -- 172.21.15.49:0/1769350504 <== mgr.7394 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359469 (secure 0 0 0) 0x7f0538165360 con 0x7f051805f270 2023-11-30T18:23:16.506 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:23:16.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.504+0000 7f053ec6e700 1 -- 172.21.15.49:0/1769350504 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f051805f270 msgr2=0x7f0518061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:16.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.504+0000 7f053ec6e700 1 --2- 172.21.15.49:0/1769350504 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f051805f270 0x7f0518061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f0520006fd0 tx=0x7f0520008040).stop 2023-11-30T18:23:16.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.504+0000 7f053ec6e700 1 -- 172.21.15.49:0/1769350504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05380cae90 msgr2=0x7f05381559d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:16.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.504+0000 7f053ec6e700 1 --2- 172.21.15.49:0/1769350504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05380cae90 0x7f05381559d0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7f0538083c30 tx=0x7f0528009780).stop 2023-11-30T18:23:16.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.504+0000 7f053ec6e700 1 -- 172.21.15.49:0/1769350504 shutdown_connections 2023-11-30T18:23:16.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.504+0000 7f053ec6e700 1 --2- 172.21.15.49:0/1769350504 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0538155ec0 0x7f0538151db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:16.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.504+0000 7f053ec6e700 1 --2- 172.21.15.49:0/1769350504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05380caab0 0x7f053814c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:16.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.504+0000 7f053ec6e700 1 --2- 172.21.15.49:0/1769350504 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f051805f270 0x7f0518061730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:16.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.504+0000 7f053ec6e700 1 --2- 172.21.15.49:0/1769350504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05380cae90 0x7f05381559d0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:16.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.504+0000 7f053ec6e700 1 -- 172.21.15.49:0/1769350504 >> 172.21.15.49:0/1769350504 conn(0x7f0538094920 msgr2=0x7f05380ac070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:16.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.505+0000 7f053ec6e700 1 -- 172.21.15.49:0/1769350504 shutdown_connections 2023-11-30T18:23:16.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.505+0000 7f053ec6e700 1 -- 172.21.15.49:0/1769350504 wait complete. 2023-11-30T18:23:16.510 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T18:23:16.517 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-30T18:23:15.227279+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":212,"acting":212,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2464280,"kb_used_data":17880,"kb_used_omap":0,"kb_used_meta":2446336,"kb_avail":752510440,"statfs":{"total":773094113280,"available":770570690560,"internally_reserved":0,"allocated":18309120,"data_stored":9329994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2505048064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13567,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-67,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.003614"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3f","version":"183'3","reported_seq":13,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120488+0000","last_change":"2023-11-30T18:23:11.729396+0000","last_active":"2023-11-30T18:23:12.120488+0000","last_peered":"2023-11-30T18:23:12.120488+0000","last_clean":"2023-11-30T18:23:12.120488+0000","last_became_active":"2023-11-30T18:23:11.729108+0000","last_became_peered":"2023-11-30T18:23:11.729108+0000","last_unstale":"2023-11-30T18:23:12.120488+0000","last_undegraded":"2023-11-30T18:23:12.120488+0000","last_fullsized":"2023-11-30T18:23:12.120488+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120073+0000","last_change":"2023-11-30T18:23:12.118530+0000","last_active":"2023-11-30T18:23:12.120073+0000","last_peered":"2023-11-30T18:23:12.120073+0000","last_clean":"2023-11-30T18:23:12.120073+0000","last_became_active":"2023-11-30T18:23:12.118224+0000","last_became_peered":"2023-11-30T18:23:12.118224+0000","last_unstale":"2023-11-30T18:23:12.120073+0000","last_undegraded":"2023-11-30T18:23:12.120073+0000","last_fullsized":"2023-11-30T18:23:12.120073+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.104272+0000","last_change":"2023-11-30T18:23:11.724379+0000","last_active":"2023-11-30T18:23:12.104272+0000","last_peered":"2023-11-30T18:23:12.104272+0000","last_clean":"2023-11-30T18:23:12.104272+0000","last_became_active":"2023-11-30T18:23:11.724081+0000","last_became_peered":"2023-11-30T18:23:11.724081+0000","last_unstale":"2023-11-30T18:23:12.104272+0000","last_undegraded":"2023-11-30T18:23:12.104272+0000","last_fullsized":"2023-11-30T18:23:12.104272+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112554+0000","last_change":"2023-11-30T18:23:12.108411+0000","last_active":"2023-11-30T18:23:12.112554+0000","last_peered":"2023-11-30T18:23:12.112554+0000","last_clean":"2023-11-30T18:23:12.112554+0000","last_became_active":"2023-11-30T18:23:12.108120+0000","last_became_peered":"2023-11-30T18:23:12.108120+0000","last_unstale":"2023-11-30T18:23:12.112554+0000","last_undegraded":"2023-11-30T18:23:12.112554+0000","last_fullsized":"2023-11-30T18:23:12.112554+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120555+0000","last_change":"2023-11-30T18:23:12.112331+0000","last_active":"2023-11-30T18:23:12.120555+0000","last_peered":"2023-11-30T18:23:12.120555+0000","last_clean":"2023-11-30T18:23:12.120555+0000","last_became_active":"2023-11-30T18:23:12.111049+0000","last_became_peered":"2023-11-30T18:23:12.111049+0000","last_unstale":"2023-11-30T18:23:12.120555+0000","last_undegraded":"2023-11-30T18:23:12.120555+0000","last_fullsized":"2023-11-30T18:23:12.120555+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128170+0000","last_change":"2023-11-30T18:23:11.730906+0000","last_active":"2023-11-30T18:23:12.128170+0000","last_peered":"2023-11-30T18:23:12.128170+0000","last_clean":"2023-11-30T18:23:12.128170+0000","last_became_active":"2023-11-30T18:23:11.729501+0000","last_became_peered":"2023-11-30T18:23:11.729501+0000","last_unstale":"2023-11-30T18:23:12.128170+0000","last_undegraded":"2023-11-30T18:23:12.128170+0000","last_fullsized":"2023-11-30T18:23:12.128170+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120886+0000","last_change":"2023-11-30T18:23:12.118680+0000","last_active":"2023-11-30T18:23:12.120886+0000","last_peered":"2023-11-30T18:23:12.120886+0000","last_clean":"2023-11-30T18:23:12.120886+0000","last_became_active":"2023-11-30T18:23:12.118358+0000","last_became_peered":"2023-11-30T18:23:12.118358+0000","last_unstale":"2023-11-30T18:23:12.120886+0000","last_undegraded":"2023-11-30T18:23:12.120886+0000","last_fullsized":"2023-11-30T18:23:12.120886+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114112+0000","last_change":"2023-11-30T18:23:11.732949+0000","last_active":"2023-11-30T18:23:12.114112+0000","last_peered":"2023-11-30T18:23:12.114112+0000","last_clean":"2023-11-30T18:23:12.114112+0000","last_became_active":"2023-11-30T18:23:11.732627+0000","last_became_peered":"2023-11-30T18:23:11.732627+0000","last_unstale":"2023-11-30T18:23:12.114112+0000","last_undegraded":"2023-11-30T18:23:12.114112+0000","last_fullsized":"2023-11-30T18:23:12.114112+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.123862+0000","last_change":"2023-11-30T18:23:12.121133+0000","last_active":"2023-11-30T18:23:12.123862+0000","last_peered":"2023-11-30T18:23:12.123862+0000","last_clean":"2023-11-30T18:23:12.123862+0000","last_became_active":"2023-11-30T18:23:12.120811+0000","last_became_peered":"2023-11-30T18:23:12.120811+0000","last_unstale":"2023-11-30T18:23:12.123862+0000","last_undegraded":"2023-11-30T18:23:12.123862+0000","last_fullsized":"2023-11-30T18:23:12.123862+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105568+0000","last_change":"2023-11-30T18:23:11.732157+0000","last_active":"2023-11-30T18:23:12.105568+0000","last_peered":"2023-11-30T18:23:12.105568+0000","last_clean":"2023-11-30T18:23:12.105568+0000","last_became_active":"2023-11-30T18:23:11.731678+0000","last_became_peered":"2023-11-30T18:23:11.731678+0000","last_unstale":"2023-11-30T18:23:12.105568+0000","last_undegraded":"2023-11-30T18:23:12.105568+0000","last_fullsized":"2023-11-30T18:23:12.105568+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124562+0000","last_change":"2023-11-30T18:23:12.121281+0000","last_active":"2023-11-30T18:23:12.124562+0000","last_peered":"2023-11-30T18:23:12.124562+0000","last_clean":"2023-11-30T18:23:12.124562+0000","last_became_active":"2023-11-30T18:23:12.119940+0000","last_became_peered":"2023-11-30T18:23:12.119940+0000","last_unstale":"2023-11-30T18:23:12.124562+0000","last_undegraded":"2023-11-30T18:23:12.124562+0000","last_fullsized":"2023-11-30T18:23:12.124562+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.099560+0000","last_change":"2023-11-30T18:23:11.729413+0000","last_active":"2023-11-30T18:23:12.099560+0000","last_peered":"2023-11-30T18:23:12.099560+0000","last_clean":"2023-11-30T18:23:12.099560+0000","last_became_active":"2023-11-30T18:23:11.729096+0000","last_became_peered":"2023-11-30T18:23:11.729096+0000","last_unstale":"2023-11-30T18:23:12.099560+0000","last_undegraded":"2023-11-30T18:23:12.099560+0000","last_fullsized":"2023-11-30T18:23:12.099560+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.103587+0000","last_change":"2023-11-30T18:23:11.731558+0000","last_active":"2023-11-30T18:23:12.103587+0000","last_peered":"2023-11-30T18:23:12.103587+0000","last_clean":"2023-11-30T18:23:12.103587+0000","last_became_active":"2023-11-30T18:23:11.731257+0000","last_became_peered":"2023-11-30T18:23:11.731257+0000","last_unstale":"2023-11-30T18:23:12.103587+0000","last_undegraded":"2023-11-30T18:23:12.103587+0000","last_fullsized":"2023-11-30T18:23:12.103587+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124485+0000","last_change":"2023-11-30T18:23:12.119514+0000","last_active":"2023-11-30T18:23:12.124485+0000","last_peered":"2023-11-30T18:23:12.124485+0000","last_clean":"2023-11-30T18:23:12.124485+0000","last_became_active":"2023-11-30T18:23:12.119170+0000","last_became_peered":"2023-11-30T18:23:12.119170+0000","last_unstale":"2023-11-30T18:23:12.124485+0000","last_undegraded":"2023-11-30T18:23:12.124485+0000","last_fullsized":"2023-11-30T18:23:12.124485+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.118785+0000","last_change":"2023-11-30T18:23:11.733798+0000","last_active":"2023-11-30T18:23:12.118785+0000","last_peered":"2023-11-30T18:23:12.118785+0000","last_clean":"2023-11-30T18:23:12.118785+0000","last_became_active":"2023-11-30T18:23:11.733491+0000","last_became_peered":"2023-11-30T18:23:11.733491+0000","last_unstale":"2023-11-30T18:23:12.118785+0000","last_undegraded":"2023-11-30T18:23:12.118785+0000","last_fullsized":"2023-11-30T18:23:12.118785+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.113796+0000","last_change":"2023-11-30T18:23:12.111493+0000","last_active":"2023-11-30T18:23:12.113796+0000","last_peered":"2023-11-30T18:23:12.113796+0000","last_clean":"2023-11-30T18:23:12.113796+0000","last_became_active":"2023-11-30T18:23:12.111224+0000","last_became_peered":"2023-11-30T18:23:12.111224+0000","last_unstale":"2023-11-30T18:23:12.113796+0000","last_undegraded":"2023-11-30T18:23:12.113796+0000","last_fullsized":"2023-11-30T18:23:12.113796+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101233+0000","last_change":"2023-11-30T18:23:11.732288+0000","last_active":"2023-11-30T18:23:12.101233+0000","last_peered":"2023-11-30T18:23:12.101233+0000","last_clean":"2023-11-30T18:23:12.101233+0000","last_became_active":"2023-11-30T18:23:11.731998+0000","last_became_peered":"2023-11-30T18:23:11.731998+0000","last_unstale":"2023-11-30T18:23:12.101233+0000","last_undegraded":"2023-11-30T18:23:12.101233+0000","last_fullsized":"2023-11-30T18:23:12.101233+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.123377+0000","last_change":"2023-11-30T18:23:12.118762+0000","last_active":"2023-11-30T18:23:12.123377+0000","last_peered":"2023-11-30T18:23:12.123377+0000","last_clean":"2023-11-30T18:23:12.123377+0000","last_became_active":"2023-11-30T18:23:12.118456+0000","last_became_peered":"2023-11-30T18:23:12.118456+0000","last_unstale":"2023-11-30T18:23:12.123377+0000","last_undegraded":"2023-11-30T18:23:12.123377+0000","last_fullsized":"2023-11-30T18:23:12.123377+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.34","version":"183'4","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.133525+0000","last_change":"2023-11-30T18:23:11.735207+0000","last_active":"2023-11-30T18:23:12.133525+0000","last_peered":"2023-11-30T18:23:12.133525+0000","last_clean":"2023-11-30T18:23:12.133525+0000","last_became_active":"2023-11-30T18:23:11.734947+0000","last_became_peered":"2023-11-30T18:23:11.734947+0000","last_unstale":"2023-11-30T18:23:12.133525+0000","last_undegraded":"2023-11-30T18:23:12.133525+0000","last_fullsized":"2023-11-30T18:23:12.133525+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112616+0000","last_change":"2023-11-30T18:23:12.110171+0000","last_active":"2023-11-30T18:23:12.112616+0000","last_peered":"2023-11-30T18:23:12.112616+0000","last_clean":"2023-11-30T18:23:12.112616+0000","last_became_active":"2023-11-30T18:23:12.109894+0000","last_became_peered":"2023-11-30T18:23:12.109894+0000","last_unstale":"2023-11-30T18:23:12.112616+0000","last_undegraded":"2023-11-30T18:23:12.112616+0000","last_fullsized":"2023-11-30T18:23:12.112616+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.33","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128319+0000","last_change":"2023-11-30T18:23:11.732423+0000","last_active":"2023-11-30T18:23:12.128319+0000","last_peered":"2023-11-30T18:23:12.128319+0000","last_clean":"2023-11-30T18:23:12.128319+0000","last_became_active":"2023-11-30T18:23:11.732141+0000","last_became_peered":"2023-11-30T18:23:11.732141+0000","last_unstale":"2023-11-30T18:23:12.128319+0000","last_undegraded":"2023-11-30T18:23:12.128319+0000","last_fullsized":"2023-11-30T18:23:12.128319+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114206+0000","last_change":"2023-11-30T18:23:12.113067+0000","last_active":"2023-11-30T18:23:12.114206+0000","last_peered":"2023-11-30T18:23:12.114206+0000","last_clean":"2023-11-30T18:23:12.114206+0000","last_became_active":"2023-11-30T18:23:12.112084+0000","last_became_peered":"2023-11-30T18:23:12.112084+0000","last_unstale":"2023-11-30T18:23:12.114206+0000","last_undegraded":"2023-11-30T18:23:12.114206+0000","last_fullsized":"2023-11-30T18:23:12.114206+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114699+0000","last_change":"2023-11-30T18:23:11.731206+0000","last_active":"2023-11-30T18:23:12.114699+0000","last_peered":"2023-11-30T18:23:12.114699+0000","last_clean":"2023-11-30T18:23:12.114699+0000","last_became_active":"2023-11-30T18:23:11.730937+0000","last_became_peered":"2023-11-30T18:23:11.730937+0000","last_unstale":"2023-11-30T18:23:12.114699+0000","last_undegraded":"2023-11-30T18:23:12.114699+0000","last_fullsized":"2023-11-30T18:23:12.114699+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.116858+0000","last_change":"2023-11-30T18:23:12.115316+0000","last_active":"2023-11-30T18:23:12.116858+0000","last_peered":"2023-11-30T18:23:12.116858+0000","last_clean":"2023-11-30T18:23:12.116858+0000","last_became_active":"2023-11-30T18:23:12.114473+0000","last_became_peered":"2023-11-30T18:23:12.114473+0000","last_unstale":"2023-11-30T18:23:12.116858+0000","last_undegraded":"2023-11-30T18:23:12.116858+0000","last_fullsized":"2023-11-30T18:23:12.116858+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.30","version":"183'4","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.127276+0000","last_change":"2023-11-30T18:23:11.729498+0000","last_active":"2023-11-30T18:23:12.127276+0000","last_peered":"2023-11-30T18:23:12.127276+0000","last_clean":"2023-11-30T18:23:12.127276+0000","last_became_active":"2023-11-30T18:23:11.729221+0000","last_became_peered":"2023-11-30T18:23:11.729221+0000","last_unstale":"2023-11-30T18:23:12.127276+0000","last_undegraded":"2023-11-30T18:23:12.127276+0000","last_fullsized":"2023-11-30T18:23:12.127276+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.118300+0000","last_change":"2023-11-30T18:23:12.113823+0000","last_active":"2023-11-30T18:23:12.118300+0000","last_peered":"2023-11-30T18:23:12.118300+0000","last_clean":"2023-11-30T18:23:12.118300+0000","last_became_active":"2023-11-30T18:23:12.113041+0000","last_became_peered":"2023-11-30T18:23:12.113041+0000","last_unstale":"2023-11-30T18:23:12.118300+0000","last_undegraded":"2023-11-30T18:23:12.118300+0000","last_fullsized":"2023-11-30T18:23:12.118300+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120207+0000","last_change":"2023-11-30T18:23:11.737572+0000","last_active":"2023-11-30T18:23:12.120207+0000","last_peered":"2023-11-30T18:23:12.120207+0000","last_clean":"2023-11-30T18:23:12.120207+0000","last_became_active":"2023-11-30T18:23:11.737226+0000","last_became_peered":"2023-11-30T18:23:11.737226+0000","last_unstale":"2023-11-30T18:23:12.120207+0000","last_undegraded":"2023-11-30T18:23:12.120207+0000","last_fullsized":"2023-11-30T18:23:12.120207+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.136298+0000","last_change":"2023-11-30T18:23:12.131062+0000","last_active":"2023-11-30T18:23:12.136298+0000","last_peered":"2023-11-30T18:23:12.136298+0000","last_clean":"2023-11-30T18:23:12.136298+0000","last_became_active":"2023-11-30T18:23:12.130780+0000","last_became_peered":"2023-11-30T18:23:12.130780+0000","last_unstale":"2023-11-30T18:23:12.136298+0000","last_undegraded":"2023-11-30T18:23:12.136298+0000","last_fullsized":"2023-11-30T18:23:12.136298+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124700+0000","last_change":"2023-11-30T18:23:12.122966+0000","last_active":"2023-11-30T18:23:12.124700+0000","last_peered":"2023-11-30T18:23:12.124700+0000","last_clean":"2023-11-30T18:23:12.124700+0000","last_became_active":"2023-11-30T18:23:12.122442+0000","last_became_peered":"2023-11-30T18:23:12.122442+0000","last_unstale":"2023-11-30T18:23:12.124700+0000","last_undegraded":"2023-11-30T18:23:12.124700+0000","last_fullsized":"2023-11-30T18:23:12.124700+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.125158+0000","last_change":"2023-11-30T18:23:11.732298+0000","last_active":"2023-11-30T18:23:12.125158+0000","last_peered":"2023-11-30T18:23:12.125158+0000","last_clean":"2023-11-30T18:23:12.125158+0000","last_became_active":"2023-11-30T18:23:11.731767+0000","last_became_peered":"2023-11-30T18:23:11.731767+0000","last_unstale":"2023-11-30T18:23:12.125158+0000","last_undegraded":"2023-11-30T18:23:12.125158+0000","last_fullsized":"2023-11-30T18:23:12.125158+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.121943+0000","last_change":"2023-11-30T18:23:11.728290+0000","last_active":"2023-11-30T18:23:12.121943+0000","last_peered":"2023-11-30T18:23:12.121943+0000","last_clean":"2023-11-30T18:23:12.121943+0000","last_became_active":"2023-11-30T18:23:11.727972+0000","last_became_peered":"2023-11-30T18:23:11.727972+0000","last_unstale":"2023-11-30T18:23:12.121943+0000","last_undegraded":"2023-11-30T18:23:12.121943+0000","last_fullsized":"2023-11-30T18:23:12.121943+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.125287+0000","last_change":"2023-11-30T18:23:12.117183+0000","last_active":"2023-11-30T18:23:12.125287+0000","last_peered":"2023-11-30T18:23:12.125287+0000","last_clean":"2023-11-30T18:23:12.125287+0000","last_became_active":"2023-11-30T18:23:12.116864+0000","last_became_peered":"2023-11-30T18:23:12.116864+0000","last_unstale":"2023-11-30T18:23:12.125287+0000","last_undegraded":"2023-11-30T18:23:12.125287+0000","last_fullsized":"2023-11-30T18:23:12.125287+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.127634+0000","last_change":"2023-11-30T18:23:11.735658+0000","last_active":"2023-11-30T18:23:12.127634+0000","last_peered":"2023-11-30T18:23:12.127634+0000","last_clean":"2023-11-30T18:23:12.127634+0000","last_became_active":"2023-11-30T18:23:11.735382+0000","last_became_peered":"2023-11-30T18:23:11.735382+0000","last_unstale":"2023-11-30T18:23:12.127634+0000","last_undegraded":"2023-11-30T18:23:12.127634+0000","last_fullsized":"2023-11-30T18:23:12.127634+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128740+0000","last_change":"2023-11-30T18:23:12.124153+0000","last_active":"2023-11-30T18:23:12.128740+0000","last_peered":"2023-11-30T18:23:12.128740+0000","last_clean":"2023-11-30T18:23:12.128740+0000","last_became_active":"2023-11-30T18:23:12.123877+0000","last_became_peered":"2023-11-30T18:23:12.123877+0000","last_unstale":"2023-11-30T18:23:12.128740+0000","last_undegraded":"2023-11-30T18:23:12.128740+0000","last_fullsized":"2023-11-30T18:23:12.128740+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.126056+0000","last_change":"2023-11-30T18:23:12.124681+0000","last_active":"2023-11-30T18:23:12.126056+0000","last_peered":"2023-11-30T18:23:12.126056+0000","last_clean":"2023-11-30T18:23:12.126056+0000","last_became_active":"2023-11-30T18:23:12.124348+0000","last_became_peered":"2023-11-30T18:23:12.124348+0000","last_unstale":"2023-11-30T18:23:12.126056+0000","last_undegraded":"2023-11-30T18:23:12.126056+0000","last_fullsized":"2023-11-30T18:23:12.126056+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.116384+0000","last_change":"2023-11-30T18:23:11.734523+0000","last_active":"2023-11-30T18:23:12.116384+0000","last_peered":"2023-11-30T18:23:12.116384+0000","last_clean":"2023-11-30T18:23:12.116384+0000","last_became_active":"2023-11-30T18:23:11.734241+0000","last_became_peered":"2023-11-30T18:23:11.734241+0000","last_unstale":"2023-11-30T18:23:12.116384+0000","last_undegraded":"2023-11-30T18:23:12.116384+0000","last_fullsized":"2023-11-30T18:23:12.116384+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124583+0000","last_change":"2023-11-30T18:23:12.122081+0000","last_active":"2023-11-30T18:23:12.124583+0000","last_peered":"2023-11-30T18:23:12.124583+0000","last_clean":"2023-11-30T18:23:12.124583+0000","last_became_active":"2023-11-30T18:23:12.121493+0000","last_became_peered":"2023-11-30T18:23:12.121493+0000","last_unstale":"2023-11-30T18:23:12.124583+0000","last_undegraded":"2023-11-30T18:23:12.124583+0000","last_fullsized":"2023-11-30T18:23:12.124583+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.119133+0000","last_change":"2023-11-30T18:23:11.734920+0000","last_active":"2023-11-30T18:23:12.119133+0000","last_peered":"2023-11-30T18:23:12.119133+0000","last_clean":"2023-11-30T18:23:12.119133+0000","last_became_active":"2023-11-30T18:23:11.734578+0000","last_became_peered":"2023-11-30T18:23:11.734578+0000","last_unstale":"2023-11-30T18:23:12.119133+0000","last_undegraded":"2023-11-30T18:23:12.119133+0000","last_fullsized":"2023-11-30T18:23:12.119133+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.123244+0000","last_change":"2023-11-30T18:23:12.118073+0000","last_active":"2023-11-30T18:23:12.123244+0000","last_peered":"2023-11-30T18:23:12.123244+0000","last_clean":"2023-11-30T18:23:12.123244+0000","last_became_active":"2023-11-30T18:23:12.117796+0000","last_became_peered":"2023-11-30T18:23:12.117796+0000","last_unstale":"2023-11-30T18:23:12.123244+0000","last_undegraded":"2023-11-30T18:23:12.123244+0000","last_fullsized":"2023-11-30T18:23:12.123244+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101617+0000","last_change":"2023-11-30T18:23:11.728070+0000","last_active":"2023-11-30T18:23:12.101617+0000","last_peered":"2023-11-30T18:23:12.101617+0000","last_clean":"2023-11-30T18:23:12.101617+0000","last_became_active":"2023-11-30T18:23:11.727817+0000","last_became_peered":"2023-11-30T18:23:11.727817+0000","last_unstale":"2023-11-30T18:23:12.101617+0000","last_undegraded":"2023-11-30T18:23:12.101617+0000","last_fullsized":"2023-11-30T18:23:12.101617+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120898+0000","last_change":"2023-11-30T18:23:12.119472+0000","last_active":"2023-11-30T18:23:12.120898+0000","last_peered":"2023-11-30T18:23:12.120898+0000","last_clean":"2023-11-30T18:23:12.120898+0000","last_became_active":"2023-11-30T18:23:12.119192+0000","last_became_peered":"2023-11-30T18:23:12.119192+0000","last_unstale":"2023-11-30T18:23:12.120898+0000","last_undegraded":"2023-11-30T18:23:12.120898+0000","last_fullsized":"2023-11-30T18:23:12.120898+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.119296+0000","last_change":"2023-11-30T18:23:11.725649+0000","last_active":"2023-11-30T18:23:12.119296+0000","last_peered":"2023-11-30T18:23:12.119296+0000","last_clean":"2023-11-30T18:23:12.119296+0000","last_became_active":"2023-11-30T18:23:11.725358+0000","last_became_peered":"2023-11-30T18:23:11.725358+0000","last_unstale":"2023-11-30T18:23:12.119296+0000","last_undegraded":"2023-11-30T18:23:12.119296+0000","last_fullsized":"2023-11-30T18:23:12.119296+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.121579+0000","last_change":"2023-11-30T18:23:12.119529+0000","last_active":"2023-11-30T18:23:12.121579+0000","last_peered":"2023-11-30T18:23:12.121579+0000","last_clean":"2023-11-30T18:23:12.121579+0000","last_became_active":"2023-11-30T18:23:12.119258+0000","last_became_peered":"2023-11-30T18:23:12.119258+0000","last_unstale":"2023-11-30T18:23:12.121579+0000","last_undegraded":"2023-11-30T18:23:12.121579+0000","last_fullsized":"2023-11-30T18:23:12.121579+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.107434+0000","last_change":"2023-11-30T18:23:11.726054+0000","last_active":"2023-11-30T18:23:12.107434+0000","last_peered":"2023-11-30T18:23:12.107434+0000","last_clean":"2023-11-30T18:23:12.107434+0000","last_became_active":"2023-11-30T18:23:11.725740+0000","last_became_peered":"2023-11-30T18:23:11.725740+0000","last_unstale":"2023-11-30T18:23:12.107434+0000","last_undegraded":"2023-11-30T18:23:12.107434+0000","last_fullsized":"2023-11-30T18:23:12.107434+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.100712+0000","last_change":"2023-11-30T18:23:11.727466+0000","last_active":"2023-11-30T18:23:12.100712+0000","last_peered":"2023-11-30T18:23:12.100712+0000","last_clean":"2023-11-30T18:23:12.100712+0000","last_became_active":"2023-11-30T18:23:11.727184+0000","last_became_peered":"2023-11-30T18:23:11.727184+0000","last_unstale":"2023-11-30T18:23:12.100712+0000","last_undegraded":"2023-11-30T18:23:12.100712+0000","last_fullsized":"2023-11-30T18:23:12.100712+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.113593+0000","last_change":"2023-11-30T18:23:12.108335+0000","last_active":"2023-11-30T18:23:12.113593+0000","last_peered":"2023-11-30T18:23:12.113593+0000","last_clean":"2023-11-30T18:23:12.113593+0000","last_became_active":"2023-11-30T18:23:12.108065+0000","last_became_peered":"2023-11-30T18:23:12.108065+0000","last_unstale":"2023-11-30T18:23:12.113593+0000","last_undegraded":"2023-11-30T18:23:12.113593+0000","last_fullsized":"2023-11-30T18:23:12.113593+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124728+0000","last_change":"2023-11-30T18:23:12.118313+0000","last_active":"2023-11-30T18:23:12.124728+0000","last_peered":"2023-11-30T18:23:12.124728+0000","last_clean":"2023-11-30T18:23:12.124728+0000","last_became_active":"2023-11-30T18:23:12.114897+0000","last_became_peered":"2023-11-30T18:23:12.114897+0000","last_unstale":"2023-11-30T18:23:12.124728+0000","last_undegraded":"2023-11-30T18:23:12.124728+0000","last_fullsized":"2023-11-30T18:23:12.124728+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.103019+0000","last_change":"2023-11-30T18:23:11.728348+0000","last_active":"2023-11-30T18:23:12.103019+0000","last_peered":"2023-11-30T18:23:12.103019+0000","last_clean":"2023-11-30T18:23:12.103019+0000","last_became_active":"2023-11-30T18:23:11.728052+0000","last_became_peered":"2023-11-30T18:23:11.728052+0000","last_unstale":"2023-11-30T18:23:12.103019+0000","last_undegraded":"2023-11-30T18:23:12.103019+0000","last_fullsized":"2023-11-30T18:23:12.103019+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.116614+0000","last_change":"2023-11-30T18:23:11.733562+0000","last_active":"2023-11-30T18:23:12.116614+0000","last_peered":"2023-11-30T18:23:12.116614+0000","last_clean":"2023-11-30T18:23:12.116614+0000","last_became_active":"2023-11-30T18:23:11.733271+0000","last_became_peered":"2023-11-30T18:23:11.733271+0000","last_unstale":"2023-11-30T18:23:12.116614+0000","last_undegraded":"2023-11-30T18:23:12.116614+0000","last_fullsized":"2023-11-30T18:23:12.116614+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.122060+0000","last_change":"2023-11-30T18:23:12.120946+0000","last_active":"2023-11-30T18:23:12.122060+0000","last_peered":"2023-11-30T18:23:12.122060+0000","last_clean":"2023-11-30T18:23:12.122060+0000","last_became_active":"2023-11-30T18:23:12.120510+0000","last_became_peered":"2023-11-30T18:23:12.120510+0000","last_unstale":"2023-11-30T18:23:12.122060+0000","last_undegraded":"2023-11-30T18:23:12.122060+0000","last_fullsized":"2023-11-30T18:23:12.122060+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.118883+0000","last_change":"2023-11-30T18:23:11.722137+0000","last_active":"2023-11-30T18:23:12.118883+0000","last_peered":"2023-11-30T18:23:12.118883+0000","last_clean":"2023-11-30T18:23:12.118883+0000","last_became_active":"2023-11-30T18:23:11.721662+0000","last_became_peered":"2023-11-30T18:23:11.721662+0000","last_unstale":"2023-11-30T18:23:12.118883+0000","last_undegraded":"2023-11-30T18:23:12.118883+0000","last_fullsized":"2023-11-30T18:23:12.118883+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112020+0000","last_change":"2023-11-30T18:23:12.108920+0000","last_active":"2023-11-30T18:23:12.112020+0000","last_peered":"2023-11-30T18:23:12.112020+0000","last_clean":"2023-11-30T18:23:12.112020+0000","last_became_active":"2023-11-30T18:23:12.108658+0000","last_became_peered":"2023-11-30T18:23:12.108658+0000","last_unstale":"2023-11-30T18:23:12.112020+0000","last_undegraded":"2023-11-30T18:23:12.112020+0000","last_fullsized":"2023-11-30T18:23:12.112020+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.127959+0000","last_change":"2023-11-30T18:23:11.735560+0000","last_active":"2023-11-30T18:23:12.127959+0000","last_peered":"2023-11-30T18:23:12.127959+0000","last_clean":"2023-11-30T18:23:12.127959+0000","last_became_active":"2023-11-30T18:23:11.735257+0000","last_became_peered":"2023-11-30T18:23:11.735257+0000","last_unstale":"2023-11-30T18:23:12.127959+0000","last_undegraded":"2023-11-30T18:23:12.127959+0000","last_fullsized":"2023-11-30T18:23:12.127959+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"183'2","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128863+0000","last_change":"2023-11-30T18:23:11.735338+0000","last_active":"2023-11-30T18:23:12.128863+0000","last_peered":"2023-11-30T18:23:12.128863+0000","last_clean":"2023-11-30T18:23:12.128863+0000","last_became_active":"2023-11-30T18:23:11.735068+0000","last_became_peered":"2023-11-30T18:23:11.735068+0000","last_unstale":"2023-11-30T18:23:12.128863+0000","last_undegraded":"2023-11-30T18:23:12.128863+0000","last_fullsized":"2023-11-30T18:23:12.128863+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.130572+0000","last_change":"2023-11-30T18:23:12.128165+0000","last_active":"2023-11-30T18:23:12.130572+0000","last_peered":"2023-11-30T18:23:12.130572+0000","last_clean":"2023-11-30T18:23:12.130572+0000","last_became_active":"2023-11-30T18:23:12.127878+0000","last_became_peered":"2023-11-30T18:23:12.127878+0000","last_unstale":"2023-11-30T18:23:12.130572+0000","last_undegraded":"2023-11-30T18:23:12.130572+0000","last_fullsized":"2023-11-30T18:23:12.130572+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.100901+0000","last_change":"2023-11-30T18:23:11.734177+0000","last_active":"2023-11-30T18:23:12.100901+0000","last_peered":"2023-11-30T18:23:12.100901+0000","last_clean":"2023-11-30T18:23:12.100901+0000","last_became_active":"2023-11-30T18:23:11.733869+0000","last_became_peered":"2023-11-30T18:23:11.733869+0000","last_unstale":"2023-11-30T18:23:12.100901+0000","last_undegraded":"2023-11-30T18:23:12.100901+0000","last_fullsized":"2023-11-30T18:23:12.100901+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.126660+0000","last_change":"2023-11-30T18:23:12.125934+0000","last_active":"2023-11-30T18:23:12.126660+0000","last_peered":"2023-11-30T18:23:12.126660+0000","last_clean":"2023-11-30T18:23:12.126660+0000","last_became_active":"2023-11-30T18:23:12.125609+0000","last_became_peered":"2023-11-30T18:23:12.125609+0000","last_unstale":"2023-11-30T18:23:12.126660+0000","last_undegraded":"2023-11-30T18:23:12.126660+0000","last_fullsized":"2023-11-30T18:23:12.126660+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105169+0000","last_change":"2023-11-30T18:23:11.726273+0000","last_active":"2023-11-30T18:23:12.105169+0000","last_peered":"2023-11-30T18:23:12.105169+0000","last_clean":"2023-11-30T18:23:12.105169+0000","last_became_active":"2023-11-30T18:23:11.726024+0000","last_became_peered":"2023-11-30T18:23:11.726024+0000","last_unstale":"2023-11-30T18:23:12.105169+0000","last_undegraded":"2023-11-30T18:23:12.105169+0000","last_fullsized":"2023-11-30T18:23:12.105169+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114198+0000","last_change":"2023-11-30T18:23:12.111598+0000","last_active":"2023-11-30T18:23:12.114198+0000","last_peered":"2023-11-30T18:23:12.114198+0000","last_clean":"2023-11-30T18:23:12.114198+0000","last_became_active":"2023-11-30T18:23:12.110743+0000","last_became_peered":"2023-11-30T18:23:12.110743+0000","last_unstale":"2023-11-30T18:23:12.114198+0000","last_undegraded":"2023-11-30T18:23:12.114198+0000","last_fullsized":"2023-11-30T18:23:12.114198+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105796+0000","last_change":"2023-11-30T18:23:11.734590+0000","last_active":"2023-11-30T18:23:12.105796+0000","last_peered":"2023-11-30T18:23:12.105796+0000","last_clean":"2023-11-30T18:23:12.105796+0000","last_became_active":"2023-11-30T18:23:11.734303+0000","last_became_peered":"2023-11-30T18:23:11.734303+0000","last_unstale":"2023-11-30T18:23:12.105796+0000","last_undegraded":"2023-11-30T18:23:12.105796+0000","last_fullsized":"2023-11-30T18:23:12.105796+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120605+0000","last_change":"2023-11-30T18:23:12.112705+0000","last_active":"2023-11-30T18:23:12.120605+0000","last_peered":"2023-11-30T18:23:12.120605+0000","last_clean":"2023-11-30T18:23:12.120605+0000","last_became_active":"2023-11-30T18:23:12.111139+0000","last_became_peered":"2023-11-30T18:23:12.111139+0000","last_unstale":"2023-11-30T18:23:12.120605+0000","last_undegraded":"2023-11-30T18:23:12.120605+0000","last_fullsized":"2023-11-30T18:23:12.120605+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.103710+0000","last_change":"2023-11-30T18:23:11.728671+0000","last_active":"2023-11-30T18:23:12.103710+0000","last_peered":"2023-11-30T18:23:12.103710+0000","last_clean":"2023-11-30T18:23:12.103710+0000","last_became_active":"2023-11-30T18:23:11.728345+0000","last_became_peered":"2023-11-30T18:23:11.728345+0000","last_unstale":"2023-11-30T18:23:12.103710+0000","last_undegraded":"2023-11-30T18:23:12.103710+0000","last_fullsized":"2023-11-30T18:23:12.103710+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128782+0000","last_change":"2023-11-30T18:23:12.124792+0000","last_active":"2023-11-30T18:23:12.128782+0000","last_peered":"2023-11-30T18:23:12.128782+0000","last_clean":"2023-11-30T18:23:12.128782+0000","last_became_active":"2023-11-30T18:23:12.124193+0000","last_became_peered":"2023-11-30T18:23:12.124193+0000","last_unstale":"2023-11-30T18:23:12.128782+0000","last_undegraded":"2023-11-30T18:23:12.128782+0000","last_fullsized":"2023-11-30T18:23:12.128782+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128865+0000","last_change":"2023-11-30T18:23:11.727412+0000","last_active":"2023-11-30T18:23:12.128865+0000","last_peered":"2023-11-30T18:23:12.128865+0000","last_clean":"2023-11-30T18:23:12.128865+0000","last_became_active":"2023-11-30T18:23:11.727129+0000","last_became_peered":"2023-11-30T18:23:11.727129+0000","last_unstale":"2023-11-30T18:23:12.128865+0000","last_undegraded":"2023-11-30T18:23:12.128865+0000","last_fullsized":"2023-11-30T18:23:12.128865+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.136285+0000","last_change":"2023-11-30T18:23:12.130940+0000","last_active":"2023-11-30T18:23:12.136285+0000","last_peered":"2023-11-30T18:23:12.136285+0000","last_clean":"2023-11-30T18:23:12.136285+0000","last_became_active":"2023-11-30T18:23:12.130705+0000","last_became_peered":"2023-11-30T18:23:12.130705+0000","last_unstale":"2023-11-30T18:23:12.136285+0000","last_undegraded":"2023-11-30T18:23:12.136285+0000","last_fullsized":"2023-11-30T18:23:12.136285+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"183'2","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128162+0000","last_change":"2023-11-30T18:23:11.736457+0000","last_active":"2023-11-30T18:23:12.128162+0000","last_peered":"2023-11-30T18:23:12.128162+0000","last_clean":"2023-11-30T18:23:12.128162+0000","last_became_active":"2023-11-30T18:23:11.736059+0000","last_became_peered":"2023-11-30T18:23:11.736059+0000","last_unstale":"2023-11-30T18:23:12.128162+0000","last_undegraded":"2023-11-30T18:23:12.128162+0000","last_fullsized":"2023-11-30T18:23:12.128162+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120877+0000","last_change":"2023-11-30T18:23:12.116925+0000","last_active":"2023-11-30T18:23:12.120877+0000","last_peered":"2023-11-30T18:23:12.120877+0000","last_clean":"2023-11-30T18:23:12.120877+0000","last_became_active":"2023-11-30T18:23:12.116645+0000","last_became_peered":"2023-11-30T18:23:12.116645+0000","last_unstale":"2023-11-30T18:23:12.120877+0000","last_undegraded":"2023-11-30T18:23:12.120877+0000","last_fullsized":"2023-11-30T18:23:12.120877+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101414+0000","last_change":"2023-11-30T18:23:11.732070+0000","last_active":"2023-11-30T18:23:12.101414+0000","last_peered":"2023-11-30T18:23:12.101414+0000","last_clean":"2023-11-30T18:23:12.101414+0000","last_became_active":"2023-11-30T18:23:11.731413+0000","last_became_peered":"2023-11-30T18:23:11.731413+0000","last_unstale":"2023-11-30T18:23:12.101414+0000","last_undegraded":"2023-11-30T18:23:12.101414+0000","last_fullsized":"2023-11-30T18:23:12.101414+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.117119+0000","last_change":"2023-11-30T18:23:12.109130+0000","last_active":"2023-11-30T18:23:12.117119+0000","last_peered":"2023-11-30T18:23:12.117119+0000","last_clean":"2023-11-30T18:23:12.117119+0000","last_became_active":"2023-11-30T18:23:12.108797+0000","last_became_peered":"2023-11-30T18:23:12.108797+0000","last_unstale":"2023-11-30T18:23:12.117119+0000","last_undegraded":"2023-11-30T18:23:12.117119+0000","last_fullsized":"2023-11-30T18:23:12.117119+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.133312+0000","last_change":"2023-11-30T18:23:12.128309+0000","last_active":"2023-11-30T18:23:12.133312+0000","last_peered":"2023-11-30T18:23:12.133312+0000","last_clean":"2023-11-30T18:23:12.133312+0000","last_became_active":"2023-11-30T18:23:12.128014+0000","last_became_peered":"2023-11-30T18:23:12.128014+0000","last_unstale":"2023-11-30T18:23:12.133312+0000","last_undegraded":"2023-11-30T18:23:12.133312+0000","last_fullsized":"2023-11-30T18:23:12.133312+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112901+0000","last_change":"2023-11-30T18:23:11.731121+0000","last_active":"2023-11-30T18:23:12.112901+0000","last_peered":"2023-11-30T18:23:12.112901+0000","last_clean":"2023-11-30T18:23:12.112901+0000","last_became_active":"2023-11-30T18:23:11.730804+0000","last_became_peered":"2023-11-30T18:23:11.730804+0000","last_unstale":"2023-11-30T18:23:12.112901+0000","last_undegraded":"2023-11-30T18:23:12.112901+0000","last_fullsized":"2023-11-30T18:23:12.112901+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114635+0000","last_change":"2023-11-30T18:23:12.113494+0000","last_active":"2023-11-30T18:23:12.114635+0000","last_peered":"2023-11-30T18:23:12.114635+0000","last_clean":"2023-11-30T18:23:12.114635+0000","last_became_active":"2023-11-30T18:23:12.112805+0000","last_became_peered":"2023-11-30T18:23:12.112805+0000","last_unstale":"2023-11-30T18:23:12.114635+0000","last_undegraded":"2023-11-30T18:23:12.114635+0000","last_fullsized":"2023-11-30T18:23:12.114635+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128947+0000","last_change":"2023-11-30T18:23:12.125304+0000","last_active":"2023-11-30T18:23:12.128947+0000","last_peered":"2023-11-30T18:23:12.128947+0000","last_clean":"2023-11-30T18:23:12.128947+0000","last_became_active":"2023-11-30T18:23:12.125058+0000","last_became_peered":"2023-11-30T18:23:12.125058+0000","last_unstale":"2023-11-30T18:23:12.128947+0000","last_undegraded":"2023-11-30T18:23:12.128947+0000","last_fullsized":"2023-11-30T18:23:12.128947+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105672+0000","last_change":"2023-11-30T18:23:11.731979+0000","last_active":"2023-11-30T18:23:12.105672+0000","last_peered":"2023-11-30T18:23:12.105672+0000","last_clean":"2023-11-30T18:23:12.105672+0000","last_became_active":"2023-11-30T18:23:11.731333+0000","last_became_peered":"2023-11-30T18:23:11.731333+0000","last_unstale":"2023-11-30T18:23:12.105672+0000","last_undegraded":"2023-11-30T18:23:12.105672+0000","last_fullsized":"2023-11-30T18:23:12.105672+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112581+0000","last_change":"2023-11-30T18:23:12.108480+0000","last_active":"2023-11-30T18:23:12.112581+0000","last_peered":"2023-11-30T18:23:12.112581+0000","last_clean":"2023-11-30T18:23:12.112581+0000","last_became_active":"2023-11-30T18:23:12.108192+0000","last_became_peered":"2023-11-30T18:23:12.108192+0000","last_unstale":"2023-11-30T18:23:12.112581+0000","last_undegraded":"2023-11-30T18:23:12.112581+0000","last_fullsized":"2023-11-30T18:23:12.112581+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.123835+0000","last_change":"2023-11-30T18:23:12.121094+0000","last_active":"2023-11-30T18:23:12.123835+0000","last_peered":"2023-11-30T18:23:12.123835+0000","last_clean":"2023-11-30T18:23:12.123835+0000","last_became_active":"2023-11-30T18:23:12.119586+0000","last_became_peered":"2023-11-30T18:23:12.119586+0000","last_unstale":"2023-11-30T18:23:12.123835+0000","last_undegraded":"2023-11-30T18:23:12.123835+0000","last_fullsized":"2023-11-30T18:23:12.123835+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105796+0000","last_change":"2023-11-30T18:23:11.728944+0000","last_active":"2023-11-30T18:23:12.105796+0000","last_peered":"2023-11-30T18:23:12.105796+0000","last_clean":"2023-11-30T18:23:12.105796+0000","last_became_active":"2023-11-30T18:23:11.728632+0000","last_became_peered":"2023-11-30T18:23:11.728632+0000","last_unstale":"2023-11-30T18:23:12.105796+0000","last_undegraded":"2023-11-30T18:23:12.105796+0000","last_fullsized":"2023-11-30T18:23:12.105796+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120459+0000","last_change":"2023-11-30T18:23:12.111474+0000","last_active":"2023-11-30T18:23:12.120459+0000","last_peered":"2023-11-30T18:23:12.120459+0000","last_clean":"2023-11-30T18:23:12.120459+0000","last_became_active":"2023-11-30T18:23:12.111119+0000","last_became_peered":"2023-11-30T18:23:12.111119+0000","last_unstale":"2023-11-30T18:23:12.120459+0000","last_undegraded":"2023-11-30T18:23:12.120459+0000","last_fullsized":"2023-11-30T18:23:12.120459+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101462+0000","last_change":"2023-11-30T18:23:11.733982+0000","last_active":"2023-11-30T18:23:12.101462+0000","last_peered":"2023-11-30T18:23:12.101462+0000","last_clean":"2023-11-30T18:23:12.101462+0000","last_became_active":"2023-11-30T18:23:11.733689+0000","last_became_peered":"2023-11-30T18:23:11.733689+0000","last_unstale":"2023-11-30T18:23:12.101462+0000","last_undegraded":"2023-11-30T18:23:12.101462+0000","last_fullsized":"2023-11-30T18:23:12.101462+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120038+0000","last_change":"2023-11-30T18:23:12.116461+0000","last_active":"2023-11-30T18:23:12.120038+0000","last_peered":"2023-11-30T18:23:12.120038+0000","last_clean":"2023-11-30T18:23:12.120038+0000","last_became_active":"2023-11-30T18:23:12.115880+0000","last_became_peered":"2023-11-30T18:23:12.115880+0000","last_unstale":"2023-11-30T18:23:12.120038+0000","last_undegraded":"2023-11-30T18:23:12.120038+0000","last_fullsized":"2023-11-30T18:23:12.120038+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.104010+0000","last_change":"2023-11-30T18:23:11.728276+0000","last_active":"2023-11-30T18:23:12.104010+0000","last_peered":"2023-11-30T18:23:12.104010+0000","last_clean":"2023-11-30T18:23:12.104010+0000","last_became_active":"2023-11-30T18:23:11.727974+0000","last_became_peered":"2023-11-30T18:23:11.727974+0000","last_unstale":"2023-11-30T18:23:12.104010+0000","last_undegraded":"2023-11-30T18:23:12.104010+0000","last_fullsized":"2023-11-30T18:23:12.104010+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.106016+0000","last_change":"2023-11-30T18:23:11.730729+0000","last_active":"2023-11-30T18:23:12.106016+0000","last_peered":"2023-11-30T18:23:12.106016+0000","last_clean":"2023-11-30T18:23:12.106016+0000","last_became_active":"2023-11-30T18:23:11.728274+0000","last_became_peered":"2023-11-30T18:23:11.728274+0000","last_unstale":"2023-11-30T18:23:12.106016+0000","last_undegraded":"2023-11-30T18:23:12.106016+0000","last_fullsized":"2023-11-30T18:23:12.106016+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.119835+0000","last_change":"2023-11-30T18:23:11.729709+0000","last_active":"2023-11-30T18:23:12.119835+0000","last_peered":"2023-11-30T18:23:12.119835+0000","last_clean":"2023-11-30T18:23:12.119835+0000","last_became_active":"2023-11-30T18:23:11.728696+0000","last_became_peered":"2023-11-30T18:23:11.728696+0000","last_unstale":"2023-11-30T18:23:12.119835+0000","last_undegraded":"2023-11-30T18:23:12.119835+0000","last_fullsized":"2023-11-30T18:23:12.119835+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112118+0000","last_change":"2023-11-30T18:23:12.110191+0000","last_active":"2023-11-30T18:23:12.112118+0000","last_peered":"2023-11-30T18:23:12.112118+0000","last_clean":"2023-11-30T18:23:12.112118+0000","last_became_active":"2023-11-30T18:23:12.108068+0000","last_became_peered":"2023-11-30T18:23:12.108068+0000","last_unstale":"2023-11-30T18:23:12.112118+0000","last_undegraded":"2023-11-30T18:23:12.112118+0000","last_fullsized":"2023-11-30T18:23:12.112118+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.106165+0000","last_change":"2023-11-30T18:23:11.724242+0000","last_active":"2023-11-30T18:23:12.106165+0000","last_peered":"2023-11-30T18:23:12.106165+0000","last_clean":"2023-11-30T18:23:12.106165+0000","last_became_active":"2023-11-30T18:23:11.723941+0000","last_became_peered":"2023-11-30T18:23:11.723941+0000","last_unstale":"2023-11-30T18:23:12.106165+0000","last_undegraded":"2023-11-30T18:23:12.106165+0000","last_fullsized":"2023-11-30T18:23:12.106165+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.116481+0000","last_change":"2023-11-30T18:23:11.733023+0000","last_active":"2023-11-30T18:23:12.116481+0000","last_peered":"2023-11-30T18:23:12.116481+0000","last_clean":"2023-11-30T18:23:12.116481+0000","last_became_active":"2023-11-30T18:23:11.732439+0000","last_became_peered":"2023-11-30T18:23:11.732439+0000","last_unstale":"2023-11-30T18:23:12.116481+0000","last_undegraded":"2023-11-30T18:23:12.116481+0000","last_fullsized":"2023-11-30T18:23:12.116481+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.118736+0000","last_change":"2023-11-30T18:23:11.724253+0000","last_active":"2023-11-30T18:23:12.118736+0000","last_peered":"2023-11-30T18:23:12.118736+0000","last_clean":"2023-11-30T18:23:12.118736+0000","last_became_active":"2023-11-30T18:23:11.723936+0000","last_became_peered":"2023-11-30T18:23:11.723936+0000","last_unstale":"2023-11-30T18:23:12.118736+0000","last_undegraded":"2023-11-30T18:23:12.118736+0000","last_fullsized":"2023-11-30T18:23:12.118736+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":154,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.100854+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T18:23:12.100854+0000","last_peered":"2023-11-30T18:23:12.100854+0000","last_clean":"2023-11-30T18:23:12.100854+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T18:23:12.100854+0000","last_undegraded":"2023-11-30T18:23:12.100854+0000","last_fullsized":"2023-11-30T18:23:12.100854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124990+0000","last_change":"2023-11-30T18:23:12.122702+0000","last_active":"2023-11-30T18:23:12.124990+0000","last_peered":"2023-11-30T18:23:12.124990+0000","last_clean":"2023-11-30T18:23:12.124990+0000","last_became_active":"2023-11-30T18:23:12.122115+0000","last_became_peered":"2023-11-30T18:23:12.122115+0000","last_unstale":"2023-11-30T18:23:12.124990+0000","last_undegraded":"2023-11-30T18:23:12.124990+0000","last_fullsized":"2023-11-30T18:23:12.124990+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"183'3","reported_seq":13,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124889+0000","last_change":"2023-11-30T18:23:11.723777+0000","last_active":"2023-11-30T18:23:12.124889+0000","last_peered":"2023-11-30T18:23:12.124889+0000","last_clean":"2023-11-30T18:23:12.124889+0000","last_became_active":"2023-11-30T18:23:11.723321+0000","last_became_peered":"2023-11-30T18:23:11.723321+0000","last_unstale":"2023-11-30T18:23:12.124889+0000","last_undegraded":"2023-11-30T18:23:12.124889+0000","last_fullsized":"2023-11-30T18:23:12.124889+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":151,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105479+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T18:23:12.105479+0000","last_peered":"2023-11-30T18:23:12.105479+0000","last_clean":"2023-11-30T18:23:12.105479+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T18:23:12.105479+0000","last_undegraded":"2023-11-30T18:23:12.105479+0000","last_fullsized":"2023-11-30T18:23:12.105479+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124947+0000","last_change":"2023-11-30T18:23:12.123908+0000","last_active":"2023-11-30T18:23:12.124947+0000","last_peered":"2023-11-30T18:23:12.124947+0000","last_clean":"2023-11-30T18:23:12.124947+0000","last_became_active":"2023-11-30T18:23:12.123674+0000","last_became_peered":"2023-11-30T18:23:12.123674+0000","last_unstale":"2023-11-30T18:23:12.124947+0000","last_undegraded":"2023-11-30T18:23:12.124947+0000","last_fullsized":"2023-11-30T18:23:12.124947+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105691+0000","last_change":"2023-11-30T18:23:11.726548+0000","last_active":"2023-11-30T18:23:12.105691+0000","last_peered":"2023-11-30T18:23:12.105691+0000","last_clean":"2023-11-30T18:23:12.105691+0000","last_became_active":"2023-11-30T18:23:11.726202+0000","last_became_peered":"2023-11-30T18:23:11.726202+0000","last_unstale":"2023-11-30T18:23:12.105691+0000","last_undegraded":"2023-11-30T18:23:12.105691+0000","last_fullsized":"2023-11-30T18:23:12.105691+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":158,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.118025+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T18:23:12.118025+0000","last_peered":"2023-11-30T18:23:12.118025+0000","last_clean":"2023-11-30T18:23:12.118025+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T18:23:12.118025+0000","last_undegraded":"2023-11-30T18:23:12.118025+0000","last_fullsized":"2023-11-30T18:23:12.118025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"183'2","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.113944+0000","last_change":"2023-11-30T18:23:11.732729+0000","last_active":"2023-11-30T18:23:12.113944+0000","last_peered":"2023-11-30T18:23:12.113944+0000","last_clean":"2023-11-30T18:23:12.113944+0000","last_became_active":"2023-11-30T18:23:11.732454+0000","last_became_peered":"2023-11-30T18:23:11.732454+0000","last_unstale":"2023-11-30T18:23:12.113944+0000","last_undegraded":"2023-11-30T18:23:12.113944+0000","last_fullsized":"2023-11-30T18:23:12.113944+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":151,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.106039+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T18:23:12.106039+0000","last_peered":"2023-11-30T18:23:12.106039+0000","last_clean":"2023-11-30T18:23:12.106039+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T18:23:12.106039+0000","last_undegraded":"2023-11-30T18:23:12.106039+0000","last_fullsized":"2023-11-30T18:23:12.106039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":148,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.116542+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T18:23:12.116542+0000","last_peered":"2023-11-30T18:23:12.116542+0000","last_clean":"2023-11-30T18:23:12.116542+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T18:23:12.116542+0000","last_undegraded":"2023-11-30T18:23:12.116542+0000","last_fullsized":"2023-11-30T18:23:12.116542+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120308+0000","last_change":"2023-11-30T18:23:11.737931+0000","last_active":"2023-11-30T18:23:12.120308+0000","last_peered":"2023-11-30T18:23:12.120308+0000","last_clean":"2023-11-30T18:23:12.120308+0000","last_became_active":"2023-11-30T18:23:11.737593+0000","last_became_peered":"2023-11-30T18:23:11.737593+0000","last_unstale":"2023-11-30T18:23:12.120308+0000","last_undegraded":"2023-11-30T18:23:12.120308+0000","last_fullsized":"2023-11-30T18:23:12.120308+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":146,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.116609+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T18:23:12.116609+0000","last_peered":"2023-11-30T18:23:12.116609+0000","last_clean":"2023-11-30T18:23:12.116609+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T18:23:12.116609+0000","last_undegraded":"2023-11-30T18:23:12.116609+0000","last_fullsized":"2023-11-30T18:23:12.116609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114593+0000","last_change":"2023-11-30T18:23:12.113259+0000","last_active":"2023-11-30T18:23:12.114593+0000","last_peered":"2023-11-30T18:23:12.114593+0000","last_clean":"2023-11-30T18:23:12.114593+0000","last_became_active":"2023-11-30T18:23:12.112451+0000","last_became_peered":"2023-11-30T18:23:12.112451+0000","last_unstale":"2023-11-30T18:23:12.114593+0000","last_undegraded":"2023-11-30T18:23:12.114593+0000","last_fullsized":"2023-11-30T18:23:12.114593+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":146,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.121501+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T18:23:12.121501+0000","last_peered":"2023-11-30T18:23:12.121501+0000","last_clean":"2023-11-30T18:23:12.121501+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T18:23:12.121501+0000","last_undegraded":"2023-11-30T18:23:12.121501+0000","last_fullsized":"2023-11-30T18:23:12.121501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.123443+0000","last_change":"2023-11-30T18:23:12.119562+0000","last_active":"2023-11-30T18:23:12.123443+0000","last_peered":"2023-11-30T18:23:12.123443+0000","last_clean":"2023-11-30T18:23:12.123443+0000","last_became_active":"2023-11-30T18:23:12.119194+0000","last_became_peered":"2023-11-30T18:23:12.119194+0000","last_unstale":"2023-11-30T18:23:12.123443+0000","last_undegraded":"2023-11-30T18:23:12.123443+0000","last_fullsized":"2023-11-30T18:23:12.123443+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":154,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101695+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T18:23:12.101695+0000","last_peered":"2023-11-30T18:23:12.101695+0000","last_clean":"2023-11-30T18:23:12.101695+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T18:23:12.101695+0000","last_undegraded":"2023-11-30T18:23:12.101695+0000","last_fullsized":"2023-11-30T18:23:12.101695+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.113473+0000","last_change":"2023-11-30T18:23:12.111164+0000","last_active":"2023-11-30T18:23:12.113473+0000","last_peered":"2023-11-30T18:23:12.113473+0000","last_clean":"2023-11-30T18:23:12.113473+0000","last_became_active":"2023-11-30T18:23:12.110887+0000","last_became_peered":"2023-11-30T18:23:12.110887+0000","last_unstale":"2023-11-30T18:23:12.113473+0000","last_undegraded":"2023-11-30T18:23:12.113473+0000","last_fullsized":"2023-11-30T18:23:12.113473+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"183'4","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128421+0000","last_change":"2023-11-30T18:23:11.728962+0000","last_active":"2023-11-30T18:23:12.128421+0000","last_peered":"2023-11-30T18:23:12.128421+0000","last_clean":"2023-11-30T18:23:12.128421+0000","last_became_active":"2023-11-30T18:23:11.728681+0000","last_became_peered":"2023-11-30T18:23:11.728681+0000","last_unstale":"2023-11-30T18:23:12.128421+0000","last_undegraded":"2023-11-30T18:23:12.128421+0000","last_fullsized":"2023-11-30T18:23:12.128421+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":168,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-11-30T18:23:07.189838+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T18:23:07.189838+0000","last_peered":"2023-11-30T18:23:07.189838+0000","last_clean":"2023-11-30T18:23:07.189838+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T18:23:07.189838+0000","last_undegraded":"2023-11-30T18:23:07.189838+0000","last_fullsized":"2023-11-30T18:23:07.189838+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":100,"acting":100,"num_store_stats":6},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":94,"acting":94,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575755,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303444,"kb_used_data":2252,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068396,"statfs":{"total":96636764160,"available":96326037504,"internally_reserved":0,"allocated":2306048,"data_stored":1173973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.32500000000000001},"max":{"1min":0.68700000000000006,"5min":0.81699999999999995,"15min":0.83599999999999997},"last":0.503},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.60699999999999998,"15min":0.61799999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.71499999999999997,"5min":0.82199999999999995,"15min":0.84999999999999998},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55000000000000004,"15min":0.55900000000000005},"min":{"1min":0.35599999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71599999999999997,"5min":0.80500000000000005,"15min":0.875},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.39800000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71699999999999997,"5min":0.79100000000000004,"15min":0.82099999999999995},"last":0.54400000000000004}]},{"osd":2,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70399999999999996,"5min":0.76900000000000002,"15min":0.85399999999999998},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.66500000000000004,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.34300000000000003},"max":{"1min":0.65700000000000003,"5min":0.79300000000000004,"15min":0.90800000000000003},"last":0.373},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60199999999999998,"15min":0.60299999999999998},"min":{"1min":0.41099999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.73399999999999999,"5min":0.80000000000000004,"15min":0.80300000000000005},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.45300000000000001,"15min":0.44400000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63900000000000001,"5min":0.70299999999999996,"15min":0.73799999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46400000000000002,"15min":0.46500000000000002},"min":{"1min":0.32100000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.66400000000000003,"5min":0.71999999999999997,"15min":0.78100000000000003},"last":0.438}]},{"osd":5,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.65000000000000002,"5min":0.749,"15min":0.753},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.51000000000000001,"15min":0.505},"min":{"1min":0.371,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":0.69099999999999995,"5min":0.76000000000000001,"15min":0.81999999999999995},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.372,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.74299999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.751,"5min":0.81499999999999995,"15min":0.83599999999999997},"last":0.53100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575753,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307480,"kb_used_data":2192,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064360,"statfs":{"total":96636764160,"available":96321904640,"internally_reserved":0,"allocated":2244608,"data_stored":1145498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.58999999999999997,"15min":0.59799999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68000000000000005,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.61799999999999999,"15min":0.61699999999999999},"min":{"1min":0.45100000000000001,"5min":0.41099999999999998,"15min":0.33600000000000002},"max":{"1min":0.72599999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.32400000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.70899999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.40999999999999998,"5min":0.39000000000000001,"15min":0.35199999999999998},"max":{"1min":0.751,"5min":0.876,"15min":0.876},"last":0.60999999999999999}]},{"osd":2,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.59699999999999998,"15min":0.59799999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71399999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.39000000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73399999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54700000000000004,"15min":0.55700000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73399999999999999,"5min":0.82299999999999995,"15min":0.83499999999999996},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.39900000000000002,"5min":0.39000000000000001,"15min":0.33200000000000002},"max":{"1min":0.64400000000000002,"5min":0.79100000000000004,"15min":0.80100000000000005},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45200000000000001,"15min":0.45100000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.68899999999999995,"5min":0.81000000000000005,"15min":0.94999999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47799999999999998,"15min":0.47599999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70399999999999996,"5min":0.76400000000000001,"15min":0.82299999999999995},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46999999999999997,"15min":0.46700000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.66300000000000003,"5min":0.76400000000000001,"15min":0.81999999999999995},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70999999999999996,"5min":0.81999999999999995,"15min":0.83499999999999996},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.29999999999999999},"max":{"1min":0.72499999999999998,"5min":0.80100000000000005,"15min":0.86799999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.376,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71599999999999997,"5min":0.80800000000000005,"15min":0.86599999999999999},"last":0.64900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575754,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307536,"kb_used_data":2248,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064304,"statfs":{"total":96636764160,"available":96321847296,"internally_reserved":0,"allocated":2301952,"data_stored":1173129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34200000000000003,"15min":0.36399999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.42799999999999999,"5min":0.54200000000000004,"15min":0.70699999999999996},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47299999999999998,"15min":0.49399999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.78100000000000003},"last":0.33100000000000002}]},{"osd":2,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.376,"15min":0.39600000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.48099999999999998,"5min":0.60599999999999998,"15min":0.67500000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.498,"15min":0.51600000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63200000000000001,"5min":0.72499999999999998,"15min":0.85599999999999998},"last":0.38}]},{"osd":3,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.44700000000000001,"15min":0.46300000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.53700000000000003,"5min":0.70599999999999996,"15min":0.79600000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.42299999999999999,"15min":0.44600000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.50700000000000001,"5min":0.65400000000000003,"15min":0.68000000000000005},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.58399999999999996,"15min":0.60999999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.314},"max":{"1min":0.80100000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.61799999999999999,"15min":0.64100000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38800000000000001},"max":{"1min":0.77900000000000003,"5min":0.80800000000000005,"15min":0.90600000000000003},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.60399999999999998,"15min":0.623},"min":{"1min":0.379,"5min":0.379,"15min":0.377},"max":{"1min":0.78400000000000003,"5min":0.86599999999999999,"15min":0.90200000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60899999999999999,"15min":0.63300000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.36799999999999999},"max":{"1min":0.79400000000000004,"5min":0.878,"15min":0.90800000000000003},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.66700000000000004,"15min":0.68899999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66300000000000003,"15min":0.67600000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42599999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.0049999999999999},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.66600000000000004,"15min":0.68999999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.96999999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.65100000000000002,"15min":0.67200000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.95899999999999996},"last":0.52100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575754,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307544,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064296,"statfs":{"total":96636764160,"available":96321839104,"internally_reserved":0,"allocated":2310144,"data_stored":1173273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.38300000000000001,"15min":0.38900000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.51900000000000002,"5min":0.56799999999999995,"15min":0.61099999999999999},"last":0.246},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41099999999999998,"15min":0.40999999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.249},"max":{"1min":0.55600000000000005,"5min":0.65600000000000003,"15min":0.68400000000000005},"last":0.34000000000000002}]},{"osd":2,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41599999999999998,"15min":0.40899999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.57499999999999996,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.49299999999999999,"15min":0.48999999999999999},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.59399999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.44600000000000001,"15min":0.45200000000000001},"min":{"1min":0.311,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.53500000000000003,"5min":0.71699999999999997,"15min":0.77500000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46899999999999997,"15min":0.46800000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65300000000000002,"5min":0.67600000000000005,"15min":0.69499999999999995},"last":0.26000000000000001}]},{"osd":4,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65000000000000002,"15min":0.63700000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.42199999999999999},"max":{"1min":0.81000000000000005,"5min":0.96399999999999997,"15min":0.995},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66600000000000004,"15min":0.65400000000000003},"min":{"1min":0.47799999999999998,"5min":0.42799999999999999,"15min":0.41499999999999998},"max":{"1min":0.75900000000000001,"5min":1.03,"15min":1.03},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65200000000000002,"15min":0.64100000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.40799999999999997},"max":{"1min":0.86499999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.68100000000000005,"15min":0.65900000000000003},"min":{"1min":0.48199999999999998,"5min":0.44800000000000001,"15min":0.41299999999999998},"max":{"1min":0.91900000000000004,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.45600000000000002}]},{"osd":6,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67700000000000005,"15min":0.67300000000000004},"min":{"1min":0.52300000000000002,"5min":0.443,"15min":0.40600000000000003},"max":{"1min":0.81799999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68600000000000005,"15min":0.67700000000000005},"min":{"1min":0.49099999999999999,"5min":0.442,"15min":0.44},"max":{"1min":0.90400000000000003,"5min":1.05,"15min":1.05},"last":0.51400000000000001}]},{"osd":7,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71299999999999997,"15min":0.69799999999999995},"min":{"1min":0.55600000000000005,"5min":0.45200000000000001,"15min":0.42599999999999999},"max":{"1min":0.88600000000000001,"5min":1.167,"15min":1.167},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73199999999999998,"15min":0.72299999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.48399999999999999},"max":{"1min":0.876,"5min":1.024,"15min":1.024},"last":0.54000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575754,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311636,"kb_used_data":2252,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060204,"statfs":{"total":96636764160,"available":96317648896,"internally_reserved":0,"allocated":2306048,"data_stored":1172687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.39500000000000002,"15min":0.40100000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.25700000000000001},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.71699999999999997},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68999999999999995,"5min":0.70599999999999996,"15min":0.751},"last":0.379}]},{"osd":1,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.443,"15min":0.44900000000000001},"min":{"1min":0.33500000000000002,"5min":0.309,"15min":0.29299999999999998},"max":{"1min":0.68700000000000006,"5min":0.755,"15min":0.755},"last":0.437},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.32300000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.81799999999999995},"last":0.42699999999999999}]},{"osd":3,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39500000000000002,"15min":0.40699999999999997},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.76000000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.308,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.75800000000000001},"last":0.314}]},{"osd":4,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.626,"15min":0.63400000000000001},"min":{"1min":0.44900000000000001,"5min":0.42199999999999999,"15min":0.40100000000000002},"max":{"1min":0.88800000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60699999999999998,"15min":0.61899999999999999},"min":{"1min":0.42199999999999999,"5min":0.40999999999999998,"15min":0.377},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.94999999999999996},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63300000000000001,"15min":0.64400000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.97399999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64700000000000002,"15min":0.64800000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85599999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.628,"15min":0.63800000000000001},"min":{"1min":0.46200000000000002,"5min":0.434,"15min":0.41099999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.97799999999999998},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67000000000000004,"15min":0.67300000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67300000000000004,"15min":0.68799999999999994},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46000000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.96599999999999997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.504,"5min":0.49199999999999999,"15min":0.46200000000000002},"max":{"1min":0.97199999999999998,"5min":0.995,"15min":1.014},"last":0.68600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575754,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315724,"kb_used_data":2244,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94056116,"statfs":{"total":96636764160,"available":96313462784,"internally_reserved":0,"allocated":2297856,"data_stored":1172539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38500000000000001,"15min":0.375},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.311},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.41199999999999998,"15min":0.40899999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.59299999999999997,"5min":0.61099999999999999,"15min":0.66200000000000003},"last":0.32900000000000001}]},{"osd":1,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.40999999999999998,"15min":0.39700000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44800000000000001,"15min":0.441},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.28699999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.26100000000000001}]},{"osd":2,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.47699999999999998,"15min":0.46899999999999997},"min":{"1min":0.35099999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58299999999999996,"5min":0.70899999999999996,"15min":0.71599999999999997},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52000000000000002,"15min":0.51500000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73199999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63200000000000001,"15min":0.63500000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92800000000000005,"5min":1.081,"15min":1.081},"last":0.436},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64900000000000002,"15min":0.63800000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.64300000000000002,"15min":0.63500000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67100000000000004,"15min":0.66200000000000003},"min":{"1min":0.47399999999999998,"5min":0.46200000000000002,"15min":0.42399999999999999},"max":{"1min":0.99199999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.52300000000000002}]},{"osd":6,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68600000000000005,"15min":0.67900000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.40100000000000002},"max":{"1min":0.96999999999999997,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48599999999999999,"5min":0.47099999999999997,"15min":0.41499999999999998},"max":{"1min":0.84299999999999997,"5min":1.206,"15min":1.206},"last":0.48499999999999999}]},{"osd":7,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.44800000000000001},"max":{"1min":0.98599999999999999,"5min":1.131,"15min":1.131},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70599999999999996,"15min":0.69499999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.44800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303384,"kb_used_data":2192,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068456,"statfs":{"total":96636764160,"available":96326098944,"internally_reserved":0,"allocated":2244608,"data_stored":1145498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54200000000000004,"15min":0.55400000000000005},"min":{"1min":0.31900000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77200000000000002,"5min":0.80600000000000005,"15min":0.94799999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.26900000000000002},"max":{"1min":0.71399999999999997,"5min":0.82599999999999996,"15min":0.83699999999999997},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54800000000000004,"15min":0.55100000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79200000000000004,"5min":0.92400000000000004,"15min":1.006},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56200000000000006,"15min":0.56399999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70999999999999996,"5min":0.79300000000000004,"15min":0.82299999999999995},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57799999999999996,"15min":0.58699999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35499999999999998},"max":{"1min":0.68700000000000006,"5min":0.82399999999999995,"15min":0.85299999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.59999999999999998,"15min":0.61499999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70099999999999996,"5min":0.95299999999999996,"15min":1.0429999999999999},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54400000000000004,"15min":0.55100000000000005},"min":{"1min":0.35799999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69399999999999995,"5min":0.78100000000000003,"15min":0.79900000000000004},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73899999999999999,"5min":0.79600000000000004,"15min":1.1679999999999999},"last":0.623}]},{"osd":5,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.27600000000000002},"max":{"1min":0.58399999999999996,"5min":0.71099999999999997,"15min":0.80700000000000005},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46200000000000002,"15min":0.45900000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.63500000000000001,"5min":0.68100000000000005,"15min":1.3919999999999999},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.50600000000000001,"15min":0.496},"min":{"1min":0.316,"5min":0.316,"15min":0.31},"max":{"1min":0.64800000000000002,"5min":0.83599999999999997,"15min":0.93300000000000005},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54900000000000004,"15min":0.54400000000000004},"min":{"1min":0.41499999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67600000000000005,"5min":0.78100000000000003,"15min":0.92500000000000004},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51300000000000001,"15min":0.51900000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30099999999999999},"max":{"1min":0.70099999999999996,"5min":0.85699999999999998,"15min":1.246},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.41499999999999998,"5min":0.39900000000000002,"15min":0.371},"max":{"1min":0.72299999999999998,"5min":0.88900000000000001,"15min":1.321},"last":0.63800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575754,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307532,"kb_used_data":2244,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064308,"statfs":{"total":96636764160,"available":96321851392,"internally_reserved":0,"allocated":2297856,"data_stored":1173397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.54300000000000004,"15min":0.55000000000000004},"min":{"1min":0.34799999999999998,"5min":0.33400000000000002,"15min":0.30099999999999999},"max":{"1min":0.59999999999999998,"5min":0.73799999999999999,"15min":0.81899999999999995},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.54700000000000004,"15min":0.55000000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.30399999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.59099999999999997}]},{"osd":1,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.34799999999999998,"5min":0.33200000000000002,"15min":0.29499999999999998},"max":{"1min":0.72299999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.55800000000000005,"15min":0.56399999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.69399999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.73999999999999999}]},{"osd":2,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.376,"5min":0.372,"15min":0.35099999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.35299999999999998},"max":{"1min":0.66500000000000004,"5min":0.84999999999999998,"15min":0.876},"last":0.72199999999999998}]},{"osd":3,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.622}]},{"osd":4,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.441,"15min":0.437},"min":{"1min":0.309,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.47399999999999998,"15min":0.46700000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.42799999999999999}]},{"osd":6,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48199999999999998,"15min":0.47899999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55700000000000005,"15min":0.54900000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.313},"max":{"1min":0.73499999999999999,"5min":0.76700000000000002,"15min":0.83499999999999996},"last":0.50600000000000001}]},{"osd":7,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.54300000000000004,"15min":0.52600000000000002},"min":{"1min":0.33300000000000002,"5min":0.313,"15min":0.313},"max":{"1min":3.2240000000000002,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.59099999999999997,"15min":0.57899999999999996},"min":{"1min":0.42999999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":3.1659999999999999,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.51700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T18:23:16.523 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T18:23:16.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.674+0000 7fccfc0ba700 1 Processor -- start 2023-11-30T18:23:16.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.675+0000 7fccfc0ba700 1 -- start start 2023-11-30T18:23:16.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.675+0000 7fccfc0ba700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fccf41544e0 0x7fccf41548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:16.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.675+0000 7fccfc0ba700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccf40c6e30 0x7fccf40c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:16.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.675+0000 7fccfc0ba700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf40c69a0 con 0x7fccf406a610 2023-11-30T18:23:16.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.675+0000 7fccfc0ba700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccf40c13a0 con 0x7fccf41544e0 2023-11-30T18:23:16.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.675+0000 7fccfc0ba700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf40c1680 con 0x7fccf40c6e30 2023-11-30T18:23:16.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.676+0000 7fccf9655700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fccf406a610 0x7fccf40c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39082/0 (socket says 172.21.15.49:39082) 2023-11-30T18:23:16.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.676+0000 7fccf9655700 1 -- 172.21.15.49:0/1649074062 learned_addr learned my addr 172.21.15.49:0/1649074062 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:23:16.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.676+0000 7fccf9e56700 1 --2- 172.21.15.49:0/1649074062 >> v2:172.21.15.115:3300/0 conn(0x7fccf41544e0 0x7fccf41548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:16.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.676+0000 7fccfa657700 1 --2- 172.21.15.49:0/1649074062 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccf40c6e30 0x7fccf40c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:16.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.676+0000 7fccf8e54700 1 -- 172.21.15.49:0/1649074062 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2051928142 0 0) 0x7fccf40c69a0 con 0x7fccf406a610 2023-11-30T18:23:16.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.676+0000 7fccf8e54700 1 -- 172.21.15.49:0/1649074062 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccdc0033f0 con 0x7fccf406a610 2023-11-30T18:23:16.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.676+0000 7fccf9e56700 1 -- 172.21.15.49:0/1649074062 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccf40c6e30 msgr2=0x7fccf40c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:16.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.676+0000 7fccf9e56700 1 --2- 172.21.15.49:0/1649074062 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccf40c6e30 0x7fccf40c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:16.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.676+0000 7fccf9e56700 1 -- 172.21.15.49:0/1649074062 >> v1:172.21.15.49:6789/0 conn(0x7fccf406a610 legacy=0x7fccf40c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:16.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.676+0000 7fccf9e56700 1 -- 172.21.15.49:0/1649074062 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf40c6630 con 0x7fccf41544e0 2023-11-30T18:23:16.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.676+0000 7fccfa657700 1 --2- 172.21.15.49:0/1649074062 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccf40c6e30 0x7fccf40c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:23:16.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.676+0000 7fccf9e56700 1 --2- 172.21.15.49:0/1649074062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccf41544e0 0x7fccf41548c0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7fccec006fd0 tx=0x7fccec006f40).ready entity=mon.1 client_cookie=e49b00d5e63f3ad7 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:16.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.676+0000 7fccf8e54700 1 -- 172.21.15.49:0/1649074062 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec005880 con 0x7fccf41544e0 2023-11-30T18:23:16.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.677+0000 7fccf8e54700 1 -- 172.21.15.49:0/1649074062 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccec0059e0 con 0x7fccf41544e0 2023-11-30T18:23:16.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.677+0000 7fccf8e54700 1 -- 172.21.15.49:0/1649074062 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec005d60 con 0x7fccf41544e0 2023-11-30T18:23:16.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.677+0000 7fccfc0ba700 1 -- 172.21.15.49:0/1649074062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccf41544e0 msgr2=0x7fccf41548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:16.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.677+0000 7fccfc0ba700 1 --2- 172.21.15.49:0/1649074062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccf41544e0 0x7fccf41548c0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7fccec006fd0 tx=0x7fccec006f40).stop 2023-11-30T18:23:16.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.677+0000 7fccfc0ba700 1 -- 172.21.15.49:0/1649074062 shutdown_connections 2023-11-30T18:23:16.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.677+0000 7fccfc0ba700 1 --2- 172.21.15.49:0/1649074062 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccf40c6e30 0x7fccf40c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:16.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.677+0000 7fccfc0ba700 1 --2- 172.21.15.49:0/1649074062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccf41544e0 0x7fccf41548c0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:16.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.677+0000 7fccfc0ba700 1 -- 172.21.15.49:0/1649074062 >> 172.21.15.49:0/1649074062 conn(0x7fccf4085020 msgr2=0x7fccf4094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:16.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.677+0000 7fccfc0ba700 1 -- 172.21.15.49:0/1649074062 shutdown_connections 2023-11-30T18:23:16.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.677+0000 7fccfc0ba700 1 -- 172.21.15.49:0/1649074062 wait complete. 2023-11-30T18:23:16.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.678+0000 7fccfc0ba700 1 Processor -- start 2023-11-30T18:23:16.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.678+0000 7fccfc0ba700 1 -- start start 2023-11-30T18:23:16.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.679+0000 7fccfc0ba700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccf406a610 0x7fccf4153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:16.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.679+0000 7fccfc0ba700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccf40c6e30 0x7fccf4064a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:16.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.679+0000 7fccfc0ba700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccf41544e0 0x7fccf4064ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:16.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.679+0000 7fccfc0ba700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf40653e0 con 0x7fccf41544e0 2023-11-30T18:23:16.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.679+0000 7fccfc0ba700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf4165000 con 0x7fccf406a610 2023-11-30T18:23:16.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.679+0000 7fccfc0ba700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf40a93e0 con 0x7fccf40c6e30 2023-11-30T18:23:16.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.679+0000 7fccfa657700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccf41544e0 0x7fccf4064ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:16.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.679+0000 7fccfa657700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccf41544e0 0x7fccf4064ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46034/0 (socket says 172.21.15.49:46034) 2023-11-30T18:23:16.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.679+0000 7fccfa657700 1 -- 172.21.15.49:0/4049311357 learned_addr learned my addr 172.21.15.49:0/4049311357 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:16.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.679+0000 7fccf9e56700 1 --2- 172.21.15.49:0/4049311357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccf406a610 0x7fccf4153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:16.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.679+0000 7fccf9655700 1 --2- 172.21.15.49:0/4049311357 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccf40c6e30 0x7fccf4064a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:16.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.679+0000 7fccfa657700 1 -- 172.21.15.49:0/4049311357 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccf40c6e30 msgr2=0x7fccf4064a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:16.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.679+0000 7fccfa657700 1 --2- 172.21.15.49:0/4049311357 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccf40c6e30 0x7fccf4064a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:16.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.679+0000 7fccfa657700 1 -- 172.21.15.49:0/4049311357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccf406a610 msgr2=0x7fccf4153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:16.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.679+0000 7fccfa657700 1 --2- 172.21.15.49:0/4049311357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccf406a610 0x7fccf4153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:16.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.679+0000 7fccfa657700 1 -- 172.21.15.49:0/4049311357 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce4009a20 con 0x7fccf41544e0 2023-11-30T18:23:16.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.680+0000 7fccfa657700 1 --2- 172.21.15.49:0/4049311357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccf41544e0 0x7fccf4064ef0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7fcce4009f20 tx=0x7fcce400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:16.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.680+0000 7fccf1ffb700 1 -- 172.21.15.49:0/4049311357 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce400cb70 con 0x7fccf41544e0 2023-11-30T18:23:16.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.680+0000 7fccf1ffb700 1 -- 172.21.15.49:0/4049311357 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce400f040 con 0x7fccf41544e0 2023-11-30T18:23:16.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.680+0000 7fccfc0ba700 1 -- 172.21.15.49:0/4049311357 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccec009250 con 0x7fccf41544e0 2023-11-30T18:23:16.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.680+0000 7fccf1ffb700 1 -- 172.21.15.49:0/4049311357 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce4013400 con 0x7fccf41544e0 2023-11-30T18:23:16.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.680+0000 7fccfc0ba700 1 -- 172.21.15.49:0/4049311357 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf41649b0 con 0x7fccf41544e0 2023-11-30T18:23:16.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.681+0000 7fccfc0ba700 1 -- 172.21.15.49:0/4049311357 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccf4165170 con 0x7fccf41544e0 2023-11-30T18:23:16.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.681+0000 7fccf1ffb700 1 -- 172.21.15.49:0/4049311357 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fcce40137f0 con 0x7fccf41544e0 2023-11-30T18:23:16.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.682+0000 7fccf1ffb700 1 --2- 172.21.15.49:0/4049311357 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcce005f270 0x7fcce0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:16.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.682+0000 7fccf1ffb700 1 -- 172.21.15.49:0/4049311357 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fcce407ac20 con 0x7fccf41544e0 2023-11-30T18:23:16.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.682+0000 7fccf9e56700 1 --2- 172.21.15.49:0/4049311357 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcce005f270 0x7fcce0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:16.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.682+0000 7fccf9e56700 1 --2- 172.21.15.49:0/4049311357 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcce005f270 0x7fcce0061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fccec006f80 tx=0x7fccec015000).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:16.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.686+0000 7fccf1ffb700 1 -- 172.21.15.49:0/4049311357 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcce404bd30 con 0x7fccf41544e0 2023-11-30T18:23:16.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.852+0000 7fccfc0ba700 1 -- 172.21.15.49:0/4049311357 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fccf40c6250 con 0x7fcce005f270 2023-11-30T18:23:16.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.863+0000 7fccf1ffb700 1 -- 172.21.15.49:0/4049311357 <== mgr.7394 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359469 (secure 0 0 0) 0x7fccf40c6250 con 0x7fcce005f270 2023-11-30T18:23:16.867 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:23:16.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.866+0000 7fccfc0ba700 1 -- 172.21.15.49:0/4049311357 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcce005f270 msgr2=0x7fcce0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:16.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.866+0000 7fccfc0ba700 1 --2- 172.21.15.49:0/4049311357 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcce005f270 0x7fcce0061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fccec006f80 tx=0x7fccec015000).stop 2023-11-30T18:23:16.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.866+0000 7fccfc0ba700 1 -- 172.21.15.49:0/4049311357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccf41544e0 msgr2=0x7fccf4064ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:16.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.866+0000 7fccfc0ba700 1 --2- 172.21.15.49:0/4049311357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccf41544e0 0x7fccf4064ef0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7fcce4009f20 tx=0x7fcce400b040).stop 2023-11-30T18:23:16.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.866+0000 7fccfc0ba700 1 -- 172.21.15.49:0/4049311357 shutdown_connections 2023-11-30T18:23:16.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.866+0000 7fccfc0ba700 1 --2- 172.21.15.49:0/4049311357 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fcce005f270 0x7fcce0061730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:16.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.866+0000 7fccfc0ba700 1 --2- 172.21.15.49:0/4049311357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccf41544e0 0x7fccf4064ef0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:16.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.866+0000 7fccfc0ba700 1 --2- 172.21.15.49:0/4049311357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccf406a610 0x7fccf4153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:16.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.866+0000 7fccfc0ba700 1 --2- 172.21.15.49:0/4049311357 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccf40c6e30 0x7fccf4064a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:16.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.866+0000 7fccfc0ba700 1 -- 172.21.15.49:0/4049311357 >> 172.21.15.49:0/4049311357 conn(0x7fccf4085020 msgr2=0x7fccf40c4340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:16.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.866+0000 7fccfc0ba700 1 -- 172.21.15.49:0/4049311357 shutdown_connections 2023-11-30T18:23:16.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:16.866+0000 7fccfc0ba700 1 -- 172.21.15.49:0/4049311357 wait complete. 2023-11-30T18:23:16.871 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T18:23:16.879 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-30T18:23:15.227279+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":212,"acting":212,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2464280,"kb_used_data":17880,"kb_used_omap":0,"kb_used_meta":2446336,"kb_avail":752510440,"statfs":{"total":773094113280,"available":770570690560,"internally_reserved":0,"allocated":18309120,"data_stored":9329994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2505048064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13567,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-67,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.003614"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3f","version":"183'3","reported_seq":13,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120488+0000","last_change":"2023-11-30T18:23:11.729396+0000","last_active":"2023-11-30T18:23:12.120488+0000","last_peered":"2023-11-30T18:23:12.120488+0000","last_clean":"2023-11-30T18:23:12.120488+0000","last_became_active":"2023-11-30T18:23:11.729108+0000","last_became_peered":"2023-11-30T18:23:11.729108+0000","last_unstale":"2023-11-30T18:23:12.120488+0000","last_undegraded":"2023-11-30T18:23:12.120488+0000","last_fullsized":"2023-11-30T18:23:12.120488+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120073+0000","last_change":"2023-11-30T18:23:12.118530+0000","last_active":"2023-11-30T18:23:12.120073+0000","last_peered":"2023-11-30T18:23:12.120073+0000","last_clean":"2023-11-30T18:23:12.120073+0000","last_became_active":"2023-11-30T18:23:12.118224+0000","last_became_peered":"2023-11-30T18:23:12.118224+0000","last_unstale":"2023-11-30T18:23:12.120073+0000","last_undegraded":"2023-11-30T18:23:12.120073+0000","last_fullsized":"2023-11-30T18:23:12.120073+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.104272+0000","last_change":"2023-11-30T18:23:11.724379+0000","last_active":"2023-11-30T18:23:12.104272+0000","last_peered":"2023-11-30T18:23:12.104272+0000","last_clean":"2023-11-30T18:23:12.104272+0000","last_became_active":"2023-11-30T18:23:11.724081+0000","last_became_peered":"2023-11-30T18:23:11.724081+0000","last_unstale":"2023-11-30T18:23:12.104272+0000","last_undegraded":"2023-11-30T18:23:12.104272+0000","last_fullsized":"2023-11-30T18:23:12.104272+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112554+0000","last_change":"2023-11-30T18:23:12.108411+0000","last_active":"2023-11-30T18:23:12.112554+0000","last_peered":"2023-11-30T18:23:12.112554+0000","last_clean":"2023-11-30T18:23:12.112554+0000","last_became_active":"2023-11-30T18:23:12.108120+0000","last_became_peered":"2023-11-30T18:23:12.108120+0000","last_unstale":"2023-11-30T18:23:12.112554+0000","last_undegraded":"2023-11-30T18:23:12.112554+0000","last_fullsized":"2023-11-30T18:23:12.112554+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120555+0000","last_change":"2023-11-30T18:23:12.112331+0000","last_active":"2023-11-30T18:23:12.120555+0000","last_peered":"2023-11-30T18:23:12.120555+0000","last_clean":"2023-11-30T18:23:12.120555+0000","last_became_active":"2023-11-30T18:23:12.111049+0000","last_became_peered":"2023-11-30T18:23:12.111049+0000","last_unstale":"2023-11-30T18:23:12.120555+0000","last_undegraded":"2023-11-30T18:23:12.120555+0000","last_fullsized":"2023-11-30T18:23:12.120555+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128170+0000","last_change":"2023-11-30T18:23:11.730906+0000","last_active":"2023-11-30T18:23:12.128170+0000","last_peered":"2023-11-30T18:23:12.128170+0000","last_clean":"2023-11-30T18:23:12.128170+0000","last_became_active":"2023-11-30T18:23:11.729501+0000","last_became_peered":"2023-11-30T18:23:11.729501+0000","last_unstale":"2023-11-30T18:23:12.128170+0000","last_undegraded":"2023-11-30T18:23:12.128170+0000","last_fullsized":"2023-11-30T18:23:12.128170+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120886+0000","last_change":"2023-11-30T18:23:12.118680+0000","last_active":"2023-11-30T18:23:12.120886+0000","last_peered":"2023-11-30T18:23:12.120886+0000","last_clean":"2023-11-30T18:23:12.120886+0000","last_became_active":"2023-11-30T18:23:12.118358+0000","last_became_peered":"2023-11-30T18:23:12.118358+0000","last_unstale":"2023-11-30T18:23:12.120886+0000","last_undegraded":"2023-11-30T18:23:12.120886+0000","last_fullsized":"2023-11-30T18:23:12.120886+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114112+0000","last_change":"2023-11-30T18:23:11.732949+0000","last_active":"2023-11-30T18:23:12.114112+0000","last_peered":"2023-11-30T18:23:12.114112+0000","last_clean":"2023-11-30T18:23:12.114112+0000","last_became_active":"2023-11-30T18:23:11.732627+0000","last_became_peered":"2023-11-30T18:23:11.732627+0000","last_unstale":"2023-11-30T18:23:12.114112+0000","last_undegraded":"2023-11-30T18:23:12.114112+0000","last_fullsized":"2023-11-30T18:23:12.114112+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.123862+0000","last_change":"2023-11-30T18:23:12.121133+0000","last_active":"2023-11-30T18:23:12.123862+0000","last_peered":"2023-11-30T18:23:12.123862+0000","last_clean":"2023-11-30T18:23:12.123862+0000","last_became_active":"2023-11-30T18:23:12.120811+0000","last_became_peered":"2023-11-30T18:23:12.120811+0000","last_unstale":"2023-11-30T18:23:12.123862+0000","last_undegraded":"2023-11-30T18:23:12.123862+0000","last_fullsized":"2023-11-30T18:23:12.123862+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105568+0000","last_change":"2023-11-30T18:23:11.732157+0000","last_active":"2023-11-30T18:23:12.105568+0000","last_peered":"2023-11-30T18:23:12.105568+0000","last_clean":"2023-11-30T18:23:12.105568+0000","last_became_active":"2023-11-30T18:23:11.731678+0000","last_became_peered":"2023-11-30T18:23:11.731678+0000","last_unstale":"2023-11-30T18:23:12.105568+0000","last_undegraded":"2023-11-30T18:23:12.105568+0000","last_fullsized":"2023-11-30T18:23:12.105568+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124562+0000","last_change":"2023-11-30T18:23:12.121281+0000","last_active":"2023-11-30T18:23:12.124562+0000","last_peered":"2023-11-30T18:23:12.124562+0000","last_clean":"2023-11-30T18:23:12.124562+0000","last_became_active":"2023-11-30T18:23:12.119940+0000","last_became_peered":"2023-11-30T18:23:12.119940+0000","last_unstale":"2023-11-30T18:23:12.124562+0000","last_undegraded":"2023-11-30T18:23:12.124562+0000","last_fullsized":"2023-11-30T18:23:12.124562+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.099560+0000","last_change":"2023-11-30T18:23:11.729413+0000","last_active":"2023-11-30T18:23:12.099560+0000","last_peered":"2023-11-30T18:23:12.099560+0000","last_clean":"2023-11-30T18:23:12.099560+0000","last_became_active":"2023-11-30T18:23:11.729096+0000","last_became_peered":"2023-11-30T18:23:11.729096+0000","last_unstale":"2023-11-30T18:23:12.099560+0000","last_undegraded":"2023-11-30T18:23:12.099560+0000","last_fullsized":"2023-11-30T18:23:12.099560+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.103587+0000","last_change":"2023-11-30T18:23:11.731558+0000","last_active":"2023-11-30T18:23:12.103587+0000","last_peered":"2023-11-30T18:23:12.103587+0000","last_clean":"2023-11-30T18:23:12.103587+0000","last_became_active":"2023-11-30T18:23:11.731257+0000","last_became_peered":"2023-11-30T18:23:11.731257+0000","last_unstale":"2023-11-30T18:23:12.103587+0000","last_undegraded":"2023-11-30T18:23:12.103587+0000","last_fullsized":"2023-11-30T18:23:12.103587+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124485+0000","last_change":"2023-11-30T18:23:12.119514+0000","last_active":"2023-11-30T18:23:12.124485+0000","last_peered":"2023-11-30T18:23:12.124485+0000","last_clean":"2023-11-30T18:23:12.124485+0000","last_became_active":"2023-11-30T18:23:12.119170+0000","last_became_peered":"2023-11-30T18:23:12.119170+0000","last_unstale":"2023-11-30T18:23:12.124485+0000","last_undegraded":"2023-11-30T18:23:12.124485+0000","last_fullsized":"2023-11-30T18:23:12.124485+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.118785+0000","last_change":"2023-11-30T18:23:11.733798+0000","last_active":"2023-11-30T18:23:12.118785+0000","last_peered":"2023-11-30T18:23:12.118785+0000","last_clean":"2023-11-30T18:23:12.118785+0000","last_became_active":"2023-11-30T18:23:11.733491+0000","last_became_peered":"2023-11-30T18:23:11.733491+0000","last_unstale":"2023-11-30T18:23:12.118785+0000","last_undegraded":"2023-11-30T18:23:12.118785+0000","last_fullsized":"2023-11-30T18:23:12.118785+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.113796+0000","last_change":"2023-11-30T18:23:12.111493+0000","last_active":"2023-11-30T18:23:12.113796+0000","last_peered":"2023-11-30T18:23:12.113796+0000","last_clean":"2023-11-30T18:23:12.113796+0000","last_became_active":"2023-11-30T18:23:12.111224+0000","last_became_peered":"2023-11-30T18:23:12.111224+0000","last_unstale":"2023-11-30T18:23:12.113796+0000","last_undegraded":"2023-11-30T18:23:12.113796+0000","last_fullsized":"2023-11-30T18:23:12.113796+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101233+0000","last_change":"2023-11-30T18:23:11.732288+0000","last_active":"2023-11-30T18:23:12.101233+0000","last_peered":"2023-11-30T18:23:12.101233+0000","last_clean":"2023-11-30T18:23:12.101233+0000","last_became_active":"2023-11-30T18:23:11.731998+0000","last_became_peered":"2023-11-30T18:23:11.731998+0000","last_unstale":"2023-11-30T18:23:12.101233+0000","last_undegraded":"2023-11-30T18:23:12.101233+0000","last_fullsized":"2023-11-30T18:23:12.101233+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.123377+0000","last_change":"2023-11-30T18:23:12.118762+0000","last_active":"2023-11-30T18:23:12.123377+0000","last_peered":"2023-11-30T18:23:12.123377+0000","last_clean":"2023-11-30T18:23:12.123377+0000","last_became_active":"2023-11-30T18:23:12.118456+0000","last_became_peered":"2023-11-30T18:23:12.118456+0000","last_unstale":"2023-11-30T18:23:12.123377+0000","last_undegraded":"2023-11-30T18:23:12.123377+0000","last_fullsized":"2023-11-30T18:23:12.123377+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.34","version":"183'4","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.133525+0000","last_change":"2023-11-30T18:23:11.735207+0000","last_active":"2023-11-30T18:23:12.133525+0000","last_peered":"2023-11-30T18:23:12.133525+0000","last_clean":"2023-11-30T18:23:12.133525+0000","last_became_active":"2023-11-30T18:23:11.734947+0000","last_became_peered":"2023-11-30T18:23:11.734947+0000","last_unstale":"2023-11-30T18:23:12.133525+0000","last_undegraded":"2023-11-30T18:23:12.133525+0000","last_fullsized":"2023-11-30T18:23:12.133525+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112616+0000","last_change":"2023-11-30T18:23:12.110171+0000","last_active":"2023-11-30T18:23:12.112616+0000","last_peered":"2023-11-30T18:23:12.112616+0000","last_clean":"2023-11-30T18:23:12.112616+0000","last_became_active":"2023-11-30T18:23:12.109894+0000","last_became_peered":"2023-11-30T18:23:12.109894+0000","last_unstale":"2023-11-30T18:23:12.112616+0000","last_undegraded":"2023-11-30T18:23:12.112616+0000","last_fullsized":"2023-11-30T18:23:12.112616+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.33","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128319+0000","last_change":"2023-11-30T18:23:11.732423+0000","last_active":"2023-11-30T18:23:12.128319+0000","last_peered":"2023-11-30T18:23:12.128319+0000","last_clean":"2023-11-30T18:23:12.128319+0000","last_became_active":"2023-11-30T18:23:11.732141+0000","last_became_peered":"2023-11-30T18:23:11.732141+0000","last_unstale":"2023-11-30T18:23:12.128319+0000","last_undegraded":"2023-11-30T18:23:12.128319+0000","last_fullsized":"2023-11-30T18:23:12.128319+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114206+0000","last_change":"2023-11-30T18:23:12.113067+0000","last_active":"2023-11-30T18:23:12.114206+0000","last_peered":"2023-11-30T18:23:12.114206+0000","last_clean":"2023-11-30T18:23:12.114206+0000","last_became_active":"2023-11-30T18:23:12.112084+0000","last_became_peered":"2023-11-30T18:23:12.112084+0000","last_unstale":"2023-11-30T18:23:12.114206+0000","last_undegraded":"2023-11-30T18:23:12.114206+0000","last_fullsized":"2023-11-30T18:23:12.114206+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114699+0000","last_change":"2023-11-30T18:23:11.731206+0000","last_active":"2023-11-30T18:23:12.114699+0000","last_peered":"2023-11-30T18:23:12.114699+0000","last_clean":"2023-11-30T18:23:12.114699+0000","last_became_active":"2023-11-30T18:23:11.730937+0000","last_became_peered":"2023-11-30T18:23:11.730937+0000","last_unstale":"2023-11-30T18:23:12.114699+0000","last_undegraded":"2023-11-30T18:23:12.114699+0000","last_fullsized":"2023-11-30T18:23:12.114699+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.116858+0000","last_change":"2023-11-30T18:23:12.115316+0000","last_active":"2023-11-30T18:23:12.116858+0000","last_peered":"2023-11-30T18:23:12.116858+0000","last_clean":"2023-11-30T18:23:12.116858+0000","last_became_active":"2023-11-30T18:23:12.114473+0000","last_became_peered":"2023-11-30T18:23:12.114473+0000","last_unstale":"2023-11-30T18:23:12.116858+0000","last_undegraded":"2023-11-30T18:23:12.116858+0000","last_fullsized":"2023-11-30T18:23:12.116858+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.30","version":"183'4","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.127276+0000","last_change":"2023-11-30T18:23:11.729498+0000","last_active":"2023-11-30T18:23:12.127276+0000","last_peered":"2023-11-30T18:23:12.127276+0000","last_clean":"2023-11-30T18:23:12.127276+0000","last_became_active":"2023-11-30T18:23:11.729221+0000","last_became_peered":"2023-11-30T18:23:11.729221+0000","last_unstale":"2023-11-30T18:23:12.127276+0000","last_undegraded":"2023-11-30T18:23:12.127276+0000","last_fullsized":"2023-11-30T18:23:12.127276+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.118300+0000","last_change":"2023-11-30T18:23:12.113823+0000","last_active":"2023-11-30T18:23:12.118300+0000","last_peered":"2023-11-30T18:23:12.118300+0000","last_clean":"2023-11-30T18:23:12.118300+0000","last_became_active":"2023-11-30T18:23:12.113041+0000","last_became_peered":"2023-11-30T18:23:12.113041+0000","last_unstale":"2023-11-30T18:23:12.118300+0000","last_undegraded":"2023-11-30T18:23:12.118300+0000","last_fullsized":"2023-11-30T18:23:12.118300+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120207+0000","last_change":"2023-11-30T18:23:11.737572+0000","last_active":"2023-11-30T18:23:12.120207+0000","last_peered":"2023-11-30T18:23:12.120207+0000","last_clean":"2023-11-30T18:23:12.120207+0000","last_became_active":"2023-11-30T18:23:11.737226+0000","last_became_peered":"2023-11-30T18:23:11.737226+0000","last_unstale":"2023-11-30T18:23:12.120207+0000","last_undegraded":"2023-11-30T18:23:12.120207+0000","last_fullsized":"2023-11-30T18:23:12.120207+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.136298+0000","last_change":"2023-11-30T18:23:12.131062+0000","last_active":"2023-11-30T18:23:12.136298+0000","last_peered":"2023-11-30T18:23:12.136298+0000","last_clean":"2023-11-30T18:23:12.136298+0000","last_became_active":"2023-11-30T18:23:12.130780+0000","last_became_peered":"2023-11-30T18:23:12.130780+0000","last_unstale":"2023-11-30T18:23:12.136298+0000","last_undegraded":"2023-11-30T18:23:12.136298+0000","last_fullsized":"2023-11-30T18:23:12.136298+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124700+0000","last_change":"2023-11-30T18:23:12.122966+0000","last_active":"2023-11-30T18:23:12.124700+0000","last_peered":"2023-11-30T18:23:12.124700+0000","last_clean":"2023-11-30T18:23:12.124700+0000","last_became_active":"2023-11-30T18:23:12.122442+0000","last_became_peered":"2023-11-30T18:23:12.122442+0000","last_unstale":"2023-11-30T18:23:12.124700+0000","last_undegraded":"2023-11-30T18:23:12.124700+0000","last_fullsized":"2023-11-30T18:23:12.124700+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.125158+0000","last_change":"2023-11-30T18:23:11.732298+0000","last_active":"2023-11-30T18:23:12.125158+0000","last_peered":"2023-11-30T18:23:12.125158+0000","last_clean":"2023-11-30T18:23:12.125158+0000","last_became_active":"2023-11-30T18:23:11.731767+0000","last_became_peered":"2023-11-30T18:23:11.731767+0000","last_unstale":"2023-11-30T18:23:12.125158+0000","last_undegraded":"2023-11-30T18:23:12.125158+0000","last_fullsized":"2023-11-30T18:23:12.125158+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.121943+0000","last_change":"2023-11-30T18:23:11.728290+0000","last_active":"2023-11-30T18:23:12.121943+0000","last_peered":"2023-11-30T18:23:12.121943+0000","last_clean":"2023-11-30T18:23:12.121943+0000","last_became_active":"2023-11-30T18:23:11.727972+0000","last_became_peered":"2023-11-30T18:23:11.727972+0000","last_unstale":"2023-11-30T18:23:12.121943+0000","last_undegraded":"2023-11-30T18:23:12.121943+0000","last_fullsized":"2023-11-30T18:23:12.121943+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.125287+0000","last_change":"2023-11-30T18:23:12.117183+0000","last_active":"2023-11-30T18:23:12.125287+0000","last_peered":"2023-11-30T18:23:12.125287+0000","last_clean":"2023-11-30T18:23:12.125287+0000","last_became_active":"2023-11-30T18:23:12.116864+0000","last_became_peered":"2023-11-30T18:23:12.116864+0000","last_unstale":"2023-11-30T18:23:12.125287+0000","last_undegraded":"2023-11-30T18:23:12.125287+0000","last_fullsized":"2023-11-30T18:23:12.125287+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.127634+0000","last_change":"2023-11-30T18:23:11.735658+0000","last_active":"2023-11-30T18:23:12.127634+0000","last_peered":"2023-11-30T18:23:12.127634+0000","last_clean":"2023-11-30T18:23:12.127634+0000","last_became_active":"2023-11-30T18:23:11.735382+0000","last_became_peered":"2023-11-30T18:23:11.735382+0000","last_unstale":"2023-11-30T18:23:12.127634+0000","last_undegraded":"2023-11-30T18:23:12.127634+0000","last_fullsized":"2023-11-30T18:23:12.127634+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128740+0000","last_change":"2023-11-30T18:23:12.124153+0000","last_active":"2023-11-30T18:23:12.128740+0000","last_peered":"2023-11-30T18:23:12.128740+0000","last_clean":"2023-11-30T18:23:12.128740+0000","last_became_active":"2023-11-30T18:23:12.123877+0000","last_became_peered":"2023-11-30T18:23:12.123877+0000","last_unstale":"2023-11-30T18:23:12.128740+0000","last_undegraded":"2023-11-30T18:23:12.128740+0000","last_fullsized":"2023-11-30T18:23:12.128740+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.126056+0000","last_change":"2023-11-30T18:23:12.124681+0000","last_active":"2023-11-30T18:23:12.126056+0000","last_peered":"2023-11-30T18:23:12.126056+0000","last_clean":"2023-11-30T18:23:12.126056+0000","last_became_active":"2023-11-30T18:23:12.124348+0000","last_became_peered":"2023-11-30T18:23:12.124348+0000","last_unstale":"2023-11-30T18:23:12.126056+0000","last_undegraded":"2023-11-30T18:23:12.126056+0000","last_fullsized":"2023-11-30T18:23:12.126056+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.116384+0000","last_change":"2023-11-30T18:23:11.734523+0000","last_active":"2023-11-30T18:23:12.116384+0000","last_peered":"2023-11-30T18:23:12.116384+0000","last_clean":"2023-11-30T18:23:12.116384+0000","last_became_active":"2023-11-30T18:23:11.734241+0000","last_became_peered":"2023-11-30T18:23:11.734241+0000","last_unstale":"2023-11-30T18:23:12.116384+0000","last_undegraded":"2023-11-30T18:23:12.116384+0000","last_fullsized":"2023-11-30T18:23:12.116384+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124583+0000","last_change":"2023-11-30T18:23:12.122081+0000","last_active":"2023-11-30T18:23:12.124583+0000","last_peered":"2023-11-30T18:23:12.124583+0000","last_clean":"2023-11-30T18:23:12.124583+0000","last_became_active":"2023-11-30T18:23:12.121493+0000","last_became_peered":"2023-11-30T18:23:12.121493+0000","last_unstale":"2023-11-30T18:23:12.124583+0000","last_undegraded":"2023-11-30T18:23:12.124583+0000","last_fullsized":"2023-11-30T18:23:12.124583+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.119133+0000","last_change":"2023-11-30T18:23:11.734920+0000","last_active":"2023-11-30T18:23:12.119133+0000","last_peered":"2023-11-30T18:23:12.119133+0000","last_clean":"2023-11-30T18:23:12.119133+0000","last_became_active":"2023-11-30T18:23:11.734578+0000","last_became_peered":"2023-11-30T18:23:11.734578+0000","last_unstale":"2023-11-30T18:23:12.119133+0000","last_undegraded":"2023-11-30T18:23:12.119133+0000","last_fullsized":"2023-11-30T18:23:12.119133+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.123244+0000","last_change":"2023-11-30T18:23:12.118073+0000","last_active":"2023-11-30T18:23:12.123244+0000","last_peered":"2023-11-30T18:23:12.123244+0000","last_clean":"2023-11-30T18:23:12.123244+0000","last_became_active":"2023-11-30T18:23:12.117796+0000","last_became_peered":"2023-11-30T18:23:12.117796+0000","last_unstale":"2023-11-30T18:23:12.123244+0000","last_undegraded":"2023-11-30T18:23:12.123244+0000","last_fullsized":"2023-11-30T18:23:12.123244+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101617+0000","last_change":"2023-11-30T18:23:11.728070+0000","last_active":"2023-11-30T18:23:12.101617+0000","last_peered":"2023-11-30T18:23:12.101617+0000","last_clean":"2023-11-30T18:23:12.101617+0000","last_became_active":"2023-11-30T18:23:11.727817+0000","last_became_peered":"2023-11-30T18:23:11.727817+0000","last_unstale":"2023-11-30T18:23:12.101617+0000","last_undegraded":"2023-11-30T18:23:12.101617+0000","last_fullsized":"2023-11-30T18:23:12.101617+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120898+0000","last_change":"2023-11-30T18:23:12.119472+0000","last_active":"2023-11-30T18:23:12.120898+0000","last_peered":"2023-11-30T18:23:12.120898+0000","last_clean":"2023-11-30T18:23:12.120898+0000","last_became_active":"2023-11-30T18:23:12.119192+0000","last_became_peered":"2023-11-30T18:23:12.119192+0000","last_unstale":"2023-11-30T18:23:12.120898+0000","last_undegraded":"2023-11-30T18:23:12.120898+0000","last_fullsized":"2023-11-30T18:23:12.120898+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.119296+0000","last_change":"2023-11-30T18:23:11.725649+0000","last_active":"2023-11-30T18:23:12.119296+0000","last_peered":"2023-11-30T18:23:12.119296+0000","last_clean":"2023-11-30T18:23:12.119296+0000","last_became_active":"2023-11-30T18:23:11.725358+0000","last_became_peered":"2023-11-30T18:23:11.725358+0000","last_unstale":"2023-11-30T18:23:12.119296+0000","last_undegraded":"2023-11-30T18:23:12.119296+0000","last_fullsized":"2023-11-30T18:23:12.119296+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.121579+0000","last_change":"2023-11-30T18:23:12.119529+0000","last_active":"2023-11-30T18:23:12.121579+0000","last_peered":"2023-11-30T18:23:12.121579+0000","last_clean":"2023-11-30T18:23:12.121579+0000","last_became_active":"2023-11-30T18:23:12.119258+0000","last_became_peered":"2023-11-30T18:23:12.119258+0000","last_unstale":"2023-11-30T18:23:12.121579+0000","last_undegraded":"2023-11-30T18:23:12.121579+0000","last_fullsized":"2023-11-30T18:23:12.121579+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.107434+0000","last_change":"2023-11-30T18:23:11.726054+0000","last_active":"2023-11-30T18:23:12.107434+0000","last_peered":"2023-11-30T18:23:12.107434+0000","last_clean":"2023-11-30T18:23:12.107434+0000","last_became_active":"2023-11-30T18:23:11.725740+0000","last_became_peered":"2023-11-30T18:23:11.725740+0000","last_unstale":"2023-11-30T18:23:12.107434+0000","last_undegraded":"2023-11-30T18:23:12.107434+0000","last_fullsized":"2023-11-30T18:23:12.107434+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.100712+0000","last_change":"2023-11-30T18:23:11.727466+0000","last_active":"2023-11-30T18:23:12.100712+0000","last_peered":"2023-11-30T18:23:12.100712+0000","last_clean":"2023-11-30T18:23:12.100712+0000","last_became_active":"2023-11-30T18:23:11.727184+0000","last_became_peered":"2023-11-30T18:23:11.727184+0000","last_unstale":"2023-11-30T18:23:12.100712+0000","last_undegraded":"2023-11-30T18:23:12.100712+0000","last_fullsized":"2023-11-30T18:23:12.100712+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.113593+0000","last_change":"2023-11-30T18:23:12.108335+0000","last_active":"2023-11-30T18:23:12.113593+0000","last_peered":"2023-11-30T18:23:12.113593+0000","last_clean":"2023-11-30T18:23:12.113593+0000","last_became_active":"2023-11-30T18:23:12.108065+0000","last_became_peered":"2023-11-30T18:23:12.108065+0000","last_unstale":"2023-11-30T18:23:12.113593+0000","last_undegraded":"2023-11-30T18:23:12.113593+0000","last_fullsized":"2023-11-30T18:23:12.113593+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124728+0000","last_change":"2023-11-30T18:23:12.118313+0000","last_active":"2023-11-30T18:23:12.124728+0000","last_peered":"2023-11-30T18:23:12.124728+0000","last_clean":"2023-11-30T18:23:12.124728+0000","last_became_active":"2023-11-30T18:23:12.114897+0000","last_became_peered":"2023-11-30T18:23:12.114897+0000","last_unstale":"2023-11-30T18:23:12.124728+0000","last_undegraded":"2023-11-30T18:23:12.124728+0000","last_fullsized":"2023-11-30T18:23:12.124728+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.103019+0000","last_change":"2023-11-30T18:23:11.728348+0000","last_active":"2023-11-30T18:23:12.103019+0000","last_peered":"2023-11-30T18:23:12.103019+0000","last_clean":"2023-11-30T18:23:12.103019+0000","last_became_active":"2023-11-30T18:23:11.728052+0000","last_became_peered":"2023-11-30T18:23:11.728052+0000","last_unstale":"2023-11-30T18:23:12.103019+0000","last_undegraded":"2023-11-30T18:23:12.103019+0000","last_fullsized":"2023-11-30T18:23:12.103019+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.116614+0000","last_change":"2023-11-30T18:23:11.733562+0000","last_active":"2023-11-30T18:23:12.116614+0000","last_peered":"2023-11-30T18:23:12.116614+0000","last_clean":"2023-11-30T18:23:12.116614+0000","last_became_active":"2023-11-30T18:23:11.733271+0000","last_became_peered":"2023-11-30T18:23:11.733271+0000","last_unstale":"2023-11-30T18:23:12.116614+0000","last_undegraded":"2023-11-30T18:23:12.116614+0000","last_fullsized":"2023-11-30T18:23:12.116614+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.122060+0000","last_change":"2023-11-30T18:23:12.120946+0000","last_active":"2023-11-30T18:23:12.122060+0000","last_peered":"2023-11-30T18:23:12.122060+0000","last_clean":"2023-11-30T18:23:12.122060+0000","last_became_active":"2023-11-30T18:23:12.120510+0000","last_became_peered":"2023-11-30T18:23:12.120510+0000","last_unstale":"2023-11-30T18:23:12.122060+0000","last_undegraded":"2023-11-30T18:23:12.122060+0000","last_fullsized":"2023-11-30T18:23:12.122060+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.118883+0000","last_change":"2023-11-30T18:23:11.722137+0000","last_active":"2023-11-30T18:23:12.118883+0000","last_peered":"2023-11-30T18:23:12.118883+0000","last_clean":"2023-11-30T18:23:12.118883+0000","last_became_active":"2023-11-30T18:23:11.721662+0000","last_became_peered":"2023-11-30T18:23:11.721662+0000","last_unstale":"2023-11-30T18:23:12.118883+0000","last_undegraded":"2023-11-30T18:23:12.118883+0000","last_fullsized":"2023-11-30T18:23:12.118883+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112020+0000","last_change":"2023-11-30T18:23:12.108920+0000","last_active":"2023-11-30T18:23:12.112020+0000","last_peered":"2023-11-30T18:23:12.112020+0000","last_clean":"2023-11-30T18:23:12.112020+0000","last_became_active":"2023-11-30T18:23:12.108658+0000","last_became_peered":"2023-11-30T18:23:12.108658+0000","last_unstale":"2023-11-30T18:23:12.112020+0000","last_undegraded":"2023-11-30T18:23:12.112020+0000","last_fullsized":"2023-11-30T18:23:12.112020+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.127959+0000","last_change":"2023-11-30T18:23:11.735560+0000","last_active":"2023-11-30T18:23:12.127959+0000","last_peered":"2023-11-30T18:23:12.127959+0000","last_clean":"2023-11-30T18:23:12.127959+0000","last_became_active":"2023-11-30T18:23:11.735257+0000","last_became_peered":"2023-11-30T18:23:11.735257+0000","last_unstale":"2023-11-30T18:23:12.127959+0000","last_undegraded":"2023-11-30T18:23:12.127959+0000","last_fullsized":"2023-11-30T18:23:12.127959+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"183'2","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128863+0000","last_change":"2023-11-30T18:23:11.735338+0000","last_active":"2023-11-30T18:23:12.128863+0000","last_peered":"2023-11-30T18:23:12.128863+0000","last_clean":"2023-11-30T18:23:12.128863+0000","last_became_active":"2023-11-30T18:23:11.735068+0000","last_became_peered":"2023-11-30T18:23:11.735068+0000","last_unstale":"2023-11-30T18:23:12.128863+0000","last_undegraded":"2023-11-30T18:23:12.128863+0000","last_fullsized":"2023-11-30T18:23:12.128863+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.130572+0000","last_change":"2023-11-30T18:23:12.128165+0000","last_active":"2023-11-30T18:23:12.130572+0000","last_peered":"2023-11-30T18:23:12.130572+0000","last_clean":"2023-11-30T18:23:12.130572+0000","last_became_active":"2023-11-30T18:23:12.127878+0000","last_became_peered":"2023-11-30T18:23:12.127878+0000","last_unstale":"2023-11-30T18:23:12.130572+0000","last_undegraded":"2023-11-30T18:23:12.130572+0000","last_fullsized":"2023-11-30T18:23:12.130572+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.100901+0000","last_change":"2023-11-30T18:23:11.734177+0000","last_active":"2023-11-30T18:23:12.100901+0000","last_peered":"2023-11-30T18:23:12.100901+0000","last_clean":"2023-11-30T18:23:12.100901+0000","last_became_active":"2023-11-30T18:23:11.733869+0000","last_became_peered":"2023-11-30T18:23:11.733869+0000","last_unstale":"2023-11-30T18:23:12.100901+0000","last_undegraded":"2023-11-30T18:23:12.100901+0000","last_fullsized":"2023-11-30T18:23:12.100901+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.126660+0000","last_change":"2023-11-30T18:23:12.125934+0000","last_active":"2023-11-30T18:23:12.126660+0000","last_peered":"2023-11-30T18:23:12.126660+0000","last_clean":"2023-11-30T18:23:12.126660+0000","last_became_active":"2023-11-30T18:23:12.125609+0000","last_became_peered":"2023-11-30T18:23:12.125609+0000","last_unstale":"2023-11-30T18:23:12.126660+0000","last_undegraded":"2023-11-30T18:23:12.126660+0000","last_fullsized":"2023-11-30T18:23:12.126660+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105169+0000","last_change":"2023-11-30T18:23:11.726273+0000","last_active":"2023-11-30T18:23:12.105169+0000","last_peered":"2023-11-30T18:23:12.105169+0000","last_clean":"2023-11-30T18:23:12.105169+0000","last_became_active":"2023-11-30T18:23:11.726024+0000","last_became_peered":"2023-11-30T18:23:11.726024+0000","last_unstale":"2023-11-30T18:23:12.105169+0000","last_undegraded":"2023-11-30T18:23:12.105169+0000","last_fullsized":"2023-11-30T18:23:12.105169+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114198+0000","last_change":"2023-11-30T18:23:12.111598+0000","last_active":"2023-11-30T18:23:12.114198+0000","last_peered":"2023-11-30T18:23:12.114198+0000","last_clean":"2023-11-30T18:23:12.114198+0000","last_became_active":"2023-11-30T18:23:12.110743+0000","last_became_peered":"2023-11-30T18:23:12.110743+0000","last_unstale":"2023-11-30T18:23:12.114198+0000","last_undegraded":"2023-11-30T18:23:12.114198+0000","last_fullsized":"2023-11-30T18:23:12.114198+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105796+0000","last_change":"2023-11-30T18:23:11.734590+0000","last_active":"2023-11-30T18:23:12.105796+0000","last_peered":"2023-11-30T18:23:12.105796+0000","last_clean":"2023-11-30T18:23:12.105796+0000","last_became_active":"2023-11-30T18:23:11.734303+0000","last_became_peered":"2023-11-30T18:23:11.734303+0000","last_unstale":"2023-11-30T18:23:12.105796+0000","last_undegraded":"2023-11-30T18:23:12.105796+0000","last_fullsized":"2023-11-30T18:23:12.105796+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120605+0000","last_change":"2023-11-30T18:23:12.112705+0000","last_active":"2023-11-30T18:23:12.120605+0000","last_peered":"2023-11-30T18:23:12.120605+0000","last_clean":"2023-11-30T18:23:12.120605+0000","last_became_active":"2023-11-30T18:23:12.111139+0000","last_became_peered":"2023-11-30T18:23:12.111139+0000","last_unstale":"2023-11-30T18:23:12.120605+0000","last_undegraded":"2023-11-30T18:23:12.120605+0000","last_fullsized":"2023-11-30T18:23:12.120605+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.103710+0000","last_change":"2023-11-30T18:23:11.728671+0000","last_active":"2023-11-30T18:23:12.103710+0000","last_peered":"2023-11-30T18:23:12.103710+0000","last_clean":"2023-11-30T18:23:12.103710+0000","last_became_active":"2023-11-30T18:23:11.728345+0000","last_became_peered":"2023-11-30T18:23:11.728345+0000","last_unstale":"2023-11-30T18:23:12.103710+0000","last_undegraded":"2023-11-30T18:23:12.103710+0000","last_fullsized":"2023-11-30T18:23:12.103710+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128782+0000","last_change":"2023-11-30T18:23:12.124792+0000","last_active":"2023-11-30T18:23:12.128782+0000","last_peered":"2023-11-30T18:23:12.128782+0000","last_clean":"2023-11-30T18:23:12.128782+0000","last_became_active":"2023-11-30T18:23:12.124193+0000","last_became_peered":"2023-11-30T18:23:12.124193+0000","last_unstale":"2023-11-30T18:23:12.128782+0000","last_undegraded":"2023-11-30T18:23:12.128782+0000","last_fullsized":"2023-11-30T18:23:12.128782+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128865+0000","last_change":"2023-11-30T18:23:11.727412+0000","last_active":"2023-11-30T18:23:12.128865+0000","last_peered":"2023-11-30T18:23:12.128865+0000","last_clean":"2023-11-30T18:23:12.128865+0000","last_became_active":"2023-11-30T18:23:11.727129+0000","last_became_peered":"2023-11-30T18:23:11.727129+0000","last_unstale":"2023-11-30T18:23:12.128865+0000","last_undegraded":"2023-11-30T18:23:12.128865+0000","last_fullsized":"2023-11-30T18:23:12.128865+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.136285+0000","last_change":"2023-11-30T18:23:12.130940+0000","last_active":"2023-11-30T18:23:12.136285+0000","last_peered":"2023-11-30T18:23:12.136285+0000","last_clean":"2023-11-30T18:23:12.136285+0000","last_became_active":"2023-11-30T18:23:12.130705+0000","last_became_peered":"2023-11-30T18:23:12.130705+0000","last_unstale":"2023-11-30T18:23:12.136285+0000","last_undegraded":"2023-11-30T18:23:12.136285+0000","last_fullsized":"2023-11-30T18:23:12.136285+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"183'2","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128162+0000","last_change":"2023-11-30T18:23:11.736457+0000","last_active":"2023-11-30T18:23:12.128162+0000","last_peered":"2023-11-30T18:23:12.128162+0000","last_clean":"2023-11-30T18:23:12.128162+0000","last_became_active":"2023-11-30T18:23:11.736059+0000","last_became_peered":"2023-11-30T18:23:11.736059+0000","last_unstale":"2023-11-30T18:23:12.128162+0000","last_undegraded":"2023-11-30T18:23:12.128162+0000","last_fullsized":"2023-11-30T18:23:12.128162+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120877+0000","last_change":"2023-11-30T18:23:12.116925+0000","last_active":"2023-11-30T18:23:12.120877+0000","last_peered":"2023-11-30T18:23:12.120877+0000","last_clean":"2023-11-30T18:23:12.120877+0000","last_became_active":"2023-11-30T18:23:12.116645+0000","last_became_peered":"2023-11-30T18:23:12.116645+0000","last_unstale":"2023-11-30T18:23:12.120877+0000","last_undegraded":"2023-11-30T18:23:12.120877+0000","last_fullsized":"2023-11-30T18:23:12.120877+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101414+0000","last_change":"2023-11-30T18:23:11.732070+0000","last_active":"2023-11-30T18:23:12.101414+0000","last_peered":"2023-11-30T18:23:12.101414+0000","last_clean":"2023-11-30T18:23:12.101414+0000","last_became_active":"2023-11-30T18:23:11.731413+0000","last_became_peered":"2023-11-30T18:23:11.731413+0000","last_unstale":"2023-11-30T18:23:12.101414+0000","last_undegraded":"2023-11-30T18:23:12.101414+0000","last_fullsized":"2023-11-30T18:23:12.101414+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.117119+0000","last_change":"2023-11-30T18:23:12.109130+0000","last_active":"2023-11-30T18:23:12.117119+0000","last_peered":"2023-11-30T18:23:12.117119+0000","last_clean":"2023-11-30T18:23:12.117119+0000","last_became_active":"2023-11-30T18:23:12.108797+0000","last_became_peered":"2023-11-30T18:23:12.108797+0000","last_unstale":"2023-11-30T18:23:12.117119+0000","last_undegraded":"2023-11-30T18:23:12.117119+0000","last_fullsized":"2023-11-30T18:23:12.117119+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.133312+0000","last_change":"2023-11-30T18:23:12.128309+0000","last_active":"2023-11-30T18:23:12.133312+0000","last_peered":"2023-11-30T18:23:12.133312+0000","last_clean":"2023-11-30T18:23:12.133312+0000","last_became_active":"2023-11-30T18:23:12.128014+0000","last_became_peered":"2023-11-30T18:23:12.128014+0000","last_unstale":"2023-11-30T18:23:12.133312+0000","last_undegraded":"2023-11-30T18:23:12.133312+0000","last_fullsized":"2023-11-30T18:23:12.133312+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112901+0000","last_change":"2023-11-30T18:23:11.731121+0000","last_active":"2023-11-30T18:23:12.112901+0000","last_peered":"2023-11-30T18:23:12.112901+0000","last_clean":"2023-11-30T18:23:12.112901+0000","last_became_active":"2023-11-30T18:23:11.730804+0000","last_became_peered":"2023-11-30T18:23:11.730804+0000","last_unstale":"2023-11-30T18:23:12.112901+0000","last_undegraded":"2023-11-30T18:23:12.112901+0000","last_fullsized":"2023-11-30T18:23:12.112901+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114635+0000","last_change":"2023-11-30T18:23:12.113494+0000","last_active":"2023-11-30T18:23:12.114635+0000","last_peered":"2023-11-30T18:23:12.114635+0000","last_clean":"2023-11-30T18:23:12.114635+0000","last_became_active":"2023-11-30T18:23:12.112805+0000","last_became_peered":"2023-11-30T18:23:12.112805+0000","last_unstale":"2023-11-30T18:23:12.114635+0000","last_undegraded":"2023-11-30T18:23:12.114635+0000","last_fullsized":"2023-11-30T18:23:12.114635+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128947+0000","last_change":"2023-11-30T18:23:12.125304+0000","last_active":"2023-11-30T18:23:12.128947+0000","last_peered":"2023-11-30T18:23:12.128947+0000","last_clean":"2023-11-30T18:23:12.128947+0000","last_became_active":"2023-11-30T18:23:12.125058+0000","last_became_peered":"2023-11-30T18:23:12.125058+0000","last_unstale":"2023-11-30T18:23:12.128947+0000","last_undegraded":"2023-11-30T18:23:12.128947+0000","last_fullsized":"2023-11-30T18:23:12.128947+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105672+0000","last_change":"2023-11-30T18:23:11.731979+0000","last_active":"2023-11-30T18:23:12.105672+0000","last_peered":"2023-11-30T18:23:12.105672+0000","last_clean":"2023-11-30T18:23:12.105672+0000","last_became_active":"2023-11-30T18:23:11.731333+0000","last_became_peered":"2023-11-30T18:23:11.731333+0000","last_unstale":"2023-11-30T18:23:12.105672+0000","last_undegraded":"2023-11-30T18:23:12.105672+0000","last_fullsized":"2023-11-30T18:23:12.105672+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112581+0000","last_change":"2023-11-30T18:23:12.108480+0000","last_active":"2023-11-30T18:23:12.112581+0000","last_peered":"2023-11-30T18:23:12.112581+0000","last_clean":"2023-11-30T18:23:12.112581+0000","last_became_active":"2023-11-30T18:23:12.108192+0000","last_became_peered":"2023-11-30T18:23:12.108192+0000","last_unstale":"2023-11-30T18:23:12.112581+0000","last_undegraded":"2023-11-30T18:23:12.112581+0000","last_fullsized":"2023-11-30T18:23:12.112581+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.123835+0000","last_change":"2023-11-30T18:23:12.121094+0000","last_active":"2023-11-30T18:23:12.123835+0000","last_peered":"2023-11-30T18:23:12.123835+0000","last_clean":"2023-11-30T18:23:12.123835+0000","last_became_active":"2023-11-30T18:23:12.119586+0000","last_became_peered":"2023-11-30T18:23:12.119586+0000","last_unstale":"2023-11-30T18:23:12.123835+0000","last_undegraded":"2023-11-30T18:23:12.123835+0000","last_fullsized":"2023-11-30T18:23:12.123835+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105796+0000","last_change":"2023-11-30T18:23:11.728944+0000","last_active":"2023-11-30T18:23:12.105796+0000","last_peered":"2023-11-30T18:23:12.105796+0000","last_clean":"2023-11-30T18:23:12.105796+0000","last_became_active":"2023-11-30T18:23:11.728632+0000","last_became_peered":"2023-11-30T18:23:11.728632+0000","last_unstale":"2023-11-30T18:23:12.105796+0000","last_undegraded":"2023-11-30T18:23:12.105796+0000","last_fullsized":"2023-11-30T18:23:12.105796+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120459+0000","last_change":"2023-11-30T18:23:12.111474+0000","last_active":"2023-11-30T18:23:12.120459+0000","last_peered":"2023-11-30T18:23:12.120459+0000","last_clean":"2023-11-30T18:23:12.120459+0000","last_became_active":"2023-11-30T18:23:12.111119+0000","last_became_peered":"2023-11-30T18:23:12.111119+0000","last_unstale":"2023-11-30T18:23:12.120459+0000","last_undegraded":"2023-11-30T18:23:12.120459+0000","last_fullsized":"2023-11-30T18:23:12.120459+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101462+0000","last_change":"2023-11-30T18:23:11.733982+0000","last_active":"2023-11-30T18:23:12.101462+0000","last_peered":"2023-11-30T18:23:12.101462+0000","last_clean":"2023-11-30T18:23:12.101462+0000","last_became_active":"2023-11-30T18:23:11.733689+0000","last_became_peered":"2023-11-30T18:23:11.733689+0000","last_unstale":"2023-11-30T18:23:12.101462+0000","last_undegraded":"2023-11-30T18:23:12.101462+0000","last_fullsized":"2023-11-30T18:23:12.101462+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120038+0000","last_change":"2023-11-30T18:23:12.116461+0000","last_active":"2023-11-30T18:23:12.120038+0000","last_peered":"2023-11-30T18:23:12.120038+0000","last_clean":"2023-11-30T18:23:12.120038+0000","last_became_active":"2023-11-30T18:23:12.115880+0000","last_became_peered":"2023-11-30T18:23:12.115880+0000","last_unstale":"2023-11-30T18:23:12.120038+0000","last_undegraded":"2023-11-30T18:23:12.120038+0000","last_fullsized":"2023-11-30T18:23:12.120038+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.104010+0000","last_change":"2023-11-30T18:23:11.728276+0000","last_active":"2023-11-30T18:23:12.104010+0000","last_peered":"2023-11-30T18:23:12.104010+0000","last_clean":"2023-11-30T18:23:12.104010+0000","last_became_active":"2023-11-30T18:23:11.727974+0000","last_became_peered":"2023-11-30T18:23:11.727974+0000","last_unstale":"2023-11-30T18:23:12.104010+0000","last_undegraded":"2023-11-30T18:23:12.104010+0000","last_fullsized":"2023-11-30T18:23:12.104010+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.106016+0000","last_change":"2023-11-30T18:23:11.730729+0000","last_active":"2023-11-30T18:23:12.106016+0000","last_peered":"2023-11-30T18:23:12.106016+0000","last_clean":"2023-11-30T18:23:12.106016+0000","last_became_active":"2023-11-30T18:23:11.728274+0000","last_became_peered":"2023-11-30T18:23:11.728274+0000","last_unstale":"2023-11-30T18:23:12.106016+0000","last_undegraded":"2023-11-30T18:23:12.106016+0000","last_fullsized":"2023-11-30T18:23:12.106016+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.119835+0000","last_change":"2023-11-30T18:23:11.729709+0000","last_active":"2023-11-30T18:23:12.119835+0000","last_peered":"2023-11-30T18:23:12.119835+0000","last_clean":"2023-11-30T18:23:12.119835+0000","last_became_active":"2023-11-30T18:23:11.728696+0000","last_became_peered":"2023-11-30T18:23:11.728696+0000","last_unstale":"2023-11-30T18:23:12.119835+0000","last_undegraded":"2023-11-30T18:23:12.119835+0000","last_fullsized":"2023-11-30T18:23:12.119835+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112118+0000","last_change":"2023-11-30T18:23:12.110191+0000","last_active":"2023-11-30T18:23:12.112118+0000","last_peered":"2023-11-30T18:23:12.112118+0000","last_clean":"2023-11-30T18:23:12.112118+0000","last_became_active":"2023-11-30T18:23:12.108068+0000","last_became_peered":"2023-11-30T18:23:12.108068+0000","last_unstale":"2023-11-30T18:23:12.112118+0000","last_undegraded":"2023-11-30T18:23:12.112118+0000","last_fullsized":"2023-11-30T18:23:12.112118+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.106165+0000","last_change":"2023-11-30T18:23:11.724242+0000","last_active":"2023-11-30T18:23:12.106165+0000","last_peered":"2023-11-30T18:23:12.106165+0000","last_clean":"2023-11-30T18:23:12.106165+0000","last_became_active":"2023-11-30T18:23:11.723941+0000","last_became_peered":"2023-11-30T18:23:11.723941+0000","last_unstale":"2023-11-30T18:23:12.106165+0000","last_undegraded":"2023-11-30T18:23:12.106165+0000","last_fullsized":"2023-11-30T18:23:12.106165+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.116481+0000","last_change":"2023-11-30T18:23:11.733023+0000","last_active":"2023-11-30T18:23:12.116481+0000","last_peered":"2023-11-30T18:23:12.116481+0000","last_clean":"2023-11-30T18:23:12.116481+0000","last_became_active":"2023-11-30T18:23:11.732439+0000","last_became_peered":"2023-11-30T18:23:11.732439+0000","last_unstale":"2023-11-30T18:23:12.116481+0000","last_undegraded":"2023-11-30T18:23:12.116481+0000","last_fullsized":"2023-11-30T18:23:12.116481+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.118736+0000","last_change":"2023-11-30T18:23:11.724253+0000","last_active":"2023-11-30T18:23:12.118736+0000","last_peered":"2023-11-30T18:23:12.118736+0000","last_clean":"2023-11-30T18:23:12.118736+0000","last_became_active":"2023-11-30T18:23:11.723936+0000","last_became_peered":"2023-11-30T18:23:11.723936+0000","last_unstale":"2023-11-30T18:23:12.118736+0000","last_undegraded":"2023-11-30T18:23:12.118736+0000","last_fullsized":"2023-11-30T18:23:12.118736+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":154,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.100854+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T18:23:12.100854+0000","last_peered":"2023-11-30T18:23:12.100854+0000","last_clean":"2023-11-30T18:23:12.100854+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T18:23:12.100854+0000","last_undegraded":"2023-11-30T18:23:12.100854+0000","last_fullsized":"2023-11-30T18:23:12.100854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124990+0000","last_change":"2023-11-30T18:23:12.122702+0000","last_active":"2023-11-30T18:23:12.124990+0000","last_peered":"2023-11-30T18:23:12.124990+0000","last_clean":"2023-11-30T18:23:12.124990+0000","last_became_active":"2023-11-30T18:23:12.122115+0000","last_became_peered":"2023-11-30T18:23:12.122115+0000","last_unstale":"2023-11-30T18:23:12.124990+0000","last_undegraded":"2023-11-30T18:23:12.124990+0000","last_fullsized":"2023-11-30T18:23:12.124990+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"183'3","reported_seq":13,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124889+0000","last_change":"2023-11-30T18:23:11.723777+0000","last_active":"2023-11-30T18:23:12.124889+0000","last_peered":"2023-11-30T18:23:12.124889+0000","last_clean":"2023-11-30T18:23:12.124889+0000","last_became_active":"2023-11-30T18:23:11.723321+0000","last_became_peered":"2023-11-30T18:23:11.723321+0000","last_unstale":"2023-11-30T18:23:12.124889+0000","last_undegraded":"2023-11-30T18:23:12.124889+0000","last_fullsized":"2023-11-30T18:23:12.124889+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":151,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105479+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T18:23:12.105479+0000","last_peered":"2023-11-30T18:23:12.105479+0000","last_clean":"2023-11-30T18:23:12.105479+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T18:23:12.105479+0000","last_undegraded":"2023-11-30T18:23:12.105479+0000","last_fullsized":"2023-11-30T18:23:12.105479+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124947+0000","last_change":"2023-11-30T18:23:12.123908+0000","last_active":"2023-11-30T18:23:12.124947+0000","last_peered":"2023-11-30T18:23:12.124947+0000","last_clean":"2023-11-30T18:23:12.124947+0000","last_became_active":"2023-11-30T18:23:12.123674+0000","last_became_peered":"2023-11-30T18:23:12.123674+0000","last_unstale":"2023-11-30T18:23:12.124947+0000","last_undegraded":"2023-11-30T18:23:12.124947+0000","last_fullsized":"2023-11-30T18:23:12.124947+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105691+0000","last_change":"2023-11-30T18:23:11.726548+0000","last_active":"2023-11-30T18:23:12.105691+0000","last_peered":"2023-11-30T18:23:12.105691+0000","last_clean":"2023-11-30T18:23:12.105691+0000","last_became_active":"2023-11-30T18:23:11.726202+0000","last_became_peered":"2023-11-30T18:23:11.726202+0000","last_unstale":"2023-11-30T18:23:12.105691+0000","last_undegraded":"2023-11-30T18:23:12.105691+0000","last_fullsized":"2023-11-30T18:23:12.105691+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":158,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.118025+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T18:23:12.118025+0000","last_peered":"2023-11-30T18:23:12.118025+0000","last_clean":"2023-11-30T18:23:12.118025+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T18:23:12.118025+0000","last_undegraded":"2023-11-30T18:23:12.118025+0000","last_fullsized":"2023-11-30T18:23:12.118025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"183'2","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.113944+0000","last_change":"2023-11-30T18:23:11.732729+0000","last_active":"2023-11-30T18:23:12.113944+0000","last_peered":"2023-11-30T18:23:12.113944+0000","last_clean":"2023-11-30T18:23:12.113944+0000","last_became_active":"2023-11-30T18:23:11.732454+0000","last_became_peered":"2023-11-30T18:23:11.732454+0000","last_unstale":"2023-11-30T18:23:12.113944+0000","last_undegraded":"2023-11-30T18:23:12.113944+0000","last_fullsized":"2023-11-30T18:23:12.113944+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":151,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.106039+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T18:23:12.106039+0000","last_peered":"2023-11-30T18:23:12.106039+0000","last_clean":"2023-11-30T18:23:12.106039+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T18:23:12.106039+0000","last_undegraded":"2023-11-30T18:23:12.106039+0000","last_fullsized":"2023-11-30T18:23:12.106039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":148,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.116542+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T18:23:12.116542+0000","last_peered":"2023-11-30T18:23:12.116542+0000","last_clean":"2023-11-30T18:23:12.116542+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T18:23:12.116542+0000","last_undegraded":"2023-11-30T18:23:12.116542+0000","last_fullsized":"2023-11-30T18:23:12.116542+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:11.703815+0000","last_change":"2023-11-30T18:23:11.703815+0000","last_active":"2023-11-30T18:23:11.703815+0000","last_peered":"2023-11-30T18:23:11.703815+0000","last_clean":"2023-11-30T18:23:11.703815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:11.703815+0000","last_undegraded":"2023-11-30T18:23:11.703815+0000","last_fullsized":"2023-11-30T18:23:11.703815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120308+0000","last_change":"2023-11-30T18:23:11.737931+0000","last_active":"2023-11-30T18:23:12.120308+0000","last_peered":"2023-11-30T18:23:12.120308+0000","last_clean":"2023-11-30T18:23:12.120308+0000","last_became_active":"2023-11-30T18:23:11.737593+0000","last_became_peered":"2023-11-30T18:23:11.737593+0000","last_unstale":"2023-11-30T18:23:12.120308+0000","last_undegraded":"2023-11-30T18:23:12.120308+0000","last_fullsized":"2023-11-30T18:23:12.120308+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":146,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.116609+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T18:23:12.116609+0000","last_peered":"2023-11-30T18:23:12.116609+0000","last_clean":"2023-11-30T18:23:12.116609+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T18:23:12.116609+0000","last_undegraded":"2023-11-30T18:23:12.116609+0000","last_fullsized":"2023-11-30T18:23:12.116609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114593+0000","last_change":"2023-11-30T18:23:12.113259+0000","last_active":"2023-11-30T18:23:12.114593+0000","last_peered":"2023-11-30T18:23:12.114593+0000","last_clean":"2023-11-30T18:23:12.114593+0000","last_became_active":"2023-11-30T18:23:12.112451+0000","last_became_peered":"2023-11-30T18:23:12.112451+0000","last_unstale":"2023-11-30T18:23:12.114593+0000","last_undegraded":"2023-11-30T18:23:12.114593+0000","last_fullsized":"2023-11-30T18:23:12.114593+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":146,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.121501+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T18:23:12.121501+0000","last_peered":"2023-11-30T18:23:12.121501+0000","last_clean":"2023-11-30T18:23:12.121501+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T18:23:12.121501+0000","last_undegraded":"2023-11-30T18:23:12.121501+0000","last_fullsized":"2023-11-30T18:23:12.121501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.123443+0000","last_change":"2023-11-30T18:23:12.119562+0000","last_active":"2023-11-30T18:23:12.123443+0000","last_peered":"2023-11-30T18:23:12.123443+0000","last_clean":"2023-11-30T18:23:12.123443+0000","last_became_active":"2023-11-30T18:23:12.119194+0000","last_became_peered":"2023-11-30T18:23:12.119194+0000","last_unstale":"2023-11-30T18:23:12.123443+0000","last_undegraded":"2023-11-30T18:23:12.123443+0000","last_fullsized":"2023-11-30T18:23:12.123443+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:23:10.701569+0000","last_change":"2023-11-30T18:23:10.701569+0000","last_active":"2023-11-30T18:23:10.701569+0000","last_peered":"2023-11-30T18:23:10.701569+0000","last_clean":"2023-11-30T18:23:10.701569+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:23:10.701569+0000","last_undegraded":"2023-11-30T18:23:10.701569+0000","last_fullsized":"2023-11-30T18:23:10.701569+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":154,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101695+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T18:23:12.101695+0000","last_peered":"2023-11-30T18:23:12.101695+0000","last_clean":"2023-11-30T18:23:12.101695+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T18:23:12.101695+0000","last_undegraded":"2023-11-30T18:23:12.101695+0000","last_fullsized":"2023-11-30T18:23:12.101695+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.113473+0000","last_change":"2023-11-30T18:23:12.111164+0000","last_active":"2023-11-30T18:23:12.113473+0000","last_peered":"2023-11-30T18:23:12.113473+0000","last_clean":"2023-11-30T18:23:12.113473+0000","last_became_active":"2023-11-30T18:23:12.110887+0000","last_became_peered":"2023-11-30T18:23:12.110887+0000","last_unstale":"2023-11-30T18:23:12.113473+0000","last_undegraded":"2023-11-30T18:23:12.113473+0000","last_fullsized":"2023-11-30T18:23:12.113473+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"183'4","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128421+0000","last_change":"2023-11-30T18:23:11.728962+0000","last_active":"2023-11-30T18:23:12.128421+0000","last_peered":"2023-11-30T18:23:12.128421+0000","last_clean":"2023-11-30T18:23:12.128421+0000","last_became_active":"2023-11-30T18:23:11.728681+0000","last_became_peered":"2023-11-30T18:23:11.728681+0000","last_unstale":"2023-11-30T18:23:12.128421+0000","last_undegraded":"2023-11-30T18:23:12.128421+0000","last_fullsized":"2023-11-30T18:23:12.128421+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":168,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-11-30T18:23:07.189838+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T18:23:07.189838+0000","last_peered":"2023-11-30T18:23:07.189838+0000","last_clean":"2023-11-30T18:23:07.189838+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T18:23:07.189838+0000","last_undegraded":"2023-11-30T18:23:07.189838+0000","last_fullsized":"2023-11-30T18:23:07.189838+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":100,"acting":100,"num_store_stats":6},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":94,"acting":94,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575755,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303444,"kb_used_data":2252,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068396,"statfs":{"total":96636764160,"available":96326037504,"internally_reserved":0,"allocated":2306048,"data_stored":1173973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.32500000000000001},"max":{"1min":0.68700000000000006,"5min":0.81699999999999995,"15min":0.83599999999999997},"last":0.503},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.60699999999999998,"15min":0.61799999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.71499999999999997,"5min":0.82199999999999995,"15min":0.84999999999999998},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55000000000000004,"15min":0.55900000000000005},"min":{"1min":0.35599999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71599999999999997,"5min":0.80500000000000005,"15min":0.875},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.39800000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71699999999999997,"5min":0.79100000000000004,"15min":0.82099999999999995},"last":0.54400000000000004}]},{"osd":2,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70399999999999996,"5min":0.76900000000000002,"15min":0.85399999999999998},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.66500000000000004,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.34300000000000003},"max":{"1min":0.65700000000000003,"5min":0.79300000000000004,"15min":0.90800000000000003},"last":0.373},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60199999999999998,"15min":0.60299999999999998},"min":{"1min":0.41099999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.73399999999999999,"5min":0.80000000000000004,"15min":0.80300000000000005},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.45300000000000001,"15min":0.44400000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63900000000000001,"5min":0.70299999999999996,"15min":0.73799999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46400000000000002,"15min":0.46500000000000002},"min":{"1min":0.32100000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.66400000000000003,"5min":0.71999999999999997,"15min":0.78100000000000003},"last":0.438}]},{"osd":5,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.65000000000000002,"5min":0.749,"15min":0.753},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.51000000000000001,"15min":0.505},"min":{"1min":0.371,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":0.69099999999999995,"5min":0.76000000000000001,"15min":0.81999999999999995},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.372,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.74299999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.751,"5min":0.81499999999999995,"15min":0.83599999999999997},"last":0.53100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575753,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307480,"kb_used_data":2192,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064360,"statfs":{"total":96636764160,"available":96321904640,"internally_reserved":0,"allocated":2244608,"data_stored":1145498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.58999999999999997,"15min":0.59799999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68000000000000005,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.61799999999999999,"15min":0.61699999999999999},"min":{"1min":0.45100000000000001,"5min":0.41099999999999998,"15min":0.33600000000000002},"max":{"1min":0.72599999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.32400000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.70899999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.40999999999999998,"5min":0.39000000000000001,"15min":0.35199999999999998},"max":{"1min":0.751,"5min":0.876,"15min":0.876},"last":0.60999999999999999}]},{"osd":2,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.59699999999999998,"15min":0.59799999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71399999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.39000000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73399999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54700000000000004,"15min":0.55700000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73399999999999999,"5min":0.82299999999999995,"15min":0.83499999999999996},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.39900000000000002,"5min":0.39000000000000001,"15min":0.33200000000000002},"max":{"1min":0.64400000000000002,"5min":0.79100000000000004,"15min":0.80100000000000005},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45200000000000001,"15min":0.45100000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.68899999999999995,"5min":0.81000000000000005,"15min":0.94999999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47799999999999998,"15min":0.47599999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70399999999999996,"5min":0.76400000000000001,"15min":0.82299999999999995},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46999999999999997,"15min":0.46700000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.66300000000000003,"5min":0.76400000000000001,"15min":0.81999999999999995},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70999999999999996,"5min":0.81999999999999995,"15min":0.83499999999999996},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.29999999999999999},"max":{"1min":0.72499999999999998,"5min":0.80100000000000005,"15min":0.86799999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.376,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71599999999999997,"5min":0.80800000000000005,"15min":0.86599999999999999},"last":0.64900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575754,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307536,"kb_used_data":2248,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064304,"statfs":{"total":96636764160,"available":96321847296,"internally_reserved":0,"allocated":2301952,"data_stored":1173129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34200000000000003,"15min":0.36399999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.42799999999999999,"5min":0.54200000000000004,"15min":0.70699999999999996},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47299999999999998,"15min":0.49399999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.78100000000000003},"last":0.33100000000000002}]},{"osd":2,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.376,"15min":0.39600000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.48099999999999998,"5min":0.60599999999999998,"15min":0.67500000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.498,"15min":0.51600000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63200000000000001,"5min":0.72499999999999998,"15min":0.85599999999999998},"last":0.38}]},{"osd":3,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.44700000000000001,"15min":0.46300000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.53700000000000003,"5min":0.70599999999999996,"15min":0.79600000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.42299999999999999,"15min":0.44600000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.50700000000000001,"5min":0.65400000000000003,"15min":0.68000000000000005},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.58399999999999996,"15min":0.60999999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.314},"max":{"1min":0.80100000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.61799999999999999,"15min":0.64100000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38800000000000001},"max":{"1min":0.77900000000000003,"5min":0.80800000000000005,"15min":0.90600000000000003},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.60399999999999998,"15min":0.623},"min":{"1min":0.379,"5min":0.379,"15min":0.377},"max":{"1min":0.78400000000000003,"5min":0.86599999999999999,"15min":0.90200000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60899999999999999,"15min":0.63300000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.36799999999999999},"max":{"1min":0.79400000000000004,"5min":0.878,"15min":0.90800000000000003},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.66700000000000004,"15min":0.68899999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66300000000000003,"15min":0.67600000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42599999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.0049999999999999},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.66600000000000004,"15min":0.68999999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.96999999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.65100000000000002,"15min":0.67200000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.95899999999999996},"last":0.52100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575754,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307544,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064296,"statfs":{"total":96636764160,"available":96321839104,"internally_reserved":0,"allocated":2310144,"data_stored":1173273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.38300000000000001,"15min":0.38900000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.51900000000000002,"5min":0.56799999999999995,"15min":0.61099999999999999},"last":0.246},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41099999999999998,"15min":0.40999999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.249},"max":{"1min":0.55600000000000005,"5min":0.65600000000000003,"15min":0.68400000000000005},"last":0.34000000000000002}]},{"osd":2,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41599999999999998,"15min":0.40899999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.57499999999999996,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.49299999999999999,"15min":0.48999999999999999},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.59399999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.44600000000000001,"15min":0.45200000000000001},"min":{"1min":0.311,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.53500000000000003,"5min":0.71699999999999997,"15min":0.77500000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46899999999999997,"15min":0.46800000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65300000000000002,"5min":0.67600000000000005,"15min":0.69499999999999995},"last":0.26000000000000001}]},{"osd":4,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65000000000000002,"15min":0.63700000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.42199999999999999},"max":{"1min":0.81000000000000005,"5min":0.96399999999999997,"15min":0.995},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66600000000000004,"15min":0.65400000000000003},"min":{"1min":0.47799999999999998,"5min":0.42799999999999999,"15min":0.41499999999999998},"max":{"1min":0.75900000000000001,"5min":1.03,"15min":1.03},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65200000000000002,"15min":0.64100000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.40799999999999997},"max":{"1min":0.86499999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.68100000000000005,"15min":0.65900000000000003},"min":{"1min":0.48199999999999998,"5min":0.44800000000000001,"15min":0.41299999999999998},"max":{"1min":0.91900000000000004,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.45600000000000002}]},{"osd":6,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67700000000000005,"15min":0.67300000000000004},"min":{"1min":0.52300000000000002,"5min":0.443,"15min":0.40600000000000003},"max":{"1min":0.81799999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68600000000000005,"15min":0.67700000000000005},"min":{"1min":0.49099999999999999,"5min":0.442,"15min":0.44},"max":{"1min":0.90400000000000003,"5min":1.05,"15min":1.05},"last":0.51400000000000001}]},{"osd":7,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71299999999999997,"15min":0.69799999999999995},"min":{"1min":0.55600000000000005,"5min":0.45200000000000001,"15min":0.42599999999999999},"max":{"1min":0.88600000000000001,"5min":1.167,"15min":1.167},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73199999999999998,"15min":0.72299999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.48399999999999999},"max":{"1min":0.876,"5min":1.024,"15min":1.024},"last":0.54000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575754,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311636,"kb_used_data":2252,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060204,"statfs":{"total":96636764160,"available":96317648896,"internally_reserved":0,"allocated":2306048,"data_stored":1172687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.39500000000000002,"15min":0.40100000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.25700000000000001},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.71699999999999997},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68999999999999995,"5min":0.70599999999999996,"15min":0.751},"last":0.379}]},{"osd":1,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.443,"15min":0.44900000000000001},"min":{"1min":0.33500000000000002,"5min":0.309,"15min":0.29299999999999998},"max":{"1min":0.68700000000000006,"5min":0.755,"15min":0.755},"last":0.437},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.32300000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.81799999999999995},"last":0.42699999999999999}]},{"osd":3,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39500000000000002,"15min":0.40699999999999997},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.76000000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.308,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.75800000000000001},"last":0.314}]},{"osd":4,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.626,"15min":0.63400000000000001},"min":{"1min":0.44900000000000001,"5min":0.42199999999999999,"15min":0.40100000000000002},"max":{"1min":0.88800000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60699999999999998,"15min":0.61899999999999999},"min":{"1min":0.42199999999999999,"5min":0.40999999999999998,"15min":0.377},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.94999999999999996},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63300000000000001,"15min":0.64400000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.97399999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64700000000000002,"15min":0.64800000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85599999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.628,"15min":0.63800000000000001},"min":{"1min":0.46200000000000002,"5min":0.434,"15min":0.41099999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.97799999999999998},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67000000000000004,"15min":0.67300000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67300000000000004,"15min":0.68799999999999994},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46000000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.96599999999999997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.504,"5min":0.49199999999999999,"15min":0.46200000000000002},"max":{"1min":0.97199999999999998,"5min":0.995,"15min":1.014},"last":0.68600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575754,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315724,"kb_used_data":2244,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94056116,"statfs":{"total":96636764160,"available":96313462784,"internally_reserved":0,"allocated":2297856,"data_stored":1172539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38500000000000001,"15min":0.375},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.311},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.41199999999999998,"15min":0.40899999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.59299999999999997,"5min":0.61099999999999999,"15min":0.66200000000000003},"last":0.32900000000000001}]},{"osd":1,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.40999999999999998,"15min":0.39700000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44800000000000001,"15min":0.441},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.28699999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.26100000000000001}]},{"osd":2,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.47699999999999998,"15min":0.46899999999999997},"min":{"1min":0.35099999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58299999999999996,"5min":0.70899999999999996,"15min":0.71599999999999997},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52000000000000002,"15min":0.51500000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73199999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63200000000000001,"15min":0.63500000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92800000000000005,"5min":1.081,"15min":1.081},"last":0.436},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64900000000000002,"15min":0.63800000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.64300000000000002,"15min":0.63500000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67100000000000004,"15min":0.66200000000000003},"min":{"1min":0.47399999999999998,"5min":0.46200000000000002,"15min":0.42399999999999999},"max":{"1min":0.99199999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.52300000000000002}]},{"osd":6,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68600000000000005,"15min":0.67900000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.40100000000000002},"max":{"1min":0.96999999999999997,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48599999999999999,"5min":0.47099999999999997,"15min":0.41499999999999998},"max":{"1min":0.84299999999999997,"5min":1.206,"15min":1.206},"last":0.48499999999999999}]},{"osd":7,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.44800000000000001},"max":{"1min":0.98599999999999999,"5min":1.131,"15min":1.131},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70599999999999996,"15min":0.69499999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.44800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303384,"kb_used_data":2192,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068456,"statfs":{"total":96636764160,"available":96326098944,"internally_reserved":0,"allocated":2244608,"data_stored":1145498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54200000000000004,"15min":0.55400000000000005},"min":{"1min":0.31900000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77200000000000002,"5min":0.80600000000000005,"15min":0.94799999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.26900000000000002},"max":{"1min":0.71399999999999997,"5min":0.82599999999999996,"15min":0.83699999999999997},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54800000000000004,"15min":0.55100000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79200000000000004,"5min":0.92400000000000004,"15min":1.006},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56200000000000006,"15min":0.56399999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70999999999999996,"5min":0.79300000000000004,"15min":0.82299999999999995},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57799999999999996,"15min":0.58699999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35499999999999998},"max":{"1min":0.68700000000000006,"5min":0.82399999999999995,"15min":0.85299999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.59999999999999998,"15min":0.61499999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70099999999999996,"5min":0.95299999999999996,"15min":1.0429999999999999},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54400000000000004,"15min":0.55100000000000005},"min":{"1min":0.35799999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69399999999999995,"5min":0.78100000000000003,"15min":0.79900000000000004},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73899999999999999,"5min":0.79600000000000004,"15min":1.1679999999999999},"last":0.623}]},{"osd":5,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.27600000000000002},"max":{"1min":0.58399999999999996,"5min":0.71099999999999997,"15min":0.80700000000000005},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46200000000000002,"15min":0.45900000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.63500000000000001,"5min":0.68100000000000005,"15min":1.3919999999999999},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.50600000000000001,"15min":0.496},"min":{"1min":0.316,"5min":0.316,"15min":0.31},"max":{"1min":0.64800000000000002,"5min":0.83599999999999997,"15min":0.93300000000000005},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54900000000000004,"15min":0.54400000000000004},"min":{"1min":0.41499999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67600000000000005,"5min":0.78100000000000003,"15min":0.92500000000000004},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51300000000000001,"15min":0.51900000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30099999999999999},"max":{"1min":0.70099999999999996,"5min":0.85699999999999998,"15min":1.246},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.41499999999999998,"5min":0.39900000000000002,"15min":0.371},"max":{"1min":0.72299999999999998,"5min":0.88900000000000001,"15min":1.321},"last":0.63800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575754,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307532,"kb_used_data":2244,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064308,"statfs":{"total":96636764160,"available":96321851392,"internally_reserved":0,"allocated":2297856,"data_stored":1173397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.54300000000000004,"15min":0.55000000000000004},"min":{"1min":0.34799999999999998,"5min":0.33400000000000002,"15min":0.30099999999999999},"max":{"1min":0.59999999999999998,"5min":0.73799999999999999,"15min":0.81899999999999995},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.54700000000000004,"15min":0.55000000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.30399999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.59099999999999997}]},{"osd":1,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.34799999999999998,"5min":0.33200000000000002,"15min":0.29499999999999998},"max":{"1min":0.72299999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.55800000000000005,"15min":0.56399999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.69399999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.73999999999999999}]},{"osd":2,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.376,"5min":0.372,"15min":0.35099999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.35299999999999998},"max":{"1min":0.66500000000000004,"5min":0.84999999999999998,"15min":0.876},"last":0.72199999999999998}]},{"osd":3,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.622}]},{"osd":4,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.441,"15min":0.437},"min":{"1min":0.309,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.47399999999999998,"15min":0.46700000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.42799999999999999}]},{"osd":6,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48199999999999998,"15min":0.47899999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55700000000000005,"15min":0.54900000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.313},"max":{"1min":0.73499999999999999,"5min":0.76700000000000002,"15min":0.83499999999999996},"last":0.50600000000000001}]},{"osd":7,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.54300000000000004,"15min":0.52600000000000002},"min":{"1min":0.33300000000000002,"5min":0.313,"15min":0.313},"max":{"1min":3.2240000000000002,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.59099999999999997,"15min":0.57899999999999996},"min":{"1min":0.42999999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":3.1659999999999999,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.51700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T18:23:16.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3c is not active+clean 2023-11-30T18:23:16.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:11.703815+0000', 'last_change': '2023-11-30T18:23:11.703815+0000', 'last_active': '2023-11-30T18:23:11.703815+0000', 'last_peered': '2023-11-30T18:23:11.703815+0000', 'last_clean': '2023-11-30T18:23:11.703815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:11.703815+0000', 'last_undegraded': '2023-11-30T18:23:11.703815+0000', 'last_fullsized': '2023-11-30T18:23:11.703815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3d is not active+clean 2023-11-30T18:23:16.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:10.701569+0000', 'last_change': '2023-11-30T18:23:10.701569+0000', 'last_active': '2023-11-30T18:23:10.701569+0000', 'last_peered': '2023-11-30T18:23:10.701569+0000', 'last_clean': '2023-11-30T18:23:10.701569+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:10.701569+0000', 'last_undegraded': '2023-11-30T18:23:10.701569+0000', 'last_fullsized': '2023-11-30T18:23:10.701569+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3c is not active+clean 2023-11-30T18:23:16.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:10.701569+0000', 'last_change': '2023-11-30T18:23:10.701569+0000', 'last_active': '2023-11-30T18:23:10.701569+0000', 'last_peered': '2023-11-30T18:23:10.701569+0000', 'last_clean': '2023-11-30T18:23:10.701569+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:10.701569+0000', 'last_undegraded': '2023-11-30T18:23:10.701569+0000', 'last_fullsized': '2023-11-30T18:23:10.701569+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.38 is not active+clean 2023-11-30T18:23:16.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:11.703815+0000', 'last_change': '2023-11-30T18:23:11.703815+0000', 'last_active': '2023-11-30T18:23:11.703815+0000', 'last_peered': '2023-11-30T18:23:11.703815+0000', 'last_clean': '2023-11-30T18:23:11.703815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:11.703815+0000', 'last_undegraded': '2023-11-30T18:23:11.703815+0000', 'last_fullsized': '2023-11-30T18:23:11.703815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.34 is not active+clean 2023-11-30T18:23:16.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:11.703815+0000', 'last_change': '2023-11-30T18:23:11.703815+0000', 'last_active': '2023-11-30T18:23:11.703815+0000', 'last_peered': '2023-11-30T18:23:11.703815+0000', 'last_clean': '2023-11-30T18:23:11.703815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:11.703815+0000', 'last_undegraded': '2023-11-30T18:23:11.703815+0000', 'last_fullsized': '2023-11-30T18:23:11.703815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.32 is not active+clean 2023-11-30T18:23:16.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:10.701569+0000', 'last_change': '2023-11-30T18:23:10.701569+0000', 'last_active': '2023-11-30T18:23:10.701569+0000', 'last_peered': '2023-11-30T18:23:10.701569+0000', 'last_clean': '2023-11-30T18:23:10.701569+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:10.701569+0000', 'last_undegraded': '2023-11-30T18:23:10.701569+0000', 'last_fullsized': '2023-11-30T18:23:10.701569+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.32 is not active+clean 2023-11-30T18:23:16.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:11.703815+0000', 'last_change': '2023-11-30T18:23:11.703815+0000', 'last_active': '2023-11-30T18:23:11.703815+0000', 'last_peered': '2023-11-30T18:23:11.703815+0000', 'last_clean': '2023-11-30T18:23:11.703815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:11.703815+0000', 'last_undegraded': '2023-11-30T18:23:11.703815+0000', 'last_fullsized': '2023-11-30T18:23:11.703815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2e is not active+clean 2023-11-30T18:23:16.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:10.701569+0000', 'last_change': '2023-11-30T18:23:10.701569+0000', 'last_active': '2023-11-30T18:23:10.701569+0000', 'last_peered': '2023-11-30T18:23:10.701569+0000', 'last_clean': '2023-11-30T18:23:10.701569+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:10.701569+0000', 'last_undegraded': '2023-11-30T18:23:10.701569+0000', 'last_fullsized': '2023-11-30T18:23:10.701569+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2f is not active+clean 2023-11-30T18:23:16.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:11.703815+0000', 'last_change': '2023-11-30T18:23:11.703815+0000', 'last_active': '2023-11-30T18:23:11.703815+0000', 'last_peered': '2023-11-30T18:23:11.703815+0000', 'last_clean': '2023-11-30T18:23:11.703815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:11.703815+0000', 'last_undegraded': '2023-11-30T18:23:11.703815+0000', 'last_fullsized': '2023-11-30T18:23:11.703815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.29 is not active+clean 2023-11-30T18:23:16.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:11.703815+0000', 'last_change': '2023-11-30T18:23:11.703815+0000', 'last_active': '2023-11-30T18:23:11.703815+0000', 'last_peered': '2023-11-30T18:23:11.703815+0000', 'last_clean': '2023-11-30T18:23:11.703815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:11.703815+0000', 'last_undegraded': '2023-11-30T18:23:11.703815+0000', 'last_fullsized': '2023-11-30T18:23:11.703815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2a is not active+clean 2023-11-30T18:23:16.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:10.701569+0000', 'last_change': '2023-11-30T18:23:10.701569+0000', 'last_active': '2023-11-30T18:23:10.701569+0000', 'last_peered': '2023-11-30T18:23:10.701569+0000', 'last_clean': '2023-11-30T18:23:10.701569+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:10.701569+0000', 'last_undegraded': '2023-11-30T18:23:10.701569+0000', 'last_fullsized': '2023-11-30T18:23:10.701569+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.29 is not active+clean 2023-11-30T18:23:16.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:10.701569+0000', 'last_change': '2023-11-30T18:23:10.701569+0000', 'last_active': '2023-11-30T18:23:10.701569+0000', 'last_peered': '2023-11-30T18:23:10.701569+0000', 'last_clean': '2023-11-30T18:23:10.701569+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:10.701569+0000', 'last_undegraded': '2023-11-30T18:23:10.701569+0000', 'last_fullsized': '2023-11-30T18:23:10.701569+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.20 is not active+clean 2023-11-30T18:23:16.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:11.703815+0000', 'last_change': '2023-11-30T18:23:11.703815+0000', 'last_active': '2023-11-30T18:23:11.703815+0000', 'last_peered': '2023-11-30T18:23:11.703815+0000', 'last_clean': '2023-11-30T18:23:11.703815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:11.703815+0000', 'last_undegraded': '2023-11-30T18:23:11.703815+0000', 'last_fullsized': '2023-11-30T18:23:11.703815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.22 is not active+clean 2023-11-30T18:23:16.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:10.701569+0000', 'last_change': '2023-11-30T18:23:10.701569+0000', 'last_active': '2023-11-30T18:23:10.701569+0000', 'last_peered': '2023-11-30T18:23:10.701569+0000', 'last_clean': '2023-11-30T18:23:10.701569+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:10.701569+0000', 'last_undegraded': '2023-11-30T18:23:10.701569+0000', 'last_fullsized': '2023-11-30T18:23:10.701569+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.23 is not active+clean 2023-11-30T18:23:16.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:11.703815+0000', 'last_change': '2023-11-30T18:23:11.703815+0000', 'last_active': '2023-11-30T18:23:11.703815+0000', 'last_peered': '2023-11-30T18:23:11.703815+0000', 'last_clean': '2023-11-30T18:23:11.703815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:11.703815+0000', 'last_undegraded': '2023-11-30T18:23:11.703815+0000', 'last_fullsized': '2023-11-30T18:23:11.703815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1e is not active+clean 2023-11-30T18:23:16.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:11.703815+0000', 'last_change': '2023-11-30T18:23:11.703815+0000', 'last_active': '2023-11-30T18:23:11.703815+0000', 'last_peered': '2023-11-30T18:23:11.703815+0000', 'last_clean': '2023-11-30T18:23:11.703815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:11.703815+0000', 'last_undegraded': '2023-11-30T18:23:11.703815+0000', 'last_fullsized': '2023-11-30T18:23:11.703815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1b is not active+clean 2023-11-30T18:23:16.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:10.701569+0000', 'last_change': '2023-11-30T18:23:10.701569+0000', 'last_active': '2023-11-30T18:23:10.701569+0000', 'last_peered': '2023-11-30T18:23:10.701569+0000', 'last_clean': '2023-11-30T18:23:10.701569+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:10.701569+0000', 'last_undegraded': '2023-11-30T18:23:10.701569+0000', 'last_fullsized': '2023-11-30T18:23:10.701569+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.19 is not active+clean 2023-11-30T18:23:16.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:11.703815+0000', 'last_change': '2023-11-30T18:23:11.703815+0000', 'last_active': '2023-11-30T18:23:11.703815+0000', 'last_peered': '2023-11-30T18:23:11.703815+0000', 'last_clean': '2023-11-30T18:23:11.703815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:11.703815+0000', 'last_undegraded': '2023-11-30T18:23:11.703815+0000', 'last_fullsized': '2023-11-30T18:23:11.703815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.c is not active+clean 2023-11-30T18:23:16.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:10.701569+0000', 'last_change': '2023-11-30T18:23:10.701569+0000', 'last_active': '2023-11-30T18:23:10.701569+0000', 'last_peered': '2023-11-30T18:23:10.701569+0000', 'last_clean': '2023-11-30T18:23:10.701569+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:10.701569+0000', 'last_undegraded': '2023-11-30T18:23:10.701569+0000', 'last_fullsized': '2023-11-30T18:23:10.701569+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.a is not active+clean 2023-11-30T18:23:16.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:10.701569+0000', 'last_change': '2023-11-30T18:23:10.701569+0000', 'last_active': '2023-11-30T18:23:10.701569+0000', 'last_peered': '2023-11-30T18:23:10.701569+0000', 'last_clean': '2023-11-30T18:23:10.701569+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:10.701569+0000', 'last_undegraded': '2023-11-30T18:23:10.701569+0000', 'last_fullsized': '2023-11-30T18:23:10.701569+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.8 is not active+clean 2023-11-30T18:23:16.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:10.701569+0000', 'last_change': '2023-11-30T18:23:10.701569+0000', 'last_active': '2023-11-30T18:23:10.701569+0000', 'last_peered': '2023-11-30T18:23:10.701569+0000', 'last_clean': '2023-11-30T18:23:10.701569+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:10.701569+0000', 'last_undegraded': '2023-11-30T18:23:10.701569+0000', 'last_fullsized': '2023-11-30T18:23:10.701569+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.7 is not active+clean 2023-11-30T18:23:16.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:10.701569+0000', 'last_change': '2023-11-30T18:23:10.701569+0000', 'last_active': '2023-11-30T18:23:10.701569+0000', 'last_peered': '2023-11-30T18:23:10.701569+0000', 'last_clean': '2023-11-30T18:23:10.701569+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:10.701569+0000', 'last_undegraded': '2023-11-30T18:23:10.701569+0000', 'last_fullsized': '2023-11-30T18:23:10.701569+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.5 is not active+clean 2023-11-30T18:23:16.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:11.703815+0000', 'last_change': '2023-11-30T18:23:11.703815+0000', 'last_active': '2023-11-30T18:23:11.703815+0000', 'last_peered': '2023-11-30T18:23:11.703815+0000', 'last_clean': '2023-11-30T18:23:11.703815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:11.703815+0000', 'last_undegraded': '2023-11-30T18:23:11.703815+0000', 'last_fullsized': '2023-11-30T18:23:11.703815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.0 is not active+clean 2023-11-30T18:23:16.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:11.703815+0000', 'last_change': '2023-11-30T18:23:11.703815+0000', 'last_active': '2023-11-30T18:23:11.703815+0000', 'last_peered': '2023-11-30T18:23:11.703815+0000', 'last_clean': '2023-11-30T18:23:11.703815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:11.703815+0000', 'last_undegraded': '2023-11-30T18:23:11.703815+0000', 'last_fullsized': '2023-11-30T18:23:11.703815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1 is not active+clean 2023-11-30T18:23:16.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:11.703815+0000', 'last_change': '2023-11-30T18:23:11.703815+0000', 'last_active': '2023-11-30T18:23:11.703815+0000', 'last_peered': '2023-11-30T18:23:11.703815+0000', 'last_clean': '2023-11-30T18:23:11.703815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:11.703815+0000', 'last_undegraded': '2023-11-30T18:23:11.703815+0000', 'last_fullsized': '2023-11-30T18:23:11.703815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3 is not active+clean 2023-11-30T18:23:16.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:11.703815+0000', 'last_change': '2023-11-30T18:23:11.703815+0000', 'last_active': '2023-11-30T18:23:11.703815+0000', 'last_peered': '2023-11-30T18:23:11.703815+0000', 'last_clean': '2023-11-30T18:23:11.703815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:11.703815+0000', 'last_undegraded': '2023-11-30T18:23:11.703815+0000', 'last_fullsized': '2023-11-30T18:23:11.703815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.10 is not active+clean 2023-11-30T18:23:16.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:11.703815+0000', 'last_change': '2023-11-30T18:23:11.703815+0000', 'last_active': '2023-11-30T18:23:11.703815+0000', 'last_peered': '2023-11-30T18:23:11.703815+0000', 'last_clean': '2023-11-30T18:23:11.703815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:11.703815+0000', 'last_undegraded': '2023-11-30T18:23:11.703815+0000', 'last_fullsized': '2023-11-30T18:23:11.703815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.17 is not active+clean 2023-11-30T18:23:16.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:11.703815+0000', 'last_change': '2023-11-30T18:23:11.703815+0000', 'last_active': '2023-11-30T18:23:11.703815+0000', 'last_peered': '2023-11-30T18:23:11.703815+0000', 'last_clean': '2023-11-30T18:23:11.703815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:11.703815+0000', 'last_undegraded': '2023-11-30T18:23:11.703815+0000', 'last_fullsized': '2023-11-30T18:23:11.703815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.14 is not active+clean 2023-11-30T18:23:16.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:11.703815+0000', 'last_change': '2023-11-30T18:23:11.703815+0000', 'last_active': '2023-11-30T18:23:11.703815+0000', 'last_peered': '2023-11-30T18:23:11.703815+0000', 'last_clean': '2023-11-30T18:23:11.703815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:11.703815+0000', 'last_undegraded': '2023-11-30T18:23:11.703815+0000', 'last_fullsized': '2023-11-30T18:23:11.703815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:11.703815+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.12 is not active+clean 2023-11-30T18:23:16.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:10.701569+0000', 'last_change': '2023-11-30T18:23:10.701569+0000', 'last_active': '2023-11-30T18:23:10.701569+0000', 'last_peered': '2023-11-30T18:23:10.701569+0000', 'last_clean': '2023-11-30T18:23:10.701569+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:10.701569+0000', 'last_undegraded': '2023-11-30T18:23:10.701569+0000', 'last_fullsized': '2023-11-30T18:23:10.701569+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.11 is not active+clean 2023-11-30T18:23:16.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:23:10.701569+0000', 'last_change': '2023-11-30T18:23:10.701569+0000', 'last_active': '2023-11-30T18:23:10.701569+0000', 'last_peered': '2023-11-30T18:23:10.701569+0000', 'last_clean': '2023-11-30T18:23:10.701569+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:23:10.701569+0000', 'last_undegraded': '2023-11-30T18:23:10.701569+0000', 'last_fullsized': '2023-11-30T18:23:10.701569+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'last_clean_scrub_stamp': '2023-11-30T18:23:10.701569+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:23:16.893 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-30T18:23:17.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.036+0000 7f93dc753700 1 Processor -- start 2023-11-30T18:23:17.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.036+0000 7f93dc753700 1 -- start start 2023-11-30T18:23:17.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.037+0000 7f93dc753700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f93d40caab0 0x7f93d40aa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:17.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.037+0000 7f93dc753700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f93d40ca180 0x7f93d415e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:17.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.037+0000 7f93dc753700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93d40a9a90 con 0x7f93d40cae90 2023-11-30T18:23:17.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.037+0000 7f93dc753700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d4154ce0 con 0x7f93d40caab0 2023-11-30T18:23:17.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.037+0000 7f93dc753700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d40a8e80 con 0x7f93d40ca180 2023-11-30T18:23:17.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.037+0000 7f93da4ef700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f93d40caab0 0x7f93d40aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:17.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.037+0000 7f93d9cee700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f93d40cae90 0x7f93d40c0ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39086/0 (socket says 172.21.15.49:39086) 2023-11-30T18:23:17.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.037+0000 7f93d9cee700 1 -- 172.21.15.49:0/1372752129 learned_addr learned my addr 172.21.15.49:0/1372752129 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:23:17.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.038+0000 7f93dacf0700 1 --2- 172.21.15.49:0/1372752129 >> v2:172.21.15.115:3300/0 conn(0x7f93d40ca180 0x7f93d415e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:17.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.038+0000 7f93d94ed700 1 -- 172.21.15.49:0/1372752129 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 380248892 0 0) 0x7f93d40a9a90 con 0x7f93d40cae90 2023-11-30T18:23:17.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.038+0000 7f93d94ed700 1 -- 172.21.15.49:0/1372752129 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93bc0033f0 con 0x7f93d40cae90 2023-11-30T18:23:17.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.038+0000 7f93da4ef700 1 -- 172.21.15.49:0/1372752129 >> v2:172.21.15.115:3300/0 conn(0x7f93d40ca180 msgr2=0x7f93d415e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:17.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.038+0000 7f93da4ef700 1 --2- 172.21.15.49:0/1372752129 >> v2:172.21.15.115:3300/0 conn(0x7f93d40ca180 0x7f93d415e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:17.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.038+0000 7f93da4ef700 1 -- 172.21.15.49:0/1372752129 >> v1:172.21.15.49:6789/0 conn(0x7f93d40cae90 legacy=0x7f93d40c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:17.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.038+0000 7f93da4ef700 1 -- 172.21.15.49:0/1372752129 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d40a9160 con 0x7f93d40caab0 2023-11-30T18:23:17.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.038+0000 7f93da4ef700 1 --2- 172.21.15.49:0/1372752129 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93d40caab0 0x7f93d40aa470 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7f93d40a9a00 tx=0x7f93cc006f40).ready entity=mon.0 client_cookie=aac88ec5ff0b539b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:17.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.038+0000 7f93d94ed700 1 -- 172.21.15.49:0/1372752129 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc005880 con 0x7f93d40caab0 2023-11-30T18:23:17.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.038+0000 7f93d94ed700 1 -- 172.21.15.49:0/1372752129 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93cc0059e0 con 0x7f93d40caab0 2023-11-30T18:23:17.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.038+0000 7f93d94ed700 1 -- 172.21.15.49:0/1372752129 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc005d60 con 0x7f93d40caab0 2023-11-30T18:23:17.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.039+0000 7f93dc753700 1 -- 172.21.15.49:0/1372752129 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93d40caab0 msgr2=0x7f93d40aa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:17.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.039+0000 7f93dc753700 1 --2- 172.21.15.49:0/1372752129 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93d40caab0 0x7f93d40aa470 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7f93d40a9a00 tx=0x7f93cc006f40).stop 2023-11-30T18:23:17.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.039+0000 7f93dc753700 1 -- 172.21.15.49:0/1372752129 shutdown_connections 2023-11-30T18:23:17.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.039+0000 7f93dc753700 1 --2- 172.21.15.49:0/1372752129 >> v2:172.21.15.115:3300/0 conn(0x7f93d40ca180 0x7f93d415e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:17.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.039+0000 7f93dc753700 1 --2- 172.21.15.49:0/1372752129 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93d40caab0 0x7f93d40aa470 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:17.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.039+0000 7f93dc753700 1 -- 172.21.15.49:0/1372752129 >> 172.21.15.49:0/1372752129 conn(0x7f93d4094920 msgr2=0x7f93d406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:17.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.039+0000 7f93dc753700 1 -- 172.21.15.49:0/1372752129 shutdown_connections 2023-11-30T18:23:17.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.039+0000 7f93dc753700 1 -- 172.21.15.49:0/1372752129 wait complete. 2023-11-30T18:23:17.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.040+0000 7f93dc753700 1 Processor -- start 2023-11-30T18:23:17.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.040+0000 7f93dc753700 1 -- start start 2023-11-30T18:23:17.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.041+0000 7f93dc753700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93d40ca180 0x7f93d40aba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:17.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.041+0000 7f93dc753700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93d40caab0 0x7f93d40abf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:17.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.041+0000 7f93dc753700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93d40cae90 0x7f93d40c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:17.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.041+0000 7f93dc753700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d40ad2e0 con 0x7f93d40cae90 2023-11-30T18:23:17.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.041+0000 7f93dc753700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d40ac460 con 0x7f93d40caab0 2023-11-30T18:23:17.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.041+0000 7f93dc753700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d40ac6d0 con 0x7f93d40ca180 2023-11-30T18:23:17.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.041+0000 7f93dacf0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93d40cae90 0x7f93d40c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:17.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.041+0000 7f93dacf0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93d40cae90 0x7f93d40c72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46050/0 (socket says 172.21.15.49:46050) 2023-11-30T18:23:17.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.041+0000 7f93dacf0700 1 -- 172.21.15.49:0/3909927860 learned_addr learned my addr 172.21.15.49:0/3909927860 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:17.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.041+0000 7f93d9cee700 1 --2- 172.21.15.49:0/3909927860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93d40caab0 0x7f93d40abf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:17.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.041+0000 7f93da4ef700 1 --2- 172.21.15.49:0/3909927860 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93d40ca180 0x7f93d40aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:17.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.041+0000 7f93dacf0700 1 -- 172.21.15.49:0/3909927860 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93d40ca180 msgr2=0x7f93d40aba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:17.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.041+0000 7f93dacf0700 1 --2- 172.21.15.49:0/3909927860 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93d40ca180 0x7f93d40aba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:17.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.041+0000 7f93dacf0700 1 -- 172.21.15.49:0/3909927860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93d40caab0 msgr2=0x7f93d40abf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:17.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.041+0000 7f93dacf0700 1 --2- 172.21.15.49:0/3909927860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93d40caab0 0x7f93d40abf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:17.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.041+0000 7f93dacf0700 1 -- 172.21.15.49:0/3909927860 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93cc009250 con 0x7f93d40cae90 2023-11-30T18:23:17.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.041+0000 7f93dacf0700 1 --2- 172.21.15.49:0/3909927860 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93d40cae90 0x7f93d40c72b0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7f93c4009e90 tx=0x7f93c400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:17.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.041+0000 7f93d27fc700 1 -- 172.21.15.49:0/3909927860 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c400caa0 con 0x7f93d40cae90 2023-11-30T18:23:17.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.041+0000 7f93d27fc700 1 -- 172.21.15.49:0/3909927860 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c400f040 con 0x7f93d40cae90 2023-11-30T18:23:17.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.041+0000 7f93dc753700 1 -- 172.21.15.49:0/3909927860 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d40ac9b0 con 0x7f93d40cae90 2023-11-30T18:23:17.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.041+0000 7f93d27fc700 1 -- 172.21.15.49:0/3909927860 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c400ce10 con 0x7f93d40cae90 2023-11-30T18:23:17.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.041+0000 7f93dc753700 1 -- 172.21.15.49:0/3909927860 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d40acf70 con 0x7f93d40cae90 2023-11-30T18:23:17.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.042+0000 7f93dc753700 1 -- 172.21.15.49:0/3909927860 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d406c860 con 0x7f93d40cae90 2023-11-30T18:23:17.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.043+0000 7f93d27fc700 1 -- 172.21.15.49:0/3909927860 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f93c4013610 con 0x7f93d40cae90 2023-11-30T18:23:17.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.043+0000 7f93d27fc700 1 --2- 172.21.15.49:0/3909927860 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f93c005f270 0x7f93c0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:17.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.043+0000 7f93d27fc700 1 -- 172.21.15.49:0/3909927860 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f93c407ac40 con 0x7f93d40cae90 2023-11-30T18:23:17.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.043+0000 7f93da4ef700 1 --2- 172.21.15.49:0/3909927860 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f93c005f270 0x7f93c0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:17.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.044+0000 7f93da4ef700 1 --2- 172.21.15.49:0/3909927860 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f93c005f270 0x7f93c0061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f93cc005fd0 tx=0x7f93cc015000).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:17.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.047+0000 7f93d27fc700 1 -- 172.21.15.49:0/3909927860 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f93c4080020 con 0x7f93d40cae90 2023-11-30T18:23:17.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.293+0000 7f93dc753700 1 -- 172.21.15.49:0/3909927860 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f93d40ad420 con 0x7f93d40cae90 2023-11-30T18:23:17.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.293+0000 7f93d27fc700 1 -- 172.21.15.49:0/3909927860 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3228 (secure 0 0 0) 0x7f93c404f780 con 0x7f93d40cae90 2023-11-30T18:23:17.294 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:23:17.294 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":4579,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":184,"num_osds":8,"num_up_osds":8,"osd_up_since":1701364027,"num_in_osds":8,"osd_in_since":1701364021,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":106},{"state_name":"unknown","count":31}],"num_pgs":137,"num_pools":4,"num_objects":19,"data_bytes":2306,"bytes_used":2523422720,"bytes_avail":770570690560,"bytes_total":773094113280,"unknown_pgs_ratio":0.22627736628055573},"fsmap":{"epoch":77,"id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":8937}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":16,"modified":"2023-11-30T18:22:27.997510+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-30T18:23:17.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.295+0000 7f93dc753700 1 -- 172.21.15.49:0/3909927860 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f93c005f270 msgr2=0x7f93c0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:17.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.295+0000 7f93dc753700 1 --2- 172.21.15.49:0/3909927860 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f93c005f270 0x7f93c0061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f93cc005fd0 tx=0x7f93cc015000).stop 2023-11-30T18:23:17.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.295+0000 7f93dc753700 1 -- 172.21.15.49:0/3909927860 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93d40cae90 msgr2=0x7f93d40c72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:17.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.295+0000 7f93dc753700 1 --2- 172.21.15.49:0/3909927860 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93d40cae90 0x7f93d40c72b0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7f93c4009e90 tx=0x7f93c400b040).stop 2023-11-30T18:23:17.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.295+0000 7f93dc753700 1 -- 172.21.15.49:0/3909927860 shutdown_connections 2023-11-30T18:23:17.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.295+0000 7f93dc753700 1 --2- 172.21.15.49:0/3909927860 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f93c005f270 0x7f93c0061730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:17.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.295+0000 7f93dc753700 1 --2- 172.21.15.49:0/3909927860 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93d40cae90 0x7f93d40c72b0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:17.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.295+0000 7f93dc753700 1 --2- 172.21.15.49:0/3909927860 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93d40ca180 0x7f93d40aba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:17.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.295+0000 7f93dc753700 1 --2- 172.21.15.49:0/3909927860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93d40caab0 0x7f93d40abf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:17.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.295+0000 7f93dc753700 1 -- 172.21.15.49:0/3909927860 >> 172.21.15.49:0/3909927860 conn(0x7f93d4094920 msgr2=0x7f93d40b00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:17.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.295+0000 7f93dc753700 1 -- 172.21.15.49:0/3909927860 shutdown_connections 2023-11-30T18:23:17.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.295+0000 7f93dc753700 1 -- 172.21.15.49:0/3909927860 wait complete. 2023-11-30T18:23:17.308 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-30T18:23:17.308 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T18:23:17.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.424+0000 7fdc9ea21700 1 Processor -- start 2023-11-30T18:23:17.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.424+0000 7fdc9ea21700 1 -- start start 2023-11-30T18:23:17.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.425+0000 7fdc9ea21700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdc980cae90 0x7fdc980c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:17.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.425+0000 7fdc9ea21700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc980a9a90 con 0x7fdc980caab0 2023-11-30T18:23:17.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.425+0000 7fdc9ea21700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc98154ce0 con 0x7fdc980ca180 2023-11-30T18:23:17.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.425+0000 7fdc9ea21700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc980aab80 con 0x7fdc980cae90 2023-11-30T18:23:17.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.425+0000 7fdc977fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdc980cae90 0x7fdc980c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:17.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.425+0000 7fdc97fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdc980caab0 0x7fdc980aa470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39102/0 (socket says 172.21.15.49:39102) 2023-11-30T18:23:17.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.425+0000 7fdc97fff700 1 -- 172.21.15.49:0/3938588605 learned_addr learned my addr 172.21.15.49:0/3938588605 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:23:17.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.426+0000 7fdc977fe700 1 -- 172.21.15.49:0/3938588605 >> v1:172.21.15.115:6789/0 conn(0x7fdc980ca180 legacy=0x7fdc9815e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:17.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.426+0000 7fdc977fe700 1 -- 172.21.15.49:0/3938588605 >> v1:172.21.15.49:6789/0 conn(0x7fdc980caab0 legacy=0x7fdc980aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:17.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.426+0000 7fdc96ffd700 1 -- 172.21.15.49:0/3938588605 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3804168996 0 0) 0x7fdc980a9a90 con 0x7fdc980caab0 2023-11-30T18:23:17.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.426+0000 7fdc977fe700 1 -- 172.21.15.49:0/3938588605 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc980a8e80 con 0x7fdc980cae90 2023-11-30T18:23:17.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.426+0000 7fdc977fe700 1 --2- 172.21.15.49:0/3938588605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc980cae90 0x7fdc980c0ab0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7fdc8c009760 tx=0x7fdc8c009060).ready entity=mon.0 client_cookie=4023a18b45f81b91 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:17.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.426+0000 7fdc96ffd700 1 -- 172.21.15.49:0/3938588605 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c00b580 con 0x7fdc980cae90 2023-11-30T18:23:17.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.426+0000 7fdc96ffd700 1 -- 172.21.15.49:0/3938588605 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8c00b6e0 con 0x7fdc980cae90 2023-11-30T18:23:17.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.426+0000 7fdc96ffd700 1 -- 172.21.15.49:0/3938588605 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c00ba60 con 0x7fdc980cae90 2023-11-30T18:23:17.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.426+0000 7fdc9ea21700 1 -- 172.21.15.49:0/3938588605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc980cae90 msgr2=0x7fdc980c0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:17.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.426+0000 7fdc9ea21700 1 --2- 172.21.15.49:0/3938588605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc980cae90 0x7fdc980c0ab0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7fdc8c009760 tx=0x7fdc8c009060).stop 2023-11-30T18:23:17.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.426+0000 7fdc9ea21700 1 -- 172.21.15.49:0/3938588605 shutdown_connections 2023-11-30T18:23:17.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.426+0000 7fdc9ea21700 1 --2- 172.21.15.49:0/3938588605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc980cae90 0x7fdc980c0ab0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:17.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.426+0000 7fdc9ea21700 1 -- 172.21.15.49:0/3938588605 >> 172.21.15.49:0/3938588605 conn(0x7fdc98094920 msgr2=0x7fdc9806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:17.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.427+0000 7fdc9ea21700 1 -- 172.21.15.49:0/3938588605 shutdown_connections 2023-11-30T18:23:17.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.427+0000 7fdc9ea21700 1 -- 172.21.15.49:0/3938588605 wait complete. 2023-11-30T18:23:17.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.428+0000 7fdc9ea21700 1 Processor -- start 2023-11-30T18:23:17.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.428+0000 7fdc9ea21700 1 -- start start 2023-11-30T18:23:17.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.429+0000 7fdc9ea21700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc980ca180 0x7fdc981584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:17.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.429+0000 7fdc9ea21700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc980caab0 0x7fdc980c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:17.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.429+0000 7fdc9ea21700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc980cae90 0x7fdc980c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:17.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.429+0000 7fdc9ea21700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc980c4c70 con 0x7fdc980cae90 2023-11-30T18:23:17.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.429+0000 7fdc9ea21700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc980c9fc0 con 0x7fdc980caab0 2023-11-30T18:23:17.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.429+0000 7fdc9ea21700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc980c43d0 con 0x7fdc980ca180 2023-11-30T18:23:17.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.429+0000 7fdc9cfbe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc980cae90 0x7fdc980c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:17.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.429+0000 7fdc9cfbe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc980cae90 0x7fdc980c9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46056/0 (socket says 172.21.15.49:46056) 2023-11-30T18:23:17.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.429+0000 7fdc9cfbe700 1 -- 172.21.15.49:0/3000873944 learned_addr learned my addr 172.21.15.49:0/3000873944 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:17.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.429+0000 7fdc97fff700 1 --2- 172.21.15.49:0/3000873944 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc980ca180 0x7fdc981584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:17.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.429+0000 7fdc977fe700 1 --2- 172.21.15.49:0/3000873944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc980caab0 0x7fdc980c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:17.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.429+0000 7fdc9cfbe700 1 -- 172.21.15.49:0/3000873944 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc980ca180 msgr2=0x7fdc981584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:17.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.429+0000 7fdc9cfbe700 1 --2- 172.21.15.49:0/3000873944 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc980ca180 0x7fdc981584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:17.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.429+0000 7fdc9cfbe700 1 -- 172.21.15.49:0/3000873944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc980caab0 msgr2=0x7fdc980c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:17.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.429+0000 7fdc9cfbe700 1 --2- 172.21.15.49:0/3000873944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc980caab0 0x7fdc980c95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:17.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.429+0000 7fdc9cfbe700 1 -- 172.21.15.49:0/3000873944 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8c0092a0 con 0x7fdc980cae90 2023-11-30T18:23:17.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.429+0000 7fdc9cfbe700 1 --2- 172.21.15.49:0/3000873944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc980cae90 0x7fdc980c9ad0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7fdc90002230 tx=0x7fdc900015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:17.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.429+0000 7fdc7ffff700 1 -- 172.21.15.49:0/3000873944 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9000e4a0 con 0x7fdc980cae90 2023-11-30T18:23:17.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.430+0000 7fdc7ffff700 1 -- 172.21.15.49:0/3000873944 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9000e600 con 0x7fdc980cae90 2023-11-30T18:23:17.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.430+0000 7fdc9ea21700 1 -- 172.21.15.49:0/3000873944 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc980c46b0 con 0x7fdc980cae90 2023-11-30T18:23:17.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.430+0000 7fdc7ffff700 1 -- 172.21.15.49:0/3000873944 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9000e980 con 0x7fdc980cae90 2023-11-30T18:23:17.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.430+0000 7fdc9ea21700 1 -- 172.21.15.49:0/3000873944 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc98165850 con 0x7fdc980cae90 2023-11-30T18:23:17.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.431+0000 7fdc9ea21700 1 -- 172.21.15.49:0/3000873944 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc98165a70 con 0x7fdc980cae90 2023-11-30T18:23:17.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.431+0000 7fdc7ffff700 1 -- 172.21.15.49:0/3000873944 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fdc9001b3b0 con 0x7fdc980cae90 2023-11-30T18:23:17.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.431+0000 7fdc7ffff700 1 --2- 172.21.15.49:0/3000873944 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdc8405f270 0x7fdc84061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:17.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.431+0000 7fdc7ffff700 1 -- 172.21.15.49:0/3000873944 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fdc90079a10 con 0x7fdc980cae90 2023-11-30T18:23:17.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.431+0000 7fdc97fff700 1 --2- 172.21.15.49:0/3000873944 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdc8405f270 0x7fdc84061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:17.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.432+0000 7fdc97fff700 1 --2- 172.21.15.49:0/3000873944 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdc8405f270 0x7fdc84061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fdc88007fd0 tx=0x7fdc88009040).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:17.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.436+0000 7fdc7ffff700 1 -- 172.21.15.49:0/3000873944 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdc90048b00 con 0x7fdc980cae90 2023-11-30T18:23:17.569 INFO:tasks.ceph.mds.a.smithi049.stderr:2023-11-30T18:23:17.568+0000 7f85881a4700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-30T18:23:17.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.603+0000 7fdc9ea21700 1 -- 172.21.15.49:0/3000873944 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdc9806c860 con 0x7fdc8405f270 2023-11-30T18:23:17.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.613+0000 7fdc7ffff700 1 -- 172.21.15.49:0/3000873944 <== mgr.7394 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362329 (secure 0 0 0) 0x7fdc9806c860 con 0x7fdc8405f270 2023-11-30T18:23:17.618 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:23:17.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.616+0000 7fdc9ea21700 1 -- 172.21.15.49:0/3000873944 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdc8405f270 msgr2=0x7fdc84061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:17.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.616+0000 7fdc9ea21700 1 --2- 172.21.15.49:0/3000873944 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdc8405f270 0x7fdc84061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fdc88007fd0 tx=0x7fdc88009040).stop 2023-11-30T18:23:17.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.616+0000 7fdc9ea21700 1 -- 172.21.15.49:0/3000873944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc980cae90 msgr2=0x7fdc980c9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:17.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.616+0000 7fdc9ea21700 1 --2- 172.21.15.49:0/3000873944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc980cae90 0x7fdc980c9ad0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7fdc90002230 tx=0x7fdc900015e0).stop 2023-11-30T18:23:17.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.617+0000 7fdc9ea21700 1 -- 172.21.15.49:0/3000873944 shutdown_connections 2023-11-30T18:23:17.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.617+0000 7fdc9ea21700 1 --2- 172.21.15.49:0/3000873944 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fdc8405f270 0x7fdc84061730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:17.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.617+0000 7fdc9ea21700 1 --2- 172.21.15.49:0/3000873944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc980cae90 0x7fdc980c9ad0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:17.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.617+0000 7fdc9ea21700 1 --2- 172.21.15.49:0/3000873944 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc980ca180 0x7fdc981584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:17.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.617+0000 7fdc9ea21700 1 --2- 172.21.15.49:0/3000873944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc980caab0 0x7fdc980c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:17.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.617+0000 7fdc9ea21700 1 -- 172.21.15.49:0/3000873944 >> 172.21.15.49:0/3000873944 conn(0x7fdc98094920 msgr2=0x7fdc980aba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:17.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.617+0000 7fdc9ea21700 1 -- 172.21.15.49:0/3000873944 shutdown_connections 2023-11-30T18:23:17.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:17.617+0000 7fdc9ea21700 1 -- 172.21.15.49:0/3000873944 wait complete. 2023-11-30T18:23:17.622 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T18:23:17.629 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-30T18:23:17.227813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":221,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2464384,"kb_used_data":17984,"kb_used_omap":0,"kb_used_meta":2446336,"kb_avail":752510336,"statfs":{"total":773094113280,"available":770570584064,"internally_reserved":0,"allocated":18415616,"data_stored":9384652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2505048064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13567,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-61,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.004148"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128500+0000","last_change":"2023-11-30T18:23:12.121637+0000","last_active":"2023-11-30T18:23:12.128500+0000","last_peered":"2023-11-30T18:23:12.128500+0000","last_clean":"2023-11-30T18:23:12.128500+0000","last_became_active":"2023-11-30T18:23:12.121177+0000","last_became_peered":"2023-11-30T18:23:12.121177+0000","last_unstale":"2023-11-30T18:23:12.128500+0000","last_undegraded":"2023-11-30T18:23:12.128500+0000","last_fullsized":"2023-11-30T18:23:12.128500+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3f","version":"183'3","reported_seq":13,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120488+0000","last_change":"2023-11-30T18:23:11.729396+0000","last_active":"2023-11-30T18:23:12.120488+0000","last_peered":"2023-11-30T18:23:12.120488+0000","last_clean":"2023-11-30T18:23:12.120488+0000","last_became_active":"2023-11-30T18:23:11.729108+0000","last_became_peered":"2023-11-30T18:23:11.729108+0000","last_unstale":"2023-11-30T18:23:12.120488+0000","last_undegraded":"2023-11-30T18:23:12.120488+0000","last_fullsized":"2023-11-30T18:23:12.120488+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120073+0000","last_change":"2023-11-30T18:23:12.118530+0000","last_active":"2023-11-30T18:23:12.120073+0000","last_peered":"2023-11-30T18:23:12.120073+0000","last_clean":"2023-11-30T18:23:12.120073+0000","last_became_active":"2023-11-30T18:23:12.118224+0000","last_became_peered":"2023-11-30T18:23:12.118224+0000","last_unstale":"2023-11-30T18:23:12.120073+0000","last_undegraded":"2023-11-30T18:23:12.120073+0000","last_fullsized":"2023-11-30T18:23:12.120073+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.104272+0000","last_change":"2023-11-30T18:23:11.724379+0000","last_active":"2023-11-30T18:23:12.104272+0000","last_peered":"2023-11-30T18:23:12.104272+0000","last_clean":"2023-11-30T18:23:12.104272+0000","last_became_active":"2023-11-30T18:23:11.724081+0000","last_became_peered":"2023-11-30T18:23:11.724081+0000","last_unstale":"2023-11-30T18:23:12.104272+0000","last_undegraded":"2023-11-30T18:23:12.104272+0000","last_fullsized":"2023-11-30T18:23:12.104272+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112554+0000","last_change":"2023-11-30T18:23:12.108411+0000","last_active":"2023-11-30T18:23:12.112554+0000","last_peered":"2023-11-30T18:23:12.112554+0000","last_clean":"2023-11-30T18:23:12.112554+0000","last_became_active":"2023-11-30T18:23:12.108120+0000","last_became_peered":"2023-11-30T18:23:12.108120+0000","last_unstale":"2023-11-30T18:23:12.112554+0000","last_undegraded":"2023-11-30T18:23:12.112554+0000","last_fullsized":"2023-11-30T18:23:12.112554+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.106126+0000","last_change":"2023-11-30T18:23:11.723925+0000","last_active":"2023-11-30T18:23:12.106126+0000","last_peered":"2023-11-30T18:23:12.106126+0000","last_clean":"2023-11-30T18:23:12.106126+0000","last_became_active":"2023-11-30T18:23:11.723615+0000","last_became_peered":"2023-11-30T18:23:11.723615+0000","last_unstale":"2023-11-30T18:23:12.106126+0000","last_undegraded":"2023-11-30T18:23:12.106126+0000","last_fullsized":"2023-11-30T18:23:12.106126+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120555+0000","last_change":"2023-11-30T18:23:12.112331+0000","last_active":"2023-11-30T18:23:12.120555+0000","last_peered":"2023-11-30T18:23:12.120555+0000","last_clean":"2023-11-30T18:23:12.120555+0000","last_became_active":"2023-11-30T18:23:12.111049+0000","last_became_peered":"2023-11-30T18:23:12.111049+0000","last_unstale":"2023-11-30T18:23:12.120555+0000","last_undegraded":"2023-11-30T18:23:12.120555+0000","last_fullsized":"2023-11-30T18:23:12.120555+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"183'2","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114501+0000","last_change":"2023-11-30T18:23:11.727774+0000","last_active":"2023-11-30T18:23:12.114501+0000","last_peered":"2023-11-30T18:23:12.114501+0000","last_clean":"2023-11-30T18:23:12.114501+0000","last_became_active":"2023-11-30T18:23:11.727453+0000","last_became_peered":"2023-11-30T18:23:11.727453+0000","last_unstale":"2023-11-30T18:23:12.114501+0000","last_undegraded":"2023-11-30T18:23:12.114501+0000","last_fullsized":"2023-11-30T18:23:12.114501+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.127552+0000","last_change":"2023-11-30T18:23:12.120369+0000","last_active":"2023-11-30T18:23:12.127552+0000","last_peered":"2023-11-30T18:23:12.127552+0000","last_clean":"2023-11-30T18:23:12.127552+0000","last_became_active":"2023-11-30T18:23:12.119333+0000","last_became_peered":"2023-11-30T18:23:12.119333+0000","last_unstale":"2023-11-30T18:23:12.127552+0000","last_undegraded":"2023-11-30T18:23:12.127552+0000","last_fullsized":"2023-11-30T18:23:12.127552+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128170+0000","last_change":"2023-11-30T18:23:11.730906+0000","last_active":"2023-11-30T18:23:12.128170+0000","last_peered":"2023-11-30T18:23:12.128170+0000","last_clean":"2023-11-30T18:23:12.128170+0000","last_became_active":"2023-11-30T18:23:11.729501+0000","last_became_peered":"2023-11-30T18:23:11.729501+0000","last_unstale":"2023-11-30T18:23:12.128170+0000","last_undegraded":"2023-11-30T18:23:12.128170+0000","last_fullsized":"2023-11-30T18:23:12.128170+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120886+0000","last_change":"2023-11-30T18:23:12.118680+0000","last_active":"2023-11-30T18:23:12.120886+0000","last_peered":"2023-11-30T18:23:12.120886+0000","last_clean":"2023-11-30T18:23:12.120886+0000","last_became_active":"2023-11-30T18:23:12.118358+0000","last_became_peered":"2023-11-30T18:23:12.118358+0000","last_unstale":"2023-11-30T18:23:12.120886+0000","last_undegraded":"2023-11-30T18:23:12.120886+0000","last_fullsized":"2023-11-30T18:23:12.120886+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114112+0000","last_change":"2023-11-30T18:23:11.732949+0000","last_active":"2023-11-30T18:23:12.114112+0000","last_peered":"2023-11-30T18:23:12.114112+0000","last_clean":"2023-11-30T18:23:12.114112+0000","last_became_active":"2023-11-30T18:23:11.732627+0000","last_became_peered":"2023-11-30T18:23:11.732627+0000","last_unstale":"2023-11-30T18:23:12.114112+0000","last_undegraded":"2023-11-30T18:23:12.114112+0000","last_fullsized":"2023-11-30T18:23:12.114112+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.123862+0000","last_change":"2023-11-30T18:23:12.121133+0000","last_active":"2023-11-30T18:23:12.123862+0000","last_peered":"2023-11-30T18:23:12.123862+0000","last_clean":"2023-11-30T18:23:12.123862+0000","last_became_active":"2023-11-30T18:23:12.120811+0000","last_became_peered":"2023-11-30T18:23:12.120811+0000","last_unstale":"2023-11-30T18:23:12.123862+0000","last_undegraded":"2023-11-30T18:23:12.123862+0000","last_fullsized":"2023-11-30T18:23:12.123862+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105568+0000","last_change":"2023-11-30T18:23:11.732157+0000","last_active":"2023-11-30T18:23:12.105568+0000","last_peered":"2023-11-30T18:23:12.105568+0000","last_clean":"2023-11-30T18:23:12.105568+0000","last_became_active":"2023-11-30T18:23:11.731678+0000","last_became_peered":"2023-11-30T18:23:11.731678+0000","last_unstale":"2023-11-30T18:23:12.105568+0000","last_undegraded":"2023-11-30T18:23:12.105568+0000","last_fullsized":"2023-11-30T18:23:12.105568+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124562+0000","last_change":"2023-11-30T18:23:12.121281+0000","last_active":"2023-11-30T18:23:12.124562+0000","last_peered":"2023-11-30T18:23:12.124562+0000","last_clean":"2023-11-30T18:23:12.124562+0000","last_became_active":"2023-11-30T18:23:12.119940+0000","last_became_peered":"2023-11-30T18:23:12.119940+0000","last_unstale":"2023-11-30T18:23:12.124562+0000","last_undegraded":"2023-11-30T18:23:12.124562+0000","last_fullsized":"2023-11-30T18:23:12.124562+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.099560+0000","last_change":"2023-11-30T18:23:11.729413+0000","last_active":"2023-11-30T18:23:12.099560+0000","last_peered":"2023-11-30T18:23:12.099560+0000","last_clean":"2023-11-30T18:23:12.099560+0000","last_became_active":"2023-11-30T18:23:11.729096+0000","last_became_peered":"2023-11-30T18:23:11.729096+0000","last_unstale":"2023-11-30T18:23:12.099560+0000","last_undegraded":"2023-11-30T18:23:12.099560+0000","last_fullsized":"2023-11-30T18:23:12.099560+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128518+0000","last_change":"2023-11-30T18:23:12.122267+0000","last_active":"2023-11-30T18:23:12.128518+0000","last_peered":"2023-11-30T18:23:12.128518+0000","last_clean":"2023-11-30T18:23:12.128518+0000","last_became_active":"2023-11-30T18:23:12.118388+0000","last_became_peered":"2023-11-30T18:23:12.118388+0000","last_unstale":"2023-11-30T18:23:12.128518+0000","last_undegraded":"2023-11-30T18:23:12.128518+0000","last_fullsized":"2023-11-30T18:23:12.128518+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.103587+0000","last_change":"2023-11-30T18:23:11.731558+0000","last_active":"2023-11-30T18:23:12.103587+0000","last_peered":"2023-11-30T18:23:12.103587+0000","last_clean":"2023-11-30T18:23:12.103587+0000","last_became_active":"2023-11-30T18:23:11.731257+0000","last_became_peered":"2023-11-30T18:23:11.731257+0000","last_unstale":"2023-11-30T18:23:12.103587+0000","last_undegraded":"2023-11-30T18:23:12.103587+0000","last_fullsized":"2023-11-30T18:23:12.103587+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124485+0000","last_change":"2023-11-30T18:23:12.119514+0000","last_active":"2023-11-30T18:23:12.124485+0000","last_peered":"2023-11-30T18:23:12.124485+0000","last_clean":"2023-11-30T18:23:12.124485+0000","last_became_active":"2023-11-30T18:23:12.119170+0000","last_became_peered":"2023-11-30T18:23:12.119170+0000","last_unstale":"2023-11-30T18:23:12.124485+0000","last_undegraded":"2023-11-30T18:23:12.124485+0000","last_fullsized":"2023-11-30T18:23:12.124485+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.118785+0000","last_change":"2023-11-30T18:23:11.733798+0000","last_active":"2023-11-30T18:23:12.118785+0000","last_peered":"2023-11-30T18:23:12.118785+0000","last_clean":"2023-11-30T18:23:12.118785+0000","last_became_active":"2023-11-30T18:23:11.733491+0000","last_became_peered":"2023-11-30T18:23:11.733491+0000","last_unstale":"2023-11-30T18:23:12.118785+0000","last_undegraded":"2023-11-30T18:23:12.118785+0000","last_fullsized":"2023-11-30T18:23:12.118785+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.113796+0000","last_change":"2023-11-30T18:23:12.111493+0000","last_active":"2023-11-30T18:23:12.113796+0000","last_peered":"2023-11-30T18:23:12.113796+0000","last_clean":"2023-11-30T18:23:12.113796+0000","last_became_active":"2023-11-30T18:23:12.111224+0000","last_became_peered":"2023-11-30T18:23:12.111224+0000","last_unstale":"2023-11-30T18:23:12.113796+0000","last_undegraded":"2023-11-30T18:23:12.113796+0000","last_fullsized":"2023-11-30T18:23:12.113796+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101233+0000","last_change":"2023-11-30T18:23:11.732288+0000","last_active":"2023-11-30T18:23:12.101233+0000","last_peered":"2023-11-30T18:23:12.101233+0000","last_clean":"2023-11-30T18:23:12.101233+0000","last_became_active":"2023-11-30T18:23:11.731998+0000","last_became_peered":"2023-11-30T18:23:11.731998+0000","last_unstale":"2023-11-30T18:23:12.101233+0000","last_undegraded":"2023-11-30T18:23:12.101233+0000","last_fullsized":"2023-11-30T18:23:12.101233+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.123377+0000","last_change":"2023-11-30T18:23:12.118762+0000","last_active":"2023-11-30T18:23:12.123377+0000","last_peered":"2023-11-30T18:23:12.123377+0000","last_clean":"2023-11-30T18:23:12.123377+0000","last_became_active":"2023-11-30T18:23:12.118456+0000","last_became_peered":"2023-11-30T18:23:12.118456+0000","last_unstale":"2023-11-30T18:23:12.123377+0000","last_undegraded":"2023-11-30T18:23:12.123377+0000","last_fullsized":"2023-11-30T18:23:12.123377+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.34","version":"183'4","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.133525+0000","last_change":"2023-11-30T18:23:11.735207+0000","last_active":"2023-11-30T18:23:12.133525+0000","last_peered":"2023-11-30T18:23:12.133525+0000","last_clean":"2023-11-30T18:23:12.133525+0000","last_became_active":"2023-11-30T18:23:11.734947+0000","last_became_peered":"2023-11-30T18:23:11.734947+0000","last_unstale":"2023-11-30T18:23:12.133525+0000","last_undegraded":"2023-11-30T18:23:12.133525+0000","last_fullsized":"2023-11-30T18:23:12.133525+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112616+0000","last_change":"2023-11-30T18:23:12.110171+0000","last_active":"2023-11-30T18:23:12.112616+0000","last_peered":"2023-11-30T18:23:12.112616+0000","last_clean":"2023-11-30T18:23:12.112616+0000","last_became_active":"2023-11-30T18:23:12.109894+0000","last_became_peered":"2023-11-30T18:23:12.109894+0000","last_unstale":"2023-11-30T18:23:12.112616+0000","last_undegraded":"2023-11-30T18:23:12.112616+0000","last_fullsized":"2023-11-30T18:23:12.112616+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.33","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128319+0000","last_change":"2023-11-30T18:23:11.732423+0000","last_active":"2023-11-30T18:23:12.128319+0000","last_peered":"2023-11-30T18:23:12.128319+0000","last_clean":"2023-11-30T18:23:12.128319+0000","last_became_active":"2023-11-30T18:23:11.732141+0000","last_became_peered":"2023-11-30T18:23:11.732141+0000","last_unstale":"2023-11-30T18:23:12.128319+0000","last_undegraded":"2023-11-30T18:23:12.128319+0000","last_fullsized":"2023-11-30T18:23:12.128319+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114206+0000","last_change":"2023-11-30T18:23:12.113067+0000","last_active":"2023-11-30T18:23:12.114206+0000","last_peered":"2023-11-30T18:23:12.114206+0000","last_clean":"2023-11-30T18:23:12.114206+0000","last_became_active":"2023-11-30T18:23:12.112084+0000","last_became_peered":"2023-11-30T18:23:12.112084+0000","last_unstale":"2023-11-30T18:23:12.114206+0000","last_undegraded":"2023-11-30T18:23:12.114206+0000","last_fullsized":"2023-11-30T18:23:12.114206+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101969+0000","last_change":"2023-11-30T18:23:11.729733+0000","last_active":"2023-11-30T18:23:12.101969+0000","last_peered":"2023-11-30T18:23:12.101969+0000","last_clean":"2023-11-30T18:23:12.101969+0000","last_became_active":"2023-11-30T18:23:11.728411+0000","last_became_peered":"2023-11-30T18:23:11.728411+0000","last_unstale":"2023-11-30T18:23:12.101969+0000","last_undegraded":"2023-11-30T18:23:12.101969+0000","last_fullsized":"2023-11-30T18:23:12.101969+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.127847+0000","last_change":"2023-11-30T18:23:12.117850+0000","last_active":"2023-11-30T18:23:12.127847+0000","last_peered":"2023-11-30T18:23:12.127847+0000","last_clean":"2023-11-30T18:23:12.127847+0000","last_became_active":"2023-11-30T18:23:12.117557+0000","last_became_peered":"2023-11-30T18:23:12.117557+0000","last_unstale":"2023-11-30T18:23:12.127847+0000","last_undegraded":"2023-11-30T18:23:12.127847+0000","last_fullsized":"2023-11-30T18:23:12.127847+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114699+0000","last_change":"2023-11-30T18:23:11.731206+0000","last_active":"2023-11-30T18:23:12.114699+0000","last_peered":"2023-11-30T18:23:12.114699+0000","last_clean":"2023-11-30T18:23:12.114699+0000","last_became_active":"2023-11-30T18:23:11.730937+0000","last_became_peered":"2023-11-30T18:23:11.730937+0000","last_unstale":"2023-11-30T18:23:12.114699+0000","last_undegraded":"2023-11-30T18:23:12.114699+0000","last_fullsized":"2023-11-30T18:23:12.114699+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.116858+0000","last_change":"2023-11-30T18:23:12.115316+0000","last_active":"2023-11-30T18:23:12.116858+0000","last_peered":"2023-11-30T18:23:12.116858+0000","last_clean":"2023-11-30T18:23:12.116858+0000","last_became_active":"2023-11-30T18:23:12.114473+0000","last_became_peered":"2023-11-30T18:23:12.114473+0000","last_unstale":"2023-11-30T18:23:12.116858+0000","last_undegraded":"2023-11-30T18:23:12.116858+0000","last_fullsized":"2023-11-30T18:23:12.116858+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.30","version":"183'4","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.127276+0000","last_change":"2023-11-30T18:23:11.729498+0000","last_active":"2023-11-30T18:23:12.127276+0000","last_peered":"2023-11-30T18:23:12.127276+0000","last_clean":"2023-11-30T18:23:12.127276+0000","last_became_active":"2023-11-30T18:23:11.729221+0000","last_became_peered":"2023-11-30T18:23:11.729221+0000","last_unstale":"2023-11-30T18:23:12.127276+0000","last_undegraded":"2023-11-30T18:23:12.127276+0000","last_fullsized":"2023-11-30T18:23:12.127276+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.118300+0000","last_change":"2023-11-30T18:23:12.113823+0000","last_active":"2023-11-30T18:23:12.118300+0000","last_peered":"2023-11-30T18:23:12.118300+0000","last_clean":"2023-11-30T18:23:12.118300+0000","last_became_active":"2023-11-30T18:23:12.113041+0000","last_became_peered":"2023-11-30T18:23:12.113041+0000","last_unstale":"2023-11-30T18:23:12.118300+0000","last_undegraded":"2023-11-30T18:23:12.118300+0000","last_fullsized":"2023-11-30T18:23:12.118300+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120207+0000","last_change":"2023-11-30T18:23:11.737572+0000","last_active":"2023-11-30T18:23:12.120207+0000","last_peered":"2023-11-30T18:23:12.120207+0000","last_clean":"2023-11-30T18:23:12.120207+0000","last_became_active":"2023-11-30T18:23:11.737226+0000","last_became_peered":"2023-11-30T18:23:11.737226+0000","last_unstale":"2023-11-30T18:23:12.120207+0000","last_undegraded":"2023-11-30T18:23:12.120207+0000","last_fullsized":"2023-11-30T18:23:12.120207+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.136298+0000","last_change":"2023-11-30T18:23:12.131062+0000","last_active":"2023-11-30T18:23:12.136298+0000","last_peered":"2023-11-30T18:23:12.136298+0000","last_clean":"2023-11-30T18:23:12.136298+0000","last_became_active":"2023-11-30T18:23:12.130780+0000","last_became_peered":"2023-11-30T18:23:12.130780+0000","last_unstale":"2023-11-30T18:23:12.136298+0000","last_undegraded":"2023-11-30T18:23:12.136298+0000","last_fullsized":"2023-11-30T18:23:12.136298+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.104816+0000","last_change":"2023-11-30T18:23:11.726724+0000","last_active":"2023-11-30T18:23:12.104816+0000","last_peered":"2023-11-30T18:23:12.104816+0000","last_clean":"2023-11-30T18:23:12.104816+0000","last_became_active":"2023-11-30T18:23:11.726441+0000","last_became_peered":"2023-11-30T18:23:11.726441+0000","last_unstale":"2023-11-30T18:23:12.104816+0000","last_undegraded":"2023-11-30T18:23:12.104816+0000","last_fullsized":"2023-11-30T18:23:12.104816+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124700+0000","last_change":"2023-11-30T18:23:12.122966+0000","last_active":"2023-11-30T18:23:12.124700+0000","last_peered":"2023-11-30T18:23:12.124700+0000","last_clean":"2023-11-30T18:23:12.124700+0000","last_became_active":"2023-11-30T18:23:12.122442+0000","last_became_peered":"2023-11-30T18:23:12.122442+0000","last_unstale":"2023-11-30T18:23:12.124700+0000","last_undegraded":"2023-11-30T18:23:12.124700+0000","last_fullsized":"2023-11-30T18:23:12.124700+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.125158+0000","last_change":"2023-11-30T18:23:11.732298+0000","last_active":"2023-11-30T18:23:12.125158+0000","last_peered":"2023-11-30T18:23:12.125158+0000","last_clean":"2023-11-30T18:23:12.125158+0000","last_became_active":"2023-11-30T18:23:11.731767+0000","last_became_peered":"2023-11-30T18:23:11.731767+0000","last_unstale":"2023-11-30T18:23:12.125158+0000","last_undegraded":"2023-11-30T18:23:12.125158+0000","last_fullsized":"2023-11-30T18:23:12.125158+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.127778+0000","last_change":"2023-11-30T18:23:12.115086+0000","last_active":"2023-11-30T18:23:12.127778+0000","last_peered":"2023-11-30T18:23:12.127778+0000","last_clean":"2023-11-30T18:23:12.127778+0000","last_became_active":"2023-11-30T18:23:12.114614+0000","last_became_peered":"2023-11-30T18:23:12.114614+0000","last_unstale":"2023-11-30T18:23:12.127778+0000","last_undegraded":"2023-11-30T18:23:12.127778+0000","last_fullsized":"2023-11-30T18:23:12.127778+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.121943+0000","last_change":"2023-11-30T18:23:11.728290+0000","last_active":"2023-11-30T18:23:12.121943+0000","last_peered":"2023-11-30T18:23:12.121943+0000","last_clean":"2023-11-30T18:23:12.121943+0000","last_became_active":"2023-11-30T18:23:11.727972+0000","last_became_peered":"2023-11-30T18:23:11.727972+0000","last_unstale":"2023-11-30T18:23:12.121943+0000","last_undegraded":"2023-11-30T18:23:12.121943+0000","last_fullsized":"2023-11-30T18:23:12.121943+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.125287+0000","last_change":"2023-11-30T18:23:12.117183+0000","last_active":"2023-11-30T18:23:12.125287+0000","last_peered":"2023-11-30T18:23:12.125287+0000","last_clean":"2023-11-30T18:23:12.125287+0000","last_became_active":"2023-11-30T18:23:12.116864+0000","last_became_peered":"2023-11-30T18:23:12.116864+0000","last_unstale":"2023-11-30T18:23:12.125287+0000","last_undegraded":"2023-11-30T18:23:12.125287+0000","last_fullsized":"2023-11-30T18:23:12.125287+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.127634+0000","last_change":"2023-11-30T18:23:11.735658+0000","last_active":"2023-11-30T18:23:12.127634+0000","last_peered":"2023-11-30T18:23:12.127634+0000","last_clean":"2023-11-30T18:23:12.127634+0000","last_became_active":"2023-11-30T18:23:11.735382+0000","last_became_peered":"2023-11-30T18:23:11.735382+0000","last_unstale":"2023-11-30T18:23:12.127634+0000","last_undegraded":"2023-11-30T18:23:12.127634+0000","last_fullsized":"2023-11-30T18:23:12.127634+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112086+0000","last_change":"2023-11-30T18:23:12.110236+0000","last_active":"2023-11-30T18:23:12.112086+0000","last_peered":"2023-11-30T18:23:12.112086+0000","last_clean":"2023-11-30T18:23:12.112086+0000","last_became_active":"2023-11-30T18:23:12.108185+0000","last_became_peered":"2023-11-30T18:23:12.108185+0000","last_unstale":"2023-11-30T18:23:12.112086+0000","last_undegraded":"2023-11-30T18:23:12.112086+0000","last_fullsized":"2023-11-30T18:23:12.112086+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.102053+0000","last_change":"2023-11-30T18:23:11.728686+0000","last_active":"2023-11-30T18:23:12.102053+0000","last_peered":"2023-11-30T18:23:12.102053+0000","last_clean":"2023-11-30T18:23:12.102053+0000","last_became_active":"2023-11-30T18:23:11.728039+0000","last_became_peered":"2023-11-30T18:23:11.728039+0000","last_unstale":"2023-11-30T18:23:12.102053+0000","last_undegraded":"2023-11-30T18:23:12.102053+0000","last_fullsized":"2023-11-30T18:23:12.102053+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128740+0000","last_change":"2023-11-30T18:23:12.124153+0000","last_active":"2023-11-30T18:23:12.128740+0000","last_peered":"2023-11-30T18:23:12.128740+0000","last_clean":"2023-11-30T18:23:12.128740+0000","last_became_active":"2023-11-30T18:23:12.123877+0000","last_became_peered":"2023-11-30T18:23:12.123877+0000","last_unstale":"2023-11-30T18:23:12.128740+0000","last_undegraded":"2023-11-30T18:23:12.128740+0000","last_fullsized":"2023-11-30T18:23:12.128740+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101738+0000","last_change":"2023-11-30T18:23:11.727138+0000","last_active":"2023-11-30T18:23:12.101738+0000","last_peered":"2023-11-30T18:23:12.101738+0000","last_clean":"2023-11-30T18:23:12.101738+0000","last_became_active":"2023-11-30T18:23:11.726796+0000","last_became_peered":"2023-11-30T18:23:11.726796+0000","last_unstale":"2023-11-30T18:23:12.101738+0000","last_undegraded":"2023-11-30T18:23:12.101738+0000","last_fullsized":"2023-11-30T18:23:12.101738+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.126056+0000","last_change":"2023-11-30T18:23:12.124681+0000","last_active":"2023-11-30T18:23:12.126056+0000","last_peered":"2023-11-30T18:23:12.126056+0000","last_clean":"2023-11-30T18:23:12.126056+0000","last_became_active":"2023-11-30T18:23:12.124348+0000","last_became_peered":"2023-11-30T18:23:12.124348+0000","last_unstale":"2023-11-30T18:23:12.126056+0000","last_undegraded":"2023-11-30T18:23:12.126056+0000","last_fullsized":"2023-11-30T18:23:12.126056+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.116384+0000","last_change":"2023-11-30T18:23:11.734523+0000","last_active":"2023-11-30T18:23:12.116384+0000","last_peered":"2023-11-30T18:23:12.116384+0000","last_clean":"2023-11-30T18:23:12.116384+0000","last_became_active":"2023-11-30T18:23:11.734241+0000","last_became_peered":"2023-11-30T18:23:11.734241+0000","last_unstale":"2023-11-30T18:23:12.116384+0000","last_undegraded":"2023-11-30T18:23:12.116384+0000","last_fullsized":"2023-11-30T18:23:12.116384+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124583+0000","last_change":"2023-11-30T18:23:12.122081+0000","last_active":"2023-11-30T18:23:12.124583+0000","last_peered":"2023-11-30T18:23:12.124583+0000","last_clean":"2023-11-30T18:23:12.124583+0000","last_became_active":"2023-11-30T18:23:12.121493+0000","last_became_peered":"2023-11-30T18:23:12.121493+0000","last_unstale":"2023-11-30T18:23:12.124583+0000","last_undegraded":"2023-11-30T18:23:12.124583+0000","last_fullsized":"2023-11-30T18:23:12.124583+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.119133+0000","last_change":"2023-11-30T18:23:11.734920+0000","last_active":"2023-11-30T18:23:12.119133+0000","last_peered":"2023-11-30T18:23:12.119133+0000","last_clean":"2023-11-30T18:23:12.119133+0000","last_became_active":"2023-11-30T18:23:11.734578+0000","last_became_peered":"2023-11-30T18:23:11.734578+0000","last_unstale":"2023-11-30T18:23:12.119133+0000","last_undegraded":"2023-11-30T18:23:12.119133+0000","last_fullsized":"2023-11-30T18:23:12.119133+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.123244+0000","last_change":"2023-11-30T18:23:12.118073+0000","last_active":"2023-11-30T18:23:12.123244+0000","last_peered":"2023-11-30T18:23:12.123244+0000","last_clean":"2023-11-30T18:23:12.123244+0000","last_became_active":"2023-11-30T18:23:12.117796+0000","last_became_peered":"2023-11-30T18:23:12.117796+0000","last_unstale":"2023-11-30T18:23:12.123244+0000","last_undegraded":"2023-11-30T18:23:12.123244+0000","last_fullsized":"2023-11-30T18:23:12.123244+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101617+0000","last_change":"2023-11-30T18:23:11.728070+0000","last_active":"2023-11-30T18:23:12.101617+0000","last_peered":"2023-11-30T18:23:12.101617+0000","last_clean":"2023-11-30T18:23:12.101617+0000","last_became_active":"2023-11-30T18:23:11.727817+0000","last_became_peered":"2023-11-30T18:23:11.727817+0000","last_unstale":"2023-11-30T18:23:12.101617+0000","last_undegraded":"2023-11-30T18:23:12.101617+0000","last_fullsized":"2023-11-30T18:23:12.101617+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120898+0000","last_change":"2023-11-30T18:23:12.119472+0000","last_active":"2023-11-30T18:23:12.120898+0000","last_peered":"2023-11-30T18:23:12.120898+0000","last_clean":"2023-11-30T18:23:12.120898+0000","last_became_active":"2023-11-30T18:23:12.119192+0000","last_became_peered":"2023-11-30T18:23:12.119192+0000","last_unstale":"2023-11-30T18:23:12.120898+0000","last_undegraded":"2023-11-30T18:23:12.120898+0000","last_fullsized":"2023-11-30T18:23:12.120898+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.119296+0000","last_change":"2023-11-30T18:23:11.725649+0000","last_active":"2023-11-30T18:23:12.119296+0000","last_peered":"2023-11-30T18:23:12.119296+0000","last_clean":"2023-11-30T18:23:12.119296+0000","last_became_active":"2023-11-30T18:23:11.725358+0000","last_became_peered":"2023-11-30T18:23:11.725358+0000","last_unstale":"2023-11-30T18:23:12.119296+0000","last_undegraded":"2023-11-30T18:23:12.119296+0000","last_fullsized":"2023-11-30T18:23:12.119296+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.121579+0000","last_change":"2023-11-30T18:23:12.119529+0000","last_active":"2023-11-30T18:23:12.121579+0000","last_peered":"2023-11-30T18:23:12.121579+0000","last_clean":"2023-11-30T18:23:12.121579+0000","last_became_active":"2023-11-30T18:23:12.119258+0000","last_became_peered":"2023-11-30T18:23:12.119258+0000","last_unstale":"2023-11-30T18:23:12.121579+0000","last_undegraded":"2023-11-30T18:23:12.121579+0000","last_fullsized":"2023-11-30T18:23:12.121579+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.107434+0000","last_change":"2023-11-30T18:23:11.726054+0000","last_active":"2023-11-30T18:23:12.107434+0000","last_peered":"2023-11-30T18:23:12.107434+0000","last_clean":"2023-11-30T18:23:12.107434+0000","last_became_active":"2023-11-30T18:23:11.725740+0000","last_became_peered":"2023-11-30T18:23:11.725740+0000","last_unstale":"2023-11-30T18:23:12.107434+0000","last_undegraded":"2023-11-30T18:23:12.107434+0000","last_fullsized":"2023-11-30T18:23:12.107434+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.127528+0000","last_change":"2023-11-30T18:23:12.120197+0000","last_active":"2023-11-30T18:23:12.127528+0000","last_peered":"2023-11-30T18:23:12.127528+0000","last_clean":"2023-11-30T18:23:12.127528+0000","last_became_active":"2023-11-30T18:23:12.118933+0000","last_became_peered":"2023-11-30T18:23:12.118933+0000","last_unstale":"2023-11-30T18:23:12.127528+0000","last_undegraded":"2023-11-30T18:23:12.127528+0000","last_fullsized":"2023-11-30T18:23:12.127528+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.100712+0000","last_change":"2023-11-30T18:23:11.727466+0000","last_active":"2023-11-30T18:23:12.100712+0000","last_peered":"2023-11-30T18:23:12.100712+0000","last_clean":"2023-11-30T18:23:12.100712+0000","last_became_active":"2023-11-30T18:23:11.727184+0000","last_became_peered":"2023-11-30T18:23:11.727184+0000","last_unstale":"2023-11-30T18:23:12.100712+0000","last_undegraded":"2023-11-30T18:23:12.100712+0000","last_fullsized":"2023-11-30T18:23:12.100712+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.113593+0000","last_change":"2023-11-30T18:23:12.108335+0000","last_active":"2023-11-30T18:23:12.113593+0000","last_peered":"2023-11-30T18:23:12.113593+0000","last_clean":"2023-11-30T18:23:12.113593+0000","last_became_active":"2023-11-30T18:23:12.108065+0000","last_became_peered":"2023-11-30T18:23:12.108065+0000","last_unstale":"2023-11-30T18:23:12.113593+0000","last_undegraded":"2023-11-30T18:23:12.113593+0000","last_fullsized":"2023-11-30T18:23:12.113593+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.102104+0000","last_change":"2023-11-30T18:23:11.734962+0000","last_active":"2023-11-30T18:23:12.102104+0000","last_peered":"2023-11-30T18:23:12.102104+0000","last_clean":"2023-11-30T18:23:12.102104+0000","last_became_active":"2023-11-30T18:23:11.734489+0000","last_became_peered":"2023-11-30T18:23:11.734489+0000","last_unstale":"2023-11-30T18:23:12.102104+0000","last_undegraded":"2023-11-30T18:23:12.102104+0000","last_fullsized":"2023-11-30T18:23:12.102104+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124728+0000","last_change":"2023-11-30T18:23:12.118313+0000","last_active":"2023-11-30T18:23:12.124728+0000","last_peered":"2023-11-30T18:23:12.124728+0000","last_clean":"2023-11-30T18:23:12.124728+0000","last_became_active":"2023-11-30T18:23:12.114897+0000","last_became_peered":"2023-11-30T18:23:12.114897+0000","last_unstale":"2023-11-30T18:23:12.124728+0000","last_undegraded":"2023-11-30T18:23:12.124728+0000","last_fullsized":"2023-11-30T18:23:12.124728+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.103019+0000","last_change":"2023-11-30T18:23:11.728348+0000","last_active":"2023-11-30T18:23:12.103019+0000","last_peered":"2023-11-30T18:23:12.103019+0000","last_clean":"2023-11-30T18:23:12.103019+0000","last_became_active":"2023-11-30T18:23:11.728052+0000","last_became_peered":"2023-11-30T18:23:11.728052+0000","last_unstale":"2023-11-30T18:23:12.103019+0000","last_undegraded":"2023-11-30T18:23:12.103019+0000","last_fullsized":"2023-11-30T18:23:12.103019+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.115122+0000","last_change":"2023-11-30T18:23:12.112694+0000","last_active":"2023-11-30T18:23:12.115122+0000","last_peered":"2023-11-30T18:23:12.115122+0000","last_clean":"2023-11-30T18:23:12.115122+0000","last_became_active":"2023-11-30T18:23:12.112404+0000","last_became_peered":"2023-11-30T18:23:12.112404+0000","last_unstale":"2023-11-30T18:23:12.115122+0000","last_undegraded":"2023-11-30T18:23:12.115122+0000","last_fullsized":"2023-11-30T18:23:12.115122+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.116614+0000","last_change":"2023-11-30T18:23:11.733562+0000","last_active":"2023-11-30T18:23:12.116614+0000","last_peered":"2023-11-30T18:23:12.116614+0000","last_clean":"2023-11-30T18:23:12.116614+0000","last_became_active":"2023-11-30T18:23:11.733271+0000","last_became_peered":"2023-11-30T18:23:11.733271+0000","last_unstale":"2023-11-30T18:23:12.116614+0000","last_undegraded":"2023-11-30T18:23:12.116614+0000","last_fullsized":"2023-11-30T18:23:12.116614+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.122060+0000","last_change":"2023-11-30T18:23:12.120946+0000","last_active":"2023-11-30T18:23:12.122060+0000","last_peered":"2023-11-30T18:23:12.122060+0000","last_clean":"2023-11-30T18:23:12.122060+0000","last_became_active":"2023-11-30T18:23:12.120510+0000","last_became_peered":"2023-11-30T18:23:12.120510+0000","last_unstale":"2023-11-30T18:23:12.122060+0000","last_undegraded":"2023-11-30T18:23:12.122060+0000","last_fullsized":"2023-11-30T18:23:12.122060+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.118883+0000","last_change":"2023-11-30T18:23:11.722137+0000","last_active":"2023-11-30T18:23:12.118883+0000","last_peered":"2023-11-30T18:23:12.118883+0000","last_clean":"2023-11-30T18:23:12.118883+0000","last_became_active":"2023-11-30T18:23:11.721662+0000","last_became_peered":"2023-11-30T18:23:11.721662+0000","last_unstale":"2023-11-30T18:23:12.118883+0000","last_undegraded":"2023-11-30T18:23:12.118883+0000","last_fullsized":"2023-11-30T18:23:12.118883+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112020+0000","last_change":"2023-11-30T18:23:12.108920+0000","last_active":"2023-11-30T18:23:12.112020+0000","last_peered":"2023-11-30T18:23:12.112020+0000","last_clean":"2023-11-30T18:23:12.112020+0000","last_became_active":"2023-11-30T18:23:12.108658+0000","last_became_peered":"2023-11-30T18:23:12.108658+0000","last_unstale":"2023-11-30T18:23:12.112020+0000","last_undegraded":"2023-11-30T18:23:12.112020+0000","last_fullsized":"2023-11-30T18:23:12.112020+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.127959+0000","last_change":"2023-11-30T18:23:11.735560+0000","last_active":"2023-11-30T18:23:12.127959+0000","last_peered":"2023-11-30T18:23:12.127959+0000","last_clean":"2023-11-30T18:23:12.127959+0000","last_became_active":"2023-11-30T18:23:11.735257+0000","last_became_peered":"2023-11-30T18:23:11.735257+0000","last_unstale":"2023-11-30T18:23:12.127959+0000","last_undegraded":"2023-11-30T18:23:12.127959+0000","last_fullsized":"2023-11-30T18:23:12.127959+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.115218+0000","last_change":"2023-11-30T18:23:12.108356+0000","last_active":"2023-11-30T18:23:12.115218+0000","last_peered":"2023-11-30T18:23:12.115218+0000","last_clean":"2023-11-30T18:23:12.115218+0000","last_became_active":"2023-11-30T18:23:12.108073+0000","last_became_peered":"2023-11-30T18:23:12.108073+0000","last_unstale":"2023-11-30T18:23:12.115218+0000","last_undegraded":"2023-11-30T18:23:12.115218+0000","last_fullsized":"2023-11-30T18:23:12.115218+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"183'2","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128863+0000","last_change":"2023-11-30T18:23:11.735338+0000","last_active":"2023-11-30T18:23:12.128863+0000","last_peered":"2023-11-30T18:23:12.128863+0000","last_clean":"2023-11-30T18:23:12.128863+0000","last_became_active":"2023-11-30T18:23:11.735068+0000","last_became_peered":"2023-11-30T18:23:11.735068+0000","last_unstale":"2023-11-30T18:23:12.128863+0000","last_undegraded":"2023-11-30T18:23:12.128863+0000","last_fullsized":"2023-11-30T18:23:12.128863+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.130572+0000","last_change":"2023-11-30T18:23:12.128165+0000","last_active":"2023-11-30T18:23:12.130572+0000","last_peered":"2023-11-30T18:23:12.130572+0000","last_clean":"2023-11-30T18:23:12.130572+0000","last_became_active":"2023-11-30T18:23:12.127878+0000","last_became_peered":"2023-11-30T18:23:12.127878+0000","last_unstale":"2023-11-30T18:23:12.130572+0000","last_undegraded":"2023-11-30T18:23:12.130572+0000","last_fullsized":"2023-11-30T18:23:12.130572+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.100901+0000","last_change":"2023-11-30T18:23:11.734177+0000","last_active":"2023-11-30T18:23:12.100901+0000","last_peered":"2023-11-30T18:23:12.100901+0000","last_clean":"2023-11-30T18:23:12.100901+0000","last_became_active":"2023-11-30T18:23:11.733869+0000","last_became_peered":"2023-11-30T18:23:11.733869+0000","last_unstale":"2023-11-30T18:23:12.100901+0000","last_undegraded":"2023-11-30T18:23:12.100901+0000","last_fullsized":"2023-11-30T18:23:12.100901+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.126660+0000","last_change":"2023-11-30T18:23:12.125934+0000","last_active":"2023-11-30T18:23:12.126660+0000","last_peered":"2023-11-30T18:23:12.126660+0000","last_clean":"2023-11-30T18:23:12.126660+0000","last_became_active":"2023-11-30T18:23:12.125609+0000","last_became_peered":"2023-11-30T18:23:12.125609+0000","last_unstale":"2023-11-30T18:23:12.126660+0000","last_undegraded":"2023-11-30T18:23:12.126660+0000","last_fullsized":"2023-11-30T18:23:12.126660+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.102384+0000","last_change":"2023-11-30T18:23:11.729527+0000","last_active":"2023-11-30T18:23:12.102384+0000","last_peered":"2023-11-30T18:23:12.102384+0000","last_clean":"2023-11-30T18:23:12.102384+0000","last_became_active":"2023-11-30T18:23:11.727436+0000","last_became_peered":"2023-11-30T18:23:11.727436+0000","last_unstale":"2023-11-30T18:23:12.102384+0000","last_undegraded":"2023-11-30T18:23:12.102384+0000","last_fullsized":"2023-11-30T18:23:12.102384+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128566+0000","last_change":"2023-11-30T18:23:12.118391+0000","last_active":"2023-11-30T18:23:12.128566+0000","last_peered":"2023-11-30T18:23:12.128566+0000","last_clean":"2023-11-30T18:23:12.128566+0000","last_became_active":"2023-11-30T18:23:12.118021+0000","last_became_peered":"2023-11-30T18:23:12.118021+0000","last_unstale":"2023-11-30T18:23:12.128566+0000","last_undegraded":"2023-11-30T18:23:12.128566+0000","last_fullsized":"2023-11-30T18:23:12.128566+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105169+0000","last_change":"2023-11-30T18:23:11.726273+0000","last_active":"2023-11-30T18:23:12.105169+0000","last_peered":"2023-11-30T18:23:12.105169+0000","last_clean":"2023-11-30T18:23:12.105169+0000","last_became_active":"2023-11-30T18:23:11.726024+0000","last_became_peered":"2023-11-30T18:23:11.726024+0000","last_unstale":"2023-11-30T18:23:12.105169+0000","last_undegraded":"2023-11-30T18:23:12.105169+0000","last_fullsized":"2023-11-30T18:23:12.105169+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114198+0000","last_change":"2023-11-30T18:23:12.111598+0000","last_active":"2023-11-30T18:23:12.114198+0000","last_peered":"2023-11-30T18:23:12.114198+0000","last_clean":"2023-11-30T18:23:12.114198+0000","last_became_active":"2023-11-30T18:23:12.110743+0000","last_became_peered":"2023-11-30T18:23:12.110743+0000","last_unstale":"2023-11-30T18:23:12.114198+0000","last_undegraded":"2023-11-30T18:23:12.114198+0000","last_fullsized":"2023-11-30T18:23:12.114198+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105796+0000","last_change":"2023-11-30T18:23:11.734590+0000","last_active":"2023-11-30T18:23:12.105796+0000","last_peered":"2023-11-30T18:23:12.105796+0000","last_clean":"2023-11-30T18:23:12.105796+0000","last_became_active":"2023-11-30T18:23:11.734303+0000","last_became_peered":"2023-11-30T18:23:11.734303+0000","last_unstale":"2023-11-30T18:23:12.105796+0000","last_undegraded":"2023-11-30T18:23:12.105796+0000","last_fullsized":"2023-11-30T18:23:12.105796+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120605+0000","last_change":"2023-11-30T18:23:12.112705+0000","last_active":"2023-11-30T18:23:12.120605+0000","last_peered":"2023-11-30T18:23:12.120605+0000","last_clean":"2023-11-30T18:23:12.120605+0000","last_became_active":"2023-11-30T18:23:12.111139+0000","last_became_peered":"2023-11-30T18:23:12.111139+0000","last_unstale":"2023-11-30T18:23:12.120605+0000","last_undegraded":"2023-11-30T18:23:12.120605+0000","last_fullsized":"2023-11-30T18:23:12.120605+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.103710+0000","last_change":"2023-11-30T18:23:11.728671+0000","last_active":"2023-11-30T18:23:12.103710+0000","last_peered":"2023-11-30T18:23:12.103710+0000","last_clean":"2023-11-30T18:23:12.103710+0000","last_became_active":"2023-11-30T18:23:11.728345+0000","last_became_peered":"2023-11-30T18:23:11.728345+0000","last_unstale":"2023-11-30T18:23:12.103710+0000","last_undegraded":"2023-11-30T18:23:12.103710+0000","last_fullsized":"2023-11-30T18:23:12.103710+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128782+0000","last_change":"2023-11-30T18:23:12.124792+0000","last_active":"2023-11-30T18:23:12.128782+0000","last_peered":"2023-11-30T18:23:12.128782+0000","last_clean":"2023-11-30T18:23:12.128782+0000","last_became_active":"2023-11-30T18:23:12.124193+0000","last_became_peered":"2023-11-30T18:23:12.124193+0000","last_unstale":"2023-11-30T18:23:12.128782+0000","last_undegraded":"2023-11-30T18:23:12.128782+0000","last_fullsized":"2023-11-30T18:23:12.128782+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128865+0000","last_change":"2023-11-30T18:23:11.727412+0000","last_active":"2023-11-30T18:23:12.128865+0000","last_peered":"2023-11-30T18:23:12.128865+0000","last_clean":"2023-11-30T18:23:12.128865+0000","last_became_active":"2023-11-30T18:23:11.727129+0000","last_became_peered":"2023-11-30T18:23:11.727129+0000","last_unstale":"2023-11-30T18:23:12.128865+0000","last_undegraded":"2023-11-30T18:23:12.128865+0000","last_fullsized":"2023-11-30T18:23:12.128865+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.136285+0000","last_change":"2023-11-30T18:23:12.130940+0000","last_active":"2023-11-30T18:23:12.136285+0000","last_peered":"2023-11-30T18:23:12.136285+0000","last_clean":"2023-11-30T18:23:12.136285+0000","last_became_active":"2023-11-30T18:23:12.130705+0000","last_became_peered":"2023-11-30T18:23:12.130705+0000","last_unstale":"2023-11-30T18:23:12.136285+0000","last_undegraded":"2023-11-30T18:23:12.136285+0000","last_fullsized":"2023-11-30T18:23:12.136285+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"183'2","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128162+0000","last_change":"2023-11-30T18:23:11.736457+0000","last_active":"2023-11-30T18:23:12.128162+0000","last_peered":"2023-11-30T18:23:12.128162+0000","last_clean":"2023-11-30T18:23:12.128162+0000","last_became_active":"2023-11-30T18:23:11.736059+0000","last_became_peered":"2023-11-30T18:23:11.736059+0000","last_unstale":"2023-11-30T18:23:12.128162+0000","last_undegraded":"2023-11-30T18:23:12.128162+0000","last_fullsized":"2023-11-30T18:23:12.128162+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120877+0000","last_change":"2023-11-30T18:23:12.116925+0000","last_active":"2023-11-30T18:23:12.120877+0000","last_peered":"2023-11-30T18:23:12.120877+0000","last_clean":"2023-11-30T18:23:12.120877+0000","last_became_active":"2023-11-30T18:23:12.116645+0000","last_became_peered":"2023-11-30T18:23:12.116645+0000","last_unstale":"2023-11-30T18:23:12.120877+0000","last_undegraded":"2023-11-30T18:23:12.120877+0000","last_fullsized":"2023-11-30T18:23:12.120877+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101414+0000","last_change":"2023-11-30T18:23:11.732070+0000","last_active":"2023-11-30T18:23:12.101414+0000","last_peered":"2023-11-30T18:23:12.101414+0000","last_clean":"2023-11-30T18:23:12.101414+0000","last_became_active":"2023-11-30T18:23:11.731413+0000","last_became_peered":"2023-11-30T18:23:11.731413+0000","last_unstale":"2023-11-30T18:23:12.101414+0000","last_undegraded":"2023-11-30T18:23:12.101414+0000","last_fullsized":"2023-11-30T18:23:12.101414+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.117119+0000","last_change":"2023-11-30T18:23:12.109130+0000","last_active":"2023-11-30T18:23:12.117119+0000","last_peered":"2023-11-30T18:23:12.117119+0000","last_clean":"2023-11-30T18:23:12.117119+0000","last_became_active":"2023-11-30T18:23:12.108797+0000","last_became_peered":"2023-11-30T18:23:12.108797+0000","last_unstale":"2023-11-30T18:23:12.117119+0000","last_undegraded":"2023-11-30T18:23:12.117119+0000","last_fullsized":"2023-11-30T18:23:12.117119+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105401+0000","last_change":"2023-11-30T18:23:11.729673+0000","last_active":"2023-11-30T18:23:12.105401+0000","last_peered":"2023-11-30T18:23:12.105401+0000","last_clean":"2023-11-30T18:23:12.105401+0000","last_became_active":"2023-11-30T18:23:11.729205+0000","last_became_peered":"2023-11-30T18:23:11.729205+0000","last_unstale":"2023-11-30T18:23:12.105401+0000","last_undegraded":"2023-11-30T18:23:12.105401+0000","last_fullsized":"2023-11-30T18:23:12.105401+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.133312+0000","last_change":"2023-11-30T18:23:12.128309+0000","last_active":"2023-11-30T18:23:12.133312+0000","last_peered":"2023-11-30T18:23:12.133312+0000","last_clean":"2023-11-30T18:23:12.133312+0000","last_became_active":"2023-11-30T18:23:12.128014+0000","last_became_peered":"2023-11-30T18:23:12.128014+0000","last_unstale":"2023-11-30T18:23:12.133312+0000","last_undegraded":"2023-11-30T18:23:12.133312+0000","last_fullsized":"2023-11-30T18:23:12.133312+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112901+0000","last_change":"2023-11-30T18:23:11.731121+0000","last_active":"2023-11-30T18:23:12.112901+0000","last_peered":"2023-11-30T18:23:12.112901+0000","last_clean":"2023-11-30T18:23:12.112901+0000","last_became_active":"2023-11-30T18:23:11.730804+0000","last_became_peered":"2023-11-30T18:23:11.730804+0000","last_unstale":"2023-11-30T18:23:12.112901+0000","last_undegraded":"2023-11-30T18:23:12.112901+0000","last_fullsized":"2023-11-30T18:23:12.112901+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114635+0000","last_change":"2023-11-30T18:23:12.113494+0000","last_active":"2023-11-30T18:23:12.114635+0000","last_peered":"2023-11-30T18:23:12.114635+0000","last_clean":"2023-11-30T18:23:12.114635+0000","last_became_active":"2023-11-30T18:23:12.112805+0000","last_became_peered":"2023-11-30T18:23:12.112805+0000","last_unstale":"2023-11-30T18:23:12.114635+0000","last_undegraded":"2023-11-30T18:23:12.114635+0000","last_fullsized":"2023-11-30T18:23:12.114635+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.102167+0000","last_change":"2023-11-30T18:23:11.734767+0000","last_active":"2023-11-30T18:23:12.102167+0000","last_peered":"2023-11-30T18:23:12.102167+0000","last_clean":"2023-11-30T18:23:12.102167+0000","last_became_active":"2023-11-30T18:23:11.734140+0000","last_became_peered":"2023-11-30T18:23:11.734140+0000","last_unstale":"2023-11-30T18:23:12.102167+0000","last_undegraded":"2023-11-30T18:23:12.102167+0000","last_fullsized":"2023-11-30T18:23:12.102167+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128947+0000","last_change":"2023-11-30T18:23:12.125304+0000","last_active":"2023-11-30T18:23:12.128947+0000","last_peered":"2023-11-30T18:23:12.128947+0000","last_clean":"2023-11-30T18:23:12.128947+0000","last_became_active":"2023-11-30T18:23:12.125058+0000","last_became_peered":"2023-11-30T18:23:12.125058+0000","last_unstale":"2023-11-30T18:23:12.128947+0000","last_undegraded":"2023-11-30T18:23:12.128947+0000","last_fullsized":"2023-11-30T18:23:12.128947+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105672+0000","last_change":"2023-11-30T18:23:11.731979+0000","last_active":"2023-11-30T18:23:12.105672+0000","last_peered":"2023-11-30T18:23:12.105672+0000","last_clean":"2023-11-30T18:23:12.105672+0000","last_became_active":"2023-11-30T18:23:11.731333+0000","last_became_peered":"2023-11-30T18:23:11.731333+0000","last_unstale":"2023-11-30T18:23:12.105672+0000","last_undegraded":"2023-11-30T18:23:12.105672+0000","last_fullsized":"2023-11-30T18:23:12.105672+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112581+0000","last_change":"2023-11-30T18:23:12.108480+0000","last_active":"2023-11-30T18:23:12.112581+0000","last_peered":"2023-11-30T18:23:12.112581+0000","last_clean":"2023-11-30T18:23:12.112581+0000","last_became_active":"2023-11-30T18:23:12.108192+0000","last_became_peered":"2023-11-30T18:23:12.108192+0000","last_unstale":"2023-11-30T18:23:12.112581+0000","last_undegraded":"2023-11-30T18:23:12.112581+0000","last_fullsized":"2023-11-30T18:23:12.112581+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101068+0000","last_change":"2023-11-30T18:23:11.732703+0000","last_active":"2023-11-30T18:23:12.101068+0000","last_peered":"2023-11-30T18:23:12.101068+0000","last_clean":"2023-11-30T18:23:12.101068+0000","last_became_active":"2023-11-30T18:23:11.732433+0000","last_became_peered":"2023-11-30T18:23:11.732433+0000","last_unstale":"2023-11-30T18:23:12.101068+0000","last_undegraded":"2023-11-30T18:23:12.101068+0000","last_fullsized":"2023-11-30T18:23:12.101068+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.123835+0000","last_change":"2023-11-30T18:23:12.121094+0000","last_active":"2023-11-30T18:23:12.123835+0000","last_peered":"2023-11-30T18:23:12.123835+0000","last_clean":"2023-11-30T18:23:12.123835+0000","last_became_active":"2023-11-30T18:23:12.119586+0000","last_became_peered":"2023-11-30T18:23:12.119586+0000","last_unstale":"2023-11-30T18:23:12.123835+0000","last_undegraded":"2023-11-30T18:23:12.123835+0000","last_fullsized":"2023-11-30T18:23:12.123835+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"183'2","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.117989+0000","last_change":"2023-11-30T18:23:11.728925+0000","last_active":"2023-11-30T18:23:12.117989+0000","last_peered":"2023-11-30T18:23:12.117989+0000","last_clean":"2023-11-30T18:23:12.117989+0000","last_became_active":"2023-11-30T18:23:11.728645+0000","last_became_peered":"2023-11-30T18:23:11.728645+0000","last_unstale":"2023-11-30T18:23:12.117989+0000","last_undegraded":"2023-11-30T18:23:12.117989+0000","last_fullsized":"2023-11-30T18:23:12.117989+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.117554+0000","last_change":"2023-11-30T18:23:12.112891+0000","last_active":"2023-11-30T18:23:12.117554+0000","last_peered":"2023-11-30T18:23:12.117554+0000","last_clean":"2023-11-30T18:23:12.117554+0000","last_became_active":"2023-11-30T18:23:12.112610+0000","last_became_peered":"2023-11-30T18:23:12.112610+0000","last_unstale":"2023-11-30T18:23:12.117554+0000","last_undegraded":"2023-11-30T18:23:12.117554+0000","last_fullsized":"2023-11-30T18:23:12.117554+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105796+0000","last_change":"2023-11-30T18:23:11.728944+0000","last_active":"2023-11-30T18:23:12.105796+0000","last_peered":"2023-11-30T18:23:12.105796+0000","last_clean":"2023-11-30T18:23:12.105796+0000","last_became_active":"2023-11-30T18:23:11.728632+0000","last_became_peered":"2023-11-30T18:23:11.728632+0000","last_unstale":"2023-11-30T18:23:12.105796+0000","last_undegraded":"2023-11-30T18:23:12.105796+0000","last_fullsized":"2023-11-30T18:23:12.105796+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120459+0000","last_change":"2023-11-30T18:23:12.111474+0000","last_active":"2023-11-30T18:23:12.120459+0000","last_peered":"2023-11-30T18:23:12.120459+0000","last_clean":"2023-11-30T18:23:12.120459+0000","last_became_active":"2023-11-30T18:23:12.111119+0000","last_became_peered":"2023-11-30T18:23:12.111119+0000","last_unstale":"2023-11-30T18:23:12.120459+0000","last_undegraded":"2023-11-30T18:23:12.120459+0000","last_fullsized":"2023-11-30T18:23:12.120459+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101462+0000","last_change":"2023-11-30T18:23:11.733982+0000","last_active":"2023-11-30T18:23:12.101462+0000","last_peered":"2023-11-30T18:23:12.101462+0000","last_clean":"2023-11-30T18:23:12.101462+0000","last_became_active":"2023-11-30T18:23:11.733689+0000","last_became_peered":"2023-11-30T18:23:11.733689+0000","last_unstale":"2023-11-30T18:23:12.101462+0000","last_undegraded":"2023-11-30T18:23:12.101462+0000","last_fullsized":"2023-11-30T18:23:12.101462+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120038+0000","last_change":"2023-11-30T18:23:12.116461+0000","last_active":"2023-11-30T18:23:12.120038+0000","last_peered":"2023-11-30T18:23:12.120038+0000","last_clean":"2023-11-30T18:23:12.120038+0000","last_became_active":"2023-11-30T18:23:12.115880+0000","last_became_peered":"2023-11-30T18:23:12.115880+0000","last_unstale":"2023-11-30T18:23:12.120038+0000","last_undegraded":"2023-11-30T18:23:12.120038+0000","last_fullsized":"2023-11-30T18:23:12.120038+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.104010+0000","last_change":"2023-11-30T18:23:11.728276+0000","last_active":"2023-11-30T18:23:12.104010+0000","last_peered":"2023-11-30T18:23:12.104010+0000","last_clean":"2023-11-30T18:23:12.104010+0000","last_became_active":"2023-11-30T18:23:11.727974+0000","last_became_peered":"2023-11-30T18:23:11.727974+0000","last_unstale":"2023-11-30T18:23:12.104010+0000","last_undegraded":"2023-11-30T18:23:12.104010+0000","last_fullsized":"2023-11-30T18:23:12.104010+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.113288+0000","last_change":"2023-11-30T18:23:12.111050+0000","last_active":"2023-11-30T18:23:12.113288+0000","last_peered":"2023-11-30T18:23:12.113288+0000","last_clean":"2023-11-30T18:23:12.113288+0000","last_became_active":"2023-11-30T18:23:12.110744+0000","last_became_peered":"2023-11-30T18:23:12.110744+0000","last_unstale":"2023-11-30T18:23:12.113288+0000","last_undegraded":"2023-11-30T18:23:12.113288+0000","last_fullsized":"2023-11-30T18:23:12.113288+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.106016+0000","last_change":"2023-11-30T18:23:11.730729+0000","last_active":"2023-11-30T18:23:12.106016+0000","last_peered":"2023-11-30T18:23:12.106016+0000","last_clean":"2023-11-30T18:23:12.106016+0000","last_became_active":"2023-11-30T18:23:11.728274+0000","last_became_peered":"2023-11-30T18:23:11.728274+0000","last_unstale":"2023-11-30T18:23:12.106016+0000","last_undegraded":"2023-11-30T18:23:12.106016+0000","last_fullsized":"2023-11-30T18:23:12.106016+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128547+0000","last_change":"2023-11-30T18:23:12.118514+0000","last_active":"2023-11-30T18:23:12.128547+0000","last_peered":"2023-11-30T18:23:12.128547+0000","last_clean":"2023-11-30T18:23:12.128547+0000","last_became_active":"2023-11-30T18:23:12.117762+0000","last_became_peered":"2023-11-30T18:23:12.117762+0000","last_unstale":"2023-11-30T18:23:12.128547+0000","last_undegraded":"2023-11-30T18:23:12.128547+0000","last_fullsized":"2023-11-30T18:23:12.128547+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.119835+0000","last_change":"2023-11-30T18:23:11.729709+0000","last_active":"2023-11-30T18:23:12.119835+0000","last_peered":"2023-11-30T18:23:12.119835+0000","last_clean":"2023-11-30T18:23:12.119835+0000","last_became_active":"2023-11-30T18:23:11.728696+0000","last_became_peered":"2023-11-30T18:23:11.728696+0000","last_unstale":"2023-11-30T18:23:12.119835+0000","last_undegraded":"2023-11-30T18:23:12.119835+0000","last_fullsized":"2023-11-30T18:23:12.119835+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112118+0000","last_change":"2023-11-30T18:23:12.110191+0000","last_active":"2023-11-30T18:23:12.112118+0000","last_peered":"2023-11-30T18:23:12.112118+0000","last_clean":"2023-11-30T18:23:12.112118+0000","last_became_active":"2023-11-30T18:23:12.108068+0000","last_became_peered":"2023-11-30T18:23:12.108068+0000","last_unstale":"2023-11-30T18:23:12.112118+0000","last_undegraded":"2023-11-30T18:23:12.112118+0000","last_fullsized":"2023-11-30T18:23:12.112118+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.106165+0000","last_change":"2023-11-30T18:23:11.724242+0000","last_active":"2023-11-30T18:23:12.106165+0000","last_peered":"2023-11-30T18:23:12.106165+0000","last_clean":"2023-11-30T18:23:12.106165+0000","last_became_active":"2023-11-30T18:23:11.723941+0000","last_became_peered":"2023-11-30T18:23:11.723941+0000","last_unstale":"2023-11-30T18:23:12.106165+0000","last_undegraded":"2023-11-30T18:23:12.106165+0000","last_fullsized":"2023-11-30T18:23:12.106165+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.115102+0000","last_change":"2023-11-30T18:23:12.112639+0000","last_active":"2023-11-30T18:23:12.115102+0000","last_peered":"2023-11-30T18:23:12.115102+0000","last_clean":"2023-11-30T18:23:12.115102+0000","last_became_active":"2023-11-30T18:23:12.112347+0000","last_became_peered":"2023-11-30T18:23:12.112347+0000","last_unstale":"2023-11-30T18:23:12.115102+0000","last_undegraded":"2023-11-30T18:23:12.115102+0000","last_fullsized":"2023-11-30T18:23:12.115102+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.116481+0000","last_change":"2023-11-30T18:23:11.733023+0000","last_active":"2023-11-30T18:23:12.116481+0000","last_peered":"2023-11-30T18:23:12.116481+0000","last_clean":"2023-11-30T18:23:12.116481+0000","last_became_active":"2023-11-30T18:23:11.732439+0000","last_became_peered":"2023-11-30T18:23:11.732439+0000","last_unstale":"2023-11-30T18:23:12.116481+0000","last_undegraded":"2023-11-30T18:23:12.116481+0000","last_fullsized":"2023-11-30T18:23:12.116481+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.130413+0000","last_change":"2023-11-30T18:23:12.123957+0000","last_active":"2023-11-30T18:23:12.130413+0000","last_peered":"2023-11-30T18:23:12.130413+0000","last_clean":"2023-11-30T18:23:12.130413+0000","last_became_active":"2023-11-30T18:23:12.123674+0000","last_became_peered":"2023-11-30T18:23:12.123674+0000","last_unstale":"2023-11-30T18:23:12.130413+0000","last_undegraded":"2023-11-30T18:23:12.130413+0000","last_fullsized":"2023-11-30T18:23:12.130413+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.118736+0000","last_change":"2023-11-30T18:23:11.724253+0000","last_active":"2023-11-30T18:23:12.118736+0000","last_peered":"2023-11-30T18:23:12.118736+0000","last_clean":"2023-11-30T18:23:12.118736+0000","last_became_active":"2023-11-30T18:23:11.723936+0000","last_became_peered":"2023-11-30T18:23:11.723936+0000","last_unstale":"2023-11-30T18:23:12.118736+0000","last_undegraded":"2023-11-30T18:23:12.118736+0000","last_fullsized":"2023-11-30T18:23:12.118736+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":154,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.100854+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T18:23:12.100854+0000","last_peered":"2023-11-30T18:23:12.100854+0000","last_clean":"2023-11-30T18:23:12.100854+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T18:23:12.100854+0000","last_undegraded":"2023-11-30T18:23:12.100854+0000","last_fullsized":"2023-11-30T18:23:12.100854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124990+0000","last_change":"2023-11-30T18:23:12.122702+0000","last_active":"2023-11-30T18:23:12.124990+0000","last_peered":"2023-11-30T18:23:12.124990+0000","last_clean":"2023-11-30T18:23:12.124990+0000","last_became_active":"2023-11-30T18:23:12.122115+0000","last_became_peered":"2023-11-30T18:23:12.122115+0000","last_unstale":"2023-11-30T18:23:12.124990+0000","last_undegraded":"2023-11-30T18:23:12.124990+0000","last_fullsized":"2023-11-30T18:23:12.124990+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"183'3","reported_seq":13,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124889+0000","last_change":"2023-11-30T18:23:11.723777+0000","last_active":"2023-11-30T18:23:12.124889+0000","last_peered":"2023-11-30T18:23:12.124889+0000","last_clean":"2023-11-30T18:23:12.124889+0000","last_became_active":"2023-11-30T18:23:11.723321+0000","last_became_peered":"2023-11-30T18:23:11.723321+0000","last_unstale":"2023-11-30T18:23:12.124889+0000","last_undegraded":"2023-11-30T18:23:12.124889+0000","last_fullsized":"2023-11-30T18:23:12.124889+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":151,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105479+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T18:23:12.105479+0000","last_peered":"2023-11-30T18:23:12.105479+0000","last_clean":"2023-11-30T18:23:12.105479+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T18:23:12.105479+0000","last_undegraded":"2023-11-30T18:23:12.105479+0000","last_fullsized":"2023-11-30T18:23:12.105479+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124947+0000","last_change":"2023-11-30T18:23:12.123908+0000","last_active":"2023-11-30T18:23:12.124947+0000","last_peered":"2023-11-30T18:23:12.124947+0000","last_clean":"2023-11-30T18:23:12.124947+0000","last_became_active":"2023-11-30T18:23:12.123674+0000","last_became_peered":"2023-11-30T18:23:12.123674+0000","last_unstale":"2023-11-30T18:23:12.124947+0000","last_undegraded":"2023-11-30T18:23:12.124947+0000","last_fullsized":"2023-11-30T18:23:12.124947+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105691+0000","last_change":"2023-11-30T18:23:11.726548+0000","last_active":"2023-11-30T18:23:12.105691+0000","last_peered":"2023-11-30T18:23:12.105691+0000","last_clean":"2023-11-30T18:23:12.105691+0000","last_became_active":"2023-11-30T18:23:11.726202+0000","last_became_peered":"2023-11-30T18:23:11.726202+0000","last_unstale":"2023-11-30T18:23:12.105691+0000","last_undegraded":"2023-11-30T18:23:12.105691+0000","last_fullsized":"2023-11-30T18:23:12.105691+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":158,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.118025+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T18:23:12.118025+0000","last_peered":"2023-11-30T18:23:12.118025+0000","last_clean":"2023-11-30T18:23:12.118025+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T18:23:12.118025+0000","last_undegraded":"2023-11-30T18:23:12.118025+0000","last_fullsized":"2023-11-30T18:23:12.118025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120302+0000","last_change":"2023-11-30T18:23:12.118780+0000","last_active":"2023-11-30T18:23:12.120302+0000","last_peered":"2023-11-30T18:23:12.120302+0000","last_clean":"2023-11-30T18:23:12.120302+0000","last_became_active":"2023-11-30T18:23:12.118475+0000","last_became_peered":"2023-11-30T18:23:12.118475+0000","last_unstale":"2023-11-30T18:23:12.120302+0000","last_undegraded":"2023-11-30T18:23:12.120302+0000","last_fullsized":"2023-11-30T18:23:12.120302+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"183'2","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.113944+0000","last_change":"2023-11-30T18:23:11.732729+0000","last_active":"2023-11-30T18:23:12.113944+0000","last_peered":"2023-11-30T18:23:12.113944+0000","last_clean":"2023-11-30T18:23:12.113944+0000","last_became_active":"2023-11-30T18:23:11.732454+0000","last_became_peered":"2023-11-30T18:23:11.732454+0000","last_unstale":"2023-11-30T18:23:12.113944+0000","last_undegraded":"2023-11-30T18:23:12.113944+0000","last_fullsized":"2023-11-30T18:23:12.113944+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":151,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.106039+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T18:23:12.106039+0000","last_peered":"2023-11-30T18:23:12.106039+0000","last_clean":"2023-11-30T18:23:12.106039+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T18:23:12.106039+0000","last_undegraded":"2023-11-30T18:23:12.106039+0000","last_fullsized":"2023-11-30T18:23:12.106039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":148,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.116542+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T18:23:12.116542+0000","last_peered":"2023-11-30T18:23:12.116542+0000","last_clean":"2023-11-30T18:23:12.116542+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T18:23:12.116542+0000","last_undegraded":"2023-11-30T18:23:12.116542+0000","last_fullsized":"2023-11-30T18:23:12.116542+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.127587+0000","last_change":"2023-11-30T18:23:12.120874+0000","last_active":"2023-11-30T18:23:12.127587+0000","last_peered":"2023-11-30T18:23:12.127587+0000","last_clean":"2023-11-30T18:23:12.127587+0000","last_became_active":"2023-11-30T18:23:12.120618+0000","last_became_peered":"2023-11-30T18:23:12.120618+0000","last_unstale":"2023-11-30T18:23:12.127587+0000","last_undegraded":"2023-11-30T18:23:12.127587+0000","last_fullsized":"2023-11-30T18:23:12.127587+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120308+0000","last_change":"2023-11-30T18:23:11.737931+0000","last_active":"2023-11-30T18:23:12.120308+0000","last_peered":"2023-11-30T18:23:12.120308+0000","last_clean":"2023-11-30T18:23:12.120308+0000","last_became_active":"2023-11-30T18:23:11.737593+0000","last_became_peered":"2023-11-30T18:23:11.737593+0000","last_unstale":"2023-11-30T18:23:12.120308+0000","last_undegraded":"2023-11-30T18:23:12.120308+0000","last_fullsized":"2023-11-30T18:23:12.120308+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":146,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.116609+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T18:23:12.116609+0000","last_peered":"2023-11-30T18:23:12.116609+0000","last_clean":"2023-11-30T18:23:12.116609+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T18:23:12.116609+0000","last_undegraded":"2023-11-30T18:23:12.116609+0000","last_fullsized":"2023-11-30T18:23:12.116609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114593+0000","last_change":"2023-11-30T18:23:12.113259+0000","last_active":"2023-11-30T18:23:12.114593+0000","last_peered":"2023-11-30T18:23:12.114593+0000","last_clean":"2023-11-30T18:23:12.114593+0000","last_became_active":"2023-11-30T18:23:12.112451+0000","last_became_peered":"2023-11-30T18:23:12.112451+0000","last_unstale":"2023-11-30T18:23:12.114593+0000","last_undegraded":"2023-11-30T18:23:12.114593+0000","last_fullsized":"2023-11-30T18:23:12.114593+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.104412+0000","last_change":"2023-11-30T18:23:11.730038+0000","last_active":"2023-11-30T18:23:12.104412+0000","last_peered":"2023-11-30T18:23:12.104412+0000","last_clean":"2023-11-30T18:23:12.104412+0000","last_became_active":"2023-11-30T18:23:11.729125+0000","last_became_peered":"2023-11-30T18:23:11.729125+0000","last_unstale":"2023-11-30T18:23:12.104412+0000","last_undegraded":"2023-11-30T18:23:12.104412+0000","last_fullsized":"2023-11-30T18:23:12.104412+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":146,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.121501+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T18:23:12.121501+0000","last_peered":"2023-11-30T18:23:12.121501+0000","last_clean":"2023-11-30T18:23:12.121501+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T18:23:12.121501+0000","last_undegraded":"2023-11-30T18:23:12.121501+0000","last_fullsized":"2023-11-30T18:23:12.121501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.123443+0000","last_change":"2023-11-30T18:23:12.119562+0000","last_active":"2023-11-30T18:23:12.123443+0000","last_peered":"2023-11-30T18:23:12.123443+0000","last_clean":"2023-11-30T18:23:12.123443+0000","last_became_active":"2023-11-30T18:23:12.119194+0000","last_became_peered":"2023-11-30T18:23:12.119194+0000","last_unstale":"2023-11-30T18:23:12.123443+0000","last_undegraded":"2023-11-30T18:23:12.123443+0000","last_fullsized":"2023-11-30T18:23:12.123443+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.104412+0000","last_change":"2023-11-30T18:23:11.723567+0000","last_active":"2023-11-30T18:23:12.104412+0000","last_peered":"2023-11-30T18:23:12.104412+0000","last_clean":"2023-11-30T18:23:12.104412+0000","last_became_active":"2023-11-30T18:23:11.723248+0000","last_became_peered":"2023-11-30T18:23:11.723248+0000","last_unstale":"2023-11-30T18:23:12.104412+0000","last_undegraded":"2023-11-30T18:23:12.104412+0000","last_fullsized":"2023-11-30T18:23:12.104412+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":154,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101695+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T18:23:12.101695+0000","last_peered":"2023-11-30T18:23:12.101695+0000","last_clean":"2023-11-30T18:23:12.101695+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T18:23:12.101695+0000","last_undegraded":"2023-11-30T18:23:12.101695+0000","last_fullsized":"2023-11-30T18:23:12.101695+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.113473+0000","last_change":"2023-11-30T18:23:12.111164+0000","last_active":"2023-11-30T18:23:12.113473+0000","last_peered":"2023-11-30T18:23:12.113473+0000","last_clean":"2023-11-30T18:23:12.113473+0000","last_became_active":"2023-11-30T18:23:12.110887+0000","last_became_peered":"2023-11-30T18:23:12.110887+0000","last_unstale":"2023-11-30T18:23:12.113473+0000","last_undegraded":"2023-11-30T18:23:12.113473+0000","last_fullsized":"2023-11-30T18:23:12.113473+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"183'4","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128421+0000","last_change":"2023-11-30T18:23:11.728962+0000","last_active":"2023-11-30T18:23:12.128421+0000","last_peered":"2023-11-30T18:23:12.128421+0000","last_clean":"2023-11-30T18:23:12.128421+0000","last_became_active":"2023-11-30T18:23:11.728681+0000","last_became_peered":"2023-11-30T18:23:11.728681+0000","last_unstale":"2023-11-30T18:23:12.128421+0000","last_undegraded":"2023-11-30T18:23:12.128421+0000","last_fullsized":"2023-11-30T18:23:12.128421+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":172,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.104755+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T18:23:12.104755+0000","last_peered":"2023-11-30T18:23:12.104755+0000","last_clean":"2023-11-30T18:23:12.104755+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T18:23:12.104755+0000","last_undegraded":"2023-11-30T18:23:12.104755+0000","last_fullsized":"2023-11-30T18:23:12.104755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575755,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303444,"kb_used_data":2252,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068396,"statfs":{"total":96636764160,"available":96326037504,"internally_reserved":0,"allocated":2306048,"data_stored":1173973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.32500000000000001},"max":{"1min":0.68700000000000006,"5min":0.81699999999999995,"15min":0.83599999999999997},"last":0.503},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.60699999999999998,"15min":0.61799999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.71499999999999997,"5min":0.82199999999999995,"15min":0.84999999999999998},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55000000000000004,"15min":0.55900000000000005},"min":{"1min":0.35599999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71599999999999997,"5min":0.80500000000000005,"15min":0.875},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.39800000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71699999999999997,"5min":0.79100000000000004,"15min":0.82099999999999995},"last":0.54400000000000004}]},{"osd":2,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70399999999999996,"5min":0.76900000000000002,"15min":0.85399999999999998},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.66500000000000004,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.34300000000000003},"max":{"1min":0.65700000000000003,"5min":0.79300000000000004,"15min":0.90800000000000003},"last":0.373},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60199999999999998,"15min":0.60299999999999998},"min":{"1min":0.41099999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.73399999999999999,"5min":0.80000000000000004,"15min":0.80300000000000005},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.45300000000000001,"15min":0.44400000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63900000000000001,"5min":0.70299999999999996,"15min":0.73799999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46400000000000002,"15min":0.46500000000000002},"min":{"1min":0.32100000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.66400000000000003,"5min":0.71999999999999997,"15min":0.78100000000000003},"last":0.438}]},{"osd":5,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.65000000000000002,"5min":0.749,"15min":0.753},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.51000000000000001,"15min":0.505},"min":{"1min":0.371,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":0.69099999999999995,"5min":0.76000000000000001,"15min":0.81999999999999995},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.372,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.74299999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.751,"5min":0.81499999999999995,"15min":0.83599999999999997},"last":0.53100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575754,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307528,"kb_used_data":2240,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064312,"statfs":{"total":96636764160,"available":96321855488,"internally_reserved":0,"allocated":2293760,"data_stored":1172505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.58999999999999997,"15min":0.59799999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68000000000000005,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.61799999999999999,"15min":0.61699999999999999},"min":{"1min":0.45100000000000001,"5min":0.41099999999999998,"15min":0.33600000000000002},"max":{"1min":0.72599999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.79500000000000004}]},{"osd":1,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.32400000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.70899999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.40999999999999998,"5min":0.39000000000000001,"15min":0.35199999999999998},"max":{"1min":0.751,"5min":0.876,"15min":0.876},"last":0.84099999999999997}]},{"osd":2,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.59699999999999998,"15min":0.59799999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71399999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.39000000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73399999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.78200000000000003}]},{"osd":3,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54700000000000004,"15min":0.55700000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73399999999999999,"5min":0.82299999999999995,"15min":0.83499999999999996},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.39900000000000002,"5min":0.39000000000000001,"15min":0.33200000000000002},"max":{"1min":0.64400000000000002,"5min":0.79100000000000004,"15min":0.80100000000000005},"last":0.73899999999999999}]},{"osd":4,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45200000000000001,"15min":0.45100000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.68899999999999995,"5min":0.81000000000000005,"15min":0.94999999999999996},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47799999999999998,"15min":0.47599999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70399999999999996,"5min":0.76400000000000001,"15min":0.82299999999999995},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46999999999999997,"15min":0.46700000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.66300000000000003,"5min":0.76400000000000001,"15min":0.81999999999999995},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70999999999999996,"5min":0.81999999999999995,"15min":0.83499999999999996},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.29999999999999999},"max":{"1min":0.72499999999999998,"5min":0.80100000000000005,"15min":0.86799999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.376,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71599999999999997,"5min":0.80800000000000005,"15min":0.86599999999999999},"last":0.77200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575754,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307536,"kb_used_data":2248,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064304,"statfs":{"total":96636764160,"available":96321847296,"internally_reserved":0,"allocated":2301952,"data_stored":1173129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34200000000000003,"15min":0.36399999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.42799999999999999,"5min":0.54200000000000004,"15min":0.70699999999999996},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47299999999999998,"15min":0.49399999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.78100000000000003},"last":0.33100000000000002}]},{"osd":2,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.376,"15min":0.39600000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.48099999999999998,"5min":0.60599999999999998,"15min":0.67500000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.498,"15min":0.51600000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63200000000000001,"5min":0.72499999999999998,"15min":0.85599999999999998},"last":0.38}]},{"osd":3,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.44700000000000001,"15min":0.46300000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.53700000000000003,"5min":0.70599999999999996,"15min":0.79600000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.42299999999999999,"15min":0.44600000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.50700000000000001,"5min":0.65400000000000003,"15min":0.68000000000000005},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.58399999999999996,"15min":0.60999999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.314},"max":{"1min":0.80100000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.61799999999999999,"15min":0.64100000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38800000000000001},"max":{"1min":0.77900000000000003,"5min":0.80800000000000005,"15min":0.90600000000000003},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.60399999999999998,"15min":0.623},"min":{"1min":0.379,"5min":0.379,"15min":0.377},"max":{"1min":0.78400000000000003,"5min":0.86599999999999999,"15min":0.90200000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60899999999999999,"15min":0.63300000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.36799999999999999},"max":{"1min":0.79400000000000004,"5min":0.878,"15min":0.90800000000000003},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.66700000000000004,"15min":0.68899999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66300000000000003,"15min":0.67600000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42599999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.0049999999999999},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.66600000000000004,"15min":0.68999999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.96999999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.65100000000000002,"15min":0.67200000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.95899999999999996},"last":0.52100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575754,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307544,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064296,"statfs":{"total":96636764160,"available":96321839104,"internally_reserved":0,"allocated":2310144,"data_stored":1173273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.38300000000000001,"15min":0.38900000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.51900000000000002,"5min":0.56799999999999995,"15min":0.61099999999999999},"last":0.246},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41099999999999998,"15min":0.40999999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.249},"max":{"1min":0.55600000000000005,"5min":0.65600000000000003,"15min":0.68400000000000005},"last":0.34000000000000002}]},{"osd":2,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41599999999999998,"15min":0.40899999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.57499999999999996,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.49299999999999999,"15min":0.48999999999999999},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.59399999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.44600000000000001,"15min":0.45200000000000001},"min":{"1min":0.311,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.53500000000000003,"5min":0.71699999999999997,"15min":0.77500000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46899999999999997,"15min":0.46800000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65300000000000002,"5min":0.67600000000000005,"15min":0.69499999999999995},"last":0.26000000000000001}]},{"osd":4,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65000000000000002,"15min":0.63700000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.42199999999999999},"max":{"1min":0.81000000000000005,"5min":0.96399999999999997,"15min":0.995},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66600000000000004,"15min":0.65400000000000003},"min":{"1min":0.47799999999999998,"5min":0.42799999999999999,"15min":0.41499999999999998},"max":{"1min":0.75900000000000001,"5min":1.03,"15min":1.03},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65200000000000002,"15min":0.64100000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.40799999999999997},"max":{"1min":0.86499999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.68100000000000005,"15min":0.65900000000000003},"min":{"1min":0.48199999999999998,"5min":0.44800000000000001,"15min":0.41299999999999998},"max":{"1min":0.91900000000000004,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.45600000000000002}]},{"osd":6,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67700000000000005,"15min":0.67300000000000004},"min":{"1min":0.52300000000000002,"5min":0.443,"15min":0.40600000000000003},"max":{"1min":0.81799999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68600000000000005,"15min":0.67700000000000005},"min":{"1min":0.49099999999999999,"5min":0.442,"15min":0.44},"max":{"1min":0.90400000000000003,"5min":1.05,"15min":1.05},"last":0.51400000000000001}]},{"osd":7,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71299999999999997,"15min":0.69799999999999995},"min":{"1min":0.55600000000000005,"5min":0.45200000000000001,"15min":0.42599999999999999},"max":{"1min":0.88600000000000001,"5min":1.167,"15min":1.167},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73199999999999998,"15min":0.72299999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.48399999999999999},"max":{"1min":0.876,"5min":1.024,"15min":1.024},"last":0.54000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575754,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311636,"kb_used_data":2252,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060204,"statfs":{"total":96636764160,"available":96317648896,"internally_reserved":0,"allocated":2306048,"data_stored":1172687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.39500000000000002,"15min":0.40100000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.25700000000000001},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.71699999999999997},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68999999999999995,"5min":0.70599999999999996,"15min":0.751},"last":0.379}]},{"osd":1,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.443,"15min":0.44900000000000001},"min":{"1min":0.33500000000000002,"5min":0.309,"15min":0.29299999999999998},"max":{"1min":0.68700000000000006,"5min":0.755,"15min":0.755},"last":0.437},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.32300000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.81799999999999995},"last":0.42699999999999999}]},{"osd":3,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39500000000000002,"15min":0.40699999999999997},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.76000000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.308,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.75800000000000001},"last":0.314}]},{"osd":4,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.626,"15min":0.63400000000000001},"min":{"1min":0.44900000000000001,"5min":0.42199999999999999,"15min":0.40100000000000002},"max":{"1min":0.88800000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60699999999999998,"15min":0.61899999999999999},"min":{"1min":0.42199999999999999,"5min":0.40999999999999998,"15min":0.377},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.94999999999999996},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63300000000000001,"15min":0.64400000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.97399999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64700000000000002,"15min":0.64800000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85599999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.628,"15min":0.63800000000000001},"min":{"1min":0.46200000000000002,"5min":0.434,"15min":0.41099999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.97799999999999998},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67000000000000004,"15min":0.67300000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67300000000000004,"15min":0.68799999999999994},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46000000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.96599999999999997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.504,"5min":0.49199999999999999,"15min":0.46200000000000002},"max":{"1min":0.97199999999999998,"5min":0.995,"15min":1.014},"last":0.68600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575754,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315724,"kb_used_data":2244,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94056116,"statfs":{"total":96636764160,"available":96313462784,"internally_reserved":0,"allocated":2297856,"data_stored":1172539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38500000000000001,"15min":0.375},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.311},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.41199999999999998,"15min":0.40899999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.59299999999999997,"5min":0.61099999999999999,"15min":0.66200000000000003},"last":0.32900000000000001}]},{"osd":1,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.40999999999999998,"15min":0.39700000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44800000000000001,"15min":0.441},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.28699999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.26100000000000001}]},{"osd":2,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.47699999999999998,"15min":0.46899999999999997},"min":{"1min":0.35099999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58299999999999996,"5min":0.70899999999999996,"15min":0.71599999999999997},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52000000000000002,"15min":0.51500000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73199999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63200000000000001,"15min":0.63500000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92800000000000005,"5min":1.081,"15min":1.081},"last":0.436},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64900000000000002,"15min":0.63800000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.64300000000000002,"15min":0.63500000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67100000000000004,"15min":0.66200000000000003},"min":{"1min":0.47399999999999998,"5min":0.46200000000000002,"15min":0.42399999999999999},"max":{"1min":0.99199999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.52300000000000002}]},{"osd":6,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68600000000000005,"15min":0.67900000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.40100000000000002},"max":{"1min":0.96999999999999997,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48599999999999999,"5min":0.47099999999999997,"15min":0.41499999999999998},"max":{"1min":0.84299999999999997,"5min":1.206,"15min":1.206},"last":0.48499999999999999}]},{"osd":7,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.44800000000000001},"max":{"1min":0.98599999999999999,"5min":1.131,"15min":1.131},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70599999999999996,"15min":0.69499999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.44800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575754,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303440,"kb_used_data":2248,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068400,"statfs":{"total":96636764160,"available":96326041600,"internally_reserved":0,"allocated":2301952,"data_stored":1173149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54200000000000004,"15min":0.55400000000000005},"min":{"1min":0.31900000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77200000000000002,"5min":0.80600000000000005,"15min":0.94799999999999995},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.26900000000000002},"max":{"1min":0.71399999999999997,"5min":0.82599999999999996,"15min":0.83699999999999997},"last":0.436}]},{"osd":1,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54800000000000004,"15min":0.55100000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79200000000000004,"5min":0.92400000000000004,"15min":1.006},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56200000000000006,"15min":0.56399999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70999999999999996,"5min":0.79300000000000004,"15min":0.82299999999999995},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57799999999999996,"15min":0.58699999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35499999999999998},"max":{"1min":0.68700000000000006,"5min":0.82399999999999995,"15min":0.85299999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.59999999999999998,"15min":0.61499999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70099999999999996,"5min":0.95299999999999996,"15min":1.0429999999999999},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54400000000000004,"15min":0.55100000000000005},"min":{"1min":0.35799999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69399999999999995,"5min":0.78100000000000003,"15min":0.79900000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73899999999999999,"5min":0.79600000000000004,"15min":1.1679999999999999},"last":0.49299999999999999}]},{"osd":5,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.27600000000000002},"max":{"1min":0.58399999999999996,"5min":0.71099999999999997,"15min":0.80700000000000005},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46200000000000002,"15min":0.45900000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.63500000000000001,"5min":0.68100000000000005,"15min":1.3919999999999999},"last":0.34799999999999998}]},{"osd":6,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.50600000000000001,"15min":0.496},"min":{"1min":0.316,"5min":0.316,"15min":0.31},"max":{"1min":0.64800000000000002,"5min":0.83599999999999997,"15min":0.93300000000000005},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54900000000000004,"15min":0.54400000000000004},"min":{"1min":0.41499999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67600000000000005,"5min":0.78100000000000003,"15min":0.92500000000000004},"last":0.42399999999999999}]},{"osd":7,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51300000000000001,"15min":0.51900000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30099999999999999},"max":{"1min":0.70099999999999996,"5min":0.85699999999999998,"15min":1.246},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.41499999999999998,"5min":0.39900000000000002,"15min":0.371},"max":{"1min":0.72299999999999998,"5min":0.88900000000000001,"15min":1.321},"last":0.51300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575754,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307532,"kb_used_data":2244,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064308,"statfs":{"total":96636764160,"available":96321851392,"internally_reserved":0,"allocated":2297856,"data_stored":1173397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.54300000000000004,"15min":0.55000000000000004},"min":{"1min":0.34799999999999998,"5min":0.33400000000000002,"15min":0.30099999999999999},"max":{"1min":0.59999999999999998,"5min":0.73799999999999999,"15min":0.81899999999999995},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.54700000000000004,"15min":0.55000000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.30399999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.59099999999999997}]},{"osd":1,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.34799999999999998,"5min":0.33200000000000002,"15min":0.29499999999999998},"max":{"1min":0.72299999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.55800000000000005,"15min":0.56399999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.69399999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.73999999999999999}]},{"osd":2,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.376,"5min":0.372,"15min":0.35099999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.35299999999999998},"max":{"1min":0.66500000000000004,"5min":0.84999999999999998,"15min":0.876},"last":0.72199999999999998}]},{"osd":3,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.622}]},{"osd":4,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.441,"15min":0.437},"min":{"1min":0.309,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.47399999999999998,"15min":0.46700000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.42799999999999999}]},{"osd":6,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48199999999999998,"15min":0.47899999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55700000000000005,"15min":0.54900000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.313},"max":{"1min":0.73499999999999999,"5min":0.76700000000000002,"15min":0.83499999999999996},"last":0.50600000000000001}]},{"osd":7,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.54300000000000004,"15min":0.52600000000000002},"min":{"1min":0.33300000000000002,"5min":0.313,"15min":0.313},"max":{"1min":3.2240000000000002,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.59099999999999997,"15min":0.57899999999999996},"min":{"1min":0.42999999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":3.1659999999999999,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.51700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T18:23:20.636 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T18:23:20.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.766+0000 7fc6c47de700 1 Processor -- start 2023-11-30T18:23:21.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.766+0000 7fc6c47de700 1 -- start start 2023-11-30T18:23:21.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.767+0000 7fc6c47de700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc6bc1548c0 0x7fc6bc06a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:21.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.767+0000 7fc6c47de700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc6bc0c6e30 0x7fc6bc0c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:21.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.767+0000 7fc6c47de700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6bc0c69a0 con 0x7fc6bc1544e0 2023-11-30T18:23:21.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.767+0000 7fc6c47de700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6bc0c13a0 con 0x7fc6bc1548c0 2023-11-30T18:23:21.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.767+0000 7fc6c47de700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6bc0c1680 con 0x7fc6bc0c6e30 2023-11-30T18:23:21.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.768+0000 7fc6c1d79700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc6bc1548c0 0x7fc6bc06a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:21.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.768+0000 7fc6c1d79700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc6bc1548c0 0x7fc6bc06a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42078/0 (socket says 172.21.15.49:42078) 2023-11-30T18:23:21.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.768+0000 7fc6c1d79700 1 -- 172.21.15.49:0/3074088357 learned_addr learned my addr 172.21.15.49:0/3074088357 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:21.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.768+0000 7fc6c2d7b700 1 --2- 172.21.15.49:0/3074088357 >> v2:172.21.15.115:3300/0 conn(0x7fc6bc0c6e30 0x7fc6bc0c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:21.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.768+0000 7fc6c1d79700 1 -- 172.21.15.49:0/3074088357 >> v2:172.21.15.115:3300/0 conn(0x7fc6bc0c6e30 msgr2=0x7fc6bc0c72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:21.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.768+0000 7fc6c1d79700 1 --2- 172.21.15.49:0/3074088357 >> v2:172.21.15.115:3300/0 conn(0x7fc6bc0c6e30 0x7fc6bc0c72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:21.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.768+0000 7fc6c1d79700 1 -- 172.21.15.49:0/3074088357 >> v1:172.21.15.115:6789/0 conn(0x7fc6bc1544e0 legacy=0x7fc6bc0c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:21.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.768+0000 7fc6c1d79700 1 -- 172.21.15.49:0/3074088357 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6bc0c6630 con 0x7fc6bc1548c0 2023-11-30T18:23:21.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.768+0000 7fc6c1d79700 1 --2- 172.21.15.49:0/3074088357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6bc1548c0 0x7fc6bc06a610 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7fc6bc0cb240 tx=0x7fc6b00090f0).ready entity=mon.0 client_cookie=7e1ee9eb46a4ea30 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:21.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.768+0000 7fc6c1578700 1 -- 172.21.15.49:0/3074088357 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b000b520 con 0x7fc6bc1548c0 2023-11-30T18:23:21.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.768+0000 7fc6c1578700 1 -- 172.21.15.49:0/3074088357 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b000b680 con 0x7fc6bc1548c0 2023-11-30T18:23:21.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.768+0000 7fc6c1578700 1 -- 172.21.15.49:0/3074088357 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b000ba00 con 0x7fc6bc1548c0 2023-11-30T18:23:21.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.769+0000 7fc6c47de700 1 -- 172.21.15.49:0/3074088357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6bc1548c0 msgr2=0x7fc6bc06a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:21.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.769+0000 7fc6c47de700 1 --2- 172.21.15.49:0/3074088357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6bc1548c0 0x7fc6bc06a610 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7fc6bc0cb240 tx=0x7fc6b00090f0).stop 2023-11-30T18:23:21.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.769+0000 7fc6c47de700 1 -- 172.21.15.49:0/3074088357 shutdown_connections 2023-11-30T18:23:21.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.769+0000 7fc6c47de700 1 --2- 172.21.15.49:0/3074088357 >> v2:172.21.15.115:3300/0 conn(0x7fc6bc0c6e30 0x7fc6bc0c72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:21.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.769+0000 7fc6c47de700 1 --2- 172.21.15.49:0/3074088357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6bc1548c0 0x7fc6bc06a610 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:21.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.769+0000 7fc6c47de700 1 -- 172.21.15.49:0/3074088357 >> 172.21.15.49:0/3074088357 conn(0x7fc6bc085020 msgr2=0x7fc6bc094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:21.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.769+0000 7fc6c47de700 1 -- 172.21.15.49:0/3074088357 shutdown_connections 2023-11-30T18:23:21.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.769+0000 7fc6c47de700 1 -- 172.21.15.49:0/3074088357 wait complete. 2023-11-30T18:23:21.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.770+0000 7fc6c47de700 1 Processor -- start 2023-11-30T18:23:21.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.770+0000 7fc6c47de700 1 -- start start 2023-11-30T18:23:21.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.771+0000 7fc6c47de700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6bc0c6e30 0x7fc6bc152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:21.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.771+0000 7fc6c47de700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6bc1544e0 0x7fc6bc095350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:21.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.771+0000 7fc6c47de700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6bc1548c0 0x7fc6bc0a8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:21.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.771+0000 7fc6c47de700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc096fd0 con 0x7fc6bc1544e0 2023-11-30T18:23:21.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.771+0000 7fc6c47de700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc0972b0 con 0x7fc6bc0c6e30 2023-11-30T18:23:21.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.771+0000 7fc6c47de700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc095d30 con 0x7fc6bc1548c0 2023-11-30T18:23:21.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.771+0000 7fc6c1d79700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6bc1544e0 0x7fc6bc095350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:21.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.771+0000 7fc6c257a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6bc0c6e30 0x7fc6bc152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:21.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.771+0000 7fc6c1d79700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6bc1544e0 0x7fc6bc095350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42084/0 (socket says 172.21.15.49:42084) 2023-11-30T18:23:21.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.771+0000 7fc6c1d79700 1 -- 172.21.15.49:0/3011078639 learned_addr learned my addr 172.21.15.49:0/3011078639 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:21.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.771+0000 7fc6c2d7b700 1 --2- 172.21.15.49:0/3011078639 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6bc1548c0 0x7fc6bc0a8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:21.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.771+0000 7fc6c1d79700 1 -- 172.21.15.49:0/3011078639 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6bc1548c0 msgr2=0x7fc6bc0a8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:21.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.771+0000 7fc6c1d79700 1 --2- 172.21.15.49:0/3011078639 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6bc1548c0 0x7fc6bc0a8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:21.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.771+0000 7fc6c1d79700 1 -- 172.21.15.49:0/3011078639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6bc0c6e30 msgr2=0x7fc6bc152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:21.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.771+0000 7fc6c1d79700 1 --2- 172.21.15.49:0/3011078639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6bc0c6e30 0x7fc6bc152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:21.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.771+0000 7fc6c1d79700 1 -- 172.21.15.49:0/3011078639 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b0009370 con 0x7fc6bc1544e0 2023-11-30T18:23:21.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.771+0000 7fc6c257a700 1 --2- 172.21.15.49:0/3011078639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6bc0c6e30 0x7fc6bc152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:23:21.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.772+0000 7fc6c1d79700 1 --2- 172.21.15.49:0/3011078639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6bc1544e0 0x7fc6bc095350 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7fc6bc05fb30 tx=0x7fc6b0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:21.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.772+0000 7fc6ba7fc700 1 -- 172.21.15.49:0/3011078639 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0000bc0 con 0x7fc6bc1544e0 2023-11-30T18:23:21.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.772+0000 7fc6ba7fc700 1 -- 172.21.15.49:0/3011078639 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b000b7f0 con 0x7fc6bc1544e0 2023-11-30T18:23:21.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.772+0000 7fc6ba7fc700 1 -- 172.21.15.49:0/3011078639 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0000d20 con 0x7fc6bc1544e0 2023-11-30T18:23:21.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.772+0000 7fc6c47de700 1 -- 172.21.15.49:0/3011078639 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6bc096010 con 0x7fc6bc1544e0 2023-11-30T18:23:21.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.772+0000 7fc6c47de700 1 -- 172.21.15.49:0/3011078639 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6bc152d10 con 0x7fc6bc1544e0 2023-11-30T18:23:21.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.773+0000 7fc6c47de700 1 -- 172.21.15.49:0/3011078639 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6bc06c860 con 0x7fc6bc1544e0 2023-11-30T18:23:21.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.773+0000 7fc6ba7fc700 1 -- 172.21.15.49:0/3011078639 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc6b001d890 con 0x7fc6bc1544e0 2023-11-30T18:23:21.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.774+0000 7fc6ba7fc700 1 --2- 172.21.15.49:0/3011078639 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc6a805f270 0x7fc6a8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:21.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.774+0000 7fc6ba7fc700 1 -- 172.21.15.49:0/3011078639 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fc6b007c140 con 0x7fc6bc1544e0 2023-11-30T18:23:21.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.774+0000 7fc6c257a700 1 --2- 172.21.15.49:0/3011078639 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc6a805f270 0x7fc6a8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:21.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.774+0000 7fc6c257a700 1 --2- 172.21.15.49:0/3011078639 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc6a805f270 0x7fc6a8061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fc6b4007fd0 tx=0x7fc6b4009040).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:21.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.778+0000 7fc6ba7fc700 1 -- 172.21.15.49:0/3011078639 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc6b004d250 con 0x7fc6bc1544e0 2023-11-30T18:23:21.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.944+0000 7fc6c47de700 1 -- 172.21.15.49:0/3011078639 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc6bc0973f0 con 0x7fc6a805f270 2023-11-30T18:23:21.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.955+0000 7fc6ba7fc700 1 -- 172.21.15.49:0/3011078639 <== mgr.7394 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362329 (secure 0 0 0) 0x7fc6bc0973f0 con 0x7fc6a805f270 2023-11-30T18:23:21.073 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:23:21.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.958+0000 7fc6c47de700 1 -- 172.21.15.49:0/3011078639 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc6a805f270 msgr2=0x7fc6a8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:21.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.958+0000 7fc6c47de700 1 --2- 172.21.15.49:0/3011078639 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc6a805f270 0x7fc6a8061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fc6b4007fd0 tx=0x7fc6b4009040).stop 2023-11-30T18:23:21.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.958+0000 7fc6c47de700 1 -- 172.21.15.49:0/3011078639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6bc1544e0 msgr2=0x7fc6bc095350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:21.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.958+0000 7fc6c47de700 1 --2- 172.21.15.49:0/3011078639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6bc1544e0 0x7fc6bc095350 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7fc6bc05fb30 tx=0x7fc6b0017000).stop 2023-11-30T18:23:21.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.958+0000 7fc6c47de700 1 -- 172.21.15.49:0/3011078639 shutdown_connections 2023-11-30T18:23:21.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.958+0000 7fc6c47de700 1 --2- 172.21.15.49:0/3011078639 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6bc1548c0 0x7fc6bc0a8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:21.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.958+0000 7fc6c47de700 1 --2- 172.21.15.49:0/3011078639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6bc0c6e30 0x7fc6bc152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:21.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.958+0000 7fc6c47de700 1 --2- 172.21.15.49:0/3011078639 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fc6a805f270 0x7fc6a8061730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:21.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.958+0000 7fc6c47de700 1 --2- 172.21.15.49:0/3011078639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6bc1544e0 0x7fc6bc095350 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:21.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.958+0000 7fc6c47de700 1 -- 172.21.15.49:0/3011078639 >> 172.21.15.49:0/3011078639 conn(0x7fc6bc085020 msgr2=0x7fc6bc0c4340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:21.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.958+0000 7fc6c47de700 1 -- 172.21.15.49:0/3011078639 shutdown_connections 2023-11-30T18:23:21.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:20.958+0000 7fc6c47de700 1 -- 172.21.15.49:0/3011078639 wait complete. 2023-11-30T18:23:21.077 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T18:23:21.078 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-11-30T18:23:19.228320+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":221,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2464384,"kb_used_data":17984,"kb_used_omap":0,"kb_used_meta":2446336,"kb_avail":752510336,"statfs":{"total":773094113280,"available":770570584064,"internally_reserved":0,"allocated":18415616,"data_stored":9384652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2505048064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13567,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-61,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.004656"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128500+0000","last_change":"2023-11-30T18:23:12.121637+0000","last_active":"2023-11-30T18:23:12.128500+0000","last_peered":"2023-11-30T18:23:12.128500+0000","last_clean":"2023-11-30T18:23:12.128500+0000","last_became_active":"2023-11-30T18:23:12.121177+0000","last_became_peered":"2023-11-30T18:23:12.121177+0000","last_unstale":"2023-11-30T18:23:12.128500+0000","last_undegraded":"2023-11-30T18:23:12.128500+0000","last_fullsized":"2023-11-30T18:23:12.128500+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3f","version":"183'3","reported_seq":13,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120488+0000","last_change":"2023-11-30T18:23:11.729396+0000","last_active":"2023-11-30T18:23:12.120488+0000","last_peered":"2023-11-30T18:23:12.120488+0000","last_clean":"2023-11-30T18:23:12.120488+0000","last_became_active":"2023-11-30T18:23:11.729108+0000","last_became_peered":"2023-11-30T18:23:11.729108+0000","last_unstale":"2023-11-30T18:23:12.120488+0000","last_undegraded":"2023-11-30T18:23:12.120488+0000","last_fullsized":"2023-11-30T18:23:12.120488+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120073+0000","last_change":"2023-11-30T18:23:12.118530+0000","last_active":"2023-11-30T18:23:12.120073+0000","last_peered":"2023-11-30T18:23:12.120073+0000","last_clean":"2023-11-30T18:23:12.120073+0000","last_became_active":"2023-11-30T18:23:12.118224+0000","last_became_peered":"2023-11-30T18:23:12.118224+0000","last_unstale":"2023-11-30T18:23:12.120073+0000","last_undegraded":"2023-11-30T18:23:12.120073+0000","last_fullsized":"2023-11-30T18:23:12.120073+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.104272+0000","last_change":"2023-11-30T18:23:11.724379+0000","last_active":"2023-11-30T18:23:12.104272+0000","last_peered":"2023-11-30T18:23:12.104272+0000","last_clean":"2023-11-30T18:23:12.104272+0000","last_became_active":"2023-11-30T18:23:11.724081+0000","last_became_peered":"2023-11-30T18:23:11.724081+0000","last_unstale":"2023-11-30T18:23:12.104272+0000","last_undegraded":"2023-11-30T18:23:12.104272+0000","last_fullsized":"2023-11-30T18:23:12.104272+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112554+0000","last_change":"2023-11-30T18:23:12.108411+0000","last_active":"2023-11-30T18:23:12.112554+0000","last_peered":"2023-11-30T18:23:12.112554+0000","last_clean":"2023-11-30T18:23:12.112554+0000","last_became_active":"2023-11-30T18:23:12.108120+0000","last_became_peered":"2023-11-30T18:23:12.108120+0000","last_unstale":"2023-11-30T18:23:12.112554+0000","last_undegraded":"2023-11-30T18:23:12.112554+0000","last_fullsized":"2023-11-30T18:23:12.112554+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.106126+0000","last_change":"2023-11-30T18:23:11.723925+0000","last_active":"2023-11-30T18:23:12.106126+0000","last_peered":"2023-11-30T18:23:12.106126+0000","last_clean":"2023-11-30T18:23:12.106126+0000","last_became_active":"2023-11-30T18:23:11.723615+0000","last_became_peered":"2023-11-30T18:23:11.723615+0000","last_unstale":"2023-11-30T18:23:12.106126+0000","last_undegraded":"2023-11-30T18:23:12.106126+0000","last_fullsized":"2023-11-30T18:23:12.106126+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120555+0000","last_change":"2023-11-30T18:23:12.112331+0000","last_active":"2023-11-30T18:23:12.120555+0000","last_peered":"2023-11-30T18:23:12.120555+0000","last_clean":"2023-11-30T18:23:12.120555+0000","last_became_active":"2023-11-30T18:23:12.111049+0000","last_became_peered":"2023-11-30T18:23:12.111049+0000","last_unstale":"2023-11-30T18:23:12.120555+0000","last_undegraded":"2023-11-30T18:23:12.120555+0000","last_fullsized":"2023-11-30T18:23:12.120555+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"183'2","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114501+0000","last_change":"2023-11-30T18:23:11.727774+0000","last_active":"2023-11-30T18:23:12.114501+0000","last_peered":"2023-11-30T18:23:12.114501+0000","last_clean":"2023-11-30T18:23:12.114501+0000","last_became_active":"2023-11-30T18:23:11.727453+0000","last_became_peered":"2023-11-30T18:23:11.727453+0000","last_unstale":"2023-11-30T18:23:12.114501+0000","last_undegraded":"2023-11-30T18:23:12.114501+0000","last_fullsized":"2023-11-30T18:23:12.114501+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.127552+0000","last_change":"2023-11-30T18:23:12.120369+0000","last_active":"2023-11-30T18:23:12.127552+0000","last_peered":"2023-11-30T18:23:12.127552+0000","last_clean":"2023-11-30T18:23:12.127552+0000","last_became_active":"2023-11-30T18:23:12.119333+0000","last_became_peered":"2023-11-30T18:23:12.119333+0000","last_unstale":"2023-11-30T18:23:12.127552+0000","last_undegraded":"2023-11-30T18:23:12.127552+0000","last_fullsized":"2023-11-30T18:23:12.127552+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128170+0000","last_change":"2023-11-30T18:23:11.730906+0000","last_active":"2023-11-30T18:23:12.128170+0000","last_peered":"2023-11-30T18:23:12.128170+0000","last_clean":"2023-11-30T18:23:12.128170+0000","last_became_active":"2023-11-30T18:23:11.729501+0000","last_became_peered":"2023-11-30T18:23:11.729501+0000","last_unstale":"2023-11-30T18:23:12.128170+0000","last_undegraded":"2023-11-30T18:23:12.128170+0000","last_fullsized":"2023-11-30T18:23:12.128170+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120886+0000","last_change":"2023-11-30T18:23:12.118680+0000","last_active":"2023-11-30T18:23:12.120886+0000","last_peered":"2023-11-30T18:23:12.120886+0000","last_clean":"2023-11-30T18:23:12.120886+0000","last_became_active":"2023-11-30T18:23:12.118358+0000","last_became_peered":"2023-11-30T18:23:12.118358+0000","last_unstale":"2023-11-30T18:23:12.120886+0000","last_undegraded":"2023-11-30T18:23:12.120886+0000","last_fullsized":"2023-11-30T18:23:12.120886+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114112+0000","last_change":"2023-11-30T18:23:11.732949+0000","last_active":"2023-11-30T18:23:12.114112+0000","last_peered":"2023-11-30T18:23:12.114112+0000","last_clean":"2023-11-30T18:23:12.114112+0000","last_became_active":"2023-11-30T18:23:11.732627+0000","last_became_peered":"2023-11-30T18:23:11.732627+0000","last_unstale":"2023-11-30T18:23:12.114112+0000","last_undegraded":"2023-11-30T18:23:12.114112+0000","last_fullsized":"2023-11-30T18:23:12.114112+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.123862+0000","last_change":"2023-11-30T18:23:12.121133+0000","last_active":"2023-11-30T18:23:12.123862+0000","last_peered":"2023-11-30T18:23:12.123862+0000","last_clean":"2023-11-30T18:23:12.123862+0000","last_became_active":"2023-11-30T18:23:12.120811+0000","last_became_peered":"2023-11-30T18:23:12.120811+0000","last_unstale":"2023-11-30T18:23:12.123862+0000","last_undegraded":"2023-11-30T18:23:12.123862+0000","last_fullsized":"2023-11-30T18:23:12.123862+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105568+0000","last_change":"2023-11-30T18:23:11.732157+0000","last_active":"2023-11-30T18:23:12.105568+0000","last_peered":"2023-11-30T18:23:12.105568+0000","last_clean":"2023-11-30T18:23:12.105568+0000","last_became_active":"2023-11-30T18:23:11.731678+0000","last_became_peered":"2023-11-30T18:23:11.731678+0000","last_unstale":"2023-11-30T18:23:12.105568+0000","last_undegraded":"2023-11-30T18:23:12.105568+0000","last_fullsized":"2023-11-30T18:23:12.105568+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124562+0000","last_change":"2023-11-30T18:23:12.121281+0000","last_active":"2023-11-30T18:23:12.124562+0000","last_peered":"2023-11-30T18:23:12.124562+0000","last_clean":"2023-11-30T18:23:12.124562+0000","last_became_active":"2023-11-30T18:23:12.119940+0000","last_became_peered":"2023-11-30T18:23:12.119940+0000","last_unstale":"2023-11-30T18:23:12.124562+0000","last_undegraded":"2023-11-30T18:23:12.124562+0000","last_fullsized":"2023-11-30T18:23:12.124562+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.099560+0000","last_change":"2023-11-30T18:23:11.729413+0000","last_active":"2023-11-30T18:23:12.099560+0000","last_peered":"2023-11-30T18:23:12.099560+0000","last_clean":"2023-11-30T18:23:12.099560+0000","last_became_active":"2023-11-30T18:23:11.729096+0000","last_became_peered":"2023-11-30T18:23:11.729096+0000","last_unstale":"2023-11-30T18:23:12.099560+0000","last_undegraded":"2023-11-30T18:23:12.099560+0000","last_fullsized":"2023-11-30T18:23:12.099560+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128518+0000","last_change":"2023-11-30T18:23:12.122267+0000","last_active":"2023-11-30T18:23:12.128518+0000","last_peered":"2023-11-30T18:23:12.128518+0000","last_clean":"2023-11-30T18:23:12.128518+0000","last_became_active":"2023-11-30T18:23:12.118388+0000","last_became_peered":"2023-11-30T18:23:12.118388+0000","last_unstale":"2023-11-30T18:23:12.128518+0000","last_undegraded":"2023-11-30T18:23:12.128518+0000","last_fullsized":"2023-11-30T18:23:12.128518+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.103587+0000","last_change":"2023-11-30T18:23:11.731558+0000","last_active":"2023-11-30T18:23:12.103587+0000","last_peered":"2023-11-30T18:23:12.103587+0000","last_clean":"2023-11-30T18:23:12.103587+0000","last_became_active":"2023-11-30T18:23:11.731257+0000","last_became_peered":"2023-11-30T18:23:11.731257+0000","last_unstale":"2023-11-30T18:23:12.103587+0000","last_undegraded":"2023-11-30T18:23:12.103587+0000","last_fullsized":"2023-11-30T18:23:12.103587+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124485+0000","last_change":"2023-11-30T18:23:12.119514+0000","last_active":"2023-11-30T18:23:12.124485+0000","last_peered":"2023-11-30T18:23:12.124485+0000","last_clean":"2023-11-30T18:23:12.124485+0000","last_became_active":"2023-11-30T18:23:12.119170+0000","last_became_peered":"2023-11-30T18:23:12.119170+0000","last_unstale":"2023-11-30T18:23:12.124485+0000","last_undegraded":"2023-11-30T18:23:12.124485+0000","last_fullsized":"2023-11-30T18:23:12.124485+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.118785+0000","last_change":"2023-11-30T18:23:11.733798+0000","last_active":"2023-11-30T18:23:12.118785+0000","last_peered":"2023-11-30T18:23:12.118785+0000","last_clean":"2023-11-30T18:23:12.118785+0000","last_became_active":"2023-11-30T18:23:11.733491+0000","last_became_peered":"2023-11-30T18:23:11.733491+0000","last_unstale":"2023-11-30T18:23:12.118785+0000","last_undegraded":"2023-11-30T18:23:12.118785+0000","last_fullsized":"2023-11-30T18:23:12.118785+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.113796+0000","last_change":"2023-11-30T18:23:12.111493+0000","last_active":"2023-11-30T18:23:12.113796+0000","last_peered":"2023-11-30T18:23:12.113796+0000","last_clean":"2023-11-30T18:23:12.113796+0000","last_became_active":"2023-11-30T18:23:12.111224+0000","last_became_peered":"2023-11-30T18:23:12.111224+0000","last_unstale":"2023-11-30T18:23:12.113796+0000","last_undegraded":"2023-11-30T18:23:12.113796+0000","last_fullsized":"2023-11-30T18:23:12.113796+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101233+0000","last_change":"2023-11-30T18:23:11.732288+0000","last_active":"2023-11-30T18:23:12.101233+0000","last_peered":"2023-11-30T18:23:12.101233+0000","last_clean":"2023-11-30T18:23:12.101233+0000","last_became_active":"2023-11-30T18:23:11.731998+0000","last_became_peered":"2023-11-30T18:23:11.731998+0000","last_unstale":"2023-11-30T18:23:12.101233+0000","last_undegraded":"2023-11-30T18:23:12.101233+0000","last_fullsized":"2023-11-30T18:23:12.101233+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.123377+0000","last_change":"2023-11-30T18:23:12.118762+0000","last_active":"2023-11-30T18:23:12.123377+0000","last_peered":"2023-11-30T18:23:12.123377+0000","last_clean":"2023-11-30T18:23:12.123377+0000","last_became_active":"2023-11-30T18:23:12.118456+0000","last_became_peered":"2023-11-30T18:23:12.118456+0000","last_unstale":"2023-11-30T18:23:12.123377+0000","last_undegraded":"2023-11-30T18:23:12.123377+0000","last_fullsized":"2023-11-30T18:23:12.123377+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.34","version":"183'4","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.133525+0000","last_change":"2023-11-30T18:23:11.735207+0000","last_active":"2023-11-30T18:23:12.133525+0000","last_peered":"2023-11-30T18:23:12.133525+0000","last_clean":"2023-11-30T18:23:12.133525+0000","last_became_active":"2023-11-30T18:23:11.734947+0000","last_became_peered":"2023-11-30T18:23:11.734947+0000","last_unstale":"2023-11-30T18:23:12.133525+0000","last_undegraded":"2023-11-30T18:23:12.133525+0000","last_fullsized":"2023-11-30T18:23:12.133525+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112616+0000","last_change":"2023-11-30T18:23:12.110171+0000","last_active":"2023-11-30T18:23:12.112616+0000","last_peered":"2023-11-30T18:23:12.112616+0000","last_clean":"2023-11-30T18:23:12.112616+0000","last_became_active":"2023-11-30T18:23:12.109894+0000","last_became_peered":"2023-11-30T18:23:12.109894+0000","last_unstale":"2023-11-30T18:23:12.112616+0000","last_undegraded":"2023-11-30T18:23:12.112616+0000","last_fullsized":"2023-11-30T18:23:12.112616+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.33","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128319+0000","last_change":"2023-11-30T18:23:11.732423+0000","last_active":"2023-11-30T18:23:12.128319+0000","last_peered":"2023-11-30T18:23:12.128319+0000","last_clean":"2023-11-30T18:23:12.128319+0000","last_became_active":"2023-11-30T18:23:11.732141+0000","last_became_peered":"2023-11-30T18:23:11.732141+0000","last_unstale":"2023-11-30T18:23:12.128319+0000","last_undegraded":"2023-11-30T18:23:12.128319+0000","last_fullsized":"2023-11-30T18:23:12.128319+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114206+0000","last_change":"2023-11-30T18:23:12.113067+0000","last_active":"2023-11-30T18:23:12.114206+0000","last_peered":"2023-11-30T18:23:12.114206+0000","last_clean":"2023-11-30T18:23:12.114206+0000","last_became_active":"2023-11-30T18:23:12.112084+0000","last_became_peered":"2023-11-30T18:23:12.112084+0000","last_unstale":"2023-11-30T18:23:12.114206+0000","last_undegraded":"2023-11-30T18:23:12.114206+0000","last_fullsized":"2023-11-30T18:23:12.114206+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101969+0000","last_change":"2023-11-30T18:23:11.729733+0000","last_active":"2023-11-30T18:23:12.101969+0000","last_peered":"2023-11-30T18:23:12.101969+0000","last_clean":"2023-11-30T18:23:12.101969+0000","last_became_active":"2023-11-30T18:23:11.728411+0000","last_became_peered":"2023-11-30T18:23:11.728411+0000","last_unstale":"2023-11-30T18:23:12.101969+0000","last_undegraded":"2023-11-30T18:23:12.101969+0000","last_fullsized":"2023-11-30T18:23:12.101969+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.127847+0000","last_change":"2023-11-30T18:23:12.117850+0000","last_active":"2023-11-30T18:23:12.127847+0000","last_peered":"2023-11-30T18:23:12.127847+0000","last_clean":"2023-11-30T18:23:12.127847+0000","last_became_active":"2023-11-30T18:23:12.117557+0000","last_became_peered":"2023-11-30T18:23:12.117557+0000","last_unstale":"2023-11-30T18:23:12.127847+0000","last_undegraded":"2023-11-30T18:23:12.127847+0000","last_fullsized":"2023-11-30T18:23:12.127847+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114699+0000","last_change":"2023-11-30T18:23:11.731206+0000","last_active":"2023-11-30T18:23:12.114699+0000","last_peered":"2023-11-30T18:23:12.114699+0000","last_clean":"2023-11-30T18:23:12.114699+0000","last_became_active":"2023-11-30T18:23:11.730937+0000","last_became_peered":"2023-11-30T18:23:11.730937+0000","last_unstale":"2023-11-30T18:23:12.114699+0000","last_undegraded":"2023-11-30T18:23:12.114699+0000","last_fullsized":"2023-11-30T18:23:12.114699+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.116858+0000","last_change":"2023-11-30T18:23:12.115316+0000","last_active":"2023-11-30T18:23:12.116858+0000","last_peered":"2023-11-30T18:23:12.116858+0000","last_clean":"2023-11-30T18:23:12.116858+0000","last_became_active":"2023-11-30T18:23:12.114473+0000","last_became_peered":"2023-11-30T18:23:12.114473+0000","last_unstale":"2023-11-30T18:23:12.116858+0000","last_undegraded":"2023-11-30T18:23:12.116858+0000","last_fullsized":"2023-11-30T18:23:12.116858+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.30","version":"183'4","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.127276+0000","last_change":"2023-11-30T18:23:11.729498+0000","last_active":"2023-11-30T18:23:12.127276+0000","last_peered":"2023-11-30T18:23:12.127276+0000","last_clean":"2023-11-30T18:23:12.127276+0000","last_became_active":"2023-11-30T18:23:11.729221+0000","last_became_peered":"2023-11-30T18:23:11.729221+0000","last_unstale":"2023-11-30T18:23:12.127276+0000","last_undegraded":"2023-11-30T18:23:12.127276+0000","last_fullsized":"2023-11-30T18:23:12.127276+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.118300+0000","last_change":"2023-11-30T18:23:12.113823+0000","last_active":"2023-11-30T18:23:12.118300+0000","last_peered":"2023-11-30T18:23:12.118300+0000","last_clean":"2023-11-30T18:23:12.118300+0000","last_became_active":"2023-11-30T18:23:12.113041+0000","last_became_peered":"2023-11-30T18:23:12.113041+0000","last_unstale":"2023-11-30T18:23:12.118300+0000","last_undegraded":"2023-11-30T18:23:12.118300+0000","last_fullsized":"2023-11-30T18:23:12.118300+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120207+0000","last_change":"2023-11-30T18:23:11.737572+0000","last_active":"2023-11-30T18:23:12.120207+0000","last_peered":"2023-11-30T18:23:12.120207+0000","last_clean":"2023-11-30T18:23:12.120207+0000","last_became_active":"2023-11-30T18:23:11.737226+0000","last_became_peered":"2023-11-30T18:23:11.737226+0000","last_unstale":"2023-11-30T18:23:12.120207+0000","last_undegraded":"2023-11-30T18:23:12.120207+0000","last_fullsized":"2023-11-30T18:23:12.120207+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.136298+0000","last_change":"2023-11-30T18:23:12.131062+0000","last_active":"2023-11-30T18:23:12.136298+0000","last_peered":"2023-11-30T18:23:12.136298+0000","last_clean":"2023-11-30T18:23:12.136298+0000","last_became_active":"2023-11-30T18:23:12.130780+0000","last_became_peered":"2023-11-30T18:23:12.130780+0000","last_unstale":"2023-11-30T18:23:12.136298+0000","last_undegraded":"2023-11-30T18:23:12.136298+0000","last_fullsized":"2023-11-30T18:23:12.136298+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.104816+0000","last_change":"2023-11-30T18:23:11.726724+0000","last_active":"2023-11-30T18:23:12.104816+0000","last_peered":"2023-11-30T18:23:12.104816+0000","last_clean":"2023-11-30T18:23:12.104816+0000","last_became_active":"2023-11-30T18:23:11.726441+0000","last_became_peered":"2023-11-30T18:23:11.726441+0000","last_unstale":"2023-11-30T18:23:12.104816+0000","last_undegraded":"2023-11-30T18:23:12.104816+0000","last_fullsized":"2023-11-30T18:23:12.104816+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124700+0000","last_change":"2023-11-30T18:23:12.122966+0000","last_active":"2023-11-30T18:23:12.124700+0000","last_peered":"2023-11-30T18:23:12.124700+0000","last_clean":"2023-11-30T18:23:12.124700+0000","last_became_active":"2023-11-30T18:23:12.122442+0000","last_became_peered":"2023-11-30T18:23:12.122442+0000","last_unstale":"2023-11-30T18:23:12.124700+0000","last_undegraded":"2023-11-30T18:23:12.124700+0000","last_fullsized":"2023-11-30T18:23:12.124700+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.125158+0000","last_change":"2023-11-30T18:23:11.732298+0000","last_active":"2023-11-30T18:23:12.125158+0000","last_peered":"2023-11-30T18:23:12.125158+0000","last_clean":"2023-11-30T18:23:12.125158+0000","last_became_active":"2023-11-30T18:23:11.731767+0000","last_became_peered":"2023-11-30T18:23:11.731767+0000","last_unstale":"2023-11-30T18:23:12.125158+0000","last_undegraded":"2023-11-30T18:23:12.125158+0000","last_fullsized":"2023-11-30T18:23:12.125158+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.127778+0000","last_change":"2023-11-30T18:23:12.115086+0000","last_active":"2023-11-30T18:23:12.127778+0000","last_peered":"2023-11-30T18:23:12.127778+0000","last_clean":"2023-11-30T18:23:12.127778+0000","last_became_active":"2023-11-30T18:23:12.114614+0000","last_became_peered":"2023-11-30T18:23:12.114614+0000","last_unstale":"2023-11-30T18:23:12.127778+0000","last_undegraded":"2023-11-30T18:23:12.127778+0000","last_fullsized":"2023-11-30T18:23:12.127778+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.121943+0000","last_change":"2023-11-30T18:23:11.728290+0000","last_active":"2023-11-30T18:23:12.121943+0000","last_peered":"2023-11-30T18:23:12.121943+0000","last_clean":"2023-11-30T18:23:12.121943+0000","last_became_active":"2023-11-30T18:23:11.727972+0000","last_became_peered":"2023-11-30T18:23:11.727972+0000","last_unstale":"2023-11-30T18:23:12.121943+0000","last_undegraded":"2023-11-30T18:23:12.121943+0000","last_fullsized":"2023-11-30T18:23:12.121943+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.125287+0000","last_change":"2023-11-30T18:23:12.117183+0000","last_active":"2023-11-30T18:23:12.125287+0000","last_peered":"2023-11-30T18:23:12.125287+0000","last_clean":"2023-11-30T18:23:12.125287+0000","last_became_active":"2023-11-30T18:23:12.116864+0000","last_became_peered":"2023-11-30T18:23:12.116864+0000","last_unstale":"2023-11-30T18:23:12.125287+0000","last_undegraded":"2023-11-30T18:23:12.125287+0000","last_fullsized":"2023-11-30T18:23:12.125287+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.127634+0000","last_change":"2023-11-30T18:23:11.735658+0000","last_active":"2023-11-30T18:23:12.127634+0000","last_peered":"2023-11-30T18:23:12.127634+0000","last_clean":"2023-11-30T18:23:12.127634+0000","last_became_active":"2023-11-30T18:23:11.735382+0000","last_became_peered":"2023-11-30T18:23:11.735382+0000","last_unstale":"2023-11-30T18:23:12.127634+0000","last_undegraded":"2023-11-30T18:23:12.127634+0000","last_fullsized":"2023-11-30T18:23:12.127634+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112086+0000","last_change":"2023-11-30T18:23:12.110236+0000","last_active":"2023-11-30T18:23:12.112086+0000","last_peered":"2023-11-30T18:23:12.112086+0000","last_clean":"2023-11-30T18:23:12.112086+0000","last_became_active":"2023-11-30T18:23:12.108185+0000","last_became_peered":"2023-11-30T18:23:12.108185+0000","last_unstale":"2023-11-30T18:23:12.112086+0000","last_undegraded":"2023-11-30T18:23:12.112086+0000","last_fullsized":"2023-11-30T18:23:12.112086+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.102053+0000","last_change":"2023-11-30T18:23:11.728686+0000","last_active":"2023-11-30T18:23:12.102053+0000","last_peered":"2023-11-30T18:23:12.102053+0000","last_clean":"2023-11-30T18:23:12.102053+0000","last_became_active":"2023-11-30T18:23:11.728039+0000","last_became_peered":"2023-11-30T18:23:11.728039+0000","last_unstale":"2023-11-30T18:23:12.102053+0000","last_undegraded":"2023-11-30T18:23:12.102053+0000","last_fullsized":"2023-11-30T18:23:12.102053+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128740+0000","last_change":"2023-11-30T18:23:12.124153+0000","last_active":"2023-11-30T18:23:12.128740+0000","last_peered":"2023-11-30T18:23:12.128740+0000","last_clean":"2023-11-30T18:23:12.128740+0000","last_became_active":"2023-11-30T18:23:12.123877+0000","last_became_peered":"2023-11-30T18:23:12.123877+0000","last_unstale":"2023-11-30T18:23:12.128740+0000","last_undegraded":"2023-11-30T18:23:12.128740+0000","last_fullsized":"2023-11-30T18:23:12.128740+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101738+0000","last_change":"2023-11-30T18:23:11.727138+0000","last_active":"2023-11-30T18:23:12.101738+0000","last_peered":"2023-11-30T18:23:12.101738+0000","last_clean":"2023-11-30T18:23:12.101738+0000","last_became_active":"2023-11-30T18:23:11.726796+0000","last_became_peered":"2023-11-30T18:23:11.726796+0000","last_unstale":"2023-11-30T18:23:12.101738+0000","last_undegraded":"2023-11-30T18:23:12.101738+0000","last_fullsized":"2023-11-30T18:23:12.101738+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.126056+0000","last_change":"2023-11-30T18:23:12.124681+0000","last_active":"2023-11-30T18:23:12.126056+0000","last_peered":"2023-11-30T18:23:12.126056+0000","last_clean":"2023-11-30T18:23:12.126056+0000","last_became_active":"2023-11-30T18:23:12.124348+0000","last_became_peered":"2023-11-30T18:23:12.124348+0000","last_unstale":"2023-11-30T18:23:12.126056+0000","last_undegraded":"2023-11-30T18:23:12.126056+0000","last_fullsized":"2023-11-30T18:23:12.126056+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.116384+0000","last_change":"2023-11-30T18:23:11.734523+0000","last_active":"2023-11-30T18:23:12.116384+0000","last_peered":"2023-11-30T18:23:12.116384+0000","last_clean":"2023-11-30T18:23:12.116384+0000","last_became_active":"2023-11-30T18:23:11.734241+0000","last_became_peered":"2023-11-30T18:23:11.734241+0000","last_unstale":"2023-11-30T18:23:12.116384+0000","last_undegraded":"2023-11-30T18:23:12.116384+0000","last_fullsized":"2023-11-30T18:23:12.116384+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124583+0000","last_change":"2023-11-30T18:23:12.122081+0000","last_active":"2023-11-30T18:23:12.124583+0000","last_peered":"2023-11-30T18:23:12.124583+0000","last_clean":"2023-11-30T18:23:12.124583+0000","last_became_active":"2023-11-30T18:23:12.121493+0000","last_became_peered":"2023-11-30T18:23:12.121493+0000","last_unstale":"2023-11-30T18:23:12.124583+0000","last_undegraded":"2023-11-30T18:23:12.124583+0000","last_fullsized":"2023-11-30T18:23:12.124583+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.119133+0000","last_change":"2023-11-30T18:23:11.734920+0000","last_active":"2023-11-30T18:23:12.119133+0000","last_peered":"2023-11-30T18:23:12.119133+0000","last_clean":"2023-11-30T18:23:12.119133+0000","last_became_active":"2023-11-30T18:23:11.734578+0000","last_became_peered":"2023-11-30T18:23:11.734578+0000","last_unstale":"2023-11-30T18:23:12.119133+0000","last_undegraded":"2023-11-30T18:23:12.119133+0000","last_fullsized":"2023-11-30T18:23:12.119133+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.123244+0000","last_change":"2023-11-30T18:23:12.118073+0000","last_active":"2023-11-30T18:23:12.123244+0000","last_peered":"2023-11-30T18:23:12.123244+0000","last_clean":"2023-11-30T18:23:12.123244+0000","last_became_active":"2023-11-30T18:23:12.117796+0000","last_became_peered":"2023-11-30T18:23:12.117796+0000","last_unstale":"2023-11-30T18:23:12.123244+0000","last_undegraded":"2023-11-30T18:23:12.123244+0000","last_fullsized":"2023-11-30T18:23:12.123244+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101617+0000","last_change":"2023-11-30T18:23:11.728070+0000","last_active":"2023-11-30T18:23:12.101617+0000","last_peered":"2023-11-30T18:23:12.101617+0000","last_clean":"2023-11-30T18:23:12.101617+0000","last_became_active":"2023-11-30T18:23:11.727817+0000","last_became_peered":"2023-11-30T18:23:11.727817+0000","last_unstale":"2023-11-30T18:23:12.101617+0000","last_undegraded":"2023-11-30T18:23:12.101617+0000","last_fullsized":"2023-11-30T18:23:12.101617+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120898+0000","last_change":"2023-11-30T18:23:12.119472+0000","last_active":"2023-11-30T18:23:12.120898+0000","last_peered":"2023-11-30T18:23:12.120898+0000","last_clean":"2023-11-30T18:23:12.120898+0000","last_became_active":"2023-11-30T18:23:12.119192+0000","last_became_peered":"2023-11-30T18:23:12.119192+0000","last_unstale":"2023-11-30T18:23:12.120898+0000","last_undegraded":"2023-11-30T18:23:12.120898+0000","last_fullsized":"2023-11-30T18:23:12.120898+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.119296+0000","last_change":"2023-11-30T18:23:11.725649+0000","last_active":"2023-11-30T18:23:12.119296+0000","last_peered":"2023-11-30T18:23:12.119296+0000","last_clean":"2023-11-30T18:23:12.119296+0000","last_became_active":"2023-11-30T18:23:11.725358+0000","last_became_peered":"2023-11-30T18:23:11.725358+0000","last_unstale":"2023-11-30T18:23:12.119296+0000","last_undegraded":"2023-11-30T18:23:12.119296+0000","last_fullsized":"2023-11-30T18:23:12.119296+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.121579+0000","last_change":"2023-11-30T18:23:12.119529+0000","last_active":"2023-11-30T18:23:12.121579+0000","last_peered":"2023-11-30T18:23:12.121579+0000","last_clean":"2023-11-30T18:23:12.121579+0000","last_became_active":"2023-11-30T18:23:12.119258+0000","last_became_peered":"2023-11-30T18:23:12.119258+0000","last_unstale":"2023-11-30T18:23:12.121579+0000","last_undegraded":"2023-11-30T18:23:12.121579+0000","last_fullsized":"2023-11-30T18:23:12.121579+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.107434+0000","last_change":"2023-11-30T18:23:11.726054+0000","last_active":"2023-11-30T18:23:12.107434+0000","last_peered":"2023-11-30T18:23:12.107434+0000","last_clean":"2023-11-30T18:23:12.107434+0000","last_became_active":"2023-11-30T18:23:11.725740+0000","last_became_peered":"2023-11-30T18:23:11.725740+0000","last_unstale":"2023-11-30T18:23:12.107434+0000","last_undegraded":"2023-11-30T18:23:12.107434+0000","last_fullsized":"2023-11-30T18:23:12.107434+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.127528+0000","last_change":"2023-11-30T18:23:12.120197+0000","last_active":"2023-11-30T18:23:12.127528+0000","last_peered":"2023-11-30T18:23:12.127528+0000","last_clean":"2023-11-30T18:23:12.127528+0000","last_became_active":"2023-11-30T18:23:12.118933+0000","last_became_peered":"2023-11-30T18:23:12.118933+0000","last_unstale":"2023-11-30T18:23:12.127528+0000","last_undegraded":"2023-11-30T18:23:12.127528+0000","last_fullsized":"2023-11-30T18:23:12.127528+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.100712+0000","last_change":"2023-11-30T18:23:11.727466+0000","last_active":"2023-11-30T18:23:12.100712+0000","last_peered":"2023-11-30T18:23:12.100712+0000","last_clean":"2023-11-30T18:23:12.100712+0000","last_became_active":"2023-11-30T18:23:11.727184+0000","last_became_peered":"2023-11-30T18:23:11.727184+0000","last_unstale":"2023-11-30T18:23:12.100712+0000","last_undegraded":"2023-11-30T18:23:12.100712+0000","last_fullsized":"2023-11-30T18:23:12.100712+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.113593+0000","last_change":"2023-11-30T18:23:12.108335+0000","last_active":"2023-11-30T18:23:12.113593+0000","last_peered":"2023-11-30T18:23:12.113593+0000","last_clean":"2023-11-30T18:23:12.113593+0000","last_became_active":"2023-11-30T18:23:12.108065+0000","last_became_peered":"2023-11-30T18:23:12.108065+0000","last_unstale":"2023-11-30T18:23:12.113593+0000","last_undegraded":"2023-11-30T18:23:12.113593+0000","last_fullsized":"2023-11-30T18:23:12.113593+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.102104+0000","last_change":"2023-11-30T18:23:11.734962+0000","last_active":"2023-11-30T18:23:12.102104+0000","last_peered":"2023-11-30T18:23:12.102104+0000","last_clean":"2023-11-30T18:23:12.102104+0000","last_became_active":"2023-11-30T18:23:11.734489+0000","last_became_peered":"2023-11-30T18:23:11.734489+0000","last_unstale":"2023-11-30T18:23:12.102104+0000","last_undegraded":"2023-11-30T18:23:12.102104+0000","last_fullsized":"2023-11-30T18:23:12.102104+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124728+0000","last_change":"2023-11-30T18:23:12.118313+0000","last_active":"2023-11-30T18:23:12.124728+0000","last_peered":"2023-11-30T18:23:12.124728+0000","last_clean":"2023-11-30T18:23:12.124728+0000","last_became_active":"2023-11-30T18:23:12.114897+0000","last_became_peered":"2023-11-30T18:23:12.114897+0000","last_unstale":"2023-11-30T18:23:12.124728+0000","last_undegraded":"2023-11-30T18:23:12.124728+0000","last_fullsized":"2023-11-30T18:23:12.124728+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.103019+0000","last_change":"2023-11-30T18:23:11.728348+0000","last_active":"2023-11-30T18:23:12.103019+0000","last_peered":"2023-11-30T18:23:12.103019+0000","last_clean":"2023-11-30T18:23:12.103019+0000","last_became_active":"2023-11-30T18:23:11.728052+0000","last_became_peered":"2023-11-30T18:23:11.728052+0000","last_unstale":"2023-11-30T18:23:12.103019+0000","last_undegraded":"2023-11-30T18:23:12.103019+0000","last_fullsized":"2023-11-30T18:23:12.103019+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.115122+0000","last_change":"2023-11-30T18:23:12.112694+0000","last_active":"2023-11-30T18:23:12.115122+0000","last_peered":"2023-11-30T18:23:12.115122+0000","last_clean":"2023-11-30T18:23:12.115122+0000","last_became_active":"2023-11-30T18:23:12.112404+0000","last_became_peered":"2023-11-30T18:23:12.112404+0000","last_unstale":"2023-11-30T18:23:12.115122+0000","last_undegraded":"2023-11-30T18:23:12.115122+0000","last_fullsized":"2023-11-30T18:23:12.115122+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.116614+0000","last_change":"2023-11-30T18:23:11.733562+0000","last_active":"2023-11-30T18:23:12.116614+0000","last_peered":"2023-11-30T18:23:12.116614+0000","last_clean":"2023-11-30T18:23:12.116614+0000","last_became_active":"2023-11-30T18:23:11.733271+0000","last_became_peered":"2023-11-30T18:23:11.733271+0000","last_unstale":"2023-11-30T18:23:12.116614+0000","last_undegraded":"2023-11-30T18:23:12.116614+0000","last_fullsized":"2023-11-30T18:23:12.116614+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.122060+0000","last_change":"2023-11-30T18:23:12.120946+0000","last_active":"2023-11-30T18:23:12.122060+0000","last_peered":"2023-11-30T18:23:12.122060+0000","last_clean":"2023-11-30T18:23:12.122060+0000","last_became_active":"2023-11-30T18:23:12.120510+0000","last_became_peered":"2023-11-30T18:23:12.120510+0000","last_unstale":"2023-11-30T18:23:12.122060+0000","last_undegraded":"2023-11-30T18:23:12.122060+0000","last_fullsized":"2023-11-30T18:23:12.122060+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.118883+0000","last_change":"2023-11-30T18:23:11.722137+0000","last_active":"2023-11-30T18:23:12.118883+0000","last_peered":"2023-11-30T18:23:12.118883+0000","last_clean":"2023-11-30T18:23:12.118883+0000","last_became_active":"2023-11-30T18:23:11.721662+0000","last_became_peered":"2023-11-30T18:23:11.721662+0000","last_unstale":"2023-11-30T18:23:12.118883+0000","last_undegraded":"2023-11-30T18:23:12.118883+0000","last_fullsized":"2023-11-30T18:23:12.118883+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112020+0000","last_change":"2023-11-30T18:23:12.108920+0000","last_active":"2023-11-30T18:23:12.112020+0000","last_peered":"2023-11-30T18:23:12.112020+0000","last_clean":"2023-11-30T18:23:12.112020+0000","last_became_active":"2023-11-30T18:23:12.108658+0000","last_became_peered":"2023-11-30T18:23:12.108658+0000","last_unstale":"2023-11-30T18:23:12.112020+0000","last_undegraded":"2023-11-30T18:23:12.112020+0000","last_fullsized":"2023-11-30T18:23:12.112020+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.127959+0000","last_change":"2023-11-30T18:23:11.735560+0000","last_active":"2023-11-30T18:23:12.127959+0000","last_peered":"2023-11-30T18:23:12.127959+0000","last_clean":"2023-11-30T18:23:12.127959+0000","last_became_active":"2023-11-30T18:23:11.735257+0000","last_became_peered":"2023-11-30T18:23:11.735257+0000","last_unstale":"2023-11-30T18:23:12.127959+0000","last_undegraded":"2023-11-30T18:23:12.127959+0000","last_fullsized":"2023-11-30T18:23:12.127959+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.115218+0000","last_change":"2023-11-30T18:23:12.108356+0000","last_active":"2023-11-30T18:23:12.115218+0000","last_peered":"2023-11-30T18:23:12.115218+0000","last_clean":"2023-11-30T18:23:12.115218+0000","last_became_active":"2023-11-30T18:23:12.108073+0000","last_became_peered":"2023-11-30T18:23:12.108073+0000","last_unstale":"2023-11-30T18:23:12.115218+0000","last_undegraded":"2023-11-30T18:23:12.115218+0000","last_fullsized":"2023-11-30T18:23:12.115218+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"183'2","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128863+0000","last_change":"2023-11-30T18:23:11.735338+0000","last_active":"2023-11-30T18:23:12.128863+0000","last_peered":"2023-11-30T18:23:12.128863+0000","last_clean":"2023-11-30T18:23:12.128863+0000","last_became_active":"2023-11-30T18:23:11.735068+0000","last_became_peered":"2023-11-30T18:23:11.735068+0000","last_unstale":"2023-11-30T18:23:12.128863+0000","last_undegraded":"2023-11-30T18:23:12.128863+0000","last_fullsized":"2023-11-30T18:23:12.128863+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.130572+0000","last_change":"2023-11-30T18:23:12.128165+0000","last_active":"2023-11-30T18:23:12.130572+0000","last_peered":"2023-11-30T18:23:12.130572+0000","last_clean":"2023-11-30T18:23:12.130572+0000","last_became_active":"2023-11-30T18:23:12.127878+0000","last_became_peered":"2023-11-30T18:23:12.127878+0000","last_unstale":"2023-11-30T18:23:12.130572+0000","last_undegraded":"2023-11-30T18:23:12.130572+0000","last_fullsized":"2023-11-30T18:23:12.130572+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.100901+0000","last_change":"2023-11-30T18:23:11.734177+0000","last_active":"2023-11-30T18:23:12.100901+0000","last_peered":"2023-11-30T18:23:12.100901+0000","last_clean":"2023-11-30T18:23:12.100901+0000","last_became_active":"2023-11-30T18:23:11.733869+0000","last_became_peered":"2023-11-30T18:23:11.733869+0000","last_unstale":"2023-11-30T18:23:12.100901+0000","last_undegraded":"2023-11-30T18:23:12.100901+0000","last_fullsized":"2023-11-30T18:23:12.100901+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.126660+0000","last_change":"2023-11-30T18:23:12.125934+0000","last_active":"2023-11-30T18:23:12.126660+0000","last_peered":"2023-11-30T18:23:12.126660+0000","last_clean":"2023-11-30T18:23:12.126660+0000","last_became_active":"2023-11-30T18:23:12.125609+0000","last_became_peered":"2023-11-30T18:23:12.125609+0000","last_unstale":"2023-11-30T18:23:12.126660+0000","last_undegraded":"2023-11-30T18:23:12.126660+0000","last_fullsized":"2023-11-30T18:23:12.126660+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.102384+0000","last_change":"2023-11-30T18:23:11.729527+0000","last_active":"2023-11-30T18:23:12.102384+0000","last_peered":"2023-11-30T18:23:12.102384+0000","last_clean":"2023-11-30T18:23:12.102384+0000","last_became_active":"2023-11-30T18:23:11.727436+0000","last_became_peered":"2023-11-30T18:23:11.727436+0000","last_unstale":"2023-11-30T18:23:12.102384+0000","last_undegraded":"2023-11-30T18:23:12.102384+0000","last_fullsized":"2023-11-30T18:23:12.102384+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128566+0000","last_change":"2023-11-30T18:23:12.118391+0000","last_active":"2023-11-30T18:23:12.128566+0000","last_peered":"2023-11-30T18:23:12.128566+0000","last_clean":"2023-11-30T18:23:12.128566+0000","last_became_active":"2023-11-30T18:23:12.118021+0000","last_became_peered":"2023-11-30T18:23:12.118021+0000","last_unstale":"2023-11-30T18:23:12.128566+0000","last_undegraded":"2023-11-30T18:23:12.128566+0000","last_fullsized":"2023-11-30T18:23:12.128566+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105169+0000","last_change":"2023-11-30T18:23:11.726273+0000","last_active":"2023-11-30T18:23:12.105169+0000","last_peered":"2023-11-30T18:23:12.105169+0000","last_clean":"2023-11-30T18:23:12.105169+0000","last_became_active":"2023-11-30T18:23:11.726024+0000","last_became_peered":"2023-11-30T18:23:11.726024+0000","last_unstale":"2023-11-30T18:23:12.105169+0000","last_undegraded":"2023-11-30T18:23:12.105169+0000","last_fullsized":"2023-11-30T18:23:12.105169+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114198+0000","last_change":"2023-11-30T18:23:12.111598+0000","last_active":"2023-11-30T18:23:12.114198+0000","last_peered":"2023-11-30T18:23:12.114198+0000","last_clean":"2023-11-30T18:23:12.114198+0000","last_became_active":"2023-11-30T18:23:12.110743+0000","last_became_peered":"2023-11-30T18:23:12.110743+0000","last_unstale":"2023-11-30T18:23:12.114198+0000","last_undegraded":"2023-11-30T18:23:12.114198+0000","last_fullsized":"2023-11-30T18:23:12.114198+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105796+0000","last_change":"2023-11-30T18:23:11.734590+0000","last_active":"2023-11-30T18:23:12.105796+0000","last_peered":"2023-11-30T18:23:12.105796+0000","last_clean":"2023-11-30T18:23:12.105796+0000","last_became_active":"2023-11-30T18:23:11.734303+0000","last_became_peered":"2023-11-30T18:23:11.734303+0000","last_unstale":"2023-11-30T18:23:12.105796+0000","last_undegraded":"2023-11-30T18:23:12.105796+0000","last_fullsized":"2023-11-30T18:23:12.105796+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120605+0000","last_change":"2023-11-30T18:23:12.112705+0000","last_active":"2023-11-30T18:23:12.120605+0000","last_peered":"2023-11-30T18:23:12.120605+0000","last_clean":"2023-11-30T18:23:12.120605+0000","last_became_active":"2023-11-30T18:23:12.111139+0000","last_became_peered":"2023-11-30T18:23:12.111139+0000","last_unstale":"2023-11-30T18:23:12.120605+0000","last_undegraded":"2023-11-30T18:23:12.120605+0000","last_fullsized":"2023-11-30T18:23:12.120605+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.103710+0000","last_change":"2023-11-30T18:23:11.728671+0000","last_active":"2023-11-30T18:23:12.103710+0000","last_peered":"2023-11-30T18:23:12.103710+0000","last_clean":"2023-11-30T18:23:12.103710+0000","last_became_active":"2023-11-30T18:23:11.728345+0000","last_became_peered":"2023-11-30T18:23:11.728345+0000","last_unstale":"2023-11-30T18:23:12.103710+0000","last_undegraded":"2023-11-30T18:23:12.103710+0000","last_fullsized":"2023-11-30T18:23:12.103710+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128782+0000","last_change":"2023-11-30T18:23:12.124792+0000","last_active":"2023-11-30T18:23:12.128782+0000","last_peered":"2023-11-30T18:23:12.128782+0000","last_clean":"2023-11-30T18:23:12.128782+0000","last_became_active":"2023-11-30T18:23:12.124193+0000","last_became_peered":"2023-11-30T18:23:12.124193+0000","last_unstale":"2023-11-30T18:23:12.128782+0000","last_undegraded":"2023-11-30T18:23:12.128782+0000","last_fullsized":"2023-11-30T18:23:12.128782+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128865+0000","last_change":"2023-11-30T18:23:11.727412+0000","last_active":"2023-11-30T18:23:12.128865+0000","last_peered":"2023-11-30T18:23:12.128865+0000","last_clean":"2023-11-30T18:23:12.128865+0000","last_became_active":"2023-11-30T18:23:11.727129+0000","last_became_peered":"2023-11-30T18:23:11.727129+0000","last_unstale":"2023-11-30T18:23:12.128865+0000","last_undegraded":"2023-11-30T18:23:12.128865+0000","last_fullsized":"2023-11-30T18:23:12.128865+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.136285+0000","last_change":"2023-11-30T18:23:12.130940+0000","last_active":"2023-11-30T18:23:12.136285+0000","last_peered":"2023-11-30T18:23:12.136285+0000","last_clean":"2023-11-30T18:23:12.136285+0000","last_became_active":"2023-11-30T18:23:12.130705+0000","last_became_peered":"2023-11-30T18:23:12.130705+0000","last_unstale":"2023-11-30T18:23:12.136285+0000","last_undegraded":"2023-11-30T18:23:12.136285+0000","last_fullsized":"2023-11-30T18:23:12.136285+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"183'2","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128162+0000","last_change":"2023-11-30T18:23:11.736457+0000","last_active":"2023-11-30T18:23:12.128162+0000","last_peered":"2023-11-30T18:23:12.128162+0000","last_clean":"2023-11-30T18:23:12.128162+0000","last_became_active":"2023-11-30T18:23:11.736059+0000","last_became_peered":"2023-11-30T18:23:11.736059+0000","last_unstale":"2023-11-30T18:23:12.128162+0000","last_undegraded":"2023-11-30T18:23:12.128162+0000","last_fullsized":"2023-11-30T18:23:12.128162+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120877+0000","last_change":"2023-11-30T18:23:12.116925+0000","last_active":"2023-11-30T18:23:12.120877+0000","last_peered":"2023-11-30T18:23:12.120877+0000","last_clean":"2023-11-30T18:23:12.120877+0000","last_became_active":"2023-11-30T18:23:12.116645+0000","last_became_peered":"2023-11-30T18:23:12.116645+0000","last_unstale":"2023-11-30T18:23:12.120877+0000","last_undegraded":"2023-11-30T18:23:12.120877+0000","last_fullsized":"2023-11-30T18:23:12.120877+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101414+0000","last_change":"2023-11-30T18:23:11.732070+0000","last_active":"2023-11-30T18:23:12.101414+0000","last_peered":"2023-11-30T18:23:12.101414+0000","last_clean":"2023-11-30T18:23:12.101414+0000","last_became_active":"2023-11-30T18:23:11.731413+0000","last_became_peered":"2023-11-30T18:23:11.731413+0000","last_unstale":"2023-11-30T18:23:12.101414+0000","last_undegraded":"2023-11-30T18:23:12.101414+0000","last_fullsized":"2023-11-30T18:23:12.101414+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.117119+0000","last_change":"2023-11-30T18:23:12.109130+0000","last_active":"2023-11-30T18:23:12.117119+0000","last_peered":"2023-11-30T18:23:12.117119+0000","last_clean":"2023-11-30T18:23:12.117119+0000","last_became_active":"2023-11-30T18:23:12.108797+0000","last_became_peered":"2023-11-30T18:23:12.108797+0000","last_unstale":"2023-11-30T18:23:12.117119+0000","last_undegraded":"2023-11-30T18:23:12.117119+0000","last_fullsized":"2023-11-30T18:23:12.117119+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105401+0000","last_change":"2023-11-30T18:23:11.729673+0000","last_active":"2023-11-30T18:23:12.105401+0000","last_peered":"2023-11-30T18:23:12.105401+0000","last_clean":"2023-11-30T18:23:12.105401+0000","last_became_active":"2023-11-30T18:23:11.729205+0000","last_became_peered":"2023-11-30T18:23:11.729205+0000","last_unstale":"2023-11-30T18:23:12.105401+0000","last_undegraded":"2023-11-30T18:23:12.105401+0000","last_fullsized":"2023-11-30T18:23:12.105401+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.133312+0000","last_change":"2023-11-30T18:23:12.128309+0000","last_active":"2023-11-30T18:23:12.133312+0000","last_peered":"2023-11-30T18:23:12.133312+0000","last_clean":"2023-11-30T18:23:12.133312+0000","last_became_active":"2023-11-30T18:23:12.128014+0000","last_became_peered":"2023-11-30T18:23:12.128014+0000","last_unstale":"2023-11-30T18:23:12.133312+0000","last_undegraded":"2023-11-30T18:23:12.133312+0000","last_fullsized":"2023-11-30T18:23:12.133312+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112901+0000","last_change":"2023-11-30T18:23:11.731121+0000","last_active":"2023-11-30T18:23:12.112901+0000","last_peered":"2023-11-30T18:23:12.112901+0000","last_clean":"2023-11-30T18:23:12.112901+0000","last_became_active":"2023-11-30T18:23:11.730804+0000","last_became_peered":"2023-11-30T18:23:11.730804+0000","last_unstale":"2023-11-30T18:23:12.112901+0000","last_undegraded":"2023-11-30T18:23:12.112901+0000","last_fullsized":"2023-11-30T18:23:12.112901+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114635+0000","last_change":"2023-11-30T18:23:12.113494+0000","last_active":"2023-11-30T18:23:12.114635+0000","last_peered":"2023-11-30T18:23:12.114635+0000","last_clean":"2023-11-30T18:23:12.114635+0000","last_became_active":"2023-11-30T18:23:12.112805+0000","last_became_peered":"2023-11-30T18:23:12.112805+0000","last_unstale":"2023-11-30T18:23:12.114635+0000","last_undegraded":"2023-11-30T18:23:12.114635+0000","last_fullsized":"2023-11-30T18:23:12.114635+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.102167+0000","last_change":"2023-11-30T18:23:11.734767+0000","last_active":"2023-11-30T18:23:12.102167+0000","last_peered":"2023-11-30T18:23:12.102167+0000","last_clean":"2023-11-30T18:23:12.102167+0000","last_became_active":"2023-11-30T18:23:11.734140+0000","last_became_peered":"2023-11-30T18:23:11.734140+0000","last_unstale":"2023-11-30T18:23:12.102167+0000","last_undegraded":"2023-11-30T18:23:12.102167+0000","last_fullsized":"2023-11-30T18:23:12.102167+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128947+0000","last_change":"2023-11-30T18:23:12.125304+0000","last_active":"2023-11-30T18:23:12.128947+0000","last_peered":"2023-11-30T18:23:12.128947+0000","last_clean":"2023-11-30T18:23:12.128947+0000","last_became_active":"2023-11-30T18:23:12.125058+0000","last_became_peered":"2023-11-30T18:23:12.125058+0000","last_unstale":"2023-11-30T18:23:12.128947+0000","last_undegraded":"2023-11-30T18:23:12.128947+0000","last_fullsized":"2023-11-30T18:23:12.128947+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105672+0000","last_change":"2023-11-30T18:23:11.731979+0000","last_active":"2023-11-30T18:23:12.105672+0000","last_peered":"2023-11-30T18:23:12.105672+0000","last_clean":"2023-11-30T18:23:12.105672+0000","last_became_active":"2023-11-30T18:23:11.731333+0000","last_became_peered":"2023-11-30T18:23:11.731333+0000","last_unstale":"2023-11-30T18:23:12.105672+0000","last_undegraded":"2023-11-30T18:23:12.105672+0000","last_fullsized":"2023-11-30T18:23:12.105672+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112581+0000","last_change":"2023-11-30T18:23:12.108480+0000","last_active":"2023-11-30T18:23:12.112581+0000","last_peered":"2023-11-30T18:23:12.112581+0000","last_clean":"2023-11-30T18:23:12.112581+0000","last_became_active":"2023-11-30T18:23:12.108192+0000","last_became_peered":"2023-11-30T18:23:12.108192+0000","last_unstale":"2023-11-30T18:23:12.112581+0000","last_undegraded":"2023-11-30T18:23:12.112581+0000","last_fullsized":"2023-11-30T18:23:12.112581+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101068+0000","last_change":"2023-11-30T18:23:11.732703+0000","last_active":"2023-11-30T18:23:12.101068+0000","last_peered":"2023-11-30T18:23:12.101068+0000","last_clean":"2023-11-30T18:23:12.101068+0000","last_became_active":"2023-11-30T18:23:11.732433+0000","last_became_peered":"2023-11-30T18:23:11.732433+0000","last_unstale":"2023-11-30T18:23:12.101068+0000","last_undegraded":"2023-11-30T18:23:12.101068+0000","last_fullsized":"2023-11-30T18:23:12.101068+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.123835+0000","last_change":"2023-11-30T18:23:12.121094+0000","last_active":"2023-11-30T18:23:12.123835+0000","last_peered":"2023-11-30T18:23:12.123835+0000","last_clean":"2023-11-30T18:23:12.123835+0000","last_became_active":"2023-11-30T18:23:12.119586+0000","last_became_peered":"2023-11-30T18:23:12.119586+0000","last_unstale":"2023-11-30T18:23:12.123835+0000","last_undegraded":"2023-11-30T18:23:12.123835+0000","last_fullsized":"2023-11-30T18:23:12.123835+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"183'2","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.117989+0000","last_change":"2023-11-30T18:23:11.728925+0000","last_active":"2023-11-30T18:23:12.117989+0000","last_peered":"2023-11-30T18:23:12.117989+0000","last_clean":"2023-11-30T18:23:12.117989+0000","last_became_active":"2023-11-30T18:23:11.728645+0000","last_became_peered":"2023-11-30T18:23:11.728645+0000","last_unstale":"2023-11-30T18:23:12.117989+0000","last_undegraded":"2023-11-30T18:23:12.117989+0000","last_fullsized":"2023-11-30T18:23:12.117989+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.117554+0000","last_change":"2023-11-30T18:23:12.112891+0000","last_active":"2023-11-30T18:23:12.117554+0000","last_peered":"2023-11-30T18:23:12.117554+0000","last_clean":"2023-11-30T18:23:12.117554+0000","last_became_active":"2023-11-30T18:23:12.112610+0000","last_became_peered":"2023-11-30T18:23:12.112610+0000","last_unstale":"2023-11-30T18:23:12.117554+0000","last_undegraded":"2023-11-30T18:23:12.117554+0000","last_fullsized":"2023-11-30T18:23:12.117554+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105796+0000","last_change":"2023-11-30T18:23:11.728944+0000","last_active":"2023-11-30T18:23:12.105796+0000","last_peered":"2023-11-30T18:23:12.105796+0000","last_clean":"2023-11-30T18:23:12.105796+0000","last_became_active":"2023-11-30T18:23:11.728632+0000","last_became_peered":"2023-11-30T18:23:11.728632+0000","last_unstale":"2023-11-30T18:23:12.105796+0000","last_undegraded":"2023-11-30T18:23:12.105796+0000","last_fullsized":"2023-11-30T18:23:12.105796+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120459+0000","last_change":"2023-11-30T18:23:12.111474+0000","last_active":"2023-11-30T18:23:12.120459+0000","last_peered":"2023-11-30T18:23:12.120459+0000","last_clean":"2023-11-30T18:23:12.120459+0000","last_became_active":"2023-11-30T18:23:12.111119+0000","last_became_peered":"2023-11-30T18:23:12.111119+0000","last_unstale":"2023-11-30T18:23:12.120459+0000","last_undegraded":"2023-11-30T18:23:12.120459+0000","last_fullsized":"2023-11-30T18:23:12.120459+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101462+0000","last_change":"2023-11-30T18:23:11.733982+0000","last_active":"2023-11-30T18:23:12.101462+0000","last_peered":"2023-11-30T18:23:12.101462+0000","last_clean":"2023-11-30T18:23:12.101462+0000","last_became_active":"2023-11-30T18:23:11.733689+0000","last_became_peered":"2023-11-30T18:23:11.733689+0000","last_unstale":"2023-11-30T18:23:12.101462+0000","last_undegraded":"2023-11-30T18:23:12.101462+0000","last_fullsized":"2023-11-30T18:23:12.101462+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120038+0000","last_change":"2023-11-30T18:23:12.116461+0000","last_active":"2023-11-30T18:23:12.120038+0000","last_peered":"2023-11-30T18:23:12.120038+0000","last_clean":"2023-11-30T18:23:12.120038+0000","last_became_active":"2023-11-30T18:23:12.115880+0000","last_became_peered":"2023-11-30T18:23:12.115880+0000","last_unstale":"2023-11-30T18:23:12.120038+0000","last_undegraded":"2023-11-30T18:23:12.120038+0000","last_fullsized":"2023-11-30T18:23:12.120038+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.104010+0000","last_change":"2023-11-30T18:23:11.728276+0000","last_active":"2023-11-30T18:23:12.104010+0000","last_peered":"2023-11-30T18:23:12.104010+0000","last_clean":"2023-11-30T18:23:12.104010+0000","last_became_active":"2023-11-30T18:23:11.727974+0000","last_became_peered":"2023-11-30T18:23:11.727974+0000","last_unstale":"2023-11-30T18:23:12.104010+0000","last_undegraded":"2023-11-30T18:23:12.104010+0000","last_fullsized":"2023-11-30T18:23:12.104010+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.113288+0000","last_change":"2023-11-30T18:23:12.111050+0000","last_active":"2023-11-30T18:23:12.113288+0000","last_peered":"2023-11-30T18:23:12.113288+0000","last_clean":"2023-11-30T18:23:12.113288+0000","last_became_active":"2023-11-30T18:23:12.110744+0000","last_became_peered":"2023-11-30T18:23:12.110744+0000","last_unstale":"2023-11-30T18:23:12.113288+0000","last_undegraded":"2023-11-30T18:23:12.113288+0000","last_fullsized":"2023-11-30T18:23:12.113288+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.106016+0000","last_change":"2023-11-30T18:23:11.730729+0000","last_active":"2023-11-30T18:23:12.106016+0000","last_peered":"2023-11-30T18:23:12.106016+0000","last_clean":"2023-11-30T18:23:12.106016+0000","last_became_active":"2023-11-30T18:23:11.728274+0000","last_became_peered":"2023-11-30T18:23:11.728274+0000","last_unstale":"2023-11-30T18:23:12.106016+0000","last_undegraded":"2023-11-30T18:23:12.106016+0000","last_fullsized":"2023-11-30T18:23:12.106016+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128547+0000","last_change":"2023-11-30T18:23:12.118514+0000","last_active":"2023-11-30T18:23:12.128547+0000","last_peered":"2023-11-30T18:23:12.128547+0000","last_clean":"2023-11-30T18:23:12.128547+0000","last_became_active":"2023-11-30T18:23:12.117762+0000","last_became_peered":"2023-11-30T18:23:12.117762+0000","last_unstale":"2023-11-30T18:23:12.128547+0000","last_undegraded":"2023-11-30T18:23:12.128547+0000","last_fullsized":"2023-11-30T18:23:12.128547+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.119835+0000","last_change":"2023-11-30T18:23:11.729709+0000","last_active":"2023-11-30T18:23:12.119835+0000","last_peered":"2023-11-30T18:23:12.119835+0000","last_clean":"2023-11-30T18:23:12.119835+0000","last_became_active":"2023-11-30T18:23:11.728696+0000","last_became_peered":"2023-11-30T18:23:11.728696+0000","last_unstale":"2023-11-30T18:23:12.119835+0000","last_undegraded":"2023-11-30T18:23:12.119835+0000","last_fullsized":"2023-11-30T18:23:12.119835+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.112118+0000","last_change":"2023-11-30T18:23:12.110191+0000","last_active":"2023-11-30T18:23:12.112118+0000","last_peered":"2023-11-30T18:23:12.112118+0000","last_clean":"2023-11-30T18:23:12.112118+0000","last_became_active":"2023-11-30T18:23:12.108068+0000","last_became_peered":"2023-11-30T18:23:12.108068+0000","last_unstale":"2023-11-30T18:23:12.112118+0000","last_undegraded":"2023-11-30T18:23:12.112118+0000","last_fullsized":"2023-11-30T18:23:12.112118+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.106165+0000","last_change":"2023-11-30T18:23:11.724242+0000","last_active":"2023-11-30T18:23:12.106165+0000","last_peered":"2023-11-30T18:23:12.106165+0000","last_clean":"2023-11-30T18:23:12.106165+0000","last_became_active":"2023-11-30T18:23:11.723941+0000","last_became_peered":"2023-11-30T18:23:11.723941+0000","last_unstale":"2023-11-30T18:23:12.106165+0000","last_undegraded":"2023-11-30T18:23:12.106165+0000","last_fullsized":"2023-11-30T18:23:12.106165+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.115102+0000","last_change":"2023-11-30T18:23:12.112639+0000","last_active":"2023-11-30T18:23:12.115102+0000","last_peered":"2023-11-30T18:23:12.115102+0000","last_clean":"2023-11-30T18:23:12.115102+0000","last_became_active":"2023-11-30T18:23:12.112347+0000","last_became_peered":"2023-11-30T18:23:12.112347+0000","last_unstale":"2023-11-30T18:23:12.115102+0000","last_undegraded":"2023-11-30T18:23:12.115102+0000","last_fullsized":"2023-11-30T18:23:12.115102+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.116481+0000","last_change":"2023-11-30T18:23:11.733023+0000","last_active":"2023-11-30T18:23:12.116481+0000","last_peered":"2023-11-30T18:23:12.116481+0000","last_clean":"2023-11-30T18:23:12.116481+0000","last_became_active":"2023-11-30T18:23:11.732439+0000","last_became_peered":"2023-11-30T18:23:11.732439+0000","last_unstale":"2023-11-30T18:23:12.116481+0000","last_undegraded":"2023-11-30T18:23:12.116481+0000","last_fullsized":"2023-11-30T18:23:12.116481+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.130413+0000","last_change":"2023-11-30T18:23:12.123957+0000","last_active":"2023-11-30T18:23:12.130413+0000","last_peered":"2023-11-30T18:23:12.130413+0000","last_clean":"2023-11-30T18:23:12.130413+0000","last_became_active":"2023-11-30T18:23:12.123674+0000","last_became_peered":"2023-11-30T18:23:12.123674+0000","last_unstale":"2023-11-30T18:23:12.130413+0000","last_undegraded":"2023-11-30T18:23:12.130413+0000","last_fullsized":"2023-11-30T18:23:12.130413+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.118736+0000","last_change":"2023-11-30T18:23:11.724253+0000","last_active":"2023-11-30T18:23:12.118736+0000","last_peered":"2023-11-30T18:23:12.118736+0000","last_clean":"2023-11-30T18:23:12.118736+0000","last_became_active":"2023-11-30T18:23:11.723936+0000","last_became_peered":"2023-11-30T18:23:11.723936+0000","last_unstale":"2023-11-30T18:23:12.118736+0000","last_undegraded":"2023-11-30T18:23:12.118736+0000","last_fullsized":"2023-11-30T18:23:12.118736+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":154,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.100854+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T18:23:12.100854+0000","last_peered":"2023-11-30T18:23:12.100854+0000","last_clean":"2023-11-30T18:23:12.100854+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T18:23:12.100854+0000","last_undegraded":"2023-11-30T18:23:12.100854+0000","last_fullsized":"2023-11-30T18:23:12.100854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124990+0000","last_change":"2023-11-30T18:23:12.122702+0000","last_active":"2023-11-30T18:23:12.124990+0000","last_peered":"2023-11-30T18:23:12.124990+0000","last_clean":"2023-11-30T18:23:12.124990+0000","last_became_active":"2023-11-30T18:23:12.122115+0000","last_became_peered":"2023-11-30T18:23:12.122115+0000","last_unstale":"2023-11-30T18:23:12.124990+0000","last_undegraded":"2023-11-30T18:23:12.124990+0000","last_fullsized":"2023-11-30T18:23:12.124990+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"183'3","reported_seq":13,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124889+0000","last_change":"2023-11-30T18:23:11.723777+0000","last_active":"2023-11-30T18:23:12.124889+0000","last_peered":"2023-11-30T18:23:12.124889+0000","last_clean":"2023-11-30T18:23:12.124889+0000","last_became_active":"2023-11-30T18:23:11.723321+0000","last_became_peered":"2023-11-30T18:23:11.723321+0000","last_unstale":"2023-11-30T18:23:12.124889+0000","last_undegraded":"2023-11-30T18:23:12.124889+0000","last_fullsized":"2023-11-30T18:23:12.124889+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":151,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105479+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T18:23:12.105479+0000","last_peered":"2023-11-30T18:23:12.105479+0000","last_clean":"2023-11-30T18:23:12.105479+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T18:23:12.105479+0000","last_undegraded":"2023-11-30T18:23:12.105479+0000","last_fullsized":"2023-11-30T18:23:12.105479+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.124947+0000","last_change":"2023-11-30T18:23:12.123908+0000","last_active":"2023-11-30T18:23:12.124947+0000","last_peered":"2023-11-30T18:23:12.124947+0000","last_clean":"2023-11-30T18:23:12.124947+0000","last_became_active":"2023-11-30T18:23:12.123674+0000","last_became_peered":"2023-11-30T18:23:12.123674+0000","last_unstale":"2023-11-30T18:23:12.124947+0000","last_undegraded":"2023-11-30T18:23:12.124947+0000","last_fullsized":"2023-11-30T18:23:12.124947+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.105691+0000","last_change":"2023-11-30T18:23:11.726548+0000","last_active":"2023-11-30T18:23:12.105691+0000","last_peered":"2023-11-30T18:23:12.105691+0000","last_clean":"2023-11-30T18:23:12.105691+0000","last_became_active":"2023-11-30T18:23:11.726202+0000","last_became_peered":"2023-11-30T18:23:11.726202+0000","last_unstale":"2023-11-30T18:23:12.105691+0000","last_undegraded":"2023-11-30T18:23:12.105691+0000","last_fullsized":"2023-11-30T18:23:12.105691+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":158,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.118025+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T18:23:12.118025+0000","last_peered":"2023-11-30T18:23:12.118025+0000","last_clean":"2023-11-30T18:23:12.118025+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T18:23:12.118025+0000","last_undegraded":"2023-11-30T18:23:12.118025+0000","last_fullsized":"2023-11-30T18:23:12.118025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120302+0000","last_change":"2023-11-30T18:23:12.118780+0000","last_active":"2023-11-30T18:23:12.120302+0000","last_peered":"2023-11-30T18:23:12.120302+0000","last_clean":"2023-11-30T18:23:12.120302+0000","last_became_active":"2023-11-30T18:23:12.118475+0000","last_became_peered":"2023-11-30T18:23:12.118475+0000","last_unstale":"2023-11-30T18:23:12.120302+0000","last_undegraded":"2023-11-30T18:23:12.120302+0000","last_fullsized":"2023-11-30T18:23:12.120302+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"183'2","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.113944+0000","last_change":"2023-11-30T18:23:11.732729+0000","last_active":"2023-11-30T18:23:12.113944+0000","last_peered":"2023-11-30T18:23:12.113944+0000","last_clean":"2023-11-30T18:23:12.113944+0000","last_became_active":"2023-11-30T18:23:11.732454+0000","last_became_peered":"2023-11-30T18:23:11.732454+0000","last_unstale":"2023-11-30T18:23:12.113944+0000","last_undegraded":"2023-11-30T18:23:12.113944+0000","last_fullsized":"2023-11-30T18:23:12.113944+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":151,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.106039+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T18:23:12.106039+0000","last_peered":"2023-11-30T18:23:12.106039+0000","last_clean":"2023-11-30T18:23:12.106039+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T18:23:12.106039+0000","last_undegraded":"2023-11-30T18:23:12.106039+0000","last_fullsized":"2023-11-30T18:23:12.106039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":148,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.116542+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T18:23:12.116542+0000","last_peered":"2023-11-30T18:23:12.116542+0000","last_clean":"2023-11-30T18:23:12.116542+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T18:23:12.116542+0000","last_undegraded":"2023-11-30T18:23:12.116542+0000","last_fullsized":"2023-11-30T18:23:12.116542+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.127587+0000","last_change":"2023-11-30T18:23:12.120874+0000","last_active":"2023-11-30T18:23:12.127587+0000","last_peered":"2023-11-30T18:23:12.127587+0000","last_clean":"2023-11-30T18:23:12.127587+0000","last_became_active":"2023-11-30T18:23:12.120618+0000","last_became_peered":"2023-11-30T18:23:12.120618+0000","last_unstale":"2023-11-30T18:23:12.127587+0000","last_undegraded":"2023-11-30T18:23:12.127587+0000","last_fullsized":"2023-11-30T18:23:12.127587+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.120308+0000","last_change":"2023-11-30T18:23:11.737931+0000","last_active":"2023-11-30T18:23:12.120308+0000","last_peered":"2023-11-30T18:23:12.120308+0000","last_clean":"2023-11-30T18:23:12.120308+0000","last_became_active":"2023-11-30T18:23:11.737593+0000","last_became_peered":"2023-11-30T18:23:11.737593+0000","last_unstale":"2023-11-30T18:23:12.120308+0000","last_undegraded":"2023-11-30T18:23:12.120308+0000","last_fullsized":"2023-11-30T18:23:12.120308+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":146,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.116609+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T18:23:12.116609+0000","last_peered":"2023-11-30T18:23:12.116609+0000","last_clean":"2023-11-30T18:23:12.116609+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T18:23:12.116609+0000","last_undegraded":"2023-11-30T18:23:12.116609+0000","last_fullsized":"2023-11-30T18:23:12.116609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.114593+0000","last_change":"2023-11-30T18:23:12.113259+0000","last_active":"2023-11-30T18:23:12.114593+0000","last_peered":"2023-11-30T18:23:12.114593+0000","last_clean":"2023-11-30T18:23:12.114593+0000","last_became_active":"2023-11-30T18:23:12.112451+0000","last_became_peered":"2023-11-30T18:23:12.112451+0000","last_unstale":"2023-11-30T18:23:12.114593+0000","last_undegraded":"2023-11-30T18:23:12.114593+0000","last_fullsized":"2023-11-30T18:23:12.114593+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.104412+0000","last_change":"2023-11-30T18:23:11.730038+0000","last_active":"2023-11-30T18:23:12.104412+0000","last_peered":"2023-11-30T18:23:12.104412+0000","last_clean":"2023-11-30T18:23:12.104412+0000","last_became_active":"2023-11-30T18:23:11.729125+0000","last_became_peered":"2023-11-30T18:23:11.729125+0000","last_unstale":"2023-11-30T18:23:12.104412+0000","last_undegraded":"2023-11-30T18:23:12.104412+0000","last_fullsized":"2023-11-30T18:23:12.104412+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":146,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.121501+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T18:23:12.121501+0000","last_peered":"2023-11-30T18:23:12.121501+0000","last_clean":"2023-11-30T18:23:12.121501+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T18:23:12.121501+0000","last_undegraded":"2023-11-30T18:23:12.121501+0000","last_fullsized":"2023-11-30T18:23:12.121501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.123443+0000","last_change":"2023-11-30T18:23:12.119562+0000","last_active":"2023-11-30T18:23:12.123443+0000","last_peered":"2023-11-30T18:23:12.123443+0000","last_clean":"2023-11-30T18:23:12.123443+0000","last_became_active":"2023-11-30T18:23:12.119194+0000","last_became_peered":"2023-11-30T18:23:12.119194+0000","last_unstale":"2023-11-30T18:23:12.123443+0000","last_undegraded":"2023-11-30T18:23:12.123443+0000","last_fullsized":"2023-11-30T18:23:12.123443+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.104412+0000","last_change":"2023-11-30T18:23:11.723567+0000","last_active":"2023-11-30T18:23:12.104412+0000","last_peered":"2023-11-30T18:23:12.104412+0000","last_clean":"2023-11-30T18:23:12.104412+0000","last_became_active":"2023-11-30T18:23:11.723248+0000","last_became_peered":"2023-11-30T18:23:11.723248+0000","last_unstale":"2023-11-30T18:23:12.104412+0000","last_undegraded":"2023-11-30T18:23:12.104412+0000","last_fullsized":"2023-11-30T18:23:12.104412+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":154,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.101695+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T18:23:12.101695+0000","last_peered":"2023-11-30T18:23:12.101695+0000","last_clean":"2023-11-30T18:23:12.101695+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T18:23:12.101695+0000","last_undegraded":"2023-11-30T18:23:12.101695+0000","last_fullsized":"2023-11-30T18:23:12.101695+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.113473+0000","last_change":"2023-11-30T18:23:12.111164+0000","last_active":"2023-11-30T18:23:12.113473+0000","last_peered":"2023-11-30T18:23:12.113473+0000","last_clean":"2023-11-30T18:23:12.113473+0000","last_became_active":"2023-11-30T18:23:12.110887+0000","last_became_peered":"2023-11-30T18:23:12.110887+0000","last_unstale":"2023-11-30T18:23:12.113473+0000","last_undegraded":"2023-11-30T18:23:12.113473+0000","last_fullsized":"2023-11-30T18:23:12.113473+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:11.703815+0000","last_clean_scrub_stamp":"2023-11-30T18:23:11.703815+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"183'4","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.128421+0000","last_change":"2023-11-30T18:23:11.728962+0000","last_active":"2023-11-30T18:23:12.128421+0000","last_peered":"2023-11-30T18:23:12.128421+0000","last_clean":"2023-11-30T18:23:12.128421+0000","last_became_active":"2023-11-30T18:23:11.728681+0000","last_became_peered":"2023-11-30T18:23:11.728681+0000","last_unstale":"2023-11-30T18:23:12.128421+0000","last_undegraded":"2023-11-30T18:23:12.128421+0000","last_fullsized":"2023-11-30T18:23:12.128421+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:23:10.701569+0000","last_clean_scrub_stamp":"2023-11-30T18:23:10.701569+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":172,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-11-30T18:23:12.104755+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T18:23:12.104755+0000","last_peered":"2023-11-30T18:23:12.104755+0000","last_clean":"2023-11-30T18:23:12.104755+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T18:23:12.104755+0000","last_undegraded":"2023-11-30T18:23:12.104755+0000","last_fullsized":"2023-11-30T18:23:12.104755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575755,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303444,"kb_used_data":2252,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068396,"statfs":{"total":96636764160,"available":96326037504,"internally_reserved":0,"allocated":2306048,"data_stored":1173973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.32500000000000001},"max":{"1min":0.68700000000000006,"5min":0.81699999999999995,"15min":0.83599999999999997},"last":0.503},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.60699999999999998,"15min":0.61799999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.71499999999999997,"5min":0.82199999999999995,"15min":0.84999999999999998},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55000000000000004,"15min":0.55900000000000005},"min":{"1min":0.35599999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71599999999999997,"5min":0.80500000000000005,"15min":0.875},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.39800000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71699999999999997,"5min":0.79100000000000004,"15min":0.82099999999999995},"last":0.54400000000000004}]},{"osd":2,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70399999999999996,"5min":0.76900000000000002,"15min":0.85399999999999998},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.66500000000000004,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.34300000000000003},"max":{"1min":0.65700000000000003,"5min":0.79300000000000004,"15min":0.90800000000000003},"last":0.373},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60199999999999998,"15min":0.60299999999999998},"min":{"1min":0.41099999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.73399999999999999,"5min":0.80000000000000004,"15min":0.80300000000000005},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.45300000000000001,"15min":0.44400000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63900000000000001,"5min":0.70299999999999996,"15min":0.73799999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46400000000000002,"15min":0.46500000000000002},"min":{"1min":0.32100000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.66400000000000003,"5min":0.71999999999999997,"15min":0.78100000000000003},"last":0.438}]},{"osd":5,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.65000000000000002,"5min":0.749,"15min":0.753},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.51000000000000001,"15min":0.505},"min":{"1min":0.371,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":0.69099999999999995,"5min":0.76000000000000001,"15min":0.81999999999999995},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.372,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.74299999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.751,"5min":0.81499999999999995,"15min":0.83599999999999997},"last":0.53100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575754,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307528,"kb_used_data":2240,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064312,"statfs":{"total":96636764160,"available":96321855488,"internally_reserved":0,"allocated":2293760,"data_stored":1172505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.58999999999999997,"15min":0.59799999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68000000000000005,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.61799999999999999,"15min":0.61699999999999999},"min":{"1min":0.45100000000000001,"5min":0.41099999999999998,"15min":0.33600000000000002},"max":{"1min":0.72599999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.79500000000000004}]},{"osd":1,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.32400000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.70899999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.40999999999999998,"5min":0.39000000000000001,"15min":0.35199999999999998},"max":{"1min":0.751,"5min":0.876,"15min":0.876},"last":0.84099999999999997}]},{"osd":2,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.59699999999999998,"15min":0.59799999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71399999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.39000000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73399999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.78200000000000003}]},{"osd":3,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54700000000000004,"15min":0.55700000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73399999999999999,"5min":0.82299999999999995,"15min":0.83499999999999996},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.39900000000000002,"5min":0.39000000000000001,"15min":0.33200000000000002},"max":{"1min":0.64400000000000002,"5min":0.79100000000000004,"15min":0.80100000000000005},"last":0.73899999999999999}]},{"osd":4,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45200000000000001,"15min":0.45100000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.68899999999999995,"5min":0.81000000000000005,"15min":0.94999999999999996},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47799999999999998,"15min":0.47599999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70399999999999996,"5min":0.76400000000000001,"15min":0.82299999999999995},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46999999999999997,"15min":0.46700000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.66300000000000003,"5min":0.76400000000000001,"15min":0.81999999999999995},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70999999999999996,"5min":0.81999999999999995,"15min":0.83499999999999996},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Nov 30 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.29999999999999999},"max":{"1min":0.72499999999999998,"5min":0.80100000000000005,"15min":0.86799999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.376,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71599999999999997,"5min":0.80800000000000005,"15min":0.86599999999999999},"last":0.77200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575754,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307536,"kb_used_data":2248,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064304,"statfs":{"total":96636764160,"available":96321847296,"internally_reserved":0,"allocated":2301952,"data_stored":1173129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34200000000000003,"15min":0.36399999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.42799999999999999,"5min":0.54200000000000004,"15min":0.70699999999999996},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47299999999999998,"15min":0.49399999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.78100000000000003},"last":0.33100000000000002}]},{"osd":2,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.376,"15min":0.39600000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.48099999999999998,"5min":0.60599999999999998,"15min":0.67500000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.498,"15min":0.51600000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63200000000000001,"5min":0.72499999999999998,"15min":0.85599999999999998},"last":0.38}]},{"osd":3,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.44700000000000001,"15min":0.46300000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.53700000000000003,"5min":0.70599999999999996,"15min":0.79600000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.42299999999999999,"15min":0.44600000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.50700000000000001,"5min":0.65400000000000003,"15min":0.68000000000000005},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.58399999999999996,"15min":0.60999999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.314},"max":{"1min":0.80100000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.61799999999999999,"15min":0.64100000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38800000000000001},"max":{"1min":0.77900000000000003,"5min":0.80800000000000005,"15min":0.90600000000000003},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.60399999999999998,"15min":0.623},"min":{"1min":0.379,"5min":0.379,"15min":0.377},"max":{"1min":0.78400000000000003,"5min":0.86599999999999999,"15min":0.90200000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60899999999999999,"15min":0.63300000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.36799999999999999},"max":{"1min":0.79400000000000004,"5min":0.878,"15min":0.90800000000000003},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.66700000000000004,"15min":0.68899999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66300000000000003,"15min":0.67600000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42599999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.0049999999999999},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Nov 30 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.66600000000000004,"15min":0.68999999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.96999999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.65100000000000002,"15min":0.67200000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.95899999999999996},"last":0.52100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575754,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307544,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064296,"statfs":{"total":96636764160,"available":96321839104,"internally_reserved":0,"allocated":2310144,"data_stored":1173273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.38300000000000001,"15min":0.38900000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.51900000000000002,"5min":0.56799999999999995,"15min":0.61099999999999999},"last":0.246},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41099999999999998,"15min":0.40999999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.249},"max":{"1min":0.55600000000000005,"5min":0.65600000000000003,"15min":0.68400000000000005},"last":0.34000000000000002}]},{"osd":2,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41599999999999998,"15min":0.40899999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.57499999999999996,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.49299999999999999,"15min":0.48999999999999999},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.59399999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.44600000000000001,"15min":0.45200000000000001},"min":{"1min":0.311,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.53500000000000003,"5min":0.71699999999999997,"15min":0.77500000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46899999999999997,"15min":0.46800000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65300000000000002,"5min":0.67600000000000005,"15min":0.69499999999999995},"last":0.26000000000000001}]},{"osd":4,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65000000000000002,"15min":0.63700000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.42199999999999999},"max":{"1min":0.81000000000000005,"5min":0.96399999999999997,"15min":0.995},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66600000000000004,"15min":0.65400000000000003},"min":{"1min":0.47799999999999998,"5min":0.42799999999999999,"15min":0.41499999999999998},"max":{"1min":0.75900000000000001,"5min":1.03,"15min":1.03},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65200000000000002,"15min":0.64100000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.40799999999999997},"max":{"1min":0.86499999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.68100000000000005,"15min":0.65900000000000003},"min":{"1min":0.48199999999999998,"5min":0.44800000000000001,"15min":0.41299999999999998},"max":{"1min":0.91900000000000004,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.45600000000000002}]},{"osd":6,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67700000000000005,"15min":0.67300000000000004},"min":{"1min":0.52300000000000002,"5min":0.443,"15min":0.40600000000000003},"max":{"1min":0.81799999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68600000000000005,"15min":0.67700000000000005},"min":{"1min":0.49099999999999999,"5min":0.442,"15min":0.44},"max":{"1min":0.90400000000000003,"5min":1.05,"15min":1.05},"last":0.51400000000000001}]},{"osd":7,"last update":"Thu Nov 30 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71299999999999997,"15min":0.69799999999999995},"min":{"1min":0.55600000000000005,"5min":0.45200000000000001,"15min":0.42599999999999999},"max":{"1min":0.88600000000000001,"5min":1.167,"15min":1.167},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73199999999999998,"15min":0.72299999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.48399999999999999},"max":{"1min":0.876,"5min":1.024,"15min":1.024},"last":0.54000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575754,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311636,"kb_used_data":2252,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060204,"statfs":{"total":96636764160,"available":96317648896,"internally_reserved":0,"allocated":2306048,"data_stored":1172687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.39500000000000002,"15min":0.40100000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.25700000000000001},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.71699999999999997},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68999999999999995,"5min":0.70599999999999996,"15min":0.751},"last":0.379}]},{"osd":1,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.443,"15min":0.44900000000000001},"min":{"1min":0.33500000000000002,"5min":0.309,"15min":0.29299999999999998},"max":{"1min":0.68700000000000006,"5min":0.755,"15min":0.755},"last":0.437},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.32300000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.81799999999999995},"last":0.42699999999999999}]},{"osd":3,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39500000000000002,"15min":0.40699999999999997},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.76000000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.308,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.75800000000000001},"last":0.314}]},{"osd":4,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.626,"15min":0.63400000000000001},"min":{"1min":0.44900000000000001,"5min":0.42199999999999999,"15min":0.40100000000000002},"max":{"1min":0.88800000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60699999999999998,"15min":0.61899999999999999},"min":{"1min":0.42199999999999999,"5min":0.40999999999999998,"15min":0.377},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.94999999999999996},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63300000000000001,"15min":0.64400000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.97399999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64700000000000002,"15min":0.64800000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85599999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.628,"15min":0.63800000000000001},"min":{"1min":0.46200000000000002,"5min":0.434,"15min":0.41099999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.97799999999999998},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67000000000000004,"15min":0.67300000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Nov 30 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67300000000000004,"15min":0.68799999999999994},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46000000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.96599999999999997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.504,"5min":0.49199999999999999,"15min":0.46200000000000002},"max":{"1min":0.97199999999999998,"5min":0.995,"15min":1.014},"last":0.68600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575754,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315724,"kb_used_data":2244,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94056116,"statfs":{"total":96636764160,"available":96313462784,"internally_reserved":0,"allocated":2297856,"data_stored":1172539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38500000000000001,"15min":0.375},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.311},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.41199999999999998,"15min":0.40899999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.59299999999999997,"5min":0.61099999999999999,"15min":0.66200000000000003},"last":0.32900000000000001}]},{"osd":1,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.40999999999999998,"15min":0.39700000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44800000000000001,"15min":0.441},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.28699999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.26100000000000001}]},{"osd":2,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.47699999999999998,"15min":0.46899999999999997},"min":{"1min":0.35099999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58299999999999996,"5min":0.70899999999999996,"15min":0.71599999999999997},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52000000000000002,"15min":0.51500000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73199999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63200000000000001,"15min":0.63500000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92800000000000005,"5min":1.081,"15min":1.081},"last":0.436},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64900000000000002,"15min":0.63800000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.64300000000000002,"15min":0.63500000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67100000000000004,"15min":0.66200000000000003},"min":{"1min":0.47399999999999998,"5min":0.46200000000000002,"15min":0.42399999999999999},"max":{"1min":0.99199999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.52300000000000002}]},{"osd":6,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68600000000000005,"15min":0.67900000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.40100000000000002},"max":{"1min":0.96999999999999997,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48599999999999999,"5min":0.47099999999999997,"15min":0.41499999999999998},"max":{"1min":0.84299999999999997,"5min":1.206,"15min":1.206},"last":0.48499999999999999}]},{"osd":7,"last update":"Thu Nov 30 18:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.44800000000000001},"max":{"1min":0.98599999999999999,"5min":1.131,"15min":1.131},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70599999999999996,"15min":0.69499999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.44800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575754,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303440,"kb_used_data":2248,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068400,"statfs":{"total":96636764160,"available":96326041600,"internally_reserved":0,"allocated":2301952,"data_stored":1173149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54200000000000004,"15min":0.55400000000000005},"min":{"1min":0.31900000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77200000000000002,"5min":0.80600000000000005,"15min":0.94799999999999995},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.26900000000000002},"max":{"1min":0.71399999999999997,"5min":0.82599999999999996,"15min":0.83699999999999997},"last":0.436}]},{"osd":1,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54800000000000004,"15min":0.55100000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79200000000000004,"5min":0.92400000000000004,"15min":1.006},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56200000000000006,"15min":0.56399999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70999999999999996,"5min":0.79300000000000004,"15min":0.82299999999999995},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57799999999999996,"15min":0.58699999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35499999999999998},"max":{"1min":0.68700000000000006,"5min":0.82399999999999995,"15min":0.85299999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.59999999999999998,"15min":0.61499999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70099999999999996,"5min":0.95299999999999996,"15min":1.0429999999999999},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54400000000000004,"15min":0.55100000000000005},"min":{"1min":0.35799999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69399999999999995,"5min":0.78100000000000003,"15min":0.79900000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73899999999999999,"5min":0.79600000000000004,"15min":1.1679999999999999},"last":0.49299999999999999}]},{"osd":5,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.27600000000000002},"max":{"1min":0.58399999999999996,"5min":0.71099999999999997,"15min":0.80700000000000005},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46200000000000002,"15min":0.45900000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.63500000000000001,"5min":0.68100000000000005,"15min":1.3919999999999999},"last":0.34799999999999998}]},{"osd":6,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.50600000000000001,"15min":0.496},"min":{"1min":0.316,"5min":0.316,"15min":0.31},"max":{"1min":0.64800000000000002,"5min":0.83599999999999997,"15min":0.93300000000000005},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54900000000000004,"15min":0.54400000000000004},"min":{"1min":0.41499999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67600000000000005,"5min":0.78100000000000003,"15min":0.92500000000000004},"last":0.42399999999999999}]},{"osd":7,"last update":"Thu Nov 30 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51300000000000001,"15min":0.51900000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30099999999999999},"max":{"1min":0.70099999999999996,"5min":0.85699999999999998,"15min":1.246},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.41499999999999998,"5min":0.39900000000000002,"15min":0.371},"max":{"1min":0.72299999999999998,"5min":0.88900000000000001,"15min":1.321},"last":0.51300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575754,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307532,"kb_used_data":2244,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064308,"statfs":{"total":96636764160,"available":96321851392,"internally_reserved":0,"allocated":2297856,"data_stored":1173397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.54300000000000004,"15min":0.55000000000000004},"min":{"1min":0.34799999999999998,"5min":0.33400000000000002,"15min":0.30099999999999999},"max":{"1min":0.59999999999999998,"5min":0.73799999999999999,"15min":0.81899999999999995},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.54700000000000004,"15min":0.55000000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.30399999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.59099999999999997}]},{"osd":1,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.34799999999999998,"5min":0.33200000000000002,"15min":0.29499999999999998},"max":{"1min":0.72299999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.55800000000000005,"15min":0.56399999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.69399999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.73999999999999999}]},{"osd":2,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.376,"5min":0.372,"15min":0.35099999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.35299999999999998},"max":{"1min":0.66500000000000004,"5min":0.84999999999999998,"15min":0.876},"last":0.72199999999999998}]},{"osd":3,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.622}]},{"osd":4,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.441,"15min":0.437},"min":{"1min":0.309,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.47399999999999998,"15min":0.46700000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.42799999999999999}]},{"osd":6,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48199999999999998,"15min":0.47899999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55700000000000005,"15min":0.54900000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.313},"max":{"1min":0.73499999999999999,"5min":0.76700000000000002,"15min":0.83499999999999996},"last":0.50600000000000001}]},{"osd":7,"last update":"Thu Nov 30 18:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.54300000000000004,"15min":0.52600000000000002},"min":{"1min":0.33300000000000002,"5min":0.313,"15min":0.313},"max":{"1min":3.2240000000000002,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.59099999999999997,"15min":0.57899999999999996},"min":{"1min":0.42999999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":3.1659999999999999,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.51700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T18:23:21.083 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-30T18:23:21.083 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-30T18:23:21.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.207+0000 7f182115c700 1 Processor -- start 2023-11-30T18:23:21.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.207+0000 7f182115c700 1 -- start start 2023-11-30T18:23:21.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.207+0000 7f182115c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f181c098d10 0x7f181c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:21.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.207+0000 7f182115c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f181c0c6190 0x7f181c063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:21.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.207+0000 7f182115c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f181c064350 0x7f181c158320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:21.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.207+0000 7f182115c700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f181c0c72d0 con 0x7f181c0c6190 2023-11-30T18:23:21.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.207+0000 7f182115c700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f181c154bc0 con 0x7f181c098d10 2023-11-30T18:23:21.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.207+0000 7f182115c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181c0c66c0 con 0x7f181c064350 2023-11-30T18:23:21.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.208+0000 7f181a59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f181c0c6190 0x7f181c063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:21.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.208+0000 7f181a59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f181c0c6190 0x7f181c063e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42090/0 (socket says 172.21.15.49:42090) 2023-11-30T18:23:21.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.208+0000 7f181a59c700 1 -- 172.21.15.49:0/2703404937 learned_addr learned my addr 172.21.15.49:0/2703404937 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:21.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.208+0000 7f181ad9d700 1 --2- 172.21.15.49:0/2703404937 >> v2:172.21.15.115:3300/0 conn(0x7f181c098d10 0x7f181c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:21.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.208+0000 7f181b59e700 1 --2- 172.21.15.49:0/2703404937 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f181c064350 0x7f181c158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:21.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.208+0000 7f181a59c700 1 -- 172.21.15.49:0/2703404937 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f181c064350 msgr2=0x7f181c158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:21.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.208+0000 7f181a59c700 1 --2- 172.21.15.49:0/2703404937 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f181c064350 0x7f181c158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:21.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.208+0000 7f181a59c700 1 -- 172.21.15.49:0/2703404937 >> v2:172.21.15.115:3300/0 conn(0x7f181c098d10 msgr2=0x7f181c0c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:21.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.208+0000 7f181a59c700 1 --2- 172.21.15.49:0/2703404937 >> v2:172.21.15.115:3300/0 conn(0x7f181c098d10 0x7f181c0c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:21.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.208+0000 7f181a59c700 1 -- 172.21.15.49:0/2703404937 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181c0c69a0 con 0x7f181c0c6190 2023-11-30T18:23:21.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.208+0000 7f181ad9d700 1 --2- 172.21.15.49:0/2703404937 >> v2:172.21.15.115:3300/0 conn(0x7f181c098d10 0x7f181c0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:23:21.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.208+0000 7f181b59e700 1 --2- 172.21.15.49:0/2703404937 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f181c064350 0x7f181c158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:23:21.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.208+0000 7f181a59c700 1 --2- 172.21.15.49:0/2703404937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f181c0c6190 0x7f181c063e60 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f181c083f80 tx=0x7f18040090f0).ready entity=mon.0 client_cookie=a0aea4da50d9e706 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:21.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.208+0000 7f1819d9b700 1 -- 172.21.15.49:0/2703404937 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180400b600 con 0x7f181c0c6190 2023-11-30T18:23:21.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.208+0000 7f1819d9b700 1 -- 172.21.15.49:0/2703404937 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180400b760 con 0x7f181c0c6190 2023-11-30T18:23:21.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.208+0000 7f1819d9b700 1 -- 172.21.15.49:0/2703404937 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180400bae0 con 0x7f181c0c6190 2023-11-30T18:23:21.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.209+0000 7f182115c700 1 -- 172.21.15.49:0/2703404937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f181c0c6190 msgr2=0x7f181c063e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:21.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.209+0000 7f182115c700 1 --2- 172.21.15.49:0/2703404937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f181c0c6190 0x7f181c063e60 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f181c083f80 tx=0x7f18040090f0).stop 2023-11-30T18:23:21.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.209+0000 7f182115c700 1 -- 172.21.15.49:0/2703404937 shutdown_connections 2023-11-30T18:23:21.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.209+0000 7f182115c700 1 --2- 172.21.15.49:0/2703404937 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f181c064350 0x7f181c158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:21.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.209+0000 7f182115c700 1 --2- 172.21.15.49:0/2703404937 >> v2:172.21.15.115:3300/0 conn(0x7f181c098d10 0x7f181c0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:21.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.209+0000 7f182115c700 1 --2- 172.21.15.49:0/2703404937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f181c0c6190 0x7f181c063e60 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:21.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.209+0000 7f182115c700 1 -- 172.21.15.49:0/2703404937 >> 172.21.15.49:0/2703404937 conn(0x7f181c0cb310 msgr2=0x7f181c0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:21.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.209+0000 7f182115c700 1 -- 172.21.15.49:0/2703404937 shutdown_connections 2023-11-30T18:23:21.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.209+0000 7f182115c700 1 -- 172.21.15.49:0/2703404937 wait complete. 2023-11-30T18:23:21.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.210+0000 7f182115c700 1 Processor -- start 2023-11-30T18:23:21.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.210+0000 7f182115c700 1 -- start start 2023-11-30T18:23:21.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.211+0000 7f182115c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f181c064350 0x7f181c0c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:21.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.211+0000 7f182115c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f181c098d10 0x7f181c1561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:21.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.211+0000 7f182115c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f181c0c6190 0x7f181c154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:21.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.211+0000 7f182115c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c0c28c0 con 0x7f181c098d10 2023-11-30T18:23:21.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.211+0000 7f182115c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c0c51a0 con 0x7f181c064350 2023-11-30T18:23:21.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.211+0000 7f182115c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181c0b0de0 con 0x7f181c0c6190 2023-11-30T18:23:21.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.211+0000 7f181a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f181c098d10 0x7f181c1561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:21.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.211+0000 7f181a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f181c098d10 0x7f181c1561c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42094/0 (socket says 172.21.15.49:42094) 2023-11-30T18:23:21.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.211+0000 7f181a59c700 1 -- 172.21.15.49:0/1861984277 learned_addr learned my addr 172.21.15.49:0/1861984277 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:21.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.211+0000 7f181ad9d700 1 --2- 172.21.15.49:0/1861984277 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f181c064350 0x7f181c0c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:21.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.211+0000 7f181b59e700 1 --2- 172.21.15.49:0/1861984277 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f181c0c6190 0x7f181c154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:21.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.211+0000 7f181a59c700 1 -- 172.21.15.49:0/1861984277 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f181c0c6190 msgr2=0x7f181c154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:21.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.211+0000 7f181a59c700 1 --2- 172.21.15.49:0/1861984277 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f181c0c6190 0x7f181c154dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:21.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.211+0000 7f181a59c700 1 -- 172.21.15.49:0/1861984277 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f181c064350 msgr2=0x7f181c0c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:21.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.211+0000 7f181a59c700 1 --2- 172.21.15.49:0/1861984277 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f181c064350 0x7f181c0c4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:21.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.211+0000 7f181a59c700 1 -- 172.21.15.49:0/1861984277 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1804009370 con 0x7f181c098d10 2023-11-30T18:23:21.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.212+0000 7f181a59c700 1 --2- 172.21.15.49:0/1861984277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f181c098d10 0x7f181c1561c0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7f1804009130 tx=0x7f1804017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:21.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.212+0000 7f1812ffd700 1 -- 172.21.15.49:0/1861984277 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180400b8d0 con 0x7f181c098d10 2023-11-30T18:23:21.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.212+0000 7f1812ffd700 1 -- 172.21.15.49:0/1861984277 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180400ba50 con 0x7f181c098d10 2023-11-30T18:23:21.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.212+0000 7f182115c700 1 -- 172.21.15.49:0/1861984277 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f181c0b10c0 con 0x7f181c098d10 2023-11-30T18:23:21.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.212+0000 7f1812ffd700 1 -- 172.21.15.49:0/1861984277 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180401c670 con 0x7f181c098d10 2023-11-30T18:23:21.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.212+0000 7f182115c700 1 -- 172.21.15.49:0/1861984277 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f181c1566b0 con 0x7f181c098d10 2023-11-30T18:23:21.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.213+0000 7f182115c700 1 -- 172.21.15.49:0/1861984277 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f181c0c2390 con 0x7f181c098d10 2023-11-30T18:23:21.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.213+0000 7f1812ffd700 1 -- 172.21.15.49:0/1861984277 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f180401c9e0 con 0x7f181c098d10 2023-11-30T18:23:21.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.213+0000 7f1812ffd700 1 --2- 172.21.15.49:0/1861984277 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f17fc05f240 0x7f17fc061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:21.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.214+0000 7f1812ffd700 1 -- 172.21.15.49:0/1861984277 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f180407bbd0 con 0x7f181c098d10 2023-11-30T18:23:21.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.214+0000 7f181ad9d700 1 --2- 172.21.15.49:0/1861984277 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f17fc05f240 0x7f17fc061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:21.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.214+0000 7f181ad9d700 1 --2- 172.21.15.49:0/1861984277 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f17fc05f240 0x7f17fc061700 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f180c00ab40 tx=0x7f180c008040).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:21.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.218+0000 7f1812ffd700 1 -- 172.21.15.49:0/1861984277 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f180404cce0 con 0x7f181c098d10 2023-11-30T18:23:21.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.463+0000 7f182115c700 1 -- 172.21.15.49:0/1861984277 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f181c06c860 con 0x7f181c098d10 2023-11-30T18:23:21.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.467+0000 7f1812ffd700 1 -- 172.21.15.49:0/1861984277 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v43) v1 ==== 190+0+0 (secure 0 0 0) 0x7f1804020070 con 0x7f181c098d10 2023-11-30T18:23:21.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.469+0000 7f182115c700 1 -- 172.21.15.49:0/1861984277 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f17fc05f240 msgr2=0x7f17fc061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:21.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.469+0000 7f182115c700 1 --2- 172.21.15.49:0/1861984277 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f17fc05f240 0x7f17fc061700 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f180c00ab40 tx=0x7f180c008040).stop 2023-11-30T18:23:21.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.469+0000 7f182115c700 1 -- 172.21.15.49:0/1861984277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f181c098d10 msgr2=0x7f181c1561c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:21.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.469+0000 7f182115c700 1 --2- 172.21.15.49:0/1861984277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f181c098d10 0x7f181c1561c0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7f1804009130 tx=0x7f1804017000).stop 2023-11-30T18:23:21.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.469+0000 7f182115c700 1 -- 172.21.15.49:0/1861984277 shutdown_connections 2023-11-30T18:23:21.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.469+0000 7f182115c700 1 --2- 172.21.15.49:0/1861984277 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f181c0c6190 0x7f181c154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:21.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.469+0000 7f182115c700 1 --2- 172.21.15.49:0/1861984277 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f181c064350 0x7f181c0c4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:21.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.469+0000 7f182115c700 1 --2- 172.21.15.49:0/1861984277 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f17fc05f240 0x7f17fc061700 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:21.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.469+0000 7f182115c700 1 --2- 172.21.15.49:0/1861984277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f181c098d10 0x7f181c1561c0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:21.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.469+0000 7f182115c700 1 -- 172.21.15.49:0/1861984277 >> 172.21.15.49:0/1861984277 conn(0x7f181c0cb310 msgr2=0x7f181c158000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:21.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.469+0000 7f182115c700 1 -- 172.21.15.49:0/1861984277 shutdown_connections 2023-11-30T18:23:21.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.469+0000 7f182115c700 1 -- 172.21.15.49:0/1861984277 wait complete. 2023-11-30T18:23:21.472 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2023-11-30T18:23:21.482 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:23:21.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.598+0000 7f5fe15f7700 1 Processor -- start 2023-11-30T18:23:21.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.598+0000 7f5fe15f7700 1 -- start start 2023-11-30T18:23:21.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.599+0000 7f5fe15f7700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5fdc157660 0x7f5fdc157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:21.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.599+0000 7f5fe15f7700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5fdc0c0180 0x7f5fdc1589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:21.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.599+0000 7f5fe15f7700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fdc0c12c0 con 0x7f5fdc0c1750 2023-11-30T18:23:21.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.599+0000 7f5fe15f7700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fdc0c06b0 con 0x7f5fdc0c0180 2023-11-30T18:23:21.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.599+0000 7f5fe15f7700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fdc0c0990 con 0x7f5fdc157660 2023-11-30T18:23:21.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.599+0000 7f5fdb7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5fdc0c0180 0x7f5fdc1589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:21.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.599+0000 7f5fe0df6700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5fdc0c1750 0x7f5fdc0648d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37218/0 (socket says 172.21.15.49:37218) 2023-11-30T18:23:21.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.599+0000 7f5fe0df6700 1 -- 172.21.15.49:0/456646367 learned_addr learned my addr 172.21.15.49:0/456646367 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:23:21.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.599+0000 7f5fdbfff700 1 --2- 172.21.15.49:0/456646367 >> v2:172.21.15.115:3300/0 conn(0x7f5fdc157660 0x7f5fdc157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:21.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.599+0000 7f5fdb7fe700 1 -- 172.21.15.49:0/456646367 >> v2:172.21.15.115:3300/0 conn(0x7f5fdc157660 msgr2=0x7f5fdc157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:21.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.599+0000 7f5fdb7fe700 1 --2- 172.21.15.49:0/456646367 >> v2:172.21.15.115:3300/0 conn(0x7f5fdc157660 0x7f5fdc157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:21.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.599+0000 7f5fdaffd700 1 -- 172.21.15.49:0/456646367 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 29855149 0 0) 0x7f5fdc0c12c0 con 0x7f5fdc0c1750 2023-11-30T18:23:21.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.599+0000 7f5fdb7fe700 1 -- 172.21.15.49:0/456646367 >> v1:172.21.15.49:6789/0 conn(0x7f5fdc0c1750 legacy=0x7f5fdc0648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:21.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.599+0000 7f5fdb7fe700 1 -- 172.21.15.49:0/456646367 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fdc0c0c70 con 0x7f5fdc0c0180 2023-11-30T18:23:21.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.599+0000 7f5fdb7fe700 1 --2- 172.21.15.49:0/456646367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fdc0c0180 0x7f5fdc1589c0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7f5fdc0839a0 tx=0x7f5fcc009060).ready entity=mon.0 client_cookie=7cb82a6fcaf55c8d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:21.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.600+0000 7f5fdaffd700 1 -- 172.21.15.49:0/456646367 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc00b580 con 0x7f5fdc0c0180 2023-11-30T18:23:21.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.600+0000 7f5fdaffd700 1 -- 172.21.15.49:0/456646367 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fcc00b6e0 con 0x7f5fdc0c0180 2023-11-30T18:23:21.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.600+0000 7f5fdaffd700 1 -- 172.21.15.49:0/456646367 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc00ba60 con 0x7f5fdc0c0180 2023-11-30T18:23:21.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.600+0000 7f5fe15f7700 1 -- 172.21.15.49:0/456646367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fdc0c0180 msgr2=0x7f5fdc1589c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:21.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.600+0000 7f5fe15f7700 1 --2- 172.21.15.49:0/456646367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fdc0c0180 0x7f5fdc1589c0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7f5fdc0839a0 tx=0x7f5fcc009060).stop 2023-11-30T18:23:21.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.600+0000 7f5fe15f7700 1 -- 172.21.15.49:0/456646367 shutdown_connections 2023-11-30T18:23:21.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.600+0000 7f5fe15f7700 1 --2- 172.21.15.49:0/456646367 >> v2:172.21.15.115:3300/0 conn(0x7f5fdc157660 0x7f5fdc157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:21.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.600+0000 7f5fe15f7700 1 --2- 172.21.15.49:0/456646367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fdc0c0180 0x7f5fdc1589c0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:21.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.600+0000 7f5fe15f7700 1 -- 172.21.15.49:0/456646367 >> 172.21.15.49:0/456646367 conn(0x7f5fdc0cb000 msgr2=0x7f5fdc0cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:21.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.600+0000 7f5fe15f7700 1 -- 172.21.15.49:0/456646367 shutdown_connections 2023-11-30T18:23:21.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.600+0000 7f5fe15f7700 1 -- 172.21.15.49:0/456646367 wait complete. 2023-11-30T18:23:21.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.601+0000 7f5fe15f7700 1 Processor -- start 2023-11-30T18:23:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.602+0000 7f5fe15f7700 1 -- start start 2023-11-30T18:23:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.602+0000 7f5fe15f7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5fdc0c0180 0x7f5fdc0c1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.602+0000 7f5fe15f7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fdc0c1750 0x7f5fdc145d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.602+0000 7f5fe15f7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fdc157660 0x7f5fdc0a9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.602+0000 7f5fe15f7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc0c3640 con 0x7f5fdc157660 2023-11-30T18:23:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.602+0000 7f5fe15f7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc0c31b0 con 0x7f5fdc0c1750 2023-11-30T18:23:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.602+0000 7f5fe15f7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc146210 con 0x7f5fdc0c0180 2023-11-30T18:23:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.602+0000 7f5fe0df6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fdc157660 0x7f5fdc0a9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.603+0000 7f5fe0df6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fdc157660 0x7f5fdc0a9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42122/0 (socket says 172.21.15.49:42122) 2023-11-30T18:23:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.603+0000 7f5fe0df6700 1 -- 172.21.15.49:0/3720718263 learned_addr learned my addr 172.21.15.49:0/3720718263 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.603+0000 7f5fdb7fe700 1 --2- 172.21.15.49:0/3720718263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fdc0c1750 0x7f5fdc145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.603+0000 7f5fdbfff700 1 --2- 172.21.15.49:0/3720718263 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5fdc0c0180 0x7f5fdc0c1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.603+0000 7f5fe0df6700 1 -- 172.21.15.49:0/3720718263 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5fdc0c0180 msgr2=0x7f5fdc0c1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.603+0000 7f5fe0df6700 1 --2- 172.21.15.49:0/3720718263 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5fdc0c0180 0x7f5fdc0c1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:21.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.603+0000 7f5fe0df6700 1 -- 172.21.15.49:0/3720718263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fdc0c1750 msgr2=0x7f5fdc145d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:21.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.603+0000 7f5fe0df6700 1 --2- 172.21.15.49:0/3720718263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fdc0c1750 0x7f5fdc145d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:21.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.603+0000 7f5fe0df6700 1 -- 172.21.15.49:0/3720718263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fcc0092a0 con 0x7f5fdc157660 2023-11-30T18:23:21.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.603+0000 7f5fdb7fe700 1 --2- 172.21.15.49:0/3720718263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fdc0c1750 0x7f5fdc145d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:23:21.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.603+0000 7f5fe0df6700 1 --2- 172.21.15.49:0/3720718263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fdc157660 0x7f5fdc0a9e70 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7f5fd400c790 tx=0x7f5fd4007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:21.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.603+0000 7f5fd3fff700 1 -- 172.21.15.49:0/3720718263 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd4005d30 con 0x7f5fdc157660 2023-11-30T18:23:21.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.603+0000 7f5fd3fff700 1 -- 172.21.15.49:0/3720718263 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd4007110 con 0x7f5fdc157660 2023-11-30T18:23:21.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.603+0000 7f5fe15f7700 1 -- 172.21.15.49:0/3720718263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fdc0b0770 con 0x7f5fdc157660 2023-11-30T18:23:21.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.603+0000 7f5fd3fff700 1 -- 172.21.15.49:0/3720718263 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd40074d0 con 0x7f5fdc157660 2023-11-30T18:23:21.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.603+0000 7f5fe15f7700 1 -- 172.21.15.49:0/3720718263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fdc0c2880 con 0x7f5fdc157660 2023-11-30T18:23:21.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.604+0000 7f5fe15f7700 1 -- 172.21.15.49:0/3720718263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fdc0c3340 con 0x7f5fdc157660 2023-11-30T18:23:21.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.604+0000 7f5fd3fff700 1 -- 172.21.15.49:0/3720718263 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f5fd4007840 con 0x7f5fdc157660 2023-11-30T18:23:21.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.605+0000 7f5fd3fff700 1 --2- 172.21.15.49:0/3720718263 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5fbc05f270 0x7f5fbc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:21.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.605+0000 7f5fd3fff700 1 -- 172.21.15.49:0/3720718263 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f5fd407a310 con 0x7f5fdc157660 2023-11-30T18:23:21.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.605+0000 7f5fdbfff700 1 --2- 172.21.15.49:0/3720718263 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5fbc05f270 0x7f5fbc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:21.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.606+0000 7f5fdbfff700 1 --2- 172.21.15.49:0/3720718263 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5fbc05f270 0x7f5fbc061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f5fc4006fd0 tx=0x7f5fc4008040).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:21.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.609+0000 7f5fd3fff700 1 -- 172.21.15.49:0/3720718263 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5fd404b420 con 0x7f5fdc157660 2023-11-30T18:23:21.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.825+0000 7f5fe15f7700 1 -- 172.21.15.49:0/3720718263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5fdc06c7c0 con 0x7f5fdc157660 2023-11-30T18:23:21.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.825+0000 7f5fd3fff700 1 -- 172.21.15.49:0/3720718263 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4499 (secure 0 0 0) 0x7f5fd404ea40 con 0x7f5fdc157660 2023-11-30T18:23:21.827 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:23:21.827 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":77,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1849144206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1849144206},{"type":"v1","addr":"172.21.15.115:6837","nonce":1849144206}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":8686,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/3927708641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3927708641},{"type":"v1","addr":"172.21.15.115:6836","nonce":3927708641}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":8934,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3388701250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3388701250},{"type":"v1","addr":"172.21.15.49:6835","nonce":3388701250}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T18:23:12.095964+0000","modified":"2023-11-30T18:23:15.119579+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8937},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8937":{"gid":8937,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/3993546381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3993546381},{"type":"v1","addr":"172.21.15.49:6834","nonce":3993546381}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-11-30T18:23:21.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.827+0000 7f5fe15f7700 1 -- 172.21.15.49:0/3720718263 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5fbc05f270 msgr2=0x7f5fbc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:21.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.827+0000 7f5fe15f7700 1 --2- 172.21.15.49:0/3720718263 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5fbc05f270 0x7f5fbc061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f5fc4006fd0 tx=0x7f5fc4008040).stop 2023-11-30T18:23:21.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.827+0000 7f5fe15f7700 1 -- 172.21.15.49:0/3720718263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fdc157660 msgr2=0x7f5fdc0a9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:21.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.827+0000 7f5fe15f7700 1 --2- 172.21.15.49:0/3720718263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fdc157660 0x7f5fdc0a9e70 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7f5fd400c790 tx=0x7f5fd4007f30).stop 2023-11-30T18:23:21.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.827+0000 7f5fe15f7700 1 -- 172.21.15.49:0/3720718263 shutdown_connections 2023-11-30T18:23:21.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.827+0000 7f5fe15f7700 1 --2- 172.21.15.49:0/3720718263 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f5fbc05f270 0x7f5fbc061730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:21.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.827+0000 7f5fe15f7700 1 --2- 172.21.15.49:0/3720718263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fdc157660 0x7f5fdc0a9e70 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.827+0000 7f5fe15f7700 1 --2- 172.21.15.49:0/3720718263 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5fdc0c0180 0x7f5fdc0c1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.827+0000 7f5fe15f7700 1 --2- 172.21.15.49:0/3720718263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fdc0c1750 0x7f5fdc145d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.827+0000 7f5fe15f7700 1 -- 172.21.15.49:0/3720718263 >> 172.21.15.49:0/3720718263 conn(0x7f5fdc0cb000 msgr2=0x7f5fdc0648d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.827+0000 7f5fe15f7700 1 -- 172.21.15.49:0/3720718263 shutdown_connections 2023-11-30T18:23:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:21.827+0000 7f5fe15f7700 1 -- 172.21.15.49:0/3720718263 wait complete. 2023-11-30T18:23:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 77 2023-11-30T18:23:22.243 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 77, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-30T18:23:12.095964+0000', 'modified': '2023-11-30T18:23:15.119579+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8937}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8937': {'gid': 8937, 'name': 'a', 'rank': 0, 'incarnation': 73, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6834/3993546381', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6832', 'nonce': 3993546381}, {'type': 'v1', 'addr': '172.21.15.49:6834', 'nonce': 3993546381}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-11-30T18:23:22.243 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-30T18:23:22.243 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-30T18:23:22.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.364+0000 7f99c6da1700 1 Processor -- start 2023-11-30T18:23:22.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.364+0000 7f99c6da1700 1 -- start start 2023-11-30T18:23:22.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.365+0000 7f99c6da1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f99c014e530 0x7f99c00c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:22.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.365+0000 7f99c6da1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99c0158570 0x7f99c0158a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:22.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.365+0000 7f99c6da1700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99c00c7bc0 con 0x7f99c0154950 2023-11-30T18:23:22.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.365+0000 7f99c6da1700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99c0155920 con 0x7f99c014e530 2023-11-30T18:23:22.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.365+0000 7f99c6da1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c0154e00 con 0x7f99c0158570 2023-11-30T18:23:22.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.365+0000 7f99c5d9f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f99c014e530 0x7f99c00c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:22.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.365+0000 7f99c559e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f99c0154950 0x7f99c014e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37226/0 (socket says 172.21.15.49:37226) 2023-11-30T18:23:22.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.365+0000 7f99c5d9f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f99c014e530 0x7f99c00c66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42138/0 (socket says 172.21.15.49:42138) 2023-11-30T18:23:22.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.365+0000 7f99c559e700 1 -- 172.21.15.49:0/583905218 learned_addr learned my addr 172.21.15.49:0/583905218 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:23:22.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.365+0000 7f99c65a0700 1 --2- 172.21.15.49:0/583905218 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99c0158570 0x7f99c0158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:22.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.365+0000 7f99c5d9f700 1 -- 172.21.15.49:0/583905218 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99c0158570 msgr2=0x7f99c0158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:22.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.365+0000 7f99c5d9f700 1 --2- 172.21.15.49:0/583905218 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99c0158570 0x7f99c0158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.365+0000 7f99c5d9f700 1 -- 172.21.15.49:0/583905218 >> v1:172.21.15.49:6789/0 conn(0x7f99c0154950 legacy=0x7f99c014e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:22.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.365+0000 7f99c5d9f700 1 -- 172.21.15.49:0/583905218 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c0155080 con 0x7f99c014e530 2023-11-30T18:23:22.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.365+0000 7f99c4d9d700 1 -- 172.21.15.49:0/583905218 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 977462476 0 0) 0x7f99c00c7bc0 con 0x7f99c0154950 2023-11-30T18:23:22.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.366+0000 7f99c5d9f700 1 --2- 172.21.15.49:0/583905218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c014e530 0x7f99c00c66f0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7f99b0009760 tx=0x7f99b0009060).ready entity=mon.0 client_cookie=d4dbd34984ad1a93 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:22.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.366+0000 7f99c4d9d700 1 -- 172.21.15.49:0/583905218 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b000f510 con 0x7f99c014e530 2023-11-30T18:23:22.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.366+0000 7f99c4d9d700 1 -- 172.21.15.49:0/583905218 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b000f670 con 0x7f99c014e530 2023-11-30T18:23:22.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.366+0000 7f99c4d9d700 1 -- 172.21.15.49:0/583905218 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b000f9f0 con 0x7f99c014e530 2023-11-30T18:23:22.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.366+0000 7f99c6da1700 1 -- 172.21.15.49:0/583905218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c014e530 msgr2=0x7f99c00c66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:22.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.366+0000 7f99c6da1700 1 --2- 172.21.15.49:0/583905218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c014e530 0x7f99c00c66f0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7f99b0009760 tx=0x7f99b0009060).stop 2023-11-30T18:23:22.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.366+0000 7f99c6da1700 1 -- 172.21.15.49:0/583905218 shutdown_connections 2023-11-30T18:23:22.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.366+0000 7f99c6da1700 1 --2- 172.21.15.49:0/583905218 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99c0158570 0x7f99c0158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.366+0000 7f99c6da1700 1 --2- 172.21.15.49:0/583905218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c014e530 0x7f99c00c66f0 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.366+0000 7f99c6da1700 1 -- 172.21.15.49:0/583905218 >> 172.21.15.49:0/583905218 conn(0x7f99c0064990 msgr2=0x7f99c0064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:22.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.366+0000 7f99c6da1700 1 -- 172.21.15.49:0/583905218 shutdown_connections 2023-11-30T18:23:22.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.366+0000 7f99c6da1700 1 -- 172.21.15.49:0/583905218 wait complete. 2023-11-30T18:23:22.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.367+0000 7f99c6da1700 1 Processor -- start 2023-11-30T18:23:22.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.367+0000 7f99c6da1700 1 -- start start 2023-11-30T18:23:22.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.368+0000 7f99c6da1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99c014e530 0x7f99c013c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:22.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.368+0000 7f99c6da1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99c0154950 0x7f99c00bffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:22.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.368+0000 7f99c6da1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c0158570 0x7f99c00c04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:22.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.368+0000 7f99c6da1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c00c09c0 con 0x7f99c0158570 2023-11-30T18:23:22.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.368+0000 7f99c6da1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c00c2ed0 con 0x7f99c014e530 2023-11-30T18:23:22.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.368+0000 7f99c6da1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c00c22c0 con 0x7f99c0154950 2023-11-30T18:23:22.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.368+0000 7f99c65a0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c0158570 0x7f99c00c04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:22.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.368+0000 7f99c65a0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c0158570 0x7f99c00c04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42140/0 (socket says 172.21.15.49:42140) 2023-11-30T18:23:22.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.368+0000 7f99c65a0700 1 -- 172.21.15.49:0/1765656533 learned_addr learned my addr 172.21.15.49:0/1765656533 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:22.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.369+0000 7f99c559e700 1 --2- 172.21.15.49:0/1765656533 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99c0154950 0x7f99c00bffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:22.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.369+0000 7f99c5d9f700 1 --2- 172.21.15.49:0/1765656533 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99c014e530 0x7f99c013c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:22.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.369+0000 7f99c65a0700 1 -- 172.21.15.49:0/1765656533 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99c0154950 msgr2=0x7f99c00bffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:22.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.369+0000 7f99c65a0700 1 --2- 172.21.15.49:0/1765656533 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99c0154950 0x7f99c00bffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.369+0000 7f99c65a0700 1 -- 172.21.15.49:0/1765656533 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99c014e530 msgr2=0x7f99c013c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:22.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.369+0000 7f99c65a0700 1 --2- 172.21.15.49:0/1765656533 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99c014e530 0x7f99c013c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.369+0000 7f99c65a0700 1 -- 172.21.15.49:0/1765656533 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b00092a0 con 0x7f99c0158570 2023-11-30T18:23:22.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.369+0000 7f99c5d9f700 1 --2- 172.21.15.49:0/1765656533 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99c014e530 0x7f99c013c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:23:22.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.369+0000 7f99c559e700 1 --2- 172.21.15.49:0/1765656533 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99c0154950 0x7f99c00bffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:23:22.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.369+0000 7f99c65a0700 1 --2- 172.21.15.49:0/1765656533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c0158570 0x7f99c00c04d0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7f99b8009df0 tx=0x7f99b800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:22.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.369+0000 7f99bdffb700 1 -- 172.21.15.49:0/1765656533 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b800cb50 con 0x7f99c0158570 2023-11-30T18:23:22.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.369+0000 7f99bdffb700 1 -- 172.21.15.49:0/1765656533 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b800f040 con 0x7f99c0158570 2023-11-30T18:23:22.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.369+0000 7f99c6da1700 1 -- 172.21.15.49:0/1765656533 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99c00c25a0 con 0x7f99c0158570 2023-11-30T18:23:22.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.369+0000 7f99bdffb700 1 -- 172.21.15.49:0/1765656533 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b800cec0 con 0x7f99c0158570 2023-11-30T18:23:22.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.369+0000 7f99c6da1700 1 -- 172.21.15.49:0/1765656533 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c00c2b60 con 0x7f99c0158570 2023-11-30T18:23:22.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.370+0000 7f99bdffb700 1 -- 172.21.15.49:0/1765656533 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f99b8013610 con 0x7f99c0158570 2023-11-30T18:23:22.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.371+0000 7f99bdffb700 1 --2- 172.21.15.49:0/1765656533 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f99ac05f270 0x7f99ac061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:22.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.371+0000 7f99bdffb700 1 -- 172.21.15.49:0/1765656533 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f99b807ac40 con 0x7f99c0158570 2023-11-30T18:23:22.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.371+0000 7f99c5d9f700 1 --2- 172.21.15.49:0/1765656533 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f99ac05f270 0x7f99ac061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:22.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.371+0000 7f99c5d9f700 1 --2- 172.21.15.49:0/1765656533 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f99ac05f270 0x7f99ac061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f99b0009fd0 tx=0x7f99b0017000).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:22.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.373+0000 7f99d999bb80 1 Processor -- start 2023-11-30T18:23:22.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.373+0000 7f99d999bb80 1 -- start start 2023-11-30T18:23:22.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.373+0000 7f99d999bb80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55a45f122e40 0x55a45f366880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:22.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.373+0000 7f99d999bb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a45f3af4e0 0x55a45f366d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:22.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.373+0000 7f99d999bb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a45f38ecf0 0x55a45f3617e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:22.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.373+0000 7f99d999bb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a45f32c060 con 0x55a45f3af4e0 2023-11-30T18:23:22.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.373+0000 7f99d999bb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a45f2a31f0 con 0x55a45f38ecf0 2023-11-30T18:23:22.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.373+0000 7f99d999bb80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a45f2b8440 con 0x55a45f122e40 2023-11-30T18:23:22.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.374+0000 7f99c559e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a45f3af4e0 0x55a45f366d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:22.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.374+0000 7f99c559e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a45f3af4e0 0x55a45f366d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42144/0 (socket says 172.21.15.49:42144) 2023-11-30T18:23:22.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.374+0000 7f99c559e700 1 -- 172.21.15.49:0/1258435745 learned_addr learned my addr 172.21.15.49:0/1258435745 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:22.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.374+0000 7f99c5d9f700 1 --2- 172.21.15.49:0/1258435745 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55a45f122e40 0x55a45f366880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:22.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.374+0000 7f99c65a0700 1 --2- 172.21.15.49:0/1258435745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a45f38ecf0 0x55a45f3617e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:22.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.374+0000 7f99c559e700 1 -- 172.21.15.49:0/1258435745 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55a45f122e40 msgr2=0x55a45f366880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:22.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.374+0000 7f99c559e700 1 --2- 172.21.15.49:0/1258435745 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55a45f122e40 0x55a45f366880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.374+0000 7f99c559e700 1 -- 172.21.15.49:0/1258435745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a45f38ecf0 msgr2=0x55a45f3617e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:22.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.374+0000 7f99c559e700 1 --2- 172.21.15.49:0/1258435745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a45f38ecf0 0x55a45f3617e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.374+0000 7f99c559e700 1 -- 172.21.15.49:0/1258435745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a45f2b1620 con 0x55a45f3af4e0 2023-11-30T18:23:22.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.374+0000 7f99c65a0700 1 --2- 172.21.15.49:0/1258435745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a45f38ecf0 0x55a45f3617e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:23:22.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.374+0000 7f99c559e700 1 --2- 172.21.15.49:0/1258435745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a45f3af4e0 0x55a45f366d70 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7f99b4001750 tx=0x7f99b4009040).ready entity=mon.0 client_cookie=dc67f608e8f72c2c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:22.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.374+0000 7f99a6ffd700 1 -- 172.21.15.49:0/1258435745 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b40072e0 con 0x55a45f3af4e0 2023-11-30T18:23:22.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.374+0000 7f99a6ffd700 1 -- 172.21.15.49:0/1258435745 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b4007440 con 0x55a45f3af4e0 2023-11-30T18:23:22.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.374+0000 7f99a6ffd700 1 -- 172.21.15.49:0/1258435745 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b40057a0 con 0x55a45f3af4e0 2023-11-30T18:23:22.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.375+0000 7f99d999bb80 1 -- 172.21.15.49:0/1258435745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a45f3af4e0 msgr2=0x55a45f366d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:22.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.375+0000 7f99d999bb80 1 --2- 172.21.15.49:0/1258435745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a45f3af4e0 0x55a45f366d70 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7f99b4001750 tx=0x7f99b4009040).stop 2023-11-30T18:23:22.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.375+0000 7f99d999bb80 1 -- 172.21.15.49:0/1258435745 shutdown_connections 2023-11-30T18:23:22.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.375+0000 7f99d999bb80 1 --2- 172.21.15.49:0/1258435745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a45f38ecf0 0x55a45f3617e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.375+0000 7f99d999bb80 1 --2- 172.21.15.49:0/1258435745 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55a45f122e40 0x55a45f366880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.375+0000 7f99d999bb80 1 --2- 172.21.15.49:0/1258435745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a45f3af4e0 0x55a45f366d70 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.375+0000 7f99d999bb80 1 -- 172.21.15.49:0/1258435745 >> 172.21.15.49:0/1258435745 conn(0x55a45f1d04a0 msgr2=0x55a45f3af970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:22.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.375+0000 7f99d999bb80 1 -- 172.21.15.49:0/1258435745 shutdown_connections 2023-11-30T18:23:22.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.375+0000 7f99d999bb80 1 -- 172.21.15.49:0/1258435745 wait complete. 2023-11-30T18:23:22.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.376+0000 7f99d999bb80 1 -- start start 2023-11-30T18:23:22.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.376+0000 7f99d999bb80 1 Processor -- start 2023-11-30T18:23:22.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.377+0000 7f99d999bb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a45f122e40 0x55a45f38b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:22.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.377+0000 7f99d999bb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a45f38ecf0 0x55a45f38b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:22.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.377+0000 7f99d999bb80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55a45f3af4e0 0x55a45f3888a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:22.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.377+0000 7f99d999bb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a45f2b8580 con 0x55a45f38ecf0 2023-11-30T18:23:22.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.377+0000 7f99d999bb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a45f2b8800 con 0x55a45f122e40 2023-11-30T18:23:22.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.377+0000 7f99d999bb80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a45f283e10 con 0x55a45f3af4e0 2023-11-30T18:23:22.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.377+0000 7f99d999bb80 10 client.0 ll_register_callbacks cb 0x55a45f326640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-30T18:23:22.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.377+0000 7f99c559e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a45f38ecf0 0x55a45f38b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:22.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.377+0000 7f99c559e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a45f38ecf0 0x55a45f38b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42152/0 (socket says 172.21.15.49:42152) 2023-11-30T18:23:22.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.377+0000 7f99c559e700 1 -- 172.21.15.49:0/2209416534 learned_addr learned my addr 172.21.15.49:0/2209416534 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:22.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.377+0000 7f99c65a0700 1 --2- 172.21.15.49:0/2209416534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55a45f3af4e0 0x55a45f3888a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:22.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.377+0000 7f99c5d9f700 1 --2- 172.21.15.49:0/2209416534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a45f122e40 0x55a45f38b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:22.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.377+0000 7f99c559e700 1 -- 172.21.15.49:0/2209416534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55a45f3af4e0 msgr2=0x55a45f3888a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:22.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.377+0000 7f99c559e700 1 --2- 172.21.15.49:0/2209416534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55a45f3af4e0 0x55a45f3888a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.377+0000 7f99c559e700 1 -- 172.21.15.49:0/2209416534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a45f122e40 msgr2=0x55a45f38b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:22.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.377+0000 7f99c559e700 1 --2- 172.21.15.49:0/2209416534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a45f122e40 0x55a45f38b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.377+0000 7f99c559e700 1 -- 172.21.15.49:0/2209416534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b4001330 con 0x55a45f38ecf0 2023-11-30T18:23:22.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.377+0000 7f99c559e700 1 --2- 172.21.15.49:0/2209416534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a45f38ecf0 0x55a45f38b780 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f99b400b000 tx=0x55a45f3674d0).ready entity=mon.0 client_cookie=7af2dc65d0fdadd8 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:22.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.377+0000 7f999ffff700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-30T18:23:22.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.377+0000 7f999ffff700 1 -- 172.21.15.49:0/2209416534 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b4013420 con 0x55a45f38ecf0 2023-11-30T18:23:22.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.377+0000 7f999ffff700 1 -- 172.21.15.49:0/2209416534 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(184..184 src has 1..184) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f99b4013580 con 0x55a45f38ecf0 2023-11-30T18:23:22.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.377+0000 7f99d999bb80 1 -- 172.21.15.49:0/2209416534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a45f35a720 con 0x55a45f38ecf0 2023-11-30T18:23:22.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.377+0000 7f999ffff700 1 -- 172.21.15.49:0/2209416534 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99b4013740 con 0x55a45f38ecf0 2023-11-30T18:23:22.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.377+0000 7f99d999bb80 10 client.9138 fetch_fsmap learned FSMap version 77 2023-11-30T18:23:22.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.377+0000 7f99d999bb80 1 -- 172.21.15.49:0/2209416534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) v3 -- 0x55a45f2ac9c0 con 0x55a45f38ecf0 2023-11-30T18:23:22.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.378+0000 7f999ffff700 1 -- 172.21.15.49:0/2209416534 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a45f35a720 con 0x55a45f38ecf0 2023-11-30T18:23:22.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.378+0000 7f999ffff700 1 -- 172.21.15.49:0/2209416534 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 77) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f99b40138a0 con 0x55a45f38ecf0 2023-11-30T18:23:22.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.378+0000 7f99d999bb80 10 client.9138 fetch_fsmap finished waiting for FSMap version 77 2023-11-30T18:23:22.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.378+0000 7f99d999bb80 10 client.9138 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-30T18:23:22.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.378+0000 7f99d999bb80 20 client.9138 populate_metadata read hostname 'smithi049' 2023-11-30T18:23:22.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.378+0000 7f99d999bb80 1 --2- 172.21.15.49:0/2209416534 >> [v2:172.21.15.49:6832/3993546381,v1:172.21.15.49:6834/3993546381] conn(0x55a45f3bc2d0 0x55a45f3bc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:22.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.378+0000 7f99d999bb80 4 client.9138 mds_command: new command op to 8937 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-30T18:23:22.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.378+0000 7f99d999bb80 1 -- 172.21.15.49:0/2209416534 --> [v2:172.21.15.49:6832/3993546381,v1:172.21.15.49:6834/3993546381] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a45f11eca0 con 0x55a45f3bc2d0 2023-11-30T18:23:22.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.378+0000 7f99c5d9f700 1 --2- 172.21.15.49:0/2209416534 >> [v2:172.21.15.49:6832/3993546381,v1:172.21.15.49:6834/3993546381] conn(0x55a45f3bc2d0 0x55a45f3bc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:22.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.378+0000 7f99c5d9f700 1 --2- 172.21.15.49:0/2209416534 >> [v2:172.21.15.49:6832/3993546381,v1:172.21.15.49:6834/3993546381] conn(0x55a45f3bc2d0 0x55a45f3bc6b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7e42abbb1d286075 server_cookie=d3f650f950a67e88 in_seq=0 out_seq=0 2023-11-30T18:23:22.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.378+0000 7f999ffff700 10 client.9138 ms_handle_connect on v2:172.21.15.49:6832/3993546381 2023-11-30T18:23:22.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.379+0000 7f999ffff700 1 -- 172.21.15.49:0/2209416534 <== mds.0 v2:172.21.15.49:6832/3993546381 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55a45f11eca0 con 0x55a45f3bc2d0 2023-11-30T18:23:22.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.379+0000 7f999ffff700 10 client.9138 handle_command_reply: tid=0 2023-11-30T18:23:22.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.379+0000 7f99d999bb80 1 client.9138 shutdown 2023-11-30T18:23:22.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.379+0000 7f99d999bb80 1 -- 172.21.15.49:0/2209416534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a45f38ecf0 msgr2=0x55a45f38b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:22.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.379+0000 7f99d999bb80 1 --2- 172.21.15.49:0/2209416534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a45f38ecf0 0x55a45f38b780 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f99b400b000 tx=0x55a45f3674d0).stop 2023-11-30T18:23:22.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.379+0000 7f99d999bb80 1 -- 172.21.15.49:0/2209416534 shutdown_connections 2023-11-30T18:23:22.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.379+0000 7f99d999bb80 1 --2- 172.21.15.49:0/2209416534 >> [v2:172.21.15.49:6832/3993546381,v1:172.21.15.49:6834/3993546381] conn(0x55a45f3bc2d0 0x55a45f3bc6b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.379+0000 7f99d999bb80 1 --2- 172.21.15.49:0/2209416534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55a45f3af4e0 0x55a45f3888a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.379+0000 7f99d999bb80 1 --2- 172.21.15.49:0/2209416534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a45f122e40 0x55a45f38b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.379+0000 7f999ffff700 0 client.9138 ms_handle_reset on v2:172.21.15.49:6832/3993546381 2023-11-30T18:23:22.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.379+0000 7f99d999bb80 1 --2- 172.21.15.49:0/2209416534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a45f38ecf0 0x55a45f38b780 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.379+0000 7f99d999bb80 1 -- 172.21.15.49:0/2209416534 >> 172.21.15.49:0/2209416534 conn(0x55a45f1d04a0 msgr2=0x55a45f3ab3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:22.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.379+0000 7f99d999bb80 1 -- 172.21.15.49:0/2209416534 shutdown_connections 2023-11-30T18:23:22.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.379+0000 7f99d999bb80 1 -- 172.21.15.49:0/2209416534 wait complete. 2023-11-30T18:23:22.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.379+0000 7f99d999bb80 20 client.9138 trim_cache size 0 max 16384 2023-11-30T18:23:22.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.396+0000 7f99d999bb80 1 Processor -- start 2023-11-30T18:23:22.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.396+0000 7f99d999bb80 1 -- start start 2023-11-30T18:23:22.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.396+0000 7f99d999bb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a45f122e40 0x55a45f3afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:22.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.396+0000 7f99d999bb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a45f38ecf0 0x55a45f394ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:22.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.396+0000 7f99d999bb80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55a45f3af4e0 0x55a45f363530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:22.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.396+0000 7f99d999bb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a45f389e70 con 0x55a45f122e40 2023-11-30T18:23:22.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.396+0000 7f99d999bb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a45f3958c0 con 0x55a45f38ecf0 2023-11-30T18:23:22.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.396+0000 7f99d999bb80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a45f364560 con 0x55a45f3af4e0 2023-11-30T18:23:22.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.396+0000 7f99c5d9f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a45f122e40 0x55a45f3afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:22.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.396+0000 7f99c5d9f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a45f122e40 0x55a45f3afa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42156/0 (socket says 172.21.15.49:42156) 2023-11-30T18:23:22.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.396+0000 7f99c5d9f700 1 -- 172.21.15.49:0/982750955 learned_addr learned my addr 172.21.15.49:0/982750955 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:22.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.397+0000 7f99c65a0700 1 --2- 172.21.15.49:0/982750955 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55a45f3af4e0 0x55a45f363530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:22.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.397+0000 7f99c559e700 1 --2- 172.21.15.49:0/982750955 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a45f38ecf0 0x55a45f394ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:22.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.397+0000 7f99c5d9f700 1 -- 172.21.15.49:0/982750955 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55a45f3af4e0 msgr2=0x55a45f363530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:22.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.397+0000 7f99c5d9f700 1 --2- 172.21.15.49:0/982750955 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55a45f3af4e0 0x55a45f363530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.397+0000 7f99c5d9f700 1 -- 172.21.15.49:0/982750955 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a45f38ecf0 msgr2=0x55a45f394ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:22.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.397+0000 7f99c5d9f700 1 --2- 172.21.15.49:0/982750955 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a45f38ecf0 0x55a45f394ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.397+0000 7f99c5d9f700 1 -- 172.21.15.49:0/982750955 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a45f2ac710 con 0x55a45f122e40 2023-11-30T18:23:22.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.397+0000 7f99c559e700 1 --2- 172.21.15.49:0/982750955 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a45f38ecf0 0x55a45f394ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:23:22.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.397+0000 7f99c5d9f700 1 --2- 172.21.15.49:0/982750955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a45f122e40 0x55a45f3afa90 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7f99c0064480 tx=0x7f99b001d040).ready entity=mon.0 client_cookie=68dccd07ccbfce79 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:22.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.397+0000 7f99a77fe700 1 -- 172.21.15.49:0/982750955 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b0029040 con 0x55a45f122e40 2023-11-30T18:23:22.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.397+0000 7f99a77fe700 1 -- 172.21.15.49:0/982750955 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b001f070 con 0x55a45f122e40 2023-11-30T18:23:22.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.397+0000 7f99a77fe700 1 -- 172.21.15.49:0/982750955 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b002f820 con 0x55a45f122e40 2023-11-30T18:23:22.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.397+0000 7f99d999bb80 1 -- 172.21.15.49:0/982750955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a45f122e40 msgr2=0x55a45f3afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:22.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.397+0000 7f99d999bb80 1 --2- 172.21.15.49:0/982750955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a45f122e40 0x55a45f3afa90 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7f99c0064480 tx=0x7f99b001d040).stop 2023-11-30T18:23:22.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.397+0000 7f99d999bb80 1 -- 172.21.15.49:0/982750955 shutdown_connections 2023-11-30T18:23:22.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.397+0000 7f99d999bb80 1 --2- 172.21.15.49:0/982750955 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55a45f3af4e0 0x55a45f363530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.397+0000 7f99d999bb80 1 --2- 172.21.15.49:0/982750955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a45f122e40 0x55a45f3afa90 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.397+0000 7f99d999bb80 1 --2- 172.21.15.49:0/982750955 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a45f38ecf0 0x55a45f394ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.397+0000 7f99d999bb80 1 -- 172.21.15.49:0/982750955 >> 172.21.15.49:0/982750955 conn(0x55a45f1d04a0 msgr2=0x55a45f364a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:22.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.398+0000 7f99d999bb80 1 -- 172.21.15.49:0/982750955 shutdown_connections 2023-11-30T18:23:22.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.398+0000 7f99d999bb80 1 -- 172.21.15.49:0/982750955 wait complete. 2023-11-30T18:23:22.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.398+0000 7f99d999bb80 1 -- start start 2023-11-30T18:23:22.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.398+0000 7f99d999bb80 1 Processor -- start 2023-11-30T18:23:22.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.399+0000 7f99d999bb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a45f122e40 0x55a45f391e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:22.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.399+0000 7f99d999bb80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55a45f38ecf0 0x55a45f388630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:22.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.399+0000 7f99d999bb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a45f3af4e0 0x55a45f38c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:22.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.399+0000 7f99d999bb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a45f3910e0 con 0x55a45f3af4e0 2023-11-30T18:23:22.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.399+0000 7f99d999bb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a45f391540 con 0x55a45f122e40 2023-11-30T18:23:22.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.399+0000 7f99d999bb80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a45f3c9e40 con 0x55a45f38ecf0 2023-11-30T18:23:22.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.399+0000 7f99d999bb80 10 client.0 ll_register_callbacks cb 0x55a45f326640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-30T18:23:22.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.399+0000 7f99c65a0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a45f3af4e0 0x55a45f38c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:22.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.399+0000 7f99c65a0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a45f3af4e0 0x55a45f38c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42162/0 (socket says 172.21.15.49:42162) 2023-11-30T18:23:22.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.399+0000 7f99c65a0700 1 -- 172.21.15.49:0/3176216269 learned_addr learned my addr 172.21.15.49:0/3176216269 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:22.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.399+0000 7f99c5d9f700 1 --2- 172.21.15.49:0/3176216269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a45f122e40 0x55a45f391e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:22.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.399+0000 7f99c559e700 1 --2- 172.21.15.49:0/3176216269 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55a45f38ecf0 0x55a45f388630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:22.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.399+0000 7f99c65a0700 1 -- 172.21.15.49:0/3176216269 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55a45f38ecf0 msgr2=0x55a45f388630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:22.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.399+0000 7f99c65a0700 1 --2- 172.21.15.49:0/3176216269 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55a45f38ecf0 0x55a45f388630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.399+0000 7f99c65a0700 1 -- 172.21.15.49:0/3176216269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a45f122e40 msgr2=0x55a45f391e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:22.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.399+0000 7f99c65a0700 1 --2- 172.21.15.49:0/3176216269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a45f122e40 0x55a45f391e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.399+0000 7f99c65a0700 1 -- 172.21.15.49:0/3176216269 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c0155080 con 0x55a45f3af4e0 2023-11-30T18:23:22.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.400+0000 7f99c65a0700 1 --2- 172.21.15.49:0/3176216269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a45f3af4e0 0x55a45f38c630 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7f99b800c730 tx=0x7f99b8052040).ready entity=mon.0 client_cookie=7b6c14f07bf6e5dd server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:22.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.400+0000 7f999ffff700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-30T18:23:22.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.400+0000 7f999ffff700 1 -- 172.21.15.49:0/3176216269 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b8055040 con 0x55a45f3af4e0 2023-11-30T18:23:22.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.400+0000 7f999ffff700 1 -- 172.21.15.49:0/3176216269 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(184..184 src has 1..184) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f99b804ef00 con 0x55a45f3af4e0 2023-11-30T18:23:22.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.400+0000 7f99d999bb80 1 -- 172.21.15.49:0/3176216269 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f99b4007440 con 0x55a45f3af4e0 2023-11-30T18:23:22.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.400+0000 7f999ffff700 1 -- 172.21.15.49:0/3176216269 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99b804dc20 con 0x55a45f3af4e0 2023-11-30T18:23:22.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.400+0000 7f99d999bb80 10 client.9144 fetch_fsmap learned FSMap version 77 2023-11-30T18:23:22.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.400+0000 7f99d999bb80 1 -- 172.21.15.49:0/3176216269 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) v3 -- 0x55a45f123f80 con 0x55a45f3af4e0 2023-11-30T18:23:22.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.400+0000 7f999ffff700 1 -- 172.21.15.49:0/3176216269 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b4007440 con 0x55a45f3af4e0 2023-11-30T18:23:22.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.401+0000 7f999ffff700 1 -- 172.21.15.49:0/3176216269 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 77) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f99b804b800 con 0x55a45f3af4e0 2023-11-30T18:23:22.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.401+0000 7f99d999bb80 10 client.9144 fetch_fsmap finished waiting for FSMap version 77 2023-11-30T18:23:22.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.401+0000 7f99d999bb80 10 client.9144 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-30T18:23:22.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.401+0000 7f99d999bb80 20 client.9144 populate_metadata read hostname 'smithi049' 2023-11-30T18:23:22.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.401+0000 7f99d999bb80 1 --2- 172.21.15.49:0/3176216269 >> [v2:172.21.15.49:6832/3993546381,v1:172.21.15.49:6834/3993546381] conn(0x55a45f3ae750 0x55a45f3aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:22.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.401+0000 7f99d999bb80 4 client.9144 mds_command: new command op to 8937 tid=0[{"prefix": "status"}] 2023-11-30T18:23:22.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.401+0000 7f99d999bb80 1 -- 172.21.15.49:0/3176216269 --> [v2:172.21.15.49:6832/3993546381,v1:172.21.15.49:6834/3993546381] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a45f155ca0 con 0x55a45f3ae750 2023-11-30T18:23:22.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.401+0000 7f99c5d9f700 1 --2- 172.21.15.49:0/3176216269 >> [v2:172.21.15.49:6832/3993546381,v1:172.21.15.49:6834/3993546381] conn(0x55a45f3ae750 0x55a45f3aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:22.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.401+0000 7f999ffff700 10 client.9144 ms_handle_connect on v2:172.21.15.49:6832/3993546381 2023-11-30T18:23:22.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.401+0000 7f99c5d9f700 1 --2- 172.21.15.49:0/3176216269 >> [v2:172.21.15.49:6832/3993546381,v1:172.21.15.49:6834/3993546381] conn(0x55a45f3ae750 0x55a45f3aeb30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=6cae0d5bfb27a851 server_cookie=604c0ad9bf8a1a64 in_seq=0 out_seq=0 2023-11-30T18:23:22.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.401+0000 7f999ffff700 1 -- 172.21.15.49:0/3176216269 <== mds.0 v2:172.21.15.49:6832/3993546381 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55a45f155ca0 con 0x55a45f3ae750 2023-11-30T18:23:22.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.401+0000 7f999ffff700 10 client.9144 handle_command_reply: tid=0 2023-11-30T18:23:22.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.401+0000 7f99d999bb80 1 client.9144 shutdown 2023-11-30T18:23:22.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.401+0000 7f99d999bb80 1 -- 172.21.15.49:0/3176216269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a45f3af4e0 msgr2=0x55a45f38c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:22.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.401+0000 7f99d999bb80 1 --2- 172.21.15.49:0/3176216269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a45f3af4e0 0x55a45f38c630 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7f99b800c730 tx=0x7f99b8052040).stop 2023-11-30T18:23:22.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.401+0000 7f99d999bb80 1 -- 172.21.15.49:0/3176216269 shutdown_connections 2023-11-30T18:23:22.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.401+0000 7f99d999bb80 1 --2- 172.21.15.49:0/3176216269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a45f3af4e0 0x55a45f38c630 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.401+0000 7f99d999bb80 1 --2- 172.21.15.49:0/3176216269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a45f122e40 0x55a45f391e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.401+0000 7f99d999bb80 1 --2- 172.21.15.49:0/3176216269 >> [v2:172.21.15.49:6832/3993546381,v1:172.21.15.49:6834/3993546381] conn(0x55a45f3ae750 0x55a45f3aeb30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.401+0000 7f99d999bb80 1 --2- 172.21.15.49:0/3176216269 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55a45f38ecf0 0x55a45f388630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.401+0000 7f999ffff700 0 client.9144 ms_handle_reset on v2:172.21.15.49:6832/3993546381 2023-11-30T18:23:22.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.401+0000 7f99d999bb80 1 -- 172.21.15.49:0/3176216269 >> 172.21.15.49:0/3176216269 conn(0x55a45f1d04a0 msgr2=0x55a45f3649a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:22.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.401+0000 7f99d999bb80 1 -- 172.21.15.49:0/3176216269 shutdown_connections 2023-11-30T18:23:22.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.401+0000 7f99d999bb80 1 -- 172.21.15.49:0/3176216269 wait complete. 2023-11-30T18:23:22.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.402+0000 7f99d999bb80 20 client.9144 trim_cache size 0 max 16384 2023-11-30T18:23:22.409 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T18:23:22.410 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "ef213ed4-8f62-4ad5-b55f-7510fd0ee359", 2023-11-30T18:23:22.410 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2023-11-30T18:23:22.410 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 8937, 2023-11-30T18:23:22.410 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-11-30T18:23:22.410 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-11-30T18:23:22.410 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-11-30T18:23:22.410 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 10.305324084, 2023-11-30T18:23:22.410 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 77, 2023-11-30T18:23:22.410 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 184, 2023-11-30T18:23:22.410 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 184, 2023-11-30T18:23:22.410 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 15.250559214000001 2023-11-30T18:23:22.410 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T18:23:22.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.402+0000 7f99c6da1700 1 -- 172.21.15.49:0/1765656533 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f99ac05f270 msgr2=0x7f99ac061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:22.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.402+0000 7f99c6da1700 1 --2- 172.21.15.49:0/1765656533 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f99ac05f270 0x7f99ac061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f99b0009fd0 tx=0x7f99b0017000).stop 2023-11-30T18:23:22.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.402+0000 7f99c6da1700 1 -- 172.21.15.49:0/1765656533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c0158570 msgr2=0x7f99c00c04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:22.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.402+0000 7f99c6da1700 1 --2- 172.21.15.49:0/1765656533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c0158570 0x7f99c00c04d0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7f99b8009df0 tx=0x7f99b800b040).stop 2023-11-30T18:23:22.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.402+0000 7f99c6da1700 1 -- 172.21.15.49:0/1765656533 shutdown_connections 2023-11-30T18:23:22.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.402+0000 7f99c6da1700 1 --2- 172.21.15.49:0/1765656533 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f99ac05f270 0x7f99ac061730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.402+0000 7f99c6da1700 1 --2- 172.21.15.49:0/1765656533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c0158570 0x7f99c00c04d0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.402+0000 7f99c6da1700 1 --2- 172.21.15.49:0/1765656533 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99c014e530 0x7f99c013c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.402+0000 7f99c6da1700 1 --2- 172.21.15.49:0/1765656533 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99c0154950 0x7f99c00bffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.402+0000 7f99c6da1700 1 -- 172.21.15.49:0/1765656533 >> 172.21.15.49:0/1765656533 conn(0x7f99c0064990 msgr2=0x7f99c01565a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:22.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.402+0000 7f99c6da1700 1 -- 172.21.15.49:0/1765656533 shutdown_connections 2023-11-30T18:23:22.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.402+0000 7f99c6da1700 1 -- 172.21.15.49:0/1765656533 wait complete. 2023-11-30T18:23:22.416 DEBUG:teuthology.orchestra.run.smithi049:> ceph fs ls 2023-11-30T18:23:22.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.518+0000 7fe8a17f1700 1 Processor -- start 2023-11-30T18:23:22.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.518+0000 7fe8a17f1700 1 -- start start 2023-11-30T18:23:22.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.519+0000 7fe8a17f1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe89c0be270 0x7fe89c15e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:22.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.519+0000 7fe8a17f1700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe89c0bdde0 con 0x7fe89c062780 2023-11-30T18:23:22.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.519+0000 7fe8a17f1700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe89c0bd1d0 con 0x7fe89c154490 2023-11-30T18:23:22.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.519+0000 7fe8a17f1700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe89c0c3390 con 0x7fe89c0be270 2023-11-30T18:23:22.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.519+0000 7fe89bfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe89c062780 0x7fe89c062b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37238/0 (socket says 172.21.15.49:37238) 2023-11-30T18:23:22.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.519+0000 7fe89bfff700 1 -- 172.21.15.49:0/3392685166 learned_addr learned my addr 172.21.15.49:0/3392685166 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:23:22.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.519+0000 7fe8a0ff0700 1 --2- 172.21.15.49:0/3392685166 >> v2:172.21.15.49:3300/0 conn(0x7fe89c0be270 0x7fe89c15e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.519+0000 7fe89affd700 1 -- 172.21.15.49:0/3392685166 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4058651057 0 0) 0x7fe89c0bdde0 con 0x7fe89c062780 2023-11-30T18:23:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.519+0000 7fe89affd700 1 -- 172.21.15.49:0/3392685166 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8840033f0 con 0x7fe89c062780 2023-11-30T18:23:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.520+0000 7fe8a0ff0700 1 -- 172.21.15.49:0/3392685166 >> v1:172.21.15.115:6789/0 conn(0x7fe89c154490 legacy=0x7fe89c0c2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.520+0000 7fe8a0ff0700 1 -- 172.21.15.49:0/3392685166 >> v1:172.21.15.49:6789/0 conn(0x7fe89c062780 legacy=0x7fe89c062b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.520+0000 7fe8a0ff0700 1 -- 172.21.15.49:0/3392685166 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c0bd4b0 con 0x7fe89c0be270 2023-11-30T18:23:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.520+0000 7fe8a0ff0700 1 --2- 172.21.15.49:0/3392685166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe89c0be270 0x7fe89c15e8e0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7fe894009e60 tx=0x7fe894009780).ready entity=mon.0 client_cookie=2033ae28c10fb589 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.520+0000 7fe89affd700 1 -- 172.21.15.49:0/3392685166 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89400e070 con 0x7fe89c0be270 2023-11-30T18:23:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.520+0000 7fe89affd700 1 -- 172.21.15.49:0/3392685166 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89400bb60 con 0x7fe89c0be270 2023-11-30T18:23:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.520+0000 7fe89affd700 1 -- 172.21.15.49:0/3392685166 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe894012410 con 0x7fe89c0be270 2023-11-30T18:23:22.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.520+0000 7fe8a17f1700 1 -- 172.21.15.49:0/3392685166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe89c0be270 msgr2=0x7fe89c15e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:22.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.520+0000 7fe8a17f1700 1 --2- 172.21.15.49:0/3392685166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe89c0be270 0x7fe89c15e8e0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7fe894009e60 tx=0x7fe894009780).stop 2023-11-30T18:23:22.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.520+0000 7fe8a17f1700 1 -- 172.21.15.49:0/3392685166 shutdown_connections 2023-11-30T18:23:22.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.520+0000 7fe8a17f1700 1 --2- 172.21.15.49:0/3392685166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe89c0be270 0x7fe89c15e8e0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.520+0000 7fe8a17f1700 1 -- 172.21.15.49:0/3392685166 >> 172.21.15.49:0/3392685166 conn(0x7fe89c0c7d00 msgr2=0x7fe89c0c8110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:22.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.520+0000 7fe8a17f1700 1 -- 172.21.15.49:0/3392685166 shutdown_connections 2023-11-30T18:23:22.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.520+0000 7fe8a17f1700 1 -- 172.21.15.49:0/3392685166 wait complete. 2023-11-30T18:23:22.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.522+0000 7fe8a17f1700 1 Processor -- start 2023-11-30T18:23:22.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.522+0000 7fe8a17f1700 1 -- start start 2023-11-30T18:23:22.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.522+0000 7fe8a17f1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe89c062780 0x7fe89c152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:22.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.522+0000 7fe8a17f1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe89c0be270 0x7fe89c0ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:22.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.522+0000 7fe8a17f1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe89c154490 0x7fe89c151630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:22.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.522+0000 7fe8a17f1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c0c0c10 con 0x7fe89c062780 2023-11-30T18:23:22.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.522+0000 7fe8a17f1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c0abdc0 con 0x7fe89c0be270 2023-11-30T18:23:22.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.522+0000 7fe8a17f1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c0ac0a0 con 0x7fe89c154490 2023-11-30T18:23:22.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.523+0000 7fe89bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe89c062780 0x7fe89c152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:22.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.523+0000 7fe89bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe89c062780 0x7fe89c152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42188/0 (socket says 172.21.15.49:42188) 2023-11-30T18:23:22.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.523+0000 7fe89bfff700 1 -- 172.21.15.49:0/1969021773 learned_addr learned my addr 172.21.15.49:0/1969021773 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:22.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.523+0000 7fe89b7fe700 1 --2- 172.21.15.49:0/1969021773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe89c0be270 0x7fe89c0ab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:22.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.523+0000 7fe8a0ff0700 1 --2- 172.21.15.49:0/1969021773 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe89c154490 0x7fe89c151630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:22.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.523+0000 7fe89bfff700 1 -- 172.21.15.49:0/1969021773 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe89c154490 msgr2=0x7fe89c151630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:22.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.523+0000 7fe89bfff700 1 --2- 172.21.15.49:0/1969021773 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe89c154490 0x7fe89c151630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.523+0000 7fe89bfff700 1 -- 172.21.15.49:0/1969021773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe89c0be270 msgr2=0x7fe89c0ab4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:22.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.523+0000 7fe89bfff700 1 --2- 172.21.15.49:0/1969021773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe89c0be270 0x7fe89c0ab4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.523+0000 7fe89bfff700 1 -- 172.21.15.49:0/1969021773 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe894009a20 con 0x7fe89c062780 2023-11-30T18:23:22.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.523+0000 7fe89bfff700 1 --2- 172.21.15.49:0/1969021773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe89c062780 0x7fe89c152280 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7fe88c00c590 tx=0x7fe88c007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:22.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.523+0000 7fe883fff700 1 -- 172.21.15.49:0/1969021773 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c0072e0 con 0x7fe89c062780 2023-11-30T18:23:22.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.523+0000 7fe883fff700 1 -- 172.21.15.49:0/1969021773 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88c007440 con 0x7fe89c062780 2023-11-30T18:23:22.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.523+0000 7fe8a17f1700 1 -- 172.21.15.49:0/1969021773 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe89c0ac380 con 0x7fe89c062780 2023-11-30T18:23:22.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.523+0000 7fe883fff700 1 -- 172.21.15.49:0/1969021773 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c0057a0 con 0x7fe89c062780 2023-11-30T18:23:22.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.523+0000 7fe8a17f1700 1 -- 172.21.15.49:0/1969021773 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe89c0ab9d0 con 0x7fe89c062780 2023-11-30T18:23:22.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.524+0000 7fe8a17f1700 1 -- 172.21.15.49:0/1969021773 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe89c068850 con 0x7fe89c062780 2023-11-30T18:23:22.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.525+0000 7fe883fff700 1 -- 172.21.15.49:0/1969021773 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe88c005bd0 con 0x7fe89c062780 2023-11-30T18:23:22.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.525+0000 7fe883fff700 1 --2- 172.21.15.49:0/1969021773 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe88805f240 0x7fe888061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:22.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.525+0000 7fe883fff700 1 -- 172.21.15.49:0/1969021773 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fe88c079840 con 0x7fe89c062780 2023-11-30T18:23:22.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.525+0000 7fe89b7fe700 1 --2- 172.21.15.49:0/1969021773 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe88805f240 0x7fe888061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:22.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.526+0000 7fe89b7fe700 1 --2- 172.21.15.49:0/1969021773 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe88805f240 0x7fe888061700 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fe89c1530f0 tx=0x7fe890007d40).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:22.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.529+0000 7fe883fff700 1 -- 172.21.15.49:0/1969021773 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe88c04a950 con 0x7fe89c062780 2023-11-30T18:23:22.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.743+0000 7fe8a17f1700 1 -- 172.21.15.49:0/1969021773 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe89c046d80 con 0x7fe89c062780 2023-11-30T18:23:22.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.744+0000 7fe883fff700 1 -- 172.21.15.49:0/1969021773 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v77) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe88c018020 con 0x7fe89c062780 2023-11-30T18:23:22.746 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-30T18:23:22.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.746+0000 7fe8a17f1700 1 -- 172.21.15.49:0/1969021773 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe88805f240 msgr2=0x7fe888061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:22.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.746+0000 7fe8a17f1700 1 --2- 172.21.15.49:0/1969021773 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe88805f240 0x7fe888061700 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fe89c1530f0 tx=0x7fe890007d40).stop 2023-11-30T18:23:22.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.746+0000 7fe8a17f1700 1 -- 172.21.15.49:0/1969021773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe89c062780 msgr2=0x7fe89c152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:22.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.746+0000 7fe8a17f1700 1 --2- 172.21.15.49:0/1969021773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe89c062780 0x7fe89c152280 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7fe88c00c590 tx=0x7fe88c007c80).stop 2023-11-30T18:23:22.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.746+0000 7fe8a17f1700 1 -- 172.21.15.49:0/1969021773 shutdown_connections 2023-11-30T18:23:22.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.746+0000 7fe8a17f1700 1 --2- 172.21.15.49:0/1969021773 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe89c154490 0x7fe89c151630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.746+0000 7fe8a17f1700 1 --2- 172.21.15.49:0/1969021773 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe88805f240 0x7fe888061700 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.746+0000 7fe8a17f1700 1 --2- 172.21.15.49:0/1969021773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe89c062780 0x7fe89c152280 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.746+0000 7fe8a17f1700 1 --2- 172.21.15.49:0/1969021773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe89c0be270 0x7fe89c0ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:22.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.746+0000 7fe8a17f1700 1 -- 172.21.15.49:0/1969021773 >> 172.21.15.49:0/1969021773 conn(0x7fe89c0c7d00 msgr2=0x7fe89c062b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:22.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.746+0000 7fe8a17f1700 1 -- 172.21.15.49:0/1969021773 shutdown_connections 2023-11-30T18:23:22.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:22.746+0000 7fe8a17f1700 1 -- 172.21.15.49:0/1969021773 wait complete. 2023-11-30T18:23:22.758 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-30T18:23:22.758 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-30T18:23:22.758 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-11-30T18:23:22.759 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-30T18:23:22.759 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-30T18:23:22.759 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-30T18:23:22.759 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-30T18:23:22.759 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-30T18:23:22.759 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-30T18:23:22.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:23:22.759 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-11-30T18:23:22.775 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-30T18:23:22.776 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-30T18:23:22.776 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-11-30T18:23:22.776 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T18:23:22.776 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-11-30T18:23:22.776 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T18:23:22.776 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T18:23:22.776 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-11-30T18:23:22.776 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-11-30T18:23:22.776 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T18:23:22.776 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-11-30T18:23:22.776 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-11-30T18:23:22.776 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-30T18:23:22.776 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-11-30T18:23:22.777 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-11-30T18:23:22.777 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-30T18:23:22.777 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 37872sec preferred_lft 37872sec 2023-11-30T18:23:22.777 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2023-11-30T18:23:22.777 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T18:23:22.777 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T18:23:22.777 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-11-30T18:23:22.777 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-11-30T18:23:22.777 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-30T18:23:22.777 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 32:bf:40:53:4c:5d brd ff:ff:ff:ff:ff:ff 2023-11-30T18:23:22.777 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-30T18:23:22.777 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T18:23:22.777 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::8b6:11ff:fe93:7174/64 scope link 2023-11-30T18:23:22.777 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T18:23:22.777 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-30T18:23:22.778 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 3e:e9:3c:a8:7a:95 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-30T18:23:22.778 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::3ce9:3cff:fea8:7a95/64 scope link 2023-11-30T18:23:22.778 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T18:23:22.778 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-30T18:23:22.778 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 32:bf:40:53:4c:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-30T18:23:22.778 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::30bf:40ff:fe53:4c5d/64 scope link 2023-11-30T18:23:22.778 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T18:23:22.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:23:22.778 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-30T18:23:22.839 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-11-30T18:23:22.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:23:22.840 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-11-30T18:23:22.896 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-11-30T18:23:22.897 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-30T18:23:22.897 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-30T18:23:22.897 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-30T18:23:22.897 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-30T18:23:22.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:23:22.897 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-11-30T18:23:22.897 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-11-30T18:23:22.897 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-30T18:23:22.898 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-30T18:23:22.898 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-30T18:23:22.898 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-11-30T18:23:22.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:23:22.999 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-11-30T18:23:23.014 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-30T18:23:23.014 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-30T18:23:23.015 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-30T18:23:23.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:23:23.015 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-11-30T18:23:23.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:23:23.080 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-11-30T18:23:23.134 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-30T18:23:23.135 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T18:23:23.214 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T18:23:23.214 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-30T18:23:23.239 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T18:23:23.239 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-30T18:23:23.241 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-30T18:23:23.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:23:23.241 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-30T18:23:23.307 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-30T18:23:23.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.465+0000 7f24b5559700 1 Processor -- start 2023-11-30T18:23:23.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.465+0000 7f24b5559700 1 -- start start 2023-11-30T18:23:23.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.466+0000 7f24b5559700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24b0158a30 0x7f24b00c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:23.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.466+0000 7f24b5559700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b00c72d0 con 0x7f24b0098d10 2023-11-30T18:23:23.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.466+0000 7f24b5559700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b0064570 con 0x7f24b00c6190 2023-11-30T18:23:23.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.466+0000 7f24b5559700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b0154bc0 con 0x7f24b0158a30 2023-11-30T18:23:23.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.466+0000 7f24aeffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f24b0098d10 0x7f24b0063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37242/0 (socket says 172.21.15.49:37242) 2023-11-30T18:23:23.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.466+0000 7f24aeffd700 1 -- 172.21.15.49:0/447139621 learned_addr learned my addr 172.21.15.49:0/447139621 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:23:23.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.466+0000 7f24af7fe700 1 --2- 172.21.15.49:0/447139621 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24b0158a30 0x7f24b00c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:23.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.466+0000 7f24adffb700 1 -- 172.21.15.49:0/447139621 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1983651290 0 0) 0x7f24b00c72d0 con 0x7f24b0098d10 2023-11-30T18:23:23.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.467+0000 7f24adffb700 1 -- 172.21.15.49:0/447139621 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f249c0033f0 con 0x7f24b0098d10 2023-11-30T18:23:23.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.467+0000 7f24adffb700 1 -- 172.21.15.49:0/447139621 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1557313558 0 0) 0x7f24b0064570 con 0x7f24b00c6190 2023-11-30T18:23:23.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.467+0000 7f24adffb700 1 -- 172.21.15.49:0/447139621 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24b00c72d0 con 0x7f24b00c6190 2023-11-30T18:23:23.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.467+0000 7f24af7fe700 1 -- 172.21.15.49:0/447139621 >> v1:172.21.15.115:6789/0 conn(0x7f24b00c6190 legacy=0x7f24b0158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:23.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.467+0000 7f24af7fe700 1 -- 172.21.15.49:0/447139621 >> v1:172.21.15.49:6789/0 conn(0x7f24b0098d10 legacy=0x7f24b0063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:23.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.467+0000 7f24af7fe700 1 -- 172.21.15.49:0/447139621 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b00c66c0 con 0x7f24b0158a30 2023-11-30T18:23:23.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.467+0000 7f24af7fe700 1 --2- 172.21.15.49:0/447139621 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24b0158a30 0x7f24b00c7760 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f24a0009e90 tx=0x7f24a0009780).ready entity=mon.2 client_cookie=cc638664028d670c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:23.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.467+0000 7f24adffb700 1 -- 172.21.15.49:0/447139621 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a000e070 con 0x7f24b0158a30 2023-11-30T18:23:23.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.467+0000 7f24adffb700 1 -- 172.21.15.49:0/447139621 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a000bab0 con 0x7f24b0158a30 2023-11-30T18:23:23.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.467+0000 7f24adffb700 1 -- 172.21.15.49:0/447139621 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a000be30 con 0x7f24b0158a30 2023-11-30T18:23:23.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.467+0000 7f24b5559700 1 -- 172.21.15.49:0/447139621 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24b0158a30 msgr2=0x7f24b00c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:23.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.467+0000 7f24b5559700 1 --2- 172.21.15.49:0/447139621 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24b0158a30 0x7f24b00c7760 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f24a0009e90 tx=0x7f24a0009780).stop 2023-11-30T18:23:23.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.468+0000 7f24b5559700 1 -- 172.21.15.49:0/447139621 shutdown_connections 2023-11-30T18:23:23.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.468+0000 7f24b5559700 1 --2- 172.21.15.49:0/447139621 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24b0158a30 0x7f24b00c7760 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:23.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.468+0000 7f24b5559700 1 -- 172.21.15.49:0/447139621 >> 172.21.15.49:0/447139621 conn(0x7f24b00cb310 msgr2=0x7f24b00cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:23.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.468+0000 7f24b5559700 1 -- 172.21.15.49:0/447139621 shutdown_connections 2023-11-30T18:23:23.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.468+0000 7f24b5559700 1 -- 172.21.15.49:0/447139621 wait complete. 2023-11-30T18:23:23.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.469+0000 7f24b5559700 1 Processor -- start 2023-11-30T18:23:23.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.469+0000 7f24b5559700 1 -- start start 2023-11-30T18:23:23.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.469+0000 7f24b5559700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b0098d10 0x7f24b0150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:23.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.470+0000 7f24b5559700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24b00c6190 0x7f24b00c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.470+0000 7f24b5559700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24b0158a30 0x7f24b00c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.470+0000 7f24b5559700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b00c5410 con 0x7f24b0098d10 2023-11-30T18:23:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.470+0000 7f24b5559700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b00c37d0 con 0x7f24b0158a30 2023-11-30T18:23:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.470+0000 7f24b5559700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b0150e60 con 0x7f24b00c6190 2023-11-30T18:23:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.470+0000 7f24aeffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b0098d10 0x7f24b0150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.470+0000 7f24aeffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b0098d10 0x7f24b0150970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42198/0 (socket says 172.21.15.49:42198) 2023-11-30T18:23:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.470+0000 7f24aeffd700 1 -- 172.21.15.49:0/4195878503 learned_addr learned my addr 172.21.15.49:0/4195878503 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.470+0000 7f24af7fe700 1 --2- 172.21.15.49:0/4195878503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24b0158a30 0x7f24b00c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.470+0000 7f24ae7fc700 1 --2- 172.21.15.49:0/4195878503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24b00c6190 0x7f24b00c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.470+0000 7f24aeffd700 1 -- 172.21.15.49:0/4195878503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24b00c6190 msgr2=0x7f24b00c4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.470+0000 7f24aeffd700 1 --2- 172.21.15.49:0/4195878503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24b00c6190 0x7f24b00c4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.470+0000 7f24aeffd700 1 -- 172.21.15.49:0/4195878503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24b0158a30 msgr2=0x7f24b00c4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.470+0000 7f24aeffd700 1 --2- 172.21.15.49:0/4195878503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24b0158a30 0x7f24b00c4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.470+0000 7f24aeffd700 1 -- 172.21.15.49:0/4195878503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a0009a20 con 0x7f24b0098d10 2023-11-30T18:23:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.470+0000 7f24ae7fc700 1 --2- 172.21.15.49:0/4195878503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24b00c6190 0x7f24b00c4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:23:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.470+0000 7f24af7fe700 1 --2- 172.21.15.49:0/4195878503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24b0158a30 0x7f24b00c4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:23:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.470+0000 7f24aeffd700 1 --2- 172.21.15.49:0/4195878503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b0098d10 0x7f24b0150970 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7f24a800c560 tx=0x7f24a8007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.470+0000 7f24a6ffd700 1 -- 172.21.15.49:0/4195878503 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a80072e0 con 0x7f24b0098d10 2023-11-30T18:23:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.470+0000 7f24a6ffd700 1 -- 172.21.15.49:0/4195878503 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a8007440 con 0x7f24b0098d10 2023-11-30T18:23:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.470+0000 7f24b5559700 1 -- 172.21.15.49:0/4195878503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b00c2bc0 con 0x7f24b0098d10 2023-11-30T18:23:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.470+0000 7f24a6ffd700 1 -- 172.21.15.49:0/4195878503 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a80057a0 con 0x7f24b0098d10 2023-11-30T18:23:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.470+0000 7f24b5559700 1 -- 172.21.15.49:0/4195878503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b00c3180 con 0x7f24b0098d10 2023-11-30T18:23:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.471+0000 7f24b5559700 1 -- 172.21.15.49:0/4195878503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b006c860 con 0x7f24b0098d10 2023-11-30T18:23:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.472+0000 7f24a6ffd700 1 -- 172.21.15.49:0/4195878503 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f24a8005bd0 con 0x7f24b0098d10 2023-11-30T18:23:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.472+0000 7f24a6ffd700 1 --2- 172.21.15.49:0/4195878503 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f249005f270 0x7f2490061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:23.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.472+0000 7f24a6ffd700 1 -- 172.21.15.49:0/4195878503 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f24a8079d40 con 0x7f24b0098d10 2023-11-30T18:23:23.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.472+0000 7f24ae7fc700 1 --2- 172.21.15.49:0/4195878503 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f249005f270 0x7f2490061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:23.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.473+0000 7f24ae7fc700 1 --2- 172.21.15.49:0/4195878503 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f249005f270 0x7f2490061730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f24b00c4200 tx=0x7f2498009040).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:23.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.476+0000 7f24a6ffd700 1 -- 172.21.15.49:0/4195878503 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f24a807d030 con 0x7f24b0098d10 2023-11-30T18:23:23.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.674+0000 7f24b5559700 1 -- 172.21.15.49:0/4195878503 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f24b00c3ed0 con 0x7f249005f270 2023-11-30T18:23:23.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.677+0000 7f24a6ffd700 1 -- 172.21.15.49:0/4195878503 <== mgr.7394 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f24b00c3ed0 con 0x7f249005f270 2023-11-30T18:23:23.678 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-11-30T18:23:23.678 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:23:23.678 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cephfs" 2023-11-30T18:23:23.678 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:23:23.678 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-11-30T18:23:23.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.678+0000 7f24b5559700 1 -- 172.21.15.49:0/4195878503 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f249005f270 msgr2=0x7f2490061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:23.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.678+0000 7f24b5559700 1 --2- 172.21.15.49:0/4195878503 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f249005f270 0x7f2490061730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f24b00c4200 tx=0x7f2498009040).stop 2023-11-30T18:23:23.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.678+0000 7f24b5559700 1 -- 172.21.15.49:0/4195878503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b0098d10 msgr2=0x7f24b0150970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:23.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.678+0000 7f24b5559700 1 --2- 172.21.15.49:0/4195878503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b0098d10 0x7f24b0150970 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7f24a800c560 tx=0x7f24a8007d20).stop 2023-11-30T18:23:23.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.678+0000 7f24b5559700 1 -- 172.21.15.49:0/4195878503 shutdown_connections 2023-11-30T18:23:23.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.678+0000 7f24b5559700 1 --2- 172.21.15.49:0/4195878503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24b0158a30 0x7f24b00c4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:23.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.678+0000 7f24b5559700 1 --2- 172.21.15.49:0/4195878503 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f249005f270 0x7f2490061730 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:23.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.678+0000 7f24b5559700 1 --2- 172.21.15.49:0/4195878503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b0098d10 0x7f24b0150970 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:23.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.678+0000 7f24b5559700 1 --2- 172.21.15.49:0/4195878503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24b00c6190 0x7f24b00c4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:23.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.678+0000 7f24b5559700 1 -- 172.21.15.49:0/4195878503 >> 172.21.15.49:0/4195878503 conn(0x7f24b00cb310 msgr2=0x7f24b00ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:23.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.678+0000 7f24b5559700 1 -- 172.21.15.49:0/4195878503 shutdown_connections 2023-11-30T18:23:23.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.678+0000 7f24b5559700 1 -- 172.21.15.49:0/4195878503 wait complete. 2023-11-30T18:23:23.693 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-11-30T18:23:23.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.811+0000 7f726223d700 1 Processor -- start 2023-11-30T18:23:23.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.811+0000 7f726223d700 1 -- start start 2023-11-30T18:23:23.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.812+0000 7f726223d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f725c1546b0 0x7f725c0c1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:23.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.812+0000 7f726223d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f725c098b30 0x7f725c063b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:23.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.812+0000 7f726223d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f725c064000 0x7f725c158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:23.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.812+0000 7f726223d700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f725c0644b0 con 0x7f725c098b30 2023-11-30T18:23:23.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.812+0000 7f726223d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f725c0c1fd0 con 0x7f725c064000 2023-11-30T18:23:23.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.812+0000 7f726223d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725c0c1a10 con 0x7f725c1546b0 2023-11-30T18:23:23.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.812+0000 7f725affd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f725c098b30 0x7f725c063b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:23.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.812+0000 7f725affd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f725c098b30 0x7f725c063b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42202/0 (socket says 172.21.15.49:42202) 2023-11-30T18:23:23.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.812+0000 7f725affd700 1 -- 172.21.15.49:0/896022064 learned_addr learned my addr 172.21.15.49:0/896022064 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:23.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.812+0000 7f725b7fe700 1 --2- 172.21.15.49:0/896022064 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f725c1546b0 0x7f725c0c1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:23.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.812+0000 7f725bfff700 1 --2- 172.21.15.49:0/896022064 >> v2:172.21.15.115:3300/0 conn(0x7f725c064000 0x7f725c158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:23.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.813+0000 7f725affd700 1 -- 172.21.15.49:0/896022064 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f725c1546b0 msgr2=0x7f725c0c1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:23.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.813+0000 7f725affd700 1 --2- 172.21.15.49:0/896022064 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f725c1546b0 0x7f725c0c1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:23.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.813+0000 7f725affd700 1 -- 172.21.15.49:0/896022064 >> v2:172.21.15.115:3300/0 conn(0x7f725c064000 msgr2=0x7f725c158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:23:23.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.813+0000 7f725affd700 1 --2- 172.21.15.49:0/896022064 >> v2:172.21.15.115:3300/0 conn(0x7f725c064000 0x7f725c158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:23.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.813+0000 7f725affd700 1 -- 172.21.15.49:0/896022064 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725c0c1cf0 con 0x7f725c098b30 2023-11-30T18:23:23.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.813+0000 7f725affd700 1 --2- 172.21.15.49:0/896022064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f725c098b30 0x7f725c063b10 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 rx=0x7f725c05e5c0 tx=0x7f72500090f0).ready entity=mon.0 client_cookie=ae993f3be3aabba1 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:23.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.813+0000 7f725a7fc700 1 -- 172.21.15.49:0/896022064 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725000b600 con 0x7f725c098b30 2023-11-30T18:23:23.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.813+0000 7f725a7fc700 1 -- 172.21.15.49:0/896022064 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725000b760 con 0x7f725c098b30 2023-11-30T18:23:23.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.813+0000 7f725a7fc700 1 -- 172.21.15.49:0/896022064 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725000bb00 con 0x7f725c098b30 2023-11-30T18:23:23.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.813+0000 7f726223d700 1 -- 172.21.15.49:0/896022064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f725c098b30 msgr2=0x7f725c063b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:23.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.813+0000 7f726223d700 1 --2- 172.21.15.49:0/896022064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f725c098b30 0x7f725c063b10 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 rx=0x7f725c05e5c0 tx=0x7f72500090f0).stop 2023-11-30T18:23:23.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.814+0000 7f726223d700 1 -- 172.21.15.49:0/896022064 shutdown_connections 2023-11-30T18:23:23.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.814+0000 7f726223d700 1 --2- 172.21.15.49:0/896022064 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f725c1546b0 0x7f725c0c1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:23.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.814+0000 7f726223d700 1 --2- 172.21.15.49:0/896022064 >> v2:172.21.15.115:3300/0 conn(0x7f725c064000 0x7f725c158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:23.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.814+0000 7f726223d700 1 --2- 172.21.15.49:0/896022064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f725c098b30 0x7f725c063b10 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:23.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.814+0000 7f726223d700 1 -- 172.21.15.49:0/896022064 >> 172.21.15.49:0/896022064 conn(0x7f725c0cb260 msgr2=0x7f725c0cb670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:23.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.814+0000 7f726223d700 1 -- 172.21.15.49:0/896022064 shutdown_connections 2023-11-30T18:23:23.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.814+0000 7f726223d700 1 -- 172.21.15.49:0/896022064 wait complete. 2023-11-30T18:23:23.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.815+0000 7f726223d700 1 Processor -- start 2023-11-30T18:23:23.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.815+0000 7f726223d700 1 -- start start 2023-11-30T18:23:23.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.816+0000 7f726223d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f725c064000 0x7f725c098040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:23.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.816+0000 7f726223d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f725c098b30 0x7f725c0c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:23.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.816+0000 7f726223d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f725c1546b0 0x7f725c0c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:23.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.816+0000 7f726223d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725c0c70d0 con 0x7f725c064000 2023-11-30T18:23:23.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.816+0000 7f726223d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725c165820 con 0x7f725c098b30 2023-11-30T18:23:23.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.816+0000 7f726223d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725c098530 con 0x7f725c1546b0 2023-11-30T18:23:23.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.816+0000 7f725b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f725c064000 0x7f725c098040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:23.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.816+0000 7f725b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f725c064000 0x7f725c098040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42210/0 (socket says 172.21.15.49:42210) 2023-11-30T18:23:23.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.816+0000 7f725b7fe700 1 -- 172.21.15.49:0/3402799669 learned_addr learned my addr 172.21.15.49:0/3402799669 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:23.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.816+0000 7f725affd700 1 --2- 172.21.15.49:0/3402799669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f725c098b30 0x7f725c0c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:23.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.816+0000 7f725bfff700 1 --2- 172.21.15.49:0/3402799669 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f725c1546b0 0x7f725c0c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:23.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.816+0000 7f725b7fe700 1 -- 172.21.15.49:0/3402799669 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f725c1546b0 msgr2=0x7f725c0c6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:23.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.816+0000 7f725b7fe700 1 --2- 172.21.15.49:0/3402799669 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f725c1546b0 0x7f725c0c6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:23.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.816+0000 7f725b7fe700 1 -- 172.21.15.49:0/3402799669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f725c098b30 msgr2=0x7f725c0c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:23.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.816+0000 7f725b7fe700 1 --2- 172.21.15.49:0/3402799669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f725c098b30 0x7f725c0c66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:23.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.816+0000 7f725b7fe700 1 -- 172.21.15.49:0/3402799669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7250009370 con 0x7f725c064000 2023-11-30T18:23:23.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.816+0000 7f725b7fe700 1 --2- 172.21.15.49:0/3402799669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f725c064000 0x7f725c098040 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7f724c00d8c0 tx=0x7f724c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:23.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.816+0000 7f72437fe700 1 -- 172.21.15.49:0/3402799669 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c011590 con 0x7f725c064000 2023-11-30T18:23:23.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.816+0000 7f72437fe700 1 -- 172.21.15.49:0/3402799669 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724c0116f0 con 0x7f725c064000 2023-11-30T18:23:23.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.816+0000 7f726223d700 1 -- 172.21.15.49:0/3402799669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f725c164c10 con 0x7f725c064000 2023-11-30T18:23:23.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.816+0000 7f72437fe700 1 -- 172.21.15.49:0/3402799669 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c011a70 con 0x7f725c064000 2023-11-30T18:23:23.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.817+0000 7f726223d700 1 -- 172.21.15.49:0/3402799669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f725c1651d0 con 0x7f725c064000 2023-11-30T18:23:23.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.818+0000 7f726223d700 1 -- 172.21.15.49:0/3402799669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f725c06c830 con 0x7f725c064000 2023-11-30T18:23:23.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.818+0000 7f72437fe700 1 -- 172.21.15.49:0/3402799669 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 75) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f724c012420 con 0x7f725c064000 2023-11-30T18:23:23.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.818+0000 7f72437fe700 1 --2- 172.21.15.49:0/3402799669 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f724805f270 0x7f7248061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:23.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.818+0000 7f72437fe700 1 -- 172.21.15.49:0/3402799669 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f724c079ca0 con 0x7f725c064000 2023-11-30T18:23:23.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.818+0000 7f725affd700 1 --2- 172.21.15.49:0/3402799669 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f724805f270 0x7f7248061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:23.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.819+0000 7f725affd700 1 --2- 172.21.15.49:0/3402799669 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f724805f270 0x7f7248061730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f725c05e5c0 tx=0x7f7250017000).ready entity=mgr.7394 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:23.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:23.822+0000 7f72437fe700 1 -- 172.21.15.49:0/3402799669 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f724c04ad50 con 0x7f725c064000 2023-11-30T18:23:24.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.043+0000 7f726223d700 1 -- 172.21.15.49:0/3402799669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f725c063010 con 0x7f725c064000 2023-11-30T18:23:24.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.719+0000 7f72437fe700 1 -- 172.21.15.49:0/3402799669 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 76) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f724c0778b0 con 0x7f725c064000 2023-11-30T18:23:24.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.721+0000 7f72437fe700 1 -- 172.21.15.49:0/3402799669 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v76) v1 ==== 92+0+0 (secure 0 0 0) 0x7f724c0721b0 con 0x7f725c064000 2023-11-30T18:23:24.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.724+0000 7f726223d700 1 -- 172.21.15.49:0/3402799669 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f724805f270 msgr2=0x7f7248061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:24.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.724+0000 7f726223d700 1 --2- 172.21.15.49:0/3402799669 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f724805f270 0x7f7248061730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f725c05e5c0 tx=0x7f7250017000).stop 2023-11-30T18:23:24.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.724+0000 7f726223d700 1 -- 172.21.15.49:0/3402799669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f725c064000 msgr2=0x7f725c098040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:24.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.724+0000 7f726223d700 1 --2- 172.21.15.49:0/3402799669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f725c064000 0x7f725c098040 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7f724c00d8c0 tx=0x7f724c008040).stop 2023-11-30T18:23:24.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.724+0000 7f726223d700 1 -- 172.21.15.49:0/3402799669 shutdown_connections 2023-11-30T18:23:24.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.724+0000 7f726223d700 1 --2- 172.21.15.49:0/3402799669 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f725c1546b0 0x7f725c0c6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:24.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.724+0000 7f726223d700 1 --2- 172.21.15.49:0/3402799669 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f724805f270 0x7f7248061730 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:24.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.724+0000 7f726223d700 1 --2- 172.21.15.49:0/3402799669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f725c064000 0x7f725c098040 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:24.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.724+0000 7f726223d700 1 --2- 172.21.15.49:0/3402799669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f725c098b30 0x7f725c0c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:24.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.724+0000 7f726223d700 1 -- 172.21.15.49:0/3402799669 >> 172.21.15.49:0/3402799669 conn(0x7f725c0cb260 msgr2=0x7f725c0af510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:24.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.724+0000 7f726223d700 1 -- 172.21.15.49:0/3402799669 shutdown_connections 2023-11-30T18:23:24.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.724+0000 7f726223d700 1 -- 172.21.15.49:0/3402799669 wait complete. 2023-11-30T18:23:24.741 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-11-30T18:23:24.866 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:24.864+0000 7f3716da7680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T18:23:24.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.866+0000 7f9329c67700 1 Processor -- start 2023-11-30T18:23:24.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.866+0000 7f9329c67700 1 -- start start 2023-11-30T18:23:24.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.867+0000 7f9329c67700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9324098d10 0x7f93240c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:24.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.867+0000 7f9329c67700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93240c72d0 con 0x7f93240c6190 2023-11-30T18:23:24.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.867+0000 7f9329c67700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9324064570 con 0x7f9324158320 2023-11-30T18:23:24.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.867+0000 7f9329c67700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9324154bc0 con 0x7f9324098d10 2023-11-30T18:23:24.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.867+0000 7f9322ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f93240c6190 0x7f9324063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37252/0 (socket says 172.21.15.49:37252) 2023-11-30T18:23:24.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.867+0000 7f9322ffd700 1 -- 172.21.15.49:0/3274514678 learned_addr learned my addr 172.21.15.49:0/3274514678 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:23:24.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.868+0000 7f93237fe700 1 --2- 172.21.15.49:0/3274514678 >> v2:172.21.15.115:3300/0 conn(0x7f9324098d10 0x7f93240c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:24.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.868+0000 7f93227fc700 1 -- 172.21.15.49:0/3274514678 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1563183543 0 0) 0x7f93240c72d0 con 0x7f93240c6190 2023-11-30T18:23:24.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.868+0000 7f93227fc700 1 -- 172.21.15.49:0/3274514678 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f930c0033f0 con 0x7f93240c6190 2023-11-30T18:23:24.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.868+0000 7f93227fc700 1 -- 172.21.15.49:0/3274514678 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2698441323 0 0) 0x7f9324064570 con 0x7f9324158320 2023-11-30T18:23:24.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.868+0000 7f93227fc700 1 -- 172.21.15.49:0/3274514678 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93240c72d0 con 0x7f9324158320 2023-11-30T18:23:24.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.868+0000 7f93237fe700 1 -- 172.21.15.49:0/3274514678 >> v1:172.21.15.115:6789/0 conn(0x7f9324158320 legacy=0x7f93240a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:24.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.868+0000 7f93237fe700 1 -- 172.21.15.49:0/3274514678 >> v1:172.21.15.49:6789/0 conn(0x7f93240c6190 legacy=0x7f9324063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:24.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.868+0000 7f93237fe700 1 -- 172.21.15.49:0/3274514678 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93240c66c0 con 0x7f9324098d10 2023-11-30T18:23:24.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.868+0000 7f93237fe700 1 --2- 172.21.15.49:0/3274514678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9324098d10 0x7f93240c7760 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f9314009760 tx=0x7f9314009060).ready entity=mon.1 client_cookie=c30614577c2e0054 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:24.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.868+0000 7f93227fc700 1 -- 172.21.15.49:0/3274514678 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931400d4a0 con 0x7f9324098d10 2023-11-30T18:23:24.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.868+0000 7f93227fc700 1 -- 172.21.15.49:0/3274514678 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931400d600 con 0x7f9324098d10 2023-11-30T18:23:24.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.868+0000 7f93227fc700 1 -- 172.21.15.49:0/3274514678 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931400d980 con 0x7f9324098d10 2023-11-30T18:23:24.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.869+0000 7f9329c67700 1 -- 172.21.15.49:0/3274514678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9324098d10 msgr2=0x7f93240c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:24.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.869+0000 7f9329c67700 1 --2- 172.21.15.49:0/3274514678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9324098d10 0x7f93240c7760 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f9314009760 tx=0x7f9314009060).stop 2023-11-30T18:23:24.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.869+0000 7f9329c67700 1 -- 172.21.15.49:0/3274514678 shutdown_connections 2023-11-30T18:23:24.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.869+0000 7f9329c67700 1 --2- 172.21.15.49:0/3274514678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9324098d10 0x7f93240c7760 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:24.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.869+0000 7f9329c67700 1 -- 172.21.15.49:0/3274514678 >> 172.21.15.49:0/3274514678 conn(0x7f93240cb310 msgr2=0x7f93240cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:24.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.869+0000 7f9329c67700 1 -- 172.21.15.49:0/3274514678 shutdown_connections 2023-11-30T18:23:24.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.869+0000 7f9329c67700 1 -- 172.21.15.49:0/3274514678 wait complete. 2023-11-30T18:23:24.873 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:23:24.870+0000 7f34647d1680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T18:23:24.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.870+0000 7f9329c67700 1 Processor -- start 2023-11-30T18:23:24.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.870+0000 7f9329c67700 1 -- start start 2023-11-30T18:23:24.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.871+0000 7f9329c67700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9324098d10 0x7f9324165070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:24.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.871+0000 7f9329c67700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93240c6190 0x7f9324168dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:24.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.871+0000 7f9329c67700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9324158320 0x7f9324156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:24.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.871+0000 7f9329c67700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9324168660 con 0x7f93240c6190 2023-11-30T18:23:24.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.871+0000 7f9329c67700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93241658c0 con 0x7f9324158320 2023-11-30T18:23:24.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.871+0000 7f9329c67700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9324165ba0 con 0x7f9324098d10 2023-11-30T18:23:24.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.871+0000 7f9322ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93240c6190 0x7f9324168dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:24.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.871+0000 7f9322ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93240c6190 0x7f9324168dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42246/0 (socket says 172.21.15.49:42246) 2023-11-30T18:23:24.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.871+0000 7f9322ffd700 1 -- 172.21.15.49:0/2079785631 learned_addr learned my addr 172.21.15.49:0/2079785631 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:24.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.871+0000 7f93237fe700 1 --2- 172.21.15.49:0/2079785631 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9324098d10 0x7f9324165070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:24.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.871+0000 7f9323fff700 1 --2- 172.21.15.49:0/2079785631 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9324158320 0x7f9324156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:24.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.871+0000 7f93237fe700 1 -- 172.21.15.49:0/2079785631 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9324158320 msgr2=0x7f9324156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:24.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.871+0000 7f93237fe700 1 --2- 172.21.15.49:0/2079785631 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9324158320 0x7f9324156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:24.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.871+0000 7f93237fe700 1 -- 172.21.15.49:0/2079785631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93240c6190 msgr2=0x7f9324168dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:24.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.871+0000 7f93237fe700 1 --2- 172.21.15.49:0/2079785631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93240c6190 0x7f9324168dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:24.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.871+0000 7f93237fe700 1 -- 172.21.15.49:0/2079785631 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93140092a0 con 0x7f9324098d10 2023-11-30T18:23:24.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.872+0000 7f93237fe700 1 --2- 172.21.15.49:0/2079785631 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9324098d10 0x7f9324165070 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f9314013000 tx=0x7f9314016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:24.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.872+0000 7f930b7fe700 1 -- 172.21.15.49:0/2079785631 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9314021070 con 0x7f9324098d10 2023-11-30T18:23:24.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.872+0000 7f930b7fe700 1 -- 172.21.15.49:0/2079785631 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931400dcf0 con 0x7f9324098d10 2023-11-30T18:23:24.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.872+0000 7f9329c67700 1 -- 172.21.15.49:0/2079785631 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9324165e80 con 0x7f9324098d10 2023-11-30T18:23:24.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.872+0000 7f930b7fe700 1 -- 172.21.15.49:0/2079785631 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931400d980 con 0x7f9324098d10 2023-11-30T18:23:24.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.872+0000 7f9329c67700 1 -- 172.21.15.49:0/2079785631 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9324165560 con 0x7f9324098d10 2023-11-30T18:23:24.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.873+0000 7f9329c67700 1 -- 172.21.15.49:0/2079785631 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9324168af0 con 0x7f9324098d10 2023-11-30T18:23:24.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.873+0000 7f930b7fe700 1 -- 172.21.15.49:0/2079785631 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 76) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f931401d640 con 0x7f9324098d10 2023-11-30T18:23:24.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.873+0000 7f930b7fe700 1 --2- 172.21.15.49:0/2079785631 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f931005f2c0 0x7f9310061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:24.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.874+0000 7f9322ffd700 1 -- 172.21.15.49:0/2079785631 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f931005f2c0 msgr2=0x7f9310061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:23:24.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.874+0000 7f930b7fe700 1 -- 172.21.15.49:0/2079785631 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f931407b760 con 0x7f9324098d10 2023-11-30T18:23:24.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.874+0000 7f9322ffd700 1 --2- 172.21.15.49:0/2079785631 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f931005f2c0 0x7f9310061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:23:24.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:24.878+0000 7f930b7fe700 1 -- 172.21.15.49:0/2079785631 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f931404c870 con 0x7f9324098d10 2023-11-30T18:23:24.930 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:24.929+0000 7f3716da7680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T18:23:24.938 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:23:24.937+0000 7f34647d1680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T18:23:25.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.056+0000 7f9329c67700 1 -- 172.21.15.49:0/2079785631 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f932406c860 con 0x7f9324098d10 2023-11-30T18:23:25.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.061+0000 7f930b7fe700 1 -- 172.21.15.49:0/2079785631 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v35)=0 v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7f931400de60 con 0x7f9324098d10 2023-11-30T18:23:25.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.063+0000 7f9329c67700 1 -- 172.21.15.49:0/2079785631 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f931005f2c0 msgr2=0x7f9310061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:23:25.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.063+0000 7f9329c67700 1 --2- 172.21.15.49:0/2079785631 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f931005f2c0 0x7f9310061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:23:25.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.063+0000 7f9329c67700 1 -- 172.21.15.49:0/2079785631 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9324098d10 msgr2=0x7f9324165070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:25.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.063+0000 7f9329c67700 1 --2- 172.21.15.49:0/2079785631 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9324098d10 0x7f9324165070 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f9314013000 tx=0x7f9314016000).stop 2023-11-30T18:23:25.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.063+0000 7f9329c67700 1 -- 172.21.15.49:0/2079785631 shutdown_connections 2023-11-30T18:23:25.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.063+0000 7f9329c67700 1 --2- 172.21.15.49:0/2079785631 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9324158320 0x7f9324156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:25.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.063+0000 7f9329c67700 1 --2- 172.21.15.49:0/2079785631 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9324098d10 0x7f9324165070 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:25.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.063+0000 7f9329c67700 1 --2- 172.21.15.49:0/2079785631 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f931005f2c0 0x7f9310061780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:23:25.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.063+0000 7f9329c67700 1 --2- 172.21.15.49:0/2079785631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93240c6190 0x7f9324168dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:25.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.063+0000 7f9329c67700 1 -- 172.21.15.49:0/2079785631 >> 172.21.15.49:0/2079785631 conn(0x7f93240cb310 msgr2=0x7f93240c7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:25.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.063+0000 7f9329c67700 1 -- 172.21.15.49:0/2079785631 shutdown_connections 2023-11-30T18:23:25.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.063+0000 7f9329c67700 1 -- 172.21.15.49:0/2079785631 wait complete. 2023-11-30T18:23:25.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:23:25.078 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-11-30T18:23:25.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:23:25.100 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/test_restart) 2023-11-30T18:23:25.157 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/test_restart 1M 2023-11-30T18:23:25.205 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:25.203+0000 7f3716da7680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T18:23:25.233 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:23:25.231+0000 7f34647d1680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T18:23:25.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.321+0000 7f752e531700 1 Processor -- start 2023-11-30T18:23:25.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.321+0000 7f752e531700 1 -- start start 2023-11-30T18:23:25.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.322+0000 7f752e531700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7528154910 0x7f75280a7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:25.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.322+0000 7f752e531700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75280c6630 con 0x7f7528154530 2023-11-30T18:23:25.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.322+0000 7f752e531700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7528064230 con 0x7f75280aa220 2023-11-30T18:23:25.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.322+0000 7f752e531700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75280c6390 con 0x7f7528154910 2023-11-30T18:23:25.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.322+0000 7f7527fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7528154530 0x7f75280c8580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37258/0 (socket says 172.21.15.49:37258) 2023-11-30T18:23:25.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.322+0000 7f7527fff700 1 -- 172.21.15.49:0/762552250 learned_addr learned my addr 172.21.15.49:0/762552250 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:23:25.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.322+0000 7f75277fe700 1 --2- 172.21.15.49:0/762552250 >> v2:172.21.15.115:3300/0 conn(0x7f7528154910 0x7f75280a7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:25.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.322+0000 7f7526ffd700 1 -- 172.21.15.49:0/762552250 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416743664 0 0) 0x7f75280c6630 con 0x7f7528154530 2023-11-30T18:23:25.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.322+0000 7f7526ffd700 1 -- 172.21.15.49:0/762552250 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75140033f0 con 0x7f7528154530 2023-11-30T18:23:25.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.322+0000 7f7526ffd700 1 -- 172.21.15.49:0/762552250 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 373393464 0 0) 0x7f7528064230 con 0x7f75280aa220 2023-11-30T18:23:25.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.322+0000 7f7526ffd700 1 -- 172.21.15.49:0/762552250 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75280c6630 con 0x7f75280aa220 2023-11-30T18:23:25.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.322+0000 7f75277fe700 1 -- 172.21.15.49:0/762552250 >> v1:172.21.15.115:6789/0 conn(0x7f75280aa220 legacy=0x7f75280c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:25.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.322+0000 7f75277fe700 1 -- 172.21.15.49:0/762552250 >> v1:172.21.15.49:6789/0 conn(0x7f7528154530 legacy=0x7f75280c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:25.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.322+0000 7f75277fe700 1 -- 172.21.15.49:0/762552250 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7528064510 con 0x7f7528154910 2023-11-30T18:23:25.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.323+0000 7f75277fe700 1 --2- 172.21.15.49:0/762552250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7528154910 0x7f75280a7ff0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f7510009760 tx=0x7f7510009060).ready entity=mon.1 client_cookie=d433a5b3c4bbe8f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:25.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.323+0000 7f7526ffd700 1 -- 172.21.15.49:0/762552250 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751000d4a0 con 0x7f7528154910 2023-11-30T18:23:25.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.323+0000 7f7526ffd700 1 -- 172.21.15.49:0/762552250 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751000d600 con 0x7f7528154910 2023-11-30T18:23:25.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.323+0000 7f7526ffd700 1 -- 172.21.15.49:0/762552250 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751000d980 con 0x7f7528154910 2023-11-30T18:23:25.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.323+0000 7f752e531700 1 -- 172.21.15.49:0/762552250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7528154910 msgr2=0x7f75280a7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:25.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.323+0000 7f752e531700 1 --2- 172.21.15.49:0/762552250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7528154910 0x7f75280a7ff0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f7510009760 tx=0x7f7510009060).stop 2023-11-30T18:23:25.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.323+0000 7f752e531700 1 -- 172.21.15.49:0/762552250 shutdown_connections 2023-11-30T18:23:25.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.323+0000 7f752e531700 1 --2- 172.21.15.49:0/762552250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7528154910 0x7f75280a7ff0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:25.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.323+0000 7f752e531700 1 -- 172.21.15.49:0/762552250 >> 172.21.15.49:0/762552250 conn(0x7f7528094930 msgr2=0x7f752806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:25.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.323+0000 7f752e531700 1 -- 172.21.15.49:0/762552250 shutdown_connections 2023-11-30T18:23:25.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.324+0000 7f752e531700 1 -- 172.21.15.49:0/762552250 wait complete. 2023-11-30T18:23:25.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.325+0000 7f752e531700 1 Processor -- start 2023-11-30T18:23:25.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.325+0000 7f752e531700 1 -- start start 2023-11-30T18:23:25.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.326+0000 7f752e531700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75280aa220 0x7f752813c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:25.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.326+0000 7f752e531700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7528154530 0x7f75280b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:25.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.326+0000 7f752e531700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7528154910 0x7f75280aab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:25.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.326+0000 7f752e531700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75280c3dc0 con 0x7f7528154530 2023-11-30T18:23:25.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.326+0000 7f752e531700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752813cc90 con 0x7f75280aa220 2023-11-30T18:23:25.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.326+0000 7f752e531700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75280c3490 con 0x7f7528154910 2023-11-30T18:23:25.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.326+0000 7f75277fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7528154530 0x7f75280b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:25.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.326+0000 7f75277fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7528154530 0x7f75280b0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42254/0 (socket says 172.21.15.49:42254) 2023-11-30T18:23:25.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.326+0000 7f75277fe700 1 -- 172.21.15.49:0/2234643314 learned_addr learned my addr 172.21.15.49:0/2234643314 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:25.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.326+0000 7f7527fff700 1 --2- 172.21.15.49:0/2234643314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75280aa220 0x7f752813c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:25.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.326+0000 7f752cace700 1 --2- 172.21.15.49:0/2234643314 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7528154910 0x7f75280aab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:25.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.326+0000 7f75277fe700 1 -- 172.21.15.49:0/2234643314 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7528154910 msgr2=0x7f75280aab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:25.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.326+0000 7f75277fe700 1 --2- 172.21.15.49:0/2234643314 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7528154910 0x7f75280aab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:25.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.326+0000 7f75277fe700 1 -- 172.21.15.49:0/2234643314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75280aa220 msgr2=0x7f752813c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:25.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.326+0000 7f75277fe700 1 --2- 172.21.15.49:0/2234643314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75280aa220 0x7f752813c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:25.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.326+0000 7f75277fe700 1 -- 172.21.15.49:0/2234643314 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75100092a0 con 0x7f7528154530 2023-11-30T18:23:25.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.326+0000 7f75277fe700 1 --2- 172.21.15.49:0/2234643314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7528154530 0x7f75280b0aa0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7f752806ae10 tx=0x7f7510016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:25.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.326+0000 7f751ffff700 1 -- 172.21.15.49:0/2234643314 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751000dcf0 con 0x7f7528154530 2023-11-30T18:23:25.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.326+0000 7f751ffff700 1 -- 172.21.15.49:0/2234643314 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751000de50 con 0x7f7528154530 2023-11-30T18:23:25.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.326+0000 7f752e531700 1 -- 172.21.15.49:0/2234643314 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75280c3770 con 0x7f7528154530 2023-11-30T18:23:25.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.326+0000 7f751ffff700 1 -- 172.21.15.49:0/2234643314 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751000d980 con 0x7f7528154530 2023-11-30T18:23:25.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.326+0000 7f752e531700 1 -- 172.21.15.49:0/2234643314 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75280b0f90 con 0x7f7528154530 2023-11-30T18:23:25.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.328+0000 7f752e531700 1 -- 172.21.15.49:0/2234643314 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75280add40 con 0x7f7528154530 2023-11-30T18:23:25.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.328+0000 7f751ffff700 1 -- 172.21.15.49:0/2234643314 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 76) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f751001d640 con 0x7f7528154530 2023-11-30T18:23:25.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.328+0000 7f751ffff700 1 --2- 172.21.15.49:0/2234643314 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f750805f2c0 0x7f7508061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:25.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.328+0000 7f751ffff700 1 -- 172.21.15.49:0/2234643314 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f751007bc90 con 0x7f7528154530 2023-11-30T18:23:25.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.328+0000 7f7527fff700 1 -- 172.21.15.49:0/2234643314 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f750805f2c0 msgr2=0x7f7508061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:23:25.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.328+0000 7f7527fff700 1 --2- 172.21.15.49:0/2234643314 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f750805f2c0 0x7f7508061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:23:25.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.333+0000 7f751ffff700 1 -- 172.21.15.49:0/2234643314 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f751004ce60 con 0x7f7528154530 2023-11-30T18:23:25.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.529+0000 7f7527fff700 1 -- 172.21.15.49:0/2234643314 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f750805f2c0 msgr2=0x7f7508061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:23:25.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.529+0000 7f7527fff700 1 --2- 172.21.15.49:0/2234643314 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f750805f2c0 0x7f7508061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T18:23:25.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.533+0000 7f752e531700 1 -- 172.21.15.49:0/2234643314 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f75280b00a0 con 0x7f750805f2c0 2023-11-30T18:23:25.829 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:25.816+0000 7f3716da7680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T18:23:25.890 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:25.888+0000 7f3716da7680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T18:23:25.901 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:23:25.899+0000 7f34647d1680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T18:23:25.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.930+0000 7f7527fff700 1 -- 172.21.15.49:0/2234643314 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f750805f2c0 msgr2=0x7f7508061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:23:25.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:25.930+0000 7f7527fff700 1 --2- 172.21.15.49:0/2234643314 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f750805f2c0 0x7f7508061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-11-30T18:23:25.970 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:23:25.968+0000 7f34647d1680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T18:23:26.076 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:26.074+0000 7f3716da7680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T18:23:26.163 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:23:26.162+0000 7f34647d1680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T18:23:26.496 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:26.494+0000 7f3716da7680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T18:23:26.600 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:26.599+0000 7f3716da7680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:23:26.602 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:23:26.600+0000 7f34647d1680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T18:23:26.710 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:23:26.709+0000 7f34647d1680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:23:26.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:26.731+0000 7f7527fff700 1 -- 172.21.15.49:0/2234643314 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f750805f2c0 msgr2=0x7f7508061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:23:26.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:26.731+0000 7f7527fff700 1 --2- 172.21.15.49:0/2234643314 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f750805f2c0 0x7f7508061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-11-30T18:23:26.753 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:26.752+0000 7f3716da7680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T18:23:26.829 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:26.828+0000 7f3716da7680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T18:23:26.870 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:23:26.868+0000 7f34647d1680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T18:23:26.895 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:26.895+0000 7f3716da7680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T18:23:26.947 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:23:26.946+0000 7f34647d1680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T18:23:27.018 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:23:27.016+0000 7f34647d1680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T18:23:27.152 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:27.151+0000 7f3716da7680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T18:23:27.292 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:23:27.290+0000 7f34647d1680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T18:23:27.338 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:27.337+0000 7f3716da7680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T18:23:27.482 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:23:27.480+0000 7f34647d1680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T18:23:27.987 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:27.986+0000 7f3716da7680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T18:23:28.056 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:28.055+0000 7f3716da7680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T18:23:28.133 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:28.132+0000 7f3716da7680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T18:23:28.170 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:23:28.168+0000 7f34647d1680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T18:23:28.241 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:23:28.240+0000 7f34647d1680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T18:23:28.280 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:28.279+0000 7f3716da7680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T18:23:28.320 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:23:28.319+0000 7f34647d1680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T18:23:28.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:28.332+0000 7f7527fff700 1 -- 172.21.15.49:0/2234643314 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f750805f2c0 msgr2=0x7f7508061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/89956 2023-11-30T18:23:28.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:28.332+0000 7f7527fff700 1 --2- 172.21.15.49:0/2234643314 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f750805f2c0 0x7f7508061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-11-30T18:23:28.351 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:28.350+0000 7f3716da7680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T18:23:28.466 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:28.465+0000 7f3716da7680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T18:23:28.474 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:23:28.472+0000 7f34647d1680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T18:23:28.547 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:23:28.545+0000 7f34647d1680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T18:23:28.575 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:28.574+0000 7f3716da7680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:23:28.668 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:23:28.666+0000 7f34647d1680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T18:23:28.782 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:23:28.781+0000 7f34647d1680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:23:28.865 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:28.865+0000 7f3716da7680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T18:23:28.937 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:28.936+0000 7f3716da7680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T18:23:28.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:28.957+0000 7f751ffff700 1 -- 172.21.15.49:0/2234643314 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 77) v1 ==== 75287+0+0 (secure 0 0 0) 0x7f75100aab00 con 0x7f7528154530 2023-11-30T18:23:28.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:28.957+0000 7f751ffff700 1 -- 172.21.15.49:0/2234643314 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f750805f2c0 msgr2=0x7f7508061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:23:28.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:28.957+0000 7f751ffff700 1 --2- 172.21.15.49:0/2234643314 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f750805f2c0 0x7f7508061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:23:29.022 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:29.021+0000 7f368e4f3700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:23:29.023 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:29.021+0000 7f368e4f3700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:23:29.023 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:29.021+0000 7f368e4f3700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:23:29.023 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:29.021+0000 7f368e4f3700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:23:29.023 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:29.021+0000 7f368e4f3700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:23:29.023 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:29.022+0000 7f368b4ed700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:23:29.023 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:29.022+0000 7f368b4ed700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:23:29.023 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:29.022+0000 7f368b4ed700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:23:29.023 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:29.022+0000 7f368b4ed700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:23:29.023 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:23:29.022+0000 7f368b4ed700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:23:29.090 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:23:29.088+0000 7f34647d1680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T18:23:29.165 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:23:29.162+0000 7f34647d1680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T18:23:29.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:29.961+0000 7f751ffff700 1 -- 172.21.15.49:0/2234643314 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mgrmap(e 78) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f7510079ce0 con 0x7f7528154530 2023-11-30T18:23:29.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:29.961+0000 7f751ffff700 1 --2- 172.21.15.49:0/2234643314 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f750805f2c0 0x7f7508061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:29.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:29.961+0000 7f751ffff700 1 -- 172.21.15.49:0/2234643314 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f75280b00a0 con 0x7f750805f2c0 2023-11-30T18:23:29.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:29.962+0000 7f7527fff700 1 --2- 172.21.15.49:0/2234643314 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f750805f2c0 0x7f7508061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:29.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:29.963+0000 7f7527fff700 1 --2- 172.21.15.49:0/2234643314 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f750805f2c0 0x7f7508061700 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f7518007860 tx=0x7f7518009040).ready entity=mgr.8842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:29.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:29.977+0000 7f751ffff700 1 -- 172.21.15.49:0/2234643314 <== mgr.8842 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f75280b00a0 con 0x7f750805f2c0 2023-11-30T18:23:29.979 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule set for path /snap_test_dir1/test_restart 2023-11-30T18:23:29.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:29.979+0000 7f752e531700 1 -- 172.21.15.49:0/2234643314 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f750805f2c0 msgr2=0x7f7508061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:29.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:29.979+0000 7f752e531700 1 --2- 172.21.15.49:0/2234643314 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f750805f2c0 0x7f7508061700 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f7518007860 tx=0x7f7518009040).stop 2023-11-30T18:23:29.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:29.979+0000 7f752e531700 1 -- 172.21.15.49:0/2234643314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7528154530 msgr2=0x7f75280b0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:29.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:29.979+0000 7f752e531700 1 --2- 172.21.15.49:0/2234643314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7528154530 0x7f75280b0aa0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7f752806ae10 tx=0x7f7510016000).stop 2023-11-30T18:23:29.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:29.979+0000 7f752e531700 1 -- 172.21.15.49:0/2234643314 shutdown_connections 2023-11-30T18:23:29.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:29.979+0000 7f752e531700 1 --2- 172.21.15.49:0/2234643314 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7528154910 0x7f75280aab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:29.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:29.979+0000 7f752e531700 1 --2- 172.21.15.49:0/2234643314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75280aa220 0x7f752813c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:29.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:29.979+0000 7f752e531700 1 --2- 172.21.15.49:0/2234643314 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f750805f2c0 0x7f7508061700 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:29.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:29.979+0000 7f752e531700 1 --2- 172.21.15.49:0/2234643314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7528154530 0x7f75280b0aa0 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:29.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:29.979+0000 7f752e531700 1 -- 172.21.15.49:0/2234643314 >> 172.21.15.49:0/2234643314 conn(0x7f7528094930 msgr2=0x7f7528156460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:29.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:29.979+0000 7f752e531700 1 -- 172.21.15.49:0/2234643314 shutdown_connections 2023-11-30T18:23:29.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:29.979+0000 7f752e531700 1 -- 172.21.15.49:0/2234643314 wait complete. 2023-11-30T18:23:29.994 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/test_restart 2023-11-30T18:23:29.994 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/test_restart 1M 2023-11-30T18:23:30.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.159+0000 7f0b035da700 1 Processor -- start 2023-11-30T18:23:30.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.160+0000 7f0b035da700 1 -- start start 2023-11-30T18:23:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.160+0000 7f0b035da700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0afc13b0b0 0x7f0afc0c6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.160+0000 7f0b035da700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0afc156d50 con 0x7f0afc13acd0 2023-11-30T18:23:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.160+0000 7f0b035da700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0afc0c6970 con 0x7f0afc0c6550 2023-11-30T18:23:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.160+0000 7f0b035da700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc156140 con 0x7f0afc13b0b0 2023-11-30T18:23:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.161+0000 7f0b01376700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0afc13acd0 0x7f0afc13b660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37264/0 (socket says 172.21.15.49:37264) 2023-11-30T18:23:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.161+0000 7f0b01376700 1 -- 172.21.15.49:0/4030531264 learned_addr learned my addr 172.21.15.49:0/4030531264 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:23:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.161+0000 7f0b00b75700 1 --2- 172.21.15.49:0/4030531264 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0afc13b0b0 0x7f0afc0c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.161+0000 7f0afbfff700 1 -- 172.21.15.49:0/4030531264 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 539657691 0 0) 0x7f0afc156d50 con 0x7f0afc13acd0 2023-11-30T18:23:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.161+0000 7f0afbfff700 1 -- 172.21.15.49:0/4030531264 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ae40033f0 con 0x7f0afc13acd0 2023-11-30T18:23:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.161+0000 7f0afbfff700 1 -- 172.21.15.49:0/4030531264 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3806839585 0 0) 0x7f0afc0c6970 con 0x7f0afc0c6550 2023-11-30T18:23:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.161+0000 7f0afbfff700 1 -- 172.21.15.49:0/4030531264 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0afc156d50 con 0x7f0afc0c6550 2023-11-30T18:23:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.161+0000 7f0b00b75700 1 -- 172.21.15.49:0/4030531264 >> v1:172.21.15.115:6789/0 conn(0x7f0afc0c6550 legacy=0x7f0afc0c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:30.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.161+0000 7f0b00b75700 1 -- 172.21.15.49:0/4030531264 >> v1:172.21.15.49:6789/0 conn(0x7f0afc13acd0 legacy=0x7f0afc13b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:30.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.161+0000 7f0b00b75700 1 -- 172.21.15.49:0/4030531264 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0afc156420 con 0x7f0afc13b0b0 2023-11-30T18:23:30.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.161+0000 7f0b00b75700 1 --2- 172.21.15.49:0/4030531264 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0afc13b0b0 0x7f0afc0c6060 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f0af0009790 tx=0x7f0af0009060).ready entity=mon.2 client_cookie=eee942b76c94f6be server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:30.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.161+0000 7f0afbfff700 1 -- 172.21.15.49:0/4030531264 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af00090d0 con 0x7f0afc13b0b0 2023-11-30T18:23:30.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.161+0000 7f0afbfff700 1 -- 172.21.15.49:0/4030531264 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af000f510 con 0x7f0afc13b0b0 2023-11-30T18:23:30.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.161+0000 7f0afbfff700 1 -- 172.21.15.49:0/4030531264 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af000f890 con 0x7f0afc13b0b0 2023-11-30T18:23:30.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.162+0000 7f0b035da700 1 -- 172.21.15.49:0/4030531264 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0afc13b0b0 msgr2=0x7f0afc0c6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:30.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.162+0000 7f0b035da700 1 --2- 172.21.15.49:0/4030531264 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0afc13b0b0 0x7f0afc0c6060 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f0af0009790 tx=0x7f0af0009060).stop 2023-11-30T18:23:30.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.162+0000 7f0b035da700 1 -- 172.21.15.49:0/4030531264 shutdown_connections 2023-11-30T18:23:30.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.162+0000 7f0b035da700 1 --2- 172.21.15.49:0/4030531264 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0afc13b0b0 0x7f0afc0c6060 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:30.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.162+0000 7f0b035da700 1 -- 172.21.15.49:0/4030531264 >> 172.21.15.49:0/4030531264 conn(0x7f0afc0628f0 msgr2=0x7f0afc062d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:30.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.162+0000 7f0b035da700 1 -- 172.21.15.49:0/4030531264 shutdown_connections 2023-11-30T18:23:30.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.162+0000 7f0b035da700 1 -- 172.21.15.49:0/4030531264 wait complete. 2023-11-30T18:23:30.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.163+0000 7f0b035da700 1 Processor -- start 2023-11-30T18:23:30.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.163+0000 7f0b035da700 1 -- start start 2023-11-30T18:23:30.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.164+0000 7f0b035da700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0afc0c6550 0x7f0afc154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:30.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.164+0000 7f0b035da700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0afc13acd0 0x7f0afc0c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:30.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.164+0000 7f0b035da700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0afc13b0b0 0x7f0afc14faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:30.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.164+0000 7f0b035da700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc155490 con 0x7f0afc13acd0 2023-11-30T18:23:30.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.164+0000 7f0b035da700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc0c4020 con 0x7f0afc0c6550 2023-11-30T18:23:30.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.164+0000 7f0b035da700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc155680 con 0x7f0afc13b0b0 2023-11-30T18:23:30.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.164+0000 7f0b00b75700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0afc13acd0 0x7f0afc0c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:30.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.164+0000 7f0b00b75700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0afc13acd0 0x7f0afc0c3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42270/0 (socket says 172.21.15.49:42270) 2023-11-30T18:23:30.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.164+0000 7f0b00b75700 1 -- 172.21.15.49:0/134512521 learned_addr learned my addr 172.21.15.49:0/134512521 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:23:30.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.164+0000 7f0b01b77700 1 --2- 172.21.15.49:0/134512521 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0afc13b0b0 0x7f0afc14faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:30.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.164+0000 7f0b01376700 1 --2- 172.21.15.49:0/134512521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0afc0c6550 0x7f0afc154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:30.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.164+0000 7f0b00b75700 1 -- 172.21.15.49:0/134512521 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0afc13b0b0 msgr2=0x7f0afc14faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:30.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.164+0000 7f0b00b75700 1 --2- 172.21.15.49:0/134512521 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0afc13b0b0 0x7f0afc14faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:30.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.165+0000 7f0b00b75700 1 -- 172.21.15.49:0/134512521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0afc0c6550 msgr2=0x7f0afc154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:30.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.165+0000 7f0b00b75700 1 --2- 172.21.15.49:0/134512521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0afc0c6550 0x7f0afc154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:30.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.165+0000 7f0b00b75700 1 -- 172.21.15.49:0/134512521 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af00092a0 con 0x7f0afc13acd0 2023-11-30T18:23:30.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.165+0000 7f0b00b75700 1 --2- 172.21.15.49:0/134512521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0afc13acd0 0x7f0afc0c3b30 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7f0af0009d80 tx=0x7f0af0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:30.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.165+0000 7f0af97fa700 1 -- 172.21.15.49:0/134512521 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af0006cd0 con 0x7f0afc13acd0 2023-11-30T18:23:30.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.165+0000 7f0af97fa700 1 -- 172.21.15.49:0/134512521 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af0000d10 con 0x7f0afc13acd0 2023-11-30T18:23:30.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.165+0000 7f0b035da700 1 -- 172.21.15.49:0/134512521 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0afc0c15c0 con 0x7f0afc13acd0 2023-11-30T18:23:30.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.165+0000 7f0af97fa700 1 -- 172.21.15.49:0/134512521 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af000f890 con 0x7f0afc13acd0 2023-11-30T18:23:30.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.165+0000 7f0b035da700 1 -- 172.21.15.49:0/134512521 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0afc0c0f70 con 0x7f0afc13acd0 2023-11-30T18:23:30.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.166+0000 7f0b035da700 1 -- 172.21.15.49:0/134512521 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0afc06c860 con 0x7f0afc13acd0 2023-11-30T18:23:30.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.166+0000 7f0af97fa700 1 -- 172.21.15.49:0/134512521 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 78) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f0af001c630 con 0x7f0afc13acd0 2023-11-30T18:23:30.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.167+0000 7f0af97fa700 1 --2- 172.21.15.49:0/134512521 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0ae805f080 0x7f0ae8061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:23:30.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.167+0000 7f0af97fa700 1 -- 172.21.15.49:0/134512521 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6435+0+0 (secure 0 0 0) 0x7f0af007b9c0 con 0x7f0afc13acd0 2023-11-30T18:23:30.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.167+0000 7f0b01376700 1 --2- 172.21.15.49:0/134512521 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0ae805f080 0x7f0ae8061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:23:30.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.167+0000 7f0b01376700 1 --2- 172.21.15.49:0/134512521 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0ae805f080 0x7f0ae8061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f0af4005750 tx=0x7f0af4009040).ready entity=mgr.8842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:23:30.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.171+0000 7f0af97fa700 1 -- 172.21.15.49:0/134512521 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0af004ccc0 con 0x7f0afc13acd0 2023-11-30T18:23:30.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.368+0000 7f0b035da700 1 -- 172.21.15.49:0/134512521 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f0afc156700 con 0x7f0ae805f080 2023-11-30T18:23:30.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.373+0000 7f0af97fa700 1 -- 172.21.15.49:0/134512521 <== mgr.8842 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+57 (secure 0 0 0) 0x7f0afc156700 con 0x7f0ae805f080 2023-11-30T18:23:30.375 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule activated for path /snap_test_dir1/test_restart 2023-11-30T18:23:30.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.375+0000 7f0b035da700 1 -- 172.21.15.49:0/134512521 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0ae805f080 msgr2=0x7f0ae8061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:30.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.375+0000 7f0b035da700 1 --2- 172.21.15.49:0/134512521 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0ae805f080 0x7f0ae8061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f0af4005750 tx=0x7f0af4009040).stop 2023-11-30T18:23:30.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.375+0000 7f0b035da700 1 -- 172.21.15.49:0/134512521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0afc13acd0 msgr2=0x7f0afc0c3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:23:30.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.375+0000 7f0b035da700 1 --2- 172.21.15.49:0/134512521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0afc13acd0 0x7f0afc0c3b30 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7f0af0009d80 tx=0x7f0af0017000).stop 2023-11-30T18:23:30.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.375+0000 7f0b035da700 1 -- 172.21.15.49:0/134512521 shutdown_connections 2023-11-30T18:23:30.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.375+0000 7f0b035da700 1 --2- 172.21.15.49:0/134512521 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0afc13b0b0 0x7f0afc14faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:30.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.375+0000 7f0b035da700 1 --2- 172.21.15.49:0/134512521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0afc0c6550 0x7f0afc154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:30.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.375+0000 7f0b035da700 1 --2- 172.21.15.49:0/134512521 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7f0ae805f080 0x7f0ae8061540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:30.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.375+0000 7f0b035da700 1 --2- 172.21.15.49:0/134512521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0afc13acd0 0x7f0afc0c3b30 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:23:30.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.375+0000 7f0b035da700 1 -- 172.21.15.49:0/134512521 >> 172.21.15.49:0/134512521 conn(0x7f0afc0628f0 msgr2=0x7f0afc139c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:23:30.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.375+0000 7f0b035da700 1 -- 172.21.15.49:0/134512521 shutdown_connections 2023-11-30T18:23:30.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:23:30.375+0000 7f0b035da700 1 -- 172.21.15.49:0/134512521 wait complete. 2023-11-30T18:23:30.389 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/test_restart 2023-11-30T18:23:35.304 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:23:35.307 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:24:00.379 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:24:00.377+0000 7f367d4d1700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:24:00.379 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:24:00.377+0000 7f367d4d1700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:24:00.379 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:24:00.377+0000 7f367d4d1700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:24:00.380 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:24:00.377+0000 7f367d4d1700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:24:00.380 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:24:00.377+0000 7f367d4d1700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:24:05.365 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:24:05.367 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:24:35.518 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:24:35.522 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:25:05.655 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:25:05.658 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:25:35.775 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:25:35.778 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:26:05.869 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:26:05.872 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:26:35.980 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:26:35.984 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:27:06.350 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:27:06.353 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:27:36.422 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:27:36.425 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:28:06.514 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:28:06.517 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:28:36.642 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:28:36.645 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:29:06.787 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:29:06.790 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:29:36.940 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:29:36.944 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:30:07.068 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:30:07.071 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:30:37.205 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:30:37.208 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:31:07.265 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:31:07.269 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:31:37.387 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:31:37.390 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:32:07.505 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:32:07.508 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:32:37.592 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:32:37.595 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:33:07.703 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:33:07.706 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:33:37.838 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:33:37.842 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:34:07.967 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:34:07.970 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:34:16.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:34:16.390 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-11-30T18:34:16.411 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_24_00_UTC 2023-11-30T18:34:16.411 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_25_00_UTC 2023-11-30T18:34:16.411 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_26_00_UTC 2023-11-30T18:34:16.411 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_27_00_UTC 2023-11-30T18:34:16.411 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_28_00_UTC 2023-11-30T18:34:16.411 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_29_00_UTC 2023-11-30T18:34:16.411 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_30_00_UTC 2023-11-30T18:34:16.411 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_31_00_UTC 2023-11-30T18:34:16.412 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_32_00_UTC 2023-11-30T18:34:16.412 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_33_00_UTC 2023-11-30T18:34:16.412 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_34_00_UTC 2023-11-30T18:34:16.412 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-11-30-18_24_00_UTC', 'scheduled-2023-11-30-18_25_00_UTC', 'scheduled-2023-11-30-18_26_00_UTC', 'scheduled-2023-11-30-18_27_00_UTC', 'scheduled-2023-11-30-18_28_00_UTC', 'scheduled-2023-11-30-18_29_00_UTC', 'scheduled-2023-11-30-18_30_00_UTC', 'scheduled-2023-11-30-18_31_00_UTC', 'scheduled-2023-11-30-18_32_00_UTC', 'scheduled-2023-11-30-18_33_00_UTC', 'scheduled-2023-11-30-18_34_00_UTC'] 2023-11-30T18:34:16.412 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-11-30T18:34:16.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.584+0000 7fce1e554700 1 Processor -- start 2023-11-30T18:34:16.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.585+0000 7fce1e554700 1 -- start start 2023-11-30T18:34:16.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.585+0000 7fce1e554700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce18154610 0x7fce181582e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:34:16.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.585+0000 7fce1e554700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fce180ab3b0 0x7fce180c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:34:16.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.585+0000 7fce1e554700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce18159210 con 0x7fce180aa1c0 2023-11-30T18:34:16.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.585+0000 7fce1e554700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce180c0c70 con 0x7fce180ab3b0 2023-11-30T18:34:16.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.585+0000 7fce1e554700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce180c2110 con 0x7fce18154610 2023-11-30T18:34:16.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.586+0000 7fce17fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce18154610 0x7fce181582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:34:16.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.586+0000 7fce177fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fce180ab3b0 0x7fce180c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:34:16.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.586+0000 7fce177fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fce180ab3b0 0x7fce180c80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:39050/0 (socket says 172.21.15.49:39050) 2023-11-30T18:34:16.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.586+0000 7fce177fe700 1 -- 172.21.15.49:0/332577407 learned_addr learned my addr 172.21.15.49:0/332577407 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:34:16.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.586+0000 7fce17fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce18154610 0x7fce181582e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:35364/0 (socket says 172.21.15.49:35364) 2023-11-30T18:34:16.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.586+0000 7fce1caf1700 1 --1- 172.21.15.49:0/332577407 >> v1:172.21.15.115:6789/0 conn(0x7fce180aa1c0 0x7fce180aa5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:46256/0 (socket says 172.21.15.49:46256) 2023-11-30T18:34:16.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.586+0000 7fce177fe700 1 -- 172.21.15.49:0/332577407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce18154610 msgr2=0x7fce181582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:34:16.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.586+0000 7fce177fe700 1 --2- 172.21.15.49:0/332577407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce18154610 0x7fce181582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:34:16.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.586+0000 7fce177fe700 1 -- 172.21.15.49:0/332577407 >> v1:172.21.15.115:6789/0 conn(0x7fce180aa1c0 legacy=0x7fce180aa5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:34:16.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.586+0000 7fce177fe700 1 -- 172.21.15.49:0/332577407 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce18158970 con 0x7fce180ab3b0 2023-11-30T18:34:16.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.586+0000 7fce16ffd700 1 -- 172.21.15.49:0/332577407 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1095108940 0 0) 0x7fce18159210 con 0x7fce180aa1c0 2023-11-30T18:34:16.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.586+0000 7fce17fff700 1 --2- 172.21.15.49:0/332577407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce18154610 0x7fce181582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:34:16.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.586+0000 7fce177fe700 1 --2- 172.21.15.49:0/332577407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce180ab3b0 0x7fce180c80c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7fce0c006fd0 tx=0x7fce0c0090f0).ready entity=mon.1 client_cookie=da390cd5c612a831 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:34:16.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.587+0000 7fce16ffd700 1 -- 172.21.15.49:0/332577407 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c00b580 con 0x7fce180ab3b0 2023-11-30T18:34:16.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.587+0000 7fce16ffd700 1 -- 172.21.15.49:0/332577407 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0c00b6e0 con 0x7fce180ab3b0 2023-11-30T18:34:16.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.587+0000 7fce16ffd700 1 -- 172.21.15.49:0/332577407 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c00ba60 con 0x7fce180ab3b0 2023-11-30T18:34:16.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.587+0000 7fce1e554700 1 -- 172.21.15.49:0/332577407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce180ab3b0 msgr2=0x7fce180c80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:34:16.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.587+0000 7fce1e554700 1 --2- 172.21.15.49:0/332577407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce180ab3b0 0x7fce180c80c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7fce0c006fd0 tx=0x7fce0c0090f0).stop 2023-11-30T18:34:16.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.587+0000 7fce1e554700 1 -- 172.21.15.49:0/332577407 shutdown_connections 2023-11-30T18:34:16.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.587+0000 7fce1e554700 1 --2- 172.21.15.49:0/332577407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce18154610 0x7fce181582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:34:16.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.587+0000 7fce1e554700 1 --2- 172.21.15.49:0/332577407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce180ab3b0 0x7fce180c80c0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:34:16.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.587+0000 7fce1e554700 1 -- 172.21.15.49:0/332577407 >> 172.21.15.49:0/332577407 conn(0x7fce180655a0 msgr2=0x7fce18069e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:34:16.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.587+0000 7fce1e554700 1 -- 172.21.15.49:0/332577407 shutdown_connections 2023-11-30T18:34:16.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.587+0000 7fce1e554700 1 -- 172.21.15.49:0/332577407 wait complete. 2023-11-30T18:34:16.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.588+0000 7fce1e554700 1 Processor -- start 2023-11-30T18:34:16.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.588+0000 7fce1e554700 1 -- start start 2023-11-30T18:34:16.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.589+0000 7fce1e554700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce180aa1c0 0x7fce180ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:34:16.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.589+0000 7fce1e554700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce18154610 0x7fce180c2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:34:16.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.589+0000 7fce1e554700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce180c3330 0x7fce180c3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:34:16.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.589+0000 7fce1e554700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1814d5a0 con 0x7fce180aa1c0 2023-11-30T18:34:16.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.589+0000 7fce1e554700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce180ae6e0 con 0x7fce180c3330 2023-11-30T18:34:16.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.589+0000 7fce1e554700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce18156e30 con 0x7fce18154610 2023-11-30T18:34:16.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.589+0000 7fce17fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce180aa1c0 0x7fce180ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:34:16.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.589+0000 7fce17fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce180aa1c0 0x7fce180ae1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39872/0 (socket says 172.21.15.49:39872) 2023-11-30T18:34:16.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.589+0000 7fce17fff700 1 -- 172.21.15.49:0/2084295667 learned_addr learned my addr 172.21.15.49:0/2084295667 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:34:16.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.590+0000 7fce1caf1700 1 --2- 172.21.15.49:0/2084295667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce180c3330 0x7fce180c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:34:16.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.590+0000 7fce177fe700 1 --2- 172.21.15.49:0/2084295667 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce18154610 0x7fce180c2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:34:16.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.590+0000 7fce17fff700 1 -- 172.21.15.49:0/2084295667 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce18154610 msgr2=0x7fce180c2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:34:16.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.590+0000 7fce17fff700 1 --2- 172.21.15.49:0/2084295667 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce18154610 0x7fce180c2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:34:16.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.590+0000 7fce17fff700 1 -- 172.21.15.49:0/2084295667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce180c3330 msgr2=0x7fce180c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:34:16.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.590+0000 7fce17fff700 1 --2- 172.21.15.49:0/2084295667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce180c3330 0x7fce180c3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:34:16.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.590+0000 7fce17fff700 1 -- 172.21.15.49:0/2084295667 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce080092a0 con 0x7fce180aa1c0 2023-11-30T18:34:16.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.590+0000 7fce1caf1700 1 --2- 172.21.15.49:0/2084295667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce180c3330 0x7fce180c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:34:16.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.590+0000 7fce17fff700 1 --2- 172.21.15.49:0/2084295667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce180aa1c0 0x7fce180ae1f0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7fce0800ea20 tx=0x7fce08009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:34:16.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.590+0000 7fcdfffff700 1 -- 172.21.15.49:0/2084295667 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0800c850 con 0x7fce180aa1c0 2023-11-30T18:34:16.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.590+0000 7fcdfffff700 1 -- 172.21.15.49:0/2084295667 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0800c9b0 con 0x7fce180aa1c0 2023-11-30T18:34:16.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.590+0000 7fce1e554700 1 -- 172.21.15.49:0/2084295667 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce0c009370 con 0x7fce180aa1c0 2023-11-30T18:34:16.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.590+0000 7fcdfffff700 1 -- 172.21.15.49:0/2084295667 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0800cd30 con 0x7fce180aa1c0 2023-11-30T18:34:16.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.590+0000 7fce1e554700 1 -- 172.21.15.49:0/2084295667 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce181567e0 con 0x7fce180aa1c0 2023-11-30T18:34:16.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.591+0000 7fce1e554700 1 -- 172.21.15.49:0/2084295667 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce1806c860 con 0x7fce180aa1c0 2023-11-30T18:34:16.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.592+0000 7fcdfffff700 1 -- 172.21.15.49:0/2084295667 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 81) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fce08012600 con 0x7fce180aa1c0 2023-11-30T18:34:16.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.592+0000 7fcdfffff700 1 --2- 172.21.15.49:0/2084295667 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fce0405f2c0 0x7fce04061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:34:16.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.592+0000 7fcdfffff700 1 -- 172.21.15.49:0/2084295667 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fce0807ab50 con 0x7fce180aa1c0 2023-11-30T18:34:16.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.592+0000 7fce177fe700 1 --2- 172.21.15.49:0/2084295667 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fce0405f2c0 0x7fce04061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:34:16.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.593+0000 7fce177fe700 1 --2- 172.21.15.49:0/2084295667 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fce0405f2c0 0x7fce04061780 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fce180c7c60 tx=0x7fce0c017000).ready entity=mgr.8842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:34:16.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.596+0000 7fcdfffff700 1 -- 172.21.15.49:0/2084295667 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fce0804bb10 con 0x7fce180aa1c0 2023-11-30T18:34:16.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.794+0000 7fce1e554700 1 -- 172.21.15.49:0/2084295667 --> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fce18158c50 con 0x7fce0405f2c0 2023-11-30T18:34:16.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.797+0000 7fcdfffff700 1 -- 172.21.15.49:0/2084295667 <== mgr.8842 v2:172.21.15.115:6832/89956 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7fce18158c50 con 0x7fce0405f2c0 2023-11-30T18:34:16.798 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:34:16.799 INFO:teuthology.orchestra.run.smithi049.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-11-30T00:00:00", "created": "2023-11-30T18:23:29", "first": "2023-11-30T18:24:00", "last": "2023-11-30T18:34:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-11-30T18:34:16.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.799+0000 7fce1e554700 1 -- 172.21.15.49:0/2084295667 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fce0405f2c0 msgr2=0x7fce04061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:34:16.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.799+0000 7fce1e554700 1 --2- 172.21.15.49:0/2084295667 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fce0405f2c0 0x7fce04061780 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fce180c7c60 tx=0x7fce0c017000).stop 2023-11-30T18:34:16.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.799+0000 7fce1e554700 1 -- 172.21.15.49:0/2084295667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce180aa1c0 msgr2=0x7fce180ae1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:34:16.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.799+0000 7fce1e554700 1 --2- 172.21.15.49:0/2084295667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce180aa1c0 0x7fce180ae1f0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7fce0800ea20 tx=0x7fce08009060).stop 2023-11-30T18:34:16.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.799+0000 7fce1e554700 1 -- 172.21.15.49:0/2084295667 shutdown_connections 2023-11-30T18:34:16.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.799+0000 7fce1e554700 1 --2- 172.21.15.49:0/2084295667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce180c3330 0x7fce180c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:34:16.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.799+0000 7fce1e554700 1 --2- 172.21.15.49:0/2084295667 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fce0405f2c0 0x7fce04061780 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:34:16.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.799+0000 7fce1e554700 1 --2- 172.21.15.49:0/2084295667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce180aa1c0 0x7fce180ae1f0 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:34:16.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.799+0000 7fce1e554700 1 --2- 172.21.15.49:0/2084295667 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce18154610 0x7fce180c2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:34:16.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.799+0000 7fce1e554700 1 -- 172.21.15.49:0/2084295667 >> 172.21.15.49:0/2084295667 conn(0x7fce180655a0 msgr2=0x7fce180c9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:34:16.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.799+0000 7fce1e554700 1 -- 172.21.15.49:0/2084295667 shutdown_connections 2023-11-30T18:34:16.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.799+0000 7fce1e554700 1 -- 172.21.15.49:0/2084295667 wait complete. 2023-11-30T18:34:16.812 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-11-30T00:00:00", "created": "2023-11-30T18:23:29", "first": "2023-11-30T18:24:00", "last": "2023-11-30T18:34:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-11-30T18:34:16.813 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-11-30T00:00:00', 'created': '2023-11-30T18:23:29', 'first': '2023-11-30T18:24:00', 'last': '2023-11-30T18:34:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': True} 2023-11-30T18:34:16.813 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-11-30T18:34:16.813 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-11-30T18:34:16.813 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-30T18:34:16.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.930+0000 7fe569e43700 1 Processor -- start 2023-11-30T18:34:16.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.930+0000 7fe569e43700 1 -- start start 2023-11-30T18:34:16.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.931+0000 7fe569e43700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe5641520c0 0x7fe564066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:34:16.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.931+0000 7fe569e43700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5641524a0 0x7fe564066a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:34:16.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.931+0000 7fe569e43700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe564067a40 0x7fe564067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:34:16.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.931+0000 7fe569e43700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5640683e0 con 0x7fe564067a40 2023-11-30T18:34:16.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.931+0000 7fe569e43700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5640be110 con 0x7fe5641520c0 2023-11-30T18:34:16.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.931+0000 7fe569e43700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe564066fc0 con 0x7fe5641524a0 2023-11-30T18:34:16.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.931+0000 7fe563fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe564067a40 0x7fe564067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:34:16.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.931+0000 7fe563fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe564067a40 0x7fe564067ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39874/0 (socket says 172.21.15.49:39874) 2023-11-30T18:34:16.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.931+0000 7fe563fff700 1 -- 172.21.15.49:0/3476542241 learned_addr learned my addr 172.21.15.49:0/3476542241 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:34:16.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.931+0000 7fe562ffd700 1 --2- 172.21.15.49:0/3476542241 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5641524a0 0x7fe564066a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:34:16.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.931+0000 7fe5637fe700 1 --2- 172.21.15.49:0/3476542241 >> v2:172.21.15.115:3300/0 conn(0x7fe5641520c0 0x7fe564066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:34:16.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.931+0000 7fe563fff700 1 -- 172.21.15.49:0/3476542241 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5641524a0 msgr2=0x7fe564066a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:34:16.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.931+0000 7fe563fff700 1 --2- 172.21.15.49:0/3476542241 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5641524a0 0x7fe564066a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:34:16.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.931+0000 7fe563fff700 1 -- 172.21.15.49:0/3476542241 >> v2:172.21.15.115:3300/0 conn(0x7fe5641520c0 msgr2=0x7fe564066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:34:16.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.931+0000 7fe563fff700 1 --2- 172.21.15.49:0/3476542241 >> v2:172.21.15.115:3300/0 conn(0x7fe5641520c0 0x7fe564066520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:34:16.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.931+0000 7fe563fff700 1 -- 172.21.15.49:0/3476542241 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5640672a0 con 0x7fe564067a40 2023-11-30T18:34:16.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.931+0000 7fe563fff700 1 --2- 172.21.15.49:0/3476542241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe564067a40 0x7fe564067ef0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7fe5640c5b10 tx=0x7fe55c009840).ready entity=mon.0 client_cookie=8dfe2afd9b7a82f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:34:16.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.931+0000 7fe5627fc700 1 -- 172.21.15.49:0/3476542241 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c00e070 con 0x7fe564067a40 2023-11-30T18:34:16.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.931+0000 7fe5627fc700 1 -- 172.21.15.49:0/3476542241 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55c00b970 con 0x7fe564067a40 2023-11-30T18:34:16.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.931+0000 7fe5627fc700 1 -- 172.21.15.49:0/3476542241 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c00bcf0 con 0x7fe564067a40 2023-11-30T18:34:16.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.932+0000 7fe569e43700 1 -- 172.21.15.49:0/3476542241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe564067a40 msgr2=0x7fe564067ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:34:16.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.932+0000 7fe569e43700 1 --2- 172.21.15.49:0/3476542241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe564067a40 0x7fe564067ef0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7fe5640c5b10 tx=0x7fe55c009840).stop 2023-11-30T18:34:16.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.932+0000 7fe569e43700 1 -- 172.21.15.49:0/3476542241 shutdown_connections 2023-11-30T18:34:16.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.932+0000 7fe569e43700 1 --2- 172.21.15.49:0/3476542241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe564067a40 0x7fe564067ef0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:34:16.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.932+0000 7fe569e43700 1 --2- 172.21.15.49:0/3476542241 >> v2:172.21.15.115:3300/0 conn(0x7fe5641520c0 0x7fe564066520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:34:16.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.932+0000 7fe569e43700 1 --2- 172.21.15.49:0/3476542241 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5641524a0 0x7fe564066a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:34:16.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.932+0000 7fe569e43700 1 -- 172.21.15.49:0/3476542241 >> 172.21.15.49:0/3476542241 conn(0x7fe5640631d0 msgr2=0x7fe5640c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:34:16.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.932+0000 7fe569e43700 1 -- 172.21.15.49:0/3476542241 shutdown_connections 2023-11-30T18:34:16.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.932+0000 7fe569e43700 1 -- 172.21.15.49:0/3476542241 wait complete. 2023-11-30T18:34:16.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.933+0000 7fe569e43700 1 Processor -- start 2023-11-30T18:34:16.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.933+0000 7fe569e43700 1 -- start start 2023-11-30T18:34:16.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.934+0000 7fe569e43700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe564067a40 0x7fe564161fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:34:16.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.934+0000 7fe569e43700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5641520c0 0x7fe5640c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:34:16.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.934+0000 7fe569e43700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5641524a0 0x7fe56414ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:34:16.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.934+0000 7fe569e43700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5640c6fc0 con 0x7fe5641520c0 2023-11-30T18:34:16.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.934+0000 7fe569e43700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5640c6cc0 con 0x7fe564067a40 2023-11-30T18:34:16.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.934+0000 7fe569e43700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe564162890 con 0x7fe5641524a0 2023-11-30T18:34:16.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.934+0000 7fe562ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5641520c0 0x7fe5640c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:34:16.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.934+0000 7fe562ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5641520c0 0x7fe5640c7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39880/0 (socket says 172.21.15.49:39880) 2023-11-30T18:34:16.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.934+0000 7fe562ffd700 1 -- 172.21.15.49:0/1769074083 learned_addr learned my addr 172.21.15.49:0/1769074083 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:34:16.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.934+0000 7fe563fff700 1 --2- 172.21.15.49:0/1769074083 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5641524a0 0x7fe56414ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:34:16.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.934+0000 7fe5637fe700 1 --2- 172.21.15.49:0/1769074083 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe564067a40 0x7fe564161fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:34:16.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.934+0000 7fe562ffd700 1 -- 172.21.15.49:0/1769074083 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5641524a0 msgr2=0x7fe56414ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:34:16.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.934+0000 7fe562ffd700 1 --2- 172.21.15.49:0/1769074083 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5641524a0 0x7fe56414ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:34:16.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.934+0000 7fe562ffd700 1 -- 172.21.15.49:0/1769074083 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe564067a40 msgr2=0x7fe564161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:34:16.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.934+0000 7fe562ffd700 1 --2- 172.21.15.49:0/1769074083 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe564067a40 0x7fe564161fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:34:16.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.934+0000 7fe562ffd700 1 -- 172.21.15.49:0/1769074083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55c009ae0 con 0x7fe5641520c0 2023-11-30T18:34:16.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.934+0000 7fe563fff700 1 --2- 172.21.15.49:0/1769074083 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5641524a0 0x7fe56414ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:34:16.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.934+0000 7fe5637fe700 1 --2- 172.21.15.49:0/1769074083 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe564067a40 0x7fe564161fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:34:16.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.935+0000 7fe562ffd700 1 --2- 172.21.15.49:0/1769074083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5641520c0 0x7fe5640c7450 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7fe55400e930 tx=0x7fe554009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:34:16.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.935+0000 7fe54b7fe700 1 -- 172.21.15.49:0/1769074083 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55400c640 con 0x7fe5641520c0 2023-11-30T18:34:16.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.935+0000 7fe54b7fe700 1 -- 172.21.15.49:0/1769074083 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55400c7a0 con 0x7fe5641520c0 2023-11-30T18:34:16.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.935+0000 7fe569e43700 1 -- 172.21.15.49:0/1769074083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe564162b70 con 0x7fe5641520c0 2023-11-30T18:34:16.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.935+0000 7fe54b7fe700 1 -- 172.21.15.49:0/1769074083 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55400cb20 con 0x7fe5641520c0 2023-11-30T18:34:16.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.935+0000 7fe569e43700 1 -- 172.21.15.49:0/1769074083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5641624a0 con 0x7fe5641520c0 2023-11-30T18:34:16.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.936+0000 7fe569e43700 1 -- 172.21.15.49:0/1769074083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe56406c860 con 0x7fe5641520c0 2023-11-30T18:34:16.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.936+0000 7fe54b7fe700 1 -- 172.21.15.49:0/1769074083 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 81) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fe55401b400 con 0x7fe5641520c0 2023-11-30T18:34:16.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.936+0000 7fe54b7fe700 1 --2- 172.21.15.49:0/1769074083 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe55005f2c0 0x7fe550061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:34:16.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.937+0000 7fe54b7fe700 1 -- 172.21.15.49:0/1769074083 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fe55407ab30 con 0x7fe5641520c0 2023-11-30T18:34:16.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.937+0000 7fe5637fe700 1 --2- 172.21.15.49:0/1769074083 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe55005f2c0 0x7fe550061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:34:16.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.937+0000 7fe5637fe700 1 --2- 172.21.15.49:0/1769074083 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe55005f2c0 0x7fe550061780 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe558006d20 tx=0x7fe558008040).ready entity=mgr.8842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:34:16.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:16.941+0000 7fe54b7fe700 1 -- 172.21.15.49:0/1769074083 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe55404b9d0 con 0x7fe5641520c0 2023-11-30T18:34:17.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:17.161+0000 7fe569e43700 1 -- 172.21.15.49:0/1769074083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fe5640c7100 con 0x7fe5641520c0 2023-11-30T18:34:17.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:17.164+0000 7fe54b7fe700 1 -- 172.21.15.49:0/1769074083 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v81) v1 ==== 74+0+149164 (secure 0 0 0) 0x7fe554016070 con 0x7fe5641520c0 2023-11-30T18:34:17.168 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:34:17.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:17.166+0000 7fe569e43700 1 -- 172.21.15.49:0/1769074083 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe55005f2c0 msgr2=0x7fe550061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:34:17.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:17.166+0000 7fe569e43700 1 --2- 172.21.15.49:0/1769074083 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe55005f2c0 0x7fe550061780 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe558006d20 tx=0x7fe558008040).stop 2023-11-30T18:34:17.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:17.166+0000 7fe569e43700 1 -- 172.21.15.49:0/1769074083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5641520c0 msgr2=0x7fe5640c7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:34:17.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:17.166+0000 7fe569e43700 1 --2- 172.21.15.49:0/1769074083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5641520c0 0x7fe5640c7450 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7fe55400e930 tx=0x7fe554009060).stop 2023-11-30T18:34:17.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:17.166+0000 7fe569e43700 1 -- 172.21.15.49:0/1769074083 shutdown_connections 2023-11-30T18:34:17.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:17.166+0000 7fe569e43700 1 --2- 172.21.15.49:0/1769074083 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5641524a0 0x7fe56414ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:34:17.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:17.166+0000 7fe569e43700 1 --2- 172.21.15.49:0/1769074083 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe564067a40 0x7fe564161fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:34:17.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:17.166+0000 7fe569e43700 1 --2- 172.21.15.49:0/1769074083 >> [v2:172.21.15.115:6832/89956,v1:172.21.15.115:6833/89956] conn(0x7fe55005f2c0 0x7fe550061780 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:34:17.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:17.166+0000 7fe569e43700 1 --2- 172.21.15.49:0/1769074083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5641520c0 0x7fe5640c7450 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:34:17.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:17.166+0000 7fe569e43700 1 -- 172.21.15.49:0/1769074083 >> 172.21.15.49:0/1769074083 conn(0x7fe5640631d0 msgr2=0x7fe5641504a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:34:17.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:17.166+0000 7fe569e43700 1 -- 172.21.15.49:0/1769074083 shutdown_connections 2023-11-30T18:34:17.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:34:17.166+0000 7fe569e43700 1 -- 172.21.15.49:0/1769074083 wait complete. 2023-11-30T18:34:17.180 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":81,"active_gid":8842,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":89956},{"type":"v1","addr":"172.21.15.115:6833","nonce":89956}]},"active_addr":"172.21.15.115:6833/89956","active_change":"2023-11-30T18:23:28.950455+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":9177,"name":"y","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":185,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":3737718649}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":1769486452}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":3122997899}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":3726314103}]}]} 2023-11-30T18:34:17.183 DEBUG:tasks.cephfs.test_snap_schedules:restarting active mgr: x 2023-11-30T18:34:17.183 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-30T18:34:17.183 INFO:tasks.ceph.mgr.x:Stopping old one... 2023-11-30T18:34:17.183 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-30T18:34:17.183 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:34:17.214 INFO:tasks.ceph.mgr.x:Stopped 2023-11-30T18:34:17.215 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-30T18:34:17.257 INFO:tasks.ceph.mgr.x:Started 2023-11-30T18:34:17.441 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:17.440+0000 7fb9ea729680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T18:34:17.503 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:17.502+0000 7fb9ea729680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T18:34:17.774 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:17.773+0000 7fb9ea729680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T18:34:18.385 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:18.385+0000 7fb9ea729680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T18:34:18.458 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:18.457+0000 7fb9ea729680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T18:34:18.645 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:18.644+0000 7fb9ea729680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T18:34:19.065 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:19.064+0000 7fb9ea729680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T18:34:19.169 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:19.169+0000 7fb9ea729680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:34:19.322 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:19.321+0000 7fb9ea729680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T18:34:19.397 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:19.396+0000 7fb9ea729680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T18:34:19.464 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:19.463+0000 7fb9ea729680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T18:34:19.723 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:19.722+0000 7fb9ea729680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T18:34:19.906 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:19.905+0000 7fb9ea729680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T18:34:20.556 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:20.555+0000 7fb9ea729680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T18:34:20.625 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:20.624+0000 7fb9ea729680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T18:34:20.700 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:20.700+0000 7fb9ea729680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T18:34:20.847 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:20.846+0000 7fb9ea729680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T18:34:20.918 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:20.917+0000 7fb9ea729680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T18:34:21.034 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:21.033+0000 7fb9ea729680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T18:34:21.142 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:21.141+0000 7fb9ea729680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:34:21.431 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:21.430+0000 7fb9ea729680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T18:34:21.503 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:21.502+0000 7fb9ea729680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T18:34:21.593 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:21.592+0000 7fb95e6ae700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:34:21.593 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:21.592+0000 7fb95e6ae700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:34:21.593 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:21.592+0000 7fb95e6ae700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:34:21.593 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:21.592+0000 7fb95e6ae700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:34:21.593 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:21.592+0000 7fb95e6ae700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:34:21.593 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:21.592+0000 7fb960eb3700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:34:21.594 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:21.592+0000 7fb960eb3700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:34:21.594 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:21.592+0000 7fb960eb3700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:34:21.594 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:21.592+0000 7fb960eb3700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:34:21.594 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:34:21.592+0000 7fb960eb3700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:34:38.087 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:34:38.090 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:35:00.585 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:35:00.584+0000 7fb96a6c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:35:00.585 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:35:00.584+0000 7fb96a6c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:35:00.586 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:35:00.584+0000 7fb96a6c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:35:00.586 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:35:00.584+0000 7fb96a6c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:35:00.586 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:35:00.584+0000 7fb96a6c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:35:08.215 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:35:08.218 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:35:38.342 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:35:38.345 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:36:08.410 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:36:08.413 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:36:38.532 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:36:38.535 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:37:08.677 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:37:08.680 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:37:38.821 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:37:38.824 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:38:08.942 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:38:08.946 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:38:39.012 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:38:39.018 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:39:09.081 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:39:09.084 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:39:17.258 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/test_restart 1M 2023-11-30T18:39:17.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.394+0000 7ff1f89ff700 1 Processor -- start 2023-11-30T18:39:17.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.394+0000 7ff1f89ff700 1 -- start start 2023-11-30T18:39:17.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.395+0000 7ff1f89ff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff1f4158040 0x7ff1f4154550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:17.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.395+0000 7ff1f89ff700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f40aa840 con 0x7ff1f4154170 2023-11-30T18:39:17.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.395+0000 7ff1f89ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f41584d0 con 0x7ff1f4064880 2023-11-30T18:39:17.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.395+0000 7ff1f89ff700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f41587b0 con 0x7ff1f4158040 2023-11-30T18:39:17.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.395+0000 7ff1f259c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff1f4158040 0x7ff1f4154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:17.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.395+0000 7ff1f2d9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff1f4154170 0x7ff1f40aa130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52966/0 (socket says 172.21.15.49:52966) 2023-11-30T18:39:17.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.395+0000 7ff1f259c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff1f4158040 0x7ff1f4154550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34806/0 (socket says 172.21.15.49:34806) 2023-11-30T18:39:17.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.395+0000 7ff1f2d9d700 1 -- 172.21.15.49:0/2260385149 learned_addr learned my addr 172.21.15.49:0/2260385149 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:17.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.396+0000 7ff1f259c700 1 -- 172.21.15.49:0/2260385149 >> v1:172.21.15.115:6789/0 conn(0x7ff1f4064880 legacy=0x7ff1f40c0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:17.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.396+0000 7ff1f259c700 1 -- 172.21.15.49:0/2260385149 >> v1:172.21.15.49:6789/0 conn(0x7ff1f4154170 legacy=0x7ff1f40aa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:17.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.396+0000 7ff1f1d9b700 1 -- 172.21.15.49:0/2260385149 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2051928002 0 0) 0x7ff1f40aa840 con 0x7ff1f4154170 2023-11-30T18:39:17.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.396+0000 7ff1f259c700 1 -- 172.21.15.49:0/2260385149 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f4158a90 con 0x7ff1f4158040 2023-11-30T18:39:17.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.396+0000 7ff1f259c700 1 --2- 172.21.15.49:0/2260385149 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1f4158040 0x7ff1f4154550 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7ff1dc009760 tx=0x7ff1dc009060).ready entity=mon.0 client_cookie=26b95e198cbceae4 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:17.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.396+0000 7ff1f1d9b700 1 -- 172.21.15.49:0/2260385149 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc00b520 con 0x7ff1f4158040 2023-11-30T18:39:17.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.396+0000 7ff1f1d9b700 1 -- 172.21.15.49:0/2260385149 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1dc00b680 con 0x7ff1f4158040 2023-11-30T18:39:17.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.396+0000 7ff1f1d9b700 1 -- 172.21.15.49:0/2260385149 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc00ba00 con 0x7ff1f4158040 2023-11-30T18:39:17.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.396+0000 7ff1f89ff700 1 -- 172.21.15.49:0/2260385149 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1f4158040 msgr2=0x7ff1f4154550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:17.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.396+0000 7ff1f89ff700 1 --2- 172.21.15.49:0/2260385149 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1f4158040 0x7ff1f4154550 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7ff1dc009760 tx=0x7ff1dc009060).stop 2023-11-30T18:39:17.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.397+0000 7ff1f89ff700 1 -- 172.21.15.49:0/2260385149 shutdown_connections 2023-11-30T18:39:17.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.397+0000 7ff1f89ff700 1 --2- 172.21.15.49:0/2260385149 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1f4158040 0x7ff1f4154550 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:17.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.397+0000 7ff1f89ff700 1 -- 172.21.15.49:0/2260385149 >> 172.21.15.49:0/2260385149 conn(0x7ff1f40cb010 msgr2=0x7ff1f40cb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:17.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.397+0000 7ff1f89ff700 1 -- 172.21.15.49:0/2260385149 shutdown_connections 2023-11-30T18:39:17.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.397+0000 7ff1f89ff700 1 -- 172.21.15.49:0/2260385149 wait complete. 2023-11-30T18:39:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.398+0000 7ff1f89ff700 1 Processor -- start 2023-11-30T18:39:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.398+0000 7ff1f89ff700 1 -- start start 2023-11-30T18:39:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.399+0000 7ff1f89ff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1f4064880 0x7ff1f40ac2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.399+0000 7ff1f89ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1f4154170 0x7ff1f40c28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.399+0000 7ff1f89ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1f4157350 0x7ff1f40c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.399+0000 7ff1f89ff700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f40ad2e0 con 0x7ff1f4064880 2023-11-30T18:39:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.399+0000 7ff1f89ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f40ac7b0 con 0x7ff1f4154170 2023-11-30T18:39:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.399+0000 7ff1f89ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f40aca40 con 0x7ff1f4157350 2023-11-30T18:39:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.399+0000 7ff1f2d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1f4064880 0x7ff1f40ac2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:17.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.399+0000 7ff1f2d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1f4064880 0x7ff1f40ac2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34820/0 (socket says 172.21.15.49:34820) 2023-11-30T18:39:17.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.399+0000 7ff1f2d9d700 1 -- 172.21.15.49:0/465013279 learned_addr learned my addr 172.21.15.49:0/465013279 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:17.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.399+0000 7ff1f259c700 1 --2- 172.21.15.49:0/465013279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1f4154170 0x7ff1f40c28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:17.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.399+0000 7ff1f359e700 1 --2- 172.21.15.49:0/465013279 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1f4157350 0x7ff1f40c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:17.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.399+0000 7ff1f2d9d700 1 -- 172.21.15.49:0/465013279 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1f4157350 msgr2=0x7ff1f40c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:17.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.399+0000 7ff1f2d9d700 1 --2- 172.21.15.49:0/465013279 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1f4157350 0x7ff1f40c42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:17.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.399+0000 7ff1f2d9d700 1 -- 172.21.15.49:0/465013279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1f4154170 msgr2=0x7ff1f40c28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:17.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.399+0000 7ff1f2d9d700 1 --2- 172.21.15.49:0/465013279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1f4154170 0x7ff1f40c28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:17.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.399+0000 7ff1f2d9d700 1 -- 172.21.15.49:0/465013279 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1dc0092a0 con 0x7ff1f4064880 2023-11-30T18:39:17.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.399+0000 7ff1f259c700 1 --2- 172.21.15.49:0/465013279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1f4154170 0x7ff1f40c28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:39:17.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.399+0000 7ff1f2d9d700 1 --2- 172.21.15.49:0/465013279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1f4064880 0x7ff1f40ac2c0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7ff1e400c960 tx=0x7ff1e4001630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:17.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.399+0000 7ff1eaffd700 1 -- 172.21.15.49:0/465013279 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4005d30 con 0x7ff1f4064880 2023-11-30T18:39:17.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.399+0000 7ff1eaffd700 1 -- 172.21.15.49:0/465013279 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e4005e90 con 0x7ff1f4064880 2023-11-30T18:39:17.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.399+0000 7ff1f89ff700 1 -- 172.21.15.49:0/465013279 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f40acd20 con 0x7ff1f4064880 2023-11-30T18:39:17.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.399+0000 7ff1eaffd700 1 -- 172.21.15.49:0/465013279 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4007320 con 0x7ff1f4064880 2023-11-30T18:39:17.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.399+0000 7ff1f89ff700 1 -- 172.21.15.49:0/465013279 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f41554f0 con 0x7ff1f4064880 2023-11-30T18:39:17.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.401+0000 7ff1f89ff700 1 -- 172.21.15.49:0/465013279 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f406c7c0 con 0x7ff1f4064880 2023-11-30T18:39:17.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.401+0000 7ff1eaffd700 1 -- 172.21.15.49:0/465013279 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 86) v1 ==== 75577+0+0 (secure 0 0 0) 0x7ff1e4007710 con 0x7ff1f4064880 2023-11-30T18:39:17.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.401+0000 7ff1eaffd700 1 --2- 172.21.15.49:0/465013279 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff1d405f2c0 0x7ff1d4061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:17.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.401+0000 7ff1eaffd700 1 -- 172.21.15.49:0/465013279 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6694+0+0 (secure 0 0 0) 0x7ff1e407a810 con 0x7ff1f4064880 2023-11-30T18:39:17.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.401+0000 7ff1f259c700 1 --2- 172.21.15.49:0/465013279 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff1d405f2c0 0x7ff1d4061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:17.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.402+0000 7ff1f259c700 1 --2- 172.21.15.49:0/465013279 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff1d405f2c0 0x7ff1d4061780 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7ff1f40c16b0 tx=0x7ff1dc017000).ready entity=mgr.8920 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:17.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.406+0000 7ff1eaffd700 1 -- 172.21.15.49:0/465013279 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff1e404b720 con 0x7ff1f4064880 2023-11-30T18:39:17.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.605+0000 7ff1f89ff700 1 -- 172.21.15.49:0/465013279 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1f4158d70 con 0x7ff1d405f2c0 2023-11-30T18:39:17.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.610+0000 7ff1eaffd700 1 -- 172.21.15.49:0/465013279 <== mgr.8920 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+59 (secure 0 0 0) 0x7ff1f4158d70 con 0x7ff1d405f2c0 2023-11-30T18:39:17.612 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule deactivated for path /snap_test_dir1/test_restart 2023-11-30T18:39:17.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.612+0000 7ff1f89ff700 1 -- 172.21.15.49:0/465013279 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff1d405f2c0 msgr2=0x7ff1d4061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:17.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.612+0000 7ff1f89ff700 1 --2- 172.21.15.49:0/465013279 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff1d405f2c0 0x7ff1d4061780 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7ff1f40c16b0 tx=0x7ff1dc017000).stop 2023-11-30T18:39:17.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.612+0000 7ff1f89ff700 1 -- 172.21.15.49:0/465013279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1f4064880 msgr2=0x7ff1f40ac2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:17.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.612+0000 7ff1f89ff700 1 --2- 172.21.15.49:0/465013279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1f4064880 0x7ff1f40ac2c0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7ff1e400c960 tx=0x7ff1e4001630).stop 2023-11-30T18:39:17.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.612+0000 7ff1f89ff700 1 -- 172.21.15.49:0/465013279 shutdown_connections 2023-11-30T18:39:17.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.612+0000 7ff1f89ff700 1 --2- 172.21.15.49:0/465013279 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff1d405f2c0 0x7ff1d4061780 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:17.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.612+0000 7ff1f89ff700 1 --2- 172.21.15.49:0/465013279 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1f4157350 0x7ff1f40c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:17.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.612+0000 7ff1f89ff700 1 --2- 172.21.15.49:0/465013279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1f4064880 0x7ff1f40ac2c0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:17.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.612+0000 7ff1f89ff700 1 --2- 172.21.15.49:0/465013279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1f4154170 0x7ff1f40c28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:17.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.612+0000 7ff1f89ff700 1 -- 172.21.15.49:0/465013279 >> 172.21.15.49:0/465013279 conn(0x7ff1f40cb010 msgr2=0x7ff1f40ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:17.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.612+0000 7ff1f89ff700 1 -- 172.21.15.49:0/465013279 shutdown_connections 2023-11-30T18:39:17.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.613+0000 7ff1f89ff700 1 -- 172.21.15.49:0/465013279 wait complete. 2023-11-30T18:39:17.626 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/test_restart 2023-11-30T18:39:17.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:39:17.626 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-11-30T18:39:17.642 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_24_00_UTC 2023-11-30T18:39:17.643 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_25_00_UTC 2023-11-30T18:39:17.643 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_26_00_UTC 2023-11-30T18:39:17.643 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_27_00_UTC 2023-11-30T18:39:17.643 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_28_00_UTC 2023-11-30T18:39:17.643 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_29_00_UTC 2023-11-30T18:39:17.643 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_30_00_UTC 2023-11-30T18:39:17.643 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_31_00_UTC 2023-11-30T18:39:17.643 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_32_00_UTC 2023-11-30T18:39:17.643 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_33_00_UTC 2023-11-30T18:39:17.643 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_34_00_UTC 2023-11-30T18:39:17.644 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_35_00_UTC 2023-11-30T18:39:17.644 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_36_00_UTC 2023-11-30T18:39:17.644 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_37_00_UTC 2023-11-30T18:39:17.644 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_38_00_UTC 2023-11-30T18:39:17.644 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_39_00_UTC 2023-11-30T18:39:17.644 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-11-30-18_24_00_UTC', 'scheduled-2023-11-30-18_25_00_UTC', 'scheduled-2023-11-30-18_26_00_UTC', 'scheduled-2023-11-30-18_27_00_UTC', 'scheduled-2023-11-30-18_28_00_UTC', 'scheduled-2023-11-30-18_29_00_UTC', 'scheduled-2023-11-30-18_30_00_UTC', 'scheduled-2023-11-30-18_31_00_UTC', 'scheduled-2023-11-30-18_32_00_UTC', 'scheduled-2023-11-30-18_33_00_UTC', 'scheduled-2023-11-30-18_34_00_UTC', 'scheduled-2023-11-30-18_35_00_UTC', 'scheduled-2023-11-30-18_36_00_UTC', 'scheduled-2023-11-30-18_37_00_UTC', 'scheduled-2023-11-30-18_38_00_UTC', 'scheduled-2023-11-30-18_39_00_UTC'] 2023-11-30T18:39:17.644 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-11-30T18:39:17.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.801+0000 7ff7b4da3700 1 Processor -- start 2023-11-30T18:39:17.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.802+0000 7ff7b4da3700 1 -- start start 2023-11-30T18:39:17.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.802+0000 7ff7b4da3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff7b00ab3b0 0x7ff7b01582e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:17.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.802+0000 7ff7b4da3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff7b00aa1c0 0x7ff7b00aa630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:17.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.802+0000 7ff7b4da3700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b0159210 con 0x7ff7b0154610 2023-11-30T18:39:17.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.803+0000 7ff7b4da3700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7b00c0c70 con 0x7ff7b00aa1c0 2023-11-30T18:39:17.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.803+0000 7ff7b4da3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b00c2110 con 0x7ff7b00ab3b0 2023-11-30T18:39:17.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.803+0000 7ff7aed9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff7b00aa1c0 0x7ff7b00aa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:17.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.803+0000 7ff7aed9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff7b00aa1c0 0x7ff7b00aa630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34828/0 (socket says 172.21.15.49:34828) 2023-11-30T18:39:17.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.803+0000 7ff7aed9d700 1 -- 172.21.15.49:0/2873038193 learned_addr learned my addr 172.21.15.49:0/2873038193 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:17.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.803+0000 7ff7add9b700 1 --2- 172.21.15.49:0/2873038193 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff7b00ab3b0 0x7ff7b01582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:17.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.803+0000 7ff7aed9d700 1 -- 172.21.15.49:0/2873038193 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff7b00ab3b0 msgr2=0x7ff7b01582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:17.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.803+0000 7ff7aed9d700 1 --2- 172.21.15.49:0/2873038193 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff7b00ab3b0 0x7ff7b01582e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:17.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.803+0000 7ff7aed9d700 1 -- 172.21.15.49:0/2873038193 >> v1:172.21.15.115:6789/0 conn(0x7ff7b0154610 legacy=0x7ff7b00c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:17.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.803+0000 7ff7aed9d700 1 -- 172.21.15.49:0/2873038193 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b00aab20 con 0x7ff7b00aa1c0 2023-11-30T18:39:17.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.803+0000 7ff7aed9d700 1 --2- 172.21.15.49:0/2873038193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b00aa1c0 0x7ff7b00aa630 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7ff7a0009f20 tx=0x7ff7a0009840).ready entity=mon.0 client_cookie=bbc53ec236247985 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:17.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.803+0000 7ff7ad59a700 1 -- 172.21.15.49:0/2873038193 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a000e070 con 0x7ff7b00aa1c0 2023-11-30T18:39:17.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.803+0000 7ff7ad59a700 1 -- 172.21.15.49:0/2873038193 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a000ba40 con 0x7ff7b00aa1c0 2023-11-30T18:39:17.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.803+0000 7ff7ad59a700 1 -- 172.21.15.49:0/2873038193 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a000bdc0 con 0x7ff7b00aa1c0 2023-11-30T18:39:17.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.804+0000 7ff7b4da3700 1 -- 172.21.15.49:0/2873038193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b00aa1c0 msgr2=0x7ff7b00aa630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:17.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.804+0000 7ff7b4da3700 1 --2- 172.21.15.49:0/2873038193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b00aa1c0 0x7ff7b00aa630 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7ff7a0009f20 tx=0x7ff7a0009840).stop 2023-11-30T18:39:17.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.804+0000 7ff7b4da3700 1 -- 172.21.15.49:0/2873038193 shutdown_connections 2023-11-30T18:39:17.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.804+0000 7ff7b4da3700 1 --2- 172.21.15.49:0/2873038193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b00aa1c0 0x7ff7b00aa630 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:17.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.804+0000 7ff7b4da3700 1 --2- 172.21.15.49:0/2873038193 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff7b00ab3b0 0x7ff7b01582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:17.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.804+0000 7ff7b4da3700 1 -- 172.21.15.49:0/2873038193 >> 172.21.15.49:0/2873038193 conn(0x7ff7b00655a0 msgr2=0x7ff7b0069e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:17.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.804+0000 7ff7b4da3700 1 -- 172.21.15.49:0/2873038193 shutdown_connections 2023-11-30T18:39:17.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.804+0000 7ff7b4da3700 1 -- 172.21.15.49:0/2873038193 wait complete. 2023-11-30T18:39:17.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.805+0000 7ff7b4da3700 1 Processor -- start 2023-11-30T18:39:17.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.805+0000 7ff7b4da3700 1 -- start start 2023-11-30T18:39:17.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.806+0000 7ff7b4da3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7b00aa1c0 0x7ff7b0144ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:17.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.806+0000 7ff7b4da3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff7b0154610 0x7ff7b00ab7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:17.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.806+0000 7ff7b4da3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b00abc90 0x7ff7b00ac0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:17.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.806+0000 7ff7b4da3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b0155bd0 con 0x7ff7b00abc90 2023-11-30T18:39:17.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.806+0000 7ff7b4da3700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b00ac5e0 con 0x7ff7b00aa1c0 2023-11-30T18:39:17.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.806+0000 7ff7b4da3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b0155000 con 0x7ff7b0154610 2023-11-30T18:39:17.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.806+0000 7ff7aed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b00abc90 0x7ff7b00ac0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:17.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.806+0000 7ff7aed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b00abc90 0x7ff7b00ac0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34834/0 (socket says 172.21.15.49:34834) 2023-11-30T18:39:17.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.806+0000 7ff7aed9d700 1 -- 172.21.15.49:0/4223604542 learned_addr learned my addr 172.21.15.49:0/4223604542 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:17.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.806+0000 7ff7ae59c700 1 --2- 172.21.15.49:0/4223604542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7b00aa1c0 0x7ff7b0144ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:17.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.806+0000 7ff7add9b700 1 --2- 172.21.15.49:0/4223604542 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff7b0154610 0x7ff7b00ab7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:17.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.806+0000 7ff7aed9d700 1 -- 172.21.15.49:0/4223604542 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff7b0154610 msgr2=0x7ff7b00ab7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:17.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.806+0000 7ff7aed9d700 1 --2- 172.21.15.49:0/4223604542 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff7b0154610 0x7ff7b00ab7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:17.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.806+0000 7ff7aed9d700 1 -- 172.21.15.49:0/4223604542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7b00aa1c0 msgr2=0x7ff7b0144ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:17.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.806+0000 7ff7aed9d700 1 --2- 172.21.15.49:0/4223604542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7b00aa1c0 0x7ff7b0144ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:17.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.806+0000 7ff7aed9d700 1 -- 172.21.15.49:0/4223604542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a0009ae0 con 0x7ff7b00abc90 2023-11-30T18:39:17.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.806+0000 7ff7ae59c700 1 --2- 172.21.15.49:0/4223604542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7b00aa1c0 0x7ff7b0144ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:39:17.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.806+0000 7ff7aed9d700 1 --2- 172.21.15.49:0/4223604542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b00abc90 0x7ff7b00ac0f0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7ff7b00cc2d0 tx=0x7ff7a0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:17.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.806+0000 7ff7a67fc700 1 -- 172.21.15.49:0/4223604542 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a000bdc0 con 0x7ff7b00abc90 2023-11-30T18:39:17.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.807+0000 7ff7a67fc700 1 -- 172.21.15.49:0/4223604542 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a001d460 con 0x7ff7b00abc90 2023-11-30T18:39:17.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.807+0000 7ff7b4da3700 1 -- 172.21.15.49:0/4223604542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b01552a0 con 0x7ff7b00abc90 2023-11-30T18:39:17.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.807+0000 7ff7a67fc700 1 -- 172.21.15.49:0/4223604542 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a001d820 con 0x7ff7b00abc90 2023-11-30T18:39:17.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.807+0000 7ff7b4da3700 1 -- 172.21.15.49:0/4223604542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b0155860 con 0x7ff7b00abc90 2023-11-30T18:39:17.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.807+0000 7ff7b4da3700 1 -- 172.21.15.49:0/4223604542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b0155d40 con 0x7ff7b00abc90 2023-11-30T18:39:17.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.808+0000 7ff7a67fc700 1 -- 172.21.15.49:0/4223604542 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 86) v1 ==== 75577+0+0 (secure 0 0 0) 0x7ff7a0003040 con 0x7ff7b00abc90 2023-11-30T18:39:17.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.809+0000 7ff7a67fc700 1 --2- 172.21.15.49:0/4223604542 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff79005f2c0 0x7ff790061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:17.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.809+0000 7ff7a67fc700 1 -- 172.21.15.49:0/4223604542 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6694+0+0 (secure 0 0 0) 0x7ff7a007c370 con 0x7ff7b00abc90 2023-11-30T18:39:17.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.809+0000 7ff7ae59c700 1 --2- 172.21.15.49:0/4223604542 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff79005f2c0 0x7ff790061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:17.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.810+0000 7ff7ae59c700 1 --2- 172.21.15.49:0/4223604542 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff79005f2c0 0x7ff790061780 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff7a8002660 tx=0x7ff7a8009040).ready entity=mgr.8920 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:17.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:17.812+0000 7ff7a67fc700 1 -- 172.21.15.49:0/4223604542 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff7a004d3f0 con 0x7ff7b00abc90 2023-11-30T18:39:18.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.013+0000 7ff7b4da3700 1 -- 172.21.15.49:0/4223604542 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff7b0158970 con 0x7ff79005f2c0 2023-11-30T18:39:18.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.015+0000 7ff7a67fc700 1 -- 172.21.15.49:0/4223604542 <== mgr.8920 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+361 (secure 0 0 0) 0x7ff7b0158970 con 0x7ff79005f2c0 2023-11-30T18:39:18.017 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:39:18.017 INFO:teuthology.orchestra.run.smithi049.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-11-30T00:00:00", "created": "2023-11-30T18:23:29", "first": "2023-11-30T18:24:00", "last": "2023-11-30T18:39:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-11-30T18:39:18.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.017+0000 7ff7b4da3700 1 -- 172.21.15.49:0/4223604542 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff79005f2c0 msgr2=0x7ff790061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:18.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.017+0000 7ff7b4da3700 1 --2- 172.21.15.49:0/4223604542 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff79005f2c0 0x7ff790061780 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff7a8002660 tx=0x7ff7a8009040).stop 2023-11-30T18:39:18.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.017+0000 7ff7b4da3700 1 -- 172.21.15.49:0/4223604542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b00abc90 msgr2=0x7ff7b00ac0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:18.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.017+0000 7ff7b4da3700 1 --2- 172.21.15.49:0/4223604542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b00abc90 0x7ff7b00ac0f0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7ff7b00cc2d0 tx=0x7ff7a0009840).stop 2023-11-30T18:39:18.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.017+0000 7ff7b4da3700 1 -- 172.21.15.49:0/4223604542 shutdown_connections 2023-11-30T18:39:18.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.017+0000 7ff7b4da3700 1 --2- 172.21.15.49:0/4223604542 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff79005f2c0 0x7ff790061780 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:18.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.017+0000 7ff7b4da3700 1 --2- 172.21.15.49:0/4223604542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b00abc90 0x7ff7b00ac0f0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:18.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.017+0000 7ff7b4da3700 1 --2- 172.21.15.49:0/4223604542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7b00aa1c0 0x7ff7b0144ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:18.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.017+0000 7ff7b4da3700 1 --2- 172.21.15.49:0/4223604542 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff7b0154610 0x7ff7b00ab7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:18.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.017+0000 7ff7b4da3700 1 -- 172.21.15.49:0/4223604542 >> 172.21.15.49:0/4223604542 conn(0x7ff7b00655a0 msgr2=0x7ff7b014e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:18.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.017+0000 7ff7b4da3700 1 -- 172.21.15.49:0/4223604542 shutdown_connections 2023-11-30T18:39:18.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.017+0000 7ff7b4da3700 1 -- 172.21.15.49:0/4223604542 wait complete. 2023-11-30T18:39:18.031 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-11-30T00:00:00", "created": "2023-11-30T18:23:29", "first": "2023-11-30T18:24:00", "last": "2023-11-30T18:39:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-11-30T18:39:18.031 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-11-30T00:00:00', 'created': '2023-11-30T18:23:29', 'first': '2023-11-30T18:24:00', 'last': '2023-11-30T18:39:00', 'last_pruned': None, 'created_count': 16, 'pruned_count': 0, 'active': False} 2023-11-30T18:39:18.031 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 16 2023-11-30T18:39:18.031 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 16 2023-11-30T18:39:18.031 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/test_restart 1M 2023-11-30T18:39:18.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.152+0000 7f804de67700 1 Processor -- start 2023-11-30T18:39:18.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.152+0000 7f804de67700 1 -- start start 2023-11-30T18:39:18.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.153+0000 7f804de67700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f804814ea80 0x7f804814ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:18.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.153+0000 7f804de67700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f80480bc660 0x7f80480bcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:18.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.153+0000 7f804de67700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80480bcfb0 con 0x7f8048062770 2023-11-30T18:39:18.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.153+0000 7f804de67700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80480640f0 con 0x7f80480bc660 2023-11-30T18:39:18.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.153+0000 7f804de67700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80480634e0 con 0x7f804814ea80 2023-11-30T18:39:18.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.153+0000 7f8046ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f80480bc660 0x7f80480bcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:18.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.153+0000 7f8046ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f80480bc660 0x7f80480bcac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34848/0 (socket says 172.21.15.49:34848) 2023-11-30T18:39:18.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.153+0000 7f8046ffd700 1 -- 172.21.15.49:0/3270274313 learned_addr learned my addr 172.21.15.49:0/3270274313 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:18.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.153+0000 7f80477fe700 1 --2- 172.21.15.49:0/3270274313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f804814ea80 0x7f804814ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:18.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.154+0000 7f8046ffd700 1 -- 172.21.15.49:0/3270274313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f804814ea80 msgr2=0x7f804814ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:18.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.154+0000 7f8046ffd700 1 --2- 172.21.15.49:0/3270274313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f804814ea80 0x7f804814ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:18.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.154+0000 7f8046ffd700 1 -- 172.21.15.49:0/3270274313 >> v1:172.21.15.115:6789/0 conn(0x7f8048062770 legacy=0x7f8048062c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:18.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.154+0000 7f8046ffd700 1 -- 172.21.15.49:0/3270274313 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80480637c0 con 0x7f80480bc660 2023-11-30T18:39:18.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.154+0000 7f80467fc700 1 -- 172.21.15.49:0/3270274313 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2810197949 0 0) 0x7f80480bcfb0 con 0x7f8048062770 2023-11-30T18:39:18.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.154+0000 7f8046ffd700 1 --2- 172.21.15.49:0/3270274313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80480bc660 0x7f80480bcac0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7f803c006fd0 tx=0x7f803c0090f0).ready entity=mon.0 client_cookie=62a1ec195ea0b7a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:18.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.154+0000 7f80467fc700 1 -- 172.21.15.49:0/3270274313 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c00b580 con 0x7f80480bc660 2023-11-30T18:39:18.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.154+0000 7f80467fc700 1 -- 172.21.15.49:0/3270274313 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803c00b6e0 con 0x7f80480bc660 2023-11-30T18:39:18.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.154+0000 7f80467fc700 1 -- 172.21.15.49:0/3270274313 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c00ba80 con 0x7f80480bc660 2023-11-30T18:39:18.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.154+0000 7f804de67700 1 -- 172.21.15.49:0/3270274313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80480bc660 msgr2=0x7f80480bcac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:18.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.154+0000 7f804de67700 1 --2- 172.21.15.49:0/3270274313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80480bc660 0x7f80480bcac0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7f803c006fd0 tx=0x7f803c0090f0).stop 2023-11-30T18:39:18.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.154+0000 7f804de67700 1 -- 172.21.15.49:0/3270274313 shutdown_connections 2023-11-30T18:39:18.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.154+0000 7f804de67700 1 --2- 172.21.15.49:0/3270274313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f804814ea80 0x7f804814ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:18.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.154+0000 7f804de67700 1 --2- 172.21.15.49:0/3270274313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80480bc660 0x7f80480bcac0 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:18.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.154+0000 7f804de67700 1 -- 172.21.15.49:0/3270274313 >> 172.21.15.49:0/3270274313 conn(0x7f80480c8170 msgr2=0x7f80480c41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:18.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.154+0000 7f804de67700 1 -- 172.21.15.49:0/3270274313 shutdown_connections 2023-11-30T18:39:18.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.154+0000 7f804de67700 1 -- 172.21.15.49:0/3270274313 wait complete. 2023-11-30T18:39:18.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.156+0000 7f804de67700 1 Processor -- start 2023-11-30T18:39:18.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.156+0000 7f804de67700 1 -- start start 2023-11-30T18:39:18.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.156+0000 7f804de67700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8048062770 0x7f80480a81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:18.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.156+0000 7f804de67700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80480bc660 0x7f8048137370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:18.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.156+0000 7f804de67700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f804814ea80 0x7f80480a8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:18.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.156+0000 7f804de67700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80480a71c0 con 0x7f80480bc660 2023-11-30T18:39:18.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.156+0000 7f804de67700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80480a7410 con 0x7f8048062770 2023-11-30T18:39:18.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.156+0000 7f804de67700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80480a76f0 con 0x7f804814ea80 2023-11-30T18:39:18.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.157+0000 7f8046ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80480bc660 0x7f8048137370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:18.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.157+0000 7f8046ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80480bc660 0x7f8048137370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34864/0 (socket says 172.21.15.49:34864) 2023-11-30T18:39:18.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.157+0000 7f8046ffd700 1 -- 172.21.15.49:0/1350439499 learned_addr learned my addr 172.21.15.49:0/1350439499 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:18.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.157+0000 7f80477fe700 1 --2- 172.21.15.49:0/1350439499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8048062770 0x7f80480a81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:18.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.157+0000 7f8047fff700 1 --2- 172.21.15.49:0/1350439499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f804814ea80 0x7f80480a8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:18.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.157+0000 7f8046ffd700 1 -- 172.21.15.49:0/1350439499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f804814ea80 msgr2=0x7f80480a8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:18.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.157+0000 7f8046ffd700 1 --2- 172.21.15.49:0/1350439499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f804814ea80 0x7f80480a8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:18.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.157+0000 7f8046ffd700 1 -- 172.21.15.49:0/1350439499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8048062770 msgr2=0x7f80480a81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:18.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.157+0000 7f8046ffd700 1 --2- 172.21.15.49:0/1350439499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8048062770 0x7f80480a81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:18.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.157+0000 7f8046ffd700 1 -- 172.21.15.49:0/1350439499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803c009370 con 0x7f80480bc660 2023-11-30T18:39:18.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.157+0000 7f80477fe700 1 --2- 172.21.15.49:0/1350439499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8048062770 0x7f80480a81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:39:18.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.157+0000 7f8046ffd700 1 --2- 172.21.15.49:0/1350439499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80480bc660 0x7f8048137370 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 rx=0x7f804806c490 tx=0x7f803c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:18.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.157+0000 7f802f7fe700 1 -- 172.21.15.49:0/1350439499 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c006d90 con 0x7f80480bc660 2023-11-30T18:39:18.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.157+0000 7f802f7fe700 1 -- 172.21.15.49:0/1350439499 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803c00be40 con 0x7f80480bc660 2023-11-30T18:39:18.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.157+0000 7f804de67700 1 -- 172.21.15.49:0/1350439499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80480a79d0 con 0x7f80480bc660 2023-11-30T18:39:18.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.157+0000 7f802f7fe700 1 -- 172.21.15.49:0/1350439499 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c01c420 con 0x7f80480bc660 2023-11-30T18:39:18.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.157+0000 7f804de67700 1 -- 172.21.15.49:0/1350439499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8048137860 con 0x7f80480bc660 2023-11-30T18:39:18.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.158+0000 7f804de67700 1 -- 172.21.15.49:0/1350439499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80480a7e70 con 0x7f80480bc660 2023-11-30T18:39:18.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.159+0000 7f802f7fe700 1 -- 172.21.15.49:0/1350439499 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 86) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f803c01c810 con 0x7f80480bc660 2023-11-30T18:39:18.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.159+0000 7f802f7fe700 1 --2- 172.21.15.49:0/1350439499 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f803405f2c0 0x7f8034061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:18.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.159+0000 7f802f7fe700 1 -- 172.21.15.49:0/1350439499 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6694+0+0 (secure 0 0 0) 0x7f803c07bf80 con 0x7f80480bc660 2023-11-30T18:39:18.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.159+0000 7f80477fe700 1 --2- 172.21.15.49:0/1350439499 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f803405f2c0 0x7f8034061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:18.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.160+0000 7f80477fe700 1 --2- 172.21.15.49:0/1350439499 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f803405f2c0 0x7f8034061780 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f8038011310 tx=0x7f8038009060).ready entity=mgr.8920 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:18.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.163+0000 7f802f7fe700 1 -- 172.21.15.49:0/1350439499 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f803c0aab00 con 0x7f80480bc660 2023-11-30T18:39:18.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.364+0000 7f804de67700 1 -- 172.21.15.49:0/1350439499 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f804806c860 con 0x7f803405f2c0 2023-11-30T18:39:18.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.368+0000 7f802f7fe700 1 -- 172.21.15.49:0/1350439499 <== mgr.8920 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+55 (secure 0 0 0) 0x7f804806c860 con 0x7f803405f2c0 2023-11-30T18:39:18.370 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule removed for path /snap_test_dir1/test_restart 2023-11-30T18:39:18.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.370+0000 7f804de67700 1 -- 172.21.15.49:0/1350439499 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f803405f2c0 msgr2=0x7f8034061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:18.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.370+0000 7f804de67700 1 --2- 172.21.15.49:0/1350439499 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f803405f2c0 0x7f8034061780 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f8038011310 tx=0x7f8038009060).stop 2023-11-30T18:39:18.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.370+0000 7f804de67700 1 -- 172.21.15.49:0/1350439499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80480bc660 msgr2=0x7f8048137370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:18.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.370+0000 7f804de67700 1 --2- 172.21.15.49:0/1350439499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80480bc660 0x7f8048137370 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 rx=0x7f804806c490 tx=0x7f803c017000).stop 2023-11-30T18:39:18.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.370+0000 7f804de67700 1 -- 172.21.15.49:0/1350439499 shutdown_connections 2023-11-30T18:39:18.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.370+0000 7f804de67700 1 --2- 172.21.15.49:0/1350439499 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f803405f2c0 0x7f8034061780 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:18.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.370+0000 7f804de67700 1 --2- 172.21.15.49:0/1350439499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f804814ea80 0x7f80480a8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:18.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.370+0000 7f804de67700 1 --2- 172.21.15.49:0/1350439499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8048062770 0x7f80480a81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:18.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.370+0000 7f804de67700 1 --2- 172.21.15.49:0/1350439499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80480bc660 0x7f8048137370 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:18.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.370+0000 7f804de67700 1 -- 172.21.15.49:0/1350439499 >> 172.21.15.49:0/1350439499 conn(0x7f80480c8170 msgr2=0x7f80480c39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:18.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.370+0000 7f804de67700 1 -- 172.21.15.49:0/1350439499 shutdown_connections 2023-11-30T18:39:18.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:18.370+0000 7f804de67700 1 -- 172.21.15.49:0/1350439499 wait complete. 2023-11-30T18:39:18.384 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/test_restart 2023-11-30T18:39:18.384 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:39:18.384 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-11-30T18:39:18.400 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_24_00_UTC 2023-11-30T18:39:18.400 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_25_00_UTC 2023-11-30T18:39:18.400 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_26_00_UTC 2023-11-30T18:39:18.400 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_27_00_UTC 2023-11-30T18:39:18.400 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_28_00_UTC 2023-11-30T18:39:18.400 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_29_00_UTC 2023-11-30T18:39:18.400 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_30_00_UTC 2023-11-30T18:39:18.400 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_31_00_UTC 2023-11-30T18:39:18.400 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_32_00_UTC 2023-11-30T18:39:18.400 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_33_00_UTC 2023-11-30T18:39:18.401 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_34_00_UTC 2023-11-30T18:39:18.401 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_35_00_UTC 2023-11-30T18:39:18.401 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_36_00_UTC 2023-11-30T18:39:18.401 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_37_00_UTC 2023-11-30T18:39:18.401 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_38_00_UTC 2023-11-30T18:39:18.401 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_39_00_UTC 2023-11-30T18:39:18.401 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_24_00_UTC 2023-11-30T18:39:18.401 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:39:18.401 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_24_00_UTC) 2023-11-30T18:39:18.461 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_25_00_UTC 2023-11-30T18:39:18.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:39:18.461 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_25_00_UTC) 2023-11-30T18:39:18.522 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_26_00_UTC 2023-11-30T18:39:18.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:39:18.522 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_26_00_UTC) 2023-11-30T18:39:18.582 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_27_00_UTC 2023-11-30T18:39:18.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:39:18.582 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_27_00_UTC) 2023-11-30T18:39:18.643 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_28_00_UTC 2023-11-30T18:39:18.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:39:18.644 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_28_00_UTC) 2023-11-30T18:39:18.704 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_29_00_UTC 2023-11-30T18:39:18.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:39:18.704 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_29_00_UTC) 2023-11-30T18:39:18.766 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_30_00_UTC 2023-11-30T18:39:18.766 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:39:18.766 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_30_00_UTC) 2023-11-30T18:39:18.826 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_31_00_UTC 2023-11-30T18:39:18.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:39:18.826 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_31_00_UTC) 2023-11-30T18:39:18.886 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_32_00_UTC 2023-11-30T18:39:18.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:39:18.886 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_32_00_UTC) 2023-11-30T18:39:18.948 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_33_00_UTC 2023-11-30T18:39:18.948 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:39:18.949 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_33_00_UTC) 2023-11-30T18:39:19.009 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_34_00_UTC 2023-11-30T18:39:19.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:39:19.010 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_34_00_UTC) 2023-11-30T18:39:19.070 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_35_00_UTC 2023-11-30T18:39:19.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:39:19.070 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_35_00_UTC) 2023-11-30T18:39:19.130 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_36_00_UTC 2023-11-30T18:39:19.130 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:39:19.130 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_36_00_UTC) 2023-11-30T18:39:19.194 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_37_00_UTC 2023-11-30T18:39:19.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:39:19.195 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_37_00_UTC) 2023-11-30T18:39:19.256 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_38_00_UTC 2023-11-30T18:39:19.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:39:19.256 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_38_00_UTC) 2023-11-30T18:39:19.317 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_39_00_UTC 2023-11-30T18:39:19.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:39:19.318 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-30-18_39_00_UTC) 2023-11-30T18:39:19.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:39:19.379 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart) 2023-11-30T18:39:19.436 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-11-30T18:39:19.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.592+0000 7f64f06e3700 1 Processor -- start 2023-11-30T18:39:19.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.592+0000 7f64f06e3700 1 -- start start 2023-11-30T18:39:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.593+0000 7f64f06e3700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f64e80c42e0 0x7f64e80c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.593+0000 7f64f06e3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f64e80a6300 0x7f64e80c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.593+0000 7f64f06e3700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e80c7e90 con 0x7f64e80a5e70 2023-11-30T18:39:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.593+0000 7f64f06e3700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e80c7280 con 0x7f64e80a6300 2023-11-30T18:39:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.593+0000 7f64f06e3700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e80c7560 con 0x7f64e80c42e0 2023-11-30T18:39:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.593+0000 7f64eec80700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f64e80a6300 0x7f64e80c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.593+0000 7f64eec80700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f64e80a6300 0x7f64e80c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34880/0 (socket says 172.21.15.49:34880) 2023-11-30T18:39:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.593+0000 7f64eec80700 1 -- 172.21.15.49:0/2853184082 learned_addr learned my addr 172.21.15.49:0/2853184082 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.594+0000 7f64ee47f700 1 --2- 172.21.15.49:0/2853184082 >> v2:172.21.15.115:3300/0 conn(0x7f64e80c42e0 0x7f64e80c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.594+0000 7f64eec80700 1 -- 172.21.15.49:0/2853184082 >> v2:172.21.15.115:3300/0 conn(0x7f64e80c42e0 msgr2=0x7f64e80c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.594+0000 7f64eec80700 1 --2- 172.21.15.49:0/2853184082 >> v2:172.21.15.115:3300/0 conn(0x7f64e80c42e0 0x7f64e80c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.594+0000 7f64eec80700 1 -- 172.21.15.49:0/2853184082 >> v1:172.21.15.115:6789/0 conn(0x7f64e80a5e70 legacy=0x7f64e80c8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:19.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.594+0000 7f64eec80700 1 -- 172.21.15.49:0/2853184082 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e80c7840 con 0x7f64e80a6300 2023-11-30T18:39:19.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.594+0000 7f64eec80700 1 --2- 172.21.15.49:0/2853184082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64e80a6300 0x7f64e80c8a30 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7f64e80c6eb0 tx=0x7f64e00090f0).ready entity=mon.0 client_cookie=564cdaf3c64385a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:19.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.594+0000 7f64ed47d700 1 -- 172.21.15.49:0/2853184082 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e000b5a0 con 0x7f64e80a6300 2023-11-30T18:39:19.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.594+0000 7f64ed47d700 1 -- 172.21.15.49:0/2853184082 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e000b700 con 0x7f64e80a6300 2023-11-30T18:39:19.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.594+0000 7f64ed47d700 1 -- 172.21.15.49:0/2853184082 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e000ba80 con 0x7f64e80a6300 2023-11-30T18:39:19.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.595+0000 7f64f06e3700 1 -- 172.21.15.49:0/2853184082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64e80a6300 msgr2=0x7f64e80c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:19.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.595+0000 7f64f06e3700 1 --2- 172.21.15.49:0/2853184082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64e80a6300 0x7f64e80c8a30 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7f64e80c6eb0 tx=0x7f64e00090f0).stop 2023-11-30T18:39:19.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.595+0000 7f64f06e3700 1 -- 172.21.15.49:0/2853184082 shutdown_connections 2023-11-30T18:39:19.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.595+0000 7f64f06e3700 1 --2- 172.21.15.49:0/2853184082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64e80a6300 0x7f64e80c8a30 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:19.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.595+0000 7f64f06e3700 1 --2- 172.21.15.49:0/2853184082 >> v2:172.21.15.115:3300/0 conn(0x7f64e80c42e0 0x7f64e80c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:19.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.595+0000 7f64f06e3700 1 -- 172.21.15.49:0/2853184082 >> 172.21.15.49:0/2853184082 conn(0x7f64e8083000 msgr2=0x7f64e80c90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:19.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.595+0000 7f64f06e3700 1 -- 172.21.15.49:0/2853184082 shutdown_connections 2023-11-30T18:39:19.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.595+0000 7f64f06e3700 1 -- 172.21.15.49:0/2853184082 wait complete. 2023-11-30T18:39:19.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.596+0000 7f64f06e3700 1 Processor -- start 2023-11-30T18:39:19.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.596+0000 7f64f06e3700 1 -- start start 2023-11-30T18:39:19.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.597+0000 7f64f06e3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64e80a5e70 0x7f64e8096b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:19.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.597+0000 7f64f06e3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64e80a6300 0x7f64e80be850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:19.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.597+0000 7f64f06e3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64e80c42e0 0x7f64e8144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:19.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.597+0000 7f64f06e3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e8093ee0 con 0x7f64e80a6300 2023-11-30T18:39:19.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.597+0000 7f64f06e3700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e80bed40 con 0x7f64e80c42e0 2023-11-30T18:39:19.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.597+0000 7f64f06e3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e8166610 con 0x7f64e80a5e70 2023-11-30T18:39:19.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.597+0000 7f64edc7e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64e80a6300 0x7f64e80be850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:19.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.597+0000 7f64edc7e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64e80a6300 0x7f64e80be850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34892/0 (socket says 172.21.15.49:34892) 2023-11-30T18:39:19.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.597+0000 7f64edc7e700 1 -- 172.21.15.49:0/2110709269 learned_addr learned my addr 172.21.15.49:0/2110709269 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:19.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.597+0000 7f64eec80700 1 --2- 172.21.15.49:0/2110709269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64e80c42e0 0x7f64e8144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:19.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.597+0000 7f64ee47f700 1 --2- 172.21.15.49:0/2110709269 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64e80a5e70 0x7f64e8096b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:19.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.597+0000 7f64edc7e700 1 -- 172.21.15.49:0/2110709269 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64e80a5e70 msgr2=0x7f64e8096b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:19.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.597+0000 7f64edc7e700 1 --2- 172.21.15.49:0/2110709269 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64e80a5e70 0x7f64e8096b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:19.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.597+0000 7f64edc7e700 1 -- 172.21.15.49:0/2110709269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64e80c42e0 msgr2=0x7f64e8144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:19.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.597+0000 7f64edc7e700 1 --2- 172.21.15.49:0/2110709269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64e80c42e0 0x7f64e8144ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:19.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.597+0000 7f64edc7e700 1 -- 172.21.15.49:0/2110709269 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e0009370 con 0x7f64e80a6300 2023-11-30T18:39:19.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.597+0000 7f64edc7e700 1 --2- 172.21.15.49:0/2110709269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64e80a6300 0x7f64e80be850 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7f64dc00c440 tx=0x7f64dc007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:19.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.597+0000 7f64e67fc700 1 -- 172.21.15.49:0/2110709269 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc012400 con 0x7f64e80a6300 2023-11-30T18:39:19.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.597+0000 7f64e67fc700 1 -- 172.21.15.49:0/2110709269 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64dc012580 con 0x7f64e80a6300 2023-11-30T18:39:19.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.597+0000 7f64f06e3700 1 -- 172.21.15.49:0/2110709269 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e8094130 con 0x7f64e80a6300 2023-11-30T18:39:19.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.597+0000 7f64e67fc700 1 -- 172.21.15.49:0/2110709269 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc012940 con 0x7f64e80a6300 2023-11-30T18:39:19.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.598+0000 7f64f06e3700 1 -- 172.21.15.49:0/2110709269 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e80946f0 con 0x7f64e80a6300 2023-11-30T18:39:19.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.599+0000 7f64f06e3700 1 -- 172.21.15.49:0/2110709269 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e806c830 con 0x7f64e80a6300 2023-11-30T18:39:19.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.599+0000 7f64e67fc700 1 -- 172.21.15.49:0/2110709269 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 86) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f64dc012d30 con 0x7f64e80a6300 2023-11-30T18:39:19.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.599+0000 7f64e67fc700 1 --2- 172.21.15.49:0/2110709269 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f64d405f2c0 0x7f64d4061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:19.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.599+0000 7f64e67fc700 1 -- 172.21.15.49:0/2110709269 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6694+0+0 (secure 0 0 0) 0x7f64dc0799b0 con 0x7f64e80a6300 2023-11-30T18:39:19.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.599+0000 7f64ee47f700 1 --2- 172.21.15.49:0/2110709269 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f64d405f2c0 0x7f64d4061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:19.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.600+0000 7f64ee47f700 1 --2- 172.21.15.49:0/2110709269 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f64d405f2c0 0x7f64d4061780 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f64e8067e00 tx=0x7f64d8009830).ready entity=mgr.8920 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:19.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.603+0000 7f64e67fc700 1 -- 172.21.15.49:0/2110709269 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f64dc048b00 con 0x7f64e80a6300 2023-11-30T18:39:19.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:19.822+0000 7f64f06e3700 1 -- 172.21.15.49:0/2110709269 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f64e80c7b20 con 0x7f64e80a6300 2023-11-30T18:39:20.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.304+0000 7f64e67fc700 1 -- 172.21.15.49:0/2110709269 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 87) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f64dc0773c0 con 0x7f64e80a6300 2023-11-30T18:39:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.306+0000 7f64e67fc700 1 -- 172.21.15.49:0/2110709269 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v87) v1 ==== 93+0+0 (secure 0 0 0) 0x7f64dc074ae0 con 0x7f64e80a6300 2023-11-30T18:39:20.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.308+0000 7f64f06e3700 1 -- 172.21.15.49:0/2110709269 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f64d405f2c0 msgr2=0x7f64d4061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:20.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.308+0000 7f64f06e3700 1 --2- 172.21.15.49:0/2110709269 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f64d405f2c0 0x7f64d4061780 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f64e8067e00 tx=0x7f64d8009830).stop 2023-11-30T18:39:20.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.308+0000 7f64f06e3700 1 -- 172.21.15.49:0/2110709269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64e80a6300 msgr2=0x7f64e80be850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:20.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.308+0000 7f64f06e3700 1 --2- 172.21.15.49:0/2110709269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64e80a6300 0x7f64e80be850 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7f64dc00c440 tx=0x7f64dc007de0).stop 2023-11-30T18:39:20.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.308+0000 7f64f06e3700 1 -- 172.21.15.49:0/2110709269 shutdown_connections 2023-11-30T18:39:20.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.308+0000 7f64f06e3700 1 --2- 172.21.15.49:0/2110709269 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f64d405f2c0 0x7f64d4061780 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:20.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.308+0000 7f64f06e3700 1 --2- 172.21.15.49:0/2110709269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64e80c42e0 0x7f64e8144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:20.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.308+0000 7f64f06e3700 1 --2- 172.21.15.49:0/2110709269 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64e80a5e70 0x7f64e8096b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:20.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.308+0000 7f64f06e3700 1 --2- 172.21.15.49:0/2110709269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64e80a6300 0x7f64e80be850 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:20.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.308+0000 7f64f06e3700 1 -- 172.21.15.49:0/2110709269 >> 172.21.15.49:0/2110709269 conn(0x7f64e8083000 msgr2=0x7f64e8068350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:20.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.308+0000 7f64f06e3700 1 -- 172.21.15.49:0/2110709269 shutdown_connections 2023-11-30T18:39:20.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.308+0000 7f64f06e3700 1 -- 172.21.15.49:0/2110709269 wait complete. 2023-11-30T18:39:20.324 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-30T18:39:20.324 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T18:39:20.368 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T18:39:20.406 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-30T18:39:20.406 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-30T18:39:20.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:39:20.407 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-30T18:39:20.448 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-11-30T18:39:20.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:39:20.449 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-30T18:39:20.454 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:20.452+0000 7feb1808a680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T18:39:20.457 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:20.457+0000 7fca4d395680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T18:39:20.468 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:39:20.520 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:20.518+0000 7feb1808a680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T18:39:20.520 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:20.519+0000 7fca4d395680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T18:39:20.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.628+0000 7f3c48bd6700 1 Processor -- start 2023-11-30T18:39:20.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.628+0000 7f3c48bd6700 1 -- start start 2023-11-30T18:39:20.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.629+0000 7f3c48bd6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3c441548c0 0x7f3c4406a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:20.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.629+0000 7f3c48bd6700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c440c69a0 con 0x7f3c440c6e30 2023-11-30T18:39:20.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.629+0000 7f3c48bd6700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c440c13a0 con 0x7f3c441544e0 2023-11-30T18:39:20.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.629+0000 7f3c48bd6700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c440c1680 con 0x7f3c441548c0 2023-11-30T18:39:20.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.629+0000 7f3c41d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3c441548c0 0x7f3c4406a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:20.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.629+0000 7f3c41d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3c441548c0 0x7f3c4406a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38764/0 (socket says 172.21.15.49:38764) 2023-11-30T18:39:20.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.629+0000 7f3c42d9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3c440c6e30 0x7f3c440a8000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46034/0 (socket says 172.21.15.49:46034) 2023-11-30T18:39:20.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.629+0000 7f3c41d9b700 1 -- 172.21.15.49:0/188498949 learned_addr learned my addr 172.21.15.49:0/188498949 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:20.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.629+0000 7f3c41d9b700 1 -- 172.21.15.49:0/188498949 >> v1:172.21.15.115:6789/0 conn(0x7f3c441544e0 legacy=0x7f3c440c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:20.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.629+0000 7f3c41d9b700 1 -- 172.21.15.49:0/188498949 >> v1:172.21.15.49:6789/0 conn(0x7f3c440c6e30 legacy=0x7f3c440a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:20.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.629+0000 7f3c41d9b700 1 -- 172.21.15.49:0/188498949 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c440c6630 con 0x7f3c441548c0 2023-11-30T18:39:20.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.629+0000 7f3c4159a700 1 -- 172.21.15.49:0/188498949 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3199903172 0 0) 0x7f3c440c69a0 con 0x7f3c440c6e30 2023-11-30T18:39:20.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.630+0000 7f3c41d9b700 1 --2- 172.21.15.49:0/188498949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c441548c0 0x7f3c4406a610 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f3c38006fd0 tx=0x7f3c380090f0).ready entity=mon.0 client_cookie=d51442b876031de3 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:20.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.630+0000 7f3c4159a700 1 -- 172.21.15.49:0/188498949 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3800b600 con 0x7f3c441548c0 2023-11-30T18:39:20.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.630+0000 7f3c4159a700 1 -- 172.21.15.49:0/188498949 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3800b760 con 0x7f3c441548c0 2023-11-30T18:39:20.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.630+0000 7f3c4159a700 1 -- 172.21.15.49:0/188498949 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3800bae0 con 0x7f3c441548c0 2023-11-30T18:39:20.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.630+0000 7f3c48bd6700 1 -- 172.21.15.49:0/188498949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c441548c0 msgr2=0x7f3c4406a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:20.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.630+0000 7f3c48bd6700 1 --2- 172.21.15.49:0/188498949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c441548c0 0x7f3c4406a610 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f3c38006fd0 tx=0x7f3c380090f0).stop 2023-11-30T18:39:20.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.630+0000 7f3c48bd6700 1 -- 172.21.15.49:0/188498949 shutdown_connections 2023-11-30T18:39:20.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.630+0000 7f3c48bd6700 1 --2- 172.21.15.49:0/188498949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c441548c0 0x7f3c4406a610 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:20.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.630+0000 7f3c48bd6700 1 -- 172.21.15.49:0/188498949 >> 172.21.15.49:0/188498949 conn(0x7f3c44085020 msgr2=0x7f3c44094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:20.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.630+0000 7f3c48bd6700 1 -- 172.21.15.49:0/188498949 shutdown_connections 2023-11-30T18:39:20.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.630+0000 7f3c48bd6700 1 -- 172.21.15.49:0/188498949 wait complete. 2023-11-30T18:39:20.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.631+0000 7f3c48bd6700 1 Processor -- start 2023-11-30T18:39:20.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.632+0000 7f3c48bd6700 1 -- start start 2023-11-30T18:39:20.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.632+0000 7f3c48bd6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c440c6e30 0x7f3c44152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:20.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.632+0000 7f3c48bd6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c441544e0 0x7f3c440c4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:20.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.632+0000 7f3c48bd6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c441548c0 0x7f3c440c4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:20.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.632+0000 7f3c48bd6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c440c4e60 con 0x7f3c441544e0 2023-11-30T18:39:20.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.632+0000 7f3c48bd6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c44097d50 con 0x7f3c440c6e30 2023-11-30T18:39:20.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.632+0000 7f3c48bd6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c44098030 con 0x7f3c441548c0 2023-11-30T18:39:20.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.632+0000 7f3c41d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c441544e0 0x7f3c440c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:20.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.632+0000 7f3c41d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c441544e0 0x7f3c440c4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38772/0 (socket says 172.21.15.49:38772) 2023-11-30T18:39:20.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.632+0000 7f3c41d9b700 1 -- 172.21.15.49:0/2774811376 learned_addr learned my addr 172.21.15.49:0/2774811376 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:20.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.632+0000 7f3c4259c700 1 --2- 172.21.15.49:0/2774811376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c440c6e30 0x7f3c44152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:20.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.633+0000 7f3c42d9d700 1 --2- 172.21.15.49:0/2774811376 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c441548c0 0x7f3c440c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:20.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.633+0000 7f3c41d9b700 1 -- 172.21.15.49:0/2774811376 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c441548c0 msgr2=0x7f3c440c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:20.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.633+0000 7f3c41d9b700 1 --2- 172.21.15.49:0/2774811376 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c441548c0 0x7f3c440c4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:20.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.633+0000 7f3c41d9b700 1 -- 172.21.15.49:0/2774811376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c440c6e30 msgr2=0x7f3c44152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:20.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.633+0000 7f3c41d9b700 1 --2- 172.21.15.49:0/2774811376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c440c6e30 0x7f3c44152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:20.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.633+0000 7f3c41d9b700 1 -- 172.21.15.49:0/2774811376 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c38009370 con 0x7f3c441544e0 2023-11-30T18:39:20.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.633+0000 7f3c41d9b700 1 --2- 172.21.15.49:0/2774811376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c441544e0 0x7f3c440c4480 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7f3c4405fb30 tx=0x7f3c38017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:20.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.633+0000 7f3c327fc700 1 -- 172.21.15.49:0/2774811376 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3800b8d0 con 0x7f3c441544e0 2023-11-30T18:39:20.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.633+0000 7f3c327fc700 1 -- 172.21.15.49:0/2774811376 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3800ba30 con 0x7f3c441544e0 2023-11-30T18:39:20.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.633+0000 7f3c48bd6700 1 -- 172.21.15.49:0/2774811376 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c44098310 con 0x7f3c441544e0 2023-11-30T18:39:20.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.633+0000 7f3c327fc700 1 -- 172.21.15.49:0/2774811376 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3801d680 con 0x7f3c441544e0 2023-11-30T18:39:20.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.633+0000 7f3c48bd6700 1 -- 172.21.15.49:0/2774811376 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c440988d0 con 0x7f3c441544e0 2023-11-30T18:39:20.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.634+0000 7f3c48bd6700 1 -- 172.21.15.49:0/2774811376 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c4406a900 con 0x7f3c441544e0 2023-11-30T18:39:20.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.634+0000 7f3c327fc700 1 -- 172.21.15.49:0/2774811376 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 87) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f3c3801da30 con 0x7f3c441544e0 2023-11-30T18:39:20.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.635+0000 7f3c327fc700 1 --2- 172.21.15.49:0/2774811376 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f3c2405f270 0x7f3c24061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:20.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.635+0000 7f3c4259c700 1 -- 172.21.15.49:0/2774811376 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f3c2405f270 msgr2=0x7f3c24061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:39:20.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.635+0000 7f3c327fc700 1 -- 172.21.15.49:0/2774811376 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6694+0+0 (secure 0 0 0) 0x7f3c3807c2f0 con 0x7f3c441544e0 2023-11-30T18:39:20.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.635+0000 7f3c4259c700 1 --2- 172.21.15.49:0/2774811376 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f3c2405f270 0x7f3c24061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:39:20.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.639+0000 7f3c327fc700 1 -- 172.21.15.49:0/2774811376 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3c3804d200 con 0x7f3c441544e0 2023-11-30T18:39:20.794 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:20.793+0000 7fca4d395680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T18:39:20.812 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:20.810+0000 7feb1808a680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T18:39:20.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.836+0000 7f3c4259c700 1 -- 172.21.15.49:0/2774811376 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f3c2405f270 msgr2=0x7f3c24061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:39:20.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.836+0000 7f3c4259c700 1 --2- 172.21.15.49:0/2774811376 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f3c2405f270 0x7f3c24061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T18:39:20.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.855+0000 7f3c48bd6700 1 -- 172.21.15.49:0/2774811376 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c4406c860 con 0x7f3c441544e0 2023-11-30T18:39:20.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.855+0000 7f3c327fc700 1 -- 172.21.15.49:0/2774811376 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4499 (secure 0 0 0) 0x7f3c38021090 con 0x7f3c441544e0 2023-11-30T18:39:20.857 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:39:20.857 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":77,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1849144206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1849144206},{"type":"v1","addr":"172.21.15.115:6837","nonce":1849144206}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":8686,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/3927708641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3927708641},{"type":"v1","addr":"172.21.15.115:6836","nonce":3927708641}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":8934,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3388701250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3388701250},{"type":"v1","addr":"172.21.15.49:6835","nonce":3388701250}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T18:23:12.095964+0000","modified":"2023-11-30T18:23:15.119579+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8937},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8937":{"gid":8937,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/3993546381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3993546381},{"type":"v1","addr":"172.21.15.49:6834","nonce":3993546381}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-11-30T18:39:20.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.857+0000 7f3c48bd6700 1 -- 172.21.15.49:0/2774811376 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f3c2405f270 msgr2=0x7f3c24061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:39:20.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.857+0000 7f3c48bd6700 1 --2- 172.21.15.49:0/2774811376 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f3c2405f270 0x7f3c24061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:39:20.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.857+0000 7f3c48bd6700 1 -- 172.21.15.49:0/2774811376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c441544e0 msgr2=0x7f3c440c4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:20.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.857+0000 7f3c48bd6700 1 --2- 172.21.15.49:0/2774811376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c441544e0 0x7f3c440c4480 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7f3c4405fb30 tx=0x7f3c38017000).stop 2023-11-30T18:39:20.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.857+0000 7f3c48bd6700 1 -- 172.21.15.49:0/2774811376 shutdown_connections 2023-11-30T18:39:20.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.857+0000 7f3c48bd6700 1 --2- 172.21.15.49:0/2774811376 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f3c2405f270 0x7f3c24061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:39:20.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.857+0000 7f3c48bd6700 1 --2- 172.21.15.49:0/2774811376 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c441548c0 0x7f3c440c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:20.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.857+0000 7f3c48bd6700 1 --2- 172.21.15.49:0/2774811376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c440c6e30 0x7f3c44152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:20.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.858+0000 7f3c48bd6700 1 --2- 172.21.15.49:0/2774811376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c441544e0 0x7f3c440c4480 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:20.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.858+0000 7f3c48bd6700 1 -- 172.21.15.49:0/2774811376 >> 172.21.15.49:0/2774811376 conn(0x7f3c44085020 msgr2=0x7f3c440ca560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:20.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.858+0000 7f3c48bd6700 1 -- 172.21.15.49:0/2774811376 shutdown_connections 2023-11-30T18:39:20.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:20.858+0000 7f3c48bd6700 1 -- 172.21.15.49:0/2774811376 wait complete. 2023-11-30T18:39:20.861 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 77 2023-11-30T18:39:20.872 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:39:21.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.030+0000 7effbbc34700 1 Processor -- start 2023-11-30T18:39:21.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.030+0000 7effbbc34700 1 -- start start 2023-11-30T18:39:21.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.031+0000 7effbbc34700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effb4068090 0x7effb40c2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:21.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.031+0000 7effbbc34700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb40a7490 con 0x7effb4067cb0 2023-11-30T18:39:21.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.031+0000 7effbbc34700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb4154d20 con 0x7effb40c45d0 2023-11-30T18:39:21.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.031+0000 7effbbc34700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb4151670 con 0x7effb4068090 2023-11-30T18:39:21.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.032+0000 7effb99d0700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7effb4067cb0 0x7effb40c3ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46038/0 (socket says 172.21.15.49:46038) 2023-11-30T18:39:21.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.032+0000 7effb99d0700 1 -- 172.21.15.49:0/2076687638 learned_addr learned my addr 172.21.15.49:0/2076687638 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:21.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.032+0000 7effba1d1700 1 --2- 172.21.15.49:0/2076687638 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effb4068090 0x7effb40c2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:21.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.032+0000 7effb89ce700 1 -- 172.21.15.49:0/2076687638 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973067121 0 0) 0x7effa4001110 con 0x7effb4067cb0 2023-11-30T18:39:21.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.032+0000 7effb89ce700 1 -- 172.21.15.49:0/2076687638 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effa00033f0 con 0x7effb4067cb0 2023-11-30T18:39:21.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.032+0000 7effb89ce700 1 -- 172.21.15.49:0/2076687638 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193663654 0 0) 0x7effb4154d20 con 0x7effb40c45d0 2023-11-30T18:39:21.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.032+0000 7effb89ce700 1 -- 172.21.15.49:0/2076687638 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effa4001110 con 0x7effb40c45d0 2023-11-30T18:39:21.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.032+0000 7effba1d1700 1 -- 172.21.15.49:0/2076687638 >> v1:172.21.15.115:6789/0 conn(0x7effb40c45d0 legacy=0x7effb40c2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:21.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.032+0000 7effba1d1700 1 -- 172.21.15.49:0/2076687638 >> v1:172.21.15.49:6789/0 conn(0x7effb4067cb0 legacy=0x7effb40c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:21.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.032+0000 7effba1d1700 1 -- 172.21.15.49:0/2076687638 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb41555c0 con 0x7effb4068090 2023-11-30T18:39:21.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.032+0000 7effba1d1700 1 --2- 172.21.15.49:0/2076687638 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effb4068090 0x7effb40c2d50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7effac009e90 tx=0x7effac009780).ready entity=mon.2 client_cookie=a045c744892658e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:21.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.032+0000 7effb89ce700 1 -- 172.21.15.49:0/2076687638 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac00e070 con 0x7effb4068090 2023-11-30T18:39:21.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.032+0000 7effb89ce700 1 -- 172.21.15.49:0/2076687638 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac00bab0 con 0x7effb4068090 2023-11-30T18:39:21.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.032+0000 7effb89ce700 1 -- 172.21.15.49:0/2076687638 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac00be30 con 0x7effb4068090 2023-11-30T18:39:21.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.033+0000 7effbbc34700 1 -- 172.21.15.49:0/2076687638 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effb4068090 msgr2=0x7effb40c2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:21.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.033+0000 7effbbc34700 1 --2- 172.21.15.49:0/2076687638 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effb4068090 0x7effb40c2d50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7effac009e90 tx=0x7effac009780).stop 2023-11-30T18:39:21.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.033+0000 7effbbc34700 1 -- 172.21.15.49:0/2076687638 shutdown_connections 2023-11-30T18:39:21.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.033+0000 7effbbc34700 1 --2- 172.21.15.49:0/2076687638 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effb4068090 0x7effb40c2d50 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:21.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.033+0000 7effbbc34700 1 -- 172.21.15.49:0/2076687638 >> 172.21.15.49:0/2076687638 conn(0x7effb40c7fd0 msgr2=0x7effb40c83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:21.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.033+0000 7effbbc34700 1 -- 172.21.15.49:0/2076687638 shutdown_connections 2023-11-30T18:39:21.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.033+0000 7effbbc34700 1 -- 172.21.15.49:0/2076687638 wait complete. 2023-11-30T18:39:21.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.034+0000 7effbbc34700 1 Processor -- start 2023-11-30T18:39:21.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.034+0000 7effbbc34700 1 -- start start 2023-11-30T18:39:21.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.035+0000 7effbbc34700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effb4067cb0 0x7effb414ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:21.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.035+0000 7effbbc34700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effb4068090 0x7effb40a9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:21.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.035+0000 7effbbc34700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effb40c45d0 0x7effb41517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:21.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.035+0000 7effbbc34700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb41617b0 con 0x7effb4067cb0 2023-11-30T18:39:21.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.035+0000 7effbbc34700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb4153d00 con 0x7effb4068090 2023-11-30T18:39:21.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.035+0000 7effbbc34700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb414f310 con 0x7effb40c45d0 2023-11-30T18:39:21.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.035+0000 7effb99d0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effb4067cb0 0x7effb414ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:21.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.035+0000 7effb99d0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effb4067cb0 0x7effb414ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38788/0 (socket says 172.21.15.49:38788) 2023-11-30T18:39:21.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.035+0000 7effb99d0700 1 -- 172.21.15.49:0/10358009 learned_addr learned my addr 172.21.15.49:0/10358009 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:21.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.035+0000 7effba1d1700 1 --2- 172.21.15.49:0/10358009 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effb40c45d0 0x7effb41517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:21.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.035+0000 7effb91cf700 1 --2- 172.21.15.49:0/10358009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effb4068090 0x7effb40a9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:21.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.035+0000 7effb99d0700 1 -- 172.21.15.49:0/10358009 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effb40c45d0 msgr2=0x7effb41517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:21.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.035+0000 7effb99d0700 1 --2- 172.21.15.49:0/10358009 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effb40c45d0 0x7effb41517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:21.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.035+0000 7effb99d0700 1 -- 172.21.15.49:0/10358009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effb4068090 msgr2=0x7effb40a9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:21.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.035+0000 7effb99d0700 1 --2- 172.21.15.49:0/10358009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effb4068090 0x7effb40a9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:21.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.035+0000 7effb99d0700 1 -- 172.21.15.49:0/10358009 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac009a20 con 0x7effb4067cb0 2023-11-30T18:39:21.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.035+0000 7effb91cf700 1 --2- 172.21.15.49:0/10358009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effb4068090 0x7effb40a9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:39:21.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.036+0000 7effb99d0700 1 --2- 172.21.15.49:0/10358009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effb4067cb0 0x7effb414ee20 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7effa400e9a0 tx=0x7effa4007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:21.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.036+0000 7effa9ffb700 1 -- 172.21.15.49:0/10358009 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa4007320 con 0x7effb4067cb0 2023-11-30T18:39:21.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.036+0000 7effa9ffb700 1 -- 172.21.15.49:0/10358009 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa4007480 con 0x7effb4067cb0 2023-11-30T18:39:21.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.036+0000 7effbbc34700 1 -- 172.21.15.49:0/10358009 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb4153740 con 0x7effb4067cb0 2023-11-30T18:39:21.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.036+0000 7effa9ffb700 1 -- 172.21.15.49:0/10358009 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa40059b0 con 0x7effb4067cb0 2023-11-30T18:39:21.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.036+0000 7effbbc34700 1 -- 172.21.15.49:0/10358009 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb40a7c30 con 0x7effb4067cb0 2023-11-30T18:39:21.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.037+0000 7effbbc34700 1 -- 172.21.15.49:0/10358009 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb406c860 con 0x7effb4067cb0 2023-11-30T18:39:21.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.037+0000 7effa9ffb700 1 -- 172.21.15.49:0/10358009 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 87) v1 ==== 75560+0+0 (secure 0 0 0) 0x7effa400c520 con 0x7effb4067cb0 2023-11-30T18:39:21.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.038+0000 7effa9ffb700 1 --2- 172.21.15.49:0/10358009 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7eff9805f270 0x7eff98061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:21.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.038+0000 7effa9ffb700 1 -- 172.21.15.49:0/10358009 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6694+0+0 (secure 0 0 0) 0x7effa407c800 con 0x7effb4067cb0 2023-11-30T18:39:21.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.038+0000 7effb91cf700 1 -- 172.21.15.49:0/10358009 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7eff9805f270 msgr2=0x7eff98061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:39:21.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.038+0000 7effb91cf700 1 --2- 172.21.15.49:0/10358009 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7eff9805f270 0x7eff98061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:39:21.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.042+0000 7effa9ffb700 1 -- 172.21.15.49:0/10358009 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7effa404d710 con 0x7effb4067cb0 2023-11-30T18:39:21.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.217+0000 7effbbc34700 1 -- 172.21.15.49:0/10358009 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7effb40a7490 con 0x7effb4067cb0 2023-11-30T18:39:21.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.218+0000 7effa9ffb700 1 -- 172.21.15.49:0/10358009 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) v1 ==== 74+0+17801 (secure 0 0 0) 0x7effa4050d30 con 0x7effb4067cb0 2023-11-30T18:39:21.220 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:39:21.220 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":188,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:34:21.516379+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-11-30T18:23:10.276504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-11-30T18:23:11.078075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.1b","mappings":[{"from":4,"to":3}]},{"pgid":"22.1","mappings":[{"from":3,"to":0}]},{"pgid":"22.2b","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/3122997899":"2023-12-01T18:34:21.516339+0000","172.21.15.115:0/3737718649":"2023-12-01T18:34:21.516339+0000","172.21.15.115:0/3726314103":"2023-12-01T18:34:21.516339+0000","172.21.15.115:0/1769486452":"2023-12-01T18:34:21.516339+0000","172.21.15.115:0/1587740371":"2023-12-01T18:23:28.950282+0000","172.21.15.115:0/3015522460":"2023-12-01T18:23:28.950282+0000","172.21.15.115:6833/89956":"2023-12-01T18:23:28.950282+0000","172.21.15.115:6832/89956":"2023-12-01T18:23:28.950282+0000","172.21.15.115:0/3750792535":"2023-12-01T18:23:28.950282+0000","172.21.15.115:0/2529631022":"2023-12-01T18:23:28.950282+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:39:21.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.220+0000 7effbbc34700 1 -- 172.21.15.49:0/10358009 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7eff9805f270 msgr2=0x7eff98061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:39:21.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.220+0000 7effbbc34700 1 --2- 172.21.15.49:0/10358009 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7eff9805f270 0x7eff98061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:39:21.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.220+0000 7effbbc34700 1 -- 172.21.15.49:0/10358009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effb4067cb0 msgr2=0x7effb414ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:21.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.220+0000 7effbbc34700 1 --2- 172.21.15.49:0/10358009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effb4067cb0 0x7effb414ee20 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7effa400e9a0 tx=0x7effa4007d90).stop 2023-11-30T18:39:21.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.220+0000 7effbbc34700 1 -- 172.21.15.49:0/10358009 shutdown_connections 2023-11-30T18:39:21.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.220+0000 7effbbc34700 1 --2- 172.21.15.49:0/10358009 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7eff9805f270 0x7eff98061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:39:21.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.220+0000 7effbbc34700 1 --2- 172.21.15.49:0/10358009 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effb40c45d0 0x7effb41517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:21.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.220+0000 7effbbc34700 1 --2- 172.21.15.49:0/10358009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effb4067cb0 0x7effb414ee20 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:21.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.220+0000 7effbbc34700 1 --2- 172.21.15.49:0/10358009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effb4068090 0x7effb40a9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:21.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.220+0000 7effbbc34700 1 -- 172.21.15.49:0/10358009 >> 172.21.15.49:0/10358009 conn(0x7effb40c7fd0 msgr2=0x7effb414fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:21.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.220+0000 7effbbc34700 1 -- 172.21.15.49:0/10358009 shutdown_connections 2023-11-30T18:39:21.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.220+0000 7effbbc34700 1 -- 172.21.15.49:0/10358009 wait complete. 2023-11-30T18:39:21.235 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '187', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-30T18:23:10.276504+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '183', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-11-30T18:23:11.078075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '184', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-30T18:39:21.235 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T18:39:21.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.359+0000 7f32e8658700 1 Processor -- start 2023-11-30T18:39:21.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.359+0000 7f32e8658700 1 -- start start 2023-11-30T18:39:21.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.360+0000 7f32e8658700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f32e0158a30 0x7f32e00c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:21.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.360+0000 7f32e8658700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32e00c72d0 con 0x7f32e0098d10 2023-11-30T18:39:21.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.360+0000 7f32e8658700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32e0064570 con 0x7f32e00c6190 2023-11-30T18:39:21.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.360+0000 7f32e8658700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32e0154bc0 con 0x7f32e0158a30 2023-11-30T18:39:21.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.361+0000 7f32e6bf5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f32e0158a30 0x7f32e00c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:21.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.361+0000 7f32e63f4700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f32e0098d10 0x7f32e0063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46046/0 (socket says 172.21.15.49:46046) 2023-11-30T18:39:21.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.361+0000 7f32e63f4700 1 -- 172.21.15.49:0/393391241 learned_addr learned my addr 172.21.15.49:0/393391241 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:21.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.361+0000 7f32e6bf5700 1 -- 172.21.15.49:0/393391241 >> v1:172.21.15.115:6789/0 conn(0x7f32e00c6190 legacy=0x7f32e0158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:21.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.361+0000 7f32e6bf5700 1 -- 172.21.15.49:0/393391241 >> v1:172.21.15.49:6789/0 conn(0x7f32e0098d10 legacy=0x7f32e0063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:21.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.361+0000 7f32e6bf5700 1 -- 172.21.15.49:0/393391241 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e00c66c0 con 0x7f32e0158a30 2023-11-30T18:39:21.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.361+0000 7f32e53f2700 1 -- 172.21.15.49:0/393391241 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3196055967 0 0) 0x7f32e00c72d0 con 0x7f32e0098d10 2023-11-30T18:39:21.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.361+0000 7f32e6bf5700 1 --2- 172.21.15.49:0/393391241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32e0158a30 0x7f32e00c7760 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7f32d8009e60 tx=0x7f32d8009780).ready entity=mon.0 client_cookie=38416aab3c7f5514 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:21.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.361+0000 7f32e53f2700 1 -- 172.21.15.49:0/393391241 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d800e070 con 0x7f32e0158a30 2023-11-30T18:39:21.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.361+0000 7f32e53f2700 1 -- 172.21.15.49:0/393391241 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d800bc30 con 0x7f32e0158a30 2023-11-30T18:39:21.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.361+0000 7f32e53f2700 1 -- 172.21.15.49:0/393391241 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d8012410 con 0x7f32e0158a30 2023-11-30T18:39:21.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.362+0000 7f32e8658700 1 -- 172.21.15.49:0/393391241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32e0158a30 msgr2=0x7f32e00c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:21.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.362+0000 7f32e8658700 1 --2- 172.21.15.49:0/393391241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32e0158a30 0x7f32e00c7760 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7f32d8009e60 tx=0x7f32d8009780).stop 2023-11-30T18:39:21.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.362+0000 7f32e8658700 1 -- 172.21.15.49:0/393391241 shutdown_connections 2023-11-30T18:39:21.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.362+0000 7f32e8658700 1 --2- 172.21.15.49:0/393391241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32e0158a30 0x7f32e00c7760 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:21.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.362+0000 7f32e8658700 1 -- 172.21.15.49:0/393391241 >> 172.21.15.49:0/393391241 conn(0x7f32e00cb310 msgr2=0x7f32e00cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:21.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.362+0000 7f32e8658700 1 -- 172.21.15.49:0/393391241 shutdown_connections 2023-11-30T18:39:21.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.362+0000 7f32e8658700 1 -- 172.21.15.49:0/393391241 wait complete. 2023-11-30T18:39:21.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.363+0000 7f32e8658700 1 Processor -- start 2023-11-30T18:39:21.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.363+0000 7f32e8658700 1 -- start start 2023-11-30T18:39:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.364+0000 7f32e8658700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32e0098d10 0x7f32e01647c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.364+0000 7f32e8658700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32e00c6190 0x7f32e00b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.364+0000 7f32e8658700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32e0158a30 0x7f32e00c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.364+0000 7f32e8658700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e013b800 con 0x7f32e00c6190 2023-11-30T18:39:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.364+0000 7f32e8658700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e00c2aa0 con 0x7f32e0158a30 2023-11-30T18:39:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.364+0000 7f32e8658700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e00b1330 con 0x7f32e0098d10 2023-11-30T18:39:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.364+0000 7f32e5bf3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32e00c6190 0x7f32e00b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.364+0000 7f32e5bf3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32e00c6190 0x7f32e00b07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38794/0 (socket says 172.21.15.49:38794) 2023-11-30T18:39:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.364+0000 7f32e5bf3700 1 -- 172.21.15.49:0/1393509972 learned_addr learned my addr 172.21.15.49:0/1393509972 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:21.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.364+0000 7f32e6bf5700 1 --2- 172.21.15.49:0/1393509972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32e0158a30 0x7f32e00c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:21.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.364+0000 7f32e63f4700 1 --2- 172.21.15.49:0/1393509972 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32e0098d10 0x7f32e01647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:21.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.364+0000 7f32e5bf3700 1 -- 172.21.15.49:0/1393509972 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32e0098d10 msgr2=0x7f32e01647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:21.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.364+0000 7f32e5bf3700 1 --2- 172.21.15.49:0/1393509972 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32e0098d10 0x7f32e01647c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:21.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.364+0000 7f32e5bf3700 1 -- 172.21.15.49:0/1393509972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32e0158a30 msgr2=0x7f32e00c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:21.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.364+0000 7f32e5bf3700 1 --2- 172.21.15.49:0/1393509972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32e0158a30 0x7f32e00c13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:21.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.364+0000 7f32e5bf3700 1 -- 172.21.15.49:0/1393509972 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d8009a20 con 0x7f32e00c6190 2023-11-30T18:39:21.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.364+0000 7f32e5bf3700 1 --2- 172.21.15.49:0/1393509972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32e00c6190 0x7f32e00b07c0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 rx=0x7f32d400c4f0 tx=0x7f32d4007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:21.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.365+0000 7f32d27fc700 1 -- 172.21.15.49:0/1393509972 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d4007020 con 0x7f32e00c6190 2023-11-30T18:39:21.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.365+0000 7f32d27fc700 1 -- 172.21.15.49:0/1393509972 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d4007180 con 0x7f32e00c6190 2023-11-30T18:39:21.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.365+0000 7f32e8658700 1 -- 172.21.15.49:0/1393509972 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e00b1050 con 0x7f32e00c6190 2023-11-30T18:39:21.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.365+0000 7f32d27fc700 1 -- 172.21.15.49:0/1393509972 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d4007520 con 0x7f32e00c6190 2023-11-30T18:39:21.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.365+0000 7f32e8658700 1 -- 172.21.15.49:0/1393509972 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e00c2730 con 0x7f32e00c6190 2023-11-30T18:39:21.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.366+0000 7f32e8658700 1 -- 172.21.15.49:0/1393509972 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e006c860 con 0x7f32e00c6190 2023-11-30T18:39:21.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.366+0000 7f32d27fc700 1 -- 172.21.15.49:0/1393509972 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 87) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f32d40068b0 con 0x7f32e00c6190 2023-11-30T18:39:21.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.366+0000 7f32d27fc700 1 --2- 172.21.15.49:0/1393509972 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f32c405f240 0x7f32c4061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:21.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.366+0000 7f32d27fc700 1 -- 172.21.15.49:0/1393509972 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6694+0+0 (secure 0 0 0) 0x7f32d4079930 con 0x7f32e00c6190 2023-11-30T18:39:21.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.366+0000 7f32e63f4700 1 -- 172.21.15.49:0/1393509972 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f32c405f240 msgr2=0x7f32c4061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:39:21.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.366+0000 7f32e63f4700 1 --2- 172.21.15.49:0/1393509972 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f32c405f240 0x7f32c4061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:39:21.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.370+0000 7f32d27fc700 1 -- 172.21.15.49:0/1393509972 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f32d4047b00 con 0x7f32e00c6190 2023-11-30T18:39:21.409 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:21.408+0000 7fca4d395680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T18:39:21.481 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:21.480+0000 7fca4d395680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T18:39:21.483 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:21.481+0000 7feb1808a680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T18:39:21.554 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:21.552+0000 7feb1808a680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T18:39:21.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.567+0000 7f32e63f4700 1 -- 172.21.15.49:0/1393509972 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f32c405f240 msgr2=0x7f32c4061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:39:21.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.567+0000 7f32e63f4700 1 --2- 172.21.15.49:0/1393509972 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f32c405f240 0x7f32c4061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T18:39:21.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.590+0000 7f32e8658700 1 -- 172.21.15.49:0/1393509972 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f32e00c2be0 con 0x7f32e00c6190 2023-11-30T18:39:21.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.590+0000 7f32d27fc700 1 -- 172.21.15.49:0/1393509972 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v188) v1 ==== 110+0+10 (secure 0 0 0) 0x7f32d404a840 con 0x7f32e00c6190 2023-11-30T18:39:21.593 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T18:39:21.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.594+0000 7f32e8658700 1 -- 172.21.15.49:0/1393509972 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f32c405f240 msgr2=0x7f32c4061700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:39:21.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.594+0000 7f32e8658700 1 --2- 172.21.15.49:0/1393509972 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f32c405f240 0x7f32c4061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:39:21.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.594+0000 7f32e8658700 1 -- 172.21.15.49:0/1393509972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32e00c6190 msgr2=0x7f32e00b07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:21.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.594+0000 7f32e8658700 1 --2- 172.21.15.49:0/1393509972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32e00c6190 0x7f32e00b07c0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 rx=0x7f32d400c4f0 tx=0x7f32d4007dd0).stop 2023-11-30T18:39:21.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.594+0000 7f32e8658700 1 -- 172.21.15.49:0/1393509972 shutdown_connections 2023-11-30T18:39:21.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.594+0000 7f32e8658700 1 --2- 172.21.15.49:0/1393509972 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f32c405f240 0x7f32c4061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:39:21.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.594+0000 7f32e8658700 1 --2- 172.21.15.49:0/1393509972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32e0158a30 0x7f32e00c13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:21.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.594+0000 7f32e8658700 1 --2- 172.21.15.49:0/1393509972 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32e0098d10 0x7f32e01647c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:21.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.594+0000 7f32e8658700 1 --2- 172.21.15.49:0/1393509972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32e00c6190 0x7f32e00b07c0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:21.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.594+0000 7f32e8658700 1 -- 172.21.15.49:0/1393509972 >> 172.21.15.49:0/1393509972 conn(0x7f32e00cb310 msgr2=0x7f32e00ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:21.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.594+0000 7f32e8658700 1 -- 172.21.15.49:0/1393509972 shutdown_connections 2023-11-30T18:39:21.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.594+0000 7f32e8658700 1 -- 172.21.15.49:0/1393509972 wait complete. 2023-11-30T18:39:21.614 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T18:39:21.666 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:21.665+0000 7fca4d395680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T18:39:21.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.736+0000 7f693b59e700 1 Processor -- start 2023-11-30T18:39:21.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.736+0000 7f693b59e700 1 -- start start 2023-11-30T18:39:21.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.737+0000 7f693b59e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f693c0bcb40 0x7f693c062700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:21.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.737+0000 7f693b59e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f693c1587b0 0x7f693c158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:21.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.737+0000 7f693b59e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f693c063a10 con 0x7f693c0bc760 2023-11-30T18:39:21.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.737+0000 7f693b59e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f693c062bf0 con 0x7f693c0bcb40 2023-11-30T18:39:21.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.737+0000 7f693b59e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f693c06bbe0 con 0x7f693c1587b0 2023-11-30T18:39:21.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.738+0000 7f6939d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f693c0bcb40 0x7f693c062700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:21.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.738+0000 7f693a59c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f693c0bc760 0x7f693c1580a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46050/0 (socket says 172.21.15.49:46050) 2023-11-30T18:39:21.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.738+0000 7f693a59c700 1 -- 172.21.15.49:0/4197180302 learned_addr learned my addr 172.21.15.49:0/4197180302 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:21.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.738+0000 7f693ad9d700 1 --2- 172.21.15.49:0/4197180302 >> v2:172.21.15.115:3300/0 conn(0x7f693c1587b0 0x7f693c158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:21.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.738+0000 7f6939d9b700 1 -- 172.21.15.49:0/4197180302 >> v2:172.21.15.115:3300/0 conn(0x7f693c1587b0 msgr2=0x7f693c158bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:21.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.738+0000 7f6939d9b700 1 --2- 172.21.15.49:0/4197180302 >> v2:172.21.15.115:3300/0 conn(0x7f693c1587b0 0x7f693c158bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:21.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.738+0000 7f6939d9b700 1 -- 172.21.15.49:0/4197180302 >> v1:172.21.15.49:6789/0 conn(0x7f693c0bc760 legacy=0x7f693c1580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:21.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.738+0000 7f6939d9b700 1 -- 172.21.15.49:0/4197180302 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693c062e00 con 0x7f693c0bcb40 2023-11-30T18:39:21.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.738+0000 7f693959a700 1 -- 172.21.15.49:0/4197180302 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176577846 0 0) 0x7f693c063a10 con 0x7f693c0bc760 2023-11-30T18:39:21.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.738+0000 7f6939d9b700 1 --2- 172.21.15.49:0/4197180302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f693c0bcb40 0x7f693c062700 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7f693c0be010 tx=0x7f6924009060).ready entity=mon.0 client_cookie=8f1e494cde45f59b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:21.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.738+0000 7f693959a700 1 -- 172.21.15.49:0/4197180302 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69240090d0 con 0x7f693c0bcb40 2023-11-30T18:39:21.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.738+0000 7f693959a700 1 -- 172.21.15.49:0/4197180302 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692400f510 con 0x7f693c0bcb40 2023-11-30T18:39:21.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.738+0000 7f693959a700 1 -- 172.21.15.49:0/4197180302 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692400f890 con 0x7f693c0bcb40 2023-11-30T18:39:21.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.739+0000 7f693b59e700 1 -- 172.21.15.49:0/4197180302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f693c0bcb40 msgr2=0x7f693c062700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:21.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.739+0000 7f693b59e700 1 --2- 172.21.15.49:0/4197180302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f693c0bcb40 0x7f693c062700 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7f693c0be010 tx=0x7f6924009060).stop 2023-11-30T18:39:21.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.739+0000 7f693b59e700 1 -- 172.21.15.49:0/4197180302 shutdown_connections 2023-11-30T18:39:21.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.739+0000 7f693b59e700 1 --2- 172.21.15.49:0/4197180302 >> v2:172.21.15.115:3300/0 conn(0x7f693c1587b0 0x7f693c158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:21.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.739+0000 7f693b59e700 1 --2- 172.21.15.49:0/4197180302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f693c0bcb40 0x7f693c062700 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:21.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.739+0000 7f693b59e700 1 -- 172.21.15.49:0/4197180302 >> 172.21.15.49:0/4197180302 conn(0x7f693c0c4010 msgr2=0x7f693c0c4420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:21.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.739+0000 7f693b59e700 1 -- 172.21.15.49:0/4197180302 shutdown_connections 2023-11-30T18:39:21.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.739+0000 7f693b59e700 1 -- 172.21.15.49:0/4197180302 wait complete. 2023-11-30T18:39:21.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.740+0000 7f693b59e700 1 Processor -- start 2023-11-30T18:39:21.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.740+0000 7f693b59e700 1 -- start start 2023-11-30T18:39:21.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.741+0000 7f693b59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f693c0bc760 0x7f693c13bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:21.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.741+0000 7f693b59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f693c0bcb40 0x7f693c13a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:21.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.741+0000 7f693b59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f693c1587b0 0x7f693c0c0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:21.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.741+0000 7f693b59e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693c13c090 con 0x7f693c0bc760 2023-11-30T18:39:21.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.741+0000 7f693b59e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693c13ac60 con 0x7f693c0bcb40 2023-11-30T18:39:21.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.741+0000 7f693b59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f693c13cad0 con 0x7f693c1587b0 2023-11-30T18:39:21.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.741+0000 7f693a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f693c0bc760 0x7f693c13bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:21.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.741+0000 7f693a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f693c0bc760 0x7f693c13bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38814/0 (socket says 172.21.15.49:38814) 2023-11-30T18:39:21.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.741+0000 7f693a59c700 1 -- 172.21.15.49:0/2296254952 learned_addr learned my addr 172.21.15.49:0/2296254952 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:21.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.741+0000 7f693ad9d700 1 --2- 172.21.15.49:0/2296254952 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f693c1587b0 0x7f693c0c0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:21.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.741+0000 7f6939d9b700 1 --2- 172.21.15.49:0/2296254952 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f693c0bcb40 0x7f693c13a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:21.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.742+0000 7f693a59c700 1 -- 172.21.15.49:0/2296254952 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f693c1587b0 msgr2=0x7f693c0c0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:21.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.742+0000 7f693a59c700 1 --2- 172.21.15.49:0/2296254952 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f693c1587b0 0x7f693c0c0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:21.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.742+0000 7f693a59c700 1 -- 172.21.15.49:0/2296254952 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f693c0bcb40 msgr2=0x7f693c13a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:21.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.742+0000 7f693a59c700 1 --2- 172.21.15.49:0/2296254952 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f693c0bcb40 0x7f693c13a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:21.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.742+0000 7f693a59c700 1 -- 172.21.15.49:0/2296254952 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69240092a0 con 0x7f693c0bc760 2023-11-30T18:39:21.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.742+0000 7f693a59c700 1 --2- 172.21.15.49:0/2296254952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f693c0bc760 0x7f693c13bba0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7f692c00c590 tx=0x7f692c007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:21.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.742+0000 7f69327fc700 1 -- 172.21.15.49:0/2296254952 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692c0072e0 con 0x7f693c0bc760 2023-11-30T18:39:21.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.742+0000 7f69327fc700 1 -- 172.21.15.49:0/2296254952 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692c007440 con 0x7f693c0bc760 2023-11-30T18:39:21.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.742+0000 7f69327fc700 1 -- 172.21.15.49:0/2296254952 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692c0057a0 con 0x7f693c0bc760 2023-11-30T18:39:21.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.742+0000 7f693b59e700 1 -- 172.21.15.49:0/2296254952 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f693c13cdb0 con 0x7f693c0bc760 2023-11-30T18:39:21.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.742+0000 7f693b59e700 1 -- 172.21.15.49:0/2296254952 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f693c13d370 con 0x7f693c0bc760 2023-11-30T18:39:21.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.743+0000 7f693b59e700 1 -- 172.21.15.49:0/2296254952 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f693c06c7c0 con 0x7f693c0bc760 2023-11-30T18:39:21.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.743+0000 7f69327fc700 1 -- 172.21.15.49:0/2296254952 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 87) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f692c005bd0 con 0x7f693c0bc760 2023-11-30T18:39:21.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.744+0000 7f69327fc700 1 --2- 172.21.15.49:0/2296254952 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f691c05f270 0x7f691c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:21.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.744+0000 7f69327fc700 1 -- 172.21.15.49:0/2296254952 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6694+0+0 (secure 0 0 0) 0x7f692c079d20 con 0x7f693c0bc760 2023-11-30T18:39:21.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.744+0000 7f6939d9b700 1 -- 172.21.15.49:0/2296254952 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f691c05f270 msgr2=0x7f691c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:39:21.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.744+0000 7f6939d9b700 1 --2- 172.21.15.49:0/2296254952 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f691c05f270 0x7f691c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:39:21.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.748+0000 7f69327fc700 1 -- 172.21.15.49:0/2296254952 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f692c04ac30 con 0x7f693c0bc760 2023-11-30T18:39:21.760 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:21.758+0000 7feb1808a680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T18:39:21.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.923+0000 7f693b59e700 1 -- 172.21.15.49:0/2296254952 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f693c0630e0 con 0x7f693c0bc760 2023-11-30T18:39:21.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.923+0000 7f69327fc700 1 -- 172.21.15.49:0/2296254952 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v188) v1 ==== 92+0+10 (secure 0 0 0) 0x7f692c04e250 con 0x7f693c0bc760 2023-11-30T18:39:21.926 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T18:39:21.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.925+0000 7f693b59e700 1 -- 172.21.15.49:0/2296254952 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f691c05f270 msgr2=0x7f691c061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:39:21.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.925+0000 7f693b59e700 1 --2- 172.21.15.49:0/2296254952 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f691c05f270 0x7f691c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:39:21.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.925+0000 7f693b59e700 1 -- 172.21.15.49:0/2296254952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f693c0bc760 msgr2=0x7f693c13bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:21.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.925+0000 7f693b59e700 1 --2- 172.21.15.49:0/2296254952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f693c0bc760 0x7f693c13bba0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7f692c00c590 tx=0x7f692c007c80).stop 2023-11-30T18:39:21.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.925+0000 7f693b59e700 1 -- 172.21.15.49:0/2296254952 shutdown_connections 2023-11-30T18:39:21.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.925+0000 7f693b59e700 1 --2- 172.21.15.49:0/2296254952 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f691c05f270 0x7f691c061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:39:21.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.925+0000 7f693b59e700 1 --2- 172.21.15.49:0/2296254952 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f693c1587b0 0x7f693c0c0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:21.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.925+0000 7f693b59e700 1 --2- 172.21.15.49:0/2296254952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f693c0bc760 0x7f693c13bba0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:21.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.925+0000 7f693b59e700 1 --2- 172.21.15.49:0/2296254952 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f693c0bcb40 0x7f693c13a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:21.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.925+0000 7f693b59e700 1 -- 172.21.15.49:0/2296254952 >> 172.21.15.49:0/2296254952 conn(0x7f693c0c4010 msgr2=0x7f693c0c2180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:21.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.925+0000 7f693b59e700 1 -- 172.21.15.49:0/2296254952 shutdown_connections 2023-11-30T18:39:21.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:21.925+0000 7f693b59e700 1 -- 172.21.15.49:0/2296254952 wait complete. 2023-11-30T18:39:21.940 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-30T18:39:22.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.064+0000 7f5456569700 1 Processor -- start 2023-11-30T18:39:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.065+0000 7f5456569700 1 -- start start 2023-11-30T18:39:22.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.065+0000 7f5456569700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f54501547f0 0x7f54500a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:22.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.065+0000 7f5456569700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5450062700 0x7f5450062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:22.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.065+0000 7f5456569700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54500630a0 con 0x7f54500c86f0 2023-11-30T18:39:22.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.065+0000 7f5456569700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54500c7e30 con 0x7f54501547f0 2023-11-30T18:39:22.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.066+0000 7f5456569700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54500bcf40 con 0x7f5450062700 2023-11-30T18:39:22.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.066+0000 7f5454b06700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5450062700 0x7f5450062bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:22.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.066+0000 7f544ffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f54501547f0 0x7f54500a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:22.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.066+0000 7f5454b06700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5450062700 0x7f5450062bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:60890/0 (socket says 172.21.15.49:60890) 2023-11-30T18:39:22.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.066+0000 7f544ffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f54501547f0 0x7f54500a72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:51536/0 (socket says 172.21.15.49:51536) 2023-11-30T18:39:22.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.066+0000 7f5454b06700 1 -- 172.21.15.49:0/1258950610 learned_addr learned my addr 172.21.15.49:0/1258950610 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:22.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.066+0000 7f544f7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f54500c86f0 0x7f54500c6fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:53952/0 (socket says 172.21.15.49:53952) 2023-11-30T18:39:22.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.066+0000 7f544ffff700 1 -- 172.21.15.49:0/1258950610 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5450062700 msgr2=0x7f5450062bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:22.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.066+0000 7f544ffff700 1 --2- 172.21.15.49:0/1258950610 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5450062700 0x7f5450062bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:22.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.066+0000 7f544ffff700 1 -- 172.21.15.49:0/1258950610 >> v1:172.21.15.115:6789/0 conn(0x7f54500c86f0 legacy=0x7f54500c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:22.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.066+0000 7f544ffff700 1 -- 172.21.15.49:0/1258950610 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54500c6b20 con 0x7f54501547f0 2023-11-30T18:39:22.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.066+0000 7f544effd700 1 -- 172.21.15.49:0/1258950610 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2471887014 0 0) 0x7f5444001110 con 0x7f54500c86f0 2023-11-30T18:39:22.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.066+0000 7f5454b06700 1 --2- 172.21.15.49:0/1258950610 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5450062700 0x7f5450062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:39:22.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.066+0000 7f544ffff700 1 --2- 172.21.15.49:0/1258950610 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54501547f0 0x7f54500a72e0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f5440009760 tx=0x7f5440009060).ready entity=mon.1 client_cookie=5f83f63223226aac server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:22.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.066+0000 7f544effd700 1 -- 172.21.15.49:0/1258950610 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54400090d0 con 0x7f54501547f0 2023-11-30T18:39:22.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.067+0000 7f544effd700 1 -- 172.21.15.49:0/1258950610 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544000f510 con 0x7f54501547f0 2023-11-30T18:39:22.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.067+0000 7f544effd700 1 -- 172.21.15.49:0/1258950610 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544000f890 con 0x7f54501547f0 2023-11-30T18:39:22.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.067+0000 7f5456569700 1 -- 172.21.15.49:0/1258950610 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54501547f0 msgr2=0x7f54500a72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:22.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.067+0000 7f5456569700 1 --2- 172.21.15.49:0/1258950610 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54501547f0 0x7f54500a72e0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f5440009760 tx=0x7f5440009060).stop 2023-11-30T18:39:22.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.067+0000 7f5456569700 1 -- 172.21.15.49:0/1258950610 shutdown_connections 2023-11-30T18:39:22.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.067+0000 7f5456569700 1 --2- 172.21.15.49:0/1258950610 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5450062700 0x7f5450062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:22.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.067+0000 7f5456569700 1 --2- 172.21.15.49:0/1258950610 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54501547f0 0x7f54500a72e0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:22.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.067+0000 7f5456569700 1 -- 172.21.15.49:0/1258950610 >> 172.21.15.49:0/1258950610 conn(0x7f54500642d0 msgr2=0x7f54500c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:22.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.067+0000 7f5456569700 1 -- 172.21.15.49:0/1258950610 shutdown_connections 2023-11-30T18:39:22.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.067+0000 7f5456569700 1 -- 172.21.15.49:0/1258950610 wait complete. 2023-11-30T18:39:22.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.068+0000 7f5456569700 1 Processor -- start 2023-11-30T18:39:22.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.069+0000 7f5456569700 1 -- start start 2023-11-30T18:39:22.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.069+0000 7f5456569700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5450062700 0x7f54500a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:22.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.069+0000 7f5456569700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54500c86f0 0x7f545014cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:22.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.069+0000 7f5456569700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54501547f0 0x7f54500ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:22.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.069+0000 7f5456569700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54500a8ce0 con 0x7f54501547f0 2023-11-30T18:39:22.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.069+0000 7f5456569700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54500a8fc0 con 0x7f5450062700 2023-11-30T18:39:22.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.069+0000 7f5456569700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54500a92a0 con 0x7f54500c86f0 2023-11-30T18:39:22.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.069+0000 7f5454b06700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54501547f0 0x7f54500ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:22.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.069+0000 7f544ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5450062700 0x7f54500a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:22.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.069+0000 7f544f7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54500c86f0 0x7f545014cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:22.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.069+0000 7f5454b06700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54501547f0 0x7f54500ac4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38826/0 (socket says 172.21.15.49:38826) 2023-11-30T18:39:22.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.069+0000 7f544ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5450062700 0x7f54500a84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:51540/0 (socket says 172.21.15.49:51540) 2023-11-30T18:39:22.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.069+0000 7f5454b06700 1 -- 172.21.15.49:0/1542342332 learned_addr learned my addr 172.21.15.49:0/1542342332 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:22.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.070+0000 7f544ffff700 1 -- 172.21.15.49:0/1542342332 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54500c86f0 msgr2=0x7f545014cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:22.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.070+0000 7f544ffff700 1 --2- 172.21.15.49:0/1542342332 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54500c86f0 0x7f545014cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:22.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.070+0000 7f544ffff700 1 -- 172.21.15.49:0/1542342332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54501547f0 msgr2=0x7f54500ac4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:22.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.070+0000 7f544ffff700 1 --2- 172.21.15.49:0/1542342332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54501547f0 0x7f54500ac4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:22.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.070+0000 7f544ffff700 1 -- 172.21.15.49:0/1542342332 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5448009ae0 con 0x7f5450062700 2023-11-30T18:39:22.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.070+0000 7f5454b06700 1 --2- 172.21.15.49:0/1542342332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54501547f0 0x7f54500ac4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:39:22.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.070+0000 7f544f7fe700 1 --2- 172.21.15.49:0/1542342332 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54500c86f0 0x7f545014cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:39:22.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.070+0000 7f544ffff700 1 --2- 172.21.15.49:0/1542342332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5450062700 0x7f54500a84d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f5440014000 tx=0x7f5440017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:22.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.070+0000 7f5437fff700 1 -- 172.21.15.49:0/1542342332 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544000f890 con 0x7f5450062700 2023-11-30T18:39:22.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.070+0000 7f5437fff700 1 -- 172.21.15.49:0/1542342332 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544000fc50 con 0x7f5450062700 2023-11-30T18:39:22.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.070+0000 7f5456569700 1 -- 172.21.15.49:0/1542342332 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54400092a0 con 0x7f5450062700 2023-11-30T18:39:22.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.070+0000 7f5437fff700 1 -- 172.21.15.49:0/1542342332 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544001c420 con 0x7f5450062700 2023-11-30T18:39:22.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.070+0000 7f5456569700 1 -- 172.21.15.49:0/1542342332 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54501574e0 con 0x7f5450062700 2023-11-30T18:39:22.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.071+0000 7f5456569700 1 -- 172.21.15.49:0/1542342332 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5450157340 con 0x7f5450062700 2023-11-30T18:39:22.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.072+0000 7f5437fff700 1 -- 172.21.15.49:0/1542342332 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 87) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f544001c850 con 0x7f5450062700 2023-11-30T18:39:22.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.072+0000 7f5437fff700 1 --2- 172.21.15.49:0/1542342332 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f543c05f270 0x7f543c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:22.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.072+0000 7f5437fff700 1 -- 172.21.15.49:0/1542342332 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6694+0+0 (secure 0 0 0) 0x7f544007c100 con 0x7f5450062700 2023-11-30T18:39:22.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.072+0000 7f544f7fe700 1 -- 172.21.15.49:0/1542342332 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f543c05f270 msgr2=0x7f543c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:39:22.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.072+0000 7f544f7fe700 1 --2- 172.21.15.49:0/1542342332 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f543c05f270 0x7f543c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:39:22.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.076+0000 7f5437fff700 1 -- 172.21.15.49:0/1542342332 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5450157340 con 0x7f5450062700 2023-11-30T18:39:22.086 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:22.085+0000 7fca4d395680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T18:39:22.190 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:22.189+0000 7fca4d395680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:39:22.209 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:22.207+0000 7feb1808a680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T18:39:22.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.249+0000 7f5456569700 1 -- 172.21.15.49:0/1542342332 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5450157340 con 0x7f5450062700 2023-11-30T18:39:22.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.249+0000 7f5437fff700 1 -- 172.21.15.49:0/1542342332 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v188) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5440020020 con 0x7f5450062700 2023-11-30T18:39:22.252 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T18:39:22.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.251+0000 7f5456569700 1 -- 172.21.15.49:0/1542342332 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f543c05f270 msgr2=0x7f543c061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:39:22.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.251+0000 7f5456569700 1 --2- 172.21.15.49:0/1542342332 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f543c05f270 0x7f543c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:39:22.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.251+0000 7f5456569700 1 -- 172.21.15.49:0/1542342332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5450062700 msgr2=0x7f54500a84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:22.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.251+0000 7f5456569700 1 --2- 172.21.15.49:0/1542342332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5450062700 0x7f54500a84d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f5440014000 tx=0x7f5440017000).stop 2023-11-30T18:39:22.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.251+0000 7f5456569700 1 -- 172.21.15.49:0/1542342332 shutdown_connections 2023-11-30T18:39:22.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.251+0000 7f5456569700 1 --2- 172.21.15.49:0/1542342332 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f543c05f270 0x7f543c061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:39:22.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.251+0000 7f5456569700 1 --2- 172.21.15.49:0/1542342332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54501547f0 0x7f54500ac4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:22.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.251+0000 7f5456569700 1 --2- 172.21.15.49:0/1542342332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5450062700 0x7f54500a84d0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:22.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.251+0000 7f5456569700 1 --2- 172.21.15.49:0/1542342332 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54500c86f0 0x7f545014cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:22.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.251+0000 7f5456569700 1 -- 172.21.15.49:0/1542342332 >> 172.21.15.49:0/1542342332 conn(0x7f54500642d0 msgr2=0x7f545014dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:22.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.251+0000 7f5456569700 1 -- 172.21.15.49:0/1542342332 shutdown_connections 2023-11-30T18:39:22.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.251+0000 7f5456569700 1 -- 172.21.15.49:0/1542342332 wait complete. 2023-11-30T18:39:22.267 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-30T18:39:22.345 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:22.335+0000 7feb1808a680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:39:22.613 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:22.352+0000 7fca4d395680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T18:39:22.613 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:22.440+0000 7fca4d395680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T18:39:22.613 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:22.530+0000 7fca4d395680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T18:39:22.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.439+0000 7f95929cf700 1 Processor -- start 2023-11-30T18:39:22.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.439+0000 7f95929cf700 1 -- start start 2023-11-30T18:39:22.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.440+0000 7f95929cf700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f958c0c5ac0 0x7f958c0c51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:22.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.440+0000 7f95929cf700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f958c0c5ea0 0x7f958c066a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:22.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.440+0000 7f95929cf700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f958c155f20 con 0x7f958c153390 2023-11-30T18:39:22.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.440+0000 7f95929cf700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f958c153990 con 0x7f958c0c5ac0 2023-11-30T18:39:22.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.440+0000 7f95929cf700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f958c156200 con 0x7f958c0c5ea0 2023-11-30T18:39:22.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.440+0000 7f958bfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f958c0c5ac0 0x7f958c0c51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:22.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.440+0000 7f958b7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f958c153390 0x7f958c156690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46058/0 (socket says 172.21.15.49:46058) 2023-11-30T18:39:22.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.440+0000 7f958b7fe700 1 -- 172.21.15.49:0/4037351874 learned_addr learned my addr 172.21.15.49:0/4037351874 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:22.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.440+0000 7f9590f6c700 1 --2- 172.21.15.49:0/4037351874 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f958c0c5ea0 0x7f958c066a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:22.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.440+0000 7f958bfff700 1 -- 172.21.15.49:0/4037351874 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f958c0c5ea0 msgr2=0x7f958c066a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:22.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.440+0000 7f958bfff700 1 --2- 172.21.15.49:0/4037351874 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f958c0c5ea0 0x7f958c066a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:22.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.440+0000 7f958bfff700 1 -- 172.21.15.49:0/4037351874 >> v1:172.21.15.49:6789/0 conn(0x7f958c153390 legacy=0x7f958c156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:22.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.440+0000 7f958affd700 1 -- 172.21.15.49:0/4037351874 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3465298125 0 0) 0x7f958c155f20 con 0x7f958c153390 2023-11-30T18:39:22.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.440+0000 7f958bfff700 1 -- 172.21.15.49:0/4037351874 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958c0bff70 con 0x7f958c0c5ac0 2023-11-30T18:39:22.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.441+0000 7f958bfff700 1 --2- 172.21.15.49:0/4037351874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f958c0c5ac0 0x7f958c0c51a0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7f957c009760 tx=0x7f957c009060).ready entity=mon.0 client_cookie=4f3ffac0a5d05508 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:22.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.441+0000 7f958affd700 1 -- 172.21.15.49:0/4037351874 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c0090d0 con 0x7f958c0c5ac0 2023-11-30T18:39:22.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.441+0000 7f958affd700 1 -- 172.21.15.49:0/4037351874 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957c00b580 con 0x7f958c0c5ac0 2023-11-30T18:39:22.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.441+0000 7f958affd700 1 -- 172.21.15.49:0/4037351874 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c00b900 con 0x7f958c0c5ac0 2023-11-30T18:39:22.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.441+0000 7f95929cf700 1 -- 172.21.15.49:0/4037351874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f958c0c5ac0 msgr2=0x7f958c0c51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:22.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.441+0000 7f95929cf700 1 --2- 172.21.15.49:0/4037351874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f958c0c5ac0 0x7f958c0c51a0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7f957c009760 tx=0x7f957c009060).stop 2023-11-30T18:39:22.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.442+0000 7f95929cf700 1 -- 172.21.15.49:0/4037351874 shutdown_connections 2023-11-30T18:39:22.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.442+0000 7f95929cf700 1 --2- 172.21.15.49:0/4037351874 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f958c0c5ea0 0x7f958c066a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:22.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.442+0000 7f95929cf700 1 --2- 172.21.15.49:0/4037351874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f958c0c5ac0 0x7f958c0c51a0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:22.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.442+0000 7f95929cf700 1 -- 172.21.15.49:0/4037351874 >> 172.21.15.49:0/4037351874 conn(0x7f958c062700 msgr2=0x7f958c062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:22.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.442+0000 7f95929cf700 1 -- 172.21.15.49:0/4037351874 shutdown_connections 2023-11-30T18:39:22.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.442+0000 7f95929cf700 1 -- 172.21.15.49:0/4037351874 wait complete. 2023-11-30T18:39:22.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.443+0000 7f95929cf700 1 Processor -- start 2023-11-30T18:39:22.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.443+0000 7f95929cf700 1 -- start start 2023-11-30T18:39:22.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.444+0000 7f95929cf700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f958c0c5ac0 0x7f958c092480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:22.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.444+0000 7f95929cf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f958c0c5ea0 0x7f958c161e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:22.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.444+0000 7f95929cf700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f958c153390 0x7f958c0c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:22.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.444+0000 7f95929cf700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958c0ad190 con 0x7f958c0c5ea0 2023-11-30T18:39:22.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.444+0000 7f95929cf700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958c0ac580 con 0x7f958c153390 2023-11-30T18:39:22.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.444+0000 7f95929cf700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f958c0ac860 con 0x7f958c0c5ac0 2023-11-30T18:39:22.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.444+0000 7f958b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f958c0c5ea0 0x7f958c161e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:22.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.444+0000 7f958b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f958c0c5ea0 0x7f958c161e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38844/0 (socket says 172.21.15.49:38844) 2023-11-30T18:39:22.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.444+0000 7f958b7fe700 1 -- 172.21.15.49:0/503394568 learned_addr learned my addr 172.21.15.49:0/503394568 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:22.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.444+0000 7f958bfff700 1 --2- 172.21.15.49:0/503394568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f958c0c5ac0 0x7f958c092480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:22.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.444+0000 7f9590f6c700 1 --2- 172.21.15.49:0/503394568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f958c153390 0x7f958c0c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:22.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.445+0000 7f958b7fe700 1 -- 172.21.15.49:0/503394568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f958c0c5ac0 msgr2=0x7f958c092480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:22.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.445+0000 7f958b7fe700 1 --2- 172.21.15.49:0/503394568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f958c0c5ac0 0x7f958c092480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:22.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.445+0000 7f958b7fe700 1 -- 172.21.15.49:0/503394568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f958c153390 msgr2=0x7f958c0c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:22.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.445+0000 7f958b7fe700 1 --2- 172.21.15.49:0/503394568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f958c153390 0x7f958c0c20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:22.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.445+0000 7f958b7fe700 1 -- 172.21.15.49:0/503394568 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957c0092a0 con 0x7f958c0c5ea0 2023-11-30T18:39:22.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.445+0000 7f958b7fe700 1 --2- 172.21.15.49:0/503394568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f958c0c5ea0 0x7f958c161e30 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7f9580001eb0 tx=0x7f9580007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:22.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.445+0000 7f9573fff700 1 -- 172.21.15.49:0/503394568 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95800070d0 con 0x7f958c0c5ea0 2023-11-30T18:39:22.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.445+0000 7f9573fff700 1 -- 172.21.15.49:0/503394568 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9580007230 con 0x7f958c0c5ea0 2023-11-30T18:39:22.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.445+0000 7f95929cf700 1 -- 172.21.15.49:0/503394568 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f958c0acb40 con 0x7f958c0c5ea0 2023-11-30T18:39:22.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.445+0000 7f9573fff700 1 -- 172.21.15.49:0/503394568 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95800075d0 con 0x7f958c0c5ea0 2023-11-30T18:39:22.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.445+0000 7f95929cf700 1 -- 172.21.15.49:0/503394568 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f958c094e30 con 0x7f958c0c5ea0 2023-11-30T18:39:22.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.447+0000 7f95929cf700 1 -- 172.21.15.49:0/503394568 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f958c06c860 con 0x7f958c0c5ea0 2023-11-30T18:39:22.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.447+0000 7f9573fff700 1 -- 172.21.15.49:0/503394568 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 87) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f9580005bc0 con 0x7f958c0c5ea0 2023-11-30T18:39:22.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.447+0000 7f9573fff700 1 --2- 172.21.15.49:0/503394568 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f957805f270 0x7f9578061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:22.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.448+0000 7f958bfff700 1 -- 172.21.15.49:0/503394568 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f957805f270 msgr2=0x7f9578061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:39:22.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.448+0000 7f9573fff700 1 -- 172.21.15.49:0/503394568 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f9580079fc0 con 0x7f958c0c5ea0 2023-11-30T18:39:22.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.448+0000 7f958bfff700 1 --2- 172.21.15.49:0/503394568 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f957805f270 0x7f9578061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:39:22.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.452+0000 7f9573fff700 1 -- 172.21.15.49:0/503394568 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f958004aea0 con 0x7f958c0c5ea0 2023-11-30T18:39:22.622 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:22.547+0000 7feb1808a680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T18:39:22.633 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:22.631+0000 7feb1808a680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T18:39:22.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.649+0000 7f958bfff700 1 -- 172.21.15.49:0/503394568 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f957805f270 msgr2=0x7f9578061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:39:22.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.649+0000 7f958bfff700 1 --2- 172.21.15.49:0/503394568 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f957805f270 0x7f9578061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T18:39:22.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.672+0000 7f95929cf700 1 -- 172.21.15.49:0/503394568 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f958c0c4f80 con 0x7f958c0c5ea0 2023-11-30T18:39:22.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.673+0000 7f9573fff700 1 -- 172.21.15.49:0/503394568 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v189) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9580018070 con 0x7f958c0c5ea0 2023-11-30T18:39:22.675 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T18:39:22.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.675+0000 7f95929cf700 1 -- 172.21.15.49:0/503394568 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f957805f270 msgr2=0x7f9578061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:39:22.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.675+0000 7f95929cf700 1 --2- 172.21.15.49:0/503394568 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f957805f270 0x7f9578061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:39:22.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.675+0000 7f95929cf700 1 -- 172.21.15.49:0/503394568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f958c0c5ea0 msgr2=0x7f958c161e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:22.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.675+0000 7f95929cf700 1 --2- 172.21.15.49:0/503394568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f958c0c5ea0 0x7f958c161e30 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7f9580001eb0 tx=0x7f9580007e90).stop 2023-11-30T18:39:22.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.675+0000 7f95929cf700 1 -- 172.21.15.49:0/503394568 shutdown_connections 2023-11-30T18:39:22.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.675+0000 7f95929cf700 1 --2- 172.21.15.49:0/503394568 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f957805f270 0x7f9578061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:39:22.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.675+0000 7f95929cf700 1 --2- 172.21.15.49:0/503394568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f958c153390 0x7f958c0c20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:22.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.675+0000 7f95929cf700 1 --2- 172.21.15.49:0/503394568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f958c0c5ac0 0x7f958c092480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:22.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.675+0000 7f95929cf700 1 --2- 172.21.15.49:0/503394568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f958c0c5ea0 0x7f958c161e30 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:22.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.675+0000 7f95929cf700 1 -- 172.21.15.49:0/503394568 >> 172.21.15.49:0/503394568 conn(0x7f958c062700 msgr2=0x7f958c0c6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:22.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.675+0000 7f95929cf700 1 -- 172.21.15.49:0/503394568 shutdown_connections 2023-11-30T18:39:22.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.675+0000 7f95929cf700 1 -- 172.21.15.49:0/503394568 wait complete. 2023-11-30T18:39:22.689 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:39:22.723 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:22.721+0000 7feb1808a680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T18:39:22.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.810+0000 7fe1fabc6700 1 Processor -- start 2023-11-30T18:39:22.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.810+0000 7fe1fabc6700 1 -- start start 2023-11-30T18:39:22.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.811+0000 7fe1fabc6700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe1f41544e0 0x7fe1f41548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:22.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.811+0000 7fe1fabc6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1f40c6e30 0x7fe1f40c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:22.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.811+0000 7fe1fabc6700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f40c69a0 con 0x7fe1f406a610 2023-11-30T18:39:22.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.811+0000 7fe1fabc6700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1f40c13a0 con 0x7fe1f41544e0 2023-11-30T18:39:22.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.811+0000 7fe1fabc6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f40c1680 con 0x7fe1f40c6e30 2023-11-30T18:39:22.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.811+0000 7fe1f3fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe1f406a610 0x7fe1f40c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46060/0 (socket says 172.21.15.49:46060) 2023-11-30T18:39:22.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.811+0000 7fe1f3fff700 1 -- 172.21.15.49:0/1265067665 learned_addr learned my addr 172.21.15.49:0/1265067665 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:22.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.811+0000 7fe1f8962700 1 --2- 172.21.15.49:0/1265067665 >> v2:172.21.15.115:3300/0 conn(0x7fe1f41544e0 0x7fe1f41548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:22.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.811+0000 7fe1f9163700 1 --2- 172.21.15.49:0/1265067665 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1f40c6e30 0x7fe1f40c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:22.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.811+0000 7fe1f37fe700 1 -- 172.21.15.49:0/1265067665 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721353753 0 0) 0x7fe1f40c69a0 con 0x7fe1f406a610 2023-11-30T18:39:22.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.811+0000 7fe1f37fe700 1 -- 172.21.15.49:0/1265067665 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1e40033f0 con 0x7fe1f406a610 2023-11-30T18:39:22.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.811+0000 7fe1f8962700 1 -- 172.21.15.49:0/1265067665 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1f40c6e30 msgr2=0x7fe1f40c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:22.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.811+0000 7fe1f8962700 1 --2- 172.21.15.49:0/1265067665 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1f40c6e30 0x7fe1f40c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:22.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.811+0000 7fe1f8962700 1 -- 172.21.15.49:0/1265067665 >> v1:172.21.15.49:6789/0 conn(0x7fe1f406a610 legacy=0x7fe1f40c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:22.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.811+0000 7fe1f8962700 1 -- 172.21.15.49:0/1265067665 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f40c6630 con 0x7fe1f41544e0 2023-11-30T18:39:22.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.811+0000 7fe1f9163700 1 --2- 172.21.15.49:0/1265067665 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1f40c6e30 0x7fe1f40c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:39:22.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.811+0000 7fe1f8962700 1 --2- 172.21.15.49:0/1265067665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1f41544e0 0x7fe1f41548c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7fe1e8006fd0 tx=0x7fe1e8006f40).ready entity=mon.1 client_cookie=734826ea3ec6fdc8 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:22.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.812+0000 7fe1f37fe700 1 -- 172.21.15.49:0/1265067665 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8005880 con 0x7fe1f41544e0 2023-11-30T18:39:22.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.812+0000 7fe1f37fe700 1 -- 172.21.15.49:0/1265067665 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e80059e0 con 0x7fe1f41544e0 2023-11-30T18:39:22.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.812+0000 7fe1f37fe700 1 -- 172.21.15.49:0/1265067665 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8005d60 con 0x7fe1f41544e0 2023-11-30T18:39:22.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.812+0000 7fe1fabc6700 1 -- 172.21.15.49:0/1265067665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1f41544e0 msgr2=0x7fe1f41548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:22.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.812+0000 7fe1fabc6700 1 --2- 172.21.15.49:0/1265067665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1f41544e0 0x7fe1f41548c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7fe1e8006fd0 tx=0x7fe1e8006f40).stop 2023-11-30T18:39:22.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.812+0000 7fe1fabc6700 1 -- 172.21.15.49:0/1265067665 shutdown_connections 2023-11-30T18:39:22.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.812+0000 7fe1fabc6700 1 --2- 172.21.15.49:0/1265067665 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1f40c6e30 0x7fe1f40c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:22.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.812+0000 7fe1fabc6700 1 --2- 172.21.15.49:0/1265067665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1f41544e0 0x7fe1f41548c0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:22.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.812+0000 7fe1fabc6700 1 -- 172.21.15.49:0/1265067665 >> 172.21.15.49:0/1265067665 conn(0x7fe1f4085020 msgr2=0x7fe1f4094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:22.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.812+0000 7fe1fabc6700 1 -- 172.21.15.49:0/1265067665 shutdown_connections 2023-11-30T18:39:22.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.812+0000 7fe1fabc6700 1 -- 172.21.15.49:0/1265067665 wait complete. 2023-11-30T18:39:22.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.813+0000 7fe1fabc6700 1 Processor -- start 2023-11-30T18:39:22.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.814+0000 7fe1fabc6700 1 -- start start 2023-11-30T18:39:22.819 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:22.814+0000 7fca4d395680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T18:39:22.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.814+0000 7fe1fabc6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1f406a610 0x7fe1f414f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:22.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.814+0000 7fe1fabc6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1f40c6e30 0x7fe1f4095aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:22.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.814+0000 7fe1fabc6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1f41544e0 0x7fe1f4142a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:22.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.814+0000 7fe1fabc6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f414f850 con 0x7fe1f406a610 2023-11-30T18:39:22.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.814+0000 7fe1fabc6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f41658f0 con 0x7fe1f40c6e30 2023-11-30T18:39:22.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.814+0000 7fe1fabc6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f4165b40 con 0x7fe1f41544e0 2023-11-30T18:39:22.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.814+0000 7fe1f8962700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1f406a610 0x7fe1f414f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:22.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.814+0000 7fe1f8962700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1f406a610 0x7fe1f414f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38856/0 (socket says 172.21.15.49:38856) 2023-11-30T18:39:22.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.814+0000 7fe1f8962700 1 -- 172.21.15.49:0/2722559004 learned_addr learned my addr 172.21.15.49:0/2722559004 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:22.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.814+0000 7fe1f9163700 1 --2- 172.21.15.49:0/2722559004 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1f41544e0 0x7fe1f4142a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:22.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.814+0000 7fe1f3fff700 1 --2- 172.21.15.49:0/2722559004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1f40c6e30 0x7fe1f4095aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:22.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.815+0000 7fe1f8962700 1 -- 172.21.15.49:0/2722559004 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1f41544e0 msgr2=0x7fe1f4142a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:22.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.815+0000 7fe1f8962700 1 --2- 172.21.15.49:0/2722559004 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1f41544e0 0x7fe1f4142a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:22.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.815+0000 7fe1f8962700 1 -- 172.21.15.49:0/2722559004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1f40c6e30 msgr2=0x7fe1f4095aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:22.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.815+0000 7fe1f8962700 1 --2- 172.21.15.49:0/2722559004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1f40c6e30 0x7fe1f4095aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:22.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.815+0000 7fe1f8962700 1 -- 172.21.15.49:0/2722559004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ec009a20 con 0x7fe1f406a610 2023-11-30T18:39:22.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.815+0000 7fe1f8962700 1 --2- 172.21.15.49:0/2722559004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1f406a610 0x7fe1f414f360 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7fe1f405fb30 tx=0x7fe1e8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:22.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.815+0000 7fe1f0ff9700 1 -- 172.21.15.49:0/2722559004 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e800d6b0 con 0x7fe1f406a610 2023-11-30T18:39:22.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.815+0000 7fe1f0ff9700 1 -- 172.21.15.49:0/2722559004 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e800d810 con 0x7fe1f406a610 2023-11-30T18:39:22.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.815+0000 7fe1f0ff9700 1 -- 172.21.15.49:0/2722559004 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e800dbd0 con 0x7fe1f406a610 2023-11-30T18:39:22.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.815+0000 7fe1fabc6700 1 -- 172.21.15.49:0/2722559004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e8009250 con 0x7fe1f406a610 2023-11-30T18:39:22.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.815+0000 7fe1fabc6700 1 -- 172.21.15.49:0/2722559004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f4166100 con 0x7fe1f406a610 2023-11-30T18:39:22.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.816+0000 7fe1fabc6700 1 -- 172.21.15.49:0/2722559004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f406c860 con 0x7fe1f406a610 2023-11-30T18:39:22.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.817+0000 7fe1f0ff9700 1 -- 172.21.15.49:0/2722559004 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 87) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fe1e80113f0 con 0x7fe1f406a610 2023-11-30T18:39:22.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.817+0000 7fe1f0ff9700 1 --2- 172.21.15.49:0/2722559004 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe1d805f270 0x7fe1d8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:22.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.817+0000 7fe1f3fff700 1 -- 172.21.15.49:0/2722559004 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe1d805f270 msgr2=0x7fe1d8061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:39:22.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.817+0000 7fe1f0ff9700 1 -- 172.21.15.49:0/2722559004 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fe1e807bc00 con 0x7fe1f406a610 2023-11-30T18:39:22.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.817+0000 7fe1f3fff700 1 --2- 172.21.15.49:0/2722559004 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe1d805f270 0x7fe1d8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:39:22.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:22.821+0000 7fe1f0ff9700 1 -- 172.21.15.49:0/2722559004 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe1e804cb30 con 0x7fe1f406a610 2023-11-30T18:39:22.999 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:22.998+0000 7fca4d395680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T18:39:23.001 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:23.000+0000 7feb1808a680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T18:39:23.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.018+0000 7fe1f3fff700 1 -- 172.21.15.49:0/2722559004 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe1d805f270 msgr2=0x7fe1d8061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:39:23.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.018+0000 7fe1f3fff700 1 --2- 172.21.15.49:0/2722559004 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe1d805f270 0x7fe1d8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T18:39:23.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.037+0000 7fe1fabc6700 1 -- 172.21.15.49:0/2722559004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1f40c6250 con 0x7fe1f406a610 2023-11-30T18:39:23.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.038+0000 7fe1f0ff9700 1 -- 172.21.15.49:0/2722559004 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4499 (secure 0 0 0) 0x7fe1e8023020 con 0x7fe1f406a610 2023-11-30T18:39:23.040 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:39:23.040 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":77,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1849144206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1849144206},{"type":"v1","addr":"172.21.15.115:6837","nonce":1849144206}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":8686,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/3927708641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3927708641},{"type":"v1","addr":"172.21.15.115:6836","nonce":3927708641}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":8934,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3388701250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3388701250},{"type":"v1","addr":"172.21.15.49:6835","nonce":3388701250}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T18:23:12.095964+0000","modified":"2023-11-30T18:23:15.119579+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8937},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8937":{"gid":8937,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/3993546381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3993546381},{"type":"v1","addr":"172.21.15.49:6834","nonce":3993546381}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-11-30T18:39:23.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.040+0000 7fe1fabc6700 1 -- 172.21.15.49:0/2722559004 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe1d805f270 msgr2=0x7fe1d8061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:39:23.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.040+0000 7fe1fabc6700 1 --2- 172.21.15.49:0/2722559004 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe1d805f270 0x7fe1d8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:39:23.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.040+0000 7fe1fabc6700 1 -- 172.21.15.49:0/2722559004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1f406a610 msgr2=0x7fe1f414f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:23.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.040+0000 7fe1fabc6700 1 --2- 172.21.15.49:0/2722559004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1f406a610 0x7fe1f414f360 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7fe1f405fb30 tx=0x7fe1e8015000).stop 2023-11-30T18:39:23.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.040+0000 7fe1fabc6700 1 -- 172.21.15.49:0/2722559004 shutdown_connections 2023-11-30T18:39:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.040+0000 7fe1fabc6700 1 --2- 172.21.15.49:0/2722559004 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe1d805f270 0x7fe1d8061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:39:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.040+0000 7fe1fabc6700 1 --2- 172.21.15.49:0/2722559004 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1f41544e0 0x7fe1f4142a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.040+0000 7fe1fabc6700 1 --2- 172.21.15.49:0/2722559004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1f406a610 0x7fe1f414f360 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.040+0000 7fe1fabc6700 1 --2- 172.21.15.49:0/2722559004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1f40c6e30 0x7fe1f4095aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.040+0000 7fe1fabc6700 1 -- 172.21.15.49:0/2722559004 >> 172.21.15.49:0/2722559004 conn(0x7fe1f4085020 msgr2=0x7fe1f4064d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.040+0000 7fe1fabc6700 1 -- 172.21.15.49:0/2722559004 shutdown_connections 2023-11-30T18:39:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.040+0000 7fe1fabc6700 1 -- 172.21.15.49:0/2722559004 wait complete. 2023-11-30T18:39:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 77 2023-11-30T18:39:23.055 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:39:23.197 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:23.195+0000 7feb1808a680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T18:39:23.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.216+0000 7f70439a2700 1 Processor -- start 2023-11-30T18:39:23.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.216+0000 7f70439a2700 1 -- start start 2023-11-30T18:39:23.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.217+0000 7f70439a2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f703c068090 0x7f703c0c2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:23.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.217+0000 7f70439a2700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f703c0a7490 con 0x7f703c0c45d0 2023-11-30T18:39:23.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.217+0000 7f70439a2700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f703c154d20 con 0x7f703c067cb0 2023-11-30T18:39:23.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.217+0000 7f70439a2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f703c151670 con 0x7f703c068090 2023-11-30T18:39:23.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.217+0000 7f7040f3d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f703c0c45d0 0x7f703c0c2640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46074/0 (socket says 172.21.15.49:46074) 2023-11-30T18:39:23.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.217+0000 7f7040f3d700 1 -- 172.21.15.49:0/1779422023 learned_addr learned my addr 172.21.15.49:0/1779422023 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:23.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.217+0000 7f7041f3f700 1 --2- 172.21.15.49:0/1779422023 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f703c068090 0x7f703c0c2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:23.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.217+0000 7f7033fff700 1 -- 172.21.15.49:0/1779422023 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330274154 0 0) 0x7f702c001110 con 0x7f703c0c45d0 2023-11-30T18:39:23.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.217+0000 7f7033fff700 1 -- 172.21.15.49:0/1779422023 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70280033f0 con 0x7f703c0c45d0 2023-11-30T18:39:23.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.217+0000 7f7033fff700 1 -- 172.21.15.49:0/1779422023 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3039188147 0 0) 0x7f703c154d20 con 0x7f703c067cb0 2023-11-30T18:39:23.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.217+0000 7f7033fff700 1 -- 172.21.15.49:0/1779422023 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f702c001110 con 0x7f703c067cb0 2023-11-30T18:39:23.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.217+0000 7f7041f3f700 1 -- 172.21.15.49:0/1779422023 >> v1:172.21.15.115:6789/0 conn(0x7f703c067cb0 legacy=0x7f703c0c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:23.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.217+0000 7f7041f3f700 1 -- 172.21.15.49:0/1779422023 >> v1:172.21.15.49:6789/0 conn(0x7f703c0c45d0 legacy=0x7f703c0c2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:23.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.217+0000 7f7041f3f700 1 -- 172.21.15.49:0/1779422023 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703c1555c0 con 0x7f703c068090 2023-11-30T18:39:23.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.218+0000 7f7041f3f700 1 --2- 172.21.15.49:0/1779422023 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f703c068090 0x7f703c0c2d50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f7034009e90 tx=0x7f7034009780).ready entity=mon.2 client_cookie=ff5d536592ab2590 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:23.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.218+0000 7f7033fff700 1 -- 172.21.15.49:0/1779422023 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703400e070 con 0x7f703c068090 2023-11-30T18:39:23.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.218+0000 7f7033fff700 1 -- 172.21.15.49:0/1779422023 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703400bab0 con 0x7f703c068090 2023-11-30T18:39:23.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.218+0000 7f7033fff700 1 -- 172.21.15.49:0/1779422023 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703400be30 con 0x7f703c068090 2023-11-30T18:39:23.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.218+0000 7f70439a2700 1 -- 172.21.15.49:0/1779422023 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f703c068090 msgr2=0x7f703c0c2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:23.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.218+0000 7f70439a2700 1 --2- 172.21.15.49:0/1779422023 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f703c068090 0x7f703c0c2d50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f7034009e90 tx=0x7f7034009780).stop 2023-11-30T18:39:23.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.218+0000 7f70439a2700 1 -- 172.21.15.49:0/1779422023 shutdown_connections 2023-11-30T18:39:23.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.218+0000 7f70439a2700 1 --2- 172.21.15.49:0/1779422023 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f703c068090 0x7f703c0c2d50 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:23.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.218+0000 7f70439a2700 1 -- 172.21.15.49:0/1779422023 >> 172.21.15.49:0/1779422023 conn(0x7f703c0c7fd0 msgr2=0x7f703c0c83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:23.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.218+0000 7f70439a2700 1 -- 172.21.15.49:0/1779422023 shutdown_connections 2023-11-30T18:39:23.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.218+0000 7f70439a2700 1 -- 172.21.15.49:0/1779422023 wait complete. 2023-11-30T18:39:23.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.220+0000 7f70439a2700 1 Processor -- start 2023-11-30T18:39:23.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.220+0000 7f70439a2700 1 -- start start 2023-11-30T18:39:23.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.221+0000 7f70439a2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f703c067cb0 0x7f703c152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:23.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.221+0000 7f70439a2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f703c068090 0x7f703c1542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:23.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.221+0000 7f70439a2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f703c0c45d0 0x7f703c150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:23.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.221+0000 7f70439a2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c0aaa90 con 0x7f703c068090 2023-11-30T18:39:23.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.221+0000 7f70439a2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c152fd0 con 0x7f703c0c45d0 2023-11-30T18:39:23.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.221+0000 7f70439a2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f703c153250 con 0x7f703c067cb0 2023-11-30T18:39:23.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.221+0000 7f7040f3d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f703c068090 0x7f703c1542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:23.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.221+0000 7f7040f3d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f703c068090 0x7f703c1542f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38858/0 (socket says 172.21.15.49:38858) 2023-11-30T18:39:23.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.221+0000 7f7040f3d700 1 -- 172.21.15.49:0/1875551687 learned_addr learned my addr 172.21.15.49:0/1875551687 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:23.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.221+0000 7f7041f3f700 1 --2- 172.21.15.49:0/1875551687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f703c0c45d0 0x7f703c150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:23.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.221+0000 7f704173e700 1 --2- 172.21.15.49:0/1875551687 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f703c067cb0 0x7f703c152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:23.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.221+0000 7f7040f3d700 1 -- 172.21.15.49:0/1875551687 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f703c067cb0 msgr2=0x7f703c152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:23.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.221+0000 7f7040f3d700 1 --2- 172.21.15.49:0/1875551687 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f703c067cb0 0x7f703c152ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:23.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.221+0000 7f7040f3d700 1 -- 172.21.15.49:0/1875551687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f703c0c45d0 msgr2=0x7f703c150750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:23.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.221+0000 7f7040f3d700 1 --2- 172.21.15.49:0/1875551687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f703c0c45d0 0x7f703c150750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:23.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.221+0000 7f7040f3d700 1 -- 172.21.15.49:0/1875551687 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7034009a20 con 0x7f703c068090 2023-11-30T18:39:23.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.221+0000 7f7040f3d700 1 --2- 172.21.15.49:0/1875551687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f703c068090 0x7f703c1542f0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7f702c00c580 tx=0x7f702c007cc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:23.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.221+0000 7f70317fa700 1 -- 172.21.15.49:0/1875551687 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c0072e0 con 0x7f703c068090 2023-11-30T18:39:23.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.221+0000 7f70439a2700 1 -- 172.21.15.49:0/1875551687 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703c153530 con 0x7f703c068090 2023-11-30T18:39:23.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.221+0000 7f70317fa700 1 -- 172.21.15.49:0/1875551687 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702c007440 con 0x7f703c068090 2023-11-30T18:39:23.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.221+0000 7f70317fa700 1 -- 172.21.15.49:0/1875551687 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c0057a0 con 0x7f703c068090 2023-11-30T18:39:23.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.221+0000 7f70439a2700 1 -- 172.21.15.49:0/1875551687 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f703c153af0 con 0x7f703c068090 2023-11-30T18:39:23.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.223+0000 7f70439a2700 1 -- 172.21.15.49:0/1875551687 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f703c06c860 con 0x7f703c068090 2023-11-30T18:39:23.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.223+0000 7f70317fa700 1 -- 172.21.15.49:0/1875551687 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 87) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f702c005b90 con 0x7f703c068090 2023-11-30T18:39:23.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.223+0000 7f70317fa700 1 --2- 172.21.15.49:0/1875551687 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f702005f270 0x7f7020061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:23.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.223+0000 7f70317fa700 1 -- 172.21.15.49:0/1875551687 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f702c079cf0 con 0x7f703c068090 2023-11-30T18:39:23.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.223+0000 7f704173e700 1 -- 172.21.15.49:0/1875551687 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f702005f270 msgr2=0x7f7020061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:39:23.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.223+0000 7f704173e700 1 --2- 172.21.15.49:0/1875551687 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f702005f270 0x7f7020061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:39:23.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.227+0000 7f70317fa700 1 -- 172.21.15.49:0/1875551687 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f702c04abd0 con 0x7f703c068090 2023-11-30T18:39:23.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.417+0000 7f70439a2700 1 -- 172.21.15.49:0/1875551687 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f703c0a7490 con 0x7f703c068090 2023-11-30T18:39:23.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.418+0000 7f70317fa700 1 -- 172.21.15.49:0/1875551687 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) v1 ==== 74+0+17916 (secure 0 0 0) 0x7f703c0a7490 con 0x7f703c068090 2023-11-30T18:39:23.420 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:39:23.421 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":189,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:39:22.303897+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-11-30T18:23:10.276504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-11-30T18:23:11.078075+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":189,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.1b","mappings":[{"from":4,"to":3}]},{"pgid":"22.1","mappings":[{"from":3,"to":0}]},{"pgid":"22.2b","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/3122997899":"2023-12-01T18:34:21.516339+0000","172.21.15.115:0/3737718649":"2023-12-01T18:34:21.516339+0000","172.21.15.115:0/3726314103":"2023-12-01T18:34:21.516339+0000","172.21.15.115:0/1769486452":"2023-12-01T18:34:21.516339+0000","172.21.15.115:0/1587740371":"2023-12-01T18:23:28.950282+0000","172.21.15.115:0/3015522460":"2023-12-01T18:23:28.950282+0000","172.21.15.115:6833/89956":"2023-12-01T18:23:28.950282+0000","172.21.15.115:6832/89956":"2023-12-01T18:23:28.950282+0000","172.21.15.115:0/3750792535":"2023-12-01T18:23:28.950282+0000","172.21.15.115:0/2529631022":"2023-12-01T18:23:28.950282+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:39:23.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.420+0000 7f70439a2700 1 -- 172.21.15.49:0/1875551687 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f702005f270 msgr2=0x7f7020061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:39:23.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.420+0000 7f70439a2700 1 --2- 172.21.15.49:0/1875551687 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f702005f270 0x7f7020061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:39:23.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.420+0000 7f70439a2700 1 -- 172.21.15.49:0/1875551687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f703c068090 msgr2=0x7f703c1542f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:23.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.420+0000 7f70439a2700 1 --2- 172.21.15.49:0/1875551687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f703c068090 0x7f703c1542f0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7f702c00c580 tx=0x7f702c007cc0).stop 2023-11-30T18:39:23.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.420+0000 7f70439a2700 1 -- 172.21.15.49:0/1875551687 shutdown_connections 2023-11-30T18:39:23.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.420+0000 7f70439a2700 1 --2- 172.21.15.49:0/1875551687 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f702005f270 0x7f7020061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:39:23.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.420+0000 7f70439a2700 1 --2- 172.21.15.49:0/1875551687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f703c0c45d0 0x7f703c150750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:23.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.420+0000 7f70439a2700 1 --2- 172.21.15.49:0/1875551687 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f703c067cb0 0x7f703c152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:23.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.420+0000 7f70439a2700 1 --2- 172.21.15.49:0/1875551687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f703c068090 0x7f703c1542f0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:23.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.420+0000 7f70439a2700 1 -- 172.21.15.49:0/1875551687 >> 172.21.15.49:0/1875551687 conn(0x7f703c0c7fd0 msgr2=0x7f703c0c5da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:23.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.421+0000 7f70439a2700 1 -- 172.21.15.49:0/1875551687 shutdown_connections 2023-11-30T18:39:23.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.421+0000 7f70439a2700 1 -- 172.21.15.49:0/1875551687 wait complete. 2023-11-30T18:39:23.435 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-30T18:39:23.435 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:39:23.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.552+0000 7f4d64f69700 1 Processor -- start 2023-11-30T18:39:23.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.553+0000 7f4d64f69700 1 -- start start 2023-11-30T18:39:23.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.553+0000 7f4d64f69700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4d60154230 0x7f4d600a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:23.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.553+0000 7f4d64f69700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4d600c2cb0 0x7f4d600a6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:23.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.553+0000 7f4d64f69700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d600c2540 con 0x7f4d60062700 2023-11-30T18:39:23.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.553+0000 7f4d64f69700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d600a4f70 con 0x7f4d60154230 2023-11-30T18:39:23.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.553+0000 7f4d64f69700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d600a5250 con 0x7f4d600c2cb0 2023-11-30T18:39:23.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.554+0000 7f4d5f7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4d60154230 0x7f4d600a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:23.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.554+0000 7f4d5ffff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4d60062700 0x7f4d60062b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46082/0 (socket says 172.21.15.49:46082) 2023-11-30T18:39:23.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.554+0000 7f4d5ffff700 1 -- 172.21.15.49:0/63364077 learned_addr learned my addr 172.21.15.49:0/63364077 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:23.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.554+0000 7f4d56ffd700 1 --2- 172.21.15.49:0/63364077 >> v2:172.21.15.115:3300/0 conn(0x7f4d600c2cb0 0x7f4d600a6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:23.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.554+0000 7f4d5f7fe700 1 -- 172.21.15.49:0/63364077 >> v2:172.21.15.115:3300/0 conn(0x7f4d600c2cb0 msgr2=0x7f4d600a6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.554+0000 7f4d5f7fe700 1 --2- 172.21.15.49:0/63364077 >> v2:172.21.15.115:3300/0 conn(0x7f4d600c2cb0 0x7f4d600a6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.554+0000 7f4d5f7fe700 1 -- 172.21.15.49:0/63364077 >> v1:172.21.15.49:6789/0 conn(0x7f4d60062700 legacy=0x7f4d60062b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.554+0000 7f4d5f7fe700 1 -- 172.21.15.49:0/63364077 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d600a5530 con 0x7f4d60154230 2023-11-30T18:39:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.554+0000 7f4d5effd700 1 -- 172.21.15.49:0/63364077 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3296401721 0 0) 0x7f4d600c2540 con 0x7f4d60062700 2023-11-30T18:39:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.554+0000 7f4d5f7fe700 1 --2- 172.21.15.49:0/63364077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d60154230 0x7f4d600a48e0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 rx=0x7f4d600a7790 tx=0x7f4d50009060).ready entity=mon.0 client_cookie=746b496e0d984375 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.554+0000 7f4d5effd700 1 -- 172.21.15.49:0/63364077 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5000f510 con 0x7f4d60154230 2023-11-30T18:39:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.554+0000 7f4d5effd700 1 -- 172.21.15.49:0/63364077 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5000f670 con 0x7f4d60154230 2023-11-30T18:39:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.554+0000 7f4d5effd700 1 -- 172.21.15.49:0/63364077 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5000f9f0 con 0x7f4d60154230 2023-11-30T18:39:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.555+0000 7f4d64f69700 1 -- 172.21.15.49:0/63364077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d60154230 msgr2=0x7f4d600a48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.555+0000 7f4d64f69700 1 --2- 172.21.15.49:0/63364077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d60154230 0x7f4d600a48e0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 rx=0x7f4d600a7790 tx=0x7f4d50009060).stop 2023-11-30T18:39:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.555+0000 7f4d64f69700 1 -- 172.21.15.49:0/63364077 shutdown_connections 2023-11-30T18:39:23.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.555+0000 7f4d64f69700 1 --2- 172.21.15.49:0/63364077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d60154230 0x7f4d600a48e0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:23.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.555+0000 7f4d64f69700 1 --2- 172.21.15.49:0/63364077 >> v2:172.21.15.115:3300/0 conn(0x7f4d600c2cb0 0x7f4d600a6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:23.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.555+0000 7f4d64f69700 1 -- 172.21.15.49:0/63364077 >> 172.21.15.49:0/63364077 conn(0x7f4d600c7ca0 msgr2=0x7f4d600c80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:23.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.555+0000 7f4d64f69700 1 -- 172.21.15.49:0/63364077 shutdown_connections 2023-11-30T18:39:23.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.555+0000 7f4d64f69700 1 -- 172.21.15.49:0/63364077 wait complete. 2023-11-30T18:39:23.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.556+0000 7f4d64f69700 1 Processor -- start 2023-11-30T18:39:23.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.556+0000 7f4d64f69700 1 -- start start 2023-11-30T18:39:23.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.557+0000 7f4d64f69700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d60062700 0x7f4d60167880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:23.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.557+0000 7f4d64f69700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d600c2cb0 0x7f4d600c1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:23.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.557+0000 7f4d64f69700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d60154230 0x7f4d600bd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:23.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.557+0000 7f4d64f69700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d60167d70 con 0x7f4d600c2cb0 2023-11-30T18:39:23.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.557+0000 7f4d64f69700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d600a8500 con 0x7f4d60154230 2023-11-30T18:39:23.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.557+0000 7f4d64f69700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d600a78f0 con 0x7f4d60062700 2023-11-30T18:39:23.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.557+0000 7f4d56ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d600c2cb0 0x7f4d600c1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:23.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.557+0000 7f4d56ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d600c2cb0 0x7f4d600c1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38880/0 (socket says 172.21.15.49:38880) 2023-11-30T18:39:23.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.557+0000 7f4d56ffd700 1 -- 172.21.15.49:0/657055381 learned_addr learned my addr 172.21.15.49:0/657055381 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:23.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.557+0000 7f4d5ffff700 1 --2- 172.21.15.49:0/657055381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d60154230 0x7f4d600bd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:23.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.557+0000 7f4d5f7fe700 1 --2- 172.21.15.49:0/657055381 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d60062700 0x7f4d60167880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:23.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.557+0000 7f4d56ffd700 1 -- 172.21.15.49:0/657055381 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d60062700 msgr2=0x7f4d60167880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:23.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.557+0000 7f4d56ffd700 1 --2- 172.21.15.49:0/657055381 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d60062700 0x7f4d60167880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:23.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.557+0000 7f4d56ffd700 1 -- 172.21.15.49:0/657055381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d60154230 msgr2=0x7f4d600bd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:23.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.557+0000 7f4d56ffd700 1 --2- 172.21.15.49:0/657055381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d60154230 0x7f4d600bd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:23.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.557+0000 7f4d56ffd700 1 -- 172.21.15.49:0/657055381 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d500092a0 con 0x7f4d600c2cb0 2023-11-30T18:39:23.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.558+0000 7f4d56ffd700 1 --2- 172.21.15.49:0/657055381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d600c2cb0 0x7f4d600c1650 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7f4d4800e930 tx=0x7f4d48009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:23.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.558+0000 7f4d57fff700 1 -- 172.21.15.49:0/657055381 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d48012600 con 0x7f4d600c2cb0 2023-11-30T18:39:23.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.558+0000 7f4d57fff700 1 -- 172.21.15.49:0/657055381 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d48012760 con 0x7f4d600c2cb0 2023-11-30T18:39:23.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.558+0000 7f4d64f69700 1 -- 172.21.15.49:0/657055381 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d600a7bd0 con 0x7f4d600c2cb0 2023-11-30T18:39:23.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.558+0000 7f4d57fff700 1 -- 172.21.15.49:0/657055381 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d48012ae0 con 0x7f4d600c2cb0 2023-11-30T18:39:23.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.558+0000 7f4d64f69700 1 -- 172.21.15.49:0/657055381 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d600a8190 con 0x7f4d600c2cb0 2023-11-30T18:39:23.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.559+0000 7f4d64f69700 1 -- 172.21.15.49:0/657055381 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6006c7c0 con 0x7f4d600c2cb0 2023-11-30T18:39:23.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.559+0000 7f4d57fff700 1 -- 172.21.15.49:0/657055381 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 87) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f4d4801b400 con 0x7f4d600c2cb0 2023-11-30T18:39:23.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.560+0000 7f4d57fff700 1 --2- 172.21.15.49:0/657055381 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4d4005f270 0x7f4d40061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:23.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.560+0000 7f4d5f7fe700 1 -- 172.21.15.49:0/657055381 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4d4005f270 msgr2=0x7f4d40061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:39:23.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.560+0000 7f4d57fff700 1 -- 172.21.15.49:0/657055381 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f4d4807aa30 con 0x7f4d600c2cb0 2023-11-30T18:39:23.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.560+0000 7f4d5f7fe700 1 --2- 172.21.15.49:0/657055381 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4d4005f270 0x7f4d40061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:39:23.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.568+0000 7f4d57fff700 1 -- 172.21.15.49:0/657055381 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4d4807ce60 con 0x7f4d600c2cb0 2023-11-30T18:39:23.653 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:23.652+0000 7fca4d395680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T18:39:23.722 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:23.721+0000 7fca4d395680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T18:39:23.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.761+0000 7f4d5f7fe700 1 -- 172.21.15.49:0/657055381 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4d4005f270 msgr2=0x7f4d40061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:39:23.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.761+0000 7f4d5f7fe700 1 --2- 172.21.15.49:0/657055381 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4d4005f270 0x7f4d40061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T18:39:23.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.784+0000 7f4d64f69700 1 -- 172.21.15.49:0/657055381 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d600a5810 con 0x7f4d600c2cb0 2023-11-30T18:39:23.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.784+0000 7f4d57fff700 1 -- 172.21.15.49:0/657055381 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4499 (secure 0 0 0) 0x7f4d4804b8b0 con 0x7f4d600c2cb0 2023-11-30T18:39:23.786 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:39:23.786 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":77,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1849144206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1849144206},{"type":"v1","addr":"172.21.15.115:6837","nonce":1849144206}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":8686,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/3927708641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3927708641},{"type":"v1","addr":"172.21.15.115:6836","nonce":3927708641}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":8934,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3388701250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3388701250},{"type":"v1","addr":"172.21.15.49:6835","nonce":3388701250}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T18:23:12.095964+0000","modified":"2023-11-30T18:23:15.119579+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8937},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8937":{"gid":8937,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/3993546381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3993546381},{"type":"v1","addr":"172.21.15.49:6834","nonce":3993546381}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-11-30T18:39:23.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.786+0000 7f4d64f69700 1 -- 172.21.15.49:0/657055381 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4d4005f270 msgr2=0x7f4d40061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:39:23.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.786+0000 7f4d64f69700 1 --2- 172.21.15.49:0/657055381 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4d4005f270 0x7f4d40061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:39:23.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.786+0000 7f4d64f69700 1 -- 172.21.15.49:0/657055381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d600c2cb0 msgr2=0x7f4d600c1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:23.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.786+0000 7f4d64f69700 1 --2- 172.21.15.49:0/657055381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d600c2cb0 0x7f4d600c1650 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7f4d4800e930 tx=0x7f4d48009060).stop 2023-11-30T18:39:23.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.786+0000 7f4d64f69700 1 -- 172.21.15.49:0/657055381 shutdown_connections 2023-11-30T18:39:23.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.786+0000 7f4d64f69700 1 --2- 172.21.15.49:0/657055381 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4d4005f270 0x7f4d40061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:39:23.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.786+0000 7f4d64f69700 1 --2- 172.21.15.49:0/657055381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d60154230 0x7f4d600bd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:23.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.786+0000 7f4d64f69700 1 --2- 172.21.15.49:0/657055381 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d60062700 0x7f4d60167880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:23.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.786+0000 7f4d64f69700 1 --2- 172.21.15.49:0/657055381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d600c2cb0 0x7f4d600c1650 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:23.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.786+0000 7f4d64f69700 1 -- 172.21.15.49:0/657055381 >> 172.21.15.49:0/657055381 conn(0x7f4d600c7ca0 msgr2=0x7f4d600bde70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:23.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.786+0000 7f4d64f69700 1 -- 172.21.15.49:0/657055381 shutdown_connections 2023-11-30T18:39:23.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.787+0000 7f4d64f69700 1 -- 172.21.15.49:0/657055381 wait complete. 2023-11-30T18:39:23.790 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 77 2023-11-30T18:39:23.799 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:23.797+0000 7fca4d395680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T18:39:23.802 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:39:23.915 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:23.913+0000 7feb1808a680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T18:39:23.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.921+0000 7f5be01f4700 1 Processor -- start 2023-11-30T18:39:23.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.922+0000 7f5be01f4700 1 -- start start 2023-11-30T18:39:23.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.923+0000 7f5be01f4700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5bd81548c0 0x7f5bd806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:23.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.923+0000 7f5be01f4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bd80c6e30 0x7f5bd80c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:23.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.923+0000 7f5be01f4700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bd80c69a0 con 0x7f5bd81544e0 2023-11-30T18:39:23.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.923+0000 7f5be01f4700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bd80c13a0 con 0x7f5bd81548c0 2023-11-30T18:39:23.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.923+0000 7f5be01f4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd80c1680 con 0x7f5bd80c6e30 2023-11-30T18:39:23.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.923+0000 7f5bdd78f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5bd81548c0 0x7f5bd806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:23.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.923+0000 7f5bdd78f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5bd81548c0 0x7f5bd806a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38888/0 (socket says 172.21.15.49:38888) 2023-11-30T18:39:23.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.923+0000 7f5bdd78f700 1 -- 172.21.15.49:0/4229194501 learned_addr learned my addr 172.21.15.49:0/4229194501 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:23.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.923+0000 7f5bde791700 1 --2- 172.21.15.49:0/4229194501 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bd80c6e30 0x7f5bd80c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:23.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.923+0000 7f5bdd78f700 1 -- 172.21.15.49:0/4229194501 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bd80c6e30 msgr2=0x7f5bd80c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:23.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.923+0000 7f5bdd78f700 1 --2- 172.21.15.49:0/4229194501 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bd80c6e30 0x7f5bd80c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:23.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.923+0000 7f5bdd78f700 1 -- 172.21.15.49:0/4229194501 >> v1:172.21.15.115:6789/0 conn(0x7f5bd81544e0 legacy=0x7f5bd80c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:23.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.923+0000 7f5bdd78f700 1 -- 172.21.15.49:0/4229194501 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd80c6630 con 0x7f5bd81548c0 2023-11-30T18:39:23.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.923+0000 7f5bdd78f700 1 --2- 172.21.15.49:0/4229194501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bd81548c0 0x7f5bd806a610 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 rx=0x7f5bd4006fd0 tx=0x7f5bd40090f0).ready entity=mon.0 client_cookie=ce0a0ecbb47dcd28 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:23.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.923+0000 7f5bdcf8e700 1 -- 172.21.15.49:0/4229194501 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd400b580 con 0x7f5bd81548c0 2023-11-30T18:39:23.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.923+0000 7f5bdcf8e700 1 -- 172.21.15.49:0/4229194501 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd400b6e0 con 0x7f5bd81548c0 2023-11-30T18:39:23.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.923+0000 7f5bdcf8e700 1 -- 172.21.15.49:0/4229194501 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd400ba60 con 0x7f5bd81548c0 2023-11-30T18:39:23.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.924+0000 7f5be01f4700 1 -- 172.21.15.49:0/4229194501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bd81548c0 msgr2=0x7f5bd806a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:23.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.924+0000 7f5be01f4700 1 --2- 172.21.15.49:0/4229194501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bd81548c0 0x7f5bd806a610 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 rx=0x7f5bd4006fd0 tx=0x7f5bd40090f0).stop 2023-11-30T18:39:23.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.924+0000 7f5be01f4700 1 -- 172.21.15.49:0/4229194501 shutdown_connections 2023-11-30T18:39:23.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.924+0000 7f5be01f4700 1 --2- 172.21.15.49:0/4229194501 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bd80c6e30 0x7f5bd80c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:23.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.924+0000 7f5be01f4700 1 --2- 172.21.15.49:0/4229194501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bd81548c0 0x7f5bd806a610 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:23.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.924+0000 7f5be01f4700 1 -- 172.21.15.49:0/4229194501 >> 172.21.15.49:0/4229194501 conn(0x7f5bd8085020 msgr2=0x7f5bd8094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:23.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.924+0000 7f5be01f4700 1 -- 172.21.15.49:0/4229194501 shutdown_connections 2023-11-30T18:39:23.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.924+0000 7f5be01f4700 1 -- 172.21.15.49:0/4229194501 wait complete. 2023-11-30T18:39:23.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.925+0000 7f5be01f4700 1 Processor -- start 2023-11-30T18:39:23.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.926+0000 7f5be01f4700 1 -- start start 2023-11-30T18:39:23.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.926+0000 7f5be01f4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5bd80c6e30 0x7f5bd8096f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:23.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.926+0000 7f5be01f4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bd81544e0 0x7f5bd814fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:23.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.926+0000 7f5be01f4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bd81548c0 0x7f5bd8142900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:23.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.926+0000 7f5be01f4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd8098fd0 con 0x7f5bd81548c0 2023-11-30T18:39:23.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.926+0000 7f5be01f4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd80950a0 con 0x7f5bd80c6e30 2023-11-30T18:39:23.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.926+0000 7f5be01f4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd80952f0 con 0x7f5bd81544e0 2023-11-30T18:39:23.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.926+0000 7f5bde791700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bd81548c0 0x7f5bd8142900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:23.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.926+0000 7f5bde791700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bd81548c0 0x7f5bd8142900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38902/0 (socket says 172.21.15.49:38902) 2023-11-30T18:39:23.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.926+0000 7f5bde791700 1 -- 172.21.15.49:0/2763278476 learned_addr learned my addr 172.21.15.49:0/2763278476 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:23.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.926+0000 7f5bdd78f700 1 --2- 172.21.15.49:0/2763278476 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bd81544e0 0x7f5bd814fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:23.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.926+0000 7f5bddf90700 1 --2- 172.21.15.49:0/2763278476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5bd80c6e30 0x7f5bd8096f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:23.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.927+0000 7f5bde791700 1 -- 172.21.15.49:0/2763278476 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bd81544e0 msgr2=0x7f5bd814fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:23.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.927+0000 7f5bde791700 1 --2- 172.21.15.49:0/2763278476 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bd81544e0 0x7f5bd814fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:23.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.927+0000 7f5bde791700 1 -- 172.21.15.49:0/2763278476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5bd80c6e30 msgr2=0x7f5bd8096f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:23.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.927+0000 7f5bde791700 1 --2- 172.21.15.49:0/2763278476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5bd80c6e30 0x7f5bd8096f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:23.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.927+0000 7f5bde791700 1 -- 172.21.15.49:0/2763278476 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd4009370 con 0x7f5bd81548c0 2023-11-30T18:39:23.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.927+0000 7f5bde791700 1 --2- 172.21.15.49:0/2763278476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bd81548c0 0x7f5bd8142900 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7f5bd0009df0 tx=0x7f5bd000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:23.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.927+0000 7f5bcdffb700 1 -- 172.21.15.49:0/2763278476 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd000caa0 con 0x7f5bd81548c0 2023-11-30T18:39:23.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.927+0000 7f5bcdffb700 1 -- 172.21.15.49:0/2763278476 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd000f040 con 0x7f5bd81548c0 2023-11-30T18:39:23.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.927+0000 7f5be01f4700 1 -- 172.21.15.49:0/2763278476 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd80955d0 con 0x7f5bd81548c0 2023-11-30T18:39:23.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.927+0000 7f5bcdffb700 1 -- 172.21.15.49:0/2763278476 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd000ce10 con 0x7f5bd81548c0 2023-11-30T18:39:23.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.927+0000 7f5be01f4700 1 -- 172.21.15.49:0/2763278476 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd8095b90 con 0x7f5bd81548c0 2023-11-30T18:39:23.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.928+0000 7f5be01f4700 1 -- 172.21.15.49:0/2763278476 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd80cc150 con 0x7f5bd81548c0 2023-11-30T18:39:23.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.929+0000 7f5bcdffb700 1 -- 172.21.15.49:0/2763278476 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 87) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f5bd0013610 con 0x7f5bd81548c0 2023-11-30T18:39:23.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.929+0000 7f5bcdffb700 1 --2- 172.21.15.49:0/2763278476 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5bbc05f270 0x7f5bbc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:23.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.929+0000 7f5bcdffb700 1 -- 172.21.15.49:0/2763278476 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f5bd007ad50 con 0x7f5bd81548c0 2023-11-30T18:39:23.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.929+0000 7f5bddf90700 1 -- 172.21.15.49:0/2763278476 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5bbc05f270 msgr2=0x7f5bbc061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:39:23.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.929+0000 7f5bddf90700 1 --2- 172.21.15.49:0/2763278476 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5bbc05f270 0x7f5bbc061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:39:23.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:23.937+0000 7f5bcdffb700 1 -- 172.21.15.49:0/2763278476 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5bd004bc30 con 0x7f5bd81548c0 2023-11-30T18:39:23.946 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:23.946+0000 7fca4d395680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T18:39:23.993 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:23.991+0000 7feb1808a680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T18:39:24.018 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:24.017+0000 7fca4d395680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T18:39:24.072 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:24.071+0000 7feb1808a680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T18:39:24.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.130+0000 7f5bddf90700 1 -- 172.21.15.49:0/2763278476 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5bbc05f270 msgr2=0x7f5bbc061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:39:24.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.130+0000 7f5bddf90700 1 --2- 172.21.15.49:0/2763278476 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5bbc05f270 0x7f5bbc061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T18:39:24.134 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:24.133+0000 7fca4d395680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T18:39:24.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.154+0000 7f5be01f4700 1 -- 172.21.15.49:0/2763278476 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5bd80c6250 con 0x7f5bd81548c0 2023-11-30T18:39:24.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.155+0000 7f5bcdffb700 1 -- 172.21.15.49:0/2763278476 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4499 (secure 0 0 0) 0x7f5bd004f250 con 0x7f5bd81548c0 2023-11-30T18:39:24.156 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:39:24.157 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":77,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1849144206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1849144206},{"type":"v1","addr":"172.21.15.115:6837","nonce":1849144206}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":8686,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/3927708641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3927708641},{"type":"v1","addr":"172.21.15.115:6836","nonce":3927708641}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":8934,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3388701250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3388701250},{"type":"v1","addr":"172.21.15.49:6835","nonce":3388701250}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T18:23:12.095964+0000","modified":"2023-11-30T18:23:15.119579+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8937},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8937":{"gid":8937,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/3993546381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3993546381},{"type":"v1","addr":"172.21.15.49:6834","nonce":3993546381}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-11-30T18:39:24.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.157+0000 7f5be01f4700 1 -- 172.21.15.49:0/2763278476 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5bbc05f270 msgr2=0x7f5bbc061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:39:24.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.157+0000 7f5be01f4700 1 --2- 172.21.15.49:0/2763278476 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5bbc05f270 0x7f5bbc061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:39:24.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.157+0000 7f5be01f4700 1 -- 172.21.15.49:0/2763278476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bd81548c0 msgr2=0x7f5bd8142900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:24.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.157+0000 7f5be01f4700 1 --2- 172.21.15.49:0/2763278476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bd81548c0 0x7f5bd8142900 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7f5bd0009df0 tx=0x7f5bd000b040).stop 2023-11-30T18:39:24.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.157+0000 7f5be01f4700 1 -- 172.21.15.49:0/2763278476 shutdown_connections 2023-11-30T18:39:24.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.157+0000 7f5be01f4700 1 --2- 172.21.15.49:0/2763278476 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5bbc05f270 0x7f5bbc061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:39:24.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.157+0000 7f5be01f4700 1 --2- 172.21.15.49:0/2763278476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bd81548c0 0x7f5bd8142900 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:24.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.157+0000 7f5be01f4700 1 --2- 172.21.15.49:0/2763278476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5bd80c6e30 0x7f5bd8096f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:24.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.157+0000 7f5be01f4700 1 --2- 172.21.15.49:0/2763278476 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bd81544e0 0x7f5bd814fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:24.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.157+0000 7f5be01f4700 1 -- 172.21.15.49:0/2763278476 >> 172.21.15.49:0/2763278476 conn(0x7f5bd8085020 msgr2=0x7f5bd80637a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:24.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.157+0000 7f5be01f4700 1 -- 172.21.15.49:0/2763278476 shutdown_connections 2023-11-30T18:39:24.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.157+0000 7f5be01f4700 1 -- 172.21.15.49:0/2763278476 wait complete. 2023-11-30T18:39:24.160 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 77 2023-11-30T18:39:24.171 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:39:24.230 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:24.228+0000 7feb1808a680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T18:39:24.243 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:24.243+0000 7fca4d395680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:39:24.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.288+0000 7f1a13a40700 1 Processor -- start 2023-11-30T18:39:24.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.289+0000 7f1a13a40700 1 -- start start 2023-11-30T18:39:24.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.289+0000 7f1a13a40700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1a0c1510c0 0x7f1a0c0a9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:24.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.289+0000 7f1a13a40700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1a0c0a9c80 0x7f1a0c069070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:24.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.290+0000 7f1a13a40700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a0c0ad4a0 con 0x7f1a0c063e50 2023-11-30T18:39:24.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.290+0000 7f1a13a40700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a0c0ac4d0 con 0x7f1a0c1510c0 2023-11-30T18:39:24.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.290+0000 7f1a13a40700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a0c0ac6e0 con 0x7f1a0c0a9c80 2023-11-30T18:39:24.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.290+0000 7f1a117dc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1a0c1510c0 0x7f1a0c0a9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:24.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.290+0000 7f1a11fdd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1a0c063e50 0x7f1a0c062700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46098/0 (socket says 172.21.15.49:46098) 2023-11-30T18:39:24.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.290+0000 7f1a11fdd700 1 -- 172.21.15.49:0/750213523 learned_addr learned my addr 172.21.15.49:0/750213523 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:24.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.290+0000 7f1a10fdb700 1 --2- 172.21.15.49:0/750213523 >> v2:172.21.15.115:3300/0 conn(0x7f1a0c0a9c80 0x7f1a0c069070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:24.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.290+0000 7f1a117dc700 1 -- 172.21.15.49:0/750213523 >> v2:172.21.15.115:3300/0 conn(0x7f1a0c0a9c80 msgr2=0x7f1a0c069070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:24.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.290+0000 7f1a117dc700 1 --2- 172.21.15.49:0/750213523 >> v2:172.21.15.115:3300/0 conn(0x7f1a0c0a9c80 0x7f1a0c069070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:24.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.290+0000 7f1a117dc700 1 -- 172.21.15.49:0/750213523 >> v1:172.21.15.49:6789/0 conn(0x7f1a0c063e50 legacy=0x7f1a0c062700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:24.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.290+0000 7f1a117dc700 1 -- 172.21.15.49:0/750213523 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0c0ac9c0 con 0x7f1a0c1510c0 2023-11-30T18:39:24.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.290+0000 7f19fffff700 1 -- 172.21.15.49:0/750213523 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307628682 0 0) 0x7f1a0c0ad4a0 con 0x7f1a0c063e50 2023-11-30T18:39:24.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.290+0000 7f1a117dc700 1 --2- 172.21.15.49:0/750213523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a0c1510c0 0x7f1a0c0a9790 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7f1a0c0c87b0 tx=0x7f1a08009060).ready entity=mon.0 client_cookie=55f22dd4c5769d54 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:24.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.290+0000 7f19fffff700 1 -- 172.21.15.49:0/750213523 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0800f510 con 0x7f1a0c1510c0 2023-11-30T18:39:24.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.290+0000 7f19fffff700 1 -- 172.21.15.49:0/750213523 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0800f670 con 0x7f1a0c1510c0 2023-11-30T18:39:24.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.290+0000 7f19fffff700 1 -- 172.21.15.49:0/750213523 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0800f9f0 con 0x7f1a0c1510c0 2023-11-30T18:39:24.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.291+0000 7f1a13a40700 1 -- 172.21.15.49:0/750213523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a0c1510c0 msgr2=0x7f1a0c0a9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:24.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.291+0000 7f1a13a40700 1 --2- 172.21.15.49:0/750213523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a0c1510c0 0x7f1a0c0a9790 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7f1a0c0c87b0 tx=0x7f1a08009060).stop 2023-11-30T18:39:24.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.291+0000 7f1a13a40700 1 -- 172.21.15.49:0/750213523 shutdown_connections 2023-11-30T18:39:24.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.291+0000 7f1a13a40700 1 --2- 172.21.15.49:0/750213523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a0c1510c0 0x7f1a0c0a9790 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:24.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.291+0000 7f1a13a40700 1 --2- 172.21.15.49:0/750213523 >> v2:172.21.15.115:3300/0 conn(0x7f1a0c0a9c80 0x7f1a0c069070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:24.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.291+0000 7f1a13a40700 1 -- 172.21.15.49:0/750213523 >> 172.21.15.49:0/750213523 conn(0x7f1a0c0c7760 msgr2=0x7f1a0c0c7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:24.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.291+0000 7f1a13a40700 1 -- 172.21.15.49:0/750213523 shutdown_connections 2023-11-30T18:39:24.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.291+0000 7f1a13a40700 1 -- 172.21.15.49:0/750213523 wait complete. 2023-11-30T18:39:24.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.292+0000 7f1a13a40700 1 Processor -- start 2023-11-30T18:39:24.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.292+0000 7f1a13a40700 1 -- start start 2023-11-30T18:39:24.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.293+0000 7f1a13a40700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a0c063e50 0x7f1a0c156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:24.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.293+0000 7f1a13a40700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a0c0a9c80 0x7f1a0c14e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:24.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.293+0000 7f1a13a40700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1a0c157270 0x7f1a0c13fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:24.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.293+0000 7f1a13a40700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c0be460 con 0x7f1a0c063e50 2023-11-30T18:39:24.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.293+0000 7f1a13a40700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c0bd3c0 con 0x7f1a0c0a9c80 2023-11-30T18:39:24.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.293+0000 7f1a13a40700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c0bd6a0 con 0x7f1a0c157270 2023-11-30T18:39:24.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.293+0000 7f1a117dc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a0c063e50 0x7f1a0c156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:24.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.293+0000 7f1a117dc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a0c063e50 0x7f1a0c156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38926/0 (socket says 172.21.15.49:38926) 2023-11-30T18:39:24.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.293+0000 7f1a117dc700 1 -- 172.21.15.49:0/112584844 learned_addr learned my addr 172.21.15.49:0/112584844 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:24.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.293+0000 7f1a11fdd700 1 --2- 172.21.15.49:0/112584844 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1a0c157270 0x7f1a0c13fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:24.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.293+0000 7f1a10fdb700 1 --2- 172.21.15.49:0/112584844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a0c0a9c80 0x7f1a0c14e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:24.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.294+0000 7f1a117dc700 1 -- 172.21.15.49:0/112584844 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1a0c157270 msgr2=0x7f1a0c13fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:24.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.294+0000 7f1a117dc700 1 --2- 172.21.15.49:0/112584844 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1a0c157270 0x7f1a0c13fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:24.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.294+0000 7f1a117dc700 1 -- 172.21.15.49:0/112584844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a0c0a9c80 msgr2=0x7f1a0c14e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:24.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.294+0000 7f1a117dc700 1 --2- 172.21.15.49:0/112584844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a0c0a9c80 0x7f1a0c14e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:24.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.294+0000 7f1a117dc700 1 -- 172.21.15.49:0/112584844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a080092a0 con 0x7f1a0c063e50 2023-11-30T18:39:24.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.294+0000 7f1a117dc700 1 --2- 172.21.15.49:0/112584844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a0c063e50 0x7f1a0c156d80 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 rx=0x7f1a08011000 tx=0x7f1a08017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:24.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.294+0000 7f19fd7fa700 1 -- 172.21.15.49:0/112584844 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0800f7e0 con 0x7f1a0c063e50 2023-11-30T18:39:24.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.294+0000 7f19fd7fa700 1 -- 172.21.15.49:0/112584844 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0800f940 con 0x7f1a0c063e50 2023-11-30T18:39:24.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.294+0000 7f1a13a40700 1 -- 172.21.15.49:0/112584844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a0c0bd980 con 0x7f1a0c063e50 2023-11-30T18:39:24.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.294+0000 7f19fd7fa700 1 -- 172.21.15.49:0/112584844 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0801b660 con 0x7f1a0c063e50 2023-11-30T18:39:24.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.294+0000 7f1a13a40700 1 -- 172.21.15.49:0/112584844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a0c0bdf40 con 0x7f1a0c063e50 2023-11-30T18:39:24.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.295+0000 7f1a13a40700 1 -- 172.21.15.49:0/112584844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a0c06c860 con 0x7f1a0c063e50 2023-11-30T18:39:24.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.296+0000 7f19fd7fa700 1 -- 172.21.15.49:0/112584844 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 87) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f1a0801ba50 con 0x7f1a0c063e50 2023-11-30T18:39:24.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.296+0000 7f19fd7fa700 1 --2- 172.21.15.49:0/112584844 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f19f005f270 0x7f19f0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:24.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.296+0000 7f19fd7fa700 1 -- 172.21.15.49:0/112584844 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f1a0807bce0 con 0x7f1a0c063e50 2023-11-30T18:39:24.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.296+0000 7f1a10fdb700 1 -- 172.21.15.49:0/112584844 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f19f005f270 msgr2=0x7f19f0061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:39:24.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.296+0000 7f1a10fdb700 1 --2- 172.21.15.49:0/112584844 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f19f005f270 0x7f19f0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:39:24.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.301+0000 7f19fd7fa700 1 -- 172.21.15.49:0/112584844 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1a08080070 con 0x7f1a0c063e50 2023-11-30T18:39:24.307 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:24.306+0000 7feb1808a680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T18:39:24.431 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:24.430+0000 7feb1808a680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T18:39:24.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.475+0000 7f1a13a40700 1 -- 172.21.15.49:0/112584844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a0c0c7420 con 0x7f1a0c063e50 2023-11-30T18:39:24.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.476+0000 7f19fd7fa700 1 -- 172.21.15.49:0/112584844 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) v1 ==== 74+0+17916 (secure 0 0 0) 0x7f1a0804cbc0 con 0x7f1a0c063e50 2023-11-30T18:39:24.478 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:39:24.478 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":189,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:39:22.303897+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-11-30T18:23:10.276504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-11-30T18:23:11.078075+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":189,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.1b","mappings":[{"from":4,"to":3}]},{"pgid":"22.1","mappings":[{"from":3,"to":0}]},{"pgid":"22.2b","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/3122997899":"2023-12-01T18:34:21.516339+0000","172.21.15.115:0/3737718649":"2023-12-01T18:34:21.516339+0000","172.21.15.115:0/3726314103":"2023-12-01T18:34:21.516339+0000","172.21.15.115:0/1769486452":"2023-12-01T18:34:21.516339+0000","172.21.15.115:0/1587740371":"2023-12-01T18:23:28.950282+0000","172.21.15.115:0/3015522460":"2023-12-01T18:23:28.950282+0000","172.21.15.115:6833/89956":"2023-12-01T18:23:28.950282+0000","172.21.15.115:6832/89956":"2023-12-01T18:23:28.950282+0000","172.21.15.115:0/3750792535":"2023-12-01T18:23:28.950282+0000","172.21.15.115:0/2529631022":"2023-12-01T18:23:28.950282+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:39:24.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.478+0000 7f1a13a40700 1 -- 172.21.15.49:0/112584844 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f19f005f270 msgr2=0x7f19f0061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:39:24.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.478+0000 7f1a13a40700 1 --2- 172.21.15.49:0/112584844 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f19f005f270 0x7f19f0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:39:24.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.478+0000 7f1a13a40700 1 -- 172.21.15.49:0/112584844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a0c063e50 msgr2=0x7f1a0c156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:24.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.478+0000 7f1a13a40700 1 --2- 172.21.15.49:0/112584844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a0c063e50 0x7f1a0c156d80 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 rx=0x7f1a08011000 tx=0x7f1a08017000).stop 2023-11-30T18:39:24.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.478+0000 7f1a13a40700 1 -- 172.21.15.49:0/112584844 shutdown_connections 2023-11-30T18:39:24.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.478+0000 7f1a13a40700 1 --2- 172.21.15.49:0/112584844 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f19f005f270 0x7f19f0061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:39:24.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.478+0000 7f1a13a40700 1 --2- 172.21.15.49:0/112584844 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1a0c157270 0x7f1a0c13fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:24.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.478+0000 7f1a13a40700 1 --2- 172.21.15.49:0/112584844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a0c063e50 0x7f1a0c156d80 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:24.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.478+0000 7f1a13a40700 1 --2- 172.21.15.49:0/112584844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a0c0a9c80 0x7f1a0c14e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:24.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.478+0000 7f1a13a40700 1 -- 172.21.15.49:0/112584844 >> 172.21.15.49:0/112584844 conn(0x7f1a0c0c7760 msgr2=0x7f1a0c0c5450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:24.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.478+0000 7f1a13a40700 1 -- 172.21.15.49:0/112584844 shutdown_connections 2023-11-30T18:39:24.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.478+0000 7f1a13a40700 1 -- 172.21.15.49:0/112584844 wait complete. 2023-11-30T18:39:24.493 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-30T18:39:24.536 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:24.536+0000 7fca4d395680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T18:39:24.550 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:24.548+0000 7feb1808a680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:39:24.608 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:24.607+0000 7fca4d395680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T18:39:24.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.613+0000 7ff786323700 1 Processor -- start 2023-11-30T18:39:24.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.613+0000 7ff786323700 1 -- start start 2023-11-30T18:39:24.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.614+0000 7ff786323700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff780098d10 0x7ff7800c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:24.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.614+0000 7ff786323700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff780158320 0x7ff7801587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:24.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.614+0000 7ff786323700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff780158cc0 con 0x7ff7800c6190 2023-11-30T18:39:24.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.614+0000 7ff786323700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7800c72d0 con 0x7ff780098d10 2023-11-30T18:39:24.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.614+0000 7ff786323700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff780064570 con 0x7ff780158320 2023-11-30T18:39:24.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.614+0000 7ff77ffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff780098d10 0x7ff7800c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:24.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.614+0000 7ff7848c0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff780158320 0x7ff7801587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:24.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.614+0000 7ff7848c0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff780158320 0x7ff7801587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:32774/0 (socket says 172.21.15.49:32774) 2023-11-30T18:39:24.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.614+0000 7ff77ffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff780098d10 0x7ff7800c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:51622/0 (socket says 172.21.15.49:51622) 2023-11-30T18:39:24.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.614+0000 7ff7848c0700 1 -- 172.21.15.49:0/203609740 learned_addr learned my addr 172.21.15.49:0/203609740 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:24.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.614+0000 7ff7848c0700 1 -- 172.21.15.49:0/203609740 >> v2:172.21.15.115:3300/0 conn(0x7ff780098d10 msgr2=0x7ff7800c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:24.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.614+0000 7ff7848c0700 1 --2- 172.21.15.49:0/203609740 >> v2:172.21.15.115:3300/0 conn(0x7ff780098d10 0x7ff7800c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:24.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.614+0000 7ff7848c0700 1 -- 172.21.15.49:0/203609740 >> v1:172.21.15.115:6789/0 conn(0x7ff7800c6190 legacy=0x7ff780063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:24.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.614+0000 7ff7848c0700 1 -- 172.21.15.49:0/203609740 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff780154bc0 con 0x7ff780158320 2023-11-30T18:39:24.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.614+0000 7ff77effd700 1 -- 172.21.15.49:0/203609740 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2562593153 0 0) 0x7ff770001110 con 0x7ff7800c6190 2023-11-30T18:39:24.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.615+0000 7ff77ffff700 1 --2- 172.21.15.49:0/203609740 >> v2:172.21.15.115:3300/0 conn(0x7ff780098d10 0x7ff7800c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:39:24.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.615+0000 7ff7848c0700 1 --2- 172.21.15.49:0/203609740 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff780158320 0x7ff7801587d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7ff778009f20 tx=0x7ff778009840).ready entity=mon.2 client_cookie=e489b812090427c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:24.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.615+0000 7ff77effd700 1 -- 172.21.15.49:0/203609740 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77800e070 con 0x7ff780158320 2023-11-30T18:39:24.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.615+0000 7ff77effd700 1 -- 172.21.15.49:0/203609740 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77800b9d0 con 0x7ff780158320 2023-11-30T18:39:24.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.615+0000 7ff77effd700 1 -- 172.21.15.49:0/203609740 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77800bd50 con 0x7ff780158320 2023-11-30T18:39:24.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.615+0000 7ff786323700 1 -- 172.21.15.49:0/203609740 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff780158320 msgr2=0x7ff7801587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:24.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.615+0000 7ff786323700 1 --2- 172.21.15.49:0/203609740 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff780158320 0x7ff7801587d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7ff778009f20 tx=0x7ff778009840).stop 2023-11-30T18:39:24.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.616+0000 7ff786323700 1 -- 172.21.15.49:0/203609740 shutdown_connections 2023-11-30T18:39:24.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.616+0000 7ff786323700 1 --2- 172.21.15.49:0/203609740 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff780158320 0x7ff7801587d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:24.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.616+0000 7ff786323700 1 --2- 172.21.15.49:0/203609740 >> v2:172.21.15.115:3300/0 conn(0x7ff780098d10 0x7ff7800c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:24.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.616+0000 7ff786323700 1 -- 172.21.15.49:0/203609740 >> 172.21.15.49:0/203609740 conn(0x7ff7800cb310 msgr2=0x7ff7800cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:24.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.616+0000 7ff786323700 1 -- 172.21.15.49:0/203609740 shutdown_connections 2023-11-30T18:39:24.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.616+0000 7ff786323700 1 -- 172.21.15.49:0/203609740 wait complete. 2023-11-30T18:39:24.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.617+0000 7ff786323700 1 Processor -- start 2023-11-30T18:39:24.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.617+0000 7ff786323700 1 -- start start 2023-11-30T18:39:24.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.618+0000 7ff786323700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff780098d10 0x7ff78014b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:24.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.618+0000 7ff786323700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7800c6190 0x7ff780155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:24.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.618+0000 7ff786323700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff780158320 0x7ff780150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:24.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.618+0000 7ff786323700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7800ab980 con 0x7ff780158320 2023-11-30T18:39:24.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.618+0000 7ff786323700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78014b600 con 0x7ff7800c6190 2023-11-30T18:39:24.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.618+0000 7ff786323700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7800aad70 con 0x7ff780098d10 2023-11-30T18:39:24.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.618+0000 7ff7848c0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff780158320 0x7ff780150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:24.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.618+0000 7ff77ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff780098d10 0x7ff78014b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:24.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.618+0000 7ff77f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7800c6190 0x7ff780155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:24.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.618+0000 7ff7848c0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff780158320 0x7ff780150e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38942/0 (socket says 172.21.15.49:38942) 2023-11-30T18:39:24.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.618+0000 7ff77ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff780098d10 0x7ff78014b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:32782/0 (socket says 172.21.15.49:32782) 2023-11-30T18:39:24.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.618+0000 7ff7848c0700 1 -- 172.21.15.49:0/3567217325 learned_addr learned my addr 172.21.15.49:0/3567217325 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:24.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.618+0000 7ff7848c0700 1 -- 172.21.15.49:0/3567217325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff780098d10 msgr2=0x7ff78014b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:24.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.618+0000 7ff7848c0700 1 --2- 172.21.15.49:0/3567217325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff780098d10 0x7ff78014b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:24.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.618+0000 7ff7848c0700 1 -- 172.21.15.49:0/3567217325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7800c6190 msgr2=0x7ff780155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:24.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.618+0000 7ff7848c0700 1 --2- 172.21.15.49:0/3567217325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7800c6190 0x7ff780155710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:24.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.618+0000 7ff7848c0700 1 -- 172.21.15.49:0/3567217325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7740092a0 con 0x7ff780158320 2023-11-30T18:39:24.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.618+0000 7ff7848c0700 1 --2- 172.21.15.49:0/3567217325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff780158320 0x7ff780150e40 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7ff7800646b0 tx=0x7ff7800a8040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:24.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.619+0000 7ff767fff700 1 -- 172.21.15.49:0/3567217325 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7780092e0 con 0x7ff780158320 2023-11-30T18:39:24.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.619+0000 7ff767fff700 1 -- 172.21.15.49:0/3567217325 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff778013e30 con 0x7ff780158320 2023-11-30T18:39:24.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.619+0000 7ff786323700 1 -- 172.21.15.49:0/3567217325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff778009ae0 con 0x7ff780158320 2023-11-30T18:39:24.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.619+0000 7ff767fff700 1 -- 172.21.15.49:0/3567217325 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff778007860 con 0x7ff780158320 2023-11-30T18:39:24.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.619+0000 7ff786323700 1 -- 172.21.15.49:0/3567217325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7800ab330 con 0x7ff780158320 2023-11-30T18:39:24.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.620+0000 7ff786323700 1 -- 172.21.15.49:0/3567217325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff78006c860 con 0x7ff780158320 2023-11-30T18:39:24.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.621+0000 7ff767fff700 1 -- 172.21.15.49:0/3567217325 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 87) v1 ==== 75560+0+0 (secure 0 0 0) 0x7ff778003040 con 0x7ff780158320 2023-11-30T18:39:24.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.621+0000 7ff767fff700 1 --2- 172.21.15.49:0/3567217325 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff76c05f270 0x7ff76c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:24.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.621+0000 7ff77ffff700 1 -- 172.21.15.49:0/3567217325 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff76c05f270 msgr2=0x7ff76c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:39:24.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.621+0000 7ff767fff700 1 -- 172.21.15.49:0/3567217325 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 6750+0+0 (secure 0 0 0) 0x7ff77807c330 con 0x7ff780158320 2023-11-30T18:39:24.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.621+0000 7ff77ffff700 1 --2- 172.21.15.49:0/3567217325 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff76c05f270 0x7ff76c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:39:24.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.626+0000 7ff767fff700 1 -- 172.21.15.49:0/3567217325 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff77804d380 con 0x7ff780158320 2023-11-30T18:39:24.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.634+0000 7ff767fff700 1 -- 172.21.15.49:0/3567217325 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 88) v1 ==== 75270+0+0 (secure 0 0 0) 0x7ff778079dd0 con 0x7ff780158320 2023-11-30T18:39:24.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.634+0000 7ff767fff700 1 -- 172.21.15.49:0/3567217325 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff76c05f270 msgr2=0x7ff76c061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:39:24.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.634+0000 7ff767fff700 1 --2- 172.21.15.49:0/3567217325 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff76c05f270 0x7ff76c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:39:24.689 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:24.688+0000 7fc9cab2d700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:39:24.689 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:24.688+0000 7fc9cab2d700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:39:24.689 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:24.688+0000 7fc9cab2d700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:39:24.689 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:24.688+0000 7fc9c7b27700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:39:24.689 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:24.688+0000 7fc9cab2d700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:39:24.690 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:24.688+0000 7fc9c7b27700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:39:24.690 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:24.688+0000 7fc9cab2d700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:39:24.690 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:24.688+0000 7fc9c7b27700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:39:24.690 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:24.688+0000 7fc9c7b27700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:39:24.690 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:24.688+0000 7fc9c7b27700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:39:24.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:24.848+0000 7ff786323700 1 -- 172.21.15.49:0/3567217325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff7800c66c0 con 0x7ff780158320 2023-11-30T18:39:24.863 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:24.862+0000 7feb1808a680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T18:39:24.938 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:24.936+0000 7feb1808a680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T18:39:25.629 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-11-30T18:39:25.627+0000 7f3888d95700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-30T18:39:25.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.633+0000 7ff767fff700 1 -- 172.21.15.49:0/3567217325 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mgrmap(e 89) v1 ==== 75340+0+0 (secure 0 0 0) 0x7ff77807a150 con 0x7ff780158320 2023-11-30T18:39:25.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.634+0000 7ff767fff700 1 --2- 172.21.15.49:0/3567217325 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff76c05f270 0x7ff76c0616b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:25.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.636+0000 7ff77ffff700 1 --2- 172.21.15.49:0/3567217325 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff76c05f270 0x7ff76c0616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:25.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.637+0000 7ff77ffff700 1 --2- 172.21.15.49:0/3567217325 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff76c05f270 0x7ff76c0616b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7ff7740091f0 tx=0x7ff774008040).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:25.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.640+0000 7ff767fff700 1 -- 172.21.15.49:0/3567217325 <== mon.0 v2:172.21.15.49:3300/0 9 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v78) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff77804e560 con 0x7ff780158320 2023-11-30T18:39:25.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.643+0000 7ff786323700 1 -- 172.21.15.49:0/3567217325 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff76c05f270 msgr2=0x7ff76c0616b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:25.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.643+0000 7ff786323700 1 --2- 172.21.15.49:0/3567217325 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff76c05f270 0x7ff76c0616b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7ff7740091f0 tx=0x7ff774008040).stop 2023-11-30T18:39:25.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.643+0000 7ff786323700 1 -- 172.21.15.49:0/3567217325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff780158320 msgr2=0x7ff780150e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:25.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.643+0000 7ff786323700 1 --2- 172.21.15.49:0/3567217325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff780158320 0x7ff780150e40 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7ff7800646b0 tx=0x7ff7800a8040).stop 2023-11-30T18:39:25.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.643+0000 7ff786323700 1 -- 172.21.15.49:0/3567217325 shutdown_connections 2023-11-30T18:39:25.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.643+0000 7ff786323700 1 --2- 172.21.15.49:0/3567217325 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff76c05f270 0x7ff76c0616b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:25.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.643+0000 7ff786323700 1 --2- 172.21.15.49:0/3567217325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff780158320 0x7ff780150e40 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:25.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.643+0000 7ff786323700 1 --2- 172.21.15.49:0/3567217325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff780098d10 0x7ff78014b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:25.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.643+0000 7ff786323700 1 --2- 172.21.15.49:0/3567217325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7800c6190 0x7ff780155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:25.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.643+0000 7ff786323700 1 -- 172.21.15.49:0/3567217325 >> 172.21.15.49:0/3567217325 conn(0x7ff7800cb310 msgr2=0x7ff7800ca400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:25.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.643+0000 7ff786323700 1 -- 172.21.15.49:0/3567217325 shutdown_connections 2023-11-30T18:39:25.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.643+0000 7ff786323700 1 -- 172.21.15.49:0/3567217325 wait complete. 2023-11-30T18:39:25.646 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-30T18:39:25.658 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-30T18:39:25.675 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-11-30T18:39:25.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.779+0000 7f2f66375700 1 Processor -- start 2023-11-30T18:39:25.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.779+0000 7f2f66375700 1 -- start start 2023-11-30T18:39:25.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.780+0000 7f2f66375700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2f60098d10 0x7f2f600c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:25.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.780+0000 7f2f66375700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f600c6190 0x7f2f60063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:25.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.780+0000 7f2f66375700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f600c72d0 con 0x7f2f60064350 2023-11-30T18:39:25.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.780+0000 7f2f66375700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f60154bc0 con 0x7f2f60098d10 2023-11-30T18:39:25.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.780+0000 7f2f66375700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f600c66c0 con 0x7f2f600c6190 2023-11-30T18:39:25.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.780+0000 7f2f5ffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2f60098d10 0x7f2f600c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:25.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.780+0000 7f2f5f7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f600c6190 0x7f2f60063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:25.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.780+0000 7f2f64912700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f2f60064350 0x7f2f60158320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:53980/0 (socket says 172.21.15.49:53980) 2023-11-30T18:39:25.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.780+0000 7f2f64912700 1 -- 172.21.15.49:0/2318210871 learned_addr learned my addr 172.21.15.49:0/2318210871 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:25.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.781+0000 7f2f5ffff700 1 -- 172.21.15.49:0/2318210871 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f600c6190 msgr2=0x7f2f60063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:25.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.781+0000 7f2f5ffff700 1 --2- 172.21.15.49:0/2318210871 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f600c6190 0x7f2f60063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:25.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.781+0000 7f2f5ffff700 1 -- 172.21.15.49:0/2318210871 >> v1:172.21.15.115:6789/0 conn(0x7f2f60064350 legacy=0x7f2f60158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:25.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.781+0000 7f2f5ffff700 1 -- 172.21.15.49:0/2318210871 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f600c69a0 con 0x7f2f60098d10 2023-11-30T18:39:25.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.781+0000 7f2f5effd700 1 -- 172.21.15.49:0/2318210871 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 157330100 0 0) 0x7f2f600c72d0 con 0x7f2f60064350 2023-11-30T18:39:25.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.781+0000 7f2f5ffff700 1 --2- 172.21.15.49:0/2318210871 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f60098d10 0x7f2f600c7760 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f2f54009760 tx=0x7f2f54009060).ready entity=mon.1 client_cookie=9ec4cc74998525a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:25.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.781+0000 7f2f5effd700 1 -- 172.21.15.49:0/2318210871 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5400f510 con 0x7f2f60098d10 2023-11-30T18:39:25.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.781+0000 7f2f5effd700 1 -- 172.21.15.49:0/2318210871 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5400f670 con 0x7f2f60098d10 2023-11-30T18:39:25.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.781+0000 7f2f5effd700 1 -- 172.21.15.49:0/2318210871 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5400f9f0 con 0x7f2f60098d10 2023-11-30T18:39:25.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.781+0000 7f2f66375700 1 -- 172.21.15.49:0/2318210871 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f60098d10 msgr2=0x7f2f600c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:25.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.781+0000 7f2f66375700 1 --2- 172.21.15.49:0/2318210871 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f60098d10 0x7f2f600c7760 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f2f54009760 tx=0x7f2f54009060).stop 2023-11-30T18:39:25.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.781+0000 7f2f66375700 1 -- 172.21.15.49:0/2318210871 shutdown_connections 2023-11-30T18:39:25.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.781+0000 7f2f66375700 1 --2- 172.21.15.49:0/2318210871 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f60098d10 0x7f2f600c7760 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:25.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.781+0000 7f2f66375700 1 --2- 172.21.15.49:0/2318210871 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f600c6190 0x7f2f60063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:25.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.781+0000 7f2f66375700 1 -- 172.21.15.49:0/2318210871 >> 172.21.15.49:0/2318210871 conn(0x7f2f600cb310 msgr2=0x7f2f600cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:25.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.781+0000 7f2f66375700 1 -- 172.21.15.49:0/2318210871 shutdown_connections 2023-11-30T18:39:25.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.781+0000 7f2f66375700 1 -- 172.21.15.49:0/2318210871 wait complete. 2023-11-30T18:39:25.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.783+0000 7f2f66375700 1 Processor -- start 2023-11-30T18:39:25.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.783+0000 7f2f66375700 1 -- start start 2023-11-30T18:39:25.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.783+0000 7f2f66375700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f60064350 0x7f2f60155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:25.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.783+0000 7f2f66375700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f60098d10 0x7f2f600b0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:25.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.783+0000 7f2f66375700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f600c6190 0x7f2f600b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:25.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.783+0000 7f2f66375700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f60155e40 con 0x7f2f600c6190 2023-11-30T18:39:25.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.783+0000 7f2f66375700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f60168640 con 0x7f2f60098d10 2023-11-30T18:39:25.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.783+0000 7f2f66375700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f60167d10 con 0x7f2f60064350 2023-11-30T18:39:25.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.784+0000 7f2f64912700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f600c6190 0x7f2f600b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:25.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.784+0000 7f2f64912700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f600c6190 0x7f2f600b0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38956/0 (socket says 172.21.15.49:38956) 2023-11-30T18:39:25.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.784+0000 7f2f5ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f60064350 0x7f2f60155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:25.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.784+0000 7f2f64912700 1 -- 172.21.15.49:0/3263120944 learned_addr learned my addr 172.21.15.49:0/3263120944 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:25.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.784+0000 7f2f5f7fe700 1 --2- 172.21.15.49:0/3263120944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f60098d10 0x7f2f600b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:25.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.784+0000 7f2f5ffff700 1 -- 172.21.15.49:0/3263120944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f60098d10 msgr2=0x7f2f600b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:25.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.784+0000 7f2f5ffff700 1 --2- 172.21.15.49:0/3263120944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f60098d10 0x7f2f600b0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:25.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.784+0000 7f2f5ffff700 1 -- 172.21.15.49:0/3263120944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f600c6190 msgr2=0x7f2f600b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:25.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.784+0000 7f2f5ffff700 1 --2- 172.21.15.49:0/3263120944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f600c6190 0x7f2f600b0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:25.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.784+0000 7f2f5ffff700 1 -- 172.21.15.49:0/3263120944 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f540092a0 con 0x7f2f60064350 2023-11-30T18:39:25.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.784+0000 7f2f64912700 1 --2- 172.21.15.49:0/3263120944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f600c6190 0x7f2f600b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:39:25.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.784+0000 7f2f5ffff700 1 --2- 172.21.15.49:0/3263120944 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f60064350 0x7f2f60155660 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f2f54014000 tx=0x7f2f54017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:25.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.784+0000 7f2f47fff700 1 -- 172.21.15.49:0/3263120944 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5400fe80 con 0x7f2f60064350 2023-11-30T18:39:25.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.784+0000 7f2f47fff700 1 -- 172.21.15.49:0/3263120944 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5400f7e0 con 0x7f2f60064350 2023-11-30T18:39:25.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.784+0000 7f2f66375700 1 -- 172.21.15.49:0/3263120944 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f60167ff0 con 0x7f2f60064350 2023-11-30T18:39:25.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.784+0000 7f2f47fff700 1 -- 172.21.15.49:0/3263120944 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5401b660 con 0x7f2f60064350 2023-11-30T18:39:25.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.784+0000 7f2f66375700 1 -- 172.21.15.49:0/3263120944 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f600b0f30 con 0x7f2f60064350 2023-11-30T18:39:25.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.785+0000 7f2f66375700 1 -- 172.21.15.49:0/3263120944 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f60168490 con 0x7f2f60064350 2023-11-30T18:39:25.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.786+0000 7f2f47fff700 1 -- 172.21.15.49:0/3263120944 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 89) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f2f5401ba10 con 0x7f2f60064350 2023-11-30T18:39:25.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.786+0000 7f2f47fff700 1 --2- 172.21.15.49:0/3263120944 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f2f4c05f030 0x7f2f4c0614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:25.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.786+0000 7f2f47fff700 1 -- 172.21.15.49:0/3263120944 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 7066+0+0 (secure 0 0 0) 0x7f2f5407b5b0 con 0x7f2f60064350 2023-11-30T18:39:25.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.786+0000 7f2f5f7fe700 1 --2- 172.21.15.49:0/3263120944 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f2f4c05f030 0x7f2f4c0614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:25.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.787+0000 7f2f5f7fe700 1 --2- 172.21.15.49:0/3263120944 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f2f4c05f030 0x7f2f4c0614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f2f6015afa0 tx=0x7f2f50009060).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:25.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:25.790+0000 7f2f47fff700 1 -- 172.21.15.49:0/3263120944 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2f5404c6a0 con 0x7f2f60064350 2023-11-30T18:39:26.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.007+0000 7f2f66375700 1 -- 172.21.15.49:0/3263120944 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2f60167e50 con 0x7f2f60064350 2023-11-30T18:39:26.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.642+0000 7f2f47fff700 1 -- 172.21.15.49:0/3263120944 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v79) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2f60167e50 con 0x7f2f60064350 2023-11-30T18:39:26.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.645+0000 7f2f66375700 1 -- 172.21.15.49:0/3263120944 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f2f4c05f030 msgr2=0x7f2f4c0614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:26.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.645+0000 7f2f66375700 1 --2- 172.21.15.49:0/3263120944 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f2f4c05f030 0x7f2f4c0614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f2f6015afa0 tx=0x7f2f50009060).stop 2023-11-30T18:39:26.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.645+0000 7f2f66375700 1 -- 172.21.15.49:0/3263120944 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f60064350 msgr2=0x7f2f60155660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:26.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.645+0000 7f2f66375700 1 --2- 172.21.15.49:0/3263120944 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f60064350 0x7f2f60155660 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f2f54014000 tx=0x7f2f54017000).stop 2023-11-30T18:39:26.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.645+0000 7f2f66375700 1 -- 172.21.15.49:0/3263120944 shutdown_connections 2023-11-30T18:39:26.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.645+0000 7f2f66375700 1 --2- 172.21.15.49:0/3263120944 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f2f4c05f030 0x7f2f4c0614f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:26.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.645+0000 7f2f66375700 1 --2- 172.21.15.49:0/3263120944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f600c6190 0x7f2f600b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:26.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.645+0000 7f2f66375700 1 --2- 172.21.15.49:0/3263120944 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f60064350 0x7f2f60155660 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:26.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.645+0000 7f2f66375700 1 --2- 172.21.15.49:0/3263120944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f60098d10 0x7f2f600b0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:26.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.645+0000 7f2f66375700 1 -- 172.21.15.49:0/3263120944 >> 172.21.15.49:0/3263120944 conn(0x7f2f600cb310 msgr2=0x7f2f600ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:26.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.645+0000 7f2f66375700 1 -- 172.21.15.49:0/3263120944 shutdown_connections 2023-11-30T18:39:26.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.645+0000 7f2f66375700 1 -- 172.21.15.49:0/3263120944 wait complete. 2023-11-30T18:39:26.661 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-30T18:39:26.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.826+0000 7f7328c1b700 1 Processor -- start 2023-11-30T18:39:26.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.826+0000 7f7328c1b700 1 -- start start 2023-11-30T18:39:26.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.827+0000 7f7328c1b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f73240ab3b0 0x7f73241582e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:26.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.827+0000 7f7328c1b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f73240aa1c0 0x7f73240aa600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:26.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.827+0000 7f7328c1b700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7324159210 con 0x7f7324154610 2023-11-30T18:39:26.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.827+0000 7f7328c1b700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73240c0c70 con 0x7f73240aa1c0 2023-11-30T18:39:26.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.827+0000 7f7328c1b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73240c2110 con 0x7f73240ab3b0 2023-11-30T18:39:26.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.827+0000 7f7322d9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f73240aa1c0 0x7f73240aa600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:26.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.827+0000 7f7322d9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f73240aa1c0 0x7f73240aa600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38962/0 (socket says 172.21.15.49:38962) 2023-11-30T18:39:26.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.828+0000 7f7322d9d700 1 -- 172.21.15.49:0/1090095463 learned_addr learned my addr 172.21.15.49:0/1090095463 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:26.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.828+0000 7f7321d9b700 1 --2- 172.21.15.49:0/1090095463 >> v2:172.21.15.115:3300/0 conn(0x7f73240ab3b0 0x7f73241582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:26.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.828+0000 7f7322d9d700 1 -- 172.21.15.49:0/1090095463 >> v2:172.21.15.115:3300/0 conn(0x7f73240ab3b0 msgr2=0x7f73241582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:26.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.828+0000 7f732159a700 1 -- 172.21.15.49:0/1090095463 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2178216197 0 0) 0x7f7324159210 con 0x7f7324154610 2023-11-30T18:39:26.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.828+0000 7f7322d9d700 1 --2- 172.21.15.49:0/1090095463 >> v2:172.21.15.115:3300/0 conn(0x7f73240ab3b0 0x7f73241582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:26.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.828+0000 7f7322d9d700 1 -- 172.21.15.49:0/1090095463 >> v1:172.21.15.115:6789/0 conn(0x7f7324154610 legacy=0x7f73240c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:26.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.828+0000 7f7322d9d700 1 -- 172.21.15.49:0/1090095463 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73240aaaf0 con 0x7f73240aa1c0 2023-11-30T18:39:26.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.828+0000 7f7322d9d700 1 --2- 172.21.15.49:0/1090095463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73240aa1c0 0x7f73240aa600 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7f73240c5770 tx=0x7f7314009840).ready entity=mon.0 client_cookie=6dc06fd132d9fe3c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:26.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.828+0000 7f732159a700 1 -- 172.21.15.49:0/1090095463 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731400e070 con 0x7f73240aa1c0 2023-11-30T18:39:26.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.828+0000 7f732159a700 1 -- 172.21.15.49:0/1090095463 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731400ba20 con 0x7f73240aa1c0 2023-11-30T18:39:26.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.828+0000 7f732159a700 1 -- 172.21.15.49:0/1090095463 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731400bda0 con 0x7f73240aa1c0 2023-11-30T18:39:26.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.829+0000 7f7328c1b700 1 -- 172.21.15.49:0/1090095463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73240aa1c0 msgr2=0x7f73240aa600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:26.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.829+0000 7f7328c1b700 1 --2- 172.21.15.49:0/1090095463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73240aa1c0 0x7f73240aa600 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7f73240c5770 tx=0x7f7314009840).stop 2023-11-30T18:39:26.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.829+0000 7f7328c1b700 1 -- 172.21.15.49:0/1090095463 shutdown_connections 2023-11-30T18:39:26.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.829+0000 7f7328c1b700 1 --2- 172.21.15.49:0/1090095463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73240aa1c0 0x7f73240aa600 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:26.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.829+0000 7f7328c1b700 1 --2- 172.21.15.49:0/1090095463 >> v2:172.21.15.115:3300/0 conn(0x7f73240ab3b0 0x7f73241582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:26.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.829+0000 7f7328c1b700 1 -- 172.21.15.49:0/1090095463 >> 172.21.15.49:0/1090095463 conn(0x7f73240655a0 msgr2=0x7f7324069e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:26.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.829+0000 7f7328c1b700 1 -- 172.21.15.49:0/1090095463 shutdown_connections 2023-11-30T18:39:26.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.829+0000 7f7328c1b700 1 -- 172.21.15.49:0/1090095463 wait complete. 2023-11-30T18:39:26.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.830+0000 7f7328c1b700 1 Processor -- start 2023-11-30T18:39:26.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.830+0000 7f7328c1b700 1 -- start start 2023-11-30T18:39:26.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.831+0000 7f7328c1b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73240aa1c0 0x7f73240c2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:26.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.831+0000 7f7328c1b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7324154610 0x7f732414d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:26.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.831+0000 7f7328c1b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f732414d5a0 0x7f73240b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:26.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.831+0000 7f7328c1b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73240c3ad0 con 0x7f7324154610 2023-11-30T18:39:26.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.831+0000 7f7328c1b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73240c2c60 con 0x7f732414d5a0 2023-11-30T18:39:26.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.831+0000 7f7328c1b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f732414da20 con 0x7f73240aa1c0 2023-11-30T18:39:26.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.831+0000 7f7321d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7324154610 0x7f732414d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:26.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.831+0000 7f7321d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7324154610 0x7f732414d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38978/0 (socket says 172.21.15.49:38978) 2023-11-30T18:39:26.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.831+0000 7f7321d9b700 1 -- 172.21.15.49:0/2168586947 learned_addr learned my addr 172.21.15.49:0/2168586947 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:26.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.831+0000 7f7322d9d700 1 --2- 172.21.15.49:0/2168586947 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f732414d5a0 0x7f73240b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:26.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.831+0000 7f732259c700 1 --2- 172.21.15.49:0/2168586947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73240aa1c0 0x7f73240c2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:26.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.831+0000 7f7321d9b700 1 -- 172.21.15.49:0/2168586947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73240aa1c0 msgr2=0x7f73240c2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:26.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.831+0000 7f7321d9b700 1 --2- 172.21.15.49:0/2168586947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73240aa1c0 0x7f73240c2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:26.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.831+0000 7f7321d9b700 1 -- 172.21.15.49:0/2168586947 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f732414d5a0 msgr2=0x7f73240b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:26.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.831+0000 7f7321d9b700 1 --2- 172.21.15.49:0/2168586947 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f732414d5a0 0x7f73240b01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:26.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.831+0000 7f7321d9b700 1 -- 172.21.15.49:0/2168586947 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7314009ae0 con 0x7f7324154610 2023-11-30T18:39:26.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.831+0000 7f732259c700 1 --2- 172.21.15.49:0/2168586947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73240aa1c0 0x7f73240c2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:39:26.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.831+0000 7f7321d9b700 1 --2- 172.21.15.49:0/2168586947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7324154610 0x7f732414d0b0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 rx=0x7f730c00e930 tx=0x7f730c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:26.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.831+0000 7f731a7fc700 1 -- 172.21.15.49:0/2168586947 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c00eed0 con 0x7f7324154610 2023-11-30T18:39:26.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.831+0000 7f731a7fc700 1 -- 172.21.15.49:0/2168586947 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730c00c850 con 0x7f7324154610 2023-11-30T18:39:26.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.831+0000 7f7328c1b700 1 -- 172.21.15.49:0/2168586947 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73240c2ec0 con 0x7f7324154610 2023-11-30T18:39:26.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.831+0000 7f731a7fc700 1 -- 172.21.15.49:0/2168586947 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c00cbd0 con 0x7f7324154610 2023-11-30T18:39:26.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.831+0000 7f7328c1b700 1 -- 172.21.15.49:0/2168586947 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73240c3480 con 0x7f7324154610 2023-11-30T18:39:26.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.832+0000 7f7328c1b700 1 -- 172.21.15.49:0/2168586947 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73240c3c80 con 0x7f7324154610 2023-11-30T18:39:26.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.833+0000 7f731a7fc700 1 -- 172.21.15.49:0/2168586947 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 89) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f730c01b400 con 0x7f7324154610 2023-11-30T18:39:26.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.833+0000 7f731a7fc700 1 --2- 172.21.15.49:0/2168586947 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f730405f000 0x7f73040614c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:26.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.833+0000 7f731a7fc700 1 -- 172.21.15.49:0/2168586947 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 7066+0+0 (secure 0 0 0) 0x7f730c07a8a0 con 0x7f7324154610 2023-11-30T18:39:26.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.833+0000 7f732259c700 1 --2- 172.21.15.49:0/2168586947 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f730405f000 0x7f73040614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:26.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.834+0000 7f732259c700 1 --2- 172.21.15.49:0/2168586947 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f730405f000 0x7f73040614c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f731c0016f0 tx=0x7f731c009040).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:26.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:26.837+0000 7f731a7fc700 1 -- 172.21.15.49:0/2168586947 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f73240c3c80 con 0x7f7324154610 2023-11-30T18:39:27.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.014+0000 7f7328c1b700 1 -- 172.21.15.49:0/2168586947 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f73240c3c80 con 0x7f7324154610 2023-11-30T18:39:27.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.325+0000 7f731a7fc700 1 -- 172.21.15.49:0/2168586947 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f730c078490 con 0x7f7324154610 2023-11-30T18:39:27.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.648+0000 7f731a7fc700 1 -- 172.21.15.49:0/2168586947 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v193) v1 ==== 181+0+0 (secure 0 0 0) 0x7f730c071d50 con 0x7f7324154610 2023-11-30T18:39:27.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.652+0000 7f7328c1b700 1 -- 172.21.15.49:0/2168586947 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f730405f000 msgr2=0x7f73040614c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:27.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.652+0000 7f7328c1b700 1 --2- 172.21.15.49:0/2168586947 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f730405f000 0x7f73040614c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f731c0016f0 tx=0x7f731c009040).stop 2023-11-30T18:39:27.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.652+0000 7f7328c1b700 1 -- 172.21.15.49:0/2168586947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7324154610 msgr2=0x7f732414d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:27.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.652+0000 7f7328c1b700 1 --2- 172.21.15.49:0/2168586947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7324154610 0x7f732414d0b0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 rx=0x7f730c00e930 tx=0x7f730c009060).stop 2023-11-30T18:39:27.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.652+0000 7f7328c1b700 1 -- 172.21.15.49:0/2168586947 shutdown_connections 2023-11-30T18:39:27.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.652+0000 7f7328c1b700 1 --2- 172.21.15.49:0/2168586947 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f730405f000 0x7f73040614c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:27.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.652+0000 7f7328c1b700 1 --2- 172.21.15.49:0/2168586947 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f732414d5a0 0x7f73240b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:27.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.652+0000 7f7328c1b700 1 --2- 172.21.15.49:0/2168586947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73240aa1c0 0x7f73240c2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:27.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.652+0000 7f7328c1b700 1 --2- 172.21.15.49:0/2168586947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7324154610 0x7f732414d0b0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:27.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.652+0000 7f7328c1b700 1 -- 172.21.15.49:0/2168586947 >> 172.21.15.49:0/2168586947 conn(0x7f73240655a0 msgr2=0x7f732414f490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:27.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.652+0000 7f7328c1b700 1 -- 172.21.15.49:0/2168586947 shutdown_connections 2023-11-30T18:39:27.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.652+0000 7f7328c1b700 1 -- 172.21.15.49:0/2168586947 wait complete. 2023-11-30T18:39:27.666 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2023-11-30T18:39:27.668 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-30T18:39:27.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.799+0000 7fe46d53e700 1 Processor -- start 2023-11-30T18:39:27.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.799+0000 7fe46d53e700 1 -- start start 2023-11-30T18:39:27.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.799+0000 7fe46d53e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe468154340 0x7fe4681580a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:27.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.799+0000 7fe46d53e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe4680c5ef0 0x7fe4680c6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:27.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.799+0000 7fe46d53e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4680c6830 con 0x7fe468154720 2023-11-30T18:39:27.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.800+0000 7fe46d53e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4680c05c0 con 0x7fe468154340 2023-11-30T18:39:27.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.800+0000 7fe46d53e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe468158660 con 0x7fe4680c5ef0 2023-11-30T18:39:27.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.800+0000 7fe467fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe468154340 0x7fe4681580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:27.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.800+0000 7fe467fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe468154340 0x7fe4681580a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38988/0 (socket says 172.21.15.49:38988) 2023-11-30T18:39:27.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.800+0000 7fe467fff700 1 -- 172.21.15.49:0/73292793 learned_addr learned my addr 172.21.15.49:0/73292793 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:27.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.800+0000 7fe46cd3d700 1 --2- 172.21.15.49:0/73292793 >> v2:172.21.15.115:3300/0 conn(0x7fe4680c5ef0 0x7fe4680c6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:27.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.800+0000 7fe467fff700 1 -- 172.21.15.49:0/73292793 >> v2:172.21.15.115:3300/0 conn(0x7fe4680c5ef0 msgr2=0x7fe4680c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:27.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.800+0000 7fe467fff700 1 --2- 172.21.15.49:0/73292793 >> v2:172.21.15.115:3300/0 conn(0x7fe4680c5ef0 0x7fe4680c6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:27.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.800+0000 7fe467fff700 1 -- 172.21.15.49:0/73292793 >> v1:172.21.15.115:6789/0 conn(0x7fe468154720 legacy=0x7fe4680aa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:27.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.800+0000 7fe467fff700 1 -- 172.21.15.49:0/73292793 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe468158940 con 0x7fe468154340 2023-11-30T18:39:27.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.800+0000 7fe467fff700 1 --2- 172.21.15.49:0/73292793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe468154340 0x7fe4681580a0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 rx=0x7fe4680476f0 tx=0x7fe4500090f0).ready entity=mon.0 client_cookie=f45c559b62831e3d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:27.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.800+0000 7fe466ffd700 1 -- 172.21.15.49:0/73292793 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45000b600 con 0x7fe468154340 2023-11-30T18:39:27.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.800+0000 7fe466ffd700 1 -- 172.21.15.49:0/73292793 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45000b760 con 0x7fe468154340 2023-11-30T18:39:27.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.800+0000 7fe466ffd700 1 -- 172.21.15.49:0/73292793 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45000bb00 con 0x7fe468154340 2023-11-30T18:39:27.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.801+0000 7fe46d53e700 1 -- 172.21.15.49:0/73292793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe468154340 msgr2=0x7fe4681580a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:27.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.801+0000 7fe46d53e700 1 --2- 172.21.15.49:0/73292793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe468154340 0x7fe4681580a0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 rx=0x7fe4680476f0 tx=0x7fe4500090f0).stop 2023-11-30T18:39:27.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.801+0000 7fe46d53e700 1 -- 172.21.15.49:0/73292793 shutdown_connections 2023-11-30T18:39:27.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.801+0000 7fe46d53e700 1 --2- 172.21.15.49:0/73292793 >> v2:172.21.15.115:3300/0 conn(0x7fe4680c5ef0 0x7fe4680c6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:27.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.801+0000 7fe46d53e700 1 --2- 172.21.15.49:0/73292793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe468154340 0x7fe4681580a0 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:27.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.801+0000 7fe46d53e700 1 -- 172.21.15.49:0/73292793 >> 172.21.15.49:0/73292793 conn(0x7fe4680cb010 msgr2=0x7fe4680cb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:27.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.801+0000 7fe46d53e700 1 -- 172.21.15.49:0/73292793 shutdown_connections 2023-11-30T18:39:27.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.801+0000 7fe46d53e700 1 -- 172.21.15.49:0/73292793 wait complete. 2023-11-30T18:39:27.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.802+0000 7fe46d53e700 1 Processor -- start 2023-11-30T18:39:27.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.802+0000 7fe46d53e700 1 -- start start 2023-11-30T18:39:27.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.803+0000 7fe46d53e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4680c5ef0 0x7fe468144c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:27.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.803+0000 7fe46d53e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe468154340 0x7fe4680acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:27.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.803+0000 7fe46d53e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe468154720 0x7fe4680ad220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:27.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.803+0000 7fe46d53e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4680ad710 con 0x7fe4680c5ef0 2023-11-30T18:39:27.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.803+0000 7fe46d53e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4680af860 con 0x7fe468154340 2023-11-30T18:39:27.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.803+0000 7fe46d53e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4680c20b0 con 0x7fe468154720 2023-11-30T18:39:27.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.803+0000 7fe467fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4680c5ef0 0x7fe468144c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:27.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.803+0000 7fe467fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4680c5ef0 0x7fe468144c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39000/0 (socket says 172.21.15.49:39000) 2023-11-30T18:39:27.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.803+0000 7fe467fff700 1 -- 172.21.15.49:0/3632065441 learned_addr learned my addr 172.21.15.49:0/3632065441 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:27.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.803+0000 7fe4677fe700 1 --2- 172.21.15.49:0/3632065441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe468154340 0x7fe4680acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:27.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.803+0000 7fe46cd3d700 1 --2- 172.21.15.49:0/3632065441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe468154720 0x7fe4680ad220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:27.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.803+0000 7fe467fff700 1 -- 172.21.15.49:0/3632065441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe468154720 msgr2=0x7fe4680ad220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:27.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.803+0000 7fe467fff700 1 --2- 172.21.15.49:0/3632065441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe468154720 0x7fe4680ad220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:27.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.803+0000 7fe467fff700 1 -- 172.21.15.49:0/3632065441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe468154340 msgr2=0x7fe4680acd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:27.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.803+0000 7fe467fff700 1 --2- 172.21.15.49:0/3632065441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe468154340 0x7fe4680acd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:27.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.803+0000 7fe467fff700 1 -- 172.21.15.49:0/3632065441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe450009370 con 0x7fe4680c5ef0 2023-11-30T18:39:27.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.803+0000 7fe46cd3d700 1 --2- 172.21.15.49:0/3632065441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe468154720 0x7fe4680ad220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:39:27.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.804+0000 7fe467fff700 1 --2- 172.21.15.49:0/3632065441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4680c5ef0 0x7fe468144c90 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7fe450006fd0 tx=0x7fe450017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:27.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.804+0000 7fe45ffff700 1 -- 172.21.15.49:0/3632065441 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45000bec0 con 0x7fe4680c5ef0 2023-11-30T18:39:27.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.804+0000 7fe45ffff700 1 -- 172.21.15.49:0/3632065441 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45000b8d0 con 0x7fe4680c5ef0 2023-11-30T18:39:27.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.804+0000 7fe45ffff700 1 -- 172.21.15.49:0/3632065441 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe450024470 con 0x7fe4680c5ef0 2023-11-30T18:39:27.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.804+0000 7fe46d53e700 1 -- 172.21.15.49:0/3632065441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4680af2a0 con 0x7fe4680c5ef0 2023-11-30T18:39:27.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.804+0000 7fe46d53e700 1 -- 172.21.15.49:0/3632065441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe468146da0 con 0x7fe4680c5ef0 2023-11-30T18:39:27.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.805+0000 7fe46d53e700 1 -- 172.21.15.49:0/3632065441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe46806c7c0 con 0x7fe4680c5ef0 2023-11-30T18:39:27.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.805+0000 7fe45ffff700 1 -- 172.21.15.49:0/3632065441 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe450021070 con 0x7fe4680c5ef0 2023-11-30T18:39:27.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.805+0000 7fe45ffff700 1 --2- 172.21.15.49:0/3632065441 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe44805f270 0x7fe448061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:27.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.806+0000 7fe45ffff700 1 -- 172.21.15.49:0/3632065441 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6599+0+0 (secure 0 0 0) 0x7fe45007bf50 con 0x7fe4680c5ef0 2023-11-30T18:39:27.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.806+0000 7fe4677fe700 1 --2- 172.21.15.49:0/3632065441 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe44805f270 0x7fe448061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:27.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.806+0000 7fe4677fe700 1 --2- 172.21.15.49:0/3632065441 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe44805f270 0x7fe448061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe46814c2b0 tx=0x7fe458007d40).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:27.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.810+0000 7fe45ffff700 1 -- 172.21.15.49:0/3632065441 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe45004cec0 con 0x7fe4680c5ef0 2023-11-30T18:39:27.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:27.990+0000 7fe46d53e700 1 -- 172.21.15.49:0/3632065441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe4681473e0 con 0x7fe4680c5ef0 2023-11-30T18:39:28.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.649+0000 7fe45ffff700 1 -- 172.21.15.49:0/3632065441 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v194) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe4681473e0 con 0x7fe4680c5ef0 2023-11-30T18:39:28.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.652+0000 7fe46d53e700 1 -- 172.21.15.49:0/3632065441 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe44805f270 msgr2=0x7fe448061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.652+0000 7fe46d53e700 1 --2- 172.21.15.49:0/3632065441 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe44805f270 0x7fe448061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe46814c2b0 tx=0x7fe458007d40).stop 2023-11-30T18:39:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.652+0000 7fe46d53e700 1 -- 172.21.15.49:0/3632065441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4680c5ef0 msgr2=0x7fe468144c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.652+0000 7fe46d53e700 1 --2- 172.21.15.49:0/3632065441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4680c5ef0 0x7fe468144c90 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7fe450006fd0 tx=0x7fe450017000).stop 2023-11-30T18:39:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.652+0000 7fe46d53e700 1 -- 172.21.15.49:0/3632065441 shutdown_connections 2023-11-30T18:39:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.652+0000 7fe46d53e700 1 --2- 172.21.15.49:0/3632065441 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe44805f270 0x7fe448061730 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.652+0000 7fe46d53e700 1 --2- 172.21.15.49:0/3632065441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe468154720 0x7fe4680ad220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.652+0000 7fe46d53e700 1 --2- 172.21.15.49:0/3632065441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4680c5ef0 0x7fe468144c90 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.652+0000 7fe46d53e700 1 --2- 172.21.15.49:0/3632065441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe468154340 0x7fe4680acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.652+0000 7fe46d53e700 1 -- 172.21.15.49:0/3632065441 >> 172.21.15.49:0/3632065441 conn(0x7fe4680cb010 msgr2=0x7fe4680c09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.652+0000 7fe46d53e700 1 -- 172.21.15.49:0/3632065441 shutdown_connections 2023-11-30T18:39:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.653+0000 7fe46d53e700 1 -- 172.21.15.49:0/3632065441 wait complete. 2023-11-30T18:39:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2023-11-30T18:39:28.668 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-30T18:39:28.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.796+0000 7f86445a4700 1 Processor -- start 2023-11-30T18:39:28.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.796+0000 7f86445a4700 1 -- start start 2023-11-30T18:39:28.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.797+0000 7f86445a4700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f863c0c6950 0x7f863c14eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:28.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.797+0000 7f86445a4700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f863c0634a0 con 0x7f863c14eb00 2023-11-30T18:39:28.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.797+0000 7f86445a4700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f863c063780 con 0x7f863c0bcdd0 2023-11-30T18:39:28.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.797+0000 7f86445a4700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f863c137d90 con 0x7f863c0c6950 2023-11-30T18:39:28.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.797+0000 7f8642340700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f863c14eb00 0x7f863c0bc6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46108/0 (socket says 172.21.15.49:46108) 2023-11-30T18:39:28.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.797+0000 7f8642340700 1 -- 172.21.15.49:0/2825321016 learned_addr learned my addr 172.21.15.49:0/2825321016 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:28.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.797+0000 7f8642b41700 1 --2- 172.21.15.49:0/2825321016 >> v2:172.21.15.115:3300/0 conn(0x7f863c0c6950 0x7f863c14eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:28.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.797+0000 7f864133e700 1 -- 172.21.15.49:0/2825321016 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3020108311 0 0) 0x7f863c0634a0 con 0x7f863c14eb00 2023-11-30T18:39:28.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.797+0000 7f864133e700 1 -- 172.21.15.49:0/2825321016 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86280033f0 con 0x7f863c14eb00 2023-11-30T18:39:28.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.797+0000 7f864133e700 1 -- 172.21.15.49:0/2825321016 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1329908908 0 0) 0x7f86280033f0 con 0x7f863c14eb00 2023-11-30T18:39:28.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.797+0000 7f864133e700 1 -- 172.21.15.49:0/2825321016 >> v2:172.21.15.115:3300/0 conn(0x7f863c0c6950 msgr2=0x7f863c14eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:28.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.797+0000 7f864133e700 1 --2- 172.21.15.49:0/2825321016 >> v2:172.21.15.115:3300/0 conn(0x7f863c0c6950 0x7f863c14eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:28.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.797+0000 7f864133e700 1 -- 172.21.15.49:0/2825321016 >> v1:172.21.15.115:6789/0 conn(0x7f863c0bcdd0 legacy=0x7f863c062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:28.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.797+0000 7f864133e700 1 -- 172.21.15.49:0/2825321016 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f863c063a60 con 0x7f863c14eb00 2023-11-30T18:39:28.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.797+0000 7f864133e700 1 -- 172.21.15.49:0/2825321016 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f86380015f0 con 0x7f863c14eb00 2023-11-30T18:39:28.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.797+0000 7f864133e700 1 -- 172.21.15.49:0/2825321016 >> v1:172.21.15.49:6789/0 conn(0x7f863c14eb00 legacy=0x7f863c0bc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:28.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.797+0000 7f864133e700 1 --2- 172.21.15.49:0/2825321016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86280038e0 0x7f8628003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:28.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.797+0000 7f864133e700 1 --2- 172.21.15.49:0/2825321016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8628004690 0x7f8628004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:28.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.798+0000 7f864133e700 1 --2- 172.21.15.49:0/2825321016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8628005000 0x7f862800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:28.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.798+0000 7f864133e700 1 -- 172.21.15.49:0/2825321016 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863c137d90 con 0x7f86280038e0 2023-11-30T18:39:28.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.798+0000 7f864133e700 1 -- 172.21.15.49:0/2825321016 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862800bf60 con 0x7f8628004690 2023-11-30T18:39:28.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.798+0000 7f864133e700 1 -- 172.21.15.49:0/2825321016 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862800c0f0 con 0x7f8628005000 2023-11-30T18:39:28.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.798+0000 7f8642340700 1 --2- 172.21.15.49:0/2825321016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86280038e0 0x7f8628003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:28.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.798+0000 7f8641b3f700 1 --2- 172.21.15.49:0/2825321016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8628004690 0x7f8628004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:28.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.798+0000 7f8642b41700 1 --2- 172.21.15.49:0/2825321016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8628005000 0x7f862800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:28.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.798+0000 7f8642340700 1 -- 172.21.15.49:0/2825321016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8628005000 msgr2=0x7f862800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:28.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.798+0000 7f8642340700 1 --2- 172.21.15.49:0/2825321016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8628005000 0x7f862800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:28.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.798+0000 7f8642340700 1 -- 172.21.15.49:0/2825321016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8628004690 msgr2=0x7f8628004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:28.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.798+0000 7f8642340700 1 --2- 172.21.15.49:0/2825321016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8628004690 0x7f8628004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:28.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.798+0000 7f8642340700 1 -- 172.21.15.49:0/2825321016 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86280033f0 con 0x7f86280038e0 2023-11-30T18:39:28.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.798+0000 7f8642b41700 1 -- 172.21.15.49:0/2825321016 reap_dead start 2023-11-30T18:39:28.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.798+0000 7f8642340700 1 --2- 172.21.15.49:0/2825321016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86280038e0 0x7f8628003d00 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 rx=0x7f863800c160 tx=0x7f86380077a0).ready entity=mon.0 client_cookie=64f6489f365f604 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:28.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.798+0000 7f864133e700 1 -- 172.21.15.49:0/2825321016 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86380079d0 con 0x7f86280038e0 2023-11-30T18:39:28.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.798+0000 7f864133e700 1 -- 172.21.15.49:0/2825321016 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863800ca90 con 0x7f86280038e0 2023-11-30T18:39:28.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.798+0000 7f864133e700 1 -- 172.21.15.49:0/2825321016 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863800ce10 con 0x7f86280038e0 2023-11-30T18:39:28.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.799+0000 7f86445a4700 1 -- 172.21.15.49:0/2825321016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86280038e0 msgr2=0x7f8628003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:28.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.799+0000 7f86445a4700 1 --2- 172.21.15.49:0/2825321016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86280038e0 0x7f8628003d00 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 rx=0x7f863800c160 tx=0x7f86380077a0).stop 2023-11-30T18:39:28.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.799+0000 7f86445a4700 1 -- 172.21.15.49:0/2825321016 shutdown_connections 2023-11-30T18:39:28.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.799+0000 7f86445a4700 1 --2- 172.21.15.49:0/2825321016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86280038e0 0x7f8628003d00 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:28.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.799+0000 7f86445a4700 1 -- 172.21.15.49:0/2825321016 >> 172.21.15.49:0/2825321016 conn(0x7f863c0c8230 msgr2=0x7f863c0c4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:28.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.799+0000 7f86445a4700 1 -- 172.21.15.49:0/2825321016 shutdown_connections 2023-11-30T18:39:28.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.799+0000 7f86445a4700 1 -- 172.21.15.49:0/2825321016 wait complete. 2023-11-30T18:39:28.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.800+0000 7f86445a4700 1 Processor -- start 2023-11-30T18:39:28.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.800+0000 7f86445a4700 1 -- start start 2023-11-30T18:39:28.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.801+0000 7f86445a4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86280038e0 0x7f863c1576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:28.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.801+0000 7f86445a4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f863c1348d0 0x7f863c14f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:28.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.801+0000 7f86445a4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f863c0a5540 0x7f863c0a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:28.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.801+0000 7f86445a4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863c0bffa0 con 0x7f863c1348d0 2023-11-30T18:39:28.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.801+0000 7f86445a4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863c0a50b0 con 0x7f86280038e0 2023-11-30T18:39:28.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.801+0000 7f86445a4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863c0bfcc0 con 0x7f863c0a5540 2023-11-30T18:39:28.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.801+0000 7f8641b3f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f863c1348d0 0x7f863c14f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:28.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.801+0000 7f8641b3f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f863c1348d0 0x7f863c14f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39030/0 (socket says 172.21.15.49:39030) 2023-11-30T18:39:28.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.801+0000 7f8641b3f700 1 -- 172.21.15.49:0/2861012280 learned_addr learned my addr 172.21.15.49:0/2861012280 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:28.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.801+0000 7f8642340700 1 --2- 172.21.15.49:0/2861012280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86280038e0 0x7f863c1576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:28.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.801+0000 7f8642b41700 1 --2- 172.21.15.49:0/2861012280 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f863c0a5540 0x7f863c0a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:28.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.801+0000 7f8641b3f700 1 -- 172.21.15.49:0/2861012280 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f863c0a5540 msgr2=0x7f863c0a59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:28.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.801+0000 7f8641b3f700 1 --2- 172.21.15.49:0/2861012280 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f863c0a5540 0x7f863c0a59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:28.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.801+0000 7f8641b3f700 1 -- 172.21.15.49:0/2861012280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86280038e0 msgr2=0x7f863c1576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:28.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.801+0000 7f8641b3f700 1 --2- 172.21.15.49:0/2861012280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86280038e0 0x7f863c1576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:28.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.801+0000 7f8641b3f700 1 -- 172.21.15.49:0/2861012280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f863c0a4a60 con 0x7f863c1348d0 2023-11-30T18:39:28.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.801+0000 7f8642b41700 1 --2- 172.21.15.49:0/2861012280 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f863c0a5540 0x7f863c0a59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:39:28.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.801+0000 7f8641b3f700 1 --2- 172.21.15.49:0/2861012280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f863c1348d0 0x7f863c14f410 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7f862c0028e0 tx=0x7f862c007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:28.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.801+0000 7f86327fc700 1 -- 172.21.15.49:0/2861012280 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862c007240 con 0x7f863c1348d0 2023-11-30T18:39:28.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.801+0000 7f86327fc700 1 -- 172.21.15.49:0/2861012280 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862c0073a0 con 0x7f863c1348d0 2023-11-30T18:39:28.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.801+0000 7f86445a4700 1 -- 172.21.15.49:0/2861012280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f863c0a4d40 con 0x7f863c1348d0 2023-11-30T18:39:28.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.801+0000 7f86327fc700 1 -- 172.21.15.49:0/2861012280 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862c0066f0 con 0x7f863c1348d0 2023-11-30T18:39:28.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.801+0000 7f86445a4700 1 -- 172.21.15.49:0/2861012280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f863c0a60f0 con 0x7f863c1348d0 2023-11-30T18:39:28.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.802+0000 7f86445a4700 1 -- 172.21.15.49:0/2861012280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f863c063c80 con 0x7f863c1348d0 2023-11-30T18:39:28.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.803+0000 7f86327fc700 1 -- 172.21.15.49:0/2861012280 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f862c006a60 con 0x7f863c1348d0 2023-11-30T18:39:28.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.803+0000 7f86327fc700 1 --2- 172.21.15.49:0/2861012280 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f862005f270 0x7f8620061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:28.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.803+0000 7f86327fc700 1 -- 172.21.15.49:0/2861012280 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6127+0+0 (secure 0 0 0) 0x7f862c079bf0 con 0x7f863c1348d0 2023-11-30T18:39:28.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.803+0000 7f8642340700 1 --2- 172.21.15.49:0/2861012280 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f862005f270 0x7f8620061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:28.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.804+0000 7f8642340700 1 --2- 172.21.15.49:0/2861012280 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f862005f270 0x7f8620061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f8638000ef0 tx=0x7f8638015000).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:28.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.807+0000 7f86327fc700 1 -- 172.21.15.49:0/2861012280 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f862c049b00 con 0x7f863c1348d0 2023-11-30T18:39:28.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.983+0000 7f86445a4700 1 -- 172.21.15.49:0/2861012280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f863c06c860 con 0x7f863c1348d0 2023-11-30T18:39:28.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.986+0000 7f86327fc700 1 -- 172.21.15.49:0/2861012280 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v36) v1 ==== 104+0+0 (secure 0 0 0) 0x7f862c018070 con 0x7f863c1348d0 2023-11-30T18:39:28.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.988+0000 7f86445a4700 1 -- 172.21.15.49:0/2861012280 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f862005f270 msgr2=0x7f8620061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:28.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.988+0000 7f86445a4700 1 --2- 172.21.15.49:0/2861012280 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f862005f270 0x7f8620061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f8638000ef0 tx=0x7f8638015000).stop 2023-11-30T18:39:28.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.988+0000 7f86445a4700 1 -- 172.21.15.49:0/2861012280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f863c1348d0 msgr2=0x7f863c14f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:28.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.988+0000 7f86445a4700 1 --2- 172.21.15.49:0/2861012280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f863c1348d0 0x7f863c14f410 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7f862c0028e0 tx=0x7f862c007c00).stop 2023-11-30T18:39:28.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.988+0000 7f86445a4700 1 -- 172.21.15.49:0/2861012280 shutdown_connections 2023-11-30T18:39:28.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.988+0000 7f86445a4700 1 --2- 172.21.15.49:0/2861012280 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f862005f270 0x7f8620061730 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:28.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.988+0000 7f86445a4700 1 --2- 172.21.15.49:0/2861012280 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f863c0a5540 0x7f863c0a59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:28.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.988+0000 7f86445a4700 1 --2- 172.21.15.49:0/2861012280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86280038e0 0x7f863c1576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:28.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.988+0000 7f86445a4700 1 --2- 172.21.15.49:0/2861012280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f863c1348d0 0x7f863c14f410 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:28.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.988+0000 7f86445a4700 1 -- 172.21.15.49:0/2861012280 >> 172.21.15.49:0/2861012280 conn(0x7f863c0c8230 msgr2=0x7f863c136800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:28.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.988+0000 7f86445a4700 1 -- 172.21.15.49:0/2861012280 shutdown_connections 2023-11-30T18:39:28.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:28.988+0000 7f86445a4700 1 -- 172.21.15.49:0/2861012280 wait complete. 2023-11-30T18:39:29.002 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-11-30T18:39:29.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.120+0000 7ff782bb4700 1 Processor -- start 2023-11-30T18:39:29.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.120+0000 7ff782bb4700 1 -- start start 2023-11-30T18:39:29.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.120+0000 7ff782bb4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff77c0c6190 0x7ff77c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:29.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.121+0000 7ff782bb4700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff77c158320 0x7ff77c1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:29.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.121+0000 7ff782bb4700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff77c158cc0 con 0x7ff77c098d10 2023-11-30T18:39:29.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.121+0000 7ff782bb4700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff77c0c72d0 con 0x7ff77c158320 2023-11-30T18:39:29.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.121+0000 7ff782bb4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c064570 con 0x7ff77c0c6190 2023-11-30T18:39:29.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.121+0000 7ff780950700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff77c098d10 0x7ff77c063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46114/0 (socket says 172.21.15.49:46114) 2023-11-30T18:39:29.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.121+0000 7ff780950700 1 -- 172.21.15.49:0/103726079 learned_addr learned my addr 172.21.15.49:0/103726079 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:29.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.121+0000 7ff781151700 1 --2- 172.21.15.49:0/103726079 >> v2:172.21.15.115:3300/0 conn(0x7ff77c158320 0x7ff77c1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:29.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.121+0000 7ff77bfff700 1 --2- 172.21.15.49:0/103726079 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff77c0c6190 0x7ff77c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:29.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.121+0000 7ff77b7fe700 1 -- 172.21.15.49:0/103726079 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2986031176 0 0) 0x7ff774001490 con 0x7ff77c098d10 2023-11-30T18:39:29.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.121+0000 7ff77b7fe700 1 -- 172.21.15.49:0/103726079 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7680033f0 con 0x7ff77c098d10 2023-11-30T18:39:29.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.121+0000 7ff77b7fe700 1 -- 172.21.15.49:0/103726079 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4046732577 0 0) 0x7ff7680033f0 con 0x7ff77c098d10 2023-11-30T18:39:29.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.121+0000 7ff77b7fe700 1 -- 172.21.15.49:0/103726079 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff77c0c6190 msgr2=0x7ff77c0c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:29.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.121+0000 7ff77b7fe700 1 --2- 172.21.15.49:0/103726079 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff77c0c6190 0x7ff77c0c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:29.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.121+0000 7ff77b7fe700 1 -- 172.21.15.49:0/103726079 >> v2:172.21.15.115:3300/0 conn(0x7ff77c158320 msgr2=0x7ff77c1587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:29.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.121+0000 7ff77b7fe700 1 --2- 172.21.15.49:0/103726079 >> v2:172.21.15.115:3300/0 conn(0x7ff77c158320 0x7ff77c1587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:29.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.121+0000 7ff77b7fe700 1 -- 172.21.15.49:0/103726079 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77c154bc0 con 0x7ff77c098d10 2023-11-30T18:39:29.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.121+0000 7ff77b7fe700 1 -- 172.21.15.49:0/103726079 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7ff774001980 con 0x7ff77c098d10 2023-11-30T18:39:29.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.121+0000 7ff77b7fe700 1 -- 172.21.15.49:0/103726079 >> v1:172.21.15.49:6789/0 conn(0x7ff77c098d10 legacy=0x7ff77c063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:29.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.121+0000 7ff77b7fe700 1 --2- 172.21.15.49:0/103726079 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff77c0c6190 0x7ff7680038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:29.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.121+0000 7ff77b7fe700 1 --2- 172.21.15.49:0/103726079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff768003e10 0x7ff768004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:29.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.121+0000 7ff77b7fe700 1 --2- 172.21.15.49:0/103726079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff768004b80 0x7ff768005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:29.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.121+0000 7ff77b7fe700 1 -- 172.21.15.49:0/103726079 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c0c72d0 con 0x7ff768003e10 2023-11-30T18:39:29.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.121+0000 7ff77b7fe700 1 -- 172.21.15.49:0/103726079 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c064570 con 0x7ff768004b80 2023-11-30T18:39:29.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.121+0000 7ff77b7fe700 1 -- 172.21.15.49:0/103726079 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76800b8e0 con 0x7ff77c0c6190 2023-11-30T18:39:29.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.122+0000 7ff77bfff700 1 --2- 172.21.15.49:0/103726079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff768003e10 0x7ff768004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:29.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.122+0000 7ff780950700 1 --2- 172.21.15.49:0/103726079 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff77c0c6190 0x7ff7680038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:29.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.122+0000 7ff781151700 1 --2- 172.21.15.49:0/103726079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff768004b80 0x7ff768005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:29.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.122+0000 7ff77bfff700 1 -- 172.21.15.49:0/103726079 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff77c0c6190 msgr2=0x7ff7680038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:29.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.122+0000 7ff77bfff700 1 --2- 172.21.15.49:0/103726079 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff77c0c6190 0x7ff7680038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:29.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.122+0000 7ff77bfff700 1 -- 172.21.15.49:0/103726079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff768004b80 msgr2=0x7ff768005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:29.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.122+0000 7ff77bfff700 1 --2- 172.21.15.49:0/103726079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff768004b80 0x7ff768005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:29.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.122+0000 7ff77bfff700 1 -- 172.21.15.49:0/103726079 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7680033f0 con 0x7ff768003e10 2023-11-30T18:39:29.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.122+0000 7ff77bfff700 1 --2- 172.21.15.49:0/103726079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff768003e10 0x7ff768004690 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7ff76c009a60 tx=0x7ff76c009060).ready entity=mon.0 client_cookie=a01c1ad1a9dba67b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:29.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.122+0000 7ff77b7fe700 1 -- 172.21.15.49:0/103726079 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c009ea0 con 0x7ff768003e10 2023-11-30T18:39:29.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.122+0000 7ff77b7fe700 1 -- 172.21.15.49:0/103726079 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76c009430 con 0x7ff768003e10 2023-11-30T18:39:29.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.122+0000 7ff77b7fe700 1 -- 172.21.15.49:0/103726079 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c00e890 con 0x7ff768003e10 2023-11-30T18:39:29.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.123+0000 7ff782bb4700 1 -- 172.21.15.49:0/103726079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff768003e10 msgr2=0x7ff768004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:29.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.123+0000 7ff782bb4700 1 --2- 172.21.15.49:0/103726079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff768003e10 0x7ff768004690 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7ff76c009a60 tx=0x7ff76c009060).stop 2023-11-30T18:39:29.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.123+0000 7ff781151700 1 -- 172.21.15.49:0/103726079 reap_dead start 2023-11-30T18:39:29.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.123+0000 7ff782bb4700 1 -- 172.21.15.49:0/103726079 shutdown_connections 2023-11-30T18:39:29.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.123+0000 7ff782bb4700 1 -- 172.21.15.49:0/103726079 >> 172.21.15.49:0/103726079 conn(0x7ff77c0cb310 msgr2=0x7ff77c0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:29.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.123+0000 7ff782bb4700 1 -- 172.21.15.49:0/103726079 shutdown_connections 2023-11-30T18:39:29.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.123+0000 7ff782bb4700 1 -- 172.21.15.49:0/103726079 wait complete. 2023-11-30T18:39:29.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.124+0000 7ff782bb4700 1 Processor -- start 2023-11-30T18:39:29.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.124+0000 7ff782bb4700 1 -- start start 2023-11-30T18:39:29.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.125+0000 7ff782bb4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff768003e10 0x7ff77c0ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:29.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.125+0000 7ff782bb4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff77c0ae7b0 0x7ff77c13ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:29.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.125+0000 7ff782bb4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff77c13f1d0 0x7ff77c13f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:29.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.125+0000 7ff782bb4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c0ac610 con 0x7ff768003e10 2023-11-30T18:39:29.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.125+0000 7ff782bb4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c0aec30 con 0x7ff77c13f1d0 2023-11-30T18:39:29.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.125+0000 7ff782bb4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c13caa0 con 0x7ff77c0ae7b0 2023-11-30T18:39:29.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.125+0000 7ff780950700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff768003e10 0x7ff77c0ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:29.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.125+0000 7ff780950700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff768003e10 0x7ff77c0ae2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39046/0 (socket says 172.21.15.49:39046) 2023-11-30T18:39:29.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.125+0000 7ff780950700 1 -- 172.21.15.49:0/331972902 learned_addr learned my addr 172.21.15.49:0/331972902 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:29.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.125+0000 7ff77bfff700 1 --2- 172.21.15.49:0/331972902 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff77c0ae7b0 0x7ff77c13ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:29.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.125+0000 7ff781151700 1 --2- 172.21.15.49:0/331972902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff77c13f1d0 0x7ff77c13f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:29.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.125+0000 7ff780950700 1 -- 172.21.15.49:0/331972902 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff77c0ae7b0 msgr2=0x7ff77c13ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:29.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.125+0000 7ff780950700 1 --2- 172.21.15.49:0/331972902 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff77c0ae7b0 0x7ff77c13ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:29.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.125+0000 7ff780950700 1 -- 172.21.15.49:0/331972902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff77c13f1d0 msgr2=0x7ff77c13f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:29.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.125+0000 7ff780950700 1 --2- 172.21.15.49:0/331972902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff77c13f1d0 0x7ff77c13f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:29.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.125+0000 7ff780950700 1 -- 172.21.15.49:0/331972902 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77c1516e0 con 0x7ff768003e10 2023-11-30T18:39:29.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.125+0000 7ff780950700 1 --2- 172.21.15.49:0/331972902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff768003e10 0x7ff77c0ae2c0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 rx=0x7ff774007770 tx=0x7ff77c0a8040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:29.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.125+0000 7ff778ff9700 1 -- 172.21.15.49:0/331972902 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77400f8d0 con 0x7ff768003e10 2023-11-30T18:39:29.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.126+0000 7ff778ff9700 1 -- 172.21.15.49:0/331972902 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77400fa30 con 0x7ff768003e10 2023-11-30T18:39:29.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.126+0000 7ff782bb4700 1 -- 172.21.15.49:0/331972902 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff77c0abfc0 con 0x7ff768003e10 2023-11-30T18:39:29.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.126+0000 7ff778ff9700 1 -- 172.21.15.49:0/331972902 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77400fdb0 con 0x7ff768003e10 2023-11-30T18:39:29.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.126+0000 7ff782bb4700 1 -- 172.21.15.49:0/331972902 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77c0abc70 con 0x7ff768003e10 2023-11-30T18:39:29.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.127+0000 7ff782bb4700 1 -- 172.21.15.49:0/331972902 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff77c06c860 con 0x7ff768003e10 2023-11-30T18:39:29.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.127+0000 7ff778ff9700 1 -- 172.21.15.49:0/331972902 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff774015620 con 0x7ff768003e10 2023-11-30T18:39:29.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.127+0000 7ff778ff9700 1 --2- 172.21.15.49:0/331972902 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff75c05f240 0x7ff75c061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:29.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.128+0000 7ff778ff9700 1 -- 172.21.15.49:0/331972902 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6127+0+0 (secure 0 0 0) 0x7ff77407a600 con 0x7ff768003e10 2023-11-30T18:39:29.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.128+0000 7ff77bfff700 1 --2- 172.21.15.49:0/331972902 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff75c05f240 0x7ff75c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:29.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.128+0000 7ff77bfff700 1 --2- 172.21.15.49:0/331972902 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff75c05f240 0x7ff75c061700 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7ff76c009930 tx=0x7ff76c019000).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:29.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.132+0000 7ff778ff9700 1 -- 172.21.15.49:0/331972902 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff77404b6f0 con 0x7ff768003e10 2023-11-30T18:39:29.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.307+0000 7ff782bb4700 1 -- 172.21.15.49:0/331972902 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7ff77c158cc0 con 0x7ff768003e10 2023-11-30T18:39:29.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.310+0000 7ff778ff9700 1 -- 172.21.15.49:0/331972902 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v37) v1 ==== 120+0+0 (secure 0 0 0) 0x7ff77c158cc0 con 0x7ff768003e10 2023-11-30T18:39:29.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.313+0000 7ff782bb4700 1 -- 172.21.15.49:0/331972902 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff75c05f240 msgr2=0x7ff75c061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:29.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.313+0000 7ff782bb4700 1 --2- 172.21.15.49:0/331972902 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff75c05f240 0x7ff75c061700 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7ff76c009930 tx=0x7ff76c019000).stop 2023-11-30T18:39:29.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.313+0000 7ff782bb4700 1 -- 172.21.15.49:0/331972902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff768003e10 msgr2=0x7ff77c0ae2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:29.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.313+0000 7ff782bb4700 1 --2- 172.21.15.49:0/331972902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff768003e10 0x7ff77c0ae2c0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 rx=0x7ff774007770 tx=0x7ff77c0a8040).stop 2023-11-30T18:39:29.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.313+0000 7ff782bb4700 1 -- 172.21.15.49:0/331972902 shutdown_connections 2023-11-30T18:39:29.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.313+0000 7ff782bb4700 1 --2- 172.21.15.49:0/331972902 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff75c05f240 0x7ff75c061700 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:29.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.313+0000 7ff782bb4700 1 --2- 172.21.15.49:0/331972902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff77c13f1d0 0x7ff77c13f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:29.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.313+0000 7ff782bb4700 1 --2- 172.21.15.49:0/331972902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff768003e10 0x7ff77c0ae2c0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:29.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.313+0000 7ff782bb4700 1 --2- 172.21.15.49:0/331972902 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff77c0ae7b0 0x7ff77c13ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:29.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.313+0000 7ff782bb4700 1 -- 172.21.15.49:0/331972902 >> 172.21.15.49:0/331972902 conn(0x7ff77c0cb310 msgr2=0x7ff77c155080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:29.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.313+0000 7ff782bb4700 1 -- 172.21.15.49:0/331972902 shutdown_connections 2023-11-30T18:39:29.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.313+0000 7ff782bb4700 1 -- 172.21.15.49:0/331972902 wait complete. 2023-11-30T18:39:29.327 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-11-30T18:39:29.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.442+0000 7f0c889f0700 1 Processor -- start 2023-11-30T18:39:29.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.442+0000 7f0c889f0700 1 -- start start 2023-11-30T18:39:29.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.443+0000 7f0c889f0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c841544d0 0x7f0c84155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:29.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.443+0000 7f0c889f0700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0c840673c0 0x7f0c8415e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:29.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.443+0000 7f0c889f0700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c840683d0 con 0x7f0c84066f40 2023-11-30T18:39:29.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.443+0000 7f0c889f0700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c84067850 con 0x7f0c840673c0 2023-11-30T18:39:29.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.443+0000 7f0c889f0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c84067b30 con 0x7f0c841544d0 2023-11-30T18:39:29.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.443+0000 7f0c82d9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0c840673c0 0x7f0c8415e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:29.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.443+0000 7f0c81d9b700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0c84066f40 0x7f0c84095e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46120/0 (socket says 172.21.15.49:46120) 2023-11-30T18:39:29.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.443+0000 7f0c81d9b700 1 -- 172.21.15.49:0/3712859642 learned_addr learned my addr 172.21.15.49:0/3712859642 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:29.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.444+0000 7f0c8259c700 1 --2- 172.21.15.49:0/3712859642 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c841544d0 0x7f0c84155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:29.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.444+0000 7f0c82d9d700 1 -- 172.21.15.49:0/3712859642 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c841544d0 msgr2=0x7f0c84155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:29.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.444+0000 7f0c82d9d700 1 --2- 172.21.15.49:0/3712859642 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c841544d0 0x7f0c84155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:29.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.444+0000 7f0c82d9d700 1 -- 172.21.15.49:0/3712859642 >> v1:172.21.15.49:6789/0 conn(0x7f0c84066f40 legacy=0x7f0c84095e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:29.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.444+0000 7f0c82d9d700 1 -- 172.21.15.49:0/3712859642 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c84067e10 con 0x7f0c840673c0 2023-11-30T18:39:29.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.444+0000 7f0c8159a700 1 -- 172.21.15.49:0/3712859642 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012484393 0 0) 0x7f0c840683d0 con 0x7f0c84066f40 2023-11-30T18:39:29.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.444+0000 7f0c82d9d700 1 --2- 172.21.15.49:0/3712859642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c840673c0 0x7f0c8415e0a0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7f0c74009760 tx=0x7f0c74009060).ready entity=mon.0 client_cookie=61a3eba11af72bf0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:29.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.444+0000 7f0c8159a700 1 -- 172.21.15.49:0/3712859642 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7400f510 con 0x7f0c840673c0 2023-11-30T18:39:29.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.444+0000 7f0c8159a700 1 -- 172.21.15.49:0/3712859642 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7400f670 con 0x7f0c840673c0 2023-11-30T18:39:29.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.444+0000 7f0c8159a700 1 -- 172.21.15.49:0/3712859642 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7400f9f0 con 0x7f0c840673c0 2023-11-30T18:39:29.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.445+0000 7f0c889f0700 1 -- 172.21.15.49:0/3712859642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c840673c0 msgr2=0x7f0c8415e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:29.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.445+0000 7f0c889f0700 1 --2- 172.21.15.49:0/3712859642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c840673c0 0x7f0c8415e0a0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7f0c74009760 tx=0x7f0c74009060).stop 2023-11-30T18:39:29.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.445+0000 7f0c889f0700 1 -- 172.21.15.49:0/3712859642 shutdown_connections 2023-11-30T18:39:29.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.445+0000 7f0c889f0700 1 --2- 172.21.15.49:0/3712859642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c840673c0 0x7f0c8415e0a0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:29.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.445+0000 7f0c889f0700 1 --2- 172.21.15.49:0/3712859642 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c841544d0 0x7f0c84155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:29.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.445+0000 7f0c889f0700 1 -- 172.21.15.49:0/3712859642 >> 172.21.15.49:0/3712859642 conn(0x7f0c840631d0 msgr2=0x7f0c840c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:29.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.445+0000 7f0c889f0700 1 -- 172.21.15.49:0/3712859642 shutdown_connections 2023-11-30T18:39:29.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.445+0000 7f0c889f0700 1 -- 172.21.15.49:0/3712859642 wait complete. 2023-11-30T18:39:29.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.446+0000 7f0c889f0700 1 Processor -- start 2023-11-30T18:39:29.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.446+0000 7f0c889f0700 1 -- start start 2023-11-30T18:39:29.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.447+0000 7f0c889f0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c84066f40 0x7f0c840a7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:29.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.447+0000 7f0c889f0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c841544d0 0x7f0c84145d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:29.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.447+0000 7f0c889f0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c840a7cb0 0x7f0c84156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:29.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.447+0000 7f0c889f0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c84146250 con 0x7f0c840a7cb0 2023-11-30T18:39:29.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.447+0000 7f0c889f0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c840a6da0 con 0x7f0c841544d0 2023-11-30T18:39:29.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.447+0000 7f0c889f0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c840a6910 con 0x7f0c84066f40 2023-11-30T18:39:29.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.447+0000 7f0c82d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c840a7cb0 0x7f0c84156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:29.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.447+0000 7f0c82d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c840a7cb0 0x7f0c84156470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39052/0 (socket says 172.21.15.49:39052) 2023-11-30T18:39:29.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.447+0000 7f0c82d9d700 1 -- 172.21.15.49:0/1810757835 learned_addr learned my addr 172.21.15.49:0/1810757835 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:29.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.447+0000 7f0c8259c700 1 --2- 172.21.15.49:0/1810757835 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c84066f40 0x7f0c840a7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:29.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.447+0000 7f0c81d9b700 1 --2- 172.21.15.49:0/1810757835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c841544d0 0x7f0c84145d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:29.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.447+0000 7f0c82d9d700 1 -- 172.21.15.49:0/1810757835 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c84066f40 msgr2=0x7f0c840a7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:29.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.447+0000 7f0c82d9d700 1 --2- 172.21.15.49:0/1810757835 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c84066f40 0x7f0c840a7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:29.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.447+0000 7f0c82d9d700 1 -- 172.21.15.49:0/1810757835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c841544d0 msgr2=0x7f0c84145d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:29.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.447+0000 7f0c82d9d700 1 --2- 172.21.15.49:0/1810757835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c841544d0 0x7f0c84145d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:29.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.447+0000 7f0c82d9d700 1 -- 172.21.15.49:0/1810757835 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c740092a0 con 0x7f0c840a7cb0 2023-11-30T18:39:29.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.447+0000 7f0c82d9d700 1 --2- 172.21.15.49:0/1810757835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c840a7cb0 0x7f0c84156470 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7f0c74009e00 tx=0x7f0c74017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:29.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.447+0000 7f0c727fc700 1 -- 172.21.15.49:0/1810757835 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c74011700 con 0x7f0c840a7cb0 2023-11-30T18:39:29.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.447+0000 7f0c727fc700 1 -- 172.21.15.49:0/1810757835 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7401e070 con 0x7f0c840a7cb0 2023-11-30T18:39:29.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.447+0000 7f0c889f0700 1 -- 172.21.15.49:0/1810757835 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c840a5fe0 con 0x7f0c840a7cb0 2023-11-30T18:39:29.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.447+0000 7f0c727fc700 1 -- 172.21.15.49:0/1810757835 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c74011ab0 con 0x7f0c840a7cb0 2023-11-30T18:39:29.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.447+0000 7f0c889f0700 1 -- 172.21.15.49:0/1810757835 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c840a65a0 con 0x7f0c840a7cb0 2023-11-30T18:39:29.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.448+0000 7f0c889f0700 1 -- 172.21.15.49:0/1810757835 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c8406c860 con 0x7f0c840a7cb0 2023-11-30T18:39:29.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.449+0000 7f0c727fc700 1 -- 172.21.15.49:0/1810757835 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0c74020030 con 0x7f0c840a7cb0 2023-11-30T18:39:29.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.449+0000 7f0c727fc700 1 --2- 172.21.15.49:0/1810757835 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0c6405f240 0x7f0c64061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:29.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.449+0000 7f0c727fc700 1 -- 172.21.15.49:0/1810757835 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6127+0+0 (secure 0 0 0) 0x7f0c7407b620 con 0x7f0c840a7cb0 2023-11-30T18:39:29.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.449+0000 7f0c8259c700 1 --2- 172.21.15.49:0/1810757835 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0c6405f240 0x7f0c64061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:29.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.450+0000 7f0c8259c700 1 --2- 172.21.15.49:0/1810757835 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0c6405f240 0x7f0c64061700 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f0c7c009fd0 tx=0x7f0c7c00b040).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:29.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.453+0000 7f0c727fc700 1 -- 172.21.15.49:0/1810757835 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0c7404c770 con 0x7f0c840a7cb0 2023-11-30T18:39:29.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:29.696+0000 7f0c889f0700 1 -- 172.21.15.49:0/1810757835 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7f0c840a6a50 con 0x7f0c840a7cb0 2023-11-30T18:39:30.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.656+0000 7f0c727fc700 1 -- 172.21.15.49:0/1810757835 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v2949) v1 ==== 165+0+0 (secure 0 0 0) 0x7f0c740280e0 con 0x7f0c840a7cb0 2023-11-30T18:39:30.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.658+0000 7f0c889f0700 1 -- 172.21.15.49:0/1810757835 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0c6405f240 msgr2=0x7f0c64061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:30.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.658+0000 7f0c889f0700 1 --2- 172.21.15.49:0/1810757835 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0c6405f240 0x7f0c64061700 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f0c7c009fd0 tx=0x7f0c7c00b040).stop 2023-11-30T18:39:30.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.658+0000 7f0c889f0700 1 -- 172.21.15.49:0/1810757835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c840a7cb0 msgr2=0x7f0c84156470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:30.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.658+0000 7f0c889f0700 1 --2- 172.21.15.49:0/1810757835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c840a7cb0 0x7f0c84156470 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7f0c74009e00 tx=0x7f0c74017000).stop 2023-11-30T18:39:30.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.658+0000 7f0c889f0700 1 -- 172.21.15.49:0/1810757835 shutdown_connections 2023-11-30T18:39:30.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.658+0000 7f0c889f0700 1 --2- 172.21.15.49:0/1810757835 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0c6405f240 0x7f0c64061700 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:30.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.658+0000 7f0c889f0700 1 --2- 172.21.15.49:0/1810757835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c840a7cb0 0x7f0c84156470 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:30.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.658+0000 7f0c889f0700 1 --2- 172.21.15.49:0/1810757835 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c84066f40 0x7f0c840a7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:30.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.658+0000 7f0c889f0700 1 --2- 172.21.15.49:0/1810757835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c841544d0 0x7f0c84145d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:30.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.658+0000 7f0c889f0700 1 -- 172.21.15.49:0/1810757835 >> 172.21.15.49:0/1810757835 conn(0x7f0c840631d0 msgr2=0x7f0c8414fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:30.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.658+0000 7f0c889f0700 1 -- 172.21.15.49:0/1810757835 shutdown_connections 2023-11-30T18:39:30.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.658+0000 7f0c889f0700 1 -- 172.21.15.49:0/1810757835 wait complete. 2023-11-30T18:39:30.675 INFO:tasks.cephfs_test_runner:Test that snap schedule is resumed after mgr restart ... ok 2023-11-30T18:39:30.675 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test scheduled snapshots along with rentention policy 2023-11-30T18:39:30.675 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-11-30T18:39:30.676 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-11-30T18:39:30.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.799+0000 7fcb5ac8b700 1 Processor -- start 2023-11-30T18:39:30.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.799+0000 7fcb5ac8b700 1 -- start start 2023-11-30T18:39:30.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.800+0000 7fcb5ac8b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcb541548c0 0x7fcb5406a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:30.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.800+0000 7fcb5ac8b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb540c6e30 0x7fcb540c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:30.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.800+0000 7fcb5ac8b700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb540c69a0 con 0x7fcb541544e0 2023-11-30T18:39:30.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.800+0000 7fcb5ac8b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb540c13a0 con 0x7fcb541548c0 2023-11-30T18:39:30.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.800+0000 7fcb5ac8b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb540c1680 con 0x7fcb540c6e30 2023-11-30T18:39:30.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.800+0000 7fcb58a27700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcb541544e0 0x7fcb540c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:54164/0 (socket says 172.21.15.49:54164) 2023-11-30T18:39:30.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.800+0000 7fcb58a27700 1 -- 172.21.15.49:0/4127823861 learned_addr learned my addr 172.21.15.49:0/4127823861 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:30.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.800+0000 7fcb537fe700 1 -- 172.21.15.49:0/4127823861 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082492461 0 0) 0x7fcb540c69a0 con 0x7fcb541544e0 2023-11-30T18:39:30.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.800+0000 7fcb53fff700 1 --2- 172.21.15.49:0/4127823861 >> v2:172.21.15.115:3300/0 conn(0x7fcb541548c0 0x7fcb5406a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:30.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.800+0000 7fcb59228700 1 --2- 172.21.15.49:0/4127823861 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb540c6e30 0x7fcb540c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:30.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.800+0000 7fcb537fe700 1 -- 172.21.15.49:0/4127823861 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb440033f0 con 0x7fcb541544e0 2023-11-30T18:39:30.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.801+0000 7fcb537fe700 1 -- 172.21.15.49:0/4127823861 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 621349071 0 0) 0x7fcb440033f0 con 0x7fcb541544e0 2023-11-30T18:39:30.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.801+0000 7fcb537fe700 1 -- 172.21.15.49:0/4127823861 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb540c6e30 msgr2=0x7fcb540c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:30.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.801+0000 7fcb537fe700 1 --2- 172.21.15.49:0/4127823861 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb540c6e30 0x7fcb540c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:30.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.801+0000 7fcb537fe700 1 -- 172.21.15.49:0/4127823861 >> v2:172.21.15.115:3300/0 conn(0x7fcb541548c0 msgr2=0x7fcb5406a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:30.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.801+0000 7fcb537fe700 1 --2- 172.21.15.49:0/4127823861 >> v2:172.21.15.115:3300/0 conn(0x7fcb541548c0 0x7fcb5406a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:30.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.801+0000 7fcb537fe700 1 -- 172.21.15.49:0/4127823861 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb540c6630 con 0x7fcb541544e0 2023-11-30T18:39:30.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.801+0000 7fcb537fe700 1 -- 172.21.15.49:0/4127823861 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fcb480015f0 con 0x7fcb541544e0 2023-11-30T18:39:30.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.801+0000 7fcb537fe700 1 -- 172.21.15.49:0/4127823861 >> v1:172.21.15.49:6789/0 conn(0x7fcb541544e0 legacy=0x7fcb540c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:30.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.801+0000 7fcb537fe700 1 --2- 172.21.15.49:0/4127823861 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb440038e0 0x7fcb44003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:30.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.801+0000 7fcb537fe700 1 --2- 172.21.15.49:0/4127823861 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb540c6e30 0x7fcb44004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:30.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.801+0000 7fcb537fe700 1 --2- 172.21.15.49:0/4127823861 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb44004b80 0x7fcb44005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:30.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.801+0000 7fcb537fe700 1 -- 172.21.15.49:0/4127823861 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb540c13a0 con 0x7fcb44004b80 2023-11-30T18:39:30.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.801+0000 7fcb537fe700 1 -- 172.21.15.49:0/4127823861 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb540c1680 con 0x7fcb440038e0 2023-11-30T18:39:30.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.801+0000 7fcb537fe700 1 -- 172.21.15.49:0/4127823861 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4400b8e0 con 0x7fcb540c6e30 2023-11-30T18:39:30.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.801+0000 7fcb59228700 1 --2- 172.21.15.49:0/4127823861 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb44004b80 0x7fcb44005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:30.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.801+0000 7fcb58a27700 1 --2- 172.21.15.49:0/4127823861 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb440038e0 0x7fcb44003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:30.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.801+0000 7fcb53fff700 1 --2- 172.21.15.49:0/4127823861 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb540c6e30 0x7fcb44004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:30.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.801+0000 7fcb59228700 1 -- 172.21.15.49:0/4127823861 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb540c6e30 msgr2=0x7fcb44004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:30.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.801+0000 7fcb59228700 1 --2- 172.21.15.49:0/4127823861 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb540c6e30 0x7fcb44004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:30.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.801+0000 7fcb59228700 1 -- 172.21.15.49:0/4127823861 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb440038e0 msgr2=0x7fcb44003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:30.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.801+0000 7fcb59228700 1 --2- 172.21.15.49:0/4127823861 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb440038e0 0x7fcb44003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:30.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.801+0000 7fcb59228700 1 -- 172.21.15.49:0/4127823861 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb440033f0 con 0x7fcb44004b80 2023-11-30T18:39:30.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.801+0000 7fcb59228700 1 --2- 172.21.15.49:0/4127823861 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb44004b80 0x7fcb44005000 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7fcb4c00e210 tx=0x7fcb4c00b040).ready entity=mon.0 client_cookie=91a636c92817120b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:30.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.802+0000 7fcb537fe700 1 -- 172.21.15.49:0/4127823861 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c009ac0 con 0x7fcb44004b80 2023-11-30T18:39:30.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.802+0000 7fcb537fe700 1 -- 172.21.15.49:0/4127823861 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4c00f040 con 0x7fcb44004b80 2023-11-30T18:39:30.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.802+0000 7fcb537fe700 1 -- 172.21.15.49:0/4127823861 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c00ecd0 con 0x7fcb44004b80 2023-11-30T18:39:30.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.802+0000 7fcb5ac8b700 1 -- 172.21.15.49:0/4127823861 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb44004b80 msgr2=0x7fcb44005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:30.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.802+0000 7fcb5ac8b700 1 --2- 172.21.15.49:0/4127823861 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb44004b80 0x7fcb44005000 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7fcb4c00e210 tx=0x7fcb4c00b040).stop 2023-11-30T18:39:30.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.802+0000 7fcb59228700 1 -- 172.21.15.49:0/4127823861 reap_dead start 2023-11-30T18:39:30.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.802+0000 7fcb5ac8b700 1 -- 172.21.15.49:0/4127823861 shutdown_connections 2023-11-30T18:39:30.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.802+0000 7fcb5ac8b700 1 -- 172.21.15.49:0/4127823861 >> 172.21.15.49:0/4127823861 conn(0x7fcb54085020 msgr2=0x7fcb54094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:30.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.802+0000 7fcb5ac8b700 1 -- 172.21.15.49:0/4127823861 shutdown_connections 2023-11-30T18:39:30.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.802+0000 7fcb5ac8b700 1 -- 172.21.15.49:0/4127823861 wait complete. 2023-11-30T18:39:30.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.803+0000 7fcb5ac8b700 1 Processor -- start 2023-11-30T18:39:30.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.803+0000 7fcb5ac8b700 1 -- start start 2023-11-30T18:39:30.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.804+0000 7fcb5ac8b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb44004b80 0x7fcb54097af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:30.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.804+0000 7fcb5ac8b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb54097fe0 0x7fcb541646a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:30.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.804+0000 7fcb5ac8b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb54164b90 0x7fcb54152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:30.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.804+0000 7fcb5ac8b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb540990c0 con 0x7fcb54164b90 2023-11-30T18:39:30.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.804+0000 7fcb5ac8b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb540984b0 con 0x7fcb54097fe0 2023-11-30T18:39:30.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.804+0000 7fcb5ac8b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb54098790 con 0x7fcb44004b80 2023-11-30T18:39:30.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.804+0000 7fcb59228700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb54164b90 0x7fcb54152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:30.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.804+0000 7fcb59228700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb54164b90 0x7fcb54152ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58358/0 (socket says 172.21.15.49:58358) 2023-11-30T18:39:30.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.804+0000 7fcb59228700 1 -- 172.21.15.49:0/190190591 learned_addr learned my addr 172.21.15.49:0/190190591 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:30.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.804+0000 7fcb53fff700 1 --2- 172.21.15.49:0/190190591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb54097fe0 0x7fcb541646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:30.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.804+0000 7fcb58a27700 1 --2- 172.21.15.49:0/190190591 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb44004b80 0x7fcb54097af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:30.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.805+0000 7fcb59228700 1 -- 172.21.15.49:0/190190591 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb44004b80 msgr2=0x7fcb54097af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:30.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.805+0000 7fcb59228700 1 --2- 172.21.15.49:0/190190591 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb44004b80 0x7fcb54097af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:30.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.805+0000 7fcb59228700 1 -- 172.21.15.49:0/190190591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb54097fe0 msgr2=0x7fcb541646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:30.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.805+0000 7fcb59228700 1 --2- 172.21.15.49:0/190190591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb54097fe0 0x7fcb541646a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:30.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.805+0000 7fcb59228700 1 -- 172.21.15.49:0/190190591 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb54098a70 con 0x7fcb54164b90 2023-11-30T18:39:30.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.805+0000 7fcb59228700 1 --2- 172.21.15.49:0/190190591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb54164b90 0x7fcb54152ec0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 rx=0x7fcb44004490 tx=0x7fcb4c01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:30.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.805+0000 7fcb50ff9700 1 -- 172.21.15.49:0/190190591 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c021030 con 0x7fcb54164b90 2023-11-30T18:39:30.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.805+0000 7fcb50ff9700 1 -- 172.21.15.49:0/190190591 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4c009ac0 con 0x7fcb54164b90 2023-11-30T18:39:30.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.805+0000 7fcb5ac8b700 1 -- 172.21.15.49:0/190190591 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb54098d50 con 0x7fcb54164b90 2023-11-30T18:39:30.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.805+0000 7fcb50ff9700 1 -- 172.21.15.49:0/190190591 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c013e70 con 0x7fcb54164b90 2023-11-30T18:39:30.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.805+0000 7fcb5ac8b700 1 -- 172.21.15.49:0/190190591 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb541533b0 con 0x7fcb54164b90 2023-11-30T18:39:30.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.806+0000 7fcb5ac8b700 1 -- 172.21.15.49:0/190190591 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb54094940 con 0x7fcb54164b90 2023-11-30T18:39:30.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.806+0000 7fcb50ff9700 1 -- 172.21.15.49:0/190190591 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fcb4c024070 con 0x7fcb54164b90 2023-11-30T18:39:30.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.807+0000 7fcb50ff9700 1 --2- 172.21.15.49:0/190190591 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fcb3805f270 0x7fcb38061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:30.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.807+0000 7fcb50ff9700 1 -- 172.21.15.49:0/190190591 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6127+0+0 (secure 0 0 0) 0x7fcb4c022070 con 0x7fcb54164b90 2023-11-30T18:39:30.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.807+0000 7fcb58a27700 1 --2- 172.21.15.49:0/190190591 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fcb3805f270 0x7fcb38061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:30.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.807+0000 7fcb58a27700 1 --2- 172.21.15.49:0/190190591 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fcb3805f270 0x7fcb38061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fcb48001820 tx=0x7fcb48009040).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:30.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:30.811+0000 7fcb50ff9700 1 -- 172.21.15.49:0/190190591 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcb54094940 con 0x7fcb54164b90 2023-11-30T18:39:31.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.052+0000 7fcb5ac8b700 1 -- 172.21.15.49:0/190190591 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7fcb54094940 con 0x7fcb54164b90 2023-11-30T18:39:31.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.658+0000 7fcb50ff9700 1 -- 172.21.15.49:0/190190591 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v2950) v1 ==== 166+0+0 (secure 0 0 0) 0x7fcb54094940 con 0x7fcb54164b90 2023-11-30T18:39:31.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.660+0000 7fcb5ac8b700 1 -- 172.21.15.49:0/190190591 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fcb3805f270 msgr2=0x7fcb38061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:31.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.660+0000 7fcb5ac8b700 1 --2- 172.21.15.49:0/190190591 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fcb3805f270 0x7fcb38061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fcb48001820 tx=0x7fcb48009040).stop 2023-11-30T18:39:31.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.660+0000 7fcb5ac8b700 1 -- 172.21.15.49:0/190190591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb54164b90 msgr2=0x7fcb54152ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:31.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.660+0000 7fcb5ac8b700 1 --2- 172.21.15.49:0/190190591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb54164b90 0x7fcb54152ec0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 rx=0x7fcb44004490 tx=0x7fcb4c01a000).stop 2023-11-30T18:39:31.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.660+0000 7fcb5ac8b700 1 -- 172.21.15.49:0/190190591 shutdown_connections 2023-11-30T18:39:31.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.660+0000 7fcb5ac8b700 1 --2- 172.21.15.49:0/190190591 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fcb3805f270 0x7fcb38061730 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:31.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.660+0000 7fcb5ac8b700 1 --2- 172.21.15.49:0/190190591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb54164b90 0x7fcb54152ec0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:31.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.660+0000 7fcb5ac8b700 1 --2- 172.21.15.49:0/190190591 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb44004b80 0x7fcb54097af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:31.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.660+0000 7fcb5ac8b700 1 --2- 172.21.15.49:0/190190591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb54097fe0 0x7fcb541646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:31.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.660+0000 7fcb5ac8b700 1 -- 172.21.15.49:0/190190591 >> 172.21.15.49:0/190190591 conn(0x7fcb54085020 msgr2=0x7fcb540ae240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:31.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.660+0000 7fcb5ac8b700 1 -- 172.21.15.49:0/190190591 shutdown_connections 2023-11-30T18:39:31.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.660+0000 7fcb5ac8b700 1 -- 172.21.15.49:0/190190591 wait complete. 2023-11-30T18:39:31.674 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-30T18:39:31.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.797+0000 7f0a7039c700 1 Processor -- start 2023-11-30T18:39:31.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.797+0000 7f0a7039c700 1 -- start start 2023-11-30T18:39:31.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.798+0000 7f0a7039c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a68098d10 0x7f0a680c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:31.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.798+0000 7f0a7039c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0a68158320 0x7f0a681587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:31.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.798+0000 7f0a7039c700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a68158cc0 con 0x7f0a680c6190 2023-11-30T18:39:31.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.798+0000 7f0a7039c700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a680c72d0 con 0x7f0a68158320 2023-11-30T18:39:31.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.798+0000 7f0a7039c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a68064570 con 0x7f0a68098d10 2023-11-30T18:39:31.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.798+0000 7f0a6d937700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0a680c6190 0x7f0a68063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:54176/0 (socket says 172.21.15.49:54176) 2023-11-30T18:39:31.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.798+0000 7f0a6d937700 1 -- 172.21.15.49:0/2310792461 learned_addr learned my addr 172.21.15.49:0/2310792461 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:31.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.798+0000 7f0a6e939700 1 --2- 172.21.15.49:0/2310792461 >> v2:172.21.15.115:3300/0 conn(0x7f0a68158320 0x7f0a681587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:31.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.798+0000 7f0a6e138700 1 --2- 172.21.15.49:0/2310792461 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a68098d10 0x7f0a680c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:31.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.798+0000 7f0a6d136700 1 -- 172.21.15.49:0/2310792461 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611427734 0 0) 0x7f0a58001110 con 0x7f0a680c6190 2023-11-30T18:39:31.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.799+0000 7f0a6d136700 1 -- 172.21.15.49:0/2310792461 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a540033f0 con 0x7f0a680c6190 2023-11-30T18:39:31.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.799+0000 7f0a6d136700 1 -- 172.21.15.49:0/2310792461 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2719442970 0 0) 0x7f0a540033f0 con 0x7f0a680c6190 2023-11-30T18:39:31.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.799+0000 7f0a6d136700 1 -- 172.21.15.49:0/2310792461 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a68098d10 msgr2=0x7f0a680c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:31.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.799+0000 7f0a6d136700 1 --2- 172.21.15.49:0/2310792461 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a68098d10 0x7f0a680c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:31.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.799+0000 7f0a6d136700 1 -- 172.21.15.49:0/2310792461 >> v2:172.21.15.115:3300/0 conn(0x7f0a68158320 msgr2=0x7f0a681587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:31.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.799+0000 7f0a6d136700 1 --2- 172.21.15.49:0/2310792461 >> v2:172.21.15.115:3300/0 conn(0x7f0a68158320 0x7f0a681587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:31.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.799+0000 7f0a6d136700 1 -- 172.21.15.49:0/2310792461 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a68154bc0 con 0x7f0a680c6190 2023-11-30T18:39:31.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.799+0000 7f0a6d136700 1 -- 172.21.15.49:0/2310792461 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f0a58001600 con 0x7f0a680c6190 2023-11-30T18:39:31.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.799+0000 7f0a6d136700 1 -- 172.21.15.49:0/2310792461 >> v1:172.21.15.49:6789/0 conn(0x7f0a680c6190 legacy=0x7f0a68063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:31.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.799+0000 7f0a6d136700 1 --2- 172.21.15.49:0/2310792461 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a68098d10 0x7f0a540038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:31.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.799+0000 7f0a6d136700 1 --2- 172.21.15.49:0/2310792461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a54003e10 0x7f0a54004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:31.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.799+0000 7f0a6d136700 1 --2- 172.21.15.49:0/2310792461 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a54004b80 0x7f0a54005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:31.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.799+0000 7f0a6d136700 1 -- 172.21.15.49:0/2310792461 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a680c72d0 con 0x7f0a54003e10 2023-11-30T18:39:31.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.799+0000 7f0a6d136700 1 -- 172.21.15.49:0/2310792461 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a68064570 con 0x7f0a54004b80 2023-11-30T18:39:31.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.799+0000 7f0a6d136700 1 -- 172.21.15.49:0/2310792461 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5400b8e0 con 0x7f0a68098d10 2023-11-30T18:39:31.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.799+0000 7f0a6d937700 1 --2- 172.21.15.49:0/2310792461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a54003e10 0x7f0a54004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:31.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.799+0000 7f0a6e138700 1 --2- 172.21.15.49:0/2310792461 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a68098d10 0x7f0a540038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:31.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.799+0000 7f0a6e939700 1 --2- 172.21.15.49:0/2310792461 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a54004b80 0x7f0a54005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:31.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.799+0000 7f0a6d937700 1 -- 172.21.15.49:0/2310792461 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a68098d10 msgr2=0x7f0a540038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:31.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.799+0000 7f0a6d937700 1 --2- 172.21.15.49:0/2310792461 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a68098d10 0x7f0a540038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:31.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.799+0000 7f0a6d937700 1 -- 172.21.15.49:0/2310792461 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a54004b80 msgr2=0x7f0a54005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:31.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.799+0000 7f0a6d937700 1 --2- 172.21.15.49:0/2310792461 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a54004b80 0x7f0a54005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:31.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.799+0000 7f0a6d937700 1 -- 172.21.15.49:0/2310792461 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a540033f0 con 0x7f0a54003e10 2023-11-30T18:39:31.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.799+0000 7f0a6d937700 1 --2- 172.21.15.49:0/2310792461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a54003e10 0x7f0a54004690 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 rx=0x7f0a5800c3c0 tx=0x7f0a680a8040).ready entity=mon.0 client_cookie=ecee6591fae6d75f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:31.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.800+0000 7f0a6d136700 1 -- 172.21.15.49:0/2310792461 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a58007be0 con 0x7f0a54003e10 2023-11-30T18:39:31.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.800+0000 7f0a6d136700 1 -- 172.21.15.49:0/2310792461 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5800cc50 con 0x7f0a54003e10 2023-11-30T18:39:31.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.800+0000 7f0a6d136700 1 -- 172.21.15.49:0/2310792461 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a580070d0 con 0x7f0a54003e10 2023-11-30T18:39:31.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.800+0000 7f0a7039c700 1 -- 172.21.15.49:0/2310792461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a54003e10 msgr2=0x7f0a54004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:31.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.800+0000 7f0a7039c700 1 --2- 172.21.15.49:0/2310792461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a54003e10 0x7f0a54004690 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 rx=0x7f0a5800c3c0 tx=0x7f0a680a8040).stop 2023-11-30T18:39:31.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.800+0000 7f0a6e939700 1 -- 172.21.15.49:0/2310792461 reap_dead start 2023-11-30T18:39:31.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.800+0000 7f0a7039c700 1 -- 172.21.15.49:0/2310792461 shutdown_connections 2023-11-30T18:39:31.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.800+0000 7f0a7039c700 1 -- 172.21.15.49:0/2310792461 >> 172.21.15.49:0/2310792461 conn(0x7f0a680cb310 msgr2=0x7f0a680cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:31.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.800+0000 7f0a7039c700 1 -- 172.21.15.49:0/2310792461 shutdown_connections 2023-11-30T18:39:31.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.800+0000 7f0a7039c700 1 -- 172.21.15.49:0/2310792461 wait complete. 2023-11-30T18:39:31.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.801+0000 7f0a7039c700 1 Processor -- start 2023-11-30T18:39:31.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.801+0000 7f0a7039c700 1 -- start start 2023-11-30T18:39:31.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.802+0000 7f0a7039c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a54003e10 0x7f0a680c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:31.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.802+0000 7f0a7039c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a680ad700 0x7f0a680aad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:31.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.802+0000 7f0a7039c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a680b09d0 0x7f0a68153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:31.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.802+0000 7f0a7039c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a681478e0 con 0x7f0a680ad700 2023-11-30T18:39:31.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.802+0000 7f0a7039c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a680b0e50 con 0x7f0a680b09d0 2023-11-30T18:39:31.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.802+0000 7f0a7039c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a680a9140 con 0x7f0a54003e10 2023-11-30T18:39:31.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.802+0000 7f0a6d937700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a680ad700 0x7f0a680aad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:31.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.802+0000 7f0a6d937700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a680ad700 0x7f0a680aad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58374/0 (socket says 172.21.15.49:58374) 2023-11-30T18:39:31.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.802+0000 7f0a6d937700 1 -- 172.21.15.49:0/3239582396 learned_addr learned my addr 172.21.15.49:0/3239582396 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:31.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.802+0000 7f0a6e939700 1 --2- 172.21.15.49:0/3239582396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a680b09d0 0x7f0a68153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:31.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.802+0000 7f0a6e138700 1 --2- 172.21.15.49:0/3239582396 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a54003e10 0x7f0a680c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:31.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.803+0000 7f0a6d937700 1 -- 172.21.15.49:0/3239582396 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a54003e10 msgr2=0x7f0a680c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:31.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.803+0000 7f0a6d937700 1 --2- 172.21.15.49:0/3239582396 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a54003e10 0x7f0a680c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:31.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.803+0000 7f0a6d937700 1 -- 172.21.15.49:0/3239582396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a680b09d0 msgr2=0x7f0a68153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:31.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.803+0000 7f0a6d937700 1 --2- 172.21.15.49:0/3239582396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a680b09d0 0x7f0a68153ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:31.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.803+0000 7f0a6d937700 1 -- 172.21.15.49:0/3239582396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a680a9420 con 0x7f0a680ad700 2023-11-30T18:39:31.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.803+0000 7f0a6d937700 1 --2- 172.21.15.49:0/3239582396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a680ad700 0x7f0a680aad70 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 rx=0x7f0a5800c9b0 tx=0x7f0a58015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:31.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.803+0000 7f0a5e7fc700 1 -- 172.21.15.49:0/3239582396 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a58001920 con 0x7f0a680ad700 2023-11-30T18:39:31.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.803+0000 7f0a5e7fc700 1 -- 172.21.15.49:0/3239582396 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a580046b0 con 0x7f0a680ad700 2023-11-30T18:39:31.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.803+0000 7f0a7039c700 1 -- 172.21.15.49:0/3239582396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a680a9700 con 0x7f0a680ad700 2023-11-30T18:39:31.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.803+0000 7f0a5e7fc700 1 -- 172.21.15.49:0/3239582396 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a58004a50 con 0x7f0a680ad700 2023-11-30T18:39:31.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.803+0000 7f0a7039c700 1 -- 172.21.15.49:0/3239582396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a680c8600 con 0x7f0a680ad700 2023-11-30T18:39:31.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.804+0000 7f0a7039c700 1 -- 172.21.15.49:0/3239582396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a680a9d50 con 0x7f0a680ad700 2023-11-30T18:39:31.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.804+0000 7f0a5e7fc700 1 -- 172.21.15.49:0/3239582396 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0a58013450 con 0x7f0a680ad700 2023-11-30T18:39:31.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.805+0000 7f0a5e7fc700 1 --2- 172.21.15.49:0/3239582396 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0a4c05f270 0x7f0a4c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:31.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.805+0000 7f0a5e7fc700 1 -- 172.21.15.49:0/3239582396 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6127+0+0 (secure 0 0 0) 0x7f0a5807af00 con 0x7f0a680ad700 2023-11-30T18:39:31.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.805+0000 7f0a6e138700 1 --2- 172.21.15.49:0/3239582396 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0a4c05f270 0x7f0a4c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:31.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.805+0000 7f0a6e138700 1 --2- 172.21.15.49:0/3239582396 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0a4c05f270 0x7f0a4c061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f0a680aa230 tx=0x7f0a64009060).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:31.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.809+0000 7f0a5e7fc700 1 -- 172.21.15.49:0/3239582396 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0a5804bff0 con 0x7f0a680ad700 2023-11-30T18:39:31.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.981+0000 7f0a7039c700 1 -- 172.21.15.49:0/3239582396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0a681478c0 con 0x7f0a680ad700 2023-11-30T18:39:31.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.985+0000 7f0a5e7fc700 1 -- 172.21.15.49:0/3239582396 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v38)=0 v38) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0a5804f610 con 0x7f0a680ad700 2023-11-30T18:39:31.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.987+0000 7f0a7039c700 1 -- 172.21.15.49:0/3239582396 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0a4c05f270 msgr2=0x7f0a4c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:31.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.987+0000 7f0a7039c700 1 --2- 172.21.15.49:0/3239582396 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0a4c05f270 0x7f0a4c061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f0a680aa230 tx=0x7f0a64009060).stop 2023-11-30T18:39:31.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.987+0000 7f0a7039c700 1 -- 172.21.15.49:0/3239582396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a680ad700 msgr2=0x7f0a680aad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:31.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.987+0000 7f0a7039c700 1 --2- 172.21.15.49:0/3239582396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a680ad700 0x7f0a680aad70 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 rx=0x7f0a5800c9b0 tx=0x7f0a58015000).stop 2023-11-30T18:39:31.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.987+0000 7f0a7039c700 1 -- 172.21.15.49:0/3239582396 shutdown_connections 2023-11-30T18:39:31.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.987+0000 7f0a7039c700 1 --2- 172.21.15.49:0/3239582396 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0a4c05f270 0x7f0a4c061730 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:31.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.987+0000 7f0a7039c700 1 --2- 172.21.15.49:0/3239582396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a680b09d0 0x7f0a68153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:31.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.987+0000 7f0a7039c700 1 --2- 172.21.15.49:0/3239582396 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a54003e10 0x7f0a680c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:31.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.987+0000 7f0a7039c700 1 --2- 172.21.15.49:0/3239582396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a680ad700 0x7f0a680aad70 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:31.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.987+0000 7f0a7039c700 1 -- 172.21.15.49:0/3239582396 >> 172.21.15.49:0/3239582396 conn(0x7f0a680cb310 msgr2=0x7f0a680cab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:31.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.987+0000 7f0a7039c700 1 -- 172.21.15.49:0/3239582396 shutdown_connections 2023-11-30T18:39:31.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:31.987+0000 7f0a7039c700 1 -- 172.21.15.49:0/3239582396 wait complete. 2023-11-30T18:39:32.000 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-30T18:39:32.000 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T18:39:32.040 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T18:39:32.090 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-30T18:39:32.090 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-30T18:39:32.091 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:39:32.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.207+0000 7fa8db312700 1 Processor -- start 2023-11-30T18:39:32.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.208+0000 7fa8db312700 1 -- start start 2023-11-30T18:39:32.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.208+0000 7fa8db312700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8d41544e0 0x7fa8d41548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:32.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.208+0000 7fa8db312700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa8d406a610 0x7fa8d40c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:32.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.208+0000 7fa8db312700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d40c69a0 con 0x7fa8d40c6e30 2023-11-30T18:39:32.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.208+0000 7fa8db312700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d40c13a0 con 0x7fa8d406a610 2023-11-30T18:39:32.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.208+0000 7fa8db312700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d40c1680 con 0x7fa8d41544e0 2023-11-30T18:39:32.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.209+0000 7fa8d98af700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa8d40c6e30 0x7fa8d40a8000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:54178/0 (socket says 172.21.15.49:54178) 2023-11-30T18:39:32.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.209+0000 7fa8d98af700 1 -- 172.21.15.49:0/1073581772 learned_addr learned my addr 172.21.15.49:0/1073581772 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:32.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.209+0000 7fa8d90ae700 1 --2- 172.21.15.49:0/1073581772 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8d41544e0 0x7fa8d41548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:32.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.209+0000 7fa8d88ad700 1 --2- 172.21.15.49:0/1073581772 >> v2:172.21.15.115:3300/0 conn(0x7fa8d406a610 0x7fa8d40c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:32.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.209+0000 7fa8d3fff700 1 -- 172.21.15.49:0/1073581772 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828726820 0 0) 0x7fa8d40c69a0 con 0x7fa8d40c6e30 2023-11-30T18:39:32.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.209+0000 7fa8d3fff700 1 -- 172.21.15.49:0/1073581772 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8bc0033f0 con 0x7fa8d40c6e30 2023-11-30T18:39:32.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.209+0000 7fa8d90ae700 1 -- 172.21.15.49:0/1073581772 >> v2:172.21.15.115:3300/0 conn(0x7fa8d406a610 msgr2=0x7fa8d40c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:32.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.209+0000 7fa8d90ae700 1 --2- 172.21.15.49:0/1073581772 >> v2:172.21.15.115:3300/0 conn(0x7fa8d406a610 0x7fa8d40c0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:32.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.209+0000 7fa8d90ae700 1 -- 172.21.15.49:0/1073581772 >> v1:172.21.15.49:6789/0 conn(0x7fa8d40c6e30 legacy=0x7fa8d40a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:32.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.209+0000 7fa8d90ae700 1 -- 172.21.15.49:0/1073581772 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d40c6630 con 0x7fa8d41544e0 2023-11-30T18:39:32.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.209+0000 7fa8d88ad700 1 --2- 172.21.15.49:0/1073581772 >> v2:172.21.15.115:3300/0 conn(0x7fa8d406a610 0x7fa8d40c0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:39:32.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.209+0000 7fa8d90ae700 1 --2- 172.21.15.49:0/1073581772 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8d41544e0 0x7fa8d41548c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fa8cc006fd0 tx=0x7fa8cc006f40).ready entity=mon.2 client_cookie=3892c0cdf315e2e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:32.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.209+0000 7fa8d3fff700 1 -- 172.21.15.49:0/1073581772 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc005880 con 0x7fa8d41544e0 2023-11-30T18:39:32.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.209+0000 7fa8d3fff700 1 -- 172.21.15.49:0/1073581772 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8cc0059e0 con 0x7fa8d41544e0 2023-11-30T18:39:32.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.209+0000 7fa8d3fff700 1 -- 172.21.15.49:0/1073581772 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc005d60 con 0x7fa8d41544e0 2023-11-30T18:39:32.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.210+0000 7fa8db312700 1 -- 172.21.15.49:0/1073581772 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8d41544e0 msgr2=0x7fa8d41548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:32.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.210+0000 7fa8db312700 1 --2- 172.21.15.49:0/1073581772 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8d41544e0 0x7fa8d41548c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fa8cc006fd0 tx=0x7fa8cc006f40).stop 2023-11-30T18:39:32.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.210+0000 7fa8db312700 1 -- 172.21.15.49:0/1073581772 shutdown_connections 2023-11-30T18:39:32.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.210+0000 7fa8db312700 1 --2- 172.21.15.49:0/1073581772 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8d41544e0 0x7fa8d41548c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:32.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.210+0000 7fa8db312700 1 --2- 172.21.15.49:0/1073581772 >> v2:172.21.15.115:3300/0 conn(0x7fa8d406a610 0x7fa8d40c0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:32.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.210+0000 7fa8db312700 1 -- 172.21.15.49:0/1073581772 >> 172.21.15.49:0/1073581772 conn(0x7fa8d4085020 msgr2=0x7fa8d4094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:32.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.210+0000 7fa8db312700 1 -- 172.21.15.49:0/1073581772 shutdown_connections 2023-11-30T18:39:32.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.210+0000 7fa8db312700 1 -- 172.21.15.49:0/1073581772 wait complete. 2023-11-30T18:39:32.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.211+0000 7fa8db312700 1 Processor -- start 2023-11-30T18:39:32.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.211+0000 7fa8db312700 1 -- start start 2023-11-30T18:39:32.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.212+0000 7fa8db312700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8d406a610 0x7fa8d413f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:32.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.212+0000 7fa8db312700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8d40c6e30 0x7fa8d4097ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:32.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.212+0000 7fa8db312700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8d41544e0 0x7fa8d4097fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:32.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.212+0000 7fa8db312700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d4099170 con 0x7fa8d41544e0 2023-11-30T18:39:32.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.212+0000 7fa8db312700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d4153670 con 0x7fa8d406a610 2023-11-30T18:39:32.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.212+0000 7fa8db312700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d413fd40 con 0x7fa8d40c6e30 2023-11-30T18:39:32.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.212+0000 7fa8d98af700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8d41544e0 0x7fa8d4097fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:32.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.212+0000 7fa8d98af700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8d41544e0 0x7fa8d4097fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58388/0 (socket says 172.21.15.49:58388) 2023-11-30T18:39:32.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.212+0000 7fa8d98af700 1 -- 172.21.15.49:0/956784383 learned_addr learned my addr 172.21.15.49:0/956784383 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:32.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.212+0000 7fa8d90ae700 1 --2- 172.21.15.49:0/956784383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8d406a610 0x7fa8d413f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:32.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.212+0000 7fa8d88ad700 1 --2- 172.21.15.49:0/956784383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8d40c6e30 0x7fa8d4097ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:32.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.213+0000 7fa8d98af700 1 -- 172.21.15.49:0/956784383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8d40c6e30 msgr2=0x7fa8d4097ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:32.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.213+0000 7fa8d98af700 1 --2- 172.21.15.49:0/956784383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8d40c6e30 0x7fa8d4097ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:32.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.213+0000 7fa8d98af700 1 -- 172.21.15.49:0/956784383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8d406a610 msgr2=0x7fa8d413f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:32.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.213+0000 7fa8d98af700 1 --2- 172.21.15.49:0/956784383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8d406a610 0x7fa8d413f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:32.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.213+0000 7fa8d98af700 1 -- 172.21.15.49:0/956784383 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c80092a0 con 0x7fa8d41544e0 2023-11-30T18:39:32.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.213+0000 7fa8d98af700 1 --2- 172.21.15.49:0/956784383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8d41544e0 0x7fa8d4097fb0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 rx=0x7fa8c4005ad0 tx=0x7fa8c40015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:32.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.213+0000 7fa8d17fa700 1 -- 172.21.15.49:0/956784383 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4005d30 con 0x7fa8d41544e0 2023-11-30T18:39:32.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.213+0000 7fa8d17fa700 1 -- 172.21.15.49:0/956784383 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c4005e90 con 0x7fa8d41544e0 2023-11-30T18:39:32.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.213+0000 7fa8db312700 1 -- 172.21.15.49:0/956784383 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8cc009250 con 0x7fa8d41544e0 2023-11-30T18:39:32.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.213+0000 7fa8d17fa700 1 -- 172.21.15.49:0/956784383 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c40072e0 con 0x7fa8d41544e0 2023-11-30T18:39:32.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.213+0000 7fa8db312700 1 -- 172.21.15.49:0/956784383 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d4098840 con 0x7fa8d41544e0 2023-11-30T18:39:32.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.214+0000 7fa8db312700 1 -- 172.21.15.49:0/956784383 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d4095910 con 0x7fa8d41544e0 2023-11-30T18:39:32.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.214+0000 7fa8d17fa700 1 -- 172.21.15.49:0/956784383 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa8c40076d0 con 0x7fa8d41544e0 2023-11-30T18:39:32.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.215+0000 7fa8d17fa700 1 --2- 172.21.15.49:0/956784383 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa8c005f270 0x7fa8c0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:32.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.215+0000 7fa8d17fa700 1 -- 172.21.15.49:0/956784383 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6127+0+0 (secure 0 0 0) 0x7fa8c4079c40 con 0x7fa8d41544e0 2023-11-30T18:39:32.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.215+0000 7fa8d90ae700 1 --2- 172.21.15.49:0/956784383 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa8c005f270 0x7fa8c0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:32.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.215+0000 7fa8d90ae700 1 --2- 172.21.15.49:0/956784383 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa8c005f270 0x7fa8c0061730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fa8cc006f80 tx=0x7fa8cc015000).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:32.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.219+0000 7fa8d17fa700 1 -- 172.21.15.49:0/956784383 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa8d4095910 con 0x7fa8d41544e0 2023-11-30T18:39:32.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.437+0000 7fa8db312700 1 -- 172.21.15.49:0/956784383 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8d4095910 con 0x7fa8d41544e0 2023-11-30T18:39:32.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.437+0000 7fa8d17fa700 1 -- 172.21.15.49:0/956784383 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fa8c4018de0 con 0x7fa8d41544e0 2023-11-30T18:39:32.438 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:39:32.439 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":79,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1849144206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1849144206},{"type":"v1","addr":"172.21.15.115:6837","nonce":1849144206}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":8686,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/3927708641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3927708641},{"type":"v1","addr":"172.21.15.115:6836","nonce":3927708641}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":8934,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3388701250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3388701250},{"type":"v1","addr":"172.21.15.49:6835","nonce":3388701250}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":9432,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/2467705790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2467705790},{"type":"v1","addr":"172.21.15.49:6834","nonce":2467705790}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[]} 2023-11-30T18:39:32.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.439+0000 7fa8db312700 1 -- 172.21.15.49:0/956784383 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa8c005f270 msgr2=0x7fa8c0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:32.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.439+0000 7fa8db312700 1 --2- 172.21.15.49:0/956784383 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa8c005f270 0x7fa8c0061730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fa8cc006f80 tx=0x7fa8cc015000).stop 2023-11-30T18:39:32.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.439+0000 7fa8db312700 1 -- 172.21.15.49:0/956784383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8d41544e0 msgr2=0x7fa8d4097fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:32.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.439+0000 7fa8db312700 1 --2- 172.21.15.49:0/956784383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8d41544e0 0x7fa8d4097fb0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 rx=0x7fa8c4005ad0 tx=0x7fa8c40015b0).stop 2023-11-30T18:39:32.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.439+0000 7fa8db312700 1 -- 172.21.15.49:0/956784383 shutdown_connections 2023-11-30T18:39:32.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.439+0000 7fa8db312700 1 --2- 172.21.15.49:0/956784383 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa8c005f270 0x7fa8c0061730 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:32.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.439+0000 7fa8db312700 1 --2- 172.21.15.49:0/956784383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8d41544e0 0x7fa8d4097fb0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:32.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.439+0000 7fa8db312700 1 --2- 172.21.15.49:0/956784383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8d406a610 0x7fa8d413f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:32.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.439+0000 7fa8db312700 1 --2- 172.21.15.49:0/956784383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8d40c6e30 0x7fa8d4097ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:32.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.439+0000 7fa8db312700 1 -- 172.21.15.49:0/956784383 >> 172.21.15.49:0/956784383 conn(0x7fa8d4085020 msgr2=0x7fa8d40ae240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:32.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.440+0000 7fa8db312700 1 -- 172.21.15.49:0/956784383 shutdown_connections 2023-11-30T18:39:32.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.440+0000 7fa8db312700 1 -- 172.21.15.49:0/956784383 wait complete. 2023-11-30T18:39:32.441 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 79 2023-11-30T18:39:32.453 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-30T18:39:32.453 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-30T18:39:32.453 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-30T18:39:32.453 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:39:32.453 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-30T18:39:32.453 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-30T18:39:32.454 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-30T18:39:32.454 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:39:32.454 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-30T18:39:32.454 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-30T18:39:32.454 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-30T18:39:32.454 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:39:32.454 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-30T18:39:32.455 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-30T18:39:32.455 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-30T18:39:32.455 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:39:32.462 INFO:tasks.ceph.mds.a:Stopped 2023-11-30T18:39:32.462 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-30T18:39:32.463 INFO:tasks.ceph.mds.c:Stopped 2023-11-30T18:39:32.463 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-30T18:39:32.467 INFO:tasks.ceph.mds.d:Stopped 2023-11-30T18:39:32.467 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-30T18:39:32.467 INFO:tasks.ceph.mds.b:Stopped 2023-11-30T18:39:32.468 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-30T18:39:32.504 INFO:tasks.ceph.mds.a:Started 2023-11-30T18:39:32.504 DEBUG:teuthology.parallel:result is None 2023-11-30T18:39:32.505 INFO:tasks.ceph.mds.c:Started 2023-11-30T18:39:32.505 DEBUG:teuthology.parallel:result is None 2023-11-30T18:39:32.510 INFO:tasks.ceph.mds.d:Started 2023-11-30T18:39:32.511 INFO:tasks.ceph.mds.b:Started 2023-11-30T18:39:32.511 DEBUG:teuthology.parallel:result is None 2023-11-30T18:39:32.511 DEBUG:teuthology.parallel:result is None 2023-11-30T18:39:32.512 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-30T18:39:32.578 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-11-30T18:39:32.579 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-11-30T18:39:32.592 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-11-30T18:39:32.593 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-11-30T18:39:32.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.638+0000 7f5cac34f700 1 Processor -- start 2023-11-30T18:39:32.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.638+0000 7f5cac34f700 1 -- start start 2023-11-30T18:39:32.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.639+0000 7f5cac34f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5ca4098d10 0x7f5ca40c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:32.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.639+0000 7f5cac34f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ca4158320 0x7f5ca41587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:32.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.639+0000 7f5cac34f700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca4158cc0 con 0x7f5ca40c6190 2023-11-30T18:39:32.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.639+0000 7f5cac34f700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca40c72d0 con 0x7f5ca4098d10 2023-11-30T18:39:32.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.639+0000 7f5cac34f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca4064570 con 0x7f5ca4158320 2023-11-30T18:39:32.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.639+0000 7f5caa0eb700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5ca4098d10 0x7f5ca40c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:32.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.640+0000 7f5caa0eb700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5ca4098d10 0x7f5ca40c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58422/0 (socket says 172.21.15.49:58422) 2023-11-30T18:39:32.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.640+0000 7f5caa0eb700 1 -- 172.21.15.49:0/2304219162 learned_addr learned my addr 172.21.15.49:0/2304219162 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:32.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.640+0000 7f5caa8ec700 1 --2- 172.21.15.49:0/2304219162 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ca4158320 0x7f5ca41587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:32.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.640+0000 7f5caa0eb700 1 -- 172.21.15.49:0/2304219162 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ca4158320 msgr2=0x7f5ca41587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:32.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.640+0000 7f5caa0eb700 1 --2- 172.21.15.49:0/2304219162 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ca4158320 0x7f5ca41587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:32.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.640+0000 7f5caa0eb700 1 -- 172.21.15.49:0/2304219162 >> v1:172.21.15.115:6789/0 conn(0x7f5ca40c6190 legacy=0x7f5ca4063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:32.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.640+0000 7f5caa0eb700 1 -- 172.21.15.49:0/2304219162 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca4154bc0 con 0x7f5ca4098d10 2023-11-30T18:39:32.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.640+0000 7f5caa8ec700 1 --2- 172.21.15.49:0/2304219162 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ca4158320 0x7f5ca41587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:39:32.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.640+0000 7f5caa0eb700 1 --2- 172.21.15.49:0/2304219162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ca4098d10 0x7f5ca40c7760 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7f5c9c006fd0 tx=0x7f5c9c0090f0).ready entity=mon.0 client_cookie=5cbce93179f12288 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:32.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.640+0000 7f5ca90e9700 1 -- 172.21.15.49:0/2304219162 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c00b600 con 0x7f5ca4098d10 2023-11-30T18:39:32.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.640+0000 7f5ca90e9700 1 -- 172.21.15.49:0/2304219162 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9c00b760 con 0x7f5ca4098d10 2023-11-30T18:39:32.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.640+0000 7f5ca90e9700 1 -- 172.21.15.49:0/2304219162 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c00bae0 con 0x7f5ca4098d10 2023-11-30T18:39:32.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.641+0000 7f5cac34f700 1 -- 172.21.15.49:0/2304219162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ca4098d10 msgr2=0x7f5ca40c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:32.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.641+0000 7f5cac34f700 1 --2- 172.21.15.49:0/2304219162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ca4098d10 0x7f5ca40c7760 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7f5c9c006fd0 tx=0x7f5c9c0090f0).stop 2023-11-30T18:39:32.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.641+0000 7f5cac34f700 1 -- 172.21.15.49:0/2304219162 shutdown_connections 2023-11-30T18:39:32.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.641+0000 7f5cac34f700 1 --2- 172.21.15.49:0/2304219162 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ca4158320 0x7f5ca41587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:32.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.641+0000 7f5cac34f700 1 --2- 172.21.15.49:0/2304219162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ca4098d10 0x7f5ca40c7760 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:32.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.641+0000 7f5cac34f700 1 -- 172.21.15.49:0/2304219162 >> 172.21.15.49:0/2304219162 conn(0x7f5ca40cb310 msgr2=0x7f5ca40cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:32.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.641+0000 7f5cac34f700 1 -- 172.21.15.49:0/2304219162 shutdown_connections 2023-11-30T18:39:32.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.641+0000 7f5cac34f700 1 -- 172.21.15.49:0/2304219162 wait complete. 2023-11-30T18:39:32.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.642+0000 7f5cac34f700 1 Processor -- start 2023-11-30T18:39:32.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.642+0000 7f5cac34f700 1 -- start start 2023-11-30T18:39:32.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.643+0000 7f5cac34f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ca4098d10 0x7f5ca4155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:32.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.643+0000 7f5cac34f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ca40c6190 0x7f5ca41571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:32.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.643+0000 7f5cac34f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ca4158320 0x7f5ca40b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:32.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.643+0000 7f5cac34f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca40aeed0 con 0x7f5ca4098d10 2023-11-30T18:39:32.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.643+0000 7f5cac34f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca4157690 con 0x7f5ca40c6190 2023-11-30T18:39:32.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.643+0000 7f5cac34f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca4156c30 con 0x7f5ca4158320 2023-11-30T18:39:32.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.643+0000 7f5caa0eb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ca4098d10 0x7f5ca4155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:32.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.643+0000 7f5caa0eb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ca4098d10 0x7f5ca4155d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58430/0 (socket says 172.21.15.49:58430) 2023-11-30T18:39:32.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.643+0000 7f5caa0eb700 1 -- 172.21.15.49:0/1717490466 learned_addr learned my addr 172.21.15.49:0/1717490466 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:32.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.643+0000 7f5ca98ea700 1 --2- 172.21.15.49:0/1717490466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ca40c6190 0x7f5ca41571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:32.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.643+0000 7f5caa8ec700 1 --2- 172.21.15.49:0/1717490466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ca4158320 0x7f5ca40b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:32.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.643+0000 7f5caa0eb700 1 -- 172.21.15.49:0/1717490466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ca4158320 msgr2=0x7f5ca40b0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:32.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.643+0000 7f5caa0eb700 1 --2- 172.21.15.49:0/1717490466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ca4158320 0x7f5ca40b0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:32.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.643+0000 7f5caa0eb700 1 -- 172.21.15.49:0/1717490466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ca40c6190 msgr2=0x7f5ca41571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:32.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.643+0000 7f5caa0eb700 1 --2- 172.21.15.49:0/1717490466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ca40c6190 0x7f5ca41571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:32.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.643+0000 7f5caa0eb700 1 -- 172.21.15.49:0/1717490466 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9c009370 con 0x7f5ca4098d10 2023-11-30T18:39:32.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.643+0000 7f5caa0eb700 1 --2- 172.21.15.49:0/1717490466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ca4098d10 0x7f5ca4155d20 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 rx=0x7f5ca40c2360 tx=0x7f5c9c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:32.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.643+0000 7f5ca27fc700 1 -- 172.21.15.49:0/1717490466 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c00b8d0 con 0x7f5ca4098d10 2023-11-30T18:39:32.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.643+0000 7f5ca27fc700 1 -- 172.21.15.49:0/1717490466 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9c00ba30 con 0x7f5ca4098d10 2023-11-30T18:39:32.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.643+0000 7f5cac34f700 1 -- 172.21.15.49:0/1717490466 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca4156390 con 0x7f5ca4098d10 2023-11-30T18:39:32.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.643+0000 7f5ca27fc700 1 -- 172.21.15.49:0/1717490466 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c01c670 con 0x7f5ca4098d10 2023-11-30T18:39:32.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.643+0000 7f5cac34f700 1 -- 172.21.15.49:0/1717490466 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca4156950 con 0x7f5ca4098d10 2023-11-30T18:39:32.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.645+0000 7f5cac34f700 1 -- 172.21.15.49:0/1717490466 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca40aeca0 con 0x7f5ca4098d10 2023-11-30T18:39:32.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.645+0000 7f5ca27fc700 1 -- 172.21.15.49:0/1717490466 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f5c9c01c9e0 con 0x7f5ca4098d10 2023-11-30T18:39:32.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.645+0000 7f5ca27fc700 1 --2- 172.21.15.49:0/1717490466 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5c9005f270 0x7f5c90061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:32.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.645+0000 7f5ca27fc700 1 -- 172.21.15.49:0/1717490466 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6127+0+0 (secure 0 0 0) 0x7f5c9c07bfc0 con 0x7f5ca4098d10 2023-11-30T18:39:32.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.646+0000 7f5ca98ea700 1 --2- 172.21.15.49:0/1717490466 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5c9005f270 0x7f5c90061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:32.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.646+0000 7f5ca98ea700 1 --2- 172.21.15.49:0/1717490466 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5c9005f270 0x7f5c90061730 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f5ca40abf00 tx=0x7f5c98007d20).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:32.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.649+0000 7f5ca27fc700 1 -- 172.21.15.49:0/1717490466 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5ca40aeca0 con 0x7f5ca4098d10 2023-11-30T18:39:32.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:32.835+0000 7f5cac34f700 1 -- 172.21.15.49:0/1717490466 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5ca4158cc0 con 0x7f5ca4098d10 2023-11-30T18:39:33.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.663+0000 7f5ca27fc700 1 -- 172.21.15.49:0/1717490466 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v199) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5ca4158cc0 con 0x7f5ca4098d10 2023-11-30T18:39:33.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.666+0000 7f5cac34f700 1 -- 172.21.15.49:0/1717490466 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5c9005f270 msgr2=0x7f5c90061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:33.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.666+0000 7f5cac34f700 1 --2- 172.21.15.49:0/1717490466 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5c9005f270 0x7f5c90061730 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f5ca40abf00 tx=0x7f5c98007d20).stop 2023-11-30T18:39:33.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.666+0000 7f5cac34f700 1 -- 172.21.15.49:0/1717490466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ca4098d10 msgr2=0x7f5ca4155d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:33.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.666+0000 7f5cac34f700 1 --2- 172.21.15.49:0/1717490466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ca4098d10 0x7f5ca4155d20 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 rx=0x7f5ca40c2360 tx=0x7f5c9c017000).stop 2023-11-30T18:39:33.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.666+0000 7f5cac34f700 1 -- 172.21.15.49:0/1717490466 shutdown_connections 2023-11-30T18:39:33.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.666+0000 7f5cac34f700 1 --2- 172.21.15.49:0/1717490466 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5c9005f270 0x7f5c90061730 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:33.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.666+0000 7f5cac34f700 1 --2- 172.21.15.49:0/1717490466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5ca4158320 0x7f5ca40b0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:33.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.666+0000 7f5cac34f700 1 --2- 172.21.15.49:0/1717490466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ca4098d10 0x7f5ca4155d20 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:33.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.666+0000 7f5cac34f700 1 --2- 172.21.15.49:0/1717490466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ca40c6190 0x7f5ca41571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:33.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.666+0000 7f5cac34f700 1 -- 172.21.15.49:0/1717490466 >> 172.21.15.49:0/1717490466 conn(0x7f5ca40cb310 msgr2=0x7f5ca40aa590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:33.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.666+0000 7f5cac34f700 1 -- 172.21.15.49:0/1717490466 shutdown_connections 2023-11-30T18:39:33.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.666+0000 7f5cac34f700 1 -- 172.21.15.49:0/1717490466 wait complete. 2023-11-30T18:39:33.668 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2023-11-30T18:39:33.682 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-30T18:39:33.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.805+0000 7fed94b17700 1 Processor -- start 2023-11-30T18:39:33.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.805+0000 7fed94b17700 1 -- start start 2023-11-30T18:39:33.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.806+0000 7fed94b17700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed900caab0 0x7fed900aa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:33.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.806+0000 7fed94b17700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed900a9a90 con 0x7fed900ca180 2023-11-30T18:39:33.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.806+0000 7fed94b17700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed90154ce0 con 0x7fed900cae90 2023-11-30T18:39:33.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.806+0000 7fed94b17700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed900a8e80 con 0x7fed900caab0 2023-11-30T18:39:33.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.806+0000 7fed8ed9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fed900ca180 0x7fed9015e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:54206/0 (socket says 172.21.15.49:54206) 2023-11-30T18:39:33.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.806+0000 7fed8ed9d700 1 -- 172.21.15.49:0/2409840255 learned_addr learned my addr 172.21.15.49:0/2409840255 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:33.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.806+0000 7fed8e59c700 1 --2- 172.21.15.49:0/2409840255 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed900caab0 0x7fed900aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:33.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.806+0000 7fed8d59a700 1 -- 172.21.15.49:0/2409840255 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902191328 0 0) 0x7fed900a9a90 con 0x7fed900ca180 2023-11-30T18:39:33.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.806+0000 7fed8d59a700 1 -- 172.21.15.49:0/2409840255 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed780033f0 con 0x7fed900ca180 2023-11-30T18:39:33.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.806+0000 7fed8d59a700 1 -- 172.21.15.49:0/2409840255 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 93244197 0 0) 0x7fed90154ce0 con 0x7fed900cae90 2023-11-30T18:39:33.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.806+0000 7fed8d59a700 1 -- 172.21.15.49:0/2409840255 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed900a9a90 con 0x7fed900cae90 2023-11-30T18:39:33.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.806+0000 7fed8d59a700 1 -- 172.21.15.49:0/2409840255 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1049132833 0 0) 0x7fed780033f0 con 0x7fed900ca180 2023-11-30T18:39:33.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.806+0000 7fed8e59c700 1 -- 172.21.15.49:0/2409840255 >> v1:172.21.15.115:6789/0 conn(0x7fed900cae90 legacy=0x7fed900c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:33.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.806+0000 7fed8e59c700 1 -- 172.21.15.49:0/2409840255 >> v1:172.21.15.49:6789/0 conn(0x7fed900ca180 legacy=0x7fed9015e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:33.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.806+0000 7fed8e59c700 1 -- 172.21.15.49:0/2409840255 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed900a9160 con 0x7fed900caab0 2023-11-30T18:39:33.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.807+0000 7fed8e59c700 1 --2- 172.21.15.49:0/2409840255 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed900caab0 0x7fed900aa470 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fed80009760 tx=0x7fed80006f40).ready entity=mon.2 client_cookie=b8ab7c95a2558ffa server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:33.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.807+0000 7fed8d59a700 1 -- 172.21.15.49:0/2409840255 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed880017f0 con 0x7fed900caab0 2023-11-30T18:39:33.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.807+0000 7fed8d59a700 1 -- 172.21.15.49:0/2409840255 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed80005880 con 0x7fed900caab0 2023-11-30T18:39:33.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.807+0000 7fed8d59a700 1 -- 172.21.15.49:0/2409840255 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed80005c00 con 0x7fed900caab0 2023-11-30T18:39:33.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.807+0000 7fed94b17700 1 -- 172.21.15.49:0/2409840255 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed900caab0 msgr2=0x7fed900aa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:33.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.807+0000 7fed94b17700 1 --2- 172.21.15.49:0/2409840255 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed900caab0 0x7fed900aa470 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fed80009760 tx=0x7fed80006f40).stop 2023-11-30T18:39:33.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.807+0000 7fed94b17700 1 -- 172.21.15.49:0/2409840255 shutdown_connections 2023-11-30T18:39:33.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.807+0000 7fed94b17700 1 --2- 172.21.15.49:0/2409840255 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed900caab0 0x7fed900aa470 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:33.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.807+0000 7fed94b17700 1 -- 172.21.15.49:0/2409840255 >> 172.21.15.49:0/2409840255 conn(0x7fed90094920 msgr2=0x7fed9006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:33.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.807+0000 7fed94b17700 1 -- 172.21.15.49:0/2409840255 shutdown_connections 2023-11-30T18:39:33.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.807+0000 7fed94b17700 1 -- 172.21.15.49:0/2409840255 wait complete. 2023-11-30T18:39:33.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.808+0000 7fed94b17700 1 Processor -- start 2023-11-30T18:39:33.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.809+0000 7fed94b17700 1 -- start start 2023-11-30T18:39:33.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.809+0000 7fed94b17700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed900ca180 0x7fed90098660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:33.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.809+0000 7fed94b17700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed900caab0 0x7fed900ad240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:33.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.809+0000 7fed94b17700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed900cae90 0x7fed90165830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:33.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.809+0000 7fed94b17700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed900aaf40 con 0x7fed900caab0 2023-11-30T18:39:33.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.809+0000 7fed94b17700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed90098b50 con 0x7fed900cae90 2023-11-30T18:39:33.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.809+0000 7fed94b17700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed900ad730 con 0x7fed900ca180 2023-11-30T18:39:33.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.809+0000 7fed8dd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed900caab0 0x7fed900ad240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:33.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.809+0000 7fed8dd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed900caab0 0x7fed900ad240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58438/0 (socket says 172.21.15.49:58438) 2023-11-30T18:39:33.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.809+0000 7fed8dd9b700 1 -- 172.21.15.49:0/489950283 learned_addr learned my addr 172.21.15.49:0/489950283 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:33.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.809+0000 7fed8e59c700 1 --2- 172.21.15.49:0/489950283 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed900ca180 0x7fed90098660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:33.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.809+0000 7fed8ed9d700 1 --2- 172.21.15.49:0/489950283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed900cae90 0x7fed90165830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:33.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.810+0000 7fed8dd9b700 1 -- 172.21.15.49:0/489950283 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed900ca180 msgr2=0x7fed90098660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:33.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.810+0000 7fed8dd9b700 1 --2- 172.21.15.49:0/489950283 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed900ca180 0x7fed90098660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:33.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.810+0000 7fed8dd9b700 1 -- 172.21.15.49:0/489950283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed900cae90 msgr2=0x7fed90165830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:33.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.810+0000 7fed8dd9b700 1 --2- 172.21.15.49:0/489950283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed900cae90 0x7fed90165830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:33.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.810+0000 7fed8dd9b700 1 -- 172.21.15.49:0/489950283 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed80009250 con 0x7fed900caab0 2023-11-30T18:39:33.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.810+0000 7fed8dd9b700 1 --2- 172.21.15.49:0/489950283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed900caab0 0x7fed900ad240 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7fed8400c420 tx=0x7fed84007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:33.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.810+0000 7fed7e7fc700 1 -- 172.21.15.49:0/489950283 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed84012400 con 0x7fed900caab0 2023-11-30T18:39:33.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.810+0000 7fed7e7fc700 1 -- 172.21.15.49:0/489950283 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed84012560 con 0x7fed900caab0 2023-11-30T18:39:33.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.810+0000 7fed7e7fc700 1 -- 172.21.15.49:0/489950283 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed84012920 con 0x7fed900caab0 2023-11-30T18:39:33.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.810+0000 7fed94b17700 1 -- 172.21.15.49:0/489950283 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed900acdb0 con 0x7fed900caab0 2023-11-30T18:39:33.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.810+0000 7fed94b17700 1 -- 172.21.15.49:0/489950283 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed900ac480 con 0x7fed900caab0 2023-11-30T18:39:33.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.811+0000 7fed94b17700 1 -- 172.21.15.49:0/489950283 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed900acf40 con 0x7fed900caab0 2023-11-30T18:39:33.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.811+0000 7fed7e7fc700 1 -- 172.21.15.49:0/489950283 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fed8401b3b0 con 0x7fed900caab0 2023-11-30T18:39:33.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.812+0000 7fed7e7fc700 1 --2- 172.21.15.49:0/489950283 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fed7005f270 0x7fed70061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:33.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.812+0000 7fed7e7fc700 1 -- 172.21.15.49:0/489950283 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fed84079800 con 0x7fed900caab0 2023-11-30T18:39:33.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.812+0000 7fed8e59c700 1 --2- 172.21.15.49:0/489950283 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fed7005f270 0x7fed70061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:33.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.812+0000 7fed8e59c700 1 --2- 172.21.15.49:0/489950283 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fed7005f270 0x7fed70061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fed80006f80 tx=0x7fed80015000).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:33.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:33.816+0000 7fed7e7fc700 1 -- 172.21.15.49:0/489950283 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fed8404abf0 con 0x7fed900caab0 2023-11-30T18:39:34.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.056+0000 7fed94b17700 1 -- 172.21.15.49:0/489950283 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fed9006c860 con 0x7fed900caab0 2023-11-30T18:39:34.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.056+0000 7fed7e7fc700 1 -- 172.21.15.49:0/489950283 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v48) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fed8404e210 con 0x7fed900caab0 2023-11-30T18:39:34.057 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:39:34.057 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T18:39:34.057 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2023-11-30T18:39:34.058 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:39:34.058 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2023-11-30T18:39:34.058 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlwm1FHxAAk+s9c60UZ5jB37wbpGzlcg==", 2023-11-30T18:39:34.058 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:39:34.058 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:39:34.058 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T18:39:34.058 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T18:39:34.058 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:39:34.058 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:39:34.058 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:39:34.058 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:39:34.058 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2023-11-30T18:39:34.058 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlADm0KhAArffesGGTXzQwY4NPnJ1Bjw==", 2023-11-30T18:39:34.059 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:39:34.059 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:39:34.059 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T18:39:34.059 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T18:39:34.059 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:39:34.059 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:39:34.059 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:39:34.059 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:39:34.059 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2023-11-30T18:39:34.059 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlYnY1JhAA+Lurauug0NhWnK8aZErR3g==", 2023-11-30T18:39:34.059 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:39:34.059 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:39:34.059 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T18:39:34.059 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T18:39:34.059 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:39:34.060 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:39:34.060 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:39:34.060 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:39:34.060 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2023-11-30T18:39:34.060 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlQdKCMRAA3h4O2NqkQ2zE3DxOqBoaQQ==", 2023-11-30T18:39:34.060 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:39:34.060 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:39:34.060 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T18:39:34.060 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T18:39:34.060 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:39:34.060 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:39:34.060 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:39:34.060 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:39:34.060 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2023-11-30T18:39:34.060 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAPwWhlGdbhFxAAOspNRLMhR59LSWatFbsYDA==", 2023-11-30T18:39:34.061 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:39:34.061 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:39:34.061 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:39:34.061 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:39:34.061 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:39:34.061 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:39:34.061 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:39:34.061 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2023-11-30T18:39:34.061 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQASwWhlfwUEFxAAuj0L8ooIGi1vsb7XWLVlDA==", 2023-11-30T18:39:34.061 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:39:34.061 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:39:34.061 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:39:34.062 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:39:34.062 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:39:34.062 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:39:34.063 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:39:34.063 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2023-11-30T18:39:34.063 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAVwWhl7XYwFBAAuSHZqdfRR8V1Y+hmPT5uuw==", 2023-11-30T18:39:34.063 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:39:34.063 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:39:34.063 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:39:34.063 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:39:34.063 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:39:34.063 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:39:34.063 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:39:34.063 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2023-11-30T18:39:34.063 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAYwWhlkhRCFRAAe3cRLcrhJ3ZoluXuRUhmew==", 2023-11-30T18:39:34.063 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:39:34.063 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:39:34.063 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:39:34.064 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:39:34.064 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:39:34.064 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:39:34.064 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:39:34.064 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2023-11-30T18:39:34.064 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAewWhlrq4qFBAAOSdqozO8iH25BQFrPI1SRQ==", 2023-11-30T18:39:34.064 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:39:34.064 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:39:34.064 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:39:34.064 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:39:34.064 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:39:34.064 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:39:34.064 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:39:34.064 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2023-11-30T18:39:34.064 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAhwWhlZL9WERAA90znWBLNuY5eem3yF6O0wg==", 2023-11-30T18:39:34.065 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:39:34.065 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:39:34.065 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:39:34.065 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:39:34.065 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:39:34.065 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:39:34.065 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:39:34.065 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2023-11-30T18:39:34.065 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAkwWhlCJDiEBAAETLCBNCdaWXFgkPPaulTAA==", 2023-11-30T18:39:34.065 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:39:34.065 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:39:34.065 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:39:34.065 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:39:34.065 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:39:34.065 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:39:34.066 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:39:34.066 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2023-11-30T18:39:34.066 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAnwWhl+IiYEBAAcI3AU5xrv0cYy9lckyu0dQ==", 2023-11-30T18:39:34.066 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:39:34.066 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:39:34.066 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:39:34.066 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:39:34.066 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:39:34.066 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:39:34.066 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:39:34.066 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2023-11-30T18:39:34.066 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhleYZcNRAA5PoPChH+s6XfbrQ0hmu2NA==", 2023-11-30T18:39:34.066 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:39:34.066 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:39:34.066 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2023-11-30T18:39:34.067 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-30T18:39:34.067 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:39:34.067 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:39:34.067 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:39:34.067 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2023-11-30T18:39:34.067 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAOwWhlFhcfAhAAzaBDtyRxuqeQ9BatfgUuXw==", 2023-11-30T18:39:34.067 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:39:34.067 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:39:34.067 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T18:39:34.067 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T18:39:34.067 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T18:39:34.067 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:39:34.067 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:39:34.067 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:39:34.067 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2023-11-30T18:39:34.068 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlLZrDOhAAHG/dYWYmPouk3+Iqafr7qw==", 2023-11-30T18:39:34.068 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:39:34.068 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:39:34.068 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T18:39:34.068 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T18:39:34.068 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T18:39:34.068 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:39:34.068 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:39:34.068 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:39:34.068 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2023-11-30T18:39:34.068 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAOwWhl6lxuBxAA/YXQDo+U2ppULGzK054Gzg==", 2023-11-30T18:39:34.068 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:39:34.068 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:39:34.068 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T18:39:34.069 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T18:39:34.069 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T18:39:34.069 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:39:34.069 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:39:34.069 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:39:34.069 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2023-11-30T18:39:34.069 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhl4JkLAxAAiaLgZ5eiazaT9VanG5ihyQ==", 2023-11-30T18:39:34.069 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:39:34.069 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T18:39:34.069 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T18:39:34.069 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T18:39:34.069 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:39:34.069 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:39:34.069 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:39:34.069 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:39:34.070 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2023-11-30T18:39:34.070 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlH1s2HBAA3ea9Utfv7fZoo2hO+ElDVQ==", 2023-11-30T18:39:34.070 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:39:34.070 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T18:39:34.070 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-11-30T18:39:34.070 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:39:34.070 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:39:34.070 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:39:34.070 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:39:34.070 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2023-11-30T18:39:34.070 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlpy+fFxAA3qmboR+PlQtK6T35ryj+Lw==", 2023-11-30T18:39:34.070 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:39:34.070 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T18:39:34.070 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-11-30T18:39:34.071 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:39:34.071 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:39:34.071 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:39:34.071 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-11-30T18:39:34.071 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T18:39:34.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.058+0000 7fed94b17700 1 -- 172.21.15.49:0/489950283 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fed7005f270 msgr2=0x7fed70061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:34.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.058+0000 7fed94b17700 1 --2- 172.21.15.49:0/489950283 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fed7005f270 0x7fed70061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fed80006f80 tx=0x7fed80015000).stop 2023-11-30T18:39:34.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.058+0000 7fed94b17700 1 -- 172.21.15.49:0/489950283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed900caab0 msgr2=0x7fed900ad240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:34.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.058+0000 7fed94b17700 1 --2- 172.21.15.49:0/489950283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed900caab0 0x7fed900ad240 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7fed8400c420 tx=0x7fed84007c00).stop 2023-11-30T18:39:34.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.058+0000 7fed94b17700 1 -- 172.21.15.49:0/489950283 shutdown_connections 2023-11-30T18:39:34.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.058+0000 7fed94b17700 1 --2- 172.21.15.49:0/489950283 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fed7005f270 0x7fed70061730 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:34.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.058+0000 7fed94b17700 1 --2- 172.21.15.49:0/489950283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed900cae90 0x7fed90165830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:34.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.058+0000 7fed94b17700 1 --2- 172.21.15.49:0/489950283 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed900ca180 0x7fed90098660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:34.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.058+0000 7fed94b17700 1 --2- 172.21.15.49:0/489950283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed900caab0 0x7fed900ad240 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:34.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.058+0000 7fed94b17700 1 -- 172.21.15.49:0/489950283 >> 172.21.15.49:0/489950283 conn(0x7fed90094920 msgr2=0x7fed900b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:34.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.058+0000 7fed94b17700 1 -- 172.21.15.49:0/489950283 shutdown_connections 2023-11-30T18:39:34.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.058+0000 7fed94b17700 1 -- 172.21.15.49:0/489950283 wait complete. 2023-11-30T18:39:34.074 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:39:34.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.191+0000 7fcde5861700 1 Processor -- start 2023-11-30T18:39:34.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.191+0000 7fcde5861700 1 -- start start 2023-11-30T18:39:34.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.191+0000 7fcde5861700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcde0157660 0x7fcde0157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:34.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.191+0000 7fcde5861700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcde00c1750 0x7fcde00c1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:34.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.191+0000 7fcde5861700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcde00c12c0 con 0x7fcde00c0180 2023-11-30T18:39:34.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.191+0000 7fcde5861700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde00c06b0 con 0x7fcde00c1750 2023-11-30T18:39:34.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.191+0000 7fcde5861700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde00c0990 con 0x7fcde0157660 2023-11-30T18:39:34.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.192+0000 7fcde5060700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcde00c1750 0x7fcde00c1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:34.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.192+0000 7fcde5060700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcde00c1750 0x7fcde00c1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58440/0 (socket says 172.21.15.49:58440) 2023-11-30T18:39:34.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.192+0000 7fcde5060700 1 -- 172.21.15.49:0/2506210568 learned_addr learned my addr 172.21.15.49:0/2506210568 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:34.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.192+0000 7fcde485f700 1 --2- 172.21.15.49:0/2506210568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcde0157660 0x7fcde0157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:34.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.192+0000 7fcde5060700 1 -- 172.21.15.49:0/2506210568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcde0157660 msgr2=0x7fcde0157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:34.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.192+0000 7fcde5060700 1 --2- 172.21.15.49:0/2506210568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcde0157660 0x7fcde0157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:34.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.192+0000 7fcde5060700 1 -- 172.21.15.49:0/2506210568 >> v1:172.21.15.115:6789/0 conn(0x7fcde00c0180 legacy=0x7fcde01589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:34.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.192+0000 7fcde5060700 1 -- 172.21.15.49:0/2506210568 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde00c0c70 con 0x7fcde00c1750 2023-11-30T18:39:34.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.192+0000 7fcde485f700 1 --2- 172.21.15.49:0/2506210568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcde0157660 0x7fcde0157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:39:34.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.192+0000 7fcde5060700 1 --2- 172.21.15.49:0/2506210568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcde00c1750 0x7fcde00c1bc0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 rx=0x7fcdc8006fd0 tx=0x7fcdc80090f0).ready entity=mon.0 client_cookie=88c58caaa018409f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:34.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.192+0000 7fcddf7fe700 1 -- 172.21.15.49:0/2506210568 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc800b600 con 0x7fcde00c1750 2023-11-30T18:39:34.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.192+0000 7fcddf7fe700 1 -- 172.21.15.49:0/2506210568 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc800b760 con 0x7fcde00c1750 2023-11-30T18:39:34.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.192+0000 7fcddf7fe700 1 -- 172.21.15.49:0/2506210568 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc800bae0 con 0x7fcde00c1750 2023-11-30T18:39:34.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.193+0000 7fcde5861700 1 -- 172.21.15.49:0/2506210568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcde00c1750 msgr2=0x7fcde00c1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:34.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.193+0000 7fcde5861700 1 --2- 172.21.15.49:0/2506210568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcde00c1750 0x7fcde00c1bc0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 rx=0x7fcdc8006fd0 tx=0x7fcdc80090f0).stop 2023-11-30T18:39:34.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.193+0000 7fcde5861700 1 -- 172.21.15.49:0/2506210568 shutdown_connections 2023-11-30T18:39:34.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.193+0000 7fcde5861700 1 --2- 172.21.15.49:0/2506210568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcde0157660 0x7fcde0157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:34.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.193+0000 7fcde5861700 1 --2- 172.21.15.49:0/2506210568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcde00c1750 0x7fcde00c1bc0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:34.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.193+0000 7fcde5861700 1 -- 172.21.15.49:0/2506210568 >> 172.21.15.49:0/2506210568 conn(0x7fcde00cb000 msgr2=0x7fcde00cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:34.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.193+0000 7fcde5861700 1 -- 172.21.15.49:0/2506210568 shutdown_connections 2023-11-30T18:39:34.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.193+0000 7fcde5861700 1 -- 172.21.15.49:0/2506210568 wait complete. 2023-11-30T18:39:34.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.194+0000 7fcde5861700 1 Processor -- start 2023-11-30T18:39:34.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.194+0000 7fcde5861700 1 -- start start 2023-11-30T18:39:34.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.195+0000 7fcde5861700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcde00c0180 0x7fcde014fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:34.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.195+0000 7fcde5861700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcde00c1750 0x7fcde00c25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:34.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.195+0000 7fcde5861700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcde0157660 0x7fcde00c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:34.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.195+0000 7fcde5861700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde00c1b60 con 0x7fcde0157660 2023-11-30T18:39:34.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.195+0000 7fcde5861700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde00c2120 con 0x7fcde00c1750 2023-11-30T18:39:34.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.195+0000 7fcde5861700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde01673b0 con 0x7fcde00c0180 2023-11-30T18:39:34.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.195+0000 7fcde5060700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcde0157660 0x7fcde00c2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:34.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.195+0000 7fcde5060700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcde0157660 0x7fcde00c2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58442/0 (socket says 172.21.15.49:58442) 2023-11-30T18:39:34.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.195+0000 7fcde5060700 1 -- 172.21.15.49:0/3029194674 learned_addr learned my addr 172.21.15.49:0/3029194674 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:34.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.195+0000 7fcddffff700 1 --2- 172.21.15.49:0/3029194674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcde00c1750 0x7fcde00c25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:34.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.195+0000 7fcde485f700 1 --2- 172.21.15.49:0/3029194674 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcde00c0180 0x7fcde014fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:34.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.195+0000 7fcde5060700 1 -- 172.21.15.49:0/3029194674 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcde00c0180 msgr2=0x7fcde014fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:34.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.195+0000 7fcde5060700 1 --2- 172.21.15.49:0/3029194674 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcde00c0180 0x7fcde014fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:34.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.195+0000 7fcde5060700 1 -- 172.21.15.49:0/3029194674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcde00c1750 msgr2=0x7fcde00c25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:34.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.195+0000 7fcde5060700 1 --2- 172.21.15.49:0/3029194674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcde00c1750 0x7fcde00c25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:34.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.195+0000 7fcde5060700 1 -- 172.21.15.49:0/3029194674 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc8009370 con 0x7fcde0157660 2023-11-30T18:39:34.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.195+0000 7fcde5060700 1 --2- 172.21.15.49:0/3029194674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcde0157660 0x7fcde00c2aa0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 rx=0x7fcde0084570 tx=0x7fcdc8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:34.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.196+0000 7fcddcff9700 1 -- 172.21.15.49:0/3029194674 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc800bae0 con 0x7fcde0157660 2023-11-30T18:39:34.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.196+0000 7fcddcff9700 1 -- 172.21.15.49:0/3029194674 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc800bea0 con 0x7fcde0157660 2023-11-30T18:39:34.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.196+0000 7fcde5861700 1 -- 172.21.15.49:0/3029194674 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde0167690 con 0x7fcde0157660 2023-11-30T18:39:34.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.196+0000 7fcddcff9700 1 -- 172.21.15.49:0/3029194674 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc801c650 con 0x7fcde0157660 2023-11-30T18:39:34.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.196+0000 7fcde5861700 1 -- 172.21.15.49:0/3029194674 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde00b0010 con 0x7fcde0157660 2023-11-30T18:39:34.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.197+0000 7fcde5861700 1 -- 172.21.15.49:0/3029194674 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcde006c7c0 con 0x7fcde0157660 2023-11-30T18:39:34.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.197+0000 7fcddcff9700 1 -- 172.21.15.49:0/3029194674 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fcdc801c9c0 con 0x7fcde0157660 2023-11-30T18:39:34.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.197+0000 7fcddcff9700 1 --2- 172.21.15.49:0/3029194674 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fcdc005f240 0x7fcdc0061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:34.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.198+0000 7fcddcff9700 1 -- 172.21.15.49:0/3029194674 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fcdc807c050 con 0x7fcde0157660 2023-11-30T18:39:34.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.198+0000 7fcde485f700 1 --2- 172.21.15.49:0/3029194674 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fcdc005f240 0x7fcdc0061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:34.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.198+0000 7fcde485f700 1 --2- 172.21.15.49:0/3029194674 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fcdc005f240 0x7fcdc0061700 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fcdd800f600 tx=0x7fcdd80077b0).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:34.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.202+0000 7fcddcff9700 1 -- 172.21.15.49:0/3029194674 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcdc804d4a0 con 0x7fcde0157660 2023-11-30T18:39:34.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.374+0000 7fcde5861700 1 -- 172.21.15.49:0/3029194674 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcde0167820 con 0x7fcde0157660 2023-11-30T18:39:34.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.375+0000 7fcddcff9700 1 -- 172.21.15.49:0/3029194674 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v199) v1 ==== 74+0+13857 (secure 0 0 0) 0x7fcde0167820 con 0x7fcde0157660 2023-11-30T18:39:34.376 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:39:34.376 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":199,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:39:33.658602+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:39:34.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.377+0000 7fcde5861700 1 -- 172.21.15.49:0/3029194674 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fcdc005f240 msgr2=0x7fcdc0061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:34.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.377+0000 7fcde5861700 1 --2- 172.21.15.49:0/3029194674 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fcdc005f240 0x7fcdc0061700 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fcdd800f600 tx=0x7fcdd80077b0).stop 2023-11-30T18:39:34.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.377+0000 7fcde5861700 1 -- 172.21.15.49:0/3029194674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcde0157660 msgr2=0x7fcde00c2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:34.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.377+0000 7fcde5861700 1 --2- 172.21.15.49:0/3029194674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcde0157660 0x7fcde00c2aa0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 rx=0x7fcde0084570 tx=0x7fcdc8017000).stop 2023-11-30T18:39:34.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.377+0000 7fcde5861700 1 -- 172.21.15.49:0/3029194674 shutdown_connections 2023-11-30T18:39:34.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.377+0000 7fcde5861700 1 --2- 172.21.15.49:0/3029194674 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fcdc005f240 0x7fcdc0061700 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:34.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.377+0000 7fcde5861700 1 --2- 172.21.15.49:0/3029194674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcde0157660 0x7fcde00c2aa0 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:34.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.377+0000 7fcde5861700 1 --2- 172.21.15.49:0/3029194674 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcde00c0180 0x7fcde014fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:34.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.377+0000 7fcde5861700 1 --2- 172.21.15.49:0/3029194674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcde00c1750 0x7fcde00c25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:34.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.377+0000 7fcde5861700 1 -- 172.21.15.49:0/3029194674 >> 172.21.15.49:0/3029194674 conn(0x7fcde00cb000 msgr2=0x7fcde0151b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:34.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.377+0000 7fcde5861700 1 -- 172.21.15.49:0/3029194674 shutdown_connections 2023-11-30T18:39:34.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.377+0000 7fcde5861700 1 -- 172.21.15.49:0/3029194674 wait complete. 2023-11-30T18:39:34.390 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '192', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-11-30T18:39:34.391 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T18:39:34.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.510+0000 7f1763fed700 1 Processor -- start 2023-11-30T18:39:34.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.510+0000 7f1763fed700 1 -- start start 2023-11-30T18:39:34.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.511+0000 7f1763fed700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f175c158a30 0x7f175c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:34.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.511+0000 7f1763fed700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f175c0c72d0 con 0x7f175c0c6190 2023-11-30T18:39:34.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.511+0000 7f1763fed700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f175c064570 con 0x7f175c098d10 2023-11-30T18:39:34.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.511+0000 7f1763fed700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f175c154bc0 con 0x7f175c158a30 2023-11-30T18:39:34.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.511+0000 7f1761588700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f175c0c6190 0x7f175c158320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:54218/0 (socket says 172.21.15.49:54218) 2023-11-30T18:39:34.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.511+0000 7f1761588700 1 -- 172.21.15.49:0/3967698598 learned_addr learned my addr 172.21.15.49:0/3967698598 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:34.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.511+0000 7f176258a700 1 --2- 172.21.15.49:0/3967698598 >> v2:172.21.15.115:3300/0 conn(0x7f175c158a30 0x7f175c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:34.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.512+0000 7f1760d87700 1 -- 172.21.15.49:0/3967698598 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3365181420 0 0) 0x7f175c0c72d0 con 0x7f175c0c6190 2023-11-30T18:39:34.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.512+0000 7f1760d87700 1 -- 172.21.15.49:0/3967698598 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17440033f0 con 0x7f175c0c6190 2023-11-30T18:39:34.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.512+0000 7f1760d87700 1 -- 172.21.15.49:0/3967698598 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1836398585 0 0) 0x7f175c064570 con 0x7f175c098d10 2023-11-30T18:39:34.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.512+0000 7f1760d87700 1 -- 172.21.15.49:0/3967698598 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f175c0c72d0 con 0x7f175c098d10 2023-11-30T18:39:34.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.512+0000 7f176258a700 1 -- 172.21.15.49:0/3967698598 >> v1:172.21.15.115:6789/0 conn(0x7f175c098d10 legacy=0x7f175c063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:34.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.512+0000 7f176258a700 1 -- 172.21.15.49:0/3967698598 >> v1:172.21.15.49:6789/0 conn(0x7f175c0c6190 legacy=0x7f175c158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:34.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.512+0000 7f176258a700 1 -- 172.21.15.49:0/3967698598 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175c0c66c0 con 0x7f175c158a30 2023-11-30T18:39:34.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.512+0000 7f176258a700 1 --2- 172.21.15.49:0/3967698598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f175c158a30 0x7f175c0c7760 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f174c009e60 tx=0x7f174c009780).ready entity=mon.1 client_cookie=4d4234ff3643248e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:34.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.512+0000 7f1760d87700 1 -- 172.21.15.49:0/3967698598 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c00e070 con 0x7f175c158a30 2023-11-30T18:39:34.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.512+0000 7f1760d87700 1 -- 172.21.15.49:0/3967698598 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174c00bab0 con 0x7f175c158a30 2023-11-30T18:39:34.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.512+0000 7f1760d87700 1 -- 172.21.15.49:0/3967698598 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c00be30 con 0x7f175c158a30 2023-11-30T18:39:34.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.513+0000 7f1763fed700 1 -- 172.21.15.49:0/3967698598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f175c158a30 msgr2=0x7f175c0c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:34.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.513+0000 7f1763fed700 1 --2- 172.21.15.49:0/3967698598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f175c158a30 0x7f175c0c7760 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f174c009e60 tx=0x7f174c009780).stop 2023-11-30T18:39:34.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.513+0000 7f1763fed700 1 -- 172.21.15.49:0/3967698598 shutdown_connections 2023-11-30T18:39:34.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.513+0000 7f1763fed700 1 --2- 172.21.15.49:0/3967698598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f175c158a30 0x7f175c0c7760 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:34.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.513+0000 7f1763fed700 1 -- 172.21.15.49:0/3967698598 >> 172.21.15.49:0/3967698598 conn(0x7f175c0cb310 msgr2=0x7f175c0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:34.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.513+0000 7f1763fed700 1 -- 172.21.15.49:0/3967698598 shutdown_connections 2023-11-30T18:39:34.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.513+0000 7f1763fed700 1 -- 172.21.15.49:0/3967698598 wait complete. 2023-11-30T18:39:34.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.514+0000 7f1763fed700 1 Processor -- start 2023-11-30T18:39:34.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.514+0000 7f1763fed700 1 -- start start 2023-11-30T18:39:34.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.514+0000 7f1763fed700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f175c098d10 0x7f175c0aad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:34.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.514+0000 7f1763fed700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f175c0c6190 0x7f175c0ab260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:34.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.514+0000 7f1763fed700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f175c158a30 0x7f175c164f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:34.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.514+0000 7f1763fed700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175c0ab750 con 0x7f175c098d10 2023-11-30T18:39:34.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.514+0000 7f1763fed700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175c0ad300 con 0x7f175c158a30 2023-11-30T18:39:34.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.515+0000 7f1763fed700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175c0ad790 con 0x7f175c0c6190 2023-11-30T18:39:34.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.515+0000 7f1761d89700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f175c098d10 0x7f175c0aad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:34.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.515+0000 7f1761d89700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f175c098d10 0x7f175c0aad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58446/0 (socket says 172.21.15.49:58446) 2023-11-30T18:39:34.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.515+0000 7f1761d89700 1 -- 172.21.15.49:0/500641311 learned_addr learned my addr 172.21.15.49:0/500641311 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:34.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.515+0000 7f176258a700 1 --2- 172.21.15.49:0/500641311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f175c158a30 0x7f175c164f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:34.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.515+0000 7f1761588700 1 --2- 172.21.15.49:0/500641311 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f175c0c6190 0x7f175c0ab260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:34.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.515+0000 7f1761d89700 1 -- 172.21.15.49:0/500641311 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f175c0c6190 msgr2=0x7f175c0ab260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:34.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.515+0000 7f1761d89700 1 --2- 172.21.15.49:0/500641311 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f175c0c6190 0x7f175c0ab260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:34.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.515+0000 7f1761d89700 1 -- 172.21.15.49:0/500641311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f175c158a30 msgr2=0x7f175c164f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:34.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.515+0000 7f1761d89700 1 --2- 172.21.15.49:0/500641311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f175c158a30 0x7f175c164f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:34.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.515+0000 7f1761d89700 1 -- 172.21.15.49:0/500641311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174c009a20 con 0x7f175c098d10 2023-11-30T18:39:34.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.515+0000 7f1761588700 1 --2- 172.21.15.49:0/500641311 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f175c0c6190 0x7f175c0ab260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:39:34.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.515+0000 7f1761d89700 1 --2- 172.21.15.49:0/500641311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f175c098d10 0x7f175c0aad70 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 rx=0x7f175400c490 tx=0x7f1754007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:34.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.515+0000 7f1759ffb700 1 -- 172.21.15.49:0/500641311 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175400f470 con 0x7f175c098d10 2023-11-30T18:39:34.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.515+0000 7f1759ffb700 1 -- 172.21.15.49:0/500641311 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175400f5d0 con 0x7f175c098d10 2023-11-30T18:39:34.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.515+0000 7f1763fed700 1 -- 172.21.15.49:0/500641311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f175c0ac6f0 con 0x7f175c098d10 2023-11-30T18:39:34.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.515+0000 7f1759ffb700 1 -- 172.21.15.49:0/500641311 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175400f970 con 0x7f175c098d10 2023-11-30T18:39:34.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.516+0000 7f1763fed700 1 -- 172.21.15.49:0/500641311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f175c0accb0 con 0x7f175c098d10 2023-11-30T18:39:34.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.517+0000 7f1763fed700 1 -- 172.21.15.49:0/500641311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f175c0ad5e0 con 0x7f175c098d10 2023-11-30T18:39:34.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.517+0000 7f1759ffb700 1 -- 172.21.15.49:0/500641311 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f175400fce0 con 0x7f175c098d10 2023-11-30T18:39:34.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.517+0000 7f1759ffb700 1 --2- 172.21.15.49:0/500641311 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f174805f240 0x7f1748061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:34.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.517+0000 7f1759ffb700 1 -- 172.21.15.49:0/500641311 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f17540796c0 con 0x7f175c098d10 2023-11-30T18:39:34.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.517+0000 7f1761588700 1 --2- 172.21.15.49:0/500641311 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f174805f240 0x7f1748061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:34.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.518+0000 7f1761588700 1 --2- 172.21.15.49:0/500641311 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f174805f240 0x7f1748061700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f1750007fd0 tx=0x7f1750009040).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:34.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.521+0000 7f1759ffb700 1 -- 172.21.15.49:0/500641311 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f175404ab10 con 0x7f175c098d10 2023-11-30T18:39:34.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.692+0000 7f1763fed700 1 -- 172.21.15.49:0/500641311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f175c158870 con 0x7f175c098d10 2023-11-30T18:39:34.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.693+0000 7f1759ffb700 1 -- 172.21.15.49:0/500641311 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v199) v1 ==== 110+0+10 (secure 0 0 0) 0x7f175404e130 con 0x7f175c098d10 2023-11-30T18:39:34.694 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T18:39:34.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.695+0000 7f1763fed700 1 -- 172.21.15.49:0/500641311 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f174805f240 msgr2=0x7f1748061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:34.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.695+0000 7f1763fed700 1 --2- 172.21.15.49:0/500641311 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f174805f240 0x7f1748061700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f1750007fd0 tx=0x7f1750009040).stop 2023-11-30T18:39:34.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.695+0000 7f1763fed700 1 -- 172.21.15.49:0/500641311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f175c098d10 msgr2=0x7f175c0aad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:34.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.695+0000 7f1763fed700 1 --2- 172.21.15.49:0/500641311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f175c098d10 0x7f175c0aad70 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 rx=0x7f175400c490 tx=0x7f1754007c90).stop 2023-11-30T18:39:34.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.695+0000 7f1763fed700 1 -- 172.21.15.49:0/500641311 shutdown_connections 2023-11-30T18:39:34.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.695+0000 7f1763fed700 1 --2- 172.21.15.49:0/500641311 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f174805f240 0x7f1748061700 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:34.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.695+0000 7f1763fed700 1 --2- 172.21.15.49:0/500641311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f175c158a30 0x7f175c164f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:34.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.695+0000 7f1763fed700 1 --2- 172.21.15.49:0/500641311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f175c098d10 0x7f175c0aad70 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:34.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.695+0000 7f1763fed700 1 --2- 172.21.15.49:0/500641311 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f175c0c6190 0x7f175c0ab260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:34.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.695+0000 7f1763fed700 1 -- 172.21.15.49:0/500641311 >> 172.21.15.49:0/500641311 conn(0x7f175c0cb310 msgr2=0x7f175c0c7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:34.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.695+0000 7f1763fed700 1 -- 172.21.15.49:0/500641311 shutdown_connections 2023-11-30T18:39:34.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.695+0000 7f1763fed700 1 -- 172.21.15.49:0/500641311 wait complete. 2023-11-30T18:39:34.708 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T18:39:34.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.829+0000 7f47c68c8700 1 Processor -- start 2023-11-30T18:39:34.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.829+0000 7f47c68c8700 1 -- start start 2023-11-30T18:39:34.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.830+0000 7f47c68c8700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f47c00c4bd0 0x7f47c0156880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:34.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.830+0000 7f47c68c8700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f47c0151d10 0x7f47c01521a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:34.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.830+0000 7f47c68c8700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47c0156d70 con 0x7f47c00c47f0 2023-11-30T18:39:34.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.830+0000 7f47c68c8700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47c00ab2a0 con 0x7f47c0151d10 2023-11-30T18:39:34.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.830+0000 7f47c68c8700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47c00ab580 con 0x7f47c00c4bd0 2023-11-30T18:39:34.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.830+0000 7f47c60c7700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f47c0151d10 0x7f47c01521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:34.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.830+0000 7f47c58c6700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f47c00c47f0 0x7f47c00ad760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:54230/0 (socket says 172.21.15.49:54230) 2023-11-30T18:39:34.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.830+0000 7f47c58c6700 1 -- 172.21.15.49:0/2437186801 learned_addr learned my addr 172.21.15.49:0/2437186801 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:34.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.830+0000 7f47c60c7700 1 -- 172.21.15.49:0/2437186801 >> v2:172.21.15.115:3300/0 conn(0x7f47c00c4bd0 msgr2=0x7f47c0156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:34.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.830+0000 7f47c50c5700 1 --2- 172.21.15.49:0/2437186801 >> v2:172.21.15.115:3300/0 conn(0x7f47c00c4bd0 0x7f47c0156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:34.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.830+0000 7f47c60c7700 1 --2- 172.21.15.49:0/2437186801 >> v2:172.21.15.115:3300/0 conn(0x7f47c00c4bd0 0x7f47c0156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:34.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.830+0000 7f47c48c4700 1 -- 172.21.15.49:0/2437186801 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2534689061 0 0) 0x7f47c0156d70 con 0x7f47c00c47f0 2023-11-30T18:39:34.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.830+0000 7f47c60c7700 1 -- 172.21.15.49:0/2437186801 >> v1:172.21.15.49:6789/0 conn(0x7f47c00c47f0 legacy=0x7f47c00ad760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:34.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.830+0000 7f47c60c7700 1 -- 172.21.15.49:0/2437186801 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c00acf60 con 0x7f47c0151d10 2023-11-30T18:39:34.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.830+0000 7f47c50c5700 1 --2- 172.21.15.49:0/2437186801 >> v2:172.21.15.115:3300/0 conn(0x7f47c00c4bd0 0x7f47c0156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:39:34.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.830+0000 7f47c60c7700 1 --2- 172.21.15.49:0/2437186801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47c0151d10 0x7f47c01521a0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7f47c00bb8d0 tx=0x7f47b0009060).ready entity=mon.0 client_cookie=ee20b51212205399 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:34.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.831+0000 7f47c48c4700 1 -- 172.21.15.49:0/2437186801 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b000b580 con 0x7f47c0151d10 2023-11-30T18:39:34.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.831+0000 7f47c48c4700 1 -- 172.21.15.49:0/2437186801 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b000b6e0 con 0x7f47c0151d10 2023-11-30T18:39:34.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.831+0000 7f47c48c4700 1 -- 172.21.15.49:0/2437186801 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b000ba60 con 0x7f47c0151d10 2023-11-30T18:39:34.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.831+0000 7f47c68c8700 1 -- 172.21.15.49:0/2437186801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47c0151d10 msgr2=0x7f47c01521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:34.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.831+0000 7f47c68c8700 1 --2- 172.21.15.49:0/2437186801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47c0151d10 0x7f47c01521a0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7f47c00bb8d0 tx=0x7f47b0009060).stop 2023-11-30T18:39:34.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.831+0000 7f47c68c8700 1 -- 172.21.15.49:0/2437186801 shutdown_connections 2023-11-30T18:39:34.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.831+0000 7f47c68c8700 1 --2- 172.21.15.49:0/2437186801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47c0151d10 0x7f47c01521a0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:34.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.831+0000 7f47c68c8700 1 --2- 172.21.15.49:0/2437186801 >> v2:172.21.15.115:3300/0 conn(0x7f47c00c4bd0 0x7f47c0156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:34.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.831+0000 7f47c68c8700 1 -- 172.21.15.49:0/2437186801 >> 172.21.15.49:0/2437186801 conn(0x7f47c0063810 msgr2=0x7f47c0063c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:34.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.831+0000 7f47c68c8700 1 -- 172.21.15.49:0/2437186801 shutdown_connections 2023-11-30T18:39:34.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.831+0000 7f47c68c8700 1 -- 172.21.15.49:0/2437186801 wait complete. 2023-11-30T18:39:34.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.832+0000 7f47c68c8700 1 Processor -- start 2023-11-30T18:39:34.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.832+0000 7f47c68c8700 1 -- start start 2023-11-30T18:39:34.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.833+0000 7f47c68c8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47c00c47f0 0x7f47c0150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:34.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.833+0000 7f47c68c8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47c00c4bd0 0x7f47c00a48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:34.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.833+0000 7f47c68c8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47c0151d10 0x7f47c00a53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:34.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.833+0000 7f47c68c8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c00c4390 con 0x7f47c00c4bd0 2023-11-30T18:39:34.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.833+0000 7f47c68c8700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c00bff80 con 0x7f47c00c47f0 2023-11-30T18:39:34.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.833+0000 7f47c68c8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47c00c34f0 con 0x7f47c0151d10 2023-11-30T18:39:34.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.833+0000 7f47c50c5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47c00c4bd0 0x7f47c00a48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:34.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.833+0000 7f47c50c5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47c00c4bd0 0x7f47c00a48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58462/0 (socket says 172.21.15.49:58462) 2023-11-30T18:39:34.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.833+0000 7f47c50c5700 1 -- 172.21.15.49:0/3189991174 learned_addr learned my addr 172.21.15.49:0/3189991174 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:34.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.833+0000 7f47c58c6700 1 --2- 172.21.15.49:0/3189991174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47c00c47f0 0x7f47c0150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:34.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.833+0000 7f47c60c7700 1 --2- 172.21.15.49:0/3189991174 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47c0151d10 0x7f47c00a53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:34.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.833+0000 7f47c50c5700 1 -- 172.21.15.49:0/3189991174 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47c0151d10 msgr2=0x7f47c00a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:34.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.833+0000 7f47c50c5700 1 --2- 172.21.15.49:0/3189991174 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47c0151d10 0x7f47c00a53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:34.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.833+0000 7f47c50c5700 1 -- 172.21.15.49:0/3189991174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47c00c47f0 msgr2=0x7f47c0150020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:34.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.833+0000 7f47c50c5700 1 --2- 172.21.15.49:0/3189991174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47c00c47f0 0x7f47c0150020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:34.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.834+0000 7f47c50c5700 1 -- 172.21.15.49:0/3189991174 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b00092a0 con 0x7f47c00c4bd0 2023-11-30T18:39:34.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.834+0000 7f47c50c5700 1 --2- 172.21.15.49:0/3189991174 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47c00c4bd0 0x7f47c00a48f0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 rx=0x7f47b400c880 tx=0x7f47b4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:34.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.834+0000 7f47bdffb700 1 -- 172.21.15.49:0/3189991174 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b4010580 con 0x7f47c00c4bd0 2023-11-30T18:39:34.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.834+0000 7f47bdffb700 1 -- 172.21.15.49:0/3189991174 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b40106e0 con 0x7f47c00c4bd0 2023-11-30T18:39:34.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.834+0000 7f47c68c8700 1 -- 172.21.15.49:0/3189991174 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c00c37d0 con 0x7f47c00c4bd0 2023-11-30T18:39:34.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.834+0000 7f47bdffb700 1 -- 172.21.15.49:0/3189991174 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b4010a60 con 0x7f47c00c4bd0 2023-11-30T18:39:34.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.834+0000 7f47c68c8700 1 -- 172.21.15.49:0/3189991174 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c00c3d90 con 0x7f47c00c4bd0 2023-11-30T18:39:34.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.835+0000 7f47c68c8700 1 -- 172.21.15.49:0/3189991174 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47c006c7c0 con 0x7f47c00c4bd0 2023-11-30T18:39:34.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.835+0000 7f47bdffb700 1 -- 172.21.15.49:0/3189991174 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f47b401b460 con 0x7f47c00c4bd0 2023-11-30T18:39:34.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.836+0000 7f47bdffb700 1 --2- 172.21.15.49:0/3189991174 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f47ac05f270 0x7f47ac061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:34.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.836+0000 7f47bdffb700 1 -- 172.21.15.49:0/3189991174 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f47b407a0b0 con 0x7f47c00c4bd0 2023-11-30T18:39:34.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.836+0000 7f47c58c6700 1 --2- 172.21.15.49:0/3189991174 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f47ac05f270 0x7f47ac061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:34.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.836+0000 7f47c58c6700 1 --2- 172.21.15.49:0/3189991174 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f47ac05f270 0x7f47ac061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f47b8001560 tx=0x7f47b8009040).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:34.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:34.840+0000 7f47bdffb700 1 -- 172.21.15.49:0/3189991174 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f47b404b4a0 con 0x7f47c00c4bd0 2023-11-30T18:39:35.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.015+0000 7f47c68c8700 1 -- 172.21.15.49:0/3189991174 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f47c00ade90 con 0x7f47c00c4bd0 2023-11-30T18:39:35.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.015+0000 7f47bdffb700 1 -- 172.21.15.49:0/3189991174 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v199) v1 ==== 92+0+10 (secure 0 0 0) 0x7f47b404eac0 con 0x7f47c00c4bd0 2023-11-30T18:39:35.016 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T18:39:35.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.017+0000 7f47c68c8700 1 -- 172.21.15.49:0/3189991174 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f47ac05f270 msgr2=0x7f47ac061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:35.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.017+0000 7f47c68c8700 1 --2- 172.21.15.49:0/3189991174 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f47ac05f270 0x7f47ac061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f47b8001560 tx=0x7f47b8009040).stop 2023-11-30T18:39:35.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.017+0000 7f47c68c8700 1 -- 172.21.15.49:0/3189991174 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47c00c4bd0 msgr2=0x7f47c00a48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:35.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.017+0000 7f47c68c8700 1 --2- 172.21.15.49:0/3189991174 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47c00c4bd0 0x7f47c00a48f0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 rx=0x7f47b400c880 tx=0x7f47b4008040).stop 2023-11-30T18:39:35.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.017+0000 7f47c68c8700 1 -- 172.21.15.49:0/3189991174 shutdown_connections 2023-11-30T18:39:35.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.017+0000 7f47c68c8700 1 --2- 172.21.15.49:0/3189991174 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f47ac05f270 0x7f47ac061730 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:35.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.017+0000 7f47c68c8700 1 --2- 172.21.15.49:0/3189991174 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47c0151d10 0x7f47c00a53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:35.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.017+0000 7f47c68c8700 1 --2- 172.21.15.49:0/3189991174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47c00c47f0 0x7f47c0150020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:35.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.017+0000 7f47c68c8700 1 --2- 172.21.15.49:0/3189991174 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47c00c4bd0 0x7f47c00a48f0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:35.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.017+0000 7f47c68c8700 1 -- 172.21.15.49:0/3189991174 >> 172.21.15.49:0/3189991174 conn(0x7f47c0063810 msgr2=0x7f47c00a9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:35.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.017+0000 7f47c68c8700 1 -- 172.21.15.49:0/3189991174 shutdown_connections 2023-11-30T18:39:35.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.017+0000 7f47c68c8700 1 -- 172.21.15.49:0/3189991174 wait complete. 2023-11-30T18:39:35.030 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-30T18:39:35.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.146+0000 7f3298765700 1 Processor -- start 2023-11-30T18:39:35.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.146+0000 7f3298765700 1 -- start start 2023-11-30T18:39:35.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.147+0000 7f3298765700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f32901544d0 0x7f3290155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:35.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.147+0000 7f3298765700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32900683d0 con 0x7f3290066f40 2023-11-30T18:39:35.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.147+0000 7f3298765700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3290067850 con 0x7f32900673c0 2023-11-30T18:39:35.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.147+0000 7f3298765700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3290067b30 con 0x7f32901544d0 2023-11-30T18:39:35.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.148+0000 7f3295d00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3290066f40 0x7f3290095e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:54246/0 (socket says 172.21.15.49:54246) 2023-11-30T18:39:35.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.148+0000 7f3295d00700 1 -- 172.21.15.49:0/3811311011 learned_addr learned my addr 172.21.15.49:0/3811311011 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:35.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.148+0000 7f3296501700 1 --2- 172.21.15.49:0/3811311011 >> v2:172.21.15.115:3300/0 conn(0x7f32901544d0 0x7f3290155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:35.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.148+0000 7f32954ff700 1 -- 172.21.15.49:0/3811311011 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4217925273 0 0) 0x7f32900683d0 con 0x7f3290066f40 2023-11-30T18:39:35.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.148+0000 7f32954ff700 1 -- 172.21.15.49:0/3811311011 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32780033f0 con 0x7f3290066f40 2023-11-30T18:39:35.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.148+0000 7f3296501700 1 -- 172.21.15.49:0/3811311011 >> v1:172.21.15.115:6789/0 conn(0x7f32900673c0 legacy=0x7f329015e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:35.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.148+0000 7f3296501700 1 -- 172.21.15.49:0/3811311011 >> v1:172.21.15.49:6789/0 conn(0x7f3290066f40 legacy=0x7f3290095e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:35.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.148+0000 7f32954ff700 1 -- 172.21.15.49:0/3811311011 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1222664766 0 0) 0x7f32780033f0 con 0x7f3290066f40 2023-11-30T18:39:35.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.148+0000 7f3296501700 1 -- 172.21.15.49:0/3811311011 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3290067e10 con 0x7f32901544d0 2023-11-30T18:39:35.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.148+0000 7f3296501700 1 --2- 172.21.15.49:0/3811311011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32901544d0 0x7f3290155750 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f3288006fd0 tx=0x7f3288006f40).ready entity=mon.1 client_cookie=ad8ba1b39e1e5797 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:35.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.148+0000 7f32954ff700 1 -- 172.21.15.49:0/3811311011 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3284001470 con 0x7f32901544d0 2023-11-30T18:39:35.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.148+0000 7f32954ff700 1 -- 172.21.15.49:0/3811311011 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3288005880 con 0x7f32901544d0 2023-11-30T18:39:35.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.148+0000 7f32954ff700 1 -- 172.21.15.49:0/3811311011 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3288005c00 con 0x7f32901544d0 2023-11-30T18:39:35.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.149+0000 7f3298765700 1 -- 172.21.15.49:0/3811311011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32901544d0 msgr2=0x7f3290155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:35.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.149+0000 7f3298765700 1 --2- 172.21.15.49:0/3811311011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32901544d0 0x7f3290155750 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f3288006fd0 tx=0x7f3288006f40).stop 2023-11-30T18:39:35.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.149+0000 7f3298765700 1 -- 172.21.15.49:0/3811311011 shutdown_connections 2023-11-30T18:39:35.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.149+0000 7f3298765700 1 --2- 172.21.15.49:0/3811311011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32901544d0 0x7f3290155750 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:35.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.149+0000 7f3298765700 1 -- 172.21.15.49:0/3811311011 >> 172.21.15.49:0/3811311011 conn(0x7f32900631d0 msgr2=0x7f32900c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:35.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.149+0000 7f3298765700 1 -- 172.21.15.49:0/3811311011 shutdown_connections 2023-11-30T18:39:35.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.149+0000 7f3298765700 1 -- 172.21.15.49:0/3811311011 wait complete. 2023-11-30T18:39:35.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.150+0000 7f3298765700 1 Processor -- start 2023-11-30T18:39:35.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.150+0000 7f3298765700 1 -- start start 2023-11-30T18:39:35.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.151+0000 7f3298765700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3290066f40 0x7f329014cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:35.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.151+0000 7f3298765700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32901544d0 0x7f3290159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:35.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.151+0000 7f3298765700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32900adca0 0x7f32900c40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:35.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.151+0000 7f3298765700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32900a8d40 con 0x7f3290066f40 2023-11-30T18:39:35.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.151+0000 7f3298765700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32900a8fa0 con 0x7f32900adca0 2023-11-30T18:39:35.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.151+0000 7f3298765700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32900a9560 con 0x7f32901544d0 2023-11-30T18:39:35.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.151+0000 7f3296501700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3290066f40 0x7f329014cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:35.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.151+0000 7f3296501700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3290066f40 0x7f329014cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58466/0 (socket says 172.21.15.49:58466) 2023-11-30T18:39:35.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.151+0000 7f3296501700 1 -- 172.21.15.49:0/1972465663 learned_addr learned my addr 172.21.15.49:0/1972465663 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:35.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.151+0000 7f3295d00700 1 --2- 172.21.15.49:0/1972465663 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32901544d0 0x7f3290159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:35.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.151+0000 7f3296d02700 1 --2- 172.21.15.49:0/1972465663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32900adca0 0x7f32900c40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:35.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.151+0000 7f3296501700 1 -- 172.21.15.49:0/1972465663 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32901544d0 msgr2=0x7f3290159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:35.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.151+0000 7f3296501700 1 --2- 172.21.15.49:0/1972465663 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32901544d0 0x7f3290159780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:35.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.151+0000 7f3296501700 1 -- 172.21.15.49:0/1972465663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32900adca0 msgr2=0x7f32900c40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:35.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.151+0000 7f3296501700 1 --2- 172.21.15.49:0/1972465663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32900adca0 0x7f32900c40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:35.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.151+0000 7f3296501700 1 -- 172.21.15.49:0/1972465663 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3288009250 con 0x7f3290066f40 2023-11-30T18:39:35.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.151+0000 7f3296d02700 1 --2- 172.21.15.49:0/1972465663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32900adca0 0x7f32900c40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:39:35.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.151+0000 7f3296501700 1 --2- 172.21.15.49:0/1972465663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3290066f40 0x7f329014cd40 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 rx=0x7f3288006d90 tx=0x7f3288015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:35.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.152+0000 7f328e7fc700 1 -- 172.21.15.49:0/1972465663 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32880116d0 con 0x7f3290066f40 2023-11-30T18:39:35.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.152+0000 7f328e7fc700 1 -- 172.21.15.49:0/1972465663 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3288011830 con 0x7f3290066f40 2023-11-30T18:39:35.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.152+0000 7f3298765700 1 -- 172.21.15.49:0/1972465663 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32900ae160 con 0x7f3290066f40 2023-11-30T18:39:35.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.152+0000 7f328e7fc700 1 -- 172.21.15.49:0/1972465663 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3288011bd0 con 0x7f3290066f40 2023-11-30T18:39:35.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.152+0000 7f3298765700 1 -- 172.21.15.49:0/1972465663 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32900a91f0 con 0x7f3290066f40 2023-11-30T18:39:35.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.153+0000 7f3298765700 1 -- 172.21.15.49:0/1972465663 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f329006c860 con 0x7f3290066f40 2023-11-30T18:39:35.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.153+0000 7f328e7fc700 1 -- 172.21.15.49:0/1972465663 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f328801d3c0 con 0x7f3290066f40 2023-11-30T18:39:35.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.153+0000 7f328e7fc700 1 --2- 172.21.15.49:0/1972465663 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f327c05f270 0x7f327c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:35.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.153+0000 7f328e7fc700 1 -- 172.21.15.49:0/1972465663 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f328807b560 con 0x7f3290066f40 2023-11-30T18:39:35.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.154+0000 7f3295d00700 1 --2- 172.21.15.49:0/1972465663 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f327c05f270 0x7f327c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:35.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.154+0000 7f3295d00700 1 --2- 172.21.15.49:0/1972465663 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f327c05f270 0x7f327c061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f32900aec10 tx=0x7f3284009040).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:35.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.158+0000 7f328e7fc700 1 -- 172.21.15.49:0/1972465663 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f328804c950 con 0x7f3290066f40 2023-11-30T18:39:35.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.333+0000 7f3298765700 1 -- 172.21.15.49:0/1972465663 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f32900680f0 con 0x7f3290066f40 2023-11-30T18:39:35.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.333+0000 7f328e7fc700 1 -- 172.21.15.49:0/1972465663 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v199) v1 ==== 84+0+143 (secure 0 0 0) 0x7f3288023020 con 0x7f3290066f40 2023-11-30T18:39:35.334 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:39:35.334 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-11-30T18:39:35.334 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:39:35.334 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2023-11-30T18:39:35.334 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "device_health_metrics" 2023-11-30T18:39:35.335 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:39:35.335 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:39:35.335 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 2, 2023-11-30T18:39:35.335 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "rbd" 2023-11-30T18:39:35.335 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:39:35.335 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-11-30T18:39:35.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.335+0000 7f3298765700 1 -- 172.21.15.49:0/1972465663 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f327c05f270 msgr2=0x7f327c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:35.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.335+0000 7f3298765700 1 --2- 172.21.15.49:0/1972465663 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f327c05f270 0x7f327c061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f32900aec10 tx=0x7f3284009040).stop 2023-11-30T18:39:35.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.335+0000 7f3298765700 1 -- 172.21.15.49:0/1972465663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3290066f40 msgr2=0x7f329014cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:35.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.335+0000 7f3298765700 1 --2- 172.21.15.49:0/1972465663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3290066f40 0x7f329014cd40 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 rx=0x7f3288006d90 tx=0x7f3288015000).stop 2023-11-30T18:39:35.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.335+0000 7f3298765700 1 -- 172.21.15.49:0/1972465663 shutdown_connections 2023-11-30T18:39:35.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.335+0000 7f3298765700 1 --2- 172.21.15.49:0/1972465663 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f327c05f270 0x7f327c061730 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:35.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.335+0000 7f3298765700 1 --2- 172.21.15.49:0/1972465663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32900adca0 0x7f32900c40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:35.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.335+0000 7f3298765700 1 --2- 172.21.15.49:0/1972465663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3290066f40 0x7f329014cd40 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:35.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.335+0000 7f3298765700 1 --2- 172.21.15.49:0/1972465663 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32901544d0 0x7f3290159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:35.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.335+0000 7f3298765700 1 -- 172.21.15.49:0/1972465663 >> 172.21.15.49:0/1972465663 conn(0x7f32900631d0 msgr2=0x7f329014eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:35.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.335+0000 7f3298765700 1 -- 172.21.15.49:0/1972465663 shutdown_connections 2023-11-30T18:39:35.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.335+0000 7f3298765700 1 -- 172.21.15.49:0/1972465663 wait complete. 2023-11-30T18:39:35.348 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-30T18:39:35.348 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-11-30T18:39:35.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.469+0000 7ff1475af700 1 Processor -- start 2023-11-30T18:39:35.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.470+0000 7ff1475af700 1 -- start start 2023-11-30T18:39:35.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.470+0000 7ff1475af700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff1400ab3b0 0x7ff1401582e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:35.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.470+0000 7ff1475af700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1400aa1c0 0x7ff1400aa600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:35.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.470+0000 7ff1475af700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff140159210 con 0x7ff140154610 2023-11-30T18:39:35.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.470+0000 7ff1475af700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1400c0c70 con 0x7ff1400ab3b0 2023-11-30T18:39:35.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.470+0000 7ff1475af700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1400c2110 con 0x7ff1400aa1c0 2023-11-30T18:39:35.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.471+0000 7ff144b4a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff1400ab3b0 0x7ff1401582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:35.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.471+0000 7ff14534b700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff140154610 0x7ff1400c80c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:54254/0 (socket says 172.21.15.49:54254) 2023-11-30T18:39:35.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.471+0000 7ff14534b700 1 -- 172.21.15.49:0/1242391749 learned_addr learned my addr 172.21.15.49:0/1242391749 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:35.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.471+0000 7ff145b4c700 1 --2- 172.21.15.49:0/1242391749 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1400aa1c0 0x7ff1400aa600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:35.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.471+0000 7ff13ffff700 1 -- 172.21.15.49:0/1242391749 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161615917 0 0) 0x7ff140159210 con 0x7ff140154610 2023-11-30T18:39:35.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.471+0000 7ff13ffff700 1 -- 172.21.15.49:0/1242391749 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1280033f0 con 0x7ff140154610 2023-11-30T18:39:35.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.471+0000 7ff144b4a700 1 -- 172.21.15.49:0/1242391749 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1400aa1c0 msgr2=0x7ff1400aa600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:35.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.471+0000 7ff144b4a700 1 --2- 172.21.15.49:0/1242391749 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1400aa1c0 0x7ff1400aa600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:35.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.471+0000 7ff144b4a700 1 -- 172.21.15.49:0/1242391749 >> v1:172.21.15.49:6789/0 conn(0x7ff140154610 legacy=0x7ff1400c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:35.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.471+0000 7ff144b4a700 1 -- 172.21.15.49:0/1242391749 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1400aaaf0 con 0x7ff1400ab3b0 2023-11-30T18:39:35.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.471+0000 7ff144b4a700 1 --2- 172.21.15.49:0/1242391749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1400ab3b0 0x7ff1401582e0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 rx=0x7ff134009760 tx=0x7ff134009060).ready entity=mon.0 client_cookie=e434fc81148b818 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:35.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.471+0000 7ff13ffff700 1 -- 172.21.15.49:0/1242391749 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13400d4a0 con 0x7ff1400ab3b0 2023-11-30T18:39:35.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.471+0000 7ff13ffff700 1 -- 172.21.15.49:0/1242391749 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13400d600 con 0x7ff1400ab3b0 2023-11-30T18:39:35.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.471+0000 7ff13ffff700 1 -- 172.21.15.49:0/1242391749 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13400d980 con 0x7ff1400ab3b0 2023-11-30T18:39:35.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.472+0000 7ff1475af700 1 -- 172.21.15.49:0/1242391749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1400ab3b0 msgr2=0x7ff1401582e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:35.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.472+0000 7ff1475af700 1 --2- 172.21.15.49:0/1242391749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1400ab3b0 0x7ff1401582e0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 rx=0x7ff134009760 tx=0x7ff134009060).stop 2023-11-30T18:39:35.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.472+0000 7ff1475af700 1 -- 172.21.15.49:0/1242391749 shutdown_connections 2023-11-30T18:39:35.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.472+0000 7ff1475af700 1 --2- 172.21.15.49:0/1242391749 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1400aa1c0 0x7ff1400aa600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:35.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.472+0000 7ff1475af700 1 --2- 172.21.15.49:0/1242391749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1400ab3b0 0x7ff1401582e0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:35.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.472+0000 7ff1475af700 1 -- 172.21.15.49:0/1242391749 >> 172.21.15.49:0/1242391749 conn(0x7ff1400655a0 msgr2=0x7ff140069e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:35.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.472+0000 7ff1475af700 1 -- 172.21.15.49:0/1242391749 shutdown_connections 2023-11-30T18:39:35.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.472+0000 7ff1475af700 1 -- 172.21.15.49:0/1242391749 wait complete. 2023-11-30T18:39:35.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.473+0000 7ff1475af700 1 Processor -- start 2023-11-30T18:39:35.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.473+0000 7ff1475af700 1 -- start start 2023-11-30T18:39:35.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.474+0000 7ff1475af700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1400aa1c0 0x7ff1400aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:35.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.474+0000 7ff1475af700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff140154610 0x7ff140168270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:35.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.474+0000 7ff1475af700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1400af090 0x7ff140156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:35.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.474+0000 7ff1475af700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1400c28a0 con 0x7ff1400af090 2023-11-30T18:39:35.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.474+0000 7ff1475af700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff140156500 con 0x7ff140154610 2023-11-30T18:39:35.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.474+0000 7ff1475af700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1400c2300 con 0x7ff1400aa1c0 2023-11-30T18:39:35.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.474+0000 7ff145b4c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1400af090 0x7ff140156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:35.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.474+0000 7ff145b4c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1400af090 0x7ff140156990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58490/0 (socket says 172.21.15.49:58490) 2023-11-30T18:39:35.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.474+0000 7ff145b4c700 1 -- 172.21.15.49:0/2233362666 learned_addr learned my addr 172.21.15.49:0/2233362666 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:35.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.474+0000 7ff14534b700 1 --2- 172.21.15.49:0/2233362666 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1400aa1c0 0x7ff1400aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:35.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.474+0000 7ff144b4a700 1 --2- 172.21.15.49:0/2233362666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff140154610 0x7ff140168270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:35.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.474+0000 7ff145b4c700 1 -- 172.21.15.49:0/2233362666 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1400aa1c0 msgr2=0x7ff1400aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:35.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.474+0000 7ff145b4c700 1 --2- 172.21.15.49:0/2233362666 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1400aa1c0 0x7ff1400aeba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:35.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.474+0000 7ff145b4c700 1 -- 172.21.15.49:0/2233362666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff140154610 msgr2=0x7ff140168270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:35.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.474+0000 7ff145b4c700 1 --2- 172.21.15.49:0/2233362666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff140154610 0x7ff140168270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:35.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.474+0000 7ff145b4c700 1 -- 172.21.15.49:0/2233362666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1340092a0 con 0x7ff1400af090 2023-11-30T18:39:35.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.474+0000 7ff144b4a700 1 --2- 172.21.15.49:0/2233362666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff140154610 0x7ff140168270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:39:35.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.475+0000 7ff145b4c700 1 --2- 172.21.15.49:0/2233362666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1400af090 0x7ff140156990 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 rx=0x7ff13000e930 tx=0x7ff130009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:35.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.475+0000 7ff13d7fa700 1 -- 172.21.15.49:0/2233362666 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13000c640 con 0x7ff1400af090 2023-11-30T18:39:35.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.475+0000 7ff13d7fa700 1 -- 172.21.15.49:0/2233362666 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13000c7a0 con 0x7ff1400af090 2023-11-30T18:39:35.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.475+0000 7ff1475af700 1 -- 172.21.15.49:0/2233362666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1400ae880 con 0x7ff1400af090 2023-11-30T18:39:35.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.475+0000 7ff13d7fa700 1 -- 172.21.15.49:0/2233362666 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13000cb20 con 0x7ff1400af090 2023-11-30T18:39:35.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.475+0000 7ff1475af700 1 -- 172.21.15.49:0/2233362666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1400ae4a0 con 0x7ff1400af090 2023-11-30T18:39:35.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.476+0000 7ff1475af700 1 -- 172.21.15.49:0/2233362666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff14006c860 con 0x7ff1400af090 2023-11-30T18:39:35.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.476+0000 7ff13d7fa700 1 -- 172.21.15.49:0/2233362666 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff13001b400 con 0x7ff1400af090 2023-11-30T18:39:35.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.477+0000 7ff13d7fa700 1 --2- 172.21.15.49:0/2233362666 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff12c05f240 0x7ff12c061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:35.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.477+0000 7ff13d7fa700 1 -- 172.21.15.49:0/2233362666 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5353+0+0 (secure 0 0 0) 0x7ff13007a4f0 con 0x7ff1400af090 2023-11-30T18:39:35.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.477+0000 7ff14534b700 1 --2- 172.21.15.49:0/2233362666 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff12c05f240 0x7ff12c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:35.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.477+0000 7ff14534b700 1 --2- 172.21.15.49:0/2233362666 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff12c05f240 0x7ff12c061700 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7ff138005ad0 tx=0x7ff138009040).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:35.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.481+0000 7ff13d7fa700 1 -- 172.21.15.49:0/2233362666 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff13004b8e0 con 0x7ff1400af090 2023-11-30T18:39:35.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.653+0000 7ff1475af700 1 -- 172.21.15.49:0/2233362666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7ff1400c0540 con 0x7ff1400af090 2023-11-30T18:39:35.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.923+0000 7ff13d7fa700 1 -- 172.21.15.49:0/2233362666 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v200) v1 ==== 152+0+0 (secure 0 0 0) 0x7ff1300160c0 con 0x7ff1400af090 2023-11-30T18:39:35.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.927+0000 7ff1475af700 1 -- 172.21.15.49:0/2233362666 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff12c05f240 msgr2=0x7ff12c061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:35.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.927+0000 7ff1475af700 1 --2- 172.21.15.49:0/2233362666 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff12c05f240 0x7ff12c061700 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7ff138005ad0 tx=0x7ff138009040).stop 2023-11-30T18:39:35.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.927+0000 7ff1475af700 1 -- 172.21.15.49:0/2233362666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1400af090 msgr2=0x7ff140156990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:35.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.927+0000 7ff1475af700 1 --2- 172.21.15.49:0/2233362666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1400af090 0x7ff140156990 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 rx=0x7ff13000e930 tx=0x7ff130009060).stop 2023-11-30T18:39:35.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.929+0000 7ff1475af700 1 -- 172.21.15.49:0/2233362666 shutdown_connections 2023-11-30T18:39:35.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.929+0000 7ff1475af700 1 --2- 172.21.15.49:0/2233362666 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff12c05f240 0x7ff12c061700 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:35.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.929+0000 7ff1475af700 1 --2- 172.21.15.49:0/2233362666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1400af090 0x7ff140156990 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:35.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.929+0000 7ff1475af700 1 --2- 172.21.15.49:0/2233362666 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1400aa1c0 0x7ff1400aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:35.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.929+0000 7ff1475af700 1 --2- 172.21.15.49:0/2233362666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff140154610 0x7ff140168270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:35.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.929+0000 7ff1475af700 1 -- 172.21.15.49:0/2233362666 >> 172.21.15.49:0/2233362666 conn(0x7ff1400655a0 msgr2=0x7ff1400ad7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:35.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.930+0000 7ff1475af700 1 -- 172.21.15.49:0/2233362666 shutdown_connections 2023-11-30T18:39:35.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:35.931+0000 7ff1475af700 1 -- 172.21.15.49:0/2233362666 wait complete. 2023-11-30T18:39:35.933 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2023-11-30T18:39:35.945 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-30T18:39:36.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.070+0000 7fe08759e700 1 Processor -- start 2023-11-30T18:39:36.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.070+0000 7fe08759e700 1 -- start start 2023-11-30T18:39:36.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.071+0000 7fe08759e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe08814e530 0x7fe0880c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:36.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.071+0000 7fe08759e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe088154950 0x7fe08814e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:36.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.071+0000 7fe08759e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0880c7bc0 con 0x7fe088158570 2023-11-30T18:39:36.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.071+0000 7fe08759e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe088155920 con 0x7fe08814e530 2023-11-30T18:39:36.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.071+0000 7fe08759e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe088154dd0 con 0x7fe088154950 2023-11-30T18:39:36.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.071+0000 7fe085d9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe088154950 0x7fe08814e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:36.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.071+0000 7fe08659c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe08814e530 0x7fe0880c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:36.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.071+0000 7fe085d9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe088154950 0x7fe08814e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:59336/0 (socket says 172.21.15.49:59336) 2023-11-30T18:39:36.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.071+0000 7fe08659c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe08814e530 0x7fe0880c66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:53450/0 (socket says 172.21.15.49:53450) 2023-11-30T18:39:36.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.071+0000 7fe085d9b700 1 -- 172.21.15.49:0/3218643142 learned_addr learned my addr 172.21.15.49:0/3218643142 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:36.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.071+0000 7fe086d9d700 1 --1- 172.21.15.49:0/3218643142 >> v1:172.21.15.115:6789/0 conn(0x7fe088158570 0x7fe0880aa030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:51164/0 (socket says 172.21.15.49:51164) 2023-11-30T18:39:36.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.072+0000 7fe085d9b700 1 -- 172.21.15.49:0/3218643142 >> v2:172.21.15.115:3300/0 conn(0x7fe08814e530 msgr2=0x7fe0880c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:36.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.072+0000 7fe085d9b700 1 --2- 172.21.15.49:0/3218643142 >> v2:172.21.15.115:3300/0 conn(0x7fe08814e530 0x7fe0880c66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:36.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.072+0000 7fe085d9b700 1 -- 172.21.15.49:0/3218643142 >> v1:172.21.15.115:6789/0 conn(0x7fe088158570 legacy=0x7fe0880aa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:36.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.072+0000 7fe085d9b700 1 -- 172.21.15.49:0/3218643142 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe088155080 con 0x7fe088154950 2023-11-30T18:39:36.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.072+0000 7fe08659c700 1 --2- 172.21.15.49:0/3218643142 >> v2:172.21.15.115:3300/0 conn(0x7fe08814e530 0x7fe0880c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:39:36.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.072+0000 7fe08559a700 1 -- 172.21.15.49:0/3218643142 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4157688947 0 0) 0x7fe0880c7bc0 con 0x7fe088158570 2023-11-30T18:39:36.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.072+0000 7fe085d9b700 1 --2- 172.21.15.49:0/3218643142 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe088154950 0x7fe08814e910 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fe070006fd0 tx=0x7fe0700090f0).ready entity=mon.2 client_cookie=1eb2d8a1e48de5f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:36.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.072+0000 7fe08559a700 1 -- 172.21.15.49:0/3218643142 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07000b580 con 0x7fe088154950 2023-11-30T18:39:36.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.072+0000 7fe08559a700 1 -- 172.21.15.49:0/3218643142 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07000b6e0 con 0x7fe088154950 2023-11-30T18:39:36.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.072+0000 7fe08559a700 1 -- 172.21.15.49:0/3218643142 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07000ba80 con 0x7fe088154950 2023-11-30T18:39:36.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.073+0000 7fe08759e700 1 -- 172.21.15.49:0/3218643142 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe088154950 msgr2=0x7fe08814e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:36.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.073+0000 7fe08759e700 1 --2- 172.21.15.49:0/3218643142 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe088154950 0x7fe08814e910 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fe070006fd0 tx=0x7fe0700090f0).stop 2023-11-30T18:39:36.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.073+0000 7fe08759e700 1 -- 172.21.15.49:0/3218643142 shutdown_connections 2023-11-30T18:39:36.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.073+0000 7fe08759e700 1 --2- 172.21.15.49:0/3218643142 >> v2:172.21.15.115:3300/0 conn(0x7fe08814e530 0x7fe0880c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:36.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.073+0000 7fe08759e700 1 --2- 172.21.15.49:0/3218643142 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe088154950 0x7fe08814e910 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:36.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.073+0000 7fe08759e700 1 -- 172.21.15.49:0/3218643142 >> 172.21.15.49:0/3218643142 conn(0x7fe088064990 msgr2=0x7fe088064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:36.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.073+0000 7fe08759e700 1 -- 172.21.15.49:0/3218643142 shutdown_connections 2023-11-30T18:39:36.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.073+0000 7fe08759e700 1 -- 172.21.15.49:0/3218643142 wait complete. 2023-11-30T18:39:36.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.074+0000 7fe08759e700 1 Processor -- start 2023-11-30T18:39:36.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.074+0000 7fe08759e700 1 -- start start 2023-11-30T18:39:36.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.075+0000 7fe08759e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe08814e530 0x7fe0880c4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:36.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.075+0000 7fe08759e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe088154950 0x7fe0880c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:36.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.075+0000 7fe08759e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe088158570 0x7fe088155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:36.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.075+0000 7fe08759e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe088165ad0 con 0x7fe088158570 2023-11-30T18:39:36.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.075+0000 7fe08759e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe088165780 con 0x7fe088154950 2023-11-30T18:39:36.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.075+0000 7fe08759e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0880b0180 con 0x7fe08814e530 2023-11-30T18:39:36.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.075+0000 7fe08659c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe08814e530 0x7fe0880c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:36.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.075+0000 7fe086d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe088158570 0x7fe088155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:36.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.075+0000 7fe085d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe088154950 0x7fe0880c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:36.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.075+0000 7fe08659c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe08814e530 0x7fe0880c4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:59352/0 (socket says 172.21.15.49:59352) 2023-11-30T18:39:36.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.075+0000 7fe08659c700 1 -- 172.21.15.49:0/2736925426 learned_addr learned my addr 172.21.15.49:0/2736925426 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:36.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.075+0000 7fe08659c700 1 -- 172.21.15.49:0/2736925426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe088154950 msgr2=0x7fe0880c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:36.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.075+0000 7fe08659c700 1 --2- 172.21.15.49:0/2736925426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe088154950 0x7fe0880c98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:36.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.075+0000 7fe08659c700 1 -- 172.21.15.49:0/2736925426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe088158570 msgr2=0x7fe088155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:36.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.075+0000 7fe08659c700 1 --2- 172.21.15.49:0/2736925426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe088158570 0x7fe088155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:36.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.075+0000 7fe08659c700 1 -- 172.21.15.49:0/2736925426 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe080009a20 con 0x7fe08814e530 2023-11-30T18:39:36.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.075+0000 7fe08659c700 1 --2- 172.21.15.49:0/2736925426 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe08814e530 0x7fe0880c4890 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fe08000c170 tx=0x7fe08000b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:36.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.075+0000 7fe07e7fc700 1 -- 172.21.15.49:0/2736925426 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe080009d80 con 0x7fe08814e530 2023-11-30T18:39:36.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.076+0000 7fe07e7fc700 1 -- 172.21.15.49:0/2736925426 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08000f040 con 0x7fe08814e530 2023-11-30T18:39:36.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.076+0000 7fe08759e700 1 -- 172.21.15.49:0/2736925426 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe070009370 con 0x7fe08814e530 2023-11-30T18:39:36.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.076+0000 7fe07e7fc700 1 -- 172.21.15.49:0/2736925426 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08000cec0 con 0x7fe08814e530 2023-11-30T18:39:36.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.076+0000 7fe08759e700 1 -- 172.21.15.49:0/2736925426 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0880b0720 con 0x7fe08814e530 2023-11-30T18:39:36.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.077+0000 7fe08759e700 1 -- 172.21.15.49:0/2736925426 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe088165d40 con 0x7fe08814e530 2023-11-30T18:39:36.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.077+0000 7fe07e7fc700 1 -- 172.21.15.49:0/2736925426 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe080013610 con 0x7fe08814e530 2023-11-30T18:39:36.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.077+0000 7fe07e7fc700 1 --2- 172.21.15.49:0/2736925426 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe06805f270 0x7fe068061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:36.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.077+0000 7fe07e7fc700 1 -- 172.21.15.49:0/2736925426 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5723+0+0 (secure 0 0 0) 0x7fe08007aac0 con 0x7fe08814e530 2023-11-30T18:39:36.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.078+0000 7fe085d9b700 1 --2- 172.21.15.49:0/2736925426 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe06805f270 0x7fe068061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:36.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.078+0000 7fe085d9b700 1 --2- 172.21.15.49:0/2736925426 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe06805f270 0x7fe068061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fe07000b340 tx=0x7fe070017000).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:36.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.082+0000 7fe07e7fc700 1 -- 172.21.15.49:0/2736925426 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe08004f7d0 con 0x7fe08814e530 2023-11-30T18:39:36.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.256+0000 7fe08759e700 1 -- 172.21.15.49:0/2736925426 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe088062ee0 con 0x7fe08814e530 2023-11-30T18:39:36.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.932+0000 7fe07e7fc700 1 -- 172.21.15.49:0/2736925426 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v201) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe08004f3c0 con 0x7fe08814e530 2023-11-30T18:39:36.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.947+0000 7fe08759e700 1 -- 172.21.15.49:0/2736925426 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe06805f270 msgr2=0x7fe068061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:36.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.947+0000 7fe08759e700 1 --2- 172.21.15.49:0/2736925426 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe06805f270 0x7fe068061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fe07000b340 tx=0x7fe070017000).stop 2023-11-30T18:39:36.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.947+0000 7fe08759e700 1 -- 172.21.15.49:0/2736925426 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe08814e530 msgr2=0x7fe0880c4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:36.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.947+0000 7fe08759e700 1 --2- 172.21.15.49:0/2736925426 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe08814e530 0x7fe0880c4890 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fe08000c170 tx=0x7fe08000b040).stop 2023-11-30T18:39:36.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.947+0000 7fe08759e700 1 -- 172.21.15.49:0/2736925426 shutdown_connections 2023-11-30T18:39:36.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.947+0000 7fe08759e700 1 --2- 172.21.15.49:0/2736925426 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe06805f270 0x7fe068061730 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:36.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.947+0000 7fe08759e700 1 --2- 172.21.15.49:0/2736925426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe088158570 0x7fe088155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:36.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.947+0000 7fe08759e700 1 --2- 172.21.15.49:0/2736925426 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe08814e530 0x7fe0880c4890 secure :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0x7fe08000c170 tx=0x7fe08000b040).stop 2023-11-30T18:39:36.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.947+0000 7fe08759e700 1 --2- 172.21.15.49:0/2736925426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe088154950 0x7fe0880c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:36.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.947+0000 7fe08759e700 1 -- 172.21.15.49:0/2736925426 >> 172.21.15.49:0/2736925426 conn(0x7fe088064990 msgr2=0x7fe0880c03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:36.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.950+0000 7fe08759e700 1 -- 172.21.15.49:0/2736925426 shutdown_connections 2023-11-30T18:39:36.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:36.951+0000 7fe08759e700 1 -- 172.21.15.49:0/2736925426 wait complete. 2023-11-30T18:39:36.954 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2023-11-30T18:39:36.968 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-30T18:39:37.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.091+0000 7f8f655a4700 1 Processor -- start 2023-11-30T18:39:37.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.091+0000 7f8f655a4700 1 -- start start 2023-11-30T18:39:37.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.092+0000 7f8f655a4700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8f600c6190 0x7f8f600c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:37.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.092+0000 7f8f655a4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f60158320 0x7f8f601587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:37.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.092+0000 7f8f655a4700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f60158cc0 con 0x7f8f60098d10 2023-11-30T18:39:37.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.092+0000 7f8f655a4700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f600c72d0 con 0x7f8f600c6190 2023-11-30T18:39:37.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.092+0000 7f8f655a4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f60064570 con 0x7f8f60158320 2023-11-30T18:39:37.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.092+0000 7f8f5effd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8f60098d10 0x7f8f60063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:54256/0 (socket says 172.21.15.49:54256) 2023-11-30T18:39:37.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.092+0000 7f8f5effd700 1 -- 172.21.15.49:0/3391811175 learned_addr learned my addr 172.21.15.49:0/3391811175 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:37.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.092+0000 7f8f5dffb700 1 -- 172.21.15.49:0/3391811175 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2838110339 0 0) 0x7f8f50001110 con 0x7f8f60098d10 2023-11-30T18:39:37.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.092+0000 7f8f5f7fe700 1 --2- 172.21.15.49:0/3391811175 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f60158320 0x7f8f601587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:37.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.092+0000 7f8f5e7fc700 1 --2- 172.21.15.49:0/3391811175 >> v2:172.21.15.115:3300/0 conn(0x7f8f600c6190 0x7f8f600c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:37.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.092+0000 7f8f5dffb700 1 -- 172.21.15.49:0/3391811175 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f480033f0 con 0x7f8f60098d10 2023-11-30T18:39:37.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.092+0000 7f8f5dffb700 1 -- 172.21.15.49:0/3391811175 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1328090311 0 0) 0x7f8f480033f0 con 0x7f8f60098d10 2023-11-30T18:39:37.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.092+0000 7f8f5dffb700 1 -- 172.21.15.49:0/3391811175 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f60158320 msgr2=0x7f8f601587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:37.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.092+0000 7f8f5dffb700 1 --2- 172.21.15.49:0/3391811175 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f60158320 0x7f8f601587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:37.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.092+0000 7f8f5dffb700 1 -- 172.21.15.49:0/3391811175 >> v2:172.21.15.115:3300/0 conn(0x7f8f600c6190 msgr2=0x7f8f600c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:37.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.092+0000 7f8f5dffb700 1 --2- 172.21.15.49:0/3391811175 >> v2:172.21.15.115:3300/0 conn(0x7f8f600c6190 0x7f8f600c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:37.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.092+0000 7f8f5dffb700 1 -- 172.21.15.49:0/3391811175 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f60154bc0 con 0x7f8f60098d10 2023-11-30T18:39:37.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.092+0000 7f8f5dffb700 1 -- 172.21.15.49:0/3391811175 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f8f50001600 con 0x7f8f60098d10 2023-11-30T18:39:37.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.092+0000 7f8f5dffb700 1 -- 172.21.15.49:0/3391811175 >> v1:172.21.15.49:6789/0 conn(0x7f8f60098d10 legacy=0x7f8f60063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:37.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.092+0000 7f8f5dffb700 1 --2- 172.21.15.49:0/3391811175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f480038e0 0x7f8f48003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:37.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.092+0000 7f8f5dffb700 1 --2- 172.21.15.49:0/3391811175 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f60158320 0x7f8f48004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:37.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.093+0000 7f8f5dffb700 1 --2- 172.21.15.49:0/3391811175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f48004b80 0x7f8f48005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:37.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.093+0000 7f8f5dffb700 1 -- 172.21.15.49:0/3391811175 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f600c72d0 con 0x7f8f480038e0 2023-11-30T18:39:37.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.093+0000 7f8f5dffb700 1 -- 172.21.15.49:0/3391811175 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f60064570 con 0x7f8f48004b80 2023-11-30T18:39:37.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.093+0000 7f8f5dffb700 1 -- 172.21.15.49:0/3391811175 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4800b8e0 con 0x7f8f60158320 2023-11-30T18:39:37.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.093+0000 7f8f5effd700 1 --2- 172.21.15.49:0/3391811175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f480038e0 0x7f8f48003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:37.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.093+0000 7f8f5e7fc700 1 --2- 172.21.15.49:0/3391811175 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f60158320 0x7f8f48004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:37.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.093+0000 7f8f5f7fe700 1 --2- 172.21.15.49:0/3391811175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f48004b80 0x7f8f48005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:37.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.093+0000 7f8f5effd700 1 -- 172.21.15.49:0/3391811175 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f60158320 msgr2=0x7f8f48004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:37.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.093+0000 7f8f5effd700 1 --2- 172.21.15.49:0/3391811175 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f60158320 0x7f8f48004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:37.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.093+0000 7f8f5effd700 1 -- 172.21.15.49:0/3391811175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f48004b80 msgr2=0x7f8f48005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:37.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.093+0000 7f8f5effd700 1 --2- 172.21.15.49:0/3391811175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f48004b80 0x7f8f48005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:37.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.093+0000 7f8f5effd700 1 -- 172.21.15.49:0/3391811175 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f480033f0 con 0x7f8f480038e0 2023-11-30T18:39:37.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.093+0000 7f8f5f7fe700 1 --2- 172.21.15.49:0/3391811175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f48004b80 0x7f8f48005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:39:37.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.093+0000 7f8f5effd700 1 --2- 172.21.15.49:0/3391811175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f480038e0 0x7f8f48003d00 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 rx=0x7f8f5000c3c0 tx=0x7f8f600a8040).ready entity=mon.0 client_cookie=18b88e8116458f4c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:37.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.093+0000 7f8f5dffb700 1 -- 172.21.15.49:0/3391811175 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f50007be0 con 0x7f8f480038e0 2023-11-30T18:39:37.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.093+0000 7f8f5dffb700 1 -- 172.21.15.49:0/3391811175 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5000cc90 con 0x7f8f480038e0 2023-11-30T18:39:37.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.093+0000 7f8f5dffb700 1 -- 172.21.15.49:0/3391811175 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f50007300 con 0x7f8f480038e0 2023-11-30T18:39:37.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.094+0000 7f8f655a4700 1 -- 172.21.15.49:0/3391811175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f480038e0 msgr2=0x7f8f48003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:37.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.094+0000 7f8f655a4700 1 --2- 172.21.15.49:0/3391811175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f480038e0 0x7f8f48003d00 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 rx=0x7f8f5000c3c0 tx=0x7f8f600a8040).stop 2023-11-30T18:39:37.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.094+0000 7f8f5f7fe700 1 -- 172.21.15.49:0/3391811175 reap_dead start 2023-11-30T18:39:37.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.094+0000 7f8f655a4700 1 -- 172.21.15.49:0/3391811175 shutdown_connections 2023-11-30T18:39:37.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.094+0000 7f8f655a4700 1 -- 172.21.15.49:0/3391811175 >> 172.21.15.49:0/3391811175 conn(0x7f8f600cb310 msgr2=0x7f8f600cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:37.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.094+0000 7f8f655a4700 1 -- 172.21.15.49:0/3391811175 shutdown_connections 2023-11-30T18:39:37.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.094+0000 7f8f655a4700 1 -- 172.21.15.49:0/3391811175 wait complete. 2023-11-30T18:39:37.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.095+0000 7f8f655a4700 1 Processor -- start 2023-11-30T18:39:37.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.095+0000 7f8f655a4700 1 -- start start 2023-11-30T18:39:37.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.096+0000 7f8f655a4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f600b0e20 0x7f8f600ab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:37.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.096+0000 7f8f655a4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f600ac1b0 0x7f8f600c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:37.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.096+0000 7f8f655a4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f600c4a70 0x7f8f600c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:37.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.096+0000 7f8f655a4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f600aed60 con 0x7f8f600c4a70 2023-11-30T18:39:37.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.096+0000 7f8f655a4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f600aea60 con 0x7f8f600ac1b0 2023-11-30T18:39:37.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.096+0000 7f8f655a4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f600c4ef0 con 0x7f8f600b0e20 2023-11-30T18:39:37.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.096+0000 7f8f5f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f600c4a70 0x7f8f600c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:37.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.096+0000 7f8f5f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f600c4a70 0x7f8f600c7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58510/0 (socket says 172.21.15.49:58510) 2023-11-30T18:39:37.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.096+0000 7f8f5f7fe700 1 -- 172.21.15.49:0/1333381357 learned_addr learned my addr 172.21.15.49:0/1333381357 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:37.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.096+0000 7f8f5effd700 1 --2- 172.21.15.49:0/1333381357 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f600b0e20 0x7f8f600ab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:37.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.096+0000 7f8f5e7fc700 1 --2- 172.21.15.49:0/1333381357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f600ac1b0 0x7f8f600c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:37.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.096+0000 7f8f5f7fe700 1 -- 172.21.15.49:0/1333381357 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f600b0e20 msgr2=0x7f8f600ab9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:37.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.096+0000 7f8f5f7fe700 1 --2- 172.21.15.49:0/1333381357 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f600b0e20 0x7f8f600ab9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:37.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.096+0000 7f8f5f7fe700 1 -- 172.21.15.49:0/1333381357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f600ac1b0 msgr2=0x7f8f600c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:37.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.096+0000 7f8f5f7fe700 1 --2- 172.21.15.49:0/1333381357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f600ac1b0 0x7f8f600c4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:37.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.096+0000 7f8f5f7fe700 1 -- 172.21.15.49:0/1333381357 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f600aca90 con 0x7f8f600c4a70 2023-11-30T18:39:37.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.096+0000 7f8f5f7fe700 1 --2- 172.21.15.49:0/1333381357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f600c4a70 0x7f8f600c7d10 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 rx=0x7f8f58009f80 tx=0x7f8f5800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:37.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.096+0000 7f8f46ffd700 1 -- 172.21.15.49:0/1333381357 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5800e030 con 0x7f8f600c4a70 2023-11-30T18:39:37.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.097+0000 7f8f46ffd700 1 -- 172.21.15.49:0/1333381357 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5800f040 con 0x7f8f600c4a70 2023-11-30T18:39:37.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.097+0000 7f8f655a4700 1 -- 172.21.15.49:0/1333381357 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f600acd70 con 0x7f8f600c4a70 2023-11-30T18:39:37.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.097+0000 7f8f46ffd700 1 -- 172.21.15.49:0/1333381357 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f58010db0 con 0x7f8f600c4a70 2023-11-30T18:39:37.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.097+0000 7f8f655a4700 1 -- 172.21.15.49:0/1333381357 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f600ad050 con 0x7f8f600c4a70 2023-11-30T18:39:37.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.098+0000 7f8f655a4700 1 -- 172.21.15.49:0/1333381357 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f600b1440 con 0x7f8f600c4a70 2023-11-30T18:39:37.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.098+0000 7f8f46ffd700 1 -- 172.21.15.49:0/1333381357 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8f58015690 con 0x7f8f600c4a70 2023-11-30T18:39:37.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.099+0000 7f8f46ffd700 1 --2- 172.21.15.49:0/1333381357 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f8f4c05f270 0x7f8f4c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:37.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.099+0000 7f8f46ffd700 1 -- 172.21.15.49:0/1333381357 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f8f5807ba50 con 0x7f8f600c4a70 2023-11-30T18:39:37.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.099+0000 7f8f5effd700 1 --2- 172.21.15.49:0/1333381357 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f8f4c05f270 0x7f8f4c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:37.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.099+0000 7f8f5effd700 1 --2- 172.21.15.49:0/1333381357 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f8f4c05f270 0x7f8f4c061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f8f60084960 tx=0x7f8f50015000).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:37.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.103+0000 7f8f46ffd700 1 -- 172.21.15.49:0/1333381357 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8f5804cc70 con 0x7f8f600c4a70 2023-11-30T18:39:37.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.319+0000 7f8f655a4700 1 -- 172.21.15.49:0/1333381357 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8f600ae8c0 con 0x7f8f600c4a70 2023-11-30T18:39:37.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.326+0000 7f8f46ffd700 1 -- 172.21.15.49:0/1333381357 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 23 and data pool 24 v81) v1 ==== 174+0+0 (secure 0 0 0) 0x7f8f600ae8c0 con 0x7f8f600c4a70 2023-11-30T18:39:37.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.337+0000 7f8f655a4700 1 -- 172.21.15.49:0/1333381357 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f8f4c05f270 msgr2=0x7f8f4c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:37.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.337+0000 7f8f655a4700 1 --2- 172.21.15.49:0/1333381357 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f8f4c05f270 0x7f8f4c061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f8f60084960 tx=0x7f8f50015000).stop 2023-11-30T18:39:37.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.337+0000 7f8f655a4700 1 -- 172.21.15.49:0/1333381357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f600c4a70 msgr2=0x7f8f600c7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:37.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.337+0000 7f8f655a4700 1 --2- 172.21.15.49:0/1333381357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f600c4a70 0x7f8f600c7d10 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 rx=0x7f8f58009f80 tx=0x7f8f5800b040).stop 2023-11-30T18:39:37.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.337+0000 7f8f655a4700 1 -- 172.21.15.49:0/1333381357 shutdown_connections 2023-11-30T18:39:37.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.337+0000 7f8f655a4700 1 --2- 172.21.15.49:0/1333381357 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f8f4c05f270 0x7f8f4c061730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:37.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.337+0000 7f8f655a4700 1 --2- 172.21.15.49:0/1333381357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f600c4a70 0x7f8f600c7d10 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:37.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.337+0000 7f8f655a4700 1 --2- 172.21.15.49:0/1333381357 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8f600b0e20 0x7f8f600ab9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:37.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.337+0000 7f8f655a4700 1 --2- 172.21.15.49:0/1333381357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f600ac1b0 0x7f8f600c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:37.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.337+0000 7f8f655a4700 1 -- 172.21.15.49:0/1333381357 >> 172.21.15.49:0/1333381357 conn(0x7f8f600cb310 msgr2=0x7f8f60153250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:37.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.338+0000 7f8f655a4700 1 -- 172.21.15.49:0/1333381357 shutdown_connections 2023-11-30T18:39:37.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.338+0000 7f8f655a4700 1 -- 172.21.15.49:0/1333381357 wait complete. 2023-11-30T18:39:37.350 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 23 and data pool 24 2023-11-30T18:39:37.361 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:39:37.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.478+0000 7f73d58fc700 1 Processor -- start 2023-11-30T18:39:37.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.478+0000 7f73d58fc700 1 -- start start 2023-11-30T18:39:37.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.478+0000 7f73d58fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f73d0066e00 0x7f73d00671e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:37.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.478+0000 7f73d58fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f73d0067980 0x7f73d0067df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:37.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.478+0000 7f73d58fc700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d00bd590 con 0x7f73d0155e40 2023-11-30T18:39:37.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.478+0000 7f73d58fc700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d00a6090 con 0x7f73d0067980 2023-11-30T18:39:37.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.478+0000 7f73d58fc700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d00682e0 con 0x7f73d0066e00 2023-11-30T18:39:37.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.479+0000 7f73cf7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f73d0067980 0x7f73d0067df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:37.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.479+0000 7f73ce7fc700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f73d0155e40 0x7f73d00a5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:54270/0 (socket says 172.21.15.49:54270) 2023-11-30T18:39:37.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.479+0000 7f73ce7fc700 1 -- 172.21.15.49:0/2854041886 learned_addr learned my addr 172.21.15.49:0/2854041886 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:37.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.479+0000 7f73ceffd700 1 --2- 172.21.15.49:0/2854041886 >> v2:172.21.15.115:3300/0 conn(0x7f73d0066e00 0x7f73d00671e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:37.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.479+0000 7f73cf7fe700 1 -- 172.21.15.49:0/2854041886 >> v2:172.21.15.115:3300/0 conn(0x7f73d0066e00 msgr2=0x7f73d00671e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:37.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.479+0000 7f73cf7fe700 1 --2- 172.21.15.49:0/2854041886 >> v2:172.21.15.115:3300/0 conn(0x7f73d0066e00 0x7f73d00671e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:37.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.479+0000 7f73cf7fe700 1 -- 172.21.15.49:0/2854041886 >> v1:172.21.15.49:6789/0 conn(0x7f73d0155e40 legacy=0x7f73d00a5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:37.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.479+0000 7f73cf7fe700 1 -- 172.21.15.49:0/2854041886 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d0156370 con 0x7f73d0067980 2023-11-30T18:39:37.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.479+0000 7f73cdffb700 1 -- 172.21.15.49:0/2854041886 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669036608 0 0) 0x7f73d00bd590 con 0x7f73d0155e40 2023-11-30T18:39:37.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.479+0000 7f73ceffd700 1 --2- 172.21.15.49:0/2854041886 >> v2:172.21.15.115:3300/0 conn(0x7f73d0066e00 0x7f73d00671e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:39:37.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.479+0000 7f73cf7fe700 1 --2- 172.21.15.49:0/2854041886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73d0067980 0x7f73d0067df0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 rx=0x7f73d006a8b0 tx=0x7f73c0009060).ready entity=mon.0 client_cookie=39d377c56d6b6e34 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:37.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.479+0000 7f73cdffb700 1 -- 172.21.15.49:0/2854041886 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c000b580 con 0x7f73d0067980 2023-11-30T18:39:37.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.479+0000 7f73cdffb700 1 -- 172.21.15.49:0/2854041886 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c000b6e0 con 0x7f73d0067980 2023-11-30T18:39:37.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.479+0000 7f73cdffb700 1 -- 172.21.15.49:0/2854041886 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c000ba60 con 0x7f73d0067980 2023-11-30T18:39:37.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.480+0000 7f73d58fc700 1 -- 172.21.15.49:0/2854041886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73d0067980 msgr2=0x7f73d0067df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:37.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.480+0000 7f73d58fc700 1 --2- 172.21.15.49:0/2854041886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73d0067980 0x7f73d0067df0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 rx=0x7f73d006a8b0 tx=0x7f73c0009060).stop 2023-11-30T18:39:37.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.480+0000 7f73d58fc700 1 -- 172.21.15.49:0/2854041886 shutdown_connections 2023-11-30T18:39:37.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.480+0000 7f73d58fc700 1 --2- 172.21.15.49:0/2854041886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73d0067980 0x7f73d0067df0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:37.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.480+0000 7f73d58fc700 1 --2- 172.21.15.49:0/2854041886 >> v2:172.21.15.115:3300/0 conn(0x7f73d0066e00 0x7f73d00671e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:37.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.480+0000 7f73d58fc700 1 -- 172.21.15.49:0/2854041886 >> 172.21.15.49:0/2854041886 conn(0x7f73d00c7fd0 msgr2=0x7f73d00c83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:37.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.480+0000 7f73d58fc700 1 -- 172.21.15.49:0/2854041886 shutdown_connections 2023-11-30T18:39:37.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.480+0000 7f73d58fc700 1 -- 172.21.15.49:0/2854041886 wait complete. 2023-11-30T18:39:37.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.481+0000 7f73d58fc700 1 Processor -- start 2023-11-30T18:39:37.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.481+0000 7f73d58fc700 1 -- start start 2023-11-30T18:39:37.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.482+0000 7f73d58fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73d0066e00 0x7f73d00ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:37.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.482+0000 7f73d58fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73d0067980 0x7f73d00aa030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:37.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.482+0000 7f73d58fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73d0155e40 0x7f73d00abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:37.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.482+0000 7f73d58fc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d00aac10 con 0x7f73d0067980 2023-11-30T18:39:37.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.482+0000 7f73d58fc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d00ab7c0 con 0x7f73d0155e40 2023-11-30T18:39:37.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.482+0000 7f73d58fc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d00aa930 con 0x7f73d0066e00 2023-11-30T18:39:37.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.482+0000 7f73ce7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73d0067980 0x7f73d00aa030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:37.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.482+0000 7f73ce7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73d0067980 0x7f73d00aa030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58524/0 (socket says 172.21.15.49:58524) 2023-11-30T18:39:37.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.482+0000 7f73ce7fc700 1 -- 172.21.15.49:0/2830253851 learned_addr learned my addr 172.21.15.49:0/2830253851 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:37.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.482+0000 7f73cf7fe700 1 --2- 172.21.15.49:0/2830253851 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73d0155e40 0x7f73d00abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:37.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.482+0000 7f73ceffd700 1 --2- 172.21.15.49:0/2830253851 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73d0066e00 0x7f73d00ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:37.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.482+0000 7f73ce7fc700 1 -- 172.21.15.49:0/2830253851 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73d0066e00 msgr2=0x7f73d00ad8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:37.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.482+0000 7f73ce7fc700 1 --2- 172.21.15.49:0/2830253851 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73d0066e00 0x7f73d00ad8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:37.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.482+0000 7f73ce7fc700 1 -- 172.21.15.49:0/2830253851 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73d0155e40 msgr2=0x7f73d00abbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:37.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.482+0000 7f73ce7fc700 1 --2- 172.21.15.49:0/2830253851 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73d0155e40 0x7f73d00abbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:37.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.482+0000 7f73ce7fc700 1 -- 172.21.15.49:0/2830253851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c00092a0 con 0x7f73d0067980 2023-11-30T18:39:37.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.482+0000 7f73ce7fc700 1 --2- 172.21.15.49:0/2830253851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73d0067980 0x7f73d00aa030 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 rx=0x7f73b8001eb0 tx=0x7f73b8007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:37.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.482+0000 7f73c6ffd700 1 -- 172.21.15.49:0/2830253851 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b80070d0 con 0x7f73d0067980 2023-11-30T18:39:37.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.483+0000 7f73c6ffd700 1 -- 172.21.15.49:0/2830253851 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b8007230 con 0x7f73d0067980 2023-11-30T18:39:37.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.483+0000 7f73d58fc700 1 -- 172.21.15.49:0/2830253851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73d00ab100 con 0x7f73d0067980 2023-11-30T18:39:37.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.483+0000 7f73c6ffd700 1 -- 172.21.15.49:0/2830253851 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b80075d0 con 0x7f73d0067980 2023-11-30T18:39:37.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.483+0000 7f73d58fc700 1 -- 172.21.15.49:0/2830253851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d00addc0 con 0x7f73d0067980 2023-11-30T18:39:37.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.484+0000 7f73d58fc700 1 -- 172.21.15.49:0/2830253851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73d00aaf60 con 0x7f73d0067980 2023-11-30T18:39:37.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.484+0000 7f73c6ffd700 1 -- 172.21.15.49:0/2830253851 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f73b8005bc0 con 0x7f73d0067980 2023-11-30T18:39:37.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.484+0000 7f73c6ffd700 1 --2- 172.21.15.49:0/2830253851 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f73b005f270 0x7f73b0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:37.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.485+0000 7f73c6ffd700 1 -- 172.21.15.49:0/2830253851 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6205+0+0 (secure 0 0 0) 0x7f73b8079d40 con 0x7f73d0067980 2023-11-30T18:39:37.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.485+0000 7f73ceffd700 1 --2- 172.21.15.49:0/2830253851 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f73b005f270 0x7f73b0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:37.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.485+0000 7f73ceffd700 1 --2- 172.21.15.49:0/2830253851 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f73b005f270 0x7f73b0061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f73c8007740 tx=0x7f73c80099d0).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:37.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.489+0000 7f73c6ffd700 1 -- 172.21.15.49:0/2830253851 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f73d00aaf60 con 0x7f73d0067980 2023-11-30T18:39:37.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.662+0000 7f73d58fc700 1 -- 172.21.15.49:0/2830253851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73d00be130 con 0x7f73d0067980 2023-11-30T18:39:37.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.662+0000 7f73c6ffd700 1 -- 172.21.15.49:0/2830253851 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v202) v1 ==== 74+0+17090 (secure 0 0 0) 0x7f73b8018030 con 0x7f73d0067980 2023-11-30T18:39:37.664 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:39:37.664 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":202,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:39:37.320047+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-11-30T18:39:35.697536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-11-30T18:39:36.299739+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:39:37.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.664+0000 7f73d58fc700 1 -- 172.21.15.49:0/2830253851 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f73b005f270 msgr2=0x7f73b0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:37.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.664+0000 7f73d58fc700 1 --2- 172.21.15.49:0/2830253851 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f73b005f270 0x7f73b0061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f73c8007740 tx=0x7f73c80099d0).stop 2023-11-30T18:39:37.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.664+0000 7f73d58fc700 1 -- 172.21.15.49:0/2830253851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73d0067980 msgr2=0x7f73d00aa030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:37.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.664+0000 7f73d58fc700 1 --2- 172.21.15.49:0/2830253851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73d0067980 0x7f73d00aa030 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 rx=0x7f73b8001eb0 tx=0x7f73b8007e90).stop 2023-11-30T18:39:37.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.664+0000 7f73d58fc700 1 -- 172.21.15.49:0/2830253851 shutdown_connections 2023-11-30T18:39:37.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.664+0000 7f73d58fc700 1 --2- 172.21.15.49:0/2830253851 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f73b005f270 0x7f73b0061730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:37.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.664+0000 7f73d58fc700 1 --2- 172.21.15.49:0/2830253851 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73d0155e40 0x7f73d00abbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:37.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.664+0000 7f73d58fc700 1 --2- 172.21.15.49:0/2830253851 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73d0066e00 0x7f73d00ad8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:37.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.664+0000 7f73d58fc700 1 --2- 172.21.15.49:0/2830253851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73d0067980 0x7f73d00aa030 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:37.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.664+0000 7f73d58fc700 1 -- 172.21.15.49:0/2830253851 >> 172.21.15.49:0/2830253851 conn(0x7f73d00c7fd0 msgr2=0x7f73d00bda20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:37.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.665+0000 7f73d58fc700 1 -- 172.21.15.49:0/2830253851 shutdown_connections 2023-11-30T18:39:37.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.665+0000 7f73d58fc700 1 -- 172.21.15.49:0/2830253851 wait complete. 2023-11-30T18:39:37.678 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:39:37.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.795+0000 7f5a41b51700 1 Processor -- start 2023-11-30T18:39:37.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.795+0000 7f5a41b51700 1 -- start start 2023-11-30T18:39:37.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.796+0000 7f5a41b51700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5a3c157660 0x7f5a3c157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:37.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.796+0000 7f5a41b51700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5a3c0c0180 0x7f5a3c1589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:37.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.796+0000 7f5a41b51700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a3c0c12c0 con 0x7f5a3c0c1750 2023-11-30T18:39:37.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.796+0000 7f5a41b51700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a3c0c06b0 con 0x7f5a3c0c0180 2023-11-30T18:39:37.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.796+0000 7f5a41b51700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a3c0c0990 con 0x7f5a3c157660 2023-11-30T18:39:37.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.796+0000 7f5a3bfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5a3c0c0180 0x7f5a3c1589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:37.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.796+0000 7f5a3bfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5a3c0c0180 0x7f5a3c1589c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58528/0 (socket says 172.21.15.49:58528) 2023-11-30T18:39:37.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.796+0000 7f5a3bfff700 1 -- 172.21.15.49:0/2435505637 learned_addr learned my addr 172.21.15.49:0/2435505637 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:37.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.796+0000 7f5a40b4f700 1 --2- 172.21.15.49:0/2435505637 >> v2:172.21.15.115:3300/0 conn(0x7f5a3c157660 0x7f5a3c157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:37.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.796+0000 7f5a3bfff700 1 -- 172.21.15.49:0/2435505637 >> v2:172.21.15.115:3300/0 conn(0x7f5a3c157660 msgr2=0x7f5a3c157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:37.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.796+0000 7f5a3bfff700 1 --2- 172.21.15.49:0/2435505637 >> v2:172.21.15.115:3300/0 conn(0x7f5a3c157660 0x7f5a3c157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:37.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.796+0000 7f5a3bfff700 1 -- 172.21.15.49:0/2435505637 >> v1:172.21.15.115:6789/0 conn(0x7f5a3c0c1750 legacy=0x7f5a3c0648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:37.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.796+0000 7f5a3bfff700 1 -- 172.21.15.49:0/2435505637 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3c0c0c70 con 0x7f5a3c0c0180 2023-11-30T18:39:37.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.796+0000 7f5a3bfff700 1 --2- 172.21.15.49:0/2435505637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a3c0c0180 0x7f5a3c1589c0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 rx=0x7f5a3c0839a0 tx=0x7f5a300090f0).ready entity=mon.0 client_cookie=4623b39f0b3d9781 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:37.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.797+0000 7f5a3b7fe700 1 -- 172.21.15.49:0/2435505637 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3000b520 con 0x7f5a3c0c0180 2023-11-30T18:39:37.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.797+0000 7f5a3b7fe700 1 -- 172.21.15.49:0/2435505637 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3000b680 con 0x7f5a3c0c0180 2023-11-30T18:39:37.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.797+0000 7f5a3b7fe700 1 -- 172.21.15.49:0/2435505637 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3000ba00 con 0x7f5a3c0c0180 2023-11-30T18:39:37.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.797+0000 7f5a41b51700 1 -- 172.21.15.49:0/2435505637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a3c0c0180 msgr2=0x7f5a3c1589c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:37.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.797+0000 7f5a41b51700 1 --2- 172.21.15.49:0/2435505637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a3c0c0180 0x7f5a3c1589c0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 rx=0x7f5a3c0839a0 tx=0x7f5a300090f0).stop 2023-11-30T18:39:37.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.797+0000 7f5a41b51700 1 -- 172.21.15.49:0/2435505637 shutdown_connections 2023-11-30T18:39:37.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.797+0000 7f5a41b51700 1 --2- 172.21.15.49:0/2435505637 >> v2:172.21.15.115:3300/0 conn(0x7f5a3c157660 0x7f5a3c157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:37.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.797+0000 7f5a41b51700 1 --2- 172.21.15.49:0/2435505637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a3c0c0180 0x7f5a3c1589c0 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:37.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.797+0000 7f5a41b51700 1 -- 172.21.15.49:0/2435505637 >> 172.21.15.49:0/2435505637 conn(0x7f5a3c0cb000 msgr2=0x7f5a3c0cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:37.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.797+0000 7f5a41b51700 1 -- 172.21.15.49:0/2435505637 shutdown_connections 2023-11-30T18:39:37.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.797+0000 7f5a41b51700 1 -- 172.21.15.49:0/2435505637 wait complete. 2023-11-30T18:39:37.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.798+0000 7f5a41b51700 1 Processor -- start 2023-11-30T18:39:37.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.799+0000 7f5a41b51700 1 -- start start 2023-11-30T18:39:37.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.799+0000 7f5a41b51700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5a3c0c0180 0x7f5a3c156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:37.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.799+0000 7f5a41b51700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a3c0c1750 0x7f5a3c1533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:37.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.799+0000 7f5a41b51700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a3c157660 0x7f5a3c154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:37.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.799+0000 7f5a41b51700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c1538a0 con 0x7f5a3c157660 2023-11-30T18:39:37.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.799+0000 7f5a41b51700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c1546c0 con 0x7f5a3c0c1750 2023-11-30T18:39:37.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.799+0000 7f5a41b51700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c153ab0 con 0x7f5a3c0c0180 2023-11-30T18:39:37.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.799+0000 7f5a41350700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a3c157660 0x7f5a3c154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:37.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.799+0000 7f5a41350700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a3c157660 0x7f5a3c154b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58534/0 (socket says 172.21.15.49:58534) 2023-11-30T18:39:37.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.799+0000 7f5a41350700 1 -- 172.21.15.49:0/2762498651 learned_addr learned my addr 172.21.15.49:0/2762498651 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:37.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.800+0000 7f5a3bfff700 1 --2- 172.21.15.49:0/2762498651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a3c0c1750 0x7f5a3c1533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:37.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.800+0000 7f5a40b4f700 1 --2- 172.21.15.49:0/2762498651 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5a3c0c0180 0x7f5a3c156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:37.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.800+0000 7f5a41350700 1 -- 172.21.15.49:0/2762498651 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5a3c0c0180 msgr2=0x7f5a3c156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:37.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.800+0000 7f5a41350700 1 --2- 172.21.15.49:0/2762498651 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5a3c0c0180 0x7f5a3c156770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:37.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.800+0000 7f5a41350700 1 -- 172.21.15.49:0/2762498651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a3c0c1750 msgr2=0x7f5a3c1533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:37.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.800+0000 7f5a41350700 1 --2- 172.21.15.49:0/2762498651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a3c0c1750 0x7f5a3c1533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:37.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.800+0000 7f5a41350700 1 -- 172.21.15.49:0/2762498651 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a30009370 con 0x7f5a3c157660 2023-11-30T18:39:37.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.800+0000 7f5a3bfff700 1 --2- 172.21.15.49:0/2762498651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a3c0c1750 0x7f5a3c1533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:39:37.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.800+0000 7f5a41350700 1 --2- 172.21.15.49:0/2762498651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a3c157660 0x7f5a3c154b50 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 rx=0x7f5a34002230 tx=0x7f5a340015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:37.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.800+0000 7f5a38ff9700 1 -- 172.21.15.49:0/2762498651 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a34010510 con 0x7f5a3c157660 2023-11-30T18:39:37.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.800+0000 7f5a38ff9700 1 -- 172.21.15.49:0/2762498651 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a34010670 con 0x7f5a3c157660 2023-11-30T18:39:37.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.800+0000 7f5a38ff9700 1 -- 172.21.15.49:0/2762498651 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a340109f0 con 0x7f5a3c157660 2023-11-30T18:39:37.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.800+0000 7f5a41b51700 1 -- 172.21.15.49:0/2762498651 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a3c153d90 con 0x7f5a3c157660 2023-11-30T18:39:37.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.800+0000 7f5a41b51700 1 -- 172.21.15.49:0/2762498651 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3c154350 con 0x7f5a3c157660 2023-11-30T18:39:37.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.801+0000 7f5a41b51700 1 -- 172.21.15.49:0/2762498651 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a3c154830 con 0x7f5a3c157660 2023-11-30T18:39:37.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.801+0000 7f5a38ff9700 1 -- 172.21.15.49:0/2762498651 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f5a3401b400 con 0x7f5a3c157660 2023-11-30T18:39:37.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.802+0000 7f5a38ff9700 1 --2- 172.21.15.49:0/2762498651 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5a2805f270 0x7f5a28061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:37.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.802+0000 7f5a38ff9700 1 -- 172.21.15.49:0/2762498651 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6205+0+0 (secure 0 0 0) 0x7f5a3407a280 con 0x7f5a3c157660 2023-11-30T18:39:37.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.802+0000 7f5a40b4f700 1 --2- 172.21.15.49:0/2762498651 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5a2805f270 0x7f5a28061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:37.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.802+0000 7f5a40b4f700 1 --2- 172.21.15.49:0/2762498651 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5a2805f270 0x7f5a28061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f5a2c006d80 tx=0x7f5a2c008040).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:37.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.806+0000 7f5a38ff9700 1 -- 172.21.15.49:0/2762498651 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5a3404b320 con 0x7f5a3c157660 2023-11-30T18:39:37.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.978+0000 7f5a41b51700 1 -- 172.21.15.49:0/2762498651 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a3c06c7c0 con 0x7f5a3c157660 2023-11-30T18:39:37.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.979+0000 7f5a38ff9700 1 -- 172.21.15.49:0/2762498651 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v202) v1 ==== 74+0+17090 (secure 0 0 0) 0x7f5a3404e940 con 0x7f5a3c157660 2023-11-30T18:39:37.980 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:39:37.980 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":202,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:39:37.320047+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-11-30T18:39:35.697536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-11-30T18:39:36.299739+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:39:37.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.981+0000 7f5a41b51700 1 -- 172.21.15.49:0/2762498651 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5a2805f270 msgr2=0x7f5a28061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:37.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.981+0000 7f5a41b51700 1 --2- 172.21.15.49:0/2762498651 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5a2805f270 0x7f5a28061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f5a2c006d80 tx=0x7f5a2c008040).stop 2023-11-30T18:39:37.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.981+0000 7f5a41b51700 1 -- 172.21.15.49:0/2762498651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a3c157660 msgr2=0x7f5a3c154b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:37.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.981+0000 7f5a41b51700 1 --2- 172.21.15.49:0/2762498651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a3c157660 0x7f5a3c154b50 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 rx=0x7f5a34002230 tx=0x7f5a340015e0).stop 2023-11-30T18:39:37.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.981+0000 7f5a41b51700 1 -- 172.21.15.49:0/2762498651 shutdown_connections 2023-11-30T18:39:37.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.981+0000 7f5a41b51700 1 --2- 172.21.15.49:0/2762498651 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5a2805f270 0x7f5a28061730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:37.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.981+0000 7f5a41b51700 1 --2- 172.21.15.49:0/2762498651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a3c157660 0x7f5a3c154b50 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:37.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.981+0000 7f5a41b51700 1 --2- 172.21.15.49:0/2762498651 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5a3c0c0180 0x7f5a3c156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:37.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.981+0000 7f5a41b51700 1 --2- 172.21.15.49:0/2762498651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a3c0c1750 0x7f5a3c1533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:37.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.981+0000 7f5a41b51700 1 -- 172.21.15.49:0/2762498651 >> 172.21.15.49:0/2762498651 conn(0x7f5a3c0cb000 msgr2=0x7f5a3c0aae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:37.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.981+0000 7f5a41b51700 1 -- 172.21.15.49:0/2762498651 shutdown_connections 2023-11-30T18:39:37.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:37.981+0000 7f5a41b51700 1 -- 172.21.15.49:0/2762498651 wait complete. 2023-11-30T18:39:37.995 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-30T18:39:38.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.115+0000 7f618c9f9700 1 Processor -- start 2023-11-30T18:39:38.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.116+0000 7f618c9f9700 1 -- start start 2023-11-30T18:39:38.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.116+0000 7f618c9f9700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f61880a8280 0x7f61880a8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:38.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.117+0000 7f618c9f9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f618814e600 0x7f618814ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:38.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.117+0000 7f618c9f9700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6188067770 con 0x7f6188158160 2023-11-30T18:39:38.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.117+0000 7f618c9f9700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6188159180 con 0x7f61880a8280 2023-11-30T18:39:38.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.117+0000 7f618c9f9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61880be8d0 con 0x7f618814e600 2023-11-30T18:39:38.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.117+0000 7f618659c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f61880a8280 0x7f61880a8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:38.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.117+0000 7f618659c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f61880a8280 0x7f61880a8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58548/0 (socket says 172.21.15.49:58548) 2023-11-30T18:39:38.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.117+0000 7f618659c700 1 -- 172.21.15.49:0/2349372806 learned_addr learned my addr 172.21.15.49:0/2349372806 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:38.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.117+0000 7f6186d9d700 1 --2- 172.21.15.49:0/2349372806 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f618814e600 0x7f618814ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:38.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.117+0000 7f618659c700 1 -- 172.21.15.49:0/2349372806 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f618814e600 msgr2=0x7f618814ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:38.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.117+0000 7f618659c700 1 --2- 172.21.15.49:0/2349372806 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f618814e600 0x7f618814ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:38.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.117+0000 7f618659c700 1 -- 172.21.15.49:0/2349372806 >> v1:172.21.15.115:6789/0 conn(0x7f6188158160 legacy=0x7f6188155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:38.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.117+0000 7f618659c700 1 -- 172.21.15.49:0/2349372806 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6188158600 con 0x7f61880a8280 2023-11-30T18:39:38.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.117+0000 7f618659c700 1 --2- 172.21.15.49:0/2349372806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61880a8280 0x7f61880a8660 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 rx=0x7f6180009f20 tx=0x7f6180009840).ready entity=mon.0 client_cookie=b383ad21c5ab3728 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:38.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.117+0000 7f618559a700 1 -- 172.21.15.49:0/2349372806 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618000e070 con 0x7f61880a8280 2023-11-30T18:39:38.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.117+0000 7f618559a700 1 -- 172.21.15.49:0/2349372806 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618000b9d0 con 0x7f61880a8280 2023-11-30T18:39:38.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.117+0000 7f618559a700 1 -- 172.21.15.49:0/2349372806 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618000bd50 con 0x7f61880a8280 2023-11-30T18:39:38.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.118+0000 7f618c9f9700 1 -- 172.21.15.49:0/2349372806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61880a8280 msgr2=0x7f61880a8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:38.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.118+0000 7f618c9f9700 1 --2- 172.21.15.49:0/2349372806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61880a8280 0x7f61880a8660 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 rx=0x7f6180009f20 tx=0x7f6180009840).stop 2023-11-30T18:39:38.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.118+0000 7f618c9f9700 1 -- 172.21.15.49:0/2349372806 shutdown_connections 2023-11-30T18:39:38.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.118+0000 7f618c9f9700 1 --2- 172.21.15.49:0/2349372806 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f618814e600 0x7f618814ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:38.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.118+0000 7f618c9f9700 1 --2- 172.21.15.49:0/2349372806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61880a8280 0x7f61880a8660 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:38.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.118+0000 7f618c9f9700 1 -- 172.21.15.49:0/2349372806 >> 172.21.15.49:0/2349372806 conn(0x7f6188062700 msgr2=0x7f6188062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:38.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.118+0000 7f618c9f9700 1 -- 172.21.15.49:0/2349372806 shutdown_connections 2023-11-30T18:39:38.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.118+0000 7f618c9f9700 1 -- 172.21.15.49:0/2349372806 wait complete. 2023-11-30T18:39:38.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.119+0000 7f618c9f9700 1 Processor -- start 2023-11-30T18:39:38.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.119+0000 7f618c9f9700 1 -- start start 2023-11-30T18:39:38.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.120+0000 7f618c9f9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61880a8280 0x7f6188157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:38.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.120+0000 7f618c9f9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f618814e600 0x7f61880c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:38.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.120+0000 7f618c9f9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6188158160 0x7f61880aac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:38.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.120+0000 7f618c9f9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618814b5d0 con 0x7f61880a8280 2023-11-30T18:39:38.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.120+0000 7f618c9f9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6188155db0 con 0x7f618814e600 2023-11-30T18:39:38.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.120+0000 7f618c9f9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6188156930 con 0x7f6188158160 2023-11-30T18:39:38.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.120+0000 7f618659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61880a8280 0x7f6188157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:38.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.120+0000 7f618659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61880a8280 0x7f6188157ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58562/0 (socket says 172.21.15.49:58562) 2023-11-30T18:39:38.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.120+0000 7f618659c700 1 -- 172.21.15.49:0/1026123686 learned_addr learned my addr 172.21.15.49:0/1026123686 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:38.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.120+0000 7f6185d9b700 1 --2- 172.21.15.49:0/1026123686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f618814e600 0x7f61880c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:38.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.120+0000 7f6186d9d700 1 --2- 172.21.15.49:0/1026123686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6188158160 0x7f61880aac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:38.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.120+0000 7f618659c700 1 -- 172.21.15.49:0/1026123686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6188158160 msgr2=0x7f61880aac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:38.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.120+0000 7f618659c700 1 --2- 172.21.15.49:0/1026123686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6188158160 0x7f61880aac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:38.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.120+0000 7f618659c700 1 -- 172.21.15.49:0/1026123686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f618814e600 msgr2=0x7f61880c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:38.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.120+0000 7f618659c700 1 --2- 172.21.15.49:0/1026123686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f618814e600 0x7f61880c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:38.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.120+0000 7f618659c700 1 -- 172.21.15.49:0/1026123686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6180009ae0 con 0x7f61880a8280 2023-11-30T18:39:38.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.120+0000 7f618659c700 1 --2- 172.21.15.49:0/1026123686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61880a8280 0x7f6188157ae0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 rx=0x7f6180013fd0 tx=0x7f6180009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:38.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.121+0000 7f617e7fc700 1 -- 172.21.15.49:0/1026123686 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61800092e0 con 0x7f61880a8280 2023-11-30T18:39:38.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.121+0000 7f617e7fc700 1 -- 172.21.15.49:0/1026123686 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618000bb40 con 0x7f61880a8280 2023-11-30T18:39:38.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.121+0000 7f618c9f9700 1 -- 172.21.15.49:0/1026123686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6188156000 con 0x7f61880a8280 2023-11-30T18:39:38.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.121+0000 7f617e7fc700 1 -- 172.21.15.49:0/1026123686 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618001d460 con 0x7f61880a8280 2023-11-30T18:39:38.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.121+0000 7f618c9f9700 1 -- 172.21.15.49:0/1026123686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61881565c0 con 0x7f61880a8280 2023-11-30T18:39:38.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.122+0000 7f618c9f9700 1 -- 172.21.15.49:0/1026123686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61880c3620 con 0x7f61880a8280 2023-11-30T18:39:38.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.122+0000 7f617e7fc700 1 -- 172.21.15.49:0/1026123686 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6180003040 con 0x7f61880a8280 2023-11-30T18:39:38.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.122+0000 7f617e7fc700 1 --2- 172.21.15.49:0/1026123686 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f616805f270 0x7f6168061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:38.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.122+0000 7f617e7fc700 1 -- 172.21.15.49:0/1026123686 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6205+0+0 (secure 0 0 0) 0x7f618007b3c0 con 0x7f61880a8280 2023-11-30T18:39:38.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.123+0000 7f6185d9b700 1 --2- 172.21.15.49:0/1026123686 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f616805f270 0x7f6168061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:38.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.123+0000 7f6185d9b700 1 --2- 172.21.15.49:0/1026123686 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f616805f270 0x7f6168061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f6188157fd0 tx=0x7f6170007d40).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:38.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.126+0000 7f617e7fc700 1 -- 172.21.15.49:0/1026123686 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f618004c570 con 0x7f61880a8280 2023-11-30T18:39:38.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:38.347+0000 7f618c9f9700 1 -- 172.21.15.49:0/1026123686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f618806c860 con 0x7f61880a8280 2023-11-30T18:39:39.226 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:39:39.229 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:39:39.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.335+0000 7f617e7fc700 1 -- 172.21.15.49:0/1026123686 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v84) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6180022020 con 0x7f61880a8280 2023-11-30T18:39:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.338+0000 7f618c9f9700 1 -- 172.21.15.49:0/1026123686 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f616805f270 msgr2=0x7f6168061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.338+0000 7f618c9f9700 1 --2- 172.21.15.49:0/1026123686 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f616805f270 0x7f6168061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f6188157fd0 tx=0x7f6170007d40).stop 2023-11-30T18:39:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.338+0000 7f618c9f9700 1 -- 172.21.15.49:0/1026123686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61880a8280 msgr2=0x7f6188157ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.338+0000 7f618c9f9700 1 --2- 172.21.15.49:0/1026123686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61880a8280 0x7f6188157ae0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 rx=0x7f6180013fd0 tx=0x7f6180009840).stop 2023-11-30T18:39:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.338+0000 7f618c9f9700 1 -- 172.21.15.49:0/1026123686 shutdown_connections 2023-11-30T18:39:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.338+0000 7f618c9f9700 1 --2- 172.21.15.49:0/1026123686 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f616805f270 0x7f6168061730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.338+0000 7f618c9f9700 1 --2- 172.21.15.49:0/1026123686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6188158160 0x7f61880aac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.338+0000 7f618c9f9700 1 --2- 172.21.15.49:0/1026123686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61880a8280 0x7f6188157ae0 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.338+0000 7f618c9f9700 1 --2- 172.21.15.49:0/1026123686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f618814e600 0x7f61880c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.338+0000 7f618c9f9700 1 -- 172.21.15.49:0/1026123686 >> 172.21.15.49:0/1026123686 conn(0x7f6188062700 msgr2=0x7f618814bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.338+0000 7f618c9f9700 1 -- 172.21.15.49:0/1026123686 shutdown_connections 2023-11-30T18:39:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.338+0000 7f618c9f9700 1 -- 172.21.15.49:0/1026123686 wait complete. 2023-11-30T18:39:39.353 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-30T18:39:39.353 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-30T18:39:39.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.480+0000 7f8049665700 1 Processor -- start 2023-11-30T18:39:39.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.480+0000 7f8049665700 1 -- start start 2023-11-30T18:39:39.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.481+0000 7f8049665700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f804414e530 0x7f80440c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:39.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.481+0000 7f8049665700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8044154950 0x7f804414e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:39.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.481+0000 7f8049665700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80440c7bc0 con 0x7f8044158570 2023-11-30T18:39:39.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.481+0000 7f8049665700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8044155920 con 0x7f8044154950 2023-11-30T18:39:39.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.481+0000 7f8049665700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8044154dd0 con 0x7f804414e530 2023-11-30T18:39:39.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.481+0000 7f8048e64700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8044158570 0x7f80440aa030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:54272/0 (socket says 172.21.15.49:54272) 2023-11-30T18:39:39.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.481+0000 7f8048e64700 1 -- 172.21.15.49:0/2840629507 learned_addr learned my addr 172.21.15.49:0/2840629507 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:39.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.481+0000 7f803bfff700 1 --2- 172.21.15.49:0/2840629507 >> v2:172.21.15.115:3300/0 conn(0x7f8044154950 0x7f804414e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:39.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.481+0000 7f8043fff700 1 --2- 172.21.15.49:0/2840629507 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f804414e530 0x7f80440c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:39.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.482+0000 7f80437fe700 1 -- 172.21.15.49:0/2840629507 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1843375395 0 0) 0x7f80440c7bc0 con 0x7f8044158570 2023-11-30T18:39:39.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.482+0000 7f80437fe700 1 -- 172.21.15.49:0/2840629507 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80300033f0 con 0x7f8044158570 2023-11-30T18:39:39.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.482+0000 7f80437fe700 1 -- 172.21.15.49:0/2840629507 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3452129526 0 0) 0x7f80300033f0 con 0x7f8044158570 2023-11-30T18:39:39.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.482+0000 7f80437fe700 1 -- 172.21.15.49:0/2840629507 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f804414e530 msgr2=0x7f80440c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:39.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.482+0000 7f80437fe700 1 --2- 172.21.15.49:0/2840629507 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f804414e530 0x7f80440c66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:39.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.482+0000 7f80437fe700 1 -- 172.21.15.49:0/2840629507 >> v2:172.21.15.115:3300/0 conn(0x7f8044154950 msgr2=0x7f804414e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:39.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.482+0000 7f80437fe700 1 --2- 172.21.15.49:0/2840629507 >> v2:172.21.15.115:3300/0 conn(0x7f8044154950 0x7f804414e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:39.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.482+0000 7f80437fe700 1 -- 172.21.15.49:0/2840629507 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8044155080 con 0x7f8044158570 2023-11-30T18:39:39.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.482+0000 7f80437fe700 1 -- 172.21.15.49:0/2840629507 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f803c0017f0 con 0x7f8044158570 2023-11-30T18:39:39.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.482+0000 7f80437fe700 1 -- 172.21.15.49:0/2840629507 >> v1:172.21.15.49:6789/0 conn(0x7f8044158570 legacy=0x7f80440aa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:39.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.482+0000 7f80437fe700 1 --2- 172.21.15.49:0/2840629507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80300038e0 0x7f8030003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:39.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.482+0000 7f80437fe700 1 --2- 172.21.15.49:0/2840629507 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f804414e530 0x7f8030004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:39.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.482+0000 7f80437fe700 1 --2- 172.21.15.49:0/2840629507 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8030004b80 0x7f8030005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:39.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.482+0000 7f80437fe700 1 -- 172.21.15.49:0/2840629507 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8044155920 con 0x7f80300038e0 2023-11-30T18:39:39.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.482+0000 7f80437fe700 1 -- 172.21.15.49:0/2840629507 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8044154dd0 con 0x7f8030004b80 2023-11-30T18:39:39.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.482+0000 7f80437fe700 1 -- 172.21.15.49:0/2840629507 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803000b8e0 con 0x7f804414e530 2023-11-30T18:39:39.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.482+0000 7f8043fff700 1 --2- 172.21.15.49:0/2840629507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80300038e0 0x7f8030003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:39.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.482+0000 7f803bfff700 1 --2- 172.21.15.49:0/2840629507 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f804414e530 0x7f8030004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:39.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.482+0000 7f8048e64700 1 --2- 172.21.15.49:0/2840629507 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8030004b80 0x7f8030005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:39.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.482+0000 7f8043fff700 1 -- 172.21.15.49:0/2840629507 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f804414e530 msgr2=0x7f8030004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:39.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.482+0000 7f8043fff700 1 --2- 172.21.15.49:0/2840629507 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f804414e530 0x7f8030004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:39.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.482+0000 7f8043fff700 1 -- 172.21.15.49:0/2840629507 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8030004b80 msgr2=0x7f8030005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:39.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.482+0000 7f8043fff700 1 --2- 172.21.15.49:0/2840629507 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8030004b80 0x7f8030005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:39.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.482+0000 7f8043fff700 1 -- 172.21.15.49:0/2840629507 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80300033f0 con 0x7f80300038e0 2023-11-30T18:39:39.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.482+0000 7f8048e64700 1 --2- 172.21.15.49:0/2840629507 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8030004b80 0x7f8030005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:39:39.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.482+0000 7f8043fff700 1 --2- 172.21.15.49:0/2840629507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80300038e0 0x7f8030003d00 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 rx=0x7f8034009a80 tx=0x7f8034009060).ready entity=mon.0 client_cookie=86abb38cca8521cb server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:39.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.483+0000 7f80437fe700 1 -- 172.21.15.49:0/2840629507 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8034009430 con 0x7f80300038e0 2023-11-30T18:39:39.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.483+0000 7f80437fe700 1 -- 172.21.15.49:0/2840629507 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803400e640 con 0x7f80300038e0 2023-11-30T18:39:39.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.483+0000 7f80437fe700 1 -- 172.21.15.49:0/2840629507 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803400e9c0 con 0x7f80300038e0 2023-11-30T18:39:39.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.483+0000 7f8049665700 1 -- 172.21.15.49:0/2840629507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80300038e0 msgr2=0x7f8030003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:39.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.483+0000 7f8049665700 1 --2- 172.21.15.49:0/2840629507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80300038e0 0x7f8030003d00 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 rx=0x7f8034009a80 tx=0x7f8034009060).stop 2023-11-30T18:39:39.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.483+0000 7f8048e64700 1 -- 172.21.15.49:0/2840629507 reap_dead start 2023-11-30T18:39:39.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.483+0000 7f8049665700 1 -- 172.21.15.49:0/2840629507 shutdown_connections 2023-11-30T18:39:39.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.483+0000 7f8049665700 1 -- 172.21.15.49:0/2840629507 >> 172.21.15.49:0/2840629507 conn(0x7f8044064990 msgr2=0x7f8044064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:39.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.483+0000 7f8049665700 1 -- 172.21.15.49:0/2840629507 shutdown_connections 2023-11-30T18:39:39.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.483+0000 7f8049665700 1 -- 172.21.15.49:0/2840629507 wait complete. 2023-11-30T18:39:39.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.484+0000 7f8049665700 1 Processor -- start 2023-11-30T18:39:39.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.484+0000 7f8049665700 1 -- start start 2023-11-30T18:39:39.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.485+0000 7f8049665700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80300038e0 0x7f80441640c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:39.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.485+0000 7f8049665700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80440c4070 0x7f80440c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:39.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.485+0000 7f8049665700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80440b0480 0x7f80440b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:39.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.485+0000 7f8049665700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80440c49e0 con 0x7f80440b0480 2023-11-30T18:39:39.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.485+0000 7f8049665700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80440af3e0 con 0x7f80440c4070 2023-11-30T18:39:39.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.485+0000 7f8049665700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80440af6c0 con 0x7f80300038e0 2023-11-30T18:39:39.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.485+0000 7f8048e64700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80440b0480 0x7f80440b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:39.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.485+0000 7f8048e64700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80440b0480 0x7f80440b0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58586/0 (socket says 172.21.15.49:58586) 2023-11-30T18:39:39.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.485+0000 7f8048e64700 1 -- 172.21.15.49:0/1302743961 learned_addr learned my addr 172.21.15.49:0/1302743961 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:39.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.485+0000 7f8043fff700 1 --2- 172.21.15.49:0/1302743961 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80300038e0 0x7f80441640c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:39.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.485+0000 7f8048e64700 1 -- 172.21.15.49:0/1302743961 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80300038e0 msgr2=0x7f80441640c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:39.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.485+0000 7f8048e64700 1 --2- 172.21.15.49:0/1302743961 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80300038e0 0x7f80441640c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:39.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.485+0000 7f8048e64700 1 -- 172.21.15.49:0/1302743961 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80440c4070 msgr2=0x7f80440c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:39.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.485+0000 7f803bfff700 1 --2- 172.21.15.49:0/1302743961 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80440c4070 0x7f80440c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:39.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.485+0000 7f8048e64700 1 --2- 172.21.15.49:0/1302743961 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80440c4070 0x7f80440c44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:39.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.485+0000 7f8048e64700 1 -- 172.21.15.49:0/1302743961 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80440af9a0 con 0x7f80440b0480 2023-11-30T18:39:39.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.486+0000 7f8048e64700 1 --2- 172.21.15.49:0/1302743961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80440b0480 0x7f80440b0900 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 rx=0x7f80440c77c0 tx=0x7f803c0017b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:39.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.486+0000 7f8040ff9700 1 -- 172.21.15.49:0/1302743961 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c00c7b0 con 0x7f80440b0480 2023-11-30T18:39:39.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.486+0000 7f8040ff9700 1 -- 172.21.15.49:0/1302743961 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803c00c910 con 0x7f80440b0480 2023-11-30T18:39:39.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.486+0000 7f8049665700 1 -- 172.21.15.49:0/1302743961 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80440afc80 con 0x7f80440b0480 2023-11-30T18:39:39.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.486+0000 7f8040ff9700 1 -- 172.21.15.49:0/1302743961 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c00ccd0 con 0x7f80440b0480 2023-11-30T18:39:39.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.486+0000 7f8049665700 1 -- 172.21.15.49:0/1302743961 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80441645b0 con 0x7f80440b0480 2023-11-30T18:39:39.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.487+0000 7f8049665700 1 -- 172.21.15.49:0/1302743961 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8044062ee0 con 0x7f80440b0480 2023-11-30T18:39:39.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.487+0000 7f8040ff9700 1 -- 172.21.15.49:0/1302743961 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f803c014430 con 0x7f80440b0480 2023-11-30T18:39:39.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.487+0000 7f8040ff9700 1 --2- 172.21.15.49:0/1302743961 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f802405f2a0 0x7f8024061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:39.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.488+0000 7f8040ff9700 1 -- 172.21.15.49:0/1302743961 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6205+0+0 (secure 0 0 0) 0x7f803c07a150 con 0x7f80440b0480 2023-11-30T18:39:39.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.488+0000 7f8043fff700 1 --2- 172.21.15.49:0/1302743961 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f802405f2a0 0x7f8024061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:39.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.488+0000 7f8043fff700 1 --2- 172.21.15.49:0/1302743961 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f802405f2a0 0x7f8024061760 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f8034009a80 tx=0x7f803401a000).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:39.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.492+0000 7f8040ff9700 1 -- 172.21.15.49:0/1302743961 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f803c049b00 con 0x7f80440b0480 2023-11-30T18:39:39.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:39.706+0000 7f8049665700 1 -- 172.21.15.49:0/1302743961 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f804406c7c0 con 0x7f80440b0480 2023-11-30T18:39:40.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.337+0000 7f8040ff9700 1 -- 172.21.15.49:0/1302743961 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v85) v1 ==== 122+0+0 (secure 0 0 0) 0x7f803c04b1f0 con 0x7f80440b0480 2023-11-30T18:39:40.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.339+0000 7f8049665700 1 -- 172.21.15.49:0/1302743961 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f802405f2a0 msgr2=0x7f8024061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:40.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.339+0000 7f8049665700 1 --2- 172.21.15.49:0/1302743961 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f802405f2a0 0x7f8024061760 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f8034009a80 tx=0x7f803401a000).stop 2023-11-30T18:39:40.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.339+0000 7f8049665700 1 -- 172.21.15.49:0/1302743961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80440b0480 msgr2=0x7f80440b0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:40.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.339+0000 7f8049665700 1 --2- 172.21.15.49:0/1302743961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80440b0480 0x7f80440b0900 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 rx=0x7f80440c77c0 tx=0x7f803c0017b0).stop 2023-11-30T18:39:40.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.339+0000 7f8049665700 1 -- 172.21.15.49:0/1302743961 shutdown_connections 2023-11-30T18:39:40.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.339+0000 7f8049665700 1 --2- 172.21.15.49:0/1302743961 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f802405f2a0 0x7f8024061760 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:40.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.339+0000 7f8049665700 1 --2- 172.21.15.49:0/1302743961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80440b0480 0x7f80440b0900 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:40.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.339+0000 7f8049665700 1 --2- 172.21.15.49:0/1302743961 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80300038e0 0x7f80441640c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:40.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.339+0000 7f8049665700 1 --2- 172.21.15.49:0/1302743961 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80440c4070 0x7f80440c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:40.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.339+0000 7f8049665700 1 -- 172.21.15.49:0/1302743961 >> 172.21.15.49:0/1302743961 conn(0x7f8044064990 msgr2=0x7f80440c9530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:40.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.339+0000 7f8049665700 1 -- 172.21.15.49:0/1302743961 shutdown_connections 2023-11-30T18:39:40.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.339+0000 7f8049665700 1 -- 172.21.15.49:0/1302743961 wait complete. 2023-11-30T18:39:40.354 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-30T18:39:40.355 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:39:40.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.475+0000 7fa0ace95700 1 Processor -- start 2023-11-30T18:39:40.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.475+0000 7fa0ace95700 1 -- start start 2023-11-30T18:39:40.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.476+0000 7fa0ace95700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa0a8064e20 0x7fa0a8155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:40.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.476+0000 7fa0ace95700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0a8095e80 0x7fa0a8096310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:40.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.476+0000 7fa0ace95700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a8096800 con 0x7fa0a81544d0 2023-11-30T18:39:40.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.476+0000 7fa0ace95700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a8067650 con 0x7fa0a8064e20 2023-11-30T18:39:40.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.476+0000 7fa0ace95700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a80683d0 con 0x7fa0a8095e80 2023-11-30T18:39:40.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.476+0000 7fa0a6d9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0a8095e80 0x7fa0a8096310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:40.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.476+0000 7fa0a5d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa0a8064e20 0x7fa0a8155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:40.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.476+0000 7fa0a6d9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0a8095e80 0x7fa0a8096310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:59448/0 (socket says 172.21.15.49:59448) 2023-11-30T18:39:40.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.476+0000 7fa0a6d9d700 1 -- 172.21.15.49:0/624239849 learned_addr learned my addr 172.21.15.49:0/624239849 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:40.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.476+0000 7fa0a659c700 1 --1- 172.21.15.49:0/624239849 >> v1:172.21.15.115:6789/0 conn(0x7fa0a81544d0 0x7fa0a8066f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:51178/0 (socket says 172.21.15.49:51178) 2023-11-30T18:39:40.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.477+0000 7fa0a5d9b700 1 -- 172.21.15.49:0/624239849 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0a8095e80 msgr2=0x7fa0a8096310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:40.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.477+0000 7fa0a5d9b700 1 --2- 172.21.15.49:0/624239849 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0a8095e80 0x7fa0a8096310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:40.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.477+0000 7fa0a5d9b700 1 -- 172.21.15.49:0/624239849 >> v1:172.21.15.115:6789/0 conn(0x7fa0a81544d0 legacy=0x7fa0a8066f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:40.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.477+0000 7fa0a559a700 1 -- 172.21.15.49:0/624239849 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 933469541 0 0) 0x7fa0a8096800 con 0x7fa0a81544d0 2023-11-30T18:39:40.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.477+0000 7fa0a5d9b700 1 -- 172.21.15.49:0/624239849 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a8067850 con 0x7fa0a8064e20 2023-11-30T18:39:40.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.477+0000 7fa0a6d9d700 1 --2- 172.21.15.49:0/624239849 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0a8095e80 0x7fa0a8096310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:39:40.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.477+0000 7fa0a5d9b700 1 --2- 172.21.15.49:0/624239849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0a8064e20 0x7fa0a8155750 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7fa09c009760 tx=0x7fa09c009060).ready entity=mon.1 client_cookie=3bbacdfbdb683f69 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:40.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.477+0000 7fa0a559a700 1 -- 172.21.15.49:0/624239849 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c00f510 con 0x7fa0a8064e20 2023-11-30T18:39:40.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.477+0000 7fa0a559a700 1 -- 172.21.15.49:0/624239849 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09c00f670 con 0x7fa0a8064e20 2023-11-30T18:39:40.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.477+0000 7fa0a559a700 1 -- 172.21.15.49:0/624239849 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c00f9f0 con 0x7fa0a8064e20 2023-11-30T18:39:40.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.477+0000 7fa0ace95700 1 -- 172.21.15.49:0/624239849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0a8064e20 msgr2=0x7fa0a8155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:40.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.477+0000 7fa0ace95700 1 --2- 172.21.15.49:0/624239849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0a8064e20 0x7fa0a8155750 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7fa09c009760 tx=0x7fa09c009060).stop 2023-11-30T18:39:40.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.477+0000 7fa0ace95700 1 -- 172.21.15.49:0/624239849 shutdown_connections 2023-11-30T18:39:40.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.477+0000 7fa0ace95700 1 --2- 172.21.15.49:0/624239849 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0a8095e80 0x7fa0a8096310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:40.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.477+0000 7fa0ace95700 1 --2- 172.21.15.49:0/624239849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0a8064e20 0x7fa0a8155750 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:40.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.477+0000 7fa0ace95700 1 -- 172.21.15.49:0/624239849 >> 172.21.15.49:0/624239849 conn(0x7fa0a80631d0 msgr2=0x7fa0a80c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:40.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.477+0000 7fa0ace95700 1 -- 172.21.15.49:0/624239849 shutdown_connections 2023-11-30T18:39:40.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.478+0000 7fa0ace95700 1 -- 172.21.15.49:0/624239849 wait complete. 2023-11-30T18:39:40.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.479+0000 7fa0ace95700 1 Processor -- start 2023-11-30T18:39:40.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.479+0000 7fa0ace95700 1 -- start start 2023-11-30T18:39:40.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.479+0000 7fa0ace95700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0a8064e20 0x7fa0a814f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:40.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.479+0000 7fa0ace95700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0a8095e80 0x7fa0a8156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:40.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.479+0000 7fa0ace95700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0a81544d0 0x7fa0a814f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:40.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.479+0000 7fa0ace95700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a814f600 con 0x7fa0a8095e80 2023-11-30T18:39:40.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.479+0000 7fa0ace95700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a8156650 con 0x7fa0a8064e20 2023-11-30T18:39:40.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.479+0000 7fa0ace95700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a81568d0 con 0x7fa0a81544d0 2023-11-30T18:39:40.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.480+0000 7fa0a5d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0a8095e80 0x7fa0a8156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:40.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.480+0000 7fa0a5d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0a8095e80 0x7fa0a8156160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58596/0 (socket says 172.21.15.49:58596) 2023-11-30T18:39:40.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.480+0000 7fa0a5d9b700 1 -- 172.21.15.49:0/2021612406 learned_addr learned my addr 172.21.15.49:0/2021612406 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:40.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.480+0000 7fa0a659c700 1 --2- 172.21.15.49:0/2021612406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0a8064e20 0x7fa0a814f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:40.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.480+0000 7fa0a6d9d700 1 --2- 172.21.15.49:0/2021612406 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0a81544d0 0x7fa0a814f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:40.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.480+0000 7fa0a5d9b700 1 -- 172.21.15.49:0/2021612406 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0a81544d0 msgr2=0x7fa0a814f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:40.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.480+0000 7fa0a5d9b700 1 --2- 172.21.15.49:0/2021612406 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0a81544d0 0x7fa0a814f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:40.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.480+0000 7fa0a5d9b700 1 -- 172.21.15.49:0/2021612406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0a8064e20 msgr2=0x7fa0a814f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:40.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.480+0000 7fa0a5d9b700 1 --2- 172.21.15.49:0/2021612406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0a8064e20 0x7fa0a814f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:40.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.480+0000 7fa0a5d9b700 1 -- 172.21.15.49:0/2021612406 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a0009ae0 con 0x7fa0a8095e80 2023-11-30T18:39:40.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.480+0000 7fa0a5d9b700 1 --2- 172.21.15.49:0/2021612406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0a8095e80 0x7fa0a8156160 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 rx=0x7fa0a806c7f0 tx=0x7fa09c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:40.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.480+0000 7fa0967fc700 1 -- 172.21.15.49:0/2021612406 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c00f7e0 con 0x7fa0a8095e80 2023-11-30T18:39:40.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.480+0000 7fa0967fc700 1 -- 172.21.15.49:0/2021612406 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09c00f940 con 0x7fa0a8095e80 2023-11-30T18:39:40.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.480+0000 7fa0ace95700 1 -- 172.21.15.49:0/2021612406 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa09c0092a0 con 0x7fa0a8095e80 2023-11-30T18:39:40.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.480+0000 7fa0967fc700 1 -- 172.21.15.49:0/2021612406 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c01b660 con 0x7fa0a8095e80 2023-11-30T18:39:40.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.480+0000 7fa0ace95700 1 -- 172.21.15.49:0/2021612406 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a8157170 con 0x7fa0a8095e80 2023-11-30T18:39:40.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.481+0000 7fa0ace95700 1 -- 172.21.15.49:0/2021612406 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a8156cc0 con 0x7fa0a8095e80 2023-11-30T18:39:40.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.482+0000 7fa0967fc700 1 -- 172.21.15.49:0/2021612406 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa09c01ba50 con 0x7fa0a8095e80 2023-11-30T18:39:40.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.482+0000 7fa0967fc700 1 --2- 172.21.15.49:0/2021612406 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa08805f270 0x7fa088061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:40.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.482+0000 7fa0967fc700 1 -- 172.21.15.49:0/2021612406 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6205+0+0 (secure 0 0 0) 0x7fa09c07be60 con 0x7fa0a8095e80 2023-11-30T18:39:40.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.482+0000 7fa0a659c700 1 --2- 172.21.15.49:0/2021612406 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa08805f270 0x7fa088061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:40.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.483+0000 7fa0a659c700 1 --2- 172.21.15.49:0/2021612406 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa08805f270 0x7fa088061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fa098004820 tx=0x7fa098007dc0).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:40.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.486+0000 7fa0967fc700 1 -- 172.21.15.49:0/2021612406 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa09c04d010 con 0x7fa0a8095e80 2023-11-30T18:39:40.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.700+0000 7fa0ace95700 1 -- 172.21.15.49:0/2021612406 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0a806c860 con 0x7fa0a8095e80 2023-11-30T18:39:40.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.701+0000 7fa0967fc700 1 -- 172.21.15.49:0/2021612406 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4496 (secure 0 0 0) 0x7fa09c006b30 con 0x7fa0a8095e80 2023-11-30T18:39:40.701 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:39:40.702 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":85,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7904,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/873619564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":873619564},{"type":"v1","addr":"172.21.15.115:6837","nonce":873619564}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":9172,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/4238872035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":4238872035},{"type":"v1","addr":"172.21.15.115:6835","nonce":4238872035}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":9495,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1878169084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1878169084},{"type":"v1","addr":"172.21.15.49:6834","nonce":1878169084}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T18:39:37.320382+0000","modified":"2023-11-30T18:39:40.334323+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9498},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9498":{"gid":9498,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/4263670008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":4263670008},{"type":"v1","addr":"172.21.15.49:6835","nonce":4263670008}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-11-30T18:39:40.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.702+0000 7fa0ace95700 1 -- 172.21.15.49:0/2021612406 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa08805f270 msgr2=0x7fa088061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:40.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.703+0000 7fa0ace95700 1 --2- 172.21.15.49:0/2021612406 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa08805f270 0x7fa088061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fa098004820 tx=0x7fa098007dc0).stop 2023-11-30T18:39:40.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.703+0000 7fa0ace95700 1 -- 172.21.15.49:0/2021612406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0a8095e80 msgr2=0x7fa0a8156160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:40.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.703+0000 7fa0ace95700 1 --2- 172.21.15.49:0/2021612406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0a8095e80 0x7fa0a8156160 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 rx=0x7fa0a806c7f0 tx=0x7fa09c017000).stop 2023-11-30T18:39:40.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.703+0000 7fa0ace95700 1 -- 172.21.15.49:0/2021612406 shutdown_connections 2023-11-30T18:39:40.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.703+0000 7fa0ace95700 1 --2- 172.21.15.49:0/2021612406 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa08805f270 0x7fa088061730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:40.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.703+0000 7fa0ace95700 1 --2- 172.21.15.49:0/2021612406 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0a81544d0 0x7fa0a814f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:40.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.703+0000 7fa0ace95700 1 --2- 172.21.15.49:0/2021612406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0a8064e20 0x7fa0a814f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:40.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.703+0000 7fa0ace95700 1 --2- 172.21.15.49:0/2021612406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0a8095e80 0x7fa0a8156160 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:40.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.703+0000 7fa0ace95700 1 -- 172.21.15.49:0/2021612406 >> 172.21.15.49:0/2021612406 conn(0x7fa0a80631d0 msgr2=0x7fa0a8151b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:40.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.703+0000 7fa0ace95700 1 -- 172.21.15.49:0/2021612406 shutdown_connections 2023-11-30T18:39:40.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.703+0000 7fa0ace95700 1 -- 172.21.15.49:0/2021612406 wait complete. 2023-11-30T18:39:40.705 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 85 2023-11-30T18:39:40.716 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:39:40.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.832+0000 7fde5759e700 1 Processor -- start 2023-11-30T18:39:40.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.832+0000 7fde5759e700 1 -- start start 2023-11-30T18:39:40.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.833+0000 7fde5759e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fde580c0180 0x7fde58157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:40.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.833+0000 7fde5759e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fde580c1750 0x7fde580c1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:40.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.833+0000 7fde5759e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde580c12c0 con 0x7fde58157660 2023-11-30T18:39:40.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.833+0000 7fde5759e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde580c06b0 con 0x7fde580c0180 2023-11-30T18:39:40.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.833+0000 7fde5759e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde580c0990 con 0x7fde580c1750 2023-11-30T18:39:40.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.833+0000 7fde55d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fde580c0180 0x7fde58157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:40.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.833+0000 7fde5659c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fde58157660 0x7fde581589c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58370/0 (socket says 172.21.15.49:58370) 2023-11-30T18:39:40.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.833+0000 7fde5659c700 1 -- 172.21.15.49:0/1316364533 learned_addr learned my addr 172.21.15.49:0/1316364533 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:40.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.834+0000 7fde56d9d700 1 --2- 172.21.15.49:0/1316364533 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fde580c1750 0x7fde580c1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:40.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.834+0000 7fde55d9b700 1 -- 172.21.15.49:0/1316364533 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fde580c1750 msgr2=0x7fde580c1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:40.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.834+0000 7fde55d9b700 1 --2- 172.21.15.49:0/1316364533 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fde580c1750 0x7fde580c1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:40.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.834+0000 7fde55d9b700 1 -- 172.21.15.49:0/1316364533 >> v1:172.21.15.49:6789/0 conn(0x7fde58157660 legacy=0x7fde581589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:40.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.834+0000 7fde5559a700 1 -- 172.21.15.49:0/1316364533 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717403160 0 0) 0x7fde580c12c0 con 0x7fde58157660 2023-11-30T18:39:40.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.834+0000 7fde55d9b700 1 -- 172.21.15.49:0/1316364533 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde580c0c70 con 0x7fde580c0180 2023-11-30T18:39:40.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.834+0000 7fde56d9d700 1 --2- 172.21.15.49:0/1316364533 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fde580c1750 0x7fde580c1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:39:40.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.834+0000 7fde55d9b700 1 --2- 172.21.15.49:0/1316364533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde580c0180 0x7fde58157a40 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 rx=0x7fde40009760 tx=0x7fde40009060).ready entity=mon.0 client_cookie=73c3c63fa50b8bd8 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:40.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.834+0000 7fde5559a700 1 -- 172.21.15.49:0/1316364533 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4000b580 con 0x7fde580c0180 2023-11-30T18:39:40.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.834+0000 7fde5559a700 1 -- 172.21.15.49:0/1316364533 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4000b6e0 con 0x7fde580c0180 2023-11-30T18:39:40.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.834+0000 7fde5559a700 1 -- 172.21.15.49:0/1316364533 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4000ba60 con 0x7fde580c0180 2023-11-30T18:39:40.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.834+0000 7fde5759e700 1 -- 172.21.15.49:0/1316364533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde580c0180 msgr2=0x7fde58157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:40.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.834+0000 7fde5759e700 1 --2- 172.21.15.49:0/1316364533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde580c0180 0x7fde58157a40 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 rx=0x7fde40009760 tx=0x7fde40009060).stop 2023-11-30T18:39:40.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.835+0000 7fde5759e700 1 -- 172.21.15.49:0/1316364533 shutdown_connections 2023-11-30T18:39:40.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.835+0000 7fde5759e700 1 --2- 172.21.15.49:0/1316364533 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fde580c1750 0x7fde580c1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:40.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.835+0000 7fde5759e700 1 --2- 172.21.15.49:0/1316364533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde580c0180 0x7fde58157a40 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:40.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.835+0000 7fde5759e700 1 -- 172.21.15.49:0/1316364533 >> 172.21.15.49:0/1316364533 conn(0x7fde580cb000 msgr2=0x7fde580cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:40.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.835+0000 7fde5759e700 1 -- 172.21.15.49:0/1316364533 shutdown_connections 2023-11-30T18:39:40.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.835+0000 7fde5759e700 1 -- 172.21.15.49:0/1316364533 wait complete. 2023-11-30T18:39:40.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.836+0000 7fde5759e700 1 Processor -- start 2023-11-30T18:39:40.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.836+0000 7fde5759e700 1 -- start start 2023-11-30T18:39:40.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.837+0000 7fde5759e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde580c0180 0x7fde58151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:40.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.837+0000 7fde5759e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde580c1750 0x7fde58146bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:40.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.837+0000 7fde5759e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fde58157660 0x7fde580b0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:40.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.837+0000 7fde5759e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde580b02b0 con 0x7fde580c0180 2023-11-30T18:39:40.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.837+0000 7fde5759e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde580af6a0 con 0x7fde580c1750 2023-11-30T18:39:40.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.837+0000 7fde5759e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde580af980 con 0x7fde58157660 2023-11-30T18:39:40.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.837+0000 7fde5659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde580c0180 0x7fde58151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:40.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.837+0000 7fde5659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde580c0180 0x7fde58151ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59758/0 (socket says 172.21.15.49:59758) 2023-11-30T18:39:40.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.837+0000 7fde5659c700 1 -- 172.21.15.49:0/1084704604 learned_addr learned my addr 172.21.15.49:0/1084704604 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:40.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.837+0000 7fde55d9b700 1 --2- 172.21.15.49:0/1084704604 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde580c1750 0x7fde58146bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:40.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.837+0000 7fde56d9d700 1 --2- 172.21.15.49:0/1084704604 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fde58157660 0x7fde580b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:40.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.837+0000 7fde5659c700 1 -- 172.21.15.49:0/1084704604 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fde58157660 msgr2=0x7fde580b0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:40.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.837+0000 7fde5659c700 1 --2- 172.21.15.49:0/1084704604 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fde58157660 0x7fde580b0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:40.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.837+0000 7fde5659c700 1 -- 172.21.15.49:0/1084704604 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde580c1750 msgr2=0x7fde58146bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:40.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.837+0000 7fde5659c700 1 --2- 172.21.15.49:0/1084704604 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde580c1750 0x7fde58146bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:40.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.837+0000 7fde5659c700 1 -- 172.21.15.49:0/1084704604 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde400092a0 con 0x7fde580c0180 2023-11-30T18:39:40.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.837+0000 7fde5659c700 1 --2- 172.21.15.49:0/1084704604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde580c0180 0x7fde58151ff0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7fde50001eb0 tx=0x7fde50007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:40.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.837+0000 7fde4e7fc700 1 -- 172.21.15.49:0/1084704604 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde500072e0 con 0x7fde580c0180 2023-11-30T18:39:40.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.837+0000 7fde4e7fc700 1 -- 172.21.15.49:0/1084704604 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde50007440 con 0x7fde580c0180 2023-11-30T18:39:40.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.837+0000 7fde5759e700 1 -- 172.21.15.49:0/1084704604 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde580afc60 con 0x7fde580c0180 2023-11-30T18:39:40.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.837+0000 7fde4e7fc700 1 -- 172.21.15.49:0/1084704604 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde500057a0 con 0x7fde580c0180 2023-11-30T18:39:40.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.837+0000 7fde5759e700 1 -- 172.21.15.49:0/1084704604 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde581470c0 con 0x7fde580c0180 2023-11-30T18:39:40.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.839+0000 7fde5759e700 1 -- 172.21.15.49:0/1084704604 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde580b0590 con 0x7fde580c0180 2023-11-30T18:39:40.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.839+0000 7fde4e7fc700 1 -- 172.21.15.49:0/1084704604 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fde50005b90 con 0x7fde580c0180 2023-11-30T18:39:40.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.839+0000 7fde4e7fc700 1 --2- 172.21.15.49:0/1084704604 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fde3805f270 0x7fde38061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:40.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.839+0000 7fde4e7fc700 1 -- 172.21.15.49:0/1084704604 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6205+0+0 (secure 0 0 0) 0x7fde50079ca0 con 0x7fde580c0180 2023-11-30T18:39:40.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.839+0000 7fde55d9b700 1 --2- 172.21.15.49:0/1084704604 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fde3805f270 0x7fde38061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:40.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.840+0000 7fde55d9b700 1 --2- 172.21.15.49:0/1084704604 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fde3805f270 0x7fde38061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fde580ca5a0 tx=0x7fde40017000).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:40.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:40.843+0000 7fde4e7fc700 1 -- 172.21.15.49:0/1084704604 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fde5004ada0 con 0x7fde580c0180 2023-11-30T18:39:41.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.014+0000 7fde5759e700 1 -- 172.21.15.49:0/1084704604 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde5806c7c0 con 0x7fde580c0180 2023-11-30T18:39:41.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.015+0000 7fde4e7fc700 1 -- 172.21.15.49:0/1084704604 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v203) v1 ==== 74+0+17077 (secure 0 0 0) 0x7fde5004e3c0 con 0x7fde580c0180 2023-11-30T18:39:41.016 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:39:41.017 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":203,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:39:38.322090+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-11-30T18:39:35.697536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-11-30T18:39:36.299739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"203","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:39:41.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.017+0000 7fde5759e700 1 -- 172.21.15.49:0/1084704604 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fde3805f270 msgr2=0x7fde38061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:41.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.017+0000 7fde5759e700 1 --2- 172.21.15.49:0/1084704604 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fde3805f270 0x7fde38061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fde580ca5a0 tx=0x7fde40017000).stop 2023-11-30T18:39:41.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.017+0000 7fde5759e700 1 -- 172.21.15.49:0/1084704604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde580c0180 msgr2=0x7fde58151ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:41.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.017+0000 7fde5759e700 1 --2- 172.21.15.49:0/1084704604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde580c0180 0x7fde58151ff0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7fde50001eb0 tx=0x7fde50007e90).stop 2023-11-30T18:39:41.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.017+0000 7fde5759e700 1 -- 172.21.15.49:0/1084704604 shutdown_connections 2023-11-30T18:39:41.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.017+0000 7fde5759e700 1 --2- 172.21.15.49:0/1084704604 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fde3805f270 0x7fde38061730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:41.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.017+0000 7fde5759e700 1 --2- 172.21.15.49:0/1084704604 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fde58157660 0x7fde580b0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:41.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.017+0000 7fde5759e700 1 --2- 172.21.15.49:0/1084704604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde580c0180 0x7fde58151ff0 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:41.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.017+0000 7fde5759e700 1 --2- 172.21.15.49:0/1084704604 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde580c1750 0x7fde58146bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:41.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.017+0000 7fde5759e700 1 -- 172.21.15.49:0/1084704604 >> 172.21.15.49:0/1084704604 conn(0x7fde580cb000 msgr2=0x7fde580aae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:41.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.017+0000 7fde5759e700 1 -- 172.21.15.49:0/1084704604 shutdown_connections 2023-11-30T18:39:41.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.017+0000 7fde5759e700 1 -- 172.21.15.49:0/1084704604 wait complete. 2023-11-30T18:39:41.030 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-30T18:39:41.031 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T18:39:41.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.147+0000 7f1589538700 1 Processor -- start 2023-11-30T18:39:41.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.148+0000 7f1589538700 1 -- start start 2023-11-30T18:39:41.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.148+0000 7f1589538700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f15840cae90 0x7f15840c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:41.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.148+0000 7f1589538700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f15840ca180 0x7f15840c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:41.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.148+0000 7f1589538700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15840a9a90 con 0x7f15840caab0 2023-11-30T18:39:41.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.148+0000 7f1589538700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15840c1490 con 0x7f15840cae90 2023-11-30T18:39:41.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.148+0000 7f1589538700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1584154ce0 con 0x7f15840ca180 2023-11-30T18:39:41.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.148+0000 7f15827fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f15840cae90 0x7f15840c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:41.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.148+0000 7f1582ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f15840caab0 0x7f15840aa470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58386/0 (socket says 172.21.15.49:58386) 2023-11-30T18:39:41.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.149+0000 7f1582ffd700 1 -- 172.21.15.49:0/961648839 learned_addr learned my addr 172.21.15.49:0/961648839 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:41.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.149+0000 7f15837fe700 1 --2- 172.21.15.49:0/961648839 >> v2:172.21.15.115:3300/0 conn(0x7f15840ca180 0x7f15840c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:41.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.149+0000 7f15827fc700 1 -- 172.21.15.49:0/961648839 >> v2:172.21.15.115:3300/0 conn(0x7f15840ca180 msgr2=0x7f15840c0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:41.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.149+0000 7f15827fc700 1 --2- 172.21.15.49:0/961648839 >> v2:172.21.15.115:3300/0 conn(0x7f15840ca180 0x7f15840c0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:41.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.149+0000 7f1581ffb700 1 -- 172.21.15.49:0/961648839 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3825808366 0 0) 0x7f15840a9a90 con 0x7f15840caab0 2023-11-30T18:39:41.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.149+0000 7f15827fc700 1 -- 172.21.15.49:0/961648839 >> v1:172.21.15.49:6789/0 conn(0x7f15840caab0 legacy=0x7f15840aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:41.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.149+0000 7f15827fc700 1 -- 172.21.15.49:0/961648839 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15840aab80 con 0x7f15840cae90 2023-11-30T18:39:41.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.149+0000 7f15827fc700 1 --2- 172.21.15.49:0/961648839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15840cae90 0x7f15840c0ab0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7f15840a9a00 tx=0x7f156c009060).ready entity=mon.0 client_cookie=8ed3408be31aaa84 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:41.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.149+0000 7f1581ffb700 1 -- 172.21.15.49:0/961648839 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c00b580 con 0x7f15840cae90 2023-11-30T18:39:41.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.149+0000 7f1581ffb700 1 -- 172.21.15.49:0/961648839 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156c00b6e0 con 0x7f15840cae90 2023-11-30T18:39:41.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.149+0000 7f1581ffb700 1 -- 172.21.15.49:0/961648839 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c00ba60 con 0x7f15840cae90 2023-11-30T18:39:41.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.150+0000 7f1589538700 1 -- 172.21.15.49:0/961648839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15840cae90 msgr2=0x7f15840c0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:41.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.150+0000 7f1589538700 1 --2- 172.21.15.49:0/961648839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15840cae90 0x7f15840c0ab0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7f15840a9a00 tx=0x7f156c009060).stop 2023-11-30T18:39:41.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.150+0000 7f1589538700 1 -- 172.21.15.49:0/961648839 shutdown_connections 2023-11-30T18:39:41.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.150+0000 7f1589538700 1 --2- 172.21.15.49:0/961648839 >> v2:172.21.15.115:3300/0 conn(0x7f15840ca180 0x7f15840c0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:41.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.150+0000 7f1589538700 1 --2- 172.21.15.49:0/961648839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15840cae90 0x7f15840c0ab0 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:41.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.150+0000 7f1589538700 1 -- 172.21.15.49:0/961648839 >> 172.21.15.49:0/961648839 conn(0x7f1584094920 msgr2=0x7f158406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:41.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.150+0000 7f1589538700 1 -- 172.21.15.49:0/961648839 shutdown_connections 2023-11-30T18:39:41.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.150+0000 7f1589538700 1 -- 172.21.15.49:0/961648839 wait complete. 2023-11-30T18:39:41.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.151+0000 7f1589538700 1 Processor -- start 2023-11-30T18:39:41.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.151+0000 7f1589538700 1 -- start start 2023-11-30T18:39:41.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.152+0000 7f1589538700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15840ca180 0x7f1584147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:41.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.152+0000 7f1589538700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15840caab0 0x7f15840c3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:41.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.152+0000 7f1589538700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15840cae90 0x7f15840af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:41.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.152+0000 7f1589538700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15840c4a40 con 0x7f15840ca180 2023-11-30T18:39:41.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.152+0000 7f1589538700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1584148490 con 0x7f15840cae90 2023-11-30T18:39:41.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.152+0000 7f1589538700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15840c3e30 con 0x7f15840caab0 2023-11-30T18:39:41.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.152+0000 7f1582ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15840ca180 0x7f1584147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:41.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.152+0000 7f1582ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15840ca180 0x7f1584147fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59778/0 (socket says 172.21.15.49:59778) 2023-11-30T18:39:41.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.152+0000 7f1582ffd700 1 -- 172.21.15.49:0/2738087640 learned_addr learned my addr 172.21.15.49:0/2738087640 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:41.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.152+0000 7f15837fe700 1 --2- 172.21.15.49:0/2738087640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15840cae90 0x7f15840af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:41.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.152+0000 7f15827fc700 1 --2- 172.21.15.49:0/2738087640 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15840caab0 0x7f15840c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:41.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.152+0000 7f1582ffd700 1 -- 172.21.15.49:0/2738087640 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15840caab0 msgr2=0x7f15840c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:41.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.152+0000 7f1582ffd700 1 --2- 172.21.15.49:0/2738087640 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15840caab0 0x7f15840c3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:41.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.152+0000 7f1582ffd700 1 -- 172.21.15.49:0/2738087640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15840cae90 msgr2=0x7f15840af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:41.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.152+0000 7f1582ffd700 1 --2- 172.21.15.49:0/2738087640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15840cae90 0x7f15840af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:41.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.152+0000 7f1582ffd700 1 -- 172.21.15.49:0/2738087640 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156c0092a0 con 0x7f15840ca180 2023-11-30T18:39:41.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.152+0000 7f1582ffd700 1 --2- 172.21.15.49:0/2738087640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15840ca180 0x7f1584147fa0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 rx=0x7f157c00c7f0 tx=0x7f157c007e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:41.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.152+0000 7f157affd700 1 -- 172.21.15.49:0/2738087640 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c005c00 con 0x7f15840ca180 2023-11-30T18:39:41.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.153+0000 7f157affd700 1 -- 172.21.15.49:0/2738087640 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157c005d60 con 0x7f15840ca180 2023-11-30T18:39:41.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.153+0000 7f1589538700 1 -- 172.21.15.49:0/2738087640 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15840c4110 con 0x7f15840ca180 2023-11-30T18:39:41.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.153+0000 7f157affd700 1 -- 172.21.15.49:0/2738087640 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c007340 con 0x7f15840ca180 2023-11-30T18:39:41.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.153+0000 7f1589538700 1 -- 172.21.15.49:0/2738087640 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15840c46d0 con 0x7f15840ca180 2023-11-30T18:39:41.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.154+0000 7f1589538700 1 -- 172.21.15.49:0/2738087640 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f158406c860 con 0x7f15840ca180 2023-11-30T18:39:41.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.154+0000 7f157affd700 1 -- 172.21.15.49:0/2738087640 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f157c0076f0 con 0x7f15840ca180 2023-11-30T18:39:41.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.154+0000 7f157affd700 1 --2- 172.21.15.49:0/2738087640 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f156405f270 0x7f1564061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:41.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.154+0000 7f157affd700 1 -- 172.21.15.49:0/2738087640 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6205+0+0 (secure 0 0 0) 0x7f157c07a360 con 0x7f15840ca180 2023-11-30T18:39:41.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.155+0000 7f15827fc700 1 --2- 172.21.15.49:0/2738087640 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f156405f270 0x7f1564061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:41.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.155+0000 7f15827fc700 1 --2- 172.21.15.49:0/2738087640 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f156405f270 0x7f1564061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f156c00b340 tx=0x7f156c017000).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:41.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.158+0000 7f157affd700 1 -- 172.21.15.49:0/2738087640 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f157c04b460 con 0x7f15840ca180 2023-11-30T18:39:41.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.329+0000 7f1589538700 1 -- 172.21.15.49:0/2738087640 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f15840c4b80 con 0x7f156405f270 2023-11-30T18:39:41.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.340+0000 7f157affd700 1 -- 172.21.15.49:0/2738087640 <== mgr.7760 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359132 (secure 0 0 0) 0x7f156c000d00 con 0x7f156405f270 2023-11-30T18:39:41.345 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:39:41.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.344+0000 7f1589538700 1 -- 172.21.15.49:0/2738087640 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f156405f270 msgr2=0x7f1564061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:41.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.344+0000 7f1589538700 1 --2- 172.21.15.49:0/2738087640 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f156405f270 0x7f1564061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f156c00b340 tx=0x7f156c017000).stop 2023-11-30T18:39:41.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.344+0000 7f1589538700 1 -- 172.21.15.49:0/2738087640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15840ca180 msgr2=0x7f1584147fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:41.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.344+0000 7f1589538700 1 --2- 172.21.15.49:0/2738087640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15840ca180 0x7f1584147fa0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 rx=0x7f157c00c7f0 tx=0x7f157c007e80).stop 2023-11-30T18:39:41.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.344+0000 7f1589538700 1 -- 172.21.15.49:0/2738087640 shutdown_connections 2023-11-30T18:39:41.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.344+0000 7f1589538700 1 --2- 172.21.15.49:0/2738087640 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f156405f270 0x7f1564061730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:41.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.344+0000 7f1589538700 1 --2- 172.21.15.49:0/2738087640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15840cae90 0x7f15840af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:41.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.344+0000 7f1589538700 1 --2- 172.21.15.49:0/2738087640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15840ca180 0x7f1584147fa0 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:41.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.344+0000 7f1589538700 1 --2- 172.21.15.49:0/2738087640 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15840caab0 0x7f15840c3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:41.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.344+0000 7f1589538700 1 -- 172.21.15.49:0/2738087640 >> 172.21.15.49:0/2738087640 conn(0x7f1584094920 msgr2=0x7f1584158320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:41.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.344+0000 7f1589538700 1 -- 172.21.15.49:0/2738087640 shutdown_connections 2023-11-30T18:39:41.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.344+0000 7f1589538700 1 -- 172.21.15.49:0/2738087640 wait complete. 2023-11-30T18:39:41.352 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T18:39:41.358 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-30T18:39:40.642877+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1414,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":208,"acting":208,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":216,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2449904,"kb_used_data":19760,"kb_used_omap":0,"kb_used_meta":2430080,"kb_avail":752524816,"statfs":{"total":773094113280,"available":770585411584,"internally_reserved":0,"allocated":20234240,"data_stored":10371452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2488401920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-594407,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-210,"num_write_kb":-721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.004735"},"pg_stats":[{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349312+0000","last_change":"2023-11-30T18:39:37.344457+0000","last_active":"2023-11-30T18:39:37.349312+0000","last_peered":"2023-11-30T18:39:37.349312+0000","last_clean":"2023-11-30T18:39:37.349312+0000","last_became_active":"2023-11-30T18:39:37.344174+0000","last_became_peered":"2023-11-30T18:39:37.344174+0000","last_unstale":"2023-11-30T18:39:37.349312+0000","last_undegraded":"2023-11-30T18:39:37.349312+0000","last_fullsized":"2023-11-30T18:39:37.349312+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3f","version":"202'3","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346160+0000","last_change":"2023-11-30T18:39:36.952718+0000","last_active":"2023-11-30T18:39:37.346160+0000","last_peered":"2023-11-30T18:39:37.346160+0000","last_clean":"2023-11-30T18:39:37.346160+0000","last_became_active":"2023-11-30T18:39:36.952412+0000","last_became_peered":"2023-11-30T18:39:36.952412+0000","last_unstale":"2023-11-30T18:39:37.346160+0000","last_undegraded":"2023-11-30T18:39:37.346160+0000","last_fullsized":"2023-11-30T18:39:37.346160+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.342165+0000","last_change":"2023-11-30T18:39:37.339227+0000","last_active":"2023-11-30T18:39:37.342165+0000","last_peered":"2023-11-30T18:39:37.342165+0000","last_clean":"2023-11-30T18:39:37.342165+0000","last_became_active":"2023-11-30T18:39:37.338774+0000","last_became_peered":"2023-11-30T18:39:37.338774+0000","last_unstale":"2023-11-30T18:39:37.342165+0000","last_undegraded":"2023-11-30T18:39:37.342165+0000","last_fullsized":"2023-11-30T18:39:37.342165+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349301+0000","last_change":"2023-11-30T18:39:37.345801+0000","last_active":"2023-11-30T18:39:37.349301+0000","last_peered":"2023-11-30T18:39:37.349301+0000","last_clean":"2023-11-30T18:39:37.349301+0000","last_became_active":"2023-11-30T18:39:37.345516+0000","last_became_peered":"2023-11-30T18:39:37.345516+0000","last_unstale":"2023-11-30T18:39:37.349301+0000","last_undegraded":"2023-11-30T18:39:37.349301+0000","last_fullsized":"2023-11-30T18:39:37.349301+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3c","version":"202'2","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347142+0000","last_change":"2023-11-30T18:39:36.949667+0000","last_active":"2023-11-30T18:39:37.347142+0000","last_peered":"2023-11-30T18:39:37.347142+0000","last_clean":"2023-11-30T18:39:37.347142+0000","last_became_active":"2023-11-30T18:39:36.949238+0000","last_became_peered":"2023-11-30T18:39:36.949238+0000","last_unstale":"2023-11-30T18:39:37.347142+0000","last_undegraded":"2023-11-30T18:39:37.347142+0000","last_fullsized":"2023-11-30T18:39:37.347142+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.351900+0000","last_change":"2023-11-30T18:39:37.349000+0000","last_active":"2023-11-30T18:39:37.351900+0000","last_peered":"2023-11-30T18:39:37.351900+0000","last_clean":"2023-11-30T18:39:37.351900+0000","last_became_active":"2023-11-30T18:39:37.348658+0000","last_became_peered":"2023-11-30T18:39:37.348658+0000","last_unstale":"2023-11-30T18:39:37.351900+0000","last_undegraded":"2023-11-30T18:39:37.351900+0000","last_fullsized":"2023-11-30T18:39:37.351900+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3a","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346845+0000","last_change":"2023-11-30T18:39:36.948257+0000","last_active":"2023-11-30T18:39:37.346845+0000","last_peered":"2023-11-30T18:39:37.346845+0000","last_clean":"2023-11-30T18:39:37.346845+0000","last_became_active":"2023-11-30T18:39:36.947769+0000","last_became_peered":"2023-11-30T18:39:36.947769+0000","last_unstale":"2023-11-30T18:39:37.346845+0000","last_undegraded":"2023-11-30T18:39:37.346845+0000","last_fullsized":"2023-11-30T18:39:37.346845+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347404+0000","last_change":"2023-11-30T18:39:37.345626+0000","last_active":"2023-11-30T18:39:37.347404+0000","last_peered":"2023-11-30T18:39:37.347404+0000","last_clean":"2023-11-30T18:39:37.347404+0000","last_became_active":"2023-11-30T18:39:37.345347+0000","last_became_peered":"2023-11-30T18:39:37.345347+0000","last_unstale":"2023-11-30T18:39:37.347404+0000","last_undegraded":"2023-11-30T18:39:37.347404+0000","last_fullsized":"2023-11-30T18:39:37.347404+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.333622+0000","last_change":"2023-11-30T18:39:36.946508+0000","last_active":"2023-11-30T18:39:37.333622+0000","last_peered":"2023-11-30T18:39:37.333622+0000","last_clean":"2023-11-30T18:39:37.333622+0000","last_became_active":"2023-11-30T18:39:36.946260+0000","last_became_peered":"2023-11-30T18:39:36.946260+0000","last_unstale":"2023-11-30T18:39:37.333622+0000","last_undegraded":"2023-11-30T18:39:37.333622+0000","last_fullsized":"2023-11-30T18:39:37.333622+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347329+0000","last_change":"2023-11-30T18:39:37.344153+0000","last_active":"2023-11-30T18:39:37.347329+0000","last_peered":"2023-11-30T18:39:37.347329+0000","last_clean":"2023-11-30T18:39:37.347329+0000","last_became_active":"2023-11-30T18:39:37.343879+0000","last_became_peered":"2023-11-30T18:39:37.343879+0000","last_unstale":"2023-11-30T18:39:37.347329+0000","last_undegraded":"2023-11-30T18:39:37.347329+0000","last_fullsized":"2023-11-30T18:39:37.347329+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347574+0000","last_change":"2023-11-30T18:39:37.343067+0000","last_active":"2023-11-30T18:39:37.347574+0000","last_peered":"2023-11-30T18:39:37.347574+0000","last_clean":"2023-11-30T18:39:37.347574+0000","last_became_active":"2023-11-30T18:39:37.338376+0000","last_became_peered":"2023-11-30T18:39:37.338376+0000","last_unstale":"2023-11-30T18:39:37.347574+0000","last_undegraded":"2023-11-30T18:39:37.347574+0000","last_fullsized":"2023-11-30T18:39:37.347574+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.343031+0000","last_change":"2023-11-30T18:39:37.336599+0000","last_active":"2023-11-30T18:39:37.343031+0000","last_peered":"2023-11-30T18:39:37.343031+0000","last_clean":"2023-11-30T18:39:37.343031+0000","last_became_active":"2023-11-30T18:39:37.336034+0000","last_became_peered":"2023-11-30T18:39:37.336034+0000","last_unstale":"2023-11-30T18:39:37.343031+0000","last_undegraded":"2023-11-30T18:39:37.343031+0000","last_fullsized":"2023-11-30T18:39:37.343031+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346994+0000","last_change":"2023-11-30T18:39:37.344677+0000","last_active":"2023-11-30T18:39:37.346994+0000","last_peered":"2023-11-30T18:39:37.346994+0000","last_clean":"2023-11-30T18:39:37.346994+0000","last_became_active":"2023-11-30T18:39:37.344361+0000","last_became_peered":"2023-11-30T18:39:37.344361+0000","last_unstale":"2023-11-30T18:39:37.346994+0000","last_undegraded":"2023-11-30T18:39:37.346994+0000","last_fullsized":"2023-11-30T18:39:37.346994+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349920+0000","last_change":"2023-11-30T18:39:37.346869+0000","last_active":"2023-11-30T18:39:37.349920+0000","last_peered":"2023-11-30T18:39:37.349920+0000","last_clean":"2023-11-30T18:39:37.349920+0000","last_became_active":"2023-11-30T18:39:37.346571+0000","last_became_peered":"2023-11-30T18:39:37.346571+0000","last_unstale":"2023-11-30T18:39:37.349920+0000","last_undegraded":"2023-11-30T18:39:37.349920+0000","last_fullsized":"2023-11-30T18:39:37.349920+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349366+0000","last_change":"2023-11-30T18:39:37.345080+0000","last_active":"2023-11-30T18:39:37.349366+0000","last_peered":"2023-11-30T18:39:37.349366+0000","last_clean":"2023-11-30T18:39:37.349366+0000","last_became_active":"2023-11-30T18:39:37.344759+0000","last_became_peered":"2023-11-30T18:39:37.344759+0000","last_unstale":"2023-11-30T18:39:37.349366+0000","last_undegraded":"2023-11-30T18:39:37.349366+0000","last_fullsized":"2023-11-30T18:39:37.349366+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352812+0000","last_change":"2023-11-30T18:39:37.351277+0000","last_active":"2023-11-30T18:39:37.352812+0000","last_peered":"2023-11-30T18:39:37.352812+0000","last_clean":"2023-11-30T18:39:37.352812+0000","last_became_active":"2023-11-30T18:39:37.351026+0000","last_became_peered":"2023-11-30T18:39:37.351026+0000","last_unstale":"2023-11-30T18:39:37.352812+0000","last_undegraded":"2023-11-30T18:39:37.352812+0000","last_fullsized":"2023-11-30T18:39:37.352812+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346081+0000","last_change":"2023-11-30T18:39:37.338925+0000","last_active":"2023-11-30T18:39:37.346081+0000","last_peered":"2023-11-30T18:39:37.346081+0000","last_clean":"2023-11-30T18:39:37.346081+0000","last_became_active":"2023-11-30T18:39:37.338608+0000","last_became_peered":"2023-11-30T18:39:37.338608+0000","last_unstale":"2023-11-30T18:39:37.346081+0000","last_undegraded":"2023-11-30T18:39:37.346081+0000","last_fullsized":"2023-11-30T18:39:37.346081+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.329742+0000","last_change":"2023-11-30T18:39:36.949738+0000","last_active":"2023-11-30T18:39:37.329742+0000","last_peered":"2023-11-30T18:39:37.329742+0000","last_clean":"2023-11-30T18:39:37.329742+0000","last_became_active":"2023-11-30T18:39:36.949398+0000","last_became_peered":"2023-11-30T18:39:36.949398+0000","last_unstale":"2023-11-30T18:39:37.329742+0000","last_undegraded":"2023-11-30T18:39:37.329742+0000","last_fullsized":"2023-11-30T18:39:37.329742+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352073+0000","last_change":"2023-11-30T18:39:37.347542+0000","last_active":"2023-11-30T18:39:37.352073+0000","last_peered":"2023-11-30T18:39:37.352073+0000","last_clean":"2023-11-30T18:39:37.352073+0000","last_became_active":"2023-11-30T18:39:37.347265+0000","last_became_peered":"2023-11-30T18:39:37.347265+0000","last_unstale":"2023-11-30T18:39:37.352073+0000","last_undegraded":"2023-11-30T18:39:37.352073+0000","last_fullsized":"2023-11-30T18:39:37.352073+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.30","version":"202'4","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.350561+0000","last_change":"2023-11-30T18:39:36.951234+0000","last_active":"2023-11-30T18:39:37.350561+0000","last_peered":"2023-11-30T18:39:37.350561+0000","last_clean":"2023-11-30T18:39:37.350561+0000","last_became_active":"2023-11-30T18:39:36.950335+0000","last_became_peered":"2023-11-30T18:39:36.950335+0000","last_unstale":"2023-11-30T18:39:37.350561+0000","last_undegraded":"2023-11-30T18:39:37.350561+0000","last_fullsized":"2023-11-30T18:39:37.350561+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.326222+0000","last_change":"2023-11-30T18:39:36.949535+0000","last_active":"2023-11-30T18:39:37.326222+0000","last_peered":"2023-11-30T18:39:37.326222+0000","last_clean":"2023-11-30T18:39:37.326222+0000","last_became_active":"2023-11-30T18:39:36.949241+0000","last_became_peered":"2023-11-30T18:39:36.949241+0000","last_unstale":"2023-11-30T18:39:37.326222+0000","last_undegraded":"2023-11-30T18:39:37.326222+0000","last_fullsized":"2023-11-30T18:39:37.326222+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.337654+0000","last_change":"2023-11-30T18:39:36.949130+0000","last_active":"2023-11-30T18:39:37.337654+0000","last_peered":"2023-11-30T18:39:37.337654+0000","last_clean":"2023-11-30T18:39:37.337654+0000","last_became_active":"2023-11-30T18:39:36.946324+0000","last_became_peered":"2023-11-30T18:39:36.946324+0000","last_unstale":"2023-11-30T18:39:37.337654+0000","last_undegraded":"2023-11-30T18:39:37.337654+0000","last_fullsized":"2023-11-30T18:39:37.337654+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2d","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347422+0000","last_change":"2023-11-30T18:39:36.943783+0000","last_active":"2023-11-30T18:39:37.347422+0000","last_peered":"2023-11-30T18:39:37.347422+0000","last_clean":"2023-11-30T18:39:37.347422+0000","last_became_active":"2023-11-30T18:39:36.943292+0000","last_became_peered":"2023-11-30T18:39:36.943292+0000","last_unstale":"2023-11-30T18:39:37.347422+0000","last_undegraded":"2023-11-30T18:39:37.347422+0000","last_fullsized":"2023-11-30T18:39:37.347422+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349567+0000","last_change":"2023-11-30T18:39:37.346979+0000","last_active":"2023-11-30T18:39:37.349567+0000","last_peered":"2023-11-30T18:39:37.349567+0000","last_clean":"2023-11-30T18:39:37.349567+0000","last_became_active":"2023-11-30T18:39:37.346664+0000","last_became_peered":"2023-11-30T18:39:37.346664+0000","last_unstale":"2023-11-30T18:39:37.349567+0000","last_undegraded":"2023-11-30T18:39:37.349567+0000","last_fullsized":"2023-11-30T18:39:37.349567+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.353489+0000","last_change":"2023-11-30T18:39:37.352660+0000","last_active":"2023-11-30T18:39:37.353489+0000","last_peered":"2023-11-30T18:39:37.353489+0000","last_clean":"2023-11-30T18:39:37.353489+0000","last_became_active":"2023-11-30T18:39:37.352052+0000","last_became_peered":"2023-11-30T18:39:37.352052+0000","last_unstale":"2023-11-30T18:39:37.353489+0000","last_undegraded":"2023-11-30T18:39:37.353489+0000","last_fullsized":"2023-11-30T18:39:37.353489+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.343254+0000","last_change":"2023-11-30T18:39:36.952248+0000","last_active":"2023-11-30T18:39:37.343254+0000","last_peered":"2023-11-30T18:39:37.343254+0000","last_clean":"2023-11-30T18:39:37.343254+0000","last_became_active":"2023-11-30T18:39:36.951960+0000","last_became_peered":"2023-11-30T18:39:36.951960+0000","last_unstale":"2023-11-30T18:39:37.343254+0000","last_undegraded":"2023-11-30T18:39:37.343254+0000","last_fullsized":"2023-11-30T18:39:37.343254+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349666+0000","last_change":"2023-11-30T18:39:37.346628+0000","last_active":"2023-11-30T18:39:37.349666+0000","last_peered":"2023-11-30T18:39:37.349666+0000","last_clean":"2023-11-30T18:39:37.349666+0000","last_became_active":"2023-11-30T18:39:37.346349+0000","last_became_peered":"2023-11-30T18:39:37.346349+0000","last_unstale":"2023-11-30T18:39:37.349666+0000","last_undegraded":"2023-11-30T18:39:37.349666+0000","last_fullsized":"2023-11-30T18:39:37.349666+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347382+0000","last_change":"2023-11-30T18:39:37.344874+0000","last_active":"2023-11-30T18:39:37.347382+0000","last_peered":"2023-11-30T18:39:37.347382+0000","last_clean":"2023-11-30T18:39:37.347382+0000","last_became_active":"2023-11-30T18:39:37.344613+0000","last_became_peered":"2023-11-30T18:39:37.344613+0000","last_unstale":"2023-11-30T18:39:37.347382+0000","last_undegraded":"2023-11-30T18:39:37.347382+0000","last_fullsized":"2023-11-30T18:39:37.347382+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.323906+0000","last_change":"2023-11-30T18:39:36.946087+0000","last_active":"2023-11-30T18:39:37.323906+0000","last_peered":"2023-11-30T18:39:37.323906+0000","last_clean":"2023-11-30T18:39:37.323906+0000","last_became_active":"2023-11-30T18:39:36.945402+0000","last_became_peered":"2023-11-30T18:39:36.945402+0000","last_unstale":"2023-11-30T18:39:37.323906+0000","last_undegraded":"2023-11-30T18:39:37.323906+0000","last_fullsized":"2023-11-30T18:39:37.323906+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.348211+0000","last_change":"2023-11-30T18:39:37.344635+0000","last_active":"2023-11-30T18:39:37.348211+0000","last_peered":"2023-11-30T18:39:37.348211+0000","last_clean":"2023-11-30T18:39:37.348211+0000","last_became_active":"2023-11-30T18:39:37.344167+0000","last_became_peered":"2023-11-30T18:39:37.344167+0000","last_unstale":"2023-11-30T18:39:37.348211+0000","last_undegraded":"2023-11-30T18:39:37.348211+0000","last_fullsized":"2023-11-30T18:39:37.348211+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349334+0000","last_change":"2023-11-30T18:39:37.344920+0000","last_active":"2023-11-30T18:39:37.349334+0000","last_peered":"2023-11-30T18:39:37.349334+0000","last_clean":"2023-11-30T18:39:37.349334+0000","last_became_active":"2023-11-30T18:39:37.344397+0000","last_became_peered":"2023-11-30T18:39:37.344397+0000","last_unstale":"2023-11-30T18:39:37.349334+0000","last_undegraded":"2023-11-30T18:39:37.349334+0000","last_fullsized":"2023-11-30T18:39:37.349334+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.340948+0000","last_change":"2023-11-30T18:39:37.339921+0000","last_active":"2023-11-30T18:39:37.340948+0000","last_peered":"2023-11-30T18:39:37.340948+0000","last_clean":"2023-11-30T18:39:37.340948+0000","last_became_active":"2023-11-30T18:39:37.339659+0000","last_became_peered":"2023-11-30T18:39:37.339659+0000","last_unstale":"2023-11-30T18:39:37.340948+0000","last_undegraded":"2023-11-30T18:39:37.340948+0000","last_fullsized":"2023-11-30T18:39:37.340948+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.331794+0000","last_change":"2023-11-30T18:39:36.952942+0000","last_active":"2023-11-30T18:39:37.331794+0000","last_peered":"2023-11-30T18:39:37.331794+0000","last_clean":"2023-11-30T18:39:37.331794+0000","last_became_active":"2023-11-30T18:39:36.952663+0000","last_became_peered":"2023-11-30T18:39:36.952663+0000","last_unstale":"2023-11-30T18:39:37.331794+0000","last_undegraded":"2023-11-30T18:39:37.331794+0000","last_fullsized":"2023-11-30T18:39:37.331794+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349529+0000","last_change":"2023-11-30T18:39:37.345821+0000","last_active":"2023-11-30T18:39:37.349529+0000","last_peered":"2023-11-30T18:39:37.349529+0000","last_clean":"2023-11-30T18:39:37.349529+0000","last_became_active":"2023-11-30T18:39:37.345470+0000","last_became_peered":"2023-11-30T18:39:37.345470+0000","last_unstale":"2023-11-30T18:39:37.349529+0000","last_undegraded":"2023-11-30T18:39:37.349529+0000","last_fullsized":"2023-11-30T18:39:37.349529+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.348203+0000","last_change":"2023-11-30T18:39:37.344683+0000","last_active":"2023-11-30T18:39:37.348203+0000","last_peered":"2023-11-30T18:39:37.348203+0000","last_clean":"2023-11-30T18:39:37.348203+0000","last_became_active":"2023-11-30T18:39:37.344395+0000","last_became_peered":"2023-11-30T18:39:37.344395+0000","last_unstale":"2023-11-30T18:39:37.348203+0000","last_undegraded":"2023-11-30T18:39:37.348203+0000","last_fullsized":"2023-11-30T18:39:37.348203+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327088+0000","last_change":"2023-11-30T18:39:36.940369+0000","last_active":"2023-11-30T18:39:37.327088+0000","last_peered":"2023-11-30T18:39:37.327088+0000","last_clean":"2023-11-30T18:39:37.327088+0000","last_became_active":"2023-11-30T18:39:36.940068+0000","last_became_peered":"2023-11-30T18:39:36.940068+0000","last_unstale":"2023-11-30T18:39:37.327088+0000","last_undegraded":"2023-11-30T18:39:37.327088+0000","last_fullsized":"2023-11-30T18:39:37.327088+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.344294+0000","last_change":"2023-11-30T18:39:37.339378+0000","last_active":"2023-11-30T18:39:37.344294+0000","last_peered":"2023-11-30T18:39:37.344294+0000","last_clean":"2023-11-30T18:39:37.344294+0000","last_became_active":"2023-11-30T18:39:37.339129+0000","last_became_peered":"2023-11-30T18:39:37.339129+0000","last_unstale":"2023-11-30T18:39:37.344294+0000","last_undegraded":"2023-11-30T18:39:37.344294+0000","last_fullsized":"2023-11-30T18:39:37.344294+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.338109+0000","last_change":"2023-11-30T18:39:36.951143+0000","last_active":"2023-11-30T18:39:37.338109+0000","last_peered":"2023-11-30T18:39:37.338109+0000","last_clean":"2023-11-30T18:39:37.338109+0000","last_became_active":"2023-11-30T18:39:36.949920+0000","last_became_peered":"2023-11-30T18:39:36.949920+0000","last_unstale":"2023-11-30T18:39:37.338109+0000","last_undegraded":"2023-11-30T18:39:37.338109+0000","last_fullsized":"2023-11-30T18:39:37.338109+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.336742+0000","last_change":"2023-11-30T18:39:36.946323+0000","last_active":"2023-11-30T18:39:37.336742+0000","last_peered":"2023-11-30T18:39:37.336742+0000","last_clean":"2023-11-30T18:39:37.336742+0000","last_became_active":"2023-11-30T18:39:36.946044+0000","last_became_peered":"2023-11-30T18:39:36.946044+0000","last_unstale":"2023-11-30T18:39:37.336742+0000","last_undegraded":"2023-11-30T18:39:37.336742+0000","last_fullsized":"2023-11-30T18:39:37.336742+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.340269+0000","last_change":"2023-11-30T18:39:37.331035+0000","last_active":"2023-11-30T18:39:37.340269+0000","last_peered":"2023-11-30T18:39:37.340269+0000","last_clean":"2023-11-30T18:39:37.340269+0000","last_became_active":"2023-11-30T18:39:37.330729+0000","last_became_peered":"2023-11-30T18:39:37.330729+0000","last_unstale":"2023-11-30T18:39:37.340269+0000","last_undegraded":"2023-11-30T18:39:37.340269+0000","last_fullsized":"2023-11-30T18:39:37.340269+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.337914+0000","last_change":"2023-11-30T18:39:36.950391+0000","last_active":"2023-11-30T18:39:37.337914+0000","last_peered":"2023-11-30T18:39:37.337914+0000","last_clean":"2023-11-30T18:39:37.337914+0000","last_became_active":"2023-11-30T18:39:36.946855+0000","last_became_peered":"2023-11-30T18:39:36.946855+0000","last_unstale":"2023-11-30T18:39:37.337914+0000","last_undegraded":"2023-11-30T18:39:37.337914+0000","last_fullsized":"2023-11-30T18:39:37.337914+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347365+0000","last_change":"2023-11-30T18:39:37.340342+0000","last_active":"2023-11-30T18:39:37.347365+0000","last_peered":"2023-11-30T18:39:37.347365+0000","last_clean":"2023-11-30T18:39:37.347365+0000","last_became_active":"2023-11-30T18:39:37.340045+0000","last_became_peered":"2023-11-30T18:39:37.340045+0000","last_unstale":"2023-11-30T18:39:37.347365+0000","last_undegraded":"2023-11-30T18:39:37.347365+0000","last_fullsized":"2023-11-30T18:39:37.347365+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352099+0000","last_change":"2023-11-30T18:39:36.948987+0000","last_active":"2023-11-30T18:39:37.352099+0000","last_peered":"2023-11-30T18:39:37.352099+0000","last_clean":"2023-11-30T18:39:37.352099+0000","last_became_active":"2023-11-30T18:39:36.947046+0000","last_became_peered":"2023-11-30T18:39:36.947046+0000","last_unstale":"2023-11-30T18:39:37.352099+0000","last_undegraded":"2023-11-30T18:39:37.352099+0000","last_fullsized":"2023-11-30T18:39:37.352099+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.345480+0000","last_change":"2023-11-30T18:39:37.341621+0000","last_active":"2023-11-30T18:39:37.345480+0000","last_peered":"2023-11-30T18:39:37.345480+0000","last_clean":"2023-11-30T18:39:37.345480+0000","last_became_active":"2023-11-30T18:39:37.341312+0000","last_became_peered":"2023-11-30T18:39:37.341312+0000","last_unstale":"2023-11-30T18:39:37.345480+0000","last_undegraded":"2023-11-30T18:39:37.345480+0000","last_fullsized":"2023-11-30T18:39:37.345480+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346986+0000","last_change":"2023-11-30T18:39:36.952827+0000","last_active":"2023-11-30T18:39:37.346986+0000","last_peered":"2023-11-30T18:39:37.346986+0000","last_clean":"2023-11-30T18:39:37.346986+0000","last_became_active":"2023-11-30T18:39:36.952608+0000","last_became_peered":"2023-11-30T18:39:36.952608+0000","last_unstale":"2023-11-30T18:39:37.346986+0000","last_undegraded":"2023-11-30T18:39:37.346986+0000","last_fullsized":"2023-11-30T18:39:37.346986+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.342144+0000","last_change":"2023-11-30T18:39:37.339035+0000","last_active":"2023-11-30T18:39:37.342144+0000","last_peered":"2023-11-30T18:39:37.342144+0000","last_clean":"2023-11-30T18:39:37.342144+0000","last_became_active":"2023-11-30T18:39:37.338479+0000","last_became_peered":"2023-11-30T18:39:37.338479+0000","last_unstale":"2023-11-30T18:39:37.342144+0000","last_undegraded":"2023-11-30T18:39:37.342144+0000","last_fullsized":"2023-11-30T18:39:37.342144+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346109+0000","last_change":"2023-11-30T18:39:37.338996+0000","last_active":"2023-11-30T18:39:37.346109+0000","last_peered":"2023-11-30T18:39:37.346109+0000","last_clean":"2023-11-30T18:39:37.346109+0000","last_became_active":"2023-11-30T18:39:37.338697+0000","last_became_peered":"2023-11-30T18:39:37.338697+0000","last_unstale":"2023-11-30T18:39:37.346109+0000","last_undegraded":"2023-11-30T18:39:37.346109+0000","last_fullsized":"2023-11-30T18:39:37.346109+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.325152+0000","last_change":"2023-11-30T18:39:36.946452+0000","last_active":"2023-11-30T18:39:37.325152+0000","last_peered":"2023-11-30T18:39:37.325152+0000","last_clean":"2023-11-30T18:39:37.325152+0000","last_became_active":"2023-11-30T18:39:36.946158+0000","last_became_peered":"2023-11-30T18:39:36.946158+0000","last_unstale":"2023-11-30T18:39:37.325152+0000","last_undegraded":"2023-11-30T18:39:37.325152+0000","last_fullsized":"2023-11-30T18:39:37.325152+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.350555+0000","last_change":"2023-11-30T18:39:37.347669+0000","last_active":"2023-11-30T18:39:37.350555+0000","last_peered":"2023-11-30T18:39:37.350555+0000","last_clean":"2023-11-30T18:39:37.350555+0000","last_became_active":"2023-11-30T18:39:37.347353+0000","last_became_peered":"2023-11-30T18:39:37.347353+0000","last_unstale":"2023-11-30T18:39:37.350555+0000","last_undegraded":"2023-11-30T18:39:37.350555+0000","last_fullsized":"2023-11-30T18:39:37.350555+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.326852+0000","last_change":"2023-11-30T18:39:36.948868+0000","last_active":"2023-11-30T18:39:37.326852+0000","last_peered":"2023-11-30T18:39:37.326852+0000","last_clean":"2023-11-30T18:39:37.326852+0000","last_became_active":"2023-11-30T18:39:36.948560+0000","last_became_peered":"2023-11-30T18:39:36.948560+0000","last_unstale":"2023-11-30T18:39:37.326852+0000","last_undegraded":"2023-11-30T18:39:37.326852+0000","last_fullsized":"2023-11-30T18:39:37.326852+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.345333+0000","last_change":"2023-11-30T18:39:37.342635+0000","last_active":"2023-11-30T18:39:37.345333+0000","last_peered":"2023-11-30T18:39:37.345333+0000","last_clean":"2023-11-30T18:39:37.345333+0000","last_became_active":"2023-11-30T18:39:37.342376+0000","last_became_peered":"2023-11-30T18:39:37.342376+0000","last_unstale":"2023-11-30T18:39:37.345333+0000","last_undegraded":"2023-11-30T18:39:37.345333+0000","last_fullsized":"2023-11-30T18:39:37.345333+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327461+0000","last_change":"2023-11-30T18:39:36.944677+0000","last_active":"2023-11-30T18:39:37.327461+0000","last_peered":"2023-11-30T18:39:37.327461+0000","last_clean":"2023-11-30T18:39:37.327461+0000","last_became_active":"2023-11-30T18:39:36.944380+0000","last_became_peered":"2023-11-30T18:39:36.944380+0000","last_unstale":"2023-11-30T18:39:37.327461+0000","last_undegraded":"2023-11-30T18:39:37.327461+0000","last_fullsized":"2023-11-30T18:39:37.327461+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.338865+0000","last_change":"2023-11-30T18:39:37.334416+0000","last_active":"2023-11-30T18:39:37.338865+0000","last_peered":"2023-11-30T18:39:37.338865+0000","last_clean":"2023-11-30T18:39:37.338865+0000","last_became_active":"2023-11-30T18:39:37.334121+0000","last_became_peered":"2023-11-30T18:39:37.334121+0000","last_unstale":"2023-11-30T18:39:37.338865+0000","last_undegraded":"2023-11-30T18:39:37.338865+0000","last_fullsized":"2023-11-30T18:39:37.338865+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.323817+0000","last_change":"2023-11-30T18:39:36.946789+0000","last_active":"2023-11-30T18:39:37.323817+0000","last_peered":"2023-11-30T18:39:37.323817+0000","last_clean":"2023-11-30T18:39:37.323817+0000","last_became_active":"2023-11-30T18:39:36.946341+0000","last_became_peered":"2023-11-30T18:39:36.946341+0000","last_unstale":"2023-11-30T18:39:37.323817+0000","last_undegraded":"2023-11-30T18:39:37.323817+0000","last_fullsized":"2023-11-30T18:39:37.323817+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349417+0000","last_change":"2023-11-30T18:39:37.344746+0000","last_active":"2023-11-30T18:39:37.349417+0000","last_peered":"2023-11-30T18:39:37.349417+0000","last_clean":"2023-11-30T18:39:37.349417+0000","last_became_active":"2023-11-30T18:39:37.344421+0000","last_became_peered":"2023-11-30T18:39:37.344421+0000","last_unstale":"2023-11-30T18:39:37.349417+0000","last_undegraded":"2023-11-30T18:39:37.349417+0000","last_fullsized":"2023-11-30T18:39:37.349417+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327484+0000","last_change":"2023-11-30T18:39:36.950190+0000","last_active":"2023-11-30T18:39:37.327484+0000","last_peered":"2023-11-30T18:39:37.327484+0000","last_clean":"2023-11-30T18:39:37.327484+0000","last_became_active":"2023-11-30T18:39:36.949891+0000","last_became_peered":"2023-11-30T18:39:36.949891+0000","last_unstale":"2023-11-30T18:39:37.327484+0000","last_undegraded":"2023-11-30T18:39:37.327484+0000","last_fullsized":"2023-11-30T18:39:37.327484+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347541+0000","last_change":"2023-11-30T18:39:37.335167+0000","last_active":"2023-11-30T18:39:37.347541+0000","last_peered":"2023-11-30T18:39:37.347541+0000","last_clean":"2023-11-30T18:39:37.347541+0000","last_became_active":"2023-11-30T18:39:37.334308+0000","last_became_peered":"2023-11-30T18:39:37.334308+0000","last_unstale":"2023-11-30T18:39:37.347541+0000","last_undegraded":"2023-11-30T18:39:37.347541+0000","last_fullsized":"2023-11-30T18:39:37.347541+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.351861+0000","last_change":"2023-11-30T18:39:36.952979+0000","last_active":"2023-11-30T18:39:37.351861+0000","last_peered":"2023-11-30T18:39:37.351861+0000","last_clean":"2023-11-30T18:39:37.351861+0000","last_became_active":"2023-11-30T18:39:36.952615+0000","last_became_peered":"2023-11-30T18:39:36.952615+0000","last_unstale":"2023-11-30T18:39:37.351861+0000","last_undegraded":"2023-11-30T18:39:37.351861+0000","last_fullsized":"2023-11-30T18:39:37.351861+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.e","version":"202'2","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.348393+0000","last_change":"2023-11-30T18:39:36.954616+0000","last_active":"2023-11-30T18:39:37.348393+0000","last_peered":"2023-11-30T18:39:37.348393+0000","last_clean":"2023-11-30T18:39:37.348393+0000","last_became_active":"2023-11-30T18:39:36.953752+0000","last_became_peered":"2023-11-30T18:39:36.953752+0000","last_unstale":"2023-11-30T18:39:37.348393+0000","last_undegraded":"2023-11-30T18:39:37.348393+0000","last_fullsized":"2023-11-30T18:39:37.348393+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.333794+0000","last_change":"2023-11-30T18:39:36.946600+0000","last_active":"2023-11-30T18:39:37.333794+0000","last_peered":"2023-11-30T18:39:37.333794+0000","last_clean":"2023-11-30T18:39:37.333794+0000","last_became_active":"2023-11-30T18:39:36.946270+0000","last_became_peered":"2023-11-30T18:39:36.946270+0000","last_unstale":"2023-11-30T18:39:37.333794+0000","last_undegraded":"2023-11-30T18:39:37.333794+0000","last_fullsized":"2023-11-30T18:39:37.333794+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327189+0000","last_change":"2023-11-30T18:39:36.944458+0000","last_active":"2023-11-30T18:39:37.327189+0000","last_peered":"2023-11-30T18:39:37.327189+0000","last_clean":"2023-11-30T18:39:37.327189+0000","last_became_active":"2023-11-30T18:39:36.944179+0000","last_became_peered":"2023-11-30T18:39:36.944179+0000","last_unstale":"2023-11-30T18:39:37.327189+0000","last_undegraded":"2023-11-30T18:39:37.327189+0000","last_fullsized":"2023-11-30T18:39:37.327189+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.353566+0000","last_change":"2023-11-30T18:39:37.352804+0000","last_active":"2023-11-30T18:39:37.353566+0000","last_peered":"2023-11-30T18:39:37.353566+0000","last_clean":"2023-11-30T18:39:37.353566+0000","last_became_active":"2023-11-30T18:39:37.352435+0000","last_became_peered":"2023-11-30T18:39:37.352435+0000","last_unstale":"2023-11-30T18:39:37.353566+0000","last_undegraded":"2023-11-30T18:39:37.353566+0000","last_fullsized":"2023-11-30T18:39:37.353566+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347239+0000","last_change":"2023-11-30T18:39:36.950997+0000","last_active":"2023-11-30T18:39:37.347239+0000","last_peered":"2023-11-30T18:39:37.347239+0000","last_clean":"2023-11-30T18:39:37.347239+0000","last_became_active":"2023-11-30T18:39:36.950673+0000","last_became_peered":"2023-11-30T18:39:36.950673+0000","last_unstale":"2023-11-30T18:39:37.347239+0000","last_undegraded":"2023-11-30T18:39:37.347239+0000","last_fullsized":"2023-11-30T18:39:37.347239+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352565+0000","last_change":"2023-11-30T18:39:37.351298+0000","last_active":"2023-11-30T18:39:37.352565+0000","last_peered":"2023-11-30T18:39:37.352565+0000","last_clean":"2023-11-30T18:39:37.352565+0000","last_became_active":"2023-11-30T18:39:37.350781+0000","last_became_peered":"2023-11-30T18:39:37.350781+0000","last_unstale":"2023-11-30T18:39:37.352565+0000","last_undegraded":"2023-11-30T18:39:37.352565+0000","last_fullsized":"2023-11-30T18:39:37.352565+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349380+0000","last_change":"2023-11-30T18:39:37.342904+0000","last_active":"2023-11-30T18:39:37.349380+0000","last_peered":"2023-11-30T18:39:37.349380+0000","last_clean":"2023-11-30T18:39:37.349380+0000","last_became_active":"2023-11-30T18:39:37.342597+0000","last_became_peered":"2023-11-30T18:39:37.342597+0000","last_unstale":"2023-11-30T18:39:37.349380+0000","last_undegraded":"2023-11-30T18:39:37.349380+0000","last_fullsized":"2023-11-30T18:39:37.349380+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.323729+0000","last_change":"2023-11-30T18:39:36.946627+0000","last_active":"2023-11-30T18:39:37.323729+0000","last_peered":"2023-11-30T18:39:37.323729+0000","last_clean":"2023-11-30T18:39:37.323729+0000","last_became_active":"2023-11-30T18:39:36.945813+0000","last_became_peered":"2023-11-30T18:39:36.945813+0000","last_unstale":"2023-11-30T18:39:37.323729+0000","last_undegraded":"2023-11-30T18:39:37.323729+0000","last_fullsized":"2023-11-30T18:39:37.323729+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346095+0000","last_change":"2023-11-30T18:39:37.343145+0000","last_active":"2023-11-30T18:39:37.346095+0000","last_peered":"2023-11-30T18:39:37.346095+0000","last_clean":"2023-11-30T18:39:37.346095+0000","last_became_active":"2023-11-30T18:39:37.342863+0000","last_became_peered":"2023-11-30T18:39:37.342863+0000","last_unstale":"2023-11-30T18:39:37.346095+0000","last_undegraded":"2023-11-30T18:39:37.346095+0000","last_fullsized":"2023-11-30T18:39:37.346095+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.330188+0000","last_change":"2023-11-30T18:39:36.949760+0000","last_active":"2023-11-30T18:39:37.330188+0000","last_peered":"2023-11-30T18:39:37.330188+0000","last_clean":"2023-11-30T18:39:37.330188+0000","last_became_active":"2023-11-30T18:39:36.949139+0000","last_became_peered":"2023-11-30T18:39:36.949139+0000","last_unstale":"2023-11-30T18:39:37.330188+0000","last_undegraded":"2023-11-30T18:39:37.330188+0000","last_fullsized":"2023-11-30T18:39:37.330188+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.7","version":"202'2","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.339149+0000","last_change":"2023-11-30T18:39:36.945986+0000","last_active":"2023-11-30T18:39:37.339149+0000","last_peered":"2023-11-30T18:39:37.339149+0000","last_clean":"2023-11-30T18:39:37.339149+0000","last_became_active":"2023-11-30T18:39:36.945645+0000","last_became_peered":"2023-11-30T18:39:36.945645+0000","last_unstale":"2023-11-30T18:39:37.339149+0000","last_undegraded":"2023-11-30T18:39:37.339149+0000","last_fullsized":"2023-11-30T18:39:37.339149+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.342995+0000","last_change":"2023-11-30T18:39:37.336408+0000","last_active":"2023-11-30T18:39:37.342995+0000","last_peered":"2023-11-30T18:39:37.342995+0000","last_clean":"2023-11-30T18:39:37.342995+0000","last_became_active":"2023-11-30T18:39:37.335738+0000","last_became_peered":"2023-11-30T18:39:37.335738+0000","last_unstale":"2023-11-30T18:39:37.342995+0000","last_undegraded":"2023-11-30T18:39:37.342995+0000","last_fullsized":"2023-11-30T18:39:37.342995+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.337854+0000","last_change":"2023-11-30T18:39:36.955512+0000","last_active":"2023-11-30T18:39:37.337854+0000","last_peered":"2023-11-30T18:39:37.337854+0000","last_clean":"2023-11-30T18:39:37.337854+0000","last_became_active":"2023-11-30T18:39:36.955212+0000","last_became_peered":"2023-11-30T18:39:36.955212+0000","last_unstale":"2023-11-30T18:39:37.337854+0000","last_undegraded":"2023-11-30T18:39:37.337854+0000","last_fullsized":"2023-11-30T18:39:37.337854+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.338579+0000","last_change":"2023-11-30T18:39:37.330346+0000","last_active":"2023-11-30T18:39:37.338579+0000","last_peered":"2023-11-30T18:39:37.338579+0000","last_clean":"2023-11-30T18:39:37.338579+0000","last_became_active":"2023-11-30T18:39:37.330086+0000","last_became_peered":"2023-11-30T18:39:37.330086+0000","last_unstale":"2023-11-30T18:39:37.338579+0000","last_undegraded":"2023-11-30T18:39:37.338579+0000","last_fullsized":"2023-11-30T18:39:37.338579+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.337927+0000","last_change":"2023-11-30T18:39:36.950992+0000","last_active":"2023-11-30T18:39:37.337927+0000","last_peered":"2023-11-30T18:39:37.337927+0000","last_clean":"2023-11-30T18:39:37.337927+0000","last_became_active":"2023-11-30T18:39:36.950695+0000","last_became_peered":"2023-11-30T18:39:36.950695+0000","last_unstale":"2023-11-30T18:39:37.337927+0000","last_undegraded":"2023-11-30T18:39:37.337927+0000","last_fullsized":"2023-11-30T18:39:37.337927+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.344708+0000","last_change":"2023-11-30T18:39:37.331147+0000","last_active":"2023-11-30T18:39:37.344708+0000","last_peered":"2023-11-30T18:39:37.344708+0000","last_clean":"2023-11-30T18:39:37.344708+0000","last_became_active":"2023-11-30T18:39:37.330838+0000","last_became_peered":"2023-11-30T18:39:37.330838+0000","last_unstale":"2023-11-30T18:39:37.344708+0000","last_undegraded":"2023-11-30T18:39:37.344708+0000","last_fullsized":"2023-11-30T18:39:37.344708+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.325251+0000","last_change":"2023-11-30T18:39:36.952569+0000","last_active":"2023-11-30T18:39:37.325251+0000","last_peered":"2023-11-30T18:39:37.325251+0000","last_clean":"2023-11-30T18:39:37.325251+0000","last_became_active":"2023-11-30T18:39:36.952293+0000","last_became_peered":"2023-11-30T18:39:36.952293+0000","last_unstale":"2023-11-30T18:39:37.325251+0000","last_undegraded":"2023-11-30T18:39:37.325251+0000","last_fullsized":"2023-11-30T18:39:37.325251+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352722+0000","last_change":"2023-11-30T18:39:37.350409+0000","last_active":"2023-11-30T18:39:37.352722+0000","last_peered":"2023-11-30T18:39:37.352722+0000","last_clean":"2023-11-30T18:39:37.352722+0000","last_became_active":"2023-11-30T18:39:37.350135+0000","last_became_peered":"2023-11-30T18:39:37.350135+0000","last_unstale":"2023-11-30T18:39:37.352722+0000","last_undegraded":"2023-11-30T18:39:37.352722+0000","last_fullsized":"2023-11-30T18:39:37.352722+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.338222+0000","last_change":"2023-11-30T18:39:36.946783+0000","last_active":"2023-11-30T18:39:37.338222+0000","last_peered":"2023-11-30T18:39:37.338222+0000","last_clean":"2023-11-30T18:39:37.338222+0000","last_became_active":"2023-11-30T18:39:36.946533+0000","last_became_peered":"2023-11-30T18:39:36.946533+0000","last_unstale":"2023-11-30T18:39:37.338222+0000","last_undegraded":"2023-11-30T18:39:37.338222+0000","last_fullsized":"2023-11-30T18:39:37.338222+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346709+0000","last_change":"2023-11-30T18:39:37.343014+0000","last_active":"2023-11-30T18:39:37.346709+0000","last_peered":"2023-11-30T18:39:37.346709+0000","last_clean":"2023-11-30T18:39:37.346709+0000","last_became_active":"2023-11-30T18:39:37.342723+0000","last_became_peered":"2023-11-30T18:39:37.342723+0000","last_unstale":"2023-11-30T18:39:37.346709+0000","last_undegraded":"2023-11-30T18:39:37.346709+0000","last_fullsized":"2023-11-30T18:39:37.346709+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.336615+0000","last_change":"2023-11-30T18:39:36.946283+0000","last_active":"2023-11-30T18:39:37.336615+0000","last_peered":"2023-11-30T18:39:37.336615+0000","last_clean":"2023-11-30T18:39:37.336615+0000","last_became_active":"2023-11-30T18:39:36.946000+0000","last_became_peered":"2023-11-30T18:39:36.946000+0000","last_unstale":"2023-11-30T18:39:37.336615+0000","last_undegraded":"2023-11-30T18:39:37.336615+0000","last_fullsized":"2023-11-30T18:39:37.336615+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.353262+0000","last_change":"2023-11-30T18:39:37.352247+0000","last_active":"2023-11-30T18:39:37.353262+0000","last_peered":"2023-11-30T18:39:37.353262+0000","last_clean":"2023-11-30T18:39:37.353262+0000","last_became_active":"2023-11-30T18:39:37.351956+0000","last_became_peered":"2023-11-30T18:39:37.351956+0000","last_unstale":"2023-11-30T18:39:37.353262+0000","last_undegraded":"2023-11-30T18:39:37.353262+0000","last_fullsized":"2023-11-30T18:39:37.353262+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.344165+0000","last_change":"2023-11-30T18:39:37.340873+0000","last_active":"2023-11-30T18:39:37.344165+0000","last_peered":"2023-11-30T18:39:37.344165+0000","last_clean":"2023-11-30T18:39:37.344165+0000","last_became_active":"2023-11-30T18:39:37.340580+0000","last_became_peered":"2023-11-30T18:39:37.340580+0000","last_unstale":"2023-11-30T18:39:37.344165+0000","last_undegraded":"2023-11-30T18:39:37.344165+0000","last_fullsized":"2023-11-30T18:39:37.344165+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.326374+0000","last_change":"2023-11-30T18:39:36.950400+0000","last_active":"2023-11-30T18:39:37.326374+0000","last_peered":"2023-11-30T18:39:37.326374+0000","last_clean":"2023-11-30T18:39:37.326374+0000","last_became_active":"2023-11-30T18:39:36.949951+0000","last_became_peered":"2023-11-30T18:39:36.949951+0000","last_unstale":"2023-11-30T18:39:37.326374+0000","last_undegraded":"2023-11-30T18:39:37.326374+0000","last_fullsized":"2023-11-30T18:39:37.326374+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":171,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327395+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T18:39:37.327395+0000","last_peered":"2023-11-30T18:39:37.327395+0000","last_clean":"2023-11-30T18:39:37.327395+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T18:39:37.327395+0000","last_undegraded":"2023-11-30T18:39:37.327395+0000","last_fullsized":"2023-11-30T18:39:37.327395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347342+0000","last_change":"2023-11-30T18:39:37.340048+0000","last_active":"2023-11-30T18:39:37.347342+0000","last_peered":"2023-11-30T18:39:37.347342+0000","last_clean":"2023-11-30T18:39:37.347342+0000","last_became_active":"2023-11-30T18:39:37.339749+0000","last_became_peered":"2023-11-30T18:39:37.339749+0000","last_unstale":"2023-11-30T18:39:37.347342+0000","last_undegraded":"2023-11-30T18:39:37.347342+0000","last_fullsized":"2023-11-30T18:39:37.347342+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.336922+0000","last_change":"2023-11-30T18:39:36.954943+0000","last_active":"2023-11-30T18:39:37.336922+0000","last_peered":"2023-11-30T18:39:37.336922+0000","last_clean":"2023-11-30T18:39:37.336922+0000","last_became_active":"2023-11-30T18:39:36.954644+0000","last_became_peered":"2023-11-30T18:39:36.954644+0000","last_unstale":"2023-11-30T18:39:37.336922+0000","last_undegraded":"2023-11-30T18:39:37.336922+0000","last_fullsized":"2023-11-30T18:39:37.336922+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":165,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-11-30T18:39:33.082262+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T18:39:33.082262+0000","last_peered":"2023-11-30T18:39:33.082262+0000","last_clean":"2023-11-30T18:39:33.082262+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T18:39:33.082262+0000","last_undegraded":"2023-11-30T18:39:33.082262+0000","last_fullsized":"2023-11-30T18:39:33.082262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.344506+0000","last_change":"2023-11-30T18:39:37.342072+0000","last_active":"2023-11-30T18:39:37.344506+0000","last_peered":"2023-11-30T18:39:37.344506+0000","last_clean":"2023-11-30T18:39:37.344506+0000","last_became_active":"2023-11-30T18:39:37.341885+0000","last_became_peered":"2023-11-30T18:39:37.341885+0000","last_unstale":"2023-11-30T18:39:37.344506+0000","last_undegraded":"2023-11-30T18:39:37.344506+0000","last_fullsized":"2023-11-30T18:39:37.344506+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"202'2","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347830+0000","last_change":"2023-11-30T18:39:36.951915+0000","last_active":"2023-11-30T18:39:37.347830+0000","last_peered":"2023-11-30T18:39:37.347830+0000","last_clean":"2023-11-30T18:39:37.347830+0000","last_became_active":"2023-11-30T18:39:36.951639+0000","last_became_peered":"2023-11-30T18:39:36.951639+0000","last_unstale":"2023-11-30T18:39:37.347830+0000","last_undegraded":"2023-11-30T18:39:37.347830+0000","last_fullsized":"2023-11-30T18:39:37.347830+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.323644+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T18:39:37.323644+0000","last_peered":"2023-11-30T18:39:37.323644+0000","last_clean":"2023-11-30T18:39:37.323644+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T18:39:37.323644+0000","last_undegraded":"2023-11-30T18:39:37.323644+0000","last_fullsized":"2023-11-30T18:39:37.323644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.345987+0000","last_change":"2023-11-30T18:39:37.339470+0000","last_active":"2023-11-30T18:39:37.345987+0000","last_peered":"2023-11-30T18:39:37.345987+0000","last_clean":"2023-11-30T18:39:37.345987+0000","last_became_active":"2023-11-30T18:39:37.339218+0000","last_became_peered":"2023-11-30T18:39:37.339218+0000","last_unstale":"2023-11-30T18:39:37.345987+0000","last_undegraded":"2023-11-30T18:39:37.345987+0000","last_fullsized":"2023-11-30T18:39:37.345987+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.337752+0000","last_change":"2023-11-30T18:39:36.957232+0000","last_active":"2023-11-30T18:39:37.337752+0000","last_peered":"2023-11-30T18:39:37.337752+0000","last_clean":"2023-11-30T18:39:37.337752+0000","last_became_active":"2023-11-30T18:39:36.956927+0000","last_became_peered":"2023-11-30T18:39:36.956927+0000","last_unstale":"2023-11-30T18:39:37.337752+0000","last_undegraded":"2023-11-30T18:39:37.337752+0000","last_fullsized":"2023-11-30T18:39:37.337752+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":165,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-11-30T18:39:33.082262+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T18:39:33.082262+0000","last_peered":"2023-11-30T18:39:33.082262+0000","last_clean":"2023-11-30T18:39:33.082262+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T18:39:33.082262+0000","last_undegraded":"2023-11-30T18:39:33.082262+0000","last_fullsized":"2023-11-30T18:39:33.082262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":165,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.330242+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T18:39:37.330242+0000","last_peered":"2023-11-30T18:39:37.330242+0000","last_clean":"2023-11-30T18:39:37.330242+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T18:39:37.330242+0000","last_undegraded":"2023-11-30T18:39:37.330242+0000","last_fullsized":"2023-11-30T18:39:37.330242+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349079+0000","last_change":"2023-11-30T18:39:37.345111+0000","last_active":"2023-11-30T18:39:37.349079+0000","last_peered":"2023-11-30T18:39:37.349079+0000","last_clean":"2023-11-30T18:39:37.349079+0000","last_became_active":"2023-11-30T18:39:37.344811+0000","last_became_peered":"2023-11-30T18:39:37.344811+0000","last_unstale":"2023-11-30T18:39:37.349079+0000","last_undegraded":"2023-11-30T18:39:37.349079+0000","last_fullsized":"2023-11-30T18:39:37.349079+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"202'3","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349684+0000","last_change":"2023-11-30T18:39:36.954554+0000","last_active":"2023-11-30T18:39:37.349684+0000","last_peered":"2023-11-30T18:39:37.349684+0000","last_clean":"2023-11-30T18:39:37.349684+0000","last_became_active":"2023-11-30T18:39:36.954255+0000","last_became_peered":"2023-11-30T18:39:36.954255+0000","last_unstale":"2023-11-30T18:39:37.349684+0000","last_undegraded":"2023-11-30T18:39:37.349684+0000","last_fullsized":"2023-11-30T18:39:37.349684+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":163,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.330312+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T18:39:37.330312+0000","last_peered":"2023-11-30T18:39:37.330312+0000","last_clean":"2023-11-30T18:39:37.330312+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T18:39:37.330312+0000","last_undegraded":"2023-11-30T18:39:37.330312+0000","last_fullsized":"2023-11-30T18:39:37.330312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352219+0000","last_change":"2023-11-30T18:39:37.351640+0000","last_active":"2023-11-30T18:39:37.352219+0000","last_peered":"2023-11-30T18:39:37.352219+0000","last_clean":"2023-11-30T18:39:37.352219+0000","last_became_active":"2023-11-30T18:39:37.350854+0000","last_became_peered":"2023-11-30T18:39:37.350854+0000","last_unstale":"2023-11-30T18:39:37.352219+0000","last_undegraded":"2023-11-30T18:39:37.352219+0000","last_fullsized":"2023-11-30T18:39:37.352219+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"202'4","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.351107+0000","last_change":"2023-11-30T18:39:36.949816+0000","last_active":"2023-11-30T18:39:37.351107+0000","last_peered":"2023-11-30T18:39:37.351107+0000","last_clean":"2023-11-30T18:39:37.351107+0000","last_became_active":"2023-11-30T18:39:36.949516+0000","last_became_peered":"2023-11-30T18:39:36.949516+0000","last_unstale":"2023-11-30T18:39:37.351107+0000","last_undegraded":"2023-11-30T18:39:37.351107+0000","last_fullsized":"2023-11-30T18:39:37.351107+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":163,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.331043+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T18:39:37.331043+0000","last_peered":"2023-11-30T18:39:37.331043+0000","last_clean":"2023-11-30T18:39:37.331043+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T18:39:37.331043+0000","last_undegraded":"2023-11-30T18:39:37.331043+0000","last_fullsized":"2023-11-30T18:39:37.331043+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.13","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347149+0000","last_change":"2023-11-30T18:39:36.954951+0000","last_active":"2023-11-30T18:39:37.347149+0000","last_peered":"2023-11-30T18:39:37.347149+0000","last_clean":"2023-11-30T18:39:37.347149+0000","last_became_active":"2023-11-30T18:39:36.954635+0000","last_became_peered":"2023-11-30T18:39:36.954635+0000","last_unstale":"2023-11-30T18:39:37.347149+0000","last_undegraded":"2023-11-30T18:39:37.347149+0000","last_fullsized":"2023-11-30T18:39:37.347149+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":171,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.329562+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T18:39:37.329562+0000","last_peered":"2023-11-30T18:39:37.329562+0000","last_clean":"2023-11-30T18:39:37.329562+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T18:39:37.329562+0000","last_undegraded":"2023-11-30T18:39:37.329562+0000","last_fullsized":"2023-11-30T18:39:37.329562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347365+0000","last_change":"2023-11-30T18:39:37.343550+0000","last_active":"2023-11-30T18:39:37.347365+0000","last_peered":"2023-11-30T18:39:37.347365+0000","last_clean":"2023-11-30T18:39:37.347365+0000","last_became_active":"2023-11-30T18:39:37.343269+0000","last_became_peered":"2023-11-30T18:39:37.343269+0000","last_unstale":"2023-11-30T18:39:37.347365+0000","last_undegraded":"2023-11-30T18:39:37.347365+0000","last_fullsized":"2023-11-30T18:39:37.347365+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.336520+0000","last_change":"2023-11-30T18:39:36.944024+0000","last_active":"2023-11-30T18:39:37.336520+0000","last_peered":"2023-11-30T18:39:37.336520+0000","last_clean":"2023-11-30T18:39:37.336520+0000","last_became_active":"2023-11-30T18:39:36.943512+0000","last_became_peered":"2023-11-30T18:39:36.943512+0000","last_unstale":"2023-11-30T18:39:37.336520+0000","last_undegraded":"2023-11-30T18:39:37.336520+0000","last_fullsized":"2023-11-30T18:39:37.336520+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":186,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-11-30T18:39:32.616984+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T18:39:32.616984+0000","last_peered":"2023-11-30T18:39:32.616984+0000","last_clean":"2023-11-30T18:39:32.616984+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T18:39:32.616984+0000","last_undegraded":"2023-11-30T18:39:32.616984+0000","last_fullsized":"2023-11-30T18:39:32.616984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":102,"acting":102,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":1414,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":88,"acting":88,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575950,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303676,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068164,"statfs":{"total":96636764160,"available":96325799936,"internally_reserved":0,"allocated":2543616,"data_stored":1304277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.629,"15min":0.626},"min":{"1min":0.39200000000000002,"5min":0.35499999999999998,"15min":0.28699999999999998},"max":{"1min":0.81399999999999995,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.63200000000000001,"15min":0.63500000000000001},"min":{"1min":0.502,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77200000000000002,"5min":0.80600000000000005,"15min":0.82099999999999995},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.42999999999999999,"5min":0.40699999999999997,"15min":0.35899999999999999},"max":{"1min":0.70399999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.41999999999999998,"5min":0.38700000000000001,"15min":0.379},"max":{"1min":0.74399999999999999,"5min":0.877,"15min":0.877},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.44800000000000001,"5min":0.41699999999999998,"15min":0.379},"max":{"1min":0.66700000000000004,"5min":0.80500000000000005,"15min":0.81100000000000005},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58599999999999997,"15min":0.59299999999999997},"min":{"1min":0.47599999999999998,"5min":0.43099999999999999,"15min":0.38700000000000001},"max":{"1min":0.72699999999999998,"5min":0.82599999999999996,"15min":0.85399999999999998},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.40200000000000002,"5min":0.36699999999999999,"15min":0.35899999999999999},"max":{"1min":0.69299999999999995,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.47499999999999998,"5min":0.41899999999999998,"15min":0.41799999999999998},"max":{"1min":0.75600000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46500000000000002,"15min":0.46300000000000002},"min":{"1min":0.36799999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.52600000000000002,"5min":0.81100000000000005,"15min":0.83799999999999997},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.49199999999999999,"15min":0.48999999999999999},"min":{"1min":0.371,"5min":0.308,"15min":0.29099999999999998},"max":{"1min":0.624,"5min":0.67200000000000004,"15min":0.80500000000000005},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.505,"15min":0.5},"min":{"1min":0.36799999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78200000000000003,"5min":0.79100000000000004,"15min":0.83399999999999996},"last":0.374},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35399999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68300000000000005,"5min":0.78600000000000003,"15min":0.88200000000000001},"last":0.35399999999999998}]},{"osd":6,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56899999999999995,"15min":0.56399999999999995},"min":{"1min":0.40200000000000002,"5min":0.36699999999999999,"15min":0.32300000000000001},"max":{"1min":0.68400000000000005,"5min":0.84999999999999998,"15min":0.90800000000000003},"last":0.499},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55700000000000005,"15min":0.55900000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76300000000000001,"5min":0.81200000000000006,"15min":0.85199999999999998},"last":0.41199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575948,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307716,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064124,"statfs":{"total":96636764160,"available":96321662976,"internally_reserved":0,"allocated":2486272,"data_stored":1275712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60499999999999998,"15min":0.61099999999999999},"min":{"1min":0.35399999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.72799999999999998,"5min":0.80700000000000005,"15min":1.6379999999999999},"last":0.437},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.629,"15min":0.625},"min":{"1min":0.49299999999999999,"5min":0.42499999999999999,"15min":0.27800000000000002},"max":{"1min":0.77500000000000002,"5min":0.84899999999999998,"15min":1.246},"last":0.51000000000000001}]},{"osd":1,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.31900000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.76500000000000001,"5min":0.86599999999999999,"15min":1.1200000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.624,"15min":0.63100000000000001},"min":{"1min":0.42199999999999999,"5min":0.41899999999999998,"15min":0.35499999999999998},"max":{"1min":0.753,"5min":0.81599999999999995,"15min":0.90400000000000003},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59799999999999998,"15min":0.59899999999999998},"min":{"1min":0.40699999999999997,"5min":0.40000000000000002,"15min":0.34499999999999997},"max":{"1min":0.71899999999999997,"5min":0.85299999999999998,"15min":1.288},"last":0.502},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61599999999999999,"15min":0.63},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":0.74199999999999999,"5min":0.84599999999999997,"15min":1.177},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55800000000000005,"15min":0.57499999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.33400000000000002},"max":{"1min":0.70599999999999996,"5min":0.79600000000000004,"15min":1.204},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.40200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.67600000000000005,"5min":0.80100000000000005,"15min":1.337},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.443,"15min":0.46800000000000003},"min":{"1min":0.34399999999999997,"5min":0.315,"15min":0.28699999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":1.51},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.49199999999999999},"min":{"1min":0.34999999999999998,"5min":0.32800000000000001,"15min":0.30399999999999999},"max":{"1min":0.69899999999999995,"5min":0.71599999999999997,"15min":0.94299999999999995},"last":0.40600000000000003}]},{"osd":5,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.45700000000000002,"15min":0.47199999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":1.159},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.503,"15min":0.52700000000000002},"min":{"1min":0.42399999999999999,"5min":0.35199999999999998,"15min":0.32500000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":1.679},"last":0.60899999999999999}]},{"osd":7,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52200000000000002,"15min":0.54000000000000004},"min":{"1min":0.36799999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.96199999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55700000000000005,"15min":0.57699999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":1.427},"last":0.52400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575949,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307772,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064068,"statfs":{"total":96636764160,"available":96321605632,"internally_reserved":0,"allocated":2543616,"data_stored":1303475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.377,"15min":0.38},"min":{"1min":0.27500000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.66300000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.50700000000000001,"15min":0.51000000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.35799999999999998},"max":{"1min":0.77400000000000002,"5min":0.87,"15min":0.87},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40699999999999997,"15min":0.41199999999999998},"min":{"1min":0.28699999999999998,"5min":0.26700000000000002,"15min":0.26200000000000001},"max":{"1min":0.64700000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.40100000000000002,"5min":0.372,"15min":0.37},"max":{"1min":0.80300000000000005,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.48099999999999998,"15min":0.47799999999999998},"min":{"1min":0.33800000000000002,"5min":0.33500000000000002,"15min":0.318},"max":{"1min":0.72899999999999998,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45500000000000002,"15min":0.46000000000000002},"min":{"1min":0.33400000000000002,"5min":0.313,"15min":0.311},"max":{"1min":0.71399999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.28799999999999998}]},{"osd":4,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.59899999999999998,"15min":0.61899999999999999},"min":{"1min":0.41099999999999998,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.93999999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66800000000000004,"15min":0.67000000000000004},"min":{"1min":0.50600000000000001,"5min":0.49199999999999999,"15min":0.42299999999999999},"max":{"1min":1.0329999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.62,"15min":0.63300000000000001},"min":{"1min":0.48899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63900000000000001,"15min":0.64600000000000002},"min":{"1min":0.47799999999999998,"5min":0.45000000000000001,"15min":0.39200000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.98099999999999998},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70299999999999996,"15min":0.70499999999999996},"min":{"1min":0.51100000000000001,"5min":0.498,"15min":0.443},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.68000000000000005,"15min":0.69199999999999995},"min":{"1min":0.51400000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.86299999999999999,"5min":1.004,"15min":1.0169999999999999},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69599999999999995,"15min":0.71199999999999997},"min":{"1min":0.51400000000000001,"5min":0.48999999999999999,"15min":0.46100000000000002},"max":{"1min":0.91000000000000003,"5min":0.97499999999999998,"15min":1.012},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68600000000000005,"15min":0.69699999999999995},"min":{"1min":0.57499999999999996,"5min":0.51800000000000002,"15min":0.47699999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.02},"last":0.64300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575949,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307768,"kb_used_data":2480,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064072,"statfs":{"total":96636764160,"available":96321609728,"internally_reserved":0,"allocated":2539520,"data_stored":1302865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.38800000000000001,"15min":0.39500000000000002},"min":{"1min":0.252,"5min":0.25,"15min":0.22900000000000001},"max":{"1min":0.50900000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.439,"5min":0.42099999999999999,"15min":0.42199999999999999},"min":{"1min":0.33500000000000002,"5min":0.27300000000000002,"15min":0.252},"max":{"1min":0.58299999999999996,"5min":0.65100000000000002,"15min":0.71399999999999997},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41199999999999998,"15min":0.41699999999999998},"min":{"1min":0.33000000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.55100000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.49099999999999999,"15min":0.5},"min":{"1min":0.40600000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.74199999999999999},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.45800000000000002,"15min":0.46200000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64400000000000002,"5min":0.69899999999999995,"15min":0.71799999999999997},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46500000000000002,"15min":0.47499999999999998},"min":{"1min":0.36599999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.60399999999999998,"5min":0.68000000000000005,"15min":0.70599999999999996},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63,"15min":0.64100000000000001},"min":{"1min":0.55900000000000005,"5min":0.40200000000000002,"15min":0.39900000000000002},"max":{"1min":0.79700000000000004,"5min":0.90600000000000003,"15min":1.0549999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.65800000000000003},"min":{"1min":0.55900000000000005,"5min":0.45100000000000001,"15min":0.442},"max":{"1min":0.77900000000000003,"5min":1.026,"15min":1.163},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.626,"15min":0.64100000000000001},"min":{"1min":0.50600000000000001,"5min":0.443,"15min":0.40400000000000003},"max":{"1min":0.78700000000000003,"5min":0.91600000000000004,"15min":1.0649999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.66800000000000004,"15min":0.67200000000000004},"min":{"1min":0.52400000000000002,"5min":0.47199999999999998,"15min":0.439},"max":{"1min":0.84799999999999998,"5min":0.998,"15min":1.1799999999999999},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.67700000000000005,"15min":0.68700000000000006},"min":{"1min":0.55100000000000005,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.873,"5min":0.94199999999999995,"15min":1.079},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66900000000000004,"15min":0.68300000000000005},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.41499999999999998},"max":{"1min":0.86099999999999999,"5min":1.0129999999999999,"15min":1.147},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69799999999999995,"15min":0.70599999999999996},"min":{"1min":0.55900000000000005,"5min":0.49199999999999999,"15min":0.47399999999999998},"max":{"1min":0.88700000000000001,"5min":1.0469999999999999,"15min":1.22},"last":0.875},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72099999999999997,"15min":0.73399999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.81799999999999995,"5min":1.0640000000000001,"15min":1.117},"last":0.92800000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575949,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311864,"kb_used_data":2480,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059976,"statfs":{"total":96636764160,"available":96317415424,"internally_reserved":0,"allocated":2539520,"data_stored":1302901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.41999999999999998,"15min":0.41199999999999998},"min":{"1min":0.30099999999999999,"5min":0.249,"15min":0.23200000000000001},"max":{"1min":0.60399999999999998,"5min":0.64800000000000002,"15min":0.72099999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45700000000000002,"15min":0.46000000000000002},"min":{"1min":0.32600000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.58599999999999997,"5min":0.65000000000000002,"15min":0.73199999999999998},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45800000000000002,"15min":0.46100000000000002},"min":{"1min":0.34300000000000003,"5min":0.33100000000000002,"15min":0.29699999999999999},"max":{"1min":0.63900000000000001,"5min":0.70599999999999996,"15min":0.74299999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.496,"15min":0.49399999999999999},"min":{"1min":0.40899999999999997,"5min":0.35599999999999998,"15min":0.29899999999999999},"max":{"1min":0.66100000000000003,"5min":0.746,"15min":0.752},"last":0.379}]},{"osd":3,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.42799999999999999,"15min":0.42299999999999999},"min":{"1min":0.315,"5min":0.28399999999999997,"15min":0.27300000000000002},"max":{"1min":0.55000000000000004,"5min":0.61399999999999999,"15min":0.65100000000000002},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.503,"15min":0.499},"min":{"1min":0.433,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.69099999999999995,"5min":0.75900000000000001,"15min":0.77100000000000002},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.52100000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.95299999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63200000000000001,"15min":0.63900000000000001},"min":{"1min":0.46000000000000002,"5min":0.42799999999999999,"15min":0.35499999999999998},"max":{"1min":0.90500000000000003,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65400000000000003,"15min":0.66400000000000003},"min":{"1min":0.51200000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.84099999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.47199999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.91700000000000004,"5min":1.01,"15min":1.01},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64900000000000002,"15min":0.65200000000000002},"min":{"1min":0.52100000000000002,"5min":0.443,"15min":0.40500000000000003},"max":{"1min":0.86699999999999999,"5min":0.93000000000000005,"15min":0.93200000000000005},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.69399999999999995,"15min":0.69699999999999995},"min":{"1min":0.54300000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93999999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69099999999999995,"15min":0.69499999999999995},"min":{"1min":0.53500000000000003,"5min":0.47499999999999998,"15min":0.47299999999999998},"max":{"1min":0.95399999999999996,"5min":0.97799999999999998,"15min":1.0109999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71099999999999997,"15min":0.71799999999999997},"min":{"1min":0.55700000000000005,"5min":0.44,"15min":0.44},"max":{"1min":0.95199999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.70799999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575949,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299712,"kb_used_data":2488,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072128,"statfs":{"total":96636764160,"available":96329859072,"internally_reserved":0,"allocated":2547712,"data_stored":1303497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.373,"15min":0.38},"min":{"1min":0.29499999999999998,"5min":0.222,"15min":0.222},"max":{"1min":0.59099999999999997,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.42699999999999999,"15min":0.42499999999999999},"min":{"1min":0.31,"5min":0.28699999999999998,"15min":0.28199999999999997},"max":{"1min":0.63700000000000001,"5min":0.70299999999999996,"15min":0.754},"last":0.504}]},{"osd":1,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40000000000000002,"15min":0.40400000000000003},"min":{"1min":0.29899999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58099999999999996,"5min":0.66500000000000004,"15min":0.73399999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44500000000000001,"15min":0.45300000000000001},"min":{"1min":0.315,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.51800000000000002,"5min":0.67700000000000005,"15min":0.86699999999999999},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.47299999999999998,"15min":0.47699999999999998},"min":{"1min":0.39000000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.59899999999999998,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51400000000000001,"15min":0.52400000000000002},"min":{"1min":0.40899999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.65600000000000003,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.63}]},{"osd":4,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63200000000000001,"15min":0.64100000000000001},"min":{"1min":0.51100000000000001,"5min":0.40200000000000002,"15min":0.35299999999999998},"max":{"1min":0.84799999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.64000000000000001,"15min":0.65100000000000002},"min":{"1min":0.40400000000000003,"5min":0.40300000000000002,"15min":0.40100000000000002},"max":{"1min":0.77400000000000002,"5min":0.97799999999999998,"15min":1.0049999999999999},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63600000000000001,"15min":0.64600000000000002},"min":{"1min":0.52000000000000002,"5min":0.44600000000000001,"15min":0.40699999999999997},"max":{"1min":0.89400000000000002,"5min":1.04,"15min":1.04},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65500000000000003,"15min":0.66800000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.34499999999999997},"max":{"1min":0.82999999999999996,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.79200000000000004}]},{"osd":6,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67200000000000004,"15min":0.68400000000000005},"min":{"1min":0.499,"5min":0.45000000000000001,"15min":0.377},"max":{"1min":0.88800000000000001,"5min":1.0189999999999999,"15min":1.0309999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66300000000000003,"15min":0.68500000000000005},"min":{"1min":0.48199999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92900000000000005,"5min":0.99399999999999999,"15min":1.0129999999999999},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68300000000000005,"15min":0.70399999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.872,"5min":1.0009999999999999,"15min":1.052},"last":0.747},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68300000000000005,"15min":0.70499999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.81299999999999994,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.80500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575949,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303680,"kb_used_data":2488,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068160,"statfs":{"total":96636764160,"available":96325795840,"internally_reserved":0,"allocated":2547712,"data_stored":1303013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53900000000000003,"15min":0.56200000000000006},"min":{"1min":0.36199999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72999999999999998,"5min":0.79400000000000004,"15min":0.85499999999999998},"last":0.316},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.374,"5min":0.34100000000000003,"15min":0.32500000000000001},"max":{"1min":0.76800000000000002,"5min":0.79300000000000004,"15min":0.94999999999999996},"last":0.436}]},{"osd":1,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56899999999999995,"15min":0.57299999999999995},"min":{"1min":0.41799999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.72199999999999998,"5min":0.86599999999999999,"15min":0.876},"last":0.371},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.67400000000000004,"5min":0.79300000000000004,"15min":0.91200000000000003},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.60599999999999998},"min":{"1min":0.438,"5min":0.36299999999999999,"15min":0.34999999999999998},"max":{"1min":0.72199999999999998,"5min":0.88400000000000001,"15min":0.93799999999999994},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.60599999999999998,"15min":0.625},"min":{"1min":0.40000000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68999999999999995,"5min":0.90800000000000003,"15min":0.94399999999999995},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.433,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":0.68899999999999995,"5min":0.83199999999999996,"15min":0.84999999999999998},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57699999999999996,"15min":0.59899999999999998},"min":{"1min":0.45600000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.67500000000000004,"5min":0.80800000000000005,"15min":0.872},"last":0.498}]},{"osd":5,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.42299999999999999,"15min":0.44800000000000001},"min":{"1min":0.309,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.53400000000000003,"5min":0.66900000000000004,"15min":0.86399999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.44900000000000001,"15min":0.46899999999999997},"min":{"1min":0.32300000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.63200000000000001,"5min":0.64900000000000002,"15min":0.82299999999999995},"last":0.49199999999999999}]},{"osd":6,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47399999999999998,"15min":0.51300000000000001},"min":{"1min":0.35699999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66100000000000003,"5min":0.79200000000000004,"15min":1.1399999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.52800000000000002,"15min":0.56299999999999994},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.67200000000000004,"5min":0.76700000000000002,"15min":1.1220000000000001},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.47999999999999998,"15min":0.52500000000000002},"min":{"1min":0.308,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58199999999999996,"5min":0.80100000000000005,"15min":0.90000000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55400000000000005,"15min":0.58199999999999996},"min":{"1min":0.44400000000000001,"5min":0.38100000000000001,"15min":0.35599999999999998},"max":{"1min":0.622,"5min":0.81599999999999995,"15min":0.86199999999999999},"last":0.56599999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575948,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307716,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064124,"statfs":{"total":96636764160,"available":96321662976,"internally_reserved":0,"allocated":2486272,"data_stored":1275712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56799999999999995,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.35799999999999998,"15min":0.29799999999999999},"max":{"1min":0.76600000000000001,"5min":0.79800000000000004,"15min":0.80800000000000005},"last":0.317},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.54300000000000004,"15min":0.55300000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.66800000000000004,"5min":0.80700000000000005,"15min":0.90300000000000002},"last":0.36199999999999999}]},{"osd":1,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54000000000000004,"15min":0.54300000000000004},"min":{"1min":0.41099999999999998,"5min":0.36899999999999999,"15min":0.32200000000000001},"max":{"1min":0.72599999999999998,"5min":0.75600000000000001,"15min":0.83699999999999997},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57699999999999996,"15min":0.57999999999999996},"min":{"1min":0.42499999999999999,"5min":0.38600000000000001,"15min":0.32400000000000001},"max":{"1min":0.72999999999999998,"5min":0.76500000000000001,"15min":0.82899999999999996},"last":0.307}]},{"osd":2,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60999999999999999,"15min":0.61399999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.36399999999999999},"max":{"1min":0.76300000000000001,"5min":0.78700000000000003,"15min":0.99199999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.62,"15min":0.62},"min":{"1min":0.47199999999999998,"5min":0.44800000000000001,"15min":0.42499999999999999},"max":{"1min":0.78400000000000003,"5min":0.79600000000000004,"15min":1.173},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.373},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.79300000000000004},"last":0.373},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.439,"5min":0.40500000000000003,"15min":0.35399999999999998},"max":{"1min":0.72699999999999998,"5min":0.84199999999999997,"15min":1.603},"last":0.32700000000000001}]},{"osd":4,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.45400000000000001,"15min":0.45200000000000001},"min":{"1min":0.35799999999999998,"5min":0.315,"15min":0.28000000000000003},"max":{"1min":0.63800000000000001,"5min":0.70299999999999996,"15min":0.75},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.48999999999999999,"15min":0.48299999999999998},"min":{"1min":0.39100000000000001,"5min":0.32000000000000001,"15min":0.314},"max":{"1min":0.67300000000000004,"5min":0.77900000000000003,"15min":0.81200000000000006},"last":0.248}]},{"osd":6,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51600000000000001,"15min":0.505},"min":{"1min":0.38400000000000001,"5min":0.33600000000000002,"15min":0.31900000000000001},"max":{"1min":0.75900000000000001,"5min":0.76700000000000002,"15min":1.105},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57699999999999996,"15min":0.57199999999999995},"min":{"1min":0.48699999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.751,"5min":0.79600000000000004,"15min":1.228},"last":0.40500000000000003}]},{"osd":7,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55000000000000004,"15min":0.54000000000000004},"min":{"1min":0.442,"5min":0.36799999999999999,"15min":0.34399999999999997},"max":{"1min":0.69299999999999995,"5min":0.80900000000000005,"15min":0.88100000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.60199999999999998,"15min":0.59599999999999997},"min":{"1min":0.47399999999999998,"5min":0.33400000000000002,"15min":0.317},"max":{"1min":0.79400000000000004,"5min":0.82499999999999996,"15min":1.0640000000000001},"last":0.41099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T18:39:41.369 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T18:39:41.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.514+0000 7fe09124c700 1 Processor -- start 2023-11-30T18:39:41.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.514+0000 7fe09124c700 1 -- start start 2023-11-30T18:39:41.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.515+0000 7fe09124c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe08c0c0180 0x7fe08c157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:41.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.515+0000 7fe09124c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe08c0c1750 0x7fe08c0c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:41.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.515+0000 7fe09124c700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe08c0c12c0 con 0x7fe08c157660 2023-11-30T18:39:41.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.515+0000 7fe09124c700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe08c0c06b0 con 0x7fe08c0c1750 2023-11-30T18:39:41.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.515+0000 7fe09124c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c0c0990 con 0x7fe08c0c0180 2023-11-30T18:39:41.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.515+0000 7fe090a4b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe08c0c1750 0x7fe08c0c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:41.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.515+0000 7fe090a4b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe08c0c1750 0x7fe08c0c1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59780/0 (socket says 172.21.15.49:59780) 2023-11-30T18:39:41.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.515+0000 7fe090a4b700 1 -- 172.21.15.49:0/1682238244 learned_addr learned my addr 172.21.15.49:0/1682238244 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:41.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.515+0000 7fe08b7fe700 1 --2- 172.21.15.49:0/1682238244 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe08c0c0180 0x7fe08c157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:41.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.515+0000 7fe090a4b700 1 -- 172.21.15.49:0/1682238244 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe08c0c0180 msgr2=0x7fe08c157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:41.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.515+0000 7fe090a4b700 1 --2- 172.21.15.49:0/1682238244 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe08c0c0180 0x7fe08c157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:41.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.516+0000 7fe090a4b700 1 -- 172.21.15.49:0/1682238244 >> v1:172.21.15.115:6789/0 conn(0x7fe08c157660 legacy=0x7fe08c1589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:41.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.516+0000 7fe090a4b700 1 -- 172.21.15.49:0/1682238244 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08c0c0c70 con 0x7fe08c0c1750 2023-11-30T18:39:41.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.516+0000 7fe090a4b700 1 --2- 172.21.15.49:0/1682238244 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe08c0c1750 0x7fe08c0c1ba0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 rx=0x7fe084009f20 tx=0x7fe084009840).ready entity=mon.0 client_cookie=758fefc4a34e9d22 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:41.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.516+0000 7fe08affd700 1 -- 172.21.15.49:0/1682238244 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08400e070 con 0x7fe08c0c1750 2023-11-30T18:39:41.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.516+0000 7fe08affd700 1 -- 172.21.15.49:0/1682238244 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08400ba80 con 0x7fe08c0c1750 2023-11-30T18:39:41.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.516+0000 7fe08affd700 1 -- 172.21.15.49:0/1682238244 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08400be00 con 0x7fe08c0c1750 2023-11-30T18:39:41.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.516+0000 7fe09124c700 1 -- 172.21.15.49:0/1682238244 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe08c0c1750 msgr2=0x7fe08c0c1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:41.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.516+0000 7fe09124c700 1 --2- 172.21.15.49:0/1682238244 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe08c0c1750 0x7fe08c0c1ba0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 rx=0x7fe084009f20 tx=0x7fe084009840).stop 2023-11-30T18:39:41.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.516+0000 7fe09124c700 1 -- 172.21.15.49:0/1682238244 shutdown_connections 2023-11-30T18:39:41.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.516+0000 7fe09124c700 1 --2- 172.21.15.49:0/1682238244 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe08c0c1750 0x7fe08c0c1ba0 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:41.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.516+0000 7fe09124c700 1 --2- 172.21.15.49:0/1682238244 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe08c0c0180 0x7fe08c157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:41.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.516+0000 7fe09124c700 1 -- 172.21.15.49:0/1682238244 >> 172.21.15.49:0/1682238244 conn(0x7fe08c0cb000 msgr2=0x7fe08c0cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:41.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.516+0000 7fe09124c700 1 -- 172.21.15.49:0/1682238244 shutdown_connections 2023-11-30T18:39:41.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.516+0000 7fe09124c700 1 -- 172.21.15.49:0/1682238244 wait complete. 2023-11-30T18:39:41.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.518+0000 7fe09124c700 1 Processor -- start 2023-11-30T18:39:41.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.518+0000 7fe09124c700 1 -- start start 2023-11-30T18:39:41.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.518+0000 7fe09124c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe08c0c0180 0x7fe08c150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:41.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.518+0000 7fe09124c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe08c0c1750 0x7fe08c15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:41.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.518+0000 7fe09124c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe08c157660 0x7fe08c15abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:41.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.519+0000 7fe09124c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c164650 con 0x7fe08c0c0180 2023-11-30T18:39:41.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.519+0000 7fe09124c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c15b0d0 con 0x7fe08c157660 2023-11-30T18:39:41.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.519+0000 7fe09124c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c150a10 con 0x7fe08c0c1750 2023-11-30T18:39:41.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.519+0000 7fe08bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe08c0c0180 0x7fe08c150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:41.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.519+0000 7fe08bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe08c0c0180 0x7fe08c150520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59796/0 (socket says 172.21.15.49:59796) 2023-11-30T18:39:41.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.519+0000 7fe08bfff700 1 -- 172.21.15.49:0/1167281354 learned_addr learned my addr 172.21.15.49:0/1167281354 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:41.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.519+0000 7fe090a4b700 1 --2- 172.21.15.49:0/1167281354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe08c157660 0x7fe08c15abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:41.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.519+0000 7fe08b7fe700 1 --2- 172.21.15.49:0/1167281354 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe08c0c1750 0x7fe08c15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:41.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.519+0000 7fe08bfff700 1 -- 172.21.15.49:0/1167281354 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe08c0c1750 msgr2=0x7fe08c15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:41.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.519+0000 7fe08bfff700 1 --2- 172.21.15.49:0/1167281354 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe08c0c1750 0x7fe08c15a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:41.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.519+0000 7fe08bfff700 1 -- 172.21.15.49:0/1167281354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe08c157660 msgr2=0x7fe08c15abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:41.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.519+0000 7fe08bfff700 1 --2- 172.21.15.49:0/1167281354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe08c157660 0x7fe08c15abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:41.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.519+0000 7fe08bfff700 1 -- 172.21.15.49:0/1167281354 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe084009ae0 con 0x7fe08c0c0180 2023-11-30T18:39:41.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.519+0000 7fe08bfff700 1 --2- 172.21.15.49:0/1167281354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe08c0c0180 0x7fe08c150520 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7fe07c00c440 tx=0x7fe07c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:41.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.519+0000 7fe083fff700 1 -- 172.21.15.49:0/1167281354 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c007020 con 0x7fe08c0c0180 2023-11-30T18:39:41.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.519+0000 7fe083fff700 1 -- 172.21.15.49:0/1167281354 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07c007180 con 0x7fe08c0c0180 2023-11-30T18:39:41.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.519+0000 7fe09124c700 1 -- 172.21.15.49:0/1167281354 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe08c0af5d0 con 0x7fe08c0c0180 2023-11-30T18:39:41.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.519+0000 7fe083fff700 1 -- 172.21.15.49:0/1167281354 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c007520 con 0x7fe08c0c0180 2023-11-30T18:39:41.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.519+0000 7fe09124c700 1 -- 172.21.15.49:0/1167281354 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe08c165180 con 0x7fe08c0c0180 2023-11-30T18:39:41.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.520+0000 7fe09124c700 1 -- 172.21.15.49:0/1167281354 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe08c06c7c0 con 0x7fe08c0c0180 2023-11-30T18:39:41.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.521+0000 7fe083fff700 1 -- 172.21.15.49:0/1167281354 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe07c0068b0 con 0x7fe08c0c0180 2023-11-30T18:39:41.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.521+0000 7fe083fff700 1 --2- 172.21.15.49:0/1167281354 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe06c05f270 0x7fe06c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:41.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.521+0000 7fe083fff700 1 -- 172.21.15.49:0/1167281354 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6205+0+0 (secure 0 0 0) 0x7fe07c079640 con 0x7fe08c0c0180 2023-11-30T18:39:41.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.521+0000 7fe08b7fe700 1 --2- 172.21.15.49:0/1167281354 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe06c05f270 0x7fe06c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:41.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.522+0000 7fe08b7fe700 1 --2- 172.21.15.49:0/1167281354 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe06c05f270 0x7fe06c061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fe08c0af4b0 tx=0x7fe074008040).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:41.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.525+0000 7fe083fff700 1 -- 172.21.15.49:0/1167281354 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe07c047b00 con 0x7fe08c0c0180 2023-11-30T18:39:41.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.693+0000 7fe09124c700 1 -- 172.21.15.49:0/1167281354 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe08c0c0f50 con 0x7fe06c05f270 2023-11-30T18:39:41.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.702+0000 7fe083fff700 1 -- 172.21.15.49:0/1167281354 <== mgr.7760 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359132 (secure 0 0 0) 0x7fe08c0c0f50 con 0x7fe06c05f270 2023-11-30T18:39:41.708 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:39:41.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.706+0000 7fe09124c700 1 -- 172.21.15.49:0/1167281354 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe06c05f270 msgr2=0x7fe06c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:41.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.706+0000 7fe09124c700 1 --2- 172.21.15.49:0/1167281354 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe06c05f270 0x7fe06c061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fe08c0af4b0 tx=0x7fe074008040).stop 2023-11-30T18:39:41.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.706+0000 7fe09124c700 1 -- 172.21.15.49:0/1167281354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe08c0c0180 msgr2=0x7fe08c150520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:41.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.706+0000 7fe09124c700 1 --2- 172.21.15.49:0/1167281354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe08c0c0180 0x7fe08c150520 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7fe07c00c440 tx=0x7fe07c007e00).stop 2023-11-30T18:39:41.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.706+0000 7fe09124c700 1 -- 172.21.15.49:0/1167281354 shutdown_connections 2023-11-30T18:39:41.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.706+0000 7fe09124c700 1 --2- 172.21.15.49:0/1167281354 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe06c05f270 0x7fe06c061730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:41.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.706+0000 7fe09124c700 1 --2- 172.21.15.49:0/1167281354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe08c157660 0x7fe08c15abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:41.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.706+0000 7fe09124c700 1 --2- 172.21.15.49:0/1167281354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe08c0c0180 0x7fe08c150520 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:41.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.706+0000 7fe09124c700 1 --2- 172.21.15.49:0/1167281354 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe08c0c1750 0x7fe08c15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:41.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.706+0000 7fe09124c700 1 -- 172.21.15.49:0/1167281354 >> 172.21.15.49:0/1167281354 conn(0x7fe08c0cb000 msgr2=0x7fe08c0648d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:41.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.706+0000 7fe09124c700 1 -- 172.21.15.49:0/1167281354 shutdown_connections 2023-11-30T18:39:41.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.706+0000 7fe09124c700 1 -- 172.21.15.49:0/1167281354 wait complete. 2023-11-30T18:39:41.713 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T18:39:41.719 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-30T18:39:40.642877+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1414,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":208,"acting":208,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":216,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2449904,"kb_used_data":19760,"kb_used_omap":0,"kb_used_meta":2430080,"kb_avail":752524816,"statfs":{"total":773094113280,"available":770585411584,"internally_reserved":0,"allocated":20234240,"data_stored":10371452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2488401920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-594407,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-210,"num_write_kb":-721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.004735"},"pg_stats":[{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349312+0000","last_change":"2023-11-30T18:39:37.344457+0000","last_active":"2023-11-30T18:39:37.349312+0000","last_peered":"2023-11-30T18:39:37.349312+0000","last_clean":"2023-11-30T18:39:37.349312+0000","last_became_active":"2023-11-30T18:39:37.344174+0000","last_became_peered":"2023-11-30T18:39:37.344174+0000","last_unstale":"2023-11-30T18:39:37.349312+0000","last_undegraded":"2023-11-30T18:39:37.349312+0000","last_fullsized":"2023-11-30T18:39:37.349312+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3f","version":"202'3","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346160+0000","last_change":"2023-11-30T18:39:36.952718+0000","last_active":"2023-11-30T18:39:37.346160+0000","last_peered":"2023-11-30T18:39:37.346160+0000","last_clean":"2023-11-30T18:39:37.346160+0000","last_became_active":"2023-11-30T18:39:36.952412+0000","last_became_peered":"2023-11-30T18:39:36.952412+0000","last_unstale":"2023-11-30T18:39:37.346160+0000","last_undegraded":"2023-11-30T18:39:37.346160+0000","last_fullsized":"2023-11-30T18:39:37.346160+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.342165+0000","last_change":"2023-11-30T18:39:37.339227+0000","last_active":"2023-11-30T18:39:37.342165+0000","last_peered":"2023-11-30T18:39:37.342165+0000","last_clean":"2023-11-30T18:39:37.342165+0000","last_became_active":"2023-11-30T18:39:37.338774+0000","last_became_peered":"2023-11-30T18:39:37.338774+0000","last_unstale":"2023-11-30T18:39:37.342165+0000","last_undegraded":"2023-11-30T18:39:37.342165+0000","last_fullsized":"2023-11-30T18:39:37.342165+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349301+0000","last_change":"2023-11-30T18:39:37.345801+0000","last_active":"2023-11-30T18:39:37.349301+0000","last_peered":"2023-11-30T18:39:37.349301+0000","last_clean":"2023-11-30T18:39:37.349301+0000","last_became_active":"2023-11-30T18:39:37.345516+0000","last_became_peered":"2023-11-30T18:39:37.345516+0000","last_unstale":"2023-11-30T18:39:37.349301+0000","last_undegraded":"2023-11-30T18:39:37.349301+0000","last_fullsized":"2023-11-30T18:39:37.349301+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3c","version":"202'2","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347142+0000","last_change":"2023-11-30T18:39:36.949667+0000","last_active":"2023-11-30T18:39:37.347142+0000","last_peered":"2023-11-30T18:39:37.347142+0000","last_clean":"2023-11-30T18:39:37.347142+0000","last_became_active":"2023-11-30T18:39:36.949238+0000","last_became_peered":"2023-11-30T18:39:36.949238+0000","last_unstale":"2023-11-30T18:39:37.347142+0000","last_undegraded":"2023-11-30T18:39:37.347142+0000","last_fullsized":"2023-11-30T18:39:37.347142+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.351900+0000","last_change":"2023-11-30T18:39:37.349000+0000","last_active":"2023-11-30T18:39:37.351900+0000","last_peered":"2023-11-30T18:39:37.351900+0000","last_clean":"2023-11-30T18:39:37.351900+0000","last_became_active":"2023-11-30T18:39:37.348658+0000","last_became_peered":"2023-11-30T18:39:37.348658+0000","last_unstale":"2023-11-30T18:39:37.351900+0000","last_undegraded":"2023-11-30T18:39:37.351900+0000","last_fullsized":"2023-11-30T18:39:37.351900+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3a","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346845+0000","last_change":"2023-11-30T18:39:36.948257+0000","last_active":"2023-11-30T18:39:37.346845+0000","last_peered":"2023-11-30T18:39:37.346845+0000","last_clean":"2023-11-30T18:39:37.346845+0000","last_became_active":"2023-11-30T18:39:36.947769+0000","last_became_peered":"2023-11-30T18:39:36.947769+0000","last_unstale":"2023-11-30T18:39:37.346845+0000","last_undegraded":"2023-11-30T18:39:37.346845+0000","last_fullsized":"2023-11-30T18:39:37.346845+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347404+0000","last_change":"2023-11-30T18:39:37.345626+0000","last_active":"2023-11-30T18:39:37.347404+0000","last_peered":"2023-11-30T18:39:37.347404+0000","last_clean":"2023-11-30T18:39:37.347404+0000","last_became_active":"2023-11-30T18:39:37.345347+0000","last_became_peered":"2023-11-30T18:39:37.345347+0000","last_unstale":"2023-11-30T18:39:37.347404+0000","last_undegraded":"2023-11-30T18:39:37.347404+0000","last_fullsized":"2023-11-30T18:39:37.347404+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.333622+0000","last_change":"2023-11-30T18:39:36.946508+0000","last_active":"2023-11-30T18:39:37.333622+0000","last_peered":"2023-11-30T18:39:37.333622+0000","last_clean":"2023-11-30T18:39:37.333622+0000","last_became_active":"2023-11-30T18:39:36.946260+0000","last_became_peered":"2023-11-30T18:39:36.946260+0000","last_unstale":"2023-11-30T18:39:37.333622+0000","last_undegraded":"2023-11-30T18:39:37.333622+0000","last_fullsized":"2023-11-30T18:39:37.333622+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347329+0000","last_change":"2023-11-30T18:39:37.344153+0000","last_active":"2023-11-30T18:39:37.347329+0000","last_peered":"2023-11-30T18:39:37.347329+0000","last_clean":"2023-11-30T18:39:37.347329+0000","last_became_active":"2023-11-30T18:39:37.343879+0000","last_became_peered":"2023-11-30T18:39:37.343879+0000","last_unstale":"2023-11-30T18:39:37.347329+0000","last_undegraded":"2023-11-30T18:39:37.347329+0000","last_fullsized":"2023-11-30T18:39:37.347329+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347574+0000","last_change":"2023-11-30T18:39:37.343067+0000","last_active":"2023-11-30T18:39:37.347574+0000","last_peered":"2023-11-30T18:39:37.347574+0000","last_clean":"2023-11-30T18:39:37.347574+0000","last_became_active":"2023-11-30T18:39:37.338376+0000","last_became_peered":"2023-11-30T18:39:37.338376+0000","last_unstale":"2023-11-30T18:39:37.347574+0000","last_undegraded":"2023-11-30T18:39:37.347574+0000","last_fullsized":"2023-11-30T18:39:37.347574+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.343031+0000","last_change":"2023-11-30T18:39:37.336599+0000","last_active":"2023-11-30T18:39:37.343031+0000","last_peered":"2023-11-30T18:39:37.343031+0000","last_clean":"2023-11-30T18:39:37.343031+0000","last_became_active":"2023-11-30T18:39:37.336034+0000","last_became_peered":"2023-11-30T18:39:37.336034+0000","last_unstale":"2023-11-30T18:39:37.343031+0000","last_undegraded":"2023-11-30T18:39:37.343031+0000","last_fullsized":"2023-11-30T18:39:37.343031+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346994+0000","last_change":"2023-11-30T18:39:37.344677+0000","last_active":"2023-11-30T18:39:37.346994+0000","last_peered":"2023-11-30T18:39:37.346994+0000","last_clean":"2023-11-30T18:39:37.346994+0000","last_became_active":"2023-11-30T18:39:37.344361+0000","last_became_peered":"2023-11-30T18:39:37.344361+0000","last_unstale":"2023-11-30T18:39:37.346994+0000","last_undegraded":"2023-11-30T18:39:37.346994+0000","last_fullsized":"2023-11-30T18:39:37.346994+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349920+0000","last_change":"2023-11-30T18:39:37.346869+0000","last_active":"2023-11-30T18:39:37.349920+0000","last_peered":"2023-11-30T18:39:37.349920+0000","last_clean":"2023-11-30T18:39:37.349920+0000","last_became_active":"2023-11-30T18:39:37.346571+0000","last_became_peered":"2023-11-30T18:39:37.346571+0000","last_unstale":"2023-11-30T18:39:37.349920+0000","last_undegraded":"2023-11-30T18:39:37.349920+0000","last_fullsized":"2023-11-30T18:39:37.349920+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349366+0000","last_change":"2023-11-30T18:39:37.345080+0000","last_active":"2023-11-30T18:39:37.349366+0000","last_peered":"2023-11-30T18:39:37.349366+0000","last_clean":"2023-11-30T18:39:37.349366+0000","last_became_active":"2023-11-30T18:39:37.344759+0000","last_became_peered":"2023-11-30T18:39:37.344759+0000","last_unstale":"2023-11-30T18:39:37.349366+0000","last_undegraded":"2023-11-30T18:39:37.349366+0000","last_fullsized":"2023-11-30T18:39:37.349366+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352812+0000","last_change":"2023-11-30T18:39:37.351277+0000","last_active":"2023-11-30T18:39:37.352812+0000","last_peered":"2023-11-30T18:39:37.352812+0000","last_clean":"2023-11-30T18:39:37.352812+0000","last_became_active":"2023-11-30T18:39:37.351026+0000","last_became_peered":"2023-11-30T18:39:37.351026+0000","last_unstale":"2023-11-30T18:39:37.352812+0000","last_undegraded":"2023-11-30T18:39:37.352812+0000","last_fullsized":"2023-11-30T18:39:37.352812+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346081+0000","last_change":"2023-11-30T18:39:37.338925+0000","last_active":"2023-11-30T18:39:37.346081+0000","last_peered":"2023-11-30T18:39:37.346081+0000","last_clean":"2023-11-30T18:39:37.346081+0000","last_became_active":"2023-11-30T18:39:37.338608+0000","last_became_peered":"2023-11-30T18:39:37.338608+0000","last_unstale":"2023-11-30T18:39:37.346081+0000","last_undegraded":"2023-11-30T18:39:37.346081+0000","last_fullsized":"2023-11-30T18:39:37.346081+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.329742+0000","last_change":"2023-11-30T18:39:36.949738+0000","last_active":"2023-11-30T18:39:37.329742+0000","last_peered":"2023-11-30T18:39:37.329742+0000","last_clean":"2023-11-30T18:39:37.329742+0000","last_became_active":"2023-11-30T18:39:36.949398+0000","last_became_peered":"2023-11-30T18:39:36.949398+0000","last_unstale":"2023-11-30T18:39:37.329742+0000","last_undegraded":"2023-11-30T18:39:37.329742+0000","last_fullsized":"2023-11-30T18:39:37.329742+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352073+0000","last_change":"2023-11-30T18:39:37.347542+0000","last_active":"2023-11-30T18:39:37.352073+0000","last_peered":"2023-11-30T18:39:37.352073+0000","last_clean":"2023-11-30T18:39:37.352073+0000","last_became_active":"2023-11-30T18:39:37.347265+0000","last_became_peered":"2023-11-30T18:39:37.347265+0000","last_unstale":"2023-11-30T18:39:37.352073+0000","last_undegraded":"2023-11-30T18:39:37.352073+0000","last_fullsized":"2023-11-30T18:39:37.352073+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.30","version":"202'4","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.350561+0000","last_change":"2023-11-30T18:39:36.951234+0000","last_active":"2023-11-30T18:39:37.350561+0000","last_peered":"2023-11-30T18:39:37.350561+0000","last_clean":"2023-11-30T18:39:37.350561+0000","last_became_active":"2023-11-30T18:39:36.950335+0000","last_became_peered":"2023-11-30T18:39:36.950335+0000","last_unstale":"2023-11-30T18:39:37.350561+0000","last_undegraded":"2023-11-30T18:39:37.350561+0000","last_fullsized":"2023-11-30T18:39:37.350561+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.326222+0000","last_change":"2023-11-30T18:39:36.949535+0000","last_active":"2023-11-30T18:39:37.326222+0000","last_peered":"2023-11-30T18:39:37.326222+0000","last_clean":"2023-11-30T18:39:37.326222+0000","last_became_active":"2023-11-30T18:39:36.949241+0000","last_became_peered":"2023-11-30T18:39:36.949241+0000","last_unstale":"2023-11-30T18:39:37.326222+0000","last_undegraded":"2023-11-30T18:39:37.326222+0000","last_fullsized":"2023-11-30T18:39:37.326222+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.337654+0000","last_change":"2023-11-30T18:39:36.949130+0000","last_active":"2023-11-30T18:39:37.337654+0000","last_peered":"2023-11-30T18:39:37.337654+0000","last_clean":"2023-11-30T18:39:37.337654+0000","last_became_active":"2023-11-30T18:39:36.946324+0000","last_became_peered":"2023-11-30T18:39:36.946324+0000","last_unstale":"2023-11-30T18:39:37.337654+0000","last_undegraded":"2023-11-30T18:39:37.337654+0000","last_fullsized":"2023-11-30T18:39:37.337654+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2d","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347422+0000","last_change":"2023-11-30T18:39:36.943783+0000","last_active":"2023-11-30T18:39:37.347422+0000","last_peered":"2023-11-30T18:39:37.347422+0000","last_clean":"2023-11-30T18:39:37.347422+0000","last_became_active":"2023-11-30T18:39:36.943292+0000","last_became_peered":"2023-11-30T18:39:36.943292+0000","last_unstale":"2023-11-30T18:39:37.347422+0000","last_undegraded":"2023-11-30T18:39:37.347422+0000","last_fullsized":"2023-11-30T18:39:37.347422+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349567+0000","last_change":"2023-11-30T18:39:37.346979+0000","last_active":"2023-11-30T18:39:37.349567+0000","last_peered":"2023-11-30T18:39:37.349567+0000","last_clean":"2023-11-30T18:39:37.349567+0000","last_became_active":"2023-11-30T18:39:37.346664+0000","last_became_peered":"2023-11-30T18:39:37.346664+0000","last_unstale":"2023-11-30T18:39:37.349567+0000","last_undegraded":"2023-11-30T18:39:37.349567+0000","last_fullsized":"2023-11-30T18:39:37.349567+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.353489+0000","last_change":"2023-11-30T18:39:37.352660+0000","last_active":"2023-11-30T18:39:37.353489+0000","last_peered":"2023-11-30T18:39:37.353489+0000","last_clean":"2023-11-30T18:39:37.353489+0000","last_became_active":"2023-11-30T18:39:37.352052+0000","last_became_peered":"2023-11-30T18:39:37.352052+0000","last_unstale":"2023-11-30T18:39:37.353489+0000","last_undegraded":"2023-11-30T18:39:37.353489+0000","last_fullsized":"2023-11-30T18:39:37.353489+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.343254+0000","last_change":"2023-11-30T18:39:36.952248+0000","last_active":"2023-11-30T18:39:37.343254+0000","last_peered":"2023-11-30T18:39:37.343254+0000","last_clean":"2023-11-30T18:39:37.343254+0000","last_became_active":"2023-11-30T18:39:36.951960+0000","last_became_peered":"2023-11-30T18:39:36.951960+0000","last_unstale":"2023-11-30T18:39:37.343254+0000","last_undegraded":"2023-11-30T18:39:37.343254+0000","last_fullsized":"2023-11-30T18:39:37.343254+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349666+0000","last_change":"2023-11-30T18:39:37.346628+0000","last_active":"2023-11-30T18:39:37.349666+0000","last_peered":"2023-11-30T18:39:37.349666+0000","last_clean":"2023-11-30T18:39:37.349666+0000","last_became_active":"2023-11-30T18:39:37.346349+0000","last_became_peered":"2023-11-30T18:39:37.346349+0000","last_unstale":"2023-11-30T18:39:37.349666+0000","last_undegraded":"2023-11-30T18:39:37.349666+0000","last_fullsized":"2023-11-30T18:39:37.349666+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347382+0000","last_change":"2023-11-30T18:39:37.344874+0000","last_active":"2023-11-30T18:39:37.347382+0000","last_peered":"2023-11-30T18:39:37.347382+0000","last_clean":"2023-11-30T18:39:37.347382+0000","last_became_active":"2023-11-30T18:39:37.344613+0000","last_became_peered":"2023-11-30T18:39:37.344613+0000","last_unstale":"2023-11-30T18:39:37.347382+0000","last_undegraded":"2023-11-30T18:39:37.347382+0000","last_fullsized":"2023-11-30T18:39:37.347382+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.323906+0000","last_change":"2023-11-30T18:39:36.946087+0000","last_active":"2023-11-30T18:39:37.323906+0000","last_peered":"2023-11-30T18:39:37.323906+0000","last_clean":"2023-11-30T18:39:37.323906+0000","last_became_active":"2023-11-30T18:39:36.945402+0000","last_became_peered":"2023-11-30T18:39:36.945402+0000","last_unstale":"2023-11-30T18:39:37.323906+0000","last_undegraded":"2023-11-30T18:39:37.323906+0000","last_fullsized":"2023-11-30T18:39:37.323906+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.348211+0000","last_change":"2023-11-30T18:39:37.344635+0000","last_active":"2023-11-30T18:39:37.348211+0000","last_peered":"2023-11-30T18:39:37.348211+0000","last_clean":"2023-11-30T18:39:37.348211+0000","last_became_active":"2023-11-30T18:39:37.344167+0000","last_became_peered":"2023-11-30T18:39:37.344167+0000","last_unstale":"2023-11-30T18:39:37.348211+0000","last_undegraded":"2023-11-30T18:39:37.348211+0000","last_fullsized":"2023-11-30T18:39:37.348211+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349334+0000","last_change":"2023-11-30T18:39:37.344920+0000","last_active":"2023-11-30T18:39:37.349334+0000","last_peered":"2023-11-30T18:39:37.349334+0000","last_clean":"2023-11-30T18:39:37.349334+0000","last_became_active":"2023-11-30T18:39:37.344397+0000","last_became_peered":"2023-11-30T18:39:37.344397+0000","last_unstale":"2023-11-30T18:39:37.349334+0000","last_undegraded":"2023-11-30T18:39:37.349334+0000","last_fullsized":"2023-11-30T18:39:37.349334+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.340948+0000","last_change":"2023-11-30T18:39:37.339921+0000","last_active":"2023-11-30T18:39:37.340948+0000","last_peered":"2023-11-30T18:39:37.340948+0000","last_clean":"2023-11-30T18:39:37.340948+0000","last_became_active":"2023-11-30T18:39:37.339659+0000","last_became_peered":"2023-11-30T18:39:37.339659+0000","last_unstale":"2023-11-30T18:39:37.340948+0000","last_undegraded":"2023-11-30T18:39:37.340948+0000","last_fullsized":"2023-11-30T18:39:37.340948+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.331794+0000","last_change":"2023-11-30T18:39:36.952942+0000","last_active":"2023-11-30T18:39:37.331794+0000","last_peered":"2023-11-30T18:39:37.331794+0000","last_clean":"2023-11-30T18:39:37.331794+0000","last_became_active":"2023-11-30T18:39:36.952663+0000","last_became_peered":"2023-11-30T18:39:36.952663+0000","last_unstale":"2023-11-30T18:39:37.331794+0000","last_undegraded":"2023-11-30T18:39:37.331794+0000","last_fullsized":"2023-11-30T18:39:37.331794+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349529+0000","last_change":"2023-11-30T18:39:37.345821+0000","last_active":"2023-11-30T18:39:37.349529+0000","last_peered":"2023-11-30T18:39:37.349529+0000","last_clean":"2023-11-30T18:39:37.349529+0000","last_became_active":"2023-11-30T18:39:37.345470+0000","last_became_peered":"2023-11-30T18:39:37.345470+0000","last_unstale":"2023-11-30T18:39:37.349529+0000","last_undegraded":"2023-11-30T18:39:37.349529+0000","last_fullsized":"2023-11-30T18:39:37.349529+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.348203+0000","last_change":"2023-11-30T18:39:37.344683+0000","last_active":"2023-11-30T18:39:37.348203+0000","last_peered":"2023-11-30T18:39:37.348203+0000","last_clean":"2023-11-30T18:39:37.348203+0000","last_became_active":"2023-11-30T18:39:37.344395+0000","last_became_peered":"2023-11-30T18:39:37.344395+0000","last_unstale":"2023-11-30T18:39:37.348203+0000","last_undegraded":"2023-11-30T18:39:37.348203+0000","last_fullsized":"2023-11-30T18:39:37.348203+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327088+0000","last_change":"2023-11-30T18:39:36.940369+0000","last_active":"2023-11-30T18:39:37.327088+0000","last_peered":"2023-11-30T18:39:37.327088+0000","last_clean":"2023-11-30T18:39:37.327088+0000","last_became_active":"2023-11-30T18:39:36.940068+0000","last_became_peered":"2023-11-30T18:39:36.940068+0000","last_unstale":"2023-11-30T18:39:37.327088+0000","last_undegraded":"2023-11-30T18:39:37.327088+0000","last_fullsized":"2023-11-30T18:39:37.327088+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.344294+0000","last_change":"2023-11-30T18:39:37.339378+0000","last_active":"2023-11-30T18:39:37.344294+0000","last_peered":"2023-11-30T18:39:37.344294+0000","last_clean":"2023-11-30T18:39:37.344294+0000","last_became_active":"2023-11-30T18:39:37.339129+0000","last_became_peered":"2023-11-30T18:39:37.339129+0000","last_unstale":"2023-11-30T18:39:37.344294+0000","last_undegraded":"2023-11-30T18:39:37.344294+0000","last_fullsized":"2023-11-30T18:39:37.344294+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.338109+0000","last_change":"2023-11-30T18:39:36.951143+0000","last_active":"2023-11-30T18:39:37.338109+0000","last_peered":"2023-11-30T18:39:37.338109+0000","last_clean":"2023-11-30T18:39:37.338109+0000","last_became_active":"2023-11-30T18:39:36.949920+0000","last_became_peered":"2023-11-30T18:39:36.949920+0000","last_unstale":"2023-11-30T18:39:37.338109+0000","last_undegraded":"2023-11-30T18:39:37.338109+0000","last_fullsized":"2023-11-30T18:39:37.338109+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.336742+0000","last_change":"2023-11-30T18:39:36.946323+0000","last_active":"2023-11-30T18:39:37.336742+0000","last_peered":"2023-11-30T18:39:37.336742+0000","last_clean":"2023-11-30T18:39:37.336742+0000","last_became_active":"2023-11-30T18:39:36.946044+0000","last_became_peered":"2023-11-30T18:39:36.946044+0000","last_unstale":"2023-11-30T18:39:37.336742+0000","last_undegraded":"2023-11-30T18:39:37.336742+0000","last_fullsized":"2023-11-30T18:39:37.336742+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.340269+0000","last_change":"2023-11-30T18:39:37.331035+0000","last_active":"2023-11-30T18:39:37.340269+0000","last_peered":"2023-11-30T18:39:37.340269+0000","last_clean":"2023-11-30T18:39:37.340269+0000","last_became_active":"2023-11-30T18:39:37.330729+0000","last_became_peered":"2023-11-30T18:39:37.330729+0000","last_unstale":"2023-11-30T18:39:37.340269+0000","last_undegraded":"2023-11-30T18:39:37.340269+0000","last_fullsized":"2023-11-30T18:39:37.340269+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.337914+0000","last_change":"2023-11-30T18:39:36.950391+0000","last_active":"2023-11-30T18:39:37.337914+0000","last_peered":"2023-11-30T18:39:37.337914+0000","last_clean":"2023-11-30T18:39:37.337914+0000","last_became_active":"2023-11-30T18:39:36.946855+0000","last_became_peered":"2023-11-30T18:39:36.946855+0000","last_unstale":"2023-11-30T18:39:37.337914+0000","last_undegraded":"2023-11-30T18:39:37.337914+0000","last_fullsized":"2023-11-30T18:39:37.337914+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347365+0000","last_change":"2023-11-30T18:39:37.340342+0000","last_active":"2023-11-30T18:39:37.347365+0000","last_peered":"2023-11-30T18:39:37.347365+0000","last_clean":"2023-11-30T18:39:37.347365+0000","last_became_active":"2023-11-30T18:39:37.340045+0000","last_became_peered":"2023-11-30T18:39:37.340045+0000","last_unstale":"2023-11-30T18:39:37.347365+0000","last_undegraded":"2023-11-30T18:39:37.347365+0000","last_fullsized":"2023-11-30T18:39:37.347365+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352099+0000","last_change":"2023-11-30T18:39:36.948987+0000","last_active":"2023-11-30T18:39:37.352099+0000","last_peered":"2023-11-30T18:39:37.352099+0000","last_clean":"2023-11-30T18:39:37.352099+0000","last_became_active":"2023-11-30T18:39:36.947046+0000","last_became_peered":"2023-11-30T18:39:36.947046+0000","last_unstale":"2023-11-30T18:39:37.352099+0000","last_undegraded":"2023-11-30T18:39:37.352099+0000","last_fullsized":"2023-11-30T18:39:37.352099+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.345480+0000","last_change":"2023-11-30T18:39:37.341621+0000","last_active":"2023-11-30T18:39:37.345480+0000","last_peered":"2023-11-30T18:39:37.345480+0000","last_clean":"2023-11-30T18:39:37.345480+0000","last_became_active":"2023-11-30T18:39:37.341312+0000","last_became_peered":"2023-11-30T18:39:37.341312+0000","last_unstale":"2023-11-30T18:39:37.345480+0000","last_undegraded":"2023-11-30T18:39:37.345480+0000","last_fullsized":"2023-11-30T18:39:37.345480+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346986+0000","last_change":"2023-11-30T18:39:36.952827+0000","last_active":"2023-11-30T18:39:37.346986+0000","last_peered":"2023-11-30T18:39:37.346986+0000","last_clean":"2023-11-30T18:39:37.346986+0000","last_became_active":"2023-11-30T18:39:36.952608+0000","last_became_peered":"2023-11-30T18:39:36.952608+0000","last_unstale":"2023-11-30T18:39:37.346986+0000","last_undegraded":"2023-11-30T18:39:37.346986+0000","last_fullsized":"2023-11-30T18:39:37.346986+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.342144+0000","last_change":"2023-11-30T18:39:37.339035+0000","last_active":"2023-11-30T18:39:37.342144+0000","last_peered":"2023-11-30T18:39:37.342144+0000","last_clean":"2023-11-30T18:39:37.342144+0000","last_became_active":"2023-11-30T18:39:37.338479+0000","last_became_peered":"2023-11-30T18:39:37.338479+0000","last_unstale":"2023-11-30T18:39:37.342144+0000","last_undegraded":"2023-11-30T18:39:37.342144+0000","last_fullsized":"2023-11-30T18:39:37.342144+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346109+0000","last_change":"2023-11-30T18:39:37.338996+0000","last_active":"2023-11-30T18:39:37.346109+0000","last_peered":"2023-11-30T18:39:37.346109+0000","last_clean":"2023-11-30T18:39:37.346109+0000","last_became_active":"2023-11-30T18:39:37.338697+0000","last_became_peered":"2023-11-30T18:39:37.338697+0000","last_unstale":"2023-11-30T18:39:37.346109+0000","last_undegraded":"2023-11-30T18:39:37.346109+0000","last_fullsized":"2023-11-30T18:39:37.346109+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.325152+0000","last_change":"2023-11-30T18:39:36.946452+0000","last_active":"2023-11-30T18:39:37.325152+0000","last_peered":"2023-11-30T18:39:37.325152+0000","last_clean":"2023-11-30T18:39:37.325152+0000","last_became_active":"2023-11-30T18:39:36.946158+0000","last_became_peered":"2023-11-30T18:39:36.946158+0000","last_unstale":"2023-11-30T18:39:37.325152+0000","last_undegraded":"2023-11-30T18:39:37.325152+0000","last_fullsized":"2023-11-30T18:39:37.325152+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.350555+0000","last_change":"2023-11-30T18:39:37.347669+0000","last_active":"2023-11-30T18:39:37.350555+0000","last_peered":"2023-11-30T18:39:37.350555+0000","last_clean":"2023-11-30T18:39:37.350555+0000","last_became_active":"2023-11-30T18:39:37.347353+0000","last_became_peered":"2023-11-30T18:39:37.347353+0000","last_unstale":"2023-11-30T18:39:37.350555+0000","last_undegraded":"2023-11-30T18:39:37.350555+0000","last_fullsized":"2023-11-30T18:39:37.350555+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.326852+0000","last_change":"2023-11-30T18:39:36.948868+0000","last_active":"2023-11-30T18:39:37.326852+0000","last_peered":"2023-11-30T18:39:37.326852+0000","last_clean":"2023-11-30T18:39:37.326852+0000","last_became_active":"2023-11-30T18:39:36.948560+0000","last_became_peered":"2023-11-30T18:39:36.948560+0000","last_unstale":"2023-11-30T18:39:37.326852+0000","last_undegraded":"2023-11-30T18:39:37.326852+0000","last_fullsized":"2023-11-30T18:39:37.326852+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.345333+0000","last_change":"2023-11-30T18:39:37.342635+0000","last_active":"2023-11-30T18:39:37.345333+0000","last_peered":"2023-11-30T18:39:37.345333+0000","last_clean":"2023-11-30T18:39:37.345333+0000","last_became_active":"2023-11-30T18:39:37.342376+0000","last_became_peered":"2023-11-30T18:39:37.342376+0000","last_unstale":"2023-11-30T18:39:37.345333+0000","last_undegraded":"2023-11-30T18:39:37.345333+0000","last_fullsized":"2023-11-30T18:39:37.345333+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327461+0000","last_change":"2023-11-30T18:39:36.944677+0000","last_active":"2023-11-30T18:39:37.327461+0000","last_peered":"2023-11-30T18:39:37.327461+0000","last_clean":"2023-11-30T18:39:37.327461+0000","last_became_active":"2023-11-30T18:39:36.944380+0000","last_became_peered":"2023-11-30T18:39:36.944380+0000","last_unstale":"2023-11-30T18:39:37.327461+0000","last_undegraded":"2023-11-30T18:39:37.327461+0000","last_fullsized":"2023-11-30T18:39:37.327461+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.338865+0000","last_change":"2023-11-30T18:39:37.334416+0000","last_active":"2023-11-30T18:39:37.338865+0000","last_peered":"2023-11-30T18:39:37.338865+0000","last_clean":"2023-11-30T18:39:37.338865+0000","last_became_active":"2023-11-30T18:39:37.334121+0000","last_became_peered":"2023-11-30T18:39:37.334121+0000","last_unstale":"2023-11-30T18:39:37.338865+0000","last_undegraded":"2023-11-30T18:39:37.338865+0000","last_fullsized":"2023-11-30T18:39:37.338865+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.323817+0000","last_change":"2023-11-30T18:39:36.946789+0000","last_active":"2023-11-30T18:39:37.323817+0000","last_peered":"2023-11-30T18:39:37.323817+0000","last_clean":"2023-11-30T18:39:37.323817+0000","last_became_active":"2023-11-30T18:39:36.946341+0000","last_became_peered":"2023-11-30T18:39:36.946341+0000","last_unstale":"2023-11-30T18:39:37.323817+0000","last_undegraded":"2023-11-30T18:39:37.323817+0000","last_fullsized":"2023-11-30T18:39:37.323817+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349417+0000","last_change":"2023-11-30T18:39:37.344746+0000","last_active":"2023-11-30T18:39:37.349417+0000","last_peered":"2023-11-30T18:39:37.349417+0000","last_clean":"2023-11-30T18:39:37.349417+0000","last_became_active":"2023-11-30T18:39:37.344421+0000","last_became_peered":"2023-11-30T18:39:37.344421+0000","last_unstale":"2023-11-30T18:39:37.349417+0000","last_undegraded":"2023-11-30T18:39:37.349417+0000","last_fullsized":"2023-11-30T18:39:37.349417+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327484+0000","last_change":"2023-11-30T18:39:36.950190+0000","last_active":"2023-11-30T18:39:37.327484+0000","last_peered":"2023-11-30T18:39:37.327484+0000","last_clean":"2023-11-30T18:39:37.327484+0000","last_became_active":"2023-11-30T18:39:36.949891+0000","last_became_peered":"2023-11-30T18:39:36.949891+0000","last_unstale":"2023-11-30T18:39:37.327484+0000","last_undegraded":"2023-11-30T18:39:37.327484+0000","last_fullsized":"2023-11-30T18:39:37.327484+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347541+0000","last_change":"2023-11-30T18:39:37.335167+0000","last_active":"2023-11-30T18:39:37.347541+0000","last_peered":"2023-11-30T18:39:37.347541+0000","last_clean":"2023-11-30T18:39:37.347541+0000","last_became_active":"2023-11-30T18:39:37.334308+0000","last_became_peered":"2023-11-30T18:39:37.334308+0000","last_unstale":"2023-11-30T18:39:37.347541+0000","last_undegraded":"2023-11-30T18:39:37.347541+0000","last_fullsized":"2023-11-30T18:39:37.347541+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.351861+0000","last_change":"2023-11-30T18:39:36.952979+0000","last_active":"2023-11-30T18:39:37.351861+0000","last_peered":"2023-11-30T18:39:37.351861+0000","last_clean":"2023-11-30T18:39:37.351861+0000","last_became_active":"2023-11-30T18:39:36.952615+0000","last_became_peered":"2023-11-30T18:39:36.952615+0000","last_unstale":"2023-11-30T18:39:37.351861+0000","last_undegraded":"2023-11-30T18:39:37.351861+0000","last_fullsized":"2023-11-30T18:39:37.351861+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.e","version":"202'2","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.348393+0000","last_change":"2023-11-30T18:39:36.954616+0000","last_active":"2023-11-30T18:39:37.348393+0000","last_peered":"2023-11-30T18:39:37.348393+0000","last_clean":"2023-11-30T18:39:37.348393+0000","last_became_active":"2023-11-30T18:39:36.953752+0000","last_became_peered":"2023-11-30T18:39:36.953752+0000","last_unstale":"2023-11-30T18:39:37.348393+0000","last_undegraded":"2023-11-30T18:39:37.348393+0000","last_fullsized":"2023-11-30T18:39:37.348393+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.333794+0000","last_change":"2023-11-30T18:39:36.946600+0000","last_active":"2023-11-30T18:39:37.333794+0000","last_peered":"2023-11-30T18:39:37.333794+0000","last_clean":"2023-11-30T18:39:37.333794+0000","last_became_active":"2023-11-30T18:39:36.946270+0000","last_became_peered":"2023-11-30T18:39:36.946270+0000","last_unstale":"2023-11-30T18:39:37.333794+0000","last_undegraded":"2023-11-30T18:39:37.333794+0000","last_fullsized":"2023-11-30T18:39:37.333794+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327189+0000","last_change":"2023-11-30T18:39:36.944458+0000","last_active":"2023-11-30T18:39:37.327189+0000","last_peered":"2023-11-30T18:39:37.327189+0000","last_clean":"2023-11-30T18:39:37.327189+0000","last_became_active":"2023-11-30T18:39:36.944179+0000","last_became_peered":"2023-11-30T18:39:36.944179+0000","last_unstale":"2023-11-30T18:39:37.327189+0000","last_undegraded":"2023-11-30T18:39:37.327189+0000","last_fullsized":"2023-11-30T18:39:37.327189+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.353566+0000","last_change":"2023-11-30T18:39:37.352804+0000","last_active":"2023-11-30T18:39:37.353566+0000","last_peered":"2023-11-30T18:39:37.353566+0000","last_clean":"2023-11-30T18:39:37.353566+0000","last_became_active":"2023-11-30T18:39:37.352435+0000","last_became_peered":"2023-11-30T18:39:37.352435+0000","last_unstale":"2023-11-30T18:39:37.353566+0000","last_undegraded":"2023-11-30T18:39:37.353566+0000","last_fullsized":"2023-11-30T18:39:37.353566+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347239+0000","last_change":"2023-11-30T18:39:36.950997+0000","last_active":"2023-11-30T18:39:37.347239+0000","last_peered":"2023-11-30T18:39:37.347239+0000","last_clean":"2023-11-30T18:39:37.347239+0000","last_became_active":"2023-11-30T18:39:36.950673+0000","last_became_peered":"2023-11-30T18:39:36.950673+0000","last_unstale":"2023-11-30T18:39:37.347239+0000","last_undegraded":"2023-11-30T18:39:37.347239+0000","last_fullsized":"2023-11-30T18:39:37.347239+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352565+0000","last_change":"2023-11-30T18:39:37.351298+0000","last_active":"2023-11-30T18:39:37.352565+0000","last_peered":"2023-11-30T18:39:37.352565+0000","last_clean":"2023-11-30T18:39:37.352565+0000","last_became_active":"2023-11-30T18:39:37.350781+0000","last_became_peered":"2023-11-30T18:39:37.350781+0000","last_unstale":"2023-11-30T18:39:37.352565+0000","last_undegraded":"2023-11-30T18:39:37.352565+0000","last_fullsized":"2023-11-30T18:39:37.352565+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349380+0000","last_change":"2023-11-30T18:39:37.342904+0000","last_active":"2023-11-30T18:39:37.349380+0000","last_peered":"2023-11-30T18:39:37.349380+0000","last_clean":"2023-11-30T18:39:37.349380+0000","last_became_active":"2023-11-30T18:39:37.342597+0000","last_became_peered":"2023-11-30T18:39:37.342597+0000","last_unstale":"2023-11-30T18:39:37.349380+0000","last_undegraded":"2023-11-30T18:39:37.349380+0000","last_fullsized":"2023-11-30T18:39:37.349380+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.323729+0000","last_change":"2023-11-30T18:39:36.946627+0000","last_active":"2023-11-30T18:39:37.323729+0000","last_peered":"2023-11-30T18:39:37.323729+0000","last_clean":"2023-11-30T18:39:37.323729+0000","last_became_active":"2023-11-30T18:39:36.945813+0000","last_became_peered":"2023-11-30T18:39:36.945813+0000","last_unstale":"2023-11-30T18:39:37.323729+0000","last_undegraded":"2023-11-30T18:39:37.323729+0000","last_fullsized":"2023-11-30T18:39:37.323729+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346095+0000","last_change":"2023-11-30T18:39:37.343145+0000","last_active":"2023-11-30T18:39:37.346095+0000","last_peered":"2023-11-30T18:39:37.346095+0000","last_clean":"2023-11-30T18:39:37.346095+0000","last_became_active":"2023-11-30T18:39:37.342863+0000","last_became_peered":"2023-11-30T18:39:37.342863+0000","last_unstale":"2023-11-30T18:39:37.346095+0000","last_undegraded":"2023-11-30T18:39:37.346095+0000","last_fullsized":"2023-11-30T18:39:37.346095+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.330188+0000","last_change":"2023-11-30T18:39:36.949760+0000","last_active":"2023-11-30T18:39:37.330188+0000","last_peered":"2023-11-30T18:39:37.330188+0000","last_clean":"2023-11-30T18:39:37.330188+0000","last_became_active":"2023-11-30T18:39:36.949139+0000","last_became_peered":"2023-11-30T18:39:36.949139+0000","last_unstale":"2023-11-30T18:39:37.330188+0000","last_undegraded":"2023-11-30T18:39:37.330188+0000","last_fullsized":"2023-11-30T18:39:37.330188+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.7","version":"202'2","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.339149+0000","last_change":"2023-11-30T18:39:36.945986+0000","last_active":"2023-11-30T18:39:37.339149+0000","last_peered":"2023-11-30T18:39:37.339149+0000","last_clean":"2023-11-30T18:39:37.339149+0000","last_became_active":"2023-11-30T18:39:36.945645+0000","last_became_peered":"2023-11-30T18:39:36.945645+0000","last_unstale":"2023-11-30T18:39:37.339149+0000","last_undegraded":"2023-11-30T18:39:37.339149+0000","last_fullsized":"2023-11-30T18:39:37.339149+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.342995+0000","last_change":"2023-11-30T18:39:37.336408+0000","last_active":"2023-11-30T18:39:37.342995+0000","last_peered":"2023-11-30T18:39:37.342995+0000","last_clean":"2023-11-30T18:39:37.342995+0000","last_became_active":"2023-11-30T18:39:37.335738+0000","last_became_peered":"2023-11-30T18:39:37.335738+0000","last_unstale":"2023-11-30T18:39:37.342995+0000","last_undegraded":"2023-11-30T18:39:37.342995+0000","last_fullsized":"2023-11-30T18:39:37.342995+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.337854+0000","last_change":"2023-11-30T18:39:36.955512+0000","last_active":"2023-11-30T18:39:37.337854+0000","last_peered":"2023-11-30T18:39:37.337854+0000","last_clean":"2023-11-30T18:39:37.337854+0000","last_became_active":"2023-11-30T18:39:36.955212+0000","last_became_peered":"2023-11-30T18:39:36.955212+0000","last_unstale":"2023-11-30T18:39:37.337854+0000","last_undegraded":"2023-11-30T18:39:37.337854+0000","last_fullsized":"2023-11-30T18:39:37.337854+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.338579+0000","last_change":"2023-11-30T18:39:37.330346+0000","last_active":"2023-11-30T18:39:37.338579+0000","last_peered":"2023-11-30T18:39:37.338579+0000","last_clean":"2023-11-30T18:39:37.338579+0000","last_became_active":"2023-11-30T18:39:37.330086+0000","last_became_peered":"2023-11-30T18:39:37.330086+0000","last_unstale":"2023-11-30T18:39:37.338579+0000","last_undegraded":"2023-11-30T18:39:37.338579+0000","last_fullsized":"2023-11-30T18:39:37.338579+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.337927+0000","last_change":"2023-11-30T18:39:36.950992+0000","last_active":"2023-11-30T18:39:37.337927+0000","last_peered":"2023-11-30T18:39:37.337927+0000","last_clean":"2023-11-30T18:39:37.337927+0000","last_became_active":"2023-11-30T18:39:36.950695+0000","last_became_peered":"2023-11-30T18:39:36.950695+0000","last_unstale":"2023-11-30T18:39:37.337927+0000","last_undegraded":"2023-11-30T18:39:37.337927+0000","last_fullsized":"2023-11-30T18:39:37.337927+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.344708+0000","last_change":"2023-11-30T18:39:37.331147+0000","last_active":"2023-11-30T18:39:37.344708+0000","last_peered":"2023-11-30T18:39:37.344708+0000","last_clean":"2023-11-30T18:39:37.344708+0000","last_became_active":"2023-11-30T18:39:37.330838+0000","last_became_peered":"2023-11-30T18:39:37.330838+0000","last_unstale":"2023-11-30T18:39:37.344708+0000","last_undegraded":"2023-11-30T18:39:37.344708+0000","last_fullsized":"2023-11-30T18:39:37.344708+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.325251+0000","last_change":"2023-11-30T18:39:36.952569+0000","last_active":"2023-11-30T18:39:37.325251+0000","last_peered":"2023-11-30T18:39:37.325251+0000","last_clean":"2023-11-30T18:39:37.325251+0000","last_became_active":"2023-11-30T18:39:36.952293+0000","last_became_peered":"2023-11-30T18:39:36.952293+0000","last_unstale":"2023-11-30T18:39:37.325251+0000","last_undegraded":"2023-11-30T18:39:37.325251+0000","last_fullsized":"2023-11-30T18:39:37.325251+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352722+0000","last_change":"2023-11-30T18:39:37.350409+0000","last_active":"2023-11-30T18:39:37.352722+0000","last_peered":"2023-11-30T18:39:37.352722+0000","last_clean":"2023-11-30T18:39:37.352722+0000","last_became_active":"2023-11-30T18:39:37.350135+0000","last_became_peered":"2023-11-30T18:39:37.350135+0000","last_unstale":"2023-11-30T18:39:37.352722+0000","last_undegraded":"2023-11-30T18:39:37.352722+0000","last_fullsized":"2023-11-30T18:39:37.352722+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.338222+0000","last_change":"2023-11-30T18:39:36.946783+0000","last_active":"2023-11-30T18:39:37.338222+0000","last_peered":"2023-11-30T18:39:37.338222+0000","last_clean":"2023-11-30T18:39:37.338222+0000","last_became_active":"2023-11-30T18:39:36.946533+0000","last_became_peered":"2023-11-30T18:39:36.946533+0000","last_unstale":"2023-11-30T18:39:37.338222+0000","last_undegraded":"2023-11-30T18:39:37.338222+0000","last_fullsized":"2023-11-30T18:39:37.338222+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346709+0000","last_change":"2023-11-30T18:39:37.343014+0000","last_active":"2023-11-30T18:39:37.346709+0000","last_peered":"2023-11-30T18:39:37.346709+0000","last_clean":"2023-11-30T18:39:37.346709+0000","last_became_active":"2023-11-30T18:39:37.342723+0000","last_became_peered":"2023-11-30T18:39:37.342723+0000","last_unstale":"2023-11-30T18:39:37.346709+0000","last_undegraded":"2023-11-30T18:39:37.346709+0000","last_fullsized":"2023-11-30T18:39:37.346709+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.336615+0000","last_change":"2023-11-30T18:39:36.946283+0000","last_active":"2023-11-30T18:39:37.336615+0000","last_peered":"2023-11-30T18:39:37.336615+0000","last_clean":"2023-11-30T18:39:37.336615+0000","last_became_active":"2023-11-30T18:39:36.946000+0000","last_became_peered":"2023-11-30T18:39:36.946000+0000","last_unstale":"2023-11-30T18:39:37.336615+0000","last_undegraded":"2023-11-30T18:39:37.336615+0000","last_fullsized":"2023-11-30T18:39:37.336615+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.353262+0000","last_change":"2023-11-30T18:39:37.352247+0000","last_active":"2023-11-30T18:39:37.353262+0000","last_peered":"2023-11-30T18:39:37.353262+0000","last_clean":"2023-11-30T18:39:37.353262+0000","last_became_active":"2023-11-30T18:39:37.351956+0000","last_became_peered":"2023-11-30T18:39:37.351956+0000","last_unstale":"2023-11-30T18:39:37.353262+0000","last_undegraded":"2023-11-30T18:39:37.353262+0000","last_fullsized":"2023-11-30T18:39:37.353262+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.344165+0000","last_change":"2023-11-30T18:39:37.340873+0000","last_active":"2023-11-30T18:39:37.344165+0000","last_peered":"2023-11-30T18:39:37.344165+0000","last_clean":"2023-11-30T18:39:37.344165+0000","last_became_active":"2023-11-30T18:39:37.340580+0000","last_became_peered":"2023-11-30T18:39:37.340580+0000","last_unstale":"2023-11-30T18:39:37.344165+0000","last_undegraded":"2023-11-30T18:39:37.344165+0000","last_fullsized":"2023-11-30T18:39:37.344165+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.326374+0000","last_change":"2023-11-30T18:39:36.950400+0000","last_active":"2023-11-30T18:39:37.326374+0000","last_peered":"2023-11-30T18:39:37.326374+0000","last_clean":"2023-11-30T18:39:37.326374+0000","last_became_active":"2023-11-30T18:39:36.949951+0000","last_became_peered":"2023-11-30T18:39:36.949951+0000","last_unstale":"2023-11-30T18:39:37.326374+0000","last_undegraded":"2023-11-30T18:39:37.326374+0000","last_fullsized":"2023-11-30T18:39:37.326374+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":171,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327395+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T18:39:37.327395+0000","last_peered":"2023-11-30T18:39:37.327395+0000","last_clean":"2023-11-30T18:39:37.327395+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T18:39:37.327395+0000","last_undegraded":"2023-11-30T18:39:37.327395+0000","last_fullsized":"2023-11-30T18:39:37.327395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347342+0000","last_change":"2023-11-30T18:39:37.340048+0000","last_active":"2023-11-30T18:39:37.347342+0000","last_peered":"2023-11-30T18:39:37.347342+0000","last_clean":"2023-11-30T18:39:37.347342+0000","last_became_active":"2023-11-30T18:39:37.339749+0000","last_became_peered":"2023-11-30T18:39:37.339749+0000","last_unstale":"2023-11-30T18:39:37.347342+0000","last_undegraded":"2023-11-30T18:39:37.347342+0000","last_fullsized":"2023-11-30T18:39:37.347342+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.336922+0000","last_change":"2023-11-30T18:39:36.954943+0000","last_active":"2023-11-30T18:39:37.336922+0000","last_peered":"2023-11-30T18:39:37.336922+0000","last_clean":"2023-11-30T18:39:37.336922+0000","last_became_active":"2023-11-30T18:39:36.954644+0000","last_became_peered":"2023-11-30T18:39:36.954644+0000","last_unstale":"2023-11-30T18:39:37.336922+0000","last_undegraded":"2023-11-30T18:39:37.336922+0000","last_fullsized":"2023-11-30T18:39:37.336922+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":165,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-11-30T18:39:33.082262+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T18:39:33.082262+0000","last_peered":"2023-11-30T18:39:33.082262+0000","last_clean":"2023-11-30T18:39:33.082262+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T18:39:33.082262+0000","last_undegraded":"2023-11-30T18:39:33.082262+0000","last_fullsized":"2023-11-30T18:39:33.082262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.344506+0000","last_change":"2023-11-30T18:39:37.342072+0000","last_active":"2023-11-30T18:39:37.344506+0000","last_peered":"2023-11-30T18:39:37.344506+0000","last_clean":"2023-11-30T18:39:37.344506+0000","last_became_active":"2023-11-30T18:39:37.341885+0000","last_became_peered":"2023-11-30T18:39:37.341885+0000","last_unstale":"2023-11-30T18:39:37.344506+0000","last_undegraded":"2023-11-30T18:39:37.344506+0000","last_fullsized":"2023-11-30T18:39:37.344506+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"202'2","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347830+0000","last_change":"2023-11-30T18:39:36.951915+0000","last_active":"2023-11-30T18:39:37.347830+0000","last_peered":"2023-11-30T18:39:37.347830+0000","last_clean":"2023-11-30T18:39:37.347830+0000","last_became_active":"2023-11-30T18:39:36.951639+0000","last_became_peered":"2023-11-30T18:39:36.951639+0000","last_unstale":"2023-11-30T18:39:37.347830+0000","last_undegraded":"2023-11-30T18:39:37.347830+0000","last_fullsized":"2023-11-30T18:39:37.347830+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.323644+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T18:39:37.323644+0000","last_peered":"2023-11-30T18:39:37.323644+0000","last_clean":"2023-11-30T18:39:37.323644+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T18:39:37.323644+0000","last_undegraded":"2023-11-30T18:39:37.323644+0000","last_fullsized":"2023-11-30T18:39:37.323644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.345987+0000","last_change":"2023-11-30T18:39:37.339470+0000","last_active":"2023-11-30T18:39:37.345987+0000","last_peered":"2023-11-30T18:39:37.345987+0000","last_clean":"2023-11-30T18:39:37.345987+0000","last_became_active":"2023-11-30T18:39:37.339218+0000","last_became_peered":"2023-11-30T18:39:37.339218+0000","last_unstale":"2023-11-30T18:39:37.345987+0000","last_undegraded":"2023-11-30T18:39:37.345987+0000","last_fullsized":"2023-11-30T18:39:37.345987+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.337752+0000","last_change":"2023-11-30T18:39:36.957232+0000","last_active":"2023-11-30T18:39:37.337752+0000","last_peered":"2023-11-30T18:39:37.337752+0000","last_clean":"2023-11-30T18:39:37.337752+0000","last_became_active":"2023-11-30T18:39:36.956927+0000","last_became_peered":"2023-11-30T18:39:36.956927+0000","last_unstale":"2023-11-30T18:39:37.337752+0000","last_undegraded":"2023-11-30T18:39:37.337752+0000","last_fullsized":"2023-11-30T18:39:37.337752+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":165,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-11-30T18:39:33.082262+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T18:39:33.082262+0000","last_peered":"2023-11-30T18:39:33.082262+0000","last_clean":"2023-11-30T18:39:33.082262+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T18:39:33.082262+0000","last_undegraded":"2023-11-30T18:39:33.082262+0000","last_fullsized":"2023-11-30T18:39:33.082262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":165,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.330242+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T18:39:37.330242+0000","last_peered":"2023-11-30T18:39:37.330242+0000","last_clean":"2023-11-30T18:39:37.330242+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T18:39:37.330242+0000","last_undegraded":"2023-11-30T18:39:37.330242+0000","last_fullsized":"2023-11-30T18:39:37.330242+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349079+0000","last_change":"2023-11-30T18:39:37.345111+0000","last_active":"2023-11-30T18:39:37.349079+0000","last_peered":"2023-11-30T18:39:37.349079+0000","last_clean":"2023-11-30T18:39:37.349079+0000","last_became_active":"2023-11-30T18:39:37.344811+0000","last_became_peered":"2023-11-30T18:39:37.344811+0000","last_unstale":"2023-11-30T18:39:37.349079+0000","last_undegraded":"2023-11-30T18:39:37.349079+0000","last_fullsized":"2023-11-30T18:39:37.349079+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"202'3","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349684+0000","last_change":"2023-11-30T18:39:36.954554+0000","last_active":"2023-11-30T18:39:37.349684+0000","last_peered":"2023-11-30T18:39:37.349684+0000","last_clean":"2023-11-30T18:39:37.349684+0000","last_became_active":"2023-11-30T18:39:36.954255+0000","last_became_peered":"2023-11-30T18:39:36.954255+0000","last_unstale":"2023-11-30T18:39:37.349684+0000","last_undegraded":"2023-11-30T18:39:37.349684+0000","last_fullsized":"2023-11-30T18:39:37.349684+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":163,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.330312+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T18:39:37.330312+0000","last_peered":"2023-11-30T18:39:37.330312+0000","last_clean":"2023-11-30T18:39:37.330312+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T18:39:37.330312+0000","last_undegraded":"2023-11-30T18:39:37.330312+0000","last_fullsized":"2023-11-30T18:39:37.330312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352219+0000","last_change":"2023-11-30T18:39:37.351640+0000","last_active":"2023-11-30T18:39:37.352219+0000","last_peered":"2023-11-30T18:39:37.352219+0000","last_clean":"2023-11-30T18:39:37.352219+0000","last_became_active":"2023-11-30T18:39:37.350854+0000","last_became_peered":"2023-11-30T18:39:37.350854+0000","last_unstale":"2023-11-30T18:39:37.352219+0000","last_undegraded":"2023-11-30T18:39:37.352219+0000","last_fullsized":"2023-11-30T18:39:37.352219+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"202'4","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.351107+0000","last_change":"2023-11-30T18:39:36.949816+0000","last_active":"2023-11-30T18:39:37.351107+0000","last_peered":"2023-11-30T18:39:37.351107+0000","last_clean":"2023-11-30T18:39:37.351107+0000","last_became_active":"2023-11-30T18:39:36.949516+0000","last_became_peered":"2023-11-30T18:39:36.949516+0000","last_unstale":"2023-11-30T18:39:37.351107+0000","last_undegraded":"2023-11-30T18:39:37.351107+0000","last_fullsized":"2023-11-30T18:39:37.351107+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":163,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.331043+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T18:39:37.331043+0000","last_peered":"2023-11-30T18:39:37.331043+0000","last_clean":"2023-11-30T18:39:37.331043+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T18:39:37.331043+0000","last_undegraded":"2023-11-30T18:39:37.331043+0000","last_fullsized":"2023-11-30T18:39:37.331043+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.13","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347149+0000","last_change":"2023-11-30T18:39:36.954951+0000","last_active":"2023-11-30T18:39:37.347149+0000","last_peered":"2023-11-30T18:39:37.347149+0000","last_clean":"2023-11-30T18:39:37.347149+0000","last_became_active":"2023-11-30T18:39:36.954635+0000","last_became_peered":"2023-11-30T18:39:36.954635+0000","last_unstale":"2023-11-30T18:39:37.347149+0000","last_undegraded":"2023-11-30T18:39:37.347149+0000","last_fullsized":"2023-11-30T18:39:37.347149+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":171,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.329562+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T18:39:37.329562+0000","last_peered":"2023-11-30T18:39:37.329562+0000","last_clean":"2023-11-30T18:39:37.329562+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T18:39:37.329562+0000","last_undegraded":"2023-11-30T18:39:37.329562+0000","last_fullsized":"2023-11-30T18:39:37.329562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347365+0000","last_change":"2023-11-30T18:39:37.343550+0000","last_active":"2023-11-30T18:39:37.347365+0000","last_peered":"2023-11-30T18:39:37.347365+0000","last_clean":"2023-11-30T18:39:37.347365+0000","last_became_active":"2023-11-30T18:39:37.343269+0000","last_became_peered":"2023-11-30T18:39:37.343269+0000","last_unstale":"2023-11-30T18:39:37.347365+0000","last_undegraded":"2023-11-30T18:39:37.347365+0000","last_fullsized":"2023-11-30T18:39:37.347365+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.336520+0000","last_change":"2023-11-30T18:39:36.944024+0000","last_active":"2023-11-30T18:39:37.336520+0000","last_peered":"2023-11-30T18:39:37.336520+0000","last_clean":"2023-11-30T18:39:37.336520+0000","last_became_active":"2023-11-30T18:39:36.943512+0000","last_became_peered":"2023-11-30T18:39:36.943512+0000","last_unstale":"2023-11-30T18:39:37.336520+0000","last_undegraded":"2023-11-30T18:39:37.336520+0000","last_fullsized":"2023-11-30T18:39:37.336520+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":186,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-11-30T18:39:32.616984+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T18:39:32.616984+0000","last_peered":"2023-11-30T18:39:32.616984+0000","last_clean":"2023-11-30T18:39:32.616984+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T18:39:32.616984+0000","last_undegraded":"2023-11-30T18:39:32.616984+0000","last_fullsized":"2023-11-30T18:39:32.616984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":102,"acting":102,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":1414,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":88,"acting":88,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575950,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303676,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068164,"statfs":{"total":96636764160,"available":96325799936,"internally_reserved":0,"allocated":2543616,"data_stored":1304277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.629,"15min":0.626},"min":{"1min":0.39200000000000002,"5min":0.35499999999999998,"15min":0.28699999999999998},"max":{"1min":0.81399999999999995,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.63200000000000001,"15min":0.63500000000000001},"min":{"1min":0.502,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77200000000000002,"5min":0.80600000000000005,"15min":0.82099999999999995},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.42999999999999999,"5min":0.40699999999999997,"15min":0.35899999999999999},"max":{"1min":0.70399999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.41999999999999998,"5min":0.38700000000000001,"15min":0.379},"max":{"1min":0.74399999999999999,"5min":0.877,"15min":0.877},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.44800000000000001,"5min":0.41699999999999998,"15min":0.379},"max":{"1min":0.66700000000000004,"5min":0.80500000000000005,"15min":0.81100000000000005},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58599999999999997,"15min":0.59299999999999997},"min":{"1min":0.47599999999999998,"5min":0.43099999999999999,"15min":0.38700000000000001},"max":{"1min":0.72699999999999998,"5min":0.82599999999999996,"15min":0.85399999999999998},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.40200000000000002,"5min":0.36699999999999999,"15min":0.35899999999999999},"max":{"1min":0.69299999999999995,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.47499999999999998,"5min":0.41899999999999998,"15min":0.41799999999999998},"max":{"1min":0.75600000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46500000000000002,"15min":0.46300000000000002},"min":{"1min":0.36799999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.52600000000000002,"5min":0.81100000000000005,"15min":0.83799999999999997},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.49199999999999999,"15min":0.48999999999999999},"min":{"1min":0.371,"5min":0.308,"15min":0.29099999999999998},"max":{"1min":0.624,"5min":0.67200000000000004,"15min":0.80500000000000005},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.505,"15min":0.5},"min":{"1min":0.36799999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78200000000000003,"5min":0.79100000000000004,"15min":0.83399999999999996},"last":0.374},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35399999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68300000000000005,"5min":0.78600000000000003,"15min":0.88200000000000001},"last":0.35399999999999998}]},{"osd":6,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56899999999999995,"15min":0.56399999999999995},"min":{"1min":0.40200000000000002,"5min":0.36699999999999999,"15min":0.32300000000000001},"max":{"1min":0.68400000000000005,"5min":0.84999999999999998,"15min":0.90800000000000003},"last":0.499},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55700000000000005,"15min":0.55900000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76300000000000001,"5min":0.81200000000000006,"15min":0.85199999999999998},"last":0.41199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575948,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307716,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064124,"statfs":{"total":96636764160,"available":96321662976,"internally_reserved":0,"allocated":2486272,"data_stored":1275712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60499999999999998,"15min":0.61099999999999999},"min":{"1min":0.35399999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.72799999999999998,"5min":0.80700000000000005,"15min":1.6379999999999999},"last":0.437},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.629,"15min":0.625},"min":{"1min":0.49299999999999999,"5min":0.42499999999999999,"15min":0.27800000000000002},"max":{"1min":0.77500000000000002,"5min":0.84899999999999998,"15min":1.246},"last":0.51000000000000001}]},{"osd":1,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.31900000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.76500000000000001,"5min":0.86599999999999999,"15min":1.1200000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.624,"15min":0.63100000000000001},"min":{"1min":0.42199999999999999,"5min":0.41899999999999998,"15min":0.35499999999999998},"max":{"1min":0.753,"5min":0.81599999999999995,"15min":0.90400000000000003},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59799999999999998,"15min":0.59899999999999998},"min":{"1min":0.40699999999999997,"5min":0.40000000000000002,"15min":0.34499999999999997},"max":{"1min":0.71899999999999997,"5min":0.85299999999999998,"15min":1.288},"last":0.502},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61599999999999999,"15min":0.63},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":0.74199999999999999,"5min":0.84599999999999997,"15min":1.177},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55800000000000005,"15min":0.57499999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.33400000000000002},"max":{"1min":0.70599999999999996,"5min":0.79600000000000004,"15min":1.204},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.40200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.67600000000000005,"5min":0.80100000000000005,"15min":1.337},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.443,"15min":0.46800000000000003},"min":{"1min":0.34399999999999997,"5min":0.315,"15min":0.28699999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":1.51},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.49199999999999999},"min":{"1min":0.34999999999999998,"5min":0.32800000000000001,"15min":0.30399999999999999},"max":{"1min":0.69899999999999995,"5min":0.71599999999999997,"15min":0.94299999999999995},"last":0.40600000000000003}]},{"osd":5,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.45700000000000002,"15min":0.47199999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":1.159},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.503,"15min":0.52700000000000002},"min":{"1min":0.42399999999999999,"5min":0.35199999999999998,"15min":0.32500000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":1.679},"last":0.60899999999999999}]},{"osd":7,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52200000000000002,"15min":0.54000000000000004},"min":{"1min":0.36799999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.96199999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55700000000000005,"15min":0.57699999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":1.427},"last":0.52400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575949,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307772,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064068,"statfs":{"total":96636764160,"available":96321605632,"internally_reserved":0,"allocated":2543616,"data_stored":1303475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.377,"15min":0.38},"min":{"1min":0.27500000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.66300000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.50700000000000001,"15min":0.51000000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.35799999999999998},"max":{"1min":0.77400000000000002,"5min":0.87,"15min":0.87},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40699999999999997,"15min":0.41199999999999998},"min":{"1min":0.28699999999999998,"5min":0.26700000000000002,"15min":0.26200000000000001},"max":{"1min":0.64700000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.40100000000000002,"5min":0.372,"15min":0.37},"max":{"1min":0.80300000000000005,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.48099999999999998,"15min":0.47799999999999998},"min":{"1min":0.33800000000000002,"5min":0.33500000000000002,"15min":0.318},"max":{"1min":0.72899999999999998,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45500000000000002,"15min":0.46000000000000002},"min":{"1min":0.33400000000000002,"5min":0.313,"15min":0.311},"max":{"1min":0.71399999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.28799999999999998}]},{"osd":4,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.59899999999999998,"15min":0.61899999999999999},"min":{"1min":0.41099999999999998,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.93999999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66800000000000004,"15min":0.67000000000000004},"min":{"1min":0.50600000000000001,"5min":0.49199999999999999,"15min":0.42299999999999999},"max":{"1min":1.0329999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.62,"15min":0.63300000000000001},"min":{"1min":0.48899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63900000000000001,"15min":0.64600000000000002},"min":{"1min":0.47799999999999998,"5min":0.45000000000000001,"15min":0.39200000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.98099999999999998},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70299999999999996,"15min":0.70499999999999996},"min":{"1min":0.51100000000000001,"5min":0.498,"15min":0.443},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.68000000000000005,"15min":0.69199999999999995},"min":{"1min":0.51400000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.86299999999999999,"5min":1.004,"15min":1.0169999999999999},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69599999999999995,"15min":0.71199999999999997},"min":{"1min":0.51400000000000001,"5min":0.48999999999999999,"15min":0.46100000000000002},"max":{"1min":0.91000000000000003,"5min":0.97499999999999998,"15min":1.012},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68600000000000005,"15min":0.69699999999999995},"min":{"1min":0.57499999999999996,"5min":0.51800000000000002,"15min":0.47699999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.02},"last":0.64300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575949,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307768,"kb_used_data":2480,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064072,"statfs":{"total":96636764160,"available":96321609728,"internally_reserved":0,"allocated":2539520,"data_stored":1302865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.38800000000000001,"15min":0.39500000000000002},"min":{"1min":0.252,"5min":0.25,"15min":0.22900000000000001},"max":{"1min":0.50900000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.439,"5min":0.42099999999999999,"15min":0.42199999999999999},"min":{"1min":0.33500000000000002,"5min":0.27300000000000002,"15min":0.252},"max":{"1min":0.58299999999999996,"5min":0.65100000000000002,"15min":0.71399999999999997},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41199999999999998,"15min":0.41699999999999998},"min":{"1min":0.33000000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.55100000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.49099999999999999,"15min":0.5},"min":{"1min":0.40600000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.74199999999999999},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.45800000000000002,"15min":0.46200000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64400000000000002,"5min":0.69899999999999995,"15min":0.71799999999999997},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46500000000000002,"15min":0.47499999999999998},"min":{"1min":0.36599999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.60399999999999998,"5min":0.68000000000000005,"15min":0.70599999999999996},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63,"15min":0.64100000000000001},"min":{"1min":0.55900000000000005,"5min":0.40200000000000002,"15min":0.39900000000000002},"max":{"1min":0.79700000000000004,"5min":0.90600000000000003,"15min":1.0549999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.65800000000000003},"min":{"1min":0.55900000000000005,"5min":0.45100000000000001,"15min":0.442},"max":{"1min":0.77900000000000003,"5min":1.026,"15min":1.163},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.626,"15min":0.64100000000000001},"min":{"1min":0.50600000000000001,"5min":0.443,"15min":0.40400000000000003},"max":{"1min":0.78700000000000003,"5min":0.91600000000000004,"15min":1.0649999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.66800000000000004,"15min":0.67200000000000004},"min":{"1min":0.52400000000000002,"5min":0.47199999999999998,"15min":0.439},"max":{"1min":0.84799999999999998,"5min":0.998,"15min":1.1799999999999999},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.67700000000000005,"15min":0.68700000000000006},"min":{"1min":0.55100000000000005,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.873,"5min":0.94199999999999995,"15min":1.079},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66900000000000004,"15min":0.68300000000000005},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.41499999999999998},"max":{"1min":0.86099999999999999,"5min":1.0129999999999999,"15min":1.147},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69799999999999995,"15min":0.70599999999999996},"min":{"1min":0.55900000000000005,"5min":0.49199999999999999,"15min":0.47399999999999998},"max":{"1min":0.88700000000000001,"5min":1.0469999999999999,"15min":1.22},"last":0.875},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72099999999999997,"15min":0.73399999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.81799999999999995,"5min":1.0640000000000001,"15min":1.117},"last":0.92800000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575949,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311864,"kb_used_data":2480,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059976,"statfs":{"total":96636764160,"available":96317415424,"internally_reserved":0,"allocated":2539520,"data_stored":1302901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.41999999999999998,"15min":0.41199999999999998},"min":{"1min":0.30099999999999999,"5min":0.249,"15min":0.23200000000000001},"max":{"1min":0.60399999999999998,"5min":0.64800000000000002,"15min":0.72099999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45700000000000002,"15min":0.46000000000000002},"min":{"1min":0.32600000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.58599999999999997,"5min":0.65000000000000002,"15min":0.73199999999999998},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45800000000000002,"15min":0.46100000000000002},"min":{"1min":0.34300000000000003,"5min":0.33100000000000002,"15min":0.29699999999999999},"max":{"1min":0.63900000000000001,"5min":0.70599999999999996,"15min":0.74299999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.496,"15min":0.49399999999999999},"min":{"1min":0.40899999999999997,"5min":0.35599999999999998,"15min":0.29899999999999999},"max":{"1min":0.66100000000000003,"5min":0.746,"15min":0.752},"last":0.379}]},{"osd":3,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.42799999999999999,"15min":0.42299999999999999},"min":{"1min":0.315,"5min":0.28399999999999997,"15min":0.27300000000000002},"max":{"1min":0.55000000000000004,"5min":0.61399999999999999,"15min":0.65100000000000002},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.503,"15min":0.499},"min":{"1min":0.433,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.69099999999999995,"5min":0.75900000000000001,"15min":0.77100000000000002},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.52100000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.95299999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63200000000000001,"15min":0.63900000000000001},"min":{"1min":0.46000000000000002,"5min":0.42799999999999999,"15min":0.35499999999999998},"max":{"1min":0.90500000000000003,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65400000000000003,"15min":0.66400000000000003},"min":{"1min":0.51200000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.84099999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.47199999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.91700000000000004,"5min":1.01,"15min":1.01},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64900000000000002,"15min":0.65200000000000002},"min":{"1min":0.52100000000000002,"5min":0.443,"15min":0.40500000000000003},"max":{"1min":0.86699999999999999,"5min":0.93000000000000005,"15min":0.93200000000000005},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.69399999999999995,"15min":0.69699999999999995},"min":{"1min":0.54300000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93999999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69099999999999995,"15min":0.69499999999999995},"min":{"1min":0.53500000000000003,"5min":0.47499999999999998,"15min":0.47299999999999998},"max":{"1min":0.95399999999999996,"5min":0.97799999999999998,"15min":1.0109999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71099999999999997,"15min":0.71799999999999997},"min":{"1min":0.55700000000000005,"5min":0.44,"15min":0.44},"max":{"1min":0.95199999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.70799999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575949,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299712,"kb_used_data":2488,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072128,"statfs":{"total":96636764160,"available":96329859072,"internally_reserved":0,"allocated":2547712,"data_stored":1303497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.373,"15min":0.38},"min":{"1min":0.29499999999999998,"5min":0.222,"15min":0.222},"max":{"1min":0.59099999999999997,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.42699999999999999,"15min":0.42499999999999999},"min":{"1min":0.31,"5min":0.28699999999999998,"15min":0.28199999999999997},"max":{"1min":0.63700000000000001,"5min":0.70299999999999996,"15min":0.754},"last":0.504}]},{"osd":1,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40000000000000002,"15min":0.40400000000000003},"min":{"1min":0.29899999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58099999999999996,"5min":0.66500000000000004,"15min":0.73399999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44500000000000001,"15min":0.45300000000000001},"min":{"1min":0.315,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.51800000000000002,"5min":0.67700000000000005,"15min":0.86699999999999999},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.47299999999999998,"15min":0.47699999999999998},"min":{"1min":0.39000000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.59899999999999998,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51400000000000001,"15min":0.52400000000000002},"min":{"1min":0.40899999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.65600000000000003,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.63}]},{"osd":4,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63200000000000001,"15min":0.64100000000000001},"min":{"1min":0.51100000000000001,"5min":0.40200000000000002,"15min":0.35299999999999998},"max":{"1min":0.84799999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.64000000000000001,"15min":0.65100000000000002},"min":{"1min":0.40400000000000003,"5min":0.40300000000000002,"15min":0.40100000000000002},"max":{"1min":0.77400000000000002,"5min":0.97799999999999998,"15min":1.0049999999999999},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63600000000000001,"15min":0.64600000000000002},"min":{"1min":0.52000000000000002,"5min":0.44600000000000001,"15min":0.40699999999999997},"max":{"1min":0.89400000000000002,"5min":1.04,"15min":1.04},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65500000000000003,"15min":0.66800000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.34499999999999997},"max":{"1min":0.82999999999999996,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.79200000000000004}]},{"osd":6,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67200000000000004,"15min":0.68400000000000005},"min":{"1min":0.499,"5min":0.45000000000000001,"15min":0.377},"max":{"1min":0.88800000000000001,"5min":1.0189999999999999,"15min":1.0309999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66300000000000003,"15min":0.68500000000000005},"min":{"1min":0.48199999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92900000000000005,"5min":0.99399999999999999,"15min":1.0129999999999999},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68300000000000005,"15min":0.70399999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.872,"5min":1.0009999999999999,"15min":1.052},"last":0.747},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68300000000000005,"15min":0.70499999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.81299999999999994,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.80500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575949,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303680,"kb_used_data":2488,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068160,"statfs":{"total":96636764160,"available":96325795840,"internally_reserved":0,"allocated":2547712,"data_stored":1303013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53900000000000003,"15min":0.56200000000000006},"min":{"1min":0.36199999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72999999999999998,"5min":0.79400000000000004,"15min":0.85499999999999998},"last":0.316},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.374,"5min":0.34100000000000003,"15min":0.32500000000000001},"max":{"1min":0.76800000000000002,"5min":0.79300000000000004,"15min":0.94999999999999996},"last":0.436}]},{"osd":1,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56899999999999995,"15min":0.57299999999999995},"min":{"1min":0.41799999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.72199999999999998,"5min":0.86599999999999999,"15min":0.876},"last":0.371},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.67400000000000004,"5min":0.79300000000000004,"15min":0.91200000000000003},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.60599999999999998},"min":{"1min":0.438,"5min":0.36299999999999999,"15min":0.34999999999999998},"max":{"1min":0.72199999999999998,"5min":0.88400000000000001,"15min":0.93799999999999994},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.60599999999999998,"15min":0.625},"min":{"1min":0.40000000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68999999999999995,"5min":0.90800000000000003,"15min":0.94399999999999995},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.433,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":0.68899999999999995,"5min":0.83199999999999996,"15min":0.84999999999999998},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57699999999999996,"15min":0.59899999999999998},"min":{"1min":0.45600000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.67500000000000004,"5min":0.80800000000000005,"15min":0.872},"last":0.498}]},{"osd":5,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.42299999999999999,"15min":0.44800000000000001},"min":{"1min":0.309,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.53400000000000003,"5min":0.66900000000000004,"15min":0.86399999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.44900000000000001,"15min":0.46899999999999997},"min":{"1min":0.32300000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.63200000000000001,"5min":0.64900000000000002,"15min":0.82299999999999995},"last":0.49199999999999999}]},{"osd":6,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47399999999999998,"15min":0.51300000000000001},"min":{"1min":0.35699999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66100000000000003,"5min":0.79200000000000004,"15min":1.1399999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.52800000000000002,"15min":0.56299999999999994},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.67200000000000004,"5min":0.76700000000000002,"15min":1.1220000000000001},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.47999999999999998,"15min":0.52500000000000002},"min":{"1min":0.308,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58199999999999996,"5min":0.80100000000000005,"15min":0.90000000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55400000000000005,"15min":0.58199999999999996},"min":{"1min":0.44400000000000001,"5min":0.38100000000000001,"15min":0.35599999999999998},"max":{"1min":0.622,"5min":0.81599999999999995,"15min":0.86199999999999999},"last":0.56599999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575948,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307716,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064124,"statfs":{"total":96636764160,"available":96321662976,"internally_reserved":0,"allocated":2486272,"data_stored":1275712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56799999999999995,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.35799999999999998,"15min":0.29799999999999999},"max":{"1min":0.76600000000000001,"5min":0.79800000000000004,"15min":0.80800000000000005},"last":0.317},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.54300000000000004,"15min":0.55300000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.66800000000000004,"5min":0.80700000000000005,"15min":0.90300000000000002},"last":0.36199999999999999}]},{"osd":1,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54000000000000004,"15min":0.54300000000000004},"min":{"1min":0.41099999999999998,"5min":0.36899999999999999,"15min":0.32200000000000001},"max":{"1min":0.72599999999999998,"5min":0.75600000000000001,"15min":0.83699999999999997},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57699999999999996,"15min":0.57999999999999996},"min":{"1min":0.42499999999999999,"5min":0.38600000000000001,"15min":0.32400000000000001},"max":{"1min":0.72999999999999998,"5min":0.76500000000000001,"15min":0.82899999999999996},"last":0.307}]},{"osd":2,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60999999999999999,"15min":0.61399999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.36399999999999999},"max":{"1min":0.76300000000000001,"5min":0.78700000000000003,"15min":0.99199999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.62,"15min":0.62},"min":{"1min":0.47199999999999998,"5min":0.44800000000000001,"15min":0.42499999999999999},"max":{"1min":0.78400000000000003,"5min":0.79600000000000004,"15min":1.173},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.373},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.79300000000000004},"last":0.373},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.439,"5min":0.40500000000000003,"15min":0.35399999999999998},"max":{"1min":0.72699999999999998,"5min":0.84199999999999997,"15min":1.603},"last":0.32700000000000001}]},{"osd":4,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.45400000000000001,"15min":0.45200000000000001},"min":{"1min":0.35799999999999998,"5min":0.315,"15min":0.28000000000000003},"max":{"1min":0.63800000000000001,"5min":0.70299999999999996,"15min":0.75},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.48999999999999999,"15min":0.48299999999999998},"min":{"1min":0.39100000000000001,"5min":0.32000000000000001,"15min":0.314},"max":{"1min":0.67300000000000004,"5min":0.77900000000000003,"15min":0.81200000000000006},"last":0.248}]},{"osd":6,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51600000000000001,"15min":0.505},"min":{"1min":0.38400000000000001,"5min":0.33600000000000002,"15min":0.31900000000000001},"max":{"1min":0.75900000000000001,"5min":0.76700000000000002,"15min":1.105},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57699999999999996,"15min":0.57199999999999995},"min":{"1min":0.48699999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.751,"5min":0.79600000000000004,"15min":1.228},"last":0.40500000000000003}]},{"osd":7,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55000000000000004,"15min":0.54000000000000004},"min":{"1min":0.442,"5min":0.36799999999999999,"15min":0.34399999999999997},"max":{"1min":0.69299999999999995,"5min":0.80900000000000005,"15min":0.88100000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.60199999999999998,"15min":0.59599999999999997},"min":{"1min":0.47399999999999998,"5min":0.33400000000000002,"15min":0.317},"max":{"1min":0.79400000000000004,"5min":0.82499999999999996,"15min":1.0640000000000001},"last":0.41099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T18:39:41.726 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T18:39:41.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.877+0000 7f242ec05700 1 Processor -- start 2023-11-30T18:39:41.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.877+0000 7f242ec05700 1 -- start start 2023-11-30T18:39:41.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.878+0000 7f242ec05700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24281544e0 0x7f24281548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:41.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.878+0000 7f242ec05700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24280c69a0 con 0x7f24280c6e30 2023-11-30T18:39:41.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.878+0000 7f242ec05700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24280c13a0 con 0x7f242806a610 2023-11-30T18:39:41.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.878+0000 7f242ec05700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24280c1680 con 0x7f24281544e0 2023-11-30T18:39:41.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.878+0000 7f242d1a2700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f24280c6e30 0x7f24280a8000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58396/0 (socket says 172.21.15.49:58396) 2023-11-30T18:39:41.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.878+0000 7f242d1a2700 1 -- 172.21.15.49:0/3082010067 learned_addr learned my addr 172.21.15.49:0/3082010067 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:41.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.878+0000 7f242c9a1700 1 --2- 172.21.15.49:0/3082010067 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24281544e0 0x7f24281548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:41.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.878+0000 7f24277fe700 1 -- 172.21.15.49:0/3082010067 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161017404 0 0) 0x7f24280c69a0 con 0x7f24280c6e30 2023-11-30T18:39:41.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.878+0000 7f24277fe700 1 -- 172.21.15.49:0/3082010067 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24180033f0 con 0x7f24280c6e30 2023-11-30T18:39:41.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.878+0000 7f24277fe700 1 -- 172.21.15.49:0/3082010067 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1822828530 0 0) 0x7f24280c13a0 con 0x7f242806a610 2023-11-30T18:39:41.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.879+0000 7f24277fe700 1 -- 172.21.15.49:0/3082010067 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24280c69a0 con 0x7f242806a610 2023-11-30T18:39:41.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.879+0000 7f24277fe700 1 -- 172.21.15.49:0/3082010067 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1092434120 0 0) 0x7f24180033f0 con 0x7f24280c6e30 2023-11-30T18:39:41.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.879+0000 7f24277fe700 1 -- 172.21.15.49:0/3082010067 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24281544e0 msgr2=0x7f24281548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:41.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.879+0000 7f24277fe700 1 --2- 172.21.15.49:0/3082010067 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24281544e0 0x7f24281548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:41.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.879+0000 7f24277fe700 1 -- 172.21.15.49:0/3082010067 >> v1:172.21.15.115:6789/0 conn(0x7f242806a610 legacy=0x7f24280c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:41.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.879+0000 7f24277fe700 1 -- 172.21.15.49:0/3082010067 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24280c6630 con 0x7f24280c6e30 2023-11-30T18:39:41.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.879+0000 7f24277fe700 1 -- 172.21.15.49:0/3082010067 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f24200017f0 con 0x7f24280c6e30 2023-11-30T18:39:41.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.879+0000 7f242c9a1700 1 --2- 172.21.15.49:0/3082010067 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24281544e0 0x7f24281548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:39:41.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.879+0000 7f24277fe700 1 -- 172.21.15.49:0/3082010067 >> v1:172.21.15.49:6789/0 conn(0x7f24280c6e30 legacy=0x7f24280a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:41.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.879+0000 7f24277fe700 1 --2- 172.21.15.49:0/3082010067 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24281544e0 0x7f2418003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:41.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.879+0000 7f24277fe700 1 --2- 172.21.15.49:0/3082010067 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2418003f90 0x7f2418004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:41.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.879+0000 7f24277fe700 1 --2- 172.21.15.49:0/3082010067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2418004b80 0x7f2418005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:41.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.879+0000 7f24277fe700 1 -- 172.21.15.49:0/3082010067 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24280c1680 con 0x7f2418004b80 2023-11-30T18:39:41.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.879+0000 7f24277fe700 1 -- 172.21.15.49:0/3082010067 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241800b940 con 0x7f2418003f90 2023-11-30T18:39:41.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.879+0000 7f24277fe700 1 -- 172.21.15.49:0/3082010067 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241800bb00 con 0x7f24281544e0 2023-11-30T18:39:41.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.879+0000 7f242d1a2700 1 --2- 172.21.15.49:0/3082010067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2418004b80 0x7f2418005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:41.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.879+0000 7f242c9a1700 1 --2- 172.21.15.49:0/3082010067 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24281544e0 0x7f2418003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:41.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.879+0000 7f2427fff700 1 --2- 172.21.15.49:0/3082010067 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2418003f90 0x7f2418004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:41.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.879+0000 7f242d1a2700 1 -- 172.21.15.49:0/3082010067 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24281544e0 msgr2=0x7f2418003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:41.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.879+0000 7f242d1a2700 1 --2- 172.21.15.49:0/3082010067 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24281544e0 0x7f2418003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:41.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.879+0000 7f242d1a2700 1 -- 172.21.15.49:0/3082010067 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2418003f90 msgr2=0x7f2418004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:41.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.879+0000 7f242d1a2700 1 --2- 172.21.15.49:0/3082010067 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2418003f90 0x7f2418004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:41.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.879+0000 7f242d1a2700 1 -- 172.21.15.49:0/3082010067 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241c009250 con 0x7f2418004b80 2023-11-30T18:39:41.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.879+0000 7f242d1a2700 1 --2- 172.21.15.49:0/3082010067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2418004b80 0x7f2418005000 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 rx=0x7f242000c5c0 tx=0x7f2420007f40).ready entity=mon.0 client_cookie=ddedbbeccde60da4 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:41.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.879+0000 7f24277fe700 1 -- 172.21.15.49:0/3082010067 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242000cdc0 con 0x7f2418004b80 2023-11-30T18:39:41.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.879+0000 7f24277fe700 1 -- 172.21.15.49:0/3082010067 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2420005b20 con 0x7f2418004b80 2023-11-30T18:39:41.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.879+0000 7f24277fe700 1 -- 172.21.15.49:0/3082010067 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2420005ea0 con 0x7f2418004b80 2023-11-30T18:39:41.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.880+0000 7f242ec05700 1 -- 172.21.15.49:0/3082010067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2418004b80 msgr2=0x7f2418005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:41.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.880+0000 7f242ec05700 1 --2- 172.21.15.49:0/3082010067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2418004b80 0x7f2418005000 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 rx=0x7f242000c5c0 tx=0x7f2420007f40).stop 2023-11-30T18:39:41.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.880+0000 7f242d1a2700 1 -- 172.21.15.49:0/3082010067 reap_dead start 2023-11-30T18:39:41.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.880+0000 7f242ec05700 1 -- 172.21.15.49:0/3082010067 shutdown_connections 2023-11-30T18:39:41.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.880+0000 7f242ec05700 1 -- 172.21.15.49:0/3082010067 >> 172.21.15.49:0/3082010067 conn(0x7f2428085020 msgr2=0x7f2428094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:41.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.880+0000 7f242ec05700 1 -- 172.21.15.49:0/3082010067 shutdown_connections 2023-11-30T18:39:41.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.880+0000 7f242ec05700 1 -- 172.21.15.49:0/3082010067 wait complete. 2023-11-30T18:39:41.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.881+0000 7f242ec05700 1 Processor -- start 2023-11-30T18:39:41.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.881+0000 7f242ec05700 1 -- start start 2023-11-30T18:39:41.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.882+0000 7f242ec05700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2418004b80 0x7f2428095bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:41.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.882+0000 7f242ec05700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24280b0b90 0x7f242814d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:41.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.882+0000 7f242ec05700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2428167fd0 0x7f2428168430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:41.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.882+0000 7f242ec05700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24280b1010 con 0x7f2418004b80 2023-11-30T18:39:41.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.882+0000 7f242ec05700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2428168920 con 0x7f2428167fd0 2023-11-30T18:39:41.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.882+0000 7f242ec05700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2428096220 con 0x7f24280b0b90 2023-11-30T18:39:41.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.882+0000 7f242c9a1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2418004b80 0x7f2428095bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:41.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.882+0000 7f242c9a1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2418004b80 0x7f2428095bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59816/0 (socket says 172.21.15.49:59816) 2023-11-30T18:39:41.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.882+0000 7f242c9a1700 1 -- 172.21.15.49:0/847469397 learned_addr learned my addr 172.21.15.49:0/847469397 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:41.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.882+0000 7f242d1a2700 1 --2- 172.21.15.49:0/847469397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2428167fd0 0x7f2428168430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:41.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.882+0000 7f2427fff700 1 --2- 172.21.15.49:0/847469397 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24280b0b90 0x7f242814d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:41.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.882+0000 7f242c9a1700 1 -- 172.21.15.49:0/847469397 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24280b0b90 msgr2=0x7f242814d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:41.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.882+0000 7f242c9a1700 1 --2- 172.21.15.49:0/847469397 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24280b0b90 0x7f242814d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:41.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.882+0000 7f242c9a1700 1 -- 172.21.15.49:0/847469397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2428167fd0 msgr2=0x7f2428168430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:41.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.882+0000 7f242c9a1700 1 --2- 172.21.15.49:0/847469397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2428167fd0 0x7f2428168430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:41.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.882+0000 7f242c9a1700 1 -- 172.21.15.49:0/847469397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2428096500 con 0x7f2418004b80 2023-11-30T18:39:41.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.882+0000 7f2427fff700 1 --2- 172.21.15.49:0/847469397 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24280b0b90 0x7f242814d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:39:41.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.883+0000 7f242c9a1700 1 --2- 172.21.15.49:0/847469397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2418004b80 0x7f2428095bb0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 rx=0x7f241c011b40 tx=0x7f241c006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:41.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.883+0000 7f2424ff9700 1 -- 172.21.15.49:0/847469397 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c00fa10 con 0x7f2418004b80 2023-11-30T18:39:41.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.883+0000 7f2424ff9700 1 -- 172.21.15.49:0/847469397 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241c00fb70 con 0x7f2418004b80 2023-11-30T18:39:41.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.883+0000 7f242ec05700 1 -- 172.21.15.49:0/847469397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24280967e0 con 0x7f2418004b80 2023-11-30T18:39:41.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.883+0000 7f2424ff9700 1 -- 172.21.15.49:0/847469397 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c014440 con 0x7f2418004b80 2023-11-30T18:39:41.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.883+0000 7f242ec05700 1 -- 172.21.15.49:0/847469397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2428096da0 con 0x7f2418004b80 2023-11-30T18:39:41.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.884+0000 7f242ec05700 1 -- 172.21.15.49:0/847469397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f242806c860 con 0x7f2418004b80 2023-11-30T18:39:41.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.884+0000 7f2424ff9700 1 -- 172.21.15.49:0/847469397 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f241c0147f0 con 0x7f2418004b80 2023-11-30T18:39:41.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.884+0000 7f2424ff9700 1 --2- 172.21.15.49:0/847469397 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f240c05f240 0x7f240c061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:41.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.884+0000 7f2424ff9700 1 -- 172.21.15.49:0/847469397 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6205+0+0 (secure 0 0 0) 0x7f241c07b010 con 0x7f2418004b80 2023-11-30T18:39:41.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.885+0000 7f2427fff700 1 --2- 172.21.15.49:0/847469397 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f240c05f240 0x7f240c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:41.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.885+0000 7f2427fff700 1 --2- 172.21.15.49:0/847469397 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f240c05f240 0x7f240c061700 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f24140010e0 tx=0x7f2414009040).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:41.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:41.889+0000 7f2424ff9700 1 -- 172.21.15.49:0/847469397 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f241c04c050 con 0x7f2418004b80 2023-11-30T18:39:42.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.056+0000 7f242ec05700 1 -- 172.21.15.49:0/847469397 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f24280c6250 con 0x7f240c05f240 2023-11-30T18:39:42.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.066+0000 7f2424ff9700 1 -- 172.21.15.49:0/847469397 <== mgr.7760 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359132 (secure 0 0 0) 0x7f24280c6250 con 0x7f240c05f240 2023-11-30T18:39:42.071 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:39:42.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.070+0000 7f242ec05700 1 -- 172.21.15.49:0/847469397 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f240c05f240 msgr2=0x7f240c061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:42.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.070+0000 7f242ec05700 1 --2- 172.21.15.49:0/847469397 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f240c05f240 0x7f240c061700 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f24140010e0 tx=0x7f2414009040).stop 2023-11-30T18:39:42.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.070+0000 7f242ec05700 1 -- 172.21.15.49:0/847469397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2418004b80 msgr2=0x7f2428095bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:42.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.070+0000 7f242ec05700 1 --2- 172.21.15.49:0/847469397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2418004b80 0x7f2428095bb0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 rx=0x7f241c011b40 tx=0x7f241c006f40).stop 2023-11-30T18:39:42.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.070+0000 7f242ec05700 1 -- 172.21.15.49:0/847469397 shutdown_connections 2023-11-30T18:39:42.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.070+0000 7f242ec05700 1 --2- 172.21.15.49:0/847469397 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f240c05f240 0x7f240c061700 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:42.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.070+0000 7f242ec05700 1 --2- 172.21.15.49:0/847469397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2428167fd0 0x7f2428168430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:42.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.070+0000 7f242ec05700 1 --2- 172.21.15.49:0/847469397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2418004b80 0x7f2428095bb0 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:42.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.070+0000 7f242ec05700 1 --2- 172.21.15.49:0/847469397 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24280b0b90 0x7f242814d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:42.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.070+0000 7f242ec05700 1 -- 172.21.15.49:0/847469397 >> 172.21.15.49:0/847469397 conn(0x7f2428085020 msgr2=0x7f24280c9580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:42.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.070+0000 7f242ec05700 1 -- 172.21.15.49:0/847469397 shutdown_connections 2023-11-30T18:39:42.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.070+0000 7f242ec05700 1 -- 172.21.15.49:0/847469397 wait complete. 2023-11-30T18:39:42.076 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T18:39:42.083 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-30T18:39:40.642877+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1414,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":208,"acting":208,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":216,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2449904,"kb_used_data":19760,"kb_used_omap":0,"kb_used_meta":2430080,"kb_avail":752524816,"statfs":{"total":773094113280,"available":770585411584,"internally_reserved":0,"allocated":20234240,"data_stored":10371452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2488401920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-594407,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-210,"num_write_kb":-721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.004735"},"pg_stats":[{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349312+0000","last_change":"2023-11-30T18:39:37.344457+0000","last_active":"2023-11-30T18:39:37.349312+0000","last_peered":"2023-11-30T18:39:37.349312+0000","last_clean":"2023-11-30T18:39:37.349312+0000","last_became_active":"2023-11-30T18:39:37.344174+0000","last_became_peered":"2023-11-30T18:39:37.344174+0000","last_unstale":"2023-11-30T18:39:37.349312+0000","last_undegraded":"2023-11-30T18:39:37.349312+0000","last_fullsized":"2023-11-30T18:39:37.349312+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3f","version":"202'3","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346160+0000","last_change":"2023-11-30T18:39:36.952718+0000","last_active":"2023-11-30T18:39:37.346160+0000","last_peered":"2023-11-30T18:39:37.346160+0000","last_clean":"2023-11-30T18:39:37.346160+0000","last_became_active":"2023-11-30T18:39:36.952412+0000","last_became_peered":"2023-11-30T18:39:36.952412+0000","last_unstale":"2023-11-30T18:39:37.346160+0000","last_undegraded":"2023-11-30T18:39:37.346160+0000","last_fullsized":"2023-11-30T18:39:37.346160+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.342165+0000","last_change":"2023-11-30T18:39:37.339227+0000","last_active":"2023-11-30T18:39:37.342165+0000","last_peered":"2023-11-30T18:39:37.342165+0000","last_clean":"2023-11-30T18:39:37.342165+0000","last_became_active":"2023-11-30T18:39:37.338774+0000","last_became_peered":"2023-11-30T18:39:37.338774+0000","last_unstale":"2023-11-30T18:39:37.342165+0000","last_undegraded":"2023-11-30T18:39:37.342165+0000","last_fullsized":"2023-11-30T18:39:37.342165+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349301+0000","last_change":"2023-11-30T18:39:37.345801+0000","last_active":"2023-11-30T18:39:37.349301+0000","last_peered":"2023-11-30T18:39:37.349301+0000","last_clean":"2023-11-30T18:39:37.349301+0000","last_became_active":"2023-11-30T18:39:37.345516+0000","last_became_peered":"2023-11-30T18:39:37.345516+0000","last_unstale":"2023-11-30T18:39:37.349301+0000","last_undegraded":"2023-11-30T18:39:37.349301+0000","last_fullsized":"2023-11-30T18:39:37.349301+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3c","version":"202'2","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347142+0000","last_change":"2023-11-30T18:39:36.949667+0000","last_active":"2023-11-30T18:39:37.347142+0000","last_peered":"2023-11-30T18:39:37.347142+0000","last_clean":"2023-11-30T18:39:37.347142+0000","last_became_active":"2023-11-30T18:39:36.949238+0000","last_became_peered":"2023-11-30T18:39:36.949238+0000","last_unstale":"2023-11-30T18:39:37.347142+0000","last_undegraded":"2023-11-30T18:39:37.347142+0000","last_fullsized":"2023-11-30T18:39:37.347142+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.351900+0000","last_change":"2023-11-30T18:39:37.349000+0000","last_active":"2023-11-30T18:39:37.351900+0000","last_peered":"2023-11-30T18:39:37.351900+0000","last_clean":"2023-11-30T18:39:37.351900+0000","last_became_active":"2023-11-30T18:39:37.348658+0000","last_became_peered":"2023-11-30T18:39:37.348658+0000","last_unstale":"2023-11-30T18:39:37.351900+0000","last_undegraded":"2023-11-30T18:39:37.351900+0000","last_fullsized":"2023-11-30T18:39:37.351900+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3a","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346845+0000","last_change":"2023-11-30T18:39:36.948257+0000","last_active":"2023-11-30T18:39:37.346845+0000","last_peered":"2023-11-30T18:39:37.346845+0000","last_clean":"2023-11-30T18:39:37.346845+0000","last_became_active":"2023-11-30T18:39:36.947769+0000","last_became_peered":"2023-11-30T18:39:36.947769+0000","last_unstale":"2023-11-30T18:39:37.346845+0000","last_undegraded":"2023-11-30T18:39:37.346845+0000","last_fullsized":"2023-11-30T18:39:37.346845+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347404+0000","last_change":"2023-11-30T18:39:37.345626+0000","last_active":"2023-11-30T18:39:37.347404+0000","last_peered":"2023-11-30T18:39:37.347404+0000","last_clean":"2023-11-30T18:39:37.347404+0000","last_became_active":"2023-11-30T18:39:37.345347+0000","last_became_peered":"2023-11-30T18:39:37.345347+0000","last_unstale":"2023-11-30T18:39:37.347404+0000","last_undegraded":"2023-11-30T18:39:37.347404+0000","last_fullsized":"2023-11-30T18:39:37.347404+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.333622+0000","last_change":"2023-11-30T18:39:36.946508+0000","last_active":"2023-11-30T18:39:37.333622+0000","last_peered":"2023-11-30T18:39:37.333622+0000","last_clean":"2023-11-30T18:39:37.333622+0000","last_became_active":"2023-11-30T18:39:36.946260+0000","last_became_peered":"2023-11-30T18:39:36.946260+0000","last_unstale":"2023-11-30T18:39:37.333622+0000","last_undegraded":"2023-11-30T18:39:37.333622+0000","last_fullsized":"2023-11-30T18:39:37.333622+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347329+0000","last_change":"2023-11-30T18:39:37.344153+0000","last_active":"2023-11-30T18:39:37.347329+0000","last_peered":"2023-11-30T18:39:37.347329+0000","last_clean":"2023-11-30T18:39:37.347329+0000","last_became_active":"2023-11-30T18:39:37.343879+0000","last_became_peered":"2023-11-30T18:39:37.343879+0000","last_unstale":"2023-11-30T18:39:37.347329+0000","last_undegraded":"2023-11-30T18:39:37.347329+0000","last_fullsized":"2023-11-30T18:39:37.347329+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347574+0000","last_change":"2023-11-30T18:39:37.343067+0000","last_active":"2023-11-30T18:39:37.347574+0000","last_peered":"2023-11-30T18:39:37.347574+0000","last_clean":"2023-11-30T18:39:37.347574+0000","last_became_active":"2023-11-30T18:39:37.338376+0000","last_became_peered":"2023-11-30T18:39:37.338376+0000","last_unstale":"2023-11-30T18:39:37.347574+0000","last_undegraded":"2023-11-30T18:39:37.347574+0000","last_fullsized":"2023-11-30T18:39:37.347574+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.343031+0000","last_change":"2023-11-30T18:39:37.336599+0000","last_active":"2023-11-30T18:39:37.343031+0000","last_peered":"2023-11-30T18:39:37.343031+0000","last_clean":"2023-11-30T18:39:37.343031+0000","last_became_active":"2023-11-30T18:39:37.336034+0000","last_became_peered":"2023-11-30T18:39:37.336034+0000","last_unstale":"2023-11-30T18:39:37.343031+0000","last_undegraded":"2023-11-30T18:39:37.343031+0000","last_fullsized":"2023-11-30T18:39:37.343031+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346994+0000","last_change":"2023-11-30T18:39:37.344677+0000","last_active":"2023-11-30T18:39:37.346994+0000","last_peered":"2023-11-30T18:39:37.346994+0000","last_clean":"2023-11-30T18:39:37.346994+0000","last_became_active":"2023-11-30T18:39:37.344361+0000","last_became_peered":"2023-11-30T18:39:37.344361+0000","last_unstale":"2023-11-30T18:39:37.346994+0000","last_undegraded":"2023-11-30T18:39:37.346994+0000","last_fullsized":"2023-11-30T18:39:37.346994+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349920+0000","last_change":"2023-11-30T18:39:37.346869+0000","last_active":"2023-11-30T18:39:37.349920+0000","last_peered":"2023-11-30T18:39:37.349920+0000","last_clean":"2023-11-30T18:39:37.349920+0000","last_became_active":"2023-11-30T18:39:37.346571+0000","last_became_peered":"2023-11-30T18:39:37.346571+0000","last_unstale":"2023-11-30T18:39:37.349920+0000","last_undegraded":"2023-11-30T18:39:37.349920+0000","last_fullsized":"2023-11-30T18:39:37.349920+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349366+0000","last_change":"2023-11-30T18:39:37.345080+0000","last_active":"2023-11-30T18:39:37.349366+0000","last_peered":"2023-11-30T18:39:37.349366+0000","last_clean":"2023-11-30T18:39:37.349366+0000","last_became_active":"2023-11-30T18:39:37.344759+0000","last_became_peered":"2023-11-30T18:39:37.344759+0000","last_unstale":"2023-11-30T18:39:37.349366+0000","last_undegraded":"2023-11-30T18:39:37.349366+0000","last_fullsized":"2023-11-30T18:39:37.349366+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352812+0000","last_change":"2023-11-30T18:39:37.351277+0000","last_active":"2023-11-30T18:39:37.352812+0000","last_peered":"2023-11-30T18:39:37.352812+0000","last_clean":"2023-11-30T18:39:37.352812+0000","last_became_active":"2023-11-30T18:39:37.351026+0000","last_became_peered":"2023-11-30T18:39:37.351026+0000","last_unstale":"2023-11-30T18:39:37.352812+0000","last_undegraded":"2023-11-30T18:39:37.352812+0000","last_fullsized":"2023-11-30T18:39:37.352812+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346081+0000","last_change":"2023-11-30T18:39:37.338925+0000","last_active":"2023-11-30T18:39:37.346081+0000","last_peered":"2023-11-30T18:39:37.346081+0000","last_clean":"2023-11-30T18:39:37.346081+0000","last_became_active":"2023-11-30T18:39:37.338608+0000","last_became_peered":"2023-11-30T18:39:37.338608+0000","last_unstale":"2023-11-30T18:39:37.346081+0000","last_undegraded":"2023-11-30T18:39:37.346081+0000","last_fullsized":"2023-11-30T18:39:37.346081+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.329742+0000","last_change":"2023-11-30T18:39:36.949738+0000","last_active":"2023-11-30T18:39:37.329742+0000","last_peered":"2023-11-30T18:39:37.329742+0000","last_clean":"2023-11-30T18:39:37.329742+0000","last_became_active":"2023-11-30T18:39:36.949398+0000","last_became_peered":"2023-11-30T18:39:36.949398+0000","last_unstale":"2023-11-30T18:39:37.329742+0000","last_undegraded":"2023-11-30T18:39:37.329742+0000","last_fullsized":"2023-11-30T18:39:37.329742+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352073+0000","last_change":"2023-11-30T18:39:37.347542+0000","last_active":"2023-11-30T18:39:37.352073+0000","last_peered":"2023-11-30T18:39:37.352073+0000","last_clean":"2023-11-30T18:39:37.352073+0000","last_became_active":"2023-11-30T18:39:37.347265+0000","last_became_peered":"2023-11-30T18:39:37.347265+0000","last_unstale":"2023-11-30T18:39:37.352073+0000","last_undegraded":"2023-11-30T18:39:37.352073+0000","last_fullsized":"2023-11-30T18:39:37.352073+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.30","version":"202'4","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.350561+0000","last_change":"2023-11-30T18:39:36.951234+0000","last_active":"2023-11-30T18:39:37.350561+0000","last_peered":"2023-11-30T18:39:37.350561+0000","last_clean":"2023-11-30T18:39:37.350561+0000","last_became_active":"2023-11-30T18:39:36.950335+0000","last_became_peered":"2023-11-30T18:39:36.950335+0000","last_unstale":"2023-11-30T18:39:37.350561+0000","last_undegraded":"2023-11-30T18:39:37.350561+0000","last_fullsized":"2023-11-30T18:39:37.350561+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.326222+0000","last_change":"2023-11-30T18:39:36.949535+0000","last_active":"2023-11-30T18:39:37.326222+0000","last_peered":"2023-11-30T18:39:37.326222+0000","last_clean":"2023-11-30T18:39:37.326222+0000","last_became_active":"2023-11-30T18:39:36.949241+0000","last_became_peered":"2023-11-30T18:39:36.949241+0000","last_unstale":"2023-11-30T18:39:37.326222+0000","last_undegraded":"2023-11-30T18:39:37.326222+0000","last_fullsized":"2023-11-30T18:39:37.326222+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.337654+0000","last_change":"2023-11-30T18:39:36.949130+0000","last_active":"2023-11-30T18:39:37.337654+0000","last_peered":"2023-11-30T18:39:37.337654+0000","last_clean":"2023-11-30T18:39:37.337654+0000","last_became_active":"2023-11-30T18:39:36.946324+0000","last_became_peered":"2023-11-30T18:39:36.946324+0000","last_unstale":"2023-11-30T18:39:37.337654+0000","last_undegraded":"2023-11-30T18:39:37.337654+0000","last_fullsized":"2023-11-30T18:39:37.337654+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2d","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347422+0000","last_change":"2023-11-30T18:39:36.943783+0000","last_active":"2023-11-30T18:39:37.347422+0000","last_peered":"2023-11-30T18:39:37.347422+0000","last_clean":"2023-11-30T18:39:37.347422+0000","last_became_active":"2023-11-30T18:39:36.943292+0000","last_became_peered":"2023-11-30T18:39:36.943292+0000","last_unstale":"2023-11-30T18:39:37.347422+0000","last_undegraded":"2023-11-30T18:39:37.347422+0000","last_fullsized":"2023-11-30T18:39:37.347422+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349567+0000","last_change":"2023-11-30T18:39:37.346979+0000","last_active":"2023-11-30T18:39:37.349567+0000","last_peered":"2023-11-30T18:39:37.349567+0000","last_clean":"2023-11-30T18:39:37.349567+0000","last_became_active":"2023-11-30T18:39:37.346664+0000","last_became_peered":"2023-11-30T18:39:37.346664+0000","last_unstale":"2023-11-30T18:39:37.349567+0000","last_undegraded":"2023-11-30T18:39:37.349567+0000","last_fullsized":"2023-11-30T18:39:37.349567+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.353489+0000","last_change":"2023-11-30T18:39:37.352660+0000","last_active":"2023-11-30T18:39:37.353489+0000","last_peered":"2023-11-30T18:39:37.353489+0000","last_clean":"2023-11-30T18:39:37.353489+0000","last_became_active":"2023-11-30T18:39:37.352052+0000","last_became_peered":"2023-11-30T18:39:37.352052+0000","last_unstale":"2023-11-30T18:39:37.353489+0000","last_undegraded":"2023-11-30T18:39:37.353489+0000","last_fullsized":"2023-11-30T18:39:37.353489+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.343254+0000","last_change":"2023-11-30T18:39:36.952248+0000","last_active":"2023-11-30T18:39:37.343254+0000","last_peered":"2023-11-30T18:39:37.343254+0000","last_clean":"2023-11-30T18:39:37.343254+0000","last_became_active":"2023-11-30T18:39:36.951960+0000","last_became_peered":"2023-11-30T18:39:36.951960+0000","last_unstale":"2023-11-30T18:39:37.343254+0000","last_undegraded":"2023-11-30T18:39:37.343254+0000","last_fullsized":"2023-11-30T18:39:37.343254+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349666+0000","last_change":"2023-11-30T18:39:37.346628+0000","last_active":"2023-11-30T18:39:37.349666+0000","last_peered":"2023-11-30T18:39:37.349666+0000","last_clean":"2023-11-30T18:39:37.349666+0000","last_became_active":"2023-11-30T18:39:37.346349+0000","last_became_peered":"2023-11-30T18:39:37.346349+0000","last_unstale":"2023-11-30T18:39:37.349666+0000","last_undegraded":"2023-11-30T18:39:37.349666+0000","last_fullsized":"2023-11-30T18:39:37.349666+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347382+0000","last_change":"2023-11-30T18:39:37.344874+0000","last_active":"2023-11-30T18:39:37.347382+0000","last_peered":"2023-11-30T18:39:37.347382+0000","last_clean":"2023-11-30T18:39:37.347382+0000","last_became_active":"2023-11-30T18:39:37.344613+0000","last_became_peered":"2023-11-30T18:39:37.344613+0000","last_unstale":"2023-11-30T18:39:37.347382+0000","last_undegraded":"2023-11-30T18:39:37.347382+0000","last_fullsized":"2023-11-30T18:39:37.347382+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.323906+0000","last_change":"2023-11-30T18:39:36.946087+0000","last_active":"2023-11-30T18:39:37.323906+0000","last_peered":"2023-11-30T18:39:37.323906+0000","last_clean":"2023-11-30T18:39:37.323906+0000","last_became_active":"2023-11-30T18:39:36.945402+0000","last_became_peered":"2023-11-30T18:39:36.945402+0000","last_unstale":"2023-11-30T18:39:37.323906+0000","last_undegraded":"2023-11-30T18:39:37.323906+0000","last_fullsized":"2023-11-30T18:39:37.323906+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.348211+0000","last_change":"2023-11-30T18:39:37.344635+0000","last_active":"2023-11-30T18:39:37.348211+0000","last_peered":"2023-11-30T18:39:37.348211+0000","last_clean":"2023-11-30T18:39:37.348211+0000","last_became_active":"2023-11-30T18:39:37.344167+0000","last_became_peered":"2023-11-30T18:39:37.344167+0000","last_unstale":"2023-11-30T18:39:37.348211+0000","last_undegraded":"2023-11-30T18:39:37.348211+0000","last_fullsized":"2023-11-30T18:39:37.348211+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349334+0000","last_change":"2023-11-30T18:39:37.344920+0000","last_active":"2023-11-30T18:39:37.349334+0000","last_peered":"2023-11-30T18:39:37.349334+0000","last_clean":"2023-11-30T18:39:37.349334+0000","last_became_active":"2023-11-30T18:39:37.344397+0000","last_became_peered":"2023-11-30T18:39:37.344397+0000","last_unstale":"2023-11-30T18:39:37.349334+0000","last_undegraded":"2023-11-30T18:39:37.349334+0000","last_fullsized":"2023-11-30T18:39:37.349334+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.340948+0000","last_change":"2023-11-30T18:39:37.339921+0000","last_active":"2023-11-30T18:39:37.340948+0000","last_peered":"2023-11-30T18:39:37.340948+0000","last_clean":"2023-11-30T18:39:37.340948+0000","last_became_active":"2023-11-30T18:39:37.339659+0000","last_became_peered":"2023-11-30T18:39:37.339659+0000","last_unstale":"2023-11-30T18:39:37.340948+0000","last_undegraded":"2023-11-30T18:39:37.340948+0000","last_fullsized":"2023-11-30T18:39:37.340948+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.331794+0000","last_change":"2023-11-30T18:39:36.952942+0000","last_active":"2023-11-30T18:39:37.331794+0000","last_peered":"2023-11-30T18:39:37.331794+0000","last_clean":"2023-11-30T18:39:37.331794+0000","last_became_active":"2023-11-30T18:39:36.952663+0000","last_became_peered":"2023-11-30T18:39:36.952663+0000","last_unstale":"2023-11-30T18:39:37.331794+0000","last_undegraded":"2023-11-30T18:39:37.331794+0000","last_fullsized":"2023-11-30T18:39:37.331794+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349529+0000","last_change":"2023-11-30T18:39:37.345821+0000","last_active":"2023-11-30T18:39:37.349529+0000","last_peered":"2023-11-30T18:39:37.349529+0000","last_clean":"2023-11-30T18:39:37.349529+0000","last_became_active":"2023-11-30T18:39:37.345470+0000","last_became_peered":"2023-11-30T18:39:37.345470+0000","last_unstale":"2023-11-30T18:39:37.349529+0000","last_undegraded":"2023-11-30T18:39:37.349529+0000","last_fullsized":"2023-11-30T18:39:37.349529+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.348203+0000","last_change":"2023-11-30T18:39:37.344683+0000","last_active":"2023-11-30T18:39:37.348203+0000","last_peered":"2023-11-30T18:39:37.348203+0000","last_clean":"2023-11-30T18:39:37.348203+0000","last_became_active":"2023-11-30T18:39:37.344395+0000","last_became_peered":"2023-11-30T18:39:37.344395+0000","last_unstale":"2023-11-30T18:39:37.348203+0000","last_undegraded":"2023-11-30T18:39:37.348203+0000","last_fullsized":"2023-11-30T18:39:37.348203+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327088+0000","last_change":"2023-11-30T18:39:36.940369+0000","last_active":"2023-11-30T18:39:37.327088+0000","last_peered":"2023-11-30T18:39:37.327088+0000","last_clean":"2023-11-30T18:39:37.327088+0000","last_became_active":"2023-11-30T18:39:36.940068+0000","last_became_peered":"2023-11-30T18:39:36.940068+0000","last_unstale":"2023-11-30T18:39:37.327088+0000","last_undegraded":"2023-11-30T18:39:37.327088+0000","last_fullsized":"2023-11-30T18:39:37.327088+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.344294+0000","last_change":"2023-11-30T18:39:37.339378+0000","last_active":"2023-11-30T18:39:37.344294+0000","last_peered":"2023-11-30T18:39:37.344294+0000","last_clean":"2023-11-30T18:39:37.344294+0000","last_became_active":"2023-11-30T18:39:37.339129+0000","last_became_peered":"2023-11-30T18:39:37.339129+0000","last_unstale":"2023-11-30T18:39:37.344294+0000","last_undegraded":"2023-11-30T18:39:37.344294+0000","last_fullsized":"2023-11-30T18:39:37.344294+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.338109+0000","last_change":"2023-11-30T18:39:36.951143+0000","last_active":"2023-11-30T18:39:37.338109+0000","last_peered":"2023-11-30T18:39:37.338109+0000","last_clean":"2023-11-30T18:39:37.338109+0000","last_became_active":"2023-11-30T18:39:36.949920+0000","last_became_peered":"2023-11-30T18:39:36.949920+0000","last_unstale":"2023-11-30T18:39:37.338109+0000","last_undegraded":"2023-11-30T18:39:37.338109+0000","last_fullsized":"2023-11-30T18:39:37.338109+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.336742+0000","last_change":"2023-11-30T18:39:36.946323+0000","last_active":"2023-11-30T18:39:37.336742+0000","last_peered":"2023-11-30T18:39:37.336742+0000","last_clean":"2023-11-30T18:39:37.336742+0000","last_became_active":"2023-11-30T18:39:36.946044+0000","last_became_peered":"2023-11-30T18:39:36.946044+0000","last_unstale":"2023-11-30T18:39:37.336742+0000","last_undegraded":"2023-11-30T18:39:37.336742+0000","last_fullsized":"2023-11-30T18:39:37.336742+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.340269+0000","last_change":"2023-11-30T18:39:37.331035+0000","last_active":"2023-11-30T18:39:37.340269+0000","last_peered":"2023-11-30T18:39:37.340269+0000","last_clean":"2023-11-30T18:39:37.340269+0000","last_became_active":"2023-11-30T18:39:37.330729+0000","last_became_peered":"2023-11-30T18:39:37.330729+0000","last_unstale":"2023-11-30T18:39:37.340269+0000","last_undegraded":"2023-11-30T18:39:37.340269+0000","last_fullsized":"2023-11-30T18:39:37.340269+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.337914+0000","last_change":"2023-11-30T18:39:36.950391+0000","last_active":"2023-11-30T18:39:37.337914+0000","last_peered":"2023-11-30T18:39:37.337914+0000","last_clean":"2023-11-30T18:39:37.337914+0000","last_became_active":"2023-11-30T18:39:36.946855+0000","last_became_peered":"2023-11-30T18:39:36.946855+0000","last_unstale":"2023-11-30T18:39:37.337914+0000","last_undegraded":"2023-11-30T18:39:37.337914+0000","last_fullsized":"2023-11-30T18:39:37.337914+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347365+0000","last_change":"2023-11-30T18:39:37.340342+0000","last_active":"2023-11-30T18:39:37.347365+0000","last_peered":"2023-11-30T18:39:37.347365+0000","last_clean":"2023-11-30T18:39:37.347365+0000","last_became_active":"2023-11-30T18:39:37.340045+0000","last_became_peered":"2023-11-30T18:39:37.340045+0000","last_unstale":"2023-11-30T18:39:37.347365+0000","last_undegraded":"2023-11-30T18:39:37.347365+0000","last_fullsized":"2023-11-30T18:39:37.347365+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352099+0000","last_change":"2023-11-30T18:39:36.948987+0000","last_active":"2023-11-30T18:39:37.352099+0000","last_peered":"2023-11-30T18:39:37.352099+0000","last_clean":"2023-11-30T18:39:37.352099+0000","last_became_active":"2023-11-30T18:39:36.947046+0000","last_became_peered":"2023-11-30T18:39:36.947046+0000","last_unstale":"2023-11-30T18:39:37.352099+0000","last_undegraded":"2023-11-30T18:39:37.352099+0000","last_fullsized":"2023-11-30T18:39:37.352099+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.345480+0000","last_change":"2023-11-30T18:39:37.341621+0000","last_active":"2023-11-30T18:39:37.345480+0000","last_peered":"2023-11-30T18:39:37.345480+0000","last_clean":"2023-11-30T18:39:37.345480+0000","last_became_active":"2023-11-30T18:39:37.341312+0000","last_became_peered":"2023-11-30T18:39:37.341312+0000","last_unstale":"2023-11-30T18:39:37.345480+0000","last_undegraded":"2023-11-30T18:39:37.345480+0000","last_fullsized":"2023-11-30T18:39:37.345480+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346986+0000","last_change":"2023-11-30T18:39:36.952827+0000","last_active":"2023-11-30T18:39:37.346986+0000","last_peered":"2023-11-30T18:39:37.346986+0000","last_clean":"2023-11-30T18:39:37.346986+0000","last_became_active":"2023-11-30T18:39:36.952608+0000","last_became_peered":"2023-11-30T18:39:36.952608+0000","last_unstale":"2023-11-30T18:39:37.346986+0000","last_undegraded":"2023-11-30T18:39:37.346986+0000","last_fullsized":"2023-11-30T18:39:37.346986+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.342144+0000","last_change":"2023-11-30T18:39:37.339035+0000","last_active":"2023-11-30T18:39:37.342144+0000","last_peered":"2023-11-30T18:39:37.342144+0000","last_clean":"2023-11-30T18:39:37.342144+0000","last_became_active":"2023-11-30T18:39:37.338479+0000","last_became_peered":"2023-11-30T18:39:37.338479+0000","last_unstale":"2023-11-30T18:39:37.342144+0000","last_undegraded":"2023-11-30T18:39:37.342144+0000","last_fullsized":"2023-11-30T18:39:37.342144+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346109+0000","last_change":"2023-11-30T18:39:37.338996+0000","last_active":"2023-11-30T18:39:37.346109+0000","last_peered":"2023-11-30T18:39:37.346109+0000","last_clean":"2023-11-30T18:39:37.346109+0000","last_became_active":"2023-11-30T18:39:37.338697+0000","last_became_peered":"2023-11-30T18:39:37.338697+0000","last_unstale":"2023-11-30T18:39:37.346109+0000","last_undegraded":"2023-11-30T18:39:37.346109+0000","last_fullsized":"2023-11-30T18:39:37.346109+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.325152+0000","last_change":"2023-11-30T18:39:36.946452+0000","last_active":"2023-11-30T18:39:37.325152+0000","last_peered":"2023-11-30T18:39:37.325152+0000","last_clean":"2023-11-30T18:39:37.325152+0000","last_became_active":"2023-11-30T18:39:36.946158+0000","last_became_peered":"2023-11-30T18:39:36.946158+0000","last_unstale":"2023-11-30T18:39:37.325152+0000","last_undegraded":"2023-11-30T18:39:37.325152+0000","last_fullsized":"2023-11-30T18:39:37.325152+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.350555+0000","last_change":"2023-11-30T18:39:37.347669+0000","last_active":"2023-11-30T18:39:37.350555+0000","last_peered":"2023-11-30T18:39:37.350555+0000","last_clean":"2023-11-30T18:39:37.350555+0000","last_became_active":"2023-11-30T18:39:37.347353+0000","last_became_peered":"2023-11-30T18:39:37.347353+0000","last_unstale":"2023-11-30T18:39:37.350555+0000","last_undegraded":"2023-11-30T18:39:37.350555+0000","last_fullsized":"2023-11-30T18:39:37.350555+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.326852+0000","last_change":"2023-11-30T18:39:36.948868+0000","last_active":"2023-11-30T18:39:37.326852+0000","last_peered":"2023-11-30T18:39:37.326852+0000","last_clean":"2023-11-30T18:39:37.326852+0000","last_became_active":"2023-11-30T18:39:36.948560+0000","last_became_peered":"2023-11-30T18:39:36.948560+0000","last_unstale":"2023-11-30T18:39:37.326852+0000","last_undegraded":"2023-11-30T18:39:37.326852+0000","last_fullsized":"2023-11-30T18:39:37.326852+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.345333+0000","last_change":"2023-11-30T18:39:37.342635+0000","last_active":"2023-11-30T18:39:37.345333+0000","last_peered":"2023-11-30T18:39:37.345333+0000","last_clean":"2023-11-30T18:39:37.345333+0000","last_became_active":"2023-11-30T18:39:37.342376+0000","last_became_peered":"2023-11-30T18:39:37.342376+0000","last_unstale":"2023-11-30T18:39:37.345333+0000","last_undegraded":"2023-11-30T18:39:37.345333+0000","last_fullsized":"2023-11-30T18:39:37.345333+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327461+0000","last_change":"2023-11-30T18:39:36.944677+0000","last_active":"2023-11-30T18:39:37.327461+0000","last_peered":"2023-11-30T18:39:37.327461+0000","last_clean":"2023-11-30T18:39:37.327461+0000","last_became_active":"2023-11-30T18:39:36.944380+0000","last_became_peered":"2023-11-30T18:39:36.944380+0000","last_unstale":"2023-11-30T18:39:37.327461+0000","last_undegraded":"2023-11-30T18:39:37.327461+0000","last_fullsized":"2023-11-30T18:39:37.327461+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.338865+0000","last_change":"2023-11-30T18:39:37.334416+0000","last_active":"2023-11-30T18:39:37.338865+0000","last_peered":"2023-11-30T18:39:37.338865+0000","last_clean":"2023-11-30T18:39:37.338865+0000","last_became_active":"2023-11-30T18:39:37.334121+0000","last_became_peered":"2023-11-30T18:39:37.334121+0000","last_unstale":"2023-11-30T18:39:37.338865+0000","last_undegraded":"2023-11-30T18:39:37.338865+0000","last_fullsized":"2023-11-30T18:39:37.338865+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.323817+0000","last_change":"2023-11-30T18:39:36.946789+0000","last_active":"2023-11-30T18:39:37.323817+0000","last_peered":"2023-11-30T18:39:37.323817+0000","last_clean":"2023-11-30T18:39:37.323817+0000","last_became_active":"2023-11-30T18:39:36.946341+0000","last_became_peered":"2023-11-30T18:39:36.946341+0000","last_unstale":"2023-11-30T18:39:37.323817+0000","last_undegraded":"2023-11-30T18:39:37.323817+0000","last_fullsized":"2023-11-30T18:39:37.323817+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349417+0000","last_change":"2023-11-30T18:39:37.344746+0000","last_active":"2023-11-30T18:39:37.349417+0000","last_peered":"2023-11-30T18:39:37.349417+0000","last_clean":"2023-11-30T18:39:37.349417+0000","last_became_active":"2023-11-30T18:39:37.344421+0000","last_became_peered":"2023-11-30T18:39:37.344421+0000","last_unstale":"2023-11-30T18:39:37.349417+0000","last_undegraded":"2023-11-30T18:39:37.349417+0000","last_fullsized":"2023-11-30T18:39:37.349417+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327484+0000","last_change":"2023-11-30T18:39:36.950190+0000","last_active":"2023-11-30T18:39:37.327484+0000","last_peered":"2023-11-30T18:39:37.327484+0000","last_clean":"2023-11-30T18:39:37.327484+0000","last_became_active":"2023-11-30T18:39:36.949891+0000","last_became_peered":"2023-11-30T18:39:36.949891+0000","last_unstale":"2023-11-30T18:39:37.327484+0000","last_undegraded":"2023-11-30T18:39:37.327484+0000","last_fullsized":"2023-11-30T18:39:37.327484+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347541+0000","last_change":"2023-11-30T18:39:37.335167+0000","last_active":"2023-11-30T18:39:37.347541+0000","last_peered":"2023-11-30T18:39:37.347541+0000","last_clean":"2023-11-30T18:39:37.347541+0000","last_became_active":"2023-11-30T18:39:37.334308+0000","last_became_peered":"2023-11-30T18:39:37.334308+0000","last_unstale":"2023-11-30T18:39:37.347541+0000","last_undegraded":"2023-11-30T18:39:37.347541+0000","last_fullsized":"2023-11-30T18:39:37.347541+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.351861+0000","last_change":"2023-11-30T18:39:36.952979+0000","last_active":"2023-11-30T18:39:37.351861+0000","last_peered":"2023-11-30T18:39:37.351861+0000","last_clean":"2023-11-30T18:39:37.351861+0000","last_became_active":"2023-11-30T18:39:36.952615+0000","last_became_peered":"2023-11-30T18:39:36.952615+0000","last_unstale":"2023-11-30T18:39:37.351861+0000","last_undegraded":"2023-11-30T18:39:37.351861+0000","last_fullsized":"2023-11-30T18:39:37.351861+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.e","version":"202'2","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.348393+0000","last_change":"2023-11-30T18:39:36.954616+0000","last_active":"2023-11-30T18:39:37.348393+0000","last_peered":"2023-11-30T18:39:37.348393+0000","last_clean":"2023-11-30T18:39:37.348393+0000","last_became_active":"2023-11-30T18:39:36.953752+0000","last_became_peered":"2023-11-30T18:39:36.953752+0000","last_unstale":"2023-11-30T18:39:37.348393+0000","last_undegraded":"2023-11-30T18:39:37.348393+0000","last_fullsized":"2023-11-30T18:39:37.348393+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.333794+0000","last_change":"2023-11-30T18:39:36.946600+0000","last_active":"2023-11-30T18:39:37.333794+0000","last_peered":"2023-11-30T18:39:37.333794+0000","last_clean":"2023-11-30T18:39:37.333794+0000","last_became_active":"2023-11-30T18:39:36.946270+0000","last_became_peered":"2023-11-30T18:39:36.946270+0000","last_unstale":"2023-11-30T18:39:37.333794+0000","last_undegraded":"2023-11-30T18:39:37.333794+0000","last_fullsized":"2023-11-30T18:39:37.333794+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327189+0000","last_change":"2023-11-30T18:39:36.944458+0000","last_active":"2023-11-30T18:39:37.327189+0000","last_peered":"2023-11-30T18:39:37.327189+0000","last_clean":"2023-11-30T18:39:37.327189+0000","last_became_active":"2023-11-30T18:39:36.944179+0000","last_became_peered":"2023-11-30T18:39:36.944179+0000","last_unstale":"2023-11-30T18:39:37.327189+0000","last_undegraded":"2023-11-30T18:39:37.327189+0000","last_fullsized":"2023-11-30T18:39:37.327189+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.353566+0000","last_change":"2023-11-30T18:39:37.352804+0000","last_active":"2023-11-30T18:39:37.353566+0000","last_peered":"2023-11-30T18:39:37.353566+0000","last_clean":"2023-11-30T18:39:37.353566+0000","last_became_active":"2023-11-30T18:39:37.352435+0000","last_became_peered":"2023-11-30T18:39:37.352435+0000","last_unstale":"2023-11-30T18:39:37.353566+0000","last_undegraded":"2023-11-30T18:39:37.353566+0000","last_fullsized":"2023-11-30T18:39:37.353566+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347239+0000","last_change":"2023-11-30T18:39:36.950997+0000","last_active":"2023-11-30T18:39:37.347239+0000","last_peered":"2023-11-30T18:39:37.347239+0000","last_clean":"2023-11-30T18:39:37.347239+0000","last_became_active":"2023-11-30T18:39:36.950673+0000","last_became_peered":"2023-11-30T18:39:36.950673+0000","last_unstale":"2023-11-30T18:39:37.347239+0000","last_undegraded":"2023-11-30T18:39:37.347239+0000","last_fullsized":"2023-11-30T18:39:37.347239+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352565+0000","last_change":"2023-11-30T18:39:37.351298+0000","last_active":"2023-11-30T18:39:37.352565+0000","last_peered":"2023-11-30T18:39:37.352565+0000","last_clean":"2023-11-30T18:39:37.352565+0000","last_became_active":"2023-11-30T18:39:37.350781+0000","last_became_peered":"2023-11-30T18:39:37.350781+0000","last_unstale":"2023-11-30T18:39:37.352565+0000","last_undegraded":"2023-11-30T18:39:37.352565+0000","last_fullsized":"2023-11-30T18:39:37.352565+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349380+0000","last_change":"2023-11-30T18:39:37.342904+0000","last_active":"2023-11-30T18:39:37.349380+0000","last_peered":"2023-11-30T18:39:37.349380+0000","last_clean":"2023-11-30T18:39:37.349380+0000","last_became_active":"2023-11-30T18:39:37.342597+0000","last_became_peered":"2023-11-30T18:39:37.342597+0000","last_unstale":"2023-11-30T18:39:37.349380+0000","last_undegraded":"2023-11-30T18:39:37.349380+0000","last_fullsized":"2023-11-30T18:39:37.349380+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.323729+0000","last_change":"2023-11-30T18:39:36.946627+0000","last_active":"2023-11-30T18:39:37.323729+0000","last_peered":"2023-11-30T18:39:37.323729+0000","last_clean":"2023-11-30T18:39:37.323729+0000","last_became_active":"2023-11-30T18:39:36.945813+0000","last_became_peered":"2023-11-30T18:39:36.945813+0000","last_unstale":"2023-11-30T18:39:37.323729+0000","last_undegraded":"2023-11-30T18:39:37.323729+0000","last_fullsized":"2023-11-30T18:39:37.323729+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346095+0000","last_change":"2023-11-30T18:39:37.343145+0000","last_active":"2023-11-30T18:39:37.346095+0000","last_peered":"2023-11-30T18:39:37.346095+0000","last_clean":"2023-11-30T18:39:37.346095+0000","last_became_active":"2023-11-30T18:39:37.342863+0000","last_became_peered":"2023-11-30T18:39:37.342863+0000","last_unstale":"2023-11-30T18:39:37.346095+0000","last_undegraded":"2023-11-30T18:39:37.346095+0000","last_fullsized":"2023-11-30T18:39:37.346095+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.330188+0000","last_change":"2023-11-30T18:39:36.949760+0000","last_active":"2023-11-30T18:39:37.330188+0000","last_peered":"2023-11-30T18:39:37.330188+0000","last_clean":"2023-11-30T18:39:37.330188+0000","last_became_active":"2023-11-30T18:39:36.949139+0000","last_became_peered":"2023-11-30T18:39:36.949139+0000","last_unstale":"2023-11-30T18:39:37.330188+0000","last_undegraded":"2023-11-30T18:39:37.330188+0000","last_fullsized":"2023-11-30T18:39:37.330188+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.7","version":"202'2","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.339149+0000","last_change":"2023-11-30T18:39:36.945986+0000","last_active":"2023-11-30T18:39:37.339149+0000","last_peered":"2023-11-30T18:39:37.339149+0000","last_clean":"2023-11-30T18:39:37.339149+0000","last_became_active":"2023-11-30T18:39:36.945645+0000","last_became_peered":"2023-11-30T18:39:36.945645+0000","last_unstale":"2023-11-30T18:39:37.339149+0000","last_undegraded":"2023-11-30T18:39:37.339149+0000","last_fullsized":"2023-11-30T18:39:37.339149+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.342995+0000","last_change":"2023-11-30T18:39:37.336408+0000","last_active":"2023-11-30T18:39:37.342995+0000","last_peered":"2023-11-30T18:39:37.342995+0000","last_clean":"2023-11-30T18:39:37.342995+0000","last_became_active":"2023-11-30T18:39:37.335738+0000","last_became_peered":"2023-11-30T18:39:37.335738+0000","last_unstale":"2023-11-30T18:39:37.342995+0000","last_undegraded":"2023-11-30T18:39:37.342995+0000","last_fullsized":"2023-11-30T18:39:37.342995+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.337854+0000","last_change":"2023-11-30T18:39:36.955512+0000","last_active":"2023-11-30T18:39:37.337854+0000","last_peered":"2023-11-30T18:39:37.337854+0000","last_clean":"2023-11-30T18:39:37.337854+0000","last_became_active":"2023-11-30T18:39:36.955212+0000","last_became_peered":"2023-11-30T18:39:36.955212+0000","last_unstale":"2023-11-30T18:39:37.337854+0000","last_undegraded":"2023-11-30T18:39:37.337854+0000","last_fullsized":"2023-11-30T18:39:37.337854+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.338579+0000","last_change":"2023-11-30T18:39:37.330346+0000","last_active":"2023-11-30T18:39:37.338579+0000","last_peered":"2023-11-30T18:39:37.338579+0000","last_clean":"2023-11-30T18:39:37.338579+0000","last_became_active":"2023-11-30T18:39:37.330086+0000","last_became_peered":"2023-11-30T18:39:37.330086+0000","last_unstale":"2023-11-30T18:39:37.338579+0000","last_undegraded":"2023-11-30T18:39:37.338579+0000","last_fullsized":"2023-11-30T18:39:37.338579+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.337927+0000","last_change":"2023-11-30T18:39:36.950992+0000","last_active":"2023-11-30T18:39:37.337927+0000","last_peered":"2023-11-30T18:39:37.337927+0000","last_clean":"2023-11-30T18:39:37.337927+0000","last_became_active":"2023-11-30T18:39:36.950695+0000","last_became_peered":"2023-11-30T18:39:36.950695+0000","last_unstale":"2023-11-30T18:39:37.337927+0000","last_undegraded":"2023-11-30T18:39:37.337927+0000","last_fullsized":"2023-11-30T18:39:37.337927+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.344708+0000","last_change":"2023-11-30T18:39:37.331147+0000","last_active":"2023-11-30T18:39:37.344708+0000","last_peered":"2023-11-30T18:39:37.344708+0000","last_clean":"2023-11-30T18:39:37.344708+0000","last_became_active":"2023-11-30T18:39:37.330838+0000","last_became_peered":"2023-11-30T18:39:37.330838+0000","last_unstale":"2023-11-30T18:39:37.344708+0000","last_undegraded":"2023-11-30T18:39:37.344708+0000","last_fullsized":"2023-11-30T18:39:37.344708+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.325251+0000","last_change":"2023-11-30T18:39:36.952569+0000","last_active":"2023-11-30T18:39:37.325251+0000","last_peered":"2023-11-30T18:39:37.325251+0000","last_clean":"2023-11-30T18:39:37.325251+0000","last_became_active":"2023-11-30T18:39:36.952293+0000","last_became_peered":"2023-11-30T18:39:36.952293+0000","last_unstale":"2023-11-30T18:39:37.325251+0000","last_undegraded":"2023-11-30T18:39:37.325251+0000","last_fullsized":"2023-11-30T18:39:37.325251+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352722+0000","last_change":"2023-11-30T18:39:37.350409+0000","last_active":"2023-11-30T18:39:37.352722+0000","last_peered":"2023-11-30T18:39:37.352722+0000","last_clean":"2023-11-30T18:39:37.352722+0000","last_became_active":"2023-11-30T18:39:37.350135+0000","last_became_peered":"2023-11-30T18:39:37.350135+0000","last_unstale":"2023-11-30T18:39:37.352722+0000","last_undegraded":"2023-11-30T18:39:37.352722+0000","last_fullsized":"2023-11-30T18:39:37.352722+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.338222+0000","last_change":"2023-11-30T18:39:36.946783+0000","last_active":"2023-11-30T18:39:37.338222+0000","last_peered":"2023-11-30T18:39:37.338222+0000","last_clean":"2023-11-30T18:39:37.338222+0000","last_became_active":"2023-11-30T18:39:36.946533+0000","last_became_peered":"2023-11-30T18:39:36.946533+0000","last_unstale":"2023-11-30T18:39:37.338222+0000","last_undegraded":"2023-11-30T18:39:37.338222+0000","last_fullsized":"2023-11-30T18:39:37.338222+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346709+0000","last_change":"2023-11-30T18:39:37.343014+0000","last_active":"2023-11-30T18:39:37.346709+0000","last_peered":"2023-11-30T18:39:37.346709+0000","last_clean":"2023-11-30T18:39:37.346709+0000","last_became_active":"2023-11-30T18:39:37.342723+0000","last_became_peered":"2023-11-30T18:39:37.342723+0000","last_unstale":"2023-11-30T18:39:37.346709+0000","last_undegraded":"2023-11-30T18:39:37.346709+0000","last_fullsized":"2023-11-30T18:39:37.346709+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.336615+0000","last_change":"2023-11-30T18:39:36.946283+0000","last_active":"2023-11-30T18:39:37.336615+0000","last_peered":"2023-11-30T18:39:37.336615+0000","last_clean":"2023-11-30T18:39:37.336615+0000","last_became_active":"2023-11-30T18:39:36.946000+0000","last_became_peered":"2023-11-30T18:39:36.946000+0000","last_unstale":"2023-11-30T18:39:37.336615+0000","last_undegraded":"2023-11-30T18:39:37.336615+0000","last_fullsized":"2023-11-30T18:39:37.336615+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.353262+0000","last_change":"2023-11-30T18:39:37.352247+0000","last_active":"2023-11-30T18:39:37.353262+0000","last_peered":"2023-11-30T18:39:37.353262+0000","last_clean":"2023-11-30T18:39:37.353262+0000","last_became_active":"2023-11-30T18:39:37.351956+0000","last_became_peered":"2023-11-30T18:39:37.351956+0000","last_unstale":"2023-11-30T18:39:37.353262+0000","last_undegraded":"2023-11-30T18:39:37.353262+0000","last_fullsized":"2023-11-30T18:39:37.353262+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.344165+0000","last_change":"2023-11-30T18:39:37.340873+0000","last_active":"2023-11-30T18:39:37.344165+0000","last_peered":"2023-11-30T18:39:37.344165+0000","last_clean":"2023-11-30T18:39:37.344165+0000","last_became_active":"2023-11-30T18:39:37.340580+0000","last_became_peered":"2023-11-30T18:39:37.340580+0000","last_unstale":"2023-11-30T18:39:37.344165+0000","last_undegraded":"2023-11-30T18:39:37.344165+0000","last_fullsized":"2023-11-30T18:39:37.344165+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.326374+0000","last_change":"2023-11-30T18:39:36.950400+0000","last_active":"2023-11-30T18:39:37.326374+0000","last_peered":"2023-11-30T18:39:37.326374+0000","last_clean":"2023-11-30T18:39:37.326374+0000","last_became_active":"2023-11-30T18:39:36.949951+0000","last_became_peered":"2023-11-30T18:39:36.949951+0000","last_unstale":"2023-11-30T18:39:37.326374+0000","last_undegraded":"2023-11-30T18:39:37.326374+0000","last_fullsized":"2023-11-30T18:39:37.326374+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:35.919960+0000","last_change":"2023-11-30T18:39:35.919960+0000","last_active":"2023-11-30T18:39:35.919960+0000","last_peered":"2023-11-30T18:39:35.919960+0000","last_clean":"2023-11-30T18:39:35.919960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:35.919960+0000","last_undegraded":"2023-11-30T18:39:35.919960+0000","last_fullsized":"2023-11-30T18:39:35.919960+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":171,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327395+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T18:39:37.327395+0000","last_peered":"2023-11-30T18:39:37.327395+0000","last_clean":"2023-11-30T18:39:37.327395+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T18:39:37.327395+0000","last_undegraded":"2023-11-30T18:39:37.327395+0000","last_fullsized":"2023-11-30T18:39:37.327395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347342+0000","last_change":"2023-11-30T18:39:37.340048+0000","last_active":"2023-11-30T18:39:37.347342+0000","last_peered":"2023-11-30T18:39:37.347342+0000","last_clean":"2023-11-30T18:39:37.347342+0000","last_became_active":"2023-11-30T18:39:37.339749+0000","last_became_peered":"2023-11-30T18:39:37.339749+0000","last_unstale":"2023-11-30T18:39:37.347342+0000","last_undegraded":"2023-11-30T18:39:37.347342+0000","last_fullsized":"2023-11-30T18:39:37.347342+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.336922+0000","last_change":"2023-11-30T18:39:36.954943+0000","last_active":"2023-11-30T18:39:37.336922+0000","last_peered":"2023-11-30T18:39:37.336922+0000","last_clean":"2023-11-30T18:39:37.336922+0000","last_became_active":"2023-11-30T18:39:36.954644+0000","last_became_peered":"2023-11-30T18:39:36.954644+0000","last_unstale":"2023-11-30T18:39:37.336922+0000","last_undegraded":"2023-11-30T18:39:37.336922+0000","last_fullsized":"2023-11-30T18:39:37.336922+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":165,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-11-30T18:39:33.082262+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T18:39:33.082262+0000","last_peered":"2023-11-30T18:39:33.082262+0000","last_clean":"2023-11-30T18:39:33.082262+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T18:39:33.082262+0000","last_undegraded":"2023-11-30T18:39:33.082262+0000","last_fullsized":"2023-11-30T18:39:33.082262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.344506+0000","last_change":"2023-11-30T18:39:37.342072+0000","last_active":"2023-11-30T18:39:37.344506+0000","last_peered":"2023-11-30T18:39:37.344506+0000","last_clean":"2023-11-30T18:39:37.344506+0000","last_became_active":"2023-11-30T18:39:37.341885+0000","last_became_peered":"2023-11-30T18:39:37.341885+0000","last_unstale":"2023-11-30T18:39:37.344506+0000","last_undegraded":"2023-11-30T18:39:37.344506+0000","last_fullsized":"2023-11-30T18:39:37.344506+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"202'2","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347830+0000","last_change":"2023-11-30T18:39:36.951915+0000","last_active":"2023-11-30T18:39:37.347830+0000","last_peered":"2023-11-30T18:39:37.347830+0000","last_clean":"2023-11-30T18:39:37.347830+0000","last_became_active":"2023-11-30T18:39:36.951639+0000","last_became_peered":"2023-11-30T18:39:36.951639+0000","last_unstale":"2023-11-30T18:39:37.347830+0000","last_undegraded":"2023-11-30T18:39:37.347830+0000","last_fullsized":"2023-11-30T18:39:37.347830+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.323644+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T18:39:37.323644+0000","last_peered":"2023-11-30T18:39:37.323644+0000","last_clean":"2023-11-30T18:39:37.323644+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T18:39:37.323644+0000","last_undegraded":"2023-11-30T18:39:37.323644+0000","last_fullsized":"2023-11-30T18:39:37.323644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.345987+0000","last_change":"2023-11-30T18:39:37.339470+0000","last_active":"2023-11-30T18:39:37.345987+0000","last_peered":"2023-11-30T18:39:37.345987+0000","last_clean":"2023-11-30T18:39:37.345987+0000","last_became_active":"2023-11-30T18:39:37.339218+0000","last_became_peered":"2023-11-30T18:39:37.339218+0000","last_unstale":"2023-11-30T18:39:37.345987+0000","last_undegraded":"2023-11-30T18:39:37.345987+0000","last_fullsized":"2023-11-30T18:39:37.345987+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.337752+0000","last_change":"2023-11-30T18:39:36.957232+0000","last_active":"2023-11-30T18:39:37.337752+0000","last_peered":"2023-11-30T18:39:37.337752+0000","last_clean":"2023-11-30T18:39:37.337752+0000","last_became_active":"2023-11-30T18:39:36.956927+0000","last_became_peered":"2023-11-30T18:39:36.956927+0000","last_unstale":"2023-11-30T18:39:37.337752+0000","last_undegraded":"2023-11-30T18:39:37.337752+0000","last_fullsized":"2023-11-30T18:39:37.337752+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":165,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-11-30T18:39:33.082262+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T18:39:33.082262+0000","last_peered":"2023-11-30T18:39:33.082262+0000","last_clean":"2023-11-30T18:39:33.082262+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T18:39:33.082262+0000","last_undegraded":"2023-11-30T18:39:33.082262+0000","last_fullsized":"2023-11-30T18:39:33.082262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":165,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.330242+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T18:39:37.330242+0000","last_peered":"2023-11-30T18:39:37.330242+0000","last_clean":"2023-11-30T18:39:37.330242+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T18:39:37.330242+0000","last_undegraded":"2023-11-30T18:39:37.330242+0000","last_fullsized":"2023-11-30T18:39:37.330242+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349079+0000","last_change":"2023-11-30T18:39:37.345111+0000","last_active":"2023-11-30T18:39:37.349079+0000","last_peered":"2023-11-30T18:39:37.349079+0000","last_clean":"2023-11-30T18:39:37.349079+0000","last_became_active":"2023-11-30T18:39:37.344811+0000","last_became_peered":"2023-11-30T18:39:37.344811+0000","last_unstale":"2023-11-30T18:39:37.349079+0000","last_undegraded":"2023-11-30T18:39:37.349079+0000","last_fullsized":"2023-11-30T18:39:37.349079+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"202'3","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349684+0000","last_change":"2023-11-30T18:39:36.954554+0000","last_active":"2023-11-30T18:39:37.349684+0000","last_peered":"2023-11-30T18:39:37.349684+0000","last_clean":"2023-11-30T18:39:37.349684+0000","last_became_active":"2023-11-30T18:39:36.954255+0000","last_became_peered":"2023-11-30T18:39:36.954255+0000","last_unstale":"2023-11-30T18:39:37.349684+0000","last_undegraded":"2023-11-30T18:39:37.349684+0000","last_fullsized":"2023-11-30T18:39:37.349684+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":163,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.330312+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T18:39:37.330312+0000","last_peered":"2023-11-30T18:39:37.330312+0000","last_clean":"2023-11-30T18:39:37.330312+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T18:39:37.330312+0000","last_undegraded":"2023-11-30T18:39:37.330312+0000","last_fullsized":"2023-11-30T18:39:37.330312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352219+0000","last_change":"2023-11-30T18:39:37.351640+0000","last_active":"2023-11-30T18:39:37.352219+0000","last_peered":"2023-11-30T18:39:37.352219+0000","last_clean":"2023-11-30T18:39:37.352219+0000","last_became_active":"2023-11-30T18:39:37.350854+0000","last_became_peered":"2023-11-30T18:39:37.350854+0000","last_unstale":"2023-11-30T18:39:37.352219+0000","last_undegraded":"2023-11-30T18:39:37.352219+0000","last_fullsized":"2023-11-30T18:39:37.352219+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"202'4","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.351107+0000","last_change":"2023-11-30T18:39:36.949816+0000","last_active":"2023-11-30T18:39:37.351107+0000","last_peered":"2023-11-30T18:39:37.351107+0000","last_clean":"2023-11-30T18:39:37.351107+0000","last_became_active":"2023-11-30T18:39:36.949516+0000","last_became_peered":"2023-11-30T18:39:36.949516+0000","last_unstale":"2023-11-30T18:39:37.351107+0000","last_undegraded":"2023-11-30T18:39:37.351107+0000","last_fullsized":"2023-11-30T18:39:37.351107+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":163,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.331043+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T18:39:37.331043+0000","last_peered":"2023-11-30T18:39:37.331043+0000","last_clean":"2023-11-30T18:39:37.331043+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T18:39:37.331043+0000","last_undegraded":"2023-11-30T18:39:37.331043+0000","last_fullsized":"2023-11-30T18:39:37.331043+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-30T18:39:36.921920+0000","last_change":"2023-11-30T18:39:36.921920+0000","last_active":"2023-11-30T18:39:36.921920+0000","last_peered":"2023-11-30T18:39:36.921920+0000","last_clean":"2023-11-30T18:39:36.921920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-30T18:39:36.921920+0000","last_undegraded":"2023-11-30T18:39:36.921920+0000","last_fullsized":"2023-11-30T18:39:36.921920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.13","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347149+0000","last_change":"2023-11-30T18:39:36.954951+0000","last_active":"2023-11-30T18:39:37.347149+0000","last_peered":"2023-11-30T18:39:37.347149+0000","last_clean":"2023-11-30T18:39:37.347149+0000","last_became_active":"2023-11-30T18:39:36.954635+0000","last_became_peered":"2023-11-30T18:39:36.954635+0000","last_unstale":"2023-11-30T18:39:37.347149+0000","last_undegraded":"2023-11-30T18:39:37.347149+0000","last_fullsized":"2023-11-30T18:39:37.347149+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":171,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.329562+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T18:39:37.329562+0000","last_peered":"2023-11-30T18:39:37.329562+0000","last_clean":"2023-11-30T18:39:37.329562+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T18:39:37.329562+0000","last_undegraded":"2023-11-30T18:39:37.329562+0000","last_fullsized":"2023-11-30T18:39:37.329562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347365+0000","last_change":"2023-11-30T18:39:37.343550+0000","last_active":"2023-11-30T18:39:37.347365+0000","last_peered":"2023-11-30T18:39:37.347365+0000","last_clean":"2023-11-30T18:39:37.347365+0000","last_became_active":"2023-11-30T18:39:37.343269+0000","last_became_peered":"2023-11-30T18:39:37.343269+0000","last_unstale":"2023-11-30T18:39:37.347365+0000","last_undegraded":"2023-11-30T18:39:37.347365+0000","last_fullsized":"2023-11-30T18:39:37.347365+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.336520+0000","last_change":"2023-11-30T18:39:36.944024+0000","last_active":"2023-11-30T18:39:37.336520+0000","last_peered":"2023-11-30T18:39:37.336520+0000","last_clean":"2023-11-30T18:39:37.336520+0000","last_became_active":"2023-11-30T18:39:36.943512+0000","last_became_peered":"2023-11-30T18:39:36.943512+0000","last_unstale":"2023-11-30T18:39:37.336520+0000","last_undegraded":"2023-11-30T18:39:37.336520+0000","last_fullsized":"2023-11-30T18:39:37.336520+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":186,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-11-30T18:39:32.616984+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T18:39:32.616984+0000","last_peered":"2023-11-30T18:39:32.616984+0000","last_clean":"2023-11-30T18:39:32.616984+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T18:39:32.616984+0000","last_undegraded":"2023-11-30T18:39:32.616984+0000","last_fullsized":"2023-11-30T18:39:32.616984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":102,"acting":102,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":1414,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":88,"acting":88,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575950,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303676,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068164,"statfs":{"total":96636764160,"available":96325799936,"internally_reserved":0,"allocated":2543616,"data_stored":1304277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.629,"15min":0.626},"min":{"1min":0.39200000000000002,"5min":0.35499999999999998,"15min":0.28699999999999998},"max":{"1min":0.81399999999999995,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.63200000000000001,"15min":0.63500000000000001},"min":{"1min":0.502,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77200000000000002,"5min":0.80600000000000005,"15min":0.82099999999999995},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.42999999999999999,"5min":0.40699999999999997,"15min":0.35899999999999999},"max":{"1min":0.70399999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.41999999999999998,"5min":0.38700000000000001,"15min":0.379},"max":{"1min":0.74399999999999999,"5min":0.877,"15min":0.877},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.44800000000000001,"5min":0.41699999999999998,"15min":0.379},"max":{"1min":0.66700000000000004,"5min":0.80500000000000005,"15min":0.81100000000000005},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58599999999999997,"15min":0.59299999999999997},"min":{"1min":0.47599999999999998,"5min":0.43099999999999999,"15min":0.38700000000000001},"max":{"1min":0.72699999999999998,"5min":0.82599999999999996,"15min":0.85399999999999998},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.40200000000000002,"5min":0.36699999999999999,"15min":0.35899999999999999},"max":{"1min":0.69299999999999995,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.47499999999999998,"5min":0.41899999999999998,"15min":0.41799999999999998},"max":{"1min":0.75600000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46500000000000002,"15min":0.46300000000000002},"min":{"1min":0.36799999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.52600000000000002,"5min":0.81100000000000005,"15min":0.83799999999999997},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.49199999999999999,"15min":0.48999999999999999},"min":{"1min":0.371,"5min":0.308,"15min":0.29099999999999998},"max":{"1min":0.624,"5min":0.67200000000000004,"15min":0.80500000000000005},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.505,"15min":0.5},"min":{"1min":0.36799999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78200000000000003,"5min":0.79100000000000004,"15min":0.83399999999999996},"last":0.374},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35399999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68300000000000005,"5min":0.78600000000000003,"15min":0.88200000000000001},"last":0.35399999999999998}]},{"osd":6,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56899999999999995,"15min":0.56399999999999995},"min":{"1min":0.40200000000000002,"5min":0.36699999999999999,"15min":0.32300000000000001},"max":{"1min":0.68400000000000005,"5min":0.84999999999999998,"15min":0.90800000000000003},"last":0.499},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55700000000000005,"15min":0.55900000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76300000000000001,"5min":0.81200000000000006,"15min":0.85199999999999998},"last":0.41199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575948,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307716,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064124,"statfs":{"total":96636764160,"available":96321662976,"internally_reserved":0,"allocated":2486272,"data_stored":1275712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60499999999999998,"15min":0.61099999999999999},"min":{"1min":0.35399999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.72799999999999998,"5min":0.80700000000000005,"15min":1.6379999999999999},"last":0.437},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.629,"15min":0.625},"min":{"1min":0.49299999999999999,"5min":0.42499999999999999,"15min":0.27800000000000002},"max":{"1min":0.77500000000000002,"5min":0.84899999999999998,"15min":1.246},"last":0.51000000000000001}]},{"osd":1,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.31900000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.76500000000000001,"5min":0.86599999999999999,"15min":1.1200000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.624,"15min":0.63100000000000001},"min":{"1min":0.42199999999999999,"5min":0.41899999999999998,"15min":0.35499999999999998},"max":{"1min":0.753,"5min":0.81599999999999995,"15min":0.90400000000000003},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59799999999999998,"15min":0.59899999999999998},"min":{"1min":0.40699999999999997,"5min":0.40000000000000002,"15min":0.34499999999999997},"max":{"1min":0.71899999999999997,"5min":0.85299999999999998,"15min":1.288},"last":0.502},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61599999999999999,"15min":0.63},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":0.74199999999999999,"5min":0.84599999999999997,"15min":1.177},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55800000000000005,"15min":0.57499999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.33400000000000002},"max":{"1min":0.70599999999999996,"5min":0.79600000000000004,"15min":1.204},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.40200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.67600000000000005,"5min":0.80100000000000005,"15min":1.337},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.443,"15min":0.46800000000000003},"min":{"1min":0.34399999999999997,"5min":0.315,"15min":0.28699999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":1.51},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.49199999999999999},"min":{"1min":0.34999999999999998,"5min":0.32800000000000001,"15min":0.30399999999999999},"max":{"1min":0.69899999999999995,"5min":0.71599999999999997,"15min":0.94299999999999995},"last":0.40600000000000003}]},{"osd":5,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.45700000000000002,"15min":0.47199999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":1.159},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.503,"15min":0.52700000000000002},"min":{"1min":0.42399999999999999,"5min":0.35199999999999998,"15min":0.32500000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":1.679},"last":0.60899999999999999}]},{"osd":7,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52200000000000002,"15min":0.54000000000000004},"min":{"1min":0.36799999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.96199999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55700000000000005,"15min":0.57699999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":1.427},"last":0.52400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575949,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307772,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064068,"statfs":{"total":96636764160,"available":96321605632,"internally_reserved":0,"allocated":2543616,"data_stored":1303475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.377,"15min":0.38},"min":{"1min":0.27500000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.66300000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.50700000000000001,"15min":0.51000000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.35799999999999998},"max":{"1min":0.77400000000000002,"5min":0.87,"15min":0.87},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40699999999999997,"15min":0.41199999999999998},"min":{"1min":0.28699999999999998,"5min":0.26700000000000002,"15min":0.26200000000000001},"max":{"1min":0.64700000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.40100000000000002,"5min":0.372,"15min":0.37},"max":{"1min":0.80300000000000005,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.48099999999999998,"15min":0.47799999999999998},"min":{"1min":0.33800000000000002,"5min":0.33500000000000002,"15min":0.318},"max":{"1min":0.72899999999999998,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45500000000000002,"15min":0.46000000000000002},"min":{"1min":0.33400000000000002,"5min":0.313,"15min":0.311},"max":{"1min":0.71399999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.28799999999999998}]},{"osd":4,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.59899999999999998,"15min":0.61899999999999999},"min":{"1min":0.41099999999999998,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.93999999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66800000000000004,"15min":0.67000000000000004},"min":{"1min":0.50600000000000001,"5min":0.49199999999999999,"15min":0.42299999999999999},"max":{"1min":1.0329999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.62,"15min":0.63300000000000001},"min":{"1min":0.48899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63900000000000001,"15min":0.64600000000000002},"min":{"1min":0.47799999999999998,"5min":0.45000000000000001,"15min":0.39200000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.98099999999999998},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70299999999999996,"15min":0.70499999999999996},"min":{"1min":0.51100000000000001,"5min":0.498,"15min":0.443},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.68000000000000005,"15min":0.69199999999999995},"min":{"1min":0.51400000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.86299999999999999,"5min":1.004,"15min":1.0169999999999999},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69599999999999995,"15min":0.71199999999999997},"min":{"1min":0.51400000000000001,"5min":0.48999999999999999,"15min":0.46100000000000002},"max":{"1min":0.91000000000000003,"5min":0.97499999999999998,"15min":1.012},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68600000000000005,"15min":0.69699999999999995},"min":{"1min":0.57499999999999996,"5min":0.51800000000000002,"15min":0.47699999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.02},"last":0.64300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575949,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307768,"kb_used_data":2480,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064072,"statfs":{"total":96636764160,"available":96321609728,"internally_reserved":0,"allocated":2539520,"data_stored":1302865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.38800000000000001,"15min":0.39500000000000002},"min":{"1min":0.252,"5min":0.25,"15min":0.22900000000000001},"max":{"1min":0.50900000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.439,"5min":0.42099999999999999,"15min":0.42199999999999999},"min":{"1min":0.33500000000000002,"5min":0.27300000000000002,"15min":0.252},"max":{"1min":0.58299999999999996,"5min":0.65100000000000002,"15min":0.71399999999999997},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41199999999999998,"15min":0.41699999999999998},"min":{"1min":0.33000000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.55100000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.49099999999999999,"15min":0.5},"min":{"1min":0.40600000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.74199999999999999},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.45800000000000002,"15min":0.46200000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64400000000000002,"5min":0.69899999999999995,"15min":0.71799999999999997},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46500000000000002,"15min":0.47499999999999998},"min":{"1min":0.36599999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.60399999999999998,"5min":0.68000000000000005,"15min":0.70599999999999996},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63,"15min":0.64100000000000001},"min":{"1min":0.55900000000000005,"5min":0.40200000000000002,"15min":0.39900000000000002},"max":{"1min":0.79700000000000004,"5min":0.90600000000000003,"15min":1.0549999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.65800000000000003},"min":{"1min":0.55900000000000005,"5min":0.45100000000000001,"15min":0.442},"max":{"1min":0.77900000000000003,"5min":1.026,"15min":1.163},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.626,"15min":0.64100000000000001},"min":{"1min":0.50600000000000001,"5min":0.443,"15min":0.40400000000000003},"max":{"1min":0.78700000000000003,"5min":0.91600000000000004,"15min":1.0649999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.66800000000000004,"15min":0.67200000000000004},"min":{"1min":0.52400000000000002,"5min":0.47199999999999998,"15min":0.439},"max":{"1min":0.84799999999999998,"5min":0.998,"15min":1.1799999999999999},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.67700000000000005,"15min":0.68700000000000006},"min":{"1min":0.55100000000000005,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.873,"5min":0.94199999999999995,"15min":1.079},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66900000000000004,"15min":0.68300000000000005},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.41499999999999998},"max":{"1min":0.86099999999999999,"5min":1.0129999999999999,"15min":1.147},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69799999999999995,"15min":0.70599999999999996},"min":{"1min":0.55900000000000005,"5min":0.49199999999999999,"15min":0.47399999999999998},"max":{"1min":0.88700000000000001,"5min":1.0469999999999999,"15min":1.22},"last":0.875},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72099999999999997,"15min":0.73399999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.81799999999999995,"5min":1.0640000000000001,"15min":1.117},"last":0.92800000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575949,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311864,"kb_used_data":2480,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059976,"statfs":{"total":96636764160,"available":96317415424,"internally_reserved":0,"allocated":2539520,"data_stored":1302901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.41999999999999998,"15min":0.41199999999999998},"min":{"1min":0.30099999999999999,"5min":0.249,"15min":0.23200000000000001},"max":{"1min":0.60399999999999998,"5min":0.64800000000000002,"15min":0.72099999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45700000000000002,"15min":0.46000000000000002},"min":{"1min":0.32600000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.58599999999999997,"5min":0.65000000000000002,"15min":0.73199999999999998},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45800000000000002,"15min":0.46100000000000002},"min":{"1min":0.34300000000000003,"5min":0.33100000000000002,"15min":0.29699999999999999},"max":{"1min":0.63900000000000001,"5min":0.70599999999999996,"15min":0.74299999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.496,"15min":0.49399999999999999},"min":{"1min":0.40899999999999997,"5min":0.35599999999999998,"15min":0.29899999999999999},"max":{"1min":0.66100000000000003,"5min":0.746,"15min":0.752},"last":0.379}]},{"osd":3,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.42799999999999999,"15min":0.42299999999999999},"min":{"1min":0.315,"5min":0.28399999999999997,"15min":0.27300000000000002},"max":{"1min":0.55000000000000004,"5min":0.61399999999999999,"15min":0.65100000000000002},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.503,"15min":0.499},"min":{"1min":0.433,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.69099999999999995,"5min":0.75900000000000001,"15min":0.77100000000000002},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.52100000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.95299999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63200000000000001,"15min":0.63900000000000001},"min":{"1min":0.46000000000000002,"5min":0.42799999999999999,"15min":0.35499999999999998},"max":{"1min":0.90500000000000003,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65400000000000003,"15min":0.66400000000000003},"min":{"1min":0.51200000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.84099999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.47199999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.91700000000000004,"5min":1.01,"15min":1.01},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64900000000000002,"15min":0.65200000000000002},"min":{"1min":0.52100000000000002,"5min":0.443,"15min":0.40500000000000003},"max":{"1min":0.86699999999999999,"5min":0.93000000000000005,"15min":0.93200000000000005},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.69399999999999995,"15min":0.69699999999999995},"min":{"1min":0.54300000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93999999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69099999999999995,"15min":0.69499999999999995},"min":{"1min":0.53500000000000003,"5min":0.47499999999999998,"15min":0.47299999999999998},"max":{"1min":0.95399999999999996,"5min":0.97799999999999998,"15min":1.0109999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71099999999999997,"15min":0.71799999999999997},"min":{"1min":0.55700000000000005,"5min":0.44,"15min":0.44},"max":{"1min":0.95199999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.70799999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575949,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299712,"kb_used_data":2488,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072128,"statfs":{"total":96636764160,"available":96329859072,"internally_reserved":0,"allocated":2547712,"data_stored":1303497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.373,"15min":0.38},"min":{"1min":0.29499999999999998,"5min":0.222,"15min":0.222},"max":{"1min":0.59099999999999997,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.42699999999999999,"15min":0.42499999999999999},"min":{"1min":0.31,"5min":0.28699999999999998,"15min":0.28199999999999997},"max":{"1min":0.63700000000000001,"5min":0.70299999999999996,"15min":0.754},"last":0.504}]},{"osd":1,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40000000000000002,"15min":0.40400000000000003},"min":{"1min":0.29899999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58099999999999996,"5min":0.66500000000000004,"15min":0.73399999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44500000000000001,"15min":0.45300000000000001},"min":{"1min":0.315,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.51800000000000002,"5min":0.67700000000000005,"15min":0.86699999999999999},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.47299999999999998,"15min":0.47699999999999998},"min":{"1min":0.39000000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.59899999999999998,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51400000000000001,"15min":0.52400000000000002},"min":{"1min":0.40899999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.65600000000000003,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.63}]},{"osd":4,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63200000000000001,"15min":0.64100000000000001},"min":{"1min":0.51100000000000001,"5min":0.40200000000000002,"15min":0.35299999999999998},"max":{"1min":0.84799999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.64000000000000001,"15min":0.65100000000000002},"min":{"1min":0.40400000000000003,"5min":0.40300000000000002,"15min":0.40100000000000002},"max":{"1min":0.77400000000000002,"5min":0.97799999999999998,"15min":1.0049999999999999},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63600000000000001,"15min":0.64600000000000002},"min":{"1min":0.52000000000000002,"5min":0.44600000000000001,"15min":0.40699999999999997},"max":{"1min":0.89400000000000002,"5min":1.04,"15min":1.04},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65500000000000003,"15min":0.66800000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.34499999999999997},"max":{"1min":0.82999999999999996,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.79200000000000004}]},{"osd":6,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67200000000000004,"15min":0.68400000000000005},"min":{"1min":0.499,"5min":0.45000000000000001,"15min":0.377},"max":{"1min":0.88800000000000001,"5min":1.0189999999999999,"15min":1.0309999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66300000000000003,"15min":0.68500000000000005},"min":{"1min":0.48199999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92900000000000005,"5min":0.99399999999999999,"15min":1.0129999999999999},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68300000000000005,"15min":0.70399999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.872,"5min":1.0009999999999999,"15min":1.052},"last":0.747},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68300000000000005,"15min":0.70499999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.81299999999999994,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.80500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575949,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303680,"kb_used_data":2488,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068160,"statfs":{"total":96636764160,"available":96325795840,"internally_reserved":0,"allocated":2547712,"data_stored":1303013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53900000000000003,"15min":0.56200000000000006},"min":{"1min":0.36199999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72999999999999998,"5min":0.79400000000000004,"15min":0.85499999999999998},"last":0.316},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.374,"5min":0.34100000000000003,"15min":0.32500000000000001},"max":{"1min":0.76800000000000002,"5min":0.79300000000000004,"15min":0.94999999999999996},"last":0.436}]},{"osd":1,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56899999999999995,"15min":0.57299999999999995},"min":{"1min":0.41799999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.72199999999999998,"5min":0.86599999999999999,"15min":0.876},"last":0.371},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.67400000000000004,"5min":0.79300000000000004,"15min":0.91200000000000003},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.60599999999999998},"min":{"1min":0.438,"5min":0.36299999999999999,"15min":0.34999999999999998},"max":{"1min":0.72199999999999998,"5min":0.88400000000000001,"15min":0.93799999999999994},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.60599999999999998,"15min":0.625},"min":{"1min":0.40000000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68999999999999995,"5min":0.90800000000000003,"15min":0.94399999999999995},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.433,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":0.68899999999999995,"5min":0.83199999999999996,"15min":0.84999999999999998},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57699999999999996,"15min":0.59899999999999998},"min":{"1min":0.45600000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.67500000000000004,"5min":0.80800000000000005,"15min":0.872},"last":0.498}]},{"osd":5,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.42299999999999999,"15min":0.44800000000000001},"min":{"1min":0.309,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.53400000000000003,"5min":0.66900000000000004,"15min":0.86399999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.44900000000000001,"15min":0.46899999999999997},"min":{"1min":0.32300000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.63200000000000001,"5min":0.64900000000000002,"15min":0.82299999999999995},"last":0.49199999999999999}]},{"osd":6,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47399999999999998,"15min":0.51300000000000001},"min":{"1min":0.35699999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66100000000000003,"5min":0.79200000000000004,"15min":1.1399999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.52800000000000002,"15min":0.56299999999999994},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.67200000000000004,"5min":0.76700000000000002,"15min":1.1220000000000001},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.47999999999999998,"15min":0.52500000000000002},"min":{"1min":0.308,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58199999999999996,"5min":0.80100000000000005,"15min":0.90000000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55400000000000005,"15min":0.58199999999999996},"min":{"1min":0.44400000000000001,"5min":0.38100000000000001,"15min":0.35599999999999998},"max":{"1min":0.622,"5min":0.81599999999999995,"15min":0.86199999999999999},"last":0.56599999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575948,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307716,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064124,"statfs":{"total":96636764160,"available":96321662976,"internally_reserved":0,"allocated":2486272,"data_stored":1275712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56799999999999995,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.35799999999999998,"15min":0.29799999999999999},"max":{"1min":0.76600000000000001,"5min":0.79800000000000004,"15min":0.80800000000000005},"last":0.317},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.54300000000000004,"15min":0.55300000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.66800000000000004,"5min":0.80700000000000005,"15min":0.90300000000000002},"last":0.36199999999999999}]},{"osd":1,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54000000000000004,"15min":0.54300000000000004},"min":{"1min":0.41099999999999998,"5min":0.36899999999999999,"15min":0.32200000000000001},"max":{"1min":0.72599999999999998,"5min":0.75600000000000001,"15min":0.83699999999999997},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57699999999999996,"15min":0.57999999999999996},"min":{"1min":0.42499999999999999,"5min":0.38600000000000001,"15min":0.32400000000000001},"max":{"1min":0.72999999999999998,"5min":0.76500000000000001,"15min":0.82899999999999996},"last":0.307}]},{"osd":2,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60999999999999999,"15min":0.61399999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.36399999999999999},"max":{"1min":0.76300000000000001,"5min":0.78700000000000003,"15min":0.99199999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.62,"15min":0.62},"min":{"1min":0.47199999999999998,"5min":0.44800000000000001,"15min":0.42499999999999999},"max":{"1min":0.78400000000000003,"5min":0.79600000000000004,"15min":1.173},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.373},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.79300000000000004},"last":0.373},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.439,"5min":0.40500000000000003,"15min":0.35399999999999998},"max":{"1min":0.72699999999999998,"5min":0.84199999999999997,"15min":1.603},"last":0.32700000000000001}]},{"osd":4,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.45400000000000001,"15min":0.45200000000000001},"min":{"1min":0.35799999999999998,"5min":0.315,"15min":0.28000000000000003},"max":{"1min":0.63800000000000001,"5min":0.70299999999999996,"15min":0.75},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.48999999999999999,"15min":0.48299999999999998},"min":{"1min":0.39100000000000001,"5min":0.32000000000000001,"15min":0.314},"max":{"1min":0.67300000000000004,"5min":0.77900000000000003,"15min":0.81200000000000006},"last":0.248}]},{"osd":6,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51600000000000001,"15min":0.505},"min":{"1min":0.38400000000000001,"5min":0.33600000000000002,"15min":0.31900000000000001},"max":{"1min":0.75900000000000001,"5min":0.76700000000000002,"15min":1.105},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57699999999999996,"15min":0.57199999999999995},"min":{"1min":0.48699999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.751,"5min":0.79600000000000004,"15min":1.228},"last":0.40500000000000003}]},{"osd":7,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55000000000000004,"15min":0.54000000000000004},"min":{"1min":0.442,"5min":0.36799999999999999,"15min":0.34399999999999997},"max":{"1min":0.69299999999999995,"5min":0.80900000000000005,"15min":0.88100000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.60199999999999998,"15min":0.59599999999999997},"min":{"1min":0.47399999999999998,"5min":0.33400000000000002,"15min":0.317},"max":{"1min":0.79400000000000004,"5min":0.82499999999999996,"15min":1.0640000000000001},"last":0.41099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T18:39:42.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.31 is not active+clean 2023-11-30T18:39:42.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:36.921920+0000', 'last_change': '2023-11-30T18:39:36.921920+0000', 'last_active': '2023-11-30T18:39:36.921920+0000', 'last_peered': '2023-11-30T18:39:36.921920+0000', 'last_clean': '2023-11-30T18:39:36.921920+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:36.921920+0000', 'last_undegraded': '2023-11-30T18:39:36.921920+0000', 'last_fullsized': '2023-11-30T18:39:36.921920+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3e is not active+clean 2023-11-30T18:39:42.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:35.919960+0000', 'last_change': '2023-11-30T18:39:35.919960+0000', 'last_active': '2023-11-30T18:39:35.919960+0000', 'last_peered': '2023-11-30T18:39:35.919960+0000', 'last_clean': '2023-11-30T18:39:35.919960+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:35.919960+0000', 'last_undegraded': '2023-11-30T18:39:35.919960+0000', 'last_fullsized': '2023-11-30T18:39:35.919960+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3d is not active+clean 2023-11-30T18:39:42.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:35.919960+0000', 'last_change': '2023-11-30T18:39:35.919960+0000', 'last_active': '2023-11-30T18:39:35.919960+0000', 'last_peered': '2023-11-30T18:39:35.919960+0000', 'last_clean': '2023-11-30T18:39:35.919960+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:35.919960+0000', 'last_undegraded': '2023-11-30T18:39:35.919960+0000', 'last_fullsized': '2023-11-30T18:39:35.919960+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3b is not active+clean 2023-11-30T18:39:42.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:35.919960+0000', 'last_change': '2023-11-30T18:39:35.919960+0000', 'last_active': '2023-11-30T18:39:35.919960+0000', 'last_peered': '2023-11-30T18:39:35.919960+0000', 'last_clean': '2023-11-30T18:39:35.919960+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:35.919960+0000', 'last_undegraded': '2023-11-30T18:39:35.919960+0000', 'last_fullsized': '2023-11-30T18:39:35.919960+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.35 is not active+clean 2023-11-30T18:39:42.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:36.921920+0000', 'last_change': '2023-11-30T18:39:36.921920+0000', 'last_active': '2023-11-30T18:39:36.921920+0000', 'last_peered': '2023-11-30T18:39:36.921920+0000', 'last_clean': '2023-11-30T18:39:36.921920+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:36.921920+0000', 'last_undegraded': '2023-11-30T18:39:36.921920+0000', 'last_fullsized': '2023-11-30T18:39:36.921920+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.38 is not active+clean 2023-11-30T18:39:42.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:35.919960+0000', 'last_change': '2023-11-30T18:39:35.919960+0000', 'last_active': '2023-11-30T18:39:35.919960+0000', 'last_peered': '2023-11-30T18:39:35.919960+0000', 'last_clean': '2023-11-30T18:39:35.919960+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:35.919960+0000', 'last_undegraded': '2023-11-30T18:39:35.919960+0000', 'last_fullsized': '2023-11-30T18:39:35.919960+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.37 is not active+clean 2023-11-30T18:39:42.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:35.919960+0000', 'last_change': '2023-11-30T18:39:35.919960+0000', 'last_active': '2023-11-30T18:39:35.919960+0000', 'last_peered': '2023-11-30T18:39:35.919960+0000', 'last_clean': '2023-11-30T18:39:35.919960+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:35.919960+0000', 'last_undegraded': '2023-11-30T18:39:35.919960+0000', 'last_fullsized': '2023-11-30T18:39:35.919960+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.36 is not active+clean 2023-11-30T18:39:42.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:35.919960+0000', 'last_change': '2023-11-30T18:39:35.919960+0000', 'last_active': '2023-11-30T18:39:35.919960+0000', 'last_peered': '2023-11-30T18:39:35.919960+0000', 'last_clean': '2023-11-30T18:39:35.919960+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:35.919960+0000', 'last_undegraded': '2023-11-30T18:39:35.919960+0000', 'last_fullsized': '2023-11-30T18:39:35.919960+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.35 is not active+clean 2023-11-30T18:39:42.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:35.919960+0000', 'last_change': '2023-11-30T18:39:35.919960+0000', 'last_active': '2023-11-30T18:39:35.919960+0000', 'last_peered': '2023-11-30T18:39:35.919960+0000', 'last_clean': '2023-11-30T18:39:35.919960+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:35.919960+0000', 'last_undegraded': '2023-11-30T18:39:35.919960+0000', 'last_fullsized': '2023-11-30T18:39:35.919960+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.34 is not active+clean 2023-11-30T18:39:42.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:35.919960+0000', 'last_change': '2023-11-30T18:39:35.919960+0000', 'last_active': '2023-11-30T18:39:35.919960+0000', 'last_peered': '2023-11-30T18:39:35.919960+0000', 'last_clean': '2023-11-30T18:39:35.919960+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:35.919960+0000', 'last_undegraded': '2023-11-30T18:39:35.919960+0000', 'last_fullsized': '2023-11-30T18:39:35.919960+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.33 is not active+clean 2023-11-30T18:39:42.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:35.919960+0000', 'last_change': '2023-11-30T18:39:35.919960+0000', 'last_active': '2023-11-30T18:39:35.919960+0000', 'last_peered': '2023-11-30T18:39:35.919960+0000', 'last_clean': '2023-11-30T18:39:35.919960+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:35.919960+0000', 'last_undegraded': '2023-11-30T18:39:35.919960+0000', 'last_fullsized': '2023-11-30T18:39:35.919960+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.32 is not active+clean 2023-11-30T18:39:42.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:35.919960+0000', 'last_change': '2023-11-30T18:39:35.919960+0000', 'last_active': '2023-11-30T18:39:35.919960+0000', 'last_peered': '2023-11-30T18:39:35.919960+0000', 'last_clean': '2023-11-30T18:39:35.919960+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:35.919960+0000', 'last_undegraded': '2023-11-30T18:39:35.919960+0000', 'last_fullsized': '2023-11-30T18:39:35.919960+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.20 is not active+clean 2023-11-30T18:39:42.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:36.921920+0000', 'last_change': '2023-11-30T18:39:36.921920+0000', 'last_active': '2023-11-30T18:39:36.921920+0000', 'last_peered': '2023-11-30T18:39:36.921920+0000', 'last_clean': '2023-11-30T18:39:36.921920+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:36.921920+0000', 'last_undegraded': '2023-11-30T18:39:36.921920+0000', 'last_fullsized': '2023-11-30T18:39:36.921920+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.21 is not active+clean 2023-11-30T18:39:42.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:36.921920+0000', 'last_change': '2023-11-30T18:39:36.921920+0000', 'last_active': '2023-11-30T18:39:36.921920+0000', 'last_peered': '2023-11-30T18:39:36.921920+0000', 'last_clean': '2023-11-30T18:39:36.921920+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:36.921920+0000', 'last_undegraded': '2023-11-30T18:39:36.921920+0000', 'last_fullsized': '2023-11-30T18:39:36.921920+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.22 is not active+clean 2023-11-30T18:39:42.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:36.921920+0000', 'last_change': '2023-11-30T18:39:36.921920+0000', 'last_active': '2023-11-30T18:39:36.921920+0000', 'last_peered': '2023-11-30T18:39:36.921920+0000', 'last_clean': '2023-11-30T18:39:36.921920+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:36.921920+0000', 'last_undegraded': '2023-11-30T18:39:36.921920+0000', 'last_fullsized': '2023-11-30T18:39:36.921920+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2c is not active+clean 2023-11-30T18:39:42.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:35.919960+0000', 'last_change': '2023-11-30T18:39:35.919960+0000', 'last_active': '2023-11-30T18:39:35.919960+0000', 'last_peered': '2023-11-30T18:39:35.919960+0000', 'last_clean': '2023-11-30T18:39:35.919960+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:35.919960+0000', 'last_undegraded': '2023-11-30T18:39:35.919960+0000', 'last_fullsized': '2023-11-30T18:39:35.919960+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2a is not active+clean 2023-11-30T18:39:42.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:35.919960+0000', 'last_change': '2023-11-30T18:39:35.919960+0000', 'last_active': '2023-11-30T18:39:35.919960+0000', 'last_peered': '2023-11-30T18:39:35.919960+0000', 'last_clean': '2023-11-30T18:39:35.919960+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:35.919960+0000', 'last_undegraded': '2023-11-30T18:39:35.919960+0000', 'last_fullsized': '2023-11-30T18:39:35.919960+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.28 is not active+clean 2023-11-30T18:39:42.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:35.919960+0000', 'last_change': '2023-11-30T18:39:35.919960+0000', 'last_active': '2023-11-30T18:39:35.919960+0000', 'last_peered': '2023-11-30T18:39:35.919960+0000', 'last_clean': '2023-11-30T18:39:35.919960+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:35.919960+0000', 'last_undegraded': '2023-11-30T18:39:35.919960+0000', 'last_fullsized': '2023-11-30T18:39:35.919960+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.27 is not active+clean 2023-11-30T18:39:42.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:35.919960+0000', 'last_change': '2023-11-30T18:39:35.919960+0000', 'last_active': '2023-11-30T18:39:35.919960+0000', 'last_peered': '2023-11-30T18:39:35.919960+0000', 'last_clean': '2023-11-30T18:39:35.919960+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:35.919960+0000', 'last_undegraded': '2023-11-30T18:39:35.919960+0000', 'last_fullsized': '2023-11-30T18:39:35.919960+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.25 is not active+clean 2023-11-30T18:39:42.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:35.919960+0000', 'last_change': '2023-11-30T18:39:35.919960+0000', 'last_active': '2023-11-30T18:39:35.919960+0000', 'last_peered': '2023-11-30T18:39:35.919960+0000', 'last_clean': '2023-11-30T18:39:35.919960+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:35.919960+0000', 'last_undegraded': '2023-11-30T18:39:35.919960+0000', 'last_fullsized': '2023-11-30T18:39:35.919960+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.23 is not active+clean 2023-11-30T18:39:42.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:35.919960+0000', 'last_change': '2023-11-30T18:39:35.919960+0000', 'last_active': '2023-11-30T18:39:35.919960+0000', 'last_peered': '2023-11-30T18:39:35.919960+0000', 'last_clean': '2023-11-30T18:39:35.919960+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:35.919960+0000', 'last_undegraded': '2023-11-30T18:39:35.919960+0000', 'last_fullsized': '2023-11-30T18:39:35.919960+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2d is not active+clean 2023-11-30T18:39:42.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:36.921920+0000', 'last_change': '2023-11-30T18:39:36.921920+0000', 'last_active': '2023-11-30T18:39:36.921920+0000', 'last_peered': '2023-11-30T18:39:36.921920+0000', 'last_clean': '2023-11-30T18:39:36.921920+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:36.921920+0000', 'last_undegraded': '2023-11-30T18:39:36.921920+0000', 'last_fullsized': '2023-11-30T18:39:36.921920+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2e is not active+clean 2023-11-30T18:39:42.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:36.921920+0000', 'last_change': '2023-11-30T18:39:36.921920+0000', 'last_active': '2023-11-30T18:39:36.921920+0000', 'last_peered': '2023-11-30T18:39:36.921920+0000', 'last_clean': '2023-11-30T18:39:36.921920+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:36.921920+0000', 'last_undegraded': '2023-11-30T18:39:36.921920+0000', 'last_fullsized': '2023-11-30T18:39:36.921920+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1d is not active+clean 2023-11-30T18:39:42.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:35.919960+0000', 'last_change': '2023-11-30T18:39:35.919960+0000', 'last_active': '2023-11-30T18:39:35.919960+0000', 'last_peered': '2023-11-30T18:39:35.919960+0000', 'last_clean': '2023-11-30T18:39:35.919960+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:35.919960+0000', 'last_undegraded': '2023-11-30T18:39:35.919960+0000', 'last_fullsized': '2023-11-30T18:39:35.919960+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1 is not active+clean 2023-11-30T18:39:42.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:36.921920+0000', 'last_change': '2023-11-30T18:39:36.921920+0000', 'last_active': '2023-11-30T18:39:36.921920+0000', 'last_peered': '2023-11-30T18:39:36.921920+0000', 'last_clean': '2023-11-30T18:39:36.921920+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:36.921920+0000', 'last_undegraded': '2023-11-30T18:39:36.921920+0000', 'last_fullsized': '2023-11-30T18:39:36.921920+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2 is not active+clean 2023-11-30T18:39:42.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:36.921920+0000', 'last_change': '2023-11-30T18:39:36.921920+0000', 'last_active': '2023-11-30T18:39:36.921920+0000', 'last_peered': '2023-11-30T18:39:36.921920+0000', 'last_clean': '2023-11-30T18:39:36.921920+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:36.921920+0000', 'last_undegraded': '2023-11-30T18:39:36.921920+0000', 'last_fullsized': '2023-11-30T18:39:36.921920+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3 is not active+clean 2023-11-30T18:39:42.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:36.921920+0000', 'last_change': '2023-11-30T18:39:36.921920+0000', 'last_active': '2023-11-30T18:39:36.921920+0000', 'last_peered': '2023-11-30T18:39:36.921920+0000', 'last_clean': '2023-11-30T18:39:36.921920+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:36.921920+0000', 'last_undegraded': '2023-11-30T18:39:36.921920+0000', 'last_fullsized': '2023-11-30T18:39:36.921920+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.a is not active+clean 2023-11-30T18:39:42.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:35.919960+0000', 'last_change': '2023-11-30T18:39:35.919960+0000', 'last_active': '2023-11-30T18:39:35.919960+0000', 'last_peered': '2023-11-30T18:39:35.919960+0000', 'last_clean': '2023-11-30T18:39:35.919960+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:35.919960+0000', 'last_undegraded': '2023-11-30T18:39:35.919960+0000', 'last_fullsized': '2023-11-30T18:39:35.919960+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.8 is not active+clean 2023-11-30T18:39:42.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:36.921920+0000', 'last_change': '2023-11-30T18:39:36.921920+0000', 'last_active': '2023-11-30T18:39:36.921920+0000', 'last_peered': '2023-11-30T18:39:36.921920+0000', 'last_clean': '2023-11-30T18:39:36.921920+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:36.921920+0000', 'last_undegraded': '2023-11-30T18:39:36.921920+0000', 'last_fullsized': '2023-11-30T18:39:36.921920+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1 is not active+clean 2023-11-30T18:39:42.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:35.919960+0000', 'last_change': '2023-11-30T18:39:35.919960+0000', 'last_active': '2023-11-30T18:39:35.919960+0000', 'last_peered': '2023-11-30T18:39:35.919960+0000', 'last_clean': '2023-11-30T18:39:35.919960+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:35.919960+0000', 'last_undegraded': '2023-11-30T18:39:35.919960+0000', 'last_fullsized': '2023-11-30T18:39:35.919960+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1e is not active+clean 2023-11-30T18:39:42.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:36.921920+0000', 'last_change': '2023-11-30T18:39:36.921920+0000', 'last_active': '2023-11-30T18:39:36.921920+0000', 'last_peered': '2023-11-30T18:39:36.921920+0000', 'last_clean': '2023-11-30T18:39:36.921920+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:36.921920+0000', 'last_undegraded': '2023-11-30T18:39:36.921920+0000', 'last_fullsized': '2023-11-30T18:39:36.921920+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.11 is not active+clean 2023-11-30T18:39:42.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:35.919960+0000', 'last_change': '2023-11-30T18:39:35.919960+0000', 'last_active': '2023-11-30T18:39:35.919960+0000', 'last_peered': '2023-11-30T18:39:35.919960+0000', 'last_clean': '2023-11-30T18:39:35.919960+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:35.919960+0000', 'last_undegraded': '2023-11-30T18:39:35.919960+0000', 'last_fullsized': '2023-11-30T18:39:35.919960+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:35.919960+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1c is not active+clean 2023-11-30T18:39:42.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-30T18:39:36.921920+0000', 'last_change': '2023-11-30T18:39:36.921920+0000', 'last_active': '2023-11-30T18:39:36.921920+0000', 'last_peered': '2023-11-30T18:39:36.921920+0000', 'last_clean': '2023-11-30T18:39:36.921920+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-30T18:39:36.921920+0000', 'last_undegraded': '2023-11-30T18:39:36.921920+0000', 'last_fullsized': '2023-11-30T18:39:36.921920+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'last_clean_scrub_stamp': '2023-11-30T18:39:36.921920+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-30T18:39:42.102 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-30T18:39:42.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.239+0000 7fe5fbf14700 1 Processor -- start 2023-11-30T18:39:42.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.240+0000 7fe5fbf14700 1 -- start start 2023-11-30T18:39:42.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.240+0000 7fe5fbf14700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5f40cae90 0x7fe5f40c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:42.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.240+0000 7fe5fbf14700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe5f40ca180 0x7fe5f40c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:42.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.240+0000 7fe5fbf14700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f40a9a90 con 0x7fe5f40caab0 2023-11-30T18:39:42.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.240+0000 7fe5fbf14700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f40c1490 con 0x7fe5f40ca180 2023-11-30T18:39:42.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.240+0000 7fe5fbf14700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f4154ce0 con 0x7fe5f40cae90 2023-11-30T18:39:42.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.241+0000 7fe5fa4b1700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe5f40ca180 0x7fe5f40c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:42.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.241+0000 7fe5f94af700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5f40cae90 0x7fe5f40c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:42.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.241+0000 7fe5f9cb0700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fe5f40caab0 0x7fe5f40aa470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:46912/0 (socket says 172.21.15.49:46912) 2023-11-30T18:39:42.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.241+0000 7fe5f9cb0700 1 -- 172.21.15.49:0/748605025 learned_addr learned my addr 172.21.15.49:0/748605025 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:42.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.241+0000 7fe5fa4b1700 1 -- 172.21.15.49:0/748605025 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5f40cae90 msgr2=0x7fe5f40c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:42.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.241+0000 7fe5fa4b1700 1 --2- 172.21.15.49:0/748605025 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5f40cae90 0x7fe5f40c0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:42.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.241+0000 7fe5fa4b1700 1 -- 172.21.15.49:0/748605025 >> v1:172.21.15.115:6789/0 conn(0x7fe5f40caab0 legacy=0x7fe5f40aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:42.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.241+0000 7fe5f8cae700 1 -- 172.21.15.49:0/748605025 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 93681731 0 0) 0x7fe5f40a9a90 con 0x7fe5f40caab0 2023-11-30T18:39:42.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.241+0000 7fe5fa4b1700 1 -- 172.21.15.49:0/748605025 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f40aab80 con 0x7fe5f40ca180 2023-11-30T18:39:42.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.241+0000 7fe5fa4b1700 1 --2- 172.21.15.49:0/748605025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5f40ca180 0x7fe5f40c0fa0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7fe5e4009760 tx=0x7fe5e4009060).ready entity=mon.1 client_cookie=78e28263da34a126 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:42.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.242+0000 7fe5f8cae700 1 -- 172.21.15.49:0/748605025 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e400f510 con 0x7fe5f40ca180 2023-11-30T18:39:42.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.242+0000 7fe5f8cae700 1 -- 172.21.15.49:0/748605025 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e400f670 con 0x7fe5f40ca180 2023-11-30T18:39:42.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.242+0000 7fe5f8cae700 1 -- 172.21.15.49:0/748605025 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e400f9f0 con 0x7fe5f40ca180 2023-11-30T18:39:42.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.242+0000 7fe5fbf14700 1 -- 172.21.15.49:0/748605025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5f40ca180 msgr2=0x7fe5f40c0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:42.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.242+0000 7fe5fbf14700 1 --2- 172.21.15.49:0/748605025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5f40ca180 0x7fe5f40c0fa0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7fe5e4009760 tx=0x7fe5e4009060).stop 2023-11-30T18:39:42.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.242+0000 7fe5fbf14700 1 -- 172.21.15.49:0/748605025 shutdown_connections 2023-11-30T18:39:42.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.242+0000 7fe5fbf14700 1 --2- 172.21.15.49:0/748605025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5f40ca180 0x7fe5f40c0fa0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:42.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.242+0000 7fe5fbf14700 1 --2- 172.21.15.49:0/748605025 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5f40cae90 0x7fe5f40c0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:42.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.242+0000 7fe5fbf14700 1 -- 172.21.15.49:0/748605025 >> 172.21.15.49:0/748605025 conn(0x7fe5f4094920 msgr2=0x7fe5f406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:42.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.242+0000 7fe5fbf14700 1 -- 172.21.15.49:0/748605025 shutdown_connections 2023-11-30T18:39:42.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.242+0000 7fe5fbf14700 1 -- 172.21.15.49:0/748605025 wait complete. 2023-11-30T18:39:42.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.243+0000 7fe5fbf14700 1 Processor -- start 2023-11-30T18:39:42.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.243+0000 7fe5fbf14700 1 -- start start 2023-11-30T18:39:42.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.244+0000 7fe5fbf14700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5f40ca180 0x7fe5f41500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:42.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.244+0000 7fe5fbf14700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5f40caab0 0x7fe5f4155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:42.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.244+0000 7fe5fbf14700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5f40cae90 0x7fe5f4155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:42.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.244+0000 7fe5fbf14700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f40ab1d0 con 0x7fe5f40cae90 2023-11-30T18:39:42.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.244+0000 7fe5fbf14700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f4156360 con 0x7fe5f40caab0 2023-11-30T18:39:42.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.244+0000 7fe5fbf14700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f4156640 con 0x7fe5f40ca180 2023-11-30T18:39:42.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.244+0000 7fe5fa4b1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5f40cae90 0x7fe5f4155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:42.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.244+0000 7fe5fa4b1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5f40cae90 0x7fe5f4155d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59826/0 (socket says 172.21.15.49:59826) 2023-11-30T18:39:42.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.244+0000 7fe5fa4b1700 1 -- 172.21.15.49:0/3293104751 learned_addr learned my addr 172.21.15.49:0/3293104751 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:42.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.244+0000 7fe5f9cb0700 1 --2- 172.21.15.49:0/3293104751 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5f40ca180 0x7fe5f41500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:42.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.244+0000 7fe5f94af700 1 --2- 172.21.15.49:0/3293104751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5f40caab0 0x7fe5f4155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:42.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.244+0000 7fe5fa4b1700 1 -- 172.21.15.49:0/3293104751 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5f40ca180 msgr2=0x7fe5f41500c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:42.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.244+0000 7fe5fa4b1700 1 --2- 172.21.15.49:0/3293104751 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5f40ca180 0x7fe5f41500c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:42.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.244+0000 7fe5fa4b1700 1 -- 172.21.15.49:0/3293104751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5f40caab0 msgr2=0x7fe5f4155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:42.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.244+0000 7fe5fa4b1700 1 --2- 172.21.15.49:0/3293104751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5f40caab0 0x7fe5f4155880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:42.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.244+0000 7fe5fa4b1700 1 -- 172.21.15.49:0/3293104751 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e40092a0 con 0x7fe5f40cae90 2023-11-30T18:39:42.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.244+0000 7fe5f94af700 1 --2- 172.21.15.49:0/3293104751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5f40caab0 0x7fe5f4155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:39:42.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.245+0000 7fe5fa4b1700 1 --2- 172.21.15.49:0/3293104751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5f40cae90 0x7fe5f4155d70 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 rx=0x7fe5e4011000 tx=0x7fe5e4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:42.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.245+0000 7fe5f1ffb700 1 -- 172.21.15.49:0/3293104751 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e400f9f0 con 0x7fe5f40cae90 2023-11-30T18:39:42.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.245+0000 7fe5f1ffb700 1 -- 172.21.15.49:0/3293104751 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e400fe80 con 0x7fe5f40cae90 2023-11-30T18:39:42.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.245+0000 7fe5fbf14700 1 -- 172.21.15.49:0/3293104751 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f4156920 con 0x7fe5f40cae90 2023-11-30T18:39:42.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.245+0000 7fe5f1ffb700 1 -- 172.21.15.49:0/3293104751 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e401b660 con 0x7fe5f40cae90 2023-11-30T18:39:42.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.245+0000 7fe5fbf14700 1 -- 172.21.15.49:0/3293104751 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f40c40b0 con 0x7fe5f40cae90 2023-11-30T18:39:42.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.246+0000 7fe5fbf14700 1 -- 172.21.15.49:0/3293104751 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f40ab390 con 0x7fe5f40cae90 2023-11-30T18:39:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.246+0000 7fe5f1ffb700 1 -- 172.21.15.49:0/3293104751 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe5e401ba50 con 0x7fe5f40cae90 2023-11-30T18:39:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.247+0000 7fe5f1ffb700 1 --2- 172.21.15.49:0/3293104751 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe5e005f270 0x7fe5e0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.247+0000 7fe5f1ffb700 1 -- 172.21.15.49:0/3293104751 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6205+0+0 (secure 0 0 0) 0x7fe5e407c080 con 0x7fe5f40cae90 2023-11-30T18:39:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.247+0000 7fe5f9cb0700 1 --2- 172.21.15.49:0/3293104751 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe5e005f270 0x7fe5e0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.247+0000 7fe5f9cb0700 1 --2- 172.21.15.49:0/3293104751 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe5e005f270 0x7fe5e0061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fe5ec004fd0 tx=0x7fe5ec007f20).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.251+0000 7fe5f1ffb700 1 -- 172.21.15.49:0/3293104751 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe5f40ab390 con 0x7fe5f40cae90 2023-11-30T18:39:42.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.494+0000 7fe5fbf14700 1 -- 172.21.15.49:0/3293104751 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe5f40ab390 con 0x7fe5f40cae90 2023-11-30T18:39:42.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.494+0000 7fe5f1ffb700 1 -- 172.21.15.49:0/3293104751 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1033 (secure 0 0 0) 0x7fe5f40ab390 con 0x7fe5f40cae90 2023-11-30T18:39:42.495 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:39:42.495 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":5564,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":203,"num_osds":8,"num_up_osds":8,"osd_up_since":1701364027,"num_in_osds":8,"osd_in_since":1701364021,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":104},{"state_name":"unknown","count":33}],"num_pgs":137,"num_pools":4,"num_objects":17,"data_bytes":1414,"bytes_used":2508701696,"bytes_avail":770585411584,"bytes_total":773094113280,"unknown_pgs_ratio":0.24087591469287872},"fsmap":{"epoch":85,"id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":9498}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":18,"modified":"2023-11-30T18:35:23.552479+0000","services":{}},"progress_events":{}} 2023-11-30T18:39:42.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.496+0000 7fe5fbf14700 1 -- 172.21.15.49:0/3293104751 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe5e005f270 msgr2=0x7fe5e0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:42.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.496+0000 7fe5fbf14700 1 --2- 172.21.15.49:0/3293104751 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe5e005f270 0x7fe5e0061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fe5ec004fd0 tx=0x7fe5ec007f20).stop 2023-11-30T18:39:42.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.496+0000 7fe5fbf14700 1 -- 172.21.15.49:0/3293104751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5f40cae90 msgr2=0x7fe5f4155d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:42.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.496+0000 7fe5fbf14700 1 --2- 172.21.15.49:0/3293104751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5f40cae90 0x7fe5f4155d70 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 rx=0x7fe5e4011000 tx=0x7fe5e4017000).stop 2023-11-30T18:39:42.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.496+0000 7fe5fbf14700 1 -- 172.21.15.49:0/3293104751 shutdown_connections 2023-11-30T18:39:42.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.496+0000 7fe5fbf14700 1 --2- 172.21.15.49:0/3293104751 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe5e005f270 0x7fe5e0061730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:42.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.496+0000 7fe5fbf14700 1 --2- 172.21.15.49:0/3293104751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5f40cae90 0x7fe5f4155d70 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:42.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.496+0000 7fe5fbf14700 1 --2- 172.21.15.49:0/3293104751 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5f40ca180 0x7fe5f41500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:42.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.496+0000 7fe5fbf14700 1 --2- 172.21.15.49:0/3293104751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5f40caab0 0x7fe5f4155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:42.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.496+0000 7fe5fbf14700 1 -- 172.21.15.49:0/3293104751 >> 172.21.15.49:0/3293104751 conn(0x7fe5f4094920 msgr2=0x7fe5f40b0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:42.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.496+0000 7fe5fbf14700 1 -- 172.21.15.49:0/3293104751 shutdown_connections 2023-11-30T18:39:42.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.496+0000 7fe5fbf14700 1 -- 172.21.15.49:0/3293104751 wait complete. 2023-11-30T18:39:42.509 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-30T18:39:42.509 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T18:39:42.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.627+0000 7fe115771700 1 Processor -- start 2023-11-30T18:39:42.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.628+0000 7fe115771700 1 -- start start 2023-11-30T18:39:42.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.628+0000 7fe115771700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe1101544e0 0x7fe1101548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:42.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.628+0000 7fe115771700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe11006a610 0x7fe1100c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:42.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.628+0000 7fe115771700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1100c6e30 0x7fe1100c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:42.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.628+0000 7fe115771700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1100c69a0 con 0x7fe1101544e0 2023-11-30T18:39:42.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.628+0000 7fe115771700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1100c13a0 con 0x7fe11006a610 2023-11-30T18:39:42.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.628+0000 7fe115771700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1100c1680 con 0x7fe1100c6e30 2023-11-30T18:39:42.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.629+0000 7fe10effd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe1101544e0 0x7fe1101548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:42.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.629+0000 7fe10effd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe1101544e0 0x7fe1101548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59842/0 (socket says 172.21.15.49:59842) 2023-11-30T18:39:42.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.629+0000 7fe10effd700 1 -- 172.21.15.49:0/2783734894 learned_addr learned my addr 172.21.15.49:0/2783734894 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:42.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.629+0000 7fe10f7fe700 1 --2- 172.21.15.49:0/2783734894 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1100c6e30 0x7fe1100c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:42.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.629+0000 7fe10e7fc700 1 --2- 172.21.15.49:0/2783734894 >> v2:172.21.15.115:3300/0 conn(0x7fe11006a610 0x7fe1100c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:42.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.629+0000 7fe10effd700 1 -- 172.21.15.49:0/2783734894 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1100c6e30 msgr2=0x7fe1100c72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:42.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.629+0000 7fe10effd700 1 --2- 172.21.15.49:0/2783734894 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1100c6e30 0x7fe1100c72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:42.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.629+0000 7fe10effd700 1 -- 172.21.15.49:0/2783734894 >> v2:172.21.15.115:3300/0 conn(0x7fe11006a610 msgr2=0x7fe1100c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:42.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.629+0000 7fe10effd700 1 --2- 172.21.15.49:0/2783734894 >> v2:172.21.15.115:3300/0 conn(0x7fe11006a610 0x7fe1100c0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:42.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.629+0000 7fe10effd700 1 -- 172.21.15.49:0/2783734894 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1100c6630 con 0x7fe1101544e0 2023-11-30T18:39:42.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.629+0000 7fe10effd700 1 --2- 172.21.15.49:0/2783734894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1101544e0 0x7fe1101548c0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 rx=0x7fe110084fb0 tx=0x7fe108009060).ready entity=mon.0 client_cookie=c1900f24ab66a03 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:42.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.629+0000 7fe10dffb700 1 -- 172.21.15.49:0/2783734894 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe108005880 con 0x7fe1101544e0 2023-11-30T18:39:42.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.629+0000 7fe10dffb700 1 -- 172.21.15.49:0/2783734894 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1080059e0 con 0x7fe1101544e0 2023-11-30T18:39:42.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.629+0000 7fe10dffb700 1 -- 172.21.15.49:0/2783734894 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe108005d60 con 0x7fe1101544e0 2023-11-30T18:39:42.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.630+0000 7fe115771700 1 -- 172.21.15.49:0/2783734894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1101544e0 msgr2=0x7fe1101548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:42.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.630+0000 7fe115771700 1 --2- 172.21.15.49:0/2783734894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1101544e0 0x7fe1101548c0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 rx=0x7fe110084fb0 tx=0x7fe108009060).stop 2023-11-30T18:39:42.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.630+0000 7fe115771700 1 -- 172.21.15.49:0/2783734894 shutdown_connections 2023-11-30T18:39:42.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.630+0000 7fe115771700 1 --2- 172.21.15.49:0/2783734894 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1100c6e30 0x7fe1100c72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:42.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.630+0000 7fe115771700 1 --2- 172.21.15.49:0/2783734894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1101544e0 0x7fe1101548c0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:42.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.630+0000 7fe115771700 1 --2- 172.21.15.49:0/2783734894 >> v2:172.21.15.115:3300/0 conn(0x7fe11006a610 0x7fe1100c0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:42.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.630+0000 7fe115771700 1 -- 172.21.15.49:0/2783734894 >> 172.21.15.49:0/2783734894 conn(0x7fe110085020 msgr2=0x7fe110094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:42.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.630+0000 7fe115771700 1 -- 172.21.15.49:0/2783734894 shutdown_connections 2023-11-30T18:39:42.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.630+0000 7fe115771700 1 -- 172.21.15.49:0/2783734894 wait complete. 2023-11-30T18:39:42.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.631+0000 7fe115771700 1 Processor -- start 2023-11-30T18:39:42.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.631+0000 7fe115771700 1 -- start start 2023-11-30T18:39:42.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.632+0000 7fe115771700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe11006a610 0x7fe110153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:42.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.632+0000 7fe115771700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1100c6e30 0x7fe1100aabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:42.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.632+0000 7fe115771700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1101544e0 0x7fe1100ab0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:42.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.632+0000 7fe115771700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1100980b0 con 0x7fe11006a610 2023-11-30T18:39:42.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.632+0000 7fe115771700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1100974a0 con 0x7fe1101544e0 2023-11-30T18:39:42.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.632+0000 7fe115771700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe110097780 con 0x7fe1100c6e30 2023-11-30T18:39:42.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.632+0000 7fe10effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe11006a610 0x7fe110153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:42.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.632+0000 7fe10effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe11006a610 0x7fe110153010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59844/0 (socket says 172.21.15.49:59844) 2023-11-30T18:39:42.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.632+0000 7fe10effd700 1 -- 172.21.15.49:0/4145445424 learned_addr learned my addr 172.21.15.49:0/4145445424 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:42.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.632+0000 7fe10f7fe700 1 --2- 172.21.15.49:0/4145445424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1101544e0 0x7fe1100ab0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:42.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.632+0000 7fe10e7fc700 1 --2- 172.21.15.49:0/4145445424 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1100c6e30 0x7fe1100aabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:42.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.632+0000 7fe10effd700 1 -- 172.21.15.49:0/4145445424 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1100c6e30 msgr2=0x7fe1100aabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:42.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.632+0000 7fe10effd700 1 --2- 172.21.15.49:0/4145445424 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1100c6e30 0x7fe1100aabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:42.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.632+0000 7fe10effd700 1 -- 172.21.15.49:0/4145445424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1101544e0 msgr2=0x7fe1100ab0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:42.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.632+0000 7fe10effd700 1 --2- 172.21.15.49:0/4145445424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1101544e0 0x7fe1100ab0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:42.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.632+0000 7fe10effd700 1 -- 172.21.15.49:0/4145445424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe108009300 con 0x7fe11006a610 2023-11-30T18:39:42.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.632+0000 7fe10effd700 1 --2- 172.21.15.49:0/4145445424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe11006a610 0x7fe110153010 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 rx=0x7fe108005f10 tx=0x7fe108016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:42.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.633+0000 7fe106ffd700 1 -- 172.21.15.49:0/4145445424 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10800f720 con 0x7fe11006a610 2023-11-30T18:39:42.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.633+0000 7fe106ffd700 1 -- 172.21.15.49:0/4145445424 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10800f880 con 0x7fe11006a610 2023-11-30T18:39:42.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.633+0000 7fe115771700 1 -- 172.21.15.49:0/4145445424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe110097a60 con 0x7fe11006a610 2023-11-30T18:39:42.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.633+0000 7fe106ffd700 1 -- 172.21.15.49:0/4145445424 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10800fc40 con 0x7fe11006a610 2023-11-30T18:39:42.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.633+0000 7fe115771700 1 -- 172.21.15.49:0/4145445424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe110153500 con 0x7fe11006a610 2023-11-30T18:39:42.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.634+0000 7fe115771700 1 -- 172.21.15.49:0/4145445424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1101536f0 con 0x7fe11006a610 2023-11-30T18:39:42.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.634+0000 7fe106ffd700 1 -- 172.21.15.49:0/4145445424 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe108018070 con 0x7fe11006a610 2023-11-30T18:39:42.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.634+0000 7fe106ffd700 1 --2- 172.21.15.49:0/4145445424 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe0f005f240 0x7fe0f0061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:42.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.634+0000 7fe106ffd700 1 -- 172.21.15.49:0/4145445424 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6205+0+0 (secure 0 0 0) 0x7fe10807b430 con 0x7fe11006a610 2023-11-30T18:39:42.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.634+0000 7fe10e7fc700 1 --2- 172.21.15.49:0/4145445424 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe0f005f240 0x7fe0f0061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:42.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.635+0000 7fe10e7fc700 1 --2- 172.21.15.49:0/4145445424 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe0f005f240 0x7fe0f0061700 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fe1100a8b80 tx=0x7fe0f8008040).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:42.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.638+0000 7fe106ffd700 1 -- 172.21.15.49:0/4145445424 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe10804c530 con 0x7fe11006a610 2023-11-30T18:39:42.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.806+0000 7fe115771700 1 -- 172.21.15.49:0/4145445424 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe1100981f0 con 0x7fe0f005f240 2023-11-30T18:39:42.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.816+0000 7fe106ffd700 1 -- 172.21.15.49:0/4145445424 <== mgr.7760 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362175 (secure 0 0 0) 0x7fe0f8009760 con 0x7fe0f005f240 2023-11-30T18:39:42.821 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:39:42.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.819+0000 7fe115771700 1 -- 172.21.15.49:0/4145445424 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe0f005f240 msgr2=0x7fe0f0061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:42.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.819+0000 7fe115771700 1 --2- 172.21.15.49:0/4145445424 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe0f005f240 0x7fe0f0061700 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fe1100a8b80 tx=0x7fe0f8008040).stop 2023-11-30T18:39:42.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.819+0000 7fe115771700 1 -- 172.21.15.49:0/4145445424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe11006a610 msgr2=0x7fe110153010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:42.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.819+0000 7fe115771700 1 --2- 172.21.15.49:0/4145445424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe11006a610 0x7fe110153010 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 rx=0x7fe108005f10 tx=0x7fe108016000).stop 2023-11-30T18:39:42.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.819+0000 7fe115771700 1 -- 172.21.15.49:0/4145445424 shutdown_connections 2023-11-30T18:39:42.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.819+0000 7fe115771700 1 --2- 172.21.15.49:0/4145445424 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe0f005f240 0x7fe0f0061700 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:42.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.819+0000 7fe115771700 1 --2- 172.21.15.49:0/4145445424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1101544e0 0x7fe1100ab0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:42.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.819+0000 7fe115771700 1 --2- 172.21.15.49:0/4145445424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe11006a610 0x7fe110153010 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:42.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.819+0000 7fe115771700 1 --2- 172.21.15.49:0/4145445424 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1100c6e30 0x7fe1100aabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:42.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.819+0000 7fe115771700 1 -- 172.21.15.49:0/4145445424 >> 172.21.15.49:0/4145445424 conn(0x7fe110085020 msgr2=0x7fe1100ae240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:42.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.819+0000 7fe115771700 1 -- 172.21.15.49:0/4145445424 shutdown_connections 2023-11-30T18:39:42.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:42.819+0000 7fe115771700 1 -- 172.21.15.49:0/4145445424 wait complete. 2023-11-30T18:39:42.825 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T18:39:42.832 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-30T18:39:42.643434+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2450016,"kb_used_data":19872,"kb_used_omap":0,"kb_used_meta":2430080,"kb_avail":752524704,"statfs":{"total":773094113280,"available":770585296896,"internally_reserved":0,"allocated":20348928,"data_stored":10427260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2488401920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-593515,"num_objects":-19,"num_object_clones":0,"num_object_copies":-38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-19,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-201,"num_write_kb":-715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.005292"},"pg_stats":[{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349312+0000","last_change":"2023-11-30T18:39:37.344457+0000","last_active":"2023-11-30T18:39:37.349312+0000","last_peered":"2023-11-30T18:39:37.349312+0000","last_clean":"2023-11-30T18:39:37.349312+0000","last_became_active":"2023-11-30T18:39:37.344174+0000","last_became_peered":"2023-11-30T18:39:37.344174+0000","last_unstale":"2023-11-30T18:39:37.349312+0000","last_undegraded":"2023-11-30T18:39:37.349312+0000","last_fullsized":"2023-11-30T18:39:37.349312+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3f","version":"202'3","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346160+0000","last_change":"2023-11-30T18:39:36.952718+0000","last_active":"2023-11-30T18:39:37.346160+0000","last_peered":"2023-11-30T18:39:37.346160+0000","last_clean":"2023-11-30T18:39:37.346160+0000","last_became_active":"2023-11-30T18:39:36.952412+0000","last_became_peered":"2023-11-30T18:39:36.952412+0000","last_unstale":"2023-11-30T18:39:37.346160+0000","last_undegraded":"2023-11-30T18:39:37.346160+0000","last_fullsized":"2023-11-30T18:39:37.346160+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.343185+0000","last_change":"2023-11-30T18:39:37.337167+0000","last_active":"2023-11-30T18:39:37.343185+0000","last_peered":"2023-11-30T18:39:37.343185+0000","last_clean":"2023-11-30T18:39:37.343185+0000","last_became_active":"2023-11-30T18:39:37.336870+0000","last_became_peered":"2023-11-30T18:39:37.336870+0000","last_unstale":"2023-11-30T18:39:37.343185+0000","last_undegraded":"2023-11-30T18:39:37.343185+0000","last_fullsized":"2023-11-30T18:39:37.343185+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.325615+0000","last_change":"2023-11-30T18:39:36.946856+0000","last_active":"2023-11-30T18:39:37.325615+0000","last_peered":"2023-11-30T18:39:37.325615+0000","last_clean":"2023-11-30T18:39:37.325615+0000","last_became_active":"2023-11-30T18:39:36.946611+0000","last_became_peered":"2023-11-30T18:39:36.946611+0000","last_unstale":"2023-11-30T18:39:37.325615+0000","last_undegraded":"2023-11-30T18:39:37.325615+0000","last_fullsized":"2023-11-30T18:39:37.325615+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.342165+0000","last_change":"2023-11-30T18:39:37.339227+0000","last_active":"2023-11-30T18:39:37.342165+0000","last_peered":"2023-11-30T18:39:37.342165+0000","last_clean":"2023-11-30T18:39:37.342165+0000","last_became_active":"2023-11-30T18:39:37.338774+0000","last_became_peered":"2023-11-30T18:39:37.338774+0000","last_unstale":"2023-11-30T18:39:37.342165+0000","last_undegraded":"2023-11-30T18:39:37.342165+0000","last_fullsized":"2023-11-30T18:39:37.342165+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327583+0000","last_change":"2023-11-30T18:39:36.951837+0000","last_active":"2023-11-30T18:39:37.327583+0000","last_peered":"2023-11-30T18:39:37.327583+0000","last_clean":"2023-11-30T18:39:37.327583+0000","last_became_active":"2023-11-30T18:39:36.951560+0000","last_became_peered":"2023-11-30T18:39:36.951560+0000","last_unstale":"2023-11-30T18:39:37.327583+0000","last_undegraded":"2023-11-30T18:39:37.327583+0000","last_fullsized":"2023-11-30T18:39:37.327583+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349301+0000","last_change":"2023-11-30T18:39:37.345801+0000","last_active":"2023-11-30T18:39:37.349301+0000","last_peered":"2023-11-30T18:39:37.349301+0000","last_clean":"2023-11-30T18:39:37.349301+0000","last_became_active":"2023-11-30T18:39:37.345516+0000","last_became_peered":"2023-11-30T18:39:37.345516+0000","last_unstale":"2023-11-30T18:39:37.349301+0000","last_undegraded":"2023-11-30T18:39:37.349301+0000","last_fullsized":"2023-11-30T18:39:37.349301+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3c","version":"202'2","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347142+0000","last_change":"2023-11-30T18:39:36.949667+0000","last_active":"2023-11-30T18:39:37.347142+0000","last_peered":"2023-11-30T18:39:37.347142+0000","last_clean":"2023-11-30T18:39:37.347142+0000","last_became_active":"2023-11-30T18:39:36.949238+0000","last_became_peered":"2023-11-30T18:39:36.949238+0000","last_unstale":"2023-11-30T18:39:37.347142+0000","last_undegraded":"2023-11-30T18:39:37.347142+0000","last_fullsized":"2023-11-30T18:39:37.347142+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.351900+0000","last_change":"2023-11-30T18:39:37.349000+0000","last_active":"2023-11-30T18:39:37.351900+0000","last_peered":"2023-11-30T18:39:37.351900+0000","last_clean":"2023-11-30T18:39:37.351900+0000","last_became_active":"2023-11-30T18:39:37.348658+0000","last_became_peered":"2023-11-30T18:39:37.348658+0000","last_unstale":"2023-11-30T18:39:37.351900+0000","last_undegraded":"2023-11-30T18:39:37.351900+0000","last_fullsized":"2023-11-30T18:39:37.351900+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3b","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347882+0000","last_change":"2023-11-30T18:39:36.941711+0000","last_active":"2023-11-30T18:39:37.347882+0000","last_peered":"2023-11-30T18:39:37.347882+0000","last_clean":"2023-11-30T18:39:37.347882+0000","last_became_active":"2023-11-30T18:39:36.941268+0000","last_became_peered":"2023-11-30T18:39:36.941268+0000","last_unstale":"2023-11-30T18:39:37.347882+0000","last_undegraded":"2023-11-30T18:39:37.347882+0000","last_fullsized":"2023-11-30T18:39:37.347882+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349423+0000","last_change":"2023-11-30T18:39:37.343623+0000","last_active":"2023-11-30T18:39:37.349423+0000","last_peered":"2023-11-30T18:39:37.349423+0000","last_clean":"2023-11-30T18:39:37.349423+0000","last_became_active":"2023-11-30T18:39:37.343286+0000","last_became_peered":"2023-11-30T18:39:37.343286+0000","last_unstale":"2023-11-30T18:39:37.349423+0000","last_undegraded":"2023-11-30T18:39:37.349423+0000","last_fullsized":"2023-11-30T18:39:37.349423+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3a","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346845+0000","last_change":"2023-11-30T18:39:36.948257+0000","last_active":"2023-11-30T18:39:37.346845+0000","last_peered":"2023-11-30T18:39:37.346845+0000","last_clean":"2023-11-30T18:39:37.346845+0000","last_became_active":"2023-11-30T18:39:36.947769+0000","last_became_peered":"2023-11-30T18:39:36.947769+0000","last_unstale":"2023-11-30T18:39:37.346845+0000","last_undegraded":"2023-11-30T18:39:37.346845+0000","last_fullsized":"2023-11-30T18:39:37.346845+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347404+0000","last_change":"2023-11-30T18:39:37.345626+0000","last_active":"2023-11-30T18:39:37.347404+0000","last_peered":"2023-11-30T18:39:37.347404+0000","last_clean":"2023-11-30T18:39:37.347404+0000","last_became_active":"2023-11-30T18:39:37.345347+0000","last_became_peered":"2023-11-30T18:39:37.345347+0000","last_unstale":"2023-11-30T18:39:37.347404+0000","last_undegraded":"2023-11-30T18:39:37.347404+0000","last_fullsized":"2023-11-30T18:39:37.347404+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.333622+0000","last_change":"2023-11-30T18:39:36.946508+0000","last_active":"2023-11-30T18:39:37.333622+0000","last_peered":"2023-11-30T18:39:37.333622+0000","last_clean":"2023-11-30T18:39:37.333622+0000","last_became_active":"2023-11-30T18:39:36.946260+0000","last_became_peered":"2023-11-30T18:39:36.946260+0000","last_unstale":"2023-11-30T18:39:37.333622+0000","last_undegraded":"2023-11-30T18:39:37.333622+0000","last_fullsized":"2023-11-30T18:39:37.333622+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347329+0000","last_change":"2023-11-30T18:39:37.344153+0000","last_active":"2023-11-30T18:39:37.347329+0000","last_peered":"2023-11-30T18:39:37.347329+0000","last_clean":"2023-11-30T18:39:37.347329+0000","last_became_active":"2023-11-30T18:39:37.343879+0000","last_became_peered":"2023-11-30T18:39:37.343879+0000","last_unstale":"2023-11-30T18:39:37.347329+0000","last_undegraded":"2023-11-30T18:39:37.347329+0000","last_fullsized":"2023-11-30T18:39:37.347329+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.328014+0000","last_change":"2023-11-30T18:39:36.941595+0000","last_active":"2023-11-30T18:39:37.328014+0000","last_peered":"2023-11-30T18:39:37.328014+0000","last_clean":"2023-11-30T18:39:37.328014+0000","last_became_active":"2023-11-30T18:39:36.941256+0000","last_became_peered":"2023-11-30T18:39:36.941256+0000","last_unstale":"2023-11-30T18:39:37.328014+0000","last_undegraded":"2023-11-30T18:39:37.328014+0000","last_fullsized":"2023-11-30T18:39:37.328014+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347574+0000","last_change":"2023-11-30T18:39:37.343067+0000","last_active":"2023-11-30T18:39:37.347574+0000","last_peered":"2023-11-30T18:39:37.347574+0000","last_clean":"2023-11-30T18:39:37.347574+0000","last_became_active":"2023-11-30T18:39:37.338376+0000","last_became_peered":"2023-11-30T18:39:37.338376+0000","last_unstale":"2023-11-30T18:39:37.347574+0000","last_undegraded":"2023-11-30T18:39:37.347574+0000","last_fullsized":"2023-11-30T18:39:37.347574+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.325340+0000","last_change":"2023-11-30T18:39:36.946345+0000","last_active":"2023-11-30T18:39:37.325340+0000","last_peered":"2023-11-30T18:39:37.325340+0000","last_clean":"2023-11-30T18:39:37.325340+0000","last_became_active":"2023-11-30T18:39:36.946063+0000","last_became_peered":"2023-11-30T18:39:36.946063+0000","last_unstale":"2023-11-30T18:39:37.325340+0000","last_undegraded":"2023-11-30T18:39:37.325340+0000","last_fullsized":"2023-11-30T18:39:37.325340+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.343031+0000","last_change":"2023-11-30T18:39:37.336599+0000","last_active":"2023-11-30T18:39:37.343031+0000","last_peered":"2023-11-30T18:39:37.343031+0000","last_clean":"2023-11-30T18:39:37.343031+0000","last_became_active":"2023-11-30T18:39:37.336034+0000","last_became_peered":"2023-11-30T18:39:37.336034+0000","last_unstale":"2023-11-30T18:39:37.343031+0000","last_undegraded":"2023-11-30T18:39:37.343031+0000","last_fullsized":"2023-11-30T18:39:37.343031+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.325646+0000","last_change":"2023-11-30T18:39:36.951924+0000","last_active":"2023-11-30T18:39:37.325646+0000","last_peered":"2023-11-30T18:39:37.325646+0000","last_clean":"2023-11-30T18:39:37.325646+0000","last_became_active":"2023-11-30T18:39:36.951723+0000","last_became_peered":"2023-11-30T18:39:36.951723+0000","last_unstale":"2023-11-30T18:39:37.325646+0000","last_undegraded":"2023-11-30T18:39:37.325646+0000","last_fullsized":"2023-11-30T18:39:37.325646+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346994+0000","last_change":"2023-11-30T18:39:37.344677+0000","last_active":"2023-11-30T18:39:37.346994+0000","last_peered":"2023-11-30T18:39:37.346994+0000","last_clean":"2023-11-30T18:39:37.346994+0000","last_became_active":"2023-11-30T18:39:37.344361+0000","last_became_peered":"2023-11-30T18:39:37.344361+0000","last_unstale":"2023-11-30T18:39:37.346994+0000","last_undegraded":"2023-11-30T18:39:37.346994+0000","last_fullsized":"2023-11-30T18:39:37.346994+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.325562+0000","last_change":"2023-11-30T18:39:36.941763+0000","last_active":"2023-11-30T18:39:37.325562+0000","last_peered":"2023-11-30T18:39:37.325562+0000","last_clean":"2023-11-30T18:39:37.325562+0000","last_became_active":"2023-11-30T18:39:36.941349+0000","last_became_peered":"2023-11-30T18:39:36.941349+0000","last_unstale":"2023-11-30T18:39:37.325562+0000","last_undegraded":"2023-11-30T18:39:37.325562+0000","last_fullsized":"2023-11-30T18:39:37.325562+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349920+0000","last_change":"2023-11-30T18:39:37.346869+0000","last_active":"2023-11-30T18:39:37.349920+0000","last_peered":"2023-11-30T18:39:37.349920+0000","last_clean":"2023-11-30T18:39:37.349920+0000","last_became_active":"2023-11-30T18:39:37.346571+0000","last_became_peered":"2023-11-30T18:39:37.346571+0000","last_unstale":"2023-11-30T18:39:37.349920+0000","last_undegraded":"2023-11-30T18:39:37.349920+0000","last_fullsized":"2023-11-30T18:39:37.349920+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.34","version":"202'4","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352871+0000","last_change":"2023-11-30T18:39:36.946240+0000","last_active":"2023-11-30T18:39:37.352871+0000","last_peered":"2023-11-30T18:39:37.352871+0000","last_clean":"2023-11-30T18:39:37.352871+0000","last_became_active":"2023-11-30T18:39:36.945944+0000","last_became_peered":"2023-11-30T18:39:36.945944+0000","last_unstale":"2023-11-30T18:39:37.352871+0000","last_undegraded":"2023-11-30T18:39:37.352871+0000","last_fullsized":"2023-11-30T18:39:37.352871+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349366+0000","last_change":"2023-11-30T18:39:37.345080+0000","last_active":"2023-11-30T18:39:37.349366+0000","last_peered":"2023-11-30T18:39:37.349366+0000","last_clean":"2023-11-30T18:39:37.349366+0000","last_became_active":"2023-11-30T18:39:37.344759+0000","last_became_peered":"2023-11-30T18:39:37.344759+0000","last_unstale":"2023-11-30T18:39:37.349366+0000","last_undegraded":"2023-11-30T18:39:37.349366+0000","last_fullsized":"2023-11-30T18:39:37.349366+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.33","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.335670+0000","last_change":"2023-11-30T18:39:36.948358+0000","last_active":"2023-11-30T18:39:37.335670+0000","last_peered":"2023-11-30T18:39:37.335670+0000","last_clean":"2023-11-30T18:39:37.335670+0000","last_became_active":"2023-11-30T18:39:36.947917+0000","last_became_peered":"2023-11-30T18:39:36.947917+0000","last_unstale":"2023-11-30T18:39:37.335670+0000","last_undegraded":"2023-11-30T18:39:37.335670+0000","last_fullsized":"2023-11-30T18:39:37.335670+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352812+0000","last_change":"2023-11-30T18:39:37.351277+0000","last_active":"2023-11-30T18:39:37.352812+0000","last_peered":"2023-11-30T18:39:37.352812+0000","last_clean":"2023-11-30T18:39:37.352812+0000","last_became_active":"2023-11-30T18:39:37.351026+0000","last_became_peered":"2023-11-30T18:39:37.351026+0000","last_unstale":"2023-11-30T18:39:37.352812+0000","last_undegraded":"2023-11-30T18:39:37.352812+0000","last_fullsized":"2023-11-30T18:39:37.352812+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327022+0000","last_change":"2023-11-30T18:39:36.951095+0000","last_active":"2023-11-30T18:39:37.327022+0000","last_peered":"2023-11-30T18:39:37.327022+0000","last_clean":"2023-11-30T18:39:37.327022+0000","last_became_active":"2023-11-30T18:39:36.950755+0000","last_became_peered":"2023-11-30T18:39:36.950755+0000","last_unstale":"2023-11-30T18:39:37.327022+0000","last_undegraded":"2023-11-30T18:39:37.327022+0000","last_fullsized":"2023-11-30T18:39:37.327022+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346081+0000","last_change":"2023-11-30T18:39:37.338925+0000","last_active":"2023-11-30T18:39:37.346081+0000","last_peered":"2023-11-30T18:39:37.346081+0000","last_clean":"2023-11-30T18:39:37.346081+0000","last_became_active":"2023-11-30T18:39:37.338608+0000","last_became_peered":"2023-11-30T18:39:37.338608+0000","last_unstale":"2023-11-30T18:39:37.346081+0000","last_undegraded":"2023-11-30T18:39:37.346081+0000","last_fullsized":"2023-11-30T18:39:37.346081+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.329742+0000","last_change":"2023-11-30T18:39:36.949738+0000","last_active":"2023-11-30T18:39:37.329742+0000","last_peered":"2023-11-30T18:39:37.329742+0000","last_clean":"2023-11-30T18:39:37.329742+0000","last_became_active":"2023-11-30T18:39:36.949398+0000","last_became_peered":"2023-11-30T18:39:36.949398+0000","last_unstale":"2023-11-30T18:39:37.329742+0000","last_undegraded":"2023-11-30T18:39:37.329742+0000","last_fullsized":"2023-11-30T18:39:37.329742+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352073+0000","last_change":"2023-11-30T18:39:37.347542+0000","last_active":"2023-11-30T18:39:37.352073+0000","last_peered":"2023-11-30T18:39:37.352073+0000","last_clean":"2023-11-30T18:39:37.352073+0000","last_became_active":"2023-11-30T18:39:37.347265+0000","last_became_peered":"2023-11-30T18:39:37.347265+0000","last_unstale":"2023-11-30T18:39:37.352073+0000","last_undegraded":"2023-11-30T18:39:37.352073+0000","last_fullsized":"2023-11-30T18:39:37.352073+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.30","version":"202'4","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.350561+0000","last_change":"2023-11-30T18:39:36.951234+0000","last_active":"2023-11-30T18:39:37.350561+0000","last_peered":"2023-11-30T18:39:37.350561+0000","last_clean":"2023-11-30T18:39:37.350561+0000","last_became_active":"2023-11-30T18:39:36.950335+0000","last_became_peered":"2023-11-30T18:39:36.950335+0000","last_unstale":"2023-11-30T18:39:37.350561+0000","last_undegraded":"2023-11-30T18:39:37.350561+0000","last_fullsized":"2023-11-30T18:39:37.350561+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346155+0000","last_change":"2023-11-30T18:39:37.338166+0000","last_active":"2023-11-30T18:39:37.346155+0000","last_peered":"2023-11-30T18:39:37.346155+0000","last_clean":"2023-11-30T18:39:37.346155+0000","last_became_active":"2023-11-30T18:39:37.337877+0000","last_became_peered":"2023-11-30T18:39:37.337877+0000","last_unstale":"2023-11-30T18:39:37.346155+0000","last_undegraded":"2023-11-30T18:39:37.346155+0000","last_fullsized":"2023-11-30T18:39:37.346155+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.326222+0000","last_change":"2023-11-30T18:39:36.949535+0000","last_active":"2023-11-30T18:39:37.326222+0000","last_peered":"2023-11-30T18:39:37.326222+0000","last_clean":"2023-11-30T18:39:37.326222+0000","last_became_active":"2023-11-30T18:39:36.949241+0000","last_became_peered":"2023-11-30T18:39:36.949241+0000","last_unstale":"2023-11-30T18:39:37.326222+0000","last_undegraded":"2023-11-30T18:39:37.326222+0000","last_fullsized":"2023-11-30T18:39:37.326222+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.336430+0000","last_change":"2023-11-30T18:39:37.333434+0000","last_active":"2023-11-30T18:39:37.336430+0000","last_peered":"2023-11-30T18:39:37.336430+0000","last_clean":"2023-11-30T18:39:37.336430+0000","last_became_active":"2023-11-30T18:39:37.333123+0000","last_became_peered":"2023-11-30T18:39:37.333123+0000","last_unstale":"2023-11-30T18:39:37.336430+0000","last_undegraded":"2023-11-30T18:39:37.336430+0000","last_fullsized":"2023-11-30T18:39:37.336430+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.337654+0000","last_change":"2023-11-30T18:39:36.949130+0000","last_active":"2023-11-30T18:39:37.337654+0000","last_peered":"2023-11-30T18:39:37.337654+0000","last_clean":"2023-11-30T18:39:37.337654+0000","last_became_active":"2023-11-30T18:39:36.946324+0000","last_became_peered":"2023-11-30T18:39:36.946324+0000","last_unstale":"2023-11-30T18:39:37.337654+0000","last_undegraded":"2023-11-30T18:39:37.337654+0000","last_fullsized":"2023-11-30T18:39:37.337654+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346825+0000","last_change":"2023-11-30T18:39:37.342066+0000","last_active":"2023-11-30T18:39:37.346825+0000","last_peered":"2023-11-30T18:39:37.346825+0000","last_clean":"2023-11-30T18:39:37.346825+0000","last_became_active":"2023-11-30T18:39:37.341771+0000","last_became_peered":"2023-11-30T18:39:37.341771+0000","last_unstale":"2023-11-30T18:39:37.346825+0000","last_undegraded":"2023-11-30T18:39:37.346825+0000","last_fullsized":"2023-11-30T18:39:37.346825+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2d","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347422+0000","last_change":"2023-11-30T18:39:36.943783+0000","last_active":"2023-11-30T18:39:37.347422+0000","last_peered":"2023-11-30T18:39:37.347422+0000","last_clean":"2023-11-30T18:39:37.347422+0000","last_became_active":"2023-11-30T18:39:36.943292+0000","last_became_peered":"2023-11-30T18:39:36.943292+0000","last_unstale":"2023-11-30T18:39:37.347422+0000","last_undegraded":"2023-11-30T18:39:37.347422+0000","last_fullsized":"2023-11-30T18:39:37.347422+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349567+0000","last_change":"2023-11-30T18:39:37.346979+0000","last_active":"2023-11-30T18:39:37.349567+0000","last_peered":"2023-11-30T18:39:37.349567+0000","last_clean":"2023-11-30T18:39:37.349567+0000","last_became_active":"2023-11-30T18:39:37.346664+0000","last_became_peered":"2023-11-30T18:39:37.346664+0000","last_unstale":"2023-11-30T18:39:37.349567+0000","last_undegraded":"2023-11-30T18:39:37.349567+0000","last_fullsized":"2023-11-30T18:39:37.349567+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327127+0000","last_change":"2023-11-30T18:39:36.951319+0000","last_active":"2023-11-30T18:39:37.327127+0000","last_peered":"2023-11-30T18:39:37.327127+0000","last_clean":"2023-11-30T18:39:37.327127+0000","last_became_active":"2023-11-30T18:39:36.950625+0000","last_became_peered":"2023-11-30T18:39:36.950625+0000","last_unstale":"2023-11-30T18:39:37.327127+0000","last_undegraded":"2023-11-30T18:39:37.327127+0000","last_fullsized":"2023-11-30T18:39:37.327127+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.353489+0000","last_change":"2023-11-30T18:39:37.352660+0000","last_active":"2023-11-30T18:39:37.353489+0000","last_peered":"2023-11-30T18:39:37.353489+0000","last_clean":"2023-11-30T18:39:37.353489+0000","last_became_active":"2023-11-30T18:39:37.352052+0000","last_became_peered":"2023-11-30T18:39:37.352052+0000","last_unstale":"2023-11-30T18:39:37.353489+0000","last_undegraded":"2023-11-30T18:39:37.353489+0000","last_fullsized":"2023-11-30T18:39:37.353489+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.343254+0000","last_change":"2023-11-30T18:39:36.952248+0000","last_active":"2023-11-30T18:39:37.343254+0000","last_peered":"2023-11-30T18:39:37.343254+0000","last_clean":"2023-11-30T18:39:37.343254+0000","last_became_active":"2023-11-30T18:39:36.951960+0000","last_became_peered":"2023-11-30T18:39:36.951960+0000","last_unstale":"2023-11-30T18:39:37.343254+0000","last_undegraded":"2023-11-30T18:39:37.343254+0000","last_fullsized":"2023-11-30T18:39:37.343254+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349666+0000","last_change":"2023-11-30T18:39:37.346628+0000","last_active":"2023-11-30T18:39:37.349666+0000","last_peered":"2023-11-30T18:39:37.349666+0000","last_clean":"2023-11-30T18:39:37.349666+0000","last_became_active":"2023-11-30T18:39:37.346349+0000","last_became_peered":"2023-11-30T18:39:37.346349+0000","last_unstale":"2023-11-30T18:39:37.349666+0000","last_undegraded":"2023-11-30T18:39:37.349666+0000","last_fullsized":"2023-11-30T18:39:37.349666+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.326648+0000","last_change":"2023-11-30T18:39:36.947146+0000","last_active":"2023-11-30T18:39:37.326648+0000","last_peered":"2023-11-30T18:39:37.326648+0000","last_clean":"2023-11-30T18:39:37.326648+0000","last_became_active":"2023-11-30T18:39:36.946809+0000","last_became_peered":"2023-11-30T18:39:36.946809+0000","last_unstale":"2023-11-30T18:39:37.326648+0000","last_undegraded":"2023-11-30T18:39:37.326648+0000","last_fullsized":"2023-11-30T18:39:37.326648+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347382+0000","last_change":"2023-11-30T18:39:37.344874+0000","last_active":"2023-11-30T18:39:37.347382+0000","last_peered":"2023-11-30T18:39:37.347382+0000","last_clean":"2023-11-30T18:39:37.347382+0000","last_became_active":"2023-11-30T18:39:37.344613+0000","last_became_peered":"2023-11-30T18:39:37.344613+0000","last_unstale":"2023-11-30T18:39:37.347382+0000","last_undegraded":"2023-11-30T18:39:37.347382+0000","last_fullsized":"2023-11-30T18:39:37.347382+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.323906+0000","last_change":"2023-11-30T18:39:36.946087+0000","last_active":"2023-11-30T18:39:37.323906+0000","last_peered":"2023-11-30T18:39:37.323906+0000","last_clean":"2023-11-30T18:39:37.323906+0000","last_became_active":"2023-11-30T18:39:36.945402+0000","last_became_peered":"2023-11-30T18:39:36.945402+0000","last_unstale":"2023-11-30T18:39:37.323906+0000","last_undegraded":"2023-11-30T18:39:37.323906+0000","last_fullsized":"2023-11-30T18:39:37.323906+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.348211+0000","last_change":"2023-11-30T18:39:37.344635+0000","last_active":"2023-11-30T18:39:37.348211+0000","last_peered":"2023-11-30T18:39:37.348211+0000","last_clean":"2023-11-30T18:39:37.348211+0000","last_became_active":"2023-11-30T18:39:37.344167+0000","last_became_peered":"2023-11-30T18:39:37.344167+0000","last_unstale":"2023-11-30T18:39:37.348211+0000","last_undegraded":"2023-11-30T18:39:37.348211+0000","last_fullsized":"2023-11-30T18:39:37.348211+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.328137+0000","last_change":"2023-11-30T18:39:36.946792+0000","last_active":"2023-11-30T18:39:37.328137+0000","last_peered":"2023-11-30T18:39:37.328137+0000","last_clean":"2023-11-30T18:39:37.328137+0000","last_became_active":"2023-11-30T18:39:36.946486+0000","last_became_peered":"2023-11-30T18:39:36.946486+0000","last_unstale":"2023-11-30T18:39:37.328137+0000","last_undegraded":"2023-11-30T18:39:37.328137+0000","last_fullsized":"2023-11-30T18:39:37.328137+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349334+0000","last_change":"2023-11-30T18:39:37.344920+0000","last_active":"2023-11-30T18:39:37.349334+0000","last_peered":"2023-11-30T18:39:37.349334+0000","last_clean":"2023-11-30T18:39:37.349334+0000","last_became_active":"2023-11-30T18:39:37.344397+0000","last_became_peered":"2023-11-30T18:39:37.344397+0000","last_unstale":"2023-11-30T18:39:37.349334+0000","last_undegraded":"2023-11-30T18:39:37.349334+0000","last_fullsized":"2023-11-30T18:39:37.349334+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327429+0000","last_change":"2023-11-30T18:39:36.950989+0000","last_active":"2023-11-30T18:39:37.327429+0000","last_peered":"2023-11-30T18:39:37.327429+0000","last_clean":"2023-11-30T18:39:37.327429+0000","last_became_active":"2023-11-30T18:39:36.950554+0000","last_became_peered":"2023-11-30T18:39:36.950554+0000","last_unstale":"2023-11-30T18:39:37.327429+0000","last_undegraded":"2023-11-30T18:39:37.327429+0000","last_fullsized":"2023-11-30T18:39:37.327429+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.340948+0000","last_change":"2023-11-30T18:39:37.339921+0000","last_active":"2023-11-30T18:39:37.340948+0000","last_peered":"2023-11-30T18:39:37.340948+0000","last_clean":"2023-11-30T18:39:37.340948+0000","last_became_active":"2023-11-30T18:39:37.339659+0000","last_became_peered":"2023-11-30T18:39:37.339659+0000","last_unstale":"2023-11-30T18:39:37.340948+0000","last_undegraded":"2023-11-30T18:39:37.340948+0000","last_fullsized":"2023-11-30T18:39:37.340948+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.331794+0000","last_change":"2023-11-30T18:39:36.952942+0000","last_active":"2023-11-30T18:39:37.331794+0000","last_peered":"2023-11-30T18:39:37.331794+0000","last_clean":"2023-11-30T18:39:37.331794+0000","last_became_active":"2023-11-30T18:39:36.952663+0000","last_became_peered":"2023-11-30T18:39:36.952663+0000","last_unstale":"2023-11-30T18:39:37.331794+0000","last_undegraded":"2023-11-30T18:39:37.331794+0000","last_fullsized":"2023-11-30T18:39:37.331794+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349529+0000","last_change":"2023-11-30T18:39:37.345821+0000","last_active":"2023-11-30T18:39:37.349529+0000","last_peered":"2023-11-30T18:39:37.349529+0000","last_clean":"2023-11-30T18:39:37.349529+0000","last_became_active":"2023-11-30T18:39:37.345470+0000","last_became_peered":"2023-11-30T18:39:37.345470+0000","last_unstale":"2023-11-30T18:39:37.349529+0000","last_undegraded":"2023-11-30T18:39:37.349529+0000","last_fullsized":"2023-11-30T18:39:37.349529+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327690+0000","last_change":"2023-11-30T18:39:36.949932+0000","last_active":"2023-11-30T18:39:37.327690+0000","last_peered":"2023-11-30T18:39:37.327690+0000","last_clean":"2023-11-30T18:39:37.327690+0000","last_became_active":"2023-11-30T18:39:36.949661+0000","last_became_peered":"2023-11-30T18:39:36.949661+0000","last_unstale":"2023-11-30T18:39:37.327690+0000","last_undegraded":"2023-11-30T18:39:37.327690+0000","last_fullsized":"2023-11-30T18:39:37.327690+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.348203+0000","last_change":"2023-11-30T18:39:37.344683+0000","last_active":"2023-11-30T18:39:37.348203+0000","last_peered":"2023-11-30T18:39:37.348203+0000","last_clean":"2023-11-30T18:39:37.348203+0000","last_became_active":"2023-11-30T18:39:37.344395+0000","last_became_peered":"2023-11-30T18:39:37.344395+0000","last_unstale":"2023-11-30T18:39:37.348203+0000","last_undegraded":"2023-11-30T18:39:37.348203+0000","last_fullsized":"2023-11-30T18:39:37.348203+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327088+0000","last_change":"2023-11-30T18:39:36.940369+0000","last_active":"2023-11-30T18:39:37.327088+0000","last_peered":"2023-11-30T18:39:37.327088+0000","last_clean":"2023-11-30T18:39:37.327088+0000","last_became_active":"2023-11-30T18:39:36.940068+0000","last_became_peered":"2023-11-30T18:39:36.940068+0000","last_unstale":"2023-11-30T18:39:37.327088+0000","last_undegraded":"2023-11-30T18:39:37.327088+0000","last_fullsized":"2023-11-30T18:39:37.327088+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.344294+0000","last_change":"2023-11-30T18:39:37.339378+0000","last_active":"2023-11-30T18:39:37.344294+0000","last_peered":"2023-11-30T18:39:37.344294+0000","last_clean":"2023-11-30T18:39:37.344294+0000","last_became_active":"2023-11-30T18:39:37.339129+0000","last_became_peered":"2023-11-30T18:39:37.339129+0000","last_unstale":"2023-11-30T18:39:37.344294+0000","last_undegraded":"2023-11-30T18:39:37.344294+0000","last_fullsized":"2023-11-30T18:39:37.344294+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327878+0000","last_change":"2023-11-30T18:39:36.956213+0000","last_active":"2023-11-30T18:39:37.327878+0000","last_peered":"2023-11-30T18:39:37.327878+0000","last_clean":"2023-11-30T18:39:37.327878+0000","last_became_active":"2023-11-30T18:39:36.955972+0000","last_became_peered":"2023-11-30T18:39:36.955972+0000","last_unstale":"2023-11-30T18:39:37.327878+0000","last_undegraded":"2023-11-30T18:39:37.327878+0000","last_fullsized":"2023-11-30T18:39:37.327878+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349361+0000","last_change":"2023-11-30T18:39:37.342243+0000","last_active":"2023-11-30T18:39:37.349361+0000","last_peered":"2023-11-30T18:39:37.349361+0000","last_clean":"2023-11-30T18:39:37.349361+0000","last_became_active":"2023-11-30T18:39:37.341924+0000","last_became_peered":"2023-11-30T18:39:37.341924+0000","last_unstale":"2023-11-30T18:39:37.349361+0000","last_undegraded":"2023-11-30T18:39:37.349361+0000","last_fullsized":"2023-11-30T18:39:37.349361+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.338109+0000","last_change":"2023-11-30T18:39:36.951143+0000","last_active":"2023-11-30T18:39:37.338109+0000","last_peered":"2023-11-30T18:39:37.338109+0000","last_clean":"2023-11-30T18:39:37.338109+0000","last_became_active":"2023-11-30T18:39:36.949920+0000","last_became_peered":"2023-11-30T18:39:36.949920+0000","last_unstale":"2023-11-30T18:39:37.338109+0000","last_undegraded":"2023-11-30T18:39:37.338109+0000","last_fullsized":"2023-11-30T18:39:37.338109+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347456+0000","last_change":"2023-11-30T18:39:37.345550+0000","last_active":"2023-11-30T18:39:37.347456+0000","last_peered":"2023-11-30T18:39:37.347456+0000","last_clean":"2023-11-30T18:39:37.347456+0000","last_became_active":"2023-11-30T18:39:37.341594+0000","last_became_peered":"2023-11-30T18:39:37.341594+0000","last_unstale":"2023-11-30T18:39:37.347456+0000","last_undegraded":"2023-11-30T18:39:37.347456+0000","last_fullsized":"2023-11-30T18:39:37.347456+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.336742+0000","last_change":"2023-11-30T18:39:36.946323+0000","last_active":"2023-11-30T18:39:37.336742+0000","last_peered":"2023-11-30T18:39:37.336742+0000","last_clean":"2023-11-30T18:39:37.336742+0000","last_became_active":"2023-11-30T18:39:36.946044+0000","last_became_peered":"2023-11-30T18:39:36.946044+0000","last_unstale":"2023-11-30T18:39:37.336742+0000","last_undegraded":"2023-11-30T18:39:37.336742+0000","last_fullsized":"2023-11-30T18:39:37.336742+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.340269+0000","last_change":"2023-11-30T18:39:37.331035+0000","last_active":"2023-11-30T18:39:37.340269+0000","last_peered":"2023-11-30T18:39:37.340269+0000","last_clean":"2023-11-30T18:39:37.340269+0000","last_became_active":"2023-11-30T18:39:37.330729+0000","last_became_peered":"2023-11-30T18:39:37.330729+0000","last_unstale":"2023-11-30T18:39:37.340269+0000","last_undegraded":"2023-11-30T18:39:37.340269+0000","last_fullsized":"2023-11-30T18:39:37.340269+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.337914+0000","last_change":"2023-11-30T18:39:36.950391+0000","last_active":"2023-11-30T18:39:37.337914+0000","last_peered":"2023-11-30T18:39:37.337914+0000","last_clean":"2023-11-30T18:39:37.337914+0000","last_became_active":"2023-11-30T18:39:36.946855+0000","last_became_peered":"2023-11-30T18:39:36.946855+0000","last_unstale":"2023-11-30T18:39:37.337914+0000","last_undegraded":"2023-11-30T18:39:37.337914+0000","last_fullsized":"2023-11-30T18:39:37.337914+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347365+0000","last_change":"2023-11-30T18:39:37.340342+0000","last_active":"2023-11-30T18:39:37.347365+0000","last_peered":"2023-11-30T18:39:37.347365+0000","last_clean":"2023-11-30T18:39:37.347365+0000","last_became_active":"2023-11-30T18:39:37.340045+0000","last_became_peered":"2023-11-30T18:39:37.340045+0000","last_unstale":"2023-11-30T18:39:37.347365+0000","last_undegraded":"2023-11-30T18:39:37.347365+0000","last_fullsized":"2023-11-30T18:39:37.347365+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352099+0000","last_change":"2023-11-30T18:39:36.948987+0000","last_active":"2023-11-30T18:39:37.352099+0000","last_peered":"2023-11-30T18:39:37.352099+0000","last_clean":"2023-11-30T18:39:37.352099+0000","last_became_active":"2023-11-30T18:39:36.947046+0000","last_became_peered":"2023-11-30T18:39:36.947046+0000","last_unstale":"2023-11-30T18:39:37.352099+0000","last_undegraded":"2023-11-30T18:39:37.352099+0000","last_fullsized":"2023-11-30T18:39:37.352099+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.345480+0000","last_change":"2023-11-30T18:39:37.341621+0000","last_active":"2023-11-30T18:39:37.345480+0000","last_peered":"2023-11-30T18:39:37.345480+0000","last_clean":"2023-11-30T18:39:37.345480+0000","last_became_active":"2023-11-30T18:39:37.341312+0000","last_became_peered":"2023-11-30T18:39:37.341312+0000","last_unstale":"2023-11-30T18:39:37.345480+0000","last_undegraded":"2023-11-30T18:39:37.345480+0000","last_fullsized":"2023-11-30T18:39:37.345480+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346986+0000","last_change":"2023-11-30T18:39:36.952827+0000","last_active":"2023-11-30T18:39:37.346986+0000","last_peered":"2023-11-30T18:39:37.346986+0000","last_clean":"2023-11-30T18:39:37.346986+0000","last_became_active":"2023-11-30T18:39:36.952608+0000","last_became_peered":"2023-11-30T18:39:36.952608+0000","last_unstale":"2023-11-30T18:39:37.346986+0000","last_undegraded":"2023-11-30T18:39:37.346986+0000","last_fullsized":"2023-11-30T18:39:37.346986+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.342144+0000","last_change":"2023-11-30T18:39:37.339035+0000","last_active":"2023-11-30T18:39:37.342144+0000","last_peered":"2023-11-30T18:39:37.342144+0000","last_clean":"2023-11-30T18:39:37.342144+0000","last_became_active":"2023-11-30T18:39:37.338479+0000","last_became_peered":"2023-11-30T18:39:37.338479+0000","last_unstale":"2023-11-30T18:39:37.342144+0000","last_undegraded":"2023-11-30T18:39:37.342144+0000","last_fullsized":"2023-11-30T18:39:37.342144+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"202'2","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.340898+0000","last_change":"2023-11-30T18:39:36.944227+0000","last_active":"2023-11-30T18:39:37.340898+0000","last_peered":"2023-11-30T18:39:37.340898+0000","last_clean":"2023-11-30T18:39:37.340898+0000","last_became_active":"2023-11-30T18:39:36.944014+0000","last_became_peered":"2023-11-30T18:39:36.944014+0000","last_unstale":"2023-11-30T18:39:37.340898+0000","last_undegraded":"2023-11-30T18:39:37.340898+0000","last_fullsized":"2023-11-30T18:39:37.340898+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346109+0000","last_change":"2023-11-30T18:39:37.338996+0000","last_active":"2023-11-30T18:39:37.346109+0000","last_peered":"2023-11-30T18:39:37.346109+0000","last_clean":"2023-11-30T18:39:37.346109+0000","last_became_active":"2023-11-30T18:39:37.338697+0000","last_became_peered":"2023-11-30T18:39:37.338697+0000","last_unstale":"2023-11-30T18:39:37.346109+0000","last_undegraded":"2023-11-30T18:39:37.346109+0000","last_fullsized":"2023-11-30T18:39:37.346109+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.325152+0000","last_change":"2023-11-30T18:39:36.946452+0000","last_active":"2023-11-30T18:39:37.325152+0000","last_peered":"2023-11-30T18:39:37.325152+0000","last_clean":"2023-11-30T18:39:37.325152+0000","last_became_active":"2023-11-30T18:39:36.946158+0000","last_became_peered":"2023-11-30T18:39:36.946158+0000","last_unstale":"2023-11-30T18:39:37.325152+0000","last_undegraded":"2023-11-30T18:39:37.325152+0000","last_fullsized":"2023-11-30T18:39:37.325152+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.350555+0000","last_change":"2023-11-30T18:39:37.347669+0000","last_active":"2023-11-30T18:39:37.350555+0000","last_peered":"2023-11-30T18:39:37.350555+0000","last_clean":"2023-11-30T18:39:37.350555+0000","last_became_active":"2023-11-30T18:39:37.347353+0000","last_became_peered":"2023-11-30T18:39:37.347353+0000","last_unstale":"2023-11-30T18:39:37.350555+0000","last_undegraded":"2023-11-30T18:39:37.350555+0000","last_fullsized":"2023-11-30T18:39:37.350555+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.326852+0000","last_change":"2023-11-30T18:39:36.948868+0000","last_active":"2023-11-30T18:39:37.326852+0000","last_peered":"2023-11-30T18:39:37.326852+0000","last_clean":"2023-11-30T18:39:37.326852+0000","last_became_active":"2023-11-30T18:39:36.948560+0000","last_became_peered":"2023-11-30T18:39:36.948560+0000","last_unstale":"2023-11-30T18:39:37.326852+0000","last_undegraded":"2023-11-30T18:39:37.326852+0000","last_fullsized":"2023-11-30T18:39:37.326852+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.345333+0000","last_change":"2023-11-30T18:39:37.342635+0000","last_active":"2023-11-30T18:39:37.345333+0000","last_peered":"2023-11-30T18:39:37.345333+0000","last_clean":"2023-11-30T18:39:37.345333+0000","last_became_active":"2023-11-30T18:39:37.342376+0000","last_became_peered":"2023-11-30T18:39:37.342376+0000","last_unstale":"2023-11-30T18:39:37.345333+0000","last_undegraded":"2023-11-30T18:39:37.345333+0000","last_fullsized":"2023-11-30T18:39:37.345333+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327461+0000","last_change":"2023-11-30T18:39:36.944677+0000","last_active":"2023-11-30T18:39:37.327461+0000","last_peered":"2023-11-30T18:39:37.327461+0000","last_clean":"2023-11-30T18:39:37.327461+0000","last_became_active":"2023-11-30T18:39:36.944380+0000","last_became_peered":"2023-11-30T18:39:36.944380+0000","last_unstale":"2023-11-30T18:39:37.327461+0000","last_undegraded":"2023-11-30T18:39:37.327461+0000","last_fullsized":"2023-11-30T18:39:37.327461+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.338865+0000","last_change":"2023-11-30T18:39:37.334416+0000","last_active":"2023-11-30T18:39:37.338865+0000","last_peered":"2023-11-30T18:39:37.338865+0000","last_clean":"2023-11-30T18:39:37.338865+0000","last_became_active":"2023-11-30T18:39:37.334121+0000","last_became_peered":"2023-11-30T18:39:37.334121+0000","last_unstale":"2023-11-30T18:39:37.338865+0000","last_undegraded":"2023-11-30T18:39:37.338865+0000","last_fullsized":"2023-11-30T18:39:37.338865+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.323817+0000","last_change":"2023-11-30T18:39:36.946789+0000","last_active":"2023-11-30T18:39:37.323817+0000","last_peered":"2023-11-30T18:39:37.323817+0000","last_clean":"2023-11-30T18:39:37.323817+0000","last_became_active":"2023-11-30T18:39:36.946341+0000","last_became_peered":"2023-11-30T18:39:36.946341+0000","last_unstale":"2023-11-30T18:39:37.323817+0000","last_undegraded":"2023-11-30T18:39:37.323817+0000","last_fullsized":"2023-11-30T18:39:37.323817+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349417+0000","last_change":"2023-11-30T18:39:37.344746+0000","last_active":"2023-11-30T18:39:37.349417+0000","last_peered":"2023-11-30T18:39:37.349417+0000","last_clean":"2023-11-30T18:39:37.349417+0000","last_became_active":"2023-11-30T18:39:37.344421+0000","last_became_peered":"2023-11-30T18:39:37.344421+0000","last_unstale":"2023-11-30T18:39:37.349417+0000","last_undegraded":"2023-11-30T18:39:37.349417+0000","last_fullsized":"2023-11-30T18:39:37.349417+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327484+0000","last_change":"2023-11-30T18:39:36.950190+0000","last_active":"2023-11-30T18:39:37.327484+0000","last_peered":"2023-11-30T18:39:37.327484+0000","last_clean":"2023-11-30T18:39:37.327484+0000","last_became_active":"2023-11-30T18:39:36.949891+0000","last_became_peered":"2023-11-30T18:39:36.949891+0000","last_unstale":"2023-11-30T18:39:37.327484+0000","last_undegraded":"2023-11-30T18:39:37.327484+0000","last_fullsized":"2023-11-30T18:39:37.327484+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347541+0000","last_change":"2023-11-30T18:39:37.335167+0000","last_active":"2023-11-30T18:39:37.347541+0000","last_peered":"2023-11-30T18:39:37.347541+0000","last_clean":"2023-11-30T18:39:37.347541+0000","last_became_active":"2023-11-30T18:39:37.334308+0000","last_became_peered":"2023-11-30T18:39:37.334308+0000","last_unstale":"2023-11-30T18:39:37.347541+0000","last_undegraded":"2023-11-30T18:39:37.347541+0000","last_fullsized":"2023-11-30T18:39:37.347541+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.351861+0000","last_change":"2023-11-30T18:39:36.952979+0000","last_active":"2023-11-30T18:39:37.351861+0000","last_peered":"2023-11-30T18:39:37.351861+0000","last_clean":"2023-11-30T18:39:37.351861+0000","last_became_active":"2023-11-30T18:39:36.952615+0000","last_became_peered":"2023-11-30T18:39:36.952615+0000","last_unstale":"2023-11-30T18:39:37.351861+0000","last_undegraded":"2023-11-30T18:39:37.351861+0000","last_fullsized":"2023-11-30T18:39:37.351861+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.334851+0000","last_change":"2023-11-30T18:39:37.330696+0000","last_active":"2023-11-30T18:39:37.334851+0000","last_peered":"2023-11-30T18:39:37.334851+0000","last_clean":"2023-11-30T18:39:37.334851+0000","last_became_active":"2023-11-30T18:39:37.330391+0000","last_became_peered":"2023-11-30T18:39:37.330391+0000","last_unstale":"2023-11-30T18:39:37.334851+0000","last_undegraded":"2023-11-30T18:39:37.334851+0000","last_fullsized":"2023-11-30T18:39:37.334851+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"202'2","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.348393+0000","last_change":"2023-11-30T18:39:36.954616+0000","last_active":"2023-11-30T18:39:37.348393+0000","last_peered":"2023-11-30T18:39:37.348393+0000","last_clean":"2023-11-30T18:39:37.348393+0000","last_became_active":"2023-11-30T18:39:36.953752+0000","last_became_peered":"2023-11-30T18:39:36.953752+0000","last_unstale":"2023-11-30T18:39:37.348393+0000","last_undegraded":"2023-11-30T18:39:37.348393+0000","last_fullsized":"2023-11-30T18:39:37.348393+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.345919+0000","last_change":"2023-11-30T18:39:37.341136+0000","last_active":"2023-11-30T18:39:37.345919+0000","last_peered":"2023-11-30T18:39:37.345919+0000","last_clean":"2023-11-30T18:39:37.345919+0000","last_became_active":"2023-11-30T18:39:37.340592+0000","last_became_peered":"2023-11-30T18:39:37.340592+0000","last_unstale":"2023-11-30T18:39:37.345919+0000","last_undegraded":"2023-11-30T18:39:37.345919+0000","last_fullsized":"2023-11-30T18:39:37.345919+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.333794+0000","last_change":"2023-11-30T18:39:36.946600+0000","last_active":"2023-11-30T18:39:37.333794+0000","last_peered":"2023-11-30T18:39:37.333794+0000","last_clean":"2023-11-30T18:39:37.333794+0000","last_became_active":"2023-11-30T18:39:36.946270+0000","last_became_peered":"2023-11-30T18:39:36.946270+0000","last_unstale":"2023-11-30T18:39:37.333794+0000","last_undegraded":"2023-11-30T18:39:37.333794+0000","last_fullsized":"2023-11-30T18:39:37.333794+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.345976+0000","last_change":"2023-11-30T18:39:37.341740+0000","last_active":"2023-11-30T18:39:37.345976+0000","last_peered":"2023-11-30T18:39:37.345976+0000","last_clean":"2023-11-30T18:39:37.345976+0000","last_became_active":"2023-11-30T18:39:37.341314+0000","last_became_peered":"2023-11-30T18:39:37.341314+0000","last_unstale":"2023-11-30T18:39:37.345976+0000","last_undegraded":"2023-11-30T18:39:37.345976+0000","last_fullsized":"2023-11-30T18:39:37.345976+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327189+0000","last_change":"2023-11-30T18:39:36.944458+0000","last_active":"2023-11-30T18:39:37.327189+0000","last_peered":"2023-11-30T18:39:37.327189+0000","last_clean":"2023-11-30T18:39:37.327189+0000","last_became_active":"2023-11-30T18:39:36.944179+0000","last_became_peered":"2023-11-30T18:39:36.944179+0000","last_unstale":"2023-11-30T18:39:37.327189+0000","last_undegraded":"2023-11-30T18:39:37.327189+0000","last_fullsized":"2023-11-30T18:39:37.327189+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.353566+0000","last_change":"2023-11-30T18:39:37.352804+0000","last_active":"2023-11-30T18:39:37.353566+0000","last_peered":"2023-11-30T18:39:37.353566+0000","last_clean":"2023-11-30T18:39:37.353566+0000","last_became_active":"2023-11-30T18:39:37.352435+0000","last_became_peered":"2023-11-30T18:39:37.352435+0000","last_unstale":"2023-11-30T18:39:37.353566+0000","last_undegraded":"2023-11-30T18:39:37.353566+0000","last_fullsized":"2023-11-30T18:39:37.353566+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347239+0000","last_change":"2023-11-30T18:39:36.950997+0000","last_active":"2023-11-30T18:39:37.347239+0000","last_peered":"2023-11-30T18:39:37.347239+0000","last_clean":"2023-11-30T18:39:37.347239+0000","last_became_active":"2023-11-30T18:39:36.950673+0000","last_became_peered":"2023-11-30T18:39:36.950673+0000","last_unstale":"2023-11-30T18:39:37.347239+0000","last_undegraded":"2023-11-30T18:39:37.347239+0000","last_fullsized":"2023-11-30T18:39:37.347239+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352565+0000","last_change":"2023-11-30T18:39:37.351298+0000","last_active":"2023-11-30T18:39:37.352565+0000","last_peered":"2023-11-30T18:39:37.352565+0000","last_clean":"2023-11-30T18:39:37.352565+0000","last_became_active":"2023-11-30T18:39:37.350781+0000","last_became_peered":"2023-11-30T18:39:37.350781+0000","last_unstale":"2023-11-30T18:39:37.352565+0000","last_undegraded":"2023-11-30T18:39:37.352565+0000","last_fullsized":"2023-11-30T18:39:37.352565+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327139+0000","last_change":"2023-11-30T18:39:36.948188+0000","last_active":"2023-11-30T18:39:37.327139+0000","last_peered":"2023-11-30T18:39:37.327139+0000","last_clean":"2023-11-30T18:39:37.327139+0000","last_became_active":"2023-11-30T18:39:36.947873+0000","last_became_peered":"2023-11-30T18:39:36.947873+0000","last_unstale":"2023-11-30T18:39:37.327139+0000","last_undegraded":"2023-11-30T18:39:37.327139+0000","last_fullsized":"2023-11-30T18:39:37.327139+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349380+0000","last_change":"2023-11-30T18:39:37.342904+0000","last_active":"2023-11-30T18:39:37.349380+0000","last_peered":"2023-11-30T18:39:37.349380+0000","last_clean":"2023-11-30T18:39:37.349380+0000","last_became_active":"2023-11-30T18:39:37.342597+0000","last_became_peered":"2023-11-30T18:39:37.342597+0000","last_unstale":"2023-11-30T18:39:37.349380+0000","last_undegraded":"2023-11-30T18:39:37.349380+0000","last_fullsized":"2023-11-30T18:39:37.349380+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.323729+0000","last_change":"2023-11-30T18:39:36.946627+0000","last_active":"2023-11-30T18:39:37.323729+0000","last_peered":"2023-11-30T18:39:37.323729+0000","last_clean":"2023-11-30T18:39:37.323729+0000","last_became_active":"2023-11-30T18:39:36.945813+0000","last_became_peered":"2023-11-30T18:39:36.945813+0000","last_unstale":"2023-11-30T18:39:37.323729+0000","last_undegraded":"2023-11-30T18:39:37.323729+0000","last_fullsized":"2023-11-30T18:39:37.323729+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346095+0000","last_change":"2023-11-30T18:39:37.343145+0000","last_active":"2023-11-30T18:39:37.346095+0000","last_peered":"2023-11-30T18:39:37.346095+0000","last_clean":"2023-11-30T18:39:37.346095+0000","last_became_active":"2023-11-30T18:39:37.342863+0000","last_became_peered":"2023-11-30T18:39:37.342863+0000","last_unstale":"2023-11-30T18:39:37.346095+0000","last_undegraded":"2023-11-30T18:39:37.346095+0000","last_fullsized":"2023-11-30T18:39:37.346095+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.330188+0000","last_change":"2023-11-30T18:39:36.949760+0000","last_active":"2023-11-30T18:39:37.330188+0000","last_peered":"2023-11-30T18:39:37.330188+0000","last_clean":"2023-11-30T18:39:37.330188+0000","last_became_active":"2023-11-30T18:39:36.949139+0000","last_became_peered":"2023-11-30T18:39:36.949139+0000","last_unstale":"2023-11-30T18:39:37.330188+0000","last_undegraded":"2023-11-30T18:39:37.330188+0000","last_fullsized":"2023-11-30T18:39:37.330188+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.336357+0000","last_change":"2023-11-30T18:39:37.333794+0000","last_active":"2023-11-30T18:39:37.336357+0000","last_peered":"2023-11-30T18:39:37.336357+0000","last_clean":"2023-11-30T18:39:37.336357+0000","last_became_active":"2023-11-30T18:39:37.333486+0000","last_became_peered":"2023-11-30T18:39:37.333486+0000","last_unstale":"2023-11-30T18:39:37.336357+0000","last_undegraded":"2023-11-30T18:39:37.336357+0000","last_fullsized":"2023-11-30T18:39:37.336357+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"202'2","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.339149+0000","last_change":"2023-11-30T18:39:36.945986+0000","last_active":"2023-11-30T18:39:37.339149+0000","last_peered":"2023-11-30T18:39:37.339149+0000","last_clean":"2023-11-30T18:39:37.339149+0000","last_became_active":"2023-11-30T18:39:36.945645+0000","last_became_peered":"2023-11-30T18:39:36.945645+0000","last_unstale":"2023-11-30T18:39:37.339149+0000","last_undegraded":"2023-11-30T18:39:37.339149+0000","last_fullsized":"2023-11-30T18:39:37.339149+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.342995+0000","last_change":"2023-11-30T18:39:37.336408+0000","last_active":"2023-11-30T18:39:37.342995+0000","last_peered":"2023-11-30T18:39:37.342995+0000","last_clean":"2023-11-30T18:39:37.342995+0000","last_became_active":"2023-11-30T18:39:37.335738+0000","last_became_peered":"2023-11-30T18:39:37.335738+0000","last_unstale":"2023-11-30T18:39:37.342995+0000","last_undegraded":"2023-11-30T18:39:37.342995+0000","last_fullsized":"2023-11-30T18:39:37.342995+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.337854+0000","last_change":"2023-11-30T18:39:36.955512+0000","last_active":"2023-11-30T18:39:37.337854+0000","last_peered":"2023-11-30T18:39:37.337854+0000","last_clean":"2023-11-30T18:39:37.337854+0000","last_became_active":"2023-11-30T18:39:36.955212+0000","last_became_peered":"2023-11-30T18:39:36.955212+0000","last_unstale":"2023-11-30T18:39:37.337854+0000","last_undegraded":"2023-11-30T18:39:37.337854+0000","last_fullsized":"2023-11-30T18:39:37.337854+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.338579+0000","last_change":"2023-11-30T18:39:37.330346+0000","last_active":"2023-11-30T18:39:37.338579+0000","last_peered":"2023-11-30T18:39:37.338579+0000","last_clean":"2023-11-30T18:39:37.338579+0000","last_became_active":"2023-11-30T18:39:37.330086+0000","last_became_peered":"2023-11-30T18:39:37.330086+0000","last_unstale":"2023-11-30T18:39:37.338579+0000","last_undegraded":"2023-11-30T18:39:37.338579+0000","last_fullsized":"2023-11-30T18:39:37.338579+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.337927+0000","last_change":"2023-11-30T18:39:36.950992+0000","last_active":"2023-11-30T18:39:37.337927+0000","last_peered":"2023-11-30T18:39:37.337927+0000","last_clean":"2023-11-30T18:39:37.337927+0000","last_became_active":"2023-11-30T18:39:36.950695+0000","last_became_peered":"2023-11-30T18:39:36.950695+0000","last_unstale":"2023-11-30T18:39:37.337927+0000","last_undegraded":"2023-11-30T18:39:37.337927+0000","last_fullsized":"2023-11-30T18:39:37.337927+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.344708+0000","last_change":"2023-11-30T18:39:37.331147+0000","last_active":"2023-11-30T18:39:37.344708+0000","last_peered":"2023-11-30T18:39:37.344708+0000","last_clean":"2023-11-30T18:39:37.344708+0000","last_became_active":"2023-11-30T18:39:37.330838+0000","last_became_peered":"2023-11-30T18:39:37.330838+0000","last_unstale":"2023-11-30T18:39:37.344708+0000","last_undegraded":"2023-11-30T18:39:37.344708+0000","last_fullsized":"2023-11-30T18:39:37.344708+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.325251+0000","last_change":"2023-11-30T18:39:36.952569+0000","last_active":"2023-11-30T18:39:37.325251+0000","last_peered":"2023-11-30T18:39:37.325251+0000","last_clean":"2023-11-30T18:39:37.325251+0000","last_became_active":"2023-11-30T18:39:36.952293+0000","last_became_peered":"2023-11-30T18:39:36.952293+0000","last_unstale":"2023-11-30T18:39:37.325251+0000","last_undegraded":"2023-11-30T18:39:37.325251+0000","last_fullsized":"2023-11-30T18:39:37.325251+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352722+0000","last_change":"2023-11-30T18:39:37.350409+0000","last_active":"2023-11-30T18:39:37.352722+0000","last_peered":"2023-11-30T18:39:37.352722+0000","last_clean":"2023-11-30T18:39:37.352722+0000","last_became_active":"2023-11-30T18:39:37.350135+0000","last_became_peered":"2023-11-30T18:39:37.350135+0000","last_unstale":"2023-11-30T18:39:37.352722+0000","last_undegraded":"2023-11-30T18:39:37.352722+0000","last_fullsized":"2023-11-30T18:39:37.352722+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.338222+0000","last_change":"2023-11-30T18:39:36.946783+0000","last_active":"2023-11-30T18:39:37.338222+0000","last_peered":"2023-11-30T18:39:37.338222+0000","last_clean":"2023-11-30T18:39:37.338222+0000","last_became_active":"2023-11-30T18:39:36.946533+0000","last_became_peered":"2023-11-30T18:39:36.946533+0000","last_unstale":"2023-11-30T18:39:37.338222+0000","last_undegraded":"2023-11-30T18:39:37.338222+0000","last_fullsized":"2023-11-30T18:39:37.338222+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346709+0000","last_change":"2023-11-30T18:39:37.343014+0000","last_active":"2023-11-30T18:39:37.346709+0000","last_peered":"2023-11-30T18:39:37.346709+0000","last_clean":"2023-11-30T18:39:37.346709+0000","last_became_active":"2023-11-30T18:39:37.342723+0000","last_became_peered":"2023-11-30T18:39:37.342723+0000","last_unstale":"2023-11-30T18:39:37.346709+0000","last_undegraded":"2023-11-30T18:39:37.346709+0000","last_fullsized":"2023-11-30T18:39:37.346709+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.336615+0000","last_change":"2023-11-30T18:39:36.946283+0000","last_active":"2023-11-30T18:39:37.336615+0000","last_peered":"2023-11-30T18:39:37.336615+0000","last_clean":"2023-11-30T18:39:37.336615+0000","last_became_active":"2023-11-30T18:39:36.946000+0000","last_became_peered":"2023-11-30T18:39:36.946000+0000","last_unstale":"2023-11-30T18:39:37.336615+0000","last_undegraded":"2023-11-30T18:39:37.336615+0000","last_fullsized":"2023-11-30T18:39:37.336615+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.353262+0000","last_change":"2023-11-30T18:39:37.352247+0000","last_active":"2023-11-30T18:39:37.353262+0000","last_peered":"2023-11-30T18:39:37.353262+0000","last_clean":"2023-11-30T18:39:37.353262+0000","last_became_active":"2023-11-30T18:39:37.351956+0000","last_became_peered":"2023-11-30T18:39:37.351956+0000","last_unstale":"2023-11-30T18:39:37.353262+0000","last_undegraded":"2023-11-30T18:39:37.353262+0000","last_fullsized":"2023-11-30T18:39:37.353262+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327175+0000","last_change":"2023-11-30T18:39:36.944204+0000","last_active":"2023-11-30T18:39:37.327175+0000","last_peered":"2023-11-30T18:39:37.327175+0000","last_clean":"2023-11-30T18:39:37.327175+0000","last_became_active":"2023-11-30T18:39:36.943937+0000","last_became_peered":"2023-11-30T18:39:36.943937+0000","last_unstale":"2023-11-30T18:39:37.327175+0000","last_undegraded":"2023-11-30T18:39:37.327175+0000","last_fullsized":"2023-11-30T18:39:37.327175+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.344165+0000","last_change":"2023-11-30T18:39:37.340873+0000","last_active":"2023-11-30T18:39:37.344165+0000","last_peered":"2023-11-30T18:39:37.344165+0000","last_clean":"2023-11-30T18:39:37.344165+0000","last_became_active":"2023-11-30T18:39:37.340580+0000","last_became_peered":"2023-11-30T18:39:37.340580+0000","last_unstale":"2023-11-30T18:39:37.344165+0000","last_undegraded":"2023-11-30T18:39:37.344165+0000","last_fullsized":"2023-11-30T18:39:37.344165+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.326374+0000","last_change":"2023-11-30T18:39:36.950400+0000","last_active":"2023-11-30T18:39:37.326374+0000","last_peered":"2023-11-30T18:39:37.326374+0000","last_clean":"2023-11-30T18:39:37.326374+0000","last_became_active":"2023-11-30T18:39:36.949951+0000","last_became_peered":"2023-11-30T18:39:36.949951+0000","last_unstale":"2023-11-30T18:39:37.326374+0000","last_undegraded":"2023-11-30T18:39:37.326374+0000","last_fullsized":"2023-11-30T18:39:37.326374+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.342774+0000","last_change":"2023-11-30T18:39:37.334735+0000","last_active":"2023-11-30T18:39:37.342774+0000","last_peered":"2023-11-30T18:39:37.342774+0000","last_clean":"2023-11-30T18:39:37.342774+0000","last_became_active":"2023-11-30T18:39:37.334250+0000","last_became_peered":"2023-11-30T18:39:37.334250+0000","last_unstale":"2023-11-30T18:39:37.342774+0000","last_undegraded":"2023-11-30T18:39:37.342774+0000","last_fullsized":"2023-11-30T18:39:37.342774+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.326966+0000","last_change":"2023-11-30T18:39:36.944158+0000","last_active":"2023-11-30T18:39:37.326966+0000","last_peered":"2023-11-30T18:39:37.326966+0000","last_clean":"2023-11-30T18:39:37.326966+0000","last_became_active":"2023-11-30T18:39:36.943851+0000","last_became_peered":"2023-11-30T18:39:36.943851+0000","last_unstale":"2023-11-30T18:39:37.326966+0000","last_undegraded":"2023-11-30T18:39:37.326966+0000","last_fullsized":"2023-11-30T18:39:37.326966+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":171,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327395+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T18:39:37.327395+0000","last_peered":"2023-11-30T18:39:37.327395+0000","last_clean":"2023-11-30T18:39:37.327395+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T18:39:37.327395+0000","last_undegraded":"2023-11-30T18:39:37.327395+0000","last_fullsized":"2023-11-30T18:39:37.327395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347342+0000","last_change":"2023-11-30T18:39:37.340048+0000","last_active":"2023-11-30T18:39:37.347342+0000","last_peered":"2023-11-30T18:39:37.347342+0000","last_clean":"2023-11-30T18:39:37.347342+0000","last_became_active":"2023-11-30T18:39:37.339749+0000","last_became_peered":"2023-11-30T18:39:37.339749+0000","last_unstale":"2023-11-30T18:39:37.347342+0000","last_undegraded":"2023-11-30T18:39:37.347342+0000","last_fullsized":"2023-11-30T18:39:37.347342+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.336922+0000","last_change":"2023-11-30T18:39:36.954943+0000","last_active":"2023-11-30T18:39:37.336922+0000","last_peered":"2023-11-30T18:39:37.336922+0000","last_clean":"2023-11-30T18:39:37.336922+0000","last_became_active":"2023-11-30T18:39:36.954644+0000","last_became_peered":"2023-11-30T18:39:36.954644+0000","last_unstale":"2023-11-30T18:39:37.336922+0000","last_undegraded":"2023-11-30T18:39:37.336922+0000","last_fullsized":"2023-11-30T18:39:37.336922+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":169,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327150+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T18:39:37.327150+0000","last_peered":"2023-11-30T18:39:37.327150+0000","last_clean":"2023-11-30T18:39:37.327150+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T18:39:37.327150+0000","last_undegraded":"2023-11-30T18:39:37.327150+0000","last_fullsized":"2023-11-30T18:39:37.327150+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.344506+0000","last_change":"2023-11-30T18:39:37.342072+0000","last_active":"2023-11-30T18:39:37.344506+0000","last_peered":"2023-11-30T18:39:37.344506+0000","last_clean":"2023-11-30T18:39:37.344506+0000","last_became_active":"2023-11-30T18:39:37.341885+0000","last_became_peered":"2023-11-30T18:39:37.341885+0000","last_unstale":"2023-11-30T18:39:37.344506+0000","last_undegraded":"2023-11-30T18:39:37.344506+0000","last_fullsized":"2023-11-30T18:39:37.344506+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"202'2","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347830+0000","last_change":"2023-11-30T18:39:36.951915+0000","last_active":"2023-11-30T18:39:37.347830+0000","last_peered":"2023-11-30T18:39:37.347830+0000","last_clean":"2023-11-30T18:39:37.347830+0000","last_became_active":"2023-11-30T18:39:36.951639+0000","last_became_peered":"2023-11-30T18:39:36.951639+0000","last_unstale":"2023-11-30T18:39:37.347830+0000","last_undegraded":"2023-11-30T18:39:37.347830+0000","last_fullsized":"2023-11-30T18:39:37.347830+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.323644+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T18:39:37.323644+0000","last_peered":"2023-11-30T18:39:37.323644+0000","last_clean":"2023-11-30T18:39:37.323644+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T18:39:37.323644+0000","last_undegraded":"2023-11-30T18:39:37.323644+0000","last_fullsized":"2023-11-30T18:39:37.323644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.345987+0000","last_change":"2023-11-30T18:39:37.339470+0000","last_active":"2023-11-30T18:39:37.345987+0000","last_peered":"2023-11-30T18:39:37.345987+0000","last_clean":"2023-11-30T18:39:37.345987+0000","last_became_active":"2023-11-30T18:39:37.339218+0000","last_became_peered":"2023-11-30T18:39:37.339218+0000","last_unstale":"2023-11-30T18:39:37.345987+0000","last_undegraded":"2023-11-30T18:39:37.345987+0000","last_fullsized":"2023-11-30T18:39:37.345987+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.337752+0000","last_change":"2023-11-30T18:39:36.957232+0000","last_active":"2023-11-30T18:39:37.337752+0000","last_peered":"2023-11-30T18:39:37.337752+0000","last_clean":"2023-11-30T18:39:37.337752+0000","last_became_active":"2023-11-30T18:39:36.956927+0000","last_became_peered":"2023-11-30T18:39:36.956927+0000","last_unstale":"2023-11-30T18:39:37.337752+0000","last_undegraded":"2023-11-30T18:39:37.337752+0000","last_fullsized":"2023-11-30T18:39:37.337752+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":169,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327987+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T18:39:37.327987+0000","last_peered":"2023-11-30T18:39:37.327987+0000","last_clean":"2023-11-30T18:39:37.327987+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T18:39:37.327987+0000","last_undegraded":"2023-11-30T18:39:37.327987+0000","last_fullsized":"2023-11-30T18:39:37.327987+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":165,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.330242+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T18:39:37.330242+0000","last_peered":"2023-11-30T18:39:37.330242+0000","last_clean":"2023-11-30T18:39:37.330242+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T18:39:37.330242+0000","last_undegraded":"2023-11-30T18:39:37.330242+0000","last_fullsized":"2023-11-30T18:39:37.330242+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349079+0000","last_change":"2023-11-30T18:39:37.345111+0000","last_active":"2023-11-30T18:39:37.349079+0000","last_peered":"2023-11-30T18:39:37.349079+0000","last_clean":"2023-11-30T18:39:37.349079+0000","last_became_active":"2023-11-30T18:39:37.344811+0000","last_became_peered":"2023-11-30T18:39:37.344811+0000","last_unstale":"2023-11-30T18:39:37.349079+0000","last_undegraded":"2023-11-30T18:39:37.349079+0000","last_fullsized":"2023-11-30T18:39:37.349079+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"202'3","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349684+0000","last_change":"2023-11-30T18:39:36.954554+0000","last_active":"2023-11-30T18:39:37.349684+0000","last_peered":"2023-11-30T18:39:37.349684+0000","last_clean":"2023-11-30T18:39:37.349684+0000","last_became_active":"2023-11-30T18:39:36.954255+0000","last_became_peered":"2023-11-30T18:39:36.954255+0000","last_unstale":"2023-11-30T18:39:37.349684+0000","last_undegraded":"2023-11-30T18:39:37.349684+0000","last_fullsized":"2023-11-30T18:39:37.349684+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":163,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.330312+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T18:39:37.330312+0000","last_peered":"2023-11-30T18:39:37.330312+0000","last_clean":"2023-11-30T18:39:37.330312+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T18:39:37.330312+0000","last_undegraded":"2023-11-30T18:39:37.330312+0000","last_fullsized":"2023-11-30T18:39:37.330312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352219+0000","last_change":"2023-11-30T18:39:37.351640+0000","last_active":"2023-11-30T18:39:37.352219+0000","last_peered":"2023-11-30T18:39:37.352219+0000","last_clean":"2023-11-30T18:39:37.352219+0000","last_became_active":"2023-11-30T18:39:37.350854+0000","last_became_peered":"2023-11-30T18:39:37.350854+0000","last_unstale":"2023-11-30T18:39:37.352219+0000","last_undegraded":"2023-11-30T18:39:37.352219+0000","last_fullsized":"2023-11-30T18:39:37.352219+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"202'4","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.351107+0000","last_change":"2023-11-30T18:39:36.949816+0000","last_active":"2023-11-30T18:39:37.351107+0000","last_peered":"2023-11-30T18:39:37.351107+0000","last_clean":"2023-11-30T18:39:37.351107+0000","last_became_active":"2023-11-30T18:39:36.949516+0000","last_became_peered":"2023-11-30T18:39:36.949516+0000","last_unstale":"2023-11-30T18:39:37.351107+0000","last_undegraded":"2023-11-30T18:39:37.351107+0000","last_fullsized":"2023-11-30T18:39:37.351107+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":163,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.331043+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T18:39:37.331043+0000","last_peered":"2023-11-30T18:39:37.331043+0000","last_clean":"2023-11-30T18:39:37.331043+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T18:39:37.331043+0000","last_undegraded":"2023-11-30T18:39:37.331043+0000","last_fullsized":"2023-11-30T18:39:37.331043+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346595+0000","last_change":"2023-11-30T18:39:37.341865+0000","last_active":"2023-11-30T18:39:37.346595+0000","last_peered":"2023-11-30T18:39:37.346595+0000","last_clean":"2023-11-30T18:39:37.346595+0000","last_became_active":"2023-11-30T18:39:37.341560+0000","last_became_peered":"2023-11-30T18:39:37.341560+0000","last_unstale":"2023-11-30T18:39:37.346595+0000","last_undegraded":"2023-11-30T18:39:37.346595+0000","last_fullsized":"2023-11-30T18:39:37.346595+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347149+0000","last_change":"2023-11-30T18:39:36.954951+0000","last_active":"2023-11-30T18:39:37.347149+0000","last_peered":"2023-11-30T18:39:37.347149+0000","last_clean":"2023-11-30T18:39:37.347149+0000","last_became_active":"2023-11-30T18:39:36.954635+0000","last_became_peered":"2023-11-30T18:39:36.954635+0000","last_unstale":"2023-11-30T18:39:37.347149+0000","last_undegraded":"2023-11-30T18:39:37.347149+0000","last_fullsized":"2023-11-30T18:39:37.347149+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":171,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.329562+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T18:39:37.329562+0000","last_peered":"2023-11-30T18:39:37.329562+0000","last_clean":"2023-11-30T18:39:37.329562+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T18:39:37.329562+0000","last_undegraded":"2023-11-30T18:39:37.329562+0000","last_fullsized":"2023-11-30T18:39:37.329562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347365+0000","last_change":"2023-11-30T18:39:37.343550+0000","last_active":"2023-11-30T18:39:37.347365+0000","last_peered":"2023-11-30T18:39:37.347365+0000","last_clean":"2023-11-30T18:39:37.347365+0000","last_became_active":"2023-11-30T18:39:37.343269+0000","last_became_peered":"2023-11-30T18:39:37.343269+0000","last_unstale":"2023-11-30T18:39:37.347365+0000","last_undegraded":"2023-11-30T18:39:37.347365+0000","last_fullsized":"2023-11-30T18:39:37.347365+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.336520+0000","last_change":"2023-11-30T18:39:36.944024+0000","last_active":"2023-11-30T18:39:37.336520+0000","last_peered":"2023-11-30T18:39:37.336520+0000","last_clean":"2023-11-30T18:39:37.336520+0000","last_became_active":"2023-11-30T18:39:36.943512+0000","last_became_peered":"2023-11-30T18:39:36.943512+0000","last_unstale":"2023-11-30T18:39:37.336520+0000","last_undegraded":"2023-11-30T18:39:37.336520+0000","last_fullsized":"2023-11-30T18:39:37.336520+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":190,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.325425+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T18:39:37.325425+0000","last_peered":"2023-11-30T18:39:37.325425+0000","last_clean":"2023-11-30T18:39:37.325425+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T18:39:37.325425+0000","last_undegraded":"2023-11-30T18:39:37.325425+0000","last_fullsized":"2023-11-30T18:39:37.325425+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575950,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303676,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068164,"statfs":{"total":96636764160,"available":96325799936,"internally_reserved":0,"allocated":2543616,"data_stored":1304277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.629,"15min":0.626},"min":{"1min":0.39200000000000002,"5min":0.35499999999999998,"15min":0.28699999999999998},"max":{"1min":0.81399999999999995,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.63200000000000001,"15min":0.63500000000000001},"min":{"1min":0.502,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77200000000000002,"5min":0.80600000000000005,"15min":0.82099999999999995},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.42999999999999999,"5min":0.40699999999999997,"15min":0.35899999999999999},"max":{"1min":0.70399999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.41999999999999998,"5min":0.38700000000000001,"15min":0.379},"max":{"1min":0.74399999999999999,"5min":0.877,"15min":0.877},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.44800000000000001,"5min":0.41699999999999998,"15min":0.379},"max":{"1min":0.66700000000000004,"5min":0.80500000000000005,"15min":0.81100000000000005},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58599999999999997,"15min":0.59299999999999997},"min":{"1min":0.47599999999999998,"5min":0.43099999999999999,"15min":0.38700000000000001},"max":{"1min":0.72699999999999998,"5min":0.82599999999999996,"15min":0.85399999999999998},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.40200000000000002,"5min":0.36699999999999999,"15min":0.35899999999999999},"max":{"1min":0.69299999999999995,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.47499999999999998,"5min":0.41899999999999998,"15min":0.41799999999999998},"max":{"1min":0.75600000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46500000000000002,"15min":0.46300000000000002},"min":{"1min":0.36799999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.52600000000000002,"5min":0.81100000000000005,"15min":0.83799999999999997},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.49199999999999999,"15min":0.48999999999999999},"min":{"1min":0.371,"5min":0.308,"15min":0.29099999999999998},"max":{"1min":0.624,"5min":0.67200000000000004,"15min":0.80500000000000005},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.505,"15min":0.5},"min":{"1min":0.36799999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78200000000000003,"5min":0.79100000000000004,"15min":0.83399999999999996},"last":0.374},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35399999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68300000000000005,"5min":0.78600000000000003,"15min":0.88200000000000001},"last":0.35399999999999998}]},{"osd":6,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56899999999999995,"15min":0.56399999999999995},"min":{"1min":0.40200000000000002,"5min":0.36699999999999999,"15min":0.32300000000000001},"max":{"1min":0.68400000000000005,"5min":0.84999999999999998,"15min":0.90800000000000003},"last":0.499},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55700000000000005,"15min":0.55900000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76300000000000001,"5min":0.81200000000000006,"15min":0.85199999999999998},"last":0.41199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575949,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307768,"kb_used_data":2480,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064072,"statfs":{"total":96636764160,"available":96321609728,"internally_reserved":0,"allocated":2539520,"data_stored":1303723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60499999999999998,"15min":0.61099999999999999},"min":{"1min":0.35399999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.72799999999999998,"5min":0.80700000000000005,"15min":1.6379999999999999},"last":0.629},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.629,"15min":0.625},"min":{"1min":0.49299999999999999,"5min":0.42499999999999999,"15min":0.27800000000000002},"max":{"1min":0.77500000000000002,"5min":0.84899999999999998,"15min":1.246},"last":0.66000000000000003}]},{"osd":1,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.31900000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.76500000000000001,"5min":0.86599999999999999,"15min":1.1200000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.624,"15min":0.63100000000000001},"min":{"1min":0.42199999999999999,"5min":0.41899999999999998,"15min":0.35499999999999998},"max":{"1min":0.753,"5min":0.81599999999999995,"15min":0.90400000000000003},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59799999999999998,"15min":0.59899999999999998},"min":{"1min":0.40699999999999997,"5min":0.40000000000000002,"15min":0.34499999999999997},"max":{"1min":0.71899999999999997,"5min":0.85299999999999998,"15min":1.288},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61599999999999999,"15min":0.63},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":0.74199999999999999,"5min":0.84599999999999997,"15min":1.177},"last":0.67000000000000004}]},{"osd":3,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55800000000000005,"15min":0.57499999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.33400000000000002},"max":{"1min":0.70599999999999996,"5min":0.79600000000000004,"15min":1.204},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.40200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.67600000000000005,"5min":0.80100000000000005,"15min":1.337},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.443,"15min":0.46800000000000003},"min":{"1min":0.34399999999999997,"5min":0.315,"15min":0.28699999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":1.51},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.49199999999999999},"min":{"1min":0.34999999999999998,"5min":0.32800000000000001,"15min":0.30399999999999999},"max":{"1min":0.69899999999999995,"5min":0.71599999999999997,"15min":0.94299999999999995},"last":0.37}]},{"osd":5,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.45700000000000002,"15min":0.47199999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":1.159},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.503,"15min":0.52700000000000002},"min":{"1min":0.42399999999999999,"5min":0.35199999999999998,"15min":0.32500000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":1.679},"last":0.40200000000000002}]},{"osd":7,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52200000000000002,"15min":0.54000000000000004},"min":{"1min":0.36799999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.96199999999999997},"last":0.502},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55700000000000005,"15min":0.57699999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":1.427},"last":0.46700000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575949,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307772,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064068,"statfs":{"total":96636764160,"available":96321605632,"internally_reserved":0,"allocated":2543616,"data_stored":1303475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.377,"15min":0.38},"min":{"1min":0.27500000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.66300000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.50700000000000001,"15min":0.51000000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.35799999999999998},"max":{"1min":0.77400000000000002,"5min":0.87,"15min":0.87},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40699999999999997,"15min":0.41199999999999998},"min":{"1min":0.28699999999999998,"5min":0.26700000000000002,"15min":0.26200000000000001},"max":{"1min":0.64700000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.40100000000000002,"5min":0.372,"15min":0.37},"max":{"1min":0.80300000000000005,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.48099999999999998,"15min":0.47799999999999998},"min":{"1min":0.33800000000000002,"5min":0.33500000000000002,"15min":0.318},"max":{"1min":0.72899999999999998,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45500000000000002,"15min":0.46000000000000002},"min":{"1min":0.33400000000000002,"5min":0.313,"15min":0.311},"max":{"1min":0.71399999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.28799999999999998}]},{"osd":4,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.59899999999999998,"15min":0.61899999999999999},"min":{"1min":0.41099999999999998,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.93999999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66800000000000004,"15min":0.67000000000000004},"min":{"1min":0.50600000000000001,"5min":0.49199999999999999,"15min":0.42299999999999999},"max":{"1min":1.0329999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.62,"15min":0.63300000000000001},"min":{"1min":0.48899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63900000000000001,"15min":0.64600000000000002},"min":{"1min":0.47799999999999998,"5min":0.45000000000000001,"15min":0.39200000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.98099999999999998},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70299999999999996,"15min":0.70499999999999996},"min":{"1min":0.51100000000000001,"5min":0.498,"15min":0.443},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.68000000000000005,"15min":0.69199999999999995},"min":{"1min":0.51400000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.86299999999999999,"5min":1.004,"15min":1.0169999999999999},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69599999999999995,"15min":0.71199999999999997},"min":{"1min":0.51400000000000001,"5min":0.48999999999999999,"15min":0.46100000000000002},"max":{"1min":0.91000000000000003,"5min":0.97499999999999998,"15min":1.012},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68600000000000005,"15min":0.69699999999999995},"min":{"1min":0.57499999999999996,"5min":0.51800000000000002,"15min":0.47699999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.02},"last":0.64300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575949,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307768,"kb_used_data":2480,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064072,"statfs":{"total":96636764160,"available":96321609728,"internally_reserved":0,"allocated":2539520,"data_stored":1302865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.38800000000000001,"15min":0.39500000000000002},"min":{"1min":0.252,"5min":0.25,"15min":0.22900000000000001},"max":{"1min":0.50900000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.439,"5min":0.42099999999999999,"15min":0.42199999999999999},"min":{"1min":0.33500000000000002,"5min":0.27300000000000002,"15min":0.252},"max":{"1min":0.58299999999999996,"5min":0.65100000000000002,"15min":0.71399999999999997},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41199999999999998,"15min":0.41699999999999998},"min":{"1min":0.33000000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.55100000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.49099999999999999,"15min":0.5},"min":{"1min":0.40600000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.74199999999999999},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.45800000000000002,"15min":0.46200000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64400000000000002,"5min":0.69899999999999995,"15min":0.71799999999999997},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46500000000000002,"15min":0.47499999999999998},"min":{"1min":0.36599999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.60399999999999998,"5min":0.68000000000000005,"15min":0.70599999999999996},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63,"15min":0.64100000000000001},"min":{"1min":0.55900000000000005,"5min":0.40200000000000002,"15min":0.39900000000000002},"max":{"1min":0.79700000000000004,"5min":0.90600000000000003,"15min":1.0549999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.65800000000000003},"min":{"1min":0.55900000000000005,"5min":0.45100000000000001,"15min":0.442},"max":{"1min":0.77900000000000003,"5min":1.026,"15min":1.163},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.626,"15min":0.64100000000000001},"min":{"1min":0.50600000000000001,"5min":0.443,"15min":0.40400000000000003},"max":{"1min":0.78700000000000003,"5min":0.91600000000000004,"15min":1.0649999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.66800000000000004,"15min":0.67200000000000004},"min":{"1min":0.52400000000000002,"5min":0.47199999999999998,"15min":0.439},"max":{"1min":0.84799999999999998,"5min":0.998,"15min":1.1799999999999999},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.67700000000000005,"15min":0.68700000000000006},"min":{"1min":0.55100000000000005,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.873,"5min":0.94199999999999995,"15min":1.079},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66900000000000004,"15min":0.68300000000000005},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.41499999999999998},"max":{"1min":0.86099999999999999,"5min":1.0129999999999999,"15min":1.147},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69799999999999995,"15min":0.70599999999999996},"min":{"1min":0.55900000000000005,"5min":0.49199999999999999,"15min":0.47399999999999998},"max":{"1min":0.88700000000000001,"5min":1.0469999999999999,"15min":1.22},"last":0.875},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72099999999999997,"15min":0.73399999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.81799999999999995,"5min":1.0640000000000001,"15min":1.117},"last":0.92800000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575949,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311864,"kb_used_data":2480,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059976,"statfs":{"total":96636764160,"available":96317415424,"internally_reserved":0,"allocated":2539520,"data_stored":1302901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.41999999999999998,"15min":0.41199999999999998},"min":{"1min":0.30099999999999999,"5min":0.249,"15min":0.23200000000000001},"max":{"1min":0.60399999999999998,"5min":0.64800000000000002,"15min":0.72099999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45700000000000002,"15min":0.46000000000000002},"min":{"1min":0.32600000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.58599999999999997,"5min":0.65000000000000002,"15min":0.73199999999999998},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45800000000000002,"15min":0.46100000000000002},"min":{"1min":0.34300000000000003,"5min":0.33100000000000002,"15min":0.29699999999999999},"max":{"1min":0.63900000000000001,"5min":0.70599999999999996,"15min":0.74299999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.496,"15min":0.49399999999999999},"min":{"1min":0.40899999999999997,"5min":0.35599999999999998,"15min":0.29899999999999999},"max":{"1min":0.66100000000000003,"5min":0.746,"15min":0.752},"last":0.379}]},{"osd":3,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.42799999999999999,"15min":0.42299999999999999},"min":{"1min":0.315,"5min":0.28399999999999997,"15min":0.27300000000000002},"max":{"1min":0.55000000000000004,"5min":0.61399999999999999,"15min":0.65100000000000002},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.503,"15min":0.499},"min":{"1min":0.433,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.69099999999999995,"5min":0.75900000000000001,"15min":0.77100000000000002},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.52100000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.95299999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63200000000000001,"15min":0.63900000000000001},"min":{"1min":0.46000000000000002,"5min":0.42799999999999999,"15min":0.35499999999999998},"max":{"1min":0.90500000000000003,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65400000000000003,"15min":0.66400000000000003},"min":{"1min":0.51200000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.84099999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.47199999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.91700000000000004,"5min":1.01,"15min":1.01},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64900000000000002,"15min":0.65200000000000002},"min":{"1min":0.52100000000000002,"5min":0.443,"15min":0.40500000000000003},"max":{"1min":0.86699999999999999,"5min":0.93000000000000005,"15min":0.93200000000000005},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.69399999999999995,"15min":0.69699999999999995},"min":{"1min":0.54300000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93999999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69099999999999995,"15min":0.69499999999999995},"min":{"1min":0.53500000000000003,"5min":0.47499999999999998,"15min":0.47299999999999998},"max":{"1min":0.95399999999999996,"5min":0.97799999999999998,"15min":1.0109999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71099999999999997,"15min":0.71799999999999997},"min":{"1min":0.55700000000000005,"5min":0.44,"15min":0.44},"max":{"1min":0.95199999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.70799999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575949,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299712,"kb_used_data":2488,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072128,"statfs":{"total":96636764160,"available":96329859072,"internally_reserved":0,"allocated":2547712,"data_stored":1303497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.373,"15min":0.38},"min":{"1min":0.29499999999999998,"5min":0.222,"15min":0.222},"max":{"1min":0.59099999999999997,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.42699999999999999,"15min":0.42499999999999999},"min":{"1min":0.31,"5min":0.28699999999999998,"15min":0.28199999999999997},"max":{"1min":0.63700000000000001,"5min":0.70299999999999996,"15min":0.754},"last":0.504}]},{"osd":1,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40000000000000002,"15min":0.40400000000000003},"min":{"1min":0.29899999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58099999999999996,"5min":0.66500000000000004,"15min":0.73399999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44500000000000001,"15min":0.45300000000000001},"min":{"1min":0.315,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.51800000000000002,"5min":0.67700000000000005,"15min":0.86699999999999999},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.47299999999999998,"15min":0.47699999999999998},"min":{"1min":0.39000000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.59899999999999998,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51400000000000001,"15min":0.52400000000000002},"min":{"1min":0.40899999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.65600000000000003,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.63}]},{"osd":4,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63200000000000001,"15min":0.64100000000000001},"min":{"1min":0.51100000000000001,"5min":0.40200000000000002,"15min":0.35299999999999998},"max":{"1min":0.84799999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.64000000000000001,"15min":0.65100000000000002},"min":{"1min":0.40400000000000003,"5min":0.40300000000000002,"15min":0.40100000000000002},"max":{"1min":0.77400000000000002,"5min":0.97799999999999998,"15min":1.0049999999999999},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63600000000000001,"15min":0.64600000000000002},"min":{"1min":0.52000000000000002,"5min":0.44600000000000001,"15min":0.40699999999999997},"max":{"1min":0.89400000000000002,"5min":1.04,"15min":1.04},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65500000000000003,"15min":0.66800000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.34499999999999997},"max":{"1min":0.82999999999999996,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.79200000000000004}]},{"osd":6,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67200000000000004,"15min":0.68400000000000005},"min":{"1min":0.499,"5min":0.45000000000000001,"15min":0.377},"max":{"1min":0.88800000000000001,"5min":1.0189999999999999,"15min":1.0309999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66300000000000003,"15min":0.68500000000000005},"min":{"1min":0.48199999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92900000000000005,"5min":0.99399999999999999,"15min":1.0129999999999999},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68300000000000005,"15min":0.70399999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.872,"5min":1.0009999999999999,"15min":1.052},"last":0.747},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68300000000000005,"15min":0.70499999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.81299999999999994,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.80500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575949,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303680,"kb_used_data":2488,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068160,"statfs":{"total":96636764160,"available":96325795840,"internally_reserved":0,"allocated":2547712,"data_stored":1303013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53900000000000003,"15min":0.56200000000000006},"min":{"1min":0.36199999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72999999999999998,"5min":0.79400000000000004,"15min":0.85499999999999998},"last":0.316},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.374,"5min":0.34100000000000003,"15min":0.32500000000000001},"max":{"1min":0.76800000000000002,"5min":0.79300000000000004,"15min":0.94999999999999996},"last":0.436}]},{"osd":1,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56899999999999995,"15min":0.57299999999999995},"min":{"1min":0.41799999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.72199999999999998,"5min":0.86599999999999999,"15min":0.876},"last":0.371},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.67400000000000004,"5min":0.79300000000000004,"15min":0.91200000000000003},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.60599999999999998},"min":{"1min":0.438,"5min":0.36299999999999999,"15min":0.34999999999999998},"max":{"1min":0.72199999999999998,"5min":0.88400000000000001,"15min":0.93799999999999994},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.60599999999999998,"15min":0.625},"min":{"1min":0.40000000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68999999999999995,"5min":0.90800000000000003,"15min":0.94399999999999995},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.433,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":0.68899999999999995,"5min":0.83199999999999996,"15min":0.84999999999999998},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57699999999999996,"15min":0.59899999999999998},"min":{"1min":0.45600000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.67500000000000004,"5min":0.80800000000000005,"15min":0.872},"last":0.498}]},{"osd":5,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.42299999999999999,"15min":0.44800000000000001},"min":{"1min":0.309,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.53400000000000003,"5min":0.66900000000000004,"15min":0.86399999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.44900000000000001,"15min":0.46899999999999997},"min":{"1min":0.32300000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.63200000000000001,"5min":0.64900000000000002,"15min":0.82299999999999995},"last":0.49199999999999999}]},{"osd":6,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47399999999999998,"15min":0.51300000000000001},"min":{"1min":0.35699999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66100000000000003,"5min":0.79200000000000004,"15min":1.1399999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.52800000000000002,"15min":0.56299999999999994},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.67200000000000004,"5min":0.76700000000000002,"15min":1.1220000000000001},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.47999999999999998,"15min":0.52500000000000002},"min":{"1min":0.308,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58199999999999996,"5min":0.80100000000000005,"15min":0.90000000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55400000000000005,"15min":0.58199999999999996},"min":{"1min":0.44400000000000001,"5min":0.38100000000000001,"15min":0.35599999999999998},"max":{"1min":0.622,"5min":0.81599999999999995,"15min":0.86199999999999999},"last":0.56599999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575949,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307776,"kb_used_data":2488,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064064,"statfs":{"total":96636764160,"available":96321601536,"internally_reserved":0,"allocated":2547712,"data_stored":1303509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56799999999999995,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.35799999999999998,"15min":0.29799999999999999},"max":{"1min":0.76600000000000001,"5min":0.79800000000000004,"15min":0.80800000000000005},"last":0.753},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.54300000000000004,"15min":0.55300000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.66800000000000004,"5min":0.80700000000000005,"15min":0.90300000000000002},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54000000000000004,"15min":0.54300000000000004},"min":{"1min":0.41099999999999998,"5min":0.36899999999999999,"15min":0.32200000000000001},"max":{"1min":0.72599999999999998,"5min":0.75600000000000001,"15min":0.83699999999999997},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57699999999999996,"15min":0.57999999999999996},"min":{"1min":0.42499999999999999,"5min":0.38600000000000001,"15min":0.32400000000000001},"max":{"1min":0.72999999999999998,"5min":0.76500000000000001,"15min":0.82899999999999996},"last":0.74199999999999999}]},{"osd":2,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60999999999999999,"15min":0.61399999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.36399999999999999},"max":{"1min":0.76300000000000001,"5min":0.78700000000000003,"15min":0.99199999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.62,"15min":0.62},"min":{"1min":0.47199999999999998,"5min":0.44800000000000001,"15min":0.42499999999999999},"max":{"1min":0.78400000000000003,"5min":0.79600000000000004,"15min":1.173},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.373},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.79300000000000004},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.439,"5min":0.40500000000000003,"15min":0.35399999999999998},"max":{"1min":0.72699999999999998,"5min":0.84199999999999997,"15min":1.603},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.45400000000000001,"15min":0.45200000000000001},"min":{"1min":0.35799999999999998,"5min":0.315,"15min":0.28000000000000003},"max":{"1min":0.63800000000000001,"5min":0.70299999999999996,"15min":0.75},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.48999999999999999,"15min":0.48299999999999998},"min":{"1min":0.39100000000000001,"5min":0.32000000000000001,"15min":0.314},"max":{"1min":0.67300000000000004,"5min":0.77900000000000003,"15min":0.81200000000000006},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51600000000000001,"15min":0.505},"min":{"1min":0.38400000000000001,"5min":0.33600000000000002,"15min":0.31900000000000001},"max":{"1min":0.75900000000000001,"5min":0.76700000000000002,"15min":1.105},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57699999999999996,"15min":0.57199999999999995},"min":{"1min":0.48699999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.751,"5min":0.79600000000000004,"15min":1.228},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55000000000000004,"15min":0.54000000000000004},"min":{"1min":0.442,"5min":0.36799999999999999,"15min":0.34399999999999997},"max":{"1min":0.69299999999999995,"5min":0.80900000000000005,"15min":0.88100000000000001},"last":0.625},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.60199999999999998,"15min":0.59599999999999997},"min":{"1min":0.47399999999999998,"5min":0.33400000000000002,"15min":0.317},"max":{"1min":0.79400000000000004,"5min":0.82499999999999996,"15min":1.0640000000000001},"last":0.69099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T18:39:42.991 INFO:tasks.ceph.mds.a.smithi049.stderr:2023-11-30T18:39:42.990+0000 7fad97c8c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-30T18:39:45.841 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T18:39:45.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.970+0000 7f1cf813d700 1 Processor -- start 2023-11-30T18:39:45.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.970+0000 7f1cf813d700 1 -- start start 2023-11-30T18:39:45.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.971+0000 7f1cf813d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1cf01544d0 0x7f1cf0155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:45.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.971+0000 7f1cf813d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1cf0066f40 0x7f1cf0095e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:45.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.971+0000 7f1cf813d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1cf00673c0 0x7f1cf0096370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:45.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.971+0000 7f1cf813d700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf0096860 con 0x7f1cf0066f40 2023-11-30T18:39:45.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.971+0000 7f1cf813d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf00683d0 con 0x7f1cf00673c0 2023-11-30T18:39:45.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.971+0000 7f1cf813d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf0067850 con 0x7f1cf01544d0 2023-11-30T18:39:45.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.971+0000 7f1cf56d8700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1cf0066f40 0x7f1cf0095e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:45.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.972+0000 7f1cf56d8700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1cf0066f40 0x7f1cf0095e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59852/0 (socket says 172.21.15.49:59852) 2023-11-30T18:39:45.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.972+0000 7f1cf56d8700 1 -- 172.21.15.49:0/1234844161 learned_addr learned my addr 172.21.15.49:0/1234844161 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:45.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.972+0000 7f1cf66da700 1 --2- 172.21.15.49:0/1234844161 >> v2:172.21.15.115:3300/0 conn(0x7f1cf00673c0 0x7f1cf0096370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:45.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.972+0000 7f1cf5ed9700 1 --2- 172.21.15.49:0/1234844161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1cf01544d0 0x7f1cf0155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:45.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.972+0000 7f1cf56d8700 1 -- 172.21.15.49:0/1234844161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1cf01544d0 msgr2=0x7f1cf0155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:45.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.972+0000 7f1cf56d8700 1 --2- 172.21.15.49:0/1234844161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1cf01544d0 0x7f1cf0155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:45.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.972+0000 7f1cf56d8700 1 -- 172.21.15.49:0/1234844161 >> v2:172.21.15.115:3300/0 conn(0x7f1cf00673c0 msgr2=0x7f1cf0096370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:45.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.972+0000 7f1cf56d8700 1 --2- 172.21.15.49:0/1234844161 >> v2:172.21.15.115:3300/0 conn(0x7f1cf00673c0 0x7f1cf0096370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:45.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.972+0000 7f1cf56d8700 1 -- 172.21.15.49:0/1234844161 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf0067b30 con 0x7f1cf0066f40 2023-11-30T18:39:45.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.972+0000 7f1cf66da700 1 --2- 172.21.15.49:0/1234844161 >> v2:172.21.15.115:3300/0 conn(0x7f1cf00673c0 0x7f1cf0096370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:39:45.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.972+0000 7f1cf5ed9700 1 --2- 172.21.15.49:0/1234844161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1cf01544d0 0x7f1cf0155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:39:45.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.972+0000 7f1cf56d8700 1 --2- 172.21.15.49:0/1234844161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cf0066f40 0x7f1cf0095e80 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7f1cf00c3680 tx=0x7f1ce40090f0).ready entity=mon.0 client_cookie=5e7f00d34e23df2a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:45.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.972+0000 7f1cf4ed7700 1 -- 172.21.15.49:0/1234844161 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce400b600 con 0x7f1cf0066f40 2023-11-30T18:39:45.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.972+0000 7f1cf4ed7700 1 -- 172.21.15.49:0/1234844161 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce400b760 con 0x7f1cf0066f40 2023-11-30T18:39:45.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.972+0000 7f1cf4ed7700 1 -- 172.21.15.49:0/1234844161 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce400bae0 con 0x7f1cf0066f40 2023-11-30T18:39:45.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.973+0000 7f1cf813d700 1 -- 172.21.15.49:0/1234844161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cf0066f40 msgr2=0x7f1cf0095e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:45.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.973+0000 7f1cf813d700 1 --2- 172.21.15.49:0/1234844161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cf0066f40 0x7f1cf0095e80 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7f1cf00c3680 tx=0x7f1ce40090f0).stop 2023-11-30T18:39:45.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.973+0000 7f1cf813d700 1 -- 172.21.15.49:0/1234844161 shutdown_connections 2023-11-30T18:39:45.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.973+0000 7f1cf813d700 1 --2- 172.21.15.49:0/1234844161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1cf01544d0 0x7f1cf0155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:45.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.973+0000 7f1cf813d700 1 --2- 172.21.15.49:0/1234844161 >> v2:172.21.15.115:3300/0 conn(0x7f1cf00673c0 0x7f1cf0096370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:45.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.973+0000 7f1cf813d700 1 --2- 172.21.15.49:0/1234844161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cf0066f40 0x7f1cf0095e80 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:45.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.973+0000 7f1cf813d700 1 -- 172.21.15.49:0/1234844161 >> 172.21.15.49:0/1234844161 conn(0x7f1cf00631d0 msgr2=0x7f1cf00c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:45.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.973+0000 7f1cf813d700 1 -- 172.21.15.49:0/1234844161 shutdown_connections 2023-11-30T18:39:45.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.973+0000 7f1cf813d700 1 -- 172.21.15.49:0/1234844161 wait complete. 2023-11-30T18:39:45.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.974+0000 7f1cf813d700 1 Processor -- start 2023-11-30T18:39:45.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.974+0000 7f1cf813d700 1 -- start start 2023-11-30T18:39:45.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.975+0000 7f1cf813d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1cf0066f40 0x7f1cf00a66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:45.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.975+0000 7f1cf813d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1cf01544d0 0x7f1cf00c2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:45.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.975+0000 7f1cf813d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cf014dc50 0x7f1cf00c4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:45.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.975+0000 7f1cf813d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf00a6b90 con 0x7f1cf014dc50 2023-11-30T18:39:45.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.975+0000 7f1cf813d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf00a7990 con 0x7f1cf0066f40 2023-11-30T18:39:45.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.975+0000 7f1cf813d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf00c2500 con 0x7f1cf01544d0 2023-11-30T18:39:45.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.975+0000 7f1cf66da700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cf014dc50 0x7f1cf00c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:45.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.975+0000 7f1cf66da700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cf014dc50 0x7f1cf00c4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59862/0 (socket says 172.21.15.49:59862) 2023-11-30T18:39:45.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.975+0000 7f1cf66da700 1 -- 172.21.15.49:0/2105220075 learned_addr learned my addr 172.21.15.49:0/2105220075 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:45.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.975+0000 7f1cf5ed9700 1 --2- 172.21.15.49:0/2105220075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1cf0066f40 0x7f1cf00a66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:45.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.975+0000 7f1cf56d8700 1 --2- 172.21.15.49:0/2105220075 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1cf01544d0 0x7f1cf00c2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:45.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.975+0000 7f1cf66da700 1 -- 172.21.15.49:0/2105220075 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1cf01544d0 msgr2=0x7f1cf00c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:45.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.975+0000 7f1cf66da700 1 --2- 172.21.15.49:0/2105220075 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1cf01544d0 0x7f1cf00c2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:45.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.975+0000 7f1cf66da700 1 -- 172.21.15.49:0/2105220075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1cf0066f40 msgr2=0x7f1cf00a66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:45.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.975+0000 7f1cf66da700 1 --2- 172.21.15.49:0/2105220075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1cf0066f40 0x7f1cf00a66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:45.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.975+0000 7f1cf66da700 1 -- 172.21.15.49:0/2105220075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce4009370 con 0x7f1cf014dc50 2023-11-30T18:39:45.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.975+0000 7f1cf66da700 1 --2- 172.21.15.49:0/2105220075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cf014dc50 0x7f1cf00c4980 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 rx=0x7f1ce000cfb0 tx=0x7f1ce0007890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:45.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.975+0000 7f1cedffb700 1 -- 172.21.15.49:0/2105220075 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce000ae60 con 0x7f1cf014dc50 2023-11-30T18:39:45.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.975+0000 7f1cedffb700 1 -- 172.21.15.49:0/2105220075 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce0016470 con 0x7f1cf014dc50 2023-11-30T18:39:45.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.975+0000 7f1cf813d700 1 -- 172.21.15.49:0/2105220075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf00a6d80 con 0x7f1cf014dc50 2023-11-30T18:39:45.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.975+0000 7f1cedffb700 1 -- 172.21.15.49:0/2105220075 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce00167f0 con 0x7f1cf014dc50 2023-11-30T18:39:45.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.976+0000 7f1cf813d700 1 -- 172.21.15.49:0/2105220075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf00a7340 con 0x7f1cf014dc50 2023-11-30T18:39:45.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.977+0000 7f1cf813d700 1 -- 172.21.15.49:0/2105220075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf00a7b40 con 0x7f1cf014dc50 2023-11-30T18:39:45.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.977+0000 7f1cedffb700 1 -- 172.21.15.49:0/2105220075 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f1ce0013070 con 0x7f1cf014dc50 2023-11-30T18:39:45.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.978+0000 7f1cedffb700 1 --2- 172.21.15.49:0/2105220075 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f1cdc05f270 0x7f1cdc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:45.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.978+0000 7f1cedffb700 1 -- 172.21.15.49:0/2105220075 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6205+0+0 (secure 0 0 0) 0x7f1ce007aeb0 con 0x7f1cf014dc50 2023-11-30T18:39:45.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.978+0000 7f1cf5ed9700 1 --2- 172.21.15.49:0/2105220075 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f1cdc05f270 0x7f1cdc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:45.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.978+0000 7f1cf5ed9700 1 --2- 172.21.15.49:0/2105220075 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f1cdc05f270 0x7f1cdc061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f1ce800ab20 tx=0x7f1ce8008040).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:45.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:45.982+0000 7f1cedffb700 1 -- 172.21.15.49:0/2105220075 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1cf00a7b40 con 0x7f1cf014dc50 2023-11-30T18:39:46.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.148+0000 7f1cf813d700 1 -- 172.21.15.49:0/2105220075 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1cf00a7b40 con 0x7f1cdc05f270 2023-11-30T18:39:46.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.158+0000 7f1cedffb700 1 -- 172.21.15.49:0/2105220075 <== mgr.7760 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362175 (secure 0 0 0) 0x7f1cf00a7b40 con 0x7f1cdc05f270 2023-11-30T18:39:46.164 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:39:46.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.161+0000 7f1cf813d700 1 -- 172.21.15.49:0/2105220075 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f1cdc05f270 msgr2=0x7f1cdc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:46.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.161+0000 7f1cf813d700 1 --2- 172.21.15.49:0/2105220075 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f1cdc05f270 0x7f1cdc061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f1ce800ab20 tx=0x7f1ce8008040).stop 2023-11-30T18:39:46.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.161+0000 7f1cf813d700 1 -- 172.21.15.49:0/2105220075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cf014dc50 msgr2=0x7f1cf00c4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:46.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.161+0000 7f1cf813d700 1 --2- 172.21.15.49:0/2105220075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cf014dc50 0x7f1cf00c4980 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 rx=0x7f1ce000cfb0 tx=0x7f1ce0007890).stop 2023-11-30T18:39:46.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.161+0000 7f1cf813d700 1 -- 172.21.15.49:0/2105220075 shutdown_connections 2023-11-30T18:39:46.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.161+0000 7f1cf813d700 1 --2- 172.21.15.49:0/2105220075 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f1cdc05f270 0x7f1cdc061730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:46.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.161+0000 7f1cf813d700 1 --2- 172.21.15.49:0/2105220075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cf014dc50 0x7f1cf00c4980 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:46.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.161+0000 7f1cf813d700 1 --2- 172.21.15.49:0/2105220075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1cf0066f40 0x7f1cf00a66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:46.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.161+0000 7f1cf813d700 1 --2- 172.21.15.49:0/2105220075 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1cf01544d0 0x7f1cf00c2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:46.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.161+0000 7f1cf813d700 1 -- 172.21.15.49:0/2105220075 >> 172.21.15.49:0/2105220075 conn(0x7f1cf00631d0 msgr2=0x7f1cf00c8640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:46.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.162+0000 7f1cf813d700 1 -- 172.21.15.49:0/2105220075 shutdown_connections 2023-11-30T18:39:46.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.162+0000 7f1cf813d700 1 -- 172.21.15.49:0/2105220075 wait complete. 2023-11-30T18:39:46.168 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T18:39:46.176 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-11-30T18:39:44.644075+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2450016,"kb_used_data":19872,"kb_used_omap":0,"kb_used_meta":2430080,"kb_avail":752524704,"statfs":{"total":773094113280,"available":770585296896,"internally_reserved":0,"allocated":20348928,"data_stored":10427260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2488401920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-593515,"num_objects":-19,"num_object_clones":0,"num_object_copies":-38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-19,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-201,"num_write_kb":-715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.005934"},"pg_stats":[{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349312+0000","last_change":"2023-11-30T18:39:37.344457+0000","last_active":"2023-11-30T18:39:37.349312+0000","last_peered":"2023-11-30T18:39:37.349312+0000","last_clean":"2023-11-30T18:39:37.349312+0000","last_became_active":"2023-11-30T18:39:37.344174+0000","last_became_peered":"2023-11-30T18:39:37.344174+0000","last_unstale":"2023-11-30T18:39:37.349312+0000","last_undegraded":"2023-11-30T18:39:37.349312+0000","last_fullsized":"2023-11-30T18:39:37.349312+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3f","version":"202'3","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346160+0000","last_change":"2023-11-30T18:39:36.952718+0000","last_active":"2023-11-30T18:39:37.346160+0000","last_peered":"2023-11-30T18:39:37.346160+0000","last_clean":"2023-11-30T18:39:37.346160+0000","last_became_active":"2023-11-30T18:39:36.952412+0000","last_became_peered":"2023-11-30T18:39:36.952412+0000","last_unstale":"2023-11-30T18:39:37.346160+0000","last_undegraded":"2023-11-30T18:39:37.346160+0000","last_fullsized":"2023-11-30T18:39:37.346160+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.343185+0000","last_change":"2023-11-30T18:39:37.337167+0000","last_active":"2023-11-30T18:39:37.343185+0000","last_peered":"2023-11-30T18:39:37.343185+0000","last_clean":"2023-11-30T18:39:37.343185+0000","last_became_active":"2023-11-30T18:39:37.336870+0000","last_became_peered":"2023-11-30T18:39:37.336870+0000","last_unstale":"2023-11-30T18:39:37.343185+0000","last_undegraded":"2023-11-30T18:39:37.343185+0000","last_fullsized":"2023-11-30T18:39:37.343185+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.325615+0000","last_change":"2023-11-30T18:39:36.946856+0000","last_active":"2023-11-30T18:39:37.325615+0000","last_peered":"2023-11-30T18:39:37.325615+0000","last_clean":"2023-11-30T18:39:37.325615+0000","last_became_active":"2023-11-30T18:39:36.946611+0000","last_became_peered":"2023-11-30T18:39:36.946611+0000","last_unstale":"2023-11-30T18:39:37.325615+0000","last_undegraded":"2023-11-30T18:39:37.325615+0000","last_fullsized":"2023-11-30T18:39:37.325615+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.342165+0000","last_change":"2023-11-30T18:39:37.339227+0000","last_active":"2023-11-30T18:39:37.342165+0000","last_peered":"2023-11-30T18:39:37.342165+0000","last_clean":"2023-11-30T18:39:37.342165+0000","last_became_active":"2023-11-30T18:39:37.338774+0000","last_became_peered":"2023-11-30T18:39:37.338774+0000","last_unstale":"2023-11-30T18:39:37.342165+0000","last_undegraded":"2023-11-30T18:39:37.342165+0000","last_fullsized":"2023-11-30T18:39:37.342165+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327583+0000","last_change":"2023-11-30T18:39:36.951837+0000","last_active":"2023-11-30T18:39:37.327583+0000","last_peered":"2023-11-30T18:39:37.327583+0000","last_clean":"2023-11-30T18:39:37.327583+0000","last_became_active":"2023-11-30T18:39:36.951560+0000","last_became_peered":"2023-11-30T18:39:36.951560+0000","last_unstale":"2023-11-30T18:39:37.327583+0000","last_undegraded":"2023-11-30T18:39:37.327583+0000","last_fullsized":"2023-11-30T18:39:37.327583+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349301+0000","last_change":"2023-11-30T18:39:37.345801+0000","last_active":"2023-11-30T18:39:37.349301+0000","last_peered":"2023-11-30T18:39:37.349301+0000","last_clean":"2023-11-30T18:39:37.349301+0000","last_became_active":"2023-11-30T18:39:37.345516+0000","last_became_peered":"2023-11-30T18:39:37.345516+0000","last_unstale":"2023-11-30T18:39:37.349301+0000","last_undegraded":"2023-11-30T18:39:37.349301+0000","last_fullsized":"2023-11-30T18:39:37.349301+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3c","version":"202'2","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347142+0000","last_change":"2023-11-30T18:39:36.949667+0000","last_active":"2023-11-30T18:39:37.347142+0000","last_peered":"2023-11-30T18:39:37.347142+0000","last_clean":"2023-11-30T18:39:37.347142+0000","last_became_active":"2023-11-30T18:39:36.949238+0000","last_became_peered":"2023-11-30T18:39:36.949238+0000","last_unstale":"2023-11-30T18:39:37.347142+0000","last_undegraded":"2023-11-30T18:39:37.347142+0000","last_fullsized":"2023-11-30T18:39:37.347142+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.351900+0000","last_change":"2023-11-30T18:39:37.349000+0000","last_active":"2023-11-30T18:39:37.351900+0000","last_peered":"2023-11-30T18:39:37.351900+0000","last_clean":"2023-11-30T18:39:37.351900+0000","last_became_active":"2023-11-30T18:39:37.348658+0000","last_became_peered":"2023-11-30T18:39:37.348658+0000","last_unstale":"2023-11-30T18:39:37.351900+0000","last_undegraded":"2023-11-30T18:39:37.351900+0000","last_fullsized":"2023-11-30T18:39:37.351900+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3b","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347882+0000","last_change":"2023-11-30T18:39:36.941711+0000","last_active":"2023-11-30T18:39:37.347882+0000","last_peered":"2023-11-30T18:39:37.347882+0000","last_clean":"2023-11-30T18:39:37.347882+0000","last_became_active":"2023-11-30T18:39:36.941268+0000","last_became_peered":"2023-11-30T18:39:36.941268+0000","last_unstale":"2023-11-30T18:39:37.347882+0000","last_undegraded":"2023-11-30T18:39:37.347882+0000","last_fullsized":"2023-11-30T18:39:37.347882+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349423+0000","last_change":"2023-11-30T18:39:37.343623+0000","last_active":"2023-11-30T18:39:37.349423+0000","last_peered":"2023-11-30T18:39:37.349423+0000","last_clean":"2023-11-30T18:39:37.349423+0000","last_became_active":"2023-11-30T18:39:37.343286+0000","last_became_peered":"2023-11-30T18:39:37.343286+0000","last_unstale":"2023-11-30T18:39:37.349423+0000","last_undegraded":"2023-11-30T18:39:37.349423+0000","last_fullsized":"2023-11-30T18:39:37.349423+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3a","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346845+0000","last_change":"2023-11-30T18:39:36.948257+0000","last_active":"2023-11-30T18:39:37.346845+0000","last_peered":"2023-11-30T18:39:37.346845+0000","last_clean":"2023-11-30T18:39:37.346845+0000","last_became_active":"2023-11-30T18:39:36.947769+0000","last_became_peered":"2023-11-30T18:39:36.947769+0000","last_unstale":"2023-11-30T18:39:37.346845+0000","last_undegraded":"2023-11-30T18:39:37.346845+0000","last_fullsized":"2023-11-30T18:39:37.346845+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347404+0000","last_change":"2023-11-30T18:39:37.345626+0000","last_active":"2023-11-30T18:39:37.347404+0000","last_peered":"2023-11-30T18:39:37.347404+0000","last_clean":"2023-11-30T18:39:37.347404+0000","last_became_active":"2023-11-30T18:39:37.345347+0000","last_became_peered":"2023-11-30T18:39:37.345347+0000","last_unstale":"2023-11-30T18:39:37.347404+0000","last_undegraded":"2023-11-30T18:39:37.347404+0000","last_fullsized":"2023-11-30T18:39:37.347404+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.333622+0000","last_change":"2023-11-30T18:39:36.946508+0000","last_active":"2023-11-30T18:39:37.333622+0000","last_peered":"2023-11-30T18:39:37.333622+0000","last_clean":"2023-11-30T18:39:37.333622+0000","last_became_active":"2023-11-30T18:39:36.946260+0000","last_became_peered":"2023-11-30T18:39:36.946260+0000","last_unstale":"2023-11-30T18:39:37.333622+0000","last_undegraded":"2023-11-30T18:39:37.333622+0000","last_fullsized":"2023-11-30T18:39:37.333622+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347329+0000","last_change":"2023-11-30T18:39:37.344153+0000","last_active":"2023-11-30T18:39:37.347329+0000","last_peered":"2023-11-30T18:39:37.347329+0000","last_clean":"2023-11-30T18:39:37.347329+0000","last_became_active":"2023-11-30T18:39:37.343879+0000","last_became_peered":"2023-11-30T18:39:37.343879+0000","last_unstale":"2023-11-30T18:39:37.347329+0000","last_undegraded":"2023-11-30T18:39:37.347329+0000","last_fullsized":"2023-11-30T18:39:37.347329+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.328014+0000","last_change":"2023-11-30T18:39:36.941595+0000","last_active":"2023-11-30T18:39:37.328014+0000","last_peered":"2023-11-30T18:39:37.328014+0000","last_clean":"2023-11-30T18:39:37.328014+0000","last_became_active":"2023-11-30T18:39:36.941256+0000","last_became_peered":"2023-11-30T18:39:36.941256+0000","last_unstale":"2023-11-30T18:39:37.328014+0000","last_undegraded":"2023-11-30T18:39:37.328014+0000","last_fullsized":"2023-11-30T18:39:37.328014+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347574+0000","last_change":"2023-11-30T18:39:37.343067+0000","last_active":"2023-11-30T18:39:37.347574+0000","last_peered":"2023-11-30T18:39:37.347574+0000","last_clean":"2023-11-30T18:39:37.347574+0000","last_became_active":"2023-11-30T18:39:37.338376+0000","last_became_peered":"2023-11-30T18:39:37.338376+0000","last_unstale":"2023-11-30T18:39:37.347574+0000","last_undegraded":"2023-11-30T18:39:37.347574+0000","last_fullsized":"2023-11-30T18:39:37.347574+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.325340+0000","last_change":"2023-11-30T18:39:36.946345+0000","last_active":"2023-11-30T18:39:37.325340+0000","last_peered":"2023-11-30T18:39:37.325340+0000","last_clean":"2023-11-30T18:39:37.325340+0000","last_became_active":"2023-11-30T18:39:36.946063+0000","last_became_peered":"2023-11-30T18:39:36.946063+0000","last_unstale":"2023-11-30T18:39:37.325340+0000","last_undegraded":"2023-11-30T18:39:37.325340+0000","last_fullsized":"2023-11-30T18:39:37.325340+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.343031+0000","last_change":"2023-11-30T18:39:37.336599+0000","last_active":"2023-11-30T18:39:37.343031+0000","last_peered":"2023-11-30T18:39:37.343031+0000","last_clean":"2023-11-30T18:39:37.343031+0000","last_became_active":"2023-11-30T18:39:37.336034+0000","last_became_peered":"2023-11-30T18:39:37.336034+0000","last_unstale":"2023-11-30T18:39:37.343031+0000","last_undegraded":"2023-11-30T18:39:37.343031+0000","last_fullsized":"2023-11-30T18:39:37.343031+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.325646+0000","last_change":"2023-11-30T18:39:36.951924+0000","last_active":"2023-11-30T18:39:37.325646+0000","last_peered":"2023-11-30T18:39:37.325646+0000","last_clean":"2023-11-30T18:39:37.325646+0000","last_became_active":"2023-11-30T18:39:36.951723+0000","last_became_peered":"2023-11-30T18:39:36.951723+0000","last_unstale":"2023-11-30T18:39:37.325646+0000","last_undegraded":"2023-11-30T18:39:37.325646+0000","last_fullsized":"2023-11-30T18:39:37.325646+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346994+0000","last_change":"2023-11-30T18:39:37.344677+0000","last_active":"2023-11-30T18:39:37.346994+0000","last_peered":"2023-11-30T18:39:37.346994+0000","last_clean":"2023-11-30T18:39:37.346994+0000","last_became_active":"2023-11-30T18:39:37.344361+0000","last_became_peered":"2023-11-30T18:39:37.344361+0000","last_unstale":"2023-11-30T18:39:37.346994+0000","last_undegraded":"2023-11-30T18:39:37.346994+0000","last_fullsized":"2023-11-30T18:39:37.346994+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.325562+0000","last_change":"2023-11-30T18:39:36.941763+0000","last_active":"2023-11-30T18:39:37.325562+0000","last_peered":"2023-11-30T18:39:37.325562+0000","last_clean":"2023-11-30T18:39:37.325562+0000","last_became_active":"2023-11-30T18:39:36.941349+0000","last_became_peered":"2023-11-30T18:39:36.941349+0000","last_unstale":"2023-11-30T18:39:37.325562+0000","last_undegraded":"2023-11-30T18:39:37.325562+0000","last_fullsized":"2023-11-30T18:39:37.325562+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349920+0000","last_change":"2023-11-30T18:39:37.346869+0000","last_active":"2023-11-30T18:39:37.349920+0000","last_peered":"2023-11-30T18:39:37.349920+0000","last_clean":"2023-11-30T18:39:37.349920+0000","last_became_active":"2023-11-30T18:39:37.346571+0000","last_became_peered":"2023-11-30T18:39:37.346571+0000","last_unstale":"2023-11-30T18:39:37.349920+0000","last_undegraded":"2023-11-30T18:39:37.349920+0000","last_fullsized":"2023-11-30T18:39:37.349920+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.34","version":"202'4","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352871+0000","last_change":"2023-11-30T18:39:36.946240+0000","last_active":"2023-11-30T18:39:37.352871+0000","last_peered":"2023-11-30T18:39:37.352871+0000","last_clean":"2023-11-30T18:39:37.352871+0000","last_became_active":"2023-11-30T18:39:36.945944+0000","last_became_peered":"2023-11-30T18:39:36.945944+0000","last_unstale":"2023-11-30T18:39:37.352871+0000","last_undegraded":"2023-11-30T18:39:37.352871+0000","last_fullsized":"2023-11-30T18:39:37.352871+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349366+0000","last_change":"2023-11-30T18:39:37.345080+0000","last_active":"2023-11-30T18:39:37.349366+0000","last_peered":"2023-11-30T18:39:37.349366+0000","last_clean":"2023-11-30T18:39:37.349366+0000","last_became_active":"2023-11-30T18:39:37.344759+0000","last_became_peered":"2023-11-30T18:39:37.344759+0000","last_unstale":"2023-11-30T18:39:37.349366+0000","last_undegraded":"2023-11-30T18:39:37.349366+0000","last_fullsized":"2023-11-30T18:39:37.349366+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.33","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.335670+0000","last_change":"2023-11-30T18:39:36.948358+0000","last_active":"2023-11-30T18:39:37.335670+0000","last_peered":"2023-11-30T18:39:37.335670+0000","last_clean":"2023-11-30T18:39:37.335670+0000","last_became_active":"2023-11-30T18:39:36.947917+0000","last_became_peered":"2023-11-30T18:39:36.947917+0000","last_unstale":"2023-11-30T18:39:37.335670+0000","last_undegraded":"2023-11-30T18:39:37.335670+0000","last_fullsized":"2023-11-30T18:39:37.335670+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352812+0000","last_change":"2023-11-30T18:39:37.351277+0000","last_active":"2023-11-30T18:39:37.352812+0000","last_peered":"2023-11-30T18:39:37.352812+0000","last_clean":"2023-11-30T18:39:37.352812+0000","last_became_active":"2023-11-30T18:39:37.351026+0000","last_became_peered":"2023-11-30T18:39:37.351026+0000","last_unstale":"2023-11-30T18:39:37.352812+0000","last_undegraded":"2023-11-30T18:39:37.352812+0000","last_fullsized":"2023-11-30T18:39:37.352812+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327022+0000","last_change":"2023-11-30T18:39:36.951095+0000","last_active":"2023-11-30T18:39:37.327022+0000","last_peered":"2023-11-30T18:39:37.327022+0000","last_clean":"2023-11-30T18:39:37.327022+0000","last_became_active":"2023-11-30T18:39:36.950755+0000","last_became_peered":"2023-11-30T18:39:36.950755+0000","last_unstale":"2023-11-30T18:39:37.327022+0000","last_undegraded":"2023-11-30T18:39:37.327022+0000","last_fullsized":"2023-11-30T18:39:37.327022+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346081+0000","last_change":"2023-11-30T18:39:37.338925+0000","last_active":"2023-11-30T18:39:37.346081+0000","last_peered":"2023-11-30T18:39:37.346081+0000","last_clean":"2023-11-30T18:39:37.346081+0000","last_became_active":"2023-11-30T18:39:37.338608+0000","last_became_peered":"2023-11-30T18:39:37.338608+0000","last_unstale":"2023-11-30T18:39:37.346081+0000","last_undegraded":"2023-11-30T18:39:37.346081+0000","last_fullsized":"2023-11-30T18:39:37.346081+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.329742+0000","last_change":"2023-11-30T18:39:36.949738+0000","last_active":"2023-11-30T18:39:37.329742+0000","last_peered":"2023-11-30T18:39:37.329742+0000","last_clean":"2023-11-30T18:39:37.329742+0000","last_became_active":"2023-11-30T18:39:36.949398+0000","last_became_peered":"2023-11-30T18:39:36.949398+0000","last_unstale":"2023-11-30T18:39:37.329742+0000","last_undegraded":"2023-11-30T18:39:37.329742+0000","last_fullsized":"2023-11-30T18:39:37.329742+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352073+0000","last_change":"2023-11-30T18:39:37.347542+0000","last_active":"2023-11-30T18:39:37.352073+0000","last_peered":"2023-11-30T18:39:37.352073+0000","last_clean":"2023-11-30T18:39:37.352073+0000","last_became_active":"2023-11-30T18:39:37.347265+0000","last_became_peered":"2023-11-30T18:39:37.347265+0000","last_unstale":"2023-11-30T18:39:37.352073+0000","last_undegraded":"2023-11-30T18:39:37.352073+0000","last_fullsized":"2023-11-30T18:39:37.352073+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.30","version":"202'4","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.350561+0000","last_change":"2023-11-30T18:39:36.951234+0000","last_active":"2023-11-30T18:39:37.350561+0000","last_peered":"2023-11-30T18:39:37.350561+0000","last_clean":"2023-11-30T18:39:37.350561+0000","last_became_active":"2023-11-30T18:39:36.950335+0000","last_became_peered":"2023-11-30T18:39:36.950335+0000","last_unstale":"2023-11-30T18:39:37.350561+0000","last_undegraded":"2023-11-30T18:39:37.350561+0000","last_fullsized":"2023-11-30T18:39:37.350561+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346155+0000","last_change":"2023-11-30T18:39:37.338166+0000","last_active":"2023-11-30T18:39:37.346155+0000","last_peered":"2023-11-30T18:39:37.346155+0000","last_clean":"2023-11-30T18:39:37.346155+0000","last_became_active":"2023-11-30T18:39:37.337877+0000","last_became_peered":"2023-11-30T18:39:37.337877+0000","last_unstale":"2023-11-30T18:39:37.346155+0000","last_undegraded":"2023-11-30T18:39:37.346155+0000","last_fullsized":"2023-11-30T18:39:37.346155+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.326222+0000","last_change":"2023-11-30T18:39:36.949535+0000","last_active":"2023-11-30T18:39:37.326222+0000","last_peered":"2023-11-30T18:39:37.326222+0000","last_clean":"2023-11-30T18:39:37.326222+0000","last_became_active":"2023-11-30T18:39:36.949241+0000","last_became_peered":"2023-11-30T18:39:36.949241+0000","last_unstale":"2023-11-30T18:39:37.326222+0000","last_undegraded":"2023-11-30T18:39:37.326222+0000","last_fullsized":"2023-11-30T18:39:37.326222+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.336430+0000","last_change":"2023-11-30T18:39:37.333434+0000","last_active":"2023-11-30T18:39:37.336430+0000","last_peered":"2023-11-30T18:39:37.336430+0000","last_clean":"2023-11-30T18:39:37.336430+0000","last_became_active":"2023-11-30T18:39:37.333123+0000","last_became_peered":"2023-11-30T18:39:37.333123+0000","last_unstale":"2023-11-30T18:39:37.336430+0000","last_undegraded":"2023-11-30T18:39:37.336430+0000","last_fullsized":"2023-11-30T18:39:37.336430+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.337654+0000","last_change":"2023-11-30T18:39:36.949130+0000","last_active":"2023-11-30T18:39:37.337654+0000","last_peered":"2023-11-30T18:39:37.337654+0000","last_clean":"2023-11-30T18:39:37.337654+0000","last_became_active":"2023-11-30T18:39:36.946324+0000","last_became_peered":"2023-11-30T18:39:36.946324+0000","last_unstale":"2023-11-30T18:39:37.337654+0000","last_undegraded":"2023-11-30T18:39:37.337654+0000","last_fullsized":"2023-11-30T18:39:37.337654+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346825+0000","last_change":"2023-11-30T18:39:37.342066+0000","last_active":"2023-11-30T18:39:37.346825+0000","last_peered":"2023-11-30T18:39:37.346825+0000","last_clean":"2023-11-30T18:39:37.346825+0000","last_became_active":"2023-11-30T18:39:37.341771+0000","last_became_peered":"2023-11-30T18:39:37.341771+0000","last_unstale":"2023-11-30T18:39:37.346825+0000","last_undegraded":"2023-11-30T18:39:37.346825+0000","last_fullsized":"2023-11-30T18:39:37.346825+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2d","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347422+0000","last_change":"2023-11-30T18:39:36.943783+0000","last_active":"2023-11-30T18:39:37.347422+0000","last_peered":"2023-11-30T18:39:37.347422+0000","last_clean":"2023-11-30T18:39:37.347422+0000","last_became_active":"2023-11-30T18:39:36.943292+0000","last_became_peered":"2023-11-30T18:39:36.943292+0000","last_unstale":"2023-11-30T18:39:37.347422+0000","last_undegraded":"2023-11-30T18:39:37.347422+0000","last_fullsized":"2023-11-30T18:39:37.347422+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349567+0000","last_change":"2023-11-30T18:39:37.346979+0000","last_active":"2023-11-30T18:39:37.349567+0000","last_peered":"2023-11-30T18:39:37.349567+0000","last_clean":"2023-11-30T18:39:37.349567+0000","last_became_active":"2023-11-30T18:39:37.346664+0000","last_became_peered":"2023-11-30T18:39:37.346664+0000","last_unstale":"2023-11-30T18:39:37.349567+0000","last_undegraded":"2023-11-30T18:39:37.349567+0000","last_fullsized":"2023-11-30T18:39:37.349567+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327127+0000","last_change":"2023-11-30T18:39:36.951319+0000","last_active":"2023-11-30T18:39:37.327127+0000","last_peered":"2023-11-30T18:39:37.327127+0000","last_clean":"2023-11-30T18:39:37.327127+0000","last_became_active":"2023-11-30T18:39:36.950625+0000","last_became_peered":"2023-11-30T18:39:36.950625+0000","last_unstale":"2023-11-30T18:39:37.327127+0000","last_undegraded":"2023-11-30T18:39:37.327127+0000","last_fullsized":"2023-11-30T18:39:37.327127+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.353489+0000","last_change":"2023-11-30T18:39:37.352660+0000","last_active":"2023-11-30T18:39:37.353489+0000","last_peered":"2023-11-30T18:39:37.353489+0000","last_clean":"2023-11-30T18:39:37.353489+0000","last_became_active":"2023-11-30T18:39:37.352052+0000","last_became_peered":"2023-11-30T18:39:37.352052+0000","last_unstale":"2023-11-30T18:39:37.353489+0000","last_undegraded":"2023-11-30T18:39:37.353489+0000","last_fullsized":"2023-11-30T18:39:37.353489+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.343254+0000","last_change":"2023-11-30T18:39:36.952248+0000","last_active":"2023-11-30T18:39:37.343254+0000","last_peered":"2023-11-30T18:39:37.343254+0000","last_clean":"2023-11-30T18:39:37.343254+0000","last_became_active":"2023-11-30T18:39:36.951960+0000","last_became_peered":"2023-11-30T18:39:36.951960+0000","last_unstale":"2023-11-30T18:39:37.343254+0000","last_undegraded":"2023-11-30T18:39:37.343254+0000","last_fullsized":"2023-11-30T18:39:37.343254+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349666+0000","last_change":"2023-11-30T18:39:37.346628+0000","last_active":"2023-11-30T18:39:37.349666+0000","last_peered":"2023-11-30T18:39:37.349666+0000","last_clean":"2023-11-30T18:39:37.349666+0000","last_became_active":"2023-11-30T18:39:37.346349+0000","last_became_peered":"2023-11-30T18:39:37.346349+0000","last_unstale":"2023-11-30T18:39:37.349666+0000","last_undegraded":"2023-11-30T18:39:37.349666+0000","last_fullsized":"2023-11-30T18:39:37.349666+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.326648+0000","last_change":"2023-11-30T18:39:36.947146+0000","last_active":"2023-11-30T18:39:37.326648+0000","last_peered":"2023-11-30T18:39:37.326648+0000","last_clean":"2023-11-30T18:39:37.326648+0000","last_became_active":"2023-11-30T18:39:36.946809+0000","last_became_peered":"2023-11-30T18:39:36.946809+0000","last_unstale":"2023-11-30T18:39:37.326648+0000","last_undegraded":"2023-11-30T18:39:37.326648+0000","last_fullsized":"2023-11-30T18:39:37.326648+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347382+0000","last_change":"2023-11-30T18:39:37.344874+0000","last_active":"2023-11-30T18:39:37.347382+0000","last_peered":"2023-11-30T18:39:37.347382+0000","last_clean":"2023-11-30T18:39:37.347382+0000","last_became_active":"2023-11-30T18:39:37.344613+0000","last_became_peered":"2023-11-30T18:39:37.344613+0000","last_unstale":"2023-11-30T18:39:37.347382+0000","last_undegraded":"2023-11-30T18:39:37.347382+0000","last_fullsized":"2023-11-30T18:39:37.347382+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.323906+0000","last_change":"2023-11-30T18:39:36.946087+0000","last_active":"2023-11-30T18:39:37.323906+0000","last_peered":"2023-11-30T18:39:37.323906+0000","last_clean":"2023-11-30T18:39:37.323906+0000","last_became_active":"2023-11-30T18:39:36.945402+0000","last_became_peered":"2023-11-30T18:39:36.945402+0000","last_unstale":"2023-11-30T18:39:37.323906+0000","last_undegraded":"2023-11-30T18:39:37.323906+0000","last_fullsized":"2023-11-30T18:39:37.323906+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.348211+0000","last_change":"2023-11-30T18:39:37.344635+0000","last_active":"2023-11-30T18:39:37.348211+0000","last_peered":"2023-11-30T18:39:37.348211+0000","last_clean":"2023-11-30T18:39:37.348211+0000","last_became_active":"2023-11-30T18:39:37.344167+0000","last_became_peered":"2023-11-30T18:39:37.344167+0000","last_unstale":"2023-11-30T18:39:37.348211+0000","last_undegraded":"2023-11-30T18:39:37.348211+0000","last_fullsized":"2023-11-30T18:39:37.348211+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.328137+0000","last_change":"2023-11-30T18:39:36.946792+0000","last_active":"2023-11-30T18:39:37.328137+0000","last_peered":"2023-11-30T18:39:37.328137+0000","last_clean":"2023-11-30T18:39:37.328137+0000","last_became_active":"2023-11-30T18:39:36.946486+0000","last_became_peered":"2023-11-30T18:39:36.946486+0000","last_unstale":"2023-11-30T18:39:37.328137+0000","last_undegraded":"2023-11-30T18:39:37.328137+0000","last_fullsized":"2023-11-30T18:39:37.328137+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349334+0000","last_change":"2023-11-30T18:39:37.344920+0000","last_active":"2023-11-30T18:39:37.349334+0000","last_peered":"2023-11-30T18:39:37.349334+0000","last_clean":"2023-11-30T18:39:37.349334+0000","last_became_active":"2023-11-30T18:39:37.344397+0000","last_became_peered":"2023-11-30T18:39:37.344397+0000","last_unstale":"2023-11-30T18:39:37.349334+0000","last_undegraded":"2023-11-30T18:39:37.349334+0000","last_fullsized":"2023-11-30T18:39:37.349334+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327429+0000","last_change":"2023-11-30T18:39:36.950989+0000","last_active":"2023-11-30T18:39:37.327429+0000","last_peered":"2023-11-30T18:39:37.327429+0000","last_clean":"2023-11-30T18:39:37.327429+0000","last_became_active":"2023-11-30T18:39:36.950554+0000","last_became_peered":"2023-11-30T18:39:36.950554+0000","last_unstale":"2023-11-30T18:39:37.327429+0000","last_undegraded":"2023-11-30T18:39:37.327429+0000","last_fullsized":"2023-11-30T18:39:37.327429+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.340948+0000","last_change":"2023-11-30T18:39:37.339921+0000","last_active":"2023-11-30T18:39:37.340948+0000","last_peered":"2023-11-30T18:39:37.340948+0000","last_clean":"2023-11-30T18:39:37.340948+0000","last_became_active":"2023-11-30T18:39:37.339659+0000","last_became_peered":"2023-11-30T18:39:37.339659+0000","last_unstale":"2023-11-30T18:39:37.340948+0000","last_undegraded":"2023-11-30T18:39:37.340948+0000","last_fullsized":"2023-11-30T18:39:37.340948+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.331794+0000","last_change":"2023-11-30T18:39:36.952942+0000","last_active":"2023-11-30T18:39:37.331794+0000","last_peered":"2023-11-30T18:39:37.331794+0000","last_clean":"2023-11-30T18:39:37.331794+0000","last_became_active":"2023-11-30T18:39:36.952663+0000","last_became_peered":"2023-11-30T18:39:36.952663+0000","last_unstale":"2023-11-30T18:39:37.331794+0000","last_undegraded":"2023-11-30T18:39:37.331794+0000","last_fullsized":"2023-11-30T18:39:37.331794+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349529+0000","last_change":"2023-11-30T18:39:37.345821+0000","last_active":"2023-11-30T18:39:37.349529+0000","last_peered":"2023-11-30T18:39:37.349529+0000","last_clean":"2023-11-30T18:39:37.349529+0000","last_became_active":"2023-11-30T18:39:37.345470+0000","last_became_peered":"2023-11-30T18:39:37.345470+0000","last_unstale":"2023-11-30T18:39:37.349529+0000","last_undegraded":"2023-11-30T18:39:37.349529+0000","last_fullsized":"2023-11-30T18:39:37.349529+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327690+0000","last_change":"2023-11-30T18:39:36.949932+0000","last_active":"2023-11-30T18:39:37.327690+0000","last_peered":"2023-11-30T18:39:37.327690+0000","last_clean":"2023-11-30T18:39:37.327690+0000","last_became_active":"2023-11-30T18:39:36.949661+0000","last_became_peered":"2023-11-30T18:39:36.949661+0000","last_unstale":"2023-11-30T18:39:37.327690+0000","last_undegraded":"2023-11-30T18:39:37.327690+0000","last_fullsized":"2023-11-30T18:39:37.327690+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.348203+0000","last_change":"2023-11-30T18:39:37.344683+0000","last_active":"2023-11-30T18:39:37.348203+0000","last_peered":"2023-11-30T18:39:37.348203+0000","last_clean":"2023-11-30T18:39:37.348203+0000","last_became_active":"2023-11-30T18:39:37.344395+0000","last_became_peered":"2023-11-30T18:39:37.344395+0000","last_unstale":"2023-11-30T18:39:37.348203+0000","last_undegraded":"2023-11-30T18:39:37.348203+0000","last_fullsized":"2023-11-30T18:39:37.348203+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327088+0000","last_change":"2023-11-30T18:39:36.940369+0000","last_active":"2023-11-30T18:39:37.327088+0000","last_peered":"2023-11-30T18:39:37.327088+0000","last_clean":"2023-11-30T18:39:37.327088+0000","last_became_active":"2023-11-30T18:39:36.940068+0000","last_became_peered":"2023-11-30T18:39:36.940068+0000","last_unstale":"2023-11-30T18:39:37.327088+0000","last_undegraded":"2023-11-30T18:39:37.327088+0000","last_fullsized":"2023-11-30T18:39:37.327088+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.344294+0000","last_change":"2023-11-30T18:39:37.339378+0000","last_active":"2023-11-30T18:39:37.344294+0000","last_peered":"2023-11-30T18:39:37.344294+0000","last_clean":"2023-11-30T18:39:37.344294+0000","last_became_active":"2023-11-30T18:39:37.339129+0000","last_became_peered":"2023-11-30T18:39:37.339129+0000","last_unstale":"2023-11-30T18:39:37.344294+0000","last_undegraded":"2023-11-30T18:39:37.344294+0000","last_fullsized":"2023-11-30T18:39:37.344294+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327878+0000","last_change":"2023-11-30T18:39:36.956213+0000","last_active":"2023-11-30T18:39:37.327878+0000","last_peered":"2023-11-30T18:39:37.327878+0000","last_clean":"2023-11-30T18:39:37.327878+0000","last_became_active":"2023-11-30T18:39:36.955972+0000","last_became_peered":"2023-11-30T18:39:36.955972+0000","last_unstale":"2023-11-30T18:39:37.327878+0000","last_undegraded":"2023-11-30T18:39:37.327878+0000","last_fullsized":"2023-11-30T18:39:37.327878+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349361+0000","last_change":"2023-11-30T18:39:37.342243+0000","last_active":"2023-11-30T18:39:37.349361+0000","last_peered":"2023-11-30T18:39:37.349361+0000","last_clean":"2023-11-30T18:39:37.349361+0000","last_became_active":"2023-11-30T18:39:37.341924+0000","last_became_peered":"2023-11-30T18:39:37.341924+0000","last_unstale":"2023-11-30T18:39:37.349361+0000","last_undegraded":"2023-11-30T18:39:37.349361+0000","last_fullsized":"2023-11-30T18:39:37.349361+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.338109+0000","last_change":"2023-11-30T18:39:36.951143+0000","last_active":"2023-11-30T18:39:37.338109+0000","last_peered":"2023-11-30T18:39:37.338109+0000","last_clean":"2023-11-30T18:39:37.338109+0000","last_became_active":"2023-11-30T18:39:36.949920+0000","last_became_peered":"2023-11-30T18:39:36.949920+0000","last_unstale":"2023-11-30T18:39:37.338109+0000","last_undegraded":"2023-11-30T18:39:37.338109+0000","last_fullsized":"2023-11-30T18:39:37.338109+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347456+0000","last_change":"2023-11-30T18:39:37.345550+0000","last_active":"2023-11-30T18:39:37.347456+0000","last_peered":"2023-11-30T18:39:37.347456+0000","last_clean":"2023-11-30T18:39:37.347456+0000","last_became_active":"2023-11-30T18:39:37.341594+0000","last_became_peered":"2023-11-30T18:39:37.341594+0000","last_unstale":"2023-11-30T18:39:37.347456+0000","last_undegraded":"2023-11-30T18:39:37.347456+0000","last_fullsized":"2023-11-30T18:39:37.347456+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.336742+0000","last_change":"2023-11-30T18:39:36.946323+0000","last_active":"2023-11-30T18:39:37.336742+0000","last_peered":"2023-11-30T18:39:37.336742+0000","last_clean":"2023-11-30T18:39:37.336742+0000","last_became_active":"2023-11-30T18:39:36.946044+0000","last_became_peered":"2023-11-30T18:39:36.946044+0000","last_unstale":"2023-11-30T18:39:37.336742+0000","last_undegraded":"2023-11-30T18:39:37.336742+0000","last_fullsized":"2023-11-30T18:39:37.336742+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.340269+0000","last_change":"2023-11-30T18:39:37.331035+0000","last_active":"2023-11-30T18:39:37.340269+0000","last_peered":"2023-11-30T18:39:37.340269+0000","last_clean":"2023-11-30T18:39:37.340269+0000","last_became_active":"2023-11-30T18:39:37.330729+0000","last_became_peered":"2023-11-30T18:39:37.330729+0000","last_unstale":"2023-11-30T18:39:37.340269+0000","last_undegraded":"2023-11-30T18:39:37.340269+0000","last_fullsized":"2023-11-30T18:39:37.340269+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.337914+0000","last_change":"2023-11-30T18:39:36.950391+0000","last_active":"2023-11-30T18:39:37.337914+0000","last_peered":"2023-11-30T18:39:37.337914+0000","last_clean":"2023-11-30T18:39:37.337914+0000","last_became_active":"2023-11-30T18:39:36.946855+0000","last_became_peered":"2023-11-30T18:39:36.946855+0000","last_unstale":"2023-11-30T18:39:37.337914+0000","last_undegraded":"2023-11-30T18:39:37.337914+0000","last_fullsized":"2023-11-30T18:39:37.337914+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347365+0000","last_change":"2023-11-30T18:39:37.340342+0000","last_active":"2023-11-30T18:39:37.347365+0000","last_peered":"2023-11-30T18:39:37.347365+0000","last_clean":"2023-11-30T18:39:37.347365+0000","last_became_active":"2023-11-30T18:39:37.340045+0000","last_became_peered":"2023-11-30T18:39:37.340045+0000","last_unstale":"2023-11-30T18:39:37.347365+0000","last_undegraded":"2023-11-30T18:39:37.347365+0000","last_fullsized":"2023-11-30T18:39:37.347365+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352099+0000","last_change":"2023-11-30T18:39:36.948987+0000","last_active":"2023-11-30T18:39:37.352099+0000","last_peered":"2023-11-30T18:39:37.352099+0000","last_clean":"2023-11-30T18:39:37.352099+0000","last_became_active":"2023-11-30T18:39:36.947046+0000","last_became_peered":"2023-11-30T18:39:36.947046+0000","last_unstale":"2023-11-30T18:39:37.352099+0000","last_undegraded":"2023-11-30T18:39:37.352099+0000","last_fullsized":"2023-11-30T18:39:37.352099+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.345480+0000","last_change":"2023-11-30T18:39:37.341621+0000","last_active":"2023-11-30T18:39:37.345480+0000","last_peered":"2023-11-30T18:39:37.345480+0000","last_clean":"2023-11-30T18:39:37.345480+0000","last_became_active":"2023-11-30T18:39:37.341312+0000","last_became_peered":"2023-11-30T18:39:37.341312+0000","last_unstale":"2023-11-30T18:39:37.345480+0000","last_undegraded":"2023-11-30T18:39:37.345480+0000","last_fullsized":"2023-11-30T18:39:37.345480+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346986+0000","last_change":"2023-11-30T18:39:36.952827+0000","last_active":"2023-11-30T18:39:37.346986+0000","last_peered":"2023-11-30T18:39:37.346986+0000","last_clean":"2023-11-30T18:39:37.346986+0000","last_became_active":"2023-11-30T18:39:36.952608+0000","last_became_peered":"2023-11-30T18:39:36.952608+0000","last_unstale":"2023-11-30T18:39:37.346986+0000","last_undegraded":"2023-11-30T18:39:37.346986+0000","last_fullsized":"2023-11-30T18:39:37.346986+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.342144+0000","last_change":"2023-11-30T18:39:37.339035+0000","last_active":"2023-11-30T18:39:37.342144+0000","last_peered":"2023-11-30T18:39:37.342144+0000","last_clean":"2023-11-30T18:39:37.342144+0000","last_became_active":"2023-11-30T18:39:37.338479+0000","last_became_peered":"2023-11-30T18:39:37.338479+0000","last_unstale":"2023-11-30T18:39:37.342144+0000","last_undegraded":"2023-11-30T18:39:37.342144+0000","last_fullsized":"2023-11-30T18:39:37.342144+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"202'2","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.340898+0000","last_change":"2023-11-30T18:39:36.944227+0000","last_active":"2023-11-30T18:39:37.340898+0000","last_peered":"2023-11-30T18:39:37.340898+0000","last_clean":"2023-11-30T18:39:37.340898+0000","last_became_active":"2023-11-30T18:39:36.944014+0000","last_became_peered":"2023-11-30T18:39:36.944014+0000","last_unstale":"2023-11-30T18:39:37.340898+0000","last_undegraded":"2023-11-30T18:39:37.340898+0000","last_fullsized":"2023-11-30T18:39:37.340898+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346109+0000","last_change":"2023-11-30T18:39:37.338996+0000","last_active":"2023-11-30T18:39:37.346109+0000","last_peered":"2023-11-30T18:39:37.346109+0000","last_clean":"2023-11-30T18:39:37.346109+0000","last_became_active":"2023-11-30T18:39:37.338697+0000","last_became_peered":"2023-11-30T18:39:37.338697+0000","last_unstale":"2023-11-30T18:39:37.346109+0000","last_undegraded":"2023-11-30T18:39:37.346109+0000","last_fullsized":"2023-11-30T18:39:37.346109+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.325152+0000","last_change":"2023-11-30T18:39:36.946452+0000","last_active":"2023-11-30T18:39:37.325152+0000","last_peered":"2023-11-30T18:39:37.325152+0000","last_clean":"2023-11-30T18:39:37.325152+0000","last_became_active":"2023-11-30T18:39:36.946158+0000","last_became_peered":"2023-11-30T18:39:36.946158+0000","last_unstale":"2023-11-30T18:39:37.325152+0000","last_undegraded":"2023-11-30T18:39:37.325152+0000","last_fullsized":"2023-11-30T18:39:37.325152+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.350555+0000","last_change":"2023-11-30T18:39:37.347669+0000","last_active":"2023-11-30T18:39:37.350555+0000","last_peered":"2023-11-30T18:39:37.350555+0000","last_clean":"2023-11-30T18:39:37.350555+0000","last_became_active":"2023-11-30T18:39:37.347353+0000","last_became_peered":"2023-11-30T18:39:37.347353+0000","last_unstale":"2023-11-30T18:39:37.350555+0000","last_undegraded":"2023-11-30T18:39:37.350555+0000","last_fullsized":"2023-11-30T18:39:37.350555+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.326852+0000","last_change":"2023-11-30T18:39:36.948868+0000","last_active":"2023-11-30T18:39:37.326852+0000","last_peered":"2023-11-30T18:39:37.326852+0000","last_clean":"2023-11-30T18:39:37.326852+0000","last_became_active":"2023-11-30T18:39:36.948560+0000","last_became_peered":"2023-11-30T18:39:36.948560+0000","last_unstale":"2023-11-30T18:39:37.326852+0000","last_undegraded":"2023-11-30T18:39:37.326852+0000","last_fullsized":"2023-11-30T18:39:37.326852+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.345333+0000","last_change":"2023-11-30T18:39:37.342635+0000","last_active":"2023-11-30T18:39:37.345333+0000","last_peered":"2023-11-30T18:39:37.345333+0000","last_clean":"2023-11-30T18:39:37.345333+0000","last_became_active":"2023-11-30T18:39:37.342376+0000","last_became_peered":"2023-11-30T18:39:37.342376+0000","last_unstale":"2023-11-30T18:39:37.345333+0000","last_undegraded":"2023-11-30T18:39:37.345333+0000","last_fullsized":"2023-11-30T18:39:37.345333+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327461+0000","last_change":"2023-11-30T18:39:36.944677+0000","last_active":"2023-11-30T18:39:37.327461+0000","last_peered":"2023-11-30T18:39:37.327461+0000","last_clean":"2023-11-30T18:39:37.327461+0000","last_became_active":"2023-11-30T18:39:36.944380+0000","last_became_peered":"2023-11-30T18:39:36.944380+0000","last_unstale":"2023-11-30T18:39:37.327461+0000","last_undegraded":"2023-11-30T18:39:37.327461+0000","last_fullsized":"2023-11-30T18:39:37.327461+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.338865+0000","last_change":"2023-11-30T18:39:37.334416+0000","last_active":"2023-11-30T18:39:37.338865+0000","last_peered":"2023-11-30T18:39:37.338865+0000","last_clean":"2023-11-30T18:39:37.338865+0000","last_became_active":"2023-11-30T18:39:37.334121+0000","last_became_peered":"2023-11-30T18:39:37.334121+0000","last_unstale":"2023-11-30T18:39:37.338865+0000","last_undegraded":"2023-11-30T18:39:37.338865+0000","last_fullsized":"2023-11-30T18:39:37.338865+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.323817+0000","last_change":"2023-11-30T18:39:36.946789+0000","last_active":"2023-11-30T18:39:37.323817+0000","last_peered":"2023-11-30T18:39:37.323817+0000","last_clean":"2023-11-30T18:39:37.323817+0000","last_became_active":"2023-11-30T18:39:36.946341+0000","last_became_peered":"2023-11-30T18:39:36.946341+0000","last_unstale":"2023-11-30T18:39:37.323817+0000","last_undegraded":"2023-11-30T18:39:37.323817+0000","last_fullsized":"2023-11-30T18:39:37.323817+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349417+0000","last_change":"2023-11-30T18:39:37.344746+0000","last_active":"2023-11-30T18:39:37.349417+0000","last_peered":"2023-11-30T18:39:37.349417+0000","last_clean":"2023-11-30T18:39:37.349417+0000","last_became_active":"2023-11-30T18:39:37.344421+0000","last_became_peered":"2023-11-30T18:39:37.344421+0000","last_unstale":"2023-11-30T18:39:37.349417+0000","last_undegraded":"2023-11-30T18:39:37.349417+0000","last_fullsized":"2023-11-30T18:39:37.349417+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327484+0000","last_change":"2023-11-30T18:39:36.950190+0000","last_active":"2023-11-30T18:39:37.327484+0000","last_peered":"2023-11-30T18:39:37.327484+0000","last_clean":"2023-11-30T18:39:37.327484+0000","last_became_active":"2023-11-30T18:39:36.949891+0000","last_became_peered":"2023-11-30T18:39:36.949891+0000","last_unstale":"2023-11-30T18:39:37.327484+0000","last_undegraded":"2023-11-30T18:39:37.327484+0000","last_fullsized":"2023-11-30T18:39:37.327484+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347541+0000","last_change":"2023-11-30T18:39:37.335167+0000","last_active":"2023-11-30T18:39:37.347541+0000","last_peered":"2023-11-30T18:39:37.347541+0000","last_clean":"2023-11-30T18:39:37.347541+0000","last_became_active":"2023-11-30T18:39:37.334308+0000","last_became_peered":"2023-11-30T18:39:37.334308+0000","last_unstale":"2023-11-30T18:39:37.347541+0000","last_undegraded":"2023-11-30T18:39:37.347541+0000","last_fullsized":"2023-11-30T18:39:37.347541+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.351861+0000","last_change":"2023-11-30T18:39:36.952979+0000","last_active":"2023-11-30T18:39:37.351861+0000","last_peered":"2023-11-30T18:39:37.351861+0000","last_clean":"2023-11-30T18:39:37.351861+0000","last_became_active":"2023-11-30T18:39:36.952615+0000","last_became_peered":"2023-11-30T18:39:36.952615+0000","last_unstale":"2023-11-30T18:39:37.351861+0000","last_undegraded":"2023-11-30T18:39:37.351861+0000","last_fullsized":"2023-11-30T18:39:37.351861+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.334851+0000","last_change":"2023-11-30T18:39:37.330696+0000","last_active":"2023-11-30T18:39:37.334851+0000","last_peered":"2023-11-30T18:39:37.334851+0000","last_clean":"2023-11-30T18:39:37.334851+0000","last_became_active":"2023-11-30T18:39:37.330391+0000","last_became_peered":"2023-11-30T18:39:37.330391+0000","last_unstale":"2023-11-30T18:39:37.334851+0000","last_undegraded":"2023-11-30T18:39:37.334851+0000","last_fullsized":"2023-11-30T18:39:37.334851+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"202'2","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.348393+0000","last_change":"2023-11-30T18:39:36.954616+0000","last_active":"2023-11-30T18:39:37.348393+0000","last_peered":"2023-11-30T18:39:37.348393+0000","last_clean":"2023-11-30T18:39:37.348393+0000","last_became_active":"2023-11-30T18:39:36.953752+0000","last_became_peered":"2023-11-30T18:39:36.953752+0000","last_unstale":"2023-11-30T18:39:37.348393+0000","last_undegraded":"2023-11-30T18:39:37.348393+0000","last_fullsized":"2023-11-30T18:39:37.348393+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.345919+0000","last_change":"2023-11-30T18:39:37.341136+0000","last_active":"2023-11-30T18:39:37.345919+0000","last_peered":"2023-11-30T18:39:37.345919+0000","last_clean":"2023-11-30T18:39:37.345919+0000","last_became_active":"2023-11-30T18:39:37.340592+0000","last_became_peered":"2023-11-30T18:39:37.340592+0000","last_unstale":"2023-11-30T18:39:37.345919+0000","last_undegraded":"2023-11-30T18:39:37.345919+0000","last_fullsized":"2023-11-30T18:39:37.345919+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.333794+0000","last_change":"2023-11-30T18:39:36.946600+0000","last_active":"2023-11-30T18:39:37.333794+0000","last_peered":"2023-11-30T18:39:37.333794+0000","last_clean":"2023-11-30T18:39:37.333794+0000","last_became_active":"2023-11-30T18:39:36.946270+0000","last_became_peered":"2023-11-30T18:39:36.946270+0000","last_unstale":"2023-11-30T18:39:37.333794+0000","last_undegraded":"2023-11-30T18:39:37.333794+0000","last_fullsized":"2023-11-30T18:39:37.333794+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.345976+0000","last_change":"2023-11-30T18:39:37.341740+0000","last_active":"2023-11-30T18:39:37.345976+0000","last_peered":"2023-11-30T18:39:37.345976+0000","last_clean":"2023-11-30T18:39:37.345976+0000","last_became_active":"2023-11-30T18:39:37.341314+0000","last_became_peered":"2023-11-30T18:39:37.341314+0000","last_unstale":"2023-11-30T18:39:37.345976+0000","last_undegraded":"2023-11-30T18:39:37.345976+0000","last_fullsized":"2023-11-30T18:39:37.345976+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327189+0000","last_change":"2023-11-30T18:39:36.944458+0000","last_active":"2023-11-30T18:39:37.327189+0000","last_peered":"2023-11-30T18:39:37.327189+0000","last_clean":"2023-11-30T18:39:37.327189+0000","last_became_active":"2023-11-30T18:39:36.944179+0000","last_became_peered":"2023-11-30T18:39:36.944179+0000","last_unstale":"2023-11-30T18:39:37.327189+0000","last_undegraded":"2023-11-30T18:39:37.327189+0000","last_fullsized":"2023-11-30T18:39:37.327189+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.353566+0000","last_change":"2023-11-30T18:39:37.352804+0000","last_active":"2023-11-30T18:39:37.353566+0000","last_peered":"2023-11-30T18:39:37.353566+0000","last_clean":"2023-11-30T18:39:37.353566+0000","last_became_active":"2023-11-30T18:39:37.352435+0000","last_became_peered":"2023-11-30T18:39:37.352435+0000","last_unstale":"2023-11-30T18:39:37.353566+0000","last_undegraded":"2023-11-30T18:39:37.353566+0000","last_fullsized":"2023-11-30T18:39:37.353566+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347239+0000","last_change":"2023-11-30T18:39:36.950997+0000","last_active":"2023-11-30T18:39:37.347239+0000","last_peered":"2023-11-30T18:39:37.347239+0000","last_clean":"2023-11-30T18:39:37.347239+0000","last_became_active":"2023-11-30T18:39:36.950673+0000","last_became_peered":"2023-11-30T18:39:36.950673+0000","last_unstale":"2023-11-30T18:39:37.347239+0000","last_undegraded":"2023-11-30T18:39:37.347239+0000","last_fullsized":"2023-11-30T18:39:37.347239+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352565+0000","last_change":"2023-11-30T18:39:37.351298+0000","last_active":"2023-11-30T18:39:37.352565+0000","last_peered":"2023-11-30T18:39:37.352565+0000","last_clean":"2023-11-30T18:39:37.352565+0000","last_became_active":"2023-11-30T18:39:37.350781+0000","last_became_peered":"2023-11-30T18:39:37.350781+0000","last_unstale":"2023-11-30T18:39:37.352565+0000","last_undegraded":"2023-11-30T18:39:37.352565+0000","last_fullsized":"2023-11-30T18:39:37.352565+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327139+0000","last_change":"2023-11-30T18:39:36.948188+0000","last_active":"2023-11-30T18:39:37.327139+0000","last_peered":"2023-11-30T18:39:37.327139+0000","last_clean":"2023-11-30T18:39:37.327139+0000","last_became_active":"2023-11-30T18:39:36.947873+0000","last_became_peered":"2023-11-30T18:39:36.947873+0000","last_unstale":"2023-11-30T18:39:37.327139+0000","last_undegraded":"2023-11-30T18:39:37.327139+0000","last_fullsized":"2023-11-30T18:39:37.327139+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349380+0000","last_change":"2023-11-30T18:39:37.342904+0000","last_active":"2023-11-30T18:39:37.349380+0000","last_peered":"2023-11-30T18:39:37.349380+0000","last_clean":"2023-11-30T18:39:37.349380+0000","last_became_active":"2023-11-30T18:39:37.342597+0000","last_became_peered":"2023-11-30T18:39:37.342597+0000","last_unstale":"2023-11-30T18:39:37.349380+0000","last_undegraded":"2023-11-30T18:39:37.349380+0000","last_fullsized":"2023-11-30T18:39:37.349380+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.323729+0000","last_change":"2023-11-30T18:39:36.946627+0000","last_active":"2023-11-30T18:39:37.323729+0000","last_peered":"2023-11-30T18:39:37.323729+0000","last_clean":"2023-11-30T18:39:37.323729+0000","last_became_active":"2023-11-30T18:39:36.945813+0000","last_became_peered":"2023-11-30T18:39:36.945813+0000","last_unstale":"2023-11-30T18:39:37.323729+0000","last_undegraded":"2023-11-30T18:39:37.323729+0000","last_fullsized":"2023-11-30T18:39:37.323729+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346095+0000","last_change":"2023-11-30T18:39:37.343145+0000","last_active":"2023-11-30T18:39:37.346095+0000","last_peered":"2023-11-30T18:39:37.346095+0000","last_clean":"2023-11-30T18:39:37.346095+0000","last_became_active":"2023-11-30T18:39:37.342863+0000","last_became_peered":"2023-11-30T18:39:37.342863+0000","last_unstale":"2023-11-30T18:39:37.346095+0000","last_undegraded":"2023-11-30T18:39:37.346095+0000","last_fullsized":"2023-11-30T18:39:37.346095+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.330188+0000","last_change":"2023-11-30T18:39:36.949760+0000","last_active":"2023-11-30T18:39:37.330188+0000","last_peered":"2023-11-30T18:39:37.330188+0000","last_clean":"2023-11-30T18:39:37.330188+0000","last_became_active":"2023-11-30T18:39:36.949139+0000","last_became_peered":"2023-11-30T18:39:36.949139+0000","last_unstale":"2023-11-30T18:39:37.330188+0000","last_undegraded":"2023-11-30T18:39:37.330188+0000","last_fullsized":"2023-11-30T18:39:37.330188+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.336357+0000","last_change":"2023-11-30T18:39:37.333794+0000","last_active":"2023-11-30T18:39:37.336357+0000","last_peered":"2023-11-30T18:39:37.336357+0000","last_clean":"2023-11-30T18:39:37.336357+0000","last_became_active":"2023-11-30T18:39:37.333486+0000","last_became_peered":"2023-11-30T18:39:37.333486+0000","last_unstale":"2023-11-30T18:39:37.336357+0000","last_undegraded":"2023-11-30T18:39:37.336357+0000","last_fullsized":"2023-11-30T18:39:37.336357+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"202'2","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.339149+0000","last_change":"2023-11-30T18:39:36.945986+0000","last_active":"2023-11-30T18:39:37.339149+0000","last_peered":"2023-11-30T18:39:37.339149+0000","last_clean":"2023-11-30T18:39:37.339149+0000","last_became_active":"2023-11-30T18:39:36.945645+0000","last_became_peered":"2023-11-30T18:39:36.945645+0000","last_unstale":"2023-11-30T18:39:37.339149+0000","last_undegraded":"2023-11-30T18:39:37.339149+0000","last_fullsized":"2023-11-30T18:39:37.339149+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.342995+0000","last_change":"2023-11-30T18:39:37.336408+0000","last_active":"2023-11-30T18:39:37.342995+0000","last_peered":"2023-11-30T18:39:37.342995+0000","last_clean":"2023-11-30T18:39:37.342995+0000","last_became_active":"2023-11-30T18:39:37.335738+0000","last_became_peered":"2023-11-30T18:39:37.335738+0000","last_unstale":"2023-11-30T18:39:37.342995+0000","last_undegraded":"2023-11-30T18:39:37.342995+0000","last_fullsized":"2023-11-30T18:39:37.342995+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.337854+0000","last_change":"2023-11-30T18:39:36.955512+0000","last_active":"2023-11-30T18:39:37.337854+0000","last_peered":"2023-11-30T18:39:37.337854+0000","last_clean":"2023-11-30T18:39:37.337854+0000","last_became_active":"2023-11-30T18:39:36.955212+0000","last_became_peered":"2023-11-30T18:39:36.955212+0000","last_unstale":"2023-11-30T18:39:37.337854+0000","last_undegraded":"2023-11-30T18:39:37.337854+0000","last_fullsized":"2023-11-30T18:39:37.337854+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.338579+0000","last_change":"2023-11-30T18:39:37.330346+0000","last_active":"2023-11-30T18:39:37.338579+0000","last_peered":"2023-11-30T18:39:37.338579+0000","last_clean":"2023-11-30T18:39:37.338579+0000","last_became_active":"2023-11-30T18:39:37.330086+0000","last_became_peered":"2023-11-30T18:39:37.330086+0000","last_unstale":"2023-11-30T18:39:37.338579+0000","last_undegraded":"2023-11-30T18:39:37.338579+0000","last_fullsized":"2023-11-30T18:39:37.338579+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.337927+0000","last_change":"2023-11-30T18:39:36.950992+0000","last_active":"2023-11-30T18:39:37.337927+0000","last_peered":"2023-11-30T18:39:37.337927+0000","last_clean":"2023-11-30T18:39:37.337927+0000","last_became_active":"2023-11-30T18:39:36.950695+0000","last_became_peered":"2023-11-30T18:39:36.950695+0000","last_unstale":"2023-11-30T18:39:37.337927+0000","last_undegraded":"2023-11-30T18:39:37.337927+0000","last_fullsized":"2023-11-30T18:39:37.337927+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.344708+0000","last_change":"2023-11-30T18:39:37.331147+0000","last_active":"2023-11-30T18:39:37.344708+0000","last_peered":"2023-11-30T18:39:37.344708+0000","last_clean":"2023-11-30T18:39:37.344708+0000","last_became_active":"2023-11-30T18:39:37.330838+0000","last_became_peered":"2023-11-30T18:39:37.330838+0000","last_unstale":"2023-11-30T18:39:37.344708+0000","last_undegraded":"2023-11-30T18:39:37.344708+0000","last_fullsized":"2023-11-30T18:39:37.344708+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.325251+0000","last_change":"2023-11-30T18:39:36.952569+0000","last_active":"2023-11-30T18:39:37.325251+0000","last_peered":"2023-11-30T18:39:37.325251+0000","last_clean":"2023-11-30T18:39:37.325251+0000","last_became_active":"2023-11-30T18:39:36.952293+0000","last_became_peered":"2023-11-30T18:39:36.952293+0000","last_unstale":"2023-11-30T18:39:37.325251+0000","last_undegraded":"2023-11-30T18:39:37.325251+0000","last_fullsized":"2023-11-30T18:39:37.325251+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352722+0000","last_change":"2023-11-30T18:39:37.350409+0000","last_active":"2023-11-30T18:39:37.352722+0000","last_peered":"2023-11-30T18:39:37.352722+0000","last_clean":"2023-11-30T18:39:37.352722+0000","last_became_active":"2023-11-30T18:39:37.350135+0000","last_became_peered":"2023-11-30T18:39:37.350135+0000","last_unstale":"2023-11-30T18:39:37.352722+0000","last_undegraded":"2023-11-30T18:39:37.352722+0000","last_fullsized":"2023-11-30T18:39:37.352722+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.338222+0000","last_change":"2023-11-30T18:39:36.946783+0000","last_active":"2023-11-30T18:39:37.338222+0000","last_peered":"2023-11-30T18:39:37.338222+0000","last_clean":"2023-11-30T18:39:37.338222+0000","last_became_active":"2023-11-30T18:39:36.946533+0000","last_became_peered":"2023-11-30T18:39:36.946533+0000","last_unstale":"2023-11-30T18:39:37.338222+0000","last_undegraded":"2023-11-30T18:39:37.338222+0000","last_fullsized":"2023-11-30T18:39:37.338222+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346709+0000","last_change":"2023-11-30T18:39:37.343014+0000","last_active":"2023-11-30T18:39:37.346709+0000","last_peered":"2023-11-30T18:39:37.346709+0000","last_clean":"2023-11-30T18:39:37.346709+0000","last_became_active":"2023-11-30T18:39:37.342723+0000","last_became_peered":"2023-11-30T18:39:37.342723+0000","last_unstale":"2023-11-30T18:39:37.346709+0000","last_undegraded":"2023-11-30T18:39:37.346709+0000","last_fullsized":"2023-11-30T18:39:37.346709+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.336615+0000","last_change":"2023-11-30T18:39:36.946283+0000","last_active":"2023-11-30T18:39:37.336615+0000","last_peered":"2023-11-30T18:39:37.336615+0000","last_clean":"2023-11-30T18:39:37.336615+0000","last_became_active":"2023-11-30T18:39:36.946000+0000","last_became_peered":"2023-11-30T18:39:36.946000+0000","last_unstale":"2023-11-30T18:39:37.336615+0000","last_undegraded":"2023-11-30T18:39:37.336615+0000","last_fullsized":"2023-11-30T18:39:37.336615+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.353262+0000","last_change":"2023-11-30T18:39:37.352247+0000","last_active":"2023-11-30T18:39:37.353262+0000","last_peered":"2023-11-30T18:39:37.353262+0000","last_clean":"2023-11-30T18:39:37.353262+0000","last_became_active":"2023-11-30T18:39:37.351956+0000","last_became_peered":"2023-11-30T18:39:37.351956+0000","last_unstale":"2023-11-30T18:39:37.353262+0000","last_undegraded":"2023-11-30T18:39:37.353262+0000","last_fullsized":"2023-11-30T18:39:37.353262+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327175+0000","last_change":"2023-11-30T18:39:36.944204+0000","last_active":"2023-11-30T18:39:37.327175+0000","last_peered":"2023-11-30T18:39:37.327175+0000","last_clean":"2023-11-30T18:39:37.327175+0000","last_became_active":"2023-11-30T18:39:36.943937+0000","last_became_peered":"2023-11-30T18:39:36.943937+0000","last_unstale":"2023-11-30T18:39:37.327175+0000","last_undegraded":"2023-11-30T18:39:37.327175+0000","last_fullsized":"2023-11-30T18:39:37.327175+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.344165+0000","last_change":"2023-11-30T18:39:37.340873+0000","last_active":"2023-11-30T18:39:37.344165+0000","last_peered":"2023-11-30T18:39:37.344165+0000","last_clean":"2023-11-30T18:39:37.344165+0000","last_became_active":"2023-11-30T18:39:37.340580+0000","last_became_peered":"2023-11-30T18:39:37.340580+0000","last_unstale":"2023-11-30T18:39:37.344165+0000","last_undegraded":"2023-11-30T18:39:37.344165+0000","last_fullsized":"2023-11-30T18:39:37.344165+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.326374+0000","last_change":"2023-11-30T18:39:36.950400+0000","last_active":"2023-11-30T18:39:37.326374+0000","last_peered":"2023-11-30T18:39:37.326374+0000","last_clean":"2023-11-30T18:39:37.326374+0000","last_became_active":"2023-11-30T18:39:36.949951+0000","last_became_peered":"2023-11-30T18:39:36.949951+0000","last_unstale":"2023-11-30T18:39:37.326374+0000","last_undegraded":"2023-11-30T18:39:37.326374+0000","last_fullsized":"2023-11-30T18:39:37.326374+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.342774+0000","last_change":"2023-11-30T18:39:37.334735+0000","last_active":"2023-11-30T18:39:37.342774+0000","last_peered":"2023-11-30T18:39:37.342774+0000","last_clean":"2023-11-30T18:39:37.342774+0000","last_became_active":"2023-11-30T18:39:37.334250+0000","last_became_peered":"2023-11-30T18:39:37.334250+0000","last_unstale":"2023-11-30T18:39:37.342774+0000","last_undegraded":"2023-11-30T18:39:37.342774+0000","last_fullsized":"2023-11-30T18:39:37.342774+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.326966+0000","last_change":"2023-11-30T18:39:36.944158+0000","last_active":"2023-11-30T18:39:37.326966+0000","last_peered":"2023-11-30T18:39:37.326966+0000","last_clean":"2023-11-30T18:39:37.326966+0000","last_became_active":"2023-11-30T18:39:36.943851+0000","last_became_peered":"2023-11-30T18:39:36.943851+0000","last_unstale":"2023-11-30T18:39:37.326966+0000","last_undegraded":"2023-11-30T18:39:37.326966+0000","last_fullsized":"2023-11-30T18:39:37.326966+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":171,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327395+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T18:39:37.327395+0000","last_peered":"2023-11-30T18:39:37.327395+0000","last_clean":"2023-11-30T18:39:37.327395+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T18:39:37.327395+0000","last_undegraded":"2023-11-30T18:39:37.327395+0000","last_fullsized":"2023-11-30T18:39:37.327395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347342+0000","last_change":"2023-11-30T18:39:37.340048+0000","last_active":"2023-11-30T18:39:37.347342+0000","last_peered":"2023-11-30T18:39:37.347342+0000","last_clean":"2023-11-30T18:39:37.347342+0000","last_became_active":"2023-11-30T18:39:37.339749+0000","last_became_peered":"2023-11-30T18:39:37.339749+0000","last_unstale":"2023-11-30T18:39:37.347342+0000","last_undegraded":"2023-11-30T18:39:37.347342+0000","last_fullsized":"2023-11-30T18:39:37.347342+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.336922+0000","last_change":"2023-11-30T18:39:36.954943+0000","last_active":"2023-11-30T18:39:37.336922+0000","last_peered":"2023-11-30T18:39:37.336922+0000","last_clean":"2023-11-30T18:39:37.336922+0000","last_became_active":"2023-11-30T18:39:36.954644+0000","last_became_peered":"2023-11-30T18:39:36.954644+0000","last_unstale":"2023-11-30T18:39:37.336922+0000","last_undegraded":"2023-11-30T18:39:37.336922+0000","last_fullsized":"2023-11-30T18:39:37.336922+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":169,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327150+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T18:39:37.327150+0000","last_peered":"2023-11-30T18:39:37.327150+0000","last_clean":"2023-11-30T18:39:37.327150+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T18:39:37.327150+0000","last_undegraded":"2023-11-30T18:39:37.327150+0000","last_fullsized":"2023-11-30T18:39:37.327150+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.344506+0000","last_change":"2023-11-30T18:39:37.342072+0000","last_active":"2023-11-30T18:39:37.344506+0000","last_peered":"2023-11-30T18:39:37.344506+0000","last_clean":"2023-11-30T18:39:37.344506+0000","last_became_active":"2023-11-30T18:39:37.341885+0000","last_became_peered":"2023-11-30T18:39:37.341885+0000","last_unstale":"2023-11-30T18:39:37.344506+0000","last_undegraded":"2023-11-30T18:39:37.344506+0000","last_fullsized":"2023-11-30T18:39:37.344506+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"202'2","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347830+0000","last_change":"2023-11-30T18:39:36.951915+0000","last_active":"2023-11-30T18:39:37.347830+0000","last_peered":"2023-11-30T18:39:37.347830+0000","last_clean":"2023-11-30T18:39:37.347830+0000","last_became_active":"2023-11-30T18:39:36.951639+0000","last_became_peered":"2023-11-30T18:39:36.951639+0000","last_unstale":"2023-11-30T18:39:37.347830+0000","last_undegraded":"2023-11-30T18:39:37.347830+0000","last_fullsized":"2023-11-30T18:39:37.347830+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.323644+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T18:39:37.323644+0000","last_peered":"2023-11-30T18:39:37.323644+0000","last_clean":"2023-11-30T18:39:37.323644+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T18:39:37.323644+0000","last_undegraded":"2023-11-30T18:39:37.323644+0000","last_fullsized":"2023-11-30T18:39:37.323644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.345987+0000","last_change":"2023-11-30T18:39:37.339470+0000","last_active":"2023-11-30T18:39:37.345987+0000","last_peered":"2023-11-30T18:39:37.345987+0000","last_clean":"2023-11-30T18:39:37.345987+0000","last_became_active":"2023-11-30T18:39:37.339218+0000","last_became_peered":"2023-11-30T18:39:37.339218+0000","last_unstale":"2023-11-30T18:39:37.345987+0000","last_undegraded":"2023-11-30T18:39:37.345987+0000","last_fullsized":"2023-11-30T18:39:37.345987+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.337752+0000","last_change":"2023-11-30T18:39:36.957232+0000","last_active":"2023-11-30T18:39:37.337752+0000","last_peered":"2023-11-30T18:39:37.337752+0000","last_clean":"2023-11-30T18:39:37.337752+0000","last_became_active":"2023-11-30T18:39:36.956927+0000","last_became_peered":"2023-11-30T18:39:36.956927+0000","last_unstale":"2023-11-30T18:39:37.337752+0000","last_undegraded":"2023-11-30T18:39:37.337752+0000","last_fullsized":"2023-11-30T18:39:37.337752+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":169,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.327987+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T18:39:37.327987+0000","last_peered":"2023-11-30T18:39:37.327987+0000","last_clean":"2023-11-30T18:39:37.327987+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T18:39:37.327987+0000","last_undegraded":"2023-11-30T18:39:37.327987+0000","last_fullsized":"2023-11-30T18:39:37.327987+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":165,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.330242+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T18:39:37.330242+0000","last_peered":"2023-11-30T18:39:37.330242+0000","last_clean":"2023-11-30T18:39:37.330242+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T18:39:37.330242+0000","last_undegraded":"2023-11-30T18:39:37.330242+0000","last_fullsized":"2023-11-30T18:39:37.330242+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349079+0000","last_change":"2023-11-30T18:39:37.345111+0000","last_active":"2023-11-30T18:39:37.349079+0000","last_peered":"2023-11-30T18:39:37.349079+0000","last_clean":"2023-11-30T18:39:37.349079+0000","last_became_active":"2023-11-30T18:39:37.344811+0000","last_became_peered":"2023-11-30T18:39:37.344811+0000","last_unstale":"2023-11-30T18:39:37.349079+0000","last_undegraded":"2023-11-30T18:39:37.349079+0000","last_fullsized":"2023-11-30T18:39:37.349079+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"202'3","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.349684+0000","last_change":"2023-11-30T18:39:36.954554+0000","last_active":"2023-11-30T18:39:37.349684+0000","last_peered":"2023-11-30T18:39:37.349684+0000","last_clean":"2023-11-30T18:39:37.349684+0000","last_became_active":"2023-11-30T18:39:36.954255+0000","last_became_peered":"2023-11-30T18:39:36.954255+0000","last_unstale":"2023-11-30T18:39:37.349684+0000","last_undegraded":"2023-11-30T18:39:37.349684+0000","last_fullsized":"2023-11-30T18:39:37.349684+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":163,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.330312+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T18:39:37.330312+0000","last_peered":"2023-11-30T18:39:37.330312+0000","last_clean":"2023-11-30T18:39:37.330312+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T18:39:37.330312+0000","last_undegraded":"2023-11-30T18:39:37.330312+0000","last_fullsized":"2023-11-30T18:39:37.330312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.352219+0000","last_change":"2023-11-30T18:39:37.351640+0000","last_active":"2023-11-30T18:39:37.352219+0000","last_peered":"2023-11-30T18:39:37.352219+0000","last_clean":"2023-11-30T18:39:37.352219+0000","last_became_active":"2023-11-30T18:39:37.350854+0000","last_became_peered":"2023-11-30T18:39:37.350854+0000","last_unstale":"2023-11-30T18:39:37.352219+0000","last_undegraded":"2023-11-30T18:39:37.352219+0000","last_fullsized":"2023-11-30T18:39:37.352219+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"202'4","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.351107+0000","last_change":"2023-11-30T18:39:36.949816+0000","last_active":"2023-11-30T18:39:37.351107+0000","last_peered":"2023-11-30T18:39:37.351107+0000","last_clean":"2023-11-30T18:39:37.351107+0000","last_became_active":"2023-11-30T18:39:36.949516+0000","last_became_peered":"2023-11-30T18:39:36.949516+0000","last_unstale":"2023-11-30T18:39:37.351107+0000","last_undegraded":"2023-11-30T18:39:37.351107+0000","last_fullsized":"2023-11-30T18:39:37.351107+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":163,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.331043+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T18:39:37.331043+0000","last_peered":"2023-11-30T18:39:37.331043+0000","last_clean":"2023-11-30T18:39:37.331043+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T18:39:37.331043+0000","last_undegraded":"2023-11-30T18:39:37.331043+0000","last_fullsized":"2023-11-30T18:39:37.331043+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.346595+0000","last_change":"2023-11-30T18:39:37.341865+0000","last_active":"2023-11-30T18:39:37.346595+0000","last_peered":"2023-11-30T18:39:37.346595+0000","last_clean":"2023-11-30T18:39:37.346595+0000","last_became_active":"2023-11-30T18:39:37.341560+0000","last_became_peered":"2023-11-30T18:39:37.341560+0000","last_unstale":"2023-11-30T18:39:37.346595+0000","last_undegraded":"2023-11-30T18:39:37.346595+0000","last_fullsized":"2023-11-30T18:39:37.346595+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"202'1","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347149+0000","last_change":"2023-11-30T18:39:36.954951+0000","last_active":"2023-11-30T18:39:37.347149+0000","last_peered":"2023-11-30T18:39:37.347149+0000","last_clean":"2023-11-30T18:39:37.347149+0000","last_became_active":"2023-11-30T18:39:36.954635+0000","last_became_peered":"2023-11-30T18:39:36.954635+0000","last_unstale":"2023-11-30T18:39:37.347149+0000","last_undegraded":"2023-11-30T18:39:37.347149+0000","last_fullsized":"2023-11-30T18:39:37.347149+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":171,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.329562+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T18:39:37.329562+0000","last_peered":"2023-11-30T18:39:37.329562+0000","last_clean":"2023-11-30T18:39:37.329562+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T18:39:37.329562+0000","last_undegraded":"2023-11-30T18:39:37.329562+0000","last_fullsized":"2023-11-30T18:39:37.329562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.347365+0000","last_change":"2023-11-30T18:39:37.343550+0000","last_active":"2023-11-30T18:39:37.347365+0000","last_peered":"2023-11-30T18:39:37.347365+0000","last_clean":"2023-11-30T18:39:37.347365+0000","last_became_active":"2023-11-30T18:39:37.343269+0000","last_became_peered":"2023-11-30T18:39:37.343269+0000","last_unstale":"2023-11-30T18:39:37.347365+0000","last_undegraded":"2023-11-30T18:39:37.347365+0000","last_fullsized":"2023-11-30T18:39:37.347365+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:36.921920+0000","last_clean_scrub_stamp":"2023-11-30T18:39:36.921920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.336520+0000","last_change":"2023-11-30T18:39:36.944024+0000","last_active":"2023-11-30T18:39:37.336520+0000","last_peered":"2023-11-30T18:39:37.336520+0000","last_clean":"2023-11-30T18:39:37.336520+0000","last_became_active":"2023-11-30T18:39:36.943512+0000","last_became_peered":"2023-11-30T18:39:36.943512+0000","last_unstale":"2023-11-30T18:39:37.336520+0000","last_undegraded":"2023-11-30T18:39:37.336520+0000","last_fullsized":"2023-11-30T18:39:37.336520+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:39:35.919960+0000","last_clean_scrub_stamp":"2023-11-30T18:39:35.919960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":190,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-11-30T18:39:37.325425+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T18:39:37.325425+0000","last_peered":"2023-11-30T18:39:37.325425+0000","last_clean":"2023-11-30T18:39:37.325425+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T18:39:37.325425+0000","last_undegraded":"2023-11-30T18:39:37.325425+0000","last_fullsized":"2023-11-30T18:39:37.325425+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575950,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303676,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068164,"statfs":{"total":96636764160,"available":96325799936,"internally_reserved":0,"allocated":2543616,"data_stored":1304277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.629,"15min":0.626},"min":{"1min":0.39200000000000002,"5min":0.35499999999999998,"15min":0.28699999999999998},"max":{"1min":0.81399999999999995,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.63200000000000001,"15min":0.63500000000000001},"min":{"1min":0.502,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77200000000000002,"5min":0.80600000000000005,"15min":0.82099999999999995},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.42999999999999999,"5min":0.40699999999999997,"15min":0.35899999999999999},"max":{"1min":0.70399999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.41999999999999998,"5min":0.38700000000000001,"15min":0.379},"max":{"1min":0.74399999999999999,"5min":0.877,"15min":0.877},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.44800000000000001,"5min":0.41699999999999998,"15min":0.379},"max":{"1min":0.66700000000000004,"5min":0.80500000000000005,"15min":0.81100000000000005},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58599999999999997,"15min":0.59299999999999997},"min":{"1min":0.47599999999999998,"5min":0.43099999999999999,"15min":0.38700000000000001},"max":{"1min":0.72699999999999998,"5min":0.82599999999999996,"15min":0.85399999999999998},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.40200000000000002,"5min":0.36699999999999999,"15min":0.35899999999999999},"max":{"1min":0.69299999999999995,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.47499999999999998,"5min":0.41899999999999998,"15min":0.41799999999999998},"max":{"1min":0.75600000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46500000000000002,"15min":0.46300000000000002},"min":{"1min":0.36799999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.52600000000000002,"5min":0.81100000000000005,"15min":0.83799999999999997},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.49199999999999999,"15min":0.48999999999999999},"min":{"1min":0.371,"5min":0.308,"15min":0.29099999999999998},"max":{"1min":0.624,"5min":0.67200000000000004,"15min":0.80500000000000005},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.505,"15min":0.5},"min":{"1min":0.36799999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78200000000000003,"5min":0.79100000000000004,"15min":0.83399999999999996},"last":0.374},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35399999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68300000000000005,"5min":0.78600000000000003,"15min":0.88200000000000001},"last":0.35399999999999998}]},{"osd":6,"last update":"Thu Nov 30 18:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56899999999999995,"15min":0.56399999999999995},"min":{"1min":0.40200000000000002,"5min":0.36699999999999999,"15min":0.32300000000000001},"max":{"1min":0.68400000000000005,"5min":0.84999999999999998,"15min":0.90800000000000003},"last":0.499},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55700000000000005,"15min":0.55900000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76300000000000001,"5min":0.81200000000000006,"15min":0.85199999999999998},"last":0.41199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575949,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307768,"kb_used_data":2480,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064072,"statfs":{"total":96636764160,"available":96321609728,"internally_reserved":0,"allocated":2539520,"data_stored":1303723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60499999999999998,"15min":0.61099999999999999},"min":{"1min":0.35399999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.72799999999999998,"5min":0.80700000000000005,"15min":1.6379999999999999},"last":0.629},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.629,"15min":0.625},"min":{"1min":0.49299999999999999,"5min":0.42499999999999999,"15min":0.27800000000000002},"max":{"1min":0.77500000000000002,"5min":0.84899999999999998,"15min":1.246},"last":0.66000000000000003}]},{"osd":1,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.31900000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.76500000000000001,"5min":0.86599999999999999,"15min":1.1200000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.624,"15min":0.63100000000000001},"min":{"1min":0.42199999999999999,"5min":0.41899999999999998,"15min":0.35499999999999998},"max":{"1min":0.753,"5min":0.81599999999999995,"15min":0.90400000000000003},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59799999999999998,"15min":0.59899999999999998},"min":{"1min":0.40699999999999997,"5min":0.40000000000000002,"15min":0.34499999999999997},"max":{"1min":0.71899999999999997,"5min":0.85299999999999998,"15min":1.288},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61599999999999999,"15min":0.63},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":0.74199999999999999,"5min":0.84599999999999997,"15min":1.177},"last":0.67000000000000004}]},{"osd":3,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55800000000000005,"15min":0.57499999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.33400000000000002},"max":{"1min":0.70599999999999996,"5min":0.79600000000000004,"15min":1.204},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.40200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.67600000000000005,"5min":0.80100000000000005,"15min":1.337},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.443,"15min":0.46800000000000003},"min":{"1min":0.34399999999999997,"5min":0.315,"15min":0.28699999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":1.51},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.49199999999999999},"min":{"1min":0.34999999999999998,"5min":0.32800000000000001,"15min":0.30399999999999999},"max":{"1min":0.69899999999999995,"5min":0.71599999999999997,"15min":0.94299999999999995},"last":0.37}]},{"osd":5,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.45700000000000002,"15min":0.47199999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":1.159},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.503,"15min":0.52700000000000002},"min":{"1min":0.42399999999999999,"5min":0.35199999999999998,"15min":0.32500000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":1.679},"last":0.40200000000000002}]},{"osd":7,"last update":"Thu Nov 30 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52200000000000002,"15min":0.54000000000000004},"min":{"1min":0.36799999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.96199999999999997},"last":0.502},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55700000000000005,"15min":0.57699999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":1.427},"last":0.46700000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575949,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307772,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064068,"statfs":{"total":96636764160,"available":96321605632,"internally_reserved":0,"allocated":2543616,"data_stored":1303475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.377,"15min":0.38},"min":{"1min":0.27500000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.66300000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.50700000000000001,"15min":0.51000000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.35799999999999998},"max":{"1min":0.77400000000000002,"5min":0.87,"15min":0.87},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40699999999999997,"15min":0.41199999999999998},"min":{"1min":0.28699999999999998,"5min":0.26700000000000002,"15min":0.26200000000000001},"max":{"1min":0.64700000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.40100000000000002,"5min":0.372,"15min":0.37},"max":{"1min":0.80300000000000005,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.48099999999999998,"15min":0.47799999999999998},"min":{"1min":0.33800000000000002,"5min":0.33500000000000002,"15min":0.318},"max":{"1min":0.72899999999999998,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45500000000000002,"15min":0.46000000000000002},"min":{"1min":0.33400000000000002,"5min":0.313,"15min":0.311},"max":{"1min":0.71399999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.28799999999999998}]},{"osd":4,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.59899999999999998,"15min":0.61899999999999999},"min":{"1min":0.41099999999999998,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.93999999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66800000000000004,"15min":0.67000000000000004},"min":{"1min":0.50600000000000001,"5min":0.49199999999999999,"15min":0.42299999999999999},"max":{"1min":1.0329999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.62,"15min":0.63300000000000001},"min":{"1min":0.48899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63900000000000001,"15min":0.64600000000000002},"min":{"1min":0.47799999999999998,"5min":0.45000000000000001,"15min":0.39200000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.98099999999999998},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70299999999999996,"15min":0.70499999999999996},"min":{"1min":0.51100000000000001,"5min":0.498,"15min":0.443},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.68000000000000005,"15min":0.69199999999999995},"min":{"1min":0.51400000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.86299999999999999,"5min":1.004,"15min":1.0169999999999999},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Nov 30 18:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69599999999999995,"15min":0.71199999999999997},"min":{"1min":0.51400000000000001,"5min":0.48999999999999999,"15min":0.46100000000000002},"max":{"1min":0.91000000000000003,"5min":0.97499999999999998,"15min":1.012},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68600000000000005,"15min":0.69699999999999995},"min":{"1min":0.57499999999999996,"5min":0.51800000000000002,"15min":0.47699999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.02},"last":0.64300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575949,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307768,"kb_used_data":2480,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064072,"statfs":{"total":96636764160,"available":96321609728,"internally_reserved":0,"allocated":2539520,"data_stored":1302865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.38800000000000001,"15min":0.39500000000000002},"min":{"1min":0.252,"5min":0.25,"15min":0.22900000000000001},"max":{"1min":0.50900000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.439,"5min":0.42099999999999999,"15min":0.42199999999999999},"min":{"1min":0.33500000000000002,"5min":0.27300000000000002,"15min":0.252},"max":{"1min":0.58299999999999996,"5min":0.65100000000000002,"15min":0.71399999999999997},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41199999999999998,"15min":0.41699999999999998},"min":{"1min":0.33000000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.55100000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.49099999999999999,"15min":0.5},"min":{"1min":0.40600000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.74199999999999999},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.45800000000000002,"15min":0.46200000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64400000000000002,"5min":0.69899999999999995,"15min":0.71799999999999997},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46500000000000002,"15min":0.47499999999999998},"min":{"1min":0.36599999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.60399999999999998,"5min":0.68000000000000005,"15min":0.70599999999999996},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63,"15min":0.64100000000000001},"min":{"1min":0.55900000000000005,"5min":0.40200000000000002,"15min":0.39900000000000002},"max":{"1min":0.79700000000000004,"5min":0.90600000000000003,"15min":1.0549999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.65800000000000003},"min":{"1min":0.55900000000000005,"5min":0.45100000000000001,"15min":0.442},"max":{"1min":0.77900000000000003,"5min":1.026,"15min":1.163},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.626,"15min":0.64100000000000001},"min":{"1min":0.50600000000000001,"5min":0.443,"15min":0.40400000000000003},"max":{"1min":0.78700000000000003,"5min":0.91600000000000004,"15min":1.0649999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.66800000000000004,"15min":0.67200000000000004},"min":{"1min":0.52400000000000002,"5min":0.47199999999999998,"15min":0.439},"max":{"1min":0.84799999999999998,"5min":0.998,"15min":1.1799999999999999},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.67700000000000005,"15min":0.68700000000000006},"min":{"1min":0.55100000000000005,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.873,"5min":0.94199999999999995,"15min":1.079},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66900000000000004,"15min":0.68300000000000005},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.41499999999999998},"max":{"1min":0.86099999999999999,"5min":1.0129999999999999,"15min":1.147},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Nov 30 18:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69799999999999995,"15min":0.70599999999999996},"min":{"1min":0.55900000000000005,"5min":0.49199999999999999,"15min":0.47399999999999998},"max":{"1min":0.88700000000000001,"5min":1.0469999999999999,"15min":1.22},"last":0.875},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72099999999999997,"15min":0.73399999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.81799999999999995,"5min":1.0640000000000001,"15min":1.117},"last":0.92800000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575949,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311864,"kb_used_data":2480,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059976,"statfs":{"total":96636764160,"available":96317415424,"internally_reserved":0,"allocated":2539520,"data_stored":1302901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.41999999999999998,"15min":0.41199999999999998},"min":{"1min":0.30099999999999999,"5min":0.249,"15min":0.23200000000000001},"max":{"1min":0.60399999999999998,"5min":0.64800000000000002,"15min":0.72099999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45700000000000002,"15min":0.46000000000000002},"min":{"1min":0.32600000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.58599999999999997,"5min":0.65000000000000002,"15min":0.73199999999999998},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45800000000000002,"15min":0.46100000000000002},"min":{"1min":0.34300000000000003,"5min":0.33100000000000002,"15min":0.29699999999999999},"max":{"1min":0.63900000000000001,"5min":0.70599999999999996,"15min":0.74299999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.496,"15min":0.49399999999999999},"min":{"1min":0.40899999999999997,"5min":0.35599999999999998,"15min":0.29899999999999999},"max":{"1min":0.66100000000000003,"5min":0.746,"15min":0.752},"last":0.379}]},{"osd":3,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.42799999999999999,"15min":0.42299999999999999},"min":{"1min":0.315,"5min":0.28399999999999997,"15min":0.27300000000000002},"max":{"1min":0.55000000000000004,"5min":0.61399999999999999,"15min":0.65100000000000002},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.503,"15min":0.499},"min":{"1min":0.433,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.69099999999999995,"5min":0.75900000000000001,"15min":0.77100000000000002},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.52100000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.95299999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63200000000000001,"15min":0.63900000000000001},"min":{"1min":0.46000000000000002,"5min":0.42799999999999999,"15min":0.35499999999999998},"max":{"1min":0.90500000000000003,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65400000000000003,"15min":0.66400000000000003},"min":{"1min":0.51200000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.84099999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.47199999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.91700000000000004,"5min":1.01,"15min":1.01},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64900000000000002,"15min":0.65200000000000002},"min":{"1min":0.52100000000000002,"5min":0.443,"15min":0.40500000000000003},"max":{"1min":0.86699999999999999,"5min":0.93000000000000005,"15min":0.93200000000000005},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.69399999999999995,"15min":0.69699999999999995},"min":{"1min":0.54300000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93999999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69099999999999995,"15min":0.69499999999999995},"min":{"1min":0.53500000000000003,"5min":0.47499999999999998,"15min":0.47299999999999998},"max":{"1min":0.95399999999999996,"5min":0.97799999999999998,"15min":1.0109999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71099999999999997,"15min":0.71799999999999997},"min":{"1min":0.55700000000000005,"5min":0.44,"15min":0.44},"max":{"1min":0.95199999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.70799999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575949,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299712,"kb_used_data":2488,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072128,"statfs":{"total":96636764160,"available":96329859072,"internally_reserved":0,"allocated":2547712,"data_stored":1303497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.373,"15min":0.38},"min":{"1min":0.29499999999999998,"5min":0.222,"15min":0.222},"max":{"1min":0.59099999999999997,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.42699999999999999,"15min":0.42499999999999999},"min":{"1min":0.31,"5min":0.28699999999999998,"15min":0.28199999999999997},"max":{"1min":0.63700000000000001,"5min":0.70299999999999996,"15min":0.754},"last":0.504}]},{"osd":1,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40000000000000002,"15min":0.40400000000000003},"min":{"1min":0.29899999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58099999999999996,"5min":0.66500000000000004,"15min":0.73399999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44500000000000001,"15min":0.45300000000000001},"min":{"1min":0.315,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.51800000000000002,"5min":0.67700000000000005,"15min":0.86699999999999999},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.47299999999999998,"15min":0.47699999999999998},"min":{"1min":0.39000000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.59899999999999998,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51400000000000001,"15min":0.52400000000000002},"min":{"1min":0.40899999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.65600000000000003,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.63}]},{"osd":4,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63200000000000001,"15min":0.64100000000000001},"min":{"1min":0.51100000000000001,"5min":0.40200000000000002,"15min":0.35299999999999998},"max":{"1min":0.84799999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.64000000000000001,"15min":0.65100000000000002},"min":{"1min":0.40400000000000003,"5min":0.40300000000000002,"15min":0.40100000000000002},"max":{"1min":0.77400000000000002,"5min":0.97799999999999998,"15min":1.0049999999999999},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63600000000000001,"15min":0.64600000000000002},"min":{"1min":0.52000000000000002,"5min":0.44600000000000001,"15min":0.40699999999999997},"max":{"1min":0.89400000000000002,"5min":1.04,"15min":1.04},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65500000000000003,"15min":0.66800000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.34499999999999997},"max":{"1min":0.82999999999999996,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.79200000000000004}]},{"osd":6,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67200000000000004,"15min":0.68400000000000005},"min":{"1min":0.499,"5min":0.45000000000000001,"15min":0.377},"max":{"1min":0.88800000000000001,"5min":1.0189999999999999,"15min":1.0309999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66300000000000003,"15min":0.68500000000000005},"min":{"1min":0.48199999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92900000000000005,"5min":0.99399999999999999,"15min":1.0129999999999999},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu Nov 30 18:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68300000000000005,"15min":0.70399999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.872,"5min":1.0009999999999999,"15min":1.052},"last":0.747},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68300000000000005,"15min":0.70499999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.81299999999999994,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.80500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575949,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303680,"kb_used_data":2488,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068160,"statfs":{"total":96636764160,"available":96325795840,"internally_reserved":0,"allocated":2547712,"data_stored":1303013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53900000000000003,"15min":0.56200000000000006},"min":{"1min":0.36199999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72999999999999998,"5min":0.79400000000000004,"15min":0.85499999999999998},"last":0.316},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.374,"5min":0.34100000000000003,"15min":0.32500000000000001},"max":{"1min":0.76800000000000002,"5min":0.79300000000000004,"15min":0.94999999999999996},"last":0.436}]},{"osd":1,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56899999999999995,"15min":0.57299999999999995},"min":{"1min":0.41799999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.72199999999999998,"5min":0.86599999999999999,"15min":0.876},"last":0.371},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.67400000000000004,"5min":0.79300000000000004,"15min":0.91200000000000003},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.60599999999999998},"min":{"1min":0.438,"5min":0.36299999999999999,"15min":0.34999999999999998},"max":{"1min":0.72199999999999998,"5min":0.88400000000000001,"15min":0.93799999999999994},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.60599999999999998,"15min":0.625},"min":{"1min":0.40000000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68999999999999995,"5min":0.90800000000000003,"15min":0.94399999999999995},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.433,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":0.68899999999999995,"5min":0.83199999999999996,"15min":0.84999999999999998},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57699999999999996,"15min":0.59899999999999998},"min":{"1min":0.45600000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.67500000000000004,"5min":0.80800000000000005,"15min":0.872},"last":0.498}]},{"osd":5,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.42299999999999999,"15min":0.44800000000000001},"min":{"1min":0.309,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.53400000000000003,"5min":0.66900000000000004,"15min":0.86399999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.44900000000000001,"15min":0.46899999999999997},"min":{"1min":0.32300000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.63200000000000001,"5min":0.64900000000000002,"15min":0.82299999999999995},"last":0.49199999999999999}]},{"osd":6,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47399999999999998,"15min":0.51300000000000001},"min":{"1min":0.35699999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66100000000000003,"5min":0.79200000000000004,"15min":1.1399999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.52800000000000002,"15min":0.56299999999999994},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.67200000000000004,"5min":0.76700000000000002,"15min":1.1220000000000001},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Nov 30 18:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.47999999999999998,"15min":0.52500000000000002},"min":{"1min":0.308,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58199999999999996,"5min":0.80100000000000005,"15min":0.90000000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55400000000000005,"15min":0.58199999999999996},"min":{"1min":0.44400000000000001,"5min":0.38100000000000001,"15min":0.35599999999999998},"max":{"1min":0.622,"5min":0.81599999999999995,"15min":0.86199999999999999},"last":0.56599999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575949,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307776,"kb_used_data":2488,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064064,"statfs":{"total":96636764160,"available":96321601536,"internally_reserved":0,"allocated":2547712,"data_stored":1303509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56799999999999995,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.35799999999999998,"15min":0.29799999999999999},"max":{"1min":0.76600000000000001,"5min":0.79800000000000004,"15min":0.80800000000000005},"last":0.753},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.54300000000000004,"15min":0.55300000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.66800000000000004,"5min":0.80700000000000005,"15min":0.90300000000000002},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54000000000000004,"15min":0.54300000000000004},"min":{"1min":0.41099999999999998,"5min":0.36899999999999999,"15min":0.32200000000000001},"max":{"1min":0.72599999999999998,"5min":0.75600000000000001,"15min":0.83699999999999997},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57699999999999996,"15min":0.57999999999999996},"min":{"1min":0.42499999999999999,"5min":0.38600000000000001,"15min":0.32400000000000001},"max":{"1min":0.72999999999999998,"5min":0.76500000000000001,"15min":0.82899999999999996},"last":0.74199999999999999}]},{"osd":2,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60999999999999999,"15min":0.61399999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.36399999999999999},"max":{"1min":0.76300000000000001,"5min":0.78700000000000003,"15min":0.99199999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.62,"15min":0.62},"min":{"1min":0.47199999999999998,"5min":0.44800000000000001,"15min":0.42499999999999999},"max":{"1min":0.78400000000000003,"5min":0.79600000000000004,"15min":1.173},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.373},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.79300000000000004},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.439,"5min":0.40500000000000003,"15min":0.35399999999999998},"max":{"1min":0.72699999999999998,"5min":0.84199999999999997,"15min":1.603},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.45400000000000001,"15min":0.45200000000000001},"min":{"1min":0.35799999999999998,"5min":0.315,"15min":0.28000000000000003},"max":{"1min":0.63800000000000001,"5min":0.70299999999999996,"15min":0.75},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.48999999999999999,"15min":0.48299999999999998},"min":{"1min":0.39100000000000001,"5min":0.32000000000000001,"15min":0.314},"max":{"1min":0.67300000000000004,"5min":0.77900000000000003,"15min":0.81200000000000006},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51600000000000001,"15min":0.505},"min":{"1min":0.38400000000000001,"5min":0.33600000000000002,"15min":0.31900000000000001},"max":{"1min":0.75900000000000001,"5min":0.76700000000000002,"15min":1.105},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57699999999999996,"15min":0.57199999999999995},"min":{"1min":0.48699999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.751,"5min":0.79600000000000004,"15min":1.228},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Nov 30 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55000000000000004,"15min":0.54000000000000004},"min":{"1min":0.442,"5min":0.36799999999999999,"15min":0.34399999999999997},"max":{"1min":0.69299999999999995,"5min":0.80900000000000005,"15min":0.88100000000000001},"last":0.625},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.60199999999999998,"15min":0.59599999999999997},"min":{"1min":0.47399999999999998,"5min":0.33400000000000002,"15min":0.317},"max":{"1min":0.79400000000000004,"5min":0.82499999999999996,"15min":1.0640000000000001},"last":0.69099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T18:39:46.182 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-30T18:39:46.185 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-30T18:39:46.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.339+0000 7f49c836f700 1 Processor -- start 2023-11-30T18:39:46.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.339+0000 7f49c836f700 1 -- start start 2023-11-30T18:39:46.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.340+0000 7f49c836f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49c0158160 0x7f49c00a8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:46.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.340+0000 7f49c836f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c0067770 con 0x7f49c014e600 2023-11-30T18:39:46.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.340+0000 7f49c836f700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c00be8d0 con 0x7f49c00a8280 2023-11-30T18:39:46.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.340+0000 7f49c836f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c0159180 con 0x7f49c0158160 2023-11-30T18:39:46.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.341+0000 7f49c690c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f49c014e600 0x7f49c014ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58412/0 (socket says 172.21.15.49:58412) 2023-11-30T18:39:46.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.341+0000 7f49c690c700 1 -- 172.21.15.49:0/1548573394 learned_addr learned my addr 172.21.15.49:0/1548573394 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:46.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.341+0000 7f49c590a700 1 --2- 172.21.15.49:0/1548573394 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49c0158160 0x7f49c00a8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:46.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.341+0000 7f49c5109700 1 -- 172.21.15.49:0/1548573394 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2947713918 0 0) 0x7f49c0067770 con 0x7f49c014e600 2023-11-30T18:39:46.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.341+0000 7f49c5109700 1 -- 172.21.15.49:0/1548573394 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49a80033f0 con 0x7f49c014e600 2023-11-30T18:39:46.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.341+0000 7f49c5109700 1 -- 172.21.15.49:0/1548573394 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541772606 0 0) 0x7f49c00be8d0 con 0x7f49c00a8280 2023-11-30T18:39:46.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.341+0000 7f49c5109700 1 -- 172.21.15.49:0/1548573394 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49c0067770 con 0x7f49c00a8280 2023-11-30T18:39:46.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.341+0000 7f49c5109700 1 -- 172.21.15.49:0/1548573394 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1362133233 0 0) 0x7f49a80033f0 con 0x7f49c014e600 2023-11-30T18:39:46.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.341+0000 7f49c590a700 1 -- 172.21.15.49:0/1548573394 >> v1:172.21.15.115:6789/0 conn(0x7f49c00a8280 legacy=0x7f49c0155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:46.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.341+0000 7f49c590a700 1 -- 172.21.15.49:0/1548573394 >> v1:172.21.15.49:6789/0 conn(0x7f49c014e600 legacy=0x7f49c014ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:46.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.341+0000 7f49c590a700 1 -- 172.21.15.49:0/1548573394 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c0158600 con 0x7f49c0158160 2023-11-30T18:39:46.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.341+0000 7f49c590a700 1 --2- 172.21.15.49:0/1548573394 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49c0158160 0x7f49c00a8660 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f49b4009790 tx=0x7f49b4009060).ready entity=mon.2 client_cookie=21a8ca461a4cf00f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:46.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.341+0000 7f49c5109700 1 -- 172.21.15.49:0/1548573394 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b0001470 con 0x7f49c0158160 2023-11-30T18:39:46.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.341+0000 7f49c5109700 1 -- 172.21.15.49:0/1548573394 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b4011400 con 0x7f49c0158160 2023-11-30T18:39:46.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.341+0000 7f49c5109700 1 -- 172.21.15.49:0/1548573394 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b4011780 con 0x7f49c0158160 2023-11-30T18:39:46.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.342+0000 7f49c836f700 1 -- 172.21.15.49:0/1548573394 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49c0158160 msgr2=0x7f49c00a8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:46.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.342+0000 7f49c836f700 1 --2- 172.21.15.49:0/1548573394 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49c0158160 0x7f49c00a8660 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f49b4009790 tx=0x7f49b4009060).stop 2023-11-30T18:39:46.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.342+0000 7f49c836f700 1 -- 172.21.15.49:0/1548573394 shutdown_connections 2023-11-30T18:39:46.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.342+0000 7f49c836f700 1 --2- 172.21.15.49:0/1548573394 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49c0158160 0x7f49c00a8660 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:46.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.342+0000 7f49c836f700 1 -- 172.21.15.49:0/1548573394 >> 172.21.15.49:0/1548573394 conn(0x7f49c0062700 msgr2=0x7f49c0062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:46.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.342+0000 7f49c836f700 1 -- 172.21.15.49:0/1548573394 shutdown_connections 2023-11-30T18:39:46.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.342+0000 7f49c836f700 1 -- 172.21.15.49:0/1548573394 wait complete. 2023-11-30T18:39:46.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.343+0000 7f49c836f700 1 Processor -- start 2023-11-30T18:39:46.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.343+0000 7f49c836f700 1 -- start start 2023-11-30T18:39:46.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.344+0000 7f49c836f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49c00a8280 0x7f49c014ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:46.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.344+0000 7f49c836f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49c014e600 0x7f49c0064ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:46.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.344+0000 7f49c836f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49c0158160 0x7f49c00653d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:46.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.344+0000 7f49c836f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c00658c0 con 0x7f49c0158160 2023-11-30T18:39:46.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.344+0000 7f49c836f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c0168cb0 con 0x7f49c014e600 2023-11-30T18:39:46.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.344+0000 7f49c836f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c0168110 con 0x7f49c00a8280 2023-11-30T18:39:46.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.344+0000 7f49c690c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49c0158160 0x7f49c00653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:46.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.344+0000 7f49c610b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49c00a8280 0x7f49c014ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:46.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.344+0000 7f49c690c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49c0158160 0x7f49c00653d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59874/0 (socket says 172.21.15.49:59874) 2023-11-30T18:39:46.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.344+0000 7f49c690c700 1 -- 172.21.15.49:0/1835590099 learned_addr learned my addr 172.21.15.49:0/1835590099 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:46.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.344+0000 7f49c590a700 1 --2- 172.21.15.49:0/1835590099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49c014e600 0x7f49c0064ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:46.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.344+0000 7f49c690c700 1 -- 172.21.15.49:0/1835590099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49c00a8280 msgr2=0x7f49c014ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:46.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.344+0000 7f49c690c700 1 --2- 172.21.15.49:0/1835590099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49c00a8280 0x7f49c014ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:46.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.344+0000 7f49c690c700 1 -- 172.21.15.49:0/1835590099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49c014e600 msgr2=0x7f49c0064ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:46.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.344+0000 7f49c690c700 1 --2- 172.21.15.49:0/1835590099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49c014e600 0x7f49c0064ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:46.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.344+0000 7f49c690c700 1 -- 172.21.15.49:0/1835590099 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b40092a0 con 0x7f49c0158160 2023-11-30T18:39:46.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.344+0000 7f49c690c700 1 --2- 172.21.15.49:0/1835590099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49c0158160 0x7f49c00653d0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 rx=0x7f49b000c810 tx=0x7f49b0001b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:46.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.345+0000 7f49be7fc700 1 -- 172.21.15.49:0/1835590099 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b0007170 con 0x7f49c0158160 2023-11-30T18:39:46.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.345+0000 7f49be7fc700 1 -- 172.21.15.49:0/1835590099 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b00072d0 con 0x7f49c0158160 2023-11-30T18:39:46.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.345+0000 7f49c836f700 1 -- 172.21.15.49:0/1835590099 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c0064670 con 0x7f49c0158160 2023-11-30T18:39:46.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.345+0000 7f49be7fc700 1 -- 172.21.15.49:0/1835590099 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b00048c0 con 0x7f49c0158160 2023-11-30T18:39:46.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.345+0000 7f49c836f700 1 -- 172.21.15.49:0/1835590099 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c0168660 con 0x7f49c0158160 2023-11-30T18:39:46.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.346+0000 7f49c836f700 1 -- 172.21.15.49:0/1835590099 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c0168e40 con 0x7f49c0158160 2023-11-30T18:39:46.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.346+0000 7f49be7fc700 1 -- 172.21.15.49:0/1835590099 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f49b0004c70 con 0x7f49c0158160 2023-11-30T18:39:46.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.346+0000 7f49be7fc700 1 --2- 172.21.15.49:0/1835590099 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f49ac05f270 0x7f49ac061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:46.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.347+0000 7f49be7fc700 1 -- 172.21.15.49:0/1835590099 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6205+0+0 (secure 0 0 0) 0x7f49b0079ff0 con 0x7f49c0158160 2023-11-30T18:39:46.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.347+0000 7f49c610b700 1 --2- 172.21.15.49:0/1835590099 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f49ac05f270 0x7f49ac061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:46.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.347+0000 7f49c610b700 1 --2- 172.21.15.49:0/1835590099 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f49ac05f270 0x7f49ac061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f49b8003fc0 tx=0x7f49b8007f50).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:46.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.351+0000 7f49be7fc700 1 -- 172.21.15.49:0/1835590099 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f49b004afd0 con 0x7f49c0158160 2023-11-30T18:39:46.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.590+0000 7f49c836f700 1 -- 172.21.15.49:0/1835590099 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f49c006c860 con 0x7f49c0158160 2023-11-30T18:39:46.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.594+0000 7f49be7fc700 1 -- 172.21.15.49:0/1835590099 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v49) v1 ==== 190+0+0 (secure 0 0 0) 0x7f49b004e5f0 con 0x7f49c0158160 2023-11-30T18:39:46.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.596+0000 7f49c836f700 1 -- 172.21.15.49:0/1835590099 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f49ac05f270 msgr2=0x7f49ac061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:46.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.596+0000 7f49c836f700 1 --2- 172.21.15.49:0/1835590099 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f49ac05f270 0x7f49ac061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f49b8003fc0 tx=0x7f49b8007f50).stop 2023-11-30T18:39:46.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.596+0000 7f49c836f700 1 -- 172.21.15.49:0/1835590099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49c0158160 msgr2=0x7f49c00653d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:46.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.596+0000 7f49c836f700 1 --2- 172.21.15.49:0/1835590099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49c0158160 0x7f49c00653d0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 rx=0x7f49b000c810 tx=0x7f49b0001b00).stop 2023-11-30T18:39:46.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.596+0000 7f49c836f700 1 -- 172.21.15.49:0/1835590099 shutdown_connections 2023-11-30T18:39:46.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.596+0000 7f49c836f700 1 --2- 172.21.15.49:0/1835590099 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f49ac05f270 0x7f49ac061730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:46.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.596+0000 7f49c836f700 1 --2- 172.21.15.49:0/1835590099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49c0158160 0x7f49c00653d0 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:46.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.596+0000 7f49c836f700 1 --2- 172.21.15.49:0/1835590099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49c00a8280 0x7f49c014ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:46.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.596+0000 7f49c836f700 1 --2- 172.21.15.49:0/1835590099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49c014e600 0x7f49c0064ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:46.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.596+0000 7f49c836f700 1 -- 172.21.15.49:0/1835590099 >> 172.21.15.49:0/1835590099 conn(0x7f49c0062700 msgr2=0x7f49c0062ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:46.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.596+0000 7f49c836f700 1 -- 172.21.15.49:0/1835590099 shutdown_connections 2023-11-30T18:39:46.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.596+0000 7f49c836f700 1 -- 172.21.15.49:0/1835590099 wait complete. 2023-11-30T18:39:46.599 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2023-11-30T18:39:46.610 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:39:46.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.726+0000 7f6be4ce3700 1 Processor -- start 2023-11-30T18:39:46.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.726+0000 7f6be4ce3700 1 -- start start 2023-11-30T18:39:46.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.727+0000 7f6be4ce3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6be01544e0 0x7f6be01548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:46.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.727+0000 7f6be4ce3700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6be006a610 0x7f6be00c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:46.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.727+0000 7f6be4ce3700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be00c69a0 con 0x7f6be00c6e30 2023-11-30T18:39:46.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.727+0000 7f6be4ce3700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be00c13a0 con 0x7f6be01544e0 2023-11-30T18:39:46.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.727+0000 7f6be4ce3700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be00c1680 con 0x7f6be006a610 2023-11-30T18:39:46.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.728+0000 7f6bde59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6be01544e0 0x7f6be01548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:46.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.728+0000 7f6bde59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6be01544e0 0x7f6be01548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59884/0 (socket says 172.21.15.49:59884) 2023-11-30T18:39:46.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.728+0000 7f6bde59c700 1 -- 172.21.15.49:0/1821564435 learned_addr learned my addr 172.21.15.49:0/1821564435 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:46.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.728+0000 7f6bde59c700 1 -- 172.21.15.49:0/1821564435 >> v2:172.21.15.115:3300/0 conn(0x7f6be006a610 msgr2=0x7f6be00c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:46.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.728+0000 7f6bde59c700 1 --2- 172.21.15.49:0/1821564435 >> v2:172.21.15.115:3300/0 conn(0x7f6be006a610 0x7f6be00c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-30T18:39:46.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.728+0000 7f6bde59c700 1 -- 172.21.15.49:0/1821564435 >> v1:172.21.15.115:6789/0 conn(0x7f6be00c6e30 legacy=0x7f6be00a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:46.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.728+0000 7f6bde59c700 1 -- 172.21.15.49:0/1821564435 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be00c6630 con 0x7f6be01544e0 2023-11-30T18:39:46.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.728+0000 7f6bde59c700 1 --2- 172.21.15.49:0/1821564435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6be01544e0 0x7f6be01548c0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 rx=0x7f6be0084fb0 tx=0x7f6bd8009060).ready entity=mon.0 client_cookie=2b6e08efdc621539 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:46.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.728+0000 7f6bdd59a700 1 -- 172.21.15.49:0/1821564435 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8005880 con 0x7f6be01544e0 2023-11-30T18:39:46.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.728+0000 7f6bdd59a700 1 -- 172.21.15.49:0/1821564435 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd80059e0 con 0x7f6be01544e0 2023-11-30T18:39:46.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.728+0000 7f6bdd59a700 1 -- 172.21.15.49:0/1821564435 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8005d60 con 0x7f6be01544e0 2023-11-30T18:39:46.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.729+0000 7f6be4ce3700 1 -- 172.21.15.49:0/1821564435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6be01544e0 msgr2=0x7f6be01548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:46.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.729+0000 7f6be4ce3700 1 --2- 172.21.15.49:0/1821564435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6be01544e0 0x7f6be01548c0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 rx=0x7f6be0084fb0 tx=0x7f6bd8009060).stop 2023-11-30T18:39:46.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.729+0000 7f6be4ce3700 1 -- 172.21.15.49:0/1821564435 shutdown_connections 2023-11-30T18:39:46.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.729+0000 7f6be4ce3700 1 --2- 172.21.15.49:0/1821564435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6be01544e0 0x7f6be01548c0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:46.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.729+0000 7f6be4ce3700 1 --2- 172.21.15.49:0/1821564435 >> v2:172.21.15.115:3300/0 conn(0x7f6be006a610 0x7f6be00c0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-30T18:39:46.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.729+0000 7f6be4ce3700 1 -- 172.21.15.49:0/1821564435 >> 172.21.15.49:0/1821564435 conn(0x7f6be0085020 msgr2=0x7f6be0094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:46.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.729+0000 7f6be4ce3700 1 -- 172.21.15.49:0/1821564435 shutdown_connections 2023-11-30T18:39:46.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.729+0000 7f6be4ce3700 1 -- 172.21.15.49:0/1821564435 wait complete. 2023-11-30T18:39:46.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.730+0000 7f6be4ce3700 1 Processor -- start 2023-11-30T18:39:46.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.730+0000 7f6be4ce3700 1 -- start start 2023-11-30T18:39:46.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.731+0000 7f6be4ce3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6be006a610 0x7f6be01510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:46.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.731+0000 7f6be4ce3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6be00c6e30 0x7f6be0064040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:46.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.731+0000 7f6be4ce3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6be01544e0 0x7f6be0098420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:46.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.731+0000 7f6be4ce3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be0096050 con 0x7f6be006a610 2023-11-30T18:39:46.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.731+0000 7f6be4ce3700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be0095440 con 0x7f6be01544e0 2023-11-30T18:39:46.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.731+0000 7f6be4ce3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be0095720 con 0x7f6be00c6e30 2023-11-30T18:39:46.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.731+0000 7f6bde59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6be006a610 0x7f6be01510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:46.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.731+0000 7f6bde59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6be006a610 0x7f6be01510f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59892/0 (socket says 172.21.15.49:59892) 2023-11-30T18:39:46.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.731+0000 7f6bde59c700 1 -- 172.21.15.49:0/1112292182 learned_addr learned my addr 172.21.15.49:0/1112292182 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:46.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.731+0000 7f6bddd9b700 1 --2- 172.21.15.49:0/1112292182 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6be00c6e30 0x7f6be0064040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:46.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.731+0000 7f6bded9d700 1 --2- 172.21.15.49:0/1112292182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6be01544e0 0x7f6be0098420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:46.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.731+0000 7f6bde59c700 1 -- 172.21.15.49:0/1112292182 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6be00c6e30 msgr2=0x7f6be0064040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:46.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.731+0000 7f6bde59c700 1 --2- 172.21.15.49:0/1112292182 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6be00c6e30 0x7f6be0064040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:46.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.731+0000 7f6bde59c700 1 -- 172.21.15.49:0/1112292182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6be01544e0 msgr2=0x7f6be0098420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:46.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.731+0000 7f6bde59c700 1 --2- 172.21.15.49:0/1112292182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6be01544e0 0x7f6be0098420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:46.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.731+0000 7f6bde59c700 1 -- 172.21.15.49:0/1112292182 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd8009300 con 0x7f6be006a610 2023-11-30T18:39:46.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.731+0000 7f6bddd9b700 1 --2- 172.21.15.49:0/1112292182 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6be00c6e30 0x7f6be0064040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:39:46.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.731+0000 7f6bde59c700 1 --2- 172.21.15.49:0/1112292182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6be006a610 0x7f6be01510f0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 rx=0x7f6be005fb30 tx=0x7f6bd8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:46.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.731+0000 7f6bd67fc700 1 -- 172.21.15.49:0/1112292182 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd800b7b0 con 0x7f6be006a610 2023-11-30T18:39:46.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.731+0000 7f6bd67fc700 1 -- 172.21.15.49:0/1112292182 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd800b910 con 0x7f6be006a610 2023-11-30T18:39:46.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.731+0000 7f6be4ce3700 1 -- 172.21.15.49:0/1112292182 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be0095a00 con 0x7f6be006a610 2023-11-30T18:39:46.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.731+0000 7f6bd67fc700 1 -- 172.21.15.49:0/1112292182 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd800bcd0 con 0x7f6be006a610 2023-11-30T18:39:46.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.731+0000 7f6be4ce3700 1 -- 172.21.15.49:0/1112292182 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be01515e0 con 0x7f6be006a610 2023-11-30T18:39:46.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.732+0000 7f6be4ce3700 1 -- 172.21.15.49:0/1112292182 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be00af980 con 0x7f6be006a610 2023-11-30T18:39:46.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.733+0000 7f6bd67fc700 1 -- 172.21.15.49:0/1112292182 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6bd8018030 con 0x7f6be006a610 2023-11-30T18:39:46.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.733+0000 7f6bd67fc700 1 --2- 172.21.15.49:0/1112292182 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f6bc005f270 0x7f6bc0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:46.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.733+0000 7f6bd67fc700 1 -- 172.21.15.49:0/1112292182 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6205+0+0 (secure 0 0 0) 0x7f6bd807b460 con 0x7f6be006a610 2023-11-30T18:39:46.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.733+0000 7f6bddd9b700 1 --2- 172.21.15.49:0/1112292182 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f6bc005f270 0x7f6bc0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:46.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.734+0000 7f6bddd9b700 1 --2- 172.21.15.49:0/1112292182 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f6bc005f270 0x7f6bc0061730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f6be0152940 tx=0x7f6bc8008040).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:46.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.738+0000 7f6bd67fc700 1 -- 172.21.15.49:0/1112292182 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6bd804c560 con 0x7f6be006a610 2023-11-30T18:39:46.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.950+0000 7f6be4ce3700 1 -- 172.21.15.49:0/1112292182 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6be00c10b0 con 0x7f6be006a610 2023-11-30T18:39:46.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.951+0000 7f6bd67fc700 1 -- 172.21.15.49:0/1112292182 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f6bd8028090 con 0x7f6be006a610 2023-11-30T18:39:46.953 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:39:46.953 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":85,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7904,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/873619564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":873619564},{"type":"v1","addr":"172.21.15.115:6837","nonce":873619564}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":9172,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/4238872035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":4238872035},{"type":"v1","addr":"172.21.15.115:6835","nonce":4238872035}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":9495,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1878169084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1878169084},{"type":"v1","addr":"172.21.15.49:6834","nonce":1878169084}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T18:39:37.320382+0000","modified":"2023-11-30T18:39:40.334323+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9498},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9498":{"gid":9498,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/4263670008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":4263670008},{"type":"v1","addr":"172.21.15.49:6835","nonce":4263670008}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-11-30T18:39:46.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.953+0000 7f6be4ce3700 1 -- 172.21.15.49:0/1112292182 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f6bc005f270 msgr2=0x7f6bc0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:46.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.953+0000 7f6be4ce3700 1 --2- 172.21.15.49:0/1112292182 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f6bc005f270 0x7f6bc0061730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f6be0152940 tx=0x7f6bc8008040).stop 2023-11-30T18:39:46.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.953+0000 7f6be4ce3700 1 -- 172.21.15.49:0/1112292182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6be006a610 msgr2=0x7f6be01510f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:46.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.953+0000 7f6be4ce3700 1 --2- 172.21.15.49:0/1112292182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6be006a610 0x7f6be01510f0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 rx=0x7f6be005fb30 tx=0x7f6bd8016000).stop 2023-11-30T18:39:46.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.953+0000 7f6be4ce3700 1 -- 172.21.15.49:0/1112292182 shutdown_connections 2023-11-30T18:39:46.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.953+0000 7f6be4ce3700 1 --2- 172.21.15.49:0/1112292182 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f6bc005f270 0x7f6bc0061730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:46.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.953+0000 7f6be4ce3700 1 --2- 172.21.15.49:0/1112292182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6be01544e0 0x7f6be0098420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:46.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.953+0000 7f6be4ce3700 1 --2- 172.21.15.49:0/1112292182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6be006a610 0x7f6be01510f0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:46.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.953+0000 7f6be4ce3700 1 --2- 172.21.15.49:0/1112292182 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6be00c6e30 0x7f6be0064040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:46.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.953+0000 7f6be4ce3700 1 -- 172.21.15.49:0/1112292182 >> 172.21.15.49:0/1112292182 conn(0x7f6be0085020 msgr2=0x7f6be0094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:46.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.953+0000 7f6be4ce3700 1 -- 172.21.15.49:0/1112292182 shutdown_connections 2023-11-30T18:39:46.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:46.953+0000 7f6be4ce3700 1 -- 172.21.15.49:0/1112292182 wait complete. 2023-11-30T18:39:46.956 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 85 2023-11-30T18:39:47.369 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 85, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-30T18:39:37.320382+0000', 'modified': '2023-11-30T18:39:40.334323+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9498}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9498': {'gid': 9498, 'name': 'a', 'rank': 0, 'incarnation': 81, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6835/4263670008', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6833', 'nonce': 4263670008}, {'type': 'v1', 'addr': '172.21.15.49:6835', 'nonce': 4263670008}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-11-30T18:39:47.369 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-30T18:39:47.369 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-30T18:39:47.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.488+0000 7f0dc53c9700 1 Processor -- start 2023-11-30T18:39:47.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.488+0000 7f0dc53c9700 1 -- start start 2023-11-30T18:39:47.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.489+0000 7f0dc53c9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0dc0154950 0x7f0dc00ca540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:47.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.489+0000 7f0dc53c9700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc00c7bc0 con 0x7f0dc00c66f0 2023-11-30T18:39:47.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.489+0000 7f0dc53c9700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc0155920 con 0x7f0dc014e530 2023-11-30T18:39:47.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.489+0000 7f0dc53c9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc00c6ba0 con 0x7f0dc0154950 2023-11-30T18:39:47.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.489+0000 7f0dbf7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0dc00c66f0 0x7f0dc0158570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58418/0 (socket says 172.21.15.49:58418) 2023-11-30T18:39:47.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.489+0000 7f0dbf7fe700 1 -- 172.21.15.49:0/3072188905 learned_addr learned my addr 172.21.15.49:0/3072188905 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:47.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.489+0000 7f0dc4bc8700 1 --2- 172.21.15.49:0/3072188905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0dc0154950 0x7f0dc00ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:47.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.489+0000 7f0dbeffd700 1 -- 172.21.15.49:0/3072188905 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2612456255 0 0) 0x7f0dc00c7bc0 con 0x7f0dc00c66f0 2023-11-30T18:39:47.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.489+0000 7f0dbeffd700 1 -- 172.21.15.49:0/3072188905 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0da80033f0 con 0x7f0dc00c66f0 2023-11-30T18:39:47.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.490+0000 7f0dbeffd700 1 -- 172.21.15.49:0/3072188905 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1616844455 0 0) 0x7f0dc0155920 con 0x7f0dc014e530 2023-11-30T18:39:47.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.490+0000 7f0dbeffd700 1 -- 172.21.15.49:0/3072188905 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dc00c7bc0 con 0x7f0dc014e530 2023-11-30T18:39:47.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.490+0000 7f0dbeffd700 1 -- 172.21.15.49:0/3072188905 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3787141003 0 0) 0x7f0da80033f0 con 0x7f0dc00c66f0 2023-11-30T18:39:47.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.490+0000 7f0dbeffd700 1 -- 172.21.15.49:0/3072188905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0dc0154950 msgr2=0x7f0dc00ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:47.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.490+0000 7f0dbeffd700 1 --2- 172.21.15.49:0/3072188905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0dc0154950 0x7f0dc00ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.490+0000 7f0dbeffd700 1 -- 172.21.15.49:0/3072188905 >> v1:172.21.15.115:6789/0 conn(0x7f0dc014e530 legacy=0x7f0dc014e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:47.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.490+0000 7f0dbeffd700 1 -- 172.21.15.49:0/3072188905 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc0154de0 con 0x7f0dc00c66f0 2023-11-30T18:39:47.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.490+0000 7f0dbeffd700 1 -- 172.21.15.49:0/3072188905 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f0db4001470 con 0x7f0dc00c66f0 2023-11-30T18:39:47.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.490+0000 7f0dbeffd700 1 -- 172.21.15.49:0/3072188905 >> v1:172.21.15.49:6789/0 conn(0x7f0dc00c66f0 legacy=0x7f0dc0158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:47.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.490+0000 7f0dbeffd700 1 --2- 172.21.15.49:0/3072188905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0da8003aa0 0x7f0da8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:47.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.490+0000 7f0dbeffd700 1 --2- 172.21.15.49:0/3072188905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da8004690 0x7f0da8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:47.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.490+0000 7f0dbeffd700 1 --2- 172.21.15.49:0/3072188905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0dc0154950 0x7f0da8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:47.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.490+0000 7f0dbeffd700 1 -- 172.21.15.49:0/3072188905 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc00c6ba0 con 0x7f0da8004690 2023-11-30T18:39:47.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.490+0000 7f0dbeffd700 1 -- 172.21.15.49:0/3072188905 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da800b910 con 0x7f0da8003aa0 2023-11-30T18:39:47.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.490+0000 7f0dbeffd700 1 -- 172.21.15.49:0/3072188905 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da800bad0 con 0x7f0dc0154950 2023-11-30T18:39:47.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.490+0000 7f0dbf7fe700 1 --2- 172.21.15.49:0/3072188905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da8004690 0x7f0da8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:47.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.490+0000 7f0dc4bc8700 1 --2- 172.21.15.49:0/3072188905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0dc0154950 0x7f0da8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:47.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.490+0000 7f0dbffff700 1 --2- 172.21.15.49:0/3072188905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0da8003aa0 0x7f0da8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:47.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.490+0000 7f0dbf7fe700 1 -- 172.21.15.49:0/3072188905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0dc0154950 msgr2=0x7f0da8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:47.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.490+0000 7f0dbf7fe700 1 --2- 172.21.15.49:0/3072188905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0dc0154950 0x7f0da8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.490+0000 7f0dbf7fe700 1 -- 172.21.15.49:0/3072188905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0da8003aa0 msgr2=0x7f0da8003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:47.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.490+0000 7f0dbf7fe700 1 --2- 172.21.15.49:0/3072188905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0da8003aa0 0x7f0da8003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.490+0000 7f0dbf7fe700 1 -- 172.21.15.49:0/3072188905 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da80033f0 con 0x7f0da8004690 2023-11-30T18:39:47.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.490+0000 7f0dbffff700 1 --2- 172.21.15.49:0/3072188905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0da8003aa0 0x7f0da8003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:39:47.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.490+0000 7f0dbf7fe700 1 --2- 172.21.15.49:0/3072188905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da8004690 0x7f0da8004b10 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7f0db400c190 tx=0x7f0db4001e10).ready entity=mon.0 client_cookie=7cdb2b1d3e6c5758 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:47.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.490+0000 7f0dbeffd700 1 -- 172.21.15.49:0/3072188905 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db400ca00 con 0x7f0da8004690 2023-11-30T18:39:47.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.490+0000 7f0dbeffd700 1 -- 172.21.15.49:0/3072188905 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db400cb60 con 0x7f0da8004690 2023-11-30T18:39:47.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.491+0000 7f0dbeffd700 1 -- 172.21.15.49:0/3072188905 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db40070d0 con 0x7f0da8004690 2023-11-30T18:39:47.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.491+0000 7f0dc53c9700 1 -- 172.21.15.49:0/3072188905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da8004690 msgr2=0x7f0da8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:47.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.491+0000 7f0dc53c9700 1 --2- 172.21.15.49:0/3072188905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da8004690 0x7f0da8004b10 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7f0db400c190 tx=0x7f0db4001e10).stop 2023-11-30T18:39:47.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.491+0000 7f0dc4bc8700 1 -- 172.21.15.49:0/3072188905 reap_dead start 2023-11-30T18:39:47.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.491+0000 7f0dc53c9700 1 -- 172.21.15.49:0/3072188905 shutdown_connections 2023-11-30T18:39:47.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.491+0000 7f0dc53c9700 1 -- 172.21.15.49:0/3072188905 >> 172.21.15.49:0/3072188905 conn(0x7f0dc0064990 msgr2=0x7f0dc0064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:47.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.491+0000 7f0dc53c9700 1 -- 172.21.15.49:0/3072188905 shutdown_connections 2023-11-30T18:39:47.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.491+0000 7f0dc53c9700 1 -- 172.21.15.49:0/3072188905 wait complete. 2023-11-30T18:39:47.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.492+0000 7f0dc53c9700 1 Processor -- start 2023-11-30T18:39:47.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.492+0000 7f0dc53c9700 1 -- start start 2023-11-30T18:39:47.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.493+0000 7f0dc53c9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0da8004690 0x7f0dc014dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:47.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.493+0000 7f0dc53c9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0dc00c3240 0x7f0dc00c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:47.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.493+0000 7f0dc53c9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dc00b0180 0x7f0dc00b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:47.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.493+0000 7f0dc53c9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc00b0af0 con 0x7f0dc00b0180 2023-11-30T18:39:47.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.493+0000 7f0dc53c9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc00c3c70 con 0x7f0da8004690 2023-11-30T18:39:47.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.493+0000 7f0dc53c9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc00c21c0 con 0x7f0dc00c3240 2023-11-30T18:39:47.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.493+0000 7f0dc4bc8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dc00b0180 0x7f0dc00b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:47.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.493+0000 7f0dc4bc8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dc00b0180 0x7f0dc00b0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59908/0 (socket says 172.21.15.49:59908) 2023-11-30T18:39:47.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.493+0000 7f0dc4bc8700 1 -- 172.21.15.49:0/4070170183 learned_addr learned my addr 172.21.15.49:0/4070170183 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:47.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.493+0000 7f0dbf7fe700 1 --2- 172.21.15.49:0/4070170183 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0dc00c3240 0x7f0dc00c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:47.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.493+0000 7f0dbffff700 1 --2- 172.21.15.49:0/4070170183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0da8004690 0x7f0dc014dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:47.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.494+0000 7f0dc4bc8700 1 -- 172.21.15.49:0/4070170183 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0dc00c3240 msgr2=0x7f0dc00c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:47.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.494+0000 7f0dc4bc8700 1 --2- 172.21.15.49:0/4070170183 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0dc00c3240 0x7f0dc00c36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.494+0000 7f0dc4bc8700 1 -- 172.21.15.49:0/4070170183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0da8004690 msgr2=0x7f0dc014dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:47.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.494+0000 7f0dc4bc8700 1 --2- 172.21.15.49:0/4070170183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0da8004690 0x7f0dc014dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.494+0000 7f0dc4bc8700 1 -- 172.21.15.49:0/4070170183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc00c24a0 con 0x7f0dc00b0180 2023-11-30T18:39:47.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.494+0000 7f0dc4bc8700 1 --2- 172.21.15.49:0/4070170183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dc00b0180 0x7f0dc00b0600 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 rx=0x7f0dc00ab070 tx=0x7f0db800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:47.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.494+0000 7f0da7fff700 1 -- 172.21.15.49:0/4070170183 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db800e040 con 0x7f0dc00b0180 2023-11-30T18:39:47.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.494+0000 7f0da7fff700 1 -- 172.21.15.49:0/4070170183 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db800f040 con 0x7f0dc00b0180 2023-11-30T18:39:47.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.494+0000 7f0dc53c9700 1 -- 172.21.15.49:0/4070170183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc00c2780 con 0x7f0dc00b0180 2023-11-30T18:39:47.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.494+0000 7f0da7fff700 1 -- 172.21.15.49:0/4070170183 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db800fd70 con 0x7f0dc00b0180 2023-11-30T18:39:47.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.494+0000 7f0dc53c9700 1 -- 172.21.15.49:0/4070170183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc00c2f80 con 0x7f0dc00b0180 2023-11-30T18:39:47.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.496+0000 7f0da7fff700 1 -- 172.21.15.49:0/4070170183 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0db8015660 con 0x7f0dc00b0180 2023-11-30T18:39:47.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.496+0000 7f0da7fff700 1 --2- 172.21.15.49:0/4070170183 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0dac05f270 0x7f0dac061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:47.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.496+0000 7f0da7fff700 1 -- 172.21.15.49:0/4070170183 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6205+0+0 (secure 0 0 0) 0x7f0db807ae00 con 0x7f0dc00b0180 2023-11-30T18:39:47.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.496+0000 7f0dbffff700 1 --2- 172.21.15.49:0/4070170183 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0dac05f270 0x7f0dac061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:47.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.497+0000 7f0dbffff700 1 --2- 172.21.15.49:0/4070170183 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0dac05f270 0x7f0dac061730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f0db0000c00 tx=0x7f0db0009040).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:47.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.498+0000 7f0dd7fc3b80 1 Processor -- start 2023-11-30T18:39:47.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.498+0000 7f0dd7fc3b80 1 -- start start 2023-11-30T18:39:47.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.499+0000 7f0dd7fc3b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5639ee287e40 0x5639ee4cb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:47.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.499+0000 7f0dd7fc3b80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5639ee5144e0 0x5639ee4cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:47.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.499+0000 7f0dd7fc3b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5639ee4f3cf0 0x5639ee4c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:47.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.499+0000 7f0dd7fc3b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639ee491060 con 0x5639ee4f3cf0 2023-11-30T18:39:47.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.499+0000 7f0dd7fc3b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639ee4081f0 con 0x5639ee287e40 2023-11-30T18:39:47.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.499+0000 7f0dd7fc3b80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x5639ee41d440 con 0x5639ee5144e0 2023-11-30T18:39:47.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.499+0000 7f0dc4bc8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5639ee4f3cf0 0x5639ee4c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:47.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.499+0000 7f0dc4bc8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5639ee4f3cf0 0x5639ee4c67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59916/0 (socket says 172.21.15.49:59916) 2023-11-30T18:39:47.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.499+0000 7f0dc4bc8700 1 -- 172.21.15.49:0/334350391 learned_addr learned my addr 172.21.15.49:0/334350391 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:47.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.499+0000 7f0dbf7fe700 1 --2- 172.21.15.49:0/334350391 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5639ee5144e0 0x5639ee4cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:47.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.499+0000 7f0dbffff700 1 --2- 172.21.15.49:0/334350391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5639ee287e40 0x5639ee4cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:47.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.499+0000 7f0dc4bc8700 1 -- 172.21.15.49:0/334350391 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5639ee5144e0 msgr2=0x5639ee4cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:47.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.499+0000 7f0dc4bc8700 1 --2- 172.21.15.49:0/334350391 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5639ee5144e0 0x5639ee4cbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.499+0000 7f0dc4bc8700 1 -- 172.21.15.49:0/334350391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5639ee287e40 msgr2=0x5639ee4cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:47.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.499+0000 7f0dc4bc8700 1 --2- 172.21.15.49:0/334350391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5639ee287e40 0x5639ee4cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.499+0000 7f0dc4bc8700 1 -- 172.21.15.49:0/334350391 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639ee416620 con 0x5639ee4f3cf0 2023-11-30T18:39:47.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.499+0000 7f0dbffff700 1 --2- 172.21.15.49:0/334350391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5639ee287e40 0x5639ee4cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:39:47.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.499+0000 7f0dc4bc8700 1 --2- 172.21.15.49:0/334350391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5639ee4f3cf0 0x5639ee4c67e0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 rx=0x7f0db804faf0 tx=0x7f0db8009780).ready entity=mon.0 client_cookie=25abb13fbf5564cb server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:47.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.499+0000 7f0da57fa700 1 -- 172.21.15.49:0/334350391 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db80552f0 con 0x5639ee4f3cf0 2023-11-30T18:39:47.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.499+0000 7f0da57fa700 1 -- 172.21.15.49:0/334350391 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db8079240 con 0x5639ee4f3cf0 2023-11-30T18:39:47.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.499+0000 7f0da57fa700 1 -- 172.21.15.49:0/334350391 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db8013dc0 con 0x5639ee4f3cf0 2023-11-30T18:39:47.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.500+0000 7f0dd7fc3b80 1 -- 172.21.15.49:0/334350391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5639ee4f3cf0 msgr2=0x5639ee4c67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:47.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.500+0000 7f0dd7fc3b80 1 --2- 172.21.15.49:0/334350391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5639ee4f3cf0 0x5639ee4c67e0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 rx=0x7f0db804faf0 tx=0x7f0db8009780).stop 2023-11-30T18:39:47.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.500+0000 7f0dd7fc3b80 1 -- 172.21.15.49:0/334350391 shutdown_connections 2023-11-30T18:39:47.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.500+0000 7f0dd7fc3b80 1 --2- 172.21.15.49:0/334350391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5639ee4f3cf0 0x5639ee4c67e0 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.500+0000 7f0dd7fc3b80 1 --2- 172.21.15.49:0/334350391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5639ee287e40 0x5639ee4cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.500+0000 7f0dd7fc3b80 1 --2- 172.21.15.49:0/334350391 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5639ee5144e0 0x5639ee4cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.500+0000 7f0dd7fc3b80 1 -- 172.21.15.49:0/334350391 >> 172.21.15.49:0/334350391 conn(0x5639ee3354a0 msgr2=0x5639ee514970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:47.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.500+0000 7f0dd7fc3b80 1 -- 172.21.15.49:0/334350391 shutdown_connections 2023-11-30T18:39:47.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.500+0000 7f0dd7fc3b80 1 -- 172.21.15.49:0/334350391 wait complete. 2023-11-30T18:39:47.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.501+0000 7f0dd7fc3b80 1 -- start start 2023-11-30T18:39:47.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.501+0000 7f0dd7fc3b80 1 Processor -- start 2023-11-30T18:39:47.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.502+0000 7f0dd7fc3b80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5639ee287e40 0x5639ee4f01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:47.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.502+0000 7f0dd7fc3b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5639ee4f3cf0 0x5639ee4f9540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:47.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.502+0000 7f0dd7fc3b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5639ee5144e0 0x5639ee4f9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:47.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.502+0000 7f0dd7fc3b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639ee41d580 con 0x5639ee5144e0 2023-11-30T18:39:47.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.502+0000 7f0dd7fc3b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639ee41d800 con 0x5639ee4f3cf0 2023-11-30T18:39:47.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.502+0000 7f0dd7fc3b80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x5639ee3e8e10 con 0x5639ee287e40 2023-11-30T18:39:47.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.502+0000 7f0dd7fc3b80 10 client.0 ll_register_callbacks cb 0x5639ee48b640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-30T18:39:47.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.502+0000 7f0dc4bc8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5639ee5144e0 0x5639ee4f9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:47.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.502+0000 7f0dc4bc8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5639ee5144e0 0x5639ee4f9a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59918/0 (socket says 172.21.15.49:59918) 2023-11-30T18:39:47.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.502+0000 7f0dc4bc8700 1 -- 172.21.15.49:0/2350895773 learned_addr learned my addr 172.21.15.49:0/2350895773 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:47.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.502+0000 7f0dbf7fe700 1 --2- 172.21.15.49:0/2350895773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5639ee4f3cf0 0x5639ee4f9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:47.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.502+0000 7f0dbffff700 1 --2- 172.21.15.49:0/2350895773 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5639ee287e40 0x5639ee4f01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:47.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.502+0000 7f0dc4bc8700 1 -- 172.21.15.49:0/2350895773 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5639ee287e40 msgr2=0x5639ee4f01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:47.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.502+0000 7f0dc4bc8700 1 --2- 172.21.15.49:0/2350895773 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5639ee287e40 0x5639ee4f01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.502+0000 7f0dc4bc8700 1 -- 172.21.15.49:0/2350895773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5639ee4f3cf0 msgr2=0x5639ee4f9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:47.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.502+0000 7f0dc4bc8700 1 --2- 172.21.15.49:0/2350895773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5639ee4f3cf0 0x5639ee4f9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.502+0000 7f0dc4bc8700 1 -- 172.21.15.49:0/2350895773 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc00c2f80 con 0x5639ee5144e0 2023-11-30T18:39:47.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.502+0000 7f0dc4bc8700 1 --2- 172.21.15.49:0/2350895773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5639ee5144e0 0x5639ee4f9a30 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 rx=0x7f0db8051010 tx=0x7f0db805a000).ready entity=mon.0 client_cookie=20d5fa987d171e90 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:47.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.502+0000 7f0d9e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-30T18:39:47.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.502+0000 7f0d9e7fc700 1 -- 172.21.15.49:0/2350895773 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db804dd00 con 0x5639ee5144e0 2023-11-30T18:39:47.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.502+0000 7f0d9e7fc700 1 -- 172.21.15.49:0/2350895773 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(203..203 src has 1..203) v4 ==== 6205+0+0 (secure 0 0 0) 0x7f0db804f0b0 con 0x5639ee5144e0 2023-11-30T18:39:47.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.502+0000 7f0dd7fc3b80 1 -- 172.21.15.49:0/2350895773 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5639ee4bf720 con 0x5639ee5144e0 2023-11-30T18:39:47.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.503+0000 7f0d9e7fc700 1 -- 172.21.15.49:0/2350895773 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0db804b9b0 con 0x5639ee5144e0 2023-11-30T18:39:47.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.503+0000 7f0dd7fc3b80 10 client.9666 fetch_fsmap learned FSMap version 85 2023-11-30T18:39:47.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.503+0000 7f0dd7fc3b80 1 -- 172.21.15.49:0/2350895773 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) v3 -- 0x5639ee4119c0 con 0x5639ee5144e0 2023-11-30T18:39:47.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.503+0000 7f0d9e7fc700 1 -- 172.21.15.49:0/2350895773 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5639ee4bf720 con 0x5639ee5144e0 2023-11-30T18:39:47.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.503+0000 7f0d9e7fc700 1 -- 172.21.15.49:0/2350895773 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 85) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0db805c070 con 0x5639ee5144e0 2023-11-30T18:39:47.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.503+0000 7f0dd7fc3b80 10 client.9666 fetch_fsmap finished waiting for FSMap version 85 2023-11-30T18:39:47.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.503+0000 7f0dd7fc3b80 10 client.9666 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-30T18:39:47.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.503+0000 7f0dd7fc3b80 20 client.9666 populate_metadata read hostname 'smithi049' 2023-11-30T18:39:47.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.503+0000 7f0dd7fc3b80 1 --2- 172.21.15.49:0/2350895773 >> [v2:172.21.15.49:6833/4263670008,v1:172.21.15.49:6835/4263670008] conn(0x5639ee50f020 0x5639ee50f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:47.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.503+0000 7f0dd7fc3b80 4 client.9666 mds_command: new command op to 9498 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-30T18:39:47.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.503+0000 7f0dd7fc3b80 1 -- 172.21.15.49:0/2350895773 --> [v2:172.21.15.49:6833/4263670008,v1:172.21.15.49:6835/4263670008] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5639ee283ca0 con 0x5639ee50f020 2023-11-30T18:39:47.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.503+0000 7f0dbffff700 1 --2- 172.21.15.49:0/2350895773 >> [v2:172.21.15.49:6833/4263670008,v1:172.21.15.49:6835/4263670008] conn(0x5639ee50f020 0x5639ee50f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:47.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.503+0000 7f0d9e7fc700 10 client.9666 ms_handle_connect on v2:172.21.15.49:6833/4263670008 2023-11-30T18:39:47.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.503+0000 7f0dbffff700 1 --2- 172.21.15.49:0/2350895773 >> [v2:172.21.15.49:6833/4263670008,v1:172.21.15.49:6835/4263670008] conn(0x5639ee50f020 0x5639ee50f400 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=a114d07db6b72f32 server_cookie=cc49abe5c04582e0 in_seq=0 out_seq=0 2023-11-30T18:39:47.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.504+0000 7f0d9e7fc700 1 -- 172.21.15.49:0/2350895773 <== mds.0 v2:172.21.15.49:6833/4263670008 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5639ee283ca0 con 0x5639ee50f020 2023-11-30T18:39:47.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.504+0000 7f0d9e7fc700 10 client.9666 handle_command_reply: tid=0 2023-11-30T18:39:47.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.504+0000 7f0dd7fc3b80 1 client.9666 shutdown 2023-11-30T18:39:47.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.504+0000 7f0dd7fc3b80 1 -- 172.21.15.49:0/2350895773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5639ee5144e0 msgr2=0x5639ee4f9a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:47.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.504+0000 7f0dd7fc3b80 1 --2- 172.21.15.49:0/2350895773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5639ee5144e0 0x5639ee4f9a30 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 rx=0x7f0db8051010 tx=0x7f0db805a000).stop 2023-11-30T18:39:47.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.504+0000 7f0dd7fc3b80 1 -- 172.21.15.49:0/2350895773 shutdown_connections 2023-11-30T18:39:47.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.504+0000 7f0dd7fc3b80 1 --2- 172.21.15.49:0/2350895773 >> [v2:172.21.15.49:6833/4263670008,v1:172.21.15.49:6835/4263670008] conn(0x5639ee50f020 0x5639ee50f400 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.504+0000 7f0dd7fc3b80 1 --2- 172.21.15.49:0/2350895773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5639ee5144e0 0x5639ee4f9a30 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.504+0000 7f0dd7fc3b80 1 --2- 172.21.15.49:0/2350895773 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5639ee287e40 0x5639ee4f01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.504+0000 7f0dd7fc3b80 1 --2- 172.21.15.49:0/2350895773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5639ee4f3cf0 0x5639ee4f9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.504+0000 7f0dd7fc3b80 1 -- 172.21.15.49:0/2350895773 >> 172.21.15.49:0/2350895773 conn(0x5639ee3354a0 msgr2=0x5639ee4ccb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:47.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.504+0000 7f0d9e7fc700 0 client.9666 ms_handle_reset on v2:172.21.15.49:6833/4263670008 2023-11-30T18:39:47.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.504+0000 7f0dd7fc3b80 1 -- 172.21.15.49:0/2350895773 shutdown_connections 2023-11-30T18:39:47.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.504+0000 7f0dd7fc3b80 1 -- 172.21.15.49:0/2350895773 wait complete. 2023-11-30T18:39:47.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.504+0000 7f0dd7fc3b80 20 client.9666 trim_cache size 0 max 16384 2023-11-30T18:39:47.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.521+0000 7f0dd7fc3b80 1 Processor -- start 2023-11-30T18:39:47.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.521+0000 7f0dd7fc3b80 1 -- start start 2023-11-30T18:39:47.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.522+0000 7f0dd7fc3b80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5639ee287e40 0x5639ee4cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:47.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.522+0000 7f0dd7fc3b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5639ee4f3cf0 0x5639ee4ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:47.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.522+0000 7f0dd7fc3b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5639ee5144e0 0x5639ee50f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:47.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.522+0000 7f0dd7fc3b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639ee50ed30 con 0x5639ee4f3cf0 2023-11-30T18:39:47.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.522+0000 7f0dd7fc3b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639ee4cd070 con 0x5639ee5144e0 2023-11-30T18:39:47.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.522+0000 7f0dd7fc3b80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x5639ee4c9ea0 con 0x5639ee287e40 2023-11-30T18:39:47.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.522+0000 7f0dbf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5639ee4f3cf0 0x5639ee4ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:47.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.522+0000 7f0dbf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5639ee4f3cf0 0x5639ee4ccb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59934/0 (socket says 172.21.15.49:59934) 2023-11-30T18:39:47.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.522+0000 7f0dbf7fe700 1 -- 172.21.15.49:0/1494187820 learned_addr learned my addr 172.21.15.49:0/1494187820 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:47.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.522+0000 7f0dbffff700 1 --2- 172.21.15.49:0/1494187820 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5639ee287e40 0x5639ee4cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:47.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.522+0000 7f0dc4bc8700 1 --2- 172.21.15.49:0/1494187820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5639ee5144e0 0x5639ee50f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:47.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.522+0000 7f0dbf7fe700 1 -- 172.21.15.49:0/1494187820 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5639ee287e40 msgr2=0x5639ee4cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:47.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.522+0000 7f0dbf7fe700 1 --2- 172.21.15.49:0/1494187820 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5639ee287e40 0x5639ee4cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.522+0000 7f0dbf7fe700 1 -- 172.21.15.49:0/1494187820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5639ee5144e0 msgr2=0x5639ee50f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:47.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.522+0000 7f0dbf7fe700 1 --2- 172.21.15.49:0/1494187820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5639ee5144e0 0x5639ee50f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.522+0000 7f0dbf7fe700 1 -- 172.21.15.49:0/1494187820 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639ee411710 con 0x5639ee4f3cf0 2023-11-30T18:39:47.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.523+0000 7f0dbf7fe700 1 --2- 172.21.15.49:0/1494187820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5639ee4f3cf0 0x5639ee4ccb80 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 rx=0x7f0db400c780 tx=0x7f0db4015000).ready entity=mon.0 client_cookie=2d317aff623efe03 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:47.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.523+0000 7f0da5ffb700 1 -- 172.21.15.49:0/1494187820 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db400c930 con 0x5639ee4f3cf0 2023-11-30T18:39:47.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.523+0000 7f0da5ffb700 1 -- 172.21.15.49:0/1494187820 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db4000c30 con 0x5639ee4f3cf0 2023-11-30T18:39:47.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.523+0000 7f0da5ffb700 1 -- 172.21.15.49:0/1494187820 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db400ccd0 con 0x5639ee4f3cf0 2023-11-30T18:39:47.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.523+0000 7f0dd7fc3b80 1 -- 172.21.15.49:0/1494187820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5639ee4f3cf0 msgr2=0x5639ee4ccb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:47.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.523+0000 7f0dd7fc3b80 1 --2- 172.21.15.49:0/1494187820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5639ee4f3cf0 0x5639ee4ccb80 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 rx=0x7f0db400c780 tx=0x7f0db4015000).stop 2023-11-30T18:39:47.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.523+0000 7f0dd7fc3b80 1 -- 172.21.15.49:0/1494187820 shutdown_connections 2023-11-30T18:39:47.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.523+0000 7f0dd7fc3b80 1 --2- 172.21.15.49:0/1494187820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5639ee5144e0 0x5639ee50f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.523+0000 7f0dd7fc3b80 1 --2- 172.21.15.49:0/1494187820 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5639ee287e40 0x5639ee4cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.523+0000 7f0dd7fc3b80 1 --2- 172.21.15.49:0/1494187820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5639ee4f3cf0 0x5639ee4ccb80 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.523+0000 7f0dd7fc3b80 1 -- 172.21.15.49:0/1494187820 >> 172.21.15.49:0/1494187820 conn(0x5639ee3354a0 msgr2=0x5639ee4f01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:47.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.523+0000 7f0dd7fc3b80 1 -- 172.21.15.49:0/1494187820 shutdown_connections 2023-11-30T18:39:47.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.523+0000 7f0dd7fc3b80 1 -- 172.21.15.49:0/1494187820 wait complete. 2023-11-30T18:39:47.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.524+0000 7f0dd7fc3b80 1 -- start start 2023-11-30T18:39:47.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.524+0000 7f0dd7fc3b80 1 Processor -- start 2023-11-30T18:39:47.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.525+0000 7f0dd7fc3b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5639ee287e40 0x5639ee575660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:47.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.525+0000 7f0dd7fc3b80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5639ee4f3cf0 0x5639ee50d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:47.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.525+0000 7f0dd7fc3b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5639ee5144e0 0x5639ee5765d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:47.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.525+0000 7f0dd7fc3b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639ee577360 con 0x5639ee287e40 2023-11-30T18:39:47.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.525+0000 7f0dd7fc3b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639ee513940 con 0x5639ee5144e0 2023-11-30T18:39:47.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.525+0000 7f0dd7fc3b80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x5639ee4c6ae0 con 0x5639ee4f3cf0 2023-11-30T18:39:47.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.525+0000 7f0dd7fc3b80 10 client.0 ll_register_callbacks cb 0x7f0db804f520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-30T18:39:47.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.525+0000 7f0dbffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5639ee287e40 0x5639ee575660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:47.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.525+0000 7f0dbffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5639ee287e40 0x5639ee575660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59938/0 (socket says 172.21.15.49:59938) 2023-11-30T18:39:47.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.525+0000 7f0dbffff700 1 -- 172.21.15.49:0/3387806315 learned_addr learned my addr 172.21.15.49:0/3387806315 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:47.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.525+0000 7f0dc4bc8700 1 --2- 172.21.15.49:0/3387806315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5639ee5144e0 0x5639ee5765d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:47.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.525+0000 7f0dbf7fe700 1 --2- 172.21.15.49:0/3387806315 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5639ee4f3cf0 0x5639ee50d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:47.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.525+0000 7f0dbffff700 1 -- 172.21.15.49:0/3387806315 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5639ee4f3cf0 msgr2=0x5639ee50d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:47.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.525+0000 7f0dbffff700 1 --2- 172.21.15.49:0/3387806315 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5639ee4f3cf0 0x5639ee50d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.525+0000 7f0dbffff700 1 -- 172.21.15.49:0/3387806315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5639ee5144e0 msgr2=0x5639ee5765d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:47.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.525+0000 7f0dbffff700 1 --2- 172.21.15.49:0/3387806315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5639ee5144e0 0x5639ee5765d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.525+0000 7f0dbffff700 1 -- 172.21.15.49:0/3387806315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0da80033f0 con 0x5639ee287e40 2023-11-30T18:39:47.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.525+0000 7f0dbf7fe700 1 --2- 172.21.15.49:0/3387806315 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5639ee4f3cf0 0x5639ee50d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:39:47.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.525+0000 7f0dbffff700 1 --2- 172.21.15.49:0/3387806315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5639ee287e40 0x5639ee575660 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 rx=0x5639ee5135a0 tx=0x7f0db0015000).ready entity=mon.0 client_cookie=1412dd7974c987dd server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:47.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.525+0000 7f0d9e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-30T18:39:47.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.525+0000 7f0d9e7fc700 1 -- 172.21.15.49:0/3387806315 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db0024650 con 0x5639ee287e40 2023-11-30T18:39:47.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.526+0000 7f0dd7fc3b80 1 -- 172.21.15.49:0/3387806315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0db8079240 con 0x5639ee287e40 2023-11-30T18:39:47.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.526+0000 7f0d9e7fc700 1 -- 172.21.15.49:0/3387806315 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(203..203 src has 1..203) v4 ==== 6205+0+0 (secure 0 0 0) 0x7f0db00247b0 con 0x5639ee287e40 2023-11-30T18:39:47.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.526+0000 7f0d9e7fc700 1 -- 172.21.15.49:0/3387806315 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0db0024b80 con 0x5639ee287e40 2023-11-30T18:39:47.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.526+0000 7f0dd7fc3b80 10 client.9672 fetch_fsmap learned FSMap version 85 2023-11-30T18:39:47.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.526+0000 7f0dd7fc3b80 1 -- 172.21.15.49:0/3387806315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) v3 -- 0x5639ee288f80 con 0x5639ee287e40 2023-11-30T18:39:47.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.526+0000 7f0d9e7fc700 1 -- 172.21.15.49:0/3387806315 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db8079240 con 0x5639ee287e40 2023-11-30T18:39:47.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.526+0000 7f0d9e7fc700 1 -- 172.21.15.49:0/3387806315 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 85) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0db0024ce0 con 0x5639ee287e40 2023-11-30T18:39:47.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.526+0000 7f0dd7fc3b80 10 client.9672 fetch_fsmap finished waiting for FSMap version 85 2023-11-30T18:39:47.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.526+0000 7f0dd7fc3b80 10 client.9672 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-30T18:39:47.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.526+0000 7f0dd7fc3b80 20 client.9672 populate_metadata read hostname 'smithi049' 2023-11-30T18:39:47.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.526+0000 7f0dd7fc3b80 1 --2- 172.21.15.49:0/3387806315 >> [v2:172.21.15.49:6833/4263670008,v1:172.21.15.49:6835/4263670008] conn(0x5639ee4ee960 0x5639ee4eed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:47.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.526+0000 7f0dd7fc3b80 4 client.9672 mds_command: new command op to 9498 tid=0[{"prefix": "status"}] 2023-11-30T18:39:47.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.526+0000 7f0dd7fc3b80 1 -- 172.21.15.49:0/3387806315 --> [v2:172.21.15.49:6833/4263670008,v1:172.21.15.49:6835/4263670008] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5639ee2baca0 con 0x5639ee4ee960 2023-11-30T18:39:47.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.526+0000 7f0dbf7fe700 1 --2- 172.21.15.49:0/3387806315 >> [v2:172.21.15.49:6833/4263670008,v1:172.21.15.49:6835/4263670008] conn(0x5639ee4ee960 0x5639ee4eed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:47.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.526+0000 7f0d9e7fc700 10 client.9672 ms_handle_connect on v2:172.21.15.49:6833/4263670008 2023-11-30T18:39:47.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.526+0000 7f0dbf7fe700 1 --2- 172.21.15.49:0/3387806315 >> [v2:172.21.15.49:6833/4263670008,v1:172.21.15.49:6835/4263670008] conn(0x5639ee4ee960 0x5639ee4eed40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8d170f6d9591da6b server_cookie=606eafec84070e6 in_seq=0 out_seq=0 2023-11-30T18:39:47.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.527+0000 7f0d9e7fc700 1 -- 172.21.15.49:0/3387806315 <== mds.0 v2:172.21.15.49:6833/4263670008 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5639ee2baca0 con 0x5639ee4ee960 2023-11-30T18:39:47.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.527+0000 7f0d9e7fc700 10 client.9672 handle_command_reply: tid=0 2023-11-30T18:39:47.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.527+0000 7f0dd7fc3b80 1 client.9672 shutdown 2023-11-30T18:39:47.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.527+0000 7f0dd7fc3b80 1 -- 172.21.15.49:0/3387806315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5639ee287e40 msgr2=0x5639ee575660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:47.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.527+0000 7f0dd7fc3b80 1 --2- 172.21.15.49:0/3387806315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5639ee287e40 0x5639ee575660 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 rx=0x5639ee5135a0 tx=0x7f0db0015000).stop 2023-11-30T18:39:47.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.527+0000 7f0dd7fc3b80 1 -- 172.21.15.49:0/3387806315 shutdown_connections 2023-11-30T18:39:47.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.527+0000 7f0dd7fc3b80 1 --2- 172.21.15.49:0/3387806315 >> [v2:172.21.15.49:6833/4263670008,v1:172.21.15.49:6835/4263670008] conn(0x5639ee4ee960 0x5639ee4eed40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.527+0000 7f0dd7fc3b80 1 --2- 172.21.15.49:0/3387806315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5639ee5144e0 0x5639ee5765d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.527+0000 7f0d9e7fc700 0 client.9672 ms_handle_reset on v2:172.21.15.49:6833/4263670008 2023-11-30T18:39:47.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.527+0000 7f0dd7fc3b80 1 --2- 172.21.15.49:0/3387806315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5639ee287e40 0x5639ee575660 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.527+0000 7f0dd7fc3b80 1 --2- 172.21.15.49:0/3387806315 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5639ee4f3cf0 0x5639ee50d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.527+0000 7f0dd7fc3b80 1 -- 172.21.15.49:0/3387806315 >> 172.21.15.49:0/3387806315 conn(0x5639ee3354a0 msgr2=0x5639ee4cc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:47.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.527+0000 7f0dd7fc3b80 1 -- 172.21.15.49:0/3387806315 shutdown_connections 2023-11-30T18:39:47.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.527+0000 7f0dd7fc3b80 1 -- 172.21.15.49:0/3387806315 wait complete. 2023-11-30T18:39:47.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.527+0000 7f0dd7fc3b80 20 client.9672 trim_cache size 0 max 16384 2023-11-30T18:39:47.537 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T18:39:47.537 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "ef213ed4-8f62-4ad5-b55f-7510fd0ee359", 2023-11-30T18:39:47.538 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2023-11-30T18:39:47.538 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 9498, 2023-11-30T18:39:47.538 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-11-30T18:39:47.538 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-11-30T18:39:47.538 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-11-30T18:39:47.538 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 10.206212007, 2023-11-30T18:39:47.538 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 85, 2023-11-30T18:39:47.538 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 203, 2023-11-30T18:39:47.538 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 203, 2023-11-30T18:39:47.539 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 14.947847792999999 2023-11-30T18:39:47.539 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T18:39:47.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.527+0000 7f0dc53c9700 1 -- 172.21.15.49:0/4070170183 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0dac05f270 msgr2=0x7f0dac061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:47.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.527+0000 7f0dc53c9700 1 --2- 172.21.15.49:0/4070170183 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0dac05f270 0x7f0dac061730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f0db0000c00 tx=0x7f0db0009040).stop 2023-11-30T18:39:47.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.527+0000 7f0dc53c9700 1 -- 172.21.15.49:0/4070170183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dc00b0180 msgr2=0x7f0dc00b0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:47.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.527+0000 7f0dc53c9700 1 --2- 172.21.15.49:0/4070170183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dc00b0180 0x7f0dc00b0600 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 rx=0x7f0dc00ab070 tx=0x7f0db800b040).stop 2023-11-30T18:39:47.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.527+0000 7f0dc53c9700 1 -- 172.21.15.49:0/4070170183 shutdown_connections 2023-11-30T18:39:47.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.527+0000 7f0dc53c9700 1 --2- 172.21.15.49:0/4070170183 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0dac05f270 0x7f0dac061730 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.527+0000 7f0dc53c9700 1 --2- 172.21.15.49:0/4070170183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dc00b0180 0x7f0dc00b0600 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.527+0000 7f0dc53c9700 1 --2- 172.21.15.49:0/4070170183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0da8004690 0x7f0dc014dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.527+0000 7f0dc53c9700 1 --2- 172.21.15.49:0/4070170183 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0dc00c3240 0x7f0dc00c36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.527+0000 7f0dc53c9700 1 -- 172.21.15.49:0/4070170183 >> 172.21.15.49:0/4070170183 conn(0x7f0dc0064990 msgr2=0x7f0dc00c1470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:47.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.528+0000 7f0dc53c9700 1 -- 172.21.15.49:0/4070170183 shutdown_connections 2023-11-30T18:39:47.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.528+0000 7f0dc53c9700 1 -- 172.21.15.49:0/4070170183 wait complete. 2023-11-30T18:39:47.541 DEBUG:teuthology.orchestra.run.smithi049:> ceph fs ls 2023-11-30T18:39:47.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.644+0000 7faf24a4b700 1 Processor -- start 2023-11-30T18:39:47.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.644+0000 7faf24a4b700 1 -- start start 2023-11-30T18:39:47.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.645+0000 7faf24a4b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faf20063890 0x7faf20063d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:47.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.645+0000 7faf24a4b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf200bee60 0x7faf200bf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:47.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.645+0000 7faf24a4b700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf200bf7e0 con 0x7faf2013aa20 2023-11-30T18:39:47.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.645+0000 7faf24a4b700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf200be9d0 con 0x7faf20063890 2023-11-30T18:39:47.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.645+0000 7faf24a4b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf200be0a0 con 0x7faf200bee60 2023-11-30T18:39:47.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.645+0000 7faf1dd9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faf20063890 0x7faf20063d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:47.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.645+0000 7faf1dd9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faf20063890 0x7faf20063d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59950/0 (socket says 172.21.15.49:59950) 2023-11-30T18:39:47.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.645+0000 7faf1dd9b700 1 -- 172.21.15.49:0/3677962735 learned_addr learned my addr 172.21.15.49:0/3677962735 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:47.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.645+0000 7faf1ed9d700 1 --2- 172.21.15.49:0/3677962735 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf200bee60 0x7faf200bf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:47.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.645+0000 7faf1dd9b700 1 -- 172.21.15.49:0/3677962735 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf200bee60 msgr2=0x7faf200bf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:47.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.645+0000 7faf1dd9b700 1 --2- 172.21.15.49:0/3677962735 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf200bee60 0x7faf200bf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.645+0000 7faf1dd9b700 1 -- 172.21.15.49:0/3677962735 >> v1:172.21.15.115:6789/0 conn(0x7faf2013aa20 legacy=0x7faf200c36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:47.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.645+0000 7faf1dd9b700 1 -- 172.21.15.49:0/3677962735 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf200be380 con 0x7faf20063890 2023-11-30T18:39:47.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.646+0000 7faf1dd9b700 1 --2- 172.21.15.49:0/3677962735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf20063890 0x7faf20063d10 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7faf08006fd0 tx=0x7faf080090f0).ready entity=mon.0 client_cookie=149d83de9003509d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:47.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.646+0000 7faf1d59a700 1 -- 172.21.15.49:0/3677962735 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0800b600 con 0x7faf20063890 2023-11-30T18:39:47.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.646+0000 7faf1d59a700 1 -- 172.21.15.49:0/3677962735 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0800b760 con 0x7faf20063890 2023-11-30T18:39:47.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.646+0000 7faf1d59a700 1 -- 172.21.15.49:0/3677962735 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0800bb00 con 0x7faf20063890 2023-11-30T18:39:47.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.646+0000 7faf24a4b700 1 -- 172.21.15.49:0/3677962735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf20063890 msgr2=0x7faf20063d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:47.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.646+0000 7faf24a4b700 1 --2- 172.21.15.49:0/3677962735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf20063890 0x7faf20063d10 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7faf08006fd0 tx=0x7faf080090f0).stop 2023-11-30T18:39:47.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.646+0000 7faf24a4b700 1 -- 172.21.15.49:0/3677962735 shutdown_connections 2023-11-30T18:39:47.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.646+0000 7faf24a4b700 1 --2- 172.21.15.49:0/3677962735 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf200bee60 0x7faf200bf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.646+0000 7faf24a4b700 1 --2- 172.21.15.49:0/3677962735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf20063890 0x7faf20063d10 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.646+0000 7faf24a4b700 1 -- 172.21.15.49:0/3677962735 >> 172.21.15.49:0/3677962735 conn(0x7faf20063250 msgr2=0x7faf200c9030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:47.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.646+0000 7faf24a4b700 1 -- 172.21.15.49:0/3677962735 shutdown_connections 2023-11-30T18:39:47.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.646+0000 7faf24a4b700 1 -- 172.21.15.49:0/3677962735 wait complete. 2023-11-30T18:39:47.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.647+0000 7faf24a4b700 1 Processor -- start 2023-11-30T18:39:47.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.647+0000 7faf24a4b700 1 -- start start 2023-11-30T18:39:47.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.648+0000 7faf24a4b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf20063890 0x7faf20153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:47.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.648+0000 7faf24a4b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf200bee60 0x7faf20164280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:47.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.648+0000 7faf24a4b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf2013aa20 0x7faf200c2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:47.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.648+0000 7faf24a4b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf20154430 con 0x7faf200bee60 2023-11-30T18:39:47.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.648+0000 7faf24a4b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf200ad4c0 con 0x7faf20063890 2023-11-30T18:39:47.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.648+0000 7faf24a4b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf200ad7a0 con 0x7faf2013aa20 2023-11-30T18:39:47.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.648+0000 7faf1dd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf200bee60 0x7faf20164280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:47.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.648+0000 7faf1dd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf200bee60 0x7faf20164280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59962/0 (socket says 172.21.15.49:59962) 2023-11-30T18:39:47.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.648+0000 7faf1dd9b700 1 -- 172.21.15.49:0/2387493629 learned_addr learned my addr 172.21.15.49:0/2387493629 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:47.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.649+0000 7faf1e59c700 1 --2- 172.21.15.49:0/2387493629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf20063890 0x7faf20153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:47.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.649+0000 7faf1ed9d700 1 --2- 172.21.15.49:0/2387493629 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf2013aa20 0x7faf200c2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:47.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.649+0000 7faf1dd9b700 1 -- 172.21.15.49:0/2387493629 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf2013aa20 msgr2=0x7faf200c2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:47.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.649+0000 7faf1dd9b700 1 --2- 172.21.15.49:0/2387493629 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf2013aa20 0x7faf200c2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.649+0000 7faf1dd9b700 1 -- 172.21.15.49:0/2387493629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf20063890 msgr2=0x7faf20153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:47.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.649+0000 7faf1dd9b700 1 --2- 172.21.15.49:0/2387493629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf20063890 0x7faf20153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.649+0000 7faf1dd9b700 1 -- 172.21.15.49:0/2387493629 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf08009370 con 0x7faf200bee60 2023-11-30T18:39:47.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.649+0000 7faf1ed9d700 1 --2- 172.21.15.49:0/2387493629 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf2013aa20 0x7faf200c2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:39:47.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.649+0000 7faf1e59c700 1 --2- 172.21.15.49:0/2387493629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf20063890 0x7faf20153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:39:47.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.649+0000 7faf1dd9b700 1 --2- 172.21.15.49:0/2387493629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf200bee60 0x7faf20164280 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 rx=0x7faf200ca140 tx=0x7faf08017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:47.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.649+0000 7faf167fc700 1 -- 172.21.15.49:0/2387493629 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0800bec0 con 0x7faf200bee60 2023-11-30T18:39:47.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.649+0000 7faf167fc700 1 -- 172.21.15.49:0/2387493629 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0800b8d0 con 0x7faf200bee60 2023-11-30T18:39:47.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.649+0000 7faf24a4b700 1 -- 172.21.15.49:0/2387493629 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf20164b20 con 0x7faf200bee60 2023-11-30T18:39:47.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.649+0000 7faf167fc700 1 -- 172.21.15.49:0/2387493629 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf08024470 con 0x7faf200bee60 2023-11-30T18:39:47.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.649+0000 7faf24a4b700 1 -- 172.21.15.49:0/2387493629 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf201650e0 con 0x7faf200bee60 2023-11-30T18:39:47.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.650+0000 7faf24a4b700 1 -- 172.21.15.49:0/2387493629 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf200ad910 con 0x7faf200bee60 2023-11-30T18:39:47.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.650+0000 7faf167fc700 1 -- 172.21.15.49:0/2387493629 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7faf08021070 con 0x7faf200bee60 2023-11-30T18:39:47.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.650+0000 7faf167fc700 1 --2- 172.21.15.49:0/2387493629 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7faf0005f270 0x7faf00061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:47.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.651+0000 7faf167fc700 1 -- 172.21.15.49:0/2387493629 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6205+0+0 (secure 0 0 0) 0x7faf0807bf30 con 0x7faf200bee60 2023-11-30T18:39:47.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.651+0000 7faf1e59c700 1 --2- 172.21.15.49:0/2387493629 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7faf0005f270 0x7faf00061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:47.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.651+0000 7faf1e59c700 1 --2- 172.21.15.49:0/2387493629 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7faf0005f270 0x7faf00061730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7faf200abc40 tx=0x7faf18009040).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:47.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.655+0000 7faf167fc700 1 -- 172.21.15.49:0/2387493629 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7faf0804d030 con 0x7faf200bee60 2023-11-30T18:39:47.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.870+0000 7faf24a4b700 1 -- 172.21.15.49:0/2387493629 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faf200475e0 con 0x7faf200bee60 2023-11-30T18:39:47.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.870+0000 7faf167fc700 1 -- 172.21.15.49:0/2387493629 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v85) v1 ==== 53+0+73 (secure 0 0 0) 0x7faf08050650 con 0x7faf200bee60 2023-11-30T18:39:47.872 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-30T18:39:47.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.872+0000 7faf24a4b700 1 -- 172.21.15.49:0/2387493629 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7faf0005f270 msgr2=0x7faf00061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:47.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.872+0000 7faf24a4b700 1 --2- 172.21.15.49:0/2387493629 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7faf0005f270 0x7faf00061730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7faf200abc40 tx=0x7faf18009040).stop 2023-11-30T18:39:47.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.872+0000 7faf24a4b700 1 -- 172.21.15.49:0/2387493629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf200bee60 msgr2=0x7faf20164280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:47.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.872+0000 7faf24a4b700 1 --2- 172.21.15.49:0/2387493629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf200bee60 0x7faf20164280 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 rx=0x7faf200ca140 tx=0x7faf08017000).stop 2023-11-30T18:39:47.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.872+0000 7faf24a4b700 1 -- 172.21.15.49:0/2387493629 shutdown_connections 2023-11-30T18:39:47.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.872+0000 7faf24a4b700 1 --2- 172.21.15.49:0/2387493629 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7faf0005f270 0x7faf00061730 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.872+0000 7faf24a4b700 1 --2- 172.21.15.49:0/2387493629 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf2013aa20 0x7faf200c2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.872+0000 7faf24a4b700 1 --2- 172.21.15.49:0/2387493629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf20063890 0x7faf20153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.872+0000 7faf24a4b700 1 --2- 172.21.15.49:0/2387493629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf200bee60 0x7faf20164280 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:47.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.872+0000 7faf24a4b700 1 -- 172.21.15.49:0/2387493629 >> 172.21.15.49:0/2387493629 conn(0x7faf20063250 msgr2=0x7faf200c3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:47.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.872+0000 7faf24a4b700 1 -- 172.21.15.49:0/2387493629 shutdown_connections 2023-11-30T18:39:47.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:47.872+0000 7faf24a4b700 1 -- 172.21.15.49:0/2387493629 wait complete. 2023-11-30T18:39:47.885 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-30T18:39:47.885 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-30T18:39:47.885 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-11-30T18:39:47.885 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-30T18:39:47.885 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-30T18:39:47.885 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-30T18:39:47.885 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-30T18:39:47.886 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-30T18:39:47.886 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-30T18:39:47.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:39:47.886 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-11-30T18:39:47.903 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-30T18:39:47.903 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-30T18:39:47.904 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-11-30T18:39:47.904 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T18:39:47.904 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-11-30T18:39:47.904 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T18:39:47.904 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T18:39:47.904 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-11-30T18:39:47.904 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-11-30T18:39:47.904 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T18:39:47.904 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-11-30T18:39:47.904 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-11-30T18:39:47.904 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-30T18:39:47.904 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-11-30T18:39:47.904 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-11-30T18:39:47.904 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-30T18:39:47.904 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 36887sec preferred_lft 36887sec 2023-11-30T18:39:47.905 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2023-11-30T18:39:47.905 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T18:39:47.905 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T18:39:47.905 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-11-30T18:39:47.905 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-11-30T18:39:47.905 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-30T18:39:47.905 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 32:bf:40:53:4c:5d brd ff:ff:ff:ff:ff:ff 2023-11-30T18:39:47.905 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-30T18:39:47.905 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T18:39:47.905 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::8b6:11ff:fe93:7174/64 scope link 2023-11-30T18:39:47.905 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T18:39:47.905 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-30T18:39:47.905 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 3e:e9:3c:a8:7a:95 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-30T18:39:47.905 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::3ce9:3cff:fea8:7a95/64 scope link 2023-11-30T18:39:47.905 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T18:39:47.906 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-30T18:39:47.906 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 32:bf:40:53:4c:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-30T18:39:47.906 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::30bf:40ff:fe53:4c5d/64 scope link 2023-11-30T18:39:47.906 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T18:39:47.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:39:47.906 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-30T18:39:47.967 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-11-30T18:39:47.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:39:47.969 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-11-30T18:39:48.027 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-11-30T18:39:48.027 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-30T18:39:48.027 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-30T18:39:48.027 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-30T18:39:48.027 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-30T18:39:48.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:39:48.027 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-11-30T18:39:48.027 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-11-30T18:39:48.028 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-30T18:39:48.028 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-30T18:39:48.028 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-30T18:39:48.028 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-11-30T18:39:48.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:39:48.312 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-11-30T18:39:48.329 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-30T18:39:48.330 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-30T18:39:48.330 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-30T18:39:48.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:39:48.330 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-11-30T18:39:48.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:39:48.395 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-11-30T18:39:48.450 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-30T18:39:48.450 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T18:39:48.530 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T18:39:48.531 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-30T18:39:48.555 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T18:39:48.556 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-30T18:39:48.558 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-30T18:39:48.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:39:48.558 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-30T18:39:48.624 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-30T18:39:48.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.781+0000 7fc584e37700 1 Processor -- start 2023-11-30T18:39:48.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.781+0000 7fc584e37700 1 -- start start 2023-11-30T18:39:48.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.782+0000 7fc584e37700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc5801350a0 0x7fc580135480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:48.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.782+0000 7fc584e37700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc580062700 0x7fc580062b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:48.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.782+0000 7fc584e37700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc58006a030 con 0x7fc580152aa0 2023-11-30T18:39:48.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.782+0000 7fc584e37700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5801537d0 con 0x7fc580062700 2023-11-30T18:39:48.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.782+0000 7fc584e37700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58006a4c0 con 0x7fc5801350a0 2023-11-30T18:39:48.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.782+0000 7fc57effd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc580062700 0x7fc580062b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:48.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.782+0000 7fc57ffff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc580152aa0 0x7fc580152f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58424/0 (socket says 172.21.15.49:58424) 2023-11-30T18:39:48.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.782+0000 7fc57ffff700 1 -- 172.21.15.49:0/3864694607 learned_addr learned my addr 172.21.15.49:0/3864694607 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:48.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.782+0000 7fc57f7fe700 1 --2- 172.21.15.49:0/3864694607 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc5801350a0 0x7fc580135480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:48.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.783+0000 7fc57effd700 1 -- 172.21.15.49:0/3864694607 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc5801350a0 msgr2=0x7fc580135480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:48.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.783+0000 7fc57effd700 1 --2- 172.21.15.49:0/3864694607 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc5801350a0 0x7fc580135480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:48.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.783+0000 7fc57effd700 1 -- 172.21.15.49:0/3864694607 >> v1:172.21.15.49:6789/0 conn(0x7fc580152aa0 legacy=0x7fc580152f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:48.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.783+0000 7fc57e7fc700 1 -- 172.21.15.49:0/3864694607 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781962840 0 0) 0x7fc58006a030 con 0x7fc580152aa0 2023-11-30T18:39:48.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.783+0000 7fc57effd700 1 -- 172.21.15.49:0/3864694607 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5800c2d30 con 0x7fc580062700 2023-11-30T18:39:48.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.783+0000 7fc57effd700 1 --2- 172.21.15.49:0/3864694607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc580062700 0x7fc580062b80 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 rx=0x7fc574009790 tx=0x7fc574009060).ready entity=mon.0 client_cookie=947875c78f198601 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:48.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.783+0000 7fc57e7fc700 1 -- 172.21.15.49:0/3864694607 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57400b580 con 0x7fc580062700 2023-11-30T18:39:48.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.783+0000 7fc57e7fc700 1 -- 172.21.15.49:0/3864694607 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57400b6e0 con 0x7fc580062700 2023-11-30T18:39:48.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.783+0000 7fc57e7fc700 1 -- 172.21.15.49:0/3864694607 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57400ba60 con 0x7fc580062700 2023-11-30T18:39:48.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.783+0000 7fc584e37700 1 -- 172.21.15.49:0/3864694607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc580062700 msgr2=0x7fc580062b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:48.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.783+0000 7fc584e37700 1 --2- 172.21.15.49:0/3864694607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc580062700 0x7fc580062b80 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 rx=0x7fc574009790 tx=0x7fc574009060).stop 2023-11-30T18:39:48.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.783+0000 7fc584e37700 1 -- 172.21.15.49:0/3864694607 shutdown_connections 2023-11-30T18:39:48.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.783+0000 7fc584e37700 1 --2- 172.21.15.49:0/3864694607 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc5801350a0 0x7fc580135480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:48.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.783+0000 7fc584e37700 1 --2- 172.21.15.49:0/3864694607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc580062700 0x7fc580062b80 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:48.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.783+0000 7fc584e37700 1 -- 172.21.15.49:0/3864694607 >> 172.21.15.49:0/3864694607 conn(0x7fc580064320 msgr2=0x7fc5800c7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:48.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.784+0000 7fc584e37700 1 -- 172.21.15.49:0/3864694607 shutdown_connections 2023-11-30T18:39:48.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.784+0000 7fc584e37700 1 -- 172.21.15.49:0/3864694607 wait complete. 2023-11-30T18:39:48.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.785+0000 7fc584e37700 1 Processor -- start 2023-11-30T18:39:48.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.785+0000 7fc584e37700 1 -- start start 2023-11-30T18:39:48.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.785+0000 7fc584e37700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc580062700 0x7fc580167210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:48.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.786+0000 7fc584e37700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5801350a0 0x7fc5800a93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:48.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.786+0000 7fc584e37700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc580152aa0 0x7fc580167b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:48.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.786+0000 7fc584e37700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58014ce70 con 0x7fc580152aa0 2023-11-30T18:39:48.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.786+0000 7fc584e37700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5800a9e30 con 0x7fc5801350a0 2023-11-30T18:39:48.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.786+0000 7fc584e37700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5800aa110 con 0x7fc580062700 2023-11-30T18:39:48.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.786+0000 7fc57ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc580152aa0 0x7fc580167b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:48.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.786+0000 7fc57ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc580152aa0 0x7fc580167b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59974/0 (socket says 172.21.15.49:59974) 2023-11-30T18:39:48.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.786+0000 7fc57ffff700 1 -- 172.21.15.49:0/825344167 learned_addr learned my addr 172.21.15.49:0/825344167 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:48.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.786+0000 7fc57f7fe700 1 --2- 172.21.15.49:0/825344167 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc580062700 0x7fc580167210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:48.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.786+0000 7fc57effd700 1 --2- 172.21.15.49:0/825344167 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5801350a0 0x7fc5800a93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:48.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.786+0000 7fc57ffff700 1 -- 172.21.15.49:0/825344167 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc580062700 msgr2=0x7fc580167210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:48.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.786+0000 7fc57ffff700 1 --2- 172.21.15.49:0/825344167 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc580062700 0x7fc580167210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:48.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.786+0000 7fc57ffff700 1 -- 172.21.15.49:0/825344167 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5801350a0 msgr2=0x7fc5800a93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:48.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.786+0000 7fc57ffff700 1 --2- 172.21.15.49:0/825344167 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5801350a0 0x7fc5800a93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:48.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.786+0000 7fc57ffff700 1 -- 172.21.15.49:0/825344167 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5740092a0 con 0x7fc580152aa0 2023-11-30T18:39:48.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.786+0000 7fc57effd700 1 --2- 172.21.15.49:0/825344167 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5801350a0 0x7fc5800a93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:39:48.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.786+0000 7fc57f7fe700 1 --2- 172.21.15.49:0/825344167 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc580062700 0x7fc580167210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:39:48.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.786+0000 7fc57ffff700 1 --2- 172.21.15.49:0/825344167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc580152aa0 0x7fc580167b40 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7fc57800c730 tx=0x7fc578001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:48.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.786+0000 7fc5677fe700 1 -- 172.21.15.49:0/825344167 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc578005d30 con 0x7fc580152aa0 2023-11-30T18:39:48.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.786+0000 7fc5677fe700 1 -- 172.21.15.49:0/825344167 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc578005e90 con 0x7fc580152aa0 2023-11-30T18:39:48.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.786+0000 7fc584e37700 1 -- 172.21.15.49:0/825344167 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5800c5fd0 con 0x7fc580152aa0 2023-11-30T18:39:48.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.786+0000 7fc5677fe700 1 -- 172.21.15.49:0/825344167 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc578007340 con 0x7fc580152aa0 2023-11-30T18:39:48.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.786+0000 7fc584e37700 1 -- 172.21.15.49:0/825344167 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5800a5e70 con 0x7fc580152aa0 2023-11-30T18:39:48.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.787+0000 7fc584e37700 1 -- 172.21.15.49:0/825344167 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5800c5e30 con 0x7fc580152aa0 2023-11-30T18:39:48.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.788+0000 7fc5677fe700 1 -- 172.21.15.49:0/825344167 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc5780076f0 con 0x7fc580152aa0 2023-11-30T18:39:48.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.788+0000 7fc5677fe700 1 --2- 172.21.15.49:0/825344167 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc56c05f270 0x7fc56c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:48.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.788+0000 7fc5677fe700 1 -- 172.21.15.49:0/825344167 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6205+0+0 (secure 0 0 0) 0x7fc57807a460 con 0x7fc580152aa0 2023-11-30T18:39:48.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.788+0000 7fc57f7fe700 1 --2- 172.21.15.49:0/825344167 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc56c05f270 0x7fc56c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:48.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.789+0000 7fc57f7fe700 1 --2- 172.21.15.49:0/825344167 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc56c05f270 0x7fc56c061730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fc57000bb60 tx=0x7fc570008040).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:48.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.792+0000 7fc5677fe700 1 -- 172.21.15.49:0/825344167 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc5800c5e30 con 0x7fc580152aa0 2023-11-30T18:39:48.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.993+0000 7fc584e37700 1 -- 172.21.15.49:0/825344167 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5800c5e30 con 0x7fc56c05f270 2023-11-30T18:39:48.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.995+0000 7fc5677fe700 1 -- 172.21.15.49:0/825344167 <== mgr.7760 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fc5800c5e30 con 0x7fc56c05f270 2023-11-30T18:39:48.997 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-11-30T18:39:48.997 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:39:48.997 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cephfs" 2023-11-30T18:39:48.997 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:39:48.997 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-11-30T18:39:48.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.997+0000 7fc584e37700 1 -- 172.21.15.49:0/825344167 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc56c05f270 msgr2=0x7fc56c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:48.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.997+0000 7fc584e37700 1 --2- 172.21.15.49:0/825344167 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc56c05f270 0x7fc56c061730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fc57000bb60 tx=0x7fc570008040).stop 2023-11-30T18:39:48.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.997+0000 7fc584e37700 1 -- 172.21.15.49:0/825344167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc580152aa0 msgr2=0x7fc580167b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:48.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.997+0000 7fc584e37700 1 --2- 172.21.15.49:0/825344167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc580152aa0 0x7fc580167b40 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7fc57800c730 tx=0x7fc578001520).stop 2023-11-30T18:39:48.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.997+0000 7fc584e37700 1 -- 172.21.15.49:0/825344167 shutdown_connections 2023-11-30T18:39:48.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.997+0000 7fc584e37700 1 --2- 172.21.15.49:0/825344167 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc56c05f270 0x7fc56c061730 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:48.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.997+0000 7fc584e37700 1 --2- 172.21.15.49:0/825344167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc580152aa0 0x7fc580167b40 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:48.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.997+0000 7fc584e37700 1 --2- 172.21.15.49:0/825344167 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc580062700 0x7fc580167210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:48.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.997+0000 7fc584e37700 1 --2- 172.21.15.49:0/825344167 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5801350a0 0x7fc5800a93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:48.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.997+0000 7fc584e37700 1 -- 172.21.15.49:0/825344167 >> 172.21.15.49:0/825344167 conn(0x7fc580064320 msgr2=0x7fc5800be5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:48.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.997+0000 7fc584e37700 1 -- 172.21.15.49:0/825344167 shutdown_connections 2023-11-30T18:39:48.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:48.997+0000 7fc584e37700 1 -- 172.21.15.49:0/825344167 wait complete. 2023-11-30T18:39:49.011 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-11-30T18:39:49.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.129+0000 7fb94d177700 1 Processor -- start 2023-11-30T18:39:49.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.129+0000 7fb94d177700 1 -- start start 2023-11-30T18:39:49.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.130+0000 7fb94d177700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9481587f0 0x7fb948063eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:49.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.130+0000 7fb94d177700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9480c0c80 con 0x7fb948098cc0 2023-11-30T18:39:49.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.130+0000 7fb94d177700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb948064be0 con 0x7fb948155ce0 2023-11-30T18:39:49.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.130+0000 7fb94d177700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb948064ec0 con 0x7fb9481587f0 2023-11-30T18:39:49.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.130+0000 7fb947fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb948098cc0 0x7fb9481580e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58432/0 (socket says 172.21.15.49:58432) 2023-11-30T18:39:49.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.130+0000 7fb947fff700 1 -- 172.21.15.49:0/1609868034 learned_addr learned my addr 172.21.15.49:0/1609868034 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:49.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.131+0000 7fb946ffd700 1 -- 172.21.15.49:0/1609868034 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1801587829 0 0) 0x7fb9480c0c80 con 0x7fb948098cc0 2023-11-30T18:39:49.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.131+0000 7fb946ffd700 1 -- 172.21.15.49:0/1609868034 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9300033f0 con 0x7fb948098cc0 2023-11-30T18:39:49.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.131+0000 7fb9477fe700 1 --2- 172.21.15.49:0/1609868034 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9481587f0 0x7fb948063eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:49.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.131+0000 7fb946ffd700 1 -- 172.21.15.49:0/1609868034 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2234205057 0 0) 0x7fb9300033f0 con 0x7fb948098cc0 2023-11-30T18:39:49.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.131+0000 7fb946ffd700 1 -- 172.21.15.49:0/1609868034 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9481587f0 msgr2=0x7fb948063eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:49.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.131+0000 7fb946ffd700 1 --2- 172.21.15.49:0/1609868034 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9481587f0 0x7fb948063eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:49.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.131+0000 7fb946ffd700 1 -- 172.21.15.49:0/1609868034 >> v1:172.21.15.115:6789/0 conn(0x7fb948155ce0 legacy=0x7fb9480643a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:49.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.131+0000 7fb946ffd700 1 -- 172.21.15.49:0/1609868034 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9480c0630 con 0x7fb948098cc0 2023-11-30T18:39:49.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.131+0000 7fb946ffd700 1 -- 172.21.15.49:0/1609868034 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fb938001470 con 0x7fb948098cc0 2023-11-30T18:39:49.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.131+0000 7fb946ffd700 1 -- 172.21.15.49:0/1609868034 >> v1:172.21.15.49:6789/0 conn(0x7fb948098cc0 legacy=0x7fb9481580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:49.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.131+0000 7fb946ffd700 1 --2- 172.21.15.49:0/1609868034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb930003910 0x7fb930003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:49.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.131+0000 7fb946ffd700 1 --2- 172.21.15.49:0/1609868034 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9481587f0 0x7fb930004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:49.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.131+0000 7fb946ffd700 1 --2- 172.21.15.49:0/1609868034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb930004b80 0x7fb930005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:49.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.131+0000 7fb946ffd700 1 -- 172.21.15.49:0/1609868034 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb948064ec0 con 0x7fb930004b80 2023-11-30T18:39:49.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.131+0000 7fb946ffd700 1 -- 172.21.15.49:0/1609868034 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93000ba30 con 0x7fb930003910 2023-11-30T18:39:49.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.131+0000 7fb946ffd700 1 -- 172.21.15.49:0/1609868034 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93000bbf0 con 0x7fb9481587f0 2023-11-30T18:39:49.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.131+0000 7fb94c976700 1 --2- 172.21.15.49:0/1609868034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb930004b80 0x7fb930005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:49.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.131+0000 7fb9477fe700 1 --2- 172.21.15.49:0/1609868034 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9481587f0 0x7fb930004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:49.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.131+0000 7fb947fff700 1 --2- 172.21.15.49:0/1609868034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb930003910 0x7fb930003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:49.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.131+0000 7fb94c976700 1 -- 172.21.15.49:0/1609868034 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9481587f0 msgr2=0x7fb930004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:49.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.131+0000 7fb94c976700 1 --2- 172.21.15.49:0/1609868034 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9481587f0 0x7fb930004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:49.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.131+0000 7fb94c976700 1 -- 172.21.15.49:0/1609868034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb930003910 msgr2=0x7fb930003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:49.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.131+0000 7fb94c976700 1 --2- 172.21.15.49:0/1609868034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb930003910 0x7fb930003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:49.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.131+0000 7fb94c976700 1 -- 172.21.15.49:0/1609868034 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9300033f0 con 0x7fb930004b80 2023-11-30T18:39:49.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.132+0000 7fb94c976700 1 --2- 172.21.15.49:0/1609868034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb930004b80 0x7fb930005000 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 rx=0x7fb9480c2140 tx=0x7fb940007f30).ready entity=mon.0 client_cookie=76898820a46bbcba server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:49.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.132+0000 7fb946ffd700 1 -- 172.21.15.49:0/1609868034 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb940006a20 con 0x7fb930004b80 2023-11-30T18:39:49.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.132+0000 7fb946ffd700 1 -- 172.21.15.49:0/1609868034 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb940006b80 con 0x7fb930004b80 2023-11-30T18:39:49.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.132+0000 7fb946ffd700 1 -- 172.21.15.49:0/1609868034 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94000c5d0 con 0x7fb930004b80 2023-11-30T18:39:49.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.132+0000 7fb94d177700 1 -- 172.21.15.49:0/1609868034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb930004b80 msgr2=0x7fb930005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:49.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.132+0000 7fb94d177700 1 --2- 172.21.15.49:0/1609868034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb930004b80 0x7fb930005000 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 rx=0x7fb9480c2140 tx=0x7fb940007f30).stop 2023-11-30T18:39:49.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.132+0000 7fb94c976700 1 -- 172.21.15.49:0/1609868034 reap_dead start 2023-11-30T18:39:49.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.132+0000 7fb94d177700 1 -- 172.21.15.49:0/1609868034 shutdown_connections 2023-11-30T18:39:49.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.132+0000 7fb94d177700 1 -- 172.21.15.49:0/1609868034 >> 172.21.15.49:0/1609868034 conn(0x7fb9480cb0f0 msgr2=0x7fb9480cb500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:49.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.132+0000 7fb94d177700 1 -- 172.21.15.49:0/1609868034 shutdown_connections 2023-11-30T18:39:49.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.132+0000 7fb94d177700 1 -- 172.21.15.49:0/1609868034 wait complete. 2023-11-30T18:39:49.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.133+0000 7fb94d177700 1 Processor -- start 2023-11-30T18:39:49.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.133+0000 7fb94d177700 1 -- start start 2023-11-30T18:39:49.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.134+0000 7fb94d177700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9480ad380 0x7fb948164290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:49.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.134+0000 7fb94d177700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9480c7ad0 0x7fb9480c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:49.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.134+0000 7fb94d177700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9480c2200 0x7fb9480c2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:49.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.134+0000 7fb94d177700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9480ad760 con 0x7fb9480c7ad0 2023-11-30T18:39:49.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.134+0000 7fb94d177700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9480c8440 con 0x7fb9480c2200 2023-11-30T18:39:49.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.134+0000 7fb94d177700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9480c4390 con 0x7fb9480ad380 2023-11-30T18:39:49.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.134+0000 7fb9477fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9480c7ad0 0x7fb9480c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:49.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.134+0000 7fb9477fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9480c7ad0 0x7fb9480c7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59998/0 (socket says 172.21.15.49:59998) 2023-11-30T18:39:49.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.134+0000 7fb9477fe700 1 -- 172.21.15.49:0/2602536518 learned_addr learned my addr 172.21.15.49:0/2602536518 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:49.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.135+0000 7fb947fff700 1 --2- 172.21.15.49:0/2602536518 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9480ad380 0x7fb948164290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:49.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.135+0000 7fb9477fe700 1 -- 172.21.15.49:0/2602536518 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9480ad380 msgr2=0x7fb948164290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:49.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.135+0000 7fb9477fe700 1 --2- 172.21.15.49:0/2602536518 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9480ad380 0x7fb948164290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:49.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.135+0000 7fb9477fe700 1 -- 172.21.15.49:0/2602536518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9480c2200 msgr2=0x7fb9480c2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:49.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.135+0000 7fb9477fe700 1 --2- 172.21.15.49:0/2602536518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9480c2200 0x7fb9480c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:39:49.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.135+0000 7fb9477fe700 1 -- 172.21.15.49:0/2602536518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb948164780 con 0x7fb9480c7ad0 2023-11-30T18:39:49.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.135+0000 7fb9477fe700 1 --2- 172.21.15.49:0/2602536518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9480c7ad0 0x7fb9480c7f50 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 rx=0x7fb93c010980 tx=0x7fb93c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:49.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.135+0000 7fb92ffff700 1 -- 172.21.15.49:0/2602536518 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93c010ec0 con 0x7fb9480c7ad0 2023-11-30T18:39:49.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.135+0000 7fb92ffff700 1 -- 172.21.15.49:0/2602536518 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93c00e8d0 con 0x7fb9480c7ad0 2023-11-30T18:39:49.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.135+0000 7fb94d177700 1 -- 172.21.15.49:0/2602536518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9480c4630 con 0x7fb9480c7ad0 2023-11-30T18:39:49.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.135+0000 7fb92ffff700 1 -- 172.21.15.49:0/2602536518 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93c00ec50 con 0x7fb9480c7ad0 2023-11-30T18:39:49.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.135+0000 7fb94d177700 1 -- 172.21.15.49:0/2602536518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9480c4bf0 con 0x7fb9480c7ad0 2023-11-30T18:39:49.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.136+0000 7fb94d177700 1 -- 172.21.15.49:0/2602536518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94806c7c0 con 0x7fb9480c7ad0 2023-11-30T18:39:49.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.136+0000 7fb92ffff700 1 -- 172.21.15.49:0/2602536518 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 90) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb93c014680 con 0x7fb9480c7ad0 2023-11-30T18:39:49.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.137+0000 7fb92ffff700 1 --2- 172.21.15.49:0/2602536518 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fb93405f270 0x7fb934061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:49.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.137+0000 7fb92ffff700 1 -- 172.21.15.49:0/2602536518 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6205+0+0 (secure 0 0 0) 0x7fb93c07a590 con 0x7fb9480c7ad0 2023-11-30T18:39:49.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.137+0000 7fb947fff700 1 --2- 172.21.15.49:0/2602536518 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fb93405f270 0x7fb934061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:49.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.137+0000 7fb947fff700 1 --2- 172.21.15.49:0/2602536518 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fb93405f270 0x7fb934061730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fb938000e10 tx=0x7fb938009040).ready entity=mgr.7760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:49.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.141+0000 7fb92ffff700 1 -- 172.21.15.49:0/2602536518 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb93c04b690 con 0x7fb9480c7ad0 2023-11-30T18:39:49.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.362+0000 7fb94d177700 1 -- 172.21.15.49:0/2602536518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fb948062cd0 con 0x7fb9480c7ad0 2023-11-30T18:39:49.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.926+0000 7fb92ffff700 1 -- 172.21.15.49:0/2602536518 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 91) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fb93c078190 con 0x7fb9480c7ad0 2023-11-30T18:39:49.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.928+0000 7fb92ffff700 1 -- 172.21.15.49:0/2602536518 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v91) v1 ==== 92+0+0 (secure 0 0 0) 0x7fb93c072190 con 0x7fb9480c7ad0 2023-11-30T18:39:49.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.930+0000 7fb94d177700 1 -- 172.21.15.49:0/2602536518 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fb93405f270 msgr2=0x7fb934061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:49.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.930+0000 7fb94d177700 1 --2- 172.21.15.49:0/2602536518 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fb93405f270 0x7fb934061730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fb938000e10 tx=0x7fb938009040).stop 2023-11-30T18:39:49.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.930+0000 7fb94d177700 1 -- 172.21.15.49:0/2602536518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9480c7ad0 msgr2=0x7fb9480c7f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:49.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.930+0000 7fb94d177700 1 --2- 172.21.15.49:0/2602536518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9480c7ad0 0x7fb9480c7f50 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 rx=0x7fb93c010980 tx=0x7fb93c008040).stop 2023-11-30T18:39:49.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.930+0000 7fb94d177700 1 -- 172.21.15.49:0/2602536518 shutdown_connections 2023-11-30T18:39:49.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.930+0000 7fb94d177700 1 --2- 172.21.15.49:0/2602536518 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fb93405f270 0x7fb934061730 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:49.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.930+0000 7fb94d177700 1 --2- 172.21.15.49:0/2602536518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9480c2200 0x7fb9480c2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:39:49.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.930+0000 7fb94d177700 1 --2- 172.21.15.49:0/2602536518 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9480ad380 0x7fb948164290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:49.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.930+0000 7fb94d177700 1 --2- 172.21.15.49:0/2602536518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9480c7ad0 0x7fb9480c7f50 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:49.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.930+0000 7fb94d177700 1 -- 172.21.15.49:0/2602536518 >> 172.21.15.49:0/2602536518 conn(0x7fb9480cb0f0 msgr2=0x7fb948152ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:49.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.930+0000 7fb94d177700 1 -- 172.21.15.49:0/2602536518 shutdown_connections 2023-11-30T18:39:49.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:49.930+0000 7fb94d177700 1 -- 172.21.15.49:0/2602536518 wait complete. 2023-11-30T18:39:49.945 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-11-30T18:39:50.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.068+0000 7f4d8be78700 1 Processor -- start 2023-11-30T18:39:50.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.068+0000 7f4d8be78700 1 -- start start 2023-11-30T18:39:50.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.069+0000 7f4d8be78700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d84158a30 0x7f4d840c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:50.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.069+0000 7f4d8be78700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d840c72d0 con 0x7f4d84098d10 2023-11-30T18:39:50.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.069+0000 7f4d8be78700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d84064570 con 0x7f4d840c6190 2023-11-30T18:39:50.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.069+0000 7f4d8be78700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d84154bc0 con 0x7f4d84158a30 2023-11-30T18:39:50.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.069+0000 7f4d89c14700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4d84098d10 0x7f4d84063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58452/0 (socket says 172.21.15.49:58452) 2023-11-30T18:39:50.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.069+0000 7f4d89c14700 1 -- 172.21.15.49:0/739536271 learned_addr learned my addr 172.21.15.49:0/739536271 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:50.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.069+0000 7f4d8a415700 1 --2- 172.21.15.49:0/739536271 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d84158a30 0x7f4d840c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:50.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.069+0000 7f4d88c12700 1 -- 172.21.15.49:0/739536271 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3765133857 0 0) 0x7f4d840c72d0 con 0x7f4d84098d10 2023-11-30T18:39:50.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.069+0000 7f4d88c12700 1 -- 172.21.15.49:0/739536271 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d700033f0 con 0x7f4d84098d10 2023-11-30T18:39:50.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.069+0000 7f4d88c12700 1 -- 172.21.15.49:0/739536271 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438232020 0 0) 0x7f4d84064570 con 0x7f4d840c6190 2023-11-30T18:39:50.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.069+0000 7f4d88c12700 1 -- 172.21.15.49:0/739536271 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d840c72d0 con 0x7f4d840c6190 2023-11-30T18:39:50.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.069+0000 7f4d8a415700 1 -- 172.21.15.49:0/739536271 >> v1:172.21.15.115:6789/0 conn(0x7f4d840c6190 legacy=0x7f4d84158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:50.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.069+0000 7f4d8a415700 1 -- 172.21.15.49:0/739536271 >> v1:172.21.15.49:6789/0 conn(0x7f4d84098d10 legacy=0x7f4d84063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:50.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.069+0000 7f4d8a415700 1 -- 172.21.15.49:0/739536271 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d840c66c0 con 0x7f4d84158a30 2023-11-30T18:39:50.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.069+0000 7f4d8a415700 1 --2- 172.21.15.49:0/739536271 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d84158a30 0x7f4d840c7760 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f4d7c009e90 tx=0x7f4d7c009780).ready entity=mon.2 client_cookie=8d0037785e750e82 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:50.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.070+0000 7f4d88c12700 1 -- 172.21.15.49:0/739536271 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c00e070 con 0x7f4d84158a30 2023-11-30T18:39:50.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.070+0000 7f4d88c12700 1 -- 172.21.15.49:0/739536271 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7c00bab0 con 0x7f4d84158a30 2023-11-30T18:39:50.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.070+0000 7f4d88c12700 1 -- 172.21.15.49:0/739536271 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c00be30 con 0x7f4d84158a30 2023-11-30T18:39:50.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.070+0000 7f4d8be78700 1 -- 172.21.15.49:0/739536271 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d84158a30 msgr2=0x7f4d840c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:50.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.070+0000 7f4d8be78700 1 --2- 172.21.15.49:0/739536271 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d84158a30 0x7f4d840c7760 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f4d7c009e90 tx=0x7f4d7c009780).stop 2023-11-30T18:39:50.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.070+0000 7f4d8be78700 1 -- 172.21.15.49:0/739536271 shutdown_connections 2023-11-30T18:39:50.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.070+0000 7f4d8be78700 1 --2- 172.21.15.49:0/739536271 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d84158a30 0x7f4d840c7760 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:50.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.070+0000 7f4d8be78700 1 -- 172.21.15.49:0/739536271 >> 172.21.15.49:0/739536271 conn(0x7f4d840cb310 msgr2=0x7f4d840cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:50.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.070+0000 7f4d8be78700 1 -- 172.21.15.49:0/739536271 shutdown_connections 2023-11-30T18:39:50.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.070+0000 7f4d8be78700 1 -- 172.21.15.49:0/739536271 wait complete. 2023-11-30T18:39:50.075 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:50.069+0000 7fed21885680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T18:39:50.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.072+0000 7f4d8be78700 1 Processor -- start 2023-11-30T18:39:50.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.072+0000 7f4d8be78700 1 -- start start 2023-11-30T18:39:50.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.072+0000 7f4d8be78700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d84098d10 0x7f4d84150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:50.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.072+0000 7f4d8be78700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d840c6190 0x7f4d84154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:50.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.072+0000 7f4d8be78700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d84158a30 0x7f4d841551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:50.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.072+0000 7f4d8be78700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d84156020 con 0x7f4d840c6190 2023-11-30T18:39:50.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.072+0000 7f4d8be78700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d840b0450 con 0x7f4d84158a30 2023-11-30T18:39:50.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.072+0000 7f4d8be78700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d840b06e0 con 0x7f4d84098d10 2023-11-30T18:39:50.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.073+0000 7f4d89413700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d840c6190 0x7f4d84154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:50.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.073+0000 7f4d89c14700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d84098d10 0x7f4d84150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:50.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.073+0000 7f4d89413700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d840c6190 0x7f4d84154d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60012/0 (socket says 172.21.15.49:60012) 2023-11-30T18:39:50.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.073+0000 7f4d89413700 1 -- 172.21.15.49:0/3319669993 learned_addr learned my addr 172.21.15.49:0/3319669993 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:50.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.073+0000 7f4d8a415700 1 --2- 172.21.15.49:0/3319669993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d84158a30 0x7f4d841551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:50.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.073+0000 7f4d89413700 1 -- 172.21.15.49:0/3319669993 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d84098d10 msgr2=0x7f4d84150820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:50.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.073+0000 7f4d89413700 1 --2- 172.21.15.49:0/3319669993 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d84098d10 0x7f4d84150820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:50.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.073+0000 7f4d89413700 1 -- 172.21.15.49:0/3319669993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d84158a30 msgr2=0x7f4d841551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:50.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.073+0000 7f4d89413700 1 --2- 172.21.15.49:0/3319669993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d84158a30 0x7f4d841551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:50.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.073+0000 7f4d89413700 1 -- 172.21.15.49:0/3319669993 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7c009a20 con 0x7f4d840c6190 2023-11-30T18:39:50.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.073+0000 7f4d89413700 1 --2- 172.21.15.49:0/3319669993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d840c6190 0x7f4d84154d00 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 rx=0x7f4d8000c440 tx=0x7f4d80007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:50.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.073+0000 7f4d79ffb700 1 -- 172.21.15.49:0/3319669993 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d80012400 con 0x7f4d840c6190 2023-11-30T18:39:50.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.073+0000 7f4d79ffb700 1 -- 172.21.15.49:0/3319669993 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d80012560 con 0x7f4d840c6190 2023-11-30T18:39:50.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.073+0000 7f4d8be78700 1 -- 172.21.15.49:0/3319669993 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d840b09c0 con 0x7f4d840c6190 2023-11-30T18:39:50.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.073+0000 7f4d79ffb700 1 -- 172.21.15.49:0/3319669993 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d80012920 con 0x7f4d840c6190 2023-11-30T18:39:50.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.073+0000 7f4d8be78700 1 -- 172.21.15.49:0/3319669993 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d840b0f80 con 0x7f4d840c6190 2023-11-30T18:39:50.080 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:50.074+0000 7f7f7cb88680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T18:39:50.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.075+0000 7f4d8be78700 1 -- 172.21.15.49:0/3319669993 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d840c7ac0 con 0x7f4d840c6190 2023-11-30T18:39:50.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.075+0000 7f4d79ffb700 1 -- 172.21.15.49:0/3319669993 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 91) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f4d8001b3b0 con 0x7f4d840c6190 2023-11-30T18:39:50.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.075+0000 7f4d79ffb700 1 --2- 172.21.15.49:0/3319669993 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4d6805f2c0 0x7f4d68061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:50.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.075+0000 7f4d79ffb700 1 -- 172.21.15.49:0/3319669993 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6205+0+0 (secure 0 0 0) 0x7f4d80079c90 con 0x7f4d840c6190 2023-11-30T18:39:50.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.075+0000 7f4d89c14700 1 -- 172.21.15.49:0/3319669993 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4d6805f2c0 msgr2=0x7f4d68061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:39:50.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.075+0000 7f4d89c14700 1 --2- 172.21.15.49:0/3319669993 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4d6805f2c0 0x7f4d68061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:39:50.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.083+0000 7f4d79ffb700 1 -- 172.21.15.49:0/3319669993 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4d8004ad30 con 0x7f4d840c6190 2023-11-30T18:39:50.136 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:50.134+0000 7fed21885680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T18:39:50.145 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:50.144+0000 7f7f7cb88680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T18:39:50.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.259+0000 7f4d8be78700 1 -- 172.21.15.49:0/3319669993 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f4d840c2430 con 0x7f4d840c6190 2023-11-30T18:39:50.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.263+0000 7f4d79ffb700 1 -- 172.21.15.49:0/3319669993 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v39)=0 v39) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4d840c2430 con 0x7f4d840c6190 2023-11-30T18:39:50.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.265+0000 7f4d8be78700 1 -- 172.21.15.49:0/3319669993 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4d6805f2c0 msgr2=0x7f4d68061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:39:50.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.265+0000 7f4d8be78700 1 --2- 172.21.15.49:0/3319669993 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4d6805f2c0 0x7f4d68061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:39:50.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.265+0000 7f4d8be78700 1 -- 172.21.15.49:0/3319669993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d840c6190 msgr2=0x7f4d84154d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:50.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.265+0000 7f4d8be78700 1 --2- 172.21.15.49:0/3319669993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d840c6190 0x7f4d84154d00 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 rx=0x7f4d8000c440 tx=0x7f4d80007be0).stop 2023-11-30T18:39:50.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.265+0000 7f4d8be78700 1 -- 172.21.15.49:0/3319669993 shutdown_connections 2023-11-30T18:39:50.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.265+0000 7f4d8be78700 1 --2- 172.21.15.49:0/3319669993 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4d6805f2c0 0x7f4d68061780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:39:50.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.265+0000 7f4d8be78700 1 --2- 172.21.15.49:0/3319669993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d84158a30 0x7f4d841551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:50.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.265+0000 7f4d8be78700 1 --2- 172.21.15.49:0/3319669993 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d84098d10 0x7f4d84150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:50.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.265+0000 7f4d8be78700 1 --2- 172.21.15.49:0/3319669993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d840c6190 0x7f4d84154d00 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:50.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.265+0000 7f4d8be78700 1 -- 172.21.15.49:0/3319669993 >> 172.21.15.49:0/3319669993 conn(0x7f4d840cb310 msgr2=0x7f4d840ca9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:50.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.265+0000 7f4d8be78700 1 -- 172.21.15.49:0/3319669993 shutdown_connections 2023-11-30T18:39:50.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.265+0000 7f4d8be78700 1 -- 172.21.15.49:0/3319669993 wait complete. 2023-11-30T18:39:50.279 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:39:50.279 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-11-30T18:39:50.299 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-11-30T18:39:50.410 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:50.409+0000 7fed21885680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T18:39:50.438 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:50.437+0000 7f7f7cb88680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T18:39:50.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.462+0000 7f6dd0f9d700 1 Processor -- start 2023-11-30T18:39:50.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.462+0000 7f6dd0f9d700 1 -- start start 2023-11-30T18:39:50.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.463+0000 7f6dd0f9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6dcc13ab60 0x7f6dcc067780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:50.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.463+0000 7f6dd0f9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6dcc13af40 0x7f6dcc0bd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:50.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.463+0000 7f6dd0f9d700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dcc0bddb0 con 0x7f6dcc154fe0 2023-11-30T18:39:50.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.463+0000 7f6dd0f9d700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dcc067c70 con 0x7f6dcc13ab60 2023-11-30T18:39:50.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.463+0000 7f6dd0f9d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dcc0c3510 con 0x7f6dcc13af40 2023-11-30T18:39:50.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.464+0000 7f6dca59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6dcc13ab60 0x7f6dcc067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:50.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.464+0000 7f6dcad9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6dcc154fe0 0x7f6dcc069760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58454/0 (socket says 172.21.15.49:58454) 2023-11-30T18:39:50.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.464+0000 7f6dcad9d700 1 -- 172.21.15.49:0/603568526 learned_addr learned my addr 172.21.15.49:0/603568526 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:50.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.464+0000 7f6dc9d9b700 1 --2- 172.21.15.49:0/603568526 >> v2:172.21.15.115:3300/0 conn(0x7f6dcc13af40 0x7f6dcc0bd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:50.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.464+0000 7f6dca59c700 1 -- 172.21.15.49:0/603568526 >> v2:172.21.15.115:3300/0 conn(0x7f6dcc13af40 msgr2=0x7f6dcc0bd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:50.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.464+0000 7f6dca59c700 1 --2- 172.21.15.49:0/603568526 >> v2:172.21.15.115:3300/0 conn(0x7f6dcc13af40 0x7f6dcc0bd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:50.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.464+0000 7f6dca59c700 1 -- 172.21.15.49:0/603568526 >> v1:172.21.15.49:6789/0 conn(0x7f6dcc154fe0 legacy=0x7f6dcc069760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:50.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.464+0000 7f6dc959a700 1 -- 172.21.15.49:0/603568526 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3291301224 0 0) 0x7f6dcc0bddb0 con 0x7f6dcc154fe0 2023-11-30T18:39:50.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.464+0000 7f6dca59c700 1 -- 172.21.15.49:0/603568526 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc0bdfe0 con 0x7f6dcc13ab60 2023-11-30T18:39:50.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.464+0000 7f6dca59c700 1 --2- 172.21.15.49:0/603568526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dcc13ab60 0x7f6dcc067780 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 rx=0x7f6dcc1560f0 tx=0x7f6db4009060).ready entity=mon.0 client_cookie=b73435ddacaaf549 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:50.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.464+0000 7f6dc959a700 1 -- 172.21.15.49:0/603568526 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db400f510 con 0x7f6dcc13ab60 2023-11-30T18:39:50.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.464+0000 7f6dc959a700 1 -- 172.21.15.49:0/603568526 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db400f670 con 0x7f6dcc13ab60 2023-11-30T18:39:50.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.464+0000 7f6dc959a700 1 -- 172.21.15.49:0/603568526 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db400f9f0 con 0x7f6dcc13ab60 2023-11-30T18:39:50.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.465+0000 7f6dd0f9d700 1 -- 172.21.15.49:0/603568526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dcc13ab60 msgr2=0x7f6dcc067780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:50.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.465+0000 7f6dd0f9d700 1 --2- 172.21.15.49:0/603568526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dcc13ab60 0x7f6dcc067780 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 rx=0x7f6dcc1560f0 tx=0x7f6db4009060).stop 2023-11-30T18:39:50.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.465+0000 7f6dd0f9d700 1 -- 172.21.15.49:0/603568526 shutdown_connections 2023-11-30T18:39:50.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.465+0000 7f6dd0f9d700 1 --2- 172.21.15.49:0/603568526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dcc13ab60 0x7f6dcc067780 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:50.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.465+0000 7f6dd0f9d700 1 --2- 172.21.15.49:0/603568526 >> v2:172.21.15.115:3300/0 conn(0x7f6dcc13af40 0x7f6dcc0bd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:50.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.465+0000 7f6dd0f9d700 1 -- 172.21.15.49:0/603568526 >> 172.21.15.49:0/603568526 conn(0x7f6dcc063810 msgr2=0x7f6dcc063c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:50.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.465+0000 7f6dd0f9d700 1 -- 172.21.15.49:0/603568526 shutdown_connections 2023-11-30T18:39:50.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.465+0000 7f6dd0f9d700 1 -- 172.21.15.49:0/603568526 wait complete. 2023-11-30T18:39:50.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.466+0000 7f6dd0f9d700 1 Processor -- start 2023-11-30T18:39:50.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.466+0000 7f6dd0f9d700 1 -- start start 2023-11-30T18:39:50.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.467+0000 7f6dd0f9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dcc13ab60 0x7f6dcc0c7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:50.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.467+0000 7f6dd0f9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dcc13af40 0x7f6dcc0c0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:50.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.467+0000 7f6dd0f9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dcc154fe0 0x7f6dcc0c1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:50.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.467+0000 7f6dd0f9d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc0c1870 con 0x7f6dcc13af40 2023-11-30T18:39:50.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.467+0000 7f6dd0f9d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc0ac280 con 0x7f6dcc13ab60 2023-11-30T18:39:50.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.467+0000 7f6dd0f9d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc0c7fb0 con 0x7f6dcc154fe0 2023-11-30T18:39:50.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.467+0000 7f6dc9d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dcc13af40 0x7f6dcc0c0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:50.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.467+0000 7f6dc9d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dcc13af40 0x7f6dcc0c0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60030/0 (socket says 172.21.15.49:60030) 2023-11-30T18:39:50.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.467+0000 7f6dc9d9b700 1 -- 172.21.15.49:0/2718229046 learned_addr learned my addr 172.21.15.49:0/2718229046 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:50.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.467+0000 7f6dca59c700 1 --2- 172.21.15.49:0/2718229046 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dcc13ab60 0x7f6dcc0c7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:50.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.467+0000 7f6dcad9d700 1 --2- 172.21.15.49:0/2718229046 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dcc154fe0 0x7f6dcc0c1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:50.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.467+0000 7f6dc9d9b700 1 -- 172.21.15.49:0/2718229046 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dcc154fe0 msgr2=0x7f6dcc0c1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:50.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.467+0000 7f6dc9d9b700 1 --2- 172.21.15.49:0/2718229046 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dcc154fe0 0x7f6dcc0c1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:50.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.467+0000 7f6dc9d9b700 1 -- 172.21.15.49:0/2718229046 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dcc13ab60 msgr2=0x7f6dcc0c7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:50.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.467+0000 7f6dc9d9b700 1 --2- 172.21.15.49:0/2718229046 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dcc13ab60 0x7f6dcc0c7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:50.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.467+0000 7f6dc9d9b700 1 -- 172.21.15.49:0/2718229046 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db40092a0 con 0x7f6dcc13af40 2023-11-30T18:39:50.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.467+0000 7f6dcad9d700 1 --2- 172.21.15.49:0/2718229046 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dcc154fe0 0x7f6dcc0c1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:39:50.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.467+0000 7f6dc9d9b700 1 --2- 172.21.15.49:0/2718229046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dcc13af40 0x7f6dcc0c0e90 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 rx=0x7f6dbc00e930 tx=0x7f6dbc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:50.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.468+0000 7f6dc27fc700 1 -- 172.21.15.49:0/2718229046 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc00c670 con 0x7f6dcc13af40 2023-11-30T18:39:50.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.468+0000 7f6dc27fc700 1 -- 172.21.15.49:0/2718229046 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc00c7d0 con 0x7f6dcc13af40 2023-11-30T18:39:50.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.468+0000 7f6dd0f9d700 1 -- 172.21.15.49:0/2718229046 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dcc0c8290 con 0x7f6dcc13af40 2023-11-30T18:39:50.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.468+0000 7f6dc27fc700 1 -- 172.21.15.49:0/2718229046 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc00cb50 con 0x7f6dcc13af40 2023-11-30T18:39:50.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.468+0000 7f6dd0f9d700 1 -- 172.21.15.49:0/2718229046 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dcc0abea0 con 0x7f6dcc13af40 2023-11-30T18:39:50.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.469+0000 7f6dd0f9d700 1 -- 172.21.15.49:0/2718229046 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dcc0ac410 con 0x7f6dcc13af40 2023-11-30T18:39:50.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.469+0000 7f6dc27fc700 1 -- 172.21.15.49:0/2718229046 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 91) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f6dbc01b400 con 0x7f6dcc13af40 2023-11-30T18:39:50.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.469+0000 7f6dc27fc700 1 --2- 172.21.15.49:0/2718229046 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f6dac05f2c0 0x7f6dac061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:50.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.470+0000 7f6dc27fc700 1 -- 172.21.15.49:0/2718229046 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6205+0+0 (secure 0 0 0) 0x7f6dbc07a900 con 0x7f6dcc13af40 2023-11-30T18:39:50.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.470+0000 7f6dca59c700 1 -- 172.21.15.49:0/2718229046 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f6dac05f2c0 msgr2=0x7f6dac061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:39:50.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.470+0000 7f6dca59c700 1 --2- 172.21.15.49:0/2718229046 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f6dac05f2c0 0x7f6dac061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:39:50.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.474+0000 7f6dc27fc700 1 -- 172.21.15.49:0/2718229046 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6dbc04b9a0 con 0x7f6dcc13af40 2023-11-30T18:39:50.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.671+0000 7f6dca59c700 1 -- 172.21.15.49:0/2718229046 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f6dac05f2c0 msgr2=0x7f6dac061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:39:50.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.671+0000 7f6dca59c700 1 --2- 172.21.15.49:0/2718229046 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f6dac05f2c0 0x7f6dac061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T18:39:50.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:50.677+0000 7f6dd0f9d700 1 -- 172.21.15.49:0/2718229046 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6dcc0be2c0 con 0x7f6dac05f2c0 2023-11-30T18:39:51.021 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:51.019+0000 7fed21885680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T18:39:51.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:51.072+0000 7f6dca59c700 1 -- 172.21.15.49:0/2718229046 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f6dac05f2c0 msgr2=0x7f6dac061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:39:51.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:51.072+0000 7f6dca59c700 1 --2- 172.21.15.49:0/2718229046 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f6dac05f2c0 0x7f6dac061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-11-30T18:39:51.093 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:51.091+0000 7fed21885680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T18:39:51.108 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:51.106+0000 7f7f7cb88680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T18:39:51.177 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:51.175+0000 7f7f7cb88680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T18:39:51.278 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:51.276+0000 7fed21885680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T18:39:51.373 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:51.371+0000 7f7f7cb88680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T18:39:51.697 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:51.695+0000 7fed21885680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T18:39:51.800 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:51.799+0000 7fed21885680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:39:51.819 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:51.818+0000 7f7f7cb88680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T18:39:51.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:51.873+0000 7f6dca59c700 1 -- 172.21.15.49:0/2718229046 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f6dac05f2c0 msgr2=0x7f6dac061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:39:51.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:51.873+0000 7f6dca59c700 1 --2- 172.21.15.49:0/2718229046 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f6dac05f2c0 0x7f6dac061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-11-30T18:39:51.928 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:51.926+0000 7f7f7cb88680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:39:51.953 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:51.951+0000 7fed21885680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T18:39:52.027 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:52.025+0000 7fed21885680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T18:39:52.087 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:52.086+0000 7f7f7cb88680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T18:39:52.094 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:52.093+0000 7fed21885680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T18:39:52.165 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:52.164+0000 7f7f7cb88680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T18:39:52.236 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:52.234+0000 7f7f7cb88680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T18:39:52.352 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:52.350+0000 7fed21885680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T18:39:52.510 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:52.507+0000 7f7f7cb88680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T18:39:52.533 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:52.532+0000 7fed21885680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T18:39:52.701 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:52.699+0000 7f7f7cb88680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T18:39:53.183 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:53.181+0000 7fed21885680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T18:39:53.253 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:53.251+0000 7fed21885680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T18:39:53.328 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:53.326+0000 7fed21885680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T18:39:53.390 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:53.388+0000 7f7f7cb88680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T18:39:53.477 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:53.459+0000 7f7f7cb88680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T18:39:53.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:53.474+0000 7f6dca59c700 1 -- 172.21.15.49:0/2718229046 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f6dac05f2c0 msgr2=0x7f6dac061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:39:53.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:53.474+0000 7f6dca59c700 1 --2- 172.21.15.49:0/2718229046 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f6dac05f2c0 0x7f6dac061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-11-30T18:39:53.484 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:53.476+0000 7fed21885680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T18:39:53.541 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:53.539+0000 7f7f7cb88680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T18:39:53.551 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:53.548+0000 7fed21885680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T18:39:53.669 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:53.664+0000 7fed21885680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T18:39:53.695 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:53.693+0000 7f7f7cb88680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T18:39:53.773 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:53.768+0000 7f7f7cb88680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T18:39:53.777 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:53.773+0000 7fed21885680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:39:53.892 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:53.890+0000 7f7f7cb88680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T18:39:54.007 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:54.004+0000 7f7f7cb88680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:39:54.065 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:54.063+0000 7fed21885680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T18:39:54.137 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:54.135+0000 7fed21885680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T18:39:54.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:54.155+0000 7f6dc27fc700 1 -- 172.21.15.49:0/2718229046 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 92) v1 ==== 75287+0+0 (secure 0 0 0) 0x7f6dbc078500 con 0x7f6dcc13af40 2023-11-30T18:39:54.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:54.155+0000 7f6dc27fc700 1 -- 172.21.15.49:0/2718229046 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f6dac05f2c0 msgr2=0x7f6dac061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:39:54.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:54.155+0000 7f6dc27fc700 1 --2- 172.21.15.49:0/2718229046 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f6dac05f2c0 0x7f6dac061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:39:54.219 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:54.217+0000 7fec99011700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:39:54.219 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:54.217+0000 7fec99011700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:39:54.219 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:54.217+0000 7fec99011700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:39:54.219 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:54.217+0000 7fec99011700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:39:54.220 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:54.217+0000 7fec99011700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:39:54.220 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:54.217+0000 7fec9600b700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:39:54.220 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:54.217+0000 7fec9600b700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:39:54.220 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:54.217+0000 7fec9600b700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:39:54.220 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:54.217+0000 7fec9600b700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:39:54.220 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:39:54.217+0000 7fec9600b700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:39:54.315 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:54.313+0000 7f7f7cb88680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T18:39:54.389 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:39:54.388+0000 7f7f7cb88680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T18:39:55.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.157+0000 7f6dc27fc700 1 -- 172.21.15.49:0/2718229046 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mgrmap(e 93) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f6dbc078880 con 0x7f6dcc13af40 2023-11-30T18:39:55.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.158+0000 7f6dc27fc700 1 --2- 172.21.15.49:0/2718229046 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f6dac05f2c0 0x7f6dac061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:55.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.158+0000 7f6dc27fc700 1 -- 172.21.15.49:0/2718229046 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6dcc0be2c0 con 0x7f6dac05f2c0 2023-11-30T18:39:55.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.158+0000 7f6dca59c700 1 --2- 172.21.15.49:0/2718229046 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f6dac05f2c0 0x7f6dac061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:55.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.159+0000 7f6dca59c700 1 --2- 172.21.15.49:0/2718229046 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f6dac05f2c0 0x7f6dac061700 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f6dcc1560f0 tx=0x7f6db4017000).ready entity=mgr.9343 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:55.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.185+0000 7f6dc27fc700 1 -- 172.21.15.49:0/2718229046 <== mgr.9343 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6dcc0be2c0 con 0x7f6dac05f2c0 2023-11-30T18:39:55.187 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule set for path snap_test_dir1 2023-11-30T18:39:55.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.187+0000 7f6dd0f9d700 1 -- 172.21.15.49:0/2718229046 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f6dac05f2c0 msgr2=0x7f6dac061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:55.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.187+0000 7f6dd0f9d700 1 --2- 172.21.15.49:0/2718229046 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f6dac05f2c0 0x7f6dac061700 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f6dcc1560f0 tx=0x7f6db4017000).stop 2023-11-30T18:39:55.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.187+0000 7f6dd0f9d700 1 -- 172.21.15.49:0/2718229046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dcc13af40 msgr2=0x7f6dcc0c0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:55.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.187+0000 7f6dd0f9d700 1 --2- 172.21.15.49:0/2718229046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dcc13af40 0x7f6dcc0c0e90 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 rx=0x7f6dbc00e930 tx=0x7f6dbc009060).stop 2023-11-30T18:39:55.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.188+0000 7f6dd0f9d700 1 -- 172.21.15.49:0/2718229046 shutdown_connections 2023-11-30T18:39:55.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.188+0000 7f6dd0f9d700 1 --2- 172.21.15.49:0/2718229046 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f6dac05f2c0 0x7f6dac061700 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:55.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.188+0000 7f6dd0f9d700 1 --2- 172.21.15.49:0/2718229046 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dcc154fe0 0x7f6dcc0c1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:55.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.188+0000 7f6dd0f9d700 1 --2- 172.21.15.49:0/2718229046 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dcc13ab60 0x7f6dcc0c7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:55.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.188+0000 7f6dd0f9d700 1 --2- 172.21.15.49:0/2718229046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dcc13af40 0x7f6dcc0c0e90 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:55.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.188+0000 7f6dd0f9d700 1 -- 172.21.15.49:0/2718229046 >> 172.21.15.49:0/2718229046 conn(0x7f6dcc063810 msgr2=0x7f6dcc152760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:55.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.188+0000 7f6dd0f9d700 1 -- 172.21.15.49:0/2718229046 shutdown_connections 2023-11-30T18:39:55.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.188+0000 7f6dd0f9d700 1 -- 172.21.15.49:0/2718229046 wait complete. 2023-11-30T18:39:55.203 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-11-30T18:39:55.203 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-11-30T18:39:55.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.327+0000 7f03a80eb700 1 Processor -- start 2023-11-30T18:39:55.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.328+0000 7f03a80eb700 1 -- start start 2023-11-30T18:39:55.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.328+0000 7f03a80eb700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f03a00c6190 0x7f03a00c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:55.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.328+0000 7f03a80eb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03a0158320 0x7f03a01587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:55.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.328+0000 7f03a80eb700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a0158cc0 con 0x7f03a0098d10 2023-11-30T18:39:55.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.328+0000 7f03a80eb700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a00c72d0 con 0x7f03a00c6190 2023-11-30T18:39:55.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.328+0000 7f03a80eb700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a0064570 con 0x7f03a0158320 2023-11-30T18:39:55.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.329+0000 7f03a5686700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f03a00c6190 0x7f03a00c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:55.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.329+0000 7f03a5686700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f03a00c6190 0x7f03a00c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42368/0 (socket says 172.21.15.49:42368) 2023-11-30T18:39:55.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.329+0000 7f03a5686700 1 -- 172.21.15.49:0/217569275 learned_addr learned my addr 172.21.15.49:0/217569275 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:55.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.329+0000 7f03a6688700 1 --2- 172.21.15.49:0/217569275 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03a0158320 0x7f03a01587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:55.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.329+0000 7f03a5686700 1 -- 172.21.15.49:0/217569275 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03a0158320 msgr2=0x7f03a01587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:39:55.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.329+0000 7f03a5686700 1 --2- 172.21.15.49:0/217569275 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03a0158320 0x7f03a01587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:55.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.329+0000 7f03a5686700 1 -- 172.21.15.49:0/217569275 >> v1:172.21.15.115:6789/0 conn(0x7f03a0098d10 legacy=0x7f03a0063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:55.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.329+0000 7f03a5686700 1 -- 172.21.15.49:0/217569275 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a0154bc0 con 0x7f03a00c6190 2023-11-30T18:39:55.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.329+0000 7f03a4e85700 1 -- 172.21.15.49:0/217569275 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3651725070 0 0) 0x7f0398001110 con 0x7f03a0098d10 2023-11-30T18:39:55.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.329+0000 7f03a5686700 1 --2- 172.21.15.49:0/217569275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03a00c6190 0x7f03a00c7760 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 rx=0x7f0394006fd0 tx=0x7f03940090f0).ready entity=mon.0 client_cookie=8027e0137332cd7d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:55.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.329+0000 7f03a4e85700 1 -- 172.21.15.49:0/217569275 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039400b580 con 0x7f03a00c6190 2023-11-30T18:39:55.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.329+0000 7f03a4e85700 1 -- 172.21.15.49:0/217569275 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039400b6e0 con 0x7f03a00c6190 2023-11-30T18:39:55.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.329+0000 7f03a4e85700 1 -- 172.21.15.49:0/217569275 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039400ba60 con 0x7f03a00c6190 2023-11-30T18:39:55.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.330+0000 7f03a80eb700 1 -- 172.21.15.49:0/217569275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03a00c6190 msgr2=0x7f03a00c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:55.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.330+0000 7f03a80eb700 1 --2- 172.21.15.49:0/217569275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03a00c6190 0x7f03a00c7760 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 rx=0x7f0394006fd0 tx=0x7f03940090f0).stop 2023-11-30T18:39:55.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.330+0000 7f03a80eb700 1 -- 172.21.15.49:0/217569275 shutdown_connections 2023-11-30T18:39:55.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.330+0000 7f03a80eb700 1 --2- 172.21.15.49:0/217569275 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03a0158320 0x7f03a01587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:55.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.330+0000 7f03a80eb700 1 --2- 172.21.15.49:0/217569275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03a00c6190 0x7f03a00c7760 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:55.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.330+0000 7f03a80eb700 1 -- 172.21.15.49:0/217569275 >> 172.21.15.49:0/217569275 conn(0x7f03a00cb310 msgr2=0x7f03a00cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:55.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.330+0000 7f03a80eb700 1 -- 172.21.15.49:0/217569275 shutdown_connections 2023-11-30T18:39:55.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.330+0000 7f03a80eb700 1 -- 172.21.15.49:0/217569275 wait complete. 2023-11-30T18:39:55.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.331+0000 7f03a80eb700 1 Processor -- start 2023-11-30T18:39:55.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.331+0000 7f03a80eb700 1 -- start start 2023-11-30T18:39:55.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.332+0000 7f03a80eb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03a0098d10 0x7f03a00c2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:55.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.332+0000 7f03a80eb700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03a00c6190 0x7f03a013f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:55.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.332+0000 7f03a80eb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03a0158320 0x7f03a0142f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:55.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.332+0000 7f03a80eb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a01437e0 con 0x7f03a0158320 2023-11-30T18:39:55.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.332+0000 7f03a80eb700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a0143ac0 con 0x7f03a00c6190 2023-11-30T18:39:55.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.332+0000 7f03a80eb700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a0143da0 con 0x7f03a0098d10 2023-11-30T18:39:55.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.332+0000 7f03a6688700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03a0158320 0x7f03a0142f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:55.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.332+0000 7f03a6688700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03a0158320 0x7f03a0142f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42380/0 (socket says 172.21.15.49:42380) 2023-11-30T18:39:55.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.332+0000 7f03a6688700 1 -- 172.21.15.49:0/3345007038 learned_addr learned my addr 172.21.15.49:0/3345007038 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:55.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.332+0000 7f03a5686700 1 --2- 172.21.15.49:0/3345007038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03a00c6190 0x7f03a013f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:55.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.332+0000 7f03a5e87700 1 --2- 172.21.15.49:0/3345007038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03a0098d10 0x7f03a00c2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:55.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.332+0000 7f03a6688700 1 -- 172.21.15.49:0/3345007038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03a0098d10 msgr2=0x7f03a00c2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:55.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.332+0000 7f03a6688700 1 --2- 172.21.15.49:0/3345007038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03a0098d10 0x7f03a00c2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:55.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.332+0000 7f03a6688700 1 -- 172.21.15.49:0/3345007038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03a00c6190 msgr2=0x7f03a013f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:55.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.332+0000 7f03a6688700 1 --2- 172.21.15.49:0/3345007038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03a00c6190 0x7f03a013f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:55.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.332+0000 7f03a6688700 1 -- 172.21.15.49:0/3345007038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0394009370 con 0x7f03a0158320 2023-11-30T18:39:55.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.332+0000 7f03a6688700 1 --2- 172.21.15.49:0/3345007038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03a0158320 0x7f03a0142f90 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 rx=0x7f0390009df0 tx=0x7f039000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:55.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.333+0000 7f039dffb700 1 -- 172.21.15.49:0/3345007038 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039000caa0 con 0x7f03a0158320 2023-11-30T18:39:55.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.333+0000 7f039dffb700 1 -- 172.21.15.49:0/3345007038 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039000f040 con 0x7f03a0158320 2023-11-30T18:39:55.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.333+0000 7f03a80eb700 1 -- 172.21.15.49:0/3345007038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a0144080 con 0x7f03a0158320 2023-11-30T18:39:55.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.333+0000 7f039dffb700 1 -- 172.21.15.49:0/3345007038 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039000ce10 con 0x7f03a0158320 2023-11-30T18:39:55.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.333+0000 7f03a80eb700 1 -- 172.21.15.49:0/3345007038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a013f540 con 0x7f03a0158320 2023-11-30T18:39:55.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.334+0000 7f03a80eb700 1 -- 172.21.15.49:0/3345007038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a01445a0 con 0x7f03a0158320 2023-11-30T18:39:55.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.334+0000 7f039dffb700 1 -- 172.21.15.49:0/3345007038 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 93) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f0390013610 con 0x7f03a0158320 2023-11-30T18:39:55.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.335+0000 7f039dffb700 1 --2- 172.21.15.49:0/3345007038 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f038c05f0b0 0x7f038c061570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:55.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.335+0000 7f039dffb700 1 -- 172.21.15.49:0/3345007038 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f039007a780 con 0x7f03a0158320 2023-11-30T18:39:55.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.335+0000 7f03a5e87700 1 --2- 172.21.15.49:0/3345007038 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f038c05f0b0 0x7f038c061570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:55.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.335+0000 7f03a5e87700 1 --2- 172.21.15.49:0/3345007038 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f038c05f0b0 0x7f038c061570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f03a015ac80 tx=0x7f0398009040).ready entity=mgr.9343 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:55.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.339+0000 7f039dffb700 1 -- 172.21.15.49:0/3345007038 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f03a01445a0 con 0x7f03a0158320 2023-11-30T18:39:55.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.536+0000 7f03a80eb700 1 -- 172.21.15.49:0/3345007038 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f03a01445a0 con 0x7f038c05f0b0 2023-11-30T18:39:55.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.540+0000 7f039dffb700 1 -- 172.21.15.49:0/3345007038 <== mgr.9343 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7f03a01445a0 con 0x7f038c05f0b0 2023-11-30T18:39:55.542 INFO:teuthology.orchestra.run.smithi049.stdout:Retention added to path snap_test_dir1 2023-11-30T18:39:55.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.542+0000 7f03a80eb700 1 -- 172.21.15.49:0/3345007038 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f038c05f0b0 msgr2=0x7f038c061570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:55.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.542+0000 7f03a80eb700 1 --2- 172.21.15.49:0/3345007038 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f038c05f0b0 0x7f038c061570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f03a015ac80 tx=0x7f0398009040).stop 2023-11-30T18:39:55.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.542+0000 7f03a80eb700 1 -- 172.21.15.49:0/3345007038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03a0158320 msgr2=0x7f03a0142f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:55.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.542+0000 7f03a80eb700 1 --2- 172.21.15.49:0/3345007038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03a0158320 0x7f03a0142f90 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 rx=0x7f0390009df0 tx=0x7f039000b040).stop 2023-11-30T18:39:55.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.542+0000 7f03a80eb700 1 -- 172.21.15.49:0/3345007038 shutdown_connections 2023-11-30T18:39:55.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.542+0000 7f03a80eb700 1 --2- 172.21.15.49:0/3345007038 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f038c05f0b0 0x7f038c061570 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:55.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.542+0000 7f03a80eb700 1 --2- 172.21.15.49:0/3345007038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03a0158320 0x7f03a0142f90 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:55.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.542+0000 7f03a80eb700 1 --2- 172.21.15.49:0/3345007038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03a0098d10 0x7f03a00c2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:55.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.542+0000 7f03a80eb700 1 --2- 172.21.15.49:0/3345007038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03a00c6190 0x7f03a013f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:55.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.542+0000 7f03a80eb700 1 -- 172.21.15.49:0/3345007038 >> 172.21.15.49:0/3345007038 conn(0x7f03a00cb310 msgr2=0x7f03a00c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:55.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.542+0000 7f03a80eb700 1 -- 172.21.15.49:0/3345007038 shutdown_connections 2023-11-30T18:39:55.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.542+0000 7f03a80eb700 1 -- 172.21.15.49:0/3345007038 wait complete. 2023-11-30T18:39:55.556 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-11-30T18:39:55.557 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-11-30-18_40_00 in ~5s... 2023-11-30T18:39:55.557 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-11-30T18:39:55.557 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-11-30T18:39:55.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.676+0000 7f7123ac7700 1 Processor -- start 2023-11-30T18:39:55.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.677+0000 7f7123ac7700 1 -- start start 2023-11-30T18:39:55.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.677+0000 7f7123ac7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f711c0ab3b0 0x7f711c1582e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:55.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.677+0000 7f7123ac7700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f711c159210 con 0x7f711c0aa1c0 2023-11-30T18:39:55.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.677+0000 7f7123ac7700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f711c0c0c70 con 0x7f711c154610 2023-11-30T18:39:55.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.677+0000 7f7123ac7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711c158970 con 0x7f711c0ab3b0 2023-11-30T18:39:55.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.678+0000 7f7122064700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f711c0aa1c0 0x7f711c0c1100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46282/0 (socket says 172.21.15.49:46282) 2023-11-30T18:39:55.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.678+0000 7f7122064700 1 -- 172.21.15.49:0/2487022480 learned_addr learned my addr 172.21.15.49:0/2487022480 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:39:55.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.678+0000 7f7121062700 1 --2- 172.21.15.49:0/2487022480 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f711c0ab3b0 0x7f711c1582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:55.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.678+0000 7f7120861700 1 -- 172.21.15.49:0/2487022480 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 277046807 0 0) 0x7f711c159210 con 0x7f711c0aa1c0 2023-11-30T18:39:55.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.678+0000 7f7120861700 1 -- 172.21.15.49:0/2487022480 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71040033f0 con 0x7f711c0aa1c0 2023-11-30T18:39:55.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.678+0000 7f7120861700 1 -- 172.21.15.49:0/2487022480 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 733334855 0 0) 0x7f711c0c0c70 con 0x7f711c154610 2023-11-30T18:39:55.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.678+0000 7f7120861700 1 -- 172.21.15.49:0/2487022480 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f711c159210 con 0x7f711c154610 2023-11-30T18:39:55.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.678+0000 7f7121062700 1 -- 172.21.15.49:0/2487022480 >> v1:172.21.15.115:6789/0 conn(0x7f711c154610 legacy=0x7f711c0c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:55.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.678+0000 7f7121062700 1 -- 172.21.15.49:0/2487022480 >> v1:172.21.15.49:6789/0 conn(0x7f711c0aa1c0 legacy=0x7f711c0c1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:55.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.678+0000 7f7120861700 1 -- 172.21.15.49:0/2487022480 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3134640464 0 0) 0x7f71040033f0 con 0x7f711c0aa1c0 2023-11-30T18:39:55.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.678+0000 7f7121062700 1 -- 172.21.15.49:0/2487022480 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711c158c50 con 0x7f711c0ab3b0 2023-11-30T18:39:55.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.678+0000 7f7121062700 1 --2- 172.21.15.49:0/2487022480 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f711c0ab3b0 0x7f711c1582e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f7110009790 tx=0x7f7110009060).ready entity=mon.2 client_cookie=2b88f6822bbc7788 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:55.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.678+0000 7f7120861700 1 -- 172.21.15.49:0/2487022480 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c0017f0 con 0x7f711c0ab3b0 2023-11-30T18:39:55.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.679+0000 7f7120861700 1 -- 172.21.15.49:0/2487022480 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7110011400 con 0x7f711c0ab3b0 2023-11-30T18:39:55.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.679+0000 7f7120861700 1 -- 172.21.15.49:0/2487022480 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7110011780 con 0x7f711c0ab3b0 2023-11-30T18:39:55.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.679+0000 7f7123ac7700 1 -- 172.21.15.49:0/2487022480 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f711c0ab3b0 msgr2=0x7f711c1582e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:55.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.679+0000 7f7123ac7700 1 --2- 172.21.15.49:0/2487022480 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f711c0ab3b0 0x7f711c1582e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f7110009790 tx=0x7f7110009060).stop 2023-11-30T18:39:55.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.679+0000 7f7123ac7700 1 -- 172.21.15.49:0/2487022480 shutdown_connections 2023-11-30T18:39:55.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.679+0000 7f7123ac7700 1 --2- 172.21.15.49:0/2487022480 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f711c0ab3b0 0x7f711c1582e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:55.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.679+0000 7f7123ac7700 1 -- 172.21.15.49:0/2487022480 >> 172.21.15.49:0/2487022480 conn(0x7f711c0655a0 msgr2=0x7f711c069e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:55.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.679+0000 7f7123ac7700 1 -- 172.21.15.49:0/2487022480 shutdown_connections 2023-11-30T18:39:55.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.679+0000 7f7123ac7700 1 -- 172.21.15.49:0/2487022480 wait complete. 2023-11-30T18:39:55.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.680+0000 7f7123ac7700 1 Processor -- start 2023-11-30T18:39:55.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.680+0000 7f7123ac7700 1 -- start start 2023-11-30T18:39:55.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.681+0000 7f7123ac7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f711c0aa1c0 0x7f711c168e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:55.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.681+0000 7f7123ac7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f711c154610 0x7f711c0afd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:55.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.681+0000 7f7123ac7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f711c0b0f50 0x7f711c0c41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:55.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.681+0000 7f7123ac7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c0c5290 con 0x7f711c0aa1c0 2023-11-30T18:39:55.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.681+0000 7f7123ac7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c0c49f0 con 0x7f711c154610 2023-11-30T18:39:55.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.681+0000 7f7123ac7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711c0c4cd0 con 0x7f711c0b0f50 2023-11-30T18:39:55.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.681+0000 7f7121863700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f711c0aa1c0 0x7f711c168e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:55.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.681+0000 7f7121863700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f711c0aa1c0 0x7f711c168e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42396/0 (socket says 172.21.15.49:42396) 2023-11-30T18:39:55.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.681+0000 7f7121863700 1 -- 172.21.15.49:0/1708280160 learned_addr learned my addr 172.21.15.49:0/1708280160 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:39:55.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.681+0000 7f7121062700 1 --2- 172.21.15.49:0/1708280160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f711c154610 0x7f711c0afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:55.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.681+0000 7f7122064700 1 --2- 172.21.15.49:0/1708280160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f711c0b0f50 0x7f711c0c41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:55.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.681+0000 7f7121863700 1 -- 172.21.15.49:0/1708280160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f711c0b0f50 msgr2=0x7f711c0c41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:55.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.681+0000 7f7121863700 1 --2- 172.21.15.49:0/1708280160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f711c0b0f50 0x7f711c0c41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:55.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.681+0000 7f7121863700 1 -- 172.21.15.49:0/1708280160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f711c154610 msgr2=0x7f711c0afd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:55.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.681+0000 7f7121863700 1 --2- 172.21.15.49:0/1708280160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f711c154610 0x7f711c0afd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:55.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.681+0000 7f7121863700 1 -- 172.21.15.49:0/1708280160 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71100092a0 con 0x7f711c0aa1c0 2023-11-30T18:39:55.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.681+0000 7f7121062700 1 --2- 172.21.15.49:0/1708280160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f711c154610 0x7f711c0afd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:39:55.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.681+0000 7f7122064700 1 --2- 172.21.15.49:0/1708280160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f711c0b0f50 0x7f711c0c41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:39:55.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.681+0000 7f7121863700 1 --2- 172.21.15.49:0/1708280160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f711c0aa1c0 0x7f711c168e60 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 rx=0x7f711400c440 tx=0x7f7114007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:55.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.682+0000 7f7119ffb700 1 -- 172.21.15.49:0/1708280160 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711400f470 con 0x7f711c0aa1c0 2023-11-30T18:39:55.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.682+0000 7f7119ffb700 1 -- 172.21.15.49:0/1708280160 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711400f5d0 con 0x7f711c0aa1c0 2023-11-30T18:39:55.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.682+0000 7f7119ffb700 1 -- 172.21.15.49:0/1708280160 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711400f990 con 0x7f711c0aa1c0 2023-11-30T18:39:55.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.682+0000 7f7123ac7700 1 -- 172.21.15.49:0/1708280160 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f711c0c4fb0 con 0x7f711c0aa1c0 2023-11-30T18:39:55.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.682+0000 7f7123ac7700 1 -- 172.21.15.49:0/1708280160 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f711c0b0200 con 0x7f711c0aa1c0 2023-11-30T18:39:55.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.683+0000 7f7123ac7700 1 -- 172.21.15.49:0/1708280160 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711c0c2e10 con 0x7f711c0aa1c0 2023-11-30T18:39:55.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.683+0000 7f7119ffb700 1 -- 172.21.15.49:0/1708280160 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 93) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f711400fd40 con 0x7f711c0aa1c0 2023-11-30T18:39:55.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.684+0000 7f7119ffb700 1 --2- 172.21.15.49:0/1708280160 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f710805f080 0x7f7108061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:39:55.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.684+0000 7f7119ffb700 1 -- 172.21.15.49:0/1708280160 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f7114079720 con 0x7f711c0aa1c0 2023-11-30T18:39:55.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.684+0000 7f7121062700 1 --2- 172.21.15.49:0/1708280160 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f710805f080 0x7f7108061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:39:55.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.684+0000 7f7121062700 1 --2- 172.21.15.49:0/1708280160 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f710805f080 0x7f7108061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f7110009790 tx=0x7f7110016000).ready entity=mgr.9343 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:39:55.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.688+0000 7f7119ffb700 1 -- 172.21.15.49:0/1708280160 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f711c0c2e10 con 0x7f711c0aa1c0 2023-11-30T18:39:55.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.887+0000 7f7123ac7700 1 -- 172.21.15.49:0/1708280160 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f711c0c2e10 con 0x7f710805f080 2023-11-30T18:39:55.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.890+0000 7f7119ffb700 1 -- 172.21.15.49:0/1708280160 <== mgr.9343 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7f711c0c2e10 con 0x7f710805f080 2023-11-30T18:39:55.892 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:39:55.892 INFO:teuthology.orchestra.run.smithi049.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-11-30T18:39:55.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.892+0000 7f7123ac7700 1 -- 172.21.15.49:0/1708280160 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f710805f080 msgr2=0x7f7108061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:55.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.892+0000 7f7123ac7700 1 --2- 172.21.15.49:0/1708280160 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f710805f080 0x7f7108061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f7110009790 tx=0x7f7110016000).stop 2023-11-30T18:39:55.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.892+0000 7f7123ac7700 1 -- 172.21.15.49:0/1708280160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f711c0aa1c0 msgr2=0x7f711c168e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:39:55.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.892+0000 7f7123ac7700 1 --2- 172.21.15.49:0/1708280160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f711c0aa1c0 0x7f711c168e60 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 rx=0x7f711400c440 tx=0x7f7114007c90).stop 2023-11-30T18:39:55.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.892+0000 7f7123ac7700 1 -- 172.21.15.49:0/1708280160 shutdown_connections 2023-11-30T18:39:55.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.892+0000 7f7123ac7700 1 --2- 172.21.15.49:0/1708280160 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f710805f080 0x7f7108061540 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:55.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.892+0000 7f7123ac7700 1 --2- 172.21.15.49:0/1708280160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f711c0b0f50 0x7f711c0c41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:55.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.892+0000 7f7123ac7700 1 --2- 172.21.15.49:0/1708280160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f711c0aa1c0 0x7f711c168e60 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:55.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.892+0000 7f7123ac7700 1 --2- 172.21.15.49:0/1708280160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f711c154610 0x7f711c0afd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:39:55.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.892+0000 7f7123ac7700 1 -- 172.21.15.49:0/1708280160 >> 172.21.15.49:0/1708280160 conn(0x7f711c0655a0 msgr2=0x7f711c0cb260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:39:55.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.892+0000 7f7123ac7700 1 -- 172.21.15.49:0/1708280160 shutdown_connections 2023-11-30T18:39:55.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:39:55.892+0000 7f7123ac7700 1 -- 172.21.15.49:0/1708280160 wait complete. 2023-11-30T18:39:55.906 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-11-30T18:39:55.906 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-11-30T18:39:55.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:39:55.906 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:39:56.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:39:56.923 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:39:57.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:39:57.944 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:39:58.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:39:58.964 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:39:59.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:39:59.985 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:00.546 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:40:00.544+0000 7fec87fef700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:40:00.547 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:40:00.544+0000 7fec87fef700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:40:00.547 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:40:00.544+0000 7fec87fef700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:40:00.547 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:40:00.544+0000 7fec87fef700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:40:00.547 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:40:00.544+0000 7fec87fef700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:40:01.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:01.005 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:01.024 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:01.024 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-11-30-18_40_00_UTC'] 2023-11-30T18:40:01.024 DEBUG:tasks.cephfs.test_snap_schedules:exec=1701369595.55683, now = 1701369601.0245554, timo = 5 2023-11-30T18:40:02.025 DEBUG:tasks.cephfs.test_snap_schedules:expecting removal of snap snap_test_dir1/.snap/scheduled-2023-11-30-18_40_00 in ~65s... 2023-11-30T18:40:02.025 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:02.025 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:02.044 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:03.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:03.046 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:03.066 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:04.067 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:04.067 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:04.087 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:05.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:05.088 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:05.107 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:06.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:06.110 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:06.129 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:07.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:07.131 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:07.150 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:08.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:08.152 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:08.171 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:09.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:09.172 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:09.191 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:09.348 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:40:09.351 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:40:10.193 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:10.193 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:10.212 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:11.214 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:11.214 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:11.233 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:12.235 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:12.235 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:12.254 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:13.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:13.255 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:13.275 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:14.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:14.276 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:14.295 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:15.297 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:15.297 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:15.317 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:16.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:16.318 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:16.337 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:17.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:17.339 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:17.358 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:18.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:18.360 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:18.379 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:19.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:19.381 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:19.400 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:20.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:20.402 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:20.421 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:21.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:21.422 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:21.442 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:22.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:22.444 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:22.463 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:23.464 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:23.464 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:23.483 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:24.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:24.485 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:24.506 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:25.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:25.509 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:25.527 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:26.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:26.529 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:26.552 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:27.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:27.554 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:27.573 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:28.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:28.575 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:28.594 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:29.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:29.596 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:29.615 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:30.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:30.617 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:30.635 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:31.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:31.637 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:31.656 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:32.658 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:32.658 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:32.678 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:33.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:33.679 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:33.698 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:34.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:34.700 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:34.720 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:35.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:35.722 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:35.741 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:36.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:36.743 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:36.762 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:37.763 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:37.763 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:37.782 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:38.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:38.784 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:38.803 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:39.483 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:40:39.486 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:40:39.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:39.804 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:39.824 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:40.824 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:40.824 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:40.843 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:41.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:41.845 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:41.865 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:42.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:42.866 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:42.885 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:43.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:43.887 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:43.906 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:44.907 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:44.907 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:44.925 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:45.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:45.927 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:45.946 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:46.948 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:46.948 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:46.968 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:47.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:47.969 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:47.988 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:48.989 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:48.989 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:49.008 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:50.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:50.009 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:50.030 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:51.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:51.091 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:51.110 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:52.111 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:52.111 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:52.131 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:53.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:53.132 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:53.152 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:54.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:54.153 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:54.173 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:55.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:55.175 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:55.195 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:56.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:56.196 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:56.216 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:57.217 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:57.217 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:57.238 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:58.238 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:58.239 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:58.259 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:40:59.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:40:59.260 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:40:59.279 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:41:00.279 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:41:00.280 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:41:00.299 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_40_00_UTC 2023-11-30T18:41:01.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:41:01.301 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:41:01.320 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_41_00_UTC 2023-11-30T18:41:01.320 DEBUG:tasks.cephfs.test_snap_schedules:snapshots removed=['scheduled-2023-11-30-18_40_00_UTC'] 2023-11-30T18:41:01.320 DEBUG:tasks.cephfs.test_snap_schedules:exec=1701369595.55683, now = 1701369661.3209789, timo = 65 2023-11-30T18:41:02.321 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-11-30T18:41:02.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.455+0000 7f974a0eb700 1 Processor -- start 2023-11-30T18:41:02.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.455+0000 7f974a0eb700 1 -- start start 2023-11-30T18:41:02.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.456+0000 7f974a0eb700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f97440aa680 0x7f97440c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:02.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.456+0000 7f974a0eb700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9744158d50 con 0x7f97441542d0 2023-11-30T18:41:02.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.456+0000 7f974a0eb700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9744158140 con 0x7f97441546b0 2023-11-30T18:41:02.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.456+0000 7f974a0eb700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9744158420 con 0x7f97440aa680 2023-11-30T18:41:02.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.456+0000 7f97490e9700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f97441542d0 0x7f97440a9f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50372/0 (socket says 172.21.15.49:50372) 2023-11-30T18:41:02.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.456+0000 7f97488e8700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f97440aa680 0x7f97440c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:02.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.456+0000 7f97490e9700 1 -- 172.21.15.49:0/745874446 learned_addr learned my addr 172.21.15.49:0/745874446 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:02.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.456+0000 7f97488e8700 1 -- 172.21.15.49:0/745874446 >> v1:172.21.15.115:6789/0 conn(0x7f97441546b0 legacy=0x7f97440c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:02.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.456+0000 7f97488e8700 1 -- 172.21.15.49:0/745874446 >> v1:172.21.15.49:6789/0 conn(0x7f97441542d0 legacy=0x7f97440a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:02.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.456+0000 7f97488e8700 1 -- 172.21.15.49:0/745874446 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9744158700 con 0x7f97440aa680 2023-11-30T18:41:02.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.456+0000 7f973bfff700 1 -- 172.21.15.49:0/745874446 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4114507413 0 0) 0x7f9744158d50 con 0x7f97441542d0 2023-11-30T18:41:02.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.457+0000 7f97488e8700 1 --2- 172.21.15.49:0/745874446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97440aa680 0x7f97440c5fc0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 rx=0x7f9734009760 tx=0x7f9734009060).ready entity=mon.0 client_cookie=6cd3e966e5b2e4a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:02.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.457+0000 7f973bfff700 1 -- 172.21.15.49:0/745874446 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973400b580 con 0x7f97440aa680 2023-11-30T18:41:02.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.457+0000 7f973bfff700 1 -- 172.21.15.49:0/745874446 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973400b6e0 con 0x7f97440aa680 2023-11-30T18:41:02.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.457+0000 7f973bfff700 1 -- 172.21.15.49:0/745874446 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973400ba60 con 0x7f97440aa680 2023-11-30T18:41:02.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.457+0000 7f974a0eb700 1 -- 172.21.15.49:0/745874446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97440aa680 msgr2=0x7f97440c5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:02.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.457+0000 7f974a0eb700 1 --2- 172.21.15.49:0/745874446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97440aa680 0x7f97440c5fc0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 rx=0x7f9734009760 tx=0x7f9734009060).stop 2023-11-30T18:41:02.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.457+0000 7f974a0eb700 1 -- 172.21.15.49:0/745874446 shutdown_connections 2023-11-30T18:41:02.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.457+0000 7f974a0eb700 1 --2- 172.21.15.49:0/745874446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97440aa680 0x7f97440c5fc0 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:02.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.457+0000 7f974a0eb700 1 -- 172.21.15.49:0/745874446 >> 172.21.15.49:0/745874446 conn(0x7f97440cb010 msgr2=0x7f97440cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:02.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.457+0000 7f974a0eb700 1 -- 172.21.15.49:0/745874446 shutdown_connections 2023-11-30T18:41:02.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.457+0000 7f974a0eb700 1 -- 172.21.15.49:0/745874446 wait complete. 2023-11-30T18:41:02.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.459+0000 7f974a0eb700 1 Processor -- start 2023-11-30T18:41:02.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.459+0000 7f974a0eb700 1 -- start start 2023-11-30T18:41:02.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.459+0000 7f974a0eb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97440aa680 0x7f9744159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:02.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.460+0000 7f974a0eb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97441542d0 0x7f97440b0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:02.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.460+0000 7f974a0eb700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97441546b0 0x7f97440b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:02.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.460+0000 7f974a0eb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97440b1130 con 0x7f97440aa680 2023-11-30T18:41:02.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.460+0000 7f974a0eb700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97440c25a0 con 0x7f97441546b0 2023-11-30T18:41:02.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.460+0000 7f974a0eb700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f974415a460 con 0x7f97441542d0 2023-11-30T18:41:02.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.460+0000 7f97490e9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97440aa680 0x7f9744159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:02.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.460+0000 7f97490e9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97440aa680 0x7f9744159bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48262/0 (socket says 172.21.15.49:48262) 2023-11-30T18:41:02.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.460+0000 7f97490e9700 1 -- 172.21.15.49:0/2810723888 learned_addr learned my addr 172.21.15.49:0/2810723888 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:02.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.460+0000 7f97490e9700 1 -- 172.21.15.49:0/2810723888 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97441542d0 msgr2=0x7f97440b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:02.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.460+0000 7f97490e9700 1 --2- 172.21.15.49:0/2810723888 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97441542d0 0x7f97440b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:02.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.460+0000 7f97490e9700 1 -- 172.21.15.49:0/2810723888 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97441546b0 msgr2=0x7f97440b0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:02.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.460+0000 7f97498ea700 1 --2- 172.21.15.49:0/2810723888 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97441546b0 0x7f97440b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:02.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.460+0000 7f97490e9700 1 --2- 172.21.15.49:0/2810723888 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97441546b0 0x7f97440b0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:02.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.460+0000 7f97490e9700 1 -- 172.21.15.49:0/2810723888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97340092a0 con 0x7f97440aa680 2023-11-30T18:41:02.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.460+0000 7f97490e9700 1 --2- 172.21.15.49:0/2810723888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97440aa680 0x7f9744159bd0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 rx=0x7f974000c4c0 tx=0x7f9740007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:02.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.460+0000 7f97397fa700 1 -- 172.21.15.49:0/2810723888 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97400072e0 con 0x7f97440aa680 2023-11-30T18:41:02.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.460+0000 7f97397fa700 1 -- 172.21.15.49:0/2810723888 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9740007460 con 0x7f97440aa680 2023-11-30T18:41:02.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.460+0000 7f974a0eb700 1 -- 172.21.15.49:0/2810723888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f974415a740 con 0x7f97440aa680 2023-11-30T18:41:02.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.460+0000 7f97397fa700 1 -- 172.21.15.49:0/2810723888 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97400059f0 con 0x7f97440aa680 2023-11-30T18:41:02.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.460+0000 7f974a0eb700 1 -- 172.21.15.49:0/2810723888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f974415ad00 con 0x7f97440aa680 2023-11-30T18:41:02.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.461+0000 7f974a0eb700 1 -- 172.21.15.49:0/2810723888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97440c1de0 con 0x7f97440aa680 2023-11-30T18:41:02.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.462+0000 7f97397fa700 1 -- 172.21.15.49:0/2810723888 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 95) v1 ==== 75679+0+0 (secure 0 0 0) 0x7f9740013450 con 0x7f97440aa680 2023-11-30T18:41:02.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.462+0000 7f97397fa700 1 --2- 172.21.15.49:0/2810723888 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f972805f3b0 0x7f9728061870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:02.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.462+0000 7f97397fa700 1 -- 172.21.15.49:0/2810723888 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f9740079f10 con 0x7f97440aa680 2023-11-30T18:41:02.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.462+0000 7f97488e8700 1 --2- 172.21.15.49:0/2810723888 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f972805f3b0 0x7f9728061870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:02.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.463+0000 7f97488e8700 1 --2- 172.21.15.49:0/2810723888 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f972805f3b0 0x7f9728061870 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f97440aaa80 tx=0x7f9734017000).ready entity=mgr.9343 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:02.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.466+0000 7f97397fa700 1 -- 172.21.15.49:0/2810723888 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f974004ad30 con 0x7f97440aa680 2023-11-30T18:41:02.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.668+0000 7f974a0eb700 1 -- 172.21.15.49:0/2810723888 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f97440c6c40 con 0x7f972805f3b0 2023-11-30T18:41:02.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.673+0000 7f97397fa700 1 -- 172.21.15.49:0/2810723888 <== mgr.9343 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f97440c6c40 con 0x7f972805f3b0 2023-11-30T18:41:02.675 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule removed for path snap_test_dir1 2023-11-30T18:41:02.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.675+0000 7f974a0eb700 1 -- 172.21.15.49:0/2810723888 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f972805f3b0 msgr2=0x7f9728061870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:02.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.675+0000 7f974a0eb700 1 --2- 172.21.15.49:0/2810723888 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f972805f3b0 0x7f9728061870 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f97440aaa80 tx=0x7f9734017000).stop 2023-11-30T18:41:02.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.675+0000 7f974a0eb700 1 -- 172.21.15.49:0/2810723888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97440aa680 msgr2=0x7f9744159bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:02.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.675+0000 7f974a0eb700 1 --2- 172.21.15.49:0/2810723888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97440aa680 0x7f9744159bd0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 rx=0x7f974000c4c0 tx=0x7f9740007c10).stop 2023-11-30T18:41:02.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.675+0000 7f974a0eb700 1 -- 172.21.15.49:0/2810723888 shutdown_connections 2023-11-30T18:41:02.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.675+0000 7f974a0eb700 1 --2- 172.21.15.49:0/2810723888 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f972805f3b0 0x7f9728061870 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:02.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.675+0000 7f974a0eb700 1 --2- 172.21.15.49:0/2810723888 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97441546b0 0x7f97440b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:02.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.675+0000 7f974a0eb700 1 --2- 172.21.15.49:0/2810723888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97440aa680 0x7f9744159bd0 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:02.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.675+0000 7f974a0eb700 1 --2- 172.21.15.49:0/2810723888 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97441542d0 0x7f97440b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:02.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.675+0000 7f974a0eb700 1 -- 172.21.15.49:0/2810723888 >> 172.21.15.49:0/2810723888 conn(0x7f97440cb010 msgr2=0x7f97440a9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:02.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.675+0000 7f974a0eb700 1 -- 172.21.15.49:0/2810723888 shutdown_connections 2023-11-30T18:41:02.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.675+0000 7f974a0eb700 1 -- 172.21.15.49:0/2810723888 wait complete. 2023-11-30T18:41:02.689 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-11-30T18:41:02.689 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:41:02.689 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:41:02.705 INFO:teuthology.orchestra.run.smithi049.stdout:scheduled-2023-11-30-18_41_00_UTC 2023-11-30T18:41:02.705 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-30-18_41_00_UTC 2023-11-30T18:41:02.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:41:02.705 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-30-18_41_00_UTC) 2023-11-30T18:41:02.766 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:41:02.766 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-11-30T18:41:02.824 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-11-30T18:41:02.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.983+0000 7fe4914fa700 1 Processor -- start 2023-11-30T18:41:02.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.983+0000 7fe4914fa700 1 -- start start 2023-11-30T18:41:02.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.984+0000 7fe4914fa700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe48c14e530 0x7fe48c0c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:02.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.984+0000 7fe4914fa700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe48c154950 0x7fe48c14e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:02.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.984+0000 7fe4914fa700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe48c0c7bc0 con 0x7fe48c158570 2023-11-30T18:41:02.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.984+0000 7fe4914fa700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe48c155920 con 0x7fe48c14e530 2023-11-30T18:41:02.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.984+0000 7fe4914fa700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c154dd0 con 0x7fe48c154950 2023-11-30T18:41:02.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.984+0000 7fe48bfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe48c14e530 0x7fe48c0c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:02.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.984+0000 7fe48bfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe48c14e530 0x7fe48c0c66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48268/0 (socket says 172.21.15.49:48268) 2023-11-30T18:41:02.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.984+0000 7fe490cf9700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe48c158570 0x7fe48c0aa030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50384/0 (socket says 172.21.15.49:50384) 2023-11-30T18:41:02.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.984+0000 7fe48bfff700 1 -- 172.21.15.49:0/4201385743 learned_addr learned my addr 172.21.15.49:0/4201385743 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:02.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.985+0000 7fe48b7fe700 1 --2- 172.21.15.49:0/4201385743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe48c154950 0x7fe48c14e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:02.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.985+0000 7fe48bfff700 1 -- 172.21.15.49:0/4201385743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe48c154950 msgr2=0x7fe48c14e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:02.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.985+0000 7fe48bfff700 1 --2- 172.21.15.49:0/4201385743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe48c154950 0x7fe48c14e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:02.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.985+0000 7fe48bfff700 1 -- 172.21.15.49:0/4201385743 >> v1:172.21.15.49:6789/0 conn(0x7fe48c158570 legacy=0x7fe48c0aa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:02.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.985+0000 7fe48bfff700 1 -- 172.21.15.49:0/4201385743 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48c155080 con 0x7fe48c14e530 2023-11-30T18:41:02.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.985+0000 7fe48affd700 1 -- 172.21.15.49:0/4201385743 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975305705 0 0) 0x7fe48c0c7bc0 con 0x7fe48c158570 2023-11-30T18:41:02.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.985+0000 7fe48b7fe700 1 --2- 172.21.15.49:0/4201385743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe48c154950 0x7fe48c14e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:41:02.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.985+0000 7fe48bfff700 1 --2- 172.21.15.49:0/4201385743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe48c14e530 0x7fe48c0c66f0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7fe474006fd0 tx=0x7fe4740090f0).ready entity=mon.0 client_cookie=54953747ce6d302c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:02.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.985+0000 7fe48affd700 1 -- 172.21.15.49:0/4201385743 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47400b600 con 0x7fe48c14e530 2023-11-30T18:41:02.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.985+0000 7fe48affd700 1 -- 172.21.15.49:0/4201385743 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47400b760 con 0x7fe48c14e530 2023-11-30T18:41:02.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.985+0000 7fe48affd700 1 -- 172.21.15.49:0/4201385743 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47400bb00 con 0x7fe48c14e530 2023-11-30T18:41:02.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.985+0000 7fe4914fa700 1 -- 172.21.15.49:0/4201385743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe48c14e530 msgr2=0x7fe48c0c66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:02.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.985+0000 7fe4914fa700 1 --2- 172.21.15.49:0/4201385743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe48c14e530 0x7fe48c0c66f0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7fe474006fd0 tx=0x7fe4740090f0).stop 2023-11-30T18:41:02.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.985+0000 7fe4914fa700 1 -- 172.21.15.49:0/4201385743 shutdown_connections 2023-11-30T18:41:02.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.985+0000 7fe4914fa700 1 --2- 172.21.15.49:0/4201385743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe48c14e530 0x7fe48c0c66f0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:02.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.985+0000 7fe4914fa700 1 --2- 172.21.15.49:0/4201385743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe48c154950 0x7fe48c14e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:02.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.985+0000 7fe4914fa700 1 -- 172.21.15.49:0/4201385743 >> 172.21.15.49:0/4201385743 conn(0x7fe48c064990 msgr2=0x7fe48c064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:02.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.985+0000 7fe4914fa700 1 -- 172.21.15.49:0/4201385743 shutdown_connections 2023-11-30T18:41:02.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.986+0000 7fe4914fa700 1 -- 172.21.15.49:0/4201385743 wait complete. 2023-11-30T18:41:02.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.987+0000 7fe4914fa700 1 Processor -- start 2023-11-30T18:41:02.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.987+0000 7fe4914fa700 1 -- start start 2023-11-30T18:41:02.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.987+0000 7fe4914fa700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe48c14e530 0x7fe48c1652e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:02.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.987+0000 7fe4914fa700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe48c154950 0x7fe48c0c2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:02.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.988+0000 7fe4914fa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe48c158570 0x7fe48c14dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:02.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.988+0000 7fe4914fa700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c0c3d80 con 0x7fe48c158570 2023-11-30T18:41:02.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.988+0000 7fe4914fa700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c0c2ef0 con 0x7fe48c14e530 2023-11-30T18:41:02.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.988+0000 7fe4914fa700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c0c3170 con 0x7fe48c154950 2023-11-30T18:41:02.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.988+0000 7fe490cf9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe48c158570 0x7fe48c14dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:02.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.988+0000 7fe490cf9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe48c158570 0x7fe48c14dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48270/0 (socket says 172.21.15.49:48270) 2023-11-30T18:41:02.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.988+0000 7fe490cf9700 1 -- 172.21.15.49:0/4257843274 learned_addr learned my addr 172.21.15.49:0/4257843274 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:02.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.988+0000 7fe48b7fe700 1 --2- 172.21.15.49:0/4257843274 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe48c154950 0x7fe48c0c2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:02.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.988+0000 7fe48bfff700 1 --2- 172.21.15.49:0/4257843274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe48c14e530 0x7fe48c1652e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:02.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.988+0000 7fe490cf9700 1 -- 172.21.15.49:0/4257843274 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe48c154950 msgr2=0x7fe48c0c2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:02.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.988+0000 7fe490cf9700 1 --2- 172.21.15.49:0/4257843274 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe48c154950 0x7fe48c0c2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:02.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.988+0000 7fe490cf9700 1 -- 172.21.15.49:0/4257843274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe48c14e530 msgr2=0x7fe48c1652e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:02.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.988+0000 7fe490cf9700 1 --2- 172.21.15.49:0/4257843274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe48c14e530 0x7fe48c1652e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:02.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.988+0000 7fe490cf9700 1 -- 172.21.15.49:0/4257843274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe474009370 con 0x7fe48c158570 2023-11-30T18:41:02.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.988+0000 7fe490cf9700 1 --2- 172.21.15.49:0/4257843274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe48c158570 0x7fe48c14dad0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 rx=0x7fe48400c730 tx=0x7fe484001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:02.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.988+0000 7fe483fff700 1 -- 172.21.15.49:0/4257843274 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe484005c70 con 0x7fe48c158570 2023-11-30T18:41:02.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.988+0000 7fe483fff700 1 -- 172.21.15.49:0/4257843274 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe484005dd0 con 0x7fe48c158570 2023-11-30T18:41:02.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.988+0000 7fe4914fa700 1 -- 172.21.15.49:0/4257843274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe48c0c3450 con 0x7fe48c158570 2023-11-30T18:41:02.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.988+0000 7fe483fff700 1 -- 172.21.15.49:0/4257843274 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe484007340 con 0x7fe48c158570 2023-11-30T18:41:02.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.988+0000 7fe4914fa700 1 -- 172.21.15.49:0/4257843274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe48c0c3a10 con 0x7fe48c158570 2023-11-30T18:41:02.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.989+0000 7fe4914fa700 1 -- 172.21.15.49:0/4257843274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe48c0c3f30 con 0x7fe48c158570 2023-11-30T18:41:02.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.990+0000 7fe483fff700 1 -- 172.21.15.49:0/4257843274 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 95) v1 ==== 75679+0+0 (secure 0 0 0) 0x7fe4840076f0 con 0x7fe48c158570 2023-11-30T18:41:02.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.990+0000 7fe483fff700 1 --2- 172.21.15.49:0/4257843274 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe46c05f3e0 0x7fe46c0618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:02.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.990+0000 7fe483fff700 1 -- 172.21.15.49:0/4257843274 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6463+0+0 (secure 0 0 0) 0x7fe48407a7b0 con 0x7fe48c158570 2023-11-30T18:41:02.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.990+0000 7fe48bfff700 1 --2- 172.21.15.49:0/4257843274 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe46c05f3e0 0x7fe46c0618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:02.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.990+0000 7fe48bfff700 1 --2- 172.21.15.49:0/4257843274 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe46c05f3e0 0x7fe46c0618a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fe48c0c6030 tx=0x7fe474017000).ready entity=mgr.9343 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:02.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:02.994+0000 7fe483fff700 1 -- 172.21.15.49:0/4257843274 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe48c0c3f30 con 0x7fe48c158570 2023-11-30T18:41:03.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:03.212+0000 7fe4914fa700 1 -- 172.21.15.49:0/4257843274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fe48c062ee0 con 0x7fe48c158570 2023-11-30T18:41:03.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:03.984+0000 7fe483fff700 1 -- 172.21.15.49:0/4257843274 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 96) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fe48401adb0 con 0x7fe48c158570 2023-11-30T18:41:03.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:03.986+0000 7fe483fff700 1 -- 172.21.15.49:0/4257843274 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v96) v1 ==== 93+0+0 (secure 0 0 0) 0x7fe484073480 con 0x7fe48c158570 2023-11-30T18:41:03.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:03.989+0000 7fe4914fa700 1 -- 172.21.15.49:0/4257843274 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe46c05f3e0 msgr2=0x7fe46c0618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:03.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:03.989+0000 7fe4914fa700 1 --2- 172.21.15.49:0/4257843274 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe46c05f3e0 0x7fe46c0618a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fe48c0c6030 tx=0x7fe474017000).stop 2023-11-30T18:41:03.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:03.989+0000 7fe4914fa700 1 -- 172.21.15.49:0/4257843274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe48c158570 msgr2=0x7fe48c14dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:03.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:03.989+0000 7fe4914fa700 1 --2- 172.21.15.49:0/4257843274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe48c158570 0x7fe48c14dad0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 rx=0x7fe48400c730 tx=0x7fe484001520).stop 2023-11-30T18:41:03.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:03.989+0000 7fe4914fa700 1 -- 172.21.15.49:0/4257843274 shutdown_connections 2023-11-30T18:41:03.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:03.989+0000 7fe4914fa700 1 --2- 172.21.15.49:0/4257843274 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe46c05f3e0 0x7fe46c0618a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:03.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:03.989+0000 7fe4914fa700 1 --2- 172.21.15.49:0/4257843274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe48c158570 0x7fe48c14dad0 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:03.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:03.989+0000 7fe4914fa700 1 --2- 172.21.15.49:0/4257843274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe48c14e530 0x7fe48c1652e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:03.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:03.989+0000 7fe4914fa700 1 --2- 172.21.15.49:0/4257843274 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe48c154950 0x7fe48c0c2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:03.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:03.989+0000 7fe4914fa700 1 -- 172.21.15.49:0/4257843274 >> 172.21.15.49:0/4257843274 conn(0x7fe48c064990 msgr2=0x7fe48c0c9530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:03.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:03.989+0000 7fe4914fa700 1 -- 172.21.15.49:0/4257843274 shutdown_connections 2023-11-30T18:41:03.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:03.989+0000 7fe4914fa700 1 -- 172.21.15.49:0/4257843274 wait complete. 2023-11-30T18:41:04.005 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-30T18:41:04.005 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T18:41:04.050 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T18:41:04.084 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-30T18:41:04.084 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-30T18:41:04.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:41:04.085 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-30T18:41:04.124 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-11-30T18:41:04.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:41:04.124 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-30T18:41:04.136 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:04.134+0000 7fc8bc633680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T18:41:04.138 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:04.138+0000 7f82c7cd7680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T18:41:04.151 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:41:04.200 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:04.199+0000 7f82c7cd7680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T18:41:04.202 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:04.201+0000 7fc8bc633680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T18:41:04.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.309+0000 7f87759fe700 1 Processor -- start 2023-11-30T18:41:04.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.309+0000 7f87759fe700 1 -- start start 2023-11-30T18:41:04.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.310+0000 7f87759fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f87700bf9e0 0x7f8770068110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:04.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.310+0000 7f87759fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8770066780 0x7f8770066c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:04.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.310+0000 7f87759fe700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8770155fa0 con 0x7f87700a73e0 2023-11-30T18:41:04.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.310+0000 7f87759fe700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8770152730 con 0x7f87700bf9e0 2023-11-30T18:41:04.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.310+0000 7f87759fe700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8770068600 con 0x7f8770066780 2023-11-30T18:41:04.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.310+0000 7f876e7fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f87700bf9e0 0x7f8770068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:04.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.310+0000 7f876e7fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f87700bf9e0 0x7f8770068110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48310/0 (socket says 172.21.15.49:48310) 2023-11-30T18:41:04.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.310+0000 7f876e7fc700 1 -- 172.21.15.49:0/2026809036 learned_addr learned my addr 172.21.15.49:0/2026809036 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:04.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.310+0000 7f876f7fe700 1 --2- 172.21.15.49:0/2026809036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8770066780 0x7f8770066c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:04.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.311+0000 7f876e7fc700 1 -- 172.21.15.49:0/2026809036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8770066780 msgr2=0x7f8770066c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:04.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.311+0000 7f876e7fc700 1 --2- 172.21.15.49:0/2026809036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8770066780 0x7f8770066c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:04.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.311+0000 7f876e7fc700 1 -- 172.21.15.49:0/2026809036 >> v1:172.21.15.115:6789/0 conn(0x7f87700a73e0 legacy=0x7f8770156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:04.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.311+0000 7f876e7fc700 1 -- 172.21.15.49:0/2026809036 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87700a7fe0 con 0x7f87700bf9e0 2023-11-30T18:41:04.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.311+0000 7f876f7fe700 1 --2- 172.21.15.49:0/2026809036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8770066780 0x7f8770066c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:41:04.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.311+0000 7f876e7fc700 1 --2- 172.21.15.49:0/2026809036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87700bf9e0 0x7f8770068110 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7f8760006fd0 tx=0x7f87600090f0).ready entity=mon.0 client_cookie=9af97378f234b67c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:04.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.311+0000 7f876dffb700 1 -- 172.21.15.49:0/2026809036 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876000b600 con 0x7f87700bf9e0 2023-11-30T18:41:04.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.311+0000 7f876dffb700 1 -- 172.21.15.49:0/2026809036 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876000b760 con 0x7f87700bf9e0 2023-11-30T18:41:04.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.311+0000 7f876dffb700 1 -- 172.21.15.49:0/2026809036 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876000bae0 con 0x7f87700bf9e0 2023-11-30T18:41:04.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.311+0000 7f87759fe700 1 -- 172.21.15.49:0/2026809036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87700bf9e0 msgr2=0x7f8770068110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:04.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.311+0000 7f87759fe700 1 --2- 172.21.15.49:0/2026809036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87700bf9e0 0x7f8770068110 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7f8760006fd0 tx=0x7f87600090f0).stop 2023-11-30T18:41:04.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.312+0000 7f87759fe700 1 -- 172.21.15.49:0/2026809036 shutdown_connections 2023-11-30T18:41:04.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.312+0000 7f87759fe700 1 --2- 172.21.15.49:0/2026809036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8770066780 0x7f8770066c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:04.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.312+0000 7f87759fe700 1 --2- 172.21.15.49:0/2026809036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87700bf9e0 0x7f8770068110 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:04.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.312+0000 7f87759fe700 1 -- 172.21.15.49:0/2026809036 >> 172.21.15.49:0/2026809036 conn(0x7f8770062700 msgr2=0x7f8770062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:04.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.312+0000 7f87759fe700 1 -- 172.21.15.49:0/2026809036 shutdown_connections 2023-11-30T18:41:04.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.312+0000 7f87759fe700 1 -- 172.21.15.49:0/2026809036 wait complete. 2023-11-30T18:41:04.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.313+0000 7f87759fe700 1 Processor -- start 2023-11-30T18:41:04.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.313+0000 7f87759fe700 1 -- start start 2023-11-30T18:41:04.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.314+0000 7f87759fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8770066780 0x7f8770158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:04.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.314+0000 7f87759fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87700a73e0 0x7f8770165540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:04.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.314+0000 7f87759fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87700bf9e0 0x7f8770165a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:04.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.314+0000 7f87759fe700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8770165f20 con 0x7f87700a73e0 2023-11-30T18:41:04.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.314+0000 7f87759fe700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87700ad810 con 0x7f87700bf9e0 2023-11-30T18:41:04.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.314+0000 7f87759fe700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87701631e0 con 0x7f8770066780 2023-11-30T18:41:04.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.314+0000 7f876e7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87700a73e0 0x7f8770165540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:04.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.314+0000 7f876effd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8770066780 0x7f8770158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:04.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.314+0000 7f876e7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87700a73e0 0x7f8770165540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48316/0 (socket says 172.21.15.49:48316) 2023-11-30T18:41:04.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.314+0000 7f876e7fc700 1 -- 172.21.15.49:0/3023160340 learned_addr learned my addr 172.21.15.49:0/3023160340 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:04.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.314+0000 7f876f7fe700 1 --2- 172.21.15.49:0/3023160340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87700bf9e0 0x7f8770165a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:04.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.314+0000 7f876e7fc700 1 -- 172.21.15.49:0/3023160340 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8770066780 msgr2=0x7f8770158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:04.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.314+0000 7f876e7fc700 1 --2- 172.21.15.49:0/3023160340 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8770066780 0x7f8770158b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:04.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.314+0000 7f876e7fc700 1 -- 172.21.15.49:0/3023160340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87700bf9e0 msgr2=0x7f8770165a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:04.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.314+0000 7f876e7fc700 1 --2- 172.21.15.49:0/3023160340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87700bf9e0 0x7f8770165a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:04.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.314+0000 7f876e7fc700 1 -- 172.21.15.49:0/3023160340 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8760009370 con 0x7f87700a73e0 2023-11-30T18:41:04.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.314+0000 7f876e7fc700 1 --2- 172.21.15.49:0/3023160340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87700a73e0 0x7f8770165540 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 rx=0x7f87700c3770 tx=0x7f8760017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:04.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.314+0000 7f8766ffd700 1 -- 172.21.15.49:0/3023160340 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876000bea0 con 0x7f87700a73e0 2023-11-30T18:41:04.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.315+0000 7f8766ffd700 1 -- 172.21.15.49:0/3023160340 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876000b8d0 con 0x7f87700a73e0 2023-11-30T18:41:04.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.315+0000 7f87759fe700 1 -- 172.21.15.49:0/3023160340 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87701634c0 con 0x7f87700a73e0 2023-11-30T18:41:04.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.315+0000 7f8766ffd700 1 -- 172.21.15.49:0/3023160340 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876001b660 con 0x7f87700a73e0 2023-11-30T18:41:04.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.315+0000 7f87759fe700 1 -- 172.21.15.49:0/3023160340 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87700adaf0 con 0x7f87700a73e0 2023-11-30T18:41:04.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.316+0000 7f87759fe700 1 -- 172.21.15.49:0/3023160340 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87701639e0 con 0x7f87700a73e0 2023-11-30T18:41:04.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.316+0000 7f8766ffd700 1 -- 172.21.15.49:0/3023160340 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 96) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f876001b9d0 con 0x7f87700a73e0 2023-11-30T18:41:04.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.317+0000 7f8766ffd700 1 --2- 172.21.15.49:0/3023160340 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f875005f360 0x7f8750061820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:04.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.317+0000 7f8766ffd700 1 -- 172.21.15.49:0/3023160340 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f876007c3c0 con 0x7f87700a73e0 2023-11-30T18:41:04.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.317+0000 7f876effd700 1 -- 172.21.15.49:0/3023160340 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f875005f360 msgr2=0x7f8750061820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:04.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.317+0000 7f876effd700 1 --2- 172.21.15.49:0/3023160340 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f875005f360 0x7f8750061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:41:04.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.321+0000 7f8766ffd700 1 -- 172.21.15.49:0/3023160340 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f876004d300 con 0x7f87700a73e0 2023-11-30T18:41:04.473 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:04.472+0000 7f82c7cd7680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T18:41:04.496 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:04.494+0000 7fc8bc633680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T18:41:04.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.518+0000 7f876effd700 1 -- 172.21.15.49:0/3023160340 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f875005f360 msgr2=0x7f8750061820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:04.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.518+0000 7f876effd700 1 --2- 172.21.15.49:0/3023160340 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f875005f360 0x7f8750061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T18:41:04.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.537+0000 7f87759fe700 1 -- 172.21.15.49:0/3023160340 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87701639e0 con 0x7f87700a73e0 2023-11-30T18:41:04.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.538+0000 7f8766ffd700 1 -- 172.21.15.49:0/3023160340 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f87701639e0 con 0x7f87700a73e0 2023-11-30T18:41:04.539 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:04.539 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":85,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7904,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/873619564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":873619564},{"type":"v1","addr":"172.21.15.115:6837","nonce":873619564}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":9172,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/4238872035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":4238872035},{"type":"v1","addr":"172.21.15.115:6835","nonce":4238872035}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":9495,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1878169084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1878169084},{"type":"v1","addr":"172.21.15.49:6834","nonce":1878169084}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T18:39:37.320382+0000","modified":"2023-11-30T18:39:40.334323+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9498},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9498":{"gid":9498,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/4263670008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":4263670008},{"type":"v1","addr":"172.21.15.49:6835","nonce":4263670008}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-11-30T18:41:04.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.540+0000 7f87759fe700 1 -- 172.21.15.49:0/3023160340 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f875005f360 msgr2=0x7f8750061820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:41:04.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.540+0000 7f87759fe700 1 --2- 172.21.15.49:0/3023160340 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f875005f360 0x7f8750061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:04.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.540+0000 7f87759fe700 1 -- 172.21.15.49:0/3023160340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87700a73e0 msgr2=0x7f8770165540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:04.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.540+0000 7f87759fe700 1 --2- 172.21.15.49:0/3023160340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87700a73e0 0x7f8770165540 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 rx=0x7f87700c3770 tx=0x7f8760017000).stop 2023-11-30T18:41:04.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.540+0000 7f87759fe700 1 -- 172.21.15.49:0/3023160340 shutdown_connections 2023-11-30T18:41:04.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.540+0000 7f87759fe700 1 --2- 172.21.15.49:0/3023160340 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f875005f360 0x7f8750061820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:04.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.540+0000 7f87759fe700 1 --2- 172.21.15.49:0/3023160340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87700bf9e0 0x7f8770165a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:04.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.540+0000 7f87759fe700 1 --2- 172.21.15.49:0/3023160340 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8770066780 0x7f8770158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:04.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.540+0000 7f87759fe700 1 --2- 172.21.15.49:0/3023160340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87700a73e0 0x7f8770165540 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:04.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.540+0000 7f87759fe700 1 -- 172.21.15.49:0/3023160340 >> 172.21.15.49:0/3023160340 conn(0x7f8770062700 msgr2=0x7f8770151150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:04.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.540+0000 7f87759fe700 1 -- 172.21.15.49:0/3023160340 shutdown_connections 2023-11-30T18:41:04.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.540+0000 7f87759fe700 1 -- 172.21.15.49:0/3023160340 wait complete. 2023-11-30T18:41:04.543 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 85 2023-11-30T18:41:04.555 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:41:04.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.712+0000 7f5bb91ad700 1 Processor -- start 2023-11-30T18:41:04.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.712+0000 7f5bb91ad700 1 -- start start 2023-11-30T18:41:04.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.713+0000 7f5bb91ad700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5bb4157a40 0x7f5bb40648d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:04.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.713+0000 7f5bb91ad700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb40c12c0 con 0x7f5bb4157660 2023-11-30T18:41:04.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.713+0000 7f5bb91ad700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb40c06b0 con 0x7f5bb40c0180 2023-11-30T18:41:04.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.713+0000 7f5bb91ad700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bb40c0990 con 0x7f5bb4157a40 2023-11-30T18:41:04.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.713+0000 7f5bb89ac700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5bb4157a40 0x7f5bb40648d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:04.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.713+0000 7f5bb3fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5bb4157660 0x7f5bb41589c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50386/0 (socket says 172.21.15.49:50386) 2023-11-30T18:41:04.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.713+0000 7f5bb89ac700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5bb4157a40 0x7f5bb40648d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48324/0 (socket says 172.21.15.49:48324) 2023-11-30T18:41:04.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.713+0000 7f5bb3fff700 1 -- 172.21.15.49:0/2318070208 learned_addr learned my addr 172.21.15.49:0/2318070208 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:04.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.713+0000 7f5bb89ac700 1 -- 172.21.15.49:0/2318070208 >> v1:172.21.15.115:6789/0 conn(0x7f5bb40c0180 legacy=0x7f5bb40c1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:04.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.713+0000 7f5bb89ac700 1 -- 172.21.15.49:0/2318070208 >> v1:172.21.15.49:6789/0 conn(0x7f5bb4157660 legacy=0x7f5bb41589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:04.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.713+0000 7f5bb89ac700 1 -- 172.21.15.49:0/2318070208 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb40c0c70 con 0x7f5bb4157a40 2023-11-30T18:41:04.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.713+0000 7f5bb89ac700 1 --2- 172.21.15.49:0/2318070208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bb4157a40 0x7f5bb40648d0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 rx=0x7f5bac009e60 tx=0x7f5bac009780).ready entity=mon.0 client_cookie=96a909480c9eece5 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:04.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.714+0000 7f5bb2ffd700 1 -- 172.21.15.49:0/2318070208 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac00e070 con 0x7f5bb4157a40 2023-11-30T18:41:04.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.714+0000 7f5bb2ffd700 1 -- 172.21.15.49:0/2318070208 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bac00bc30 con 0x7f5bb4157a40 2023-11-30T18:41:04.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.714+0000 7f5bb2ffd700 1 -- 172.21.15.49:0/2318070208 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac012410 con 0x7f5bb4157a40 2023-11-30T18:41:04.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.714+0000 7f5bb91ad700 1 -- 172.21.15.49:0/2318070208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bb4157a40 msgr2=0x7f5bb40648d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:04.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.714+0000 7f5bb91ad700 1 --2- 172.21.15.49:0/2318070208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bb4157a40 0x7f5bb40648d0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 rx=0x7f5bac009e60 tx=0x7f5bac009780).stop 2023-11-30T18:41:04.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.714+0000 7f5bb91ad700 1 -- 172.21.15.49:0/2318070208 shutdown_connections 2023-11-30T18:41:04.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.714+0000 7f5bb91ad700 1 --2- 172.21.15.49:0/2318070208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bb4157a40 0x7f5bb40648d0 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:04.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.714+0000 7f5bb91ad700 1 -- 172.21.15.49:0/2318070208 >> 172.21.15.49:0/2318070208 conn(0x7f5bb40cb000 msgr2=0x7f5bb40cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:04.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.714+0000 7f5bb91ad700 1 -- 172.21.15.49:0/2318070208 shutdown_connections 2023-11-30T18:41:04.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.714+0000 7f5bb91ad700 1 -- 172.21.15.49:0/2318070208 wait complete. 2023-11-30T18:41:04.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.715+0000 7f5bb91ad700 1 Processor -- start 2023-11-30T18:41:04.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.716+0000 7f5bb91ad700 1 -- start start 2023-11-30T18:41:04.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.716+0000 7f5bb91ad700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bb40c0180 0x7f5bb414fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:04.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.716+0000 7f5bb91ad700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5bb4157660 0x7f5bb40ae820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:04.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.716+0000 7f5bb91ad700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bb4157a40 0x7f5bb40aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:04.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.716+0000 7f5bb91ad700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb40af200 con 0x7f5bb4157a40 2023-11-30T18:41:04.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.716+0000 7f5bb91ad700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb40b0ba0 con 0x7f5bb4157660 2023-11-30T18:41:04.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.716+0000 7f5bb91ad700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb40c3f80 con 0x7f5bb40c0180 2023-11-30T18:41:04.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.716+0000 7f5bb89ac700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bb4157a40 0x7f5bb40aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:04.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.716+0000 7f5bb89ac700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bb4157a40 0x7f5bb40aed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48326/0 (socket says 172.21.15.49:48326) 2023-11-30T18:41:04.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.716+0000 7f5bb89ac700 1 -- 172.21.15.49:0/257121919 learned_addr learned my addr 172.21.15.49:0/257121919 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:04.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.716+0000 7f5bb3fff700 1 --2- 172.21.15.49:0/257121919 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bb40c0180 0x7f5bb414fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:04.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.716+0000 7f5bb37fe700 1 --2- 172.21.15.49:0/257121919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5bb4157660 0x7f5bb40ae820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:04.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.717+0000 7f5bb89ac700 1 -- 172.21.15.49:0/257121919 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bb40c0180 msgr2=0x7f5bb414fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:04.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.717+0000 7f5bb89ac700 1 --2- 172.21.15.49:0/257121919 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bb40c0180 0x7f5bb414fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:04.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.717+0000 7f5bb89ac700 1 -- 172.21.15.49:0/257121919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5bb4157660 msgr2=0x7f5bb40ae820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:04.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.717+0000 7f5bb89ac700 1 --2- 172.21.15.49:0/257121919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5bb4157660 0x7f5bb40ae820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:04.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.717+0000 7f5bb89ac700 1 -- 172.21.15.49:0/257121919 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bac009a20 con 0x7f5bb4157a40 2023-11-30T18:41:04.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.717+0000 7f5bb89ac700 1 --2- 172.21.15.49:0/257121919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bb4157a40 0x7f5bb40aed10 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 rx=0x7f5bac00b6c0 tx=0x7f5bac009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:04.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.717+0000 7f5babfff700 1 -- 172.21.15.49:0/257121919 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac0064a0 con 0x7f5bb4157a40 2023-11-30T18:41:04.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.717+0000 7f5babfff700 1 -- 172.21.15.49:0/257121919 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bac006600 con 0x7f5bb4157a40 2023-11-30T18:41:04.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.717+0000 7f5bb91ad700 1 -- 172.21.15.49:0/257121919 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb40c3370 con 0x7f5bb4157a40 2023-11-30T18:41:04.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.717+0000 7f5babfff700 1 -- 172.21.15.49:0/257121919 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac0069a0 con 0x7f5bb4157a40 2023-11-30T18:41:04.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.717+0000 7f5bb91ad700 1 -- 172.21.15.49:0/257121919 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb40c3930 con 0x7f5bb4157a40 2023-11-30T18:41:04.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.718+0000 7f5bb91ad700 1 -- 172.21.15.49:0/257121919 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bb406c7c0 con 0x7f5bb4157a40 2023-11-30T18:41:04.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.719+0000 7f5babfff700 1 -- 172.21.15.49:0/257121919 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 96) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f5bac01d630 con 0x7f5bb4157a40 2023-11-30T18:41:04.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.719+0000 7f5babfff700 1 --2- 172.21.15.49:0/257121919 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5b9405f390 0x7f5b94061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:04.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.719+0000 7f5babfff700 1 -- 172.21.15.49:0/257121919 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f5bac07cc80 con 0x7f5bb4157a40 2023-11-30T18:41:04.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.719+0000 7f5bb3fff700 1 -- 172.21.15.49:0/257121919 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5b9405f390 msgr2=0x7f5b94061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:04.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.719+0000 7f5bb3fff700 1 --2- 172.21.15.49:0/257121919 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5b9405f390 0x7f5b94061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:41:04.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.727+0000 7f5babfff700 1 -- 172.21.15.49:0/257121919 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5bac04d9f0 con 0x7f5bb4157a40 2023-11-30T18:41:04.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.900+0000 7f5bb91ad700 1 -- 172.21.15.49:0/257121919 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5bb40bff60 con 0x7f5bb4157a40 2023-11-30T18:41:04.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.901+0000 7f5babfff700 1 -- 172.21.15.49:0/257121919 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v204) v1 ==== 74+0+17451 (secure 0 0 0) 0x7f5bac051010 con 0x7f5bb4157a40 2023-11-30T18:41:04.903 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:04.904 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":204,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:39:54.149974+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-11-30T18:39:35.697536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-11-30T18:39:36.299739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"203","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/1811121398":"2023-12-01T18:39:54.149939+0000","172.21.15.115:0/131972554":"2023-12-01T18:39:54.149939+0000","172.21.15.115:0/1834129081":"2023-12-01T18:39:54.149939+0000","172.21.15.115:6833/103051":"2023-12-01T18:39:54.149939+0000","172.21.15.115:6832/103051":"2023-12-01T18:39:54.149939+0000","172.21.15.115:0/2733548343":"2023-12-01T18:39:54.149939+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:41:04.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.903+0000 7f5bb91ad700 1 -- 172.21.15.49:0/257121919 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5b9405f390 msgr2=0x7f5b94061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:41:04.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.903+0000 7f5bb91ad700 1 --2- 172.21.15.49:0/257121919 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5b9405f390 0x7f5b94061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:04.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.903+0000 7f5bb91ad700 1 -- 172.21.15.49:0/257121919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bb4157a40 msgr2=0x7f5bb40aed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:04.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.903+0000 7f5bb91ad700 1 --2- 172.21.15.49:0/257121919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bb4157a40 0x7f5bb40aed10 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 rx=0x7f5bac00b6c0 tx=0x7f5bac009780).stop 2023-11-30T18:41:04.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.903+0000 7f5bb91ad700 1 -- 172.21.15.49:0/257121919 shutdown_connections 2023-11-30T18:41:04.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.903+0000 7f5bb91ad700 1 --2- 172.21.15.49:0/257121919 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5b9405f390 0x7f5b94061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:04.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.903+0000 7f5bb91ad700 1 --2- 172.21.15.49:0/257121919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bb4157a40 0x7f5bb40aed10 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:04.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.903+0000 7f5bb91ad700 1 --2- 172.21.15.49:0/257121919 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bb40c0180 0x7f5bb414fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:04.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.903+0000 7f5bb91ad700 1 --2- 172.21.15.49:0/257121919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5bb4157660 0x7f5bb40ae820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:04.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.903+0000 7f5bb91ad700 1 -- 172.21.15.49:0/257121919 >> 172.21.15.49:0/257121919 conn(0x7f5bb40cb000 msgr2=0x7f5bb40ab130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:04.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.904+0000 7f5bb91ad700 1 -- 172.21.15.49:0/257121919 shutdown_connections 2023-11-30T18:41:04.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:04.904+0000 7f5bb91ad700 1 -- 172.21.15.49:0/257121919 wait complete. 2023-11-30T18:41:04.919 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '192', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-30T18:39:35.697536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '202', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-11-30T18:39:36.299739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '203', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-30T18:41:04.919 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T18:41:05.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.044+0000 7f7c08171700 1 Processor -- start 2023-11-30T18:41:05.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.044+0000 7f7c08171700 1 -- start start 2023-11-30T18:41:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.045+0000 7f7c08171700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7c00098d10 0x7f7c000c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.045+0000 7f7c08171700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7c000c6190 0x7f7c00063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.045+0000 7f7c08171700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c000c72d0 con 0x7f7c00064350 2023-11-30T18:41:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.045+0000 7f7c08171700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c00154bc0 con 0x7f7c00098d10 2023-11-30T18:41:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.045+0000 7f7c08171700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c000c66c0 con 0x7f7c000c6190 2023-11-30T18:41:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.045+0000 7f7c05f0d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7c00098d10 0x7f7c000c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.045+0000 7f7c0670e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7c00064350 0x7f7c00158320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50400/0 (socket says 172.21.15.49:50400) 2023-11-30T18:41:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.045+0000 7f7c0670e700 1 -- 172.21.15.49:0/540744177 learned_addr learned my addr 172.21.15.49:0/540744177 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:05.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.045+0000 7f7c0570c700 1 --2- 172.21.15.49:0/540744177 >> v2:172.21.15.115:3300/0 conn(0x7f7c000c6190 0x7f7c00063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:05.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.045+0000 7f7c05f0d700 1 -- 172.21.15.49:0/540744177 >> v2:172.21.15.115:3300/0 conn(0x7f7c000c6190 msgr2=0x7f7c00063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:05.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.045+0000 7f7c05f0d700 1 --2- 172.21.15.49:0/540744177 >> v2:172.21.15.115:3300/0 conn(0x7f7c000c6190 0x7f7c00063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:05.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.045+0000 7f7c05f0d700 1 -- 172.21.15.49:0/540744177 >> v1:172.21.15.49:6789/0 conn(0x7f7c00064350 legacy=0x7f7c00158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:05.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.045+0000 7f7c05f0d700 1 -- 172.21.15.49:0/540744177 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c000c69a0 con 0x7f7c00098d10 2023-11-30T18:41:05.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.045+0000 7f7c04f0b700 1 -- 172.21.15.49:0/540744177 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3580662085 0 0) 0x7f7c000c72d0 con 0x7f7c00064350 2023-11-30T18:41:05.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.045+0000 7f7c0570c700 1 --2- 172.21.15.49:0/540744177 >> v2:172.21.15.115:3300/0 conn(0x7f7c000c6190 0x7f7c00063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:41:05.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.045+0000 7f7c05f0d700 1 --2- 172.21.15.49:0/540744177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c00098d10 0x7f7c000c7760 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 rx=0x7f7c000c5b40 tx=0x7f7bfc009060).ready entity=mon.0 client_cookie=820897cf7c2d6168 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:05.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.046+0000 7f7c04f0b700 1 -- 172.21.15.49:0/540744177 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc00b580 con 0x7f7c00098d10 2023-11-30T18:41:05.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.046+0000 7f7c04f0b700 1 -- 172.21.15.49:0/540744177 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bfc00b6e0 con 0x7f7c00098d10 2023-11-30T18:41:05.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.046+0000 7f7c04f0b700 1 -- 172.21.15.49:0/540744177 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc00ba60 con 0x7f7c00098d10 2023-11-30T18:41:05.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.046+0000 7f7c08171700 1 -- 172.21.15.49:0/540744177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c00098d10 msgr2=0x7f7c000c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:05.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.046+0000 7f7c08171700 1 --2- 172.21.15.49:0/540744177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c00098d10 0x7f7c000c7760 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 rx=0x7f7c000c5b40 tx=0x7f7bfc009060).stop 2023-11-30T18:41:05.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.046+0000 7f7c08171700 1 -- 172.21.15.49:0/540744177 shutdown_connections 2023-11-30T18:41:05.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.046+0000 7f7c08171700 1 --2- 172.21.15.49:0/540744177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c00098d10 0x7f7c000c7760 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:05.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.046+0000 7f7c08171700 1 --2- 172.21.15.49:0/540744177 >> v2:172.21.15.115:3300/0 conn(0x7f7c000c6190 0x7f7c00063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:05.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.046+0000 7f7c08171700 1 -- 172.21.15.49:0/540744177 >> 172.21.15.49:0/540744177 conn(0x7f7c000cb310 msgr2=0x7f7c000cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:05.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.046+0000 7f7c08171700 1 -- 172.21.15.49:0/540744177 shutdown_connections 2023-11-30T18:41:05.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.046+0000 7f7c08171700 1 -- 172.21.15.49:0/540744177 wait complete. 2023-11-30T18:41:05.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.048+0000 7f7c08171700 1 Processor -- start 2023-11-30T18:41:05.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.048+0000 7f7c08171700 1 -- start start 2023-11-30T18:41:05.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.048+0000 7f7c08171700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c00064350 0x7f7c000ab080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:05.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.048+0000 7f7c08171700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c00098d10 0x7f7c000c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:05.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.048+0000 7f7c08171700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c000c6190 0x7f7c0013f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:05.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.048+0000 7f7c08171700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c000c4dd0 con 0x7f7c00098d10 2023-11-30T18:41:05.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.048+0000 7f7c08171700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c000ab570 con 0x7f7c000c6190 2023-11-30T18:41:05.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.048+0000 7f7c08171700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c000c4530 con 0x7f7c00064350 2023-11-30T18:41:05.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.048+0000 7f7c0570c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c00098d10 0x7f7c000c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:05.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.048+0000 7f7c0570c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c00098d10 0x7f7c000c3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48344/0 (socket says 172.21.15.49:48344) 2023-11-30T18:41:05.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.049+0000 7f7c0570c700 1 -- 172.21.15.49:0/3861037781 learned_addr learned my addr 172.21.15.49:0/3861037781 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:05.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.049+0000 7f7c05f0d700 1 --2- 172.21.15.49:0/3861037781 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c00064350 0x7f7c000ab080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:05.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.049+0000 7f7c0670e700 1 --2- 172.21.15.49:0/3861037781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c000c6190 0x7f7c0013f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:05.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.049+0000 7f7c0570c700 1 -- 172.21.15.49:0/3861037781 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c00064350 msgr2=0x7f7c000ab080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:05.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.049+0000 7f7c0570c700 1 --2- 172.21.15.49:0/3861037781 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c00064350 0x7f7c000ab080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:05.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.049+0000 7f7c0570c700 1 -- 172.21.15.49:0/3861037781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c000c6190 msgr2=0x7f7c0013f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:05.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.049+0000 7f7c0570c700 1 --2- 172.21.15.49:0/3861037781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c000c6190 0x7f7c0013f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:05.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.049+0000 7f7c0570c700 1 -- 172.21.15.49:0/3861037781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bfc0092a0 con 0x7f7c00098d10 2023-11-30T18:41:05.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.049+0000 7f7c0570c700 1 --2- 172.21.15.49:0/3861037781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c00098d10 0x7f7c000c3d20 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 rx=0x7f7bf400d890 tx=0x7f7bf4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:05.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.049+0000 7f7bf1ffb700 1 -- 172.21.15.49:0/3861037781 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf40125f0 con 0x7f7c00098d10 2023-11-30T18:41:05.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.049+0000 7f7bf1ffb700 1 -- 172.21.15.49:0/3861037781 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf4012750 con 0x7f7c00098d10 2023-11-30T18:41:05.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.049+0000 7f7c08171700 1 -- 172.21.15.49:0/3861037781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c000c4870 con 0x7f7c00098d10 2023-11-30T18:41:05.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.049+0000 7f7bf1ffb700 1 -- 172.21.15.49:0/3861037781 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4012ad0 con 0x7f7c00098d10 2023-11-30T18:41:05.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.049+0000 7f7c08171700 1 -- 172.21.15.49:0/3861037781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c000c4210 con 0x7f7c00098d10 2023-11-30T18:41:05.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.051+0000 7f7c08171700 1 -- 172.21.15.49:0/3861037781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c0006c860 con 0x7f7c00098d10 2023-11-30T18:41:05.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.051+0000 7f7bf1ffb700 1 -- 172.21.15.49:0/3861037781 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 96) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f7bf4013480 con 0x7f7c00098d10 2023-11-30T18:41:05.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.051+0000 7f7bf1ffb700 1 --2- 172.21.15.49:0/3861037781 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f7be405f390 0x7f7be4061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:05.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.051+0000 7f7c05f0d700 1 -- 172.21.15.49:0/3861037781 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f7be405f390 msgr2=0x7f7be4061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:05.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.051+0000 7f7bf1ffb700 1 -- 172.21.15.49:0/3861037781 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f7bf407a410 con 0x7f7c00098d10 2023-11-30T18:41:05.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.051+0000 7f7c05f0d700 1 --2- 172.21.15.49:0/3861037781 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f7be405f390 0x7f7be4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:41:05.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.059+0000 7f7bf1ffb700 1 -- 172.21.15.49:0/3861037781 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7bf404b2e0 con 0x7f7c00098d10 2023-11-30T18:41:05.086 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:05.085+0000 7f82c7cd7680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T18:41:05.158 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:05.157+0000 7f82c7cd7680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T18:41:05.173 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:05.171+0000 7fc8bc633680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T18:41:05.243 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:05.241+0000 7fc8bc633680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T18:41:05.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.252+0000 7f7c05f0d700 1 -- 172.21.15.49:0/3861037781 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f7be405f390 msgr2=0x7f7be4061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:05.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.252+0000 7f7c05f0d700 1 --2- 172.21.15.49:0/3861037781 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f7be405f390 0x7f7be4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T18:41:05.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.279+0000 7f7c08171700 1 -- 172.21.15.49:0/3861037781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7c000c6c80 con 0x7f7c00098d10 2023-11-30T18:41:05.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.280+0000 7f7bf1ffb700 1 -- 172.21.15.49:0/3861037781 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v204) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7bf404e900 con 0x7f7c00098d10 2023-11-30T18:41:05.281 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T18:41:05.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.281+0000 7f7c08171700 1 -- 172.21.15.49:0/3861037781 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f7be405f390 msgr2=0x7f7be4061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:41:05.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.281+0000 7f7c08171700 1 --2- 172.21.15.49:0/3861037781 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f7be405f390 0x7f7be4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:05.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.282+0000 7f7c08171700 1 -- 172.21.15.49:0/3861037781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c00098d10 msgr2=0x7f7c000c3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:05.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.282+0000 7f7c08171700 1 --2- 172.21.15.49:0/3861037781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c00098d10 0x7f7c000c3d20 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 rx=0x7f7bf400d890 tx=0x7f7bf4008040).stop 2023-11-30T18:41:05.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.282+0000 7f7c08171700 1 -- 172.21.15.49:0/3861037781 shutdown_connections 2023-11-30T18:41:05.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.282+0000 7f7c08171700 1 --2- 172.21.15.49:0/3861037781 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f7be405f390 0x7f7be4061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:05.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.282+0000 7f7c08171700 1 --2- 172.21.15.49:0/3861037781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c000c6190 0x7f7c0013f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:05.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.282+0000 7f7c08171700 1 --2- 172.21.15.49:0/3861037781 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c00064350 0x7f7c000ab080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:05.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.282+0000 7f7c08171700 1 --2- 172.21.15.49:0/3861037781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c00098d10 0x7f7c000c3d20 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:05.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.282+0000 7f7c08171700 1 -- 172.21.15.49:0/3861037781 >> 172.21.15.49:0/3861037781 conn(0x7f7c000cb310 msgr2=0x7f7c00151c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:05.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.282+0000 7f7c08171700 1 -- 172.21.15.49:0/3861037781 shutdown_connections 2023-11-30T18:41:05.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.282+0000 7f7c08171700 1 -- 172.21.15.49:0/3861037781 wait complete. 2023-11-30T18:41:05.297 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T18:41:05.343 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:05.343+0000 7f82c7cd7680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T18:41:05.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.421+0000 7f1468d32700 1 Processor -- start 2023-11-30T18:41:05.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.421+0000 7f1468d32700 1 -- start start 2023-11-30T18:41:05.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.422+0000 7f1468d32700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1464062e10 0x7f14640a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:05.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.422+0000 7f1468d32700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14640c7e30 con 0x7f14640c86f0 2023-11-30T18:41:05.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.422+0000 7f1468d32700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14640bcf40 con 0x7f14641547f0 2023-11-30T18:41:05.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.422+0000 7f1468d32700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14640c6b20 con 0x7f1464062e10 2023-11-30T18:41:05.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.422+0000 7f1462d9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1464062e10 0x7f14640a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:05.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.422+0000 7f1462d9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1464062e10 0x7f14640a72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48360/0 (socket says 172.21.15.49:48360) 2023-11-30T18:41:05.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.422+0000 7f1462d9d700 1 -- 172.21.15.49:0/2786196140 learned_addr learned my addr 172.21.15.49:0/2786196140 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:05.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.422+0000 7f1461d9b700 1 --1- 172.21.15.49:0/2786196140 >> v1:172.21.15.49:6789/0 conn(0x7f14640c86f0 0x7f1464062700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50402/0 (socket says 172.21.15.49:50402) 2023-11-30T18:41:05.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.423+0000 7f1462d9d700 1 -- 172.21.15.49:0/2786196140 >> v1:172.21.15.115:6789/0 conn(0x7f14641547f0 legacy=0x7f14640c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:05.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.423+0000 7f1462d9d700 1 -- 172.21.15.49:0/2786196140 >> v1:172.21.15.49:6789/0 conn(0x7f14640c86f0 legacy=0x7f1464062700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:05.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.423+0000 7f1462d9d700 1 -- 172.21.15.49:0/2786196140 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14640a77d0 con 0x7f1464062e10 2023-11-30T18:41:05.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.423+0000 7f146159a700 1 -- 172.21.15.49:0/2786196140 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3034736588 0 0) 0x7f14640c7e30 con 0x7f14640c86f0 2023-11-30T18:41:05.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.423+0000 7f1462d9d700 1 --2- 172.21.15.49:0/2786196140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1464062e10 0x7f14640a72e0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 rx=0x7f145c009f20 tx=0x7f145c009840).ready entity=mon.0 client_cookie=b7a7f7df8a67ceae server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:05.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.423+0000 7f146159a700 1 -- 172.21.15.49:0/2786196140 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c00e070 con 0x7f1464062e10 2023-11-30T18:41:05.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.423+0000 7f146159a700 1 -- 172.21.15.49:0/2786196140 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145c00ba80 con 0x7f1464062e10 2023-11-30T18:41:05.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.423+0000 7f146159a700 1 -- 172.21.15.49:0/2786196140 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c00be00 con 0x7f1464062e10 2023-11-30T18:41:05.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.424+0000 7f1468d32700 1 -- 172.21.15.49:0/2786196140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1464062e10 msgr2=0x7f14640a72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:05.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.424+0000 7f1468d32700 1 --2- 172.21.15.49:0/2786196140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1464062e10 0x7f14640a72e0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 rx=0x7f145c009f20 tx=0x7f145c009840).stop 2023-11-30T18:41:05.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.424+0000 7f1468d32700 1 -- 172.21.15.49:0/2786196140 shutdown_connections 2023-11-30T18:41:05.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.424+0000 7f1468d32700 1 --2- 172.21.15.49:0/2786196140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1464062e10 0x7f14640a72e0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:05.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.424+0000 7f1468d32700 1 -- 172.21.15.49:0/2786196140 >> 172.21.15.49:0/2786196140 conn(0x7f14640642d0 msgr2=0x7f14640c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:05.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.424+0000 7f1468d32700 1 -- 172.21.15.49:0/2786196140 shutdown_connections 2023-11-30T18:41:05.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.424+0000 7f1468d32700 1 -- 172.21.15.49:0/2786196140 wait complete. 2023-11-30T18:41:05.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.425+0000 7f1468d32700 1 Processor -- start 2023-11-30T18:41:05.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.425+0000 7f1468d32700 1 -- start start 2023-11-30T18:41:05.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.426+0000 7f1468d32700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1464062e10 0x7f146413a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:05.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.426+0000 7f1468d32700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14640c86f0 0x7f14640a5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:05.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.426+0000 7f1468d32700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14641547f0 0x7f14640a5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:05.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.426+0000 7f1468d32700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14640ae110 con 0x7f14641547f0 2023-11-30T18:41:05.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.426+0000 7f1468d32700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14640a5f20 con 0x7f14640c86f0 2023-11-30T18:41:05.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.426+0000 7f1468d32700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1464165ee0 con 0x7f1464062e10 2023-11-30T18:41:05.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.426+0000 7f1462d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14641547f0 0x7f14640a5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:05.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.426+0000 7f1462d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14641547f0 0x7f14640a5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48374/0 (socket says 172.21.15.49:48374) 2023-11-30T18:41:05.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.426+0000 7f1462d9d700 1 -- 172.21.15.49:0/1041064424 learned_addr learned my addr 172.21.15.49:0/1041064424 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:05.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.426+0000 7f1461d9b700 1 --2- 172.21.15.49:0/1041064424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14640c86f0 0x7f14640a5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:05.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.426+0000 7f146259c700 1 --2- 172.21.15.49:0/1041064424 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1464062e10 0x7f146413a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:05.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.426+0000 7f1462d9d700 1 -- 172.21.15.49:0/1041064424 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1464062e10 msgr2=0x7f146413a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:05.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.426+0000 7f1462d9d700 1 --2- 172.21.15.49:0/1041064424 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1464062e10 0x7f146413a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:05.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.426+0000 7f1462d9d700 1 -- 172.21.15.49:0/1041064424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14640c86f0 msgr2=0x7f14640a5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:05.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.426+0000 7f1462d9d700 1 --2- 172.21.15.49:0/1041064424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14640c86f0 0x7f14640a5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:05.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.426+0000 7f1462d9d700 1 -- 172.21.15.49:0/1041064424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145c009ae0 con 0x7f14641547f0 2023-11-30T18:41:05.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.426+0000 7f1462d9d700 1 --2- 172.21.15.49:0/1041064424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14641547f0 0x7f14640a5a30 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 rx=0x7f14640695b0 tx=0x7f145c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:05.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.427+0000 7f145a7fc700 1 -- 172.21.15.49:0/1041064424 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c00b6f0 con 0x7f14641547f0 2023-11-30T18:41:05.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.427+0000 7f145a7fc700 1 -- 172.21.15.49:0/1041064424 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145c0092e0 con 0x7f14641547f0 2023-11-30T18:41:05.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.427+0000 7f145a7fc700 1 -- 172.21.15.49:0/1041064424 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c01e6a0 con 0x7f14641547f0 2023-11-30T18:41:05.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.427+0000 7f1468d32700 1 -- 172.21.15.49:0/1041064424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14640adb50 con 0x7f14641547f0 2023-11-30T18:41:05.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.427+0000 7f1468d32700 1 -- 172.21.15.49:0/1041064424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1464165b70 con 0x7f14641547f0 2023-11-30T18:41:05.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.428+0000 7f145a7fc700 1 -- 172.21.15.49:0/1041064424 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 96) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f145c003040 con 0x7f14641547f0 2023-11-30T18:41:05.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.428+0000 7f1468d32700 1 -- 172.21.15.49:0/1041064424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14641659d0 con 0x7f14641547f0 2023-11-30T18:41:05.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.428+0000 7f145a7fc700 1 --2- 172.21.15.49:0/1041064424 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f144405f390 0x7f1444061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:05.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.428+0000 7f145a7fc700 1 -- 172.21.15.49:0/1041064424 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f145c07bd10 con 0x7f14641547f0 2023-11-30T18:41:05.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.428+0000 7f146259c700 1 -- 172.21.15.49:0/1041064424 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f144405f390 msgr2=0x7f1444061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:05.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.428+0000 7f146259c700 1 --2- 172.21.15.49:0/1041064424 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f144405f390 0x7f1444061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:41:05.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.433+0000 7f145a7fc700 1 -- 172.21.15.49:0/1041064424 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f14641659d0 con 0x7f14641547f0 2023-11-30T18:41:05.446 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:05.445+0000 7fc8bc633680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T18:41:05.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.608+0000 7f1468d32700 1 -- 172.21.15.49:0/1041064424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f14641659d0 con 0x7f14641547f0 2023-11-30T18:41:05.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.608+0000 7f145a7fc700 1 -- 172.21.15.49:0/1041064424 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v204) v1 ==== 92+0+10 (secure 0 0 0) 0x7f14641659d0 con 0x7f14641547f0 2023-11-30T18:41:05.610 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T18:41:05.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.610+0000 7f1468d32700 1 -- 172.21.15.49:0/1041064424 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f144405f390 msgr2=0x7f1444061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:41:05.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.610+0000 7f1468d32700 1 --2- 172.21.15.49:0/1041064424 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f144405f390 0x7f1444061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:05.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.610+0000 7f1468d32700 1 -- 172.21.15.49:0/1041064424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14641547f0 msgr2=0x7f14640a5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:05.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.610+0000 7f1468d32700 1 --2- 172.21.15.49:0/1041064424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14641547f0 0x7f14640a5a30 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 rx=0x7f14640695b0 tx=0x7f145c009840).stop 2023-11-30T18:41:05.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.610+0000 7f1468d32700 1 -- 172.21.15.49:0/1041064424 shutdown_connections 2023-11-30T18:41:05.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.610+0000 7f1468d32700 1 --2- 172.21.15.49:0/1041064424 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f144405f390 0x7f1444061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:05.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.610+0000 7f1468d32700 1 --2- 172.21.15.49:0/1041064424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14641547f0 0x7f14640a5a30 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:05.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.610+0000 7f1468d32700 1 --2- 172.21.15.49:0/1041064424 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1464062e10 0x7f146413a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:05.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.610+0000 7f1468d32700 1 --2- 172.21.15.49:0/1041064424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14640c86f0 0x7f14640a5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:05.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.610+0000 7f1468d32700 1 -- 172.21.15.49:0/1041064424 >> 172.21.15.49:0/1041064424 conn(0x7f14640642d0 msgr2=0x7f14640c5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:05.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.610+0000 7f1468d32700 1 -- 172.21.15.49:0/1041064424 shutdown_connections 2023-11-30T18:41:05.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.610+0000 7f1468d32700 1 -- 172.21.15.49:0/1041064424 wait complete. 2023-11-30T18:41:05.624 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-30T18:41:05.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.748+0000 7feb02d87700 1 Processor -- start 2023-11-30T18:41:05.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.748+0000 7feb02d87700 1 -- start start 2023-11-30T18:41:05.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.749+0000 7feb02d87700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feafc1546f0 0x7feafc0673b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:05.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.749+0000 7feb02d87700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feafc0c9ad0 con 0x7feafc0678a0 2023-11-30T18:41:05.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.749+0000 7feb02d87700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feafc067e70 con 0x7feafc096590 2023-11-30T18:41:05.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.749+0000 7feb02d87700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feafc154f40 con 0x7feafc1546f0 2023-11-30T18:41:05.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.749+0000 7feb00b23700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feafc1546f0 0x7feafc0673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:05.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.749+0000 7feafbfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7feafc0678a0 0x7feafc095e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50408/0 (socket says 172.21.15.49:50408) 2023-11-30T18:41:05.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.749+0000 7feb00b23700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feafc1546f0 0x7feafc0673b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48386/0 (socket says 172.21.15.49:48386) 2023-11-30T18:41:05.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.749+0000 7feafbfff700 1 -- 172.21.15.49:0/3420537802 learned_addr learned my addr 172.21.15.49:0/3420537802 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:05.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.749+0000 7feb00b23700 1 -- 172.21.15.49:0/3420537802 >> v1:172.21.15.115:6789/0 conn(0x7feafc096590 legacy=0x7feafc0beb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:05.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.749+0000 7feb00b23700 1 -- 172.21.15.49:0/3420537802 >> v1:172.21.15.49:6789/0 conn(0x7feafc0678a0 legacy=0x7feafc095e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:05.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.749+0000 7feb00b23700 1 -- 172.21.15.49:0/3420537802 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc155220 con 0x7feafc1546f0 2023-11-30T18:41:05.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.749+0000 7feafb7fe700 1 -- 172.21.15.49:0/3420537802 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040206276 0 0) 0x7feafc0c9ad0 con 0x7feafc0678a0 2023-11-30T18:41:05.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.749+0000 7feb00b23700 1 --2- 172.21.15.49:0/3420537802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feafc1546f0 0x7feafc0673b0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 rx=0x7feaf0009760 tx=0x7feaf0009060).ready entity=mon.0 client_cookie=f8e623a2b6c68790 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:05.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.749+0000 7feafb7fe700 1 -- 172.21.15.49:0/3420537802 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf000b580 con 0x7feafc1546f0 2023-11-30T18:41:05.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.749+0000 7feafb7fe700 1 -- 172.21.15.49:0/3420537802 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf000b6e0 con 0x7feafc1546f0 2023-11-30T18:41:05.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.750+0000 7feafb7fe700 1 -- 172.21.15.49:0/3420537802 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf000ba60 con 0x7feafc1546f0 2023-11-30T18:41:05.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.750+0000 7feb02d87700 1 -- 172.21.15.49:0/3420537802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feafc1546f0 msgr2=0x7feafc0673b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:05.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.750+0000 7feb02d87700 1 --2- 172.21.15.49:0/3420537802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feafc1546f0 0x7feafc0673b0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 rx=0x7feaf0009760 tx=0x7feaf0009060).stop 2023-11-30T18:41:05.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.750+0000 7feb02d87700 1 -- 172.21.15.49:0/3420537802 shutdown_connections 2023-11-30T18:41:05.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.750+0000 7feb02d87700 1 --2- 172.21.15.49:0/3420537802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feafc1546f0 0x7feafc0673b0 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:05.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.750+0000 7feb02d87700 1 -- 172.21.15.49:0/3420537802 >> 172.21.15.49:0/3420537802 conn(0x7feafc0631d0 msgr2=0x7feafc0c9160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:05.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.750+0000 7feb02d87700 1 -- 172.21.15.49:0/3420537802 shutdown_connections 2023-11-30T18:41:05.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.750+0000 7feb02d87700 1 -- 172.21.15.49:0/3420537802 wait complete. 2023-11-30T18:41:05.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.751+0000 7feb02d87700 1 Processor -- start 2023-11-30T18:41:05.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.751+0000 7feb02d87700 1 -- start start 2023-11-30T18:41:05.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.752+0000 7feb02d87700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feafc0678a0 0x7feafc156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:05.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.752+0000 7feb02d87700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feafc096590 0x7feafc1645d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:05.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.752+0000 7feb02d87700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feafc1546f0 0x7feafc0a8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:05.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.752+0000 7feb02d87700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feafc0c08d0 con 0x7feafc096590 2023-11-30T18:41:05.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.752+0000 7feb02d87700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feafc156b80 con 0x7feafc0678a0 2023-11-30T18:41:05.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.752+0000 7feb02d87700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feafc156e60 con 0x7feafc1546f0 2023-11-30T18:41:05.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.752+0000 7feafbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feafc096590 0x7feafc1645d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:05.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.752+0000 7feafbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feafc096590 0x7feafc1645d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48398/0 (socket says 172.21.15.49:48398) 2023-11-30T18:41:05.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.752+0000 7feafbfff700 1 -- 172.21.15.49:0/805293201 learned_addr learned my addr 172.21.15.49:0/805293201 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:05.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.752+0000 7feb00b23700 1 --2- 172.21.15.49:0/805293201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feafc0678a0 0x7feafc156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:05.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.752+0000 7feb01324700 1 --2- 172.21.15.49:0/805293201 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feafc1546f0 0x7feafc0a8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:05.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.753+0000 7feafbfff700 1 -- 172.21.15.49:0/805293201 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feafc1546f0 msgr2=0x7feafc0a8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:05.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.753+0000 7feafbfff700 1 --2- 172.21.15.49:0/805293201 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feafc1546f0 0x7feafc0a8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:05.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.753+0000 7feafbfff700 1 -- 172.21.15.49:0/805293201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feafc0678a0 msgr2=0x7feafc156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:05.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.753+0000 7feafbfff700 1 --2- 172.21.15.49:0/805293201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feafc0678a0 0x7feafc156330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:05.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.753+0000 7feafbfff700 1 -- 172.21.15.49:0/805293201 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf00092a0 con 0x7feafc096590 2023-11-30T18:41:05.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.753+0000 7feafbfff700 1 --2- 172.21.15.49:0/805293201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feafc096590 0x7feafc1645d0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 rx=0x7feae800c490 tx=0x7feae8007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:05.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.753+0000 7feaf8ff9700 1 -- 172.21.15.49:0/805293201 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae80070d0 con 0x7feafc096590 2023-11-30T18:41:05.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.753+0000 7feaf8ff9700 1 -- 172.21.15.49:0/805293201 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae8007230 con 0x7feafc096590 2023-11-30T18:41:05.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.753+0000 7feb02d87700 1 -- 172.21.15.49:0/805293201 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feafc157140 con 0x7feafc096590 2023-11-30T18:41:05.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.753+0000 7feaf8ff9700 1 -- 172.21.15.49:0/805293201 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae80075f0 con 0x7feafc096590 2023-11-30T18:41:05.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.753+0000 7feb02d87700 1 -- 172.21.15.49:0/805293201 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feafc156820 con 0x7feafc096590 2023-11-30T18:41:05.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.754+0000 7feb02d87700 1 -- 172.21.15.49:0/805293201 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feafc0c0d60 con 0x7feafc096590 2023-11-30T18:41:05.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.755+0000 7feaf8ff9700 1 -- 172.21.15.49:0/805293201 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 96) v1 ==== 75662+0+0 (secure 0 0 0) 0x7feae80059b0 con 0x7feafc096590 2023-11-30T18:41:05.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.755+0000 7feaf8ff9700 1 --2- 172.21.15.49:0/805293201 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7feae005f390 0x7feae0061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:05.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.755+0000 7feb00b23700 1 -- 172.21.15.49:0/805293201 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7feae005f390 msgr2=0x7feae0061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:05.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.755+0000 7feaf8ff9700 1 -- 172.21.15.49:0/805293201 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6463+0+0 (secure 0 0 0) 0x7feae8079d60 con 0x7feafc096590 2023-11-30T18:41:05.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.755+0000 7feb00b23700 1 --2- 172.21.15.49:0/805293201 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7feae005f390 0x7feae0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:41:05.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.760+0000 7feaf8ff9700 1 -- 172.21.15.49:0/805293201 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7feafc0c0d60 con 0x7feafc096590 2023-11-30T18:41:05.765 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:05.764+0000 7f82c7cd7680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T18:41:05.869 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:05.868+0000 7f82c7cd7680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:41:05.893 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:05.891+0000 7fc8bc633680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T18:41:05.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.932+0000 7feb02d87700 1 -- 172.21.15.49:0/805293201 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feafc0c0d60 con 0x7feafc096590 2023-11-30T18:41:05.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.932+0000 7feaf8ff9700 1 -- 172.21.15.49:0/805293201 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v204) v1 ==== 104+0+11 (secure 0 0 0) 0x7feafc0c0d60 con 0x7feafc096590 2023-11-30T18:41:05.934 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T18:41:05.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.934+0000 7feb02d87700 1 -- 172.21.15.49:0/805293201 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7feae005f390 msgr2=0x7feae0061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:41:05.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.934+0000 7feb02d87700 1 --2- 172.21.15.49:0/805293201 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7feae005f390 0x7feae0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:05.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.934+0000 7feb02d87700 1 -- 172.21.15.49:0/805293201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feafc096590 msgr2=0x7feafc1645d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:05.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.934+0000 7feb02d87700 1 --2- 172.21.15.49:0/805293201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feafc096590 0x7feafc1645d0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 rx=0x7feae800c490 tx=0x7feae8007e40).stop 2023-11-30T18:41:05.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.934+0000 7feb02d87700 1 -- 172.21.15.49:0/805293201 shutdown_connections 2023-11-30T18:41:05.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.934+0000 7feb02d87700 1 --2- 172.21.15.49:0/805293201 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7feae005f390 0x7feae0061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:05.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.934+0000 7feb02d87700 1 --2- 172.21.15.49:0/805293201 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feafc1546f0 0x7feafc0a8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:05.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.934+0000 7feb02d87700 1 --2- 172.21.15.49:0/805293201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feafc0678a0 0x7feafc156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:05.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.934+0000 7feb02d87700 1 --2- 172.21.15.49:0/805293201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feafc096590 0x7feafc1645d0 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:05.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.934+0000 7feb02d87700 1 -- 172.21.15.49:0/805293201 >> 172.21.15.49:0/805293201 conn(0x7feafc0631d0 msgr2=0x7feafc0c80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:05.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.934+0000 7feb02d87700 1 -- 172.21.15.49:0/805293201 shutdown_connections 2023-11-30T18:41:05.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:05.934+0000 7feb02d87700 1 -- 172.21.15.49:0/805293201 wait complete. 2023-11-30T18:41:05.949 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-30T18:41:06.006 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:06.004+0000 7fc8bc633680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:41:06.022 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:06.021+0000 7f82c7cd7680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T18:41:06.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.071+0000 7f7345d7d700 1 Processor -- start 2023-11-30T18:41:06.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.071+0000 7f7345d7d700 1 -- start start 2023-11-30T18:41:06.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.071+0000 7f7345d7d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7340069d10 0x7f734006a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:06.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.071+0000 7f7345d7d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f73400bd1f0 0x7f73400bd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:06.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.071+0000 7f7345d7d700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73400c3470 con 0x7f7340151a20 2023-11-30T18:41:06.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.071+0000 7f7345d7d700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73400c48f0 con 0x7f73400bd1f0 2023-11-30T18:41:06.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.071+0000 7f7345d7d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73400bdb50 con 0x7f7340069d10 2023-11-30T18:41:06.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.072+0000 7f733ffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f73400bd1f0 0x7f73400bd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:06.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.072+0000 7f733ffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f73400bd1f0 0x7f73400bd660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48408/0 (socket says 172.21.15.49:48408) 2023-11-30T18:41:06.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.072+0000 7f733ffff700 1 -- 172.21.15.49:0/1820348906 learned_addr learned my addr 172.21.15.49:0/1820348906 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:06.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.072+0000 7f733f7fe700 1 --2- 172.21.15.49:0/1820348906 >> v2:172.21.15.115:3300/0 conn(0x7f7340069d10 0x7f734006a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:06.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.072+0000 7f733ffff700 1 -- 172.21.15.49:0/1820348906 >> v2:172.21.15.115:3300/0 conn(0x7f7340069d10 msgr2=0x7f734006a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:06.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.072+0000 7f733ffff700 1 --2- 172.21.15.49:0/1820348906 >> v2:172.21.15.115:3300/0 conn(0x7f7340069d10 0x7f734006a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:06.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.072+0000 7f733ffff700 1 -- 172.21.15.49:0/1820348906 >> v1:172.21.15.115:6789/0 conn(0x7f7340151a20 legacy=0x7f73400be1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:06.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.072+0000 7f733ffff700 1 -- 172.21.15.49:0/1820348906 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7340151ea0 con 0x7f73400bd1f0 2023-11-30T18:41:06.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.072+0000 7f733ffff700 1 --2- 172.21.15.49:0/1820348906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73400bd1f0 0x7f73400bd660 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 rx=0x7f734005f7f0 tx=0x7f7338009840).ready entity=mon.0 client_cookie=428073487420759f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:06.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.072+0000 7f733e7fc700 1 -- 172.21.15.49:0/1820348906 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733800e070 con 0x7f73400bd1f0 2023-11-30T18:41:06.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.072+0000 7f733e7fc700 1 -- 172.21.15.49:0/1820348906 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733800ba20 con 0x7f73400bd1f0 2023-11-30T18:41:06.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.072+0000 7f733e7fc700 1 -- 172.21.15.49:0/1820348906 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733800bda0 con 0x7f73400bd1f0 2023-11-30T18:41:06.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.073+0000 7f7345d7d700 1 -- 172.21.15.49:0/1820348906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73400bd1f0 msgr2=0x7f73400bd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:06.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.073+0000 7f7345d7d700 1 --2- 172.21.15.49:0/1820348906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73400bd1f0 0x7f73400bd660 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 rx=0x7f734005f7f0 tx=0x7f7338009840).stop 2023-11-30T18:41:06.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.073+0000 7f7345d7d700 1 -- 172.21.15.49:0/1820348906 shutdown_connections 2023-11-30T18:41:06.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.073+0000 7f7345d7d700 1 --2- 172.21.15.49:0/1820348906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73400bd1f0 0x7f73400bd660 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:06.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.073+0000 7f7345d7d700 1 --2- 172.21.15.49:0/1820348906 >> v2:172.21.15.115:3300/0 conn(0x7f7340069d10 0x7f734006a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:06.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.073+0000 7f7345d7d700 1 -- 172.21.15.49:0/1820348906 >> 172.21.15.49:0/1820348906 conn(0x7f73400642d0 msgr2=0x7f73400c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:06.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.073+0000 7f7345d7d700 1 -- 172.21.15.49:0/1820348906 shutdown_connections 2023-11-30T18:41:06.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.073+0000 7f7345d7d700 1 -- 172.21.15.49:0/1820348906 wait complete. 2023-11-30T18:41:06.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.074+0000 7f7345d7d700 1 Processor -- start 2023-11-30T18:41:06.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.074+0000 7f7345d7d700 1 -- start start 2023-11-30T18:41:06.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.075+0000 7f7345d7d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7340069d10 0x7f73401455c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:06.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.075+0000 7f7345d7d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73400bd1f0 0x7f73401535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:06.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.075+0000 7f7345d7d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7340151a20 0x7f7340153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:06.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.075+0000 7f7345d7d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73400a9080 con 0x7f7340151a20 2023-11-30T18:41:06.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.075+0000 7f7345d7d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7340154150 con 0x7f73400bd1f0 2023-11-30T18:41:06.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.075+0000 7f7345d7d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7340154430 con 0x7f7340069d10 2023-11-30T18:41:06.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.075+0000 7f733ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7340151a20 0x7f7340153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:06.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.075+0000 7f733ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7340151a20 0x7f7340153ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48416/0 (socket says 172.21.15.49:48416) 2023-11-30T18:41:06.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.075+0000 7f733effd700 1 --2- 172.21.15.49:0/245447954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73400bd1f0 0x7f73401535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:06.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.075+0000 7f733ffff700 1 -- 172.21.15.49:0/245447954 learned_addr learned my addr 172.21.15.49:0/245447954 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:06.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.075+0000 7f733f7fe700 1 --2- 172.21.15.49:0/245447954 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7340069d10 0x7f73401455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:06.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.076+0000 7f733ffff700 1 -- 172.21.15.49:0/245447954 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7340069d10 msgr2=0x7f73401455c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:06.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.076+0000 7f733ffff700 1 --2- 172.21.15.49:0/245447954 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7340069d10 0x7f73401455c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:06.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.076+0000 7f733ffff700 1 -- 172.21.15.49:0/245447954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73400bd1f0 msgr2=0x7f73401535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:06.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.076+0000 7f733ffff700 1 --2- 172.21.15.49:0/245447954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73400bd1f0 0x7f73401535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:06.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.076+0000 7f733ffff700 1 -- 172.21.15.49:0/245447954 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7338009ae0 con 0x7f7340151a20 2023-11-30T18:41:06.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.076+0000 7f733effd700 1 --2- 172.21.15.49:0/245447954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73400bd1f0 0x7f73401535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:41:06.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.076+0000 7f733ffff700 1 --2- 172.21.15.49:0/245447954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7340151a20 0x7f7340153ad0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 rx=0x7f733800b6c0 tx=0x7f7338009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:06.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.076+0000 7f73277fe700 1 -- 172.21.15.49:0/245447954 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733800b6f0 con 0x7f7340151a20 2023-11-30T18:41:06.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.076+0000 7f73277fe700 1 -- 172.21.15.49:0/245447954 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73380092e0 con 0x7f7340151a20 2023-11-30T18:41:06.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.076+0000 7f7345d7d700 1 -- 172.21.15.49:0/245447954 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f734014f990 con 0x7f7340151a20 2023-11-30T18:41:06.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.076+0000 7f73277fe700 1 -- 172.21.15.49:0/245447954 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733801e6a0 con 0x7f7340151a20 2023-11-30T18:41:06.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.076+0000 7f7345d7d700 1 -- 172.21.15.49:0/245447954 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f734014ff50 con 0x7f7340151a20 2023-11-30T18:41:06.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.077+0000 7f7345d7d700 1 -- 172.21.15.49:0/245447954 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f734006c860 con 0x7f7340151a20 2023-11-30T18:41:06.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.077+0000 7f73277fe700 1 -- 172.21.15.49:0/245447954 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 96) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f7338003040 con 0x7f7340151a20 2023-11-30T18:41:06.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.078+0000 7f73277fe700 1 --2- 172.21.15.49:0/245447954 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f732c05f390 0x7f732c061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:06.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.078+0000 7f73277fe700 1 -- 172.21.15.49:0/245447954 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f733807bd20 con 0x7f7340151a20 2023-11-30T18:41:06.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.078+0000 7f733f7fe700 1 -- 172.21.15.49:0/245447954 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f732c05f390 msgr2=0x7f732c061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:06.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.078+0000 7f733f7fe700 1 --2- 172.21.15.49:0/245447954 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f732c05f390 0x7f732c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:41:06.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.082+0000 7f73277fe700 1 -- 172.21.15.49:0/245447954 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f73380a8b00 con 0x7f7340151a20 2023-11-30T18:41:06.096 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:06.096+0000 7f82c7cd7680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T18:41:06.164 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:06.163+0000 7f82c7cd7680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T18:41:06.168 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:06.167+0000 7fc8bc633680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T18:41:06.247 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:06.245+0000 7fc8bc633680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T18:41:06.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.255+0000 7f7345d7d700 1 -- 172.21.15.49:0/245447954 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f734006a620 con 0x7f7340151a20 2023-11-30T18:41:06.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.256+0000 7f73277fe700 1 -- 172.21.15.49:0/245447954 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v204) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7338023030 con 0x7f7340151a20 2023-11-30T18:41:06.257 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T18:41:06.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.257+0000 7f7345d7d700 1 -- 172.21.15.49:0/245447954 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f732c05f390 msgr2=0x7f732c061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:41:06.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.257+0000 7f7345d7d700 1 --2- 172.21.15.49:0/245447954 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f732c05f390 0x7f732c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:06.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.257+0000 7f7345d7d700 1 -- 172.21.15.49:0/245447954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7340151a20 msgr2=0x7f7340153ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:06.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.257+0000 7f7345d7d700 1 --2- 172.21.15.49:0/245447954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7340151a20 0x7f7340153ad0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 rx=0x7f733800b6c0 tx=0x7f7338009840).stop 2023-11-30T18:41:06.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.258+0000 7f7345d7d700 1 -- 172.21.15.49:0/245447954 shutdown_connections 2023-11-30T18:41:06.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.258+0000 7f7345d7d700 1 --2- 172.21.15.49:0/245447954 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f732c05f390 0x7f732c061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:06.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.258+0000 7f7345d7d700 1 --2- 172.21.15.49:0/245447954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7340151a20 0x7f7340153ad0 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:06.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.258+0000 7f7345d7d700 1 --2- 172.21.15.49:0/245447954 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7340069d10 0x7f73401455c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:06.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.258+0000 7f7345d7d700 1 --2- 172.21.15.49:0/245447954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73400bd1f0 0x7f73401535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:06.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.258+0000 7f7345d7d700 1 -- 172.21.15.49:0/245447954 >> 172.21.15.49:0/245447954 conn(0x7f73400642d0 msgr2=0x7f73400c5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:06.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.258+0000 7f7345d7d700 1 -- 172.21.15.49:0/245447954 shutdown_connections 2023-11-30T18:41:06.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.258+0000 7f7345d7d700 1 -- 172.21.15.49:0/245447954 wait complete. 2023-11-30T18:41:06.272 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:41:06.321 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:06.319+0000 7fc8bc633680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T18:41:06.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.389+0000 7f30704ef700 1 Processor -- start 2023-11-30T18:41:06.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.389+0000 7f30704ef700 1 -- start start 2023-11-30T18:41:06.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.390+0000 7f30704ef700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3068064e20 0x7f3068155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:06.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.390+0000 7f30704ef700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30680683d0 con 0x7f3068095e80 2023-11-30T18:41:06.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.390+0000 7f30704ef700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3068067850 con 0x7f30681544d0 2023-11-30T18:41:06.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.390+0000 7f30704ef700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3068067650 con 0x7f3068064e20 2023-11-30T18:41:06.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.391+0000 7f306da8a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3068064e20 0x7f3068155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:06.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.391+0000 7f306ea8c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3068095e80 0x7f306815e0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50410/0 (socket says 172.21.15.49:50410) 2023-11-30T18:41:06.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.391+0000 7f306ea8c700 1 -- 172.21.15.49:0/1052307908 learned_addr learned my addr 172.21.15.49:0/1052307908 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:06.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.391+0000 7f306da8a700 1 -- 172.21.15.49:0/1052307908 >> v1:172.21.15.115:6789/0 conn(0x7f30681544d0 legacy=0x7f3068066f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:06.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.391+0000 7f306da8a700 1 -- 172.21.15.49:0/1052307908 >> v1:172.21.15.49:6789/0 conn(0x7f3068095e80 legacy=0x7f306815e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:06.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.391+0000 7f306d289700 1 -- 172.21.15.49:0/1052307908 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547959974 0 0) 0x7f30680683d0 con 0x7f3068095e80 2023-11-30T18:41:06.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.391+0000 7f306da8a700 1 -- 172.21.15.49:0/1052307908 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3068067b30 con 0x7f3068064e20 2023-11-30T18:41:06.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.391+0000 7f306da8a700 1 --2- 172.21.15.49:0/1052307908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3068064e20 0x7f3068155750 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 rx=0x7f305c009760 tx=0x7f305c009060).ready entity=mon.0 client_cookie=a3e293be511ba437 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:06.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.391+0000 7f306d289700 1 -- 172.21.15.49:0/1052307908 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c00b580 con 0x7f3068064e20 2023-11-30T18:41:06.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.391+0000 7f306d289700 1 -- 172.21.15.49:0/1052307908 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305c00b6e0 con 0x7f3068064e20 2023-11-30T18:41:06.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.391+0000 7f306d289700 1 -- 172.21.15.49:0/1052307908 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c00ba60 con 0x7f3068064e20 2023-11-30T18:41:06.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.392+0000 7f30704ef700 1 -- 172.21.15.49:0/1052307908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3068064e20 msgr2=0x7f3068155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:06.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.392+0000 7f30704ef700 1 --2- 172.21.15.49:0/1052307908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3068064e20 0x7f3068155750 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 rx=0x7f305c009760 tx=0x7f305c009060).stop 2023-11-30T18:41:06.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.392+0000 7f30704ef700 1 -- 172.21.15.49:0/1052307908 shutdown_connections 2023-11-30T18:41:06.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.392+0000 7f30704ef700 1 --2- 172.21.15.49:0/1052307908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3068064e20 0x7f3068155750 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:06.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.392+0000 7f30704ef700 1 -- 172.21.15.49:0/1052307908 >> 172.21.15.49:0/1052307908 conn(0x7f30680631d0 msgr2=0x7f30680c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:06.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.392+0000 7f30704ef700 1 -- 172.21.15.49:0/1052307908 shutdown_connections 2023-11-30T18:41:06.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.392+0000 7f30704ef700 1 -- 172.21.15.49:0/1052307908 wait complete. 2023-11-30T18:41:06.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.393+0000 7f30704ef700 1 Processor -- start 2023-11-30T18:41:06.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.393+0000 7f30704ef700 1 -- start start 2023-11-30T18:41:06.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.394+0000 7f30704ef700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3068064e20 0x7f306814d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:06.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.394+0000 7f30704ef700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3068095e80 0x7f3068155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:06.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.394+0000 7f30704ef700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30681544d0 0x7f3068063d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:06.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.394+0000 7f30704ef700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306814da90 con 0x7f30681544d0 2023-11-30T18:41:06.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.394+0000 7f30704ef700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30681565a0 con 0x7f3068064e20 2023-11-30T18:41:06.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.394+0000 7f30704ef700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3068156880 con 0x7f3068095e80 2023-11-30T18:41:06.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.394+0000 7f306ea8c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30681544d0 0x7f3068063d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:06.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.394+0000 7f306ea8c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30681544d0 0x7f3068063d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48430/0 (socket says 172.21.15.49:48430) 2023-11-30T18:41:06.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.394+0000 7f306ea8c700 1 -- 172.21.15.49:0/2350839136 learned_addr learned my addr 172.21.15.49:0/2350839136 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:06.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.394+0000 7f306da8a700 1 --2- 172.21.15.49:0/2350839136 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3068095e80 0x7f3068155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:06.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.394+0000 7f306e28b700 1 --2- 172.21.15.49:0/2350839136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3068064e20 0x7f306814d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:06.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.394+0000 7f306ea8c700 1 -- 172.21.15.49:0/2350839136 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3068095e80 msgr2=0x7f3068155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:06.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.394+0000 7f306ea8c700 1 --2- 172.21.15.49:0/2350839136 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3068095e80 0x7f3068155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:06.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.394+0000 7f306ea8c700 1 -- 172.21.15.49:0/2350839136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3068064e20 msgr2=0x7f306814d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:06.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.394+0000 7f306ea8c700 1 --2- 172.21.15.49:0/2350839136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3068064e20 0x7f306814d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:06.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.394+0000 7f306ea8c700 1 -- 172.21.15.49:0/2350839136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305c0092a0 con 0x7f30681544d0 2023-11-30T18:41:06.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.395+0000 7f306ea8c700 1 --2- 172.21.15.49:0/2350839136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30681544d0 0x7f3068063d10 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 rx=0x7f306000c7e0 tx=0x7f3060007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:06.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.395+0000 7f305a7fc700 1 -- 172.21.15.49:0/2350839136 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3060005d30 con 0x7f30681544d0 2023-11-30T18:41:06.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.395+0000 7f305a7fc700 1 -- 172.21.15.49:0/2350839136 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3060005e90 con 0x7f30681544d0 2023-11-30T18:41:06.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.395+0000 7f30704ef700 1 -- 172.21.15.49:0/2350839136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3068156b60 con 0x7f30681544d0 2023-11-30T18:41:06.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.395+0000 7f305a7fc700 1 -- 172.21.15.49:0/2350839136 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3060007320 con 0x7f30681544d0 2023-11-30T18:41:06.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.395+0000 7f30704ef700 1 -- 172.21.15.49:0/2350839136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3068157120 con 0x7f30681544d0 2023-11-30T18:41:06.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.396+0000 7f30704ef700 1 -- 172.21.15.49:0/2350839136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306806c860 con 0x7f30681544d0 2023-11-30T18:41:06.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.396+0000 7f305a7fc700 1 -- 172.21.15.49:0/2350839136 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 96) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f3060007710 con 0x7f30681544d0 2023-11-30T18:41:06.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.396+0000 7f305a7fc700 1 --2- 172.21.15.49:0/2350839136 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f304c05f390 0x7f304c061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:06.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.397+0000 7f305a7fc700 1 -- 172.21.15.49:0/2350839136 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f306007a610 con 0x7f30681544d0 2023-11-30T18:41:06.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.397+0000 7f306e28b700 1 -- 172.21.15.49:0/2350839136 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f304c05f390 msgr2=0x7f304c061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:06.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.397+0000 7f306e28b700 1 --2- 172.21.15.49:0/2350839136 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f304c05f390 0x7f304c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:41:06.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.401+0000 7f305a7fc700 1 -- 172.21.15.49:0/2350839136 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f306004b430 con 0x7f30681544d0 2023-11-30T18:41:06.423 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:06.422+0000 7f82c7cd7680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T18:41:06.596 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:06.595+0000 7fc8bc633680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T18:41:06.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.598+0000 7f306e28b700 1 -- 172.21.15.49:0/2350839136 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f304c05f390 msgr2=0x7f304c061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:06.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.598+0000 7f306e28b700 1 --2- 172.21.15.49:0/2350839136 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f304c05f390 0x7f304c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T18:41:06.605 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:06.605+0000 7f82c7cd7680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T18:41:06.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.615+0000 7f30704ef700 1 -- 172.21.15.49:0/2350839136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3068067e10 con 0x7f30681544d0 2023-11-30T18:41:06.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.616+0000 7f305a7fc700 1 -- 172.21.15.49:0/2350839136 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f306004ea50 con 0x7f30681544d0 2023-11-30T18:41:06.618 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:06.618 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":85,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7904,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/873619564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":873619564},{"type":"v1","addr":"172.21.15.115:6837","nonce":873619564}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":9172,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/4238872035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":4238872035},{"type":"v1","addr":"172.21.15.115:6835","nonce":4238872035}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":9495,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1878169084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1878169084},{"type":"v1","addr":"172.21.15.49:6834","nonce":1878169084}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T18:39:37.320382+0000","modified":"2023-11-30T18:39:40.334323+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9498},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9498":{"gid":9498,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/4263670008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":4263670008},{"type":"v1","addr":"172.21.15.49:6835","nonce":4263670008}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-11-30T18:41:06.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.618+0000 7f30704ef700 1 -- 172.21.15.49:0/2350839136 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f304c05f390 msgr2=0x7f304c061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:41:06.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.618+0000 7f30704ef700 1 --2- 172.21.15.49:0/2350839136 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f304c05f390 0x7f304c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:06.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.618+0000 7f30704ef700 1 -- 172.21.15.49:0/2350839136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30681544d0 msgr2=0x7f3068063d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:06.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.618+0000 7f30704ef700 1 --2- 172.21.15.49:0/2350839136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30681544d0 0x7f3068063d10 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 rx=0x7f306000c7e0 tx=0x7f3060007f90).stop 2023-11-30T18:41:06.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.618+0000 7f30704ef700 1 -- 172.21.15.49:0/2350839136 shutdown_connections 2023-11-30T18:41:06.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.618+0000 7f30704ef700 1 --2- 172.21.15.49:0/2350839136 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f304c05f390 0x7f304c061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:06.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.618+0000 7f30704ef700 1 --2- 172.21.15.49:0/2350839136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30681544d0 0x7f3068063d10 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:06.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.618+0000 7f30704ef700 1 --2- 172.21.15.49:0/2350839136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3068064e20 0x7f306814d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:06.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.618+0000 7f30704ef700 1 --2- 172.21.15.49:0/2350839136 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3068095e80 0x7f3068155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:06.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.618+0000 7f30704ef700 1 -- 172.21.15.49:0/2350839136 >> 172.21.15.49:0/2350839136 conn(0x7f30680631d0 msgr2=0x7f30680bf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:06.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.618+0000 7f30704ef700 1 -- 172.21.15.49:0/2350839136 shutdown_connections 2023-11-30T18:41:06.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.618+0000 7f30704ef700 1 -- 172.21.15.49:0/2350839136 wait complete. 2023-11-30T18:41:06.621 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 85 2023-11-30T18:41:06.632 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:41:06.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.753+0000 7f8718a25700 1 Processor -- start 2023-11-30T18:41:06.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.753+0000 7f8718a25700 1 -- start start 2023-11-30T18:41:06.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.754+0000 7f8718a25700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f87141544d0 0x7f8714155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:06.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.754+0000 7f8718a25700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87140673c0 0x7f871415e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:06.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.754+0000 7f8718a25700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87140683d0 con 0x7f8714066f40 2023-11-30T18:41:06.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.754+0000 7f8718a25700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8714067850 con 0x7f87141544d0 2023-11-30T18:41:06.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.754+0000 7f8718a25700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8714067b30 con 0x7f87140673c0 2023-11-30T18:41:06.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.754+0000 7f871259c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f87141544d0 0x7f8714155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:06.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.754+0000 7f8711d9b700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8714066f40 0x7f8714095e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50422/0 (socket says 172.21.15.49:50422) 2023-11-30T18:41:06.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.754+0000 7f8711d9b700 1 -- 172.21.15.49:0/1496491182 learned_addr learned my addr 172.21.15.49:0/1496491182 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:06.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.754+0000 7f8712d9d700 1 --2- 172.21.15.49:0/1496491182 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87140673c0 0x7f871415e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:06.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.754+0000 7f871259c700 1 -- 172.21.15.49:0/1496491182 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87140673c0 msgr2=0x7f871415e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:06.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.754+0000 7f871259c700 1 --2- 172.21.15.49:0/1496491182 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87140673c0 0x7f871415e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:06.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.754+0000 7f871259c700 1 -- 172.21.15.49:0/1496491182 >> v1:172.21.15.49:6789/0 conn(0x7f8714066f40 legacy=0x7f8714095e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:06.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.754+0000 7f871259c700 1 -- 172.21.15.49:0/1496491182 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8714067e10 con 0x7f87141544d0 2023-11-30T18:41:06.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.754+0000 7f871159a700 1 -- 172.21.15.49:0/1496491182 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2098230458 0 0) 0x7f87140683d0 con 0x7f8714066f40 2023-11-30T18:41:06.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.755+0000 7f871259c700 1 --2- 172.21.15.49:0/1496491182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87141544d0 0x7f8714155750 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 rx=0x7f8708006fd0 tx=0x7f8708006f40).ready entity=mon.0 client_cookie=fe6852bb6c81b3cb server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:06.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.755+0000 7f871159a700 1 -- 172.21.15.49:0/1496491182 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708005880 con 0x7f87141544d0 2023-11-30T18:41:06.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.755+0000 7f871159a700 1 -- 172.21.15.49:0/1496491182 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87080059e0 con 0x7f87141544d0 2023-11-30T18:41:06.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.755+0000 7f871159a700 1 -- 172.21.15.49:0/1496491182 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708005d60 con 0x7f87141544d0 2023-11-30T18:41:06.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.755+0000 7f8718a25700 1 -- 172.21.15.49:0/1496491182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87141544d0 msgr2=0x7f8714155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:06.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.755+0000 7f8718a25700 1 --2- 172.21.15.49:0/1496491182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87141544d0 0x7f8714155750 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 rx=0x7f8708006fd0 tx=0x7f8708006f40).stop 2023-11-30T18:41:06.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.756+0000 7f8718a25700 1 -- 172.21.15.49:0/1496491182 shutdown_connections 2023-11-30T18:41:06.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.756+0000 7f8718a25700 1 --2- 172.21.15.49:0/1496491182 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87140673c0 0x7f871415e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:06.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.756+0000 7f8718a25700 1 --2- 172.21.15.49:0/1496491182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87141544d0 0x7f8714155750 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:06.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.756+0000 7f8718a25700 1 -- 172.21.15.49:0/1496491182 >> 172.21.15.49:0/1496491182 conn(0x7f87140631d0 msgr2=0x7f87140c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:06.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.756+0000 7f8718a25700 1 -- 172.21.15.49:0/1496491182 shutdown_connections 2023-11-30T18:41:06.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.756+0000 7f8718a25700 1 -- 172.21.15.49:0/1496491182 wait complete. 2023-11-30T18:41:06.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.757+0000 7f8718a25700 1 Processor -- start 2023-11-30T18:41:06.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.757+0000 7f8718a25700 1 -- start start 2023-11-30T18:41:06.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.757+0000 7f8718a25700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8714066f40 0x7f8714156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:06.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.757+0000 7f8718a25700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87141544d0 0x7f871414e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:06.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.757+0000 7f8718a25700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87141554a0 0x7f87140a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:06.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.758+0000 7f8718a25700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871414ec80 con 0x7f87141544d0 2023-11-30T18:41:06.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.758+0000 7f8718a25700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87140a8330 con 0x7f8714066f40 2023-11-30T18:41:06.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.758+0000 7f8718a25700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87140c0330 con 0x7f87141554a0 2023-11-30T18:41:06.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.758+0000 7f8711d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87141544d0 0x7f871414e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:06.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.758+0000 7f8711d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87141544d0 0x7f871414e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48444/0 (socket says 172.21.15.49:48444) 2023-11-30T18:41:06.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.758+0000 7f8711d9b700 1 -- 172.21.15.49:0/437021899 learned_addr learned my addr 172.21.15.49:0/437021899 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:06.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.758+0000 7f8712d9d700 1 --2- 172.21.15.49:0/437021899 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87141554a0 0x7f87140a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:06.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.758+0000 7f871259c700 1 --2- 172.21.15.49:0/437021899 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8714066f40 0x7f8714156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:06.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.758+0000 7f8711d9b700 1 -- 172.21.15.49:0/437021899 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87141554a0 msgr2=0x7f87140a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:06.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.758+0000 7f8711d9b700 1 --2- 172.21.15.49:0/437021899 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87141554a0 0x7f87140a6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:06.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.758+0000 7f8711d9b700 1 -- 172.21.15.49:0/437021899 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8714066f40 msgr2=0x7f8714156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:06.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.758+0000 7f8711d9b700 1 --2- 172.21.15.49:0/437021899 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8714066f40 0x7f8714156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:06.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.758+0000 7f8711d9b700 1 -- 172.21.15.49:0/437021899 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8708009250 con 0x7f87141544d0 2023-11-30T18:41:06.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.758+0000 7f8711d9b700 1 --2- 172.21.15.49:0/437021899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87141544d0 0x7f871414e790 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 rx=0x7f870400c4e0 tx=0x7f8704007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:06.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.758+0000 7f87027fc700 1 -- 172.21.15.49:0/437021899 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870400ce90 con 0x7f87141544d0 2023-11-30T18:41:06.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.758+0000 7f87027fc700 1 -- 172.21.15.49:0/437021899 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87040072e0 con 0x7f87141544d0 2023-11-30T18:41:06.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.758+0000 7f87027fc700 1 -- 172.21.15.49:0/437021899 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8704007660 con 0x7f87141544d0 2023-11-30T18:41:06.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.758+0000 7f8718a25700 1 -- 172.21.15.49:0/437021899 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8714155c40 con 0x7f87141544d0 2023-11-30T18:41:06.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.758+0000 7f8718a25700 1 -- 172.21.15.49:0/437021899 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8714156200 con 0x7f87141544d0 2023-11-30T18:41:06.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.760+0000 7f87027fc700 1 -- 172.21.15.49:0/437021899 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 96) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f87040059b0 con 0x7f87141544d0 2023-11-30T18:41:06.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.760+0000 7f8718a25700 1 -- 172.21.15.49:0/437021899 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87140c0190 con 0x7f87141544d0 2023-11-30T18:41:06.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.760+0000 7f87027fc700 1 --2- 172.21.15.49:0/437021899 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f86f405f390 0x7f86f4061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:06.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.760+0000 7f87027fc700 1 -- 172.21.15.49:0/437021899 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f8704079dd0 con 0x7f87141544d0 2023-11-30T18:41:06.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.760+0000 7f871259c700 1 -- 172.21.15.49:0/437021899 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f86f405f390 msgr2=0x7f86f4061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:06.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.760+0000 7f871259c700 1 --2- 172.21.15.49:0/437021899 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f86f405f390 0x7f86f4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:41:06.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.764+0000 7f87027fc700 1 -- 172.21.15.49:0/437021899 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f87140c0190 con 0x7f87141544d0 2023-11-30T18:41:06.802 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:06.800+0000 7fc8bc633680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T18:41:06.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.953+0000 7f8718a25700 1 -- 172.21.15.49:0/437021899 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87140c0190 con 0x7f87141544d0 2023-11-30T18:41:06.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.954+0000 7f87027fc700 1 -- 172.21.15.49:0/437021899 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v204) v1 ==== 74+0+17451 (secure 0 0 0) 0x7f87140c0190 con 0x7f87141544d0 2023-11-30T18:41:06.956 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:06.956 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":204,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:39:54.149974+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-11-30T18:39:35.697536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-11-30T18:39:36.299739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"203","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/1811121398":"2023-12-01T18:39:54.149939+0000","172.21.15.115:0/131972554":"2023-12-01T18:39:54.149939+0000","172.21.15.115:0/1834129081":"2023-12-01T18:39:54.149939+0000","172.21.15.115:6833/103051":"2023-12-01T18:39:54.149939+0000","172.21.15.115:6832/103051":"2023-12-01T18:39:54.149939+0000","172.21.15.115:0/2733548343":"2023-12-01T18:39:54.149939+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:41:06.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.957+0000 7f8718a25700 1 -- 172.21.15.49:0/437021899 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f86f405f390 msgr2=0x7f86f4061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:41:06.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.957+0000 7f8718a25700 1 --2- 172.21.15.49:0/437021899 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f86f405f390 0x7f86f4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:06.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.957+0000 7f8718a25700 1 -- 172.21.15.49:0/437021899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87141544d0 msgr2=0x7f871414e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:06.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.957+0000 7f8718a25700 1 --2- 172.21.15.49:0/437021899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87141544d0 0x7f871414e790 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 rx=0x7f870400c4e0 tx=0x7f8704007c70).stop 2023-11-30T18:41:06.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.957+0000 7f8718a25700 1 -- 172.21.15.49:0/437021899 shutdown_connections 2023-11-30T18:41:06.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.957+0000 7f8718a25700 1 --2- 172.21.15.49:0/437021899 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f86f405f390 0x7f86f4061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:06.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.957+0000 7f8718a25700 1 --2- 172.21.15.49:0/437021899 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87141554a0 0x7f87140a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:06.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.957+0000 7f8718a25700 1 --2- 172.21.15.49:0/437021899 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8714066f40 0x7f8714156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:06.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.957+0000 7f8718a25700 1 --2- 172.21.15.49:0/437021899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87141544d0 0x7f871414e790 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:06.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.957+0000 7f8718a25700 1 -- 172.21.15.49:0/437021899 >> 172.21.15.49:0/437021899 conn(0x7f87140631d0 msgr2=0x7f87140be580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:06.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.958+0000 7f8718a25700 1 -- 172.21.15.49:0/437021899 shutdown_connections 2023-11-30T18:41:06.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:06.958+0000 7f8718a25700 1 -- 172.21.15.49:0/437021899 wait complete. 2023-11-30T18:41:06.977 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-30T18:41:06.977 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:41:07.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.095+0000 7fa2c61f5700 1 Processor -- start 2023-11-30T18:41:07.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.095+0000 7fa2c61f5700 1 -- start start 2023-11-30T18:41:07.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.096+0000 7fa2c61f5700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa2c0157660 0x7fa2c0157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:07.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.096+0000 7fa2c61f5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa2c00c1750 0x7fa2c00c1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:07.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.096+0000 7fa2c61f5700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2c00c12c0 con 0x7fa2c00c0180 2023-11-30T18:41:07.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.096+0000 7fa2c61f5700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2c00c06b0 con 0x7fa2c00c1750 2023-11-30T18:41:07.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.096+0000 7fa2c61f5700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2c00c0990 con 0x7fa2c0157660 2023-11-30T18:41:07.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.096+0000 7fa2c59f4700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa2c00c1750 0x7fa2c00c1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:07.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.096+0000 7fa2c59f4700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa2c00c1750 0x7fa2c00c1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48448/0 (socket says 172.21.15.49:48448) 2023-11-30T18:41:07.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.096+0000 7fa2c59f4700 1 -- 172.21.15.49:0/416363993 learned_addr learned my addr 172.21.15.49:0/416363993 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:07.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.096+0000 7fa2c49f2700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa2c00c0180 0x7fa2c01589c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50426/0 (socket says 172.21.15.49:50426) 2023-11-30T18:41:07.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.096+0000 7fa2c51f3700 1 --2- 172.21.15.49:0/416363993 >> v2:172.21.15.115:3300/0 conn(0x7fa2c0157660 0x7fa2c0157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:07.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.096+0000 7fa2c59f4700 1 -- 172.21.15.49:0/416363993 >> v2:172.21.15.115:3300/0 conn(0x7fa2c0157660 msgr2=0x7fa2c0157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:07.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.096+0000 7fa2c59f4700 1 --2- 172.21.15.49:0/416363993 >> v2:172.21.15.115:3300/0 conn(0x7fa2c0157660 0x7fa2c0157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:07.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.096+0000 7fa2c59f4700 1 -- 172.21.15.49:0/416363993 >> v1:172.21.15.49:6789/0 conn(0x7fa2c00c0180 legacy=0x7fa2c01589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:07.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.096+0000 7fa2b7fff700 1 -- 172.21.15.49:0/416363993 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1585796217 0 0) 0x7fa2c00c12c0 con 0x7fa2c00c0180 2023-11-30T18:41:07.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.096+0000 7fa2c59f4700 1 -- 172.21.15.49:0/416363993 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c00c0c70 con 0x7fa2c00c1750 2023-11-30T18:41:07.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.097+0000 7fa2c59f4700 1 --2- 172.21.15.49:0/416363993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c00c1750 0x7fa2c00c1b70 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 rx=0x7fa2c00839a0 tx=0x7fa2b8009840).ready entity=mon.0 client_cookie=5541e71a5e50bb36 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:07.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.097+0000 7fa2b7fff700 1 -- 172.21.15.49:0/416363993 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b800e070 con 0x7fa2c00c1750 2023-11-30T18:41:07.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.097+0000 7fa2b7fff700 1 -- 172.21.15.49:0/416363993 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b800ba20 con 0x7fa2c00c1750 2023-11-30T18:41:07.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.097+0000 7fa2b7fff700 1 -- 172.21.15.49:0/416363993 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b800bda0 con 0x7fa2c00c1750 2023-11-30T18:41:07.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.097+0000 7fa2c61f5700 1 -- 172.21.15.49:0/416363993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c00c1750 msgr2=0x7fa2c00c1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:07.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.097+0000 7fa2c61f5700 1 --2- 172.21.15.49:0/416363993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c00c1750 0x7fa2c00c1b70 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 rx=0x7fa2c00839a0 tx=0x7fa2b8009840).stop 2023-11-30T18:41:07.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.097+0000 7fa2c61f5700 1 -- 172.21.15.49:0/416363993 shutdown_connections 2023-11-30T18:41:07.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.097+0000 7fa2c61f5700 1 --2- 172.21.15.49:0/416363993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c00c1750 0x7fa2c00c1b70 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:07.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.097+0000 7fa2c61f5700 1 --2- 172.21.15.49:0/416363993 >> v2:172.21.15.115:3300/0 conn(0x7fa2c0157660 0x7fa2c0157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:07.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.097+0000 7fa2c61f5700 1 -- 172.21.15.49:0/416363993 >> 172.21.15.49:0/416363993 conn(0x7fa2c00cb000 msgr2=0x7fa2c00cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:07.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.098+0000 7fa2c61f5700 1 -- 172.21.15.49:0/416363993 shutdown_connections 2023-11-30T18:41:07.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.098+0000 7fa2c61f5700 1 -- 172.21.15.49:0/416363993 wait complete. 2023-11-30T18:41:07.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.099+0000 7fa2c61f5700 1 Processor -- start 2023-11-30T18:41:07.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.099+0000 7fa2c61f5700 1 -- start start 2023-11-30T18:41:07.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.100+0000 7fa2c61f5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2c00c0180 0x7fa2c00c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:07.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.100+0000 7fa2c61f5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c00c1750 0x7fa2c0150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:07.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.100+0000 7fa2c61f5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2c0157660 0x7fa2c00b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:07.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.100+0000 7fa2c61f5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c00c4fa0 con 0x7fa2c00c1750 2023-11-30T18:41:07.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.100+0000 7fa2c61f5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c00c4620 con 0x7fa2c0157660 2023-11-30T18:41:07.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.100+0000 7fa2c61f5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c00c3a10 con 0x7fa2c00c0180 2023-11-30T18:41:07.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.100+0000 7fa2c49f2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c00c1750 0x7fa2c0150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:07.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.100+0000 7fa2c49f2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c00c1750 0x7fa2c0150bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48460/0 (socket says 172.21.15.49:48460) 2023-11-30T18:41:07.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.100+0000 7fa2c49f2700 1 -- 172.21.15.49:0/3275175290 learned_addr learned my addr 172.21.15.49:0/3275175290 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:07.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.100+0000 7fa2c51f3700 1 --2- 172.21.15.49:0/3275175290 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2c00c0180 0x7fa2c00c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:07.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.100+0000 7fa2c59f4700 1 --2- 172.21.15.49:0/3275175290 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2c0157660 0x7fa2c00b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:07.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.100+0000 7fa2c49f2700 1 -- 172.21.15.49:0/3275175290 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2c00c0180 msgr2=0x7fa2c00c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:07.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.100+0000 7fa2c49f2700 1 --2- 172.21.15.49:0/3275175290 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2c00c0180 0x7fa2c00c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:07.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.100+0000 7fa2c49f2700 1 -- 172.21.15.49:0/3275175290 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2c0157660 msgr2=0x7fa2c00b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:07.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.100+0000 7fa2c49f2700 1 --2- 172.21.15.49:0/3275175290 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2c0157660 0x7fa2c00b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:07.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.100+0000 7fa2c49f2700 1 -- 172.21.15.49:0/3275175290 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b8009ae0 con 0x7fa2c00c1750 2023-11-30T18:41:07.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.100+0000 7fa2c49f2700 1 --2- 172.21.15.49:0/3275175290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c00c1750 0x7fa2c0150bf0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 rx=0x7fa2b000c560 tx=0x7fa2b0007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:07.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.100+0000 7fa2b57fa700 1 -- 172.21.15.49:0/3275175290 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b00072e0 con 0x7fa2c00c1750 2023-11-30T18:41:07.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.101+0000 7fa2b57fa700 1 -- 172.21.15.49:0/3275175290 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b0007440 con 0x7fa2c00c1750 2023-11-30T18:41:07.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.101+0000 7fa2c61f5700 1 -- 172.21.15.49:0/3275175290 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c00c3cf0 con 0x7fa2c00c1750 2023-11-30T18:41:07.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.101+0000 7fa2b57fa700 1 -- 172.21.15.49:0/3275175290 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b00058f0 con 0x7fa2c00c1750 2023-11-30T18:41:07.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.101+0000 7fa2c61f5700 1 -- 172.21.15.49:0/3275175290 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c00c42b0 con 0x7fa2c00c1750 2023-11-30T18:41:07.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.102+0000 7fa2c61f5700 1 -- 172.21.15.49:0/3275175290 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2c00c47b0 con 0x7fa2c00c1750 2023-11-30T18:41:07.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.102+0000 7fa2b57fa700 1 -- 172.21.15.49:0/3275175290 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 96) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fa2b0005ce0 con 0x7fa2c00c1750 2023-11-30T18:41:07.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.102+0000 7fa2b57fa700 1 --2- 172.21.15.49:0/3275175290 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa2a405f390 0x7fa2a4061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:07.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.103+0000 7fa2c51f3700 1 -- 172.21.15.49:0/3275175290 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa2a405f390 msgr2=0x7fa2a4061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:07.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.103+0000 7fa2b57fa700 1 -- 172.21.15.49:0/3275175290 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6463+0+0 (secure 0 0 0) 0x7fa2b0079f40 con 0x7fa2c00c1750 2023-11-30T18:41:07.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.103+0000 7fa2c51f3700 1 --2- 172.21.15.49:0/3275175290 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa2a405f390 0x7fa2a4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:41:07.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.107+0000 7fa2b57fa700 1 -- 172.21.15.49:0/3275175290 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa2b004adc0 con 0x7fa2c00c1750 2023-11-30T18:41:07.254 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:07.254+0000 7f82c7cd7680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T18:41:07.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.304+0000 7fa2c51f3700 1 -- 172.21.15.49:0/3275175290 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa2a405f390 msgr2=0x7fa2a4061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:07.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.304+0000 7fa2c51f3700 1 --2- 172.21.15.49:0/3275175290 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa2a405f390 0x7fa2a4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T18:41:07.324 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:07.323+0000 7f82c7cd7680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T18:41:07.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.322+0000 7fa2c61f5700 1 -- 172.21.15.49:0/3275175290 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2c006c7c0 con 0x7fa2c00c1750 2023-11-30T18:41:07.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.323+0000 7fa2b57fa700 1 -- 172.21.15.49:0/3275175290 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4496 (secure 0 0 0) 0x7fa2b0018030 con 0x7fa2c00c1750 2023-11-30T18:41:07.325 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:07.325 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":85,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7904,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/873619564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":873619564},{"type":"v1","addr":"172.21.15.115:6837","nonce":873619564}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":9172,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/4238872035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":4238872035},{"type":"v1","addr":"172.21.15.115:6835","nonce":4238872035}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":9495,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1878169084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1878169084},{"type":"v1","addr":"172.21.15.49:6834","nonce":1878169084}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T18:39:37.320382+0000","modified":"2023-11-30T18:39:40.334323+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9498},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9498":{"gid":9498,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/4263670008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":4263670008},{"type":"v1","addr":"172.21.15.49:6835","nonce":4263670008}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-11-30T18:41:07.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.325+0000 7fa2c61f5700 1 -- 172.21.15.49:0/3275175290 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa2a405f390 msgr2=0x7fa2a4061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:41:07.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.325+0000 7fa2c61f5700 1 --2- 172.21.15.49:0/3275175290 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa2a405f390 0x7fa2a4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:07.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.325+0000 7fa2c61f5700 1 -- 172.21.15.49:0/3275175290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c00c1750 msgr2=0x7fa2c0150bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:07.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.325+0000 7fa2c61f5700 1 --2- 172.21.15.49:0/3275175290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c00c1750 0x7fa2c0150bf0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 rx=0x7fa2b000c560 tx=0x7fa2b0007c90).stop 2023-11-30T18:41:07.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.325+0000 7fa2c61f5700 1 -- 172.21.15.49:0/3275175290 shutdown_connections 2023-11-30T18:41:07.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.325+0000 7fa2c61f5700 1 --2- 172.21.15.49:0/3275175290 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa2a405f390 0x7fa2a4061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:07.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.325+0000 7fa2c61f5700 1 --2- 172.21.15.49:0/3275175290 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2c0157660 0x7fa2c00b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:07.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.325+0000 7fa2c61f5700 1 --2- 172.21.15.49:0/3275175290 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2c00c0180 0x7fa2c00c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:07.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.325+0000 7fa2c61f5700 1 --2- 172.21.15.49:0/3275175290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c00c1750 0x7fa2c0150bf0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:07.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.325+0000 7fa2c61f5700 1 -- 172.21.15.49:0/3275175290 >> 172.21.15.49:0/3275175290 conn(0x7fa2c00cb000 msgr2=0x7fa2c0063ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:07.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.325+0000 7fa2c61f5700 1 -- 172.21.15.49:0/3275175290 shutdown_connections 2023-11-30T18:41:07.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.325+0000 7fa2c61f5700 1 -- 172.21.15.49:0/3275175290 wait complete. 2023-11-30T18:41:07.328 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 85 2023-11-30T18:41:07.340 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:41:07.399 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:07.398+0000 7f82c7cd7680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T18:41:07.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.461+0000 7f3f01c97700 1 Processor -- start 2023-11-30T18:41:07.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.461+0000 7f3f01c97700 1 -- start start 2023-11-30T18:41:07.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.462+0000 7f3f01c97700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3efc154230 0x7f3efc0a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:07.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.462+0000 7f3f01c97700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3efc062700 0x7f3efc062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:07.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.462+0000 7f3f01c97700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3efc0630a0 con 0x7f3efc0c2cb0 2023-11-30T18:41:07.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.462+0000 7f3f01c97700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3efc0a6720 con 0x7f3efc062700 2023-11-30T18:41:07.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.462+0000 7f3f01c97700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc0c2540 con 0x7f3efc154230 2023-11-30T18:41:07.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.462+0000 7f3f01496700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3efc062700 0x7f3efc062bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:07.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.462+0000 7f3f01496700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3efc062700 0x7f3efc062bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48476/0 (socket says 172.21.15.49:48476) 2023-11-30T18:41:07.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.462+0000 7f3f01496700 1 -- 172.21.15.49:0/529750031 learned_addr learned my addr 172.21.15.49:0/529750031 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:07.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.462+0000 7f3f00c95700 1 --2- 172.21.15.49:0/529750031 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3efc154230 0x7f3efc0a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:07.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.463+0000 7f3f01496700 1 -- 172.21.15.49:0/529750031 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3efc154230 msgr2=0x7f3efc0a48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:07.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.463+0000 7f3f01496700 1 --2- 172.21.15.49:0/529750031 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3efc154230 0x7f3efc0a48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:07.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.463+0000 7f3f01496700 1 -- 172.21.15.49:0/529750031 >> v1:172.21.15.115:6789/0 conn(0x7f3efc0c2cb0 legacy=0x7f3efc0a6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:07.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.463+0000 7f3f01496700 1 -- 172.21.15.49:0/529750031 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3efc0a4f70 con 0x7f3efc062700 2023-11-30T18:41:07.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.463+0000 7f3f01496700 1 --2- 172.21.15.49:0/529750031 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3efc062700 0x7f3efc062bb0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 rx=0x7f3ef4009f20 tx=0x7f3ef4009840).ready entity=mon.0 client_cookie=bcd49dda623f3f8b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:07.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.463+0000 7f3efb7fe700 1 -- 172.21.15.49:0/529750031 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef400e070 con 0x7f3efc062700 2023-11-30T18:41:07.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.463+0000 7f3efb7fe700 1 -- 172.21.15.49:0/529750031 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef400b9d0 con 0x7f3efc062700 2023-11-30T18:41:07.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.463+0000 7f3efb7fe700 1 -- 172.21.15.49:0/529750031 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef400bd50 con 0x7f3efc062700 2023-11-30T18:41:07.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.463+0000 7f3f01c97700 1 -- 172.21.15.49:0/529750031 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3efc062700 msgr2=0x7f3efc062bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:07.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.463+0000 7f3f01c97700 1 --2- 172.21.15.49:0/529750031 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3efc062700 0x7f3efc062bb0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 rx=0x7f3ef4009f20 tx=0x7f3ef4009840).stop 2023-11-30T18:41:07.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.463+0000 7f3f01c97700 1 -- 172.21.15.49:0/529750031 shutdown_connections 2023-11-30T18:41:07.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.463+0000 7f3f01c97700 1 --2- 172.21.15.49:0/529750031 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3efc154230 0x7f3efc0a48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:07.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.463+0000 7f3f01c97700 1 --2- 172.21.15.49:0/529750031 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3efc062700 0x7f3efc062bb0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:07.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.463+0000 7f3f01c97700 1 -- 172.21.15.49:0/529750031 >> 172.21.15.49:0/529750031 conn(0x7f3efc0c7ca0 msgr2=0x7f3efc0c80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:07.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.464+0000 7f3f01c97700 1 -- 172.21.15.49:0/529750031 shutdown_connections 2023-11-30T18:41:07.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.464+0000 7f3f01c97700 1 -- 172.21.15.49:0/529750031 wait complete. 2023-11-30T18:41:07.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.465+0000 7f3f01c97700 1 Processor -- start 2023-11-30T18:41:07.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.465+0000 7f3f01c97700 1 -- start start 2023-11-30T18:41:07.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.466+0000 7f3f01c97700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3efc062700 0x7f3efc0c17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:07.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.466+0000 7f3f01c97700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3efc0c2cb0 0x7f3efc1526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:07.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.466+0000 7f3f01c97700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3efc154230 0x7f3efc152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:07.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.466+0000 7f3f01c97700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc153080 con 0x7f3efc062700 2023-11-30T18:41:07.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.466+0000 7f3f01c97700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc0bf510 con 0x7f3efc0c2cb0 2023-11-30T18:41:07.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.466+0000 7f3f01c97700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc0adaa0 con 0x7f3efc154230 2023-11-30T18:41:07.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.466+0000 7f3f00c95700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3efc062700 0x7f3efc0c17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:07.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.466+0000 7f3f00c95700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3efc062700 0x7f3efc0c17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48488/0 (socket says 172.21.15.49:48488) 2023-11-30T18:41:07.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.466+0000 7f3f00c95700 1 -- 172.21.15.49:0/2364333370 learned_addr learned my addr 172.21.15.49:0/2364333370 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:07.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.466+0000 7f3f01496700 1 --2- 172.21.15.49:0/2364333370 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3efc154230 0x7f3efc152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:07.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.466+0000 7f3efbfff700 1 --2- 172.21.15.49:0/2364333370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3efc0c2cb0 0x7f3efc1526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:07.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.466+0000 7f3f00c95700 1 -- 172.21.15.49:0/2364333370 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3efc154230 msgr2=0x7f3efc152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:07.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.466+0000 7f3f00c95700 1 --2- 172.21.15.49:0/2364333370 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3efc154230 0x7f3efc152b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:07.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.466+0000 7f3f00c95700 1 -- 172.21.15.49:0/2364333370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3efc0c2cb0 msgr2=0x7f3efc1526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:07.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.466+0000 7f3f00c95700 1 --2- 172.21.15.49:0/2364333370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3efc0c2cb0 0x7f3efc1526a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:07.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.466+0000 7f3f00c95700 1 -- 172.21.15.49:0/2364333370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef4009ae0 con 0x7f3efc062700 2023-11-30T18:41:07.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.466+0000 7f3f00c95700 1 --2- 172.21.15.49:0/2364333370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3efc062700 0x7f3efc0c17b0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 rx=0x7f3ef000e900 tx=0x7f3ef0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:07.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.466+0000 7f3ef8ff9700 1 -- 172.21.15.49:0/2364333370 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0012600 con 0x7f3efc062700 2023-11-30T18:41:07.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.466+0000 7f3ef8ff9700 1 -- 172.21.15.49:0/2364333370 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef0012760 con 0x7f3efc062700 2023-11-30T18:41:07.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.466+0000 7f3f01c97700 1 -- 172.21.15.49:0/2364333370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3efc0beec0 con 0x7f3efc062700 2023-11-30T18:41:07.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.466+0000 7f3ef8ff9700 1 -- 172.21.15.49:0/2364333370 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0012ae0 con 0x7f3efc062700 2023-11-30T18:41:07.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.466+0000 7f3f01c97700 1 -- 172.21.15.49:0/2364333370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3efc0acd70 con 0x7f3efc062700 2023-11-30T18:41:07.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.467+0000 7f3f01c97700 1 -- 172.21.15.49:0/2364333370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3efc0bed20 con 0x7f3efc062700 2023-11-30T18:41:07.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.468+0000 7f3ef8ff9700 1 -- 172.21.15.49:0/2364333370 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 96) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f3ef001b400 con 0x7f3efc062700 2023-11-30T18:41:07.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.468+0000 7f3ef8ff9700 1 --2- 172.21.15.49:0/2364333370 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f3ee005f390 0x7f3ee0061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:07.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.468+0000 7f3efbfff700 1 -- 172.21.15.49:0/2364333370 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f3ee005f390 msgr2=0x7f3ee0061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:07.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.468+0000 7f3ef8ff9700 1 -- 172.21.15.49:0/2364333370 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f3ef007aa40 con 0x7f3efc062700 2023-11-30T18:41:07.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.468+0000 7f3efbfff700 1 --2- 172.21.15.49:0/2364333370 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f3ee005f390 0x7f3ee0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:41:07.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.476+0000 7f3ef8ff9700 1 -- 172.21.15.49:0/2364333370 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3efc0bed20 con 0x7f3efc062700 2023-11-30T18:41:07.508 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:07.507+0000 7fc8bc633680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T18:41:07.546 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:07.546+0000 7f82c7cd7680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T18:41:07.581 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:07.580+0000 7fc8bc633680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T18:41:07.617 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:07.616+0000 7f82c7cd7680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T18:41:07.661 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:07.659+0000 7fc8bc633680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T18:41:07.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.669+0000 7f3efbfff700 1 -- 172.21.15.49:0/2364333370 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f3ee005f390 msgr2=0x7f3ee0061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:07.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.669+0000 7f3efbfff700 1 --2- 172.21.15.49:0/2364333370 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f3ee005f390 0x7f3ee0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T18:41:07.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.693+0000 7f3f01c97700 1 -- 172.21.15.49:0/2364333370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3efc0bed20 con 0x7f3efc062700 2023-11-30T18:41:07.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.693+0000 7f3ef8ff9700 1 -- 172.21.15.49:0/2364333370 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f3efc0bed20 con 0x7f3efc062700 2023-11-30T18:41:07.695 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:07.695 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":85,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7904,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/873619564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":873619564},{"type":"v1","addr":"172.21.15.115:6837","nonce":873619564}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":9172,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/4238872035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":4238872035},{"type":"v1","addr":"172.21.15.115:6835","nonce":4238872035}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":9495,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1878169084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1878169084},{"type":"v1","addr":"172.21.15.49:6834","nonce":1878169084}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T18:39:37.320382+0000","modified":"2023-11-30T18:39:40.334323+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9498},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9498":{"gid":9498,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/4263670008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":4263670008},{"type":"v1","addr":"172.21.15.49:6835","nonce":4263670008}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-11-30T18:41:07.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.695+0000 7f3f01c97700 1 -- 172.21.15.49:0/2364333370 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f3ee005f390 msgr2=0x7f3ee0061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:41:07.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.695+0000 7f3f01c97700 1 --2- 172.21.15.49:0/2364333370 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f3ee005f390 0x7f3ee0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:07.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.695+0000 7f3f01c97700 1 -- 172.21.15.49:0/2364333370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3efc062700 msgr2=0x7f3efc0c17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:07.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.695+0000 7f3f01c97700 1 --2- 172.21.15.49:0/2364333370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3efc062700 0x7f3efc0c17b0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 rx=0x7f3ef000e900 tx=0x7f3ef0009060).stop 2023-11-30T18:41:07.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.695+0000 7f3f01c97700 1 -- 172.21.15.49:0/2364333370 shutdown_connections 2023-11-30T18:41:07.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.695+0000 7f3f01c97700 1 --2- 172.21.15.49:0/2364333370 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f3ee005f390 0x7f3ee0061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:07.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.695+0000 7f3f01c97700 1 --2- 172.21.15.49:0/2364333370 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3efc154230 0x7f3efc152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:07.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.695+0000 7f3f01c97700 1 --2- 172.21.15.49:0/2364333370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3efc062700 0x7f3efc0c17b0 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:07.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.695+0000 7f3f01c97700 1 --2- 172.21.15.49:0/2364333370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3efc0c2cb0 0x7f3efc1526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:07.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.695+0000 7f3f01c97700 1 -- 172.21.15.49:0/2364333370 >> 172.21.15.49:0/2364333370 conn(0x7f3efc0c7ca0 msgr2=0x7f3efc0bdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:07.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.695+0000 7f3f01c97700 1 -- 172.21.15.49:0/2364333370 shutdown_connections 2023-11-30T18:41:07.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.696+0000 7f3f01c97700 1 -- 172.21.15.49:0/2364333370 wait complete. 2023-11-30T18:41:07.698 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 85 2023-11-30T18:41:07.710 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:41:07.733 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:07.732+0000 7f82c7cd7680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T18:41:07.821 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:07.819+0000 7fc8bc633680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T18:41:07.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.826+0000 7f54f0e57700 1 Processor -- start 2023-11-30T18:41:07.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.826+0000 7f54f0e57700 1 -- start start 2023-11-30T18:41:07.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.827+0000 7f54f0e57700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f54ec1544e0 0x7f54ec1548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:07.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.827+0000 7f54f0e57700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54ec0c6e30 0x7f54ec0c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:07.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.827+0000 7f54f0e57700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54ec0c69a0 con 0x7f54ec06a610 2023-11-30T18:41:07.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.827+0000 7f54f0e57700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54ec0c13a0 con 0x7f54ec1544e0 2023-11-30T18:41:07.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.827+0000 7f54f0e57700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec0c1680 con 0x7f54ec0c6e30 2023-11-30T18:41:07.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.827+0000 7f54ea59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f54ec1544e0 0x7f54ec1548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:07.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.827+0000 7f54ea59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f54ec1544e0 0x7f54ec1548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48492/0 (socket says 172.21.15.49:48492) 2023-11-30T18:41:07.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.828+0000 7f54ea59c700 1 -- 172.21.15.49:0/964645052 learned_addr learned my addr 172.21.15.49:0/964645052 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:07.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.828+0000 7f54e9d9b700 1 --1- 172.21.15.49:0/964645052 >> v1:172.21.15.49:6789/0 conn(0x7f54ec06a610 0x7f54ec0c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50430/0 (socket says 172.21.15.49:50430) 2023-11-30T18:41:07.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.828+0000 7f54ead9d700 1 --2- 172.21.15.49:0/964645052 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54ec0c6e30 0x7f54ec0c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:07.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.828+0000 7f54ea59c700 1 -- 172.21.15.49:0/964645052 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54ec0c6e30 msgr2=0x7f54ec0c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:07.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.828+0000 7f54ea59c700 1 --2- 172.21.15.49:0/964645052 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54ec0c6e30 0x7f54ec0c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:07.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.828+0000 7f54ea59c700 1 -- 172.21.15.49:0/964645052 >> v1:172.21.15.49:6789/0 conn(0x7f54ec06a610 legacy=0x7f54ec0c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:07.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.828+0000 7f54ea59c700 1 -- 172.21.15.49:0/964645052 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ec0c6630 con 0x7f54ec1544e0 2023-11-30T18:41:07.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.828+0000 7f54ea59c700 1 --2- 172.21.15.49:0/964645052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ec1544e0 0x7f54ec1548c0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 rx=0x7f54dc009810 tx=0x7f54dc009060).ready entity=mon.0 client_cookie=bafbb4585a0e3812 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:07.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.828+0000 7f54e959a700 1 -- 172.21.15.49:0/964645052 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc005880 con 0x7f54ec1544e0 2023-11-30T18:41:07.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.828+0000 7f54e959a700 1 -- 172.21.15.49:0/964645052 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54dc0059e0 con 0x7f54ec1544e0 2023-11-30T18:41:07.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.828+0000 7f54e959a700 1 -- 172.21.15.49:0/964645052 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc005d60 con 0x7f54ec1544e0 2023-11-30T18:41:07.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.829+0000 7f54f0e57700 1 -- 172.21.15.49:0/964645052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ec1544e0 msgr2=0x7f54ec1548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:07.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.829+0000 7f54f0e57700 1 --2- 172.21.15.49:0/964645052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ec1544e0 0x7f54ec1548c0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 rx=0x7f54dc009810 tx=0x7f54dc009060).stop 2023-11-30T18:41:07.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.829+0000 7f54f0e57700 1 -- 172.21.15.49:0/964645052 shutdown_connections 2023-11-30T18:41:07.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.829+0000 7f54f0e57700 1 --2- 172.21.15.49:0/964645052 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54ec0c6e30 0x7f54ec0c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:07.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.829+0000 7f54f0e57700 1 --2- 172.21.15.49:0/964645052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ec1544e0 0x7f54ec1548c0 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:07.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.829+0000 7f54f0e57700 1 -- 172.21.15.49:0/964645052 >> 172.21.15.49:0/964645052 conn(0x7f54ec085020 msgr2=0x7f54ec094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:07.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.829+0000 7f54f0e57700 1 -- 172.21.15.49:0/964645052 shutdown_connections 2023-11-30T18:41:07.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.829+0000 7f54f0e57700 1 -- 172.21.15.49:0/964645052 wait complete. 2023-11-30T18:41:07.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.830+0000 7f54f0e57700 1 Processor -- start 2023-11-30T18:41:07.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.830+0000 7f54f0e57700 1 -- start start 2023-11-30T18:41:07.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.831+0000 7f54f0e57700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54ec06a610 0x7f54ec096750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:07.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.831+0000 7f54f0e57700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ec0c6e30 0x7f54ec1513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:07.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.831+0000 7f54f0e57700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54ec1544e0 0x7f54ec0af250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:07.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.831+0000 7f54f0e57700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec097e00 con 0x7f54ec0c6e30 2023-11-30T18:41:07.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.831+0000 7f54f0e57700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec096d60 con 0x7f54ec1544e0 2023-11-30T18:41:07.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.831+0000 7f54f0e57700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec097040 con 0x7f54ec06a610 2023-11-30T18:41:07.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.831+0000 7f54e9d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ec0c6e30 0x7f54ec1513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:07.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.831+0000 7f54e9d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ec0c6e30 0x7f54ec1513f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48494/0 (socket says 172.21.15.49:48494) 2023-11-30T18:41:07.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.831+0000 7f54e9d9b700 1 -- 172.21.15.49:0/1212682435 learned_addr learned my addr 172.21.15.49:0/1212682435 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:07.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.831+0000 7f54ea59c700 1 --2- 172.21.15.49:0/1212682435 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54ec06a610 0x7f54ec096750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:07.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.831+0000 7f54ead9d700 1 --2- 172.21.15.49:0/1212682435 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54ec1544e0 0x7f54ec0af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:07.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.831+0000 7f54e9d9b700 1 -- 172.21.15.49:0/1212682435 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54ec06a610 msgr2=0x7f54ec096750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:07.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.831+0000 7f54e9d9b700 1 --2- 172.21.15.49:0/1212682435 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54ec06a610 0x7f54ec096750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:07.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.831+0000 7f54e9d9b700 1 -- 172.21.15.49:0/1212682435 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54ec1544e0 msgr2=0x7f54ec0af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:07.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.831+0000 7f54e9d9b700 1 --2- 172.21.15.49:0/1212682435 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54ec1544e0 0x7f54ec0af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:07.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.831+0000 7f54e9d9b700 1 -- 172.21.15.49:0/1212682435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54dc009300 con 0x7f54ec0c6e30 2023-11-30T18:41:07.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.831+0000 7f54e9d9b700 1 --2- 172.21.15.49:0/1212682435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ec0c6e30 0x7f54ec1513f0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 rx=0x7f54e000c440 tx=0x7f54e0007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:07.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.832+0000 7f54da7fc700 1 -- 172.21.15.49:0/1212682435 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e00070d0 con 0x7f54ec0c6e30 2023-11-30T18:41:07.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.832+0000 7f54da7fc700 1 -- 172.21.15.49:0/1212682435 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e0007230 con 0x7f54ec0c6e30 2023-11-30T18:41:07.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.832+0000 7f54f0e57700 1 -- 172.21.15.49:0/1212682435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54ec097320 con 0x7f54ec0c6e30 2023-11-30T18:41:07.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.832+0000 7f54da7fc700 1 -- 172.21.15.49:0/1212682435 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e00056e0 con 0x7f54ec0c6e30 2023-11-30T18:41:07.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.832+0000 7f54f0e57700 1 -- 172.21.15.49:0/1212682435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54ec0978e0 con 0x7f54ec0c6e30 2023-11-30T18:41:07.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.833+0000 7f54f0e57700 1 -- 172.21.15.49:0/1212682435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54ec165f00 con 0x7f54ec0c6e30 2023-11-30T18:41:07.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.833+0000 7f54da7fc700 1 -- 172.21.15.49:0/1212682435 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 96) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f54e0005a90 con 0x7f54ec0c6e30 2023-11-30T18:41:07.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.833+0000 7f54da7fc700 1 --2- 172.21.15.49:0/1212682435 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f54cc05f390 0x7f54cc061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:07.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.834+0000 7f54da7fc700 1 -- 172.21.15.49:0/1212682435 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f54e0079c30 con 0x7f54ec0c6e30 2023-11-30T18:41:07.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.834+0000 7f54ea59c700 1 -- 172.21.15.49:0/1212682435 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f54cc05f390 msgr2=0x7f54cc061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:07.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.834+0000 7f54ea59c700 1 --2- 172.21.15.49:0/1212682435 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f54cc05f390 0x7f54cc061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:41:07.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:07.838+0000 7f54da7fc700 1 -- 172.21.15.49:0/1212682435 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f54e004a9f0 con 0x7f54ec0c6e30 2023-11-30T18:41:07.841 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:07.840+0000 7f82c7cd7680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:41:07.898 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:07.896+0000 7fc8bc633680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T18:41:08.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.018+0000 7f54f0e57700 1 -- 172.21.15.49:0/1212682435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54ec097b00 con 0x7f54ec0c6e30 2023-11-30T18:41:08.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.020+0000 7f54da7fc700 1 -- 172.21.15.49:0/1212682435 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v205) v1 ==== 74+0+17563 (secure 0 0 0) 0x7f54e004e010 con 0x7f54ec0c6e30 2023-11-30T18:41:08.022 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:08.022 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":205,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:41:07.986574+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-11-30T18:39:35.697536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-11-30T18:39:36.299739+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"205","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":205,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/1811121398":"2023-12-01T18:39:54.149939+0000","172.21.15.115:0/131972554":"2023-12-01T18:39:54.149939+0000","172.21.15.115:0/1834129081":"2023-12-01T18:39:54.149939+0000","172.21.15.115:6833/103051":"2023-12-01T18:39:54.149939+0000","172.21.15.115:6832/103051":"2023-12-01T18:39:54.149939+0000","172.21.15.115:0/2733548343":"2023-12-01T18:39:54.149939+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:41:08.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.022+0000 7f54f0e57700 1 -- 172.21.15.49:0/1212682435 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f54cc05f390 msgr2=0x7f54cc061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:41:08.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.022+0000 7f54f0e57700 1 --2- 172.21.15.49:0/1212682435 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f54cc05f390 0x7f54cc061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:08.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.022+0000 7f54f0e57700 1 -- 172.21.15.49:0/1212682435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ec0c6e30 msgr2=0x7f54ec1513f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:08.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.022+0000 7f54f0e57700 1 --2- 172.21.15.49:0/1212682435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ec0c6e30 0x7f54ec1513f0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 rx=0x7f54e000c440 tx=0x7f54e0007de0).stop 2023-11-30T18:41:08.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.022+0000 7f54f0e57700 1 -- 172.21.15.49:0/1212682435 shutdown_connections 2023-11-30T18:41:08.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.022+0000 7f54f0e57700 1 --2- 172.21.15.49:0/1212682435 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f54cc05f390 0x7f54cc061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:08.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.022+0000 7f54f0e57700 1 --2- 172.21.15.49:0/1212682435 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54ec1544e0 0x7f54ec0af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:08.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.022+0000 7f54f0e57700 1 --2- 172.21.15.49:0/1212682435 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54ec06a610 0x7f54ec096750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:08.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.022+0000 7f54f0e57700 1 --2- 172.21.15.49:0/1212682435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ec0c6e30 0x7f54ec1513f0 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:08.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.022+0000 7f54f0e57700 1 -- 172.21.15.49:0/1212682435 >> 172.21.15.49:0/1212682435 conn(0x7f54ec085020 msgr2=0x7f54ec1531b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:08.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.022+0000 7f54f0e57700 1 -- 172.21.15.49:0/1212682435 shutdown_connections 2023-11-30T18:41:08.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.022+0000 7f54f0e57700 1 -- 172.21.15.49:0/1212682435 wait complete. 2023-11-30T18:41:08.027 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:08.025+0000 7fc8bc633680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T18:41:08.037 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-30T18:41:08.133 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:08.133+0000 7f82c7cd7680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T18:41:08.147 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:08.146+0000 7fc8bc633680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:41:08.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.157+0000 7f7f123f4700 1 Processor -- start 2023-11-30T18:41:08.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.157+0000 7f7f123f4700 1 -- start start 2023-11-30T18:41:08.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.158+0000 7f7f123f4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f0c069d10 0x7f7f0c06a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:08.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.158+0000 7f7f123f4700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7f0c151a20 0x7f7f0c0be1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:08.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.158+0000 7f7f123f4700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7f0c0be6a0 0x7f7f0c0bd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:08.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.158+0000 7f7f123f4700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f0c0c3470 con 0x7f7f0c0be6a0 2023-11-30T18:41:08.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.158+0000 7f7f123f4700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f0c151ea0 con 0x7f7f0c151a20 2023-11-30T18:41:08.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.158+0000 7f7f123f4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c152180 con 0x7f7f0c069d10 2023-11-30T18:41:08.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.159+0000 7f7f10991700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7f0c0be6a0 0x7f7f0c0bd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:08.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.159+0000 7f7f10991700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7f0c0be6a0 0x7f7f0c0bd1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48504/0 (socket says 172.21.15.49:48504) 2023-11-30T18:41:08.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.159+0000 7f7f10991700 1 -- 172.21.15.49:0/2174531265 learned_addr learned my addr 172.21.15.49:0/2174531265 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:08.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.159+0000 7f7f0bfff700 1 --2- 172.21.15.49:0/2174531265 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f0c069d10 0x7f7f0c06a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:08.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.159+0000 7f7f0b7fe700 1 --2- 172.21.15.49:0/2174531265 >> v2:172.21.15.115:3300/0 conn(0x7f7f0c151a20 0x7f7f0c0be1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:08.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.159+0000 7f7f10991700 1 -- 172.21.15.49:0/2174531265 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f0c069d10 msgr2=0x7f7f0c06a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:08.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.159+0000 7f7f10991700 1 --2- 172.21.15.49:0/2174531265 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f0c069d10 0x7f7f0c06a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:08.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.159+0000 7f7f10991700 1 -- 172.21.15.49:0/2174531265 >> v2:172.21.15.115:3300/0 conn(0x7f7f0c151a20 msgr2=0x7f7f0c0be1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:08.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.159+0000 7f7f10991700 1 --2- 172.21.15.49:0/2174531265 >> v2:172.21.15.115:3300/0 conn(0x7f7f0c151a20 0x7f7f0c0be1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:08.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.159+0000 7f7f10991700 1 -- 172.21.15.49:0/2174531265 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0c152460 con 0x7f7f0c0be6a0 2023-11-30T18:41:08.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.159+0000 7f7f10991700 1 --2- 172.21.15.49:0/2174531265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f0c0be6a0 0x7f7f0c0bd1f0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 rx=0x7f7f0c0600b0 tx=0x7f7f04009840).ready entity=mon.0 client_cookie=8d992167ca5e3cda server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:08.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.159+0000 7f7f0affd700 1 -- 172.21.15.49:0/2174531265 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0400e070 con 0x7f7f0c0be6a0 2023-11-30T18:41:08.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.159+0000 7f7f0affd700 1 -- 172.21.15.49:0/2174531265 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0400b970 con 0x7f7f0c0be6a0 2023-11-30T18:41:08.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.159+0000 7f7f0affd700 1 -- 172.21.15.49:0/2174531265 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0400bcf0 con 0x7f7f0c0be6a0 2023-11-30T18:41:08.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.160+0000 7f7f123f4700 1 -- 172.21.15.49:0/2174531265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f0c0be6a0 msgr2=0x7f7f0c0bd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:08.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.160+0000 7f7f123f4700 1 --2- 172.21.15.49:0/2174531265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f0c0be6a0 0x7f7f0c0bd1f0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 rx=0x7f7f0c0600b0 tx=0x7f7f04009840).stop 2023-11-30T18:41:08.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.160+0000 7f7f123f4700 1 -- 172.21.15.49:0/2174531265 shutdown_connections 2023-11-30T18:41:08.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.160+0000 7f7f123f4700 1 --2- 172.21.15.49:0/2174531265 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f0c069d10 0x7f7f0c06a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:08.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.160+0000 7f7f123f4700 1 --2- 172.21.15.49:0/2174531265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f0c0be6a0 0x7f7f0c0bd1f0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:08.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.160+0000 7f7f123f4700 1 --2- 172.21.15.49:0/2174531265 >> v2:172.21.15.115:3300/0 conn(0x7f7f0c151a20 0x7f7f0c0be1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:08.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.160+0000 7f7f123f4700 1 -- 172.21.15.49:0/2174531265 >> 172.21.15.49:0/2174531265 conn(0x7f7f0c0642d0 msgr2=0x7f7f0c0c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:08.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.160+0000 7f7f123f4700 1 -- 172.21.15.49:0/2174531265 shutdown_connections 2023-11-30T18:41:08.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.160+0000 7f7f123f4700 1 -- 172.21.15.49:0/2174531265 wait complete. 2023-11-30T18:41:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.161+0000 7f7f123f4700 1 Processor -- start 2023-11-30T18:41:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.161+0000 7f7f123f4700 1 -- start start 2023-11-30T18:41:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.162+0000 7f7f123f4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f0c069d10 0x7f7f0c142c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.162+0000 7f7f123f4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f0c0be6a0 0x7f7f0c0ac180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.162+0000 7f7f123f4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f0c151a20 0x7f7f0c0c1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.162+0000 7f7f123f4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c0ad7e0 con 0x7f7f0c151a20 2023-11-30T18:41:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.162+0000 7f7f123f4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c0acbd0 con 0x7f7f0c0be6a0 2023-11-30T18:41:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.162+0000 7f7f123f4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c0aceb0 con 0x7f7f0c069d10 2023-11-30T18:41:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.162+0000 7f7f10991700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f0c151a20 0x7f7f0c0c1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.162+0000 7f7f10991700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f0c151a20 0x7f7f0c0c1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48506/0 (socket says 172.21.15.49:48506) 2023-11-30T18:41:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.162+0000 7f7f10991700 1 -- 172.21.15.49:0/3230664886 learned_addr learned my addr 172.21.15.49:0/3230664886 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.162+0000 7f7f0bfff700 1 --2- 172.21.15.49:0/3230664886 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f0c069d10 0x7f7f0c142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.162+0000 7f7f0b7fe700 1 --2- 172.21.15.49:0/3230664886 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f0c0be6a0 0x7f7f0c0ac180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.163+0000 7f7f10991700 1 -- 172.21.15.49:0/3230664886 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f0c069d10 msgr2=0x7f7f0c142c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.163+0000 7f7f10991700 1 --2- 172.21.15.49:0/3230664886 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f0c069d10 0x7f7f0c142c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.163+0000 7f7f10991700 1 -- 172.21.15.49:0/3230664886 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f0c0be6a0 msgr2=0x7f7f0c0ac180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.163+0000 7f7f10991700 1 --2- 172.21.15.49:0/3230664886 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f0c0be6a0 0x7f7f0c0ac180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.163+0000 7f7f10991700 1 -- 172.21.15.49:0/3230664886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f04009ae0 con 0x7f7f0c151a20 2023-11-30T18:41:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.163+0000 7f7f10991700 1 --2- 172.21.15.49:0/3230664886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f0c151a20 0x7f7f0c0c1330 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 rx=0x7f7f0400b610 tx=0x7f7f04009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.163+0000 7f7f03fff700 1 -- 172.21.15.49:0/3230664886 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0400bcf0 con 0x7f7f0c151a20 2023-11-30T18:41:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.163+0000 7f7f03fff700 1 -- 172.21.15.49:0/3230664886 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0400b640 con 0x7f7f0c151a20 2023-11-30T18:41:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.163+0000 7f7f123f4700 1 -- 172.21.15.49:0/3230664886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f0c0ad190 con 0x7f7f0c151a20 2023-11-30T18:41:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.163+0000 7f7f03fff700 1 -- 172.21.15.49:0/3230664886 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0401d690 con 0x7f7f0c151a20 2023-11-30T18:41:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.163+0000 7f7f123f4700 1 -- 172.21.15.49:0/3230664886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f0c143170 con 0x7f7f0c151a20 2023-11-30T18:41:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.164+0000 7f7f123f4700 1 -- 172.21.15.49:0/3230664886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f0c0ad950 con 0x7f7f0c151a20 2023-11-30T18:41:08.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.164+0000 7f7f03fff700 1 -- 172.21.15.49:0/3230664886 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 96) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f7f04003040 con 0x7f7f0c151a20 2023-11-30T18:41:08.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.165+0000 7f7f03fff700 1 --2- 172.21.15.49:0/3230664886 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f7eec05f390 0x7f7eec061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:08.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.165+0000 7f7f03fff700 1 -- 172.21.15.49:0/3230664886 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f7f0407b990 con 0x7f7f0c151a20 2023-11-30T18:41:08.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.165+0000 7f7f0bfff700 1 -- 172.21.15.49:0/3230664886 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f7eec05f390 msgr2=0x7f7eec061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:08.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.165+0000 7f7f0bfff700 1 --2- 172.21.15.49:0/3230664886 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f7eec05f390 0x7f7eec061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:41:08.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.174+0000 7f7f03fff700 1 -- 172.21.15.49:0/3230664886 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7f0404c6c0 con 0x7f7f0c151a20 2023-11-30T18:41:08.206 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:08.206+0000 7f82c7cd7680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T18:41:08.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.229+0000 7f7f03fff700 1 -- 172.21.15.49:0/3230664886 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 97) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f7f040791c0 con 0x7f7f0c151a20 2023-11-30T18:41:08.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.230+0000 7f7f03fff700 1 -- 172.21.15.49:0/3230664886 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f7eec05f390 msgr2=0x7f7eec061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:41:08.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.230+0000 7f7f03fff700 1 --2- 172.21.15.49:0/3230664886 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f7eec05f390 0x7f7eec061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:08.291 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:08.290+0000 7f824546f700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:41:08.291 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:08.290+0000 7f824546f700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:41:08.291 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:08.290+0000 7f824546f700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:41:08.291 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:08.290+0000 7f824546f700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:41:08.291 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:08.290+0000 7f824546f700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:41:08.291 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:08.290+0000 7f8241c68700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:41:08.291 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:08.290+0000 7f8241c68700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:41:08.291 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:08.290+0000 7f8241c68700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:41:08.291 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:08.290+0000 7f8241c68700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:41:08.291 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:08.290+0000 7f8241c68700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:41:08.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:08.410+0000 7f7f123f4700 1 -- 172.21.15.49:0/3230664886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7f0c06c860 con 0x7f7f0c151a20 2023-11-30T18:41:08.468 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:08.466+0000 7fc8bc633680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T18:41:08.543 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:08.541+0000 7fc8bc633680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T18:41:09.224 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-11-30T18:41:09.222+0000 7f3888d95700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-30T18:41:09.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.227+0000 7f7f03fff700 1 -- 172.21.15.49:0/3230664886 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mgrmap(e 98) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f7f04079540 con 0x7f7f0c151a20 2023-11-30T18:41:09.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.227+0000 7f7f03fff700 1 --2- 172.21.15.49:0/3230664886 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f7eec05f390 0x7f7eec061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:09.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.228+0000 7f7f0bfff700 1 --2- 172.21.15.49:0/3230664886 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f7eec05f390 0x7f7eec061850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:09.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.229+0000 7f7f0bfff700 1 --2- 172.21.15.49:0/3230664886 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f7eec05f390 0x7f7eec061850 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f7efc0094a0 tx=0x7f7efc009060).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:09.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.235+0000 7f7f03fff700 1 -- 172.21.15.49:0/3230664886 <== mon.0 v2:172.21.15.49:3300/0 9 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v86) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7f0404d6d0 con 0x7f7f0c151a20 2023-11-30T18:41:09.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.238+0000 7f7f123f4700 1 -- 172.21.15.49:0/3230664886 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f7eec05f390 msgr2=0x7f7eec061850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:09.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.238+0000 7f7f123f4700 1 --2- 172.21.15.49:0/3230664886 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f7eec05f390 0x7f7eec061850 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f7efc0094a0 tx=0x7f7efc009060).stop 2023-11-30T18:41:09.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.238+0000 7f7f123f4700 1 -- 172.21.15.49:0/3230664886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f0c151a20 msgr2=0x7f7f0c0c1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:09.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.238+0000 7f7f123f4700 1 --2- 172.21.15.49:0/3230664886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f0c151a20 0x7f7f0c0c1330 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 rx=0x7f7f0400b610 tx=0x7f7f04009840).stop 2023-11-30T18:41:09.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.238+0000 7f7f123f4700 1 -- 172.21.15.49:0/3230664886 shutdown_connections 2023-11-30T18:41:09.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.238+0000 7f7f123f4700 1 --2- 172.21.15.49:0/3230664886 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f7eec05f390 0x7f7eec061850 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:09.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.238+0000 7f7f123f4700 1 --2- 172.21.15.49:0/3230664886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f0c151a20 0x7f7f0c0c1330 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:09.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.238+0000 7f7f123f4700 1 --2- 172.21.15.49:0/3230664886 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f0c069d10 0x7f7f0c142c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:09.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.238+0000 7f7f123f4700 1 --2- 172.21.15.49:0/3230664886 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f0c0be6a0 0x7f7f0c0ac180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:09.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.238+0000 7f7f123f4700 1 -- 172.21.15.49:0/3230664886 >> 172.21.15.49:0/3230664886 conn(0x7f7f0c0642d0 msgr2=0x7f7f0c14dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:09.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.238+0000 7f7f123f4700 1 -- 172.21.15.49:0/3230664886 shutdown_connections 2023-11-30T18:41:09.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.238+0000 7f7f123f4700 1 -- 172.21.15.49:0/3230664886 wait complete. 2023-11-30T18:41:09.241 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-30T18:41:09.253 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-30T18:41:09.270 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-11-30T18:41:09.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.372+0000 7f74822ae700 1 Processor -- start 2023-11-30T18:41:09.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.372+0000 7f74822ae700 1 -- start start 2023-11-30T18:41:09.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.373+0000 7f74822ae700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f747c098d10 0x7f747c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:09.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.373+0000 7f74822ae700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f747c158320 0x7f747c1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:09.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.373+0000 7f74822ae700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747c158cc0 con 0x7f747c0c6190 2023-11-30T18:41:09.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.373+0000 7f74822ae700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f747c0c72d0 con 0x7f747c098d10 2023-11-30T18:41:09.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.373+0000 7f74822ae700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f747c064570 con 0x7f747c158320 2023-11-30T18:41:09.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.373+0000 7f747bfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f747c098d10 0x7f747c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:09.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.373+0000 7f747bfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f747c098d10 0x7f747c0c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48530/0 (socket says 172.21.15.49:48530) 2023-11-30T18:41:09.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.373+0000 7f747bfff700 1 -- 172.21.15.49:0/768537859 learned_addr learned my addr 172.21.15.49:0/768537859 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:09.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.374+0000 7f748084b700 1 --2- 172.21.15.49:0/768537859 >> v2:172.21.15.115:3300/0 conn(0x7f747c158320 0x7f747c1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:09.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.374+0000 7f747bfff700 1 -- 172.21.15.49:0/768537859 >> v2:172.21.15.115:3300/0 conn(0x7f747c158320 msgr2=0x7f747c1587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:09.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.374+0000 7f747bfff700 1 --2- 172.21.15.49:0/768537859 >> v2:172.21.15.115:3300/0 conn(0x7f747c158320 0x7f747c1587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:09.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.374+0000 7f747bfff700 1 -- 172.21.15.49:0/768537859 >> v1:172.21.15.49:6789/0 conn(0x7f747c0c6190 legacy=0x7f747c063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:09.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.374+0000 7f747bfff700 1 -- 172.21.15.49:0/768537859 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747c154bc0 con 0x7f747c098d10 2023-11-30T18:41:09.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.374+0000 7f747bfff700 1 --2- 172.21.15.49:0/768537859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f747c098d10 0x7f747c0c7760 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 rx=0x7f747c0657a0 tx=0x7f74700090f0).ready entity=mon.0 client_cookie=8621b8d7875809ec server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:09.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.374+0000 7f747affd700 1 -- 172.21.15.49:0/768537859 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747000b600 con 0x7f747c098d10 2023-11-30T18:41:09.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.374+0000 7f747affd700 1 -- 172.21.15.49:0/768537859 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747000b760 con 0x7f747c098d10 2023-11-30T18:41:09.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.374+0000 7f747affd700 1 -- 172.21.15.49:0/768537859 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747000bae0 con 0x7f747c098d10 2023-11-30T18:41:09.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.374+0000 7f74822ae700 1 -- 172.21.15.49:0/768537859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f747c098d10 msgr2=0x7f747c0c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:09.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.374+0000 7f74822ae700 1 --2- 172.21.15.49:0/768537859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f747c098d10 0x7f747c0c7760 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 rx=0x7f747c0657a0 tx=0x7f74700090f0).stop 2023-11-30T18:41:09.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.375+0000 7f74822ae700 1 -- 172.21.15.49:0/768537859 shutdown_connections 2023-11-30T18:41:09.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.375+0000 7f74822ae700 1 --2- 172.21.15.49:0/768537859 >> v2:172.21.15.115:3300/0 conn(0x7f747c158320 0x7f747c1587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:09.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.375+0000 7f74822ae700 1 --2- 172.21.15.49:0/768537859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f747c098d10 0x7f747c0c7760 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:09.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.375+0000 7f74822ae700 1 -- 172.21.15.49:0/768537859 >> 172.21.15.49:0/768537859 conn(0x7f747c0cb310 msgr2=0x7f747c0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:09.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.375+0000 7f74822ae700 1 -- 172.21.15.49:0/768537859 shutdown_connections 2023-11-30T18:41:09.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.375+0000 7f74822ae700 1 -- 172.21.15.49:0/768537859 wait complete. 2023-11-30T18:41:09.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.376+0000 7f74822ae700 1 Processor -- start 2023-11-30T18:41:09.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.376+0000 7f74822ae700 1 -- start start 2023-11-30T18:41:09.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.377+0000 7f74822ae700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f747c098d10 0x7f747c155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:09.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.377+0000 7f74822ae700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f747c0c6190 0x7f747c0a95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:09.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.377+0000 7f74822ae700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f747c158320 0x7f747c0a9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:09.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.377+0000 7f74822ae700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c156280 con 0x7f747c098d10 2023-11-30T18:41:09.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.377+0000 7f74822ae700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c0a9fc0 con 0x7f747c158320 2023-11-30T18:41:09.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.377+0000 7f74822ae700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747c0c38e0 con 0x7f747c0c6190 2023-11-30T18:41:09.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.377+0000 7f747bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f747c098d10 0x7f747c155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:09.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.377+0000 7f747bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f747c098d10 0x7f747c155090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48534/0 (socket says 172.21.15.49:48534) 2023-11-30T18:41:09.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.377+0000 7f747bfff700 1 -- 172.21.15.49:0/4274139953 learned_addr learned my addr 172.21.15.49:0/4274139953 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:09.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.377+0000 7f748084b700 1 --2- 172.21.15.49:0/4274139953 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f747c158320 0x7f747c0a9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:09.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.377+0000 7f747b7fe700 1 --2- 172.21.15.49:0/4274139953 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f747c0c6190 0x7f747c0a95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:09.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.377+0000 7f747bfff700 1 -- 172.21.15.49:0/4274139953 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f747c0c6190 msgr2=0x7f747c0a95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:09.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.377+0000 7f747bfff700 1 --2- 172.21.15.49:0/4274139953 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f747c0c6190 0x7f747c0a95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:09.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.377+0000 7f747bfff700 1 -- 172.21.15.49:0/4274139953 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f747c158320 msgr2=0x7f747c0a9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:09.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.377+0000 7f747bfff700 1 --2- 172.21.15.49:0/4274139953 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f747c158320 0x7f747c0a9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:09.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.377+0000 7f747bfff700 1 -- 172.21.15.49:0/4274139953 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7470009370 con 0x7f747c098d10 2023-11-30T18:41:09.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.377+0000 7f747bfff700 1 --2- 172.21.15.49:0/4274139953 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f747c098d10 0x7f747c155090 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 rx=0x7f747c0c2360 tx=0x7f7470017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:09.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.377+0000 7f7463fff700 1 -- 172.21.15.49:0/4274139953 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747000b8d0 con 0x7f747c098d10 2023-11-30T18:41:09.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.377+0000 7f7463fff700 1 -- 172.21.15.49:0/4274139953 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747000ba30 con 0x7f747c098d10 2023-11-30T18:41:09.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.377+0000 7f74822ae700 1 -- 172.21.15.49:0/4274139953 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f747c1559e0 con 0x7f747c098d10 2023-11-30T18:41:09.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.377+0000 7f7463fff700 1 -- 172.21.15.49:0/4274139953 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74700246c0 con 0x7f747c098d10 2023-11-30T18:41:09.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.377+0000 7f74822ae700 1 -- 172.21.15.49:0/4274139953 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747c155fa0 con 0x7f747c098d10 2023-11-30T18:41:09.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.378+0000 7f74822ae700 1 -- 172.21.15.49:0/4274139953 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f747c0c3bc0 con 0x7f747c098d10 2023-11-30T18:41:09.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.379+0000 7f7463fff700 1 -- 172.21.15.49:0/4274139953 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 98) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f7470021070 con 0x7f747c098d10 2023-11-30T18:41:09.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.379+0000 7f7463fff700 1 --2- 172.21.15.49:0/4274139953 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f746805f030 0x7f74680614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:09.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.379+0000 7f7463fff700 1 -- 172.21.15.49:0/4274139953 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f747007c070 con 0x7f747c098d10 2023-11-30T18:41:09.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.379+0000 7f747b7fe700 1 --2- 172.21.15.49:0/4274139953 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f746805f030 0x7f74680614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:09.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.379+0000 7f747b7fe700 1 --2- 172.21.15.49:0/4274139953 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f746805f030 0x7f74680614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f747c168310 tx=0x7f746c009040).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:09.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.383+0000 7f7463fff700 1 -- 172.21.15.49:0/4274139953 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f747004d240 con 0x7f747c098d10 2023-11-30T18:41:09.587 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:41:09.589 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:41:09.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:09.605+0000 7f74822ae700 1 -- 172.21.15.49:0/4274139953 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f747c0c36b0 con 0x7f747c098d10 2023-11-30T18:41:10.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.240+0000 7f7463fff700 1 -- 172.21.15.49:0/4274139953 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v87) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7470050860 con 0x7f747c098d10 2023-11-30T18:41:10.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.242+0000 7f74822ae700 1 -- 172.21.15.49:0/4274139953 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f746805f030 msgr2=0x7f74680614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:10.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.242+0000 7f74822ae700 1 --2- 172.21.15.49:0/4274139953 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f746805f030 0x7f74680614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f747c168310 tx=0x7f746c009040).stop 2023-11-30T18:41:10.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.242+0000 7f74822ae700 1 -- 172.21.15.49:0/4274139953 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f747c098d10 msgr2=0x7f747c155090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:10.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.242+0000 7f74822ae700 1 --2- 172.21.15.49:0/4274139953 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f747c098d10 0x7f747c155090 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 rx=0x7f747c0c2360 tx=0x7f7470017000).stop 2023-11-30T18:41:10.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.243+0000 7f74822ae700 1 -- 172.21.15.49:0/4274139953 shutdown_connections 2023-11-30T18:41:10.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.243+0000 7f74822ae700 1 --2- 172.21.15.49:0/4274139953 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f746805f030 0x7f74680614f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:10.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.243+0000 7f74822ae700 1 --2- 172.21.15.49:0/4274139953 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f747c158320 0x7f747c0a9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:10.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.243+0000 7f74822ae700 1 --2- 172.21.15.49:0/4274139953 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f747c098d10 0x7f747c155090 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:10.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.243+0000 7f74822ae700 1 --2- 172.21.15.49:0/4274139953 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f747c0c6190 0x7f747c0a95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:10.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.243+0000 7f74822ae700 1 -- 172.21.15.49:0/4274139953 >> 172.21.15.49:0/4274139953 conn(0x7f747c0cb310 msgr2=0x7f747c14c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:10.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.243+0000 7f74822ae700 1 -- 172.21.15.49:0/4274139953 shutdown_connections 2023-11-30T18:41:10.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.243+0000 7f74822ae700 1 -- 172.21.15.49:0/4274139953 wait complete. 2023-11-30T18:41:10.258 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-30T18:41:10.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.382+0000 7fc75dbd2700 1 Processor -- start 2023-11-30T18:41:10.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.382+0000 7fc75dbd2700 1 -- start start 2023-11-30T18:41:10.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.383+0000 7fc75dbd2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc7580c18a0 0x7fc7580c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:10.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.383+0000 7fc75dbd2700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc758158d50 con 0x7fc7581542d0 2023-11-30T18:41:10.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.383+0000 7fc75dbd2700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc758158140 con 0x7fc7580aa680 2023-11-30T18:41:10.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.383+0000 7fc75dbd2700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc758158420 con 0x7fc7580c18a0 2023-11-30T18:41:10.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.383+0000 7fc75cbd0700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc7581542d0 0x7fc7580a9f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50454/0 (socket says 172.21.15.49:50454) 2023-11-30T18:41:10.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.383+0000 7fc75cbd0700 1 -- 172.21.15.49:0/1742750501 learned_addr learned my addr 172.21.15.49:0/1742750501 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:10.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.383+0000 7fc75d3d1700 1 --2- 172.21.15.49:0/1742750501 >> v2:172.21.15.49:3300/0 conn(0x7fc7580c18a0 0x7fc7580c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:10.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.383+0000 7fc75d3d1700 1 -- 172.21.15.49:0/1742750501 >> v1:172.21.15.115:6789/0 conn(0x7fc7580aa680 legacy=0x7fc7580c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:10.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.383+0000 7fc75d3d1700 1 -- 172.21.15.49:0/1742750501 >> v1:172.21.15.49:6789/0 conn(0x7fc7581542d0 legacy=0x7fc7580a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:10.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.383+0000 7fc75d3d1700 1 -- 172.21.15.49:0/1742750501 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc758158700 con 0x7fc7580c18a0 2023-11-30T18:41:10.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.384+0000 7fc75d3d1700 1 --2- 172.21.15.49:0/1742750501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7580c18a0 0x7fc7580c66d0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 rx=0x7fc740009760 tx=0x7fc740009060).ready entity=mon.0 client_cookie=5b78a69cae23e4cf server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:10.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.384+0000 7fc7577fe700 1 -- 172.21.15.49:0/1742750501 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74000b580 con 0x7fc7580c18a0 2023-11-30T18:41:10.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.384+0000 7fc7577fe700 1 -- 172.21.15.49:0/1742750501 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74000b6e0 con 0x7fc7580c18a0 2023-11-30T18:41:10.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.384+0000 7fc7577fe700 1 -- 172.21.15.49:0/1742750501 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74000ba60 con 0x7fc7580c18a0 2023-11-30T18:41:10.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.384+0000 7fc75dbd2700 1 -- 172.21.15.49:0/1742750501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7580c18a0 msgr2=0x7fc7580c66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:10.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.384+0000 7fc75dbd2700 1 --2- 172.21.15.49:0/1742750501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7580c18a0 0x7fc7580c66d0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 rx=0x7fc740009760 tx=0x7fc740009060).stop 2023-11-30T18:41:10.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.384+0000 7fc75dbd2700 1 -- 172.21.15.49:0/1742750501 shutdown_connections 2023-11-30T18:41:10.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.384+0000 7fc75dbd2700 1 --2- 172.21.15.49:0/1742750501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7580c18a0 0x7fc7580c66d0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:10.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.384+0000 7fc75dbd2700 1 -- 172.21.15.49:0/1742750501 >> 172.21.15.49:0/1742750501 conn(0x7fc7580cb010 msgr2=0x7fc7580cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:10.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.384+0000 7fc75dbd2700 1 -- 172.21.15.49:0/1742750501 shutdown_connections 2023-11-30T18:41:10.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.384+0000 7fc75dbd2700 1 -- 172.21.15.49:0/1742750501 wait complete. 2023-11-30T18:41:10.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.385+0000 7fc75dbd2700 1 Processor -- start 2023-11-30T18:41:10.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.386+0000 7fc75dbd2700 1 -- start start 2023-11-30T18:41:10.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.386+0000 7fc75dbd2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7580aa680 0x7fc75814f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:10.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.386+0000 7fc75dbd2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7580c18a0 0x7fc758141b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:10.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.386+0000 7fc75dbd2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7581542d0 0x7fc7581546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:10.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.386+0000 7fc75dbd2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc758157d60 con 0x7fc7581542d0 2023-11-30T18:41:10.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.386+0000 7fc75dbd2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7580adfc0 con 0x7fc7580c18a0 2023-11-30T18:41:10.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.386+0000 7fc75dbd2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7580ae2a0 con 0x7fc7580aa680 2023-11-30T18:41:10.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.386+0000 7fc75d3d1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7581542d0 0x7fc7581546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:10.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.386+0000 7fc75d3d1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7581542d0 0x7fc7581546b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48552/0 (socket says 172.21.15.49:48552) 2023-11-30T18:41:10.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.386+0000 7fc75d3d1700 1 -- 172.21.15.49:0/2652541887 learned_addr learned my addr 172.21.15.49:0/2652541887 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:10.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.387+0000 7fc757fff700 1 --2- 172.21.15.49:0/2652541887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7580c18a0 0x7fc758141b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:10.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.387+0000 7fc75cbd0700 1 --2- 172.21.15.49:0/2652541887 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7580aa680 0x7fc75814f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:10.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.387+0000 7fc75d3d1700 1 -- 172.21.15.49:0/2652541887 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7580aa680 msgr2=0x7fc75814f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:10.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.387+0000 7fc75d3d1700 1 --2- 172.21.15.49:0/2652541887 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7580aa680 0x7fc75814f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:10.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.387+0000 7fc75d3d1700 1 -- 172.21.15.49:0/2652541887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7580c18a0 msgr2=0x7fc758141b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:10.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.387+0000 7fc75d3d1700 1 --2- 172.21.15.49:0/2652541887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7580c18a0 0x7fc758141b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:10.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.387+0000 7fc75d3d1700 1 -- 172.21.15.49:0/2652541887 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7400092a0 con 0x7fc7581542d0 2023-11-30T18:41:10.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.387+0000 7fc757fff700 1 --2- 172.21.15.49:0/2652541887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7580c18a0 0x7fc758141b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:41:10.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.387+0000 7fc75d3d1700 1 --2- 172.21.15.49:0/2652541887 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7581542d0 0x7fc7581546b0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 rx=0x7fc758060090 tx=0x7fc740017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:10.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.387+0000 7fc754ff9700 1 -- 172.21.15.49:0/2652541887 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74000ba60 con 0x7fc7581542d0 2023-11-30T18:41:10.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.387+0000 7fc754ff9700 1 -- 172.21.15.49:0/2652541887 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74001b410 con 0x7fc7581542d0 2023-11-30T18:41:10.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.387+0000 7fc75dbd2700 1 -- 172.21.15.49:0/2652541887 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7580ae580 con 0x7fc7581542d0 2023-11-30T18:41:10.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.387+0000 7fc754ff9700 1 -- 172.21.15.49:0/2652541887 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74001b790 con 0x7fc7581542d0 2023-11-30T18:41:10.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.387+0000 7fc75dbd2700 1 -- 172.21.15.49:0/2652541887 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc758142020 con 0x7fc7581542d0 2023-11-30T18:41:10.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.388+0000 7fc75dbd2700 1 -- 172.21.15.49:0/2652541887 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc758142240 con 0x7fc7581542d0 2023-11-30T18:41:10.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.388+0000 7fc754ff9700 1 -- 172.21.15.49:0/2652541887 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 98) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fc74001bb80 con 0x7fc7581542d0 2023-11-30T18:41:10.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.389+0000 7fc754ff9700 1 --2- 172.21.15.49:0/2652541887 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc73805f000 0x7fc7380614c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:10.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.389+0000 7fc754ff9700 1 -- 172.21.15.49:0/2652541887 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 6835+0+0 (secure 0 0 0) 0x7fc74007bb50 con 0x7fc7581542d0 2023-11-30T18:41:10.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.389+0000 7fc75cbd0700 1 --2- 172.21.15.49:0/2652541887 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc73805f000 0x7fc7380614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:10.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.389+0000 7fc75cbd0700 1 --2- 172.21.15.49:0/2652541887 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc73805f000 0x7fc7380614c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fc750007fd0 tx=0x7fc750009040).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:10.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.393+0000 7fc754ff9700 1 -- 172.21.15.49:0/2652541887 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc758142240 con 0x7fc7581542d0 2023-11-30T18:41:10.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:10.565+0000 7fc75dbd2700 1 -- 172.21.15.49:0/2652541887 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc758142240 con 0x7fc7581542d0 2023-11-30T18:41:11.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.007+0000 7fc754ff9700 1 -- 172.21.15.49:0/2652541887 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc740079820 con 0x7fc7581542d0 2023-11-30T18:41:11.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.241+0000 7fc754ff9700 1 -- 172.21.15.49:0/2652541887 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v209) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc740042260 con 0x7fc7581542d0 2023-11-30T18:41:11.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.244+0000 7fc75dbd2700 1 -- 172.21.15.49:0/2652541887 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc73805f000 msgr2=0x7fc7380614c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:11.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.244+0000 7fc75dbd2700 1 --2- 172.21.15.49:0/2652541887 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc73805f000 0x7fc7380614c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fc750007fd0 tx=0x7fc750009040).stop 2023-11-30T18:41:11.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.244+0000 7fc75dbd2700 1 -- 172.21.15.49:0/2652541887 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7581542d0 msgr2=0x7fc7581546b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:11.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.244+0000 7fc75dbd2700 1 --2- 172.21.15.49:0/2652541887 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7581542d0 0x7fc7581546b0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 rx=0x7fc758060090 tx=0x7fc740017000).stop 2023-11-30T18:41:11.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.245+0000 7fc75dbd2700 1 -- 172.21.15.49:0/2652541887 shutdown_connections 2023-11-30T18:41:11.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.245+0000 7fc75dbd2700 1 --2- 172.21.15.49:0/2652541887 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc73805f000 0x7fc7380614c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:11.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.245+0000 7fc75dbd2700 1 --2- 172.21.15.49:0/2652541887 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7581542d0 0x7fc7581546b0 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:11.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.245+0000 7fc75dbd2700 1 --2- 172.21.15.49:0/2652541887 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7580aa680 0x7fc75814f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:11.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.245+0000 7fc75dbd2700 1 --2- 172.21.15.49:0/2652541887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7580c18a0 0x7fc758141b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:11.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.245+0000 7fc75dbd2700 1 -- 172.21.15.49:0/2652541887 >> 172.21.15.49:0/2652541887 conn(0x7fc7580cb010 msgr2=0x7fc7580ca470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:11.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.245+0000 7fc75dbd2700 1 -- 172.21.15.49:0/2652541887 shutdown_connections 2023-11-30T18:41:11.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.245+0000 7fc75dbd2700 1 -- 172.21.15.49:0/2652541887 wait complete. 2023-11-30T18:41:11.248 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2023-11-30T18:41:11.263 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-30T18:41:11.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.390+0000 7ffae73c1700 1 Processor -- start 2023-11-30T18:41:11.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.390+0000 7ffae73c1700 1 -- start start 2023-11-30T18:41:11.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.391+0000 7ffae73c1700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ffae00aa680 0x7ffae00c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:11.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.391+0000 7ffae73c1700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffae0158d50 con 0x7ffae01546b0 2023-11-30T18:41:11.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.391+0000 7ffae73c1700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffae0158140 con 0x7ffae01542d0 2023-11-30T18:41:11.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.391+0000 7ffae73c1700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffae0158420 con 0x7ffae00aa680 2023-11-30T18:41:11.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.391+0000 7ffae6bc0700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ffae01546b0 0x7ffae00c64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43560/0 (socket says 172.21.15.49:43560) 2023-11-30T18:41:11.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.391+0000 7ffae6bc0700 1 -- 172.21.15.49:0/2013356095 learned_addr learned my addr 172.21.15.49:0/2013356095 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:11.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.391+0000 7ffae5bbe700 1 --2- 172.21.15.49:0/2013356095 >> v2:172.21.15.115:3300/0 conn(0x7ffae00aa680 0x7ffae00c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:11.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.391+0000 7ffae53bd700 1 -- 172.21.15.49:0/2013356095 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809610193 0 0) 0x7ffae0158d50 con 0x7ffae01546b0 2023-11-30T18:41:11.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.391+0000 7ffae53bd700 1 -- 172.21.15.49:0/2013356095 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffac80033f0 con 0x7ffae01546b0 2023-11-30T18:41:11.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.391+0000 7ffae53bd700 1 -- 172.21.15.49:0/2013356095 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1424591366 0 0) 0x7ffae0158140 con 0x7ffae01542d0 2023-11-30T18:41:11.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.391+0000 7ffae53bd700 1 -- 172.21.15.49:0/2013356095 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffae0158d50 con 0x7ffae01542d0 2023-11-30T18:41:11.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.392+0000 7ffae53bd700 1 -- 172.21.15.49:0/2013356095 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4066101396 0 0) 0x7ffac80033f0 con 0x7ffae01546b0 2023-11-30T18:41:11.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.392+0000 7ffae53bd700 1 -- 172.21.15.49:0/2013356095 >> v2:172.21.15.115:3300/0 conn(0x7ffae00aa680 msgr2=0x7ffae00c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:11.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.392+0000 7ffae53bd700 1 --2- 172.21.15.49:0/2013356095 >> v2:172.21.15.115:3300/0 conn(0x7ffae00aa680 0x7ffae00c5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:11.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.392+0000 7ffae53bd700 1 -- 172.21.15.49:0/2013356095 >> v1:172.21.15.115:6789/0 conn(0x7ffae01542d0 legacy=0x7ffae00a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:11.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.392+0000 7ffae53bd700 1 -- 172.21.15.49:0/2013356095 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae0158700 con 0x7ffae01546b0 2023-11-30T18:41:11.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.392+0000 7ffae53bd700 1 -- 172.21.15.49:0/2013356095 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7ffad00017f0 con 0x7ffae01546b0 2023-11-30T18:41:11.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.392+0000 7ffae53bd700 1 -- 172.21.15.49:0/2013356095 >> v1:172.21.15.49:6789/0 conn(0x7ffae01546b0 legacy=0x7ffae00c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:11.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.392+0000 7ffae53bd700 1 --2- 172.21.15.49:0/2013356095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffac8003ac0 0x7ffac8003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:11.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.392+0000 7ffae53bd700 1 --2- 172.21.15.49:0/2013356095 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffac8004690 0x7ffac8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:11.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.392+0000 7ffae53bd700 1 --2- 172.21.15.49:0/2013356095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac8005000 0x7ffac800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:11.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.392+0000 7ffae53bd700 1 -- 172.21.15.49:0/2013356095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae0158420 con 0x7ffac8005000 2023-11-30T18:41:11.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.392+0000 7ffae53bd700 1 -- 172.21.15.49:0/2013356095 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac800bf60 con 0x7ffac8003ac0 2023-11-30T18:41:11.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.392+0000 7ffae53bd700 1 -- 172.21.15.49:0/2013356095 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac800c120 con 0x7ffac8004690 2023-11-30T18:41:11.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.392+0000 7ffae5bbe700 1 --2- 172.21.15.49:0/2013356095 >> v2:172.21.15.115:3300/0 conn(0x7ffae00aa680 0x7ffae00c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:41:11.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.392+0000 7ffae6bc0700 1 --2- 172.21.15.49:0/2013356095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac8005000 0x7ffac800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:11.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.392+0000 7ffae63bf700 1 --2- 172.21.15.49:0/2013356095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffac8003ac0 0x7ffac8003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:11.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.392+0000 7ffae5bbe700 1 --2- 172.21.15.49:0/2013356095 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffac8004690 0x7ffac8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:11.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.392+0000 7ffae6bc0700 1 -- 172.21.15.49:0/2013356095 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffac8004690 msgr2=0x7ffac8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:11.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.392+0000 7ffae6bc0700 1 --2- 172.21.15.49:0/2013356095 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffac8004690 0x7ffac8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:11.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.392+0000 7ffae6bc0700 1 -- 172.21.15.49:0/2013356095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffac8003ac0 msgr2=0x7ffac8003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:11.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.392+0000 7ffae6bc0700 1 --2- 172.21.15.49:0/2013356095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffac8003ac0 0x7ffac8003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:11.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.392+0000 7ffae6bc0700 1 -- 172.21.15.49:0/2013356095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac80033f0 con 0x7ffac8005000 2023-11-30T18:41:11.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.392+0000 7ffae6bc0700 1 -- 172.21.15.49:0/2013356095 reap_dead start 2023-11-30T18:41:11.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.392+0000 7ffae6bc0700 1 --2- 172.21.15.49:0/2013356095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac8005000 0x7ffac800b8e0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 rx=0x7ffad000c410 tx=0x7ffad0007f40).ready entity=mon.0 client_cookie=c65da398c1cbaf8b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:11.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.392+0000 7ffae53bd700 1 -- 172.21.15.49:0/2013356095 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad000cce0 con 0x7ffac8005000 2023-11-30T18:41:11.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.392+0000 7ffae53bd700 1 -- 172.21.15.49:0/2013356095 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad000ce40 con 0x7ffac8005000 2023-11-30T18:41:11.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.392+0000 7ffae53bd700 1 -- 172.21.15.49:0/2013356095 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad0005d70 con 0x7ffac8005000 2023-11-30T18:41:11.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.393+0000 7ffae73c1700 1 -- 172.21.15.49:0/2013356095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac8005000 msgr2=0x7ffac800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:11.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.393+0000 7ffae73c1700 1 --2- 172.21.15.49:0/2013356095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac8005000 0x7ffac800b8e0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 rx=0x7ffad000c410 tx=0x7ffad0007f40).stop 2023-11-30T18:41:11.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.393+0000 7ffae73c1700 1 -- 172.21.15.49:0/2013356095 shutdown_connections 2023-11-30T18:41:11.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.393+0000 7ffae73c1700 1 --2- 172.21.15.49:0/2013356095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac8005000 0x7ffac800b8e0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:11.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.393+0000 7ffae73c1700 1 -- 172.21.15.49:0/2013356095 >> 172.21.15.49:0/2013356095 conn(0x7ffae00cb010 msgr2=0x7ffae00cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:11.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.393+0000 7ffae73c1700 1 -- 172.21.15.49:0/2013356095 shutdown_connections 2023-11-30T18:41:11.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.393+0000 7ffae73c1700 1 -- 172.21.15.49:0/2013356095 wait complete. 2023-11-30T18:41:11.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.394+0000 7ffae73c1700 1 Processor -- start 2023-11-30T18:41:11.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.394+0000 7ffae73c1700 1 -- start start 2023-11-30T18:41:11.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.395+0000 7ffae73c1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffac8005000 0x7ffae014b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:11.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.395+0000 7ffae73c1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffae014ce70 0x7ffae014d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:11.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.395+0000 7ffae73c1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffae00aeeb0 0x7ffae00af330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:11.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.395+0000 7ffae73c1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae00c23e0 con 0x7ffae00aeeb0 2023-11-30T18:41:11.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.395+0000 7ffae73c1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae014d7e0 con 0x7ffae014ce70 2023-11-30T18:41:11.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.395+0000 7ffae73c1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffae00c20b0 con 0x7ffac8005000 2023-11-30T18:41:11.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.395+0000 7ffae6bc0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffae00aeeb0 0x7ffae00af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:11.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.395+0000 7ffae6bc0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffae00aeeb0 0x7ffae00af330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58622/0 (socket says 172.21.15.49:58622) 2023-11-30T18:41:11.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.395+0000 7ffae6bc0700 1 -- 172.21.15.49:0/118886906 learned_addr learned my addr 172.21.15.49:0/118886906 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:11.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.395+0000 7ffae63bf700 1 --2- 172.21.15.49:0/118886906 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffac8005000 0x7ffae014b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:11.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.395+0000 7ffae5bbe700 1 --2- 172.21.15.49:0/118886906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffae014ce70 0x7ffae014d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:11.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.395+0000 7ffae6bc0700 1 -- 172.21.15.49:0/118886906 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffac8005000 msgr2=0x7ffae014b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:11.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.395+0000 7ffae6bc0700 1 --2- 172.21.15.49:0/118886906 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffac8005000 0x7ffae014b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:11.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.395+0000 7ffae6bc0700 1 -- 172.21.15.49:0/118886906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffae014ce70 msgr2=0x7ffae014d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:11.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.395+0000 7ffae6bc0700 1 --2- 172.21.15.49:0/118886906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffae014ce70 0x7ffae014d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:11.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.395+0000 7ffae6bc0700 1 -- 172.21.15.49:0/118886906 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae00afca0 con 0x7ffae00aeeb0 2023-11-30T18:41:11.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.395+0000 7ffae5bbe700 1 --2- 172.21.15.49:0/118886906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffae014ce70 0x7ffae014d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:41:11.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.395+0000 7ffae6bc0700 1 --2- 172.21.15.49:0/118886906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffae00aeeb0 0x7ffae00af330 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 rx=0x7ffad0000f80 tx=0x7ffad0013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:11.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.395+0000 7ffade7fc700 1 -- 172.21.15.49:0/118886906 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad0004a30 con 0x7ffae00aeeb0 2023-11-30T18:41:11.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.396+0000 7ffade7fc700 1 -- 172.21.15.49:0/118886906 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad0004bb0 con 0x7ffae00aeeb0 2023-11-30T18:41:11.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.396+0000 7ffae73c1700 1 -- 172.21.15.49:0/118886906 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae00aff80 con 0x7ffae00aeeb0 2023-11-30T18:41:11.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.396+0000 7ffade7fc700 1 -- 172.21.15.49:0/118886906 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad0013450 con 0x7ffae00aeeb0 2023-11-30T18:41:11.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.396+0000 7ffae73c1700 1 -- 172.21.15.49:0/118886906 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae014bb20 con 0x7ffae00aeeb0 2023-11-30T18:41:11.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.397+0000 7ffae73c1700 1 -- 172.21.15.49:0/118886906 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffae006c7c0 con 0x7ffae00aeeb0 2023-11-30T18:41:11.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.397+0000 7ffade7fc700 1 -- 172.21.15.49:0/118886906 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ffad0013800 con 0x7ffae00aeeb0 2023-11-30T18:41:11.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.397+0000 7ffade7fc700 1 --2- 172.21.15.49:0/118886906 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ffacc05f270 0x7ffacc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:11.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.397+0000 7ffade7fc700 1 -- 172.21.15.49:0/118886906 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6397+0+0 (secure 0 0 0) 0x7ffad007a6b0 con 0x7ffae00aeeb0 2023-11-30T18:41:11.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.398+0000 7ffae63bf700 1 --2- 172.21.15.49:0/118886906 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ffacc05f270 0x7ffacc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:11.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.398+0000 7ffae63bf700 1 --2- 172.21.15.49:0/118886906 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ffacc05f270 0x7ffacc061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7ffad8007ca0 tx=0x7ffad8009040).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:11.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.402+0000 7ffade7fc700 1 -- 172.21.15.49:0/118886906 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ffad004b6f0 con 0x7ffae00aeeb0 2023-11-30T18:41:11.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:11.573+0000 7ffae73c1700 1 -- 172.21.15.49:0/118886906 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ffae00c0120 con 0x7ffae00aeeb0 2023-11-30T18:41:12.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.243+0000 7ffade7fc700 1 -- 172.21.15.49:0/118886906 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v210) v1 ==== 169+0+0 (secure 0 0 0) 0x7ffad004ed10 con 0x7ffae00aeeb0 2023-11-30T18:41:12.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.246+0000 7ffae73c1700 1 -- 172.21.15.49:0/118886906 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ffacc05f270 msgr2=0x7ffacc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:12.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.246+0000 7ffae73c1700 1 --2- 172.21.15.49:0/118886906 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ffacc05f270 0x7ffacc061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7ffad8007ca0 tx=0x7ffad8009040).stop 2023-11-30T18:41:12.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.246+0000 7ffae73c1700 1 -- 172.21.15.49:0/118886906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffae00aeeb0 msgr2=0x7ffae00af330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:12.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.246+0000 7ffae73c1700 1 --2- 172.21.15.49:0/118886906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffae00aeeb0 0x7ffae00af330 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 rx=0x7ffad0000f80 tx=0x7ffad0013000).stop 2023-11-30T18:41:12.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.246+0000 7ffae73c1700 1 -- 172.21.15.49:0/118886906 shutdown_connections 2023-11-30T18:41:12.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.246+0000 7ffae73c1700 1 --2- 172.21.15.49:0/118886906 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ffacc05f270 0x7ffacc061730 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:12.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.246+0000 7ffae73c1700 1 --2- 172.21.15.49:0/118886906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffae00aeeb0 0x7ffae00af330 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:12.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.246+0000 7ffae73c1700 1 --2- 172.21.15.49:0/118886906 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffac8005000 0x7ffae014b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:12.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.246+0000 7ffae73c1700 1 --2- 172.21.15.49:0/118886906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffae014ce70 0x7ffae014d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:12.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.246+0000 7ffae73c1700 1 -- 172.21.15.49:0/118886906 >> 172.21.15.49:0/118886906 conn(0x7ffae00cb010 msgr2=0x7ffae014ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:12.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.246+0000 7ffae73c1700 1 -- 172.21.15.49:0/118886906 shutdown_connections 2023-11-30T18:41:12.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.247+0000 7ffae73c1700 1 -- 172.21.15.49:0/118886906 wait complete. 2023-11-30T18:41:12.250 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2023-11-30T18:41:12.266 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-30T18:41:12.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.388+0000 7fa6e005e700 1 Processor -- start 2023-11-30T18:41:12.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.388+0000 7fa6e005e700 1 -- start start 2023-11-30T18:41:12.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.389+0000 7fa6e005e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa6d8158a30 0x7fa6d80c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:12.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.389+0000 7fa6e005e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d80c72d0 con 0x7fa6d8098d10 2023-11-30T18:41:12.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.389+0000 7fa6e005e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d8064570 con 0x7fa6d80c6190 2023-11-30T18:41:12.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.389+0000 7fa6e005e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d8154bc0 con 0x7fa6d8158a30 2023-11-30T18:41:12.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.389+0000 7fa6de5fb700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa6d8158a30 0x7fa6d80c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:12.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.389+0000 7fa6de5fb700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa6d8158a30 0x7fa6d80c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58624/0 (socket says 172.21.15.49:58624) 2023-11-30T18:41:12.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.389+0000 7fa6de5fb700 1 -- 172.21.15.49:0/3463523020 learned_addr learned my addr 172.21.15.49:0/3463523020 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:12.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.389+0000 7fa6de5fb700 1 -- 172.21.15.49:0/3463523020 >> v1:172.21.15.115:6789/0 conn(0x7fa6d80c6190 legacy=0x7fa6d8158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:12.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.389+0000 7fa6de5fb700 1 -- 172.21.15.49:0/3463523020 >> v1:172.21.15.49:6789/0 conn(0x7fa6d8098d10 legacy=0x7fa6d8063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:12.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.389+0000 7fa6dcdf8700 1 -- 172.21.15.49:0/3463523020 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3055655330 0 0) 0x7fa6d80c72d0 con 0x7fa6d8098d10 2023-11-30T18:41:12.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.389+0000 7fa6de5fb700 1 -- 172.21.15.49:0/3463523020 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d80c66c0 con 0x7fa6d8158a30 2023-11-30T18:41:12.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.389+0000 7fa6de5fb700 1 --2- 172.21.15.49:0/3463523020 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6d8158a30 0x7fa6d80c7760 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 rx=0x7fa6c8009f20 tx=0x7fa6c8009840).ready entity=mon.0 client_cookie=1af20217a107403b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:12.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.390+0000 7fa6dcdf8700 1 -- 172.21.15.49:0/3463523020 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c800e070 con 0x7fa6d8158a30 2023-11-30T18:41:12.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.390+0000 7fa6dcdf8700 1 -- 172.21.15.49:0/3463523020 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c800ba80 con 0x7fa6d8158a30 2023-11-30T18:41:12.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.390+0000 7fa6dcdf8700 1 -- 172.21.15.49:0/3463523020 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c800be00 con 0x7fa6d8158a30 2023-11-30T18:41:12.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.390+0000 7fa6e005e700 1 -- 172.21.15.49:0/3463523020 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6d8158a30 msgr2=0x7fa6d80c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:12.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.390+0000 7fa6e005e700 1 --2- 172.21.15.49:0/3463523020 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6d8158a30 0x7fa6d80c7760 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 rx=0x7fa6c8009f20 tx=0x7fa6c8009840).stop 2023-11-30T18:41:12.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.390+0000 7fa6e005e700 1 -- 172.21.15.49:0/3463523020 shutdown_connections 2023-11-30T18:41:12.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.390+0000 7fa6e005e700 1 --2- 172.21.15.49:0/3463523020 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6d8158a30 0x7fa6d80c7760 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:12.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.390+0000 7fa6e005e700 1 -- 172.21.15.49:0/3463523020 >> 172.21.15.49:0/3463523020 conn(0x7fa6d80cb310 msgr2=0x7fa6d80cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:12.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.390+0000 7fa6e005e700 1 -- 172.21.15.49:0/3463523020 shutdown_connections 2023-11-30T18:41:12.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.390+0000 7fa6e005e700 1 -- 172.21.15.49:0/3463523020 wait complete. 2023-11-30T18:41:12.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.391+0000 7fa6e005e700 1 Processor -- start 2023-11-30T18:41:12.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.391+0000 7fa6e005e700 1 -- start start 2023-11-30T18:41:12.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.392+0000 7fa6e005e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6d8098d10 0x7fa6d8165540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:12.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.392+0000 7fa6e005e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6d80c6190 0x7fa6d80afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:12.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.392+0000 7fa6e005e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6d8158a30 0x7fa6d81528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:12.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.392+0000 7fa6e005e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d8165a30 con 0x7fa6d8098d10 2023-11-30T18:41:12.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.392+0000 7fa6e005e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d80aec50 con 0x7fa6d80c6190 2023-11-30T18:41:12.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.392+0000 7fa6e005e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d80b02e0 con 0x7fa6d8158a30 2023-11-30T18:41:12.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.392+0000 7fa6dddfa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6d8098d10 0x7fa6d8165540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:12.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.392+0000 7fa6dddfa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6d8098d10 0x7fa6d8165540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58628/0 (socket says 172.21.15.49:58628) 2023-11-30T18:41:12.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.392+0000 7fa6dddfa700 1 -- 172.21.15.49:0/885132491 learned_addr learned my addr 172.21.15.49:0/885132491 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:12.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.392+0000 7fa6de5fb700 1 --2- 172.21.15.49:0/885132491 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6d8158a30 0x7fa6d81528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:12.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.392+0000 7fa6dd5f9700 1 --2- 172.21.15.49:0/885132491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6d80c6190 0x7fa6d80afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:12.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.392+0000 7fa6dddfa700 1 -- 172.21.15.49:0/885132491 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6d8158a30 msgr2=0x7fa6d81528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:12.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.393+0000 7fa6dddfa700 1 --2- 172.21.15.49:0/885132491 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6d8158a30 0x7fa6d81528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:12.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.393+0000 7fa6dddfa700 1 -- 172.21.15.49:0/885132491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6d80c6190 msgr2=0x7fa6d80afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:12.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.393+0000 7fa6dddfa700 1 --2- 172.21.15.49:0/885132491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6d80c6190 0x7fa6d80afdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:12.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.393+0000 7fa6dddfa700 1 -- 172.21.15.49:0/885132491 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c8009ae0 con 0x7fa6d8098d10 2023-11-30T18:41:12.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.393+0000 7fa6dddfa700 1 --2- 172.21.15.49:0/885132491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6d8098d10 0x7fa6d8165540 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 rx=0x7fa6d000c490 tx=0x7fa6d0007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:12.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.393+0000 7fa6d5ffb700 1 -- 172.21.15.49:0/885132491 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d000f470 con 0x7fa6d8098d10 2023-11-30T18:41:12.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.393+0000 7fa6d5ffb700 1 -- 172.21.15.49:0/885132491 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d000f5f0 con 0x7fa6d8098d10 2023-11-30T18:41:12.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.393+0000 7fa6e005e700 1 -- 172.21.15.49:0/885132491 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d80ae360 con 0x7fa6d8098d10 2023-11-30T18:41:12.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.393+0000 7fa6d5ffb700 1 -- 172.21.15.49:0/885132491 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d000f9b0 con 0x7fa6d8098d10 2023-11-30T18:41:12.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.393+0000 7fa6e005e700 1 -- 172.21.15.49:0/885132491 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d80ae960 con 0x7fa6d8098d10 2023-11-30T18:41:12.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.394+0000 7fa6e005e700 1 -- 172.21.15.49:0/885132491 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d806c860 con 0x7fa6d8098d10 2023-11-30T18:41:12.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.394+0000 7fa6d5ffb700 1 -- 172.21.15.49:0/885132491 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa6d0012400 con 0x7fa6d8098d10 2023-11-30T18:41:12.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.394+0000 7fa6d5ffb700 1 --2- 172.21.15.49:0/885132491 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa6c405f240 0x7fa6c4061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:12.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.395+0000 7fa6d5ffb700 1 -- 172.21.15.49:0/885132491 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 5983+0+0 (secure 0 0 0) 0x7fa6d0079920 con 0x7fa6d8098d10 2023-11-30T18:41:12.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.395+0000 7fa6dd5f9700 1 --2- 172.21.15.49:0/885132491 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa6c405f240 0x7fa6c4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:12.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.395+0000 7fa6dd5f9700 1 --2- 172.21.15.49:0/885132491 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa6c405f240 0x7fa6c4061700 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fa6d8168010 tx=0x7fa6cc009040).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:12.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.399+0000 7fa6d5ffb700 1 -- 172.21.15.49:0/885132491 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa6d004aaa0 con 0x7fa6d8098d10 2023-11-30T18:41:12.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.570+0000 7fa6e005e700 1 -- 172.21.15.49:0/885132491 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa6d80c69a0 con 0x7fa6d8098d10 2023-11-30T18:41:12.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.574+0000 7fa6d5ffb700 1 -- 172.21.15.49:0/885132491 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v40) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa6d004e0c0 con 0x7fa6d8098d10 2023-11-30T18:41:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.576+0000 7fa6e005e700 1 -- 172.21.15.49:0/885132491 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa6c405f240 msgr2=0x7fa6c4061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.576+0000 7fa6e005e700 1 --2- 172.21.15.49:0/885132491 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa6c405f240 0x7fa6c4061700 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fa6d8168010 tx=0x7fa6cc009040).stop 2023-11-30T18:41:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.576+0000 7fa6e005e700 1 -- 172.21.15.49:0/885132491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6d8098d10 msgr2=0x7fa6d8165540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.576+0000 7fa6e005e700 1 --2- 172.21.15.49:0/885132491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6d8098d10 0x7fa6d8165540 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 rx=0x7fa6d000c490 tx=0x7fa6d0007c20).stop 2023-11-30T18:41:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.576+0000 7fa6e005e700 1 -- 172.21.15.49:0/885132491 shutdown_connections 2023-11-30T18:41:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.576+0000 7fa6e005e700 1 --2- 172.21.15.49:0/885132491 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa6c405f240 0x7fa6c4061700 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.576+0000 7fa6e005e700 1 --2- 172.21.15.49:0/885132491 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6d8158a30 0x7fa6d81528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.576+0000 7fa6e005e700 1 --2- 172.21.15.49:0/885132491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6d8098d10 0x7fa6d8165540 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.576+0000 7fa6e005e700 1 --2- 172.21.15.49:0/885132491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6d80c6190 0x7fa6d80afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.576+0000 7fa6e005e700 1 -- 172.21.15.49:0/885132491 >> 172.21.15.49:0/885132491 conn(0x7fa6d80cb310 msgr2=0x7fa6d80c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.576+0000 7fa6e005e700 1 -- 172.21.15.49:0/885132491 shutdown_connections 2023-11-30T18:41:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.576+0000 7fa6e005e700 1 -- 172.21.15.49:0/885132491 wait complete. 2023-11-30T18:41:12.590 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-11-30T18:41:12.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.707+0000 7f7dc214f700 1 Processor -- start 2023-11-30T18:41:12.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.707+0000 7f7dc214f700 1 -- start start 2023-11-30T18:41:12.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.708+0000 7f7dc214f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7dbc14e530 0x7f7dbc0c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:12.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.708+0000 7f7dc214f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dbc0c7bc0 con 0x7f7dbc158570 2023-11-30T18:41:12.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.708+0000 7f7dc214f700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dbc155920 con 0x7f7dbc154950 2023-11-30T18:41:12.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.708+0000 7f7dc214f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc154dd0 con 0x7f7dbc14e530 2023-11-30T18:41:12.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.708+0000 7f7dc194e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7dbc158570 0x7f7dbc0aa030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43576/0 (socket says 172.21.15.49:43576) 2023-11-30T18:41:12.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.708+0000 7f7dc194e700 1 -- 172.21.15.49:0/25094235 learned_addr learned my addr 172.21.15.49:0/25094235 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:12.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.709+0000 7f7dc114d700 1 --2- 172.21.15.49:0/25094235 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7dbc14e530 0x7f7dbc0c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:12.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.709+0000 7f7db3fff700 1 -- 172.21.15.49:0/25094235 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844531050 0 0) 0x7f7dbc0c7bc0 con 0x7f7dbc158570 2023-11-30T18:41:12.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.709+0000 7f7db3fff700 1 -- 172.21.15.49:0/25094235 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7da80033f0 con 0x7f7dbc158570 2023-11-30T18:41:12.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.709+0000 7f7db3fff700 1 -- 172.21.15.49:0/25094235 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868200241 0 0) 0x7f7dbc155920 con 0x7f7dbc154950 2023-11-30T18:41:12.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.709+0000 7f7db3fff700 1 -- 172.21.15.49:0/25094235 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dbc0c7bc0 con 0x7f7dbc154950 2023-11-30T18:41:12.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.709+0000 7f7dc114d700 1 -- 172.21.15.49:0/25094235 >> v1:172.21.15.115:6789/0 conn(0x7f7dbc154950 legacy=0x7f7dbc14e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:12.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.709+0000 7f7dc114d700 1 -- 172.21.15.49:0/25094235 >> v1:172.21.15.49:6789/0 conn(0x7f7dbc158570 legacy=0x7f7dbc0aa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:12.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.709+0000 7f7dc114d700 1 -- 172.21.15.49:0/25094235 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dbc155080 con 0x7f7dbc14e530 2023-11-30T18:41:12.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.709+0000 7f7dc114d700 1 --2- 172.21.15.49:0/25094235 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7dbc14e530 0x7f7dbc0c66f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f7db8009790 tx=0x7f7db8009060).ready entity=mon.2 client_cookie=d04a26ec275d6a5c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:12.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.709+0000 7f7db3fff700 1 -- 172.21.15.49:0/25094235 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db80090d0 con 0x7f7dbc14e530 2023-11-30T18:41:12.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.709+0000 7f7db3fff700 1 -- 172.21.15.49:0/25094235 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db800f510 con 0x7f7dbc14e530 2023-11-30T18:41:12.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.709+0000 7f7db3fff700 1 -- 172.21.15.49:0/25094235 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db800f890 con 0x7f7dbc14e530 2023-11-30T18:41:12.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.710+0000 7f7dc214f700 1 -- 172.21.15.49:0/25094235 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7dbc14e530 msgr2=0x7f7dbc0c66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:12.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.710+0000 7f7dc214f700 1 --2- 172.21.15.49:0/25094235 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7dbc14e530 0x7f7dbc0c66f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f7db8009790 tx=0x7f7db8009060).stop 2023-11-30T18:41:12.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.710+0000 7f7dc214f700 1 -- 172.21.15.49:0/25094235 shutdown_connections 2023-11-30T18:41:12.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.710+0000 7f7dc214f700 1 --2- 172.21.15.49:0/25094235 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7dbc14e530 0x7f7dbc0c66f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:12.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.710+0000 7f7dc214f700 1 -- 172.21.15.49:0/25094235 >> 172.21.15.49:0/25094235 conn(0x7f7dbc064990 msgr2=0x7f7dbc064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:12.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.710+0000 7f7dc214f700 1 -- 172.21.15.49:0/25094235 shutdown_connections 2023-11-30T18:41:12.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.710+0000 7f7dc214f700 1 -- 172.21.15.49:0/25094235 wait complete. 2023-11-30T18:41:12.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.711+0000 7f7dc214f700 1 Processor -- start 2023-11-30T18:41:12.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.711+0000 7f7dc214f700 1 -- start start 2023-11-30T18:41:12.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.712+0000 7f7dc214f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dbc14e530 0x7f7dbc14d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:12.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.712+0000 7f7dc214f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dbc154950 0x7f7dbc0af1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:12.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.712+0000 7f7dc214f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7dbc158570 0x7f7dbc0c31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:12.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.712+0000 7f7dc214f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc14dbd0 con 0x7f7dbc154950 2023-11-30T18:41:12.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.712+0000 7f7dc214f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc0ae160 con 0x7f7dbc14e530 2023-11-30T18:41:12.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.712+0000 7f7dc214f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc0ae400 con 0x7f7dbc158570 2023-11-30T18:41:12.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.712+0000 7f7dc094c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dbc154950 0x7f7dbc0af1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:12.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.712+0000 7f7dc194e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7dbc158570 0x7f7dbc0c31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:12.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.712+0000 7f7dc094c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dbc154950 0x7f7dbc0af1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58636/0 (socket says 172.21.15.49:58636) 2023-11-30T18:41:12.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.712+0000 7f7dc094c700 1 -- 172.21.15.49:0/4222725224 learned_addr learned my addr 172.21.15.49:0/4222725224 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:12.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.712+0000 7f7dc114d700 1 --2- 172.21.15.49:0/4222725224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dbc14e530 0x7f7dbc14d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:12.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.712+0000 7f7dc094c700 1 -- 172.21.15.49:0/4222725224 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7dbc158570 msgr2=0x7f7dbc0c31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:12.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.712+0000 7f7dc094c700 1 --2- 172.21.15.49:0/4222725224 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7dbc158570 0x7f7dbc0c31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:12.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.712+0000 7f7dc094c700 1 -- 172.21.15.49:0/4222725224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dbc14e530 msgr2=0x7f7dbc14d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:12.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.712+0000 7f7dc094c700 1 --2- 172.21.15.49:0/4222725224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dbc14e530 0x7f7dbc14d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:12.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.712+0000 7f7dc094c700 1 -- 172.21.15.49:0/4222725224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db80092a0 con 0x7f7dbc154950 2023-11-30T18:41:12.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.712+0000 7f7dc194e700 1 --2- 172.21.15.49:0/4222725224 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7dbc158570 0x7f7dbc0c31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:41:12.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.712+0000 7f7dc114d700 1 --2- 172.21.15.49:0/4222725224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dbc14e530 0x7f7dbc14d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:41:12.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.712+0000 7f7dc094c700 1 --2- 172.21.15.49:0/4222725224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dbc154950 0x7f7dbc0af1c0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 rx=0x7f7dac00c490 tx=0x7f7dac007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:12.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.713+0000 7f7db17fa700 1 -- 172.21.15.49:0/4222725224 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac00ce40 con 0x7f7dbc154950 2023-11-30T18:41:12.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.713+0000 7f7db17fa700 1 -- 172.21.15.49:0/4222725224 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dac00f470 con 0x7f7dbc154950 2023-11-30T18:41:12.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.713+0000 7f7dc214f700 1 -- 172.21.15.49:0/4222725224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dbc0ae6e0 con 0x7f7dbc154950 2023-11-30T18:41:12.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.713+0000 7f7db17fa700 1 -- 172.21.15.49:0/4222725224 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac00f830 con 0x7f7dbc154950 2023-11-30T18:41:12.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.713+0000 7f7dc214f700 1 -- 172.21.15.49:0/4222725224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dbc0aeca0 con 0x7f7dbc154950 2023-11-30T18:41:12.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.714+0000 7f7dc214f700 1 -- 172.21.15.49:0/4222725224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dbc062ee0 con 0x7f7dbc154950 2023-11-30T18:41:12.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.714+0000 7f7db17fa700 1 -- 172.21.15.49:0/4222725224 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f7dac00fbe0 con 0x7f7dbc154950 2023-11-30T18:41:12.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.714+0000 7f7db17fa700 1 --2- 172.21.15.49:0/4222725224 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f7da005f270 0x7f7da0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:12.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.715+0000 7f7db17fa700 1 -- 172.21.15.49:0/4222725224 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 5983+0+0 (secure 0 0 0) 0x7f7dac079820 con 0x7f7dbc154950 2023-11-30T18:41:12.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.715+0000 7f7dc114d700 1 --2- 172.21.15.49:0/4222725224 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f7da005f270 0x7f7da0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:12.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.715+0000 7f7dc114d700 1 --2- 172.21.15.49:0/4222725224 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f7da005f270 0x7f7da0061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f7db8009fd0 tx=0x7f7db8017000).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:12.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.720+0000 7f7db17fa700 1 -- 172.21.15.49:0/4222725224 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7dac04aa00 con 0x7f7dbc154950 2023-11-30T18:41:12.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.897+0000 7f7dc214f700 1 -- 172.21.15.49:0/4222725224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f7dbc06c7c0 con 0x7f7dbc154950 2023-11-30T18:41:12.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.901+0000 7f7db17fa700 1 -- 172.21.15.49:0/4222725224 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v41) v1 ==== 120+0+0 (secure 0 0 0) 0x7f7dac04e020 con 0x7f7dbc154950 2023-11-30T18:41:12.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.903+0000 7f7dc214f700 1 -- 172.21.15.49:0/4222725224 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f7da005f270 msgr2=0x7f7da0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:12.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.903+0000 7f7dc214f700 1 --2- 172.21.15.49:0/4222725224 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f7da005f270 0x7f7da0061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f7db8009fd0 tx=0x7f7db8017000).stop 2023-11-30T18:41:12.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.903+0000 7f7dc214f700 1 -- 172.21.15.49:0/4222725224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dbc154950 msgr2=0x7f7dbc0af1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:12.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.903+0000 7f7dc214f700 1 --2- 172.21.15.49:0/4222725224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dbc154950 0x7f7dbc0af1c0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 rx=0x7f7dac00c490 tx=0x7f7dac007c60).stop 2023-11-30T18:41:12.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.903+0000 7f7dc214f700 1 -- 172.21.15.49:0/4222725224 shutdown_connections 2023-11-30T18:41:12.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.903+0000 7f7dc214f700 1 --2- 172.21.15.49:0/4222725224 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f7da005f270 0x7f7da0061730 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:12.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.903+0000 7f7dc214f700 1 --2- 172.21.15.49:0/4222725224 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7dbc158570 0x7f7dbc0c31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:12.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.903+0000 7f7dc214f700 1 --2- 172.21.15.49:0/4222725224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dbc14e530 0x7f7dbc14d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:12.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.903+0000 7f7dc214f700 1 --2- 172.21.15.49:0/4222725224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dbc154950 0x7f7dbc0af1c0 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:12.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.903+0000 7f7dc214f700 1 -- 172.21.15.49:0/4222725224 >> 172.21.15.49:0/4222725224 conn(0x7f7dbc064990 msgr2=0x7f7dbc0ca3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:12.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.903+0000 7f7dc214f700 1 -- 172.21.15.49:0/4222725224 shutdown_connections 2023-11-30T18:41:12.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:12.903+0000 7f7dc214f700 1 -- 172.21.15.49:0/4222725224 wait complete. 2023-11-30T18:41:12.917 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-11-30T18:41:13.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.033+0000 7fa1b359e700 1 Processor -- start 2023-11-30T18:41:13.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.033+0000 7fa1b359e700 1 -- start start 2023-11-30T18:41:13.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.034+0000 7fa1b359e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa1b4157660 0x7fa1b4157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:13.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.034+0000 7fa1b359e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa1b40c0180 0x7fa1b41589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:13.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.034+0000 7fa1b359e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b40c12c0 con 0x7fa1b40c1750 2023-11-30T18:41:13.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.034+0000 7fa1b359e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b40c06b0 con 0x7fa1b40c0180 2023-11-30T18:41:13.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.034+0000 7fa1b359e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b40c0990 con 0x7fa1b4157660 2023-11-30T18:41:13.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.034+0000 7fa1b1d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa1b40c0180 0x7fa1b41589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:13.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.034+0000 7fa1b1d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa1b40c0180 0x7fa1b41589c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58644/0 (socket says 172.21.15.49:58644) 2023-11-30T18:41:13.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.034+0000 7fa1b1d9b700 1 -- 172.21.15.49:0/2015235367 learned_addr learned my addr 172.21.15.49:0/2015235367 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:13.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.035+0000 7fa1b1d9b700 1 -- 172.21.15.49:0/2015235367 >> v2:172.21.15.115:3300/0 conn(0x7fa1b4157660 msgr2=0x7fa1b4157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:13.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.035+0000 7fa1b259c700 1 --2- 172.21.15.49:0/2015235367 >> v2:172.21.15.115:3300/0 conn(0x7fa1b4157660 0x7fa1b4157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:13.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.035+0000 7fa1b1d9b700 1 --2- 172.21.15.49:0/2015235367 >> v2:172.21.15.115:3300/0 conn(0x7fa1b4157660 0x7fa1b4157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:13.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.035+0000 7fa1b1d9b700 1 -- 172.21.15.49:0/2015235367 >> v1:172.21.15.49:6789/0 conn(0x7fa1b40c1750 legacy=0x7fa1b40648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:13.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.035+0000 7fa1b159a700 1 -- 172.21.15.49:0/2015235367 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342657914 0 0) 0x7fa1b40c12c0 con 0x7fa1b40c1750 2023-11-30T18:41:13.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.035+0000 7fa1b1d9b700 1 -- 172.21.15.49:0/2015235367 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b40c0c70 con 0x7fa1b40c0180 2023-11-30T18:41:13.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.035+0000 7fa1b259c700 1 --2- 172.21.15.49:0/2015235367 >> v2:172.21.15.115:3300/0 conn(0x7fa1b4157660 0x7fa1b4157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:41:13.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.035+0000 7fa1b1d9b700 1 --2- 172.21.15.49:0/2015235367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1b40c0180 0x7fa1b41589c0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 rx=0x7fa1b40839a0 tx=0x7fa19c0090f0).ready entity=mon.0 client_cookie=4c50f0977a84672c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:13.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.035+0000 7fa1b159a700 1 -- 172.21.15.49:0/2015235367 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c00b600 con 0x7fa1b40c0180 2023-11-30T18:41:13.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.035+0000 7fa1b159a700 1 -- 172.21.15.49:0/2015235367 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19c00b760 con 0x7fa1b40c0180 2023-11-30T18:41:13.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.035+0000 7fa1b159a700 1 -- 172.21.15.49:0/2015235367 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c00bae0 con 0x7fa1b40c0180 2023-11-30T18:41:13.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.035+0000 7fa1b359e700 1 -- 172.21.15.49:0/2015235367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1b40c0180 msgr2=0x7fa1b41589c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:13.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.035+0000 7fa1b359e700 1 --2- 172.21.15.49:0/2015235367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1b40c0180 0x7fa1b41589c0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 rx=0x7fa1b40839a0 tx=0x7fa19c0090f0).stop 2023-11-30T18:41:13.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.036+0000 7fa1b359e700 1 -- 172.21.15.49:0/2015235367 shutdown_connections 2023-11-30T18:41:13.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.036+0000 7fa1b359e700 1 --2- 172.21.15.49:0/2015235367 >> v2:172.21.15.115:3300/0 conn(0x7fa1b4157660 0x7fa1b4157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:13.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.036+0000 7fa1b359e700 1 --2- 172.21.15.49:0/2015235367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1b40c0180 0x7fa1b41589c0 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:13.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.036+0000 7fa1b359e700 1 -- 172.21.15.49:0/2015235367 >> 172.21.15.49:0/2015235367 conn(0x7fa1b40cb000 msgr2=0x7fa1b40cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:13.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.036+0000 7fa1b359e700 1 -- 172.21.15.49:0/2015235367 shutdown_connections 2023-11-30T18:41:13.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.036+0000 7fa1b359e700 1 -- 172.21.15.49:0/2015235367 wait complete. 2023-11-30T18:41:13.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.037+0000 7fa1b359e700 1 Processor -- start 2023-11-30T18:41:13.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.037+0000 7fa1b359e700 1 -- start start 2023-11-30T18:41:13.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.037+0000 7fa1b359e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1b40c0180 0x7fa1b4153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:13.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.037+0000 7fa1b359e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1b40c1750 0x7fa1b4142c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:13.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.038+0000 7fa1b359e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1b4157660 0x7fa1b40c2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:13.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.038+0000 7fa1b359e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b41550a0 con 0x7fa1b4157660 2023-11-30T18:41:13.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.038+0000 7fa1b359e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b40c2e70 con 0x7fa1b40c1750 2023-11-30T18:41:13.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.038+0000 7fa1b359e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b4155c00 con 0x7fa1b40c0180 2023-11-30T18:41:13.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.038+0000 7fa1b2d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1b4157660 0x7fa1b40c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:13.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.038+0000 7fa1b2d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1b4157660 0x7fa1b40c2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58654/0 (socket says 172.21.15.49:58654) 2023-11-30T18:41:13.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.038+0000 7fa1b2d9d700 1 -- 172.21.15.49:0/2582105402 learned_addr learned my addr 172.21.15.49:0/2582105402 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:13.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.038+0000 7fa1b1d9b700 1 --2- 172.21.15.49:0/2582105402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1b40c1750 0x7fa1b4142c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:13.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.038+0000 7fa1b259c700 1 --2- 172.21.15.49:0/2582105402 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1b40c0180 0x7fa1b4153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:13.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.038+0000 7fa1b2d9d700 1 -- 172.21.15.49:0/2582105402 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1b40c0180 msgr2=0x7fa1b4153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:13.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.038+0000 7fa1b2d9d700 1 --2- 172.21.15.49:0/2582105402 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1b40c0180 0x7fa1b4153900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:13.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.038+0000 7fa1b2d9d700 1 -- 172.21.15.49:0/2582105402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1b40c1750 msgr2=0x7fa1b4142c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:13.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.038+0000 7fa1b2d9d700 1 --2- 172.21.15.49:0/2582105402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1b40c1750 0x7fa1b4142c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:13.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.038+0000 7fa1b2d9d700 1 -- 172.21.15.49:0/2582105402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19c009370 con 0x7fa1b4157660 2023-11-30T18:41:13.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.038+0000 7fa1b1d9b700 1 --2- 172.21.15.49:0/2582105402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1b40c1750 0x7fa1b4142c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:41:13.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.038+0000 7fa1b2d9d700 1 --2- 172.21.15.49:0/2582105402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1b4157660 0x7fa1b40c2500 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 rx=0x7fa1a400c7e0 tx=0x7fa1a4007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:13.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.038+0000 7fa1aa7fc700 1 -- 172.21.15.49:0/2582105402 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a400a520 con 0x7fa1b4157660 2023-11-30T18:41:13.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.038+0000 7fa1aa7fc700 1 -- 172.21.15.49:0/2582105402 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a400a680 con 0x7fa1b4157660 2023-11-30T18:41:13.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.038+0000 7fa1b359e700 1 -- 172.21.15.49:0/2582105402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b41552d0 con 0x7fa1b4157660 2023-11-30T18:41:13.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.038+0000 7fa1aa7fc700 1 -- 172.21.15.49:0/2582105402 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a400aa20 con 0x7fa1b4157660 2023-11-30T18:41:13.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.038+0000 7fa1b359e700 1 -- 172.21.15.49:0/2582105402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b4155910 con 0x7fa1b4157660 2023-11-30T18:41:13.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.039+0000 7fa1b359e700 1 -- 172.21.15.49:0/2582105402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b41431d0 con 0x7fa1b4157660 2023-11-30T18:41:13.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.040+0000 7fa1aa7fc700 1 -- 172.21.15.49:0/2582105402 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa1a401b400 con 0x7fa1b4157660 2023-11-30T18:41:13.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.040+0000 7fa1aa7fc700 1 --2- 172.21.15.49:0/2582105402 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa19405f270 0x7fa194061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:13.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.040+0000 7fa1aa7fc700 1 -- 172.21.15.49:0/2582105402 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 5983+0+0 (secure 0 0 0) 0x7fa1a407a1f0 con 0x7fa1b4157660 2023-11-30T18:41:13.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.040+0000 7fa1b259c700 1 --2- 172.21.15.49:0/2582105402 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa19405f270 0x7fa194061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:13.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.041+0000 7fa1b259c700 1 --2- 172.21.15.49:0/2582105402 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa19405f270 0x7fa194061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fa1ac00b850 tx=0x7fa1ac008040).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:13.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.045+0000 7fa1aa7fc700 1 -- 172.21.15.49:0/2582105402 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa1a404b370 con 0x7fa1b4157660 2023-11-30T18:41:13.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:13.284+0000 7fa1b359e700 1 -- 172.21.15.49:0/2582105402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7fa1b406c7c0 con 0x7fa1b4157660 2023-11-30T18:41:14.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.247+0000 7fa1aa7fc700 1 -- 172.21.15.49:0/2582105402 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v3016) v1 ==== 163+0+0 (secure 0 0 0) 0x7fa1a404e990 con 0x7fa1b4157660 2023-11-30T18:41:14.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.249+0000 7fa1b359e700 1 -- 172.21.15.49:0/2582105402 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa19405f270 msgr2=0x7fa194061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:14.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.249+0000 7fa1b359e700 1 --2- 172.21.15.49:0/2582105402 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa19405f270 0x7fa194061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fa1ac00b850 tx=0x7fa1ac008040).stop 2023-11-30T18:41:14.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.249+0000 7fa1b359e700 1 -- 172.21.15.49:0/2582105402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1b4157660 msgr2=0x7fa1b40c2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:14.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.249+0000 7fa1b359e700 1 --2- 172.21.15.49:0/2582105402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1b4157660 0x7fa1b40c2500 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 rx=0x7fa1a400c7e0 tx=0x7fa1a4007f70).stop 2023-11-30T18:41:14.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.249+0000 7fa1b359e700 1 -- 172.21.15.49:0/2582105402 shutdown_connections 2023-11-30T18:41:14.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.249+0000 7fa1b359e700 1 --2- 172.21.15.49:0/2582105402 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa19405f270 0x7fa194061730 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:14.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.249+0000 7fa1b359e700 1 --2- 172.21.15.49:0/2582105402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1b4157660 0x7fa1b40c2500 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:14.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.249+0000 7fa1b359e700 1 --2- 172.21.15.49:0/2582105402 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1b40c0180 0x7fa1b4153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:14.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.249+0000 7fa1b359e700 1 --2- 172.21.15.49:0/2582105402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1b40c1750 0x7fa1b4142c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:14.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.249+0000 7fa1b359e700 1 -- 172.21.15.49:0/2582105402 >> 172.21.15.49:0/2582105402 conn(0x7fa1b40cb000 msgr2=0x7fa1b40ab670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:14.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.249+0000 7fa1b359e700 1 -- 172.21.15.49:0/2582105402 shutdown_connections 2023-11-30T18:41:14.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.249+0000 7fa1b359e700 1 -- 172.21.15.49:0/2582105402 wait complete. 2023-11-30T18:41:14.264 INFO:tasks.cephfs_test_runner:Test scheduled snapshots along with rentention policy ... ok 2023-11-30T18:41:14.264 INFO:tasks.cephfs_test_runner:Starting test: test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) Test the correctness of snap directory name 2023-11-30T18:41:14.264 INFO:tasks.cephfs_test_runner:test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) 2023-11-30T18:41:14.264 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-11-30T18:41:14.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.385+0000 7fbb11f68700 1 Processor -- start 2023-11-30T18:41:14.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.385+0000 7fbb11f68700 1 -- start start 2023-11-30T18:41:14.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.386+0000 7fbb11f68700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb0c154500 0x7fbb0c0c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:14.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.386+0000 7fbb11f68700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbb0c0c7db0 0x7fbb0c0c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:14.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.386+0000 7fbb11f68700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb0c0bfc00 con 0x7fbb0c154120 2023-11-30T18:41:14.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.386+0000 7fbb11f68700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb0c0c49b0 con 0x7fbb0c0c7db0 2023-11-30T18:41:14.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.386+0000 7fbb11f68700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c0beff0 con 0x7fbb0c154500 2023-11-30T18:41:14.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.386+0000 7fbb11767700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbb0c0c7db0 0x7fbb0c0c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:14.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.386+0000 7fbb11767700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbb0c0c7db0 0x7fbb0c0c44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58662/0 (socket says 172.21.15.49:58662) 2023-11-30T18:41:14.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.386+0000 7fbb11767700 1 -- 172.21.15.49:0/1425308255 learned_addr learned my addr 172.21.15.49:0/1425308255 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:14.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.386+0000 7fbb0bfff700 1 --2- 172.21.15.49:0/1425308255 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb0c154500 0x7fbb0c0c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:14.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.387+0000 7fbb11767700 1 -- 172.21.15.49:0/1425308255 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb0c154500 msgr2=0x7fbb0c0c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:14.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.387+0000 7fbb11767700 1 --2- 172.21.15.49:0/1425308255 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb0c154500 0x7fbb0c0c3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:14.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.387+0000 7fbb11767700 1 -- 172.21.15.49:0/1425308255 >> v1:172.21.15.115:6789/0 conn(0x7fbb0c154120 legacy=0x7fbb0c0be510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:14.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.387+0000 7fbb11767700 1 -- 172.21.15.49:0/1425308255 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c0bf2d0 con 0x7fbb0c0c7db0 2023-11-30T18:41:14.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.387+0000 7fbb11767700 1 --2- 172.21.15.49:0/1425308255 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c0c7db0 0x7fbb0c0c44c0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 rx=0x7fbb04009f20 tx=0x7fbb04009840).ready entity=mon.0 client_cookie=49ca6f5beb8196e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:14.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.387+0000 7fbb0b7fe700 1 -- 172.21.15.49:0/1425308255 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0400e070 con 0x7fbb0c0c7db0 2023-11-30T18:41:14.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.387+0000 7fbb0b7fe700 1 -- 172.21.15.49:0/1425308255 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0400ba80 con 0x7fbb0c0c7db0 2023-11-30T18:41:14.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.387+0000 7fbb0b7fe700 1 -- 172.21.15.49:0/1425308255 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0400be00 con 0x7fbb0c0c7db0 2023-11-30T18:41:14.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.387+0000 7fbb11f68700 1 -- 172.21.15.49:0/1425308255 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c0c7db0 msgr2=0x7fbb0c0c44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:14.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.387+0000 7fbb11f68700 1 --2- 172.21.15.49:0/1425308255 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c0c7db0 0x7fbb0c0c44c0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 rx=0x7fbb04009f20 tx=0x7fbb04009840).stop 2023-11-30T18:41:14.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.387+0000 7fbb11f68700 1 -- 172.21.15.49:0/1425308255 shutdown_connections 2023-11-30T18:41:14.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.387+0000 7fbb11f68700 1 --2- 172.21.15.49:0/1425308255 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c0c7db0 0x7fbb0c0c44c0 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:14.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.387+0000 7fbb11f68700 1 --2- 172.21.15.49:0/1425308255 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb0c154500 0x7fbb0c0c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:14.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.387+0000 7fbb11f68700 1 -- 172.21.15.49:0/1425308255 >> 172.21.15.49:0/1425308255 conn(0x7fbb0c083000 msgr2=0x7fbb0c092540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:14.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.387+0000 7fbb11f68700 1 -- 172.21.15.49:0/1425308255 shutdown_connections 2023-11-30T18:41:14.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.387+0000 7fbb11f68700 1 -- 172.21.15.49:0/1425308255 wait complete. 2023-11-30T18:41:14.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.389+0000 7fbb11f68700 1 Processor -- start 2023-11-30T18:41:14.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.389+0000 7fbb11f68700 1 -- start start 2023-11-30T18:41:14.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.389+0000 7fbb11f68700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb0c0c7db0 0x7fbb0c150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:14.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.389+0000 7fbb11f68700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c154120 0x7fbb0c0acbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:14.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.389+0000 7fbb11f68700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb0c154500 0x7fbb0c0a8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:14.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.389+0000 7fbb11f68700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c0ac190 con 0x7fbb0c154120 2023-11-30T18:41:14.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.390+0000 7fbb11f68700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c0ac750 con 0x7fbb0c154500 2023-11-30T18:41:14.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.390+0000 7fbb11f68700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c0aeb30 con 0x7fbb0c0c7db0 2023-11-30T18:41:14.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.390+0000 7fbb0bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c154120 0x7fbb0c0acbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:14.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.390+0000 7fbb0bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c154120 0x7fbb0c0acbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58672/0 (socket says 172.21.15.49:58672) 2023-11-30T18:41:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.390+0000 7fbb0bfff700 1 -- 172.21.15.49:0/320914063 learned_addr learned my addr 172.21.15.49:0/320914063 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.390+0000 7fbb10f66700 1 --2- 172.21.15.49:0/320914063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb0c0c7db0 0x7fbb0c150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.390+0000 7fbb11767700 1 --2- 172.21.15.49:0/320914063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb0c154500 0x7fbb0c0a8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.390+0000 7fbb0bfff700 1 -- 172.21.15.49:0/320914063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb0c0c7db0 msgr2=0x7fbb0c150e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.390+0000 7fbb0bfff700 1 --2- 172.21.15.49:0/320914063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb0c0c7db0 0x7fbb0c150e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.390+0000 7fbb0bfff700 1 -- 172.21.15.49:0/320914063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb0c154500 msgr2=0x7fbb0c0a8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.390+0000 7fbb0bfff700 1 --2- 172.21.15.49:0/320914063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb0c154500 0x7fbb0c0a8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.390+0000 7fbb0bfff700 1 -- 172.21.15.49:0/320914063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb04009ae0 con 0x7fbb0c154120 2023-11-30T18:41:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.390+0000 7fbb0bfff700 1 --2- 172.21.15.49:0/320914063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c154120 0x7fbb0c0acbe0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 rx=0x7fbaf800d8c0 tx=0x7fbaf8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.390+0000 7fbb08ff9700 1 -- 172.21.15.49:0/320914063 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8011590 con 0x7fbb0c154120 2023-11-30T18:41:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.390+0000 7fbb08ff9700 1 -- 172.21.15.49:0/320914063 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf80116f0 con 0x7fbb0c154120 2023-11-30T18:41:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.390+0000 7fbb11f68700 1 -- 172.21.15.49:0/320914063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb0c0a93f0 con 0x7fbb0c154120 2023-11-30T18:41:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.390+0000 7fbb08ff9700 1 -- 172.21.15.49:0/320914063 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8011a70 con 0x7fbb0c154120 2023-11-30T18:41:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.390+0000 7fbb11f68700 1 -- 172.21.15.49:0/320914063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb0c0ac3e0 con 0x7fbb0c154120 2023-11-30T18:41:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.391+0000 7fbb11f68700 1 -- 172.21.15.49:0/320914063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb0c06c7c0 con 0x7fbb0c154120 2023-11-30T18:41:14.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.392+0000 7fbb08ff9700 1 -- 172.21.15.49:0/320914063 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fbaf801c460 con 0x7fbb0c154120 2023-11-30T18:41:14.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.392+0000 7fbb08ff9700 1 --2- 172.21.15.49:0/320914063 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fbaf005f270 0x7fbaf0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:14.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.392+0000 7fbb08ff9700 1 -- 172.21.15.49:0/320914063 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 5983+0+0 (secure 0 0 0) 0x7fbaf8079f40 con 0x7fbb0c154120 2023-11-30T18:41:14.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.392+0000 7fbb10f66700 1 --2- 172.21.15.49:0/320914063 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fbaf005f270 0x7fbaf0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:14.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.393+0000 7fbb10f66700 1 --2- 172.21.15.49:0/320914063 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fbaf005f270 0x7fbaf0061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fbb0c153a50 tx=0x7fbb00009040).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:14.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.396+0000 7fbb08ff9700 1 -- 172.21.15.49:0/320914063 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbaf804b0c0 con 0x7fbb0c154120 2023-11-30T18:41:14.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:14.639+0000 7fbb11f68700 1 -- 172.21.15.49:0/320914063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7fbb0c06c130 con 0x7fbb0c154120 2023-11-30T18:41:15.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.248+0000 7fbb08ff9700 1 -- 172.21.15.49:0/320914063 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v3017) v1 ==== 158+0+0 (secure 0 0 0) 0x7fbaf8011e60 con 0x7fbb0c154120 2023-11-30T18:41:15.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.250+0000 7fbb11f68700 1 -- 172.21.15.49:0/320914063 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fbaf005f270 msgr2=0x7fbaf0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:15.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.250+0000 7fbb11f68700 1 --2- 172.21.15.49:0/320914063 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fbaf005f270 0x7fbaf0061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fbb0c153a50 tx=0x7fbb00009040).stop 2023-11-30T18:41:15.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.250+0000 7fbb11f68700 1 -- 172.21.15.49:0/320914063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c154120 msgr2=0x7fbb0c0acbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:15.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.250+0000 7fbb11f68700 1 --2- 172.21.15.49:0/320914063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c154120 0x7fbb0c0acbe0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 rx=0x7fbaf800d8c0 tx=0x7fbaf8008040).stop 2023-11-30T18:41:15.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.250+0000 7fbb11f68700 1 -- 172.21.15.49:0/320914063 shutdown_connections 2023-11-30T18:41:15.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.250+0000 7fbb11f68700 1 --2- 172.21.15.49:0/320914063 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fbaf005f270 0x7fbaf0061730 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:15.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.250+0000 7fbb11f68700 1 --2- 172.21.15.49:0/320914063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb0c154500 0x7fbb0c0a8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:15.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.250+0000 7fbb11f68700 1 --2- 172.21.15.49:0/320914063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbb0c0c7db0 0x7fbb0c150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:15.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.250+0000 7fbb11f68700 1 --2- 172.21.15.49:0/320914063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c154120 0x7fbb0c0acbe0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:15.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.250+0000 7fbb11f68700 1 -- 172.21.15.49:0/320914063 >> 172.21.15.49:0/320914063 conn(0x7fbb0c083000 msgr2=0x7fbb0c067d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:15.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.250+0000 7fbb11f68700 1 -- 172.21.15.49:0/320914063 shutdown_connections 2023-11-30T18:41:15.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.250+0000 7fbb11f68700 1 -- 172.21.15.49:0/320914063 wait complete. 2023-11-30T18:41:15.265 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-30T18:41:15.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.388+0000 7fc48340c700 1 Processor -- start 2023-11-30T18:41:15.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.388+0000 7fc48340c700 1 -- start start 2023-11-30T18:41:15.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.389+0000 7fc48340c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc47c0c6190 0x7fc47c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:15.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.389+0000 7fc48340c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc47c158320 0x7fc47c1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:15.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.389+0000 7fc48340c700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc47c158cc0 con 0x7fc47c098d10 2023-11-30T18:41:15.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.389+0000 7fc48340c700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47c0c72d0 con 0x7fc47c158320 2023-11-30T18:41:15.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.389+0000 7fc48340c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c064570 con 0x7fc47c0c6190 2023-11-30T18:41:15.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.389+0000 7fc4811a8700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc47c098d10 0x7fc47c063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43586/0 (socket says 172.21.15.49:43586) 2023-11-30T18:41:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.389+0000 7fc4811a8700 1 -- 172.21.15.49:0/496770390 learned_addr learned my addr 172.21.15.49:0/496770390 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.389+0000 7fc4809a7700 1 --2- 172.21.15.49:0/496770390 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc47c0c6190 0x7fc47c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.389+0000 7fc4819a9700 1 --2- 172.21.15.49:0/496770390 >> v2:172.21.15.115:3300/0 conn(0x7fc47c158320 0x7fc47c1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.389+0000 7fc47bfff700 1 -- 172.21.15.49:0/496770390 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1254673981 0 0) 0x7fc474001110 con 0x7fc47c098d10 2023-11-30T18:41:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.390+0000 7fc47bfff700 1 -- 172.21.15.49:0/496770390 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4640033f0 con 0x7fc47c098d10 2023-11-30T18:41:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.390+0000 7fc47bfff700 1 -- 172.21.15.49:0/496770390 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2410716176 0 0) 0x7fc4640033f0 con 0x7fc47c098d10 2023-11-30T18:41:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.390+0000 7fc47bfff700 1 -- 172.21.15.49:0/496770390 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc47c0c6190 msgr2=0x7fc47c0c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.390+0000 7fc47bfff700 1 --2- 172.21.15.49:0/496770390 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc47c0c6190 0x7fc47c0c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.390+0000 7fc47bfff700 1 -- 172.21.15.49:0/496770390 >> v2:172.21.15.115:3300/0 conn(0x7fc47c158320 msgr2=0x7fc47c1587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.390+0000 7fc47bfff700 1 --2- 172.21.15.49:0/496770390 >> v2:172.21.15.115:3300/0 conn(0x7fc47c158320 0x7fc47c1587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.390+0000 7fc47bfff700 1 -- 172.21.15.49:0/496770390 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c154bc0 con 0x7fc47c098d10 2023-11-30T18:41:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.390+0000 7fc47bfff700 1 -- 172.21.15.49:0/496770390 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fc474001600 con 0x7fc47c098d10 2023-11-30T18:41:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.390+0000 7fc4819a9700 1 --2- 172.21.15.49:0/496770390 >> v2:172.21.15.115:3300/0 conn(0x7fc47c158320 0x7fc47c1587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:41:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.390+0000 7fc4809a7700 1 --2- 172.21.15.49:0/496770390 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc47c0c6190 0x7fc47c0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:41:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.390+0000 7fc47bfff700 1 -- 172.21.15.49:0/496770390 >> v1:172.21.15.49:6789/0 conn(0x7fc47c098d10 legacy=0x7fc47c063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.390+0000 7fc47bfff700 1 --2- 172.21.15.49:0/496770390 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc47c0c6190 0x7fc4640038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.390+0000 7fc47bfff700 1 --2- 172.21.15.49:0/496770390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc464003dd0 0x7fc464004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.390+0000 7fc47bfff700 1 --2- 172.21.15.49:0/496770390 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc464004b80 0x7fc464005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.390+0000 7fc47bfff700 1 -- 172.21.15.49:0/496770390 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c0c72d0 con 0x7fc464003dd0 2023-11-30T18:41:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.390+0000 7fc47bfff700 1 -- 172.21.15.49:0/496770390 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c064570 con 0x7fc464004b80 2023-11-30T18:41:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.390+0000 7fc47bfff700 1 -- 172.21.15.49:0/496770390 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc46400b8e0 con 0x7fc47c0c6190 2023-11-30T18:41:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.390+0000 7fc4809a7700 1 --2- 172.21.15.49:0/496770390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc464003dd0 0x7fc464004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.390+0000 7fc4819a9700 1 --2- 172.21.15.49:0/496770390 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc464004b80 0x7fc464005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.390+0000 7fc4811a8700 1 --2- 172.21.15.49:0/496770390 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc47c0c6190 0x7fc4640038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:15.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.390+0000 7fc4809a7700 1 -- 172.21.15.49:0/496770390 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc47c0c6190 msgr2=0x7fc4640038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:15.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.390+0000 7fc4809a7700 1 --2- 172.21.15.49:0/496770390 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc47c0c6190 0x7fc4640038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:15.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.390+0000 7fc4809a7700 1 -- 172.21.15.49:0/496770390 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc464004b80 msgr2=0x7fc464005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:15.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.390+0000 7fc4809a7700 1 --2- 172.21.15.49:0/496770390 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc464004b80 0x7fc464005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:15.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.390+0000 7fc4809a7700 1 -- 172.21.15.49:0/496770390 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4700092a0 con 0x7fc464003dd0 2023-11-30T18:41:15.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.390+0000 7fc4809a7700 1 --2- 172.21.15.49:0/496770390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc464003dd0 0x7fc464004690 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7fc47c0c65f0 tx=0x7fc470009060).ready entity=mon.0 client_cookie=68893e36f283d45f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:15.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.391+0000 7fc47bfff700 1 -- 172.21.15.49:0/496770390 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4700095c0 con 0x7fc464003dd0 2023-11-30T18:41:15.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.391+0000 7fc47bfff700 1 -- 172.21.15.49:0/496770390 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47000e710 con 0x7fc464003dd0 2023-11-30T18:41:15.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.391+0000 7fc47bfff700 1 -- 172.21.15.49:0/496770390 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47000ea90 con 0x7fc464003dd0 2023-11-30T18:41:15.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.391+0000 7fc48340c700 1 -- 172.21.15.49:0/496770390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc464003dd0 msgr2=0x7fc464004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:15.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.391+0000 7fc48340c700 1 --2- 172.21.15.49:0/496770390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc464003dd0 0x7fc464004690 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7fc47c0c65f0 tx=0x7fc470009060).stop 2023-11-30T18:41:15.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.391+0000 7fc4819a9700 1 -- 172.21.15.49:0/496770390 reap_dead start 2023-11-30T18:41:15.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.391+0000 7fc48340c700 1 -- 172.21.15.49:0/496770390 shutdown_connections 2023-11-30T18:41:15.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.391+0000 7fc48340c700 1 -- 172.21.15.49:0/496770390 >> 172.21.15.49:0/496770390 conn(0x7fc47c0cb310 msgr2=0x7fc47c0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:15.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.391+0000 7fc48340c700 1 -- 172.21.15.49:0/496770390 shutdown_connections 2023-11-30T18:41:15.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.391+0000 7fc48340c700 1 -- 172.21.15.49:0/496770390 wait complete. 2023-11-30T18:41:15.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.392+0000 7fc48340c700 1 Processor -- start 2023-11-30T18:41:15.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.392+0000 7fc48340c700 1 -- start start 2023-11-30T18:41:15.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.393+0000 7fc48340c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc464003dd0 0x7fc47c148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:15.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.393+0000 7fc48340c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc47c0c9900 0x7fc47c155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:15.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.393+0000 7fc48340c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc47c155af0 0x7fc47c168360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:15.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.393+0000 7fc48340c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c0c8730 con 0x7fc47c0c9900 2023-11-30T18:41:15.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.393+0000 7fc48340c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c0c9590 con 0x7fc47c155af0 2023-11-30T18:41:15.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.393+0000 7fc48340c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c155f70 con 0x7fc464003dd0 2023-11-30T18:41:15.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.393+0000 7fc4809a7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc47c0c9900 0x7fc47c155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:15.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.393+0000 7fc4809a7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc47c0c9900 0x7fc47c155600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58698/0 (socket says 172.21.15.49:58698) 2023-11-30T18:41:15.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.393+0000 7fc4809a7700 1 -- 172.21.15.49:0/79132833 learned_addr learned my addr 172.21.15.49:0/79132833 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:15.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.394+0000 7fc4811a8700 1 --2- 172.21.15.49:0/79132833 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc464003dd0 0x7fc47c148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:15.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.394+0000 7fc4819a9700 1 --2- 172.21.15.49:0/79132833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc47c155af0 0x7fc47c168360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:15.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.394+0000 7fc4809a7700 1 -- 172.21.15.49:0/79132833 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc464003dd0 msgr2=0x7fc47c148b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:15.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.394+0000 7fc4809a7700 1 --2- 172.21.15.49:0/79132833 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc464003dd0 0x7fc47c148b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:15.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.394+0000 7fc4809a7700 1 -- 172.21.15.49:0/79132833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc47c155af0 msgr2=0x7fc47c168360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:15.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.394+0000 7fc4809a7700 1 --2- 172.21.15.49:0/79132833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc47c155af0 0x7fc47c168360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:15.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.394+0000 7fc4809a7700 1 -- 172.21.15.49:0/79132833 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c0c8980 con 0x7fc47c0c9900 2023-11-30T18:41:15.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.394+0000 7fc4819a9700 1 --2- 172.21.15.49:0/79132833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc47c155af0 0x7fc47c168360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:41:15.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.394+0000 7fc4809a7700 1 --2- 172.21.15.49:0/79132833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc47c0c9900 0x7fc47c155600 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 rx=0x7fc47001d7c0 tx=0x7fc470019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:15.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.394+0000 7fc4797fa700 1 -- 172.21.15.49:0/79132833 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47001dd10 con 0x7fc47c0c9900 2023-11-30T18:41:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.394+0000 7fc4797fa700 1 -- 172.21.15.49:0/79132833 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47001de70 con 0x7fc47c0c9900 2023-11-30T18:41:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.394+0000 7fc48340c700 1 -- 172.21.15.49:0/79132833 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc47c0c8c60 con 0x7fc47c0c9900 2023-11-30T18:41:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.394+0000 7fc4797fa700 1 -- 172.21.15.49:0/79132833 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc470026640 con 0x7fc47c0c9900 2023-11-30T18:41:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.394+0000 7fc48340c700 1 -- 172.21.15.49:0/79132833 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc47c0c9220 con 0x7fc47c0c9900 2023-11-30T18:41:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.395+0000 7fc48340c700 1 -- 172.21.15.49:0/79132833 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc47c165ec0 con 0x7fc47c0c9900 2023-11-30T18:41:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.395+0000 7fc4797fa700 1 -- 172.21.15.49:0/79132833 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc47001b470 con 0x7fc47c0c9900 2023-11-30T18:41:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.396+0000 7fc4797fa700 1 --2- 172.21.15.49:0/79132833 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc46805f270 0x7fc468061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.396+0000 7fc4797fa700 1 -- 172.21.15.49:0/79132833 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 5983+0+0 (secure 0 0 0) 0x7fc47007bcd0 con 0x7fc47c0c9900 2023-11-30T18:41:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.396+0000 7fc4811a8700 1 --2- 172.21.15.49:0/79132833 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc46805f270 0x7fc468061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.396+0000 7fc4811a8700 1 --2- 172.21.15.49:0/79132833 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc46805f270 0x7fc468061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fc474001870 tx=0x7fc474009040).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.400+0000 7fc4797fa700 1 -- 172.21.15.49:0/79132833 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc47004ce50 con 0x7fc47c0c9900 2023-11-30T18:41:15.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.572+0000 7fc48340c700 1 -- 172.21.15.49:0/79132833 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc47c0c96d0 con 0x7fc47c0c9900 2023-11-30T18:41:15.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.576+0000 7fc4797fa700 1 -- 172.21.15.49:0/79132833 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v42)=0 v42) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc47c0c96d0 con 0x7fc47c0c9900 2023-11-30T18:41:15.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.578+0000 7fc48340c700 1 -- 172.21.15.49:0/79132833 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc46805f270 msgr2=0x7fc468061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:15.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.578+0000 7fc48340c700 1 --2- 172.21.15.49:0/79132833 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc46805f270 0x7fc468061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fc474001870 tx=0x7fc474009040).stop 2023-11-30T18:41:15.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.578+0000 7fc48340c700 1 -- 172.21.15.49:0/79132833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc47c0c9900 msgr2=0x7fc47c155600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:15.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.578+0000 7fc48340c700 1 --2- 172.21.15.49:0/79132833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc47c0c9900 0x7fc47c155600 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 rx=0x7fc47001d7c0 tx=0x7fc470019000).stop 2023-11-30T18:41:15.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.578+0000 7fc48340c700 1 -- 172.21.15.49:0/79132833 shutdown_connections 2023-11-30T18:41:15.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.578+0000 7fc48340c700 1 --2- 172.21.15.49:0/79132833 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc46805f270 0x7fc468061730 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:15.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.578+0000 7fc48340c700 1 --2- 172.21.15.49:0/79132833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc47c155af0 0x7fc47c168360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:15.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.578+0000 7fc48340c700 1 --2- 172.21.15.49:0/79132833 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc464003dd0 0x7fc47c148b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:15.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.578+0000 7fc48340c700 1 --2- 172.21.15.49:0/79132833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc47c0c9900 0x7fc47c155600 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:15.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.578+0000 7fc48340c700 1 -- 172.21.15.49:0/79132833 >> 172.21.15.49:0/79132833 conn(0x7fc47c0cb310 msgr2=0x7fc47c151b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:15.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.578+0000 7fc48340c700 1 -- 172.21.15.49:0/79132833 shutdown_connections 2023-11-30T18:41:15.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.578+0000 7fc48340c700 1 -- 172.21.15.49:0/79132833 wait complete. 2023-11-30T18:41:15.591 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-30T18:41:15.592 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T18:41:15.633 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T18:41:15.680 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-30T18:41:15.680 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-30T18:41:15.681 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:41:15.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.797+0000 7f3f62c94700 1 Processor -- start 2023-11-30T18:41:15.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.797+0000 7f3f62c94700 1 -- start start 2023-11-30T18:41:15.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.798+0000 7f3f62c94700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3f5c1548c0 0x7f3f5c06a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:15.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.798+0000 7f3f62c94700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3f5c0c6e30 0x7f3f5c0c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:15.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.798+0000 7f3f62c94700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5c0c69a0 con 0x7f3f5c1544e0 2023-11-30T18:41:15.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.798+0000 7f3f62c94700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f5c0c13a0 con 0x7f3f5c0c6e30 2023-11-30T18:41:15.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.798+0000 7f3f62c94700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f5c0c1680 con 0x7f3f5c1548c0 2023-11-30T18:41:15.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.799+0000 7f3f61231700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3f5c0c6e30 0x7f3f5c0c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:15.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.799+0000 7f3f61231700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3f5c0c6e30 0x7f3f5c0c72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58700/0 (socket says 172.21.15.49:58700) 2023-11-30T18:41:15.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.799+0000 7f3f61231700 1 -- 172.21.15.49:0/3896484167 learned_addr learned my addr 172.21.15.49:0/3896484167 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:15.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.799+0000 7f3f5bfff700 1 --2- 172.21.15.49:0/3896484167 >> v2:172.21.15.115:3300/0 conn(0x7f3f5c1548c0 0x7f3f5c06a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:15.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.799+0000 7f3f61231700 1 -- 172.21.15.49:0/3896484167 >> v2:172.21.15.115:3300/0 conn(0x7f3f5c1548c0 msgr2=0x7f3f5c06a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:15.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.799+0000 7f3f61231700 1 --2- 172.21.15.49:0/3896484167 >> v2:172.21.15.115:3300/0 conn(0x7f3f5c1548c0 0x7f3f5c06a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:15.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.799+0000 7f3f61231700 1 -- 172.21.15.49:0/3896484167 >> v1:172.21.15.115:6789/0 conn(0x7f3f5c1544e0 legacy=0x7f3f5c0c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:15.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.799+0000 7f3f61231700 1 -- 172.21.15.49:0/3896484167 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5c0c6630 con 0x7f3f5c0c6e30 2023-11-30T18:41:15.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.799+0000 7f3f61231700 1 --2- 172.21.15.49:0/3896484167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f5c0c6e30 0x7f3f5c0c72a0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 rx=0x7f3f5c0c12d0 tx=0x7f3f440090f0).ready entity=mon.0 client_cookie=94758f29123fc0ad server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:15.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.799+0000 7f3f5b7fe700 1 -- 172.21.15.49:0/3896484167 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4400b600 con 0x7f3f5c0c6e30 2023-11-30T18:41:15.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.799+0000 7f3f5b7fe700 1 -- 172.21.15.49:0/3896484167 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4400b760 con 0x7f3f5c0c6e30 2023-11-30T18:41:15.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.799+0000 7f3f5b7fe700 1 -- 172.21.15.49:0/3896484167 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4400bae0 con 0x7f3f5c0c6e30 2023-11-30T18:41:15.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.800+0000 7f3f62c94700 1 -- 172.21.15.49:0/3896484167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f5c0c6e30 msgr2=0x7f3f5c0c72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:15.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.800+0000 7f3f62c94700 1 --2- 172.21.15.49:0/3896484167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f5c0c6e30 0x7f3f5c0c72a0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 rx=0x7f3f5c0c12d0 tx=0x7f3f440090f0).stop 2023-11-30T18:41:15.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.800+0000 7f3f62c94700 1 -- 172.21.15.49:0/3896484167 shutdown_connections 2023-11-30T18:41:15.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.800+0000 7f3f62c94700 1 --2- 172.21.15.49:0/3896484167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f5c0c6e30 0x7f3f5c0c72a0 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:15.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.800+0000 7f3f62c94700 1 --2- 172.21.15.49:0/3896484167 >> v2:172.21.15.115:3300/0 conn(0x7f3f5c1548c0 0x7f3f5c06a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:15.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.800+0000 7f3f62c94700 1 -- 172.21.15.49:0/3896484167 >> 172.21.15.49:0/3896484167 conn(0x7f3f5c085020 msgr2=0x7f3f5c094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:15.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.800+0000 7f3f62c94700 1 -- 172.21.15.49:0/3896484167 shutdown_connections 2023-11-30T18:41:15.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.800+0000 7f3f62c94700 1 -- 172.21.15.49:0/3896484167 wait complete. 2023-11-30T18:41:15.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.801+0000 7f3f62c94700 1 Processor -- start 2023-11-30T18:41:15.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.801+0000 7f3f62c94700 1 -- start start 2023-11-30T18:41:15.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.802+0000 7f3f62c94700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f5c0c6e30 0x7f3f5c0c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:15.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.802+0000 7f3f62c94700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3f5c1544e0 0x7f3f5c0acd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:15.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.802+0000 7f3f62c94700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f5c1548c0 0x7f3f5c0c2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:15.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.802+0000 7f3f62c94700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c0c3700 con 0x7f3f5c1548c0 2023-11-30T18:41:15.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.802+0000 7f3f62c94700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c0c2820 con 0x7f3f5c0c6e30 2023-11-30T18:41:15.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.802+0000 7f3f62c94700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c0c2af0 con 0x7f3f5c1544e0 2023-11-30T18:41:15.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.802+0000 7f3f61231700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f5c1548c0 0x7f3f5c0c2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:15.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.802+0000 7f3f61231700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f5c1548c0 0x7f3f5c0c2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58706/0 (socket says 172.21.15.49:58706) 2023-11-30T18:41:15.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.802+0000 7f3f61231700 1 -- 172.21.15.49:0/739154219 learned_addr learned my addr 172.21.15.49:0/739154219 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:15.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.802+0000 7f3f60a30700 1 --2- 172.21.15.49:0/739154219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f5c0c6e30 0x7f3f5c0c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:15.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.802+0000 7f3f5bfff700 1 --2- 172.21.15.49:0/739154219 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3f5c1544e0 0x7f3f5c0acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:15.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.802+0000 7f3f61231700 1 -- 172.21.15.49:0/739154219 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3f5c1544e0 msgr2=0x7f3f5c0acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:15.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.802+0000 7f3f61231700 1 --2- 172.21.15.49:0/739154219 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3f5c1544e0 0x7f3f5c0acd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:15.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.802+0000 7f3f61231700 1 -- 172.21.15.49:0/739154219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f5c0c6e30 msgr2=0x7f3f5c0c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:15.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.802+0000 7f3f61231700 1 --2- 172.21.15.49:0/739154219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f5c0c6e30 0x7f3f5c0c3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:15.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.802+0000 7f3f61231700 1 -- 172.21.15.49:0/739154219 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f44009370 con 0x7f3f5c1548c0 2023-11-30T18:41:15.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.802+0000 7f3f5bfff700 1 --2- 172.21.15.49:0/739154219 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3f5c1544e0 0x7f3f5c0acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:41:15.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.802+0000 7f3f61231700 1 --2- 172.21.15.49:0/739154219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f5c1548c0 0x7f3f5c0c2330 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 rx=0x7f3f44009130 tx=0x7f3f44017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:15.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.802+0000 7f3f58ff9700 1 -- 172.21.15.49:0/739154219 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4400bae0 con 0x7f3f5c1548c0 2023-11-30T18:41:15.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.803+0000 7f3f58ff9700 1 -- 172.21.15.49:0/739154219 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4401b410 con 0x7f3f5c1548c0 2023-11-30T18:41:15.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.803+0000 7f3f62c94700 1 -- 172.21.15.49:0/739154219 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f5c0c2dd0 con 0x7f3f5c1548c0 2023-11-30T18:41:15.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.803+0000 7f3f58ff9700 1 -- 172.21.15.49:0/739154219 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4401b7d0 con 0x7f3f5c1548c0 2023-11-30T18:41:15.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.803+0000 7f3f62c94700 1 -- 172.21.15.49:0/739154219 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5c0c3390 con 0x7f3f5c1548c0 2023-11-30T18:41:15.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.804+0000 7f3f62c94700 1 -- 172.21.15.49:0/739154219 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f5c0c3870 con 0x7f3f5c1548c0 2023-11-30T18:41:15.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.804+0000 7f3f58ff9700 1 -- 172.21.15.49:0/739154219 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f3f4401bb80 con 0x7f3f5c1548c0 2023-11-30T18:41:15.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.804+0000 7f3f58ff9700 1 --2- 172.21.15.49:0/739154219 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f3f3c05f240 0x7f3f3c061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:15.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.804+0000 7f3f58ff9700 1 -- 172.21.15.49:0/739154219 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 5983+0+0 (secure 0 0 0) 0x7f3f4407bf20 con 0x7f3f5c1548c0 2023-11-30T18:41:15.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.804+0000 7f3f60a30700 1 --2- 172.21.15.49:0/739154219 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f3f3c05f240 0x7f3f3c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:15.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.805+0000 7f3f60a30700 1 --2- 172.21.15.49:0/739154219 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f3f3c05f240 0x7f3f3c061700 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f3f54007fd0 tx=0x7f3f54009040).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:15.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:15.809+0000 7f3f58ff9700 1 -- 172.21.15.49:0/739154219 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3f4404d100 con 0x7f3f5c1548c0 2023-11-30T18:41:16.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.023+0000 7f3f62c94700 1 -- 172.21.15.49:0/739154219 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f5c0c6250 con 0x7f3f5c1548c0 2023-11-30T18:41:16.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.023+0000 7f3f58ff9700 1 -- 172.21.15.49:0/739154219 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f3f44029020 con 0x7f3f5c1548c0 2023-11-30T18:41:16.025 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:16.025 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":87,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7904,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/873619564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":873619564},{"type":"v1","addr":"172.21.15.115:6837","nonce":873619564}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":9172,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/4238872035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":4238872035},{"type":"v1","addr":"172.21.15.115:6835","nonce":4238872035}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":9495,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1878169084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1878169084},{"type":"v1","addr":"172.21.15.49:6834","nonce":1878169084}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":9921,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3883392044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3883392044},{"type":"v1","addr":"172.21.15.49:6835","nonce":3883392044}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[]} 2023-11-30T18:41:16.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.025+0000 7f3f62c94700 1 -- 172.21.15.49:0/739154219 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f3f3c05f240 msgr2=0x7f3f3c061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:16.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.025+0000 7f3f62c94700 1 --2- 172.21.15.49:0/739154219 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f3f3c05f240 0x7f3f3c061700 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f3f54007fd0 tx=0x7f3f54009040).stop 2023-11-30T18:41:16.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.025+0000 7f3f62c94700 1 -- 172.21.15.49:0/739154219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f5c1548c0 msgr2=0x7f3f5c0c2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:16.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.025+0000 7f3f62c94700 1 --2- 172.21.15.49:0/739154219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f5c1548c0 0x7f3f5c0c2330 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 rx=0x7f3f44009130 tx=0x7f3f44017000).stop 2023-11-30T18:41:16.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.025+0000 7f3f62c94700 1 -- 172.21.15.49:0/739154219 shutdown_connections 2023-11-30T18:41:16.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.025+0000 7f3f62c94700 1 --2- 172.21.15.49:0/739154219 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f3f3c05f240 0x7f3f3c061700 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:16.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.025+0000 7f3f62c94700 1 --2- 172.21.15.49:0/739154219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f5c1548c0 0x7f3f5c0c2330 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:16.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.025+0000 7f3f62c94700 1 --2- 172.21.15.49:0/739154219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f5c0c6e30 0x7f3f5c0c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:16.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.025+0000 7f3f62c94700 1 --2- 172.21.15.49:0/739154219 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3f5c1544e0 0x7f3f5c0acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:16.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.025+0000 7f3f62c94700 1 -- 172.21.15.49:0/739154219 >> 172.21.15.49:0/739154219 conn(0x7f3f5c085020 msgr2=0x7f3f5c064630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:16.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.025+0000 7f3f62c94700 1 -- 172.21.15.49:0/739154219 shutdown_connections 2023-11-30T18:41:16.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.025+0000 7f3f62c94700 1 -- 172.21.15.49:0/739154219 wait complete. 2023-11-30T18:41:16.028 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 87 2023-11-30T18:41:16.039 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-30T18:41:16.039 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-30T18:41:16.040 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-30T18:41:16.040 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:41:16.040 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-30T18:41:16.040 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-30T18:41:16.040 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-30T18:41:16.041 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:41:16.041 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-30T18:41:16.041 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-30T18:41:16.041 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-30T18:41:16.041 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:41:16.041 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-30T18:41:16.042 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-30T18:41:16.042 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-30T18:41:16.042 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:41:16.049 INFO:tasks.ceph.mds.a:Stopped 2023-11-30T18:41:16.049 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-30T18:41:16.050 INFO:tasks.ceph.mds.c:Stopped 2023-11-30T18:41:16.051 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-30T18:41:16.052 INFO:tasks.ceph.mds.b:Stopped 2023-11-30T18:41:16.052 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-30T18:41:16.054 INFO:tasks.ceph.mds.d:Stopped 2023-11-30T18:41:16.054 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-30T18:41:16.092 INFO:tasks.ceph.mds.a:Started 2023-11-30T18:41:16.092 DEBUG:teuthology.parallel:result is None 2023-11-30T18:41:16.093 INFO:tasks.ceph.mds.c:Started 2023-11-30T18:41:16.093 DEBUG:teuthology.parallel:result is None 2023-11-30T18:41:16.098 INFO:tasks.ceph.mds.b:Started 2023-11-30T18:41:16.098 DEBUG:teuthology.parallel:result is None 2023-11-30T18:41:16.099 INFO:tasks.ceph.mds.d:Started 2023-11-30T18:41:16.099 DEBUG:teuthology.parallel:result is None 2023-11-30T18:41:16.099 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-30T18:41:16.167 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-11-30T18:41:16.168 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-11-30T18:41:16.178 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-11-30T18:41:16.178 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-11-30T18:41:16.179 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-11-30T18:41:16.177+0000 7f67c006f700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-11-30T18:41:16.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.230+0000 7fc848f77700 1 Processor -- start 2023-11-30T18:41:16.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.230+0000 7fc848f77700 1 -- start start 2023-11-30T18:41:16.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.231+0000 7fc848f77700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc844098d10 0x7fc8440c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:16.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.231+0000 7fc848f77700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc8440c6190 0x7fc844063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:16.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.231+0000 7fc848f77700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8440c72d0 con 0x7fc844064350 2023-11-30T18:41:16.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.231+0000 7fc848f77700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc844154bc0 con 0x7fc844098d10 2023-11-30T18:41:16.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.231+0000 7fc848f77700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8440c66c0 con 0x7fc8440c6190 2023-11-30T18:41:16.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.231+0000 7fc84259c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc844098d10 0x7fc8440c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:16.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.231+0000 7fc84259c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc844098d10 0x7fc8440c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58746/0 (socket says 172.21.15.49:58746) 2023-11-30T18:41:16.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.231+0000 7fc84259c700 1 -- 172.21.15.49:0/3810032693 learned_addr learned my addr 172.21.15.49:0/3810032693 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:16.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.231+0000 7fc841d9b700 1 --2- 172.21.15.49:0/3810032693 >> v2:172.21.15.115:3300/0 conn(0x7fc8440c6190 0x7fc844063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:16.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.231+0000 7fc84259c700 1 -- 172.21.15.49:0/3810032693 >> v2:172.21.15.115:3300/0 conn(0x7fc8440c6190 msgr2=0x7fc844063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:16.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.231+0000 7fc84259c700 1 --2- 172.21.15.49:0/3810032693 >> v2:172.21.15.115:3300/0 conn(0x7fc8440c6190 0x7fc844063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:16.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.231+0000 7fc84259c700 1 -- 172.21.15.49:0/3810032693 >> v1:172.21.15.115:6789/0 conn(0x7fc844064350 legacy=0x7fc844158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:16.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.231+0000 7fc84259c700 1 -- 172.21.15.49:0/3810032693 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8440c69a0 con 0x7fc844098d10 2023-11-30T18:41:16.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.231+0000 7fc84259c700 1 --2- 172.21.15.49:0/3810032693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc844098d10 0x7fc8440c7760 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 rx=0x7fc8440c5b40 tx=0x7fc8340090f0).ready entity=mon.0 client_cookie=6c650f6d0c1cf3f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:16.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.231+0000 7fc84159a700 1 -- 172.21.15.49:0/3810032693 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83400b520 con 0x7fc844098d10 2023-11-30T18:41:16.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.232+0000 7fc84159a700 1 -- 172.21.15.49:0/3810032693 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83400b680 con 0x7fc844098d10 2023-11-30T18:41:16.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.232+0000 7fc84159a700 1 -- 172.21.15.49:0/3810032693 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83400ba00 con 0x7fc844098d10 2023-11-30T18:41:16.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.232+0000 7fc848f77700 1 -- 172.21.15.49:0/3810032693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc844098d10 msgr2=0x7fc8440c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:16.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.232+0000 7fc848f77700 1 --2- 172.21.15.49:0/3810032693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc844098d10 0x7fc8440c7760 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 rx=0x7fc8440c5b40 tx=0x7fc8340090f0).stop 2023-11-30T18:41:16.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.232+0000 7fc848f77700 1 -- 172.21.15.49:0/3810032693 shutdown_connections 2023-11-30T18:41:16.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.232+0000 7fc848f77700 1 --2- 172.21.15.49:0/3810032693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc844098d10 0x7fc8440c7760 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:16.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.232+0000 7fc848f77700 1 --2- 172.21.15.49:0/3810032693 >> v2:172.21.15.115:3300/0 conn(0x7fc8440c6190 0x7fc844063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:16.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.232+0000 7fc848f77700 1 -- 172.21.15.49:0/3810032693 >> 172.21.15.49:0/3810032693 conn(0x7fc8440cb310 msgr2=0x7fc8440cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:16.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.232+0000 7fc848f77700 1 -- 172.21.15.49:0/3810032693 shutdown_connections 2023-11-30T18:41:16.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.232+0000 7fc848f77700 1 -- 172.21.15.49:0/3810032693 wait complete. 2023-11-30T18:41:16.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.233+0000 7fc848f77700 1 Processor -- start 2023-11-30T18:41:16.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.233+0000 7fc848f77700 1 -- start start 2023-11-30T18:41:16.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.234+0000 7fc848f77700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc844064350 0x7fc8440c4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:16.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.234+0000 7fc848f77700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc844098d10 0x7fc844155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:16.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.234+0000 7fc848f77700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8440c6190 0x7fc8440a94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:16.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.234+0000 7fc848f77700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8440c5200 con 0x7fc844098d10 2023-11-30T18:41:16.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.234+0000 7fc848f77700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8440aec90 con 0x7fc844064350 2023-11-30T18:41:16.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.234+0000 7fc848f77700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8440aef70 con 0x7fc8440c6190 2023-11-30T18:41:16.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.234+0000 7fc841d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc844098d10 0x7fc844155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:16.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.234+0000 7fc841d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc844098d10 0x7fc844155770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58762/0 (socket says 172.21.15.49:58762) 2023-11-30T18:41:16.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.234+0000 7fc841d9b700 1 -- 172.21.15.49:0/3372165193 learned_addr learned my addr 172.21.15.49:0/3372165193 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:16.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.234+0000 7fc84259c700 1 --2- 172.21.15.49:0/3372165193 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc844064350 0x7fc8440c4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:16.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.234+0000 7fc842d9d700 1 --2- 172.21.15.49:0/3372165193 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8440c6190 0x7fc8440a94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:16.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.234+0000 7fc841d9b700 1 -- 172.21.15.49:0/3372165193 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8440c6190 msgr2=0x7fc8440a94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:16.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.234+0000 7fc841d9b700 1 --2- 172.21.15.49:0/3372165193 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8440c6190 0x7fc8440a94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:16.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.234+0000 7fc841d9b700 1 -- 172.21.15.49:0/3372165193 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc844064350 msgr2=0x7fc8440c4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:16.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.234+0000 7fc841d9b700 1 --2- 172.21.15.49:0/3372165193 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc844064350 0x7fc8440c4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:16.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.234+0000 7fc841d9b700 1 -- 172.21.15.49:0/3372165193 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc834009370 con 0x7fc844098d10 2023-11-30T18:41:16.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.234+0000 7fc842d9d700 1 --2- 172.21.15.49:0/3372165193 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8440c6190 0x7fc8440a94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:41:16.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.234+0000 7fc84259c700 1 --2- 172.21.15.49:0/3372165193 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc844064350 0x7fc8440c4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:41:16.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.235+0000 7fc841d9b700 1 --2- 172.21.15.49:0/3372165193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc844098d10 0x7fc844155770 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 rx=0x7fc83800e900 tx=0x7fc838009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:16.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.235+0000 7fc8327fc700 1 -- 172.21.15.49:0/3372165193 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83800c640 con 0x7fc844098d10 2023-11-30T18:41:16.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.235+0000 7fc8327fc700 1 -- 172.21.15.49:0/3372165193 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83800c7a0 con 0x7fc844098d10 2023-11-30T18:41:16.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.235+0000 7fc8327fc700 1 -- 172.21.15.49:0/3372165193 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83800cb20 con 0x7fc844098d10 2023-11-30T18:41:16.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.235+0000 7fc848f77700 1 -- 172.21.15.49:0/3372165193 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc844157510 con 0x7fc844098d10 2023-11-30T18:41:16.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.235+0000 7fc848f77700 1 -- 172.21.15.49:0/3372165193 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc844157ad0 con 0x7fc844098d10 2023-11-30T18:41:16.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.236+0000 7fc848f77700 1 -- 172.21.15.49:0/3372165193 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc84406c860 con 0x7fc844098d10 2023-11-30T18:41:16.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.236+0000 7fc8327fc700 1 -- 172.21.15.49:0/3372165193 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc83801b400 con 0x7fc844098d10 2023-11-30T18:41:16.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.236+0000 7fc8327fc700 1 --2- 172.21.15.49:0/3372165193 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc82405f270 0x7fc824061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:16.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.237+0000 7fc8327fc700 1 -- 172.21.15.49:0/3372165193 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 5983+0+0 (secure 0 0 0) 0x7fc83807a6f0 con 0x7fc844098d10 2023-11-30T18:41:16.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.237+0000 7fc84259c700 1 --2- 172.21.15.49:0/3372165193 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc82405f270 0x7fc824061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:16.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.237+0000 7fc84259c700 1 --2- 172.21.15.49:0/3372165193 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc82405f270 0x7fc824061730 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fc83400b2e0 tx=0x7fc834017000).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:16.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.241+0000 7fc8327fc700 1 -- 172.21.15.49:0/3372165193 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc83804b870 con 0x7fc844098d10 2023-11-30T18:41:16.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:16.431+0000 7fc848f77700 1 -- 172.21.15.49:0/3372165193 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc8440c6c80 con 0x7fc844098d10 2023-11-30T18:41:17.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.262+0000 7fc8327fc700 1 -- 172.21.15.49:0/3372165193 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v215) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc83804ee90 con 0x7fc844098d10 2023-11-30T18:41:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.264+0000 7fc848f77700 1 -- 172.21.15.49:0/3372165193 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc82405f270 msgr2=0x7fc824061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.264+0000 7fc848f77700 1 --2- 172.21.15.49:0/3372165193 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc82405f270 0x7fc824061730 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fc83400b2e0 tx=0x7fc834017000).stop 2023-11-30T18:41:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.264+0000 7fc848f77700 1 -- 172.21.15.49:0/3372165193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc844098d10 msgr2=0x7fc844155770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.264+0000 7fc848f77700 1 --2- 172.21.15.49:0/3372165193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc844098d10 0x7fc844155770 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 rx=0x7fc83800e900 tx=0x7fc838009060).stop 2023-11-30T18:41:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.264+0000 7fc848f77700 1 -- 172.21.15.49:0/3372165193 shutdown_connections 2023-11-30T18:41:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.264+0000 7fc848f77700 1 --2- 172.21.15.49:0/3372165193 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc82405f270 0x7fc824061730 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.264+0000 7fc848f77700 1 --2- 172.21.15.49:0/3372165193 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8440c6190 0x7fc8440a94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:17.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.264+0000 7fc848f77700 1 --2- 172.21.15.49:0/3372165193 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc844064350 0x7fc8440c4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:17.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.264+0000 7fc848f77700 1 --2- 172.21.15.49:0/3372165193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc844098d10 0x7fc844155770 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:17.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.264+0000 7fc848f77700 1 -- 172.21.15.49:0/3372165193 >> 172.21.15.49:0/3372165193 conn(0x7fc8440cb310 msgr2=0x7fc84414d460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:17.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.264+0000 7fc848f77700 1 -- 172.21.15.49:0/3372165193 shutdown_connections 2023-11-30T18:41:17.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.264+0000 7fc848f77700 1 -- 172.21.15.49:0/3372165193 wait complete. 2023-11-30T18:41:17.266 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2023-11-30T18:41:17.279 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-30T18:41:17.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.398+0000 7ff9a0ab7700 1 Processor -- start 2023-11-30T18:41:17.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.398+0000 7ff9a0ab7700 1 -- start start 2023-11-30T18:41:17.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.399+0000 7ff9a0ab7700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff99c0caab0 0x7ff99c0aa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:17.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.399+0000 7ff9a0ab7700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff99c0ca180 0x7ff99c15e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.399+0000 7ff9a0ab7700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff99c0a9a90 con 0x7ff99c0cae90 2023-11-30T18:41:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.399+0000 7ff9a0ab7700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff99c154ce0 con 0x7ff99c0ca180 2023-11-30T18:41:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.399+0000 7ff9a0ab7700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff99c0a8e80 con 0x7ff99c0caab0 2023-11-30T18:41:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.399+0000 7ff99ad9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff99c0ca180 0x7ff99c15e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.399+0000 7ff99ad9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff99c0ca180 0x7ff99c15e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58774/0 (socket says 172.21.15.49:58774) 2023-11-30T18:41:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.399+0000 7ff99ad9d700 1 -- 172.21.15.49:0/3797586836 learned_addr learned my addr 172.21.15.49:0/3797586836 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.400+0000 7ff99a59c700 1 --2- 172.21.15.49:0/3797586836 >> v2:172.21.15.115:3300/0 conn(0x7ff99c0caab0 0x7ff99c0aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.400+0000 7ff99ad9d700 1 -- 172.21.15.49:0/3797586836 >> v2:172.21.15.115:3300/0 conn(0x7ff99c0caab0 msgr2=0x7ff99c0aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.400+0000 7ff99ad9d700 1 --2- 172.21.15.49:0/3797586836 >> v2:172.21.15.115:3300/0 conn(0x7ff99c0caab0 0x7ff99c0aa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.400+0000 7ff99ad9d700 1 -- 172.21.15.49:0/3797586836 >> v1:172.21.15.115:6789/0 conn(0x7ff99c0cae90 legacy=0x7ff99c0c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.400+0000 7ff99ad9d700 1 -- 172.21.15.49:0/3797586836 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99c0a9160 con 0x7ff99c0ca180 2023-11-30T18:41:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.400+0000 7ff99ad9d700 1 --2- 172.21.15.49:0/3797586836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff99c0ca180 0x7ff99c15e3c0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 rx=0x7ff99c0848c0 tx=0x7ff98c009840).ready entity=mon.0 client_cookie=8a141f3535cb7d7f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.400+0000 7ff99959a700 1 -- 172.21.15.49:0/3797586836 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c00e070 con 0x7ff99c0ca180 2023-11-30T18:41:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.400+0000 7ff99959a700 1 -- 172.21.15.49:0/3797586836 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98c00ba10 con 0x7ff99c0ca180 2023-11-30T18:41:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.400+0000 7ff99959a700 1 -- 172.21.15.49:0/3797586836 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c00bd90 con 0x7ff99c0ca180 2023-11-30T18:41:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.400+0000 7ff9a0ab7700 1 -- 172.21.15.49:0/3797586836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff99c0ca180 msgr2=0x7ff99c15e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.400+0000 7ff9a0ab7700 1 --2- 172.21.15.49:0/3797586836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff99c0ca180 0x7ff99c15e3c0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 rx=0x7ff99c0848c0 tx=0x7ff98c009840).stop 2023-11-30T18:41:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.400+0000 7ff9a0ab7700 1 -- 172.21.15.49:0/3797586836 shutdown_connections 2023-11-30T18:41:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.401+0000 7ff9a0ab7700 1 --2- 172.21.15.49:0/3797586836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff99c0ca180 0x7ff99c15e3c0 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.401+0000 7ff9a0ab7700 1 --2- 172.21.15.49:0/3797586836 >> v2:172.21.15.115:3300/0 conn(0x7ff99c0caab0 0x7ff99c0aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.401+0000 7ff9a0ab7700 1 -- 172.21.15.49:0/3797586836 >> 172.21.15.49:0/3797586836 conn(0x7ff99c094920 msgr2=0x7ff99c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.401+0000 7ff9a0ab7700 1 -- 172.21.15.49:0/3797586836 shutdown_connections 2023-11-30T18:41:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.401+0000 7ff9a0ab7700 1 -- 172.21.15.49:0/3797586836 wait complete. 2023-11-30T18:41:17.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.402+0000 7ff9a0ab7700 1 Processor -- start 2023-11-30T18:41:17.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.402+0000 7ff9a0ab7700 1 -- start start 2023-11-30T18:41:17.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.402+0000 7ff9a0ab7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff99c0ca180 0x7ff99c1649a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:17.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.402+0000 7ff9a0ab7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff99c0caab0 0x7ff99c0c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:17.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.402+0000 7ff9a0ab7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff99c0cae90 0x7ff99c0c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:17.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.402+0000 7ff9a0ab7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c164e90 con 0x7ff99c0caab0 2023-11-30T18:41:17.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.402+0000 7ff9a0ab7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c156030 con 0x7ff99c0cae90 2023-11-30T18:41:17.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.402+0000 7ff9a0ab7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c1565f0 con 0x7ff99c0ca180 2023-11-30T18:41:17.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.403+0000 7ff999d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff99c0caab0 0x7ff99c0c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:17.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.403+0000 7ff999d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff99c0caab0 0x7ff99c0c4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58778/0 (socket says 172.21.15.49:58778) 2023-11-30T18:41:17.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.403+0000 7ff999d9b700 1 -- 172.21.15.49:0/1577443204 learned_addr learned my addr 172.21.15.49:0/1577443204 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:17.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.403+0000 7ff99a59c700 1 --2- 172.21.15.49:0/1577443204 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff99c0ca180 0x7ff99c1649a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:17.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.403+0000 7ff99ad9d700 1 --2- 172.21.15.49:0/1577443204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff99c0cae90 0x7ff99c0c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:17.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.403+0000 7ff999d9b700 1 -- 172.21.15.49:0/1577443204 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff99c0ca180 msgr2=0x7ff99c1649a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:17.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.403+0000 7ff999d9b700 1 --2- 172.21.15.49:0/1577443204 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff99c0ca180 0x7ff99c1649a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:17.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.403+0000 7ff999d9b700 1 -- 172.21.15.49:0/1577443204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff99c0cae90 msgr2=0x7ff99c0c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:17.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.403+0000 7ff999d9b700 1 --2- 172.21.15.49:0/1577443204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff99c0cae90 0x7ff99c0c8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:17.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.403+0000 7ff999d9b700 1 -- 172.21.15.49:0/1577443204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98c009ae0 con 0x7ff99c0caab0 2023-11-30T18:41:17.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.403+0000 7ff99a59c700 1 --2- 172.21.15.49:0/1577443204 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff99c0ca180 0x7ff99c1649a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:41:17.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.403+0000 7ff99ad9d700 1 --2- 172.21.15.49:0/1577443204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff99c0cae90 0x7ff99c0c8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:41:17.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.403+0000 7ff999d9b700 1 --2- 172.21.15.49:0/1577443204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff99c0caab0 0x7ff99c0c4c00 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 rx=0x7ff98400b460 tx=0x7ff984006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:17.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.403+0000 7ff9927fc700 1 -- 172.21.15.49:0/1577443204 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff984012410 con 0x7ff99c0caab0 2023-11-30T18:41:17.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.403+0000 7ff9927fc700 1 -- 172.21.15.49:0/1577443204 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9840125b0 con 0x7ff99c0caab0 2023-11-30T18:41:17.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.403+0000 7ff9927fc700 1 -- 172.21.15.49:0/1577443204 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff984012970 con 0x7ff99c0caab0 2023-11-30T18:41:17.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.403+0000 7ff9a0ab7700 1 -- 172.21.15.49:0/1577443204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff99c0c50f0 con 0x7ff99c0caab0 2023-11-30T18:41:17.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.403+0000 7ff9a0ab7700 1 -- 172.21.15.49:0/1577443204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff99c0c5350 con 0x7ff99c0caab0 2023-11-30T18:41:17.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.404+0000 7ff9a0ab7700 1 -- 172.21.15.49:0/1577443204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff99c06c860 con 0x7ff99c0caab0 2023-11-30T18:41:17.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.404+0000 7ff9927fc700 1 -- 172.21.15.49:0/1577443204 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff984012d20 con 0x7ff99c0caab0 2023-11-30T18:41:17.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.405+0000 7ff9927fc700 1 --2- 172.21.15.49:0/1577443204 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff97c05f240 0x7ff97c061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:17.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.405+0000 7ff9927fc700 1 -- 172.21.15.49:0/1577443204 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 5381+0+0 (secure 0 0 0) 0x7ff984079e30 con 0x7ff99c0caab0 2023-11-30T18:41:17.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.405+0000 7ff99a59c700 1 --2- 172.21.15.49:0/1577443204 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff97c05f240 0x7ff97c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:17.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.405+0000 7ff99a59c700 1 --2- 172.21.15.49:0/1577443204 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff97c05f240 0x7ff97c061700 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7ff994006fd0 tx=0x7ff994008040).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:17.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.409+0000 7ff9927fc700 1 -- 172.21.15.49:0/1577443204 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff98404b260 con 0x7ff99c0caab0 2023-11-30T18:41:17.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.647+0000 7ff9a0ab7700 1 -- 172.21.15.49:0/1577443204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff99c0a9440 con 0x7ff99c0caab0 2023-11-30T18:41:17.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.648+0000 7ff9927fc700 1 -- 172.21.15.49:0/1577443204 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v49) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ff98404e880 con 0x7ff99c0caab0 2023-11-30T18:41:17.649 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:17.649 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T18:41:17.649 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2023-11-30T18:41:17.649 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:41:17.649 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2023-11-30T18:41:17.649 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlwm1FHxAAk+s9c60UZ5jB37wbpGzlcg==", 2023-11-30T18:41:17.649 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:41:17.649 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:41:17.650 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T18:41:17.650 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T18:41:17.650 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:41:17.650 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:41:17.650 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:41:17.650 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:41:17.650 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2023-11-30T18:41:17.650 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlADm0KhAArffesGGTXzQwY4NPnJ1Bjw==", 2023-11-30T18:41:17.650 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:41:17.650 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:41:17.650 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T18:41:17.650 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T18:41:17.650 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:41:17.650 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:41:17.650 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:41:17.651 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:41:17.651 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2023-11-30T18:41:17.651 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlYnY1JhAA+Lurauug0NhWnK8aZErR3g==", 2023-11-30T18:41:17.651 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:41:17.651 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:41:17.651 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T18:41:17.651 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T18:41:17.651 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:41:17.651 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:41:17.651 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:41:17.651 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:41:17.651 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2023-11-30T18:41:17.651 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlQdKCMRAA3h4O2NqkQ2zE3DxOqBoaQQ==", 2023-11-30T18:41:17.651 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:41:17.652 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:41:17.652 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T18:41:17.652 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T18:41:17.652 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:41:17.652 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:41:17.652 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:41:17.652 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:41:17.652 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2023-11-30T18:41:17.652 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAPwWhlGdbhFxAAOspNRLMhR59LSWatFbsYDA==", 2023-11-30T18:41:17.652 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:41:17.652 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:41:17.652 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:41:17.652 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:41:17.652 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:41:17.652 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:41:17.653 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:41:17.653 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2023-11-30T18:41:17.653 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQASwWhlfwUEFxAAuj0L8ooIGi1vsb7XWLVlDA==", 2023-11-30T18:41:17.653 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:41:17.653 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:41:17.653 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:41:17.653 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:41:17.653 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:41:17.653 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:41:17.653 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:41:17.653 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2023-11-30T18:41:17.653 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAVwWhl7XYwFBAAuSHZqdfRR8V1Y+hmPT5uuw==", 2023-11-30T18:41:17.653 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:41:17.653 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:41:17.654 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:41:17.654 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:41:17.654 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:41:17.654 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:41:17.654 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:41:17.654 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2023-11-30T18:41:17.654 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAYwWhlkhRCFRAAe3cRLcrhJ3ZoluXuRUhmew==", 2023-11-30T18:41:17.654 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:41:17.654 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:41:17.654 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:41:17.654 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:41:17.654 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:41:17.654 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:41:17.654 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:41:17.654 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2023-11-30T18:41:17.655 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAewWhlrq4qFBAAOSdqozO8iH25BQFrPI1SRQ==", 2023-11-30T18:41:17.655 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:41:17.655 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:41:17.655 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:41:17.655 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:41:17.655 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:41:17.655 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:41:17.655 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:41:17.655 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2023-11-30T18:41:17.655 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAhwWhlZL9WERAA90znWBLNuY5eem3yF6O0wg==", 2023-11-30T18:41:17.655 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:41:17.655 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:41:17.655 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:41:17.655 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:41:17.655 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:41:17.656 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:41:17.656 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:41:17.656 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2023-11-30T18:41:17.656 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAkwWhlCJDiEBAAETLCBNCdaWXFgkPPaulTAA==", 2023-11-30T18:41:17.656 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:41:17.656 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:41:17.656 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:41:17.656 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:41:17.656 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:41:17.656 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:41:17.656 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:41:17.656 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2023-11-30T18:41:17.656 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAnwWhl+IiYEBAAcI3AU5xrv0cYy9lckyu0dQ==", 2023-11-30T18:41:17.656 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:41:17.656 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2023-11-30T18:41:17.657 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2023-11-30T18:41:17.657 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:41:17.657 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:41:17.657 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:41:17.657 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:41:17.657 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2023-11-30T18:41:17.657 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhleYZcNRAA5PoPChH+s6XfbrQ0hmu2NA==", 2023-11-30T18:41:17.657 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:41:17.657 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:41:17.657 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2023-11-30T18:41:17.657 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-30T18:41:17.657 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:41:17.658 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:41:17.658 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:41:17.658 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2023-11-30T18:41:17.658 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAOwWhlFhcfAhAAzaBDtyRxuqeQ9BatfgUuXw==", 2023-11-30T18:41:17.658 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:41:17.658 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:41:17.658 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T18:41:17.658 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T18:41:17.658 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T18:41:17.658 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:41:17.658 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:41:17.658 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:41:17.658 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2023-11-30T18:41:17.658 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlLZrDOhAAHG/dYWYmPouk3+Iqafr7qw==", 2023-11-30T18:41:17.658 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:41:17.659 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:41:17.659 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T18:41:17.659 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T18:41:17.659 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T18:41:17.659 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:41:17.659 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:41:17.659 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:41:17.659 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2023-11-30T18:41:17.659 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAOwWhl6lxuBxAA/YXQDo+U2ppULGzK054Gzg==", 2023-11-30T18:41:17.659 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:41:17.659 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2023-11-30T18:41:17.659 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2023-11-30T18:41:17.659 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2023-11-30T18:41:17.659 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2023-11-30T18:41:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:41:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:41:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:41:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2023-11-30T18:41:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhl4JkLAxAAiaLgZ5eiazaT9VanG5ihyQ==", 2023-11-30T18:41:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:41:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T18:41:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2023-11-30T18:41:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2023-11-30T18:41:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:41:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:41:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:41:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:41:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2023-11-30T18:41:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlH1s2HBAA3ea9Utfv7fZoo2hO+ElDVQ==", 2023-11-30T18:41:17.660 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:41:17.661 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T18:41:17.661 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-11-30T18:41:17.661 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:41:17.661 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:41:17.661 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:41:17.661 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:41:17.661 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2023-11-30T18:41:17.661 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQANwWhlpy+fFxAA3qmboR+PlQtK6T35ryj+Lw==", 2023-11-30T18:41:17.661 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2023-11-30T18:41:17.661 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2023-11-30T18:41:17.661 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2023-11-30T18:41:17.661 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2023-11-30T18:41:17.661 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:41:17.661 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:41:17.661 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-11-30T18:41:17.662 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T18:41:17.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.650+0000 7ff9a0ab7700 1 -- 172.21.15.49:0/1577443204 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff97c05f240 msgr2=0x7ff97c061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:17.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.650+0000 7ff9a0ab7700 1 --2- 172.21.15.49:0/1577443204 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff97c05f240 0x7ff97c061700 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7ff994006fd0 tx=0x7ff994008040).stop 2023-11-30T18:41:17.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.650+0000 7ff9a0ab7700 1 -- 172.21.15.49:0/1577443204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff99c0caab0 msgr2=0x7ff99c0c4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:17.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.650+0000 7ff9a0ab7700 1 --2- 172.21.15.49:0/1577443204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff99c0caab0 0x7ff99c0c4c00 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 rx=0x7ff98400b460 tx=0x7ff984006f20).stop 2023-11-30T18:41:17.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.650+0000 7ff9a0ab7700 1 -- 172.21.15.49:0/1577443204 shutdown_connections 2023-11-30T18:41:17.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.650+0000 7ff9a0ab7700 1 --2- 172.21.15.49:0/1577443204 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff97c05f240 0x7ff97c061700 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:17.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.650+0000 7ff9a0ab7700 1 --2- 172.21.15.49:0/1577443204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff99c0cae90 0x7ff99c0c8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:17.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.650+0000 7ff9a0ab7700 1 --2- 172.21.15.49:0/1577443204 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff99c0ca180 0x7ff99c1649a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:17.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.650+0000 7ff9a0ab7700 1 --2- 172.21.15.49:0/1577443204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff99c0caab0 0x7ff99c0c4c00 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:17.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.650+0000 7ff9a0ab7700 1 -- 172.21.15.49:0/1577443204 >> 172.21.15.49:0/1577443204 conn(0x7ff99c094920 msgr2=0x7ff99c0a7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:17.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.650+0000 7ff9a0ab7700 1 -- 172.21.15.49:0/1577443204 shutdown_connections 2023-11-30T18:41:17.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.650+0000 7ff9a0ab7700 1 -- 172.21.15.49:0/1577443204 wait complete. 2023-11-30T18:41:17.664 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:41:17.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.781+0000 7fc4693b5700 1 Processor -- start 2023-11-30T18:41:17.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.781+0000 7fc4693b5700 1 -- start start 2023-11-30T18:41:17.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.782+0000 7fc4693b5700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc464157660 0x7fc464157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:17.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.782+0000 7fc4693b5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc4640c0180 0x7fc4641589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:17.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.782+0000 7fc4693b5700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4640c12c0 con 0x7fc4640c1750 2023-11-30T18:41:17.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.782+0000 7fc4693b5700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4640c06b0 con 0x7fc4640c0180 2023-11-30T18:41:17.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.782+0000 7fc4693b5700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4640c0990 con 0x7fc464157660 2023-11-30T18:41:17.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.782+0000 7fc4637fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc4640c0180 0x7fc4641589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:17.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.782+0000 7fc4637fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc4640c0180 0x7fc4641589c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58790/0 (socket says 172.21.15.49:58790) 2023-11-30T18:41:17.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.782+0000 7fc4637fe700 1 -- 172.21.15.49:0/3336286213 learned_addr learned my addr 172.21.15.49:0/3336286213 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:17.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.782+0000 7fc463fff700 1 --2- 172.21.15.49:0/3336286213 >> v2:172.21.15.115:3300/0 conn(0x7fc464157660 0x7fc464157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:17.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.782+0000 7fc4637fe700 1 -- 172.21.15.49:0/3336286213 >> v2:172.21.15.115:3300/0 conn(0x7fc464157660 msgr2=0x7fc464157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:17.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.782+0000 7fc4637fe700 1 --2- 172.21.15.49:0/3336286213 >> v2:172.21.15.115:3300/0 conn(0x7fc464157660 0x7fc464157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:17.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.782+0000 7fc4637fe700 1 -- 172.21.15.49:0/3336286213 >> v1:172.21.15.115:6789/0 conn(0x7fc4640c1750 legacy=0x7fc4640648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:17.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.782+0000 7fc4637fe700 1 -- 172.21.15.49:0/3336286213 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4640c0c70 con 0x7fc4640c0180 2023-11-30T18:41:17.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.783+0000 7fc4637fe700 1 --2- 172.21.15.49:0/3336286213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4640c0180 0x7fc4641589c0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 rx=0x7fc4640839a0 tx=0x7fc4580090f0).ready entity=mon.0 client_cookie=7bfa88a98a5c04e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:17.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.783+0000 7fc462ffd700 1 -- 172.21.15.49:0/3336286213 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45800b600 con 0x7fc4640c0180 2023-11-30T18:41:17.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.783+0000 7fc462ffd700 1 -- 172.21.15.49:0/3336286213 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc45800b760 con 0x7fc4640c0180 2023-11-30T18:41:17.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.783+0000 7fc462ffd700 1 -- 172.21.15.49:0/3336286213 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45800bae0 con 0x7fc4640c0180 2023-11-30T18:41:17.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.783+0000 7fc4693b5700 1 -- 172.21.15.49:0/3336286213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4640c0180 msgr2=0x7fc4641589c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:17.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.783+0000 7fc4693b5700 1 --2- 172.21.15.49:0/3336286213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4640c0180 0x7fc4641589c0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 rx=0x7fc4640839a0 tx=0x7fc4580090f0).stop 2023-11-30T18:41:17.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.783+0000 7fc4693b5700 1 -- 172.21.15.49:0/3336286213 shutdown_connections 2023-11-30T18:41:17.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.783+0000 7fc4693b5700 1 --2- 172.21.15.49:0/3336286213 >> v2:172.21.15.115:3300/0 conn(0x7fc464157660 0x7fc464157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:17.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.783+0000 7fc4693b5700 1 --2- 172.21.15.49:0/3336286213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4640c0180 0x7fc4641589c0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:17.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.783+0000 7fc4693b5700 1 -- 172.21.15.49:0/3336286213 >> 172.21.15.49:0/3336286213 conn(0x7fc4640cb000 msgr2=0x7fc4640cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:17.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.783+0000 7fc4693b5700 1 -- 172.21.15.49:0/3336286213 shutdown_connections 2023-11-30T18:41:17.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.783+0000 7fc4693b5700 1 -- 172.21.15.49:0/3336286213 wait complete. 2023-11-30T18:41:17.787 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.784+0000 7fc4693b5700 1 Processor -- start 2023-11-30T18:41:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.785+0000 7fc4693b5700 1 -- start start 2023-11-30T18:41:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.785+0000 7fc4693b5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4640c0180 0x7fc464156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.785+0000 7fc4693b5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc4640c1750 0x7fc4640c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.785+0000 7fc4693b5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc464157660 0x7fc4640c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.785+0000 7fc4693b5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc464156840 con 0x7fc4640c0180 2023-11-30T18:41:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.785+0000 7fc4693b5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc464158c50 con 0x7fc464157660 2023-11-30T18:41:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.785+0000 7fc4693b5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc464158f30 con 0x7fc4640c1750 2023-11-30T18:41:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.785+0000 7fc463fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4640c0180 0x7fc464156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.785+0000 7fc463fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4640c0180 0x7fc464156350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58794/0 (socket says 172.21.15.49:58794) 2023-11-30T18:41:17.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.785+0000 7fc463fff700 1 -- 172.21.15.49:0/3477796082 learned_addr learned my addr 172.21.15.49:0/3477796082 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:17.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.786+0000 7fc463fff700 1 -- 172.21.15.49:0/3477796082 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc4640c1750 msgr2=0x7fc4640c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:17.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.786+0000 7fc463fff700 1 --2- 172.21.15.49:0/3477796082 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc4640c1750 0x7fc4640c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:17.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.786+0000 7fc463fff700 1 -- 172.21.15.49:0/3477796082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc464157660 msgr2=0x7fc4640c46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:17.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.786+0000 7fc463fff700 1 --2- 172.21.15.49:0/3477796082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc464157660 0x7fc4640c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:17.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.786+0000 7fc463fff700 1 -- 172.21.15.49:0/3477796082 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc458009370 con 0x7fc4640c0180 2023-11-30T18:41:17.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.786+0000 7fc463fff700 1 --2- 172.21.15.49:0/3477796082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4640c0180 0x7fc464156350 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7fc45400d860 tx=0x7fc454008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:17.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.786+0000 7fc44bfff700 1 -- 172.21.15.49:0/3477796082 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc454011590 con 0x7fc4640c0180 2023-11-30T18:41:17.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.786+0000 7fc44bfff700 1 -- 172.21.15.49:0/3477796082 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4540116f0 con 0x7fc4640c0180 2023-11-30T18:41:17.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.786+0000 7fc4693b5700 1 -- 172.21.15.49:0/3477796082 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc464159210 con 0x7fc4640c0180 2023-11-30T18:41:17.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.786+0000 7fc44bfff700 1 -- 172.21.15.49:0/3477796082 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc454011a70 con 0x7fc4640c0180 2023-11-30T18:41:17.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.786+0000 7fc4693b5700 1 -- 172.21.15.49:0/3477796082 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4641597d0 con 0x7fc4640c0180 2023-11-30T18:41:17.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.787+0000 7fc4693b5700 1 -- 172.21.15.49:0/3477796082 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc46406c7c0 con 0x7fc4640c0180 2023-11-30T18:41:17.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.787+0000 7fc44bfff700 1 -- 172.21.15.49:0/3477796082 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc454012420 con 0x7fc4640c0180 2023-11-30T18:41:17.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.788+0000 7fc44bfff700 1 --2- 172.21.15.49:0/3477796082 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc45005f240 0x7fc450061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:17.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.788+0000 7fc44bfff700 1 -- 172.21.15.49:0/3477796082 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 5381+0+0 (secure 0 0 0) 0x7fc454079b80 con 0x7fc4640c0180 2023-11-30T18:41:17.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.788+0000 7fc4637fe700 1 --2- 172.21.15.49:0/3477796082 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc45005f240 0x7fc450061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:17.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.788+0000 7fc4637fe700 1 --2- 172.21.15.49:0/3477796082 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc45005f240 0x7fc450061700 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fc4640aa230 tx=0x7fc458017000).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:17.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.792+0000 7fc44bfff700 1 -- 172.21.15.49:0/3477796082 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc45404af50 con 0x7fc4640c0180 2023-11-30T18:41:17.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.969+0000 7fc4693b5700 1 -- 172.21.15.49:0/3477796082 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4640c0f50 con 0x7fc4640c0180 2023-11-30T18:41:17.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.970+0000 7fc44bfff700 1 -- 172.21.15.49:0/3477796082 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v215) v1 ==== 74+0+13902 (secure 0 0 0) 0x7fc454011e60 con 0x7fc4640c0180 2023-11-30T18:41:17.971 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:17.971 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":215,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:41:17.251656+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"208","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:41:17.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.972+0000 7fc4693b5700 1 -- 172.21.15.49:0/3477796082 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc45005f240 msgr2=0x7fc450061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:17.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.972+0000 7fc4693b5700 1 --2- 172.21.15.49:0/3477796082 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc45005f240 0x7fc450061700 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fc4640aa230 tx=0x7fc458017000).stop 2023-11-30T18:41:17.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.972+0000 7fc4693b5700 1 -- 172.21.15.49:0/3477796082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4640c0180 msgr2=0x7fc464156350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:17.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.972+0000 7fc4693b5700 1 --2- 172.21.15.49:0/3477796082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4640c0180 0x7fc464156350 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7fc45400d860 tx=0x7fc454008040).stop 2023-11-30T18:41:17.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.972+0000 7fc4693b5700 1 -- 172.21.15.49:0/3477796082 shutdown_connections 2023-11-30T18:41:17.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.972+0000 7fc4693b5700 1 --2- 172.21.15.49:0/3477796082 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc45005f240 0x7fc450061700 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:17.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.972+0000 7fc4693b5700 1 --2- 172.21.15.49:0/3477796082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc464157660 0x7fc4640c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:17.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.972+0000 7fc4693b5700 1 --2- 172.21.15.49:0/3477796082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4640c0180 0x7fc464156350 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:17.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.972+0000 7fc4693b5700 1 --2- 172.21.15.49:0/3477796082 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc4640c1750 0x7fc4640c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:17.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.972+0000 7fc4693b5700 1 -- 172.21.15.49:0/3477796082 >> 172.21.15.49:0/3477796082 conn(0x7fc4640cb000 msgr2=0x7fc464063b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:17.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.972+0000 7fc4693b5700 1 -- 172.21.15.49:0/3477796082 shutdown_connections 2023-11-30T18:41:17.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:17.972+0000 7fc4693b5700 1 -- 172.21.15.49:0/3477796082 wait complete. 2023-11-30T18:41:17.985 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '208', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-11-30T18:41:17.986 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T18:41:18.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.106+0000 7fc177ad1700 1 Processor -- start 2023-11-30T18:41:18.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.106+0000 7fc177ad1700 1 -- start start 2023-11-30T18:41:18.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.107+0000 7fc177ad1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc170098e50 0x7fc1700c7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:18.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.107+0000 7fc177ad1700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc170154bc0 con 0x7fc1701589d0 2023-11-30T18:41:18.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.107+0000 7fc177ad1700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc170064540 con 0x7fc1700640b0 2023-11-30T18:41:18.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.107+0000 7fc177ad1700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc170099230 con 0x7fc170098e50 2023-11-30T18:41:18.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.107+0000 7fc17586d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc170098e50 0x7fc1700c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:18.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.107+0000 7fc17606e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc1701589d0 0x7fc1700a8180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43594/0 (socket says 172.21.15.49:43594) 2023-11-30T18:41:18.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.107+0000 7fc17606e700 1 -- 172.21.15.49:0/3392050932 learned_addr learned my addr 172.21.15.49:0/3392050932 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:18.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.107+0000 7fc17586d700 1 -- 172.21.15.49:0/3392050932 >> v1:172.21.15.115:6789/0 conn(0x7fc1700640b0 legacy=0x7fc1701582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:18.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.108+0000 7fc17586d700 1 -- 172.21.15.49:0/3392050932 >> v1:172.21.15.49:6789/0 conn(0x7fc1701589d0 legacy=0x7fc1700a8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:18.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.108+0000 7fc17586d700 1 -- 172.21.15.49:0/3392050932 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1700c6580 con 0x7fc170098e50 2023-11-30T18:41:18.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.108+0000 7fc17586d700 1 --2- 172.21.15.49:0/3392050932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc170098e50 0x7fc1700c7620 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 rx=0x7fc160009eb0 tx=0x7fc160009780).ready entity=mon.0 client_cookie=9bf6c8dede2298fc server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:18.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.108+0000 7fc17486b700 1 -- 172.21.15.49:0/3392050932 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16000e070 con 0x7fc170098e50 2023-11-30T18:41:18.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.108+0000 7fc17486b700 1 -- 172.21.15.49:0/3392050932 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16000bbf0 con 0x7fc170098e50 2023-11-30T18:41:18.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.108+0000 7fc17486b700 1 -- 172.21.15.49:0/3392050932 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc160012410 con 0x7fc170098e50 2023-11-30T18:41:18.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.108+0000 7fc177ad1700 1 -- 172.21.15.49:0/3392050932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc170098e50 msgr2=0x7fc1700c7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:18.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.108+0000 7fc177ad1700 1 --2- 172.21.15.49:0/3392050932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc170098e50 0x7fc1700c7620 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 rx=0x7fc160009eb0 tx=0x7fc160009780).stop 2023-11-30T18:41:18.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.108+0000 7fc177ad1700 1 -- 172.21.15.49:0/3392050932 shutdown_connections 2023-11-30T18:41:18.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.108+0000 7fc177ad1700 1 --2- 172.21.15.49:0/3392050932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc170098e50 0x7fc1700c7620 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:18.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.108+0000 7fc177ad1700 1 -- 172.21.15.49:0/3392050932 >> 172.21.15.49:0/3392050932 conn(0x7fc1700c7db0 msgr2=0x7fc1700c81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:18.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.108+0000 7fc177ad1700 1 -- 172.21.15.49:0/3392050932 shutdown_connections 2023-11-30T18:41:18.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.108+0000 7fc177ad1700 1 -- 172.21.15.49:0/3392050932 wait complete. 2023-11-30T18:41:18.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.110+0000 7fc177ad1700 1 Processor -- start 2023-11-30T18:41:18.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.110+0000 7fc177ad1700 1 -- start start 2023-11-30T18:41:18.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.110+0000 7fc177ad1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc1700640b0 0x7fc170168820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:18.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.110+0000 7fc177ad1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc170098e50 0x7fc170157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:18.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.110+0000 7fc177ad1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1701589d0 0x7fc1700af130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:18.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.110+0000 7fc177ad1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc170168d10 con 0x7fc1701589d0 2023-11-30T18:41:18.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.110+0000 7fc177ad1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc170151d50 con 0x7fc170098e50 2023-11-30T18:41:18.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.110+0000 7fc177ad1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1700b1010 con 0x7fc1700640b0 2023-11-30T18:41:18.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.110+0000 7fc17606e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1701589d0 0x7fc1700af130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:18.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.110+0000 7fc17606e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1701589d0 0x7fc1700af130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58814/0 (socket says 172.21.15.49:58814) 2023-11-30T18:41:18.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.110+0000 7fc17606e700 1 -- 172.21.15.49:0/234090285 learned_addr learned my addr 172.21.15.49:0/234090285 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:18.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.111+0000 7fc17506c700 1 --2- 172.21.15.49:0/234090285 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc170098e50 0x7fc170157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:18.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.111+0000 7fc17586d700 1 --2- 172.21.15.49:0/234090285 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc1700640b0 0x7fc170168820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:18.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.111+0000 7fc17606e700 1 -- 172.21.15.49:0/234090285 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc1700640b0 msgr2=0x7fc170168820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:18.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.111+0000 7fc17606e700 1 --2- 172.21.15.49:0/234090285 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc1700640b0 0x7fc170168820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:18.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.111+0000 7fc17606e700 1 -- 172.21.15.49:0/234090285 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc170098e50 msgr2=0x7fc170157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:18.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.111+0000 7fc17606e700 1 --2- 172.21.15.49:0/234090285 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc170098e50 0x7fc170157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:18.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.111+0000 7fc17606e700 1 -- 172.21.15.49:0/234090285 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc160009a20 con 0x7fc1701589d0 2023-11-30T18:41:18.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.111+0000 7fc17586d700 1 --2- 172.21.15.49:0/234090285 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc1700640b0 0x7fc170168820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:41:18.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.111+0000 7fc17506c700 1 --2- 172.21.15.49:0/234090285 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc170098e50 0x7fc170157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:41:18.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.111+0000 7fc17606e700 1 --2- 172.21.15.49:0/234090285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1701589d0 0x7fc1700af130 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 rx=0x7fc16800c440 tx=0x7fc168007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:18.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.111+0000 7fc16dffb700 1 -- 172.21.15.49:0/234090285 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1680072e0 con 0x7fc1701589d0 2023-11-30T18:41:18.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.111+0000 7fc16dffb700 1 -- 172.21.15.49:0/234090285 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc168007440 con 0x7fc1701589d0 2023-11-30T18:41:18.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.111+0000 7fc177ad1700 1 -- 172.21.15.49:0/234090285 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1700b1350 con 0x7fc1701589d0 2023-11-30T18:41:18.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.111+0000 7fc16dffb700 1 -- 172.21.15.49:0/234090285 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1680057a0 con 0x7fc1701589d0 2023-11-30T18:41:18.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.111+0000 7fc177ad1700 1 -- 172.21.15.49:0/234090285 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc170168300 con 0x7fc1701589d0 2023-11-30T18:41:18.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.112+0000 7fc177ad1700 1 -- 172.21.15.49:0/234090285 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc17006c860 con 0x7fc1701589d0 2023-11-30T18:41:18.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.112+0000 7fc16dffb700 1 -- 172.21.15.49:0/234090285 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc168005bd0 con 0x7fc1701589d0 2023-11-30T18:41:18.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.113+0000 7fc16dffb700 1 --2- 172.21.15.49:0/234090285 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc15c05f270 0x7fc15c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:18.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.113+0000 7fc16dffb700 1 -- 172.21.15.49:0/234090285 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 5381+0+0 (secure 0 0 0) 0x7fc1680796e0 con 0x7fc1701589d0 2023-11-30T18:41:18.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.113+0000 7fc17586d700 1 --2- 172.21.15.49:0/234090285 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc15c05f270 0x7fc15c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:18.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.113+0000 7fc17586d700 1 --2- 172.21.15.49:0/234090285 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc15c05f270 0x7fc15c061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fc160009eb0 tx=0x7fc160017000).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:18.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.117+0000 7fc16dffb700 1 -- 172.21.15.49:0/234090285 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc16804ab10 con 0x7fc1701589d0 2023-11-30T18:41:18.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.288+0000 7fc177ad1700 1 -- 172.21.15.49:0/234090285 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc170154bc0 con 0x7fc1701589d0 2023-11-30T18:41:18.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.289+0000 7fc16dffb700 1 -- 172.21.15.49:0/234090285 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v215) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc170154bc0 con 0x7fc1701589d0 2023-11-30T18:41:18.290 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T18:41:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.291+0000 7fc177ad1700 1 -- 172.21.15.49:0/234090285 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc15c05f270 msgr2=0x7fc15c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.291+0000 7fc177ad1700 1 --2- 172.21.15.49:0/234090285 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc15c05f270 0x7fc15c061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fc160009eb0 tx=0x7fc160017000).stop 2023-11-30T18:41:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.291+0000 7fc177ad1700 1 -- 172.21.15.49:0/234090285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1701589d0 msgr2=0x7fc1700af130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.291+0000 7fc177ad1700 1 --2- 172.21.15.49:0/234090285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1701589d0 0x7fc1700af130 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 rx=0x7fc16800c440 tx=0x7fc168007db0).stop 2023-11-30T18:41:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.291+0000 7fc177ad1700 1 -- 172.21.15.49:0/234090285 shutdown_connections 2023-11-30T18:41:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.291+0000 7fc177ad1700 1 --2- 172.21.15.49:0/234090285 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc15c05f270 0x7fc15c061730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.291+0000 7fc177ad1700 1 --2- 172.21.15.49:0/234090285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1701589d0 0x7fc1700af130 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.291+0000 7fc177ad1700 1 --2- 172.21.15.49:0/234090285 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc1700640b0 0x7fc170168820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.291+0000 7fc177ad1700 1 --2- 172.21.15.49:0/234090285 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc170098e50 0x7fc170157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.291+0000 7fc177ad1700 1 -- 172.21.15.49:0/234090285 >> 172.21.15.49:0/234090285 conn(0x7fc1700c7db0 msgr2=0x7fc1700a8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.291+0000 7fc177ad1700 1 -- 172.21.15.49:0/234090285 shutdown_connections 2023-11-30T18:41:18.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.291+0000 7fc177ad1700 1 -- 172.21.15.49:0/234090285 wait complete. 2023-11-30T18:41:18.304 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T18:41:18.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.425+0000 7f722c14d700 1 Processor -- start 2023-11-30T18:41:18.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.425+0000 7f722c14d700 1 -- start start 2023-11-30T18:41:18.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.426+0000 7f722c14d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f72240c6190 0x7f72240c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:18.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.426+0000 7f722c14d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7224158320 0x7f72241587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:18.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.426+0000 7f722c14d700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7224158cc0 con 0x7f7224098d10 2023-11-30T18:41:18.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.426+0000 7f722c14d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72240c72d0 con 0x7f72240c6190 2023-11-30T18:41:18.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.426+0000 7f722c14d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7224064570 con 0x7f7224158320 2023-11-30T18:41:18.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.426+0000 7f722a6ea700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7224158320 0x7f72241587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:18.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.426+0000 7f72296e8700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f72240c6190 0x7f72240c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:18.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.426+0000 7f72296e8700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f72240c6190 0x7f72240c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:44166/0 (socket says 172.21.15.49:44166) 2023-11-30T18:41:18.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.426+0000 7f722a6ea700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7224158320 0x7f72241587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:53010/0 (socket says 172.21.15.49:53010) 2023-11-30T18:41:18.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.426+0000 7f72296e8700 1 -- 172.21.15.49:0/2028402868 learned_addr learned my addr 172.21.15.49:0/2028402868 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:18.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.426+0000 7f7229ee9700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f7224098d10 0x7f7224063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:44540/0 (socket says 172.21.15.49:44540) 2023-11-30T18:41:18.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.427+0000 7f72296e8700 1 -- 172.21.15.49:0/2028402868 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7224158320 msgr2=0x7f72241587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:18.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.427+0000 7f72296e8700 1 --2- 172.21.15.49:0/2028402868 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7224158320 0x7f72241587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:18.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.427+0000 7f72296e8700 1 -- 172.21.15.49:0/2028402868 >> v1:172.21.15.115:6789/0 conn(0x7f7224098d10 legacy=0x7f7224063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:18.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.427+0000 7f72296e8700 1 -- 172.21.15.49:0/2028402868 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7224154bc0 con 0x7f72240c6190 2023-11-30T18:41:18.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.427+0000 7f722a6ea700 1 --2- 172.21.15.49:0/2028402868 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7224158320 0x7f72241587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:41:18.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.427+0000 7f72296e8700 1 --2- 172.21.15.49:0/2028402868 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72240c6190 0x7f72240c7760 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7f7218006fd0 tx=0x7f72180090f0).ready entity=mon.1 client_cookie=c6cb6a790e4c0e61 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:18.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.427+0000 7f7228ee7700 1 -- 172.21.15.49:0/2028402868 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721800b580 con 0x7f72240c6190 2023-11-30T18:41:18.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.427+0000 7f7228ee7700 1 -- 172.21.15.49:0/2028402868 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721800b6e0 con 0x7f72240c6190 2023-11-30T18:41:18.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.427+0000 7f7228ee7700 1 -- 172.21.15.49:0/2028402868 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721800ba60 con 0x7f72240c6190 2023-11-30T18:41:18.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.427+0000 7f722c14d700 1 -- 172.21.15.49:0/2028402868 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72240c6190 msgr2=0x7f72240c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:18.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.427+0000 7f722c14d700 1 --2- 172.21.15.49:0/2028402868 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72240c6190 0x7f72240c7760 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7f7218006fd0 tx=0x7f72180090f0).stop 2023-11-30T18:41:18.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.427+0000 7f722c14d700 1 -- 172.21.15.49:0/2028402868 shutdown_connections 2023-11-30T18:41:18.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.427+0000 7f722c14d700 1 --2- 172.21.15.49:0/2028402868 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7224158320 0x7f72241587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:18.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.427+0000 7f722c14d700 1 --2- 172.21.15.49:0/2028402868 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72240c6190 0x7f72240c7760 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:18.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.427+0000 7f722c14d700 1 -- 172.21.15.49:0/2028402868 >> 172.21.15.49:0/2028402868 conn(0x7f72240cb310 msgr2=0x7f72240cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:18.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.428+0000 7f722c14d700 1 -- 172.21.15.49:0/2028402868 shutdown_connections 2023-11-30T18:41:18.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.428+0000 7f722c14d700 1 -- 172.21.15.49:0/2028402868 wait complete. 2023-11-30T18:41:18.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.429+0000 7f722c14d700 1 Processor -- start 2023-11-30T18:41:18.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.429+0000 7f722c14d700 1 -- start start 2023-11-30T18:41:18.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.429+0000 7f722c14d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7224098d10 0x7f7224147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:18.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.429+0000 7f722c14d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72240c6190 0x7f7224165530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:18.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.429+0000 7f722c14d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7224158320 0x7f72240a96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:18.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.429+0000 7f722c14d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72240ad490 con 0x7f7224158320 2023-11-30T18:41:18.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.429+0000 7f722c14d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72240aaef0 con 0x7f72240c6190 2023-11-30T18:41:18.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.429+0000 7f722c14d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72241560c0 con 0x7f7224098d10 2023-11-30T18:41:18.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.430+0000 7f722a6ea700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7224158320 0x7f72240a96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:18.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.430+0000 7f722a6ea700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7224158320 0x7f72240a96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58822/0 (socket says 172.21.15.49:58822) 2023-11-30T18:41:18.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.430+0000 7f722a6ea700 1 -- 172.21.15.49:0/129742883 learned_addr learned my addr 172.21.15.49:0/129742883 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:18.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.430+0000 7f7229ee9700 1 --2- 172.21.15.49:0/129742883 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7224098d10 0x7f7224147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:18.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.430+0000 7f72296e8700 1 --2- 172.21.15.49:0/129742883 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72240c6190 0x7f7224165530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:18.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.430+0000 7f722a6ea700 1 -- 172.21.15.49:0/129742883 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7224098d10 msgr2=0x7f7224147b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:18.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.430+0000 7f722a6ea700 1 --2- 172.21.15.49:0/129742883 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7224098d10 0x7f7224147b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:18.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.430+0000 7f722a6ea700 1 -- 172.21.15.49:0/129742883 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72240c6190 msgr2=0x7f7224165530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:18.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.430+0000 7f722a6ea700 1 --2- 172.21.15.49:0/129742883 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72240c6190 0x7f7224165530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:18.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.430+0000 7f722a6ea700 1 -- 172.21.15.49:0/129742883 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7214009a20 con 0x7f7224158320 2023-11-30T18:41:18.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.430+0000 7f722a6ea700 1 --2- 172.21.15.49:0/129742883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7224158320 0x7f72240a96d0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 rx=0x7f7214009f20 tx=0x7f721400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:18.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.430+0000 7f7221ffb700 1 -- 172.21.15.49:0/129742883 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721400cb70 con 0x7f7224158320 2023-11-30T18:41:18.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.430+0000 7f7221ffb700 1 -- 172.21.15.49:0/129742883 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721400f040 con 0x7f7224158320 2023-11-30T18:41:18.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.430+0000 7f7221ffb700 1 -- 172.21.15.49:0/129742883 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7214013400 con 0x7f7224158320 2023-11-30T18:41:18.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.430+0000 7f722c14d700 1 -- 172.21.15.49:0/129742883 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7218009370 con 0x7f7224158320 2023-11-30T18:41:18.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.431+0000 7f722c14d700 1 -- 172.21.15.49:0/129742883 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7224148000 con 0x7f7224158320 2023-11-30T18:41:18.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.431+0000 7f722c14d700 1 -- 172.21.15.49:0/129742883 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72240ab060 con 0x7f7224158320 2023-11-30T18:41:18.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.432+0000 7f7221ffb700 1 -- 172.21.15.49:0/129742883 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f72140137f0 con 0x7f7224158320 2023-11-30T18:41:18.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.432+0000 7f7221ffb700 1 --2- 172.21.15.49:0/129742883 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f721005f270 0x7f7210061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:18.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.432+0000 7f7221ffb700 1 -- 172.21.15.49:0/129742883 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 5381+0+0 (secure 0 0 0) 0x7f721407a9f0 con 0x7f7224158320 2023-11-30T18:41:18.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.432+0000 7f7229ee9700 1 --2- 172.21.15.49:0/129742883 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f721005f270 0x7f7210061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:18.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.433+0000 7f7229ee9700 1 --2- 172.21.15.49:0/129742883 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f721005f270 0x7f7210061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f721c007fd0 tx=0x7f721c007d30).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:18.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.436+0000 7f7221ffb700 1 -- 172.21.15.49:0/129742883 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f72240ab060 con 0x7f7224158320 2023-11-30T18:41:18.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.607+0000 7f722c14d700 1 -- 172.21.15.49:0/129742883 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f72240ab060 con 0x7f7224158320 2023-11-30T18:41:18.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.607+0000 7f7221ffb700 1 -- 172.21.15.49:0/129742883 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v215) v1 ==== 92+0+10 (secure 0 0 0) 0x7f72240ab060 con 0x7f7224158320 2023-11-30T18:41:18.608 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T18:41:18.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.609+0000 7f722c14d700 1 -- 172.21.15.49:0/129742883 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f721005f270 msgr2=0x7f7210061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:18.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.609+0000 7f722c14d700 1 --2- 172.21.15.49:0/129742883 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f721005f270 0x7f7210061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f721c007fd0 tx=0x7f721c007d30).stop 2023-11-30T18:41:18.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.609+0000 7f722c14d700 1 -- 172.21.15.49:0/129742883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7224158320 msgr2=0x7f72240a96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:18.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.609+0000 7f722c14d700 1 --2- 172.21.15.49:0/129742883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7224158320 0x7f72240a96d0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 rx=0x7f7214009f20 tx=0x7f721400b040).stop 2023-11-30T18:41:18.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.609+0000 7f722c14d700 1 -- 172.21.15.49:0/129742883 shutdown_connections 2023-11-30T18:41:18.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.609+0000 7f722c14d700 1 --2- 172.21.15.49:0/129742883 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f721005f270 0x7f7210061730 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:18.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.609+0000 7f722c14d700 1 --2- 172.21.15.49:0/129742883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7224158320 0x7f72240a96d0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:18.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.609+0000 7f722c14d700 1 --2- 172.21.15.49:0/129742883 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7224098d10 0x7f7224147b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:18.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.609+0000 7f722c14d700 1 --2- 172.21.15.49:0/129742883 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72240c6190 0x7f7224165530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:18.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.609+0000 7f722c14d700 1 -- 172.21.15.49:0/129742883 >> 172.21.15.49:0/129742883 conn(0x7f72240cb310 msgr2=0x7f7224152ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:18.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.609+0000 7f722c14d700 1 -- 172.21.15.49:0/129742883 shutdown_connections 2023-11-30T18:41:18.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.609+0000 7f722c14d700 1 -- 172.21.15.49:0/129742883 wait complete. 2023-11-30T18:41:18.622 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-30T18:41:18.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.739+0000 7ff552824700 1 Processor -- start 2023-11-30T18:41:18.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.739+0000 7ff552824700 1 -- start start 2023-11-30T18:41:18.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.740+0000 7ff552824700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff54c1544e0 0x7ff54c1548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.740+0000 7ff552824700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff54c0c6e30 0x7ff54c0c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.740+0000 7ff552824700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff54c0c69a0 con 0x7ff54c06a610 2023-11-30T18:41:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.740+0000 7ff552824700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff54c0c13a0 con 0x7ff54c0c6e30 2023-11-30T18:41:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.740+0000 7ff552824700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c0c1680 con 0x7ff54c1544e0 2023-11-30T18:41:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.740+0000 7ff54bfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff54c1544e0 0x7ff54c1548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.740+0000 7ff550dc1700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff54c0c6e30 0x7ff54c0c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.740+0000 7ff54bfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff54c1544e0 0x7ff54c1548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:53032/0 (socket says 172.21.15.49:53032) 2023-11-30T18:41:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.740+0000 7ff550dc1700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff54c0c6e30 0x7ff54c0c72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:44180/0 (socket says 172.21.15.49:44180) 2023-11-30T18:41:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.740+0000 7ff54bfff700 1 -- 172.21.15.49:0/1869457756 learned_addr learned my addr 172.21.15.49:0/1869457756 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.740+0000 7ff54b7fe700 1 --1- 172.21.15.49:0/1869457756 >> v1:172.21.15.115:6789/0 conn(0x7ff54c06a610 0x7ff54c0c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:44542/0 (socket says 172.21.15.49:44542) 2023-11-30T18:41:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.741+0000 7ff54bfff700 1 -- 172.21.15.49:0/1869457756 >> v2:172.21.15.115:3300/0 conn(0x7ff54c0c6e30 msgr2=0x7ff54c0c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.741+0000 7ff54bfff700 1 --2- 172.21.15.49:0/1869457756 >> v2:172.21.15.115:3300/0 conn(0x7ff54c0c6e30 0x7ff54c0c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.741+0000 7ff54bfff700 1 -- 172.21.15.49:0/1869457756 >> v1:172.21.15.115:6789/0 conn(0x7ff54c06a610 legacy=0x7ff54c0c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.741+0000 7ff54bfff700 1 -- 172.21.15.49:0/1869457756 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff54c0c6630 con 0x7ff54c1544e0 2023-11-30T18:41:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.741+0000 7ff54bfff700 1 --2- 172.21.15.49:0/1869457756 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff54c1544e0 0x7ff54c1548c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7ff53c009810 tx=0x7ff53c009060).ready entity=mon.2 client_cookie=63cbbf681bd93aac server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.741+0000 7ff54affd700 1 -- 172.21.15.49:0/1869457756 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c005880 con 0x7ff54c1544e0 2023-11-30T18:41:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.741+0000 7ff54affd700 1 -- 172.21.15.49:0/1869457756 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53c0059e0 con 0x7ff54c1544e0 2023-11-30T18:41:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.741+0000 7ff54affd700 1 -- 172.21.15.49:0/1869457756 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c005d60 con 0x7ff54c1544e0 2023-11-30T18:41:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.742+0000 7ff552824700 1 -- 172.21.15.49:0/1869457756 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff54c1544e0 msgr2=0x7ff54c1548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.742+0000 7ff552824700 1 --2- 172.21.15.49:0/1869457756 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff54c1544e0 0x7ff54c1548c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7ff53c009810 tx=0x7ff53c009060).stop 2023-11-30T18:41:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.742+0000 7ff552824700 1 -- 172.21.15.49:0/1869457756 shutdown_connections 2023-11-30T18:41:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.742+0000 7ff552824700 1 --2- 172.21.15.49:0/1869457756 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff54c1544e0 0x7ff54c1548c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.742+0000 7ff552824700 1 --2- 172.21.15.49:0/1869457756 >> v2:172.21.15.115:3300/0 conn(0x7ff54c0c6e30 0x7ff54c0c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.742+0000 7ff552824700 1 -- 172.21.15.49:0/1869457756 >> 172.21.15.49:0/1869457756 conn(0x7ff54c085020 msgr2=0x7ff54c094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.742+0000 7ff552824700 1 -- 172.21.15.49:0/1869457756 shutdown_connections 2023-11-30T18:41:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.742+0000 7ff552824700 1 -- 172.21.15.49:0/1869457756 wait complete. 2023-11-30T18:41:18.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.743+0000 7ff552824700 1 Processor -- start 2023-11-30T18:41:18.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.743+0000 7ff552824700 1 -- start start 2023-11-30T18:41:18.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.744+0000 7ff552824700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff54c06a610 0x7ff54c142810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:18.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.744+0000 7ff552824700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff54c0c6e30 0x7ff54c164d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:18.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.744+0000 7ff552824700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff54c1544e0 0x7ff54c096d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:18.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.744+0000 7ff552824700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c1507e0 con 0x7ff54c0c6e30 2023-11-30T18:41:18.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.744+0000 7ff552824700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c095250 con 0x7ff54c06a610 2023-11-30T18:41:18.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.744+0000 7ff552824700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c094940 con 0x7ff54c1544e0 2023-11-30T18:41:18.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.744+0000 7ff54b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff54c0c6e30 0x7ff54c164d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:18.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.744+0000 7ff54b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff54c0c6e30 0x7ff54c164d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58830/0 (socket says 172.21.15.49:58830) 2023-11-30T18:41:18.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.744+0000 7ff54b7fe700 1 -- 172.21.15.49:0/1017712475 learned_addr learned my addr 172.21.15.49:0/1017712475 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:18.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.744+0000 7ff54bfff700 1 --2- 172.21.15.49:0/1017712475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff54c06a610 0x7ff54c142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:18.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.744+0000 7ff550dc1700 1 --2- 172.21.15.49:0/1017712475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff54c1544e0 0x7ff54c096d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:18.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.744+0000 7ff54b7fe700 1 -- 172.21.15.49:0/1017712475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff54c1544e0 msgr2=0x7ff54c096d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:18.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.744+0000 7ff54b7fe700 1 --2- 172.21.15.49:0/1017712475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff54c1544e0 0x7ff54c096d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:18.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.744+0000 7ff54b7fe700 1 -- 172.21.15.49:0/1017712475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff54c06a610 msgr2=0x7ff54c142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:18.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.744+0000 7ff54b7fe700 1 --2- 172.21.15.49:0/1017712475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff54c06a610 0x7ff54c142810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:18.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.744+0000 7ff54b7fe700 1 -- 172.21.15.49:0/1017712475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c009300 con 0x7ff54c0c6e30 2023-11-30T18:41:18.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.744+0000 7ff54b7fe700 1 --2- 172.21.15.49:0/1017712475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff54c0c6e30 0x7ff54c164d10 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 rx=0x7ff53400c440 tx=0x7ff534007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:18.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.744+0000 7ff543fff700 1 -- 172.21.15.49:0/1017712475 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5340070d0 con 0x7ff54c0c6e30 2023-11-30T18:41:18.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.744+0000 7ff543fff700 1 -- 172.21.15.49:0/1017712475 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff534007230 con 0x7ff54c0c6e30 2023-11-30T18:41:18.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.744+0000 7ff552824700 1 -- 172.21.15.49:0/1017712475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff54c142d00 con 0x7ff54c0c6e30 2023-11-30T18:41:18.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.745+0000 7ff543fff700 1 -- 172.21.15.49:0/1017712475 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5340056e0 con 0x7ff54c0c6e30 2023-11-30T18:41:18.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.745+0000 7ff552824700 1 -- 172.21.15.49:0/1017712475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff54c094c00 con 0x7ff54c0c6e30 2023-11-30T18:41:18.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.745+0000 7ff552824700 1 -- 172.21.15.49:0/1017712475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff54c095400 con 0x7ff54c0c6e30 2023-11-30T18:41:18.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.746+0000 7ff543fff700 1 -- 172.21.15.49:0/1017712475 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff534005a50 con 0x7ff54c0c6e30 2023-11-30T18:41:18.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.746+0000 7ff543fff700 1 --2- 172.21.15.49:0/1017712475 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff52c05f270 0x7ff52c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:18.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.746+0000 7ff543fff700 1 -- 172.21.15.49:0/1017712475 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 5381+0+0 (secure 0 0 0) 0x7ff5340794e0 con 0x7ff54c0c6e30 2023-11-30T18:41:18.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.746+0000 7ff54bfff700 1 --2- 172.21.15.49:0/1017712475 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff52c05f270 0x7ff52c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:18.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.747+0000 7ff54bfff700 1 --2- 172.21.15.49:0/1017712475 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff52c05f270 0x7ff52c061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7ff53c005fd0 tx=0x7ff53c016000).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:18.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.750+0000 7ff543fff700 1 -- 172.21.15.49:0/1017712475 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff54c095400 con 0x7ff54c0c6e30 2023-11-30T18:41:18.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.924+0000 7ff552824700 1 -- 172.21.15.49:0/1017712475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff54c06c860 con 0x7ff54c0c6e30 2023-11-30T18:41:18.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.924+0000 7ff543fff700 1 -- 172.21.15.49:0/1017712475 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v215) v1 ==== 84+0+143 (secure 0 0 0) 0x7ff53404a910 con 0x7ff54c0c6e30 2023-11-30T18:41:18.925 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:18.925 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-11-30T18:41:18.925 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:41:18.925 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2023-11-30T18:41:18.925 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "device_health_metrics" 2023-11-30T18:41:18.926 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-30T18:41:18.926 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:41:18.926 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 2, 2023-11-30T18:41:18.926 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "rbd" 2023-11-30T18:41:18.926 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:41:18.926 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-11-30T18:41:18.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.926+0000 7ff552824700 1 -- 172.21.15.49:0/1017712475 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff52c05f270 msgr2=0x7ff52c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:18.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.926+0000 7ff552824700 1 --2- 172.21.15.49:0/1017712475 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff52c05f270 0x7ff52c061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7ff53c005fd0 tx=0x7ff53c016000).stop 2023-11-30T18:41:18.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.926+0000 7ff552824700 1 -- 172.21.15.49:0/1017712475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff54c0c6e30 msgr2=0x7ff54c164d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:18.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.926+0000 7ff552824700 1 --2- 172.21.15.49:0/1017712475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff54c0c6e30 0x7ff54c164d10 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 rx=0x7ff53400c440 tx=0x7ff534007de0).stop 2023-11-30T18:41:18.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.926+0000 7ff552824700 1 -- 172.21.15.49:0/1017712475 shutdown_connections 2023-11-30T18:41:18.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.926+0000 7ff552824700 1 --2- 172.21.15.49:0/1017712475 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff52c05f270 0x7ff52c061730 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:18.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.926+0000 7ff552824700 1 --2- 172.21.15.49:0/1017712475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff54c1544e0 0x7ff54c096d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:18.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.926+0000 7ff552824700 1 --2- 172.21.15.49:0/1017712475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff54c06a610 0x7ff54c142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:18.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.926+0000 7ff552824700 1 --2- 172.21.15.49:0/1017712475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff54c0c6e30 0x7ff54c164d10 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:18.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.926+0000 7ff552824700 1 -- 172.21.15.49:0/1017712475 >> 172.21.15.49:0/1017712475 conn(0x7ff54c085020 msgr2=0x7ff54c0ca640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:18.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.926+0000 7ff552824700 1 -- 172.21.15.49:0/1017712475 shutdown_connections 2023-11-30T18:41:18.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:18.926+0000 7ff552824700 1 -- 172.21.15.49:0/1017712475 wait complete. 2023-11-30T18:41:18.939 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-30T18:41:18.939 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-11-30T18:41:19.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.062+0000 7f87cb129700 1 Processor -- start 2023-11-30T18:41:19.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.062+0000 7f87cb129700 1 -- start start 2023-11-30T18:41:19.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.063+0000 7f87cb129700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87c4065fb0 0x7f87c406a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:19.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.063+0000 7f87cb129700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f87c4062700 0x7f87c4062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:19.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.063+0000 7f87cb129700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c4069420 con 0x7f87c413b8c0 2023-11-30T18:41:19.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.063+0000 7f87cb129700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c4063040 con 0x7f87c4062700 2023-11-30T18:41:19.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.063+0000 7f87cb129700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c4066590 con 0x7f87c4065fb0 2023-11-30T18:41:19.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.064+0000 7f87ca928700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f87c4062700 0x7f87c4062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:19.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.064+0000 7f87ca127700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f87c413b8c0 0x7f87c41530a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43598/0 (socket says 172.21.15.49:43598) 2023-11-30T18:41:19.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.064+0000 7f87ca928700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f87c4062700 0x7f87c4062b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58844/0 (socket says 172.21.15.49:58844) 2023-11-30T18:41:19.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.064+0000 7f87ca127700 1 -- 172.21.15.49:0/3152260001 learned_addr learned my addr 172.21.15.49:0/3152260001 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:19.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.064+0000 7f87c9926700 1 --2- 172.21.15.49:0/3152260001 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87c4065fb0 0x7f87c406a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:19.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.064+0000 7f87ca928700 1 -- 172.21.15.49:0/3152260001 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87c4065fb0 msgr2=0x7f87c406a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:19.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.064+0000 7f87ca928700 1 --2- 172.21.15.49:0/3152260001 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87c4065fb0 0x7f87c406a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:19.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.064+0000 7f87ca928700 1 -- 172.21.15.49:0/3152260001 >> v1:172.21.15.49:6789/0 conn(0x7f87c413b8c0 legacy=0x7f87c41530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:19.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.064+0000 7f87c9125700 1 -- 172.21.15.49:0/3152260001 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2379581317 0 0) 0x7f87c4069420 con 0x7f87c413b8c0 2023-11-30T18:41:19.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.064+0000 7f87ca928700 1 -- 172.21.15.49:0/3152260001 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c40696c0 con 0x7f87c4062700 2023-11-30T18:41:19.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.064+0000 7f87ca928700 1 --2- 172.21.15.49:0/3152260001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87c4062700 0x7f87c4062b50 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 rx=0x7f87b4009760 tx=0x7f87b4009060).ready entity=mon.0 client_cookie=1adbb3e430904ac1 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:19.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.064+0000 7f87c9125700 1 -- 172.21.15.49:0/3152260001 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b40090d0 con 0x7f87c4062700 2023-11-30T18:41:19.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.064+0000 7f87c9125700 1 -- 172.21.15.49:0/3152260001 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b400f510 con 0x7f87c4062700 2023-11-30T18:41:19.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.064+0000 7f87c9125700 1 -- 172.21.15.49:0/3152260001 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b400f890 con 0x7f87c4062700 2023-11-30T18:41:19.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.065+0000 7f87cb129700 1 -- 172.21.15.49:0/3152260001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87c4062700 msgr2=0x7f87c4062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:19.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.065+0000 7f87cb129700 1 --2- 172.21.15.49:0/3152260001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87c4062700 0x7f87c4062b50 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 rx=0x7f87b4009760 tx=0x7f87b4009060).stop 2023-11-30T18:41:19.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.065+0000 7f87cb129700 1 -- 172.21.15.49:0/3152260001 shutdown_connections 2023-11-30T18:41:19.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.065+0000 7f87cb129700 1 --2- 172.21.15.49:0/3152260001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87c4062700 0x7f87c4062b50 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:19.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.065+0000 7f87cb129700 1 --2- 172.21.15.49:0/3152260001 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87c4065fb0 0x7f87c406a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:19.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.065+0000 7f87cb129700 1 -- 172.21.15.49:0/3152260001 >> 172.21.15.49:0/3152260001 conn(0x7f87c40642e0 msgr2=0x7f87c40c7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:19.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.065+0000 7f87cb129700 1 -- 172.21.15.49:0/3152260001 shutdown_connections 2023-11-30T18:41:19.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.065+0000 7f87cb129700 1 -- 172.21.15.49:0/3152260001 wait complete. 2023-11-30T18:41:19.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.066+0000 7f87cb129700 1 Processor -- start 2023-11-30T18:41:19.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.066+0000 7f87cb129700 1 -- start start 2023-11-30T18:41:19.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.067+0000 7f87cb129700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87c4062700 0x7f87c4138810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:19.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.067+0000 7f87cb129700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87c4065fb0 0x7f87c4165380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:19.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.067+0000 7f87cb129700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87c413b8c0 0x7f87c40ab9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:19.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.067+0000 7f87cb129700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c40ac820 con 0x7f87c4065fb0 2023-11-30T18:41:19.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.067+0000 7f87cb129700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c40a8eb0 con 0x7f87c4062700 2023-11-30T18:41:19.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.067+0000 7f87cb129700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c40a8840 con 0x7f87c413b8c0 2023-11-30T18:41:19.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.067+0000 7f87c9926700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87c4065fb0 0x7f87c4165380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:19.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.067+0000 7f87c9926700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87c4065fb0 0x7f87c4165380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58846/0 (socket says 172.21.15.49:58846) 2023-11-30T18:41:19.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.067+0000 7f87c9926700 1 -- 172.21.15.49:0/1024805340 learned_addr learned my addr 172.21.15.49:0/1024805340 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:19.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.067+0000 7f87ca127700 1 --2- 172.21.15.49:0/1024805340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87c4062700 0x7f87c4138810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:19.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.067+0000 7f87c9926700 1 -- 172.21.15.49:0/1024805340 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87c413b8c0 msgr2=0x7f87c40ab9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:19.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.067+0000 7f87ca928700 1 --2- 172.21.15.49:0/1024805340 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87c413b8c0 0x7f87c40ab9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:19.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.067+0000 7f87c9926700 1 --2- 172.21.15.49:0/1024805340 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87c413b8c0 0x7f87c40ab9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:19.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.067+0000 7f87c9926700 1 -- 172.21.15.49:0/1024805340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87c4062700 msgr2=0x7f87c4138810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:19.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.067+0000 7f87c9926700 1 --2- 172.21.15.49:0/1024805340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87c4062700 0x7f87c4138810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:19.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.067+0000 7f87c9926700 1 -- 172.21.15.49:0/1024805340 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b40092a0 con 0x7f87c4065fb0 2023-11-30T18:41:19.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.067+0000 7f87ca127700 1 --2- 172.21.15.49:0/1024805340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87c4062700 0x7f87c4138810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:41:19.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.067+0000 7f87c9926700 1 --2- 172.21.15.49:0/1024805340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87c4065fb0 0x7f87c4165380 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 rx=0x7f87b800e950 tx=0x7f87b8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:19.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.067+0000 7f87c27fc700 1 -- 172.21.15.49:0/1024805340 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b800c850 con 0x7f87c4065fb0 2023-11-30T18:41:19.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.068+0000 7f87c27fc700 1 -- 172.21.15.49:0/1024805340 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b800c9b0 con 0x7f87c4065fb0 2023-11-30T18:41:19.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.068+0000 7f87cb129700 1 -- 172.21.15.49:0/1024805340 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c40a9710 con 0x7f87c4065fb0 2023-11-30T18:41:19.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.068+0000 7f87c27fc700 1 -- 172.21.15.49:0/1024805340 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b800cd30 con 0x7f87c4065fb0 2023-11-30T18:41:19.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.068+0000 7f87cb129700 1 -- 172.21.15.49:0/1024805340 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c40a90c0 con 0x7f87c4065fb0 2023-11-30T18:41:19.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.069+0000 7f87cb129700 1 -- 172.21.15.49:0/1024805340 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c406c7c0 con 0x7f87c4065fb0 2023-11-30T18:41:19.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.069+0000 7f87c27fc700 1 -- 172.21.15.49:0/1024805340 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f87b8012600 con 0x7f87c4065fb0 2023-11-30T18:41:19.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.069+0000 7f87c27fc700 1 --2- 172.21.15.49:0/1024805340 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f87b005f270 0x7f87b0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:19.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.069+0000 7f87c27fc700 1 -- 172.21.15.49:0/1024805340 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 5381+0+0 (secure 0 0 0) 0x7f87b807a700 con 0x7f87c4065fb0 2023-11-30T18:41:19.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.070+0000 7f87ca127700 1 --2- 172.21.15.49:0/1024805340 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f87b005f270 0x7f87b0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:19.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.070+0000 7f87ca127700 1 --2- 172.21.15.49:0/1024805340 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f87b005f270 0x7f87b0061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f87bc007fd0 tx=0x7f87bc009040).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:19.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.074+0000 7f87c27fc700 1 -- 172.21.15.49:0/1024805340 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f87b804bb30 con 0x7f87c4065fb0 2023-11-30T18:41:19.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.249+0000 7f87cb129700 1 -- 172.21.15.49:0/1024805340 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f87c40ac2e0 con 0x7f87c4065fb0 2023-11-30T18:41:19.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.957+0000 7f87c27fc700 1 -- 172.21.15.49:0/1024805340 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v216) v1 ==== 152+0+0 (secure 0 0 0) 0x7f87b8016020 con 0x7f87c4065fb0 2023-11-30T18:41:19.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.962+0000 7f87cb129700 1 -- 172.21.15.49:0/1024805340 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f87b005f270 msgr2=0x7f87b0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:19.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.962+0000 7f87cb129700 1 --2- 172.21.15.49:0/1024805340 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f87b005f270 0x7f87b0061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f87bc007fd0 tx=0x7f87bc009040).stop 2023-11-30T18:41:19.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.962+0000 7f87cb129700 1 -- 172.21.15.49:0/1024805340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87c4065fb0 msgr2=0x7f87c4165380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:19.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.962+0000 7f87cb129700 1 --2- 172.21.15.49:0/1024805340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87c4065fb0 0x7f87c4165380 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 rx=0x7f87b800e950 tx=0x7f87b8009060).stop 2023-11-30T18:41:19.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.964+0000 7f87cb129700 1 -- 172.21.15.49:0/1024805340 shutdown_connections 2023-11-30T18:41:19.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.964+0000 7f87cb129700 1 --2- 172.21.15.49:0/1024805340 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f87b005f270 0x7f87b0061730 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:19.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.964+0000 7f87cb129700 1 --2- 172.21.15.49:0/1024805340 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87c413b8c0 0x7f87c40ab9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:19.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.964+0000 7f87cb129700 1 --2- 172.21.15.49:0/1024805340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87c4062700 0x7f87c4138810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:19.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.964+0000 7f87cb129700 1 --2- 172.21.15.49:0/1024805340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87c4065fb0 0x7f87c4165380 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:19.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.964+0000 7f87cb129700 1 -- 172.21.15.49:0/1024805340 >> 172.21.15.49:0/1024805340 conn(0x7f87c40642e0 msgr2=0x7f87c4155050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:19.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.965+0000 7f87cb129700 1 -- 172.21.15.49:0/1024805340 shutdown_connections 2023-11-30T18:41:19.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:19.965+0000 7f87cb129700 1 -- 172.21.15.49:0/1024805340 wait complete. 2023-11-30T18:41:19.969 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2023-11-30T18:41:19.982 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-30T18:41:20.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.111+0000 7fa12c59d700 1 Processor -- start 2023-11-30T18:41:20.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.111+0000 7fa12c59d700 1 -- start start 2023-11-30T18:41:20.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.112+0000 7fa12c59d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa124098d10 0x7fa1240c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:20.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.112+0000 7fa12c59d700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1240c72d0 con 0x7fa124158320 2023-11-30T18:41:20.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.112+0000 7fa12c59d700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa124064570 con 0x7fa1240c6190 2023-11-30T18:41:20.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.112+0000 7fa12c59d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa124154bc0 con 0x7fa124098d10 2023-11-30T18:41:20.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.112+0000 7fa12ab3a700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa124158320 0x7fa1240a80f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43612/0 (socket says 172.21.15.49:43612) 2023-11-30T18:41:20.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.112+0000 7fa12ab3a700 1 -- 172.21.15.49:0/2520612743 learned_addr learned my addr 172.21.15.49:0/2520612743 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:20.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.112+0000 7fa129337700 1 -- 172.21.15.49:0/2520612743 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505549135 0 0) 0x7fa1240c72d0 con 0x7fa124158320 2023-11-30T18:41:20.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.113+0000 7fa12a339700 1 --2- 172.21.15.49:0/2520612743 >> v2:172.21.15.115:3300/0 conn(0x7fa124098d10 0x7fa1240c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:20.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.113+0000 7fa129337700 1 -- 172.21.15.49:0/2520612743 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa10c0033f0 con 0x7fa124158320 2023-11-30T18:41:20.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.113+0000 7fa129337700 1 -- 172.21.15.49:0/2520612743 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3721045081 0 0) 0x7fa10c0033f0 con 0x7fa124158320 2023-11-30T18:41:20.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.113+0000 7fa129337700 1 -- 172.21.15.49:0/2520612743 >> v2:172.21.15.115:3300/0 conn(0x7fa124098d10 msgr2=0x7fa1240c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:20.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.113+0000 7fa129337700 1 --2- 172.21.15.49:0/2520612743 >> v2:172.21.15.115:3300/0 conn(0x7fa124098d10 0x7fa1240c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:20.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.113+0000 7fa129337700 1 -- 172.21.15.49:0/2520612743 >> v1:172.21.15.115:6789/0 conn(0x7fa1240c6190 legacy=0x7fa124063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:20.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.113+0000 7fa129337700 1 -- 172.21.15.49:0/2520612743 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1240c66c0 con 0x7fa124158320 2023-11-30T18:41:20.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.113+0000 7fa129337700 1 -- 172.21.15.49:0/2520612743 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fa1140017f0 con 0x7fa124158320 2023-11-30T18:41:20.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.113+0000 7fa129337700 1 -- 172.21.15.49:0/2520612743 >> v1:172.21.15.49:6789/0 conn(0x7fa124158320 legacy=0x7fa1240a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:20.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.113+0000 7fa129337700 1 --2- 172.21.15.49:0/2520612743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa10c0038e0 0x7fa10c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:20.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.113+0000 7fa129337700 1 --2- 172.21.15.49:0/2520612743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa10c004690 0x7fa10c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:20.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.113+0000 7fa129337700 1 --2- 172.21.15.49:0/2520612743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa10c005000 0x7fa10c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:20.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.113+0000 7fa129337700 1 -- 172.21.15.49:0/2520612743 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa124154bc0 con 0x7fa10c004690 2023-11-30T18:41:20.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.113+0000 7fa129337700 1 -- 172.21.15.49:0/2520612743 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c00beb0 con 0x7fa10c005000 2023-11-30T18:41:20.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.113+0000 7fa129337700 1 -- 172.21.15.49:0/2520612743 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c00c070 con 0x7fa10c0038e0 2023-11-30T18:41:20.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.113+0000 7fa129b38700 1 --2- 172.21.15.49:0/2520612743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa10c004690 0x7fa10c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:20.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.113+0000 7fa12ab3a700 1 --2- 172.21.15.49:0/2520612743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa10c005000 0x7fa10c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:20.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.113+0000 7fa12a339700 1 --2- 172.21.15.49:0/2520612743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa10c0038e0 0x7fa10c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:20.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.113+0000 7fa129b38700 1 -- 172.21.15.49:0/2520612743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa10c0038e0 msgr2=0x7fa10c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:20.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.113+0000 7fa129b38700 1 --2- 172.21.15.49:0/2520612743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa10c0038e0 0x7fa10c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:20.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.113+0000 7fa129b38700 1 -- 172.21.15.49:0/2520612743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa10c005000 msgr2=0x7fa10c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:20.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.113+0000 7fa129b38700 1 --2- 172.21.15.49:0/2520612743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa10c005000 0x7fa10c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:20.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.113+0000 7fa12ab3a700 1 -- 172.21.15.49:0/2520612743 reap_dead start 2023-11-30T18:41:20.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.113+0000 7fa129b38700 1 -- 172.21.15.49:0/2520612743 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10c0033f0 con 0x7fa10c004690 2023-11-30T18:41:20.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.113+0000 7fa129b38700 1 --2- 172.21.15.49:0/2520612743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa10c004690 0x7fa10c004b10 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 rx=0x7fa118001700 tx=0x7fa118007bb0).ready entity=mon.0 client_cookie=c781996bfcfbfa5a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.114+0000 7fa129337700 1 -- 172.21.15.49:0/2520612743 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa118007020 con 0x7fa10c004690 2023-11-30T18:41:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.114+0000 7fa129337700 1 -- 172.21.15.49:0/2520612743 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa118007180 con 0x7fa10c004690 2023-11-30T18:41:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.114+0000 7fa129337700 1 -- 172.21.15.49:0/2520612743 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa118007520 con 0x7fa10c004690 2023-11-30T18:41:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.114+0000 7fa12c59d700 1 -- 172.21.15.49:0/2520612743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa10c004690 msgr2=0x7fa10c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.114+0000 7fa12c59d700 1 --2- 172.21.15.49:0/2520612743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa10c004690 0x7fa10c004b10 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 rx=0x7fa118001700 tx=0x7fa118007bb0).stop 2023-11-30T18:41:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.114+0000 7fa12c59d700 1 -- 172.21.15.49:0/2520612743 shutdown_connections 2023-11-30T18:41:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.114+0000 7fa12c59d700 1 --2- 172.21.15.49:0/2520612743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa10c004690 0x7fa10c004b10 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.114+0000 7fa12c59d700 1 -- 172.21.15.49:0/2520612743 >> 172.21.15.49:0/2520612743 conn(0x7fa1240cb310 msgr2=0x7fa1240cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.114+0000 7fa12c59d700 1 -- 172.21.15.49:0/2520612743 shutdown_connections 2023-11-30T18:41:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.114+0000 7fa12c59d700 1 -- 172.21.15.49:0/2520612743 wait complete. 2023-11-30T18:41:20.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.115+0000 7fa12c59d700 1 Processor -- start 2023-11-30T18:41:20.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.115+0000 7fa12c59d700 1 -- start start 2023-11-30T18:41:20.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.116+0000 7fa12c59d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa10c004690 0x7fa1240a8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:20.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.116+0000 7fa12c59d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa124157000 0x7fa12414bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:20.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.116+0000 7fa12c59d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa124150f50 0x7fa1241513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:20.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.116+0000 7fa12c59d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1240a9610 con 0x7fa10c004690 2023-11-30T18:41:20.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.116+0000 7fa12c59d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1241518c0 con 0x7fa124157000 2023-11-30T18:41:20.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.116+0000 7fa12c59d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1240a8a00 con 0x7fa124150f50 2023-11-30T18:41:20.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.116+0000 7fa12a339700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa10c004690 0x7fa1240a8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:20.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.116+0000 7fa12a339700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa10c004690 0x7fa1240a8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58860/0 (socket says 172.21.15.49:58860) 2023-11-30T18:41:20.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.116+0000 7fa12a339700 1 -- 172.21.15.49:0/3894634412 learned_addr learned my addr 172.21.15.49:0/3894634412 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:20.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.116+0000 7fa12ab3a700 1 --2- 172.21.15.49:0/3894634412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa124150f50 0x7fa1241513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:20.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.116+0000 7fa129b38700 1 --2- 172.21.15.49:0/3894634412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa124157000 0x7fa12414bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:20.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.116+0000 7fa12a339700 1 -- 172.21.15.49:0/3894634412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa124150f50 msgr2=0x7fa1241513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:20.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.116+0000 7fa12a339700 1 --2- 172.21.15.49:0/3894634412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa124150f50 0x7fa1241513d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:20.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.117+0000 7fa12a339700 1 -- 172.21.15.49:0/3894634412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa124157000 msgr2=0x7fa12414bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:20.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.117+0000 7fa12a339700 1 --2- 172.21.15.49:0/3894634412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa124157000 0x7fa12414bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:20.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.117+0000 7fa12a339700 1 -- 172.21.15.49:0/3894634412 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1240a8ce0 con 0x7fa10c004690 2023-11-30T18:41:20.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.117+0000 7fa12a339700 1 --2- 172.21.15.49:0/3894634412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa10c004690 0x7fa1240a8420 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 rx=0x7fa11c0119f0 tx=0x7fa11c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:20.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.117+0000 7fa1227fc700 1 -- 172.21.15.49:0/3894634412 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c00f790 con 0x7fa10c004690 2023-11-30T18:41:20.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.117+0000 7fa1227fc700 1 -- 172.21.15.49:0/3894634412 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11c00f8f0 con 0x7fa10c004690 2023-11-30T18:41:20.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.117+0000 7fa12c59d700 1 -- 172.21.15.49:0/3894634412 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1240a8fc0 con 0x7fa10c004690 2023-11-30T18:41:20.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.117+0000 7fa1227fc700 1 -- 172.21.15.49:0/3894634412 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c00fc70 con 0x7fa10c004690 2023-11-30T18:41:20.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.117+0000 7fa12c59d700 1 -- 172.21.15.49:0/3894634412 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa124157480 con 0x7fa10c004690 2023-11-30T18:41:20.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.118+0000 7fa12c59d700 1 -- 172.21.15.49:0/3894634412 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1240abc90 con 0x7fa10c004690 2023-11-30T18:41:20.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.118+0000 7fa1227fc700 1 -- 172.21.15.49:0/3894634412 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa11c014650 con 0x7fa10c004690 2023-11-30T18:41:20.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.119+0000 7fa1227fc700 1 --2- 172.21.15.49:0/3894634412 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa11005f270 0x7fa110061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:20.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.119+0000 7fa1227fc700 1 -- 172.21.15.49:0/3894634412 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(216..216 src has 1..216) v4 ==== 5751+0+0 (secure 0 0 0) 0x7fa11c07ade0 con 0x7fa10c004690 2023-11-30T18:41:20.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.119+0000 7fa129b38700 1 --2- 172.21.15.49:0/3894634412 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa11005f270 0x7fa110061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:20.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.119+0000 7fa129b38700 1 --2- 172.21.15.49:0/3894634412 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa11005f270 0x7fa110061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fa124151c70 tx=0x7fa118016000).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:20.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.123+0000 7fa1227fc700 1 -- 172.21.15.49:0/3894634412 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa11c04c0a0 con 0x7fa10c004690 2023-11-30T18:41:20.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.297+0000 7fa12c59d700 1 -- 172.21.15.49:0/3894634412 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa1240ca4f0 con 0x7fa10c004690 2023-11-30T18:41:20.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.962+0000 7fa1227fc700 1 -- 172.21.15.49:0/3894634412 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v217) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa11c04f6c0 con 0x7fa10c004690 2023-11-30T18:41:20.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.972+0000 7fa12c59d700 1 -- 172.21.15.49:0/3894634412 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa11005f270 msgr2=0x7fa110061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:20.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.972+0000 7fa12c59d700 1 --2- 172.21.15.49:0/3894634412 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa11005f270 0x7fa110061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fa124151c70 tx=0x7fa118016000).stop 2023-11-30T18:41:20.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.972+0000 7fa12c59d700 1 -- 172.21.15.49:0/3894634412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa10c004690 msgr2=0x7fa1240a8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:20.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.972+0000 7fa12c59d700 1 --2- 172.21.15.49:0/3894634412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa10c004690 0x7fa1240a8420 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 rx=0x7fa11c0119f0 tx=0x7fa11c009060).stop 2023-11-30T18:41:20.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.973+0000 7fa12c59d700 1 -- 172.21.15.49:0/3894634412 shutdown_connections 2023-11-30T18:41:20.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.973+0000 7fa12c59d700 1 --2- 172.21.15.49:0/3894634412 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa11005f270 0x7fa110061730 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:20.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.973+0000 7fa12c59d700 1 --2- 172.21.15.49:0/3894634412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa124150f50 0x7fa1241513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:20.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.973+0000 7fa12c59d700 1 --2- 172.21.15.49:0/3894634412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa10c004690 0x7fa1240a8420 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:20.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.973+0000 7fa12c59d700 1 --2- 172.21.15.49:0/3894634412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa124157000 0x7fa12414bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:20.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.973+0000 7fa12c59d700 1 -- 172.21.15.49:0/3894634412 >> 172.21.15.49:0/3894634412 conn(0x7fa1240cb310 msgr2=0x7fa1240ca9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:20.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.974+0000 7fa12c59d700 1 -- 172.21.15.49:0/3894634412 shutdown_connections 2023-11-30T18:41:20.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:20.975+0000 7fa12c59d700 1 -- 172.21.15.49:0/3894634412 wait complete. 2023-11-30T18:41:20.986 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2023-11-30T18:41:20.999 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-30T18:41:21.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.121+0000 7eff18ee6700 1 Processor -- start 2023-11-30T18:41:21.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.121+0000 7eff18ee6700 1 -- start start 2023-11-30T18:41:21.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.122+0000 7eff18ee6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff1414e7e0 0x7eff140bccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:21.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.122+0000 7eff18ee6700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7eff1414ebc0 0x7eff14062700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:21.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.122+0000 7eff18ee6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7eff14062bf0 0x7eff140c59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:21.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.122+0000 7eff18ee6700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1406a3f0 con 0x7eff14062bf0 2023-11-30T18:41:21.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.122+0000 7eff18ee6700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff14069560 con 0x7eff1414ebc0 2023-11-30T18:41:21.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.122+0000 7eff18ee6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff14063080 con 0x7eff1414e7e0 2023-11-30T18:41:21.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.122+0000 7eff13fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7eff14062bf0 0x7eff140c59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:21.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.122+0000 7eff13fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7eff14062bf0 0x7eff140c59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43566/0 (socket says 172.21.15.49:43566) 2023-11-30T18:41:21.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.122+0000 7eff13fff700 1 -- 172.21.15.49:0/254014466 learned_addr learned my addr 172.21.15.49:0/254014466 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:21.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.122+0000 7eff12ffd700 1 --2- 172.21.15.49:0/254014466 >> v2:172.21.15.115:3300/0 conn(0x7eff1414ebc0 0x7eff14062700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:21.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.122+0000 7eff137fe700 1 --2- 172.21.15.49:0/254014466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff1414e7e0 0x7eff140bccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:21.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.122+0000 7eff13fff700 1 -- 172.21.15.49:0/254014466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff1414e7e0 msgr2=0x7eff140bccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:21.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.122+0000 7eff13fff700 1 --2- 172.21.15.49:0/254014466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff1414e7e0 0x7eff140bccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:21.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.122+0000 7eff13fff700 1 -- 172.21.15.49:0/254014466 >> v2:172.21.15.115:3300/0 conn(0x7eff1414ebc0 msgr2=0x7eff14062700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:21.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.122+0000 7eff13fff700 1 --2- 172.21.15.49:0/254014466 >> v2:172.21.15.115:3300/0 conn(0x7eff1414ebc0 0x7eff14062700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:21.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.122+0000 7eff13fff700 1 -- 172.21.15.49:0/254014466 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff14069770 con 0x7eff14062bf0 2023-11-30T18:41:21.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.122+0000 7eff12ffd700 1 --2- 172.21.15.49:0/254014466 >> v2:172.21.15.115:3300/0 conn(0x7eff1414ebc0 0x7eff14062700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:41:21.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.122+0000 7eff13fff700 1 --2- 172.21.15.49:0/254014466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff14062bf0 0x7eff140c59f0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 rx=0x7eff14069070 tx=0x7eff0c009840).ready entity=mon.0 client_cookie=b1523cb856dab9e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:21.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.123+0000 7eff127fc700 1 -- 172.21.15.49:0/254014466 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c00e070 con 0x7eff14062bf0 2023-11-30T18:41:21.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.123+0000 7eff127fc700 1 -- 172.21.15.49:0/254014466 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c00ba50 con 0x7eff14062bf0 2023-11-30T18:41:21.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.123+0000 7eff127fc700 1 -- 172.21.15.49:0/254014466 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c00bdd0 con 0x7eff14062bf0 2023-11-30T18:41:21.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.123+0000 7eff18ee6700 1 -- 172.21.15.49:0/254014466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff14062bf0 msgr2=0x7eff140c59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:21.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.123+0000 7eff18ee6700 1 --2- 172.21.15.49:0/254014466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff14062bf0 0x7eff140c59f0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 rx=0x7eff14069070 tx=0x7eff0c009840).stop 2023-11-30T18:41:21.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.123+0000 7eff18ee6700 1 -- 172.21.15.49:0/254014466 shutdown_connections 2023-11-30T18:41:21.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.123+0000 7eff18ee6700 1 --2- 172.21.15.49:0/254014466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff1414e7e0 0x7eff140bccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:21.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.123+0000 7eff18ee6700 1 --2- 172.21.15.49:0/254014466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff14062bf0 0x7eff140c59f0 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:21.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.123+0000 7eff18ee6700 1 --2- 172.21.15.49:0/254014466 >> v2:172.21.15.115:3300/0 conn(0x7eff1414ebc0 0x7eff14062700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:21.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.123+0000 7eff18ee6700 1 -- 172.21.15.49:0/254014466 >> 172.21.15.49:0/254014466 conn(0x7eff14064320 msgr2=0x7eff140c7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:21.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.123+0000 7eff18ee6700 1 -- 172.21.15.49:0/254014466 shutdown_connections 2023-11-30T18:41:21.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.123+0000 7eff18ee6700 1 -- 172.21.15.49:0/254014466 wait complete. 2023-11-30T18:41:21.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.124+0000 7eff18ee6700 1 Processor -- start 2023-11-30T18:41:21.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.125+0000 7eff18ee6700 1 -- start start 2023-11-30T18:41:21.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.125+0000 7eff18ee6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff14062bf0 0x7eff140ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:21.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.125+0000 7eff18ee6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff1414e7e0 0x7eff1414da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:21.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.125+0000 7eff18ee6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff1414ebc0 0x7eff140a9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:21.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.125+0000 7eff18ee6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff140abd90 con 0x7eff1414ebc0 2023-11-30T18:41:21.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.125+0000 7eff18ee6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff140aa6d0 con 0x7eff14062bf0 2023-11-30T18:41:21.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.125+0000 7eff18ee6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff140aa3f0 con 0x7eff1414e7e0 2023-11-30T18:41:21.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.125+0000 7eff13fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff1414ebc0 0x7eff140a9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:21.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.125+0000 7eff13fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff1414ebc0 0x7eff140a9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43578/0 (socket says 172.21.15.49:43578) 2023-11-30T18:41:21.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.125+0000 7eff13fff700 1 -- 172.21.15.49:0/3438679943 learned_addr learned my addr 172.21.15.49:0/3438679943 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:21.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.125+0000 7eff12ffd700 1 --2- 172.21.15.49:0/3438679943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff1414e7e0 0x7eff1414da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:21.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.125+0000 7eff137fe700 1 --2- 172.21.15.49:0/3438679943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff14062bf0 0x7eff140ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:21.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.126+0000 7eff13fff700 1 -- 172.21.15.49:0/3438679943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff1414e7e0 msgr2=0x7eff1414da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:21.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.126+0000 7eff13fff700 1 --2- 172.21.15.49:0/3438679943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff1414e7e0 0x7eff1414da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:21.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.126+0000 7eff13fff700 1 -- 172.21.15.49:0/3438679943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff14062bf0 msgr2=0x7eff140ab8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:21.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.126+0000 7eff13fff700 1 --2- 172.21.15.49:0/3438679943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff14062bf0 0x7eff140ab8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:21.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.126+0000 7eff13fff700 1 -- 172.21.15.49:0/3438679943 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0c009ae0 con 0x7eff1414ebc0 2023-11-30T18:41:21.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.126+0000 7eff13fff700 1 --2- 172.21.15.49:0/3438679943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff1414ebc0 0x7eff140a9830 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 rx=0x7eff0c009fd0 tx=0x7eff0c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:21.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.126+0000 7efefb7fe700 1 -- 172.21.15.49:0/3438679943 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c013e60 con 0x7eff1414ebc0 2023-11-30T18:41:21.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.126+0000 7efefb7fe700 1 -- 172.21.15.49:0/3438679943 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c009500 con 0x7eff1414ebc0 2023-11-30T18:41:21.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.126+0000 7eff18ee6700 1 -- 172.21.15.49:0/3438679943 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff140aadc0 con 0x7eff1414ebc0 2023-11-30T18:41:21.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.126+0000 7efefb7fe700 1 -- 172.21.15.49:0/3438679943 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c01e6c0 con 0x7eff1414ebc0 2023-11-30T18:41:21.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.126+0000 7eff18ee6700 1 -- 172.21.15.49:0/3438679943 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff140ab380 con 0x7eff1414ebc0 2023-11-30T18:41:21.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.127+0000 7eff18ee6700 1 -- 172.21.15.49:0/3438679943 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1406c7c0 con 0x7eff1414ebc0 2023-11-30T18:41:21.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.127+0000 7efefb7fe700 1 -- 172.21.15.49:0/3438679943 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7eff0c003040 con 0x7eff1414ebc0 2023-11-30T18:41:21.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.128+0000 7efefb7fe700 1 --2- 172.21.15.49:0/3438679943 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7eff0005f270 0x7eff00061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:21.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.128+0000 7efefb7fe700 1 -- 172.21.15.49:0/3438679943 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6133+0+0 (secure 0 0 0) 0x7eff0c07ba20 con 0x7eff1414ebc0 2023-11-30T18:41:21.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.128+0000 7eff137fe700 1 --2- 172.21.15.49:0/3438679943 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7eff0005f270 0x7eff00061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:21.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.129+0000 7eff137fe700 1 --2- 172.21.15.49:0/3438679943 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7eff0005f270 0x7eff00061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7eff0400ab30 tx=0x7eff04008040).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:21.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.133+0000 7efefb7fe700 1 -- 172.21.15.49:0/3438679943 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7eff0c050590 con 0x7eff1414ebc0 2023-11-30T18:41:21.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.350+0000 7eff18ee6700 1 -- 172.21.15.49:0/3438679943 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7eff140aa140 con 0x7eff1414ebc0 2023-11-30T18:41:21.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.363+0000 7efefb7fe700 1 -- 172.21.15.49:0/3438679943 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 25 and data pool 26 v89) v1 ==== 174+0+0 (secure 0 0 0) 0x7eff0c023030 con 0x7eff1414ebc0 2023-11-30T18:41:21.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.367+0000 7eff18ee6700 1 -- 172.21.15.49:0/3438679943 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7eff0005f270 msgr2=0x7eff00061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.367+0000 7eff18ee6700 1 --2- 172.21.15.49:0/3438679943 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7eff0005f270 0x7eff00061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7eff0400ab30 tx=0x7eff04008040).stop 2023-11-30T18:41:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.367+0000 7eff18ee6700 1 -- 172.21.15.49:0/3438679943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff1414ebc0 msgr2=0x7eff140a9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.367+0000 7eff18ee6700 1 --2- 172.21.15.49:0/3438679943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff1414ebc0 0x7eff140a9830 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 rx=0x7eff0c009fd0 tx=0x7eff0c009840).stop 2023-11-30T18:41:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.367+0000 7eff18ee6700 1 -- 172.21.15.49:0/3438679943 shutdown_connections 2023-11-30T18:41:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.367+0000 7eff18ee6700 1 --2- 172.21.15.49:0/3438679943 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7eff0005f270 0x7eff00061730 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0x7eff0400ab30 tx=0x7eff04008040).stop 2023-11-30T18:41:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.367+0000 7eff18ee6700 1 --2- 172.21.15.49:0/3438679943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff1414ebc0 0x7eff140a9830 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.367+0000 7eff18ee6700 1 --2- 172.21.15.49:0/3438679943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff14062bf0 0x7eff140ab8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.367+0000 7eff18ee6700 1 --2- 172.21.15.49:0/3438679943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff1414e7e0 0x7eff1414da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.367+0000 7eff18ee6700 1 -- 172.21.15.49:0/3438679943 >> 172.21.15.49:0/3438679943 conn(0x7eff14064320 msgr2=0x7eff140a5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:21.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.368+0000 7eff18ee6700 1 -- 172.21.15.49:0/3438679943 shutdown_connections 2023-11-30T18:41:21.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.368+0000 7eff18ee6700 1 -- 172.21.15.49:0/3438679943 wait complete. 2023-11-30T18:41:21.376 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 25 and data pool 26 2023-11-30T18:41:21.390 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:41:21.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.507+0000 7f85e1866700 1 Processor -- start 2023-11-30T18:41:21.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.508+0000 7f85e1866700 1 -- start start 2023-11-30T18:41:21.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.508+0000 7f85e1866700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f85dc1544e0 0x7f85dc1548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:21.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.508+0000 7f85e1866700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85dc0c69a0 con 0x7f85dc0c6e30 2023-11-30T18:41:21.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.508+0000 7f85e1866700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85dc0c13a0 con 0x7f85dc06a610 2023-11-30T18:41:21.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.508+0000 7f85e1866700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85dc0c1680 con 0x7f85dc1544e0 2023-11-30T18:41:21.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.509+0000 7f85daffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f85dc1544e0 0x7f85dc1548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:21.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.509+0000 7f85daffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f85dc1544e0 0x7f85dc1548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43590/0 (socket says 172.21.15.49:43590) 2023-11-30T18:41:21.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.509+0000 7f85daffd700 1 -- 172.21.15.49:0/3125326369 learned_addr learned my addr 172.21.15.49:0/3125326369 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:21.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.509+0000 7f85db7fe700 1 --1- 172.21.15.49:0/3125326369 >> v1:172.21.15.49:6789/0 conn(0x7f85dc0c6e30 0x7f85dc0a8000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57346/0 (socket says 172.21.15.49:57346) 2023-11-30T18:41:21.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.509+0000 7f85daffd700 1 -- 172.21.15.49:0/3125326369 >> v1:172.21.15.115:6789/0 conn(0x7f85dc06a610 legacy=0x7f85dc0c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:21.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.509+0000 7f85daffd700 1 -- 172.21.15.49:0/3125326369 >> v1:172.21.15.49:6789/0 conn(0x7f85dc0c6e30 legacy=0x7f85dc0a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:21.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.509+0000 7f85daffd700 1 -- 172.21.15.49:0/3125326369 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85dc0c6630 con 0x7f85dc1544e0 2023-11-30T18:41:21.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.509+0000 7f85d9ffb700 1 -- 172.21.15.49:0/3125326369 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1592116960 0 0) 0x7f85dc0c69a0 con 0x7f85dc0c6e30 2023-11-30T18:41:21.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.509+0000 7f85daffd700 1 --2- 172.21.15.49:0/3125326369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85dc1544e0 0x7f85dc1548c0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 rx=0x7f85d4009810 tx=0x7f85d4009060).ready entity=mon.0 client_cookie=8c2970a338a0536e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:21.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.509+0000 7f85d9ffb700 1 -- 172.21.15.49:0/3125326369 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d4005880 con 0x7f85dc1544e0 2023-11-30T18:41:21.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.509+0000 7f85d9ffb700 1 -- 172.21.15.49:0/3125326369 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d40059e0 con 0x7f85dc1544e0 2023-11-30T18:41:21.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.509+0000 7f85d9ffb700 1 -- 172.21.15.49:0/3125326369 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d4005d60 con 0x7f85dc1544e0 2023-11-30T18:41:21.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.510+0000 7f85e1866700 1 -- 172.21.15.49:0/3125326369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85dc1544e0 msgr2=0x7f85dc1548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:21.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.510+0000 7f85e1866700 1 --2- 172.21.15.49:0/3125326369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85dc1544e0 0x7f85dc1548c0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 rx=0x7f85d4009810 tx=0x7f85d4009060).stop 2023-11-30T18:41:21.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.510+0000 7f85e1866700 1 -- 172.21.15.49:0/3125326369 shutdown_connections 2023-11-30T18:41:21.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.510+0000 7f85e1866700 1 --2- 172.21.15.49:0/3125326369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85dc1544e0 0x7f85dc1548c0 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:21.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.510+0000 7f85e1866700 1 -- 172.21.15.49:0/3125326369 >> 172.21.15.49:0/3125326369 conn(0x7f85dc085020 msgr2=0x7f85dc094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:21.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.510+0000 7f85e1866700 1 -- 172.21.15.49:0/3125326369 shutdown_connections 2023-11-30T18:41:21.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.510+0000 7f85e1866700 1 -- 172.21.15.49:0/3125326369 wait complete. 2023-11-30T18:41:21.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.511+0000 7f85e1866700 1 Processor -- start 2023-11-30T18:41:21.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.511+0000 7f85e1866700 1 -- start start 2023-11-30T18:41:21.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.512+0000 7f85e1866700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85dc06a610 0x7f85dc1531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:21.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.512+0000 7f85e1866700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85dc0c6e30 0x7f85dc0aad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:21.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.512+0000 7f85e1866700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85dc1544e0 0x7f85dc0a8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:21.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.512+0000 7f85e1866700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc1536a0 con 0x7f85dc06a610 2023-11-30T18:41:21.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.512+0000 7f85e1866700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc0950a0 con 0x7f85dc0c6e30 2023-11-30T18:41:21.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.512+0000 7f85e1866700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc095360 con 0x7f85dc1544e0 2023-11-30T18:41:21.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.512+0000 7f85daffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85dc06a610 0x7f85dc1531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:21.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.512+0000 7f85daffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85dc06a610 0x7f85dc1531b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43592/0 (socket says 172.21.15.49:43592) 2023-11-30T18:41:21.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.512+0000 7f85daffd700 1 -- 172.21.15.49:0/1029173757 learned_addr learned my addr 172.21.15.49:0/1029173757 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.512+0000 7f85db7fe700 1 --2- 172.21.15.49:0/1029173757 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85dc1544e0 0x7f85dc0a8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.512+0000 7f85da7fc700 1 --2- 172.21.15.49:0/1029173757 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85dc0c6e30 0x7f85dc0aad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.512+0000 7f85daffd700 1 -- 172.21.15.49:0/1029173757 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85dc1544e0 msgr2=0x7f85dc0a8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.512+0000 7f85daffd700 1 --2- 172.21.15.49:0/1029173757 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85dc1544e0 0x7f85dc0a8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.512+0000 7f85daffd700 1 -- 172.21.15.49:0/1029173757 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85dc0c6e30 msgr2=0x7f85dc0aad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.512+0000 7f85daffd700 1 --2- 172.21.15.49:0/1029173757 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85dc0c6e30 0x7f85dc0aad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.512+0000 7f85daffd700 1 -- 172.21.15.49:0/1029173757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d4009300 con 0x7f85dc06a610 2023-11-30T18:41:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.512+0000 7f85da7fc700 1 --2- 172.21.15.49:0/1029173757 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85dc0c6e30 0x7f85dc0aad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:41:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.512+0000 7f85db7fe700 1 --2- 172.21.15.49:0/1029173757 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85dc1544e0 0x7f85dc0a8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:41:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.512+0000 7f85daffd700 1 --2- 172.21.15.49:0/1029173757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85dc06a610 0x7f85dc1531b0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 rx=0x7f85d4009f60 tx=0x7f85d4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.513+0000 7f85d2ffd700 1 -- 172.21.15.49:0/1029173757 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d400b810 con 0x7f85dc06a610 2023-11-30T18:41:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.513+0000 7f85d2ffd700 1 -- 172.21.15.49:0/1029173757 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d400b970 con 0x7f85dc06a610 2023-11-30T18:41:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.513+0000 7f85d2ffd700 1 -- 172.21.15.49:0/1029173757 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d400bd10 con 0x7f85dc06a610 2023-11-30T18:41:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.513+0000 7f85e1866700 1 -- 172.21.15.49:0/1029173757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85dc095640 con 0x7f85dc06a610 2023-11-30T18:41:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.513+0000 7f85e1866700 1 -- 172.21.15.49:0/1029173757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85dc095c00 con 0x7f85dc06a610 2023-11-30T18:41:21.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.514+0000 7f85e1866700 1 -- 172.21.15.49:0/1029173757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85dc06c860 con 0x7f85dc06a610 2023-11-30T18:41:21.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.514+0000 7f85d2ffd700 1 -- 172.21.15.49:0/1029173757 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f85d4018030 con 0x7f85dc06a610 2023-11-30T18:41:21.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.515+0000 7f85d2ffd700 1 --2- 172.21.15.49:0/1029173757 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f85bc05f270 0x7f85bc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:21.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.515+0000 7f85d2ffd700 1 -- 172.21.15.49:0/1029173757 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6233+0+0 (secure 0 0 0) 0x7f85d407b5a0 con 0x7f85dc06a610 2023-11-30T18:41:21.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.515+0000 7f85da7fc700 1 --2- 172.21.15.49:0/1029173757 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f85bc05f270 0x7f85bc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:21.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.515+0000 7f85da7fc700 1 --2- 172.21.15.49:0/1029173757 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f85bc05f270 0x7f85bc061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f85dc0b0e60 tx=0x7f85c4008040).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:21.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.519+0000 7f85d2ffd700 1 -- 172.21.15.49:0/1029173757 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f85d404c680 con 0x7f85dc06a610 2023-11-30T18:41:21.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.693+0000 7f85e1866700 1 -- 172.21.15.49:0/1029173757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85dc095df0 con 0x7f85dc06a610 2023-11-30T18:41:21.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.694+0000 7f85d2ffd700 1 -- 172.21.15.49:0/1029173757 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v218) v1 ==== 74+0+17135 (secure 0 0 0) 0x7f85d4028090 con 0x7f85dc06a610 2023-11-30T18:41:21.695 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:21.695 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":218,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:41:21.351392+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"208","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-11-30T18:41:19.292113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"218","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-11-30T18:41:20.340870+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"218","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:41:21.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.695+0000 7f85e1866700 1 -- 172.21.15.49:0/1029173757 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f85bc05f270 msgr2=0x7f85bc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:21.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.695+0000 7f85e1866700 1 --2- 172.21.15.49:0/1029173757 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f85bc05f270 0x7f85bc061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f85dc0b0e60 tx=0x7f85c4008040).stop 2023-11-30T18:41:21.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.695+0000 7f85e1866700 1 -- 172.21.15.49:0/1029173757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85dc06a610 msgr2=0x7f85dc1531b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:21.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.695+0000 7f85e1866700 1 --2- 172.21.15.49:0/1029173757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85dc06a610 0x7f85dc1531b0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 rx=0x7f85d4009f60 tx=0x7f85d4016000).stop 2023-11-30T18:41:21.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.696+0000 7f85e1866700 1 -- 172.21.15.49:0/1029173757 shutdown_connections 2023-11-30T18:41:21.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.696+0000 7f85e1866700 1 --2- 172.21.15.49:0/1029173757 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f85bc05f270 0x7f85bc061730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:21.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.696+0000 7f85e1866700 1 --2- 172.21.15.49:0/1029173757 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85dc1544e0 0x7f85dc0a8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:21.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.696+0000 7f85e1866700 1 --2- 172.21.15.49:0/1029173757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85dc06a610 0x7f85dc1531b0 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:21.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.696+0000 7f85e1866700 1 --2- 172.21.15.49:0/1029173757 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85dc0c6e30 0x7f85dc0aad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:21.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.696+0000 7f85e1866700 1 -- 172.21.15.49:0/1029173757 >> 172.21.15.49:0/1029173757 conn(0x7f85dc085020 msgr2=0x7f85dc0ca930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:21.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.696+0000 7f85e1866700 1 -- 172.21.15.49:0/1029173757 shutdown_connections 2023-11-30T18:41:21.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.696+0000 7f85e1866700 1 -- 172.21.15.49:0/1029173757 wait complete. 2023-11-30T18:41:21.709 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:41:21.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.826+0000 7ff103d1a700 1 Processor -- start 2023-11-30T18:41:21.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.826+0000 7ff103d1a700 1 -- start start 2023-11-30T18:41:21.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.827+0000 7ff103d1a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff0fc064e20 0x7ff0fc155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:21.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.827+0000 7ff103d1a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0fc095e80 0x7ff0fc096310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.827+0000 7ff103d1a700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0fc096800 con 0x7ff0fc1544d0 2023-11-30T18:41:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.827+0000 7ff103d1a700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0fc067650 con 0x7ff0fc064e20 2023-11-30T18:41:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.827+0000 7ff103d1a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc0683d0 con 0x7ff0fc095e80 2023-11-30T18:41:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.827+0000 7ff1012b5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff0fc064e20 0x7ff0fc155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.827+0000 7ff1012b5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff0fc064e20 0x7ff0fc155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43608/0 (socket says 172.21.15.49:43608) 2023-11-30T18:41:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.828+0000 7ff1012b5700 1 -- 172.21.15.49:0/1972929885 learned_addr learned my addr 172.21.15.49:0/1972929885 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.828+0000 7ff1022b7700 1 --2- 172.21.15.49:0/1972929885 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0fc095e80 0x7ff0fc096310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.828+0000 7ff1012b5700 1 -- 172.21.15.49:0/1972929885 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0fc095e80 msgr2=0x7ff0fc096310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.828+0000 7ff1012b5700 1 --2- 172.21.15.49:0/1972929885 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0fc095e80 0x7ff0fc096310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.828+0000 7ff1012b5700 1 -- 172.21.15.49:0/1972929885 >> v1:172.21.15.115:6789/0 conn(0x7ff0fc1544d0 legacy=0x7ff0fc066f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.828+0000 7ff1012b5700 1 -- 172.21.15.49:0/1972929885 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc067850 con 0x7ff0fc064e20 2023-11-30T18:41:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.828+0000 7ff1012b5700 1 --2- 172.21.15.49:0/1972929885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0fc064e20 0x7ff0fc155750 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 rx=0x7ff0f0006fd0 tx=0x7ff0f00090f0).ready entity=mon.0 client_cookie=9be404a33e4b6d36 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.828+0000 7ff100ab4700 1 -- 172.21.15.49:0/1972929885 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f000b600 con 0x7ff0fc064e20 2023-11-30T18:41:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.828+0000 7ff100ab4700 1 -- 172.21.15.49:0/1972929885 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f000b760 con 0x7ff0fc064e20 2023-11-30T18:41:21.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.828+0000 7ff100ab4700 1 -- 172.21.15.49:0/1972929885 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f000bae0 con 0x7ff0fc064e20 2023-11-30T18:41:21.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.829+0000 7ff103d1a700 1 -- 172.21.15.49:0/1972929885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0fc064e20 msgr2=0x7ff0fc155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:21.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.829+0000 7ff103d1a700 1 --2- 172.21.15.49:0/1972929885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0fc064e20 0x7ff0fc155750 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 rx=0x7ff0f0006fd0 tx=0x7ff0f00090f0).stop 2023-11-30T18:41:21.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.829+0000 7ff103d1a700 1 -- 172.21.15.49:0/1972929885 shutdown_connections 2023-11-30T18:41:21.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.829+0000 7ff103d1a700 1 --2- 172.21.15.49:0/1972929885 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0fc095e80 0x7ff0fc096310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:21.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.829+0000 7ff103d1a700 1 --2- 172.21.15.49:0/1972929885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0fc064e20 0x7ff0fc155750 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:21.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.829+0000 7ff103d1a700 1 -- 172.21.15.49:0/1972929885 >> 172.21.15.49:0/1972929885 conn(0x7ff0fc0631d0 msgr2=0x7ff0fc0c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:21.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.829+0000 7ff103d1a700 1 -- 172.21.15.49:0/1972929885 shutdown_connections 2023-11-30T18:41:21.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.829+0000 7ff103d1a700 1 -- 172.21.15.49:0/1972929885 wait complete. 2023-11-30T18:41:21.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.830+0000 7ff103d1a700 1 Processor -- start 2023-11-30T18:41:21.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.830+0000 7ff103d1a700 1 -- start start 2023-11-30T18:41:21.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.831+0000 7ff103d1a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0fc064e20 0x7ff0fc14ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:21.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.831+0000 7ff103d1a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0fc095e80 0x7ff0fc1554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:21.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.831+0000 7ff103d1a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0fc1544d0 0x7ff0fc155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:21.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.831+0000 7ff103d1a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc155e80 con 0x7ff0fc064e20 2023-11-30T18:41:21.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.831+0000 7ff103d1a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc157ea0 con 0x7ff0fc095e80 2023-11-30T18:41:21.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.831+0000 7ff103d1a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc0c8510 con 0x7ff0fc1544d0 2023-11-30T18:41:21.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.831+0000 7ff101ab6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0fc064e20 0x7ff0fc14ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:21.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.831+0000 7ff101ab6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0fc064e20 0x7ff0fc14ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43618/0 (socket says 172.21.15.49:43618) 2023-11-30T18:41:21.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.831+0000 7ff101ab6700 1 -- 172.21.15.49:0/2950265103 learned_addr learned my addr 172.21.15.49:0/2950265103 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:21.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.831+0000 7ff1022b7700 1 --2- 172.21.15.49:0/2950265103 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0fc1544d0 0x7ff0fc155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:21.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.831+0000 7ff1012b5700 1 --2- 172.21.15.49:0/2950265103 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0fc095e80 0x7ff0fc1554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:21.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.831+0000 7ff101ab6700 1 -- 172.21.15.49:0/2950265103 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0fc1544d0 msgr2=0x7ff0fc155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:21.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.831+0000 7ff101ab6700 1 --2- 172.21.15.49:0/2950265103 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0fc1544d0 0x7ff0fc155990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:21.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.831+0000 7ff101ab6700 1 -- 172.21.15.49:0/2950265103 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0fc095e80 msgr2=0x7ff0fc1554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:21.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.831+0000 7ff101ab6700 1 --2- 172.21.15.49:0/2950265103 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0fc095e80 0x7ff0fc1554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:21.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.831+0000 7ff101ab6700 1 -- 172.21.15.49:0/2950265103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f0009370 con 0x7ff0fc064e20 2023-11-30T18:41:21.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.831+0000 7ff101ab6700 1 --2- 172.21.15.49:0/2950265103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0fc064e20 0x7ff0fc14ca50 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 rx=0x7ff0f400c440 tx=0x7ff0f4007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:21.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.831+0000 7ff0f9ffb700 1 -- 172.21.15.49:0/2950265103 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4007020 con 0x7ff0fc064e20 2023-11-30T18:41:21.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.832+0000 7ff0f9ffb700 1 -- 172.21.15.49:0/2950265103 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f4007180 con 0x7ff0fc064e20 2023-11-30T18:41:21.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.832+0000 7ff103d1a700 1 -- 172.21.15.49:0/2950265103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0fc1580f0 con 0x7ff0fc064e20 2023-11-30T18:41:21.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.832+0000 7ff0f9ffb700 1 -- 172.21.15.49:0/2950265103 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4007520 con 0x7ff0fc064e20 2023-11-30T18:41:21.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.832+0000 7ff103d1a700 1 -- 172.21.15.49:0/2950265103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0fc1586b0 con 0x7ff0fc064e20 2023-11-30T18:41:21.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.833+0000 7ff103d1a700 1 -- 172.21.15.49:0/2950265103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0fc06c860 con 0x7ff0fc064e20 2023-11-30T18:41:21.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.833+0000 7ff0f9ffb700 1 -- 172.21.15.49:0/2950265103 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff0f4006900 con 0x7ff0fc064e20 2023-11-30T18:41:21.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.833+0000 7ff0f9ffb700 1 --2- 172.21.15.49:0/2950265103 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff0e805f2a0 0x7ff0e8061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:21.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.834+0000 7ff0f9ffb700 1 -- 172.21.15.49:0/2950265103 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6233+0+0 (secure 0 0 0) 0x7ff0f40796f0 con 0x7ff0fc064e20 2023-11-30T18:41:21.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.834+0000 7ff1012b5700 1 --2- 172.21.15.49:0/2950265103 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff0e805f2a0 0x7ff0e8061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:21.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.834+0000 7ff1012b5700 1 --2- 172.21.15.49:0/2950265103 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff0e805f2a0 0x7ff0e8061760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7ff0f0009130 tx=0x7ff0f0017000).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:21.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:21.838+0000 7ff0f9ffb700 1 -- 172.21.15.49:0/2950265103 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff0f4047b00 con 0x7ff0fc064e20 2023-11-30T18:41:22.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.008+0000 7ff103d1a700 1 -- 172.21.15.49:0/2950265103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0fc067b30 con 0x7ff0fc064e20 2023-11-30T18:41:22.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.009+0000 7ff0f9ffb700 1 -- 172.21.15.49:0/2950265103 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v218) v1 ==== 74+0+17135 (secure 0 0 0) 0x7ff0f404a7d0 con 0x7ff0fc064e20 2023-11-30T18:41:22.009 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:22.010 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":218,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:41:21.351392+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"208","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-11-30T18:41:19.292113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"218","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-11-30T18:41:20.340870+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"218","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:41:22.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.010+0000 7ff103d1a700 1 -- 172.21.15.49:0/2950265103 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff0e805f2a0 msgr2=0x7ff0e8061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:22.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.010+0000 7ff103d1a700 1 --2- 172.21.15.49:0/2950265103 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff0e805f2a0 0x7ff0e8061760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7ff0f0009130 tx=0x7ff0f0017000).stop 2023-11-30T18:41:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.010+0000 7ff103d1a700 1 -- 172.21.15.49:0/2950265103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0fc064e20 msgr2=0x7ff0fc14ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.010+0000 7ff103d1a700 1 --2- 172.21.15.49:0/2950265103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0fc064e20 0x7ff0fc14ca50 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 rx=0x7ff0f400c440 tx=0x7ff0f4007e50).stop 2023-11-30T18:41:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.010+0000 7ff103d1a700 1 -- 172.21.15.49:0/2950265103 shutdown_connections 2023-11-30T18:41:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.011+0000 7ff103d1a700 1 --2- 172.21.15.49:0/2950265103 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff0e805f2a0 0x7ff0e8061760 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.011+0000 7ff103d1a700 1 --2- 172.21.15.49:0/2950265103 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0fc1544d0 0x7ff0fc155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.011+0000 7ff103d1a700 1 --2- 172.21.15.49:0/2950265103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0fc064e20 0x7ff0fc14ca50 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.011+0000 7ff103d1a700 1 --2- 172.21.15.49:0/2950265103 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0fc095e80 0x7ff0fc1554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.011+0000 7ff103d1a700 1 -- 172.21.15.49:0/2950265103 >> 172.21.15.49:0/2950265103 conn(0x7ff0fc0631d0 msgr2=0x7ff0fc14d490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.011+0000 7ff103d1a700 1 -- 172.21.15.49:0/2950265103 shutdown_connections 2023-11-30T18:41:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.011+0000 7ff103d1a700 1 -- 172.21.15.49:0/2950265103 wait complete. 2023-11-30T18:41:22.024 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-30T18:41:22.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.144+0000 7f193a225700 1 Processor -- start 2023-11-30T18:41:22.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.144+0000 7f193a225700 1 -- start start 2023-11-30T18:41:22.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.145+0000 7f193a225700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1934066a30 0x7f1934066e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:22.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.145+0000 7f193a225700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f19340c6eb0 0x7f193413db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:22.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.145+0000 7f193a225700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19341586a0 con 0x7f19340c6a30 2023-11-30T18:41:22.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.145+0000 7f193a225700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1934157de0 con 0x7f19340c6eb0 2023-11-30T18:41:22.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.145+0000 7f193a225700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1934064820 con 0x7f1934066a30 2023-11-30T18:41:22.147 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.145+0000 7f1939a24700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f19340c6eb0 0x7f193413db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:22.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.145+0000 7f1938a22700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f19340c6a30 0x7f193413d450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57348/0 (socket says 172.21.15.49:57348) 2023-11-30T18:41:22.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.145+0000 7f1938a22700 1 -- 172.21.15.49:0/907555595 learned_addr learned my addr 172.21.15.49:0/907555595 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:22.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.145+0000 7f1939223700 1 --2- 172.21.15.49:0/907555595 >> v2:172.21.15.115:3300/0 conn(0x7f1934066a30 0x7f1934066e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:22.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.145+0000 7f1939a24700 1 -- 172.21.15.49:0/907555595 >> v2:172.21.15.115:3300/0 conn(0x7f1934066a30 msgr2=0x7f1934066e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:22.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.145+0000 7f1939a24700 1 --2- 172.21.15.49:0/907555595 >> v2:172.21.15.115:3300/0 conn(0x7f1934066a30 0x7f1934066e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:22.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.145+0000 7f1939a24700 1 -- 172.21.15.49:0/907555595 >> v1:172.21.15.49:6789/0 conn(0x7f19340c6a30 legacy=0x7f193413d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:22.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.145+0000 7f192bfff700 1 -- 172.21.15.49:0/907555595 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 580232013 0 0) 0x7f19341586a0 con 0x7f19340c6a30 2023-11-30T18:41:22.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.145+0000 7f1939a24700 1 -- 172.21.15.49:0/907555595 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1934158050 con 0x7f19340c6eb0 2023-11-30T18:41:22.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.145+0000 7f1939a24700 1 --2- 172.21.15.49:0/907555595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19340c6eb0 0x7f193413db60 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 rx=0x7f19340c6980 tx=0x7f192c009780).ready entity=mon.0 client_cookie=8d91c64e849fdaf3 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:22.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.146+0000 7f192bfff700 1 -- 172.21.15.49:0/907555595 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c00e070 con 0x7f19340c6eb0 2023-11-30T18:41:22.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.146+0000 7f192bfff700 1 -- 172.21.15.49:0/907555595 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192c00bb60 con 0x7f19340c6eb0 2023-11-30T18:41:22.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.146+0000 7f192bfff700 1 -- 172.21.15.49:0/907555595 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c012410 con 0x7f19340c6eb0 2023-11-30T18:41:22.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.146+0000 7f193a225700 1 -- 172.21.15.49:0/907555595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19340c6eb0 msgr2=0x7f193413db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.146+0000 7f193a225700 1 --2- 172.21.15.49:0/907555595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19340c6eb0 0x7f193413db60 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 rx=0x7f19340c6980 tx=0x7f192c009780).stop 2023-11-30T18:41:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.146+0000 7f193a225700 1 -- 172.21.15.49:0/907555595 shutdown_connections 2023-11-30T18:41:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.146+0000 7f193a225700 1 --2- 172.21.15.49:0/907555595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19340c6eb0 0x7f193413db60 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.146+0000 7f193a225700 1 --2- 172.21.15.49:0/907555595 >> v2:172.21.15.115:3300/0 conn(0x7f1934066a30 0x7f1934066e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.146+0000 7f193a225700 1 -- 172.21.15.49:0/907555595 >> 172.21.15.49:0/907555595 conn(0x7f19340c8ed0 msgr2=0x7f19340c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.146+0000 7f193a225700 1 -- 172.21.15.49:0/907555595 shutdown_connections 2023-11-30T18:41:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.146+0000 7f193a225700 1 -- 172.21.15.49:0/907555595 wait complete. 2023-11-30T18:41:22.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.147+0000 7f193a225700 1 Processor -- start 2023-11-30T18:41:22.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.147+0000 7f193a225700 1 -- start start 2023-11-30T18:41:22.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.148+0000 7f193a225700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1934066a30 0x7f1934168370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:22.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.148+0000 7f193a225700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19340c6a30 0x7f1934135260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:22.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.148+0000 7f193a225700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19340c6eb0 0x7f1934134190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:22.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.148+0000 7f193a225700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1934165210 con 0x7f19340c6eb0 2023-11-30T18:41:22.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.148+0000 7f193a225700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1934135a20 con 0x7f19340c6a30 2023-11-30T18:41:22.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.148+0000 7f193a225700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1934164d80 con 0x7f1934066a30 2023-11-30T18:41:22.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.148+0000 7f1939a24700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19340c6eb0 0x7f1934134190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:22.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.148+0000 7f1939a24700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19340c6eb0 0x7f1934134190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43636/0 (socket says 172.21.15.49:43636) 2023-11-30T18:41:22.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.148+0000 7f1939a24700 1 -- 172.21.15.49:0/2178138476 learned_addr learned my addr 172.21.15.49:0/2178138476 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:22.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.149+0000 7f1939223700 1 --2- 172.21.15.49:0/2178138476 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1934066a30 0x7f1934168370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:22.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.149+0000 7f1938a22700 1 --2- 172.21.15.49:0/2178138476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19340c6a30 0x7f1934135260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:22.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.149+0000 7f1939a24700 1 -- 172.21.15.49:0/2178138476 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1934066a30 msgr2=0x7f1934168370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:22.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.149+0000 7f1939a24700 1 --2- 172.21.15.49:0/2178138476 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1934066a30 0x7f1934168370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:22.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.149+0000 7f1939a24700 1 -- 172.21.15.49:0/2178138476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19340c6a30 msgr2=0x7f1934135260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:22.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.149+0000 7f1939a24700 1 --2- 172.21.15.49:0/2178138476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19340c6a30 0x7f1934135260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:22.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.149+0000 7f1939a24700 1 -- 172.21.15.49:0/2178138476 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192c009a20 con 0x7f19340c6eb0 2023-11-30T18:41:22.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.149+0000 7f1938a22700 1 --2- 172.21.15.49:0/2178138476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19340c6a30 0x7f1934135260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:41:22.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.149+0000 7f1939a24700 1 --2- 172.21.15.49:0/2178138476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19340c6eb0 0x7f1934134190 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 rx=0x7f19340bfed0 tx=0x7f192c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:22.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.149+0000 7f19297fa700 1 -- 172.21.15.49:0/2178138476 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c012410 con 0x7f19340c6eb0 2023-11-30T18:41:22.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.149+0000 7f19297fa700 1 -- 172.21.15.49:0/2178138476 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192c009440 con 0x7f19340c6eb0 2023-11-30T18:41:22.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.149+0000 7f193a225700 1 -- 172.21.15.49:0/2178138476 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1934135750 con 0x7f19340c6eb0 2023-11-30T18:41:22.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.149+0000 7f19297fa700 1 -- 172.21.15.49:0/2178138476 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c01d840 con 0x7f19340c6eb0 2023-11-30T18:41:22.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.149+0000 7f193a225700 1 -- 172.21.15.49:0/2178138476 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1934164730 con 0x7f19340c6eb0 2023-11-30T18:41:22.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.150+0000 7f193a225700 1 -- 172.21.15.49:0/2178138476 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193406c7c0 con 0x7f19340c6eb0 2023-11-30T18:41:22.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.150+0000 7f19297fa700 1 -- 172.21.15.49:0/2178138476 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f192c01dbb0 con 0x7f19340c6eb0 2023-11-30T18:41:22.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.151+0000 7f19297fa700 1 --2- 172.21.15.49:0/2178138476 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f191805f270 0x7f1918061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:22.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.151+0000 7f19297fa700 1 -- 172.21.15.49:0/2178138476 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6233+0+0 (secure 0 0 0) 0x7f192c07c110 con 0x7f19340c6eb0 2023-11-30T18:41:22.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.151+0000 7f1939223700 1 --2- 172.21.15.49:0/2178138476 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f191805f270 0x7f1918061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:22.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.151+0000 7f1939223700 1 --2- 172.21.15.49:0/2178138476 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f191805f270 0x7f1918061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f1930009c30 tx=0x7f1930009060).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:22.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.155+0000 7f19297fa700 1 -- 172.21.15.49:0/2178138476 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f192c050c20 con 0x7f19340c6eb0 2023-11-30T18:41:22.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:22.377+0000 7f193a225700 1 -- 172.21.15.49:0/2178138476 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1934158330 con 0x7f19340c6eb0 2023-11-30T18:41:23.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.361+0000 7f19297fa700 1 -- 172.21.15.49:0/2178138476 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v92) v1 ==== 118+0+0 (secure 0 0 0) 0x7f192c050810 con 0x7f19340c6eb0 2023-11-30T18:41:23.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.364+0000 7f193a225700 1 -- 172.21.15.49:0/2178138476 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f191805f270 msgr2=0x7f1918061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:23.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.364+0000 7f193a225700 1 --2- 172.21.15.49:0/2178138476 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f191805f270 0x7f1918061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f1930009c30 tx=0x7f1930009060).stop 2023-11-30T18:41:23.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.364+0000 7f193a225700 1 -- 172.21.15.49:0/2178138476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19340c6eb0 msgr2=0x7f1934134190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:23.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.364+0000 7f193a225700 1 --2- 172.21.15.49:0/2178138476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19340c6eb0 0x7f1934134190 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 rx=0x7f19340bfed0 tx=0x7f192c009780).stop 2023-11-30T18:41:23.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.364+0000 7f193a225700 1 -- 172.21.15.49:0/2178138476 shutdown_connections 2023-11-30T18:41:23.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.364+0000 7f193a225700 1 --2- 172.21.15.49:0/2178138476 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f191805f270 0x7f1918061730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:23.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.364+0000 7f193a225700 1 --2- 172.21.15.49:0/2178138476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19340c6eb0 0x7f1934134190 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:23.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.364+0000 7f193a225700 1 --2- 172.21.15.49:0/2178138476 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1934066a30 0x7f1934168370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:23.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.364+0000 7f193a225700 1 --2- 172.21.15.49:0/2178138476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19340c6a30 0x7f1934135260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:23.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.364+0000 7f193a225700 1 -- 172.21.15.49:0/2178138476 >> 172.21.15.49:0/2178138476 conn(0x7f19340c8ed0 msgr2=0x7f1934067df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:23.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.364+0000 7f193a225700 1 -- 172.21.15.49:0/2178138476 shutdown_connections 2023-11-30T18:41:23.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.364+0000 7f193a225700 1 -- 172.21.15.49:0/2178138476 wait complete. 2023-11-30T18:41:23.380 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-30T18:41:23.380 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-30T18:41:23.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.507+0000 7f579cdd0700 1 Processor -- start 2023-11-30T18:41:23.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.507+0000 7f579cdd0700 1 -- start start 2023-11-30T18:41:23.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.508+0000 7f579cdd0700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f57980c6190 0x7f57980c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:23.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.508+0000 7f579cdd0700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5798158320 0x7f57981587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:23.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.508+0000 7f579cdd0700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5798158cc0 con 0x7f5798098d10 2023-11-30T18:41:23.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.508+0000 7f579cdd0700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57980c72d0 con 0x7f5798158320 2023-11-30T18:41:23.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.508+0000 7f579cdd0700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5798064570 con 0x7f57980c6190 2023-11-30T18:41:23.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.508+0000 7f5796d9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5798158320 0x7f57981587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:23.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.508+0000 7f579659c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5798098d10 0x7f5798063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57354/0 (socket says 172.21.15.49:57354) 2023-11-30T18:41:23.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.508+0000 7f579659c700 1 -- 172.21.15.49:0/3679059894 learned_addr learned my addr 172.21.15.49:0/3679059894 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:23.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.509+0000 7f5795d9b700 1 --2- 172.21.15.49:0/3679059894 >> v2:172.21.15.115:3300/0 conn(0x7f57980c6190 0x7f57980c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:23.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.509+0000 7f5796d9d700 1 -- 172.21.15.49:0/3679059894 >> v2:172.21.15.115:3300/0 conn(0x7f57980c6190 msgr2=0x7f57980c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:23.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.509+0000 7f5796d9d700 1 --2- 172.21.15.49:0/3679059894 >> v2:172.21.15.115:3300/0 conn(0x7f57980c6190 0x7f57980c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:23.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.509+0000 7f5796d9d700 1 -- 172.21.15.49:0/3679059894 >> v1:172.21.15.49:6789/0 conn(0x7f5798098d10 legacy=0x7f5798063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:23.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.509+0000 7f579559a700 1 -- 172.21.15.49:0/3679059894 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3008330073 0 0) 0x7f5788001110 con 0x7f5798098d10 2023-11-30T18:41:23.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.509+0000 7f5796d9d700 1 -- 172.21.15.49:0/3679059894 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5798154bc0 con 0x7f5798158320 2023-11-30T18:41:23.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.509+0000 7f5796d9d700 1 --2- 172.21.15.49:0/3679059894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5798158320 0x7f57981587d0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 rx=0x7f57980c5b40 tx=0x7f5790009780).ready entity=mon.0 client_cookie=f7d306009f15cdfc server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:23.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.509+0000 7f579559a700 1 -- 172.21.15.49:0/3679059894 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579000e070 con 0x7f5798158320 2023-11-30T18:41:23.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.509+0000 7f579559a700 1 -- 172.21.15.49:0/3679059894 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579000bc30 con 0x7f5798158320 2023-11-30T18:41:23.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.509+0000 7f579559a700 1 -- 172.21.15.49:0/3679059894 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5790012410 con 0x7f5798158320 2023-11-30T18:41:23.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.510+0000 7f579cdd0700 1 -- 172.21.15.49:0/3679059894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5798158320 msgr2=0x7f57981587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:23.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.510+0000 7f579cdd0700 1 --2- 172.21.15.49:0/3679059894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5798158320 0x7f57981587d0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 rx=0x7f57980c5b40 tx=0x7f5790009780).stop 2023-11-30T18:41:23.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.510+0000 7f579cdd0700 1 -- 172.21.15.49:0/3679059894 shutdown_connections 2023-11-30T18:41:23.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.510+0000 7f579cdd0700 1 --2- 172.21.15.49:0/3679059894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5798158320 0x7f57981587d0 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:23.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.510+0000 7f579cdd0700 1 --2- 172.21.15.49:0/3679059894 >> v2:172.21.15.115:3300/0 conn(0x7f57980c6190 0x7f57980c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:23.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.510+0000 7f579cdd0700 1 -- 172.21.15.49:0/3679059894 >> 172.21.15.49:0/3679059894 conn(0x7f57980cb310 msgr2=0x7f57980cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:23.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.510+0000 7f579cdd0700 1 -- 172.21.15.49:0/3679059894 shutdown_connections 2023-11-30T18:41:23.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.510+0000 7f579cdd0700 1 -- 172.21.15.49:0/3679059894 wait complete. 2023-11-30T18:41:23.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.511+0000 7f579cdd0700 1 Processor -- start 2023-11-30T18:41:23.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.511+0000 7f579cdd0700 1 -- start start 2023-11-30T18:41:23.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.512+0000 7f579cdd0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5798098d10 0x7f57980b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:23.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.512+0000 7f579cdd0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f57980c6190 0x7f57980c4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:23.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.512+0000 7f579cdd0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5798158320 0x7f57980c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:23.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.512+0000 7f579cdd0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57980afaf0 con 0x7f5798098d10 2023-11-30T18:41:23.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.512+0000 7f579cdd0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57980b1290 con 0x7f5798158320 2023-11-30T18:41:23.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.512+0000 7f579cdd0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57980ae570 con 0x7f57980c6190 2023-11-30T18:41:23.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.512+0000 7f579659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5798098d10 0x7f57980b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:23.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.512+0000 7f579659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5798098d10 0x7f57980b0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43660/0 (socket says 172.21.15.49:43660) 2023-11-30T18:41:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.512+0000 7f579659c700 1 -- 172.21.15.49:0/529601602 learned_addr learned my addr 172.21.15.49:0/529601602 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.512+0000 7f5796d9d700 1 --2- 172.21.15.49:0/529601602 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5798158320 0x7f57980c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.512+0000 7f5795d9b700 1 --2- 172.21.15.49:0/529601602 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f57980c6190 0x7f57980c4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.512+0000 7f579659c700 1 -- 172.21.15.49:0/529601602 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f57980c6190 msgr2=0x7f57980c4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.512+0000 7f579659c700 1 --2- 172.21.15.49:0/529601602 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f57980c6190 0x7f57980c4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.512+0000 7f579659c700 1 -- 172.21.15.49:0/529601602 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5798158320 msgr2=0x7f57980c4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.512+0000 7f579659c700 1 --2- 172.21.15.49:0/529601602 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5798158320 0x7f57980c4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.512+0000 7f579659c700 1 -- 172.21.15.49:0/529601602 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5790009a20 con 0x7f5798098d10 2023-11-30T18:41:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.512+0000 7f579659c700 1 --2- 172.21.15.49:0/529601602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5798098d10 0x7f57980b0da0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 rx=0x7f578800c510 tx=0x7f5788007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.512+0000 7f57867fc700 1 -- 172.21.15.49:0/529601602 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578800ce80 con 0x7f5798098d10 2023-11-30T18:41:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.512+0000 7f57867fc700 1 -- 172.21.15.49:0/529601602 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57880072e0 con 0x7f5798098d10 2023-11-30T18:41:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.512+0000 7f579cdd0700 1 -- 172.21.15.49:0/529601602 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57980afd00 con 0x7f5798098d10 2023-11-30T18:41:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.512+0000 7f57867fc700 1 -- 172.21.15.49:0/529601602 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5788007660 con 0x7f5798098d10 2023-11-30T18:41:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.512+0000 7f579cdd0700 1 -- 172.21.15.49:0/529601602 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57980b0090 con 0x7f5798098d10 2023-11-30T18:41:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.513+0000 7f579cdd0700 1 -- 172.21.15.49:0/529601602 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f579806c860 con 0x7f5798098d10 2023-11-30T18:41:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.514+0000 7f57867fc700 1 -- 172.21.15.49:0/529601602 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f57880059b0 con 0x7f5798098d10 2023-11-30T18:41:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.514+0000 7f57867fc700 1 --2- 172.21.15.49:0/529601602 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f577805f270 0x7f5778061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.514+0000 7f57867fc700 1 -- 172.21.15.49:0/529601602 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(219..219 src has 1..219) v4 ==== 6233+0+0 (secure 0 0 0) 0x7f5788079990 con 0x7f5798098d10 2023-11-30T18:41:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.514+0000 7f5795d9b700 1 --2- 172.21.15.49:0/529601602 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f577805f270 0x7f5778061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.515+0000 7f5795d9b700 1 --2- 172.21.15.49:0/529601602 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f577805f270 0x7f5778061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f5798156cd0 tx=0x7f578c008040).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.518+0000 7f57867fc700 1 -- 172.21.15.49:0/529601602 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f578804aa70 con 0x7f5798098d10 2023-11-30T18:41:23.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:23.735+0000 7f579cdd0700 1 -- 172.21.15.49:0/529601602 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5798158cc0 con 0x7f5798098d10 2023-11-30T18:41:24.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.368+0000 7f57867fc700 1 -- 172.21.15.49:0/529601602 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v93) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5798158cc0 con 0x7f5798098d10 2023-11-30T18:41:24.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.370+0000 7f579cdd0700 1 -- 172.21.15.49:0/529601602 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f577805f270 msgr2=0x7f5778061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:24.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.370+0000 7f579cdd0700 1 --2- 172.21.15.49:0/529601602 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f577805f270 0x7f5778061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f5798156cd0 tx=0x7f578c008040).stop 2023-11-30T18:41:24.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.370+0000 7f579cdd0700 1 -- 172.21.15.49:0/529601602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5798098d10 msgr2=0x7f57980b0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:24.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.370+0000 7f579cdd0700 1 --2- 172.21.15.49:0/529601602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5798098d10 0x7f57980b0da0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 rx=0x7f578800c510 tx=0x7f5788007ad0).stop 2023-11-30T18:41:24.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.370+0000 7f579cdd0700 1 -- 172.21.15.49:0/529601602 shutdown_connections 2023-11-30T18:41:24.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.370+0000 7f579cdd0700 1 --2- 172.21.15.49:0/529601602 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f577805f270 0x7f5778061730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:24.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.370+0000 7f579cdd0700 1 --2- 172.21.15.49:0/529601602 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5798158320 0x7f57980c4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:24.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.370+0000 7f579cdd0700 1 --2- 172.21.15.49:0/529601602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5798098d10 0x7f57980b0da0 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:24.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.370+0000 7f579cdd0700 1 --2- 172.21.15.49:0/529601602 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f57980c6190 0x7f57980c4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:24.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.370+0000 7f579cdd0700 1 -- 172.21.15.49:0/529601602 >> 172.21.15.49:0/529601602 conn(0x7f57980cb310 msgr2=0x7f57980ca270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:24.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.370+0000 7f579cdd0700 1 -- 172.21.15.49:0/529601602 shutdown_connections 2023-11-30T18:41:24.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.370+0000 7f579cdd0700 1 -- 172.21.15.49:0/529601602 wait complete. 2023-11-30T18:41:24.385 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-30T18:41:24.385 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:41:24.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.507+0000 7fc638681700 1 Processor -- start 2023-11-30T18:41:24.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.507+0000 7fc638681700 1 -- start start 2023-11-30T18:41:24.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.508+0000 7fc638681700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc63006a610 0x7fc6300a8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:24.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.508+0000 7fc638681700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6300c69a0 con 0x7fc6301544e0 2023-11-30T18:41:24.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.508+0000 7fc638681700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6300c13a0 con 0x7fc6301548c0 2023-11-30T18:41:24.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.508+0000 7fc638681700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6300c1680 con 0x7fc63006a610 2023-11-30T18:41:24.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.509+0000 7fc63641d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc6301544e0 0x7fc6300c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57364/0 (socket says 172.21.15.49:57364) 2023-11-30T18:41:24.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.509+0000 7fc63641d700 1 -- 172.21.15.49:0/2278304441 learned_addr learned my addr 172.21.15.49:0/2278304441 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:24.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.509+0000 7fc636c1e700 1 --2- 172.21.15.49:0/2278304441 >> v2:172.21.15.115:3300/0 conn(0x7fc63006a610 0x7fc6300a8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:24.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.509+0000 7fc63541b700 1 -- 172.21.15.49:0/2278304441 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3767959180 0 0) 0x7fc6300c69a0 con 0x7fc6301544e0 2023-11-30T18:41:24.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.509+0000 7fc63541b700 1 -- 172.21.15.49:0/2278304441 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6180033f0 con 0x7fc6301544e0 2023-11-30T18:41:24.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.509+0000 7fc63541b700 1 -- 172.21.15.49:0/2278304441 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3320804459 0 0) 0x7fc6180033f0 con 0x7fc6301544e0 2023-11-30T18:41:24.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.509+0000 7fc63541b700 1 -- 172.21.15.49:0/2278304441 >> v2:172.21.15.115:3300/0 conn(0x7fc63006a610 msgr2=0x7fc6300a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:24.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.509+0000 7fc63541b700 1 --2- 172.21.15.49:0/2278304441 >> v2:172.21.15.115:3300/0 conn(0x7fc63006a610 0x7fc6300a8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:24.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.509+0000 7fc63541b700 1 -- 172.21.15.49:0/2278304441 >> v1:172.21.15.115:6789/0 conn(0x7fc6301548c0 legacy=0x7fc6300c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:24.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.509+0000 7fc63541b700 1 -- 172.21.15.49:0/2278304441 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6300c6630 con 0x7fc6301544e0 2023-11-30T18:41:24.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.509+0000 7fc63541b700 1 -- 172.21.15.49:0/2278304441 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fc620001970 con 0x7fc6301544e0 2023-11-30T18:41:24.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.509+0000 7fc63541b700 1 -- 172.21.15.49:0/2278304441 >> v1:172.21.15.49:6789/0 conn(0x7fc6301544e0 legacy=0x7fc6300c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:24.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.509+0000 7fc63541b700 1 --2- 172.21.15.49:0/2278304441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6180038e0 0x7fc618003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:24.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.509+0000 7fc63541b700 1 --2- 172.21.15.49:0/2278304441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc618004690 0x7fc618004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:24.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.509+0000 7fc63541b700 1 --2- 172.21.15.49:0/2278304441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc618005000 0x7fc61800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:24.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.509+0000 7fc63541b700 1 -- 172.21.15.49:0/2278304441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6300c1680 con 0x7fc6180038e0 2023-11-30T18:41:24.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.509+0000 7fc63541b700 1 -- 172.21.15.49:0/2278304441 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61800be00 con 0x7fc618004690 2023-11-30T18:41:24.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.509+0000 7fc63541b700 1 -- 172.21.15.49:0/2278304441 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61800bfc0 con 0x7fc618005000 2023-11-30T18:41:24.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.509+0000 7fc63641d700 1 --2- 172.21.15.49:0/2278304441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6180038e0 0x7fc618003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:24.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.509+0000 7fc635c1c700 1 --2- 172.21.15.49:0/2278304441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc618004690 0x7fc618004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:24.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.509+0000 7fc636c1e700 1 --2- 172.21.15.49:0/2278304441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc618005000 0x7fc61800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:24.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.510+0000 7fc63641d700 1 -- 172.21.15.49:0/2278304441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc618005000 msgr2=0x7fc61800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:24.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.510+0000 7fc63641d700 1 --2- 172.21.15.49:0/2278304441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc618005000 0x7fc61800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:24.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.510+0000 7fc63641d700 1 -- 172.21.15.49:0/2278304441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc618004690 msgr2=0x7fc618004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:24.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.510+0000 7fc63641d700 1 --2- 172.21.15.49:0/2278304441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc618004690 0x7fc618004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:24.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.510+0000 7fc63641d700 1 -- 172.21.15.49:0/2278304441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6180033f0 con 0x7fc6180038e0 2023-11-30T18:41:24.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.510+0000 7fc636c1e700 1 --2- 172.21.15.49:0/2278304441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc618005000 0x7fc61800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:41:24.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.510+0000 7fc636c1e700 1 -- 172.21.15.49:0/2278304441 reap_dead start 2023-11-30T18:41:24.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.510+0000 7fc63641d700 1 --2- 172.21.15.49:0/2278304441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6180038e0 0x7fc618003cc0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 rx=0x7fc62000c500 tx=0x7fc620007b20).ready entity=mon.0 client_cookie=feb282aaf87b1dd2 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:24.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.510+0000 7fc63541b700 1 -- 172.21.15.49:0/2278304441 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62000ce30 con 0x7fc6180038e0 2023-11-30T18:41:24.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.510+0000 7fc63541b700 1 -- 172.21.15.49:0/2278304441 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc620007d30 con 0x7fc6180038e0 2023-11-30T18:41:24.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.510+0000 7fc63541b700 1 -- 172.21.15.49:0/2278304441 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc620005c00 con 0x7fc6180038e0 2023-11-30T18:41:24.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.510+0000 7fc638681700 1 -- 172.21.15.49:0/2278304441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6180038e0 msgr2=0x7fc618003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:24.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.510+0000 7fc638681700 1 --2- 172.21.15.49:0/2278304441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6180038e0 0x7fc618003cc0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 rx=0x7fc62000c500 tx=0x7fc620007b20).stop 2023-11-30T18:41:24.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.510+0000 7fc638681700 1 -- 172.21.15.49:0/2278304441 shutdown_connections 2023-11-30T18:41:24.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.510+0000 7fc638681700 1 --2- 172.21.15.49:0/2278304441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6180038e0 0x7fc618003cc0 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:24.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.510+0000 7fc638681700 1 -- 172.21.15.49:0/2278304441 >> 172.21.15.49:0/2278304441 conn(0x7fc630085020 msgr2=0x7fc630094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:24.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.511+0000 7fc638681700 1 -- 172.21.15.49:0/2278304441 shutdown_connections 2023-11-30T18:41:24.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.511+0000 7fc638681700 1 -- 172.21.15.49:0/2278304441 wait complete. 2023-11-30T18:41:24.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.512+0000 7fc638681700 1 Processor -- start 2023-11-30T18:41:24.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.512+0000 7fc638681700 1 -- start start 2023-11-30T18:41:24.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.512+0000 7fc638681700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6180038e0 0x7fc630159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:24.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.512+0000 7fc638681700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6300c48d0 0x7fc6300c2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:24.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.512+0000 7fc638681700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc630156230 0x7fc6301566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:24.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.512+0000 7fc638681700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63015a490 con 0x7fc6180038e0 2023-11-30T18:41:24.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.512+0000 7fc638681700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc630156ba0 con 0x7fc630156230 2023-11-30T18:41:24.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.512+0000 7fc638681700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6300c4d50 con 0x7fc6300c48d0 2023-11-30T18:41:24.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.513+0000 7fc63641d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6180038e0 0x7fc630159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:24.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.513+0000 7fc63641d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6180038e0 0x7fc630159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43680/0 (socket says 172.21.15.49:43680) 2023-11-30T18:41:24.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.513+0000 7fc63641d700 1 -- 172.21.15.49:0/1956234799 learned_addr learned my addr 172.21.15.49:0/1956234799 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:24.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.513+0000 7fc635c1c700 1 --2- 172.21.15.49:0/1956234799 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6300c48d0 0x7fc6300c2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:24.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.513+0000 7fc636c1e700 1 --2- 172.21.15.49:0/1956234799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc630156230 0x7fc6301566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:24.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.513+0000 7fc63641d700 1 -- 172.21.15.49:0/1956234799 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6300c48d0 msgr2=0x7fc6300c2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:24.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.513+0000 7fc63641d700 1 --2- 172.21.15.49:0/1956234799 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6300c48d0 0x7fc6300c2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:24.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.513+0000 7fc63641d700 1 -- 172.21.15.49:0/1956234799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc630156230 msgr2=0x7fc6301566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:24.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.513+0000 7fc63641d700 1 --2- 172.21.15.49:0/1956234799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc630156230 0x7fc6301566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:24.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.513+0000 7fc63641d700 1 -- 172.21.15.49:0/1956234799 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6300c2b10 con 0x7fc6180038e0 2023-11-30T18:41:24.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.513+0000 7fc63641d700 1 --2- 172.21.15.49:0/1956234799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6180038e0 0x7fc630159fa0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 rx=0x7fc62000caf0 tx=0x7fc620015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:24.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.513+0000 7fc62e7fc700 1 -- 172.21.15.49:0/1956234799 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6200012f0 con 0x7fc6180038e0 2023-11-30T18:41:24.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.513+0000 7fc62e7fc700 1 -- 172.21.15.49:0/1956234799 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc620001b50 con 0x7fc6180038e0 2023-11-30T18:41:24.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.513+0000 7fc638681700 1 -- 172.21.15.49:0/1956234799 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6300c2df0 con 0x7fc6180038e0 2023-11-30T18:41:24.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.513+0000 7fc62e7fc700 1 -- 172.21.15.49:0/1956234799 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc620001cc0 con 0x7fc6180038e0 2023-11-30T18:41:24.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.513+0000 7fc638681700 1 -- 172.21.15.49:0/1956234799 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6300c33b0 con 0x7fc6180038e0 2023-11-30T18:41:24.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.514+0000 7fc638681700 1 -- 172.21.15.49:0/1956234799 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc63006c860 con 0x7fc6180038e0 2023-11-30T18:41:24.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.515+0000 7fc62e7fc700 1 -- 172.21.15.49:0/1956234799 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc620013660 con 0x7fc6180038e0 2023-11-30T18:41:24.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.515+0000 7fc62e7fc700 1 --2- 172.21.15.49:0/1956234799 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc61c05f270 0x7fc61c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:24.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.515+0000 7fc62e7fc700 1 -- 172.21.15.49:0/1956234799 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(219..219 src has 1..219) v4 ==== 6233+0+0 (secure 0 0 0) 0x7fc62007aea0 con 0x7fc6180038e0 2023-11-30T18:41:24.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.515+0000 7fc635c1c700 1 --2- 172.21.15.49:0/1956234799 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc61c05f270 0x7fc61c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:24.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.516+0000 7fc635c1c700 1 --2- 172.21.15.49:0/1956234799 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc61c05f270 0x7fc61c061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fc624000c00 tx=0x7fc624007b90).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:24.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.519+0000 7fc62e7fc700 1 -- 172.21.15.49:0/1956234799 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc62004bf80 con 0x7fc6180038e0 2023-11-30T18:41:24.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.735+0000 7fc638681700 1 -- 172.21.15.49:0/1956234799 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6300c39f0 con 0x7fc6180038e0 2023-11-30T18:41:24.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.735+0000 7fc62e7fc700 1 -- 172.21.15.49:0/1956234799 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4499 (secure 0 0 0) 0x7fc6300c39f0 con 0x7fc6180038e0 2023-11-30T18:41:24.737 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:24.737 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":93,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8219,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3124035021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3124035021},{"type":"v1","addr":"172.21.15.115:6837","nonce":3124035021}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":9565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2947558957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2947558957},{"type":"v1","addr":"172.21.15.115:6836","nonce":2947558957}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":9996,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1999244219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1999244219},{"type":"v1","addr":"172.21.15.49:6834","nonce":1999244219}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T18:41:21.351721+0000","modified":"2023-11-30T18:41:24.361310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9999":{"gid":9999,"name":"a","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1129424322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1129424322},{"type":"v1","addr":"172.21.15.49:6835","nonce":1129424322}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-11-30T18:41:24.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.737+0000 7fc638681700 1 -- 172.21.15.49:0/1956234799 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc61c05f270 msgr2=0x7fc61c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:24.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.737+0000 7fc638681700 1 --2- 172.21.15.49:0/1956234799 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc61c05f270 0x7fc61c061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fc624000c00 tx=0x7fc624007b90).stop 2023-11-30T18:41:24.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.737+0000 7fc638681700 1 -- 172.21.15.49:0/1956234799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6180038e0 msgr2=0x7fc630159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:24.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.737+0000 7fc638681700 1 --2- 172.21.15.49:0/1956234799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6180038e0 0x7fc630159fa0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 rx=0x7fc62000caf0 tx=0x7fc620015000).stop 2023-11-30T18:41:24.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.737+0000 7fc638681700 1 -- 172.21.15.49:0/1956234799 shutdown_connections 2023-11-30T18:41:24.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.737+0000 7fc638681700 1 --2- 172.21.15.49:0/1956234799 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc61c05f270 0x7fc61c061730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:24.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.737+0000 7fc638681700 1 --2- 172.21.15.49:0/1956234799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc630156230 0x7fc6301566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:24.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.737+0000 7fc638681700 1 --2- 172.21.15.49:0/1956234799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6180038e0 0x7fc630159fa0 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:24.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.737+0000 7fc638681700 1 --2- 172.21.15.49:0/1956234799 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6300c48d0 0x7fc6300c2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:24.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.737+0000 7fc638681700 1 -- 172.21.15.49:0/1956234799 >> 172.21.15.49:0/1956234799 conn(0x7fc630085020 msgr2=0x7fc6300ca700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:24.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.737+0000 7fc638681700 1 -- 172.21.15.49:0/1956234799 shutdown_connections 2023-11-30T18:41:24.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.737+0000 7fc638681700 1 -- 172.21.15.49:0/1956234799 wait complete. 2023-11-30T18:41:24.741 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 93 2023-11-30T18:41:24.750 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:41:24.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.867+0000 7f4a3a941700 1 Processor -- start 2023-11-30T18:41:24.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.867+0000 7f4a3a941700 1 -- start start 2023-11-30T18:41:24.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.868+0000 7f4a3a941700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4a34157660 0x7f4a34157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:24.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.868+0000 7f4a3a941700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a340c1750 0x7f4a340c1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:24.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.868+0000 7f4a3a941700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a340c12c0 con 0x7f4a340c0180 2023-11-30T18:41:24.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.868+0000 7f4a3a941700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a340c06b0 con 0x7f4a34157660 2023-11-30T18:41:24.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.868+0000 7f4a3a941700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a340c0990 con 0x7f4a340c1750 2023-11-30T18:41:24.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.868+0000 7f4a3993f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4a34157660 0x7f4a34157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:24.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.868+0000 7f4a3993f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4a34157660 0x7f4a34157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43688/0 (socket says 172.21.15.49:43688) 2023-11-30T18:41:24.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.868+0000 7f4a3993f700 1 -- 172.21.15.49:0/1851948257 learned_addr learned my addr 172.21.15.49:0/1851948257 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:24.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.868+0000 7f4a3a140700 1 --2- 172.21.15.49:0/1851948257 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a340c1750 0x7f4a340c1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:24.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.868+0000 7f4a3993f700 1 -- 172.21.15.49:0/1851948257 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a340c1750 msgr2=0x7f4a340c1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:24.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.868+0000 7f4a3993f700 1 --2- 172.21.15.49:0/1851948257 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a340c1750 0x7f4a340c1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:24.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.868+0000 7f4a3993f700 1 -- 172.21.15.49:0/1851948257 >> v1:172.21.15.115:6789/0 conn(0x7f4a340c0180 legacy=0x7f4a341589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:24.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.868+0000 7f4a3993f700 1 -- 172.21.15.49:0/1851948257 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a340c0c70 con 0x7f4a34157660 2023-11-30T18:41:24.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.868+0000 7f4a3a140700 1 --2- 172.21.15.49:0/1851948257 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a340c1750 0x7f4a340c1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:41:24.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.868+0000 7f4a3993f700 1 --2- 172.21.15.49:0/1851948257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a34157660 0x7f4a34157a40 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 rx=0x7f4a30006fd0 tx=0x7f4a300090f0).ready entity=mon.0 client_cookie=a6e2a85ab9adb208 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:24.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.869+0000 7f4a3893d700 1 -- 172.21.15.49:0/1851948257 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3000b600 con 0x7f4a34157660 2023-11-30T18:41:24.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.869+0000 7f4a3893d700 1 -- 172.21.15.49:0/1851948257 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3000b760 con 0x7f4a34157660 2023-11-30T18:41:24.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.869+0000 7f4a3893d700 1 -- 172.21.15.49:0/1851948257 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3000bae0 con 0x7f4a34157660 2023-11-30T18:41:24.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.869+0000 7f4a3a941700 1 -- 172.21.15.49:0/1851948257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a34157660 msgr2=0x7f4a34157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:24.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.869+0000 7f4a3a941700 1 --2- 172.21.15.49:0/1851948257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a34157660 0x7f4a34157a40 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 rx=0x7f4a30006fd0 tx=0x7f4a300090f0).stop 2023-11-30T18:41:24.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.869+0000 7f4a3a941700 1 -- 172.21.15.49:0/1851948257 shutdown_connections 2023-11-30T18:41:24.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.869+0000 7f4a3a941700 1 --2- 172.21.15.49:0/1851948257 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a340c1750 0x7f4a340c1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:24.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.869+0000 7f4a3a941700 1 --2- 172.21.15.49:0/1851948257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a34157660 0x7f4a34157a40 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:24.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.869+0000 7f4a3a941700 1 -- 172.21.15.49:0/1851948257 >> 172.21.15.49:0/1851948257 conn(0x7f4a340cb000 msgr2=0x7f4a340cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:24.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.869+0000 7f4a3a941700 1 -- 172.21.15.49:0/1851948257 shutdown_connections 2023-11-30T18:41:24.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.869+0000 7f4a3a941700 1 -- 172.21.15.49:0/1851948257 wait complete. 2023-11-30T18:41:24.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.870+0000 7f4a3a941700 1 Processor -- start 2023-11-30T18:41:24.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.870+0000 7f4a3a941700 1 -- start start 2023-11-30T18:41:24.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.871+0000 7f4a3a941700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a340c0180 0x7f4a34147c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:24.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.871+0000 7f4a3a941700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a340c1750 0x7f4a340c1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:24.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.871+0000 7f4a3a941700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a34157660 0x7f4a341646e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:24.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.871+0000 7f4a3a941700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a341656f0 con 0x7f4a340c1750 2023-11-30T18:41:24.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.871+0000 7f4a3a941700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a34165130 con 0x7f4a34157660 2023-11-30T18:41:24.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.871+0000 7f4a3a941700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a34165410 con 0x7f4a340c0180 2023-11-30T18:41:24.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.871+0000 7f4a3913e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a340c1750 0x7f4a340c1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:24.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.871+0000 7f4a3913e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a340c1750 0x7f4a340c1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43698/0 (socket says 172.21.15.49:43698) 2023-11-30T18:41:24.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.871+0000 7f4a3913e700 1 -- 172.21.15.49:0/4048829748 learned_addr learned my addr 172.21.15.49:0/4048829748 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:24.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.871+0000 7f4a3993f700 1 --2- 172.21.15.49:0/4048829748 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a340c0180 0x7f4a34147c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:24.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.871+0000 7f4a3a140700 1 --2- 172.21.15.49:0/4048829748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a34157660 0x7f4a341646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:24.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.872+0000 7f4a3913e700 1 -- 172.21.15.49:0/4048829748 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a340c0180 msgr2=0x7f4a34147c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:24.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.872+0000 7f4a3913e700 1 --2- 172.21.15.49:0/4048829748 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a340c0180 0x7f4a34147c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:24.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.872+0000 7f4a3913e700 1 -- 172.21.15.49:0/4048829748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a34157660 msgr2=0x7f4a341646e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:24.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.872+0000 7f4a3913e700 1 --2- 172.21.15.49:0/4048829748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a34157660 0x7f4a341646e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:24.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.872+0000 7f4a3913e700 1 -- 172.21.15.49:0/4048829748 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a30009370 con 0x7f4a340c1750 2023-11-30T18:41:24.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.872+0000 7f4a3913e700 1 --2- 172.21.15.49:0/4048829748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a340c1750 0x7f4a340c1bc0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 rx=0x7f4a2400c4c0 tx=0x7f4a24007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:24.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.872+0000 7f4a29ffb700 1 -- 172.21.15.49:0/4048829748 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2400ce70 con 0x7f4a340c1750 2023-11-30T18:41:24.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.872+0000 7f4a29ffb700 1 -- 172.21.15.49:0/4048829748 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a24001e90 con 0x7f4a340c1750 2023-11-30T18:41:24.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.872+0000 7f4a3a941700 1 -- 172.21.15.49:0/4048829748 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a34153c50 con 0x7f4a340c1750 2023-11-30T18:41:24.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.872+0000 7f4a29ffb700 1 -- 172.21.15.49:0/4048829748 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a24007250 con 0x7f4a340c1750 2023-11-30T18:41:24.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.872+0000 7f4a3a941700 1 -- 172.21.15.49:0/4048829748 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a34148160 con 0x7f4a340c1750 2023-11-30T18:41:24.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.873+0000 7f4a3a941700 1 -- 172.21.15.49:0/4048829748 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a34153ab0 con 0x7f4a340c1750 2023-11-30T18:41:24.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.873+0000 7f4a29ffb700 1 -- 172.21.15.49:0/4048829748 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4a240066a0 con 0x7f4a340c1750 2023-11-30T18:41:24.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.874+0000 7f4a29ffb700 1 --2- 172.21.15.49:0/4048829748 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4a1805f270 0x7f4a18061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:24.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.874+0000 7f4a29ffb700 1 -- 172.21.15.49:0/4048829748 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(219..219 src has 1..219) v4 ==== 6233+0+0 (secure 0 0 0) 0x7f4a24079cb0 con 0x7f4a340c1750 2023-11-30T18:41:24.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.874+0000 7f4a3993f700 1 --2- 172.21.15.49:0/4048829748 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4a1805f270 0x7f4a18061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:24.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.874+0000 7f4a3993f700 1 --2- 172.21.15.49:0/4048829748 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4a1805f270 0x7f4a18061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f4a30009130 tx=0x7f4a30017000).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:24.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:24.878+0000 7f4a29ffb700 1 -- 172.21.15.49:0/4048829748 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4a34153ab0 con 0x7f4a340c1750 2023-11-30T18:41:25.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.052+0000 7f4a3a941700 1 -- 172.21.15.49:0/4048829748 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a34154170 con 0x7f4a340c1750 2023-11-30T18:41:25.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.053+0000 7f4a29ffb700 1 -- 172.21.15.49:0/4048829748 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v219) v1 ==== 74+0+17122 (secure 0 0 0) 0x7f4a34154170 con 0x7f4a340c1750 2023-11-30T18:41:25.054 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:25.054 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":219,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:41:22.353126+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"208","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-11-30T18:41:19.292113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"218","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-11-30T18:41:20.340870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"219","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:41:25.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.054+0000 7f4a3a941700 1 -- 172.21.15.49:0/4048829748 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4a1805f270 msgr2=0x7f4a18061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:25.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.054+0000 7f4a3a941700 1 --2- 172.21.15.49:0/4048829748 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4a1805f270 0x7f4a18061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f4a30009130 tx=0x7f4a30017000).stop 2023-11-30T18:41:25.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.054+0000 7f4a3a941700 1 -- 172.21.15.49:0/4048829748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a340c1750 msgr2=0x7f4a340c1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:25.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.054+0000 7f4a3a941700 1 --2- 172.21.15.49:0/4048829748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a340c1750 0x7f4a340c1bc0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 rx=0x7f4a2400c4c0 tx=0x7f4a24007e00).stop 2023-11-30T18:41:25.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.055+0000 7f4a3a941700 1 -- 172.21.15.49:0/4048829748 shutdown_connections 2023-11-30T18:41:25.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.055+0000 7f4a3a941700 1 --2- 172.21.15.49:0/4048829748 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4a1805f270 0x7f4a18061730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:25.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.055+0000 7f4a3a941700 1 --2- 172.21.15.49:0/4048829748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a34157660 0x7f4a341646e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:25.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.055+0000 7f4a3a941700 1 --2- 172.21.15.49:0/4048829748 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a340c0180 0x7f4a34147c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:25.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.055+0000 7f4a3a941700 1 --2- 172.21.15.49:0/4048829748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a340c1750 0x7f4a340c1bc0 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:25.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.055+0000 7f4a3a941700 1 -- 172.21.15.49:0/4048829748 >> 172.21.15.49:0/4048829748 conn(0x7f4a340cb000 msgr2=0x7f4a340affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:25.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.055+0000 7f4a3a941700 1 -- 172.21.15.49:0/4048829748 shutdown_connections 2023-11-30T18:41:25.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.055+0000 7f4a3a941700 1 -- 172.21.15.49:0/4048829748 wait complete. 2023-11-30T18:41:25.068 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-30T18:41:25.068 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T18:41:25.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.185+0000 7feb08dd2700 1 Processor -- start 2023-11-30T18:41:25.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.185+0000 7feb08dd2700 1 -- start start 2023-11-30T18:41:25.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.186+0000 7feb08dd2700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7feb040c0180 0x7feb04157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:25.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.186+0000 7feb08dd2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb040c1750 0x7feb040c1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:25.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.186+0000 7feb08dd2700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb040c12c0 con 0x7feb04157660 2023-11-30T18:41:25.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.186+0000 7feb08dd2700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb040c06b0 con 0x7feb040c0180 2023-11-30T18:41:25.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.186+0000 7feb08dd2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb040c0990 con 0x7feb040c1750 2023-11-30T18:41:25.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.186+0000 7feb037fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7feb04157660 0x7feb041589c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57370/0 (socket says 172.21.15.49:57370) 2023-11-30T18:41:25.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.186+0000 7feb037fe700 1 -- 172.21.15.49:0/3354921495 learned_addr learned my addr 172.21.15.49:0/3354921495 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:25.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.186+0000 7feb03fff700 1 --2- 172.21.15.49:0/3354921495 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb040c1750 0x7feb040c1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:25.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.186+0000 7feb02ffd700 1 --2- 172.21.15.49:0/3354921495 >> v2:172.21.15.115:3300/0 conn(0x7feb040c0180 0x7feb04157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:25.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.186+0000 7feb027fc700 1 -- 172.21.15.49:0/3354921495 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 763641151 0 0) 0x7feb040c12c0 con 0x7feb04157660 2023-11-30T18:41:25.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.186+0000 7feb027fc700 1 -- 172.21.15.49:0/3354921495 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaec0033f0 con 0x7feb04157660 2023-11-30T18:41:25.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.186+0000 7feb027fc700 1 -- 172.21.15.49:0/3354921495 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2258389768 0 0) 0x7feaec0033f0 con 0x7feb04157660 2023-11-30T18:41:25.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.187+0000 7feb027fc700 1 -- 172.21.15.49:0/3354921495 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb040c1750 msgr2=0x7feb040c1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:25.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.187+0000 7feb027fc700 1 --2- 172.21.15.49:0/3354921495 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb040c1750 0x7feb040c1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:25.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.187+0000 7feb027fc700 1 -- 172.21.15.49:0/3354921495 >> v2:172.21.15.115:3300/0 conn(0x7feb040c0180 msgr2=0x7feb04157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:25.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.187+0000 7feb027fc700 1 --2- 172.21.15.49:0/3354921495 >> v2:172.21.15.115:3300/0 conn(0x7feb040c0180 0x7feb04157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:25.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.187+0000 7feb027fc700 1 -- 172.21.15.49:0/3354921495 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb040c0c70 con 0x7feb04157660 2023-11-30T18:41:25.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.187+0000 7feb027fc700 1 -- 172.21.15.49:0/3354921495 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7feaf4001470 con 0x7feb04157660 2023-11-30T18:41:25.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.187+0000 7feb027fc700 1 -- 172.21.15.49:0/3354921495 >> v1:172.21.15.49:6789/0 conn(0x7feb04157660 legacy=0x7feb041589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:25.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.187+0000 7feb027fc700 1 --2- 172.21.15.49:0/3354921495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaec0038e0 0x7feaec003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:25.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.187+0000 7feb027fc700 1 --2- 172.21.15.49:0/3354921495 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb040c1750 0x7feaec004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:25.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.187+0000 7feb027fc700 1 --2- 172.21.15.49:0/3354921495 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feaec004b80 0x7feaec005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:25.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.187+0000 7feb027fc700 1 -- 172.21.15.49:0/3354921495 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb040c06b0 con 0x7feaec0038e0 2023-11-30T18:41:25.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.187+0000 7feb027fc700 1 -- 172.21.15.49:0/3354921495 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb040c0990 con 0x7feaec004b80 2023-11-30T18:41:25.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.187+0000 7feb027fc700 1 -- 172.21.15.49:0/3354921495 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaec00b8e0 con 0x7feb040c1750 2023-11-30T18:41:25.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.187+0000 7feb037fe700 1 --2- 172.21.15.49:0/3354921495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaec0038e0 0x7feaec003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:25.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.187+0000 7feb03fff700 1 --2- 172.21.15.49:0/3354921495 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feaec004b80 0x7feaec005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:25.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.187+0000 7feb02ffd700 1 --2- 172.21.15.49:0/3354921495 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb040c1750 0x7feaec004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:25.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.187+0000 7feb037fe700 1 -- 172.21.15.49:0/3354921495 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb040c1750 msgr2=0x7feaec004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:25.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.187+0000 7feb037fe700 1 --2- 172.21.15.49:0/3354921495 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb040c1750 0x7feaec004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:25.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.187+0000 7feb037fe700 1 -- 172.21.15.49:0/3354921495 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feaec004b80 msgr2=0x7feaec005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:25.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.187+0000 7feb037fe700 1 --2- 172.21.15.49:0/3354921495 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feaec004b80 0x7feaec005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:25.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.187+0000 7feb037fe700 1 -- 172.21.15.49:0/3354921495 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaec0033f0 con 0x7feaec0038e0 2023-11-30T18:41:25.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.187+0000 7feb037fe700 1 --2- 172.21.15.49:0/3354921495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaec0038e0 0x7feaec003d00 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 rx=0x7feaf400c210 tx=0x7feaf4001e90).ready entity=mon.0 client_cookie=6f5c1c0952fab1b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:25.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.187+0000 7feb027fc700 1 -- 172.21.15.49:0/3354921495 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf4007a60 con 0x7feaec0038e0 2023-11-30T18:41:25.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.187+0000 7feb027fc700 1 -- 172.21.15.49:0/3354921495 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf400cae0 con 0x7feaec0038e0 2023-11-30T18:41:25.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.187+0000 7feb027fc700 1 -- 172.21.15.49:0/3354921495 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf400ce80 con 0x7feaec0038e0 2023-11-30T18:41:25.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.188+0000 7feb08dd2700 1 -- 172.21.15.49:0/3354921495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaec0038e0 msgr2=0x7feaec003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:25.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.188+0000 7feb08dd2700 1 --2- 172.21.15.49:0/3354921495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaec0038e0 0x7feaec003d00 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 rx=0x7feaf400c210 tx=0x7feaf4001e90).stop 2023-11-30T18:41:25.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.188+0000 7feb03fff700 1 -- 172.21.15.49:0/3354921495 reap_dead start 2023-11-30T18:41:25.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.188+0000 7feb08dd2700 1 -- 172.21.15.49:0/3354921495 shutdown_connections 2023-11-30T18:41:25.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.188+0000 7feb08dd2700 1 -- 172.21.15.49:0/3354921495 >> 172.21.15.49:0/3354921495 conn(0x7feb040cb000 msgr2=0x7feb040cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:25.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.188+0000 7feb08dd2700 1 -- 172.21.15.49:0/3354921495 shutdown_connections 2023-11-30T18:41:25.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.188+0000 7feb08dd2700 1 -- 172.21.15.49:0/3354921495 wait complete. 2023-11-30T18:41:25.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.189+0000 7feb08dd2700 1 Processor -- start 2023-11-30T18:41:25.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.190+0000 7feb08dd2700 1 -- start start 2023-11-30T18:41:25.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.190+0000 7feb08dd2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feaec0038e0 0x7feb041567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:25.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.190+0000 7feb08dd2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb041552e0 0x7feb04150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:25.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.190+0000 7feb08dd2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb040c28c0 0x7feb040c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:25.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.190+0000 7feb08dd2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb04156cd0 con 0x7feb040c28c0 2023-11-30T18:41:25.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.190+0000 7feb08dd2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb04156350 con 0x7feaec0038e0 2023-11-30T18:41:25.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.190+0000 7feb08dd2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb04150a10 con 0x7feb041552e0 2023-11-30T18:41:25.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.190+0000 7feb03fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb040c28c0 0x7feb040c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:25.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.190+0000 7feb03fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb040c28c0 0x7feb040c9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43716/0 (socket says 172.21.15.49:43716) 2023-11-30T18:41:25.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.190+0000 7feb03fff700 1 -- 172.21.15.49:0/217440645 learned_addr learned my addr 172.21.15.49:0/217440645 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:25.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.191+0000 7feb02ffd700 1 --2- 172.21.15.49:0/217440645 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb041552e0 0x7feb04150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:25.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.191+0000 7feb037fe700 1 --2- 172.21.15.49:0/217440645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feaec0038e0 0x7feb041567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:25.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.191+0000 7feb03fff700 1 -- 172.21.15.49:0/217440645 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb041552e0 msgr2=0x7feb04150520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.191+0000 7feb03fff700 1 --2- 172.21.15.49:0/217440645 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb041552e0 0x7feb04150520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.191+0000 7feb03fff700 1 -- 172.21.15.49:0/217440645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feaec0038e0 msgr2=0x7feb041567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.191+0000 7feb03fff700 1 --2- 172.21.15.49:0/217440645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feaec0038e0 0x7feb041567e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.191+0000 7feb03fff700 1 -- 172.21.15.49:0/217440645 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb04155760 con 0x7feb040c28c0 2023-11-30T18:41:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.191+0000 7feb037fe700 1 --2- 172.21.15.49:0/217440645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feaec0038e0 0x7feb041567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:41:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.191+0000 7feb03fff700 1 --2- 172.21.15.49:0/217440645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb040c28c0 0x7feb040c9320 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 rx=0x7feb040cbeb0 tx=0x7feafc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.191+0000 7feaeb7fe700 1 -- 172.21.15.49:0/217440645 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc00e040 con 0x7feb040c28c0 2023-11-30T18:41:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.191+0000 7feaeb7fe700 1 -- 172.21.15.49:0/217440645 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feafc00f040 con 0x7feb040c28c0 2023-11-30T18:41:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.191+0000 7feb08dd2700 1 -- 172.21.15.49:0/217440645 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb04155a20 con 0x7feb040c28c0 2023-11-30T18:41:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.191+0000 7feaeb7fe700 1 -- 172.21.15.49:0/217440645 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc00fdc0 con 0x7feb040c28c0 2023-11-30T18:41:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.191+0000 7feb08dd2700 1 -- 172.21.15.49:0/217440645 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb04155fe0 con 0x7feb040c28c0 2023-11-30T18:41:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.192+0000 7feb08dd2700 1 -- 172.21.15.49:0/217440645 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb0406c7c0 con 0x7feb040c28c0 2023-11-30T18:41:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.192+0000 7feaeb7fe700 1 -- 172.21.15.49:0/217440645 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7feafc015660 con 0x7feb040c28c0 2023-11-30T18:41:25.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.193+0000 7feaeb7fe700 1 --2- 172.21.15.49:0/217440645 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7feaf005f270 0x7feaf0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:25.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.193+0000 7feaeb7fe700 1 -- 172.21.15.49:0/217440645 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(219..219 src has 1..219) v4 ==== 6233+0+0 (secure 0 0 0) 0x7feafc07af70 con 0x7feb040c28c0 2023-11-30T18:41:25.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.193+0000 7feb037fe700 1 --2- 172.21.15.49:0/217440645 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7feaf005f270 0x7feaf0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:25.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.193+0000 7feb037fe700 1 --2- 172.21.15.49:0/217440645 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7feaf005f270 0x7feaf0061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7feaf4001ed0 tx=0x7feaf4015000).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:25.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.197+0000 7feaeb7fe700 1 -- 172.21.15.49:0/217440645 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7feafc0a9b00 con 0x7feb040c28c0 2023-11-30T18:41:25.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.366+0000 7feb08dd2700 1 -- 172.21.15.49:0/217440645 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feb04156490 con 0x7feaf005f270 2023-11-30T18:41:25.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.378+0000 7feaeb7fe700 1 -- 172.21.15.49:0/217440645 <== mgr.8096 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361790 (secure 0 0 0) 0x7feb04156490 con 0x7feaf005f270 2023-11-30T18:41:25.383 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:25.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.382+0000 7feb08dd2700 1 -- 172.21.15.49:0/217440645 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7feaf005f270 msgr2=0x7feaf0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:25.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.382+0000 7feb08dd2700 1 --2- 172.21.15.49:0/217440645 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7feaf005f270 0x7feaf0061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7feaf4001ed0 tx=0x7feaf4015000).stop 2023-11-30T18:41:25.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.382+0000 7feb08dd2700 1 -- 172.21.15.49:0/217440645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb040c28c0 msgr2=0x7feb040c9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:25.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.382+0000 7feb08dd2700 1 --2- 172.21.15.49:0/217440645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb040c28c0 0x7feb040c9320 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 rx=0x7feb040cbeb0 tx=0x7feafc00b040).stop 2023-11-30T18:41:25.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.382+0000 7feb08dd2700 1 -- 172.21.15.49:0/217440645 shutdown_connections 2023-11-30T18:41:25.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.382+0000 7feb08dd2700 1 --2- 172.21.15.49:0/217440645 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7feaf005f270 0x7feaf0061730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:25.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.382+0000 7feb08dd2700 1 --2- 172.21.15.49:0/217440645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb040c28c0 0x7feb040c9320 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:25.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.382+0000 7feb08dd2700 1 --2- 172.21.15.49:0/217440645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feaec0038e0 0x7feb041567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:25.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.382+0000 7feb08dd2700 1 --2- 172.21.15.49:0/217440645 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb041552e0 0x7feb04150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:25.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.382+0000 7feb08dd2700 1 -- 172.21.15.49:0/217440645 >> 172.21.15.49:0/217440645 conn(0x7feb040cb000 msgr2=0x7feb040aaee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:25.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.382+0000 7feb08dd2700 1 -- 172.21.15.49:0/217440645 shutdown_connections 2023-11-30T18:41:25.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.382+0000 7feb08dd2700 1 -- 172.21.15.49:0/217440645 wait complete. 2023-11-30T18:41:25.387 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T18:41:25.395 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-30T18:41:24.238879+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":217,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2459808,"kb_used_data":21472,"kb_used_omap":0,"kb_used_meta":2438272,"kb_avail":752514912,"statfs":{"total":773094113280,"available":770575269888,"internally_reserved":0,"allocated":21987328,"data_stored":11287076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2496790528},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-28932,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-81,"num_write_kb":-63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.006727"},"pg_stats":[{"pgid":"26.3c","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382834+0000","last_change":"2023-11-30T18:41:21.374332+0000","last_active":"2023-11-30T18:41:21.382834+0000","last_peered":"2023-11-30T18:41:21.382834+0000","last_clean":"2023-11-30T18:41:21.382834+0000","last_became_active":"2023-11-30T18:41:21.374012+0000","last_became_peered":"2023-11-30T18:41:21.374012+0000","last_unstale":"2023-11-30T18:41:21.382834+0000","last_undegraded":"2023-11-30T18:41:21.382834+0000","last_fullsized":"2023-11-30T18:41:21.382834+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.3f","version":"218'3","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.375825+0000","last_change":"2023-11-30T18:41:20.983040+0000","last_active":"2023-11-30T18:41:21.375825+0000","last_peered":"2023-11-30T18:41:21.375825+0000","last_clean":"2023-11-30T18:41:21.375825+0000","last_became_active":"2023-11-30T18:41:20.982842+0000","last_became_peered":"2023-11-30T18:41:20.982842+0000","last_unstale":"2023-11-30T18:41:21.375825+0000","last_undegraded":"2023-11-30T18:41:21.375825+0000","last_fullsized":"2023-11-30T18:41:21.375825+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.377170+0000","last_change":"2023-11-30T18:41:21.371025+0000","last_active":"2023-11-30T18:41:21.377170+0000","last_peered":"2023-11-30T18:41:21.377170+0000","last_clean":"2023-11-30T18:41:21.377170+0000","last_became_active":"2023-11-30T18:41:21.370691+0000","last_became_peered":"2023-11-30T18:41:21.370691+0000","last_unstale":"2023-11-30T18:41:21.377170+0000","last_undegraded":"2023-11-30T18:41:21.377170+0000","last_fullsized":"2023-11-30T18:41:21.377170+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.357384+0000","last_change":"2023-11-30T18:41:20.979506+0000","last_active":"2023-11-30T18:41:21.357384+0000","last_peered":"2023-11-30T18:41:21.357384+0000","last_clean":"2023-11-30T18:41:21.357384+0000","last_became_active":"2023-11-30T18:41:20.979201+0000","last_became_peered":"2023-11-30T18:41:20.979201+0000","last_unstale":"2023-11-30T18:41:21.357384+0000","last_undegraded":"2023-11-30T18:41:21.357384+0000","last_fullsized":"2023-11-30T18:41:21.357384+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382350+0000","last_change":"2023-11-30T18:41:21.381779+0000","last_active":"2023-11-30T18:41:21.382350+0000","last_peered":"2023-11-30T18:41:21.382350+0000","last_clean":"2023-11-30T18:41:21.382350+0000","last_became_active":"2023-11-30T18:41:21.381414+0000","last_became_peered":"2023-11-30T18:41:21.381414+0000","last_unstale":"2023-11-30T18:41:21.382350+0000","last_undegraded":"2023-11-30T18:41:21.382350+0000","last_fullsized":"2023-11-30T18:41:21.382350+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.361319+0000","last_change":"2023-11-30T18:41:20.986452+0000","last_active":"2023-11-30T18:41:21.361319+0000","last_peered":"2023-11-30T18:41:21.361319+0000","last_clean":"2023-11-30T18:41:21.361319+0000","last_became_active":"2023-11-30T18:41:20.986134+0000","last_became_peered":"2023-11-30T18:41:20.986134+0000","last_unstale":"2023-11-30T18:41:21.361319+0000","last_undegraded":"2023-11-30T18:41:21.361319+0000","last_fullsized":"2023-11-30T18:41:21.361319+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3f","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.379323+0000","last_change":"2023-11-30T18:41:21.373494+0000","last_active":"2023-11-30T18:41:21.379323+0000","last_peered":"2023-11-30T18:41:21.379323+0000","last_clean":"2023-11-30T18:41:21.379323+0000","last_became_active":"2023-11-30T18:41:21.373176+0000","last_became_peered":"2023-11-30T18:41:21.373176+0000","last_unstale":"2023-11-30T18:41:21.379323+0000","last_undegraded":"2023-11-30T18:41:21.379323+0000","last_fullsized":"2023-11-30T18:41:21.379323+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"218'2","reported_seq":12,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.377731+0000","last_change":"2023-11-30T18:41:20.979454+0000","last_active":"2023-11-30T18:41:21.377731+0000","last_peered":"2023-11-30T18:41:21.377731+0000","last_clean":"2023-11-30T18:41:21.377731+0000","last_became_active":"2023-11-30T18:41:20.979178+0000","last_became_peered":"2023-11-30T18:41:20.979178+0000","last_unstale":"2023-11-30T18:41:21.377731+0000","last_undegraded":"2023-11-30T18:41:21.377731+0000","last_fullsized":"2023-11-30T18:41:21.377731+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382709+0000","last_change":"2023-11-30T18:41:21.376814+0000","last_active":"2023-11-30T18:41:21.382709+0000","last_peered":"2023-11-30T18:41:21.382709+0000","last_clean":"2023-11-30T18:41:21.382709+0000","last_became_active":"2023-11-30T18:41:21.376526+0000","last_became_peered":"2023-11-30T18:41:21.376526+0000","last_unstale":"2023-11-30T18:41:21.382709+0000","last_undegraded":"2023-11-30T18:41:21.382709+0000","last_fullsized":"2023-11-30T18:41:21.382709+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3b","version":"218'1","reported_seq":11,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.381165+0000","last_change":"2023-11-30T18:41:20.977633+0000","last_active":"2023-11-30T18:41:21.381165+0000","last_peered":"2023-11-30T18:41:21.381165+0000","last_clean":"2023-11-30T18:41:21.381165+0000","last_became_active":"2023-11-30T18:41:20.977332+0000","last_became_peered":"2023-11-30T18:41:20.977332+0000","last_unstale":"2023-11-30T18:41:21.381165+0000","last_undegraded":"2023-11-30T18:41:21.381165+0000","last_fullsized":"2023-11-30T18:41:21.381165+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.369874+0000","last_change":"2023-11-30T18:41:21.366707+0000","last_active":"2023-11-30T18:41:21.369874+0000","last_peered":"2023-11-30T18:41:21.369874+0000","last_clean":"2023-11-30T18:41:21.369874+0000","last_became_active":"2023-11-30T18:41:21.366073+0000","last_became_peered":"2023-11-30T18:41:21.366073+0000","last_unstale":"2023-11-30T18:41:21.369874+0000","last_undegraded":"2023-11-30T18:41:21.369874+0000","last_fullsized":"2023-11-30T18:41:21.369874+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"218'1","reported_seq":11,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.371850+0000","last_change":"2023-11-30T18:41:20.981829+0000","last_active":"2023-11-30T18:41:21.371850+0000","last_peered":"2023-11-30T18:41:21.371850+0000","last_clean":"2023-11-30T18:41:21.371850+0000","last_became_active":"2023-11-30T18:41:20.981532+0000","last_became_peered":"2023-11-30T18:41:20.981532+0000","last_unstale":"2023-11-30T18:41:21.371850+0000","last_undegraded":"2023-11-30T18:41:21.371850+0000","last_fullsized":"2023-11-30T18:41:21.371850+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.384922+0000","last_change":"2023-11-30T18:41:21.376312+0000","last_active":"2023-11-30T18:41:21.384922+0000","last_peered":"2023-11-30T18:41:21.384922+0000","last_clean":"2023-11-30T18:41:21.384922+0000","last_became_active":"2023-11-30T18:41:21.376010+0000","last_became_peered":"2023-11-30T18:41:21.376010+0000","last_unstale":"2023-11-30T18:41:21.384922+0000","last_undegraded":"2023-11-30T18:41:21.384922+0000","last_fullsized":"2023-11-30T18:41:21.384922+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.364566+0000","last_change":"2023-11-30T18:41:20.984609+0000","last_active":"2023-11-30T18:41:21.364566+0000","last_peered":"2023-11-30T18:41:21.364566+0000","last_clean":"2023-11-30T18:41:21.364566+0000","last_became_active":"2023-11-30T18:41:20.984292+0000","last_became_peered":"2023-11-30T18:41:20.984292+0000","last_unstale":"2023-11-30T18:41:21.364566+0000","last_undegraded":"2023-11-30T18:41:21.364566+0000","last_fullsized":"2023-11-30T18:41:21.364566+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.383628+0000","last_change":"2023-11-30T18:41:21.370543+0000","last_active":"2023-11-30T18:41:21.383628+0000","last_peered":"2023-11-30T18:41:21.383628+0000","last_clean":"2023-11-30T18:41:21.383628+0000","last_became_active":"2023-11-30T18:41:21.369771+0000","last_became_peered":"2023-11-30T18:41:21.369771+0000","last_unstale":"2023-11-30T18:41:21.383628+0000","last_undegraded":"2023-11-30T18:41:21.383628+0000","last_fullsized":"2023-11-30T18:41:21.383628+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.362968+0000","last_change":"2023-11-30T18:41:20.988516+0000","last_active":"2023-11-30T18:41:21.362968+0000","last_peered":"2023-11-30T18:41:21.362968+0000","last_clean":"2023-11-30T18:41:21.362968+0000","last_became_active":"2023-11-30T18:41:20.988216+0000","last_became_peered":"2023-11-30T18:41:20.988216+0000","last_unstale":"2023-11-30T18:41:21.362968+0000","last_undegraded":"2023-11-30T18:41:21.362968+0000","last_fullsized":"2023-11-30T18:41:21.362968+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.375379+0000","last_change":"2023-11-30T18:41:21.366663+0000","last_active":"2023-11-30T18:41:21.375379+0000","last_peered":"2023-11-30T18:41:21.375379+0000","last_clean":"2023-11-30T18:41:21.375379+0000","last_became_active":"2023-11-30T18:41:21.366367+0000","last_became_peered":"2023-11-30T18:41:21.366367+0000","last_unstale":"2023-11-30T18:41:21.375379+0000","last_undegraded":"2023-11-30T18:41:21.375379+0000","last_fullsized":"2023-11-30T18:41:21.375379+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.369624+0000","last_change":"2023-11-30T18:41:20.979376+0000","last_active":"2023-11-30T18:41:21.369624+0000","last_peered":"2023-11-30T18:41:21.369624+0000","last_clean":"2023-11-30T18:41:21.369624+0000","last_became_active":"2023-11-30T18:41:20.979079+0000","last_became_peered":"2023-11-30T18:41:20.979079+0000","last_unstale":"2023-11-30T18:41:21.369624+0000","last_undegraded":"2023-11-30T18:41:21.369624+0000","last_fullsized":"2023-11-30T18:41:21.369624+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382919+0000","last_change":"2023-11-30T18:41:21.378398+0000","last_active":"2023-11-30T18:41:21.382919+0000","last_peered":"2023-11-30T18:41:21.382919+0000","last_clean":"2023-11-30T18:41:21.382919+0000","last_became_active":"2023-11-30T18:41:21.378087+0000","last_became_peered":"2023-11-30T18:41:21.378087+0000","last_unstale":"2023-11-30T18:41:21.382919+0000","last_undegraded":"2023-11-30T18:41:21.382919+0000","last_fullsized":"2023-11-30T18:41:21.382919+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.358532+0000","last_change":"2023-11-30T18:41:20.979619+0000","last_active":"2023-11-30T18:41:21.358532+0000","last_peered":"2023-11-30T18:41:21.358532+0000","last_clean":"2023-11-30T18:41:21.358532+0000","last_became_active":"2023-11-30T18:41:20.979335+0000","last_became_peered":"2023-11-30T18:41:20.979335+0000","last_unstale":"2023-11-30T18:41:21.358532+0000","last_undegraded":"2023-11-30T18:41:21.358532+0000","last_fullsized":"2023-11-30T18:41:21.358532+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.385019+0000","last_change":"2023-11-30T18:41:21.377885+0000","last_active":"2023-11-30T18:41:21.385019+0000","last_peered":"2023-11-30T18:41:21.385019+0000","last_clean":"2023-11-30T18:41:21.385019+0000","last_became_active":"2023-11-30T18:41:21.377291+0000","last_became_peered":"2023-11-30T18:41:21.377291+0000","last_unstale":"2023-11-30T18:41:21.385019+0000","last_undegraded":"2023-11-30T18:41:21.385019+0000","last_fullsized":"2023-11-30T18:41:21.385019+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.366867+0000","last_change":"2023-11-30T18:41:20.984959+0000","last_active":"2023-11-30T18:41:21.366867+0000","last_peered":"2023-11-30T18:41:21.366867+0000","last_clean":"2023-11-30T18:41:21.366867+0000","last_became_active":"2023-11-30T18:41:20.984741+0000","last_became_peered":"2023-11-30T18:41:20.984741+0000","last_unstale":"2023-11-30T18:41:21.366867+0000","last_undegraded":"2023-11-30T18:41:21.366867+0000","last_fullsized":"2023-11-30T18:41:21.366867+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.380926+0000","last_change":"2023-11-30T18:41:21.379212+0000","last_active":"2023-11-30T18:41:21.380926+0000","last_peered":"2023-11-30T18:41:21.380926+0000","last_clean":"2023-11-30T18:41:21.380926+0000","last_became_active":"2023-11-30T18:41:21.378946+0000","last_became_peered":"2023-11-30T18:41:21.378946+0000","last_unstale":"2023-11-30T18:41:21.380926+0000","last_undegraded":"2023-11-30T18:41:21.380926+0000","last_fullsized":"2023-11-30T18:41:21.380926+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.34","version":"218'4","reported_seq":14,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.385176+0000","last_change":"2023-11-30T18:41:20.977031+0000","last_active":"2023-11-30T18:41:21.385176+0000","last_peered":"2023-11-30T18:41:21.385176+0000","last_clean":"2023-11-30T18:41:21.385176+0000","last_became_active":"2023-11-30T18:41:20.976716+0000","last_became_peered":"2023-11-30T18:41:20.976716+0000","last_unstale":"2023-11-30T18:41:21.385176+0000","last_undegraded":"2023-11-30T18:41:21.385176+0000","last_fullsized":"2023-11-30T18:41:21.385176+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.384818+0000","last_change":"2023-11-30T18:41:21.378135+0000","last_active":"2023-11-30T18:41:21.384818+0000","last_peered":"2023-11-30T18:41:21.384818+0000","last_clean":"2023-11-30T18:41:21.384818+0000","last_became_active":"2023-11-30T18:41:21.377709+0000","last_became_peered":"2023-11-30T18:41:21.377709+0000","last_unstale":"2023-11-30T18:41:21.384818+0000","last_undegraded":"2023-11-30T18:41:21.384818+0000","last_fullsized":"2023-11-30T18:41:21.384818+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.33","version":"218'1","reported_seq":11,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.380824+0000","last_change":"2023-11-30T18:41:20.985654+0000","last_active":"2023-11-30T18:41:21.380824+0000","last_peered":"2023-11-30T18:41:21.380824+0000","last_clean":"2023-11-30T18:41:21.380824+0000","last_became_active":"2023-11-30T18:41:20.985412+0000","last_became_peered":"2023-11-30T18:41:20.985412+0000","last_unstale":"2023-11-30T18:41:21.380824+0000","last_undegraded":"2023-11-30T18:41:21.380824+0000","last_fullsized":"2023-11-30T18:41:21.380824+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.378751+0000","last_change":"2023-11-30T18:41:21.376374+0000","last_active":"2023-11-30T18:41:21.378751+0000","last_peered":"2023-11-30T18:41:21.378751+0000","last_clean":"2023-11-30T18:41:21.378751+0000","last_became_active":"2023-11-30T18:41:21.376100+0000","last_became_peered":"2023-11-30T18:41:21.376100+0000","last_unstale":"2023-11-30T18:41:21.378751+0000","last_undegraded":"2023-11-30T18:41:21.378751+0000","last_fullsized":"2023-11-30T18:41:21.378751+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.368304+0000","last_change":"2023-11-30T18:41:20.980132+0000","last_active":"2023-11-30T18:41:21.368304+0000","last_peered":"2023-11-30T18:41:21.368304+0000","last_clean":"2023-11-30T18:41:21.368304+0000","last_became_active":"2023-11-30T18:41:20.979834+0000","last_became_peered":"2023-11-30T18:41:20.979834+0000","last_unstale":"2023-11-30T18:41:21.368304+0000","last_undegraded":"2023-11-30T18:41:21.368304+0000","last_fullsized":"2023-11-30T18:41:21.368304+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.370929+0000","last_change":"2023-11-30T18:41:21.370346+0000","last_active":"2023-11-30T18:41:21.370929+0000","last_peered":"2023-11-30T18:41:21.370929+0000","last_clean":"2023-11-30T18:41:21.370929+0000","last_became_active":"2023-11-30T18:41:21.370136+0000","last_became_peered":"2023-11-30T18:41:21.370136+0000","last_unstale":"2023-11-30T18:41:21.370929+0000","last_undegraded":"2023-11-30T18:41:21.370929+0000","last_fullsized":"2023-11-30T18:41:21.370929+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.357015+0000","last_change":"2023-11-30T18:41:20.976814+0000","last_active":"2023-11-30T18:41:21.357015+0000","last_peered":"2023-11-30T18:41:21.357015+0000","last_clean":"2023-11-30T18:41:21.357015+0000","last_became_active":"2023-11-30T18:41:20.976503+0000","last_became_peered":"2023-11-30T18:41:20.976503+0000","last_unstale":"2023-11-30T18:41:21.357015+0000","last_undegraded":"2023-11-30T18:41:21.357015+0000","last_fullsized":"2023-11-30T18:41:21.357015+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382434+0000","last_change":"2023-11-30T18:41:21.377940+0000","last_active":"2023-11-30T18:41:21.382434+0000","last_peered":"2023-11-30T18:41:21.382434+0000","last_clean":"2023-11-30T18:41:21.382434+0000","last_became_active":"2023-11-30T18:41:21.377335+0000","last_became_peered":"2023-11-30T18:41:21.377335+0000","last_unstale":"2023-11-30T18:41:21.382434+0000","last_undegraded":"2023-11-30T18:41:21.382434+0000","last_fullsized":"2023-11-30T18:41:21.382434+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.30","version":"218'4","reported_seq":14,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.384748+0000","last_change":"2023-11-30T18:41:20.979102+0000","last_active":"2023-11-30T18:41:21.384748+0000","last_peered":"2023-11-30T18:41:21.384748+0000","last_clean":"2023-11-30T18:41:21.384748+0000","last_became_active":"2023-11-30T18:41:20.978385+0000","last_became_peered":"2023-11-30T18:41:20.978385+0000","last_unstale":"2023-11-30T18:41:21.384748+0000","last_undegraded":"2023-11-30T18:41:21.384748+0000","last_fullsized":"2023-11-30T18:41:21.384748+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.384968+0000","last_change":"2023-11-30T18:41:21.379816+0000","last_active":"2023-11-30T18:41:21.384968+0000","last_peered":"2023-11-30T18:41:21.384968+0000","last_clean":"2023-11-30T18:41:21.384968+0000","last_became_active":"2023-11-30T18:41:21.379513+0000","last_became_peered":"2023-11-30T18:41:21.379513+0000","last_unstale":"2023-11-30T18:41:21.384968+0000","last_undegraded":"2023-11-30T18:41:21.384968+0000","last_fullsized":"2023-11-30T18:41:21.384968+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.357036+0000","last_change":"2023-11-30T18:41:20.975583+0000","last_active":"2023-11-30T18:41:21.357036+0000","last_peered":"2023-11-30T18:41:21.357036+0000","last_clean":"2023-11-30T18:41:21.357036+0000","last_became_active":"2023-11-30T18:41:20.974358+0000","last_became_peered":"2023-11-30T18:41:20.974358+0000","last_unstale":"2023-11-30T18:41:21.357036+0000","last_undegraded":"2023-11-30T18:41:21.357036+0000","last_fullsized":"2023-11-30T18:41:21.357036+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.377605+0000","last_change":"2023-11-30T18:41:21.374080+0000","last_active":"2023-11-30T18:41:21.377605+0000","last_peered":"2023-11-30T18:41:21.377605+0000","last_clean":"2023-11-30T18:41:21.377605+0000","last_became_active":"2023-11-30T18:41:21.372562+0000","last_became_peered":"2023-11-30T18:41:21.372562+0000","last_unstale":"2023-11-30T18:41:21.377605+0000","last_undegraded":"2023-11-30T18:41:21.377605+0000","last_fullsized":"2023-11-30T18:41:21.377605+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.363152+0000","last_change":"2023-11-30T18:41:20.979600+0000","last_active":"2023-11-30T18:41:21.363152+0000","last_peered":"2023-11-30T18:41:21.363152+0000","last_clean":"2023-11-30T18:41:21.363152+0000","last_became_active":"2023-11-30T18:41:20.979305+0000","last_became_peered":"2023-11-30T18:41:20.979305+0000","last_unstale":"2023-11-30T18:41:21.363152+0000","last_undegraded":"2023-11-30T18:41:21.363152+0000","last_fullsized":"2023-11-30T18:41:21.363152+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.377913+0000","last_change":"2023-11-30T18:41:21.372885+0000","last_active":"2023-11-30T18:41:21.377913+0000","last_peered":"2023-11-30T18:41:21.377913+0000","last_clean":"2023-11-30T18:41:21.377913+0000","last_became_active":"2023-11-30T18:41:21.372530+0000","last_became_peered":"2023-11-30T18:41:21.372530+0000","last_unstale":"2023-11-30T18:41:21.377913+0000","last_undegraded":"2023-11-30T18:41:21.377913+0000","last_fullsized":"2023-11-30T18:41:21.377913+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2d","version":"218'1","reported_seq":11,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382630+0000","last_change":"2023-11-30T18:41:20.981381+0000","last_active":"2023-11-30T18:41:21.382630+0000","last_peered":"2023-11-30T18:41:21.382630+0000","last_clean":"2023-11-30T18:41:21.382630+0000","last_became_active":"2023-11-30T18:41:20.980805+0000","last_became_peered":"2023-11-30T18:41:20.980805+0000","last_unstale":"2023-11-30T18:41:21.382630+0000","last_undegraded":"2023-11-30T18:41:21.382630+0000","last_fullsized":"2023-11-30T18:41:21.382630+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.385037+0000","last_change":"2023-11-30T18:41:21.383228+0000","last_active":"2023-11-30T18:41:21.385037+0000","last_peered":"2023-11-30T18:41:21.385037+0000","last_clean":"2023-11-30T18:41:21.385037+0000","last_became_active":"2023-11-30T18:41:21.382982+0000","last_became_peered":"2023-11-30T18:41:21.382982+0000","last_unstale":"2023-11-30T18:41:21.385037+0000","last_undegraded":"2023-11-30T18:41:21.385037+0000","last_fullsized":"2023-11-30T18:41:21.385037+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.357452+0000","last_change":"2023-11-30T18:41:20.976097+0000","last_active":"2023-11-30T18:41:21.357452+0000","last_peered":"2023-11-30T18:41:21.357452+0000","last_clean":"2023-11-30T18:41:21.357452+0000","last_became_active":"2023-11-30T18:41:20.975833+0000","last_became_peered":"2023-11-30T18:41:20.975833+0000","last_unstale":"2023-11-30T18:41:21.357452+0000","last_undegraded":"2023-11-30T18:41:21.357452+0000","last_fullsized":"2023-11-30T18:41:21.357452+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.373439+0000","last_change":"2023-11-30T18:41:21.370277+0000","last_active":"2023-11-30T18:41:21.373439+0000","last_peered":"2023-11-30T18:41:21.373439+0000","last_clean":"2023-11-30T18:41:21.373439+0000","last_became_active":"2023-11-30T18:41:21.369969+0000","last_became_peered":"2023-11-30T18:41:21.369969+0000","last_unstale":"2023-11-30T18:41:21.373439+0000","last_undegraded":"2023-11-30T18:41:21.373439+0000","last_fullsized":"2023-11-30T18:41:21.373439+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.2b","version":"218'1","reported_seq":11,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.381298+0000","last_change":"2023-11-30T18:41:20.977671+0000","last_active":"2023-11-30T18:41:21.381298+0000","last_peered":"2023-11-30T18:41:21.381298+0000","last_clean":"2023-11-30T18:41:21.381298+0000","last_became_active":"2023-11-30T18:41:20.977316+0000","last_became_peered":"2023-11-30T18:41:20.977316+0000","last_unstale":"2023-11-30T18:41:21.381298+0000","last_undegraded":"2023-11-30T18:41:21.381298+0000","last_fullsized":"2023-11-30T18:41:21.381298+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382273+0000","last_change":"2023-11-30T18:41:21.375934+0000","last_active":"2023-11-30T18:41:21.382273+0000","last_peered":"2023-11-30T18:41:21.382273+0000","last_clean":"2023-11-30T18:41:21.382273+0000","last_became_active":"2023-11-30T18:41:21.375609+0000","last_became_peered":"2023-11-30T18:41:21.375609+0000","last_unstale":"2023-11-30T18:41:21.382273+0000","last_undegraded":"2023-11-30T18:41:21.382273+0000","last_fullsized":"2023-11-30T18:41:21.382273+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.359169+0000","last_change":"2023-11-30T18:41:20.981771+0000","last_active":"2023-11-30T18:41:21.359169+0000","last_peered":"2023-11-30T18:41:21.359169+0000","last_clean":"2023-11-30T18:41:21.359169+0000","last_became_active":"2023-11-30T18:41:20.981177+0000","last_became_peered":"2023-11-30T18:41:20.981177+0000","last_unstale":"2023-11-30T18:41:21.359169+0000","last_undegraded":"2023-11-30T18:41:21.359169+0000","last_fullsized":"2023-11-30T18:41:21.359169+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.379151+0000","last_change":"2023-11-30T18:41:21.377531+0000","last_active":"2023-11-30T18:41:21.379151+0000","last_peered":"2023-11-30T18:41:21.379151+0000","last_clean":"2023-11-30T18:41:21.379151+0000","last_became_active":"2023-11-30T18:41:21.377268+0000","last_became_peered":"2023-11-30T18:41:21.377268+0000","last_unstale":"2023-11-30T18:41:21.379151+0000","last_undegraded":"2023-11-30T18:41:21.379151+0000","last_fullsized":"2023-11-30T18:41:21.379151+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.359633+0000","last_change":"2023-11-30T18:41:20.986392+0000","last_active":"2023-11-30T18:41:21.359633+0000","last_peered":"2023-11-30T18:41:21.359633+0000","last_clean":"2023-11-30T18:41:21.359633+0000","last_became_active":"2023-11-30T18:41:20.986009+0000","last_became_peered":"2023-11-30T18:41:20.986009+0000","last_unstale":"2023-11-30T18:41:21.359633+0000","last_undegraded":"2023-11-30T18:41:21.359633+0000","last_fullsized":"2023-11-30T18:41:21.359633+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.379393+0000","last_change":"2023-11-30T18:41:21.377394+0000","last_active":"2023-11-30T18:41:21.379393+0000","last_peered":"2023-11-30T18:41:21.379393+0000","last_clean":"2023-11-30T18:41:21.379393+0000","last_became_active":"2023-11-30T18:41:21.377096+0000","last_became_peered":"2023-11-30T18:41:21.377096+0000","last_unstale":"2023-11-30T18:41:21.379393+0000","last_undegraded":"2023-11-30T18:41:21.379393+0000","last_fullsized":"2023-11-30T18:41:21.379393+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.363165+0000","last_change":"2023-11-30T18:41:20.981154+0000","last_active":"2023-11-30T18:41:21.363165+0000","last_peered":"2023-11-30T18:41:21.363165+0000","last_clean":"2023-11-30T18:41:21.363165+0000","last_became_active":"2023-11-30T18:41:20.980204+0000","last_became_peered":"2023-11-30T18:41:20.980204+0000","last_unstale":"2023-11-30T18:41:21.363165+0000","last_undegraded":"2023-11-30T18:41:21.363165+0000","last_fullsized":"2023-11-30T18:41:21.363165+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.384471+0000","last_change":"2023-11-30T18:41:21.372972+0000","last_active":"2023-11-30T18:41:21.384471+0000","last_peered":"2023-11-30T18:41:21.384471+0000","last_clean":"2023-11-30T18:41:21.384471+0000","last_became_active":"2023-11-30T18:41:21.372693+0000","last_became_peered":"2023-11-30T18:41:21.372693+0000","last_unstale":"2023-11-30T18:41:21.384471+0000","last_undegraded":"2023-11-30T18:41:21.384471+0000","last_fullsized":"2023-11-30T18:41:21.384471+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.357296+0000","last_change":"2023-11-30T18:41:20.981094+0000","last_active":"2023-11-30T18:41:21.357296+0000","last_peered":"2023-11-30T18:41:21.357296+0000","last_clean":"2023-11-30T18:41:21.357296+0000","last_became_active":"2023-11-30T18:41:20.980805+0000","last_became_peered":"2023-11-30T18:41:20.980805+0000","last_unstale":"2023-11-30T18:41:21.357296+0000","last_undegraded":"2023-11-30T18:41:21.357296+0000","last_fullsized":"2023-11-30T18:41:21.357296+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.375197+0000","last_change":"2023-11-30T18:41:21.372047+0000","last_active":"2023-11-30T18:41:21.375197+0000","last_peered":"2023-11-30T18:41:21.375197+0000","last_clean":"2023-11-30T18:41:21.375197+0000","last_became_active":"2023-11-30T18:41:21.371733+0000","last_became_peered":"2023-11-30T18:41:21.371733+0000","last_unstale":"2023-11-30T18:41:21.375197+0000","last_undegraded":"2023-11-30T18:41:21.375197+0000","last_fullsized":"2023-11-30T18:41:21.375197+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.367426+0000","last_change":"2023-11-30T18:41:20.984398+0000","last_active":"2023-11-30T18:41:21.367426+0000","last_peered":"2023-11-30T18:41:21.367426+0000","last_clean":"2023-11-30T18:41:21.367426+0000","last_became_active":"2023-11-30T18:41:20.984070+0000","last_became_peered":"2023-11-30T18:41:20.984070+0000","last_unstale":"2023-11-30T18:41:21.367426+0000","last_undegraded":"2023-11-30T18:41:21.367426+0000","last_fullsized":"2023-11-30T18:41:21.367426+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.383031+0000","last_change":"2023-11-30T18:41:21.378248+0000","last_active":"2023-11-30T18:41:21.383031+0000","last_peered":"2023-11-30T18:41:21.383031+0000","last_clean":"2023-11-30T18:41:21.383031+0000","last_became_active":"2023-11-30T18:41:21.375027+0000","last_became_peered":"2023-11-30T18:41:21.375027+0000","last_unstale":"2023-11-30T18:41:21.383031+0000","last_undegraded":"2023-11-30T18:41:21.383031+0000","last_fullsized":"2023-11-30T18:41:21.383031+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.361305+0000","last_change":"2023-11-30T18:41:20.981919+0000","last_active":"2023-11-30T18:41:21.361305+0000","last_peered":"2023-11-30T18:41:21.361305+0000","last_clean":"2023-11-30T18:41:21.361305+0000","last_became_active":"2023-11-30T18:41:20.981631+0000","last_became_peered":"2023-11-30T18:41:20.981631+0000","last_unstale":"2023-11-30T18:41:21.361305+0000","last_undegraded":"2023-11-30T18:41:21.361305+0000","last_fullsized":"2023-11-30T18:41:21.361305+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.380933+0000","last_change":"2023-11-30T18:41:21.377985+0000","last_active":"2023-11-30T18:41:21.380933+0000","last_peered":"2023-11-30T18:41:21.380933+0000","last_clean":"2023-11-30T18:41:21.380933+0000","last_became_active":"2023-11-30T18:41:21.377674+0000","last_became_peered":"2023-11-30T18:41:21.377674+0000","last_unstale":"2023-11-30T18:41:21.380933+0000","last_undegraded":"2023-11-30T18:41:21.380933+0000","last_fullsized":"2023-11-30T18:41:21.380933+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.357587+0000","last_change":"2023-11-30T18:41:20.987050+0000","last_active":"2023-11-30T18:41:21.357587+0000","last_peered":"2023-11-30T18:41:21.357587+0000","last_clean":"2023-11-30T18:41:21.357587+0000","last_became_active":"2023-11-30T18:41:20.986681+0000","last_became_peered":"2023-11-30T18:41:20.986681+0000","last_unstale":"2023-11-30T18:41:21.357587+0000","last_undegraded":"2023-11-30T18:41:21.357587+0000","last_fullsized":"2023-11-30T18:41:21.357587+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.384805+0000","last_change":"2023-11-30T18:41:21.374050+0000","last_active":"2023-11-30T18:41:21.384805+0000","last_peered":"2023-11-30T18:41:21.384805+0000","last_clean":"2023-11-30T18:41:21.384805+0000","last_became_active":"2023-11-30T18:41:21.373769+0000","last_became_peered":"2023-11-30T18:41:21.373769+0000","last_unstale":"2023-11-30T18:41:21.384805+0000","last_undegraded":"2023-11-30T18:41:21.384805+0000","last_fullsized":"2023-11-30T18:41:21.384805+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.357449+0000","last_change":"2023-11-30T18:41:20.974292+0000","last_active":"2023-11-30T18:41:21.357449+0000","last_peered":"2023-11-30T18:41:21.357449+0000","last_clean":"2023-11-30T18:41:21.357449+0000","last_became_active":"2023-11-30T18:41:20.973996+0000","last_became_peered":"2023-11-30T18:41:20.973996+0000","last_unstale":"2023-11-30T18:41:21.357449+0000","last_undegraded":"2023-11-30T18:41:21.357449+0000","last_fullsized":"2023-11-30T18:41:21.357449+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.369893+0000","last_change":"2023-11-30T18:41:21.366876+0000","last_active":"2023-11-30T18:41:21.369893+0000","last_peered":"2023-11-30T18:41:21.369893+0000","last_clean":"2023-11-30T18:41:21.369893+0000","last_became_active":"2023-11-30T18:41:21.366432+0000","last_became_peered":"2023-11-30T18:41:21.366432+0000","last_unstale":"2023-11-30T18:41:21.369893+0000","last_undegraded":"2023-11-30T18:41:21.369893+0000","last_fullsized":"2023-11-30T18:41:21.369893+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.368417+0000","last_change":"2023-11-30T18:41:20.982138+0000","last_active":"2023-11-30T18:41:21.368417+0000","last_peered":"2023-11-30T18:41:21.368417+0000","last_clean":"2023-11-30T18:41:21.368417+0000","last_became_active":"2023-11-30T18:41:20.980457+0000","last_became_peered":"2023-11-30T18:41:20.980457+0000","last_unstale":"2023-11-30T18:41:21.368417+0000","last_undegraded":"2023-11-30T18:41:21.368417+0000","last_fullsized":"2023-11-30T18:41:21.368417+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382561+0000","last_change":"2023-11-30T18:41:21.374060+0000","last_active":"2023-11-30T18:41:21.382561+0000","last_peered":"2023-11-30T18:41:21.382561+0000","last_clean":"2023-11-30T18:41:21.382561+0000","last_became_active":"2023-11-30T18:41:21.373792+0000","last_became_peered":"2023-11-30T18:41:21.373792+0000","last_unstale":"2023-11-30T18:41:21.382561+0000","last_undegraded":"2023-11-30T18:41:21.382561+0000","last_fullsized":"2023-11-30T18:41:21.382561+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.359530+0000","last_change":"2023-11-30T18:41:20.989922+0000","last_active":"2023-11-30T18:41:21.359530+0000","last_peered":"2023-11-30T18:41:21.359530+0000","last_clean":"2023-11-30T18:41:21.359530+0000","last_became_active":"2023-11-30T18:41:20.989651+0000","last_became_peered":"2023-11-30T18:41:20.989651+0000","last_unstale":"2023-11-30T18:41:21.359530+0000","last_undegraded":"2023-11-30T18:41:21.359530+0000","last_fullsized":"2023-11-30T18:41:21.359530+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382759+0000","last_change":"2023-11-30T18:41:21.374454+0000","last_active":"2023-11-30T18:41:21.382759+0000","last_peered":"2023-11-30T18:41:21.382759+0000","last_clean":"2023-11-30T18:41:21.382759+0000","last_became_active":"2023-11-30T18:41:21.374188+0000","last_became_peered":"2023-11-30T18:41:21.374188+0000","last_unstale":"2023-11-30T18:41:21.382759+0000","last_undegraded":"2023-11-30T18:41:21.382759+0000","last_fullsized":"2023-11-30T18:41:21.382759+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.355161+0000","last_change":"2023-11-30T18:41:20.985764+0000","last_active":"2023-11-30T18:41:21.355161+0000","last_peered":"2023-11-30T18:41:21.355161+0000","last_clean":"2023-11-30T18:41:21.355161+0000","last_became_active":"2023-11-30T18:41:20.985447+0000","last_became_peered":"2023-11-30T18:41:20.985447+0000","last_unstale":"2023-11-30T18:41:21.355161+0000","last_undegraded":"2023-11-30T18:41:21.355161+0000","last_fullsized":"2023-11-30T18:41:21.355161+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.383100+0000","last_change":"2023-11-30T18:41:21.378091+0000","last_active":"2023-11-30T18:41:21.383100+0000","last_peered":"2023-11-30T18:41:21.383100+0000","last_clean":"2023-11-30T18:41:21.383100+0000","last_became_active":"2023-11-30T18:41:21.377782+0000","last_became_peered":"2023-11-30T18:41:21.377782+0000","last_unstale":"2023-11-30T18:41:21.383100+0000","last_undegraded":"2023-11-30T18:41:21.383100+0000","last_fullsized":"2023-11-30T18:41:21.383100+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.367096+0000","last_change":"2023-11-30T18:41:20.978712+0000","last_active":"2023-11-30T18:41:21.367096+0000","last_peered":"2023-11-30T18:41:21.367096+0000","last_clean":"2023-11-30T18:41:21.367096+0000","last_became_active":"2023-11-30T18:41:20.977951+0000","last_became_peered":"2023-11-30T18:41:20.977951+0000","last_unstale":"2023-11-30T18:41:21.367096+0000","last_undegraded":"2023-11-30T18:41:21.367096+0000","last_fullsized":"2023-11-30T18:41:21.367096+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.384628+0000","last_change":"2023-11-30T18:41:21.375397+0000","last_active":"2023-11-30T18:41:21.384628+0000","last_peered":"2023-11-30T18:41:21.384628+0000","last_clean":"2023-11-30T18:41:21.384628+0000","last_became_active":"2023-11-30T18:41:21.374975+0000","last_became_peered":"2023-11-30T18:41:21.374975+0000","last_unstale":"2023-11-30T18:41:21.384628+0000","last_undegraded":"2023-11-30T18:41:21.384628+0000","last_fullsized":"2023-11-30T18:41:21.384628+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.362778+0000","last_change":"2023-11-30T18:41:20.986258+0000","last_active":"2023-11-30T18:41:21.362778+0000","last_peered":"2023-11-30T18:41:21.362778+0000","last_clean":"2023-11-30T18:41:21.362778+0000","last_became_active":"2023-11-30T18:41:20.985545+0000","last_became_peered":"2023-11-30T18:41:20.985545+0000","last_unstale":"2023-11-30T18:41:21.362778+0000","last_undegraded":"2023-11-30T18:41:21.362778+0000","last_fullsized":"2023-11-30T18:41:21.362778+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.379702+0000","last_change":"2023-11-30T18:41:21.374628+0000","last_active":"2023-11-30T18:41:21.379702+0000","last_peered":"2023-11-30T18:41:21.379702+0000","last_clean":"2023-11-30T18:41:21.379702+0000","last_became_active":"2023-11-30T18:41:21.374320+0000","last_became_peered":"2023-11-30T18:41:21.374320+0000","last_unstale":"2023-11-30T18:41:21.379702+0000","last_undegraded":"2023-11-30T18:41:21.379702+0000","last_fullsized":"2023-11-30T18:41:21.379702+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"218'3","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.385463+0000","last_change":"2023-11-30T18:41:20.981899+0000","last_active":"2023-11-30T18:41:21.385463+0000","last_peered":"2023-11-30T18:41:21.385463+0000","last_clean":"2023-11-30T18:41:21.385463+0000","last_became_active":"2023-11-30T18:41:20.981631+0000","last_became_peered":"2023-11-30T18:41:20.981631+0000","last_unstale":"2023-11-30T18:41:21.385463+0000","last_undegraded":"2023-11-30T18:41:21.385463+0000","last_fullsized":"2023-11-30T18:41:21.385463+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382359+0000","last_change":"2023-11-30T18:41:21.381831+0000","last_active":"2023-11-30T18:41:21.382359+0000","last_peered":"2023-11-30T18:41:21.382359+0000","last_clean":"2023-11-30T18:41:21.382359+0000","last_became_active":"2023-11-30T18:41:21.381506+0000","last_became_peered":"2023-11-30T18:41:21.381506+0000","last_unstale":"2023-11-30T18:41:21.382359+0000","last_undegraded":"2023-11-30T18:41:21.382359+0000","last_fullsized":"2023-11-30T18:41:21.382359+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"218'2","reported_seq":12,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.381562+0000","last_change":"2023-11-30T18:41:20.986353+0000","last_active":"2023-11-30T18:41:21.381562+0000","last_peered":"2023-11-30T18:41:21.381562+0000","last_clean":"2023-11-30T18:41:21.381562+0000","last_became_active":"2023-11-30T18:41:20.986070+0000","last_became_peered":"2023-11-30T18:41:20.986070+0000","last_unstale":"2023-11-30T18:41:21.381562+0000","last_undegraded":"2023-11-30T18:41:21.381562+0000","last_fullsized":"2023-11-30T18:41:21.381562+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.370471+0000","last_change":"2023-11-30T18:41:21.367945+0000","last_active":"2023-11-30T18:41:21.370471+0000","last_peered":"2023-11-30T18:41:21.370471+0000","last_clean":"2023-11-30T18:41:21.370471+0000","last_became_active":"2023-11-30T18:41:21.367649+0000","last_became_peered":"2023-11-30T18:41:21.367649+0000","last_unstale":"2023-11-30T18:41:21.370471+0000","last_undegraded":"2023-11-30T18:41:21.370471+0000","last_fullsized":"2023-11-30T18:41:21.370471+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"218'1","reported_seq":11,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.383014+0000","last_change":"2023-11-30T18:41:20.985005+0000","last_active":"2023-11-30T18:41:21.383014+0000","last_peered":"2023-11-30T18:41:21.383014+0000","last_clean":"2023-11-30T18:41:21.383014+0000","last_became_active":"2023-11-30T18:41:20.984504+0000","last_became_peered":"2023-11-30T18:41:20.984504+0000","last_unstale":"2023-11-30T18:41:21.383014+0000","last_undegraded":"2023-11-30T18:41:21.383014+0000","last_fullsized":"2023-11-30T18:41:21.383014+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.384867+0000","last_change":"2023-11-30T18:41:21.378536+0000","last_active":"2023-11-30T18:41:21.384867+0000","last_peered":"2023-11-30T18:41:21.384867+0000","last_clean":"2023-11-30T18:41:21.384867+0000","last_became_active":"2023-11-30T18:41:21.377866+0000","last_became_peered":"2023-11-30T18:41:21.377866+0000","last_unstale":"2023-11-30T18:41:21.384867+0000","last_undegraded":"2023-11-30T18:41:21.384867+0000","last_fullsized":"2023-11-30T18:41:21.384867+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.363064+0000","last_change":"2023-11-30T18:41:20.986393+0000","last_active":"2023-11-30T18:41:21.363064+0000","last_peered":"2023-11-30T18:41:21.363064+0000","last_clean":"2023-11-30T18:41:21.363064+0000","last_became_active":"2023-11-30T18:41:20.985928+0000","last_became_peered":"2023-11-30T18:41:20.985928+0000","last_unstale":"2023-11-30T18:41:21.363064+0000","last_undegraded":"2023-11-30T18:41:21.363064+0000","last_fullsized":"2023-11-30T18:41:21.363064+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.371350+0000","last_change":"2023-11-30T18:41:21.368035+0000","last_active":"2023-11-30T18:41:21.371350+0000","last_peered":"2023-11-30T18:41:21.371350+0000","last_clean":"2023-11-30T18:41:21.371350+0000","last_became_active":"2023-11-30T18:41:21.367739+0000","last_became_peered":"2023-11-30T18:41:21.367739+0000","last_unstale":"2023-11-30T18:41:21.371350+0000","last_undegraded":"2023-11-30T18:41:21.371350+0000","last_fullsized":"2023-11-30T18:41:21.371350+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.358726+0000","last_change":"2023-11-30T18:41:20.989158+0000","last_active":"2023-11-30T18:41:21.358726+0000","last_peered":"2023-11-30T18:41:21.358726+0000","last_clean":"2023-11-30T18:41:21.358726+0000","last_became_active":"2023-11-30T18:41:20.988892+0000","last_became_peered":"2023-11-30T18:41:20.988892+0000","last_unstale":"2023-11-30T18:41:21.358726+0000","last_undegraded":"2023-11-30T18:41:21.358726+0000","last_fullsized":"2023-11-30T18:41:21.358726+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382404+0000","last_change":"2023-11-30T18:41:21.377760+0000","last_active":"2023-11-30T18:41:21.382404+0000","last_peered":"2023-11-30T18:41:21.382404+0000","last_clean":"2023-11-30T18:41:21.382404+0000","last_became_active":"2023-11-30T18:41:21.376927+0000","last_became_peered":"2023-11-30T18:41:21.376927+0000","last_unstale":"2023-11-30T18:41:21.382404+0000","last_undegraded":"2023-11-30T18:41:21.382404+0000","last_fullsized":"2023-11-30T18:41:21.382404+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"218'4","reported_seq":14,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.386058+0000","last_change":"2023-11-30T18:41:20.977618+0000","last_active":"2023-11-30T18:41:21.386058+0000","last_peered":"2023-11-30T18:41:21.386058+0000","last_clean":"2023-11-30T18:41:21.386058+0000","last_became_active":"2023-11-30T18:41:20.977311+0000","last_became_peered":"2023-11-30T18:41:20.977311+0000","last_unstale":"2023-11-30T18:41:21.386058+0000","last_undegraded":"2023-11-30T18:41:21.386058+0000","last_fullsized":"2023-11-30T18:41:21.386058+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.375661+0000","last_change":"2023-11-30T18:41:21.373109+0000","last_active":"2023-11-30T18:41:21.375661+0000","last_peered":"2023-11-30T18:41:21.375661+0000","last_clean":"2023-11-30T18:41:21.375661+0000","last_became_active":"2023-11-30T18:41:21.372859+0000","last_became_peered":"2023-11-30T18:41:21.372859+0000","last_unstale":"2023-11-30T18:41:21.375661+0000","last_undegraded":"2023-11-30T18:41:21.375661+0000","last_fullsized":"2023-11-30T18:41:21.375661+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"218'1","reported_seq":11,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.383044+0000","last_change":"2023-11-30T18:41:20.977200+0000","last_active":"2023-11-30T18:41:21.383044+0000","last_peered":"2023-11-30T18:41:21.383044+0000","last_clean":"2023-11-30T18:41:21.383044+0000","last_became_active":"2023-11-30T18:41:20.976942+0000","last_became_peered":"2023-11-30T18:41:20.976942+0000","last_unstale":"2023-11-30T18:41:21.383044+0000","last_undegraded":"2023-11-30T18:41:21.383044+0000","last_fullsized":"2023-11-30T18:41:21.383044+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.384607+0000","last_change":"2023-11-30T18:41:21.375235+0000","last_active":"2023-11-30T18:41:21.384607+0000","last_peered":"2023-11-30T18:41:21.384607+0000","last_clean":"2023-11-30T18:41:21.384607+0000","last_became_active":"2023-11-30T18:41:21.374662+0000","last_became_peered":"2023-11-30T18:41:21.374662+0000","last_unstale":"2023-11-30T18:41:21.384607+0000","last_undegraded":"2023-11-30T18:41:21.384607+0000","last_fullsized":"2023-11-30T18:41:21.384607+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"218'2","reported_seq":12,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.373748+0000","last_change":"2023-11-30T18:41:20.988667+0000","last_active":"2023-11-30T18:41:21.373748+0000","last_peered":"2023-11-30T18:41:21.373748+0000","last_clean":"2023-11-30T18:41:21.373748+0000","last_became_active":"2023-11-30T18:41:20.988362+0000","last_became_peered":"2023-11-30T18:41:20.988362+0000","last_unstale":"2023-11-30T18:41:21.373748+0000","last_undegraded":"2023-11-30T18:41:21.373748+0000","last_fullsized":"2023-11-30T18:41:21.373748+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382815+0000","last_change":"2023-11-30T18:41:21.377411+0000","last_active":"2023-11-30T18:41:21.382815+0000","last_peered":"2023-11-30T18:41:21.382815+0000","last_clean":"2023-11-30T18:41:21.382815+0000","last_became_active":"2023-11-30T18:41:21.374761+0000","last_became_peered":"2023-11-30T18:41:21.374761+0000","last_unstale":"2023-11-30T18:41:21.382815+0000","last_undegraded":"2023-11-30T18:41:21.382815+0000","last_fullsized":"2023-11-30T18:41:21.382815+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.357507+0000","last_change":"2023-11-30T18:41:20.981066+0000","last_active":"2023-11-30T18:41:21.357507+0000","last_peered":"2023-11-30T18:41:21.357507+0000","last_clean":"2023-11-30T18:41:21.357507+0000","last_became_active":"2023-11-30T18:41:20.980747+0000","last_became_peered":"2023-11-30T18:41:20.980747+0000","last_unstale":"2023-11-30T18:41:21.357507+0000","last_undegraded":"2023-11-30T18:41:21.357507+0000","last_fullsized":"2023-11-30T18:41:21.357507+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.385677+0000","last_change":"2023-11-30T18:41:21.384689+0000","last_active":"2023-11-30T18:41:21.385677+0000","last_peered":"2023-11-30T18:41:21.385677+0000","last_clean":"2023-11-30T18:41:21.385677+0000","last_became_active":"2023-11-30T18:41:21.384243+0000","last_became_peered":"2023-11-30T18:41:21.384243+0000","last_unstale":"2023-11-30T18:41:21.385677+0000","last_undegraded":"2023-11-30T18:41:21.385677+0000","last_fullsized":"2023-11-30T18:41:21.385677+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.367823+0000","last_change":"2023-11-30T18:41:20.982399+0000","last_active":"2023-11-30T18:41:21.367823+0000","last_peered":"2023-11-30T18:41:21.367823+0000","last_clean":"2023-11-30T18:41:21.367823+0000","last_became_active":"2023-11-30T18:41:20.982127+0000","last_became_peered":"2023-11-30T18:41:20.982127+0000","last_unstale":"2023-11-30T18:41:21.367823+0000","last_undegraded":"2023-11-30T18:41:21.367823+0000","last_fullsized":"2023-11-30T18:41:21.367823+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.380712+0000","last_change":"2023-11-30T18:41:21.379979+0000","last_active":"2023-11-30T18:41:21.380712+0000","last_peered":"2023-11-30T18:41:21.380712+0000","last_clean":"2023-11-30T18:41:21.380712+0000","last_became_active":"2023-11-30T18:41:21.379555+0000","last_became_peered":"2023-11-30T18:41:21.379555+0000","last_unstale":"2023-11-30T18:41:21.380712+0000","last_undegraded":"2023-11-30T18:41:21.380712+0000","last_fullsized":"2023-11-30T18:41:21.380712+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"218'1","reported_seq":11,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.383896+0000","last_change":"2023-11-30T18:41:20.984859+0000","last_active":"2023-11-30T18:41:21.383896+0000","last_peered":"2023-11-30T18:41:21.383896+0000","last_clean":"2023-11-30T18:41:21.383896+0000","last_became_active":"2023-11-30T18:41:20.984214+0000","last_became_peered":"2023-11-30T18:41:20.984214+0000","last_unstale":"2023-11-30T18:41:21.383896+0000","last_undegraded":"2023-11-30T18:41:21.383896+0000","last_fullsized":"2023-11-30T18:41:21.383896+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382784+0000","last_change":"2023-11-30T18:41:21.371724+0000","last_active":"2023-11-30T18:41:21.382784+0000","last_peered":"2023-11-30T18:41:21.382784+0000","last_clean":"2023-11-30T18:41:21.382784+0000","last_became_active":"2023-11-30T18:41:21.371443+0000","last_became_peered":"2023-11-30T18:41:21.371443+0000","last_unstale":"2023-11-30T18:41:21.382784+0000","last_undegraded":"2023-11-30T18:41:21.382784+0000","last_fullsized":"2023-11-30T18:41:21.382784+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.359371+0000","last_change":"2023-11-30T18:41:20.988139+0000","last_active":"2023-11-30T18:41:21.359371+0000","last_peered":"2023-11-30T18:41:21.359371+0000","last_clean":"2023-11-30T18:41:21.359371+0000","last_became_active":"2023-11-30T18:41:20.987851+0000","last_became_peered":"2023-11-30T18:41:20.987851+0000","last_unstale":"2023-11-30T18:41:21.359371+0000","last_undegraded":"2023-11-30T18:41:21.359371+0000","last_fullsized":"2023-11-30T18:41:21.359371+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382503+0000","last_change":"2023-11-30T18:41:21.368385+0000","last_active":"2023-11-30T18:41:21.382503+0000","last_peered":"2023-11-30T18:41:21.382503+0000","last_clean":"2023-11-30T18:41:21.382503+0000","last_became_active":"2023-11-30T18:41:21.368109+0000","last_became_peered":"2023-11-30T18:41:21.368109+0000","last_unstale":"2023-11-30T18:41:21.382503+0000","last_undegraded":"2023-11-30T18:41:21.382503+0000","last_fullsized":"2023-11-30T18:41:21.382503+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.355556+0000","last_change":"2023-11-30T18:41:20.980928+0000","last_active":"2023-11-30T18:41:21.355556+0000","last_peered":"2023-11-30T18:41:21.355556+0000","last_clean":"2023-11-30T18:41:21.355556+0000","last_became_active":"2023-11-30T18:41:20.980603+0000","last_became_peered":"2023-11-30T18:41:20.980603+0000","last_unstale":"2023-11-30T18:41:21.355556+0000","last_undegraded":"2023-11-30T18:41:21.355556+0000","last_fullsized":"2023-11-30T18:41:21.355556+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.383653+0000","last_change":"2023-11-30T18:41:21.371635+0000","last_active":"2023-11-30T18:41:21.383653+0000","last_peered":"2023-11-30T18:41:21.383653+0000","last_clean":"2023-11-30T18:41:21.383653+0000","last_became_active":"2023-11-30T18:41:21.370167+0000","last_became_peered":"2023-11-30T18:41:21.370167+0000","last_unstale":"2023-11-30T18:41:21.383653+0000","last_undegraded":"2023-11-30T18:41:21.383653+0000","last_fullsized":"2023-11-30T18:41:21.383653+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.357025+0000","last_change":"2023-11-30T18:41:20.981629+0000","last_active":"2023-11-30T18:41:21.357025+0000","last_peered":"2023-11-30T18:41:21.357025+0000","last_clean":"2023-11-30T18:41:21.357025+0000","last_became_active":"2023-11-30T18:41:20.981135+0000","last_became_peered":"2023-11-30T18:41:20.981135+0000","last_unstale":"2023-11-30T18:41:21.357025+0000","last_undegraded":"2023-11-30T18:41:21.357025+0000","last_fullsized":"2023-11-30T18:41:21.357025+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.373405+0000","last_change":"2023-11-30T18:41:21.368669+0000","last_active":"2023-11-30T18:41:21.373405+0000","last_peered":"2023-11-30T18:41:21.373405+0000","last_clean":"2023-11-30T18:41:21.373405+0000","last_became_active":"2023-11-30T18:41:21.368406+0000","last_became_peered":"2023-11-30T18:41:21.368406+0000","last_unstale":"2023-11-30T18:41:21.373405+0000","last_undegraded":"2023-11-30T18:41:21.373405+0000","last_fullsized":"2023-11-30T18:41:21.373405+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"218'2","reported_seq":12,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.371572+0000","last_change":"2023-11-30T18:41:20.981488+0000","last_active":"2023-11-30T18:41:21.371572+0000","last_peered":"2023-11-30T18:41:21.371572+0000","last_clean":"2023-11-30T18:41:21.371572+0000","last_became_active":"2023-11-30T18:41:20.981102+0000","last_became_peered":"2023-11-30T18:41:20.981102+0000","last_unstale":"2023-11-30T18:41:21.371572+0000","last_undegraded":"2023-11-30T18:41:21.371572+0000","last_fullsized":"2023-11-30T18:41:21.371572+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.373243+0000","last_change":"2023-11-30T18:41:21.369888+0000","last_active":"2023-11-30T18:41:21.373243+0000","last_peered":"2023-11-30T18:41:21.373243+0000","last_clean":"2023-11-30T18:41:21.373243+0000","last_became_active":"2023-11-30T18:41:21.369582+0000","last_became_peered":"2023-11-30T18:41:21.369582+0000","last_unstale":"2023-11-30T18:41:21.373243+0000","last_undegraded":"2023-11-30T18:41:21.373243+0000","last_fullsized":"2023-11-30T18:41:21.373243+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.356180+0000","last_change":"2023-11-30T18:41:20.978232+0000","last_active":"2023-11-30T18:41:21.356180+0000","last_peered":"2023-11-30T18:41:21.356180+0000","last_clean":"2023-11-30T18:41:21.356180+0000","last_became_active":"2023-11-30T18:41:20.977961+0000","last_became_peered":"2023-11-30T18:41:20.977961+0000","last_unstale":"2023-11-30T18:41:21.356180+0000","last_undegraded":"2023-11-30T18:41:21.356180+0000","last_fullsized":"2023-11-30T18:41:21.356180+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382738+0000","last_change":"2023-11-30T18:41:21.378285+0000","last_active":"2023-11-30T18:41:21.382738+0000","last_peered":"2023-11-30T18:41:21.382738+0000","last_clean":"2023-11-30T18:41:21.382738+0000","last_became_active":"2023-11-30T18:41:21.377973+0000","last_became_peered":"2023-11-30T18:41:21.377973+0000","last_unstale":"2023-11-30T18:41:21.382738+0000","last_undegraded":"2023-11-30T18:41:21.382738+0000","last_fullsized":"2023-11-30T18:41:21.382738+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.364518+0000","last_change":"2023-11-30T18:41:20.978766+0000","last_active":"2023-11-30T18:41:21.364518+0000","last_peered":"2023-11-30T18:41:21.364518+0000","last_clean":"2023-11-30T18:41:21.364518+0000","last_became_active":"2023-11-30T18:41:20.978462+0000","last_became_peered":"2023-11-30T18:41:20.978462+0000","last_unstale":"2023-11-30T18:41:21.364518+0000","last_undegraded":"2023-11-30T18:41:21.364518+0000","last_fullsized":"2023-11-30T18:41:21.364518+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.375791+0000","last_change":"2023-11-30T18:41:21.373179+0000","last_active":"2023-11-30T18:41:21.375791+0000","last_peered":"2023-11-30T18:41:21.375791+0000","last_clean":"2023-11-30T18:41:21.375791+0000","last_became_active":"2023-11-30T18:41:21.372888+0000","last_became_peered":"2023-11-30T18:41:21.372888+0000","last_unstale":"2023-11-30T18:41:21.375791+0000","last_undegraded":"2023-11-30T18:41:21.375791+0000","last_fullsized":"2023-11-30T18:41:21.375791+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.362192+0000","last_change":"2023-11-30T18:41:20.982542+0000","last_active":"2023-11-30T18:41:21.362192+0000","last_peered":"2023-11-30T18:41:21.362192+0000","last_clean":"2023-11-30T18:41:21.362192+0000","last_became_active":"2023-11-30T18:41:20.982234+0000","last_became_peered":"2023-11-30T18:41:20.982234+0000","last_unstale":"2023-11-30T18:41:21.362192+0000","last_undegraded":"2023-11-30T18:41:21.362192+0000","last_fullsized":"2023-11-30T18:41:21.362192+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.377188+0000","last_change":"2023-11-30T18:41:21.368059+0000","last_active":"2023-11-30T18:41:21.377188+0000","last_peered":"2023-11-30T18:41:21.377188+0000","last_clean":"2023-11-30T18:41:21.377188+0000","last_became_active":"2023-11-30T18:41:21.367783+0000","last_became_peered":"2023-11-30T18:41:21.367783+0000","last_unstale":"2023-11-30T18:41:21.377188+0000","last_undegraded":"2023-11-30T18:41:21.377188+0000","last_fullsized":"2023-11-30T18:41:21.377188+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.360834+0000","last_change":"2023-11-30T18:41:20.988465+0000","last_active":"2023-11-30T18:41:21.360834+0000","last_peered":"2023-11-30T18:41:21.360834+0000","last_clean":"2023-11-30T18:41:21.360834+0000","last_became_active":"2023-11-30T18:41:20.988109+0000","last_became_peered":"2023-11-30T18:41:20.988109+0000","last_unstale":"2023-11-30T18:41:21.360834+0000","last_undegraded":"2023-11-30T18:41:21.360834+0000","last_fullsized":"2023-11-30T18:41:21.360834+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.377554+0000","last_change":"2023-11-30T18:41:21.372926+0000","last_active":"2023-11-30T18:41:21.377554+0000","last_peered":"2023-11-30T18:41:21.377554+0000","last_clean":"2023-11-30T18:41:21.377554+0000","last_became_active":"2023-11-30T18:41:21.372375+0000","last_became_peered":"2023-11-30T18:41:21.372375+0000","last_unstale":"2023-11-30T18:41:21.377554+0000","last_undegraded":"2023-11-30T18:41:21.377554+0000","last_fullsized":"2023-11-30T18:41:21.377554+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.360645+0000","last_change":"2023-11-30T18:41:20.984013+0000","last_active":"2023-11-30T18:41:21.360645+0000","last_peered":"2023-11-30T18:41:21.360645+0000","last_clean":"2023-11-30T18:41:21.360645+0000","last_became_active":"2023-11-30T18:41:20.983762+0000","last_became_peered":"2023-11-30T18:41:20.983762+0000","last_unstale":"2023-11-30T18:41:21.360645+0000","last_undegraded":"2023-11-30T18:41:21.360645+0000","last_fullsized":"2023-11-30T18:41:21.360645+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.385675+0000","last_change":"2023-11-30T18:41:21.384606+0000","last_active":"2023-11-30T18:41:21.385675+0000","last_peered":"2023-11-30T18:41:21.385675+0000","last_clean":"2023-11-30T18:41:21.385675+0000","last_became_active":"2023-11-30T18:41:21.384295+0000","last_became_peered":"2023-11-30T18:41:21.384295+0000","last_unstale":"2023-11-30T18:41:21.385675+0000","last_undegraded":"2023-11-30T18:41:21.385675+0000","last_fullsized":"2023-11-30T18:41:21.385675+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.355658+0000","last_change":"2023-11-30T18:41:20.976983+0000","last_active":"2023-11-30T18:41:21.355658+0000","last_peered":"2023-11-30T18:41:21.355658+0000","last_clean":"2023-11-30T18:41:21.355658+0000","last_became_active":"2023-11-30T18:41:20.976695+0000","last_became_peered":"2023-11-30T18:41:20.976695+0000","last_unstale":"2023-11-30T18:41:21.355658+0000","last_undegraded":"2023-11-30T18:41:21.355658+0000","last_fullsized":"2023-11-30T18:41:21.355658+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382009+0000","last_change":"2023-11-30T18:41:21.374039+0000","last_active":"2023-11-30T18:41:21.382009+0000","last_peered":"2023-11-30T18:41:21.382009+0000","last_clean":"2023-11-30T18:41:21.382009+0000","last_became_active":"2023-11-30T18:41:21.373771+0000","last_became_peered":"2023-11-30T18:41:21.373771+0000","last_unstale":"2023-11-30T18:41:21.382009+0000","last_undegraded":"2023-11-30T18:41:21.382009+0000","last_fullsized":"2023-11-30T18:41:21.382009+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.357475+0000","last_change":"2023-11-30T18:41:20.981406+0000","last_active":"2023-11-30T18:41:21.357475+0000","last_peered":"2023-11-30T18:41:21.357475+0000","last_clean":"2023-11-30T18:41:21.357475+0000","last_became_active":"2023-11-30T18:41:20.980777+0000","last_became_peered":"2023-11-30T18:41:20.980777+0000","last_unstale":"2023-11-30T18:41:21.357475+0000","last_undegraded":"2023-11-30T18:41:21.357475+0000","last_fullsized":"2023-11-30T18:41:21.357475+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.375435+0000","last_change":"2023-11-30T18:41:21.371959+0000","last_active":"2023-11-30T18:41:21.375435+0000","last_peered":"2023-11-30T18:41:21.375435+0000","last_clean":"2023-11-30T18:41:21.375435+0000","last_became_active":"2023-11-30T18:41:21.370246+0000","last_became_peered":"2023-11-30T18:41:21.370246+0000","last_unstale":"2023-11-30T18:41:21.375435+0000","last_undegraded":"2023-11-30T18:41:21.375435+0000","last_fullsized":"2023-11-30T18:41:21.375435+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"218'1","reported_seq":11,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.371233+0000","last_change":"2023-11-30T18:41:20.989472+0000","last_active":"2023-11-30T18:41:21.371233+0000","last_peered":"2023-11-30T18:41:21.371233+0000","last_clean":"2023-11-30T18:41:21.371233+0000","last_became_active":"2023-11-30T18:41:20.989158+0000","last_became_peered":"2023-11-30T18:41:20.989158+0000","last_unstale":"2023-11-30T18:41:21.371233+0000","last_undegraded":"2023-11-30T18:41:21.371233+0000","last_fullsized":"2023-11-30T18:41:21.371233+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":185,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.364504+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T18:41:21.364504+0000","last_peered":"2023-11-30T18:41:21.364504+0000","last_clean":"2023-11-30T18:41:21.364504+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T18:41:21.364504+0000","last_undegraded":"2023-11-30T18:41:21.364504+0000","last_fullsized":"2023-11-30T18:41:21.364504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.374849+0000","last_change":"2023-11-30T18:41:21.372418+0000","last_active":"2023-11-30T18:41:21.374849+0000","last_peered":"2023-11-30T18:41:21.374849+0000","last_clean":"2023-11-30T18:41:21.374849+0000","last_became_active":"2023-11-30T18:41:21.372108+0000","last_became_peered":"2023-11-30T18:41:21.372108+0000","last_unstale":"2023-11-30T18:41:21.374849+0000","last_undegraded":"2023-11-30T18:41:21.374849+0000","last_fullsized":"2023-11-30T18:41:21.374849+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.364670+0000","last_change":"2023-11-30T18:41:20.984071+0000","last_active":"2023-11-30T18:41:21.364670+0000","last_peered":"2023-11-30T18:41:21.364670+0000","last_clean":"2023-11-30T18:41:21.364670+0000","last_became_active":"2023-11-30T18:41:20.983789+0000","last_became_peered":"2023-11-30T18:41:20.983789+0000","last_unstale":"2023-11-30T18:41:21.364670+0000","last_undegraded":"2023-11-30T18:41:21.364670+0000","last_fullsized":"2023-11-30T18:41:21.364670+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":181,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.368519+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T18:41:21.368519+0000","last_peered":"2023-11-30T18:41:21.368519+0000","last_clean":"2023-11-30T18:41:21.368519+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T18:41:21.368519+0000","last_undegraded":"2023-11-30T18:41:21.368519+0000","last_fullsized":"2023-11-30T18:41:21.368519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.375089+0000","last_change":"2023-11-30T18:41:21.370723+0000","last_active":"2023-11-30T18:41:21.375089+0000","last_peered":"2023-11-30T18:41:21.375089+0000","last_clean":"2023-11-30T18:41:21.375089+0000","last_became_active":"2023-11-30T18:41:21.370505+0000","last_became_peered":"2023-11-30T18:41:21.370505+0000","last_unstale":"2023-11-30T18:41:21.375089+0000","last_undegraded":"2023-11-30T18:41:21.375089+0000","last_fullsized":"2023-11-30T18:41:21.375089+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.359269+0000","last_change":"2023-11-30T18:41:20.984042+0000","last_active":"2023-11-30T18:41:21.359269+0000","last_peered":"2023-11-30T18:41:21.359269+0000","last_clean":"2023-11-30T18:41:21.359269+0000","last_became_active":"2023-11-30T18:41:20.983561+0000","last_became_peered":"2023-11-30T18:41:20.983561+0000","last_unstale":"2023-11-30T18:41:21.359269+0000","last_undegraded":"2023-11-30T18:41:21.359269+0000","last_fullsized":"2023-11-30T18:41:21.359269+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":189,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.355734+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T18:41:21.355734+0000","last_peered":"2023-11-30T18:41:21.355734+0000","last_clean":"2023-11-30T18:41:21.355734+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T18:41:21.355734+0000","last_undegraded":"2023-11-30T18:41:21.355734+0000","last_fullsized":"2023-11-30T18:41:21.355734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382729+0000","last_change":"2023-11-30T18:41:21.376245+0000","last_active":"2023-11-30T18:41:21.382729+0000","last_peered":"2023-11-30T18:41:21.382729+0000","last_clean":"2023-11-30T18:41:21.382729+0000","last_became_active":"2023-11-30T18:41:21.375152+0000","last_became_peered":"2023-11-30T18:41:21.375152+0000","last_unstale":"2023-11-30T18:41:21.382729+0000","last_undegraded":"2023-11-30T18:41:21.382729+0000","last_fullsized":"2023-11-30T18:41:21.382729+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.360059+0000","last_change":"2023-11-30T18:41:20.983138+0000","last_active":"2023-11-30T18:41:21.360059+0000","last_peered":"2023-11-30T18:41:21.360059+0000","last_clean":"2023-11-30T18:41:21.360059+0000","last_became_active":"2023-11-30T18:41:20.982858+0000","last_became_peered":"2023-11-30T18:41:20.982858+0000","last_unstale":"2023-11-30T18:41:21.360059+0000","last_undegraded":"2023-11-30T18:41:21.360059+0000","last_fullsized":"2023-11-30T18:41:21.360059+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":181,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.368194+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T18:41:21.368194+0000","last_peered":"2023-11-30T18:41:21.368194+0000","last_clean":"2023-11-30T18:41:21.368194+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T18:41:21.368194+0000","last_undegraded":"2023-11-30T18:41:21.368194+0000","last_fullsized":"2023-11-30T18:41:21.368194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":177,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.360301+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T18:41:21.360301+0000","last_peered":"2023-11-30T18:41:21.360301+0000","last_clean":"2023-11-30T18:41:21.360301+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T18:41:21.360301+0000","last_undegraded":"2023-11-30T18:41:21.360301+0000","last_fullsized":"2023-11-30T18:41:21.360301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.377713+0000","last_change":"2023-11-30T18:41:21.373876+0000","last_active":"2023-11-30T18:41:21.377713+0000","last_peered":"2023-11-30T18:41:21.377713+0000","last_clean":"2023-11-30T18:41:21.377713+0000","last_became_active":"2023-11-30T18:41:21.373605+0000","last_became_peered":"2023-11-30T18:41:21.373605+0000","last_unstale":"2023-11-30T18:41:21.377713+0000","last_undegraded":"2023-11-30T18:41:21.377713+0000","last_fullsized":"2023-11-30T18:41:21.377713+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.361327+0000","last_change":"2023-11-30T18:41:20.979854+0000","last_active":"2023-11-30T18:41:21.361327+0000","last_peered":"2023-11-30T18:41:21.361327+0000","last_clean":"2023-11-30T18:41:21.361327+0000","last_became_active":"2023-11-30T18:41:20.979018+0000","last_became_peered":"2023-11-30T18:41:20.979018+0000","last_unstale":"2023-11-30T18:41:21.361327+0000","last_undegraded":"2023-11-30T18:41:21.361327+0000","last_fullsized":"2023-11-30T18:41:21.361327+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":175,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.360382+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T18:41:21.360382+0000","last_peered":"2023-11-30T18:41:21.360382+0000","last_clean":"2023-11-30T18:41:21.360382+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T18:41:21.360382+0000","last_undegraded":"2023-11-30T18:41:21.360382+0000","last_fullsized":"2023-11-30T18:41:21.360382+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.370044+0000","last_change":"2023-11-30T18:41:21.367733+0000","last_active":"2023-11-30T18:41:21.370044+0000","last_peered":"2023-11-30T18:41:21.370044+0000","last_clean":"2023-11-30T18:41:21.370044+0000","last_became_active":"2023-11-30T18:41:21.367404+0000","last_became_peered":"2023-11-30T18:41:21.367404+0000","last_unstale":"2023-11-30T18:41:21.370044+0000","last_undegraded":"2023-11-30T18:41:21.370044+0000","last_fullsized":"2023-11-30T18:41:21.370044+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"218'1","reported_seq":11,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.383683+0000","last_change":"2023-11-30T18:41:20.977253+0000","last_active":"2023-11-30T18:41:21.383683+0000","last_peered":"2023-11-30T18:41:21.383683+0000","last_clean":"2023-11-30T18:41:21.383683+0000","last_became_active":"2023-11-30T18:41:20.976988+0000","last_became_peered":"2023-11-30T18:41:20.976988+0000","last_unstale":"2023-11-30T18:41:21.383683+0000","last_undegraded":"2023-11-30T18:41:21.383683+0000","last_fullsized":"2023-11-30T18:41:21.383683+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":175,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.362999+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T18:41:21.362999+0000","last_peered":"2023-11-30T18:41:21.362999+0000","last_clean":"2023-11-30T18:41:21.362999+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T18:41:21.362999+0000","last_undegraded":"2023-11-30T18:41:21.362999+0000","last_fullsized":"2023-11-30T18:41:21.362999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.383049+0000","last_change":"2023-11-30T18:41:21.379210+0000","last_active":"2023-11-30T18:41:21.383049+0000","last_peered":"2023-11-30T18:41:21.383049+0000","last_clean":"2023-11-30T18:41:21.383049+0000","last_became_active":"2023-11-30T18:41:21.378325+0000","last_became_peered":"2023-11-30T18:41:21.378325+0000","last_unstale":"2023-11-30T18:41:21.383049+0000","last_undegraded":"2023-11-30T18:41:21.383049+0000","last_fullsized":"2023-11-30T18:41:21.383049+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"218'2","reported_seq":12,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.381102+0000","last_change":"2023-11-30T18:41:20.986137+0000","last_active":"2023-11-30T18:41:21.381102+0000","last_peered":"2023-11-30T18:41:21.381102+0000","last_clean":"2023-11-30T18:41:21.381102+0000","last_became_active":"2023-11-30T18:41:20.985840+0000","last_became_peered":"2023-11-30T18:41:20.985840+0000","last_unstale":"2023-11-30T18:41:21.381102+0000","last_undegraded":"2023-11-30T18:41:21.381102+0000","last_fullsized":"2023-11-30T18:41:21.381102+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":185,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.362870+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T18:41:21.362870+0000","last_peered":"2023-11-30T18:41:21.362870+0000","last_clean":"2023-11-30T18:41:21.362870+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T18:41:21.362870+0000","last_undegraded":"2023-11-30T18:41:21.362870+0000","last_fullsized":"2023-11-30T18:41:21.362870+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382032+0000","last_change":"2023-11-30T18:41:21.372954+0000","last_active":"2023-11-30T18:41:21.382032+0000","last_peered":"2023-11-30T18:41:21.382032+0000","last_clean":"2023-11-30T18:41:21.382032+0000","last_became_active":"2023-11-30T18:41:21.372375+0000","last_became_peered":"2023-11-30T18:41:21.372375+0000","last_unstale":"2023-11-30T18:41:21.382032+0000","last_undegraded":"2023-11-30T18:41:21.382032+0000","last_fullsized":"2023-11-30T18:41:21.382032+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.360991+0000","last_change":"2023-11-30T18:41:20.987695+0000","last_active":"2023-11-30T18:41:21.360991+0000","last_peered":"2023-11-30T18:41:21.360991+0000","last_clean":"2023-11-30T18:41:21.360991+0000","last_became_active":"2023-11-30T18:41:20.987279+0000","last_became_peered":"2023-11-30T18:41:20.987279+0000","last_unstale":"2023-11-30T18:41:21.360991+0000","last_undegraded":"2023-11-30T18:41:21.360991+0000","last_fullsized":"2023-11-30T18:41:21.360991+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":206,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.357585+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T18:41:21.357585+0000","last_peered":"2023-11-30T18:41:21.357585+0000","last_clean":"2023-11-30T18:41:21.357585+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T18:41:21.357585+0000","last_undegraded":"2023-11-30T18:41:21.357585+0000","last_fullsized":"2023-11-30T18:41:21.357585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575969,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303876,"kb_used_data":2684,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94067964,"statfs":{"total":96636764160,"available":96325595136,"internally_reserved":0,"allocated":2748416,"data_stored":1411754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.377,"5min":0.34200000000000003,"15min":0.28699999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.84799999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.621,"15min":0.63},"min":{"1min":0.46999999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82099999999999995,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.66100000000000003}]},{"osd":1,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.39500000000000002,"5min":0.36199999999999999,"15min":0.35899999999999999},"max":{"1min":0.74199999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56000000000000005,"15min":0.57399999999999995},"min":{"1min":0.38400000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73199999999999998,"5min":0.77800000000000002,"15min":0.877},"last":0.63600000000000001}]},{"osd":2,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.81100000000000005},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.44600000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79300000000000004,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.622}]},{"osd":3,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55800000000000005,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.372,"15min":0.35899999999999999},"max":{"1min":0.78100000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59499999999999997,"15min":0.60699999999999998},"min":{"1min":0.42699999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77600000000000002,"5min":0.80400000000000005,"15min":0.89900000000000002},"last":0.67300000000000004}]},{"osd":4,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46600000000000003,"15min":0.46500000000000002},"min":{"1min":0.32100000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.66100000000000003,"5min":1.264,"15min":1.264},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.48699999999999999,"15min":0.48999999999999999},"min":{"1min":0.307,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.64400000000000002,"5min":1.149,"15min":1.149},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.498,"15min":0.497},"min":{"1min":0.32200000000000001,"5min":0.30599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71099999999999997,"5min":0.78200000000000003,"15min":0.83399999999999996},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.497,"5min":0.52900000000000003,"15min":0.53100000000000003},"min":{"1min":0.38400000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66800000000000004,"5min":1.286,"15min":1.286},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.38100000000000001,"5min":0.33000000000000002,"15min":0.32300000000000001},"max":{"1min":0.72699999999999998,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54700000000000004,"15min":0.55400000000000005},"min":{"1min":0.34799999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.68799999999999994,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.72899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575968,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307968,"kb_used_data":2680,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063872,"statfs":{"total":96636764160,"available":96321404928,"internally_reserved":0,"allocated":2744320,"data_stored":1411200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59499999999999997,"15min":0.61099999999999999},"min":{"1min":0.42299999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.76300000000000001,"5min":0.80500000000000005,"15min":1.6379999999999999},"last":0.499},{"interface":"front","average":{"1min":0.62,"5min":0.623,"15min":0.625},"min":{"1min":0.45100000000000001,"5min":0.42499999999999999,"15min":0.27800000000000002},"max":{"1min":0.77800000000000002,"5min":0.82999999999999996,"15min":1.246},"last":0.51200000000000001}]},{"osd":1,"last update":"Thu Nov 30 18:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59499999999999997,"15min":0.61099999999999999},"min":{"1min":0.40100000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":1.1200000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61399999999999999,"15min":0.63},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.35499999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.90400000000000003},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Nov 30 18:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58799999999999997,"15min":0.59899999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.34499999999999997},"max":{"1min":0.751,"5min":0.751,"15min":1.288},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.61199999999999999,"15min":0.63200000000000001},"min":{"1min":0.441,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":0.80600000000000005,"5min":0.84599999999999997,"15min":1.177},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Nov 30 18:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55200000000000005,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.371,"15min":0.33400000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":1.204},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56100000000000005,"15min":0.56999999999999995},"min":{"1min":0.42199999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.72299999999999998,"5min":0.78300000000000003,"15min":1.337},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Nov 30 18:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.44700000000000001,"15min":0.47199999999999998},"min":{"1min":0.33800000000000002,"5min":0.32500000000000001,"15min":0.28699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":1.51},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.47099999999999997,"15min":0.49299999999999999},"min":{"1min":0.34200000000000003,"5min":0.32800000000000001,"15min":0.30399999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.94299999999999995},"last":0.45900000000000002}]},{"osd":5,"last update":"Thu Nov 30 18:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.45300000000000001,"15min":0.47299999999999998},"min":{"1min":0.32600000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":1.159},"last":0.432},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.505,"15min":0.53100000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":1.679},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Nov 30 18:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.51900000000000002,"15min":0.54100000000000004},"min":{"1min":0.35699999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.96199999999999997},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55500000000000005,"15min":0.57799999999999996},"min":{"1min":0.41099999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":1.427},"last":0.55600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575968,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312060,"kb_used_data":2676,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059780,"statfs":{"total":96636764160,"available":96317214720,"internally_reserved":0,"allocated":2740224,"data_stored":1410308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.36799999999999999,"15min":0.376},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.56399999999999995,"5min":0.66300000000000003,"15min":0.79900000000000004},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.49399999999999999,"15min":0.505},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.87},"last":0.371}]},{"osd":2,"last update":"Thu Nov 30 18:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.39300000000000002,"15min":0.40899999999999997},"min":{"1min":0.27100000000000002,"5min":0.26700000000000002,"15min":0.26200000000000001},"max":{"1min":0.55700000000000005,"5min":0.64700000000000002,"15min":0.89100000000000001},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.51500000000000001,"15min":0.52800000000000002},"min":{"1min":0.38100000000000001,"5min":0.372,"15min":0.37},"max":{"1min":0.73799999999999999,"5min":0.80300000000000005,"15min":0.98599999999999999},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Nov 30 18:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.46999999999999997,"15min":0.47499999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.91900000000000004},"last":0.432},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.443,"15min":0.45500000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.625,"5min":0.71399999999999997,"15min":0.84599999999999997},"last":0.32100000000000001}]},{"osd":4,"last update":"Thu Nov 30 18:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59599999999999997,"15min":0.61299999999999999},"min":{"1min":0.38900000000000001,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":0.78500000000000003,"5min":0.89800000000000002,"15min":0.93999999999999995},"last":0.625},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65100000000000002,"15min":0.66400000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.42299999999999999},"max":{"1min":0.78400000000000003,"5min":1.0329999999999999,"15min":1.0700000000000001},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Nov 30 18:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60899999999999999,"15min":0.627},"min":{"1min":0.41399999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76200000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.63400000000000001,"15min":0.64100000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.39200000000000002},"max":{"1min":0.82399999999999995,"5min":0.93400000000000005,"15min":0.98099999999999998},"last":0.55400000000000005}]},{"osd":6,"last update":"Thu Nov 30 18:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69299999999999995,"15min":0.70299999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.95099999999999996,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67200000000000004,"15min":0.68500000000000005},"min":{"1min":0.46000000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.876,"5min":0.88100000000000001,"15min":1.004},"last":0.61499999999999999}]},{"osd":7,"last update":"Thu Nov 30 18:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.68600000000000005,"15min":0.70499999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.46100000000000002},"max":{"1min":0.83499999999999996,"5min":0.92200000000000004,"15min":1.012},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68000000000000005,"15min":0.69099999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.85099999999999998,"5min":0.97599999999999998,"15min":1.02},"last":0.53500000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575968,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312080,"kb_used_data":2696,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059760,"statfs":{"total":96636764160,"available":96317194240,"internally_reserved":0,"allocated":2760704,"data_stored":1411078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.39300000000000002,"15min":0.39600000000000002},"min":{"1min":0.26000000000000001,"5min":0.252,"15min":0.22900000000000001},"max":{"1min":0.45900000000000002,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42299999999999999,"15min":0.41899999999999998},"min":{"1min":0.28399999999999997,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.497,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.28799999999999998}]},{"osd":2,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.40699999999999997,"15min":0.41399999999999998},"min":{"1min":0.26000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.63500000000000001,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48599999999999999,"15min":0.495},"min":{"1min":0.36799999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.626,"5min":0.69799999999999995,"15min":0.74199999999999999},"last":0.42499999999999999}]},{"osd":3,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.47299999999999998,"15min":0.46200000000000002},"min":{"1min":0.33500000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.54200000000000004,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.47299999999999998,"15min":0.47099999999999997},"min":{"1min":0.33100000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.57899999999999996,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.378}]},{"osd":4,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61699999999999999,"15min":0.63300000000000001},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.40200000000000002},"max":{"1min":0.72299999999999998,"5min":0.85399999999999998,"15min":1.026},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65200000000000002,"15min":0.65500000000000003},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84299999999999997,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.621}]},{"osd":5,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.48799999999999999,"5min":0.41799999999999998,"15min":0.40400000000000003},"max":{"1min":0.86399999999999999,"5min":0.97699999999999998,"15min":0.97799999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.64100000000000001,"15min":0.66100000000000003},"min":{"1min":0.48399999999999999,"5min":0.47199999999999998,"15min":0.439},"max":{"1min":0.751,"5min":0.91000000000000003,"15min":1.079},"last":0.749}]},{"osd":6,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67500000000000004,"15min":0.68200000000000005},"min":{"1min":0.48399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.67500000000000004,"15min":0.67800000000000005},"min":{"1min":0.45200000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91500000000000004,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.67800000000000005,"15min":0.69499999999999995},"min":{"1min":0.45800000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82999999999999996,"5min":0.94099999999999995,"15min":1.123},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71699999999999997,"15min":0.73199999999999998},"min":{"1min":0.56399999999999995,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92000000000000004,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.71199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575968,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312060,"kb_used_data":2676,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059780,"statfs":{"total":96636764160,"available":96317214720,"internally_reserved":0,"allocated":2740224,"data_stored":1410308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40699999999999997,"15min":0.41499999999999998},"min":{"1min":0.28000000000000003,"5min":0.249,"15min":0.23200000000000001},"max":{"1min":0.54600000000000004,"5min":0.64800000000000002,"15min":0.72099999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45200000000000001,"15min":0.45800000000000002},"min":{"1min":0.29199999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.623,"5min":0.63400000000000001,"15min":0.73199999999999998},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.45100000000000001,"15min":0.46000000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.66800000000000004,"5min":0.70599999999999996,"15min":0.74299999999999999},"last":0.432},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48899999999999999,"15min":0.49199999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.29899999999999999},"max":{"1min":0.68700000000000006,"5min":0.746,"15min":0.752},"last":0.38}]},{"osd":3,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.42199999999999999,"15min":0.42299999999999999},"min":{"1min":0.29399999999999998,"5min":0.28399999999999997,"15min":0.27500000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.49099999999999999,"15min":0.496},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.77100000000000002},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.496,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81299999999999994,"5min":0.91900000000000004,"15min":0.95299999999999996},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.61599999999999999,"15min":0.63600000000000001},"min":{"1min":0.46800000000000003,"5min":0.42199999999999999,"15min":0.35899999999999999},"max":{"1min":0.83399999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64700000000000002,"15min":0.66000000000000003},"min":{"1min":0.435,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89900000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65100000000000002,"15min":0.66500000000000004},"min":{"1min":0.52500000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80200000000000005,"5min":1.01,"15min":1.01},"last":0.495}]},{"osd":6,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63900000000000001,"15min":0.64800000000000002},"min":{"1min":0.50900000000000001,"5min":0.432,"15min":0.40500000000000003},"max":{"1min":0.81899999999999995,"5min":0.93000000000000005,"15min":0.93200000000000005},"last":0.501},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.67900000000000005,"15min":0.69499999999999995},"min":{"1min":0.53400000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88500000000000001,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67900000000000005,"15min":0.68999999999999995},"min":{"1min":0.53700000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96499999999999997,"5min":0.97799999999999998,"15min":1.0109999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69699999999999995,"15min":0.71399999999999997},"min":{"1min":0.51100000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.91300000000000003,"5min":0.97899999999999998,"15min":0.98699999999999999},"last":0.56299999999999994}]}]},{"osd":3,"up_from":13,"seq":55834575968,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299904,"kb_used_data":2680,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94071936,"statfs":{"total":96636764160,"available":96329662464,"internally_reserved":0,"allocated":2744320,"data_stored":1410398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38200000000000001,"15min":0.38},"min":{"1min":0.26300000000000001,"5min":0.254,"15min":0.222},"max":{"1min":0.60899999999999999,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.374},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.42299999999999999,"15min":0.42599999999999999},"min":{"1min":0.29999999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.56000000000000005,"5min":0.64200000000000002,"15min":0.754},"last":0.40400000000000003}]},{"osd":1,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39400000000000002,"15min":0.40300000000000002},"min":{"1min":0.28799999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.59499999999999997,"5min":0.65800000000000003,"15min":0.73399999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.442,"15min":0.45200000000000001},"min":{"1min":0.32300000000000001,"5min":0.28699999999999998,"15min":0.25700000000000001},"max":{"1min":0.65900000000000003,"5min":0.66800000000000004,"15min":0.86699999999999999},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47399999999999998,"15min":0.47299999999999998},"min":{"1min":0.35599999999999998,"5min":0.29299999999999998,"15min":0.27800000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.79500000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51500000000000001,"15min":0.52100000000000002},"min":{"1min":0.41399999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.747,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.504}]},{"osd":4,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.434,"5min":0.39100000000000001,"15min":0.35299999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63800000000000001,"15min":0.64700000000000002},"min":{"1min":0.42499999999999999,"5min":0.40300000000000002,"15min":0.40100000000000002},"max":{"1min":0.91800000000000004,"5min":0.97799999999999998,"15min":1.0049999999999999},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63500000000000001,"15min":0.64200000000000002},"min":{"1min":0.45500000000000002,"5min":0.41499999999999998,"15min":0.40699999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65300000000000002,"15min":0.66400000000000003},"min":{"1min":0.51300000000000001,"5min":0.41299999999999998,"15min":0.34499999999999997},"max":{"1min":1.038,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67300000000000004,"15min":0.67900000000000005},"min":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.377},"max":{"1min":1.004,"5min":1.0189999999999999,"15min":1.0309999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66500000000000004,"15min":0.68500000000000005},"min":{"1min":0.52200000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.68000000000000005,"15min":0.69899999999999995},"min":{"1min":0.48299999999999998,"5min":0.434,"15min":0.434},"max":{"1min":1.03,"5min":1.03,"15min":1.052},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.67900000000000005,"15min":0.69899999999999995},"min":{"1min":0.48599999999999999,"5min":0.441,"15min":0.441},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.624}]}]},{"osd":4,"up_from":13,"seq":55834575968,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303880,"kb_used_data":2688,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94067960,"statfs":{"total":96636764160,"available":96325591040,"internally_reserved":0,"allocated":2752512,"data_stored":1410986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52200000000000002,"15min":0.55500000000000005},"min":{"1min":0.315,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.85499999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54800000000000004,"15min":0.56499999999999995},"min":{"1min":0.376,"5min":0.34100000000000003,"15min":0.32500000000000001},"max":{"1min":0.77200000000000002,"5min":0.77500000000000002,"15min":0.94999999999999996},"last":0.69299999999999995}]},{"osd":1,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54000000000000004,"15min":0.56399999999999995},"min":{"1min":0.314,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.876},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.54800000000000004,"15min":0.57699999999999996},"min":{"1min":0.34899999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69799999999999995,"5min":0.81399999999999995,"15min":0.91200000000000003},"last":0.65600000000000003}]},{"osd":2,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.57599999999999996,"15min":0.59699999999999998},"min":{"1min":0.33400000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.79000000000000004,"5min":0.81200000000000006,"15min":0.93799999999999994},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.58599999999999997,"15min":0.621},"min":{"1min":0.371,"5min":0.35999999999999999,"15min":0.34899999999999998},"max":{"1min":0.77700000000000002,"5min":0.82299999999999995,"15min":0.94399999999999995},"last":0.51500000000000001}]},{"osd":3,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.53700000000000003,"15min":0.56000000000000005},"min":{"1min":0.38,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70899999999999996,"5min":0.73999999999999999,"15min":0.84999999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.56100000000000005,"15min":0.59599999999999997},"min":{"1min":0.432,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.80300000000000005,"5min":0.80800000000000005,"15min":0.872},"last":0.60999999999999999}]},{"osd":5,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42499999999999999,"15min":0.44700000000000001},"min":{"1min":0.32300000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.626,"5min":0.66600000000000004,"15min":0.86399999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.45000000000000001,"15min":0.46800000000000003},"min":{"1min":0.33700000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.82299999999999995},"last":0.35999999999999999}]},{"osd":6,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.47899999999999998,"15min":0.51100000000000001},"min":{"1min":0.36099999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":1.1399999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52200000000000002,"15min":0.55800000000000005},"min":{"1min":0.39800000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":1.1220000000000001},"last":0.41599999999999998}]},{"osd":7,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.47999999999999998,"15min":0.52300000000000002},"min":{"1min":0.36099999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77100000000000002,"5min":0.77400000000000002,"15min":0.90000000000000002},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55200000000000005,"15min":0.58099999999999996},"min":{"1min":0.44,"5min":0.38600000000000001,"15min":0.35599999999999998},"max":{"1min":0.72899999999999998,"5min":0.73599999999999999,"15min":0.86199999999999999},"last":0.46400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575968,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307980,"kb_used_data":2692,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063860,"statfs":{"total":96636764160,"available":96321392640,"internally_reserved":0,"allocated":2756608,"data_stored":1411044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.317,"5min":0.317,"15min":0.29799999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.54800000000000004},"min":{"1min":0.32800000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.90300000000000002},"last":0.76100000000000001}]},{"osd":1,"last update":"Thu Nov 30 18:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.83699999999999997},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.74199999999999999,"5min":0.76500000000000001,"15min":0.82899999999999996},"last":0.79100000000000004}]},{"osd":2,"last update":"Thu Nov 30 18:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.60499999999999998,"15min":0.60899999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.99199999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.61299999999999999,"15min":0.61399999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":1.173},"last":0.80300000000000005}]},{"osd":3,"last update":"Thu Nov 30 18:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.56699999999999995,"15min":0.56599999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.74399999999999999,"5min":0.77700000000000002,"15min":0.79300000000000004},"last":0.747},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58999999999999997,"15min":0.59499999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.753,"5min":0.77700000000000002,"15min":1.603},"last":0.71599999999999997}]},{"osd":4,"last update":"Thu Nov 30 18:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45800000000000002,"15min":0.45100000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.28100000000000003},"max":{"1min":0.58299999999999996,"5min":0.70299999999999996,"15min":0.75},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.436,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.54900000000000004,"5min":0.77900000000000003,"15min":0.81200000000000006},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Nov 30 18:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.505,"15min":0.5},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64200000000000002,"5min":0.76700000000000002,"15min":1.105},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57599999999999996,"15min":0.57099999999999995},"min":{"1min":0.40500000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":1.228},"last":0.72199999999999998}]},{"osd":7,"last update":"Thu Nov 30 18:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.54100000000000004,"15min":0.53600000000000003},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.625,"5min":0.80900000000000005,"15min":0.88100000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.39100000000000001,"5min":0.376,"15min":0.317},"max":{"1min":0.78700000000000003,"5min":0.82499999999999996,"15min":1.0640000000000001},"last":0.63100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T18:41:25.401 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T18:41:25.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.552+0000 7fb2dc8e1700 1 Processor -- start 2023-11-30T18:41:25.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.552+0000 7fb2dc8e1700 1 -- start start 2023-11-30T18:41:25.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.553+0000 7fb2dc8e1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb2d8064e20 0x7fb2d8155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:25.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.553+0000 7fb2dc8e1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2d8095e80 0x7fb2d8096310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:25.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.553+0000 7fb2dc8e1700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d8096800 con 0x7fb2d81544d0 2023-11-30T18:41:25.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.553+0000 7fb2dc8e1700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d8067650 con 0x7fb2d8064e20 2023-11-30T18:41:25.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.553+0000 7fb2dc8e1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d80683d0 con 0x7fb2d8095e80 2023-11-30T18:41:25.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.554+0000 7fb2d659c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb2d81544d0 0x7fb2d8066f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57374/0 (socket says 172.21.15.49:57374) 2023-11-30T18:41:25.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.554+0000 7fb2d659c700 1 -- 172.21.15.49:0/2440209098 learned_addr learned my addr 172.21.15.49:0/2440209098 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:25.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.554+0000 7fb2d5d9b700 1 --2- 172.21.15.49:0/2440209098 >> v2:172.21.15.49:3300/0 conn(0x7fb2d8064e20 0x7fb2d8155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:25.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.554+0000 7fb2d559a700 1 -- 172.21.15.49:0/2440209098 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590883805 0 0) 0x7fb2d8096800 con 0x7fb2d81544d0 2023-11-30T18:41:25.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.554+0000 7fb2d6d9d700 1 --2- 172.21.15.49:0/2440209098 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2d8095e80 0x7fb2d8096310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:25.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.554+0000 7fb2d559a700 1 -- 172.21.15.49:0/2440209098 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2c40033f0 con 0x7fb2d81544d0 2023-11-30T18:41:25.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.554+0000 7fb2d5d9b700 1 -- 172.21.15.49:0/2440209098 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2d8095e80 msgr2=0x7fb2d8096310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:25.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.554+0000 7fb2d5d9b700 1 --2- 172.21.15.49:0/2440209098 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2d8095e80 0x7fb2d8096310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:25.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.554+0000 7fb2d5d9b700 1 -- 172.21.15.49:0/2440209098 >> v1:172.21.15.49:6789/0 conn(0x7fb2d81544d0 legacy=0x7fb2d8066f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:25.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.554+0000 7fb2d5d9b700 1 -- 172.21.15.49:0/2440209098 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d8067850 con 0x7fb2d8064e20 2023-11-30T18:41:25.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.554+0000 7fb2d5d9b700 1 --2- 172.21.15.49:0/2440209098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2d8064e20 0x7fb2d8155750 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 rx=0x7fb2c0009760 tx=0x7fb2c0009060).ready entity=mon.0 client_cookie=bdea49614948eaae server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:25.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.554+0000 7fb2d559a700 1 -- 172.21.15.49:0/2440209098 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c000f510 con 0x7fb2d8064e20 2023-11-30T18:41:25.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.554+0000 7fb2d559a700 1 -- 172.21.15.49:0/2440209098 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c000f670 con 0x7fb2d8064e20 2023-11-30T18:41:25.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.554+0000 7fb2d559a700 1 -- 172.21.15.49:0/2440209098 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c000f9f0 con 0x7fb2d8064e20 2023-11-30T18:41:25.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.555+0000 7fb2dc8e1700 1 -- 172.21.15.49:0/2440209098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2d8064e20 msgr2=0x7fb2d8155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:25.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.555+0000 7fb2dc8e1700 1 --2- 172.21.15.49:0/2440209098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2d8064e20 0x7fb2d8155750 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 rx=0x7fb2c0009760 tx=0x7fb2c0009060).stop 2023-11-30T18:41:25.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.555+0000 7fb2dc8e1700 1 -- 172.21.15.49:0/2440209098 shutdown_connections 2023-11-30T18:41:25.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.555+0000 7fb2dc8e1700 1 --2- 172.21.15.49:0/2440209098 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2d8095e80 0x7fb2d8096310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:25.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.555+0000 7fb2dc8e1700 1 --2- 172.21.15.49:0/2440209098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2d8064e20 0x7fb2d8155750 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:25.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.555+0000 7fb2dc8e1700 1 -- 172.21.15.49:0/2440209098 >> 172.21.15.49:0/2440209098 conn(0x7fb2d80631d0 msgr2=0x7fb2d80c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:25.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.555+0000 7fb2dc8e1700 1 -- 172.21.15.49:0/2440209098 shutdown_connections 2023-11-30T18:41:25.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.555+0000 7fb2dc8e1700 1 -- 172.21.15.49:0/2440209098 wait complete. 2023-11-30T18:41:25.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.556+0000 7fb2dc8e1700 1 Processor -- start 2023-11-30T18:41:25.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.556+0000 7fb2dc8e1700 1 -- start start 2023-11-30T18:41:25.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.557+0000 7fb2dc8e1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2d8064e20 0x7fb2d8151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:25.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.557+0000 7fb2dc8e1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2d8095e80 0x7fb2d8158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:25.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.557+0000 7fb2dc8e1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2d81544d0 0x7fb2d80c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:25.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.557+0000 7fb2dc8e1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d8150d30 con 0x7fb2d8064e20 2023-11-30T18:41:25.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.557+0000 7fb2dc8e1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d8151640 con 0x7fb2d8095e80 2023-11-30T18:41:25.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.557+0000 7fb2dc8e1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d8158630 con 0x7fb2d81544d0 2023-11-30T18:41:25.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.557+0000 7fb2d659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2d8064e20 0x7fb2d8151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:25.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.557+0000 7fb2d659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2d8064e20 0x7fb2d8151150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43740/0 (socket says 172.21.15.49:43740) 2023-11-30T18:41:25.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.557+0000 7fb2d659c700 1 -- 172.21.15.49:0/1402087534 learned_addr learned my addr 172.21.15.49:0/1402087534 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:25.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.557+0000 7fb2d5d9b700 1 --2- 172.21.15.49:0/1402087534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2d8095e80 0x7fb2d8158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:25.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.557+0000 7fb2d6d9d700 1 --2- 172.21.15.49:0/1402087534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2d81544d0 0x7fb2d80c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:25.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.557+0000 7fb2d659c700 1 -- 172.21.15.49:0/1402087534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2d81544d0 msgr2=0x7fb2d80c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:25.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.557+0000 7fb2d659c700 1 --2- 172.21.15.49:0/1402087534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2d81544d0 0x7fb2d80c80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:25.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.557+0000 7fb2d659c700 1 -- 172.21.15.49:0/1402087534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2d8095e80 msgr2=0x7fb2d8158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:25.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.557+0000 7fb2d659c700 1 --2- 172.21.15.49:0/1402087534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2d8095e80 0x7fb2d8158140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:25.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.557+0000 7fb2d659c700 1 -- 172.21.15.49:0/1402087534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c00092a0 con 0x7fb2d8064e20 2023-11-30T18:41:25.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.557+0000 7fb2d6d9d700 1 --2- 172.21.15.49:0/1402087534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2d81544d0 0x7fb2d80c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:41:25.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.557+0000 7fb2d659c700 1 --2- 172.21.15.49:0/1402087534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2d8064e20 0x7fb2d8151150 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 rx=0x7fb2d000c440 tx=0x7fb2d0007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:25.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.557+0000 7fb2ce7fc700 1 -- 172.21.15.49:0/1402087534 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d000ce60 con 0x7fb2d8064e20 2023-11-30T18:41:25.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.557+0000 7fb2ce7fc700 1 -- 172.21.15.49:0/1402087534 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d00072e0 con 0x7fb2d8064e20 2023-11-30T18:41:25.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.557+0000 7fb2ce7fc700 1 -- 172.21.15.49:0/1402087534 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0005670 con 0x7fb2d8064e20 2023-11-30T18:41:25.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.557+0000 7fb2dc8e1700 1 -- 172.21.15.49:0/1402087534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d81500b0 con 0x7fb2d8064e20 2023-11-30T18:41:25.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.557+0000 7fb2dc8e1700 1 -- 172.21.15.49:0/1402087534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d8150670 con 0x7fb2d8064e20 2023-11-30T18:41:25.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.558+0000 7fb2dc8e1700 1 -- 172.21.15.49:0/1402087534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d8150fa0 con 0x7fb2d8064e20 2023-11-30T18:41:25.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.559+0000 7fb2ce7fc700 1 -- 172.21.15.49:0/1402087534 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb2d0005a20 con 0x7fb2d8064e20 2023-11-30T18:41:25.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.560+0000 7fb2ce7fc700 1 --2- 172.21.15.49:0/1402087534 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fb2b805f270 0x7fb2b8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:25.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.560+0000 7fb2ce7fc700 1 -- 172.21.15.49:0/1402087534 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(219..219 src has 1..219) v4 ==== 6233+0+0 (secure 0 0 0) 0x7fb2d007a100 con 0x7fb2d8064e20 2023-11-30T18:41:25.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.560+0000 7fb2d5d9b700 1 --2- 172.21.15.49:0/1402087534 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fb2b805f270 0x7fb2b8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:25.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.560+0000 7fb2d5d9b700 1 --2- 172.21.15.49:0/1402087534 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fb2b805f270 0x7fb2b8061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fb2d80c95a0 tx=0x7fb2c0017000).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:25.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.563+0000 7fb2ce7fc700 1 -- 172.21.15.49:0/1402087534 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb2d004b2a0 con 0x7fb2d8064e20 2023-11-30T18:41:25.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.731+0000 7fb2dc8e1700 1 -- 172.21.15.49:0/1402087534 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb2d806c860 con 0x7fb2b805f270 2023-11-30T18:41:25.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.741+0000 7fb2ce7fc700 1 -- 172.21.15.49:0/1402087534 <== mgr.8096 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361790 (secure 0 0 0) 0x7fb2d806c860 con 0x7fb2b805f270 2023-11-30T18:41:25.746 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:25.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.745+0000 7fb2dc8e1700 1 -- 172.21.15.49:0/1402087534 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fb2b805f270 msgr2=0x7fb2b8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:25.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.745+0000 7fb2dc8e1700 1 --2- 172.21.15.49:0/1402087534 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fb2b805f270 0x7fb2b8061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fb2d80c95a0 tx=0x7fb2c0017000).stop 2023-11-30T18:41:25.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.745+0000 7fb2dc8e1700 1 -- 172.21.15.49:0/1402087534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2d8064e20 msgr2=0x7fb2d8151150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:25.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.745+0000 7fb2dc8e1700 1 --2- 172.21.15.49:0/1402087534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2d8064e20 0x7fb2d8151150 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 rx=0x7fb2d000c440 tx=0x7fb2d0007ae0).stop 2023-11-30T18:41:25.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.745+0000 7fb2dc8e1700 1 -- 172.21.15.49:0/1402087534 shutdown_connections 2023-11-30T18:41:25.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.745+0000 7fb2dc8e1700 1 --2- 172.21.15.49:0/1402087534 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fb2b805f270 0x7fb2b8061730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:25.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.745+0000 7fb2dc8e1700 1 --2- 172.21.15.49:0/1402087534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2d81544d0 0x7fb2d80c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:25.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.745+0000 7fb2dc8e1700 1 --2- 172.21.15.49:0/1402087534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2d8064e20 0x7fb2d8151150 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:25.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.745+0000 7fb2dc8e1700 1 --2- 172.21.15.49:0/1402087534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2d8095e80 0x7fb2d8158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:25.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.745+0000 7fb2dc8e1700 1 -- 172.21.15.49:0/1402087534 >> 172.21.15.49:0/1402087534 conn(0x7fb2d80631d0 msgr2=0x7fb2d80bfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:25.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.745+0000 7fb2dc8e1700 1 -- 172.21.15.49:0/1402087534 shutdown_connections 2023-11-30T18:41:25.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.745+0000 7fb2dc8e1700 1 -- 172.21.15.49:0/1402087534 wait complete. 2023-11-30T18:41:25.750 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T18:41:25.757 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-30T18:41:24.238879+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":217,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2459808,"kb_used_data":21472,"kb_used_omap":0,"kb_used_meta":2438272,"kb_avail":752514912,"statfs":{"total":773094113280,"available":770575269888,"internally_reserved":0,"allocated":21987328,"data_stored":11287076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2496790528},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-28932,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-81,"num_write_kb":-63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.006727"},"pg_stats":[{"pgid":"26.3c","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382834+0000","last_change":"2023-11-30T18:41:21.374332+0000","last_active":"2023-11-30T18:41:21.382834+0000","last_peered":"2023-11-30T18:41:21.382834+0000","last_clean":"2023-11-30T18:41:21.382834+0000","last_became_active":"2023-11-30T18:41:21.374012+0000","last_became_peered":"2023-11-30T18:41:21.374012+0000","last_unstale":"2023-11-30T18:41:21.382834+0000","last_undegraded":"2023-11-30T18:41:21.382834+0000","last_fullsized":"2023-11-30T18:41:21.382834+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.3f","version":"218'3","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.375825+0000","last_change":"2023-11-30T18:41:20.983040+0000","last_active":"2023-11-30T18:41:21.375825+0000","last_peered":"2023-11-30T18:41:21.375825+0000","last_clean":"2023-11-30T18:41:21.375825+0000","last_became_active":"2023-11-30T18:41:20.982842+0000","last_became_peered":"2023-11-30T18:41:20.982842+0000","last_unstale":"2023-11-30T18:41:21.375825+0000","last_undegraded":"2023-11-30T18:41:21.375825+0000","last_fullsized":"2023-11-30T18:41:21.375825+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.377170+0000","last_change":"2023-11-30T18:41:21.371025+0000","last_active":"2023-11-30T18:41:21.377170+0000","last_peered":"2023-11-30T18:41:21.377170+0000","last_clean":"2023-11-30T18:41:21.377170+0000","last_became_active":"2023-11-30T18:41:21.370691+0000","last_became_peered":"2023-11-30T18:41:21.370691+0000","last_unstale":"2023-11-30T18:41:21.377170+0000","last_undegraded":"2023-11-30T18:41:21.377170+0000","last_fullsized":"2023-11-30T18:41:21.377170+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.357384+0000","last_change":"2023-11-30T18:41:20.979506+0000","last_active":"2023-11-30T18:41:21.357384+0000","last_peered":"2023-11-30T18:41:21.357384+0000","last_clean":"2023-11-30T18:41:21.357384+0000","last_became_active":"2023-11-30T18:41:20.979201+0000","last_became_peered":"2023-11-30T18:41:20.979201+0000","last_unstale":"2023-11-30T18:41:21.357384+0000","last_undegraded":"2023-11-30T18:41:21.357384+0000","last_fullsized":"2023-11-30T18:41:21.357384+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382350+0000","last_change":"2023-11-30T18:41:21.381779+0000","last_active":"2023-11-30T18:41:21.382350+0000","last_peered":"2023-11-30T18:41:21.382350+0000","last_clean":"2023-11-30T18:41:21.382350+0000","last_became_active":"2023-11-30T18:41:21.381414+0000","last_became_peered":"2023-11-30T18:41:21.381414+0000","last_unstale":"2023-11-30T18:41:21.382350+0000","last_undegraded":"2023-11-30T18:41:21.382350+0000","last_fullsized":"2023-11-30T18:41:21.382350+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.361319+0000","last_change":"2023-11-30T18:41:20.986452+0000","last_active":"2023-11-30T18:41:21.361319+0000","last_peered":"2023-11-30T18:41:21.361319+0000","last_clean":"2023-11-30T18:41:21.361319+0000","last_became_active":"2023-11-30T18:41:20.986134+0000","last_became_peered":"2023-11-30T18:41:20.986134+0000","last_unstale":"2023-11-30T18:41:21.361319+0000","last_undegraded":"2023-11-30T18:41:21.361319+0000","last_fullsized":"2023-11-30T18:41:21.361319+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3f","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.379323+0000","last_change":"2023-11-30T18:41:21.373494+0000","last_active":"2023-11-30T18:41:21.379323+0000","last_peered":"2023-11-30T18:41:21.379323+0000","last_clean":"2023-11-30T18:41:21.379323+0000","last_became_active":"2023-11-30T18:41:21.373176+0000","last_became_peered":"2023-11-30T18:41:21.373176+0000","last_unstale":"2023-11-30T18:41:21.379323+0000","last_undegraded":"2023-11-30T18:41:21.379323+0000","last_fullsized":"2023-11-30T18:41:21.379323+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"218'2","reported_seq":12,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.377731+0000","last_change":"2023-11-30T18:41:20.979454+0000","last_active":"2023-11-30T18:41:21.377731+0000","last_peered":"2023-11-30T18:41:21.377731+0000","last_clean":"2023-11-30T18:41:21.377731+0000","last_became_active":"2023-11-30T18:41:20.979178+0000","last_became_peered":"2023-11-30T18:41:20.979178+0000","last_unstale":"2023-11-30T18:41:21.377731+0000","last_undegraded":"2023-11-30T18:41:21.377731+0000","last_fullsized":"2023-11-30T18:41:21.377731+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382709+0000","last_change":"2023-11-30T18:41:21.376814+0000","last_active":"2023-11-30T18:41:21.382709+0000","last_peered":"2023-11-30T18:41:21.382709+0000","last_clean":"2023-11-30T18:41:21.382709+0000","last_became_active":"2023-11-30T18:41:21.376526+0000","last_became_peered":"2023-11-30T18:41:21.376526+0000","last_unstale":"2023-11-30T18:41:21.382709+0000","last_undegraded":"2023-11-30T18:41:21.382709+0000","last_fullsized":"2023-11-30T18:41:21.382709+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3b","version":"218'1","reported_seq":11,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.381165+0000","last_change":"2023-11-30T18:41:20.977633+0000","last_active":"2023-11-30T18:41:21.381165+0000","last_peered":"2023-11-30T18:41:21.381165+0000","last_clean":"2023-11-30T18:41:21.381165+0000","last_became_active":"2023-11-30T18:41:20.977332+0000","last_became_peered":"2023-11-30T18:41:20.977332+0000","last_unstale":"2023-11-30T18:41:21.381165+0000","last_undegraded":"2023-11-30T18:41:21.381165+0000","last_fullsized":"2023-11-30T18:41:21.381165+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.369874+0000","last_change":"2023-11-30T18:41:21.366707+0000","last_active":"2023-11-30T18:41:21.369874+0000","last_peered":"2023-11-30T18:41:21.369874+0000","last_clean":"2023-11-30T18:41:21.369874+0000","last_became_active":"2023-11-30T18:41:21.366073+0000","last_became_peered":"2023-11-30T18:41:21.366073+0000","last_unstale":"2023-11-30T18:41:21.369874+0000","last_undegraded":"2023-11-30T18:41:21.369874+0000","last_fullsized":"2023-11-30T18:41:21.369874+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"218'1","reported_seq":11,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.371850+0000","last_change":"2023-11-30T18:41:20.981829+0000","last_active":"2023-11-30T18:41:21.371850+0000","last_peered":"2023-11-30T18:41:21.371850+0000","last_clean":"2023-11-30T18:41:21.371850+0000","last_became_active":"2023-11-30T18:41:20.981532+0000","last_became_peered":"2023-11-30T18:41:20.981532+0000","last_unstale":"2023-11-30T18:41:21.371850+0000","last_undegraded":"2023-11-30T18:41:21.371850+0000","last_fullsized":"2023-11-30T18:41:21.371850+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.384922+0000","last_change":"2023-11-30T18:41:21.376312+0000","last_active":"2023-11-30T18:41:21.384922+0000","last_peered":"2023-11-30T18:41:21.384922+0000","last_clean":"2023-11-30T18:41:21.384922+0000","last_became_active":"2023-11-30T18:41:21.376010+0000","last_became_peered":"2023-11-30T18:41:21.376010+0000","last_unstale":"2023-11-30T18:41:21.384922+0000","last_undegraded":"2023-11-30T18:41:21.384922+0000","last_fullsized":"2023-11-30T18:41:21.384922+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.364566+0000","last_change":"2023-11-30T18:41:20.984609+0000","last_active":"2023-11-30T18:41:21.364566+0000","last_peered":"2023-11-30T18:41:21.364566+0000","last_clean":"2023-11-30T18:41:21.364566+0000","last_became_active":"2023-11-30T18:41:20.984292+0000","last_became_peered":"2023-11-30T18:41:20.984292+0000","last_unstale":"2023-11-30T18:41:21.364566+0000","last_undegraded":"2023-11-30T18:41:21.364566+0000","last_fullsized":"2023-11-30T18:41:21.364566+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.383628+0000","last_change":"2023-11-30T18:41:21.370543+0000","last_active":"2023-11-30T18:41:21.383628+0000","last_peered":"2023-11-30T18:41:21.383628+0000","last_clean":"2023-11-30T18:41:21.383628+0000","last_became_active":"2023-11-30T18:41:21.369771+0000","last_became_peered":"2023-11-30T18:41:21.369771+0000","last_unstale":"2023-11-30T18:41:21.383628+0000","last_undegraded":"2023-11-30T18:41:21.383628+0000","last_fullsized":"2023-11-30T18:41:21.383628+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.362968+0000","last_change":"2023-11-30T18:41:20.988516+0000","last_active":"2023-11-30T18:41:21.362968+0000","last_peered":"2023-11-30T18:41:21.362968+0000","last_clean":"2023-11-30T18:41:21.362968+0000","last_became_active":"2023-11-30T18:41:20.988216+0000","last_became_peered":"2023-11-30T18:41:20.988216+0000","last_unstale":"2023-11-30T18:41:21.362968+0000","last_undegraded":"2023-11-30T18:41:21.362968+0000","last_fullsized":"2023-11-30T18:41:21.362968+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.375379+0000","last_change":"2023-11-30T18:41:21.366663+0000","last_active":"2023-11-30T18:41:21.375379+0000","last_peered":"2023-11-30T18:41:21.375379+0000","last_clean":"2023-11-30T18:41:21.375379+0000","last_became_active":"2023-11-30T18:41:21.366367+0000","last_became_peered":"2023-11-30T18:41:21.366367+0000","last_unstale":"2023-11-30T18:41:21.375379+0000","last_undegraded":"2023-11-30T18:41:21.375379+0000","last_fullsized":"2023-11-30T18:41:21.375379+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.369624+0000","last_change":"2023-11-30T18:41:20.979376+0000","last_active":"2023-11-30T18:41:21.369624+0000","last_peered":"2023-11-30T18:41:21.369624+0000","last_clean":"2023-11-30T18:41:21.369624+0000","last_became_active":"2023-11-30T18:41:20.979079+0000","last_became_peered":"2023-11-30T18:41:20.979079+0000","last_unstale":"2023-11-30T18:41:21.369624+0000","last_undegraded":"2023-11-30T18:41:21.369624+0000","last_fullsized":"2023-11-30T18:41:21.369624+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382919+0000","last_change":"2023-11-30T18:41:21.378398+0000","last_active":"2023-11-30T18:41:21.382919+0000","last_peered":"2023-11-30T18:41:21.382919+0000","last_clean":"2023-11-30T18:41:21.382919+0000","last_became_active":"2023-11-30T18:41:21.378087+0000","last_became_peered":"2023-11-30T18:41:21.378087+0000","last_unstale":"2023-11-30T18:41:21.382919+0000","last_undegraded":"2023-11-30T18:41:21.382919+0000","last_fullsized":"2023-11-30T18:41:21.382919+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.358532+0000","last_change":"2023-11-30T18:41:20.979619+0000","last_active":"2023-11-30T18:41:21.358532+0000","last_peered":"2023-11-30T18:41:21.358532+0000","last_clean":"2023-11-30T18:41:21.358532+0000","last_became_active":"2023-11-30T18:41:20.979335+0000","last_became_peered":"2023-11-30T18:41:20.979335+0000","last_unstale":"2023-11-30T18:41:21.358532+0000","last_undegraded":"2023-11-30T18:41:21.358532+0000","last_fullsized":"2023-11-30T18:41:21.358532+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.385019+0000","last_change":"2023-11-30T18:41:21.377885+0000","last_active":"2023-11-30T18:41:21.385019+0000","last_peered":"2023-11-30T18:41:21.385019+0000","last_clean":"2023-11-30T18:41:21.385019+0000","last_became_active":"2023-11-30T18:41:21.377291+0000","last_became_peered":"2023-11-30T18:41:21.377291+0000","last_unstale":"2023-11-30T18:41:21.385019+0000","last_undegraded":"2023-11-30T18:41:21.385019+0000","last_fullsized":"2023-11-30T18:41:21.385019+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.366867+0000","last_change":"2023-11-30T18:41:20.984959+0000","last_active":"2023-11-30T18:41:21.366867+0000","last_peered":"2023-11-30T18:41:21.366867+0000","last_clean":"2023-11-30T18:41:21.366867+0000","last_became_active":"2023-11-30T18:41:20.984741+0000","last_became_peered":"2023-11-30T18:41:20.984741+0000","last_unstale":"2023-11-30T18:41:21.366867+0000","last_undegraded":"2023-11-30T18:41:21.366867+0000","last_fullsized":"2023-11-30T18:41:21.366867+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.380926+0000","last_change":"2023-11-30T18:41:21.379212+0000","last_active":"2023-11-30T18:41:21.380926+0000","last_peered":"2023-11-30T18:41:21.380926+0000","last_clean":"2023-11-30T18:41:21.380926+0000","last_became_active":"2023-11-30T18:41:21.378946+0000","last_became_peered":"2023-11-30T18:41:21.378946+0000","last_unstale":"2023-11-30T18:41:21.380926+0000","last_undegraded":"2023-11-30T18:41:21.380926+0000","last_fullsized":"2023-11-30T18:41:21.380926+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.34","version":"218'4","reported_seq":14,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.385176+0000","last_change":"2023-11-30T18:41:20.977031+0000","last_active":"2023-11-30T18:41:21.385176+0000","last_peered":"2023-11-30T18:41:21.385176+0000","last_clean":"2023-11-30T18:41:21.385176+0000","last_became_active":"2023-11-30T18:41:20.976716+0000","last_became_peered":"2023-11-30T18:41:20.976716+0000","last_unstale":"2023-11-30T18:41:21.385176+0000","last_undegraded":"2023-11-30T18:41:21.385176+0000","last_fullsized":"2023-11-30T18:41:21.385176+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.384818+0000","last_change":"2023-11-30T18:41:21.378135+0000","last_active":"2023-11-30T18:41:21.384818+0000","last_peered":"2023-11-30T18:41:21.384818+0000","last_clean":"2023-11-30T18:41:21.384818+0000","last_became_active":"2023-11-30T18:41:21.377709+0000","last_became_peered":"2023-11-30T18:41:21.377709+0000","last_unstale":"2023-11-30T18:41:21.384818+0000","last_undegraded":"2023-11-30T18:41:21.384818+0000","last_fullsized":"2023-11-30T18:41:21.384818+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.33","version":"218'1","reported_seq":11,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.380824+0000","last_change":"2023-11-30T18:41:20.985654+0000","last_active":"2023-11-30T18:41:21.380824+0000","last_peered":"2023-11-30T18:41:21.380824+0000","last_clean":"2023-11-30T18:41:21.380824+0000","last_became_active":"2023-11-30T18:41:20.985412+0000","last_became_peered":"2023-11-30T18:41:20.985412+0000","last_unstale":"2023-11-30T18:41:21.380824+0000","last_undegraded":"2023-11-30T18:41:21.380824+0000","last_fullsized":"2023-11-30T18:41:21.380824+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.378751+0000","last_change":"2023-11-30T18:41:21.376374+0000","last_active":"2023-11-30T18:41:21.378751+0000","last_peered":"2023-11-30T18:41:21.378751+0000","last_clean":"2023-11-30T18:41:21.378751+0000","last_became_active":"2023-11-30T18:41:21.376100+0000","last_became_peered":"2023-11-30T18:41:21.376100+0000","last_unstale":"2023-11-30T18:41:21.378751+0000","last_undegraded":"2023-11-30T18:41:21.378751+0000","last_fullsized":"2023-11-30T18:41:21.378751+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.368304+0000","last_change":"2023-11-30T18:41:20.980132+0000","last_active":"2023-11-30T18:41:21.368304+0000","last_peered":"2023-11-30T18:41:21.368304+0000","last_clean":"2023-11-30T18:41:21.368304+0000","last_became_active":"2023-11-30T18:41:20.979834+0000","last_became_peered":"2023-11-30T18:41:20.979834+0000","last_unstale":"2023-11-30T18:41:21.368304+0000","last_undegraded":"2023-11-30T18:41:21.368304+0000","last_fullsized":"2023-11-30T18:41:21.368304+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.370929+0000","last_change":"2023-11-30T18:41:21.370346+0000","last_active":"2023-11-30T18:41:21.370929+0000","last_peered":"2023-11-30T18:41:21.370929+0000","last_clean":"2023-11-30T18:41:21.370929+0000","last_became_active":"2023-11-30T18:41:21.370136+0000","last_became_peered":"2023-11-30T18:41:21.370136+0000","last_unstale":"2023-11-30T18:41:21.370929+0000","last_undegraded":"2023-11-30T18:41:21.370929+0000","last_fullsized":"2023-11-30T18:41:21.370929+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.357015+0000","last_change":"2023-11-30T18:41:20.976814+0000","last_active":"2023-11-30T18:41:21.357015+0000","last_peered":"2023-11-30T18:41:21.357015+0000","last_clean":"2023-11-30T18:41:21.357015+0000","last_became_active":"2023-11-30T18:41:20.976503+0000","last_became_peered":"2023-11-30T18:41:20.976503+0000","last_unstale":"2023-11-30T18:41:21.357015+0000","last_undegraded":"2023-11-30T18:41:21.357015+0000","last_fullsized":"2023-11-30T18:41:21.357015+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382434+0000","last_change":"2023-11-30T18:41:21.377940+0000","last_active":"2023-11-30T18:41:21.382434+0000","last_peered":"2023-11-30T18:41:21.382434+0000","last_clean":"2023-11-30T18:41:21.382434+0000","last_became_active":"2023-11-30T18:41:21.377335+0000","last_became_peered":"2023-11-30T18:41:21.377335+0000","last_unstale":"2023-11-30T18:41:21.382434+0000","last_undegraded":"2023-11-30T18:41:21.382434+0000","last_fullsized":"2023-11-30T18:41:21.382434+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.30","version":"218'4","reported_seq":14,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.384748+0000","last_change":"2023-11-30T18:41:20.979102+0000","last_active":"2023-11-30T18:41:21.384748+0000","last_peered":"2023-11-30T18:41:21.384748+0000","last_clean":"2023-11-30T18:41:21.384748+0000","last_became_active":"2023-11-30T18:41:20.978385+0000","last_became_peered":"2023-11-30T18:41:20.978385+0000","last_unstale":"2023-11-30T18:41:21.384748+0000","last_undegraded":"2023-11-30T18:41:21.384748+0000","last_fullsized":"2023-11-30T18:41:21.384748+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.384968+0000","last_change":"2023-11-30T18:41:21.379816+0000","last_active":"2023-11-30T18:41:21.384968+0000","last_peered":"2023-11-30T18:41:21.384968+0000","last_clean":"2023-11-30T18:41:21.384968+0000","last_became_active":"2023-11-30T18:41:21.379513+0000","last_became_peered":"2023-11-30T18:41:21.379513+0000","last_unstale":"2023-11-30T18:41:21.384968+0000","last_undegraded":"2023-11-30T18:41:21.384968+0000","last_fullsized":"2023-11-30T18:41:21.384968+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.357036+0000","last_change":"2023-11-30T18:41:20.975583+0000","last_active":"2023-11-30T18:41:21.357036+0000","last_peered":"2023-11-30T18:41:21.357036+0000","last_clean":"2023-11-30T18:41:21.357036+0000","last_became_active":"2023-11-30T18:41:20.974358+0000","last_became_peered":"2023-11-30T18:41:20.974358+0000","last_unstale":"2023-11-30T18:41:21.357036+0000","last_undegraded":"2023-11-30T18:41:21.357036+0000","last_fullsized":"2023-11-30T18:41:21.357036+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.377605+0000","last_change":"2023-11-30T18:41:21.374080+0000","last_active":"2023-11-30T18:41:21.377605+0000","last_peered":"2023-11-30T18:41:21.377605+0000","last_clean":"2023-11-30T18:41:21.377605+0000","last_became_active":"2023-11-30T18:41:21.372562+0000","last_became_peered":"2023-11-30T18:41:21.372562+0000","last_unstale":"2023-11-30T18:41:21.377605+0000","last_undegraded":"2023-11-30T18:41:21.377605+0000","last_fullsized":"2023-11-30T18:41:21.377605+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.363152+0000","last_change":"2023-11-30T18:41:20.979600+0000","last_active":"2023-11-30T18:41:21.363152+0000","last_peered":"2023-11-30T18:41:21.363152+0000","last_clean":"2023-11-30T18:41:21.363152+0000","last_became_active":"2023-11-30T18:41:20.979305+0000","last_became_peered":"2023-11-30T18:41:20.979305+0000","last_unstale":"2023-11-30T18:41:21.363152+0000","last_undegraded":"2023-11-30T18:41:21.363152+0000","last_fullsized":"2023-11-30T18:41:21.363152+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.377913+0000","last_change":"2023-11-30T18:41:21.372885+0000","last_active":"2023-11-30T18:41:21.377913+0000","last_peered":"2023-11-30T18:41:21.377913+0000","last_clean":"2023-11-30T18:41:21.377913+0000","last_became_active":"2023-11-30T18:41:21.372530+0000","last_became_peered":"2023-11-30T18:41:21.372530+0000","last_unstale":"2023-11-30T18:41:21.377913+0000","last_undegraded":"2023-11-30T18:41:21.377913+0000","last_fullsized":"2023-11-30T18:41:21.377913+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2d","version":"218'1","reported_seq":11,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382630+0000","last_change":"2023-11-30T18:41:20.981381+0000","last_active":"2023-11-30T18:41:21.382630+0000","last_peered":"2023-11-30T18:41:21.382630+0000","last_clean":"2023-11-30T18:41:21.382630+0000","last_became_active":"2023-11-30T18:41:20.980805+0000","last_became_peered":"2023-11-30T18:41:20.980805+0000","last_unstale":"2023-11-30T18:41:21.382630+0000","last_undegraded":"2023-11-30T18:41:21.382630+0000","last_fullsized":"2023-11-30T18:41:21.382630+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.385037+0000","last_change":"2023-11-30T18:41:21.383228+0000","last_active":"2023-11-30T18:41:21.385037+0000","last_peered":"2023-11-30T18:41:21.385037+0000","last_clean":"2023-11-30T18:41:21.385037+0000","last_became_active":"2023-11-30T18:41:21.382982+0000","last_became_peered":"2023-11-30T18:41:21.382982+0000","last_unstale":"2023-11-30T18:41:21.385037+0000","last_undegraded":"2023-11-30T18:41:21.385037+0000","last_fullsized":"2023-11-30T18:41:21.385037+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.357452+0000","last_change":"2023-11-30T18:41:20.976097+0000","last_active":"2023-11-30T18:41:21.357452+0000","last_peered":"2023-11-30T18:41:21.357452+0000","last_clean":"2023-11-30T18:41:21.357452+0000","last_became_active":"2023-11-30T18:41:20.975833+0000","last_became_peered":"2023-11-30T18:41:20.975833+0000","last_unstale":"2023-11-30T18:41:21.357452+0000","last_undegraded":"2023-11-30T18:41:21.357452+0000","last_fullsized":"2023-11-30T18:41:21.357452+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.373439+0000","last_change":"2023-11-30T18:41:21.370277+0000","last_active":"2023-11-30T18:41:21.373439+0000","last_peered":"2023-11-30T18:41:21.373439+0000","last_clean":"2023-11-30T18:41:21.373439+0000","last_became_active":"2023-11-30T18:41:21.369969+0000","last_became_peered":"2023-11-30T18:41:21.369969+0000","last_unstale":"2023-11-30T18:41:21.373439+0000","last_undegraded":"2023-11-30T18:41:21.373439+0000","last_fullsized":"2023-11-30T18:41:21.373439+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.2b","version":"218'1","reported_seq":11,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.381298+0000","last_change":"2023-11-30T18:41:20.977671+0000","last_active":"2023-11-30T18:41:21.381298+0000","last_peered":"2023-11-30T18:41:21.381298+0000","last_clean":"2023-11-30T18:41:21.381298+0000","last_became_active":"2023-11-30T18:41:20.977316+0000","last_became_peered":"2023-11-30T18:41:20.977316+0000","last_unstale":"2023-11-30T18:41:21.381298+0000","last_undegraded":"2023-11-30T18:41:21.381298+0000","last_fullsized":"2023-11-30T18:41:21.381298+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382273+0000","last_change":"2023-11-30T18:41:21.375934+0000","last_active":"2023-11-30T18:41:21.382273+0000","last_peered":"2023-11-30T18:41:21.382273+0000","last_clean":"2023-11-30T18:41:21.382273+0000","last_became_active":"2023-11-30T18:41:21.375609+0000","last_became_peered":"2023-11-30T18:41:21.375609+0000","last_unstale":"2023-11-30T18:41:21.382273+0000","last_undegraded":"2023-11-30T18:41:21.382273+0000","last_fullsized":"2023-11-30T18:41:21.382273+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.359169+0000","last_change":"2023-11-30T18:41:20.981771+0000","last_active":"2023-11-30T18:41:21.359169+0000","last_peered":"2023-11-30T18:41:21.359169+0000","last_clean":"2023-11-30T18:41:21.359169+0000","last_became_active":"2023-11-30T18:41:20.981177+0000","last_became_peered":"2023-11-30T18:41:20.981177+0000","last_unstale":"2023-11-30T18:41:21.359169+0000","last_undegraded":"2023-11-30T18:41:21.359169+0000","last_fullsized":"2023-11-30T18:41:21.359169+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.379151+0000","last_change":"2023-11-30T18:41:21.377531+0000","last_active":"2023-11-30T18:41:21.379151+0000","last_peered":"2023-11-30T18:41:21.379151+0000","last_clean":"2023-11-30T18:41:21.379151+0000","last_became_active":"2023-11-30T18:41:21.377268+0000","last_became_peered":"2023-11-30T18:41:21.377268+0000","last_unstale":"2023-11-30T18:41:21.379151+0000","last_undegraded":"2023-11-30T18:41:21.379151+0000","last_fullsized":"2023-11-30T18:41:21.379151+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.359633+0000","last_change":"2023-11-30T18:41:20.986392+0000","last_active":"2023-11-30T18:41:21.359633+0000","last_peered":"2023-11-30T18:41:21.359633+0000","last_clean":"2023-11-30T18:41:21.359633+0000","last_became_active":"2023-11-30T18:41:20.986009+0000","last_became_peered":"2023-11-30T18:41:20.986009+0000","last_unstale":"2023-11-30T18:41:21.359633+0000","last_undegraded":"2023-11-30T18:41:21.359633+0000","last_fullsized":"2023-11-30T18:41:21.359633+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.379393+0000","last_change":"2023-11-30T18:41:21.377394+0000","last_active":"2023-11-30T18:41:21.379393+0000","last_peered":"2023-11-30T18:41:21.379393+0000","last_clean":"2023-11-30T18:41:21.379393+0000","last_became_active":"2023-11-30T18:41:21.377096+0000","last_became_peered":"2023-11-30T18:41:21.377096+0000","last_unstale":"2023-11-30T18:41:21.379393+0000","last_undegraded":"2023-11-30T18:41:21.379393+0000","last_fullsized":"2023-11-30T18:41:21.379393+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.363165+0000","last_change":"2023-11-30T18:41:20.981154+0000","last_active":"2023-11-30T18:41:21.363165+0000","last_peered":"2023-11-30T18:41:21.363165+0000","last_clean":"2023-11-30T18:41:21.363165+0000","last_became_active":"2023-11-30T18:41:20.980204+0000","last_became_peered":"2023-11-30T18:41:20.980204+0000","last_unstale":"2023-11-30T18:41:21.363165+0000","last_undegraded":"2023-11-30T18:41:21.363165+0000","last_fullsized":"2023-11-30T18:41:21.363165+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.384471+0000","last_change":"2023-11-30T18:41:21.372972+0000","last_active":"2023-11-30T18:41:21.384471+0000","last_peered":"2023-11-30T18:41:21.384471+0000","last_clean":"2023-11-30T18:41:21.384471+0000","last_became_active":"2023-11-30T18:41:21.372693+0000","last_became_peered":"2023-11-30T18:41:21.372693+0000","last_unstale":"2023-11-30T18:41:21.384471+0000","last_undegraded":"2023-11-30T18:41:21.384471+0000","last_fullsized":"2023-11-30T18:41:21.384471+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.357296+0000","last_change":"2023-11-30T18:41:20.981094+0000","last_active":"2023-11-30T18:41:21.357296+0000","last_peered":"2023-11-30T18:41:21.357296+0000","last_clean":"2023-11-30T18:41:21.357296+0000","last_became_active":"2023-11-30T18:41:20.980805+0000","last_became_peered":"2023-11-30T18:41:20.980805+0000","last_unstale":"2023-11-30T18:41:21.357296+0000","last_undegraded":"2023-11-30T18:41:21.357296+0000","last_fullsized":"2023-11-30T18:41:21.357296+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.375197+0000","last_change":"2023-11-30T18:41:21.372047+0000","last_active":"2023-11-30T18:41:21.375197+0000","last_peered":"2023-11-30T18:41:21.375197+0000","last_clean":"2023-11-30T18:41:21.375197+0000","last_became_active":"2023-11-30T18:41:21.371733+0000","last_became_peered":"2023-11-30T18:41:21.371733+0000","last_unstale":"2023-11-30T18:41:21.375197+0000","last_undegraded":"2023-11-30T18:41:21.375197+0000","last_fullsized":"2023-11-30T18:41:21.375197+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.367426+0000","last_change":"2023-11-30T18:41:20.984398+0000","last_active":"2023-11-30T18:41:21.367426+0000","last_peered":"2023-11-30T18:41:21.367426+0000","last_clean":"2023-11-30T18:41:21.367426+0000","last_became_active":"2023-11-30T18:41:20.984070+0000","last_became_peered":"2023-11-30T18:41:20.984070+0000","last_unstale":"2023-11-30T18:41:21.367426+0000","last_undegraded":"2023-11-30T18:41:21.367426+0000","last_fullsized":"2023-11-30T18:41:21.367426+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.383031+0000","last_change":"2023-11-30T18:41:21.378248+0000","last_active":"2023-11-30T18:41:21.383031+0000","last_peered":"2023-11-30T18:41:21.383031+0000","last_clean":"2023-11-30T18:41:21.383031+0000","last_became_active":"2023-11-30T18:41:21.375027+0000","last_became_peered":"2023-11-30T18:41:21.375027+0000","last_unstale":"2023-11-30T18:41:21.383031+0000","last_undegraded":"2023-11-30T18:41:21.383031+0000","last_fullsized":"2023-11-30T18:41:21.383031+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.361305+0000","last_change":"2023-11-30T18:41:20.981919+0000","last_active":"2023-11-30T18:41:21.361305+0000","last_peered":"2023-11-30T18:41:21.361305+0000","last_clean":"2023-11-30T18:41:21.361305+0000","last_became_active":"2023-11-30T18:41:20.981631+0000","last_became_peered":"2023-11-30T18:41:20.981631+0000","last_unstale":"2023-11-30T18:41:21.361305+0000","last_undegraded":"2023-11-30T18:41:21.361305+0000","last_fullsized":"2023-11-30T18:41:21.361305+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.380933+0000","last_change":"2023-11-30T18:41:21.377985+0000","last_active":"2023-11-30T18:41:21.380933+0000","last_peered":"2023-11-30T18:41:21.380933+0000","last_clean":"2023-11-30T18:41:21.380933+0000","last_became_active":"2023-11-30T18:41:21.377674+0000","last_became_peered":"2023-11-30T18:41:21.377674+0000","last_unstale":"2023-11-30T18:41:21.380933+0000","last_undegraded":"2023-11-30T18:41:21.380933+0000","last_fullsized":"2023-11-30T18:41:21.380933+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.357587+0000","last_change":"2023-11-30T18:41:20.987050+0000","last_active":"2023-11-30T18:41:21.357587+0000","last_peered":"2023-11-30T18:41:21.357587+0000","last_clean":"2023-11-30T18:41:21.357587+0000","last_became_active":"2023-11-30T18:41:20.986681+0000","last_became_peered":"2023-11-30T18:41:20.986681+0000","last_unstale":"2023-11-30T18:41:21.357587+0000","last_undegraded":"2023-11-30T18:41:21.357587+0000","last_fullsized":"2023-11-30T18:41:21.357587+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.384805+0000","last_change":"2023-11-30T18:41:21.374050+0000","last_active":"2023-11-30T18:41:21.384805+0000","last_peered":"2023-11-30T18:41:21.384805+0000","last_clean":"2023-11-30T18:41:21.384805+0000","last_became_active":"2023-11-30T18:41:21.373769+0000","last_became_peered":"2023-11-30T18:41:21.373769+0000","last_unstale":"2023-11-30T18:41:21.384805+0000","last_undegraded":"2023-11-30T18:41:21.384805+0000","last_fullsized":"2023-11-30T18:41:21.384805+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.357449+0000","last_change":"2023-11-30T18:41:20.974292+0000","last_active":"2023-11-30T18:41:21.357449+0000","last_peered":"2023-11-30T18:41:21.357449+0000","last_clean":"2023-11-30T18:41:21.357449+0000","last_became_active":"2023-11-30T18:41:20.973996+0000","last_became_peered":"2023-11-30T18:41:20.973996+0000","last_unstale":"2023-11-30T18:41:21.357449+0000","last_undegraded":"2023-11-30T18:41:21.357449+0000","last_fullsized":"2023-11-30T18:41:21.357449+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.369893+0000","last_change":"2023-11-30T18:41:21.366876+0000","last_active":"2023-11-30T18:41:21.369893+0000","last_peered":"2023-11-30T18:41:21.369893+0000","last_clean":"2023-11-30T18:41:21.369893+0000","last_became_active":"2023-11-30T18:41:21.366432+0000","last_became_peered":"2023-11-30T18:41:21.366432+0000","last_unstale":"2023-11-30T18:41:21.369893+0000","last_undegraded":"2023-11-30T18:41:21.369893+0000","last_fullsized":"2023-11-30T18:41:21.369893+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.368417+0000","last_change":"2023-11-30T18:41:20.982138+0000","last_active":"2023-11-30T18:41:21.368417+0000","last_peered":"2023-11-30T18:41:21.368417+0000","last_clean":"2023-11-30T18:41:21.368417+0000","last_became_active":"2023-11-30T18:41:20.980457+0000","last_became_peered":"2023-11-30T18:41:20.980457+0000","last_unstale":"2023-11-30T18:41:21.368417+0000","last_undegraded":"2023-11-30T18:41:21.368417+0000","last_fullsized":"2023-11-30T18:41:21.368417+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382561+0000","last_change":"2023-11-30T18:41:21.374060+0000","last_active":"2023-11-30T18:41:21.382561+0000","last_peered":"2023-11-30T18:41:21.382561+0000","last_clean":"2023-11-30T18:41:21.382561+0000","last_became_active":"2023-11-30T18:41:21.373792+0000","last_became_peered":"2023-11-30T18:41:21.373792+0000","last_unstale":"2023-11-30T18:41:21.382561+0000","last_undegraded":"2023-11-30T18:41:21.382561+0000","last_fullsized":"2023-11-30T18:41:21.382561+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.359530+0000","last_change":"2023-11-30T18:41:20.989922+0000","last_active":"2023-11-30T18:41:21.359530+0000","last_peered":"2023-11-30T18:41:21.359530+0000","last_clean":"2023-11-30T18:41:21.359530+0000","last_became_active":"2023-11-30T18:41:20.989651+0000","last_became_peered":"2023-11-30T18:41:20.989651+0000","last_unstale":"2023-11-30T18:41:21.359530+0000","last_undegraded":"2023-11-30T18:41:21.359530+0000","last_fullsized":"2023-11-30T18:41:21.359530+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382759+0000","last_change":"2023-11-30T18:41:21.374454+0000","last_active":"2023-11-30T18:41:21.382759+0000","last_peered":"2023-11-30T18:41:21.382759+0000","last_clean":"2023-11-30T18:41:21.382759+0000","last_became_active":"2023-11-30T18:41:21.374188+0000","last_became_peered":"2023-11-30T18:41:21.374188+0000","last_unstale":"2023-11-30T18:41:21.382759+0000","last_undegraded":"2023-11-30T18:41:21.382759+0000","last_fullsized":"2023-11-30T18:41:21.382759+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.355161+0000","last_change":"2023-11-30T18:41:20.985764+0000","last_active":"2023-11-30T18:41:21.355161+0000","last_peered":"2023-11-30T18:41:21.355161+0000","last_clean":"2023-11-30T18:41:21.355161+0000","last_became_active":"2023-11-30T18:41:20.985447+0000","last_became_peered":"2023-11-30T18:41:20.985447+0000","last_unstale":"2023-11-30T18:41:21.355161+0000","last_undegraded":"2023-11-30T18:41:21.355161+0000","last_fullsized":"2023-11-30T18:41:21.355161+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.383100+0000","last_change":"2023-11-30T18:41:21.378091+0000","last_active":"2023-11-30T18:41:21.383100+0000","last_peered":"2023-11-30T18:41:21.383100+0000","last_clean":"2023-11-30T18:41:21.383100+0000","last_became_active":"2023-11-30T18:41:21.377782+0000","last_became_peered":"2023-11-30T18:41:21.377782+0000","last_unstale":"2023-11-30T18:41:21.383100+0000","last_undegraded":"2023-11-30T18:41:21.383100+0000","last_fullsized":"2023-11-30T18:41:21.383100+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.367096+0000","last_change":"2023-11-30T18:41:20.978712+0000","last_active":"2023-11-30T18:41:21.367096+0000","last_peered":"2023-11-30T18:41:21.367096+0000","last_clean":"2023-11-30T18:41:21.367096+0000","last_became_active":"2023-11-30T18:41:20.977951+0000","last_became_peered":"2023-11-30T18:41:20.977951+0000","last_unstale":"2023-11-30T18:41:21.367096+0000","last_undegraded":"2023-11-30T18:41:21.367096+0000","last_fullsized":"2023-11-30T18:41:21.367096+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.384628+0000","last_change":"2023-11-30T18:41:21.375397+0000","last_active":"2023-11-30T18:41:21.384628+0000","last_peered":"2023-11-30T18:41:21.384628+0000","last_clean":"2023-11-30T18:41:21.384628+0000","last_became_active":"2023-11-30T18:41:21.374975+0000","last_became_peered":"2023-11-30T18:41:21.374975+0000","last_unstale":"2023-11-30T18:41:21.384628+0000","last_undegraded":"2023-11-30T18:41:21.384628+0000","last_fullsized":"2023-11-30T18:41:21.384628+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.362778+0000","last_change":"2023-11-30T18:41:20.986258+0000","last_active":"2023-11-30T18:41:21.362778+0000","last_peered":"2023-11-30T18:41:21.362778+0000","last_clean":"2023-11-30T18:41:21.362778+0000","last_became_active":"2023-11-30T18:41:20.985545+0000","last_became_peered":"2023-11-30T18:41:20.985545+0000","last_unstale":"2023-11-30T18:41:21.362778+0000","last_undegraded":"2023-11-30T18:41:21.362778+0000","last_fullsized":"2023-11-30T18:41:21.362778+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.379702+0000","last_change":"2023-11-30T18:41:21.374628+0000","last_active":"2023-11-30T18:41:21.379702+0000","last_peered":"2023-11-30T18:41:21.379702+0000","last_clean":"2023-11-30T18:41:21.379702+0000","last_became_active":"2023-11-30T18:41:21.374320+0000","last_became_peered":"2023-11-30T18:41:21.374320+0000","last_unstale":"2023-11-30T18:41:21.379702+0000","last_undegraded":"2023-11-30T18:41:21.379702+0000","last_fullsized":"2023-11-30T18:41:21.379702+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"218'3","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.385463+0000","last_change":"2023-11-30T18:41:20.981899+0000","last_active":"2023-11-30T18:41:21.385463+0000","last_peered":"2023-11-30T18:41:21.385463+0000","last_clean":"2023-11-30T18:41:21.385463+0000","last_became_active":"2023-11-30T18:41:20.981631+0000","last_became_peered":"2023-11-30T18:41:20.981631+0000","last_unstale":"2023-11-30T18:41:21.385463+0000","last_undegraded":"2023-11-30T18:41:21.385463+0000","last_fullsized":"2023-11-30T18:41:21.385463+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382359+0000","last_change":"2023-11-30T18:41:21.381831+0000","last_active":"2023-11-30T18:41:21.382359+0000","last_peered":"2023-11-30T18:41:21.382359+0000","last_clean":"2023-11-30T18:41:21.382359+0000","last_became_active":"2023-11-30T18:41:21.381506+0000","last_became_peered":"2023-11-30T18:41:21.381506+0000","last_unstale":"2023-11-30T18:41:21.382359+0000","last_undegraded":"2023-11-30T18:41:21.382359+0000","last_fullsized":"2023-11-30T18:41:21.382359+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"218'2","reported_seq":12,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.381562+0000","last_change":"2023-11-30T18:41:20.986353+0000","last_active":"2023-11-30T18:41:21.381562+0000","last_peered":"2023-11-30T18:41:21.381562+0000","last_clean":"2023-11-30T18:41:21.381562+0000","last_became_active":"2023-11-30T18:41:20.986070+0000","last_became_peered":"2023-11-30T18:41:20.986070+0000","last_unstale":"2023-11-30T18:41:21.381562+0000","last_undegraded":"2023-11-30T18:41:21.381562+0000","last_fullsized":"2023-11-30T18:41:21.381562+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.370471+0000","last_change":"2023-11-30T18:41:21.367945+0000","last_active":"2023-11-30T18:41:21.370471+0000","last_peered":"2023-11-30T18:41:21.370471+0000","last_clean":"2023-11-30T18:41:21.370471+0000","last_became_active":"2023-11-30T18:41:21.367649+0000","last_became_peered":"2023-11-30T18:41:21.367649+0000","last_unstale":"2023-11-30T18:41:21.370471+0000","last_undegraded":"2023-11-30T18:41:21.370471+0000","last_fullsized":"2023-11-30T18:41:21.370471+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"218'1","reported_seq":11,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.383014+0000","last_change":"2023-11-30T18:41:20.985005+0000","last_active":"2023-11-30T18:41:21.383014+0000","last_peered":"2023-11-30T18:41:21.383014+0000","last_clean":"2023-11-30T18:41:21.383014+0000","last_became_active":"2023-11-30T18:41:20.984504+0000","last_became_peered":"2023-11-30T18:41:20.984504+0000","last_unstale":"2023-11-30T18:41:21.383014+0000","last_undegraded":"2023-11-30T18:41:21.383014+0000","last_fullsized":"2023-11-30T18:41:21.383014+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.384867+0000","last_change":"2023-11-30T18:41:21.378536+0000","last_active":"2023-11-30T18:41:21.384867+0000","last_peered":"2023-11-30T18:41:21.384867+0000","last_clean":"2023-11-30T18:41:21.384867+0000","last_became_active":"2023-11-30T18:41:21.377866+0000","last_became_peered":"2023-11-30T18:41:21.377866+0000","last_unstale":"2023-11-30T18:41:21.384867+0000","last_undegraded":"2023-11-30T18:41:21.384867+0000","last_fullsized":"2023-11-30T18:41:21.384867+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.363064+0000","last_change":"2023-11-30T18:41:20.986393+0000","last_active":"2023-11-30T18:41:21.363064+0000","last_peered":"2023-11-30T18:41:21.363064+0000","last_clean":"2023-11-30T18:41:21.363064+0000","last_became_active":"2023-11-30T18:41:20.985928+0000","last_became_peered":"2023-11-30T18:41:20.985928+0000","last_unstale":"2023-11-30T18:41:21.363064+0000","last_undegraded":"2023-11-30T18:41:21.363064+0000","last_fullsized":"2023-11-30T18:41:21.363064+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.371350+0000","last_change":"2023-11-30T18:41:21.368035+0000","last_active":"2023-11-30T18:41:21.371350+0000","last_peered":"2023-11-30T18:41:21.371350+0000","last_clean":"2023-11-30T18:41:21.371350+0000","last_became_active":"2023-11-30T18:41:21.367739+0000","last_became_peered":"2023-11-30T18:41:21.367739+0000","last_unstale":"2023-11-30T18:41:21.371350+0000","last_undegraded":"2023-11-30T18:41:21.371350+0000","last_fullsized":"2023-11-30T18:41:21.371350+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.358726+0000","last_change":"2023-11-30T18:41:20.989158+0000","last_active":"2023-11-30T18:41:21.358726+0000","last_peered":"2023-11-30T18:41:21.358726+0000","last_clean":"2023-11-30T18:41:21.358726+0000","last_became_active":"2023-11-30T18:41:20.988892+0000","last_became_peered":"2023-11-30T18:41:20.988892+0000","last_unstale":"2023-11-30T18:41:21.358726+0000","last_undegraded":"2023-11-30T18:41:21.358726+0000","last_fullsized":"2023-11-30T18:41:21.358726+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382404+0000","last_change":"2023-11-30T18:41:21.377760+0000","last_active":"2023-11-30T18:41:21.382404+0000","last_peered":"2023-11-30T18:41:21.382404+0000","last_clean":"2023-11-30T18:41:21.382404+0000","last_became_active":"2023-11-30T18:41:21.376927+0000","last_became_peered":"2023-11-30T18:41:21.376927+0000","last_unstale":"2023-11-30T18:41:21.382404+0000","last_undegraded":"2023-11-30T18:41:21.382404+0000","last_fullsized":"2023-11-30T18:41:21.382404+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"218'4","reported_seq":14,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.386058+0000","last_change":"2023-11-30T18:41:20.977618+0000","last_active":"2023-11-30T18:41:21.386058+0000","last_peered":"2023-11-30T18:41:21.386058+0000","last_clean":"2023-11-30T18:41:21.386058+0000","last_became_active":"2023-11-30T18:41:20.977311+0000","last_became_peered":"2023-11-30T18:41:20.977311+0000","last_unstale":"2023-11-30T18:41:21.386058+0000","last_undegraded":"2023-11-30T18:41:21.386058+0000","last_fullsized":"2023-11-30T18:41:21.386058+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.375661+0000","last_change":"2023-11-30T18:41:21.373109+0000","last_active":"2023-11-30T18:41:21.375661+0000","last_peered":"2023-11-30T18:41:21.375661+0000","last_clean":"2023-11-30T18:41:21.375661+0000","last_became_active":"2023-11-30T18:41:21.372859+0000","last_became_peered":"2023-11-30T18:41:21.372859+0000","last_unstale":"2023-11-30T18:41:21.375661+0000","last_undegraded":"2023-11-30T18:41:21.375661+0000","last_fullsized":"2023-11-30T18:41:21.375661+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"218'1","reported_seq":11,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.383044+0000","last_change":"2023-11-30T18:41:20.977200+0000","last_active":"2023-11-30T18:41:21.383044+0000","last_peered":"2023-11-30T18:41:21.383044+0000","last_clean":"2023-11-30T18:41:21.383044+0000","last_became_active":"2023-11-30T18:41:20.976942+0000","last_became_peered":"2023-11-30T18:41:20.976942+0000","last_unstale":"2023-11-30T18:41:21.383044+0000","last_undegraded":"2023-11-30T18:41:21.383044+0000","last_fullsized":"2023-11-30T18:41:21.383044+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.384607+0000","last_change":"2023-11-30T18:41:21.375235+0000","last_active":"2023-11-30T18:41:21.384607+0000","last_peered":"2023-11-30T18:41:21.384607+0000","last_clean":"2023-11-30T18:41:21.384607+0000","last_became_active":"2023-11-30T18:41:21.374662+0000","last_became_peered":"2023-11-30T18:41:21.374662+0000","last_unstale":"2023-11-30T18:41:21.384607+0000","last_undegraded":"2023-11-30T18:41:21.384607+0000","last_fullsized":"2023-11-30T18:41:21.384607+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"218'2","reported_seq":12,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.373748+0000","last_change":"2023-11-30T18:41:20.988667+0000","last_active":"2023-11-30T18:41:21.373748+0000","last_peered":"2023-11-30T18:41:21.373748+0000","last_clean":"2023-11-30T18:41:21.373748+0000","last_became_active":"2023-11-30T18:41:20.988362+0000","last_became_peered":"2023-11-30T18:41:20.988362+0000","last_unstale":"2023-11-30T18:41:21.373748+0000","last_undegraded":"2023-11-30T18:41:21.373748+0000","last_fullsized":"2023-11-30T18:41:21.373748+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382815+0000","last_change":"2023-11-30T18:41:21.377411+0000","last_active":"2023-11-30T18:41:21.382815+0000","last_peered":"2023-11-30T18:41:21.382815+0000","last_clean":"2023-11-30T18:41:21.382815+0000","last_became_active":"2023-11-30T18:41:21.374761+0000","last_became_peered":"2023-11-30T18:41:21.374761+0000","last_unstale":"2023-11-30T18:41:21.382815+0000","last_undegraded":"2023-11-30T18:41:21.382815+0000","last_fullsized":"2023-11-30T18:41:21.382815+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.357507+0000","last_change":"2023-11-30T18:41:20.981066+0000","last_active":"2023-11-30T18:41:21.357507+0000","last_peered":"2023-11-30T18:41:21.357507+0000","last_clean":"2023-11-30T18:41:21.357507+0000","last_became_active":"2023-11-30T18:41:20.980747+0000","last_became_peered":"2023-11-30T18:41:20.980747+0000","last_unstale":"2023-11-30T18:41:21.357507+0000","last_undegraded":"2023-11-30T18:41:21.357507+0000","last_fullsized":"2023-11-30T18:41:21.357507+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.385677+0000","last_change":"2023-11-30T18:41:21.384689+0000","last_active":"2023-11-30T18:41:21.385677+0000","last_peered":"2023-11-30T18:41:21.385677+0000","last_clean":"2023-11-30T18:41:21.385677+0000","last_became_active":"2023-11-30T18:41:21.384243+0000","last_became_peered":"2023-11-30T18:41:21.384243+0000","last_unstale":"2023-11-30T18:41:21.385677+0000","last_undegraded":"2023-11-30T18:41:21.385677+0000","last_fullsized":"2023-11-30T18:41:21.385677+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.367823+0000","last_change":"2023-11-30T18:41:20.982399+0000","last_active":"2023-11-30T18:41:21.367823+0000","last_peered":"2023-11-30T18:41:21.367823+0000","last_clean":"2023-11-30T18:41:21.367823+0000","last_became_active":"2023-11-30T18:41:20.982127+0000","last_became_peered":"2023-11-30T18:41:20.982127+0000","last_unstale":"2023-11-30T18:41:21.367823+0000","last_undegraded":"2023-11-30T18:41:21.367823+0000","last_fullsized":"2023-11-30T18:41:21.367823+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.380712+0000","last_change":"2023-11-30T18:41:21.379979+0000","last_active":"2023-11-30T18:41:21.380712+0000","last_peered":"2023-11-30T18:41:21.380712+0000","last_clean":"2023-11-30T18:41:21.380712+0000","last_became_active":"2023-11-30T18:41:21.379555+0000","last_became_peered":"2023-11-30T18:41:21.379555+0000","last_unstale":"2023-11-30T18:41:21.380712+0000","last_undegraded":"2023-11-30T18:41:21.380712+0000","last_fullsized":"2023-11-30T18:41:21.380712+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"218'1","reported_seq":11,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.383896+0000","last_change":"2023-11-30T18:41:20.984859+0000","last_active":"2023-11-30T18:41:21.383896+0000","last_peered":"2023-11-30T18:41:21.383896+0000","last_clean":"2023-11-30T18:41:21.383896+0000","last_became_active":"2023-11-30T18:41:20.984214+0000","last_became_peered":"2023-11-30T18:41:20.984214+0000","last_unstale":"2023-11-30T18:41:21.383896+0000","last_undegraded":"2023-11-30T18:41:21.383896+0000","last_fullsized":"2023-11-30T18:41:21.383896+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382784+0000","last_change":"2023-11-30T18:41:21.371724+0000","last_active":"2023-11-30T18:41:21.382784+0000","last_peered":"2023-11-30T18:41:21.382784+0000","last_clean":"2023-11-30T18:41:21.382784+0000","last_became_active":"2023-11-30T18:41:21.371443+0000","last_became_peered":"2023-11-30T18:41:21.371443+0000","last_unstale":"2023-11-30T18:41:21.382784+0000","last_undegraded":"2023-11-30T18:41:21.382784+0000","last_fullsized":"2023-11-30T18:41:21.382784+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.359371+0000","last_change":"2023-11-30T18:41:20.988139+0000","last_active":"2023-11-30T18:41:21.359371+0000","last_peered":"2023-11-30T18:41:21.359371+0000","last_clean":"2023-11-30T18:41:21.359371+0000","last_became_active":"2023-11-30T18:41:20.987851+0000","last_became_peered":"2023-11-30T18:41:20.987851+0000","last_unstale":"2023-11-30T18:41:21.359371+0000","last_undegraded":"2023-11-30T18:41:21.359371+0000","last_fullsized":"2023-11-30T18:41:21.359371+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382503+0000","last_change":"2023-11-30T18:41:21.368385+0000","last_active":"2023-11-30T18:41:21.382503+0000","last_peered":"2023-11-30T18:41:21.382503+0000","last_clean":"2023-11-30T18:41:21.382503+0000","last_became_active":"2023-11-30T18:41:21.368109+0000","last_became_peered":"2023-11-30T18:41:21.368109+0000","last_unstale":"2023-11-30T18:41:21.382503+0000","last_undegraded":"2023-11-30T18:41:21.382503+0000","last_fullsized":"2023-11-30T18:41:21.382503+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.355556+0000","last_change":"2023-11-30T18:41:20.980928+0000","last_active":"2023-11-30T18:41:21.355556+0000","last_peered":"2023-11-30T18:41:21.355556+0000","last_clean":"2023-11-30T18:41:21.355556+0000","last_became_active":"2023-11-30T18:41:20.980603+0000","last_became_peered":"2023-11-30T18:41:20.980603+0000","last_unstale":"2023-11-30T18:41:21.355556+0000","last_undegraded":"2023-11-30T18:41:21.355556+0000","last_fullsized":"2023-11-30T18:41:21.355556+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.383653+0000","last_change":"2023-11-30T18:41:21.371635+0000","last_active":"2023-11-30T18:41:21.383653+0000","last_peered":"2023-11-30T18:41:21.383653+0000","last_clean":"2023-11-30T18:41:21.383653+0000","last_became_active":"2023-11-30T18:41:21.370167+0000","last_became_peered":"2023-11-30T18:41:21.370167+0000","last_unstale":"2023-11-30T18:41:21.383653+0000","last_undegraded":"2023-11-30T18:41:21.383653+0000","last_fullsized":"2023-11-30T18:41:21.383653+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.357025+0000","last_change":"2023-11-30T18:41:20.981629+0000","last_active":"2023-11-30T18:41:21.357025+0000","last_peered":"2023-11-30T18:41:21.357025+0000","last_clean":"2023-11-30T18:41:21.357025+0000","last_became_active":"2023-11-30T18:41:20.981135+0000","last_became_peered":"2023-11-30T18:41:20.981135+0000","last_unstale":"2023-11-30T18:41:21.357025+0000","last_undegraded":"2023-11-30T18:41:21.357025+0000","last_fullsized":"2023-11-30T18:41:21.357025+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.373405+0000","last_change":"2023-11-30T18:41:21.368669+0000","last_active":"2023-11-30T18:41:21.373405+0000","last_peered":"2023-11-30T18:41:21.373405+0000","last_clean":"2023-11-30T18:41:21.373405+0000","last_became_active":"2023-11-30T18:41:21.368406+0000","last_became_peered":"2023-11-30T18:41:21.368406+0000","last_unstale":"2023-11-30T18:41:21.373405+0000","last_undegraded":"2023-11-30T18:41:21.373405+0000","last_fullsized":"2023-11-30T18:41:21.373405+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"218'2","reported_seq":12,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.371572+0000","last_change":"2023-11-30T18:41:20.981488+0000","last_active":"2023-11-30T18:41:21.371572+0000","last_peered":"2023-11-30T18:41:21.371572+0000","last_clean":"2023-11-30T18:41:21.371572+0000","last_became_active":"2023-11-30T18:41:20.981102+0000","last_became_peered":"2023-11-30T18:41:20.981102+0000","last_unstale":"2023-11-30T18:41:21.371572+0000","last_undegraded":"2023-11-30T18:41:21.371572+0000","last_fullsized":"2023-11-30T18:41:21.371572+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.373243+0000","last_change":"2023-11-30T18:41:21.369888+0000","last_active":"2023-11-30T18:41:21.373243+0000","last_peered":"2023-11-30T18:41:21.373243+0000","last_clean":"2023-11-30T18:41:21.373243+0000","last_became_active":"2023-11-30T18:41:21.369582+0000","last_became_peered":"2023-11-30T18:41:21.369582+0000","last_unstale":"2023-11-30T18:41:21.373243+0000","last_undegraded":"2023-11-30T18:41:21.373243+0000","last_fullsized":"2023-11-30T18:41:21.373243+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.356180+0000","last_change":"2023-11-30T18:41:20.978232+0000","last_active":"2023-11-30T18:41:21.356180+0000","last_peered":"2023-11-30T18:41:21.356180+0000","last_clean":"2023-11-30T18:41:21.356180+0000","last_became_active":"2023-11-30T18:41:20.977961+0000","last_became_peered":"2023-11-30T18:41:20.977961+0000","last_unstale":"2023-11-30T18:41:21.356180+0000","last_undegraded":"2023-11-30T18:41:21.356180+0000","last_fullsized":"2023-11-30T18:41:21.356180+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382738+0000","last_change":"2023-11-30T18:41:21.378285+0000","last_active":"2023-11-30T18:41:21.382738+0000","last_peered":"2023-11-30T18:41:21.382738+0000","last_clean":"2023-11-30T18:41:21.382738+0000","last_became_active":"2023-11-30T18:41:21.377973+0000","last_became_peered":"2023-11-30T18:41:21.377973+0000","last_unstale":"2023-11-30T18:41:21.382738+0000","last_undegraded":"2023-11-30T18:41:21.382738+0000","last_fullsized":"2023-11-30T18:41:21.382738+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.364518+0000","last_change":"2023-11-30T18:41:20.978766+0000","last_active":"2023-11-30T18:41:21.364518+0000","last_peered":"2023-11-30T18:41:21.364518+0000","last_clean":"2023-11-30T18:41:21.364518+0000","last_became_active":"2023-11-30T18:41:20.978462+0000","last_became_peered":"2023-11-30T18:41:20.978462+0000","last_unstale":"2023-11-30T18:41:21.364518+0000","last_undegraded":"2023-11-30T18:41:21.364518+0000","last_fullsized":"2023-11-30T18:41:21.364518+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.375791+0000","last_change":"2023-11-30T18:41:21.373179+0000","last_active":"2023-11-30T18:41:21.375791+0000","last_peered":"2023-11-30T18:41:21.375791+0000","last_clean":"2023-11-30T18:41:21.375791+0000","last_became_active":"2023-11-30T18:41:21.372888+0000","last_became_peered":"2023-11-30T18:41:21.372888+0000","last_unstale":"2023-11-30T18:41:21.375791+0000","last_undegraded":"2023-11-30T18:41:21.375791+0000","last_fullsized":"2023-11-30T18:41:21.375791+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.362192+0000","last_change":"2023-11-30T18:41:20.982542+0000","last_active":"2023-11-30T18:41:21.362192+0000","last_peered":"2023-11-30T18:41:21.362192+0000","last_clean":"2023-11-30T18:41:21.362192+0000","last_became_active":"2023-11-30T18:41:20.982234+0000","last_became_peered":"2023-11-30T18:41:20.982234+0000","last_unstale":"2023-11-30T18:41:21.362192+0000","last_undegraded":"2023-11-30T18:41:21.362192+0000","last_fullsized":"2023-11-30T18:41:21.362192+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.377188+0000","last_change":"2023-11-30T18:41:21.368059+0000","last_active":"2023-11-30T18:41:21.377188+0000","last_peered":"2023-11-30T18:41:21.377188+0000","last_clean":"2023-11-30T18:41:21.377188+0000","last_became_active":"2023-11-30T18:41:21.367783+0000","last_became_peered":"2023-11-30T18:41:21.367783+0000","last_unstale":"2023-11-30T18:41:21.377188+0000","last_undegraded":"2023-11-30T18:41:21.377188+0000","last_fullsized":"2023-11-30T18:41:21.377188+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.360834+0000","last_change":"2023-11-30T18:41:20.988465+0000","last_active":"2023-11-30T18:41:21.360834+0000","last_peered":"2023-11-30T18:41:21.360834+0000","last_clean":"2023-11-30T18:41:21.360834+0000","last_became_active":"2023-11-30T18:41:20.988109+0000","last_became_peered":"2023-11-30T18:41:20.988109+0000","last_unstale":"2023-11-30T18:41:21.360834+0000","last_undegraded":"2023-11-30T18:41:21.360834+0000","last_fullsized":"2023-11-30T18:41:21.360834+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.377554+0000","last_change":"2023-11-30T18:41:21.372926+0000","last_active":"2023-11-30T18:41:21.377554+0000","last_peered":"2023-11-30T18:41:21.377554+0000","last_clean":"2023-11-30T18:41:21.377554+0000","last_became_active":"2023-11-30T18:41:21.372375+0000","last_became_peered":"2023-11-30T18:41:21.372375+0000","last_unstale":"2023-11-30T18:41:21.377554+0000","last_undegraded":"2023-11-30T18:41:21.377554+0000","last_fullsized":"2023-11-30T18:41:21.377554+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.360645+0000","last_change":"2023-11-30T18:41:20.984013+0000","last_active":"2023-11-30T18:41:21.360645+0000","last_peered":"2023-11-30T18:41:21.360645+0000","last_clean":"2023-11-30T18:41:21.360645+0000","last_became_active":"2023-11-30T18:41:20.983762+0000","last_became_peered":"2023-11-30T18:41:20.983762+0000","last_unstale":"2023-11-30T18:41:21.360645+0000","last_undegraded":"2023-11-30T18:41:21.360645+0000","last_fullsized":"2023-11-30T18:41:21.360645+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.385675+0000","last_change":"2023-11-30T18:41:21.384606+0000","last_active":"2023-11-30T18:41:21.385675+0000","last_peered":"2023-11-30T18:41:21.385675+0000","last_clean":"2023-11-30T18:41:21.385675+0000","last_became_active":"2023-11-30T18:41:21.384295+0000","last_became_peered":"2023-11-30T18:41:21.384295+0000","last_unstale":"2023-11-30T18:41:21.385675+0000","last_undegraded":"2023-11-30T18:41:21.385675+0000","last_fullsized":"2023-11-30T18:41:21.385675+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.355658+0000","last_change":"2023-11-30T18:41:20.976983+0000","last_active":"2023-11-30T18:41:21.355658+0000","last_peered":"2023-11-30T18:41:21.355658+0000","last_clean":"2023-11-30T18:41:21.355658+0000","last_became_active":"2023-11-30T18:41:20.976695+0000","last_became_peered":"2023-11-30T18:41:20.976695+0000","last_unstale":"2023-11-30T18:41:21.355658+0000","last_undegraded":"2023-11-30T18:41:21.355658+0000","last_fullsized":"2023-11-30T18:41:21.355658+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382009+0000","last_change":"2023-11-30T18:41:21.374039+0000","last_active":"2023-11-30T18:41:21.382009+0000","last_peered":"2023-11-30T18:41:21.382009+0000","last_clean":"2023-11-30T18:41:21.382009+0000","last_became_active":"2023-11-30T18:41:21.373771+0000","last_became_peered":"2023-11-30T18:41:21.373771+0000","last_unstale":"2023-11-30T18:41:21.382009+0000","last_undegraded":"2023-11-30T18:41:21.382009+0000","last_fullsized":"2023-11-30T18:41:21.382009+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.357475+0000","last_change":"2023-11-30T18:41:20.981406+0000","last_active":"2023-11-30T18:41:21.357475+0000","last_peered":"2023-11-30T18:41:21.357475+0000","last_clean":"2023-11-30T18:41:21.357475+0000","last_became_active":"2023-11-30T18:41:20.980777+0000","last_became_peered":"2023-11-30T18:41:20.980777+0000","last_unstale":"2023-11-30T18:41:21.357475+0000","last_undegraded":"2023-11-30T18:41:21.357475+0000","last_fullsized":"2023-11-30T18:41:21.357475+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.375435+0000","last_change":"2023-11-30T18:41:21.371959+0000","last_active":"2023-11-30T18:41:21.375435+0000","last_peered":"2023-11-30T18:41:21.375435+0000","last_clean":"2023-11-30T18:41:21.375435+0000","last_became_active":"2023-11-30T18:41:21.370246+0000","last_became_peered":"2023-11-30T18:41:21.370246+0000","last_unstale":"2023-11-30T18:41:21.375435+0000","last_undegraded":"2023-11-30T18:41:21.375435+0000","last_fullsized":"2023-11-30T18:41:21.375435+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"218'1","reported_seq":11,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.371233+0000","last_change":"2023-11-30T18:41:20.989472+0000","last_active":"2023-11-30T18:41:21.371233+0000","last_peered":"2023-11-30T18:41:21.371233+0000","last_clean":"2023-11-30T18:41:21.371233+0000","last_became_active":"2023-11-30T18:41:20.989158+0000","last_became_peered":"2023-11-30T18:41:20.989158+0000","last_unstale":"2023-11-30T18:41:21.371233+0000","last_undegraded":"2023-11-30T18:41:21.371233+0000","last_fullsized":"2023-11-30T18:41:21.371233+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":185,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.364504+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T18:41:21.364504+0000","last_peered":"2023-11-30T18:41:21.364504+0000","last_clean":"2023-11-30T18:41:21.364504+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T18:41:21.364504+0000","last_undegraded":"2023-11-30T18:41:21.364504+0000","last_fullsized":"2023-11-30T18:41:21.364504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.374849+0000","last_change":"2023-11-30T18:41:21.372418+0000","last_active":"2023-11-30T18:41:21.374849+0000","last_peered":"2023-11-30T18:41:21.374849+0000","last_clean":"2023-11-30T18:41:21.374849+0000","last_became_active":"2023-11-30T18:41:21.372108+0000","last_became_peered":"2023-11-30T18:41:21.372108+0000","last_unstale":"2023-11-30T18:41:21.374849+0000","last_undegraded":"2023-11-30T18:41:21.374849+0000","last_fullsized":"2023-11-30T18:41:21.374849+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.364670+0000","last_change":"2023-11-30T18:41:20.984071+0000","last_active":"2023-11-30T18:41:21.364670+0000","last_peered":"2023-11-30T18:41:21.364670+0000","last_clean":"2023-11-30T18:41:21.364670+0000","last_became_active":"2023-11-30T18:41:20.983789+0000","last_became_peered":"2023-11-30T18:41:20.983789+0000","last_unstale":"2023-11-30T18:41:21.364670+0000","last_undegraded":"2023-11-30T18:41:21.364670+0000","last_fullsized":"2023-11-30T18:41:21.364670+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":181,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.368519+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T18:41:21.368519+0000","last_peered":"2023-11-30T18:41:21.368519+0000","last_clean":"2023-11-30T18:41:21.368519+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T18:41:21.368519+0000","last_undegraded":"2023-11-30T18:41:21.368519+0000","last_fullsized":"2023-11-30T18:41:21.368519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.375089+0000","last_change":"2023-11-30T18:41:21.370723+0000","last_active":"2023-11-30T18:41:21.375089+0000","last_peered":"2023-11-30T18:41:21.375089+0000","last_clean":"2023-11-30T18:41:21.375089+0000","last_became_active":"2023-11-30T18:41:21.370505+0000","last_became_peered":"2023-11-30T18:41:21.370505+0000","last_unstale":"2023-11-30T18:41:21.375089+0000","last_undegraded":"2023-11-30T18:41:21.375089+0000","last_fullsized":"2023-11-30T18:41:21.375089+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.359269+0000","last_change":"2023-11-30T18:41:20.984042+0000","last_active":"2023-11-30T18:41:21.359269+0000","last_peered":"2023-11-30T18:41:21.359269+0000","last_clean":"2023-11-30T18:41:21.359269+0000","last_became_active":"2023-11-30T18:41:20.983561+0000","last_became_peered":"2023-11-30T18:41:20.983561+0000","last_unstale":"2023-11-30T18:41:21.359269+0000","last_undegraded":"2023-11-30T18:41:21.359269+0000","last_fullsized":"2023-11-30T18:41:21.359269+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":189,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.355734+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T18:41:21.355734+0000","last_peered":"2023-11-30T18:41:21.355734+0000","last_clean":"2023-11-30T18:41:21.355734+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T18:41:21.355734+0000","last_undegraded":"2023-11-30T18:41:21.355734+0000","last_fullsized":"2023-11-30T18:41:21.355734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382729+0000","last_change":"2023-11-30T18:41:21.376245+0000","last_active":"2023-11-30T18:41:21.382729+0000","last_peered":"2023-11-30T18:41:21.382729+0000","last_clean":"2023-11-30T18:41:21.382729+0000","last_became_active":"2023-11-30T18:41:21.375152+0000","last_became_peered":"2023-11-30T18:41:21.375152+0000","last_unstale":"2023-11-30T18:41:21.382729+0000","last_undegraded":"2023-11-30T18:41:21.382729+0000","last_fullsized":"2023-11-30T18:41:21.382729+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.360059+0000","last_change":"2023-11-30T18:41:20.983138+0000","last_active":"2023-11-30T18:41:21.360059+0000","last_peered":"2023-11-30T18:41:21.360059+0000","last_clean":"2023-11-30T18:41:21.360059+0000","last_became_active":"2023-11-30T18:41:20.982858+0000","last_became_peered":"2023-11-30T18:41:20.982858+0000","last_unstale":"2023-11-30T18:41:21.360059+0000","last_undegraded":"2023-11-30T18:41:21.360059+0000","last_fullsized":"2023-11-30T18:41:21.360059+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":181,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.368194+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T18:41:21.368194+0000","last_peered":"2023-11-30T18:41:21.368194+0000","last_clean":"2023-11-30T18:41:21.368194+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T18:41:21.368194+0000","last_undegraded":"2023-11-30T18:41:21.368194+0000","last_fullsized":"2023-11-30T18:41:21.368194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":177,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.360301+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T18:41:21.360301+0000","last_peered":"2023-11-30T18:41:21.360301+0000","last_clean":"2023-11-30T18:41:21.360301+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T18:41:21.360301+0000","last_undegraded":"2023-11-30T18:41:21.360301+0000","last_fullsized":"2023-11-30T18:41:21.360301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.377713+0000","last_change":"2023-11-30T18:41:21.373876+0000","last_active":"2023-11-30T18:41:21.377713+0000","last_peered":"2023-11-30T18:41:21.377713+0000","last_clean":"2023-11-30T18:41:21.377713+0000","last_became_active":"2023-11-30T18:41:21.373605+0000","last_became_peered":"2023-11-30T18:41:21.373605+0000","last_unstale":"2023-11-30T18:41:21.377713+0000","last_undegraded":"2023-11-30T18:41:21.377713+0000","last_fullsized":"2023-11-30T18:41:21.377713+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.361327+0000","last_change":"2023-11-30T18:41:20.979854+0000","last_active":"2023-11-30T18:41:21.361327+0000","last_peered":"2023-11-30T18:41:21.361327+0000","last_clean":"2023-11-30T18:41:21.361327+0000","last_became_active":"2023-11-30T18:41:20.979018+0000","last_became_peered":"2023-11-30T18:41:20.979018+0000","last_unstale":"2023-11-30T18:41:21.361327+0000","last_undegraded":"2023-11-30T18:41:21.361327+0000","last_fullsized":"2023-11-30T18:41:21.361327+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":175,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.360382+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T18:41:21.360382+0000","last_peered":"2023-11-30T18:41:21.360382+0000","last_clean":"2023-11-30T18:41:21.360382+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T18:41:21.360382+0000","last_undegraded":"2023-11-30T18:41:21.360382+0000","last_fullsized":"2023-11-30T18:41:21.360382+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.370044+0000","last_change":"2023-11-30T18:41:21.367733+0000","last_active":"2023-11-30T18:41:21.370044+0000","last_peered":"2023-11-30T18:41:21.370044+0000","last_clean":"2023-11-30T18:41:21.370044+0000","last_became_active":"2023-11-30T18:41:21.367404+0000","last_became_peered":"2023-11-30T18:41:21.367404+0000","last_unstale":"2023-11-30T18:41:21.370044+0000","last_undegraded":"2023-11-30T18:41:21.370044+0000","last_fullsized":"2023-11-30T18:41:21.370044+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"218'1","reported_seq":11,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.383683+0000","last_change":"2023-11-30T18:41:20.977253+0000","last_active":"2023-11-30T18:41:21.383683+0000","last_peered":"2023-11-30T18:41:21.383683+0000","last_clean":"2023-11-30T18:41:21.383683+0000","last_became_active":"2023-11-30T18:41:20.976988+0000","last_became_peered":"2023-11-30T18:41:20.976988+0000","last_unstale":"2023-11-30T18:41:21.383683+0000","last_undegraded":"2023-11-30T18:41:21.383683+0000","last_fullsized":"2023-11-30T18:41:21.383683+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":175,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.362999+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T18:41:21.362999+0000","last_peered":"2023-11-30T18:41:21.362999+0000","last_clean":"2023-11-30T18:41:21.362999+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T18:41:21.362999+0000","last_undegraded":"2023-11-30T18:41:21.362999+0000","last_fullsized":"2023-11-30T18:41:21.362999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.383049+0000","last_change":"2023-11-30T18:41:21.379210+0000","last_active":"2023-11-30T18:41:21.383049+0000","last_peered":"2023-11-30T18:41:21.383049+0000","last_clean":"2023-11-30T18:41:21.383049+0000","last_became_active":"2023-11-30T18:41:21.378325+0000","last_became_peered":"2023-11-30T18:41:21.378325+0000","last_unstale":"2023-11-30T18:41:21.383049+0000","last_undegraded":"2023-11-30T18:41:21.383049+0000","last_fullsized":"2023-11-30T18:41:21.383049+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"218'2","reported_seq":12,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.381102+0000","last_change":"2023-11-30T18:41:20.986137+0000","last_active":"2023-11-30T18:41:21.381102+0000","last_peered":"2023-11-30T18:41:21.381102+0000","last_clean":"2023-11-30T18:41:21.381102+0000","last_became_active":"2023-11-30T18:41:20.985840+0000","last_became_peered":"2023-11-30T18:41:20.985840+0000","last_unstale":"2023-11-30T18:41:21.381102+0000","last_undegraded":"2023-11-30T18:41:21.381102+0000","last_fullsized":"2023-11-30T18:41:21.381102+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":185,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.362870+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T18:41:21.362870+0000","last_peered":"2023-11-30T18:41:21.362870+0000","last_clean":"2023-11-30T18:41:21.362870+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T18:41:21.362870+0000","last_undegraded":"2023-11-30T18:41:21.362870+0000","last_fullsized":"2023-11-30T18:41:21.362870+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":9,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.382032+0000","last_change":"2023-11-30T18:41:21.372954+0000","last_active":"2023-11-30T18:41:21.382032+0000","last_peered":"2023-11-30T18:41:21.382032+0000","last_clean":"2023-11-30T18:41:21.382032+0000","last_became_active":"2023-11-30T18:41:21.372375+0000","last_became_peered":"2023-11-30T18:41:21.372375+0000","last_unstale":"2023-11-30T18:41:21.382032+0000","last_undegraded":"2023-11-30T18:41:21.382032+0000","last_fullsized":"2023-11-30T18:41:21.382032+0000","mapping_epoch":217,"log_start":"0'0","ondisk_log_start":"0'0","created":217,"last_epoch_clean":218,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:20.956037+0000","last_clean_scrub_stamp":"2023-11-30T18:41:20.956037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":10,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.360991+0000","last_change":"2023-11-30T18:41:20.987695+0000","last_active":"2023-11-30T18:41:21.360991+0000","last_peered":"2023-11-30T18:41:21.360991+0000","last_clean":"2023-11-30T18:41:21.360991+0000","last_became_active":"2023-11-30T18:41:20.987279+0000","last_became_peered":"2023-11-30T18:41:20.987279+0000","last_unstale":"2023-11-30T18:41:21.360991+0000","last_undegraded":"2023-11-30T18:41:21.360991+0000","last_fullsized":"2023-11-30T18:41:21.360991+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:19.953788+0000","last_clean_scrub_stamp":"2023-11-30T18:41:19.953788+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":206,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-30T18:41:21.357585+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T18:41:21.357585+0000","last_peered":"2023-11-30T18:41:21.357585+0000","last_clean":"2023-11-30T18:41:21.357585+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T18:41:21.357585+0000","last_undegraded":"2023-11-30T18:41:21.357585+0000","last_fullsized":"2023-11-30T18:41:21.357585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575969,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303876,"kb_used_data":2684,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94067964,"statfs":{"total":96636764160,"available":96325595136,"internally_reserved":0,"allocated":2748416,"data_stored":1411754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.377,"5min":0.34200000000000003,"15min":0.28699999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.84799999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.621,"15min":0.63},"min":{"1min":0.46999999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82099999999999995,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.66100000000000003}]},{"osd":1,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.39500000000000002,"5min":0.36199999999999999,"15min":0.35899999999999999},"max":{"1min":0.74199999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56000000000000005,"15min":0.57399999999999995},"min":{"1min":0.38400000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73199999999999998,"5min":0.77800000000000002,"15min":0.877},"last":0.63600000000000001}]},{"osd":2,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.81100000000000005},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.44600000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79300000000000004,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.622}]},{"osd":3,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55800000000000005,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.372,"15min":0.35899999999999999},"max":{"1min":0.78100000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59499999999999997,"15min":0.60699999999999998},"min":{"1min":0.42699999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77600000000000002,"5min":0.80400000000000005,"15min":0.89900000000000002},"last":0.67300000000000004}]},{"osd":4,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46600000000000003,"15min":0.46500000000000002},"min":{"1min":0.32100000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.66100000000000003,"5min":1.264,"15min":1.264},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.48699999999999999,"15min":0.48999999999999999},"min":{"1min":0.307,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.64400000000000002,"5min":1.149,"15min":1.149},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.498,"15min":0.497},"min":{"1min":0.32200000000000001,"5min":0.30599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71099999999999997,"5min":0.78200000000000003,"15min":0.83399999999999996},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.497,"5min":0.52900000000000003,"15min":0.53100000000000003},"min":{"1min":0.38400000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66800000000000004,"5min":1.286,"15min":1.286},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.38100000000000001,"5min":0.33000000000000002,"15min":0.32300000000000001},"max":{"1min":0.72699999999999998,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54700000000000004,"15min":0.55400000000000005},"min":{"1min":0.34799999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.68799999999999994,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.72899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575968,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307968,"kb_used_data":2680,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063872,"statfs":{"total":96636764160,"available":96321404928,"internally_reserved":0,"allocated":2744320,"data_stored":1411200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59499999999999997,"15min":0.61099999999999999},"min":{"1min":0.42299999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.76300000000000001,"5min":0.80500000000000005,"15min":1.6379999999999999},"last":0.499},{"interface":"front","average":{"1min":0.62,"5min":0.623,"15min":0.625},"min":{"1min":0.45100000000000001,"5min":0.42499999999999999,"15min":0.27800000000000002},"max":{"1min":0.77800000000000002,"5min":0.82999999999999996,"15min":1.246},"last":0.51200000000000001}]},{"osd":1,"last update":"Thu Nov 30 18:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59499999999999997,"15min":0.61099999999999999},"min":{"1min":0.40100000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":1.1200000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61399999999999999,"15min":0.63},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.35499999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.90400000000000003},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Nov 30 18:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58799999999999997,"15min":0.59899999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.34499999999999997},"max":{"1min":0.751,"5min":0.751,"15min":1.288},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.61199999999999999,"15min":0.63200000000000001},"min":{"1min":0.441,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":0.80600000000000005,"5min":0.84599999999999997,"15min":1.177},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Nov 30 18:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55200000000000005,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.371,"15min":0.33400000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":1.204},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56100000000000005,"15min":0.56999999999999995},"min":{"1min":0.42199999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.72299999999999998,"5min":0.78300000000000003,"15min":1.337},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Nov 30 18:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.44700000000000001,"15min":0.47199999999999998},"min":{"1min":0.33800000000000002,"5min":0.32500000000000001,"15min":0.28699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":1.51},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.47099999999999997,"15min":0.49299999999999999},"min":{"1min":0.34200000000000003,"5min":0.32800000000000001,"15min":0.30399999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.94299999999999995},"last":0.45900000000000002}]},{"osd":5,"last update":"Thu Nov 30 18:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.45300000000000001,"15min":0.47299999999999998},"min":{"1min":0.32600000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":1.159},"last":0.432},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.505,"15min":0.53100000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":1.679},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Nov 30 18:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.51900000000000002,"15min":0.54100000000000004},"min":{"1min":0.35699999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.96199999999999997},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55500000000000005,"15min":0.57799999999999996},"min":{"1min":0.41099999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":1.427},"last":0.55600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575968,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312060,"kb_used_data":2676,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059780,"statfs":{"total":96636764160,"available":96317214720,"internally_reserved":0,"allocated":2740224,"data_stored":1410308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.36799999999999999,"15min":0.376},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.56399999999999995,"5min":0.66300000000000003,"15min":0.79900000000000004},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.49399999999999999,"15min":0.505},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.87},"last":0.371}]},{"osd":2,"last update":"Thu Nov 30 18:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.39300000000000002,"15min":0.40899999999999997},"min":{"1min":0.27100000000000002,"5min":0.26700000000000002,"15min":0.26200000000000001},"max":{"1min":0.55700000000000005,"5min":0.64700000000000002,"15min":0.89100000000000001},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.51500000000000001,"15min":0.52800000000000002},"min":{"1min":0.38100000000000001,"5min":0.372,"15min":0.37},"max":{"1min":0.73799999999999999,"5min":0.80300000000000005,"15min":0.98599999999999999},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Nov 30 18:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.46999999999999997,"15min":0.47499999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.91900000000000004},"last":0.432},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.443,"15min":0.45500000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.625,"5min":0.71399999999999997,"15min":0.84599999999999997},"last":0.32100000000000001}]},{"osd":4,"last update":"Thu Nov 30 18:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59599999999999997,"15min":0.61299999999999999},"min":{"1min":0.38900000000000001,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":0.78500000000000003,"5min":0.89800000000000002,"15min":0.93999999999999995},"last":0.625},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65100000000000002,"15min":0.66400000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.42299999999999999},"max":{"1min":0.78400000000000003,"5min":1.0329999999999999,"15min":1.0700000000000001},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Nov 30 18:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60899999999999999,"15min":0.627},"min":{"1min":0.41399999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76200000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.63400000000000001,"15min":0.64100000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.39200000000000002},"max":{"1min":0.82399999999999995,"5min":0.93400000000000005,"15min":0.98099999999999998},"last":0.55400000000000005}]},{"osd":6,"last update":"Thu Nov 30 18:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69299999999999995,"15min":0.70299999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.95099999999999996,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67200000000000004,"15min":0.68500000000000005},"min":{"1min":0.46000000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.876,"5min":0.88100000000000001,"15min":1.004},"last":0.61499999999999999}]},{"osd":7,"last update":"Thu Nov 30 18:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.68600000000000005,"15min":0.70499999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.46100000000000002},"max":{"1min":0.83499999999999996,"5min":0.92200000000000004,"15min":1.012},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68000000000000005,"15min":0.69099999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.85099999999999998,"5min":0.97599999999999998,"15min":1.02},"last":0.53500000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575968,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312080,"kb_used_data":2696,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059760,"statfs":{"total":96636764160,"available":96317194240,"internally_reserved":0,"allocated":2760704,"data_stored":1411078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.39300000000000002,"15min":0.39600000000000002},"min":{"1min":0.26000000000000001,"5min":0.252,"15min":0.22900000000000001},"max":{"1min":0.45900000000000002,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42299999999999999,"15min":0.41899999999999998},"min":{"1min":0.28399999999999997,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.497,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.28799999999999998}]},{"osd":2,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.40699999999999997,"15min":0.41399999999999998},"min":{"1min":0.26000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.63500000000000001,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48599999999999999,"15min":0.495},"min":{"1min":0.36799999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.626,"5min":0.69799999999999995,"15min":0.74199999999999999},"last":0.42499999999999999}]},{"osd":3,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.47299999999999998,"15min":0.46200000000000002},"min":{"1min":0.33500000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.54200000000000004,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.47299999999999998,"15min":0.47099999999999997},"min":{"1min":0.33100000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.57899999999999996,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.378}]},{"osd":4,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61699999999999999,"15min":0.63300000000000001},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.40200000000000002},"max":{"1min":0.72299999999999998,"5min":0.85399999999999998,"15min":1.026},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65200000000000002,"15min":0.65500000000000003},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84299999999999997,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.621}]},{"osd":5,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.48799999999999999,"5min":0.41799999999999998,"15min":0.40400000000000003},"max":{"1min":0.86399999999999999,"5min":0.97699999999999998,"15min":0.97799999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.64100000000000001,"15min":0.66100000000000003},"min":{"1min":0.48399999999999999,"5min":0.47199999999999998,"15min":0.439},"max":{"1min":0.751,"5min":0.91000000000000003,"15min":1.079},"last":0.749}]},{"osd":6,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67500000000000004,"15min":0.68200000000000005},"min":{"1min":0.48399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.67500000000000004,"15min":0.67800000000000005},"min":{"1min":0.45200000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91500000000000004,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.67800000000000005,"15min":0.69499999999999995},"min":{"1min":0.45800000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82999999999999996,"5min":0.94099999999999995,"15min":1.123},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71699999999999997,"15min":0.73199999999999998},"min":{"1min":0.56399999999999995,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92000000000000004,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.71199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575968,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312060,"kb_used_data":2676,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059780,"statfs":{"total":96636764160,"available":96317214720,"internally_reserved":0,"allocated":2740224,"data_stored":1410308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40699999999999997,"15min":0.41499999999999998},"min":{"1min":0.28000000000000003,"5min":0.249,"15min":0.23200000000000001},"max":{"1min":0.54600000000000004,"5min":0.64800000000000002,"15min":0.72099999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45200000000000001,"15min":0.45800000000000002},"min":{"1min":0.29199999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.623,"5min":0.63400000000000001,"15min":0.73199999999999998},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.45100000000000001,"15min":0.46000000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.66800000000000004,"5min":0.70599999999999996,"15min":0.74299999999999999},"last":0.432},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48899999999999999,"15min":0.49199999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.29899999999999999},"max":{"1min":0.68700000000000006,"5min":0.746,"15min":0.752},"last":0.38}]},{"osd":3,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.42199999999999999,"15min":0.42299999999999999},"min":{"1min":0.29399999999999998,"5min":0.28399999999999997,"15min":0.27500000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.49099999999999999,"15min":0.496},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.77100000000000002},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.496,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81299999999999994,"5min":0.91900000000000004,"15min":0.95299999999999996},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.61599999999999999,"15min":0.63600000000000001},"min":{"1min":0.46800000000000003,"5min":0.42199999999999999,"15min":0.35899999999999999},"max":{"1min":0.83399999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64700000000000002,"15min":0.66000000000000003},"min":{"1min":0.435,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89900000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65100000000000002,"15min":0.66500000000000004},"min":{"1min":0.52500000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80200000000000005,"5min":1.01,"15min":1.01},"last":0.495}]},{"osd":6,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63900000000000001,"15min":0.64800000000000002},"min":{"1min":0.50900000000000001,"5min":0.432,"15min":0.40500000000000003},"max":{"1min":0.81899999999999995,"5min":0.93000000000000005,"15min":0.93200000000000005},"last":0.501},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.67900000000000005,"15min":0.69499999999999995},"min":{"1min":0.53400000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88500000000000001,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67900000000000005,"15min":0.68999999999999995},"min":{"1min":0.53700000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96499999999999997,"5min":0.97799999999999998,"15min":1.0109999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69699999999999995,"15min":0.71399999999999997},"min":{"1min":0.51100000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.91300000000000003,"5min":0.97899999999999998,"15min":0.98699999999999999},"last":0.56299999999999994}]}]},{"osd":3,"up_from":13,"seq":55834575968,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299904,"kb_used_data":2680,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94071936,"statfs":{"total":96636764160,"available":96329662464,"internally_reserved":0,"allocated":2744320,"data_stored":1410398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38200000000000001,"15min":0.38},"min":{"1min":0.26300000000000001,"5min":0.254,"15min":0.222},"max":{"1min":0.60899999999999999,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.374},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.42299999999999999,"15min":0.42599999999999999},"min":{"1min":0.29999999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.56000000000000005,"5min":0.64200000000000002,"15min":0.754},"last":0.40400000000000003}]},{"osd":1,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39400000000000002,"15min":0.40300000000000002},"min":{"1min":0.28799999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.59499999999999997,"5min":0.65800000000000003,"15min":0.73399999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.442,"15min":0.45200000000000001},"min":{"1min":0.32300000000000001,"5min":0.28699999999999998,"15min":0.25700000000000001},"max":{"1min":0.65900000000000003,"5min":0.66800000000000004,"15min":0.86699999999999999},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47399999999999998,"15min":0.47299999999999998},"min":{"1min":0.35599999999999998,"5min":0.29299999999999998,"15min":0.27800000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.79500000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51500000000000001,"15min":0.52100000000000002},"min":{"1min":0.41399999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.747,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.504}]},{"osd":4,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.434,"5min":0.39100000000000001,"15min":0.35299999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63800000000000001,"15min":0.64700000000000002},"min":{"1min":0.42499999999999999,"5min":0.40300000000000002,"15min":0.40100000000000002},"max":{"1min":0.91800000000000004,"5min":0.97799999999999998,"15min":1.0049999999999999},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63500000000000001,"15min":0.64200000000000002},"min":{"1min":0.45500000000000002,"5min":0.41499999999999998,"15min":0.40699999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65300000000000002,"15min":0.66400000000000003},"min":{"1min":0.51300000000000001,"5min":0.41299999999999998,"15min":0.34499999999999997},"max":{"1min":1.038,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67300000000000004,"15min":0.67900000000000005},"min":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.377},"max":{"1min":1.004,"5min":1.0189999999999999,"15min":1.0309999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66500000000000004,"15min":0.68500000000000005},"min":{"1min":0.52200000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.68000000000000005,"15min":0.69899999999999995},"min":{"1min":0.48299999999999998,"5min":0.434,"15min":0.434},"max":{"1min":1.03,"5min":1.03,"15min":1.052},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.67900000000000005,"15min":0.69899999999999995},"min":{"1min":0.48599999999999999,"5min":0.441,"15min":0.441},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.624}]}]},{"osd":4,"up_from":13,"seq":55834575968,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303880,"kb_used_data":2688,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94067960,"statfs":{"total":96636764160,"available":96325591040,"internally_reserved":0,"allocated":2752512,"data_stored":1410986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52200000000000002,"15min":0.55500000000000005},"min":{"1min":0.315,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.85499999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54800000000000004,"15min":0.56499999999999995},"min":{"1min":0.376,"5min":0.34100000000000003,"15min":0.32500000000000001},"max":{"1min":0.77200000000000002,"5min":0.77500000000000002,"15min":0.94999999999999996},"last":0.69299999999999995}]},{"osd":1,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54000000000000004,"15min":0.56399999999999995},"min":{"1min":0.314,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.876},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.54800000000000004,"15min":0.57699999999999996},"min":{"1min":0.34899999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69799999999999995,"5min":0.81399999999999995,"15min":0.91200000000000003},"last":0.65600000000000003}]},{"osd":2,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.57599999999999996,"15min":0.59699999999999998},"min":{"1min":0.33400000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.79000000000000004,"5min":0.81200000000000006,"15min":0.93799999999999994},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.58599999999999997,"15min":0.621},"min":{"1min":0.371,"5min":0.35999999999999999,"15min":0.34899999999999998},"max":{"1min":0.77700000000000002,"5min":0.82299999999999995,"15min":0.94399999999999995},"last":0.51500000000000001}]},{"osd":3,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.53700000000000003,"15min":0.56000000000000005},"min":{"1min":0.38,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70899999999999996,"5min":0.73999999999999999,"15min":0.84999999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.56100000000000005,"15min":0.59599999999999997},"min":{"1min":0.432,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.80300000000000005,"5min":0.80800000000000005,"15min":0.872},"last":0.60999999999999999}]},{"osd":5,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42499999999999999,"15min":0.44700000000000001},"min":{"1min":0.32300000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.626,"5min":0.66600000000000004,"15min":0.86399999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.45000000000000001,"15min":0.46800000000000003},"min":{"1min":0.33700000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.82299999999999995},"last":0.35999999999999999}]},{"osd":6,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.47899999999999998,"15min":0.51100000000000001},"min":{"1min":0.36099999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":1.1399999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52200000000000002,"15min":0.55800000000000005},"min":{"1min":0.39800000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":1.1220000000000001},"last":0.41599999999999998}]},{"osd":7,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.47999999999999998,"15min":0.52300000000000002},"min":{"1min":0.36099999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77100000000000002,"5min":0.77400000000000002,"15min":0.90000000000000002},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55200000000000005,"15min":0.58099999999999996},"min":{"1min":0.44,"5min":0.38600000000000001,"15min":0.35599999999999998},"max":{"1min":0.72899999999999998,"5min":0.73599999999999999,"15min":0.86199999999999999},"last":0.46400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575968,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307980,"kb_used_data":2692,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063860,"statfs":{"total":96636764160,"available":96321392640,"internally_reserved":0,"allocated":2756608,"data_stored":1411044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.317,"5min":0.317,"15min":0.29799999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.54800000000000004},"min":{"1min":0.32800000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.90300000000000002},"last":0.76100000000000001}]},{"osd":1,"last update":"Thu Nov 30 18:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.83699999999999997},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.74199999999999999,"5min":0.76500000000000001,"15min":0.82899999999999996},"last":0.79100000000000004}]},{"osd":2,"last update":"Thu Nov 30 18:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.60499999999999998,"15min":0.60899999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.99199999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.61299999999999999,"15min":0.61399999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":1.173},"last":0.80300000000000005}]},{"osd":3,"last update":"Thu Nov 30 18:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.56699999999999995,"15min":0.56599999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.74399999999999999,"5min":0.77700000000000002,"15min":0.79300000000000004},"last":0.747},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58999999999999997,"15min":0.59499999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.753,"5min":0.77700000000000002,"15min":1.603},"last":0.71599999999999997}]},{"osd":4,"last update":"Thu Nov 30 18:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45800000000000002,"15min":0.45100000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.28100000000000003},"max":{"1min":0.58299999999999996,"5min":0.70299999999999996,"15min":0.75},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.436,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.54900000000000004,"5min":0.77900000000000003,"15min":0.81200000000000006},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Nov 30 18:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.505,"15min":0.5},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64200000000000002,"5min":0.76700000000000002,"15min":1.105},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57599999999999996,"15min":0.57099999999999995},"min":{"1min":0.40500000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":1.228},"last":0.72199999999999998}]},{"osd":7,"last update":"Thu Nov 30 18:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.54100000000000004,"15min":0.53600000000000003},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.625,"5min":0.80900000000000005,"15min":0.88100000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.39100000000000001,"5min":0.376,"15min":0.317},"max":{"1min":0.78700000000000003,"5min":0.82499999999999996,"15min":1.0640000000000001},"last":0.63100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T18:41:25.763 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-30T18:41:25.763 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-30T18:41:25.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.923+0000 7f290115a700 1 Processor -- start 2023-11-30T18:41:25.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.923+0000 7f290115a700 1 -- start start 2023-11-30T18:41:25.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.924+0000 7f290115a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f28fc098d10 0x7f28fc0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:25.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.924+0000 7f290115a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f28fc0c6190 0x7f28fc063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:25.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.924+0000 7f290115a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28fc064350 0x7f28fc158320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:25.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.924+0000 7f290115a700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28fc0c72d0 con 0x7f28fc0c6190 2023-11-30T18:41:25.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.924+0000 7f290115a700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28fc154bc0 con 0x7f28fc098d10 2023-11-30T18:41:25.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.924+0000 7f290115a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc0c66c0 con 0x7f28fc064350 2023-11-30T18:41:25.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.924+0000 7f28fa59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f28fc0c6190 0x7f28fc063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:25.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.924+0000 7f28fa59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f28fc0c6190 0x7f28fc063e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43748/0 (socket says 172.21.15.49:43748) 2023-11-30T18:41:25.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.924+0000 7f28fa59c700 1 -- 172.21.15.49:0/771712458 learned_addr learned my addr 172.21.15.49:0/771712458 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:25.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.924+0000 7f28fb59e700 1 --2- 172.21.15.49:0/771712458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28fc064350 0x7f28fc158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:25.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.924+0000 7f28fad9d700 1 --2- 172.21.15.49:0/771712458 >> v2:172.21.15.115:3300/0 conn(0x7f28fc098d10 0x7f28fc0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:25.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.924+0000 7f28fa59c700 1 -- 172.21.15.49:0/771712458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28fc064350 msgr2=0x7f28fc158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:25.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.924+0000 7f28fa59c700 1 --2- 172.21.15.49:0/771712458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28fc064350 0x7f28fc158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:25.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.924+0000 7f28fa59c700 1 -- 172.21.15.49:0/771712458 >> v2:172.21.15.115:3300/0 conn(0x7f28fc098d10 msgr2=0x7f28fc0c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:25.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.924+0000 7f28fa59c700 1 --2- 172.21.15.49:0/771712458 >> v2:172.21.15.115:3300/0 conn(0x7f28fc098d10 0x7f28fc0c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:25.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.924+0000 7f28fa59c700 1 -- 172.21.15.49:0/771712458 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28fc0c69a0 con 0x7f28fc0c6190 2023-11-30T18:41:25.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.925+0000 7f28fa59c700 1 --2- 172.21.15.49:0/771712458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28fc0c6190 0x7f28fc063e60 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 rx=0x7f28fc083f80 tx=0x7f28e40090f0).ready entity=mon.0 client_cookie=a17c32513ba8b13f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:25.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.925+0000 7f28f9d9b700 1 -- 172.21.15.49:0/771712458 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e400b600 con 0x7f28fc0c6190 2023-11-30T18:41:25.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.925+0000 7f28f9d9b700 1 -- 172.21.15.49:0/771712458 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e400b760 con 0x7f28fc0c6190 2023-11-30T18:41:25.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.925+0000 7f28f9d9b700 1 -- 172.21.15.49:0/771712458 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e400bae0 con 0x7f28fc0c6190 2023-11-30T18:41:25.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.925+0000 7f290115a700 1 -- 172.21.15.49:0/771712458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28fc0c6190 msgr2=0x7f28fc063e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:25.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.925+0000 7f290115a700 1 --2- 172.21.15.49:0/771712458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28fc0c6190 0x7f28fc063e60 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 rx=0x7f28fc083f80 tx=0x7f28e40090f0).stop 2023-11-30T18:41:25.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.925+0000 7f290115a700 1 -- 172.21.15.49:0/771712458 shutdown_connections 2023-11-30T18:41:25.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.925+0000 7f290115a700 1 --2- 172.21.15.49:0/771712458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28fc064350 0x7f28fc158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:25.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.925+0000 7f290115a700 1 --2- 172.21.15.49:0/771712458 >> v2:172.21.15.115:3300/0 conn(0x7f28fc098d10 0x7f28fc0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:25.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.925+0000 7f290115a700 1 --2- 172.21.15.49:0/771712458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28fc0c6190 0x7f28fc063e60 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:25.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.925+0000 7f290115a700 1 -- 172.21.15.49:0/771712458 >> 172.21.15.49:0/771712458 conn(0x7f28fc0cb310 msgr2=0x7f28fc0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:25.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.925+0000 7f290115a700 1 -- 172.21.15.49:0/771712458 shutdown_connections 2023-11-30T18:41:25.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.925+0000 7f290115a700 1 -- 172.21.15.49:0/771712458 wait complete. 2023-11-30T18:41:25.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.927+0000 7f290115a700 1 Processor -- start 2023-11-30T18:41:25.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.927+0000 7f290115a700 1 -- start start 2023-11-30T18:41:25.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.927+0000 7f290115a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28fc064350 0x7f28fc0c5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:25.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.927+0000 7f290115a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28fc098d10 0x7f28fc0c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:25.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.927+0000 7f290115a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28fc0c6190 0x7f28fc0b0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:25.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.927+0000 7f290115a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc154dc0 con 0x7f28fc0c6190 2023-11-30T18:41:25.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.927+0000 7f290115a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc155660 con 0x7f28fc098d10 2023-11-30T18:41:25.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.927+0000 7f290115a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc0c5650 con 0x7f28fc064350 2023-11-30T18:41:25.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.928+0000 7f28fb59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28fc0c6190 0x7f28fc0b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:25.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.928+0000 7f28fb59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28fc0c6190 0x7f28fc0b0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43762/0 (socket says 172.21.15.49:43762) 2023-11-30T18:41:25.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.928+0000 7f28fb59e700 1 -- 172.21.15.49:0/289762581 learned_addr learned my addr 172.21.15.49:0/289762581 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:25.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.928+0000 7f28fad9d700 1 --2- 172.21.15.49:0/289762581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28fc064350 0x7f28fc0c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:25.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.928+0000 7f28fa59c700 1 --2- 172.21.15.49:0/289762581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28fc098d10 0x7f28fc0c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:25.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.928+0000 7f28fb59e700 1 -- 172.21.15.49:0/289762581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28fc064350 msgr2=0x7f28fc0c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:25.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.928+0000 7f28fb59e700 1 --2- 172.21.15.49:0/289762581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28fc064350 0x7f28fc0c5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:25.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.928+0000 7f28fb59e700 1 -- 172.21.15.49:0/289762581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28fc098d10 msgr2=0x7f28fc0c31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:25.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.928+0000 7f28fb59e700 1 --2- 172.21.15.49:0/289762581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28fc098d10 0x7f28fc0c31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:25.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.928+0000 7f28fb59e700 1 -- 172.21.15.49:0/289762581 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e4009370 con 0x7f28fc0c6190 2023-11-30T18:41:25.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.928+0000 7f28fa59c700 1 --2- 172.21.15.49:0/289762581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28fc098d10 0x7f28fc0c31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:41:25.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.928+0000 7f28fb59e700 1 --2- 172.21.15.49:0/289762581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28fc0c6190 0x7f28fc0b0310 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 rx=0x7f28ec00d8f0 tx=0x7f28ec008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:25.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.928+0000 7f28f2ffd700 1 -- 172.21.15.49:0/289762581 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec011590 con 0x7f28fc0c6190 2023-11-30T18:41:25.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.928+0000 7f28f2ffd700 1 -- 172.21.15.49:0/289762581 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ec0116f0 con 0x7f28fc0c6190 2023-11-30T18:41:25.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.928+0000 7f290115a700 1 -- 172.21.15.49:0/289762581 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28fc0c36c0 con 0x7f28fc0c6190 2023-11-30T18:41:25.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.928+0000 7f28f2ffd700 1 -- 172.21.15.49:0/289762581 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec011a70 con 0x7f28fc0c6190 2023-11-30T18:41:25.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.928+0000 7f290115a700 1 -- 172.21.15.49:0/289762581 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28fc155010 con 0x7f28fc0c6190 2023-11-30T18:41:25.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.929+0000 7f290115a700 1 -- 172.21.15.49:0/289762581 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28fc06c860 con 0x7f28fc0c6190 2023-11-30T18:41:25.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.930+0000 7f28f2ffd700 1 -- 172.21.15.49:0/289762581 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f28ec01c460 con 0x7f28fc0c6190 2023-11-30T18:41:25.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.930+0000 7f28f2ffd700 1 --2- 172.21.15.49:0/289762581 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f28dc05f270 0x7f28dc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:25.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.930+0000 7f28f2ffd700 1 -- 172.21.15.49:0/289762581 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(219..219 src has 1..219) v4 ==== 6233+0+0 (secure 0 0 0) 0x7f28ec07a1c0 con 0x7f28fc0c6190 2023-11-30T18:41:25.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.930+0000 7f28fad9d700 1 --2- 172.21.15.49:0/289762581 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f28dc05f270 0x7f28dc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:25.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.931+0000 7f28fad9d700 1 --2- 172.21.15.49:0/289762581 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f28dc05f270 0x7f28dc061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f28f4009fd0 tx=0x7f28f4009880).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:25.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:25.934+0000 7f28f2ffd700 1 -- 172.21.15.49:0/289762581 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f28ec04b240 con 0x7f28fc0c6190 2023-11-30T18:41:26.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.176+0000 7f290115a700 1 -- 172.21.15.49:0/289762581 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f28fc0c6c80 con 0x7f28fc0c6190 2023-11-30T18:41:26.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.180+0000 7f28f2ffd700 1 -- 172.21.15.49:0/289762581 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v50) v1 ==== 190+0+0 (secure 0 0 0) 0x7f28ec04e860 con 0x7f28fc0c6190 2023-11-30T18:41:26.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.182+0000 7f290115a700 1 -- 172.21.15.49:0/289762581 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f28dc05f270 msgr2=0x7f28dc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:26.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.182+0000 7f290115a700 1 --2- 172.21.15.49:0/289762581 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f28dc05f270 0x7f28dc061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f28f4009fd0 tx=0x7f28f4009880).stop 2023-11-30T18:41:26.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.182+0000 7f290115a700 1 -- 172.21.15.49:0/289762581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28fc0c6190 msgr2=0x7f28fc0b0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:26.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.182+0000 7f290115a700 1 --2- 172.21.15.49:0/289762581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28fc0c6190 0x7f28fc0b0310 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 rx=0x7f28ec00d8f0 tx=0x7f28ec008040).stop 2023-11-30T18:41:26.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.182+0000 7f290115a700 1 -- 172.21.15.49:0/289762581 shutdown_connections 2023-11-30T18:41:26.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.182+0000 7f290115a700 1 --2- 172.21.15.49:0/289762581 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f28dc05f270 0x7f28dc061730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:26.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.182+0000 7f290115a700 1 --2- 172.21.15.49:0/289762581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28fc0c6190 0x7f28fc0b0310 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:26.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.182+0000 7f290115a700 1 --2- 172.21.15.49:0/289762581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28fc064350 0x7f28fc0c5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:26.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.182+0000 7f290115a700 1 --2- 172.21.15.49:0/289762581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28fc098d10 0x7f28fc0c31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:26.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.182+0000 7f290115a700 1 -- 172.21.15.49:0/289762581 >> 172.21.15.49:0/289762581 conn(0x7f28fc0cb310 msgr2=0x7f28fc158820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:26.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.182+0000 7f290115a700 1 -- 172.21.15.49:0/289762581 shutdown_connections 2023-11-30T18:41:26.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.182+0000 7f290115a700 1 -- 172.21.15.49:0/289762581 wait complete. 2023-11-30T18:41:26.184 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2023-11-30T18:41:26.195 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:41:26.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.312+0000 7fec3bfff700 1 Processor -- start 2023-11-30T18:41:26.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.312+0000 7fec3bfff700 1 -- start start 2023-11-30T18:41:26.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.313+0000 7fec3bfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fec3c0c0180 0x7fec3c157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:26.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.313+0000 7fec3bfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fec3c0c1750 0x7fec3c0c1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:26.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.313+0000 7fec3bfff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec3c0c12c0 con 0x7fec3c157660 2023-11-30T18:41:26.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.313+0000 7fec3bfff700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec3c0c06b0 con 0x7fec3c0c1750 2023-11-30T18:41:26.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.313+0000 7fec3bfff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec3c0c0990 con 0x7fec3c0c0180 2023-11-30T18:41:26.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.313+0000 7fec3b7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fec3c0c1750 0x7fec3c0c1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:26.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.313+0000 7fec3b7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fec3c0c1750 0x7fec3c0c1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43776/0 (socket says 172.21.15.49:43776) 2023-11-30T18:41:26.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.313+0000 7fec3b7fe700 1 -- 172.21.15.49:0/319512045 learned_addr learned my addr 172.21.15.49:0/319512045 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:26.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.313+0000 7fec3a7fc700 1 --2- 172.21.15.49:0/319512045 >> v2:172.21.15.115:3300/0 conn(0x7fec3c0c0180 0x7fec3c157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:26.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.313+0000 7fec3b7fe700 1 -- 172.21.15.49:0/319512045 >> v2:172.21.15.115:3300/0 conn(0x7fec3c0c0180 msgr2=0x7fec3c157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:26.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.313+0000 7fec3b7fe700 1 --2- 172.21.15.49:0/319512045 >> v2:172.21.15.115:3300/0 conn(0x7fec3c0c0180 0x7fec3c157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:26.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.313+0000 7fec3b7fe700 1 -- 172.21.15.49:0/319512045 >> v1:172.21.15.115:6789/0 conn(0x7fec3c157660 legacy=0x7fec3c1589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:26.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.313+0000 7fec3b7fe700 1 -- 172.21.15.49:0/319512045 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec3c0c0c70 con 0x7fec3c0c1750 2023-11-30T18:41:26.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.313+0000 7fec3a7fc700 1 --2- 172.21.15.49:0/319512045 >> v2:172.21.15.115:3300/0 conn(0x7fec3c0c0180 0x7fec3c157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:41:26.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.314+0000 7fec3b7fe700 1 --2- 172.21.15.49:0/319512045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec3c0c1750 0x7fec3c0c1b70 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 rx=0x7fec3c0c5820 tx=0x7fec340090f0).ready entity=mon.0 client_cookie=b675e698931779ee server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:26.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.314+0000 7fec39ffb700 1 -- 172.21.15.49:0/319512045 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3400b600 con 0x7fec3c0c1750 2023-11-30T18:41:26.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.314+0000 7fec39ffb700 1 -- 172.21.15.49:0/319512045 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3400b760 con 0x7fec3c0c1750 2023-11-30T18:41:26.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.314+0000 7fec39ffb700 1 -- 172.21.15.49:0/319512045 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3400bae0 con 0x7fec3c0c1750 2023-11-30T18:41:26.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.314+0000 7fec3bfff700 1 -- 172.21.15.49:0/319512045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec3c0c1750 msgr2=0x7fec3c0c1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:26.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.314+0000 7fec3bfff700 1 --2- 172.21.15.49:0/319512045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec3c0c1750 0x7fec3c0c1b70 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 rx=0x7fec3c0c5820 tx=0x7fec340090f0).stop 2023-11-30T18:41:26.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.314+0000 7fec3bfff700 1 -- 172.21.15.49:0/319512045 shutdown_connections 2023-11-30T18:41:26.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.314+0000 7fec3bfff700 1 --2- 172.21.15.49:0/319512045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec3c0c1750 0x7fec3c0c1b70 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:26.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.314+0000 7fec3bfff700 1 --2- 172.21.15.49:0/319512045 >> v2:172.21.15.115:3300/0 conn(0x7fec3c0c0180 0x7fec3c157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:26.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.314+0000 7fec3bfff700 1 -- 172.21.15.49:0/319512045 >> 172.21.15.49:0/319512045 conn(0x7fec3c0cb000 msgr2=0x7fec3c0cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:26.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.314+0000 7fec3bfff700 1 -- 172.21.15.49:0/319512045 shutdown_connections 2023-11-30T18:41:26.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.314+0000 7fec3bfff700 1 -- 172.21.15.49:0/319512045 wait complete. 2023-11-30T18:41:26.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.315+0000 7fec3bfff700 1 Processor -- start 2023-11-30T18:41:26.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.316+0000 7fec3bfff700 1 -- start start 2023-11-30T18:41:26.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.316+0000 7fec3bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec3c0c0180 0x7fec3c147810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:26.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.316+0000 7fec3bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec3c0c1750 0x7fec3c0c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:26.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.316+0000 7fec3bfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec3c157660 0x7fec3c0c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:26.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.316+0000 7fec3bfff700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c0ca320 con 0x7fec3c0c1750 2023-11-30T18:41:26.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.316+0000 7fec3bfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c0c36b0 con 0x7fec3c0c0180 2023-11-30T18:41:26.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.316+0000 7fec3bfff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c0c2aa0 con 0x7fec3c157660 2023-11-30T18:41:26.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.316+0000 7fec3a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec3c0c1750 0x7fec3c0c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:26.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.316+0000 7fec3a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec3c0c1750 0x7fec3c0c9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43788/0 (socket says 172.21.15.49:43788) 2023-11-30T18:41:26.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.316+0000 7fec3a7fc700 1 -- 172.21.15.49:0/4047039818 learned_addr learned my addr 172.21.15.49:0/4047039818 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:26.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.317+0000 7fec3a7fc700 1 -- 172.21.15.49:0/4047039818 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec3c157660 msgr2=0x7fec3c0c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:26.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.317+0000 7fec3a7fc700 1 --2- 172.21.15.49:0/4047039818 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec3c157660 0x7fec3c0c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:26.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.317+0000 7fec3a7fc700 1 -- 172.21.15.49:0/4047039818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec3c0c0180 msgr2=0x7fec3c147810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:26.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.317+0000 7fec3affd700 1 --2- 172.21.15.49:0/4047039818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec3c0c0180 0x7fec3c147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:26.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.317+0000 7fec3a7fc700 1 --2- 172.21.15.49:0/4047039818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec3c0c0180 0x7fec3c147810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:26.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.317+0000 7fec3a7fc700 1 -- 172.21.15.49:0/4047039818 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec34009370 con 0x7fec3c0c1750 2023-11-30T18:41:26.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.317+0000 7fec3a7fc700 1 --2- 172.21.15.49:0/4047039818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec3c0c1750 0x7fec3c0c9940 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 rx=0x7fec2400d860 tx=0x7fec24008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:26.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.317+0000 7fec32ffd700 1 -- 172.21.15.49:0/4047039818 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec24011590 con 0x7fec3c0c1750 2023-11-30T18:41:26.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.317+0000 7fec32ffd700 1 -- 172.21.15.49:0/4047039818 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec240116f0 con 0x7fec3c0c1750 2023-11-30T18:41:26.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.317+0000 7fec3bfff700 1 -- 172.21.15.49:0/4047039818 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec3c0c2d80 con 0x7fec3c0c1750 2023-11-30T18:41:26.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.317+0000 7fec32ffd700 1 -- 172.21.15.49:0/4047039818 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec24011a70 con 0x7fec3c0c1750 2023-11-30T18:41:26.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.317+0000 7fec3bfff700 1 -- 172.21.15.49:0/4047039818 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec3c0c3340 con 0x7fec3c0c1750 2023-11-30T18:41:26.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.318+0000 7fec3bfff700 1 -- 172.21.15.49:0/4047039818 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec3c0c3860 con 0x7fec3c0c1750 2023-11-30T18:41:26.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.318+0000 7fec32ffd700 1 -- 172.21.15.49:0/4047039818 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fec24012420 con 0x7fec3c0c1750 2023-11-30T18:41:26.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.319+0000 7fec32ffd700 1 --2- 172.21.15.49:0/4047039818 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fec1c05f270 0x7fec1c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:26.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.319+0000 7fec32ffd700 1 -- 172.21.15.49:0/4047039818 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(219..219 src has 1..219) v4 ==== 6233+0+0 (secure 0 0 0) 0x7fec24079fa0 con 0x7fec3c0c1750 2023-11-30T18:41:26.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.319+0000 7fec3affd700 1 --2- 172.21.15.49:0/4047039818 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fec1c05f270 0x7fec1c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:26.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.320+0000 7fec3affd700 1 --2- 172.21.15.49:0/4047039818 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fec1c05f270 0x7fec1c061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fec3c0ada50 tx=0x7fec2c009040).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:26.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.323+0000 7fec32ffd700 1 -- 172.21.15.49:0/4047039818 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fec3c0c3860 con 0x7fec3c0c1750 2023-11-30T18:41:26.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.538+0000 7fec3bfff700 1 -- 172.21.15.49:0/4047039818 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec3c0c3860 con 0x7fec3c0c1750 2023-11-30T18:41:26.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.538+0000 7fec32ffd700 1 -- 172.21.15.49:0/4047039818 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4499 (secure 0 0 0) 0x7fec3c0c3860 con 0x7fec3c0c1750 2023-11-30T18:41:26.539 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:26.539 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":93,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8219,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3124035021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3124035021},{"type":"v1","addr":"172.21.15.115:6837","nonce":3124035021}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":9565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2947558957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2947558957},{"type":"v1","addr":"172.21.15.115:6836","nonce":2947558957}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":9996,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1999244219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1999244219},{"type":"v1","addr":"172.21.15.49:6834","nonce":1999244219}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T18:41:21.351721+0000","modified":"2023-11-30T18:41:24.361310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9999":{"gid":9999,"name":"a","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1129424322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1129424322},{"type":"v1","addr":"172.21.15.49:6835","nonce":1129424322}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-11-30T18:41:26.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.540+0000 7fec3bfff700 1 -- 172.21.15.49:0/4047039818 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fec1c05f270 msgr2=0x7fec1c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:26.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.540+0000 7fec3bfff700 1 --2- 172.21.15.49:0/4047039818 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fec1c05f270 0x7fec1c061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fec3c0ada50 tx=0x7fec2c009040).stop 2023-11-30T18:41:26.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.540+0000 7fec3bfff700 1 -- 172.21.15.49:0/4047039818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec3c0c1750 msgr2=0x7fec3c0c9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:26.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.540+0000 7fec3bfff700 1 --2- 172.21.15.49:0/4047039818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec3c0c1750 0x7fec3c0c9940 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 rx=0x7fec2400d860 tx=0x7fec24008040).stop 2023-11-30T18:41:26.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.540+0000 7fec3bfff700 1 -- 172.21.15.49:0/4047039818 shutdown_connections 2023-11-30T18:41:26.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.540+0000 7fec3bfff700 1 --2- 172.21.15.49:0/4047039818 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fec1c05f270 0x7fec1c061730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:26.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.540+0000 7fec3bfff700 1 --2- 172.21.15.49:0/4047039818 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec3c157660 0x7fec3c0c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:26.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.540+0000 7fec3bfff700 1 --2- 172.21.15.49:0/4047039818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec3c0c0180 0x7fec3c147810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:26.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.540+0000 7fec3bfff700 1 --2- 172.21.15.49:0/4047039818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec3c0c1750 0x7fec3c0c9940 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:26.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.540+0000 7fec3bfff700 1 -- 172.21.15.49:0/4047039818 >> 172.21.15.49:0/4047039818 conn(0x7fec3c0cb000 msgr2=0x7fec3c151890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:26.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.540+0000 7fec3bfff700 1 -- 172.21.15.49:0/4047039818 shutdown_connections 2023-11-30T18:41:26.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:26.540+0000 7fec3bfff700 1 -- 172.21.15.49:0/4047039818 wait complete. 2023-11-30T18:41:26.542 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 93 2023-11-30T18:41:26.582 INFO:tasks.ceph.mds.a.smithi049.stderr:2023-11-30T18:41:26.581+0000 7f807fd4c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-30T18:41:26.957 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 93, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-30T18:41:21.351721+0000', 'modified': '2023-11-30T18:41:24.361310+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9999}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9999': {'gid': 9999, 'name': 'a', 'rank': 0, 'incarnation': 89, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6835/1129424322', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6833', 'nonce': 1129424322}, {'type': 'v1', 'addr': '172.21.15.49:6835', 'nonce': 1129424322}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-11-30T18:41:26.957 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-30T18:41:26.957 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-30T18:41:27.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.077+0000 7fce8214a700 1 Processor -- start 2023-11-30T18:41:27.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.077+0000 7fce8214a700 1 -- start start 2023-11-30T18:41:27.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.078+0000 7fce8214a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fce7c14e530 0x7fce7c0c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:27.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.078+0000 7fce8214a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fce7c154950 0x7fce7c14e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:27.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.078+0000 7fce8214a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce7c0c7bc0 con 0x7fce7c158570 2023-11-30T18:41:27.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.078+0000 7fce8214a700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce7c155920 con 0x7fce7c154950 2023-11-30T18:41:27.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.078+0000 7fce8214a700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce7c154e00 con 0x7fce7c14e530 2023-11-30T18:41:27.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.078+0000 7fce80947700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fce7c154950 0x7fce7c14e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:27.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.078+0000 7fce81949700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fce7c158570 0x7fce7c0aa030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57380/0 (socket says 172.21.15.49:57380) 2023-11-30T18:41:27.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.078+0000 7fce81949700 1 -- 172.21.15.49:0/487312450 learned_addr learned my addr 172.21.15.49:0/487312450 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:27.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.078+0000 7fce81148700 1 --2- 172.21.15.49:0/487312450 >> v2:172.21.15.115:3300/0 conn(0x7fce7c14e530 0x7fce7c0c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:27.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.078+0000 7fce80947700 1 -- 172.21.15.49:0/487312450 >> v2:172.21.15.115:3300/0 conn(0x7fce7c14e530 msgr2=0x7fce7c0c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:27.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.078+0000 7fce80947700 1 --2- 172.21.15.49:0/487312450 >> v2:172.21.15.115:3300/0 conn(0x7fce7c14e530 0x7fce7c0c66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.078+0000 7fce80947700 1 -- 172.21.15.49:0/487312450 >> v1:172.21.15.49:6789/0 conn(0x7fce7c158570 legacy=0x7fce7c0aa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:27.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.078+0000 7fce7bfff700 1 -- 172.21.15.49:0/487312450 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223091611 0 0) 0x7fce7c0c7bc0 con 0x7fce7c158570 2023-11-30T18:41:27.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.078+0000 7fce80947700 1 -- 172.21.15.49:0/487312450 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7c155080 con 0x7fce7c154950 2023-11-30T18:41:27.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.078+0000 7fce80947700 1 --2- 172.21.15.49:0/487312450 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce7c154950 0x7fce7c14e910 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 rx=0x7fce7c064450 tx=0x7fce70009060).ready entity=mon.0 client_cookie=f1b6573cad5cf70f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:27.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.079+0000 7fce7bfff700 1 -- 172.21.15.49:0/487312450 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7000b580 con 0x7fce7c154950 2023-11-30T18:41:27.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.079+0000 7fce7bfff700 1 -- 172.21.15.49:0/487312450 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7000b6e0 con 0x7fce7c154950 2023-11-30T18:41:27.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.079+0000 7fce7bfff700 1 -- 172.21.15.49:0/487312450 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7000ba60 con 0x7fce7c154950 2023-11-30T18:41:27.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.079+0000 7fce8214a700 1 -- 172.21.15.49:0/487312450 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce7c154950 msgr2=0x7fce7c14e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:27.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.079+0000 7fce8214a700 1 --2- 172.21.15.49:0/487312450 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce7c154950 0x7fce7c14e910 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 rx=0x7fce7c064450 tx=0x7fce70009060).stop 2023-11-30T18:41:27.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.079+0000 7fce8214a700 1 -- 172.21.15.49:0/487312450 shutdown_connections 2023-11-30T18:41:27.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.079+0000 7fce8214a700 1 --2- 172.21.15.49:0/487312450 >> v2:172.21.15.115:3300/0 conn(0x7fce7c14e530 0x7fce7c0c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.079+0000 7fce8214a700 1 --2- 172.21.15.49:0/487312450 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce7c154950 0x7fce7c14e910 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.079+0000 7fce8214a700 1 -- 172.21.15.49:0/487312450 >> 172.21.15.49:0/487312450 conn(0x7fce7c064990 msgr2=0x7fce7c064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:27.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.079+0000 7fce8214a700 1 -- 172.21.15.49:0/487312450 shutdown_connections 2023-11-30T18:41:27.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.079+0000 7fce8214a700 1 -- 172.21.15.49:0/487312450 wait complete. 2023-11-30T18:41:27.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.080+0000 7fce8214a700 1 Processor -- start 2023-11-30T18:41:27.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.080+0000 7fce8214a700 1 -- start start 2023-11-30T18:41:27.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.081+0000 7fce8214a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce7c14e530 0x7fce7c163e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:27.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.081+0000 7fce8214a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce7c154950 0x7fce7c0af900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:27.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.081+0000 7fce8214a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce7c158570 0x7fce7c0afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:27.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.081+0000 7fce8214a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c0c2fb0 con 0x7fce7c154950 2023-11-30T18:41:27.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.081+0000 7fce8214a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c164370 con 0x7fce7c158570 2023-11-30T18:41:27.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.081+0000 7fce8214a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c0b0490 con 0x7fce7c14e530 2023-11-30T18:41:27.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.081+0000 7fce80947700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce7c154950 0x7fce7c0af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:27.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.081+0000 7fce80947700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce7c154950 0x7fce7c0af900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43814/0 (socket says 172.21.15.49:43814) 2023-11-30T18:41:27.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.081+0000 7fce80947700 1 -- 172.21.15.49:0/458329948 learned_addr learned my addr 172.21.15.49:0/458329948 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:27.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.081+0000 7fce81949700 1 --2- 172.21.15.49:0/458329948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce7c158570 0x7fce7c0afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:27.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.081+0000 7fce81148700 1 --2- 172.21.15.49:0/458329948 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce7c14e530 0x7fce7c163e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:27.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.082+0000 7fce80947700 1 -- 172.21.15.49:0/458329948 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce7c14e530 msgr2=0x7fce7c163e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:27.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.082+0000 7fce80947700 1 --2- 172.21.15.49:0/458329948 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce7c14e530 0x7fce7c163e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.082+0000 7fce80947700 1 -- 172.21.15.49:0/458329948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce7c158570 msgr2=0x7fce7c0afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:27.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.082+0000 7fce80947700 1 --2- 172.21.15.49:0/458329948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce7c158570 0x7fce7c0afdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.082+0000 7fce80947700 1 -- 172.21.15.49:0/458329948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce700092a0 con 0x7fce7c154950 2023-11-30T18:41:27.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.082+0000 7fce80947700 1 --2- 172.21.15.49:0/458329948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce7c154950 0x7fce7c0af900 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 rx=0x7fce70009fd0 tx=0x7fce70017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:27.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.082+0000 7fce797fa700 1 -- 172.21.15.49:0/458329948 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7000b850 con 0x7fce7c154950 2023-11-30T18:41:27.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.082+0000 7fce797fa700 1 -- 172.21.15.49:0/458329948 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7000b9b0 con 0x7fce7c154950 2023-11-30T18:41:27.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.082+0000 7fce8214a700 1 -- 172.21.15.49:0/458329948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce7c0b0770 con 0x7fce7c154950 2023-11-30T18:41:27.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.082+0000 7fce797fa700 1 -- 172.21.15.49:0/458329948 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7001b660 con 0x7fce7c154950 2023-11-30T18:41:27.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.082+0000 7fce8214a700 1 -- 172.21.15.49:0/458329948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce7c0c2630 con 0x7fce7c154950 2023-11-30T18:41:27.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.083+0000 7fce797fa700 1 -- 172.21.15.49:0/458329948 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fce7001ba90 con 0x7fce7c154950 2023-11-30T18:41:27.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.084+0000 7fce797fa700 1 --2- 172.21.15.49:0/458329948 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fce6805f270 0x7fce68061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:27.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.084+0000 7fce797fa700 1 -- 172.21.15.49:0/458329948 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(219..219 src has 1..219) v4 ==== 6233+0+0 (secure 0 0 0) 0x7fce7007bf00 con 0x7fce7c154950 2023-11-30T18:41:27.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.084+0000 7fce81148700 1 --2- 172.21.15.49:0/458329948 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fce6805f270 0x7fce68061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:27.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.085+0000 7fce81148700 1 --2- 172.21.15.49:0/458329948 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fce6805f270 0x7fce68061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fce74006fd0 tx=0x7fce74008040).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:27.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.086+0000 7fce94d44b80 1 Processor -- start 2023-11-30T18:41:27.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.086+0000 7fce94d44b80 1 -- start start 2023-11-30T18:41:27.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.087+0000 7fce94d44b80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606706f9e40 0x56067093d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:27.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.087+0000 7fce94d44b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606709864e0 0x56067093dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:27.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.087+0000 7fce94d44b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560670965cf0 0x5606709387e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:27.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.087+0000 7fce94d44b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x560670903060 con 0x560670965cf0 2023-11-30T18:41:27.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.087+0000 7fce94d44b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x56067087a1f0 con 0x5606709864e0 2023-11-30T18:41:27.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.087+0000 7fce94d44b80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x56067088f440 con 0x5606706f9e40 2023-11-30T18:41:27.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.087+0000 7fce81949700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560670965cf0 0x5606709387e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:27.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.087+0000 7fce81949700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560670965cf0 0x5606709387e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43822/0 (socket says 172.21.15.49:43822) 2023-11-30T18:41:27.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.087+0000 7fce81949700 1 -- 172.21.15.49:0/665053398 learned_addr learned my addr 172.21.15.49:0/665053398 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:27.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.087+0000 7fce81148700 1 --2- 172.21.15.49:0/665053398 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606706f9e40 0x56067093d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:27.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.087+0000 7fce80947700 1 --2- 172.21.15.49:0/665053398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606709864e0 0x56067093dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:27.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.087+0000 7fce81949700 1 -- 172.21.15.49:0/665053398 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606706f9e40 msgr2=0x56067093d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:27.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.087+0000 7fce81949700 1 --2- 172.21.15.49:0/665053398 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606706f9e40 0x56067093d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.087+0000 7fce81949700 1 -- 172.21.15.49:0/665053398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606709864e0 msgr2=0x56067093dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:27.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.087+0000 7fce81949700 1 --2- 172.21.15.49:0/665053398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606709864e0 0x56067093dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.087+0000 7fce81949700 1 -- 172.21.15.49:0/665053398 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560670888620 con 0x560670965cf0 2023-11-30T18:41:27.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.087+0000 7fce81949700 1 --2- 172.21.15.49:0/665053398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560670965cf0 0x5606709387e0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 rx=0x7fce6c001c10 tx=0x7fce6c009040).ready entity=mon.0 client_cookie=a069e4f00ec5af1c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:27.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.087+0000 7fce627fc700 1 -- 172.21.15.49:0/665053398 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c005d10 con 0x560670965cf0 2023-11-30T18:41:27.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.087+0000 7fce627fc700 1 -- 172.21.15.49:0/665053398 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6c005e70 con 0x560670965cf0 2023-11-30T18:41:27.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.087+0000 7fce627fc700 1 -- 172.21.15.49:0/665053398 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c00e800 con 0x560670965cf0 2023-11-30T18:41:27.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.088+0000 7fce94d44b80 1 -- 172.21.15.49:0/665053398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560670965cf0 msgr2=0x5606709387e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:27.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.088+0000 7fce94d44b80 1 --2- 172.21.15.49:0/665053398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560670965cf0 0x5606709387e0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 rx=0x7fce6c001c10 tx=0x7fce6c009040).stop 2023-11-30T18:41:27.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.088+0000 7fce94d44b80 1 -- 172.21.15.49:0/665053398 shutdown_connections 2023-11-30T18:41:27.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.088+0000 7fce94d44b80 1 --2- 172.21.15.49:0/665053398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560670965cf0 0x5606709387e0 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.088+0000 7fce94d44b80 1 --2- 172.21.15.49:0/665053398 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606706f9e40 0x56067093d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.088+0000 7fce94d44b80 1 --2- 172.21.15.49:0/665053398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606709864e0 0x56067093dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.088+0000 7fce94d44b80 1 -- 172.21.15.49:0/665053398 >> 172.21.15.49:0/665053398 conn(0x5606707a74a0 msgr2=0x560670986970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:27.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.088+0000 7fce94d44b80 1 -- 172.21.15.49:0/665053398 shutdown_connections 2023-11-30T18:41:27.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.088+0000 7fce94d44b80 1 -- 172.21.15.49:0/665053398 wait complete. 2023-11-30T18:41:27.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.089+0000 7fce94d44b80 1 -- start start 2023-11-30T18:41:27.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.089+0000 7fce94d44b80 1 Processor -- start 2023-11-30T18:41:27.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.090+0000 7fce94d44b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606706f9e40 0x560670965020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:27.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.090+0000 7fce94d44b80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x560670965cf0 0x5606709857e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:27.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.090+0000 7fce94d44b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606709864e0 0x560670985cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:27.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.090+0000 7fce94d44b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x56067088f580 con 0x5606706f9e40 2023-11-30T18:41:27.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.090+0000 7fce94d44b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x56067088f800 con 0x5606709864e0 2023-11-30T18:41:27.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.090+0000 7fce94d44b80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x56067085ae10 con 0x560670965cf0 2023-11-30T18:41:27.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.090+0000 7fce94d44b80 10 client.0 ll_register_callbacks cb 0x5606708fd640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-30T18:41:27.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.090+0000 7fce81148700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606706f9e40 0x560670965020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:27.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.090+0000 7fce81148700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606706f9e40 0x560670965020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43834/0 (socket says 172.21.15.49:43834) 2023-11-30T18:41:27.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.090+0000 7fce81148700 1 -- 172.21.15.49:0/3353254967 learned_addr learned my addr 172.21.15.49:0/3353254967 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:27.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.090+0000 7fce80947700 1 --2- 172.21.15.49:0/3353254967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x560670965cf0 0x5606709857e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:27.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.090+0000 7fce81949700 1 --2- 172.21.15.49:0/3353254967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606709864e0 0x560670985cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:27.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.090+0000 7fce81148700 1 -- 172.21.15.49:0/3353254967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x560670965cf0 msgr2=0x5606709857e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:27.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.090+0000 7fce81148700 1 --2- 172.21.15.49:0/3353254967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x560670965cf0 0x5606709857e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.090+0000 7fce81148700 1 -- 172.21.15.49:0/3353254967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606709864e0 msgr2=0x560670985cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:27.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.090+0000 7fce81148700 1 --2- 172.21.15.49:0/3353254967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606709864e0 0x560670985cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.090+0000 7fce81148700 1 -- 172.21.15.49:0/3353254967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce6c00f040 con 0x5606706f9e40 2023-11-30T18:41:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.090+0000 7fce81148700 1 --2- 172.21.15.49:0/3353254967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606706f9e40 0x560670965020 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 rx=0x7fce74013400 tx=0x7fce74016040).ready entity=mon.0 client_cookie=279b355a5f2b25f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.090+0000 7fce5b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-30T18:41:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.090+0000 7fce5b7fe700 1 -- 172.21.15.49:0/3353254967 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74013e80 con 0x5606706f9e40 2023-11-30T18:41:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.090+0000 7fce5b7fe700 1 -- 172.21.15.49:0/3353254967 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(219..219 src has 1..219) v4 ==== 6233+0+0 (secure 0 0 0) 0x7fce74020420 con 0x5606706f9e40 2023-11-30T18:41:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.090+0000 7fce94d44b80 1 -- 172.21.15.49:0/3353254967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560670931720 con 0x5606706f9e40 2023-11-30T18:41:27.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.091+0000 7fce5b7fe700 1 -- 172.21.15.49:0/3353254967 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce74020840 con 0x5606706f9e40 2023-11-30T18:41:27.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.091+0000 7fce94d44b80 10 client.10152 fetch_fsmap learned FSMap version 93 2023-11-30T18:41:27.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.091+0000 7fce94d44b80 1 -- 172.21.15.49:0/3353254967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x5606708839c0 con 0x5606706f9e40 2023-11-30T18:41:27.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.091+0000 7fce5b7fe700 1 -- 172.21.15.49:0/3353254967 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560670931720 con 0x5606706f9e40 2023-11-30T18:41:27.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.091+0000 7fce5b7fe700 1 -- 172.21.15.49:0/3353254967 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 93) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fce740209a0 con 0x5606706f9e40 2023-11-30T18:41:27.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.091+0000 7fce94d44b80 10 client.10152 fetch_fsmap finished waiting for FSMap version 93 2023-11-30T18:41:27.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.091+0000 7fce94d44b80 10 client.10152 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-30T18:41:27.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.091+0000 7fce94d44b80 20 client.10152 populate_metadata read hostname 'smithi049' 2023-11-30T18:41:27.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.091+0000 7fce94d44b80 1 --2- 172.21.15.49:0/3353254967 >> [v2:172.21.15.49:6833/1129424322,v1:172.21.15.49:6835/1129424322] conn(0x560670991e60 0x560670992240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:27.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.091+0000 7fce94d44b80 4 client.10152 mds_command: new command op to 9999 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-30T18:41:27.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.091+0000 7fce94d44b80 1 -- 172.21.15.49:0/3353254967 --> [v2:172.21.15.49:6833/1129424322,v1:172.21.15.49:6835/1129424322] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5606706f5ca0 con 0x560670991e60 2023-11-30T18:41:27.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.091+0000 7fce80947700 1 --2- 172.21.15.49:0/3353254967 >> [v2:172.21.15.49:6833/1129424322,v1:172.21.15.49:6835/1129424322] conn(0x560670991e60 0x560670992240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:27.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.091+0000 7fce80947700 1 --2- 172.21.15.49:0/3353254967 >> [v2:172.21.15.49:6833/1129424322,v1:172.21.15.49:6835/1129424322] conn(0x560670991e60 0x560670992240 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=a095b04b847e4a3c server_cookie=22772ba9f1cb0225 in_seq=0 out_seq=0 2023-11-30T18:41:27.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.091+0000 7fce5b7fe700 10 client.10152 ms_handle_connect on v2:172.21.15.49:6833/1129424322 2023-11-30T18:41:27.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.092+0000 7fce5b7fe700 1 -- 172.21.15.49:0/3353254967 <== mds.0 v2:172.21.15.49:6833/1129424322 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5606706f5ca0 con 0x560670991e60 2023-11-30T18:41:27.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.092+0000 7fce5b7fe700 10 client.10152 handle_command_reply: tid=0 2023-11-30T18:41:27.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.092+0000 7fce94d44b80 1 client.10152 shutdown 2023-11-30T18:41:27.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.092+0000 7fce94d44b80 1 -- 172.21.15.49:0/3353254967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606706f9e40 msgr2=0x560670965020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:27.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.092+0000 7fce94d44b80 1 --2- 172.21.15.49:0/3353254967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606706f9e40 0x560670965020 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 rx=0x7fce74013400 tx=0x7fce74016040).stop 2023-11-30T18:41:27.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.092+0000 7fce94d44b80 1 -- 172.21.15.49:0/3353254967 shutdown_connections 2023-11-30T18:41:27.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.092+0000 7fce94d44b80 1 --2- 172.21.15.49:0/3353254967 >> [v2:172.21.15.49:6833/1129424322,v1:172.21.15.49:6835/1129424322] conn(0x560670991e60 0x560670992240 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.092+0000 7fce94d44b80 1 --2- 172.21.15.49:0/3353254967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606709864e0 0x560670985cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.092+0000 7fce94d44b80 1 --2- 172.21.15.49:0/3353254967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606706f9e40 0x560670965020 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.092+0000 7fce5b7fe700 0 client.10152 ms_handle_reset on v2:172.21.15.49:6833/1129424322 2023-11-30T18:41:27.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.092+0000 7fce94d44b80 1 --2- 172.21.15.49:0/3353254967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x560670965cf0 0x5606709857e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.092+0000 7fce94d44b80 1 -- 172.21.15.49:0/3353254967 >> 172.21.15.49:0/3353254967 conn(0x5606707a74a0 msgr2=0x56067093d880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:27.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.092+0000 7fce94d44b80 1 -- 172.21.15.49:0/3353254967 shutdown_connections 2023-11-30T18:41:27.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.092+0000 7fce94d44b80 1 -- 172.21.15.49:0/3353254967 wait complete. 2023-11-30T18:41:27.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.092+0000 7fce94d44b80 20 client.10152 trim_cache size 0 max 16384 2023-11-30T18:41:27.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.109+0000 7fce94d44b80 1 Processor -- start 2023-11-30T18:41:27.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.109+0000 7fce94d44b80 1 -- start start 2023-11-30T18:41:27.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.110+0000 7fce94d44b80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606706f9e40 0x560670961c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:27.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.110+0000 7fce94d44b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560670965cf0 0x560670985ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:27.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.110+0000 7fce94d44b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606709864e0 0x56067099b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:27.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.110+0000 7fce94d44b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x560670938630 con 0x5606709864e0 2023-11-30T18:41:27.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.110+0000 7fce94d44b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606709390f0 con 0x560670965cf0 2023-11-30T18:41:27.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.110+0000 7fce94d44b80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x560670939ae0 con 0x5606706f9e40 2023-11-30T18:41:27.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.110+0000 7fce81949700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606709864e0 0x56067099b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:27.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.110+0000 7fce81949700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606709864e0 0x56067099b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43844/0 (socket says 172.21.15.49:43844) 2023-11-30T18:41:27.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.110+0000 7fce81949700 1 -- 172.21.15.49:0/3120064520 learned_addr learned my addr 172.21.15.49:0/3120064520 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:27.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.110+0000 7fce81148700 1 --2- 172.21.15.49:0/3120064520 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606706f9e40 0x560670961c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:27.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.110+0000 7fce80947700 1 --2- 172.21.15.49:0/3120064520 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560670965cf0 0x560670985ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:27.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.110+0000 7fce81949700 1 -- 172.21.15.49:0/3120064520 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606706f9e40 msgr2=0x560670961c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:27.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.110+0000 7fce81949700 1 --2- 172.21.15.49:0/3120064520 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606706f9e40 0x560670961c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.110+0000 7fce81949700 1 -- 172.21.15.49:0/3120064520 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560670965cf0 msgr2=0x560670985ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:27.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.110+0000 7fce81949700 1 --2- 172.21.15.49:0/3120064520 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560670965cf0 0x560670985ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.110+0000 7fce81949700 1 -- 172.21.15.49:0/3120064520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560670883710 con 0x5606709864e0 2023-11-30T18:41:27.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.110+0000 7fce81148700 1 --2- 172.21.15.49:0/3120064520 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606706f9e40 0x560670961c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:41:27.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.110+0000 7fce81949700 1 --2- 172.21.15.49:0/3120064520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606709864e0 0x56067099b1d0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 rx=0x7fce6c00e440 tx=0x56067093e4d0).ready entity=mon.0 client_cookie=a52499c07744a9bb server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:27.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.110+0000 7fce62ffd700 1 -- 172.21.15.49:0/3120064520 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c000fb0 con 0x5606709864e0 2023-11-30T18:41:27.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.110+0000 7fce62ffd700 1 -- 172.21.15.49:0/3120064520 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6c00e5f0 con 0x5606709864e0 2023-11-30T18:41:27.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.110+0000 7fce62ffd700 1 -- 172.21.15.49:0/3120064520 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c00e760 con 0x5606709864e0 2023-11-30T18:41:27.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.111+0000 7fce94d44b80 1 -- 172.21.15.49:0/3120064520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606709864e0 msgr2=0x56067099b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:27.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.111+0000 7fce94d44b80 1 --2- 172.21.15.49:0/3120064520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606709864e0 0x56067099b1d0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 rx=0x7fce6c00e440 tx=0x56067093e4d0).stop 2023-11-30T18:41:27.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.111+0000 7fce94d44b80 1 -- 172.21.15.49:0/3120064520 shutdown_connections 2023-11-30T18:41:27.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.111+0000 7fce94d44b80 1 --2- 172.21.15.49:0/3120064520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606709864e0 0x56067099b1d0 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.111+0000 7fce94d44b80 1 --2- 172.21.15.49:0/3120064520 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5606706f9e40 0x560670961c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.111+0000 7fce94d44b80 1 --2- 172.21.15.49:0/3120064520 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560670965cf0 0x560670985ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.111+0000 7fce94d44b80 1 -- 172.21.15.49:0/3120064520 >> 172.21.15.49:0/3120064520 conn(0x5606707a74a0 msgr2=0x560670986970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:27.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.111+0000 7fce94d44b80 1 -- 172.21.15.49:0/3120064520 shutdown_connections 2023-11-30T18:41:27.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.111+0000 7fce94d44b80 1 -- 172.21.15.49:0/3120064520 wait complete. 2023-11-30T18:41:27.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.111+0000 7fce94d44b80 1 -- start start 2023-11-30T18:41:27.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.112+0000 7fce94d44b80 1 Processor -- start 2023-11-30T18:41:27.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.112+0000 7fce94d44b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606706f9e40 0x5606709e7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:27.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.112+0000 7fce94d44b80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x560670965cf0 0x560670986a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:27.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.112+0000 7fce94d44b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606709864e0 0x56067096b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:27.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.112+0000 7fce94d44b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606709e7c30 con 0x5606709864e0 2023-11-30T18:41:27.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.112+0000 7fce94d44b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606709e7f10 con 0x5606706f9e40 2023-11-30T18:41:27.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.112+0000 7fce94d44b80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x56067095e6c0 con 0x560670965cf0 2023-11-30T18:41:27.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.113+0000 7fce94d44b80 10 client.0 ll_register_callbacks cb 0x5606708fd640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-30T18:41:27.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.113+0000 7fce81949700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606709864e0 0x56067096b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:27.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.113+0000 7fce81949700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606709864e0 0x56067096b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43856/0 (socket says 172.21.15.49:43856) 2023-11-30T18:41:27.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.113+0000 7fce81949700 1 -- 172.21.15.49:0/3419294664 learned_addr learned my addr 172.21.15.49:0/3419294664 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:27.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.113+0000 7fce80947700 1 --2- 172.21.15.49:0/3419294664 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x560670965cf0 0x560670986a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:27.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.113+0000 7fce81148700 1 --2- 172.21.15.49:0/3419294664 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606706f9e40 0x5606709e7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:27.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.113+0000 7fce81949700 1 -- 172.21.15.49:0/3419294664 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x560670965cf0 msgr2=0x560670986a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:27.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.113+0000 7fce81949700 1 --2- 172.21.15.49:0/3419294664 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x560670965cf0 0x560670986a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.113+0000 7fce81949700 1 -- 172.21.15.49:0/3419294664 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606706f9e40 msgr2=0x5606709e7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:27.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.113+0000 7fce81949700 1 --2- 172.21.15.49:0/3419294664 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606706f9e40 0x5606709e7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.113+0000 7fce81949700 1 -- 172.21.15.49:0/3419294664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce6c018040 con 0x5606709864e0 2023-11-30T18:41:27.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.113+0000 7fce81949700 1 --2- 172.21.15.49:0/3419294664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606709864e0 0x56067096b290 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 rx=0x7fce6c023040 tx=0x7fce6c020000).ready entity=mon.0 client_cookie=239b1126249a0ece server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:27.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.113+0000 7fce5b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-30T18:41:27.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.113+0000 7fce5b7fe700 1 -- 172.21.15.49:0/3419294664 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c004a30 con 0x5606709864e0 2023-11-30T18:41:27.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.113+0000 7fce5b7fe700 1 -- 172.21.15.49:0/3419294664 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(219..219 src has 1..219) v4 ==== 6233+0+0 (secure 0 0 0) 0x7fce6c004b90 con 0x5606709864e0 2023-11-30T18:41:27.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.113+0000 7fce94d44b80 1 -- 172.21.15.49:0/3419294664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fce6c005e70 con 0x5606709864e0 2023-11-30T18:41:27.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.113+0000 7fce5b7fe700 1 -- 172.21.15.49:0/3419294664 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce6c0070d0 con 0x5606709864e0 2023-11-30T18:41:27.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.113+0000 7fce94d44b80 10 client.10158 fetch_fsmap learned FSMap version 93 2023-11-30T18:41:27.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.113+0000 7fce94d44b80 1 -- 172.21.15.49:0/3419294664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x5606706faf80 con 0x5606709864e0 2023-11-30T18:41:27.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.114+0000 7fce5b7fe700 1 -- 172.21.15.49:0/3419294664 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6c005e70 con 0x5606709864e0 2023-11-30T18:41:27.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.114+0000 7fce5b7fe700 1 -- 172.21.15.49:0/3419294664 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 93) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fce6c007230 con 0x5606709864e0 2023-11-30T18:41:27.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.114+0000 7fce94d44b80 10 client.10158 fetch_fsmap finished waiting for FSMap version 93 2023-11-30T18:41:27.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.114+0000 7fce94d44b80 10 client.10158 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-30T18:41:27.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.114+0000 7fce94d44b80 20 client.10158 populate_metadata read hostname 'smithi049' 2023-11-30T18:41:27.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.114+0000 7fce94d44b80 1 --2- 172.21.15.49:0/3419294664 >> [v2:172.21.15.49:6833/1129424322,v1:172.21.15.49:6835/1129424322] conn(0x56067095ebe0 0x56067095efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:27.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.114+0000 7fce94d44b80 4 client.10158 mds_command: new command op to 9999 tid=0[{"prefix": "status"}] 2023-11-30T18:41:27.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.114+0000 7fce94d44b80 1 -- 172.21.15.49:0/3419294664 --> [v2:172.21.15.49:6833/1129424322,v1:172.21.15.49:6835/1129424322] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56067072cca0 con 0x56067095ebe0 2023-11-30T18:41:27.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.114+0000 7fce81148700 1 --2- 172.21.15.49:0/3419294664 >> [v2:172.21.15.49:6833/1129424322,v1:172.21.15.49:6835/1129424322] conn(0x56067095ebe0 0x56067095efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:27.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.114+0000 7fce5b7fe700 10 client.10158 ms_handle_connect on v2:172.21.15.49:6833/1129424322 2023-11-30T18:41:27.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.114+0000 7fce81148700 1 --2- 172.21.15.49:0/3419294664 >> [v2:172.21.15.49:6833/1129424322,v1:172.21.15.49:6835/1129424322] conn(0x56067095ebe0 0x56067095efc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=197f3fbbfc65fc26 server_cookie=8946e72cf6cd325d in_seq=0 out_seq=0 2023-11-30T18:41:27.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.114+0000 7fce5b7fe700 1 -- 172.21.15.49:0/3419294664 <== mds.0 v2:172.21.15.49:6833/1129424322 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x56067072cca0 con 0x56067095ebe0 2023-11-30T18:41:27.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.114+0000 7fce5b7fe700 10 client.10158 handle_command_reply: tid=0 2023-11-30T18:41:27.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.114+0000 7fce94d44b80 1 client.10158 shutdown 2023-11-30T18:41:27.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.114+0000 7fce94d44b80 1 -- 172.21.15.49:0/3419294664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606709864e0 msgr2=0x56067096b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:27.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.114+0000 7fce94d44b80 1 --2- 172.21.15.49:0/3419294664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606709864e0 0x56067096b290 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 rx=0x7fce6c023040 tx=0x7fce6c020000).stop 2023-11-30T18:41:27.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.115+0000 7fce94d44b80 1 -- 172.21.15.49:0/3419294664 shutdown_connections 2023-11-30T18:41:27.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.115+0000 7fce94d44b80 1 --2- 172.21.15.49:0/3419294664 >> [v2:172.21.15.49:6833/1129424322,v1:172.21.15.49:6835/1129424322] conn(0x56067095ebe0 0x56067095efc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.115+0000 7fce94d44b80 1 --2- 172.21.15.49:0/3419294664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606709864e0 0x56067096b290 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.115+0000 7fce94d44b80 1 --2- 172.21.15.49:0/3419294664 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5606706f9e40 0x5606709e7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.115+0000 7fce5b7fe700 0 client.10158 ms_handle_reset on v2:172.21.15.49:6833/1129424322 2023-11-30T18:41:27.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.115+0000 7fce94d44b80 1 --2- 172.21.15.49:0/3419294664 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x560670965cf0 0x560670986a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.115+0000 7fce94d44b80 1 -- 172.21.15.49:0/3419294664 >> 172.21.15.49:0/3419294664 conn(0x5606707a74a0 msgr2=0x560670934e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:27.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.115+0000 7fce94d44b80 1 -- 172.21.15.49:0/3419294664 shutdown_connections 2023-11-30T18:41:27.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.115+0000 7fce94d44b80 1 -- 172.21.15.49:0/3419294664 wait complete. 2023-11-30T18:41:27.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.115+0000 7fce94d44b80 20 client.10158 trim_cache size 0 max 16384 2023-11-30T18:41:27.140 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T18:41:27.140 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "ef213ed4-8f62-4ad5-b55f-7510fd0ee359", 2023-11-30T18:41:27.140 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2023-11-30T18:41:27.140 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 9999, 2023-11-30T18:41:27.140 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-11-30T18:41:27.140 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-11-30T18:41:27.140 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-11-30T18:41:27.140 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 5.7618252810000001, 2023-11-30T18:41:27.140 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 93, 2023-11-30T18:41:27.141 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 219, 2023-11-30T18:41:27.141 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 219, 2023-11-30T18:41:27.141 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 10.946412026000001 2023-11-30T18:41:27.141 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T18:41:27.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.115+0000 7fce8214a700 1 -- 172.21.15.49:0/458329948 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fce6805f270 msgr2=0x7fce68061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:27.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.115+0000 7fce8214a700 1 --2- 172.21.15.49:0/458329948 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fce6805f270 0x7fce68061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fce74006fd0 tx=0x7fce74008040).stop 2023-11-30T18:41:27.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.115+0000 7fce8214a700 1 -- 172.21.15.49:0/458329948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce7c154950 msgr2=0x7fce7c0af900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:27.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.115+0000 7fce8214a700 1 --2- 172.21.15.49:0/458329948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce7c154950 0x7fce7c0af900 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 rx=0x7fce70009fd0 tx=0x7fce70017000).stop 2023-11-30T18:41:27.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.115+0000 7fce8214a700 1 -- 172.21.15.49:0/458329948 shutdown_connections 2023-11-30T18:41:27.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.115+0000 7fce8214a700 1 --2- 172.21.15.49:0/458329948 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fce6805f270 0x7fce68061730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.115+0000 7fce8214a700 1 --2- 172.21.15.49:0/458329948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce7c158570 0x7fce7c0afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.115+0000 7fce8214a700 1 --2- 172.21.15.49:0/458329948 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fce7c14e530 0x7fce7c163e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.115+0000 7fce8214a700 1 --2- 172.21.15.49:0/458329948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce7c154950 0x7fce7c0af900 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.115+0000 7fce8214a700 1 -- 172.21.15.49:0/458329948 >> 172.21.15.49:0/458329948 conn(0x7fce7c064990 msgr2=0x7fce7c156f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:27.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.115+0000 7fce8214a700 1 -- 172.21.15.49:0/458329948 shutdown_connections 2023-11-30T18:41:27.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.115+0000 7fce8214a700 1 -- 172.21.15.49:0/458329948 wait complete. 2023-11-30T18:41:27.144 DEBUG:teuthology.orchestra.run.smithi049:> ceph fs ls 2023-11-30T18:41:27.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.248+0000 7f290cf60700 1 Processor -- start 2023-11-30T18:41:27.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.248+0000 7f290cf60700 1 -- start start 2023-11-30T18:41:27.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.249+0000 7f290cf60700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f29080c3fe0 0x7f2908154590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:27.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.249+0000 7f290cf60700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29080c25d0 con 0x7f29080632e0 2023-11-30T18:41:27.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.249+0000 7f290cf60700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29080c2890 con 0x7f29081541b0 2023-11-30T18:41:27.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.249+0000 7f290cf60700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f290806a8d0 con 0x7f29080c3fe0 2023-11-30T18:41:27.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.249+0000 7f2905d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f29080c3fe0 0x7f2908154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:27.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.249+0000 7f2906d9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f29080632e0 0x7f29080bce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57394/0 (socket says 172.21.15.49:57394) 2023-11-30T18:41:27.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.249+0000 7f2905d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f29080c3fe0 0x7f2908154590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43862/0 (socket says 172.21.15.49:43862) 2023-11-30T18:41:27.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.249+0000 7f2906d9d700 1 -- 172.21.15.49:0/1456076942 learned_addr learned my addr 172.21.15.49:0/1456076942 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:27.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.250+0000 7f2905d9b700 1 -- 172.21.15.49:0/1456076942 >> v1:172.21.15.115:6789/0 conn(0x7f29081541b0 legacy=0x7f2908069850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:27.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.250+0000 7f2905d9b700 1 -- 172.21.15.49:0/1456076942 >> v1:172.21.15.49:6789/0 conn(0x7f29080632e0 legacy=0x7f29080bce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:27.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.250+0000 7f2905d9b700 1 -- 172.21.15.49:0/1456076942 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f290806a030 con 0x7f29080c3fe0 2023-11-30T18:41:27.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.250+0000 7f290559a700 1 -- 172.21.15.49:0/1456076942 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520169339 0 0) 0x7f29080c25d0 con 0x7f29080632e0 2023-11-30T18:41:27.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.250+0000 7f2905d9b700 1 --2- 172.21.15.49:0/1456076942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29080c3fe0 0x7f2908154590 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 rx=0x7f28f0009760 tx=0x7f28f0009060).ready entity=mon.0 client_cookie=8898bedca5d458e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:27.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.250+0000 7f290559a700 1 -- 172.21.15.49:0/1456076942 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f000b580 con 0x7f29080c3fe0 2023-11-30T18:41:27.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.250+0000 7f290559a700 1 -- 172.21.15.49:0/1456076942 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f000b6e0 con 0x7f29080c3fe0 2023-11-30T18:41:27.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.250+0000 7f290559a700 1 -- 172.21.15.49:0/1456076942 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f000ba60 con 0x7f29080c3fe0 2023-11-30T18:41:27.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.250+0000 7f290cf60700 1 -- 172.21.15.49:0/1456076942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29080c3fe0 msgr2=0x7f2908154590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:27.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.250+0000 7f290cf60700 1 --2- 172.21.15.49:0/1456076942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29080c3fe0 0x7f2908154590 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 rx=0x7f28f0009760 tx=0x7f28f0009060).stop 2023-11-30T18:41:27.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.250+0000 7f290cf60700 1 -- 172.21.15.49:0/1456076942 shutdown_connections 2023-11-30T18:41:27.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.250+0000 7f290cf60700 1 --2- 172.21.15.49:0/1456076942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29080c3fe0 0x7f2908154590 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.250+0000 7f290cf60700 1 -- 172.21.15.49:0/1456076942 >> 172.21.15.49:0/1456076942 conn(0x7f2908064360 msgr2=0x7f2908065900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:27.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.251+0000 7f290cf60700 1 -- 172.21.15.49:0/1456076942 shutdown_connections 2023-11-30T18:41:27.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.251+0000 7f290cf60700 1 -- 172.21.15.49:0/1456076942 wait complete. 2023-11-30T18:41:27.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.252+0000 7f290cf60700 1 Processor -- start 2023-11-30T18:41:27.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.252+0000 7f290cf60700 1 -- start start 2023-11-30T18:41:27.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.252+0000 7f290cf60700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29080632e0 0x7f29081488d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:27.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.252+0000 7f290cf60700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29080c3fe0 0x7f2908167d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:27.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.252+0000 7f290cf60700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29081541b0 0x7f2908168270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:27.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.252+0000 7f290cf60700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290813c390 con 0x7f29081541b0 2023-11-30T18:41:27.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.252+0000 7f290cf60700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2908168760 con 0x7f29080632e0 2023-11-30T18:41:27.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.252+0000 7f290cf60700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29080c6c40 con 0x7f29080c3fe0 2023-11-30T18:41:27.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.252+0000 7f2906d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29081541b0 0x7f2908168270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:27.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.252+0000 7f2906d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29081541b0 0x7f2908168270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43878/0 (socket says 172.21.15.49:43878) 2023-11-30T18:41:27.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.253+0000 7f2906d9d700 1 -- 172.21.15.49:0/2410855561 learned_addr learned my addr 172.21.15.49:0/2410855561 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:27.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.253+0000 7f290659c700 1 --2- 172.21.15.49:0/2410855561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29080632e0 0x7f29081488d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:27.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.253+0000 7f2905d9b700 1 --2- 172.21.15.49:0/2410855561 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29080c3fe0 0x7f2908167d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:27.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.253+0000 7f2906d9d700 1 -- 172.21.15.49:0/2410855561 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29080c3fe0 msgr2=0x7f2908167d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:27.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.253+0000 7f2906d9d700 1 --2- 172.21.15.49:0/2410855561 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29080c3fe0 0x7f2908167d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.253+0000 7f2906d9d700 1 -- 172.21.15.49:0/2410855561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29080632e0 msgr2=0x7f29081488d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:27.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.253+0000 7f2906d9d700 1 --2- 172.21.15.49:0/2410855561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29080632e0 0x7f29081488d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.253+0000 7f2906d9d700 1 -- 172.21.15.49:0/2410855561 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f00092a0 con 0x7f29081541b0 2023-11-30T18:41:27.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.253+0000 7f290659c700 1 --2- 172.21.15.49:0/2410855561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29080632e0 0x7f29081488d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:41:27.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.253+0000 7f2905d9b700 1 --2- 172.21.15.49:0/2410855561 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29080c3fe0 0x7f2908167d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:41:27.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.253+0000 7f2906d9d700 1 --2- 172.21.15.49:0/2410855561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29081541b0 0x7f2908168270 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 rx=0x7f28f800c4f0 tx=0x7f28f8007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:27.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.253+0000 7f28fe7fc700 1 -- 172.21.15.49:0/2410855561 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f80072e0 con 0x7f29081541b0 2023-11-30T18:41:27.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.253+0000 7f28fe7fc700 1 -- 172.21.15.49:0/2410855561 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f8007440 con 0x7f29081541b0 2023-11-30T18:41:27.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.253+0000 7f28fe7fc700 1 -- 172.21.15.49:0/2410855561 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f80057a0 con 0x7f29081541b0 2023-11-30T18:41:27.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.253+0000 7f290cf60700 1 -- 172.21.15.49:0/2410855561 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29080c6f20 con 0x7f29081541b0 2023-11-30T18:41:27.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.253+0000 7f290cf60700 1 -- 172.21.15.49:0/2410855561 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29080c74e0 con 0x7f29081541b0 2023-11-30T18:41:27.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.254+0000 7f290cf60700 1 -- 172.21.15.49:0/2410855561 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2908149ef0 con 0x7f29081541b0 2023-11-30T18:41:27.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.255+0000 7f28fe7fc700 1 -- 172.21.15.49:0/2410855561 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f28f8005b90 con 0x7f29081541b0 2023-11-30T18:41:27.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.255+0000 7f28fe7fc700 1 --2- 172.21.15.49:0/2410855561 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f28e805f270 0x7f28e8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:27.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.255+0000 7f28fe7fc700 1 -- 172.21.15.49:0/2410855561 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(219..219 src has 1..219) v4 ==== 6233+0+0 (secure 0 0 0) 0x7f28f8079c70 con 0x7f29081541b0 2023-11-30T18:41:27.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.255+0000 7f290659c700 1 --2- 172.21.15.49:0/2410855561 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f28e805f270 0x7f28e8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:27.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.256+0000 7f290659c700 1 --2- 172.21.15.49:0/2410855561 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f28e805f270 0x7f28e8061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f2900007fd0 tx=0x7f2900009040).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:27.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.259+0000 7f28fe7fc700 1 -- 172.21.15.49:0/2410855561 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2908149ef0 con 0x7f29081541b0 2023-11-30T18:41:27.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.478+0000 7f290cf60700 1 -- 172.21.15.49:0/2410855561 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2908149ef0 con 0x7f29081541b0 2023-11-30T18:41:27.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.478+0000 7f28fe7fc700 1 -- 172.21.15.49:0/2410855561 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v93) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2908149ef0 con 0x7f29081541b0 2023-11-30T18:41:27.479 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-30T18:41:27.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.480+0000 7f290cf60700 1 -- 172.21.15.49:0/2410855561 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f28e805f270 msgr2=0x7f28e8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:27.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.480+0000 7f290cf60700 1 --2- 172.21.15.49:0/2410855561 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f28e805f270 0x7f28e8061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f2900007fd0 tx=0x7f2900009040).stop 2023-11-30T18:41:27.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.480+0000 7f290cf60700 1 -- 172.21.15.49:0/2410855561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29081541b0 msgr2=0x7f2908168270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:27.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.480+0000 7f290cf60700 1 --2- 172.21.15.49:0/2410855561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29081541b0 0x7f2908168270 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 rx=0x7f28f800c4f0 tx=0x7f28f8007c10).stop 2023-11-30T18:41:27.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.480+0000 7f290cf60700 1 -- 172.21.15.49:0/2410855561 shutdown_connections 2023-11-30T18:41:27.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.480+0000 7f290cf60700 1 --2- 172.21.15.49:0/2410855561 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f28e805f270 0x7f28e8061730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.480+0000 7f290cf60700 1 --2- 172.21.15.49:0/2410855561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29081541b0 0x7f2908168270 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.480+0000 7f290cf60700 1 --2- 172.21.15.49:0/2410855561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29080632e0 0x7f29081488d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.480+0000 7f290cf60700 1 --2- 172.21.15.49:0/2410855561 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29080c3fe0 0x7f2908167d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:27.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.480+0000 7f290cf60700 1 -- 172.21.15.49:0/2410855561 >> 172.21.15.49:0/2410855561 conn(0x7f2908064360 msgr2=0x7f2908149330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:27.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.481+0000 7f290cf60700 1 -- 172.21.15.49:0/2410855561 shutdown_connections 2023-11-30T18:41:27.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:27.481+0000 7f290cf60700 1 -- 172.21.15.49:0/2410855561 wait complete. 2023-11-30T18:41:27.492 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-30T18:41:27.492 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-30T18:41:27.492 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-11-30T18:41:27.492 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-30T18:41:27.492 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-30T18:41:27.492 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-30T18:41:27.492 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-30T18:41:27.492 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-30T18:41:27.493 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-30T18:41:27.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:41:27.493 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-11-30T18:41:27.509 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-30T18:41:27.509 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-30T18:41:27.509 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-11-30T18:41:27.509 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T18:41:27.509 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-11-30T18:41:27.509 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T18:41:27.509 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T18:41:27.509 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-11-30T18:41:27.509 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-11-30T18:41:27.509 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T18:41:27.510 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-11-30T18:41:27.510 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-11-30T18:41:27.510 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-30T18:41:27.510 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-11-30T18:41:27.510 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-11-30T18:41:27.510 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-30T18:41:27.510 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 36788sec preferred_lft 36788sec 2023-11-30T18:41:27.510 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2023-11-30T18:41:27.510 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T18:41:27.510 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-30T18:41:27.510 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-11-30T18:41:27.510 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-11-30T18:41:27.510 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-30T18:41:27.510 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 32:bf:40:53:4c:5d brd ff:ff:ff:ff:ff:ff 2023-11-30T18:41:27.511 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-30T18:41:27.511 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T18:41:27.511 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::8b6:11ff:fe93:7174/64 scope link 2023-11-30T18:41:27.511 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T18:41:27.511 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-30T18:41:27.511 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 3e:e9:3c:a8:7a:95 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-30T18:41:27.511 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::3ce9:3cff:fea8:7a95/64 scope link 2023-11-30T18:41:27.511 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T18:41:27.511 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-30T18:41:27.511 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 32:bf:40:53:4c:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-30T18:41:27.511 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::30bf:40ff:fe53:4c5d/64 scope link 2023-11-30T18:41:27.511 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-30T18:41:27.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:41:27.512 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-30T18:41:27.573 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-11-30T18:41:27.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:41:27.575 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-11-30T18:41:27.631 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-11-30T18:41:27.631 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-30T18:41:27.631 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-30T18:41:27.631 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-30T18:41:27.631 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-30T18:41:27.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:41:27.631 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-11-30T18:41:27.632 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-11-30T18:41:27.632 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-30T18:41:27.632 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-30T18:41:27.632 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-30T18:41:27.632 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-11-30T18:41:27.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:41:27.734 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-11-30T18:41:27.749 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-30T18:41:27.749 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-30T18:41:27.750 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-30T18:41:27.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:41:27.750 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-11-30T18:41:27.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:41:27.814 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-11-30T18:41:27.869 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-30T18:41:27.869 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T18:41:27.949 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T18:41:27.949 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-30T18:41:27.974 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-30T18:41:27.974 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-30T18:41:27.976 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-30T18:41:27.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:41:27.977 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-30T18:41:28.042 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-30T18:41:28.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.199+0000 7f04cf7fa700 1 Processor -- start 2023-11-30T18:41:28.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.199+0000 7f04cf7fa700 1 -- start start 2023-11-30T18:41:28.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.200+0000 7f04cf7fa700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f04c8155830 0x7f04c8155c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:28.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.200+0000 7f04cf7fa700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f04c8155030 0x7f04c80c2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:28.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.200+0000 7f04cf7fa700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c80c32e0 con 0x7f04c80c2e70 2023-11-30T18:41:28.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.200+0000 7f04cf7fa700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c81554b0 con 0x7f04c8155030 2023-11-30T18:41:28.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.200+0000 7f04cf7fa700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c81529c0 con 0x7f04c8155830 2023-11-30T18:41:28.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.200+0000 7f04ccd95700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f04c8155030 0x7f04c80c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:28.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.200+0000 7f04ccd95700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f04c8155030 0x7f04c80c2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43880/0 (socket says 172.21.15.49:43880) 2023-11-30T18:41:28.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.200+0000 7f04ccd95700 1 -- 172.21.15.49:0/3619788239 learned_addr learned my addr 172.21.15.49:0/3619788239 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:28.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.200+0000 7f04cdd97700 1 --1- 172.21.15.49:0/3619788239 >> v1:172.21.15.49:6789/0 conn(0x7f04c80c2e70 0x7f04c80c5ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57402/0 (socket says 172.21.15.49:57402) 2023-11-30T18:41:28.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.201+0000 7f04cd596700 1 --2- 172.21.15.49:0/3619788239 >> v2:172.21.15.115:3300/0 conn(0x7f04c8155830 0x7f04c8155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:28.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.201+0000 7f04ccd95700 1 -- 172.21.15.49:0/3619788239 >> v2:172.21.15.115:3300/0 conn(0x7f04c8155830 msgr2=0x7f04c8155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:28.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.201+0000 7f04ccd95700 1 --2- 172.21.15.49:0/3619788239 >> v2:172.21.15.115:3300/0 conn(0x7f04c8155830 0x7f04c8155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:28.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.201+0000 7f04ccd95700 1 -- 172.21.15.49:0/3619788239 >> v1:172.21.15.49:6789/0 conn(0x7f04c80c2e70 legacy=0x7f04c80c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:28.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.201+0000 7f04ccd95700 1 -- 172.21.15.49:0/3619788239 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c8151db0 con 0x7f04c8155030 2023-11-30T18:41:28.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.201+0000 7f04c7fff700 1 -- 172.21.15.49:0/3619788239 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925821080 0 0) 0x7f04c80c32e0 con 0x7f04c80c2e70 2023-11-30T18:41:28.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.201+0000 7f04cd596700 1 --2- 172.21.15.49:0/3619788239 >> v2:172.21.15.115:3300/0 conn(0x7f04c8155830 0x7f04c8155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:41:28.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.201+0000 7f04ccd95700 1 --2- 172.21.15.49:0/3619788239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04c8155030 0x7f04c80c2980 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 rx=0x7f04c80bc3a0 tx=0x7f04bc0090f0).ready entity=mon.0 client_cookie=64caa8ff57110657 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:28.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.201+0000 7f04c7fff700 1 -- 172.21.15.49:0/3619788239 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc00b600 con 0x7f04c8155030 2023-11-30T18:41:28.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.201+0000 7f04c7fff700 1 -- 172.21.15.49:0/3619788239 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04bc00b760 con 0x7f04c8155030 2023-11-30T18:41:28.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.201+0000 7f04c7fff700 1 -- 172.21.15.49:0/3619788239 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc00bb00 con 0x7f04c8155030 2023-11-30T18:41:28.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.201+0000 7f04cf7fa700 1 -- 172.21.15.49:0/3619788239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04c8155030 msgr2=0x7f04c80c2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:28.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.201+0000 7f04cf7fa700 1 --2- 172.21.15.49:0/3619788239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04c8155030 0x7f04c80c2980 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 rx=0x7f04c80bc3a0 tx=0x7f04bc0090f0).stop 2023-11-30T18:41:28.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.201+0000 7f04cf7fa700 1 -- 172.21.15.49:0/3619788239 shutdown_connections 2023-11-30T18:41:28.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.201+0000 7f04cf7fa700 1 --2- 172.21.15.49:0/3619788239 >> v2:172.21.15.115:3300/0 conn(0x7f04c8155830 0x7f04c8155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:28.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.201+0000 7f04cf7fa700 1 --2- 172.21.15.49:0/3619788239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04c8155030 0x7f04c80c2980 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:28.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.201+0000 7f04cf7fa700 1 -- 172.21.15.49:0/3619788239 >> 172.21.15.49:0/3619788239 conn(0x7f04c8062700 msgr2=0x7f04c8062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:28.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.202+0000 7f04cf7fa700 1 -- 172.21.15.49:0/3619788239 shutdown_connections 2023-11-30T18:41:28.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.202+0000 7f04cf7fa700 1 -- 172.21.15.49:0/3619788239 wait complete. 2023-11-30T18:41:28.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.203+0000 7f04cf7fa700 1 Processor -- start 2023-11-30T18:41:28.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.203+0000 7f04cf7fa700 1 -- start start 2023-11-30T18:41:28.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.204+0000 7f04cf7fa700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04c80c2e70 0x7f04c8148f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:28.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.204+0000 7f04cf7fa700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04c8155030 0x7f04c8165df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:28.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.204+0000 7f04cf7fa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04c8155830 0x7f04c81662e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:28.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.204+0000 7f04cf7fa700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c80a66f0 con 0x7f04c8155830 2023-11-30T18:41:28.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.204+0000 7f04cf7fa700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c80a6cb0 con 0x7f04c8155030 2023-11-30T18:41:28.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.204+0000 7f04cf7fa700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c8166870 con 0x7f04c80c2e70 2023-11-30T18:41:28.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.204+0000 7f04cdd97700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04c8155830 0x7f04c81662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:28.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.204+0000 7f04cdd97700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04c8155830 0x7f04c81662e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43892/0 (socket says 172.21.15.49:43892) 2023-11-30T18:41:28.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.204+0000 7f04cdd97700 1 -- 172.21.15.49:0/3684833041 learned_addr learned my addr 172.21.15.49:0/3684833041 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:28.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.204+0000 7f04ccd95700 1 --2- 172.21.15.49:0/3684833041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04c8155030 0x7f04c8165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:28.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.204+0000 7f04cd596700 1 --2- 172.21.15.49:0/3684833041 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04c80c2e70 0x7f04c8148f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:28.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.204+0000 7f04cdd97700 1 -- 172.21.15.49:0/3684833041 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04c80c2e70 msgr2=0x7f04c8148f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:28.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.204+0000 7f04cdd97700 1 --2- 172.21.15.49:0/3684833041 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04c80c2e70 0x7f04c8148f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:28.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.204+0000 7f04cdd97700 1 -- 172.21.15.49:0/3684833041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04c8155030 msgr2=0x7f04c8165df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:28.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.204+0000 7f04cdd97700 1 --2- 172.21.15.49:0/3684833041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04c8155030 0x7f04c8165df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:28.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.204+0000 7f04cdd97700 1 -- 172.21.15.49:0/3684833041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04bc009370 con 0x7f04c8155830 2023-11-30T18:41:28.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.204+0000 7f04cdd97700 1 --2- 172.21.15.49:0/3684833041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04c8155830 0x7f04c81662e0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 rx=0x7f04b800c440 tx=0x7f04b8007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:28.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.204+0000 7f04c57fa700 1 -- 172.21.15.49:0/3684833041 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b80070d0 con 0x7f04c8155830 2023-11-30T18:41:28.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.204+0000 7f04c57fa700 1 -- 172.21.15.49:0/3684833041 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b8007250 con 0x7f04c8155830 2023-11-30T18:41:28.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.204+0000 7f04cf7fa700 1 -- 172.21.15.49:0/3684833041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c8166b50 con 0x7f04c8155830 2023-11-30T18:41:28.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.204+0000 7f04c57fa700 1 -- 172.21.15.49:0/3684833041 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b80056e0 con 0x7f04c8155830 2023-11-30T18:41:28.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.204+0000 7f04cf7fa700 1 -- 172.21.15.49:0/3684833041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c8149420 con 0x7f04c8155830 2023-11-30T18:41:28.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.205+0000 7f04cf7fa700 1 -- 172.21.15.49:0/3684833041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c81518c0 con 0x7f04c8155830 2023-11-30T18:41:28.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.206+0000 7f04c57fa700 1 -- 172.21.15.49:0/3684833041 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f04b8005a90 con 0x7f04c8155830 2023-11-30T18:41:28.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.206+0000 7f04c57fa700 1 --2- 172.21.15.49:0/3684833041 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f04b405f270 0x7f04b4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:28.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.206+0000 7f04c57fa700 1 -- 172.21.15.49:0/3684833041 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(219..219 src has 1..219) v4 ==== 6233+0+0 (secure 0 0 0) 0x7f04b8079ab0 con 0x7f04c8155830 2023-11-30T18:41:28.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.206+0000 7f04cd596700 1 --2- 172.21.15.49:0/3684833041 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f04b405f270 0x7f04b4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:28.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.207+0000 7f04cd596700 1 --2- 172.21.15.49:0/3684833041 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f04b405f270 0x7f04b4061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f04c000f600 tx=0x7f04c00077b0).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:28.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.210+0000 7f04c57fa700 1 -- 172.21.15.49:0/3684833041 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f04c81518c0 con 0x7f04c8155830 2023-11-30T18:41:28.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.411+0000 7f04cf7fa700 1 -- 172.21.15.49:0/3684833041 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f04c8166d40 con 0x7f04b405f270 2023-11-30T18:41:28.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.414+0000 7f04c57fa700 1 -- 172.21.15.49:0/3684833041 <== mgr.8096 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f04c0018490 con 0x7f04b405f270 2023-11-30T18:41:28.415 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-11-30T18:41:28.415 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-30T18:41:28.415 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cephfs" 2023-11-30T18:41:28.415 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-30T18:41:28.415 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-11-30T18:41:28.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.415+0000 7f04cf7fa700 1 -- 172.21.15.49:0/3684833041 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f04b405f270 msgr2=0x7f04b4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:28.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.415+0000 7f04cf7fa700 1 --2- 172.21.15.49:0/3684833041 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f04b405f270 0x7f04b4061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f04c000f600 tx=0x7f04c00077b0).stop 2023-11-30T18:41:28.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.415+0000 7f04cf7fa700 1 -- 172.21.15.49:0/3684833041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04c8155830 msgr2=0x7f04c81662e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:28.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.415+0000 7f04cf7fa700 1 --2- 172.21.15.49:0/3684833041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04c8155830 0x7f04c81662e0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 rx=0x7f04b800c440 tx=0x7f04b8007b90).stop 2023-11-30T18:41:28.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.415+0000 7f04cf7fa700 1 -- 172.21.15.49:0/3684833041 shutdown_connections 2023-11-30T18:41:28.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.415+0000 7f04cf7fa700 1 --2- 172.21.15.49:0/3684833041 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f04b405f270 0x7f04b4061730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:28.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.415+0000 7f04cf7fa700 1 --2- 172.21.15.49:0/3684833041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04c8155830 0x7f04c81662e0 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:28.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.415+0000 7f04cf7fa700 1 --2- 172.21.15.49:0/3684833041 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04c80c2e70 0x7f04c8148f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:28.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.415+0000 7f04cf7fa700 1 --2- 172.21.15.49:0/3684833041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04c8155030 0x7f04c8165df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:28.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.415+0000 7f04cf7fa700 1 -- 172.21.15.49:0/3684833041 >> 172.21.15.49:0/3684833041 conn(0x7f04c8062700 msgr2=0x7f04c814eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:28.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.415+0000 7f04cf7fa700 1 -- 172.21.15.49:0/3684833041 shutdown_connections 2023-11-30T18:41:28.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.415+0000 7f04cf7fa700 1 -- 172.21.15.49:0/3684833041 wait complete. 2023-11-30T18:41:28.429 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-11-30T18:41:28.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.546+0000 7f1d33d51700 1 Processor -- start 2023-11-30T18:41:28.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.546+0000 7f1d33d51700 1 -- start start 2023-11-30T18:41:28.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.547+0000 7f1d33d51700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1d2c0c6190 0x7f1d2c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:28.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.547+0000 7f1d33d51700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1d2c158320 0x7f1d2c1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:28.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.547+0000 7f1d33d51700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d2c158cc0 con 0x7f1d2c098d10 2023-11-30T18:41:28.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.547+0000 7f1d33d51700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d2c0c72d0 con 0x7f1d2c158320 2023-11-30T18:41:28.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.547+0000 7f1d33d51700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d2c064570 con 0x7f1d2c0c6190 2023-11-30T18:41:28.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.547+0000 7f1d322ee700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1d2c158320 0x7f1d2c1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:28.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.547+0000 7f1d31aed700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1d2c098d10 0x7f1d2c063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57414/0 (socket says 172.21.15.49:57414) 2023-11-30T18:41:28.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.547+0000 7f1d31aed700 1 -- 172.21.15.49:0/63980156 learned_addr learned my addr 172.21.15.49:0/63980156 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:28.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.547+0000 7f1d312ec700 1 --2- 172.21.15.49:0/63980156 >> v2:172.21.15.115:3300/0 conn(0x7f1d2c0c6190 0x7f1d2c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:28.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.547+0000 7f1d322ee700 1 -- 172.21.15.49:0/63980156 >> v2:172.21.15.115:3300/0 conn(0x7f1d2c0c6190 msgr2=0x7f1d2c0c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:28.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.547+0000 7f1d322ee700 1 --2- 172.21.15.49:0/63980156 >> v2:172.21.15.115:3300/0 conn(0x7f1d2c0c6190 0x7f1d2c0c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:28.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.548+0000 7f1d322ee700 1 -- 172.21.15.49:0/63980156 >> v1:172.21.15.49:6789/0 conn(0x7f1d2c098d10 legacy=0x7f1d2c063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:28.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.548+0000 7f1d322ee700 1 -- 172.21.15.49:0/63980156 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2c154bc0 con 0x7f1d2c158320 2023-11-30T18:41:28.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.548+0000 7f1d30aeb700 1 -- 172.21.15.49:0/63980156 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392709774 0 0) 0x7f1d24001110 con 0x7f1d2c098d10 2023-11-30T18:41:28.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.548+0000 7f1d322ee700 1 --2- 172.21.15.49:0/63980156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d2c158320 0x7f1d2c1587d0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 rx=0x7f1d2c0c5b40 tx=0x7f1d1c009780).ready entity=mon.0 client_cookie=17512e8648469ff3 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:28.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.548+0000 7f1d30aeb700 1 -- 172.21.15.49:0/63980156 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c00e070 con 0x7f1d2c158320 2023-11-30T18:41:28.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.548+0000 7f1d30aeb700 1 -- 172.21.15.49:0/63980156 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1c00bc30 con 0x7f1d2c158320 2023-11-30T18:41:28.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.548+0000 7f1d30aeb700 1 -- 172.21.15.49:0/63980156 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c012410 con 0x7f1d2c158320 2023-11-30T18:41:28.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.548+0000 7f1d33d51700 1 -- 172.21.15.49:0/63980156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d2c158320 msgr2=0x7f1d2c1587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:28.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.548+0000 7f1d33d51700 1 --2- 172.21.15.49:0/63980156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d2c158320 0x7f1d2c1587d0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 rx=0x7f1d2c0c5b40 tx=0x7f1d1c009780).stop 2023-11-30T18:41:28.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.548+0000 7f1d33d51700 1 -- 172.21.15.49:0/63980156 shutdown_connections 2023-11-30T18:41:28.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.548+0000 7f1d33d51700 1 --2- 172.21.15.49:0/63980156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d2c158320 0x7f1d2c1587d0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:28.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.548+0000 7f1d33d51700 1 --2- 172.21.15.49:0/63980156 >> v2:172.21.15.115:3300/0 conn(0x7f1d2c0c6190 0x7f1d2c0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:28.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.548+0000 7f1d33d51700 1 -- 172.21.15.49:0/63980156 >> 172.21.15.49:0/63980156 conn(0x7f1d2c0cb310 msgr2=0x7f1d2c0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:28.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.548+0000 7f1d33d51700 1 -- 172.21.15.49:0/63980156 shutdown_connections 2023-11-30T18:41:28.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.548+0000 7f1d33d51700 1 -- 172.21.15.49:0/63980156 wait complete. 2023-11-30T18:41:28.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.549+0000 7f1d33d51700 1 Processor -- start 2023-11-30T18:41:28.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.550+0000 7f1d33d51700 1 -- start start 2023-11-30T18:41:28.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.550+0000 7f1d33d51700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d2c098d10 0x7f1d2c0b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:28.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.550+0000 7f1d33d51700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d2c0c6190 0x7f1d2c0c4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:28.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.550+0000 7f1d33d51700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d2c158320 0x7f1d2c0c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:28.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.550+0000 7f1d33d51700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c0afaf0 con 0x7f1d2c098d10 2023-11-30T18:41:28.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.550+0000 7f1d33d51700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c0b1290 con 0x7f1d2c0c6190 2023-11-30T18:41:28.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.550+0000 7f1d33d51700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c0ae570 con 0x7f1d2c158320 2023-11-30T18:41:28.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.550+0000 7f1d31aed700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d2c098d10 0x7f1d2c0b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:28.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.550+0000 7f1d31aed700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d2c098d10 0x7f1d2c0b0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43908/0 (socket says 172.21.15.49:43908) 2023-11-30T18:41:28.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.550+0000 7f1d31aed700 1 -- 172.21.15.49:0/3789699189 learned_addr learned my addr 172.21.15.49:0/3789699189 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:28.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.551+0000 7f1d31aed700 1 -- 172.21.15.49:0/3789699189 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d2c158320 msgr2=0x7f1d2c0c4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:28.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.551+0000 7f1d31aed700 1 --2- 172.21.15.49:0/3789699189 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d2c158320 0x7f1d2c0c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:28.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.551+0000 7f1d312ec700 1 --2- 172.21.15.49:0/3789699189 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d2c0c6190 0x7f1d2c0c4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:28.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.551+0000 7f1d31aed700 1 -- 172.21.15.49:0/3789699189 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d2c0c6190 msgr2=0x7f1d2c0c4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:28.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.551+0000 7f1d31aed700 1 --2- 172.21.15.49:0/3789699189 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d2c0c6190 0x7f1d2c0c4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:28.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.551+0000 7f1d31aed700 1 -- 172.21.15.49:0/3789699189 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1c009a20 con 0x7f1d2c098d10 2023-11-30T18:41:28.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.551+0000 7f1d31aed700 1 --2- 172.21.15.49:0/3789699189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d2c098d10 0x7f1d2c0b0da0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7f1d2400c510 tx=0x7f1d24007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:28.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.551+0000 7f1d29ffb700 1 -- 172.21.15.49:0/3789699189 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d240072e0 con 0x7f1d2c098d10 2023-11-30T18:41:28.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.551+0000 7f1d29ffb700 1 -- 172.21.15.49:0/3789699189 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d24007440 con 0x7f1d2c098d10 2023-11-30T18:41:28.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.551+0000 7f1d29ffb700 1 -- 172.21.15.49:0/3789699189 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d240057a0 con 0x7f1d2c098d10 2023-11-30T18:41:28.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.551+0000 7f1d33d51700 1 -- 172.21.15.49:0/3789699189 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d2c0afd00 con 0x7f1d2c098d10 2023-11-30T18:41:28.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.551+0000 7f1d33d51700 1 -- 172.21.15.49:0/3789699189 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d2c0b0090 con 0x7f1d2c098d10 2023-11-30T18:41:28.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.552+0000 7f1d33d51700 1 -- 172.21.15.49:0/3789699189 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d2c06c860 con 0x7f1d2c098d10 2023-11-30T18:41:28.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.552+0000 7f1d29ffb700 1 -- 172.21.15.49:0/3789699189 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 99) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f1d24005bd0 con 0x7f1d2c098d10 2023-11-30T18:41:28.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.553+0000 7f1d29ffb700 1 --2- 172.21.15.49:0/3789699189 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f1d1805f270 0x7f1d18061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:28.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.553+0000 7f1d29ffb700 1 -- 172.21.15.49:0/3789699189 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(219..219 src has 1..219) v4 ==== 6233+0+0 (secure 0 0 0) 0x7f1d24079ac0 con 0x7f1d2c098d10 2023-11-30T18:41:28.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.553+0000 7f1d312ec700 1 --2- 172.21.15.49:0/3789699189 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f1d1805f270 0x7f1d18061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:28.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.553+0000 7f1d312ec700 1 --2- 172.21.15.49:0/3789699189 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f1d1805f270 0x7f1d18061730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f1d20006fd0 tx=0x7f1d20008040).ready entity=mgr.8096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:28.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.557+0000 7f1d29ffb700 1 -- 172.21.15.49:0/3789699189 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1d2404aba0 con 0x7f1d2c098d10 2023-11-30T18:41:28.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:28.772+0000 7f1d33d51700 1 -- 172.21.15.49:0/3789699189 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f1d2c158cc0 con 0x7f1d2c098d10 2023-11-30T18:41:29.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.389+0000 7f1d29ffb700 1 -- 172.21.15.49:0/3789699189 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 100) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f1d240776a0 con 0x7f1d2c098d10 2023-11-30T18:41:29.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.390+0000 7f1d29ffb700 1 -- 172.21.15.49:0/3789699189 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v100) v1 ==== 92+0+0 (secure 0 0 0) 0x7f1d24072a30 con 0x7f1d2c098d10 2023-11-30T18:41:29.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.392+0000 7f1d33d51700 1 -- 172.21.15.49:0/3789699189 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f1d1805f270 msgr2=0x7f1d18061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:29.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.392+0000 7f1d33d51700 1 --2- 172.21.15.49:0/3789699189 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f1d1805f270 0x7f1d18061730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f1d20006fd0 tx=0x7f1d20008040).stop 2023-11-30T18:41:29.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.392+0000 7f1d33d51700 1 -- 172.21.15.49:0/3789699189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d2c098d10 msgr2=0x7f1d2c0b0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:29.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.392+0000 7f1d33d51700 1 --2- 172.21.15.49:0/3789699189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d2c098d10 0x7f1d2c0b0da0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7f1d2400c510 tx=0x7f1d24007ad0).stop 2023-11-30T18:41:29.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.392+0000 7f1d33d51700 1 -- 172.21.15.49:0/3789699189 shutdown_connections 2023-11-30T18:41:29.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.392+0000 7f1d33d51700 1 --2- 172.21.15.49:0/3789699189 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f1d1805f270 0x7f1d18061730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:29.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.392+0000 7f1d33d51700 1 --2- 172.21.15.49:0/3789699189 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d2c158320 0x7f1d2c0c4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:29.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.392+0000 7f1d33d51700 1 --2- 172.21.15.49:0/3789699189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d2c098d10 0x7f1d2c0b0da0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:29.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.392+0000 7f1d33d51700 1 --2- 172.21.15.49:0/3789699189 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d2c0c6190 0x7f1d2c0c4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:29.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.392+0000 7f1d33d51700 1 -- 172.21.15.49:0/3789699189 >> 172.21.15.49:0/3789699189 conn(0x7f1d2c0cb310 msgr2=0x7f1d2c0ca270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:29.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.393+0000 7f1d33d51700 1 -- 172.21.15.49:0/3789699189 shutdown_connections 2023-11-30T18:41:29.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.393+0000 7f1d33d51700 1 -- 172.21.15.49:0/3789699189 wait complete. 2023-11-30T18:41:29.408 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-11-30T18:41:29.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.529+0000 7fcc22111700 1 Processor -- start 2023-11-30T18:41:29.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.529+0000 7fcc22111700 1 -- start start 2023-11-30T18:41:29.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.530+0000 7fcc22111700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc1c1547f0 0x7fcc1c0a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:29.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.530+0000 7fcc22111700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc1c0c7e30 con 0x7fcc1c062700 2023-11-30T18:41:29.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.530+0000 7fcc22111700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc1c0bcf40 con 0x7fcc1c0c86f0 2023-11-30T18:41:29.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.530+0000 7fcc22111700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c0c6b20 con 0x7fcc1c1547f0 2023-11-30T18:41:29.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.530+0000 7fcc1bfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcc1c062700 0x7fcc1c0a4db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57420/0 (socket says 172.21.15.49:57420) 2023-11-30T18:41:29.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.530+0000 7fcc1bfff700 1 -- 172.21.15.49:0/44704973 learned_addr learned my addr 172.21.15.49:0/44704973 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:29.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.530+0000 7fcc1b7fe700 1 --2- 172.21.15.49:0/44704973 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc1c1547f0 0x7fcc1c0a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:29.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.531+0000 7fcc1affd700 1 -- 172.21.15.49:0/44704973 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2779261527 0 0) 0x7fcc1c0c7e30 con 0x7fcc1c062700 2023-11-30T18:41:29.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.531+0000 7fcc1affd700 1 -- 172.21.15.49:0/44704973 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc080033f0 con 0x7fcc1c062700 2023-11-30T18:41:29.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.531+0000 7fcc1affd700 1 -- 172.21.15.49:0/44704973 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2447435452 0 0) 0x7fcc1c0bcf40 con 0x7fcc1c0c86f0 2023-11-30T18:41:29.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.531+0000 7fcc1affd700 1 -- 172.21.15.49:0/44704973 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc1c0c7e30 con 0x7fcc1c0c86f0 2023-11-30T18:41:29.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.531+0000 7fcc1b7fe700 1 -- 172.21.15.49:0/44704973 >> v1:172.21.15.115:6789/0 conn(0x7fcc1c0c86f0 legacy=0x7fcc1c0c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:29.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.531+0000 7fcc1b7fe700 1 -- 172.21.15.49:0/44704973 >> v1:172.21.15.49:6789/0 conn(0x7fcc1c062700 legacy=0x7fcc1c0a4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:29.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.531+0000 7fcc1b7fe700 1 -- 172.21.15.49:0/44704973 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1c0a77d0 con 0x7fcc1c1547f0 2023-11-30T18:41:29.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.531+0000 7fcc1b7fe700 1 --2- 172.21.15.49:0/44704973 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc1c1547f0 0x7fcc1c0a72e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fcc0c009790 tx=0x7fcc0c009060).ready entity=mon.2 client_cookie=304e81e4a32a2e66 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:29.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.531+0000 7fcc1affd700 1 -- 172.21.15.49:0/44704973 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c0090d0 con 0x7fcc1c1547f0 2023-11-30T18:41:29.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.531+0000 7fcc1affd700 1 -- 172.21.15.49:0/44704973 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc0c00f510 con 0x7fcc1c1547f0 2023-11-30T18:41:29.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.531+0000 7fcc1affd700 1 -- 172.21.15.49:0/44704973 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c00f890 con 0x7fcc1c1547f0 2023-11-30T18:41:29.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.532+0000 7fcc22111700 1 -- 172.21.15.49:0/44704973 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc1c1547f0 msgr2=0x7fcc1c0a72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:29.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.532+0000 7fcc22111700 1 --2- 172.21.15.49:0/44704973 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc1c1547f0 0x7fcc1c0a72e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fcc0c009790 tx=0x7fcc0c009060).stop 2023-11-30T18:41:29.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.532+0000 7fcc22111700 1 -- 172.21.15.49:0/44704973 shutdown_connections 2023-11-30T18:41:29.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.532+0000 7fcc22111700 1 --2- 172.21.15.49:0/44704973 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc1c1547f0 0x7fcc1c0a72e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:29.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.532+0000 7fcc22111700 1 -- 172.21.15.49:0/44704973 >> 172.21.15.49:0/44704973 conn(0x7fcc1c0642d0 msgr2=0x7fcc1c0c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:29.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.532+0000 7fcc22111700 1 -- 172.21.15.49:0/44704973 shutdown_connections 2023-11-30T18:41:29.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.532+0000 7fcc22111700 1 -- 172.21.15.49:0/44704973 wait complete. 2023-11-30T18:41:29.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.533+0000 7fcc22111700 1 Processor -- start 2023-11-30T18:41:29.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.533+0000 7fcc22111700 1 -- start start 2023-11-30T18:41:29.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.534+0000 7fcc22111700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc1c062700 0x7fcc1c168590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:29.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.534+0000 7fcc22111700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc1c0c86f0 0x7fcc1c0a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:29.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.534+0000 7fcc22111700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc1c1547f0 0x7fcc1c14fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:29.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.534+0000 7fcc22111700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c0a9ca0 con 0x7fcc1c0c86f0 2023-11-30T18:41:29.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.534+0000 7fcc22111700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c0aaf90 con 0x7fcc1c1547f0 2023-11-30T18:41:29.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.534+0000 7fcc22111700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c0ab830 con 0x7fcc1c062700 2023-11-30T18:41:29.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.534+0000 7fcc13fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc1c0c86f0 0x7fcc1c0a5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:29.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.534+0000 7fcc13fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc1c0c86f0 0x7fcc1c0a5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43922/0 (socket says 172.21.15.49:43922) 2023-11-30T18:41:29.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.534+0000 7fcc1b7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc1c062700 0x7fcc1c168590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:29.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.534+0000 7fcc13fff700 1 -- 172.21.15.49:0/1512936755 learned_addr learned my addr 172.21.15.49:0/1512936755 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:29.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.534+0000 7fcc1bfff700 1 --2- 172.21.15.49:0/1512936755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc1c1547f0 0x7fcc1c14fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:29.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.534+0000 7fcc13fff700 1 -- 172.21.15.49:0/1512936755 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc1c062700 msgr2=0x7fcc1c168590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:29.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.534+0000 7fcc13fff700 1 --2- 172.21.15.49:0/1512936755 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc1c062700 0x7fcc1c168590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:29.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.534+0000 7fcc13fff700 1 -- 172.21.15.49:0/1512936755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc1c1547f0 msgr2=0x7fcc1c14fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:29.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.534+0000 7fcc13fff700 1 --2- 172.21.15.49:0/1512936755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc1c1547f0 0x7fcc1c14fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:29.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.534+0000 7fcc13fff700 1 -- 172.21.15.49:0/1512936755 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0c0092a0 con 0x7fcc1c0c86f0 2023-11-30T18:41:29.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.534+0000 7fcc1b7fe700 1 --2- 172.21.15.49:0/1512936755 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc1c062700 0x7fcc1c168590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:41:29.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.534+0000 7fcc1bfff700 1 --2- 172.21.15.49:0/1512936755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc1c1547f0 0x7fcc1c14fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:41:29.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.534+0000 7fcc13fff700 1 --2- 172.21.15.49:0/1512936755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc1c0c86f0 0x7fcc1c0a5f40 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7fcc0400c4c0 tx=0x7fcc04007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:29.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.535+0000 7fcc137fe700 1 -- 172.21.15.49:0/1512936755 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0400ce10 con 0x7fcc1c0c86f0 2023-11-30T18:41:29.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.535+0000 7fcc137fe700 1 -- 172.21.15.49:0/1512936755 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc0400f470 con 0x7fcc1c0c86f0 2023-11-30T18:41:29.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.535+0000 7fcc22111700 1 -- 172.21.15.49:0/1512936755 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc1c0aa630 con 0x7fcc1c0c86f0 2023-11-30T18:41:29.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.535+0000 7fcc137fe700 1 -- 172.21.15.49:0/1512936755 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0400f830 con 0x7fcc1c0c86f0 2023-11-30T18:41:29.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.535+0000 7fcc22111700 1 -- 172.21.15.49:0/1512936755 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1c0ab4c0 con 0x7fcc1c0c86f0 2023-11-30T18:41:29.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.536+0000 7fcc22111700 1 -- 172.21.15.49:0/1512936755 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc1c06c860 con 0x7fcc1c0c86f0 2023-11-30T18:41:29.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.537+0000 7fcc137fe700 1 -- 172.21.15.49:0/1512936755 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 100) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fcc0400fc20 con 0x7fcc1c0c86f0 2023-11-30T18:41:29.540 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:29.537+0000 7f06ee143680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T18:41:29.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.537+0000 7fcc137fe700 1 --2- 172.21.15.49:0/1512936755 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fcbfc05f2c0 0x7fcbfc061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:29.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.537+0000 7fcc137fe700 1 -- 172.21.15.49:0/1512936755 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(219..219 src has 1..219) v4 ==== 6233+0+0 (secure 0 0 0) 0x7fcc04079800 con 0x7fcc1c0c86f0 2023-11-30T18:41:29.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.537+0000 7fcc1b7fe700 1 -- 172.21.15.49:0/1512936755 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fcbfc05f2c0 msgr2=0x7fcbfc061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:29.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.537+0000 7fcc1b7fe700 1 --2- 172.21.15.49:0/1512936755 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fcbfc05f2c0 0x7fcbfc061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:41:29.542 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:29.540+0000 7fa40d336680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T18:41:29.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.541+0000 7fcc137fe700 1 -- 172.21.15.49:0/1512936755 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcc04048b00 con 0x7fcc1c0c86f0 2023-11-30T18:41:29.602 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:29.600+0000 7f06ee143680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T18:41:29.608 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:29.607+0000 7fa40d336680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T18:41:29.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.718+0000 7fcc22111700 1 -- 172.21.15.49:0/1512936755 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fcc1c0ab970 con 0x7fcc1c0c86f0 2023-11-30T18:41:29.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.721+0000 7fcc137fe700 1 -- 172.21.15.49:0/1512936755 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v43)=0 v43) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcc0404a990 con 0x7fcc1c0c86f0 2023-11-30T18:41:29.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.723+0000 7fcc22111700 1 -- 172.21.15.49:0/1512936755 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fcbfc05f2c0 msgr2=0x7fcbfc061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:41:29.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.723+0000 7fcc22111700 1 --2- 172.21.15.49:0/1512936755 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fcbfc05f2c0 0x7fcbfc061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:29.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.723+0000 7fcc22111700 1 -- 172.21.15.49:0/1512936755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc1c0c86f0 msgr2=0x7fcc1c0a5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:29.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.723+0000 7fcc22111700 1 --2- 172.21.15.49:0/1512936755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc1c0c86f0 0x7fcc1c0a5f40 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7fcc0400c4c0 tx=0x7fcc04007c10).stop 2023-11-30T18:41:29.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.723+0000 7fcc22111700 1 -- 172.21.15.49:0/1512936755 shutdown_connections 2023-11-30T18:41:29.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.723+0000 7fcc22111700 1 --2- 172.21.15.49:0/1512936755 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fcbfc05f2c0 0x7fcbfc061780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:29.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.723+0000 7fcc22111700 1 --2- 172.21.15.49:0/1512936755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc1c1547f0 0x7fcc1c14fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:29.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.723+0000 7fcc22111700 1 --2- 172.21.15.49:0/1512936755 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc1c062700 0x7fcc1c168590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:29.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.723+0000 7fcc22111700 1 --2- 172.21.15.49:0/1512936755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc1c0c86f0 0x7fcc1c0a5f40 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:29.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.723+0000 7fcc22111700 1 -- 172.21.15.49:0/1512936755 >> 172.21.15.49:0/1512936755 conn(0x7fcc1c0642d0 msgr2=0x7fcc1c153bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:29.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.723+0000 7fcc22111700 1 -- 172.21.15.49:0/1512936755 shutdown_connections 2023-11-30T18:41:29.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.723+0000 7fcc22111700 1 -- 172.21.15.49:0/1512936755 wait complete. 2023-11-30T18:41:29.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:41:29.738 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-11-30T18:41:29.758 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-11-30T18:41:29.875 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:29.874+0000 7f06ee143680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T18:41:29.902 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:29.900+0000 7fa40d336680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T18:41:29.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.921+0000 7fa7043f2700 1 Processor -- start 2023-11-30T18:41:29.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.921+0000 7fa7043f2700 1 -- start start 2023-11-30T18:41:29.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.922+0000 7fa7043f2700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa6fc1556f0 0x7fa6fc067780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:29.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.922+0000 7fa7043f2700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa6fc13af40 0x7fa6fc0bd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:29.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.922+0000 7fa7043f2700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6fc0bddb0 con 0x7fa6fc13ab60 2023-11-30T18:41:29.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.922+0000 7fa7043f2700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6fc067c70 con 0x7fa6fc1556f0 2023-11-30T18:41:29.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.922+0000 7fa7043f2700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6fc0c3510 con 0x7fa6fc13af40 2023-11-30T18:41:29.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.922+0000 7fa70198d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa6fc1556f0 0x7fa6fc067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:29.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.922+0000 7fa70218e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa6fc13ab60 0x7fa6fc154fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57424/0 (socket says 172.21.15.49:57424) 2023-11-30T18:41:29.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.922+0000 7fa70218e700 1 -- 172.21.15.49:0/1424367478 learned_addr learned my addr 172.21.15.49:0/1424367478 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:29.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.922+0000 7fa70298f700 1 --2- 172.21.15.49:0/1424367478 >> v2:172.21.15.115:3300/0 conn(0x7fa6fc13af40 0x7fa6fc0bd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:29.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.922+0000 7fa70198d700 1 -- 172.21.15.49:0/1424367478 >> v2:172.21.15.115:3300/0 conn(0x7fa6fc13af40 msgr2=0x7fa6fc0bd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:29.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.922+0000 7fa70198d700 1 --2- 172.21.15.49:0/1424367478 >> v2:172.21.15.115:3300/0 conn(0x7fa6fc13af40 0x7fa6fc0bd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:29.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.922+0000 7fa70198d700 1 -- 172.21.15.49:0/1424367478 >> v1:172.21.15.49:6789/0 conn(0x7fa6fc13ab60 legacy=0x7fa6fc154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:29.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.922+0000 7fa70198d700 1 -- 172.21.15.49:0/1424367478 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6fc0bdfe0 con 0x7fa6fc1556f0 2023-11-30T18:41:29.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.922+0000 7fa70118c700 1 -- 172.21.15.49:0/1424367478 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 819319137 0 0) 0x7fa6fc0bddb0 con 0x7fa6fc13ab60 2023-11-30T18:41:29.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.923+0000 7fa70198d700 1 --2- 172.21.15.49:0/1424367478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6fc1556f0 0x7fa6fc067780 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 rx=0x7fa6fc06acd0 tx=0x7fa6f8009060).ready entity=mon.0 client_cookie=b0eccec252440e65 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:29.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.923+0000 7fa70118c700 1 -- 172.21.15.49:0/1424367478 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f800f510 con 0x7fa6fc1556f0 2023-11-30T18:41:29.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.923+0000 7fa70118c700 1 -- 172.21.15.49:0/1424367478 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f800f670 con 0x7fa6fc1556f0 2023-11-30T18:41:29.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.923+0000 7fa70118c700 1 -- 172.21.15.49:0/1424367478 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f800f9f0 con 0x7fa6fc1556f0 2023-11-30T18:41:29.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.923+0000 7fa7043f2700 1 -- 172.21.15.49:0/1424367478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6fc1556f0 msgr2=0x7fa6fc067780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:29.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.923+0000 7fa7043f2700 1 --2- 172.21.15.49:0/1424367478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6fc1556f0 0x7fa6fc067780 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 rx=0x7fa6fc06acd0 tx=0x7fa6f8009060).stop 2023-11-30T18:41:29.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.923+0000 7fa7043f2700 1 -- 172.21.15.49:0/1424367478 shutdown_connections 2023-11-30T18:41:29.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.923+0000 7fa7043f2700 1 --2- 172.21.15.49:0/1424367478 >> v2:172.21.15.115:3300/0 conn(0x7fa6fc13af40 0x7fa6fc0bd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:29.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.923+0000 7fa7043f2700 1 --2- 172.21.15.49:0/1424367478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6fc1556f0 0x7fa6fc067780 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:29.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.923+0000 7fa7043f2700 1 -- 172.21.15.49:0/1424367478 >> 172.21.15.49:0/1424367478 conn(0x7fa6fc063810 msgr2=0x7fa6fc063c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:29.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.923+0000 7fa7043f2700 1 -- 172.21.15.49:0/1424367478 shutdown_connections 2023-11-30T18:41:29.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.923+0000 7fa7043f2700 1 -- 172.21.15.49:0/1424367478 wait complete. 2023-11-30T18:41:29.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.925+0000 7fa7043f2700 1 Processor -- start 2023-11-30T18:41:29.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.925+0000 7fa7043f2700 1 -- start start 2023-11-30T18:41:29.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.925+0000 7fa7043f2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6fc13ab60 0x7fa6fc0ad6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:29.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.925+0000 7fa7043f2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6fc13af40 0x7fa6fc136780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:29.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.925+0000 7fa7043f2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6fc1556f0 0x7fa6fc136c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:29.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.925+0000 7fa7043f2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc0ad250 con 0x7fa6fc13af40 2023-11-30T18:41:29.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.925+0000 7fa7043f2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc137160 con 0x7fa6fc13ab60 2023-11-30T18:41:29.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.925+0000 7fa7043f2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc0ac640 con 0x7fa6fc1556f0 2023-11-30T18:41:29.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.926+0000 7fa70198d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6fc13af40 0x7fa6fc136780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:29.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.926+0000 7fa70198d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6fc13af40 0x7fa6fc136780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43948/0 (socket says 172.21.15.49:43948) 2023-11-30T18:41:29.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.926+0000 7fa70198d700 1 -- 172.21.15.49:0/1727085959 learned_addr learned my addr 172.21.15.49:0/1727085959 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:29.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.926+0000 7fa70218e700 1 --2- 172.21.15.49:0/1727085959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6fc13ab60 0x7fa6fc0ad6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:29.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.926+0000 7fa70298f700 1 --2- 172.21.15.49:0/1727085959 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6fc1556f0 0x7fa6fc136c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:29.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.926+0000 7fa70198d700 1 -- 172.21.15.49:0/1727085959 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6fc1556f0 msgr2=0x7fa6fc136c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:29.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.926+0000 7fa70198d700 1 --2- 172.21.15.49:0/1727085959 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6fc1556f0 0x7fa6fc136c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:29.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.926+0000 7fa70198d700 1 -- 172.21.15.49:0/1727085959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6fc13ab60 msgr2=0x7fa6fc0ad6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:29.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.926+0000 7fa70198d700 1 --2- 172.21.15.49:0/1727085959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6fc13ab60 0x7fa6fc0ad6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:29.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.926+0000 7fa70198d700 1 -- 172.21.15.49:0/1727085959 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f80092a0 con 0x7fa6fc13af40 2023-11-30T18:41:29.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.926+0000 7fa70198d700 1 --2- 172.21.15.49:0/1727085959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6fc13af40 0x7fa6fc136780 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 rx=0x7fa6fc065710 tx=0x7fa6f8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:29.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.926+0000 7fa6f27fc700 1 -- 172.21.15.49:0/1727085959 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f800f7e0 con 0x7fa6fc13af40 2023-11-30T18:41:29.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.926+0000 7fa6f27fc700 1 -- 172.21.15.49:0/1727085959 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f800f940 con 0x7fa6fc13af40 2023-11-30T18:41:29.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.926+0000 7fa7043f2700 1 -- 172.21.15.49:0/1727085959 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6fc0ac920 con 0x7fa6fc13af40 2023-11-30T18:41:29.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.926+0000 7fa6f27fc700 1 -- 172.21.15.49:0/1727085959 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f801b690 con 0x7fa6fc13af40 2023-11-30T18:41:29.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.926+0000 7fa7043f2700 1 -- 172.21.15.49:0/1727085959 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6fc0acee0 con 0x7fa6fc13af40 2023-11-30T18:41:29.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.927+0000 7fa7043f2700 1 -- 172.21.15.49:0/1727085959 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6fc0ad3c0 con 0x7fa6fc13af40 2023-11-30T18:41:29.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.928+0000 7fa6f27fc700 1 -- 172.21.15.49:0/1727085959 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 100) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fa6f801ba00 con 0x7fa6fc13af40 2023-11-30T18:41:29.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.928+0000 7fa6f27fc700 1 --2- 172.21.15.49:0/1727085959 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa6e005f2c0 0x7fa6e0061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:29.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.928+0000 7fa6f27fc700 1 -- 172.21.15.49:0/1727085959 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(219..219 src has 1..219) v4 ==== 6233+0+0 (secure 0 0 0) 0x7fa6f807b9d0 con 0x7fa6fc13af40 2023-11-30T18:41:29.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.928+0000 7fa70218e700 1 -- 172.21.15.49:0/1727085959 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa6e005f2c0 msgr2=0x7fa6e0061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:29.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.928+0000 7fa70218e700 1 --2- 172.21.15.49:0/1727085959 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa6e005f2c0 0x7fa6e0061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:41:29.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:29.932+0000 7fa6f27fc700 1 -- 172.21.15.49:0/1727085959 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa6f804cab0 con 0x7fa6fc13af40 2023-11-30T18:41:30.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:30.129+0000 7fa70218e700 1 -- 172.21.15.49:0/1727085959 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa6e005f2c0 msgr2=0x7fa6e0061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:30.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:30.129+0000 7fa70218e700 1 --2- 172.21.15.49:0/1727085959 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa6e005f2c0 0x7fa6e0061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T18:41:30.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:30.131+0000 7fa7043f2700 1 -- 172.21.15.49:0/1727085959 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6fc0ad0a0 con 0x7fa6e005f2c0 2023-11-30T18:41:30.487 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:30.486+0000 7f06ee143680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T18:41:30.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:30.530+0000 7fa70218e700 1 -- 172.21.15.49:0/1727085959 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa6e005f2c0 msgr2=0x7fa6e0061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:30.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:30.530+0000 7fa70218e700 1 --2- 172.21.15.49:0/1727085959 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa6e005f2c0 0x7fa6e0061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-11-30T18:41:30.560 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:30.558+0000 7f06ee143680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T18:41:30.570 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:30.569+0000 7fa40d336680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T18:41:30.639 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:30.637+0000 7fa40d336680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T18:41:30.746 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:30.744+0000 7f06ee143680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T18:41:30.834 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:30.832+0000 7fa40d336680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T18:41:31.165 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:31.163+0000 7f06ee143680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T18:41:31.269 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:31.267+0000 7f06ee143680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:41:31.273 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:31.272+0000 7fa40d336680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T18:41:31.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:31.331+0000 7fa70218e700 1 -- 172.21.15.49:0/1727085959 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa6e005f2c0 msgr2=0x7fa6e0061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:31.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:31.331+0000 7fa70218e700 1 --2- 172.21.15.49:0/1727085959 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa6e005f2c0 0x7fa6e0061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-11-30T18:41:31.384 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:31.382+0000 7fa40d336680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:41:31.422 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:31.420+0000 7f06ee143680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T18:41:31.497 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:31.495+0000 7f06ee143680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T18:41:31.543 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:31.542+0000 7fa40d336680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T18:41:31.564 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:31.562+0000 7f06ee143680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T18:41:31.622 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:31.620+0000 7fa40d336680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T18:41:31.692 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:31.691+0000 7fa40d336680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T18:41:31.822 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:31.821+0000 7f06ee143680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T18:41:31.966 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:31.964+0000 7fa40d336680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T18:41:32.007 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:32.005+0000 7f06ee143680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T18:41:32.157 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:32.155+0000 7fa40d336680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T18:41:32.656 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:32.654+0000 7f06ee143680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T18:41:32.725 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:32.723+0000 7f06ee143680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T18:41:32.801 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:32.799+0000 7f06ee143680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T18:41:32.844 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:32.843+0000 7fa40d336680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T18:41:32.917 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:32.915+0000 7fa40d336680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T18:41:32.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:32.932+0000 7fa70218e700 1 -- 172.21.15.49:0/1727085959 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa6e005f2c0 msgr2=0x7fa6e0061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:32.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:32.933+0000 7fa70218e700 1 --2- 172.21.15.49:0/1727085959 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa6e005f2c0 0x7fa6e0061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-11-30T18:41:32.949 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:32.947+0000 7f06ee143680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T18:41:32.996 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:32.994+0000 7fa40d336680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T18:41:33.019 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:33.018+0000 7f06ee143680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T18:41:33.135 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:33.133+0000 7f06ee143680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T18:41:33.150 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:33.149+0000 7fa40d336680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T18:41:33.225 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:33.223+0000 7fa40d336680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T18:41:33.244 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:33.243+0000 7f06ee143680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:41:33.347 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:33.345+0000 7fa40d336680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T18:41:33.462 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:33.460+0000 7fa40d336680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:41:33.536 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:33.534+0000 7f06ee143680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T18:41:33.608 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:33.606+0000 7f06ee143680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T18:41:33.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:33.627+0000 7fa6f27fc700 1 -- 172.21.15.49:0/1727085959 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 101) v1 ==== 75287+0+0 (secure 0 0 0) 0x7fa6f80795b0 con 0x7fa6fc13af40 2023-11-30T18:41:33.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:33.627+0000 7fa6f27fc700 1 -- 172.21.15.49:0/1727085959 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa6e005f2c0 msgr2=0x7fa6e0061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:41:33.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:33.627+0000 7fa6f27fc700 1 --2- 172.21.15.49:0/1727085959 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa6e005f2c0 0x7fa6e0061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:33.696 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:33.694+0000 7f06620c8700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:41:33.696 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:33.694+0000 7f06620c8700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:41:33.696 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:33.694+0000 7f06620c8700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:41:33.696 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:33.694+0000 7f06620c8700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:41:33.696 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:33.694+0000 7f06620c8700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:41:33.696 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:33.694+0000 7f06658cf700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:41:33.696 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:33.694+0000 7f06658cf700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:41:33.696 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:33.694+0000 7f06658cf700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:41:33.696 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:33.694+0000 7f06658cf700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:41:33.696 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:33.694+0000 7f06658cf700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:41:33.772 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:33.770+0000 7fa40d336680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T18:41:33.848 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:33.846+0000 7fa40d336680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T18:41:34.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.630+0000 7fa6f27fc700 1 -- 172.21.15.49:0/1727085959 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mgrmap(e 102) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fa6f8079930 con 0x7fa6fc13af40 2023-11-30T18:41:34.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.630+0000 7fa6f27fc700 1 --2- 172.21.15.49:0/1727085959 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa6e005f2c0 0x7fa6e0061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:34.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.630+0000 7fa6f27fc700 1 -- 172.21.15.49:0/1727085959 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6fc0ad0a0 con 0x7fa6e005f2c0 2023-11-30T18:41:34.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.633+0000 7fa70218e700 1 --2- 172.21.15.49:0/1727085959 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa6e005f2c0 0x7fa6e0061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:34.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.635+0000 7fa70218e700 1 --2- 172.21.15.49:0/1727085959 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa6e005f2c0 0x7fa6e0061700 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fa6ec0011e0 tx=0x7fa6ec007bb0).ready entity=mgr.8315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:34.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.650+0000 7fa6f27fc700 1 -- 172.21.15.49:0/1727085959 <== mgr.8315 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa6fc0ad0a0 con 0x7fa6e005f2c0 2023-11-30T18:41:34.652 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule set for path snap_test_dir1 2023-11-30T18:41:34.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.653+0000 7fa7043f2700 1 -- 172.21.15.49:0/1727085959 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa6e005f2c0 msgr2=0x7fa6e0061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:34.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.653+0000 7fa7043f2700 1 --2- 172.21.15.49:0/1727085959 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa6e005f2c0 0x7fa6e0061700 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fa6ec0011e0 tx=0x7fa6ec007bb0).stop 2023-11-30T18:41:34.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.653+0000 7fa7043f2700 1 -- 172.21.15.49:0/1727085959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6fc13af40 msgr2=0x7fa6fc136780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:34.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.653+0000 7fa7043f2700 1 --2- 172.21.15.49:0/1727085959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6fc13af40 0x7fa6fc136780 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 rx=0x7fa6fc065710 tx=0x7fa6f8017000).stop 2023-11-30T18:41:34.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.653+0000 7fa7043f2700 1 -- 172.21.15.49:0/1727085959 shutdown_connections 2023-11-30T18:41:34.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.653+0000 7fa7043f2700 1 --2- 172.21.15.49:0/1727085959 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa6e005f2c0 0x7fa6e0061700 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:34.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.653+0000 7fa7043f2700 1 --2- 172.21.15.49:0/1727085959 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6fc1556f0 0x7fa6fc136c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:34.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.653+0000 7fa7043f2700 1 --2- 172.21.15.49:0/1727085959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6fc13ab60 0x7fa6fc0ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:34.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.653+0000 7fa7043f2700 1 --2- 172.21.15.49:0/1727085959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6fc13af40 0x7fa6fc136780 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:34.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.653+0000 7fa7043f2700 1 -- 172.21.15.49:0/1727085959 >> 172.21.15.49:0/1727085959 conn(0x7fa6fc063810 msgr2=0x7fa6fc151ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:34.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.653+0000 7fa7043f2700 1 -- 172.21.15.49:0/1727085959 shutdown_connections 2023-11-30T18:41:34.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.653+0000 7fa7043f2700 1 -- 172.21.15.49:0/1727085959 wait complete. 2023-11-30T18:41:34.670 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-11-30T18:41:34.670 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-11-30T18:41:34.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.798+0000 7f4e9e4c6700 1 Processor -- start 2023-11-30T18:41:34.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.798+0000 7f4e9e4c6700 1 -- start start 2023-11-30T18:41:34.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.799+0000 7f4e9e4c6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4e981547f0 0x7f4e980a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:34.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.799+0000 7f4e9e4c6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e980c86f0 0x7f4e980c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:34.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.799+0000 7f4e9e4c6700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e980c7e30 con 0x7f4e98062700 2023-11-30T18:41:34.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.799+0000 7f4e9e4c6700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e980bcf40 con 0x7f4e981547f0 2023-11-30T18:41:34.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.799+0000 7f4e9e4c6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e980c6b20 con 0x7f4e980c86f0 2023-11-30T18:41:34.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.799+0000 7f4e97fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4e981547f0 0x7f4e980a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:34.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.799+0000 7f4e9ca63700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4e98062700 0x7f4e980a4db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36578/0 (socket says 172.21.15.49:36578) 2023-11-30T18:41:34.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.799+0000 7f4e9ca63700 1 -- 172.21.15.49:0/862684000 learned_addr learned my addr 172.21.15.49:0/862684000 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:34.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.799+0000 7f4e977fe700 1 --2- 172.21.15.49:0/862684000 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e980c86f0 0x7f4e980c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:34.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.800+0000 7f4e97fff700 1 -- 172.21.15.49:0/862684000 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e980c86f0 msgr2=0x7f4e980c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:34.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.800+0000 7f4e97fff700 1 --2- 172.21.15.49:0/862684000 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e980c86f0 0x7f4e980c6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:34.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.800+0000 7f4e97fff700 1 -- 172.21.15.49:0/862684000 >> v1:172.21.15.49:6789/0 conn(0x7f4e98062700 legacy=0x7f4e980a4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:34.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.800+0000 7f4e96ffd700 1 -- 172.21.15.49:0/862684000 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882167516 0 0) 0x7f4e980c7e30 con 0x7f4e98062700 2023-11-30T18:41:34.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.800+0000 7f4e97fff700 1 -- 172.21.15.49:0/862684000 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e980a77d0 con 0x7f4e981547f0 2023-11-30T18:41:34.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.800+0000 7f4e977fe700 1 --2- 172.21.15.49:0/862684000 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e980c86f0 0x7f4e980c6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:41:34.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.800+0000 7f4e97fff700 1 --2- 172.21.15.49:0/862684000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e981547f0 0x7f4e980a72e0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 rx=0x7f4e80009760 tx=0x7f4e80009060).ready entity=mon.0 client_cookie=bc9957387bf7ee7a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:34.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.800+0000 7f4e96ffd700 1 -- 172.21.15.49:0/862684000 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e800090d0 con 0x7f4e981547f0 2023-11-30T18:41:34.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.800+0000 7f4e96ffd700 1 -- 172.21.15.49:0/862684000 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8000b580 con 0x7f4e981547f0 2023-11-30T18:41:34.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.800+0000 7f4e96ffd700 1 -- 172.21.15.49:0/862684000 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8000b900 con 0x7f4e981547f0 2023-11-30T18:41:34.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.800+0000 7f4e9e4c6700 1 -- 172.21.15.49:0/862684000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e981547f0 msgr2=0x7f4e980a72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:34.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.800+0000 7f4e9e4c6700 1 --2- 172.21.15.49:0/862684000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e981547f0 0x7f4e980a72e0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 rx=0x7f4e80009760 tx=0x7f4e80009060).stop 2023-11-30T18:41:34.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.800+0000 7f4e9e4c6700 1 -- 172.21.15.49:0/862684000 shutdown_connections 2023-11-30T18:41:34.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.800+0000 7f4e9e4c6700 1 --2- 172.21.15.49:0/862684000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e981547f0 0x7f4e980a72e0 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:34.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.800+0000 7f4e9e4c6700 1 --2- 172.21.15.49:0/862684000 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e980c86f0 0x7f4e980c6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:34.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.800+0000 7f4e9e4c6700 1 -- 172.21.15.49:0/862684000 >> 172.21.15.49:0/862684000 conn(0x7f4e980642d0 msgr2=0x7f4e980c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:34.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.800+0000 7f4e9e4c6700 1 -- 172.21.15.49:0/862684000 shutdown_connections 2023-11-30T18:41:34.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.800+0000 7f4e9e4c6700 1 -- 172.21.15.49:0/862684000 wait complete. 2023-11-30T18:41:34.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.802+0000 7f4e9e4c6700 1 Processor -- start 2023-11-30T18:41:34.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.802+0000 7f4e9e4c6700 1 -- start start 2023-11-30T18:41:34.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.802+0000 7f4e9e4c6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e98062700 0x7f4e981409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:34.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.802+0000 7f4e9e4c6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e980c86f0 0x7f4e981526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:34.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.802+0000 7f4e9e4c6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e981547f0 0x7f4e98069d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:34.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.802+0000 7f4e9e4c6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9814ec30 con 0x7f4e98062700 2023-11-30T18:41:34.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.802+0000 7f4e9e4c6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e981538e0 con 0x7f4e981547f0 2023-11-30T18:41:34.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.802+0000 7f4e9e4c6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e98153040 con 0x7f4e980c86f0 2023-11-30T18:41:34.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.803+0000 7f4e97fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e98062700 0x7f4e981409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:34.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.803+0000 7f4e97fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e98062700 0x7f4e981409d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34466/0 (socket says 172.21.15.49:34466) 2023-11-30T18:41:34.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.803+0000 7f4e97fff700 1 -- 172.21.15.49:0/2564150318 learned_addr learned my addr 172.21.15.49:0/2564150318 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:34.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.803+0000 7f4e977fe700 1 --2- 172.21.15.49:0/2564150318 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e980c86f0 0x7f4e981526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:34.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.803+0000 7f4e9ca63700 1 --2- 172.21.15.49:0/2564150318 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e981547f0 0x7f4e98069d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:34.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.803+0000 7f4e97fff700 1 -- 172.21.15.49:0/2564150318 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e980c86f0 msgr2=0x7f4e981526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:34.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.803+0000 7f4e97fff700 1 --2- 172.21.15.49:0/2564150318 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e980c86f0 0x7f4e981526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:34.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.803+0000 7f4e97fff700 1 -- 172.21.15.49:0/2564150318 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e981547f0 msgr2=0x7f4e98069d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:34.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.803+0000 7f4e97fff700 1 --2- 172.21.15.49:0/2564150318 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e981547f0 0x7f4e98069d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:34.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.803+0000 7f4e97fff700 1 -- 172.21.15.49:0/2564150318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e800092a0 con 0x7f4e98062700 2023-11-30T18:41:34.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.803+0000 7f4e977fe700 1 --2- 172.21.15.49:0/2564150318 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e980c86f0 0x7f4e981526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:41:34.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.803+0000 7f4e9ca63700 1 --2- 172.21.15.49:0/2564150318 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e981547f0 0x7f4e98069d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:41:34.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.803+0000 7f4e97fff700 1 --2- 172.21.15.49:0/2564150318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e98062700 0x7f4e981409d0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 rx=0x7f4e80009eb0 tx=0x7f4e80017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:34.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.803+0000 7f4e8ffff700 1 -- 172.21.15.49:0/2564150318 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8000b900 con 0x7f4e98062700 2023-11-30T18:41:34.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.803+0000 7f4e8ffff700 1 -- 172.21.15.49:0/2564150318 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8000bcc0 con 0x7f4e98062700 2023-11-30T18:41:34.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.803+0000 7f4e9e4c6700 1 -- 172.21.15.49:0/2564150318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e98153320 con 0x7f4e98062700 2023-11-30T18:41:34.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.803+0000 7f4e8ffff700 1 -- 172.21.15.49:0/2564150318 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8001b440 con 0x7f4e98062700 2023-11-30T18:41:34.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.803+0000 7f4e9e4c6700 1 -- 172.21.15.49:0/2564150318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e98140ec0 con 0x7f4e98062700 2023-11-30T18:41:34.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.804+0000 7f4e9e4c6700 1 -- 172.21.15.49:0/2564150318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e9814ea00 con 0x7f4e98062700 2023-11-30T18:41:34.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.805+0000 7f4e8ffff700 1 -- 172.21.15.49:0/2564150318 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 102) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f4e8001b7f0 con 0x7f4e98062700 2023-11-30T18:41:34.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.805+0000 7f4e8ffff700 1 --2- 172.21.15.49:0/2564150318 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4e7805f080 0x7f4e78061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:34.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.805+0000 7f4e8ffff700 1 -- 172.21.15.49:0/2564150318 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(220..220 src has 1..220) v4 ==== 6491+0+0 (secure 0 0 0) 0x7f4e8007bb30 con 0x7f4e98062700 2023-11-30T18:41:34.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.805+0000 7f4e977fe700 1 --2- 172.21.15.49:0/2564150318 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4e7805f080 0x7f4e78061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:34.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.806+0000 7f4e977fe700 1 --2- 172.21.15.49:0/2564150318 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4e7805f080 0x7f4e78061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f4e981507f0 tx=0x7f4e88008040).ready entity=mgr.8315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:34.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:34.809+0000 7f4e8ffff700 1 -- 172.21.15.49:0/2564150318 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4e9814ea00 con 0x7f4e98062700 2023-11-30T18:41:35.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.011+0000 7f4e9e4c6700 1 -- 172.21.15.49:0/2564150318 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e9814ea00 con 0x7f4e7805f080 2023-11-30T18:41:35.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.015+0000 7f4e8ffff700 1 -- 172.21.15.49:0/2564150318 <== mgr.8315 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7f4e9814ea00 con 0x7f4e7805f080 2023-11-30T18:41:35.018 INFO:teuthology.orchestra.run.smithi049.stdout:Retention added to path snap_test_dir1 2023-11-30T18:41:35.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.017+0000 7f4e9e4c6700 1 -- 172.21.15.49:0/2564150318 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4e7805f080 msgr2=0x7f4e78061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:35.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.017+0000 7f4e9e4c6700 1 --2- 172.21.15.49:0/2564150318 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4e7805f080 0x7f4e78061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f4e981507f0 tx=0x7f4e88008040).stop 2023-11-30T18:41:35.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.017+0000 7f4e9e4c6700 1 -- 172.21.15.49:0/2564150318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e98062700 msgr2=0x7f4e981409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:35.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.017+0000 7f4e9e4c6700 1 --2- 172.21.15.49:0/2564150318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e98062700 0x7f4e981409d0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 rx=0x7f4e80009eb0 tx=0x7f4e80017000).stop 2023-11-30T18:41:35.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.018+0000 7f4e9e4c6700 1 -- 172.21.15.49:0/2564150318 shutdown_connections 2023-11-30T18:41:35.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.018+0000 7f4e9e4c6700 1 --2- 172.21.15.49:0/2564150318 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4e7805f080 0x7f4e78061540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:35.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.018+0000 7f4e9e4c6700 1 --2- 172.21.15.49:0/2564150318 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e981547f0 0x7f4e98069d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:35.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.018+0000 7f4e9e4c6700 1 --2- 172.21.15.49:0/2564150318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e98062700 0x7f4e981409d0 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:35.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.018+0000 7f4e9e4c6700 1 --2- 172.21.15.49:0/2564150318 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e980c86f0 0x7f4e981526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:35.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.018+0000 7f4e9e4c6700 1 -- 172.21.15.49:0/2564150318 >> 172.21.15.49:0/2564150318 conn(0x7f4e980642d0 msgr2=0x7f4e980a5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:35.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.018+0000 7f4e9e4c6700 1 -- 172.21.15.49:0/2564150318 shutdown_connections 2023-11-30T18:41:35.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.018+0000 7f4e9e4c6700 1 -- 172.21.15.49:0/2564150318 wait complete. 2023-11-30T18:41:35.032 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-11-30T18:41:35.037 INFO:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-11-30-18_42_00 in ~25s... 2023-11-30T18:41:35.037 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-11-30T18:41:35.038 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-11-30T18:41:35.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.157+0000 7fa59ec69700 1 Processor -- start 2023-11-30T18:41:35.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.157+0000 7fa59ec69700 1 -- start start 2023-11-30T18:41:35.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.158+0000 7fa59ec69700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa5981373a0 0x7fa5980c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:35.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.158+0000 7fa59ec69700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa5980c5f30 0x7fa5980c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:35.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.158+0000 7fa59ec69700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5980669a0 0x7fa598066e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:35.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.158+0000 7fa59ec69700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5980c68d0 con 0x7fa5981373a0 2023-11-30T18:41:35.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.158+0000 7fa59ec69700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa598158e20 con 0x7fa5980c5f30 2023-11-30T18:41:35.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.158+0000 7fa59ec69700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5981582a0 con 0x7fa5980669a0 2023-11-30T18:41:35.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.158+0000 7fa59ca05700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa5981373a0 0x7fa5980c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:35.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.158+0000 7fa59ca05700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa5981373a0 0x7fa5980c72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34476/0 (socket says 172.21.15.49:34476) 2023-11-30T18:41:35.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.158+0000 7fa59ca05700 1 -- 172.21.15.49:0/859486112 learned_addr learned my addr 172.21.15.49:0/859486112 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:35.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.159+0000 7fa597fff700 1 --2- 172.21.15.49:0/859486112 >> v2:172.21.15.115:3300/0 conn(0x7fa5980c5f30 0x7fa5980c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:35.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.159+0000 7fa59d206700 1 --2- 172.21.15.49:0/859486112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5980669a0 0x7fa598066e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:35.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.159+0000 7fa59ca05700 1 -- 172.21.15.49:0/859486112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5980669a0 msgr2=0x7fa598066e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:35.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.159+0000 7fa59ca05700 1 --2- 172.21.15.49:0/859486112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5980669a0 0x7fa598066e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:35.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.159+0000 7fa59ca05700 1 -- 172.21.15.49:0/859486112 >> v2:172.21.15.115:3300/0 conn(0x7fa5980c5f30 msgr2=0x7fa5980c63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:35.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.159+0000 7fa59ca05700 1 --2- 172.21.15.49:0/859486112 >> v2:172.21.15.115:3300/0 conn(0x7fa5980c5f30 0x7fa5980c63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:35.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.159+0000 7fa59ca05700 1 -- 172.21.15.49:0/859486112 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa598158580 con 0x7fa5981373a0 2023-11-30T18:41:35.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.159+0000 7fa59ca05700 1 --2- 172.21.15.49:0/859486112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5981373a0 0x7fa5980c72e0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 rx=0x7fa598069110 tx=0x7fa590009840).ready entity=mon.0 client_cookie=5b75ee18c8ef02a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:35.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.159+0000 7fa5977fe700 1 -- 172.21.15.49:0/859486112 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59000e070 con 0x7fa5981373a0 2023-11-30T18:41:35.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.159+0000 7fa5977fe700 1 -- 172.21.15.49:0/859486112 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59000b970 con 0x7fa5981373a0 2023-11-30T18:41:35.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.159+0000 7fa5977fe700 1 -- 172.21.15.49:0/859486112 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59000bcf0 con 0x7fa5981373a0 2023-11-30T18:41:35.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.160+0000 7fa59ec69700 1 -- 172.21.15.49:0/859486112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5981373a0 msgr2=0x7fa5980c72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:35.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.160+0000 7fa59ec69700 1 --2- 172.21.15.49:0/859486112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5981373a0 0x7fa5980c72e0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 rx=0x7fa598069110 tx=0x7fa590009840).stop 2023-11-30T18:41:35.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.160+0000 7fa59ec69700 1 -- 172.21.15.49:0/859486112 shutdown_connections 2023-11-30T18:41:35.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.160+0000 7fa59ec69700 1 --2- 172.21.15.49:0/859486112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5980669a0 0x7fa598066e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:35.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.160+0000 7fa59ec69700 1 --2- 172.21.15.49:0/859486112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5981373a0 0x7fa5980c72e0 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:35.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.160+0000 7fa59ec69700 1 --2- 172.21.15.49:0/859486112 >> v2:172.21.15.115:3300/0 conn(0x7fa5980c5f30 0x7fa5980c63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:35.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.160+0000 7fa59ec69700 1 -- 172.21.15.49:0/859486112 >> 172.21.15.49:0/859486112 conn(0x7fa5980628f0 msgr2=0x7fa598062d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:35.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.160+0000 7fa59ec69700 1 -- 172.21.15.49:0/859486112 shutdown_connections 2023-11-30T18:41:35.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.160+0000 7fa59ec69700 1 -- 172.21.15.49:0/859486112 wait complete. 2023-11-30T18:41:35.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.161+0000 7fa59ec69700 1 Processor -- start 2023-11-30T18:41:35.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.161+0000 7fa59ec69700 1 -- start start 2023-11-30T18:41:35.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.162+0000 7fa59ec69700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5980669a0 0x7fa5980aa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:35.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.162+0000 7fa59ec69700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5980c5f30 0x7fa598157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:35.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.162+0000 7fa59ec69700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5981373a0 0x7fa59813a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:35.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.162+0000 7fa59ec69700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5980aa230 con 0x7fa5980669a0 2023-11-30T18:41:35.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.162+0000 7fa59ec69700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5981380b0 con 0x7fa5980c5f30 2023-11-30T18:41:35.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.162+0000 7fa59ec69700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa598138390 con 0x7fa5981373a0 2023-11-30T18:41:35.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.162+0000 7fa59ca05700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5980669a0 0x7fa5980aa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:35.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.162+0000 7fa59ca05700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5980669a0 0x7fa5980aa6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34484/0 (socket says 172.21.15.49:34484) 2023-11-30T18:41:35.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.162+0000 7fa59ca05700 1 -- 172.21.15.49:0/527930039 learned_addr learned my addr 172.21.15.49:0/527930039 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:35.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.162+0000 7fa597fff700 1 --2- 172.21.15.49:0/527930039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5980c5f30 0x7fa598157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:35.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.162+0000 7fa59d206700 1 --2- 172.21.15.49:0/527930039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5981373a0 0x7fa59813a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:35.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.162+0000 7fa59ca05700 1 -- 172.21.15.49:0/527930039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5981373a0 msgr2=0x7fa59813a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:35.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.162+0000 7fa59ca05700 1 --2- 172.21.15.49:0/527930039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5981373a0 0x7fa59813a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:35.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.162+0000 7fa59ca05700 1 -- 172.21.15.49:0/527930039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5980c5f30 msgr2=0x7fa598157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:35.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.162+0000 7fa59ca05700 1 --2- 172.21.15.49:0/527930039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5980c5f30 0x7fa598157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:35.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.162+0000 7fa59ca05700 1 -- 172.21.15.49:0/527930039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa590009ae0 con 0x7fa5980669a0 2023-11-30T18:41:35.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.162+0000 7fa59d206700 1 --2- 172.21.15.49:0/527930039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5981373a0 0x7fa59813a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:41:35.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.162+0000 7fa59ca05700 1 --2- 172.21.15.49:0/527930039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5980669a0 0x7fa5980aa6c0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 rx=0x7fa59000b610 tx=0x7fa590009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:35.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.162+0000 7fa594ff9700 1 -- 172.21.15.49:0/527930039 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59000bcf0 con 0x7fa5980669a0 2023-11-30T18:41:35.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.162+0000 7fa594ff9700 1 -- 172.21.15.49:0/527930039 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5900092e0 con 0x7fa5980669a0 2023-11-30T18:41:35.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.162+0000 7fa59ec69700 1 -- 172.21.15.49:0/527930039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5980a9be0 con 0x7fa5980669a0 2023-11-30T18:41:35.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.162+0000 7fa594ff9700 1 -- 172.21.15.49:0/527930039 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59001e680 con 0x7fa5980669a0 2023-11-30T18:41:35.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.163+0000 7fa59ec69700 1 -- 172.21.15.49:0/527930039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa598137cf0 con 0x7fa5980669a0 2023-11-30T18:41:35.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.163+0000 7fa59ec69700 1 -- 172.21.15.49:0/527930039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5980aa510 con 0x7fa5980669a0 2023-11-30T18:41:35.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.164+0000 7fa594ff9700 1 -- 172.21.15.49:0/527930039 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 102) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fa590003040 con 0x7fa5980669a0 2023-11-30T18:41:35.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.164+0000 7fa594ff9700 1 --2- 172.21.15.49:0/527930039 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa58405f080 0x7fa584061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:35.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.164+0000 7fa594ff9700 1 -- 172.21.15.49:0/527930039 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(220..220 src has 1..220) v4 ==== 6491+0+0 (secure 0 0 0) 0x7fa59007b730 con 0x7fa5980669a0 2023-11-30T18:41:35.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.164+0000 7fa597fff700 1 --2- 172.21.15.49:0/527930039 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa58405f080 0x7fa584061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:35.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.165+0000 7fa597fff700 1 --2- 172.21.15.49:0/527930039 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa58405f080 0x7fa584061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fa58c009c30 tx=0x7fa58c009060).ready entity=mgr.8315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:35.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.168+0000 7fa594ff9700 1 -- 172.21.15.49:0/527930039 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa59004cb10 con 0x7fa5980669a0 2023-11-30T18:41:35.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.365+0000 7fa59ec69700 1 -- 172.21.15.49:0/527930039 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa5980aa370 con 0x7fa58405f080 2023-11-30T18:41:35.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.367+0000 7fa594ff9700 1 -- 172.21.15.49:0/527930039 <== mgr.8315 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7fa58c011890 con 0x7fa58405f080 2023-11-30T18:41:35.369 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:35.369 INFO:teuthology.orchestra.run.smithi049.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-11-30T18:41:35.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.369+0000 7fa59ec69700 1 -- 172.21.15.49:0/527930039 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa58405f080 msgr2=0x7fa584061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:35.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.369+0000 7fa59ec69700 1 --2- 172.21.15.49:0/527930039 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa58405f080 0x7fa584061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fa58c009c30 tx=0x7fa58c009060).stop 2023-11-30T18:41:35.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.369+0000 7fa59ec69700 1 -- 172.21.15.49:0/527930039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5980669a0 msgr2=0x7fa5980aa6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:35.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.369+0000 7fa59ec69700 1 --2- 172.21.15.49:0/527930039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5980669a0 0x7fa5980aa6c0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 rx=0x7fa59000b610 tx=0x7fa590009840).stop 2023-11-30T18:41:35.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.369+0000 7fa59ec69700 1 -- 172.21.15.49:0/527930039 shutdown_connections 2023-11-30T18:41:35.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.369+0000 7fa59ec69700 1 --2- 172.21.15.49:0/527930039 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa58405f080 0x7fa584061540 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:35.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.369+0000 7fa59ec69700 1 --2- 172.21.15.49:0/527930039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5981373a0 0x7fa59813a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:35.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.369+0000 7fa59ec69700 1 --2- 172.21.15.49:0/527930039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5980669a0 0x7fa5980aa6c0 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:35.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.369+0000 7fa59ec69700 1 --2- 172.21.15.49:0/527930039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5980c5f30 0x7fa598157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:35.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.369+0000 7fa59ec69700 1 -- 172.21.15.49:0/527930039 >> 172.21.15.49:0/527930039 conn(0x7fa5980628f0 msgr2=0x7fa5981365c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:35.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.369+0000 7fa59ec69700 1 -- 172.21.15.49:0/527930039 shutdown_connections 2023-11-30T18:41:35.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.369+0000 7fa59ec69700 1 -- 172.21.15.49:0/527930039 wait complete. 2023-11-30T18:41:35.383 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-11-30T18:41:35.383 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-11-30T18:41:35.384 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-11-30T18:41:35.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.504+0000 7f11dc8e7700 1 Processor -- start 2023-11-30T18:41:35.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.504+0000 7f11dc8e7700 1 -- start start 2023-11-30T18:41:35.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.505+0000 7f11dc8e7700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f11d80c6530 0x7f11d80640b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:35.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.505+0000 7f11dc8e7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11d80c57e0 0x7f11d80be880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:35.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.505+0000 7f11dc8e7700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d80bf1f0 con 0x7f11d80bed70 2023-11-30T18:41:35.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.505+0000 7f11dc8e7700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d8065680 con 0x7f11d80c6530 2023-11-30T18:41:35.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.505+0000 7f11dc8e7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d80c6910 con 0x7f11d80c57e0 2023-11-30T18:41:35.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.505+0000 7f11d759e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f11d80bed70 0x7f11d81549a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36594/0 (socket says 172.21.15.49:36594) 2023-11-30T18:41:35.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.505+0000 7f11d759e700 1 -- 172.21.15.49:0/3853638430 learned_addr learned my addr 172.21.15.49:0/3853638430 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:35.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.505+0000 7f11d6d9d700 1 --2- 172.21.15.49:0/3853638430 >> v2:172.21.15.49:3300/0 conn(0x7f11d80c6530 0x7f11d80640b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:35.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.505+0000 7f11d659c700 1 --2- 172.21.15.49:0/3853638430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11d80c57e0 0x7f11d80be880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:35.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.505+0000 7f11d6d9d700 1 -- 172.21.15.49:0/3853638430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11d80c57e0 msgr2=0x7f11d80be880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:35.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.505+0000 7f11d6d9d700 1 --2- 172.21.15.49:0/3853638430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11d80c57e0 0x7f11d80be880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:35.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.505+0000 7f11d6d9d700 1 -- 172.21.15.49:0/3853638430 >> v1:172.21.15.49:6789/0 conn(0x7f11d80bed70 legacy=0x7f11d81549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:35.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.505+0000 7f11d6d9d700 1 -- 172.21.15.49:0/3853638430 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d8064a00 con 0x7f11d80c6530 2023-11-30T18:41:35.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.505+0000 7f11d659c700 1 --2- 172.21.15.49:0/3853638430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11d80c57e0 0x7f11d80be880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:41:35.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.505+0000 7f11d6d9d700 1 --2- 172.21.15.49:0/3853638430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11d80c6530 0x7f11d80640b0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 rx=0x7f11d0009760 tx=0x7f11d0009060).ready entity=mon.0 client_cookie=f0af59844d8276d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:35.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.505+0000 7f11d5d9b700 1 -- 172.21.15.49:0/3853638430 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d000b580 con 0x7f11d80c6530 2023-11-30T18:41:35.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.505+0000 7f11d5d9b700 1 -- 172.21.15.49:0/3853638430 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d000b6e0 con 0x7f11d80c6530 2023-11-30T18:41:35.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.506+0000 7f11d5d9b700 1 -- 172.21.15.49:0/3853638430 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d000ba60 con 0x7f11d80c6530 2023-11-30T18:41:35.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.506+0000 7f11dc8e7700 1 -- 172.21.15.49:0/3853638430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11d80c6530 msgr2=0x7f11d80640b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:35.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.506+0000 7f11dc8e7700 1 --2- 172.21.15.49:0/3853638430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11d80c6530 0x7f11d80640b0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 rx=0x7f11d0009760 tx=0x7f11d0009060).stop 2023-11-30T18:41:35.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.506+0000 7f11dc8e7700 1 -- 172.21.15.49:0/3853638430 shutdown_connections 2023-11-30T18:41:35.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.506+0000 7f11dc8e7700 1 --2- 172.21.15.49:0/3853638430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11d80c6530 0x7f11d80640b0 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:35.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.506+0000 7f11dc8e7700 1 --2- 172.21.15.49:0/3853638430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11d80c57e0 0x7f11d80be880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:35.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.506+0000 7f11dc8e7700 1 -- 172.21.15.49:0/3853638430 >> 172.21.15.49:0/3853638430 conn(0x7f11d8092520 msgr2=0x7f11d8062ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:35.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.506+0000 7f11dc8e7700 1 -- 172.21.15.49:0/3853638430 shutdown_connections 2023-11-30T18:41:35.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.506+0000 7f11dc8e7700 1 -- 172.21.15.49:0/3853638430 wait complete. 2023-11-30T18:41:35.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.507+0000 7f11dc8e7700 1 Processor -- start 2023-11-30T18:41:35.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.507+0000 7f11dc8e7700 1 -- start start 2023-11-30T18:41:35.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.508+0000 7f11dc8e7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11d80bed70 0x7f11d80c2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:35.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.508+0000 7f11dc8e7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11d80c57e0 0x7f11d80bfe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:35.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.508+0000 7f11dc8e7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11d80c6530 0x7f11d8146e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:35.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.508+0000 7f11dc8e7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d80c2310 con 0x7f11d80c6530 2023-11-30T18:41:35.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.508+0000 7f11dc8e7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d80c3210 con 0x7f11d80bed70 2023-11-30T18:41:35.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.508+0000 7f11dc8e7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d8159ae0 con 0x7f11d80c57e0 2023-11-30T18:41:35.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.508+0000 7f11d759e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11d80c6530 0x7f11d8146e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:35.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.508+0000 7f11d759e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11d80c6530 0x7f11d8146e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34498/0 (socket says 172.21.15.49:34498) 2023-11-30T18:41:35.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.508+0000 7f11d759e700 1 -- 172.21.15.49:0/2602005991 learned_addr learned my addr 172.21.15.49:0/2602005991 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:35.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.508+0000 7f11d6d9d700 1 --2- 172.21.15.49:0/2602005991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11d80bed70 0x7f11d80c2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:35.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.508+0000 7f11d659c700 1 --2- 172.21.15.49:0/2602005991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11d80c57e0 0x7f11d80bfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:35.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.508+0000 7f11d759e700 1 -- 172.21.15.49:0/2602005991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11d80c57e0 msgr2=0x7f11d80bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:35.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.508+0000 7f11d759e700 1 --2- 172.21.15.49:0/2602005991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11d80c57e0 0x7f11d80bfe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:35.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.508+0000 7f11d759e700 1 -- 172.21.15.49:0/2602005991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11d80bed70 msgr2=0x7f11d80c2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:35.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.508+0000 7f11d759e700 1 --2- 172.21.15.49:0/2602005991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11d80bed70 0x7f11d80c2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:35.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.508+0000 7f11d759e700 1 -- 172.21.15.49:0/2602005991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d00092a0 con 0x7f11d80c6530 2023-11-30T18:41:35.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.509+0000 7f11d759e700 1 --2- 172.21.15.49:0/2602005991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11d80c6530 0x7f11d8146e60 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 rx=0x7f11c800c7c0 tx=0x7f11c80015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:35.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.509+0000 7f11ceffd700 1 -- 172.21.15.49:0/2602005991 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c8005d30 con 0x7f11d80c6530 2023-11-30T18:41:35.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.509+0000 7f11ceffd700 1 -- 172.21.15.49:0/2602005991 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c8005e90 con 0x7f11d80c6530 2023-11-30T18:41:35.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.509+0000 7f11dc8e7700 1 -- 172.21.15.49:0/2602005991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d8159dc0 con 0x7f11d80c6530 2023-11-30T18:41:35.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.509+0000 7f11ceffd700 1 -- 172.21.15.49:0/2602005991 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c80072e0 con 0x7f11d80c6530 2023-11-30T18:41:35.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.509+0000 7f11dc8e7700 1 -- 172.21.15.49:0/2602005991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d80c2800 con 0x7f11d80c6530 2023-11-30T18:41:35.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.510+0000 7f11dc8e7700 1 -- 172.21.15.49:0/2602005991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d80c2a20 con 0x7f11d80c6530 2023-11-30T18:41:35.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.510+0000 7f11ceffd700 1 -- 172.21.15.49:0/2602005991 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 102) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f11c8007690 con 0x7f11d80c6530 2023-11-30T18:41:35.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.511+0000 7f11ceffd700 1 --2- 172.21.15.49:0/2602005991 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f11b805f050 0x7f11b8061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:35.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.511+0000 7f11ceffd700 1 -- 172.21.15.49:0/2602005991 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(220..220 src has 1..220) v4 ==== 6491+0+0 (secure 0 0 0) 0x7f11c8079ae0 con 0x7f11d80c6530 2023-11-30T18:41:35.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.511+0000 7f11d6d9d700 1 --2- 172.21.15.49:0/2602005991 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f11b805f050 0x7f11b8061510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:35.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.511+0000 7f11d6d9d700 1 --2- 172.21.15.49:0/2602005991 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f11b805f050 0x7f11b8061510 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f11d000b340 tx=0x7f11d0017000).ready entity=mgr.8315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:35.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.515+0000 7f11ceffd700 1 -- 172.21.15.49:0/2602005991 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f11c804ae10 con 0x7f11d80c6530 2023-11-30T18:41:35.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.714+0000 7f11dc8e7700 1 -- 172.21.15.49:0/2602005991 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f11d806c7c0 con 0x7f11b805f050 2023-11-30T18:41:35.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.718+0000 7f11ceffd700 1 -- 172.21.15.49:0/2602005991 <== mgr.8315 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f11d806c7c0 con 0x7f11b805f050 2023-11-30T18:41:35.720 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule removed for path snap_test_dir1 2023-11-30T18:41:35.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.720+0000 7f11dc8e7700 1 -- 172.21.15.49:0/2602005991 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f11b805f050 msgr2=0x7f11b8061510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:35.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.720+0000 7f11dc8e7700 1 --2- 172.21.15.49:0/2602005991 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f11b805f050 0x7f11b8061510 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f11d000b340 tx=0x7f11d0017000).stop 2023-11-30T18:41:35.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.720+0000 7f11dc8e7700 1 -- 172.21.15.49:0/2602005991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11d80c6530 msgr2=0x7f11d8146e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:35.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.720+0000 7f11dc8e7700 1 --2- 172.21.15.49:0/2602005991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11d80c6530 0x7f11d8146e60 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 rx=0x7f11c800c7c0 tx=0x7f11c80015e0).stop 2023-11-30T18:41:35.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.720+0000 7f11dc8e7700 1 -- 172.21.15.49:0/2602005991 shutdown_connections 2023-11-30T18:41:35.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.720+0000 7f11dc8e7700 1 --2- 172.21.15.49:0/2602005991 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f11b805f050 0x7f11b8061510 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:35.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.720+0000 7f11dc8e7700 1 --2- 172.21.15.49:0/2602005991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11d80c6530 0x7f11d8146e60 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:35.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.720+0000 7f11dc8e7700 1 --2- 172.21.15.49:0/2602005991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11d80bed70 0x7f11d80c2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:35.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.720+0000 7f11dc8e7700 1 --2- 172.21.15.49:0/2602005991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11d80c57e0 0x7f11d80bfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:35.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.720+0000 7f11dc8e7700 1 -- 172.21.15.49:0/2602005991 >> 172.21.15.49:0/2602005991 conn(0x7f11d8092520 msgr2=0x7f11d80c79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:35.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.720+0000 7f11dc8e7700 1 -- 172.21.15.49:0/2602005991 shutdown_connections 2023-11-30T18:41:35.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.720+0000 7f11dc8e7700 1 -- 172.21.15.49:0/2602005991 wait complete. 2023-11-30T18:41:35.734 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-11-30T18:41:35.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:41:35.736 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-30T18:41:35.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:41:35.752 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-11-30T18:41:35.808 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-11-30T18:41:35.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.968+0000 7f5b7e8e3700 1 Processor -- start 2023-11-30T18:41:35.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.968+0000 7f5b7e8e3700 1 -- start start 2023-11-30T18:41:35.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.969+0000 7f5b7e8e3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b78098d10 0x7f5b780c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:35.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.969+0000 7f5b7e8e3700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b780c72d0 con 0x7f5b780c6190 2023-11-30T18:41:35.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.969+0000 7f5b7e8e3700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b78064570 con 0x7f5b78158320 2023-11-30T18:41:35.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.969+0000 7f5b7e8e3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b78154bc0 con 0x7f5b78098d10 2023-11-30T18:41:35.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.969+0000 7f5b777fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5b780c6190 0x7f5b78063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36600/0 (socket says 172.21.15.49:36600) 2023-11-30T18:41:35.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.969+0000 7f5b777fe700 1 -- 172.21.15.49:0/2437422035 learned_addr learned my addr 172.21.15.49:0/2437422035 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:35.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.969+0000 7f5b77fff700 1 --2- 172.21.15.49:0/2437422035 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b78098d10 0x7f5b780c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:35.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.969+0000 7f5b76ffd700 1 -- 172.21.15.49:0/2437422035 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4191030383 0 0) 0x7f5b780c72d0 con 0x7f5b780c6190 2023-11-30T18:41:35.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.969+0000 7f5b76ffd700 1 -- 172.21.15.49:0/2437422035 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b640033f0 con 0x7f5b780c6190 2023-11-30T18:41:35.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.969+0000 7f5b76ffd700 1 -- 172.21.15.49:0/2437422035 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3228967950 0 0) 0x7f5b640033f0 con 0x7f5b780c6190 2023-11-30T18:41:35.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.969+0000 7f5b76ffd700 1 -- 172.21.15.49:0/2437422035 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b78098d10 msgr2=0x7f5b780c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:35.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.969+0000 7f5b76ffd700 1 --2- 172.21.15.49:0/2437422035 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b78098d10 0x7f5b780c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:35.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.969+0000 7f5b76ffd700 1 -- 172.21.15.49:0/2437422035 >> v1:172.21.15.115:6789/0 conn(0x7f5b78158320 legacy=0x7f5b780a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:35.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.969+0000 7f5b76ffd700 1 -- 172.21.15.49:0/2437422035 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b780c66c0 con 0x7f5b780c6190 2023-11-30T18:41:35.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.969+0000 7f5b76ffd700 1 -- 172.21.15.49:0/2437422035 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f5b60001470 con 0x7f5b780c6190 2023-11-30T18:41:35.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.969+0000 7f5b76ffd700 1 -- 172.21.15.49:0/2437422035 >> v1:172.21.15.49:6789/0 conn(0x7f5b780c6190 legacy=0x7f5b78063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:35.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.969+0000 7f5b76ffd700 1 --2- 172.21.15.49:0/2437422035 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b78098d10 0x7f5b64003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:35.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.969+0000 7f5b76ffd700 1 --2- 172.21.15.49:0/2437422035 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b64003e00 0x7f5b64004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:35.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.969+0000 7f5b76ffd700 1 --2- 172.21.15.49:0/2437422035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b64004b80 0x7f5b64005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:35.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.970+0000 7f5b76ffd700 1 -- 172.21.15.49:0/2437422035 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b78154bc0 con 0x7f5b64004b80 2023-11-30T18:41:35.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.970+0000 7f5b76ffd700 1 -- 172.21.15.49:0/2437422035 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6400b8e0 con 0x7f5b64003e00 2023-11-30T18:41:35.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.970+0000 7f5b76ffd700 1 -- 172.21.15.49:0/2437422035 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6400baa0 con 0x7f5b78098d10 2023-11-30T18:41:35.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.970+0000 7f5b7ce80700 1 --2- 172.21.15.49:0/2437422035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b64004b80 0x7f5b64005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:35.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.970+0000 7f5b77fff700 1 --2- 172.21.15.49:0/2437422035 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b78098d10 0x7f5b64003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:35.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.970+0000 7f5b777fe700 1 --2- 172.21.15.49:0/2437422035 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b64003e00 0x7f5b64004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:35.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.970+0000 7f5b7ce80700 1 -- 172.21.15.49:0/2437422035 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b78098d10 msgr2=0x7f5b64003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:35.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.970+0000 7f5b7ce80700 1 --2- 172.21.15.49:0/2437422035 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b78098d10 0x7f5b64003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:35.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.970+0000 7f5b7ce80700 1 -- 172.21.15.49:0/2437422035 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b64003e00 msgr2=0x7f5b64004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:35.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.970+0000 7f5b7ce80700 1 --2- 172.21.15.49:0/2437422035 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b64003e00 0x7f5b64004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:35.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.970+0000 7f5b7ce80700 1 -- 172.21.15.49:0/2437422035 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b640033f0 con 0x7f5b64004b80 2023-11-30T18:41:35.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.970+0000 7f5b7ce80700 1 --2- 172.21.15.49:0/2437422035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b64004b80 0x7f5b64005000 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 rx=0x7f5b70001f20 tx=0x7f5b70007f10).ready entity=mon.0 client_cookie=7357482d812be435 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:35.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.970+0000 7f5b76ffd700 1 -- 172.21.15.49:0/2437422035 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b700017e0 con 0x7f5b64004b80 2023-11-30T18:41:35.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.970+0000 7f5b76ffd700 1 -- 172.21.15.49:0/2437422035 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7000c6d0 con 0x7f5b64004b80 2023-11-30T18:41:35.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.970+0000 7f5b76ffd700 1 -- 172.21.15.49:0/2437422035 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7000ca50 con 0x7f5b64004b80 2023-11-30T18:41:35.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.971+0000 7f5b7e8e3700 1 -- 172.21.15.49:0/2437422035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b64004b80 msgr2=0x7f5b64005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:35.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.971+0000 7f5b7e8e3700 1 --2- 172.21.15.49:0/2437422035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b64004b80 0x7f5b64005000 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 rx=0x7f5b70001f20 tx=0x7f5b70007f10).stop 2023-11-30T18:41:35.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.971+0000 7f5b7ce80700 1 -- 172.21.15.49:0/2437422035 reap_dead start 2023-11-30T18:41:35.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.971+0000 7f5b7e8e3700 1 -- 172.21.15.49:0/2437422035 shutdown_connections 2023-11-30T18:41:35.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.971+0000 7f5b7e8e3700 1 -- 172.21.15.49:0/2437422035 >> 172.21.15.49:0/2437422035 conn(0x7f5b780cb310 msgr2=0x7f5b780cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:35.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.971+0000 7f5b7e8e3700 1 -- 172.21.15.49:0/2437422035 shutdown_connections 2023-11-30T18:41:35.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.971+0000 7f5b7e8e3700 1 -- 172.21.15.49:0/2437422035 wait complete. 2023-11-30T18:41:35.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.972+0000 7f5b7e8e3700 1 Processor -- start 2023-11-30T18:41:35.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.972+0000 7f5b7e8e3700 1 -- start start 2023-11-30T18:41:35.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.973+0000 7f5b7e8e3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b7814c1b0 0x7f5b780ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:35.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.973+0000 7f5b7e8e3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b7814c590 0x7f5b78156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:35.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.973+0000 7f5b7e8e3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b781564f0 0x7f5b780c23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:35.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.973+0000 7f5b7e8e3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b780ad460 con 0x7f5b7814c590 2023-11-30T18:41:35.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.973+0000 7f5b7e8e3700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b78156970 con 0x7f5b7814c1b0 2023-11-30T18:41:35.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.973+0000 7f5b7e8e3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b780ac850 con 0x7f5b781564f0 2023-11-30T18:41:35.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.973+0000 7f5b777fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b7814c590 0x7f5b78156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:35.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.973+0000 7f5b777fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b7814c590 0x7f5b78156000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34514/0 (socket says 172.21.15.49:34514) 2023-11-30T18:41:35.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.973+0000 7f5b777fe700 1 -- 172.21.15.49:0/3372060238 learned_addr learned my addr 172.21.15.49:0/3372060238 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:35.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.973+0000 7f5b77fff700 1 --2- 172.21.15.49:0/3372060238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b7814c1b0 0x7f5b780ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:35.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.973+0000 7f5b7ce80700 1 --2- 172.21.15.49:0/3372060238 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b781564f0 0x7f5b780c23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:35.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.973+0000 7f5b777fe700 1 -- 172.21.15.49:0/3372060238 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b781564f0 msgr2=0x7f5b780c23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:35.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.973+0000 7f5b777fe700 1 --2- 172.21.15.49:0/3372060238 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b781564f0 0x7f5b780c23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:35.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.973+0000 7f5b777fe700 1 -- 172.21.15.49:0/3372060238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b7814c1b0 msgr2=0x7f5b780ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:35.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.973+0000 7f5b777fe700 1 --2- 172.21.15.49:0/3372060238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b7814c1b0 0x7f5b780ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:35.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.973+0000 7f5b777fe700 1 -- 172.21.15.49:0/3372060238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b780acb30 con 0x7f5b7814c590 2023-11-30T18:41:35.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.973+0000 7f5b777fe700 1 --2- 172.21.15.49:0/3372060238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b7814c590 0x7f5b78156000 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 rx=0x7f5b600010e0 tx=0x7f5b60001df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:35.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.973+0000 7f5b6ffff700 1 -- 172.21.15.49:0/3372060238 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b60011590 con 0x7f5b7814c590 2023-11-30T18:41:35.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.973+0000 7f5b6ffff700 1 -- 172.21.15.49:0/3372060238 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b600116f0 con 0x7f5b7814c590 2023-11-30T18:41:35.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.973+0000 7f5b7e8e3700 1 -- 172.21.15.49:0/3372060238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b780ace10 con 0x7f5b7814c590 2023-11-30T18:41:35.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.973+0000 7f5b6ffff700 1 -- 172.21.15.49:0/3372060238 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b60011ab0 con 0x7f5b7814c590 2023-11-30T18:41:35.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.973+0000 7f5b7e8e3700 1 -- 172.21.15.49:0/3372060238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b780ae730 con 0x7f5b7814c590 2023-11-30T18:41:35.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.974+0000 7f5b7e8e3700 1 -- 172.21.15.49:0/3372060238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b780ad5d0 con 0x7f5b7814c590 2023-11-30T18:41:35.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.975+0000 7f5b6ffff700 1 -- 172.21.15.49:0/3372060238 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 102) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f5b6001d3b0 con 0x7f5b7814c590 2023-11-30T18:41:35.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.975+0000 7f5b6ffff700 1 --2- 172.21.15.49:0/3372060238 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5b5805f080 0x7f5b58061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:35.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.975+0000 7f5b6ffff700 1 -- 172.21.15.49:0/3372060238 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(220..220 src has 1..220) v4 ==== 6491+0+0 (secure 0 0 0) 0x7f5b60079b80 con 0x7f5b7814c590 2023-11-30T18:41:35.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.975+0000 7f5b77fff700 1 --2- 172.21.15.49:0/3372060238 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5b5805f080 0x7f5b58061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:35.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.976+0000 7f5b77fff700 1 --2- 172.21.15.49:0/3372060238 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5b5805f080 0x7f5b58061540 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f5b68006d80 tx=0x7f5b68009060).ready entity=mgr.8315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:35.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:35.979+0000 7f5b6ffff700 1 -- 172.21.15.49:0/3372060238 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5b6004ad40 con 0x7f5b7814c590 2023-11-30T18:41:36.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.199+0000 7f5b7e8e3700 1 -- 172.21.15.49:0/3372060238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f5b780ae8c0 con 0x7f5b7814c590 2023-11-30T18:41:36.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.635+0000 7f5b6ffff700 1 -- 172.21.15.49:0/3372060238 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 103) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f5b600778a0 con 0x7f5b7814c590 2023-11-30T18:41:36.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.636+0000 7f5b6ffff700 1 -- 172.21.15.49:0/3372060238 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v103) v1 ==== 93+0+0 (secure 0 0 0) 0x7f5b60072b50 con 0x7f5b7814c590 2023-11-30T18:41:36.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.639+0000 7f5b7e8e3700 1 -- 172.21.15.49:0/3372060238 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5b5805f080 msgr2=0x7f5b58061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:36.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.639+0000 7f5b7e8e3700 1 --2- 172.21.15.49:0/3372060238 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5b5805f080 0x7f5b58061540 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f5b68006d80 tx=0x7f5b68009060).stop 2023-11-30T18:41:36.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.639+0000 7f5b7e8e3700 1 -- 172.21.15.49:0/3372060238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b7814c590 msgr2=0x7f5b78156000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:36.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.639+0000 7f5b7e8e3700 1 --2- 172.21.15.49:0/3372060238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b7814c590 0x7f5b78156000 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 rx=0x7f5b600010e0 tx=0x7f5b60001df0).stop 2023-11-30T18:41:36.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.639+0000 7f5b7e8e3700 1 -- 172.21.15.49:0/3372060238 shutdown_connections 2023-11-30T18:41:36.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.639+0000 7f5b7e8e3700 1 --2- 172.21.15.49:0/3372060238 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f5b5805f080 0x7f5b58061540 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:36.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.639+0000 7f5b7e8e3700 1 --2- 172.21.15.49:0/3372060238 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b781564f0 0x7f5b780c23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:36.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.639+0000 7f5b7e8e3700 1 --2- 172.21.15.49:0/3372060238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b7814c1b0 0x7f5b780ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:36.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.639+0000 7f5b7e8e3700 1 --2- 172.21.15.49:0/3372060238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b7814c590 0x7f5b78156000 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:36.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.639+0000 7f5b7e8e3700 1 -- 172.21.15.49:0/3372060238 >> 172.21.15.49:0/3372060238 conn(0x7f5b780cb310 msgr2=0x7f5b78154360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:36.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.639+0000 7f5b7e8e3700 1 -- 172.21.15.49:0/3372060238 shutdown_connections 2023-11-30T18:41:36.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.639+0000 7f5b7e8e3700 1 -- 172.21.15.49:0/3372060238 wait complete. 2023-11-30T18:41:36.654 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-30T18:41:36.654 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T18:41:36.698 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-30T18:41:36.732 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-30T18:41:36.732 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-30T18:41:36.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-30T18:41:36.733 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-30T18:41:36.779 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-11-30T18:41:36.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:41:36.779 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-30T18:41:36.782 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:36.780+0000 7f8db809f680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T18:41:36.789 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:36.787+0000 7f5c5f1f9680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T18:41:36.798 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:41:36.848 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:36.846+0000 7f8db809f680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T18:41:36.851 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:36.850+0000 7f5c5f1f9680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T18:41:36.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.958+0000 7ff3ce258700 1 Processor -- start 2023-11-30T18:41:36.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.958+0000 7ff3ce258700 1 -- start start 2023-11-30T18:41:36.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.959+0000 7ff3ce258700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff3c8157660 0x7ff3c8157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:36.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.959+0000 7ff3ce258700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3c80c0180 0x7ff3c81589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:36.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.959+0000 7ff3ce258700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c80c12c0 con 0x7ff3c80c1750 2023-11-30T18:41:36.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.959+0000 7ff3ce258700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c80c06b0 con 0x7ff3c8157660 2023-11-30T18:41:36.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.959+0000 7ff3ce258700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c80c0990 con 0x7ff3c80c0180 2023-11-30T18:41:36.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.959+0000 7ff3cd256700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff3c8157660 0x7ff3c8157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:36.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.959+0000 7ff3cd256700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff3c8157660 0x7ff3c8157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34544/0 (socket says 172.21.15.49:34544) 2023-11-30T18:41:36.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.959+0000 7ff3cd256700 1 -- 172.21.15.49:0/596127625 learned_addr learned my addr 172.21.15.49:0/596127625 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:36.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.959+0000 7ff3cca55700 1 --2- 172.21.15.49:0/596127625 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3c80c0180 0x7ff3c81589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:36.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.959+0000 7ff3cd256700 1 -- 172.21.15.49:0/596127625 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3c80c0180 msgr2=0x7ff3c81589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:36.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.959+0000 7ff3cd256700 1 --2- 172.21.15.49:0/596127625 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3c80c0180 0x7ff3c81589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:36.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.959+0000 7ff3cd256700 1 -- 172.21.15.49:0/596127625 >> v1:172.21.15.115:6789/0 conn(0x7ff3c80c1750 legacy=0x7ff3c80648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:36.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.959+0000 7ff3bffff700 1 -- 172.21.15.49:0/596127625 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4071843228 0 0) 0x7ff3c80c12c0 con 0x7ff3c80c1750 2023-11-30T18:41:36.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.959+0000 7ff3cd256700 1 -- 172.21.15.49:0/596127625 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c80c0c70 con 0x7ff3c8157660 2023-11-30T18:41:36.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.960+0000 7ff3cd256700 1 --2- 172.21.15.49:0/596127625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3c8157660 0x7ff3c8157a40 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 rx=0x7ff3c4006fd0 tx=0x7ff3c40090f0).ready entity=mon.0 client_cookie=93d60eb345687d93 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:36.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.960+0000 7ff3bffff700 1 -- 172.21.15.49:0/596127625 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c400b580 con 0x7ff3c8157660 2023-11-30T18:41:36.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.960+0000 7ff3bffff700 1 -- 172.21.15.49:0/596127625 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c400b6e0 con 0x7ff3c8157660 2023-11-30T18:41:36.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.960+0000 7ff3bffff700 1 -- 172.21.15.49:0/596127625 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c400ba60 con 0x7ff3c8157660 2023-11-30T18:41:36.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.960+0000 7ff3ce258700 1 -- 172.21.15.49:0/596127625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3c8157660 msgr2=0x7ff3c8157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:36.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.960+0000 7ff3ce258700 1 --2- 172.21.15.49:0/596127625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3c8157660 0x7ff3c8157a40 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 rx=0x7ff3c4006fd0 tx=0x7ff3c40090f0).stop 2023-11-30T18:41:36.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.960+0000 7ff3ce258700 1 -- 172.21.15.49:0/596127625 shutdown_connections 2023-11-30T18:41:36.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.960+0000 7ff3ce258700 1 --2- 172.21.15.49:0/596127625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3c8157660 0x7ff3c8157a40 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:36.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.960+0000 7ff3ce258700 1 --2- 172.21.15.49:0/596127625 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3c80c0180 0x7ff3c81589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:36.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.960+0000 7ff3ce258700 1 -- 172.21.15.49:0/596127625 >> 172.21.15.49:0/596127625 conn(0x7ff3c80cb000 msgr2=0x7ff3c80cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:36.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.960+0000 7ff3ce258700 1 -- 172.21.15.49:0/596127625 shutdown_connections 2023-11-30T18:41:36.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.960+0000 7ff3ce258700 1 -- 172.21.15.49:0/596127625 wait complete. 2023-11-30T18:41:36.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.962+0000 7ff3ce258700 1 Processor -- start 2023-11-30T18:41:36.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.962+0000 7ff3ce258700 1 -- start start 2023-11-30T18:41:36.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.962+0000 7ff3ce258700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3c80c0180 0x7ff3c8155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:36.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.962+0000 7ff3ce258700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3c80c1750 0x7ff3c80adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:36.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.962+0000 7ff3ce258700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3c8157660 0x7ff3c80ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:36.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.962+0000 7ff3ce258700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c8155c70 con 0x7ff3c80c1750 2023-11-30T18:41:36.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.962+0000 7ff3ce258700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c8155f50 con 0x7ff3c8157660 2023-11-30T18:41:36.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.962+0000 7ff3ce258700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c8156230 con 0x7ff3c80c0180 2023-11-30T18:41:36.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.963+0000 7ff3cca55700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3c80c1750 0x7ff3c80adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:36.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.963+0000 7ff3cca55700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3c80c1750 0x7ff3c80adfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34554/0 (socket says 172.21.15.49:34554) 2023-11-30T18:41:36.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.963+0000 7ff3cca55700 1 -- 172.21.15.49:0/766731217 learned_addr learned my addr 172.21.15.49:0/766731217 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:36.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.963+0000 7ff3cd256700 1 --2- 172.21.15.49:0/766731217 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3c80c0180 0x7ff3c8155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:36.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.963+0000 7ff3cda57700 1 --2- 172.21.15.49:0/766731217 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3c8157660 0x7ff3c80ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:36.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.963+0000 7ff3cca55700 1 -- 172.21.15.49:0/766731217 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3c80c0180 msgr2=0x7ff3c8155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:36.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.963+0000 7ff3cca55700 1 --2- 172.21.15.49:0/766731217 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3c80c0180 0x7ff3c8155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:36.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.963+0000 7ff3cca55700 1 -- 172.21.15.49:0/766731217 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3c8157660 msgr2=0x7ff3c80ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:36.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.963+0000 7ff3cca55700 1 --2- 172.21.15.49:0/766731217 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3c8157660 0x7ff3c80ae4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:36.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.963+0000 7ff3cca55700 1 -- 172.21.15.49:0/766731217 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c4009370 con 0x7ff3c80c1750 2023-11-30T18:41:36.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.963+0000 7ff3cda57700 1 --2- 172.21.15.49:0/766731217 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3c8157660 0x7ff3c80ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:41:36.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.963+0000 7ff3cd256700 1 --2- 172.21.15.49:0/766731217 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3c80c0180 0x7ff3c8155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:41:36.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.963+0000 7ff3cca55700 1 --2- 172.21.15.49:0/766731217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3c80c1750 0x7ff3c80adfb0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 rx=0x7ff3b800e900 tx=0x7ff3b8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:36.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.963+0000 7ff3bd7fa700 1 -- 172.21.15.49:0/766731217 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8012600 con 0x7ff3c80c1750 2023-11-30T18:41:36.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.963+0000 7ff3bd7fa700 1 -- 172.21.15.49:0/766731217 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b8012760 con 0x7ff3c80c1750 2023-11-30T18:41:36.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.963+0000 7ff3bd7fa700 1 -- 172.21.15.49:0/766731217 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8012ae0 con 0x7ff3c80c1750 2023-11-30T18:41:36.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.963+0000 7ff3ce258700 1 -- 172.21.15.49:0/766731217 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c8156510 con 0x7ff3c80c1750 2023-11-30T18:41:36.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.963+0000 7ff3ce258700 1 -- 172.21.15.49:0/766731217 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c8156d10 con 0x7ff3c80c1750 2023-11-30T18:41:36.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.965+0000 7ff3bd7fa700 1 -- 172.21.15.49:0/766731217 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 103) v1 ==== 75605+0+0 (secure 0 0 0) 0x7ff3b801b400 con 0x7ff3c80c1750 2023-11-30T18:41:36.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.965+0000 7ff3ce258700 1 -- 172.21.15.49:0/766731217 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c806c7c0 con 0x7ff3c80c1750 2023-11-30T18:41:36.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.965+0000 7ff3bd7fa700 1 --2- 172.21.15.49:0/766731217 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff3ac05f300 0x7ff3ac0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:36.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.965+0000 7ff3bd7fa700 1 -- 172.21.15.49:0/766731217 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(220..220 src has 1..220) v4 ==== 6491+0+0 (secure 0 0 0) 0x7ff3b807aac0 con 0x7ff3c80c1750 2023-11-30T18:41:36.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.965+0000 7ff3cd256700 1 -- 172.21.15.49:0/766731217 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff3ac05f300 msgr2=0x7ff3ac0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:36.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.965+0000 7ff3cd256700 1 --2- 172.21.15.49:0/766731217 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff3ac05f300 0x7ff3ac0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:41:36.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:36.970+0000 7ff3bd7fa700 1 -- 172.21.15.49:0/766731217 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff3b804ba20 con 0x7ff3c80c1750 2023-11-30T18:41:37.127 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:37.125+0000 7f5c5f1f9680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T18:41:37.159 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:37.157+0000 7f8db809f680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T18:41:37.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.166+0000 7ff3cd256700 1 -- 172.21.15.49:0/766731217 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff3ac05f300 msgr2=0x7ff3ac0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:37.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.166+0000 7ff3cd256700 1 --2- 172.21.15.49:0/766731217 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff3ac05f300 0x7ff3ac0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T18:41:37.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.207+0000 7ff3ce258700 1 -- 172.21.15.49:0/766731217 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3c80c0f50 con 0x7ff3c80c1750 2023-11-30T18:41:37.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.208+0000 7ff3bd7fa700 1 -- 172.21.15.49:0/766731217 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4499 (secure 0 0 0) 0x7ff3b8016090 con 0x7ff3c80c1750 2023-11-30T18:41:37.210 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:37.210 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":93,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8219,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3124035021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3124035021},{"type":"v1","addr":"172.21.15.115:6837","nonce":3124035021}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":9565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2947558957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2947558957},{"type":"v1","addr":"172.21.15.115:6836","nonce":2947558957}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":9996,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1999244219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1999244219},{"type":"v1","addr":"172.21.15.49:6834","nonce":1999244219}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T18:41:21.351721+0000","modified":"2023-11-30T18:41:24.361310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9999":{"gid":9999,"name":"a","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1129424322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1129424322},{"type":"v1","addr":"172.21.15.49:6835","nonce":1129424322}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-11-30T18:41:37.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.210+0000 7ff3ce258700 1 -- 172.21.15.49:0/766731217 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff3ac05f300 msgr2=0x7ff3ac0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:41:37.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.210+0000 7ff3ce258700 1 --2- 172.21.15.49:0/766731217 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff3ac05f300 0x7ff3ac0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:37.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.210+0000 7ff3ce258700 1 -- 172.21.15.49:0/766731217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3c80c1750 msgr2=0x7ff3c80adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:37.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.210+0000 7ff3ce258700 1 --2- 172.21.15.49:0/766731217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3c80c1750 0x7ff3c80adfb0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 rx=0x7ff3b800e900 tx=0x7ff3b8009060).stop 2023-11-30T18:41:37.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.210+0000 7ff3ce258700 1 -- 172.21.15.49:0/766731217 shutdown_connections 2023-11-30T18:41:37.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.210+0000 7ff3ce258700 1 --2- 172.21.15.49:0/766731217 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7ff3ac05f300 0x7ff3ac0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:37.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.210+0000 7ff3ce258700 1 --2- 172.21.15.49:0/766731217 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3c8157660 0x7ff3c80ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:37.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.210+0000 7ff3ce258700 1 --2- 172.21.15.49:0/766731217 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3c80c0180 0x7ff3c8155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:37.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.210+0000 7ff3ce258700 1 --2- 172.21.15.49:0/766731217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3c80c1750 0x7ff3c80adfb0 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:37.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.210+0000 7ff3ce258700 1 -- 172.21.15.49:0/766731217 >> 172.21.15.49:0/766731217 conn(0x7ff3c80cb000 msgr2=0x7ff3c80abb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:37.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.210+0000 7ff3ce258700 1 -- 172.21.15.49:0/766731217 shutdown_connections 2023-11-30T18:41:37.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.210+0000 7ff3ce258700 1 -- 172.21.15.49:0/766731217 wait complete. 2023-11-30T18:41:37.213 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 93 2023-11-30T18:41:37.224 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:41:37.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.385+0000 7f35485f3700 1 Processor -- start 2023-11-30T18:41:37.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.386+0000 7f35485f3700 1 -- start start 2023-11-30T18:41:37.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.387+0000 7f35485f3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35401520c0 0x7f3540066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:37.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.387+0000 7f35485f3700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3540068150 0x7f3540066a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:37.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.387+0000 7f35485f3700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35400be110 con 0x7f35401524a0 2023-11-30T18:41:37.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.387+0000 7f35485f3700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3540066fc0 con 0x7f3540068150 2023-11-30T18:41:37.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.387+0000 7f35485f3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35400672a0 con 0x7f35401520c0 2023-11-30T18:41:37.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.387+0000 7f3545b8e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f35401524a0 0x7f3540067a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36616/0 (socket says 172.21.15.49:36616) 2023-11-30T18:41:37.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.387+0000 7f3545b8e700 1 -- 172.21.15.49:0/1100178281 learned_addr learned my addr 172.21.15.49:0/1100178281 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:37.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.387+0000 7f3546b90700 1 --2- 172.21.15.49:0/1100178281 >> v2:172.21.15.115:3300/0 conn(0x7f3540068150 0x7f3540066a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:37.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.387+0000 7f354638f700 1 --2- 172.21.15.49:0/1100178281 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35401520c0 0x7f3540066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:37.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.387+0000 7f354538d700 1 -- 172.21.15.49:0/1100178281 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1333431823 0 0) 0x7f35400be110 con 0x7f35401524a0 2023-11-30T18:41:37.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.387+0000 7f354538d700 1 -- 172.21.15.49:0/1100178281 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f352c0033f0 con 0x7f35401524a0 2023-11-30T18:41:37.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.387+0000 7f3546b90700 1 -- 172.21.15.49:0/1100178281 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35401520c0 msgr2=0x7f3540066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:37.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.387+0000 7f3546b90700 1 --2- 172.21.15.49:0/1100178281 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35401520c0 0x7f3540066520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:37.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.387+0000 7f3546b90700 1 -- 172.21.15.49:0/1100178281 >> v1:172.21.15.49:6789/0 conn(0x7f35401524a0 legacy=0x7f3540067a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:37.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.387+0000 7f3546b90700 1 -- 172.21.15.49:0/1100178281 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35400be380 con 0x7f3540068150 2023-11-30T18:41:37.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.387+0000 7f354638f700 1 --2- 172.21.15.49:0/1100178281 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35401520c0 0x7f3540066520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:41:37.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.387+0000 7f3546b90700 1 --2- 172.21.15.49:0/1100178281 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3540068150 0x7f3540066a10 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f3538009e60 tx=0x7f3538009780).ready entity=mon.1 client_cookie=455920a027769bfb server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:37.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.388+0000 7f354538d700 1 -- 172.21.15.49:0/1100178281 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353800e070 con 0x7f3540068150 2023-11-30T18:41:37.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.388+0000 7f354538d700 1 -- 172.21.15.49:0/1100178281 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353800bab0 con 0x7f3540068150 2023-11-30T18:41:37.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.388+0000 7f354538d700 1 -- 172.21.15.49:0/1100178281 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353800be30 con 0x7f3540068150 2023-11-30T18:41:37.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.388+0000 7f35485f3700 1 -- 172.21.15.49:0/1100178281 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3540068150 msgr2=0x7f3540066a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:37.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.388+0000 7f35485f3700 1 --2- 172.21.15.49:0/1100178281 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3540068150 0x7f3540066a10 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f3538009e60 tx=0x7f3538009780).stop 2023-11-30T18:41:37.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.388+0000 7f35485f3700 1 -- 172.21.15.49:0/1100178281 shutdown_connections 2023-11-30T18:41:37.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.388+0000 7f35485f3700 1 --2- 172.21.15.49:0/1100178281 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3540068150 0x7f3540066a10 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:37.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.388+0000 7f35485f3700 1 --2- 172.21.15.49:0/1100178281 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35401520c0 0x7f3540066520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:37.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.388+0000 7f35485f3700 1 -- 172.21.15.49:0/1100178281 >> 172.21.15.49:0/1100178281 conn(0x7f35400631d0 msgr2=0x7f35400c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:37.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.388+0000 7f35485f3700 1 -- 172.21.15.49:0/1100178281 shutdown_connections 2023-11-30T18:41:37.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.388+0000 7f35485f3700 1 -- 172.21.15.49:0/1100178281 wait complete. 2023-11-30T18:41:37.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.389+0000 7f35485f3700 1 Processor -- start 2023-11-30T18:41:37.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.390+0000 7f35485f3700 1 -- start start 2023-11-30T18:41:37.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.390+0000 7f35485f3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3540068150 0x7f354014a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:37.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.390+0000 7f35485f3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35401520c0 0x7f35400c13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:37.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.390+0000 7f35485f3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35401524a0 0x7f35400c18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:37.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.390+0000 7f35485f3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35400c1dd0 con 0x7f35401520c0 2023-11-30T18:41:37.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.390+0000 7f35485f3700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35400c2be0 con 0x7f3540068150 2023-11-30T18:41:37.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.390+0000 7f35485f3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35400c1fd0 con 0x7f35401524a0 2023-11-30T18:41:37.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.390+0000 7f3545b8e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35401520c0 0x7f35400c13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:37.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.390+0000 7f3545b8e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35401520c0 0x7f35400c13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34564/0 (socket says 172.21.15.49:34564) 2023-11-30T18:41:37.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.390+0000 7f3545b8e700 1 -- 172.21.15.49:0/1643690503 learned_addr learned my addr 172.21.15.49:0/1643690503 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:37.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.390+0000 7f354638f700 1 --2- 172.21.15.49:0/1643690503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3540068150 0x7f354014a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:37.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.391+0000 7f3546b90700 1 --2- 172.21.15.49:0/1643690503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35401524a0 0x7f35400c18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:37.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.391+0000 7f3545b8e700 1 -- 172.21.15.49:0/1643690503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35401524a0 msgr2=0x7f35400c18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:37.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.391+0000 7f3545b8e700 1 --2- 172.21.15.49:0/1643690503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35401524a0 0x7f35400c18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:37.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.391+0000 7f3545b8e700 1 -- 172.21.15.49:0/1643690503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3540068150 msgr2=0x7f354014a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:37.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.391+0000 7f3545b8e700 1 --2- 172.21.15.49:0/1643690503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3540068150 0x7f354014a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:37.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.391+0000 7f3545b8e700 1 -- 172.21.15.49:0/1643690503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3530009250 con 0x7f35401520c0 2023-11-30T18:41:37.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.391+0000 7f354638f700 1 --2- 172.21.15.49:0/1643690503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3540068150 0x7f354014a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:41:37.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.391+0000 7f3545b8e700 1 --2- 172.21.15.49:0/1643690503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35401520c0 0x7f35400c13f0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 rx=0x7f353c00c450 tx=0x7f353c007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:37.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.391+0000 7f35367fc700 1 -- 172.21.15.49:0/1643690503 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c0070d0 con 0x7f35401520c0 2023-11-30T18:41:37.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.391+0000 7f35367fc700 1 -- 172.21.15.49:0/1643690503 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353c007230 con 0x7f35401520c0 2023-11-30T18:41:37.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.391+0000 7f35485f3700 1 -- 172.21.15.49:0/1643690503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3538009a20 con 0x7f35401520c0 2023-11-30T18:41:37.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.391+0000 7f35367fc700 1 -- 172.21.15.49:0/1643690503 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c0075f0 con 0x7f35401520c0 2023-11-30T18:41:37.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.391+0000 7f35485f3700 1 -- 172.21.15.49:0/1643690503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35400c2590 con 0x7f35401520c0 2023-11-30T18:41:37.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.392+0000 7f35485f3700 1 -- 172.21.15.49:0/1643690503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35400c2d70 con 0x7f35401520c0 2023-11-30T18:41:37.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.393+0000 7f35367fc700 1 -- 172.21.15.49:0/1643690503 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 103) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f353c0059b0 con 0x7f35401520c0 2023-11-30T18:41:37.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.393+0000 7f35367fc700 1 --2- 172.21.15.49:0/1643690503 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f352405f2d0 0x7f3524061790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:37.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.393+0000 7f35367fc700 1 -- 172.21.15.49:0/1643690503 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(220..220 src has 1..220) v4 ==== 6491+0+0 (secure 0 0 0) 0x7f353c079c90 con 0x7f35401520c0 2023-11-30T18:41:37.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.393+0000 7f354638f700 1 -- 172.21.15.49:0/1643690503 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f352405f2d0 msgr2=0x7f3524061790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:37.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.393+0000 7f354638f700 1 --2- 172.21.15.49:0/1643690503 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f352405f2d0 0x7f3524061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:41:37.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.397+0000 7f35367fc700 1 -- 172.21.15.49:0/1643690503 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f353c04abf0 con 0x7f35401520c0 2023-11-30T18:41:37.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.581+0000 7f35485f3700 1 -- 172.21.15.49:0/1643690503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f354006c860 con 0x7f35401520c0 2023-11-30T18:41:37.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.582+0000 7f35367fc700 1 -- 172.21.15.49:0/1643690503 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v220) v1 ==== 74+0+17495 (secure 0 0 0) 0x7f353c007d90 con 0x7f35401520c0 2023-11-30T18:41:37.584 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:37.584 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":220,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:41:33.621384+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"208","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-11-30T18:41:19.292113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"218","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-11-30T18:41:20.340870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"219","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/1773998477":"2023-12-01T18:41:33.621332+0000","172.21.15.115:6833/103051":"2023-12-01T18:41:33.621332+0000","172.21.15.115:6832/103051":"2023-12-01T18:41:33.621332+0000","172.21.15.115:0/3037216069":"2023-12-01T18:41:33.621332+0000","172.21.15.115:0/467841810":"2023-12-01T18:41:33.621332+0000","172.21.15.115:0/107175683":"2023-12-01T18:41:33.621332+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:41:37.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.584+0000 7f35485f3700 1 -- 172.21.15.49:0/1643690503 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f352405f2d0 msgr2=0x7f3524061790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:41:37.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.584+0000 7f35485f3700 1 --2- 172.21.15.49:0/1643690503 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f352405f2d0 0x7f3524061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:37.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.584+0000 7f35485f3700 1 -- 172.21.15.49:0/1643690503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35401520c0 msgr2=0x7f35400c13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:37.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.584+0000 7f35485f3700 1 --2- 172.21.15.49:0/1643690503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35401520c0 0x7f35400c13f0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 rx=0x7f353c00c450 tx=0x7f353c007c50).stop 2023-11-30T18:41:37.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.584+0000 7f35485f3700 1 -- 172.21.15.49:0/1643690503 shutdown_connections 2023-11-30T18:41:37.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.584+0000 7f35485f3700 1 --2- 172.21.15.49:0/1643690503 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f352405f2d0 0x7f3524061790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:37.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.584+0000 7f35485f3700 1 --2- 172.21.15.49:0/1643690503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35401524a0 0x7f35400c18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:37.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.584+0000 7f35485f3700 1 --2- 172.21.15.49:0/1643690503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3540068150 0x7f354014a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:37.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.584+0000 7f35485f3700 1 --2- 172.21.15.49:0/1643690503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35401520c0 0x7f35400c13f0 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:37.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.584+0000 7f35485f3700 1 -- 172.21.15.49:0/1643690503 >> 172.21.15.49:0/1643690503 conn(0x7f35400631d0 msgr2=0x7f35400a5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:37.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.584+0000 7f35485f3700 1 -- 172.21.15.49:0/1643690503 shutdown_connections 2023-11-30T18:41:37.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.584+0000 7f35485f3700 1 -- 172.21.15.49:0/1643690503 wait complete. 2023-11-30T18:41:37.599 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-30T17:07:07.896608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '208', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-30T17:07:09.972752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-30T18:41:19.292113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '218', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2023-11-30T18:41:20.340870+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '219', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-30T18:41:37.599 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-30T18:41:37.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.721+0000 7f4df090e700 1 Processor -- start 2023-11-30T18:41:37.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.721+0000 7f4df090e700 1 -- start start 2023-11-30T18:41:37.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.722+0000 7f4df090e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4dec1510d0 0x7f4dec0a6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:37.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.722+0000 7f4df090e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4dec1514b0 0x7f4dec0c37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:37.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.722+0000 7f4df090e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4dec0bcea0 0x7f4dec0bd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:37.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.722+0000 7f4df090e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dec063b40 con 0x7f4dec1514b0 2023-11-30T18:41:37.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.722+0000 7f4df090e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dec0c2ce0 con 0x7f4dec0bcea0 2023-11-30T18:41:37.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.722+0000 7f4df090e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec0c2fc0 con 0x7f4dec1510d0 2023-11-30T18:41:37.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.722+0000 7f4dea59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4dec1514b0 0x7f4dec0c37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:37.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.722+0000 7f4dea59c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4dec1514b0 0x7f4dec0c37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34572/0 (socket says 172.21.15.49:34572) 2023-11-30T18:41:37.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.722+0000 7f4dea59c700 1 -- 172.21.15.49:0/684390529 learned_addr learned my addr 172.21.15.49:0/684390529 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:37.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.722+0000 7f4deb59e700 1 --2- 172.21.15.49:0/684390529 >> v2:172.21.15.115:3300/0 conn(0x7f4dec0bcea0 0x7f4dec0bd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:37.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.722+0000 7f4dead9d700 1 --2- 172.21.15.49:0/684390529 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4dec1510d0 0x7f4dec0a6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:37.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.722+0000 7f4dea59c700 1 -- 172.21.15.49:0/684390529 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4dec1510d0 msgr2=0x7f4dec0a6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:37.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.722+0000 7f4dea59c700 1 --2- 172.21.15.49:0/684390529 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4dec1510d0 0x7f4dec0a6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:37.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.722+0000 7f4dea59c700 1 -- 172.21.15.49:0/684390529 >> v2:172.21.15.115:3300/0 conn(0x7f4dec0bcea0 msgr2=0x7f4dec0bd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:37.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.722+0000 7f4dea59c700 1 --2- 172.21.15.49:0/684390529 >> v2:172.21.15.115:3300/0 conn(0x7f4dec0bcea0 0x7f4dec0bd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:37.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.722+0000 7f4dea59c700 1 -- 172.21.15.49:0/684390529 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dec0c32a0 con 0x7f4dec1514b0 2023-11-30T18:41:37.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.722+0000 7f4dead9d700 1 --2- 172.21.15.49:0/684390529 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4dec1510d0 0x7f4dec0a6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:41:37.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.722+0000 7f4dea59c700 1 --2- 172.21.15.49:0/684390529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dec1514b0 0x7f4dec0c37c0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 rx=0x7f4de0006fd0 tx=0x7f4de00090f0).ready entity=mon.0 client_cookie=8391da402ada2900 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:37.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.723+0000 7f4de9d9b700 1 -- 172.21.15.49:0/684390529 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de000b520 con 0x7f4dec1514b0 2023-11-30T18:41:37.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.723+0000 7f4de9d9b700 1 -- 172.21.15.49:0/684390529 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de000b680 con 0x7f4dec1514b0 2023-11-30T18:41:37.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.723+0000 7f4de9d9b700 1 -- 172.21.15.49:0/684390529 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de000ba00 con 0x7f4dec1514b0 2023-11-30T18:41:37.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.723+0000 7f4df090e700 1 -- 172.21.15.49:0/684390529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dec1514b0 msgr2=0x7f4dec0c37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:37.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.723+0000 7f4df090e700 1 --2- 172.21.15.49:0/684390529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dec1514b0 0x7f4dec0c37c0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 rx=0x7f4de0006fd0 tx=0x7f4de00090f0).stop 2023-11-30T18:41:37.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.723+0000 7f4df090e700 1 -- 172.21.15.49:0/684390529 shutdown_connections 2023-11-30T18:41:37.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.723+0000 7f4df090e700 1 --2- 172.21.15.49:0/684390529 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4dec1510d0 0x7f4dec0a6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:37.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.723+0000 7f4df090e700 1 --2- 172.21.15.49:0/684390529 >> v2:172.21.15.115:3300/0 conn(0x7f4dec0bcea0 0x7f4dec0bd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:37.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.723+0000 7f4df090e700 1 --2- 172.21.15.49:0/684390529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dec1514b0 0x7f4dec0c37c0 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:37.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.723+0000 7f4df090e700 1 -- 172.21.15.49:0/684390529 >> 172.21.15.49:0/684390529 conn(0x7f4dec0c4010 msgr2=0x7f4dec0c4420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:37.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.723+0000 7f4df090e700 1 -- 172.21.15.49:0/684390529 shutdown_connections 2023-11-30T18:41:37.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.723+0000 7f4df090e700 1 -- 172.21.15.49:0/684390529 wait complete. 2023-11-30T18:41:37.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.724+0000 7f4df090e700 1 Processor -- start 2023-11-30T18:41:37.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.725+0000 7f4df090e700 1 -- start start 2023-11-30T18:41:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.725+0000 7f4df090e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dec0bcea0 0x7f4dec0a7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.725+0000 7f4df090e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4dec1510d0 0x7f4dec0a9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.725+0000 7f4df090e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dec1514b0 0x7f4dec14a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.725+0000 7f4df090e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec0aa130 con 0x7f4dec0bcea0 2023-11-30T18:41:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.725+0000 7f4df090e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec153630 con 0x7f4dec1514b0 2023-11-30T18:41:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.725+0000 7f4df090e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec0a5e50 con 0x7f4dec1510d0 2023-11-30T18:41:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.725+0000 7f4dead9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dec0bcea0 0x7f4dec0a7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.725+0000 7f4dead9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dec0bcea0 0x7f4dec0a7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34574/0 (socket says 172.21.15.49:34574) 2023-11-30T18:41:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.725+0000 7f4dead9d700 1 -- 172.21.15.49:0/3518957543 learned_addr learned my addr 172.21.15.49:0/3518957543 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.725+0000 7f4dea59c700 1 --2- 172.21.15.49:0/3518957543 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4dec1510d0 0x7f4dec0a9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.726+0000 7f4deb59e700 1 --2- 172.21.15.49:0/3518957543 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dec1514b0 0x7f4dec14a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.726+0000 7f4dead9d700 1 -- 172.21.15.49:0/3518957543 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4dec1510d0 msgr2=0x7f4dec0a9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.726+0000 7f4dead9d700 1 --2- 172.21.15.49:0/3518957543 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4dec1510d0 0x7f4dec0a9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.726+0000 7f4dead9d700 1 -- 172.21.15.49:0/3518957543 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dec1514b0 msgr2=0x7f4dec14a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.726+0000 7f4dead9d700 1 --2- 172.21.15.49:0/3518957543 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dec1514b0 0x7f4dec14a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:37.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.726+0000 7f4dead9d700 1 -- 172.21.15.49:0/3518957543 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de0009370 con 0x7f4dec0bcea0 2023-11-30T18:41:37.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.726+0000 7f4dead9d700 1 --2- 172.21.15.49:0/3518957543 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dec0bcea0 0x7f4dec0a7050 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 rx=0x7f4ddc00d890 tx=0x7f4ddc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:37.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.726+0000 7f4dd2ffd700 1 -- 172.21.15.49:0/3518957543 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc011590 con 0x7f4dec0bcea0 2023-11-30T18:41:37.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.726+0000 7f4dd2ffd700 1 -- 172.21.15.49:0/3518957543 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ddc0116f0 con 0x7f4dec0bcea0 2023-11-30T18:41:37.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.726+0000 7f4dd2ffd700 1 -- 172.21.15.49:0/3518957543 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc011a70 con 0x7f4dec0bcea0 2023-11-30T18:41:37.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.726+0000 7f4df090e700 1 -- 172.21.15.49:0/3518957543 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dec0a6130 con 0x7f4dec0bcea0 2023-11-30T18:41:37.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.726+0000 7f4df090e700 1 -- 172.21.15.49:0/3518957543 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dec0a6410 con 0x7f4dec0bcea0 2023-11-30T18:41:37.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.727+0000 7f4df090e700 1 -- 172.21.15.49:0/3518957543 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dec153120 con 0x7f4dec0bcea0 2023-11-30T18:41:37.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.728+0000 7f4dd2ffd700 1 -- 172.21.15.49:0/3518957543 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 103) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f4ddc012420 con 0x7f4dec0bcea0 2023-11-30T18:41:37.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.728+0000 7f4dd2ffd700 1 --2- 172.21.15.49:0/3518957543 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4dd805f300 0x7f4dd80617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:37.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.728+0000 7f4dd2ffd700 1 -- 172.21.15.49:0/3518957543 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(220..220 src has 1..220) v4 ==== 6491+0+0 (secure 0 0 0) 0x7f4ddc079fe0 con 0x7f4dec0bcea0 2023-11-30T18:41:37.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.728+0000 7f4dea59c700 1 -- 172.21.15.49:0/3518957543 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4dd805f300 msgr2=0x7f4dd80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:37.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.728+0000 7f4dea59c700 1 --2- 172.21.15.49:0/3518957543 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4dd805f300 0x7f4dd80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:41:37.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.733+0000 7f4dd2ffd700 1 -- 172.21.15.49:0/3518957543 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4dec153120 con 0x7f4dec0bcea0 2023-11-30T18:41:37.742 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:37.740+0000 7f5c5f1f9680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T18:41:37.814 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:37.812+0000 7f5c5f1f9680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T18:41:37.856 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:37.854+0000 7f8db809f680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T18:41:37.925 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:37.923+0000 7f8db809f680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T18:41:37.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.929+0000 7f4dea59c700 1 -- 172.21.15.49:0/3518957543 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4dd805f300 msgr2=0x7f4dd80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:37.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.929+0000 7f4dea59c700 1 --2- 172.21.15.49:0/3518957543 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4dd805f300 0x7f4dd80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T18:41:37.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.951+0000 7f4df090e700 1 -- 172.21.15.49:0/3518957543 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4dec153120 con 0x7f4dec0bcea0 2023-11-30T18:41:37.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.951+0000 7f4dd2ffd700 1 -- 172.21.15.49:0/3518957543 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v220) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4dec153120 con 0x7f4dec0bcea0 2023-11-30T18:41:37.954 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-30T18:41:37.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.953+0000 7f4df090e700 1 -- 172.21.15.49:0/3518957543 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4dd805f300 msgr2=0x7f4dd80617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:41:37.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.953+0000 7f4df090e700 1 --2- 172.21.15.49:0/3518957543 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4dd805f300 0x7f4dd80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:37.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.953+0000 7f4df090e700 1 -- 172.21.15.49:0/3518957543 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dec0bcea0 msgr2=0x7f4dec0a7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:37.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.953+0000 7f4df090e700 1 --2- 172.21.15.49:0/3518957543 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dec0bcea0 0x7f4dec0a7050 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 rx=0x7f4ddc00d890 tx=0x7f4ddc008040).stop 2023-11-30T18:41:37.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.953+0000 7f4df090e700 1 -- 172.21.15.49:0/3518957543 shutdown_connections 2023-11-30T18:41:37.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.953+0000 7f4df090e700 1 --2- 172.21.15.49:0/3518957543 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4dd805f300 0x7f4dd80617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:37.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.953+0000 7f4df090e700 1 --2- 172.21.15.49:0/3518957543 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dec1514b0 0x7f4dec14a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:37.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.953+0000 7f4df090e700 1 --2- 172.21.15.49:0/3518957543 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dec0bcea0 0x7f4dec0a7050 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:37.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.953+0000 7f4df090e700 1 --2- 172.21.15.49:0/3518957543 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4dec1510d0 0x7f4dec0a9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:37.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.953+0000 7f4df090e700 1 -- 172.21.15.49:0/3518957543 >> 172.21.15.49:0/3518957543 conn(0x7f4dec0c4010 msgr2=0x7f4dec1460f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:37.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.953+0000 7f4df090e700 1 -- 172.21.15.49:0/3518957543 shutdown_connections 2023-11-30T18:41:37.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:37.953+0000 7f4df090e700 1 -- 172.21.15.49:0/3518957543 wait complete. 2023-11-30T18:41:37.968 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-30T18:41:38.000 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:37.998+0000 7f5c5f1f9680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T18:41:38.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.090+0000 7f8544a7b700 1 Processor -- start 2023-11-30T18:41:38.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.090+0000 7f8544a7b700 1 -- start start 2023-11-30T18:41:38.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.091+0000 7f8544a7b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8540098d10 0x7f85400c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:38.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.091+0000 7f8544a7b700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85400c72d0 con 0x7f8540158320 2023-11-30T18:41:38.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.091+0000 7f8544a7b700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8540064570 con 0x7f85400c6190 2023-11-30T18:41:38.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.091+0000 7f8544a7b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8540154bc0 con 0x7f8540098d10 2023-11-30T18:41:38.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.091+0000 7f853ed9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8540158320 0x7f85400a80f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36622/0 (socket says 172.21.15.49:36622) 2023-11-30T18:41:38.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.091+0000 7f853ed9d700 1 -- 172.21.15.49:0/2703157455 learned_addr learned my addr 172.21.15.49:0/2703157455 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:38.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.092+0000 7f853e59c700 1 --2- 172.21.15.49:0/2703157455 >> v2:172.21.15.115:3300/0 conn(0x7f8540098d10 0x7f85400c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:38.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.092+0000 7f853d59a700 1 -- 172.21.15.49:0/2703157455 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463488675 0 0) 0x7f85400c72d0 con 0x7f8540158320 2023-11-30T18:41:38.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.092+0000 7f853d59a700 1 -- 172.21.15.49:0/2703157455 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f852c0033f0 con 0x7f8540158320 2023-11-30T18:41:38.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.092+0000 7f853e59c700 1 -- 172.21.15.49:0/2703157455 >> v1:172.21.15.115:6789/0 conn(0x7f85400c6190 legacy=0x7f8540063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:38.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.092+0000 7f853d59a700 1 -- 172.21.15.49:0/2703157455 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3906785715 0 0) 0x7f8540064570 con 0x7f85400c6190 2023-11-30T18:41:38.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.092+0000 7f853e59c700 1 -- 172.21.15.49:0/2703157455 >> v1:172.21.15.49:6789/0 conn(0x7f8540158320 legacy=0x7f85400a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:38.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.092+0000 7f853e59c700 1 -- 172.21.15.49:0/2703157455 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85400c66c0 con 0x7f8540098d10 2023-11-30T18:41:38.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.092+0000 7f853e59c700 1 --2- 172.21.15.49:0/2703157455 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8540098d10 0x7f85400c7760 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f8528009760 tx=0x7f8528009060).ready entity=mon.1 client_cookie=fc5222c0f78aa3be server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:38.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.092+0000 7f853d59a700 1 -- 172.21.15.49:0/2703157455 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852800f510 con 0x7f8540098d10 2023-11-30T18:41:38.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.092+0000 7f853d59a700 1 -- 172.21.15.49:0/2703157455 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852800f670 con 0x7f8540098d10 2023-11-30T18:41:38.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.092+0000 7f853d59a700 1 -- 172.21.15.49:0/2703157455 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852800f9f0 con 0x7f8540098d10 2023-11-30T18:41:38.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.093+0000 7f8544a7b700 1 -- 172.21.15.49:0/2703157455 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8540098d10 msgr2=0x7f85400c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:38.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.093+0000 7f8544a7b700 1 --2- 172.21.15.49:0/2703157455 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8540098d10 0x7f85400c7760 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f8528009760 tx=0x7f8528009060).stop 2023-11-30T18:41:38.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.093+0000 7f8544a7b700 1 -- 172.21.15.49:0/2703157455 shutdown_connections 2023-11-30T18:41:38.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.093+0000 7f8544a7b700 1 --2- 172.21.15.49:0/2703157455 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8540098d10 0x7f85400c7760 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:38.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.093+0000 7f8544a7b700 1 -- 172.21.15.49:0/2703157455 >> 172.21.15.49:0/2703157455 conn(0x7f85400cb310 msgr2=0x7f85400cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:38.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.093+0000 7f8544a7b700 1 -- 172.21.15.49:0/2703157455 shutdown_connections 2023-11-30T18:41:38.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.093+0000 7f8544a7b700 1 -- 172.21.15.49:0/2703157455 wait complete. 2023-11-30T18:41:38.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.094+0000 7f8544a7b700 1 Processor -- start 2023-11-30T18:41:38.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.094+0000 7f8544a7b700 1 -- start start 2023-11-30T18:41:38.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.095+0000 7f8544a7b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8540098d10 0x7f85401488f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:38.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.095+0000 7f8544a7b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85400c6190 0x7f8540156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:38.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.095+0000 7f8544a7b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8540158320 0x7f8540157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:38.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.095+0000 7f8544a7b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85400b1380 con 0x7f85400c6190 2023-11-30T18:41:38.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.095+0000 7f8544a7b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85400c3fb0 con 0x7f8540098d10 2023-11-30T18:41:38.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.095+0000 7f8544a7b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8540155a10 con 0x7f8540158320 2023-11-30T18:41:38.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.095+0000 7f853dd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85400c6190 0x7f8540156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:38.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.095+0000 7f853e59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8540098d10 0x7f85401488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:38.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.095+0000 7f853dd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85400c6190 0x7f8540156f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34586/0 (socket says 172.21.15.49:34586) 2023-11-30T18:41:38.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.095+0000 7f853dd9b700 1 -- 172.21.15.49:0/992921419 learned_addr learned my addr 172.21.15.49:0/992921419 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:38.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.095+0000 7f853ed9d700 1 --2- 172.21.15.49:0/992921419 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8540158320 0x7f8540157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:38.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.095+0000 7f853dd9b700 1 -- 172.21.15.49:0/992921419 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8540158320 msgr2=0x7f8540157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:38.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.095+0000 7f853dd9b700 1 --2- 172.21.15.49:0/992921419 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8540158320 0x7f8540157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:38.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.095+0000 7f853dd9b700 1 -- 172.21.15.49:0/992921419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8540098d10 msgr2=0x7f85401488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:38.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.095+0000 7f853dd9b700 1 --2- 172.21.15.49:0/992921419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8540098d10 0x7f85401488f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:38.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.096+0000 7f853dd9b700 1 -- 172.21.15.49:0/992921419 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85280092a0 con 0x7f85400c6190 2023-11-30T18:41:38.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.096+0000 7f853e59c700 1 --2- 172.21.15.49:0/992921419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8540098d10 0x7f85401488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:41:38.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.096+0000 7f853ed9d700 1 --2- 172.21.15.49:0/992921419 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8540158320 0x7f8540157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:41:38.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.096+0000 7f853dd9b700 1 --2- 172.21.15.49:0/992921419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85400c6190 0x7f8540156f80 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 rx=0x7f8530001eb0 tx=0x7f8530007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:38.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.096+0000 7f85367fc700 1 -- 172.21.15.49:0/992921419 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853000ce30 con 0x7f85400c6190 2023-11-30T18:41:38.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.096+0000 7f85367fc700 1 -- 172.21.15.49:0/992921419 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853000f470 con 0x7f85400c6190 2023-11-30T18:41:38.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.096+0000 7f8544a7b700 1 -- 172.21.15.49:0/992921419 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8540155cf0 con 0x7f85400c6190 2023-11-30T18:41:38.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.096+0000 7f85367fc700 1 -- 172.21.15.49:0/992921419 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853000f830 con 0x7f85400c6190 2023-11-30T18:41:38.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.096+0000 7f8544a7b700 1 -- 172.21.15.49:0/992921419 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8540156780 con 0x7f85400c6190 2023-11-30T18:41:38.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.097+0000 7f8544a7b700 1 -- 172.21.15.49:0/992921419 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8540156dd0 con 0x7f85400c6190 2023-11-30T18:41:38.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.098+0000 7f85367fc700 1 -- 172.21.15.49:0/992921419 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 103) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f853000fba0 con 0x7f85400c6190 2023-11-30T18:41:38.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.098+0000 7f85367fc700 1 --2- 172.21.15.49:0/992921419 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f852005f2d0 0x7f8520061790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:38.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.098+0000 7f85367fc700 1 -- 172.21.15.49:0/992921419 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(220..220 src has 1..220) v4 ==== 6491+0+0 (secure 0 0 0) 0x7f8530079b10 con 0x7f85400c6190 2023-11-30T18:41:38.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.098+0000 7f853e59c700 1 -- 172.21.15.49:0/992921419 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f852005f2d0 msgr2=0x7f8520061790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:38.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.098+0000 7f853e59c700 1 --2- 172.21.15.49:0/992921419 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f852005f2d0 0x7f8520061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:41:38.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.103+0000 7f85367fc700 1 -- 172.21.15.49:0/992921419 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f853004aa70 con 0x7f85400c6190 2023-11-30T18:41:38.125 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:38.124+0000 7f8db809f680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T18:41:38.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.275+0000 7f8544a7b700 1 -- 172.21.15.49:0/992921419 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f854006c860 con 0x7f85400c6190 2023-11-30T18:41:38.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.275+0000 7f85367fc700 1 -- 172.21.15.49:0/992921419 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v220) v1 ==== 92+0+10 (secure 0 0 0) 0x7f853004e090 con 0x7f85400c6190 2023-11-30T18:41:38.277 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2023-11-30T18:41:38.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.277+0000 7f8544a7b700 1 -- 172.21.15.49:0/992921419 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f852005f2d0 msgr2=0x7f8520061790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:41:38.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.277+0000 7f8544a7b700 1 --2- 172.21.15.49:0/992921419 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f852005f2d0 0x7f8520061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:38.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.277+0000 7f8544a7b700 1 -- 172.21.15.49:0/992921419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85400c6190 msgr2=0x7f8540156f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:38.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.277+0000 7f8544a7b700 1 --2- 172.21.15.49:0/992921419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85400c6190 0x7f8540156f80 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 rx=0x7f8530001eb0 tx=0x7f8530007c40).stop 2023-11-30T18:41:38.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.277+0000 7f8544a7b700 1 -- 172.21.15.49:0/992921419 shutdown_connections 2023-11-30T18:41:38.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.277+0000 7f8544a7b700 1 --2- 172.21.15.49:0/992921419 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f852005f2d0 0x7f8520061790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:38.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.277+0000 7f8544a7b700 1 --2- 172.21.15.49:0/992921419 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8540158320 0x7f8540157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:38.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.277+0000 7f8544a7b700 1 --2- 172.21.15.49:0/992921419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8540098d10 0x7f85401488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:38.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.277+0000 7f8544a7b700 1 --2- 172.21.15.49:0/992921419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85400c6190 0x7f8540156f80 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:38.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.277+0000 7f8544a7b700 1 -- 172.21.15.49:0/992921419 >> 172.21.15.49:0/992921419 conn(0x7f85400cb310 msgr2=0x7f85400ca400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:38.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.277+0000 7f8544a7b700 1 -- 172.21.15.49:0/992921419 shutdown_connections 2023-11-30T18:41:38.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.277+0000 7f8544a7b700 1 -- 172.21.15.49:0/992921419 wait complete. 2023-11-30T18:41:38.292 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-30T18:41:38.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.415+0000 7fcb9da63700 1 Processor -- start 2023-11-30T18:41:38.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.415+0000 7fcb9da63700 1 -- start start 2023-11-30T18:41:38.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.416+0000 7fcb9da63700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcb980c86f0 0x7fcb980a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:38.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.416+0000 7fcb9da63700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcb98062700 0x7fcb98062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:38.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.416+0000 7fcb9da63700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb980630a0 con 0x7fcb981547f0 2023-11-30T18:41:38.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.416+0000 7fcb9da63700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb980c7e30 con 0x7fcb98062700 2023-11-30T18:41:38.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.416+0000 7fcb9da63700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb980bcf40 con 0x7fcb980c86f0 2023-11-30T18:41:38.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.416+0000 7fcb97fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcb98062700 0x7fcb98062bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:38.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.416+0000 7fcb97fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcb98062700 0x7fcb98062bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34594/0 (socket says 172.21.15.49:34594) 2023-11-30T18:41:38.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.416+0000 7fcb97fff700 1 -- 172.21.15.49:0/802734381 learned_addr learned my addr 172.21.15.49:0/802734381 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:38.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.416+0000 7fcb977fe700 1 --1- 172.21.15.49:0/802734381 >> v1:172.21.15.49:6789/0 conn(0x7fcb981547f0 0x7fcb980c6fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36636/0 (socket says 172.21.15.49:36636) 2023-11-30T18:41:38.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.417+0000 7fcb96ffd700 1 --2- 172.21.15.49:0/802734381 >> v2:172.21.15.115:3300/0 conn(0x7fcb980c86f0 0x7fcb980a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:38.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.417+0000 7fcb97fff700 1 -- 172.21.15.49:0/802734381 >> v2:172.21.15.115:3300/0 conn(0x7fcb980c86f0 msgr2=0x7fcb980a72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:38.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.417+0000 7fcb97fff700 1 --2- 172.21.15.49:0/802734381 >> v2:172.21.15.115:3300/0 conn(0x7fcb980c86f0 0x7fcb980a72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:38.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.417+0000 7fcb97fff700 1 -- 172.21.15.49:0/802734381 >> v1:172.21.15.49:6789/0 conn(0x7fcb981547f0 legacy=0x7fcb980c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:38.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.417+0000 7fcb97fff700 1 -- 172.21.15.49:0/802734381 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb980c6b20 con 0x7fcb98062700 2023-11-30T18:41:38.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.417+0000 7fcb97fff700 1 --2- 172.21.15.49:0/802734381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb98062700 0x7fcb98062bb0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 rx=0x7fcb98064d00 tx=0x7fcb90009840).ready entity=mon.0 client_cookie=60882b77959c624e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:38.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.417+0000 7fcb967fc700 1 -- 172.21.15.49:0/802734381 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9000e070 con 0x7fcb98062700 2023-11-30T18:41:38.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.417+0000 7fcb967fc700 1 -- 172.21.15.49:0/802734381 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9000ba20 con 0x7fcb98062700 2023-11-30T18:41:38.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.417+0000 7fcb967fc700 1 -- 172.21.15.49:0/802734381 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9000bda0 con 0x7fcb98062700 2023-11-30T18:41:38.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.418+0000 7fcb9da63700 1 -- 172.21.15.49:0/802734381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb98062700 msgr2=0x7fcb98062bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:38.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.418+0000 7fcb9da63700 1 --2- 172.21.15.49:0/802734381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb98062700 0x7fcb98062bb0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 rx=0x7fcb98064d00 tx=0x7fcb90009840).stop 2023-11-30T18:41:38.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.418+0000 7fcb9da63700 1 -- 172.21.15.49:0/802734381 shutdown_connections 2023-11-30T18:41:38.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.418+0000 7fcb9da63700 1 --2- 172.21.15.49:0/802734381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb98062700 0x7fcb98062bb0 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:38.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.418+0000 7fcb9da63700 1 --2- 172.21.15.49:0/802734381 >> v2:172.21.15.115:3300/0 conn(0x7fcb980c86f0 0x7fcb980a72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:38.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.418+0000 7fcb9da63700 1 -- 172.21.15.49:0/802734381 >> 172.21.15.49:0/802734381 conn(0x7fcb980642d0 msgr2=0x7fcb980c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:38.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.418+0000 7fcb9da63700 1 -- 172.21.15.49:0/802734381 shutdown_connections 2023-11-30T18:41:38.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.418+0000 7fcb9da63700 1 -- 172.21.15.49:0/802734381 wait complete. 2023-11-30T18:41:38.422 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:38.419+0000 7f5c5f1f9680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T18:41:38.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.419+0000 7fcb9da63700 1 Processor -- start 2023-11-30T18:41:38.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.419+0000 7fcb9da63700 1 -- start start 2023-11-30T18:41:38.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.420+0000 7fcb9da63700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb98062700 0x7fcb98140d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:38.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.420+0000 7fcb9da63700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb980c86f0 0x7fcb9814fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:38.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.420+0000 7fcb9da63700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb981547f0 0x7fcb980aaf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:38.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.420+0000 7fcb9da63700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9814f950 con 0x7fcb980c86f0 2023-11-30T18:41:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.420+0000 7fcb9da63700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb98141260 con 0x7fcb98062700 2023-11-30T18:41:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.420+0000 7fcb9da63700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9814ed40 con 0x7fcb981547f0 2023-11-30T18:41:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.420+0000 7fcb96ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb980c86f0 0x7fcb9814fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.420+0000 7fcb96ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb980c86f0 0x7fcb9814fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34606/0 (socket says 172.21.15.49:34606) 2023-11-30T18:41:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.420+0000 7fcb96ffd700 1 -- 172.21.15.49:0/3848478954 learned_addr learned my addr 172.21.15.49:0/3848478954 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.420+0000 7fcb977fe700 1 --2- 172.21.15.49:0/3848478954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb98062700 0x7fcb98140d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.420+0000 7fcb97fff700 1 --2- 172.21.15.49:0/3848478954 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb981547f0 0x7fcb980aaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.420+0000 7fcb96ffd700 1 -- 172.21.15.49:0/3848478954 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb981547f0 msgr2=0x7fcb980aaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.420+0000 7fcb96ffd700 1 --2- 172.21.15.49:0/3848478954 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb981547f0 0x7fcb980aaf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.420+0000 7fcb96ffd700 1 -- 172.21.15.49:0/3848478954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb98062700 msgr2=0x7fcb98140d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.420+0000 7fcb96ffd700 1 --2- 172.21.15.49:0/3848478954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb98062700 0x7fcb98140d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.420+0000 7fcb96ffd700 1 -- 172.21.15.49:0/3848478954 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb90009ae0 con 0x7fcb980c86f0 2023-11-30T18:41:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.420+0000 7fcb96ffd700 1 --2- 172.21.15.49:0/3848478954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb980c86f0 0x7fcb9814fde0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 rx=0x7fcb8c00e900 tx=0x7fcb8c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.421+0000 7fcb7f7fe700 1 -- 172.21.15.49:0/3848478954 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c012600 con 0x7fcb980c86f0 2023-11-30T18:41:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.421+0000 7fcb7f7fe700 1 -- 172.21.15.49:0/3848478954 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8c012760 con 0x7fcb980c86f0 2023-11-30T18:41:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.421+0000 7fcb9da63700 1 -- 172.21.15.49:0/3848478954 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb9814f020 con 0x7fcb980c86f0 2023-11-30T18:41:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.421+0000 7fcb7f7fe700 1 -- 172.21.15.49:0/3848478954 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c012ae0 con 0x7fcb980c86f0 2023-11-30T18:41:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.421+0000 7fcb9da63700 1 -- 172.21.15.49:0/3848478954 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb9814f5e0 con 0x7fcb980c86f0 2023-11-30T18:41:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.422+0000 7fcb9da63700 1 -- 172.21.15.49:0/3848478954 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb9814fb00 con 0x7fcb980c86f0 2023-11-30T18:41:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.422+0000 7fcb7f7fe700 1 -- 172.21.15.49:0/3848478954 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 103) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fcb8c01b400 con 0x7fcb980c86f0 2023-11-30T18:41:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.422+0000 7fcb7f7fe700 1 --2- 172.21.15.49:0/3848478954 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fcb8405f300 0x7fcb840617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.422+0000 7fcb7f7fe700 1 -- 172.21.15.49:0/3848478954 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(220..220 src has 1..220) v4 ==== 6491+0+0 (secure 0 0 0) 0x7fcb8c07a9e0 con 0x7fcb980c86f0 2023-11-30T18:41:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.422+0000 7fcb977fe700 1 -- 172.21.15.49:0/3848478954 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fcb8405f300 msgr2=0x7fcb840617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.422+0000 7fcb977fe700 1 --2- 172.21.15.49:0/3848478954 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fcb8405f300 0x7fcb840617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:41:38.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.427+0000 7fcb7f7fe700 1 -- 172.21.15.49:0/3848478954 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcb9814fb00 con 0x7fcb980c86f0 2023-11-30T18:41:38.524 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:38.522+0000 7f5c5f1f9680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:41:38.585 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:38.583+0000 7f8db809f680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T18:41:38.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.616+0000 7fcb9da63700 1 -- 172.21.15.49:0/3848478954 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcb9806c860 con 0x7fcb980c86f0 2023-11-30T18:41:38.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.616+0000 7fcb7f7fe700 1 -- 172.21.15.49:0/3848478954 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v220) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcb8c04b8e0 con 0x7fcb980c86f0 2023-11-30T18:41:38.618 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T18:41:38.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.618+0000 7fcb9da63700 1 -- 172.21.15.49:0/3848478954 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fcb8405f300 msgr2=0x7fcb840617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:41:38.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.618+0000 7fcb9da63700 1 --2- 172.21.15.49:0/3848478954 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fcb8405f300 0x7fcb840617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:38.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.618+0000 7fcb9da63700 1 -- 172.21.15.49:0/3848478954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb980c86f0 msgr2=0x7fcb9814fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:38.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.618+0000 7fcb9da63700 1 --2- 172.21.15.49:0/3848478954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb980c86f0 0x7fcb9814fde0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 rx=0x7fcb8c00e900 tx=0x7fcb8c009060).stop 2023-11-30T18:41:38.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.618+0000 7fcb9da63700 1 -- 172.21.15.49:0/3848478954 shutdown_connections 2023-11-30T18:41:38.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.618+0000 7fcb9da63700 1 --2- 172.21.15.49:0/3848478954 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fcb8405f300 0x7fcb840617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:38.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.618+0000 7fcb9da63700 1 --2- 172.21.15.49:0/3848478954 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb981547f0 0x7fcb980aaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:38.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.618+0000 7fcb9da63700 1 --2- 172.21.15.49:0/3848478954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb98062700 0x7fcb98140d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:38.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.618+0000 7fcb9da63700 1 --2- 172.21.15.49:0/3848478954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb980c86f0 0x7fcb9814fde0 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:38.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.618+0000 7fcb9da63700 1 -- 172.21.15.49:0/3848478954 >> 172.21.15.49:0/3848478954 conn(0x7fcb980642d0 msgr2=0x7fcb98151040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:38.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.618+0000 7fcb9da63700 1 -- 172.21.15.49:0/3848478954 shutdown_connections 2023-11-30T18:41:38.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.618+0000 7fcb9da63700 1 -- 172.21.15.49:0/3848478954 wait complete. 2023-11-30T18:41:38.633 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-30T18:41:38.676 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:38.674+0000 7f5c5f1f9680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T18:41:38.698 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:38.696+0000 7f8db809f680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:41:38.751 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:38.750+0000 7f5c5f1f9680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T18:41:38.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.755+0000 7f9e2f577700 1 Processor -- start 2023-11-30T18:41:38.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.755+0000 7f9e2f577700 1 -- start start 2023-11-30T18:41:38.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.756+0000 7f9e2f577700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9e2814e530 0x7f9e280c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:38.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.756+0000 7f9e2f577700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e28154950 0x7f9e2814e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:38.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.756+0000 7f9e2f577700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e280c7bc0 con 0x7f9e28158570 2023-11-30T18:41:38.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.756+0000 7f9e2f577700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e28155920 con 0x7f9e2814e530 2023-11-30T18:41:38.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.756+0000 7f9e2f577700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e28154dd0 con 0x7f9e28154950 2023-11-30T18:41:38.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.756+0000 7f9e2e575700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9e2814e530 0x7f9e280c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:38.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.756+0000 7f9e2dd74700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e28154950 0x7f9e2814e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:38.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.756+0000 7f9e2dd74700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e28154950 0x7f9e2814e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:38120/0 (socket says 172.21.15.49:38120) 2023-11-30T18:41:38.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.756+0000 7f9e2e575700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9e2814e530 0x7f9e280c66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:50470/0 (socket says 172.21.15.49:50470) 2023-11-30T18:41:38.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.756+0000 7f9e2ed76700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f9e28158570 0x7f9e280aa030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:42412/0 (socket says 172.21.15.49:42412) 2023-11-30T18:41:38.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.756+0000 7f9e2dd74700 1 -- 172.21.15.49:0/3587079517 learned_addr learned my addr 172.21.15.49:0/3587079517 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:38.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.757+0000 7f9e2dd74700 1 -- 172.21.15.49:0/3587079517 >> v2:172.21.15.115:3300/0 conn(0x7f9e2814e530 msgr2=0x7f9e280c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:38.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.757+0000 7f9e2dd74700 1 --2- 172.21.15.49:0/3587079517 >> v2:172.21.15.115:3300/0 conn(0x7f9e2814e530 0x7f9e280c66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:38.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.757+0000 7f9e2dd74700 1 -- 172.21.15.49:0/3587079517 >> v1:172.21.15.115:6789/0 conn(0x7f9e28158570 legacy=0x7f9e280aa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:38.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.757+0000 7f9e2dd74700 1 -- 172.21.15.49:0/3587079517 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e28155080 con 0x7f9e28154950 2023-11-30T18:41:38.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.757+0000 7f9e2d573700 1 -- 172.21.15.49:0/3587079517 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3487385500 0 0) 0x7f9e280c7bc0 con 0x7f9e28158570 2023-11-30T18:41:38.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.757+0000 7f9e2e575700 1 --2- 172.21.15.49:0/3587079517 >> v2:172.21.15.115:3300/0 conn(0x7f9e2814e530 0x7f9e280c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:41:38.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.757+0000 7f9e2dd74700 1 --2- 172.21.15.49:0/3587079517 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e28154950 0x7f9e2814e910 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f9e18006fd0 tx=0x7f9e180090f0).ready entity=mon.2 client_cookie=9de3ce393663769f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:38.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.757+0000 7f9e2d573700 1 -- 172.21.15.49:0/3587079517 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1800b580 con 0x7f9e28154950 2023-11-30T18:41:38.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.757+0000 7f9e2d573700 1 -- 172.21.15.49:0/3587079517 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1800b6e0 con 0x7f9e28154950 2023-11-30T18:41:38.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.757+0000 7f9e2d573700 1 -- 172.21.15.49:0/3587079517 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1800ba80 con 0x7f9e28154950 2023-11-30T18:41:38.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.757+0000 7f9e2f577700 1 -- 172.21.15.49:0/3587079517 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e28154950 msgr2=0x7f9e2814e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:38.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.757+0000 7f9e2f577700 1 --2- 172.21.15.49:0/3587079517 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e28154950 0x7f9e2814e910 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f9e18006fd0 tx=0x7f9e180090f0).stop 2023-11-30T18:41:38.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.758+0000 7f9e2f577700 1 -- 172.21.15.49:0/3587079517 shutdown_connections 2023-11-30T18:41:38.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.758+0000 7f9e2f577700 1 --2- 172.21.15.49:0/3587079517 >> v2:172.21.15.115:3300/0 conn(0x7f9e2814e530 0x7f9e280c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:38.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.758+0000 7f9e2f577700 1 --2- 172.21.15.49:0/3587079517 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e28154950 0x7f9e2814e910 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:38.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.758+0000 7f9e2f577700 1 -- 172.21.15.49:0/3587079517 >> 172.21.15.49:0/3587079517 conn(0x7f9e28064990 msgr2=0x7f9e28064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:38.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.758+0000 7f9e2f577700 1 -- 172.21.15.49:0/3587079517 shutdown_connections 2023-11-30T18:41:38.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.758+0000 7f9e2f577700 1 -- 172.21.15.49:0/3587079517 wait complete. 2023-11-30T18:41:38.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.759+0000 7f9e2f577700 1 Processor -- start 2023-11-30T18:41:38.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.759+0000 7f9e2f577700 1 -- start start 2023-11-30T18:41:38.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.759+0000 7f9e2f577700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e2814e530 0x7f9e28153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:38.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.759+0000 7f9e2f577700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e28154950 0x7f9e280af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:38.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.759+0000 7f9e2f577700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e28158570 0x7f9e280af4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:38.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.759+0000 7f9e2f577700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e280c3150 con 0x7f9e2814e530 2023-11-30T18:41:38.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.759+0000 7f9e2f577700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e280c3430 con 0x7f9e28158570 2023-11-30T18:41:38.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.759+0000 7f9e2f577700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e280c3710 con 0x7f9e28154950 2023-11-30T18:41:38.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.760+0000 7f9e2e575700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e2814e530 0x7f9e28153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:38.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.760+0000 7f9e2e575700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e2814e530 0x7f9e28153810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34622/0 (socket says 172.21.15.49:34622) 2023-11-30T18:41:38.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.760+0000 7f9e2e575700 1 -- 172.21.15.49:0/3443521512 learned_addr learned my addr 172.21.15.49:0/3443521512 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:38.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.760+0000 7f9e2dd74700 1 --2- 172.21.15.49:0/3443521512 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e28154950 0x7f9e280af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:38.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.760+0000 7f9e2ed76700 1 --2- 172.21.15.49:0/3443521512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e28158570 0x7f9e280af4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:38.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.760+0000 7f9e2e575700 1 -- 172.21.15.49:0/3443521512 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e28154950 msgr2=0x7f9e280af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:38.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.760+0000 7f9e2e575700 1 --2- 172.21.15.49:0/3443521512 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e28154950 0x7f9e280af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:38.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.760+0000 7f9e2e575700 1 -- 172.21.15.49:0/3443521512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e28158570 msgr2=0x7f9e280af4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:38.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.760+0000 7f9e2e575700 1 --2- 172.21.15.49:0/3443521512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e28158570 0x7f9e280af4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:38.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.760+0000 7f9e2e575700 1 -- 172.21.15.49:0/3443521512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e240092a0 con 0x7f9e2814e530 2023-11-30T18:41:38.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.760+0000 7f9e2dd74700 1 --2- 172.21.15.49:0/3443521512 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e28154950 0x7f9e280af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:41:38.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.760+0000 7f9e2e575700 1 --2- 172.21.15.49:0/3443521512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e2814e530 0x7f9e28153810 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 rx=0x7f9e2400ea20 tx=0x7f9e24009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:38.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.760+0000 7f9e1e7fc700 1 -- 172.21.15.49:0/3443521512 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2400ee60 con 0x7f9e2814e530 2023-11-30T18:41:38.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.760+0000 7f9e1e7fc700 1 -- 172.21.15.49:0/3443521512 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2400c850 con 0x7f9e2814e530 2023-11-30T18:41:38.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.760+0000 7f9e2f577700 1 -- 172.21.15.49:0/3443521512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e18009370 con 0x7f9e2814e530 2023-11-30T18:41:38.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.760+0000 7f9e1e7fc700 1 -- 172.21.15.49:0/3443521512 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2400cbd0 con 0x7f9e2814e530 2023-11-30T18:41:38.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.760+0000 7f9e2f577700 1 -- 172.21.15.49:0/3443521512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e280c3cd0 con 0x7f9e2814e530 2023-11-30T18:41:38.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.761+0000 7f9e2f577700 1 -- 172.21.15.49:0/3443521512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e280c4040 con 0x7f9e2814e530 2023-11-30T18:41:38.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.762+0000 7f9e1e7fc700 1 -- 172.21.15.49:0/3443521512 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 103) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f9e2401b400 con 0x7f9e2814e530 2023-11-30T18:41:38.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.763+0000 7f9e1e7fc700 1 --2- 172.21.15.49:0/3443521512 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f9e0c05f300 0x7f9e0c0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:38.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.763+0000 7f9e2dd74700 1 -- 172.21.15.49:0/3443521512 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f9e0c05f300 msgr2=0x7f9e0c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:38.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.763+0000 7f9e1e7fc700 1 -- 172.21.15.49:0/3443521512 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(220..220 src has 1..220) v4 ==== 6491+0+0 (secure 0 0 0) 0x7f9e2407b040 con 0x7f9e2814e530 2023-11-30T18:41:38.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.763+0000 7f9e2dd74700 1 --2- 172.21.15.49:0/3443521512 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f9e0c05f300 0x7f9e0c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:41:38.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.766+0000 7f9e1e7fc700 1 -- 172.21.15.49:0/3443521512 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9e2404bfc0 con 0x7f9e2814e530 2023-11-30T18:41:38.820 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:38.818+0000 7f5c5f1f9680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T18:41:38.860 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:38.858+0000 7f8db809f680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T18:41:38.938 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:38.937+0000 7f8db809f680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T18:41:38.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.941+0000 7f9e2f577700 1 -- 172.21.15.49:0/3443521512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9e280c1ea0 con 0x7f9e2814e530 2023-11-30T18:41:38.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.941+0000 7f9e1e7fc700 1 -- 172.21.15.49:0/3443521512 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v220) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9e2404f5e0 con 0x7f9e2814e530 2023-11-30T18:41:38.943 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-30T18:41:38.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.943+0000 7f9e2f577700 1 -- 172.21.15.49:0/3443521512 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f9e0c05f300 msgr2=0x7f9e0c0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:41:38.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.943+0000 7f9e2f577700 1 --2- 172.21.15.49:0/3443521512 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f9e0c05f300 0x7f9e0c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:38.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.943+0000 7f9e2f577700 1 -- 172.21.15.49:0/3443521512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e2814e530 msgr2=0x7f9e28153810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:38.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.943+0000 7f9e2f577700 1 --2- 172.21.15.49:0/3443521512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e2814e530 0x7f9e28153810 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 rx=0x7f9e2400ea20 tx=0x7f9e24009060).stop 2023-11-30T18:41:38.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.943+0000 7f9e2f577700 1 -- 172.21.15.49:0/3443521512 shutdown_connections 2023-11-30T18:41:38.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.943+0000 7f9e2f577700 1 --2- 172.21.15.49:0/3443521512 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f9e0c05f300 0x7f9e0c0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:38.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.943+0000 7f9e2f577700 1 --2- 172.21.15.49:0/3443521512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e28158570 0x7f9e280af4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:38.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.943+0000 7f9e2f577700 1 --2- 172.21.15.49:0/3443521512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e2814e530 0x7f9e28153810 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:38.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.943+0000 7f9e2f577700 1 --2- 172.21.15.49:0/3443521512 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e28154950 0x7f9e280af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:38.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.943+0000 7f9e2f577700 1 -- 172.21.15.49:0/3443521512 >> 172.21.15.49:0/3443521512 conn(0x7f9e28064990 msgr2=0x7f9e280c7860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:38.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.943+0000 7f9e2f577700 1 -- 172.21.15.49:0/3443521512 shutdown_connections 2023-11-30T18:41:38.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:38.943+0000 7f9e2f577700 1 -- 172.21.15.49:0/3443521512 wait complete. 2023-11-30T18:41:38.958 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:41:39.013 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:39.011+0000 7f8db809f680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T18:41:39.078 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:39.076+0000 7f5c5f1f9680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T18:41:39.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.077+0000 7fee9759e700 1 Processor -- start 2023-11-30T18:41:39.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.077+0000 7fee9759e700 1 -- start start 2023-11-30T18:41:39.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.078+0000 7fee9759e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fee98157660 0x7fee98157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:39.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.078+0000 7fee9759e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fee980c0180 0x7fee981589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:39.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.078+0000 7fee9759e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee980c12c0 con 0x7fee980c1750 2023-11-30T18:41:39.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.078+0000 7fee9759e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee980c06b0 con 0x7fee98157660 2023-11-30T18:41:39.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.078+0000 7fee9759e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee980c0990 con 0x7fee980c0180 2023-11-30T18:41:39.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.078+0000 7fee9659c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fee98157660 0x7fee98157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:39.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.078+0000 7fee9659c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fee98157660 0x7fee98157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34628/0 (socket says 172.21.15.49:34628) 2023-11-30T18:41:39.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.078+0000 7fee9659c700 1 -- 172.21.15.49:0/2620287720 learned_addr learned my addr 172.21.15.49:0/2620287720 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:39.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.078+0000 7fee96d9d700 1 --1- 172.21.15.49:0/2620287720 >> v1:172.21.15.49:6789/0 conn(0x7fee980c1750 0x7fee980648d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36640/0 (socket says 172.21.15.49:36640) 2023-11-30T18:41:39.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.078+0000 7fee95d9b700 1 --2- 172.21.15.49:0/2620287720 >> v2:172.21.15.115:3300/0 conn(0x7fee980c0180 0x7fee981589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:39.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.078+0000 7fee9659c700 1 -- 172.21.15.49:0/2620287720 >> v2:172.21.15.115:3300/0 conn(0x7fee980c0180 msgr2=0x7fee981589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:39.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.078+0000 7fee9659c700 1 --2- 172.21.15.49:0/2620287720 >> v2:172.21.15.115:3300/0 conn(0x7fee980c0180 0x7fee981589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:39.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.078+0000 7fee9659c700 1 -- 172.21.15.49:0/2620287720 >> v1:172.21.15.49:6789/0 conn(0x7fee980c1750 legacy=0x7fee980648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:39.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.078+0000 7fee9659c700 1 -- 172.21.15.49:0/2620287720 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee980c0c70 con 0x7fee98157660 2023-11-30T18:41:39.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.078+0000 7fee95d9b700 1 --2- 172.21.15.49:0/2620287720 >> v2:172.21.15.115:3300/0 conn(0x7fee980c0180 0x7fee981589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:41:39.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.079+0000 7fee9659c700 1 --2- 172.21.15.49:0/2620287720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee98157660 0x7fee98157a40 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 rx=0x7fee980c5820 tx=0x7fee880090f0).ready entity=mon.0 client_cookie=487c2223795b59b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:39.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.079+0000 7fee9559a700 1 -- 172.21.15.49:0/2620287720 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8800b600 con 0x7fee98157660 2023-11-30T18:41:39.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.079+0000 7fee9559a700 1 -- 172.21.15.49:0/2620287720 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8800b760 con 0x7fee98157660 2023-11-30T18:41:39.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.079+0000 7fee9559a700 1 -- 172.21.15.49:0/2620287720 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8800bae0 con 0x7fee98157660 2023-11-30T18:41:39.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.079+0000 7fee9759e700 1 -- 172.21.15.49:0/2620287720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee98157660 msgr2=0x7fee98157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:39.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.079+0000 7fee9759e700 1 --2- 172.21.15.49:0/2620287720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee98157660 0x7fee98157a40 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 rx=0x7fee980c5820 tx=0x7fee880090f0).stop 2023-11-30T18:41:39.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.079+0000 7fee9759e700 1 -- 172.21.15.49:0/2620287720 shutdown_connections 2023-11-30T18:41:39.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.079+0000 7fee9759e700 1 --2- 172.21.15.49:0/2620287720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee98157660 0x7fee98157a40 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:39.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.079+0000 7fee9759e700 1 --2- 172.21.15.49:0/2620287720 >> v2:172.21.15.115:3300/0 conn(0x7fee980c0180 0x7fee981589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:39.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.079+0000 7fee9759e700 1 -- 172.21.15.49:0/2620287720 >> 172.21.15.49:0/2620287720 conn(0x7fee980cb000 msgr2=0x7fee980cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:39.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.079+0000 7fee9759e700 1 -- 172.21.15.49:0/2620287720 shutdown_connections 2023-11-30T18:41:39.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.079+0000 7fee9759e700 1 -- 172.21.15.49:0/2620287720 wait complete. 2023-11-30T18:41:39.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.081+0000 7fee9759e700 1 Processor -- start 2023-11-30T18:41:39.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.081+0000 7fee9759e700 1 -- start start 2023-11-30T18:41:39.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.081+0000 7fee9759e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee980c0180 0x7fee98159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:39.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.081+0000 7fee9759e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee980c1750 0x7fee980afc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:39.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.081+0000 7fee9759e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee98157660 0x7fee980aa430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:39.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.081+0000 7fee9759e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee980af7d0 con 0x7fee980c1750 2023-11-30T18:41:39.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.081+0000 7fee9759e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee980aebc0 con 0x7fee98157660 2023-11-30T18:41:39.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.081+0000 7fee9759e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee980aeea0 con 0x7fee980c0180 2023-11-30T18:41:39.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.081+0000 7fee95d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee980c1750 0x7fee980afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:39.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.081+0000 7fee95d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee980c1750 0x7fee980afc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34630/0 (socket says 172.21.15.49:34630) 2023-11-30T18:41:39.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.081+0000 7fee95d9b700 1 -- 172.21.15.49:0/3013087850 learned_addr learned my addr 172.21.15.49:0/3013087850 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:39.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.081+0000 7fee9659c700 1 --2- 172.21.15.49:0/3013087850 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee980c0180 0x7fee98159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:39.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.081+0000 7fee96d9d700 1 --2- 172.21.15.49:0/3013087850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee98157660 0x7fee980aa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:39.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.082+0000 7fee95d9b700 1 -- 172.21.15.49:0/3013087850 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee980c0180 msgr2=0x7fee98159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:39.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.082+0000 7fee95d9b700 1 --2- 172.21.15.49:0/3013087850 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee980c0180 0x7fee98159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:39.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.082+0000 7fee95d9b700 1 -- 172.21.15.49:0/3013087850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee98157660 msgr2=0x7fee980aa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:39.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.082+0000 7fee95d9b700 1 --2- 172.21.15.49:0/3013087850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee98157660 0x7fee980aa430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:39.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.082+0000 7fee95d9b700 1 -- 172.21.15.49:0/3013087850 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee88009370 con 0x7fee980c1750 2023-11-30T18:41:39.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.082+0000 7fee95d9b700 1 --2- 172.21.15.49:0/3013087850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee980c1750 0x7fee980afc60 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 rx=0x7fee8c00d860 tx=0x7fee8c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:39.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.082+0000 7fee867fc700 1 -- 172.21.15.49:0/3013087850 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c00f520 con 0x7fee980c1750 2023-11-30T18:41:39.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.082+0000 7fee867fc700 1 -- 172.21.15.49:0/3013087850 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8c00f680 con 0x7fee980c1750 2023-11-30T18:41:39.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.082+0000 7fee9759e700 1 -- 172.21.15.49:0/3013087850 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee980af180 con 0x7fee980c1750 2023-11-30T18:41:39.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.082+0000 7fee867fc700 1 -- 172.21.15.49:0/3013087850 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c00fa00 con 0x7fee980c1750 2023-11-30T18:41:39.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.082+0000 7fee9759e700 1 -- 172.21.15.49:0/3013087850 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee98159700 con 0x7fee980c1750 2023-11-30T18:41:39.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.083+0000 7fee9759e700 1 -- 172.21.15.49:0/3013087850 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee980c3270 con 0x7fee980c1750 2023-11-30T18:41:39.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.084+0000 7fee867fc700 1 -- 172.21.15.49:0/3013087850 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 103) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fee8c0123e0 con 0x7fee980c1750 2023-11-30T18:41:39.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.084+0000 7fee867fc700 1 --2- 172.21.15.49:0/3013087850 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fee7805f300 0x7fee780617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:39.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.084+0000 7fee867fc700 1 -- 172.21.15.49:0/3013087850 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(220..220 src has 1..220) v4 ==== 6491+0+0 (secure 0 0 0) 0x7fee8c07a1b0 con 0x7fee980c1750 2023-11-30T18:41:39.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.084+0000 7fee9659c700 1 -- 172.21.15.49:0/3013087850 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fee7805f300 msgr2=0x7fee780617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:39.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.084+0000 7fee9659c700 1 --2- 172.21.15.49:0/3013087850 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fee7805f300 0x7fee780617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:41:39.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.092+0000 7fee867fc700 1 -- 172.21.15.49:0/3013087850 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fee8c04b0b0 con 0x7fee980c1750 2023-11-30T18:41:39.261 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:39.260+0000 7f5c5f1f9680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T18:41:39.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.285+0000 7fee9659c700 1 -- 172.21.15.49:0/3013087850 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fee7805f300 msgr2=0x7fee780617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:39.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.285+0000 7fee9659c700 1 --2- 172.21.15.49:0/3013087850 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fee7805f300 0x7fee780617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T18:41:39.293 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:39.292+0000 7f8db809f680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T18:41:39.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.309+0000 7fee9759e700 1 -- 172.21.15.49:0/3013087850 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee9806c7c0 con 0x7fee980c1750 2023-11-30T18:41:39.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.310+0000 7fee867fc700 1 -- 172.21.15.49:0/3013087850 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4499 (secure 0 0 0) 0x7fee8c04e6d0 con 0x7fee980c1750 2023-11-30T18:41:39.312 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:39.312 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":93,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8219,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3124035021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3124035021},{"type":"v1","addr":"172.21.15.115:6837","nonce":3124035021}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":9565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2947558957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2947558957},{"type":"v1","addr":"172.21.15.115:6836","nonce":2947558957}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":9996,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1999244219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1999244219},{"type":"v1","addr":"172.21.15.49:6834","nonce":1999244219}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T18:41:21.351721+0000","modified":"2023-11-30T18:41:24.361310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9999":{"gid":9999,"name":"a","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1129424322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1129424322},{"type":"v1","addr":"172.21.15.49:6835","nonce":1129424322}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-11-30T18:41:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.312+0000 7fee9759e700 1 -- 172.21.15.49:0/3013087850 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fee7805f300 msgr2=0x7fee780617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:41:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.312+0000 7fee9759e700 1 --2- 172.21.15.49:0/3013087850 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fee7805f300 0x7fee780617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.312+0000 7fee9759e700 1 -- 172.21.15.49:0/3013087850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee980c1750 msgr2=0x7fee980afc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.312+0000 7fee9759e700 1 --2- 172.21.15.49:0/3013087850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee980c1750 0x7fee980afc60 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 rx=0x7fee8c00d860 tx=0x7fee8c008040).stop 2023-11-30T18:41:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.312+0000 7fee9759e700 1 -- 172.21.15.49:0/3013087850 shutdown_connections 2023-11-30T18:41:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.312+0000 7fee9759e700 1 --2- 172.21.15.49:0/3013087850 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fee7805f300 0x7fee780617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.312+0000 7fee9759e700 1 --2- 172.21.15.49:0/3013087850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee98157660 0x7fee980aa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.312+0000 7fee9759e700 1 --2- 172.21.15.49:0/3013087850 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee980c0180 0x7fee98159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.312+0000 7fee9759e700 1 --2- 172.21.15.49:0/3013087850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee980c1750 0x7fee980afc60 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.312+0000 7fee9759e700 1 -- 172.21.15.49:0/3013087850 >> 172.21.15.49:0/3013087850 conn(0x7fee980cb000 msgr2=0x7fee98152be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.312+0000 7fee9759e700 1 -- 172.21.15.49:0/3013087850 shutdown_connections 2023-11-30T18:41:39.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.312+0000 7fee9759e700 1 -- 172.21.15.49:0/3013087850 wait complete. 2023-11-30T18:41:39.315 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 93 2023-11-30T18:41:39.326 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:41:39.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.446+0000 7fbc294d2700 1 Processor -- start 2023-11-30T18:41:39.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.446+0000 7fbc294d2700 1 -- start start 2023-11-30T18:41:39.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.447+0000 7fbc294d2700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbc240bf8b0 0x7fbc2415d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:39.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.447+0000 7fbc294d2700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc240be110 con 0x7fbc241524a0 2023-11-30T18:41:39.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.447+0000 7fbc294d2700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc24066fc0 con 0x7fbc241520c0 2023-11-30T18:41:39.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.447+0000 7fbc294d2700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc240672a0 con 0x7fbc240bf8b0 2023-11-30T18:41:39.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.447+0000 7fbc227fc700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbc241524a0 0x7fbc24067a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36648/0 (socket says 172.21.15.49:36648) 2023-11-30T18:41:39.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.447+0000 7fbc227fc700 1 -- 172.21.15.49:0/1163429428 learned_addr learned my addr 172.21.15.49:0/1163429428 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:39.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.448+0000 7fbc237fe700 1 --2- 172.21.15.49:0/1163429428 >> v2:172.21.15.115:3300/0 conn(0x7fbc240bf8b0 0x7fbc2415d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:39.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.448+0000 7fbc21ffb700 1 -- 172.21.15.49:0/1163429428 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3059272096 0 0) 0x7fbc240be110 con 0x7fbc241524a0 2023-11-30T18:41:39.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.448+0000 7fbc21ffb700 1 -- 172.21.15.49:0/1163429428 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc100033f0 con 0x7fbc241524a0 2023-11-30T18:41:39.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.448+0000 7fbc21ffb700 1 -- 172.21.15.49:0/1163429428 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4277367307 0 0) 0x7fbc24066fc0 con 0x7fbc241520c0 2023-11-30T18:41:39.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.448+0000 7fbc21ffb700 1 -- 172.21.15.49:0/1163429428 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc240be110 con 0x7fbc241520c0 2023-11-30T18:41:39.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.448+0000 7fbc237fe700 1 -- 172.21.15.49:0/1163429428 >> v1:172.21.15.115:6789/0 conn(0x7fbc241520c0 legacy=0x7fbc24066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:39.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.448+0000 7fbc237fe700 1 -- 172.21.15.49:0/1163429428 >> v1:172.21.15.49:6789/0 conn(0x7fbc241524a0 legacy=0x7fbc24067a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:39.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.448+0000 7fbc237fe700 1 -- 172.21.15.49:0/1163429428 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc240be380 con 0x7fbc240bf8b0 2023-11-30T18:41:39.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.448+0000 7fbc237fe700 1 --2- 172.21.15.49:0/1163429428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc240bf8b0 0x7fbc2415d250 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7fbc1c009e60 tx=0x7fbc1c009780).ready entity=mon.1 client_cookie=f66dc7d269004942 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:39.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.448+0000 7fbc21ffb700 1 -- 172.21.15.49:0/1163429428 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c00e070 con 0x7fbc240bf8b0 2023-11-30T18:41:39.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.448+0000 7fbc21ffb700 1 -- 172.21.15.49:0/1163429428 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1c00bab0 con 0x7fbc240bf8b0 2023-11-30T18:41:39.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.448+0000 7fbc21ffb700 1 -- 172.21.15.49:0/1163429428 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c00be30 con 0x7fbc240bf8b0 2023-11-30T18:41:39.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.449+0000 7fbc294d2700 1 -- 172.21.15.49:0/1163429428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc240bf8b0 msgr2=0x7fbc2415d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:39.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.449+0000 7fbc294d2700 1 --2- 172.21.15.49:0/1163429428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc240bf8b0 0x7fbc2415d250 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7fbc1c009e60 tx=0x7fbc1c009780).stop 2023-11-30T18:41:39.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.449+0000 7fbc294d2700 1 -- 172.21.15.49:0/1163429428 shutdown_connections 2023-11-30T18:41:39.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.449+0000 7fbc294d2700 1 --2- 172.21.15.49:0/1163429428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc240bf8b0 0x7fbc2415d250 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:39.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.449+0000 7fbc294d2700 1 -- 172.21.15.49:0/1163429428 >> 172.21.15.49:0/1163429428 conn(0x7fbc240631d0 msgr2=0x7fbc240c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:39.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.449+0000 7fbc294d2700 1 -- 172.21.15.49:0/1163429428 shutdown_connections 2023-11-30T18:41:39.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.449+0000 7fbc294d2700 1 -- 172.21.15.49:0/1163429428 wait complete. 2023-11-30T18:41:39.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.450+0000 7fbc294d2700 1 Processor -- start 2023-11-30T18:41:39.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.450+0000 7fbc294d2700 1 -- start start 2023-11-30T18:41:39.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.451+0000 7fbc294d2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc240bf8b0 0x7fbc240ac270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:39.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.451+0000 7fbc294d2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc241520c0 0x7fbc2414a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:39.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.451+0000 7fbc294d2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc241524a0 0x7fbc240c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:39.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.451+0000 7fbc294d2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2414b130 con 0x7fbc241524a0 2023-11-30T18:41:39.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.451+0000 7fbc294d2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc240ac760 con 0x7fbc241520c0 2023-11-30T18:41:39.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.451+0000 7fbc294d2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2414dfa0 con 0x7fbc240bf8b0 2023-11-30T18:41:39.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.451+0000 7fbc237fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc241524a0 0x7fbc240c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:39.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.451+0000 7fbc237fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc241524a0 0x7fbc240c5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34640/0 (socket says 172.21.15.49:34640) 2023-11-30T18:41:39.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.451+0000 7fbc237fe700 1 -- 172.21.15.49:0/618629218 learned_addr learned my addr 172.21.15.49:0/618629218 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:39.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.451+0000 7fbc227fc700 1 --2- 172.21.15.49:0/618629218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc241520c0 0x7fbc2414a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:39.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.451+0000 7fbc22ffd700 1 --2- 172.21.15.49:0/618629218 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc240bf8b0 0x7fbc240ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:39.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.452+0000 7fbc237fe700 1 -- 172.21.15.49:0/618629218 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc240bf8b0 msgr2=0x7fbc240ac270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:39.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.452+0000 7fbc237fe700 1 --2- 172.21.15.49:0/618629218 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc240bf8b0 0x7fbc240ac270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:39.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.452+0000 7fbc237fe700 1 -- 172.21.15.49:0/618629218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc241520c0 msgr2=0x7fbc2414a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:39.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.452+0000 7fbc237fe700 1 --2- 172.21.15.49:0/618629218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc241520c0 0x7fbc2414a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:39.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.452+0000 7fbc237fe700 1 -- 172.21.15.49:0/618629218 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc1c009a20 con 0x7fbc241524a0 2023-11-30T18:41:39.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.452+0000 7fbc237fe700 1 --2- 172.21.15.49:0/618629218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc241524a0 0x7fbc240c5b40 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 rx=0x7fbc1c00b610 tx=0x7fbc1c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:39.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.452+0000 7fbc1affd700 1 -- 172.21.15.49:0/618629218 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c012e60 con 0x7fbc241524a0 2023-11-30T18:41:39.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.452+0000 7fbc1affd700 1 -- 172.21.15.49:0/618629218 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1c01d630 con 0x7fbc241524a0 2023-11-30T18:41:39.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.452+0000 7fbc294d2700 1 -- 172.21.15.49:0/618629218 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc240acf80 con 0x7fbc241524a0 2023-11-30T18:41:39.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.452+0000 7fbc1affd700 1 -- 172.21.15.49:0/618629218 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c01d9b0 con 0x7fbc241524a0 2023-11-30T18:41:39.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.452+0000 7fbc294d2700 1 -- 172.21.15.49:0/618629218 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc240ac9c0 con 0x7fbc241524a0 2023-11-30T18:41:39.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.453+0000 7fbc294d2700 1 -- 172.21.15.49:0/618629218 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc2414b2a0 con 0x7fbc241524a0 2023-11-30T18:41:39.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.453+0000 7fbc1affd700 1 -- 172.21.15.49:0/618629218 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 103) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fbc1c026410 con 0x7fbc241524a0 2023-11-30T18:41:39.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.454+0000 7fbc1affd700 1 --2- 172.21.15.49:0/618629218 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fbc0405f300 0x7fbc040617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:39.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.454+0000 7fbc22ffd700 1 -- 172.21.15.49:0/618629218 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fbc0405f300 msgr2=0x7fbc040617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:39.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.454+0000 7fbc1affd700 1 -- 172.21.15.49:0/618629218 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(220..220 src has 1..220) v4 ==== 6491+0+0 (secure 0 0 0) 0x7fbc1c07c460 con 0x7fbc241524a0 2023-11-30T18:41:39.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.454+0000 7fbc22ffd700 1 --2- 172.21.15.49:0/618629218 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fbc0405f300 0x7fbc040617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:41:39.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.458+0000 7fbc1affd700 1 -- 172.21.15.49:0/618629218 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbc1c04d250 con 0x7fbc241524a0 2023-11-30T18:41:39.490 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:39.488+0000 7f8db809f680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T18:41:39.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.632+0000 7fbc294d2700 1 -- 172.21.15.49:0/618629218 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc2406c860 con 0x7fbc241524a0 2023-11-30T18:41:39.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.633+0000 7fbc1affd700 1 -- 172.21.15.49:0/618629218 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v220) v1 ==== 74+0+17495 (secure 0 0 0) 0x7fbc1c050870 con 0x7fbc241524a0 2023-11-30T18:41:39.635 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:39.635 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":220,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:41:33.621384+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"208","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-11-30T18:41:19.292113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"218","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-11-30T18:41:20.340870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"219","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/1773998477":"2023-12-01T18:41:33.621332+0000","172.21.15.115:6833/103051":"2023-12-01T18:41:33.621332+0000","172.21.15.115:6832/103051":"2023-12-01T18:41:33.621332+0000","172.21.15.115:0/3037216069":"2023-12-01T18:41:33.621332+0000","172.21.15.115:0/467841810":"2023-12-01T18:41:33.621332+0000","172.21.15.115:0/107175683":"2023-12-01T18:41:33.621332+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:41:39.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.635+0000 7fbc294d2700 1 -- 172.21.15.49:0/618629218 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fbc0405f300 msgr2=0x7fbc040617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:41:39.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.635+0000 7fbc294d2700 1 --2- 172.21.15.49:0/618629218 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fbc0405f300 0x7fbc040617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:39.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.635+0000 7fbc294d2700 1 -- 172.21.15.49:0/618629218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc241524a0 msgr2=0x7fbc240c5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:39.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.635+0000 7fbc294d2700 1 --2- 172.21.15.49:0/618629218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc241524a0 0x7fbc240c5b40 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 rx=0x7fbc1c00b610 tx=0x7fbc1c009780).stop 2023-11-30T18:41:39.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.635+0000 7fbc294d2700 1 -- 172.21.15.49:0/618629218 shutdown_connections 2023-11-30T18:41:39.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.635+0000 7fbc294d2700 1 --2- 172.21.15.49:0/618629218 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fbc0405f300 0x7fbc040617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:39.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.635+0000 7fbc294d2700 1 --2- 172.21.15.49:0/618629218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc241524a0 0x7fbc240c5b40 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:39.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.635+0000 7fbc294d2700 1 --2- 172.21.15.49:0/618629218 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc240bf8b0 0x7fbc240ac270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:39.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.635+0000 7fbc294d2700 1 --2- 172.21.15.49:0/618629218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc241520c0 0x7fbc2414a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:39.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.635+0000 7fbc294d2700 1 -- 172.21.15.49:0/618629218 >> 172.21.15.49:0/618629218 conn(0x7fbc240631d0 msgr2=0x7fbc241588a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:39.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.635+0000 7fbc294d2700 1 -- 172.21.15.49:0/618629218 shutdown_connections 2023-11-30T18:41:39.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.635+0000 7fbc294d2700 1 -- 172.21.15.49:0/618629218 wait complete. 2023-11-30T18:41:39.649 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-30T18:41:39.650 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:41:39.715 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:41:39.717 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:41:39.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.770+0000 7f1876529700 1 Processor -- start 2023-11-30T18:41:39.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.770+0000 7f1876529700 1 -- start start 2023-11-30T18:41:39.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.771+0000 7f1876529700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f18701544d0 0x7f1870155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:39.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.771+0000 7f1876529700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1870066f40 0x7f1870095e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:39.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.771+0000 7f1876529700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18700683d0 con 0x7f18700673c0 2023-11-30T18:41:39.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.771+0000 7f1876529700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1870067850 con 0x7f18701544d0 2023-11-30T18:41:39.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.771+0000 7f1876529700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1870067b30 con 0x7f1870066f40 2023-11-30T18:41:39.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.771+0000 7f186ffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f18701544d0 0x7f1870155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:39.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.771+0000 7f186ffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f18701544d0 0x7f1870155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34656/0 (socket says 172.21.15.49:34656) 2023-11-30T18:41:39.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.771+0000 7f186ffff700 1 -- 172.21.15.49:0/434444339 learned_addr learned my addr 172.21.15.49:0/434444339 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:39.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.771+0000 7f1874ac6700 1 --1- 172.21.15.49:0/434444339 >> v1:172.21.15.49:6789/0 conn(0x7f18700673c0 0x7f1870063e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36660/0 (socket says 172.21.15.49:36660) 2023-11-30T18:41:39.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.772+0000 7f186f7fe700 1 --2- 172.21.15.49:0/434444339 >> v2:172.21.15.115:3300/0 conn(0x7f1870066f40 0x7f1870095e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:39.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.772+0000 7f186ffff700 1 -- 172.21.15.49:0/434444339 >> v2:172.21.15.115:3300/0 conn(0x7f1870066f40 msgr2=0x7f1870095e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:39.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.772+0000 7f186ffff700 1 --2- 172.21.15.49:0/434444339 >> v2:172.21.15.115:3300/0 conn(0x7f1870066f40 0x7f1870095e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:39.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.772+0000 7f186ffff700 1 -- 172.21.15.49:0/434444339 >> v1:172.21.15.49:6789/0 conn(0x7f18700673c0 legacy=0x7f1870063e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:39.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.772+0000 7f186ffff700 1 -- 172.21.15.49:0/434444339 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1870067e10 con 0x7f18701544d0 2023-11-30T18:41:39.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.772+0000 7f186f7fe700 1 --2- 172.21.15.49:0/434444339 >> v2:172.21.15.115:3300/0 conn(0x7f1870066f40 0x7f1870095e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:41:39.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.772+0000 7f186ffff700 1 --2- 172.21.15.49:0/434444339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18701544d0 0x7f1870155750 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 rx=0x7f187006a7d0 tx=0x7f1858009060).ready entity=mon.0 client_cookie=c06f07a4f104b8ed server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:39.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.772+0000 7f186effd700 1 -- 172.21.15.49:0/434444339 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1858005880 con 0x7f18701544d0 2023-11-30T18:41:39.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.772+0000 7f186effd700 1 -- 172.21.15.49:0/434444339 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18580059e0 con 0x7f18701544d0 2023-11-30T18:41:39.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.772+0000 7f186effd700 1 -- 172.21.15.49:0/434444339 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1858005d60 con 0x7f18701544d0 2023-11-30T18:41:39.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.773+0000 7f1876529700 1 -- 172.21.15.49:0/434444339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18701544d0 msgr2=0x7f1870155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:39.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.773+0000 7f1876529700 1 --2- 172.21.15.49:0/434444339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18701544d0 0x7f1870155750 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 rx=0x7f187006a7d0 tx=0x7f1858009060).stop 2023-11-30T18:41:39.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.773+0000 7f1876529700 1 -- 172.21.15.49:0/434444339 shutdown_connections 2023-11-30T18:41:39.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.773+0000 7f1876529700 1 --2- 172.21.15.49:0/434444339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18701544d0 0x7f1870155750 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:39.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.773+0000 7f1876529700 1 --2- 172.21.15.49:0/434444339 >> v2:172.21.15.115:3300/0 conn(0x7f1870066f40 0x7f1870095e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:39.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.773+0000 7f1876529700 1 -- 172.21.15.49:0/434444339 >> 172.21.15.49:0/434444339 conn(0x7f18700631d0 msgr2=0x7f18700c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:39.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.773+0000 7f1876529700 1 -- 172.21.15.49:0/434444339 shutdown_connections 2023-11-30T18:41:39.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.773+0000 7f1876529700 1 -- 172.21.15.49:0/434444339 wait complete. 2023-11-30T18:41:39.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.774+0000 7f1876529700 1 Processor -- start 2023-11-30T18:41:39.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.774+0000 7f1876529700 1 -- start start 2023-11-30T18:41:39.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.775+0000 7f1876529700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1870066f40 0x7f187014edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:39.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.775+0000 7f1876529700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18701544d0 0x7f18700aa670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:39.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.775+0000 7f1876529700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18700aab60 0x7f18700c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:39.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.775+0000 7f1876529700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18700aafc0 con 0x7f18700aab60 2023-11-30T18:41:39.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.775+0000 7f1876529700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187014f2e0 con 0x7f1870066f40 2023-11-30T18:41:39.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.775+0000 7f1876529700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18700ac4b0 con 0x7f18701544d0 2023-11-30T18:41:39.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.775+0000 7f1874ac6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18700aab60 0x7f18700c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:39.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.775+0000 7f1874ac6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18700aab60 0x7f18700c49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34670/0 (socket says 172.21.15.49:34670) 2023-11-30T18:41:39.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.775+0000 7f1874ac6700 1 -- 172.21.15.49:0/2651482172 learned_addr learned my addr 172.21.15.49:0/2651482172 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:39.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.775+0000 7f186ffff700 1 --2- 172.21.15.49:0/2651482172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1870066f40 0x7f187014edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:39.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.775+0000 7f186f7fe700 1 --2- 172.21.15.49:0/2651482172 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18701544d0 0x7f18700aa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:39.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.775+0000 7f1874ac6700 1 -- 172.21.15.49:0/2651482172 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18701544d0 msgr2=0x7f18700aa670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:39.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.775+0000 7f1874ac6700 1 --2- 172.21.15.49:0/2651482172 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18701544d0 0x7f18700aa670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:39.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.775+0000 7f1874ac6700 1 -- 172.21.15.49:0/2651482172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1870066f40 msgr2=0x7f187014edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:39.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.775+0000 7f1874ac6700 1 --2- 172.21.15.49:0/2651482172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1870066f40 0x7f187014edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:39.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.775+0000 7f1874ac6700 1 -- 172.21.15.49:0/2651482172 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1858009300 con 0x7f18700aab60 2023-11-30T18:41:39.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.775+0000 7f1874ac6700 1 --2- 172.21.15.49:0/2651482172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18700aab60 0x7f18700c49b0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 rx=0x7f186800c7f0 tx=0x7f1868001560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:39.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.776+0000 7f1867fff700 1 -- 172.21.15.49:0/2651482172 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1868005c70 con 0x7f18700aab60 2023-11-30T18:41:39.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.776+0000 7f1867fff700 1 -- 172.21.15.49:0/2651482172 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1868005dd0 con 0x7f18700aab60 2023-11-30T18:41:39.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.776+0000 7f1876529700 1 -- 172.21.15.49:0/2651482172 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18700ac790 con 0x7f18700aab60 2023-11-30T18:41:39.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.776+0000 7f1867fff700 1 -- 172.21.15.49:0/2651482172 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18680072e0 con 0x7f18700aab60 2023-11-30T18:41:39.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.776+0000 7f1876529700 1 -- 172.21.15.49:0/2651482172 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18700acd50 con 0x7f18700aab60 2023-11-30T18:41:39.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.777+0000 7f1876529700 1 -- 172.21.15.49:0/2651482172 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f187006c860 con 0x7f18700aab60 2023-11-30T18:41:39.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.777+0000 7f1867fff700 1 -- 172.21.15.49:0/2651482172 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 103) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f18680076d0 con 0x7f18700aab60 2023-11-30T18:41:39.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.778+0000 7f1867fff700 1 --2- 172.21.15.49:0/2651482172 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f185005f2d0 0x7f1850061790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:39.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.778+0000 7f1867fff700 1 -- 172.21.15.49:0/2651482172 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(220..220 src has 1..220) v4 ==== 6491+0+0 (secure 0 0 0) 0x7f1868079e90 con 0x7f18700aab60 2023-11-30T18:41:39.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.778+0000 7f186ffff700 1 -- 172.21.15.49:0/2651482172 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f185005f2d0 msgr2=0x7f1850061790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:39.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.778+0000 7f186ffff700 1 --2- 172.21.15.49:0/2651482172 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f185005f2d0 0x7f1850061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:41:39.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.782+0000 7f1867fff700 1 -- 172.21.15.49:0/2651482172 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f186804adf0 con 0x7f18700aab60 2023-11-30T18:41:39.916 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:39.914+0000 7f5c5f1f9680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T18:41:39.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.979+0000 7f186ffff700 1 -- 172.21.15.49:0/2651482172 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f185005f2d0 msgr2=0x7f1850061790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:39.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.979+0000 7f186ffff700 1 --2- 172.21.15.49:0/2651482172 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f185005f2d0 0x7f1850061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T18:41:39.984 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:39.982+0000 7f5c5f1f9680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T18:41:39.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.996+0000 7f1876529700 1 -- 172.21.15.49:0/2651482172 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18700680f0 con 0x7f18700aab60 2023-11-30T18:41:39.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.997+0000 7f1867fff700 1 -- 172.21.15.49:0/2651482172 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4499 (secure 0 0 0) 0x7f186804e410 con 0x7f18700aab60 2023-11-30T18:41:39.999 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:39.999 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":93,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8219,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3124035021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3124035021},{"type":"v1","addr":"172.21.15.115:6837","nonce":3124035021}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":9565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2947558957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2947558957},{"type":"v1","addr":"172.21.15.115:6836","nonce":2947558957}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":9996,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1999244219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1999244219},{"type":"v1","addr":"172.21.15.49:6834","nonce":1999244219}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T18:41:21.351721+0000","modified":"2023-11-30T18:41:24.361310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9999":{"gid":9999,"name":"a","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1129424322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1129424322},{"type":"v1","addr":"172.21.15.49:6835","nonce":1129424322}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-11-30T18:41:40.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.999+0000 7f1876529700 1 -- 172.21.15.49:0/2651482172 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f185005f2d0 msgr2=0x7f1850061790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:41:40.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.999+0000 7f1876529700 1 --2- 172.21.15.49:0/2651482172 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f185005f2d0 0x7f1850061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:40.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.999+0000 7f1876529700 1 -- 172.21.15.49:0/2651482172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18700aab60 msgr2=0x7f18700c49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:40.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.999+0000 7f1876529700 1 --2- 172.21.15.49:0/2651482172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18700aab60 0x7f18700c49b0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 rx=0x7f186800c7f0 tx=0x7f1868001560).stop 2023-11-30T18:41:40.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.999+0000 7f1876529700 1 -- 172.21.15.49:0/2651482172 shutdown_connections 2023-11-30T18:41:40.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.999+0000 7f1876529700 1 --2- 172.21.15.49:0/2651482172 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f185005f2d0 0x7f1850061790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:40.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.999+0000 7f1876529700 1 --2- 172.21.15.49:0/2651482172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18700aab60 0x7f18700c49b0 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:40.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.999+0000 7f1876529700 1 --2- 172.21.15.49:0/2651482172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1870066f40 0x7f187014edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:40.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.999+0000 7f1876529700 1 --2- 172.21.15.49:0/2651482172 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18701544d0 0x7f18700aa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:40.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.999+0000 7f1876529700 1 -- 172.21.15.49:0/2651482172 >> 172.21.15.49:0/2651482172 conn(0x7f18700631d0 msgr2=0x7f187014fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:40.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.999+0000 7f1876529700 1 -- 172.21.15.49:0/2651482172 shutdown_connections 2023-11-30T18:41:40.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:39.999+0000 7f1876529700 1 -- 172.21.15.49:0/2651482172 wait complete. 2023-11-30T18:41:40.002 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 93 2023-11-30T18:41:40.013 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:41:40.060 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:40.058+0000 7f5c5f1f9680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T18:41:40.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.174+0000 7f4d520e5700 1 Processor -- start 2023-11-30T18:41:40.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.174+0000 7f4d520e5700 1 -- start start 2023-11-30T18:41:40.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.175+0000 7f4d520e5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4d4c1542d0 0x7f4d4c0697f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:40.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.175+0000 7f4d520e5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d4c062e10 0x7f4d4c0661b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:40.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.175+0000 7f4d520e5700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4c065760 con 0x7f4d4c069ce0 2023-11-30T18:41:40.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.175+0000 7f4d520e5700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4c0c3250 con 0x7f4d4c1542d0 2023-11-30T18:41:40.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.175+0000 7f4d520e5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c06a340 con 0x7f4d4c062e10 2023-11-30T18:41:40.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.175+0000 7f4d4b7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4d4c1542d0 0x7f4d4c0697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:40.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.175+0000 7f4d4b7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4d4c1542d0 0x7f4d4c0697f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34674/0 (socket says 172.21.15.49:34674) 2023-11-30T18:41:40.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.175+0000 7f4d4b7fe700 1 -- 172.21.15.49:0/743348106 learned_addr learned my addr 172.21.15.49:0/743348106 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:40.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.175+0000 7f4d4bfff700 1 --2- 172.21.15.49:0/743348106 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d4c062e10 0x7f4d4c0661b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:40.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.176+0000 7f4d4b7fe700 1 -- 172.21.15.49:0/743348106 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d4c062e10 msgr2=0x7f4d4c0661b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:40.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.176+0000 7f4d4b7fe700 1 --2- 172.21.15.49:0/743348106 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d4c062e10 0x7f4d4c0661b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:40.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.176+0000 7f4d4b7fe700 1 -- 172.21.15.49:0/743348106 >> v1:172.21.15.115:6789/0 conn(0x7f4d4c069ce0 legacy=0x7f4d4c062700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:40.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.176+0000 7f4d4b7fe700 1 -- 172.21.15.49:0/743348106 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c06a620 con 0x7f4d4c1542d0 2023-11-30T18:41:40.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.176+0000 7f4d4b7fe700 1 --2- 172.21.15.49:0/743348106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d4c1542d0 0x7f4d4c0697f0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 rx=0x7f4d34006fd0 tx=0x7f4d340090f0).ready entity=mon.0 client_cookie=ddaf36503d7458a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:40.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.176+0000 7f4d4a7fc700 1 -- 172.21.15.49:0/743348106 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3400b580 con 0x7f4d4c1542d0 2023-11-30T18:41:40.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.176+0000 7f4d4a7fc700 1 -- 172.21.15.49:0/743348106 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3400b6e0 con 0x7f4d4c1542d0 2023-11-30T18:41:40.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.176+0000 7f4d4a7fc700 1 -- 172.21.15.49:0/743348106 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3400ba60 con 0x7f4d4c1542d0 2023-11-30T18:41:40.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.176+0000 7f4d520e5700 1 -- 172.21.15.49:0/743348106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d4c1542d0 msgr2=0x7f4d4c0697f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:40.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.176+0000 7f4d520e5700 1 --2- 172.21.15.49:0/743348106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d4c1542d0 0x7f4d4c0697f0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 rx=0x7f4d34006fd0 tx=0x7f4d340090f0).stop 2023-11-30T18:41:40.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.177+0000 7f4d520e5700 1 -- 172.21.15.49:0/743348106 shutdown_connections 2023-11-30T18:41:40.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.177+0000 7f4d520e5700 1 --2- 172.21.15.49:0/743348106 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d4c062e10 0x7f4d4c0661b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:40.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.177+0000 7f4d520e5700 1 --2- 172.21.15.49:0/743348106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d4c1542d0 0x7f4d4c0697f0 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:40.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.177+0000 7f4d520e5700 1 -- 172.21.15.49:0/743348106 >> 172.21.15.49:0/743348106 conn(0x7f4d4c0c7fd0 msgr2=0x7f4d4c0c83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:40.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.177+0000 7f4d520e5700 1 -- 172.21.15.49:0/743348106 shutdown_connections 2023-11-30T18:41:40.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.177+0000 7f4d520e5700 1 -- 172.21.15.49:0/743348106 wait complete. 2023-11-30T18:41:40.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.178+0000 7f4d520e5700 1 Processor -- start 2023-11-30T18:41:40.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.178+0000 7f4d520e5700 1 -- start start 2023-11-30T18:41:40.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.179+0000 7f4d520e5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d4c062e10 0x7f4d4c164530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:40.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.179+0000 7f4d520e5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d4c069ce0 0x7f4d4c167ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:40.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.179+0000 7f4d520e5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d4c1542d0 0x7f4d4c167210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:40.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.179+0000 7f4d520e5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c0a97f0 con 0x7f4d4c1542d0 2023-11-30T18:41:40.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.179+0000 7f4d520e5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c164a20 con 0x7f4d4c069ce0 2023-11-30T18:41:40.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.179+0000 7f4d520e5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c168310 con 0x7f4d4c062e10 2023-11-30T18:41:40.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.179+0000 7f4d4bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d4c1542d0 0x7f4d4c167210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:40.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.179+0000 7f4d4bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d4c1542d0 0x7f4d4c167210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34678/0 (socket says 172.21.15.49:34678) 2023-11-30T18:41:40.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.179+0000 7f4d4bfff700 1 -- 172.21.15.49:0/1296147641 learned_addr learned my addr 172.21.15.49:0/1296147641 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:40.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.179+0000 7f4d4b7fe700 1 --2- 172.21.15.49:0/1296147641 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d4c062e10 0x7f4d4c164530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:40.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.179+0000 7f4d4affd700 1 --2- 172.21.15.49:0/1296147641 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d4c069ce0 0x7f4d4c167ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:40.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.179+0000 7f4d4bfff700 1 -- 172.21.15.49:0/1296147641 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d4c062e10 msgr2=0x7f4d4c164530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:40.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.179+0000 7f4d4bfff700 1 --2- 172.21.15.49:0/1296147641 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d4c062e10 0x7f4d4c164530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:40.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.179+0000 7f4d4bfff700 1 -- 172.21.15.49:0/1296147641 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d4c069ce0 msgr2=0x7f4d4c167ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:40.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.179+0000 7f4d4bfff700 1 --2- 172.21.15.49:0/1296147641 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d4c069ce0 0x7f4d4c167ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:40.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.179+0000 7f4d4bfff700 1 -- 172.21.15.49:0/1296147641 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d34009370 con 0x7f4d4c1542d0 2023-11-30T18:41:40.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.179+0000 7f4d4bfff700 1 --2- 172.21.15.49:0/1296147641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d4c1542d0 0x7f4d4c167210 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 rx=0x7f4d44009df0 tx=0x7f4d4400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:40.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.179+0000 7f4d437fe700 1 -- 172.21.15.49:0/1296147641 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4400caa0 con 0x7f4d4c1542d0 2023-11-30T18:41:40.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.179+0000 7f4d437fe700 1 -- 172.21.15.49:0/1296147641 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4400f040 con 0x7f4d4c1542d0 2023-11-30T18:41:40.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.179+0000 7f4d520e5700 1 -- 172.21.15.49:0/1296147641 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d4c1685f0 con 0x7f4d4c1542d0 2023-11-30T18:41:40.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.179+0000 7f4d437fe700 1 -- 172.21.15.49:0/1296147641 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4400ce10 con 0x7f4d4c1542d0 2023-11-30T18:41:40.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.179+0000 7f4d520e5700 1 -- 172.21.15.49:0/1296147641 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d4c0a9480 con 0x7f4d4c1542d0 2023-11-30T18:41:40.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.180+0000 7f4d520e5700 1 -- 172.21.15.49:0/1296147641 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d4c0a99a0 con 0x7f4d4c1542d0 2023-11-30T18:41:40.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.181+0000 7f4d437fe700 1 -- 172.21.15.49:0/1296147641 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 103) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f4d44013610 con 0x7f4d4c1542d0 2023-11-30T18:41:40.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.181+0000 7f4d437fe700 1 --2- 172.21.15.49:0/1296147641 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4d2c05f300 0x7f4d2c0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:40.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.181+0000 7f4d4b7fe700 1 -- 172.21.15.49:0/1296147641 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4d2c05f300 msgr2=0x7f4d2c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:40.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.181+0000 7f4d437fe700 1 -- 172.21.15.49:0/1296147641 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(220..220 src has 1..220) v4 ==== 6491+0+0 (secure 0 0 0) 0x7f4d4407ad80 con 0x7f4d4c1542d0 2023-11-30T18:41:40.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.181+0000 7f4d4b7fe700 1 --2- 172.21.15.49:0/1296147641 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4d2c05f300 0x7f4d2c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:41:40.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.186+0000 7f4d437fe700 1 -- 172.21.15.49:0/1296147641 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4d4c0a99a0 con 0x7f4d4c1542d0 2023-11-30T18:41:40.192 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:40.190+0000 7f8db809f680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-30T18:41:40.207 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:40.205+0000 7f5c5f1f9680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T18:41:40.266 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:40.264+0000 7f8db809f680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T18:41:40.279 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:40.277+0000 7f5c5f1f9680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T18:41:40.346 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:40.344+0000 7f8db809f680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T18:41:40.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.382+0000 7f4d4b7fe700 1 -- 172.21.15.49:0/1296147641 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4d2c05f300 msgr2=0x7f4d2c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:40.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.382+0000 7f4d4b7fe700 1 --2- 172.21.15.49:0/1296147641 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4d2c05f300 0x7f4d2c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-30T18:41:40.394 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:40.392+0000 7f5c5f1f9680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T18:41:40.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.402+0000 7f4d520e5700 1 -- 172.21.15.49:0/1296147641 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d4c06c860 con 0x7f4d4c1542d0 2023-11-30T18:41:40.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.403+0000 7f4d437fe700 1 -- 172.21.15.49:0/1296147641 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4499 (secure 0 0 0) 0x7f4d4407c020 con 0x7f4d4c1542d0 2023-11-30T18:41:40.404 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:40.405 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":93,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8219,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3124035021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3124035021},{"type":"v1","addr":"172.21.15.115:6837","nonce":3124035021}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":9565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2947558957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2947558957},{"type":"v1","addr":"172.21.15.115:6836","nonce":2947558957}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":9996,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1999244219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1999244219},{"type":"v1","addr":"172.21.15.49:6834","nonce":1999244219}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T18:41:21.351721+0000","modified":"2023-11-30T18:41:24.361310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9999":{"gid":9999,"name":"a","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1129424322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1129424322},{"type":"v1","addr":"172.21.15.49:6835","nonce":1129424322}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-11-30T18:41:40.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.405+0000 7f4d520e5700 1 -- 172.21.15.49:0/1296147641 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4d2c05f300 msgr2=0x7f4d2c0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:41:40.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.405+0000 7f4d520e5700 1 --2- 172.21.15.49:0/1296147641 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4d2c05f300 0x7f4d2c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:40.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.405+0000 7f4d520e5700 1 -- 172.21.15.49:0/1296147641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d4c1542d0 msgr2=0x7f4d4c167210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:40.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.405+0000 7f4d520e5700 1 --2- 172.21.15.49:0/1296147641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d4c1542d0 0x7f4d4c167210 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 rx=0x7f4d44009df0 tx=0x7f4d4400b040).stop 2023-11-30T18:41:40.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.405+0000 7f4d520e5700 1 -- 172.21.15.49:0/1296147641 shutdown_connections 2023-11-30T18:41:40.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.405+0000 7f4d520e5700 1 --2- 172.21.15.49:0/1296147641 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4d2c05f300 0x7f4d2c0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:40.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.405+0000 7f4d520e5700 1 --2- 172.21.15.49:0/1296147641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d4c1542d0 0x7f4d4c167210 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:40.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.405+0000 7f4d520e5700 1 --2- 172.21.15.49:0/1296147641 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d4c062e10 0x7f4d4c164530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:40.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.405+0000 7f4d520e5700 1 --2- 172.21.15.49:0/1296147641 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d4c069ce0 0x7f4d4c167ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:40.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.405+0000 7f4d520e5700 1 -- 172.21.15.49:0/1296147641 >> 172.21.15.49:0/1296147641 conn(0x7f4d4c0c7fd0 msgr2=0x7f4d4c0bcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:40.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.405+0000 7f4d520e5700 1 -- 172.21.15.49:0/1296147641 shutdown_connections 2023-11-30T18:41:40.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.405+0000 7f4d520e5700 1 -- 172.21.15.49:0/1296147641 wait complete. 2023-11-30T18:41:40.408 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 93 2023-11-30T18:41:40.422 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:41:40.503 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:40.501+0000 7f5c5f1f9680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:41:40.506 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:40.504+0000 7f8db809f680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T18:41:40.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.541+0000 7f1b9d9fc700 1 Processor -- start 2023-11-30T18:41:40.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.542+0000 7f1b9d9fc700 1 -- start start 2023-11-30T18:41:40.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.542+0000 7f1b9d9fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b981548c0 0x7f1b9806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:40.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.542+0000 7f1b9d9fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1b980c6e30 0x7f1b980c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:40.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.542+0000 7f1b9d9fc700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b980c69a0 con 0x7f1b981544e0 2023-11-30T18:41:40.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.542+0000 7f1b9d9fc700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b980c13a0 con 0x7f1b980c6e30 2023-11-30T18:41:40.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.542+0000 7f1b9d9fc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b980c1680 con 0x7f1b981548c0 2023-11-30T18:41:40.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.543+0000 7f1b977fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1b980c6e30 0x7f1b980c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:40.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.543+0000 7f1b977fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1b980c6e30 0x7f1b980c72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34682/0 (socket says 172.21.15.49:34682) 2023-11-30T18:41:40.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.543+0000 7f1b977fe700 1 -- 172.21.15.49:0/2346243992 learned_addr learned my addr 172.21.15.49:0/2346243992 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:40.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.543+0000 7f1b967fc700 1 --2- 172.21.15.49:0/2346243992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b981548c0 0x7f1b9806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:40.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.543+0000 7f1b977fe700 1 -- 172.21.15.49:0/2346243992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b981548c0 msgr2=0x7f1b9806a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:40.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.543+0000 7f1b977fe700 1 --2- 172.21.15.49:0/2346243992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b981548c0 0x7f1b9806a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:40.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.543+0000 7f1b977fe700 1 -- 172.21.15.49:0/2346243992 >> v1:172.21.15.115:6789/0 conn(0x7f1b981544e0 legacy=0x7f1b980c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:40.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.543+0000 7f1b977fe700 1 -- 172.21.15.49:0/2346243992 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b980c6630 con 0x7f1b980c6e30 2023-11-30T18:41:40.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.543+0000 7f1b967fc700 1 --2- 172.21.15.49:0/2346243992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b981548c0 0x7f1b9806a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:41:40.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.543+0000 7f1b977fe700 1 --2- 172.21.15.49:0/2346243992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b980c6e30 0x7f1b980c72e0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 rx=0x7f1b90009f20 tx=0x7f1b90009840).ready entity=mon.0 client_cookie=52b9b942737df02d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:40.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.543+0000 7f1b95ffb700 1 -- 172.21.15.49:0/2346243992 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9000e070 con 0x7f1b980c6e30 2023-11-30T18:41:40.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.543+0000 7f1b95ffb700 1 -- 172.21.15.49:0/2346243992 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9000ba80 con 0x7f1b980c6e30 2023-11-30T18:41:40.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.543+0000 7f1b95ffb700 1 -- 172.21.15.49:0/2346243992 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9000be00 con 0x7f1b980c6e30 2023-11-30T18:41:40.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.544+0000 7f1b9d9fc700 1 -- 172.21.15.49:0/2346243992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b980c6e30 msgr2=0x7f1b980c72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:40.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.544+0000 7f1b9d9fc700 1 --2- 172.21.15.49:0/2346243992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b980c6e30 0x7f1b980c72e0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 rx=0x7f1b90009f20 tx=0x7f1b90009840).stop 2023-11-30T18:41:40.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.544+0000 7f1b9d9fc700 1 -- 172.21.15.49:0/2346243992 shutdown_connections 2023-11-30T18:41:40.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.544+0000 7f1b9d9fc700 1 --2- 172.21.15.49:0/2346243992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b980c6e30 0x7f1b980c72e0 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:40.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.544+0000 7f1b9d9fc700 1 --2- 172.21.15.49:0/2346243992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b981548c0 0x7f1b9806a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:40.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.544+0000 7f1b9d9fc700 1 -- 172.21.15.49:0/2346243992 >> 172.21.15.49:0/2346243992 conn(0x7f1b98085020 msgr2=0x7f1b98094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:40.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.544+0000 7f1b9d9fc700 1 -- 172.21.15.49:0/2346243992 shutdown_connections 2023-11-30T18:41:40.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.544+0000 7f1b9d9fc700 1 -- 172.21.15.49:0/2346243992 wait complete. 2023-11-30T18:41:40.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.545+0000 7f1b9d9fc700 1 Processor -- start 2023-11-30T18:41:40.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.545+0000 7f1b9d9fc700 1 -- start start 2023-11-30T18:41:40.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.546+0000 7f1b9d9fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b980c6e30 0x7f1b98147560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:40.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.546+0000 7f1b9d9fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b981544e0 0x7f1b980c4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:40.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.546+0000 7f1b9d9fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b981548c0 0x7f1b980c4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:40.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.546+0000 7f1b9d9fc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b98144d40 con 0x7f1b981548c0 2023-11-30T18:41:40.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.546+0000 7f1b9d9fc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b98144810 con 0x7f1b981544e0 2023-11-30T18:41:40.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.546+0000 7f1b9d9fc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9814e9a0 con 0x7f1b980c6e30 2023-11-30T18:41:40.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.546+0000 7f1b977fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b981548c0 0x7f1b980c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:40.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.546+0000 7f1b977fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b981548c0 0x7f1b980c4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34684/0 (socket says 172.21.15.49:34684) 2023-11-30T18:41:40.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.546+0000 7f1b977fe700 1 -- 172.21.15.49:0/3078709460 learned_addr learned my addr 172.21.15.49:0/3078709460 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:40.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.546+0000 7f1b96ffd700 1 --2- 172.21.15.49:0/3078709460 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b980c6e30 0x7f1b98147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:40.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.546+0000 7f1b967fc700 1 --2- 172.21.15.49:0/3078709460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b981544e0 0x7f1b980c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:40.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.546+0000 7f1b977fe700 1 -- 172.21.15.49:0/3078709460 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b980c6e30 msgr2=0x7f1b98147560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:40.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.546+0000 7f1b977fe700 1 --2- 172.21.15.49:0/3078709460 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b980c6e30 0x7f1b98147560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:40.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.546+0000 7f1b977fe700 1 -- 172.21.15.49:0/3078709460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b981544e0 msgr2=0x7f1b980c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:40.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.546+0000 7f1b977fe700 1 --2- 172.21.15.49:0/3078709460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b981544e0 0x7f1b980c4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:40.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.546+0000 7f1b977fe700 1 -- 172.21.15.49:0/3078709460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b90009ae0 con 0x7f1b981548c0 2023-11-30T18:41:40.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.547+0000 7f1b977fe700 1 --2- 172.21.15.49:0/3078709460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b981548c0 0x7f1b980c4710 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 rx=0x7f1b9000b6c0 tx=0x7f1b90009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:40.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.547+0000 7f1b8effd700 1 -- 172.21.15.49:0/3078709460 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b90013d80 con 0x7f1b981548c0 2023-11-30T18:41:40.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.547+0000 7f1b8effd700 1 -- 172.21.15.49:0/3078709460 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9001d460 con 0x7f1b981548c0 2023-11-30T18:41:40.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.547+0000 7f1b9d9fc700 1 -- 172.21.15.49:0/3078709460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b9814ec80 con 0x7f1b981548c0 2023-11-30T18:41:40.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.547+0000 7f1b8effd700 1 -- 172.21.15.49:0/3078709460 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9001d820 con 0x7f1b981548c0 2023-11-30T18:41:40.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.547+0000 7f1b9d9fc700 1 -- 172.21.15.49:0/3078709460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b9814f240 con 0x7f1b981548c0 2023-11-30T18:41:40.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.548+0000 7f1b9d9fc700 1 -- 172.21.15.49:0/3078709460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b9806c860 con 0x7f1b981548c0 2023-11-30T18:41:40.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.548+0000 7f1b8effd700 1 -- 172.21.15.49:0/3078709460 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 103) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f1b90003040 con 0x7f1b981548c0 2023-11-30T18:41:40.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.548+0000 7f1b8effd700 1 --2- 172.21.15.49:0/3078709460 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f1b7805f300 0x7f1b780617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:40.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.549+0000 7f1b8effd700 1 -- 172.21.15.49:0/3078709460 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(220..220 src has 1..220) v4 ==== 6491+0+0 (secure 0 0 0) 0x7f1b9007bda0 con 0x7f1b981548c0 2023-11-30T18:41:40.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.549+0000 7f1b96ffd700 1 -- 172.21.15.49:0/3078709460 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f1b7805f300 msgr2=0x7f1b780617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:40.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.549+0000 7f1b96ffd700 1 --2- 172.21.15.49:0/3078709460 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f1b7805f300 0x7f1b780617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:41:40.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.553+0000 7f1b8effd700 1 -- 172.21.15.49:0/3078709460 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1b9004cbf0 con 0x7f1b981548c0 2023-11-30T18:41:40.584 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:40.582+0000 7f8db809f680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T18:41:40.707 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:40.705+0000 7f8db809f680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T18:41:40.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.726+0000 7f1b9d9fc700 1 -- 172.21.15.49:0/3078709460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b9814f880 con 0x7f1b981548c0 2023-11-30T18:41:40.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.727+0000 7f1b8effd700 1 -- 172.21.15.49:0/3078709460 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v220) v1 ==== 74+0+17495 (secure 0 0 0) 0x7f1b9814f880 con 0x7f1b981548c0 2023-11-30T18:41:40.729 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:40.729 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":220,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:41:33.621384+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"208","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-11-30T18:41:19.292113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"218","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-11-30T18:41:20.340870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"219","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/1773998477":"2023-12-01T18:41:33.621332+0000","172.21.15.115:6833/103051":"2023-12-01T18:41:33.621332+0000","172.21.15.115:6832/103051":"2023-12-01T18:41:33.621332+0000","172.21.15.115:0/3037216069":"2023-12-01T18:41:33.621332+0000","172.21.15.115:0/467841810":"2023-12-01T18:41:33.621332+0000","172.21.15.115:0/107175683":"2023-12-01T18:41:33.621332+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:41:40.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.729+0000 7f1b9d9fc700 1 -- 172.21.15.49:0/3078709460 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f1b7805f300 msgr2=0x7f1b780617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:41:40.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.729+0000 7f1b9d9fc700 1 --2- 172.21.15.49:0/3078709460 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f1b7805f300 0x7f1b780617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:40.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.729+0000 7f1b9d9fc700 1 -- 172.21.15.49:0/3078709460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b981548c0 msgr2=0x7f1b980c4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:40.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.729+0000 7f1b9d9fc700 1 --2- 172.21.15.49:0/3078709460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b981548c0 0x7f1b980c4710 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 rx=0x7f1b9000b6c0 tx=0x7f1b90009840).stop 2023-11-30T18:41:40.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.729+0000 7f1b9d9fc700 1 -- 172.21.15.49:0/3078709460 shutdown_connections 2023-11-30T18:41:40.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.729+0000 7f1b9d9fc700 1 --2- 172.21.15.49:0/3078709460 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f1b7805f300 0x7f1b780617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:40.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.729+0000 7f1b9d9fc700 1 --2- 172.21.15.49:0/3078709460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b981548c0 0x7f1b980c4710 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:40.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.729+0000 7f1b9d9fc700 1 --2- 172.21.15.49:0/3078709460 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b980c6e30 0x7f1b98147560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:40.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.729+0000 7f1b9d9fc700 1 --2- 172.21.15.49:0/3078709460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b981544e0 0x7f1b980c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:40.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.729+0000 7f1b9d9fc700 1 -- 172.21.15.49:0/3078709460 >> 172.21.15.49:0/3078709460 conn(0x7f1b98085020 msgr2=0x7f1b980b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:40.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.729+0000 7f1b9d9fc700 1 -- 172.21.15.49:0/3078709460 shutdown_connections 2023-11-30T18:41:40.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.729+0000 7f1b9d9fc700 1 -- 172.21.15.49:0/3078709460 wait complete. 2023-11-30T18:41:40.744 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-30T18:41:40.793 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:40.792+0000 7f5c5f1f9680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T18:41:40.825 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:40.823+0000 7f8db809f680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T18:41:40.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.863+0000 7f1519719700 1 Processor -- start 2023-11-30T18:41:40.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.863+0000 7f1519719700 1 -- start start 2023-11-30T18:41:40.866 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:40.864+0000 7f5c5f1f9680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T18:41:40.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.864+0000 7f1519719700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1514155830 0x7f1514155c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:40.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.864+0000 7f1519719700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f15140c3090 0x7f15140c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:40.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.864+0000 7f1519719700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15141529c0 con 0x7f1514155030 2023-11-30T18:41:40.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.864+0000 7f1519719700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15141554b0 con 0x7f15140c3090 2023-11-30T18:41:40.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.864+0000 7f1519719700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1514151db0 con 0x7f1514155830 2023-11-30T18:41:40.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.864+0000 7f15137fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f15140c3090 0x7f15140c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:40.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.864+0000 7f15137fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f15140c3090 0x7f15140c5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58842/0 (socket says 172.21.15.49:58842) 2023-11-30T18:41:40.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.864+0000 7f15137fe700 1 -- 172.21.15.49:0/944365116 learned_addr learned my addr 172.21.15.49:0/944365116 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:40.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.864+0000 7f1512ffd700 1 --2- 172.21.15.49:0/944365116 >> v2:172.21.15.115:3300/0 conn(0x7f1514155830 0x7f1514155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:40.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.864+0000 7f15137fe700 1 -- 172.21.15.49:0/944365116 >> v2:172.21.15.115:3300/0 conn(0x7f1514155830 msgr2=0x7f1514155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:40.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.864+0000 7f15137fe700 1 --2- 172.21.15.49:0/944365116 >> v2:172.21.15.115:3300/0 conn(0x7f1514155830 0x7f1514155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:40.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.864+0000 7f15137fe700 1 -- 172.21.15.49:0/944365116 >> v1:172.21.15.49:6789/0 conn(0x7f1514155030 legacy=0x7f15140c2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:40.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.864+0000 7f15137fe700 1 -- 172.21.15.49:0/944365116 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1514152090 con 0x7f15140c3090 2023-11-30T18:41:40.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.864+0000 7f1511ffb700 1 -- 172.21.15.49:0/944365116 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2120302496 0 0) 0x7f15141529c0 con 0x7f1514155030 2023-11-30T18:41:40.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.865+0000 7f15137fe700 1 --2- 172.21.15.49:0/944365116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15140c3090 0x7f15140c5ec0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 rx=0x7f15140bc3a0 tx=0x7f150c009840).ready entity=mon.0 client_cookie=b6d042806a3dc35b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:40.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.865+0000 7f1511ffb700 1 -- 172.21.15.49:0/944365116 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c00e070 con 0x7f15140c3090 2023-11-30T18:41:40.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.865+0000 7f1511ffb700 1 -- 172.21.15.49:0/944365116 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150c00ba20 con 0x7f15140c3090 2023-11-30T18:41:40.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.865+0000 7f1511ffb700 1 -- 172.21.15.49:0/944365116 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c00bda0 con 0x7f15140c3090 2023-11-30T18:41:40.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.865+0000 7f1519719700 1 -- 172.21.15.49:0/944365116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15140c3090 msgr2=0x7f15140c5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:40.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.865+0000 7f1519719700 1 --2- 172.21.15.49:0/944365116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15140c3090 0x7f15140c5ec0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 rx=0x7f15140bc3a0 tx=0x7f150c009840).stop 2023-11-30T18:41:40.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.865+0000 7f1519719700 1 -- 172.21.15.49:0/944365116 shutdown_connections 2023-11-30T18:41:40.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.865+0000 7f1519719700 1 --2- 172.21.15.49:0/944365116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15140c3090 0x7f15140c5ec0 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:40.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.865+0000 7f1519719700 1 --2- 172.21.15.49:0/944365116 >> v2:172.21.15.115:3300/0 conn(0x7f1514155830 0x7f1514155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:40.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.865+0000 7f1519719700 1 -- 172.21.15.49:0/944365116 >> 172.21.15.49:0/944365116 conn(0x7f1514062700 msgr2=0x7f1514062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:40.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.865+0000 7f1519719700 1 -- 172.21.15.49:0/944365116 shutdown_connections 2023-11-30T18:41:40.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.865+0000 7f1519719700 1 -- 172.21.15.49:0/944365116 wait complete. 2023-11-30T18:41:40.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.867+0000 7f1519719700 1 Processor -- start 2023-11-30T18:41:40.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.867+0000 7f1519719700 1 -- start start 2023-11-30T18:41:40.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.867+0000 7f1519719700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15140c3090 0x7f1514151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:40.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.867+0000 7f1519719700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1514155030 0x7f151414d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:40.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.867+0000 7f1519719700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1514155830 0x7f1514064c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:40.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.868+0000 7f1519719700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15140a66f0 con 0x7f1514155030 2023-11-30T18:41:40.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.868+0000 7f1519719700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15140a7550 con 0x7f15140c3090 2023-11-30T18:41:40.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.868+0000 7f1519719700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15140a6940 con 0x7f1514155830 2023-11-30T18:41:40.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.868+0000 7f15127fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1514155030 0x7f151414d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:40.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.868+0000 7f15127fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1514155030 0x7f151414d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58850/0 (socket says 172.21.15.49:58850) 2023-11-30T18:41:40.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.868+0000 7f15127fc700 1 -- 172.21.15.49:0/2649391998 learned_addr learned my addr 172.21.15.49:0/2649391998 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:40.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.868+0000 7f1512ffd700 1 --2- 172.21.15.49:0/2649391998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15140c3090 0x7f1514151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:40.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.868+0000 7f15137fe700 1 --2- 172.21.15.49:0/2649391998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1514155830 0x7f1514064c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:40.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.868+0000 7f15127fc700 1 -- 172.21.15.49:0/2649391998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1514155830 msgr2=0x7f1514064c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:40.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.868+0000 7f15127fc700 1 --2- 172.21.15.49:0/2649391998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1514155830 0x7f1514064c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:40.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.868+0000 7f15127fc700 1 -- 172.21.15.49:0/2649391998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15140c3090 msgr2=0x7f1514151030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:40.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.868+0000 7f15127fc700 1 --2- 172.21.15.49:0/2649391998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15140c3090 0x7f1514151030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:40.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.868+0000 7f15127fc700 1 -- 172.21.15.49:0/2649391998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150c009ae0 con 0x7f1514155030 2023-11-30T18:41:40.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.868+0000 7f1512ffd700 1 --2- 172.21.15.49:0/2649391998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15140c3090 0x7f1514151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:41:40.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.868+0000 7f15127fc700 1 --2- 172.21.15.49:0/2649391998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1514155030 0x7f151414d870 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 rx=0x7f1504001eb0 tx=0x7f1504007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:40.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.868+0000 7f14faffd700 1 -- 172.21.15.49:0/2649391998 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150400ce60 con 0x7f1514155030 2023-11-30T18:41:40.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.868+0000 7f14faffd700 1 -- 172.21.15.49:0/2649391998 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150400f470 con 0x7f1514155030 2023-11-30T18:41:40.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.868+0000 7f1519719700 1 -- 172.21.15.49:0/2649391998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15140a6c20 con 0x7f1514155030 2023-11-30T18:41:40.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.868+0000 7f14faffd700 1 -- 172.21.15.49:0/2649391998 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150400f810 con 0x7f1514155030 2023-11-30T18:41:40.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.869+0000 7f1519719700 1 -- 172.21.15.49:0/2649391998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15140a71e0 con 0x7f1514155030 2023-11-30T18:41:40.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.870+0000 7f1519719700 1 -- 172.21.15.49:0/2649391998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15140a7700 con 0x7f1514155030 2023-11-30T18:41:40.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.870+0000 7f14faffd700 1 -- 172.21.15.49:0/2649391998 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 103) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f150400fb80 con 0x7f1514155030 2023-11-30T18:41:40.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.870+0000 7f14faffd700 1 --2- 172.21.15.49:0/2649391998 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f150005f300 0x7f15000617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:40.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.870+0000 7f14faffd700 1 -- 172.21.15.49:0/2649391998 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(220..220 src has 1..220) v4 ==== 6491+0+0 (secure 0 0 0) 0x7f1504079a70 con 0x7f1514155030 2023-11-30T18:41:40.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.870+0000 7f1512ffd700 1 -- 172.21.15.49:0/2649391998 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f150005f300 msgr2=0x7f15000617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6832/103051 2023-11-30T18:41:40.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.870+0000 7f1512ffd700 1 --2- 172.21.15.49:0/2649391998 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f150005f300 0x7f15000617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-30T18:41:40.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.874+0000 7f14faffd700 1 -- 172.21.15.49:0/2649391998 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f15140a7700 con 0x7f1514155030 2023-11-30T18:41:40.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.886+0000 7f14faffd700 1 -- 172.21.15.49:0/2649391998 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 104) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f15040774d0 con 0x7f1514155030 2023-11-30T18:41:40.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.886+0000 7f14faffd700 1 -- 172.21.15.49:0/2649391998 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f150005f300 msgr2=0x7f15000617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T18:41:40.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:40.886+0000 7f14faffd700 1 --2- 172.21.15.49:0/2649391998 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f150005f300 0x7f15000617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:40.933 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:40.931+0000 7f5bdc190700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:41:40.933 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:40.931+0000 7f5bdc190700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:41:40.933 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:40.931+0000 7f5bdc190700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:41:40.933 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:40.931+0000 7f5bdc190700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:41:40.934 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:40.931+0000 7f5bdc190700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:41:40.934 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:40.932+0000 7f5bd998b700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:41:40.934 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:40.932+0000 7f5bd998b700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:41:40.934 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:40.932+0000 7f5bd998b700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:41:40.934 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:40.932+0000 7f5bd998b700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:41:40.934 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-11-30T18:41:40.932+0000 7f5bd998b700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-30T18:41:41.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:41.098+0000 7f1519719700 1 -- 172.21.15.49:0/2649391998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f15140a76c0 con 0x7f1514155030 2023-11-30T18:41:41.136 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:41.135+0000 7f8db809f680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T18:41:41.171 INFO:tasks.ceph.mds.a.smithi049.stderr:2023-11-30T18:41:41.170+0000 7f807c545700 -1 MDSIOContextBase: failed with -108, restarting... 2023-11-30T18:41:41.175 INFO:tasks.ceph.mds.a.smithi049.stderr: -2696> 2023-11-30T18:41:26.581+0000 7f807fd4c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-30T18:41:41.178 INFO:tasks.ceph.mds.a.smithi049.stderr: -1> 2023-11-30T18:41:41.170+0000 7f807c545700 -1 MDSIOContextBase: failed with -108, restarting... 2023-11-30T18:41:41.198 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-11-30T18:41:41.217 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-30T18:41:41.215+0000 7f8db809f680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T18:41:41.882 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-11-30T18:41:41.880+0000 7f3888d95700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-30T18:41:41.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:41.885+0000 7f14faffd700 1 -- 172.21.15.49:0/2649391998 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mgrmap(e 105) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f1504077850 con 0x7f1514155030 2023-11-30T18:41:41.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:41.886+0000 7f14faffd700 1 --2- 172.21.15.49:0/2649391998 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f150005f300 0x7f1500061740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:41.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:41.887+0000 7f1512ffd700 1 --2- 172.21.15.49:0/2649391998 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f150005f300 0x7f1500061740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:41.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:41.888+0000 7f1512ffd700 1 --2- 172.21.15.49:0/2649391998 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f150005f300 0x7f1500061740 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f1508009860 tx=0x7f1508009060).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:41.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:41.891+0000 7f14faffd700 1 -- 172.21.15.49:0/2649391998 <== mon.0 v2:172.21.15.49:3300/0 9 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v94) v1 ==== 161+0+0 (secure 0 0 0) 0x7f150404b9e0 con 0x7f1514155030 2023-11-30T18:41:41.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:41.893+0000 7f1519719700 1 -- 172.21.15.49:0/2649391998 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f150005f300 msgr2=0x7f1500061740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:41.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:41.893+0000 7f1519719700 1 --2- 172.21.15.49:0/2649391998 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f150005f300 0x7f1500061740 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f1508009860 tx=0x7f1508009060).stop 2023-11-30T18:41:41.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:41.893+0000 7f1519719700 1 -- 172.21.15.49:0/2649391998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1514155030 msgr2=0x7f151414d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:41.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:41.893+0000 7f1519719700 1 --2- 172.21.15.49:0/2649391998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1514155030 0x7f151414d870 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 rx=0x7f1504001eb0 tx=0x7f1504007c70).stop 2023-11-30T18:41:41.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:41.893+0000 7f1519719700 1 -- 172.21.15.49:0/2649391998 shutdown_connections 2023-11-30T18:41:41.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:41.893+0000 7f1519719700 1 --2- 172.21.15.49:0/2649391998 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f150005f300 0x7f1500061740 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:41.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:41.893+0000 7f1519719700 1 --2- 172.21.15.49:0/2649391998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1514155830 0x7f1514064c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:41.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:41.893+0000 7f1519719700 1 --2- 172.21.15.49:0/2649391998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15140c3090 0x7f1514151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:41.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:41.893+0000 7f1519719700 1 --2- 172.21.15.49:0/2649391998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1514155030 0x7f151414d870 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:41.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:41.893+0000 7f1519719700 1 -- 172.21.15.49:0/2649391998 >> 172.21.15.49:0/2649391998 conn(0x7f1514062700 msgr2=0x7f15140c5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:41.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:41.894+0000 7f1519719700 1 -- 172.21.15.49:0/2649391998 shutdown_connections 2023-11-30T18:41:41.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:41.894+0000 7f1519719700 1 -- 172.21.15.49:0/2649391998 wait complete. 2023-11-30T18:41:41.897 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-30T18:41:41.909 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-30T18:41:42.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.028+0000 7f46f7818700 1 Processor -- start 2023-11-30T18:41:42.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.028+0000 7f46f7818700 1 -- start start 2023-11-30T18:41:42.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.029+0000 7f46f7818700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46f0098d10 0x7f46f00c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:42.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.029+0000 7f46f7818700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f46f00c6190 0x7f46f0063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:42.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.029+0000 7f46f7818700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46f00c72d0 con 0x7f46f0064350 2023-11-30T18:41:42.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.029+0000 7f46f7818700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f0154bc0 con 0x7f46f00c6190 2023-11-30T18:41:42.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.029+0000 7f46f7818700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f00c66c0 con 0x7f46f0098d10 2023-11-30T18:41:42.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.029+0000 7f46f5db5700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f46f0064350 0x7f46f0158320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50506/0 (socket says 172.21.15.49:50506) 2023-11-30T18:41:42.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.029+0000 7f46f5db5700 1 -- 172.21.15.49:0/1243915052 learned_addr learned my addr 172.21.15.49:0/1243915052 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:42.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.030+0000 7f46f4db3700 1 --2- 172.21.15.49:0/1243915052 >> v2:172.21.15.115:3300/0 conn(0x7f46f00c6190 0x7f46f0063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:42.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.030+0000 7f46f55b4700 1 --2- 172.21.15.49:0/1243915052 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46f0098d10 0x7f46f00c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:42.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.030+0000 7f46effff700 1 -- 172.21.15.49:0/1243915052 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2574878493 0 0) 0x7f46f00c72d0 con 0x7f46f0064350 2023-11-30T18:41:42.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.030+0000 7f46effff700 1 -- 172.21.15.49:0/1243915052 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46d80033f0 con 0x7f46f0064350 2023-11-30T18:41:42.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.030+0000 7f46f4db3700 1 -- 172.21.15.49:0/1243915052 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46f0098d10 msgr2=0x7f46f00c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:42.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.030+0000 7f46effff700 1 -- 172.21.15.49:0/1243915052 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1188492261 0 0) 0x7f46d80033f0 con 0x7f46f0064350 2023-11-30T18:41:42.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.030+0000 7f46f4db3700 1 --2- 172.21.15.49:0/1243915052 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46f0098d10 0x7f46f00c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:42.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.030+0000 7f46f4db3700 1 -- 172.21.15.49:0/1243915052 >> v1:172.21.15.49:6789/0 conn(0x7f46f0064350 legacy=0x7f46f0158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:42.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.030+0000 7f46f4db3700 1 -- 172.21.15.49:0/1243915052 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f00c69a0 con 0x7f46f00c6190 2023-11-30T18:41:42.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.030+0000 7f46f4db3700 1 --2- 172.21.15.49:0/1243915052 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f00c6190 0x7f46f0063e60 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f46e4009760 tx=0x7f46e4009060).ready entity=mon.1 client_cookie=e91808f52d8bb70d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:42.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.030+0000 7f46effff700 1 -- 172.21.15.49:0/1243915052 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e00017f0 con 0x7f46f00c6190 2023-11-30T18:41:42.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.030+0000 7f46effff700 1 -- 172.21.15.49:0/1243915052 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e4011400 con 0x7f46f00c6190 2023-11-30T18:41:42.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.030+0000 7f46effff700 1 -- 172.21.15.49:0/1243915052 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e4011780 con 0x7f46f00c6190 2023-11-30T18:41:42.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.031+0000 7f46f7818700 1 -- 172.21.15.49:0/1243915052 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f00c6190 msgr2=0x7f46f0063e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:42.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.031+0000 7f46f7818700 1 --2- 172.21.15.49:0/1243915052 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f00c6190 0x7f46f0063e60 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f46e4009760 tx=0x7f46e4009060).stop 2023-11-30T18:41:42.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.031+0000 7f46f7818700 1 -- 172.21.15.49:0/1243915052 shutdown_connections 2023-11-30T18:41:42.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.031+0000 7f46f7818700 1 --2- 172.21.15.49:0/1243915052 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46f0098d10 0x7f46f00c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:42.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.031+0000 7f46f7818700 1 --2- 172.21.15.49:0/1243915052 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f00c6190 0x7f46f0063e60 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:42.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.031+0000 7f46f7818700 1 -- 172.21.15.49:0/1243915052 >> 172.21.15.49:0/1243915052 conn(0x7f46f00cb310 msgr2=0x7f46f00cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:42.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.031+0000 7f46f7818700 1 -- 172.21.15.49:0/1243915052 shutdown_connections 2023-11-30T18:41:42.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.031+0000 7f46f7818700 1 -- 172.21.15.49:0/1243915052 wait complete. 2023-11-30T18:41:42.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.032+0000 7f46f7818700 1 Processor -- start 2023-11-30T18:41:42.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.032+0000 7f46f7818700 1 -- start start 2023-11-30T18:41:42.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.033+0000 7f46f7818700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f0064350 0x7f46f00a9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:42.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.033+0000 7f46f7818700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46f0098d10 0x7f46f01507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:42.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.033+0000 7f46f7818700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f00c6190 0x7f46f00ace60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:42.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.033+0000 7f46f7818700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f00a9570 con 0x7f46f0064350 2023-11-30T18:41:42.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.033+0000 7f46f7818700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f00a8680 con 0x7f46f00c6190 2023-11-30T18:41:42.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.033+0000 7f46f7818700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f00a8960 con 0x7f46f0098d10 2023-11-30T18:41:42.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.033+0000 7f46f55b4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f0064350 0x7f46f00a9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:42.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.033+0000 7f46f55b4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f0064350 0x7f46f00a9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58884/0 (socket says 172.21.15.49:58884) 2023-11-30T18:41:42.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.033+0000 7f46f55b4700 1 -- 172.21.15.49:0/1920078426 learned_addr learned my addr 172.21.15.49:0/1920078426 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:42.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.033+0000 7f46f55b4700 1 -- 172.21.15.49:0/1920078426 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46f0098d10 msgr2=0x7f46f01507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:42.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.033+0000 7f46f5db5700 1 --2- 172.21.15.49:0/1920078426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f00c6190 0x7f46f00ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:42.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.033+0000 7f46f55b4700 1 --2- 172.21.15.49:0/1920078426 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46f0098d10 0x7f46f01507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:42.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.033+0000 7f46f55b4700 1 -- 172.21.15.49:0/1920078426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f00c6190 msgr2=0x7f46f00ace60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:42.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.033+0000 7f46f55b4700 1 --2- 172.21.15.49:0/1920078426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f00c6190 0x7f46f00ace60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:42.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.033+0000 7f46f55b4700 1 -- 172.21.15.49:0/1920078426 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e40092a0 con 0x7f46f0064350 2023-11-30T18:41:42.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.034+0000 7f46f55b4700 1 --2- 172.21.15.49:0/1920078426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f0064350 0x7f46f00a9a00 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 rx=0x7f46e800e930 tx=0x7f46e8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:42.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.034+0000 7f46ed7fa700 1 -- 172.21.15.49:0/1920078426 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e800eed0 con 0x7f46f0064350 2023-11-30T18:41:42.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.034+0000 7f46f7818700 1 -- 172.21.15.49:0/1920078426 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f00a8c40 con 0x7f46f0064350 2023-11-30T18:41:42.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.034+0000 7f46ed7fa700 1 -- 172.21.15.49:0/1920078426 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e800c850 con 0x7f46f0064350 2023-11-30T18:41:42.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.034+0000 7f46ed7fa700 1 -- 172.21.15.49:0/1920078426 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e800cbd0 con 0x7f46f0064350 2023-11-30T18:41:42.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.034+0000 7f46f7818700 1 -- 172.21.15.49:0/1920078426 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f00a9200 con 0x7f46f0064350 2023-11-30T18:41:42.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.035+0000 7f46f7818700 1 -- 172.21.15.49:0/1920078426 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46f00a9850 con 0x7f46f0064350 2023-11-30T18:41:42.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.035+0000 7f46ed7fa700 1 -- 172.21.15.49:0/1920078426 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 105) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f46e801b400 con 0x7f46f0064350 2023-11-30T18:41:42.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.036+0000 7f46ed7fa700 1 --2- 172.21.15.49:0/1920078426 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f46dc05f030 0x7f46dc0614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:42.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.036+0000 7f46ed7fa700 1 -- 172.21.15.49:0/1920078426 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(222..222 src has 1..222) v4 ==== 6792+0+0 (secure 0 0 0) 0x7f46e807a800 con 0x7f46f0064350 2023-11-30T18:41:42.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.036+0000 7f46f4db3700 1 --2- 172.21.15.49:0/1920078426 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f46dc05f030 0x7f46dc0614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:42.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.036+0000 7f46f4db3700 1 --2- 172.21.15.49:0/1920078426 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f46dc05f030 0x7f46dc0614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f46e4009760 tx=0x7f46e4016000).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:42.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.040+0000 7f46ed7fa700 1 -- 172.21.15.49:0/1920078426 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f46e804b9a0 con 0x7f46f0064350 2023-11-30T18:41:42.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:42.261+0000 7f46f7818700 1 -- 172.21.15.49:0/1920078426 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f46f006c860 con 0x7f46f0064350 2023-11-30T18:41:43.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.104+0000 7f46ed7fa700 1 -- 172.21.15.49:0/1920078426 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v95) v1 ==== 104+0+0 (secure 0 0 0) 0x7f46e804efc0 con 0x7f46f0064350 2023-11-30T18:41:43.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.106+0000 7f46f7818700 1 -- 172.21.15.49:0/1920078426 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f46dc05f030 msgr2=0x7f46dc0614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:43.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.106+0000 7f46f7818700 1 --2- 172.21.15.49:0/1920078426 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f46dc05f030 0x7f46dc0614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f46e4009760 tx=0x7f46e4016000).stop 2023-11-30T18:41:43.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.106+0000 7f46f7818700 1 -- 172.21.15.49:0/1920078426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f0064350 msgr2=0x7f46f00a9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:43.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.106+0000 7f46f7818700 1 --2- 172.21.15.49:0/1920078426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f0064350 0x7f46f00a9a00 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 rx=0x7f46e800e930 tx=0x7f46e8009060).stop 2023-11-30T18:41:43.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.107+0000 7f46f7818700 1 -- 172.21.15.49:0/1920078426 shutdown_connections 2023-11-30T18:41:43.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.107+0000 7f46f7818700 1 --2- 172.21.15.49:0/1920078426 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f46dc05f030 0x7f46dc0614f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:43.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.107+0000 7f46f7818700 1 --2- 172.21.15.49:0/1920078426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f00c6190 0x7f46f00ace60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:43.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.107+0000 7f46f7818700 1 --2- 172.21.15.49:0/1920078426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f0064350 0x7f46f00a9a00 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:43.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.107+0000 7f46f7818700 1 --2- 172.21.15.49:0/1920078426 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46f0098d10 0x7f46f01507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:43.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.107+0000 7f46f7818700 1 -- 172.21.15.49:0/1920078426 >> 172.21.15.49:0/1920078426 conn(0x7f46f00cb310 msgr2=0x7f46f0063a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:43.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.107+0000 7f46f7818700 1 -- 172.21.15.49:0/1920078426 shutdown_connections 2023-11-30T18:41:43.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.107+0000 7f46f7818700 1 -- 172.21.15.49:0/1920078426 wait complete. 2023-11-30T18:41:43.122 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-30T18:41:43.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.247+0000 7f92e167e700 1 Processor -- start 2023-11-30T18:41:43.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.247+0000 7f92e167e700 1 -- start start 2023-11-30T18:41:43.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.248+0000 7f92e167e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f92dc14b320 0x7f92dc151f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:43.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.248+0000 7f92e167e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92dc1523f0 con 0x7f92dc14b700 2023-11-30T18:41:43.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.248+0000 7f92e167e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92dc0c3040 con 0x7f92dc064db0 2023-11-30T18:41:43.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.248+0000 7f92e167e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92dc0bd140 con 0x7f92dc14b320 2023-11-30T18:41:43.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.248+0000 7f92da7fc700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f92dc14b700 0x7f92dc0646a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50516/0 (socket says 172.21.15.49:50516) 2023-11-30T18:41:43.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.248+0000 7f92da7fc700 1 -- 172.21.15.49:0/4274329359 learned_addr learned my addr 172.21.15.49:0/4274329359 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:43.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.248+0000 7f92d9ffb700 1 -- 172.21.15.49:0/4274329359 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735127698 0 0) 0x7f92dc1523f0 con 0x7f92dc14b700 2023-11-30T18:41:43.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.248+0000 7f92daffd700 1 --2- 172.21.15.49:0/4274329359 >> v2:172.21.15.115:3300/0 conn(0x7f92dc14b320 0x7f92dc151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:43.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.248+0000 7f92d9ffb700 1 -- 172.21.15.49:0/4274329359 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92c8004500 con 0x7f92dc14b700 2023-11-30T18:41:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.249+0000 7f92d9ffb700 1 -- 172.21.15.49:0/4274329359 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3789363505 0 0) 0x7f92c8004500 con 0x7f92dc14b700 2023-11-30T18:41:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.249+0000 7f92d9ffb700 1 -- 172.21.15.49:0/4274329359 >> v2:172.21.15.115:3300/0 conn(0x7f92dc14b320 msgr2=0x7f92dc151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.249+0000 7f92d9ffb700 1 --2- 172.21.15.49:0/4274329359 >> v2:172.21.15.115:3300/0 conn(0x7f92dc14b320 0x7f92dc151f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.249+0000 7f92d9ffb700 1 -- 172.21.15.49:0/4274329359 >> v1:172.21.15.115:6789/0 conn(0x7f92dc064db0 legacy=0x7f92dc069470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.249+0000 7f92d9ffb700 1 -- 172.21.15.49:0/4274329359 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92dc0bc530 con 0x7f92dc14b700 2023-11-30T18:41:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.249+0000 7f92d9ffb700 1 -- 172.21.15.49:0/4274329359 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f92c4001470 con 0x7f92dc14b700 2023-11-30T18:41:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.249+0000 7f92d9ffb700 1 -- 172.21.15.49:0/4274329359 >> v1:172.21.15.49:6789/0 conn(0x7f92dc14b700 legacy=0x7f92dc0646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.249+0000 7f92d9ffb700 1 --2- 172.21.15.49:0/4274329359 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92c80049f0 0x7f92c8004e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.249+0000 7f92d9ffb700 1 --2- 172.21.15.49:0/4274329359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92c80057a0 0x7f92c8005c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.249+0000 7f92d9ffb700 1 --2- 172.21.15.49:0/4274329359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92c8006160 0x7f92c800c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.249+0000 7f92d9ffb700 1 -- 172.21.15.49:0/4274329359 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc0bd140 con 0x7f92c8006160 2023-11-30T18:41:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.249+0000 7f92d9ffb700 1 -- 172.21.15.49:0/4274329359 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c800d0f0 con 0x7f92c80057a0 2023-11-30T18:41:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.249+0000 7f92d9ffb700 1 -- 172.21.15.49:0/4274329359 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c800d2b0 con 0x7f92c80049f0 2023-11-30T18:41:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.249+0000 7f92db7fe700 1 --2- 172.21.15.49:0/4274329359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92c8006160 0x7f92c800c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:43.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.249+0000 7f92da7fc700 1 --2- 172.21.15.49:0/4274329359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92c80057a0 0x7f92c8005c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:43.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.249+0000 7f92daffd700 1 --2- 172.21.15.49:0/4274329359 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92c80049f0 0x7f92c8004e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:43.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.249+0000 7f92db7fe700 1 -- 172.21.15.49:0/4274329359 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92c80049f0 msgr2=0x7f92c8004e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:43.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.249+0000 7f92db7fe700 1 --2- 172.21.15.49:0/4274329359 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92c80049f0 0x7f92c8004e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:43.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.249+0000 7f92db7fe700 1 -- 172.21.15.49:0/4274329359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92c80057a0 msgr2=0x7f92c8005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:43.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.249+0000 7f92db7fe700 1 --2- 172.21.15.49:0/4274329359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92c80057a0 0x7f92c8005c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:43.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.249+0000 7f92db7fe700 1 -- 172.21.15.49:0/4274329359 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c8004500 con 0x7f92c8006160 2023-11-30T18:41:43.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.249+0000 7f92db7fe700 1 -- 172.21.15.49:0/4274329359 reap_dead start 2023-11-30T18:41:43.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.249+0000 7f92db7fe700 1 --2- 172.21.15.49:0/4274329359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92c8006160 0x7f92c800c9f0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 rx=0x7f92d4001e00 tx=0x7f92d4007f30).ready entity=mon.0 client_cookie=984ef33aed4be7d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:43.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.250+0000 7f92d9ffb700 1 -- 172.21.15.49:0/4274329359 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d4006a20 con 0x7f92c8006160 2023-11-30T18:41:43.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.250+0000 7f92d9ffb700 1 -- 172.21.15.49:0/4274329359 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d4006b80 con 0x7f92c8006160 2023-11-30T18:41:43.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.250+0000 7f92d9ffb700 1 -- 172.21.15.49:0/4274329359 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d400c5d0 con 0x7f92c8006160 2023-11-30T18:41:43.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.250+0000 7f92e167e700 1 -- 172.21.15.49:0/4274329359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92c8006160 msgr2=0x7f92c800c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:43.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.250+0000 7f92e167e700 1 --2- 172.21.15.49:0/4274329359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92c8006160 0x7f92c800c9f0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 rx=0x7f92d4001e00 tx=0x7f92d4007f30).stop 2023-11-30T18:41:43.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.250+0000 7f92e167e700 1 -- 172.21.15.49:0/4274329359 shutdown_connections 2023-11-30T18:41:43.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.250+0000 7f92e167e700 1 --2- 172.21.15.49:0/4274329359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92c8006160 0x7f92c800c9f0 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:43.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.250+0000 7f92e167e700 1 -- 172.21.15.49:0/4274329359 >> 172.21.15.49:0/4274329359 conn(0x7f92dc062700 msgr2=0x7f92dc062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:43.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.250+0000 7f92e167e700 1 -- 172.21.15.49:0/4274329359 shutdown_connections 2023-11-30T18:41:43.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.250+0000 7f92e167e700 1 -- 172.21.15.49:0/4274329359 wait complete. 2023-11-30T18:41:43.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.251+0000 7f92e167e700 1 Processor -- start 2023-11-30T18:41:43.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.252+0000 7f92e167e700 1 -- start start 2023-11-30T18:41:43.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.252+0000 7f92e167e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92c8006160 0x7f92dc0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:43.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.252+0000 7f92e167e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92dc0c6780 0x7f92dc164a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:43.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.252+0000 7f92e167e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92dc164f30 0x7f92dc1653b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:43.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.252+0000 7f92e167e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc14bb00 con 0x7f92dc164f30 2023-11-30T18:41:43.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.252+0000 7f92e167e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc0a5860 con 0x7f92c8006160 2023-11-30T18:41:43.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.252+0000 7f92e167e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc0a5b40 con 0x7f92dc0c6780 2023-11-30T18:41:43.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.252+0000 7f92db7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92dc164f30 0x7f92dc1653b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:43.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.252+0000 7f92db7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92dc164f30 0x7f92dc1653b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58900/0 (socket says 172.21.15.49:58900) 2023-11-30T18:41:43.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.252+0000 7f92db7fe700 1 -- 172.21.15.49:0/2449860128 learned_addr learned my addr 172.21.15.49:0/2449860128 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:43.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.253+0000 7f92da7fc700 1 --2- 172.21.15.49:0/2449860128 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92dc0c6780 0x7f92dc164a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:43.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.253+0000 7f92daffd700 1 --2- 172.21.15.49:0/2449860128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92c8006160 0x7f92dc0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:43.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.253+0000 7f92db7fe700 1 -- 172.21.15.49:0/2449860128 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92dc0c6780 msgr2=0x7f92dc164a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:43.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.253+0000 7f92db7fe700 1 --2- 172.21.15.49:0/2449860128 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92dc0c6780 0x7f92dc164a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:43.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.253+0000 7f92db7fe700 1 -- 172.21.15.49:0/2449860128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92c8006160 msgr2=0x7f92dc0a5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:43.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.253+0000 7f92db7fe700 1 --2- 172.21.15.49:0/2449860128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92c8006160 0x7f92dc0a5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:43.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.253+0000 7f92db7fe700 1 -- 172.21.15.49:0/2449860128 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92dc0a5e20 con 0x7f92dc164f30 2023-11-30T18:41:43.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.253+0000 7f92daffd700 1 --2- 172.21.15.49:0/2449860128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92c8006160 0x7f92dc0a5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:41:43.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.253+0000 7f92db7fe700 1 --2- 172.21.15.49:0/2449860128 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92dc164f30 0x7f92dc1653b0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 rx=0x7f92d4001e00 tx=0x7f92d4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:43.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.253+0000 7f92d2ffd700 1 -- 172.21.15.49:0/2449860128 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d4007230 con 0x7f92dc164f30 2023-11-30T18:41:43.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.253+0000 7f92d2ffd700 1 -- 172.21.15.49:0/2449860128 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d4007390 con 0x7f92dc164f30 2023-11-30T18:41:43.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.253+0000 7f92e167e700 1 -- 172.21.15.49:0/2449860128 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92dc0a6100 con 0x7f92dc164f30 2023-11-30T18:41:43.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.253+0000 7f92d2ffd700 1 -- 172.21.15.49:0/2449860128 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d4007750 con 0x7f92dc164f30 2023-11-30T18:41:43.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.253+0000 7f92e167e700 1 -- 172.21.15.49:0/2449860128 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92dc1658a0 con 0x7f92dc164f30 2023-11-30T18:41:43.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.254+0000 7f92e167e700 1 -- 172.21.15.49:0/2449860128 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92dc0a62f0 con 0x7f92dc164f30 2023-11-30T18:41:43.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.254+0000 7f92d2ffd700 1 -- 172.21.15.49:0/2449860128 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 105) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f92d401b040 con 0x7f92dc164f30 2023-11-30T18:41:43.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.255+0000 7f92d2ffd700 1 --2- 172.21.15.49:0/2449860128 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f92bc05f030 0x7f92bc0614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:43.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.255+0000 7f92d2ffd700 1 -- 172.21.15.49:0/2449860128 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(223..223 src has 1..223) v4 ==== 6792+0+0 (secure 0 0 0) 0x7f92d4018040 con 0x7f92dc164f30 2023-11-30T18:41:43.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.255+0000 7f92daffd700 1 --2- 172.21.15.49:0/2449860128 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f92bc05f030 0x7f92bc0614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:43.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.256+0000 7f92daffd700 1 --2- 172.21.15.49:0/2449860128 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f92bc05f030 0x7f92bc0614f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f92cc006d80 tx=0x7f92cc008040).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:43.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.259+0000 7f92d2ffd700 1 -- 172.21.15.49:0/2449860128 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f92d404c120 con 0x7f92dc164f30 2023-11-30T18:41:43.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.433+0000 7f92e167e700 1 -- 172.21.15.49:0/2449860128 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f92dc14bde0 con 0x7f92dc164f30 2023-11-30T18:41:43.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:43.689+0000 7f92d2ffd700 1 -- 172.21.15.49:0/2449860128 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f92d4078b70 con 0x7f92dc164f30 2023-11-30T18:41:44.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.105+0000 7f92d2ffd700 1 -- 172.21.15.49:0/2449860128 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v224) v1 ==== 181+0+0 (secure 0 0 0) 0x7f92d4040b40 con 0x7f92dc164f30 2023-11-30T18:41:44.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.108+0000 7f92e167e700 1 -- 172.21.15.49:0/2449860128 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f92bc05f030 msgr2=0x7f92bc0614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:44.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.108+0000 7f92e167e700 1 --2- 172.21.15.49:0/2449860128 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f92bc05f030 0x7f92bc0614f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f92cc006d80 tx=0x7f92cc008040).stop 2023-11-30T18:41:44.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.108+0000 7f92e167e700 1 -- 172.21.15.49:0/2449860128 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92dc164f30 msgr2=0x7f92dc1653b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:44.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.108+0000 7f92e167e700 1 --2- 172.21.15.49:0/2449860128 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92dc164f30 0x7f92dc1653b0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 rx=0x7f92d4001e00 tx=0x7f92d4015000).stop 2023-11-30T18:41:44.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.109+0000 7f92e167e700 1 -- 172.21.15.49:0/2449860128 shutdown_connections 2023-11-30T18:41:44.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.109+0000 7f92e167e700 1 --2- 172.21.15.49:0/2449860128 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f92bc05f030 0x7f92bc0614f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:44.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.109+0000 7f92e167e700 1 --2- 172.21.15.49:0/2449860128 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92dc164f30 0x7f92dc1653b0 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:44.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.109+0000 7f92e167e700 1 --2- 172.21.15.49:0/2449860128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92c8006160 0x7f92dc0a5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:44.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.109+0000 7f92e167e700 1 --2- 172.21.15.49:0/2449860128 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f92dc0c6780 0x7f92dc164a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:44.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.109+0000 7f92e167e700 1 -- 172.21.15.49:0/2449860128 >> 172.21.15.49:0/2449860128 conn(0x7f92dc062700 msgr2=0x7f92dc0c0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:44.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.109+0000 7f92e167e700 1 -- 172.21.15.49:0/2449860128 shutdown_connections 2023-11-30T18:41:44.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.109+0000 7f92e167e700 1 -- 172.21.15.49:0/2449860128 wait complete. 2023-11-30T18:41:44.112 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2023-11-30T18:41:44.129 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-30T18:41:44.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.250+0000 7f8a1125d700 1 Processor -- start 2023-11-30T18:41:44.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.250+0000 7f8a1125d700 1 -- start start 2023-11-30T18:41:44.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.251+0000 7f8a1125d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a0c0aa680 0x7f8a0c0c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:44.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.251+0000 7f8a1125d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8a0c1546b0 0x7f8a0c0c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:44.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.251+0000 7f8a1125d700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a0c158d50 con 0x7f8a0c1542d0 2023-11-30T18:41:44.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.251+0000 7f8a1125d700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a0c158140 con 0x7f8a0c1546b0 2023-11-30T18:41:44.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.251+0000 7f8a1125d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c158420 con 0x7f8a0c0aa680 2023-11-30T18:41:44.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.251+0000 7f8a10a5c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8a0c1546b0 0x7f8a0c0c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:44.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.251+0000 7f8a0bfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8a0c1542d0 0x7f8a0c0a9f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50532/0 (socket says 172.21.15.49:50532) 2023-11-30T18:41:44.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.251+0000 7f8a0bfff700 1 -- 172.21.15.49:0/3449948416 learned_addr learned my addr 172.21.15.49:0/3449948416 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:44.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.251+0000 7f8a0b7fe700 1 --2- 172.21.15.49:0/3449948416 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a0c0aa680 0x7f8a0c0c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:44.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.251+0000 7f8a10a5c700 1 -- 172.21.15.49:0/3449948416 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a0c0aa680 msgr2=0x7f8a0c0c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:44.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.251+0000 7f8a10a5c700 1 --2- 172.21.15.49:0/3449948416 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a0c0aa680 0x7f8a0c0c5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:44.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.251+0000 7f8a10a5c700 1 -- 172.21.15.49:0/3449948416 >> v1:172.21.15.49:6789/0 conn(0x7f8a0c1542d0 legacy=0x7f8a0c0a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:44.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.251+0000 7f8a10a5c700 1 -- 172.21.15.49:0/3449948416 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0c158700 con 0x7f8a0c1546b0 2023-11-30T18:41:44.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.251+0000 7f8a0affd700 1 -- 172.21.15.49:0/3449948416 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1184797690 0 0) 0x7f8a0c158d50 con 0x7f8a0c1542d0 2023-11-30T18:41:44.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.251+0000 7f8a0b7fe700 1 --2- 172.21.15.49:0/3449948416 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a0c0aa680 0x7f8a0c0c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:41:44.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.251+0000 7f8a10a5c700 1 --2- 172.21.15.49:0/3449948416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a0c1546b0 0x7f8a0c0c64b0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 rx=0x7f8a04009e60 tx=0x7f8a04009780).ready entity=mon.0 client_cookie=a75811187037336d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:44.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.252+0000 7f8a0affd700 1 -- 172.21.15.49:0/3449948416 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0400e070 con 0x7f8a0c1546b0 2023-11-30T18:41:44.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.252+0000 7f8a0affd700 1 -- 172.21.15.49:0/3449948416 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0400bc30 con 0x7f8a0c1546b0 2023-11-30T18:41:44.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.252+0000 7f8a0affd700 1 -- 172.21.15.49:0/3449948416 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a04012410 con 0x7f8a0c1546b0 2023-11-30T18:41:44.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.252+0000 7f8a1125d700 1 -- 172.21.15.49:0/3449948416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a0c1546b0 msgr2=0x7f8a0c0c64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:44.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.252+0000 7f8a1125d700 1 --2- 172.21.15.49:0/3449948416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a0c1546b0 0x7f8a0c0c64b0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 rx=0x7f8a04009e60 tx=0x7f8a04009780).stop 2023-11-30T18:41:44.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.252+0000 7f8a1125d700 1 -- 172.21.15.49:0/3449948416 shutdown_connections 2023-11-30T18:41:44.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.252+0000 7f8a1125d700 1 --2- 172.21.15.49:0/3449948416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a0c1546b0 0x7f8a0c0c64b0 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:44.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.252+0000 7f8a1125d700 1 --2- 172.21.15.49:0/3449948416 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a0c0aa680 0x7f8a0c0c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:44.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.252+0000 7f8a1125d700 1 -- 172.21.15.49:0/3449948416 >> 172.21.15.49:0/3449948416 conn(0x7f8a0c0cb010 msgr2=0x7f8a0c0cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:44.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.252+0000 7f8a1125d700 1 -- 172.21.15.49:0/3449948416 shutdown_connections 2023-11-30T18:41:44.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.252+0000 7f8a1125d700 1 -- 172.21.15.49:0/3449948416 wait complete. 2023-11-30T18:41:44.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.253+0000 7f8a1125d700 1 Processor -- start 2023-11-30T18:41:44.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.254+0000 7f8a1125d700 1 -- start start 2023-11-30T18:41:44.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.254+0000 7f8a1125d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a0c0aa680 0x7f8a0c0af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:44.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.254+0000 7f8a1125d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a0c1542d0 0x7f8a0c168030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:44.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.254+0000 7f8a1125d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a0c1546b0 0x7f8a0c163990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:44.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.254+0000 7f8a1125d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c1485e0 con 0x7f8a0c0aa680 2023-11-30T18:41:44.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.254+0000 7f8a1125d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c0b1010 con 0x7f8a0c1546b0 2023-11-30T18:41:44.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.254+0000 7f8a1125d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c0aff70 con 0x7f8a0c1542d0 2023-11-30T18:41:44.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.254+0000 7f8a0bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a0c0aa680 0x7f8a0c0af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:44.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.254+0000 7f8a0bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a0c0aa680 0x7f8a0c0af8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58928/0 (socket says 172.21.15.49:58928) 2023-11-30T18:41:44.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.254+0000 7f8a0bfff700 1 -- 172.21.15.49:0/1591875232 learned_addr learned my addr 172.21.15.49:0/1591875232 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:44.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.255+0000 7f8a10a5c700 1 --2- 172.21.15.49:0/1591875232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a0c1546b0 0x7f8a0c163990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:44.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.255+0000 7f8a0b7fe700 1 --2- 172.21.15.49:0/1591875232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a0c1542d0 0x7f8a0c168030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:44.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.255+0000 7f8a0bfff700 1 -- 172.21.15.49:0/1591875232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a0c1542d0 msgr2=0x7f8a0c168030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:44.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.255+0000 7f8a0bfff700 1 --2- 172.21.15.49:0/1591875232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a0c1542d0 0x7f8a0c168030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:44.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.255+0000 7f8a0bfff700 1 -- 172.21.15.49:0/1591875232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a0c1546b0 msgr2=0x7f8a0c163990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:44.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.255+0000 7f8a0bfff700 1 --2- 172.21.15.49:0/1591875232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a0c1546b0 0x7f8a0c163990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:44.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.255+0000 7f8a0bfff700 1 -- 172.21.15.49:0/1591875232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a04009a20 con 0x7f8a0c0aa680 2023-11-30T18:41:44.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.255+0000 7f8a0bfff700 1 --2- 172.21.15.49:0/1591875232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a0c0aa680 0x7f8a0c0af8b0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 rx=0x7f89f400c4e0 tx=0x7f89f4007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:44.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.255+0000 7f8a03fff700 1 -- 172.21.15.49:0/1591875232 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f40072e0 con 0x7f8a0c0aa680 2023-11-30T18:41:44.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.255+0000 7f8a03fff700 1 -- 172.21.15.49:0/1591875232 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f4007440 con 0x7f8a0c0aa680 2023-11-30T18:41:44.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.255+0000 7f8a1125d700 1 -- 172.21.15.49:0/1591875232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a0c0b0250 con 0x7f8a0c0aa680 2023-11-30T18:41:44.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.255+0000 7f8a03fff700 1 -- 172.21.15.49:0/1591875232 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f40057a0 con 0x7f8a0c0aa680 2023-11-30T18:41:44.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.255+0000 7f8a1125d700 1 -- 172.21.15.49:0/1591875232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a0c0b0810 con 0x7f8a0c0aa680 2023-11-30T18:41:44.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.256+0000 7f8a1125d700 1 -- 172.21.15.49:0/1591875232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a0c06c7c0 con 0x7f8a0c0aa680 2023-11-30T18:41:44.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.257+0000 7f8a03fff700 1 -- 172.21.15.49:0/1591875232 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f89f4005bd0 con 0x7f8a0c0aa680 2023-11-30T18:41:44.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.257+0000 7f8a03fff700 1 --2- 172.21.15.49:0/1591875232 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f89ec05f240 0x7f89ec061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:44.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.257+0000 7f8a03fff700 1 -- 172.21.15.49:0/1591875232 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(224..224 src has 1..224) v4 ==== 6354+0+0 (secure 0 0 0) 0x7f89f4079d80 con 0x7f8a0c0aa680 2023-11-30T18:41:44.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.257+0000 7f8a0b7fe700 1 --2- 172.21.15.49:0/1591875232 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f89ec05f240 0x7f89ec061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:44.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.258+0000 7f8a0b7fe700 1 --2- 172.21.15.49:0/1591875232 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f89ec05f240 0x7f89ec061700 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f8a0c0c4da0 tx=0x7f89fc008040).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:44.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.261+0000 7f8a03fff700 1 -- 172.21.15.49:0/1591875232 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f89f404ade0 con 0x7f8a0c0aa680 2023-11-30T18:41:44.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:44.438+0000 7f8a1125d700 1 -- 172.21.15.49:0/1591875232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8a0c0b0e50 con 0x7f8a0c0aa680 2023-11-30T18:41:45.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.111+0000 7f8a03fff700 1 -- 172.21.15.49:0/1591875232 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v225) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8a0c0b0e50 con 0x7f8a0c0aa680 2023-11-30T18:41:45.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.115+0000 7f8a1125d700 1 -- 172.21.15.49:0/1591875232 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f89ec05f240 msgr2=0x7f89ec061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:45.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.115+0000 7f8a1125d700 1 --2- 172.21.15.49:0/1591875232 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f89ec05f240 0x7f89ec061700 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f8a0c0c4da0 tx=0x7f89fc008040).stop 2023-11-30T18:41:45.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.115+0000 7f8a1125d700 1 -- 172.21.15.49:0/1591875232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a0c0aa680 msgr2=0x7f8a0c0af8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:45.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.115+0000 7f8a1125d700 1 --2- 172.21.15.49:0/1591875232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a0c0aa680 0x7f8a0c0af8b0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 rx=0x7f89f400c4e0 tx=0x7f89f4007c70).stop 2023-11-30T18:41:45.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.115+0000 7f8a1125d700 1 -- 172.21.15.49:0/1591875232 shutdown_connections 2023-11-30T18:41:45.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.115+0000 7f8a1125d700 1 --2- 172.21.15.49:0/1591875232 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f89ec05f240 0x7f89ec061700 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:45.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.115+0000 7f8a1125d700 1 --2- 172.21.15.49:0/1591875232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a0c1546b0 0x7f8a0c163990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:45.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.115+0000 7f8a1125d700 1 --2- 172.21.15.49:0/1591875232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a0c0aa680 0x7f8a0c0af8b0 secure :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 rx=0x7f89f400c4e0 tx=0x7f89f4007c70).stop 2023-11-30T18:41:45.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.115+0000 7f8a1125d700 1 --2- 172.21.15.49:0/1591875232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a0c1542d0 0x7f8a0c168030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:45.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.115+0000 7f8a1125d700 1 -- 172.21.15.49:0/1591875232 >> 172.21.15.49:0/1591875232 conn(0x7f8a0c0cb010 msgr2=0x7f8a0c14e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:45.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.115+0000 7f8a1125d700 1 -- 172.21.15.49:0/1591875232 shutdown_connections 2023-11-30T18:41:45.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.115+0000 7f8a1125d700 1 -- 172.21.15.49:0/1591875232 wait complete. 2023-11-30T18:41:45.119 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2023-11-30T18:41:45.134 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-30T18:41:45.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.255+0000 7f9d91b72700 1 Processor -- start 2023-11-30T18:41:45.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.255+0000 7f9d91b72700 1 -- start start 2023-11-30T18:41:45.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.255+0000 7f9d91b72700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9d8c0a8280 0x7f9d8c0a8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:45.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.255+0000 7f9d91b72700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9d8c158160 0x7f9d8c155500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:45.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.255+0000 7f9d91b72700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d8c14e600 0x7f9d8c14ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:45.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.255+0000 7f9d91b72700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d8c159180 con 0x7f9d8c158160 2023-11-30T18:41:45.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.255+0000 7f9d91b72700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d8c067770 con 0x7f9d8c0a8280 2023-11-30T18:41:45.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.255+0000 7f9d91b72700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c0be8d0 con 0x7f9d8c14e600 2023-11-30T18:41:45.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.256+0000 7f9d8affd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9d8c158160 0x7f9d8c155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:45.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.256+0000 7f9d8affd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9d8c158160 0x7f9d8c155500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58938/0 (socket says 172.21.15.49:58938) 2023-11-30T18:41:45.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.256+0000 7f9d8affd700 1 -- 172.21.15.49:0/1829339848 learned_addr learned my addr 172.21.15.49:0/1829339848 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:45.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.256+0000 7f9d8bfff700 1 --2- 172.21.15.49:0/1829339848 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d8c14e600 0x7f9d8c14ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:45.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.256+0000 7f9d8b7fe700 1 --2- 172.21.15.49:0/1829339848 >> v2:172.21.15.115:3300/0 conn(0x7f9d8c0a8280 0x7f9d8c0a8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:45.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.256+0000 7f9d8affd700 1 -- 172.21.15.49:0/1829339848 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d8c14e600 msgr2=0x7f9d8c14ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:45.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.256+0000 7f9d8affd700 1 --2- 172.21.15.49:0/1829339848 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d8c14e600 0x7f9d8c14ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:45.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.256+0000 7f9d8affd700 1 -- 172.21.15.49:0/1829339848 >> v2:172.21.15.115:3300/0 conn(0x7f9d8c0a8280 msgr2=0x7f9d8c0a8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:45.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.256+0000 7f9d8affd700 1 --2- 172.21.15.49:0/1829339848 >> v2:172.21.15.115:3300/0 conn(0x7f9d8c0a8280 0x7f9d8c0a8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:45.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.256+0000 7f9d8affd700 1 -- 172.21.15.49:0/1829339848 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8c158600 con 0x7f9d8c158160 2023-11-30T18:41:45.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.256+0000 7f9d8bfff700 1 --2- 172.21.15.49:0/1829339848 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d8c14e600 0x7f9d8c14ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:41:45.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.256+0000 7f9d8b7fe700 1 --2- 172.21.15.49:0/1829339848 >> v2:172.21.15.115:3300/0 conn(0x7f9d8c0a8280 0x7f9d8c0a8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:41:45.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.256+0000 7f9d8affd700 1 --2- 172.21.15.49:0/1829339848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d8c158160 0x7f9d8c155500 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 rx=0x7f9d8c0c9050 tx=0x7f9d800090f0).ready entity=mon.0 client_cookie=b60b9ab28f86d705 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:45.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.256+0000 7f9d8a7fc700 1 -- 172.21.15.49:0/1829339848 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8000b600 con 0x7f9d8c158160 2023-11-30T18:41:45.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.256+0000 7f9d8a7fc700 1 -- 172.21.15.49:0/1829339848 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8000b760 con 0x7f9d8c158160 2023-11-30T18:41:45.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.256+0000 7f9d8a7fc700 1 -- 172.21.15.49:0/1829339848 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8000bae0 con 0x7f9d8c158160 2023-11-30T18:41:45.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.257+0000 7f9d91b72700 1 -- 172.21.15.49:0/1829339848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d8c158160 msgr2=0x7f9d8c155500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:45.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.257+0000 7f9d91b72700 1 --2- 172.21.15.49:0/1829339848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d8c158160 0x7f9d8c155500 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 rx=0x7f9d8c0c9050 tx=0x7f9d800090f0).stop 2023-11-30T18:41:45.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.257+0000 7f9d91b72700 1 -- 172.21.15.49:0/1829339848 shutdown_connections 2023-11-30T18:41:45.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.257+0000 7f9d91b72700 1 --2- 172.21.15.49:0/1829339848 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d8c14e600 0x7f9d8c14ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:45.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.257+0000 7f9d91b72700 1 --2- 172.21.15.49:0/1829339848 >> v2:172.21.15.115:3300/0 conn(0x7f9d8c0a8280 0x7f9d8c0a8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:45.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.257+0000 7f9d91b72700 1 --2- 172.21.15.49:0/1829339848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d8c158160 0x7f9d8c155500 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:45.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.257+0000 7f9d91b72700 1 -- 172.21.15.49:0/1829339848 >> 172.21.15.49:0/1829339848 conn(0x7f9d8c062700 msgr2=0x7f9d8c062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:45.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.257+0000 7f9d91b72700 1 -- 172.21.15.49:0/1829339848 shutdown_connections 2023-11-30T18:41:45.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.257+0000 7f9d91b72700 1 -- 172.21.15.49:0/1829339848 wait complete. 2023-11-30T18:41:45.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.258+0000 7f9d91b72700 1 Processor -- start 2023-11-30T18:41:45.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.258+0000 7f9d91b72700 1 -- start start 2023-11-30T18:41:45.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.259+0000 7f9d91b72700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d8c0a8280 0x7f9d8c159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:45.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.259+0000 7f9d91b72700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d8c14e600 0x7f9d8c15af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:45.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.259+0000 7f9d91b72700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d8c158160 0x7f9d8c14d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:45.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.259+0000 7f9d91b72700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c15a2b0 con 0x7f9d8c158160 2023-11-30T18:41:45.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.259+0000 7f9d91b72700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c15a8f0 con 0x7f9d8c0a8280 2023-11-30T18:41:45.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.259+0000 7f9d91b72700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c156ba0 con 0x7f9d8c14e600 2023-11-30T18:41:45.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.259+0000 7f9d8bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d8c158160 0x7f9d8c14d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:45.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.259+0000 7f9d8bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d8c158160 0x7f9d8c14d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58940/0 (socket says 172.21.15.49:58940) 2023-11-30T18:41:45.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.259+0000 7f9d8bfff700 1 -- 172.21.15.49:0/3594412187 learned_addr learned my addr 172.21.15.49:0/3594412187 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:45.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.259+0000 7f9d8b7fe700 1 --2- 172.21.15.49:0/3594412187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d8c0a8280 0x7f9d8c159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:45.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.259+0000 7f9d8affd700 1 --2- 172.21.15.49:0/3594412187 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d8c14e600 0x7f9d8c15af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:45.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.259+0000 7f9d8bfff700 1 -- 172.21.15.49:0/3594412187 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d8c14e600 msgr2=0x7f9d8c15af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:45.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.259+0000 7f9d8bfff700 1 --2- 172.21.15.49:0/3594412187 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d8c14e600 0x7f9d8c15af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:45.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.259+0000 7f9d8bfff700 1 -- 172.21.15.49:0/3594412187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d8c0a8280 msgr2=0x7f9d8c159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:45.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.259+0000 7f9d8bfff700 1 --2- 172.21.15.49:0/3594412187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d8c0a8280 0x7f9d8c159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:45.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.259+0000 7f9d8bfff700 1 -- 172.21.15.49:0/3594412187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d80009370 con 0x7f9d8c158160 2023-11-30T18:41:45.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.259+0000 7f9d8bfff700 1 --2- 172.21.15.49:0/3594412187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d8c158160 0x7f9d8c14d960 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 rx=0x7f9d8400d100 tx=0x7f9d840099d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:45.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.260+0000 7f9d737fe700 1 -- 172.21.15.49:0/3594412187 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8400dc40 con 0x7f9d8c158160 2023-11-30T18:41:45.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.260+0000 7f9d737fe700 1 -- 172.21.15.49:0/3594412187 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8400f040 con 0x7f9d8c158160 2023-11-30T18:41:45.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.260+0000 7f9d91b72700 1 -- 172.21.15.49:0/3594412187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d8c156e80 con 0x7f9d8c158160 2023-11-30T18:41:45.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.260+0000 7f9d737fe700 1 -- 172.21.15.49:0/3594412187 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d840133f0 con 0x7f9d8c158160 2023-11-30T18:41:45.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.260+0000 7f9d91b72700 1 -- 172.21.15.49:0/3594412187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8c157440 con 0x7f9d8c158160 2023-11-30T18:41:45.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.261+0000 7f9d91b72700 1 -- 172.21.15.49:0/3594412187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d8c06c860 con 0x7f9d8c158160 2023-11-30T18:41:45.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.261+0000 7f9d737fe700 1 -- 172.21.15.49:0/3594412187 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f9d84013760 con 0x7f9d8c158160 2023-11-30T18:41:45.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.261+0000 7f9d737fe700 1 --2- 172.21.15.49:0/3594412187 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f9d7805f270 0x7f9d78061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:45.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.262+0000 7f9d737fe700 1 -- 172.21.15.49:0/3594412187 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(225..225 src has 1..225) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f9d8407aa00 con 0x7f9d8c158160 2023-11-30T18:41:45.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.262+0000 7f9d8b7fe700 1 --2- 172.21.15.49:0/3594412187 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f9d7805f270 0x7f9d78061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:45.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.262+0000 7f9d8b7fe700 1 --2- 172.21.15.49:0/3594412187 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f9d7805f270 0x7f9d78061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f9d7c006d80 tx=0x7f9d7c008040).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:45.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.266+0000 7f9d737fe700 1 -- 172.21.15.49:0/3594412187 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9d8404bae0 con 0x7f9d8c158160 2023-11-30T18:41:45.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.439+0000 7f9d91b72700 1 -- 172.21.15.49:0/3594412187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9d8c157630 con 0x7f9d8c158160 2023-11-30T18:41:45.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.444+0000 7f9d737fe700 1 -- 172.21.15.49:0/3594412187 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v44) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9d8404f100 con 0x7f9d8c158160 2023-11-30T18:41:45.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.446+0000 7f9d91b72700 1 -- 172.21.15.49:0/3594412187 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f9d7805f270 msgr2=0x7f9d78061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:45.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.446+0000 7f9d91b72700 1 --2- 172.21.15.49:0/3594412187 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f9d7805f270 0x7f9d78061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f9d7c006d80 tx=0x7f9d7c008040).stop 2023-11-30T18:41:45.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.446+0000 7f9d91b72700 1 -- 172.21.15.49:0/3594412187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d8c158160 msgr2=0x7f9d8c14d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:45.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.446+0000 7f9d91b72700 1 --2- 172.21.15.49:0/3594412187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d8c158160 0x7f9d8c14d960 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 rx=0x7f9d8400d100 tx=0x7f9d840099d0).stop 2023-11-30T18:41:45.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.446+0000 7f9d91b72700 1 -- 172.21.15.49:0/3594412187 shutdown_connections 2023-11-30T18:41:45.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.446+0000 7f9d91b72700 1 --2- 172.21.15.49:0/3594412187 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f9d7805f270 0x7f9d78061730 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:45.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.446+0000 7f9d91b72700 1 --2- 172.21.15.49:0/3594412187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d8c158160 0x7f9d8c14d960 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:45.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.446+0000 7f9d91b72700 1 --2- 172.21.15.49:0/3594412187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d8c0a8280 0x7f9d8c159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:45.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.446+0000 7f9d91b72700 1 --2- 172.21.15.49:0/3594412187 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d8c14e600 0x7f9d8c15af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:45.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.446+0000 7f9d91b72700 1 -- 172.21.15.49:0/3594412187 >> 172.21.15.49:0/3594412187 conn(0x7f9d8c062700 msgr2=0x7f9d8c0a5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:45.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.446+0000 7f9d91b72700 1 -- 172.21.15.49:0/3594412187 shutdown_connections 2023-11-30T18:41:45.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.446+0000 7f9d91b72700 1 -- 172.21.15.49:0/3594412187 wait complete. 2023-11-30T18:41:45.460 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-11-30T18:41:45.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.582+0000 7fcef4654700 1 Processor -- start 2023-11-30T18:41:45.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.582+0000 7fcef4654700 1 -- start start 2023-11-30T18:41:45.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.583+0000 7fcef4654700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fceec151a20 0x7fceec06a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:45.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.583+0000 7fcef4654700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fceec0bd1f0 0x7fceec0bd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:45.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.583+0000 7fcef4654700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceec0c3470 con 0x7fceec069d10 2023-11-30T18:41:45.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.583+0000 7fcef4654700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceec0c48f0 con 0x7fceec0bd1f0 2023-11-30T18:41:45.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.583+0000 7fcef4654700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceec0bdb30 con 0x7fceec151a20 2023-11-30T18:41:45.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.583+0000 7fcef23f0700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fceec069d10 0x7fceec0be1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50540/0 (socket says 172.21.15.49:50540) 2023-11-30T18:41:45.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.584+0000 7fcef23f0700 1 -- 172.21.15.49:0/1390022820 learned_addr learned my addr 172.21.15.49:0/1390022820 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:45.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.584+0000 7fcef1bef700 1 --2- 172.21.15.49:0/1390022820 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fceec151a20 0x7fceec06a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:45.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.584+0000 7fcef2bf1700 1 --2- 172.21.15.49:0/1390022820 >> v2:172.21.15.115:3300/0 conn(0x7fceec0bd1f0 0x7fceec0bd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:45.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.584+0000 7fcef13ee700 1 -- 172.21.15.49:0/1390022820 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 665166346 0 0) 0x7fceec0c3470 con 0x7fceec069d10 2023-11-30T18:41:45.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.584+0000 7fcef13ee700 1 -- 172.21.15.49:0/1390022820 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fced40033f0 con 0x7fceec069d10 2023-11-30T18:41:45.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.584+0000 7fcef13ee700 1 -- 172.21.15.49:0/1390022820 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2176939333 0 0) 0x7fced40033f0 con 0x7fceec069d10 2023-11-30T18:41:45.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.584+0000 7fcef13ee700 1 -- 172.21.15.49:0/1390022820 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fceec151a20 msgr2=0x7fceec06a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:45.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.584+0000 7fcef13ee700 1 --2- 172.21.15.49:0/1390022820 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fceec151a20 0x7fceec06a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:45.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.584+0000 7fcef13ee700 1 -- 172.21.15.49:0/1390022820 >> v2:172.21.15.115:3300/0 conn(0x7fceec0bd1f0 msgr2=0x7fceec0bd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:45.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.584+0000 7fcef13ee700 1 --2- 172.21.15.49:0/1390022820 >> v2:172.21.15.115:3300/0 conn(0x7fceec0bd1f0 0x7fceec0bd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:45.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.584+0000 7fcef13ee700 1 -- 172.21.15.49:0/1390022820 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceec151ea0 con 0x7fceec069d10 2023-11-30T18:41:45.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.584+0000 7fcef13ee700 1 -- 172.21.15.49:0/1390022820 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7fcee4001470 con 0x7fceec069d10 2023-11-30T18:41:45.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.584+0000 7fcef13ee700 1 -- 172.21.15.49:0/1390022820 >> v1:172.21.15.49:6789/0 conn(0x7fceec069d10 legacy=0x7fceec0be1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:45.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.584+0000 7fcef13ee700 1 --2- 172.21.15.49:0/1390022820 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fceec151a20 0x7fced40038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:45.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.584+0000 7fcef13ee700 1 --2- 172.21.15.49:0/1390022820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fced4003e10 0x7fced4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:45.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.584+0000 7fcef13ee700 1 --2- 172.21.15.49:0/1390022820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fced4004b80 0x7fced4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:45.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.584+0000 7fcef13ee700 1 -- 172.21.15.49:0/1390022820 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec0c48f0 con 0x7fced4003e10 2023-11-30T18:41:45.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.584+0000 7fcef13ee700 1 -- 172.21.15.49:0/1390022820 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec0bdb30 con 0x7fced4004b80 2023-11-30T18:41:45.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.584+0000 7fcef13ee700 1 -- 172.21.15.49:0/1390022820 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced400b8e0 con 0x7fceec151a20 2023-11-30T18:41:45.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.584+0000 7fcef1bef700 1 --2- 172.21.15.49:0/1390022820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fced4003e10 0x7fced4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:45.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.584+0000 7fcef23f0700 1 --2- 172.21.15.49:0/1390022820 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fceec151a20 0x7fced40038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:45.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.584+0000 7fcef2bf1700 1 --2- 172.21.15.49:0/1390022820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fced4004b80 0x7fced4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:45.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.585+0000 7fcef1bef700 1 -- 172.21.15.49:0/1390022820 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fceec151a20 msgr2=0x7fced40038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:45.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.585+0000 7fcef1bef700 1 --2- 172.21.15.49:0/1390022820 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fceec151a20 0x7fced40038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:45.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.585+0000 7fcef1bef700 1 -- 172.21.15.49:0/1390022820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fced4004b80 msgr2=0x7fced4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:45.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.585+0000 7fcef1bef700 1 --2- 172.21.15.49:0/1390022820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fced4004b80 0x7fced4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:45.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.585+0000 7fcef1bef700 1 -- 172.21.15.49:0/1390022820 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced40033f0 con 0x7fced4003e10 2023-11-30T18:41:45.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.585+0000 7fcef1bef700 1 --2- 172.21.15.49:0/1390022820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fced4003e10 0x7fced4004690 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 rx=0x7fcee0009a90 tx=0x7fcee0009060).ready entity=mon.0 client_cookie=821bf79d6bcd3b62 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:45.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.585+0000 7fcef13ee700 1 -- 172.21.15.49:0/1390022820 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee0009430 con 0x7fced4003e10 2023-11-30T18:41:45.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.585+0000 7fcef13ee700 1 -- 172.21.15.49:0/1390022820 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee000e640 con 0x7fced4003e10 2023-11-30T18:41:45.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.585+0000 7fcef13ee700 1 -- 172.21.15.49:0/1390022820 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee000e9c0 con 0x7fced4003e10 2023-11-30T18:41:45.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.585+0000 7fcef4654700 1 -- 172.21.15.49:0/1390022820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fced4003e10 msgr2=0x7fced4004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:45.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.585+0000 7fcef4654700 1 --2- 172.21.15.49:0/1390022820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fced4003e10 0x7fced4004690 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 rx=0x7fcee0009a90 tx=0x7fcee0009060).stop 2023-11-30T18:41:45.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.585+0000 7fcef2bf1700 1 -- 172.21.15.49:0/1390022820 reap_dead start 2023-11-30T18:41:45.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.585+0000 7fcef4654700 1 -- 172.21.15.49:0/1390022820 shutdown_connections 2023-11-30T18:41:45.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.585+0000 7fcef4654700 1 -- 172.21.15.49:0/1390022820 >> 172.21.15.49:0/1390022820 conn(0x7fceec0642d0 msgr2=0x7fceec0c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:45.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.586+0000 7fcef4654700 1 -- 172.21.15.49:0/1390022820 shutdown_connections 2023-11-30T18:41:45.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.586+0000 7fcef4654700 1 -- 172.21.15.49:0/1390022820 wait complete. 2023-11-30T18:41:45.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.587+0000 7fcef4654700 1 Processor -- start 2023-11-30T18:41:45.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.587+0000 7fcef4654700 1 -- start start 2023-11-30T18:41:45.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.587+0000 7fcef4654700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fced4003e10 0x7fceec0c0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:45.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.587+0000 7fcef4654700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fceec145170 0x7fceec153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:45.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.587+0000 7fcef4654700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fceec150670 0x7fceec150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:45.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.588+0000 7fcef4654700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec165710 con 0x7fceec145170 2023-11-30T18:41:45.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.588+0000 7fcef4654700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec150fc0 con 0x7fced4003e10 2023-11-30T18:41:45.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.588+0000 7fcef4654700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceec164b00 con 0x7fceec150670 2023-11-30T18:41:45.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.588+0000 7fcef1bef700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fceec145170 0x7fceec153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:45.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.588+0000 7fcef1bef700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fceec145170 0x7fceec153d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58968/0 (socket says 172.21.15.49:58968) 2023-11-30T18:41:45.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.588+0000 7fcef1bef700 1 -- 172.21.15.49:0/1472612199 learned_addr learned my addr 172.21.15.49:0/1472612199 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:45.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.588+0000 7fcef23f0700 1 --2- 172.21.15.49:0/1472612199 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fced4003e10 0x7fceec0c0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:45.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.588+0000 7fcef2bf1700 1 --2- 172.21.15.49:0/1472612199 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fceec150670 0x7fceec150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:45.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.588+0000 7fcef1bef700 1 -- 172.21.15.49:0/1472612199 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fceec150670 msgr2=0x7fceec150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:45.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.588+0000 7fcef1bef700 1 --2- 172.21.15.49:0/1472612199 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fceec150670 0x7fceec150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:45.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.588+0000 7fcef1bef700 1 -- 172.21.15.49:0/1472612199 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fced4003e10 msgr2=0x7fceec0c0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:45.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.588+0000 7fcef1bef700 1 --2- 172.21.15.49:0/1472612199 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fced4003e10 0x7fceec0c0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:45.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.588+0000 7fcef1bef700 1 -- 172.21.15.49:0/1472612199 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceec164de0 con 0x7fceec145170 2023-11-30T18:41:45.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.588+0000 7fcef2bf1700 1 --2- 172.21.15.49:0/1472612199 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fceec150670 0x7fceec150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:41:45.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.588+0000 7fcef1bef700 1 --2- 172.21.15.49:0/1472612199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fceec145170 0x7fceec153d70 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 rx=0x7fced40045a0 tx=0x7fcee001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:45.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.588+0000 7fceea7fc700 1 -- 172.21.15.49:0/1472612199 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee0020070 con 0x7fceec145170 2023-11-30T18:41:45.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.588+0000 7fceea7fc700 1 -- 172.21.15.49:0/1472612199 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee000e7b0 con 0x7fceec145170 2023-11-30T18:41:45.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.588+0000 7fceea7fc700 1 -- 172.21.15.49:0/1472612199 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee0024660 con 0x7fceec145170 2023-11-30T18:41:45.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.588+0000 7fcef4654700 1 -- 172.21.15.49:0/1472612199 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceec1650c0 con 0x7fceec145170 2023-11-30T18:41:45.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.588+0000 7fcef4654700 1 -- 172.21.15.49:0/1472612199 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceec145700 con 0x7fceec145170 2023-11-30T18:41:45.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.589+0000 7fcef4654700 1 -- 172.21.15.49:0/1472612199 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceec1458f0 con 0x7fceec145170 2023-11-30T18:41:45.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.590+0000 7fceea7fc700 1 -- 172.21.15.49:0/1472612199 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fcee00123f0 con 0x7fceec145170 2023-11-30T18:41:45.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.590+0000 7fceea7fc700 1 --2- 172.21.15.49:0/1472612199 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fced805f270 0x7fced8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:45.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.590+0000 7fceea7fc700 1 -- 172.21.15.49:0/1472612199 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(225..225 src has 1..225) v4 ==== 5940+0+0 (secure 0 0 0) 0x7fcee007b930 con 0x7fceec145170 2023-11-30T18:41:45.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.590+0000 7fcef23f0700 1 --2- 172.21.15.49:0/1472612199 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fced805f270 0x7fced8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:45.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.591+0000 7fcef23f0700 1 --2- 172.21.15.49:0/1472612199 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fced805f270 0x7fced8061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fcee4000e50 tx=0x7fcee4001e90).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:45.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.594+0000 7fceea7fc700 1 -- 172.21.15.49:0/1472612199 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fceec1458f0 con 0x7fceec145170 2023-11-30T18:41:45.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.767+0000 7fcef4654700 1 -- 172.21.15.49:0/1472612199 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fceec1458f0 con 0x7fceec145170 2023-11-30T18:41:45.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.770+0000 7fceea7fc700 1 -- 172.21.15.49:0/1472612199 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v45) v1 ==== 120+0+0 (secure 0 0 0) 0x7fceec1458f0 con 0x7fceec145170 2023-11-30T18:41:45.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.772+0000 7fcef4654700 1 -- 172.21.15.49:0/1472612199 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fced805f270 msgr2=0x7fced8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:45.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.772+0000 7fcef4654700 1 --2- 172.21.15.49:0/1472612199 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fced805f270 0x7fced8061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fcee4000e50 tx=0x7fcee4001e90).stop 2023-11-30T18:41:45.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.772+0000 7fcef4654700 1 -- 172.21.15.49:0/1472612199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fceec145170 msgr2=0x7fceec153d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:45.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.772+0000 7fcef4654700 1 --2- 172.21.15.49:0/1472612199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fceec145170 0x7fceec153d70 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 rx=0x7fced40045a0 tx=0x7fcee001a000).stop 2023-11-30T18:41:45.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.772+0000 7fcef4654700 1 -- 172.21.15.49:0/1472612199 shutdown_connections 2023-11-30T18:41:45.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.772+0000 7fcef4654700 1 --2- 172.21.15.49:0/1472612199 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fced805f270 0x7fced8061730 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:45.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.772+0000 7fcef4654700 1 --2- 172.21.15.49:0/1472612199 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fceec150670 0x7fceec150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:45.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.772+0000 7fcef4654700 1 --2- 172.21.15.49:0/1472612199 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fced4003e10 0x7fceec0c0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:45.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.772+0000 7fcef4654700 1 --2- 172.21.15.49:0/1472612199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fceec145170 0x7fceec153d70 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:45.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.772+0000 7fcef4654700 1 -- 172.21.15.49:0/1472612199 >> 172.21.15.49:0/1472612199 conn(0x7fceec0642d0 msgr2=0x7fceec062700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:45.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.772+0000 7fcef4654700 1 -- 172.21.15.49:0/1472612199 shutdown_connections 2023-11-30T18:41:45.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.772+0000 7fcef4654700 1 -- 172.21.15.49:0/1472612199 wait complete. 2023-11-30T18:41:45.786 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-11-30T18:41:45.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.902+0000 7f0e62f5f700 1 Processor -- start 2023-11-30T18:41:45.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.902+0000 7f0e62f5f700 1 -- start start 2023-11-30T18:41:45.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.903+0000 7f0e62f5f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e5c0caab0 0x7f0e5c0aa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:45.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.903+0000 7f0e62f5f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0e5c0cae90 0x7f0e5c0c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:45.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.903+0000 7f0e62f5f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e5c0a9a90 con 0x7f0e5c0aa960 2023-11-30T18:41:45.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.903+0000 7f0e62f5f700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e5c154ce0 con 0x7f0e5c0cae90 2023-11-30T18:41:45.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.903+0000 7f0e62f5f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c0a8e80 con 0x7f0e5c0caab0 2023-11-30T18:41:45.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.903+0000 7f0e5bfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0e5c0cae90 0x7f0e5c0c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:45.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.903+0000 7f0e614fc700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0e5c0aa960 0x7f0e5c0c9170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50550/0 (socket says 172.21.15.49:50550) 2023-11-30T18:41:45.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.903+0000 7f0e614fc700 1 -- 172.21.15.49:0/3903952064 learned_addr learned my addr 172.21.15.49:0/3903952064 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:45.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.903+0000 7f0e60cfb700 1 --2- 172.21.15.49:0/3903952064 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e5c0caab0 0x7f0e5c0aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:45.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.903+0000 7f0e5bfff700 1 -- 172.21.15.49:0/3903952064 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e5c0caab0 msgr2=0x7f0e5c0aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:45.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.903+0000 7f0e5bfff700 1 --2- 172.21.15.49:0/3903952064 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e5c0caab0 0x7f0e5c0aa470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:45.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.903+0000 7f0e5b7fe700 1 -- 172.21.15.49:0/3903952064 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2251758766 0 0) 0x7f0e5c0a9a90 con 0x7f0e5c0aa960 2023-11-30T18:41:45.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.903+0000 7f0e5bfff700 1 -- 172.21.15.49:0/3903952064 >> v1:172.21.15.49:6789/0 conn(0x7f0e5c0aa960 legacy=0x7f0e5c0c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:45.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.903+0000 7f0e5bfff700 1 -- 172.21.15.49:0/3903952064 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5c0a9160 con 0x7f0e5c0cae90 2023-11-30T18:41:45.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.903+0000 7f0e5bfff700 1 --2- 172.21.15.49:0/3903952064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e5c0cae90 0x7f0e5c0c0ab0 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 rx=0x7f0e50009760 tx=0x7f0e50009060).ready entity=mon.0 client_cookie=96d4961d6246e349 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:45.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.904+0000 7f0e5b7fe700 1 -- 172.21.15.49:0/3903952064 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5000f510 con 0x7f0e5c0cae90 2023-11-30T18:41:45.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.904+0000 7f0e5b7fe700 1 -- 172.21.15.49:0/3903952064 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5000f670 con 0x7f0e5c0cae90 2023-11-30T18:41:45.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.904+0000 7f0e5b7fe700 1 -- 172.21.15.49:0/3903952064 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5000f9f0 con 0x7f0e5c0cae90 2023-11-30T18:41:45.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.904+0000 7f0e62f5f700 1 -- 172.21.15.49:0/3903952064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e5c0cae90 msgr2=0x7f0e5c0c0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:45.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.904+0000 7f0e62f5f700 1 --2- 172.21.15.49:0/3903952064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e5c0cae90 0x7f0e5c0c0ab0 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 rx=0x7f0e50009760 tx=0x7f0e50009060).stop 2023-11-30T18:41:45.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.904+0000 7f0e62f5f700 1 -- 172.21.15.49:0/3903952064 shutdown_connections 2023-11-30T18:41:45.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.904+0000 7f0e62f5f700 1 --2- 172.21.15.49:0/3903952064 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e5c0caab0 0x7f0e5c0aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:45.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.904+0000 7f0e62f5f700 1 --2- 172.21.15.49:0/3903952064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e5c0cae90 0x7f0e5c0c0ab0 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:45.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.904+0000 7f0e62f5f700 1 -- 172.21.15.49:0/3903952064 >> 172.21.15.49:0/3903952064 conn(0x7f0e5c094920 msgr2=0x7f0e5c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:45.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.904+0000 7f0e62f5f700 1 -- 172.21.15.49:0/3903952064 shutdown_connections 2023-11-30T18:41:45.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.904+0000 7f0e62f5f700 1 -- 172.21.15.49:0/3903952064 wait complete. 2023-11-30T18:41:45.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.905+0000 7f0e62f5f700 1 Processor -- start 2023-11-30T18:41:45.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.905+0000 7f0e62f5f700 1 -- start start 2023-11-30T18:41:45.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.906+0000 7f0e62f5f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e5c0caab0 0x7f0e5c0c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:45.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.906+0000 7f0e62f5f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e5c0cae90 0x7f0e5c0ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:45.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.906+0000 7f0e62f5f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e5c0aecb0 0x7f0e5c167f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:45.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.906+0000 7f0e62f5f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c0c32e0 con 0x7f0e5c0aecb0 2023-11-30T18:41:45.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.906+0000 7f0e62f5f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c0c35c0 con 0x7f0e5c0cae90 2023-11-30T18:41:45.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.906+0000 7f0e62f5f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c0c38a0 con 0x7f0e5c0caab0 2023-11-30T18:41:45.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.906+0000 7f0e614fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e5c0aecb0 0x7f0e5c167f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:45.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.906+0000 7f0e614fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e5c0aecb0 0x7f0e5c167f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58982/0 (socket says 172.21.15.49:58982) 2023-11-30T18:41:45.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.906+0000 7f0e614fc700 1 -- 172.21.15.49:0/2427222796 learned_addr learned my addr 172.21.15.49:0/2427222796 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:45.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.906+0000 7f0e60cfb700 1 --2- 172.21.15.49:0/2427222796 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e5c0caab0 0x7f0e5c0c2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:45.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.906+0000 7f0e5bfff700 1 --2- 172.21.15.49:0/2427222796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e5c0cae90 0x7f0e5c0ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:45.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.907+0000 7f0e614fc700 1 -- 172.21.15.49:0/2427222796 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e5c0caab0 msgr2=0x7f0e5c0c2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:45.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.907+0000 7f0e614fc700 1 --2- 172.21.15.49:0/2427222796 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e5c0caab0 0x7f0e5c0c2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:45.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.907+0000 7f0e614fc700 1 -- 172.21.15.49:0/2427222796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e5c0cae90 msgr2=0x7f0e5c0ae7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:45.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.907+0000 7f0e614fc700 1 --2- 172.21.15.49:0/2427222796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e5c0cae90 0x7f0e5c0ae7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:45.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.907+0000 7f0e614fc700 1 -- 172.21.15.49:0/2427222796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e500092a0 con 0x7f0e5c0aecb0 2023-11-30T18:41:45.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.907+0000 7f0e614fc700 1 --2- 172.21.15.49:0/2427222796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e5c0aecb0 0x7f0e5c167f10 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 rx=0x7f0e5400c7e0 tx=0x7f0e54007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:45.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.907+0000 7f0e58ff9700 1 -- 172.21.15.49:0/2427222796 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e54005d30 con 0x7f0e5c0aecb0 2023-11-30T18:41:45.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.907+0000 7f0e58ff9700 1 -- 172.21.15.49:0/2427222796 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e54005e90 con 0x7f0e5c0aecb0 2023-11-30T18:41:45.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.907+0000 7f0e62f5f700 1 -- 172.21.15.49:0/2427222796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e5c0c3b80 con 0x7f0e5c0aecb0 2023-11-30T18:41:45.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.907+0000 7f0e58ff9700 1 -- 172.21.15.49:0/2427222796 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e54007320 con 0x7f0e5c0aecb0 2023-11-30T18:41:45.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.907+0000 7f0e62f5f700 1 -- 172.21.15.49:0/2427222796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5c168400 con 0x7f0e5c0aecb0 2023-11-30T18:41:45.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.908+0000 7f0e62f5f700 1 -- 172.21.15.49:0/2427222796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e5c06c860 con 0x7f0e5c0aecb0 2023-11-30T18:41:45.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.908+0000 7f0e58ff9700 1 -- 172.21.15.49:0/2427222796 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0e54007710 con 0x7f0e5c0aecb0 2023-11-30T18:41:45.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.909+0000 7f0e58ff9700 1 --2- 172.21.15.49:0/2427222796 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0e4805f270 0x7f0e48061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:45.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.909+0000 7f0e58ff9700 1 -- 172.21.15.49:0/2427222796 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(225..225 src has 1..225) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f0e5407a3b0 con 0x7f0e5c0aecb0 2023-11-30T18:41:45.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.909+0000 7f0e60cfb700 1 --2- 172.21.15.49:0/2427222796 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0e4805f270 0x7f0e48061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:45.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.909+0000 7f0e60cfb700 1 --2- 172.21.15.49:0/2427222796 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0e4805f270 0x7f0e48061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f0e4c009200 tx=0x7f0e4c008040).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:45.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:45.913+0000 7f0e58ff9700 1 -- 172.21.15.49:0/2427222796 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0e5404b5b0 con 0x7f0e5c0aecb0 2023-11-30T18:41:46.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:46.152+0000 7f0e62f5f700 1 -- 172.21.15.49:0/2427222796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7f0e5c0a9440 con 0x7f0e5c0aecb0 2023-11-30T18:41:47.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:47.116+0000 7f0e58ff9700 1 -- 172.21.15.49:0/2427222796 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v3046) v1 ==== 155+0+0 (secure 0 0 0) 0x7f0e5404ebd0 con 0x7f0e5c0aecb0 2023-11-30T18:41:47.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:47.119+0000 7f0e62f5f700 1 -- 172.21.15.49:0/2427222796 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0e4805f270 msgr2=0x7f0e48061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:47.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:47.119+0000 7f0e62f5f700 1 --2- 172.21.15.49:0/2427222796 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0e4805f270 0x7f0e48061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f0e4c009200 tx=0x7f0e4c008040).stop 2023-11-30T18:41:47.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:47.119+0000 7f0e62f5f700 1 -- 172.21.15.49:0/2427222796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e5c0aecb0 msgr2=0x7f0e5c167f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:47.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:47.119+0000 7f0e62f5f700 1 --2- 172.21.15.49:0/2427222796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e5c0aecb0 0x7f0e5c167f10 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 rx=0x7f0e5400c7e0 tx=0x7f0e54007f90).stop 2023-11-30T18:41:47.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:47.119+0000 7f0e62f5f700 1 -- 172.21.15.49:0/2427222796 shutdown_connections 2023-11-30T18:41:47.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:47.119+0000 7f0e62f5f700 1 --2- 172.21.15.49:0/2427222796 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0e4805f270 0x7f0e48061730 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:47.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:47.119+0000 7f0e62f5f700 1 --2- 172.21.15.49:0/2427222796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e5c0aecb0 0x7f0e5c167f10 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:47.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:47.119+0000 7f0e62f5f700 1 --2- 172.21.15.49:0/2427222796 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e5c0caab0 0x7f0e5c0c2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:47.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:47.119+0000 7f0e62f5f700 1 --2- 172.21.15.49:0/2427222796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e5c0cae90 0x7f0e5c0ae7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:47.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:47.119+0000 7f0e62f5f700 1 -- 172.21.15.49:0/2427222796 >> 172.21.15.49:0/2427222796 conn(0x7f0e5c094920 msgr2=0x7f0e5c0a7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:47.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:47.119+0000 7f0e62f5f700 1 -- 172.21.15.49:0/2427222796 shutdown_connections 2023-11-30T18:41:47.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:47.119+0000 7f0e62f5f700 1 -- 172.21.15.49:0/2427222796 wait complete. 2023-11-30T18:41:47.135 INFO:tasks.cephfs_test_runner:Test the correctness of snap directory name ... ok 2023-11-30T18:41:47.136 INFO:tasks.cephfs_test_runner: 2023-11-30T18:41:47.136 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-30T18:41:47.136 INFO:tasks.cephfs_test_runner:Ran 11 tests in 5638.153s 2023-11-30T18:41:47.136 INFO:tasks.cephfs_test_runner: 2023-11-30T18:41:47.136 INFO:tasks.cephfs_test_runner:OK 2023-11-30T18:41:47.136 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-30T18:41:47.148 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-11-30T18:41:47.196 INFO:tasks.kclient:Unmounting kernel clients... 2023-11-30T18:41:47.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:41:47.197 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-11-30T18:41:47.215 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-30T18:41:47.215 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-30T18:41:47.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:41:47.215 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-30T18:41:47.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:41:47.292 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-30T18:41:47.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:41:47.371 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2023-11-30T18:41:47.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:41:47.468 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-11-30T18:41:47.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:41:47.484 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2023-11-30T18:41:47.554 INFO:teuthology.orchestra.run.smithi049.stderr:Cannot find device "ceph-brx" 2023-11-30T18:41:47.554 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-30T18:41:47.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:41:47.555 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-11-30T18:41:47.573 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-30T18:41:47.573 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-30T18:41:47.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:41:47.574 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-30T18:41:47.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:41:47.655 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-30T18:41:47.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:41:47.734 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link delete ceph-brx 2023-11-30T18:41:47.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:41:47.823 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-11-30T18:41:47.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-30T18:41:47.839 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link delete ceph-brx 2023-11-30T18:41:47.908 INFO:teuthology.orchestra.run.smithi115.stderr:Cannot find device "ceph-brx" 2023-11-30T18:41:47.908 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-30T18:41:47.909 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-30T18:41:47.918 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-11-30T18:41:47.919 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:41:48.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.041+0000 7f49a5526700 1 Processor -- start 2023-11-30T18:41:48.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.042+0000 7f49a5526700 1 -- start start 2023-11-30T18:41:48.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.042+0000 7f49a5526700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f49a0150890 0x7f49a00bbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:48.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.042+0000 7f49a5526700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a00c28c0 con 0x7f49a006a010 2023-11-30T18:41:48.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.042+0000 7f49a5526700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a01552e0 con 0x7f49a00bc320 2023-11-30T18:41:48.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.042+0000 7f49a5526700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a006a4b0 con 0x7f49a0150890 2023-11-30T18:41:48.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.043+0000 7f499effd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f49a0150890 0x7f49a00bbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:48.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.043+0000 7f499f7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f49a006a010 0x7f49a01544f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50564/0 (socket says 172.21.15.49:50564) 2023-11-30T18:41:48.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.043+0000 7f499f7fe700 1 -- 172.21.15.49:0/951211877 learned_addr learned my addr 172.21.15.49:0/951211877 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:48.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.043+0000 7f499effd700 1 -- 172.21.15.49:0/951211877 >> v1:172.21.15.115:6789/0 conn(0x7f49a00bc320 legacy=0x7f49a0069900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:48.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.043+0000 7f499effd700 1 -- 172.21.15.49:0/951211877 >> v1:172.21.15.49:6789/0 conn(0x7f49a006a010 legacy=0x7f49a01544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:48.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.043+0000 7f499effd700 1 -- 172.21.15.49:0/951211877 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a00c1f90 con 0x7f49a0150890 2023-11-30T18:41:48.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.043+0000 7f499dffb700 1 -- 172.21.15.49:0/951211877 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1640413300 0 0) 0x7f49a00c28c0 con 0x7f49a006a010 2023-11-30T18:41:48.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.043+0000 7f499effd700 1 --2- 172.21.15.49:0/951211877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49a0150890 0x7f49a00bbe30 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 rx=0x7f4990009e60 tx=0x7f4990009780).ready entity=mon.0 client_cookie=95401a14f1e2adb5 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:48.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.043+0000 7f499dffb700 1 -- 172.21.15.49:0/951211877 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499000e070 con 0x7f49a0150890 2023-11-30T18:41:48.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.043+0000 7f499dffb700 1 -- 172.21.15.49:0/951211877 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499000bc30 con 0x7f49a0150890 2023-11-30T18:41:48.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.043+0000 7f499dffb700 1 -- 172.21.15.49:0/951211877 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4990012410 con 0x7f49a0150890 2023-11-30T18:41:48.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.044+0000 7f49a5526700 1 -- 172.21.15.49:0/951211877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49a0150890 msgr2=0x7f49a00bbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:48.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.044+0000 7f49a5526700 1 --2- 172.21.15.49:0/951211877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49a0150890 0x7f49a00bbe30 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 rx=0x7f4990009e60 tx=0x7f4990009780).stop 2023-11-30T18:41:48.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.044+0000 7f49a5526700 1 -- 172.21.15.49:0/951211877 shutdown_connections 2023-11-30T18:41:48.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.044+0000 7f49a5526700 1 --2- 172.21.15.49:0/951211877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49a0150890 0x7f49a00bbe30 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:48.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.044+0000 7f49a5526700 1 -- 172.21.15.49:0/951211877 >> 172.21.15.49:0/951211877 conn(0x7f49a00631d0 msgr2=0x7f49a00c6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:48.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.044+0000 7f49a5526700 1 -- 172.21.15.49:0/951211877 shutdown_connections 2023-11-30T18:41:48.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.044+0000 7f49a5526700 1 -- 172.21.15.49:0/951211877 wait complete. 2023-11-30T18:41:48.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.045+0000 7f49a5526700 1 Processor -- start 2023-11-30T18:41:48.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.045+0000 7f49a5526700 1 -- start start 2023-11-30T18:41:48.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.046+0000 7f49a5526700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49a006a010 0x7f49a00aaa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:48.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.046+0000 7f49a5526700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49a00bc320 0x7f49a00aaf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:48.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.046+0000 7f49a5526700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49a0150890 0x7f49a0162c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:48.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.046+0000 7f49a5526700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a00ab560 con 0x7f49a0150890 2023-11-30T18:41:48.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.046+0000 7f49a5526700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a0092960 con 0x7f49a00bc320 2023-11-30T18:41:48.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.046+0000 7f49a5526700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a0091ba0 con 0x7f49a006a010 2023-11-30T18:41:48.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.046+0000 7f499f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49a0150890 0x7f49a0162c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:48.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.046+0000 7f499f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49a0150890 0x7f49a0162c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59000/0 (socket says 172.21.15.49:59000) 2023-11-30T18:41:48.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.046+0000 7f499f7fe700 1 -- 172.21.15.49:0/992668926 learned_addr learned my addr 172.21.15.49:0/992668926 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:48.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.046+0000 7f499effd700 1 --2- 172.21.15.49:0/992668926 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49a006a010 0x7f49a00aaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:48.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.046+0000 7f499e7fc700 1 --2- 172.21.15.49:0/992668926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49a00bc320 0x7f49a00aaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:48.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.046+0000 7f499f7fe700 1 -- 172.21.15.49:0/992668926 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49a006a010 msgr2=0x7f49a00aaa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:48.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.046+0000 7f499f7fe700 1 --2- 172.21.15.49:0/992668926 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49a006a010 0x7f49a00aaa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:48.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.046+0000 7f499f7fe700 1 -- 172.21.15.49:0/992668926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49a00bc320 msgr2=0x7f49a00aaf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:48.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.046+0000 7f499f7fe700 1 --2- 172.21.15.49:0/992668926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49a00bc320 0x7f49a00aaf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:48.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.046+0000 7f499f7fe700 1 -- 172.21.15.49:0/992668926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4990009a20 con 0x7f49a0150890 2023-11-30T18:41:48.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.047+0000 7f499f7fe700 1 --2- 172.21.15.49:0/992668926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49a0150890 0x7f49a0162c60 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 rx=0x7f4998001eb0 tx=0x7f4998007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:48.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.047+0000 7f4996ffd700 1 -- 172.21.15.49:0/992668926 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49980070d0 con 0x7f49a0150890 2023-11-30T18:41:48.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.047+0000 7f4996ffd700 1 -- 172.21.15.49:0/992668926 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4998007230 con 0x7f49a0150890 2023-11-30T18:41:48.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.047+0000 7f4996ffd700 1 -- 172.21.15.49:0/992668926 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49980075f0 con 0x7f49a0150890 2023-11-30T18:41:48.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.047+0000 7f49a5526700 1 -- 172.21.15.49:0/992668926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a0091e80 con 0x7f49a0150890 2023-11-30T18:41:48.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.047+0000 7f49a5526700 1 -- 172.21.15.49:0/992668926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a0092440 con 0x7f49a0150890 2023-11-30T18:41:48.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.048+0000 7f49a5526700 1 -- 172.21.15.49:0/992668926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a0092660 con 0x7f49a0150890 2023-11-30T18:41:48.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.048+0000 7f4996ffd700 1 -- 172.21.15.49:0/992668926 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f49980059b0 con 0x7f49a0150890 2023-11-30T18:41:48.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.048+0000 7f4996ffd700 1 --2- 172.21.15.49:0/992668926 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f498005f270 0x7f4980061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:48.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.049+0000 7f4996ffd700 1 -- 172.21.15.49:0/992668926 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(225..225 src has 1..225) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f4998079920 con 0x7f49a0150890 2023-11-30T18:41:48.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.049+0000 7f499effd700 1 --2- 172.21.15.49:0/992668926 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f498005f270 0x7f4980061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:48.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.049+0000 7f499effd700 1 --2- 172.21.15.49:0/992668926 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f498005f270 0x7f4980061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f49900099f0 tx=0x7f4990009780).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:48.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.053+0000 7f4996ffd700 1 -- 172.21.15.49:0/992668926 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f499804ab20 con 0x7f49a0150890 2023-11-30T18:41:48.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.228+0000 7f49a5526700 1 -- 172.21.15.49:0/992668926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49a0163570 con 0x7f49a0150890 2023-11-30T18:41:48.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.229+0000 7f4996ffd700 1 -- 172.21.15.49:0/992668926 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v225) v1 ==== 74+0+14716 (secure 0 0 0) 0x7f4998079020 con 0x7f49a0150890 2023-11-30T18:41:48.229 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:48.230 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":225,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:41:45.105847+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"223","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/483174904":"2023-12-01T18:41:40.879006+0000","172.21.15.49:6835/1129424322":"2023-12-01T18:41:41.100183+0000","172.21.15.49:6833/1129424322":"2023-12-01T18:41:41.100183+0000","172.21.15.115:0/728270803":"2023-12-01T18:41:40.879006+0000","172.21.15.115:0/2113507503":"2023-12-01T18:41:40.879006+0000","172.21.15.115:0/825362846":"2023-12-01T18:41:40.879006+0000","172.21.15.115:0/695180815":"2023-12-01T18:41:40.879006+0000","172.21.15.115:0/1773998477":"2023-12-01T18:41:33.621332+0000","172.21.15.115:6833/103051":"2023-12-01T18:41:33.621332+0000","172.21.15.115:6832/103051":"2023-12-01T18:41:33.621332+0000","172.21.15.115:0/3037216069":"2023-12-01T18:41:33.621332+0000","172.21.15.115:0/467841810":"2023-12-01T18:41:33.621332+0000","172.21.15.115:0/107175683":"2023-12-01T18:41:33.621332+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:41:48.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.230+0000 7f49a5526700 1 -- 172.21.15.49:0/992668926 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f498005f270 msgr2=0x7f4980061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:48.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.230+0000 7f49a5526700 1 --2- 172.21.15.49:0/992668926 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f498005f270 0x7f4980061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f49900099f0 tx=0x7f4990009780).stop 2023-11-30T18:41:48.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.230+0000 7f49a5526700 1 -- 172.21.15.49:0/992668926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49a0150890 msgr2=0x7f49a0162c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:48.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.230+0000 7f49a5526700 1 --2- 172.21.15.49:0/992668926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49a0150890 0x7f49a0162c60 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 rx=0x7f4998001eb0 tx=0x7f4998007bb0).stop 2023-11-30T18:41:48.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.230+0000 7f49a5526700 1 -- 172.21.15.49:0/992668926 shutdown_connections 2023-11-30T18:41:48.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.230+0000 7f49a5526700 1 --2- 172.21.15.49:0/992668926 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f498005f270 0x7f4980061730 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:48.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.230+0000 7f49a5526700 1 --2- 172.21.15.49:0/992668926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49a0150890 0x7f49a0162c60 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:48.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.230+0000 7f49a5526700 1 --2- 172.21.15.49:0/992668926 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49a006a010 0x7f49a00aaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:48.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.230+0000 7f49a5526700 1 --2- 172.21.15.49:0/992668926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49a00bc320 0x7f49a00aaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:48.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.230+0000 7f49a5526700 1 -- 172.21.15.49:0/992668926 >> 172.21.15.49:0/992668926 conn(0x7f49a00631d0 msgr2=0x7f49a00c64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:48.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.231+0000 7f49a5526700 1 -- 172.21.15.49:0/992668926 shutdown_connections 2023-11-30T18:41:48.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.231+0000 7f49a5526700 1 -- 172.21.15.49:0/992668926 wait complete. 2023-11-30T18:41:48.244 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-30T18:41:48.244 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T18:41:48.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.361+0000 7fb91cb2c700 1 Processor -- start 2023-11-30T18:41:48.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.361+0000 7fb91cb2c700 1 -- start start 2023-11-30T18:41:48.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.362+0000 7fb91cb2c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb9181544e0 0x7fb9181548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:48.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.362+0000 7fb91cb2c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9180c6e30 0x7fb9180c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:48.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.362+0000 7fb91cb2c700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9180c69a0 con 0x7fb91806a610 2023-11-30T18:41:48.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.362+0000 7fb91cb2c700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9180c13a0 con 0x7fb9181544e0 2023-11-30T18:41:48.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.362+0000 7fb91cb2c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9180c1680 con 0x7fb9180c6e30 2023-11-30T18:41:48.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.362+0000 7fb91659c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb9181544e0 0x7fb9181548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:48.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.362+0000 7fb915d9b700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb91806a610 0x7fb9180c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50576/0 (socket says 172.21.15.49:50576) 2023-11-30T18:41:48.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.362+0000 7fb915d9b700 1 -- 172.21.15.49:0/3686224457 learned_addr learned my addr 172.21.15.49:0/3686224457 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:48.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.362+0000 7fb91659c700 1 --2- 172.21.15.49:0/3686224457 >> v2:172.21.15.49:3300/0 conn(0x7fb9181544e0 0x7fb9181548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59016/0 (socket says 172.21.15.49:59016) 2023-11-30T18:41:48.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.362+0000 7fb916d9d700 1 --2- 172.21.15.49:0/3686224457 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9180c6e30 0x7fb9180c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:48.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.362+0000 7fb91659c700 1 -- 172.21.15.49:0/3686224457 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9180c6e30 msgr2=0x7fb9180c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:48.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.362+0000 7fb91659c700 1 --2- 172.21.15.49:0/3686224457 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9180c6e30 0x7fb9180c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:48.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.362+0000 7fb91659c700 1 -- 172.21.15.49:0/3686224457 >> v1:172.21.15.49:6789/0 conn(0x7fb91806a610 legacy=0x7fb9180c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:48.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.362+0000 7fb91659c700 1 -- 172.21.15.49:0/3686224457 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9180c6630 con 0x7fb9181544e0 2023-11-30T18:41:48.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.362+0000 7fb91559a700 1 -- 172.21.15.49:0/3686224457 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 136140033 0 0) 0x7fb9180c69a0 con 0x7fb91806a610 2023-11-30T18:41:48.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.362+0000 7fb916d9d700 1 --2- 172.21.15.49:0/3686224457 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9180c6e30 0x7fb9180c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:41:48.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.362+0000 7fb91659c700 1 --2- 172.21.15.49:0/3686224457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9181544e0 0x7fb9181548c0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 rx=0x7fb910006fd0 tx=0x7fb910006f40).ready entity=mon.0 client_cookie=e9f833aea434fe12 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:48.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.362+0000 7fb91559a700 1 -- 172.21.15.49:0/3686224457 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb910005880 con 0x7fb9181544e0 2023-11-30T18:41:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.363+0000 7fb91559a700 1 -- 172.21.15.49:0/3686224457 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9100059e0 con 0x7fb9181544e0 2023-11-30T18:41:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.363+0000 7fb91559a700 1 -- 172.21.15.49:0/3686224457 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb910005d60 con 0x7fb9181544e0 2023-11-30T18:41:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.363+0000 7fb91cb2c700 1 -- 172.21.15.49:0/3686224457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9181544e0 msgr2=0x7fb9181548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.363+0000 7fb91cb2c700 1 --2- 172.21.15.49:0/3686224457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9181544e0 0x7fb9181548c0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 rx=0x7fb910006fd0 tx=0x7fb910006f40).stop 2023-11-30T18:41:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.363+0000 7fb91cb2c700 1 -- 172.21.15.49:0/3686224457 shutdown_connections 2023-11-30T18:41:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.363+0000 7fb91cb2c700 1 --2- 172.21.15.49:0/3686224457 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9180c6e30 0x7fb9180c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.363+0000 7fb91cb2c700 1 --2- 172.21.15.49:0/3686224457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9181544e0 0x7fb9181548c0 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.363+0000 7fb91cb2c700 1 -- 172.21.15.49:0/3686224457 >> 172.21.15.49:0/3686224457 conn(0x7fb918085020 msgr2=0x7fb918094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.363+0000 7fb91cb2c700 1 -- 172.21.15.49:0/3686224457 shutdown_connections 2023-11-30T18:41:48.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.363+0000 7fb91cb2c700 1 -- 172.21.15.49:0/3686224457 wait complete. 2023-11-30T18:41:48.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.364+0000 7fb91cb2c700 1 Processor -- start 2023-11-30T18:41:48.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.364+0000 7fb91cb2c700 1 -- start start 2023-11-30T18:41:48.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.365+0000 7fb91cb2c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb91806a610 0x7fb91813e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:48.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.365+0000 7fb91cb2c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9180c6e30 0x7fb918097c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:48.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.365+0000 7fb91cb2c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9181544e0 0x7fb918096240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:48.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.365+0000 7fb91cb2c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91813eb00 con 0x7fb91806a610 2023-11-30T18:41:48.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.365+0000 7fb91cb2c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb918096bb0 con 0x7fb9181544e0 2023-11-30T18:41:48.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.365+0000 7fb91cb2c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb918096e90 con 0x7fb9180c6e30 2023-11-30T18:41:48.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.365+0000 7fb91659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb91806a610 0x7fb91813e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:48.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.365+0000 7fb91659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb91806a610 0x7fb91813e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59020/0 (socket says 172.21.15.49:59020) 2023-11-30T18:41:48.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.365+0000 7fb91659c700 1 -- 172.21.15.49:0/2010521221 learned_addr learned my addr 172.21.15.49:0/2010521221 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:48.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.365+0000 7fb915d9b700 1 --2- 172.21.15.49:0/2010521221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9180c6e30 0x7fb918097c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:48.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.365+0000 7fb916d9d700 1 --2- 172.21.15.49:0/2010521221 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9181544e0 0x7fb918096240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:48.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.365+0000 7fb91659c700 1 -- 172.21.15.49:0/2010521221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9180c6e30 msgr2=0x7fb918097c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:48.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.365+0000 7fb91659c700 1 --2- 172.21.15.49:0/2010521221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9180c6e30 0x7fb918097c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:48.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.365+0000 7fb91659c700 1 -- 172.21.15.49:0/2010521221 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9181544e0 msgr2=0x7fb918096240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:48.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.366+0000 7fb91659c700 1 --2- 172.21.15.49:0/2010521221 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9181544e0 0x7fb918096240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:48.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.366+0000 7fb91659c700 1 -- 172.21.15.49:0/2010521221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb910009250 con 0x7fb91806a610 2023-11-30T18:41:48.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.366+0000 7fb91659c700 1 --2- 172.21.15.49:0/2010521221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb91806a610 0x7fb91813e610 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 rx=0x7fb91805fb30 tx=0x7fb910016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:48.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.366+0000 7fb90e7fc700 1 -- 172.21.15.49:0/2010521221 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91000b790 con 0x7fb91806a610 2023-11-30T18:41:48.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.366+0000 7fb90e7fc700 1 -- 172.21.15.49:0/2010521221 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91000b8f0 con 0x7fb91806a610 2023-11-30T18:41:48.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.366+0000 7fb90e7fc700 1 -- 172.21.15.49:0/2010521221 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91000bc70 con 0x7fb91806a610 2023-11-30T18:41:48.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.366+0000 7fb91cb2c700 1 -- 172.21.15.49:0/2010521221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb918097170 con 0x7fb91806a610 2023-11-30T18:41:48.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.366+0000 7fb91cb2c700 1 -- 172.21.15.49:0/2010521221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb918097730 con 0x7fb91806a610 2023-11-30T18:41:48.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.367+0000 7fb91cb2c700 1 -- 172.21.15.49:0/2010521221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb91806c860 con 0x7fb91806a610 2023-11-30T18:41:48.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.367+0000 7fb90e7fc700 1 -- 172.21.15.49:0/2010521221 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb910011650 con 0x7fb91806a610 2023-11-30T18:41:48.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.368+0000 7fb90e7fc700 1 --2- 172.21.15.49:0/2010521221 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fb8f805f270 0x7fb8f8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:48.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.368+0000 7fb90e7fc700 1 -- 172.21.15.49:0/2010521221 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(225..225 src has 1..225) v4 ==== 5940+0+0 (secure 0 0 0) 0x7fb91007bb50 con 0x7fb91806a610 2023-11-30T18:41:48.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.368+0000 7fb915d9b700 1 --2- 172.21.15.49:0/2010521221 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fb8f805f270 0x7fb8f8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:48.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.368+0000 7fb915d9b700 1 --2- 172.21.15.49:0/2010521221 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fb8f805f270 0x7fb8f8061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fb9180990a0 tx=0x7fb900009040).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:48.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.372+0000 7fb90e7fc700 1 -- 172.21.15.49:0/2010521221 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb91004cd50 con 0x7fb91806a610 2023-11-30T18:41:48.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.540+0000 7fb91cb2c700 1 -- 172.21.15.49:0/2010521221 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb9180ae310 con 0x7fb8f805f270 2023-11-30T18:41:48.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.544+0000 7fb90e7fc700 1 -- 172.21.15.49:0/2010521221 <== mgr.9772 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71233 (secure 0 0 0) 0x7fb9180ae310 con 0x7fb8f805f270 2023-11-30T18:41:48.545 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:48.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.545+0000 7fb91cb2c700 1 -- 172.21.15.49:0/2010521221 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fb8f805f270 msgr2=0x7fb8f8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:48.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.545+0000 7fb91cb2c700 1 --2- 172.21.15.49:0/2010521221 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fb8f805f270 0x7fb8f8061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fb9180990a0 tx=0x7fb900009040).stop 2023-11-30T18:41:48.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.545+0000 7fb91cb2c700 1 -- 172.21.15.49:0/2010521221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb91806a610 msgr2=0x7fb91813e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:48.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.545+0000 7fb91cb2c700 1 --2- 172.21.15.49:0/2010521221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb91806a610 0x7fb91813e610 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 rx=0x7fb91805fb30 tx=0x7fb910016000).stop 2023-11-30T18:41:48.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.545+0000 7fb91cb2c700 1 -- 172.21.15.49:0/2010521221 shutdown_connections 2023-11-30T18:41:48.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.545+0000 7fb91cb2c700 1 --2- 172.21.15.49:0/2010521221 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fb8f805f270 0x7fb8f8061730 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:48.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.545+0000 7fb91cb2c700 1 --2- 172.21.15.49:0/2010521221 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9181544e0 0x7fb918096240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:48.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.545+0000 7fb91cb2c700 1 --2- 172.21.15.49:0/2010521221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb91806a610 0x7fb91813e610 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:48.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.545+0000 7fb91cb2c700 1 --2- 172.21.15.49:0/2010521221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9180c6e30 0x7fb918097c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:48.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.546+0000 7fb91cb2c700 1 -- 172.21.15.49:0/2010521221 >> 172.21.15.49:0/2010521221 conn(0x7fb918085020 msgr2=0x7fb9180c9890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:48.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.546+0000 7fb91cb2c700 1 -- 172.21.15.49:0/2010521221 shutdown_connections 2023-11-30T18:41:48.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.546+0000 7fb91cb2c700 1 -- 172.21.15.49:0/2010521221 wait complete. 2023-11-30T18:41:48.548 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T18:41:48.558 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2023-11-30T18:41:46.896204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2460384,"kb_used_data":22048,"kb_used_omap":0,"kb_used_meta":2438272,"kb_avail":752514336,"statfs":{"total":773094113280,"available":770574680064,"internally_reserved":0,"allocated":22577152,"data_stored":11619448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2496790528},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13043,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-64,"num_write_kb":-36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.212215"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":191,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.428905+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T18:41:44.428905+0000","last_peered":"2023-11-30T18:41:44.428905+0000","last_clean":"2023-11-30T18:41:44.428905+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T18:41:44.428905+0000","last_undegraded":"2023-11-30T18:41:44.428905+0000","last_fullsized":"2023-11-30T18:41:44.428905+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":187,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.428979+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T18:41:44.428979+0000","last_peered":"2023-11-30T18:41:44.428979+0000","last_clean":"2023-11-30T18:41:44.428979+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T18:41:44.428979+0000","last_undegraded":"2023-11-30T18:41:44.428979+0000","last_fullsized":"2023-11-30T18:41:44.428979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":195,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.430709+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T18:41:44.430709+0000","last_peered":"2023-11-30T18:41:44.430709+0000","last_clean":"2023-11-30T18:41:44.430709+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T18:41:44.430709+0000","last_undegraded":"2023-11-30T18:41:44.430709+0000","last_fullsized":"2023-11-30T18:41:44.430709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":187,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.430859+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T18:41:44.430859+0000","last_peered":"2023-11-30T18:41:44.430859+0000","last_clean":"2023-11-30T18:41:44.430859+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T18:41:44.430859+0000","last_undegraded":"2023-11-30T18:41:44.430859+0000","last_fullsized":"2023-11-30T18:41:44.430859+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":183,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.428147+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T18:41:44.428147+0000","last_peered":"2023-11-30T18:41:44.428147+0000","last_clean":"2023-11-30T18:41:44.428147+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T18:41:44.428147+0000","last_undegraded":"2023-11-30T18:41:44.428147+0000","last_fullsized":"2023-11-30T18:41:44.428147+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":181,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.428241+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T18:41:44.428241+0000","last_peered":"2023-11-30T18:41:44.428241+0000","last_clean":"2023-11-30T18:41:44.428241+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T18:41:44.428241+0000","last_undegraded":"2023-11-30T18:41:44.428241+0000","last_fullsized":"2023-11-30T18:41:44.428241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.434931+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T18:41:44.434931+0000","last_peered":"2023-11-30T18:41:44.434931+0000","last_clean":"2023-11-30T18:41:44.434931+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T18:41:44.434931+0000","last_undegraded":"2023-11-30T18:41:44.434931+0000","last_fullsized":"2023-11-30T18:41:44.434931+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":191,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.428827+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T18:41:44.428827+0000","last_peered":"2023-11-30T18:41:44.428827+0000","last_clean":"2023-11-30T18:41:44.428827+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T18:41:44.428827+0000","last_undegraded":"2023-11-30T18:41:44.428827+0000","last_fullsized":"2023-11-30T18:41:44.428827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":212,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.117140+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T18:41:44.117140+0000","last_peered":"2023-11-30T18:41:44.117140+0000","last_clean":"2023-11-30T18:41:44.117140+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T18:41:44.117140+0000","last_undegraded":"2023-11-30T18:41:44.117140+0000","last_fullsized":"2023-11-30T18:41:44.117140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575973,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303948,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94067892,"statfs":{"total":96636764160,"available":96325521408,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.377,"5min":0.34200000000000003,"15min":0.28699999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.84799999999999998},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.621,"15min":0.63},"min":{"1min":0.46999999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82099999999999995,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.69399999999999995}]},{"osd":1,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.39500000000000002,"5min":0.36199999999999999,"15min":0.35899999999999999},"max":{"1min":0.74199999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56000000000000005,"15min":0.57399999999999995},"min":{"1min":0.38400000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73199999999999998,"5min":0.77800000000000002,"15min":0.877},"last":0.71699999999999997}]},{"osd":2,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.81100000000000005},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.44600000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79300000000000004,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.66100000000000003}]},{"osd":3,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55800000000000005,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.372,"15min":0.35899999999999999},"max":{"1min":0.78100000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59499999999999997,"15min":0.60699999999999998},"min":{"1min":0.42699999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77600000000000002,"5min":0.80400000000000005,"15min":0.89900000000000002},"last":0.75900000000000001}]},{"osd":4,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46600000000000003,"15min":0.46500000000000002},"min":{"1min":0.32100000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.66100000000000003,"5min":1.264,"15min":1.264},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.48699999999999999,"15min":0.48999999999999999},"min":{"1min":0.307,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.64400000000000002,"5min":1.149,"15min":1.149},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.498,"15min":0.497},"min":{"1min":0.32200000000000001,"5min":0.30599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71099999999999997,"5min":0.78200000000000003,"15min":0.83399999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.52900000000000003,"15min":0.53100000000000003},"min":{"1min":0.38400000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66800000000000004,"5min":1.286,"15min":1.286},"last":0.59099999999999997}]},{"osd":6,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.38100000000000001,"5min":0.33000000000000002,"15min":0.32300000000000001},"max":{"1min":0.72699999999999998,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54700000000000004,"15min":0.55400000000000005},"min":{"1min":0.34799999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.68799999999999994,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.51600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575972,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308044,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063796,"statfs":{"total":96636764160,"available":96321327104,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58999999999999997,"15min":0.60799999999999998},"min":{"1min":0.38500000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.79500000000000004,"5min":0.80500000000000005,"15min":1.6379999999999999},"last":0.628},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.61399999999999999,"15min":0.622},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.27800000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":1.246},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.58199999999999996,"15min":0.60599999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72399999999999998,"5min":0.78400000000000003,"15min":1.1200000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60799999999999998,"15min":0.628},"min":{"1min":0.40400000000000003,"5min":0.39100000000000001,"15min":0.35499999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.90400000000000003},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58599999999999997,"15min":0.59699999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.34499999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":1.288},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.60199999999999998,"15min":0.626},"min":{"1min":0.40000000000000002,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":1.177},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.54600000000000004,"15min":0.56999999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.33400000000000002},"max":{"1min":0.76700000000000002,"5min":0.79400000000000004,"15min":1.204},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55100000000000005,"15min":0.56599999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.68200000000000005,"5min":0.78300000000000003,"15min":1.337},"last":0.46999999999999997}]},{"osd":4,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.45200000000000001,"15min":0.47299999999999998},"min":{"1min":0.34200000000000003,"5min":0.32500000000000001,"15min":0.28699999999999998},"max":{"1min":0.68799999999999994,"5min":0.80800000000000005,"15min":1.51},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.503,"5min":0.47699999999999998,"15min":0.49299999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.30399999999999999},"max":{"1min":0.77400000000000002,"5min":0.79300000000000004,"15min":0.94299999999999995},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.46000000000000002,"15min":0.47299999999999998},"min":{"1min":0.33200000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72699999999999998,"5min":0.77600000000000002,"15min":1.159},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.51600000000000001,"15min":0.53100000000000003},"min":{"1min":0.30599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.747,"5min":0.84899999999999998,"15min":1.679},"last":0.71999999999999997}]},{"osd":7,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52900000000000003,"15min":0.54100000000000004},"min":{"1min":0.38,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73499999999999999,"5min":0.83899999999999997,"15min":0.96199999999999997},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77000000000000002,"5min":0.89100000000000001,"15min":1.427},"last":0.66000000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575972,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.35699999999999998,"15min":0.374},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59499999999999997,"5min":0.66300000000000003,"15min":0.79900000000000004},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.47799999999999998,"15min":0.503},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71699999999999997,"5min":0.78800000000000003,"15min":0.87},"last":0.439}]},{"osd":2,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39000000000000001,"15min":0.40799999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.60399999999999998,"5min":0.64700000000000002,"15min":0.89100000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.497,"15min":0.52400000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.63400000000000001,"5min":0.80300000000000005,"15min":0.98599999999999999},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46200000000000002,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68899999999999995,"5min":0.749,"15min":0.91900000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.437,"5min":0.439,"15min":0.45500000000000002},"min":{"1min":0.308,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66100000000000003,"5min":0.71399999999999997,"15min":0.84599999999999997},"last":0.32000000000000001}]},{"osd":4,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59299999999999997,"15min":0.61199999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":0.89000000000000001,"5min":0.89800000000000002,"15min":0.93999999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63900000000000001,"15min":0.66200000000000003},"min":{"1min":0.46200000000000002,"5min":0.45500000000000002,"15min":0.42299999999999999},"max":{"1min":0.94799999999999995,"5min":1.0329999999999999,"15min":1.0700000000000001},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60899999999999999,"15min":0.627},"min":{"1min":0.43099999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76300000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.63100000000000001,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.39200000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.98099999999999998},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.67800000000000005,"15min":0.69999999999999996},"min":{"1min":0.46000000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.99099999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.629},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.66300000000000003,"15min":0.68300000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.40799999999999997},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":1.004},"last":0.51900000000000002}]},{"osd":7,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68600000000000005,"15min":0.70499999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46100000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":1.012},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.66900000000000004,"15min":0.68899999999999995},"min":{"1min":0.46600000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.96399999999999997,"5min":0.97599999999999998,"15min":1.02},"last":0.60699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575972,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.39300000000000002,"15min":0.39600000000000002},"min":{"1min":0.26000000000000001,"5min":0.252,"15min":0.22900000000000001},"max":{"1min":0.45900000000000002,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42299999999999999,"15min":0.41899999999999998},"min":{"1min":0.28399999999999997,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.497,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.30099999999999999}]},{"osd":2,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.40699999999999997,"15min":0.41399999999999998},"min":{"1min":0.26000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.63500000000000001,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48599999999999999,"15min":0.495},"min":{"1min":0.36799999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.626,"5min":0.69799999999999995,"15min":0.74199999999999999},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.47299999999999998,"15min":0.46200000000000002},"min":{"1min":0.33500000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.54200000000000004,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.375},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.47299999999999998,"15min":0.47099999999999997},"min":{"1min":0.33100000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.57899999999999996,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.38600000000000001}]},{"osd":4,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61699999999999999,"15min":0.63300000000000001},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.40200000000000002},"max":{"1min":0.72299999999999998,"5min":0.85399999999999998,"15min":1.026},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65200000000000002,"15min":0.65500000000000003},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84299999999999997,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.48799999999999999,"5min":0.41799999999999998,"15min":0.40400000000000003},"max":{"1min":0.86399999999999999,"5min":0.97699999999999998,"15min":0.97799999999999998},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.64100000000000001,"15min":0.66100000000000003},"min":{"1min":0.48399999999999999,"5min":0.47199999999999998,"15min":0.439},"max":{"1min":0.751,"5min":0.91000000000000003,"15min":1.079},"last":0.56599999999999995}]},{"osd":6,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67500000000000004,"15min":0.68200000000000005},"min":{"1min":0.48399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.67500000000000004,"15min":0.67800000000000005},"min":{"1min":0.45200000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91500000000000004,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.501}]},{"osd":7,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.67800000000000005,"15min":0.69499999999999995},"min":{"1min":0.45800000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82999999999999996,"5min":0.94099999999999995,"15min":1.123},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71699999999999997,"15min":0.73199999999999998},"min":{"1min":0.56399999999999995,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92000000000000004,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.57799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575972,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40699999999999997,"15min":0.41499999999999998},"min":{"1min":0.28000000000000003,"5min":0.249,"15min":0.23200000000000001},"max":{"1min":0.54600000000000004,"5min":0.64800000000000002,"15min":0.72099999999999997},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45200000000000001,"15min":0.45800000000000002},"min":{"1min":0.29199999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.623,"5min":0.63400000000000001,"15min":0.73199999999999998},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.45100000000000001,"15min":0.46000000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.66800000000000004,"5min":0.70599999999999996,"15min":0.74299999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48899999999999999,"15min":0.49199999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.29899999999999999},"max":{"1min":0.68700000000000006,"5min":0.746,"15min":0.752},"last":0.37}]},{"osd":3,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.42199999999999999,"15min":0.42299999999999999},"min":{"1min":0.29399999999999998,"5min":0.28399999999999997,"15min":0.27500000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.49099999999999999,"15min":0.496},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.77100000000000002},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.496,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81299999999999994,"5min":0.91900000000000004,"15min":0.95299999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.61599999999999999,"15min":0.63600000000000001},"min":{"1min":0.46800000000000003,"5min":0.42199999999999999,"15min":0.35899999999999999},"max":{"1min":0.83399999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64700000000000002,"15min":0.66000000000000003},"min":{"1min":0.435,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89900000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65100000000000002,"15min":0.66500000000000004},"min":{"1min":0.52500000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80200000000000005,"5min":1.01,"15min":1.01},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63900000000000001,"15min":0.64800000000000002},"min":{"1min":0.50900000000000001,"5min":0.432,"15min":0.40500000000000003},"max":{"1min":0.81899999999999995,"5min":0.93000000000000005,"15min":0.93200000000000005},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.67900000000000005,"15min":0.69499999999999995},"min":{"1min":0.53400000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88500000000000001,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67900000000000005,"15min":0.68999999999999995},"min":{"1min":0.53700000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96499999999999997,"5min":0.97799999999999998,"15min":1.0109999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69699999999999995,"15min":0.71399999999999997},"min":{"1min":0.51100000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.91300000000000003,"5min":0.97899999999999998,"15min":0.98699999999999999},"last":0.69999999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575972,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299980,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94071860,"statfs":{"total":96636764160,"available":96329584640,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38200000000000001,"15min":0.38},"min":{"1min":0.26300000000000001,"5min":0.254,"15min":0.222},"max":{"1min":0.60899999999999999,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.316},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.42299999999999999,"15min":0.42599999999999999},"min":{"1min":0.29999999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.56000000000000005,"5min":0.64200000000000002,"15min":0.754},"last":0.32600000000000001}]},{"osd":1,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39400000000000002,"15min":0.40300000000000002},"min":{"1min":0.28799999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.59499999999999997,"5min":0.65800000000000003,"15min":0.73399999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.442,"15min":0.45200000000000001},"min":{"1min":0.32300000000000001,"5min":0.28699999999999998,"15min":0.25700000000000001},"max":{"1min":0.65900000000000003,"5min":0.66800000000000004,"15min":0.86699999999999999},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47399999999999998,"15min":0.47299999999999998},"min":{"1min":0.35599999999999998,"5min":0.29299999999999998,"15min":0.27800000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.79500000000000004},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51500000000000001,"15min":0.52100000000000002},"min":{"1min":0.41399999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.747,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.434,"5min":0.39100000000000001,"15min":0.35299999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63800000000000001,"15min":0.64700000000000002},"min":{"1min":0.42499999999999999,"5min":0.40300000000000002,"15min":0.40100000000000002},"max":{"1min":0.91800000000000004,"5min":0.97799999999999998,"15min":1.0049999999999999},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63500000000000001,"15min":0.64200000000000002},"min":{"1min":0.45500000000000002,"5min":0.41499999999999998,"15min":0.40699999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.624},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65300000000000002,"15min":0.66400000000000003},"min":{"1min":0.51300000000000001,"5min":0.41299999999999998,"15min":0.34499999999999997},"max":{"1min":1.038,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67300000000000004,"15min":0.67900000000000005},"min":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.377},"max":{"1min":1.004,"5min":1.0189999999999999,"15min":1.0309999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66500000000000004,"15min":0.68500000000000005},"min":{"1min":0.52200000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.54200000000000004}]},{"osd":7,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.68000000000000005,"15min":0.69899999999999995},"min":{"1min":0.48299999999999998,"5min":0.434,"15min":0.434},"max":{"1min":1.03,"5min":1.03,"15min":1.052},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.67900000000000005,"15min":0.69899999999999995},"min":{"1min":0.48599999999999999,"5min":0.441,"15min":0.441},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.59899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575972,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303948,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94067892,"statfs":{"total":96636764160,"available":96325521408,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52200000000000002,"15min":0.55500000000000005},"min":{"1min":0.315,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.85499999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54800000000000004,"15min":0.56499999999999995},"min":{"1min":0.376,"5min":0.34100000000000003,"15min":0.32500000000000001},"max":{"1min":0.77200000000000002,"5min":0.77500000000000002,"15min":0.94999999999999996},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54000000000000004,"15min":0.56399999999999995},"min":{"1min":0.314,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.876},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.54800000000000004,"15min":0.57699999999999996},"min":{"1min":0.34899999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69799999999999995,"5min":0.81399999999999995,"15min":0.91200000000000003},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.57599999999999996,"15min":0.59699999999999998},"min":{"1min":0.33400000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.79000000000000004,"5min":0.81200000000000006,"15min":0.93799999999999994},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.58599999999999997,"15min":0.621},"min":{"1min":0.371,"5min":0.35999999999999999,"15min":0.34899999999999998},"max":{"1min":0.77700000000000002,"5min":0.82299999999999995,"15min":0.94399999999999995},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.53700000000000003,"15min":0.56000000000000005},"min":{"1min":0.38,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70899999999999996,"5min":0.73999999999999999,"15min":0.84999999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.56100000000000005,"15min":0.59599999999999997},"min":{"1min":0.432,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.80300000000000005,"5min":0.80800000000000005,"15min":0.872},"last":0.56499999999999995}]},{"osd":5,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42499999999999999,"15min":0.44700000000000001},"min":{"1min":0.32300000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.626,"5min":0.66600000000000004,"15min":0.86399999999999999},"last":0.439},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.45000000000000001,"15min":0.46800000000000003},"min":{"1min":0.33700000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.82299999999999995},"last":0.42299999999999999}]},{"osd":6,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.47899999999999998,"15min":0.51100000000000001},"min":{"1min":0.36099999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":1.1399999999999999},"last":0.378},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52200000000000002,"15min":0.55800000000000005},"min":{"1min":0.39800000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":1.1220000000000001},"last":0.46899999999999997}]},{"osd":7,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.47999999999999998,"15min":0.52300000000000002},"min":{"1min":0.36099999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77100000000000002,"5min":0.77400000000000002,"15min":0.90000000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55200000000000005,"15min":0.58099999999999996},"min":{"1min":0.44,"5min":0.38600000000000001,"15min":0.35599999999999998},"max":{"1min":0.72899999999999998,"5min":0.73599999999999999,"15min":0.86199999999999999},"last":0.499}]}]},{"osd":5,"up_from":13,"seq":55834575972,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308044,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063796,"statfs":{"total":96636764160,"available":96321327104,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.40799999999999997,"5min":0.317,"15min":0.29799999999999999},"max":{"1min":0.78000000000000003,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.53800000000000003,"15min":0.55100000000000005},"min":{"1min":0.38800000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.90300000000000002},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53900000000000003},"min":{"1min":0.35099999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.83699999999999997},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56699999999999995,"15min":0.57399999999999995},"min":{"1min":0.44,"5min":0.307,"15min":0.307},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.82899999999999996},"last":0.374}]},{"osd":2,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59899999999999998,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.99199999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.432,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":1.173},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56499999999999995,"15min":0.56799999999999995},"min":{"1min":0.38200000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.747,"5min":0.77700000000000002,"15min":0.79300000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58199999999999996,"15min":0.59499999999999997},"min":{"1min":0.46800000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":1.603},"last":0.44}]},{"osd":4,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.317,"5min":0.311,"15min":0.311},"max":{"1min":0.64500000000000002,"5min":0.68000000000000005,"15min":0.75},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.35999999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.69799999999999995,"5min":0.77900000000000003,"15min":0.81200000000000006},"last":0.313}]},{"osd":6,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48499999999999999,"15min":0.498},"min":{"1min":0.34499999999999997,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68799999999999994,"5min":0.75900000000000001,"15min":1.105},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56499999999999995,"15min":0.57199999999999995},"min":{"1min":0.34100000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81000000000000005,"5min":0.85299999999999998,"15min":1.228},"last":0.39900000000000002}]},{"osd":7,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.33000000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69699999999999995,"5min":0.72199999999999998,"15min":0.88100000000000001},"last":0.433},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.39700000000000002,"5min":0.376,"15min":0.317},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":1.0640000000000001},"last":0.38600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T18:41:48.560 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T18:41:48.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.677+0000 7fbecc7da700 1 Processor -- start 2023-11-30T18:41:48.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.677+0000 7fbecc7da700 1 -- start start 2023-11-30T18:41:48.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.678+0000 7fbecc7da700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbec41544e0 0x7fbec41548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:48.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.678+0000 7fbecc7da700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbec40c6e30 0x7fbec40c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:48.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.678+0000 7fbecc7da700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec40c69a0 con 0x7fbec406a610 2023-11-30T18:41:48.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.678+0000 7fbecc7da700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbec40c13a0 con 0x7fbec41544e0 2023-11-30T18:41:48.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.678+0000 7fbecc7da700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec40c1680 con 0x7fbec40c6e30 2023-11-30T18:41:48.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.678+0000 7fbeca576700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbec41544e0 0x7fbec41548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:48.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.678+0000 7fbec9d75700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbec406a610 0x7fbec40c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50592/0 (socket says 172.21.15.49:50592) 2023-11-30T18:41:48.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.678+0000 7fbec9d75700 1 -- 172.21.15.49:0/834431601 learned_addr learned my addr 172.21.15.49:0/834431601 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:48.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.678+0000 7fbecad77700 1 --2- 172.21.15.49:0/834431601 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbec40c6e30 0x7fbec40c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:48.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.679+0000 7fbeca576700 1 -- 172.21.15.49:0/834431601 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbec40c6e30 msgr2=0x7fbec40c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:48.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.679+0000 7fbeca576700 1 --2- 172.21.15.49:0/834431601 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbec40c6e30 0x7fbec40c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:48.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.679+0000 7fbeca576700 1 -- 172.21.15.49:0/834431601 >> v1:172.21.15.49:6789/0 conn(0x7fbec406a610 legacy=0x7fbec40c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:48.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.679+0000 7fbeca576700 1 -- 172.21.15.49:0/834431601 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec40c6630 con 0x7fbec41544e0 2023-11-30T18:41:48.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.679+0000 7fbecad77700 1 --2- 172.21.15.49:0/834431601 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbec40c6e30 0x7fbec40c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:41:48.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.679+0000 7fbec9574700 1 -- 172.21.15.49:0/834431601 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2133811451 0 0) 0x7fbec40c69a0 con 0x7fbec406a610 2023-11-30T18:41:48.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.679+0000 7fbeca576700 1 --2- 172.21.15.49:0/834431601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbec41544e0 0x7fbec41548c0 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 rx=0x7fbebc009eb0 tx=0x7fbebc009780).ready entity=mon.0 client_cookie=9af6d8f11c60b4cf server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:48.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.679+0000 7fbec9574700 1 -- 172.21.15.49:0/834431601 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc00e070 con 0x7fbec41544e0 2023-11-30T18:41:48.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.679+0000 7fbec9574700 1 -- 172.21.15.49:0/834431601 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbebc00bc30 con 0x7fbec41544e0 2023-11-30T18:41:48.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.679+0000 7fbec9574700 1 -- 172.21.15.49:0/834431601 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc012410 con 0x7fbec41544e0 2023-11-30T18:41:48.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.679+0000 7fbecc7da700 1 -- 172.21.15.49:0/834431601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbec41544e0 msgr2=0x7fbec41548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:48.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.679+0000 7fbecc7da700 1 --2- 172.21.15.49:0/834431601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbec41544e0 0x7fbec41548c0 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 rx=0x7fbebc009eb0 tx=0x7fbebc009780).stop 2023-11-30T18:41:48.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.679+0000 7fbecc7da700 1 -- 172.21.15.49:0/834431601 shutdown_connections 2023-11-30T18:41:48.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.679+0000 7fbecc7da700 1 --2- 172.21.15.49:0/834431601 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbec40c6e30 0x7fbec40c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:48.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.679+0000 7fbecc7da700 1 --2- 172.21.15.49:0/834431601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbec41544e0 0x7fbec41548c0 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:48.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.679+0000 7fbecc7da700 1 -- 172.21.15.49:0/834431601 >> 172.21.15.49:0/834431601 conn(0x7fbec4085020 msgr2=0x7fbec4094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:48.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.679+0000 7fbecc7da700 1 -- 172.21.15.49:0/834431601 shutdown_connections 2023-11-30T18:41:48.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.679+0000 7fbecc7da700 1 -- 172.21.15.49:0/834431601 wait complete. 2023-11-30T18:41:48.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.681+0000 7fbecc7da700 1 Processor -- start 2023-11-30T18:41:48.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.681+0000 7fbecc7da700 1 -- start start 2023-11-30T18:41:48.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.681+0000 7fbecc7da700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbec406a610 0x7fbec413e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:48.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.681+0000 7fbecc7da700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbec40c6e30 0x7fbec4097c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:48.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.681+0000 7fbecc7da700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbec41544e0 0x7fbec4096240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:48.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.681+0000 7fbecc7da700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec413eb00 con 0x7fbec41544e0 2023-11-30T18:41:48.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.681+0000 7fbecc7da700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec4096bb0 con 0x7fbec40c6e30 2023-11-30T18:41:48.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.681+0000 7fbecc7da700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec4096e90 con 0x7fbec406a610 2023-11-30T18:41:48.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.681+0000 7fbecad77700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbec41544e0 0x7fbec4096240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:48.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.681+0000 7fbecad77700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbec41544e0 0x7fbec4096240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59038/0 (socket says 172.21.15.49:59038) 2023-11-30T18:41:48.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.681+0000 7fbecad77700 1 -- 172.21.15.49:0/2078156635 learned_addr learned my addr 172.21.15.49:0/2078156635 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:48.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.682+0000 7fbec9d75700 1 --2- 172.21.15.49:0/2078156635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbec40c6e30 0x7fbec4097c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:48.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.682+0000 7fbeca576700 1 --2- 172.21.15.49:0/2078156635 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbec406a610 0x7fbec413e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:48.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.682+0000 7fbecad77700 1 -- 172.21.15.49:0/2078156635 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbec406a610 msgr2=0x7fbec413e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:48.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.682+0000 7fbecad77700 1 --2- 172.21.15.49:0/2078156635 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbec406a610 0x7fbec413e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:48.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.682+0000 7fbecad77700 1 -- 172.21.15.49:0/2078156635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbec40c6e30 msgr2=0x7fbec4097c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:48.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.682+0000 7fbecad77700 1 --2- 172.21.15.49:0/2078156635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbec40c6e30 0x7fbec4097c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:48.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.682+0000 7fbecad77700 1 -- 172.21.15.49:0/2078156635 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbebc009a20 con 0x7fbec41544e0 2023-11-30T18:41:48.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.682+0000 7fbecad77700 1 --2- 172.21.15.49:0/2078156635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbec41544e0 0x7fbec4096240 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 rx=0x7fbeb400d680 tx=0x7fbeb4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:48.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.682+0000 7fbec27fc700 1 -- 172.21.15.49:0/2078156635 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb4011590 con 0x7fbec41544e0 2023-11-30T18:41:48.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.682+0000 7fbec27fc700 1 -- 172.21.15.49:0/2078156635 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb40116f0 con 0x7fbec41544e0 2023-11-30T18:41:48.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.682+0000 7fbecc7da700 1 -- 172.21.15.49:0/2078156635 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec4097170 con 0x7fbec41544e0 2023-11-30T18:41:48.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.682+0000 7fbec27fc700 1 -- 172.21.15.49:0/2078156635 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb4011a70 con 0x7fbec41544e0 2023-11-30T18:41:48.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.682+0000 7fbecc7da700 1 -- 172.21.15.49:0/2078156635 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec4097730 con 0x7fbec41544e0 2023-11-30T18:41:48.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.683+0000 7fbecc7da700 1 -- 172.21.15.49:0/2078156635 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbec406c860 con 0x7fbec41544e0 2023-11-30T18:41:48.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.683+0000 7fbec27fc700 1 -- 172.21.15.49:0/2078156635 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fbeb4012420 con 0x7fbec41544e0 2023-11-30T18:41:48.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.684+0000 7fbec27fc700 1 --2- 172.21.15.49:0/2078156635 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fbeb005f270 0x7fbeb0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:48.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.684+0000 7fbec27fc700 1 -- 172.21.15.49:0/2078156635 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(225..225 src has 1..225) v4 ==== 5940+0+0 (secure 0 0 0) 0x7fbeb4079ca0 con 0x7fbec41544e0 2023-11-30T18:41:48.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.684+0000 7fbeca576700 1 --2- 172.21.15.49:0/2078156635 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fbeb005f270 0x7fbeb0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:48.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.684+0000 7fbeca576700 1 --2- 172.21.15.49:0/2078156635 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fbeb005f270 0x7fbeb0061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fbebc00b9f0 tx=0x7fbebc017000).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:48.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.688+0000 7fbec27fc700 1 -- 172.21.15.49:0/2078156635 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbeb404ae40 con 0x7fbec41544e0 2023-11-30T18:41:48.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.855+0000 7fbecc7da700 1 -- 172.21.15.49:0/2078156635 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbec40ae310 con 0x7fbeb005f270 2023-11-30T18:41:48.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.858+0000 7fbec27fc700 1 -- 172.21.15.49:0/2078156635 <== mgr.9772 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71233 (secure 0 0 0) 0x7fbec40ae310 con 0x7fbeb005f270 2023-11-30T18:41:48.860 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:48.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.860+0000 7fbecc7da700 1 -- 172.21.15.49:0/2078156635 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fbeb005f270 msgr2=0x7fbeb0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:48.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.860+0000 7fbecc7da700 1 --2- 172.21.15.49:0/2078156635 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fbeb005f270 0x7fbeb0061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fbebc00b9f0 tx=0x7fbebc017000).stop 2023-11-30T18:41:48.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.860+0000 7fbecc7da700 1 -- 172.21.15.49:0/2078156635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbec41544e0 msgr2=0x7fbec4096240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:48.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.860+0000 7fbecc7da700 1 --2- 172.21.15.49:0/2078156635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbec41544e0 0x7fbec4096240 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 rx=0x7fbeb400d680 tx=0x7fbeb4008040).stop 2023-11-30T18:41:48.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.860+0000 7fbecc7da700 1 -- 172.21.15.49:0/2078156635 shutdown_connections 2023-11-30T18:41:48.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.860+0000 7fbecc7da700 1 --2- 172.21.15.49:0/2078156635 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fbeb005f270 0x7fbeb0061730 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:48.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.860+0000 7fbecc7da700 1 --2- 172.21.15.49:0/2078156635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbec41544e0 0x7fbec4096240 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:48.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.860+0000 7fbecc7da700 1 --2- 172.21.15.49:0/2078156635 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbec406a610 0x7fbec413e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:48.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.860+0000 7fbecc7da700 1 --2- 172.21.15.49:0/2078156635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbec40c6e30 0x7fbec4097c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:48.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.860+0000 7fbecc7da700 1 -- 172.21.15.49:0/2078156635 >> 172.21.15.49:0/2078156635 conn(0x7fbec4085020 msgr2=0x7fbec40c9890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:48.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.860+0000 7fbecc7da700 1 -- 172.21.15.49:0/2078156635 shutdown_connections 2023-11-30T18:41:48.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.860+0000 7fbecc7da700 1 -- 172.21.15.49:0/2078156635 wait complete. 2023-11-30T18:41:48.862 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T18:41:48.872 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2023-11-30T18:41:46.896204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2460384,"kb_used_data":22048,"kb_used_omap":0,"kb_used_meta":2438272,"kb_avail":752514336,"statfs":{"total":773094113280,"available":770574680064,"internally_reserved":0,"allocated":22577152,"data_stored":11619448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2496790528},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13043,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-64,"num_write_kb":-36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.212215"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":191,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.428905+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T18:41:44.428905+0000","last_peered":"2023-11-30T18:41:44.428905+0000","last_clean":"2023-11-30T18:41:44.428905+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T18:41:44.428905+0000","last_undegraded":"2023-11-30T18:41:44.428905+0000","last_fullsized":"2023-11-30T18:41:44.428905+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":187,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.428979+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T18:41:44.428979+0000","last_peered":"2023-11-30T18:41:44.428979+0000","last_clean":"2023-11-30T18:41:44.428979+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T18:41:44.428979+0000","last_undegraded":"2023-11-30T18:41:44.428979+0000","last_fullsized":"2023-11-30T18:41:44.428979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":195,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.430709+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T18:41:44.430709+0000","last_peered":"2023-11-30T18:41:44.430709+0000","last_clean":"2023-11-30T18:41:44.430709+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T18:41:44.430709+0000","last_undegraded":"2023-11-30T18:41:44.430709+0000","last_fullsized":"2023-11-30T18:41:44.430709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":187,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.430859+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T18:41:44.430859+0000","last_peered":"2023-11-30T18:41:44.430859+0000","last_clean":"2023-11-30T18:41:44.430859+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T18:41:44.430859+0000","last_undegraded":"2023-11-30T18:41:44.430859+0000","last_fullsized":"2023-11-30T18:41:44.430859+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":183,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.428147+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T18:41:44.428147+0000","last_peered":"2023-11-30T18:41:44.428147+0000","last_clean":"2023-11-30T18:41:44.428147+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T18:41:44.428147+0000","last_undegraded":"2023-11-30T18:41:44.428147+0000","last_fullsized":"2023-11-30T18:41:44.428147+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":181,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.428241+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T18:41:44.428241+0000","last_peered":"2023-11-30T18:41:44.428241+0000","last_clean":"2023-11-30T18:41:44.428241+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T18:41:44.428241+0000","last_undegraded":"2023-11-30T18:41:44.428241+0000","last_fullsized":"2023-11-30T18:41:44.428241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.434931+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T18:41:44.434931+0000","last_peered":"2023-11-30T18:41:44.434931+0000","last_clean":"2023-11-30T18:41:44.434931+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T18:41:44.434931+0000","last_undegraded":"2023-11-30T18:41:44.434931+0000","last_fullsized":"2023-11-30T18:41:44.434931+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":191,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.428827+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T18:41:44.428827+0000","last_peered":"2023-11-30T18:41:44.428827+0000","last_clean":"2023-11-30T18:41:44.428827+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T18:41:44.428827+0000","last_undegraded":"2023-11-30T18:41:44.428827+0000","last_fullsized":"2023-11-30T18:41:44.428827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":212,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.117140+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T18:41:44.117140+0000","last_peered":"2023-11-30T18:41:44.117140+0000","last_clean":"2023-11-30T18:41:44.117140+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T18:41:44.117140+0000","last_undegraded":"2023-11-30T18:41:44.117140+0000","last_fullsized":"2023-11-30T18:41:44.117140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575973,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303948,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94067892,"statfs":{"total":96636764160,"available":96325521408,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.377,"5min":0.34200000000000003,"15min":0.28699999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.84799999999999998},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.621,"15min":0.63},"min":{"1min":0.46999999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82099999999999995,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.69399999999999995}]},{"osd":1,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.39500000000000002,"5min":0.36199999999999999,"15min":0.35899999999999999},"max":{"1min":0.74199999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56000000000000005,"15min":0.57399999999999995},"min":{"1min":0.38400000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73199999999999998,"5min":0.77800000000000002,"15min":0.877},"last":0.71699999999999997}]},{"osd":2,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.81100000000000005},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.44600000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79300000000000004,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.66100000000000003}]},{"osd":3,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55800000000000005,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.372,"15min":0.35899999999999999},"max":{"1min":0.78100000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59499999999999997,"15min":0.60699999999999998},"min":{"1min":0.42699999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77600000000000002,"5min":0.80400000000000005,"15min":0.89900000000000002},"last":0.75900000000000001}]},{"osd":4,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46600000000000003,"15min":0.46500000000000002},"min":{"1min":0.32100000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.66100000000000003,"5min":1.264,"15min":1.264},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.48699999999999999,"15min":0.48999999999999999},"min":{"1min":0.307,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.64400000000000002,"5min":1.149,"15min":1.149},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.498,"15min":0.497},"min":{"1min":0.32200000000000001,"5min":0.30599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71099999999999997,"5min":0.78200000000000003,"15min":0.83399999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.52900000000000003,"15min":0.53100000000000003},"min":{"1min":0.38400000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66800000000000004,"5min":1.286,"15min":1.286},"last":0.59099999999999997}]},{"osd":6,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.38100000000000001,"5min":0.33000000000000002,"15min":0.32300000000000001},"max":{"1min":0.72699999999999998,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54700000000000004,"15min":0.55400000000000005},"min":{"1min":0.34799999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.68799999999999994,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.51600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575972,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308044,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063796,"statfs":{"total":96636764160,"available":96321327104,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58999999999999997,"15min":0.60799999999999998},"min":{"1min":0.38500000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.79500000000000004,"5min":0.80500000000000005,"15min":1.6379999999999999},"last":0.628},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.61399999999999999,"15min":0.622},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.27800000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":1.246},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.58199999999999996,"15min":0.60599999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72399999999999998,"5min":0.78400000000000003,"15min":1.1200000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60799999999999998,"15min":0.628},"min":{"1min":0.40400000000000003,"5min":0.39100000000000001,"15min":0.35499999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.90400000000000003},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58599999999999997,"15min":0.59699999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.34499999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":1.288},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.60199999999999998,"15min":0.626},"min":{"1min":0.40000000000000002,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":1.177},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.54600000000000004,"15min":0.56999999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.33400000000000002},"max":{"1min":0.76700000000000002,"5min":0.79400000000000004,"15min":1.204},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55100000000000005,"15min":0.56599999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.68200000000000005,"5min":0.78300000000000003,"15min":1.337},"last":0.46999999999999997}]},{"osd":4,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.45200000000000001,"15min":0.47299999999999998},"min":{"1min":0.34200000000000003,"5min":0.32500000000000001,"15min":0.28699999999999998},"max":{"1min":0.68799999999999994,"5min":0.80800000000000005,"15min":1.51},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.503,"5min":0.47699999999999998,"15min":0.49299999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.30399999999999999},"max":{"1min":0.77400000000000002,"5min":0.79300000000000004,"15min":0.94299999999999995},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.46000000000000002,"15min":0.47299999999999998},"min":{"1min":0.33200000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72699999999999998,"5min":0.77600000000000002,"15min":1.159},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.51600000000000001,"15min":0.53100000000000003},"min":{"1min":0.30599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.747,"5min":0.84899999999999998,"15min":1.679},"last":0.71999999999999997}]},{"osd":7,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52900000000000003,"15min":0.54100000000000004},"min":{"1min":0.38,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73499999999999999,"5min":0.83899999999999997,"15min":0.96199999999999997},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77000000000000002,"5min":0.89100000000000001,"15min":1.427},"last":0.66000000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575972,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.35699999999999998,"15min":0.374},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59499999999999997,"5min":0.66300000000000003,"15min":0.79900000000000004},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.47799999999999998,"15min":0.503},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71699999999999997,"5min":0.78800000000000003,"15min":0.87},"last":0.439}]},{"osd":2,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39000000000000001,"15min":0.40799999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.60399999999999998,"5min":0.64700000000000002,"15min":0.89100000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.497,"15min":0.52400000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.63400000000000001,"5min":0.80300000000000005,"15min":0.98599999999999999},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46200000000000002,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68899999999999995,"5min":0.749,"15min":0.91900000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.437,"5min":0.439,"15min":0.45500000000000002},"min":{"1min":0.308,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66100000000000003,"5min":0.71399999999999997,"15min":0.84599999999999997},"last":0.32000000000000001}]},{"osd":4,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59299999999999997,"15min":0.61199999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":0.89000000000000001,"5min":0.89800000000000002,"15min":0.93999999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63900000000000001,"15min":0.66200000000000003},"min":{"1min":0.46200000000000002,"5min":0.45500000000000002,"15min":0.42299999999999999},"max":{"1min":0.94799999999999995,"5min":1.0329999999999999,"15min":1.0700000000000001},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60899999999999999,"15min":0.627},"min":{"1min":0.43099999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76300000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.63100000000000001,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.39200000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.98099999999999998},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.67800000000000005,"15min":0.69999999999999996},"min":{"1min":0.46000000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.99099999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.629},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.66300000000000003,"15min":0.68300000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.40799999999999997},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":1.004},"last":0.51900000000000002}]},{"osd":7,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68600000000000005,"15min":0.70499999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46100000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":1.012},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.66900000000000004,"15min":0.68899999999999995},"min":{"1min":0.46600000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.96399999999999997,"5min":0.97599999999999998,"15min":1.02},"last":0.60699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575972,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.39300000000000002,"15min":0.39600000000000002},"min":{"1min":0.26000000000000001,"5min":0.252,"15min":0.22900000000000001},"max":{"1min":0.45900000000000002,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42299999999999999,"15min":0.41899999999999998},"min":{"1min":0.28399999999999997,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.497,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.30099999999999999}]},{"osd":2,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.40699999999999997,"15min":0.41399999999999998},"min":{"1min":0.26000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.63500000000000001,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48599999999999999,"15min":0.495},"min":{"1min":0.36799999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.626,"5min":0.69799999999999995,"15min":0.74199999999999999},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.47299999999999998,"15min":0.46200000000000002},"min":{"1min":0.33500000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.54200000000000004,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.375},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.47299999999999998,"15min":0.47099999999999997},"min":{"1min":0.33100000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.57899999999999996,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.38600000000000001}]},{"osd":4,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61699999999999999,"15min":0.63300000000000001},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.40200000000000002},"max":{"1min":0.72299999999999998,"5min":0.85399999999999998,"15min":1.026},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65200000000000002,"15min":0.65500000000000003},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84299999999999997,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.48799999999999999,"5min":0.41799999999999998,"15min":0.40400000000000003},"max":{"1min":0.86399999999999999,"5min":0.97699999999999998,"15min":0.97799999999999998},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.64100000000000001,"15min":0.66100000000000003},"min":{"1min":0.48399999999999999,"5min":0.47199999999999998,"15min":0.439},"max":{"1min":0.751,"5min":0.91000000000000003,"15min":1.079},"last":0.56599999999999995}]},{"osd":6,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67500000000000004,"15min":0.68200000000000005},"min":{"1min":0.48399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.67500000000000004,"15min":0.67800000000000005},"min":{"1min":0.45200000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91500000000000004,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.501}]},{"osd":7,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.67800000000000005,"15min":0.69499999999999995},"min":{"1min":0.45800000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82999999999999996,"5min":0.94099999999999995,"15min":1.123},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71699999999999997,"15min":0.73199999999999998},"min":{"1min":0.56399999999999995,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92000000000000004,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.57799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575972,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40699999999999997,"15min":0.41499999999999998},"min":{"1min":0.28000000000000003,"5min":0.249,"15min":0.23200000000000001},"max":{"1min":0.54600000000000004,"5min":0.64800000000000002,"15min":0.72099999999999997},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45200000000000001,"15min":0.45800000000000002},"min":{"1min":0.29199999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.623,"5min":0.63400000000000001,"15min":0.73199999999999998},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.45100000000000001,"15min":0.46000000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.66800000000000004,"5min":0.70599999999999996,"15min":0.74299999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48899999999999999,"15min":0.49199999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.29899999999999999},"max":{"1min":0.68700000000000006,"5min":0.746,"15min":0.752},"last":0.37}]},{"osd":3,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.42199999999999999,"15min":0.42299999999999999},"min":{"1min":0.29399999999999998,"5min":0.28399999999999997,"15min":0.27500000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.49099999999999999,"15min":0.496},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.77100000000000002},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.496,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81299999999999994,"5min":0.91900000000000004,"15min":0.95299999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.61599999999999999,"15min":0.63600000000000001},"min":{"1min":0.46800000000000003,"5min":0.42199999999999999,"15min":0.35899999999999999},"max":{"1min":0.83399999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64700000000000002,"15min":0.66000000000000003},"min":{"1min":0.435,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89900000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65100000000000002,"15min":0.66500000000000004},"min":{"1min":0.52500000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80200000000000005,"5min":1.01,"15min":1.01},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63900000000000001,"15min":0.64800000000000002},"min":{"1min":0.50900000000000001,"5min":0.432,"15min":0.40500000000000003},"max":{"1min":0.81899999999999995,"5min":0.93000000000000005,"15min":0.93200000000000005},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.67900000000000005,"15min":0.69499999999999995},"min":{"1min":0.53400000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88500000000000001,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67900000000000005,"15min":0.68999999999999995},"min":{"1min":0.53700000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96499999999999997,"5min":0.97799999999999998,"15min":1.0109999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69699999999999995,"15min":0.71399999999999997},"min":{"1min":0.51100000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.91300000000000003,"5min":0.97899999999999998,"15min":0.98699999999999999},"last":0.69999999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575972,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299980,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94071860,"statfs":{"total":96636764160,"available":96329584640,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38200000000000001,"15min":0.38},"min":{"1min":0.26300000000000001,"5min":0.254,"15min":0.222},"max":{"1min":0.60899999999999999,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.316},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.42299999999999999,"15min":0.42599999999999999},"min":{"1min":0.29999999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.56000000000000005,"5min":0.64200000000000002,"15min":0.754},"last":0.32600000000000001}]},{"osd":1,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39400000000000002,"15min":0.40300000000000002},"min":{"1min":0.28799999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.59499999999999997,"5min":0.65800000000000003,"15min":0.73399999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.442,"15min":0.45200000000000001},"min":{"1min":0.32300000000000001,"5min":0.28699999999999998,"15min":0.25700000000000001},"max":{"1min":0.65900000000000003,"5min":0.66800000000000004,"15min":0.86699999999999999},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47399999999999998,"15min":0.47299999999999998},"min":{"1min":0.35599999999999998,"5min":0.29299999999999998,"15min":0.27800000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.79500000000000004},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51500000000000001,"15min":0.52100000000000002},"min":{"1min":0.41399999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.747,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.434,"5min":0.39100000000000001,"15min":0.35299999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63800000000000001,"15min":0.64700000000000002},"min":{"1min":0.42499999999999999,"5min":0.40300000000000002,"15min":0.40100000000000002},"max":{"1min":0.91800000000000004,"5min":0.97799999999999998,"15min":1.0049999999999999},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63500000000000001,"15min":0.64200000000000002},"min":{"1min":0.45500000000000002,"5min":0.41499999999999998,"15min":0.40699999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.624},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65300000000000002,"15min":0.66400000000000003},"min":{"1min":0.51300000000000001,"5min":0.41299999999999998,"15min":0.34499999999999997},"max":{"1min":1.038,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67300000000000004,"15min":0.67900000000000005},"min":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.377},"max":{"1min":1.004,"5min":1.0189999999999999,"15min":1.0309999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66500000000000004,"15min":0.68500000000000005},"min":{"1min":0.52200000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.54200000000000004}]},{"osd":7,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.68000000000000005,"15min":0.69899999999999995},"min":{"1min":0.48299999999999998,"5min":0.434,"15min":0.434},"max":{"1min":1.03,"5min":1.03,"15min":1.052},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.67900000000000005,"15min":0.69899999999999995},"min":{"1min":0.48599999999999999,"5min":0.441,"15min":0.441},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.59899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575972,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303948,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94067892,"statfs":{"total":96636764160,"available":96325521408,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52200000000000002,"15min":0.55500000000000005},"min":{"1min":0.315,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.85499999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54800000000000004,"15min":0.56499999999999995},"min":{"1min":0.376,"5min":0.34100000000000003,"15min":0.32500000000000001},"max":{"1min":0.77200000000000002,"5min":0.77500000000000002,"15min":0.94999999999999996},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54000000000000004,"15min":0.56399999999999995},"min":{"1min":0.314,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.876},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.54800000000000004,"15min":0.57699999999999996},"min":{"1min":0.34899999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69799999999999995,"5min":0.81399999999999995,"15min":0.91200000000000003},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.57599999999999996,"15min":0.59699999999999998},"min":{"1min":0.33400000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.79000000000000004,"5min":0.81200000000000006,"15min":0.93799999999999994},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.58599999999999997,"15min":0.621},"min":{"1min":0.371,"5min":0.35999999999999999,"15min":0.34899999999999998},"max":{"1min":0.77700000000000002,"5min":0.82299999999999995,"15min":0.94399999999999995},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.53700000000000003,"15min":0.56000000000000005},"min":{"1min":0.38,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70899999999999996,"5min":0.73999999999999999,"15min":0.84999999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.56100000000000005,"15min":0.59599999999999997},"min":{"1min":0.432,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.80300000000000005,"5min":0.80800000000000005,"15min":0.872},"last":0.56499999999999995}]},{"osd":5,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42499999999999999,"15min":0.44700000000000001},"min":{"1min":0.32300000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.626,"5min":0.66600000000000004,"15min":0.86399999999999999},"last":0.439},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.45000000000000001,"15min":0.46800000000000003},"min":{"1min":0.33700000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.82299999999999995},"last":0.42299999999999999}]},{"osd":6,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.47899999999999998,"15min":0.51100000000000001},"min":{"1min":0.36099999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":1.1399999999999999},"last":0.378},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52200000000000002,"15min":0.55800000000000005},"min":{"1min":0.39800000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":1.1220000000000001},"last":0.46899999999999997}]},{"osd":7,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.47999999999999998,"15min":0.52300000000000002},"min":{"1min":0.36099999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77100000000000002,"5min":0.77400000000000002,"15min":0.90000000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55200000000000005,"15min":0.58099999999999996},"min":{"1min":0.44,"5min":0.38600000000000001,"15min":0.35599999999999998},"max":{"1min":0.72899999999999998,"5min":0.73599999999999999,"15min":0.86199999999999999},"last":0.499}]}]},{"osd":5,"up_from":13,"seq":55834575972,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308044,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063796,"statfs":{"total":96636764160,"available":96321327104,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.40799999999999997,"5min":0.317,"15min":0.29799999999999999},"max":{"1min":0.78000000000000003,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.53800000000000003,"15min":0.55100000000000005},"min":{"1min":0.38800000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.90300000000000002},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53900000000000003},"min":{"1min":0.35099999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.83699999999999997},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56699999999999995,"15min":0.57399999999999995},"min":{"1min":0.44,"5min":0.307,"15min":0.307},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.82899999999999996},"last":0.374}]},{"osd":2,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59899999999999998,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.99199999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.432,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":1.173},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56499999999999995,"15min":0.56799999999999995},"min":{"1min":0.38200000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.747,"5min":0.77700000000000002,"15min":0.79300000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58199999999999996,"15min":0.59499999999999997},"min":{"1min":0.46800000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":1.603},"last":0.44}]},{"osd":4,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.317,"5min":0.311,"15min":0.311},"max":{"1min":0.64500000000000002,"5min":0.68000000000000005,"15min":0.75},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.35999999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.69799999999999995,"5min":0.77900000000000003,"15min":0.81200000000000006},"last":0.313}]},{"osd":6,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48499999999999999,"15min":0.498},"min":{"1min":0.34499999999999997,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68799999999999994,"5min":0.75900000000000001,"15min":1.105},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56499999999999995,"15min":0.57199999999999995},"min":{"1min":0.34100000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81000000000000005,"5min":0.85299999999999998,"15min":1.228},"last":0.39900000000000002}]},{"osd":7,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.33000000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69699999999999995,"5min":0.72199999999999998,"15min":0.88100000000000001},"last":0.433},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.39700000000000002,"5min":0.376,"15min":0.317},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":1.0640000000000001},"last":0.38600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T18:41:48.874 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-30T18:41:48.874 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T18:41:48.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.992+0000 7f74ee5be700 1 Processor -- start 2023-11-30T18:41:48.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.992+0000 7f74ee5be700 1 -- start start 2023-11-30T18:41:48.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.993+0000 7f74ee5be700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74e80caab0 0x7f74e80aa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:48.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.993+0000 7f74ee5be700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f74e80ca180 0x7f74e815e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:48.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.993+0000 7f74ee5be700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74e80a9a90 con 0x7f74e80cae90 2023-11-30T18:41:48.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.993+0000 7f74ee5be700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e8154ce0 con 0x7f74e80ca180 2023-11-30T18:41:48.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.993+0000 7f74ee5be700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e80a8e80 con 0x7f74e80caab0 2023-11-30T18:41:48.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.994+0000 7f74e7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74e80caab0 0x7f74e80aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:48.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.994+0000 7f74ecb5b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f74e80ca180 0x7f74e815e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:48.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.994+0000 7f74e7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74e80caab0 0x7f74e80aa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:49900/0 (socket says 172.21.15.49:49900) 2023-11-30T18:41:48.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.994+0000 7f74e7fff700 1 -- 172.21.15.49:0/2795638275 learned_addr learned my addr 172.21.15.49:0/2795638275 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:48.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.994+0000 7f74e77fe700 1 --1- 172.21.15.49:0/2795638275 >> v1:172.21.15.115:6789/0 conn(0x7f74e80cae90 0x7f74e80c0ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:49032/0 (socket says 172.21.15.49:49032) 2023-11-30T18:41:48.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.994+0000 7f74e7fff700 1 -- 172.21.15.49:0/2795638275 >> v2:172.21.15.115:3300/0 conn(0x7f74e80ca180 msgr2=0x7f74e815e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:48.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.994+0000 7f74e7fff700 1 --2- 172.21.15.49:0/2795638275 >> v2:172.21.15.115:3300/0 conn(0x7f74e80ca180 0x7f74e815e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:48.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.994+0000 7f74e7fff700 1 -- 172.21.15.49:0/2795638275 >> v1:172.21.15.115:6789/0 conn(0x7f74e80cae90 legacy=0x7f74e80c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.994+0000 7f74e7fff700 1 -- 172.21.15.49:0/2795638275 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e80a9160 con 0x7f74e80caab0 2023-11-30T18:41:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.994+0000 7f74e6ffd700 1 -- 172.21.15.49:0/2795638275 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2965725408 0 0) 0x7f74e80a9a90 con 0x7f74e80cae90 2023-11-30T18:41:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.994+0000 7f74ecb5b700 1 --2- 172.21.15.49:0/2795638275 >> v2:172.21.15.115:3300/0 conn(0x7f74e80ca180 0x7f74e815e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:41:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.994+0000 7f74e7fff700 1 --2- 172.21.15.49:0/2795638275 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74e80caab0 0x7f74e80aa470 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f74d8009810 tx=0x7f74d8009060).ready entity=mon.2 client_cookie=31c4536dd972a18 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.994+0000 7f74e6ffd700 1 -- 172.21.15.49:0/2795638275 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d8005880 con 0x7f74e80caab0 2023-11-30T18:41:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.994+0000 7f74e6ffd700 1 -- 172.21.15.49:0/2795638275 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d80059e0 con 0x7f74e80caab0 2023-11-30T18:41:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.994+0000 7f74e6ffd700 1 -- 172.21.15.49:0/2795638275 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d8005d60 con 0x7f74e80caab0 2023-11-30T18:41:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.995+0000 7f74ee5be700 1 -- 172.21.15.49:0/2795638275 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74e80caab0 msgr2=0x7f74e80aa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.995+0000 7f74ee5be700 1 --2- 172.21.15.49:0/2795638275 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74e80caab0 0x7f74e80aa470 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f74d8009810 tx=0x7f74d8009060).stop 2023-11-30T18:41:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.995+0000 7f74ee5be700 1 -- 172.21.15.49:0/2795638275 shutdown_connections 2023-11-30T18:41:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.995+0000 7f74ee5be700 1 --2- 172.21.15.49:0/2795638275 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74e80caab0 0x7f74e80aa470 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.995+0000 7f74ee5be700 1 --2- 172.21.15.49:0/2795638275 >> v2:172.21.15.115:3300/0 conn(0x7f74e80ca180 0x7f74e815e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.995+0000 7f74ee5be700 1 -- 172.21.15.49:0/2795638275 >> 172.21.15.49:0/2795638275 conn(0x7f74e8094920 msgr2=0x7f74e806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.995+0000 7f74ee5be700 1 -- 172.21.15.49:0/2795638275 shutdown_connections 2023-11-30T18:41:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.995+0000 7f74ee5be700 1 -- 172.21.15.49:0/2795638275 wait complete. 2023-11-30T18:41:49.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.996+0000 7f74ee5be700 1 Processor -- start 2023-11-30T18:41:49.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.996+0000 7f74ee5be700 1 -- start start 2023-11-30T18:41:49.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.997+0000 7f74ee5be700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74e80ca180 0x7f74e80ad920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:49.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.997+0000 7f74ee5be700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74e80caab0 0x7f74e8158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:49.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.997+0000 7f74ee5be700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74e80cae90 0x7f74e8153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:49.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.997+0000 7f74ee5be700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e80c2440 con 0x7f74e80cae90 2023-11-30T18:41:49.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.997+0000 7f74ee5be700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e8159510 con 0x7f74e80caab0 2023-11-30T18:41:49.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.997+0000 7f74ee5be700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e81597f0 con 0x7f74e80ca180 2023-11-30T18:41:49.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.997+0000 7f74ecb5b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74e80cae90 0x7f74e8153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:49.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.997+0000 7f74ecb5b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74e80cae90 0x7f74e8153f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59054/0 (socket says 172.21.15.49:59054) 2023-11-30T18:41:49.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.997+0000 7f74ecb5b700 1 -- 172.21.15.49:0/2551343881 learned_addr learned my addr 172.21.15.49:0/2551343881 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:49.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.997+0000 7f74e7fff700 1 --2- 172.21.15.49:0/2551343881 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74e80ca180 0x7f74e80ad920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:49.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.997+0000 7f74e77fe700 1 --2- 172.21.15.49:0/2551343881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74e80caab0 0x7f74e8158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:49.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.997+0000 7f74ecb5b700 1 -- 172.21.15.49:0/2551343881 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74e80ca180 msgr2=0x7f74e80ad920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:49.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.997+0000 7f74ecb5b700 1 --2- 172.21.15.49:0/2551343881 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74e80ca180 0x7f74e80ad920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:49.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.997+0000 7f74ecb5b700 1 -- 172.21.15.49:0/2551343881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74e80caab0 msgr2=0x7f74e8158cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:49.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.997+0000 7f74ecb5b700 1 --2- 172.21.15.49:0/2551343881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74e80caab0 0x7f74e8158cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:49.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.997+0000 7f74ecb5b700 1 -- 172.21.15.49:0/2551343881 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e0009a20 con 0x7f74e80cae90 2023-11-30T18:41:49.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.997+0000 7f74e7fff700 1 --2- 172.21.15.49:0/2551343881 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74e80ca180 0x7f74e80ad920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:41:49.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.997+0000 7f74ecb5b700 1 --2- 172.21.15.49:0/2551343881 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74e80cae90 0x7f74e8153f90 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 rx=0x7f74e0009fc0 tx=0x7f74e000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:49.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.998+0000 7f74dffff700 1 -- 172.21.15.49:0/2551343881 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e000cd30 con 0x7f74e80cae90 2023-11-30T18:41:49.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.998+0000 7f74dffff700 1 -- 172.21.15.49:0/2551343881 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e000f040 con 0x7f74e80cae90 2023-11-30T18:41:49.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.998+0000 7f74ee5be700 1 -- 172.21.15.49:0/2551343881 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d8009300 con 0x7f74e80cae90 2023-11-30T18:41:49.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.998+0000 7f74dffff700 1 -- 172.21.15.49:0/2551343881 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e0013610 con 0x7f74e80cae90 2023-11-30T18:41:49.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.998+0000 7f74ee5be700 1 -- 172.21.15.49:0/2551343881 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e8159db0 con 0x7f74e80cae90 2023-11-30T18:41:49.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.999+0000 7f74ee5be700 1 -- 172.21.15.49:0/2551343881 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e80c25f0 con 0x7f74e80cae90 2023-11-30T18:41:49.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.999+0000 7f74dffff700 1 -- 172.21.15.49:0/2551343881 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f74e0013a00 con 0x7f74e80cae90 2023-11-30T18:41:49.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:48.999+0000 7f74dffff700 1 --2- 172.21.15.49:0/2551343881 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f74c805f270 0x7f74c8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:49.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.000+0000 7f74dffff700 1 -- 172.21.15.49:0/2551343881 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(225..225 src has 1..225) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f74e007ad60 con 0x7f74e80cae90 2023-11-30T18:41:49.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.000+0000 7f74e7fff700 1 --2- 172.21.15.49:0/2551343881 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f74c805f270 0x7f74c8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:49.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.000+0000 7f74e7fff700 1 --2- 172.21.15.49:0/2551343881 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f74c805f270 0x7f74c8061730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f74d800b340 tx=0x7f74d8016000).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:49.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.004+0000 7f74dffff700 1 -- 172.21.15.49:0/2551343881 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f74e80c25f0 con 0x7f74e80cae90 2023-11-30T18:41:49.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.173+0000 7f74ee5be700 1 -- 172.21.15.49:0/2551343881 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f74e806c860 con 0x7f74c805f270 2023-11-30T18:41:49.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.176+0000 7f74dffff700 1 -- 172.21.15.49:0/2551343881 <== mgr.9772 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71233 (secure 0 0 0) 0x7f74e806c860 con 0x7f74c805f270 2023-11-30T18:41:49.177 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:49.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.178+0000 7f74ee5be700 1 -- 172.21.15.49:0/2551343881 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f74c805f270 msgr2=0x7f74c8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:49.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.178+0000 7f74ee5be700 1 --2- 172.21.15.49:0/2551343881 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f74c805f270 0x7f74c8061730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f74d800b340 tx=0x7f74d8016000).stop 2023-11-30T18:41:49.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.178+0000 7f74ee5be700 1 -- 172.21.15.49:0/2551343881 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74e80cae90 msgr2=0x7f74e8153f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:49.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.178+0000 7f74ee5be700 1 --2- 172.21.15.49:0/2551343881 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74e80cae90 0x7f74e8153f90 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 rx=0x7f74e0009fc0 tx=0x7f74e000b040).stop 2023-11-30T18:41:49.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.178+0000 7f74ee5be700 1 -- 172.21.15.49:0/2551343881 shutdown_connections 2023-11-30T18:41:49.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.178+0000 7f74ee5be700 1 --2- 172.21.15.49:0/2551343881 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f74c805f270 0x7f74c8061730 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:49.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.178+0000 7f74ee5be700 1 --2- 172.21.15.49:0/2551343881 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74e80cae90 0x7f74e8153f90 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:49.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.178+0000 7f74ee5be700 1 --2- 172.21.15.49:0/2551343881 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74e80ca180 0x7f74e80ad920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:49.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.178+0000 7f74ee5be700 1 --2- 172.21.15.49:0/2551343881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74e80caab0 0x7f74e8158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:49.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.178+0000 7f74ee5be700 1 -- 172.21.15.49:0/2551343881 >> 172.21.15.49:0/2551343881 conn(0x7f74e8094920 msgr2=0x7f74e80c6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:49.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.178+0000 7f74ee5be700 1 -- 172.21.15.49:0/2551343881 shutdown_connections 2023-11-30T18:41:49.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.178+0000 7f74ee5be700 1 -- 172.21.15.49:0/2551343881 wait complete. 2023-11-30T18:41:49.181 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T18:41:49.191 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2023-11-30T18:41:48.896687+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2460384,"kb_used_data":22048,"kb_used_omap":0,"kb_used_meta":2438272,"kb_avail":752514336,"statfs":{"total":773094113280,"available":770574680064,"internally_reserved":0,"allocated":22577152,"data_stored":11619448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2496790528},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13043,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-64,"num_write_kb":-36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.212215"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":191,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.428905+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T18:41:44.428905+0000","last_peered":"2023-11-30T18:41:44.428905+0000","last_clean":"2023-11-30T18:41:44.428905+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T18:41:44.428905+0000","last_undegraded":"2023-11-30T18:41:44.428905+0000","last_fullsized":"2023-11-30T18:41:44.428905+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":187,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.428979+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T18:41:44.428979+0000","last_peered":"2023-11-30T18:41:44.428979+0000","last_clean":"2023-11-30T18:41:44.428979+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T18:41:44.428979+0000","last_undegraded":"2023-11-30T18:41:44.428979+0000","last_fullsized":"2023-11-30T18:41:44.428979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":195,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.430709+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T18:41:44.430709+0000","last_peered":"2023-11-30T18:41:44.430709+0000","last_clean":"2023-11-30T18:41:44.430709+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T18:41:44.430709+0000","last_undegraded":"2023-11-30T18:41:44.430709+0000","last_fullsized":"2023-11-30T18:41:44.430709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":187,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.430859+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T18:41:44.430859+0000","last_peered":"2023-11-30T18:41:44.430859+0000","last_clean":"2023-11-30T18:41:44.430859+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T18:41:44.430859+0000","last_undegraded":"2023-11-30T18:41:44.430859+0000","last_fullsized":"2023-11-30T18:41:44.430859+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":183,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.428147+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T18:41:44.428147+0000","last_peered":"2023-11-30T18:41:44.428147+0000","last_clean":"2023-11-30T18:41:44.428147+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T18:41:44.428147+0000","last_undegraded":"2023-11-30T18:41:44.428147+0000","last_fullsized":"2023-11-30T18:41:44.428147+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":181,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.428241+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T18:41:44.428241+0000","last_peered":"2023-11-30T18:41:44.428241+0000","last_clean":"2023-11-30T18:41:44.428241+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T18:41:44.428241+0000","last_undegraded":"2023-11-30T18:41:44.428241+0000","last_fullsized":"2023-11-30T18:41:44.428241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.434931+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T18:41:44.434931+0000","last_peered":"2023-11-30T18:41:44.434931+0000","last_clean":"2023-11-30T18:41:44.434931+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T18:41:44.434931+0000","last_undegraded":"2023-11-30T18:41:44.434931+0000","last_fullsized":"2023-11-30T18:41:44.434931+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":191,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.428827+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T18:41:44.428827+0000","last_peered":"2023-11-30T18:41:44.428827+0000","last_clean":"2023-11-30T18:41:44.428827+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T18:41:44.428827+0000","last_undegraded":"2023-11-30T18:41:44.428827+0000","last_fullsized":"2023-11-30T18:41:44.428827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":212,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.117140+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T18:41:44.117140+0000","last_peered":"2023-11-30T18:41:44.117140+0000","last_clean":"2023-11-30T18:41:44.117140+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T18:41:44.117140+0000","last_undegraded":"2023-11-30T18:41:44.117140+0000","last_fullsized":"2023-11-30T18:41:44.117140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575973,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303948,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94067892,"statfs":{"total":96636764160,"available":96325521408,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.377,"5min":0.34200000000000003,"15min":0.28699999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.84799999999999998},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.621,"15min":0.63},"min":{"1min":0.46999999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82099999999999995,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.69399999999999995}]},{"osd":1,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.39500000000000002,"5min":0.36199999999999999,"15min":0.35899999999999999},"max":{"1min":0.74199999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56000000000000005,"15min":0.57399999999999995},"min":{"1min":0.38400000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73199999999999998,"5min":0.77800000000000002,"15min":0.877},"last":0.71699999999999997}]},{"osd":2,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.81100000000000005},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.44600000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79300000000000004,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.66100000000000003}]},{"osd":3,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55800000000000005,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.372,"15min":0.35899999999999999},"max":{"1min":0.78100000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59499999999999997,"15min":0.60699999999999998},"min":{"1min":0.42699999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77600000000000002,"5min":0.80400000000000005,"15min":0.89900000000000002},"last":0.75900000000000001}]},{"osd":4,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46600000000000003,"15min":0.46500000000000002},"min":{"1min":0.32100000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.66100000000000003,"5min":1.264,"15min":1.264},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.48699999999999999,"15min":0.48999999999999999},"min":{"1min":0.307,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.64400000000000002,"5min":1.149,"15min":1.149},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.498,"15min":0.497},"min":{"1min":0.32200000000000001,"5min":0.30599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71099999999999997,"5min":0.78200000000000003,"15min":0.83399999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.52900000000000003,"15min":0.53100000000000003},"min":{"1min":0.38400000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66800000000000004,"5min":1.286,"15min":1.286},"last":0.59099999999999997}]},{"osd":6,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.38100000000000001,"5min":0.33000000000000002,"15min":0.32300000000000001},"max":{"1min":0.72699999999999998,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54700000000000004,"15min":0.55400000000000005},"min":{"1min":0.34799999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.68799999999999994,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.51600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575972,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308044,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063796,"statfs":{"total":96636764160,"available":96321327104,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58999999999999997,"15min":0.60799999999999998},"min":{"1min":0.38500000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.79500000000000004,"5min":0.80500000000000005,"15min":1.6379999999999999},"last":0.628},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.61399999999999999,"15min":0.622},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.27800000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":1.246},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.58199999999999996,"15min":0.60599999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72399999999999998,"5min":0.78400000000000003,"15min":1.1200000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60799999999999998,"15min":0.628},"min":{"1min":0.40400000000000003,"5min":0.39100000000000001,"15min":0.35499999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.90400000000000003},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58599999999999997,"15min":0.59699999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.34499999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":1.288},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.60199999999999998,"15min":0.626},"min":{"1min":0.40000000000000002,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":1.177},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.54600000000000004,"15min":0.56999999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.33400000000000002},"max":{"1min":0.76700000000000002,"5min":0.79400000000000004,"15min":1.204},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55100000000000005,"15min":0.56599999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.68200000000000005,"5min":0.78300000000000003,"15min":1.337},"last":0.46999999999999997}]},{"osd":4,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.45200000000000001,"15min":0.47299999999999998},"min":{"1min":0.34200000000000003,"5min":0.32500000000000001,"15min":0.28699999999999998},"max":{"1min":0.68799999999999994,"5min":0.80800000000000005,"15min":1.51},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.503,"5min":0.47699999999999998,"15min":0.49299999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.30399999999999999},"max":{"1min":0.77400000000000002,"5min":0.79300000000000004,"15min":0.94299999999999995},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.46000000000000002,"15min":0.47299999999999998},"min":{"1min":0.33200000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72699999999999998,"5min":0.77600000000000002,"15min":1.159},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.51600000000000001,"15min":0.53100000000000003},"min":{"1min":0.30599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.747,"5min":0.84899999999999998,"15min":1.679},"last":0.71999999999999997}]},{"osd":7,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52900000000000003,"15min":0.54100000000000004},"min":{"1min":0.38,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73499999999999999,"5min":0.83899999999999997,"15min":0.96199999999999997},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77000000000000002,"5min":0.89100000000000001,"15min":1.427},"last":0.66000000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575972,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.35699999999999998,"15min":0.374},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59499999999999997,"5min":0.66300000000000003,"15min":0.79900000000000004},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.47799999999999998,"15min":0.503},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71699999999999997,"5min":0.78800000000000003,"15min":0.87},"last":0.439}]},{"osd":2,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39000000000000001,"15min":0.40799999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.60399999999999998,"5min":0.64700000000000002,"15min":0.89100000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.497,"15min":0.52400000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.63400000000000001,"5min":0.80300000000000005,"15min":0.98599999999999999},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46200000000000002,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68899999999999995,"5min":0.749,"15min":0.91900000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.437,"5min":0.439,"15min":0.45500000000000002},"min":{"1min":0.308,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66100000000000003,"5min":0.71399999999999997,"15min":0.84599999999999997},"last":0.32000000000000001}]},{"osd":4,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59299999999999997,"15min":0.61199999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":0.89000000000000001,"5min":0.89800000000000002,"15min":0.93999999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63900000000000001,"15min":0.66200000000000003},"min":{"1min":0.46200000000000002,"5min":0.45500000000000002,"15min":0.42299999999999999},"max":{"1min":0.94799999999999995,"5min":1.0329999999999999,"15min":1.0700000000000001},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60899999999999999,"15min":0.627},"min":{"1min":0.43099999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76300000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.63100000000000001,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.39200000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.98099999999999998},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.67800000000000005,"15min":0.69999999999999996},"min":{"1min":0.46000000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.99099999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.629},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.66300000000000003,"15min":0.68300000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.40799999999999997},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":1.004},"last":0.51900000000000002}]},{"osd":7,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68600000000000005,"15min":0.70499999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46100000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":1.012},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.66900000000000004,"15min":0.68899999999999995},"min":{"1min":0.46600000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.96399999999999997,"5min":0.97599999999999998,"15min":1.02},"last":0.60699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575972,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.39300000000000002,"15min":0.39600000000000002},"min":{"1min":0.26000000000000001,"5min":0.252,"15min":0.22900000000000001},"max":{"1min":0.45900000000000002,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42299999999999999,"15min":0.41899999999999998},"min":{"1min":0.28399999999999997,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.497,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.30099999999999999}]},{"osd":2,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.40699999999999997,"15min":0.41399999999999998},"min":{"1min":0.26000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.63500000000000001,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48599999999999999,"15min":0.495},"min":{"1min":0.36799999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.626,"5min":0.69799999999999995,"15min":0.74199999999999999},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.47299999999999998,"15min":0.46200000000000002},"min":{"1min":0.33500000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.54200000000000004,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.375},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.47299999999999998,"15min":0.47099999999999997},"min":{"1min":0.33100000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.57899999999999996,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.38600000000000001}]},{"osd":4,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61699999999999999,"15min":0.63300000000000001},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.40200000000000002},"max":{"1min":0.72299999999999998,"5min":0.85399999999999998,"15min":1.026},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65200000000000002,"15min":0.65500000000000003},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84299999999999997,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.48799999999999999,"5min":0.41799999999999998,"15min":0.40400000000000003},"max":{"1min":0.86399999999999999,"5min":0.97699999999999998,"15min":0.97799999999999998},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.64100000000000001,"15min":0.66100000000000003},"min":{"1min":0.48399999999999999,"5min":0.47199999999999998,"15min":0.439},"max":{"1min":0.751,"5min":0.91000000000000003,"15min":1.079},"last":0.56599999999999995}]},{"osd":6,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67500000000000004,"15min":0.68200000000000005},"min":{"1min":0.48399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.67500000000000004,"15min":0.67800000000000005},"min":{"1min":0.45200000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91500000000000004,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.501}]},{"osd":7,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.67800000000000005,"15min":0.69499999999999995},"min":{"1min":0.45800000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82999999999999996,"5min":0.94099999999999995,"15min":1.123},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71699999999999997,"15min":0.73199999999999998},"min":{"1min":0.56399999999999995,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92000000000000004,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.57799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575972,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40699999999999997,"15min":0.41499999999999998},"min":{"1min":0.28000000000000003,"5min":0.249,"15min":0.23200000000000001},"max":{"1min":0.54600000000000004,"5min":0.64800000000000002,"15min":0.72099999999999997},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45200000000000001,"15min":0.45800000000000002},"min":{"1min":0.29199999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.623,"5min":0.63400000000000001,"15min":0.73199999999999998},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.45100000000000001,"15min":0.46000000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.66800000000000004,"5min":0.70599999999999996,"15min":0.74299999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48899999999999999,"15min":0.49199999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.29899999999999999},"max":{"1min":0.68700000000000006,"5min":0.746,"15min":0.752},"last":0.37}]},{"osd":3,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.42199999999999999,"15min":0.42299999999999999},"min":{"1min":0.29399999999999998,"5min":0.28399999999999997,"15min":0.27500000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.49099999999999999,"15min":0.496},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.77100000000000002},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.496,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81299999999999994,"5min":0.91900000000000004,"15min":0.95299999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.61599999999999999,"15min":0.63600000000000001},"min":{"1min":0.46800000000000003,"5min":0.42199999999999999,"15min":0.35899999999999999},"max":{"1min":0.83399999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64700000000000002,"15min":0.66000000000000003},"min":{"1min":0.435,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89900000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65100000000000002,"15min":0.66500000000000004},"min":{"1min":0.52500000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80200000000000005,"5min":1.01,"15min":1.01},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63900000000000001,"15min":0.64800000000000002},"min":{"1min":0.50900000000000001,"5min":0.432,"15min":0.40500000000000003},"max":{"1min":0.81899999999999995,"5min":0.93000000000000005,"15min":0.93200000000000005},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.67900000000000005,"15min":0.69499999999999995},"min":{"1min":0.53400000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88500000000000001,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67900000000000005,"15min":0.68999999999999995},"min":{"1min":0.53700000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96499999999999997,"5min":0.97799999999999998,"15min":1.0109999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69699999999999995,"15min":0.71399999999999997},"min":{"1min":0.51100000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.91300000000000003,"5min":0.97899999999999998,"15min":0.98699999999999999},"last":0.69999999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575972,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299980,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94071860,"statfs":{"total":96636764160,"available":96329584640,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38200000000000001,"15min":0.38},"min":{"1min":0.26300000000000001,"5min":0.254,"15min":0.222},"max":{"1min":0.60899999999999999,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.316},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.42299999999999999,"15min":0.42599999999999999},"min":{"1min":0.29999999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.56000000000000005,"5min":0.64200000000000002,"15min":0.754},"last":0.32600000000000001}]},{"osd":1,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39400000000000002,"15min":0.40300000000000002},"min":{"1min":0.28799999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.59499999999999997,"5min":0.65800000000000003,"15min":0.73399999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.442,"15min":0.45200000000000001},"min":{"1min":0.32300000000000001,"5min":0.28699999999999998,"15min":0.25700000000000001},"max":{"1min":0.65900000000000003,"5min":0.66800000000000004,"15min":0.86699999999999999},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47399999999999998,"15min":0.47299999999999998},"min":{"1min":0.35599999999999998,"5min":0.29299999999999998,"15min":0.27800000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.79500000000000004},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51500000000000001,"15min":0.52100000000000002},"min":{"1min":0.41399999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.747,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.434,"5min":0.39100000000000001,"15min":0.35299999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63800000000000001,"15min":0.64700000000000002},"min":{"1min":0.42499999999999999,"5min":0.40300000000000002,"15min":0.40100000000000002},"max":{"1min":0.91800000000000004,"5min":0.97799999999999998,"15min":1.0049999999999999},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63500000000000001,"15min":0.64200000000000002},"min":{"1min":0.45500000000000002,"5min":0.41499999999999998,"15min":0.40699999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.624},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65300000000000002,"15min":0.66400000000000003},"min":{"1min":0.51300000000000001,"5min":0.41299999999999998,"15min":0.34499999999999997},"max":{"1min":1.038,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67300000000000004,"15min":0.67900000000000005},"min":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.377},"max":{"1min":1.004,"5min":1.0189999999999999,"15min":1.0309999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66500000000000004,"15min":0.68500000000000005},"min":{"1min":0.52200000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.54200000000000004}]},{"osd":7,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.68000000000000005,"15min":0.69899999999999995},"min":{"1min":0.48299999999999998,"5min":0.434,"15min":0.434},"max":{"1min":1.03,"5min":1.03,"15min":1.052},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.67900000000000005,"15min":0.69899999999999995},"min":{"1min":0.48599999999999999,"5min":0.441,"15min":0.441},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.59899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575972,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303948,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94067892,"statfs":{"total":96636764160,"available":96325521408,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52200000000000002,"15min":0.55500000000000005},"min":{"1min":0.315,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.85499999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54800000000000004,"15min":0.56499999999999995},"min":{"1min":0.376,"5min":0.34100000000000003,"15min":0.32500000000000001},"max":{"1min":0.77200000000000002,"5min":0.77500000000000002,"15min":0.94999999999999996},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54000000000000004,"15min":0.56399999999999995},"min":{"1min":0.314,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.876},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.54800000000000004,"15min":0.57699999999999996},"min":{"1min":0.34899999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69799999999999995,"5min":0.81399999999999995,"15min":0.91200000000000003},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.57599999999999996,"15min":0.59699999999999998},"min":{"1min":0.33400000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.79000000000000004,"5min":0.81200000000000006,"15min":0.93799999999999994},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.58599999999999997,"15min":0.621},"min":{"1min":0.371,"5min":0.35999999999999999,"15min":0.34899999999999998},"max":{"1min":0.77700000000000002,"5min":0.82299999999999995,"15min":0.94399999999999995},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.53700000000000003,"15min":0.56000000000000005},"min":{"1min":0.38,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70899999999999996,"5min":0.73999999999999999,"15min":0.84999999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.56100000000000005,"15min":0.59599999999999997},"min":{"1min":0.432,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.80300000000000005,"5min":0.80800000000000005,"15min":0.872},"last":0.56499999999999995}]},{"osd":5,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42499999999999999,"15min":0.44700000000000001},"min":{"1min":0.32300000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.626,"5min":0.66600000000000004,"15min":0.86399999999999999},"last":0.439},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.45000000000000001,"15min":0.46800000000000003},"min":{"1min":0.33700000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.82299999999999995},"last":0.42299999999999999}]},{"osd":6,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.47899999999999998,"15min":0.51100000000000001},"min":{"1min":0.36099999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":1.1399999999999999},"last":0.378},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52200000000000002,"15min":0.55800000000000005},"min":{"1min":0.39800000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":1.1220000000000001},"last":0.46899999999999997}]},{"osd":7,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.47999999999999998,"15min":0.52300000000000002},"min":{"1min":0.36099999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77100000000000002,"5min":0.77400000000000002,"15min":0.90000000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55200000000000005,"15min":0.58099999999999996},"min":{"1min":0.44,"5min":0.38600000000000001,"15min":0.35599999999999998},"max":{"1min":0.72899999999999998,"5min":0.73599999999999999,"15min":0.86199999999999999},"last":0.499}]}]},{"osd":5,"up_from":13,"seq":55834575972,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308044,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063796,"statfs":{"total":96636764160,"available":96321327104,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.40799999999999997,"5min":0.317,"15min":0.29799999999999999},"max":{"1min":0.78000000000000003,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.53800000000000003,"15min":0.55100000000000005},"min":{"1min":0.38800000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.90300000000000002},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53900000000000003},"min":{"1min":0.35099999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.83699999999999997},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56699999999999995,"15min":0.57399999999999995},"min":{"1min":0.44,"5min":0.307,"15min":0.307},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.82899999999999996},"last":0.374}]},{"osd":2,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59899999999999998,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.99199999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.432,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":1.173},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56499999999999995,"15min":0.56799999999999995},"min":{"1min":0.38200000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.747,"5min":0.77700000000000002,"15min":0.79300000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58199999999999996,"15min":0.59499999999999997},"min":{"1min":0.46800000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":1.603},"last":0.44}]},{"osd":4,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.317,"5min":0.311,"15min":0.311},"max":{"1min":0.64500000000000002,"5min":0.68000000000000005,"15min":0.75},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.35999999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.69799999999999995,"5min":0.77900000000000003,"15min":0.81200000000000006},"last":0.313}]},{"osd":6,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48499999999999999,"15min":0.498},"min":{"1min":0.34499999999999997,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68799999999999994,"5min":0.75900000000000001,"15min":1.105},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56499999999999995,"15min":0.57199999999999995},"min":{"1min":0.34100000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81000000000000005,"5min":0.85299999999999998,"15min":1.228},"last":0.39900000000000002}]},{"osd":7,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.33000000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69699999999999995,"5min":0.72199999999999998,"15min":0.88100000000000001},"last":0.433},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.39700000000000002,"5min":0.376,"15min":0.317},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":1.0640000000000001},"last":0.38600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T18:41:49.194 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T18:41:49.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.311+0000 7fd1ad8a2700 1 Processor -- start 2023-11-30T18:41:49.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.311+0000 7fd1ad8a2700 1 -- start start 2023-11-30T18:41:49.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.312+0000 7fd1ad8a2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1a81548c0 0x7fd1a806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:49.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.312+0000 7fd1ad8a2700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a80c69a0 con 0x7fd1a80c6e30 2023-11-30T18:41:49.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.312+0000 7fd1ad8a2700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a80c13a0 con 0x7fd1a81544e0 2023-11-30T18:41:49.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.312+0000 7fd1ad8a2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a80c1680 con 0x7fd1a81548c0 2023-11-30T18:41:49.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.312+0000 7fd1a77fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd1a80c6e30 0x7fd1a80a8000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50604/0 (socket says 172.21.15.49:50604) 2023-11-30T18:41:49.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.312+0000 7fd1a77fe700 1 -- 172.21.15.49:0/558738606 learned_addr learned my addr 172.21.15.49:0/558738606 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:49.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.313+0000 7fd1a67fc700 1 --2- 172.21.15.49:0/558738606 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1a81548c0 0x7fd1a806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:49.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.313+0000 7fd1a5ffb700 1 -- 172.21.15.49:0/558738606 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3754848062 0 0) 0x7fd1a80c69a0 con 0x7fd1a80c6e30 2023-11-30T18:41:49.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.313+0000 7fd1a5ffb700 1 -- 172.21.15.49:0/558738606 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1940033f0 con 0x7fd1a80c6e30 2023-11-30T18:41:49.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.313+0000 7fd1a5ffb700 1 -- 172.21.15.49:0/558738606 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2263159146 0 0) 0x7fd1a80c13a0 con 0x7fd1a81544e0 2023-11-30T18:41:49.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.313+0000 7fd1a5ffb700 1 -- 172.21.15.49:0/558738606 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1a80c69a0 con 0x7fd1a81544e0 2023-11-30T18:41:49.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.313+0000 7fd1a67fc700 1 -- 172.21.15.49:0/558738606 >> v1:172.21.15.115:6789/0 conn(0x7fd1a81544e0 legacy=0x7fd1a80c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:49.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.313+0000 7fd1a67fc700 1 -- 172.21.15.49:0/558738606 >> v1:172.21.15.49:6789/0 conn(0x7fd1a80c6e30 legacy=0x7fd1a80a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:49.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.313+0000 7fd1a67fc700 1 -- 172.21.15.49:0/558738606 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a80c6630 con 0x7fd1a81548c0 2023-11-30T18:41:49.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.313+0000 7fd1a67fc700 1 --2- 172.21.15.49:0/558738606 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1a81548c0 0x7fd1a806a610 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7fd190009790 tx=0x7fd190009060).ready entity=mon.2 client_cookie=db9eaab2ad3a6282 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:49.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.313+0000 7fd1a5ffb700 1 -- 172.21.15.49:0/558738606 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19000f510 con 0x7fd1a81548c0 2023-11-30T18:41:49.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.313+0000 7fd1a5ffb700 1 -- 172.21.15.49:0/558738606 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19000f670 con 0x7fd1a81548c0 2023-11-30T18:41:49.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.313+0000 7fd1a5ffb700 1 -- 172.21.15.49:0/558738606 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19000f9f0 con 0x7fd1a81548c0 2023-11-30T18:41:49.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.314+0000 7fd1ad8a2700 1 -- 172.21.15.49:0/558738606 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1a81548c0 msgr2=0x7fd1a806a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:49.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.314+0000 7fd1ad8a2700 1 --2- 172.21.15.49:0/558738606 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1a81548c0 0x7fd1a806a610 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7fd190009790 tx=0x7fd190009060).stop 2023-11-30T18:41:49.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.314+0000 7fd1ad8a2700 1 -- 172.21.15.49:0/558738606 shutdown_connections 2023-11-30T18:41:49.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.314+0000 7fd1ad8a2700 1 --2- 172.21.15.49:0/558738606 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1a81548c0 0x7fd1a806a610 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:49.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.314+0000 7fd1ad8a2700 1 -- 172.21.15.49:0/558738606 >> 172.21.15.49:0/558738606 conn(0x7fd1a8085020 msgr2=0x7fd1a8094940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:49.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.314+0000 7fd1ad8a2700 1 -- 172.21.15.49:0/558738606 shutdown_connections 2023-11-30T18:41:49.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.314+0000 7fd1ad8a2700 1 -- 172.21.15.49:0/558738606 wait complete. 2023-11-30T18:41:49.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.315+0000 7fd1ad8a2700 1 Processor -- start 2023-11-30T18:41:49.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.315+0000 7fd1ad8a2700 1 -- start start 2023-11-30T18:41:49.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.316+0000 7fd1ad8a2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1a80c6e30 0x7fd1a8165580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:49.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.316+0000 7fd1ad8a2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1a81544e0 0x7fd1a8148f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:49.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.316+0000 7fd1ad8a2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1a81548c0 0x7fd1a8152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:49.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.316+0000 7fd1ad8a2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a8165a70 con 0x7fd1a81548c0 2023-11-30T18:41:49.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.316+0000 7fd1ad8a2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a8097790 con 0x7fd1a80c6e30 2023-11-30T18:41:49.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.316+0000 7fd1ad8a2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a8095d20 con 0x7fd1a81544e0 2023-11-30T18:41:49.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.316+0000 7fd1a77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1a81548c0 0x7fd1a8152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:49.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.316+0000 7fd1a77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1a81548c0 0x7fd1a8152a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59064/0 (socket says 172.21.15.49:59064) 2023-11-30T18:41:49.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.316+0000 7fd1a77fe700 1 -- 172.21.15.49:0/2352364662 learned_addr learned my addr 172.21.15.49:0/2352364662 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:49.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.316+0000 7fd1a6ffd700 1 --2- 172.21.15.49:0/2352364662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1a80c6e30 0x7fd1a8165580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:49.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.316+0000 7fd1a67fc700 1 --2- 172.21.15.49:0/2352364662 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1a81544e0 0x7fd1a8148f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:49.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.316+0000 7fd1a77fe700 1 -- 172.21.15.49:0/2352364662 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1a81544e0 msgr2=0x7fd1a8148f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:49.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.316+0000 7fd1a77fe700 1 --2- 172.21.15.49:0/2352364662 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1a81544e0 0x7fd1a8148f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:49.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.316+0000 7fd1a77fe700 1 -- 172.21.15.49:0/2352364662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1a80c6e30 msgr2=0x7fd1a8165580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:49.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.316+0000 7fd1a77fe700 1 --2- 172.21.15.49:0/2352364662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1a80c6e30 0x7fd1a8165580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:49.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.316+0000 7fd1a77fe700 1 -- 172.21.15.49:0/2352364662 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1900092a0 con 0x7fd1a81548c0 2023-11-30T18:41:49.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.317+0000 7fd1a77fe700 1 --2- 172.21.15.49:0/2352364662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1a81548c0 0x7fd1a8152a40 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 rx=0x7fd198001560 tx=0x7fd1980015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:49.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.317+0000 7fd19effd700 1 -- 172.21.15.49:0/2352364662 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd198005d30 con 0x7fd1a81548c0 2023-11-30T18:41:49.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.317+0000 7fd19effd700 1 -- 172.21.15.49:0/2352364662 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd198005e90 con 0x7fd1a81548c0 2023-11-30T18:41:49.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.317+0000 7fd1ad8a2700 1 -- 172.21.15.49:0/2352364662 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a80c27c0 con 0x7fd1a81548c0 2023-11-30T18:41:49.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.317+0000 7fd19effd700 1 -- 172.21.15.49:0/2352364662 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1980072e0 con 0x7fd1a81548c0 2023-11-30T18:41:49.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.317+0000 7fd1ad8a2700 1 -- 172.21.15.49:0/2352364662 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a80c2d80 con 0x7fd1a81548c0 2023-11-30T18:41:49.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.318+0000 7fd1ad8a2700 1 -- 172.21.15.49:0/2352364662 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a806c860 con 0x7fd1a81548c0 2023-11-30T18:41:49.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.318+0000 7fd19effd700 1 -- 172.21.15.49:0/2352364662 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fd198007650 con 0x7fd1a81548c0 2023-11-30T18:41:49.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.319+0000 7fd19effd700 1 --2- 172.21.15.49:0/2352364662 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fd18805f240 0x7fd188061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:49.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.319+0000 7fd19effd700 1 -- 172.21.15.49:0/2352364662 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(225..225 src has 1..225) v4 ==== 5940+0+0 (secure 0 0 0) 0x7fd198079d40 con 0x7fd1a81548c0 2023-11-30T18:41:49.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.319+0000 7fd1a6ffd700 1 --2- 172.21.15.49:0/2352364662 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fd18805f240 0x7fd188061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:49.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.319+0000 7fd1a6ffd700 1 --2- 172.21.15.49:0/2352364662 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fd18805f240 0x7fd188061700 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fd1a00038c0 tx=0x7fd1a0007bc0).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:49.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.323+0000 7fd19effd700 1 -- 172.21.15.49:0/2352364662 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd19807d030 con 0x7fd1a81548c0 2023-11-30T18:41:49.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.497+0000 7fd1ad8a2700 1 -- 172.21.15.49:0/2352364662 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1a80990e0 con 0x7fd1a81548c0 2023-11-30T18:41:49.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.498+0000 7fd19effd700 1 -- 172.21.15.49:0/2352364662 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v225) v1 ==== 74+0+14716 (secure 0 0 0) 0x7fd198018070 con 0x7fd1a81548c0 2023-11-30T18:41:49.499 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:49.499 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":225,"fsid":"ef213ed4-8f62-4ad5-b55f-7510fd0ee359","created":"2023-11-30T17:06:57.994010+0000","modified":"2023-11-30T18:41:45.105847+0000","last_up_change":"2023-11-30T17:07:07.846634+0000","last_in_change":"2023-11-30T17:07:01.209781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-30T17:07:07.896608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"223","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-30T17:07:09.972752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"de56022c-e31e-4aa5-8f71-06fa5a59378d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":90306},{"type":"v1","addr":"172.21.15.49:6825","nonce":90306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":90306},{"type":"v1","addr":"172.21.15.49:6827","nonce":90306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":90306},{"type":"v1","addr":"172.21.15.49:6831","nonce":90306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":90306},{"type":"v1","addr":"172.21.15.49:6829","nonce":90306}]},"public_addr":"172.21.15.49:6825/90306","cluster_addr":"172.21.15.49:6827/90306","heartbeat_back_addr":"172.21.15.49:6831/90306","heartbeat_front_addr":"172.21.15.49:6829/90306","state":["exists","up"]},{"osd":1,"uuid":"0db27d78-4d49-426b-8028-c160cd6004d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":90315},{"type":"v1","addr":"172.21.15.49:6809","nonce":90315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":90315},{"type":"v1","addr":"172.21.15.49:6811","nonce":90315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":90315},{"type":"v1","addr":"172.21.15.49:6815","nonce":90315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":90315},{"type":"v1","addr":"172.21.15.49:6813","nonce":90315}]},"public_addr":"172.21.15.49:6809/90315","cluster_addr":"172.21.15.49:6811/90315","heartbeat_back_addr":"172.21.15.49:6815/90315","heartbeat_front_addr":"172.21.15.49:6813/90315","state":["exists","up"]},{"osd":2,"uuid":"ea04ab6b-30cd-4b3f-8b91-64c839245dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":90305},{"type":"v1","addr":"172.21.15.49:6801","nonce":90305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":90305},{"type":"v1","addr":"172.21.15.49:6803","nonce":90305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":90305},{"type":"v1","addr":"172.21.15.49:6807","nonce":90305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":90305},{"type":"v1","addr":"172.21.15.49:6805","nonce":90305}]},"public_addr":"172.21.15.49:6801/90305","cluster_addr":"172.21.15.49:6803/90305","heartbeat_back_addr":"172.21.15.49:6807/90305","heartbeat_front_addr":"172.21.15.49:6805/90305","state":["exists","up"]},{"osd":3,"uuid":"13617b13-0ec6-4515-91a8-fee1f18754df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":90322},{"type":"v1","addr":"172.21.15.49:6817","nonce":90322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":90322},{"type":"v1","addr":"172.21.15.49:6819","nonce":90322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":90322},{"type":"v1","addr":"172.21.15.49:6823","nonce":90322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":90322},{"type":"v1","addr":"172.21.15.49:6821","nonce":90322}]},"public_addr":"172.21.15.49:6817/90322","cluster_addr":"172.21.15.49:6819/90322","heartbeat_back_addr":"172.21.15.49:6823/90322","heartbeat_front_addr":"172.21.15.49:6821/90322","state":["exists","up"]},{"osd":4,"uuid":"36fb835b-48c2-4954-9fff-5d6d2cf7576a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":90553},{"type":"v1","addr":"172.21.15.115:6801","nonce":90553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":90553},{"type":"v1","addr":"172.21.15.115:6803","nonce":90553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":90553},{"type":"v1","addr":"172.21.15.115:6807","nonce":90553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":90553},{"type":"v1","addr":"172.21.15.115:6805","nonce":90553}]},"public_addr":"172.21.15.115:6801/90553","cluster_addr":"172.21.15.115:6803/90553","heartbeat_back_addr":"172.21.15.115:6807/90553","heartbeat_front_addr":"172.21.15.115:6805/90553","state":["exists","up"]},{"osd":5,"uuid":"6a1cc107-899d-44da-b7b4-29e656ee7880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":90554},{"type":"v1","addr":"172.21.15.115:6811","nonce":90554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":90554},{"type":"v1","addr":"172.21.15.115:6816","nonce":90554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":90554},{"type":"v1","addr":"172.21.15.115:6823","nonce":90554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":90554},{"type":"v1","addr":"172.21.15.115:6821","nonce":90554}]},"public_addr":"172.21.15.115:6811/90554","cluster_addr":"172.21.15.115:6816/90554","heartbeat_back_addr":"172.21.15.115:6823/90554","heartbeat_front_addr":"172.21.15.115:6821/90554","state":["exists","up"]},{"osd":6,"uuid":"e974c62c-9567-46b8-b70c-2ae47a55482e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":90555},{"type":"v1","addr":"172.21.15.115:6810","nonce":90555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":90555},{"type":"v1","addr":"172.21.15.115:6814","nonce":90555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":90555},{"type":"v1","addr":"172.21.15.115:6820","nonce":90555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6815","nonce":90555},{"type":"v1","addr":"172.21.15.115:6817","nonce":90555}]},"public_addr":"172.21.15.115:6810/90555","cluster_addr":"172.21.15.115:6814/90555","heartbeat_back_addr":"172.21.15.115:6820/90555","heartbeat_front_addr":"172.21.15.115:6817/90555","state":["exists","up"]},{"osd":7,"uuid":"39b0a658-7017-4637-99b1-b60ce3583779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":217,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":90598},{"type":"v1","addr":"172.21.15.115:6825","nonce":90598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":90598},{"type":"v1","addr":"172.21.15.115:6827","nonce":90598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":90598},{"type":"v1","addr":"172.21.15.115:6831","nonce":90598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":90598},{"type":"v1","addr":"172.21.15.115:6829","nonce":90598}]},"public_addr":"172.21.15.115:6825/90598","cluster_addr":"172.21.15.115:6827/90598","heartbeat_back_addr":"172.21.15.115:6831/90598","heartbeat_front_addr":"172.21.15.115:6829/90598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.333754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.374845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.275402+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.340774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.362422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.282465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.358892+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T17:07:06.408546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/483174904":"2023-12-01T18:41:40.879006+0000","172.21.15.49:6835/1129424322":"2023-12-01T18:41:41.100183+0000","172.21.15.49:6833/1129424322":"2023-12-01T18:41:41.100183+0000","172.21.15.115:0/728270803":"2023-12-01T18:41:40.879006+0000","172.21.15.115:0/2113507503":"2023-12-01T18:41:40.879006+0000","172.21.15.115:0/825362846":"2023-12-01T18:41:40.879006+0000","172.21.15.115:0/695180815":"2023-12-01T18:41:40.879006+0000","172.21.15.115:0/1773998477":"2023-12-01T18:41:33.621332+0000","172.21.15.115:6833/103051":"2023-12-01T18:41:33.621332+0000","172.21.15.115:6832/103051":"2023-12-01T18:41:33.621332+0000","172.21.15.115:0/3037216069":"2023-12-01T18:41:33.621332+0000","172.21.15.115:0/467841810":"2023-12-01T18:41:33.621332+0000","172.21.15.115:0/107175683":"2023-12-01T18:41:33.621332+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T18:41:49.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.500+0000 7fd1ad8a2700 1 -- 172.21.15.49:0/2352364662 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fd18805f240 msgr2=0x7fd188061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:49.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.500+0000 7fd1ad8a2700 1 --2- 172.21.15.49:0/2352364662 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fd18805f240 0x7fd188061700 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fd1a00038c0 tx=0x7fd1a0007bc0).stop 2023-11-30T18:41:49.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.500+0000 7fd1ad8a2700 1 -- 172.21.15.49:0/2352364662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1a81548c0 msgr2=0x7fd1a8152a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:49.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.500+0000 7fd1ad8a2700 1 --2- 172.21.15.49:0/2352364662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1a81548c0 0x7fd1a8152a40 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 rx=0x7fd198001560 tx=0x7fd1980015b0).stop 2023-11-30T18:41:49.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.500+0000 7fd1ad8a2700 1 -- 172.21.15.49:0/2352364662 shutdown_connections 2023-11-30T18:41:49.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.500+0000 7fd1ad8a2700 1 --2- 172.21.15.49:0/2352364662 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fd18805f240 0x7fd188061700 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:49.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.500+0000 7fd1ad8a2700 1 --2- 172.21.15.49:0/2352364662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1a81548c0 0x7fd1a8152a40 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:49.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.500+0000 7fd1ad8a2700 1 --2- 172.21.15.49:0/2352364662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1a80c6e30 0x7fd1a8165580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:49.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.500+0000 7fd1ad8a2700 1 --2- 172.21.15.49:0/2352364662 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1a81544e0 0x7fd1a8148f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:49.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.500+0000 7fd1ad8a2700 1 -- 172.21.15.49:0/2352364662 >> 172.21.15.49:0/2352364662 conn(0x7fd1a8085020 msgr2=0x7fd1a80c0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:49.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.500+0000 7fd1ad8a2700 1 -- 172.21.15.49:0/2352364662 shutdown_connections 2023-11-30T18:41:49.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:49.500+0000 7fd1ad8a2700 1 -- 172.21.15.49:0/2352364662 wait complete. 2023-11-30T18:41:50.514 INFO:tasks.ceph:Scrubbing osd.0 2023-11-30T18:41:50.514 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-30T18:41:50.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.645+0000 7f45f8c6e700 1 Processor -- start 2023-11-30T18:41:50.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.645+0000 7f45f8c6e700 1 -- start start 2023-11-30T18:41:50.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.646+0000 7f45f8c6e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f45f41542d0 0x7f45f40a9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:50.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.646+0000 7f45f8c6e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f45f40c66d0 0x7f45f40aa460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:50.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.646+0000 7f45f8c6e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f4158d50 con 0x7f45f41546b0 2023-11-30T18:41:50.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.646+0000 7f45f8c6e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f40c6b60 con 0x7f45f41542d0 2023-11-30T18:41:50.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.646+0000 7f45f8c6e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f40aa950 con 0x7f45f40c66d0 2023-11-30T18:41:50.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.646+0000 7f45f37fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f45f41542d0 0x7f45f40a9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:50.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.646+0000 7f45f37fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f45f41542d0 0x7f45f40a9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59100/0 (socket says 172.21.15.49:59100) 2023-11-30T18:41:50.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.646+0000 7f45f37fe700 1 -- 172.21.15.49:0/2909298913 learned_addr learned my addr 172.21.15.49:0/2909298913 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:50.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.646+0000 7f45f3fff700 1 --2- 172.21.15.49:0/2909298913 >> v2:172.21.15.115:3300/0 conn(0x7f45f40c66d0 0x7f45f40aa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:50.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.646+0000 7f45f37fe700 1 -- 172.21.15.49:0/2909298913 >> v2:172.21.15.115:3300/0 conn(0x7f45f40c66d0 msgr2=0x7f45f40aa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:50.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.646+0000 7f45f37fe700 1 --2- 172.21.15.49:0/2909298913 >> v2:172.21.15.115:3300/0 conn(0x7f45f40c66d0 0x7f45f40aa460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:50.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.646+0000 7f45f37fe700 1 -- 172.21.15.49:0/2909298913 >> v1:172.21.15.115:6789/0 conn(0x7f45f41546b0 legacy=0x7f45f40c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:50.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.646+0000 7f45f37fe700 1 -- 172.21.15.49:0/2909298913 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f4158140 con 0x7f45f41542d0 2023-11-30T18:41:50.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.646+0000 7f45f3fff700 1 --2- 172.21.15.49:0/2909298913 >> v2:172.21.15.115:3300/0 conn(0x7f45f40c66d0 0x7f45f40aa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:41:50.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.647+0000 7f45f37fe700 1 --2- 172.21.15.49:0/2909298913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45f41542d0 0x7f45f40a9f70 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 rx=0x7f45f40b12a0 tx=0x7f45e40090f0).ready entity=mon.0 client_cookie=e024e69e2cb13bb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:50.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.647+0000 7f45f27fc700 1 -- 172.21.15.49:0/2909298913 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e400b5a0 con 0x7f45f41542d0 2023-11-30T18:41:50.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.647+0000 7f45f27fc700 1 -- 172.21.15.49:0/2909298913 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e400b700 con 0x7f45f41542d0 2023-11-30T18:41:50.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.647+0000 7f45f27fc700 1 -- 172.21.15.49:0/2909298913 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e400ba80 con 0x7f45f41542d0 2023-11-30T18:41:50.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.647+0000 7f45f8c6e700 1 -- 172.21.15.49:0/2909298913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45f41542d0 msgr2=0x7f45f40a9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:50.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.647+0000 7f45f8c6e700 1 --2- 172.21.15.49:0/2909298913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45f41542d0 0x7f45f40a9f70 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 rx=0x7f45f40b12a0 tx=0x7f45e40090f0).stop 2023-11-30T18:41:50.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.647+0000 7f45f8c6e700 1 -- 172.21.15.49:0/2909298913 shutdown_connections 2023-11-30T18:41:50.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.647+0000 7f45f8c6e700 1 --2- 172.21.15.49:0/2909298913 >> v2:172.21.15.115:3300/0 conn(0x7f45f40c66d0 0x7f45f40aa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:50.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.647+0000 7f45f8c6e700 1 --2- 172.21.15.49:0/2909298913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45f41542d0 0x7f45f40a9f70 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:50.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.647+0000 7f45f8c6e700 1 -- 172.21.15.49:0/2909298913 >> 172.21.15.49:0/2909298913 conn(0x7f45f40cb010 msgr2=0x7f45f40cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:50.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.647+0000 7f45f8c6e700 1 -- 172.21.15.49:0/2909298913 shutdown_connections 2023-11-30T18:41:50.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.647+0000 7f45f8c6e700 1 -- 172.21.15.49:0/2909298913 wait complete. 2023-11-30T18:41:50.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.648+0000 7f45f8c6e700 1 Processor -- start 2023-11-30T18:41:50.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.649+0000 7f45f8c6e700 1 -- start start 2023-11-30T18:41:50.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.649+0000 7f45f8c6e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45f40c66d0 0x7f45f4157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:50.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.649+0000 7f45f8c6e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45f41542d0 0x7f45f414d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:50.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.649+0000 7f45f8c6e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45f41546b0 0x7f45f40ab910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:50.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.649+0000 7f45f8c6e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f4164960 con 0x7f45f40c66d0 2023-11-30T18:41:50.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.649+0000 7f45f8c6e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f40af960 con 0x7f45f41546b0 2023-11-30T18:41:50.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.649+0000 7f45f8c6e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f40af070 con 0x7f45f41542d0 2023-11-30T18:41:50.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.649+0000 7f45f37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45f40c66d0 0x7f45f4157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:50.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.649+0000 7f45f37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45f40c66d0 0x7f45f4157a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59102/0 (socket says 172.21.15.49:59102) 2023-11-30T18:41:50.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.649+0000 7f45f37fe700 1 -- 172.21.15.49:0/345661219 learned_addr learned my addr 172.21.15.49:0/345661219 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:50.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.650+0000 7f45f37fe700 1 -- 172.21.15.49:0/345661219 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45f41542d0 msgr2=0x7f45f414d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:50.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.650+0000 7f45f37fe700 1 --2- 172.21.15.49:0/345661219 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45f41542d0 0x7f45f414d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:50.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.650+0000 7f45f37fe700 1 -- 172.21.15.49:0/345661219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45f41546b0 msgr2=0x7f45f40ab910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:50.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.650+0000 7f45f37fe700 1 --2- 172.21.15.49:0/345661219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45f41546b0 0x7f45f40ab910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-30T18:41:50.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.650+0000 7f45f37fe700 1 -- 172.21.15.49:0/345661219 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e4009370 con 0x7f45f40c66d0 2023-11-30T18:41:50.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.650+0000 7f45f37fe700 1 --2- 172.21.15.49:0/345661219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45f40c66d0 0x7f45f4157a90 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 rx=0x7f45e4009130 tx=0x7f45e4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:50.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.650+0000 7f45db7fe700 1 -- 172.21.15.49:0/345661219 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e400ba80 con 0x7f45f40c66d0 2023-11-30T18:41:50.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.650+0000 7f45db7fe700 1 -- 172.21.15.49:0/345661219 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e4000d10 con 0x7f45f40c66d0 2023-11-30T18:41:50.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.650+0000 7f45f8c6e700 1 -- 172.21.15.49:0/345661219 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f414d590 con 0x7f45f40c66d0 2023-11-30T18:41:50.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.650+0000 7f45db7fe700 1 -- 172.21.15.49:0/345661219 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e401c670 con 0x7f45f40c66d0 2023-11-30T18:41:50.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.650+0000 7f45f8c6e700 1 -- 172.21.15.49:0/345661219 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f40af5f0 con 0x7f45f40c66d0 2023-11-30T18:41:50.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.651+0000 7f45f8c6e700 1 -- 172.21.15.49:0/345661219 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f45f406c7c0 con 0x7f45f40c66d0 2023-11-30T18:41:50.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.651+0000 7f45db7fe700 1 -- 172.21.15.49:0/345661219 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f45e401c9e0 con 0x7f45f40c66d0 2023-11-30T18:41:50.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.652+0000 7f45db7fe700 1 --2- 172.21.15.49:0/345661219 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f45e005f240 0x7f45e0061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:50.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.652+0000 7f45db7fe700 1 -- 172.21.15.49:0/345661219 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(225..225 src has 1..225) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f45e407c6e0 con 0x7f45f40c66d0 2023-11-30T18:41:50.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.652+0000 7f45db7fe700 1 --2- 172.21.15.49:0/345661219 >> [v2:172.21.15.49:6824/90306,v1:172.21.15.49:6825/90306] conn(0x7f45e0065cc0 0x7f45e0068160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:50.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.652+0000 7f45db7fe700 1 -- 172.21.15.49:0/345661219 --> [v2:172.21.15.49:6824/90306,v1:172.21.15.49:6825/90306] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f45e00687e0 con 0x7f45e0065cc0 2023-11-30T18:41:50.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.652+0000 7f45db7fe700 1 -- 172.21.15.49:0/345661219 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=225) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45e407cac0 con 0x7f45f40c66d0 2023-11-30T18:41:50.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.652+0000 7f45f2ffd700 1 --2- 172.21.15.49:0/345661219 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f45e005f240 0x7f45e0061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:50.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.652+0000 7f45f3fff700 1 --2- 172.21.15.49:0/345661219 >> [v2:172.21.15.49:6824/90306,v1:172.21.15.49:6825/90306] conn(0x7f45e0065cc0 0x7f45e0068160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:50.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.652+0000 7f45f3fff700 1 --2- 172.21.15.49:0/345661219 >> [v2:172.21.15.49:6824/90306,v1:172.21.15.49:6825/90306] conn(0x7f45e0065cc0 0x7f45e0068160 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:50.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.652+0000 7f45f2ffd700 1 --2- 172.21.15.49:0/345661219 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f45e005f240 0x7f45e0061700 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f45f40c9be0 tx=0x7f45e80079a0).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:50.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.653+0000 7f45db7fe700 1 -- 172.21.15.49:0/345661219 <== osd.0 v2:172.21.15.49:6824/90306 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f45e00687e0 con 0x7f45e0065cc0 2023-11-30T18:41:50.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.666+0000 7f45f8c6e700 1 -- 172.21.15.49:0/345661219 --> [v2:172.21.15.49:6824/90306,v1:172.21.15.49:6825/90306] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f45f4065240 con 0x7f45e0065cc0 2023-11-30T18:41:50.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.667+0000 7f45db7fe700 1 -- 172.21.15.49:0/345661219 <== osd.0 v2:172.21.15.49:6824/90306 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f45f4065240 con 0x7f45e0065cc0 2023-11-30T18:41:50.668 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T18:41:50.668 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-30T18:41:50.668 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T18:41:50.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.667+0000 7f45f8c6e700 1 -- 172.21.15.49:0/345661219 >> [v2:172.21.15.49:6824/90306,v1:172.21.15.49:6825/90306] conn(0x7f45e0065cc0 msgr2=0x7f45e0068160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:50.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.667+0000 7f45f8c6e700 1 --2- 172.21.15.49:0/345661219 >> [v2:172.21.15.49:6824/90306,v1:172.21.15.49:6825/90306] conn(0x7f45e0065cc0 0x7f45e0068160 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:50.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.667+0000 7f45f8c6e700 1 -- 172.21.15.49:0/345661219 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f45e005f240 msgr2=0x7f45e0061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:50.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.667+0000 7f45f8c6e700 1 --2- 172.21.15.49:0/345661219 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f45e005f240 0x7f45e0061700 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f45f40c9be0 tx=0x7f45e80079a0).stop 2023-11-30T18:41:50.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.667+0000 7f45f8c6e700 1 -- 172.21.15.49:0/345661219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45f40c66d0 msgr2=0x7f45f4157a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:50.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.667+0000 7f45f8c6e700 1 --2- 172.21.15.49:0/345661219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45f40c66d0 0x7f45f4157a90 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 rx=0x7f45e4009130 tx=0x7f45e4015000).stop 2023-11-30T18:41:50.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.667+0000 7f45f3fff700 1 -- 172.21.15.49:0/345661219 reap_dead start 2023-11-30T18:41:50.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.667+0000 7f45f8c6e700 1 -- 172.21.15.49:0/345661219 shutdown_connections 2023-11-30T18:41:50.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.667+0000 7f45f8c6e700 1 -- 172.21.15.49:0/345661219 >> 172.21.15.49:0/345661219 conn(0x7f45f40cb010 msgr2=0x7f45f40ca670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:50.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.667+0000 7f45f8c6e700 1 -- 172.21.15.49:0/345661219 shutdown_connections 2023-11-30T18:41:50.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.667+0000 7f45f8c6e700 1 -- 172.21.15.49:0/345661219 wait complete. 2023-11-30T18:41:50.679 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-30T18:41:50.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.797+0000 7fbc71eb9700 1 Processor -- start 2023-11-30T18:41:50.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.797+0000 7fbc71eb9700 1 -- start start 2023-11-30T18:41:50.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.798+0000 7fbc71eb9700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbc6c098e50 0x7fbc6c0c7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:50.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.798+0000 7fbc71eb9700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbc6c0640b0 0x7fbc6c0c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:50.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.798+0000 7fbc71eb9700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc6c154bc0 con 0x7fbc6c1582c0 2023-11-30T18:41:50.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.798+0000 7fbc71eb9700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc6c099230 con 0x7fbc6c098e50 2023-11-30T18:41:50.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.798+0000 7fbc71eb9700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc6c064540 con 0x7fbc6c0640b0 2023-11-30T18:41:50.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.798+0000 7fbc6b7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbc6c098e50 0x7fbc6c0c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:50.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.798+0000 7fbc6bfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbc6c1582c0 0x7fbc6c1586c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53454/0 (socket says 172.21.15.49:53454) 2023-11-30T18:41:50.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.798+0000 7fbc6bfff700 1 -- 172.21.15.49:0/3400704123 learned_addr learned my addr 172.21.15.49:0/3400704123 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:50.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.798+0000 7fbc6affd700 1 --2- 172.21.15.49:0/3400704123 >> v2:172.21.15.115:3300/0 conn(0x7fbc6c0640b0 0x7fbc6c0c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:50.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.798+0000 7fbc6b7fe700 1 -- 172.21.15.49:0/3400704123 >> v2:172.21.15.115:3300/0 conn(0x7fbc6c0640b0 msgr2=0x7fbc6c0c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:50.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.798+0000 7fbc6b7fe700 1 --2- 172.21.15.49:0/3400704123 >> v2:172.21.15.115:3300/0 conn(0x7fbc6c0640b0 0x7fbc6c0c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:50.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.798+0000 7fbc6b7fe700 1 -- 172.21.15.49:0/3400704123 >> v1:172.21.15.49:6789/0 conn(0x7fbc6c1582c0 legacy=0x7fbc6c1586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:50.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.799+0000 7fbc6b7fe700 1 -- 172.21.15.49:0/3400704123 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6c0c6320 con 0x7fbc6c098e50 2023-11-30T18:41:50.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.799+0000 7fbc6a7fc700 1 -- 172.21.15.49:0/3400704123 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1137636265 0 0) 0x7fbc64001490 con 0x7fbc6c1582c0 2023-11-30T18:41:50.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.799+0000 7fbc6b7fe700 1 --2- 172.21.15.49:0/3400704123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc6c098e50 0x7fbc6c0c7620 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 rx=0x7fbc6c06c4c0 tx=0x7fbc5c006f40).ready entity=mon.0 client_cookie=831ba9d88deb341c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:50.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.799+0000 7fbc6a7fc700 1 -- 172.21.15.49:0/3400704123 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c005880 con 0x7fbc6c098e50 2023-11-30T18:41:50.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.799+0000 7fbc6a7fc700 1 -- 172.21.15.49:0/3400704123 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5c0059e0 con 0x7fbc6c098e50 2023-11-30T18:41:50.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.799+0000 7fbc6a7fc700 1 -- 172.21.15.49:0/3400704123 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c005d60 con 0x7fbc6c098e50 2023-11-30T18:41:50.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.799+0000 7fbc71eb9700 1 -- 172.21.15.49:0/3400704123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc6c098e50 msgr2=0x7fbc6c0c7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:50.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.799+0000 7fbc71eb9700 1 --2- 172.21.15.49:0/3400704123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc6c098e50 0x7fbc6c0c7620 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 rx=0x7fbc6c06c4c0 tx=0x7fbc5c006f40).stop 2023-11-30T18:41:50.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.799+0000 7fbc71eb9700 1 -- 172.21.15.49:0/3400704123 shutdown_connections 2023-11-30T18:41:50.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.799+0000 7fbc71eb9700 1 --2- 172.21.15.49:0/3400704123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc6c098e50 0x7fbc6c0c7620 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:50.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.799+0000 7fbc71eb9700 1 --2- 172.21.15.49:0/3400704123 >> v2:172.21.15.115:3300/0 conn(0x7fbc6c0640b0 0x7fbc6c0c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:50.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.799+0000 7fbc71eb9700 1 -- 172.21.15.49:0/3400704123 >> 172.21.15.49:0/3400704123 conn(0x7fbc6c0c7db0 msgr2=0x7fbc6c0c81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:50.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.799+0000 7fbc71eb9700 1 -- 172.21.15.49:0/3400704123 shutdown_connections 2023-11-30T18:41:50.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.799+0000 7fbc71eb9700 1 -- 172.21.15.49:0/3400704123 wait complete. 2023-11-30T18:41:50.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.801+0000 7fbc71eb9700 1 Processor -- start 2023-11-30T18:41:50.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.801+0000 7fbc71eb9700 1 -- start start 2023-11-30T18:41:50.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.801+0000 7fbc71eb9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc6c0640b0 0x7fbc6c156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:50.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.801+0000 7fbc71eb9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc6c098e50 0x7fbc6c1573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:50.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.801+0000 7fbc71eb9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc6c1582c0 0x7fbc6c168750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:50.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.801+0000 7fbc71eb9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c156ae0 con 0x7fbc6c098e50 2023-11-30T18:41:50.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.801+0000 7fbc71eb9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c155e60 con 0x7fbc6c0640b0 2023-11-30T18:41:50.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.801+0000 7fbc71eb9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c156140 con 0x7fbc6c1582c0 2023-11-30T18:41:50.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.801+0000 7fbc6affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc6c098e50 0x7fbc6c1573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:50.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.802+0000 7fbc6b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc6c0640b0 0x7fbc6c156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:50.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.802+0000 7fbc6b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc6c0640b0 0x7fbc6c156f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.49:59242/0 (socket says 172.21.15.49:59242) 2023-11-30T18:41:50.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.802+0000 7fbc6affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc6c098e50 0x7fbc6c1573f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59130/0 (socket says 172.21.15.49:59130) 2023-11-30T18:41:50.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.802+0000 7fbc6b7fe700 1 -- 172.21.15.49:0/510530655 learned_addr learned my addr 172.21.15.49:0/510530655 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:50.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.802+0000 7fbc6bfff700 1 --2- 172.21.15.49:0/510530655 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc6c1582c0 0x7fbc6c168750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:50.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.802+0000 7fbc6affd700 1 -- 172.21.15.49:0/510530655 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc6c1582c0 msgr2=0x7fbc6c168750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:50.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.802+0000 7fbc6affd700 1 --2- 172.21.15.49:0/510530655 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc6c1582c0 0x7fbc6c168750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:50.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.802+0000 7fbc6affd700 1 -- 172.21.15.49:0/510530655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc6c0640b0 msgr2=0x7fbc6c156f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:50.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.802+0000 7fbc6affd700 1 --2- 172.21.15.49:0/510530655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc6c0640b0 0x7fbc6c156f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:50.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.802+0000 7fbc6affd700 1 -- 172.21.15.49:0/510530655 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc5c009250 con 0x7fbc6c098e50 2023-11-30T18:41:50.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.802+0000 7fbc6affd700 1 --2- 172.21.15.49:0/510530655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc6c098e50 0x7fbc6c1573f0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 rx=0x7fbc6000d890 tx=0x7fbc60008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:50.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.802+0000 7fbc537fe700 1 -- 172.21.15.49:0/510530655 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc60011590 con 0x7fbc6c098e50 2023-11-30T18:41:50.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.802+0000 7fbc537fe700 1 -- 172.21.15.49:0/510530655 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc600116f0 con 0x7fbc6c098e50 2023-11-30T18:41:50.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.802+0000 7fbc71eb9700 1 -- 172.21.15.49:0/510530655 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc6c156420 con 0x7fbc6c098e50 2023-11-30T18:41:50.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.802+0000 7fbc537fe700 1 -- 172.21.15.49:0/510530655 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc60011a70 con 0x7fbc6c098e50 2023-11-30T18:41:50.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.802+0000 7fbc71eb9700 1 -- 172.21.15.49:0/510530655 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc6c169460 con 0x7fbc6c098e50 2023-11-30T18:41:50.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.803+0000 7fbc71eb9700 1 -- 172.21.15.49:0/510530655 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc6c06c860 con 0x7fbc6c098e50 2023-11-30T18:41:50.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.804+0000 7fbc537fe700 1 -- 172.21.15.49:0/510530655 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fbc60012420 con 0x7fbc6c098e50 2023-11-30T18:41:50.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.804+0000 7fbc537fe700 1 --2- 172.21.15.49:0/510530655 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fbc5805f270 0x7fbc58061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:50.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.804+0000 7fbc537fe700 1 -- 172.21.15.49:0/510530655 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(225..225 src has 1..225) v4 ==== 5940+0+0 (secure 0 0 0) 0x7fbc60079bf0 con 0x7fbc6c098e50 2023-11-30T18:41:50.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.804+0000 7fbc6b7fe700 1 --2- 172.21.15.49:0/510530655 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fbc5805f270 0x7fbc58061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:50.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.805+0000 7fbc6b7fe700 1 --2- 172.21.15.49:0/510530655 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fbc5805f270 0x7fbc58061730 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fbc5c006fa0 tx=0x7fbc5c016000).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:50.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.808+0000 7fbc537fe700 1 -- 172.21.15.49:0/510530655 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbc60080080 con 0x7fbc6c098e50 2023-11-30T18:41:50.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.981+0000 7fbc71eb9700 1 -- 172.21.15.49:0/510530655 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc6c0c6580 con 0x7fbc5805f270 2023-11-30T18:41:50.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.981+0000 7fbc537fe700 1 -- 172.21.15.49:0/510530655 <== mgr.9772 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbc6c0c6580 con 0x7fbc5805f270 2023-11-30T18:41:50.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.983+0000 7fbc71eb9700 1 -- 172.21.15.49:0/510530655 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fbc5805f270 msgr2=0x7fbc58061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:50.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.983+0000 7fbc71eb9700 1 --2- 172.21.15.49:0/510530655 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fbc5805f270 0x7fbc58061730 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fbc5c006fa0 tx=0x7fbc5c016000).stop 2023-11-30T18:41:50.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.983+0000 7fbc71eb9700 1 -- 172.21.15.49:0/510530655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc6c098e50 msgr2=0x7fbc6c1573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:50.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.983+0000 7fbc71eb9700 1 --2- 172.21.15.49:0/510530655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc6c098e50 0x7fbc6c1573f0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 rx=0x7fbc6000d890 tx=0x7fbc60008040).stop 2023-11-30T18:41:50.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.983+0000 7fbc71eb9700 1 -- 172.21.15.49:0/510530655 shutdown_connections 2023-11-30T18:41:50.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.983+0000 7fbc71eb9700 1 --2- 172.21.15.49:0/510530655 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fbc5805f270 0x7fbc58061730 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:50.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.983+0000 7fbc71eb9700 1 --2- 172.21.15.49:0/510530655 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc6c1582c0 0x7fbc6c168750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:50.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.983+0000 7fbc71eb9700 1 --2- 172.21.15.49:0/510530655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc6c0640b0 0x7fbc6c156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:50.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.983+0000 7fbc71eb9700 1 --2- 172.21.15.49:0/510530655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc6c098e50 0x7fbc6c1573f0 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:50.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.983+0000 7fbc71eb9700 1 -- 172.21.15.49:0/510530655 >> 172.21.15.49:0/510530655 conn(0x7fbc6c0c7db0 msgr2=0x7fbc6c0af0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:50.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.983+0000 7fbc71eb9700 1 -- 172.21.15.49:0/510530655 shutdown_connections 2023-11-30T18:41:50.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:50.983+0000 7fbc71eb9700 1 -- 172.21.15.49:0/510530655 wait complete. 2023-11-30T18:41:50.985 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 0 to deep-scrub 2023-11-30T18:41:50.996 INFO:tasks.ceph:Scrubbing osd.1 2023-11-30T18:41:50.996 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-30T18:41:51.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.118+0000 7f6fc5f99700 1 Processor -- start 2023-11-30T18:41:51.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.118+0000 7f6fc5f99700 1 -- start start 2023-11-30T18:41:51.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.119+0000 7f6fc5f99700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6fc0158040 0x7f6fc0154550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:51.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.119+0000 7f6fc5f99700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6fc0064880 0x7f6fc0064d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:51.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.119+0000 7f6fc5f99700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc0065200 con 0x7f6fc0154170 2023-11-30T18:41:51.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.119+0000 7f6fc5f99700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc00aa840 con 0x7f6fc0158040 2023-11-30T18:41:51.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.119+0000 7f6fc5f99700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc01584d0 con 0x7f6fc0064880 2023-11-30T18:41:51.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.119+0000 7f6fbffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6fc0158040 0x7f6fc0154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:51.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.119+0000 7f6fbffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6fc0158040 0x7f6fc0154550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59132/0 (socket says 172.21.15.49:59132) 2023-11-30T18:41:51.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.119+0000 7f6fbffff700 1 -- 172.21.15.49:0/788379763 learned_addr learned my addr 172.21.15.49:0/788379763 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:51.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.119+0000 7f6fc5798700 1 --2- 172.21.15.49:0/788379763 >> v2:172.21.15.115:3300/0 conn(0x7f6fc0064880 0x7f6fc0064d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:51.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.119+0000 7f6fbffff700 1 -- 172.21.15.49:0/788379763 >> v2:172.21.15.115:3300/0 conn(0x7f6fc0064880 msgr2=0x7f6fc0064d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:51.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.119+0000 7f6fbffff700 1 --2- 172.21.15.49:0/788379763 >> v2:172.21.15.115:3300/0 conn(0x7f6fc0064880 0x7f6fc0064d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.119+0000 7f6fbffff700 1 -- 172.21.15.49:0/788379763 >> v1:172.21.15.115:6789/0 conn(0x7f6fc0154170 legacy=0x7f6fc00aa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:51.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.119+0000 7f6fbffff700 1 -- 172.21.15.49:0/788379763 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc01587b0 con 0x7f6fc0158040 2023-11-30T18:41:51.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.119+0000 7f6fbffff700 1 --2- 172.21.15.49:0/788379763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fc0158040 0x7f6fc0154550 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 rx=0x7f6fc00aa9e0 tx=0x7f6fb40090f0).ready entity=mon.0 client_cookie=24e2722589ded879 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:51.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.119+0000 7f6fbf7fe700 1 -- 172.21.15.49:0/788379763 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb400b520 con 0x7f6fc0158040 2023-11-30T18:41:51.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.119+0000 7f6fbf7fe700 1 -- 172.21.15.49:0/788379763 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb400b680 con 0x7f6fc0158040 2023-11-30T18:41:51.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.120+0000 7f6fbf7fe700 1 -- 172.21.15.49:0/788379763 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb400ba00 con 0x7f6fc0158040 2023-11-30T18:41:51.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.120+0000 7f6fc5f99700 1 -- 172.21.15.49:0/788379763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fc0158040 msgr2=0x7f6fc0154550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:51.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.120+0000 7f6fc5f99700 1 --2- 172.21.15.49:0/788379763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fc0158040 0x7f6fc0154550 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 rx=0x7f6fc00aa9e0 tx=0x7f6fb40090f0).stop 2023-11-30T18:41:51.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.120+0000 7f6fc5f99700 1 -- 172.21.15.49:0/788379763 shutdown_connections 2023-11-30T18:41:51.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.120+0000 7f6fc5f99700 1 --2- 172.21.15.49:0/788379763 >> v2:172.21.15.115:3300/0 conn(0x7f6fc0064880 0x7f6fc0064d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.120+0000 7f6fc5f99700 1 --2- 172.21.15.49:0/788379763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fc0158040 0x7f6fc0154550 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.120+0000 7f6fc5f99700 1 -- 172.21.15.49:0/788379763 >> 172.21.15.49:0/788379763 conn(0x7f6fc00cb010 msgr2=0x7f6fc00cb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:51.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.120+0000 7f6fc5f99700 1 -- 172.21.15.49:0/788379763 shutdown_connections 2023-11-30T18:41:51.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.120+0000 7f6fc5f99700 1 -- 172.21.15.49:0/788379763 wait complete. 2023-11-30T18:41:51.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.121+0000 7f6fc5f99700 1 Processor -- start 2023-11-30T18:41:51.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.121+0000 7f6fc5f99700 1 -- start start 2023-11-30T18:41:51.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.122+0000 7f6fc5f99700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fc0064880 0x7f6fc00b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:51.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.122+0000 7f6fc5f99700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc0154170 0x7f6fc0169960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:51.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.122+0000 7f6fc5f99700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6fc0140f40 0x7f6fc00adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:51.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.122+0000 7f6fc5f99700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc00afce0 con 0x7f6fc0064880 2023-11-30T18:41:51.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.122+0000 7f6fc5f99700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc00b0840 con 0x7f6fc0154170 2023-11-30T18:41:51.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.122+0000 7f6fc5f99700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc00aff10 con 0x7f6fc0140f40 2023-11-30T18:41:51.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.122+0000 7f6fc4f97700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fc0064880 0x7f6fc00b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:51.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.122+0000 7f6fc4f97700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fc0064880 0x7f6fc00b0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59148/0 (socket says 172.21.15.49:59148) 2023-11-30T18:41:51.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.122+0000 7f6fc4f97700 1 -- 172.21.15.49:0/23170814 learned_addr learned my addr 172.21.15.49:0/23170814 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:51.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.122+0000 7f6fbffff700 1 --2- 172.21.15.49:0/23170814 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc0154170 0x7f6fc0169960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:51.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.122+0000 7f6fc5798700 1 --2- 172.21.15.49:0/23170814 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6fc0140f40 0x7f6fc00adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:51.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.122+0000 7f6fc4f97700 1 -- 172.21.15.49:0/23170814 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6fc0140f40 msgr2=0x7f6fc00adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:51.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.122+0000 7f6fc4f97700 1 --2- 172.21.15.49:0/23170814 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6fc0140f40 0x7f6fc00adfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.122+0000 7f6fc4f97700 1 -- 172.21.15.49:0/23170814 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc0154170 msgr2=0x7f6fc0169960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:51.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.122+0000 7f6fc4f97700 1 --2- 172.21.15.49:0/23170814 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc0154170 0x7f6fc0169960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.122+0000 7f6fc4f97700 1 -- 172.21.15.49:0/23170814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb4009370 con 0x7f6fc0064880 2023-11-30T18:41:51.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.123+0000 7f6fc4f97700 1 --2- 172.21.15.49:0/23170814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fc0064880 0x7f6fc00b0cd0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 rx=0x7f6fb000c4c0 tx=0x7f6fb0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:51.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.123+0000 7f6fbcff9700 1 -- 172.21.15.49:0/23170814 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb000ce70 con 0x7f6fc0064880 2023-11-30T18:41:51.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.123+0000 7f6fbcff9700 1 -- 172.21.15.49:0/23170814 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb0001e90 con 0x7f6fc0064880 2023-11-30T18:41:51.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.123+0000 7f6fc5f99700 1 -- 172.21.15.49:0/23170814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc00b01f0 con 0x7f6fc0064880 2023-11-30T18:41:51.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.123+0000 7f6fbcff9700 1 -- 172.21.15.49:0/23170814 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0007250 con 0x7f6fc0064880 2023-11-30T18:41:51.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.123+0000 7f6fc5f99700 1 -- 172.21.15.49:0/23170814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc00ae810 con 0x7f6fc0064880 2023-11-30T18:41:51.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.123+0000 7f6fc5f99700 1 -- 172.21.15.49:0/23170814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6fc006c7c0 con 0x7f6fc0064880 2023-11-30T18:41:51.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.124+0000 7f6fbcff9700 1 -- 172.21.15.49:0/23170814 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6fb00066a0 con 0x7f6fc0064880 2023-11-30T18:41:51.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.125+0000 7f6fbcff9700 1 --2- 172.21.15.49:0/23170814 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f6fac05f270 0x7f6fac061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:51.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.125+0000 7f6fbcff9700 1 -- 172.21.15.49:0/23170814 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(225..225 src has 1..225) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f6fb007a4f0 con 0x7f6fc0064880 2023-11-30T18:41:51.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.125+0000 7f6fbcff9700 1 --2- 172.21.15.49:0/23170814 >> [v2:172.21.15.49:6808/90315,v1:172.21.15.49:6809/90315] conn(0x7f6fac065cf0 0x7f6fac068190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:51.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.125+0000 7f6fbcff9700 1 -- 172.21.15.49:0/23170814 --> [v2:172.21.15.49:6808/90315,v1:172.21.15.49:6809/90315] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6fac068810 con 0x7f6fac065cf0 2023-11-30T18:41:51.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.125+0000 7f6fbcff9700 1 -- 172.21.15.49:0/23170814 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=225) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6fb007a8d0 con 0x7f6fc0064880 2023-11-30T18:41:51.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.125+0000 7f6fbffff700 1 --2- 172.21.15.49:0/23170814 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f6fac05f270 0x7f6fac061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:51.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.125+0000 7f6fc5798700 1 --2- 172.21.15.49:0/23170814 >> [v2:172.21.15.49:6808/90315,v1:172.21.15.49:6809/90315] conn(0x7f6fac065cf0 0x7f6fac068190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:51.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.125+0000 7f6fbffff700 1 --2- 172.21.15.49:0/23170814 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f6fac05f270 0x7f6fac061730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f6fc00aa9e0 tx=0x7f6fb4017000).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:51.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.125+0000 7f6fc5798700 1 --2- 172.21.15.49:0/23170814 >> [v2:172.21.15.49:6808/90315,v1:172.21.15.49:6809/90315] conn(0x7f6fac065cf0 0x7f6fac068190 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:51.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.126+0000 7f6fbcff9700 1 -- 172.21.15.49:0/23170814 <== osd.1 v2:172.21.15.49:6808/90315 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f6fac068810 con 0x7f6fac065cf0 2023-11-30T18:41:51.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.139+0000 7f6fc5f99700 1 -- 172.21.15.49:0/23170814 --> [v2:172.21.15.49:6808/90315,v1:172.21.15.49:6809/90315] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6fc00b0b20 con 0x7f6fac065cf0 2023-11-30T18:41:51.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.139+0000 7f6fbcff9700 1 -- 172.21.15.49:0/23170814 <== osd.1 v2:172.21.15.49:6808/90315 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6fc00b0b20 con 0x7f6fac065cf0 2023-11-30T18:41:51.140 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T18:41:51.140 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-30T18:41:51.141 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T18:41:51.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.140+0000 7f6fc5f99700 1 -- 172.21.15.49:0/23170814 >> [v2:172.21.15.49:6808/90315,v1:172.21.15.49:6809/90315] conn(0x7f6fac065cf0 msgr2=0x7f6fac068190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:51.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.140+0000 7f6fc5f99700 1 --2- 172.21.15.49:0/23170814 >> [v2:172.21.15.49:6808/90315,v1:172.21.15.49:6809/90315] conn(0x7f6fac065cf0 0x7f6fac068190 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.140+0000 7f6fc5f99700 1 -- 172.21.15.49:0/23170814 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f6fac05f270 msgr2=0x7f6fac061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:51.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.140+0000 7f6fc5f99700 1 --2- 172.21.15.49:0/23170814 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f6fac05f270 0x7f6fac061730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f6fc00aa9e0 tx=0x7f6fb4017000).stop 2023-11-30T18:41:51.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.140+0000 7f6fc5f99700 1 -- 172.21.15.49:0/23170814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fc0064880 msgr2=0x7f6fc00b0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:51.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.140+0000 7f6fc5f99700 1 --2- 172.21.15.49:0/23170814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fc0064880 0x7f6fc00b0cd0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 rx=0x7f6fb000c4c0 tx=0x7f6fb0007e00).stop 2023-11-30T18:41:51.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.140+0000 7f6fc5798700 1 -- 172.21.15.49:0/23170814 reap_dead start 2023-11-30T18:41:51.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.140+0000 7f6fc5f99700 1 -- 172.21.15.49:0/23170814 shutdown_connections 2023-11-30T18:41:51.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.140+0000 7f6fc5f99700 1 -- 172.21.15.49:0/23170814 >> 172.21.15.49:0/23170814 conn(0x7f6fc00cb010 msgr2=0x7f6fc01510e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:51.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.140+0000 7f6fc5f99700 1 -- 172.21.15.49:0/23170814 shutdown_connections 2023-11-30T18:41:51.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.140+0000 7f6fc5f99700 1 -- 172.21.15.49:0/23170814 wait complete. 2023-11-30T18:41:51.152 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-30T18:41:51.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.270+0000 7f4bc26e7700 1 Processor -- start 2023-11-30T18:41:51.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.270+0000 7f4bc26e7700 1 -- start start 2023-11-30T18:41:51.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.271+0000 7f4bc26e7700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4bbc066e10 0x7f4bbc13d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:51.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.271+0000 7f4bc26e7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4bbc13d940 0x7f4bbc063810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:51.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.271+0000 7f4bc26e7700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bbc1586a0 con 0x7f4bbc066a30 2023-11-30T18:41:51.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.271+0000 7f4bc26e7700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bbc157de0 con 0x7f4bbc066e10 2023-11-30T18:41:51.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.271+0000 7f4bc26e7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc0c7140 con 0x7f4bbc13d940 2023-11-30T18:41:51.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.271+0000 7f4bc16e5700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4bbc066a30 0x7f4bbc0c6a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53466/0 (socket says 172.21.15.49:53466) 2023-11-30T18:41:51.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.271+0000 7f4bc0ee4700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4bbc066e10 0x7f4bbc13d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:51.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.271+0000 7f4bc16e5700 1 -- 172.21.15.49:0/675615667 learned_addr learned my addr 172.21.15.49:0/675615667 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:51.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.271+0000 7f4bc1ee6700 1 --2- 172.21.15.49:0/675615667 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4bbc13d940 0x7f4bbc063810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:51.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.271+0000 7f4bc0ee4700 1 -- 172.21.15.49:0/675615667 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4bbc13d940 msgr2=0x7f4bbc063810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:51.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.271+0000 7f4bc0ee4700 1 --2- 172.21.15.49:0/675615667 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4bbc13d940 0x7f4bbc063810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.271+0000 7f4bc0ee4700 1 -- 172.21.15.49:0/675615667 >> v1:172.21.15.49:6789/0 conn(0x7f4bbc066a30 legacy=0x7f4bbc0c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:51.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.271+0000 7f4bc0ee4700 1 -- 172.21.15.49:0/675615667 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bbc158050 con 0x7f4bbc066e10 2023-11-30T18:41:51.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.271+0000 7f4bbbfff700 1 -- 172.21.15.49:0/675615667 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1832568472 0 0) 0x7f4bbc1586a0 con 0x7f4bbc066a30 2023-11-30T18:41:51.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.271+0000 7f4bc1ee6700 1 --2- 172.21.15.49:0/675615667 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4bbc13d940 0x7f4bbc063810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:41:51.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.272+0000 7f4bc0ee4700 1 --2- 172.21.15.49:0/675615667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bbc066e10 0x7f4bbc13d450 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 rx=0x7f4bb0009760 tx=0x7f4bb0009060).ready entity=mon.0 client_cookie=fb13ef67c7493fbe server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:51.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.272+0000 7f4bbbfff700 1 -- 172.21.15.49:0/675615667 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb000b580 con 0x7f4bbc066e10 2023-11-30T18:41:51.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.272+0000 7f4bbbfff700 1 -- 172.21.15.49:0/675615667 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb000b6e0 con 0x7f4bbc066e10 2023-11-30T18:41:51.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.272+0000 7f4bbbfff700 1 -- 172.21.15.49:0/675615667 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb000ba60 con 0x7f4bbc066e10 2023-11-30T18:41:51.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.272+0000 7f4bc26e7700 1 -- 172.21.15.49:0/675615667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bbc066e10 msgr2=0x7f4bbc13d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:51.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.272+0000 7f4bc26e7700 1 --2- 172.21.15.49:0/675615667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bbc066e10 0x7f4bbc13d450 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 rx=0x7f4bb0009760 tx=0x7f4bb0009060).stop 2023-11-30T18:41:51.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.272+0000 7f4bc26e7700 1 -- 172.21.15.49:0/675615667 shutdown_connections 2023-11-30T18:41:51.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.272+0000 7f4bc26e7700 1 --2- 172.21.15.49:0/675615667 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4bbc13d940 0x7f4bbc063810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.272+0000 7f4bc26e7700 1 --2- 172.21.15.49:0/675615667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bbc066e10 0x7f4bbc13d450 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.272+0000 7f4bc26e7700 1 -- 172.21.15.49:0/675615667 >> 172.21.15.49:0/675615667 conn(0x7f4bbc0c8ed0 msgr2=0x7f4bbc0c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:51.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.272+0000 7f4bc26e7700 1 -- 172.21.15.49:0/675615667 shutdown_connections 2023-11-30T18:41:51.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.272+0000 7f4bc26e7700 1 -- 172.21.15.49:0/675615667 wait complete. 2023-11-30T18:41:51.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.273+0000 7f4bc26e7700 1 Processor -- start 2023-11-30T18:41:51.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.274+0000 7f4bc26e7700 1 -- start start 2023-11-30T18:41:51.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.274+0000 7f4bc26e7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4bbc066a30 0x7f4bbc139e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:51.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.274+0000 7f4bc26e7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4bbc066e10 0x7f4bbc0ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:51.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.274+0000 7f4bc26e7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bbc13d940 0x7f4bbc063d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:51.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.274+0000 7f4bc26e7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc13a360 con 0x7f4bbc13d940 2023-11-30T18:41:51.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.274+0000 7f4bc26e7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc0c3b30 con 0x7f4bbc066e10 2023-11-30T18:41:51.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.274+0000 7f4bc26e7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc0c3db0 con 0x7f4bbc066a30 2023-11-30T18:41:51.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.275+0000 7f4bc1ee6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bbc13d940 0x7f4bbc063d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:51.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.275+0000 7f4bc1ee6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bbc13d940 0x7f4bbc063d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59170/0 (socket says 172.21.15.49:59170) 2023-11-30T18:41:51.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.275+0000 7f4bc1ee6700 1 -- 172.21.15.49:0/1428216056 learned_addr learned my addr 172.21.15.49:0/1428216056 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:51.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.275+0000 7f4bc16e5700 1 --2- 172.21.15.49:0/1428216056 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4bbc066a30 0x7f4bbc139e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:51.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.275+0000 7f4bc0ee4700 1 --2- 172.21.15.49:0/1428216056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4bbc066e10 0x7f4bbc0ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:51.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.275+0000 7f4bc1ee6700 1 -- 172.21.15.49:0/1428216056 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4bbc066a30 msgr2=0x7f4bbc139e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:51.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.275+0000 7f4bc1ee6700 1 --2- 172.21.15.49:0/1428216056 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4bbc066a30 0x7f4bbc139e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.275+0000 7f4bc1ee6700 1 -- 172.21.15.49:0/1428216056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4bbc066e10 msgr2=0x7f4bbc0ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:51.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.275+0000 7f4bc1ee6700 1 --2- 172.21.15.49:0/1428216056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4bbc066e10 0x7f4bbc0ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.275+0000 7f4bc1ee6700 1 -- 172.21.15.49:0/1428216056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb00092a0 con 0x7f4bbc13d940 2023-11-30T18:41:51.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.275+0000 7f4bc1ee6700 1 --2- 172.21.15.49:0/1428216056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bbc13d940 0x7f4bbc063d60 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 rx=0x7f4bb400d680 tx=0x7f4bb4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:51.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.275+0000 7f4bb97fa700 1 -- 172.21.15.49:0/1428216056 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4011590 con 0x7f4bbc13d940 2023-11-30T18:41:51.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.275+0000 7f4bb97fa700 1 -- 172.21.15.49:0/1428216056 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb40116f0 con 0x7f4bbc13d940 2023-11-30T18:41:51.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.275+0000 7f4bb97fa700 1 -- 172.21.15.49:0/1428216056 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4011a70 con 0x7f4bbc13d940 2023-11-30T18:41:51.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.275+0000 7f4bc26e7700 1 -- 172.21.15.49:0/1428216056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bbc0c4090 con 0x7f4bbc13d940 2023-11-30T18:41:51.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.275+0000 7f4bc26e7700 1 -- 172.21.15.49:0/1428216056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bbc0c4650 con 0x7f4bbc13d940 2023-11-30T18:41:51.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.276+0000 7f4bc26e7700 1 -- 172.21.15.49:0/1428216056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bbc06c7c0 con 0x7f4bbc13d940 2023-11-30T18:41:51.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.277+0000 7f4bb97fa700 1 -- 172.21.15.49:0/1428216056 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4bb4012420 con 0x7f4bbc13d940 2023-11-30T18:41:51.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.277+0000 7f4bb97fa700 1 --2- 172.21.15.49:0/1428216056 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4ba805f240 0x7f4ba8061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:51.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.277+0000 7f4bb97fa700 1 -- 172.21.15.49:0/1428216056 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(225..225 src has 1..225) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f4bb4079ca0 con 0x7f4bbc13d940 2023-11-30T18:41:51.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.277+0000 7f4bc16e5700 1 --2- 172.21.15.49:0/1428216056 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4ba805f240 0x7f4ba8061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:51.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.278+0000 7f4bc16e5700 1 --2- 172.21.15.49:0/1428216056 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4ba805f240 0x7f4ba8061700 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f4bac001560 tx=0x7f4bac007f30).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:51.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.281+0000 7f4bb97fa700 1 -- 172.21.15.49:0/1428216056 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4bb404ae40 con 0x7f4bbc13d940 2023-11-30T18:41:51.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.453+0000 7f4bc26e7700 1 -- 172.21.15.49:0/1428216056 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f4bbc06c1e0 con 0x7f4ba805f240 2023-11-30T18:41:51.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.454+0000 7f4bb97fa700 1 -- 172.21.15.49:0/1428216056 <== mgr.9772 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4bbc06c1e0 con 0x7f4ba805f240 2023-11-30T18:41:51.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.456+0000 7f4bc26e7700 1 -- 172.21.15.49:0/1428216056 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4ba805f240 msgr2=0x7f4ba8061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:51.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.456+0000 7f4bc26e7700 1 --2- 172.21.15.49:0/1428216056 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4ba805f240 0x7f4ba8061700 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f4bac001560 tx=0x7f4bac007f30).stop 2023-11-30T18:41:51.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.456+0000 7f4bc26e7700 1 -- 172.21.15.49:0/1428216056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bbc13d940 msgr2=0x7f4bbc063d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:51.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.456+0000 7f4bc26e7700 1 --2- 172.21.15.49:0/1428216056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bbc13d940 0x7f4bbc063d60 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 rx=0x7f4bb400d680 tx=0x7f4bb4008040).stop 2023-11-30T18:41:51.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.456+0000 7f4bc26e7700 1 -- 172.21.15.49:0/1428216056 shutdown_connections 2023-11-30T18:41:51.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.456+0000 7f4bc26e7700 1 --2- 172.21.15.49:0/1428216056 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4ba805f240 0x7f4ba8061700 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.456+0000 7f4bc26e7700 1 --2- 172.21.15.49:0/1428216056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bbc13d940 0x7f4bbc063d60 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.456+0000 7f4bc26e7700 1 --2- 172.21.15.49:0/1428216056 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4bbc066a30 0x7f4bbc139e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.456+0000 7f4bc26e7700 1 --2- 172.21.15.49:0/1428216056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4bbc066e10 0x7f4bbc0ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.456+0000 7f4bc26e7700 1 -- 172.21.15.49:0/1428216056 >> 172.21.15.49:0/1428216056 conn(0x7f4bbc0c8ed0 msgr2=0x7f4bbc13c420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:51.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.456+0000 7f4bc26e7700 1 -- 172.21.15.49:0/1428216056 shutdown_connections 2023-11-30T18:41:51.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.456+0000 7f4bc26e7700 1 -- 172.21.15.49:0/1428216056 wait complete. 2023-11-30T18:41:51.458 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 1 to deep-scrub 2023-11-30T18:41:51.470 INFO:tasks.ceph:Scrubbing osd.2 2023-11-30T18:41:51.470 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-30T18:41:51.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.591+0000 7f7c9c925700 1 Processor -- start 2023-11-30T18:41:51.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.591+0000 7f7c9c925700 1 -- start start 2023-11-30T18:41:51.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.592+0000 7f7c9c925700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7c98154610 0x7f7c981582e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:51.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.592+0000 7f7c9c925700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c980aa1c0 0x7f7c980aa600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:51.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.592+0000 7f7c9c925700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c98159210 con 0x7f7c980ab3b0 2023-11-30T18:41:51.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.592+0000 7f7c9c925700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c980c0c70 con 0x7f7c98154610 2023-11-30T18:41:51.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.592+0000 7f7c9c925700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c980c2110 con 0x7f7c980aa1c0 2023-11-30T18:41:51.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.592+0000 7f7c9659c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7c98154610 0x7f7c981582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:51.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.592+0000 7f7c9659c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7c98154610 0x7f7c981582e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59184/0 (socket says 172.21.15.49:59184) 2023-11-30T18:41:51.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.592+0000 7f7c9659c700 1 -- 172.21.15.49:0/1564760063 learned_addr learned my addr 172.21.15.49:0/1564760063 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:51.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.592+0000 7f7c96d9d700 1 --2- 172.21.15.49:0/1564760063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c980aa1c0 0x7f7c980aa600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:51.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.593+0000 7f7c9659c700 1 -- 172.21.15.49:0/1564760063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c980aa1c0 msgr2=0x7f7c980aa600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:51.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.593+0000 7f7c9659c700 1 --2- 172.21.15.49:0/1564760063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c980aa1c0 0x7f7c980aa600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.593+0000 7f7c9659c700 1 -- 172.21.15.49:0/1564760063 >> v1:172.21.15.115:6789/0 conn(0x7f7c980ab3b0 legacy=0x7f7c980c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:51.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.593+0000 7f7c9659c700 1 -- 172.21.15.49:0/1564760063 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c980aaaf0 con 0x7f7c98154610 2023-11-30T18:41:51.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.593+0000 7f7c96d9d700 1 --2- 172.21.15.49:0/1564760063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c980aa1c0 0x7f7c980aa600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T18:41:51.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.593+0000 7f7c9659c700 1 --2- 172.21.15.49:0/1564760063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c98154610 0x7f7c981582e0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 rx=0x7f7c90006fd0 tx=0x7f7c900090f0).ready entity=mon.0 client_cookie=ac030a9dc75267a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:51.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.593+0000 7f7c9559a700 1 -- 172.21.15.49:0/1564760063 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9000b600 con 0x7f7c98154610 2023-11-30T18:41:51.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.593+0000 7f7c9559a700 1 -- 172.21.15.49:0/1564760063 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9000b760 con 0x7f7c98154610 2023-11-30T18:41:51.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.593+0000 7f7c9559a700 1 -- 172.21.15.49:0/1564760063 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9000bae0 con 0x7f7c98154610 2023-11-30T18:41:51.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.593+0000 7f7c9c925700 1 -- 172.21.15.49:0/1564760063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c98154610 msgr2=0x7f7c981582e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:51.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.593+0000 7f7c9c925700 1 --2- 172.21.15.49:0/1564760063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c98154610 0x7f7c981582e0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 rx=0x7f7c90006fd0 tx=0x7f7c900090f0).stop 2023-11-30T18:41:51.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.593+0000 7f7c9c925700 1 -- 172.21.15.49:0/1564760063 shutdown_connections 2023-11-30T18:41:51.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.593+0000 7f7c9c925700 1 --2- 172.21.15.49:0/1564760063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c980aa1c0 0x7f7c980aa600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.593+0000 7f7c9c925700 1 --2- 172.21.15.49:0/1564760063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c98154610 0x7f7c981582e0 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.593+0000 7f7c9c925700 1 -- 172.21.15.49:0/1564760063 >> 172.21.15.49:0/1564760063 conn(0x7f7c980655a0 msgr2=0x7f7c98069e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:51.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.594+0000 7f7c9c925700 1 -- 172.21.15.49:0/1564760063 shutdown_connections 2023-11-30T18:41:51.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.594+0000 7f7c9c925700 1 -- 172.21.15.49:0/1564760063 wait complete. 2023-11-30T18:41:51.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.595+0000 7f7c9c925700 1 Processor -- start 2023-11-30T18:41:51.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.595+0000 7f7c9c925700 1 -- start start 2023-11-30T18:41:51.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.595+0000 7f7c9c925700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c980aa1c0 0x7f7c98144c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:51.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.595+0000 7f7c9c925700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c98154610 0x7f7c98157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:51.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.595+0000 7f7c9c925700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c981575f0 0x7f7c9814cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:51.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.595+0000 7f7c9c925700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c980ae1f0 con 0x7f7c981575f0 2023-11-30T18:41:51.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.595+0000 7f7c9c925700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c980af050 con 0x7f7c98154610 2023-11-30T18:41:51.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.595+0000 7f7c9c925700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c980ae440 con 0x7f7c980aa1c0 2023-11-30T18:41:51.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.596+0000 7f7c96d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c981575f0 0x7f7c9814cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:51.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.596+0000 7f7c96d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c981575f0 0x7f7c9814cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59198/0 (socket says 172.21.15.49:59198) 2023-11-30T18:41:51.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.596+0000 7f7c96d9d700 1 -- 172.21.15.49:0/3542767114 learned_addr learned my addr 172.21.15.49:0/3542767114 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:51.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.596+0000 7f7c9659c700 1 --2- 172.21.15.49:0/3542767114 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c980aa1c0 0x7f7c98144c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:51.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.596+0000 7f7c95d9b700 1 --2- 172.21.15.49:0/3542767114 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c98154610 0x7f7c98157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:51.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.596+0000 7f7c96d9d700 1 -- 172.21.15.49:0/3542767114 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c980aa1c0 msgr2=0x7f7c98144c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:51.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.596+0000 7f7c96d9d700 1 --2- 172.21.15.49:0/3542767114 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c980aa1c0 0x7f7c98144c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.596+0000 7f7c96d9d700 1 -- 172.21.15.49:0/3542767114 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c98154610 msgr2=0x7f7c98157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:51.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.596+0000 7f7c96d9d700 1 --2- 172.21.15.49:0/3542767114 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c98154610 0x7f7c98157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.596+0000 7f7c96d9d700 1 -- 172.21.15.49:0/3542767114 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c90009370 con 0x7f7c981575f0 2023-11-30T18:41:51.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.596+0000 7f7c96d9d700 1 --2- 172.21.15.49:0/3542767114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c981575f0 0x7f7c9814cac0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 rx=0x7f7c8800d180 tx=0x7f7c88009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:51.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.596+0000 7f7c8e7fc700 1 -- 172.21.15.49:0/3542767114 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8800dcc0 con 0x7f7c981575f0 2023-11-30T18:41:51.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.596+0000 7f7c8e7fc700 1 -- 172.21.15.49:0/3542767114 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8800f040 con 0x7f7c981575f0 2023-11-30T18:41:51.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.596+0000 7f7c8e7fc700 1 -- 172.21.15.49:0/3542767114 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88013600 con 0x7f7c981575f0 2023-11-30T18:41:51.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.596+0000 7f7c9c925700 1 -- 172.21.15.49:0/3542767114 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c980ae720 con 0x7f7c981575f0 2023-11-30T18:41:51.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.596+0000 7f7c9c925700 1 -- 172.21.15.49:0/3542767114 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c980afb00 con 0x7f7c981575f0 2023-11-30T18:41:51.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.597+0000 7f7c9c925700 1 -- 172.21.15.49:0/3542767114 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7c980c02a0 con 0x7f7c981575f0 2023-11-30T18:41:51.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.598+0000 7f7c8e7fc700 1 -- 172.21.15.49:0/3542767114 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f7c880139f0 con 0x7f7c981575f0 2023-11-30T18:41:51.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.598+0000 7f7c8e7fc700 1 --2- 172.21.15.49:0/3542767114 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f7c7805f270 0x7f7c78061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:51.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.598+0000 7f7c8e7fc700 1 -- 172.21.15.49:0/3542767114 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(225..225 src has 1..225) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f7c8807b680 con 0x7f7c981575f0 2023-11-30T18:41:51.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.598+0000 7f7c8e7fc700 1 --2- 172.21.15.49:0/3542767114 >> [v2:172.21.15.49:6800/90305,v1:172.21.15.49:6801/90305] conn(0x7f7c78065cf0 0x7f7c78068190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:51.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.598+0000 7f7c8e7fc700 1 -- 172.21.15.49:0/3542767114 --> [v2:172.21.15.49:6800/90305,v1:172.21.15.49:6801/90305] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7c78068810 con 0x7f7c78065cf0 2023-11-30T18:41:51.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.598+0000 7f7c8e7fc700 1 -- 172.21.15.49:0/3542767114 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=225) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c8807ba60 con 0x7f7c981575f0 2023-11-30T18:41:51.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.598+0000 7f7c9659c700 1 --2- 172.21.15.49:0/3542767114 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f7c7805f270 0x7f7c78061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:51.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.598+0000 7f7c95d9b700 1 --2- 172.21.15.49:0/3542767114 >> [v2:172.21.15.49:6800/90305,v1:172.21.15.49:6801/90305] conn(0x7f7c78065cf0 0x7f7c78068190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:51.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.599+0000 7f7c9659c700 1 --2- 172.21.15.49:0/3542767114 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f7c7805f270 0x7f7c78061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f7c9000b3c0 tx=0x7f7c90017000).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:51.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.599+0000 7f7c95d9b700 1 --2- 172.21.15.49:0/3542767114 >> [v2:172.21.15.49:6800/90305,v1:172.21.15.49:6801/90305] conn(0x7f7c78065cf0 0x7f7c78068190 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:51.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.599+0000 7f7c8e7fc700 1 -- 172.21.15.49:0/3542767114 <== osd.2 v2:172.21.15.49:6800/90305 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f7c78068810 con 0x7f7c78065cf0 2023-11-30T18:41:51.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.612+0000 7f7c9c925700 1 -- 172.21.15.49:0/3542767114 --> [v2:172.21.15.49:6800/90305,v1:172.21.15.49:6801/90305] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7c9806c860 con 0x7f7c78065cf0 2023-11-30T18:41:51.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.613+0000 7f7c8e7fc700 1 -- 172.21.15.49:0/3542767114 <== osd.2 v2:172.21.15.49:6800/90305 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f7c9806c860 con 0x7f7c78065cf0 2023-11-30T18:41:51.613 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T18:41:51.614 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-30T18:41:51.614 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T18:41:51.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.613+0000 7f7c9c925700 1 -- 172.21.15.49:0/3542767114 >> [v2:172.21.15.49:6800/90305,v1:172.21.15.49:6801/90305] conn(0x7f7c78065cf0 msgr2=0x7f7c78068190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:51.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.613+0000 7f7c9c925700 1 --2- 172.21.15.49:0/3542767114 >> [v2:172.21.15.49:6800/90305,v1:172.21.15.49:6801/90305] conn(0x7f7c78065cf0 0x7f7c78068190 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.613+0000 7f7c9c925700 1 -- 172.21.15.49:0/3542767114 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f7c7805f270 msgr2=0x7f7c78061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:51.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.613+0000 7f7c9c925700 1 --2- 172.21.15.49:0/3542767114 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f7c7805f270 0x7f7c78061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f7c9000b3c0 tx=0x7f7c90017000).stop 2023-11-30T18:41:51.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.613+0000 7f7c9c925700 1 -- 172.21.15.49:0/3542767114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c981575f0 msgr2=0x7f7c9814cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:51.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.613+0000 7f7c9c925700 1 --2- 172.21.15.49:0/3542767114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c981575f0 0x7f7c9814cac0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 rx=0x7f7c8800d180 tx=0x7f7c88009a50).stop 2023-11-30T18:41:51.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.613+0000 7f7c96d9d700 1 -- 172.21.15.49:0/3542767114 reap_dead start 2023-11-30T18:41:51.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.613+0000 7f7c9c925700 1 -- 172.21.15.49:0/3542767114 shutdown_connections 2023-11-30T18:41:51.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.613+0000 7f7c9c925700 1 -- 172.21.15.49:0/3542767114 >> 172.21.15.49:0/3542767114 conn(0x7f7c980655a0 msgr2=0x7f7c980ad7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:51.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.613+0000 7f7c9c925700 1 -- 172.21.15.49:0/3542767114 shutdown_connections 2023-11-30T18:41:51.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.613+0000 7f7c9c925700 1 -- 172.21.15.49:0/3542767114 wait complete. 2023-11-30T18:41:51.625 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-30T18:41:51.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.743+0000 7fa332938700 1 Processor -- start 2023-11-30T18:41:51.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.743+0000 7fa332938700 1 -- start start 2023-11-30T18:41:51.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.744+0000 7fa332938700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa32c098d10 0x7fa32c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:51.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.744+0000 7fa332938700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa32c0c6190 0x7fa32c063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:51.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.744+0000 7fa332938700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa32c064350 0x7fa32c158320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:51.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.744+0000 7fa332938700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa32c0c72d0 con 0x7fa32c064350 2023-11-30T18:41:51.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.744+0000 7fa332938700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa32c154bc0 con 0x7fa32c0c6190 2023-11-30T18:41:51.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.744+0000 7fa332938700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c0c66c0 con 0x7fa32c098d10 2023-11-30T18:41:51.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.744+0000 7fa330ed5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa32c064350 0x7fa32c158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:51.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.744+0000 7fa330ed5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa32c064350 0x7fa32c158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59212/0 (socket says 172.21.15.49:59212) 2023-11-30T18:41:51.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.744+0000 7fa330ed5700 1 -- 172.21.15.49:0/2612800214 learned_addr learned my addr 172.21.15.49:0/2612800214 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:51.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.744+0000 7fa32b7fe700 1 --2- 172.21.15.49:0/2612800214 >> v2:172.21.15.115:3300/0 conn(0x7fa32c0c6190 0x7fa32c063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:51.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.744+0000 7fa32bfff700 1 --2- 172.21.15.49:0/2612800214 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa32c098d10 0x7fa32c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:51.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.744+0000 7fa330ed5700 1 -- 172.21.15.49:0/2612800214 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa32c098d10 msgr2=0x7fa32c0c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:51.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.744+0000 7fa330ed5700 1 --2- 172.21.15.49:0/2612800214 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa32c098d10 0x7fa32c0c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.744+0000 7fa330ed5700 1 -- 172.21.15.49:0/2612800214 >> v2:172.21.15.115:3300/0 conn(0x7fa32c0c6190 msgr2=0x7fa32c063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:51.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.744+0000 7fa330ed5700 1 --2- 172.21.15.49:0/2612800214 >> v2:172.21.15.115:3300/0 conn(0x7fa32c0c6190 0x7fa32c063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.744+0000 7fa330ed5700 1 -- 172.21.15.49:0/2612800214 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32c0c69a0 con 0x7fa32c064350 2023-11-30T18:41:51.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.744+0000 7fa330ed5700 1 --2- 172.21.15.49:0/2612800214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa32c064350 0x7fa32c158320 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 rx=0x7fa32c0c8e20 tx=0x7fa324009840).ready entity=mon.0 client_cookie=7dfe225a770c0724 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:51.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.745+0000 7fa32affd700 1 -- 172.21.15.49:0/2612800214 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32400e070 con 0x7fa32c064350 2023-11-30T18:41:51.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.745+0000 7fa32affd700 1 -- 172.21.15.49:0/2612800214 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32400b970 con 0x7fa32c064350 2023-11-30T18:41:51.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.745+0000 7fa32affd700 1 -- 172.21.15.49:0/2612800214 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32400bcf0 con 0x7fa32c064350 2023-11-30T18:41:51.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.745+0000 7fa332938700 1 -- 172.21.15.49:0/2612800214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa32c064350 msgr2=0x7fa32c158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:51.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.745+0000 7fa332938700 1 --2- 172.21.15.49:0/2612800214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa32c064350 0x7fa32c158320 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 rx=0x7fa32c0c8e20 tx=0x7fa324009840).stop 2023-11-30T18:41:51.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.745+0000 7fa332938700 1 -- 172.21.15.49:0/2612800214 shutdown_connections 2023-11-30T18:41:51.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.745+0000 7fa332938700 1 --2- 172.21.15.49:0/2612800214 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa32c098d10 0x7fa32c0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.745+0000 7fa332938700 1 --2- 172.21.15.49:0/2612800214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa32c064350 0x7fa32c158320 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.745+0000 7fa332938700 1 --2- 172.21.15.49:0/2612800214 >> v2:172.21.15.115:3300/0 conn(0x7fa32c0c6190 0x7fa32c063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.745+0000 7fa332938700 1 -- 172.21.15.49:0/2612800214 >> 172.21.15.49:0/2612800214 conn(0x7fa32c0cb310 msgr2=0x7fa32c0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:51.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.745+0000 7fa332938700 1 -- 172.21.15.49:0/2612800214 shutdown_connections 2023-11-30T18:41:51.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.745+0000 7fa332938700 1 -- 172.21.15.49:0/2612800214 wait complete. 2023-11-30T18:41:51.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.746+0000 7fa332938700 1 Processor -- start 2023-11-30T18:41:51.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.746+0000 7fa332938700 1 -- start start 2023-11-30T18:41:51.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.747+0000 7fa332938700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa32c064350 0x7fa32c14e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:51.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.747+0000 7fa332938700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa32c098d10 0x7fa32c15a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:51.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.747+0000 7fa332938700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa32c0c6190 0x7fa32c1556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:51.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.747+0000 7fa332938700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c0aaa30 con 0x7fa32c098d10 2023-11-30T18:41:51.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.747+0000 7fa332938700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c0a9e20 con 0x7fa32c064350 2023-11-30T18:41:51.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.747+0000 7fa332938700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c0aa100 con 0x7fa32c0c6190 2023-11-30T18:41:51.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.747+0000 7fa32b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa32c098d10 0x7fa32c15a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:51.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.747+0000 7fa32b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa32c098d10 0x7fa32c15a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59226/0 (socket says 172.21.15.49:59226) 2023-11-30T18:41:51.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.747+0000 7fa32b7fe700 1 -- 172.21.15.49:0/2569768984 learned_addr learned my addr 172.21.15.49:0/2569768984 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:51.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.747+0000 7fa330ed5700 1 --2- 172.21.15.49:0/2569768984 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa32c0c6190 0x7fa32c1556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:51.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.747+0000 7fa32bfff700 1 --2- 172.21.15.49:0/2569768984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa32c064350 0x7fa32c14e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:51.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.748+0000 7fa32b7fe700 1 -- 172.21.15.49:0/2569768984 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa32c0c6190 msgr2=0x7fa32c1556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:51.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.748+0000 7fa32b7fe700 1 --2- 172.21.15.49:0/2569768984 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa32c0c6190 0x7fa32c1556a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.748+0000 7fa32b7fe700 1 -- 172.21.15.49:0/2569768984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa32c064350 msgr2=0x7fa32c14e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:51.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.748+0000 7fa32b7fe700 1 --2- 172.21.15.49:0/2569768984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa32c064350 0x7fa32c14e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.748+0000 7fa32b7fe700 1 -- 172.21.15.49:0/2569768984 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa324009ae0 con 0x7fa32c098d10 2023-11-30T18:41:51.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.748+0000 7fa32b7fe700 1 --2- 172.21.15.49:0/2569768984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa32c098d10 0x7fa32c15a7c0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 rx=0x7fa32000e8d0 tx=0x7fa320009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:51.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.748+0000 7fa313fff700 1 -- 172.21.15.49:0/2569768984 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa320012600 con 0x7fa32c098d10 2023-11-30T18:41:51.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.748+0000 7fa313fff700 1 -- 172.21.15.49:0/2569768984 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa320012760 con 0x7fa32c098d10 2023-11-30T18:41:51.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.748+0000 7fa332938700 1 -- 172.21.15.49:0/2569768984 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa32c0aa3e0 con 0x7fa32c098d10 2023-11-30T18:41:51.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.748+0000 7fa313fff700 1 -- 172.21.15.49:0/2569768984 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa320012ae0 con 0x7fa32c098d10 2023-11-30T18:41:51.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.748+0000 7fa332938700 1 -- 172.21.15.49:0/2569768984 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa32c14e630 con 0x7fa32c098d10 2023-11-30T18:41:51.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.749+0000 7fa332938700 1 -- 172.21.15.49:0/2569768984 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa32c0aad20 con 0x7fa32c098d10 2023-11-30T18:41:51.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.749+0000 7fa313fff700 1 -- 172.21.15.49:0/2569768984 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa32001b400 con 0x7fa32c098d10 2023-11-30T18:41:51.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.750+0000 7fa313fff700 1 --2- 172.21.15.49:0/2569768984 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa31805f270 0x7fa318061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:51.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.750+0000 7fa313fff700 1 -- 172.21.15.49:0/2569768984 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(225..225 src has 1..225) v4 ==== 5940+0+0 (secure 0 0 0) 0x7fa32007a610 con 0x7fa32c098d10 2023-11-30T18:41:51.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.750+0000 7fa32bfff700 1 --2- 172.21.15.49:0/2569768984 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa31805f270 0x7fa318061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:51.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.750+0000 7fa32bfff700 1 --2- 172.21.15.49:0/2569768984 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa31805f270 0x7fa318061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fa31c009c30 tx=0x7fa31c009060).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:51.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.754+0000 7fa313fff700 1 -- 172.21.15.49:0/2569768984 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa32c0aad20 con 0x7fa32c098d10 2023-11-30T18:41:51.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.925+0000 7fa332938700 1 -- 172.21.15.49:0/2569768984 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fa32c0aad20 con 0x7fa31805f270 2023-11-30T18:41:51.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.926+0000 7fa313fff700 1 -- 172.21.15.49:0/2569768984 <== mgr.9772 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa32c0aad20 con 0x7fa31805f270 2023-11-30T18:41:51.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.928+0000 7fa332938700 1 -- 172.21.15.49:0/2569768984 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa31805f270 msgr2=0x7fa318061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:51.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.928+0000 7fa332938700 1 --2- 172.21.15.49:0/2569768984 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa31805f270 0x7fa318061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fa31c009c30 tx=0x7fa31c009060).stop 2023-11-30T18:41:51.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.928+0000 7fa332938700 1 -- 172.21.15.49:0/2569768984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa32c098d10 msgr2=0x7fa32c15a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:51.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.928+0000 7fa332938700 1 --2- 172.21.15.49:0/2569768984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa32c098d10 0x7fa32c15a7c0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 rx=0x7fa32000e8d0 tx=0x7fa320009060).stop 2023-11-30T18:41:51.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.928+0000 7fa332938700 1 -- 172.21.15.49:0/2569768984 shutdown_connections 2023-11-30T18:41:51.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.928+0000 7fa332938700 1 --2- 172.21.15.49:0/2569768984 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fa31805f270 0x7fa318061730 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.928+0000 7fa332938700 1 --2- 172.21.15.49:0/2569768984 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa32c0c6190 0x7fa32c1556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.928+0000 7fa332938700 1 --2- 172.21.15.49:0/2569768984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa32c064350 0x7fa32c14e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.928+0000 7fa332938700 1 --2- 172.21.15.49:0/2569768984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa32c098d10 0x7fa32c15a7c0 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:51.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.928+0000 7fa332938700 1 -- 172.21.15.49:0/2569768984 >> 172.21.15.49:0/2569768984 conn(0x7fa32c0cb310 msgr2=0x7fa32c152990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:51.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.928+0000 7fa332938700 1 -- 172.21.15.49:0/2569768984 shutdown_connections 2023-11-30T18:41:51.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:51.928+0000 7fa332938700 1 -- 172.21.15.49:0/2569768984 wait complete. 2023-11-30T18:41:51.930 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 2 to deep-scrub 2023-11-30T18:41:51.941 INFO:tasks.ceph:Scrubbing osd.3 2023-11-30T18:41:51.941 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-30T18:41:52.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.062+0000 7fe9cd75c700 1 Processor -- start 2023-11-30T18:41:52.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.062+0000 7fe9cd75c700 1 -- start start 2023-11-30T18:41:52.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.063+0000 7fe9cd75c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe9c8158040 0x7fe9c8154550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:52.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.063+0000 7fe9cd75c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9c8064880 0x7fe9c8064d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:52.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.063+0000 7fe9cd75c700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9c8065200 con 0x7fe9c8154170 2023-11-30T18:41:52.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.063+0000 7fe9cd75c700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c80aa840 con 0x7fe9c8158040 2023-11-30T18:41:52.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.063+0000 7fe9cd75c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c81584d0 con 0x7fe9c8064880 2023-11-30T18:41:52.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.063+0000 7fe9c7fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe9c8154170 0x7fe9c80aa130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53480/0 (socket says 172.21.15.49:53480) 2023-11-30T18:41:52.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.063+0000 7fe9c7fff700 1 -- 172.21.15.49:0/2403556109 learned_addr learned my addr 172.21.15.49:0/2403556109 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:52.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.063+0000 7fe9ccf5b700 1 --2- 172.21.15.49:0/2403556109 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9c8064880 0x7fe9c8064d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:52.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.063+0000 7fe9c77fe700 1 --2- 172.21.15.49:0/2403556109 >> v2:172.21.15.115:3300/0 conn(0x7fe9c8158040 0x7fe9c8154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:52.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.063+0000 7fe9c6ffd700 1 -- 172.21.15.49:0/2403556109 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2995969434 0 0) 0x7fe9c8065200 con 0x7fe9c8154170 2023-11-30T18:41:52.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.063+0000 7fe9c6ffd700 1 -- 172.21.15.49:0/2403556109 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9b00033f0 con 0x7fe9c8154170 2023-11-30T18:41:52.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.064+0000 7fe9c6ffd700 1 -- 172.21.15.49:0/2403556109 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4157060160 0 0) 0x7fe9b00033f0 con 0x7fe9c8154170 2023-11-30T18:41:52.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.064+0000 7fe9c77fe700 1 -- 172.21.15.49:0/2403556109 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9c8064880 msgr2=0x7fe9c8064d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:52.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.064+0000 7fe9c77fe700 1 --2- 172.21.15.49:0/2403556109 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9c8064880 0x7fe9c8064d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:52.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.064+0000 7fe9c77fe700 1 -- 172.21.15.49:0/2403556109 >> v1:172.21.15.49:6789/0 conn(0x7fe9c8154170 legacy=0x7fe9c80aa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:52.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.064+0000 7fe9c77fe700 1 -- 172.21.15.49:0/2403556109 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c81587b0 con 0x7fe9c8158040 2023-11-30T18:41:52.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.064+0000 7fe9ccf5b700 1 --2- 172.21.15.49:0/2403556109 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9c8064880 0x7fe9c8064d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:41:52.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.064+0000 7fe9c77fe700 1 --2- 172.21.15.49:0/2403556109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9c8158040 0x7fe9c8154550 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7fe9bc009760 tx=0x7fe9bc009060).ready entity=mon.1 client_cookie=468c8e67d1816f61 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:52.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.064+0000 7fe9c6ffd700 1 -- 172.21.15.49:0/2403556109 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8001490 con 0x7fe9c8158040 2023-11-30T18:41:52.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.064+0000 7fe9c6ffd700 1 -- 172.21.15.49:0/2403556109 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9bc011400 con 0x7fe9c8158040 2023-11-30T18:41:52.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.064+0000 7fe9c6ffd700 1 -- 172.21.15.49:0/2403556109 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc011780 con 0x7fe9c8158040 2023-11-30T18:41:52.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.064+0000 7fe9cd75c700 1 -- 172.21.15.49:0/2403556109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9c8158040 msgr2=0x7fe9c8154550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:52.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.064+0000 7fe9cd75c700 1 --2- 172.21.15.49:0/2403556109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9c8158040 0x7fe9c8154550 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7fe9bc009760 tx=0x7fe9bc009060).stop 2023-11-30T18:41:52.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.064+0000 7fe9cd75c700 1 -- 172.21.15.49:0/2403556109 shutdown_connections 2023-11-30T18:41:52.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.064+0000 7fe9cd75c700 1 --2- 172.21.15.49:0/2403556109 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9c8064880 0x7fe9c8064d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:52.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.064+0000 7fe9cd75c700 1 --2- 172.21.15.49:0/2403556109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9c8158040 0x7fe9c8154550 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:52.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.064+0000 7fe9cd75c700 1 -- 172.21.15.49:0/2403556109 >> 172.21.15.49:0/2403556109 conn(0x7fe9c80cb010 msgr2=0x7fe9c80cb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:52.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.065+0000 7fe9cd75c700 1 -- 172.21.15.49:0/2403556109 shutdown_connections 2023-11-30T18:41:52.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.065+0000 7fe9cd75c700 1 -- 172.21.15.49:0/2403556109 wait complete. 2023-11-30T18:41:52.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.066+0000 7fe9cd75c700 1 Processor -- start 2023-11-30T18:41:52.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.066+0000 7fe9cd75c700 1 -- start start 2023-11-30T18:41:52.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.067+0000 7fe9cd75c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9c8064880 0x7fe9c814e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:52.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.067+0000 7fe9cd75c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9c8154170 0x7fe9c81555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:52.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.067+0000 7fe9cd75c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9c80c20b0 0x7fe9c8155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:52.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.067+0000 7fe9cd75c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c8164570 con 0x7fe9c8154170 2023-11-30T18:41:52.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.067+0000 7fe9cd75c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c80c2df0 con 0x7fe9c80c20b0 2023-11-30T18:41:52.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.067+0000 7fe9cd75c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c814f3f0 con 0x7fe9c8064880 2023-11-30T18:41:52.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.067+0000 7fe9c77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9c8154170 0x7fe9c81555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:52.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.067+0000 7fe9c77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9c8154170 0x7fe9c81555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59228/0 (socket says 172.21.15.49:59228) 2023-11-30T18:41:52.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.067+0000 7fe9c77fe700 1 -- 172.21.15.49:0/3385101866 learned_addr learned my addr 172.21.15.49:0/3385101866 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:52.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.067+0000 7fe9ccf5b700 1 --2- 172.21.15.49:0/3385101866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9c80c20b0 0x7fe9c8155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:52.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.067+0000 7fe9c7fff700 1 --2- 172.21.15.49:0/3385101866 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9c8064880 0x7fe9c814e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:52.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.067+0000 7fe9c77fe700 1 -- 172.21.15.49:0/3385101866 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9c8064880 msgr2=0x7fe9c814e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:52.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.067+0000 7fe9c77fe700 1 --2- 172.21.15.49:0/3385101866 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9c8064880 0x7fe9c814e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:52.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.067+0000 7fe9c77fe700 1 -- 172.21.15.49:0/3385101866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9c80c20b0 msgr2=0x7fe9c8155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:52.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.067+0000 7fe9c77fe700 1 --2- 172.21.15.49:0/3385101866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9c80c20b0 0x7fe9c8155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:52.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.067+0000 7fe9c77fe700 1 -- 172.21.15.49:0/3385101866 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c0009a20 con 0x7fe9c8154170 2023-11-30T18:41:52.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.067+0000 7fe9ccf5b700 1 --2- 172.21.15.49:0/3385101866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9c80c20b0 0x7fe9c8155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:41:52.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.067+0000 7fe9c77fe700 1 --2- 172.21.15.49:0/3385101866 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9c8154170 0x7fe9c81555a0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 rx=0x7fe9bc009d50 tx=0x7fe9bc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:52.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.067+0000 7fe9affff700 1 -- 172.21.15.49:0/3385101866 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc010b00 con 0x7fe9c8154170 2023-11-30T18:41:52.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.067+0000 7fe9affff700 1 -- 172.21.15.49:0/3385101866 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9bc010c80 con 0x7fe9c8154170 2023-11-30T18:41:52.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.067+0000 7fe9affff700 1 -- 172.21.15.49:0/3385101866 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc01d430 con 0x7fe9c8154170 2023-11-30T18:41:52.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.067+0000 7fe9cd75c700 1 -- 172.21.15.49:0/3385101866 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9bc0092a0 con 0x7fe9c8154170 2023-11-30T18:41:52.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.067+0000 7fe9cd75c700 1 -- 172.21.15.49:0/3385101866 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c80c2550 con 0x7fe9c8154170 2023-11-30T18:41:52.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.068+0000 7fe9cd75c700 1 -- 172.21.15.49:0/3385101866 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe9c806c7c0 con 0x7fe9c8154170 2023-11-30T18:41:52.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.069+0000 7fe9affff700 1 -- 172.21.15.49:0/3385101866 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe9bc01d7e0 con 0x7fe9c8154170 2023-11-30T18:41:52.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.069+0000 7fe9affff700 1 --2- 172.21.15.49:0/3385101866 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe9b405f270 0x7fe9b4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:52.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.069+0000 7fe9affff700 1 -- 172.21.15.49:0/3385101866 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(225..225 src has 1..225) v4 ==== 5940+0+0 (secure 0 0 0) 0x7fe9bc07af90 con 0x7fe9c8154170 2023-11-30T18:41:52.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.069+0000 7fe9c7fff700 1 --2- 172.21.15.49:0/3385101866 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe9b405f270 0x7fe9b4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:52.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.069+0000 7fe9affff700 1 --2- 172.21.15.49:0/3385101866 >> [v2:172.21.15.49:6816/90322,v1:172.21.15.49:6817/90322] conn(0x7fe9b4065cf0 0x7fe9b4068190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:52.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.069+0000 7fe9affff700 1 -- 172.21.15.49:0/3385101866 --> [v2:172.21.15.49:6816/90322,v1:172.21.15.49:6817/90322] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe9b4068810 con 0x7fe9b4065cf0 2023-11-30T18:41:52.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.069+0000 7fe9affff700 1 -- 172.21.15.49:0/3385101866 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=225) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9bc07d580 con 0x7fe9c8154170 2023-11-30T18:41:52.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.070+0000 7fe9ccf5b700 1 --2- 172.21.15.49:0/3385101866 >> [v2:172.21.15.49:6816/90322,v1:172.21.15.49:6817/90322] conn(0x7fe9b4065cf0 0x7fe9b4068190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:52.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.070+0000 7fe9c7fff700 1 --2- 172.21.15.49:0/3385101866 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe9b405f270 0x7fe9b4061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fe9b8001200 tx=0x7fe9b8001ac0).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:52.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.070+0000 7fe9ccf5b700 1 --2- 172.21.15.49:0/3385101866 >> [v2:172.21.15.49:6816/90322,v1:172.21.15.49:6817/90322] conn(0x7fe9b4065cf0 0x7fe9b4068190 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:52.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.070+0000 7fe9affff700 1 -- 172.21.15.49:0/3385101866 <== osd.3 v2:172.21.15.49:6816/90322 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fe9b4068810 con 0x7fe9b4065cf0 2023-11-30T18:41:52.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.084+0000 7fe9cd75c700 1 -- 172.21.15.49:0/3385101866 --> [v2:172.21.15.49:6816/90322,v1:172.21.15.49:6817/90322] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe9c8158a90 con 0x7fe9b4065cf0 2023-11-30T18:41:52.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.084+0000 7fe9affff700 1 -- 172.21.15.49:0/3385101866 <== osd.3 v2:172.21.15.49:6816/90322 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe9c8158a90 con 0x7fe9b4065cf0 2023-11-30T18:41:52.085 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T18:41:52.085 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-30T18:41:52.085 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T18:41:52.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.084+0000 7fe9cd75c700 1 -- 172.21.15.49:0/3385101866 >> [v2:172.21.15.49:6816/90322,v1:172.21.15.49:6817/90322] conn(0x7fe9b4065cf0 msgr2=0x7fe9b4068190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:52.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.084+0000 7fe9cd75c700 1 --2- 172.21.15.49:0/3385101866 >> [v2:172.21.15.49:6816/90322,v1:172.21.15.49:6817/90322] conn(0x7fe9b4065cf0 0x7fe9b4068190 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:52.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.084+0000 7fe9cd75c700 1 -- 172.21.15.49:0/3385101866 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe9b405f270 msgr2=0x7fe9b4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:52.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.084+0000 7fe9cd75c700 1 --2- 172.21.15.49:0/3385101866 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fe9b405f270 0x7fe9b4061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fe9b8001200 tx=0x7fe9b8001ac0).stop 2023-11-30T18:41:52.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.084+0000 7fe9cd75c700 1 -- 172.21.15.49:0/3385101866 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9c8154170 msgr2=0x7fe9c81555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:52.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.084+0000 7fe9cd75c700 1 --2- 172.21.15.49:0/3385101866 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9c8154170 0x7fe9c81555a0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 rx=0x7fe9bc009d50 tx=0x7fe9bc016000).stop 2023-11-30T18:41:52.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.084+0000 7fe9ccf5b700 1 -- 172.21.15.49:0/3385101866 reap_dead start 2023-11-30T18:41:52.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.084+0000 7fe9cd75c700 1 -- 172.21.15.49:0/3385101866 shutdown_connections 2023-11-30T18:41:52.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.084+0000 7fe9cd75c700 1 -- 172.21.15.49:0/3385101866 >> 172.21.15.49:0/3385101866 conn(0x7fe9c80cb010 msgr2=0x7fe9c80c1560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:52.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.085+0000 7fe9cd75c700 1 -- 172.21.15.49:0/3385101866 shutdown_connections 2023-11-30T18:41:52.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.085+0000 7fe9cd75c700 1 -- 172.21.15.49:0/3385101866 wait complete. 2023-11-30T18:41:52.097 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-30T18:41:52.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.215+0000 7f06dd218700 1 Processor -- start 2023-11-30T18:41:52.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.215+0000 7f06dd218700 1 -- start start 2023-11-30T18:41:52.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.216+0000 7f06dd218700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f06d8066e10 0x7f06d813b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.216+0000 7f06dd218700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06d813b920 0x7f06d80c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.216+0000 7f06dd218700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d80c75e0 con 0x7f06d8066a30 2023-11-30T18:41:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.216+0000 7f06dd218700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d80ac660 con 0x7f06d8066e10 2023-11-30T18:41:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.216+0000 7f06dd218700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d80c6d20 con 0x7f06d813b920 2023-11-30T18:41:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.216+0000 7f06d7fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f06d8066a30 0x7f06d80abf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53490/0 (socket says 172.21.15.49:53490) 2023-11-30T18:41:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.216+0000 7f06d7fff700 1 -- 172.21.15.49:0/2911629118 learned_addr learned my addr 172.21.15.49:0/2911629118 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.216+0000 7f06dca17700 1 --2- 172.21.15.49:0/2911629118 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06d813b920 0x7f06d80c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.216+0000 7f06d77fe700 1 --2- 172.21.15.49:0/2911629118 >> v2:172.21.15.115:3300/0 conn(0x7f06d8066e10 0x7f06d813b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.217+0000 7f06d6ffd700 1 -- 172.21.15.49:0/2911629118 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497225394 0 0) 0x7f06d80c75e0 con 0x7f06d8066a30 2023-11-30T18:41:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.217+0000 7f06d6ffd700 1 -- 172.21.15.49:0/2911629118 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06c00033f0 con 0x7f06d8066a30 2023-11-30T18:41:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.217+0000 7f06dca17700 1 -- 172.21.15.49:0/2911629118 >> v2:172.21.15.115:3300/0 conn(0x7f06d8066e10 msgr2=0x7f06d813b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.217+0000 7f06dca17700 1 --2- 172.21.15.49:0/2911629118 >> v2:172.21.15.115:3300/0 conn(0x7f06d8066e10 0x7f06d813b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.217+0000 7f06dca17700 1 -- 172.21.15.49:0/2911629118 >> v1:172.21.15.49:6789/0 conn(0x7f06d8066a30 legacy=0x7f06d80abf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.217+0000 7f06dca17700 1 -- 172.21.15.49:0/2911629118 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d80c6f90 con 0x7f06d813b920 2023-11-30T18:41:52.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.217+0000 7f06d77fe700 1 --2- 172.21.15.49:0/2911629118 >> v2:172.21.15.115:3300/0 conn(0x7f06d8066e10 0x7f06d813b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:41:52.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.217+0000 7f06dca17700 1 --2- 172.21.15.49:0/2911629118 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06d813b920 0x7f06d80c7a70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f06d0009e60 tx=0x7f06d0009780).ready entity=mon.2 client_cookie=e9d7564449677da7 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:52.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.217+0000 7f06d6ffd700 1 -- 172.21.15.49:0/2911629118 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d000e070 con 0x7f06d813b920 2023-11-30T18:41:52.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.217+0000 7f06d6ffd700 1 -- 172.21.15.49:0/2911629118 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d000bab0 con 0x7f06d813b920 2023-11-30T18:41:52.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.217+0000 7f06d6ffd700 1 -- 172.21.15.49:0/2911629118 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d000be30 con 0x7f06d813b920 2023-11-30T18:41:52.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.217+0000 7f06dd218700 1 -- 172.21.15.49:0/2911629118 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06d813b920 msgr2=0x7f06d80c7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:52.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.217+0000 7f06dd218700 1 --2- 172.21.15.49:0/2911629118 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06d813b920 0x7f06d80c7a70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f06d0009e60 tx=0x7f06d0009780).stop 2023-11-30T18:41:52.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.217+0000 7f06dd218700 1 -- 172.21.15.49:0/2911629118 shutdown_connections 2023-11-30T18:41:52.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.217+0000 7f06dd218700 1 --2- 172.21.15.49:0/2911629118 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06d813b920 0x7f06d80c7a70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:52.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.217+0000 7f06dd218700 1 --2- 172.21.15.49:0/2911629118 >> v2:172.21.15.115:3300/0 conn(0x7f06d8066e10 0x7f06d813b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:52.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.217+0000 7f06dd218700 1 -- 172.21.15.49:0/2911629118 >> 172.21.15.49:0/2911629118 conn(0x7f06d80c8ed0 msgr2=0x7f06d80c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:52.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.218+0000 7f06dd218700 1 -- 172.21.15.49:0/2911629118 shutdown_connections 2023-11-30T18:41:52.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.218+0000 7f06dd218700 1 -- 172.21.15.49:0/2911629118 wait complete. 2023-11-30T18:41:52.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.219+0000 7f06dd218700 1 Processor -- start 2023-11-30T18:41:52.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.219+0000 7f06dd218700 1 -- start start 2023-11-30T18:41:52.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.219+0000 7f06dd218700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06d8066a30 0x7f06d8163290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:52.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.219+0000 7f06dd218700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06d8066e10 0x7f06d8138400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:52.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.220+0000 7f06dd218700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06d813b920 0x7f06d80aaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:52.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.220+0000 7f06dd218700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d80c1030 con 0x7f06d813b920 2023-11-30T18:41:52.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.220+0000 7f06dd218700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d80a8b50 con 0x7f06d8066a30 2023-11-30T18:41:52.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.220+0000 7f06dd218700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d80c0d50 con 0x7f06d8066e10 2023-11-30T18:41:52.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.220+0000 7f06dca17700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06d813b920 0x7f06d80aaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:52.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.220+0000 7f06dca17700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06d813b920 0x7f06d80aaeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59240/0 (socket says 172.21.15.49:59240) 2023-11-30T18:41:52.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.220+0000 7f06dca17700 1 -- 172.21.15.49:0/3857759243 learned_addr learned my addr 172.21.15.49:0/3857759243 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:52.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.220+0000 7f06d7fff700 1 --2- 172.21.15.49:0/3857759243 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06d8066a30 0x7f06d8163290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:52.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.220+0000 7f06d77fe700 1 --2- 172.21.15.49:0/3857759243 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06d8066e10 0x7f06d8138400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:52.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.220+0000 7f06dca17700 1 -- 172.21.15.49:0/3857759243 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06d8066e10 msgr2=0x7f06d8138400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:52.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.220+0000 7f06dca17700 1 --2- 172.21.15.49:0/3857759243 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06d8066e10 0x7f06d8138400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:52.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.220+0000 7f06dca17700 1 -- 172.21.15.49:0/3857759243 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06d8066a30 msgr2=0x7f06d8163290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:52.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.220+0000 7f06dca17700 1 --2- 172.21.15.49:0/3857759243 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06d8066a30 0x7f06d8163290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:52.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.220+0000 7f06dca17700 1 -- 172.21.15.49:0/3857759243 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06cc0092a0 con 0x7f06d813b920 2023-11-30T18:41:52.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.220+0000 7f06d77fe700 1 --2- 172.21.15.49:0/3857759243 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06d8066e10 0x7f06d8138400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:41:52.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.220+0000 7f06d7fff700 1 --2- 172.21.15.49:0/3857759243 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06d8066a30 0x7f06d8163290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:41:52.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.220+0000 7f06dca17700 1 --2- 172.21.15.49:0/3857759243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06d813b920 0x7f06d80aaeb0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 rx=0x7f06d80c6e60 tx=0x7f06d0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:52.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.220+0000 7f06bffff700 1 -- 172.21.15.49:0/3857759243 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d0013ea0 con 0x7f06d813b920 2023-11-30T18:41:52.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.220+0000 7f06bffff700 1 -- 172.21.15.49:0/3857759243 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d001d630 con 0x7f06d813b920 2023-11-30T18:41:52.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.220+0000 7f06dd218700 1 -- 172.21.15.49:0/3857759243 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d0009a20 con 0x7f06d813b920 2023-11-30T18:41:52.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.220+0000 7f06bffff700 1 -- 172.21.15.49:0/3857759243 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d001d9f0 con 0x7f06d813b920 2023-11-30T18:41:52.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.220+0000 7f06dd218700 1 -- 172.21.15.49:0/3857759243 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d80a90d0 con 0x7f06d813b920 2023-11-30T18:41:52.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.221+0000 7f06dd218700 1 -- 172.21.15.49:0/3857759243 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d80a89b0 con 0x7f06d813b920 2023-11-30T18:41:52.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.222+0000 7f06bffff700 1 -- 172.21.15.49:0/3857759243 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f06d0003040 con 0x7f06d813b920 2023-11-30T18:41:52.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.222+0000 7f06bffff700 1 --2- 172.21.15.49:0/3857759243 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f06c405f270 0x7f06c4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:52.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.222+0000 7f06bffff700 1 -- 172.21.15.49:0/3857759243 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(225..225 src has 1..225) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f06d007c020 con 0x7f06d813b920 2023-11-30T18:41:52.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.222+0000 7f06d7fff700 1 --2- 172.21.15.49:0/3857759243 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f06c405f270 0x7f06c4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:52.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.223+0000 7f06d7fff700 1 --2- 172.21.15.49:0/3857759243 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f06c405f270 0x7f06c4061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f06c8005750 tx=0x7f06c8009040).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:52.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.226+0000 7f06bffff700 1 -- 172.21.15.49:0/3857759243 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f06d80a89b0 con 0x7f06d813b920 2023-11-30T18:41:52.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.397+0000 7f06dd218700 1 -- 172.21.15.49:0/3857759243 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f06d80a89b0 con 0x7f06c405f270 2023-11-30T18:41:52.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.398+0000 7f06bffff700 1 -- 172.21.15.49:0/3857759243 <== mgr.9772 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f06d80a89b0 con 0x7f06c405f270 2023-11-30T18:41:52.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.400+0000 7f06dd218700 1 -- 172.21.15.49:0/3857759243 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f06c405f270 msgr2=0x7f06c4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:52.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.400+0000 7f06dd218700 1 --2- 172.21.15.49:0/3857759243 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f06c405f270 0x7f06c4061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f06c8005750 tx=0x7f06c8009040).stop 2023-11-30T18:41:52.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.400+0000 7f06dd218700 1 -- 172.21.15.49:0/3857759243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06d813b920 msgr2=0x7f06d80aaeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:52.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.400+0000 7f06dd218700 1 --2- 172.21.15.49:0/3857759243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06d813b920 0x7f06d80aaeb0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 rx=0x7f06d80c6e60 tx=0x7f06d0009780).stop 2023-11-30T18:41:52.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.400+0000 7f06dd218700 1 -- 172.21.15.49:0/3857759243 shutdown_connections 2023-11-30T18:41:52.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.400+0000 7f06dd218700 1 --2- 172.21.15.49:0/3857759243 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f06c405f270 0x7f06c4061730 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:52.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.400+0000 7f06dd218700 1 --2- 172.21.15.49:0/3857759243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06d813b920 0x7f06d80aaeb0 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:52.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.400+0000 7f06dd218700 1 --2- 172.21.15.49:0/3857759243 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06d8066a30 0x7f06d8163290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:52.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.400+0000 7f06dd218700 1 --2- 172.21.15.49:0/3857759243 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06d8066e10 0x7f06d8138400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:52.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.400+0000 7f06dd218700 1 -- 172.21.15.49:0/3857759243 >> 172.21.15.49:0/3857759243 conn(0x7f06d80c8ed0 msgr2=0x7f06d80abe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:52.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.400+0000 7f06dd218700 1 -- 172.21.15.49:0/3857759243 shutdown_connections 2023-11-30T18:41:52.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.400+0000 7f06dd218700 1 -- 172.21.15.49:0/3857759243 wait complete. 2023-11-30T18:41:52.402 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 3 to deep-scrub 2023-11-30T18:41:52.412 INFO:tasks.ceph:Scrubbing osd.4 2023-11-30T18:41:52.413 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-30T18:41:52.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.533+0000 7f8058e08700 1 Processor -- start 2023-11-30T18:41:52.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.533+0000 7f8058e08700 1 -- start start 2023-11-30T18:41:52.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.534+0000 7f8058e08700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f80540ab3b0 0x7f80541582e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:52.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.534+0000 7f8058e08700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f80540aa1c0 0x7f80540aa600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:52.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.534+0000 7f8058e08700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8054159210 con 0x7f8054154610 2023-11-30T18:41:52.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.534+0000 7f8058e08700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80540c0c70 con 0x7f80540aa1c0 2023-11-30T18:41:52.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.534+0000 7f8058e08700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80540c2110 con 0x7f80540ab3b0 2023-11-30T18:41:52.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.534+0000 7f805259c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8054154610 0x7f80540c80c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53492/0 (socket says 172.21.15.49:53492) 2023-11-30T18:41:52.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.534+0000 7f805259c700 1 -- 172.21.15.49:0/917168587 learned_addr learned my addr 172.21.15.49:0/917168587 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:52.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.534+0000 7f8052d9d700 1 --2- 172.21.15.49:0/917168587 >> v2:172.21.15.49:3300/0 conn(0x7f80540aa1c0 0x7f80540aa600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:52.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.534+0000 7f8051d9b700 1 --2- 172.21.15.49:0/917168587 >> v2:172.21.15.115:3300/0 conn(0x7f80540ab3b0 0x7f80541582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:52.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.534+0000 7f805159a700 1 -- 172.21.15.49:0/917168587 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2068016153 0 0) 0x7f8054159210 con 0x7f8054154610 2023-11-30T18:41:52.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.535+0000 7f805159a700 1 -- 172.21.15.49:0/917168587 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80400033f0 con 0x7f8054154610 2023-11-30T18:41:52.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.535+0000 7f8052d9d700 1 -- 172.21.15.49:0/917168587 >> v2:172.21.15.115:3300/0 conn(0x7f80540ab3b0 msgr2=0x7f80541582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:52.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.535+0000 7f8052d9d700 1 --2- 172.21.15.49:0/917168587 >> v2:172.21.15.115:3300/0 conn(0x7f80540ab3b0 0x7f80541582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:52.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.535+0000 7f8052d9d700 1 -- 172.21.15.49:0/917168587 >> v1:172.21.15.49:6789/0 conn(0x7f8054154610 legacy=0x7f80540c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:52.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.535+0000 7f8052d9d700 1 -- 172.21.15.49:0/917168587 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80540aaaf0 con 0x7f80540aa1c0 2023-11-30T18:41:52.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.535+0000 7f8052d9d700 1 --2- 172.21.15.49:0/917168587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80540aa1c0 0x7f80540aa600 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 rx=0x7f80540c5770 tx=0x7f8044009780).ready entity=mon.0 client_cookie=4ff61432097ad25 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:52.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.535+0000 7f805159a700 1 -- 172.21.15.49:0/917168587 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804400e070 con 0x7f80540aa1c0 2023-11-30T18:41:52.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.535+0000 7f805159a700 1 -- 172.21.15.49:0/917168587 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804400bab0 con 0x7f80540aa1c0 2023-11-30T18:41:52.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.535+0000 7f805159a700 1 -- 172.21.15.49:0/917168587 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804400be30 con 0x7f80540aa1c0 2023-11-30T18:41:52.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.535+0000 7f8058e08700 1 -- 172.21.15.49:0/917168587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80540aa1c0 msgr2=0x7f80540aa600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:52.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.535+0000 7f8058e08700 1 --2- 172.21.15.49:0/917168587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80540aa1c0 0x7f80540aa600 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 rx=0x7f80540c5770 tx=0x7f8044009780).stop 2023-11-30T18:41:52.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.535+0000 7f8058e08700 1 -- 172.21.15.49:0/917168587 shutdown_connections 2023-11-30T18:41:52.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.535+0000 7f8058e08700 1 --2- 172.21.15.49:0/917168587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80540aa1c0 0x7f80540aa600 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:52.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.535+0000 7f8058e08700 1 --2- 172.21.15.49:0/917168587 >> v2:172.21.15.115:3300/0 conn(0x7f80540ab3b0 0x7f80541582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:52.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.535+0000 7f8058e08700 1 -- 172.21.15.49:0/917168587 >> 172.21.15.49:0/917168587 conn(0x7f80540655a0 msgr2=0x7f8054069e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:52.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.536+0000 7f8058e08700 1 -- 172.21.15.49:0/917168587 shutdown_connections 2023-11-30T18:41:52.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.536+0000 7f8058e08700 1 -- 172.21.15.49:0/917168587 wait complete. 2023-11-30T18:41:52.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.537+0000 7f8058e08700 1 Processor -- start 2023-11-30T18:41:52.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.537+0000 7f8058e08700 1 -- start start 2023-11-30T18:41:52.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.537+0000 7f8058e08700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80540aa1c0 0x7f8054164fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:52.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.537+0000 7f8058e08700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8054154610 0x7f8054163c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:52.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.537+0000 7f8058e08700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8054164120 0x7f805415a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:52.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.537+0000 7f8058e08700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80541559a0 con 0x7f8054154610 2023-11-30T18:41:52.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.537+0000 7f8058e08700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80541654c0 con 0x7f80540aa1c0 2023-11-30T18:41:52.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.537+0000 7f8058e08700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8054154d90 con 0x7f8054164120 2023-11-30T18:41:52.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.538+0000 7f8051d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8054154610 0x7f8054163c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:52.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.538+0000 7f8051d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8054154610 0x7f8054163c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59252/0 (socket says 172.21.15.49:59252) 2023-11-30T18:41:52.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.538+0000 7f8051d9b700 1 -- 172.21.15.49:0/3171346242 learned_addr learned my addr 172.21.15.49:0/3171346242 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:52.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.538+0000 7f805259c700 1 --2- 172.21.15.49:0/3171346242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80540aa1c0 0x7f8054164fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:52.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.538+0000 7f8052d9d700 1 --2- 172.21.15.49:0/3171346242 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8054164120 0x7f805415a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:52.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.538+0000 7f8051d9b700 1 -- 172.21.15.49:0/3171346242 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8054164120 msgr2=0x7f805415a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:52.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.538+0000 7f8051d9b700 1 --2- 172.21.15.49:0/3171346242 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8054164120 0x7f805415a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:52.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.538+0000 7f8051d9b700 1 -- 172.21.15.49:0/3171346242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80540aa1c0 msgr2=0x7f8054164fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:52.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.538+0000 7f8051d9b700 1 --2- 172.21.15.49:0/3171346242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80540aa1c0 0x7f8054164fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:52.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.538+0000 7f8051d9b700 1 -- 172.21.15.49:0/3171346242 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8044009a20 con 0x7f8054154610 2023-11-30T18:41:52.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.538+0000 7f805259c700 1 --2- 172.21.15.49:0/3171346242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80540aa1c0 0x7f8054164fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:41:52.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.538+0000 7f8051d9b700 1 --2- 172.21.15.49:0/3171346242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8054154610 0x7f8054163c30 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 rx=0x7f803c00e900 tx=0x7f803c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:52.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.538+0000 7f804a7fc700 1 -- 172.21.15.49:0/3171346242 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c012600 con 0x7f8054154610 2023-11-30T18:41:52.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.538+0000 7f804a7fc700 1 -- 172.21.15.49:0/3171346242 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803c012760 con 0x7f8054154610 2023-11-30T18:41:52.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.538+0000 7f8058e08700 1 -- 172.21.15.49:0/3171346242 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8054155070 con 0x7f8054154610 2023-11-30T18:41:52.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.538+0000 7f804a7fc700 1 -- 172.21.15.49:0/3171346242 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c012ae0 con 0x7f8054154610 2023-11-30T18:41:52.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.538+0000 7f8058e08700 1 -- 172.21.15.49:0/3171346242 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8054155630 con 0x7f8054154610 2023-11-30T18:41:52.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.539+0000 7f8058e08700 1 -- 172.21.15.49:0/3171346242 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f805406c860 con 0x7f8054154610 2023-11-30T18:41:52.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.540+0000 7f804a7fc700 1 -- 172.21.15.49:0/3171346242 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f803c01b400 con 0x7f8054154610 2023-11-30T18:41:52.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.540+0000 7f804a7fc700 1 --2- 172.21.15.49:0/3171346242 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f803405f240 0x7f8034061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:52.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.540+0000 7f804a7fc700 1 -- 172.21.15.49:0/3171346242 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(225..225 src has 1..225) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f803c07a760 con 0x7f8054154610 2023-11-30T18:41:52.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.540+0000 7f804a7fc700 1 --2- 172.21.15.49:0/3171346242 >> [v2:172.21.15.115:6800/90553,v1:172.21.15.115:6801/90553] conn(0x7f8034065cc0 0x7f8034068160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:52.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.540+0000 7f805259c700 1 --2- 172.21.15.49:0/3171346242 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f803405f240 0x7f8034061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:52.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.540+0000 7f804a7fc700 1 -- 172.21.15.49:0/3171346242 --> [v2:172.21.15.115:6800/90553,v1:172.21.15.115:6801/90553] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f80340687e0 con 0x7f8034065cc0 2023-11-30T18:41:52.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.540+0000 7f804a7fc700 1 -- 172.21.15.49:0/3171346242 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=225) v2 ==== 24+0+0 (secure 0 0 0) 0x7f803c07cdb0 con 0x7f8054154610 2023-11-30T18:41:52.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.540+0000 7f8052d9d700 1 --2- 172.21.15.49:0/3171346242 >> [v2:172.21.15.115:6800/90553,v1:172.21.15.115:6801/90553] conn(0x7f8034065cc0 0x7f8034068160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:52.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.540+0000 7f805259c700 1 --2- 172.21.15.49:0/3171346242 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f803405f240 0x7f8034061700 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f804c005750 tx=0x7f804c009040).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:52.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.541+0000 7f8052d9d700 1 --2- 172.21.15.49:0/3171346242 >> [v2:172.21.15.115:6800/90553,v1:172.21.15.115:6801/90553] conn(0x7f8034065cc0 0x7f8034068160 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:52.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.541+0000 7f804a7fc700 1 -- 172.21.15.49:0/3171346242 <== osd.4 v2:172.21.15.115:6800/90553 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f80340687e0 con 0x7f8034065cc0 2023-11-30T18:41:52.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.555+0000 7f8058e08700 1 -- 172.21.15.49:0/3171346242 --> [v2:172.21.15.115:6800/90553,v1:172.21.15.115:6801/90553] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f80540b03b0 con 0x7f8034065cc0 2023-11-30T18:41:52.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.555+0000 7f804a7fc700 1 -- 172.21.15.49:0/3171346242 <== osd.4 v2:172.21.15.115:6800/90553 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f80540b03b0 con 0x7f8034065cc0 2023-11-30T18:41:52.556 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T18:41:52.556 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-30T18:41:52.556 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T18:41:52.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.555+0000 7f8058e08700 1 -- 172.21.15.49:0/3171346242 >> [v2:172.21.15.115:6800/90553,v1:172.21.15.115:6801/90553] conn(0x7f8034065cc0 msgr2=0x7f8034068160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:52.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.555+0000 7f8058e08700 1 --2- 172.21.15.49:0/3171346242 >> [v2:172.21.15.115:6800/90553,v1:172.21.15.115:6801/90553] conn(0x7f8034065cc0 0x7f8034068160 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:52.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.555+0000 7f8058e08700 1 -- 172.21.15.49:0/3171346242 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f803405f240 msgr2=0x7f8034061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:52.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.555+0000 7f8058e08700 1 --2- 172.21.15.49:0/3171346242 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f803405f240 0x7f8034061700 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f804c005750 tx=0x7f804c009040).stop 2023-11-30T18:41:52.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.555+0000 7f8058e08700 1 -- 172.21.15.49:0/3171346242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8054154610 msgr2=0x7f8054163c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:52.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.555+0000 7f8058e08700 1 --2- 172.21.15.49:0/3171346242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8054154610 0x7f8054163c30 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 rx=0x7f803c00e900 tx=0x7f803c009060).stop 2023-11-30T18:41:52.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.555+0000 7f8052d9d700 1 -- 172.21.15.49:0/3171346242 reap_dead start 2023-11-30T18:41:52.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.555+0000 7f8058e08700 1 -- 172.21.15.49:0/3171346242 shutdown_connections 2023-11-30T18:41:52.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.555+0000 7f8058e08700 1 -- 172.21.15.49:0/3171346242 >> 172.21.15.49:0/3171346242 conn(0x7f80540655a0 msgr2=0x7f8054063880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:52.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.555+0000 7f8058e08700 1 -- 172.21.15.49:0/3171346242 shutdown_connections 2023-11-30T18:41:52.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.555+0000 7f8058e08700 1 -- 172.21.15.49:0/3171346242 wait complete. 2023-11-30T18:41:52.567 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-30T18:41:52.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.685+0000 7f0da7dc9700 1 Processor -- start 2023-11-30T18:41:52.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.685+0000 7f0da7dc9700 1 -- start start 2023-11-30T18:41:52.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.686+0000 7f0da7dc9700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0da014ed10 0x7f0da00a8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:52.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.686+0000 7f0da7dc9700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0da0067770 con 0x7f0da0158160 2023-11-30T18:41:52.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.686+0000 7f0da7dc9700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0da00be8d0 con 0x7f0da00a8280 2023-11-30T18:41:52.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.686+0000 7f0da7dc9700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da0159180 con 0x7f0da014ed10 2023-11-30T18:41:52.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.686+0000 7f0da5364700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0da0158160 0x7f0da014e600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53506/0 (socket says 172.21.15.49:53506) 2023-11-30T18:41:52.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.686+0000 7f0da5364700 1 -- 172.21.15.49:0/3695691110 learned_addr learned my addr 172.21.15.49:0/3695691110 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:52.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.686+0000 7f0da6366700 1 --2- 172.21.15.49:0/3695691110 >> v2:172.21.15.115:3300/0 conn(0x7f0da014ed10 0x7f0da00a8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:52.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.686+0000 7f0da4b63700 1 -- 172.21.15.49:0/3695691110 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1387739115 0 0) 0x7f0da0067770 con 0x7f0da0158160 2023-11-30T18:41:52.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.687+0000 7f0da4b63700 1 -- 172.21.15.49:0/3695691110 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d880033f0 con 0x7f0da0158160 2023-11-30T18:41:52.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.687+0000 7f0da4b63700 1 -- 172.21.15.49:0/3695691110 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 226693610 0 0) 0x7f0da00be8d0 con 0x7f0da00a8280 2023-11-30T18:41:52.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.687+0000 7f0da4b63700 1 -- 172.21.15.49:0/3695691110 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0da0067770 con 0x7f0da00a8280 2023-11-30T18:41:52.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.687+0000 7f0da6366700 1 -- 172.21.15.49:0/3695691110 >> v1:172.21.15.115:6789/0 conn(0x7f0da00a8280 legacy=0x7f0da0155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:52.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.687+0000 7f0da6366700 1 -- 172.21.15.49:0/3695691110 >> v1:172.21.15.49:6789/0 conn(0x7f0da0158160 legacy=0x7f0da014e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:52.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.687+0000 7f0da6366700 1 -- 172.21.15.49:0/3695691110 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da0158600 con 0x7f0da014ed10 2023-11-30T18:41:52.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.687+0000 7f0da6366700 1 --2- 172.21.15.49:0/3695691110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0da014ed10 0x7f0da00a8660 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7f0d90009e60 tx=0x7f0d90009780).ready entity=mon.1 client_cookie=c45b6ce48b29c174 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:52.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.687+0000 7f0da4b63700 1 -- 172.21.15.49:0/3695691110 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9000e070 con 0x7f0da014ed10 2023-11-30T18:41:52.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.687+0000 7f0da4b63700 1 -- 172.21.15.49:0/3695691110 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9000bab0 con 0x7f0da014ed10 2023-11-30T18:41:52.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.687+0000 7f0da4b63700 1 -- 172.21.15.49:0/3695691110 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9000be30 con 0x7f0da014ed10 2023-11-30T18:41:52.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.687+0000 7f0da7dc9700 1 -- 172.21.15.49:0/3695691110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0da014ed10 msgr2=0x7f0da00a8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:52.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.687+0000 7f0da7dc9700 1 --2- 172.21.15.49:0/3695691110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0da014ed10 0x7f0da00a8660 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7f0d90009e60 tx=0x7f0d90009780).stop 2023-11-30T18:41:52.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.687+0000 7f0da7dc9700 1 -- 172.21.15.49:0/3695691110 shutdown_connections 2023-11-30T18:41:52.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.687+0000 7f0da7dc9700 1 --2- 172.21.15.49:0/3695691110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0da014ed10 0x7f0da00a8660 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:52.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.687+0000 7f0da7dc9700 1 -- 172.21.15.49:0/3695691110 >> 172.21.15.49:0/3695691110 conn(0x7f0da0062700 msgr2=0x7f0da0062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:52.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.687+0000 7f0da7dc9700 1 -- 172.21.15.49:0/3695691110 shutdown_connections 2023-11-30T18:41:52.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.687+0000 7f0da7dc9700 1 -- 172.21.15.49:0/3695691110 wait complete. 2023-11-30T18:41:52.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.689+0000 7f0da7dc9700 1 Processor -- start 2023-11-30T18:41:52.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.689+0000 7f0da7dc9700 1 -- start start 2023-11-30T18:41:52.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.689+0000 7f0da7dc9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0da00a8280 0x7f0da014e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:52.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.689+0000 7f0da7dc9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0da014ed10 0x7f0da014d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:52.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.689+0000 7f0da7dc9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da0158160 0x7f0da00aaed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:52.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.689+0000 7f0da7dc9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da0155d20 con 0x7f0da0158160 2023-11-30T18:41:52.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.689+0000 7f0da7dc9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da01562a0 con 0x7f0da014ed10 2023-11-30T18:41:52.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.689+0000 7f0da7dc9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da014da70 con 0x7f0da00a8280 2023-11-30T18:41:52.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.689+0000 7f0da6366700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da0158160 0x7f0da00aaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:52.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.689+0000 7f0da6366700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da0158160 0x7f0da00aaed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59264/0 (socket says 172.21.15.49:59264) 2023-11-30T18:41:52.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.689+0000 7f0da6366700 1 -- 172.21.15.49:0/1273911872 learned_addr learned my addr 172.21.15.49:0/1273911872 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:52.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.689+0000 7f0da5b65700 1 --2- 172.21.15.49:0/1273911872 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0da00a8280 0x7f0da014e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:52.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.689+0000 7f0da5364700 1 --2- 172.21.15.49:0/1273911872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0da014ed10 0x7f0da014d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:52.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.690+0000 7f0da6366700 1 -- 172.21.15.49:0/1273911872 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0da00a8280 msgr2=0x7f0da014e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:52.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.690+0000 7f0da6366700 1 --2- 172.21.15.49:0/1273911872 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0da00a8280 0x7f0da014e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:52.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.690+0000 7f0da6366700 1 -- 172.21.15.49:0/1273911872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0da014ed10 msgr2=0x7f0da014d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:52.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.690+0000 7f0da6366700 1 --2- 172.21.15.49:0/1273911872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0da014ed10 0x7f0da014d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:52.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.690+0000 7f0da6366700 1 -- 172.21.15.49:0/1273911872 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d90009a20 con 0x7f0da0158160 2023-11-30T18:41:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.690+0000 7f0da6366700 1 --2- 172.21.15.49:0/1273911872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da0158160 0x7f0da00aaed0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 rx=0x7f0d90012cb0 tx=0x7f0da00bea60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.690+0000 7f0d9dffb700 1 -- 172.21.15.49:0/1273911872 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d90012e90 con 0x7f0da0158160 2023-11-30T18:41:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.690+0000 7f0d9dffb700 1 -- 172.21.15.49:0/1273911872 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9001d630 con 0x7f0da0158160 2023-11-30T18:41:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.690+0000 7f0da7dc9700 1 -- 172.21.15.49:0/1273911872 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da00ab7b0 con 0x7f0da0158160 2023-11-30T18:41:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.690+0000 7f0d9dffb700 1 -- 172.21.15.49:0/1273911872 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9001d9b0 con 0x7f0da0158160 2023-11-30T18:41:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.690+0000 7f0da7dc9700 1 -- 172.21.15.49:0/1273911872 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0da0155f30 con 0x7f0da0158160 2023-11-30T18:41:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.691+0000 7f0da7dc9700 1 -- 172.21.15.49:0/1273911872 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0da0156430 con 0x7f0da0158160 2023-11-30T18:41:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.692+0000 7f0d9dffb700 1 -- 172.21.15.49:0/1273911872 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0d9001dd20 con 0x7f0da0158160 2023-11-30T18:41:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.692+0000 7f0d9dffb700 1 --2- 172.21.15.49:0/1273911872 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0d8c05f270 0x7f0d8c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.692+0000 7f0d9dffb700 1 -- 172.21.15.49:0/1273911872 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(225..225 src has 1..225) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f0d9007bfb0 con 0x7f0da0158160 2023-11-30T18:41:52.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.692+0000 7f0da5b65700 1 --2- 172.21.15.49:0/1273911872 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0d8c05f270 0x7f0d8c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:52.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.692+0000 7f0da5b65700 1 --2- 172.21.15.49:0/1273911872 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0d8c05f270 0x7f0d8c061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f0d98003890 tx=0x7f0d98007bd0).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:52.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.696+0000 7f0d9dffb700 1 -- 172.21.15.49:0/1273911872 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0d900aab00 con 0x7f0da0158160 2023-11-30T18:41:52.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.869+0000 7f0da7dc9700 1 -- 172.21.15.49:0/1273911872 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f0da006c860 con 0x7f0d8c05f270 2023-11-30T18:41:52.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.869+0000 7f0d9dffb700 1 -- 172.21.15.49:0/1273911872 <== mgr.9772 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0da006c860 con 0x7f0d8c05f270 2023-11-30T18:41:52.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.871+0000 7f0da7dc9700 1 -- 172.21.15.49:0/1273911872 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0d8c05f270 msgr2=0x7f0d8c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:52.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.871+0000 7f0da7dc9700 1 --2- 172.21.15.49:0/1273911872 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0d8c05f270 0x7f0d8c061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f0d98003890 tx=0x7f0d98007bd0).stop 2023-11-30T18:41:52.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.871+0000 7f0da7dc9700 1 -- 172.21.15.49:0/1273911872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da0158160 msgr2=0x7f0da00aaed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:52.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.871+0000 7f0da7dc9700 1 --2- 172.21.15.49:0/1273911872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da0158160 0x7f0da00aaed0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 rx=0x7f0d90012cb0 tx=0x7f0da00bea60).stop 2023-11-30T18:41:52.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.871+0000 7f0da7dc9700 1 -- 172.21.15.49:0/1273911872 shutdown_connections 2023-11-30T18:41:52.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.871+0000 7f0da7dc9700 1 --2- 172.21.15.49:0/1273911872 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0d8c05f270 0x7f0d8c061730 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:52.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.871+0000 7f0da7dc9700 1 --2- 172.21.15.49:0/1273911872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da0158160 0x7f0da00aaed0 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:52.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.871+0000 7f0da7dc9700 1 --2- 172.21.15.49:0/1273911872 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0da00a8280 0x7f0da014e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:52.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.871+0000 7f0da7dc9700 1 --2- 172.21.15.49:0/1273911872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0da014ed10 0x7f0da014d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:52.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.871+0000 7f0da7dc9700 1 -- 172.21.15.49:0/1273911872 >> 172.21.15.49:0/1273911872 conn(0x7f0da0062700 msgr2=0x7f0da00becb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:52.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.871+0000 7f0da7dc9700 1 -- 172.21.15.49:0/1273911872 shutdown_connections 2023-11-30T18:41:52.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:52.871+0000 7f0da7dc9700 1 -- 172.21.15.49:0/1273911872 wait complete. 2023-11-30T18:41:52.873 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 4 to deep-scrub 2023-11-30T18:41:52.884 INFO:tasks.ceph:Scrubbing osd.5 2023-11-30T18:41:52.884 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-30T18:41:53.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.005+0000 7faac5bde700 1 Processor -- start 2023-11-30T18:41:53.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.005+0000 7faac5bde700 1 -- start start 2023-11-30T18:41:53.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.006+0000 7faac5bde700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faac01373a0 0x7faac00c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.006+0000 7faac5bde700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac0158e20 con 0x7faac0064b00 2023-11-30T18:41:53.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.006+0000 7faac5bde700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac00677c0 con 0x7faac00c5f30 2023-11-30T18:41:53.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.006+0000 7faac5bde700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac01582a0 con 0x7faac01373a0 2023-11-30T18:41:53.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.006+0000 7faabffff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7faac0064b00 0x7faac00670b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53516/0 (socket says 172.21.15.49:53516) 2023-11-30T18:41:53.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.006+0000 7faabffff700 1 -- 172.21.15.49:0/2885121250 learned_addr learned my addr 172.21.15.49:0/2885121250 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:53.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.006+0000 7faabe7fc700 1 -- 172.21.15.49:0/2885121250 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 776161745 0 0) 0x7faac0158e20 con 0x7faac0064b00 2023-11-30T18:41:53.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.007+0000 7faabf7fe700 1 --2- 172.21.15.49:0/2885121250 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faac01373a0 0x7faac00c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.007+0000 7faabe7fc700 1 -- 172.21.15.49:0/2885121250 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaa80033f0 con 0x7faac0064b00 2023-11-30T18:41:53.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.007+0000 7faabe7fc700 1 -- 172.21.15.49:0/2885121250 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 441026447 0 0) 0x7faaa80033f0 con 0x7faac0064b00 2023-11-30T18:41:53.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.007+0000 7faabe7fc700 1 -- 172.21.15.49:0/2885121250 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faac01373a0 msgr2=0x7faac00c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:53.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.007+0000 7faabe7fc700 1 --2- 172.21.15.49:0/2885121250 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faac01373a0 0x7faac00c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.007+0000 7faabe7fc700 1 -- 172.21.15.49:0/2885121250 >> v1:172.21.15.115:6789/0 conn(0x7faac00c5f30 legacy=0x7faac00669a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.007+0000 7faabe7fc700 1 -- 172.21.15.49:0/2885121250 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac0158580 con 0x7faac0064b00 2023-11-30T18:41:53.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.007+0000 7faabe7fc700 1 -- 172.21.15.49:0/2885121250 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7faab80017f0 con 0x7faac0064b00 2023-11-30T18:41:53.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.007+0000 7faabe7fc700 1 -- 172.21.15.49:0/2885121250 >> v1:172.21.15.49:6789/0 conn(0x7faac0064b00 legacy=0x7faac00670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.007+0000 7faabe7fc700 1 --2- 172.21.15.49:0/2885121250 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faac01373a0 0x7faaa8003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.007+0000 7faabe7fc700 1 --2- 172.21.15.49:0/2885121250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faaa8003e00 0x7faaa8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.007+0000 7faabe7fc700 1 --2- 172.21.15.49:0/2885121250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faaa8004b80 0x7faaa8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.007+0000 7faabe7fc700 1 -- 172.21.15.49:0/2885121250 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac01582a0 con 0x7faaa8004b80 2023-11-30T18:41:53.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.007+0000 7faabe7fc700 1 -- 172.21.15.49:0/2885121250 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa800b8e0 con 0x7faaa8003e00 2023-11-30T18:41:53.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.007+0000 7faabe7fc700 1 -- 172.21.15.49:0/2885121250 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa800baa0 con 0x7faac01373a0 2023-11-30T18:41:53.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.007+0000 7faabffff700 1 --2- 172.21.15.49:0/2885121250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faaa8004b80 0x7faaa8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.007+0000 7faabf7fe700 1 --2- 172.21.15.49:0/2885121250 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faac01373a0 0x7faaa8003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.007+0000 7faabeffd700 1 --2- 172.21.15.49:0/2885121250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faaa8003e00 0x7faaa8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.007+0000 7faabffff700 1 -- 172.21.15.49:0/2885121250 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faac01373a0 msgr2=0x7faaa8003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:53.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.007+0000 7faabffff700 1 --2- 172.21.15.49:0/2885121250 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faac01373a0 0x7faaa8003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.007+0000 7faabffff700 1 -- 172.21.15.49:0/2885121250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faaa8003e00 msgr2=0x7faaa8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:53.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.007+0000 7faabffff700 1 --2- 172.21.15.49:0/2885121250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faaa8003e00 0x7faaa8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.007+0000 7faabffff700 1 -- 172.21.15.49:0/2885121250 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa80033f0 con 0x7faaa8004b80 2023-11-30T18:41:53.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.007+0000 7faabf7fe700 1 --2- 172.21.15.49:0/2885121250 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faac01373a0 0x7faaa8003910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:41:53.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.007+0000 7faabffff700 1 --2- 172.21.15.49:0/2885121250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faaa8004b80 0x7faaa8005000 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 rx=0x7faab800c5c0 tx=0x7faab8001d90).ready entity=mon.0 client_cookie=880ed550eb747385 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:53.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.008+0000 7faabe7fc700 1 -- 172.21.15.49:0/2885121250 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab800ce90 con 0x7faaa8004b80 2023-11-30T18:41:53.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.008+0000 7faabe7fc700 1 -- 172.21.15.49:0/2885121250 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab8001fc0 con 0x7faaa8004b80 2023-11-30T18:41:53.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.008+0000 7faabe7fc700 1 -- 172.21.15.49:0/2885121250 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab8005d50 con 0x7faaa8004b80 2023-11-30T18:41:53.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.008+0000 7faac5bde700 1 -- 172.21.15.49:0/2885121250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faaa8004b80 msgr2=0x7faaa8005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.008+0000 7faac5bde700 1 --2- 172.21.15.49:0/2885121250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faaa8004b80 0x7faaa8005000 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 rx=0x7faab800c5c0 tx=0x7faab8001d90).stop 2023-11-30T18:41:53.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.008+0000 7faabffff700 1 -- 172.21.15.49:0/2885121250 reap_dead start 2023-11-30T18:41:53.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.008+0000 7faac5bde700 1 -- 172.21.15.49:0/2885121250 shutdown_connections 2023-11-30T18:41:53.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.008+0000 7faac5bde700 1 -- 172.21.15.49:0/2885121250 >> 172.21.15.49:0/2885121250 conn(0x7faac00628f0 msgr2=0x7faac0062d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:53.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.008+0000 7faac5bde700 1 -- 172.21.15.49:0/2885121250 shutdown_connections 2023-11-30T18:41:53.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.008+0000 7faac5bde700 1 -- 172.21.15.49:0/2885121250 wait complete. 2023-11-30T18:41:53.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.009+0000 7faac5bde700 1 Processor -- start 2023-11-30T18:41:53.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.010+0000 7faac5bde700 1 -- start start 2023-11-30T18:41:53.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.010+0000 7faac5bde700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faac014da70 0x7faac0155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.010+0000 7faac5bde700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faac0154df0 0x7faac00ab360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.010+0000 7faac5bde700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faac014de50 0x7faac0152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.010+0000 7faac5bde700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac00aa070 con 0x7faac014da70 2023-11-30T18:41:53.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.010+0000 7faac5bde700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac00aaed0 con 0x7faac014de50 2023-11-30T18:41:53.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.010+0000 7faac5bde700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac00aa2c0 con 0x7faac0154df0 2023-11-30T18:41:53.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.010+0000 7faabf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faac014da70 0x7faac0155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.010+0000 7faabf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faac014da70 0x7faac0155320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59286/0 (socket says 172.21.15.49:59286) 2023-11-30T18:41:53.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.010+0000 7faabf7fe700 1 -- 172.21.15.49:0/498804117 learned_addr learned my addr 172.21.15.49:0/498804117 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:53.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.011+0000 7faabeffd700 1 --2- 172.21.15.49:0/498804117 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faac0154df0 0x7faac00ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.011+0000 7faabffff700 1 --2- 172.21.15.49:0/498804117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faac014de50 0x7faac0152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.011+0000 7faabf7fe700 1 -- 172.21.15.49:0/498804117 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faac0154df0 msgr2=0x7faac00ab360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.011+0000 7faabf7fe700 1 --2- 172.21.15.49:0/498804117 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faac0154df0 0x7faac00ab360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.011+0000 7faabf7fe700 1 -- 172.21.15.49:0/498804117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faac014de50 msgr2=0x7faac0152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.011+0000 7faabf7fe700 1 --2- 172.21.15.49:0/498804117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faac014de50 0x7faac0152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.011+0000 7faabf7fe700 1 -- 172.21.15.49:0/498804117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac00aa5a0 con 0x7faac014da70 2023-11-30T18:41:53.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.011+0000 7faabffff700 1 --2- 172.21.15.49:0/498804117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faac014de50 0x7faac0152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:41:53.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.011+0000 7faabf7fe700 1 --2- 172.21.15.49:0/498804117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faac014da70 0x7faac0155320 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 rx=0x7faab0011b10 tx=0x7faab0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:53.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.011+0000 7faaa77fe700 1 -- 172.21.15.49:0/498804117 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab000f9f0 con 0x7faac014da70 2023-11-30T18:41:53.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.011+0000 7faaa77fe700 1 -- 172.21.15.49:0/498804117 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab000fb50 con 0x7faac014da70 2023-11-30T18:41:53.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.011+0000 7faac5bde700 1 -- 172.21.15.49:0/498804117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac00aa880 con 0x7faac014da70 2023-11-30T18:41:53.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.011+0000 7faaa77fe700 1 -- 172.21.15.49:0/498804117 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab000fed0 con 0x7faac014da70 2023-11-30T18:41:53.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.011+0000 7faac5bde700 1 -- 172.21.15.49:0/498804117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac0155810 con 0x7faac014da70 2023-11-30T18:41:53.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.012+0000 7faac5bde700 1 -- 172.21.15.49:0/498804117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faac006c860 con 0x7faac014da70 2023-11-30T18:41:53.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.013+0000 7faaa77fe700 1 -- 172.21.15.49:0/498804117 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7faab0014650 con 0x7faac014da70 2023-11-30T18:41:53.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.013+0000 7faaa77fe700 1 --2- 172.21.15.49:0/498804117 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7faaac05f270 0x7faaac061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.013+0000 7faaa77fe700 1 -- 172.21.15.49:0/498804117 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(225..225 src has 1..225) v4 ==== 5940+0+0 (secure 0 0 0) 0x7faab007b3c0 con 0x7faac014da70 2023-11-30T18:41:53.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.013+0000 7faabeffd700 1 --2- 172.21.15.49:0/498804117 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7faaac05f270 0x7faaac061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.013+0000 7faaa77fe700 1 --2- 172.21.15.49:0/498804117 >> [v2:172.21.15.115:6808/90554,v1:172.21.15.115:6811/90554] conn(0x7faaac065b80 0x7faaac068020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.013+0000 7faaa77fe700 1 -- 172.21.15.49:0/498804117 --> [v2:172.21.15.115:6808/90554,v1:172.21.15.115:6811/90554] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faaac0686a0 con 0x7faaac065b80 2023-11-30T18:41:53.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.013+0000 7faaa77fe700 1 -- 172.21.15.49:0/498804117 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=225) v2 ==== 24+0+0 (secure 0 0 0) 0x7faab007b7a0 con 0x7faac014da70 2023-11-30T18:41:53.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.013+0000 7faabffff700 1 --2- 172.21.15.49:0/498804117 >> [v2:172.21.15.115:6808/90554,v1:172.21.15.115:6811/90554] conn(0x7faaac065b80 0x7faaac068020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.013+0000 7faabeffd700 1 --2- 172.21.15.49:0/498804117 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7faaac05f270 0x7faaac061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7faab4000c00 tx=0x7faab4009040).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:53.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.014+0000 7faabffff700 1 --2- 172.21.15.49:0/498804117 >> [v2:172.21.15.115:6808/90554,v1:172.21.15.115:6811/90554] conn(0x7faaac065b80 0x7faaac068020 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:53.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.014+0000 7faaa77fe700 1 -- 172.21.15.49:0/498804117 <== osd.5 v2:172.21.15.115:6808/90554 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7faaac0686a0 con 0x7faaac065b80 2023-11-30T18:41:53.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.027+0000 7faac5bde700 1 -- 172.21.15.49:0/498804117 --> [v2:172.21.15.115:6808/90554,v1:172.21.15.115:6811/90554] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7faac00ab1b0 con 0x7faaac065b80 2023-11-30T18:41:53.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.028+0000 7faaa77fe700 1 -- 172.21.15.49:0/498804117 <== osd.5 v2:172.21.15.115:6808/90554 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7faac00ab1b0 con 0x7faaac065b80 2023-11-30T18:41:53.030 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T18:41:53.030 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-30T18:41:53.031 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T18:41:53.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.028+0000 7faac5bde700 1 -- 172.21.15.49:0/498804117 >> [v2:172.21.15.115:6808/90554,v1:172.21.15.115:6811/90554] conn(0x7faaac065b80 msgr2=0x7faaac068020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.028+0000 7faac5bde700 1 --2- 172.21.15.49:0/498804117 >> [v2:172.21.15.115:6808/90554,v1:172.21.15.115:6811/90554] conn(0x7faaac065b80 0x7faaac068020 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.028+0000 7faac5bde700 1 -- 172.21.15.49:0/498804117 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7faaac05f270 msgr2=0x7faaac061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.028+0000 7faac5bde700 1 --2- 172.21.15.49:0/498804117 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7faaac05f270 0x7faaac061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7faab4000c00 tx=0x7faab4009040).stop 2023-11-30T18:41:53.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.028+0000 7faac5bde700 1 -- 172.21.15.49:0/498804117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faac014da70 msgr2=0x7faac0155320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.028+0000 7faac5bde700 1 --2- 172.21.15.49:0/498804117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faac014da70 0x7faac0155320 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 rx=0x7faab0011b10 tx=0x7faab0009060).stop 2023-11-30T18:41:53.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.028+0000 7faabffff700 1 -- 172.21.15.49:0/498804117 reap_dead start 2023-11-30T18:41:53.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.028+0000 7faac5bde700 1 -- 172.21.15.49:0/498804117 shutdown_connections 2023-11-30T18:41:53.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.028+0000 7faac5bde700 1 -- 172.21.15.49:0/498804117 >> 172.21.15.49:0/498804117 conn(0x7faac00628f0 msgr2=0x7faac00c6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:53.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.029+0000 7faac5bde700 1 -- 172.21.15.49:0/498804117 shutdown_connections 2023-11-30T18:41:53.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.029+0000 7faac5bde700 1 -- 172.21.15.49:0/498804117 wait complete. 2023-11-30T18:41:53.041 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-30T18:41:53.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.161+0000 7f1e50bcb700 1 Processor -- start 2023-11-30T18:41:53.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.161+0000 7f1e50bcb700 1 -- start start 2023-11-30T18:41:53.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.162+0000 7f1e50bcb700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1e4c098d10 0x7f1e4c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.162+0000 7f1e50bcb700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e4c0c72d0 con 0x7f1e4c0c6190 2023-11-30T18:41:53.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.162+0000 7f1e50bcb700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e4c064570 con 0x7f1e4c158320 2023-11-30T18:41:53.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.162+0000 7f1e50bcb700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e4c154bc0 con 0x7f1e4c098d10 2023-11-30T18:41:53.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.162+0000 7f1e49d9b700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1e4c0c6190 0x7f1e4c063e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53522/0 (socket says 172.21.15.49:53522) 2023-11-30T18:41:53.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.162+0000 7f1e49d9b700 1 -- 172.21.15.49:0/3449759705 learned_addr learned my addr 172.21.15.49:0/3449759705 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:53.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.163+0000 7f1e4a59c700 1 --2- 172.21.15.49:0/3449759705 >> v2:172.21.15.115:3300/0 conn(0x7f1e4c098d10 0x7f1e4c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.163+0000 7f1e4959a700 1 -- 172.21.15.49:0/3449759705 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 925376277 0 0) 0x7f1e4c0c72d0 con 0x7f1e4c0c6190 2023-11-30T18:41:53.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.163+0000 7f1e4959a700 1 -- 172.21.15.49:0/3449759705 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e380033f0 con 0x7f1e4c0c6190 2023-11-30T18:41:53.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.163+0000 7f1e4959a700 1 -- 172.21.15.49:0/3449759705 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967422393 0 0) 0x7f1e4c064570 con 0x7f1e4c158320 2023-11-30T18:41:53.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.163+0000 7f1e4959a700 1 -- 172.21.15.49:0/3449759705 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e4c0c72d0 con 0x7f1e4c158320 2023-11-30T18:41:53.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.163+0000 7f1e4a59c700 1 -- 172.21.15.49:0/3449759705 >> v1:172.21.15.115:6789/0 conn(0x7f1e4c158320 legacy=0x7f1e4c0a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.163+0000 7f1e4959a700 1 -- 172.21.15.49:0/3449759705 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3196489469 0 0) 0x7f1e380033f0 con 0x7f1e4c0c6190 2023-11-30T18:41:53.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.163+0000 7f1e4a59c700 1 -- 172.21.15.49:0/3449759705 >> v1:172.21.15.49:6789/0 conn(0x7f1e4c0c6190 legacy=0x7f1e4c063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.163+0000 7f1e4a59c700 1 -- 172.21.15.49:0/3449759705 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e4c0c66c0 con 0x7f1e4c098d10 2023-11-30T18:41:53.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.163+0000 7f1e4a59c700 1 --2- 172.21.15.49:0/3449759705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e4c098d10 0x7f1e4c0c7760 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f1e44009e60 tx=0x7f1e44009780).ready entity=mon.1 client_cookie=db79676711050a63 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:53.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.163+0000 7f1e4959a700 1 -- 172.21.15.49:0/3449759705 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4400e070 con 0x7f1e4c098d10 2023-11-30T18:41:53.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.163+0000 7f1e4959a700 1 -- 172.21.15.49:0/3449759705 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4400b7a0 con 0x7f1e4c098d10 2023-11-30T18:41:53.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.163+0000 7f1e4959a700 1 -- 172.21.15.49:0/3449759705 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e34001470 con 0x7f1e4c098d10 2023-11-30T18:41:53.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.164+0000 7f1e50bcb700 1 -- 172.21.15.49:0/3449759705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e4c098d10 msgr2=0x7f1e4c0c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.164+0000 7f1e50bcb700 1 --2- 172.21.15.49:0/3449759705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e4c098d10 0x7f1e4c0c7760 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f1e44009e60 tx=0x7f1e44009780).stop 2023-11-30T18:41:53.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.164+0000 7f1e50bcb700 1 -- 172.21.15.49:0/3449759705 shutdown_connections 2023-11-30T18:41:53.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.164+0000 7f1e50bcb700 1 --2- 172.21.15.49:0/3449759705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e4c098d10 0x7f1e4c0c7760 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.164+0000 7f1e50bcb700 1 -- 172.21.15.49:0/3449759705 >> 172.21.15.49:0/3449759705 conn(0x7f1e4c0cb310 msgr2=0x7f1e4c0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:53.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.164+0000 7f1e50bcb700 1 -- 172.21.15.49:0/3449759705 shutdown_connections 2023-11-30T18:41:53.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.164+0000 7f1e50bcb700 1 -- 172.21.15.49:0/3449759705 wait complete. 2023-11-30T18:41:53.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.165+0000 7f1e50bcb700 1 Processor -- start 2023-11-30T18:41:53.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.165+0000 7f1e50bcb700 1 -- start start 2023-11-30T18:41:53.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.166+0000 7f1e50bcb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e4c098d10 0x7f1e4c155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.166+0000 7f1e50bcb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e4c0c6190 0x7f1e4c156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.166+0000 7f1e50bcb700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e4c158320 0x7f1e4c149350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.166+0000 7f1e50bcb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c14c560 con 0x7f1e4c098d10 2023-11-30T18:41:53.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.166+0000 7f1e50bcb700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c1570e0 con 0x7f1e4c158320 2023-11-30T18:41:53.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.166+0000 7f1e50bcb700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c155c80 con 0x7f1e4c0c6190 2023-11-30T18:41:53.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.166+0000 7f1e4a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e4c098d10 0x7f1e4c155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.166+0000 7f1e4a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e4c098d10 0x7f1e4c155790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59298/0 (socket says 172.21.15.49:59298) 2023-11-30T18:41:53.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.166+0000 7f1e4a59c700 1 -- 172.21.15.49:0/793595053 learned_addr learned my addr 172.21.15.49:0/793595053 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:53.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.166+0000 7f1e4ad9d700 1 --2- 172.21.15.49:0/793595053 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e4c158320 0x7f1e4c149350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.166+0000 7f1e49d9b700 1 --2- 172.21.15.49:0/793595053 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e4c0c6190 0x7f1e4c156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.166+0000 7f1e4a59c700 1 -- 172.21.15.49:0/793595053 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e4c0c6190 msgr2=0x7f1e4c156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.166+0000 7f1e4a59c700 1 --2- 172.21.15.49:0/793595053 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e4c0c6190 0x7f1e4c156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.166+0000 7f1e4a59c700 1 -- 172.21.15.49:0/793595053 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e4c158320 msgr2=0x7f1e4c149350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.166+0000 7f1e4a59c700 1 --2- 172.21.15.49:0/793595053 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e4c158320 0x7f1e4c149350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.166+0000 7f1e4a59c700 1 -- 172.21.15.49:0/793595053 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e44009a20 con 0x7f1e4c098d10 2023-11-30T18:41:53.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.166+0000 7f1e49d9b700 1 --2- 172.21.15.49:0/793595053 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e4c0c6190 0x7f1e4c156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:41:53.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.166+0000 7f1e4a59c700 1 --2- 172.21.15.49:0/793595053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e4c098d10 0x7f1e4c155790 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 rx=0x7f1e4400b610 tx=0x7f1e44009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:53.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.166+0000 7f1e427fc700 1 -- 172.21.15.49:0/793595053 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4401d440 con 0x7f1e4c098d10 2023-11-30T18:41:53.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.166+0000 7f1e427fc700 1 -- 172.21.15.49:0/793595053 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4401d5a0 con 0x7f1e4c098d10 2023-11-30T18:41:53.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.166+0000 7f1e50bcb700 1 -- 172.21.15.49:0/793595053 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e4c0aeed0 con 0x7f1e4c098d10 2023-11-30T18:41:53.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.166+0000 7f1e427fc700 1 -- 172.21.15.49:0/793595053 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4401d920 con 0x7f1e4c098d10 2023-11-30T18:41:53.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.166+0000 7f1e50bcb700 1 -- 172.21.15.49:0/793595053 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e4c0ae5a0 con 0x7f1e4c098d10 2023-11-30T18:41:53.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.168+0000 7f1e50bcb700 1 -- 172.21.15.49:0/793595053 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e4c06c860 con 0x7f1e4c098d10 2023-11-30T18:41:53.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.168+0000 7f1e427fc700 1 -- 172.21.15.49:0/793595053 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f1e4401dc90 con 0x7f1e4c098d10 2023-11-30T18:41:53.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.168+0000 7f1e427fc700 1 --2- 172.21.15.49:0/793595053 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f1e2c05f270 0x7f1e2c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.168+0000 7f1e427fc700 1 -- 172.21.15.49:0/793595053 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(225..225 src has 1..225) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f1e4407c290 con 0x7f1e4c098d10 2023-11-30T18:41:53.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.168+0000 7f1e49d9b700 1 --2- 172.21.15.49:0/793595053 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f1e2c05f270 0x7f1e2c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.169+0000 7f1e49d9b700 1 --2- 172.21.15.49:0/793595053 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f1e2c05f270 0x7f1e2c061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f1e340015a0 tx=0x7f1e34009040).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:53.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.172+0000 7f1e427fc700 1 -- 172.21.15.49:0/793595053 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1e4404d490 con 0x7f1e4c098d10 2023-11-30T18:41:53.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.344+0000 7f1e50bcb700 1 -- 172.21.15.49:0/793595053 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e4c149840 con 0x7f1e2c05f270 2023-11-30T18:41:53.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.344+0000 7f1e427fc700 1 -- 172.21.15.49:0/793595053 <== mgr.9772 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1e4c149840 con 0x7f1e2c05f270 2023-11-30T18:41:53.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.346+0000 7f1e50bcb700 1 -- 172.21.15.49:0/793595053 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f1e2c05f270 msgr2=0x7f1e2c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.346+0000 7f1e50bcb700 1 --2- 172.21.15.49:0/793595053 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f1e2c05f270 0x7f1e2c061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f1e340015a0 tx=0x7f1e34009040).stop 2023-11-30T18:41:53.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.346+0000 7f1e50bcb700 1 -- 172.21.15.49:0/793595053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e4c098d10 msgr2=0x7f1e4c155790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.346+0000 7f1e50bcb700 1 --2- 172.21.15.49:0/793595053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e4c098d10 0x7f1e4c155790 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 rx=0x7f1e4400b610 tx=0x7f1e44009780).stop 2023-11-30T18:41:53.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.346+0000 7f1e50bcb700 1 -- 172.21.15.49:0/793595053 shutdown_connections 2023-11-30T18:41:53.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.346+0000 7f1e50bcb700 1 --2- 172.21.15.49:0/793595053 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f1e2c05f270 0x7f1e2c061730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.346+0000 7f1e50bcb700 1 --2- 172.21.15.49:0/793595053 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e4c158320 0x7f1e4c149350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.346+0000 7f1e50bcb700 1 --2- 172.21.15.49:0/793595053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e4c098d10 0x7f1e4c155790 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.346+0000 7f1e50bcb700 1 --2- 172.21.15.49:0/793595053 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e4c0c6190 0x7f1e4c156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.346+0000 7f1e50bcb700 1 -- 172.21.15.49:0/793595053 >> 172.21.15.49:0/793595053 conn(0x7f1e4c0cb310 msgr2=0x7f1e4c152230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:53.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.346+0000 7f1e50bcb700 1 -- 172.21.15.49:0/793595053 shutdown_connections 2023-11-30T18:41:53.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.346+0000 7f1e50bcb700 1 -- 172.21.15.49:0/793595053 wait complete. 2023-11-30T18:41:53.348 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 5 to deep-scrub 2023-11-30T18:41:53.359 INFO:tasks.ceph:Scrubbing osd.6 2023-11-30T18:41:53.359 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-30T18:41:53.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.479+0000 7fc24f5fd700 1 Processor -- start 2023-11-30T18:41:53.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.480+0000 7fc24f5fd700 1 -- start start 2023-11-30T18:41:53.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.480+0000 7fc24f5fd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc248154530 0x7fc248154910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.480+0000 7fc24f5fd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc2480a7ff0 0x7fc2480c8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.480+0000 7fc24f5fd700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2480c6630 con 0x7fc2480aa220 2023-11-30T18:41:53.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.480+0000 7fc24f5fd700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2480c6390 con 0x7fc248154530 2023-11-30T18:41:53.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.480+0000 7fc24f5fd700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2480a8470 con 0x7fc2480a7ff0 2023-11-30T18:41:53.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.481+0000 7fc24d399700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc248154530 0x7fc248154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.481+0000 7fc24db9a700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc2480aa220 0x7fc2480c6ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53526/0 (socket says 172.21.15.49:53526) 2023-11-30T18:41:53.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.481+0000 7fc24db9a700 1 -- 172.21.15.49:0/4156224521 learned_addr learned my addr 172.21.15.49:0/4156224521 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:53.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.481+0000 7fc24cb98700 1 --2- 172.21.15.49:0/4156224521 >> v2:172.21.15.115:3300/0 conn(0x7fc2480a7ff0 0x7fc2480c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.481+0000 7fc247fff700 1 -- 172.21.15.49:0/4156224521 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1757248472 0 0) 0x7fc2480c6630 con 0x7fc2480aa220 2023-11-30T18:41:53.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.481+0000 7fc247fff700 1 -- 172.21.15.49:0/4156224521 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2300033f0 con 0x7fc2480aa220 2023-11-30T18:41:53.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.481+0000 7fc24d399700 1 -- 172.21.15.49:0/4156224521 >> v2:172.21.15.115:3300/0 conn(0x7fc2480a7ff0 msgr2=0x7fc2480c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:53.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.481+0000 7fc24d399700 1 --2- 172.21.15.49:0/4156224521 >> v2:172.21.15.115:3300/0 conn(0x7fc2480a7ff0 0x7fc2480c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.481+0000 7fc24d399700 1 -- 172.21.15.49:0/4156224521 >> v1:172.21.15.49:6789/0 conn(0x7fc2480aa220 legacy=0x7fc2480c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.481+0000 7fc24d399700 1 -- 172.21.15.49:0/4156224521 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc248064230 con 0x7fc248154530 2023-11-30T18:41:53.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.481+0000 7fc24d399700 1 --2- 172.21.15.49:0/4156224521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc248154530 0x7fc248154910 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 rx=0x7fc2480adfd0 tx=0x7fc240009780).ready entity=mon.0 client_cookie=cc2a102a8a71cdb2 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:53.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.481+0000 7fc247fff700 1 -- 172.21.15.49:0/4156224521 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24000e070 con 0x7fc248154530 2023-11-30T18:41:53.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.481+0000 7fc247fff700 1 -- 172.21.15.49:0/4156224521 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24000bb60 con 0x7fc248154530 2023-11-30T18:41:53.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.481+0000 7fc247fff700 1 -- 172.21.15.49:0/4156224521 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc240012410 con 0x7fc248154530 2023-11-30T18:41:53.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.482+0000 7fc24f5fd700 1 -- 172.21.15.49:0/4156224521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc248154530 msgr2=0x7fc248154910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.482+0000 7fc24f5fd700 1 --2- 172.21.15.49:0/4156224521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc248154530 0x7fc248154910 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 rx=0x7fc2480adfd0 tx=0x7fc240009780).stop 2023-11-30T18:41:53.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.482+0000 7fc24f5fd700 1 -- 172.21.15.49:0/4156224521 shutdown_connections 2023-11-30T18:41:53.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.482+0000 7fc24f5fd700 1 --2- 172.21.15.49:0/4156224521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc248154530 0x7fc248154910 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.482+0000 7fc24f5fd700 1 --2- 172.21.15.49:0/4156224521 >> v2:172.21.15.115:3300/0 conn(0x7fc2480a7ff0 0x7fc2480c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.482+0000 7fc24f5fd700 1 -- 172.21.15.49:0/4156224521 >> 172.21.15.49:0/4156224521 conn(0x7fc248094930 msgr2=0x7fc24806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:53.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.482+0000 7fc24f5fd700 1 -- 172.21.15.49:0/4156224521 shutdown_connections 2023-11-30T18:41:53.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.482+0000 7fc24f5fd700 1 -- 172.21.15.49:0/4156224521 wait complete. 2023-11-30T18:41:53.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.483+0000 7fc24f5fd700 1 Processor -- start 2023-11-30T18:41:53.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.483+0000 7fc24f5fd700 1 -- start start 2023-11-30T18:41:53.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.484+0000 7fc24f5fd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2480a7ff0 0x7fc2481650b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.484+0000 7fc24f5fd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2480aa220 0x7fc24815a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.484+0000 7fc24f5fd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc248154530 0x7fc24815a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.484+0000 7fc24f5fd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24815abb0 con 0x7fc2480aa220 2023-11-30T18:41:53.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.484+0000 7fc24f5fd700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc248148840 con 0x7fc2480a7ff0 2023-11-30T18:41:53.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.484+0000 7fc24f5fd700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2480afcb0 con 0x7fc248154530 2023-11-30T18:41:53.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.484+0000 7fc24cb98700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2480aa220 0x7fc24815a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.484+0000 7fc24cb98700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2480aa220 0x7fc24815a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59324/0 (socket says 172.21.15.49:59324) 2023-11-30T18:41:53.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.484+0000 7fc24cb98700 1 -- 172.21.15.49:0/2133404964 learned_addr learned my addr 172.21.15.49:0/2133404964 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:53.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.484+0000 7fc24d399700 1 --2- 172.21.15.49:0/2133404964 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2480a7ff0 0x7fc2481650b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.484+0000 7fc24db9a700 1 --2- 172.21.15.49:0/2133404964 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc248154530 0x7fc24815a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.484+0000 7fc24cb98700 1 -- 172.21.15.49:0/2133404964 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc248154530 msgr2=0x7fc24815a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.484+0000 7fc24cb98700 1 --2- 172.21.15.49:0/2133404964 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc248154530 0x7fc24815a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.484+0000 7fc24cb98700 1 -- 172.21.15.49:0/2133404964 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2480a7ff0 msgr2=0x7fc2481650b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.484+0000 7fc24cb98700 1 --2- 172.21.15.49:0/2133404964 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2480a7ff0 0x7fc2481650b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.484+0000 7fc24cb98700 1 -- 172.21.15.49:0/2133404964 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc240009a20 con 0x7fc2480aa220 2023-11-30T18:41:53.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.484+0000 7fc24cb98700 1 --2- 172.21.15.49:0/2133404964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2480aa220 0x7fc24815a1d0 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 rx=0x7fc23c00d890 tx=0x7fc23c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:53.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.485+0000 7fc2457fa700 1 -- 172.21.15.49:0/2133404964 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c011590 con 0x7fc2480aa220 2023-11-30T18:41:53.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.485+0000 7fc2457fa700 1 -- 172.21.15.49:0/2133404964 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23c0116f0 con 0x7fc2480aa220 2023-11-30T18:41:53.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.485+0000 7fc2457fa700 1 -- 172.21.15.49:0/2133404964 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c011a70 con 0x7fc2480aa220 2023-11-30T18:41:53.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.485+0000 7fc24f5fd700 1 -- 172.21.15.49:0/2133404964 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2481655a0 con 0x7fc2480aa220 2023-11-30T18:41:53.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.485+0000 7fc24f5fd700 1 -- 172.21.15.49:0/2133404964 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2480acc00 con 0x7fc2480aa220 2023-11-30T18:41:53.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.485+0000 7fc24f5fd700 1 -- 172.21.15.49:0/2133404964 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc24806c860 con 0x7fc2480aa220 2023-11-30T18:41:53.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.486+0000 7fc2457fa700 1 -- 172.21.15.49:0/2133404964 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc23c01c460 con 0x7fc2480aa220 2023-11-30T18:41:53.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.486+0000 7fc2457fa700 1 --2- 172.21.15.49:0/2133404964 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc23405f270 0x7fc234061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.486+0000 7fc2457fa700 1 -- 172.21.15.49:0/2133404964 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(225..225 src has 1..225) v4 ==== 5940+0+0 (secure 0 0 0) 0x7fc23c07a030 con 0x7fc2480aa220 2023-11-30T18:41:53.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.486+0000 7fc24d399700 1 --2- 172.21.15.49:0/2133404964 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc23405f270 0x7fc234061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.486+0000 7fc2457fa700 1 --2- 172.21.15.49:0/2133404964 >> [v2:172.21.15.115:6809/90555,v1:172.21.15.115:6810/90555] conn(0x7fc234065cf0 0x7fc234068190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.486+0000 7fc2457fa700 1 -- 172.21.15.49:0/2133404964 --> [v2:172.21.15.115:6809/90555,v1:172.21.15.115:6810/90555] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc234068810 con 0x7fc234065cf0 2023-11-30T18:41:53.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.486+0000 7fc2457fa700 1 -- 172.21.15.49:0/2133404964 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=225) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc23c07c680 con 0x7fc2480aa220 2023-11-30T18:41:53.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.487+0000 7fc24db9a700 1 --2- 172.21.15.49:0/2133404964 >> [v2:172.21.15.115:6809/90555,v1:172.21.15.115:6810/90555] conn(0x7fc234065cf0 0x7fc234068190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.487+0000 7fc24d399700 1 --2- 172.21.15.49:0/2133404964 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc23405f270 0x7fc234061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fc2480c5020 tx=0x7fc240009780).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:53.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.487+0000 7fc24db9a700 1 --2- 172.21.15.49:0/2133404964 >> [v2:172.21.15.115:6809/90555,v1:172.21.15.115:6810/90555] conn(0x7fc234065cf0 0x7fc234068190 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:53.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.488+0000 7fc2457fa700 1 -- 172.21.15.49:0/2133404964 <== osd.6 v2:172.21.15.115:6809/90555 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fc234068810 con 0x7fc234065cf0 2023-11-30T18:41:53.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.501+0000 7fc24f5fd700 1 -- 172.21.15.49:0/2133404964 --> [v2:172.21.15.115:6809/90555,v1:172.21.15.115:6810/90555] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc248064510 con 0x7fc234065cf0 2023-11-30T18:41:53.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.501+0000 7fc2457fa700 1 -- 172.21.15.49:0/2133404964 <== osd.6 v2:172.21.15.115:6809/90555 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc248064510 con 0x7fc234065cf0 2023-11-30T18:41:53.502 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T18:41:53.502 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-30T18:41:53.502 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T18:41:53.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.501+0000 7fc24f5fd700 1 -- 172.21.15.49:0/2133404964 >> [v2:172.21.15.115:6809/90555,v1:172.21.15.115:6810/90555] conn(0x7fc234065cf0 msgr2=0x7fc234068190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.501+0000 7fc24f5fd700 1 --2- 172.21.15.49:0/2133404964 >> [v2:172.21.15.115:6809/90555,v1:172.21.15.115:6810/90555] conn(0x7fc234065cf0 0x7fc234068190 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.501+0000 7fc24f5fd700 1 -- 172.21.15.49:0/2133404964 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc23405f270 msgr2=0x7fc234061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.501+0000 7fc24f5fd700 1 --2- 172.21.15.49:0/2133404964 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fc23405f270 0x7fc234061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fc2480c5020 tx=0x7fc240009780).stop 2023-11-30T18:41:53.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.501+0000 7fc24f5fd700 1 -- 172.21.15.49:0/2133404964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2480aa220 msgr2=0x7fc24815a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.501+0000 7fc24f5fd700 1 --2- 172.21.15.49:0/2133404964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2480aa220 0x7fc24815a1d0 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 rx=0x7fc23c00d890 tx=0x7fc23c008040).stop 2023-11-30T18:41:53.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.501+0000 7fc24db9a700 1 -- 172.21.15.49:0/2133404964 reap_dead start 2023-11-30T18:41:53.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.501+0000 7fc24f5fd700 1 -- 172.21.15.49:0/2133404964 shutdown_connections 2023-11-30T18:41:53.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.501+0000 7fc24f5fd700 1 -- 172.21.15.49:0/2133404964 >> 172.21.15.49:0/2133404964 conn(0x7fc248094930 msgr2=0x7fc248148c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:53.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.501+0000 7fc24f5fd700 1 -- 172.21.15.49:0/2133404964 shutdown_connections 2023-11-30T18:41:53.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.502+0000 7fc24f5fd700 1 -- 172.21.15.49:0/2133404964 wait complete. 2023-11-30T18:41:53.514 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-30T18:41:53.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.632+0000 7f99dac1c700 1 Processor -- start 2023-11-30T18:41:53.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.632+0000 7f99dac1c700 1 -- start start 2023-11-30T18:41:53.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.633+0000 7f99dac1c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99d40c66f0 0x7f99d4154950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.633+0000 7f99dac1c700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f99d4158570 0x7f99d4158a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.633+0000 7f99dac1c700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d4154e40 con 0x7f99d414e530 2023-11-30T18:41:53.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.633+0000 7f99dac1c700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d40c6b70 con 0x7f99d4158570 2023-11-30T18:41:53.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.633+0000 7f99dac1c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d40c7bc0 con 0x7f99d40c66f0 2023-11-30T18:41:53.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.633+0000 7f99da41b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f99d4158570 0x7f99d4158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.633+0000 7f99da41b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f99d4158570 0x7f99d4158a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59332/0 (socket says 172.21.15.49:59332) 2023-11-30T18:41:53.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.633+0000 7f99da41b700 1 -- 172.21.15.49:0/575908153 learned_addr learned my addr 172.21.15.49:0/575908153 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:53.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.633+0000 7f99d9419700 1 --2- 172.21.15.49:0/575908153 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99d40c66f0 0x7f99d4154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.633+0000 7f99da41b700 1 -- 172.21.15.49:0/575908153 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99d40c66f0 msgr2=0x7f99d4154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:53.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.633+0000 7f99da41b700 1 --2- 172.21.15.49:0/575908153 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99d40c66f0 0x7f99d4154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.633+0000 7f99da41b700 1 -- 172.21.15.49:0/575908153 >> v1:172.21.15.115:6789/0 conn(0x7f99d414e530 legacy=0x7f99d414e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.633+0000 7f99da41b700 1 -- 172.21.15.49:0/575908153 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d4155920 con 0x7f99d4158570 2023-11-30T18:41:53.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.633+0000 7f99d8c18700 1 -- 172.21.15.49:0/575908153 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4020589654 0 0) 0x7f99d0001110 con 0x7f99d414e530 2023-11-30T18:41:53.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.633+0000 7f99da41b700 1 --2- 172.21.15.49:0/575908153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d4158570 0x7f99d4158a00 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 rx=0x7f99cc009f20 tx=0x7f99cc009840).ready entity=mon.0 client_cookie=f386ffd679f48370 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:53.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.634+0000 7f99d8c18700 1 -- 172.21.15.49:0/575908153 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc00e070 con 0x7f99d4158570 2023-11-30T18:41:53.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.634+0000 7f99d8c18700 1 -- 172.21.15.49:0/575908153 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99cc00b9d0 con 0x7f99d4158570 2023-11-30T18:41:53.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.634+0000 7f99d8c18700 1 -- 172.21.15.49:0/575908153 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc00bd50 con 0x7f99d4158570 2023-11-30T18:41:53.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.634+0000 7f99dac1c700 1 -- 172.21.15.49:0/575908153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d4158570 msgr2=0x7f99d4158a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.634+0000 7f99dac1c700 1 --2- 172.21.15.49:0/575908153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d4158570 0x7f99d4158a00 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 rx=0x7f99cc009f20 tx=0x7f99cc009840).stop 2023-11-30T18:41:53.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.634+0000 7f99dac1c700 1 -- 172.21.15.49:0/575908153 shutdown_connections 2023-11-30T18:41:53.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.634+0000 7f99dac1c700 1 --2- 172.21.15.49:0/575908153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d4158570 0x7f99d4158a00 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.634+0000 7f99dac1c700 1 --2- 172.21.15.49:0/575908153 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99d40c66f0 0x7f99d4154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.634+0000 7f99dac1c700 1 -- 172.21.15.49:0/575908153 >> 172.21.15.49:0/575908153 conn(0x7f99d4064990 msgr2=0x7f99d4064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:53.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.634+0000 7f99dac1c700 1 -- 172.21.15.49:0/575908153 shutdown_connections 2023-11-30T18:41:53.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.634+0000 7f99dac1c700 1 -- 172.21.15.49:0/575908153 wait complete. 2023-11-30T18:41:53.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.635+0000 7f99dac1c700 1 Processor -- start 2023-11-30T18:41:53.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.635+0000 7f99dac1c700 1 -- start start 2023-11-30T18:41:53.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.636+0000 7f99dac1c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99d40c66f0 0x7f99d4153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.636+0000 7f99dac1c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99d414e530 0x7f99d41678c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.636+0000 7f99dac1c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d4158570 0x7f99d4064d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.636+0000 7f99dac1c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d413c5b0 con 0x7f99d4158570 2023-11-30T18:41:53.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.636+0000 7f99dac1c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d41687f0 con 0x7f99d40c66f0 2023-11-30T18:41:53.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.636+0000 7f99dac1c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d40c2850 con 0x7f99d414e530 2023-11-30T18:41:53.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.636+0000 7f99da41b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d4158570 0x7f99d4064d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.636+0000 7f99da41b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d4158570 0x7f99d4064d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59340/0 (socket says 172.21.15.49:59340) 2023-11-30T18:41:53.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.636+0000 7f99da41b700 1 -- 172.21.15.49:0/4179557811 learned_addr learned my addr 172.21.15.49:0/4179557811 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:53.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.636+0000 7f99d9c1a700 1 --2- 172.21.15.49:0/4179557811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99d40c66f0 0x7f99d4153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.636+0000 7f99d9419700 1 --2- 172.21.15.49:0/4179557811 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99d414e530 0x7f99d41678c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.636+0000 7f99da41b700 1 -- 172.21.15.49:0/4179557811 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99d414e530 msgr2=0x7f99d41678c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.636+0000 7f99da41b700 1 --2- 172.21.15.49:0/4179557811 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99d414e530 0x7f99d41678c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.636+0000 7f99da41b700 1 -- 172.21.15.49:0/4179557811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99d40c66f0 msgr2=0x7f99d4153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.636+0000 7f99da41b700 1 --2- 172.21.15.49:0/4179557811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99d40c66f0 0x7f99d4153b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.636+0000 7f99da41b700 1 -- 172.21.15.49:0/4179557811 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc009ae0 con 0x7f99d4158570 2023-11-30T18:41:53.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.637+0000 7f99d9c1a700 1 --2- 172.21.15.49:0/4179557811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99d40c66f0 0x7f99d4153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:41:53.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.637+0000 7f99d9419700 1 --2- 172.21.15.49:0/4179557811 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99d414e530 0x7f99d41678c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-30T18:41:53.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.637+0000 7f99da41b700 1 --2- 172.21.15.49:0/4179557811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d4158570 0x7f99d4064d70 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 rx=0x7f99cc00b610 tx=0x7f99cc009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:53.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.637+0000 7f99c9ffb700 1 -- 172.21.15.49:0/4179557811 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc007080 con 0x7f99d4158570 2023-11-30T18:41:53.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.637+0000 7f99c9ffb700 1 -- 172.21.15.49:0/4179557811 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99cc0092e0 con 0x7f99d4158570 2023-11-30T18:41:53.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.637+0000 7f99dac1c700 1 -- 172.21.15.49:0/4179557811 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d4168230 con 0x7f99d4158570 2023-11-30T18:41:53.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.637+0000 7f99c9ffb700 1 -- 172.21.15.49:0/4179557811 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc01e6a0 con 0x7f99d4158570 2023-11-30T18:41:53.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.637+0000 7f99dac1c700 1 -- 172.21.15.49:0/4179557811 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d40c2af0 con 0x7f99d4158570 2023-11-30T18:41:53.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.638+0000 7f99dac1c700 1 -- 172.21.15.49:0/4179557811 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d4083310 con 0x7f99d4158570 2023-11-30T18:41:53.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.638+0000 7f99c9ffb700 1 -- 172.21.15.49:0/4179557811 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f99cc003040 con 0x7f99d4158570 2023-11-30T18:41:53.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.639+0000 7f99c9ffb700 1 --2- 172.21.15.49:0/4179557811 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f99b805f270 0x7f99b8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.639+0000 7f99c9ffb700 1 -- 172.21.15.49:0/4179557811 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(225..225 src has 1..225) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f99cc07b870 con 0x7f99d4158570 2023-11-30T18:41:53.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.639+0000 7f99d9c1a700 1 --2- 172.21.15.49:0/4179557811 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f99b805f270 0x7f99b8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.639+0000 7f99d9c1a700 1 --2- 172.21.15.49:0/4179557811 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f99b805f270 0x7f99b8061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f99d0001740 tx=0x7f99d0009040).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:53.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.643+0000 7f99c9ffb700 1 -- 172.21.15.49:0/4179557811 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f99cc04ca70 con 0x7f99d4158570 2023-11-30T18:41:53.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.813+0000 7f99dac1c700 1 -- 172.21.15.49:0/4179557811 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f99d4062ee0 con 0x7f99b805f270 2023-11-30T18:41:53.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.814+0000 7f99c9ffb700 1 -- 172.21.15.49:0/4179557811 <== mgr.9772 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f99d4062ee0 con 0x7f99b805f270 2023-11-30T18:41:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.816+0000 7f99dac1c700 1 -- 172.21.15.49:0/4179557811 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f99b805f270 msgr2=0x7f99b8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.816+0000 7f99dac1c700 1 --2- 172.21.15.49:0/4179557811 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f99b805f270 0x7f99b8061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f99d0001740 tx=0x7f99d0009040).stop 2023-11-30T18:41:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.816+0000 7f99dac1c700 1 -- 172.21.15.49:0/4179557811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d4158570 msgr2=0x7f99d4064d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.816+0000 7f99dac1c700 1 --2- 172.21.15.49:0/4179557811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d4158570 0x7f99d4064d70 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 rx=0x7f99cc00b610 tx=0x7f99cc009840).stop 2023-11-30T18:41:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.816+0000 7f99dac1c700 1 -- 172.21.15.49:0/4179557811 shutdown_connections 2023-11-30T18:41:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.816+0000 7f99dac1c700 1 --2- 172.21.15.49:0/4179557811 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f99b805f270 0x7f99b8061730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.816+0000 7f99dac1c700 1 --2- 172.21.15.49:0/4179557811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d4158570 0x7f99d4064d70 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.816+0000 7f99dac1c700 1 --2- 172.21.15.49:0/4179557811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99d40c66f0 0x7f99d4153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.816+0000 7f99dac1c700 1 --2- 172.21.15.49:0/4179557811 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99d414e530 0x7f99d41678c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.816+0000 7f99dac1c700 1 -- 172.21.15.49:0/4179557811 >> 172.21.15.49:0/4179557811 conn(0x7f99d4064990 msgr2=0x7f99d4156c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.816+0000 7f99dac1c700 1 -- 172.21.15.49:0/4179557811 shutdown_connections 2023-11-30T18:41:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.816+0000 7f99dac1c700 1 -- 172.21.15.49:0/4179557811 wait complete. 2023-11-30T18:41:53.818 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 6 to deep-scrub 2023-11-30T18:41:53.828 INFO:tasks.ceph:Scrubbing osd.7 2023-11-30T18:41:53.828 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-30T18:41:53.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.949+0000 7f0f81a39700 1 Processor -- start 2023-11-30T18:41:53.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.949+0000 7f0f81a39700 1 -- start start 2023-11-30T18:41:53.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.950+0000 7f0f81a39700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0f7c0ab3b0 0x7f0f7c1582e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.950+0000 7f0f81a39700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f7c0aa1c0 0x7f0f7c0aa600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.950+0000 7f0f81a39700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f7c159210 con 0x7f0f7c154610 2023-11-30T18:41:53.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.950+0000 7f0f81a39700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f7c0c0c70 con 0x7f0f7c0ab3b0 2023-11-30T18:41:53.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.950+0000 7f0f81a39700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c0c2110 con 0x7f0f7c0aa1c0 2023-11-30T18:41:53.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.950+0000 7f0f7b7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f7c0aa1c0 0x7f0f7c0aa600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.950+0000 7f0f7b7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f7c0aa1c0 0x7f0f7c0aa600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:46628/0 (socket says 172.21.15.49:46628) 2023-11-30T18:41:53.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.950+0000 7f0f7a7fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0f7c0ab3b0 0x7f0f7c1582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.950+0000 7f0f7b7fe700 1 -- 172.21.15.49:0/398656119 learned_addr learned my addr 172.21.15.49:0/398656119 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:53.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.950+0000 7f0f7affd700 1 --1- 172.21.15.49:0/398656119 >> v1:172.21.15.115:6789/0 conn(0x7f0f7c154610 0x7f0f7c0c80c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:54204/0 (socket says 172.21.15.49:54204) 2023-11-30T18:41:53.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.950+0000 7f0f7b7fe700 1 -- 172.21.15.49:0/398656119 >> v2:172.21.15.115:3300/0 conn(0x7f0f7c0ab3b0 msgr2=0x7f0f7c1582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:53.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.950+0000 7f0f7b7fe700 1 --2- 172.21.15.49:0/398656119 >> v2:172.21.15.115:3300/0 conn(0x7f0f7c0ab3b0 0x7f0f7c1582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.950+0000 7f0f7b7fe700 1 -- 172.21.15.49:0/398656119 >> v1:172.21.15.115:6789/0 conn(0x7f0f7c154610 legacy=0x7f0f7c0c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.950+0000 7f0f7b7fe700 1 -- 172.21.15.49:0/398656119 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7c0aaaf0 con 0x7f0f7c0aa1c0 2023-11-30T18:41:53.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.950+0000 7f0f7b7fe700 1 --2- 172.21.15.49:0/398656119 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f7c0aa1c0 0x7f0f7c0aa600 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f0f6c009f20 tx=0x7f0f6c009840).ready entity=mon.2 client_cookie=fa2e1edf6b251ddd server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:53.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.950+0000 7f0f79ffb700 1 -- 172.21.15.49:0/398656119 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c00e070 con 0x7f0f7c0aa1c0 2023-11-30T18:41:53.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.951+0000 7f0f79ffb700 1 -- 172.21.15.49:0/398656119 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6c00b9d0 con 0x7f0f7c0aa1c0 2023-11-30T18:41:53.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.951+0000 7f0f79ffb700 1 -- 172.21.15.49:0/398656119 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c00bd50 con 0x7f0f7c0aa1c0 2023-11-30T18:41:53.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.951+0000 7f0f81a39700 1 -- 172.21.15.49:0/398656119 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f7c0aa1c0 msgr2=0x7f0f7c0aa600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.951+0000 7f0f81a39700 1 --2- 172.21.15.49:0/398656119 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f7c0aa1c0 0x7f0f7c0aa600 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f0f6c009f20 tx=0x7f0f6c009840).stop 2023-11-30T18:41:53.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.951+0000 7f0f81a39700 1 -- 172.21.15.49:0/398656119 shutdown_connections 2023-11-30T18:41:53.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.951+0000 7f0f81a39700 1 --2- 172.21.15.49:0/398656119 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f7c0aa1c0 0x7f0f7c0aa600 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.951+0000 7f0f81a39700 1 --2- 172.21.15.49:0/398656119 >> v2:172.21.15.115:3300/0 conn(0x7f0f7c0ab3b0 0x7f0f7c1582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.951+0000 7f0f81a39700 1 -- 172.21.15.49:0/398656119 >> 172.21.15.49:0/398656119 conn(0x7f0f7c0655a0 msgr2=0x7f0f7c069e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:53.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.951+0000 7f0f81a39700 1 -- 172.21.15.49:0/398656119 shutdown_connections 2023-11-30T18:41:53.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.951+0000 7f0f81a39700 1 -- 172.21.15.49:0/398656119 wait complete. 2023-11-30T18:41:53.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.952+0000 7f0f81a39700 1 Processor -- start 2023-11-30T18:41:53.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.952+0000 7f0f81a39700 1 -- start start 2023-11-30T18:41:53.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.953+0000 7f0f81a39700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f7c0aa1c0 0x7f0f7c13f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.953+0000 7f0f81a39700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f7c154610 0x7f0f7c154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.953+0000 7f0f81a39700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f7c14ba20 0x7f0f7c14f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.953+0000 7f0f81a39700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c0c2300 con 0x7f0f7c14ba20 2023-11-30T18:41:53.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.953+0000 7f0f81a39700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c13faa0 con 0x7f0f7c0aa1c0 2023-11-30T18:41:53.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.953+0000 7f0f81a39700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c14bee0 con 0x7f0f7c154610 2023-11-30T18:41:53.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.953+0000 7f0f7b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f7c14ba20 0x7f0f7c14f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.953+0000 7f0f7b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f7c14ba20 0x7f0f7c14f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59342/0 (socket says 172.21.15.49:59342) 2023-11-30T18:41:53.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.953+0000 7f0f7b7fe700 1 -- 172.21.15.49:0/1424945601 learned_addr learned my addr 172.21.15.49:0/1424945601 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:53.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.953+0000 7f0f7a7fc700 1 --2- 172.21.15.49:0/1424945601 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f7c154610 0x7f0f7c154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.953+0000 7f0f7affd700 1 --2- 172.21.15.49:0/1424945601 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f7c0aa1c0 0x7f0f7c13f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.954+0000 7f0f7b7fe700 1 -- 172.21.15.49:0/1424945601 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f7c154610 msgr2=0x7f0f7c154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.954+0000 7f0f7b7fe700 1 --2- 172.21.15.49:0/1424945601 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f7c154610 0x7f0f7c154b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.954+0000 7f0f7b7fe700 1 -- 172.21.15.49:0/1424945601 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f7c0aa1c0 msgr2=0x7f0f7c13f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.954+0000 7f0f7b7fe700 1 --2- 172.21.15.49:0/1424945601 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f7c0aa1c0 0x7f0f7c13f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.954+0000 7f0f7b7fe700 1 -- 172.21.15.49:0/1424945601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6c009ae0 con 0x7f0f7c14ba20 2023-11-30T18:41:53.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.954+0000 7f0f7a7fc700 1 --2- 172.21.15.49:0/1424945601 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f7c154610 0x7f0f7c154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:41:53.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.954+0000 7f0f7b7fe700 1 --2- 172.21.15.49:0/1424945601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f7c14ba20 0x7f0f7c14f5c0 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 rx=0x7f0f6c00b610 tx=0x7f0f6c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:53.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.954+0000 7f0f72ffd700 1 -- 172.21.15.49:0/1424945601 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c0092e0 con 0x7f0f7c14ba20 2023-11-30T18:41:53.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.954+0000 7f0f72ffd700 1 -- 172.21.15.49:0/1424945601 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6c01e470 con 0x7f0f7c14ba20 2023-11-30T18:41:53.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.954+0000 7f0f72ffd700 1 -- 172.21.15.49:0/1424945601 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c01e830 con 0x7f0f7c14ba20 2023-11-30T18:41:53.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.954+0000 7f0f81a39700 1 -- 172.21.15.49:0/1424945601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f7c0c2550 con 0x7f0f7c14ba20 2023-11-30T18:41:53.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.954+0000 7f0f81a39700 1 -- 172.21.15.49:0/1424945601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f7c13fef0 con 0x7f0f7c14ba20 2023-11-30T18:41:53.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.955+0000 7f0f81a39700 1 -- 172.21.15.49:0/1424945601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0f7c06c860 con 0x7f0f7c14ba20 2023-11-30T18:41:53.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.956+0000 7f0f72ffd700 1 -- 172.21.15.49:0/1424945601 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0f6c003040 con 0x7f0f7c14ba20 2023-11-30T18:41:53.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.956+0000 7f0f72ffd700 1 --2- 172.21.15.49:0/1424945601 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0f5c05f270 0x7f0f5c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.956+0000 7f0f72ffd700 1 -- 172.21.15.49:0/1424945601 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(225..225 src has 1..225) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f0f6c07c1e0 con 0x7f0f7c14ba20 2023-11-30T18:41:53.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.956+0000 7f0f72ffd700 1 --2- 172.21.15.49:0/1424945601 >> [v2:172.21.15.115:6824/90598,v1:172.21.15.115:6825/90598] conn(0x7f0f5c065cf0 0x7f0f5c068190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:53.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.956+0000 7f0f72ffd700 1 -- 172.21.15.49:0/1424945601 --> [v2:172.21.15.115:6824/90598,v1:172.21.15.115:6825/90598] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f5c068810 con 0x7f0f5c065cf0 2023-11-30T18:41:53.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.956+0000 7f0f72ffd700 1 -- 172.21.15.49:0/1424945601 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=225) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f6c07c5c0 con 0x7f0f7c14ba20 2023-11-30T18:41:53.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.956+0000 7f0f7affd700 1 --2- 172.21.15.49:0/1424945601 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0f5c05f270 0x7f0f5c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.956+0000 7f0f7a7fc700 1 --2- 172.21.15.49:0/1424945601 >> [v2:172.21.15.115:6824/90598,v1:172.21.15.115:6825/90598] conn(0x7f0f5c065cf0 0x7f0f5c068190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:53.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.956+0000 7f0f7affd700 1 --2- 172.21.15.49:0/1424945601 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0f5c05f270 0x7f0f5c061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f0f74007fd0 tx=0x7f0f74007d30).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:53.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.957+0000 7f0f7a7fc700 1 --2- 172.21.15.49:0/1424945601 >> [v2:172.21.15.115:6824/90598,v1:172.21.15.115:6825/90598] conn(0x7f0f5c065cf0 0x7f0f5c068190 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:53.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.957+0000 7f0f72ffd700 1 -- 172.21.15.49:0/1424945601 <== osd.7 v2:172.21.15.115:6824/90598 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f0f5c068810 con 0x7f0f5c065cf0 2023-11-30T18:41:53.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.972+0000 7f0f81a39700 1 -- 172.21.15.49:0/1424945601 --> [v2:172.21.15.115:6824/90598,v1:172.21.15.115:6825/90598] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0f7c14f410 con 0x7f0f5c065cf0 2023-11-30T18:41:53.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.972+0000 7f0f72ffd700 1 -- 172.21.15.49:0/1424945601 <== osd.7 v2:172.21.15.115:6824/90598 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0f7c14f410 con 0x7f0f5c065cf0 2023-11-30T18:41:53.973 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-30T18:41:53.974 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-30T18:41:53.974 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-30T18:41:53.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.973+0000 7f0f81a39700 1 -- 172.21.15.49:0/1424945601 >> [v2:172.21.15.115:6824/90598,v1:172.21.15.115:6825/90598] conn(0x7f0f5c065cf0 msgr2=0x7f0f5c068190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.973+0000 7f0f81a39700 1 --2- 172.21.15.49:0/1424945601 >> [v2:172.21.15.115:6824/90598,v1:172.21.15.115:6825/90598] conn(0x7f0f5c065cf0 0x7f0f5c068190 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:53.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.973+0000 7f0f81a39700 1 -- 172.21.15.49:0/1424945601 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0f5c05f270 msgr2=0x7f0f5c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.973+0000 7f0f81a39700 1 --2- 172.21.15.49:0/1424945601 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f0f5c05f270 0x7f0f5c061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f0f74007fd0 tx=0x7f0f74007d30).stop 2023-11-30T18:41:53.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.973+0000 7f0f81a39700 1 -- 172.21.15.49:0/1424945601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f7c14ba20 msgr2=0x7f0f7c14f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:53.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.973+0000 7f0f81a39700 1 --2- 172.21.15.49:0/1424945601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f7c14ba20 0x7f0f7c14f5c0 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 rx=0x7f0f6c00b610 tx=0x7f0f6c009840).stop 2023-11-30T18:41:53.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.973+0000 7f0f7b7fe700 1 -- 172.21.15.49:0/1424945601 reap_dead start 2023-11-30T18:41:53.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.973+0000 7f0f81a39700 1 -- 172.21.15.49:0/1424945601 shutdown_connections 2023-11-30T18:41:53.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.973+0000 7f0f81a39700 1 -- 172.21.15.49:0/1424945601 >> 172.21.15.49:0/1424945601 conn(0x7f0f7c0655a0 msgr2=0x7f0f7c0cb260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:53.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.973+0000 7f0f81a39700 1 -- 172.21.15.49:0/1424945601 shutdown_connections 2023-11-30T18:41:53.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:53.973+0000 7f0f81a39700 1 -- 172.21.15.49:0/1424945601 wait complete. 2023-11-30T18:41:53.988 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-30T18:41:54.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.107+0000 7f3781973700 1 Processor -- start 2023-11-30T18:41:54.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.107+0000 7f3781973700 1 -- start start 2023-11-30T18:41:54.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.107+0000 7f3781973700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f377c0c86f0 0x7f377c0a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:54.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.107+0000 7f3781973700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f377c062700 0x7f377c062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:54.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.107+0000 7f3781973700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377c0630a0 con 0x7f377c1547f0 2023-11-30T18:41:54.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.107+0000 7f3781973700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377c0c7e30 con 0x7f377c0c86f0 2023-11-30T18:41:54.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.107+0000 7f3781973700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0bcf40 con 0x7f377c062700 2023-11-30T18:41:54.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.108+0000 7f377affd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f377c1547f0 0x7f377c0c6fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53532/0 (socket says 172.21.15.49:53532) 2023-11-30T18:41:54.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.108+0000 7f377affd700 1 -- 172.21.15.49:0/81407760 learned_addr learned my addr 172.21.15.49:0/81407760 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:54.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.108+0000 7f377b7fe700 1 --2- 172.21.15.49:0/81407760 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f377c062700 0x7f377c062bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:54.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.108+0000 7f377a7fc700 1 --2- 172.21.15.49:0/81407760 >> v2:172.21.15.115:3300/0 conn(0x7f377c0c86f0 0x7f377c0a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:54.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.108+0000 7f3779ffb700 1 -- 172.21.15.49:0/81407760 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2417857095 0 0) 0x7f3774001110 con 0x7f377c1547f0 2023-11-30T18:41:54.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.108+0000 7f3779ffb700 1 -- 172.21.15.49:0/81407760 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37680033f0 con 0x7f377c1547f0 2023-11-30T18:41:54.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.108+0000 7f3779ffb700 1 -- 172.21.15.49:0/81407760 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4121241642 0 0) 0x7f37680033f0 con 0x7f377c1547f0 2023-11-30T18:41:54.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.108+0000 7f3779ffb700 1 -- 172.21.15.49:0/81407760 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f377c062700 msgr2=0x7f377c062bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:54.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.108+0000 7f3779ffb700 1 --2- 172.21.15.49:0/81407760 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f377c062700 0x7f377c062bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:54.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.108+0000 7f3779ffb700 1 -- 172.21.15.49:0/81407760 >> v2:172.21.15.115:3300/0 conn(0x7f377c0c86f0 msgr2=0x7f377c0a72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:54.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.108+0000 7f3779ffb700 1 --2- 172.21.15.49:0/81407760 >> v2:172.21.15.115:3300/0 conn(0x7f377c0c86f0 0x7f377c0a72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:54.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.108+0000 7f3779ffb700 1 -- 172.21.15.49:0/81407760 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c0c6b20 con 0x7f377c1547f0 2023-11-30T18:41:54.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.108+0000 7f3779ffb700 1 -- 172.21.15.49:0/81407760 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1759328984 0 0) 0x7f3774001600 con 0x7f377c1547f0 2023-11-30T18:41:54.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.108+0000 7f3779ffb700 1 -- 172.21.15.49:0/81407760 >> v1:172.21.15.49:6789/0 conn(0x7f377c1547f0 legacy=0x7f377c0c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:54.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.108+0000 7f3779ffb700 1 --2- 172.21.15.49:0/81407760 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f377c062700 0x7f37680038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:54.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.108+0000 7f3779ffb700 1 --2- 172.21.15.49:0/81407760 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3768003e10 0x7f3768004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:54.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.108+0000 7f3779ffb700 1 --2- 172.21.15.49:0/81407760 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3768004b80 0x7f3768005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:54.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.108+0000 7f3779ffb700 1 -- 172.21.15.49:0/81407760 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0c7e30 con 0x7f3768003e10 2023-11-30T18:41:54.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.108+0000 7f3779ffb700 1 -- 172.21.15.49:0/81407760 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0bcf40 con 0x7f3768004b80 2023-11-30T18:41:54.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.108+0000 7f3779ffb700 1 -- 172.21.15.49:0/81407760 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376800b8e0 con 0x7f377c062700 2023-11-30T18:41:54.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.108+0000 7f377a7fc700 1 --2- 172.21.15.49:0/81407760 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3768003e10 0x7f3768004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:54.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.108+0000 7f377affd700 1 --2- 172.21.15.49:0/81407760 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f377c062700 0x7f37680038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:54.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.108+0000 7f377b7fe700 1 --2- 172.21.15.49:0/81407760 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3768004b80 0x7f3768005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:54.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.109+0000 7f377a7fc700 1 -- 172.21.15.49:0/81407760 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f377c062700 msgr2=0x7f37680038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:54.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.109+0000 7f377a7fc700 1 --2- 172.21.15.49:0/81407760 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f377c062700 0x7f37680038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:54.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.109+0000 7f377a7fc700 1 -- 172.21.15.49:0/81407760 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3768004b80 msgr2=0x7f3768005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:54.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.109+0000 7f377a7fc700 1 --2- 172.21.15.49:0/81407760 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3768004b80 0x7f3768005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:54.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.109+0000 7f377a7fc700 1 -- 172.21.15.49:0/81407760 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37680033f0 con 0x7f3768003e10 2023-11-30T18:41:54.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.109+0000 7f377a7fc700 1 --2- 172.21.15.49:0/81407760 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3768003e10 0x7f3768004690 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 rx=0x7f3764009a80 tx=0x7f3764009060).ready entity=mon.0 client_cookie=6ee9eb08c2e503f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:54.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.109+0000 7f3779ffb700 1 -- 172.21.15.49:0/81407760 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3764009430 con 0x7f3768003e10 2023-11-30T18:41:54.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.109+0000 7f3779ffb700 1 -- 172.21.15.49:0/81407760 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376400e640 con 0x7f3768003e10 2023-11-30T18:41:54.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.109+0000 7f3779ffb700 1 -- 172.21.15.49:0/81407760 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376400e9c0 con 0x7f3768003e10 2023-11-30T18:41:54.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.109+0000 7f3781973700 1 -- 172.21.15.49:0/81407760 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3768003e10 msgr2=0x7f3768004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:54.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.109+0000 7f3781973700 1 --2- 172.21.15.49:0/81407760 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3768003e10 0x7f3768004690 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 rx=0x7f3764009a80 tx=0x7f3764009060).stop 2023-11-30T18:41:54.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.109+0000 7f377b7fe700 1 -- 172.21.15.49:0/81407760 reap_dead start 2023-11-30T18:41:54.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.109+0000 7f3781973700 1 -- 172.21.15.49:0/81407760 shutdown_connections 2023-11-30T18:41:54.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.109+0000 7f3781973700 1 -- 172.21.15.49:0/81407760 >> 172.21.15.49:0/81407760 conn(0x7f377c0642d0 msgr2=0x7f377c0c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:54.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.110+0000 7f3781973700 1 -- 172.21.15.49:0/81407760 shutdown_connections 2023-11-30T18:41:54.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.110+0000 7f3781973700 1 -- 172.21.15.49:0/81407760 wait complete. 2023-11-30T18:41:54.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.111+0000 7f3781973700 1 Processor -- start 2023-11-30T18:41:54.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.111+0000 7f3781973700 1 -- start start 2023-11-30T18:41:54.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.112+0000 7f3781973700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3768003e10 0x7f377c14f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:54.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.112+0000 7f3781973700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f377c0c5e10 0x7f377c0c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:54.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.112+0000 7f3781973700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f377c164c70 0x7f377c1650d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:54.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.112+0000 7f3781973700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0add60 con 0x7f377c0c5e10 2023-11-30T18:41:54.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.112+0000 7f3781973700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c165e70 con 0x7f377c164c70 2023-11-30T18:41:54.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.112+0000 7f3781973700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0a9250 con 0x7f3768003e10 2023-11-30T18:41:54.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.112+0000 7f377a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f377c0c5e10 0x7f377c0c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:54.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.112+0000 7f377a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f377c0c5e10 0x7f377c0c6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59360/0 (socket says 172.21.15.49:59360) 2023-11-30T18:41:54.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.112+0000 7f377a7fc700 1 -- 172.21.15.49:0/312461937 learned_addr learned my addr 172.21.15.49:0/312461937 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:54.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.112+0000 7f377affd700 1 --2- 172.21.15.49:0/312461937 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3768003e10 0x7f377c14f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:54.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.112+0000 7f377b7fe700 1 --2- 172.21.15.49:0/312461937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f377c164c70 0x7f377c1650d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:54.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.112+0000 7f377a7fc700 1 -- 172.21.15.49:0/312461937 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3768003e10 msgr2=0x7f377c14f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:54.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.112+0000 7f377a7fc700 1 --2- 172.21.15.49:0/312461937 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3768003e10 0x7f377c14f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:54.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.112+0000 7f377a7fc700 1 -- 172.21.15.49:0/312461937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f377c164c70 msgr2=0x7f377c1650d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:54.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.112+0000 7f377a7fc700 1 --2- 172.21.15.49:0/312461937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f377c164c70 0x7f377c1650d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:54.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.112+0000 7f377a7fc700 1 -- 172.21.15.49:0/312461937 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c0c6780 con 0x7f377c0c5e10 2023-11-30T18:41:54.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.112+0000 7f377a7fc700 1 --2- 172.21.15.49:0/312461937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f377c0c5e10 0x7f377c0c6290 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 rx=0x7f376400e4b0 tx=0x7f376401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:54.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.112+0000 7f3772ffd700 1 -- 172.21.15.49:0/312461937 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3764009ec0 con 0x7f377c0c5e10 2023-11-30T18:41:54.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.112+0000 7f3772ffd700 1 -- 172.21.15.49:0/312461937 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376400ed30 con 0x7f377c0c5e10 2023-11-30T18:41:54.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.112+0000 7f3781973700 1 -- 172.21.15.49:0/312461937 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f377c14f5a0 con 0x7f377c0c5e10 2023-11-30T18:41:54.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.112+0000 7f3772ffd700 1 -- 172.21.15.49:0/312461937 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376400eea0 con 0x7f377c0c5e10 2023-11-30T18:41:54.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.112+0000 7f3781973700 1 -- 172.21.15.49:0/312461937 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f377c1658f0 con 0x7f377c0c5e10 2023-11-30T18:41:54.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.113+0000 7f3781973700 1 -- 172.21.15.49:0/312461937 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f377c06c860 con 0x7f377c0c5e10 2023-11-30T18:41:54.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.114+0000 7f3772ffd700 1 -- 172.21.15.49:0/312461937 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f376402f440 con 0x7f377c0c5e10 2023-11-30T18:41:54.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.114+0000 7f3772ffd700 1 --2- 172.21.15.49:0/312461937 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f375c05f270 0x7f375c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:54.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.114+0000 7f3772ffd700 1 -- 172.21.15.49:0/312461937 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(225..225 src has 1..225) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f376407bfe0 con 0x7f377c0c5e10 2023-11-30T18:41:54.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.114+0000 7f377affd700 1 --2- 172.21.15.49:0/312461937 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f375c05f270 0x7f375c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:54.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.115+0000 7f377affd700 1 --2- 172.21.15.49:0/312461937 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f375c05f270 0x7f375c061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f3774001870 tx=0x7f3774007900).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:54.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.118+0000 7f3772ffd700 1 -- 172.21.15.49:0/312461937 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f376404d180 con 0x7f377c0c5e10 2023-11-30T18:41:54.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.292+0000 7f3781973700 1 -- 172.21.15.49:0/312461937 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f377c0a9390 con 0x7f375c05f270 2023-11-30T18:41:54.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.293+0000 7f3772ffd700 1 -- 172.21.15.49:0/312461937 <== mgr.9772 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f377c0a9390 con 0x7f375c05f270 2023-11-30T18:41:54.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.294+0000 7f3781973700 1 -- 172.21.15.49:0/312461937 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f375c05f270 msgr2=0x7f375c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:54.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.294+0000 7f3781973700 1 --2- 172.21.15.49:0/312461937 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f375c05f270 0x7f375c061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f3774001870 tx=0x7f3774007900).stop 2023-11-30T18:41:54.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.294+0000 7f3781973700 1 -- 172.21.15.49:0/312461937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f377c0c5e10 msgr2=0x7f377c0c6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:54.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.294+0000 7f3781973700 1 --2- 172.21.15.49:0/312461937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f377c0c5e10 0x7f377c0c6290 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 rx=0x7f376400e4b0 tx=0x7f376401a000).stop 2023-11-30T18:41:54.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.294+0000 7f3781973700 1 -- 172.21.15.49:0/312461937 shutdown_connections 2023-11-30T18:41:54.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.294+0000 7f3781973700 1 --2- 172.21.15.49:0/312461937 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f375c05f270 0x7f375c061730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:54.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.294+0000 7f3781973700 1 --2- 172.21.15.49:0/312461937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f377c164c70 0x7f377c1650d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:54.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.295+0000 7f3781973700 1 --2- 172.21.15.49:0/312461937 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3768003e10 0x7f377c14f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:54.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.295+0000 7f3781973700 1 --2- 172.21.15.49:0/312461937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f377c0c5e10 0x7f377c0c6290 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:54.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.295+0000 7f3781973700 1 -- 172.21.15.49:0/312461937 >> 172.21.15.49:0/312461937 conn(0x7f377c0642d0 msgr2=0x7f377c153b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:54.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.295+0000 7f3781973700 1 -- 172.21.15.49:0/312461937 shutdown_connections 2023-11-30T18:41:54.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.295+0000 7f3781973700 1 -- 172.21.15.49:0/312461937 wait complete. 2023-11-30T18:41:54.299 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 7 to deep-scrub 2023-11-30T18:41:54.308 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T18:41:54.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.426+0000 7f4c3b59e700 1 Processor -- start 2023-11-30T18:41:54.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.426+0000 7f4c3b59e700 1 -- start start 2023-11-30T18:41:54.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.427+0000 7f4c3b59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c3c154120 0x7f4c3c0be510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:54.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.427+0000 7f4c3b59e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4c3c0c46e0 0x7f4c3c0bea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:54.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.427+0000 7f4c3b59e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c3c0bfc00 con 0x7f4c3c154500 2023-11-30T18:41:54.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.427+0000 7f4c3b59e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c3c0beff0 con 0x7f4c3c0c46e0 2023-11-30T18:41:54.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.427+0000 7f4c3b59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3c0bf2d0 con 0x7f4c3c154120 2023-11-30T18:41:54.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.427+0000 7f4c3ad9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4c3c0c46e0 0x7f4c3c0bea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:54.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.427+0000 7f4c39d9b700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4c3c154500 0x7f4c3c0c3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53548/0 (socket says 172.21.15.49:53548) 2023-11-30T18:41:54.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.427+0000 7f4c39d9b700 1 -- 172.21.15.49:0/3671444503 learned_addr learned my addr 172.21.15.49:0/3671444503 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-30T18:41:54.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.427+0000 7f4c3a59c700 1 --2- 172.21.15.49:0/3671444503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c3c154120 0x7f4c3c0be510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:54.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.427+0000 7f4c3959a700 1 -- 172.21.15.49:0/3671444503 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2042905698 0 0) 0x7f4c3c0bfc00 con 0x7f4c3c154500 2023-11-30T18:41:54.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.427+0000 7f4c3959a700 1 -- 172.21.15.49:0/3671444503 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c280033f0 con 0x7f4c3c154500 2023-11-30T18:41:54.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.427+0000 7f4c3ad9d700 1 -- 172.21.15.49:0/3671444503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c3c154120 msgr2=0x7f4c3c0be510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:41:54.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.427+0000 7f4c3ad9d700 1 --2- 172.21.15.49:0/3671444503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c3c154120 0x7f4c3c0be510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:54.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.427+0000 7f4c3ad9d700 1 -- 172.21.15.49:0/3671444503 >> v1:172.21.15.49:6789/0 conn(0x7f4c3c154500 legacy=0x7f4c3c0c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:54.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.427+0000 7f4c3ad9d700 1 -- 172.21.15.49:0/3671444503 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c3c0bf5b0 con 0x7f4c3c0c46e0 2023-11-30T18:41:54.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.428+0000 7f4c3ad9d700 1 --2- 172.21.15.49:0/3671444503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c3c0c46e0 0x7f4c3c0bea00 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 rx=0x7f4c2c009760 tx=0x7f4c2c009060).ready entity=mon.0 client_cookie=cfdbb977056ee719 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:54.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.428+0000 7f4c3959a700 1 -- 172.21.15.49:0/3671444503 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c00d4a0 con 0x7f4c3c0c46e0 2023-11-30T18:41:54.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.428+0000 7f4c3959a700 1 -- 172.21.15.49:0/3671444503 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2c00d600 con 0x7f4c3c0c46e0 2023-11-30T18:41:54.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.428+0000 7f4c3959a700 1 -- 172.21.15.49:0/3671444503 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c00d980 con 0x7f4c3c0c46e0 2023-11-30T18:41:54.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.428+0000 7f4c3b59e700 1 -- 172.21.15.49:0/3671444503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c3c0c46e0 msgr2=0x7f4c3c0bea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:54.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.428+0000 7f4c3b59e700 1 --2- 172.21.15.49:0/3671444503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c3c0c46e0 0x7f4c3c0bea00 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 rx=0x7f4c2c009760 tx=0x7f4c2c009060).stop 2023-11-30T18:41:54.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.428+0000 7f4c3b59e700 1 -- 172.21.15.49:0/3671444503 shutdown_connections 2023-11-30T18:41:54.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.428+0000 7f4c3b59e700 1 --2- 172.21.15.49:0/3671444503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c3c0c46e0 0x7f4c3c0bea00 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:54.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.428+0000 7f4c3b59e700 1 --2- 172.21.15.49:0/3671444503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c3c154120 0x7f4c3c0be510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:54.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.428+0000 7f4c3b59e700 1 -- 172.21.15.49:0/3671444503 >> 172.21.15.49:0/3671444503 conn(0x7f4c3c083000 msgr2=0x7f4c3c092540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:54.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.428+0000 7f4c3b59e700 1 -- 172.21.15.49:0/3671444503 shutdown_connections 2023-11-30T18:41:54.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.428+0000 7f4c3b59e700 1 -- 172.21.15.49:0/3671444503 wait complete. 2023-11-30T18:41:54.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.429+0000 7f4c3b59e700 1 Processor -- start 2023-11-30T18:41:54.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.429+0000 7f4c3b59e700 1 -- start start 2023-11-30T18:41:54.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.430+0000 7f4c3b59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c3c0c46e0 0x7f4c3c14f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:54.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.430+0000 7f4c3b59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c3c154120 0x7f4c3c0acac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:54.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.430+0000 7f4c3b59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c3c154500 0x7f4c3c0ad3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:54.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.430+0000 7f4c3b59e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3c0a9900 con 0x7f4c3c154500 2023-11-30T18:41:54.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.430+0000 7f4c3b59e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3c0a9be0 con 0x7f4c3c154120 2023-11-30T18:41:54.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.430+0000 7f4c3b59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3c0a9ec0 con 0x7f4c3c0c46e0 2023-11-30T18:41:54.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.430+0000 7f4c3ad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c3c154500 0x7f4c3c0ad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:54.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.430+0000 7f4c3ad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c3c154500 0x7f4c3c0ad3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59380/0 (socket says 172.21.15.49:59380) 2023-11-30T18:41:54.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.430+0000 7f4c3ad9d700 1 -- 172.21.15.49:0/1398288520 learned_addr learned my addr 172.21.15.49:0/1398288520 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:41:54.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.430+0000 7f4c3a59c700 1 --2- 172.21.15.49:0/1398288520 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c3c0c46e0 0x7f4c3c14f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:54.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.430+0000 7f4c39d9b700 1 --2- 172.21.15.49:0/1398288520 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c3c154120 0x7f4c3c0acac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:54.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.431+0000 7f4c3ad9d700 1 -- 172.21.15.49:0/1398288520 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c3c0c46e0 msgr2=0x7f4c3c14f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:54.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.431+0000 7f4c3ad9d700 1 --2- 172.21.15.49:0/1398288520 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c3c0c46e0 0x7f4c3c14f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:54.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.431+0000 7f4c3ad9d700 1 -- 172.21.15.49:0/1398288520 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c3c154120 msgr2=0x7f4c3c0acac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:54.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.431+0000 7f4c3ad9d700 1 --2- 172.21.15.49:0/1398288520 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c3c154120 0x7f4c3c0acac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:54.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.431+0000 7f4c3ad9d700 1 -- 172.21.15.49:0/1398288520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2c0092a0 con 0x7f4c3c154500 2023-11-30T18:41:54.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.431+0000 7f4c3ad9d700 1 --2- 172.21.15.49:0/1398288520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c3c154500 0x7f4c3c0ad3f0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 rx=0x7f4c3c083490 tx=0x7f4c2c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:54.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.431+0000 7f4c327fc700 1 -- 172.21.15.49:0/1398288520 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c00d4a0 con 0x7f4c3c154500 2023-11-30T18:41:54.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.431+0000 7f4c327fc700 1 -- 172.21.15.49:0/1398288520 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2c00d770 con 0x7f4c3c154500 2023-11-30T18:41:54.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.431+0000 7f4c3b59e700 1 -- 172.21.15.49:0/1398288520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c3c0aa1a0 con 0x7f4c3c154500 2023-11-30T18:41:54.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.431+0000 7f4c327fc700 1 -- 172.21.15.49:0/1398288520 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c01d430 con 0x7f4c3c154500 2023-11-30T18:41:54.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.431+0000 7f4c3b59e700 1 -- 172.21.15.49:0/1398288520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c3c14f720 con 0x7f4c3c154500 2023-11-30T18:41:54.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.432+0000 7f4c3b59e700 1 -- 172.21.15.49:0/1398288520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c3c06c7c0 con 0x7f4c3c154500 2023-11-30T18:41:54.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.432+0000 7f4c327fc700 1 -- 172.21.15.49:0/1398288520 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4c2c01d7a0 con 0x7f4c3c154500 2023-11-30T18:41:54.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.433+0000 7f4c327fc700 1 --2- 172.21.15.49:0/1398288520 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4c1c05f270 0x7f4c1c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:41:54.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.433+0000 7f4c327fc700 1 -- 172.21.15.49:0/1398288520 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(225..225 src has 1..225) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f4c2c07bb90 con 0x7f4c3c154500 2023-11-30T18:41:54.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.433+0000 7f4c3a59c700 1 --2- 172.21.15.49:0/1398288520 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4c1c05f270 0x7f4c1c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:41:54.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.433+0000 7f4c3a59c700 1 --2- 172.21.15.49:0/1398288520 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4c1c05f270 0x7f4c1c061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f4c3400f5b0 tx=0x7f4c3400b040).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:41:54.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.437+0000 7f4c327fc700 1 -- 172.21.15.49:0/1398288520 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4c2c04cd90 con 0x7f4c3c154500 2023-11-30T18:41:54.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.604+0000 7f4c3b59e700 1 -- 172.21.15.49:0/1398288520 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4c3c0aa640 con 0x7f4c1c05f270 2023-11-30T18:41:54.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.607+0000 7f4c327fc700 1 -- 172.21.15.49:0/1398288520 <== mgr.9772 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71099 (secure 0 0 0) 0x7f4c3c0aa640 con 0x7f4c1c05f270 2023-11-30T18:41:54.610 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:41:54.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.609+0000 7f4c3b59e700 1 -- 172.21.15.49:0/1398288520 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4c1c05f270 msgr2=0x7f4c1c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:54.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.609+0000 7f4c3b59e700 1 --2- 172.21.15.49:0/1398288520 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4c1c05f270 0x7f4c1c061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f4c3400f5b0 tx=0x7f4c3400b040).stop 2023-11-30T18:41:54.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.609+0000 7f4c3b59e700 1 -- 172.21.15.49:0/1398288520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c3c154500 msgr2=0x7f4c3c0ad3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:41:54.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.609+0000 7f4c3b59e700 1 --2- 172.21.15.49:0/1398288520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c3c154500 0x7f4c3c0ad3f0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 rx=0x7f4c3c083490 tx=0x7f4c2c016000).stop 2023-11-30T18:41:54.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.609+0000 7f4c3b59e700 1 -- 172.21.15.49:0/1398288520 shutdown_connections 2023-11-30T18:41:54.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.609+0000 7f4c3b59e700 1 --2- 172.21.15.49:0/1398288520 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f4c1c05f270 0x7f4c1c061730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:54.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.609+0000 7f4c3b59e700 1 --2- 172.21.15.49:0/1398288520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c3c154500 0x7f4c3c0ad3f0 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:54.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.609+0000 7f4c3b59e700 1 --2- 172.21.15.49:0/1398288520 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c3c0c46e0 0x7f4c3c14f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:54.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.609+0000 7f4c3b59e700 1 --2- 172.21.15.49:0/1398288520 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c3c154120 0x7f4c3c0acac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:41:54.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.609+0000 7f4c3b59e700 1 -- 172.21.15.49:0/1398288520 >> 172.21.15.49:0/1398288520 conn(0x7f4c3c083000 msgr2=0x7f4c3c0c79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:41:54.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.609+0000 7f4c3b59e700 1 -- 172.21.15.49:0/1398288520 shutdown_connections 2023-11-30T18:41:54.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:41:54.609+0000 7f4c3b59e700 1 -- 172.21.15.49:0/1398288520 wait complete. 2023-11-30T18:41:54.612 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T18:41:54.622 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2023-11-30T18:41:52.897492+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2460384,"kb_used_data":22048,"kb_used_omap":0,"kb_used_meta":2438272,"kb_avail":752514336,"statfs":{"total":773094113280,"available":770574680064,"internally_reserved":0,"allocated":22577152,"data_stored":11619448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2496790528},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13043,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-64,"num_write_kb":-36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.212215"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":191,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.428905+0000","last_change":"2023-11-30T17:07:12.300473+0000","last_active":"2023-11-30T18:41:44.428905+0000","last_peered":"2023-11-30T18:41:44.428905+0000","last_clean":"2023-11-30T18:41:44.428905+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T18:41:44.428905+0000","last_undegraded":"2023-11-30T18:41:44.428905+0000","last_fullsized":"2023-11-30T18:41:44.428905+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":187,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.428979+0000","last_change":"2023-11-30T17:07:11.875121+0000","last_active":"2023-11-30T18:41:44.428979+0000","last_peered":"2023-11-30T18:41:44.428979+0000","last_clean":"2023-11-30T18:41:44.428979+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T18:41:44.428979+0000","last_undegraded":"2023-11-30T18:41:44.428979+0000","last_fullsized":"2023-11-30T18:41:44.428979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":195,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.430709+0000","last_change":"2023-11-30T17:07:11.873903+0000","last_active":"2023-11-30T18:41:44.430709+0000","last_peered":"2023-11-30T18:41:44.430709+0000","last_clean":"2023-11-30T18:41:44.430709+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T18:41:44.430709+0000","last_undegraded":"2023-11-30T18:41:44.430709+0000","last_fullsized":"2023-11-30T18:41:44.430709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":187,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.430859+0000","last_change":"2023-11-30T17:07:11.876907+0000","last_active":"2023-11-30T18:41:44.430859+0000","last_peered":"2023-11-30T18:41:44.430859+0000","last_clean":"2023-11-30T18:41:44.430859+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T18:41:44.430859+0000","last_undegraded":"2023-11-30T18:41:44.430859+0000","last_fullsized":"2023-11-30T18:41:44.430859+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":183,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.428147+0000","last_change":"2023-11-30T17:07:10.327932+0000","last_active":"2023-11-30T18:41:44.428147+0000","last_peered":"2023-11-30T18:41:44.428147+0000","last_clean":"2023-11-30T18:41:44.428147+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T18:41:44.428147+0000","last_undegraded":"2023-11-30T18:41:44.428147+0000","last_fullsized":"2023-11-30T18:41:44.428147+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:08.852991+0000","last_clean_scrub_stamp":"2023-11-30T17:07:08.852991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":181,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.428241+0000","last_change":"2023-11-30T17:07:11.875079+0000","last_active":"2023-11-30T18:41:44.428241+0000","last_peered":"2023-11-30T18:41:44.428241+0000","last_clean":"2023-11-30T18:41:44.428241+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T18:41:44.428241+0000","last_undegraded":"2023-11-30T18:41:44.428241+0000","last_fullsized":"2023-11-30T18:41:44.428241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.434931+0000","last_change":"2023-11-30T17:07:12.300861+0000","last_active":"2023-11-30T18:41:44.434931+0000","last_peered":"2023-11-30T18:41:44.434931+0000","last_clean":"2023-11-30T18:41:44.434931+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T18:41:44.434931+0000","last_undegraded":"2023-11-30T18:41:44.434931+0000","last_fullsized":"2023-11-30T18:41:44.434931+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":191,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.428827+0000","last_change":"2023-11-30T17:07:11.877153+0000","last_active":"2023-11-30T18:41:44.428827+0000","last_peered":"2023-11-30T18:41:44.428827+0000","last_clean":"2023-11-30T18:41:44.428827+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T18:41:44.428827+0000","last_undegraded":"2023-11-30T18:41:44.428827+0000","last_fullsized":"2023-11-30T18:41:44.428827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":212,"reported_epoch":224,"state":"active+clean","last_fresh":"2023-11-30T18:41:44.117140+0000","last_change":"2023-11-30T17:07:11.877285+0000","last_active":"2023-11-30T18:41:44.117140+0000","last_peered":"2023-11-30T18:41:44.117140+0000","last_clean":"2023-11-30T18:41:44.117140+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T18:41:44.117140+0000","last_undegraded":"2023-11-30T18:41:44.117140+0000","last_fullsized":"2023-11-30T18:41:44.117140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T17:07:10.862159+0000","last_clean_scrub_stamp":"2023-11-30T17:07:10.862159+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575974,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303948,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94067892,"statfs":{"total":96636764160,"available":96325521408,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.377,"5min":0.34200000000000003,"15min":0.28699999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.84799999999999998},"last":0.745},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.621,"15min":0.63},"min":{"1min":0.46999999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82099999999999995,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.72799999999999998}]},{"osd":1,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.39500000000000002,"5min":0.36199999999999999,"15min":0.35899999999999999},"max":{"1min":0.74199999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56000000000000005,"15min":0.57399999999999995},"min":{"1min":0.38400000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73199999999999998,"5min":0.77800000000000002,"15min":0.877},"last":0.78100000000000003}]},{"osd":2,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.81100000000000005},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.44600000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79300000000000004,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55800000000000005,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.372,"15min":0.35899999999999999},"max":{"1min":0.78100000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59499999999999997,"15min":0.60699999999999998},"min":{"1min":0.42699999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77600000000000002,"5min":0.80400000000000005,"15min":0.89900000000000002},"last":0.70199999999999996}]},{"osd":4,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46600000000000003,"15min":0.46500000000000002},"min":{"1min":0.32100000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.66100000000000003,"5min":1.264,"15min":1.264},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.48699999999999999,"15min":0.48999999999999999},"min":{"1min":0.307,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.64400000000000002,"5min":1.149,"15min":1.149},"last":0.80300000000000005}]},{"osd":5,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.498,"15min":0.497},"min":{"1min":0.32200000000000001,"5min":0.30599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71099999999999997,"5min":0.78200000000000003,"15min":0.83399999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.497,"5min":0.52900000000000003,"15min":0.53100000000000003},"min":{"1min":0.38400000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66800000000000004,"5min":1.286,"15min":1.286},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.38100000000000001,"5min":0.33000000000000002,"15min":0.32300000000000001},"max":{"1min":0.72699999999999998,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54700000000000004,"15min":0.55400000000000005},"min":{"1min":0.34799999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.68799999999999994,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.65400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575973,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308044,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063796,"statfs":{"total":96636764160,"available":96321327104,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58999999999999997,"15min":0.60799999999999998},"min":{"1min":0.38500000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.79500000000000004,"5min":0.80500000000000005,"15min":1.6379999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.61399999999999999,"15min":0.622},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.27800000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":1.246},"last":0.61599999999999999}]},{"osd":1,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.58199999999999996,"15min":0.60599999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72399999999999998,"5min":0.78400000000000003,"15min":1.1200000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60799999999999998,"15min":0.628},"min":{"1min":0.40400000000000003,"5min":0.39100000000000001,"15min":0.35499999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.90400000000000003},"last":0.67100000000000004}]},{"osd":2,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58599999999999997,"15min":0.59699999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.34499999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":1.288},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.60199999999999998,"15min":0.626},"min":{"1min":0.40000000000000002,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":1.177},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.54600000000000004,"15min":0.56999999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.33400000000000002},"max":{"1min":0.76700000000000002,"5min":0.79400000000000004,"15min":1.204},"last":0.495},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55100000000000005,"15min":0.56599999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.68200000000000005,"5min":0.78300000000000003,"15min":1.337},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.45200000000000001,"15min":0.47299999999999998},"min":{"1min":0.34200000000000003,"5min":0.32500000000000001,"15min":0.28699999999999998},"max":{"1min":0.68799999999999994,"5min":0.80800000000000005,"15min":1.51},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.47699999999999998,"15min":0.49299999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.30399999999999999},"max":{"1min":0.77400000000000002,"5min":0.79300000000000004,"15min":0.94299999999999995},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.46000000000000002,"15min":0.47299999999999998},"min":{"1min":0.33200000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72699999999999998,"5min":0.77600000000000002,"15min":1.159},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.51600000000000001,"15min":0.53100000000000003},"min":{"1min":0.30599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.747,"5min":0.84899999999999998,"15min":1.679},"last":0.65900000000000003}]},{"osd":7,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52900000000000003,"15min":0.54100000000000004},"min":{"1min":0.38,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73499999999999999,"5min":0.83899999999999997,"15min":0.96199999999999997},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77000000000000002,"5min":0.89100000000000001,"15min":1.427},"last":0.68400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575973,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.35699999999999998,"15min":0.374},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59499999999999997,"5min":0.66300000000000003,"15min":0.79900000000000004},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.47799999999999998,"15min":0.503},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71699999999999997,"5min":0.78800000000000003,"15min":0.87},"last":0.316}]},{"osd":2,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39000000000000001,"15min":0.40799999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.60399999999999998,"5min":0.64700000000000002,"15min":0.89100000000000001},"last":0.245},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.497,"15min":0.52400000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.63400000000000001,"5min":0.80300000000000005,"15min":0.98599999999999999},"last":0.38}]},{"osd":3,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46200000000000002,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68899999999999995,"5min":0.749,"15min":0.91900000000000004},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.439,"15min":0.45500000000000002},"min":{"1min":0.308,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66100000000000003,"5min":0.71399999999999997,"15min":0.84599999999999997},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59299999999999997,"15min":0.61199999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":0.89000000000000001,"5min":0.89800000000000002,"15min":0.93999999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63900000000000001,"15min":0.66200000000000003},"min":{"1min":0.46200000000000002,"5min":0.45500000000000002,"15min":0.42299999999999999},"max":{"1min":0.94799999999999995,"5min":1.0329999999999999,"15min":1.0700000000000001},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60899999999999999,"15min":0.627},"min":{"1min":0.43099999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76300000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.63100000000000001,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.39200000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.98099999999999998},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.67800000000000005,"15min":0.69999999999999996},"min":{"1min":0.46000000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.99099999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.75},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.66300000000000003,"15min":0.68300000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.40799999999999997},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":1.004},"last":0.76500000000000001}]},{"osd":7,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68600000000000005,"15min":0.70499999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46100000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":1.012},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.66900000000000004,"15min":0.68899999999999995},"min":{"1min":0.46600000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.96399999999999997,"5min":0.97599999999999998,"15min":1.02},"last":0.64900000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575973,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.39300000000000002,"15min":0.39600000000000002},"min":{"1min":0.26000000000000001,"5min":0.252,"15min":0.22900000000000001},"max":{"1min":0.45900000000000002,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42299999999999999,"15min":0.41899999999999998},"min":{"1min":0.28399999999999997,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.497,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.35199999999999998}]},{"osd":2,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.40699999999999997,"15min":0.41399999999999998},"min":{"1min":0.26000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.63500000000000001,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48599999999999999,"15min":0.495},"min":{"1min":0.36799999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.626,"5min":0.69799999999999995,"15min":0.74199999999999999},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.47299999999999998,"15min":0.46200000000000002},"min":{"1min":0.33500000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.54200000000000004,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.371},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.47299999999999998,"15min":0.47099999999999997},"min":{"1min":0.33100000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.57899999999999996,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.38}]},{"osd":4,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61699999999999999,"15min":0.63300000000000001},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.40200000000000002},"max":{"1min":0.72299999999999998,"5min":0.85399999999999998,"15min":1.026},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65200000000000002,"15min":0.65500000000000003},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84299999999999997,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.57799999999999996}]},{"osd":5,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.48799999999999999,"5min":0.41799999999999998,"15min":0.40400000000000003},"max":{"1min":0.86399999999999999,"5min":0.97699999999999998,"15min":0.97799999999999998},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.64100000000000001,"15min":0.66100000000000003},"min":{"1min":0.48399999999999999,"5min":0.47199999999999998,"15min":0.439},"max":{"1min":0.751,"5min":0.91000000000000003,"15min":1.079},"last":0.47899999999999998}]},{"osd":6,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67500000000000004,"15min":0.68200000000000005},"min":{"1min":0.48399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.67500000000000004,"15min":0.67800000000000005},"min":{"1min":0.45200000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91500000000000004,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.503}]},{"osd":7,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.67800000000000005,"15min":0.69499999999999995},"min":{"1min":0.45800000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82999999999999996,"5min":0.94099999999999995,"15min":1.123},"last":0.498},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71699999999999997,"15min":0.73199999999999998},"min":{"1min":0.56399999999999995,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92000000000000004,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.62}]}]},{"osd":2,"up_from":13,"seq":55834575973,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40699999999999997,"15min":0.41499999999999998},"min":{"1min":0.28000000000000003,"5min":0.249,"15min":0.23200000000000001},"max":{"1min":0.54600000000000004,"5min":0.64800000000000002,"15min":0.72099999999999997},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45200000000000001,"15min":0.45800000000000002},"min":{"1min":0.29199999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.623,"5min":0.63400000000000001,"15min":0.73199999999999998},"last":0.371}]},{"osd":1,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.45100000000000001,"15min":0.46000000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.66800000000000004,"5min":0.70599999999999996,"15min":0.74299999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48899999999999999,"15min":0.49199999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.29899999999999999},"max":{"1min":0.68700000000000006,"5min":0.746,"15min":0.752},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.42199999999999999,"15min":0.42299999999999999},"min":{"1min":0.29399999999999998,"5min":0.28399999999999997,"15min":0.27500000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.49099999999999999,"15min":0.496},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.77100000000000002},"last":0.312}]},{"osd":4,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.496,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81299999999999994,"5min":0.91900000000000004,"15min":0.95299999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.61599999999999999,"15min":0.63600000000000001},"min":{"1min":0.46800000000000003,"5min":0.42199999999999999,"15min":0.35899999999999999},"max":{"1min":0.83399999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.63200000000000001}]},{"osd":5,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64700000000000002,"15min":0.66000000000000003},"min":{"1min":0.435,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89900000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65100000000000002,"15min":0.66500000000000004},"min":{"1min":0.52500000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80200000000000005,"5min":1.01,"15min":1.01},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63900000000000001,"15min":0.64800000000000002},"min":{"1min":0.50900000000000001,"5min":0.432,"15min":0.40500000000000003},"max":{"1min":0.81899999999999995,"5min":0.93000000000000005,"15min":0.93200000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.67900000000000005,"15min":0.69499999999999995},"min":{"1min":0.53400000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88500000000000001,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Nov 30 18:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67900000000000005,"15min":0.68999999999999995},"min":{"1min":0.53700000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96499999999999997,"5min":0.97799999999999998,"15min":1.0109999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69699999999999995,"15min":0.71399999999999997},"min":{"1min":0.51100000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.91300000000000003,"5min":0.97899999999999998,"15min":0.98699999999999999},"last":0.66100000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575973,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299980,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94071860,"statfs":{"total":96636764160,"available":96329584640,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38200000000000001,"15min":0.38},"min":{"1min":0.26300000000000001,"5min":0.254,"15min":0.222},"max":{"1min":0.60899999999999999,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.42299999999999999,"15min":0.42599999999999999},"min":{"1min":0.29999999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.56000000000000005,"5min":0.64200000000000002,"15min":0.754},"last":0.32200000000000001}]},{"osd":1,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39400000000000002,"15min":0.40300000000000002},"min":{"1min":0.28799999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.59499999999999997,"5min":0.65800000000000003,"15min":0.73399999999999999},"last":0.377},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.442,"15min":0.45200000000000001},"min":{"1min":0.32300000000000001,"5min":0.28699999999999998,"15min":0.25700000000000001},"max":{"1min":0.65900000000000003,"5min":0.66800000000000004,"15min":0.86699999999999999},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47399999999999998,"15min":0.47299999999999998},"min":{"1min":0.35599999999999998,"5min":0.29299999999999998,"15min":0.27800000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.79500000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51500000000000001,"15min":0.52100000000000002},"min":{"1min":0.41399999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.747,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.434,"5min":0.39100000000000001,"15min":0.35299999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63800000000000001,"15min":0.64700000000000002},"min":{"1min":0.42499999999999999,"5min":0.40300000000000002,"15min":0.40100000000000002},"max":{"1min":0.91800000000000004,"5min":0.97799999999999998,"15min":1.0049999999999999},"last":0.441}]},{"osd":5,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63500000000000001,"15min":0.64200000000000002},"min":{"1min":0.45500000000000002,"5min":0.41499999999999998,"15min":0.40699999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65300000000000002,"15min":0.66400000000000003},"min":{"1min":0.51300000000000001,"5min":0.41299999999999998,"15min":0.34499999999999997},"max":{"1min":1.038,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.52500000000000002}]},{"osd":6,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67300000000000004,"15min":0.67900000000000005},"min":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.377},"max":{"1min":1.004,"5min":1.0189999999999999,"15min":1.0309999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66500000000000004,"15min":0.68500000000000005},"min":{"1min":0.52200000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Nov 30 18:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.68000000000000005,"15min":0.69899999999999995},"min":{"1min":0.48299999999999998,"5min":0.434,"15min":0.434},"max":{"1min":1.03,"5min":1.03,"15min":1.052},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.67900000000000005,"15min":0.69899999999999995},"min":{"1min":0.48599999999999999,"5min":0.441,"15min":0.441},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.51700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575973,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303948,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94067892,"statfs":{"total":96636764160,"available":96325521408,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52200000000000002,"15min":0.55500000000000005},"min":{"1min":0.315,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.85499999999999998},"last":0.499},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54800000000000004,"15min":0.56499999999999995},"min":{"1min":0.376,"5min":0.34100000000000003,"15min":0.32500000000000001},"max":{"1min":0.77200000000000002,"5min":0.77500000000000002,"15min":0.94999999999999996},"last":0.40500000000000003}]},{"osd":1,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54000000000000004,"15min":0.56399999999999995},"min":{"1min":0.314,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.876},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.54800000000000004,"15min":0.57699999999999996},"min":{"1min":0.34899999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69799999999999995,"5min":0.81399999999999995,"15min":0.91200000000000003},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.57599999999999996,"15min":0.59699999999999998},"min":{"1min":0.33400000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.79000000000000004,"5min":0.81200000000000006,"15min":0.93799999999999994},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.58599999999999997,"15min":0.621},"min":{"1min":0.371,"5min":0.35999999999999999,"15min":0.34899999999999998},"max":{"1min":0.77700000000000002,"5min":0.82299999999999995,"15min":0.94399999999999995},"last":0.60099999999999998}]},{"osd":3,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.53700000000000003,"15min":0.56000000000000005},"min":{"1min":0.38,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70899999999999996,"5min":0.73999999999999999,"15min":0.84999999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.56100000000000005,"15min":0.59599999999999997},"min":{"1min":0.432,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.80300000000000005,"5min":0.80800000000000005,"15min":0.872},"last":0.56499999999999995}]},{"osd":5,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42499999999999999,"15min":0.44700000000000001},"min":{"1min":0.32300000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.626,"5min":0.66600000000000004,"15min":0.86399999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.45000000000000001,"15min":0.46800000000000003},"min":{"1min":0.33700000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.82299999999999995},"last":0.51300000000000001}]},{"osd":6,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.47899999999999998,"15min":0.51100000000000001},"min":{"1min":0.36099999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":1.1399999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52200000000000002,"15min":0.55800000000000005},"min":{"1min":0.39800000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":1.1220000000000001},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.47999999999999998,"15min":0.52300000000000002},"min":{"1min":0.36099999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77100000000000002,"5min":0.77400000000000002,"15min":0.90000000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55200000000000005,"15min":0.58099999999999996},"min":{"1min":0.44,"5min":0.38600000000000001,"15min":0.35599999999999998},"max":{"1min":0.72899999999999998,"5min":0.73599999999999999,"15min":0.86199999999999999},"last":0.55900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575973,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308044,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063796,"statfs":{"total":96636764160,"available":96321327104,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.40799999999999997,"5min":0.317,"15min":0.29799999999999999},"max":{"1min":0.78000000000000003,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.53800000000000003,"15min":0.55100000000000005},"min":{"1min":0.38800000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.90300000000000002},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53900000000000003},"min":{"1min":0.35099999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.83699999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56699999999999995,"15min":0.57399999999999995},"min":{"1min":0.44,"5min":0.307,"15min":0.307},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.82899999999999996},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59899999999999998,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.99199999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.432,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":1.173},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56499999999999995,"15min":0.56799999999999995},"min":{"1min":0.38200000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.747,"5min":0.77700000000000002,"15min":0.79300000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58199999999999996,"15min":0.59499999999999997},"min":{"1min":0.46800000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":1.603},"last":0.54500000000000004}]},{"osd":4,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.317,"5min":0.311,"15min":0.311},"max":{"1min":0.64500000000000002,"5min":0.68000000000000005,"15min":0.75},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.35999999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.69799999999999995,"5min":0.77900000000000003,"15min":0.81200000000000006},"last":0.38700000000000001}]},{"osd":6,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48499999999999999,"15min":0.498},"min":{"1min":0.34499999999999997,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68799999999999994,"5min":0.75900000000000001,"15min":1.105},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56499999999999995,"15min":0.57199999999999995},"min":{"1min":0.34100000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81000000000000005,"5min":0.85299999999999998,"15min":1.228},"last":0.36899999999999999}]},{"osd":7,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.33000000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69699999999999995,"5min":0.72199999999999998,"15min":0.88100000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.39700000000000002,"5min":0.376,"15min":0.317},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":1.0640000000000001},"last":0.42799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T18:41:54.626 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-30T17:07:10.862159+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=18, tm_min=41, tm_sec=49, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T18:41:54.626 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-30T17:07:10.862159+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=18, tm_min=41, tm_sec=49, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T18:41:54.626 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-30T17:07:10.862159+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=18, tm_min=41, tm_sec=49, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T18:41:54.626 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-30T17:07:10.862159+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=18, tm_min=41, tm_sec=49, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T18:41:54.626 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-30T17:07:08.852991+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=8, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=18, tm_min=41, tm_sec=49, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T18:41:54.626 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-30T17:07:10.862159+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=18, tm_min=41, tm_sec=49, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T18:41:54.627 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-30T17:07:10.862159+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=18, tm_min=41, tm_sec=49, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T18:41:54.627 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-30T17:07:10.862159+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=18, tm_min=41, tm_sec=49, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T18:41:54.627 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-30T17:07:10.862159+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=18, tm_min=41, tm_sec=49, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T18:41:54.627 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-30T18:42:09.836 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:42:09.839 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:42:14.628 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T18:42:14.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.760+0000 7f29c6009700 1 Processor -- start 2023-11-30T18:42:14.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.760+0000 7f29c6009700 1 -- start start 2023-11-30T18:42:14.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.761+0000 7f29c6009700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f29c0157f50 0x7f29c00c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:42:14.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.761+0000 7f29c6009700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29c00be910 0x7f29c00c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:42:14.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.761+0000 7f29c6009700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29c00a88b0 con 0x7f29c0154270 2023-11-30T18:42:14.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.761+0000 7f29c6009700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29c00c63c0 con 0x7f29c0157f50 2023-11-30T18:42:14.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.761+0000 7f29c6009700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c00c77b0 con 0x7f29c00be910 2023-11-30T18:42:14.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.761+0000 7f29bffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29c00be910 0x7f29c00c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:42:14.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.762+0000 7f29beffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f29c0157f50 0x7f29c00c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:42:14.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.762+0000 7f29bffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29c00be910 0x7f29c00c5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.49:45678/0 (socket says 172.21.15.49:45678) 2023-11-30T18:42:14.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.762+0000 7f29bffff700 1 -- 172.21.15.49:0/2371377405 learned_addr learned my addr 172.21.15.49:0/2371377405 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:42:14.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.762+0000 7f29bf7fe700 1 --1- 172.21.15.49:0/2371377405 >> v1:172.21.15.115:6789/0 conn(0x7f29c0154270 0x7f29c00a81a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.49:57914/0 (socket says 172.21.15.49:57914) 2023-11-30T18:42:14.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.762+0000 7f29be7fc700 1 -- 172.21.15.49:0/2371377405 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648109562 0 0) 0x7f29c00a88b0 con 0x7f29c0154270 2023-11-30T18:42:14.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.762+0000 7f29be7fc700 1 -- 172.21.15.49:0/2371377405 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29a80033f0 con 0x7f29c0154270 2023-11-30T18:42:14.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.762+0000 7f29bffff700 1 -- 172.21.15.49:0/2371377405 >> v2:172.21.15.115:3300/0 conn(0x7f29c0157f50 msgr2=0x7f29c00c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:42:14.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.762+0000 7f29bffff700 1 --2- 172.21.15.49:0/2371377405 >> v2:172.21.15.115:3300/0 conn(0x7f29c0157f50 0x7f29c00c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:14.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.762+0000 7f29bffff700 1 -- 172.21.15.49:0/2371377405 >> v1:172.21.15.115:6789/0 conn(0x7f29c0154270 legacy=0x7f29c00a81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:42:14.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.762+0000 7f29bffff700 1 -- 172.21.15.49:0/2371377405 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c0158450 con 0x7f29c00be910 2023-11-30T18:42:14.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.762+0000 7f29beffd700 1 --2- 172.21.15.49:0/2371377405 >> v2:172.21.15.115:3300/0 conn(0x7f29c0157f50 0x7f29c00c59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:42:14.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.762+0000 7f29bffff700 1 --2- 172.21.15.49:0/2371377405 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29c00be910 0x7f29c00c5ed0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f29b8009f20 tx=0x7f29b8009840).ready entity=mon.2 client_cookie=e0974403d38b2c05 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:42:14.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.762+0000 7f29be7fc700 1 -- 172.21.15.49:0/2371377405 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b800e070 con 0x7f29c00be910 2023-11-30T18:42:14.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.762+0000 7f29be7fc700 1 -- 172.21.15.49:0/2371377405 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b800b970 con 0x7f29c00be910 2023-11-30T18:42:14.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.762+0000 7f29be7fc700 1 -- 172.21.15.49:0/2371377405 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b800bcf0 con 0x7f29c00be910 2023-11-30T18:42:14.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.763+0000 7f29c6009700 1 -- 172.21.15.49:0/2371377405 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29c00be910 msgr2=0x7f29c00c5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:42:14.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.763+0000 7f29c6009700 1 --2- 172.21.15.49:0/2371377405 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29c00be910 0x7f29c00c5ed0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f29b8009f20 tx=0x7f29b8009840).stop 2023-11-30T18:42:14.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.763+0000 7f29c6009700 1 -- 172.21.15.49:0/2371377405 shutdown_connections 2023-11-30T18:42:14.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.763+0000 7f29c6009700 1 --2- 172.21.15.49:0/2371377405 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29c00be910 0x7f29c00c5ed0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:14.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.763+0000 7f29c6009700 1 --2- 172.21.15.49:0/2371377405 >> v2:172.21.15.115:3300/0 conn(0x7f29c0157f50 0x7f29c00c59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:14.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.763+0000 7f29c6009700 1 -- 172.21.15.49:0/2371377405 >> 172.21.15.49:0/2371377405 conn(0x7f29c0062700 msgr2=0x7f29c0062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:42:14.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.763+0000 7f29c6009700 1 -- 172.21.15.49:0/2371377405 shutdown_connections 2023-11-30T18:42:14.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.763+0000 7f29c6009700 1 -- 172.21.15.49:0/2371377405 wait complete. 2023-11-30T18:42:14.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.764+0000 7f29c6009700 1 Processor -- start 2023-11-30T18:42:14.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.764+0000 7f29c6009700 1 -- start start 2023-11-30T18:42:14.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.765+0000 7f29c6009700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29c00be910 0x7f29c0144b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:42:14.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.765+0000 7f29c6009700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29c0154270 0x7f29c00a8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:42:14.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.765+0000 7f29c6009700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29c0157f50 0x7f29c00c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:42:14.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.765+0000 7f29c6009700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c00aa8f0 con 0x7f29c00be910 2023-11-30T18:42:14.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.765+0000 7f29c6009700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c00aabd0 con 0x7f29c0154270 2023-11-30T18:42:14.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.765+0000 7f29c6009700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c00aaeb0 con 0x7f29c0157f50 2023-11-30T18:42:14.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.765+0000 7f29bf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29c00be910 0x7f29c0144b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:42:14.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.765+0000 7f29bf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29c00be910 0x7f29c0144b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43042/0 (socket says 172.21.15.49:43042) 2023-11-30T18:42:14.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.765+0000 7f29bf7fe700 1 -- 172.21.15.49:0/3425222630 learned_addr learned my addr 172.21.15.49:0/3425222630 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:42:14.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.765+0000 7f29bffff700 1 --2- 172.21.15.49:0/3425222630 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29c0157f50 0x7f29c00c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:42:14.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.765+0000 7f29beffd700 1 --2- 172.21.15.49:0/3425222630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29c0154270 0x7f29c00a8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:42:14.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.765+0000 7f29bf7fe700 1 -- 172.21.15.49:0/3425222630 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29c0157f50 msgr2=0x7f29c00c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:42:14.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.765+0000 7f29bf7fe700 1 --2- 172.21.15.49:0/3425222630 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29c0157f50 0x7f29c00c9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:14.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.766+0000 7f29bf7fe700 1 -- 172.21.15.49:0/3425222630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29c0154270 msgr2=0x7f29c00a8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:42:14.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.766+0000 7f29bf7fe700 1 --2- 172.21.15.49:0/3425222630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29c0154270 0x7f29c00a8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:14.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.766+0000 7f29bf7fe700 1 -- 172.21.15.49:0/3425222630 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b40092a0 con 0x7f29c00be910 2023-11-30T18:42:14.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.766+0000 7f29bf7fe700 1 --2- 172.21.15.49:0/3425222630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29c00be910 0x7f29c0144b40 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 rx=0x7f29b000c590 tx=0x7f29b0007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:42:14.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.766+0000 7f29a77fe700 1 -- 172.21.15.49:0/3425222630 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b00072e0 con 0x7f29c00be910 2023-11-30T18:42:14.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.766+0000 7f29a77fe700 1 -- 172.21.15.49:0/3425222630 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b0007440 con 0x7f29c00be910 2023-11-30T18:42:14.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.766+0000 7f29c6009700 1 -- 172.21.15.49:0/3425222630 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b8009ae0 con 0x7f29c00be910 2023-11-30T18:42:14.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.766+0000 7f29a77fe700 1 -- 172.21.15.49:0/3425222630 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b0005910 con 0x7f29c00be910 2023-11-30T18:42:14.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.766+0000 7f29c6009700 1 -- 172.21.15.49:0/3425222630 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c00ab470 con 0x7f29c00be910 2023-11-30T18:42:14.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.767+0000 7f29c6009700 1 -- 172.21.15.49:0/3425222630 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c006c860 con 0x7f29c00be910 2023-11-30T18:42:14.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.767+0000 7f29a77fe700 1 -- 172.21.15.49:0/3425222630 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f29b0005d40 con 0x7f29c00be910 2023-11-30T18:42:14.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.768+0000 7f29a77fe700 1 --2- 172.21.15.49:0/3425222630 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f29ac05f270 0x7f29ac061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:42:14.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.768+0000 7f29a77fe700 1 -- 172.21.15.49:0/3425222630 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(225..225 src has 1..225) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f29b0079aa0 con 0x7f29c00be910 2023-11-30T18:42:14.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.768+0000 7f29beffd700 1 --2- 172.21.15.49:0/3425222630 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f29ac05f270 0x7f29ac061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:42:14.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.768+0000 7f29beffd700 1 --2- 172.21.15.49:0/3425222630 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f29ac05f270 0x7f29ac061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f29c0167ab0 tx=0x7f29b4009060).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:42:14.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.772+0000 7f29a77fe700 1 -- 172.21.15.49:0/3425222630 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f29b004aca0 con 0x7f29c00be910 2023-11-30T18:42:14.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.940+0000 7f29c6009700 1 -- 172.21.15.49:0/3425222630 --> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f29c00be6f0 con 0x7f29ac05f270 2023-11-30T18:42:14.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.943+0000 7f29a77fe700 1 -- 172.21.15.49:0/3425222630 <== mgr.9772 v2:172.21.15.115:6832/103051 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70920 (secure 0 0 0) 0x7f29c00be6f0 con 0x7f29ac05f270 2023-11-30T18:42:14.945 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:42:14.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.945+0000 7f29c6009700 1 -- 172.21.15.49:0/3425222630 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f29ac05f270 msgr2=0x7f29ac061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:42:14.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.945+0000 7f29c6009700 1 --2- 172.21.15.49:0/3425222630 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f29ac05f270 0x7f29ac061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f29c0167ab0 tx=0x7f29b4009060).stop 2023-11-30T18:42:14.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.945+0000 7f29c6009700 1 -- 172.21.15.49:0/3425222630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29c00be910 msgr2=0x7f29c0144b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:42:14.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.945+0000 7f29c6009700 1 --2- 172.21.15.49:0/3425222630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29c00be910 0x7f29c0144b40 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 rx=0x7f29b000c590 tx=0x7f29b0007c80).stop 2023-11-30T18:42:14.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.945+0000 7f29c6009700 1 -- 172.21.15.49:0/3425222630 shutdown_connections 2023-11-30T18:42:14.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.945+0000 7f29c6009700 1 --2- 172.21.15.49:0/3425222630 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f29ac05f270 0x7f29ac061730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:14.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.945+0000 7f29c6009700 1 --2- 172.21.15.49:0/3425222630 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29c0157f50 0x7f29c00c9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:14.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.945+0000 7f29c6009700 1 --2- 172.21.15.49:0/3425222630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29c00be910 0x7f29c0144b40 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:14.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.945+0000 7f29c6009700 1 --2- 172.21.15.49:0/3425222630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29c0154270 0x7f29c00a8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:14.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.945+0000 7f29c6009700 1 -- 172.21.15.49:0/3425222630 >> 172.21.15.49:0/3425222630 conn(0x7f29c0062700 msgr2=0x7f29c00680b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:42:14.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.945+0000 7f29c6009700 1 -- 172.21.15.49:0/3425222630 shutdown_connections 2023-11-30T18:42:14.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:14.945+0000 7f29c6009700 1 -- 172.21.15.49:0/3425222630 wait complete. 2023-11-30T18:42:14.948 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-30T18:42:14.958 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-30T18:42:14.902383+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2460384,"kb_used_data":22048,"kb_used_omap":0,"kb_used_meta":2438272,"kb_avail":752514336,"statfs":{"total":773094113280,"available":770574680064,"internally_reserved":0,"allocated":22577152,"data_stored":11619448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2496790528},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13043,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-64,"num_write_kb":-36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.212215"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":225,"state":"active+clean","last_fresh":"2023-11-30T18:41:54.935447+0000","last_change":"2023-11-30T18:41:54.935447+0000","last_active":"2023-11-30T18:41:54.935447+0000","last_peered":"2023-11-30T18:41:54.935447+0000","last_clean":"2023-11-30T18:41:54.935447+0000","last_became_active":"2023-11-30T17:07:12.300169+0000","last_became_peered":"2023-11-30T17:07:12.300169+0000","last_unstale":"2023-11-30T18:41:54.935447+0000","last_undegraded":"2023-11-30T18:41:54.935447+0000","last_fullsized":"2023-11-30T18:41:54.935447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:54.935348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:54.935348+0000","last_clean_scrub_stamp":"2023-11-30T18:41:54.935348+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":192,"reported_epoch":225,"state":"active+clean","last_fresh":"2023-11-30T18:41:54.882967+0000","last_change":"2023-11-30T18:41:54.882967+0000","last_active":"2023-11-30T18:41:54.882967+0000","last_peered":"2023-11-30T18:41:54.882967+0000","last_clean":"2023-11-30T18:41:54.882967+0000","last_became_active":"2023-11-30T17:07:11.874788+0000","last_became_peered":"2023-11-30T17:07:11.874788+0000","last_unstale":"2023-11-30T18:41:54.882967+0000","last_undegraded":"2023-11-30T18:41:54.882967+0000","last_fullsized":"2023-11-30T18:41:54.882967+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:54.882875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:54.882875+0000","last_clean_scrub_stamp":"2023-11-30T18:41:54.882875+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":200,"reported_epoch":225,"state":"active+clean","last_fresh":"2023-11-30T18:41:54.141362+0000","last_change":"2023-11-30T18:41:54.141362+0000","last_active":"2023-11-30T18:41:54.141362+0000","last_peered":"2023-11-30T18:41:54.141362+0000","last_clean":"2023-11-30T18:41:54.141362+0000","last_became_active":"2023-11-30T17:07:11.873608+0000","last_became_peered":"2023-11-30T17:07:11.873608+0000","last_unstale":"2023-11-30T18:41:54.141362+0000","last_undegraded":"2023-11-30T18:41:54.141362+0000","last_fullsized":"2023-11-30T18:41:54.141362+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:54.141200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:54.141200+0000","last_clean_scrub_stamp":"2023-11-30T18:41:54.141200+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":192,"reported_epoch":225,"state":"active+clean","last_fresh":"2023-11-30T18:41:57.867393+0000","last_change":"2023-11-30T18:41:57.867393+0000","last_active":"2023-11-30T18:41:57.867393+0000","last_peered":"2023-11-30T18:41:57.867393+0000","last_clean":"2023-11-30T18:41:57.867393+0000","last_became_active":"2023-11-30T17:07:11.876535+0000","last_became_peered":"2023-11-30T17:07:11.876535+0000","last_unstale":"2023-11-30T18:41:57.867393+0000","last_undegraded":"2023-11-30T18:41:57.867393+0000","last_fullsized":"2023-11-30T18:41:57.867393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:57.867254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:57.867254+0000","last_clean_scrub_stamp":"2023-11-30T18:41:57.867254+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":188,"reported_epoch":225,"state":"active+clean","last_fresh":"2023-11-30T18:41:54.889850+0000","last_change":"2023-11-30T18:41:54.889850+0000","last_active":"2023-11-30T18:41:54.889850+0000","last_peered":"2023-11-30T18:41:54.889850+0000","last_clean":"2023-11-30T18:41:54.889850+0000","last_became_active":"2023-11-30T17:07:10.327570+0000","last_became_peered":"2023-11-30T17:07:10.327570+0000","last_unstale":"2023-11-30T18:41:54.889850+0000","last_undegraded":"2023-11-30T18:41:54.889850+0000","last_fullsized":"2023-11-30T18:41:54.889850+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:54.889756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:54.889756+0000","last_clean_scrub_stamp":"2023-11-30T18:41:54.889756+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":186,"reported_epoch":225,"state":"active+clean","last_fresh":"2023-11-30T18:41:58.859977+0000","last_change":"2023-11-30T18:41:58.859977+0000","last_active":"2023-11-30T18:41:58.859977+0000","last_peered":"2023-11-30T18:41:58.859977+0000","last_clean":"2023-11-30T18:41:58.859977+0000","last_became_active":"2023-11-30T17:07:11.874725+0000","last_became_peered":"2023-11-30T17:07:11.874725+0000","last_unstale":"2023-11-30T18:41:58.859977+0000","last_undegraded":"2023-11-30T18:41:58.859977+0000","last_fullsized":"2023-11-30T18:41:58.859977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:58.859853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:58.859853+0000","last_clean_scrub_stamp":"2023-11-30T18:41:58.859853+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":186,"reported_epoch":225,"state":"active+clean","last_fresh":"2023-11-30T18:42:01.764465+0000","last_change":"2023-11-30T18:42:01.764465+0000","last_active":"2023-11-30T18:42:01.764465+0000","last_peered":"2023-11-30T18:42:01.764465+0000","last_clean":"2023-11-30T18:42:01.764465+0000","last_became_active":"2023-11-30T17:07:12.300537+0000","last_became_peered":"2023-11-30T17:07:12.300537+0000","last_unstale":"2023-11-30T18:42:01.764465+0000","last_undegraded":"2023-11-30T18:42:01.764465+0000","last_fullsized":"2023-11-30T18:42:01.764465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:42:01.764356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:42:01.764356+0000","last_clean_scrub_stamp":"2023-11-30T18:42:01.764356+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":225,"state":"active+clean","last_fresh":"2023-11-30T18:41:55.983673+0000","last_change":"2023-11-30T18:41:55.983673+0000","last_active":"2023-11-30T18:41:55.983673+0000","last_peered":"2023-11-30T18:41:55.983673+0000","last_clean":"2023-11-30T18:41:55.983673+0000","last_became_active":"2023-11-30T17:07:11.876807+0000","last_became_peered":"2023-11-30T17:07:11.876807+0000","last_unstale":"2023-11-30T18:41:55.983673+0000","last_undegraded":"2023-11-30T18:41:55.983673+0000","last_fullsized":"2023-11-30T18:41:55.983673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:55.983563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:55.983563+0000","last_clean_scrub_stamp":"2023-11-30T18:41:55.983563+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":217,"reported_epoch":225,"state":"active+clean","last_fresh":"2023-11-30T18:41:54.399357+0000","last_change":"2023-11-30T18:41:54.399357+0000","last_active":"2023-11-30T18:41:54.399357+0000","last_peered":"2023-11-30T18:41:54.399357+0000","last_clean":"2023-11-30T18:41:54.399357+0000","last_became_active":"2023-11-30T17:07:11.876869+0000","last_became_peered":"2023-11-30T17:07:11.876869+0000","last_unstale":"2023-11-30T18:41:54.399357+0000","last_undegraded":"2023-11-30T18:41:54.399357+0000","last_fullsized":"2023-11-30T18:41:54.399357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T18:41:54.399238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T18:41:54.399238+0000","last_clean_scrub_stamp":"2023-11-30T18:41:54.399238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575978,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303948,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94067892,"statfs":{"total":96636764160,"available":96325521408,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.377,"5min":0.34200000000000003,"15min":0.28699999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.84799999999999998},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.621,"15min":0.63},"min":{"1min":0.46999999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82099999999999995,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.754}]},{"osd":1,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.39500000000000002,"5min":0.36199999999999999,"15min":0.35899999999999999},"max":{"1min":0.74199999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56000000000000005,"15min":0.57399999999999995},"min":{"1min":0.38400000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73199999999999998,"5min":0.77800000000000002,"15min":0.877},"last":0.70599999999999996}]},{"osd":2,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.81100000000000005},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.44600000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79300000000000004,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.60499999999999998}]},{"osd":3,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55800000000000005,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.372,"15min":0.35899999999999999},"max":{"1min":0.78100000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59499999999999997,"15min":0.60699999999999998},"min":{"1min":0.42699999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77600000000000002,"5min":0.80400000000000005,"15min":0.89900000000000002},"last":0.74299999999999999}]},{"osd":4,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46600000000000003,"15min":0.46500000000000002},"min":{"1min":0.32100000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.66100000000000003,"5min":1.264,"15min":1.264},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.48699999999999999,"15min":0.48999999999999999},"min":{"1min":0.307,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.64400000000000002,"5min":1.149,"15min":1.149},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.498,"15min":0.497},"min":{"1min":0.32200000000000001,"5min":0.30599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71099999999999997,"5min":0.78200000000000003,"15min":0.83399999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.497,"5min":0.52900000000000003,"15min":0.53100000000000003},"min":{"1min":0.38400000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66800000000000004,"5min":1.286,"15min":1.286},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Nov 30 18:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.38100000000000001,"5min":0.33000000000000002,"15min":0.32300000000000001},"max":{"1min":0.72699999999999998,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54700000000000004,"15min":0.55400000000000005},"min":{"1min":0.34799999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.68799999999999994,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.64400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575977,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308044,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063796,"statfs":{"total":96636764160,"available":96321327104,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58999999999999997,"15min":0.60799999999999998},"min":{"1min":0.38500000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.79500000000000004,"5min":0.80500000000000005,"15min":1.6379999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.61399999999999999,"15min":0.622},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.27800000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":1.246},"last":0.76900000000000002}]},{"osd":1,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.58199999999999996,"15min":0.60599999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72399999999999998,"5min":0.78400000000000003,"15min":1.1200000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60799999999999998,"15min":0.628},"min":{"1min":0.40400000000000003,"5min":0.39100000000000001,"15min":0.35499999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.90400000000000003},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58599999999999997,"15min":0.59699999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.34499999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":1.288},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.60199999999999998,"15min":0.626},"min":{"1min":0.40000000000000002,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":1.177},"last":0.71299999999999997}]},{"osd":3,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.54600000000000004,"15min":0.56999999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.33400000000000002},"max":{"1min":0.76700000000000002,"5min":0.79400000000000004,"15min":1.204},"last":0.626},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55100000000000005,"15min":0.56599999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.68200000000000005,"5min":0.78300000000000003,"15min":1.337},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.45200000000000001,"15min":0.47299999999999998},"min":{"1min":0.34200000000000003,"5min":0.32500000000000001,"15min":0.28699999999999998},"max":{"1min":0.68799999999999994,"5min":0.80800000000000005,"15min":1.51},"last":0.37},{"interface":"front","average":{"1min":0.503,"5min":0.47699999999999998,"15min":0.49299999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.30399999999999999},"max":{"1min":0.77400000000000002,"5min":0.79300000000000004,"15min":0.94299999999999995},"last":0.39600000000000002}]},{"osd":5,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.46000000000000002,"15min":0.47299999999999998},"min":{"1min":0.33200000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72699999999999998,"5min":0.77600000000000002,"15min":1.159},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.51600000000000001,"15min":0.53100000000000003},"min":{"1min":0.30599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.747,"5min":0.84899999999999998,"15min":1.679},"last":0.41499999999999998}]},{"osd":7,"last update":"Thu Nov 30 18:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52900000000000003,"15min":0.54100000000000004},"min":{"1min":0.38,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73499999999999999,"5min":0.83899999999999997,"15min":0.96199999999999997},"last":0.441},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77000000000000002,"5min":0.89100000000000001,"15min":1.427},"last":0.47799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575977,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.35699999999999998,"15min":0.374},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59499999999999997,"5min":0.66300000000000003,"15min":0.79900000000000004},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.47799999999999998,"15min":0.503},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71699999999999997,"5min":0.78800000000000003,"15min":0.87},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39000000000000001,"15min":0.40799999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.60399999999999998,"5min":0.64700000000000002,"15min":0.89100000000000001},"last":0.433},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.497,"15min":0.52400000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.63400000000000001,"5min":0.80300000000000005,"15min":0.98599999999999999},"last":0.62}]},{"osd":3,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46200000000000002,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68899999999999995,"5min":0.749,"15min":0.91900000000000004},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.437,"5min":0.439,"15min":0.45500000000000002},"min":{"1min":0.308,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66100000000000003,"5min":0.71399999999999997,"15min":0.84599999999999997},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59299999999999997,"15min":0.61199999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":0.89000000000000001,"5min":0.89800000000000002,"15min":0.93999999999999995},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63900000000000001,"15min":0.66200000000000003},"min":{"1min":0.46200000000000002,"5min":0.45500000000000002,"15min":0.42299999999999999},"max":{"1min":0.94799999999999995,"5min":1.0329999999999999,"15min":1.0700000000000001},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60899999999999999,"15min":0.627},"min":{"1min":0.43099999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76300000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.63100000000000001,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.39200000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.98099999999999998},"last":0.67700000000000005}]},{"osd":6,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.67800000000000005,"15min":0.69999999999999996},"min":{"1min":0.46000000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.99099999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.66300000000000003,"15min":0.68300000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.40799999999999997},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":1.004},"last":0.61399999999999999}]},{"osd":7,"last update":"Thu Nov 30 18:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68600000000000005,"15min":0.70499999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46100000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":1.012},"last":0.504},{"interface":"front","average":{"1min":0.63,"5min":0.66900000000000004,"15min":0.68899999999999995},"min":{"1min":0.46600000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.96399999999999997,"5min":0.97599999999999998,"15min":1.02},"last":0.59299999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575977,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.39300000000000002,"15min":0.39600000000000002},"min":{"1min":0.26000000000000001,"5min":0.252,"15min":0.22900000000000001},"max":{"1min":0.45900000000000002,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42299999999999999,"15min":0.41899999999999998},"min":{"1min":0.28399999999999997,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.497,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.35299999999999998}]},{"osd":2,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.40699999999999997,"15min":0.41399999999999998},"min":{"1min":0.26000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.63500000000000001,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.373},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48599999999999999,"15min":0.495},"min":{"1min":0.36799999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.626,"5min":0.69799999999999995,"15min":0.74199999999999999},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.47299999999999998,"15min":0.46200000000000002},"min":{"1min":0.33500000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.54200000000000004,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.311},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.47299999999999998,"15min":0.47099999999999997},"min":{"1min":0.33100000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.57899999999999996,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61699999999999999,"15min":0.63300000000000001},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.40200000000000002},"max":{"1min":0.72299999999999998,"5min":0.85399999999999998,"15min":1.026},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65200000000000002,"15min":0.65500000000000003},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84299999999999997,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.48799999999999999,"5min":0.41799999999999998,"15min":0.40400000000000003},"max":{"1min":0.86399999999999999,"5min":0.97699999999999998,"15min":0.97799999999999998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.64100000000000001,"15min":0.66100000000000003},"min":{"1min":0.48399999999999999,"5min":0.47199999999999998,"15min":0.439},"max":{"1min":0.751,"5min":0.91000000000000003,"15min":1.079},"last":0.60699999999999998}]},{"osd":6,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67500000000000004,"15min":0.68200000000000005},"min":{"1min":0.48399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.67500000000000004,"15min":0.67800000000000005},"min":{"1min":0.45200000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91500000000000004,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Nov 30 18:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.67800000000000005,"15min":0.69499999999999995},"min":{"1min":0.45800000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82999999999999996,"5min":0.94099999999999995,"15min":1.123},"last":0.746},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71699999999999997,"15min":0.73199999999999998},"min":{"1min":0.56399999999999995,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92000000000000004,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.58199999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575977,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.40400000000000003,"15min":0.41399999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.23200000000000001},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.72099999999999997},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.312,"5min":0.255,"15min":0.255},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.58699999999999997}]},{"osd":1,"last update":"Thu Nov 30 18:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.44900000000000001,"15min":0.45700000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.33600000000000002,"5min":0.315,"15min":0.29899999999999999},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Nov 30 18:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.41799999999999998,"15min":0.41999999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.52200000000000002,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.47999999999999998,"15min":0.49099999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.65000000000000002,"5min":0.75900000000000001,"15min":0.77100000000000002},"last":0.623}]},{"osd":4,"last update":"Thu Nov 30 18:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64200000000000002,"15min":0.64700000000000002},"min":{"1min":0.50700000000000001,"5min":0.41899999999999998,"15min":0.39000000000000001},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61499999999999999,"15min":0.63300000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.35899999999999999},"max":{"1min":0.93300000000000005,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.52500000000000002}]},{"osd":5,"last update":"Thu Nov 30 18:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.64400000000000002,"15min":0.65600000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83899999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66100000000000003,"15min":0.66500000000000004},"min":{"1min":0.46000000000000002,"5min":0.439,"15min":0.42499999999999999},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.71799999999999997}]},{"osd":6,"last update":"Thu Nov 30 18:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63500000000000001,"15min":0.64500000000000002},"min":{"1min":0.45600000000000002,"5min":0.432,"15min":0.42499999999999999},"max":{"1min":0.873,"5min":0.93000000000000005,"15min":0.93200000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.67500000000000004,"15min":0.68999999999999995},"min":{"1min":0.46100000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89900000000000002,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.73899999999999999}]},{"osd":7,"last update":"Thu Nov 30 18:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.69199999999999995,"15min":0.69399999999999995},"min":{"1min":0.53100000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.69499999999999995,"15min":0.70999999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.44},"max":{"1min":0.97699999999999998,"5min":0.97899999999999998,"15min":0.98699999999999999},"last":0.68700000000000006}]}]},{"osd":3,"up_from":13,"seq":55834575977,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299980,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94071860,"statfs":{"total":96636764160,"available":96329584640,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.38100000000000001,"15min":0.378},"min":{"1min":0.246,"5min":0.246,"15min":0.222},"max":{"1min":0.48699999999999999,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.41199999999999998,"15min":0.42099999999999999},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.50700000000000001,"5min":0.64200000000000002,"15min":0.754},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Nov 30 18:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.38400000000000001,"15min":0.39800000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.25700000000000001},"max":{"1min":0.51200000000000001,"5min":0.65800000000000003,"15min":0.73399999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.435,"15min":0.44700000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64200000000000002,"5min":0.66800000000000004,"15min":0.86699999999999999},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Nov 30 18:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.314,"5min":0.29299999999999998,"15min":0.27800000000000002},"max":{"1min":0.59099999999999997,"5min":0.73599999999999999,"15min":0.79500000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.503,"15min":0.51600000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.626,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Nov 30 18:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.61699999999999999,"15min":0.63200000000000001},"min":{"1min":0.435,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.72299999999999998,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.61599999999999999,"15min":0.64100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.82599999999999996,"5min":0.93500000000000005,"15min":1.0049999999999999},"last":0.82599999999999996}]},{"osd":5,"last update":"Thu Nov 30 18:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.61099999999999999,"15min":0.63300000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.67700000000000005,"5min":1.123,"15min":1.123},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.63800000000000001,"15min":0.65800000000000003},"min":{"1min":0.42099999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86499999999999999,"5min":1.038,"15min":1.0680000000000001},"last":0.81299999999999994}]},{"osd":6,"last update":"Thu Nov 30 18:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.65600000000000003,"15min":0.67500000000000004},"min":{"1min":0.47099999999999997,"5min":0.46300000000000002,"15min":0.40200000000000002},"max":{"1min":0.90900000000000003,"5min":1.004,"15min":1.0309999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.64900000000000002,"15min":0.67800000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.41499999999999998},"max":{"1min":0.76700000000000002,"5min":1.137,"15min":1.137},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Nov 30 18:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.66300000000000003,"15min":0.69399999999999995},"min":{"1min":0.435,"5min":0.434,"15min":0.434},"max":{"1min":0.84299999999999997,"5min":1.03,"15min":1.052},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.65900000000000003,"15min":0.69099999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.754,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.72799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575977,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303948,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94067892,"statfs":{"total":96636764160,"available":96325521408,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52200000000000002,"15min":0.55500000000000005},"min":{"1min":0.315,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.85499999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54800000000000004,"15min":0.56499999999999995},"min":{"1min":0.376,"5min":0.34100000000000003,"15min":0.32500000000000001},"max":{"1min":0.77200000000000002,"5min":0.77500000000000002,"15min":0.94999999999999996},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54000000000000004,"15min":0.56399999999999995},"min":{"1min":0.314,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.876},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.54800000000000004,"15min":0.57699999999999996},"min":{"1min":0.34899999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69799999999999995,"5min":0.81399999999999995,"15min":0.91200000000000003},"last":0.47899999999999998}]},{"osd":2,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.57599999999999996,"15min":0.59699999999999998},"min":{"1min":0.33400000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.79000000000000004,"5min":0.81200000000000006,"15min":0.93799999999999994},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.58599999999999997,"15min":0.621},"min":{"1min":0.371,"5min":0.35999999999999999,"15min":0.34899999999999998},"max":{"1min":0.77700000000000002,"5min":0.82299999999999995,"15min":0.94399999999999995},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.53700000000000003,"15min":0.56000000000000005},"min":{"1min":0.38,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70899999999999996,"5min":0.73999999999999999,"15min":0.84999999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.56100000000000005,"15min":0.59599999999999997},"min":{"1min":0.432,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.80300000000000005,"5min":0.80800000000000005,"15min":0.872},"last":0.55900000000000005}]},{"osd":5,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42499999999999999,"15min":0.44700000000000001},"min":{"1min":0.32300000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.626,"5min":0.66600000000000004,"15min":0.86399999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.45000000000000001,"15min":0.46800000000000003},"min":{"1min":0.33700000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.82299999999999995},"last":0.438}]},{"osd":6,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.47899999999999998,"15min":0.51100000000000001},"min":{"1min":0.36099999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":1.1399999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52200000000000002,"15min":0.55800000000000005},"min":{"1min":0.39800000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":1.1220000000000001},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Nov 30 18:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.47999999999999998,"15min":0.52300000000000002},"min":{"1min":0.36099999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77100000000000002,"5min":0.77400000000000002,"15min":0.90000000000000002},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55200000000000005,"15min":0.58099999999999996},"min":{"1min":0.44,"5min":0.38600000000000001,"15min":0.35599999999999998},"max":{"1min":0.72899999999999998,"5min":0.73599999999999999,"15min":0.86199999999999999},"last":0.63700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575977,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308044,"kb_used_data":2756,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063796,"statfs":{"total":96636764160,"available":96321327104,"internally_reserved":0,"allocated":2822144,"data_stored":1452431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.40799999999999997,"5min":0.317,"15min":0.29799999999999999},"max":{"1min":0.78000000000000003,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.53800000000000003,"15min":0.55100000000000005},"min":{"1min":0.38800000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.90300000000000002},"last":0.42799999999999999}]},{"osd":1,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53900000000000003},"min":{"1min":0.35099999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.83699999999999997},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56699999999999995,"15min":0.57399999999999995},"min":{"1min":0.44,"5min":0.307,"15min":0.307},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.82899999999999996},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59899999999999998,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.99199999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.432,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":1.173},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56499999999999995,"15min":0.56799999999999995},"min":{"1min":0.38200000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.747,"5min":0.77700000000000002,"15min":0.79300000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58199999999999996,"15min":0.59499999999999997},"min":{"1min":0.46800000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":1.603},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.317,"5min":0.311,"15min":0.311},"max":{"1min":0.64500000000000002,"5min":0.68000000000000005,"15min":0.75},"last":0.373},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.35999999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.69799999999999995,"5min":0.77900000000000003,"15min":0.81200000000000006},"last":0.442}]},{"osd":6,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48499999999999999,"15min":0.498},"min":{"1min":0.34499999999999997,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68799999999999994,"5min":0.75900000000000001,"15min":1.105},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56499999999999995,"15min":0.57199999999999995},"min":{"1min":0.34100000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81000000000000005,"5min":0.85299999999999998,"15min":1.228},"last":0.5}]},{"osd":7,"last update":"Thu Nov 30 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.33000000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69699999999999995,"5min":0.72199999999999998,"15min":0.88100000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.39700000000000002,"5min":0.376,"15min":0.317},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":1.0640000000000001},"last":0.47299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T18:42:14.961 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-30T18:42:15.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.076+0000 7fec2100f700 1 Processor -- start 2023-11-30T18:42:15.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.076+0000 7fec2100f700 1 -- start start 2023-11-30T18:42:15.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.077+0000 7fec2100f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec1c14e530 0x7fec1c0c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:42:15.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.077+0000 7fec2100f700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fec1c154950 0x7fec1c14e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:42:15.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.077+0000 7fec2100f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fec1c158570 0x7fec1c158a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:42:15.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.077+0000 7fec2100f700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1c0c7bc0 con 0x7fec1c158570 2023-11-30T18:42:15.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.077+0000 7fec2100f700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1c155920 con 0x7fec1c154950 2023-11-30T18:42:15.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.077+0000 7fec2100f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c154dd0 con 0x7fec1c14e530 2023-11-30T18:42:15.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.077+0000 7fec2080e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fec1c158570 0x7fec1c158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:42:15.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.077+0000 7fec2080e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fec1c158570 0x7fec1c158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43046/0 (socket says 172.21.15.49:43046) 2023-11-30T18:42:15.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.077+0000 7fec2080e700 1 -- 172.21.15.49:0/586236123 learned_addr learned my addr 172.21.15.49:0/586236123 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:42:15.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.077+0000 7fec1bfff700 1 --2- 172.21.15.49:0/586236123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec1c14e530 0x7fec1c0c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:42:15.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.077+0000 7fec1b7fe700 1 --2- 172.21.15.49:0/586236123 >> v2:172.21.15.115:3300/0 conn(0x7fec1c154950 0x7fec1c14e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:42:15.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.077+0000 7fec2080e700 1 -- 172.21.15.49:0/586236123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec1c14e530 msgr2=0x7fec1c0c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:42:15.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.077+0000 7fec2080e700 1 --2- 172.21.15.49:0/586236123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec1c14e530 0x7fec1c0c66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:15.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.077+0000 7fec2080e700 1 -- 172.21.15.49:0/586236123 >> v2:172.21.15.115:3300/0 conn(0x7fec1c154950 msgr2=0x7fec1c14e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:42:15.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.077+0000 7fec2080e700 1 --2- 172.21.15.49:0/586236123 >> v2:172.21.15.115:3300/0 conn(0x7fec1c154950 0x7fec1c14e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:15.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.077+0000 7fec2080e700 1 -- 172.21.15.49:0/586236123 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1c155080 con 0x7fec1c158570 2023-11-30T18:42:15.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.077+0000 7fec1bfff700 1 --2- 172.21.15.49:0/586236123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec1c14e530 0x7fec1c0c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:42:15.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.078+0000 7fec2080e700 1 --2- 172.21.15.49:0/586236123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec1c158570 0x7fec1c158a20 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 rx=0x7fec1c0cc090 tx=0x7fec14009840).ready entity=mon.0 client_cookie=ae2992f79e3be1e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:42:15.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.078+0000 7fec1affd700 1 -- 172.21.15.49:0/586236123 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1400e070 con 0x7fec1c158570 2023-11-30T18:42:15.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.078+0000 7fec1affd700 1 -- 172.21.15.49:0/586236123 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1400b970 con 0x7fec1c158570 2023-11-30T18:42:15.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.078+0000 7fec1affd700 1 -- 172.21.15.49:0/586236123 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1400bcf0 con 0x7fec1c158570 2023-11-30T18:42:15.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.078+0000 7fec2100f700 1 -- 172.21.15.49:0/586236123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec1c158570 msgr2=0x7fec1c158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:42:15.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.078+0000 7fec2100f700 1 --2- 172.21.15.49:0/586236123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec1c158570 0x7fec1c158a20 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 rx=0x7fec1c0cc090 tx=0x7fec14009840).stop 2023-11-30T18:42:15.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.078+0000 7fec2100f700 1 -- 172.21.15.49:0/586236123 shutdown_connections 2023-11-30T18:42:15.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.078+0000 7fec2100f700 1 --2- 172.21.15.49:0/586236123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec1c14e530 0x7fec1c0c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:15.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.078+0000 7fec2100f700 1 --2- 172.21.15.49:0/586236123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec1c158570 0x7fec1c158a20 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:15.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.078+0000 7fec2100f700 1 --2- 172.21.15.49:0/586236123 >> v2:172.21.15.115:3300/0 conn(0x7fec1c154950 0x7fec1c14e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:15.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.078+0000 7fec2100f700 1 -- 172.21.15.49:0/586236123 >> 172.21.15.49:0/586236123 conn(0x7fec1c064990 msgr2=0x7fec1c064d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:42:15.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.078+0000 7fec2100f700 1 -- 172.21.15.49:0/586236123 shutdown_connections 2023-11-30T18:42:15.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.078+0000 7fec2100f700 1 -- 172.21.15.49:0/586236123 wait complete. 2023-11-30T18:42:15.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.079+0000 7fec2100f700 1 Processor -- start 2023-11-30T18:42:15.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.080+0000 7fec2100f700 1 -- start start 2023-11-30T18:42:15.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.080+0000 7fec2100f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec1c14e530 0x7fec1c14de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:42:15.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.080+0000 7fec2100f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec1c154950 0x7fec1c0c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:42:15.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.080+0000 7fec2100f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec1c158570 0x7fec1c1678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:42:15.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.080+0000 7fec2100f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c14e330 con 0x7fec1c154950 2023-11-30T18:42:15.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.080+0000 7fec2100f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c0c4f10 con 0x7fec1c158570 2023-11-30T18:42:15.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.080+0000 7fec2100f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c0c51f0 con 0x7fec1c14e530 2023-11-30T18:42:15.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.081+0000 7fec1b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec1c154950 0x7fec1c0c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:42:15.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.081+0000 7fec1b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec1c154950 0x7fec1c0c46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43062/0 (socket says 172.21.15.49:43062) 2023-11-30T18:42:15.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.081+0000 7fec1b7fe700 1 -- 172.21.15.49:0/3916485166 learned_addr learned my addr 172.21.15.49:0/3916485166 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:42:15.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.081+0000 7fec1bfff700 1 --2- 172.21.15.49:0/3916485166 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec1c14e530 0x7fec1c14de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:42:15.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.081+0000 7fec2080e700 1 --2- 172.21.15.49:0/3916485166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec1c158570 0x7fec1c1678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:42:15.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.081+0000 7fec1b7fe700 1 -- 172.21.15.49:0/3916485166 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec1c14e530 msgr2=0x7fec1c14de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:42:15.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.081+0000 7fec1b7fe700 1 --2- 172.21.15.49:0/3916485166 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec1c14e530 0x7fec1c14de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:15.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.081+0000 7fec1b7fe700 1 -- 172.21.15.49:0/3916485166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec1c158570 msgr2=0x7fec1c1678a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:42:15.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.081+0000 7fec1b7fe700 1 --2- 172.21.15.49:0/3916485166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec1c158570 0x7fec1c1678a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:15.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.081+0000 7fec1b7fe700 1 -- 172.21.15.49:0/3916485166 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c0092a0 con 0x7fec1c154950 2023-11-30T18:42:15.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.081+0000 7fec1b7fe700 1 --2- 172.21.15.49:0/3916485166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec1c154950 0x7fec1c0c46c0 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 rx=0x7fec1000e900 tx=0x7fec10009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:42:15.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.081+0000 7fec03fff700 1 -- 172.21.15.49:0/3916485166 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec10012600 con 0x7fec1c154950 2023-11-30T18:42:15.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.081+0000 7fec03fff700 1 -- 172.21.15.49:0/3916485166 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec10012760 con 0x7fec1c154950 2023-11-30T18:42:15.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.081+0000 7fec2100f700 1 -- 172.21.15.49:0/3916485166 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec14009ae0 con 0x7fec1c154950 2023-11-30T18:42:15.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.081+0000 7fec03fff700 1 -- 172.21.15.49:0/3916485166 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec10012ae0 con 0x7fec1c154950 2023-11-30T18:42:15.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.081+0000 7fec2100f700 1 -- 172.21.15.49:0/3916485166 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec1c0ae160 con 0x7fec1c154950 2023-11-30T18:42:15.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.082+0000 7fec2100f700 1 -- 172.21.15.49:0/3916485166 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec1c062ee0 con 0x7fec1c154950 2023-11-30T18:42:15.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.083+0000 7fec03fff700 1 -- 172.21.15.49:0/3916485166 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fec1001b400 con 0x7fec1c154950 2023-11-30T18:42:15.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.083+0000 7fec03fff700 1 --2- 172.21.15.49:0/3916485166 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fec0805f270 0x7fec08061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:42:15.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.083+0000 7fec03fff700 1 -- 172.21.15.49:0/3916485166 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(225..225 src has 1..225) v4 ==== 5940+0+0 (secure 0 0 0) 0x7fec1007a730 con 0x7fec1c154950 2023-11-30T18:42:15.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.083+0000 7fec1bfff700 1 --2- 172.21.15.49:0/3916485166 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fec0805f270 0x7fec08061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:42:15.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.084+0000 7fec1bfff700 1 --2- 172.21.15.49:0/3916485166 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fec0805f270 0x7fec08061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fec1c063850 tx=0x7fec0c009060).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:42:15.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.087+0000 7fec03fff700 1 -- 172.21.15.49:0/3916485166 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fec1004b8d0 con 0x7fec1c154950 2023-11-30T18:42:15.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.260+0000 7fec2100f700 1 -- 172.21.15.49:0/3916485166 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fec1c06c7c0 con 0x7fec1c154950 2023-11-30T18:42:15.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.264+0000 7fec03fff700 1 -- 172.21.15.49:0/3916485166 <== mon.0 v2:172.21.15.49:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fec10012e90 con 0x7fec1c154950 2023-11-30T18:42:15.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.264+0000 7fec03fff700 1 -- 172.21.15.49:0/3916485166 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v46)=0 v46) v1 ==== 123+0+0 (secure 0 0 0) 0x7fec1004eef0 con 0x7fec1c154950 2023-11-30T18:42:15.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.266+0000 7fec2100f700 1 -- 172.21.15.49:0/3916485166 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fec0805f270 msgr2=0x7fec08061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:42:15.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.266+0000 7fec2100f700 1 --2- 172.21.15.49:0/3916485166 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fec0805f270 0x7fec08061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fec1c063850 tx=0x7fec0c009060).stop 2023-11-30T18:42:15.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.266+0000 7fec2100f700 1 -- 172.21.15.49:0/3916485166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec1c154950 msgr2=0x7fec1c0c46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:42:15.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.266+0000 7fec2100f700 1 --2- 172.21.15.49:0/3916485166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec1c154950 0x7fec1c0c46c0 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 rx=0x7fec1000e900 tx=0x7fec10009060).stop 2023-11-30T18:42:15.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.266+0000 7fec2100f700 1 -- 172.21.15.49:0/3916485166 shutdown_connections 2023-11-30T18:42:15.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.266+0000 7fec2100f700 1 --2- 172.21.15.49:0/3916485166 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7fec0805f270 0x7fec08061730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:15.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.266+0000 7fec2100f700 1 --2- 172.21.15.49:0/3916485166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec1c158570 0x7fec1c1678a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:15.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.266+0000 7fec2100f700 1 --2- 172.21.15.49:0/3916485166 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec1c14e530 0x7fec1c14de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:15.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.266+0000 7fec2100f700 1 --2- 172.21.15.49:0/3916485166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec1c154950 0x7fec1c0c46c0 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:15.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.266+0000 7fec2100f700 1 -- 172.21.15.49:0/3916485166 >> 172.21.15.49:0/3916485166 conn(0x7fec1c064990 msgr2=0x7fec1c153d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:42:15.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.266+0000 7fec2100f700 1 -- 172.21.15.49:0/3916485166 shutdown_connections 2023-11-30T18:42:15.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.266+0000 7fec2100f700 1 -- 172.21.15.49:0/3916485166 wait complete. 2023-11-30T18:42:15.280 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-30T18:42:15.280 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T18:42:15.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.396+0000 7f5065345700 1 Processor -- start 2023-11-30T18:42:15.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.396+0000 7f5065345700 1 -- start start 2023-11-30T18:42:15.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.397+0000 7f5065345700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5060157660 0x7f5060157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:42:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.397+0000 7f5065345700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f50600c0180 0x7f50601589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:42:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.397+0000 7f5065345700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f50600c1750 0x7f50600c1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-30T18:42:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.397+0000 7f5065345700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50600c12c0 con 0x7f50600c1750 2023-11-30T18:42:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.397+0000 7f5065345700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50600c06b0 con 0x7f50600c0180 2023-11-30T18:42:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.397+0000 7f5065345700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50600c0990 con 0x7f5060157660 2023-11-30T18:42:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.397+0000 7f5064b44700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f50600c1750 0x7f50600c1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:42:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.397+0000 7f5064b44700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f50600c1750 0x7f50600c1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43074/0 (socket says 172.21.15.49:43074) 2023-11-30T18:42:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.397+0000 7f5064b44700 1 -- 172.21.15.49:0/2949370319 learned_addr learned my addr 172.21.15.49:0/2949370319 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:42:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.397+0000 7f505ffff700 1 --2- 172.21.15.49:0/2949370319 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5060157660 0x7f5060157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:42:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.397+0000 7f505f7fe700 1 --2- 172.21.15.49:0/2949370319 >> v2:172.21.15.115:3300/0 conn(0x7f50600c0180 0x7f50601589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:42:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.397+0000 7f5064b44700 1 -- 172.21.15.49:0/2949370319 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5060157660 msgr2=0x7f5060157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:42:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.397+0000 7f5064b44700 1 --2- 172.21.15.49:0/2949370319 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5060157660 0x7f5060157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:15.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.397+0000 7f5064b44700 1 -- 172.21.15.49:0/2949370319 >> v2:172.21.15.115:3300/0 conn(0x7f50600c0180 msgr2=0x7f50601589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T18:42:15.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.397+0000 7f5064b44700 1 --2- 172.21.15.49:0/2949370319 >> v2:172.21.15.115:3300/0 conn(0x7f50600c0180 0x7f50601589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:15.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.397+0000 7f5064b44700 1 -- 172.21.15.49:0/2949370319 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50600c0c70 con 0x7f50600c1750 2023-11-30T18:42:15.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.398+0000 7f5064b44700 1 --2- 172.21.15.49:0/2949370319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50600c1750 0x7f50600c1bc0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 rx=0x7f5060084330 tx=0x7f5058009840).ready entity=mon.0 client_cookie=e4392fd73c069562 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:42:15.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.398+0000 7f505effd700 1 -- 172.21.15.49:0/2949370319 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505800e070 con 0x7f50600c1750 2023-11-30T18:42:15.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.398+0000 7f505effd700 1 -- 172.21.15.49:0/2949370319 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f505800b970 con 0x7f50600c1750 2023-11-30T18:42:15.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.398+0000 7f505effd700 1 -- 172.21.15.49:0/2949370319 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505800bd10 con 0x7f50600c1750 2023-11-30T18:42:15.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.398+0000 7f5065345700 1 -- 172.21.15.49:0/2949370319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50600c1750 msgr2=0x7f50600c1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:42:15.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.398+0000 7f5065345700 1 --2- 172.21.15.49:0/2949370319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50600c1750 0x7f50600c1bc0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 rx=0x7f5060084330 tx=0x7f5058009840).stop 2023-11-30T18:42:15.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.398+0000 7f5065345700 1 -- 172.21.15.49:0/2949370319 shutdown_connections 2023-11-30T18:42:15.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.398+0000 7f5065345700 1 --2- 172.21.15.49:0/2949370319 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5060157660 0x7f5060157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:15.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.398+0000 7f5065345700 1 --2- 172.21.15.49:0/2949370319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50600c1750 0x7f50600c1bc0 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:15.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.398+0000 7f5065345700 1 --2- 172.21.15.49:0/2949370319 >> v2:172.21.15.115:3300/0 conn(0x7f50600c0180 0x7f50601589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:15.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.398+0000 7f5065345700 1 -- 172.21.15.49:0/2949370319 >> 172.21.15.49:0/2949370319 conn(0x7f50600cb000 msgr2=0x7f50600cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:42:15.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.398+0000 7f5065345700 1 -- 172.21.15.49:0/2949370319 shutdown_connections 2023-11-30T18:42:15.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.398+0000 7f5065345700 1 -- 172.21.15.49:0/2949370319 wait complete. 2023-11-30T18:42:15.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.399+0000 7f5065345700 1 Processor -- start 2023-11-30T18:42:15.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.400+0000 7f5065345700 1 -- start start 2023-11-30T18:42:15.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.400+0000 7f5065345700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50600c0180 0x7f506013f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:42:15.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.400+0000 7f5065345700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50600c1750 0x7f5060156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:42:15.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.400+0000 7f5065345700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5060157660 0x7f5060156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:42:15.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.400+0000 7f5065345700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5060156f80 con 0x7f5060157660 2023-11-30T18:42:15.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.400+0000 7f5065345700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50600b1080 con 0x7f50600c0180 2023-11-30T18:42:15.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.400+0000 7f5065345700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5060152410 con 0x7f50600c1750 2023-11-30T18:42:15.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.400+0000 7f5064b44700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5060157660 0x7f5060156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:42:15.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.401+0000 7f505ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50600c0180 0x7f506013f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:42:15.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.401+0000 7f5064b44700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5060157660 0x7f5060156620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43078/0 (socket says 172.21.15.49:43078) 2023-11-30T18:42:15.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.401+0000 7f5064b44700 1 -- 172.21.15.49:0/1249810626 learned_addr learned my addr 172.21.15.49:0/1249810626 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-30T18:42:15.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.401+0000 7f505f7fe700 1 --2- 172.21.15.49:0/1249810626 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50600c1750 0x7f5060156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:42:15.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.401+0000 7f5064b44700 1 -- 172.21.15.49:0/1249810626 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50600c1750 msgr2=0x7f5060156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:42:15.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.401+0000 7f5064b44700 1 --2- 172.21.15.49:0/1249810626 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50600c1750 0x7f5060156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:15.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.401+0000 7f5064b44700 1 -- 172.21.15.49:0/1249810626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50600c0180 msgr2=0x7f506013f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:42:15.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.401+0000 7f5064b44700 1 --2- 172.21.15.49:0/1249810626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50600c0180 0x7f506013f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:15.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.401+0000 7f5064b44700 1 -- 172.21.15.49:0/1249810626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5058009ae0 con 0x7f5060157660 2023-11-30T18:42:15.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.401+0000 7f505ffff700 1 --2- 172.21.15.49:0/1249810626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50600c0180 0x7f506013f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-30T18:42:15.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.401+0000 7f5064b44700 1 --2- 172.21.15.49:0/1249810626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5060157660 0x7f5060156620 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 rx=0x7f5060084570 tx=0x7f5058009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:42:15.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.401+0000 7f5057fff700 1 -- 172.21.15.49:0/1249810626 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50580092e0 con 0x7f5060157660 2023-11-30T18:42:15.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.401+0000 7f5057fff700 1 -- 172.21.15.49:0/1249810626 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5058009500 con 0x7f5060157660 2023-11-30T18:42:15.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.401+0000 7f5065345700 1 -- 172.21.15.49:0/1249810626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5060156ca0 con 0x7f5060157660 2023-11-30T18:42:15.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.401+0000 7f5057fff700 1 -- 172.21.15.49:0/1249810626 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5058007170 con 0x7f5060157660 2023-11-30T18:42:15.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.401+0000 7f5065345700 1 -- 172.21.15.49:0/1249810626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50600ae7f0 con 0x7f5060157660 2023-11-30T18:42:15.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.402+0000 7f5065345700 1 -- 172.21.15.49:0/1249810626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5060157c50 con 0x7f5060157660 2023-11-30T18:42:15.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.403+0000 7f5057fff700 1 -- 172.21.15.49:0/1249810626 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f5058003040 con 0x7f5060157660 2023-11-30T18:42:15.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.403+0000 7f5057fff700 1 --2- 172.21.15.49:0/1249810626 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f504005f270 0x7f5040061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-30T18:42:15.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.403+0000 7f5057fff700 1 -- 172.21.15.49:0/1249810626 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(225..225 src has 1..225) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f505807b520 con 0x7f5060157660 2023-11-30T18:42:15.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.403+0000 7f505ffff700 1 --2- 172.21.15.49:0/1249810626 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f504005f270 0x7f5040061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-30T18:42:15.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.403+0000 7f505ffff700 1 --2- 172.21.15.49:0/1249810626 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f504005f270 0x7f5040061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f5048011310 tx=0x7f5048009060).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T18:42:15.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.407+0000 7f5057fff700 1 -- 172.21.15.49:0/1249810626 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f505804c790 con 0x7f5060157660 2023-11-30T18:42:15.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.624+0000 7f5065345700 1 -- 172.21.15.49:0/1249810626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50600aee40 con 0x7f5060157660 2023-11-30T18:42:15.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.625+0000 7f5057fff700 1 -- 172.21.15.49:0/1249810626 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+3533 (secure 0 0 0) 0x7f5058022020 con 0x7f5060157660 2023-11-30T18:42:15.629 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-30T18:42:15.629 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":95,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8219,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3124035021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":3124035021},{"type":"v1","addr":"172.21.15.115:6837","nonce":3124035021}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":9565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2947558957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2947558957},{"type":"v1","addr":"172.21.15.115:6836","nonce":2947558957}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":9996,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1999244219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1999244219},{"type":"v1","addr":"172.21.15.49:6834","nonce":1999244219}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":10395,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/598473804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":598473804},{"type":"v1","addr":"172.21.15.49:6835","nonce":598473804}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94}],"filesystems":[]} 2023-11-30T18:42:15.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.626+0000 7f5065345700 1 -- 172.21.15.49:0/1249810626 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f504005f270 msgr2=0x7f5040061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:42:15.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.626+0000 7f5065345700 1 --2- 172.21.15.49:0/1249810626 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f504005f270 0x7f5040061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f5048011310 tx=0x7f5048009060).stop 2023-11-30T18:42:15.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.626+0000 7f5065345700 1 -- 172.21.15.49:0/1249810626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5060157660 msgr2=0x7f5060156620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T18:42:15.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.626+0000 7f5065345700 1 --2- 172.21.15.49:0/1249810626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5060157660 0x7f5060156620 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 rx=0x7f5060084570 tx=0x7f5058009840).stop 2023-11-30T18:42:15.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.626+0000 7f5065345700 1 -- 172.21.15.49:0/1249810626 shutdown_connections 2023-11-30T18:42:15.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.626+0000 7f5065345700 1 --2- 172.21.15.49:0/1249810626 >> [v2:172.21.15.115:6832/103051,v1:172.21.15.115:6833/103051] conn(0x7f504005f270 0x7f5040061730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:15.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.626+0000 7f5065345700 1 --2- 172.21.15.49:0/1249810626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5060157660 0x7f5060156620 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:15.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.626+0000 7f5065345700 1 --2- 172.21.15.49:0/1249810626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50600c0180 0x7f506013f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:15.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.626+0000 7f5065345700 1 --2- 172.21.15.49:0/1249810626 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50600c1750 0x7f5060156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-30T18:42:15.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.626+0000 7f5065345700 1 -- 172.21.15.49:0/1249810626 >> 172.21.15.49:0/1249810626 conn(0x7f50600cb000 msgr2=0x7f5060152950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T18:42:15.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.627+0000 7f5065345700 1 -- 172.21.15.49:0/1249810626 shutdown_connections 2023-11-30T18:42:15.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-30T18:42:15.627+0000 7f5065345700 1 -- 172.21.15.49:0/1249810626 wait complete. 2023-11-30T18:42:15.631 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 95 2023-11-30T18:42:15.640 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-30T18:42:15.640 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-30T18:42:15.641 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-30T18:42:15.641 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:42:15.649 INFO:tasks.ceph.mds.a:Stopped 2023-11-30T18:42:15.649 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-30T18:42:15.649 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:42:15.698 INFO:tasks.ceph.mds.c:Stopped 2023-11-30T18:42:15.698 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-30T18:42:15.699 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:42:15.709 INFO:tasks.ceph.mds.b:Stopped 2023-11-30T18:42:15.709 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-30T18:42:15.709 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:42:15.760 INFO:tasks.ceph.mds.d:Stopped 2023-11-30T18:42:15.760 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-30T18:42:15.761 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-30T18:42:15.761 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:42:15.793 INFO:tasks.ceph.osd.0:Stopped 2023-11-30T18:42:15.793 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-30T18:42:15.793 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:42:15.860 INFO:tasks.ceph.osd.1:Stopped 2023-11-30T18:42:15.860 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-30T18:42:15.860 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:42:15.933 INFO:tasks.ceph.osd.2:Stopped 2023-11-30T18:42:15.933 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-30T18:42:15.933 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:42:16.006 INFO:tasks.ceph.osd.3:Stopped 2023-11-30T18:42:16.006 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-30T18:42:16.006 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:42:16.049 INFO:tasks.ceph.osd.4:Stopped 2023-11-30T18:42:16.049 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-30T18:42:16.049 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:42:16.081 INFO:tasks.ceph.osd.5:Stopped 2023-11-30T18:42:16.081 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-30T18:42:16.081 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:42:16.154 INFO:tasks.ceph.osd.6:Stopped 2023-11-30T18:42:16.154 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-30T18:42:16.154 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:42:16.223 INFO:tasks.ceph.osd.7:Stopped 2023-11-30T18:42:16.224 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-30T18:42:16.224 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-30T18:42:16.224 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:42:16.248 INFO:tasks.ceph.mgr.y:Stopped 2023-11-30T18:42:16.248 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-30T18:42:16.248 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:42:16.296 INFO:tasks.ceph.mgr.x:Stopped 2023-11-30T18:42:16.296 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-30T18:42:16.297 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-30T18:42:16.297 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:42:16.316 INFO:tasks.ceph.mon.a:Stopped 2023-11-30T18:42:16.317 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-30T18:42:16.317 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:42:16.353 INFO:tasks.ceph.mon.b:Stopped 2023-11-30T18:42:16.353 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-30T18:42:16.353 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T18:42:16.410 INFO:tasks.ceph.mon.c:Stopped 2023-11-30T18:42:16.411 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-30T18:42:16.411 DEBUG:teuthology.orchestra.run.smithi049:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-11-30T18:42:16.441 INFO:teuthology.orchestra.run.smithi049.stdout:2023-11-30T17:09:24.850485+0000 mon.a (mon.0) 320 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-11-30T18:42:16.441 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-11-30T18:42:16.441 DEBUG:teuthology.orchestra.run.smithi049:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-11-30T18:42:16.510 DEBUG:teuthology.orchestra.run.smithi049:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-11-30T18:42:16.580 DEBUG:teuthology.orchestra.run.smithi049:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-11-30T18:42:16.648 INFO:teuthology.orchestra.run.smithi049.stdout:2023-11-30T17:09:24.850485+0000 mon.a (mon.0) 320 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-11-30T18:42:16.648 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi049.front.sepia.ceph.com 2023-11-30T18:42:16.648 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-30T18:42:16.894 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi049.front.sepia.ceph.com 2023-11-30T18:42:16.894 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-30T18:42:16.978 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi049.front.sepia.ceph.com 2023-11-30T18:42:16.978 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-30T18:42:17.048 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi049.front.sepia.ceph.com 2023-11-30T18:42:17.048 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-30T18:42:17.119 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi115.front.sepia.ceph.com 2023-11-30T18:42:17.119 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-30T18:42:17.238 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi115.front.sepia.ceph.com 2023-11-30T18:42:17.238 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-30T18:42:17.349 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi115.front.sepia.ceph.com 2023-11-30T18:42:17.349 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-30T18:42:17.408 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi115.front.sepia.ceph.com 2023-11-30T18:42:17.408 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-30T18:42:17.463 INFO:tasks.ceph:Archiving mon data... 2023-11-30T18:42:17.466 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472115/data/mon.a.tgz 2023-11-30T18:42:17.467 DEBUG:teuthology.orchestra.run.smithi049:> mktemp 2023-11-30T18:42:17.483 INFO:teuthology.orchestra.run.smithi049.stdout:/tmp/tmp.Qk9cKrtpIp 2023-11-30T18:42:17.483 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Qk9cKrtpIp 2023-11-30T18:42:17.989 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0666 /tmp/tmp.Qk9cKrtpIp 2023-11-30T18:42:18.072 DEBUG:teuthology.orchestra.remote:smithi049:/tmp/tmp.Qk9cKrtpIp is 2MB 2023-11-30T18:42:18.203 DEBUG:teuthology.orchestra.run.smithi049:> rm -fr /tmp/tmp.Qk9cKrtpIp 2023-11-30T18:42:18.218 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472115/data/mon.b.tgz 2023-11-30T18:42:18.219 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2023-11-30T18:42:18.235 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.A3V8fH2xEw 2023-11-30T18:42:18.235 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.A3V8fH2xEw 2023-11-30T18:42:18.713 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.A3V8fH2xEw 2023-11-30T18:42:18.794 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.A3V8fH2xEw is 2MB 2023-11-30T18:42:18.913 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.A3V8fH2xEw 2023-11-30T18:42:18.928 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472115/data/mon.c.tgz 2023-11-30T18:42:18.929 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2023-11-30T18:42:18.982 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.pc2RwPzQ6M 2023-11-30T18:42:18.982 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.pc2RwPzQ6M 2023-11-30T18:42:19.449 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.pc2RwPzQ6M 2023-11-30T18:42:19.533 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.pc2RwPzQ6M is 2MB 2023-11-30T18:42:19.656 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.pc2RwPzQ6M 2023-11-30T18:42:19.671 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-30T18:42:19.671 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-30T18:42:19.673 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-30T18:42:19.735 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-30T18:42:19.735 DEBUG:teuthology.orchestra.run.smithi049:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-30T18:42:19.743 DEBUG:teuthology.orchestra.run.smithi115:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-30T18:42:19.769 INFO:teuthology.orchestra.run.smithi049.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-30T18:42:19.799 INFO:teuthology.orchestra.run.smithi115.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-30T18:42:19.805 INFO:tasks.ceph:Archiving crash dumps... 2023-11-30T18:42:19.807 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472115/remote/smithi049/crash 2023-11-30T18:42:19.807 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-30T18:42:19.844 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472115/remote/smithi115/crash 2023-11-30T18:42:19.845 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-30T18:42:19.869 INFO:tasks.ceph:Shutting down logrotate 2023-11-30T18:42:19.869 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:42:19.889 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T18:42:19.947 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-30T18:42:19.973 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-30T18:42:20.012 INFO:tasks.ceph:Compressing logs... 2023-11-30T18:42:20.012 DEBUG:teuthology.orchestra.run.smithi049:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-30T18:42:20.015 DEBUG:teuthology.orchestra.run.smithi115:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-30T18:42:20.040 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136608.log 2023-11-30T18:42:20.040 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97963.log 2023-11-30T18:42:20.040 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.136608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120466.log 2023-11-30T18:42:20.083 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.94906.log 2023-11-30T18:42:20.083 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90413.log 2023-11-30T18:42:20.083 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.3.94906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90203.log 2023-11-30T18:42:20.083 INFO:teuthology.orchestra.run.smithi115.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.94906.log.gz 2023-11-30T18:42:20.083 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.90413.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-30T18:42:20.083 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.90203.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-30T18:42:20.083 INFO:teuthology.orchestra.run.smithi115.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.90413.log.gz 2023-11-30T18:42:20.083 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.90203.log.gz 2023-11-30T18:42:20.083 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90287.log 2023-11-30T18:42:20.083 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-30T18:42:20.083 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.90287.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-30T18:42:20.083 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph.audit.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.90287.log.gz 2023-11-30T18:42:20.094 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-30T18:42:20.094 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-30T18:42:20.094 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-30T18:42:20.094 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-mon.c.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-30T18:42:20.094 INFO:teuthology.orchestra.run.smithi115.stderr: 94.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-30T18:42:20.094 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-30T18:42:20.094 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90246.log 2023-11-30T18:42:20.094 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90371.log 2023-11-30T18:42:20.094 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.90246.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.90246.log.gz 2023-11-30T18:42:20.094 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.90371.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-30T18:42:20.094 INFO:teuthology.orchestra.run.smithi115.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.90371.log.gz 2023-11-30T18:42:20.094 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90161.log 2023-11-30T18:42:20.108 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.90161.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.90161.log.gz 2023-11-30T18:42:20.109 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94116.log 2023-11-30T18:42:20.109 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.94116.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94116.log.gz 2023-11-30T18:42:20.109 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-30T18:42:20.115 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.94520.log 2023-11-30T18:42:20.115 INFO:teuthology.orchestra.run.smithi115.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-30T18:42:20.122 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.1.94520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.94520.log.gz 2023-11-30T18:42:20.122 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-30T18:42:20.128 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94548.log 2023-11-30T18:42:20.141 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.94548.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94548.log.gz 2023-11-30T18:42:20.142 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90329.log 2023-11-30T18:42:20.159 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.90329.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.90329.log.gz 2023-11-30T18:42:20.159 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90456.log 2023-11-30T18:42:20.171 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.90456.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.90456.log.gz 2023-11-30T18:42:20.193 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.97963.log: 88.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.136608.log.gz--verbose 2023-11-30T18:42:20.193 INFO:teuthology.orchestra.run.smithi049.stderr:-- /var/log/ceph/ceph-client.admin.117111.log 2023-11-30T18:42:20.193 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.120466.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97963.log.gz 2023-11-30T18:42:20.193 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117503.log 2023-11-30T18:42:20.193 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.117111.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.120466.log.gz 2023-11-30T18:42:20.194 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102358.log 2023-11-30T18:42:20.194 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117111.log.gz 2023-11-30T18:42:20.194 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.117503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95627.log 2023-11-30T18:42:20.194 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122208.log 2023-11-30T18:42:20.194 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.102358.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.117503.log.gz 2023-11-30T18:42:20.194 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.95627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116214.log 2023-11-30T18:42:20.194 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102358.log.gz 2023-11-30T18:42:20.194 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95627.log.gz 2023-11-30T18:42:20.194 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.122208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98489.log 2023-11-30T18:42:20.194 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.116214.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.122208.log.gz 2023-11-30T18:42:20.194 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114625.log 2023-11-30T18:42:20.194 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.98489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.133088.log 2023-11-30T18:42:20.194 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.116214.log.gz 2023-11-30T18:42:20.194 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.114625.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.98489.log.gz 2023-11-30T18:42:20.194 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.94288.log 2023-11-30T18:42:20.195 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114625.log.gz 2023-11-30T18:42:20.195 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.133088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124339.log 2023-11-30T18:42:20.195 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.133088.log.gz 2023-11-30T18:42:20.195 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.94288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114797.log 2023-11-30T18:42:20.195 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.124339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132764.log 2023-11-30T18:42:20.195 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94288.log.gz 2023-11-30T18:42:20.195 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8%/var/log/ceph/ceph-client.admin.114797.log: -- replaced with /var/log/ceph/ceph-client.admin.124339.log.gz 2023-11-30T18:42:20.195 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120126.log 2023-11-30T18:42:20.195 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114797.log.gz 2023-11-30T18:42:20.195 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.132764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140435.log 2023-11-30T18:42:20.195 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.120126.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.132764.log.gz 2023-11-30T18:42:20.195 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115391.log 2023-11-30T18:42:20.195 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.140435.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.120126.log.gz 2023-11-30T18:42:20.195 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106516.log 2023-11-30T18:42:20.195 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.115391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122836.log 2023-11-30T18:42:20.196 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140435.log.gz 2023-11-30T18:42:20.196 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115391.log.gz 2023-11-30T18:42:20.196 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.106516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136211.log 2023-11-30T18:42:20.196 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.122836.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.106516.log.gz 2023-11-30T18:42:20.196 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141792.log 2023-11-30T18:42:20.196 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.136211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90028.log 2023-11-30T18:42:20.196 INFO:teuthology.orchestra.run.smithi049.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.122836.log.gz 2023-11-30T18:42:20.196 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.141792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123719.log 2023-11-30T18:42:20.196 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.136211.log.gz 2023-11-30T18:42:20.196 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141792.log.gz 2023-11-30T18:42:20.196 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.90028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140265.log 2023-11-30T18:42:20.196 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.123719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99256.log 2023-11-30T18:42:20.196 INFO:teuthology.orchestra.run.smithi049.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.90028.log.gz 2023-11-30T18:42:20.196 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.140265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140651.log 2023-11-30T18:42:20.196 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123719.log.gz 2023-11-30T18:42:20.196 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.99256.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.140265.log.gz 2023-11-30T18:42:20.197 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.97837.log 2023-11-30T18:42:20.197 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.140651.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99256.log.gzgzip 2023-11-30T18:42:20.197 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.116629.log 2023-11-30T18:42:20.197 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.97837.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140651.log.gz 2023-11-30T18:42:20.197 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119112.log 2023-11-30T18:42:20.197 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.116629.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97837.log.gz 2023-11-30T18:42:20.197 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122351.log 2023-11-30T18:42:20.197 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.116629.log.gz 2023-11-30T18:42:20.197 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.119112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94695.log 2023-11-30T18:42:20.197 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.119112.log.gz 2023-11-30T18:42:20.197 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.122351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119022.log 2023-11-30T18:42:20.197 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.94695.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.122351.log.gz 2023-11-30T18:42:20.197 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99932.log 2023-11-30T18:42:20.197 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94695.log.gz 2023-11-30T18:42:20.197 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.119022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99012.log 2023-11-30T18:42:20.198 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.99932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133238.log 2023-11-30T18:42:20.198 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.119022.log.gz 2023-11-30T18:42:20.198 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.99012.log: gzip -5 88.3%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.99932.log.gz 2023-11-30T18:42:20.198 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.130999.log 2023-11-30T18:42:20.198 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.99012.log.gz 2023-11-30T18:42:20.198 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.133238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93868.log 2023-11-30T18:42:20.198 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.130999.log: gzip -5 87.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.133238.log.gz/var/log/ceph/ceph-client.admin.106726.log 2023-11-30T18:42:20.198 INFO:teuthology.orchestra.run.smithi049.stderr: 2023-11-30T18:42:20.198 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.93868.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.130999.log.gz 2023-11-30T18:42:20.198 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94424.log 2023-11-30T18:42:20.198 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93868.log.gz 2023-11-30T18:42:20.198 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.106726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.118249.log 2023-11-30T18:42:20.198 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.94424.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.106726.log.gz 2023-11-30T18:42:20.198 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117279.log 2023-11-30T18:42:20.198 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94424.log.gz 2023-11-30T18:42:20.199 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139875.log 2023-11-30T18:42:20.199 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.118249.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.118249.log.gz 2023-11-30T18:42:20.199 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.117279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103175.log 2023-11-30T18:42:20.199 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.139875.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117279.log.gz 2023-11-30T18:42:20.199 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115667.log 2023-11-30T18:42:20.199 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139875.log.gz 2023-11-30T18:42:20.199 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.103175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117367.log 2023-11-30T18:42:20.199 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.115667.log: 86.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.103175.log.gz 2023-11-30T18:42:20.199 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.135337.log 2023-11-30T18:42:20.199 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.117367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113593.log 2023-11-30T18:42:20.199 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115667.log.gz 2023-11-30T18:42:20.199 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.135337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136566.log 2023-11-30T18:42:20.199 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117367.log.gz 2023-11-30T18:42:20.199 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.135337.log.gz 2023-11-30T18:42:20.199 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.113593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104844.log 2023-11-30T18:42:20.200 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113593.log.gz 2023-11-30T18:42:20.200 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.136566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129718.log 2023-11-30T18:42:20.200 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.104844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116755.log 2023-11-30T18:42:20.200 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.136566.log.gz 2023-11-30T18:42:20.200 INFO:teuthology.orchestra.run.smithi049.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.104844.log.gz 2023-11-30T18:42:20.200 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.129718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120550.log 2023-11-30T18:42:20.200 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.116755.log: gzip -5 --verbose 89.1%-- /var/log/ceph/ceph-client.admin.116393.log 2023-11-30T18:42:20.200 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.129718.log.gz 2023-11-30T18:42:20.200 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.120550.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.116755.log.gzgzip 2023-11-30T18:42:20.200 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.119568.log 2023-11-30T18:42:20.200 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.120550.log.gz 2023-11-30T18:42:20.200 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.116393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112132.log 2023-11-30T18:42:20.200 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.119568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98132.log 2023-11-30T18:42:20.200 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.116393.log.gz 2023-11-30T18:42:20.200 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.112132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121000.log 2023-11-30T18:42:20.200 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.119568.log.gz 2023-11-30T18:42:20.201 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.98132.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112132.log.gzgzip 2023-11-30T18:42:20.201 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.120000.log 2023-11-30T18:42:20.201 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98132.log.gz 2023-11-30T18:42:20.201 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132164.log 2023-11-30T18:42:20.201 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.121000.log: /var/log/ceph/ceph-client.admin.120000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120256.log 2023-11-30T18:42:20.201 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.121000.log.gz 2023-11-30T18:42:20.201 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.120000.log.gz 2023-11-30T18:42:20.201 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.132164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115091.log 2023-11-30T18:42:20.201 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.132164.log.gz 2023-11-30T18:42:20.201 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.120256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123004.log 2023-11-30T18:42:20.201 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.115091.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.120256.log.gz 2023-11-30T18:42:20.201 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118818.log 2023-11-30T18:42:20.201 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115091.log.gz 2023-11-30T18:42:20.201 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.123004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101441.log 2023-11-30T18:42:20.201 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.123004.log.gz 2023-11-30T18:42:20.201 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.118818.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-30T18:42:20.202 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.101441.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.118818.log.gz 2023-11-30T18:42:20.202 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131910.log 2023-11-30T18:42:20.202 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mds.a.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.101441.log.gz 2023-11-30T18:42:20.202 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112694.log 2023-11-30T18:42:20.202 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.131910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115175.log 2023-11-30T18:42:20.202 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.131910.log.gz 2023-11-30T18:42:20.202 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112694.log: /var/log/ceph/ceph-client.admin.128320.log 2023-11-30T18:42:20.202 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.115175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130901.log 2023-11-30T18:42:20.202 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.112694.log.gz 2023-11-30T18:42:20.202 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.128320.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.115175.log.gz 2023-11-30T18:42:20.202 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101617.log 2023-11-30T18:42:20.202 INFO:teuthology.orchestra.run.smithi049.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.128320.log.gz 2023-11-30T18:42:20.202 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.130901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130812.log 2023-11-30T18:42:20.202 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.101617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128590.log 2023-11-30T18:42:20.202 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.130901.log.gz 2023-11-30T18:42:20.203 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.130812.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101617.log.gz 2023-11-30T18:42:20.203 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128456.log 2023-11-30T18:42:20.203 INFO:teuthology.orchestra.run.smithi049.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.130812.log.gz 2023-11-30T18:42:20.203 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.128590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133172.log 2023-11-30T18:42:20.203 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.128456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107176.log 2023-11-30T18:42:20.203 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.128590.log.gz 2023-11-30T18:42:20.203 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128456.log.gz/var/log/ceph/ceph-client.admin.133172.log: 2023-11-30T18:42:20.203 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115343.log 2023-11-30T18:42:20.203 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.107176.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.133172.log.gz 2023-11-30T18:42:20.203 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105094.log 2023-11-30T18:42:20.203 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107176.log.gz 2023-11-30T18:42:20.203 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.115343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101701.log 2023-11-30T18:42:20.203 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.105094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115259.log 2023-11-30T18:42:20.203 INFO:teuthology.orchestra.run.smithi049.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.115343.log.gz 2023-11-30T18:42:20.203 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.101701.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105094.log.gz 2023-11-30T18:42:20.204 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111209.log 2023-11-30T18:42:20.204 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.101701.log.gz 2023-11-30T18:42:20.204 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.115259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122752.log 2023-11-30T18:42:20.204 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.115259.log.gz 2023-11-30T18:42:20.204 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.111209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142961.log 2023-11-30T18:42:20.204 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111209.log.gz 2023-11-30T18:42:20.204 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.122752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106768.log 2023-11-30T18:42:20.204 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.142961.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122752.log.gz 2023-11-30T18:42:20.204 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113317.log 2023-11-30T18:42:20.204 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.106768.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.142961.log.gz 2023-11-30T18:42:20.204 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98741.log 2023-11-30T18:42:20.204 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.113317.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.106768.log.gz 2023-11-30T18:42:20.204 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110743.log 2023-11-30T18:42:20.204 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.98741.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.113317.log.gz 2023-11-30T18:42:20.204 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124572.log 2023-11-30T18:42:20.204 INFO:teuthology.orchestra.run.smithi049.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.98741.log.gz 2023-11-30T18:42:20.205 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.110743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129930.log 2023-11-30T18:42:20.205 INFO:teuthology.orchestra.run.smithi049.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.110743.log.gz 2023-11-30T18:42:20.205 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.124572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103591.log 2023-11-30T18:42:20.205 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.129930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96257.log 2023-11-30T18:42:20.205 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.124572.log.gz 2023-11-30T18:42:20.205 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.103591.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.129930.log.gz 2023-11-30T18:42:20.205 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112562.log 2023-11-30T18:42:20.205 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.103591.log.gz 2023-11-30T18:42:20.205 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.96257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140393.log 2023-11-30T18:42:20.205 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.112562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129328.log 2023-11-30T18:42:20.205 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96257.log.gz 2023-11-30T18:42:20.205 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.140393.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.112562.log.gz 2023-11-30T18:42:20.205 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142176.log 2023-11-30T18:42:20.205 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140393.log.gz 2023-11-30T18:42:20.205 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.129328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122794.log 2023-11-30T18:42:20.206 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.142176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134914.log 2023-11-30T18:42:20.206 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.129328.log.gz 2023-11-30T18:42:20.206 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.122794.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.142176.log.gz 2023-11-30T18:42:20.206 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131952.log 2023-11-30T18:42:20.206 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.122794.log.gz 2023-11-30T18:42:20.206 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.134914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111523.log 2023-11-30T18:42:20.206 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.131952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132722.log 2023-11-30T18:42:20.206 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.134914.log.gz 2023-11-30T18:42:20.206 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.111523.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.131952.log.gz 2023-11-30T18:42:20.206 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95199.log 2023-11-30T18:42:20.206 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.111523.log.gz 2023-11-30T18:42:20.206 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.132722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130381.log 2023-11-30T18:42:20.206 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.95199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143397.log 2023-11-30T18:42:20.206 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.132722.log.gz 2023-11-30T18:42:20.206 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.130381.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95199.log.gz 2023-11-30T18:42:20.206 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129496.log 2023-11-30T18:42:20.207 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.130381.log.gz 2023-11-30T18:42:20.207 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.143397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129888.log 2023-11-30T18:42:20.207 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.129496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116027.log 2023-11-30T18:42:20.207 INFO:teuthology.orchestra.run.smithi049.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.143397.log.gz 2023-11-30T18:42:20.207 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.129888.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.129496.log.gz 2023-11-30T18:42:20.207 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128743.log 2023-11-30T18:42:20.207 INFO:teuthology.orchestra.run.smithi049.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.129888.log.gz 2023-11-30T18:42:20.207 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.116027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129187.log 2023-11-30T18:42:20.207 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.128743.log: gzip -5 --verbose 87.7%-- /var/log/ceph/ceph-client.admin.140223.log -- replaced with /var/log/ceph/ceph-client.admin.116027.log.gz 2023-11-30T18:42:20.207 INFO:teuthology.orchestra.run.smithi049.stderr: 2023-11-30T18:42:20.207 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.129187.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128743.log.gz 2023-11-30T18:42:20.207 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102627.log 2023-11-30T18:42:20.207 INFO:teuthology.orchestra.run.smithi049.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.129187.log.gz 2023-11-30T18:42:20.207 INFO:teuthology.orchestra.run.smithi049.stderr:gzip /var/log/ceph/ceph-client.admin.140223.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.130339.log 2023-11-30T18:42:20.207 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.102627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102711.log 2023-11-30T18:42:20.208 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140223.log.gz 2023-11-30T18:42:20.208 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.130339.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.102627.log.gz 2023-11-30T18:42:20.208 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113195.log 2023-11-30T18:42:20.208 INFO:teuthology.orchestra.run.smithi049.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.130339.log.gz 2023-11-30T18:42:20.208 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.102711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118009.log 2023-11-30T18:42:20.208 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.113195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114092.log 2023-11-30T18:42:20.208 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.102711.log.gz 2023-11-30T18:42:20.208 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.118009.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113195.log.gz 2023-11-30T18:42:20.208 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119652.log 2023-11-30T18:42:20.208 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.114092.log: -- /var/log/ceph/ceph-client.admin.137269.log 2023-11-30T18:42:20.208 INFO:teuthology.orchestra.run.smithi049.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.118009.log.gz 2023-11-30T18:42:20.208 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.119652.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114092.log.gz 2023-11-30T18:42:20.208 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120634.log 2023-11-30T18:42:20.208 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143045.log 2023-11-30T18:42:20.208 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.137269.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.119652.log.gz 2023-11-30T18:42:20.208 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.120634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120676.log 2023-11-30T18:42:20.209 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.137269.log.gz 2023-11-30T18:42:20.209 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.120634.log.gz 2023-11-30T18:42:20.209 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.143045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123226.log 2023-11-30T18:42:20.209 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.120676.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.143045.log.gz 2023-11-30T18:42:20.209 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143087.log 2023-11-30T18:42:20.209 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.123226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118057.log 2023-11-30T18:42:20.209 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.123226.log.gz 2023-11-30T18:42:20.209 INFO:teuthology.orchestra.run.smithi049.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.120676.log.gz 2023-11-30T18:42:20.209 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.143087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134220.log 2023-11-30T18:42:20.209 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.118057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132208.log 2023-11-30T18:42:20.209 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.143087.log.gz 2023-11-30T18:42:20.209 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.134220.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.118057.log.gz 2023-11-30T18:42:20.209 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136818.log 2023-11-30T18:42:20.209 INFO:teuthology.orchestra.run.smithi049.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.134220.log.gz 2023-11-30T18:42:20.209 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.132208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119484.log 2023-11-30T18:42:20.209 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.136818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116901.log 2023-11-30T18:42:20.210 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.132208.log.gz 2023-11-30T18:42:20.210 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.119484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94382.log 2023-11-30T18:42:20.210 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.119484.log.gz 2023-11-30T18:42:20.210 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.116901.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.136818.log.gz 2023-11-30T18:42:20.210 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103333.log 2023-11-30T18:42:20.210 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.94382.log: gzip -5 88.4%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.116901.log.gz/var/log/ceph/ceph-client.admin.100310.log 2023-11-30T18:42:20.210 INFO:teuthology.orchestra.run.smithi049.stderr: 2023-11-30T18:42:20.210 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.103333.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.94382.log.gz 2023-11-30T18:42:20.210 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115133.log 2023-11-30T18:42:20.210 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103333.log.gz 2023-11-30T18:42:20.210 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.100310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118695.log 2023-11-30T18:42:20.210 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.115133.log: gzip -5 87.2%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.100310.log.gz/var/log/ceph/ceph-client.admin.101109.log 2023-11-30T18:42:20.210 INFO:teuthology.orchestra.run.smithi049.stderr: 2023-11-30T18:42:20.210 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.118695.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115133.log.gz 2023-11-30T18:42:20.210 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96542.log 2023-11-30T18:42:20.210 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.118695.log.gz 2023-11-30T18:42:20.211 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.101109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132428.log 2023-11-30T18:42:20.211 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.96542.log: gzip 87.8%-5 -- replaced with /var/log/ceph/ceph-client.admin.101109.log.gz--verbose 2023-11-30T18:42:20.211 INFO:teuthology.orchestra.run.smithi049.stderr:-- /var/log/ceph/ceph-client.admin.142751.log 2023-11-30T18:42:20.211 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.132428.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.96542.log.gz 2023-11-30T18:42:20.211 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132638.log 2023-11-30T18:42:20.211 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.132428.log.gz 2023-11-30T18:42:20.211 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.142751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117925.log 2023-11-30T18:42:20.211 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.132638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131503.log 2023-11-30T18:42:20.211 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.142751.log.gz 2023-11-30T18:42:20.211 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.117925.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.132638.log.gz 2023-11-30T18:42:20.211 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93693.log 2023-11-30T18:42:20.211 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117925.log.gz 2023-11-30T18:42:20.211 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.131503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136031.log 2023-11-30T18:42:20.211 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.93693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123574.log 2023-11-30T18:42:20.211 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.131503.log.gz 2023-11-30T18:42:20.212 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.136031.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.93693.log.gz 2023-11-30T18:42:20.212 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106970.log 2023-11-30T18:42:20.212 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.136031.log.gz 2023-11-30T18:42:20.212 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.123574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123616.log 2023-11-30T18:42:20.212 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.106970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143171.log 2023-11-30T18:42:20.212 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.123574.log.gz 2023-11-30T18:42:20.212 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.123616.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.106970.log.gz 2023-11-30T18:42:20.212 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112520.log 2023-11-30T18:42:20.212 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.123616.log.gz 2023-11-30T18:42:20.212 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.143171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110879.log 2023-11-30T18:42:20.212 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.112520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107824.log 2023-11-30T18:42:20.212 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.143171.log.gz 2023-11-30T18:42:20.212 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.110879.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.112520.log.gz 2023-11-30T18:42:20.212 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99214.log 2023-11-30T18:42:20.212 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110879.log.gz 2023-11-30T18:42:20.213 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.107824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106381.log 2023-11-30T18:42:20.213 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.99214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94821.log 2023-11-30T18:42:20.213 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.107824.log.gz 2023-11-30T18:42:20.213 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.106381.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.99214.log.gz 2023-11-30T18:42:20.213 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98005.log 2023-11-30T18:42:20.213 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.106381.log.gz 2023-11-30T18:42:20.213 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.94821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103001.log 2023-11-30T18:42:20.213 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.98005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141146.log 2023-11-30T18:42:20.213 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94821.log.gz 2023-11-30T18:42:20.213 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.103001.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.98005.log.gz 2023-11-30T18:42:20.213 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99678.log 2023-11-30T18:42:20.213 INFO:teuthology.orchestra.run.smithi049.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.103001.log.gz 2023-11-30T18:42:20.213 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.141146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95417.log 2023-11-30T18:42:20.213 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.99678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123845.log 2023-11-30T18:42:20.213 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.141146.log.gz 2023-11-30T18:42:20.213 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.95417.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.99678.log.gz 2023-11-30T18:42:20.214 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141658.log 2023-11-30T18:42:20.214 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95417.log.gz 2023-11-30T18:42:20.214 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.123845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139673.log 2023-11-30T18:42:20.214 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.141658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99340.log 2023-11-30T18:42:20.214 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.123845.log.gz 2023-11-30T18:42:20.214 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.139673.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.141658.log.gz 2023-11-30T18:42:20.214 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119246.log 2023-11-30T18:42:20.214 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.139673.log.gz 2023-11-30T18:42:20.214 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.99340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111058.log 2023-11-30T18:42:20.214 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.119246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122487.log 2023-11-30T18:42:20.214 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.99340.log.gz 2023-11-30T18:42:20.214 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.111058.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.119246.log.gz 2023-11-30T18:42:20.214 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106471.log 2023-11-30T18:42:20.214 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.111058.log.gz 2023-11-30T18:42:20.214 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.122487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97501.log 2023-11-30T18:42:20.214 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7%/var/log/ceph/ceph-client.admin.106471.log: -- replaced with /var/log/ceph/ceph-client.admin.122487.log.gz 2023-11-30T18:42:20.215 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116839.log 2023-11-30T18:42:20.215 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.97501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99424.log 2023-11-30T18:42:20.215 INFO:teuthology.orchestra.run.smithi049.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.106471.log.gz 2023-11-30T18:42:20.215 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.116839.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.97501.log.gz 2023-11-30T18:42:20.215 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102316.log 2023-11-30T18:42:20.215 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.116839.log.gz 2023-11-30T18:42:20.215 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.99424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112344.log 2023-11-30T18:42:20.215 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.102316.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.99424.log.gz 2023-11-30T18:42:20.215 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115301.log 2023-11-30T18:42:20.215 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.112344.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102316.log.gz 2023-11-30T18:42:20.215 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-30T18:42:20.215 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.115301.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112344.log.gz 2023-11-30T18:42:20.215 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120424.log 2023-11-30T18:42:20.215 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph.log: gzip 89.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.115301.log.gz--verbose 2023-11-30T18:42:20.215 INFO:teuthology.orchestra.run.smithi049.stderr:-- /var/log/ceph/ceph-client.admin.97795.log 2023-11-30T18:42:20.215 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.120424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131088.log 2023-11-30T18:42:20.216 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.120424.log.gz 2023-11-30T18:42:20.216 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.97795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98174.log 2023-11-30T18:42:20.216 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97795.log.gz 2023-11-30T18:42:20.216 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94160.log 2023-11-30T18:42:20.216 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.131088.log: /var/log/ceph/ceph-client.admin.98174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124013.log 2023-11-30T18:42:20.216 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.131088.log.gz 2023-11-30T18:42:20.216 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98174.log.gz 2023-11-30T18:42:20.216 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.94160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114255.log 2023-11-30T18:42:20.216 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95115.log 2023-11-30T18:42:20.216 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8%/var/log/ceph/ceph-client.admin.124013.log: -- replaced with /var/log/ceph/ceph-client.admin.94160.log.gz 2023-11-30T18:42:20.216 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.114255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98657.log 2023-11-30T18:42:20.216 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.95115.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114255.log.gz 2023-11-30T18:42:20.216 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117419.log 2023-11-30T18:42:20.216 INFO:teuthology.orchestra.run.smithi049.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.124013.log.gz 2023-11-30T18:42:20.216 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95115.log.gz 2023-11-30T18:42:20.216 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95711.log 2023-11-30T18:42:20.217 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.98657.log: /var/log/ceph/ceph-client.admin.117419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118444.log 2023-11-30T18:42:20.217 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98657.log.gz 2023-11-30T18:42:20.217 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.95711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99172.log 2023-11-30T18:42:20.217 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.117419.log.gz 2023-11-30T18:42:20.217 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.118444.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95711.log.gz 2023-11-30T18:42:20.217 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101167.log 2023-11-30T18:42:20.217 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.118444.log.gz 2023-11-30T18:42:20.217 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114333.log 2023-11-30T18:42:20.217 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.99172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102943.log 2023-11-30T18:42:20.217 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.101167.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99172.log.gz 2023-11-30T18:42:20.217 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.114333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116438.log 2023-11-30T18:42:20.217 INFO:teuthology.orchestra.run.smithi049.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.101167.log.gz 2023-11-30T18:42:20.217 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129676.log 2023-11-30T18:42:20.217 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.102943.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.114333.log.gz 2023-11-30T18:42:20.217 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.116438.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.102943.log.gz 2023-11-30T18:42:20.218 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117195.log 2023-11-30T18:42:20.218 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100100.log 2023-11-30T18:42:20.218 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.129676.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116438.log.gz 2023-11-30T18:42:20.218 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.117195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132896.log 88.3% 2023-11-30T18:42:20.218 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.129676.log.gz 2023-11-30T18:42:20.218 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142008.log 2023-11-30T18:42:20.218 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.100100.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.117195.log.gz 2023-11-30T18:42:20.218 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.132896.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100100.log.gz 2023-11-30T18:42:20.218 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102442.log 2023-11-30T18:42:20.218 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135096.log 2023-11-30T18:42:20.218 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.142008.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.132896.log.gz 2023-11-30T18:42:20.218 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.102442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118925.log 2023-11-30T18:42:20.218 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.142008.log.gz 2023-11-30T18:42:20.218 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99634.log 2023-11-30T18:42:20.218 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.135096.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.102442.log.gz 2023-11-30T18:42:20.219 INFO:teuthology.orchestra.run.smithi049.stderr: 89.5% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-30T18:42:20.219 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.118925.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.135096.log.gz 2023-11-30T18:42:20.219 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107398.log 2023-11-30T18:42:20.219 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95157.log 2023-11-30T18:42:20.219 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.99634.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.118925.log.gz 2023-11-30T18:42:20.219 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.107398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120724.log 2023-11-30T18:42:20.219 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99634.log.gz 2023-11-30T18:42:20.219 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.95157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135781.log 2023-11-30T18:42:20.219 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107398.log.gz 2023-11-30T18:42:20.219 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95157.log.gz 2023-11-30T18:42:20.219 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.120724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97627.log 2023-11-30T18:42:20.219 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.120724.log.gz 2023-11-30T18:42:20.219 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.135781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140131.log 2023-11-30T18:42:20.219 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.97627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100058.log 2023-11-30T18:42:20.219 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.135781.log.gz 2023-11-30T18:42:20.219 INFO:teuthology.orchestra.run.smithi049.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.97627.log.gz 2023-11-30T18:42:20.220 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.140131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94244.log 2023-11-30T18:42:20.220 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.140131.log.gz 2023-11-30T18:42:20.220 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.100058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134278.log 2023-11-30T18:42:20.220 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.94244.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.100058.log.gz 2023-11-30T18:42:20.220 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100184.log 2023-11-30T18:42:20.220 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94244.log.gz 2023-11-30T18:42:20.220 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.134278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108443.log 2023-11-30T18:42:20.220 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112928.log 2023-11-30T18:42:20.220 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.100184.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.134278.log.gz 2023-11-30T18:42:20.220 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.108443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143315.log 2023-11-30T18:42:20.220 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100184.log.gz 2023-11-30T18:42:20.220 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108443.log.gz 2023-11-30T18:42:20.220 INFO:teuthology.orchestra.run.smithi049.stderr:gzip /var/log/ceph/ceph-client.admin.112928.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.139569.log 2023-11-30T18:42:20.220 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.143315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128962.log 2023-11-30T18:42:20.220 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112928.log.gz 2023-11-30T18:42:20.220 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.139569.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.143315.log.gz 2023-11-30T18:42:20.221 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111293.log 2023-11-30T18:42:20.221 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139569.log.gz 2023-11-30T18:42:20.221 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.128962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111461.log 2023-11-30T18:42:20.221 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.111293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134960.log 2023-11-30T18:42:20.221 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.128962.log.gz 2023-11-30T18:42:20.221 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.111461.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.111293.log.gz 2023-11-30T18:42:20.221 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129370.log 2023-11-30T18:42:20.221 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.111461.log.gz 2023-11-30T18:42:20.221 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.134960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96131.log 2023-11-30T18:42:20.221 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.129370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122665.log 2023-11-30T18:42:20.221 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.134960.log.gz 2023-11-30T18:42:20.221 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.96131.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.129370.log.gz 2023-11-30T18:42:20.221 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137100.log 2023-11-30T18:42:20.221 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96131.log.gz 2023-11-30T18:42:20.221 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.122665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142793.log 2023-11-30T18:42:20.221 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.137100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132036.log 2023-11-30T18:42:20.222 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122665.log.gz 2023-11-30T18:42:20.222 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.142793.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.137100.log.gz 2023-11-30T18:42:20.222 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99466.log 2023-11-30T18:42:20.222 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.142793.log.gz 2023-11-30T18:42:20.222 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120592.log /var/log/ceph/ceph-client.admin.132036.log: 2023-11-30T18:42:20.222 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.99466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128836.log 2023-11-30T18:42:20.222 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.132036.log.gz 2023-11-30T18:42:20.222 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.120592.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99466.log.gz 2023-11-30T18:42:20.222 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115982.log 2023-11-30T18:42:20.222 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.120592.log.gz 2023-11-30T18:42:20.222 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.128836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.120916.log 2023-11-30T18:42:20.222 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.115982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135989.log 2023-11-30T18:42:20.222 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.128836.log.gz 2023-11-30T18:42:20.222 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.120916.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115982.log.gz 2023-11-30T18:42:20.222 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115625.log 2023-11-30T18:42:20.222 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.120916.log.gz 2023-11-30T18:42:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.135989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140928.log 2023-11-30T18:42:20.223 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.135989.log.gz 2023-11-30T18:42:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.115625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138967.log 2023-11-30T18:42:20.223 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.115625.log.gz 2023-11-30T18:42:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.140928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108040.log 2023-11-30T18:42:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.138967.log: 87.5%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.140928.log.gz--verbose 2023-11-30T18:42:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:-- /var/log/ceph/ceph-client.admin.90432.log 2023-11-30T18:42:20.223 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.138967.log.gz 2023-11-30T18:42:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.108040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98275.log 2023-11-30T18:42:20.223 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.108040.log.gz 2023-11-30T18:42:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.90432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97879.log 2023-11-30T18:42:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.98275.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.90432.log.gzgzip 2023-11-30T18:42:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.101827.log 2023-11-30T18:42:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.97879.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98275.log.gz 2023-11-30T18:42:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95501.log 2023-11-30T18:42:20.224 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97879.log.gz 2023-11-30T18:42:20.224 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.101827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117673.log 2023-11-30T18:42:20.224 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.95501.log: gzip 87.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.101827.log.gz-- 2023-11-30T18:42:20.224 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.106600.log 2023-11-30T18:42:20.224 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.117673.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95501.log.gz 2023-11-30T18:42:20.224 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122396.log 2023-11-30T18:42:20.224 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.117673.log.gz 2023-11-30T18:42:20.224 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.106600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97711.log 2023-11-30T18:42:20.224 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.106600.log.gz 2023-11-30T18:42:20.224 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.122396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107526.log 2023-11-30T18:42:20.224 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.97711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111251.log 2023-11-30T18:42:20.224 INFO:teuthology.orchestra.run.smithi049.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.122396.log.gz 2023-11-30T18:42:20.224 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97711.log.gz 2023-11-30T18:42:20.224 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.107526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99550.log 2023-11-30T18:42:20.224 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.111251.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107526.log.gz 2023-11-30T18:42:20.224 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139146.log 2023-11-30T18:42:20.225 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.111251.log.gz 2023-11-30T18:42:20.225 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.99550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122575.log 2023-11-30T18:42:20.225 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.139146.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99550.log.gz 2023-11-30T18:42:20.225 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97459.log 2023-11-30T18:42:20.225 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.139146.log.gz/var/log/ceph/ceph-client.admin.122575.log: 2023-11-30T18:42:20.225 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132300.log 2023-11-30T18:42:20.225 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.97459.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122575.log.gzgzip 2023-11-30T18:42:20.225 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.134773.log 2023-11-30T18:42:20.225 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.97459.log.gz 2023-11-30T18:42:20.225 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.132300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96047.log 2023-11-30T18:42:20.225 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.134773.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.132300.log.gz 2023-11-30T18:42:20.225 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134862.log 2023-11-30T18:42:20.225 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.134773.log.gz 2023-11-30T18:42:20.225 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.96047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116305.log 2023-11-30T18:42:20.225 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96047.log.gz 2023-11-30T18:42:20.225 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.134862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122022.log 2023-11-30T18:42:20.226 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.116305.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.134862.log.gz 2023-11-30T18:42:20.226 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129109.log 2023-11-30T18:42:20.226 INFO:teuthology.orchestra.run.smithi049.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.116305.log.gz 2023-11-30T18:42:20.226 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.122022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140477.log 2023-11-30T18:42:20.226 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.122022.log.gz 2023-11-30T18:42:20.226 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.129109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123929.log 2023-11-30T18:42:20.226 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.140477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134650.log 2023-11-30T18:42:20.226 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.129109.log.gz 2023-11-30T18:42:20.226 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.140477.log.gz 2023-11-30T18:42:20.226 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.123929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106059.log 2023-11-30T18:42:20.226 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.123929.log.gz 2023-11-30T18:42:20.226 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.134650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.115583.log 2023-11-30T18:42:20.226 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.106059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123761.log 2023-11-30T18:42:20.226 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.134650.log.gz 2023-11-30T18:42:20.226 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.106059.log.gz 2023-11-30T18:42:20.227 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.115583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133406.log 2023-11-30T18:42:20.227 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.115583.log.gz 2023-11-30T18:42:20.227 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.123761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96173.log 2023-11-30T18:42:20.227 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.133406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94947.log 2023-11-30T18:42:20.227 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.123761.log.gz 2023-11-30T18:42:20.227 INFO:teuthology.orchestra.run.smithi049.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.133406.log.gz 2023-11-30T18:42:20.227 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.96173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96383.log 2023-11-30T18:42:20.227 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.94947.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96173.log.gz 2023-11-30T18:42:20.227 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94118.log 2023-11-30T18:42:20.227 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.96383.log: 88.3%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.94947.log.gz--verbose 2023-11-30T18:42:20.227 INFO:teuthology.orchestra.run.smithi049.stderr:-- /var/log/ceph/ceph-client.admin.106293.log 2023-11-30T18:42:20.227 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96383.log.gz 2023-11-30T18:42:20.227 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.94118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110789.log 2023-11-30T18:42:20.227 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94118.log.gz 2023-11-30T18:42:20.227 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.106293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101283.log 2023-11-30T18:42:20.227 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.106293.log.gz 2023-11-30T18:42:20.228 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.110789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119337.log 2023-11-30T18:42:20.228 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.101283.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110789.log.gz 2023-11-30T18:42:20.228 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115778.log 2023-11-30T18:42:20.228 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.101283.log.gz 2023-11-30T18:42:20.228 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.119337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141471.log 2023-11-30T18:42:20.228 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.115778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100935.log 2023-11-30T18:42:20.228 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.119337.log.gz 2023-11-30T18:42:20.228 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115778.log.gz 2023-11-30T18:42:20.228 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.141471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112970.log 2023-11-30T18:42:20.228 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.141471.log.gz 2023-11-30T18:42:20.228 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.100935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127097.log 2023-11-30T18:42:20.228 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.112970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100634.log 2023-11-30T18:42:20.228 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100935.log.gz 2023-11-30T18:42:20.228 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.112970.log.gz 2023-11-30T18:42:20.228 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.127097.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-30T18:42:20.228 INFO:teuthology.orchestra.run.smithi049.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.127097.log.gz 2023-11-30T18:42:20.229 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.100634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119201.log 2023-11-30T18:42:20.229 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph.audit.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.100634.log.gz 2023-11-30T18:42:20.229 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110374.log 2023-11-30T18:42:20.229 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.119201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139917.log 2023-11-30T18:42:20.229 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.110374.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.119201.log.gz 2023-11-30T18:42:20.229 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98531.log 2023-11-30T18:42:20.229 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110374.log.gz 2023-11-30T18:42:20.229 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.139917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100400.log 2023-11-30T18:42:20.229 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.139917.log.gz 2023-11-30T18:42:20.229 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.98531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138613.log 2023-11-30T18:42:20.229 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.100400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112470.log 2023-11-30T18:42:20.229 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98531.log.gz 2023-11-30T18:42:20.229 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100400.log.gz 2023-11-30T18:42:20.229 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.138613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107260.log 2023-11-30T18:42:20.230 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140561.log 2023-11-30T18:42:20.230 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.112470.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.138613.log.gz 2023-11-30T18:42:20.230 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.107260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131044.log 2023-11-30T18:42:20.230 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.112470.log.gz 2023-11-30T18:42:20.230 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107260.log.gz 2023-11-30T18:42:20.230 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112646.log 2023-11-30T18:42:20.230 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.140561.log: /var/log/ceph/ceph-client.admin.131044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107698.log 2023-11-30T18:42:20.230 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140561.log.gz 2023-11-30T18:42:20.230 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.112646.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.131044.log.gz 2023-11-30T18:42:20.230 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124295.log 2023-11-30T18:42:20.230 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.107698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103841.log 2023-11-30T18:42:20.230 INFO:teuthology.orchestra.run.smithi049.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.112646.log.gz 2023-11-30T18:42:20.230 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.124295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120042.log 2023-11-30T18:42:20.230 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.107698.log.gz 2023-11-30T18:42:20.230 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139299.log 2023-11-30T18:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.124295.log.gz 2023-11-30T18:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.103841.log: /var/log/ceph/ceph-client.admin.120042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139401.log 2023-11-30T18:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.103841.log.gz 2023-11-30T18:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.139299.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.120042.log.gz 2023-11-30T18:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131828.log 2023-11-30T18:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr: 90.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-30T18:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116528.log 2023-11-30T18:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139299.log.gz 2023-11-30T18:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.139401.log: /var/log/ceph/ceph-client.admin.131828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139101.log 2023-11-30T18:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.139401.log.gz 2023-11-30T18:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.116528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122620.log 2023-11-30T18:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.131828.log.gz 2023-11-30T18:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.116528.log.gz 2023-11-30T18:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.139101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110969.log 2023-11-30T18:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.139101.log.gz 2023-11-30T18:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.122620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118399.log 2023-11-30T18:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.110969.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.122620.log.gz 2023-11-30T18:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139611.log 2023-11-30T18:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.110969.log.gz 2023-11-30T18:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.118399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98090.log 2023-11-30T18:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.118399.log.gz 2023-11-30T18:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.139611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129846.log 2023-11-30T18:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.98090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120340.log 2023-11-30T18:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.139611.log.gz 2023-11-30T18:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98090.log.gz 2023-11-30T18:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.129846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130056.log 2023-11-30T18:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129846.log.gz 2023-11-30T18:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.120340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123436.log 2023-11-30T18:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.130056.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.120340.log.gzgzip 2023-11-30T18:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.133925.log 2023-11-30T18:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.123436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141188.log 2023-11-30T18:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.133925.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.130056.log.gz 2023-11-30T18:42:20.233 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.123436.log.gz 2023-11-30T18:42:20.233 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106201.log 2023-11-30T18:42:20.233 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.133925.log.gz 2023-11-30T18:42:20.233 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.141188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102769.log 2023-11-30T18:42:20.233 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.141188.log.gz 2023-11-30T18:42:20.233 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.106201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103233.log 2023-11-30T18:42:20.233 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.102769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122920.log 2023-11-30T18:42:20.233 INFO:teuthology.orchestra.run.smithi049.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.106201.log.gz 2023-11-30T18:42:20.233 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.103233.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.102769.log.gz 2023-11-30T18:42:20.233 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136398.log 2023-11-30T18:42:20.233 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.103233.log.gz 2023-11-30T18:42:20.233 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.122920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104092.log 2023-11-30T18:42:20.233 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.136398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95073.log 2023-11-30T18:42:20.233 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.122920.log.gz 2023-11-30T18:42:20.233 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.104092.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.136398.log.gz 2023-11-30T18:42:20.233 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142415.log 2023-11-30T18:42:20.234 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104092.log.gz 2023-11-30T18:42:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.95073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131688.log 2023-11-30T18:42:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.142415.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-30T18:42:20.234 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95073.log.gz 2023-11-30T18:42:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.131688.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.142415.log.gz 2023-11-30T18:42:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129046.log 2023-11-30T18:42:20.234 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.131688.log.gz 2023-11-30T18:42:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95459.log 2023-11-30T18:42:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.129046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128056.log 2023-11-30T18:42:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.95459.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.129046.log.gz 2023-11-30T18:42:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138876.log 2023-11-30T18:42:20.234 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95459.log.gz 2023-11-30T18:42:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.128056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117967.log 2023-11-30T18:42:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.138876.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.128056.log.gz 2023-11-30T18:42:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95241.log 2023-11-30T18:42:20.235 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.138876.log.gz 2023-11-30T18:42:20.235 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.117967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106810.log 2023-11-30T18:42:20.235 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98573.log 2023-11-30T18:42:20.235 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.95241.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117967.log.gz 2023-11-30T18:42:20.235 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.106810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139191.log 2023-11-30T18:42:20.235 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95241.log.gz 2023-11-30T18:42:20.235 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110834.log 2023-11-30T18:42:20.235 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.98573.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.106810.log.gz 2023-11-30T18:42:20.235 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.139191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132342.log 2023-11-30T18:42:20.235 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98573.log.gz 2023-11-30T18:42:20.235 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107950.log 2023-11-30T18:42:20.235 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.110834.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.139191.log.gz 2023-11-30T18:42:20.235 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.132342.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.110834.log.gz 2023-11-30T18:42:20.235 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130014.log 2023-11-30T18:42:20.235 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119442.log 2023-11-30T18:42:20.235 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.107950.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.132342.log.gz 2023-11-30T18:42:20.236 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.130014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101341.log 2023-11-30T18:42:20.236 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.107950.log.gz 2023-11-30T18:42:20.236 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135905.log 2023-11-30T18:42:20.236 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5%/var/log/ceph/ceph-client.admin.119442.log: -- replaced with /var/log/ceph/ceph-client.admin.130014.log.gz 2023-11-30T18:42:20.236 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.101341.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.119442.log.gz 2023-11-30T18:42:20.236 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127055.log 2023-11-30T18:42:20.236 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131419.log 2023-11-30T18:42:20.236 INFO:teuthology.orchestra.run.smithi049.stderr: 87.0%/var/log/ceph/ceph-client.admin.135905.log: -- replaced with /var/log/ceph/ceph-client.admin.101341.log.gz 2023-11-30T18:42:20.236 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.127055.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.135905.log.gz 2023-11-30T18:42:20.236 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129004.log 2023-11-30T18:42:20.236 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98970.log 2023-11-30T18:42:20.236 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.131419.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.127055.log.gz 2023-11-30T18:42:20.236 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.129004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131268.log 2023-11-30T18:42:20.236 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.131419.log.gz 2023-11-30T18:42:20.236 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140886.log 2023-11-30T18:42:20.237 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8%/var/log/ceph/ceph-client.admin.98970.log: -- replaced with /var/log/ceph/ceph-client.admin.129004.log.gz 2023-11-30T18:42:20.237 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.131268.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98970.log.gz 2023-11-30T18:42:20.237 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111767.log 2023-11-30T18:42:20.237 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142050.log 2023-11-30T18:42:20.237 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.140886.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.131268.log.gz 2023-11-30T18:42:20.237 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.111767.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.140886.log.gz 2023-11-30T18:42:20.237 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95669.log 2023-11-30T18:42:20.237 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108274.log 2023-11-30T18:42:20.237 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.142050.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111767.log.gz 2023-11-30T18:42:20.237 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.95669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100352.log 2023-11-30T18:42:20.237 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.142050.log.gz 2023-11-30T18:42:20.237 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99592.log 2023-11-30T18:42:20.237 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.108274.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95669.log.gz 2023-11-30T18:42:20.237 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.100352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96005.log 2023-11-30T18:42:20.237 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108274.log.gz 2023-11-30T18:42:20.237 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102400.log 2023-11-30T18:42:20.238 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.99592.log: /var/log/ceph/ceph-client.admin.96005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131646.log 2023-11-30T18:42:20.238 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.99592.log.gz 2023-11-30T18:42:20.238 INFO:teuthology.orchestra.run.smithi049.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.100352.log.gz 2023-11-30T18:42:20.238 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.102400.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96005.log.gz 2023-11-30T18:42:20.238 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108526.log 2023-11-30T18:42:20.238 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.102400.log.gz 2023-11-30T18:42:20.238 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128502.log 2023-11-30T18:42:20.238 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.131646.log: /var/log/ceph/ceph-client.admin.108526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122878.log 2023-11-30T18:42:20.238 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.131646.log.gz 2023-11-30T18:42:20.238 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.108526.log.gz 2023-11-30T18:42:20.238 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.128502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96215.log 2023-11-30T18:42:20.238 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90304.log 2023-11-30T18:42:20.238 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.122878.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.128502.log.gz 2023-11-30T18:42:20.238 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.96215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120508.log 2023-11-30T18:42:20.238 INFO:teuthology.orchestra.run.smithi049.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.122878.log.gz 2023-11-30T18:42:20.239 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131135.log 2023-11-30T18:42:20.239 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.90304.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.96215.log.gz 2023-11-30T18:42:20.239 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.120508.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.90304.log.gz 2023-11-30T18:42:20.239 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100820.log 2023-11-30T18:42:20.239 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135464.log 2023-11-30T18:42:20.239 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0%/var/log/ceph/ceph-client.admin.131135.log: -- replaced with /var/log/ceph/ceph-client.admin.120508.log.gz 2023-11-30T18:42:20.239 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.100820.log: gzip 87.8%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.131135.log.gz-- 2023-11-30T18:42:20.239 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.118653.log 2023-11-30T18:42:20.239 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110480.log 2023-11-30T18:42:20.239 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.135464.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.100820.log.gz 2023-11-30T18:42:20.239 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.118653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135005.log 2023-11-30T18:42:20.239 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.135464.log.gz 2023-11-30T18:42:20.239 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113640.log 2023-11-30T18:42:20.239 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.110480.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.118653.log.gz 2023-11-30T18:42:20.239 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.135005.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110480.log.gz 2023-11-30T18:42:20.239 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112886.log 2023-11-30T18:42:20.240 INFO:teuthology.orchestra.run.smithi049.stderr:gzip /var/log/ceph/ceph-client.admin.113640.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.100142.log 2023-11-30T18:42:20.240 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.135005.log.gz 2023-11-30T18:42:20.240 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.112886.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113640.log.gz 2023-11-30T18:42:20.240 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135947.log 2023-11-30T18:42:20.240 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.112886.log.gz 2023-11-30T18:42:20.240 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95753.log 2023-11-30T18:42:20.240 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.100142.log: /var/log/ceph/ceph-client.admin.135947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98405.log 2023-11-30T18:42:20.240 INFO:teuthology.orchestra.run.smithi049.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100142.log.gz 2023-11-30T18:42:20.240 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.135947.log.gz 2023-11-30T18:42:20.240 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.95753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119291.log 2023-11-30T18:42:20.240 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.98405.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95753.log.gz 2023-11-30T18:42:20.240 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135140.log 2023-11-30T18:42:20.240 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98405.log.gz 2023-11-30T18:42:20.240 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.119291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142092.log 2023-11-30T18:42:20.240 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143355.log 2023-11-30T18:42:20.240 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.135140.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.119291.log.gz 2023-11-30T18:42:20.241 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.142092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114193.log 2023-11-30T18:42:20.241 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.135140.log.gz 2023-11-30T18:42:20.241 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106157.log 2023-11-30T18:42:20.241 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.143355.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.142092.log.gz 2023-11-30T18:42:20.241 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.114193.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.143355.log.gz 2023-11-30T18:42:20.241 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113924.log 2023-11-30T18:42:20.241 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97417.log 2023-11-30T18:42:20.241 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114193.log.gz 2023-11-30T18:42:20.241 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.106157.log: /var/log/ceph/ceph-client.admin.113924.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.106157.log.gz 2023-11-30T18:42:20.241 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107866.log 2023-11-30T18:42:20.241 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136692.log 2023-11-30T18:42:20.241 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.97417.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.113924.log.gz 2023-11-30T18:42:20.241 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.107866.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97417.log.gz 2023-11-30T18:42:20.241 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111725.log 2023-11-30T18:42:20.241 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129412.log 2023-11-30T18:42:20.241 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.107866.log.gz 2023-11-30T18:42:20.242 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.136692.log: /var/log/ceph/ceph-client.admin.111725.log: gzip -5 88.8%--verbose -- replaced with /var/log/ceph/ceph-client.admin.136692.log.gz-- 2023-11-30T18:42:20.242 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.95325.log 2023-11-30T18:42:20.242 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95837.log 2023-11-30T18:42:20.242 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.129412.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.111725.log.gz 2023-11-30T18:42:20.242 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.95325.log: 88.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.129412.log.gz--verbose 2023-11-30T18:42:20.242 INFO:teuthology.orchestra.run.smithi049.stderr:-- /var/log/ceph/ceph-client.0.108232.log 2023-11-30T18:42:20.242 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94569.log 2023-11-30T18:42:20.242 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.95837.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.95325.log.gz 2023-11-30T18:42:20.242 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.108232.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95837.log.gz 2023-11-30T18:42:20.242 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141515.log 2023-11-30T18:42:20.242 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.108232.log.gz 2023-11-30T18:42:20.242 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.94569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123480.log 2023-11-30T18:42:20.242 INFO:teuthology.orchestra.run.smithi049.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.94569.log.gz 2023-11-30T18:42:20.242 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.141515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135598.log 2023-11-30T18:42:20.242 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108568.log 2023-11-30T18:42:20.243 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.141515.log.gz 2023-11-30T18:42:20.243 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.123480.log: /var/log/ceph/ceph-client.admin.135598.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.123480.log.gzgzip 2023-11-30T18:42:20.243 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.121919.log 2023-11-30T18:42:20.243 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119834.log 2023-11-30T18:42:20.243 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.108568.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.135598.log.gz 2023-11-30T18:42:20.243 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.121919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133130.log 2023-11-30T18:42:20.243 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108568.log.gz 2023-11-30T18:42:20.243 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99848.log 2023-11-30T18:42:20.243 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.119834.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.121919.log.gz 2023-11-30T18:42:20.243 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.133130.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.119834.log.gz 2023-11-30T18:42:20.243 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97375.log 2023-11-30T18:42:20.243 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110925.log 2023-11-30T18:42:20.243 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.99848.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.133130.log.gz 2023-11-30T18:42:20.243 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.97375.log: gzip 87.9%-5 -- replaced with /var/log/ceph/ceph-client.admin.99848.log.gz--verbose 2023-11-30T18:42:20.243 INFO:teuthology.orchestra.run.smithi049.stderr:-- /var/log/ceph/ceph-client.admin.130633.log 2023-11-30T18:42:20.244 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139359.log 2023-11-30T18:42:20.244 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.110925.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97375.log.gz 2023-11-30T18:42:20.244 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.130633.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110925.log.gz 2023-11-30T18:42:20.244 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141002.log 2023-11-30T18:42:20.244 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97543.log 2023-11-30T18:42:20.244 INFO:teuthology.orchestra.run.smithi049.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.130633.log.gz 2023-11-30T18:42:20.244 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.139359.log: /var/log/ceph/ceph-client.admin.141002.log: 87.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.139359.log.gz-5 2023-11-30T18:42:20.244 INFO:teuthology.orchestra.run.smithi049.stderr:--verbose -- /var/log/ceph/ceph-client.admin.142218.log 2023-11-30T18:42:20.244 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94466.log 2023-11-30T18:42:20.244 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.97543.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.141002.log.gz 2023-11-30T18:42:20.244 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.142218.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97543.log.gz 2023-11-30T18:42:20.244 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115049.log 2023-11-30T18:42:20.244 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142583.log 2023-11-30T18:42:20.244 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.94466.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.142218.log.gz 2023-11-30T18:42:20.244 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.115049.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.94466.log.gz 2023-11-30T18:42:20.244 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136253.log 2023-11-30T18:42:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117069.log 2023-11-30T18:42:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.142583.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.115049.log.gz 2023-11-30T18:42:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.136253.log: 87.7%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.142583.log.gz 2023-11-30T18:42:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:--verbose -- /var/log/ceph/ceph-client.admin.114050.log 2023-11-30T18:42:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115860.log 2023-11-30T18:42:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.117069.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.136253.log.gz 2023-11-30T18:42:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.114050.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.117069.log.gz 2023-11-30T18:42:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142709.log 2023-11-30T18:42:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139485.log 2023-11-30T18:42:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.115860.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114050.log.gz 2023-11-30T18:42:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.142709.log: gzip 87.9%-5 -- replaced with /var/log/ceph/ceph-client.admin.115860.log.gz--verbose 2023-11-30T18:42:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:-- /var/log/ceph/ceph-client.admin.106873.log 2023-11-30T18:42:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135229.log 2023-11-30T18:42:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.139485.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.142709.log.gz 2023-11-30T18:42:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.106873.log: gzip 87.5%-5 -- replaced with /var/log/ceph/ceph-client.admin.139485.log.gz--verbose 2023-11-30T18:42:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:-- /var/log/ceph/ceph-client.admin.113818.log 2023-11-30T18:42:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99764.log 2023-11-30T18:42:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.135229.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.106873.log.gz 2023-11-30T18:42:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.113818.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.135229.log.gz 2023-11-30T18:42:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111809.log 2023-11-30T18:42:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94033.log 2023-11-30T18:42:20.246 INFO:teuthology.orchestra.run.smithi049.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.113818.log.gz 2023-11-30T18:42:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.99764.log: /var/log/ceph/ceph-client.admin.111809.log: gzip 88.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.99764.log.gz--verbose 2023-11-30T18:42:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:-- /var/log/ceph/ceph-client.admin.129269.log 2023-11-30T18:42:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130508.log 2023-11-30T18:42:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.94033.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111809.log.gz 2023-11-30T18:42:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.129269.log: gzip -5 --verbose -- 88.0%/var/log/ceph/ceph-client.admin.111166.log 2023-11-30T18:42:20.246 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94033.log.gz 2023-11-30T18:42:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114965.log 2023-11-30T18:42:20.247 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.130508.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129269.log.gz 2023-11-30T18:42:20.247 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.111166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113966.log 2023-11-30T18:42:20.247 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.130508.log.gz 2023-11-30T18:42:20.247 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111851.log 2023-11-30T18:42:20.247 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.111166.log.gz 2023-11-30T18:42:20.247 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.114965.log: /var/log/ceph/ceph-client.admin.113966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141945.log 2023-11-30T18:42:20.247 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.114965.log.gz 2023-11-30T18:42:20.247 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123971.log 2023-11-30T18:42:20.247 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.111851.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113966.log.gz 2023-11-30T18:42:20.247 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.141945.log: gzip 87.3%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.111851.log.gz-- 2023-11-30T18:42:20.247 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.121210.log 2023-11-30T18:42:20.247 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139751.log 2023-11-30T18:42:20.247 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.123971.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141945.log.gz 2023-11-30T18:42:20.247 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.121210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132078.log 2023-11-30T18:42:20.247 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.123971.log.gz 2023-11-30T18:42:20.248 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106642.log 2023-11-30T18:42:20.248 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.139751.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.121210.log.gz 2023-11-30T18:42:20.248 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.132078.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.139751.log.gz 2023-11-30T18:42:20.248 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136440.log 2023-11-30T18:42:20.248 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108316.log 2023-11-30T18:42:20.248 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.106642.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.132078.log.gz 2023-11-30T18:42:20.248 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.136440.log: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.106642.log.gz 2023-11-30T18:42:20.248 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.107092.log 2023-11-30T18:42:20.248 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136117.log 2023-11-30T18:42:20.248 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.108316.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.136440.log.gz 2023-11-30T18:42:20.248 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.107092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128878.log 2023-11-30T18:42:20.248 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108316.log.gz 2023-11-30T18:42:20.248 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124486.log 2023-11-30T18:42:20.248 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.136117.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107092.log.gz 2023-11-30T18:42:20.249 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.128878.log: gzip -5 --verbose -- 87.8%/var/log/ceph/ceph-client.admin.132848.log 2023-11-30T18:42:20.249 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.136117.log.gz 2023-11-30T18:42:20.249 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119158.log 2023-11-30T18:42:20.249 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.124486.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.128878.log.gz 2023-11-30T18:42:20.249 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.132848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142134.log 2023-11-30T18:42:20.249 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.124486.log.gz 2023-11-30T18:42:20.249 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93949.log 2023-11-30T18:42:20.249 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.119158.log: /var/log/ceph/ceph-client.admin.142134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117461.log 2023-11-30T18:42:20.249 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.119158.log.gz 2023-11-30T18:42:20.249 INFO:teuthology.orchestra.run.smithi049.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.132848.log.gz 2023-11-30T18:42:20.249 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.93949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141304.log 2023-11-30T18:42:20.249 INFO:teuthology.orchestra.run.smithi049.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.142134.log.gz 2023-11-30T18:42:20.249 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.117461.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.93949.log.gz 2023-11-30T18:42:20.249 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118527.log 2023-11-30T18:42:20.249 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135422.log 2023-11-30T18:42:20.249 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.117461.log.gz 2023-11-30T18:42:20.250 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.141304.log: /var/log/ceph/ceph-client.admin.118527.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-30T18:42:20.250 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.141304.log.gz 2023-11-30T18:42:20.250 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114755.log 2023-11-30T18:42:20.250 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.135422.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118527.log.gz 2023-11-30T18:42:20.250 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-osd.3.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.135422.log.gz 2023-11-30T18:42:20.250 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141567.log 2023-11-30T18:42:20.250 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122305.log 2023-11-30T18:42:20.250 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.114755.log: /var/log/ceph/ceph-client.admin.141567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131461.log 2023-11-30T18:42:20.250 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114755.log.gz 2023-11-30T18:42:20.250 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.122305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100742.log 2023-11-30T18:42:20.250 INFO:teuthology.orchestra.run.smithi049.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.141567.log.gz 2023-11-30T18:42:20.250 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.122305.log.gz 2023-11-30T18:42:20.250 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.131461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128268.log 2023-11-30T18:42:20.250 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95543.log 2023-11-30T18:42:20.250 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.100742.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.131461.log.gz 2023-11-30T18:42:20.251 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.128268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132386.log 2023-11-30T18:42:20.251 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.100742.log.gz 2023-11-30T18:42:20.251 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.95543.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128268.log.gz 2023-11-30T18:42:20.251 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123066.log 2023-11-30T18:42:20.251 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.132386.log: gzip -5 --verbose -- 88.3%/var/log/ceph/ceph-client.admin.93991.log 2023-11-30T18:42:20.251 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95543.log.gz 2023-11-30T18:42:20.251 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.132386.log.gz 2023-11-30T18:42:20.251 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.123066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136734.log 2023-11-30T18:42:20.251 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.93991.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.123066.log.gz 2023-11-30T18:42:20.251 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140181.log 2023-11-30T18:42:20.251 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93991.log.gz 2023-11-30T18:42:20.251 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.136734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136650.log 2023-11-30T18:42:20.251 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.140181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102827.log 2023-11-30T18:42:20.251 INFO:teuthology.orchestra.run.smithi049.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.136734.log.gz 2023-11-30T18:42:20.251 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.136650.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.140181.log.gz 2023-11-30T18:42:20.251 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120298.log 2023-11-30T18:42:20.252 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.136650.log.gz 2023-11-30T18:42:20.252 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.102827.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-30T18:42:20.252 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.120298.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.102827.log.gz 2023-11-30T18:42:20.252 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107740.log 2023-11-30T18:42:20.252 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.120298.log.gz 2023-11-30T18:42:20.252 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94905.log 2023-11-30T18:42:20.252 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.107740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140087.log 2023-11-30T18:42:20.252 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.94905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138780.log 2023-11-30T18:42:20.252 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107740.log.gz 2023-11-30T18:42:20.252 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.140087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142541.log 2023-11-30T18:42:20.252 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94905.log.gz 2023-11-30T18:42:20.252 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.138780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115733.log 2023-11-30T18:42:20.252 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140087.log.gz 2023-11-30T18:42:20.252 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.142541.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.138780.log.gz 2023-11-30T18:42:20.252 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128180.log 2023-11-30T18:42:20.252 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4%/var/log/ceph/ceph-client.admin.115733.log: -- replaced with /var/log/ceph/ceph-client.admin.142541.log.gz 2023-11-30T18:42:20.253 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.128180.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.115733.log.gz 2023-11-30T18:42:20.253 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105970.log 2023-11-30T18:42:20.253 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.128180.log.gz 2023-11-30T18:42:20.253 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129762.log 2023-11-30T18:42:20.253 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.105970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113549.log 2023-11-30T18:42:20.253 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.129762.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105970.log.gz 2023-11-30T18:42:20.253 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.113549.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.129762.log.gz 2023-11-30T18:42:20.253 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.113549.log.gz 2023-11-30T18:42:20.253 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96425.log 2023-11-30T18:42:20.253 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104342.log 2023-11-30T18:42:20.253 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.96425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113458.log 2023-11-30T18:42:20.253 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.104342.log: /var/log/ceph/ceph-client.admin.113458.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104342.log.gz 2023-11-30T18:42:20.253 INFO:teuthology.orchestra.run.smithi049.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.96425.log.gz 2023-11-30T18:42:20.253 INFO:teuthology.orchestra.run.smithi049.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.113458.log.gz 2023-11-30T18:42:20.253 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112386.log 2023-11-30T18:42:20.254 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116797.log 2023-11-30T18:42:20.254 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.112386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131376.log 2023-11-30T18:42:20.254 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.116797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117799.log 2023-11-30T18:42:20.254 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.112386.log.gz 2023-11-30T18:42:20.254 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.131376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98699.log 2023-11-30T18:42:20.254 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.116797.log.gz 2023-11-30T18:42:20.254 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.117799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123310.log 2023-11-30T18:42:20.254 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.131376.log.gz 2023-11-30T18:42:20.254 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.98699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139058.log 2023-11-30T18:42:20.254 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117799.log.gz 2023-11-30T18:42:20.254 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98699.log.gz 2023-11-30T18:42:20.254 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.123310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123268.log 2023-11-30T18:42:20.254 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.139058.log: gzip 87.3%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.123310.log.gz-- 2023-11-30T18:42:20.254 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.132120.log 2023-11-30T18:42:20.254 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.123268.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.139058.log.gz 2023-11-30T18:42:20.255 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.132120.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.123268.log.gz 2023-11-30T18:42:20.255 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.132120.log.gz 2023-11-30T18:42:20.255 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97669.log 2023-11-30T18:42:20.255 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.130296.log 2023-11-30T18:42:20.255 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.97669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135640.log 2023-11-30T18:42:20.255 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.130296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129972.log 2023-11-30T18:42:20.255 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97669.log.gz 2023-11-30T18:42:20.255 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.130296.log.gz 2023-11-30T18:42:20.255 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.135640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99890.log 2023-11-30T18:42:20.255 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.129972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139236.log 2023-11-30T18:42:20.255 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.135640.log.gz 2023-11-30T18:42:20.255 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.99890.log: gzip 88.2%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.129972.log.gz-- 2023-11-30T18:42:20.255 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.137058.log 2023-11-30T18:42:20.255 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.139236.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99890.log.gz 2023-11-30T18:42:20.255 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.137058.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.139236.log.gz 2023-11-30T18:42:20.256 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.137058.log.gz 2023-11-30T18:42:20.256 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128920.log 2023-11-30T18:42:20.256 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137352.log 2023-11-30T18:42:20.256 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.128920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123352.log 2023-11-30T18:42:20.256 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.137352.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.128920.log.gz 2023-11-30T18:42:20.256 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.123352.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.137352.log.gz 2023-11-30T18:42:20.256 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.123352.log.gz 2023-11-30T18:42:20.256 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110647.log 2023-11-30T18:42:20.256 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-30T18:42:20.256 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.110647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100993.log 2023-11-30T18:42:20.256 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114415.log 2023-11-30T18:42:20.256 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.110647.log.gz 2023-11-30T18:42:20.256 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.100993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128681.log 2023-11-30T18:42:20.256 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.114415.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.100993.log.gz 2023-11-30T18:42:20.256 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.128681.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114415.log.gz 2023-11-30T18:42:20.256 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.128681.log.gz 2023-11-30T18:42:20.257 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111981.log 2023-11-30T18:42:20.257 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110602.log 2023-11-30T18:42:20.257 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.111981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96341.log 2023-11-30T18:42:20.257 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.110602.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111981.log.gz 2023-11-30T18:42:20.257 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.96341.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110602.log.gz 2023-11-30T18:42:20.257 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96341.log.gz 2023-11-30T18:42:20.257 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99508.log 2023-11-30T18:42:20.257 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111937.log 2023-11-30T18:42:20.257 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.99508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111104.log 2023-11-30T18:42:20.257 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.111937.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.99508.log.gz 2023-11-30T18:42:20.257 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.111104.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111937.log.gz 2023-11-30T18:42:20.257 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111104.log.gz 2023-11-30T18:42:20.257 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124614.log 2023-11-30T18:42:20.257 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117757.log 2023-11-30T18:42:20.257 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.124614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113097.log 2023-11-30T18:42:20.257 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.117757.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.124614.log.gz 2023-11-30T18:42:20.258 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.113097.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.117757.log.gz 2023-11-30T18:42:20.258 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113097.log.gz 2023-11-30T18:42:20.258 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95879.log 2023-11-30T18:42:20.258 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120214.log 2023-11-30T18:42:20.258 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.95879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136776.log 2023-11-30T18:42:20.258 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.120214.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.95879.log.gz 2023-11-30T18:42:20.258 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.136776.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.120214.log.gz 2023-11-30T18:42:20.258 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136776.log.gz 2023-11-30T18:42:20.258 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107482.log 2023-11-30T18:42:20.258 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117153.log 2023-11-30T18:42:20.258 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.107482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98867.log 2023-11-30T18:42:20.258 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.117153.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.107482.log.gz 2023-11-30T18:42:20.258 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.98867.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.117153.log.gz 2023-11-30T18:42:20.258 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98867.log.gz 2023-11-30T18:42:20.258 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140001.log 2023-11-30T18:42:20.259 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113881.log 2023-11-30T18:42:20.259 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.140001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142457.log 2023-11-30T18:42:20.259 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.113881.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140001.log.gz 2023-11-30T18:42:20.259 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.142457.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.113881.log.gz 2023-11-30T18:42:20.259 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.142457.log.gz 2023-11-30T18:42:20.259 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94510.log 2023-11-30T18:42:20.259 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120170.log 2023-11-30T18:42:20.259 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.94510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95795.log 2023-11-30T18:42:20.293 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.120170.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94510.log.gz 2023-11-30T18:42:20.293 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.120170.log.gz 2023-11-30T18:42:20.293 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.95795.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.95795.log.gz 2023-11-30T18:42:20.293 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106426.log 2023-11-30T18:42:20.293 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107440.log 2023-11-30T18:42:20.293 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.106426.log: /var/log/ceph/ceph-client.admin.107440.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.106426.log.gz 2023-11-30T18:42:20.293 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103117.log 2023-11-30T18:42:20.293 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.107440.log.gz 2023-11-30T18:42:20.294 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120382.log 2023-11-30T18:42:20.294 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.103117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132806.log 2023-11-30T18:42:20.294 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.120382.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103117.log.gz 2023-11-30T18:42:20.294 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.132806.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.120382.log.gz 2023-11-30T18:42:20.294 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.132806.log.gz 2023-11-30T18:42:20.294 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118977.log 2023-11-30T18:42:20.294 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124061.log 2023-11-30T18:42:20.294 INFO:teuthology.orchestra.run.smithi049.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-30T18:42:20.294 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111683.log 2023-11-30T18:42:20.294 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.118977.log: /var/log/ceph/ceph-client.admin.124061.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118977.log.gz 2023-11-30T18:42:20.294 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.111683.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.124061.log.gz 2023-11-30T18:42:20.294 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111683.log.gz 2023-11-30T18:42:20.294 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.97333.log 2023-11-30T18:42:20.294 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107568.log 2023-11-30T18:42:20.294 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.2.97333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94611.log 2023-11-30T18:42:20.295 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.97333.log.gz 2023-11-30T18:42:20.295 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95367.log 2023-11-30T18:42:20.295 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.107568.log: /var/log/ceph/ceph-client.admin.94611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99298.log 2023-11-30T18:42:20.295 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107568.log.gz 2023-11-30T18:42:20.295 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0%/var/log/ceph/ceph-client.admin.95367.log: -- replaced with /var/log/ceph/ceph-client.admin.94611.log.gz 2023-11-30T18:42:20.295 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132258.log 2023-11-30T18:42:20.295 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95367.log.gz 2023-11-30T18:42:20.295 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.99298.log: 88.2%/var/log/ceph/ceph-client.admin.132258.log: -- replaced with /var/log/ceph/ceph-client.admin.99298.log.gz 2023-11-30T18:42:20.295 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.132258.log.gz 2023-11-30T18:42:20.295 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136161.log 2023-11-30T18:42:20.295 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114669.log 2023-11-30T18:42:20.295 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.136161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96089.log 2023-11-30T18:42:20.295 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.136161.log.gz 2023-11-30T18:42:20.295 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.114669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142667.log 2023-11-30T18:42:20.295 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99090.log 2023-11-30T18:42:20.295 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.96089.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114669.log.gz 2023-11-30T18:42:20.296 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.142667.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96089.log.gz 2023-11-30T18:42:20.296 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.99090.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.142667.log.gz 2023-11-30T18:42:20.296 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99090.log.gz 2023-11-30T18:42:20.296 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112604.log 2023-11-30T18:42:20.296 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112048.log 2023-11-30T18:42:20.296 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.112604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142919.log 2023-11-30T18:42:20.296 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.112604.log.gz 2023-11-30T18:42:20.296 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.112048.log: /var/log/ceph/ceph-client.admin.142919.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.112048.log.gz 2023-11-30T18:42:20.296 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.142919.log.gz 2023-11-30T18:42:20.296 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114583.log 2023-11-30T18:42:20.296 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133967.log 2023-11-30T18:42:20.296 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.114583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122161.log 2023-11-30T18:42:20.296 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.133967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115217.log 2023-11-30T18:42:20.296 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.114583.log.gz 2023-11-30T18:42:20.296 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.122161.log: gzip 89.2%-5 -- replaced with /var/log/ceph/ceph-client.admin.133967.log.gz--verbose 2023-11-30T18:42:20.296 INFO:teuthology.orchestra.run.smithi049.stderr:-- /var/log/ceph/ceph-client.admin.99974.log 2023-11-30T18:42:20.297 INFO:teuthology.orchestra.run.smithi049.stderr:gzip /var/log/ceph/ceph-client.admin.115217.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.114839.log 2023-11-30T18:42:20.297 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122161.log.gz 2023-11-30T18:42:20.297 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.99974.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.115217.log.gz 2023-11-30T18:42:20.297 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.114839.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99974.log.gz 2023-11-30T18:42:20.297 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114839.log.gz 2023-11-30T18:42:20.297 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130690.log 2023-11-30T18:42:20.297 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114457.log 2023-11-30T18:42:20.297 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.130690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102585.log 2023-11-30T18:42:20.297 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.130690.log.gz 2023-11-30T18:42:20.297 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.114457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118291.log 2023-11-30T18:42:20.297 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117841.log 2023-11-30T18:42:20.297 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.102585.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.114457.log.gz 2023-11-30T18:42:20.297 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.118291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94779.log 2023-11-30T18:42:20.297 INFO:teuthology.orchestra.run.smithi049.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.102585.log.gz 2023-11-30T18:42:20.297 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.117841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97921.log 2023-11-30T18:42:20.298 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118291.log.gz 2023-11-30T18:42:20.298 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.94779.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.117841.log.gz 2023-11-30T18:42:20.298 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6%/var/log/ceph/ceph-client.admin.97921.log: -- replaced with /var/log/ceph/ceph-client.admin.94779.log.gz 2023-11-30T18:42:20.298 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97921.log.gz 2023-11-30T18:42:20.298 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121127.log 2023-11-30T18:42:20.298 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99382.log 2023-11-30T18:42:20.298 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.121127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113683.log 2023-11-30T18:42:20.298 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.99382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122440.log 2023-11-30T18:42:20.298 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.121127.log.gz 2023-11-30T18:42:20.298 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.113683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139443.log 2023-11-30T18:42:20.298 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99382.log.gz 2023-11-30T18:42:20.298 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99806.log 2023-11-30T18:42:20.298 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.122440.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.113683.log.gz 2023-11-30T18:42:20.298 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.139443.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.122440.log.gz 2023-11-30T18:42:20.298 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.99806.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.139443.log.gz 2023-11-30T18:42:20.298 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99806.log.gz 2023-11-30T18:42:20.299 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143213.log 2023-11-30T18:42:20.299 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102669.log 2023-11-30T18:42:20.299 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.143213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118611.log 2023-11-30T18:42:20.299 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.143213.log.gz 2023-11-30T18:42:20.299 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.102669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116169.log 2023-11-30T18:42:20.299 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129584.log 2023-11-30T18:42:20.299 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.118611.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.102669.log.gz 2023-11-30T18:42:20.299 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.116169.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.118611.log.gz 2023-11-30T18:42:20.299 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.129584.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.116169.log.gz 2023-11-30T18:42:20.299 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.129584.log.gz 2023-11-30T18:42:20.299 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96299.log 2023-11-30T18:42:20.299 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107304.log 2023-11-30T18:42:20.299 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.96299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131313.log 2023-11-30T18:42:20.299 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96299.log.gz 2023-11-30T18:42:20.299 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.107304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111377.log 2023-11-30T18:42:20.300 INFO:teuthology.orchestra.run.smithi049.stderr:gzip /var/log/ceph/ceph-client.admin.131313.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.111893.log 2023-11-30T18:42:20.300 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107304.log.gz 2023-11-30T18:42:20.300 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.111377.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.131313.log.gz 2023-11-30T18:42:20.300 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.111893.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111377.log.gz 2023-11-30T18:42:20.300 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105596.log 2023-11-30T18:42:20.300 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111893.log.gz 2023-11-30T18:42:20.300 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138922.log 2023-11-30T18:42:20.300 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.105596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141899.log 2023-11-30T18:42:20.300 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105596.log.gz 2023-11-30T18:42:20.300 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.138922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128636.log 2023-11-30T18:42:20.300 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131994.log 2023-11-30T18:42:20.300 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.141899.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.138922.log.gz 2023-11-30T18:42:20.300 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.128636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141749.log 2023-11-30T18:42:20.300 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141899.log.gz 2023-11-30T18:42:20.300 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.131994.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.128636.log.gz 2023-11-30T18:42:20.300 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.131994.log.gz 2023-11-30T18:42:20.301 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.141749.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.141749.log.gz 2023-11-30T18:42:20.301 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111601.log 2023-11-30T18:42:20.301 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94653.log 2023-11-30T18:42:20.301 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.111601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131178.log 2023-11-30T18:42:20.301 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.94653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95963.log 2023-11-30T18:42:20.301 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.111601.log.gz 2023-11-30T18:42:20.301 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94653.log.gz 2023-11-30T18:42:20.301 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.131178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111419.log 2023-11-30T18:42:20.301 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.95963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128786.log 2023-11-30T18:42:20.301 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.131178.log.gz 2023-11-30T18:42:20.301 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.111419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136866.log 2023-11-30T18:42:20.301 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95963.log.gz 2023-11-30T18:42:20.301 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.128786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100676.log 2023-11-30T18:42:20.301 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111419.log.gz 2023-11-30T18:42:20.301 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.136866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135184.log 2023-11-30T18:42:20.301 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.128786.log.gz 2023-11-30T18:42:20.302 INFO:teuthology.orchestra.run.smithi049.stderr:gzip /var/log/ceph/ceph-client.admin.100676.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.98216.log 2023-11-30T18:42:20.302 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.136866.log.gz 2023-11-30T18:42:20.302 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.135184.log: gzip -5 --verbose 87.9%-- /var/log/ceph/ceph-client.admin.98825.log -- replaced with /var/log/ceph/ceph-client.admin.100676.log.gz 2023-11-30T18:42:20.302 INFO:teuthology.orchestra.run.smithi049.stderr: 2023-11-30T18:42:20.302 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.98216.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.135184.log.gz 2023-11-30T18:42:20.302 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98216.log.gz 2023-11-30T18:42:20.302 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.98825.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98825.log.gz 2023-11-30T18:42:20.302 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119526.log 2023-11-30T18:42:20.302 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101225.log 2023-11-30T18:42:20.302 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.119526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117589.log 2023-11-30T18:42:20.302 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.101225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101483.log 2023-11-30T18:42:20.302 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.119526.log.gz 2023-11-30T18:42:20.302 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.117589.log: gzip 87.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.101225.log.gz-- 2023-11-30T18:42:20.302 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.119916.log 2023-11-30T18:42:20.302 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143003.log 2023-11-30T18:42:20.302 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.101483.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.117589.log.gz 2023-11-30T18:42:20.303 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.119916.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101483.log.gz 2023-11-30T18:42:20.303 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.143003.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.119916.log.gz 2023-11-30T18:42:20.303 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.143003.log.gzgzip 2023-11-30T18:42:20.303 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.124415.log 2023-11-30T18:42:20.303 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97753.log 2023-11-30T18:42:20.303 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.124415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100016.log 2023-11-30T18:42:20.303 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.124415.log.gz 2023-11-30T18:42:20.303 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.97753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98927.log 2023-11-30T18:42:20.303 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122252.log 2023-11-30T18:42:20.303 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.100016.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.97753.log.gz 2023-11-30T18:42:20.303 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.98927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113406.log 2023-11-30T18:42:20.303 INFO:teuthology.orchestra.run.smithi049.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.100016.log.gz 2023-11-30T18:42:20.303 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.122252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129454.log 2023-11-30T18:42:20.303 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98927.log.gz 2023-11-30T18:42:20.303 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.113406.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.122252.log.gz 2023-11-30T18:42:20.303 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.129454.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.113406.log.gz 2023-11-30T18:42:20.304 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.129454.log.gz 2023-11-30T18:42:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135703.log 2023-11-30T18:42:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141426.log 2023-11-30T18:42:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.135703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103291.log 2023-11-30T18:42:20.304 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.135703.log.gz 2023-11-30T18:42:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.141426.log: /var/log/ceph/ceph-client.admin.103291.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.141426.log.gz 2023-11-30T18:42:20.304 INFO:teuthology.orchestra.run.smithi049.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.103291.log.gz 2023-11-30T18:42:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140519.log 2023-11-30T18:42:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102885.log 2023-11-30T18:42:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.140519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119067.log 2023-11-30T18:42:20.304 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.140519.log.gz 2023-11-30T18:42:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.102885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94863.log 2023-11-30T18:42:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119610.log 2023-11-30T18:42:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.119067.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.102885.log.gz 2023-11-30T18:42:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.94863.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.119067.log.gz 2023-11-30T18:42:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.119610.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94863.log.gz 2023-11-30T18:42:20.305 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.119610.log.gz 2023-11-30T18:42:20.305 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95283.log 2023-11-30T18:42:20.305 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93790.log 2023-11-30T18:42:20.305 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.95283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122530.log 2023-11-30T18:42:20.305 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.95283.log.gz 2023-11-30T18:42:20.305 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.93790.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-30T18:42:20.305 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123394.log 2023-11-30T18:42:20.305 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.122530.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93790.log.gz 2023-11-30T18:42:20.305 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-osd.0.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.122530.log.gz 2023-11-30T18:42:20.305 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.123394.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.123394.log.gz 2023-11-30T18:42:20.305 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105344.log 2023-11-30T18:42:20.305 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129540.log 2023-11-30T18:42:20.305 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.105344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136482.log 2023-11-30T18:42:20.305 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.129540.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105344.log.gz 2023-11-30T18:42:20.305 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.136482.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.129540.log.gz 2023-11-30T18:42:20.306 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.136482.log.gz 2023-11-30T18:42:20.306 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141702.log 2023-11-30T18:42:20.306 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107348.log 2023-11-30T18:42:20.306 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.141702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135275.log 2023-11-30T18:42:20.306 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.107348.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.141702.log.gz 2023-11-30T18:42:20.306 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.135275.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107348.log.gz 2023-11-30T18:42:20.306 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.135275.log.gz 2023-11-30T18:42:20.306 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102543.log 2023-11-30T18:42:20.306 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128366.log 2023-11-30T18:42:20.306 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.102543.log: /var/log/ceph/ceph-client.admin.128366.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102543.log.gz 2023-11-30T18:42:20.306 INFO:teuthology.orchestra.run.smithi049.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.128366.log.gz 2023-11-30T18:42:20.306 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107050.log 2023-11-30T18:42:20.306 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107654.log 2023-11-30T18:42:20.306 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.107050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131750.log 2023-11-30T18:42:20.306 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.107654.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107050.log.gz 2023-11-30T18:42:20.306 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.131750.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.107654.log.gz 2023-11-30T18:42:20.307 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.131750.log.gz 2023-11-30T18:42:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123144.log 2023-11-30T18:42:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98783.log 2023-11-30T18:42:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.123144.log: /var/log/ceph/ceph-client.admin.98783.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.123144.log.gz 2023-11-30T18:42:20.307 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.98783.log.gz 2023-11-30T18:42:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94737.log 2023-11-30T18:42:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101399.log 2023-11-30T18:42:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.94737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143129.log 2023-11-30T18:42:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.101399.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94737.log.gz 2023-11-30T18:42:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.143129.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101399.log.gz 2023-11-30T18:42:20.307 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.143129.log.gz 2023-11-30T18:42:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132680.log 2023-11-30T18:42:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135863.log 2023-11-30T18:42:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.132680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128224.log 2023-11-30T18:42:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.135863.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.132680.log.gz 2023-11-30T18:42:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.128224.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.135863.log.gz 2023-11-30T18:42:20.308 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128224.log.gz 2023-11-30T18:42:20.308 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140603.log 2023-11-30T18:42:20.308 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123658.log 2023-11-30T18:42:20.308 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.140603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123803.log 2023-11-30T18:42:20.308 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.123658.log: /var/log/ceph/ceph-client.admin.123803.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.123658.log.gz 2023-11-30T18:42:20.308 INFO:teuthology.orchestra.run.smithi049.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.140603.log.gz 2023-11-30T18:42:20.308 INFO:teuthology.orchestra.run.smithi049.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.123803.log.gz 2023-11-30T18:42:20.308 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106246.log 2023-11-30T18:42:20.308 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142499.log 2023-11-30T18:42:20.308 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.106246.log: /var/log/ceph/ceph-client.admin.142499.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106246.log.gz 2023-11-30T18:42:20.308 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.142499.log.gz 2023-11-30T18:42:20.308 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139833.log 2023-11-30T18:42:20.308 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135514.log 2023-11-30T18:42:20.308 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.139833.log: /var/log/ceph/ceph-client.admin.135514.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.139833.log.gz 2023-11-30T18:42:20.308 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.135514.log.gz 2023-11-30T18:42:20.308 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116570.log 2023-11-30T18:42:20.309 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106111.log 2023-11-30T18:42:20.309 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.116570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140351.log 2023-11-30T18:42:20.309 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.106111.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.116570.log.gz 2023-11-30T18:42:20.309 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.140351.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.106111.log.gz 2023-11-30T18:42:20.309 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.140351.log.gz 2023-11-30T18:42:20.309 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116713.log 2023-11-30T18:42:20.309 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122962.log 2023-11-30T18:42:20.309 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.116713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114541.log 2023-11-30T18:42:20.309 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.122962.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116713.log.gz 2023-11-30T18:42:20.309 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.114541.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.122962.log.gz 2023-11-30T18:42:20.309 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114541.log.gz 2023-11-30T18:42:20.309 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135050.log 2023-11-30T18:42:20.309 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112090.log 2023-11-30T18:42:20.309 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.135050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119756.log 2023-11-30T18:42:20.309 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.112090.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.135050.log.gz 2023-11-30T18:42:20.309 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.119756.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.112090.log.gz 2023-11-30T18:42:20.310 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.119756.log.gz 2023-11-30T18:42:20.310 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94076.log 2023-11-30T18:42:20.310 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118333.log 2023-11-30T18:42:20.310 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116123.log 2023-11-30T18:42:20.310 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.94076.log: /var/log/ceph/ceph-client.admin.118333.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94076.log.gz 2023-11-30T18:42:20.310 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.116123.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.118333.log.gz 2023-11-30T18:42:20.310 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116123.log.gz 2023-11-30T18:42:20.310 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102501.log 2023-11-30T18:42:20.310 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129804.log 2023-11-30T18:42:20.310 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.102501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95921.log 2023-11-30T18:42:20.310 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.129804.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.102501.log.gz 2023-11-30T18:42:20.310 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.95921.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.129804.log.gz 2023-11-30T18:42:20.310 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.95921.log.gz 2023-11-30T18:42:20.310 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142835.log 2023-11-30T18:42:20.310 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119694.log 2023-11-30T18:42:20.310 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.142835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106558.log 2023-11-30T18:42:20.311 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.119694.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.142835.log.gz 2023-11-30T18:42:20.311 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.106558.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.119694.log.gz 2023-11-30T18:42:20.311 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.106558.log.gz 2023-11-30T18:42:20.311 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133316.log 2023-11-30T18:42:20.311 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.100592.log 2023-11-30T18:42:20.311 INFO:teuthology.orchestra.run.smithi049.stderr:gzip /var/log/ceph/ceph-client.admin.133316.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.141230.log 2023-11-30T18:42:20.311 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.100592.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.100592.log.gz 2023-11-30T18:42:20.311 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.133316.log.gz 2023-11-30T18:42:20.311 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.141230.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.141230.log.gz 2023-11-30T18:42:20.311 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100268.log 2023-11-30T18:42:20.311 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101659.log 2023-11-30T18:42:20.311 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.100268.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.84000.log 2023-11-30T18:42:20.311 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.101659.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100268.log.gz 2023-11-30T18:42:20.311 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph.tmp-client.admin.84000.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101659.log.gz 2023-11-30T18:42:20.311 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.84000.log.gz 2023-11-30T18:42:20.311 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142625.log 2023-11-30T18:42:20.312 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132554.log 2023-11-30T18:42:20.312 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.142625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101051.log 2023-11-30T18:42:20.312 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.132554.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.142625.log.gz 2023-11-30T18:42:20.312 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.101051.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.132554.log.gz 2023-11-30T18:42:20.312 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.101051.log.gz 2023-11-30T18:42:20.312 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101533.log 2023-11-30T18:42:20.312 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120958.log 2023-11-30T18:42:20.312 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.101533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112218.log 2023-11-30T18:42:20.312 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.120958.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101533.log.gz 2023-11-30T18:42:20.312 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.112218.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.120958.log.gz 2023-11-30T18:42:20.312 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112218.log.gz 2023-11-30T18:42:20.312 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117715.log 2023-11-30T18:42:20.312 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134320.log 2023-11-30T18:42:20.312 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.117715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135556.log 2023-11-30T18:42:20.312 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.134320.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.117715.log.gz 2023-11-30T18:42:20.312 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.134320.log.gz 2023-11-30T18:42:20.313 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.135556.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.135556.log.gz 2023-11-30T18:42:20.313 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111013.log 2023-11-30T18:42:20.313 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118863.log 2023-11-30T18:42:20.313 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.111013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123887.log 2023-11-30T18:42:20.313 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.118863.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.111013.log.gz 2023-11-30T18:42:20.313 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.123887.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.118863.log.gz 2023-11-30T18:42:20.313 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.123887.log.gz 2023-11-30T18:42:20.313 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-30T18:42:20.313 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114923.log 2023-11-30T18:42:20.313 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98447.log 2023-11-30T18:42:20.313 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.114923.log: /var/log/ceph/ceph-client.admin.98447.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.114923.log.gz 2023-11-30T18:42:20.313 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.98447.log.gz 2023-11-30T18:42:20.313 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114008.log 2023-11-30T18:42:20.313 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116671.log 2023-11-30T18:42:20.313 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.114008.log: /var/log/ceph/ceph-client.admin.116671.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114008.log.gz 2023-11-30T18:42:20.313 INFO:teuthology.orchestra.run.smithi049.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.116671.log.gz 2023-11-30T18:42:20.314 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128546.log 2023-11-30T18:42:20.314 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136073.log 2023-11-30T18:42:20.314 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.128546.log: /var/log/ceph/ceph-client.admin.136073.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.128546.log.gz 2023-11-30T18:42:20.314 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.136073.log.gz 2023-11-30T18:42:20.314 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107992.log 2023-11-30T18:42:20.314 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136295.log 2023-11-30T18:42:20.314 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.107992.log: /var/log/ceph/ceph-client.admin.136295.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.136295.log.gz 2023-11-30T18:42:20.314 INFO:teuthology.orchestra.run.smithi049.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.107992.log.gz 2023-11-30T18:42:20.314 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130447.log 2023-11-30T18:42:20.314 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106015.log 2023-11-30T18:42:20.314 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.130447.log: /var/log/ceph/ceph-client.admin.106015.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.130447.log.gz 2023-11-30T18:42:20.314 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.106015.log.gz 2023-11-30T18:42:20.314 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132470.log 2023-11-30T18:42:20.314 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142373.log 2023-11-30T18:42:20.314 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.132470.log: /var/log/ceph/ceph-client.admin.142373.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.132470.log.gz 2023-11-30T18:42:20.315 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.142373.log.gz 2023-11-30T18:42:20.315 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116483.log 2023-11-30T18:42:20.315 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121066.log 2023-11-30T18:42:20.315 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.116483.log: /var/log/ceph/ceph-client.admin.121066.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116483.log.gz 2023-11-30T18:42:20.315 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.121066.log.gz 2023-11-30T18:42:20.315 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110691.log 2023-11-30T18:42:20.315 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113504.log 2023-11-30T18:42:20.315 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.110691.log: /var/log/ceph/ceph-client.admin.113504.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.110691.log.gz 2023-11-30T18:42:20.315 INFO:teuthology.orchestra.run.smithi049.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.113504.log.gz 2023-11-30T18:42:20.315 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138824.log 2023-11-30T18:42:20.315 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107782.log 2023-11-30T18:42:20.315 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.138824.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.138824.log.gz 2023-11-30T18:42:20.315 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106336.log 2023-11-30T18:42:20.315 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.107782.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.107782.log.gz 2023-11-30T18:42:20.315 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.106336.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.106336.log.gz 2023-11-30T18:42:20.315 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104593.log 2023-11-30T18:42:20.316 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101743.log 2023-11-30T18:42:20.316 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.104593.log: /var/log/ceph/ceph-client.admin.101743.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104593.log.gz 2023-11-30T18:42:20.316 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101743.log.gz 2023-11-30T18:42:20.316 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94989.log 2023-11-30T18:42:20.316 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117323.log 2023-11-30T18:42:20.316 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.94989.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94989.log.gz/var/log/ceph/ceph-client.admin.117323.log: 2023-11-30T18:42:20.316 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.117323.log.gz 2023-11-30T18:42:20.316 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140309.log 2023-11-30T18:42:20.316 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132512.log 2023-11-30T18:42:20.316 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.140309.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140309.log.gz 2023-11-30T18:42:20.316 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137142.log 2023-11-30T18:42:20.316 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.132512.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.132512.log.gz 2023-11-30T18:42:20.316 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97585.log 2023-11-30T18:42:20.316 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.137142.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.137142.log.gz 2023-11-30T18:42:20.316 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114713.log 2023-11-30T18:42:20.316 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.97585.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97585.log.gz 2023-11-30T18:42:20.317 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.114713.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.114713.log.gz 2023-11-30T18:42:20.317 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128411.log 2023-11-30T18:42:20.317 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117237.log 2023-11-30T18:42:20.317 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.128411.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.128411.log.gz 2023-11-30T18:42:20.317 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.117237.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.117237.log.gz 2023-11-30T18:42:20.317 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96975.log 2023-11-30T18:42:20.317 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138735.log 2023-11-30T18:42:20.317 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.96975.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96975.log.gz 2023-11-30T18:42:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114499.log 2023-11-30T18:42:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.138735.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.138735.log.gz 2023-11-30T18:42:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.114499.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.114499.log.gz 2023-11-30T18:42:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131223.log 2023-11-30T18:42:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101785.log 2023-11-30T18:42:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.131223.log: /var/log/ceph/ceph-client.admin.101785.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.131223.log.gz 2023-11-30T18:42:20.326 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101785.log.gz 2023-11-30T18:42:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139527.log 2023-11-30T18:42:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113728.log 2023-11-30T18:42:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.139527.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139527.log.gz/var/log/ceph/ceph-client.admin.113728.log: 2023-11-30T18:42:20.326 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113728.log.gz 2023-11-30T18:42:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132596.log 2023-11-30T18:42:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99722.log 2023-11-30T18:42:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.132596.log: /var/log/ceph/ceph-client.admin.99722.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.132596.log.gz 2023-11-30T18:42:20.327 INFO:teuthology.orchestra.run.smithi049.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.99722.log.gz 2023-11-30T18:42:20.327 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113362.log 2023-11-30T18:42:20.327 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107134.log 2023-11-30T18:42:20.327 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.113362.log: /var/log/ceph/ceph-client.admin.107134.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.113362.log.gz 2023-11-30T18:42:20.327 INFO:teuthology.orchestra.run.smithi049.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.107134.log.gz 2023-11-30T18:42:20.327 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131545.log 2023-11-30T18:42:20.327 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94332.log 2023-11-30T18:42:20.327 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.131545.log: /var/log/ceph/ceph-client.admin.94332.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.131545.log.gz 2023-11-30T18:42:20.327 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94332.log.gz 2023-11-30T18:42:20.327 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103059.log 2023-11-30T18:42:20.327 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117547.log 2023-11-30T18:42:20.327 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.103059.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.103059.log.gz 2023-11-30T18:42:20.327 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98615.log 2023-11-30T18:42:20.327 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.117547.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.117547.log.gz 2023-11-30T18:42:20.327 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137208.log 2023-11-30T18:42:20.328 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.98615.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.98615.log.gz 2023-11-30T18:42:20.328 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.137208.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.137208.log.gz 2023-11-30T18:42:20.328 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95585.log 2023-11-30T18:42:20.328 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139011.log 2023-11-30T18:42:20.328 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.95585.log: /var/log/ceph/ceph-client.admin.139011.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.95585.log.gz 2023-11-30T18:42:20.328 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.139011.log.gz 2023-11-30T18:42:20.328 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111335.log 2023-11-30T18:42:20.328 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136356.log 2023-11-30T18:42:20.328 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.111335.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111335.log.gz 2023-11-30T18:42:20.328 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.136356.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.136356.log.gz 2023-11-30T18:42:20.328 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101575.log 2023-11-30T18:42:20.328 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119958.log 2023-11-30T18:42:20.328 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.101575.log: /var/log/ceph/ceph-client.admin.119958.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101575.log.gz 2023-11-30T18:42:20.328 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.119958.log.gz 2023-11-30T18:42:20.328 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117883.log 2023-11-30T18:42:20.328 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112260.log 2023-11-30T18:42:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.117883.log: /var/log/ceph/ceph-client.admin.112260.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.117883.log.gz 2023-11-30T18:42:20.329 INFO:teuthology.orchestra.run.smithi049.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.112260.log.gz 2023-11-30T18:42:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107218.log 2023-11-30T18:42:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112428.log 2023-11-30T18:42:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.107218.log: 89.1%/var/log/ceph/ceph-client.admin.112428.log: -- replaced with /var/log/ceph/ceph-client.admin.107218.log.gz 2023-11-30T18:42:20.329 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112428.log.gz 2023-11-30T18:42:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142877.log 2023-11-30T18:42:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93748.log 2023-11-30T18:42:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.142877.log: /var/log/ceph/ceph-client.admin.93748.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.142877.log.gz 2023-11-30T18:42:20.329 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93748.log.gz 2023-11-30T18:42:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130591.log 2023-11-30T18:42:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116979.log 2023-11-30T18:42:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.130591.log: /var/log/ceph/ceph-client.admin.116979.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.130591.log.gz 2023-11-30T18:42:20.329 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.116979.log.gz 2023-11-30T18:42:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140043.log 2023-11-30T18:42:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129634.log 2023-11-30T18:42:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.140043.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.140043.log.gz 2023-11-30T18:42:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113036.log 2023-11-30T18:42:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.129634.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.129634.log.gz 2023-11-30T18:42:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.113036.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.113036.log.gz 2023-11-30T18:42:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112176.log 2023-11-30T18:42:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100226.log 2023-11-30T18:42:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.112176.log: /var/log/ceph/ceph-client.admin.100226.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.112176.log.gz 2023-11-30T18:42:20.330 INFO:teuthology.orchestra.run.smithi049.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.100226.log.gz 2023-11-30T18:42:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141854.log 2023-11-30T18:42:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106684.log 2023-11-30T18:42:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.141854.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.141854.log.gz 2023-11-30T18:42:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.106684.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.106684.log.gz 2023-11-30T18:42:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141613.log 2023-11-30T18:42:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112302.log 2023-11-30T18:42:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.141613.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.141613.log.gz 2023-11-30T18:42:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.112302.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.112302.log.gz 2023-11-30T18:42:20.331 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120084.log 2023-11-30T18:42:20.331 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113773.log 2023-11-30T18:42:20.331 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.120084.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.120084.log.gz 2023-11-30T18:42:20.331 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.113773.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113773.log.gz 2023-11-30T18:42:20.331 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107908.log 2023-11-30T18:42:20.331 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135380.log 2023-11-30T18:42:20.331 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.107908.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107908.log.gz 2023-11-30T18:42:20.332 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141063.log 2023-11-30T18:42:20.332 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.135380.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.135380.log.gz 2023-11-30T18:42:20.332 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.141063.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.141063.log.gz 2023-11-30T18:42:20.332 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98047.log 2023-11-30T18:42:20.332 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.98047.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98047.log.gz 2023-11-30T18:42:20.332 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130857.log 2023-11-30T18:42:20.332 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115007.log 2023-11-30T18:42:20.333 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.130857.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.130857.log.gz 2023-11-30T18:42:20.333 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.115007.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115007.log.gz 2023-11-30T18:42:20.333 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138523.log 2023-11-30T18:42:20.333 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130953.log 2023-11-30T18:42:20.334 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.138523.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.138523.log.gz 2023-11-30T18:42:20.334 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134818.log 2023-11-30T18:42:20.335 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.130953.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.130953.log.gz 2023-11-30T18:42:20.335 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.134818.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.134818.log.gz 2023-11-30T18:42:20.335 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116071.log 2023-11-30T18:42:20.336 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.140843.log 2023-11-30T18:42:20.336 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.116071.log: /var/log/ceph/ceph-client.0.140843.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.116071.log.gz 2023-11-30T18:42:20.337 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.140843.log.gz 2023-11-30T18:42:20.337 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94202.log 2023-11-30T18:42:20.337 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107610.log 2023-11-30T18:42:20.338 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.94202.log: /var/log/ceph/ceph-client.admin.107610.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94202.log.gz 2023-11-30T18:42:20.338 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.107610.log.gz 2023-11-30T18:42:20.338 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136524.log 2023-11-30T18:42:20.341 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119399.log 2023-11-30T18:42:20.341 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.136524.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136524.log.gz 2023-11-30T18:42:20.342 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122710.log 2023-11-30T18:42:20.342 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.119399.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.119399.log.gz 2023-11-30T18:42:20.343 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.122710.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.122710.log.gz 2023-11-30T18:42:20.343 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123524.log 2023-11-30T18:42:20.343 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139959.log 2023-11-30T18:42:20.343 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.123524.log: /var/log/ceph/ceph-client.admin.139959.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.123524.log.gz 2023-11-30T18:42:20.343 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139959.log.gz 2023-11-30T18:42:20.343 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131587.log 2023-11-30T18:42:20.343 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.124253.log 2023-11-30T18:42:20.344 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.131587.log: /var/log/ceph/ceph-client.0.124253.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.131587.log.gz 2023-11-30T18:42:20.344 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.124253.log.gz 2023-11-30T18:42:20.344 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95031.log 2023-11-30T18:42:20.344 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114134.log 2023-11-30T18:42:20.344 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.95031.log: /var/log/ceph/ceph-client.admin.114134.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95031.log.gz 2023-11-30T18:42:20.345 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114134.log.gz 2023-11-30T18:42:20.345 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116258.log 2023-11-30T18:42:20.345 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96946.log 2023-11-30T18:42:20.345 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.116258.log: /var/log/ceph/ceph-client.0.96946.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.116258.log.gz 2023-11-30T18:42:20.345 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.96946.log.gz 2023-11-30T18:42:20.345 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114881.log 2023-11-30T18:42:20.346 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137394.log 2023-11-30T18:42:20.346 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.114881.log: /var/log/ceph/ceph-client.admin.137394.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.114881.log.gz 2023-11-30T18:42:20.347 INFO:teuthology.orchestra.run.smithi049.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.137394.log.gz 2023-11-30T18:42:20.347 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-30T18:42:20.347 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108382.log 2023-11-30T18:42:20.357 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.108382.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108382.log.gz 2023-11-30T18:42:20.357 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130104.log 2023-11-30T18:42:20.357 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.130104.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.130104.log.gz 2023-11-30T18:42:20.357 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143255.log 2023-11-30T18:42:20.357 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.143255.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.143255.log.gz 2023-11-30T18:42:20.357 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117631.log 2023-11-30T18:42:20.357 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.117631.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.117631.log.gz 2023-11-30T18:42:20.357 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116348.log 2023-11-30T18:42:20.358 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.116348.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116348.log.gz 2023-11-30T18:42:20.358 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105846.log 2023-11-30T18:42:20.358 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.105846.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105846.log.gz 2023-11-30T18:42:20.380 INFO:teuthology.orchestra.run.smithi049.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-30T18:42:20.810 INFO:teuthology.orchestra.run.smithi115.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-30T18:42:20.963 INFO:teuthology.orchestra.run.smithi049.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-30T18:42:21.710 INFO:teuthology.orchestra.run.smithi115.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-30T18:42:21.806 INFO:teuthology.orchestra.run.smithi115.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-30T18:42:22.011 INFO:teuthology.orchestra.run.smithi115.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-30T18:42:22.508 INFO:teuthology.orchestra.run.smithi115.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-30T18:42:22.677 INFO:teuthology.orchestra.run.smithi049.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-30T18:42:22.677 INFO:teuthology.orchestra.run.smithi049.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-30T18:42:22.735 INFO:teuthology.orchestra.run.smithi115.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-30T18:42:22.802 INFO:teuthology.orchestra.run.smithi115.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-30T18:42:22.968 INFO:teuthology.orchestra.run.smithi115.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-30T18:42:22.970 INFO:teuthology.orchestra.run.smithi115.stderr: 2023-11-30T18:42:22.970 INFO:teuthology.orchestra.run.smithi115.stderr:real 0m2.903s 2023-11-30T18:42:22.970 INFO:teuthology.orchestra.run.smithi115.stderr:user 0m16.097s 2023-11-30T18:42:22.970 INFO:teuthology.orchestra.run.smithi115.stderr:sys 0m0.597s 2023-11-30T18:42:23.061 INFO:teuthology.orchestra.run.smithi049.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-30T18:42:23.315 INFO:teuthology.orchestra.run.smithi049.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-30T18:42:23.401 INFO:teuthology.orchestra.run.smithi049.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-30T18:42:23.403 INFO:teuthology.orchestra.run.smithi049.stderr: 2023-11-30T18:42:23.403 INFO:teuthology.orchestra.run.smithi049.stderr:real 0m3.375s 2023-11-30T18:42:23.403 INFO:teuthology.orchestra.run.smithi049.stderr:user 0m14.672s 2023-11-30T18:42:23.403 INFO:teuthology.orchestra.run.smithi049.stderr:sys 0m0.928s 2023-11-30T18:42:23.404 INFO:tasks.ceph:Archiving logs... 2023-11-30T18:42:23.404 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472115/remote/smithi049/log 2023-11-30T18:42:23.405 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-30T18:42:26.033 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472115/remote/smithi115/log 2023-11-30T18:42:26.033 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-30T18:42:28.127 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-30T18:42:28.138 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-30T18:42:28.138 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-30T18:42:28.144 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-30T18:42:28.226 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-30T18:42:28.237 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-30T18:42:28.238 DEBUG:teuthology.orchestra.run.smithi049:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-30T18:42:28.240 DEBUG:teuthology.orchestra.run.smithi115:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-30T18:42:28.254 INFO:teuthology.orchestra.run.smithi049.stderr:bash: ntpq: command not found 2023-11-30T18:42:28.255 INFO:teuthology.orchestra.run.smithi115.stderr:bash: ntpq: command not found 2023-11-30T18:42:28.258 INFO:teuthology.orchestra.run.smithi049.stdout:210 Number of sources = 4 2023-11-30T18:42:28.258 INFO:teuthology.orchestra.run.smithi049.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-30T18:42:28.258 INFO:teuthology.orchestra.run.smithi049.stdout:=============================================================================== 2023-11-30T18:42:28.258 INFO:teuthology.orchestra.run.smithi049.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 28 +370us[ +362us] +/- 89ms 2023-11-30T18:42:28.258 INFO:teuthology.orchestra.run.smithi049.stdout:^* hv02.front.sepia.ceph.com 3 6 377 26 -245us[ -253us] +/- 62ms 2023-11-30T18:42:28.258 INFO:teuthology.orchestra.run.smithi049.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 -15us[ -15us] +/- 64ms 2023-11-30T18:42:28.258 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-11-30T18:42:28.259 INFO:teuthology.orchestra.run.smithi115.stdout:210 Number of sources = 4 2023-11-30T18:42:28.259 INFO:teuthology.orchestra.run.smithi115.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-30T18:42:28.259 INFO:teuthology.orchestra.run.smithi115.stdout:=============================================================================== 2023-11-30T18:42:28.259 INFO:teuthology.orchestra.run.smithi115.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 26 +316us[ +304us] +/- 89ms 2023-11-30T18:42:28.259 INFO:teuthology.orchestra.run.smithi115.stdout:^* hv02.front.sepia.ceph.com 3 6 377 24 -239us[ -252us] +/- 63ms 2023-11-30T18:42:28.259 INFO:teuthology.orchestra.run.smithi115.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 24 +9580ns[-2840ns] +/- 64ms 2023-11-30T18:42:28.259 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-11-30T18:42:28.260 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-30T18:42:28.270 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-30T18:42:28.271 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-30T18:42:28.294 DEBUG:teuthology.orchestra.run.smithi049:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-30T18:42:28.347 DEBUG:teuthology.orchestra.run.smithi115:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-30T18:42:28.446 DEBUG:teuthology.orchestra.run.smithi049:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-30T18:42:28.475 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-30T18:42:28.476 DEBUG:teuthology.orchestra.run.smithi115:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-30T18:42:28.506 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-30T18:42:28.507 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-30T18:42:28.517 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-30T18:42:28.547 INFO:teuthology.task.internal:Duration was 6459.442538 seconds 2023-11-30T18:42:28.547 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-30T18:42:28.577 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-30T18:42:28.577 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-30T18:42:28.579 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-30T18:42:28.624 INFO:teuthology.orchestra.run.smithi115.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-30T18:42:28.627 INFO:teuthology.orchestra.run.smithi049.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-30T18:42:28.841 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-30T18:42:28.841 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi049.front.sepia.ceph.com 2023-11-30T18:42:28.842 DEBUG:teuthology.orchestra.run.smithi049:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-30T18:42:28.863 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi115.front.sepia.ceph.com 2023-11-30T18:42:28.863 DEBUG:teuthology.orchestra.run.smithi115:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-30T18:42:28.883 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-30T18:42:28.883 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-30T18:42:28.906 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-30T18:42:28.963 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-30T18:42:28.964 DEBUG:teuthology.orchestra.run.smithi049:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-30T18:42:28.966 DEBUG:teuthology.orchestra.run.smithi115:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-30T18:42:29.083 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-30T18:42:29.093 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-30T18:42:29.093 DEBUG:teuthology.orchestra.run.smithi049:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-30T18:42:29.119 DEBUG:teuthology.orchestra.run.smithi115:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-30T18:42:29.143 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-30T18:42:29.155 DEBUG:teuthology.orchestra.run.smithi049:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-30T18:42:29.162 DEBUG:teuthology.orchestra.run.smithi115:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-30T18:42:29.184 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = core 2023-11-30T18:42:29.208 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = core 2023-11-30T18:42:29.222 DEBUG:teuthology.orchestra.run.smithi049:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-30T18:42:29.252 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-30T18:42:29.253 DEBUG:teuthology.orchestra.run.smithi115:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-30T18:42:29.275 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-30T18:42:29.276 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-30T18:42:29.286 INFO:teuthology.task.internal:Transferring archived files... 2023-11-30T18:42:29.287 DEBUG:teuthology.misc:Transferring archived files from smithi049:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472115/remote/smithi049 2023-11-30T18:42:29.287 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-30T18:42:29.329 DEBUG:teuthology.misc:Transferring archived files from smithi115:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472115/remote/smithi115 2023-11-30T18:42:29.329 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-30T18:42:29.368 INFO:teuthology.task.internal:Removing archive directory... 2023-11-30T18:42:29.369 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-30T18:42:29.371 DEBUG:teuthology.orchestra.run.smithi115:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-30T18:42:29.416 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-30T18:42:29.428 INFO:teuthology.task.internal:Not uploading archives. 2023-11-30T18:42:29.429 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-30T18:42:29.453 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-30T18:42:29.453 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-30T18:42:29.456 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-30T18:42:29.468 INFO:teuthology.orchestra.run.smithi049.stdout: 262176 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 30 18:42 /home/ubuntu/cephtest 2023-11-30T18:42:29.471 INFO:teuthology.orchestra.run.smithi115.stdout: 262153 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 30 18:42 /home/ubuntu/cephtest 2023-11-30T18:42:29.473 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-30T18:42:29.487 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-30T18:42:29.606 INFO:teuthology.nuke:Checking targets against current locks 2023-11-30T18:42:29.633 DEBUG:teuthology.nuke:shortname: smithi049 2023-11-30T18:42:29.634 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-30T18:42:29.654 DEBUG:teuthology.nuke:shortname: smithi115 2023-11-30T18:42:29.654 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-30T18:42:29.657 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472115', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-30 16:44:45.201688', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGWtCmC456vXsvM+Bn7/qfysPkkMTNCua9SIzCCxA1MXbgbTPPxwvKFdbdC7RzEivFCAkkaTQnUfUN/5fjWYzcs='} 2023-11-30T18:42:29.678 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472115', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-30 16:44:45.203314', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL2YEHmGElf6OzvqTeRZfpqQ6SDdXrnJF0LarYALtARSHEsaJ+XW3FHDs8f855sCsmA+Xlv2nPq3H1Fzj/Dqg8s='} 2023-11-30T18:42:29.708 INFO:teuthology.orchestra.console.smithi049:Power off 2023-11-30T18:42:29.709 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-30T18:42:29.730 INFO:teuthology.orchestra.console.smithi115:Power off 2023-11-30T18:42:29.730 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-30T18:42:29.740 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2023-11-30T18:42:29.741 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T18:42:29.753 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2023-11-30T18:42:29.753 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T18:42:29.764 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-11-30T18:42:29.778 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2023-11-30T18:42:33.766 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T18:42:33.779 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T18:42:33.875 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-11-30T18:42:33.889 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2023-11-30T18:42:37.876 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T18:42:37.890 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T18:42:37.986 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-11-30T18:42:37.998 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2023-11-30T18:42:38.088 INFO:teuthology.orchestra.console.smithi049:Power off completed 2023-11-30T18:42:42.002 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T18:42:42.112 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2023-11-30T18:42:42.212 INFO:teuthology.orchestra.console.smithi115:Power off completed 2023-11-30T18:42:42.317 INFO:teuthology.run:Summary data: description: fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} duration: 6459.442537784576 failure_reason: '"2023-11-30T17:09:24.850485+0000 mon.a (mon.0) 320 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-11-30T18:42:42.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T18:42:42.399 INFO:teuthology.run:FAIL